2023-03-17T07:27:36.548 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3 2023-03-17T07:27:37.267 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} --verbose --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223 -- /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223/orig.config.yaml 2023-03-17T07:27:38.651 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-17T07:27:41.240 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223 branch: wip-pdonnell-testing-20230316.214637 description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7211223' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20230316.214637 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 4aa791bf129eece187e94ddbfa7c2b475588cf0c subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 4aa791bf129eece187e94ddbfa7c2b475588cf0c kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230316.214637 sha1: 4aa791bf129eece187e94ddbfa7c2b475588cf0c owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 4aa791bf129eece187e94ddbfa7c2b475588cf0c sleep_before_teardown: 0 suite: fs:workload suite_branch: wip-pdonnell-testing-20230316.214637 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4aa791bf129eece187e94ddbfa7c2b475588cf0c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 7f7f7c33a372789d0252bbbcd5798300b0f044d0 timestamp: 2023-03-16_23:18:17 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4737 2023-03-17T07:27:43.305 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa; will attempt to use it 2023-03-17T07:27:43.306 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks 2023-03-17T07:27:43.306 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-17T07:27:43.308 INFO:teuthology.task.internal:Checking packages... 2023-03-17T07:27:45.997 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4aa791bf129eece187e94ddbfa7c2b475588cf0c' 2023-03-17T07:27:49.285 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-17T07:27:49.285 INFO:teuthology.packaging:ref: None 2023-03-17T07:27:49.285 INFO:teuthology.packaging:tag: None 2023-03-17T07:27:49.286 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230316.214637 2023-03-17T07:27:49.286 INFO:teuthology.packaging:sha1: 4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:27:49.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230316.214637 2023-03-17T07:27:49.452 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3051.g4aa791bf 2023-03-17T07:27:50.910 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-17T07:27:51.662 INFO:teuthology.task.internal:no buildpackages task found 2023-03-17T07:27:53.366 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-17T07:27:53.373 INFO:teuthology.task.internal:Saving configuration 2023-03-17T07:27:55.023 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-17T07:27:56.314 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-17T07:27:57.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi035.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-17 07:21:31.969948', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-17T07:27:59.958 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-17 07:21:31.966720', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-17T07:28:01.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-17 07:21:31.968816', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-17T07:28:03.422 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-17T07:28:03.433 INFO:teuthology.task.internal:roles: ubuntu@smithi035.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-03-17T07:28:05.752 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-03-17T07:28:05.752 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-03-17T07:28:05.752 INFO:teuthology.run_tasks:Running task console_log... 2023-03-17T07:28:05.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f663b9f7dc0>, signals=[15]) 2023-03-17T07:28:07.435 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-17T07:28:07.443 INFO:teuthology.task.internal:Opening connections... 2023-03-17T07:28:09.709 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T07:28:09.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T07:28:09.782 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-03-17T07:28:12.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T07:28:12.072 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-03-17T07:28:12.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T07:28:13.007 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-17T07:28:13.905 DEBUG:teuthology.orchestra.run.smithi035:> uname -m 2023-03-17T07:28:14.310 INFO:teuthology.orchestra.run.smithi035.stdout:x86_64 2023-03-17T07:28:15.967 DEBUG:teuthology.orchestra.run.smithi035:> cat /etc/os-release 2023-03-17T07:28:15.988 INFO:teuthology.orchestra.run.smithi035.stdout:NAME="Red Hat Enterprise Linux" 2023-03-17T07:28:17.132 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION="8.6 (Ootpa)" 2023-03-17T07:28:17.132 INFO:teuthology.orchestra.run.smithi035.stdout:ID="rhel" 2023-03-17T07:28:17.132 INFO:teuthology.orchestra.run.smithi035.stdout:ID_LIKE="fedora" 2023-03-17T07:28:17.132 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_ID="8.6" 2023-03-17T07:28:17.132 INFO:teuthology.orchestra.run.smithi035.stdout:PLATFORM_ID="platform:el8" 2023-03-17T07:28:17.132 INFO:teuthology.orchestra.run.smithi035.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-17T07:28:17.133 INFO:teuthology.orchestra.run.smithi035.stdout:ANSI_COLOR="0;31" 2023-03-17T07:28:17.133 INFO:teuthology.orchestra.run.smithi035.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-17T07:28:17.133 INFO:teuthology.orchestra.run.smithi035.stdout:HOME_URL="https://www.redhat.com/" 2023-03-17T07:28:17.133 INFO:teuthology.orchestra.run.smithi035.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-17T07:28:17.133 INFO:teuthology.orchestra.run.smithi035.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-17T07:28:17.133 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:28:18.185 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-17T07:28:18.185 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-17T07:28:18.185 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-17T07:28:18.185 INFO:teuthology.orchestra.run.smithi035.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-17T07:28:18.186 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2023-03-17T07:28:18.218 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-03-17T07:28:19.217 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-03-17T07:28:20.373 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-03-17T07:28:20.393 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-03-17T07:28:21.050 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-03-17T07:28:21.050 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-03-17T07:28:21.050 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-03-17T07:28:21.050 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-03-17T07:28:21.050 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-03-17T07:28:21.050 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-17T07:28:21.051 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-17T07:28:21.051 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-03-17T07:28:21.076 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-03-17T07:28:22.247 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-03-17T07:28:24.298 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-03-17T07:28:24.318 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-03-17T07:28:26.531 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-17T07:28:26.532 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-17T07:28:28.043 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-03-17T07:28:28.067 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-17T07:28:29.760 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-17T07:28:30.699 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-17T07:28:31.868 DEBUG:teuthology.orchestra.run.smithi035:> test '!' -e /home/ubuntu/cephtest 2023-03-17T07:28:31.870 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-03-17T07:28:33.716 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-03-17T07:28:35.164 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-17T07:28:36.388 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-17T07:28:37.333 DEBUG:teuthology.orchestra.run.smithi035:> test -z $(ls -A /var/lib/ceph) 2023-03-17T07:28:37.335 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-03-17T07:28:37.675 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-03-17T07:28:38.599 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-17T07:28:39.115 INFO:teuthology.run_tasks:Running task kernel... 2023-03-17T07:28:40.056 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-03-17T07:28:41.044 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-03-17T07:28:41.045 DEBUG:teuthology.orchestra.run.smithi035:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-17T07:28:41.046 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-17T07:28:41.046 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-17T07:28:41.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T07:28:41.694 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-03-17T07:28:42.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T07:28:42.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T07:28:44.236 DEBUG:teuthology.orchestra.run.smithi035:> uname -r 2023-03-17T07:28:44.237 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-03-17T07:28:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-17T07:28:44.238 INFO:teuthology.task.kernel:Running kernel on smithi082: 4.18.0-372.9.1.el8.x86_64 2023-03-17T07:28:44.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2023-03-17T07:28:44.296 INFO:teuthology.orchestra.run.smithi078.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-17T07:28:45.226 INFO:teuthology.task.kernel:Running kernel on smithi078: 4.18.0-372.9.1.el8.x86_64 2023-03-17T07:28:45.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2023-03-17T07:28:45.905 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:28:45.905 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-03-17T07:28:45.906 INFO:teuthology.orchestra.run.smithi035.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-17T07:28:45.906 INFO:teuthology.task.kernel:Running kernel on smithi035: 4.18.0-372.9.1.el8.x86_64 2023-03-17T07:28:45.906 DEBUG:teuthology.orchestra.run.smithi035:> sudo yum install -y kernel 2023-03-17T07:28:51.323 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-03-17T07:28:51.323 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-03-17T07:28:51.323 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 458 kB/s | 24 kB 00:00 2023-03-17T07:28:51.324 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:01 ago on Fri 17 Mar 2023 07:28:50 AM UTC. 2023-03-17T07:28:51.324 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:28:51.324 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-03-17T07:28:51.324 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-03-17T07:28:51.324 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-03-17T07:28:51.635 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-17T07:28:52.775 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 559 kB/s | 24 kB 00:00 2023-03-17T07:28:52.775 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:28:52.775 INFO:teuthology.orchestra.run.smithi035.stdout:Unable to read consumer identity 2023-03-17T07:28:52.776 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-03-17T07:28:52.776 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-03-17T07:28:52.776 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-03-17T07:28:52.777 DEBUG:teuthology.orchestra.run.smithi082:> echo no | sudo yum reinstall kernel || true 2023-03-17T07:28:53.119 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-03-17T07:28:56.260 INFO:teuthology.orchestra.run.smithi035.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-03-17T07:28:56.261 INFO:teuthology.orchestra.run.smithi035.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2023-03-17T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:03 ago on Fri 17 Mar 2023 07:28:50 AM UTC. 2023-03-17T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-17T07:28:56.262 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-17T07:28:56.262 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-03-17T07:28:56.262 INFO:teuthology.orchestra.run.smithi078.stdout:Nothing to do. 2023-03-17T07:28:56.262 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-03-17T07:28:56.263 DEBUG:teuthology.orchestra.run.smithi078:> echo no | sudo yum reinstall kernel || true 2023-03-17T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stderr:Error: No packages marked for reinstall. 2023-03-17T07:28:56.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum reinstall -y kernel || true 2023-03-17T07:28:58.698 INFO:teuthology.orchestra.run.smithi035.stdout:lab-extras 535 kB/s | 24 kB 00:00 2023-03-17T07:29:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:29:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:Unable to read consumer identity 2023-03-17T07:29:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:09 ago on Fri 17 Mar 2023 07:28:50 AM UTC. 2023-03-17T07:29:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-17T07:29:00.132 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:29:01.265 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-03-17T07:29:01.265 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:07 ago on Fri 17 Mar 2023 07:28:52 AM UTC. 2023-03-17T07:29:01.265 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-17T07:29:01.266 INFO:teuthology.orchestra.run.smithi035.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-17T07:29:01.773 INFO:teuthology.orchestra.run.smithi035.stdout:Dependencies resolved. 2023-03-17T07:29:01.773 INFO:teuthology.orchestra.run.smithi035.stdout:Nothing to do. 2023-03-17T07:29:01.773 INFO:teuthology.orchestra.run.smithi035.stdout:Complete! 2023-03-17T07:29:01.774 DEBUG:teuthology.orchestra.run.smithi035:> echo no | sudo yum reinstall kernel || true 2023-03-17T07:29:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:Error: No packages marked for reinstall. 2023-03-17T07:29:02.998 INFO:teuthology.orchestra.run.smithi078.stderr:Error: No packages marked for reinstall. 2023-03-17T07:29:02.998 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel --last | head -n 1 2023-03-17T07:29:02.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum reinstall -y kernel || true 2023-03-17T07:29:04.108 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-17T07:29:05.047 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:29:05.047 INFO:teuthology.orchestra.run.smithi035.stdout:Unable to read consumer identity 2023-03-17T07:29:05.923 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:00:06 ago on Fri 17 Mar 2023 07:28:58 AM UTC. 2023-03-17T07:29:06.071 INFO:teuthology.orchestra.run.smithi035.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-17T07:29:06.072 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:29:06.072 INFO:teuthology.orchestra.run.smithi078.stdout:Unable to read consumer identity 2023-03-17T07:29:06.072 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:00:12 ago on Fri 17 Mar 2023 07:28:52 AM UTC. 2023-03-17T07:29:06.072 INFO:teuthology.orchestra.run.smithi078.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-17T07:29:06.072 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-17T07:29:06.072 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-17T07:29:08.939 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-03-17T07:29:08.939 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-03-17T07:29:08.941 INFO:teuthology.orchestra.run.smithi035.stderr:Error: No packages marked for reinstall. 2023-03-17T07:29:10.193 INFO:teuthology.orchestra.run.smithi078.stderr:Error: No packages marked for reinstall. 2023-03-17T07:29:10.693 DEBUG:teuthology.orchestra.run.smithi035:> sudo yum reinstall -y kernel || true 2023-03-17T07:29:10.694 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel --last | head -n 1 2023-03-17T07:29:10.696 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2023-03-17T07:29:10.696 DEBUG:teuthology.parallel:result is None 2023-03-17T07:29:10.782 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-17T07:29:12.298 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:29:12.298 INFO:teuthology.orchestra.run.smithi035.stdout:Unable to read consumer identity 2023-03-17T07:29:12.298 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:00:13 ago on Fri 17 Mar 2023 07:28:58 AM UTC. 2023-03-17T07:29:12.299 INFO:teuthology.orchestra.run.smithi035.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-17T07:29:12.299 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-17T07:29:12.299 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-17T07:29:12.299 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-03-17T07:29:12.299 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-03-17T07:29:12.300 INFO:teuthology.orchestra.run.smithi035.stderr:Error: No packages marked for reinstall. 2023-03-17T07:29:15.706 DEBUG:teuthology.orchestra.run.smithi035:> rpm -q kernel --last | head -n 1 2023-03-17T07:29:15.739 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2023-03-17T07:29:17.223 INFO:teuthology.orchestra.run.smithi035.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-17T07:29:17.223 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-17T07:29:17.223 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-17T07:29:17.223 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-03-17T07:29:17.223 DEBUG:teuthology.orchestra.run.smithi035:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-03-17T07:29:17.224 DEBUG:teuthology.parallel:result is None 2023-03-17T07:29:17.255 INFO:teuthology.orchestra.run.smithi035.stdout:ttyS1 2023-03-17T07:29:19.183 DEBUG:teuthology.parallel:result is None 2023-03-17T07:29:19.183 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-17T07:29:19.191 INFO:teuthology.task.internal:Creating test directory... 2023-03-17T07:29:20.285 DEBUG:teuthology.orchestra.run.smithi035:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-17T07:29:20.288 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-17T07:29:22.024 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-17T07:29:23.382 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-17T07:29:26.147 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-17T07:29:26.845 INFO:teuthology.task.internal:Creating archive directory... 2023-03-17T07:29:27.701 DEBUG:teuthology.orchestra.run.smithi035:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-17T07:29:27.704 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-17T07:29:28.457 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-17T07:29:29.589 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-17T07:29:30.927 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-17T07:29:32.269 DEBUG:teuthology.orchestra.run.smithi035:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-17T07:29:32.272 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-17T07:29:33.788 INFO:teuthology.orchestra.run.smithi035.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-17T07:29:34.337 INFO:teuthology.orchestra.run.smithi035.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-17T07:29:35.369 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-17T07:29:35.370 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-17T07:29:37.197 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-17T07:29:37.237 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-17T07:29:39.714 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-17T07:29:39.714 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-17T07:29:39.724 INFO:teuthology.task.internal:Configuring sudo... 2023-03-17T07:29:42.934 DEBUG:teuthology.orchestra.run.smithi035:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-17T07:29:42.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-17T07:29:44.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-17T07:29:44.364 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-17T07:29:45.561 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-17T07:29:45.840 DEBUG:teuthology.orchestra.run.smithi035:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-17T07:29:45.843 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-17T07:29:46.973 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-17T07:29:47.455 DEBUG:teuthology.orchestra.run.smithi035:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-17T07:29:48.381 DEBUG:teuthology.orchestra.run.smithi035:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-17T07:29:49.730 DEBUG:teuthology.orchestra.run.smithi035:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-17T07:29:51.149 DEBUG:teuthology.orchestra.run.smithi035:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-17T07:29:53.280 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:29:54.856 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-17T07:29:54.890 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-17T07:29:56.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-17T07:29:57.314 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-17T07:29:58.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-17T07:29:58.924 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:30:00.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-17T07:30:00.386 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-17T07:30:01.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-17T07:30:01.967 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-17T07:30:02.921 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-17T07:30:03.889 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:30:04.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-17T07:30:05.008 DEBUG:teuthology.orchestra.run.smithi035:> sudo service rsyslog restart 2023-03-17T07:30:07.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-03-17T07:30:07.696 INFO:teuthology.orchestra.run.smithi035.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-17T07:30:08.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-03-17T07:30:09.839 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-17T07:30:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-17T07:30:11.983 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-17T07:30:11.990 INFO:teuthology.task.internal:Starting timer... 2023-03-17T07:30:14.286 INFO:teuthology.run_tasks:Running task pcp... 2023-03-17T07:30:14.298 INFO:teuthology.run_tasks:Running task selinux... 2023-03-17T07:30:16.943 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-17T07:30:19.257 DEBUG:teuthology.orchestra.run.smithi035:> sudo service auditd rotate 2023-03-17T07:30:19.335 INFO:teuthology.orchestra.run.smithi035.stdout:Rotating logs: 2023-03-17T07:30:20.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2023-03-17T07:30:20.791 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2023-03-17T07:30:21.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2023-03-17T07:30:22.028 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2023-03-17T07:30:22.740 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-17T07:30:22.740 DEBUG:teuthology.orchestra.run.smithi035:> /usr/sbin/getenforce 2023-03-17T07:30:22.777 INFO:teuthology.orchestra.run.smithi035.stdout:Permissive 2023-03-17T07:30:23.497 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2023-03-17T07:30:23.525 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2023-03-17T07:30:24.065 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2023-03-17T07:30:24.100 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2023-03-17T07:30:24.572 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi035.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2023-03-17T07:30:24.572 DEBUG:teuthology.orchestra.run.smithi035:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-17T07:30:26.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T07:30:27.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-17T07:30:27.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T07:30:27.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-17T07:30:28.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T07:30:29.331 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-17T07:30:33.733 DEBUG:teuthology.orchestra.run.smithi035:> sudo /usr/sbin/setenforce permissive 2023-03-17T07:30:33.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2023-03-17T07:30:35.504 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2023-03-17T07:30:38.171 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-17T07:30:39.627 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-03-17T07:30:41.678 INFO:teuthology.repo_utils:Fetching main from origin 2023-03-17T07:30:42.892 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-17T07:30:43.771 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-17T07:30:44.966 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi035.front.sepia.ceph.com,smithi078.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-17T07:37:45.945 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi035.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2023-03-17T07:37:46.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T07:37:46.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T07:37:48.102 DEBUG:teuthology.orchestra.run.smithi035:> true 2023-03-17T07:37:49.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-03-17T07:37:49.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T07:37:51.634 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-03-17T07:37:52.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-03-17T07:37:54.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T07:37:54.264 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-03-17T07:37:56.044 INFO:teuthology.run_tasks:Running task clock... 2023-03-17T07:37:57.248 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-17T07:37:58.428 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-17T07:37:58.429 DEBUG:teuthology.orchestra.run.smithi035:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-17T07:37:58.431 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-17T07:38:00.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-17T07:38:01.225 INFO:teuthology.orchestra.run.smithi035.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-17T07:38:02.861 INFO:teuthology.orchestra.run.smithi035.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-17T07:38:02.861 INFO:teuthology.orchestra.run.smithi035.stderr:sudo: ntpd: command not found 2023-03-17T07:38:02.862 INFO:teuthology.orchestra.run.smithi035.stdout:506 Cannot talk to daemon 2023-03-17T07:38:02.862 INFO:teuthology.orchestra.run.smithi035.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-17T07:38:02.862 INFO:teuthology.orchestra.run.smithi035.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-17T07:38:02.862 INFO:teuthology.orchestra.run.smithi035.stderr:bash: ntpq: command not found 2023-03-17T07:38:02.863 INFO:teuthology.orchestra.run.smithi035.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-17T07:38:02.863 INFO:teuthology.orchestra.run.smithi035.stdout:=============================================================================== 2023-03-17T07:38:02.863 INFO:teuthology.orchestra.run.smithi035.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:02.863 INFO:teuthology.orchestra.run.smithi035.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:02.863 INFO:teuthology.orchestra.run.smithi035.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:02.863 INFO:teuthology.orchestra.run.smithi035.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:02.864 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-17T07:38:04.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-17T07:38:04.434 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-17T07:38:04.434 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-17T07:38:04.434 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2023-03-17T07:38:04.434 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2023-03-17T07:38:04.435 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-17T07:38:06.781 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-17T07:38:06.782 INFO:teuthology.orchestra.run.smithi078.stderr:bash: ntpq: command not found 2023-03-17T07:38:06.783 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-17T07:38:06.783 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-03-17T07:38:08.149 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:08.149 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:08.149 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:08.149 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:08.185 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-17T07:38:10.792 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-17T07:38:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2023-03-17T07:38:12.289 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2023-03-17T07:38:12.290 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-17T07:38:13.643 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-17T07:38:13.643 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2023-03-17T07:38:13.644 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-17T07:38:13.644 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2023-03-17T07:38:13.644 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:13.644 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:14.208 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:14.208 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-17T07:38:14.208 INFO:teuthology.run_tasks:Running task pexec... 2023-03-17T07:38:14.221 INFO:teuthology.task.pexec:Executing custom commands... 2023-03-17T07:38:15.991 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T07:38:17.463 DEBUG:teuthology.orchestra.run.smithi035:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-03-17T07:38:17.463 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi078.front.sepia.ceph.com 2023-03-17T07:38:17.463 DEBUG:teuthology.orchestra.run.smithi078:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-03-17T07:38:17.464 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi082.front.sepia.ceph.com 2023-03-17T07:38:17.464 DEBUG:teuthology.orchestra.run.smithi082:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-03-17T07:38:17.849 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:38:18.295 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:38:20.645 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:38:20.647 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:01 ago on Fri 17 Mar 2023 07:36:17 AM UTC. 2023-03-17T07:38:20.647 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-03-17T07:38:20.647 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-03-17T07:38:24.751 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2023-03-17T07:38:24.751 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-03-17T07:38:24.751 INFO:teuthology.orchestra.run.smithi082.stdout:Resetting modules: 2023-03-17T07:38:24.751 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools 2023-03-17T07:38:24.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:24.751 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:01:54 ago on Fri 17 Mar 2023 07:36:24 AM UTC. 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi035.stdout:Dependencies resolved. 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi035.stdout:================================================================================ 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi035.stdout: Package Architecture Version Repository Size 2023-03-17T07:38:24.752 INFO:teuthology.orchestra.run.smithi035.stdout:================================================================================ 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi035.stdout:Resetting modules: 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi035.stdout: container-tools 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction Summary 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi035.stdout:================================================================================ 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:24.753 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:02:00 ago on Fri 17 Mar 2023 07:36:18 AM UTC. 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout:Resetting modules: 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout: container-tools 2023-03-17T07:38:26.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:26.465 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2023-03-17T07:38:26.465 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2023-03-17T07:38:27.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:27.892 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:01:57 ago on Fri 17 Mar 2023 07:36:24 AM UTC. 2023-03-17T07:38:29.127 INFO:teuthology.orchestra.run.smithi035.stdout:Complete! 2023-03-17T07:38:29.127 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:38:29.127 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:02:01 ago on Fri 17 Mar 2023 07:36:24 AM UTC. 2023-03-17T07:38:29.127 INFO:teuthology.orchestra.run.smithi035.stdout:Dependencies resolved. 2023-03-17T07:38:29.131 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:04 ago on Fri 17 Mar 2023 07:36:17 AM UTC. 2023-03-17T07:38:30.117 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-03-17T07:38:31.059 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:38:31.059 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:08 ago on Fri 17 Mar 2023 07:36:17 AM UTC. 2023-03-17T07:38:31.059 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-03-17T07:38:31.655 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================================ 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================================ 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout:Installing group/module packages: 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-03-17T07:38:31.656 INFO:teuthology.orchestra.run.smithi082.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-03-17T07:38:31.657 INFO:teuthology.orchestra.run.smithi082.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-03-17T07:38:31.657 INFO:teuthology.orchestra.run.smithi082.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-03-17T07:38:31.657 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-03-17T07:38:31.657 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout:Installing module profiles: 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools/common 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2023-03-17T07:38:35.548 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools rhel8 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================================ 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout:Install 10 Packages 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 18 M 2023-03-17T07:38:35.549 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 65 M 2023-03-17T07:38:35.550 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-03-17T07:38:35.550 INFO:teuthology.orchestra.run.smithi082.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 775 kB/s | 41 kB 00:00 2023-03-17T07:38:35.550 INFO:teuthology.orchestra.run.smithi082.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 319 kB/s | 25 kB 00:00 2023-03-17T07:38:35.550 INFO:teuthology.orchestra.run.smithi082.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 984 kB/s | 49 kB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 730 kB/s | 94 kB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 24 MB/s | 2.2 MB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 31 MB/s | 7.0 MB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 20 MB/s | 8.0 MB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:Total 37 MB/s | 18 MB 00:00 2023-03-17T07:38:38.290 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-03-17T07:38:39.695 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-03-17T07:38:39.695 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-03-17T07:38:39.695 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-03-17T07:38:39.695 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-03-17T07:38:39.695 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-03-17T07:38:39.701 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:02:02 ago on Fri 17 Mar 2023 07:36:18 AM UTC. 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:02:06 ago on Fri 17 Mar 2023 07:36:18 AM UTC. 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================================ 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================================ 2023-03-17T07:38:40.818 INFO:teuthology.orchestra.run.smithi078.stdout:Installing group/module packages: 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout:Installing module profiles: 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: container-tools/common 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling module streams: 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: container-tools rhel8 2023-03-17T07:38:40.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:40.820 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2023-03-17T07:38:40.820 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================================================ 2023-03-17T07:38:40.820 INFO:teuthology.orchestra.run.smithi078.stdout:Install 10 Packages 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 18 M 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 65 M 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 241 kB/s | 25 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 266 kB/s | 41 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 454 kB/s | 49 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.4 MB/s | 524 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.5 MB/s | 213 kB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 23 MB/s | 8.0 MB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 20 MB/s | 7.0 MB 00:00 2023-03-17T07:38:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:Total 30 MB/s | 18 MB 00:00 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-03-17T07:38:47.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-03-17T07:38:49.969 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-03-17T07:38:49.969 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-03-17T07:38:49.969 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-03-17T07:38:49.969 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-03-17T07:38:49.969 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-03-17T07:38:49.969 INFO:teuthology.orchestra.run.smithi078.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-03-17T07:38:49.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-03-17T07:38:49.971 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-03-17T07:38:52.466 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-03-17T07:38:52.466 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-03-17T07:38:52.466 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:02:15 ago on Fri 17 Mar 2023 07:36:18 AM UTC. 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout:Installed products updated. 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: yajl-2.1.0-10.el8.x86_64 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:38:52.467 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-03-17T07:38:52.468 DEBUG:teuthology.parallel:result is None 2023-03-17T07:38:52.469 INFO:teuthology.orchestra.run.smithi035.stdout:============================================================================================================ 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: Package Arch Version Repository Size 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout:============================================================================================================ 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout:Installing group/module packages: 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-03-17T07:38:55.645 INFO:teuthology.orchestra.run.smithi035.stdout:Installing dependencies: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Installing module profiles: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: container-tools/common 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Enabling module streams: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: container-tools rhel8 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction Summary 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:============================================================================================================ 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Install 10 Packages 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Total download size: 18 M 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Installed size: 65 M 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:Downloading Packages: 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.3 MB/s | 94 kB 00:00 2023-03-17T07:38:55.646 INFO:teuthology.orchestra.run.smithi035.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 256 kB/s | 25 kB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 334 kB/s | 41 kB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 653 kB/s | 49 kB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.6 MB/s | 149 kB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.3 MB/s | 213 kB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 26 MB/s | 7.0 MB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:Total 29 MB/s | 18 MB 00:00 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:Running transaction check 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction check succeeded. 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:Running transaction test 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction test succeeded. 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout:Running transaction 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout: Preparing : 1/1 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-03-17T07:38:55.647 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-03-17T07:38:55.648 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-03-17T07:38:55.648 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-03-17T07:38:55.648 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-03-17T07:38:55.648 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-03-17T07:38:55.648 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-03-17T07:38:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-03-17T07:38:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-03-17T07:38:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-03-17T07:38:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:02:09 ago on Fri 17 Mar 2023 07:36:24 AM UTC. 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout:Installed products updated. 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:56.731 INFO:teuthology.orchestra.run.smithi035.stdout:Installed: 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: yajl-2.1.0-10.el8.x86_64 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:38:56.732 INFO:teuthology.orchestra.run.smithi035.stdout:Complete! 2023-03-17T07:38:56.733 DEBUG:teuthology.parallel:result is None 2023-03-17T07:38:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-03-17T07:38:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-03-17T07:38:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-03-17T07:38:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:16 ago on Fri 17 Mar 2023 07:36:17 AM UTC. 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2023-03-17T07:38:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:38:59.184 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-03-17T07:39:02.457 INFO:teuthology.orchestra.run.smithi082.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:39:02.458 INFO:teuthology.orchestra.run.smithi082.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-03-17T07:39:02.458 INFO:teuthology.orchestra.run.smithi082.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-03-17T07:39:02.458 INFO:teuthology.orchestra.run.smithi082.stdout: yajl-2.1.0-10.el8.x86_64 2023-03-17T07:39:02.458 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:39:02.458 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-03-17T07:39:02.458 DEBUG:teuthology.parallel:result is None 2023-03-17T07:39:02.458 INFO:teuthology.run_tasks:Running task install... 2023-03-17T07:39:02.467 DEBUG:teuthology.task.install:project ceph 2023-03-17T07:39:04.727 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c'}} 2023-03-17T07:39:04.728 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c'} 2023-03-17T07:39:04.728 INFO:teuthology.task.install:Using flavor: default 2023-03-17T07:39:04.735 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-17T07:39:08.671 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-17T07:39:08.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c', 'tag': None, 'wait_for_package': False} 2023-03-17T07:39:09.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:39:09.222 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c', 'tag': None, 'wait_for_package': False} 2023-03-17T07:39:10.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:39:10.076 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c', 'tag': None, 'wait_for_package': False} 2023-03-17T07:39:10.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:39:12.126 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/ 2023-03-17T07:39:12.978 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3051.g4aa791bf 2023-03-17T07:39:12.994 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/ 2023-03-17T07:39:13.896 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3051.g4aa791bf 2023-03-17T07:39:13.899 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/ 2023-03-17T07:39:14.415 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3051.g4aa791bf 2023-03-17T07:39:14.507 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-17T07:39:15.540 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:39:15.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-17T07:39:16.386 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-17T07:39:17.202 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:39:17.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-17T07:39:17.203 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-17T07:39:17.203 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:39:17.203 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-17T07:39:17.237 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-17T07:39:18.037 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4aa791bf129eece187e94ddbfa7c2b475588cf0c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-17T07:39:18.039 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-17T07:39:18.039 DEBUG:teuthology.orchestra.run.smithi035:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4aa791bf129eece187e94ddbfa7c2b475588cf0c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-17T07:39:18.039 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-17T07:39:18.039 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4aa791bf129eece187e94ddbfa7c2b475588cf0c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-17T07:39:18.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-17T07:39:19.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-17T07:39:20.867 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-17T07:39:22.470 DEBUG:teuthology.orchestra.run.smithi035:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-17T07:39:23.551 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-17T07:39:23.582 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2023-03-17T07:39:24.371 DEBUG:teuthology.orchestra.run.smithi035:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-17T07:39:25.310 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2023-03-17T07:39:25.311 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2023-03-17T07:39:25.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2023-03-17T07:39:25.341 INFO:teuthology.orchestra.run.smithi035.stdout:check_obsoletes = 1 2023-03-17T07:39:26.194 DEBUG:teuthology.orchestra.run.smithi035:> sudo yum clean all 2023-03-17T07:39:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:39:27.183 INFO:teuthology.orchestra.run.smithi082.stdout:44 files removed 2023-03-17T07:39:27.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-17T07:39:27.185 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:39:28.640 INFO:teuthology.orchestra.run.smithi078.stdout:44 files removed 2023-03-17T07:39:28.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-17T07:39:28.643 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2023-03-17T07:39:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 292 kB/s | 80 kB 00:00 2023-03-17T07:39:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-03-17T07:39:29.490 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:39:29.882 INFO:teuthology.orchestra.run.smithi035.stdout:44 files removed 2023-03-17T07:39:29.883 DEBUG:teuthology.orchestra.run.smithi035:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-17T07:39:31.311 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:Updating Subscription Management repositories. 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 300 kB/s | 80 kB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-03-17T07:39:31.312 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-03-17T07:39:31.677 INFO:teuthology.orchestra.run.smithi035.stdout:Updating Subscription Management repositories. 2023-03-17T07:39:33.018 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 514 kB/s | 24 kB 00:00 2023-03-17T07:39:34.484 INFO:teuthology.orchestra.run.smithi035.stdout:ceph packages for x86_64 305 kB/s | 80 kB 00:00 2023-03-17T07:39:34.484 INFO:teuthology.orchestra.run.smithi035.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-03-17T07:39:35.613 INFO:teuthology.orchestra.run.smithi035.stdout:ceph source packages 6.3 kB/s | 1.5 kB 00:00 2023-03-17T07:39:35.613 INFO:teuthology.orchestra.run.smithi035.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-03-17T07:39:35.613 INFO:teuthology.orchestra.run.smithi035.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:01 2023-03-17T07:39:35.614 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-03-17T07:39:35.614 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 325 kB/s | 24 kB 00:00 2023-03-17T07:39:35.615 INFO:teuthology.orchestra.run.smithi078.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-03-17T07:39:37.424 INFO:teuthology.orchestra.run.smithi035.stdout:lab-extras 555 kB/s | 24 kB 00:00 2023-03-17T07:39:39.161 INFO:teuthology.orchestra.run.smithi035.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 55 MB/s | 53 MB 00:00 2023-03-17T07:39:41.477 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 MB/s | 53 MB 00:00 2023-03-17T07:39:43.527 INFO:teuthology.orchestra.run.smithi078.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-03-17T07:39:47.037 INFO:teuthology.orchestra.run.smithi035.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-03-17T07:39:52.665 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-17T07:39:53.047 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-17T07:39:53.453 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-17T07:39:53.658 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-17T07:39:53.658 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-17T07:39:53.658 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-17T07:39:53.658 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-17T07:39:53.658 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================================================== 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================================================== 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-17T07:39:53.659 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 6.4 k 2023-03-17T07:39:53.660 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 5.4 M 2023-03-17T07:39:53.660 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 846 k 2023-03-17T07:39:53.660 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 165 k 2023-03-17T07:39:54.069 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 1.5 M 2023-03-17T07:39:54.069 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 123 k 2023-03-17T07:39:54.069 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 1.7 M 2023-03-17T07:39:54.069 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 7.4 M 2023-03-17T07:39:54.070 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 47 k 2023-03-17T07:39:54.283 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 13 M 2023-03-17T07:39:54.283 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 41 M 2023-03-17T07:39:54.283 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 263 k 2023-03-17T07:39:54.283 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 83 k 2023-03-17T07:39:54.283 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 258 k 2023-03-17T07:39:54.284 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 18 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 30 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 768 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 139 k 2023-03-17T07:39:54.784 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 190 k 2023-03-17T07:39:54.785 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 370 k 2023-03-17T07:39:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 365 k 2023-03-17T07:39:55.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 106 k 2023-03-17T07:39:55.584 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 94 k 2023-03-17T07:39:55.584 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.5 M 2023-03-17T07:39:55.584 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 180 k 2023-03-17T07:39:55.815 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-17T07:39:55.815 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2023-03-17T07:39:55.815 INFO:teuthology.orchestra.run.smithi082.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-17T07:39:55.815 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.7 M 2023-03-17T07:39:55.815 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.6 M 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 22 M 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 23 k 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 2.3 M 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 239 k 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 4.6 M 2023-03-17T07:39:55.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 18 M 2023-03-17T07:39:55.817 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 15 k 2023-03-17T07:39:55.817 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 24 k 2023-03-17T07:39:55.817 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-17T07:39:55.817 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 137 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-17T07:39:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-17T07:39:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 474 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 6.5 M 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-17T07:39:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 45 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 117 k 2023-03-17T07:39:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-17T07:39:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-17T07:39:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-17T07:39:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-17T07:39:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-17T07:39:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-17T07:39:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-17T07:39:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-17T07:39:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-17T07:39:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-17T07:39:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-17T07:39:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-17T07:39:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-17T07:39:58.140 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-17T07:39:58.140 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-17T07:39:58.140 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-17T07:39:58.141 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-17T07:39:58.141 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-17T07:39:58.141 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-17T07:39:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-17T07:39:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-17T07:39:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-17T07:39:58.311 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-17T07:39:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-17T07:39:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-17T07:39:58.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-17T07:39:58.710 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-17T07:39:59.261 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-17T07:39:59.262 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-17T07:39:59.262 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-17T07:39:59.262 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-17T07:39:59.811 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-17T07:39:59.811 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-17T07:39:59.812 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-17T07:39:59.812 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-17T07:39:59.812 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2023-03-17T07:40:00.235 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql 10 2023-03-17T07:40:00.962 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:40:00.962 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-03-17T07:40:00.962 INFO:teuthology.orchestra.run.smithi082.stdout:=========================================================================================================================== 2023-03-17T07:40:00.962 INFO:teuthology.orchestra.run.smithi082.stdout:Install 128 Packages 2023-03-17T07:40:00.962 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 3 Packages 2023-03-17T07:40:00.963 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:40:01.329 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 197 M 2023-03-17T07:40:01.329 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-03-17T07:40:01.329 INFO:teuthology.orchestra.run.smithi082.stdout:(1/131): ceph-18.0.0-3051.g4aa791bf.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-03-17T07:40:01.335 INFO:teuthology.orchestra.run.smithi035.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:Dependencies resolved. 2023-03-17T07:40:01.932 INFO:teuthology.orchestra.run.smithi035.stdout:=========================================================================================================================== 2023-03-17T07:40:02.321 INFO:teuthology.orchestra.run.smithi035.stdout: Package Arch Version Repository Size 2023-03-17T07:40:02.321 INFO:teuthology.orchestra.run.smithi035.stdout:=========================================================================================================================== 2023-03-17T07:40:02.321 INFO:teuthology.orchestra.run.smithi035.stdout:Installing: 2023-03-17T07:40:02.321 INFO:teuthology.orchestra.run.smithi035.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-17T07:40:02.322 INFO:teuthology.orchestra.run.smithi035.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-17T07:40:02.322 INFO:teuthology.orchestra.run.smithi035.stdout: ceph x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 6.4 k 2023-03-17T07:40:02.322 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-base x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 5.4 M 2023-03-17T07:40:02.322 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-fuse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 846 k 2023-03-17T07:40:02.322 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 165 k 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 1.5 M 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 123 k 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 1.7 M 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 7.4 M 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-rook noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 47 k 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-radosgw x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 13 M 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-test x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 41 M 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-volume noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 263 k 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: cephadm noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 83 k 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: cephfs-mirror x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 258 k 2023-03-17T07:40:02.447 INFO:teuthology.orchestra.run.smithi035.stdout: cephfs-top noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 18 k 2023-03-17T07:40:02.448 INFO:teuthology.orchestra.run.smithi035.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-17T07:40:02.448 INFO:teuthology.orchestra.run.smithi035.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-17T07:40:03.243 INFO:teuthology.orchestra.run.smithi035.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-17T07:40:03.243 INFO:teuthology.orchestra.run.smithi035.stdout: libcephfs-devel x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 30 k 2023-03-17T07:40:03.243 INFO:teuthology.orchestra.run.smithi035.stdout: libcephfs2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 768 k 2023-03-17T07:40:03.243 INFO:teuthology.orchestra.run.smithi035.stdout: librados-devel x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 139 k 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cephfs x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 190 k 2023-03-17T07:40:03.727 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rados x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 370 k 2023-03-17T07:40:04.070 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rbd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 365 k 2023-03-17T07:40:04.070 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rgw x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 106 k 2023-03-17T07:40:04.070 INFO:teuthology.orchestra.run.smithi035.stdout: rbd-fuse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 94 k 2023-03-17T07:40:04.070 INFO:teuthology.orchestra.run.smithi035.stdout: rbd-mirror x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.5 M 2023-03-17T07:40:04.070 INFO:teuthology.orchestra.run.smithi035.stdout: rbd-nbd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 180 k 2023-03-17T07:40:04.070 INFO:teuthology.orchestra.run.smithi035.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-17T07:40:05.427 INFO:teuthology.orchestra.run.smithi035.stdout:Upgrading: 2023-03-17T07:40:05.427 INFO:teuthology.orchestra.run.smithi035.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: librados2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.7 M 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: librbd1 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.6 M 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout:Installing dependencies: 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-common x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 22 M 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 23 k 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mds x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 2.3 M 2023-03-17T07:40:05.816 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 239 k 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mon x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 4.6 M 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-osd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 18 M 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 15 k 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-selinux x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 24 k 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-17T07:40:05.817 INFO:teuthology.orchestra.run.smithi035.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-17T07:40:06.808 INFO:teuthology.orchestra.run.smithi035.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-17T07:40:06.808 INFO:teuthology.orchestra.run.smithi035.stdout: libcephsqlite x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 137 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: libradosstriper1 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 474 k 2023-03-17T07:40:06.809 INFO:teuthology.orchestra.run.smithi035.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: librgw2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 6.5 M 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-17T07:40:06.810 INFO:teuthology.orchestra.run.smithi035.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-17T07:40:07.707 INFO:teuthology.orchestra.run.smithi035.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-17T07:40:07.707 INFO:teuthology.orchestra.run.smithi035.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-17T07:40:07.707 INFO:teuthology.orchestra.run.smithi035.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-17T07:40:07.707 INFO:teuthology.orchestra.run.smithi035.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-17T07:40:07.707 INFO:teuthology.orchestra.run.smithi035.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-17T07:40:07.707 INFO:teuthology.orchestra.run.smithi035.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-17T07:40:07.708 INFO:teuthology.orchestra.run.smithi035.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-17T07:40:07.708 INFO:teuthology.orchestra.run.smithi035.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-17T07:40:08.183 INFO:teuthology.orchestra.run.smithi035.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-17T07:40:08.183 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-17T07:40:08.183 INFO:teuthology.orchestra.run.smithi035.stdout: python3-ceph-argparse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 45 k 2023-03-17T07:40:08.183 INFO:teuthology.orchestra.run.smithi035.stdout: python3-ceph-common x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 117 k 2023-03-17T07:40:08.183 INFO:teuthology.orchestra.run.smithi035.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-17T07:40:08.184 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-17T07:40:08.632 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-17T07:40:08.632 INFO:teuthology.orchestra.run.smithi035.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-17T07:40:08.633 INFO:teuthology.orchestra.run.smithi035.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-17T07:40:08.633 INFO:teuthology.orchestra.run.smithi035.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-17T07:40:08.633 INFO:teuthology.orchestra.run.smithi035.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-17T07:40:08.633 INFO:teuthology.orchestra.run.smithi035.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-17T07:40:09.257 INFO:teuthology.orchestra.run.smithi035.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-17T07:40:09.257 INFO:teuthology.orchestra.run.smithi035.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-17T07:40:09.257 INFO:teuthology.orchestra.run.smithi035.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-17T07:40:09.257 INFO:teuthology.orchestra.run.smithi035.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-17T07:40:09.257 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-17T07:40:09.258 INFO:teuthology.orchestra.run.smithi035.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-17T07:40:10.461 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-17T07:40:10.462 INFO:teuthology.orchestra.run.smithi035.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-17T07:40:10.462 INFO:teuthology.orchestra.run.smithi035.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-17T07:40:12.089 INFO:teuthology.orchestra.run.smithi035.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-17T07:40:12.601 INFO:teuthology.orchestra.run.smithi035.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-17T07:40:12.602 INFO:teuthology.orchestra.run.smithi035.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-17T07:40:12.602 INFO:teuthology.orchestra.run.smithi035.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-17T07:40:13.171 INFO:teuthology.orchestra.run.smithi035.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-17T07:40:13.171 INFO:teuthology.orchestra.run.smithi035.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-17T07:40:13.171 INFO:teuthology.orchestra.run.smithi035.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-17T07:40:13.172 INFO:teuthology.orchestra.run.smithi035.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout:Enabling module streams: 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql 10 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction Summary 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout:=========================================================================================================================== 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout:Install 128 Packages 2023-03-17T07:40:14.728 INFO:teuthology.orchestra.run.smithi035.stdout:Upgrade 3 Packages 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:Total download size: 197 M 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:Downloading Packages: 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(1/131): ceph-18.0.0-3051.g4aa791bf.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(2/131): ceph-fuse-18.0.0-3051.g4aa791bf.el8.x8 2.2 MB/s | 846 kB 00:00 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(3/131): ceph-immutable-object-cache-18.0.0-305 1.4 MB/s | 165 kB 00:00 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(4/131): ceph-base-18.0.0-3051.g4aa791bf.el8.x8 5.4 MB/s | 5.4 MB 00:00 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(5/131): ceph-mds-18.0.0-3051.g4aa791bf.el8.x86 4.0 MB/s | 2.3 MB 00:00 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(6/131): ceph-mgr-18.0.0-3051.g4aa791bf.el8.x86 4.9 MB/s | 1.5 MB 00:00 2023-03-17T07:40:15.548 INFO:teuthology.orchestra.run.smithi035.stdout:(7/131): ceph-mon-18.0.0-3051.g4aa791bf.el8.x86 4.0 MB/s | 4.6 MB 00:01 2023-03-17T07:40:15.573 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-03-17T07:40:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================================================== 2023-03-17T07:40:18.004 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2023-03-17T07:40:20.084 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================================================== 2023-03-17T07:40:20.823 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2023-03-17T07:40:20.823 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-17T07:40:20.823 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-17T07:40:20.823 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 6.4 k 2023-03-17T07:40:20.823 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 5.4 M 2023-03-17T07:40:20.824 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 846 k 2023-03-17T07:40:21.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 165 k 2023-03-17T07:40:21.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 1.5 M 2023-03-17T07:40:21.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 123 k 2023-03-17T07:40:21.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 1.7 M 2023-03-17T07:40:21.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 7.4 M 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 47 k 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 13 M 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 41 M 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 263 k 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 83 k 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 258 k 2023-03-17T07:40:22.563 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 18 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 30 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 768 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 139 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-17T07:40:22.564 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-17T07:40:22.565 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-17T07:40:22.565 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-17T07:40:22.565 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-17T07:40:22.565 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 190 k 2023-03-17T07:40:22.565 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 370 k 2023-03-17T07:40:22.565 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 365 k 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 106 k 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 94 k 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.5 M 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 180 k 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.7 M 2023-03-17T07:40:24.554 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 3.6 M 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 22 M 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 23 k 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 2.3 M 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 239 k 2023-03-17T07:40:24.555 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 4.6 M 2023-03-17T07:40:26.101 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 18 M 2023-03-17T07:40:26.524 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3051.g4aa791bf.el8 ceph-noarch 15 k 2023-03-17T07:40:27.959 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 24 k 2023-03-17T07:40:27.959 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-17T07:40:27.959 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-17T07:40:27.960 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-17T07:40:27.960 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-17T07:40:28.375 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-17T07:40:28.375 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 137 k 2023-03-17T07:40:28.375 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-17T07:40:28.375 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-17T07:40:28.375 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-17T07:40:28.375 INFO:teuthology.orchestra.run.smithi078.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-17T07:40:28.882 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-17T07:40:29.399 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-17T07:40:29.399 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 474 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 6.5 M 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-17T07:40:29.400 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 45 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:18.0.0-3051.g4aa791bf.el8 ceph 117 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-17T07:40:29.401 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-17T07:40:29.764 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-17T07:40:30.143 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-17T07:40:31.174 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-17T07:40:31.174 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-17T07:40:31.174 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-17T07:40:31.175 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-17T07:40:31.176 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-17T07:40:31.177 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling module streams: 2023-03-17T07:40:31.177 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql 10 2023-03-17T07:40:31.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:40:31.177 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2023-03-17T07:40:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================================================== 2023-03-17T07:40:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:Install 128 Packages 2023-03-17T07:40:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 3 Packages 2023-03-17T07:40:31.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:40:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 197 M 2023-03-17T07:40:31.855 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2023-03-17T07:40:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:(1/131): ceph-18.0.0-3051.g4aa791bf.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-03-17T07:40:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:(2/131): ceph-fuse-18.0.0-3051.g4aa791bf.el8.x8 1.6 MB/s | 846 kB 00:00 2023-03-17T07:40:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:(3/131): ceph-immutable-object-cache-18.0.0-305 2.2 MB/s | 165 kB 00:00 2023-03-17T07:40:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:(4/131): ceph-mds-18.0.0-3051.g4aa791bf.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-03-17T07:40:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:(5/131): ceph-mgr-18.0.0-3051.g4aa791bf.el8.x86 3.5 MB/s | 1.5 MB 00:00 2023-03-17T07:40:32.869 INFO:teuthology.orchestra.run.smithi078.stdout:(6/131): ceph-mon-18.0.0-3051.g4aa791bf.el8.x86 5.5 MB/s | 4.6 MB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(7/131): ceph-base-18.0.0-3051.g4aa791bf.el8.x8 1.2 MB/s | 5.4 MB 00:04 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(8/131): ceph-osd-18.0.0-3051.g4aa791bf.el8.x86 6.8 MB/s | 18 MB 00:02 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(9/131): ceph-selinux-18.0.0-3051.g4aa791bf.el8 366 kB/s | 24 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(10/131): ceph-radosgw-18.0.0-3051.g4aa791bf.el 2.8 MB/s | 13 MB 00:04 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(11/131): cephfs-mirror-18.0.0-3051.g4aa791bf.e 1.4 MB/s | 258 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(12/131): libcephfs-devel-18.0.0-3051.g4aa791bf 65 kB/s | 30 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(13/131): libcephfs2-18.0.0-3051.g4aa791bf.el8. 2.2 MB/s | 768 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(14/131): libcephsqlite-18.0.0-3051.g4aa791bf.e 1.1 MB/s | 137 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(15/131): librados-devel-18.0.0-3051.g4aa791bf. 1.2 MB/s | 139 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(16/131): libradosstriper1-18.0.0-3051.g4aa791b 1.8 MB/s | 474 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(17/131): ceph-common-18.0.0-3051.g4aa791bf.el8 1.7 MB/s | 22 MB 00:12 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(18/131): librgw2-18.0.0-3051.g4aa791bf.el8.x86 3.4 MB/s | 6.5 MB 00:01 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(19/131): python3-ceph-argparse-18.0.0-3051.g4a 446 kB/s | 45 kB 00:00 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(20/131): ceph-test-18.0.0-3051.g4aa791bf.el8.x 5.5 MB/s | 41 MB 00:07 2023-03-17T07:40:32.870 INFO:teuthology.orchestra.run.smithi078.stdout:(21/131): python3-ceph-common-18.0.0-3051.g4aa7 246 kB/s | 117 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(22/131): python3-cephfs-18.0.0-3051.g4aa791bf. 394 kB/s | 190 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(23/131): python3-rados-18.0.0-3051.g4aa791bf.e 3.9 MB/s | 370 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(24/131): python3-rgw-18.0.0-3051.g4aa791bf.el8 1.6 MB/s | 106 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(25/131): python3-rbd-18.0.0-3051.g4aa791bf.el8 2.8 MB/s | 365 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(26/131): rbd-fuse-18.0.0-3051.g4aa791bf.el8.x8 939 kB/s | 94 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3051.g 556 kB/s | 23 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(28/131): rbd-nbd-18.0.0-3051.g4aa791bf.el8.x86 2.6 MB/s | 180 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(29/131): ceph-mgr-cephadm-18.0.0-3051.g4aa791b 2.9 MB/s | 123 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(30/131): ceph-mgr-dashboard-18.0.0-3051.g4aa79 4.7 MB/s | 1.7 MB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3051.g4a 2.8 MB/s | 239 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(32/131): ceph-mgr-rook-18.0.0-3051.g4aa791bf.e 949 kB/s | 47 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3051.g4 351 kB/s | 15 kB 00:00 2023-03-17T07:40:32.871 INFO:teuthology.orchestra.run.smithi078.stdout:(34/131): ceph-volume-18.0.0-3051.g4aa791bf.el8 5.1 MB/s | 263 kB 00:00 2023-03-17T07:40:34.255 INFO:teuthology.orchestra.run.smithi078.stdout:(35/131): cephadm-18.0.0-3051.g4aa791bf.el8.noa 1.6 MB/s | 83 kB 00:00 2023-03-17T07:40:34.256 INFO:teuthology.orchestra.run.smithi078.stdout:(36/131): cephfs-top-18.0.0-3051.g4aa791bf.el8. 363 kB/s | 18 kB 00:00 2023-03-17T07:40:34.596 INFO:teuthology.orchestra.run.smithi078.stdout:(37/131): rbd-mirror-18.0.0-3051.g4aa791bf.el8. 3.8 MB/s | 3.5 MB 00:00 2023-03-17T07:40:34.597 INFO:teuthology.orchestra.run.smithi078.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2023-03-17T07:40:35.779 INFO:teuthology.orchestra.run.smithi078.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 853 kB/s | 306 kB 00:00 2023-03-17T07:40:35.779 INFO:teuthology.orchestra.run.smithi078.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 561 kB/s | 75 kB 00:00 2023-03-17T07:40:35.779 INFO:teuthology.orchestra.run.smithi078.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 655 kB/s | 44 kB 00:00 2023-03-17T07:40:35.779 INFO:teuthology.orchestra.run.smithi078.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-03-17T07:40:35.780 INFO:teuthology.orchestra.run.smithi078.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-03-17T07:40:35.780 INFO:teuthology.orchestra.run.smithi078.stdout:(44/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(46/131): python3-cachetools-3.1.1-4.el8.noarch 207 kB/s | 33 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(50/131): python3-cheroot-8.5.2-1.el8.noarch.rp 763 kB/s | 173 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-03-17T07:40:36.578 INFO:teuthology.orchestra.run.smithi078.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 969 kB/s | 49 kB 00:00 2023-03-17T07:40:36.955 INFO:teuthology.orchestra.run.smithi078.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 874 kB/s | 59 kB 00:00 2023-03-17T07:40:36.955 INFO:teuthology.orchestra.run.smithi078.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 376 kB/s | 16 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 504 kB/s | 34 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(60/131): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 247 kB/s | 19 kB 00:00 2023-03-17T07:40:36.956 INFO:teuthology.orchestra.run.smithi078.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 356 kB/s | 24 kB 00:00 2023-03-17T07:40:36.957 INFO:teuthology.orchestra.run.smithi078.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 580 kB/s | 29 kB 00:00 2023-03-17T07:40:37.630 INFO:teuthology.orchestra.run.smithi078.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 660 kB/s | 27 kB 00:00 2023-03-17T07:40:37.630 INFO:teuthology.orchestra.run.smithi078.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-03-17T07:40:37.630 INFO:teuthology.orchestra.run.smithi078.stdout:(66/131): python3-waitress-1.2.1-2.el8.1.noarch 1.7 MB/s | 241 kB 00:00 2023-03-17T07:40:37.630 INFO:teuthology.orchestra.run.smithi078.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-03-17T07:40:37.630 INFO:teuthology.orchestra.run.smithi078.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 387 kB/s | 23 kB 00:00 2023-03-17T07:40:38.429 INFO:teuthology.orchestra.run.smithi078.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 636 kB/s | 85 kB 00:00 2023-03-17T07:40:38.429 INFO:teuthology.orchestra.run.smithi078.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-03-17T07:40:38.429 INFO:teuthology.orchestra.run.smithi078.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-03-17T07:40:38.429 INFO:teuthology.orchestra.run.smithi078.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-03-17T07:40:38.429 INFO:teuthology.orchestra.run.smithi078.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-03-17T07:40:38.429 INFO:teuthology.orchestra.run.smithi078.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 583 kB/s | 39 kB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(80/131): thrift-0.13.0-2.el8.x86_64.rpm 3.1 MB/s | 1.7 MB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 20 MB/s | 14 MB 00:00 2023-03-17T07:40:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 2.7 MB/s | 713 kB 00:00 2023-03-17T07:40:39.536 INFO:teuthology.orchestra.run.smithi078.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 433 kB/s | 27 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 752 kB/s | 44 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 18 MB/s | 3.7 MB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 547 kB/s | 64 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.9 MB/s | 126 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 340 kB/s | 20 kB 00:00 2023-03-17T07:40:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-03-17T07:40:40.041 INFO:teuthology.orchestra.run.smithi078.stdout:(93/131): python3-babel-2.5.1-7.el8.noarch.rpm 7.2 MB/s | 4.8 MB 00:00 2023-03-17T07:40:40.041 INFO:teuthology.orchestra.run.smithi078.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-03-17T07:40:40.041 INFO:teuthology.orchestra.run.smithi078.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-03-17T07:40:40.041 INFO:teuthology.orchestra.run.smithi078.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-17T07:40:40.535 INFO:teuthology.orchestra.run.smithi078.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 4.8 MB/s | 354 kB 00:00 2023-03-17T07:40:40.535 INFO:teuthology.orchestra.run.smithi078.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-03-17T07:40:41.175 INFO:teuthology.orchestra.run.smithi078.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-03-17T07:40:41.175 INFO:teuthology.orchestra.run.smithi078.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-03-17T07:40:41.175 INFO:teuthology.orchestra.run.smithi078.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-03-17T07:40:42.622 INFO:teuthology.orchestra.run.smithi078.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-03-17T07:40:42.622 INFO:teuthology.orchestra.run.smithi078.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.0 MB/s | 200 kB 00:00 2023-03-17T07:40:43.222 INFO:teuthology.orchestra.run.smithi078.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-03-17T07:40:43.222 INFO:teuthology.orchestra.run.smithi078.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.6 MB/s | 220 kB 00:00 2023-03-17T07:40:43.222 INFO:teuthology.orchestra.run.smithi078.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-03-17T07:40:43.223 INFO:teuthology.orchestra.run.smithi078.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-03-17T07:40:43.223 INFO:teuthology.orchestra.run.smithi078.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 847 kB/s | 43 kB 00:00 2023-03-17T07:40:44.653 INFO:teuthology.orchestra.run.smithi078.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-03-17T07:40:44.654 INFO:teuthology.orchestra.run.smithi078.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-03-17T07:40:44.654 INFO:teuthology.orchestra.run.smithi078.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.2 MB/s | 5.1 MB 00:00 2023-03-17T07:40:45.266 INFO:teuthology.orchestra.run.smithi078.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-03-17T07:40:45.266 INFO:teuthology.orchestra.run.smithi078.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-03-17T07:40:45.266 INFO:teuthology.orchestra.run.smithi078.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.4 MB/s | 155 kB 00:00 2023-03-17T07:40:45.267 INFO:teuthology.orchestra.run.smithi078.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-03-17T07:40:45.267 INFO:teuthology.orchestra.run.smithi078.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-03-17T07:40:45.267 INFO:teuthology.orchestra.run.smithi078.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.8 MB/s | 605 kB 00:00 2023-03-17T07:40:45.267 INFO:teuthology.orchestra.run.smithi078.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 6.9 MB/s | 644 kB 00:00 2023-03-17T07:40:46.268 INFO:teuthology.orchestra.run.smithi078.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.7 MB/s | 171 kB 00:00 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:(130/131): librados2-18.0.0-3051.g4aa791bf.el8. 8.0 MB/s | 3.7 MB 00:00 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:(131/131): librbd1-18.0.0-3051.g4aa791bf.el8.x8 6.5 MB/s | 3.6 MB 00:00 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:Total 11 MB/s | 197 MB 00:18 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2023-03-17T07:40:46.269 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2023-03-17T07:40:46.288 INFO:teuthology.orchestra.run.smithi082.stdout:(2/131): ceph-fuse-18.0.0-3051.g4aa791bf.el8.x8 3.8 MB/s | 846 kB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(3/131): ceph-immutable-object-cache-18.0.0-305 2.4 MB/s | 165 kB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(4/131): ceph-mds-18.0.0-3051.g4aa791bf.el8.x86 6.1 MB/s | 2.3 MB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(5/131): ceph-base-18.0.0-3051.g4aa791bf.el8.x8 6.3 MB/s | 5.4 MB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(6/131): ceph-mgr-18.0.0-3051.g4aa791bf.el8.x86 5.4 MB/s | 1.5 MB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(7/131): ceph-mon-18.0.0-3051.g4aa791bf.el8.x86 9.0 MB/s | 4.6 MB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(8/131): ceph-common-18.0.0-3051.g4aa791bf.el8. 9.3 MB/s | 22 MB 00:02 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(9/131): ceph-selinux-18.0.0-3051.g4aa791bf.el8 366 kB/s | 24 kB 00:00 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(10/131): ceph-radosgw-18.0.0-3051.g4aa791bf.el 8.6 MB/s | 13 MB 00:01 2023-03-17T07:40:47.862 INFO:teuthology.orchestra.run.smithi082.stdout:(11/131): cephfs-mirror-18.0.0-3051.g4aa791bf.e 2.8 MB/s | 258 kB 00:00 2023-03-17T07:40:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:(12/131): libcephfs-devel-18.0.0-3051.g4aa791bf 407 kB/s | 30 kB 00:00 2023-03-17T07:40:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:(13/131): libcephfs2-18.0.0-3051.g4aa791bf.el8. 4.5 MB/s | 768 kB 00:00 2023-03-17T07:40:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:(14/131): libcephsqlite-18.0.0-3051.g4aa791bf.e 1.5 MB/s | 137 kB 00:00 2023-03-17T07:40:48.753 INFO:teuthology.orchestra.run.smithi082.stdout:(15/131): librados-devel-18.0.0-3051.g4aa791bf. 1.5 MB/s | 139 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(16/131): libradosstriper1-18.0.0-3051.g4aa791b 4.6 MB/s | 474 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(17/131): ceph-osd-18.0.0-3051.g4aa791bf.el8.x8 6.7 MB/s | 18 MB 00:02 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(18/131): python3-ceph-argparse-18.0.0-3051.g4a 447 kB/s | 45 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(19/131): python3-ceph-common-18.0.0-3051.g4aa7 1.1 MB/s | 117 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(20/131): python3-cephfs-18.0.0-3051.g4aa791bf. 1.7 MB/s | 190 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(21/131): python3-rados-18.0.0-3051.g4aa791bf.e 1.4 MB/s | 370 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(22/131): librgw2-18.0.0-3051.g4aa791bf.el8.x86 7.4 MB/s | 6.5 MB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(23/131): python3-rbd-18.0.0-3051.g4aa791bf.el8 2.4 MB/s | 365 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(24/131): python3-rgw-18.0.0-3051.g4aa791bf.el8 1.6 MB/s | 106 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(25/131): rbd-fuse-18.0.0-3051.g4aa791bf.el8.x8 1.4 MB/s | 94 kB 00:00 2023-03-17T07:40:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(26/131): rbd-nbd-18.0.0-3051.g4aa791bf.el8.x86 2.1 MB/s | 180 kB 00:00 2023-03-17T07:40:50.290 INFO:teuthology.orchestra.run.smithi082.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3051.g 346 kB/s | 23 kB 00:00 2023-03-17T07:40:50.290 INFO:teuthology.orchestra.run.smithi082.stdout:(28/131): ceph-mgr-cephadm-18.0.0-3051.g4aa791b 1.6 MB/s | 123 kB 00:00 2023-03-17T07:40:50.290 INFO:teuthology.orchestra.run.smithi082.stdout:(29/131): rbd-mirror-18.0.0-3051.g4aa791bf.el8. 7.2 MB/s | 3.5 MB 00:00 2023-03-17T07:40:50.290 INFO:teuthology.orchestra.run.smithi082.stdout:(30/131): ceph-mgr-dashboard-18.0.0-3051.g4aa79 3.7 MB/s | 1.7 MB 00:00 2023-03-17T07:40:50.291 INFO:teuthology.orchestra.run.smithi082.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3051.g4a 2.6 MB/s | 239 kB 00:00 2023-03-17T07:40:50.577 INFO:teuthology.orchestra.run.smithi082.stdout:(32/131): ceph-mgr-rook-18.0.0-3051.g4aa791bf.e 400 kB/s | 47 kB 00:00 2023-03-17T07:40:50.577 INFO:teuthology.orchestra.run.smithi082.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3051.g4 118 kB/s | 15 kB 00:00 2023-03-17T07:40:50.577 INFO:teuthology.orchestra.run.smithi082.stdout:(34/131): ceph-volume-18.0.0-3051.g4aa791bf.el8 1.7 MB/s | 263 kB 00:00 2023-03-17T07:40:50.577 INFO:teuthology.orchestra.run.smithi082.stdout:(35/131): cephadm-18.0.0-3051.g4aa791bf.el8.noa 1.1 MB/s | 83 kB 00:00 2023-03-17T07:40:50.577 INFO:teuthology.orchestra.run.smithi082.stdout:(36/131): cephfs-top-18.0.0-3051.g4aa791bf.el8. 241 kB/s | 18 kB 00:00 2023-03-17T07:40:50.577 INFO:teuthology.orchestra.run.smithi082.stdout:(37/131): ceph-test-18.0.0-3051.g4aa791bf.el8.x 11 MB/s | 41 MB 00:03 2023-03-17T07:40:52.618 INFO:teuthology.orchestra.run.smithi082.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-03-17T07:40:52.618 INFO:teuthology.orchestra.run.smithi082.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 524 kB/s | 306 kB 00:00 2023-03-17T07:40:52.618 INFO:teuthology.orchestra.run.smithi082.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 243 kB/s | 59 kB 00:00 2023-03-17T07:40:52.618 INFO:teuthology.orchestra.run.smithi082.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 346 kB/s | 75 kB 00:00 2023-03-17T07:40:52.618 INFO:teuthology.orchestra.run.smithi082.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 475 kB/s | 44 kB 00:00 2023-03-17T07:40:52.619 INFO:teuthology.orchestra.run.smithi082.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.6 MB/s | 476 kB 00:00 2023-03-17T07:40:52.619 INFO:teuthology.orchestra.run.smithi082.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 493 kB/s | 33 kB 00:00 2023-03-17T07:40:52.619 INFO:teuthology.orchestra.run.smithi082.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-03-17T07:40:52.619 INFO:teuthology.orchestra.run.smithi082.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-03-17T07:40:53.539 INFO:teuthology.orchestra.run.smithi082.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-03-17T07:40:53.539 INFO:teuthology.orchestra.run.smithi082.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-03-17T07:40:53.539 INFO:teuthology.orchestra.run.smithi082.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 647 kB/s | 81 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 165 kB/s | 11 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 262 kB/s | 18 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 389 kB/s | 49 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 602 kB/s | 60 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 184 kB/s | 16 kB 00:00 2023-03-17T07:40:53.540 INFO:teuthology.orchestra.run.smithi082.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 410 kB/s | 34 kB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(58/131): python3-kubernetes-11.0.0-6.el8.noarc 1.9 MB/s | 1.2 MB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 358 kB/s | 24 kB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 499 kB/s | 29 kB 00:00 2023-03-17T07:40:53.916 INFO:teuthology.orchestra.run.smithi082.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2023-03-17T07:40:54.280 INFO:teuthology.orchestra.run.smithi082.stdout:(64/131): python3-pecan-1.3.2-9.el8.noarch.rpm 457 kB/s | 283 kB 00:00 2023-03-17T07:40:54.280 INFO:teuthology.orchestra.run.smithi082.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 1.9 MB/s | 241 kB 00:00 2023-03-17T07:40:54.280 INFO:teuthology.orchestra.run.smithi082.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2023-03-17T07:40:54.280 INFO:teuthology.orchestra.run.smithi082.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-03-17T07:40:54.280 INFO:teuthology.orchestra.run.smithi082.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-03-17T07:40:54.280 INFO:teuthology.orchestra.run.smithi082.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 273 kB/s | 23 kB 00:00 2023-03-17T07:40:55.522 INFO:teuthology.orchestra.run.smithi082.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-03-17T07:40:55.522 INFO:teuthology.orchestra.run.smithi082.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-03-17T07:40:55.522 INFO:teuthology.orchestra.run.smithi082.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-03-17T07:40:55.522 INFO:teuthology.orchestra.run.smithi082.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-03-17T07:40:55.522 INFO:teuthology.orchestra.run.smithi082.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-03-17T07:40:55.522 INFO:teuthology.orchestra.run.smithi082.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 460 kB/s | 39 kB 00:00 2023-03-17T07:40:55.882 INFO:teuthology.orchestra.run.smithi082.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 28 MB/s | 14 MB 00:00 2023-03-17T07:40:55.882 INFO:teuthology.orchestra.run.smithi082.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 3.5 MB/s | 688 kB 00:00 2023-03-17T07:40:55.882 INFO:teuthology.orchestra.run.smithi082.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-03-17T07:40:55.882 INFO:teuthology.orchestra.run.smithi082.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.0 MB/s | 157 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 530 kB/s | 27 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(85/131): thrift-0.13.0-2.el8.x86_64.rpm 1.9 MB/s | 1.7 MB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 484 kB/s | 44 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.9 MB/s | 225 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(93/131): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-03-17T07:40:55.883 INFO:teuthology.orchestra.run.smithi082.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(97/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 621 kB/s | 47 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-03-17T07:40:55.884 INFO:teuthology.orchestra.run.smithi082.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 842 kB/s | 43 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(107/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 365 kB/s | 43 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(109/131): libsepol-devel-2.9-3.el8.x86_64.rpm 577 kB/s | 87 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.2 MB/s | 109 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2023-03-17T07:40:56.226 INFO:teuthology.orchestra.run.smithi082.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 371 kB/s | 19 kB 00:00 2023-03-17T07:40:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-03-17T07:40:58.983 INFO:teuthology.orchestra.run.smithi082.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-03-17T07:40:58.983 INFO:teuthology.orchestra.run.smithi082.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 304 kB/s | 18 kB 00:00 2023-03-17T07:40:58.984 INFO:teuthology.orchestra.run.smithi082.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.3 MB/s | 559 kB 00:00 2023-03-17T07:40:58.984 INFO:teuthology.orchestra.run.smithi082.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-03-17T07:40:58.984 INFO:teuthology.orchestra.run.smithi082.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-03-17T07:40:59.539 INFO:teuthology.orchestra.run.smithi082.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-03-17T07:40:59.539 INFO:teuthology.orchestra.run.smithi082.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-03-17T07:40:59.539 INFO:teuthology.orchestra.run.smithi082.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-03-17T07:40:59.539 INFO:teuthology.orchestra.run.smithi082.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-03-17T07:40:59.539 INFO:teuthology.orchestra.run.smithi082.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-17T07:40:59.539 INFO:teuthology.orchestra.run.smithi082.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.0 MB/s | 171 kB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.4 MB/s | 2.3 MB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(130/131): librbd1-18.0.0-3051.g4aa791bf.el8.x8 3.6 MB/s | 3.6 MB 00:00 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:(131/131): librados2-18.0.0-3051.g4aa791bf.el8. 2.8 MB/s | 3.7 MB 00:01 2023-03-17T07:41:00.790 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:41:02.112 INFO:teuthology.orchestra.run.smithi082.stdout:Total 17 MB/s | 197 MB 00:11 2023-03-17T07:41:02.112 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-03-17T07:41:02.112 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-03-17T07:41:02.112 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-03-17T07:41:02.112 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-03-17T07:41:02.113 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-03-17T07:41:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-03-17T07:41:02.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 9/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-17T07:41:02.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 14/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 14/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 15/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 15/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-17T07:41:02.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-17T07:41:02.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-17T07:41:02.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-17T07:41:02.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8. 26/134 2023-03-17T07:41:02.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el 27/134 2023-03-17T07:41:02.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_6 28/134 2023-03-17T07:41:02.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 36/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_6 37/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-17T07:41:03.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-17T07:41:03.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-17T07:41:03.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-17T07:41:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-17T07:41:05.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-17T07:41:05.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-17T07:41:05.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-17T07:41:05.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-17T07:41:05.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-17T07:41:05.106 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-17T07:41:05.106 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 92/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 92/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 93/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:05.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 95/134 2023-03-17T07:41:05.774 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 95/134 2023-03-17T07:41:05.774 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 96/134 2023-03-17T07:41:05.777 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:41:06.533 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 9/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-17T07:41:08.065 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 14/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 14/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 15/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 15/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-17T07:41:08.066 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-17T07:41:08.067 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-17T07:41:09.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-17T07:41:09.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-17T07:41:09.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-17T07:41:09.579 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8. 26/134 2023-03-17T07:41:09.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el 27/134 2023-03-17T07:41:09.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_6 28/134 2023-03-17T07:41:09.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-17T07:41:09.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-17T07:41:09.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-17T07:41:10.740 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-17T07:41:10.741 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-17T07:41:10.741 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-17T07:41:11.867 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 36/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_6 37/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-17T07:41:11.868 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-17T07:41:11.869 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-17T07:41:11.869 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-17T07:41:11.869 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-17T07:41:11.869 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-17T07:41:12.843 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-17T07:41:12.844 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-17T07:41:14.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-17T07:41:14.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-17T07:41:14.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-17T07:41:14.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-17T07:41:14.210 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-17T07:41:14.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-17T07:41:14.212 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-17T07:41:17.216 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-17T07:41:17.216 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-17T07:41:17.216 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-17T07:41:18.240 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-17T07:41:18.240 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-17T07:41:18.240 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-17T07:41:18.241 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-17T07:41:18.241 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-17T07:41:18.241 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-17T07:41:18.241 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 92/134 2023-03-17T07:41:18.241 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 92/134 2023-03-17T07:41:18.652 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 93/134 2023-03-17T07:41:18.652 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:18.652 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:18.652 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:18.652 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 95/134 2023-03-17T07:41:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 95/134 2023-03-17T07:41:20.045 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 96/134 2023-03-17T07:41:21.935 INFO:teuthology.orchestra.run.smithi035.stdout:(8/131): ceph-common-18.0.0-3051.g4aa791bf.el8. 7.2 MB/s | 22 MB 00:02 2023-03-17T07:41:26.819 INFO:teuthology.orchestra.run.smithi035.stdout:(9/131): ceph-selinux-18.0.0-3051.g4aa791bf.el8 325 kB/s | 24 kB 00:00 2023-03-17T07:41:26.819 INFO:teuthology.orchestra.run.smithi035.stdout:(10/131): ceph-osd-18.0.0-3051.g4aa791bf.el8.x8 6.6 MB/s | 18 MB 00:02 2023-03-17T07:41:26.819 INFO:teuthology.orchestra.run.smithi035.stdout:(11/131): cephfs-mirror-18.0.0-3051.g4aa791bf.e 3.0 MB/s | 258 kB 00:00 2023-03-17T07:41:26.819 INFO:teuthology.orchestra.run.smithi035.stdout:(12/131): libcephfs-devel-18.0.0-3051.g4aa791bf 365 kB/s | 30 kB 00:00 2023-03-17T07:41:27.663 INFO:teuthology.orchestra.run.smithi035.stdout:(13/131): libcephfs2-18.0.0-3051.g4aa791bf.el8. 3.5 MB/s | 768 kB 00:00 2023-03-17T07:41:27.663 INFO:teuthology.orchestra.run.smithi035.stdout:(14/131): libcephsqlite-18.0.0-3051.g4aa791bf.e 1.6 MB/s | 137 kB 00:00 2023-03-17T07:41:27.663 INFO:teuthology.orchestra.run.smithi035.stdout:(15/131): librados-devel-18.0.0-3051.g4aa791bf. 1.3 MB/s | 139 kB 00:00 2023-03-17T07:41:27.663 INFO:teuthology.orchestra.run.smithi035.stdout:(16/131): libradosstriper1-18.0.0-3051.g4aa791b 862 kB/s | 474 kB 00:00 2023-03-17T07:41:27.663 INFO:teuthology.orchestra.run.smithi035.stdout:(17/131): ceph-radosgw-18.0.0-3051.g4aa791bf.el 4.4 MB/s | 13 MB 00:02 2023-03-17T07:41:28.390 INFO:teuthology.orchestra.run.smithi035.stdout:(18/131): python3-ceph-argparse-18.0.0-3051.g4a 598 kB/s | 45 kB 00:00 2023-03-17T07:41:28.390 INFO:teuthology.orchestra.run.smithi035.stdout:(19/131): python3-ceph-common-18.0.0-3051.g4aa7 1.4 MB/s | 117 kB 00:00 2023-03-17T07:41:28.390 INFO:teuthology.orchestra.run.smithi035.stdout:(20/131): python3-cephfs-18.0.0-3051.g4aa791bf. 2.8 MB/s | 190 kB 00:00 2023-03-17T07:41:28.390 INFO:teuthology.orchestra.run.smithi035.stdout:(21/131): python3-rados-18.0.0-3051.g4aa791bf.e 2.7 MB/s | 370 kB 00:00 2023-03-17T07:41:28.391 INFO:teuthology.orchestra.run.smithi035.stdout:(22/131): python3-rbd-18.0.0-3051.g4aa791bf.el8 2.7 MB/s | 365 kB 00:00 2023-03-17T07:41:28.391 INFO:teuthology.orchestra.run.smithi035.stdout:(23/131): python3-rgw-18.0.0-3051.g4aa791bf.el8 1.6 MB/s | 106 kB 00:00 2023-03-17T07:41:28.391 INFO:teuthology.orchestra.run.smithi035.stdout:(24/131): rbd-fuse-18.0.0-3051.g4aa791bf.el8.x8 931 kB/s | 94 kB 00:00 2023-03-17T07:41:28.391 INFO:teuthology.orchestra.run.smithi035.stdout:(25/131): librgw2-18.0.0-3051.g4aa791bf.el8.x86 6.1 MB/s | 6.5 MB 00:01 2023-03-17T07:41:28.391 INFO:teuthology.orchestra.run.smithi035.stdout:(26/131): rbd-nbd-18.0.0-3051.g4aa791bf.el8.x86 2.3 MB/s | 180 kB 00:00 2023-03-17T07:41:30.403 INFO:teuthology.orchestra.run.smithi035.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3051.g 308 kB/s | 23 kB 00:00 2023-03-17T07:41:30.403 INFO:teuthology.orchestra.run.smithi035.stdout:(28/131): ceph-mgr-cephadm-18.0.0-3051.g4aa791b 1.4 MB/s | 123 kB 00:00 2023-03-17T07:41:30.403 INFO:teuthology.orchestra.run.smithi035.stdout:(29/131): ceph-mgr-dashboard-18.0.0-3051.g4aa79 4.7 MB/s | 1.7 MB 00:00 2023-03-17T07:41:30.403 INFO:teuthology.orchestra.run.smithi035.stdout:(30/131): rbd-mirror-18.0.0-3051.g4aa791bf.el8. 4.1 MB/s | 3.5 MB 00:00 2023-03-17T07:41:30.404 INFO:teuthology.orchestra.run.smithi035.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3051.g4a 2.6 MB/s | 239 kB 00:00 2023-03-17T07:41:30.404 INFO:teuthology.orchestra.run.smithi035.stdout:(32/131): ceph-mgr-rook-18.0.0-3051.g4aa791bf.e 632 kB/s | 47 kB 00:00 2023-03-17T07:41:30.404 INFO:teuthology.orchestra.run.smithi035.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3051.g4 218 kB/s | 15 kB 00:00 2023-03-17T07:41:31.704 INFO:teuthology.orchestra.run.smithi035.stdout:(34/131): ceph-volume-18.0.0-3051.g4aa791bf.el8 2.8 MB/s | 263 kB 00:00 2023-03-17T07:41:31.704 INFO:teuthology.orchestra.run.smithi035.stdout:(35/131): ceph-test-18.0.0-3051.g4aa791bf.el8.x 9.0 MB/s | 41 MB 00:04 2023-03-17T07:41:31.704 INFO:teuthology.orchestra.run.smithi035.stdout:(36/131): cephadm-18.0.0-3051.g4aa791bf.el8.noa 188 kB/s | 83 kB 00:00 2023-03-17T07:41:31.704 INFO:teuthology.orchestra.run.smithi035.stdout:(37/131): cephfs-top-18.0.0-3051.g4aa791bf.el8. 436 kB/s | 18 kB 00:00 2023-03-17T07:41:31.704 INFO:teuthology.orchestra.run.smithi035.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 320 kB/s | 59 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 874 kB/s | 44 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(42/131): libunwind-1.3.1-3.el8.x86_64.rpm 427 kB/s | 75 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 564 kB/s | 33 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-03-17T07:41:32.656 INFO:teuthology.orchestra.run.smithi035.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-03-17T07:41:34.011 INFO:teuthology.orchestra.run.smithi035.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-03-17T07:41:34.011 INFO:teuthology.orchestra.run.smithi035.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-03-17T07:41:34.011 INFO:teuthology.orchestra.run.smithi035.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-03-17T07:41:34.011 INFO:teuthology.orchestra.run.smithi035.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-03-17T07:41:34.011 INFO:teuthology.orchestra.run.smithi035.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-03-17T07:41:34.011 INFO:teuthology.orchestra.run.smithi035.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 969 kB/s | 49 kB 00:00 2023-03-17T07:41:34.014 INFO:teuthology.orchestra.run.smithi035.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-03-17T07:41:34.014 INFO:teuthology.orchestra.run.smithi035.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 656 kB/s | 60 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 673 kB/s | 34 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 476 kB/s | 24 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(62/131): python3-kubernetes-11.0.0-6.el8.noarc 2.5 MB/s | 1.2 MB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-03-17T07:41:34.887 INFO:teuthology.orchestra.run.smithi035.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 2.0 MB/s | 241 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 743 kB/s | 85 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 73 kB/s | 23 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(69/131): python3-webob-1.8.5-1.el8.1.noarch.rp 626 kB/s | 251 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 850 kB/s | 43 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 956 kB/s | 48 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-03-17T07:41:34.888 INFO:teuthology.orchestra.run.smithi035.stdout:(81/131): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 431 kB/s | 18 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.4 MB/s | 559 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.8 MB/s | 605 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-03-17T07:41:34.889 INFO:teuthology.orchestra.run.smithi035.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 6.3 MB/s | 644 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.7 MB/s | 171 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.6 MB/s | 2.3 MB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 723 kB/s | 54 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-03-17T07:41:34.890 INFO:teuthology.orchestra.run.smithi035.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.3 MB/s | 538 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-17T07:41:35.615 INFO:teuthology.orchestra.run.smithi035.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 639 kB/s | 27 kB 00:00 2023-03-17T07:41:36.853 INFO:teuthology.orchestra.run.smithi035.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-03-17T07:41:36.853 INFO:teuthology.orchestra.run.smithi035.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-03-17T07:41:36.853 INFO:teuthology.orchestra.run.smithi035.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-03-17T07:41:36.854 INFO:teuthology.orchestra.run.smithi035.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 5.4 MB/s | 457 kB 00:00 2023-03-17T07:41:36.854 INFO:teuthology.orchestra.run.smithi035.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 3.3 MB/s | 225 kB 00:00 2023-03-17T07:41:38.718 INFO:teuthology.orchestra.run.smithi035.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-03-17T07:41:38.718 INFO:teuthology.orchestra.run.smithi035.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 852 kB/s | 64 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.4 MB/s | 354 kB 00:00 2023-03-17T07:41:38.719 INFO:teuthology.orchestra.run.smithi035.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-03-17T07:41:38.720 INFO:teuthology.orchestra.run.smithi035.stdout:(125/131): postgresql-contrib-10.21-2.module+el 16 MB/s | 808 kB 00:00 2023-03-17T07:41:38.720 INFO:teuthology.orchestra.run.smithi035.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-03-17T07:41:38.720 INFO:teuthology.orchestra.run.smithi035.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 9.5 MB/s | 1.5 MB 00:00 2023-03-17T07:41:38.720 INFO:teuthology.orchestra.run.smithi035.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-03-17T07:41:38.720 INFO:teuthology.orchestra.run.smithi035.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-03-17T07:41:39.825 INFO:teuthology.orchestra.run.smithi035.stdout:(130/131): librbd1-18.0.0-3051.g4aa791bf.el8.x8 9.1 MB/s | 3.6 MB 00:00 2023-03-17T07:41:39.825 INFO:teuthology.orchestra.run.smithi035.stdout:(131/131): librados2-18.0.0-3051.g4aa791bf.el8. 6.7 MB/s | 3.7 MB 00:00 2023-03-17T07:41:39.825 INFO:teuthology.orchestra.run.smithi035.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:41:39.826 INFO:teuthology.orchestra.run.smithi035.stdout:Total 16 MB/s | 197 MB 00:11 2023-03-17T07:41:39.826 INFO:teuthology.orchestra.run.smithi035.stdout:Running transaction check 2023-03-17T07:41:39.826 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction check succeeded. 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout:Running transaction test 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout:Transaction test succeeded. 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout:Running transaction 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout: Preparing : 1/1 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-17T07:41:41.896 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-03-17T07:41:42.667 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-17T07:41:42.667 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-03-17T07:41:42.667 INFO:teuthology.orchestra.run.smithi035.stdout: Upgrading : librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 5/134 2023-03-17T07:41:42.667 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 5/134 2023-03-17T07:41:42.667 INFO:teuthology.orchestra.run.smithi035.stdout: Upgrading : librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:41:44.093 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:41:45.563 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 14/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 14/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 15/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 15/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-03-17T07:41:45.564 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-17T07:41:46.438 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-03-17T07:41:46.438 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-17T07:41:46.438 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-03-17T07:41:46.438 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-17T07:41:46.438 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-03-17T07:41:46.438 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-03-17T07:41:48.016 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-03-17T07:41:48.016 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-03-17T07:41:48.016 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-03-17T07:41:48.016 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-17T07:41:48.017 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8. 26/134 2023-03-17T07:41:48.017 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el 27/134 2023-03-17T07:41:48.017 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_6 28/134 2023-03-17T07:41:48.017 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-17T07:41:48.017 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-03-17T07:41:48.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-03-17T07:41:48.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-03-17T07:41:48.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 36/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_6 37/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-03-17T07:41:48.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-03-17T07:41:48.548 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-03-17T07:41:48.548 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-03-17T07:41:48.548 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-03-17T07:41:48.548 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-17T07:41:50.234 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-03-17T07:41:50.234 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-03-17T07:41:50.235 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-03-17T07:41:50.236 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-03-17T07:41:50.237 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-03-17T07:41:50.237 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-03-17T07:41:50.237 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-03-17T07:41:51.299 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-03-17T07:41:51.299 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-17T07:41:51.874 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-17T07:41:51.875 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-17T07:41:52.885 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-17T07:41:52.886 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-17T07:41:52.886 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-17T07:41:52.886 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-17T07:41:52.886 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-17T07:41:52.886 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-17T07:41:54.100 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 92/134 2023-03-17T07:41:54.100 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 92/134 2023-03-17T07:41:54.100 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 93/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 94/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 95/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 95/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 96/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 96/134 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /sys 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /proc 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /dev 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /run 2023-03-17T07:41:55.614 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /mnt 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /var/tmp 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /home 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /tmp 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout:skipping the directory /dev 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 97/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 97/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 98/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 98/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 99/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 99/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 100/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 100/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 101/134 2023-03-17T07:41:55.615 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 101/134 2023-03-17T07:41:57.350 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.e 102/134 2023-03-17T07:41:57.350 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf. 103/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 104/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 104/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 105/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 105/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 106/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 106/134 2023-03-17T07:41:57.351 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el 107/134 2023-03-17T07:41:57.857 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 108/134 2023-03-17T07:41:57.857 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 108/134 2023-03-17T07:41:57.857 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 109/134 2023-03-17T07:41:57.857 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 109/134 2023-03-17T07:41:57.858 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 110/134 2023-03-17T07:41:57.858 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 111/134 2023-03-17T07:41:57.858 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 111/134 2023-03-17T07:41:57.858 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 112/134 2023-03-17T07:41:57.858 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 112/134 2023-03-17T07:41:59.870 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 96/134 2023-03-17T07:42:00.763 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2023-03-17T07:42:04.420 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2023-03-17T07:42:04.420 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 97/134 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 97/134 2023-03-17T07:42:04.421 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 98/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 98/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 99/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 99/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 100/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 100/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 101/134 2023-03-17T07:42:05.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 101/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.e 102/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf. 103/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 104/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 104/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 105/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 105/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 106/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 106/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el 107/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 108/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 108/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 109/134 2023-03-17T07:42:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 109/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 110/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 111/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 111/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 112/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 112/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 113/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 113/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 114/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 114/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 115/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-17T07:42:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-17T07:42:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 119/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_ 121/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:42:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 124/134 2023-03-17T07:42:10.217 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 125/134 2023-03-17T07:42:10.217 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 126/134 2023-03-17T07:42:10.217 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-17T07:42:10.217 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-17T07:42:10.217 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-17T07:42:10.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-17T07:42:10.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-17T07:42:10.218 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-17T07:42:10.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-17T07:42:10.218 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-17T07:42:10.723 INFO:teuthology.orchestra.run.smithi082.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 1/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 2/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 3/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 4/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 5/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 9/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 10/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 11/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 12/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 13/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_ 14/134 2023-03-17T07:42:10.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 15/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 16/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_6 17/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 18/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 19/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el 20/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8. 21/134 2023-03-17T07:42:10.725 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_6 22/134 2023-03-17T07:42:11.140 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 23/134 2023-03-17T07:42:11.141 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 24/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 25/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 26/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 27/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 28/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf. 29/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 30/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 31/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 32/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el 33/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 34/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.e 35/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 36/134 2023-03-17T07:42:11.436 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 37/134 2023-03-17T07:42:11.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 38/134 2023-03-17T07:42:11.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-17T07:42:11.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-17T07:42:11.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-17T07:42:11.437 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-17T07:42:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-17T07:42:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-17T07:42:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-17T07:42:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-17T07:42:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-17T07:42:11.941 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-17T07:42:12.358 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-17T07:42:12.529 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-17T07:42:12.529 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-17T07:42:12.529 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-17T07:42:12.529 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-17T07:42:12.529 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-17T07:42:12.529 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-17T07:42:12.693 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-17T07:42:12.694 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-17T07:42:13.288 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-17T07:42:13.288 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-17T07:42:13.288 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-17T07:42:13.288 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-17T07:42:13.288 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-17T07:42:13.588 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-17T07:42:13.881 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-17T07:42:13.881 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-17T07:42:13.882 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-17T07:42:13.883 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-17T07:42:13.883 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-17T07:42:14.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 129/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 131/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:42:14.428 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:46 ago on Fri 17 Mar 2023 07:39:41 AM UTC. 2023-03-17T07:42:14.429 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2023-03-17T07:42:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:42:15.323 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2023-03-17T07:42:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-17T07:42:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:15.323 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-7.el8.noarch 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:16.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:16.066 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:16.066 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.019 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.019 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.019 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.019 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.019 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.019 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.020 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.020 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2023-03-17T07:42:17.487 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-3.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libpq-13.5-1.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.488 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-17T07:42:17.489 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-17T07:42:19.681 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-17T07:42:19.681 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-17T07:42:19.681 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-17T07:42:19.681 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-17T07:42:19.682 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-17T07:42:19.683 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-17T07:42:19.684 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-17T07:42:19.684 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-17T07:42:19.684 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-17T07:42:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-17T07:42:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-17T07:42:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-17T07:42:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-17T07:42:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-17T07:42:22.045 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-17T07:42:22.718 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-17T07:42:22.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-17T07:42:22.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-17T07:42:22.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-17T07:42:22.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-17T07:42:22.719 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:24.435 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:24.436 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-17T07:42:25.289 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-17T07:42:25.290 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-17T07:42:25.892 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-17T07:42:25.892 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-17T07:42:25.892 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:42:25.892 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-03-17T07:42:25.894 DEBUG:teuthology.parallel:result is None 2023-03-17T07:42:30.021 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 96/134 2023-03-17T07:42:31.197 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2023-03-17T07:42:31.197 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2023-03-17T07:42:31.197 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2023-03-17T07:42:31.197 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /run 2023-03-17T07:42:31.197 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2023-03-17T07:42:31.198 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2023-03-17T07:42:35.326 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2023-03-17T07:42:35.326 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2023-03-17T07:42:35.326 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /dev 2023-03-17T07:42:35.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:42:35.327 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 97/134 2023-03-17T07:42:35.327 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 97/134 2023-03-17T07:42:35.327 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 98/134 2023-03-17T07:42:35.745 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 98/134 2023-03-17T07:42:35.746 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 99/134 2023-03-17T07:42:35.746 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 99/134 2023-03-17T07:42:35.746 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 100/134 2023-03-17T07:42:35.746 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 100/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 101/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 101/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.e 102/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf. 103/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 104/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 104/134 2023-03-17T07:42:36.887 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 105/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 105/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 106/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 106/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el 107/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 108/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 108/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 109/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 109/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 110/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 111/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 111/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 112/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 112/134 2023-03-17T07:42:36.888 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 113/134 2023-03-17T07:42:36.889 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 113/134 2023-03-17T07:42:36.889 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 114/134 2023-03-17T07:42:36.889 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 114/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 115/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 119/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-17T07:42:37.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_ 121/134 2023-03-17T07:42:37.148 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-17T07:42:38.197 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:42:38.197 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:42:38.197 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:42:38.198 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 124/134 2023-03-17T07:42:38.198 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 125/134 2023-03-17T07:42:38.198 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 126/134 2023-03-17T07:42:38.198 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:42:38.656 INFO:teuthology.orchestra.run.smithi078.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 1/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 2/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 3/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 4/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 5/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 9/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 10/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 11/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 12/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 13/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_ 14/134 2023-03-17T07:42:38.657 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 15/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 16/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_6 17/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 18/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 19/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el 20/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8. 21/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_6 22/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 23/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 24/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 25/134 2023-03-17T07:42:38.658 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 26/134 2023-03-17T07:42:39.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 27/134 2023-03-17T07:42:39.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 28/134 2023-03-17T07:42:39.546 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf. 29/134 2023-03-17T07:42:40.193 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 30/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 31/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 32/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el 33/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 34/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.e 35/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 36/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 37/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 38/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-17T07:42:41.379 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-17T07:42:41.380 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-17T07:42:42.295 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-17T07:42:42.296 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-17T07:42:45.653 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-17T07:42:45.653 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-17T07:42:45.653 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-17T07:42:45.653 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-17T07:42:45.653 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-17T07:42:45.653 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-17T07:42:46.683 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-17T07:42:46.683 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-17T07:42:46.683 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-17T07:42:46.683 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-17T07:42:46.683 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-17T07:42:48.353 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-17T07:42:48.353 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-17T07:42:48.353 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-17T07:42:48.969 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-17T07:42:48.969 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-17T07:42:48.969 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-17T07:42:48.970 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-17T07:42:48.971 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-17T07:42:51.018 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-17T07:42:51.018 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-17T07:42:51.018 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-17T07:42:51.019 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-17T07:42:51.635 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-17T07:42:53.057 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-17T07:42:54.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-17T07:42:54.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-17T07:42:54.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-17T07:42:54.132 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 129/134 2023-03-17T07:42:56.352 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-17T07:42:56.352 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 131/134 2023-03-17T07:42:56.352 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:42:56.353 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-17T07:42:56.353 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:42:56.353 INFO:teuthology.orchestra.run.smithi078.stdout:Last metadata expiration check: 0:01:54 ago on Fri 17 Mar 2023 07:39:42 AM UTC. 2023-03-17T07:42:56.353 INFO:teuthology.orchestra.run.smithi078.stdout:Installed products updated. 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.1-7.el8.noarch 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.0.4-10.el8.x86_64 2023-03-17T07:42:58.539 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.540 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.1-9.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.6-3.el8.x86_64 2023-03-17T07:42:58.541 INFO:teuthology.orchestra.run.smithi078.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-17T07:42:58.542 INFO:teuthology.orchestra.run.smithi078.stdout: libpq-13.5-1.el8.x86_64 2023-03-17T07:42:58.543 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-17T07:43:06.051 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-17T07:43:06.051 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:06.051 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:06.052 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-17T07:43:06.876 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:06.876 INFO:teuthology.orchestra.run.smithi078.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-17T07:43:06.876 INFO:teuthology.orchestra.run.smithi078.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-17T07:43:06.876 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:43:06.877 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:07.789 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-17T07:43:09.272 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-17T07:43:09.273 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-17T07:43:09.273 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-17T07:43:09.273 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-17T07:43:10.351 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-17T07:43:10.351 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-17T07:43:10.351 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-17T07:43:10.854 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-2.6-1.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-17T07:43:10.855 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-17T07:43:10.856 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-17T07:43:11.695 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-17T07:43:11.695 INFO:teuthology.orchestra.run.smithi078.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-17T07:43:11.695 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-17T07:43:11.695 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-17T07:43:11.695 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-17T07:43:12.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-17T07:43:12.130 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-17T07:43:12.913 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-17T07:43:12.913 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-17T07:43:12.913 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-17T07:43:12.913 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-17T07:43:13.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-03-17T07:43:13.544 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-03-17T07:43:13.546 DEBUG:teuthology.parallel:result is None 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 113/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 113/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 114/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 114/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 115/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 117/134 2023-03-17T07:43:13.546 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_ 121/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 124/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 125/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 126/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-03-17T07:43:13.547 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-03-17T07:43:14.955 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-17T07:43:14.955 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 1/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 2/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 3/134 2023-03-17T07:43:14.956 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 4/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3051.g4aa79 5/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 6/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 7/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 8/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 9/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 10/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 11/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 12/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 13/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_ 14/134 2023-03-17T07:43:14.957 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 15/134 2023-03-17T07:43:16.411 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 16/134 2023-03-17T07:43:16.411 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_6 17/134 2023-03-17T07:43:16.411 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86 18/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 19/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el 20/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8. 21/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_6 22/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 23/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 24/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 25/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 26/134 2023-03-17T07:43:16.412 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 27/134 2023-03-17T07:43:16.413 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 28/134 2023-03-17T07:43:16.413 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf. 29/134 2023-03-17T07:43:16.413 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noa 30/134 2023-03-17T07:43:17.305 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.n 31/134 2023-03-17T07:43:17.305 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa 32/134 2023-03-17T07:43:17.305 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el 33/134 2023-03-17T07:43:17.305 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 34/134 2023-03-17T07:43:17.305 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.e 35/134 2023-03-17T07:43:17.306 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 36/134 2023-03-17T07:43:17.306 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 37/134 2023-03-17T07:43:17.306 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 38/134 2023-03-17T07:43:17.306 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-17T07:43:17.868 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-17T07:43:18.826 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-17T07:43:18.827 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-17T07:43:18.827 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-17T07:43:18.827 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-17T07:43:18.827 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-17T07:43:18.827 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-03-17T07:43:18.828 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-03-17T07:43:18.829 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-03-17T07:43:19.433 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-03-17T07:43:19.434 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-03-17T07:43:19.435 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-03-17T07:43:21.446 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-03-17T07:43:21.446 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-03-17T07:43:21.446 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-03-17T07:43:23.005 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-03-17T07:43:23.005 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 129/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 131/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout:Last metadata expiration check: 0:01:51 ago on Fri 17 Mar 2023 07:39:46 AM UTC. 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout:Installed products updated. 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout:Upgraded: 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: librados2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: librbd1-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout:Installed: 2023-03-17T07:43:23.006 INFO:teuthology.orchestra.run.smithi035.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: automake-1.16.1-7.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: bison-3.0.4-10.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-base-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-grafana-dashboards-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-immutable-object-cache-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mds-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-dashboard-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-modules-core-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-rook-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mon-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.007 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-osd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-prometheus-alerts-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-radosgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-selinux-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-test-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-volume-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: cephadm-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: cephfs-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: cephfs-top-2:18.0.0-3051.g4aa791bf.el8.noarch 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: flex-2.6.1-9.el8.x86_64 2023-03-17T07:43:23.008 INFO:teuthology.orchestra.run.smithi035.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-17T07:43:25.001 INFO:teuthology.orchestra.run.smithi035.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: jq-1.6-3.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libcephfs-devel-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libcephfs2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libcephsqlite-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-17T07:43:27.472 INFO:teuthology.orchestra.run.smithi035.stdout: libpq-13.5-1.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: librados-devel-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: libradosstriper1-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: librgw2-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-17T07:43:27.473 INFO:teuthology.orchestra.run.smithi035.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-17T07:43:27.474 INFO:teuthology.orchestra.run.smithi035.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-17T07:43:27.474 INFO:teuthology.orchestra.run.smithi035.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-17T07:43:28.853 INFO:teuthology.orchestra.run.smithi035.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-17T07:43:28.853 INFO:teuthology.orchestra.run.smithi035.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-17T07:43:28.853 INFO:teuthology.orchestra.run.smithi035.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-17T07:43:28.853 INFO:teuthology.orchestra.run.smithi035.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-17T07:43:30.325 INFO:teuthology.orchestra.run.smithi035.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-ceph-argparse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-ceph-common-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cephfs-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-17T07:43:30.326 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-portend-2.6-1.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-17T07:43:30.327 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rados-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rgw-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-17T07:43:30.328 INFO:teuthology.orchestra.run.smithi035.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-17T07:43:30.329 INFO:teuthology.orchestra.run.smithi035.stdout: rbd-fuse-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.329 INFO:teuthology.orchestra.run.smithi035.stdout: rbd-mirror-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.329 INFO:teuthology.orchestra.run.smithi035.stdout: rbd-nbd-2:18.0.0-3051.g4aa791bf.el8.x86_64 2023-03-17T07:43:30.412 INFO:teuthology.orchestra.run.smithi035.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-17T07:43:30.412 INFO:teuthology.orchestra.run.smithi035.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-17T07:43:30.412 INFO:teuthology.orchestra.run.smithi035.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-17T07:43:30.412 INFO:teuthology.orchestra.run.smithi035.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-17T07:43:31.427 INFO:teuthology.orchestra.run.smithi035.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-17T07:43:31.428 INFO:teuthology.orchestra.run.smithi035.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-17T07:43:31.428 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:43:32.278 INFO:teuthology.orchestra.run.smithi035.stdout:Complete! 2023-03-17T07:43:32.278 DEBUG:teuthology.parallel:result is None 2023-03-17T07:43:32.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:43:32.430 DEBUG:teuthology.orchestra.run.smithi035:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-17T07:43:33.728 INFO:teuthology.orchestra.run.smithi035.stdout:18.0.0-3051.g4aa791bf.el8 2023-03-17T07:43:35.258 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3051.g4aa791bf.el8 2023-03-17T07:43:36.073 INFO:teuthology.task.install:The correct ceph version 18.0.0-3051.g4aa791bf is installed. 2023-03-17T07:43:36.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:43:36.210 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-17T07:43:36.923 INFO:teuthology.orchestra.run.smithi078.stdout:18.0.0-3051.g4aa791bf.el8 2023-03-17T07:43:37.918 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3051.g4aa791bf.el8 2023-03-17T07:43:38.954 INFO:teuthology.task.install:The correct ceph version 18.0.0-3051.g4aa791bf is installed. 2023-03-17T07:43:38.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:43:39.089 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-17T07:43:40.442 INFO:teuthology.orchestra.run.smithi082.stdout:18.0.0-3051.g4aa791bf.el8 2023-03-17T07:43:41.409 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3051.g4aa791bf.el8 2023-03-17T07:43:43.821 INFO:teuthology.task.install:The correct ceph version 18.0.0-3051.g4aa791bf is installed. 2023-03-17T07:43:43.821 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-17T07:43:43.821 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:43:43.822 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-17T07:43:43.870 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:43:44.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-17T07:43:44.905 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:43:45.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-17T07:43:46.203 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-17T07:43:47.176 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:43:47.176 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/usr/bin/daemon-helper 2023-03-17T07:43:47.210 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-17T07:43:48.459 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:43:50.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-03-17T07:43:50.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-17T07:43:52.816 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:43:54.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-03-17T07:43:54.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-17T07:43:56.008 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-17T07:43:57.241 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:43:57.241 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-17T07:43:57.275 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-17T07:43:58.483 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:43:59.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-17T07:43:59.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-17T07:43:59.522 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:44:00.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-17T07:44:01.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-17T07:44:02.093 INFO:teuthology.run_tasks:Running task cephadm... 2023-03-17T07:44:02.963 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c', 'subvols': {'create': 2}} 2023-03-17T07:44:09.658 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:44:09.668 INFO:tasks.cephadm:Cluster fsid is 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:44:11.447 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-03-17T07:44:11.448 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.35', 'mon.b': '172.21.15.78', 'mon.c': '172.21.15.82'} 2023-03-17T07:44:12.061 INFO:tasks.cephadm:First mon is mon.a on smithi035 2023-03-17T07:44:12.062 INFO:tasks.cephadm:First mgr is x 2023-03-17T07:44:12.062 INFO:tasks.cephadm:Normalizing hostnames... 2023-03-17T07:44:12.062 DEBUG:teuthology.orchestra.run.smithi035:> sudo hostname $(hostname -s) 2023-03-17T07:44:12.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname $(hostname -s) 2023-03-17T07:44:19.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2023-03-17T07:44:20.985 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-03-17T07:44:22.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:44:23.073 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4aa791bf129eece187e94ddbfa7c2b475588cf0c', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/68744/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-3051-g4aa791bf', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-3051.g4aa791bf'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-03-16 23:14:47.784798', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20230316.214637', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-03-17T07:44:24.817 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-pdonnell-testing-20230316.214637, sha1 4aa791bf129eece187e94ddbfa7c2b475588cf0c from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T07:44:25.898 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/x86_64/flavors/default/cephadm 2023-03-17T07:44:25.898 DEBUG:teuthology.orchestra.run.smithi035:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:26.293 INFO:teuthology.orchestra.run.smithi035.stdout:-rw-rw-r--. 1 ubuntu ubuntu 381328 Mar 17 07:44 /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:26.795 DEBUG:teuthology.orchestra.run.smithi078:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:28.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-rw-r--. 1 ubuntu ubuntu 381328 Mar 17 07:44 /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:30.199 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230316.214637/4aa791bf129eece187e94ddbfa7c2b475588cf0c/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:30.587 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-rw-r--. 1 ubuntu ubuntu 381328 Mar 17 07:44 /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:31.911 DEBUG:teuthology.orchestra.run.smithi035:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:31.933 DEBUG:teuthology.orchestra.run.smithi078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:33.299 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-03-17T07:44:34.408 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c on all hosts... 2023-03-17T07:44:35.433 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c pull 2023-03-17T07:44:35.435 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c pull 2023-03-17T07:44:35.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c pull 2023-03-17T07:44:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c... 2023-03-17T07:44:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c... 2023-03-17T07:44:38.439 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c... 2023-03-17T07:45:10.758 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-03-17T07:45:11.306 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev)", 2023-03-17T07:45:11.306 INFO:teuthology.orchestra.run.smithi078.stdout: "image_id": "ba7c89c5733003c2152a4d55c7a824f56349867eae02d8004c85ca8c92be6420", 2023-03-17T07:45:11.306 INFO:teuthology.orchestra.run.smithi078.stdout: "repo_digests": [ 2023-03-17T07:45:11.306 INFO:teuthology.orchestra.run.smithi078.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d17dc5d073a33e4a5e643e6fbaa604cecf1be416da1848880d1e8f16942eb0b3" 2023-03-17T07:45:11.306 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-03-17T07:45:11.306 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-03-17T07:45:11.753 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T07:45:11.851 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_version": "ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev)", 2023-03-17T07:45:11.851 INFO:teuthology.orchestra.run.smithi035.stdout: "image_id": "ba7c89c5733003c2152a4d55c7a824f56349867eae02d8004c85ca8c92be6420", 2023-03-17T07:45:11.851 INFO:teuthology.orchestra.run.smithi035.stdout: "repo_digests": [ 2023-03-17T07:45:11.851 INFO:teuthology.orchestra.run.smithi035.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d17dc5d073a33e4a5e643e6fbaa604cecf1be416da1848880d1e8f16942eb0b3" 2023-03-17T07:45:11.851 INFO:teuthology.orchestra.run.smithi035.stdout: ] 2023-03-17T07:45:11.851 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T07:45:13.041 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-03-17T07:45:13.554 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev)", 2023-03-17T07:45:13.554 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "ba7c89c5733003c2152a4d55c7a824f56349867eae02d8004c85ca8c92be6420", 2023-03-17T07:45:13.554 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2023-03-17T07:45:13.554 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d17dc5d073a33e4a5e643e6fbaa604cecf1be416da1848880d1e8f16942eb0b3" 2023-03-17T07:45:13.554 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-03-17T07:45:13.555 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-03-17T07:45:13.556 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /etc/ceph 2023-03-17T07:45:14.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph 2023-03-17T07:45:15.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2023-03-17T07:45:16.666 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 777 /etc/ceph 2023-03-17T07:45:17.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /etc/ceph 2023-03-17T07:45:18.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2023-03-17T07:45:19.940 INFO:tasks.cephadm:Writing seed config... 2023-03-17T07:45:21.346 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-03-17T07:45:21.346 INFO:tasks.cephadm: override: [client] debug client = 20 2023-03-17T07:45:21.346 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-03-17T07:45:21.346 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-03-17T07:45:22.174 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-03-17T07:45:22.175 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-03-17T07:45:23.087 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-03-17T07:45:23.087 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-03-17T07:45:23.087 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-03-17T07:45:23.087 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-03-17T07:45:23.088 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-03-17T07:45:23.089 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:45:23.937 DEBUG:teuthology.orchestra.run.smithi035:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-03-17T07:45:25.196 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 80b32574-c497-11ed-9afb-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-03-17T07:45:25.631 DEBUG:teuthology.orchestra.run.smithi035:mon.a> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.a.service 2023-03-17T07:45:30.269 DEBUG:teuthology.orchestra.run.smithi035:mgr.x> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.x.service 2023-03-17T07:45:30.301 INFO:journalctl@ceph.mon.a.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T07:45:34.111 INFO:tasks.cephadm:Bootstrapping... 2023-03-17T07:45:34.111 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c -v bootstrap --fsid 80b32574-c497-11ed-9afb-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.35 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-03-17T07:45:34.112 INFO:journalctl@ceph.mgr.x.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T07:45:34.398 INFO:teuthology.orchestra.run.smithi035.stdout:-------------------------------------------------------------------------------- 2023-03-17T07:45:36.604 INFO:teuthology.orchestra.run.smithi035.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c', '-v', 'bootstrap', '--fsid', '80b32574-c497-11ed-9afb-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.35', '--skip-admin-label'] 2023-03-17T07:45:38.868 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stdout 4.1.1 2023-03-17T07:45:38.869 INFO:teuthology.orchestra.run.smithi035.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-03-17T07:45:38.873 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying podman|docker is present... 2023-03-17T07:45:40.673 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stdout 4.1.1 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying lvm2 is present... 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying time synchronization is in place... 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout inactive 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout enabled 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout active 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Unit chronyd.service is enabled and running 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Repeating the final host check... 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stdout 4.1.1 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:podman (/bin/podman) version 4.1.1 is present 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl is present 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:lvcreate is present 2023-03-17T07:45:40.674 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout inactive 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout enabled 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout active 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Unit chronyd.service is enabled and running 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Host looks OK 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Cluster fsid: 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Acquiring lock 140199198849512 on /run/cephadm/80b32574-c497-11ed-9afb-001a4aab830c.lock 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Lock 140199198849512 acquired on /run/cephadm/80b32574-c497-11ed-9afb-001a4aab830c.lock 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying IP 172.21.15.35 port 3300 ... 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying IP 172.21.15.35 port 6789 ... 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:Base mon IP(s) is [172.21.15.35:3300, 172.21.15.35:6789], mon addrv is [v2:172.21.15.35:3300,v1:172.21.15.35:6789] 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-03-17T07:45:40.675 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.35 metric 100 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1782sec hoplimit 64 pref medium 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25f6/64 scope link 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:Mon IP `172.21.15.35` is in CIDR network `172.21.0.0/20` 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:Mon IP `172.21.15.35` is in CIDR network `172.21.0.0/20` 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c... 2023-03-17T07:45:40.676 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stdout ba7c89c5733003c2152a4d55c7a824f56349867eae02d8004c85ca8c92be6420 2023-03-17T07:45:41.399 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c... 2023-03-17T07:45:43.744 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Getting image source signatures 2023-03-17T07:45:44.581 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Copying blob sha256:9049d186446395f8049501873280ae0e5df8a48b4b3ddd4ca6c9c0caa8e0bfcd 2023-03-17T07:45:44.581 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Copying blob sha256:e8273662897a8d884c6f0dc47291edd7e6000e44d20afd185182e3ace70cf9b9 2023-03-17T07:45:44.581 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Copying config sha256:ba7c89c5733003c2152a4d55c7a824f56349867eae02d8004c85ca8c92be6420 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Writing manifest to image destination 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:/bin/podman: stderr Storing signatures 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:ceph: stdout ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:Ceph version: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:Extracting ceph user uid/gid from container image... 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:stat: stdout 167 167 2023-03-17T07:45:46.133 INFO:teuthology.orchestra.run.smithi035.stdout:Creating initial keys... 2023-03-17T07:45:46.134 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph-authtool: stdout AQCjGhRkUZDOERAACGcrKdyABdRnRpflm2A5ng== 2023-03-17T07:45:46.134 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph-authtool: stdout AQCnGhRkOBp7LhAAVQeuLYsKetYubuN1PzldAw== 2023-03-17T07:45:46.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph-authtool: stdout AQCqGhRkKDOJFBAAVfT4XnbnoydDoL3hFZvDOw== 2023-03-17T07:45:48.348 INFO:teuthology.orchestra.run.smithi035.stdout:Creating initial monmap... 2023-03-17T07:45:48.348 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-03-17T07:45:48.349 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-03-17T07:45:48.349 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:45:50.423 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-03-17T07:45:51.500 INFO:teuthology.orchestra.run.smithi035.stdout:monmaptool for a [v2:172.21.15.35:3300,v1:172.21.15.35:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-03-17T07:45:51.500 INFO:teuthology.orchestra.run.smithi035.stdout:setting min_mon_release = pacific 2023-03-17T07:45:51.500 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/monmaptool: set fsid to 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:45:51.500 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-03-17T07:45:52.681 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:45:52.681 INFO:teuthology.orchestra.run.smithi035.stdout:Creating mon... 2023-03-17T07:45:52.681 INFO:teuthology.orchestra.run.smithi035.stdout:create mon.a on 2023-03-17T07:45:52.681 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-03-17T07:45:52.681 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-03-17T07:45:52.683 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-80b32574-c497-11ed-9afb-001a4aab830c.target → /etc/systemd/system/ceph-80b32574-c497-11ed-9afb-001a4aab830c.target. 2023-03-17T07:45:54.694 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-80b32574-c497-11ed-9afb-001a4aab830c.target → /etc/systemd/system/ceph-80b32574-c497-11ed-9afb-001a4aab830c.target. 2023-03-17T07:45:54.694 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.a 2023-03-17T07:45:54.694 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Failed to reset failed state of unit ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.a.service: Unit ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.a.service not loaded. 2023-03-17T07:45:54.694 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-80b32574-c497-11ed-9afb-001a4aab830c.target.wants/ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-80b32574-c497-11ed-9afb-001a4aab830c@.service. 2023-03-17T07:45:54.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:48 smithi035 systemd[1]: Starting Ceph mon.a for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T07:45:54.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:48 smithi035 podman[91982]: 2023-03-17T07:45:54.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:49 smithi035 bash[91982]: a7f9c3336223a6804b78d99fbb687e811227d062aa9fcc5029a9b88aa1e13e81 2023-03-17T07:45:54.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:49 smithi035 ceph-mon[92022]: mkfs 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:45:54.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:49 smithi035 ceph-mon[92022]: mon.a is new leader, mons a in quorum (ranks 0) 2023-03-17T07:45:54.696 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-17T07:45:54.696 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout disabled 2023-03-17T07:45:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-17T07:45:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout inactive 2023-03-17T07:45:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:firewalld.service is not enabled 2023-03-17T07:45:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:Not possible to enable service . firewalld.service is not available 2023-03-17T07:45:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for mon to start... 2023-03-17T07:45:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for mon... 2023-03-17T07:45:56.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:49 smithi035 systemd[1]: Started Ceph mon.a for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T07:45:57.598 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout cluster: 2023-03-17T07:46:01.057 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout id: 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout services: 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.671518s) 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-03-17T07:46:01.058 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:46:01.917 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout data: 2023-03-17T07:46:02.712 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-03-17T07:46:02.712 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-03-17T07:46:02.712 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-03-17T07:46:02.712 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout pgs: 2023-03-17T07:46:02.712 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:46:04.145 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e2c41700 1 Processor -- start 2023-03-17T07:46:04.145 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e2c41700 1 -- start start 2023-03-17T07:46:04.148 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e2c41700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc108830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e2c41700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc079cf0 con 0x7fb6dc106450 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e09dd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc108830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e09dd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc108830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38822/0 (socket says 172.21.15.35:38822) 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.753+0000 7fb6e09dd700 1 -- 172.21.15.35:0/2499327947 learned_addr learned my addr 172.21.15.35:0/2499327947 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.754+0000 7fb6e09dd700 1 -- 172.21.15.35:0/2499327947 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc079e30 con 0x7fb6dc106450 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.754+0000 7fb6e09dd700 1 --2- 172.21.15.35:0/2499327947 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc108830 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00098a0 tx=0x7fb6d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a9733c82f506f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:46:05.785 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.754+0000 7fb6db7fe700 1 -- 172.21.15.35:0/2499327947 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6d0004160 con 0x7fb6dc106450 2023-03-17T07:46:07.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.754+0000 7fb6db7fe700 1 -- 172.21.15.35:0/2499327947 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d00042c0 con 0x7fb6dc106450 2023-03-17T07:46:07.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.754+0000 7fb6db7fe700 1 -- 172.21.15.35:0/2499327947 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6d00045a0 con 0x7fb6dc106450 2023-03-17T07:46:07.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 -- 172.21.15.35:0/2499327947 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 msgr2=0x7fb6dc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:46:07.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 --2- 172.21.15.35:0/2499327947 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc108830 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00098a0 tx=0x7fb6d0009bb0 comp rx=0 tx=0).stop 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 -- 172.21.15.35:0/2499327947 shutdown_connections 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 --2- 172.21.15.35:0/2499327947 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc108830 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 -- 172.21.15.35:0/2499327947 >> 172.21.15.35:0/2499327947 conn(0x7fb6dc0ffe90 msgr2=0x7fb6dc1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 -- 172.21.15.35:0/2499327947 shutdown_connections 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 -- 172.21.15.35:0/2499327947 wait complete. 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 Processor -- start 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.755+0000 7fb6e2c41700 1 -- start start 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e2c41700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc105db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e2c41700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1062f0 con 0x7fb6dc106450 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e09dd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc105db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e09dd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc105db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38824/0 (socket says 172.21.15.35:38824) 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e09dd700 1 -- 172.21.15.35:0/3000399653 learned_addr learned my addr 172.21.15.35:0/3000399653 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e09dd700 1 -- 172.21.15.35:0/3000399653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009550 con 0x7fb6dc106450 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e09dd700 1 --2- 172.21.15.35:0/3000399653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc105db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0004000 tx=0x7fb6d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:46:07.158 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6d0011630 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d0011790 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6d0011a30 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.756+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc109020 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.757+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc108e90 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.757+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb6d0022070 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.757+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb6d001c450 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.758+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc0620b0 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.760+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb6d001b450 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.891+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb6dc192720 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.891+0000 7fb6d9ffb700 1 -- 172.21.15.35:0/3000399653 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fb6d001b5f0 con 0x7fb6dc106450 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.892+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 msgr2=0x7fb6dc105db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.892+0000 7fb6e2c41700 1 --2- 172.21.15.35:0/3000399653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc105db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0004000 tx=0x7fb6d0004750 comp rx=0 tx=0).stop 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.892+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 shutdown_connections 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.892+0000 7fb6e2c41700 1 --2- 172.21.15.35:0/3000399653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6dc106450 0x7fb6dc105db0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.893+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 >> 172.21.15.35:0/3000399653 conn(0x7fb6dc0ffe90 msgr2=0x7fb6dc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:46:07.159 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.893+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 shutdown_connections 2023-03-17T07:46:08.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:49.893+0000 7fb6e2c41700 1 -- 172.21.15.35:0/3000399653 wait complete. 2023-03-17T07:46:08.012 INFO:teuthology.orchestra.run.smithi035.stdout:mon is available 2023-03-17T07:46:08.012 INFO:teuthology.orchestra.run.smithi035.stdout:Assimilating anything we can from ceph.conf... 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:50 smithi035 ceph-mon[92022]: mon.a is new leader, mons a in quorum (ranks 0) 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:50 smithi035 ceph-mon[92022]: monmap e1: 1 mons at {a=[v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0]} removed_ranks: {} 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:50 smithi035 ceph-mon[92022]: fsmap 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:50 smithi035 ceph-mon[92022]: osdmap e1: 0 total, 0 up, 0 in 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:50 smithi035 ceph-mon[92022]: mgrmap e1: no daemons active 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:50 smithi035 ceph-mon[92022]: from='client.? 172.21.15.35:0/3000399653' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-03-17T07:46:08.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:51 smithi035 ceph-mon[92022]: from='client.? 172.21.15.35:0/4279487441' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-03-17T07:46:08.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:51 smithi035 ceph-mon[92022]: from='client.? 172.21.15.35:0/4279487441' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-03-17T07:46:08.019 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:46:09.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout [global] 2023-03-17T07:46:09.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout fsid = 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:46:09.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.35:3300,v1:172.21.15.35:6789] 2023-03-17T07:46:09.535 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-03-17T07:46:10.809 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-03-17T07:46:10.809 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-03-17T07:46:10.809 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-03-17T07:46:10.809 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:46:10.809 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout [mgr] 2023-03-17T07:46:10.809 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-03-17T07:46:12.479 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout [osd] 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe12578c700 1 Processor -- start 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe12578c700 1 -- start start 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe12578c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe12578c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120105130 con 0x7fe1201047e0 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe11effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:46:12.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe11effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38826/0 (socket says 172.21.15.35:38826) 2023-03-17T07:46:12.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.826+0000 7fe11effd700 1 -- 172.21.15.35:0/4124335672 learned_addr learned my addr 172.21.15.35:0/4124335672 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:46:12.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.827+0000 7fe11effd700 1 -- 172.21.15.35:0/4124335672 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120105270 con 0x7fe1201047e0 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.827+0000 7fe11effd700 1 --2- 172.21.15.35:0/4124335672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120104bf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1100098a0 tx=0x7fe110009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0173569470e3568 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.827+0000 7fe11dffb700 1 -- 172.21.15.35:0/4124335672 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe110004160 con 0x7fe1201047e0 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.827+0000 7fe11dffb700 1 -- 172.21.15.35:0/4124335672 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100042c0 con 0x7fe1201047e0 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.827+0000 7fe11dffb700 1 -- 172.21.15.35:0/4124335672 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1100045a0 con 0x7fe1201047e0 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 -- 172.21.15.35:0/4124335672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 msgr2=0x7fe120104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 --2- 172.21.15.35:0/4124335672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120104bf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1100098a0 tx=0x7fe110009bb0 comp rx=0 tx=0).stop 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 -- 172.21.15.35:0/4124335672 shutdown_connections 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 --2- 172.21.15.35:0/4124335672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120104bf0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:46:13.361 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 -- 172.21.15.35:0/4124335672 >> 172.21.15.35:0/4124335672 conn(0x7fe1200ffed0 msgr2=0x7fe1201022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:46:13.362 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 -- 172.21.15.35:0/4124335672 shutdown_connections 2023-03-17T07:46:13.362 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 -- 172.21.15.35:0/4124335672 wait complete. 2023-03-17T07:46:13.362 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 Processor -- start 2023-03-17T07:46:13.362 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.828+0000 7fe12578c700 1 -- start start 2023-03-17T07:46:13.362 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe12578c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120079ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:46:13.362 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe12578c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12019bb00 con 0x7fe1201047e0 2023-03-17T07:46:13.973 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe11effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120079ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:46:13.973 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe11effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120079ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38828/0 (socket says 172.21.15.35:38828) 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe11effd700 1 -- 172.21.15.35:0/4279487441 learned_addr learned my addr 172.21.15.35:0/4279487441 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe11effd700 1 -- 172.21.15.35:0/4279487441 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009550 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe11effd700 1 --2- 172.21.15.35:0/4279487441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120079ae0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe120105510 tx=0x7fe110004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe110011630 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110011790 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe120105d30 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.829+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe110011a30 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.830+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe120105ba0 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.830+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe110022070 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.830+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe11001c450 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.831+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe120191480 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.833+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe11001b450 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.960+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe12002d010 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.963+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe11001b5f0 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.963+0000 7fe117fff700 1 -- 172.21.15.35:0/4279487441 <== mon.0 v2:172.21.15.35:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fe110024560 con 0x7fe1201047e0 2023-03-17T07:46:13.974 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 msgr2=0x7fe120079ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:46:14.536 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 --2- 172.21.15.35:0/4279487441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120079ae0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe120105510 tx=0x7fe110004750 comp rx=0 tx=0).stop 2023-03-17T07:46:14.536 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 shutdown_connections 2023-03-17T07:46:16.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 --2- 172.21.15.35:0/4279487441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1201047e0 0x7fe120079ae0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:46:16.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 >> 172.21.15.35:0/4279487441 conn(0x7fe1200ffed0 msgr2=0x7fe12018c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:46:16.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 shutdown_connections 2023-03-17T07:46:16.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:50.964+0000 7fe12578c700 1 -- 172.21.15.35:0/4279487441 wait complete. 2023-03-17T07:46:16.012 INFO:teuthology.orchestra.run.smithi035.stdout:Generating new minimal ceph.conf... 2023-03-17T07:46:16.012 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:52 smithi035 ceph-mon[92022]: from='client.? 172.21.15.35:0/1527796571' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:46:16.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.854+0000 7f2d9a505700 1 Processor -- start 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.854+0000 7f2d9a505700 1 -- start start 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d9a505700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d941087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d9a505700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94079d30 con 0x7f2d941063f0 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d941087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d941087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38830/0 (socket says 172.21.15.35:38830) 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d93fff700 1 -- 172.21.15.35:0/4061257474 learned_addr learned my addr 172.21.15.35:0/4061257474 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:46:17.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d93fff700 1 -- 172.21.15.35:0/4061257474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94079e70 con 0x7f2d941063f0 2023-03-17T07:46:20.528 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d93fff700 1 --2- 172.21.15.35:0/4061257474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d941087d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2d840098a0 tx=0x7f2d84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c235a7319814c58 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:46:20.528 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d92ffd700 1 -- 172.21.15.35:0/4061257474 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d84004160 con 0x7f2d941063f0 2023-03-17T07:46:20.528 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d92ffd700 1 -- 172.21.15.35:0/4061257474 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2d840042c0 con 0x7f2d941063f0 2023-03-17T07:46:20.528 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.855+0000 7f2d92ffd700 1 -- 172.21.15.35:0/4061257474 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d84011940 con 0x7f2d941063f0 2023-03-17T07:46:20.528 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 -- 172.21.15.35:0/4061257474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 msgr2=0x7f2d941087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:46:20.528 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 --2- 172.21.15.35:0/4061257474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d941087d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2d840098a0 tx=0x7f2d84009bb0 comp rx=0 tx=0).stop 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 -- 172.21.15.35:0/4061257474 shutdown_connections 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 --2- 172.21.15.35:0/4061257474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d941087d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 -- 172.21.15.35:0/4061257474 >> 172.21.15.35:0/4061257474 conn(0x7f2d940ffed0 msgr2=0x7f2d941022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 -- 172.21.15.35:0/4061257474 shutdown_connections 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.856+0000 7f2d9a505700 1 -- 172.21.15.35:0/4061257474 wait complete. 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d9a505700 1 Processor -- start 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d9a505700 1 -- start start 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d9a505700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d94105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d9a505700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94106290 con 0x7f2d941063f0 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d94105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d94105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38832/0 (socket says 172.21.15.35:38832) 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.857+0000 7f2d93fff700 1 -- 172.21.15.35:0/1527796571 learned_addr learned my addr 172.21.15.35:0/1527796571 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d93fff700 1 -- 172.21.15.35:0/1527796571 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009550 con 0x7f2d941063f0 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d93fff700 1 --2- 172.21.15.35:0/1527796571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d94105d50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2d84006af0 tx=0x7f2d84011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:46:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d84003bf0 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2d8401b8b0 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d840198b0 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d94109b10 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d94109980 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d840233f0 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.858+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2d8401a750 con 0x7f2d941063f0 2023-03-17T07:46:21.998 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.859+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d940620b0 con 0x7f2d941063f0 2023-03-17T07:46:23.409 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.862+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2d84028060 con 0x7f2d941063f0 2023-03-17T07:46:23.409 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.988+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f2d941051b0 con 0x7f2d941063f0 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.989+0000 7f2d917fa700 1 -- 172.21.15.35:0/1527796571 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f2d8401bd70 con 0x7f2d941063f0 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 msgr2=0x7f2d94105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 --2- 172.21.15.35:0/1527796571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d94105d50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2d84006af0 tx=0x7f2d84011a30 comp rx=0 tx=0).stop 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 shutdown_connections 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 --2- 172.21.15.35:0/1527796571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d941063f0 0x7f2d94105d50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 >> 172.21.15.35:0/1527796571 conn(0x7f2d940ffed0 msgr2=0x7f2d94100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 shutdown_connections 2023-03-17T07:46:23.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:51.990+0000 7f2d9a505700 1 -- 172.21.15.35:0/1527796571 wait complete. 2023-03-17T07:46:23.411 INFO:teuthology.orchestra.run.smithi035.stdout:Restarting the monitor... 2023-03-17T07:46:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:52 smithi035 systemd[1]: Stopping Ceph mon.a for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T07:46:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mon-a[91998]: 2023-03-17T07:45:52.659+0000 7f105dee7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-03-17T07:46:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mon-a[91998]: 2023-03-17T07:45:52.659+0000 7f105dee7700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-03-17T07:46:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 bash[92365]: ceph-80b32574-c497-11ed-9afb-001a4aab830c-mon-a 2023-03-17T07:46:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.a.service: Succeeded. 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 systemd[1]: Stopped Ceph mon.a for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 systemd[1]: Starting Ceph mon.a for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 podman[92495]: 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: set uid:gid to 167:167 (ceph:ceph) 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev), process ceph-mon, pid 7 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: pidfile_write: ignore empty --pid-file 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: load: jerasure load: lrc 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: RocksDB version: 7.9.2 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Git sha 0 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Compile date 2023-03-16 22:03:12 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: DB SUMMARY 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: DB Session ID: 91PBJALD9HUXVIUYMUU7 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: CURRENT file: CURRENT 2023-03-17T07:46:26.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: IDENTITY file: IDENTITY 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98397 ; 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.error_if_exists: 0 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.create_if_missing: 0 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.paranoid_checks: 1 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.flush_verify_memtable_count: 1 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.env: 0x55560d0d8720 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.fs: PosixFileSystem 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.info_log: 0x55560de75440 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_file_opening_threads: 16 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.statistics: (nil) 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.use_fsync: 0 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_log_file_size: 0 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-03-17T07:46:26.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.log_file_time_to_roll: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.keep_log_file_num: 1000 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.recycle_log_file_num: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.allow_fallocate: 1 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.allow_mmap_reads: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.allow_mmap_writes: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.use_direct_reads: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.create_missing_column_families: 0 2023-03-17T07:46:26.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.db_log_dir: 2023-03-17T07:46:27.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.wal_dir: 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.table_cache_numshardbits: 6 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.WAL_ttl_seconds: 0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.WAL_size_limit_MB: 0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.is_fd_close_on_exec: 1 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.advise_random_on_open: 1 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.db_write_buffer_size: 0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.write_buffer_manager: 0x55560de4a5a0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.use_adaptive_mutex: 0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.rate_limiter: (nil) 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.wal_recovery_mode: 2 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.enable_thread_tracking: 0 2023-03-17T07:46:27.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.enable_pipelined_write: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.unordered_write: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.row_cache: None 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.wal_filter: None 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.allow_ingest_behind: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.two_write_queues: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.manual_wal_flush: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.wal_compression: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.atomic_flush: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.persist_stats_to_disk: 0 2023-03-17T07:46:27.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.write_dbid_to_manifest: 0 2023-03-17T07:46:28.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.log_readahead_size: 0 2023-03-17T07:46:28.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-03-17T07:46:28.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.best_efforts_recovery: 0 2023-03-17T07:46:28.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-03-17T07:46:28.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-03-17T07:46:28.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.allow_data_in_errors: 0 2023-03-17T07:46:30.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.db_host_id: __hostname__ 2023-03-17T07:46:31.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.enforce_single_del_contracts: true 2023-03-17T07:46:31.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_background_jobs: 2 2023-03-17T07:46:31.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_background_compactions: -1 2023-03-17T07:46:31.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_subcompactions: 1 2023-03-17T07:46:31.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-03-17T07:46:33.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-03-17T07:46:35.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.delayed_write_rate : 16777216 2023-03-17T07:46:35.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_total_wal_size: 0 2023-03-17T07:46:35.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-03-17T07:46:35.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.stats_dump_period_sec: 600 2023-03-17T07:46:36.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.stats_persist_period_sec: 600 2023-03-17T07:46:36.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-03-17T07:46:36.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_open_files: -1 2023-03-17T07:46:36.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bytes_per_sync: 0 2023-03-17T07:46:38.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.wal_bytes_per_sync: 0 2023-03-17T07:46:38.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.strict_bytes_per_sync: 0 2023-03-17T07:46:38.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_readahead_size: 0 2023-03-17T07:46:38.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_background_flushes: -1 2023-03-17T07:46:39.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Compression algorithms supported: 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kZSTD supported: 0 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kXpressCompression supported: 0 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kLZ4HCCompression supported: 1 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kZlibCompression supported: 1 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kSnappyCompression supported: 1 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kLZ4Compression supported: 1 2023-03-17T07:46:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: kBZip2Compression supported: 0 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Fast CRC32 supported: Supported on x86 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: DMutex implementation: pthread_mutex_t 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.merge_operator: 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_filter: None 2023-03-17T07:46:39.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_filter_factory: None 2023-03-17T07:46:42.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.sst_partitioner_factory: None 2023-03-17T07:46:42.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.memtable_factory: SkipListFactory 2023-03-17T07:46:42.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.table_factory: BlockBasedTable 2023-03-17T07:46:42.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55560de75540) 2023-03-17T07:46:42.407 INFO:journalctl@ceph.mon.a.smithi035.stdout: cache_index_and_filter_blocks: 1 2023-03-17T07:46:42.407 INFO:journalctl@ceph.mon.a.smithi035.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-03-17T07:46:43.395 INFO:journalctl@ceph.mon.a.smithi035.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: pin_top_level_index_and_filter: 1 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: index_type: 0 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: data_block_index_type: 0 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: index_shortening: 1 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: data_block_hash_table_util_ratio: 0.750000 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: checksum: 4 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: no_block_cache: 0 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_cache: 0x55560decb350 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_cache_name: BinnedLRUCache 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_cache_options: 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: capacity : 536870912 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: num_shard_bits : 4 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: strict_capacity_limit : 0 2023-03-17T07:46:43.396 INFO:journalctl@ceph.mon.a.smithi035.stdout: high_pri_pool_ratio: 0.000 2023-03-17T07:46:43.397 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_cache_compressed: (nil) 2023-03-17T07:46:43.397 INFO:journalctl@ceph.mon.a.smithi035.stdout: persistent_cache: (nil) 2023-03-17T07:46:43.397 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_size: 4096 2023-03-17T07:46:43.397 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_size_deviation: 10 2023-03-17T07:46:43.397 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_restart_interval: 16 2023-03-17T07:46:43.397 INFO:journalctl@ceph.mon.a.smithi035.stdout: index_block_restart_interval: 1 2023-03-17T07:46:44.469 INFO:journalctl@ceph.mon.a.smithi035.stdout: metadata_block_size: 4096 2023-03-17T07:46:44.470 INFO:journalctl@ceph.mon.a.smithi035.stdout: partition_filters: 0 2023-03-17T07:46:46.618 INFO:journalctl@ceph.mon.a.smithi035.stdout: use_delta_encoding: 1 2023-03-17T07:46:46.618 INFO:journalctl@ceph.mon.a.smithi035.stdout: filter_policy: bloomfilter 2023-03-17T07:46:46.618 INFO:journalctl@ceph.mon.a.smithi035.stdout: whole_key_filtering: 1 2023-03-17T07:46:46.618 INFO:journalctl@ceph.mon.a.smithi035.stdout: verify_compression: 0 2023-03-17T07:46:46.618 INFO:journalctl@ceph.mon.a.smithi035.stdout: read_amp_bytes_per_bit: 0 2023-03-17T07:46:46.619 INFO:journalctl@ceph.mon.a.smithi035.stdout: format_version: 5 2023-03-17T07:46:46.619 INFO:journalctl@ceph.mon.a.smithi035.stdout: enable_index_compression: 1 2023-03-17T07:46:46.619 INFO:journalctl@ceph.mon.a.smithi035.stdout: block_align: 0 2023-03-17T07:46:46.619 INFO:journalctl@ceph.mon.a.smithi035.stdout: max_auto_readahead_size: 262144 2023-03-17T07:46:46.980 INFO:journalctl@ceph.mon.a.smithi035.stdout: prepopulate_block_cache: 0 2023-03-17T07:46:46.980 INFO:journalctl@ceph.mon.a.smithi035.stdout: initial_auto_readahead_size: 8192 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout: num_file_reads_for_auto_readahead: 2 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.write_buffer_size: 33554432 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_write_buffer_number: 2 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression: NoCompression 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression: Disabled 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.prefix_extractor: nullptr 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-03-17T07:46:46.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.num_levels: 7 2023-03-17T07:46:47.612 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-03-17T07:46:47.612 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-03-17T07:46:47.612 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-03-17T07:46:48.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.window_bits: -14 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.level: 32767 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.strategy: 0 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-03-17T07:46:48.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.enabled: false 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-03-17T07:46:49.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-03-17T07:46:50.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.target_file_size_base: 67108864 2023-03-17T07:46:50.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.target_file_size_multiplier: 1 2023-03-17T07:46:50.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-03-17T07:46:53.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-03-17T07:46:53.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-03-17T07:46:53.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-03-17T07:46:59.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-03-17T07:46:59.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-03-17T07:46:59.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-03-17T07:46:59.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-03-17T07:47:00.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-03-17T07:47:00.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-03-17T07:47:00.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-03-17T07:47:00.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-03-17T07:47:00.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-03-17T07:47:00.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.arena_block_size: 1048576 2023-03-17T07:47:00.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-03-17T07:47:00.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-03-17T07:47:00.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.disable_auto_compactions: 0 2023-03-17T07:47:00.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-03-17T07:47:00.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-03-17T07:47:01.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-03-17T07:47:01.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-03-17T07:47:01.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-03-17T07:47:01.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-03-17T07:47:01.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.table_properties_collectors: 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.inplace_update_support: 0 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.inplace_update_num_locks: 10000 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-03-17T07:47:01.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.memtable_huge_page_size: 0 2023-03-17T07:47:02.508 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.bloom_locality: 0 2023-03-17T07:47:02.508 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.max_successive_merges: 0 2023-03-17T07:47:03.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.optimize_filters_for_hits: 0 2023-03-17T07:47:03.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.paranoid_file_checks: 0 2023-03-17T07:47:03.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.force_consistency_checks: 1 2023-03-17T07:47:03.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.report_bg_io_stats: 0 2023-03-17T07:47:03.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.ttl: 2592000 2023-03-17T07:47:03.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.periodic_compaction_seconds: 0 2023-03-17T07:47:03.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.enable_blob_files: false 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.min_blob_size: 0 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.blob_file_size: 268435456 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.blob_compression_type: NoCompression 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.enable_blob_garbage_collection: false 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-03-17T07:47:03.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.blob_file_starting_level: 0 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 09a7432d-372e-456a-bcf1-36892a223c9e 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1679039153915021, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1679039153916032, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93689, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 314, "table_properties": {"data_size": 91688, "index_size": 283, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13608, "raw_average_key_size": 49, "raw_value_size": 84240, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1679039153, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "09a7432d-372e-456a-bcf1-36892a223c9e", "db_session_id": "91PBJALD9HUXVIUYMUU7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: EVENT_LOG_v1 {"time_micros": 1679039153916118, "job": 1, "event": "recovery_finished"} 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-03-17T07:47:03.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55560df68000 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: DB pointer 0x55560df54000 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: ** DB Stats ** 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-03-17T07:47:06.695 INFO:journalctl@ceph.mon.a.smithi035.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: ** Compaction Stats [default] ** 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: L0 2/0 93.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: Sum 2/0 93.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: ** Compaction Stats [default] ** 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: 2023-03-17T07:47:06.696 INFO:journalctl@ceph.mon.a.smithi035.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: AddFile(Keys): cumulative 0, interval 0 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: Cumulative compaction: 0.00 GB write, 28.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: Interval compaction: 0.00 GB write, 28.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-03-17T07:47:06.697 INFO:journalctl@ceph.mon.a.smithi035.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout: Block cache BinnedLRUCache@0x55560decb350#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout: 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout: ** File Read Latency Histogram By Level [default] ** 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: starting mon.a rank 0 at public addrs [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] at bind addrs [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???) e1 preinit fsid 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).mds e1 new map 2023-03-17T07:47:07.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).mds e1 print_map 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout: e1 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout: legacy client fscid: -1 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout: 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout: No filesystems configured 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expand map: {default=false} 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta from 'false' to 'false' 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expanded map: {default=false} 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expand map: {default=info} 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta from 'info' to 'info' 2023-03-17T07:47:07.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expanded map: {default=info} 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expand map: {default=daemon} 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta from 'daemon' to 'daemon' 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expanded map: {default=daemon} 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expand map: {default=debug} 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta from 'debug' to 'debug' 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: expand_channel_meta expanded map: {default=debug} 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 bash[92495]: 3af5f75e6da02922a24543c45d20155c6cf9a2195a725579bb717c78088e966e 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mon.a is new leader, mons a in quorum (ranks 0) 2023-03-17T07:47:07.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: monmap e1: 1 mons at {a=[v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0]} removed_ranks: {} 2023-03-17T07:47:08.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: fsmap 2023-03-17T07:47:08.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: osdmap e1: 0 total, 0 up, 0 in 2023-03-17T07:47:08.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:53 smithi035 ceph-mon[92535]: mgrmap e1: no daemons active 2023-03-17T07:47:08.715 INFO:teuthology.orchestra.run.smithi035.stdout:Setting mon public_network to 172.21.0.0/20 2023-03-17T07:47:08.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:54 smithi035 systemd[1]: Started Ceph mon.a for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T07:47:08.720 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.473+0000 7fe0848d7700 1 Processor -- start 2023-03-17T07:47:09.806 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.473+0000 7fe0848d7700 1 -- start start 2023-03-17T07:47:09.806 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.473+0000 7fe0848d7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe080104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:09.807 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.473+0000 7fe0848d7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0801051a0 con 0x7fe080104850 2023-03-17T07:47:09.807 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.474+0000 7fe07e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe080104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:09.807 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.474+0000 7fe07e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe080104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38834/0 (socket says 172.21.15.35:38834) 2023-03-17T07:47:10.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.474+0000 7fe07e59c700 1 -- 172.21.15.35:0/2322414024 learned_addr learned my addr 172.21.15.35:0/2322414024 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:10.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.474+0000 7fe07e59c700 1 -- 172.21.15.35:0/2322414024 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0801052e0 con 0x7fe080104850 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.474+0000 7fe07e59c700 1 --2- 172.21.15.35:0/2322414024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe080104c60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe07000bb40 tx=0x7fe07000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d387b53797118ea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe07d59a700 1 -- 172.21.15.35:0/2322414024 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe07000dbe0 con 0x7fe080104850 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe07d59a700 1 -- 172.21.15.35:0/2322414024 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe0700044a0 con 0x7fe080104850 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe07d59a700 1 -- 172.21.15.35:0/2322414024 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe070003da0 con 0x7fe080104850 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 -- 172.21.15.35:0/2322414024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 msgr2=0x7fe080104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 --2- 172.21.15.35:0/2322414024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe080104c60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe07000bb40 tx=0x7fe07000be50 comp rx=0 tx=0).stop 2023-03-17T07:47:10.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 -- 172.21.15.35:0/2322414024 shutdown_connections 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 --2- 172.21.15.35:0/2322414024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe080104c60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 -- 172.21.15.35:0/2322414024 >> 172.21.15.35:0/2322414024 conn(0x7fe0800ffee0 msgr2=0x7fe0801022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 -- 172.21.15.35:0/2322414024 shutdown_connections 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.475+0000 7fe0848d7700 1 -- 172.21.15.35:0/2322414024 wait complete. 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.476+0000 7fe0848d7700 1 Processor -- start 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.476+0000 7fe0848d7700 1 -- start start 2023-03-17T07:47:10.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.476+0000 7fe0848d7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe08019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.476+0000 7fe0848d7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08019bc80 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe07e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe08019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe07e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe08019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38836/0 (socket says 172.21.15.35:38836) 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe07e59c700 1 -- 172.21.15.35:0/1067634046 learned_addr learned my addr 172.21.15.35:0/1067634046 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe07e59c700 1 -- 172.21.15.35:0/1067634046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07000b7f0 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe07e59c700 1 --2- 172.21.15.35:0/1067634046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe08019b740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe070003df0 tx=0x7fe070003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0700104c0 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe070010a90 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe080106840 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe070021b80 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0801066b0 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.477+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe07002a6f0 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.478+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0700196e0 con 0x7fe080104850 2023-03-17T07:47:12.152 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.478+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080078f80 con 0x7fe080104850 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.481+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe07002f060 con 0x7fe080104850 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.606+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe080191180 con 0x7fe080104850 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.608+0000 7fe06f7fe700 1 -- 172.21.15.35:0/1067634046 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe070006d50 con 0x7fe080104850 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 msgr2=0x7fe08019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 --2- 172.21.15.35:0/1067634046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe08019b740 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe070003df0 tx=0x7fe070003ed0 comp rx=0 tx=0).stop 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 shutdown_connections 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 --2- 172.21.15.35:0/1067634046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe080104850 0x7fe08019b740 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 >> 172.21.15.35:0/1067634046 conn(0x7fe0800ffee0 msgr2=0x7fe08018e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 shutdown_connections 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:54.609+0000 7fe0848d7700 1 -- 172.21.15.35:0/1067634046 wait complete. 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:Wrote config to /etc/ceph/ceph.conf 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:Creating mgr... 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying port 9283 ... 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:Verifying port 8765 ... 2023-03-17T07:47:12.153 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.x 2023-03-17T07:47:12.154 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Failed to reset failed state of unit ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.x.service: Unit ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.x.service not loaded. 2023-03-17T07:47:12.154 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-80b32574-c497-11ed-9afb-001a4aab830c.target.wants/ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-80b32574-c497-11ed-9afb-001a4aab830c@.service. 2023-03-17T07:47:12.154 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:55 smithi035 systemd[1]: Starting Ceph mgr.x for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T07:47:12.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:55 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1067634046' entity='client.admin' 2023-03-17T07:47:13.283 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:55 smithi035 podman[92765]: 2023-03-17T07:47:13.284 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-17T07:47:13.284 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout disabled 2023-03-17T07:47:13.284 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-17T07:47:13.284 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout inactive 2023-03-17T07:47:13.284 INFO:teuthology.orchestra.run.smithi035.stdout:firewalld.service is not enabled 2023-03-17T07:47:13.284 INFO:teuthology.orchestra.run.smithi035.stdout:Not possible to enable service . firewalld.service is not available 2023-03-17T07:47:13.285 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout disabled 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout inactive 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:firewalld.service is not enabled 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for mgr to start... 2023-03-17T07:47:13.957 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for mgr... 2023-03-17T07:47:13.958 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:55 smithi035 bash[92765]: d60dfc6aaed7f8b17ba96ee1d86837094292de9d67983f42a05ef12c11606214 2023-03-17T07:47:14.546 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:55 smithi035 systemd[1]: Started Ceph mgr.x for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T07:47:14.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:55 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:55.944+0000 7f315c60e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-17T07:47:14.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:56.041+0000 7f315c60e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-17T07:47:14.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:56.156+0000 7f315c60e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-17T07:47:14.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:56.270+0000 7f315c60e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-17T07:47:14.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2353887013' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-17T07:47:14.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:56.481+0000 7f315c60e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-17T07:47:14.554 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:47:15.682 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:47:15.682 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T07:47:15.682 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "health": { 2023-03-17T07:47:15.682 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 0 2023-03-17T07:47:16.444 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "a" 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-17T07:47:18.001 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-17T07:47:18.002 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-17T07:47:18.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-17T07:47:18.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:18.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-17T07:47:18.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-17T07:47:18.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-17T07:47:18.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-17T07:47:18.743 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-17T07:47:19.478 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-17T07:47:19.479 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:19.479 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-17T07:47:19.479 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "available": false, 2023-03-17T07:47:19.479 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-17T07:47:20.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-17T07:47:20.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-17T07:47:20.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-17T07:47:20.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "restful" 2023-03-17T07:47:20.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:20.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:47:21.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:21.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-17T07:47:21.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modified": "2023-03-17T07:45:49.223095+0000", 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.431+0000 7f2a5db6f700 1 Processor -- start 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.431+0000 7f2a5db6f700 1 -- start start 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.431+0000 7f2a5db6f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a581084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.431+0000 7f2a5db6f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58108a20 con 0x7f2a58073f70 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a581084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a581084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38842/0 (socket says 172.21.15.35:38842) 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a577fe700 1 -- 172.21.15.35:0/2458541348 learned_addr learned my addr 172.21.15.35:0/2458541348 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a577fe700 1 -- 172.21.15.35:0/2458541348 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58108b60 con 0x7f2a58073f70 2023-03-17T07:47:21.097 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a577fe700 1 --2- 172.21.15.35:0/2458541348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a581084e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098a0 tx=0x7f2a48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcb5b01b85bc9bf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a567fc700 1 -- 172.21.15.35:0/2458541348 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a48004160 con 0x7f2a58073f70 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a567fc700 1 -- 172.21.15.35:0/2458541348 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2a480042c0 con 0x7f2a58073f70 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.432+0000 7f2a567fc700 1 -- 172.21.15.35:0/2458541348 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a48011940 con 0x7f2a58073f70 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2458541348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 msgr2=0x7f2a581084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 --2- 172.21.15.35:0/2458541348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a581084e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098a0 tx=0x7f2a48009bb0 comp rx=0 tx=0).stop 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2458541348 shutdown_connections 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 --2- 172.21.15.35:0/2458541348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a581084e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2458541348 >> 172.21.15.35:0/2458541348 conn(0x7f2a580ffeb0 msgr2=0x7f2a581022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:21.098 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2458541348 shutdown_connections 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.433+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2458541348 wait complete. 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a5db6f700 1 Processor -- start 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a5db6f700 1 -- start start 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a5db6f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a58105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a5db6f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58106370 con 0x7f2a58073f70 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a58105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a58105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38844/0 (socket says 172.21.15.35:38844) 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.434+0000 7f2a577fe700 1 -- 172.21.15.35:0/2353887013 learned_addr learned my addr 172.21.15.35:0/2353887013 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:22.382 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a577fe700 1 -- 172.21.15.35:0/2353887013 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48009550 con 0x7f2a58073f70 2023-03-17T07:47:23.498 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a577fe700 1 --2- 172.21.15.35:0/2353887013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a58105e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a48011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:23.498 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a480036a0 con 0x7f2a58073f70 2023-03-17T07:47:23.498 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2a4801b440 con 0x7f2a58073f70 2023-03-17T07:47:23.498 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a480193f0 con 0x7f2a58073f70 2023-03-17T07:47:24.858 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a58109af0 con 0x7f2a58073f70 2023-03-17T07:47:24.858 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a58109960 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a48019930 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.435+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2a4801a3d0 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.436+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a580620b0 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.439+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2a48029060 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.571+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2a58104be0 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.572+0000 7f2a54ff9700 1 -- 172.21.15.35:0/2353887013 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2a4801f070 con 0x7f2a58073f70 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 msgr2=0x7f2a58105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 --2- 172.21.15.35:0/2353887013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a58105e30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a48011e70 comp rx=0 tx=0).stop 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 shutdown_connections 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 --2- 172.21.15.35:0/2353887013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a58073f70 0x7f2a58105e30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 >> 172.21.15.35:0/2353887013 conn(0x7f2a580ffeb0 msgr2=0x7f2a58100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 shutdown_connections 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:56.573+0000 7f2a5db6f700 1 -- 172.21.15.35:0/2353887013 wait complete. 2023-03-17T07:47:24.859 INFO:teuthology.orchestra.run.smithi035.stdout:mgr not available, waiting (1/15)... 2023-03-17T07:47:24.860 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:56.885+0000 7f315c60e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-17T07:47:24.860 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:56.994+0000 7f315c60e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-17T07:47:24.861 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:57 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:57.145+0000 7f315c60e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-17T07:47:25.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:57 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:57.258+0000 7f315c60e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-17T07:47:25.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:57 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:57.767+0000 7f315c60e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-17T07:47:26.858 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:58 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:58.459+0000 7f315c60e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-17T07:47:26.858 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:58 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:58.652+0000 7f315c60e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-17T07:47:26.859 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:59 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:59.618+0000 7f315c60e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-17T07:47:26.859 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:59 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:59.731+0000 7f315c60e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-17T07:47:26.867 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:47:28.219 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:47:28.219 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T07:47:28.749 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "health": { 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-17T07:47:34.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 0 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "a" 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-17T07:47:35.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-17T07:47:36.862 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:36.862 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-17T07:47:36.862 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:36.862 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-17T07:47:36.862 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-17T07:47:36.863 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:37.984 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-17T07:47:37.984 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:37.984 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-17T07:47:37.984 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-17T07:47:37.984 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:37.984 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "available": false, 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "restful" 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:47:39.075 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modified": "2023-03-17T07:45:49.223095+0000", 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.441+0000 7f1f95007700 1 Processor -- start 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.441+0000 7f1f95007700 1 -- start start 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.441+0000 7f1f95007700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f90105d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.441+0000 7f1f95007700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90106240 con 0x7f1f901058f0 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f90105d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f90105d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38846/0 (socket says 172.21.15.35:38846) 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8ed9d700 1 -- 172.21.15.35:0/3801412123 learned_addr learned my addr 172.21.15.35:0/3801412123 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8ed9d700 1 -- 172.21.15.35:0/3801412123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f90106380 con 0x7f1f901058f0 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8ed9d700 1 --2- 172.21.15.35:0/3801412123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f90105d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f800098a0 tx=0x7f1f80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dbf90916095791 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:39.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8dd9b700 1 -- 172.21.15.35:0/3801412123 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f80004160 con 0x7f1f901058f0 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8dd9b700 1 -- 172.21.15.35:0/3801412123 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1f800042c0 con 0x7f1f901058f0 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.442+0000 7f1f8dd9b700 1 -- 172.21.15.35:0/3801412123 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f80011940 con 0x7f1f901058f0 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 -- 172.21.15.35:0/3801412123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 msgr2=0x7f1f90105d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 --2- 172.21.15.35:0/3801412123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f90105d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f800098a0 tx=0x7f1f80009bb0 comp rx=0 tx=0).stop 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 -- 172.21.15.35:0/3801412123 shutdown_connections 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 --2- 172.21.15.35:0/3801412123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f90105d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 -- 172.21.15.35:0/3801412123 >> 172.21.15.35:0/3801412123 conn(0x7f1f90100f60 msgr2=0x7f1f90103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 -- 172.21.15.35:0/3801412123 shutdown_connections 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.443+0000 7f1f95007700 1 -- 172.21.15.35:0/3801412123 wait complete. 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f95007700 1 Processor -- start 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f95007700 1 -- start start 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f95007700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f901994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f95007700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901999e0 con 0x7f1f901058f0 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f901994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f8ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f901994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38848/0 (socket says 172.21.15.35:38848) 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.444+0000 7f1f8ed9d700 1 -- 172.21.15.35:0/1945266128 learned_addr learned my addr 172.21.15.35:0/1945266128 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:39.077 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f8ed9d700 1 -- 172.21.15.35:0/1945266128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80009550 con 0x7f1f901058f0 2023-03-17T07:47:39.078 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f8ed9d700 1 --2- 172.21.15.35:0/1945266128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f901994a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f80006af0 tx=0x7f1f80011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f80003bf0 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f901078e0 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1f8001b8b0 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f80019880 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.445+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f90107750 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.446+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1f800233f0 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.446+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1f8001a7e0 con 0x7f1f901058f0 2023-03-17T07:47:41.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.446+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f90109dc0 con 0x7f1f901058f0 2023-03-17T07:47:41.648 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.449+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f1f80028060 con 0x7f1f901058f0 2023-03-17T07:47:41.648 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.581+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1f90199f50 con 0x7f1f901058f0 2023-03-17T07:47:41.648 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.582+0000 7f1f77fff700 1 -- 172.21.15.35:0/1945266128 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f1f8001bd70 con 0x7f1f901058f0 2023-03-17T07:47:41.648 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 msgr2=0x7f1f901994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 --2- 172.21.15.35:0/1945266128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f901994a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f80006af0 tx=0x7f1f80011a30 comp rx=0 tx=0).stop 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 shutdown_connections 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 --2- 172.21.15.35:0/1945266128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f901058f0 0x7f1f901994a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 >> 172.21.15.35:0/1945266128 conn(0x7f1f90100f60 msgr2=0x7f1f90101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 shutdown_connections 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:45:59.583+0000 7f1f95007700 1 -- 172.21.15.35:0/1945266128 wait complete. 2023-03-17T07:47:43.883 INFO:teuthology.orchestra.run.smithi035.stdout:mgr not available, waiting (2/15)... 2023-03-17T07:47:43.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:45:59 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1945266128' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:45:59 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:45:59.949+0000 7f315c60e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:00.292+0000 7f315c60e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:00.397+0000 7f315c60e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:00.728+0000 7f315c60e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:01.049+0000 7f315c60e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:01.870+0000 7f315c60e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:02 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:02.035+0000 7f315c60e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:02 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:02.282+0000 7f315c60e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:02 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:02.418+0000 7f315c60e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-17T07:47:43.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:02 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/904204517' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-17T07:47:46.137 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:02 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:02.692+0000 7f315c60e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-17T07:47:47.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:47:49.869 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:47:49.870 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T07:47:49.870 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "health": { 2023-03-17T07:47:49.870 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-17T07:47:49.870 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 0 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "a" 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:50.585 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-17T07:47:50.586 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "available": false, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "restful" 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:47:50.587 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modified": "2023-03-17T07:45:49.223095+0000", 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b45e32700 1 Processor -- start 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b45e32700 1 -- start start 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b45e32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b401087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b45e32700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b40074050 con 0x7f7b401063f0 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b401087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b401087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38850/0 (socket says 172.21.15.35:38850) 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b3f7fe700 1 -- 172.21.15.35:0/2489227509 learned_addr learned my addr 172.21.15.35:0/2489227509 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:50.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.452+0000 7f7b3f7fe700 1 -- 172.21.15.35:0/2489227509 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40074190 con 0x7f7b401063f0 2023-03-17T07:47:51.308 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.453+0000 7f7b3f7fe700 1 --2- 172.21.15.35:0/2489227509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b401087d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b300098a0 tx=0x7f7b30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db52d508c8f8a110 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.453+0000 7f7b3e7fc700 1 -- 172.21.15.35:0/2489227509 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b30004160 con 0x7f7b401063f0 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.453+0000 7f7b3e7fc700 1 -- 172.21.15.35:0/2489227509 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7b300042c0 con 0x7f7b401063f0 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.453+0000 7f7b3e7fc700 1 -- 172.21.15.35:0/2489227509 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b30011940 con 0x7f7b401063f0 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.453+0000 7f7b45e32700 1 -- 172.21.15.35:0/2489227509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 msgr2=0x7f7b401087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.453+0000 7f7b45e32700 1 --2- 172.21.15.35:0/2489227509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b401087d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b300098a0 tx=0x7f7b30009bb0 comp rx=0 tx=0).stop 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 -- 172.21.15.35:0/2489227509 shutdown_connections 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 --2- 172.21.15.35:0/2489227509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b401087d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:52.483 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 -- 172.21.15.35:0/2489227509 >> 172.21.15.35:0/2489227509 conn(0x7f7b400ffeb0 msgr2=0x7f7b401022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:52.484 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 -- 172.21.15.35:0/2489227509 shutdown_connections 2023-03-17T07:47:52.484 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 -- 172.21.15.35:0/2489227509 wait complete. 2023-03-17T07:47:52.484 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 Processor -- start 2023-03-17T07:47:52.484 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 -- start start 2023-03-17T07:47:52.484 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.454+0000 7f7b45e32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b4019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:47:52.484 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b45e32700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4019bc20 con 0x7f7b401063f0 2023-03-17T07:47:53.324 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b4019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:47:53.324 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b4019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38852/0 (socket says 172.21.15.35:38852) 2023-03-17T07:47:54.035 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3f7fe700 1 -- 172.21.15.35:0/904204517 learned_addr learned my addr 172.21.15.35:0/904204517 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:47:55.497 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3f7fe700 1 -- 172.21.15.35:0/904204517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30009550 con 0x7f7b401063f0 2023-03-17T07:47:55.497 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3f7fe700 1 --2- 172.21.15.35:0/904204517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b4019b6e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7b30000c00 tx=0x7f7b30011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:47:55.497 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b300036a0 con 0x7f7b401063f0 2023-03-17T07:47:55.497 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7b3001b440 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b40109b10 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40109980 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.455+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b300193f0 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.456+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7b30019980 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.456+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7b3001a3d0 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.456+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c005320 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.459+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f7b30029060 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.591+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7b2c005cc0 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.592+0000 7f7b3cff9700 1 -- 172.21.15.35:0/904204517 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f7b3001f070 con 0x7f7b401063f0 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 msgr2=0x7f7b4019b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 --2- 172.21.15.35:0/904204517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b4019b6e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7b30000c00 tx=0x7f7b30011e70 comp rx=0 tx=0).stop 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 shutdown_connections 2023-03-17T07:47:56.576 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 --2- 172.21.15.35:0/904204517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7b401063f0 0x7f7b4019b6e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:47:56.577 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 >> 172.21.15.35:0/904204517 conn(0x7f7b400ffeb0 msgr2=0x7f7b40100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:47:56.577 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 shutdown_connections 2023-03-17T07:47:56.577 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:02.593+0000 7f7b45e32700 1 -- 172.21.15.35:0/904204517 wait complete. 2023-03-17T07:47:56.577 INFO:teuthology.orchestra.run.smithi035.stdout:mgr not available, waiting (3/15)... 2023-03-17T07:47:56.578 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:03.728+0000 7f315c60e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-17T07:47:58.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: Activating manager daemon x 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: mgrmap e2: x(active, starting, since 0.00324314s) 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-17T07:48:05.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: Manager daemon x is now available 2023-03-17T07:48:05.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-17T07:48:06.012 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-17T07:48:06.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' 2023-03-17T07:48:06.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:03 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' 2023-03-17T07:48:06.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:04 smithi035 ceph-mon[92535]: from='mgr.14100 172.21.15.35:0/586779849' entity='mgr.x' 2023-03-17T07:48:06.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:04 smithi035 ceph-mon[92535]: mgrmap e3: x(active, since 1.00748s) 2023-03-17T07:48:06.021 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:48:07.209 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:48:07.209 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T07:48:07.209 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "health": { 2023-03-17T07:48:07.209 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-03-17T07:48:07.209 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-03-17T07:48:07.209 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 0 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "a" 2023-03-17T07:48:07.791 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:48:08.485 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-03-17T07:48:08.485 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "monmap": { 2023-03-17T07:48:09.379 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-03-17T07:48:09.380 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-03-17T07:48:09.381 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-03-17T07:48:10.510 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-03-17T07:48:10.510 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-03-17T07:48:10.510 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:10.510 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-03-17T07:48:10.510 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-03-17T07:48:10.510 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:10.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-03-17T07:48:12.082 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:48:13.814 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-03-17T07:48:13.815 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-03-17T07:48:13.815 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:13.815 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-03-17T07:48:13.815 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "available": true, 2023-03-17T07:48:13.815 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-03-17T07:48:15.271 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modules": [ 2023-03-17T07:48:15.271 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "iostat", 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "nfs", 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "restful" 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ], 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-03-17T07:48:15.853 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "modified": "2023-03-17T07:45:49.223095+0000", 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "services": {} 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout }, 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.488+0000 7f312c647700 1 Processor -- start 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.488+0000 7f312c647700 1 -- start start 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.488+0000 7f312c647700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f3124103fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.488+0000 7f312c647700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124104520 con 0x7f3124103bd0 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f312a3e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f3124103fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f312a3e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f3124103fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38880/0 (socket says 172.21.15.35:38880) 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f312a3e3700 1 -- 172.21.15.35:0/2052129427 learned_addr learned my addr 172.21.15.35:0/2052129427 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:15.854 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f312a3e3700 1 -- 172.21.15.35:0/2052129427 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124104660 con 0x7f3124103bd0 2023-03-17T07:48:16.857 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f312a3e3700 1 --2- 172.21.15.35:0/2052129427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f3124103fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f312001a940 tx=0x7f312001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31f2d341b27618b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:16.857 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f31293e1700 1 -- 172.21.15.35:0/2052129427 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3120004030 con 0x7f3124103bd0 2023-03-17T07:48:16.857 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f31293e1700 1 -- 172.21.15.35:0/2052129427 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f312001c7f0 con 0x7f3124103bd0 2023-03-17T07:48:16.857 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.489+0000 7f31293e1700 1 -- 172.21.15.35:0/2052129427 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31200039f0 con 0x7f3124103bd0 2023-03-17T07:48:16.857 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 -- 172.21.15.35:0/2052129427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 msgr2=0x7f3124103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:16.857 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 --2- 172.21.15.35:0/2052129427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f3124103fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f312001a940 tx=0x7f312001ac50 comp rx=0 tx=0).stop 2023-03-17T07:48:17.676 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 -- 172.21.15.35:0/2052129427 shutdown_connections 2023-03-17T07:48:17.676 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 --2- 172.21.15.35:0/2052129427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f3124103fe0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:18.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 -- 172.21.15.35:0/2052129427 >> 172.21.15.35:0/2052129427 conn(0x7f31240ff650 msgr2=0x7f3124101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:18.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 -- 172.21.15.35:0/2052129427 shutdown_connections 2023-03-17T07:48:18.723 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.490+0000 7f312c647700 1 -- 172.21.15.35:0/2052129427 wait complete. 2023-03-17T07:48:18.723 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312c647700 1 Processor -- start 2023-03-17T07:48:18.723 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312c647700 1 -- start start 2023-03-17T07:48:18.723 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312c647700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f31241972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312c647700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3124197800 con 0x7f3124103bd0 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312a3e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f31241972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312a3e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f31241972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38882/0 (socket says 172.21.15.35:38882) 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312a3e3700 1 -- 172.21.15.35:0/1222934625 learned_addr learned my addr 172.21.15.35:0/1222934625 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312a3e3700 1 -- 172.21.15.35:0/1222934625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312001a5f0 con 0x7f3124103bd0 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f312a3e3700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f31241972c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3120003e60 tx=0x7f3120003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:19.109 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.491+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31200043e0 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.492+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f31200358d0 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.492+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31241056d0 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.492+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f312002c890 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.492+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3124105540 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.492+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 3) v1 ==== 44548+0+0 (secure 0 0 0) 0x7f312002cb00 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.493+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3124107be0 con 0x7f3124103bd0 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.493+0000 7f311b7fe700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3110037cd0 0x7f311003a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.493+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f312005cb20 con 0x7f3124103bd0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.493+0000 7f3129be2700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3110037cd0 0x7f311003a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.493+0000 7f3129be2700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3110037cd0 0x7f311003a180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3114006fd0 tx=0x7f3114006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.498+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3120022950 con 0x7f3124103bd0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:05.806+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mgrmap(e 4) v1 ==== 44654+0+0 (secure 0 0 0) 0x7f3120035a40 con 0x7f3124103bd0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.009+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f312419ae50 con 0x7f3124103bd0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.010+0000 7f311b7fe700 1 -- 172.21.15.35:0/1222934625 <== mon.0 v2:172.21.15.35:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f3120030020 con 0x7f3124103bd0 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3110037cd0 msgr2=0x7f311003a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3110037cd0 0x7f311003a180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3114006fd0 tx=0x7f3114006e40 comp rx=0 tx=0).stop 2023-03-17T07:48:19.111 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 msgr2=0x7f31241972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:19.112 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f31241972c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3120003e60 tx=0x7f3120003f40 comp rx=0 tx=0).stop 2023-03-17T07:48:19.315 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 shutdown_connections 2023-03-17T07:48:19.316 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3110037cd0 0x7f311003a180 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:19.316 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 --2- 172.21.15.35:0/1222934625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3124103bd0 0x7f31241972c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:19.316 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 >> 172.21.15.35:0/1222934625 conn(0x7f31240ff650 msgr2=0x7f31241002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:19.316 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 shutdown_connections 2023-03-17T07:48:19.316 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.012+0000 7f312c647700 1 -- 172.21.15.35:0/1222934625 wait complete. 2023-03-17T07:48:19.316 INFO:teuthology.orchestra.run.smithi035.stdout:mgr is available 2023-03-17T07:48:19.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:06 smithi035 ceph-mon[92535]: mgrmap e4: x(active, since 2s) 2023-03-17T07:48:19.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:06 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1222934625' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-03-17T07:48:19.322 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:48:19.725 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout [global] 2023-03-17T07:48:19.725 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout fsid = 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:48:19.725 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout [mgr] 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-03-17T07:48:19.726 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 2023-03-17T07:48:20.134 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout [osd] 2023-03-17T07:48:20.134 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-03-17T07:48:20.134 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-03-17T07:48:20.135 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-03-17T07:48:20.135 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-03-17T07:48:20.526 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-03-17T07:48:20.526 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd72075700 1 Processor -- start 2023-03-17T07:48:20.526 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd72075700 1 -- start start 2023-03-17T07:48:20.526 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd72075700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c105d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd72075700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c106240 con 0x7efd6c1058f0 2023-03-17T07:48:20.529 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd6b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c105d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:20.816 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd6b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c105d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38886/0 (socket says 172.21.15.35:38886) 2023-03-17T07:48:20.816 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.935+0000 7efd6b7fe700 1 -- 172.21.15.35:0/3429153143 learned_addr learned my addr 172.21.15.35:0/3429153143 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:20.816 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.936+0000 7efd6b7fe700 1 -- 172.21.15.35:0/3429153143 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c106380 con 0x7efd6c1058f0 2023-03-17T07:48:20.816 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.936+0000 7efd6b7fe700 1 --2- 172.21.15.35:0/3429153143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c105d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efd600098a0 tx=0x7efd60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ff04fc7b475df3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:20.817 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.936+0000 7efd6a7fc700 1 -- 172.21.15.35:0/3429153143 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd60004160 con 0x7efd6c1058f0 2023-03-17T07:48:20.817 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.936+0000 7efd6a7fc700 1 -- 172.21.15.35:0/3429153143 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efd600042c0 con 0x7efd6c1058f0 2023-03-17T07:48:20.817 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.936+0000 7efd6a7fc700 1 -- 172.21.15.35:0/3429153143 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd60011940 con 0x7efd6c1058f0 2023-03-17T07:48:20.986 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 -- 172.21.15.35:0/3429153143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 msgr2=0x7efd6c105d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:20.987 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 --2- 172.21.15.35:0/3429153143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c105d00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efd600098a0 tx=0x7efd60009bb0 comp rx=0 tx=0).stop 2023-03-17T07:48:20.987 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 -- 172.21.15.35:0/3429153143 shutdown_connections 2023-03-17T07:48:20.987 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 --2- 172.21.15.35:0/3429153143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c105d00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:20.987 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 -- 172.21.15.35:0/3429153143 >> 172.21.15.35:0/3429153143 conn(0x7efd6c100f60 msgr2=0x7efd6c103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:21.721 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 -- 172.21.15.35:0/3429153143 shutdown_connections 2023-03-17T07:48:21.722 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 -- 172.21.15.35:0/3429153143 wait complete. 2023-03-17T07:48:21.722 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.937+0000 7efd72075700 1 Processor -- start 2023-03-17T07:48:22.059 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd72075700 1 -- start start 2023-03-17T07:48:22.059 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd72075700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:22.059 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd72075700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1999e0 con 0x7efd6c1058f0 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd6b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd6b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c1994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38888/0 (socket says 172.21.15.35:38888) 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd6b7fe700 1 -- 172.21.15.35:0/4115808380 learned_addr learned my addr 172.21.15.35:0/4115808380 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd6b7fe700 1 -- 172.21.15.35:0/4115808380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009550 con 0x7efd6c1058f0 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd6b7fe700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c1994a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd60011dc0 tx=0x7efd60011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd600037d0 con 0x7efd6c1058f0 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c1078e0 con 0x7efd6c1058f0 2023-03-17T07:48:22.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efd6001b440 con 0x7efd6c1058f0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.938+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd6001a560 con 0x7efd6c1058f0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.939+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c107750 con 0x7efd6c1058f0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.939+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 4) v1 ==== 44654+0+0 (secure 0 0 0) 0x7efd6001b5b0 con 0x7efd6c1058f0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.940+0000 7efd68ff9700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7efd54037e00 0x7efd5403a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.940+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efd6004b8a0 con 0x7efd6c1058f0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.940+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c109dc0 con 0x7efd6c1058f0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.940+0000 7efd6affd700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7efd54037e00 0x7efd5403a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:22.061 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.940+0000 7efd6affd700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7efd54037e00 0x7efd5403a2b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd5c006fd0 tx=0x7efd5c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:06.945+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7efd6001f020 con 0x7efd6c1058f0 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.299+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7efd6c0620b0 con 0x7efd6c1058f0 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.300+0000 7efd68ff9700 1 -- 172.21.15.35:0/4115808380 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7efd6004a020 con 0x7efd6c1058f0 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7efd54037e00 msgr2=0x7efd5403a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7efd54037e00 0x7efd5403a2b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd5c006fd0 tx=0x7efd5c006e40 comp rx=0 tx=0).stop 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 msgr2=0x7efd6c1994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:22.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c1994a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd60011dc0 tx=0x7efd60011ea0 comp rx=0 tx=0).stop 2023-03-17T07:48:24.005 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 shutdown_connections 2023-03-17T07:48:24.005 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7efd54037e00 0x7efd5403a2b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:24.005 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 --2- 172.21.15.35:0/4115808380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd6c1058f0 0x7efd6c1994a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:24.006 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.302+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 >> 172.21.15.35:0/4115808380 conn(0x7efd6c100f60 msgr2=0x7efd6c101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:24.006 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.303+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 shutdown_connections 2023-03-17T07:48:24.434 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:07.303+0000 7efd72075700 1 -- 172.21.15.35:0/4115808380 wait complete. 2023-03-17T07:48:24.434 INFO:teuthology.orchestra.run.smithi035.stdout:Enabling cephadm module... 2023-03-17T07:48:24.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:07 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4115808380' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-03-17T07:48:24.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:08 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3979673883' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-03-17T07:48:24.435 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:08 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: ignoring --setuser ceph since I am not root 2023-03-17T07:48:24.435 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:08 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: ignoring --setgroup ceph since I am not root 2023-03-17T07:48:24.435 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:09.003+0000 7f70714fe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-17T07:48:24.439 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36b6842700 1 Processor -- start 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36b6842700 1 -- start start 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36b6842700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36b6842700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0106210 con 0x7f36b01058c0 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36affff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36affff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38892/0 (socket says 172.21.15.35:38892) 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36affff700 1 -- 172.21.15.35:0/925036663 learned_addr learned my addr 172.21.15.35:0/925036663 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.132+0000 7f36affff700 1 -- 172.21.15.35:0/925036663 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0106350 con 0x7f36b01058c0 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36affff700 1 --2- 172.21.15.35:0/925036663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0105cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36a00098a0 tx=0x7f36a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaa62b397c67c6b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36aeffd700 1 -- 172.21.15.35:0/925036663 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36a0004160 con 0x7f36b01058c0 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36aeffd700 1 -- 172.21.15.35:0/925036663 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f36a00042c0 con 0x7f36b01058c0 2023-03-17T07:48:25.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36aeffd700 1 -- 172.21.15.35:0/925036663 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36a0011940 con 0x7f36b01058c0 2023-03-17T07:48:26.303 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36b6842700 1 -- 172.21.15.35:0/925036663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 msgr2=0x7f36b0105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:26.303 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36b6842700 1 --2- 172.21.15.35:0/925036663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0105cd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36a00098a0 tx=0x7f36a0009bb0 comp rx=0 tx=0).stop 2023-03-17T07:48:26.303 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36b6842700 1 -- 172.21.15.35:0/925036663 shutdown_connections 2023-03-17T07:48:26.304 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36b6842700 1 --2- 172.21.15.35:0/925036663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0105cd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:27.239 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.133+0000 7f36b6842700 1 -- 172.21.15.35:0/925036663 >> 172.21.15.35:0/925036663 conn(0x7f36b0100f50 msgr2=0x7f36b0103360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:27.240 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.134+0000 7f36b6842700 1 -- 172.21.15.35:0/925036663 shutdown_connections 2023-03-17T07:48:27.240 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.134+0000 7f36b6842700 1 -- 172.21.15.35:0/925036663 wait complete. 2023-03-17T07:48:27.240 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.134+0000 7f36b6842700 1 Processor -- start 2023-03-17T07:48:27.532 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.134+0000 7f36b6842700 1 -- start start 2023-03-17T07:48:27.532 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.134+0000 7f36b6842700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:27.532 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.134+0000 7f36b6842700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b01999d0 con 0x7f36b01058c0 2023-03-17T07:48:28.062 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36affff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:28.062 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36affff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38894/0 (socket says 172.21.15.35:38894) 2023-03-17T07:48:29.123 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36affff700 1 -- 172.21.15.35:0/3979673883 learned_addr learned my addr 172.21.15.35:0/3979673883 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:29.123 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36affff700 1 -- 172.21.15.35:0/3979673883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0009550 con 0x7f36b01058c0 2023-03-17T07:48:29.123 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36affff700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0199490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36a0006af0 tx=0x7f36a0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:29.123 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36a0003bf0 con 0x7f36b01058c0 2023-03-17T07:48:29.123 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f36a001b8b0 con 0x7f36b01058c0 2023-03-17T07:48:29.124 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b01078b0 con 0x7f36b01058c0 2023-03-17T07:48:29.124 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36a00197b0 con 0x7f36b01058c0 2023-03-17T07:48:29.662 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.135+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b0107720 con 0x7f36b01058c0 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.136+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 4) v1 ==== 44654+0+0 (secure 0 0 0) 0x7f36a0019a20 con 0x7f36b01058c0 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.136+0000 7f36ad7fa700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3698037e00 0x7f369803a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.136+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f36a004bca0 con 0x7f36b01058c0 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.136+0000 7f36af7fe700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3698037e00 0x7f369803a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.136+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00620b0 con 0x7f36b01058c0 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.137+0000 7f36af7fe700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3698037e00 0x7f369803a2b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36a4006fd0 tx=0x7f36a4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:30.437 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.141+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f36a0018bd0 con 0x7f36b01058c0 2023-03-17T07:48:30.438 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.607+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f36b0199f10 con 0x7f36b01058c0 2023-03-17T07:48:30.438 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.810+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mgrmap(e 5) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f36a001ba20 con 0x7f36b01058c0 2023-03-17T07:48:30.438 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.812+0000 7f36ad7fa700 1 -- 172.21.15.35:0/3979673883 <== mon.0 v2:172.21.15.35:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f36a0018e00 con 0x7f36b01058c0 2023-03-17T07:48:30.438 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3698037e00 msgr2=0x7f369803a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:30.438 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3698037e00 0x7f369803a2b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36a4006fd0 tx=0x7f36a4006e40 comp rx=0 tx=0).stop 2023-03-17T07:48:30.438 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 msgr2=0x7f36b0199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0199490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36a0006af0 tx=0x7f36a0011a30 comp rx=0 tx=0).stop 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 shutdown_connections 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f3698037e00 0x7f369803a2b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 --2- 172.21.15.35:0/3979673883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36b01058c0 0x7f36b0199490 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 >> 172.21.15.35:0/3979673883 conn(0x7f36b0100f50 msgr2=0x7f36b0101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 shutdown_connections 2023-03-17T07:48:32.191 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:08.814+0000 7f36b6842700 1 -- 172.21.15.35:0/3979673883 wait complete. 2023-03-17T07:48:32.192 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:09.098+0000 7f70714fe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-17T07:48:32.192 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:09.207+0000 7f70714fe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-17T07:48:32.192 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:09.330+0000 7f70714fe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-17T07:48:32.192 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:09.544+0000 7f70714fe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-17T07:48:32.192 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3979673883' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-03-17T07:48:32.192 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-mon[92535]: mgrmap e5: x(active, since 5s) 2023-03-17T07:48:32.193 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:09 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:09.942+0000 7f70714fe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-17T07:48:32.193 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:10 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:10.050+0000 7f70714fe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-17T07:48:32.193 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:10 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:10.201+0000 7f70714fe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-17T07:48:32.193 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:10 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:10.323+0000 7f70714fe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-17T07:48:32.197 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "available": true, 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.716+0000 7f905c618700 1 Processor -- start 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.716+0000 7f905c618700 1 -- start start 2023-03-17T07:48:33.155 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.716+0000 7f905c618700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.716+0000 7f905c618700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054074050 con 0x7f90541063f0 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f905a3b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f905a3b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38908/0 (socket says 172.21.15.35:38908) 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f905a3b4700 1 -- 172.21.15.35:0/2288106051 learned_addr learned my addr 172.21.15.35:0/2288106051 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f905a3b4700 1 -- 172.21.15.35:0/2288106051 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054074190 con 0x7f90541063f0 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f905a3b4700 1 --2- 172.21.15.35:0/2288106051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541087d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90440098a0 tx=0x7f9044009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccf2e74d8acbfce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:33.156 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f90593b2700 1 -- 172.21.15.35:0/2288106051 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9044004160 con 0x7f90541063f0 2023-03-17T07:48:33.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f90593b2700 1 -- 172.21.15.35:0/2288106051 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f90440042c0 con 0x7f90541063f0 2023-03-17T07:48:33.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.717+0000 7f90593b2700 1 -- 172.21.15.35:0/2288106051 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9044011940 con 0x7f90541063f0 2023-03-17T07:48:33.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 -- 172.21.15.35:0/2288106051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 msgr2=0x7f90541087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:33.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 --2- 172.21.15.35:0/2288106051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541087d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90440098a0 tx=0x7f9044009bb0 comp rx=0 tx=0).stop 2023-03-17T07:48:33.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 -- 172.21.15.35:0/2288106051 shutdown_connections 2023-03-17T07:48:33.157 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 --2- 172.21.15.35:0/2288106051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541087d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:33.996 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 -- 172.21.15.35:0/2288106051 >> 172.21.15.35:0/2288106051 conn(0x7f90540ffeb0 msgr2=0x7f90541022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:34.548 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 -- 172.21.15.35:0/2288106051 shutdown_connections 2023-03-17T07:48:34.548 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.718+0000 7f905c618700 1 -- 172.21.15.35:0/2288106051 wait complete. 2023-03-17T07:48:34.548 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905c618700 1 Processor -- start 2023-03-17T07:48:34.548 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905c618700 1 -- start start 2023-03-17T07:48:34.548 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905c618700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:34.549 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905c618700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054199a00 con 0x7f90541063f0 2023-03-17T07:48:34.549 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905a3b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:36.273 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905a3b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38910/0 (socket says 172.21.15.35:38910) 2023-03-17T07:48:36.274 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905a3b4700 1 -- 172.21.15.35:0/3372841226 learned_addr learned my addr 172.21.15.35:0/3372841226 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:36.274 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905a3b4700 1 -- 172.21.15.35:0/3372841226 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044009550 con 0x7f90541063f0 2023-03-17T07:48:36.274 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f905a3b4700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541994c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9044000c00 tx=0x7f9044011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:36.274 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90440036a0 con 0x7f90541063f0 2023-03-17T07:48:37.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.719+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f904401b440 con 0x7f90541063f0 2023-03-17T07:48:37.618 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.720+0000 7f905c618700 1 -- 172.21.15.35:0/3372841226 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9054109b10 con 0x7f90541063f0 2023-03-17T07:48:37.619 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.720+0000 7f905c618700 1 -- 172.21.15.35:0/3372841226 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9054109980 con 0x7f90541063f0 2023-03-17T07:48:40.204 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.720+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90440193f0 con 0x7f90541063f0 2023-03-17T07:48:40.204 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.721+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 5) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f9044019680 con 0x7f90541063f0 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.721+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0052f0 con 0x7f90541063f0 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.721+0000 7f904b7fe700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 0x7f904003a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.721+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f904404b9c0 con 0x7f90541063f0 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.721+0000 7f9059bb3700 1 -- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 msgr2=0x7f904003a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.721+0000 7f9059bb3700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 0x7f904003a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.726+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f9044022720 con 0x7f90541063f0 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.922+0000 7f9059bb3700 1 -- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 msgr2=0x7f904003a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:40.205 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:09.922+0000 7f9059bb3700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 0x7f904003a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-17T07:48:41.481 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.194+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f903c0061d0 con 0x7f90541063f0 2023-03-17T07:48:41.481 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.195+0000 7f904b7fe700 1 -- 172.21.15.35:0/3372841226 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f904401f020 con 0x7f90541063f0 2023-03-17T07:48:41.481 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 msgr2=0x7f904003a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T07:48:41.481 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 0x7f904003a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 msgr2=0x7f90541994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541994c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9044000c00 tx=0x7f9044011e70 comp rx=0 tx=0).stop 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 shutdown_connections 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f9040037ea0 0x7f904003a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.197+0000 7f90497fa700 1 --2- 172.21.15.35:0/3372841226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90541063f0 0x7f90541994c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.198+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 >> 172.21.15.35:0/3372841226 conn(0x7f90540ffeb0 msgr2=0x7f9054100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:41.482 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.198+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 shutdown_connections 2023-03-17T07:48:43.742 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:10.198+0000 7f90497fa700 1 -- 172.21.15.35:0/3372841226 wait complete. 2023-03-17T07:48:43.742 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for the mgr to restart... 2023-03-17T07:48:43.743 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for mgr epoch 5... 2023-03-17T07:48:43.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:10 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3372841226' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-03-17T07:48:43.744 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:10 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:10.844+0000 7f70714fe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-17T07:48:43.744 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:11 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:11.535+0000 7f70714fe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-17T07:48:43.744 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:11 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:11.728+0000 7f70714fe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-17T07:48:43.744 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:12 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:12.678+0000 7f70714fe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-17T07:48:43.744 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:12 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:12.788+0000 7f70714fe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-17T07:48:43.744 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:13 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:13.006+0000 7f70714fe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-17T07:48:43.745 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:13 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:13.350+0000 7f70714fe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-17T07:48:43.745 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:13 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:13.456+0000 7f70714fe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-17T07:48:43.745 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:13 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:13.787+0000 7f70714fe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-17T07:48:44.330 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:14 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:14.110+0000 7f70714fe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-17T07:48:44.330 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:14 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:14.962+0000 7f70714fe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-17T07:48:45.099 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:15.122+0000 7f70714fe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-17T07:48:45.099 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:15.364+0000 7f70714fe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-17T07:48:45.099 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:15.499+0000 7f70714fe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-17T07:48:45.099 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:15.769+0000 7f70714fe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-17T07:48:45.099 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:16 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:16.803+0000 7f70714fe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-17T07:48:45.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: Active manager daemon x restarted 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: Activating manager daemon x 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: osdmap e2: 0 total, 0 up, 0 in 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: mgrmap e6: x(active, starting, since 0.0527755s) 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-17T07:48:47.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-17T07:48:48.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: Manager daemon x is now available 2023-03-17T07:48:48.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:48:48.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:48:48.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:48:48.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:48:48.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:48:48.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-17T07:48:48.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-17T07:48:48.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:48:48.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:17 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:48:48.082 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "initialized": true 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.127+0000 7f257365e700 1 Processor -- start 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.127+0000 7f257365e700 1 -- start start 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f257365e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c105cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f257365e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c106230 con 0x7f256c1058e0 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f25713fa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c105cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:49.449 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f25713fa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c105cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38918/0 (socket says 172.21.15.35:38918) 2023-03-17T07:48:50.095 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f25713fa700 1 -- 172.21.15.35:0/1275622192 learned_addr learned my addr 172.21.15.35:0/1275622192 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:50.095 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f25713fa700 1 -- 172.21.15.35:0/1275622192 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c106370 con 0x7f256c1058e0 2023-03-17T07:48:50.095 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f25713fa700 1 --2- 172.21.15.35:0/1275622192 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c105cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f255c0098a0 tx=0x7f255c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f15c42e1faee27b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:50.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.128+0000 7f2563fff700 1 -- 172.21.15.35:0/1275622192 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f255c004160 con 0x7f256c1058e0 2023-03-17T07:48:50.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f2563fff700 1 -- 172.21.15.35:0/1275622192 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f255c0042c0 con 0x7f256c1058e0 2023-03-17T07:48:50.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f2563fff700 1 -- 172.21.15.35:0/1275622192 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f255c011940 con 0x7f256c1058e0 2023-03-17T07:48:50.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 -- 172.21.15.35:0/1275622192 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 msgr2=0x7f256c105cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:50.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 --2- 172.21.15.35:0/1275622192 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c105cf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f255c0098a0 tx=0x7f255c009bb0 comp rx=0 tx=0).stop 2023-03-17T07:48:50.096 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 -- 172.21.15.35:0/1275622192 shutdown_connections 2023-03-17T07:48:50.794 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 --2- 172.21.15.35:0/1275622192 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c105cf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 -- 172.21.15.35:0/1275622192 >> 172.21.15.35:0/1275622192 conn(0x7f256c100fd0 msgr2=0x7f256c1033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 -- 172.21.15.35:0/1275622192 shutdown_connections 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.129+0000 7f257365e700 1 -- 172.21.15.35:0/1275622192 wait complete. 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f257365e700 1 Processor -- start 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f257365e700 1 -- start start 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f257365e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c07aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f257365e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c07b030 con 0x7f256c1058e0 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f25713fa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c07aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:51.728 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f25713fa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c07aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38920/0 (socket says 172.21.15.35:38920) 2023-03-17T07:48:54.824 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.130+0000 7f25713fa700 1 -- 172.21.15.35:0/2353765090 learned_addr learned my addr 172.21.15.35:0/2353765090 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:48:54.824 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f25713fa700 1 -- 172.21.15.35:0/2353765090 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c009550 con 0x7f256c1058e0 2023-03-17T07:48:54.824 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f25713fa700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c07aaf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f255c011dc0 tx=0x7f255c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:54.824 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f255c0037d0 con 0x7f256c1058e0 2023-03-17T07:48:54.824 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f255c01b440 con 0x7f256c1058e0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c1078d0 con 0x7f256c1058e0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f255c01a560 con 0x7f256c1058e0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.131+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c107740 con 0x7f256c1058e0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.132+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 5) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f255c003930 con 0x7f256c1058e0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.132+0000 7f25627fc700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.132+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 --> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f255803aa60 con 0x7f2558037ea0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.132+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f255c04b950 con 0x7f256c1058e0 2023-03-17T07:48:55.464 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.132+0000 7f2570bf9700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 msgr2=0x7f255803a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:55.465 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.132+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-17T07:48:55.465 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.333+0000 7f2570bf9700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 msgr2=0x7f255803a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:55.465 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.333+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-17T07:48:55.465 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.734+0000 7f2570bf9700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 msgr2=0x7f255803a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:55.465 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:11.734+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-17T07:48:55.465 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:12.535+0000 7f2570bf9700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 msgr2=0x7f255803a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:56.212 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:12.535+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:14.136+0000 7f2570bf9700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 msgr2=0x7f255803a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/3695297381 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:14.136+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:16.869+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mgrmap(e 6) v1 ==== 44432+0+0 (secure 0 0 0) 0x7f255c00bcc0 con 0x7f256c1058e0 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:16.869+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 msgr2=0x7f255803a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:16.869+0000 7f25627fc700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.871+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mgrmap(e 7) v1 ==== 44559+0+0 (secure 0 0 0) 0x7f255c016260 con 0x7f256c1058e0 2023-03-17T07:48:56.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.871+0000 7f25627fc700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f255803b790 0x7f255803db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:48:57.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.871+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f255803aa60 con 0x7f255803b790 2023-03-17T07:48:57.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.871+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f255803b790 0x7f255803db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:48:57.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.872+0000 7f2570bf9700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f255803b790 0x7f255803db70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2568003a10 tx=0x7f25680092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:48:59.456 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.873+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f255803aa60 con 0x7f255803b790 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.883+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f256c07a690 con 0x7f255803b790 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f25627fc700 1 -- 172.21.15.35:0/2353765090 <== mgr.14120 v2:172.21.15.35:6800/1582063547 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f256c07a690 con 0x7f255803b790 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f255803b790 msgr2=0x7f255803db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f255803b790 0x7f255803db70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2568003a10 tx=0x7f25680092b0 comp rx=0 tx=0).stop 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 msgr2=0x7f256c07aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c07aaf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f255c011dc0 tx=0x7f255c011ea0 comp rx=0 tx=0).stop 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 shutdown_connections 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f255803b790 0x7f255803db70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f256c1058e0 0x7f256c07aaf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 --2- 172.21.15.35:0/2353765090 >> [v2:172.21.15.35:6800/3695297381,v1:172.21.15.35:6801/3695297381] conn(0x7f2558037ea0 0x7f255803a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 >> 172.21.15.35:0/2353765090 conn(0x7f256c100fd0 msgr2=0x7f256c101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 shutdown_connections 2023-03-17T07:48:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:17.884+0000 7f257365e700 1 -- 172.21.15.35:0/2353765090 wait complete. 2023-03-17T07:49:02.322 INFO:teuthology.orchestra.run.smithi035.stdout:mgr epoch 5 is available 2023-03-17T07:49:02.685 INFO:teuthology.orchestra.run.smithi035.stdout:Setting orchestrator backend to cephadm... 2023-03-17T07:49:02.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:18 smithi035 ceph-mon[92535]: Found migration_current of "None". Setting to last migration. 2023-03-17T07:49:02.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:18 smithi035 ceph-mon[92535]: mgrmap e7: x(active, since 1.05579s) 2023-03-17T07:49:02.690 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.750+0000 7f75f7023700 1 Processor -- start 2023-03-17T07:49:04.780 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.750+0000 7f75f7023700 1 -- start start 2023-03-17T07:49:04.780 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.750+0000 7f75f7023700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 0x7f75f0079180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:04.780 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.750+0000 7f75f7023700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00796c0 con 0x7f75f007ac80 2023-03-17T07:49:04.780 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75f4dbf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 0x7f75f0079180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75f4dbf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 0x7f75f0079180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38964/0 (socket says 172.21.15.35:38964) 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75f4dbf700 1 -- 172.21.15.35:0/154573582 learned_addr learned my addr 172.21.15.35:0/154573582 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75f4dbf700 1 -- 172.21.15.35:0/154573582 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0079800 con 0x7f75f007ac80 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75f4dbf700 1 --2- 172.21.15.35:0/154573582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 0x7f75f0079180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75d80098a0 tx=0x7f75d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe40027c3fee2b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75ef7fe700 1 -- 172.21.15.35:0/154573582 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d8004160 con 0x7f75f007ac80 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75ef7fe700 1 -- 172.21.15.35:0/154573582 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f75d80042c0 con 0x7f75f007ac80 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.751+0000 7f75ef7fe700 1 -- 172.21.15.35:0/154573582 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d8011940 con 0x7f75f007ac80 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 -- 172.21.15.35:0/154573582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 msgr2=0x7f75f0079180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:06.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 --2- 172.21.15.35:0/154573582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 0x7f75f0079180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f75d80098a0 tx=0x7f75d8009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:06.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 -- 172.21.15.35:0/154573582 shutdown_connections 2023-03-17T07:49:06.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 --2- 172.21.15.35:0/154573582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f007ac80 0x7f75f0079180 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:06.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 -- 172.21.15.35:0/154573582 >> 172.21.15.35:0/154573582 conn(0x7f75f0100f30 msgr2=0x7f75f0103340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:06.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 -- 172.21.15.35:0/154573582 shutdown_connections 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 -- 172.21.15.35:0/154573582 wait complete. 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.752+0000 7f75f7023700 1 Processor -- start 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f7023700 1 -- start start 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f7023700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 0x7f75f019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f7023700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f019c270 con 0x7f75f019b920 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f4dbf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 0x7f75f019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f4dbf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 0x7f75f019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38966/0 (socket says 172.21.15.35:38966) 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f4dbf700 1 -- 172.21.15.35:0/3546517444 learned_addr learned my addr 172.21.15.35:0/3546517444 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f4dbf700 1 -- 172.21.15.35:0/3546517444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8009550 con 0x7f75f019b920 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75f4dbf700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 0x7f75f019bd30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000c00 tx=0x7f75d8003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.753+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d80118f0 con 0x7f75f019b920 2023-03-17T07:49:06.951 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.754+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f75d801b470 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.754+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75d801c450 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.754+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f010bd50 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.754+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f010bbc0 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.755+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 7) v1 ==== 44559+0+0 (secure 0 0 0) 0x7f75d8022070 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.755+0000 7f75edffb700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f75dc037d70 0x7f75dc03a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.755+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f75d804b7c0 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.755+0000 7f75effff700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f75dc037d70 0x7f75dc03a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.755+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f010bee0 con 0x7f75f019b920 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.756+0000 7f75effff700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f75dc037d70 0x7f75dc03a220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75e0006fd0 tx=0x7f75e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:06.952 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:18.760+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f75d801b5e0 con 0x7f75f019b920 2023-03-17T07:49:08.226 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.155+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f75f0060f20 con 0x7f75dc037d70 2023-03-17T07:49:08.226 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.161+0000 7f75edffb700 1 -- 172.21.15.35:0/3546517444 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f75f0060f20 con 0x7f75dc037d70 2023-03-17T07:49:08.227 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f75dc037d70 msgr2=0x7f75dc03a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:08.227 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f75dc037d70 0x7f75dc03a220 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75e0006fd0 tx=0x7f75e0006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:08.227 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 msgr2=0x7f75f019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:08.227 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 0x7f75f019bd30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000c00 tx=0x7f75d8003a40 comp rx=0 tx=0).stop 2023-03-17T07:49:08.680 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 shutdown_connections 2023-03-17T07:49:08.681 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f75dc037d70 0x7f75dc03a220 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:08.681 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 --2- 172.21.15.35:0/3546517444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75f019b920 0x7f75f019bd30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:08.681 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.163+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 >> 172.21.15.35:0/3546517444 conn(0x7f75f0100f30 msgr2=0x7f75f01032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:08.681 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.164+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 shutdown_connections 2023-03-17T07:49:08.681 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.164+0000 7f75f7023700 1 -- 172.21.15.35:0/3546517444 wait complete. 2023-03-17T07:49:09.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:19 smithi035 ceph-mon[92535]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-03-17T07:49:09.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:19 smithi035 ceph-mon[92535]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-03-17T07:49:09.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:19 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:10.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:19 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:49:11.995 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout value unchanged 2023-03-17T07:49:12.731 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.968+0000 7fa242b3a700 1 Processor -- start 2023-03-17T07:49:12.731 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.968+0000 7fa242b3a700 1 -- start start 2023-03-17T07:49:13.069 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.968+0000 7fa242b3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c1087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:13.069 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.968+0000 7fa242b3a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c074050 con 0x7fa23c1063f0 2023-03-17T07:49:13.069 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa2408d6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c1087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:13.069 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa2408d6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c1087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38978/0 (socket says 172.21.15.35:38978) 2023-03-17T07:49:13.069 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa2408d6700 1 -- 172.21.15.35:0/2667754393 learned_addr learned my addr 172.21.15.35:0/2667754393 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:13.069 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa2408d6700 1 -- 172.21.15.35:0/2667754393 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c074190 con 0x7fa23c1063f0 2023-03-17T07:49:13.070 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa2408d6700 1 --2- 172.21.15.35:0/2667754393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c1087d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa2300098a0 tx=0x7fa230009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ea5ef2705cee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:13.577 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa23b7fe700 1 -- 172.21.15.35:0/2667754393 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa230004160 con 0x7fa23c1063f0 2023-03-17T07:49:13.577 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa23b7fe700 1 -- 172.21.15.35:0/2667754393 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa2300042c0 con 0x7fa23c1063f0 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.969+0000 7fa23b7fe700 1 -- 172.21.15.35:0/2667754393 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa230011940 con 0x7fa23c1063f0 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 -- 172.21.15.35:0/2667754393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 msgr2=0x7fa23c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 --2- 172.21.15.35:0/2667754393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c1087d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa2300098a0 tx=0x7fa230009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 -- 172.21.15.35:0/2667754393 shutdown_connections 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 --2- 172.21.15.35:0/2667754393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c1087d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 -- 172.21.15.35:0/2667754393 >> 172.21.15.35:0/2667754393 conn(0x7fa23c0ffeb0 msgr2=0x7fa23c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 -- 172.21.15.35:0/2667754393 shutdown_connections 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 -- 172.21.15.35:0/2667754393 wait complete. 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.970+0000 7fa242b3a700 1 Processor -- start 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa242b3a700 1 -- start start 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa242b3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa242b3a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c106290 con 0x7fa23c1063f0 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa2408d6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:13.968 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa2408d6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38980/0 (socket says 172.21.15.35:38980) 2023-03-17T07:49:13.969 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa2408d6700 1 -- 172.21.15.35:0/699865918 learned_addr learned my addr 172.21.15.35:0/699865918 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:13.969 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa2408d6700 1 -- 172.21.15.35:0/699865918 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009550 con 0x7fa23c1063f0 2023-03-17T07:49:13.969 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa2408d6700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c105d50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa230011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:13.969 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2300036a0 con 0x7fa23c1063f0 2023-03-17T07:49:13.969 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa23001b440 con 0x7fa23c1063f0 2023-03-17T07:49:13.969 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.971+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c109b10 con 0x7fa23c1063f0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.972+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2300193f0 con 0x7fa23c1063f0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.972+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c109980 con 0x7fa23c1063f0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.973+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7fa230019630 con 0x7fa23c1063f0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.973+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c0620b0 con 0x7fa23c1063f0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.973+0000 7fa239ffb700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa22c037e50 0x7fa22c03a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.973+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa23004bba0 con 0x7fa23c1063f0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.973+0000 7fa23bfff700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa22c037e50 0x7fa22c03a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.974+0000 7fa23bfff700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa22c037e50 0x7fa22c03a300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa228006fd0 tx=0x7fa228006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:14.421 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:19.978+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fa230018d20 con 0x7fa23c1063f0 2023-03-17T07:49:14.422 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.337+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fa23c105270 con 0x7fa22c037e50 2023-03-17T07:49:14.422 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.338+0000 7fa239ffb700 1 -- 172.21.15.35:0/699865918 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fa23c105270 con 0x7fa22c037e50 2023-03-17T07:49:15.688 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa22c037e50 msgr2=0x7fa22c03a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:15.689 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa22c037e50 0x7fa22c03a300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa228006fd0 tx=0x7fa228006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:15.689 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 msgr2=0x7fa23c105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:15.689 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c105d50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa230000c00 tx=0x7fa230011e70 comp rx=0 tx=0).stop 2023-03-17T07:49:15.689 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 shutdown_connections 2023-03-17T07:49:15.689 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa22c037e50 0x7fa22c03a300 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:15.689 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 --2- 172.21.15.35:0/699865918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa23c1063f0 0x7fa23c105d50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:16.701 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 >> 172.21.15.35:0/699865918 conn(0x7fa23c0ffeb0 msgr2=0x7fa23c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:16.701 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 shutdown_connections 2023-03-17T07:49:16.701 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:20.340+0000 7fa242b3a700 1 -- 172.21.15.35:0/699865918 wait complete. 2023-03-17T07:49:16.701 INFO:teuthology.orchestra.run.smithi035.stdout:Generating ssh key... 2023-03-17T07:49:16.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:20 smithi035 ceph-mon[92535]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:16.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:20 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:19] ENGINE Bus STARTING 2023-03-17T07:49:16.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:20 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:19] ENGINE Serving on http://172.21.15.35:8765 2023-03-17T07:49:16.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:20 smithi035 ceph-mon[92535]: mgrmap e8: x(active, since 3s) 2023-03-17T07:49:16.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:20 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:49:17.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:19] ENGINE Serving on https://172.21.15.35:7150 2023-03-17T07:49:17.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:19] ENGINE Bus STARTED 2023-03-17T07:49:17.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-mon[92535]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:17.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:17.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:18.081 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: Generating public/private rsa key pair. 2023-03-17T07:49:18.081 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: Your identification has been saved in /tmp/tmpw7q1b42i/key. 2023-03-17T07:49:18.081 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: Your public key has been saved in /tmp/tmpw7q1b42i/key.pub. 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: The key fingerprint is: 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: SHA256:/oSl3F3cIQw6idiFPGKPpQH5f7jUDMO5lK9anPacll0 ceph-80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: The key's randomart image is: 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: +---[RSA 3072]----+ 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | .o . .. . | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | . +o=o o o | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | o.Oo++ o . | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | + O . ....| 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | o S . o .| 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | .B.X . E | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | .=O = o | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | ooo=.. | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: | .. .+. | 2023-03-17T07:49:18.082 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:21 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: +----[SHA256]-----+ 2023-03-17T07:49:18.086 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.208+0000 7f3b65183700 1 Processor -- start 2023-03-17T07:49:18.962 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.208+0000 7f3b65183700 1 -- start start 2023-03-17T07:49:18.962 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.208+0000 7f3b65183700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b60105cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.208+0000 7f3b65183700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60106230 con 0x7f3b601058e0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.208+0000 7f3b5ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b60105cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b60105cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38984/0 (socket says 172.21.15.35:38984) 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5ed9d700 1 -- 172.21.15.35:0/1304301915 learned_addr learned my addr 172.21.15.35:0/1304301915 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5ed9d700 1 -- 172.21.15.35:0/1304301915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60106370 con 0x7f3b601058e0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5ed9d700 1 --2- 172.21.15.35:0/1304301915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b60105cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b540098a0 tx=0x7f3b54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9569476e103a14b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5dd9b700 1 -- 172.21.15.35:0/1304301915 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b54004160 con 0x7f3b601058e0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5dd9b700 1 -- 172.21.15.35:0/1304301915 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3b540042c0 con 0x7f3b601058e0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.209+0000 7f3b5dd9b700 1 -- 172.21.15.35:0/1304301915 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b54011940 con 0x7f3b601058e0 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 -- 172.21.15.35:0/1304301915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 msgr2=0x7f3b60105cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 --2- 172.21.15.35:0/1304301915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b60105cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b540098a0 tx=0x7f3b54009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 -- 172.21.15.35:0/1304301915 shutdown_connections 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 --2- 172.21.15.35:0/1304301915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b60105cf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 -- 172.21.15.35:0/1304301915 >> 172.21.15.35:0/1304301915 conn(0x7f3b60100fd0 msgr2=0x7f3b601033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:18.963 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 -- 172.21.15.35:0/1304301915 shutdown_connections 2023-03-17T07:49:18.964 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.210+0000 7f3b65183700 1 -- 172.21.15.35:0/1304301915 wait complete. 2023-03-17T07:49:18.964 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b65183700 1 Processor -- start 2023-03-17T07:49:20.307 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b65183700 1 -- start start 2023-03-17T07:49:20.307 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b65183700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b601994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:20.307 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b65183700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60199a20 con 0x7f3b601058e0 2023-03-17T07:49:20.307 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b5ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b601994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:20.307 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b5ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b601994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38986/0 (socket says 172.21.15.35:38986) 2023-03-17T07:49:20.741 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b5ed9d700 1 -- 172.21.15.35:0/4177171880 learned_addr learned my addr 172.21.15.35:0/4177171880 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:21.117 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.211+0000 7f3b5ed9d700 1 -- 172.21.15.35:0/4177171880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54009550 con 0x7f3b601058e0 2023-03-17T07:49:21.117 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.212+0000 7f3b5ed9d700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b601994e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011dc0 tx=0x7f3b54011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:21.117 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.212+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b540037d0 con 0x7f3b601058e0 2023-03-17T07:49:21.455 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.212+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3b5401b440 con 0x7f3b601058e0 2023-03-17T07:49:21.455 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.212+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b601078d0 con 0x7f3b601058e0 2023-03-17T07:49:21.455 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.212+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b5401a560 con 0x7f3b601058e0 2023-03-17T07:49:21.455 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.212+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b60107740 con 0x7f3b601058e0 2023-03-17T07:49:21.820 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.213+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f3b5401a7d0 con 0x7f3b601058e0 2023-03-17T07:49:21.820 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.213+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b60109db0 con 0x7f3b601058e0 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.213+0000 7f3b47fff700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f3b48037ea0 0x7f3b4803a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.213+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3b5404b910 con 0x7f3b601058e0 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.213+0000 7f3b5e59c700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f3b48037ea0 0x7f3b4803a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.214+0000 7f3b5e59c700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f3b48037ea0 0x7f3b4803a350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006fd0 tx=0x7f3b50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.218+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3b54023770 con 0x7f3b601058e0 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.579+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b60102350 con 0x7f3b48037ea0 2023-03-17T07:49:21.821 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.775+0000 7f3b47fff700 1 -- 172.21.15.35:0/4177171880 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3b60102350 con 0x7f3b48037ea0 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f3b48037ea0 msgr2=0x7f3b4803a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f3b48037ea0 0x7f3b4803a350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006fd0 tx=0x7f3b50006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 msgr2=0x7f3b601994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b601994e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011dc0 tx=0x7f3b54011ea0 comp rx=0 tx=0).stop 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 shutdown_connections 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f3b48037ea0 0x7f3b4803a350 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 --2- 172.21.15.35:0/4177171880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b601058e0 0x7f3b601994e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.777+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 >> 172.21.15.35:0/4177171880 conn(0x7f3b60100fd0 msgr2=0x7f3b60101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.778+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 shutdown_connections 2023-03-17T07:49:21.822 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:21.778+0000 7f3b65183700 1 -- 172.21.15.35:0/4177171880 wait complete. 2023-03-17T07:49:21.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:22 smithi035 ceph-mon[92535]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:21.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:22 smithi035 ceph-mon[92535]: Generating ssh key... 2023-03-17T07:49:21.826 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:49:23.416 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7c337700 1 Processor -- start 2023-03-17T07:49:23.416 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7c337700 1 -- start start 2023-03-17T07:49:23.416 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7c337700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e74104c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:23.417 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7c337700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74105150 con 0x7f1e74104800 2023-03-17T07:49:23.417 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7a0d3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e74104c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:23.417 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7a0d3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e74104c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38990/0 (socket says 172.21.15.35:38990) 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7a0d3700 1 -- 172.21.15.35:0/930139041 learned_addr learned my addr 172.21.15.35:0/930139041 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.683+0000 7f1e7a0d3700 1 -- 172.21.15.35:0/930139041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74105290 con 0x7f1e74104800 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.684+0000 7f1e7a0d3700 1 --2- 172.21.15.35:0/930139041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e74104c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e700098a0 tx=0x7f1e70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8188af7a66b58b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.684+0000 7f1e790d1700 1 -- 172.21.15.35:0/930139041 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e70004160 con 0x7f1e74104800 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.684+0000 7f1e790d1700 1 -- 172.21.15.35:0/930139041 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1e700042c0 con 0x7f1e74104800 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.684+0000 7f1e790d1700 1 -- 172.21.15.35:0/930139041 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e70011940 con 0x7f1e74104800 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.684+0000 7f1e7c337700 1 -- 172.21.15.35:0/930139041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 msgr2=0x7f1e74104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.684+0000 7f1e7c337700 1 --2- 172.21.15.35:0/930139041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e74104c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e700098a0 tx=0x7f1e70009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:26.487 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 -- 172.21.15.35:0/930139041 shutdown_connections 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 --2- 172.21.15.35:0/930139041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e74104c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 -- 172.21.15.35:0/930139041 >> 172.21.15.35:0/930139041 conn(0x7f1e740ffe90 msgr2=0x7f1e741022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 -- 172.21.15.35:0/930139041 shutdown_connections 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 -- 172.21.15.35:0/930139041 wait complete. 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 Processor -- start 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 -- start start 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e7418f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.685+0000 7f1e7c337700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7418fec0 con 0x7f1e74104800 2023-03-17T07:49:26.488 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7a0d3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e7418f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7a0d3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e7418f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38992/0 (socket says 172.21.15.35:38992) 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7a0d3700 1 -- 172.21.15.35:0/536384682 learned_addr learned my addr 172.21.15.35:0/536384682 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7a0d3700 1 -- 172.21.15.35:0/536384682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70009550 con 0x7f1e74104800 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7a0d3700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e7418f980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e70011dc0 tx=0x7f1e70011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e700037d0 con 0x7f1e74104800 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1e7001b440 con 0x7f1e74104800 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e741067f0 con 0x7f1e74104800 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e7001a560 con 0x7f1e74104800 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.686+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e74106660 con 0x7f1e74104800 2023-03-17T07:49:26.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.687+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e740620b0 con 0x7f1e74104800 2023-03-17T07:49:29.128 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.687+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f1e7001b5b0 con 0x7f1e74104800 2023-03-17T07:49:29.128 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.688+0000 7f1e6b7fe700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f1e60037ea0 0x7f1e6003a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:29.128 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.688+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1e7004b910 con 0x7f1e74104800 2023-03-17T07:49:29.128 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.688+0000 7f1e798d2700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f1e60037ea0 0x7f1e6003a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:31.099 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.688+0000 7f1e798d2700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f1e60037ea0 0x7f1e6003a350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e64006fd0 tx=0x7f1e64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:31.099 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:22.692+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1e700239a0 con 0x7f1e74104800 2023-03-17T07:49:31.099 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.054+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e7418ee90 con 0x7f1e60037ea0 2023-03-17T07:49:31.099 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.054+0000 7f1e6b7fe700 1 -- 172.21.15.35:0/536384682 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f1e7418ee90 con 0x7f1e60037ea0 2023-03-17T07:49:32.591 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f1e60037ea0 msgr2=0x7f1e6003a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:32.591 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f1e60037ea0 0x7f1e6003a350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e64006fd0 tx=0x7f1e64006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:32.591 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 msgr2=0x7f1e7418f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:32.591 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e7418f980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e70011dc0 tx=0x7f1e70011ea0 comp rx=0 tx=0).stop 2023-03-17T07:49:33.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 shutdown_connections 2023-03-17T07:49:33.511 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f1e60037ea0 0x7f1e6003a350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 --2- 172.21.15.35:0/536384682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1e74104800 0x7f1e7418f980 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.056+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 >> 172.21.15.35:0/536384682 conn(0x7f1e740ffe90 msgr2=0x7f1e74079850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.057+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 shutdown_connections 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.057+0000 7f1e7c337700 1 -- 172.21.15.35:0/536384682 wait complete. 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:Adding key to root@localhost authorized_keys... 2023-03-17T07:49:34.273 INFO:teuthology.orchestra.run.smithi035.stdout:Adding host smithi035... 2023-03-17T07:49:34.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:23 smithi035 ceph-mon[92535]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:34.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:24 smithi035 ceph-mon[92535]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi035", "addr": "172.21.15.35", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:36.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:24 smithi035 ceph-mon[92535]: Deploying cephadm binary to smithi035 2023-03-17T07:49:36.324 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout Added host 'smithi035' with addr '172.21.15.35' 2023-03-17T07:49:36.938 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.946+0000 7f5744b4b700 1 Processor -- start 2023-03-17T07:49:36.938 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f5744b4b700 1 -- start start 2023-03-17T07:49:36.938 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f5744b4b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f57401045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:36.938 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f5744b4b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740079d30 con 0x7f57401041c0 2023-03-17T07:49:36.938 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f573e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f57401045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f573e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f57401045d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38996/0 (socket says 172.21.15.35:38996) 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f573e59c700 1 -- 172.21.15.35:0/3450772795 learned_addr learned my addr 172.21.15.35:0/3450772795 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f573e59c700 1 -- 172.21.15.35:0/3450772795 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740079e70 con 0x7f57401041c0 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.947+0000 7f573e59c700 1 --2- 172.21.15.35:0/3450772795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f57401045d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57300098a0 tx=0x7f5730009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df26990541b7d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f573d59a700 1 -- 172.21.15.35:0/3450772795 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5730004160 con 0x7f57401041c0 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f573d59a700 1 -- 172.21.15.35:0/3450772795 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f57300042c0 con 0x7f57401041c0 2023-03-17T07:49:37.864 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f573d59a700 1 -- 172.21.15.35:0/3450772795 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5730011940 con 0x7f57401041c0 2023-03-17T07:49:37.865 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 -- 172.21.15.35:0/3450772795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 msgr2=0x7f57401045d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:37.865 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 --2- 172.21.15.35:0/3450772795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f57401045d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57300098a0 tx=0x7f5730009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:37.865 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 -- 172.21.15.35:0/3450772795 shutdown_connections 2023-03-17T07:49:37.866 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 --2- 172.21.15.35:0/3450772795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f57401045d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:37.866 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 -- 172.21.15.35:0/3450772795 >> 172.21.15.35:0/3450772795 conn(0x7f57400ffe30 msgr2=0x7f5740102240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:38.845 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 -- 172.21.15.35:0/3450772795 shutdown_connections 2023-03-17T07:49:38.845 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.948+0000 7f5744b4b700 1 -- 172.21.15.35:0/3450772795 wait complete. 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f5744b4b700 1 Processor -- start 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f5744b4b700 1 -- start start 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f5744b4b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f574019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f5744b4b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574019bc10 con 0x7f57401041c0 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f573e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f574019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f573e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f574019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:38998/0 (socket says 172.21.15.35:38998) 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.949+0000 7f573e59c700 1 -- 172.21.15.35:0/2013719447 learned_addr learned my addr 172.21.15.35:0/2013719447 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:38.846 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f573e59c700 1 -- 172.21.15.35:0/2013719447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009550 con 0x7f57401041c0 2023-03-17T07:49:39.393 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f573e59c700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f574019b6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5730000c00 tx=0x7f5730011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:39.393 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57300036a0 con 0x7f57401041c0 2023-03-17T07:49:40.993 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5730003c70 con 0x7f57401041c0 2023-03-17T07:49:40.993 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5740105910 con 0x7f57401041c0 2023-03-17T07:49:40.993 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57300193f0 con 0x7f57401041c0 2023-03-17T07:49:40.994 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.950+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5740105780 con 0x7f57401041c0 2023-03-17T07:49:40.994 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.951+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f5730019620 con 0x7f57401041c0 2023-03-17T07:49:42.005 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.951+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5740194eb0 con 0x7f57401041c0 2023-03-17T07:49:42.005 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.951+0000 7f57377fe700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f572c037ea0 0x7f572c03a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:42.006 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.951+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f573004b870 con 0x7f57401041c0 2023-03-17T07:49:42.589 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.951+0000 7f573dd9b700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f572c037ea0 0x7f572c03a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:42.589 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.952+0000 7f573dd9b700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f572c037ea0 0x7f572c03a350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5728006fd0 tx=0x7f5728006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:23.956+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f5730022720 con 0x7f57401041c0 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:24.318+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi035", "addr": "172.21.15.35", "target": ["mon-mgr", ""]}) v1 -- 0x7f5740060ec0 con 0x7f572c037ea0 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.416+0000 7f57377fe700 1 -- 172.21.15.35:0/2013719447 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5740060ec0 con 0x7f572c037ea0 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f572c037ea0 msgr2=0x7f572c03a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f572c037ea0 0x7f572c03a350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5728006fd0 tx=0x7f5728006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 msgr2=0x7f574019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f574019b6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5730000c00 tx=0x7f5730011e70 comp rx=0 tx=0).stop 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 shutdown_connections 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f572c037ea0 0x7f572c03a350 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 --2- 172.21.15.35:0/2013719447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f57401041c0 0x7f574019b6d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 >> 172.21.15.35:0/2013719447 conn(0x7f57400ffe30 msgr2=0x7f574018fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 shutdown_connections 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:26.419+0000 7f5744b4b700 1 -- 172.21.15.35:0/2013719447 wait complete. 2023-03-17T07:49:43.564 INFO:teuthology.orchestra.run.smithi035.stdout:Deploying unmanaged mon service... 2023-03-17T07:49:43.565 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:27 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:43.565 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:27 smithi035 ceph-mon[92535]: Added host smithi035 2023-03-17T07:49:43.565 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:27 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:49:44.672 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-03-17T07:49:45.451 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.284+0000 7f8a98292700 1 Processor -- start 2023-03-17T07:49:45.451 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a98292700 1 -- start start 2023-03-17T07:49:45.451 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a98292700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a90105180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:45.451 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a98292700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a901056c0 con 0x7f8a90104d70 2023-03-17T07:49:45.451 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a9602e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a90105180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:45.452 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a9602e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a90105180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39032/0 (socket says 172.21.15.35:39032) 2023-03-17T07:49:45.452 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a9602e700 1 -- 172.21.15.35:0/788626295 learned_addr learned my addr 172.21.15.35:0/788626295 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:45.452 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.285+0000 7f8a9602e700 1 -- 172.21.15.35:0/788626295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90105800 con 0x7f8a90104d70 2023-03-17T07:49:45.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.286+0000 7f8a9602e700 1 --2- 172.21.15.35:0/788626295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a90105180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00bb40 tx=0x7f8a8c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabf29310d596c08 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:45.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.286+0000 7f8a9502c700 1 -- 172.21.15.35:0/788626295 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8c00dbe0 con 0x7f8a90104d70 2023-03-17T07:49:45.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.286+0000 7f8a9502c700 1 -- 172.21.15.35:0/788626295 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8a8c0044a0 con 0x7f8a90104d70 2023-03-17T07:49:45.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.286+0000 7f8a9502c700 1 -- 172.21.15.35:0/788626295 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8c003da0 con 0x7f8a90104d70 2023-03-17T07:49:45.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.286+0000 7f8a98292700 1 -- 172.21.15.35:0/788626295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 msgr2=0x7f8a90105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:45.882 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.286+0000 7f8a98292700 1 --2- 172.21.15.35:0/788626295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a90105180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00bb40 tx=0x7f8a8c00be50 comp rx=0 tx=0).stop 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 -- 172.21.15.35:0/788626295 shutdown_connections 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 --2- 172.21.15.35:0/788626295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a90105180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 -- 172.21.15.35:0/788626295 >> 172.21.15.35:0/788626295 conn(0x7f8a900ff680 msgr2=0x7f8a90101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 -- 172.21.15.35:0/788626295 shutdown_connections 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 -- 172.21.15.35:0/788626295 wait complete. 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 Processor -- start 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 -- start start 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.287+0000 7f8a98292700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a901973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a98292700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a90197920 con 0x7f8a90104d70 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a9602e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a901973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a9602e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a901973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39034/0 (socket says 172.21.15.35:39034) 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a9602e700 1 -- 172.21.15.35:0/3035020983 learned_addr learned my addr 172.21.15.35:0/3035020983 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a9602e700 1 -- 172.21.15.35:0/3035020983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c00b7f0 con 0x7f8a90104d70 2023-03-17T07:49:45.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a9602e700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a901973e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c003df0 tx=0x7f8a8c003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8c01e070 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8a8c010970 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a901068d0 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8c022850 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.288+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a90106740 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.289+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f8a8c02c440 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.289+0000 7f8a837fe700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f8a7c037e00 0x7f8a7c03a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.289+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a90103970 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.290+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8a8c04de10 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.294+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f8a8c027080 con 0x7f8a90104d70 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.298+0000 7f8a9582d700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f8a7c037e00 0x7f8a7c03a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.298+0000 7f8a9582d700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f8a7c037e00 0x7f8a7c03a2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006fd0 tx=0x7f8a84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.678+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8a90060ec0 con 0x7f8a7c037e00 2023-03-17T07:49:45.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.684+0000 7f8a837fe700 1 -- 172.21.15.35:0/3035020983 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8a90060ec0 con 0x7f8a7c037e00 2023-03-17T07:49:47.026 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f8a7c037e00 msgr2=0x7f8a7c03a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:47.026 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f8a7c037e00 0x7f8a7c03a2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006fd0 tx=0x7f8a84006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 msgr2=0x7f8a901973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a901973e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c003df0 tx=0x7f8a8c003ed0 comp rx=0 tx=0).stop 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 shutdown_connections 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f8a7c037e00 0x7f8a7c03a2b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 --2- 172.21.15.35:0/3035020983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8a90104d70 0x7f8a901973e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 >> 172.21.15.35:0/3035020983 conn(0x7f8a900ff680 msgr2=0x7f8a9018e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:47.027 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 shutdown_connections 2023-03-17T07:49:48.740 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:27.686+0000 7f8a98292700 1 -- 172.21.15.35:0/3035020983 wait complete. 2023-03-17T07:49:48.740 INFO:teuthology.orchestra.run.smithi035.stdout:Deploying unmanaged mgr service... 2023-03-17T07:49:49.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:28 smithi035 ceph-mon[92535]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:49.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:28 smithi035 ceph-mon[92535]: Saving service mon spec with placement count:5 2023-03-17T07:49:49.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:28 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:49.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:28 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:49.588 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-03-17T07:49:51.608 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.941+0000 7f7f09447700 1 Processor -- start 2023-03-17T07:49:51.608 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.941+0000 7f7f09447700 1 -- start start 2023-03-17T07:49:51.608 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.941+0000 7f7f09447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f04105180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:51.608 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.941+0000 7f7f09447700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f041056c0 con 0x7f7f04104d70 2023-03-17T07:49:51.608 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f04105180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:51.608 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f04105180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39038/0 (socket says 172.21.15.35:39038) 2023-03-17T07:49:52.284 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f02ffd700 1 -- 172.21.15.35:0/1424605860 learned_addr learned my addr 172.21.15.35:0/1424605860 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:52.284 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f02ffd700 1 -- 172.21.15.35:0/1424605860 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04105800 con 0x7f7f04104d70 2023-03-17T07:49:52.284 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f02ffd700 1 --2- 172.21.15.35:0/1424605860 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f04105180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098a0 tx=0x7f7ef4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ddbb2a88df9456 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:52.284 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f01ffb700 1 -- 172.21.15.35:0/1424605860 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef4004160 con 0x7f7f04104d70 2023-03-17T07:49:52.284 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f01ffb700 1 -- 172.21.15.35:0/1424605860 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ef40042c0 con 0x7f7f04104d70 2023-03-17T07:49:52.284 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.942+0000 7f7f01ffb700 1 -- 172.21.15.35:0/1424605860 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef40118e0 con 0x7f7f04104d70 2023-03-17T07:49:53.009 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.943+0000 7f7f09447700 1 -- 172.21.15.35:0/1424605860 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 msgr2=0x7f7f04105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.943+0000 7f7f09447700 1 --2- 172.21.15.35:0/1424605860 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f04105180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098a0 tx=0x7f7ef4009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.944+0000 7f7f09447700 1 -- 172.21.15.35:0/1424605860 shutdown_connections 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.944+0000 7f7f09447700 1 --2- 172.21.15.35:0/1424605860 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f04105180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.944+0000 7f7f09447700 1 -- 172.21.15.35:0/1424605860 >> 172.21.15.35:0/1424605860 conn(0x7f7f040ff680 msgr2=0x7f7f04101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.944+0000 7f7f09447700 1 -- 172.21.15.35:0/1424605860 shutdown_connections 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.944+0000 7f7f09447700 1 -- 172.21.15.35:0/1424605860 wait complete. 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.944+0000 7f7f09447700 1 Processor -- start 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f09447700 1 -- start start 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f09447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f0418f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f09447700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0418ff10 con 0x7f7f04104d70 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f0418f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f0418f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39040/0 (socket says 172.21.15.35:39040) 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f02ffd700 1 -- 172.21.15.35:0/1230396238 learned_addr learned my addr 172.21.15.35:0/1230396238 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f02ffd700 1 -- 172.21.15.35:0/1230396238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4009550 con 0x7f7f04104d70 2023-03-17T07:49:53.010 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7f02ffd700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f0418f9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4006af0 tx=0x7f7ef4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.945+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef40037d0 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.946+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ef401b440 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.946+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef4019560 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.946+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04106910 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.946+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04106780 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.947+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f7ef40197d0 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.947+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f040620b0 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.947+0000 7f7eebfff700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f7eec037e50 0x7f7eec03a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.947+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7ef404b870 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.947+0000 7f7f027fc700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f7eec037e50 0x7f7eec03a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.948+0000 7f7f027fc700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f7eec037e50 0x7f7eec03a300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8006fd0 tx=0x7f7ef8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:28.953+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f7ef4018db0 con 0x7f7f04104d70 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.335+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7f0418eed0 con 0x7f7eec037e50 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.340+0000 7f7eebfff700 1 -- 172.21.15.35:0/1230396238 <== mgr.14120 v2:172.21.15.35:6800/1582063547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7f0418eed0 con 0x7f7eec037e50 2023-03-17T07:49:53.011 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f7eec037e50 msgr2=0x7f7eec03a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f7eec037e50 0x7f7eec03a300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8006fd0 tx=0x7f7ef8006e40 comp rx=0 tx=0).stop 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 msgr2=0x7f7f0418f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f0418f9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4006af0 tx=0x7f7ef4011e80 comp rx=0 tx=0).stop 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 shutdown_connections 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f7eec037e50 0x7f7eec03a300 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 --2- 172.21.15.35:0/1230396238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7f04104d70 0x7f7f0418f9d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 >> 172.21.15.35:0/1230396238 conn(0x7f7f040ff680 msgr2=0x7f7f04104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:53.012 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 shutdown_connections 2023-03-17T07:49:54.302 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:29.343+0000 7f7f09447700 1 -- 172.21.15.35:0/1230396238 wait complete. 2023-03-17T07:49:54.303 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:30 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:55.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:30 smithi035 ceph-mon[92535]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:49:55.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:30 smithi035 ceph-mon[92535]: Saving service mgr spec with placement count:2 2023-03-17T07:49:55.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:30 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:49:55.540 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2eefe700 1 Processor -- start 2023-03-17T07:49:56.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2eefe700 1 -- start start 2023-03-17T07:49:56.798 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2eefe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28104370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:56.799 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2eefe700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef281048b0 con 0x7fef28103f60 2023-03-17T07:49:56.799 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2cc9a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28104370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:56.799 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2cc9a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28104370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39044/0 (socket says 172.21.15.35:39044) 2023-03-17T07:49:56.799 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.181+0000 7fef2cc9a700 1 -- 172.21.15.35:0/3705683573 learned_addr learned my addr 172.21.15.35:0/3705683573 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:56.799 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.182+0000 7fef2cc9a700 1 -- 172.21.15.35:0/3705683573 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef281049f0 con 0x7fef28103f60 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.182+0000 7fef2cc9a700 1 --2- 172.21.15.35:0/3705683573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28104370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0098a0 tx=0x7fef1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28ff397874658c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.182+0000 7fef277fe700 1 -- 172.21.15.35:0/3705683573 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef1c004160 con 0x7fef28103f60 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.182+0000 7fef277fe700 1 -- 172.21.15.35:0/3705683573 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1c0042c0 con 0x7fef28103f60 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.182+0000 7fef277fe700 1 -- 172.21.15.35:0/3705683573 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef1c0118e0 con 0x7fef28103f60 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 -- 172.21.15.35:0/3705683573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 msgr2=0x7fef28104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 --2- 172.21.15.35:0/3705683573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28104370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0098a0 tx=0x7fef1c009bb0 comp rx=0 tx=0).stop 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 -- 172.21.15.35:0/3705683573 shutdown_connections 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 --2- 172.21.15.35:0/3705683573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28104370 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 -- 172.21.15.35:0/3705683573 >> 172.21.15.35:0/3705683573 conn(0x7fef280ff650 msgr2=0x7fef28101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 -- 172.21.15.35:0/3705683573 shutdown_connections 2023-03-17T07:49:56.800 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.183+0000 7fef2eefe700 1 -- 172.21.15.35:0/3705683573 wait complete. 2023-03-17T07:49:58.006 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2eefe700 1 Processor -- start 2023-03-17T07:49:58.006 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2eefe700 1 -- start start 2023-03-17T07:49:58.007 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2eefe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:49:58.007 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2eefe700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28199a80 con 0x7fef28103f60 2023-03-17T07:49:59.202 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2cc9a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:49:59.202 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2cc9a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39046/0 (socket says 172.21.15.35:39046) 2023-03-17T07:49:59.202 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2cc9a700 1 -- 172.21.15.35:0/1756316049 learned_addr learned my addr 172.21.15.35:0/1756316049 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:49:59.202 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2cc9a700 1 -- 172.21.15.35:0/1756316049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009550 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.184+0000 7fef2cc9a700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28199540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef1c006af0 tx=0x7fef1c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.185+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef1c0037d0 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.185+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef28105f90 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.185+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1c01b440 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.185+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef1c0193d0 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.185+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef28105e00 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.186+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7fef1c019690 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.186+0000 7fef25ffb700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fef18037e00 0x7fef1803a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.186+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fef1c04b940 con 0x7fef28103f60 2023-03-17T07:50:01.065 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.186+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef28108430 con 0x7fef28103f60 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.186+0000 7fef27fff700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fef18037e00 0x7fef1803a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.187+0000 7fef27fff700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fef18037e00 0x7fef1803a2b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef14006fd0 tx=0x7fef14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.195+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fef1c01a3d0 con 0x7fef28103f60 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.564+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fef280620b0 con 0x7fef28103f60 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.568+0000 7fef25ffb700 1 -- 172.21.15.35:0/1756316049 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fef1c049020 con 0x7fef28103f60 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fef18037e00 msgr2=0x7fef1803a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fef18037e00 0x7fef1803a2b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef14006fd0 tx=0x7fef14006e40 comp rx=0 tx=0).stop 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 msgr2=0x7fef28199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28199540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef1c006af0 tx=0x7fef1c011e80 comp rx=0 tx=0).stop 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 shutdown_connections 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fef18037e00 0x7fef1803a2b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 --2- 172.21.15.35:0/1756316049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef28103f60 0x7fef28199540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.570+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 >> 172.21.15.35:0/1756316049 conn(0x7fef280ff650 msgr2=0x7fef28100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.571+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 shutdown_connections 2023-03-17T07:50:01.066 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:30.571+0000 7fef2eefe700 1 -- 172.21.15.35:0/1756316049 wait complete. 2023-03-17T07:50:01.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:31 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1756316049' entity='client.admin' 2023-03-17T07:50:01.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:31 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:50:01.071 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.685+0000 7f428ea09700 1 Processor -- start 2023-03-17T07:50:03.149 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.685+0000 7f428ea09700 1 -- start start 2023-03-17T07:50:03.149 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.685+0000 7f428ea09700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288108880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:03.149 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.685+0000 7f428ea09700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288079cf0 con 0x7f42881064a0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4287fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288108880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4287fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288108880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39050/0 (socket says 172.21.15.35:39050) 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4287fff700 1 -- 172.21.15.35:0/3701158513 learned_addr learned my addr 172.21.15.35:0/3701158513 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4287fff700 1 -- 172.21.15.35:0/3701158513 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4288079e30 con 0x7f42881064a0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4287fff700 1 --2- 172.21.15.35:0/3701158513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288108880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42780098a0 tx=0x7f4278009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9252b2f69f4ad1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4286ffd700 1 -- 172.21.15.35:0/3701158513 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4278004160 con 0x7f42881064a0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4286ffd700 1 -- 172.21.15.35:0/3701158513 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42780042c0 con 0x7f42881064a0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.686+0000 7f4286ffd700 1 -- 172.21.15.35:0/3701158513 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42780118e0 con 0x7f42881064a0 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 -- 172.21.15.35:0/3701158513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 msgr2=0x7f4288108880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 --2- 172.21.15.35:0/3701158513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288108880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42780098a0 tx=0x7f4278009bb0 comp rx=0 tx=0).stop 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 -- 172.21.15.35:0/3701158513 shutdown_connections 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 --2- 172.21.15.35:0/3701158513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288108880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 -- 172.21.15.35:0/3701158513 >> 172.21.15.35:0/3701158513 conn(0x7f42880ffee0 msgr2=0x7f42881022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 -- 172.21.15.35:0/3701158513 shutdown_connections 2023-03-17T07:50:03.150 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.687+0000 7f428ea09700 1 -- 172.21.15.35:0/3701158513 wait complete. 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f428ea09700 1 Processor -- start 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f428ea09700 1 -- start start 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f428ea09700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288105e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f428ea09700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288106340 con 0x7f42881064a0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f4287fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288105e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f4287fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288105e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39052/0 (socket says 172.21.15.35:39052) 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f4287fff700 1 -- 172.21.15.35:0/807830183 learned_addr learned my addr 172.21.15.35:0/807830183 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.688+0000 7f4287fff700 1 -- 172.21.15.35:0/807830183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009550 con 0x7f42881064a0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.689+0000 7f4287fff700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288105e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c00 tx=0x7f42780119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.689+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42780036a0 con 0x7f42881064a0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.689+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427801b440 con 0x7f42881064a0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.689+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4288109b40 con 0x7f42881064a0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.689+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f427801a3d0 con 0x7f42881064a0 2023-03-17T07:50:03.151 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.689+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42881099b0 con 0x7f42881064a0 2023-03-17T07:50:05.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.690+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7f427801a690 con 0x7f42881064a0 2023-03-17T07:50:05.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.690+0000 7f42857fa700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f4270037e50 0x7f427003a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:05.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.690+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f427804b930 con 0x7f42881064a0 2023-03-17T07:50:05.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.690+0000 7f42877fe700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f4270037e50 0x7f427003a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:05.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.690+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42880620b0 con 0x7f42881064a0 2023-03-17T07:50:05.213 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.691+0000 7f42877fe700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f4270037e50 0x7f427003a300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f427c006fd0 tx=0x7f427c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:31.695+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f427801f020 con 0x7f42881064a0 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.064+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f4288105330 con 0x7f42881064a0 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.067+0000 7f42857fa700 1 -- 172.21.15.35:0/807830183 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f427804a0c0 con 0x7f42881064a0 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f4270037e50 msgr2=0x7f427003a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f4270037e50 0x7f427003a300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f427c006fd0 tx=0x7f427c006e40 comp rx=0 tx=0).stop 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 msgr2=0x7f4288105e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288105e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c00 tx=0x7f42780119a0 comp rx=0 tx=0).stop 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 shutdown_connections 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f4270037e50 0x7f427003a300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 --2- 172.21.15.35:0/807830183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42881064a0 0x7f4288105e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 >> 172.21.15.35:0/807830183 conn(0x7f42880ffee0 msgr2=0x7f4288100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 shutdown_connections 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.070+0000 7f428ea09700 1 -- 172.21.15.35:0/807830183 wait complete. 2023-03-17T07:50:05.214 INFO:teuthology.orchestra.run.smithi035.stdout:Enabling the dashboard module... 2023-03-17T07:50:05.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:33 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/807830183' entity='client.admin' 2023-03-17T07:50:05.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:33 smithi035 ceph-mon[92535]: from='mgr.14120 172.21.15.35:0/3746611832' entity='mgr.x' 2023-03-17T07:50:05.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1046842605' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-03-17T07:50:05.215 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: ignoring --setuser ceph since I am not root 2023-03-17T07:50:05.215 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: ignoring --setgroup ceph since I am not root 2023-03-17T07:50:05.219 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa2070b1700 1 Processor -- start 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa2070b1700 1 -- start start 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa2070b1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200104c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa2070b1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001051b0 con 0x7fa200104860 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa204e4d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa204e4d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39056/0 (socket says 172.21.15.35:39056) 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.899+0000 7fa204e4d700 1 -- 172.21.15.35:0/814591622 learned_addr learned my addr 172.21.15.35:0/814591622 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.900+0000 7fa204e4d700 1 -- 172.21.15.35:0/814591622 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2001052f0 con 0x7fa200104860 2023-03-17T07:50:07.041 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.900+0000 7fa204e4d700 1 --2- 172.21.15.35:0/814591622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200104c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40098a0 tx=0x7fa1f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80ad4b29dfb8ca8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.900+0000 7fa1ff7fe700 1 -- 172.21.15.35:0/814591622 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f4004160 con 0x7fa200104860 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.900+0000 7fa1ff7fe700 1 -- 172.21.15.35:0/814591622 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f40042c0 con 0x7fa200104860 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.900+0000 7fa1ff7fe700 1 -- 172.21.15.35:0/814591622 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f40118e0 con 0x7fa200104860 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 -- 172.21.15.35:0/814591622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 msgr2=0x7fa200104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 --2- 172.21.15.35:0/814591622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200104c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40098a0 tx=0x7fa1f4009bb0 comp rx=0 tx=0).stop 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 -- 172.21.15.35:0/814591622 shutdown_connections 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 --2- 172.21.15.35:0/814591622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200104c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 -- 172.21.15.35:0/814591622 >> 172.21.15.35:0/814591622 conn(0x7fa2000ffef0 msgr2=0x7fa200102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 -- 172.21.15.35:0/814591622 shutdown_connections 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 -- 172.21.15.35:0/814591622 wait complete. 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.901+0000 7fa2070b1700 1 Processor -- start 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa2070b1700 1 -- start start 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa2070b1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200073e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa2070b1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019a090 con 0x7fa200104860 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa204e4d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:07.042 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa204e4d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39058/0 (socket says 172.21.15.35:39058) 2023-03-17T07:50:07.043 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa204e4d700 1 -- 172.21.15.35:0/1046842605 learned_addr learned my addr 172.21.15.35:0/1046842605 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:07.043 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa204e4d700 1 -- 172.21.15.35:0/1046842605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009550 con 0x7fa200104860 2023-03-17T07:50:07.043 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa204e4d700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200073e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006af0 tx=0x7fa1f4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:07.043 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f40037d0 con 0x7fa200104860 2023-03-17T07:50:07.043 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f401b440 con 0x7fa200104860 2023-03-17T07:50:08.259 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa200106890 con 0x7fa200104860 2023-03-17T07:50:08.259 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.902+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1f40193d0 con 0x7fa200104860 2023-03-17T07:50:08.259 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.903+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200106700 con 0x7fa200104860 2023-03-17T07:50:08.259 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.904+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 8) v1 ==== 44665+0+0 (secure 0 0 0) 0x7fa1f4019640 con 0x7fa200104860 2023-03-17T07:50:08.259 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.904+0000 7fa1fdffb700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa1f0037e50 0x7fa1f003a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:08.260 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.904+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa1f404b8b0 con 0x7fa200104860 2023-03-17T07:50:08.260 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.904+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa200108d30 con 0x7fa200104860 2023-03-17T07:50:10.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.904+0000 7fa1fffff700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa1f0037e50 0x7fa1f003a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:10.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.904+0000 7fa1fffff700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa1f0037e50 0x7fa1f003a300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec006fd0 tx=0x7fa1ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:10.290 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:32.909+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fa1f4018940 con 0x7fa200104860 2023-03-17T07:50:10.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:33.384+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa2000620b0 con 0x7fa200104860 2023-03-17T07:50:10.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.078+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mgrmap(e 9) v1 ==== 44678+0+0 (secure 0 0 0) 0x7fa1f401b5b0 con 0x7fa200104860 2023-03-17T07:50:10.867 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.079+0000 7fa1fdffb700 1 -- 172.21.15.35:0/1046842605 <== mon.0 v2:172.21.15.35:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa1f400b5c0 con 0x7fa200104860 2023-03-17T07:50:10.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.081+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa1f0037e50 msgr2=0x7fa1f003a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:10.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.081+0000 7fa2070b1700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa1f0037e50 0x7fa1f003a300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec006fd0 tx=0x7fa1ec006e40 comp rx=0 tx=0).stop 2023-03-17T07:50:10.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 msgr2=0x7fa200073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:10.868 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200073e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4006af0 tx=0x7fa1f4011e80 comp rx=0 tx=0).stop 2023-03-17T07:50:11.546 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 shutdown_connections 2023-03-17T07:50:11.546 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7fa1f0037e50 0x7fa1f003a300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:11.546 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 --2- 172.21.15.35:0/1046842605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa200104860 0x7fa200073e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:11.547 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 >> 172.21.15.35:0/1046842605 conn(0x7fa2000ffef0 msgr2=0x7fa200100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:11.547 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 shutdown_connections 2023-03-17T07:50:11.547 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:34.082+0000 7fa2070b1700 1 -- 172.21.15.35:0/1046842605 wait complete. 2023-03-17T07:50:11.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:34.278+0000 7fb7ba433200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-17T07:50:11.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:34.374+0000 7fb7ba433200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-17T07:50:11.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:34.484+0000 7fb7ba433200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-17T07:50:11.547 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:34.600+0000 7fb7ba433200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-17T07:50:11.548 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:34 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:34.813+0000 7fb7ba433200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-17T07:50:11.548 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:35 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:35.212+0000 7fb7ba433200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-17T07:50:11.548 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:35 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:35.322+0000 7fb7ba433200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-17T07:50:13.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1046842605' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-03-17T07:50:14.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:35 smithi035 ceph-mon[92535]: mgrmap e9: x(active, since 17s) 2023-03-17T07:50:14.030 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:35 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:35.480+0000 7fb7ba433200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-17T07:50:14.030 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:35 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:35.600+0000 7fb7ba433200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-17T07:50:14.034 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:50:15.379 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-03-17T07:50:15.379 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "available": true, 2023-03-17T07:50:17.136 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-03-17T07:50:17.136 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-03-17T07:50:17.136 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:50:17.136 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.009+0000 7f594e43f700 1 Processor -- start 2023-03-17T07:50:17.136 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.009+0000 7f594e43f700 1 -- start start 2023-03-17T07:50:17.136 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f594e43f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f59481087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f594e43f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5948074050 con 0x7f59481063f0 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f5947fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f59481087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f5947fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f59481087d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39072/0 (socket says 172.21.15.35:39072) 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f5947fff700 1 -- 172.21.15.35:0/2999498265 learned_addr learned my addr 172.21.15.35:0/2999498265 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f5947fff700 1 -- 172.21.15.35:0/2999498265 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948074190 con 0x7f59481063f0 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f5947fff700 1 --2- 172.21.15.35:0/2999498265 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f59481087d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59380098a0 tx=0x7f5938009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f5c88436ab4c7b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:18.313 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.010+0000 7f5946ffd700 1 -- 172.21.15.35:0/2999498265 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5938004160 con 0x7f59481063f0 2023-03-17T07:50:19.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f5946ffd700 1 -- 172.21.15.35:0/2999498265 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59380042c0 con 0x7f59481063f0 2023-03-17T07:50:19.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f5946ffd700 1 -- 172.21.15.35:0/2999498265 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59380118e0 con 0x7f59481063f0 2023-03-17T07:50:19.884 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 -- 172.21.15.35:0/2999498265 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 msgr2=0x7f59481087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:20.727 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 --2- 172.21.15.35:0/2999498265 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f59481087d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59380098a0 tx=0x7f5938009bb0 comp rx=0 tx=0).stop 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 -- 172.21.15.35:0/2999498265 shutdown_connections 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 --2- 172.21.15.35:0/2999498265 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f59481087d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 -- 172.21.15.35:0/2999498265 >> 172.21.15.35:0/2999498265 conn(0x7f59480ffeb0 msgr2=0x7f59481022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 -- 172.21.15.35:0/2999498265 shutdown_connections 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.011+0000 7f594e43f700 1 -- 172.21.15.35:0/2999498265 wait complete. 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.012+0000 7f594e43f700 1 Processor -- start 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.012+0000 7f594e43f700 1 -- start start 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f594e43f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f5948199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:21.634 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f594e43f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5948199aa0 con 0x7f59481063f0 2023-03-17T07:50:21.635 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f5947fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f5948199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:21.635 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f5947fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f5948199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39074/0 (socket says 172.21.15.35:39074) 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f5947fff700 1 -- 172.21.15.35:0/939647604 learned_addr learned my addr 172.21.15.35:0/939647604 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f5947fff700 1 -- 172.21.15.35:0/939647604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009550 con 0x7f59481063f0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f5947fff700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f5948199560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f59380119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59380036a0 con 0x7f59481063f0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f593801b440 con 0x7f59481063f0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5948109b50 con 0x7f59481063f0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f593801a3d0 con 0x7f59481063f0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.013+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59481099c0 con 0x7f59481063f0 2023-03-17T07:50:22.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.014+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 9) v1 ==== 44678+0+0 (secure 0 0 0) 0x7f593801b5b0 con 0x7f59481063f0 2023-03-17T07:50:25.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.015+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5948109ce0 con 0x7f59481063f0 2023-03-17T07:50:25.016 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.015+0000 7f59457fa700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 0x7f593003a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:25.016 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.015+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f593804b880 con 0x7f59481063f0 2023-03-17T07:50:25.441 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.015+0000 7f59477fe700 1 -- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 msgr2=0x7f593003a3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:25.441 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.015+0000 7f59477fe700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 0x7f593003a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-17T07:50:25.441 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.020+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f5938023be0 con 0x7f59481063f0 2023-03-17T07:50:25.441 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.216+0000 7f59477fe700 1 -- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 msgr2=0x7f593003a3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:25.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.216+0000 7f59477fe700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 0x7f593003a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-17T07:50:25.442 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.486+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f594819d130 con 0x7f59481063f0 2023-03-17T07:50:27.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.486+0000 7f59457fa700 1 -- 172.21.15.35:0/939647604 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f593801f020 con 0x7f59481063f0 2023-03-17T07:50:27.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 msgr2=0x7f593003a3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T07:50:27.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 0x7f593003a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:27.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 msgr2=0x7f5948199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:27.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f5948199560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f59380119a0 comp rx=0 tx=0).stop 2023-03-17T07:50:27.076 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 shutdown_connections 2023-03-17T07:50:28.755 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f5930037ef0 0x7f593003a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:28.755 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 --2- 172.21.15.35:0/939647604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f59481063f0 0x7f5948199560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:28.755 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 >> 172.21.15.35:0/939647604 conn(0x7f59480ffeb0 msgr2=0x7f5948100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:28.755 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 shutdown_connections 2023-03-17T07:50:28.756 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:35.489+0000 7f594e43f700 1 -- 172.21.15.35:0/939647604 wait complete. 2023-03-17T07:50:28.756 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for the mgr to restart... 2023-03-17T07:50:29.468 INFO:teuthology.orchestra.run.smithi035.stdout:Waiting for mgr epoch 9... 2023-03-17T07:50:29.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:36 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/939647604' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-03-17T07:50:30.272 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:36 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:36.126+0000 7fb7ba433200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-17T07:50:30.272 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:36 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:36.817+0000 7fb7ba433200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-17T07:50:30.273 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:37 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:37.010+0000 7fb7ba433200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-17T07:50:30.273 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:37 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:37.958+0000 7fb7ba433200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-17T07:50:30.871 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:38.068+0000 7fb7ba433200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-17T07:50:30.871 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:38.285+0000 7fb7ba433200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-17T07:50:30.871 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:38.630+0000 7fb7ba433200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-17T07:50:30.871 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:38.737+0000 7fb7ba433200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-17T07:50:30.871 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:39 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:39.093+0000 7fb7ba433200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-17T07:50:30.871 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:39 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:39.417+0000 7fb7ba433200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-17T07:50:30.872 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:40 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:40.249+0000 7fb7ba433200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-17T07:50:30.872 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:40 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:40.408+0000 7fb7ba433200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-17T07:50:30.872 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:40 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:40.651+0000 7fb7ba433200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-17T07:50:30.872 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:40 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:40.788+0000 7fb7ba433200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-17T07:50:30.872 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:41 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:41.059+0000 7fb7ba433200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-17T07:50:30.872 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 07:46:42 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T07:46:42.128+0000 7fb7ba433200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-17T07:50:30.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: Active manager daemon x restarted 2023-03-17T07:50:30.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: Activating manager daemon x 2023-03-17T07:50:30.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: osdmap e3: 0 total, 0 up, 0 in 2023-03-17T07:50:31.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: mgrmap e10: x(active, starting, since 0.0528512s) 2023-03-17T07:50:31.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:50:31.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-17T07:50:31.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-17T07:50:31.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-17T07:50:31.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-17T07:50:31.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: Manager daemon x is now available 2023-03-17T07:50:32.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:50:32.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:50:32.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-17T07:50:32.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-17T07:50:32.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:43 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:43] ENGINE Bus STARTING 2023-03-17T07:50:32.725 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout { 2023-03-17T07:50:33.805 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-03-17T07:50:33.805 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout "initialized": true 2023-03-17T07:50:33.805 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout } 2023-03-17T07:50:33.805 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6583e2f700 1 Processor -- start 2023-03-17T07:50:33.805 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6583e2f700 1 -- start start 2023-03-17T07:50:33.805 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6583e2f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:34.450 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6583e2f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c105130 con 0x7f657c1047e0 2023-03-17T07:50:36.506 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6581bcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:36.506 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6581bcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39082/0 (socket says 172.21.15.35:39082) 2023-03-17T07:50:36.506 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.375+0000 7f6581bcb700 1 -- 172.21.15.35:0/3308355823 learned_addr learned my addr 172.21.15.35:0/3308355823 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:36.506 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.376+0000 7f6581bcb700 1 -- 172.21.15.35:0/3308355823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c105270 con 0x7f657c1047e0 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.376+0000 7f6581bcb700 1 --2- 172.21.15.35:0/3308355823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c104bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65780098a0 tx=0x7f6578009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c6c758cb82144 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.376+0000 7f6580bc9700 1 -- 172.21.15.35:0/3308355823 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6578004160 con 0x7f657c1047e0 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.376+0000 7f6580bc9700 1 -- 172.21.15.35:0/3308355823 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65780042c0 con 0x7f657c1047e0 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.376+0000 7f6580bc9700 1 -- 172.21.15.35:0/3308355823 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65780118e0 con 0x7f657c1047e0 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 -- 172.21.15.35:0/3308355823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 msgr2=0x7f657c104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3308355823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c104bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f65780098a0 tx=0x7f6578009bb0 comp rx=0 tx=0).stop 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 -- 172.21.15.35:0/3308355823 shutdown_connections 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3308355823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c104bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 -- 172.21.15.35:0/3308355823 >> 172.21.15.35:0/3308355823 conn(0x7f657c0ffeb0 msgr2=0x7f657c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 -- 172.21.15.35:0/3308355823 shutdown_connections 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 -- 172.21.15.35:0/3308355823 wait complete. 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.377+0000 7f6583e2f700 1 Processor -- start 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6583e2f700 1 -- start start 2023-03-17T07:50:36.507 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6583e2f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:37.180 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6583e2f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c197870 con 0x7f657c1047e0 2023-03-17T07:50:37.180 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6581bcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:37.180 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6581bcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39084/0 (socket says 172.21.15.35:39084) 2023-03-17T07:50:37.180 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6581bcb700 1 -- 172.21.15.35:0/3731107184 learned_addr learned my addr 172.21.15.35:0/3731107184 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6581bcb700 1 -- 172.21.15.35:0/3731107184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578009550 con 0x7f657c1047e0 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6581bcb700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c197330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6578006af0 tx=0x7f6578011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65780037d0 con 0x7f657c1047e0 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f657801b440 con 0x7f657c1047e0 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.378+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c106810 con 0x7f657c1047e0 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.379+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65780193d0 con 0x7f657c1047e0 2023-03-17T07:50:37.181 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.379+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c106680 con 0x7f657c1047e0 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.380+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 9) v1 ==== 44678+0+0 (secure 0 0 0) 0x7f657801b5b0 con 0x7f657c1047e0 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.380+0000 7f6572ffd700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.380+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 --> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f656803ee70 con 0x7f656803c2b0 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.380+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f657804b890 con 0x7f657c1047e0 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.380+0000 7f65813ca700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 msgr2=0x7f656803e760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.380+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-17T07:50:38.818 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.581+0000 7f65813ca700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 msgr2=0x7f656803e760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:38.819 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.581+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-17T07:50:38.819 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.982+0000 7f65813ca700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 msgr2=0x7f656803e760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:38.819 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:36.982+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-17T07:50:38.819 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:37.783+0000 7f65813ca700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 msgr2=0x7f656803e760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:38.819 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:37.783+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-17T07:50:39.708 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:39.384+0000 7f65813ca700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 msgr2=0x7f656803e760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.35:6800/1582063547 2023-03-17T07:50:39.708 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:39.384+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:42.193+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mgrmap(e 10) v1 ==== 44445+0+0 (secure 0 0 0) 0x7f657801b8b0 con 0x7f657c1047e0 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:42.193+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 msgr2=0x7f656803e760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:42.193+0000 7f6572ffd700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.195+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mgrmap(e 11) v1 ==== 44572+0+0 (secure 0 0 0) 0x7f6578003930 con 0x7f657c1047e0 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.195+0000 7f6572ffd700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f656803fd30 0x7f6568042110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.195+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f656803ee70 con 0x7f656803fd30 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.196+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f656803fd30 0x7f6568042110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.196+0000 7f65813ca700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f656803fd30 0x7f6568042110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f656c003a10 tx=0x7f656c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:40.508 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.197+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f656803ee70 con 0x7f656803fd30 2023-03-17T07:50:44.583 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f657c198670 con 0x7f656803fd30 2023-03-17T07:50:44.583 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6572ffd700 1 -- 172.21.15.35:0/3731107184 <== mgr.14152 v2:172.21.15.35:6800/889943724 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f657c198670 con 0x7f656803fd30 2023-03-17T07:50:44.583 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f656803fd30 msgr2=0x7f6568042110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:44.583 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f656803fd30 0x7f6568042110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f656c003a10 tx=0x7f656c009270 comp rx=0 tx=0).stop 2023-03-17T07:50:44.583 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 msgr2=0x7f657c197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:45.255 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c197330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6578006af0 tx=0x7f6578011e80 comp rx=0 tx=0).stop 2023-03-17T07:50:45.255 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 shutdown_connections 2023-03-17T07:50:45.255 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f656803fd30 0x7f6568042110 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:45.255 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f657c1047e0 0x7f657c197330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:45.255 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 --2- 172.21.15.35:0/3731107184 >> [v2:172.21.15.35:6800/1582063547,v1:172.21.15.35:6801/1582063547] conn(0x7f656803c2b0 0x7f656803e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:45.255 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.208+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 >> 172.21.15.35:0/3731107184 conn(0x7f657c0ffeb0 msgr2=0x7f657c18e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:45.256 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.209+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 shutdown_connections 2023-03-17T07:50:45.256 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:43.209+0000 7f6583e2f700 1 -- 172.21.15.35:0/3731107184 wait complete. 2023-03-17T07:50:45.256 INFO:teuthology.orchestra.run.smithi035.stdout:mgr epoch 9 is available 2023-03-17T07:50:45.256 INFO:teuthology.orchestra.run.smithi035.stdout:Generating a dashboard self-signed certificate... 2023-03-17T07:50:45.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:44 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:43] ENGINE Serving on https://172.21.15.35:7150 2023-03-17T07:50:46.372 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:44 smithi035 ceph-mon[92535]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-03-17T07:50:46.372 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:44 smithi035 ceph-mon[92535]: mgrmap e11: x(active, since 1.05587s) 2023-03-17T07:50:46.372 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:44 smithi035 ceph-mon[92535]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-03-17T07:50:47.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:44 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:43] ENGINE Serving on http://172.21.15.35:8765 2023-03-17T07:50:48.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:44 smithi035 ceph-mon[92535]: [17/Mar/2023:07:46:43] ENGINE Bus STARTED 2023-03-17T07:50:48.384 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c32ce700 1 Processor -- start 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c32ce700 1 -- start start 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c32ce700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc108850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c32ce700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc079cd0 con 0x7f47bc106470 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c106a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc108850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c106a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc108850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39138/0 (socket says 172.21.15.35:39138) 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.138+0000 7f47c106a700 1 -- 172.21.15.35:0/1215671582 learned_addr learned my addr 172.21.15.35:0/1215671582 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.139+0000 7f47c106a700 1 -- 172.21.15.35:0/1215671582 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc079e10 con 0x7f47bc106470 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.139+0000 7f47c106a700 1 --2- 172.21.15.35:0/1215671582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc108850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47b80098a0 tx=0x7f47b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79f8a6917f4767b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.139+0000 7f47b3fff700 1 -- 172.21.15.35:0/1215671582 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b8004160 con 0x7f47bc106470 2023-03-17T07:50:50.052 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.139+0000 7f47b3fff700 1 -- 172.21.15.35:0/1215671582 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b80042c0 con 0x7f47bc106470 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.139+0000 7f47b3fff700 1 -- 172.21.15.35:0/1215671582 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b80118e0 con 0x7f47bc106470 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 -- 172.21.15.35:0/1215671582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 msgr2=0x7f47bc108850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 --2- 172.21.15.35:0/1215671582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc108850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47b80098a0 tx=0x7f47b8009bb0 comp rx=0 tx=0).stop 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 -- 172.21.15.35:0/1215671582 shutdown_connections 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 --2- 172.21.15.35:0/1215671582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc108850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 -- 172.21.15.35:0/1215671582 >> 172.21.15.35:0/1215671582 conn(0x7f47bc0ffe90 msgr2=0x7f47bc1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 -- 172.21.15.35:0/1215671582 shutdown_connections 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 -- 172.21.15.35:0/1215671582 wait complete. 2023-03-17T07:50:50.053 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 Processor -- start 2023-03-17T07:50:50.642 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.140+0000 7f47c32ce700 1 -- start start 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c32ce700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c32ce700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc199af0 con 0x7f47bc106470 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c106a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c106a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39140/0 (socket says 172.21.15.35:39140) 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c106a700 1 -- 172.21.15.35:0/4008973642 learned_addr learned my addr 172.21.15.35:0/4008973642 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c106a700 1 -- 172.21.15.35:0/4008973642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8009550 con 0x7f47bc106470 2023-03-17T07:50:54.971 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.141+0000 7f47c106a700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc1995b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47b8006af0 tx=0x7f47b8011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:56.383 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.142+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b80037d0 con 0x7f47bc106470 2023-03-17T07:50:56.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.142+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b801b440 con 0x7f47bc106470 2023-03-17T07:50:56.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.142+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc109b70 con 0x7f47bc106470 2023-03-17T07:50:56.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.142+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47b8019560 con 0x7f47bc106470 2023-03-17T07:50:56.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.142+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc1099e0 con 0x7f47bc106470 2023-03-17T07:50:56.965 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.143+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 11) v1 ==== 44572+0+0 (secure 0 0 0) 0x7f47b80197d0 con 0x7f47bc106470 2023-03-17T07:50:56.966 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.143+0000 7f47b27fc700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f47a8037d80 0x7f47a803a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:50:58.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.143+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f47b804b7e0 con 0x7f47bc106470 2023-03-17T07:50:58.291 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.143+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc109d00 con 0x7f47bc106470 2023-03-17T07:50:58.906 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.143+0000 7f47c0869700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f47a8037d80 0x7f47a803a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:50:58.906 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.143+0000 7f47c0869700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f47a8037d80 0x7f47a803a230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f47ac006fd0 tx=0x7f47ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:50:59.883 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.148+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f47b8018db0 con 0x7f47bc106470 2023-03-17T07:51:00.410 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.536+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f47bc101330 con 0x7f47a8037d80 2023-03-17T07:51:00.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.786+0000 7f47b27fc700 1 -- 172.21.15.35:0/4008973642 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f47bc101330 con 0x7f47a8037d80 2023-03-17T07:51:00.881 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f47a8037d80 msgr2=0x7f47a803a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:01.408 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f47a8037d80 0x7f47a803a230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f47ac006fd0 tx=0x7f47ac006e40 comp rx=0 tx=0).stop 2023-03-17T07:51:01.408 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 msgr2=0x7f47bc1995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:01.408 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc1995b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47b8006af0 tx=0x7f47b8011e80 comp rx=0 tx=0).stop 2023-03-17T07:51:01.408 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 shutdown_connections 2023-03-17T07:51:01.408 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f47a8037d80 0x7f47a803a230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:01.409 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 --2- 172.21.15.35:0/4008973642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47bc106470 0x7f47bc1995b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:01.409 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 >> 172.21.15.35:0/4008973642 conn(0x7f47bc0ffe90 msgr2=0x7f47bc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:01.409 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 shutdown_connections 2023-03-17T07:51:01.409 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:44.788+0000 7f47c32ce700 1 -- 172.21.15.35:0/4008973642 wait complete. 2023-03-17T07:51:01.409 INFO:teuthology.orchestra.run.smithi035.stdout:Creating initial admin user... 2023-03-17T07:51:01.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:03.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:45 smithi035 ceph-mon[92535]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:51:03.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:03.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:03.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:45 smithi035 ceph-mon[92535]: mgrmap e12: x(active, since 2s) 2023-03-17T07:51:03.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:46 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:03.414 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$/wgvgH6DxsIdXSerJBRMTelIFhQi.VxRo6K22BE1qoAAT8mFetSBi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1679039206, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5effc700 1 Processor -- start 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5effc700 1 -- start start 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5effc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58103fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5effc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58104520 con 0x7efd58103bd0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5cd98700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58103fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5cd98700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58103fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39144/0 (socket says 172.21.15.35:39144) 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5cd98700 1 -- 172.21.15.35:0/1243786424 learned_addr learned my addr 172.21.15.35:0/1243786424 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.732+0000 7efd5cd98700 1 -- 172.21.15.35:0/1243786424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58104660 con 0x7efd58103bd0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5cd98700 1 --2- 172.21.15.35:0/1243786424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58103fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0098a0 tx=0x7efd4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02d9d6224bb55d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd577fe700 1 -- 172.21.15.35:0/1243786424 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c004160 con 0x7efd58103bd0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd577fe700 1 -- 172.21.15.35:0/1243786424 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd4c0042c0 con 0x7efd58103bd0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd577fe700 1 -- 172.21.15.35:0/1243786424 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c0118e0 con 0x7efd58103bd0 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 -- 172.21.15.35:0/1243786424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 msgr2=0x7efd58103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:03.415 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 --2- 172.21.15.35:0/1243786424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58103fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0098a0 tx=0x7efd4c009bb0 comp rx=0 tx=0).stop 2023-03-17T07:51:03.416 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 -- 172.21.15.35:0/1243786424 shutdown_connections 2023-03-17T07:51:04.413 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 --2- 172.21.15.35:0/1243786424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58103fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:04.413 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 -- 172.21.15.35:0/1243786424 >> 172.21.15.35:0/1243786424 conn(0x7efd580ff650 msgr2=0x7efd58101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:04.413 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 -- 172.21.15.35:0/1243786424 shutdown_connections 2023-03-17T07:51:04.413 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.733+0000 7efd5effc700 1 -- 172.21.15.35:0/1243786424 wait complete. 2023-03-17T07:51:04.413 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.734+0000 7efd5effc700 1 Processor -- start 2023-03-17T07:51:04.847 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.734+0000 7efd5effc700 1 -- start start 2023-03-17T07:51:05.298 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.734+0000 7efd5effc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:05.298 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5effc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58199ab0 con 0x7efd58103bd0 2023-03-17T07:51:05.299 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5cd98700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:06.727 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5cd98700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39146/0 (socket says 172.21.15.35:39146) 2023-03-17T07:51:06.727 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5cd98700 1 -- 172.21.15.35:0/198159030 learned_addr learned my addr 172.21.15.35:0/198159030 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:06.727 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5cd98700 1 -- 172.21.15.35:0/198159030 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c009550 con 0x7efd58103bd0 2023-03-17T07:51:06.727 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5cd98700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58199570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006af0 tx=0x7efd4c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:09.690 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c0037d0 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd4c01b440 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd58107980 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c019560 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.735+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd581077f0 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.737+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58109e30 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.737+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 12) v1 ==== 44678+0+0 (secure 0 0 0) 0x7efd4c003930 con 0x7efd58103bd0 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.737+0000 7efd55ffb700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efd48037e50 0x7efd4803a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:10.346 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.737+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efd4c04bee0 con 0x7efd58103bd0 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.737+0000 7efd57fff700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efd48037e50 0x7efd4803a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.738+0000 7efd57fff700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efd48037e50 0x7efd4803a300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd44006fd0 tx=0x7efd44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:45.742+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7efd4c01aa20 con 0x7efd58103bd0 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.165+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7efd58062100 con 0x7efd48037e50 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.412+0000 7efd55ffb700 1 -- 172.21.15.35:0/198159030 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7efd58062100 con 0x7efd48037e50 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.414+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efd48037e50 msgr2=0x7efd4803a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.414+0000 7efd5effc700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efd48037e50 0x7efd4803a300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd44006fd0 tx=0x7efd44006e40 comp rx=0 tx=0).stop 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 msgr2=0x7efd58199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58199570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd4c006af0 tx=0x7efd4c011e80 comp rx=0 tx=0).stop 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 shutdown_connections 2023-03-17T07:51:10.347 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efd48037e50 0x7efd4803a300 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:11.056 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 --2- 172.21.15.35:0/198159030 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd58103bd0 0x7efd58199570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:11.056 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 >> 172.21.15.35:0/198159030 conn(0x7efd580ff650 msgr2=0x7efd581003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:11.056 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 shutdown_connections 2023-03-17T07:51:11.057 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:46.415+0000 7efd5effc700 1 -- 172.21.15.35:0/198159030 wait complete. 2023-03-17T07:51:11.057 INFO:teuthology.orchestra.run.smithi035.stdout:Fetching dashboard port number... 2023-03-17T07:51:11.057 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:47 smithi035 ceph-mon[92535]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:51:11.057 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:11.060 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stdout 8443 2023-03-17T07:51:12.646 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.614+0000 7fc04eb92700 1 Processor -- start 2023-03-17T07:51:12.646 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.614+0000 7fc04eb92700 1 -- start start 2023-03-17T07:51:12.646 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.614+0000 7fc04eb92700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04807a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:12.646 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.614+0000 7fc04eb92700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04807a810 con 0x7fc04807bdd0 2023-03-17T07:51:12.647 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc04c92e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04807a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:13.221 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc04c92e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04807a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39154/0 (socket says 172.21.15.35:39154) 2023-03-17T07:51:13.221 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc04c92e700 1 -- 172.21.15.35:0/4273132069 learned_addr learned my addr 172.21.15.35:0/4273132069 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:13.221 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc04c92e700 1 -- 172.21.15.35:0/4273132069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04807a950 con 0x7fc04807bdd0 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc04c92e700 1 --2- 172.21.15.35:0/4273132069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04807a2d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0098a0 tx=0x7fc03c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da5a341946cb99d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc0477fe700 1 -- 172.21.15.35:0/4273132069 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc03c004160 con 0x7fc04807bdd0 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc0477fe700 1 -- 172.21.15.35:0/4273132069 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03c0042c0 con 0x7fc04807bdd0 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.615+0000 7fc0477fe700 1 -- 172.21.15.35:0/4273132069 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc03c0118e0 con 0x7fc04807bdd0 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 -- 172.21.15.35:0/4273132069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 msgr2=0x7fc04807a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 --2- 172.21.15.35:0/4273132069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04807a2d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0098a0 tx=0x7fc03c009bb0 comp rx=0 tx=0).stop 2023-03-17T07:51:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 -- 172.21.15.35:0/4273132069 shutdown_connections 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 --2- 172.21.15.35:0/4273132069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04807a2d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 -- 172.21.15.35:0/4273132069 >> 172.21.15.35:0/4273132069 conn(0x7fc048100f50 msgr2=0x7fc048103360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 -- 172.21.15.35:0/4273132069 shutdown_connections 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.616+0000 7fc04eb92700 1 -- 172.21.15.35:0/4273132069 wait complete. 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04eb92700 1 Processor -- start 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04eb92700 1 -- start start 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04eb92700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04eb92700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04819bcc0 con 0x7fc04807bdd0 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04c92e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:14.015 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04c92e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04819b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39156/0 (socket says 172.21.15.35:39156) 2023-03-17T07:51:14.016 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.617+0000 7fc04c92e700 1 -- 172.21.15.35:0/1624040245 learned_addr learned my addr 172.21.15.35:0/1624040245 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:14.016 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc04c92e700 1 -- 172.21.15.35:0/1624040245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c009550 con 0x7fc04807bdd0 2023-03-17T07:51:14.016 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc04c92e700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04819b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc03c006af0 tx=0x7fc03c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:14.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:48 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1624040245' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-03-17T07:51:14.017 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:49 smithi035 ceph-mon[92535]: mgrmap e13: x(active, since 6s) 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:51 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3294839040' entity='client.admin' 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi035", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:46:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:03 smithi035 ceph-mon[92535]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:05 smithi035 ceph-mon[92535]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:14.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:07 smithi035 ceph-mon[92535]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:14.930 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc03c0037d0 con 0x7fc04807bdd0 2023-03-17T07:51:17.085 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03c01b440 con 0x7fc04807bdd0 2023-03-17T07:51:17.086 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04810bd60 con 0x7fc04807bdd0 2023-03-17T07:51:17.086 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc03c023400 con 0x7fc04807bdd0 2023-03-17T07:51:17.086 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.618+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04810bbd0 con 0x7fc04807bdd0 2023-03-17T07:51:17.086 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.619+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 12) v1 ==== 44678+0+0 (secure 0 0 0) 0x7fc03c023670 con 0x7fc04807bdd0 2023-03-17T07:51:17.086 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.619+0000 7fc045ffb700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc038037ea0 0x7fc03803a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.619+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc03c04bbb0 con 0x7fc04807bdd0 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.619+0000 7fc047fff700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc038037ea0 0x7fc03803a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.619+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04810bef0 con 0x7fc04807bdd0 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.620+0000 7fc047fff700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc038037ea0 0x7fc03803a350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc034006fd0 tx=0x7fc034006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.624+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fc03c023970 con 0x7fc04807bdd0 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.981+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fc0480620b0 con 0x7fc04807bdd0 2023-03-17T07:51:18.118 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.981+0000 7fc045ffb700 1 -- 172.21.15.35:0/1624040245 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fc03c049020 con 0x7fc04807bdd0 2023-03-17T07:51:18.935 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc038037ea0 msgr2=0x7fc03803a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:18.935 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc038037ea0 0x7fc03803a350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc034006fd0 tx=0x7fc034006e40 comp rx=0 tx=0).stop 2023-03-17T07:51:18.935 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 msgr2=0x7fc04819b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:18.935 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04819b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc03c006af0 tx=0x7fc03c011ed0 comp rx=0 tx=0).stop 2023-03-17T07:51:18.935 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 shutdown_connections 2023-03-17T07:51:21.046 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc038037ea0 0x7fc03803a350 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:21.046 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 --2- 172.21.15.35:0/1624040245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc04807bdd0 0x7fc04819b780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:21.046 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 >> 172.21.15.35:0/1624040245 conn(0x7fc048100f50 msgr2=0x7fc048101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:21.046 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 shutdown_connections 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:47.984+0000 7fc04eb92700 1 -- 172.21.15.35:0/1624040245 wait complete. 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout disabled 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:systemctl: stdout inactive 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:firewalld.service is not enabled 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-03-17T07:51:21.047 INFO:teuthology.orchestra.run.smithi035.stdout:Ceph Dashboard is now available at: 2023-03-17T07:51:21.048 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:21.048 INFO:teuthology.orchestra.run.smithi035.stdout: URL: https://smithi035:8443/ 2023-03-17T07:51:24.454 INFO:teuthology.orchestra.run.smithi035.stdout: User: admin 2023-03-17T07:51:24.454 INFO:teuthology.orchestra.run.smithi035.stdout: Password: u53kng1ie2 2023-03-17T07:51:24.454 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:24.454 INFO:teuthology.orchestra.run.smithi035.stdout:Saving cluster configuration to /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config directory 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:Enabling autotune for osd_memory_target 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.058+0000 7f5439fc4700 1 Processor -- start 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.058+0000 7f5439fc4700 1 -- start start 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f5439fc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 0x7f543410a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f5439fc4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54341062f0 con 0x7f5434073fd0 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54337fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 0x7f543410a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:25.079 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54337fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 0x7f543410a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39160/0 (socket says 172.21.15.35:39160) 2023-03-17T07:51:26.679 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54337fe700 1 -- 172.21.15.35:0/1902352732 learned_addr learned my addr 172.21.15.35:0/1902352732 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:26.679 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54337fe700 1 -- 172.21.15.35:0/1902352732 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543410ae40 con 0x7f5434073fd0 2023-03-17T07:51:26.679 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54337fe700 1 --2- 172.21.15.35:0/1902352732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 0x7f543410a900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54240098a0 tx=0x7f5424009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee9ec7863a0c82a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54327fc700 1 -- 172.21.15.35:0/1902352732 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5424004160 con 0x7f5434073fd0 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.059+0000 7f54327fc700 1 -- 172.21.15.35:0/1902352732 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54240042c0 con 0x7f5434073fd0 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f54327fc700 1 -- 172.21.15.35:0/1902352732 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240118e0 con 0x7f5434073fd0 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 -- 172.21.15.35:0/1902352732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 msgr2=0x7f543410a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 --2- 172.21.15.35:0/1902352732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 0x7f543410a900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54240098a0 tx=0x7f5424009bb0 comp rx=0 tx=0).stop 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 -- 172.21.15.35:0/1902352732 shutdown_connections 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 --2- 172.21.15.35:0/1902352732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5434073fd0 0x7f543410a900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 -- 172.21.15.35:0/1902352732 >> 172.21.15.35:0/1902352732 conn(0x7f54340ffef0 msgr2=0x7f5434102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 -- 172.21.15.35:0/1902352732 shutdown_connections 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.060+0000 7f5439fc4700 1 -- 172.21.15.35:0/1902352732 wait complete. 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f5439fc4700 1 Processor -- start 2023-03-17T07:51:27.927 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f5439fc4700 1 -- start start 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f5439fc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 0x7f543419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f5439fc4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543419c0f0 con 0x7f543419b7a0 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f54337fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 0x7f543419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f54337fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 0x7f543419bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39162/0 (socket says 172.21.15.35:39162) 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.061+0000 7f54337fe700 1 -- 172.21.15.35:0/935032593 learned_addr learned my addr 172.21.15.35:0/935032593 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f54337fe700 1 -- 172.21.15.35:0/935032593 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5424009550 con 0x7f543419b7a0 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f54337fe700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 0x7f543419bbb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5424000c00 tx=0x7f54240119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:27.928 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240036a0 con 0x7f543419b7a0 2023-03-17T07:51:29.461 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543410bdb0 con 0x7f543419b7a0 2023-03-17T07:51:29.461 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f542401b440 con 0x7f543419b7a0 2023-03-17T07:51:29.461 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f542401a3d0 con 0x7f543419b7a0 2023-03-17T07:51:29.461 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.062+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543410bc20 con 0x7f543419b7a0 2023-03-17T07:51:29.461 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.063+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7f542401a690 con 0x7f543419b7a0 2023-03-17T07:51:31.229 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.063+0000 7f5430ff9700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5420037f40 0x7f542003a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:31.229 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.063+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f542404bbe0 con 0x7f543419b7a0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.063+0000 7f5432ffd700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5420037f40 0x7f542003a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.063+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54340620b0 con 0x7f543419b7a0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.064+0000 7f5432ffd700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5420037f40 0x7f542003a3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f541c006fd0 tx=0x7f541c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.068+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f542401f020 con 0x7f543419b7a0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.425+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f54340740c0 con 0x7f543419b7a0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.426+0000 7f5430ff9700 1 -- 172.21.15.35:0/935032593 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f542404a0c0 con 0x7f543419b7a0 2023-03-17T07:51:32.048 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5420037f40 msgr2=0x7f542003a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:32.049 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5420037f40 0x7f542003a3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f541c006fd0 tx=0x7f541c006e40 comp rx=0 tx=0).stop 2023-03-17T07:51:33.889 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 msgr2=0x7f543419bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:33.889 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 0x7f543419bbb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5424000c00 tx=0x7f54240119a0 comp rx=0 tx=0).stop 2023-03-17T07:51:33.889 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 shutdown_connections 2023-03-17T07:51:33.889 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5420037f40 0x7f542003a3f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:33.889 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 --2- 172.21.15.35:0/935032593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f543419b7a0 0x7f543419bbb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:33.891 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 >> 172.21.15.35:0/935032593 conn(0x7f54340ffef0 msgr2=0x7f5434100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:33.891 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 shutdown_connections 2023-03-17T07:51:33.891 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:49.428+0000 7f5439fc4700 1 -- 172.21.15.35:0/935032593 wait complete. 2023-03-17T07:51:33.891 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03b258d700 1 Processor -- start 2023-03-17T07:51:35.640 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03b258d700 1 -- start start 2023-03-17T07:51:35.640 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03b258d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac108880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:35.640 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03b258d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac079cf0 con 0x7f03ac1064a0 2023-03-17T07:51:35.640 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03abfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac108880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:36.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03abfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac108880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39166/0 (socket says 172.21.15.35:39166) 2023-03-17T07:51:36.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03abfff700 1 -- 172.21.15.35:0/2475107402 learned_addr learned my addr 172.21.15.35:0/2475107402 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:36.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.384+0000 7f03abfff700 1 -- 172.21.15.35:0/2475107402 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac079e30 con 0x7f03ac1064a0 2023-03-17T07:51:36.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.385+0000 7f03abfff700 1 --2- 172.21.15.35:0/2475107402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac108880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f039c0098a0 tx=0x7f039c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea70d39b80e98010 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:36.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.385+0000 7f03aaffd700 1 -- 172.21.15.35:0/2475107402 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c004160 con 0x7f03ac1064a0 2023-03-17T07:51:36.534 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.385+0000 7f03aaffd700 1 -- 172.21.15.35:0/2475107402 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f039c0042c0 con 0x7f03ac1064a0 2023-03-17T07:51:36.535 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.385+0000 7f03aaffd700 1 -- 172.21.15.35:0/2475107402 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c0118e0 con 0x7f03ac1064a0 2023-03-17T07:51:36.535 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.385+0000 7f03b258d700 1 -- 172.21.15.35:0/2475107402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 msgr2=0x7f03ac108880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:36.535 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.385+0000 7f03b258d700 1 --2- 172.21.15.35:0/2475107402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac108880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f039c0098a0 tx=0x7f039c009bb0 comp rx=0 tx=0).stop 2023-03-17T07:51:36.535 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 -- 172.21.15.35:0/2475107402 shutdown_connections 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 --2- 172.21.15.35:0/2475107402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac108880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 -- 172.21.15.35:0/2475107402 >> 172.21.15.35:0/2475107402 conn(0x7f03ac0ffee0 msgr2=0x7f03ac1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 -- 172.21.15.35:0/2475107402 shutdown_connections 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 -- 172.21.15.35:0/2475107402 wait complete. 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 Processor -- start 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.386+0000 7f03b258d700 1 -- start start 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03b258d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac105e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:38.238 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03b258d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac106340 con 0x7f03ac1064a0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03abfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac105e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03abfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac105e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39168/0 (socket says 172.21.15.35:39168) 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03abfff700 1 -- 172.21.15.35:0/3294839040 learned_addr learned my addr 172.21.15.35:0/3294839040 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03abfff700 1 -- 172.21.15.35:0/3294839040 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c009550 con 0x7f03ac1064a0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03abfff700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac105e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f039c000c00 tx=0x7f039c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c0036a0 con 0x7f03ac1064a0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f039c01b440 con 0x7f03ac1064a0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c01a3d0 con 0x7f03ac1064a0 2023-03-17T07:51:40.330 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac109b40 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.387+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac1099b0 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.388+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7f039c01a690 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.388+0000 7f03a97fa700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0394037f40 0x7f039403a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.388+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f039c04be20 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.389+0000 7f03ab7fe700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0394037f40 0x7f039403a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.389+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac109cd0 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.389+0000 7f03ab7fe700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0394037f40 0x7f039403a3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03a0006fd0 tx=0x7f03a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.394+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f039c0239a0 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.962+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f03ac0620b0 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.965+0000 7f03a97fa700 1 -- 172.21.15.35:0/3294839040 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f039c0233b0 con 0x7f03ac1064a0 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0394037f40 msgr2=0x7f039403a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:40.331 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0394037f40 0x7f039403a3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03a0006fd0 tx=0x7f03a0006e40 comp rx=0 tx=0).stop 2023-03-17T07:51:40.332 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 msgr2=0x7f03ac105e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:51:40.332 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac105e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f039c000c00 tx=0x7f039c0119a0 comp rx=0 tx=0).stop 2023-03-17T07:51:40.332 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 shutdown_connections 2023-03-17T07:51:40.332 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0394037f40 0x7f039403a3f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:40.332 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 --2- 172.21.15.35:0/3294839040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1064a0 0x7f03ac105e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:51:40.332 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 >> 172.21.15.35:0/3294839040 conn(0x7f03ac0ffee0 msgr2=0x7f03ac100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:51:42.184 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 shutdown_connections 2023-03-17T07:51:42.184 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr 2023-03-17T07:46:50.967+0000 7f03b258d700 1 -- 172.21.15.35:0/3294839040 wait complete. 2023-03-17T07:51:42.184 INFO:teuthology.orchestra.run.smithi035.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-03-17T07:51:42.184 INFO:teuthology.orchestra.run.smithi035.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-03-17T07:51:42.184 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:42.185 INFO:teuthology.orchestra.run.smithi035.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-03-17T07:51:42.185 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:42.185 INFO:teuthology.orchestra.run.smithi035.stdout:Or, if you are only running a single cluster on this host: 2023-03-17T07:51:42.185 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:42.185 INFO:teuthology.orchestra.run.smithi035.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-03-17T07:51:43.762 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:43.762 INFO:teuthology.orchestra.run.smithi035.stdout:Please consider enabling telemetry to help improve Ceph: 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout: ceph telemetry on 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout:For more information see: 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:51:43.763 INFO:teuthology.orchestra.run.smithi035.stdout:Bootstrap complete. 2023-03-17T07:51:43.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:09 smithi035 ceph-mon[92535]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:43.766 INFO:tasks.cephadm:Fetching config... 2023-03-17T07:51:43.766 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:51:45.244 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-03-17T07:51:45.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:11 smithi035 ceph-mon[92535]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:13 smithi035 ceph-mon[92535]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:15 smithi035 ceph-mon[92535]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:17 smithi035 ceph-mon[92535]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:19 smithi035 ceph-mon[92535]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:21 smithi035 ceph-mon[92535]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:23 smithi035 ceph-mon[92535]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:25 smithi035 ceph-mon[92535]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:27 smithi035 ceph-mon[92535]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:29 smithi035 ceph-mon[92535]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:31 smithi035 ceph-mon[92535]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:33 smithi035 ceph-mon[92535]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:35 smithi035 ceph-mon[92535]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:47.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:37 smithi035 ceph-mon[92535]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:49.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:39 smithi035 ceph-mon[92535]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:49.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:41 smithi035 ceph-mon[92535]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:43 smithi035 ceph-mon[92535]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:45 smithi035 ceph-mon[92535]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:47 smithi035 ceph-mon[92535]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:49 smithi035 ceph-mon[92535]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:51 smithi035 ceph-mon[92535]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:53 smithi035 ceph-mon[92535]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:55 smithi035 ceph-mon[92535]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:57 smithi035 ceph-mon[92535]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:47:59 smithi035 ceph-mon[92535]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:51.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:01 smithi035 ceph-mon[92535]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:03 smithi035 ceph-mon[92535]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:05 smithi035 ceph-mon[92535]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:07 smithi035 ceph-mon[92535]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:09 smithi035 ceph-mon[92535]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:11 smithi035 ceph-mon[92535]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:13 smithi035 ceph-mon[92535]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:15 smithi035 ceph-mon[92535]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:17 smithi035 ceph-mon[92535]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:19 smithi035 ceph-mon[92535]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:52.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:21 smithi035 ceph-mon[92535]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:23 smithi035 ceph-mon[92535]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:25 smithi035 ceph-mon[92535]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:27 smithi035 ceph-mon[92535]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:29 smithi035 ceph-mon[92535]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:31 smithi035 ceph-mon[92535]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:33 smithi035 ceph-mon[92535]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:35 smithi035 ceph-mon[92535]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:37 smithi035 ceph-mon[92535]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:40 smithi035 ceph-mon[92535]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:42 smithi035 ceph-mon[92535]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:44 smithi035 ceph-mon[92535]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:46 smithi035 ceph-mon[92535]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:48 smithi035 ceph-mon[92535]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:50 smithi035 ceph-mon[92535]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:52 smithi035 ceph-mon[92535]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:54 smithi035 ceph-mon[92535]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:51:59.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:56 smithi035 ceph-mon[92535]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:48:58 smithi035 ceph-mon[92535]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:00 smithi035 ceph-mon[92535]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:02 smithi035 ceph-mon[92535]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:04 smithi035 ceph-mon[92535]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:06 smithi035 ceph-mon[92535]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:08 smithi035 ceph-mon[92535]: pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:10 smithi035 ceph-mon[92535]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:12 smithi035 ceph-mon[92535]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:14 smithi035 ceph-mon[92535]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:16 smithi035 ceph-mon[92535]: pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:18 smithi035 ceph-mon[92535]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:20 smithi035 ceph-mon[92535]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:22 smithi035 ceph-mon[92535]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:24 smithi035 ceph-mon[92535]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:26 smithi035 ceph-mon[92535]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:28 smithi035 ceph-mon[92535]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:30 smithi035 ceph-mon[92535]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:32 smithi035 ceph-mon[92535]: pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:34 smithi035 ceph-mon[92535]: pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:36 smithi035 ceph-mon[92535]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:38 smithi035 ceph-mon[92535]: pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:40 smithi035 ceph-mon[92535]: pgmap v81: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:42 smithi035 ceph-mon[92535]: pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:44 smithi035 ceph-mon[92535]: pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:46 smithi035 ceph-mon[92535]: pgmap v84: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:51:59.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:48 smithi035 ceph-mon[92535]: pgmap v85: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:50 smithi035 ceph-mon[92535]: pgmap v86: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:52 smithi035 ceph-mon[92535]: pgmap v87: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:54 smithi035 ceph-mon[92535]: pgmap v88: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:55 smithi035 ceph-mon[92535]: pgmap v89: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:00.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:57 smithi035 ceph-mon[92535]: pgmap v90: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:49:59 smithi035 ceph-mon[92535]: pgmap v91: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:01 smithi035 ceph-mon[92535]: pgmap v92: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:03 smithi035 ceph-mon[92535]: pgmap v93: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:05 smithi035 ceph-mon[92535]: pgmap v94: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:07 smithi035 ceph-mon[92535]: pgmap v95: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:00.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:09 smithi035 ceph-mon[92535]: pgmap v96: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:01.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:11 smithi035 ceph-mon[92535]: pgmap v97: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:01.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:13 smithi035 ceph-mon[92535]: pgmap v98: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:01.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:15 smithi035 ceph-mon[92535]: pgmap v99: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:01.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:17 smithi035 ceph-mon[92535]: pgmap v100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:01.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:19 smithi035 ceph-mon[92535]: pgmap v101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:01.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:21 smithi035 ceph-mon[92535]: pgmap v102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:23 smithi035 ceph-mon[92535]: pgmap v103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:25 smithi035 ceph-mon[92535]: pgmap v104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:27 smithi035 ceph-mon[92535]: pgmap v105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:29 smithi035 ceph-mon[92535]: pgmap v106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:31 smithi035 ceph-mon[92535]: pgmap v107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:33 smithi035 ceph-mon[92535]: pgmap v108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:35 smithi035 ceph-mon[92535]: pgmap v109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:37 smithi035 ceph-mon[92535]: pgmap v110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:39 smithi035 ceph-mon[92535]: pgmap v111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:41 smithi035 ceph-mon[92535]: pgmap v112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:43 smithi035 ceph-mon[92535]: pgmap v113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:45 smithi035 ceph-mon[92535]: pgmap v114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:47 smithi035 ceph-mon[92535]: pgmap v115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:49 smithi035 ceph-mon[92535]: pgmap v116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:51 smithi035 ceph-mon[92535]: pgmap v117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:53 smithi035 ceph-mon[92535]: pgmap v118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:56 smithi035 ceph-mon[92535]: pgmap v119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:50:58 smithi035 ceph-mon[92535]: pgmap v120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:00 smithi035 ceph-mon[92535]: pgmap v121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:02 smithi035 ceph-mon[92535]: pgmap v122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:04 smithi035 ceph-mon[92535]: pgmap v123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:06 smithi035 ceph-mon[92535]: pgmap v124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:08 smithi035 ceph-mon[92535]: pgmap v125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:10 smithi035 ceph-mon[92535]: pgmap v126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:12 smithi035 ceph-mon[92535]: pgmap v127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:14 smithi035 ceph-mon[92535]: pgmap v128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:15 smithi035 ceph-mon[92535]: pgmap v129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:17 smithi035 ceph-mon[92535]: pgmap v130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:02.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:19 smithi035 ceph-mon[92535]: pgmap v131: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:03.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:21 smithi035 ceph-mon[92535]: pgmap v132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:04.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:23 smithi035 ceph-mon[92535]: pgmap v133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:06.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:25 smithi035 ceph-mon[92535]: pgmap v134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:06.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:27 smithi035 ceph-mon[92535]: pgmap v135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:29 smithi035 ceph-mon[92535]: pgmap v136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:31 smithi035 ceph-mon[92535]: pgmap v137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:33 smithi035 ceph-mon[92535]: pgmap v138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:35 smithi035 ceph-mon[92535]: pgmap v139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:37 smithi035 ceph-mon[92535]: pgmap v140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:39 smithi035 ceph-mon[92535]: pgmap v141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:41 smithi035 ceph-mon[92535]: pgmap v142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:43 smithi035 ceph-mon[92535]: pgmap v143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:09.502 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:45 smithi035 ceph-mon[92535]: pgmap v144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:47 smithi035 ceph-mon[92535]: pgmap v145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:49 smithi035 ceph-mon[92535]: pgmap v146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:51 smithi035 ceph-mon[92535]: pgmap v147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:53 smithi035 ceph-mon[92535]: pgmap v148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:55 smithi035 ceph-mon[92535]: pgmap v149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:52:10.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:11.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:57 smithi035 ceph-mon[92535]: pgmap v150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:11.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:51:59 smithi035 ceph-mon[92535]: pgmap v151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:11.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:02 smithi035 ceph-mon[92535]: pgmap v152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:11.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:04 smithi035 ceph-mon[92535]: pgmap v153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:11.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:06 smithi035 ceph-mon[92535]: pgmap v154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:11.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:08 smithi035 ceph-mon[92535]: pgmap v155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:12.000 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-03-17T07:52:12.000 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:52:12.000 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-03-17T07:52:12.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:10 smithi035 ceph-mon[92535]: pgmap v156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:12.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:12 smithi035 ceph-mon[92535]: pgmap v157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:12.591 INFO:tasks.cephadm:Fetching mon keyring... 2023-03-17T07:52:15.578 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:52:15.578 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-03-17T07:52:15.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:14 smithi035 ceph-mon[92535]: pgmap v158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:15.628 INFO:tasks.cephadm:Fetching pub ssh key... 2023-03-17T07:52:18.693 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:52:18.693 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-03-17T07:52:18.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:16 smithi035 ceph-mon[92535]: pgmap v159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:18.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:18 smithi035 ceph-mon[92535]: pgmap v160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:18.714 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-03-17T07:52:19.843 DEBUG:teuthology.orchestra.run.smithi035:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-03-17T07:52:20.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:20 smithi035 ceph-mon[92535]: pgmap v161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:20.929 INFO:teuthology.orchestra.run.smithi035.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:52:22.206 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-03-17T07:52:23.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:22 smithi035 ceph-mon[92535]: pgmap v162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:27.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:24 smithi035 ceph-mon[92535]: pgmap v163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:27.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:26 smithi035 ceph-mon[92535]: pgmap v164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:27.199 INFO:teuthology.orchestra.run.smithi078.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:52:28.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:28 smithi035 ceph-mon[92535]: pgmap v165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:28.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-03-17T07:52:29.034 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDU6MxEWAxhHq4B8zvZ1xdySs9UkhwWjDwLmh6ZnFaE4EThAxklU6Xe6YOgra/yXhUi9RABE52y5RJ1gYzlIxJ1CVlk31b622m9CudNqAj9I8nalbc75FaByzc/DUwNV/fW7e+B9E1T/NS3OQLM0xAQsGN4Q3urY9sjnwlPnEBWM0jbv2rcTRZZ4eZbgJC45ott8DJN2LUwoNpy5K0l3Gc1qRU0c1Hl5d+I+FbuqkS2Y2FOrZpDnJcqyEQvYE42YI1aWij9q7OBB9sfWgkW4h1VoUfA19YdUBTHh4I3h9b7fpRvMkw85eMMYV/a+vouzGMJKSNFZDnvUlvFtrJ912+XBXI5cWDFKpVIJPuxXSsMpQyjunhEIoCX1V+ytoSvucIcxDnqbj3Nm49jUGmQNzJ0zN38d64KoVojQPH+87KjPN0ANgpvSuRLwZBe9+9a6oZPJ5VF1scHn44pon38DcFcnH2iu9Lu3ZwMPbvNoYrI7q18BR+ySfqd6gSS7SIkLB8= ceph-80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:52:30.439 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-03-17T07:52:32.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:30 smithi035 ceph-mon[92535]: pgmap v166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:32.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:32 smithi035 ceph-mon[92535]: pgmap v167: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:33.146 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:52:34.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:34 smithi035 ceph-mon[92535]: pgmap v168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:35.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 -- 172.21.15.35:0/3939516012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 msgr2=0x7fbb94102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:36.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 --2- 172.21.15.35:0/3939516012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94102b00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009910 tx=0x7fbb90009c20 comp rx=0 tx=0).stop 2023-03-17T07:52:37.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 -- 172.21.15.35:0/3939516012 shutdown_connections 2023-03-17T07:52:37.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 --2- 172.21.15.35:0/3939516012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94102b00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:37.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 -- 172.21.15.35:0/3939516012 >> 172.21.15.35:0/3939516012 conn(0x7fbb940fa120 msgr2=0x7fbb940fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:52:37.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 -- 172.21.15.35:0/3939516012 shutdown_connections 2023-03-17T07:52:37.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.565+0000 7fbb9c2df700 1 -- 172.21.15.35:0/3939516012 wait complete. 2023-03-17T07:52:37.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9c2df700 1 Processor -- start 2023-03-17T07:52:38.349 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9c2df700 1 -- start start 2023-03-17T07:52:38.349 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9c2df700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9c2df700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941005c0 con 0x7fbb94100720 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9a07b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9a07b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94100080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39174/0 (socket says 172.21.15.35:39174) 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9a07b700 1 -- 172.21.15.35:0/1275189704 learned_addr learned my addr 172.21.15.35:0/1275189704 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9a07b700 1 -- 172.21.15.35:0/1275189704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb900095f0 con 0x7fbb94100720 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.566+0000 7fbb9a07b700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94100080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb90005760 tx=0x7fbb90004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.567+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb9000ba90 con 0x7fbb94100720 2023-03-17T07:52:38.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.567+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb9000bbf0 con 0x7fbb94100720 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.567+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94105a10 con 0x7fbb94100720 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.567+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb90017440 con 0x7fbb94100720 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.567+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94105880 con 0x7fbb94100720 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.567+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7fbb9000f460 con 0x7fbb94100720 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.568+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb940620b0 con 0x7fbb94100720 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.568+0000 7fbb8b7fe700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbb80037ef0 0x7fbb8003a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:52:38.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.568+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbb9004bc80 con 0x7fbb94100720 2023-03-17T07:52:38.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.568+0000 7fbb9987a700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbb80037ef0 0x7fbb8003a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:52:38.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.568+0000 7fbb9987a700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbb80037ef0 0x7fbb8003a3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb84006fd0 tx=0x7fbb84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:52:38.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.572+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fbb90005c00 con 0x7fbb94100720 2023-03-17T07:52:38.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.769+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fbb9418e570 con 0x7fbb94100720 2023-03-17T07:52:38.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.772+0000 7fbb8b7fe700 1 -- 172.21.15.35:0/1275189704 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbb90027030 con 0x7fbb94100720 2023-03-17T07:52:39.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.774+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbb80037ef0 msgr2=0x7fbb8003a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:39.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.774+0000 7fbb9c2df700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbb80037ef0 0x7fbb8003a3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb84006fd0 tx=0x7fbb84006e40 comp rx=0 tx=0).stop 2023-03-17T07:52:39.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.774+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 msgr2=0x7fbb94100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:39.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.774+0000 7fbb9c2df700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94100080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb90005760 tx=0x7fbb90004f20 comp rx=0 tx=0).stop 2023-03-17T07:52:39.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.775+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 shutdown_connections 2023-03-17T07:52:39.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.775+0000 7fbb9c2df700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbb80037ef0 0x7fbb8003a3a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:39.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.775+0000 7fbb9c2df700 1 --2- 172.21.15.35:0/1275189704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb94100720 0x7fbb94100080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:39.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.775+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 >> 172.21.15.35:0/1275189704 conn(0x7fbb940fa120 msgr2=0x7fbb940fadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:52:39.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.775+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 shutdown_connections 2023-03-17T07:52:39.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:34.775+0000 7fbb9c2df700 1 -- 172.21.15.35:0/1275189704 wait complete. 2023-03-17T07:52:39.578 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-03-17T07:52:39.579 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-03-17T07:52:39.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:35 smithi035 ceph-mon[92535]: pgmap v169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:40.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1275189704' entity='client.admin' 2023-03-17T07:52:40.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:35 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:52:42.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:35 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:42.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:37 smithi035 ceph-mon[92535]: pgmap v170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:42.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:39 smithi035 ceph-mon[92535]: pgmap v171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:42.454 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:41 smithi035 ceph-mon[92535]: pgmap v172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:43.311 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:52:43.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 -- 172.21.15.35:0/1657468879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 msgr2=0x7fdfd80fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:45.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 --2- 172.21.15.35:0/1657468879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd80fef90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009910 tx=0x7fdfc8009c20 comp rx=0 tx=0).stop 2023-03-17T07:52:45.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 -- 172.21.15.35:0/1657468879 shutdown_connections 2023-03-17T07:52:45.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 --2- 172.21.15.35:0/1657468879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd80fef90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 -- 172.21.15.35:0/1657468879 >> 172.21.15.35:0/1657468879 conn(0x7fdfd80fa1d0 msgr2=0x7fdfd80fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 -- 172.21.15.35:0/1657468879 shutdown_connections 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 -- 172.21.15.35:0/1657468879 wait complete. 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 Processor -- start 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.969+0000 7fdfde67c700 1 -- start start 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfde67c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd8193bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:52:47.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfde67c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8194100 con 0x7fdfd80feb80 2023-03-17T07:52:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfd7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd8193bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:52:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfd7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd8193bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39180/0 (socket says 172.21.15.35:39180) 2023-03-17T07:52:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfd7fff700 1 -- 172.21.15.35:0/1653490298 learned_addr learned my addr 172.21.15.35:0/1653490298 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:52:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfd7fff700 1 -- 172.21.15.35:0/1653490298 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80095f0 con 0x7fdfd80feb80 2023-03-17T07:52:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.970+0000 7fdfd7fff700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd8193bc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005790 tx=0x7fdfc8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:52:48.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.971+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfc800b960 con 0x7fdfd80feb80 2023-03-17T07:52:48.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.971+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd8104880 con 0x7fdfd80feb80 2023-03-17T07:52:48.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.971+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfc8021470 con 0x7fdfd80feb80 2023-03-17T07:52:48.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.971+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfc800f5f0 con 0x7fdfd80feb80 2023-03-17T07:52:48.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.971+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd81046f0 con 0x7fdfd80feb80 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.971+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7fdfc800bac0 con 0x7fdfd80feb80 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.972+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd80620b0 con 0x7fdfd80feb80 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.972+0000 7fdfd57fa700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fdfc4037ef0 0x7fdfc403a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.972+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdfc804f080 con 0x7fdfd80feb80 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.972+0000 7fdfd77fe700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fdfc4037ef0 0x7fdfc403a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.972+0000 7fdfd77fe700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fdfc4037ef0 0x7fdfc403a3a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006fd0 tx=0x7fdfc0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:52:49.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:43.977+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fdfc8029b60 con 0x7fdfd80feb80 2023-03-17T07:52:49.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.179+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfd8067d10 con 0x7fdfc4037ef0 2023-03-17T07:52:49.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.183+0000 7fdfd57fa700 1 -- 172.21.15.35:0/1653490298 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdfd8067d10 con 0x7fdfc4037ef0 2023-03-17T07:52:49.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fdfc4037ef0 msgr2=0x7fdfc403a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:49.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fdfc4037ef0 0x7fdfc403a3a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006fd0 tx=0x7fdfc0006e40 comp rx=0 tx=0).stop 2023-03-17T07:52:49.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 msgr2=0x7fdfd8193bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:49.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd8193bc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8005790 tx=0x7fdfc8004f90 comp rx=0 tx=0).stop 2023-03-17T07:52:49.705 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 shutdown_connections 2023-03-17T07:52:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fdfc4037ef0 0x7fdfc403a3a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 --2- 172.21.15.35:0/1653490298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdfd80feb80 0x7fdfd8193bc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 >> 172.21.15.35:0/1653490298 conn(0x7fdfd80fa1d0 msgr2=0x7fdfd80faec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:52:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 shutdown_connections 2023-03-17T07:52:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:44.185+0000 7fdfde67c700 1 -- 172.21.15.35:0/1653490298 wait complete. 2023-03-17T07:52:50.496 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:43 smithi035 ceph-mon[92535]: pgmap v173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:50.496 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi078 2023-03-17T07:52:50.497 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:52:50.497 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/etc/ceph/ceph.conf 2023-03-17T07:52:50.497 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:52:50.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:50.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:52:50.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:52:50.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:52:50.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:50.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:50.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:52:51.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:46 smithi035 ceph-mon[92535]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T07:52:51.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:46 smithi035 ceph-mon[92535]: pgmap v174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:51.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:46 smithi035 ceph-mon[92535]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:52:51.697 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:46 smithi035 ceph-mon[92535]: Updating smithi035:/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:52:52.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:46 smithi035 ceph-mon[92535]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T07:52:52.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:48 smithi035 ceph-mon[92535]: pgmap v175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:52.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:50 smithi035 ceph-mon[92535]: pgmap v176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:52.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:52 smithi035 ceph-mon[92535]: pgmap v177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:53.895 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:52:54.720 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:52:54.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:54 smithi035 ceph-mon[92535]: pgmap v178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:55.753 INFO:tasks.cephadm:Adding host smithi078 to orchestrator... 2023-03-17T07:52:56.493 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch host add smithi078 2023-03-17T07:52:56.494 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:56 smithi035 ceph-mon[92535]: pgmap v179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:57.161 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:52:58.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 -- 172.21.15.35:0/2851517344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 msgr2=0x7fe0741002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:52:59.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 --2- 172.21.15.35:0/2851517344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe0741002f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe064009910 tx=0x7fe064009c20 comp rx=0 tx=0).stop 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 -- 172.21.15.35:0/2851517344 shutdown_connections 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 --2- 172.21.15.35:0/2851517344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe0741002f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 -- 172.21.15.35:0/2851517344 >> 172.21.15.35:0/2851517344 conn(0x7fe0740fb800 msgr2=0x7fe0740fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 -- 172.21.15.35:0/2851517344 shutdown_connections 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.344+0000 7fe0795ef700 1 -- 172.21.15.35:0/2851517344 wait complete. 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.345+0000 7fe0795ef700 1 Processor -- start 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.345+0000 7fe0795ef700 1 -- start start 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.345+0000 7fe0795ef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe074195050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.345+0000 7fe0795ef700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe074195590 con 0x7fe0740fff20 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.345+0000 7fe072ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe074195050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe072ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe074195050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39186/0 (socket says 172.21.15.35:39186) 2023-03-17T07:52:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe072ffd700 1 -- 172.21.15.35:0/4156082227 learned_addr learned my addr 172.21.15.35:0/4156082227 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe072ffd700 1 -- 172.21.15.35:0/4156082227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640095f0 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe072ffd700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe074195050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe064006010 tx=0x7fe064004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe06401d070 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe074109fb0 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe06400bdf0 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe064022cd0 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.346+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe074109e20 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.347+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7fe06400b960 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.347+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07410a140 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.347+0000 7fe05bfff700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe05c037ef0 0x7fe05c03a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.347+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe06404bbf0 con 0x7fe0740fff20 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.347+0000 7fe0727fc700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe05c037ef0 0x7fe05c03a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.348+0000 7fe0727fc700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe05c037ef0 0x7fe05c03a3a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe068006fd0 tx=0x7fe068006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:52:59.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.352+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fe06402bba0 con 0x7fe0740fff20 2023-03-17T07:52:59.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:52:58 smithi035 ceph-mon[92535]: pgmap v180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:52:59.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:52:58.558+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi078", "target": ["mon-mgr", ""]}) v1 -- 0x7fe074195b90 con 0x7fe05c037ef0 2023-03-17T07:53:00.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:00 smithi035 ceph-mon[92535]: pgmap v181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:01.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:00 smithi035 ceph-mon[92535]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi078", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:53:01.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:00 smithi035 ceph-mon[92535]: Deploying cephadm binary to smithi078 2023-03-17T07:53:01.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.807+0000 7fe05bfff700 1 -- 172.21.15.35:0/4156082227 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fe074195b90 con 0x7fe05c037ef0 2023-03-17T07:53:01.347 INFO:teuthology.orchestra.run.smithi035.stdout:Added host 'smithi078' with addr '172.21.15.78' 2023-03-17T07:53:01.349 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe05c037ef0 msgr2=0x7fe05c03a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:02.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe05c037ef0 0x7fe05c03a3a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe068006fd0 tx=0x7fe068006e40 comp rx=0 tx=0).stop 2023-03-17T07:53:02.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 msgr2=0x7fe074195050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:02.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe074195050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe064006010 tx=0x7fe064004ff0 comp rx=0 tx=0).stop 2023-03-17T07:53:02.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 shutdown_connections 2023-03-17T07:53:02.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe05c037ef0 0x7fe05c03a3a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:02.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 --2- 172.21.15.35:0/4156082227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0740fff20 0x7fe074195050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:02.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 >> 172.21.15.35:0/4156082227 conn(0x7fe0740fb800 msgr2=0x7fe074104100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:02.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.809+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 shutdown_connections 2023-03-17T07:53:02.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:00.810+0000 7fe0795ef700 1 -- 172.21.15.35:0/4156082227 wait complete. 2023-03-17T07:53:03.001 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch host ls --format=json 2023-03-17T07:53:03.003 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:01 smithi035 ceph-mon[92535]: pgmap v182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:03.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:03.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:01 smithi035 ceph-mon[92535]: Added host smithi078 2023-03-17T07:53:03.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:53:03.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:03.746 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:04.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:04 smithi035 ceph-mon[92535]: pgmap v183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:04.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:04.483 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:53:05.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 -- 172.21.15.35:0/3912948760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 msgr2=0x7ff9641002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 --2- 172.21.15.35:0/3912948760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff9641002f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff954009910 tx=0x7ff954009c20 comp rx=0 tx=0).stop 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 -- 172.21.15.35:0/3912948760 shutdown_connections 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 --2- 172.21.15.35:0/3912948760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff9641002f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 -- 172.21.15.35:0/3912948760 >> 172.21.15.35:0/3912948760 conn(0x7ff9640fb7e0 msgr2=0x7ff9640fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 -- 172.21.15.35:0/3912948760 shutdown_connections 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.550+0000 7ff96a2ec700 1 -- 172.21.15.35:0/3912948760 wait complete. 2023-03-17T07:53:06.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff96a2ec700 1 Processor -- start 2023-03-17T07:53:06.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff96a2ec700 1 -- start start 2023-03-17T07:53:06.531 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff96a2ec700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff964195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff96a2ec700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641956c0 con 0x7ff9640fff20 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff964195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff964195180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39212/0 (socket says 172.21.15.35:39212) 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff963fff700 1 -- 172.21.15.35:0/474158382 learned_addr learned my addr 172.21.15.35:0/474158382 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.551+0000 7ff963fff700 1 -- 172.21.15.35:0/474158382 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540095f0 con 0x7ff9640fff20 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.552+0000 7ff963fff700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff964195180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff954004f40 tx=0x7ff954005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.552+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff95401d070 con 0x7ff9640fff20 2023-03-17T07:53:07.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.552+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff964109fb0 con 0x7ff9640fff20 2023-03-17T07:53:07.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.552+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff964109e20 con 0x7ff9640fff20 2023-03-17T07:53:07.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.552+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9540044b0 con 0x7ff9640fff20 2023-03-17T07:53:07.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.552+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff954003810 con 0x7ff9640fff20 2023-03-17T07:53:07.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.553+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff950005320 con 0x7ff9640fff20 2023-03-17T07:53:09.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.553+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7ff954003a90 con 0x7ff9640fff20 2023-03-17T07:53:09.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.553+0000 7ff9617fa700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff94c037ef0 0x7ff94c03a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:09.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.553+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff95404b9c0 con 0x7ff9640fff20 2023-03-17T07:53:09.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.553+0000 7ff9637fe700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff94c037ef0 0x7ff94c03a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:09.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.553+0000 7ff9637fe700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff94c037ef0 0x7ff94c03a3a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff958006fd0 tx=0x7ff958006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:09.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.558+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff95402a770 con 0x7ff9640fff20 2023-03-17T07:53:09.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.764+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff950000bf0 con 0x7ff94c037ef0 2023-03-17T07:53:09.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.765+0000 7ff9617fa700 1 -- 172.21.15.35:0/474158382 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7ff950000bf0 con 0x7ff94c037ef0 2023-03-17T07:53:09.581 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:53:09.581 INFO:teuthology.orchestra.run.smithi035.stdout:[{"addr": "172.21.15.35", "hostname": "smithi035", "labels": [], "status": ""}, {"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}] 2023-03-17T07:53:09.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff94c037ef0 msgr2=0x7ff94c03a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:09.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff94c037ef0 0x7ff94c03a3a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff958006fd0 tx=0x7ff958006e40 comp rx=0 tx=0).stop 2023-03-17T07:53:11.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 msgr2=0x7ff964195180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:11.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff964195180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff954004f40 tx=0x7ff954005020 comp rx=0 tx=0).stop 2023-03-17T07:53:11.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 shutdown_connections 2023-03-17T07:53:12.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff94c037ef0 0x7ff94c03a3a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:12.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 --2- 172.21.15.35:0/474158382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9640fff20 0x7ff964195180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:12.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 >> 172.21.15.35:0/474158382 conn(0x7ff9640fb7e0 msgr2=0x7ff964104100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:12.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 shutdown_connections 2023-03-17T07:53:12.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:05.767+0000 7ff96a2ec700 1 -- 172.21.15.35:0/474158382 wait complete. 2023-03-17T07:53:12.305 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: pgmap v184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:12.305 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:12.305 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:12.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:12.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:12.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:53:12.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:53:12.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:53:12.307 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi082 2023-03-17T07:53:14.194 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:53:14.194 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.conf 2023-03-17T07:53:14.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:07 smithi035 ceph-mon[92535]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T07:53:14.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:07 smithi035 ceph-mon[92535]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T07:53:14.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:14.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:14.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:14.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:08 smithi035 ceph-mon[92535]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:53:14.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:08 smithi035 ceph-mon[92535]: pgmap v185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:14.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:08 smithi035 ceph-mon[92535]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:53:14.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:08 smithi035 ceph-mon[92535]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T07:53:14.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:10 smithi035 ceph-mon[92535]: pgmap v186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:14.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:12 smithi035 ceph-mon[92535]: pgmap v187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:14.216 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:53:15.787 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:53:15.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:14 smithi035 ceph-mon[92535]: pgmap v188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:15.807 INFO:tasks.cephadm:Adding host smithi082 to orchestrator... 2023-03-17T07:53:17.214 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch host add smithi082 2023-03-17T07:53:18.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:16 smithi035 ceph-mon[92535]: pgmap v189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:19.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:18 smithi035 ceph-mon[92535]: pgmap v190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:22.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:20 smithi035 ceph-mon[92535]: pgmap v191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:22.405 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:53:22.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 -- 172.21.15.35:0/1002205035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 msgr2=0x7fd528101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:22.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 --2- 172.21.15.35:0/1002205035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd528101190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd524009910 tx=0x7fd524009c20 comp rx=0 tx=0).stop 2023-03-17T07:53:22.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 -- 172.21.15.35:0/1002205035 shutdown_connections 2023-03-17T07:53:22.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 --2- 172.21.15.35:0/1002205035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd528101190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:22.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 -- 172.21.15.35:0/1002205035 >> 172.21.15.35:0/1002205035 conn(0x7fd5280748c0 msgr2=0x7fd528074cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:24.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 -- 172.21.15.35:0/1002205035 shutdown_connections 2023-03-17T07:53:24.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 -- 172.21.15.35:0/1002205035 wait complete. 2023-03-17T07:53:24.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 Processor -- start 2023-03-17T07:53:24.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.975+0000 7fd52fd24700 1 -- start start 2023-03-17T07:53:24.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52fd24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd5280febf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:24.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52fd24700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528100b70 con 0x7fd528100dc0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52dac0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd5280febf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52dac0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd5280febf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39218/0 (socket says 172.21.15.35:39218) 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52dac0700 1 -- 172.21.15.35:0/1810388032 learned_addr learned my addr 172.21.15.35:0/1810388032 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52dac0700 1 -- 172.21.15.35:0/1810388032 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240095f0 con 0x7fd528100dc0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52dac0700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd5280febf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd524004e90 tx=0x7fd524004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd52401d070 con 0x7fd528100dc0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd528109fe0 con 0x7fd528100dc0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5240044b0 con 0x7fd528100dc0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5240038f0 con 0x7fd528100dc0 2023-03-17T07:53:24.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.976+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd528109e50 con 0x7fd528100dc0 2023-03-17T07:53:26.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.977+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7fd524003b70 con 0x7fd528100dc0 2023-03-17T07:53:26.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.977+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52810a170 con 0x7fd528100dc0 2023-03-17T07:53:26.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.977+0000 7fd51effd700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:26.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.977+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd52404ba40 con 0x7fd528100dc0 2023-03-17T07:53:26.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.978+0000 7fd52d2bf700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:26.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.978+0000 7fd52d2bf700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:27.216 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:21.982+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fd52404de60 con 0x7fd528100dc0 2023-03-17T07:53:27.216 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:22.185+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}) v1 -- 0x7fd528100120 con 0x7fd514037ef0 2023-03-17T07:53:27.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:22 smithi035 ceph-mon[92535]: pgmap v192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:28.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:23 smithi035 ceph-mon[92535]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:53:28.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.277+0000 7fd51effd700 1 -- 172.21.15.35:0/1810388032 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fd528100120 con 0x7fd514037ef0 2023-03-17T07:53:28.274 INFO:teuthology.orchestra.run.smithi035.stdout:Added host 'smithi082' with addr '172.21.15.82' 2023-03-17T07:53:28.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 msgr2=0x7fd51403a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006e40 comp rx=0 tx=0).stop 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 msgr2=0x7fd5280febf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd5280febf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd524004e90 tx=0x7fd524004f70 comp rx=0 tx=0).stop 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 shutdown_connections 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 --2- 172.21.15.35:0/1810388032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd528100dc0 0x7fd5280febf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 >> 172.21.15.35:0/1810388032 conn(0x7fd5280748c0 msgr2=0x7fd5281045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:28.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 shutdown_connections 2023-03-17T07:53:28.901 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:24.280+0000 7fd52fd24700 1 -- 172.21.15.35:0/1810388032 wait complete. 2023-03-17T07:53:28.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:24 smithi035 ceph-mon[92535]: pgmap v193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:28.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:24 smithi035 ceph-mon[92535]: Deploying cephadm binary to smithi082 2023-03-17T07:53:29.574 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch host ls --format=json 2023-03-17T07:53:29.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:25 smithi035 ceph-mon[92535]: pgmap v194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:25 smithi035 ceph-mon[92535]: Added host smithi082 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:27 smithi035 ceph-mon[92535]: pgmap v195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:29.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:30.454 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: pgmap v196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:31.226 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:31.227 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:31.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:32.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:32.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:53:32.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:53:32.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:53:32.703 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:53:32.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T07:53:32.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:53:32.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:53:32.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T07:53:32.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:32.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:32.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:53:33.669 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 -- 172.21.15.35:0/4004514803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 msgr2=0x7f4b840ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:34.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 --2- 172.21.15.35:0/4004514803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b840ff260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009910 tx=0x7f4b74009c20 comp rx=0 tx=0).stop 2023-03-17T07:53:34.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 -- 172.21.15.35:0/4004514803 shutdown_connections 2023-03-17T07:53:34.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 --2- 172.21.15.35:0/4004514803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b840ff260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:34.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 -- 172.21.15.35:0/4004514803 >> 172.21.15.35:0/4004514803 conn(0x7f4b840748c0 msgr2=0x7f4b84074cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:34.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 -- 172.21.15.35:0/4004514803 shutdown_connections 2023-03-17T07:53:34.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 -- 172.21.15.35:0/4004514803 wait complete. 2023-03-17T07:53:34.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.793+0000 7f4b89344700 1 Processor -- start 2023-03-17T07:53:34.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b89344700 1 -- start start 2023-03-17T07:53:34.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b89344700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b84195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:34.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b89344700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b841963d0 con 0x7f4b840fee90 2023-03-17T07:53:34.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b82ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b84195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:34.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b82ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b84195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39244/0 (socket says 172.21.15.35:39244) 2023-03-17T07:53:35.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b82ffd700 1 -- 172.21.15.35:0/1479141745 learned_addr learned my addr 172.21.15.35:0/1479141745 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:53:35.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b82ffd700 1 -- 172.21.15.35:0/1479141745 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740095f0 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.794+0000 7f4b82ffd700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b84195e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b74004f40 tx=0x7f4b74005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.795+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b7401d070 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.795+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84108ed0 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.795+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b740044b0 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.795+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74003860 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.795+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84108d40 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.795+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b84109060 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.796+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7f4b7400b960 con 0x7f4b840fee90 2023-03-17T07:53:35.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.796+0000 7f4b7bfff700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4b70037f40 0x7f4b7003a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:35.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.796+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4b7404be40 con 0x7f4b840fee90 2023-03-17T07:53:35.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.796+0000 7f4b827fc700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4b70037f40 0x7f4b7003a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:35.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.797+0000 7f4b827fc700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4b70037f40 0x7f4b7003a3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c006fd0 tx=0x7f4b6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:35.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:31.801+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f4b7400e9d0 con 0x7f4b840fee90 2023-03-17T07:53:35.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.004+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b84068270 con 0x7f4b70037f40 2023-03-17T07:53:35.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.005+0000 7f4b7bfff700 1 -- 172.21.15.35:0/1479141745 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f4b84068270 con 0x7f4b70037f40 2023-03-17T07:53:35.856 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T07:53:37.087 INFO:teuthology.orchestra.run.smithi035.stdout:[{"addr": "172.21.15.35", "hostname": "smithi035", "labels": [], "status": ""}, {"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}] 2023-03-17T07:53:37.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.007+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4b70037f40 msgr2=0x7f4b7003a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:37.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.007+0000 7f4b89344700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4b70037f40 0x7f4b7003a3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c006fd0 tx=0x7f4b6c006e40 comp rx=0 tx=0).stop 2023-03-17T07:53:37.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.007+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 msgr2=0x7f4b84195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:37.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.007+0000 7f4b89344700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b84195e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b74004f40 tx=0x7f4b74005020 comp rx=0 tx=0).stop 2023-03-17T07:53:37.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.008+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 shutdown_connections 2023-03-17T07:53:37.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.008+0000 7f4b89344700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4b70037f40 0x7f4b7003a3f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:37.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.008+0000 7f4b89344700 1 --2- 172.21.15.35:0/1479141745 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4b840fee90 0x7f4b84195e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:37.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.008+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 >> 172.21.15.35:0/1479141745 conn(0x7f4b840748c0 msgr2=0x7f4b84103020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:37.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.008+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 shutdown_connections 2023-03-17T07:53:37.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:32.008+0000 7f4b89344700 1 -- 172.21.15.35:0/1479141745 wait complete. 2023-03-17T07:53:37.089 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:31 smithi035 ceph-mon[92535]: pgmap v197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:37.091 INFO:tasks.cephadm:Setting crush tunables to default 2023-03-17T07:53:38.009 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd crush tunables default 2023-03-17T07:53:38.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:32 smithi035 ceph-mon[92535]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T07:53:39.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:33 smithi035 ceph-mon[92535]: pgmap v198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:39.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:35 smithi035 ceph-mon[92535]: pgmap v199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:39.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:37 smithi035 ceph-mon[92535]: pgmap v200: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:40.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:40 smithi035 ceph-mon[92535]: pgmap v201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:41.133 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:53:41.648 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 -- 172.21.15.35:0/4081132636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 msgr2=0x7fd52c0ff2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 --2- 172.21.15.35:0/4081132636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c0ff2e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009910 tx=0x7fd51c009c20 comp rx=0 tx=0).stop 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 -- 172.21.15.35:0/4081132636 shutdown_connections 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 --2- 172.21.15.35:0/4081132636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c0ff2e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 -- 172.21.15.35:0/4081132636 >> 172.21.15.35:0/4081132636 conn(0x7fd52c0fa810 msgr2=0x7fd52c0fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 -- 172.21.15.35:0/4081132636 shutdown_connections 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.640+0000 7fd53234d700 1 -- 172.21.15.35:0/4081132636 wait complete. 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd53234d700 1 Processor -- start 2023-03-17T07:53:43.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd53234d700 1 -- start start 2023-03-17T07:53:43.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd53234d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:45.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd53234d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c196470 con 0x7fd52c0fef10 2023-03-17T07:53:46.414 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:46.414 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39250/0 (socket says 172.21.15.35:39250) 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.641+0000 7fd52bfff700 1 -- 172.21.15.35:0/1853911983 learned_addr learned my addr 172.21.15.35:0/1853911983 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd52bfff700 1 -- 172.21.15.35:0/1853911983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0095f0 con 0x7fd52c0fef10 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd52bfff700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c195f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd51c004f40 tx=0x7fd51c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd51c01d070 con 0x7fd52c0fef10 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd51c0044b0 con 0x7fd52c0fef10 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c108fa0 con 0x7fd52c0fef10 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd51c003860 con 0x7fd52c0fef10 2023-03-17T07:53:46.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.642+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c108e10 con 0x7fd52c0fef10 2023-03-17T07:53:46.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.643+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7fd51c003ae0 con 0x7fd52c0fef10 2023-03-17T07:53:46.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.643+0000 7fd5297fa700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:53:46.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.643+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c109130 con 0x7fd52c0fef10 2023-03-17T07:53:46.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.643+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd51c04bce0 con 0x7fd52c0fef10 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.643+0000 7fd52b7fe700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.644+0000 7fd52b7fe700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd520006fd0 tx=0x7fd520006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.648+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fd51c02a770 con 0x7fd52c0fef10 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:41.850+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd52c068b00 con 0x7fd52c0fef10 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.009+0000 7fd5297fa700 1 -- 172.21.15.35:0/1853911983 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd51c033070 con 0x7fd52c0fef10 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 msgr2=0x7fd51403a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:47.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd520006fd0 tx=0x7fd520006e40 comp rx=0 tx=0).stop 2023-03-17T07:53:48.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 msgr2=0x7fd52c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:50.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c195f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd51c004f40 tx=0x7fd51c005020 comp rx=0 tx=0).stop 2023-03-17T07:53:50.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 shutdown_connections 2023-03-17T07:53:50.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd514037ef0 0x7fd51403a3a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:50.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 --2- 172.21.15.35:0/1853911983 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd52c0fef10 0x7fd52c195f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:53:50.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 >> 172.21.15.35:0/1853911983 conn(0x7fd52c0fa810 msgr2=0x7fd52c1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:53:50.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 shutdown_connections 2023-03-17T07:53:50.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:53:42.011+0000 7fd53234d700 1 -- 172.21.15.35:0/1853911983 wait complete. 2023-03-17T07:53:50.651 INFO:teuthology.orchestra.run.smithi035.stderr:adjusted tunables profile to default 2023-03-17T07:53:50.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:42 smithi035 ceph-mon[92535]: pgmap v202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:50.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:42 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1853911983' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-03-17T07:53:50.653 INFO:tasks.cephadm:Adding mon.a on smithi035 2023-03-17T07:53:50.653 INFO:tasks.cephadm:Adding mon.b on smithi078 2023-03-17T07:53:52.065 INFO:tasks.cephadm:Adding mon.c on smithi082 2023-03-17T07:53:52.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch apply mon '3;smithi035:172.21.15.35=a;smithi078:172.21.15.78=b;smithi082:172.21.15.82=c' 2023-03-17T07:53:52.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:43 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1853911983' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-03-17T07:53:54.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:43 smithi035 ceph-mon[92535]: osdmap e4: 0 total, 0 up, 0 in 2023-03-17T07:53:54.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:44 smithi035 ceph-mon[92535]: pgmap v204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:54.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:46 smithi035 ceph-mon[92535]: pgmap v205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:54.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:48 smithi035 ceph-mon[92535]: pgmap v206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:54.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:50 smithi035 ceph-mon[92535]: pgmap v207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:55.084 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:52 smithi035 ceph-mon[92535]: pgmap v208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:55.084 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:54 smithi035 ceph-mon[92535]: pgmap v209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:55.746 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:53:56.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:56 smithi035 ceph-mon[92535]: pgmap v210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:53:58.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 -- 172.21.15.82:0/695621807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 msgr2=0x7fc64c1002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:53:58.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 --2- 172.21.15.82:0/695621807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c1002f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009910 tx=0x7fc63c009c20 comp rx=0 tx=0).stop 2023-03-17T07:53:58.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 -- 172.21.15.82:0/695621807 shutdown_connections 2023-03-17T07:54:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 --2- 172.21.15.82:0/695621807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c1002f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 -- 172.21.15.82:0/695621807 >> 172.21.15.82:0/695621807 conn(0x7fc64c0fb800 msgr2=0x7fc64c0fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:54:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 -- 172.21.15.82:0/695621807 shutdown_connections 2023-03-17T07:54:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.931+0000 7fc651f98700 1 -- 172.21.15.82:0/695621807 wait complete. 2023-03-17T07:54:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.932+0000 7fc651f98700 1 Processor -- start 2023-03-17T07:54:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.932+0000 7fc651f98700 1 -- start start 2023-03-17T07:54:01.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.932+0000 7fc651f98700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:54:01.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.932+0000 7fc651f98700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1955a0 con 0x7fc64c0fff20 2023-03-17T07:54:01.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.932+0000 7fc64b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.932+0000 7fc64b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c195060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.82:41566/0 (socket says 172.21.15.82:41566) 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc64b7fe700 1 -- 172.21.15.82:0/2202570283 learned_addr learned my addr 172.21.15.82:0/2202570283 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc64b7fe700 1 -- 172.21.15.82:0/2202570283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c0095f0 con 0x7fc64c0fff20 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc64b7fe700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c195060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc63c006010 tx=0x7fc63c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63c01d070 con 0x7fc64c0fff20 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c109fb0 con 0x7fc64c0fff20 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc63c00bdf0 con 0x7fc64c0fff20 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc63c022cd0 con 0x7fc64c0fff20 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.933+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c109e20 con 0x7fc64c0fff20 2023-03-17T07:54:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.934+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7fc63c022470 con 0x7fc64c0fff20 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.934+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c10a140 con 0x7fc64c0fff20 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.934+0000 7fc648ff9700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc634037ef0 0x7fc63403a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.934+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc63c04bbd0 con 0x7fc64c0fff20 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.935+0000 7fc64affd700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc634037ef0 0x7fc63403a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.935+0000 7fc64affd700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc634037ef0 0x7fc63403a3a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc640006fd0 tx=0x7fc640006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:56.940+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fc63c02bba0 con 0x7fc64c0fff20 2023-03-17T07:54:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.135+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi035:172.21.15.35=a;smithi078:172.21.15.78=b;smithi082:172.21.15.82=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fc64c195ba0 con 0x7fc634037ef0 2023-03-17T07:54:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.143+0000 7fc648ff9700 1 -- 172.21.15.82:0/2202570283 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc64c195ba0 con 0x7fc634037ef0 2023-03-17T07:54:01.662 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mon update... 2023-03-17T07:54:01.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: pgmap v211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:03.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi035:172.21.15.35=a;smithi078:172.21.15.78=b;smithi082:172.21.15.82=c", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:54:03.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: Saving service mon spec with placement smithi035:172.21.15.35=a;smithi078:172.21.15.78=b;smithi082:172.21.15.82=c;count:3 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:53:58 smithi035 ceph-mon[92535]: Deploying daemon mon.c on smithi082 2023-03-17T07:54:05.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:00 smithi035 ceph-mon[92535]: pgmap v212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc634037ef0 msgr2=0x7fc63403a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc634037ef0 0x7fc63403a3a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc640006fd0 tx=0x7fc640006e40 comp rx=0 tx=0).stop 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 msgr2=0x7fc64c195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c195060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc63c006010 tx=0x7fc63c004ff0 comp rx=0 tx=0).stop 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 shutdown_connections 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc634037ef0 0x7fc63403a3a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:05.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 --2- 172.21.15.82:0/2202570283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc64c0fff20 0x7fc64c195060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:06.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 >> 172.21.15.82:0/2202570283 conn(0x7fc64c0fb800 msgr2=0x7fc64c104100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:54:06.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 shutdown_connections 2023-03-17T07:54:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:53:57.145+0000 7fc651f98700 1 -- 172.21.15.82:0/2202570283 wait complete. 2023-03-17T07:54:08.720 DEBUG:teuthology.orchestra.run.smithi078:mon.b> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.b.service 2023-03-17T07:54:08.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:54:08.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:08.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: mon.a calling monitor election 2023-03-17T07:54:08.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: pgmap v213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: mon.c calling monitor election 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: pgmap v214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: pgmap v215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: monmap e2: 2 mons at {a=[v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0],c=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: fsmap 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: osdmap e4: 0 total, 0 up, 0 in 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: mgrmap e13: x(active, since 7m) 2023-03-17T07:54:08.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:06 smithi035 ceph-mon[92535]: Deploying daemon mon.b on smithi078 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:09.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:07 smithi035 ceph-mon[92535]: pgmap v216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:09.644 DEBUG:teuthology.orchestra.run.smithi082:mon.c> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mon.c.service 2023-03-17T07:54:12.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T07:54:12.768 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-03-17T07:54:12.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph mon dump -f json 2023-03-17T07:54:12.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T07:54:16.494 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T07:54:16.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:16.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:54:16.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:16.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: mon.a calling monitor election 2023-03-17T07:54:18.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: mon.c calling monitor election 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: mon.b calling monitor election 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:19.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: monmap e3: 3 mons at {a=[v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0],b=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],c=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: fsmap 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: osdmap e4: 0 total, 0 up, 0 in 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: mgrmap e13: x(active, since 7m) 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:15 smithi035 ceph-mon[92535]: pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:15 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/4114705276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:19.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:19.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:54:21.445 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: mon.a calling monitor election 2023-03-17T07:54:23.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: mon.c calling monitor election 2023-03-17T07:54:23.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:23.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:23.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: mon.b calling monitor election 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-03-17T07:54:23.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: monmap e3: 3 mons at {a=[v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0],b=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],c=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: fsmap 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: osdmap e4: 0 total, 0 up, 0 in 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: mgrmap e13: x(active, since 7m) 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:23.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:23.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:15 smithi078 ceph-mon[94114]: pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:23.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:15 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/4114705276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-17T07:54:23.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:23.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:25.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:25.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T07:54:25.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:25.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: mon.a calling monitor election 2023-03-17T07:54:25.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: mon.c calling monitor election 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: mon.b calling monitor election 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:25.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:25.143 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:25.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-03-17T07:54:25.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: monmap e3: 3 mons at {a=[v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0],b=[v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0],c=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} 2023-03-17T07:54:25.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: fsmap 2023-03-17T07:54:25.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: osdmap e4: 0 total, 0 up, 0 in 2023-03-17T07:54:25.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: mgrmap e13: x(active, since 7m) 2023-03-17T07:54:25.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T07:54:25.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:26.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:26.498 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:26.498 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:26.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:27.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:27.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:27.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:29.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:29.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:29.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:29.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:29.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:30.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: Reconfiguring mon.a (unknown last config time)... 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: Reconfiguring daemon mon.a on smithi035 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:30.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: Reconfiguring mon.b (monmap changed)... 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: Reconfiguring daemon mon.b on smithi078 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:30.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:31.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: Reconfiguring mon.c (monmap changed)... 2023-03-17T07:54:32.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: Reconfiguring daemon mon.c on smithi082 2023-03-17T07:54:32.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:32.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:33.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:33.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:33.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:33.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.746 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:22 smithi035 ceph-mon[92535]: pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:34.746 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:24 smithi035 ceph-mon[92535]: pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:34.746 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:26 smithi035 ceph-mon[92535]: pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.748 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.748 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.748 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:34.748 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:34.748 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:35.477 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:35.477 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: Reconfiguring mon.a (unknown last config time)... 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: Reconfiguring daemon mon.a on smithi035 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: Reconfiguring mon.b (monmap changed)... 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: Reconfiguring daemon mon.b on smithi078 2023-03-17T07:54:36.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: Reconfiguring mon.c (monmap changed)... 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: Reconfiguring daemon mon.c on smithi082 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:22 smithi078 ceph-mon[94114]: pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:24 smithi078 ceph-mon[94114]: pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:36.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:26 smithi078 ceph-mon[94114]: pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:36.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:28 smithi035 ceph-mon[92535]: pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:38.796 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:30 smithi035 ceph-mon[92535]: pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:38.796 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:32 smithi035 ceph-mon[92535]: pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:38.796 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:34 smithi035 ceph-mon[92535]: pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:38.796 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:36 smithi035 ceph-mon[92535]: pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:38.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:28 smithi078 ceph-mon[94114]: pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:39.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:30 smithi078 ceph-mon[94114]: pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:39.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:32 smithi078 ceph-mon[94114]: pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:39.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:34 smithi078 ceph-mon[94114]: pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:39.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:36 smithi078 ceph-mon[94114]: pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 -- 172.21.15.82:0/2116817077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 msgr2=0x7f2e28104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 --2- 172.21.15.82:0/2116817077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28104930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009910 tx=0x7f2e1c009c20 comp rx=0 tx=0).stop 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 -- 172.21.15.82:0/2116817077 shutdown_connections 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 --2- 172.21.15.82:0/2116817077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28104930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 -- 172.21.15.82:0/2116817077 >> 172.21.15.82:0/2116817077 conn(0x7f2e28074230 msgr2=0x7f2e28074630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 -- 172.21.15.82:0/2116817077 shutdown_connections 2023-03-17T07:54:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 -- 172.21.15.82:0/2116817077 wait complete. 2023-03-17T07:54:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.676+0000 7f2e2d193700 1 Processor -- start 2023-03-17T07:54:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 -- start start 2023-03-17T07:54:41.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:54:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 0x7f2e28196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:54:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 0x7f2e281a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:54:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e281a1d00 con 0x7f2e28104560 2023-03-17T07:54:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e281a1e70 con 0x7f2e281966b0 2023-03-17T07:54:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2d193700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e281a2030 con 0x7f2e2819f1e0 2023-03-17T07:54:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 0x7f2e281a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.82:41592/0 (socket says 172.21.15.82:41592) 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 -- 172.21.15.82:0/4114705276 learned_addr learned my addr 172.21.15.82:0/4114705276 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2659c700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 0x7f2e28196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2759e700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 msgr2=0x7f2e281a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2759e700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 msgr2=0x7f2e281a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-17T07:54:42.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2759e700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 0x7f2e281a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2759e700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 0x7f2e281a15c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2659c700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 msgr2=0x7f2e28196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2659c700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 msgr2=0x7f2e28196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2659c700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 0x7f2e28196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e2659c700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 0x7f2e28196b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 msgr2=0x7f2e281a15c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T07:54:42.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 0x7f2e281a15c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:43.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 msgr2=0x7f2e28196b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 0x7f2e28196b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 -- 172.21.15.82:0/4114705276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0095f0 con 0x7f2e28104560 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.677+0000 7f2e26d9d700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28196170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00bd20 tx=0x7f2e1c00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.678+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c01d070 con 0x7f2e28104560 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.678+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e1c004db0 con 0x7f2e28104560 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.678+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c022d80 con 0x7f2e28104560 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.678+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e28108750 con 0x7f2e28104560 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.678+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e281085c0 con 0x7f2e28104560 2023-03-17T07:54:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.678+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7f2e1c00f460 con 0x7f2e28104560 2023-03-17T07:54:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.679+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e281088e0 con 0x7f2e28104560 2023-03-17T07:54:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.679+0000 7f2e0ffff700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2e100383c0 0x7f2e1003a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:54:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.679+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2e1c04bc70 con 0x7f2e28104560 2023-03-17T07:54:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.679+0000 7f2e2659c700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2e100383c0 0x7f2e1003a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:54:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.679+0000 7f2e2659c700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2e100383c0 0x7f2e1003a870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2e28106350 tx=0x7f2e18008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:54:46.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.684+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f2e1c020960 con 0x7f2e28104560 2023-03-17T07:54:46.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:46.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T07:54:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.956+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e280620b0 con 0x7f2e28104560 2023-03-17T07:54:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.957+0000 7f2e0ffff700 1 -- 172.21.15.82:0/4114705276 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f2e1c027020 con 0x7f2e28104560 2023-03-17T07:54:46.254 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-03-17T07:54:46.255 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","modified":"2023-03-17T07:54:08.470203Z","created":"2023-03-17T07:45:47.117399Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:3300","nonce":0},{"type":"v1","addr":"172.21.15.35:6789","nonce":0}]},"addr":"172.21.15.35:6789/0","public_addr":"172.21.15.35:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-03-17T07:54:46.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:38 smithi035 ceph-mon[92535]: pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:40 smithi035 ceph-mon[92535]: pgmap v232: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:42 smithi035 ceph-mon[92535]: pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:44 smithi035 ceph-mon[92535]: pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:38 smithi078 ceph-mon[94114]: pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:40 smithi078 ceph-mon[94114]: pgmap v232: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:42 smithi078 ceph-mon[94114]: pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:47.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:44 smithi078 ceph-mon[94114]: pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2e100383c0 msgr2=0x7f2e1003a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2e100383c0 0x7f2e1003a870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2e28106350 tx=0x7f2e18008040 comp rx=0 tx=0).stop 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 msgr2=0x7f2e28196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28196170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00bd20 tx=0x7f2e1c00be00 comp rx=0 tx=0).stop 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 shutdown_connections 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e2819f1e0 0x7f2e281a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2e100383c0 0x7f2e1003a870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2e28104560 0x7f2e28196170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 --2- 172.21.15.82:0/4114705276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e281966b0 0x7f2e28196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:54:48.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 >> 172.21.15.82:0/4114705276 conn(0x7f2e28074230 msgr2=0x7f2e281066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:54:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 shutdown_connections 2023-03-17T07:54:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:54:14.959+0000 7f2e2d193700 1 -- 172.21.15.82:0/4114705276 wait complete. 2023-03-17T07:54:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 3 2023-03-17T07:54:48.567 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-03-17T07:54:48.568 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph config generate-minimal-conf 2023-03-17T07:54:50.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:46 smithi035 ceph-mon[92535]: pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:50.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:48 smithi035 ceph-mon[92535]: pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:50.660 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:46 smithi078 ceph-mon[94114]: pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:50.660 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:48 smithi078 ceph-mon[94114]: pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:50.661 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:15 smithi082 ceph-mon[94281]: pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:52.357 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:15 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/4114705276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-03-17T07:54:53.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:53.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:54.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:54.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:54.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:54.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:55.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:56.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:56.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:56.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:56.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:56.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:56.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:56.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: Reconfiguring mon.a (unknown last config time)... 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: Reconfiguring daemon mon.a on smithi035 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:58.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: Reconfiguring mon.b (monmap changed)... 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: Reconfiguring daemon mon.b on smithi078 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: Reconfiguring mon.c (monmap changed)... 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: Reconfiguring daemon mon.c on smithi082 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:54:58.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:22 smithi082 ceph-mon[94281]: pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:24 smithi082 ceph-mon[94281]: pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:26 smithi082 ceph-mon[94281]: pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:28 smithi082 ceph-mon[94281]: pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:30 smithi082 ceph-mon[94281]: pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:32 smithi082 ceph-mon[94281]: pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:34 smithi082 ceph-mon[94281]: pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:36 smithi082 ceph-mon[94281]: pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:38 smithi082 ceph-mon[94281]: pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:58.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:40 smithi082 ceph-mon[94281]: pgmap v232: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:59.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:42 smithi082 ceph-mon[94281]: pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:59.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:44 smithi082 ceph-mon[94281]: pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:59.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:46 smithi082 ceph-mon[94281]: pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:59.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:48 smithi082 ceph-mon[94281]: pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:59.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:50 smithi082 ceph-mon[94281]: pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:54:59.698 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:50 smithi035 ceph-mon[92535]: pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:00.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:52 smithi082 ceph-mon[94281]: pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3798116892' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:02.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:54 smithi082 ceph-mon[94281]: pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:56 smithi082 ceph-mon[94281]: pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:54:58 smithi082 ceph-mon[94281]: pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:00 smithi082 ceph-mon[94281]: pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:50 smithi078 ceph-mon[94114]: pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:52 smithi078 ceph-mon[94114]: pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3798116892' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:54 smithi078 ceph-mon[94114]: pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:56 smithi078 ceph-mon[94114]: pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:54:58 smithi078 ceph-mon[94114]: pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:00 smithi078 ceph-mon[94114]: pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:01 smithi078 ceph-mon[94114]: pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:01 smithi082 ceph-mon[94281]: pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:02.140 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:55:03.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 -- 172.21.15.35:0/2188782005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac104490 msgr2=0x7f19ac10c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:03.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 --2- 172.21.15.35:0/2188782005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac104490 0x7f19ac10c010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19a400b0d0 tx=0x7f19a400b3e0 comp rx=0 tx=0).stop 2023-03-17T07:55:03.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 -- 172.21.15.35:0/2188782005 shutdown_connections 2023-03-17T07:55:03.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 --2- 172.21.15.35:0/2188782005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac104490 0x7f19ac10c010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 --2- 172.21.15.35:0/2188782005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 --2- 172.21.15.35:0/2188782005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19ac0ffd90 0x7f19ac103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 -- 172.21.15.35:0/2188782005 >> 172.21.15.35:0/2188782005 conn(0x7f19ac077030 msgr2=0x7f19ac077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 -- 172.21.15.35:0/2188782005 shutdown_connections 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 -- 172.21.15.35:0/2188782005 wait complete. 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.504+0000 7f19b20af700 1 Processor -- start 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 -- start start 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac195080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19ac0ffd90 0x7f19ac1955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19ac104490 0x7f19ac195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1a48c0 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1a4a30 con 0x7f19ac0ffd90 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19b20af700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1a4bf0 con 0x7f19ac104490 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac195080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:03.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac195080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39260/0 (socket says 172.21.15.35:39260) 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 -- 172.21.15.35:0/3798116892 learned_addr learned my addr 172.21.15.35:0/3798116892 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19abfff700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19ac104490 0x7f19ac195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19aaffd700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19ac0ffd90 0x7f19ac1955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 -- 172.21.15.35:0/3798116892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19ac104490 msgr2=0x7f19ac195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19ac104490 0x7f19ac195b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 -- 172.21.15.35:0/3798116892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19ac0ffd90 msgr2=0x7f19ac1955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19ac0ffd90 0x7f19ac1955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 -- 172.21.15.35:0/3798116892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4009d00 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.505+0000 7f19ab7fe700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac195080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f199c00d950 tx=0x7f199c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.506+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00f890 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.506+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f199c00fe80 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.506+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac10f110 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.506+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00e3b0 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.506+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac10ef80 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.506+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7f199c00e510 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.507+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac10f2a0 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.507+0000 7f19a8ff9700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1994038060 0x7f199403a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.507+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f199c04a430 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.507+0000 7f19aaffd700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1994038060 0x7f199403a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.507+0000 7f19aaffd700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1994038060 0x7f199403a510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19ac068ea0 tx=0x7f19a0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:55:03.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.512+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f199c0228f0 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:52 smithi035 ceph-mon[92535]: pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:03.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.711+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f19ac066e30 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.712+0000 7f19a8ff9700 1 -- 172.21.15.35:0/3798116892 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7f199c022300 con 0x7f19ac0ff3f0 2023-03-17T07:55:03.930 INFO:teuthology.orchestra.run.smithi035.stdout:# minimal ceph.conf for 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:55:03.931 INFO:teuthology.orchestra.run.smithi035.stdout:[global] 2023-03-17T07:55:03.931 INFO:teuthology.orchestra.run.smithi035.stdout: fsid = 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T07:55:03.931 INFO:teuthology.orchestra.run.smithi035.stdout: mon_host = [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2023-03-17T07:55:03.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:03 smithi078 ceph-mon[94114]: pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:05.949 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:03 smithi082 ceph-mon[94281]: pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:05.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1994038060 msgr2=0x7f199403a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:05.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1994038060 0x7f199403a510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19ac068ea0 tx=0x7f19a0009190 comp rx=0 tx=0).stop 2023-03-17T07:55:05.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 msgr2=0x7f19ac195080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:05.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac195080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f199c00d950 tx=0x7f199c00dc60 comp rx=0 tx=0).stop 2023-03-17T07:55:05.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 shutdown_connections 2023-03-17T07:55:05.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19ac104490 0x7f19ac195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:05.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1994038060 0x7f199403a510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:05.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19ac0ff3f0 0x7f19ac195080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:05.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 --2- 172.21.15.35:0/3798116892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19ac0ffd90 0x7f19ac1955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:05.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 >> 172.21.15.35:0/3798116892 conn(0x7f19ac077030 msgr2=0x7f19ac0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:55:05.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 shutdown_connections 2023-03-17T07:55:05.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:54:52.714+0000 7f19b20af700 1 -- 172.21.15.35:0/3798116892 wait complete. 2023-03-17T07:55:05.953 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-03-17T07:55:07.761 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:55:07.761 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/ceph/ceph.conf 2023-03-17T07:55:07.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3798116892' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:07.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:54 smithi035 ceph-mon[92535]: pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:07.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:56 smithi035 ceph-mon[92535]: pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:08.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:54:58 smithi035 ceph-mon[92535]: pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:08.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:00 smithi035 ceph-mon[92535]: pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:08.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:01 smithi035 ceph-mon[92535]: pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:08.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:03 smithi035 ceph-mon[92535]: pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:08.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:06 smithi035 ceph-mon[92535]: pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:08.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:08 smithi035 ceph-mon[92535]: pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:10.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:06 smithi078 ceph-mon[94114]: pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:10.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:08 smithi078 ceph-mon[94114]: pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:10.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:06 smithi082 ceph-mon[94281]: pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:10.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:08 smithi082 ceph-mon[94281]: pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:10.151 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:55:13.387 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:55:13.389 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:10 smithi078 ceph-mon[94114]: pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:12 smithi078 ceph-mon[94114]: pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:10 smithi082 ceph-mon[94281]: pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:12 smithi082 ceph-mon[94281]: pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:10 smithi035 ceph-mon[92535]: pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:12 smithi035 ceph-mon[92535]: pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.655 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:14 smithi078 ceph-mon[94114]: pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.655 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:14 smithi082 ceph-mon[94281]: pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:14 smithi035 ceph-mon[92535]: pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:15.687 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:55:17.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.conf 2023-03-17T07:55:17.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:16 smithi078 ceph-mon[94114]: pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:17.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:16 smithi082 ceph-mon[94281]: pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:18.515 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:16 smithi035 ceph-mon[92535]: pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:18.516 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:18 smithi082 ceph-mon[94281]: pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:18.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:18 smithi035 ceph-mon[92535]: pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:18.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:18 smithi078 ceph-mon[94114]: pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:18.560 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:55:19.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:55:21.313 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:20 smithi035 ceph-mon[92535]: pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:21.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:20 smithi082 ceph-mon[94281]: pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:22.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:20 smithi078 ceph-mon[94114]: pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:22.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:22.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:23.053 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:23.053 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:23.053 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:23.053 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:23.053 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:23.053 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:23.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:23.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:23.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:23.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:23.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:22 smithi035 ceph-mon[92535]: pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:24.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:22 smithi082 ceph-mon[94281]: pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:24.266 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:22 smithi078 ceph-mon[94114]: pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:25.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:24 smithi035 ceph-mon[92535]: pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:25.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:24 smithi082 ceph-mon[94281]: pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:25.304 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:24 smithi078 ceph-mon[94114]: pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:25.305 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:55:25.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2023-03-17T07:55:25.341 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:55:26.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-03-17T07:55:26.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:26 smithi035 ceph-mon[92535]: pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:27.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:26 smithi078 ceph-mon[94114]: pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:26 smithi082 ceph-mon[94281]: pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:27.591 INFO:tasks.cephadm:Adding mgr.x on smithi035 2023-03-17T07:55:28.988 INFO:tasks.cephadm:Adding mgr.y on smithi078 2023-03-17T07:55:28.988 INFO:tasks.cephadm:Adding mgr.z on smithi082 2023-03-17T07:55:28.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch apply mgr '3;smithi035=x;smithi078=y;smithi082=z' 2023-03-17T07:55:28.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:28 smithi035 ceph-mon[92535]: pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:28.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:28 smithi078 ceph-mon[94114]: pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:28.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:28 smithi082 ceph-mon[94281]: pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:29.632 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T07:55:30.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:30 smithi035 ceph-mon[92535]: pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:33.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:30 smithi078 ceph-mon[94114]: pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:33.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:30 smithi082 ceph-mon[94281]: pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:33.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:33.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi035=x;smithi078=y;smithi082=z", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:55:33.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: Saving service mgr spec with placement smithi035=x;smithi078=y;smithi082=z;count:3 2023-03-17T07:55:33.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:33.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:33.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi035=x;smithi078=y;smithi082=z", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: Saving service mgr spec with placement smithi035=x;smithi078=y;smithi082=z;count:3 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:33.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-17T07:55:33.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:33.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 -- 172.21.15.82:0/1402396427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354100370 msgr2=0x7f13541007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:34.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 --2- 172.21.15.82:0/1402396427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354100370 0x7f13541007c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1344009990 tx=0x7f1344009ca0 comp rx=0 tx=0).stop 2023-03-17T07:55:34.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 -- 172.21.15.82:0/1402396427 shutdown_connections 2023-03-17T07:55:35.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 --2- 172.21.15.82:0/1402396427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100d00 0x7f13541075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:35.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 --2- 172.21.15.82:0/1402396427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13540ff170 0x7f13540ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:35.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 --2- 172.21.15.82:0/1402396427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354100370 0x7f13541007c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:35.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 -- 172.21.15.82:0/1402396427 >> 172.21.15.82:0/1402396427 conn(0x7f13540fa780 msgr2=0x7f13540fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:55:35.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 -- 172.21.15.82:0/1402396427 shutdown_connections 2023-03-17T07:55:35.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 -- 172.21.15.82:0/1402396427 wait complete. 2023-03-17T07:55:35.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.976+0000 7f13595a5700 1 Processor -- start 2023-03-17T07:55:35.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 -- start start 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 0x7f1354069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100370 0x7f135419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1354100d00 0x7f135419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135419d950 con 0x7f1354100370 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135419dac0 con 0x7f1354100d00 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13595a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135419dc80 con 0x7f13540ff170 2023-03-17T07:55:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 0x7f1354069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:36.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 0x7f1354069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52694/0 (socket says 172.21.15.82:52694) 2023-03-17T07:55:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 -- 172.21.15.82:0/3424575812 learned_addr learned my addr 172.21.15.82:0/3424575812 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T07:55:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13527fc700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100370 0x7f135419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 -- 172.21.15.82:0/3424575812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1354100d00 msgr2=0x7f135419d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13537fe700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1354100d00 0x7f135419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1354100d00 0x7f135419d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 -- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100370 msgr2=0x7f135419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100370 0x7f135419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 -- 172.21.15.82:0/3424575812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440095f0 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13527fc700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100370 0x7f135419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f13537fe700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1354100d00 0x7f135419d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.977+0000 7f1352ffd700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 0x7f1354069930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f134800c990 tx=0x7f134800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.978+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348007b00 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.978+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1348007c60 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.978+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135410a970 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.978+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348018660 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.978+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135410a7e0 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.978+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 44721+0+0 (secure 0 0 0) 0x7f13480187c0 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.979+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1354106770 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.979+0000 7f133bfff700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f133c038060 0x7f133c03a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.979+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f134804a580 con 0x7f13540ff170 2023-03-17T07:55:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.979+0000 7f13527fc700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f133c038060 0x7f133c03a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:55:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.979+0000 7f13527fc700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f133c038060 0x7f133c03a510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13440095c0 tx=0x7f1344009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:55:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:30.984+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f134801f770 con 0x7f13540ff170 2023-03-17T07:55:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.181+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi035=x;smithi078=y;smithi082=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f1354061af0 con 0x7f133c038060 2023-03-17T07:55:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.189+0000 7f133bfff700 1 -- 172.21.15.82:0/3424575812 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1354061af0 con 0x7f133c038060 2023-03-17T07:55:38.621 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mgr update... 2023-03-17T07:55:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f133c038060 msgr2=0x7f133c03a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:39.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f133c038060 0x7f133c03a510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13440095c0 tx=0x7f1344009550 comp rx=0 tx=0).stop 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 msgr2=0x7f1354069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 0x7f1354069930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f134800c990 tx=0x7f134800cd50 comp rx=0 tx=0).stop 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 shutdown_connections 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1354100d00 0x7f135419d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13540ff170 0x7f1354069930 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f133c038060 0x7f133c03a510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 --2- 172.21.15.82:0/3424575812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1354100370 0x7f135419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 >> 172.21.15.82:0/3424575812 conn(0x7f13540fa780 msgr2=0x7f13541038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 shutdown_connections 2023-03-17T07:55:39.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T07:55:31.192+0000 7f13595a5700 1 -- 172.21.15.82:0/3424575812 wait complete. 2023-03-17T07:55:39.915 DEBUG:teuthology.orchestra.run.smithi078:mgr.y> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.y.service 2023-03-17T07:55:40.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi035=x;smithi078=y;smithi082=z", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: Saving service mgr spec with placement smithi035=x;smithi078=y;smithi082=z;count:3 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:40.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:40.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:40.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-17T07:55:40.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:41.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:41.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:33 smithi082 ceph-mon[94281]: Deploying daemon mgr.z on smithi082 2023-03-17T07:55:41.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:41.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:41.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:41.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:41.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:35 smithi082 ceph-mon[94281]: Deploying daemon mgr.y on smithi078 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:36 smithi082 ceph-mon[94281]: pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: Reconfiguring mgr.x (unknown last config time)... 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: Reconfiguring daemon mgr.x on smithi035 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:42.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:40 smithi082 ceph-mon[94281]: pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:40 smithi082 ceph-mon[94281]: Standby manager daemon z started 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:40 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:40 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:40 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-17T07:55:42.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:40 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T07:55:42.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:41 smithi082 ceph-mon[94281]: mgrmap e14: x(active, since 8m), standbys: z 2023-03-17T07:55:43.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:41 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-17T07:55:43.314 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:33 smithi035 ceph-mon[92535]: Deploying daemon mgr.z on smithi082 2023-03-17T07:55:45.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-17T07:55:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:46.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:46.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:35 smithi035 ceph-mon[92535]: Deploying daemon mgr.y on smithi078 2023-03-17T07:55:46.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:36 smithi035 ceph-mon[92535]: pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:47.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:48.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:48.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:49.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: Reconfiguring mgr.x (unknown last config time)... 2023-03-17T07:55:49.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: Reconfiguring daemon mgr.x on smithi035 2023-03-17T07:55:49.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:49.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:49.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:40 smithi035 ceph-mon[92535]: pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:40 smithi035 ceph-mon[92535]: Standby manager daemon z started 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:40 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:40 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:40 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:40 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:41 smithi035 ceph-mon[92535]: mgrmap e14: x(active, since 8m), standbys: z 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:41 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-17T07:55:49.225 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:42 smithi035 ceph-mon[92535]: pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:50.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:42 smithi035 ceph-mon[92535]: Standby manager daemon y started 2023-03-17T07:55:50.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:42 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-17T07:55:50.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:42 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T07:55:50.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:42 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-17T07:55:50.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:42 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T07:55:51.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:33 smithi078 ceph-mon[94114]: Deploying daemon mgr.z on smithi082 2023-03-17T07:55:51.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:51.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:51.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:51.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:51.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-03-17T07:55:51.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:51.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:51.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:35 smithi078 ceph-mon[94114]: Deploying daemon mgr.y on smithi078 2023-03-17T07:55:51.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:36 smithi078 ceph-mon[94114]: pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:51.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.762 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.762 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:52.762 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:52.762 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-03-17T07:55:53.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-03-17T07:55:53.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: Reconfiguring mgr.x (unknown last config time)... 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: Reconfiguring daemon mgr.x on smithi035 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:55:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:40 smithi078 ceph-mon[94114]: pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:40 smithi078 ceph-mon[94114]: Standby manager daemon z started 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:40 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:40 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:40 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:40 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/31413160' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:41 smithi078 ceph-mon[94114]: mgrmap e14: x(active, since 8m), standbys: z 2023-03-17T07:55:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:41 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-17T07:55:54.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:42 smithi078 ceph-mon[94114]: pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:42 smithi078 ceph-mon[94114]: Standby manager daemon y started 2023-03-17T07:55:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:42 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-17T07:55:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:42 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T07:55:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:42 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-17T07:55:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:42 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T07:55:55.246 DEBUG:teuthology.orchestra.run.smithi082:mgr.z> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mgr.z.service 2023-03-17T07:55:55.246 INFO:journalctl@ceph.mgr.y.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T07:55:55.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:43 smithi035 ceph-mon[92535]: mgrmap e15: x(active, since 9m), standbys: y, z 2023-03-17T07:55:56.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-17T07:55:56.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:44 smithi035 ceph-mon[92535]: pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:57.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:46 smithi035 ceph-mon[92535]: pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:57.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:48 smithi035 ceph-mon[92535]: pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:57.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:50 smithi035 ceph-mon[92535]: pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:57.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:52 smithi035 ceph-mon[92535]: pgmap v268: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:57.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:53 smithi035 ceph-mon[92535]: pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:57.436 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:42 smithi082 ceph-mon[94281]: pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:42 smithi082 ceph-mon[94281]: Standby manager daemon y started 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:42 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:42 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:42 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:42 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/4125443220' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:43 smithi082 ceph-mon[94281]: mgrmap e15: x(active, since 9m), standbys: y, z 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:44 smithi082 ceph-mon[94281]: pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:46 smithi082 ceph-mon[94281]: pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:48 smithi082 ceph-mon[94281]: pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:50 smithi082 ceph-mon[94281]: pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:52 smithi082 ceph-mon[94281]: pgmap v268: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:53 smithi082 ceph-mon[94281]: pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:56 smithi082 ceph-mon[94281]: pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:56 smithi035 ceph-mon[92535]: pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:43 smithi078 ceph-mon[94114]: mgrmap e15: x(active, since 9m), standbys: y, z 2023-03-17T07:55:59.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-17T07:55:59.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:44 smithi078 ceph-mon[94114]: pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:46 smithi078 ceph-mon[94114]: pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:48 smithi078 ceph-mon[94114]: pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:50 smithi078 ceph-mon[94114]: pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:52 smithi078 ceph-mon[94114]: pgmap v268: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:53 smithi078 ceph-mon[94114]: pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:56 smithi078 ceph-mon[94114]: pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.855 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:55:58 smithi078 ceph-mon[94114]: pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:55:59.855 INFO:tasks.cephadm:Deploying OSDs... 2023-03-17T07:56:00.533 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T07:56:00.533 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/scratch_devs of=/dev/stdout 2023-03-17T07:56:00.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:55:58 smithi035 ceph-mon[92535]: pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:00.534 INFO:journalctl@ceph.mgr.z.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T07:56:01.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:55:58 smithi082 ceph-mon[94281]: pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:02.511 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:00 smithi082 ceph-mon[94281]: pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:02.512 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:02 smithi082 ceph-mon[94281]: pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:02.512 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:00 smithi078 ceph-mon[94114]: pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:03.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:02 smithi078 ceph-mon[94114]: pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:03.830 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:00 smithi035 ceph-mon[92535]: pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:03.830 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:02 smithi035 ceph-mon[92535]: pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:03.832 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-17T07:56:05.309 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_1 2023-03-17T07:56:05.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:04 smithi078 ceph-mon[94114]: pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:05.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:04 smithi082 ceph-mon[94281]: pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:05.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:04 smithi035 ceph-mon[92535]: pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:05.331 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 362732 Links: 1 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-03-17 07:46:53.269724709 +0000 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-03-17 07:37:18.253954859 +0000 2023-03-17T07:56:07.665 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-03-17 07:37:18.253954859 +0000 2023-03-17T07:56:08.870 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-03-17T07:56:08.870 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-17T07:56:08.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:06 smithi078 ceph-mon[94114]: pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:10.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:08 smithi078 ceph-mon[94114]: pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:10.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:06 smithi082 ceph-mon[94281]: pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:10.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:08 smithi082 ceph-mon[94281]: pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:10.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:06 smithi035 ceph-mon[92535]: pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:10.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:08 smithi035 ceph-mon[92535]: pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:12.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:10 smithi078 ceph-mon[94114]: pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:12.125 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:10 smithi082 ceph-mon[94281]: pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:12.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:10 smithi035 ceph-mon[92535]: pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:12.161 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-03-17T07:56:14.529 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-03-17T07:56:14.530 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000252569 s, 2.0 MB/s 2023-03-17T07:56:14.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:12 smithi078 ceph-mon[94114]: pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:16.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:14 smithi078 ceph-mon[94114]: pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:16.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:12 smithi082 ceph-mon[94281]: pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:16.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:14 smithi082 ceph-mon[94281]: pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:16.298 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-17T07:56:16.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:12 smithi035 ceph-mon[92535]: pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:16.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:14 smithi035 ceph-mon[92535]: pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:16.361 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_2 2023-03-17T07:56:17.119 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:16 smithi078 ceph-mon[94114]: pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:19.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:16 smithi082 ceph-mon[94281]: pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:19.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:16 smithi035 ceph-mon[92535]: pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:19.780 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:18 smithi078 ceph-mon[94114]: pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:19.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:18 smithi082 ceph-mon[94281]: pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:19.780 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:18 smithi035 ceph-mon[92535]: pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:19.801 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-17T07:56:22.258 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:56:22.258 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 360941 Links: 1 2023-03-17T07:56:22.258 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:56:22.258 INFO:teuthology.orchestra.run.smithi035.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:56:22.259 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-03-17 07:46:53.269724709 +0000 2023-03-17T07:56:22.259 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-03-17 07:37:18.752944587 +0000 2023-03-17T07:56:22.259 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-03-17 07:37:18.752944587 +0000 2023-03-17T07:56:22.259 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-03-17T07:56:22.259 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-17T07:56:22.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:20 smithi078 ceph-mon[94114]: pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:22.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:20 smithi082 ceph-mon[94281]: pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:22.260 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:20 smithi035 ceph-mon[92535]: pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:23.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:22 smithi078 ceph-mon[94114]: pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:24.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:22 smithi082 ceph-mon[94281]: pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:24.804 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:22 smithi035 ceph-mon[92535]: pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:24.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:24 smithi078 ceph-mon[94114]: pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:26.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:24 smithi082 ceph-mon[94281]: pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:26.759 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-03-17T07:56:29.239 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-03-17T07:56:29.240 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000247693 s, 2.1 MB/s 2023-03-17T07:56:29.240 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-17T07:56:29.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:24 smithi035 ceph-mon[92535]: pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:26 smithi035 ceph-mon[92535]: pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:28 smithi035 ceph-mon[92535]: pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:26 smithi078 ceph-mon[94114]: pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:28 smithi078 ceph-mon[94114]: pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:26 smithi082 ceph-mon[94281]: pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:28 smithi082 ceph-mon[94281]: pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:29.263 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_3 2023-03-17T07:56:30.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:30 smithi082 ceph-mon[94281]: pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:31.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:30 smithi078 ceph-mon[94114]: pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:31.545 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-17T07:56:31.545 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:56:31.545 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 365615 Links: 1 2023-03-17T07:56:31.546 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:56:31.546 INFO:teuthology.orchestra.run.smithi035.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:56:31.546 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-03-17 07:46:53.269724709 +0000 2023-03-17T07:56:31.546 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-03-17 07:37:19.283933658 +0000 2023-03-17T07:56:31.546 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-03-17 07:37:19.283933658 +0000 2023-03-17T07:56:31.546 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-03-17T07:56:31.547 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-17T07:56:31.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:30 smithi035 ceph-mon[92535]: pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:32.713 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:32 smithi082 ceph-mon[94281]: pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:32.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:32 smithi078 ceph-mon[94114]: pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:33.562 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:32 smithi035 ceph-mon[92535]: pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:33.563 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-03-17T07:56:33.563 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-03-17T07:56:33.563 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000280166 s, 1.8 MB/s 2023-03-17T07:56:33.564 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-17T07:56:35.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:34 smithi078 ceph-mon[94114]: pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:35.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:34 smithi082 ceph-mon[94281]: pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:35.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:34 smithi035 ceph-mon[92535]: pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:35.417 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_4 2023-03-17T07:56:36.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:36 smithi078 ceph-mon[94114]: pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:38.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:36 smithi082 ceph-mon[94281]: pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:38.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:36 smithi035 ceph-mon[92535]: pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:38.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:38 smithi078 ceph-mon[94114]: pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:38.732 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:38 smithi082 ceph-mon[94281]: pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:38.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:38 smithi035 ceph-mon[92535]: pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:38.749 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-17T07:56:40.055 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 367637 Links: 1 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-03-17 07:46:53.269724709 +0000 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-03-17 07:37:19.787923284 +0000 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-03-17 07:37:19.787923284 +0000 2023-03-17T07:56:40.056 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-03-17T07:56:40.056 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-17T07:56:40.058 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:56:40.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:56:40.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:56:40.084 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-03-17T07:56:40.693 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-03-17T07:56:40.693 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000215417 s, 2.4 MB/s 2023-03-17T07:56:40.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:40 smithi082 ceph-mon[94281]: pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:42.121 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:40 smithi078 ceph-mon[94114]: pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:42.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:56:43.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:56:43.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:43.118 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-17T07:56:43.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:40 smithi035 ceph-mon[92535]: pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:43.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:43.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:43.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:56:43.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:56:43.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:56:43.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:42 smithi035 ceph-mon[92535]: pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:44.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:42 smithi082 ceph-mon[94281]: pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:44.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:44 smithi035 ceph-mon[92535]: pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:44.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:42 smithi078 ceph-mon[94114]: pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:44.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:44 smithi078 ceph-mon[94114]: pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:44.628 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-03-17T07:56:45.926 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-03-17T07:56:45.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:44 smithi082 ceph-mon[94281]: pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:45.947 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-17T07:56:46.900 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-03-17T07:56:46.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:46 smithi082 ceph-mon[94281]: pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:46.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:46 smithi035 ceph-mon[92535]: pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:46.902 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:46 smithi078 ceph-mon[94114]: pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:46.923 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-17T07:56:48.253 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:56:48.253 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 361592 Links: 1 2023-03-17T07:56:48.253 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:56:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:56:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-03-17 07:55:34.790626108 +0000 2023-03-17T07:56:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-03-17 07:37:10.962178746 +0000 2023-03-17T07:56:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-03-17 07:37:10.962178746 +0000 2023-03-17T07:56:48.254 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-03-17T07:56:48.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-17T07:56:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-03-17T07:56:51.871 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-03-17T07:56:51.872 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000298298 s, 1.7 MB/s 2023-03-17T07:56:51.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:48 smithi082 ceph-mon[94281]: pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:51.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:50 smithi082 ceph-mon[94281]: pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:52.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:48 smithi035 ceph-mon[92535]: pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:52.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:50 smithi035 ceph-mon[92535]: pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.778 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-17T07:56:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:48 smithi078 ceph-mon[94114]: pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:50 smithi078 ceph-mon[94114]: pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:52 smithi078 ceph-mon[94114]: pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:54 smithi078 ceph-mon[94114]: pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:52 smithi082 ceph-mon[94281]: pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:54 smithi082 ceph-mon[94281]: pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.780 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:52 smithi035 ceph-mon[92535]: pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.780 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:54 smithi035 ceph-mon[92535]: pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:54.840 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-03-17T07:56:56.276 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 361624 Links: 1 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-03-17 07:55:34.790626108 +0000 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-03-17 07:37:11.453170006 +0000 2023-03-17T07:56:57.464 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-03-17 07:37:11.453170006 +0000 2023-03-17T07:56:57.899 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-03-17T07:56:57.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-17T07:56:57.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:56 smithi082 ceph-mon[94281]: pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:59.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:56 smithi035 ceph-mon[92535]: pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:59.152 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:56 smithi078 ceph-mon[94114]: pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:56:59.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:56:58 smithi082 ceph-mon[94281]: pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:00.126 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:56:58 smithi035 ceph-mon[92535]: pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:00.126 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:56:58 smithi078 ceph-mon[94114]: pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:00.128 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-03-17T07:57:00.128 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-03-17T07:57:00.128 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000262237 s, 2.0 MB/s 2023-03-17T07:57:00.129 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-17T07:57:00.189 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-03-17T07:57:00.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:00 smithi082 ceph-mon[94281]: pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:01.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:00 smithi035 ceph-mon[92535]: pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:01.744 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:00 smithi078 ceph-mon[94114]: pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:01.764 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-17T07:57:03.246 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:57:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 365669 Links: 1 2023-03-17T07:57:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:57:03.246 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:57:03.247 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-03-17 07:55:34.790626108 +0000 2023-03-17T07:57:03.247 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-03-17 07:37:11.956161052 +0000 2023-03-17T07:57:03.247 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-03-17 07:37:11.956161052 +0000 2023-03-17T07:57:03.247 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-03-17T07:57:03.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-17T07:57:03.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:02 smithi082 ceph-mon[94281]: pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:04.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:02 smithi035 ceph-mon[92535]: pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:04.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:02 smithi078 ceph-mon[94114]: pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:04.305 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-03-17T07:57:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-03-17T07:57:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000246059 s, 2.1 MB/s 2023-03-17T07:57:05.122 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:04 smithi082 ceph-mon[94281]: pgmap v304: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:06.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:04 smithi035 ceph-mon[92535]: pgmap v304: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:06.202 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-17T07:57:07.652 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:04 smithi078 ceph-mon[94114]: pgmap v304: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:08.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:06 smithi082 ceph-mon[94281]: pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:08.565 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:06 smithi035 ceph-mon[92535]: pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:08.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:06 smithi078 ceph-mon[94114]: pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:08.586 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-03-17T07:57:09.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:08 smithi035 ceph-mon[92535]: pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:11.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:08 smithi082 ceph-mon[94281]: pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:11.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:08 smithi078 ceph-mon[94114]: pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:11.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:10 smithi035 ceph-mon[92535]: pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:11.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:10 smithi082 ceph-mon[94281]: pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:11.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:10 smithi078 ceph-mon[94114]: pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:11.847 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-17T07:57:11.847 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:57:11.847 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 367832 Links: 1 2023-03-17T07:57:11.848 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:57:11.848 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:57:11.848 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-03-17 07:55:34.790626108 +0000 2023-03-17T07:57:11.848 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-03-17 07:37:12.482151689 +0000 2023-03-17T07:57:11.848 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-03-17 07:37:12.482151689 +0000 2023-03-17T07:57:11.848 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-03-17T07:57:11.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-17T07:57:11.920 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-03-17T07:57:13.177 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-03-17T07:57:13.177 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00020039 s, 2.6 MB/s 2023-03-17T07:57:13.178 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:12 smithi035 ceph-mon[92535]: pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:13.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:12 smithi082 ceph-mon[94281]: pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:13.726 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-17T07:57:13.727 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:12 smithi078 ceph-mon[94114]: pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:13.789 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-03-17T07:57:14.789 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2023-03-17T07:57:14.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:14 smithi035 ceph-mon[92535]: pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:15.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:14 smithi082 ceph-mon[94281]: pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:15.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:14 smithi078 ceph-mon[94114]: pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:15.336 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-17T07:57:16.284 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2023-03-17T07:57:16.305 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 355063 Links: 1 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-03-17 07:55:32.652753792 +0000 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-03-17 07:37:09.768270833 +0000 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-03-17 07:37:09.768270833 +0000 2023-03-17T07:57:17.340 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-03-17T07:57:18.974 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-17T07:57:18.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:16 smithi035 ceph-mon[92535]: pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:18.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:18 smithi035 ceph-mon[92535]: pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:18.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:16 smithi078 ceph-mon[94114]: pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:18.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:18 smithi078 ceph-mon[94114]: pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:18.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:16 smithi082 ceph-mon[94281]: pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:19.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:18 smithi082 ceph-mon[94281]: pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:19.401 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-03-17T07:57:26.837 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-03-17T07:57:26.837 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000262737 s, 1.9 MB/s 2023-03-17T07:57:26.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:20 smithi035 ceph-mon[92535]: pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:26.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:22 smithi035 ceph-mon[92535]: pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:26.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:24 smithi035 ceph-mon[92535]: pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:26.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:26 smithi035 ceph-mon[92535]: pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:27.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:20 smithi078 ceph-mon[94114]: pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:27.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:22 smithi078 ceph-mon[94114]: pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:27.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:24 smithi078 ceph-mon[94114]: pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:26 smithi078 ceph-mon[94114]: pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.688 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-17T07:57:28.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:20 smithi082 ceph-mon[94281]: pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:22 smithi082 ceph-mon[94281]: pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:24 smithi082 ceph-mon[94281]: pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:26 smithi082 ceph-mon[94281]: pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:28 smithi082 ceph-mon[94281]: pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:28.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:28 smithi078 ceph-mon[94114]: pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:30 smithi082 ceph-mon[94281]: pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:31.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:30 smithi078 ceph-mon[94114]: pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:31.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:28 smithi035 ceph-mon[92535]: pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:32.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:30 smithi035 ceph-mon[92535]: pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:32.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:32 smithi035 ceph-mon[92535]: pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:34.868 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:32 smithi078 ceph-mon[94114]: pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:34.870 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2023-03-17T07:57:34.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:32 smithi082 ceph-mon[94281]: pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:36.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:34 smithi082 ceph-mon[94281]: pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:36.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:34 smithi035 ceph-mon[92535]: pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:37.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:34 smithi078 ceph-mon[94114]: pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:37.191 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:36 smithi035 ceph-mon[92535]: pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:38.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:36 smithi078 ceph-mon[94114]: pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:38.123 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-17T07:57:39.087 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:57:39.088 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 355161 Links: 1 2023-03-17T07:57:39.088 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:57:39.088 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:57:39.088 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-03-17 07:55:32.652753792 +0000 2023-03-17T07:57:39.088 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-03-17 07:37:10.269260819 +0000 2023-03-17T07:57:39.477 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-03-17 07:37:10.269260819 +0000 2023-03-17T07:57:39.477 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-03-17T07:57:39.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-17T07:57:39.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:36 smithi082 ceph-mon[94281]: pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:40.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:38 smithi082 ceph-mon[94281]: pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:41.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:40 smithi082 ceph-mon[94281]: pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:42.276 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:57:42.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:38 smithi035 ceph-mon[92535]: pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:42.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:40 smithi035 ceph-mon[92535]: pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:42.279 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:57:42.279 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:38 smithi078 ceph-mon[94114]: pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:43.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:40 smithi078 ceph-mon[94114]: pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:43.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:57:43.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:46.611 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:46.611 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:46.611 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi035", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:57:46.611 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:57:46.611 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:57:46.612 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:46.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:46.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:46.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:46.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi035", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:57:46.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:57:47.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:57:49.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-03-17T07:57:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-03-17T07:57:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.0002366 s, 2.2 MB/s 2023-03-17T07:57:49.079 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-17T07:57:49.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:50.916 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:50.916 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:50.916 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi035", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:57:50.916 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:57:50.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:57:51.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:57:51.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:44 smithi082 ceph-mon[94281]: pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:51.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:46 smithi082 ceph-mon[94281]: pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:53.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:48 smithi082 ceph-mon[94281]: pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:53.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:50 smithi082 ceph-mon[94281]: pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:53.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:52 smithi082 ceph-mon[94281]: pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:53.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:44 smithi035 ceph-mon[92535]: pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:46 smithi035 ceph-mon[92535]: pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:48 smithi035 ceph-mon[92535]: pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:50 smithi035 ceph-mon[92535]: pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:52 smithi035 ceph-mon[92535]: pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:44 smithi078 ceph-mon[94114]: pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:46 smithi078 ceph-mon[94114]: pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:48 smithi078 ceph-mon[94114]: pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:50 smithi078 ceph-mon[94114]: pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:52 smithi078 ceph-mon[94114]: pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:54 smithi035 ceph-mon[92535]: pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:54 smithi078 ceph-mon[94114]: pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.760 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2023-03-17T07:57:55.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:54 smithi082 ceph-mon[94281]: pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:57:55.821 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-17T07:57:57.687 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:57:58.643 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 361986 Links: 1 2023-03-17T07:57:58.643 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:57:58.643 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:57:58.644 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-03-17 07:55:32.652753792 +0000 2023-03-17T07:57:58.644 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-03-17 07:37:10.758251044 +0000 2023-03-17T07:57:58.644 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-03-17 07:37:10.758251044 +0000 2023-03-17T07:57:58.644 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-03-17T07:57:58.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-17T07:57:58.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:56 smithi035 ceph-mon[92535]: pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:00.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:57:58 smithi035 ceph-mon[92535]: pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:00.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:56 smithi078 ceph-mon[94114]: pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:00.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:57:58 smithi078 ceph-mon[94114]: pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:00.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:56 smithi082 ceph-mon[94281]: pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:00.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:57:58 smithi082 ceph-mon[94281]: pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:00.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:00 smithi082 ceph-mon[94281]: pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:01.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:00 smithi035 ceph-mon[92535]: pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:01.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:00 smithi078 ceph-mon[94114]: pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:01.289 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-03-17T07:58:01.289 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-03-17T07:58:01.289 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000266647 s, 1.9 MB/s 2023-03-17T07:58:01.289 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-17T07:58:02.046 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2023-03-17T07:58:03.259 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:02 smithi035 ceph-mon[92535]: pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:03.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:02 smithi078 ceph-mon[94114]: pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:03.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:02 smithi082 ceph-mon[94281]: pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:03.280 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-17T07:58:05.023 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-17T07:58:05.023 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 359666 Links: 1 2023-03-17T07:58:05.024 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T07:58:05.024 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2023-03-17T07:58:05.024 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-03-17 07:55:32.652753792 +0000 2023-03-17T07:58:05.402 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-03-17 07:37:11.242241369 +0000 2023-03-17T07:58:05.402 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-03-17 07:37:11.242241369 +0000 2023-03-17T07:58:05.402 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2023-03-17T07:58:05.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-17T07:58:05.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:04 smithi035 ceph-mon[92535]: pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:06.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:04 smithi078 ceph-mon[94114]: pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:06.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:04 smithi082 ceph-mon[94281]: pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:07.174 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:06 smithi035 ceph-mon[92535]: pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:07.174 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:06 smithi078 ceph-mon[94114]: pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:07.174 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:06 smithi082 ceph-mon[94281]: pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:07.204 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-03-17T07:58:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-03-17T07:58:09.969 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000196971 s, 2.6 MB/s 2023-03-17T07:58:09.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:08 smithi035 ceph-mon[92535]: pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:09.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:08 smithi078 ceph-mon[94114]: pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:09.971 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-17T07:58:09.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:08 smithi082 ceph-mon[94281]: pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:10.033 INFO:tasks.cephadm:Deploying osd.0 on smithi035 with /dev/vg_nvme/lv_4... 2023-03-17T07:58:11.097 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-03-17T07:58:11.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:10 smithi035 ceph-mon[92535]: pgmap v337: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:11.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:10 smithi078 ceph-mon[94114]: pgmap v337: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:11.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:10 smithi082 ceph-mon[94281]: pgmap v337: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:11.774 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:58:15.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:12 smithi035 ceph-mon[92535]: pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:17.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:12 smithi078 ceph-mon[94114]: pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:17.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:14 smithi078 ceph-mon[94114]: pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:17.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:12 smithi082 ceph-mon[94281]: pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:18.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:14 smithi082 ceph-mon[94281]: pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:18.249 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-03-17T07:58:18.249 INFO:teuthology.orchestra.run.smithi035.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-03-17T07:58:18.249 INFO:teuthology.orchestra.run.smithi035.stderr: stderr: 10+0 records in 2023-03-17T07:58:18.249 INFO:teuthology.orchestra.run.smithi035.stderr:10+0 records out 2023-03-17T07:58:18.249 INFO:teuthology.orchestra.run.smithi035.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112567 s, 932 MB/s 2023-03-17T07:58:18.249 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping successful for: 2023-03-17T07:58:18.250 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi035:vg_nvme/lv_4 2023-03-17T07:58:18.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:14 smithi035 ceph-mon[92535]: pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:19.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:16 smithi035 ceph-mon[92535]: pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:18 smithi035 ceph-mon[92535]: pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:20 smithi035 ceph-mon[92535]: pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:16 smithi078 ceph-mon[94114]: pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:18 smithi078 ceph-mon[94114]: pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:20 smithi078 ceph-mon[94114]: pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:16 smithi082 ceph-mon[94281]: pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:18 smithi082 ceph-mon[94281]: pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:20 smithi082 ceph-mon[94281]: pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:21.769 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T07:58:22.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:22 smithi078 ceph-mon[94114]: pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:23.833 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:22 smithi082 ceph-mon[94281]: pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:23.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:22 smithi035 ceph-mon[92535]: pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:23.836 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 -- 172.21.15.35:0/2414579557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9438100720 msgr2=0x7f9438100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:58:24.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 --2- 172.21.15.35:0/2414579557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9438100720 0x7f9438100b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f942c009990 tx=0x7f942c009ca0 comp rx=0 tx=0).stop 2023-03-17T07:58:24.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 -- 172.21.15.35:0/2414579557 shutdown_connections 2023-03-17T07:58:24.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 --2- 172.21.15.35:0/2414579557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 0x7f94381075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:24.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 --2- 172.21.15.35:0/2414579557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9438100720 0x7f9438100b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:25.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 --2- 172.21.15.35:0/2414579557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94380ff380 0x7f94380ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:25.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 -- 172.21.15.35:0/2414579557 >> 172.21.15.35:0/2414579557 conn(0x7f94380f9f00 msgr2=0x7f94380fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:58:25.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 -- 172.21.15.35:0/2414579557 shutdown_connections 2023-03-17T07:58:25.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.145+0000 7f943d517700 1 -- 172.21.15.35:0/2414579557 wait complete. 2023-03-17T07:58:25.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 Processor -- start 2023-03-17T07:58:25.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 -- start start 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 0x7f9438195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 0x7f9438196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9438100720 0x7f943819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943819dad0 con 0x7f94380ff380 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943819dc10 con 0x7f9438100720 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f943d517700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943819dda0 con 0x7f94380ffd30 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 0x7f9438195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:58:25.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 0x7f9438195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39274/0 (socket says 172.21.15.35:39274) 2023-03-17T07:58:25.760 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 -- 172.21.15.35:0/3433598001 learned_addr learned my addr 172.21.15.35:0/3433598001 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T07:58:28.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f94377fe700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9438100720 0x7f943819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:58:28.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f94367fc700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 0x7f9438196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:58:28.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 -- 172.21.15.35:0/3433598001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 msgr2=0x7f9438196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:58:28.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 0x7f9438196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:28.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 -- 172.21.15.35:0/3433598001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9438100720 msgr2=0x7f943819d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:58:29.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9438100720 0x7f943819d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:29.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f9436ffd700 1 -- 172.21.15.35:0/3433598001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0095f0 con 0x7f94380ff380 2023-03-17T07:58:29.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f94377fe700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9438100720 0x7f943819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T07:58:29.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.146+0000 7f94367fc700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 0x7f9438196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T07:58:29.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.147+0000 7f9436ffd700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 0x7f9438195f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f942c000c00 tx=0x7f942c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.147+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c01d070 con 0x7f94380ff380 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.147+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943810a9c0 con 0x7f94380ff380 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.147+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f942c004040 con 0x7f94380ff380 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.147+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c022e00 con 0x7f94380ff380 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.147+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943810a830 con 0x7f94380ff380 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.148+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94381072f0 con 0x7f94380ff380 2023-03-17T07:58:29.829 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.149+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 15) v1 ==== 133205+0+0 (secure 0 0 0) 0x7f942c003bb0 con 0x7f94380ff380 2023-03-17T07:58:29.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.149+0000 7f941ffff700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f942009f440 0x7f94200a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:58:29.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.150+0000 7f94367fc700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f942009f440 0x7f94200a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:58:29.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.150+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f942c0c9a30 con 0x7f94380ff380 2023-03-17T07:58:29.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.150+0000 7f94367fc700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f942009f440 0x7f94200a18f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9428005950 tx=0x7f94280058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:58:29.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.154+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f942c095880 con 0x7f94380ff380 2023-03-17T07:58:29.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:23.359+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9438061b70 con 0x7f942009f440 2023-03-17T07:58:29.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:24 smithi078 ceph-mon[94114]: pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:31.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T07:58:31.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:25 smithi078 ceph-mon[94114]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:26 smithi078 ceph-mon[94114]: pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:26 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3249950560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "747adca4-1ffd-4d6f-959f-8f2cc8b71782"}]: dispatch 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:26 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3249950560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "747adca4-1ffd-4d6f-959f-8f2cc8b71782"}]': finished 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:26 smithi078 ceph-mon[94114]: osdmap e5: 1 total, 0 up, 1 in 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:27 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2072289706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:28 smithi078 ceph-mon[94114]: pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:31.491 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:24 smithi082 ceph-mon[94281]: pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:32.863 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:25 smithi082 ceph-mon[94281]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:26 smithi082 ceph-mon[94281]: pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:26 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3249950560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "747adca4-1ffd-4d6f-959f-8f2cc8b71782"}]: dispatch 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:26 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3249950560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "747adca4-1ffd-4d6f-959f-8f2cc8b71782"}]': finished 2023-03-17T07:58:35.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:26 smithi082 ceph-mon[94281]: osdmap e5: 1 total, 0 up, 1 in 2023-03-17T07:58:37.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:37.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:27 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2072289706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T07:58:37.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:28 smithi082 ceph-mon[94281]: pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:24 smithi035 ceph-mon[92535]: pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:25 smithi035 ceph-mon[92535]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:26 smithi035 ceph-mon[92535]: pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:38.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:26 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3249950560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "747adca4-1ffd-4d6f-959f-8f2cc8b71782"}]: dispatch 2023-03-17T07:58:38.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:26 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3249950560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "747adca4-1ffd-4d6f-959f-8f2cc8b71782"}]': finished 2023-03-17T07:58:38.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:26 smithi035 ceph-mon[92535]: osdmap e5: 1 total, 0 up, 1 in 2023-03-17T07:58:38.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:38.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:27 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2072289706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T07:58:38.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:28 smithi035 ceph-mon[92535]: pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:38.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:30 smithi078 ceph-mon[94114]: pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:32 smithi078 ceph-mon[94114]: pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:34 smithi078 ceph-mon[94114]: pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:34 smithi078 ceph-mon[94114]: Deploying daemon osd.0 on smithi035 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:36 smithi078 ceph-mon[94114]: pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:30 smithi082 ceph-mon[94281]: pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:32 smithi082 ceph-mon[94281]: pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:40.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:34 smithi082 ceph-mon[94281]: pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:34 smithi082 ceph-mon[94281]: Deploying daemon osd.0 on smithi035 2023-03-17T07:58:40.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:36 smithi082 ceph-mon[94281]: pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:30 smithi035 ceph-mon[92535]: pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:32 smithi035 ceph-mon[92535]: pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:40.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-03-17T07:58:41.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:41.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:34 smithi035 ceph-mon[92535]: pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:41.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:34 smithi035 ceph-mon[92535]: Deploying daemon osd.0 on smithi035 2023-03-17T07:58:41.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:36 smithi035 ceph-mon[92535]: pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:41.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:38 smithi078 ceph-mon[94114]: pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:41.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:41.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:41.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:58:41.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:40 smithi078 ceph-mon[94114]: pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:38 smithi082 ceph-mon[94281]: pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:43.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:58:44.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:40 smithi082 ceph-mon[94281]: pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:44.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:44.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:44.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:44.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:58:44.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:44.469 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:38 smithi035 ceph-mon[92535]: pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:45.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:45.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:45.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:58:45.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:40 smithi035 ceph-mon[92535]: pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:45.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:45.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:45.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:45.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:58:45.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:45.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.823+0000 7f941ffff700 1 -- 172.21.15.35:0/3433598001 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9438061b70 con 0x7f942009f440 2023-03-17T07:58:45.735 INFO:teuthology.orchestra.run.smithi035.stdout:Created osd(s) 0 on host 'smithi035' 2023-03-17T07:58:45.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f942009f440 msgr2=0x7f94200a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f942009f440 0x7f94200a18f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9428005950 tx=0x7f94280058e0 comp rx=0 tx=0).stop 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 msgr2=0x7f9438195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 0x7f9438195f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f942c000c00 tx=0x7f942c009ee0 comp rx=0 tx=0).stop 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 shutdown_connections 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9438100720 0x7f943819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f942009f440 0x7f94200a18f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94380ff380 0x7f9438195f40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:48.053 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 --2- 172.21.15.35:0/3433598001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94380ffd30 0x7f9438196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:58:48.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 >> 172.21.15.35:0/3433598001 conn(0x7f94380f9f00 msgr2=0x7f94380fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:58:48.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.825+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 shutdown_connections 2023-03-17T07:58:48.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T07:58:40.826+0000 7f943d517700 1 -- 172.21.15.35:0/3433598001 wait complete. 2023-03-17T07:58:48.055 DEBUG:teuthology.orchestra.run.smithi035:osd.0> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.0.service 2023-03-17T07:58:48.878 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:41 smithi035 ceph-mon[92535]: pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:41 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:41 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:41 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:41 smithi035 ceph-mon[92535]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:43 smithi035 ceph-mon[92535]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:43 smithi035 ceph-mon[92535]: osdmap e6: 1 total, 0 up, 1 in 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:43 smithi035 ceph-mon[92535]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T07:58:50.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: osdmap e7: 1 total, 0 up, 1 in 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:44 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi035 2023-03-17T07:58:50.195 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 17173M 2023-03-17T07:58:51.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:51.842 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] boot 2023-03-17T07:58:51.842 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: osdmap e8: 1 total, 1 up, 1 in 2023-03-17T07:58:51.842 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:51.842 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:46 smithi035 ceph-mon[92535]: pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:51.842 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:46 smithi035 ceph-mon[92535]: osdmap e9: 1 total, 1 up, 1 in 2023-03-17T07:58:51.842 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:48 smithi035 ceph-mon[92535]: pgmap v361: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:58:51.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:41 smithi078 ceph-mon[94114]: pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:51.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:41 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:51.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:41 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:51.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:41 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:58:51.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:41 smithi078 ceph-mon[94114]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-03-17T07:58:51.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:43 smithi078 ceph-mon[94114]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-03-17T07:58:52.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:43 smithi078 ceph-mon[94114]: osdmap e6: 1 total, 0 up, 1 in 2023-03-17T07:58:52.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:52.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:43 smithi078 ceph-mon[94114]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T07:58:52.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:52.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T07:58:52.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: osdmap e7: 1 total, 0 up, 1 in 2023-03-17T07:58:52.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:52.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:52.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:52.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:52.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:58:54.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:54.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:44 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi035 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 17173M 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] boot 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: osdmap e8: 1 total, 1 up, 1 in 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:46 smithi078 ceph-mon[94114]: pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:46 smithi078 ceph-mon[94114]: osdmap e9: 1 total, 1 up, 1 in 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:48 smithi078 ceph-mon[94114]: pgmap v361: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:50 smithi078 ceph-mon[94114]: pgmap v362: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:58:54.687 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:41 smithi082 ceph-mon[94281]: pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:41 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:41 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:41 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:41 smithi082 ceph-mon[94281]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:43 smithi082 ceph-mon[94281]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:43 smithi082 ceph-mon[94281]: osdmap e6: 1 total, 0 up, 1 in 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:43 smithi082 ceph-mon[94281]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: osdmap e7: 1 total, 0 up, 1 in 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:54.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:54.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:55.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:58:56.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:56.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:58:56.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:58:56.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:44 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:58:56.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T07:58:57.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T07:58:57.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi035 2023-03-17T07:58:57.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 17173M 2023-03-17T07:58:57.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: osd.0 [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] boot 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: osdmap e8: 1 total, 1 up, 1 in 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:46 smithi082 ceph-mon[94281]: pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:46 smithi082 ceph-mon[94281]: osdmap e9: 1 total, 1 up, 1 in 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:48 smithi082 ceph-mon[94281]: pgmap v361: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:58:58.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:50 smithi082 ceph-mon[94281]: pgmap v362: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:58:58.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:50 smithi035 ceph-mon[92535]: pgmap v362: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:58:58.826 INFO:tasks.cephadm:Deploying osd.1 on smithi078 with /dev/vg_nvme/lv_4... 2023-03-17T07:59:00.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-03-17T07:59:00.246 INFO:journalctl@ceph.osd.0.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:52 smithi078 ceph-mon[94114]: pgmap v363: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:54 smithi078 ceph-mon[94114]: pgmap v364: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:56 smithi078 ceph-mon[94114]: pgmap v365: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:58:58 smithi078 ceph-mon[94114]: pgmap v366: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:52 smithi082 ceph-mon[94281]: pgmap v363: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:54 smithi082 ceph-mon[94281]: pgmap v364: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:00.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:56 smithi082 ceph-mon[94281]: pgmap v365: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:58:58 smithi082 ceph-mon[94281]: pgmap v366: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:52 smithi035 ceph-mon[92535]: pgmap v363: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:54 smithi035 ceph-mon[92535]: pgmap v364: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:56 smithi035 ceph-mon[92535]: pgmap v365: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:58:58 smithi035 ceph-mon[92535]: pgmap v366: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:00 smithi035 ceph-mon[92535]: pgmap v367: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:01.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:00 smithi082 ceph-mon[94281]: pgmap v367: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:04.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:00 smithi078 ceph-mon[94114]: pgmap v367: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:04.956 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T07:59:04.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:02 smithi078 ceph-mon[94114]: pgmap v368: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:04.956 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-03-17T07:59:04.957 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-03-17T07:59:04.957 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2023-03-17T07:59:04.957 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2023-03-17T07:59:04.957 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111447 s, 941 MB/s 2023-03-17T07:59:08.597 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2023-03-17T07:59:08.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi078:vg_nvme/lv_4 2023-03-17T07:59:08.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:04 smithi078 ceph-mon[94114]: pgmap v369: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:08.598 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:06 smithi078 ceph-mon[94114]: pgmap v370: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:08 smithi078 ceph-mon[94114]: pgmap v371: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:10 smithi078 ceph-mon[94114]: pgmap v372: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:02 smithi035 ceph-mon[92535]: pgmap v368: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:04 smithi035 ceph-mon[92535]: pgmap v369: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:06 smithi035 ceph-mon[92535]: pgmap v370: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:08 smithi035 ceph-mon[92535]: pgmap v371: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:10 smithi035 ceph-mon[92535]: pgmap v372: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:02 smithi082 ceph-mon[94281]: pgmap v368: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:04 smithi082 ceph-mon[94281]: pgmap v369: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:06 smithi082 ceph-mon[94281]: pgmap v370: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:08 smithi082 ceph-mon[94281]: pgmap v371: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:10 smithi082 ceph-mon[94281]: pgmap v372: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:11.878 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T07:59:12.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:12 smithi035 ceph-mon[92535]: pgmap v373: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:14.301 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:12 smithi082 ceph-mon[94281]: pgmap v373: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:14.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:12 smithi078 ceph-mon[94114]: pgmap v373: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:14.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2679937581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100d00 msgr2=0x7f2b201075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:59:14.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2679937581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100d00 0x7f2b201075c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800b0a0 tx=0x7f2b1800b3b0 comp rx=0 tx=0).stop 2023-03-17T07:59:15.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2679937581 shutdown_connections 2023-03-17T07:59:15.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2679937581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100d00 0x7f2b201075c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:15.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2679937581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b200ff170 0x7f2b200ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:15.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2679937581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b20100370 0x7f2b201007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2679937581 >> 172.21.15.78:0/2679937581 conn(0x7f2b200fa780 msgr2=0x7f2b200fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:59:15.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2679937581 shutdown_connections 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.073+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2679937581 wait complete. 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.074+0000 7f2b24b8c700 1 Processor -- start 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.074+0000 7f2b24b8c700 1 -- start start 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b200ff170 0x7f2b20195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 0x7f2b20196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b20100d00 0x7f2b2019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2019db70 con 0x7f2b200ff170 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2019dcb0 con 0x7f2b20100370 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2019de40 con 0x7f2b20100d00 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 0x7f2b20196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 0x7f2b20196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49140/0 (socket says 172.21.15.78:49140) 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 -- 172.21.15.78:0/2190440032 learned_addr learned my addr 172.21.15.78:0/2190440032 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1ed9d700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b20100d00 0x7f2b2019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:59:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1e59c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b200ff170 0x7f2b20195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:59:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 -- 172.21.15.78:0/2190440032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b20100d00 msgr2=0x7f2b2019d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:59:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b20100d00 0x7f2b2019d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 -- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b200ff170 msgr2=0x7f2b20195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:59:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b200ff170 0x7f2b20195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 -- 172.21.15.78:0/2190440032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18009d00 con 0x7f2b20100370 2023-03-17T07:59:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b1dd9b700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 0x7f2b20196520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000d950 tx=0x7f2b1000dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:59:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10009b40 con 0x7f2b20100370 2023-03-17T07:59:19.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b10009ca0 con 0x7f2b20100370 2023-03-17T07:59:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2010a980 con 0x7f2b20100370 2023-03-17T07:59:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10010ea0 con 0x7f2b20100370 2023-03-17T07:59:21.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.075+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2010a7f0 con 0x7f2b20100370 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.076+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2019e520 con 0x7f2b20100370 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.077+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 15) v1 ==== 133205+0+0 (secure 0 0 0) 0x7f2b10010460 con 0x7f2b20100370 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.078+0000 7f2b0f7fe700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b0809f440 0x7f2b080a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.078+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f2b100c8be0 con 0x7f2b20100370 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.078+0000 7f2b1e59c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b0809f440 0x7f2b080a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.079+0000 7f2b1e59c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b0809f440 0x7f2b080a18f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b14005950 tx=0x7f2b140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.082+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mon.2 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f2b100946a0 con 0x7f2b20100370 2023-03-17T07:59:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:13.276+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b20068c70 con 0x7f2b0809f440 2023-03-17T07:59:21.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:14 smithi035 ceph-mon[92535]: pgmap v374: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:22.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T07:59:22.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T07:59:22.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:15 smithi035 ceph-mon[92535]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:16 smithi035 ceph-mon[92535]: pgmap v375: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:16 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/1881484073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]: dispatch 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:16 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]: dispatch 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:16 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]': finished 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:16 smithi035 ceph-mon[92535]: osdmap e10: 2 total, 1 up, 2 in 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:17 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/1142505001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T07:59:22.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:18 smithi035 ceph-mon[92535]: pgmap v377: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:20 smithi035 ceph-mon[92535]: pgmap v378: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:14 smithi082 ceph-mon[94281]: pgmap v374: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:15 smithi082 ceph-mon[94281]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:59:22.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:16 smithi082 ceph-mon[94281]: pgmap v375: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:24.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:16 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/1881484073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]: dispatch 2023-03-17T07:59:24.525 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:16 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]: dispatch 2023-03-17T07:59:24.525 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:16 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]': finished 2023-03-17T07:59:26.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:16 smithi082 ceph-mon[94281]: osdmap e10: 2 total, 1 up, 2 in 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:17 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/1142505001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:18 smithi082 ceph-mon[94281]: pgmap v377: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:20 smithi082 ceph-mon[94281]: pgmap v378: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:14 smithi078 ceph-mon[94114]: pgmap v374: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:15 smithi078 ceph-mon[94114]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:16 smithi078 ceph-mon[94114]: pgmap v375: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:16 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/1881484073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]: dispatch 2023-03-17T07:59:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:16 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]: dispatch 2023-03-17T07:59:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:16 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ec58882-7916-437c-b210-38afc3a391f6"}]': finished 2023-03-17T07:59:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:16 smithi078 ceph-mon[94114]: osdmap e10: 2 total, 1 up, 2 in 2023-03-17T07:59:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:17 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/1142505001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T07:59:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:18 smithi078 ceph-mon[94114]: pgmap v377: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:20 smithi078 ceph-mon[94114]: pgmap v378: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:26.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:22 smithi035 ceph-mon[92535]: pgmap v379: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-03-17T07:59:28.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:28.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:24 smithi035 ceph-mon[92535]: pgmap v380: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:24 smithi035 ceph-mon[92535]: Deploying daemon osd.1 on smithi078 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:22 smithi082 ceph-mon[94281]: pgmap v379: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:24 smithi082 ceph-mon[94281]: pgmap v380: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:24 smithi082 ceph-mon[94281]: Deploying daemon osd.1 on smithi078 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:22 smithi078 ceph-mon[94114]: pgmap v379: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:24 smithi078 ceph-mon[94114]: pgmap v380: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:24 smithi078 ceph-mon[94114]: Deploying daemon osd.1 on smithi078 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:26 smithi035 ceph-mon[92535]: pgmap v381: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:26 smithi078 ceph-mon[94114]: pgmap v381: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:26 smithi082 ceph-mon[94281]: pgmap v381: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:28 smithi082 ceph-mon[94281]: pgmap v382: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:28.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:59:28.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:28 smithi078 ceph-mon[94114]: pgmap v382: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:30.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:30.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:30.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:59:30.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:28 smithi035 ceph-mon[92535]: pgmap v382: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:30.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:30.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:30.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:59:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.964+0000 7f2b0f7fe700 1 -- 172.21.15.78:0/2190440032 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2b20068c70 con 0x7f2b0809f440 2023-03-17T07:59:30.141 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 1 on host 'smithi078' 2023-03-17T07:59:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b0809f440 msgr2=0x7f2b080a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:59:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b0809f440 0x7f2b080a18f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b14005950 tx=0x7f2b140058e0 comp rx=0 tx=0).stop 2023-03-17T07:59:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 msgr2=0x7f2b20196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T07:59:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 0x7f2b20196520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000d950 tx=0x7f2b1000dd10 comp rx=0 tx=0).stop 2023-03-17T07:59:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 shutdown_connections 2023-03-17T07:59:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b20100d00 0x7f2b2019d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b0809f440 0x7f2b080a18f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:32.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b200ff170 0x7f2b20195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:34.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 --2- 172.21.15.78:0/2190440032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b20100370 0x7f2b20196520 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T07:59:34.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.966+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 >> 172.21.15.78:0/2190440032 conn(0x7f2b200fa780 msgr2=0x7f2b20068560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T07:59:34.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.967+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 shutdown_connections 2023-03-17T07:59:34.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T07:59:29.967+0000 7f2b24b8c700 1 -- 172.21.15.78:0/2190440032 wait complete. 2023-03-17T07:59:34.238 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: pgmap v383: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:35.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:35.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:35.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:35.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:59:35.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:35.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:36.029 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:36.030 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:59:36.030 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:31 smithi082 ceph-mon[94281]: from='osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-17T07:59:36.030 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:31 smithi082 ceph-mon[94281]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-17T07:59:36.030 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:32 smithi082 ceph-mon[94281]: pgmap v384: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:36.030 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:32 smithi082 ceph-mon[94281]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-03-17T07:59:36.030 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:32 smithi082 ceph-mon[94281]: osdmap e11: 2 total, 1 up, 2 in 2023-03-17T07:59:36.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:36.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:32 smithi082 ceph-mon[94281]: from='osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T07:59:36.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:32 smithi082 ceph-mon[94281]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T07:59:36.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: osdmap e12: 2 total, 1 up, 2 in 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: pgmap v387: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi078 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:36.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:36.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:59:36.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 17168M 2023-03-17T07:59:36.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:36.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:36.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:59:36.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:37.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: pgmap v383: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:37.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:37.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:37.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:37.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:59:37.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:38.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:31 smithi035 ceph-mon[92535]: from='osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:31 smithi035 ceph-mon[92535]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:32 smithi035 ceph-mon[92535]: pgmap v384: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:32 smithi035 ceph-mon[92535]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:32 smithi035 ceph-mon[92535]: osdmap e11: 2 total, 1 up, 2 in 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:32 smithi035 ceph-mon[92535]: from='osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T07:59:39.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:32 smithi035 ceph-mon[92535]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T07:59:40.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T07:59:40.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: osdmap e12: 2 total, 1 up, 2 in 2023-03-17T07:59:40.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:40.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:40.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: pgmap v387: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:40.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi078 2023-03-17T07:59:40.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:40.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:41.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:59:41.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 17168M 2023-03-17T07:59:41.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:42.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:42.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:59:42.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:42.804 DEBUG:teuthology.orchestra.run.smithi078:osd.1> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.1.service 2023-03-17T07:59:42.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: pgmap v383: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:42.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:42.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:44.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:44.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:59:44.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:45.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:45.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:45.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T07:59:45.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:31 smithi078 ceph-mon[94114]: from='osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-17T07:59:45.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:31 smithi078 ceph-mon[94114]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:32 smithi078 ceph-mon[94114]: pgmap v384: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:32 smithi078 ceph-mon[94114]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:32 smithi078 ceph-mon[94114]: osdmap e11: 2 total, 1 up, 2 in 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:32 smithi078 ceph-mon[94114]: from='osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:32 smithi078 ceph-mon[94114]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: osdmap e12: 2 total, 1 up, 2 in 2023-03-17T07:59:46.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:47.055 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: pgmap v387: 0 pgs: ; 0 B data, 4.9 MiB used, 89 GiB / 89 GiB avail 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi078 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 17168M 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:34 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:34 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T07:59:47.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:34 smithi078 ceph-mon[94114]: osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] boot 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:34 smithi078 ceph-mon[94114]: osdmap e13: 2 total, 2 up, 2 in 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:35 smithi078 ceph-mon[94114]: osdmap e14: 2 total, 2 up, 2 in 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:35 smithi078 ceph-mon[94114]: pgmap v390: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:37 smithi078 ceph-mon[94114]: pgmap v391: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:40 smithi078 ceph-mon[94114]: pgmap v392: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:47.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:42 smithi078 ceph-mon[94114]: pgmap v393: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:47.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:44 smithi078 ceph-mon[94114]: pgmap v394: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:46 smithi078 ceph-mon[94114]: pgmap v395: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.566 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:34 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T07:59:48.566 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:34 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T07:59:48.566 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:34 smithi082 ceph-mon[94281]: osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] boot 2023-03-17T07:59:48.566 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:34 smithi082 ceph-mon[94281]: osdmap e13: 2 total, 2 up, 2 in 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:35 smithi082 ceph-mon[94281]: osdmap e14: 2 total, 2 up, 2 in 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:35 smithi082 ceph-mon[94281]: pgmap v390: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:37 smithi082 ceph-mon[94281]: pgmap v391: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:40 smithi082 ceph-mon[94281]: pgmap v392: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:42 smithi082 ceph-mon[94281]: pgmap v393: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:44 smithi082 ceph-mon[94281]: pgmap v394: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:46 smithi082 ceph-mon[94281]: pgmap v395: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:48 smithi082 ceph-mon[94281]: pgmap v396: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:48.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:34 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T07:59:48.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:34 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T07:59:48.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:34 smithi035 ceph-mon[92535]: osd.1 [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] boot 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:34 smithi035 ceph-mon[92535]: osdmap e13: 2 total, 2 up, 2 in 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:35 smithi035 ceph-mon[92535]: osdmap e14: 2 total, 2 up, 2 in 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:35 smithi035 ceph-mon[92535]: pgmap v390: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:37 smithi035 ceph-mon[92535]: pgmap v391: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:40 smithi035 ceph-mon[92535]: pgmap v392: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:42 smithi035 ceph-mon[92535]: pgmap v393: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:44 smithi035 ceph-mon[92535]: pgmap v394: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:46 smithi035 ceph-mon[92535]: pgmap v395: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:48 smithi035 ceph-mon[92535]: pgmap v396: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:49.474 INFO:tasks.cephadm:Deploying osd.2 on smithi082 with /dev/vg_nvme/lv_4... 2023-03-17T07:59:50.120 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-03-17T07:59:50.121 INFO:journalctl@ceph.osd.1.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T07:59:53.295 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:48 smithi078 ceph-mon[94114]: pgmap v396: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:53.295 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:50 smithi078 ceph-mon[94114]: pgmap v397: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:53.295 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:52 smithi078 ceph-mon[94114]: pgmap v398: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:54.542 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:54 smithi078 ceph-mon[94114]: pgmap v399: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:54.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:50 smithi035 ceph-mon[92535]: pgmap v397: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:55.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:52 smithi035 ceph-mon[92535]: pgmap v398: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:55.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:54 smithi035 ceph-mon[92535]: pgmap v399: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:55.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:50 smithi082 ceph-mon[94281]: pgmap v397: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:55.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:52 smithi082 ceph-mon[94281]: pgmap v398: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:55.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:54 smithi082 ceph-mon[94281]: pgmap v399: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:55.724 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T07:59:56.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:56 smithi082 ceph-mon[94281]: pgmap v400: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:58.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:56 smithi035 ceph-mon[92535]: pgmap v400: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:58.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:56 smithi078 ceph-mon[94114]: pgmap v400: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T07:59:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-03-17T07:59:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-03-17T07:59:58.257 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-03-17T07:59:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-03-17T07:59:58.257 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111936 s, 937 MB/s 2023-03-17T07:59:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-03-17T07:59:58.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2023-03-17T08:00:00.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 07:59:58 smithi035 ceph-mon[92535]: pgmap v401: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:00.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:00 smithi035 ceph-mon[92535]: pgmap v402: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:00.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T08:00:00.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 07:59:58 smithi078 ceph-mon[94114]: pgmap v401: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:00.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:00 smithi078 ceph-mon[94114]: pgmap v402: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:00.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T08:00:00.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 07:59:58 smithi082 ceph-mon[94281]: pgmap v401: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:00.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:00 smithi082 ceph-mon[94281]: pgmap v402: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:00.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T08:00:01.449 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:00:02.494 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:02 smithi035 ceph-mon[92535]: pgmap v403: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:02.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:02 smithi078 ceph-mon[94114]: pgmap v403: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:02.494 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:02 smithi082 ceph-mon[94281]: pgmap v403: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:02.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 -- 172.21.15.82:0/3328471298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100370 msgr2=0x7f54b01007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 --2- 172.21.15.82:0/3328471298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100370 0x7f54b01007c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009990 tx=0x7f54ac009ca0 comp rx=0 tx=0).stop 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 -- 172.21.15.82:0/3328471298 shutdown_connections 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 --2- 172.21.15.82:0/3328471298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54b0100d00 0x7f54b01075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 --2- 172.21.15.82:0/3328471298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54b00ff170 0x7f54b00ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 --2- 172.21.15.82:0/3328471298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100370 0x7f54b01007c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 -- 172.21.15.82:0/3328471298 >> 172.21.15.82:0/3328471298 conn(0x7f54b00fa780 msgr2=0x7f54b00fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 -- 172.21.15.82:0/3328471298 shutdown_connections 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.640+0000 7f54b7671700 1 -- 172.21.15.82:0/3328471298 wait complete. 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 Processor -- start 2023-03-17T08:00:05.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 -- start start 2023-03-17T08:00:06.260 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:00:06.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:00:08.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:08.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:04 smithi035 ceph-mon[92535]: pgmap v404: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:08.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:04 smithi035 ceph-mon[92535]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:00:08.714 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:00:09.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:00:10.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:10.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:04 smithi078 ceph-mon[94114]: pgmap v404: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:10.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:04 smithi078 ceph-mon[94114]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:00:10.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: pgmap v405: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:11.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/550482068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]: dispatch 2023-03-17T08:00:11.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]: dispatch 2023-03-17T08:00:11.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]': finished 2023-03-17T08:00:11.962 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: osdmap e15: 3 total, 2 up, 3 in 2023-03-17T08:00:13.936 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:16.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:06 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/457436581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:00:16.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:08 smithi035 ceph-mon[92535]: pgmap v407: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:16.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: pgmap v405: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:16.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/550482068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]: dispatch 2023-03-17T08:00:16.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]: dispatch 2023-03-17T08:00:16.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]': finished 2023-03-17T08:00:16.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: osdmap e15: 3 total, 2 up, 3 in 2023-03-17T08:00:16.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:16.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:06 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/457436581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:00:16.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:08 smithi078 ceph-mon[94114]: pgmap v407: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54b00ff170 0x7f54b00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:00:17.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54b0100370 0x7f54b019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 0x7f54b019d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b019da30 con 0x7f54b0100370 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b019dba0 con 0x7f54b00ff170 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b7671700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b019dd60 con 0x7f54b0100d00 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 0x7f54b019d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 0x7f54b019d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52730/0 (socket says 172.21.15.82:52730) 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 -- 172.21.15.82:0/2690739464 learned_addr learned my addr 172.21.15.82:0/2690739464 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b4c0c700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54b0100370 0x7f54b019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b540d700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54b00ff170 0x7f54b00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 -- 172.21.15.82:0/2690739464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54b00ff170 msgr2=0x7f54b00690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54b00ff170 0x7f54b00690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 -- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54b0100370 msgr2=0x7f54b019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54b0100370 0x7f54b019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 -- 172.21.15.82:0/2690739464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0095f0 con 0x7f54b0100d00 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.641+0000 7f54b5c0e700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 0x7f54b019d290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f54a8007ee0 tx=0x7f54a800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.642+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8017070 con 0x7f54b0100d00 2023-03-17T08:00:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.642+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54a800f040 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.642+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b010a970 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.642+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8005710 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.642+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b010a7e0 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.642+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b019e360 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.644+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) v1 ==== 133205+0+0 (secure 0 0 0) 0x7f54a8005870 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.644+0000 7f54a67fc700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f549c09f440 0x7f549c0a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.644+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f54a80c8890 con 0x7f54b0100d00 2023-03-17T08:00:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.644+0000 7f54b540d700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f549c09f440 0x7f549c0a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:00:20.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.645+0000 7f54b540d700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f549c09f440 0x7f549c0a18f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54a0005950 tx=0x7f54a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:00:20.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.647+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f54a80941d0 con 0x7f54b0100d00 2023-03-17T08:00:20.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:02.839+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f54b0060ec0 con 0x7f549c09f440 2023-03-17T08:00:20.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:00:21.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:00:21.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:21.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:04 smithi082 ceph-mon[94281]: pgmap v404: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:21.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:04 smithi082 ceph-mon[94281]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:00:22.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: pgmap v405: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:22.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/550482068' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]: dispatch 2023-03-17T08:00:22.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]: dispatch 2023-03-17T08:00:24.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2359345e-1870-4b03-803a-5ab6ae403e78"}]': finished 2023-03-17T08:00:24.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: osdmap e15: 3 total, 2 up, 3 in 2023-03-17T08:00:24.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:24.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:06 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/457436581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:00:24.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:08 smithi082 ceph-mon[94281]: pgmap v407: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:24.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:10 smithi082 ceph-mon[94281]: pgmap v408: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:12 smithi082 ceph-mon[94281]: pgmap v409: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:13 smithi082 ceph-mon[94281]: Deploying daemon osd.2 on smithi082 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:14 smithi082 ceph-mon[94281]: pgmap v410: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:16 smithi082 ceph-mon[94281]: pgmap v411: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:17 smithi082 ceph-mon[94281]: pgmap v412: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:17 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:17 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:00:25.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:17 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.605+0000 7f54a67fc700 1 -- 172.21.15.82:0/2690739464 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f54b0060ec0 con 0x7f549c09f440 2023-03-17T08:00:25.968 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 2 on host 'smithi082' 2023-03-17T08:00:25.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f549c09f440 msgr2=0x7f549c0a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f549c09f440 0x7f549c0a18f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54a0005950 tx=0x7f54a00058e0 comp rx=0 tx=0).stop 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 msgr2=0x7f54b019d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 0x7f54b019d290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f54a8007ee0 tx=0x7f54a800d3b0 comp rx=0 tx=0).stop 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 shutdown_connections 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b0100d00 0x7f54b019d290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54b00ff170 0x7f54b00690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f549c09f440 0x7f549c0a18f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 --2- 172.21.15.82:0/2690739464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54b0100370 0x7f54b019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 >> 172.21.15.82:0/2690739464 conn(0x7f54b00fa780 msgr2=0x7f54b00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 shutdown_connections 2023-03-17T08:00:28.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:00:19.607+0000 7f54b7671700 1 -- 172.21.15.82:0/2690739464 wait complete. 2023-03-17T08:00:28.220 DEBUG:teuthology.orchestra.run.smithi082:osd.2> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.2.service 2023-03-17T08:00:28.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:10 smithi035 ceph-mon[92535]: pgmap v408: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:31.302 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:12 smithi035 ceph-mon[92535]: pgmap v409: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:33.160 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-03-17T08:00:33.160 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:33.160 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:13 smithi035 ceph-mon[92535]: Deploying daemon osd.2 on smithi082 2023-03-17T08:00:33.160 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:14 smithi035 ceph-mon[92535]: pgmap v410: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:33.160 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:16 smithi035 ceph-mon[92535]: pgmap v411: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:33.160 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:17 smithi035 ceph-mon[92535]: pgmap v412: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:34.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:17 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:34.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:17 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:00:34.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:17 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:34.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:19 smithi035 ceph-mon[92535]: pgmap v413: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:34.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:34.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:34.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:38.036 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:38.036 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:20 smithi035 ceph-mon[92535]: from='osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:20 smithi035 ceph-mon[92535]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:21 smithi035 ceph-mon[92535]: pgmap v414: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:21 smithi035 ceph-mon[92535]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:21 smithi035 ceph-mon[92535]: osdmap e16: 3 total, 2 up, 3 in 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:21 smithi035 ceph-mon[92535]: from='osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:21 smithi035 ceph-mon[92535]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: osdmap e17: 3 total, 2 up, 3 in 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:38.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:38.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:38.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:40.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:00:41.132 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:41.132 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:41.132 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:00:41.133 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:41.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:00:43.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: pgmap v417: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi082 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 17168M 2023-03-17T08:00:43.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] boot 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: osdmap e18: 3 total, 3 up, 3 in 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:24 smithi035 ceph-mon[92535]: osdmap e19: 3 total, 3 up, 3 in 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:26 smithi035 ceph-mon[92535]: pgmap v420: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:26 smithi035 ceph-mon[92535]: osdmap e20: 3 total, 3 up, 3 in 2023-03-17T08:00:43.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-03-17T08:00:44.333 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:26 smithi035 sudo[109380]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-17T08:00:45.555 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:26 smithi035 sudo[109380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:00:45.555 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:26 smithi035 sudo[109380]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:00:45.555 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:26 smithi035 sudo[109380]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:10 smithi078 ceph-mon[94114]: pgmap v408: 0 pgs: ; 0 B data, 9.9 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:12 smithi078 ceph-mon[94114]: pgmap v409: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:13 smithi078 ceph-mon[94114]: Deploying daemon osd.2 on smithi082 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:14 smithi078 ceph-mon[94114]: pgmap v410: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:16 smithi078 ceph-mon[94114]: pgmap v411: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:17 smithi078 ceph-mon[94114]: pgmap v412: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:17 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:45.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:17 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:00:47.174 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:17 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:47.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:19 smithi078 ceph-mon[94114]: pgmap v413: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:47.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:47.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:47.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:47.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:47.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:20 smithi078 ceph-mon[94114]: from='osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-17T08:00:47.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:20 smithi078 ceph-mon[94114]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-17T08:00:48.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:21 smithi078 ceph-mon[94114]: pgmap v414: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:21 smithi078 ceph-mon[94114]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:21 smithi078 ceph-mon[94114]: osdmap e16: 3 total, 2 up, 3 in 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:21 smithi078 ceph-mon[94114]: from='osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:21 smithi078 ceph-mon[94114]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:00:48.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: osdmap e17: 3 total, 2 up, 3 in 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:00:49.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: pgmap v417: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi082 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 17168M 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] boot 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: osdmap e18: 3 total, 3 up, 3 in 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:24 smithi078 ceph-mon[94114]: osdmap e19: 3 total, 3 up, 3 in 2023-03-17T08:00:49.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-03-17T08:00:51.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:26 smithi078 ceph-mon[94114]: pgmap v420: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:00:51.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-03-17T08:00:51.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:26 smithi078 ceph-mon[94114]: osdmap e20: 3 total, 3 up, 3 in 2023-03-17T08:00:51.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-03-17T08:00:52.528 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-03-17T08:00:52.528 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:27 smithi078 ceph-mon[94114]: osdmap e21: 3 total, 3 up, 3 in 2023-03-17T08:00:52.529 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102089]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102089]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102089]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102089]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102092]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102092]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102092]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:00:52.530 INFO:journalctl@ceph.osd.1.smithi078.stdout:Mar 17 08:00:27 smithi078 sudo[102092]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:00:52.530 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-03-17T08:00:52.530 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:27 smithi035 ceph-mon[92535]: osdmap e21: 3 total, 3 up, 3 in 2023-03-17T08:00:52.531 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:27 smithi035 sudo[109383]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-17T08:00:52.531 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:27 smithi035 sudo[109383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:00:52.531 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:27 smithi035 sudo[109383]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:00:52.531 INFO:journalctl@ceph.osd.0.smithi035.stdout:Mar 17 08:00:27 smithi035 sudo[109383]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:00:52.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:19 smithi082 ceph-mon[94281]: pgmap v413: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:55.309 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:20 smithi082 ceph-mon[94281]: from='osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:20 smithi082 ceph-mon[94281]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:21 smithi082 ceph-mon[94281]: pgmap v414: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:55.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:21 smithi082 ceph-mon[94281]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:21 smithi082 ceph-mon[94281]: osdmap e16: 3 total, 2 up, 3 in 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:21 smithi082 ceph-mon[94281]: from='osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:21 smithi082 ceph-mon[94281]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: osdmap e17: 3 total, 2 up, 3 in 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:57.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:00:57.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:00:59.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:00:59.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:00:59.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:00:59.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: pgmap v417: 0 pgs: ; 0 B data, 10 MiB used, 179 GiB / 179 GiB avail 2023-03-17T08:00:59.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi082 2023-03-17T08:00:59.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 17168M 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: osd.2 [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] boot 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: osdmap e18: 3 total, 3 up, 3 in 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:24 smithi082 ceph-mon[94281]: osdmap e19: 3 total, 3 up, 3 in 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:26 smithi082 ceph-mon[94281]: pgmap v420: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:00.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:26 smithi082 ceph-mon[94281]: osdmap e20: 3 total, 3 up, 3 in 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:27 smithi082 ceph-mon[94281]: osdmap e21: 3 total, 3 up, 3 in 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:28 smithi082 ceph-mon[94281]: pgmap v423: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:28 smithi082 ceph-mon[94281]: mgrmap e16: x(active, since 13m), standbys: y, z 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:28 smithi082 ceph-mon[94281]: osdmap e22: 3 total, 3 up, 3 in 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102670]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102670]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102670]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102670]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:01:00.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102673]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-17T08:01:01.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102673]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:01:02.859 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102673]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:01:02.859 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:29 smithi082 sudo[102673]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:01:02.859 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:02.859 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:02.859 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:04.278 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:05.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:05.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:05.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:05.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:05.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:05.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: pgmap v425: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:05.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:05.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:05.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:06.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:06.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:06.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:31 smithi082 ceph-mon[94281]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:32 smithi082 ceph-mon[94281]: pgmap v426: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:34 smithi082 ceph-mon[94281]: pgmap v427: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:36 smithi082 ceph-mon[94281]: pgmap v428: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:38 smithi082 ceph-mon[94281]: pgmap v429: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:40 smithi082 ceph-mon[94281]: pgmap v430: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:42 smithi082 ceph-mon[94281]: pgmap v431: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:44 smithi082 ceph-mon[94281]: pgmap v432: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:06.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:46 smithi082 ceph-mon[94281]: pgmap v433: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:06.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:48 smithi082 ceph-mon[94281]: pgmap v434: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:06.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:50 smithi082 ceph-mon[94281]: pgmap v435: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:06.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:52 smithi082 ceph-mon[94281]: pgmap v436: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:07.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:28 smithi078 ceph-mon[94114]: pgmap v423: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:07.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:28 smithi078 ceph-mon[94114]: mgrmap e16: x(active, since 13m), standbys: y, z 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:28 smithi078 ceph-mon[94114]: osdmap e22: 3 total, 3 up, 3 in 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:29 smithi078 sudo[102095]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:29 smithi078 sudo[102095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:29 smithi078 sudo[102095]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:29 smithi078 sudo[102095]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 sudo[102098]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 sudo[102098]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 sudo[102098]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 sudo[102098]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:01:07.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:07.788 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:07.788 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:07.788 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:07.788 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:08.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:09.672 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:09.673 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:09.673 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:09.673 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: pgmap v425: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:31 smithi078 ceph-mon[94114]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:32 smithi078 ceph-mon[94114]: pgmap v426: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:34 smithi078 ceph-mon[94114]: pgmap v427: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:36 smithi078 ceph-mon[94114]: pgmap v428: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-03-17T08:01:12.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:38 smithi078 ceph-mon[94114]: pgmap v429: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-03-17T08:01:14.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:40 smithi078 ceph-mon[94114]: pgmap v430: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-03-17T08:01:14.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:42 smithi078 ceph-mon[94114]: pgmap v431: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:14.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:44 smithi078 ceph-mon[94114]: pgmap v432: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:14.876 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:46 smithi078 ceph-mon[94114]: pgmap v433: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:14.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:48 smithi078 ceph-mon[94114]: pgmap v434: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:14.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:50 smithi078 ceph-mon[94114]: pgmap v435: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:14.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:52 smithi078 ceph-mon[94114]: pgmap v436: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:14.877 INFO:tasks.cephadm:Deploying osd.3 on smithi035 with /dev/vg_nvme/lv_3... 2023-03-17T08:01:15.550 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-03-17T08:01:15.551 INFO:journalctl@ceph.osd.2.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:01:15.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:54 smithi082 ceph-mon[94281]: pgmap v437: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:56 smithi082 ceph-mon[94281]: pgmap v438: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:00:58 smithi082 ceph-mon[94281]: pgmap v439: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:00 smithi082 ceph-mon[94281]: pgmap v440: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:02 smithi082 ceph-mon[94281]: pgmap v441: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:04 smithi082 ceph-mon[94281]: pgmap v442: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:06 smithi082 ceph-mon[94281]: pgmap v443: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:08 smithi082 ceph-mon[94281]: pgmap v444: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:10 smithi082 ceph-mon[94281]: pgmap v445: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:12 smithi082 ceph-mon[94281]: pgmap v446: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:14 smithi082 ceph-mon[94281]: pgmap v447: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:54 smithi078 ceph-mon[94114]: pgmap v437: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:16.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:56 smithi078 ceph-mon[94114]: pgmap v438: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:17.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:00:58 smithi078 ceph-mon[94114]: pgmap v439: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:17.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:00 smithi078 ceph-mon[94114]: pgmap v440: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:17.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:02 smithi078 ceph-mon[94114]: pgmap v441: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:17.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:04 smithi078 ceph-mon[94114]: pgmap v442: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:17.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:06 smithi078 ceph-mon[94114]: pgmap v443: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:17.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:08 smithi078 ceph-mon[94114]: pgmap v444: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:18.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:10 smithi078 ceph-mon[94114]: pgmap v445: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:18.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:12 smithi078 ceph-mon[94114]: pgmap v446: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:18.250 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:14 smithi078 ceph-mon[94114]: pgmap v447: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:18.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 ceph-mon[92535]: pgmap v423: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:18.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 ceph-mon[92535]: mgrmap e16: x(active, since 13m), standbys: y, z 2023-03-17T08:01:18.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 ceph-mon[92535]: osdmap e22: 3 total, 3 up, 3 in 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 sudo[109386]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 sudo[109386]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 sudo[109386]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:28 smithi035 sudo[109386]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:01:18.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:29 smithi035 sudo[109389]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-03-17T08:01:18.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:29 smithi035 sudo[109389]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-03-17T08:01:18.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:29 smithi035 sudo[109389]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-03-17T08:01:18.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:29 smithi035 sudo[109389]: pam_unix(sudo:session): session closed for user root 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:19.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:19.187 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: pgmap v425: 1 pgs: 1 active+clean; 577 KiB data, 16 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:31 smithi035 ceph-mon[92535]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:32 smithi035 ceph-mon[92535]: pgmap v426: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:34 smithi035 ceph-mon[92535]: pgmap v427: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:36 smithi035 ceph-mon[92535]: pgmap v428: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-03-17T08:01:19.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:38 smithi035 ceph-mon[92535]: pgmap v429: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-03-17T08:01:19.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:40 smithi035 ceph-mon[92535]: pgmap v430: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-03-17T08:01:20.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:42 smithi035 ceph-mon[92535]: pgmap v431: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:20.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:44 smithi035 ceph-mon[92535]: pgmap v432: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:20.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:46 smithi035 ceph-mon[92535]: pgmap v433: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-03-17T08:01:20.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:48 smithi035 ceph-mon[92535]: pgmap v434: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:20.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:50 smithi035 ceph-mon[92535]: pgmap v435: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:20.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:52 smithi035 ceph-mon[92535]: pgmap v436: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:20.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:54 smithi035 ceph-mon[92535]: pgmap v437: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:20.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:56 smithi035 ceph-mon[92535]: pgmap v438: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:20.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:00:58 smithi035 ceph-mon[92535]: pgmap v439: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:00 smithi035 ceph-mon[92535]: pgmap v440: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:02 smithi035 ceph-mon[92535]: pgmap v441: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:04 smithi035 ceph-mon[92535]: pgmap v442: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:06 smithi035 ceph-mon[92535]: pgmap v443: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:08 smithi035 ceph-mon[92535]: pgmap v444: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:10 smithi035 ceph-mon[92535]: pgmap v445: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:12 smithi035 ceph-mon[92535]: pgmap v446: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:14 smithi035 ceph-mon[92535]: pgmap v447: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:16 smithi035 ceph-mon[92535]: pgmap v448: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:21.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:18 smithi035 ceph-mon[92535]: pgmap v449: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.427 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:01:23.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:16 smithi082 ceph-mon[94281]: pgmap v448: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:18 smithi082 ceph-mon[94281]: pgmap v449: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:20 smithi082 ceph-mon[94281]: pgmap v450: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:22 smithi082 ceph-mon[94281]: pgmap v451: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:16 smithi078 ceph-mon[94114]: pgmap v448: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:18 smithi078 ceph-mon[94114]: pgmap v449: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:20 smithi078 ceph-mon[94114]: pgmap v450: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:22 smithi078 ceph-mon[94114]: pgmap v451: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.428 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:20 smithi035 ceph-mon[92535]: pgmap v450: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:23.428 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-03-17T08:01:23.429 INFO:teuthology.orchestra.run.smithi035.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-03-17T08:01:23.429 INFO:teuthology.orchestra.run.smithi035.stderr: stderr: 10+0 records in 2023-03-17T08:01:23.429 INFO:teuthology.orchestra.run.smithi035.stderr:10+0 records out 2023-03-17T08:01:23.429 INFO:teuthology.orchestra.run.smithi035.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108356 s, 968 MB/s 2023-03-17T08:01:23.429 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping successful for: 2023-03-17T08:01:23.429 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi035:vg_nvme/lv_3 2023-03-17T08:01:23.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:22 smithi035 ceph-mon[92535]: pgmap v451: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:24.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:24.637 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:24 smithi035 ceph-mon[92535]: pgmap v452: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:24.637 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:24.637 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:24 smithi082 ceph-mon[94281]: pgmap v452: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:24 smithi078 ceph-mon[94114]: pgmap v452: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:25.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:25.299 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:01:26.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:26 smithi078 ceph-mon[94114]: pgmap v453: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:27.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:26 smithi082 ceph-mon[94281]: pgmap v453: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:27.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:26 smithi035 ceph-mon[92535]: pgmap v453: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:27.037 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 -- 172.21.15.35:0/2733145177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 msgr2=0x7fac6c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:01:28.533 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 --2- 172.21.15.35:0/2733145177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c1075c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b0a0 tx=0x7fac6400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:01:28.533 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 -- 172.21.15.35:0/2733145177 shutdown_connections 2023-03-17T08:01:28.533 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 --2- 172.21.15.35:0/2733145177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c1075c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:28.533 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 --2- 172.21.15.35:0/2733145177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac6c0ff170 0x7fac6c0ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:28.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 --2- 172.21.15.35:0/2733145177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac6c100370 0x7fac6c1007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:28.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 -- 172.21.15.35:0/2733145177 >> 172.21.15.35:0/2733145177 conn(0x7fac6c0fa780 msgr2=0x7fac6c0fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:01:28.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.852+0000 7fac73537700 1 -- 172.21.15.35:0/2733145177 shutdown_connections 2023-03-17T08:01:28.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 -- 172.21.15.35:0/2733145177 wait complete. 2023-03-17T08:01:28.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 Processor -- start 2023-03-17T08:01:29.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 -- start start 2023-03-17T08:01:29.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac6c0ff170 0x7fac6c196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:01:31.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac6c100370 0x7fac6c1965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:01:31.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:01:31.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c19dc00 con 0x7fac6c100d00 2023-03-17T08:01:31.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c19dd40 con 0x7fac6c100370 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac73537700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c19ded0 con 0x7fac6c0ff170 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac71ad4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.853+0000 7fac71ad4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39376/0 (socket says 172.21.15.35:39376) 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 -- 172.21.15.35:0/3734058079 learned_addr learned my addr 172.21.15.35:0/3734058079 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac712d3700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac6c0ff170 0x7fac6c196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac70ad2700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac6c100370 0x7fac6c1965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 -- 172.21.15.35:0/3734058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac6c0ff170 msgr2=0x7fac6c196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac6c0ff170 0x7fac6c196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:31.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 -- 172.21.15.35:0/3734058079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac6c100370 msgr2=0x7fac6c1965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac6c100370 0x7fac6c1965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 -- 172.21.15.35:0/3734058079 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64009d00 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac71ad4700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c19d630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b070 tx=0x7fac64004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6400e040 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c10a9f0 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac64003e90 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64004020 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.854+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c10a860 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.855+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c107300 con 0x7fac6c100d00 2023-03-17T08:01:31.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.856+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fac64003a00 con 0x7fac6c100d00 2023-03-17T08:01:31.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.857+0000 7fac5e7fc700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fac5809f4d0 0x7fac580a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:01:31.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.857+0000 7fac712d3700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fac5809f4d0 0x7fac580a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:01:31.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.857+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fac640cac60 con 0x7fac6c100d00 2023-03-17T08:01:31.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.857+0000 7fac712d3700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fac5809f4d0 0x7fac580a1980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac6c1001d0 tx=0x7fac6800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:01:31.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:26.860+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fac640961b0 con 0x7fac6c100d00 2023-03-17T08:01:31.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:27.068+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fac6c061a70 con 0x7fac5809f4d0 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:28 smithi078 ceph-mon[94114]: pgmap v454: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:28 smithi078 ceph-mon[94114]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:30 smithi078 ceph-mon[94114]: pgmap v455: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:30 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1524767907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c236cee-6090-4bd3-855b-1b0807335333"}]: dispatch 2023-03-17T08:01:32.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:30 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1524767907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c236cee-6090-4bd3-855b-1b0807335333"}]': finished 2023-03-17T08:01:32.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:30 smithi078 ceph-mon[94114]: osdmap e23: 4 total, 3 up, 4 in 2023-03-17T08:01:32.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:30 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:32.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:31 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3581367452' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:32 smithi078 ceph-mon[94114]: pgmap v457: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:28 smithi082 ceph-mon[94281]: pgmap v454: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:28 smithi082 ceph-mon[94281]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:01:34.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:30 smithi082 ceph-mon[94281]: pgmap v455: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:30 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1524767907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c236cee-6090-4bd3-855b-1b0807335333"}]: dispatch 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:30 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1524767907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c236cee-6090-4bd3-855b-1b0807335333"}]': finished 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:30 smithi082 ceph-mon[94281]: osdmap e23: 4 total, 3 up, 4 in 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:30 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:31 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3581367452' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:32 smithi082 ceph-mon[94281]: pgmap v457: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:34.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:01:34.687 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:01:34.687 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:34.687 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:28 smithi035 ceph-mon[92535]: pgmap v454: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:35.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:28 smithi035 ceph-mon[92535]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:01:35.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:30 smithi035 ceph-mon[92535]: pgmap v455: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:35.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:30 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1524767907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c236cee-6090-4bd3-855b-1b0807335333"}]: dispatch 2023-03-17T08:01:35.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:30 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1524767907' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c236cee-6090-4bd3-855b-1b0807335333"}]': finished 2023-03-17T08:01:35.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:30 smithi035 ceph-mon[92535]: osdmap e23: 4 total, 3 up, 4 in 2023-03-17T08:01:35.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:30 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:35.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:31 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3581367452' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:01:37.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:32 smithi035 ceph-mon[92535]: pgmap v457: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:37.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:34 smithi035 ceph-mon[92535]: pgmap v458: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:37.114 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:36 smithi035 ceph-mon[92535]: pgmap v459: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:38.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:34 smithi078 ceph-mon[94114]: pgmap v458: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:38.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:36 smithi078 ceph-mon[94114]: pgmap v459: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:38.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:34 smithi082 ceph-mon[94281]: pgmap v458: 1 pgs: 1 active+clean; 577 KiB data, 20 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:38.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:36 smithi082 ceph-mon[94281]: pgmap v459: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:38.359 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:37 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-03-17T08:01:38.359 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:37 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:38.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:37 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-03-17T08:01:40.020 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:37 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:40.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:37 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-03-17T08:01:40.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:37 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:40.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:38 smithi078 ceph-mon[94114]: pgmap v460: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:40.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:38 smithi078 ceph-mon[94114]: Deploying daemon osd.3 on smithi035 2023-03-17T08:01:40.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:38 smithi082 ceph-mon[94281]: pgmap v460: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:40.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:38 smithi082 ceph-mon[94281]: Deploying daemon osd.3 on smithi035 2023-03-17T08:01:40.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:38 smithi035 ceph-mon[92535]: pgmap v460: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:40.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:38 smithi035 ceph-mon[92535]: Deploying daemon osd.3 on smithi035 2023-03-17T08:01:40.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:40 smithi035 ceph-mon[92535]: pgmap v461: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:42.171 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:40 smithi078 ceph-mon[94114]: pgmap v461: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:42.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:40 smithi082 ceph-mon[94281]: pgmap v461: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:42.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:42 smithi035 ceph-mon[92535]: pgmap v462: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:43.615 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:45.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:44 smithi035 ceph-mon[92535]: pgmap v463: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:42 smithi078 ceph-mon[94114]: pgmap v462: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:44 smithi078 ceph-mon[94114]: pgmap v463: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:42 smithi082 ceph-mon[94281]: pgmap v462: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:45.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:44 smithi082 ceph-mon[94281]: pgmap v463: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.013+0000 7fac5e7fc700 1 -- 172.21.15.35:0/3734058079 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fac6c061a70 con 0x7fac5809f4d0 2023-03-17T08:01:45.048 INFO:teuthology.orchestra.run.smithi035.stdout:Created osd(s) 3 on host 'smithi035' 2023-03-17T08:01:45.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fac5809f4d0 msgr2=0x7fac580a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:01:45.884 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fac5809f4d0 0x7fac580a1980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac6c1001d0 tx=0x7fac6800a380 comp rx=0 tx=0).stop 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 msgr2=0x7fac6c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c19d630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b070 tx=0x7fac64004c80 comp rx=0 tx=0).stop 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 shutdown_connections 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fac5809f4d0 0x7fac580a1980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fac6c100d00 0x7fac6c19d630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac6c0ff170 0x7fac6c196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 --2- 172.21.15.35:0/3734058079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac6c100370 0x7fac6c1965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 >> 172.21.15.35:0/3734058079 conn(0x7fac6c0fa780 msgr2=0x7fac6c0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 shutdown_connections 2023-03-17T08:01:45.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:01:45.015+0000 7fac73537700 1 -- 172.21.15.35:0/3734058079 wait complete. 2023-03-17T08:01:45.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: pgmap v464: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:45.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:45.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:45.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:45.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: pgmap v464: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:45.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:46.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:46.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:46.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:46.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:46.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:46.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:46.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:46.455 DEBUG:teuthology.orchestra.run.smithi035:osd.3> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.3.service 2023-03-17T08:01:47.072 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: pgmap v464: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:47.738 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:47.738 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:47.738 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:47.738 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:47.738 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:48.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:48.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:49.454 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:01:49.457 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:46 smithi078 ceph-mon[94114]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-03-17T08:01:50.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:47 smithi078 ceph-mon[94114]: pgmap v465: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:47 smithi078 ceph-mon[94114]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:47 smithi078 ceph-mon[94114]: osdmap e24: 4 total, 3 up, 4 in 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:47 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:47 smithi078 ceph-mon[94114]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: osdmap e25: 4 total, 3 up, 4 in 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:50.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi035 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 8586M 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:46 smithi082 ceph-mon[94281]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-03-17T08:01:51.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:47 smithi082 ceph-mon[94281]: pgmap v465: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:47 smithi082 ceph-mon[94281]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:47 smithi082 ceph-mon[94281]: osdmap e24: 4 total, 3 up, 4 in 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:47 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:47 smithi082 ceph-mon[94281]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: osdmap e25: 4 total, 3 up, 4 in 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:51.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi035 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 8586M 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:53.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:53.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:46 smithi035 ceph-mon[92535]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-03-17T08:01:53.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:47 smithi035 ceph-mon[92535]: pgmap v465: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:53.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:47 smithi035 ceph-mon[92535]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-03-17T08:01:53.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:47 smithi035 ceph-mon[92535]: osdmap e24: 4 total, 3 up, 4 in 2023-03-17T08:01:53.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:53.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:47 smithi035 ceph-mon[92535]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: osdmap e25: 4 total, 3 up, 4 in 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi035 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:54.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:01:54.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:01:54.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 8586M 2023-03-17T08:01:54.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:54.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:01:54.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:01:54.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:01:54.118 INFO:tasks.cephadm:Deploying osd.4 on smithi078 with /dev/vg_nvme/lv_3... 2023-03-17T08:01:54.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-03-17T08:01:54.919 INFO:journalctl@ceph.osd.3.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:01:54.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:01:54.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:01:54.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: pgmap v468: 1 pgs: 1 peering; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:54.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] boot 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: osdmap e26: 4 total, 4 up, 4 in 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:49 smithi078 ceph-mon[94114]: osdmap e27: 4 total, 4 up, 4 in 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:51 smithi078 ceph-mon[94114]: osdmap e28: 4 total, 4 up, 4 in 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:52 smithi078 ceph-mon[94114]: pgmap v472: 1 pgs: 1 peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:52 smithi078 ceph-mon[94114]: osdmap e29: 4 total, 4 up, 4 in 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:53 smithi078 ceph-mon[94114]: osdmap e30: 4 total, 4 up, 4 in 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:54 smithi078 ceph-mon[94114]: pgmap v475: 1 pgs: 1 peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:01:54.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: pgmap v468: 1 pgs: 1 peering; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] boot 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: osdmap e26: 4 total, 4 up, 4 in 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:49 smithi082 ceph-mon[94281]: osdmap e27: 4 total, 4 up, 4 in 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:51 smithi082 ceph-mon[94281]: osdmap e28: 4 total, 4 up, 4 in 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:52 smithi082 ceph-mon[94281]: pgmap v472: 1 pgs: 1 peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:52 smithi082 ceph-mon[94281]: osdmap e29: 4 total, 4 up, 4 in 2023-03-17T08:01:54.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:53 smithi082 ceph-mon[94281]: osdmap e30: 4 total, 4 up, 4 in 2023-03-17T08:01:56.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:54 smithi082 ceph-mon[94281]: pgmap v475: 1 pgs: 1 peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:01:56.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:01:56.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:01:56.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: pgmap v468: 1 pgs: 1 peering; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2023-03-17T08:01:56.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:56.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: osd.3 [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] boot 2023-03-17T08:01:56.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: osdmap e26: 4 total, 4 up, 4 in 2023-03-17T08:01:56.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:01:56.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:49 smithi035 ceph-mon[92535]: osdmap e27: 4 total, 4 up, 4 in 2023-03-17T08:01:57.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:51 smithi035 ceph-mon[92535]: osdmap e28: 4 total, 4 up, 4 in 2023-03-17T08:01:57.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:52 smithi035 ceph-mon[92535]: pgmap v472: 1 pgs: 1 peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:01:57.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:52 smithi035 ceph-mon[92535]: osdmap e29: 4 total, 4 up, 4 in 2023-03-17T08:01:57.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:53 smithi035 ceph-mon[92535]: osdmap e30: 4 total, 4 up, 4 in 2023-03-17T08:01:57.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:54 smithi035 ceph-mon[92535]: pgmap v475: 1 pgs: 1 peering; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:01:57.712 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:56 smithi082 ceph-mon[94281]: pgmap v476: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-03-17T08:01:59.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:56 smithi035 ceph-mon[92535]: pgmap v476: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-03-17T08:02:00.488 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T08:02:00.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:56 smithi078 ceph-mon[94114]: pgmap v476: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-03-17T08:02:00.489 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-03-17T08:02:00.489 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-03-17T08:02:00.489 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2023-03-17T08:02:00.489 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2023-03-17T08:02:00.490 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111606 s, 940 MB/s 2023-03-17T08:02:00.490 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2023-03-17T08:02:00.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi078:vg_nvme/lv_3 2023-03-17T08:02:02.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:01:58 smithi078 ceph-mon[94114]: pgmap v477: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:00 smithi078 ceph-mon[94114]: pgmap v478: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:02 smithi078 ceph-mon[94114]: pgmap v479: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:01:58 smithi082 ceph-mon[94281]: pgmap v477: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:00 smithi082 ceph-mon[94281]: pgmap v478: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.493 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:01:58 smithi035 ceph-mon[92535]: pgmap v477: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.493 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:00 smithi035 ceph-mon[92535]: pgmap v478: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.493 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:02 smithi035 ceph-mon[92535]: pgmap v479: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-03-17T08:02:02.636 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:02 smithi082 ceph-mon[94281]: pgmap v479: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-03-17T08:02:04.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:04 smithi035 ceph-mon[92535]: pgmap v480: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-03-17T08:02:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T08:02:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 -- 172.21.15.78:0/2380795827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100f10 msgr2=0x7f33401077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:02:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 --2- 172.21.15.78:0/2380795827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100f10 0x7f33401077d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f333800b0a0 tx=0x7f333800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:02:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 -- 172.21.15.78:0/2380795827 shutdown_connections 2023-03-17T08:02:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 --2- 172.21.15.78:0/2380795827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100f10 0x7f33401077d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 --2- 172.21.15.78:0/2380795827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f33400ff380 0x7f33400ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 --2- 172.21.15.78:0/2380795827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3340100580 0x7f33401009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 -- 172.21.15.78:0/2380795827 >> 172.21.15.78:0/2380795827 conn(0x7f33400fa9b0 msgr2=0x7f33400fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 -- 172.21.15.78:0/2380795827 shutdown_connections 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.356+0000 7f33450a7700 1 -- 172.21.15.78:0/2380795827 wait complete. 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.357+0000 7f33450a7700 1 Processor -- start 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.357+0000 7f33450a7700 1 -- start start 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33400ff380 0x7f3340103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:02:11.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 0x7f3340101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3340100f10 0x7f33401021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340102930 con 0x7f3340100f10 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340102aa0 con 0x7f3340100580 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401a0230 con 0x7f33400ff380 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 0x7f3340101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 0x7f3340101c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49214/0 (socket says 172.21.15.78:49214) 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 -- 172.21.15.78:0/3070289472 learned_addr learned my addr 172.21.15.78:0/3070289472 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-03-17T08:02:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333f59e700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3340100f10 0x7f33401021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333ed9d700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33400ff380 0x7f3340103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 -- 172.21.15.78:0/3070289472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33400ff380 msgr2=0x7f3340103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33400ff380 0x7f3340103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 -- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3340100f10 msgr2=0x7f33401021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3340100f10 0x7f33401021b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 -- 172.21.15.78:0/3070289472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009d00 con 0x7f3340100580 2023-03-17T08:02:11.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f333e59c700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 0x7f3340101c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f333000d950 tx=0x7f333000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:02:14.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000f890 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f333000fe80 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334010aba0 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000e3b0 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.358+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334010aa10 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.359+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340107470 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.360+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3330010460 con 0x7f3340100580 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.361+0000 7f3327fff700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f332809f4d0 0x7f33280a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:02:14.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.361+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3669+0+0 (secure 0 0 0) 0x7f33300c8db0 con 0x7f3340100580 2023-03-17T08:02:14.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.361+0000 7f333ed9d700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f332809f4d0 0x7f33280a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:02:14.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.362+0000 7f333ed9d700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f332809f4d0 0x7f33280a1980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33401003e0 tx=0x7f333400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:02:14.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.365+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mon.2 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f33300940c0 con 0x7f3340100580 2023-03-17T08:02:14.510 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:04 smithi078 ceph-mon[94114]: pgmap v480: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-03-17T08:02:14.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:04.560+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3340060ec0 con 0x7f332809f4d0 2023-03-17T08:02:16.136 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:02:16.136 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:02:16.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:16.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:06 smithi078 ceph-mon[94114]: pgmap v481: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-03-17T08:02:16.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:06 smithi078 ceph-mon[94114]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:02:16.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:07 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/3043182898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]: dispatch 2023-03-17T08:02:16.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:07 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]: dispatch 2023-03-17T08:02:16.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:07 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]': finished 2023-03-17T08:02:16.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:07 smithi078 ceph-mon[94114]: osdmap e31: 5 total, 4 up, 5 in 2023-03-17T08:02:16.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:07 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:16.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:08 smithi078 ceph-mon[94114]: pgmap v482: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:08 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/2472427070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:10 smithi078 ceph-mon[94114]: pgmap v484: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:12 smithi078 ceph-mon[94114]: pgmap v485: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:14 smithi078 ceph-mon[94114]: pgmap v486: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:16.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:15 smithi078 ceph-mon[94114]: Deploying daemon osd.4 on smithi078 2023-03-17T08:02:16.523 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:16 smithi078 ceph-mon[94114]: pgmap v487: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:16.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:04 smithi082 ceph-mon[94281]: pgmap v480: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-03-17T08:02:17.197 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:02:17.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:02:17.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:17.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:06 smithi082 ceph-mon[94281]: pgmap v481: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-03-17T08:02:17.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:06 smithi082 ceph-mon[94281]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:02:17.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:07 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/3043182898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]: dispatch 2023-03-17T08:02:17.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:07 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]: dispatch 2023-03-17T08:02:17.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:07 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]': finished 2023-03-17T08:02:17.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:07 smithi082 ceph-mon[94281]: osdmap e31: 5 total, 4 up, 5 in 2023-03-17T08:02:17.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:07 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:08 smithi082 ceph-mon[94281]: pgmap v482: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:08 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/2472427070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:10 smithi082 ceph-mon[94281]: pgmap v484: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:12 smithi082 ceph-mon[94281]: pgmap v485: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:14 smithi082 ceph-mon[94281]: pgmap v486: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:15 smithi082 ceph-mon[94281]: Deploying daemon osd.4 on smithi078 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:06 smithi035 ceph-mon[92535]: pgmap v481: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-03-17T08:02:17.578 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:06 smithi035 ceph-mon[92535]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:07 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/3043182898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]: dispatch 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:07 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]: dispatch 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:07 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2a94d43-e076-49ee-85bc-723575af1907"}]': finished 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:07 smithi035 ceph-mon[92535]: osdmap e31: 5 total, 4 up, 5 in 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:08 smithi035 ceph-mon[92535]: pgmap v482: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:08 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/2472427070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:10 smithi035 ceph-mon[92535]: pgmap v484: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:12 smithi035 ceph-mon[92535]: pgmap v485: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:17.579 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:14 smithi035 ceph-mon[92535]: pgmap v486: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:18.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-03-17T08:02:18.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:18.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:15 smithi035 ceph-mon[92535]: Deploying daemon osd.4 on smithi078 2023-03-17T08:02:18.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:16 smithi035 ceph-mon[92535]: pgmap v487: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:18.331 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:16 smithi082 ceph-mon[94281]: pgmap v487: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:18.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:18 smithi078 ceph-mon[94114]: pgmap v488: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:18.689 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:18 smithi082 ceph-mon[94281]: pgmap v488: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:18.689 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:18 smithi035 ceph-mon[92535]: pgmap v488: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:19.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:19 smithi078 ceph-mon[94114]: pgmap v489: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:20.483 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:20.483 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:20.483 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:19 smithi035 ceph-mon[92535]: pgmap v489: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:19 smithi082 ceph-mon[94281]: pgmap v489: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:20.484 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:02:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.373+0000 7f3327fff700 1 -- 172.21.15.78:0/3070289472 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3340060ec0 con 0x7f332809f4d0 2023-03-17T08:02:22.125 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 4 on host 'smithi078' 2023-03-17T08:02:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f332809f4d0 msgr2=0x7f33280a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:02:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f332809f4d0 0x7f33280a1980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33401003e0 tx=0x7f333400b410 comp rx=0 tx=0).stop 2023-03-17T08:02:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 msgr2=0x7f3340101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:02:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 0x7f3340101c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f333000d950 tx=0x7f333000dc60 comp rx=0 tx=0).stop 2023-03-17T08:02:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 shutdown_connections 2023-03-17T08:02:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f332809f4d0 0x7f33280a1980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:23.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3340100f10 0x7f33401021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:23.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33400ff380 0x7f3340103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:23.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 --2- 172.21.15.78:0/3070289472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3340100580 0x7f3340101c70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:02:23.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 >> 172.21.15.78:0/3070289472 conn(0x7f33400fa9b0 msgr2=0x7f33400fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:02:23.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 shutdown_connections 2023-03-17T08:02:23.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:02:21.376+0000 7f33450a7700 1 -- 172.21.15.78:0/3070289472 wait complete. 2023-03-17T08:02:23.120 DEBUG:teuthology.orchestra.run.smithi078:osd.4> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.4.service 2023-03-17T08:02:24.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: pgmap v490: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:24.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:23 smithi035 ceph-mon[92535]: from='osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:23 smithi035 ceph-mon[92535]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: pgmap v490: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:24.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:25.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:25.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:02:25.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:23 smithi082 ceph-mon[94281]: from='osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-17T08:02:25.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:23 smithi082 ceph-mon[94281]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-17T08:02:25.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: pgmap v490: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:25.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:25.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:25.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:26.485 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:02:29.361 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:29.361 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:23 smithi078 ceph-mon[94114]: from='osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:23 smithi078 ceph-mon[94114]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:24 smithi078 ceph-mon[94114]: pgmap v491: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:24 smithi078 ceph-mon[94114]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:24 smithi078 ceph-mon[94114]: osdmap e32: 5 total, 4 up, 5 in 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:24 smithi078 ceph-mon[94114]: from='osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:02:29.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:24 smithi078 ceph-mon[94114]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:02:29.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: osdmap e33: 5 total, 4 up, 5 in 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi078 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 8584M 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:02:30.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: pgmap v494: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] boot 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: osdmap e34: 5 total, 5 up, 5 in 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:27 smithi078 ceph-mon[94114]: osdmap e35: 5 total, 5 up, 5 in 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:27 smithi078 ceph-mon[94114]: pgmap v497: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:30.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:24 smithi035 ceph-mon[92535]: pgmap v491: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:32.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:24 smithi035 ceph-mon[92535]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-03-17T08:02:32.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:24 smithi035 ceph-mon[92535]: osdmap e32: 5 total, 4 up, 5 in 2023-03-17T08:02:32.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:32.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:24 smithi035 ceph-mon[92535]: from='osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:02:33.212 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:24 smithi035 ceph-mon[92535]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:02:33.212 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:02:34.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: osdmap e33: 5 total, 4 up, 5 in 2023-03-17T08:02:37.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:37.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:37.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi078 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 8584M 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:02:37.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:37.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:02:37.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:02:37.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: pgmap v494: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:37.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:37.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] boot 2023-03-17T08:02:37.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: osdmap e34: 5 total, 5 up, 5 in 2023-03-17T08:02:37.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:37.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:27 smithi035 ceph-mon[92535]: osdmap e35: 5 total, 5 up, 5 in 2023-03-17T08:02:39.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:27 smithi035 ceph-mon[92535]: pgmap v497: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:39.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:24 smithi082 ceph-mon[94281]: pgmap v491: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:39.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:24 smithi082 ceph-mon[94281]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-03-17T08:02:39.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:24 smithi082 ceph-mon[94281]: osdmap e32: 5 total, 4 up, 5 in 2023-03-17T08:02:39.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:39.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:24 smithi082 ceph-mon[94281]: from='osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:02:39.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:24 smithi082 ceph-mon[94281]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:02:40.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:02:40.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: osdmap e33: 5 total, 4 up, 5 in 2023-03-17T08:02:40.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:40.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:40.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi078 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 8584M 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: pgmap v494: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: osd.4 [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] boot 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: osdmap e34: 5 total, 5 up, 5 in 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:02:40.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:27 smithi082 ceph-mon[94281]: osdmap e35: 5 total, 5 up, 5 in 2023-03-17T08:02:40.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:27 smithi082 ceph-mon[94281]: pgmap v497: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:40.606 INFO:tasks.cephadm:Deploying osd.5 on smithi082 with /dev/vg_nvme/lv_3... 2023-03-17T08:02:40.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-03-17T08:02:40.607 INFO:journalctl@ceph.osd.4.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:02:40.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:30 smithi078 ceph-mon[94114]: pgmap v498: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:41.852 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:32 smithi078 ceph-mon[94114]: pgmap v499: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:41.852 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:34 smithi078 ceph-mon[94114]: pgmap v500: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:41.852 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:36 smithi078 ceph-mon[94114]: pgmap v501: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:41.852 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:38 smithi078 ceph-mon[94114]: pgmap v502: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:41.852 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:40 smithi078 ceph-mon[94114]: pgmap v503: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:41.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:30 smithi035 ceph-mon[92535]: pgmap v498: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:32 smithi035 ceph-mon[92535]: pgmap v499: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:34 smithi035 ceph-mon[92535]: pgmap v500: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:36 smithi035 ceph-mon[92535]: pgmap v501: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:38 smithi035 ceph-mon[92535]: pgmap v502: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:40 smithi035 ceph-mon[92535]: pgmap v503: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:30 smithi082 ceph-mon[94281]: pgmap v498: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:32 smithi082 ceph-mon[94281]: pgmap v499: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:34 smithi082 ceph-mon[94281]: pgmap v500: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:36 smithi082 ceph-mon[94281]: pgmap v501: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:38 smithi082 ceph-mon[94281]: pgmap v502: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:40 smithi082 ceph-mon[94281]: pgmap v503: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.266 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:42 smithi078 ceph-mon[94114]: pgmap v504: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:42 smithi035 ceph-mon[92535]: pgmap v504: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:42 smithi082 ceph-mon[94281]: pgmap v504: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:43.922 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:02:47.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:44 smithi082 ceph-mon[94281]: pgmap v505: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:47.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:44 smithi035 ceph-mon[92535]: pgmap v505: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:47.255 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:46 smithi035 ceph-mon[92535]: pgmap v506: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:47.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:44 smithi078 ceph-mon[94114]: pgmap v505: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:47.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:46 smithi078 ceph-mon[94114]: pgmap v506: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:47.255 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-03-17T08:02:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-03-17T08:02:47.256 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-03-17T08:02:47.256 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-03-17T08:02:50.547 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110963 s, 945 MB/s 2023-03-17T08:02:50.548 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-03-17T08:02:50.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2023-03-17T08:02:50.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:46 smithi082 ceph-mon[94281]: pgmap v506: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:51.466 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:48 smithi082 ceph-mon[94281]: pgmap v507: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:51.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:50 smithi082 ceph-mon[94281]: pgmap v508: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:51.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:48 smithi035 ceph-mon[92535]: pgmap v507: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:51.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:50 smithi035 ceph-mon[92535]: pgmap v508: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:51.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:48 smithi078 ceph-mon[94114]: pgmap v507: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:51.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:50 smithi078 ceph-mon[94114]: pgmap v508: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:52.114 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:02:53.188 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:52 smithi035 ceph-mon[92535]: pgmap v509: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:55.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:52 smithi078 ceph-mon[94114]: pgmap v509: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:56.636 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:52 smithi082 ceph-mon[94281]: pgmap v509: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:56.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:54 smithi035 ceph-mon[92535]: pgmap v510: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:02:56.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:02:56.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:02:56.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:02:56.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:55 smithi035 ceph-mon[92535]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:03:00.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:56 smithi035 ceph-mon[92535]: pgmap v511: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:00.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:54 smithi078 ceph-mon[94114]: pgmap v510: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:00.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:03:00.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:03:04.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:05.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:55 smithi078 ceph-mon[94114]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:03:05.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:56 smithi078 ceph-mon[94114]: pgmap v511: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:05.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:57 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/370639058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]: dispatch 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:57 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]: dispatch 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:57 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]': finished 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:57 smithi035 ceph-mon[92535]: osdmap e36: 6 total, 5 up, 6 in 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:57 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:57 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/306168593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:02:58 smithi035 ceph-mon[92535]: pgmap v513: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:08.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:00 smithi035 ceph-mon[92535]: pgmap v514: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:08.308 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:02 smithi035 ceph-mon[92535]: pgmap v515: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:08.308 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-03-17T08:03:09.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:09.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:04 smithi035 ceph-mon[92535]: pgmap v516: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:09.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:04 smithi035 ceph-mon[92535]: Deploying daemon osd.5 on smithi082 2023-03-17T08:03:09.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:57 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/370639058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]: dispatch 2023-03-17T08:03:10.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:57 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]: dispatch 2023-03-17T08:03:10.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:57 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]': finished 2023-03-17T08:03:10.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:57 smithi078 ceph-mon[94114]: osdmap e36: 6 total, 5 up, 6 in 2023-03-17T08:03:10.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:57 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:10.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:57 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/306168593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:03:10.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:02:58 smithi078 ceph-mon[94114]: pgmap v513: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:10.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:00 smithi078 ceph-mon[94114]: pgmap v514: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:10.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:02 smithi078 ceph-mon[94114]: pgmap v515: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:12.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-03-17T08:03:12.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:12.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:04 smithi078 ceph-mon[94114]: pgmap v516: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:12.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:04 smithi078 ceph-mon[94114]: Deploying daemon osd.5 on smithi082 2023-03-17T08:03:12.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 -- 172.21.15.82:0/205399859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ffd70 msgr2=0x7f94b0107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:03:12.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 --2- 172.21.15.82:0/205399859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ffd70 0x7f94b0107620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f94a800b0a0 tx=0x7f94a800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 -- 172.21.15.82:0/205399859 shutdown_connections 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 --2- 172.21.15.82:0/205399859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ffd70 0x7f94b0107620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 --2- 172.21.15.82:0/205399859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b01007f0 0x7f94b0100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 --2- 172.21.15.82:0/205399859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94b00ff3c0 0x7f94b00ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 -- 172.21.15.82:0/205399859 >> 172.21.15.82:0/205399859 conn(0x7f94b00f9f00 msgr2=0x7f94b00fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 -- 172.21.15.82:0/205399859 shutdown_connections 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.452+0000 7f94b49b2700 1 -- 172.21.15.82:0/205399859 wait complete. 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 Processor -- start 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 -- start start 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 0x7f94b0194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94b00ffd70 0x7f94b0195430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b01007f0 0x7f94b019c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:03:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b019ca80 con 0x7f94b00ffd70 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b019cbc0 con 0x7f94b01007f0 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94b49b2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b019cd50 con 0x7f94b00ff3c0 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 0x7f94b0194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 0x7f94b0194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52810/0 (socket says 172.21.15.82:52810) 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 -- 172.21.15.82:0/3947207015 learned_addr learned my addr 172.21.15.82:0/3947207015 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94add9b700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94b00ffd70 0x7f94b0195430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94aed9d700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b01007f0 0x7f94b019c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:03:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 -- 172.21.15.82:0/3947207015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b01007f0 msgr2=0x7f94b019c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:03:13.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b01007f0 0x7f94b019c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:14.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 -- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94b00ffd70 msgr2=0x7f94b0195430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94b00ffd70 0x7f94b0195430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 -- 172.21.15.82:0/3947207015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009d00 con 0x7f94b00ff3c0 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.453+0000 7f94ae59c700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 0x7f94b0194ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b560 tx=0x7f94a000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.454+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0011830 con 0x7f94b00ff3c0 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.454+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94a0011e20 con 0x7f94b00ff3c0 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.454+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0010dd0 con 0x7f94b00ff3c0 2023-03-17T08:03:15.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.454+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b010aa30 con 0x7f94b00ff3c0 2023-03-17T08:03:15.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.454+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b010a8a0 con 0x7f94b00ff3c0 2023-03-17T08:03:15.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.454+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b00ff030 con 0x7f94b00ff3c0 2023-03-17T08:03:15.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.456+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f94a0011990 con 0x7f94b00ff3c0 2023-03-17T08:03:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.456+0000 7f949f7fe700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f949809f4d0 0x7f94980a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:03:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.456+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f94a00c8fd0 con 0x7f94b00ff3c0 2023-03-17T08:03:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.456+0000 7f94add9b700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f949809f4d0 0x7f94980a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:03:16.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.457+0000 7f94add9b700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f949809f4d0 0x7f94980a1980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005950 tx=0x7f94a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:03:16.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.460+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f94a0094130 con 0x7f94b00ff3c0 2023-03-17T08:03:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:02:53.653+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f94b00fe860 con 0x7f949809f4d0 2023-03-17T08:03:17.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:54 smithi082 ceph-mon[94281]: pgmap v510: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:03:18.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:03:18.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:18.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:55 smithi082 ceph-mon[94281]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:56 smithi082 ceph-mon[94281]: pgmap v511: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:57 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/370639058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]: dispatch 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:57 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]: dispatch 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:57 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "955eccc0-b6f3-4b18-a929-577d360f315d"}]': finished 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:57 smithi082 ceph-mon[94281]: osdmap e36: 6 total, 5 up, 6 in 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:57 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:57 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/306168593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:02:58 smithi082 ceph-mon[94281]: pgmap v513: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:00 smithi082 ceph-mon[94281]: pgmap v514: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:02 smithi082 ceph-mon[94281]: pgmap v515: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:04 smithi082 ceph-mon[94281]: pgmap v516: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:04 smithi082 ceph-mon[94281]: Deploying daemon osd.5 on smithi082 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:06 smithi082 ceph-mon[94281]: pgmap v517: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:08 smithi082 ceph-mon[94281]: pgmap v518: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:18.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:19.432 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:03:19.432 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:09 smithi082 ceph-mon[94281]: pgmap v519: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:19.432 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:19.432 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:19.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.892+0000 7f949f7fe700 1 -- 172.21.15.82:0/3947207015 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f94b00fe860 con 0x7f949809f4d0 2023-03-17T08:03:21.505 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 5 on host 'smithi082' 2023-03-17T08:03:21.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:06 smithi035 ceph-mon[92535]: pgmap v517: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:24.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:08 smithi035 ceph-mon[92535]: pgmap v518: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:24.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:24.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:24.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:09 smithi035 ceph-mon[92535]: pgmap v519: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:25.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:26.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:03:26.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:12 smithi035 ceph-mon[92535]: pgmap v520: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:26.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:12 smithi035 ceph-mon[92535]: from='osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-17T08:03:26.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:12 smithi035 ceph-mon[92535]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-17T08:03:26.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:13 smithi035 ceph-mon[92535]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-03-17T08:03:26.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:13 smithi035 ceph-mon[92535]: osdmap e37: 6 total, 5 up, 6 in 2023-03-17T08:03:27.301 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:28.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:13 smithi035 ceph-mon[92535]: from='osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:03:28.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:13 smithi035 ceph-mon[92535]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:03:28.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: pgmap v522: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:28.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:03:28.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: osdmap e38: 6 total, 5 up, 6 in 2023-03-17T08:03:29.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:29.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:29.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:29.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:29.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:03:29.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:03:29.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:29.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:29.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:03:30.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:30.871 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] boot 2023-03-17T08:03:30.871 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: osdmap e39: 6 total, 6 up, 6 in 2023-03-17T08:03:30.871 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:30.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:15 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:03:30.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:15 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:03:30.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:15 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi082 2023-03-17T08:03:30.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:15 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 8584M 2023-03-17T08:03:30.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:15 smithi035 ceph-mon[92535]: osdmap e40: 6 total, 6 up, 6 in 2023-03-17T08:03:31.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:16 smithi035 ceph-mon[92535]: pgmap v525: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:32.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:16 smithi035 ceph-mon[92535]: osdmap e41: 6 total, 6 up, 6 in 2023-03-17T08:03:33.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:18 smithi035 ceph-mon[92535]: pgmap v528: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:33.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:18 smithi035 ceph-mon[92535]: osdmap e42: 6 total, 6 up, 6 in 2023-03-17T08:03:33.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:19 smithi035 ceph-mon[92535]: osdmap e43: 6 total, 6 up, 6 in 2023-03-17T08:03:33.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:20 smithi035 ceph-mon[92535]: pgmap v531: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-03-17T08:03:33.553 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:06 smithi078 ceph-mon[94114]: pgmap v517: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:33.553 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:08 smithi078 ceph-mon[94114]: pgmap v518: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:09 smithi078 ceph-mon[94114]: pgmap v519: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:33.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:03:36.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:36.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:36.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:37.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:03:37.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:12 smithi078 ceph-mon[94114]: pgmap v520: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:37.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:12 smithi078 ceph-mon[94114]: from='osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-17T08:03:37.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:12 smithi078 ceph-mon[94114]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-17T08:03:37.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:13 smithi078 ceph-mon[94114]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-03-17T08:03:37.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:13 smithi078 ceph-mon[94114]: osdmap e37: 6 total, 5 up, 6 in 2023-03-17T08:03:37.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:37.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:13 smithi078 ceph-mon[94114]: from='osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:03:37.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:13 smithi078 ceph-mon[94114]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:03:38.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: pgmap v522: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:38.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:03:38.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: osdmap e38: 6 total, 5 up, 6 in 2023-03-17T08:03:38.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:38.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:38.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:38.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:39.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:03:39.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:03:39.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:39.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:39.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:03:39.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:39.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] boot 2023-03-17T08:03:39.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: osdmap e39: 6 total, 6 up, 6 in 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:15 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:15 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:15 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi082 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:15 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 8584M 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:15 smithi078 ceph-mon[94114]: osdmap e40: 6 total, 6 up, 6 in 2023-03-17T08:03:40.443 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:16 smithi078 ceph-mon[94114]: pgmap v525: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:40.444 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:16 smithi078 ceph-mon[94114]: osdmap e41: 6 total, 6 up, 6 in 2023-03-17T08:03:40.444 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:18 smithi078 ceph-mon[94114]: pgmap v528: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:40.444 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:18 smithi078 ceph-mon[94114]: osdmap e42: 6 total, 6 up, 6 in 2023-03-17T08:03:40.444 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:19 smithi078 ceph-mon[94114]: osdmap e43: 6 total, 6 up, 6 in 2023-03-17T08:03:40.444 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:20 smithi078 ceph-mon[94114]: pgmap v531: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-03-17T08:03:40.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f949809f4d0 msgr2=0x7f94980a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:03:40.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f949809f4d0 0x7f94980a1980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005950 tx=0x7f94a400b410 comp rx=0 tx=0).stop 2023-03-17T08:03:40.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 msgr2=0x7f94b0194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:03:40.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 0x7f94b0194ef0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94a000b560 tx=0x7f94a000b870 comp rx=0 tx=0).stop 2023-03-17T08:03:40.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 shutdown_connections 2023-03-17T08:03:40.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b01007f0 0x7f94b019c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:40.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94b00ff3c0 0x7f94b0194ef0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:40.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f949809f4d0 0x7f94980a1980 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:40.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 --2- 172.21.15.82:0/3947207015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94b00ffd70 0x7f94b0195430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:03:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 >> 172.21.15.82:0/3947207015 conn(0x7f94b00f9f00 msgr2=0x7f94b01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:03:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 shutdown_connections 2023-03-17T08:03:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:03:10.894+0000 7f94b49b2700 1 -- 172.21.15.82:0/3947207015 wait complete. 2023-03-17T08:03:41.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:41.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:42.146 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:42.146 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:03:44.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:44.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:44.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:44.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:03:44.085 DEBUG:teuthology.orchestra.run.smithi082:osd.5> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.5.service 2023-03-17T08:03:44.088 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:22 smithi078 ceph-mon[94114]: pgmap v532: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-03-17T08:03:45.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:24 smithi078 ceph-mon[94114]: pgmap v533: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-03-17T08:03:45.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:26 smithi078 ceph-mon[94114]: pgmap v534: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:03:45.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:28 smithi078 ceph-mon[94114]: pgmap v535: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-03-17T08:03:46.695 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:30 smithi078 ceph-mon[94114]: pgmap v536: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:32 smithi078 ceph-mon[94114]: pgmap v537: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:34 smithi078 ceph-mon[94114]: pgmap v538: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:36 smithi078 ceph-mon[94114]: pgmap v539: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:38 smithi078 ceph-mon[94114]: pgmap v540: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:40 smithi078 ceph-mon[94114]: pgmap v541: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:42 smithi078 ceph-mon[94114]: pgmap v542: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:22 smithi035 ceph-mon[92535]: pgmap v532: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-03-17T08:03:46.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:24 smithi035 ceph-mon[92535]: pgmap v533: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:26 smithi035 ceph-mon[92535]: pgmap v534: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:28 smithi035 ceph-mon[92535]: pgmap v535: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:30 smithi035 ceph-mon[92535]: pgmap v536: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:32 smithi035 ceph-mon[92535]: pgmap v537: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:34 smithi035 ceph-mon[92535]: pgmap v538: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:36 smithi035 ceph-mon[92535]: pgmap v539: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:38 smithi035 ceph-mon[92535]: pgmap v540: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:47.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:40 smithi035 ceph-mon[92535]: pgmap v541: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:49.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:42 smithi035 ceph-mon[92535]: pgmap v542: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:49.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:12 smithi082 ceph-mon[94281]: pgmap v520: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:51.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:12 smithi082 ceph-mon[94281]: from='osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-17T08:03:51.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:12 smithi082 ceph-mon[94281]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-03-17T08:03:51.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:13 smithi082 ceph-mon[94281]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-03-17T08:03:51.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:13 smithi082 ceph-mon[94281]: osdmap e37: 6 total, 5 up, 6 in 2023-03-17T08:03:51.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:51.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:13 smithi082 ceph-mon[94281]: from='osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:03:51.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:13 smithi082 ceph-mon[94281]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:03:51.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: pgmap v522: 1 pgs: 1 active+clean; 577 KiB data, 30 MiB used, 447 GiB / 447 GiB avail 2023-03-17T08:03:51.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:03:51.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: osdmap e38: 6 total, 5 up, 6 in 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:52.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: osd.5 [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] boot 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: osdmap e39: 6 total, 6 up, 6 in 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:15 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:03:52.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:15 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:03:52.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:15 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi082 2023-03-17T08:03:52.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:15 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 8584M 2023-03-17T08:03:52.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:15 smithi082 ceph-mon[94281]: osdmap e40: 6 total, 6 up, 6 in 2023-03-17T08:03:52.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:16 smithi082 ceph-mon[94281]: pgmap v525: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:52.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:16 smithi082 ceph-mon[94281]: osdmap e41: 6 total, 6 up, 6 in 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:18 smithi082 ceph-mon[94281]: pgmap v528: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:18 smithi082 ceph-mon[94281]: osdmap e42: 6 total, 6 up, 6 in 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:19 smithi082 ceph-mon[94281]: osdmap e43: 6 total, 6 up, 6 in 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:20 smithi082 ceph-mon[94281]: pgmap v531: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:22 smithi082 ceph-mon[94281]: pgmap v532: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:24 smithi082 ceph-mon[94281]: pgmap v533: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-03-17T08:03:53.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:26 smithi082 ceph-mon[94281]: pgmap v534: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:03:53.594 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:28 smithi082 ceph-mon[94281]: pgmap v535: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-03-17T08:03:53.594 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:30 smithi082 ceph-mon[94281]: pgmap v536: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-03-17T08:03:53.594 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:32 smithi082 ceph-mon[94281]: pgmap v537: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:53.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:34 smithi082 ceph-mon[94281]: pgmap v538: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:53.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:36 smithi082 ceph-mon[94281]: pgmap v539: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:53.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:38 smithi082 ceph-mon[94281]: pgmap v540: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:40 smithi082 ceph-mon[94281]: pgmap v541: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:42 smithi082 ceph-mon[94281]: pgmap v542: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:44 smithi082 ceph-mon[94281]: pgmap v543: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:46 smithi082 ceph-mon[94281]: pgmap v544: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:48 smithi082 ceph-mon[94281]: pgmap v545: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.176 INFO:tasks.cephadm:Deploying osd.6 on smithi035 with /dev/vg_nvme/lv_2... 2023-03-17T08:03:54.723 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-03-17T08:03:54.724 INFO:journalctl@ceph.osd.5.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:03:54.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:50 smithi082 ceph-mon[94281]: pgmap v546: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:52 smithi082 ceph-mon[94281]: pgmap v547: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:54 smithi082 ceph-mon[94281]: pgmap v548: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:44 smithi078 ceph-mon[94114]: pgmap v543: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:46 smithi078 ceph-mon[94114]: pgmap v544: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:48 smithi078 ceph-mon[94114]: pgmap v545: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:54.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:50 smithi078 ceph-mon[94114]: pgmap v546: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:55.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:52 smithi078 ceph-mon[94114]: pgmap v547: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:55.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:54 smithi078 ceph-mon[94114]: pgmap v548: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:55.850 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:44 smithi035 ceph-mon[92535]: pgmap v543: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:55.851 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:46 smithi035 ceph-mon[92535]: pgmap v544: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:55.851 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:48 smithi035 ceph-mon[92535]: pgmap v545: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:56.292 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:50 smithi035 ceph-mon[92535]: pgmap v546: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:56.292 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:52 smithi035 ceph-mon[92535]: pgmap v547: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:56.292 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:54 smithi035 ceph-mon[92535]: pgmap v548: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:56.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:56 smithi078 ceph-mon[94114]: pgmap v549: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:56.995 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:56 smithi082 ceph-mon[94281]: pgmap v549: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:56.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:56 smithi035 ceph-mon[92535]: pgmap v549: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:57.176 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:03:58.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:03:58 smithi078 ceph-mon[94114]: pgmap v550: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:59.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:03:58 smithi082 ceph-mon[94281]: pgmap v550: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:59.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:03:58 smithi035 ceph-mon[92535]: pgmap v550: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:03:59.602 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-03-17T08:03:59.603 INFO:teuthology.orchestra.run.smithi035.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-03-17T08:03:59.603 INFO:teuthology.orchestra.run.smithi035.stderr: stderr: 10+0 records in 2023-03-17T08:03:59.603 INFO:teuthology.orchestra.run.smithi035.stderr:10+0 records out 2023-03-17T08:03:59.603 INFO:teuthology.orchestra.run.smithi035.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109714 s, 956 MB/s 2023-03-17T08:03:59.603 INFO:teuthology.orchestra.run.smithi035.stderr: stderr: 2023-03-17T08:03:59.603 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping successful for: 2023-03-17T08:03:59.603 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi035:vg_nvme/lv_2 2023-03-17T08:04:00.263 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:04:00.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:00 smithi082 ceph-mon[94281]: pgmap v551: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:00.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:00 smithi078 ceph-mon[94114]: pgmap v551: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:00.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:00 smithi035 ceph-mon[92535]: pgmap v551: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:01.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 -- 172.21.15.35:0/565418153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c1014a0 msgr2=0x7f251c1018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:04:02.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 --2- 172.21.15.35:0/565418153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c1014a0 0x7f251c1018f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510009ca0 comp rx=0 tx=0).stop 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 -- 172.21.15.35:0/565418153 shutdown_connections 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 --2- 172.21.15.35:0/565418153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f251c101e30 0x7f251c1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 --2- 172.21.15.35:0/565418153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c1002a0 0x7f251c1006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 --2- 172.21.15.35:0/565418153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c1014a0 0x7f251c1018f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 -- 172.21.15.35:0/565418153 >> 172.21.15.35:0/565418153 conn(0x7f251c0fb8f0 msgr2=0x7f251c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 -- 172.21.15.35:0/565418153 shutdown_connections 2023-03-17T08:04:02.606 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.661+0000 7f25233b5700 1 -- 172.21.15.35:0/565418153 wait complete. 2023-03-17T08:04:02.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:02 smithi078 ceph-mon[94114]: pgmap v552: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:03.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:04:03.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:04:03.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 Processor -- start 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 -- start start 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f251c1002a0 0x7f251c195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c1014a0 0x7f251c1964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 0x7f251c19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c19db10 con 0x7f251c101e30 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c19dc50 con 0x7f251c1002a0 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.662+0000 7f25233b5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c19dde0 con 0x7f251c1014a0 2023-03-17T08:04:03.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 0x7f251c19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:04:04.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 0x7f251c19d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39492/0 (socket says 172.21.15.35:39492) 2023-03-17T08:04:04.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 -- 172.21.15.35:0/774870197 learned_addr learned my addr 172.21.15.35:0/774870197 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2520950700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c1014a0 0x7f251c1964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521151700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f251c1002a0 0x7f251c195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 -- 172.21.15.35:0/774870197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c1014a0 msgr2=0x7f251c1964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c1014a0 0x7f251c1964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 -- 172.21.15.35:0/774870197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f251c1002a0 msgr2=0x7f251c195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f251c1002a0 0x7f251c195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 -- 172.21.15.35:0/774870197 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100095f0 con 0x7f251c101e30 2023-03-17T08:04:04.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f2521952700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 0x7f251c19d540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f251400b9a0 tx=0x7f251400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400c930 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2514014440 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c10bba0 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.663+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140075d0 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.664+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c10ba10 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.664+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c19e5a0 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.665+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f25140145b0 con 0x7f251c101e30 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.666+0000 7f250e7fc700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f250809f550 0x7f25080a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:04:04.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.666+0000 7f2521151700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f250809f550 0x7f25080a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:04:04.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.666+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f2514006e40 con 0x7f251c101e30 2023-03-17T08:04:04.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.667+0000 7f2521151700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f250809f550 0x7f25080a1a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2518005950 tx=0x7f25180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:04:04.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.671+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f2514093c10 con 0x7f251c101e30 2023-03-17T08:04:04.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:01.880+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f251c060ec0 con 0x7f250809f550 2023-03-17T08:04:04.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:03 smithi078 ceph-mon[94114]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:04:04.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:04 smithi078 ceph-mon[94114]: pgmap v553: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:04.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:02 smithi035 ceph-mon[92535]: pgmap v552: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:04.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:04:04.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:04:04.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:04.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:03 smithi035 ceph-mon[92535]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:04:04.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:04 smithi035 ceph-mon[92535]: pgmap v553: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:04.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:02 smithi082 ceph-mon[94281]: pgmap v552: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:04.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:04:05.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:04:05.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:05.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:03 smithi082 ceph-mon[94281]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:04:05.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:04 smithi082 ceph-mon[94281]: pgmap v553: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:05.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:05 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1672283740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf1b5136-d013-4824-8907-958e6fe0f471"}]: dispatch 2023-03-17T08:04:06.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:05 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1672283740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf1b5136-d013-4824-8907-958e6fe0f471"}]': finished 2023-03-17T08:04:06.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:05 smithi035 ceph-mon[92535]: osdmap e44: 7 total, 6 up, 7 in 2023-03-17T08:04:06.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:06.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:05 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1672283740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf1b5136-d013-4824-8907-958e6fe0f471"}]: dispatch 2023-03-17T08:04:07.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:05 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1672283740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf1b5136-d013-4824-8907-958e6fe0f471"}]': finished 2023-03-17T08:04:07.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:05 smithi078 ceph-mon[94114]: osdmap e44: 7 total, 6 up, 7 in 2023-03-17T08:04:07.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:07.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:06 smithi035 ceph-mon[92535]: pgmap v554: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:07.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:06 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3312637191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:04:07.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:06 smithi078 ceph-mon[94114]: pgmap v554: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:07.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:06 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3312637191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:04:07.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:05 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1672283740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf1b5136-d013-4824-8907-958e6fe0f471"}]: dispatch 2023-03-17T08:04:08.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:05 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1672283740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf1b5136-d013-4824-8907-958e6fe0f471"}]': finished 2023-03-17T08:04:08.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:05 smithi082 ceph-mon[94281]: osdmap e44: 7 total, 6 up, 7 in 2023-03-17T08:04:08.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:08.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:06 smithi082 ceph-mon[94281]: pgmap v554: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:09.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:06 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3312637191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:04:09.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:08 smithi082 ceph-mon[94281]: pgmap v556: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:09.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:08 smithi035 ceph-mon[92535]: pgmap v556: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:09.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:08 smithi078 ceph-mon[94114]: pgmap v556: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:10.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:10 smithi035 ceph-mon[92535]: pgmap v557: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:11.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:10 smithi082 ceph-mon[94281]: pgmap v557: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:12.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:10 smithi078 ceph-mon[94114]: pgmap v557: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:12.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:12 smithi035 ceph-mon[92535]: pgmap v558: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:12.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-03-17T08:04:12.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:13.284 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:12 smithi082 ceph-mon[94281]: pgmap v558: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:13.284 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-03-17T08:04:14.492 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:14.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:12 smithi078 ceph-mon[94114]: pgmap v558: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:14.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-03-17T08:04:14.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:14.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:13 smithi082 ceph-mon[94281]: Deploying daemon osd.6 on smithi035 2023-03-17T08:04:14.494 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:13 smithi035 ceph-mon[92535]: Deploying daemon osd.6 on smithi035 2023-03-17T08:04:14.494 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:14 smithi035 ceph-mon[92535]: pgmap v559: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:14.494 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:15.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:13 smithi078 ceph-mon[94114]: Deploying daemon osd.6 on smithi035 2023-03-17T08:04:16.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:14 smithi078 ceph-mon[94114]: pgmap v559: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:16.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:16.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:15 smithi035 ceph-mon[92535]: pgmap v560: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:15 smithi078 ceph-mon[94114]: pgmap v560: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:16.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:17.486 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:18.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:18.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:18.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:18.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:14 smithi082 ceph-mon[94281]: pgmap v559: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:20.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:20.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:15 smithi082 ceph-mon[94281]: pgmap v560: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:21.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:21.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:21.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:21.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:21.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:21.255 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:17 smithi035 ceph-mon[92535]: pgmap v561: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:22.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:17 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:22.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:17 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:22.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:17 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:22.662 INFO:teuthology.orchestra.run.smithi035.stdout:Created osd(s) 6 on host 'smithi035' 2023-03-17T08:04:22.663 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:17 smithi082 ceph-mon[94281]: pgmap v561: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:22.663 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:17 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:22.663 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:17 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:22.663 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:17 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:22.663 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: pgmap v562: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:23.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:24.880 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:24.880 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:21 smithi082 ceph-mon[94281]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:22 smithi082 ceph-mon[94281]: pgmap v563: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:22 smithi082 ceph-mon[94281]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:22 smithi082 ceph-mon[94281]: osdmap e45: 7 total, 6 up, 7 in 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:22 smithi082 ceph-mon[94281]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:04:24.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:17 smithi078 ceph-mon[94114]: pgmap v561: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:17 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:17 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:17 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: pgmap v562: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.543 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:21 smithi078 ceph-mon[94114]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:22 smithi078 ceph-mon[94114]: pgmap v563: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:22 smithi078 ceph-mon[94114]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:22 smithi078 ceph-mon[94114]: osdmap e45: 7 total, 6 up, 7 in 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:30.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:22 smithi078 ceph-mon[94114]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:04:30.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.086+0000 7f250e7fc700 1 -- 172.21.15.35:0/774870197 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f251c060ec0 con 0x7f250809f550 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f250809f550 msgr2=0x7f25080a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f250809f550 0x7f25080a1a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2518005950 tx=0x7f25180058e0 comp rx=0 tx=0).stop 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 msgr2=0x7f251c19d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 0x7f251c19d540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f251400b9a0 tx=0x7f251400bcb0 comp rx=0 tx=0).stop 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 shutdown_connections 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f250809f550 0x7f25080a1a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:33.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f251c101e30 0x7f251c19d540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:33.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f251c1002a0 0x7f251c195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:33.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 --2- 172.21.15.35:0/774870197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f251c1014a0 0x7f251c1964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:04:35.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.088+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 >> 172.21.15.35:0/774870197 conn(0x7f251c0fb8f0 msgr2=0x7f251c0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:04:35.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.089+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 shutdown_connections 2023-03-17T08:04:35.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:04:20.089+0000 7f25233b5700 1 -- 172.21.15.35:0/774870197 wait complete. 2023-03-17T08:04:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: pgmap v562: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:36.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:36.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:36.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:36.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:36.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:38.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:04:38.273 DEBUG:teuthology.orchestra.run.smithi035:osd.6> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.6.service 2023-03-17T08:04:38.276 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:04:41.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: osdmap e46: 7 total, 6 up, 7 in 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:04:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: pgmap v566: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi035 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 5724M 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] boot 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: osdmap e47: 7 total, 7 up, 7 in 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:24 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:25 smithi082 ceph-mon[94281]: osdmap e48: 7 total, 7 up, 7 in 2023-03-17T08:04:41.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:26 smithi082 ceph-mon[94281]: pgmap v569: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:42.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:28 smithi082 ceph-mon[94281]: pgmap v570: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:42.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:30 smithi082 ceph-mon[94281]: pgmap v571: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:42.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:32 smithi082 ceph-mon[94281]: pgmap v572: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:42.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:34 smithi082 ceph-mon[94281]: pgmap v573: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:42.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:36 smithi082 ceph-mon[94281]: pgmap v574: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:42.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: osdmap e46: 7 total, 6 up, 7 in 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:43.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:44.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:44.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:44.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: pgmap v566: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi035 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 5724M 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] boot 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: osdmap e47: 7 total, 7 up, 7 in 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:24 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:25 smithi078 ceph-mon[94114]: osdmap e48: 7 total, 7 up, 7 in 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:26 smithi078 ceph-mon[94114]: pgmap v569: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:28 smithi078 ceph-mon[94114]: pgmap v570: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:30 smithi078 ceph-mon[94114]: pgmap v571: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:44.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:32 smithi078 ceph-mon[94114]: pgmap v572: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:34 smithi078 ceph-mon[94114]: pgmap v573: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:36 smithi078 ceph-mon[94114]: pgmap v574: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:21 smithi035 ceph-mon[92535]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:22 smithi035 ceph-mon[92535]: pgmap v563: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:22 smithi035 ceph-mon[92535]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:22 smithi035 ceph-mon[92535]: osdmap e45: 7 total, 6 up, 7 in 2023-03-17T08:04:44.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:45.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:22 smithi035 ceph-mon[92535]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:04:45.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:04:45.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: osdmap e46: 7 total, 6 up, 7 in 2023-03-17T08:04:45.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:04:46.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: pgmap v566: 1 pgs: 1 active+clean; 577 KiB data, 36 MiB used, 536 GiB / 536 GiB avail 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi035 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 5724M 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: osd.6 [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] boot 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: osdmap e47: 7 total, 7 up, 7 in 2023-03-17T08:04:46.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:24 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:25 smithi035 ceph-mon[92535]: osdmap e48: 7 total, 7 up, 7 in 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:26 smithi035 ceph-mon[92535]: pgmap v569: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:28 smithi035 ceph-mon[92535]: pgmap v570: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:30 smithi035 ceph-mon[92535]: pgmap v571: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:32 smithi035 ceph-mon[92535]: pgmap v572: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:34 smithi035 ceph-mon[92535]: pgmap v573: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:47.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:36 smithi035 ceph-mon[92535]: pgmap v574: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:47.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:38 smithi035 ceph-mon[92535]: pgmap v575: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:40 smithi035 ceph-mon[92535]: pgmap v576: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:42 smithi035 ceph-mon[92535]: pgmap v577: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:44 smithi035 ceph-mon[92535]: pgmap v578: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:46 smithi035 ceph-mon[92535]: pgmap v579: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:38 smithi082 ceph-mon[94281]: pgmap v575: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:40 smithi082 ceph-mon[94281]: pgmap v576: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:42 smithi082 ceph-mon[94281]: pgmap v577: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:44 smithi082 ceph-mon[94281]: pgmap v578: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:48.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:46 smithi082 ceph-mon[94281]: pgmap v579: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:49.305 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:38 smithi078 ceph-mon[94114]: pgmap v575: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:50.266 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:40 smithi078 ceph-mon[94114]: pgmap v576: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:50.266 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:42 smithi078 ceph-mon[94114]: pgmap v577: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:50.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:44 smithi078 ceph-mon[94114]: pgmap v578: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:50.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:46 smithi078 ceph-mon[94114]: pgmap v579: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:50.760 INFO:tasks.cephadm:Deploying osd.7 on smithi078 with /dev/vg_nvme/lv_2... 2023-03-17T08:04:50.761 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-03-17T08:04:50.762 INFO:journalctl@ceph.osd.6.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:04:52.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:48 smithi082 ceph-mon[94281]: pgmap v580: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:52.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:50 smithi082 ceph-mon[94281]: pgmap v581: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:52.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:48 smithi078 ceph-mon[94114]: pgmap v580: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:52.984 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:50 smithi078 ceph-mon[94114]: pgmap v581: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:52.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:48 smithi035 ceph-mon[92535]: pgmap v580: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:53.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:50 smithi035 ceph-mon[92535]: pgmap v581: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:53.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:52 smithi035 ceph-mon[92535]: pgmap v582: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:53.528 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:52 smithi082 ceph-mon[94281]: pgmap v582: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:54.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:52 smithi078 ceph-mon[94114]: pgmap v582: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:54.075 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T08:04:55.052 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:54 smithi035 ceph-mon[92535]: pgmap v583: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:55.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:54 smithi082 ceph-mon[94281]: pgmap v583: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:56.141 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:54 smithi078 ceph-mon[94114]: pgmap v583: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:56.142 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-03-17T08:04:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-03-17T08:04:56.829 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2023-03-17T08:04:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2023-03-17T08:04:56.829 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110644 s, 948 MB/s 2023-03-17T08:04:56.829 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2023-03-17T08:04:56.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi078:vg_nvme/lv_2 2023-03-17T08:04:58.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:56 smithi035 ceph-mon[92535]: pgmap v584: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:59.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:56 smithi082 ceph-mon[94281]: pgmap v584: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:59.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:56 smithi078 ceph-mon[94114]: pgmap v584: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:59.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:04:58 smithi035 ceph-mon[92535]: pgmap v585: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:59.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:04:58 smithi082 ceph-mon[94281]: pgmap v585: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:59.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:04:58 smithi078 ceph-mon[94114]: pgmap v585: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:04:59.814 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T08:05:00.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:00 smithi078 ceph-mon[94114]: pgmap v586: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:00.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:00 smithi035 ceph-mon[92535]: pgmap v586: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:00.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:00 smithi082 ceph-mon[94281]: pgmap v586: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:01.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 -- 172.21.15.78:0/1651627570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101e10 msgr2=0x7fb06c1086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 --2- 172.21.15.78:0/1651627570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101e10 0x7fb06c1086d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb06400b0a0 tx=0x7fb06400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:05:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 -- 172.21.15.78:0/1651627570 shutdown_connections 2023-03-17T08:05:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 --2- 172.21.15.78:0/1651627570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101e10 0x7fb06c1086d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:02.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 --2- 172.21.15.78:0/1651627570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb06c100280 0x7fb06c100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:02.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 --2- 172.21.15.78:0/1651627570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb06c101480 0x7fb06c1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:02.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 -- 172.21.15.78:0/1651627570 >> 172.21.15.78:0/1651627570 conn(0x7fb06c0fb890 msgr2=0x7fb06c0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:05:02.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 -- 172.21.15.78:0/1651627570 shutdown_connections 2023-03-17T08:05:02.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 -- 172.21.15.78:0/1651627570 wait complete. 2023-03-17T08:05:02.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.134+0000 7fb073652700 1 Processor -- start 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 -- start start 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb06c100280 0x7fb06c074820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 0x7fb06c072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb06c101e10 0x7fb06c0733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c073b30 con 0x7fb06c100280 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c073ca0 con 0x7fb06c101480 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c1a00c0 con 0x7fb06c101e10 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 0x7fb06c072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 0x7fb06c072e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49326/0 (socket says 172.21.15.78:49326) 2023-03-17T08:05:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 -- 172.21.15.78:0/1331432504 learned_addr learned my addr 172.21.15.78:0/1331432504 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb0713ee700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb06c100280 0x7fb06c074820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 -- 172.21.15.78:0/1331432504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb06c101e10 msgr2=0x7fb06c0733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb06c101e10 0x7fb06c0733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 -- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb06c100280 msgr2=0x7fb06c074820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb06c100280 0x7fb06c074820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 -- 172.21.15.78:0/1331432504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064009d00 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb070bed700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 0x7fb06c072e70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb06800e9c0 tx=0x7fb06800ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680097b0 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c10ba60 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb068004cc0 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680055f0 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.135+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c10b8d0 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.137+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c107920 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.138+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb068004750 con 0x7fb06c101480 2023-03-17T08:05:03.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.138+0000 7fb0627fc700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb05809f4d0 0x7fb0580a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:03.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.138+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fb068014070 con 0x7fb06c101480 2023-03-17T08:05:03.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.138+0000 7fb0713ee700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb05809f4d0 0x7fb0580a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:03.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.139+0000 7fb0713ee700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb05809f4d0 0x7fb0580a1980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb05c005950 tx=0x7fb05c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:05:03.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.142+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mon.2 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb0680948a0 con 0x7fb06c101480 2023-03-17T08:05:03.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:01.340+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb06c061b60 con 0x7fb05809f4d0 2023-03-17T08:05:03.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:02 smithi035 ceph-mon[92535]: pgmap v587: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:04.070 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:05:04.070 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:05:04.071 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:04.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:02 smithi082 ceph-mon[94281]: pgmap v587: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:04.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:05:04.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:05:04.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:04.071 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:02 smithi078 ceph-mon[94114]: pgmap v587: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:05:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:05:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:03 smithi078 ceph-mon[94114]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:05:04.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:03 smithi035 ceph-mon[92535]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:05:04.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:03 smithi082 ceph-mon[94281]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:05:04.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:04 smithi078 ceph-mon[94114]: pgmap v588: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:05.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:04 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/552606048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]: dispatch 2023-03-17T08:05:05.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:04 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]: dispatch 2023-03-17T08:05:05.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:04 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]': finished 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:04 smithi078 ceph-mon[94114]: osdmap e49: 8 total, 7 up, 8 in 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:04 smithi035 ceph-mon[92535]: pgmap v588: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:04 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/552606048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]: dispatch 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:04 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]: dispatch 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:04 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]': finished 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:04 smithi035 ceph-mon[92535]: osdmap e49: 8 total, 7 up, 8 in 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:04 smithi082 ceph-mon[94281]: pgmap v588: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:04 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/552606048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]: dispatch 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:04 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]: dispatch 2023-03-17T08:05:05.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:04 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9212f7b3-e1a7-4ea7-8666-55936c0c401d"}]': finished 2023-03-17T08:05:05.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:04 smithi082 ceph-mon[94281]: osdmap e49: 8 total, 7 up, 8 in 2023-03-17T08:05:05.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:05.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:05 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/345493135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:05:06.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:05 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/345493135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:05:06.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:05 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/345493135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:05:06.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:06 smithi082 ceph-mon[94281]: pgmap v590: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:07.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:06 smithi035 ceph-mon[92535]: pgmap v590: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:07.737 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:06 smithi078 ceph-mon[94114]: pgmap v590: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:08.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:08 smithi082 ceph-mon[94281]: pgmap v591: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:09.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:08 smithi035 ceph-mon[92535]: pgmap v591: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:11.579 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:08 smithi078 ceph-mon[94114]: pgmap v591: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:11.918 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:10 smithi082 ceph-mon[94281]: pgmap v592: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:12.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-03-17T08:05:12.771 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:12.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:10 smithi035 ceph-mon[92535]: pgmap v592: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:12.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-03-17T08:05:12.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:12.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:10 smithi078 ceph-mon[94114]: pgmap v592: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:12.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-03-17T08:05:12.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:12.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:12 smithi082 ceph-mon[94281]: pgmap v593: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:12.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:12 smithi082 ceph-mon[94281]: Deploying daemon osd.7 on smithi078 2023-03-17T08:05:14.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:12 smithi035 ceph-mon[92535]: pgmap v593: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:15.523 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:12 smithi035 ceph-mon[92535]: Deploying daemon osd.7 on smithi078 2023-03-17T08:05:15.523 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:12 smithi078 ceph-mon[94114]: pgmap v593: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:15.523 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:12 smithi078 ceph-mon[94114]: Deploying daemon osd.7 on smithi078 2023-03-17T08:05:15.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:14 smithi082 ceph-mon[94281]: pgmap v594: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:15.524 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:14 smithi035 ceph-mon[92535]: pgmap v594: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:15.524 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:14 smithi078 ceph-mon[94114]: pgmap v594: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:16.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:16 smithi078 ceph-mon[94114]: pgmap v595: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:17.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:17.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:17.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:16 smithi035 ceph-mon[92535]: pgmap v595: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:16 smithi082 ceph-mon[94281]: pgmap v595: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:17.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:05:18.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.279+0000 7fb0627fc700 1 -- 172.21.15.78:0/1331432504 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb06c061b60 con 0x7fb05809f4d0 2023-03-17T08:05:18.847 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 7 on host 'smithi078' 2023-03-17T08:05:19.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb05809f4d0 msgr2=0x7fb0580a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb05809f4d0 0x7fb0580a1980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb05c005950 tx=0x7fb05c0058e0 comp rx=0 tx=0).stop 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 msgr2=0x7fb06c072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 0x7fb06c072e70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb06800e9c0 tx=0x7fb06800ed80 comp rx=0 tx=0).stop 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 shutdown_connections 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb06c101e10 0x7fb06c0733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb05809f4d0 0x7fb0580a1980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb06c100280 0x7fb06c074820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 --2- 172.21.15.78:0/1331432504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb06c101480 0x7fb06c072e70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 >> 172.21.15.78:0/1331432504 conn(0x7fb06c0fb890 msgr2=0x7fb06c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 shutdown_connections 2023-03-17T08:05:20.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:05:18.282+0000 7fb073652700 1 -- 172.21.15.78:0/1331432504 wait complete. 2023-03-17T08:05:21.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:18 smithi078 ceph-mon[94114]: pgmap v596: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:21.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:21.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:21.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:21.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:22.477 DEBUG:teuthology.orchestra.run.smithi078:osd.7> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.7.service 2023-03-17T08:05:22.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:20 smithi078 ceph-mon[94114]: pgmap v597: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:23.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:20 smithi078 ceph-mon[94114]: from='osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-17T08:05:23.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:20 smithi078 ceph-mon[94114]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-17T08:05:23.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:21 smithi078 ceph-mon[94114]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-03-17T08:05:23.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:21 smithi078 ceph-mon[94114]: osdmap e50: 8 total, 7 up, 8 in 2023-03-17T08:05:23.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:23.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:21 smithi078 ceph-mon[94114]: from='osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:05:23.490 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:21 smithi078 ceph-mon[94114]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:05:24.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: pgmap v599: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:24.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:05:24.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: osdmap e51: 8 total, 7 up, 8 in 2023-03-17T08:05:24.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:24.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:24.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:24.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:24.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:24.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:24.501 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:24.501 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:24.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:25.577 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:05:27.070 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:27.070 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:05:27.070 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:27.070 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:05:27.071 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:27.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:05:27.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:05:27.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi078 2023-03-17T08:05:27.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 5722M 2023-03-17T08:05:27.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] boot 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: osdmap e52: 8 total, 8 up, 8 in 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:23 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:24 smithi078 ceph-mon[94114]: pgmap v602: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:24 smithi078 ceph-mon[94114]: osdmap e53: 8 total, 8 up, 8 in 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:25 smithi078 ceph-mon[94114]: osdmap e54: 8 total, 8 up, 8 in 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:26 smithi078 ceph-mon[94114]: pgmap v605: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:28.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:26 smithi078 ceph-mon[94114]: osdmap e55: 8 total, 8 up, 8 in 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:18 smithi035 ceph-mon[92535]: pgmap v596: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:20 smithi035 ceph-mon[92535]: pgmap v597: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:28.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:20 smithi035 ceph-mon[92535]: from='osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:20 smithi035 ceph-mon[92535]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:21 smithi035 ceph-mon[92535]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:21 smithi035 ceph-mon[92535]: osdmap e50: 8 total, 7 up, 8 in 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:21 smithi035 ceph-mon[92535]: from='osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:21 smithi035 ceph-mon[92535]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: pgmap v599: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: osdmap e51: 8 total, 7 up, 8 in 2023-03-17T08:05:28.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:29.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:29.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:29.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:29.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:29.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:29.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:29.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:29.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:30.422 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi078 2023-03-17T08:05:30.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 5722M 2023-03-17T08:05:30.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:30.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] boot 2023-03-17T08:05:30.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: osdmap e52: 8 total, 8 up, 8 in 2023-03-17T08:05:30.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:23 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:30.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:24 smithi035 ceph-mon[92535]: pgmap v602: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:30.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:24 smithi035 ceph-mon[92535]: osdmap e53: 8 total, 8 up, 8 in 2023-03-17T08:05:31.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:25 smithi035 ceph-mon[92535]: osdmap e54: 8 total, 8 up, 8 in 2023-03-17T08:05:31.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:26 smithi035 ceph-mon[92535]: pgmap v605: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:31.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:26 smithi035 ceph-mon[92535]: osdmap e55: 8 total, 8 up, 8 in 2023-03-17T08:05:31.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:27 smithi035 ceph-mon[92535]: osdmap e56: 8 total, 8 up, 8 in 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:18 smithi082 ceph-mon[94281]: pgmap v596: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:20 smithi082 ceph-mon[94281]: pgmap v597: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:20 smithi082 ceph-mon[94281]: from='osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-17T08:05:31.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:20 smithi082 ceph-mon[94281]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-03-17T08:05:31.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:21 smithi082 ceph-mon[94281]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-03-17T08:05:31.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:21 smithi082 ceph-mon[94281]: osdmap e50: 8 total, 7 up, 8 in 2023-03-17T08:05:34.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:34.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:21 smithi082 ceph-mon[94281]: from='osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:05:34.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:21 smithi082 ceph-mon[94281]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:05:34.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: pgmap v599: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: osdmap e51: 8 total, 7 up, 8 in 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:34.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:05:35.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:35.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi078 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 5722M 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: osd.7 [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] boot 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: osdmap e52: 8 total, 8 up, 8 in 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:23 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:24 smithi082 ceph-mon[94281]: pgmap v602: 1 pgs: 1 active+clean; 577 KiB data, 42 MiB used, 626 GiB / 626 GiB avail 2023-03-17T08:05:35.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:24 smithi082 ceph-mon[94281]: osdmap e53: 8 total, 8 up, 8 in 2023-03-17T08:05:36.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:25 smithi082 ceph-mon[94281]: osdmap e54: 8 total, 8 up, 8 in 2023-03-17T08:05:36.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:26 smithi082 ceph-mon[94281]: pgmap v605: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:36.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:26 smithi082 ceph-mon[94281]: osdmap e55: 8 total, 8 up, 8 in 2023-03-17T08:05:36.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:27 smithi082 ceph-mon[94281]: osdmap e56: 8 total, 8 up, 8 in 2023-03-17T08:05:36.363 INFO:tasks.cephadm:Deploying osd.8 on smithi082 with /dev/vg_nvme/lv_2... 2023-03-17T08:05:38.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-03-17T08:05:38.812 INFO:journalctl@ceph.osd.7.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:28 smithi035 ceph-mon[92535]: pgmap v608: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:30 smithi035 ceph-mon[92535]: pgmap v609: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:32 smithi035 ceph-mon[92535]: pgmap v610: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:34 smithi035 ceph-mon[92535]: pgmap v611: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:36 smithi035 ceph-mon[92535]: pgmap v612: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:38 smithi035 ceph-mon[92535]: pgmap v613: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:28 smithi082 ceph-mon[94281]: pgmap v608: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:30 smithi082 ceph-mon[94281]: pgmap v609: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:32 smithi082 ceph-mon[94281]: pgmap v610: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:34 smithi082 ceph-mon[94281]: pgmap v611: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:36 smithi082 ceph-mon[94281]: pgmap v612: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:38 smithi082 ceph-mon[94281]: pgmap v613: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:27 smithi078 ceph-mon[94114]: osdmap e56: 8 total, 8 up, 8 in 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:28 smithi078 ceph-mon[94114]: pgmap v608: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:30 smithi078 ceph-mon[94114]: pgmap v609: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:32 smithi078 ceph-mon[94114]: pgmap v610: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:34 smithi078 ceph-mon[94114]: pgmap v611: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:36 smithi078 ceph-mon[94114]: pgmap v612: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:38.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:38 smithi078 ceph-mon[94114]: pgmap v613: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:39.460 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:05:44.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:40 smithi082 ceph-mon[94281]: pgmap v614: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:44.628 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:40 smithi035 ceph-mon[92535]: pgmap v614: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:44.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:42 smithi035 ceph-mon[92535]: pgmap v615: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:44.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:40 smithi078 ceph-mon[94114]: pgmap v614: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:44.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:42 smithi078 ceph-mon[94114]: pgmap v615: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-03-17T08:05:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-03-17T08:05:44.630 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-03-17T08:05:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-03-17T08:05:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110712 s, 947 MB/s 2023-03-17T08:05:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-03-17T08:05:44.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2023-03-17T08:05:45.833 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:42 smithi082 ceph-mon[94281]: pgmap v615: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:47.048 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:44 smithi035 ceph-mon[92535]: pgmap v616: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:47.048 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:46 smithi035 ceph-mon[92535]: pgmap v617: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:47.049 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:44 smithi078 ceph-mon[94114]: pgmap v616: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:47.049 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:46 smithi078 ceph-mon[94114]: pgmap v617: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:48.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:44 smithi082 ceph-mon[94281]: pgmap v616: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:48.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:46 smithi082 ceph-mon[94281]: pgmap v617: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:05:48.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:48 smithi082 ceph-mon[94281]: pgmap v618: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:49.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:48 smithi035 ceph-mon[92535]: pgmap v618: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:49.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:48 smithi078 ceph-mon[94114]: pgmap v618: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 -- 172.21.15.82:0/273470765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ff410 msgr2=0x7f3d340ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 --2- 172.21.15.82:0/273470765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ff410 0x7f3d340ff880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009990 tx=0x7f3d28009ca0 comp rx=0 tx=0).stop 2023-03-17T08:05:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 -- 172.21.15.82:0/273470765 shutdown_connections 2023-03-17T08:05:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 --2- 172.21.15.82:0/273470765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3d340ffdc0 0x7f3d34107670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 --2- 172.21.15.82:0/273470765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d34100840 0x7f3d34100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 --2- 172.21.15.82:0/273470765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ff410 0x7f3d340ff880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 -- 172.21.15.82:0/273470765 >> 172.21.15.82:0/273470765 conn(0x7f3d340f9f90 msgr2=0x7f3d340fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:05:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 -- 172.21.15.82:0/273470765 shutdown_connections 2023-03-17T08:05:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.993+0000 7f3d3948d700 1 -- 172.21.15.82:0/273470765 wait complete. 2023-03-17T08:05:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 Processor -- start 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 -- start start 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d340ff410 0x7f3d34195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 0x7f3d34196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3d34100840 0x7f3d3419d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3419da50 con 0x7f3d34100840 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3419db90 con 0x7f3d340ff410 2023-03-17T08:05:52.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d3948d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3419dd20 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 0x7f3d34196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 0x7f3d34196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52928/0 (socket says 172.21.15.82:52928) 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 -- 172.21.15.82:0/2830826582 learned_addr learned my addr 172.21.15.82:0/2830826582 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d32ffd700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d340ff410 0x7f3d34195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d337fe700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3d34100840 0x7f3d3419d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 -- 172.21.15.82:0/2830826582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d340ff410 msgr2=0x7f3d34195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d340ff410 0x7f3d34195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 -- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3d34100840 msgr2=0x7f3d3419d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3d34100840 0x7f3d3419d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.994+0000 7f3d327fc700 1 -- 172.21.15.82:0/2830826582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d280095f0 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.995+0000 7f3d327fc700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 0x7f3d34196400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d28005910 tx=0x7f3d28004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.995+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2801d070 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.995+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3410aa80 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.995+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d2800beb0 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.995+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800fe50 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.995+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3410a8f0 con 0x7f3d340ffdc0 2023-03-17T08:05:52.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.996+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d341072c0 con 0x7f3d340ffdc0 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.997+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3d2800ba20 con 0x7f3d340ffdc0 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.997+0000 7f3d1bfff700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3d1c09f4d0 0x7f3d1c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.997+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f3d280cae00 con 0x7f3d340ffdc0 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.998+0000 7f3d32ffd700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3d1c09f4d0 0x7f3d1c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:48.998+0000 7f3d32ffd700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3d1c09f4d0 0x7f3d1c0a1980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009c60 tx=0x7f3d24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:49.001+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3d28095ae0 con 0x7f3d340ffdc0 2023-03-17T08:05:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:05:49.194+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d34061b50 con 0x7f3d1c09f4d0 2023-03-17T08:05:52.416 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:50 smithi035 ceph-mon[92535]: pgmap v619: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:50 smithi035 ceph-mon[92535]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:50 smithi078 ceph-mon[94114]: pgmap v619: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:50 smithi078 ceph-mon[94114]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:50 smithi082 ceph-mon[94281]: pgmap v619: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:50 smithi082 ceph-mon[94281]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:05:53.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:05:53.839 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:05:53.839 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:05:53.839 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:52 smithi035 ceph-mon[92535]: pgmap v620: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:53.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:52 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/177530552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]: dispatch 2023-03-17T08:05:53.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:52 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]: dispatch 2023-03-17T08:05:53.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:52 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]': finished 2023-03-17T08:05:53.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:52 smithi035 ceph-mon[92535]: osdmap e57: 9 total, 8 up, 9 in 2023-03-17T08:05:55.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:05:55.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/439376671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:05:55.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:52 smithi078 ceph-mon[94114]: pgmap v620: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:55.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:52 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/177530552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]: dispatch 2023-03-17T08:05:55.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:52 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]: dispatch 2023-03-17T08:05:55.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:52 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]': finished 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:52 smithi078 ceph-mon[94114]: osdmap e57: 9 total, 8 up, 9 in 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/439376671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:52 smithi082 ceph-mon[94281]: pgmap v620: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:52 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/177530552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]: dispatch 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:52 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]: dispatch 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:52 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "402f50a6-8d44-4cad-ba4b-273831715b55"}]': finished 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:52 smithi082 ceph-mon[94281]: osdmap e57: 9 total, 8 up, 9 in 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:05:55.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/439376671' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:05:55.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:54 smithi035 ceph-mon[92535]: pgmap v622: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:56.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:54 smithi078 ceph-mon[94114]: pgmap v622: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:56.799 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:54 smithi082 ceph-mon[94281]: pgmap v622: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:05:56.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:56 smithi035 ceph-mon[92535]: pgmap v623: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:56 smithi078 ceph-mon[94114]: pgmap v623: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:56 smithi082 ceph-mon[94281]: pgmap v623: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.878 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:58 smithi035 ceph-mon[92535]: pgmap v624: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.878 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-03-17T08:06:01.878 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:05:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:00 smithi035 ceph-mon[92535]: pgmap v625: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:00 smithi035 ceph-mon[92535]: Deploying daemon osd.8 on smithi082 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:58 smithi078 ceph-mon[94114]: pgmap v624: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:05:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:00 smithi078 ceph-mon[94114]: pgmap v625: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:00 smithi078 ceph-mon[94114]: Deploying daemon osd.8 on smithi082 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:58 smithi082 ceph-mon[94281]: pgmap v624: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:05:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:00 smithi082 ceph-mon[94281]: pgmap v625: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:01.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:00 smithi082 ceph-mon[94281]: Deploying daemon osd.8 on smithi082 2023-03-17T08:06:02.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:02 smithi035 ceph-mon[92535]: pgmap v626: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:03.272 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:02 smithi078 ceph-mon[94114]: pgmap v626: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:06.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:02 smithi082 ceph-mon[94281]: pgmap v626: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:06.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:04 smithi035 ceph-mon[92535]: pgmap v627: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:06.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:06.650 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:06.650 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:06:06.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:04 smithi078 ceph-mon[94114]: pgmap v627: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:06.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:09.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:09.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:06:09.512 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:04 smithi082 ceph-mon[94281]: pgmap v627: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:09.512 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:09.512 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:10.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:06:10.388 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 8 on host 'smithi082' 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.294+0000 7f3d1bfff700 1 -- 172.21.15.82:0/2830826582 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3d34061b50 con 0x7f3d1c09f4d0 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3d1c09f4d0 msgr2=0x7f3d1c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3d1c09f4d0 0x7f3d1c0a1980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009c60 tx=0x7f3d24009260 comp rx=0 tx=0).stop 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 msgr2=0x7f3d34196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 0x7f3d34196400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d28005910 tx=0x7f3d28004790 comp rx=0 tx=0).stop 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 shutdown_connections 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3d1c09f4d0 0x7f3d1c0a1980 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3d34100840 0x7f3d3419d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d340ff410 0x7f3d34195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 --2- 172.21.15.82:0/2830826582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d340ffdc0 0x7f3d34196400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 >> 172.21.15.82:0/2830826582 conn(0x7f3d340f9f90 msgr2=0x7f3d340fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:06:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 shutdown_connections 2023-03-17T08:06:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:06:06.297+0000 7f3d3948d700 1 -- 172.21.15.82:0/2830826582 wait complete. 2023-03-17T08:06:14.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: pgmap v628: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:16.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:16.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:06:16.653 DEBUG:teuthology.orchestra.run.smithi082:osd.8> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.8.service 2023-03-17T08:06:16.654 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:07 smithi082 ceph-mon[94281]: from='osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:07 smithi082 ceph-mon[94281]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:08 smithi082 ceph-mon[94281]: pgmap v629: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:08 smithi082 ceph-mon[94281]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:08 smithi082 ceph-mon[94281]: osdmap e58: 9 total, 8 up, 9 in 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:08 smithi082 ceph-mon[94281]: from='osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:08 smithi082 ceph-mon[94281]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: osdmap e59: 9 total, 8 up, 9 in 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:18.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] boot 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: osdmap e60: 9 total, 9 up, 9 in 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:10 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:10 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:10 smithi082 ceph-mon[94281]: pgmap v632: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:10 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi082 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:10 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 5722M 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:10 smithi082 ceph-mon[94281]: osdmap e61: 9 total, 9 up, 9 in 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:12 smithi082 ceph-mon[94281]: pgmap v635: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:18.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:12 smithi082 ceph-mon[94281]: osdmap e62: 9 total, 9 up, 9 in 2023-03-17T08:06:18.217 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:13 smithi082 ceph-mon[94281]: osdmap e63: 9 total, 9 up, 9 in 2023-03-17T08:06:18.217 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:14 smithi082 ceph-mon[94281]: pgmap v638: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:18.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:14 smithi082 ceph-mon[94281]: osdmap e64: 9 total, 9 up, 9 in 2023-03-17T08:06:21.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:15 smithi082 ceph-mon[94281]: pgmap v640: 1 pgs: 1 peering; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-03-17T08:06:21.590 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: pgmap v628: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:21.590 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:07 smithi035 ceph-mon[92535]: from='osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:07 smithi035 ceph-mon[92535]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:08 smithi035 ceph-mon[92535]: pgmap v629: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:08 smithi035 ceph-mon[92535]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:08 smithi035 ceph-mon[92535]: osdmap e58: 9 total, 8 up, 9 in 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:08 smithi035 ceph-mon[92535]: from='osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:08 smithi035 ceph-mon[92535]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:06:21.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: osdmap e59: 9 total, 8 up, 9 in 2023-03-17T08:06:21.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:21.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:21.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:21.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:21.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:23.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] boot 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: osdmap e60: 9 total, 9 up, 9 in 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:23.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:10 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:06:23.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:10 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:10 smithi035 ceph-mon[92535]: pgmap v632: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:10 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi082 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:10 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 5722M 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:10 smithi035 ceph-mon[92535]: osdmap e61: 9 total, 9 up, 9 in 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:12 smithi035 ceph-mon[92535]: pgmap v635: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:12 smithi035 ceph-mon[92535]: osdmap e62: 9 total, 9 up, 9 in 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:13 smithi035 ceph-mon[92535]: osdmap e63: 9 total, 9 up, 9 in 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:14 smithi035 ceph-mon[92535]: pgmap v638: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:24.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:14 smithi035 ceph-mon[92535]: osdmap e64: 9 total, 9 up, 9 in 2023-03-17T08:06:25.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:15 smithi035 ceph-mon[92535]: pgmap v640: 1 pgs: 1 peering; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-03-17T08:06:25.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:17 smithi035 ceph-mon[92535]: pgmap v641: 1 pgs: 1 peering; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-17T08:06:25.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:20 smithi035 ceph-mon[92535]: pgmap v642: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-03-17T08:06:25.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: pgmap v628: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:25.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:25.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:07 smithi078 ceph-mon[94114]: from='osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:07 smithi078 ceph-mon[94114]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:08 smithi078 ceph-mon[94114]: pgmap v629: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:08 smithi078 ceph-mon[94114]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:08 smithi078 ceph-mon[94114]: osdmap e58: 9 total, 8 up, 9 in 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:08 smithi078 ceph-mon[94114]: from='osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:08 smithi078 ceph-mon[94114]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:06:31.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: osdmap e59: 9 total, 8 up, 9 in 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: osd.8 [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] boot 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: osdmap e60: 9 total, 9 up, 9 in 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:10 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:10 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:06:31.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:10 smithi078 ceph-mon[94114]: pgmap v632: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:10 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi082 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:10 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 5722M 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:10 smithi078 ceph-mon[94114]: osdmap e61: 9 total, 9 up, 9 in 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:12 smithi078 ceph-mon[94114]: pgmap v635: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:12 smithi078 ceph-mon[94114]: osdmap e62: 9 total, 9 up, 9 in 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:13 smithi078 ceph-mon[94114]: osdmap e63: 9 total, 9 up, 9 in 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:14 smithi078 ceph-mon[94114]: pgmap v638: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:14 smithi078 ceph-mon[94114]: osdmap e64: 9 total, 9 up, 9 in 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:15 smithi078 ceph-mon[94114]: pgmap v640: 1 pgs: 1 peering; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-03-17T08:06:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:17 smithi078 ceph-mon[94114]: pgmap v641: 1 pgs: 1 peering; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-17T08:06:33.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:20 smithi078 ceph-mon[94114]: pgmap v642: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-03-17T08:06:33.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:17 smithi082 ceph-mon[94281]: pgmap v641: 1 pgs: 1 peering; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-17T08:06:33.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:20 smithi082 ceph-mon[94281]: pgmap v642: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-03-17T08:06:33.336 INFO:tasks.cephadm:Deploying osd.9 on smithi035 with /dev/vg_nvme/lv_1... 2023-03-17T08:06:34.686 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-03-17T08:06:34.687 INFO:journalctl@ceph.osd.8.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:06:34.689 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:22 smithi035 ceph-mon[92535]: pgmap v643: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:06:37.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:24 smithi035 ceph-mon[92535]: pgmap v644: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:26 smithi035 ceph-mon[92535]: pgmap v645: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:28 smithi035 ceph-mon[92535]: pgmap v646: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:30 smithi035 ceph-mon[92535]: pgmap v647: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:32 smithi035 ceph-mon[92535]: pgmap v648: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:34 smithi035 ceph-mon[92535]: pgmap v649: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:22 smithi078 ceph-mon[94114]: pgmap v643: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:24 smithi078 ceph-mon[94114]: pgmap v644: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:26 smithi078 ceph-mon[94114]: pgmap v645: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:28 smithi078 ceph-mon[94114]: pgmap v646: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:30 smithi078 ceph-mon[94114]: pgmap v647: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.297 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:32 smithi078 ceph-mon[94114]: pgmap v648: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:34 smithi078 ceph-mon[94114]: pgmap v649: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:22 smithi082 ceph-mon[94281]: pgmap v643: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:24 smithi082 ceph-mon[94281]: pgmap v644: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:26 smithi082 ceph-mon[94281]: pgmap v645: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:28 smithi082 ceph-mon[94281]: pgmap v646: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:30 smithi082 ceph-mon[94281]: pgmap v647: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:32 smithi082 ceph-mon[94281]: pgmap v648: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:34 smithi082 ceph-mon[94281]: pgmap v649: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:36 smithi082 ceph-mon[94281]: pgmap v650: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:37.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:36 smithi035 ceph-mon[92535]: pgmap v650: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:38.282 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:36 smithi078 ceph-mon[94114]: pgmap v650: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:39.758 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:06:39.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:38 smithi035 ceph-mon[92535]: pgmap v651: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:39.758 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-03-17T08:06:39.759 INFO:teuthology.orchestra.run.smithi035.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-03-17T08:06:39.759 INFO:teuthology.orchestra.run.smithi035.stderr: stderr: 10+0 records in 2023-03-17T08:06:39.759 INFO:teuthology.orchestra.run.smithi035.stderr:10+0 records out 2023-03-17T08:06:39.759 INFO:teuthology.orchestra.run.smithi035.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108789 s, 964 MB/s 2023-03-17T08:06:39.759 INFO:teuthology.orchestra.run.smithi035.stderr:--> Zapping successful for: 2023-03-17T08:06:39.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:38 smithi082 ceph-mon[94281]: pgmap v651: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:41.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:38 smithi078 ceph-mon[94114]: pgmap v651: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:41.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:40 smithi082 ceph-mon[94281]: pgmap v652: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:41.022 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:40 smithi078 ceph-mon[94114]: pgmap v652: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:41.023 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi035:vg_nvme/lv_1 2023-03-17T08:06:41.023 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:40 smithi035 ceph-mon[92535]: pgmap v652: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:41.691 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:06:42.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:42 smithi078 ceph-mon[94114]: pgmap v653: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:42.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:42 smithi082 ceph-mon[94281]: pgmap v653: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:42.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:42 smithi035 ceph-mon[92535]: pgmap v653: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:43.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 -- 172.21.15.35:0/804505315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb8100370 msgr2=0x7fceb81007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:06:44.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 --2- 172.21.15.35:0/804505315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb8100370 0x7fceb81007c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fceac009990 tx=0x7fceac009ca0 comp rx=0 tx=0).stop 2023-03-17T08:06:44.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 -- 172.21.15.35:0/804505315 shutdown_connections 2023-03-17T08:06:44.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 --2- 172.21.15.35:0/804505315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8100d00 0x7fceb81075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:44.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 --2- 172.21.15.35:0/804505315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb80ff170 0x7fceb80ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:44.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 --2- 172.21.15.35:0/804505315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb8100370 0x7fceb81007c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:44.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 -- 172.21.15.35:0/804505315 >> 172.21.15.35:0/804505315 conn(0x7fceb80fa780 msgr2=0x7fceb80fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:06:44.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.937+0000 7fcebe03c700 1 -- 172.21.15.35:0/804505315 shutdown_connections 2023-03-17T08:06:44.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 -- 172.21.15.35:0/804505315 wait complete. 2023-03-17T08:06:44.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 Processor -- start 2023-03-17T08:06:44.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 -- start start 2023-03-17T08:06:44.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 0x7fceb80698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:06:44.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb8100370 0x7fceb819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:06:45.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8100d00 0x7fceb819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:06:45.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb819d9b0 con 0x7fceb80ff170 2023-03-17T08:06:45.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb819db20 con 0x7fceb8100370 2023-03-17T08:06:45.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.938+0000 7fcebe03c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb819dce0 con 0x7fceb8100d00 2023-03-17T08:06:45.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 0x7fceb80698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:06:45.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 0x7fceb80698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39626/0 (socket says 172.21.15.35:39626) 2023-03-17T08:06:45.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 -- 172.21.15.35:0/1497259243 learned_addr learned my addr 172.21.15.35:0/1497259243 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb6ffd700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb8100370 0x7fceb819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb7fff700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8100d00 0x7fceb819d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 -- 172.21.15.35:0/1497259243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8100d00 msgr2=0x7fceb819d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8100d00 0x7fceb819d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 -- 172.21.15.35:0/1497259243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb8100370 msgr2=0x7fceb819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb8100370 0x7fceb819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 -- 172.21.15.35:0/1497259243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0095f0 con 0x7fceb80ff170 2023-03-17T08:06:45.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb77fe700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 0x7fceb80698e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcea800d980 tx=0x7fcea800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8004020 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcea800f690 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb810a970 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80039e0 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.939+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb810a7e0 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.940+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb8106760 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.942+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fcea800f800 con 0x7fceb80ff170 2023-03-17T08:06:45.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.942+0000 7fceb4ff9700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcea009f550 0x7fcea00a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:06:45.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.942+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5829+0+0 (secure 0 0 0) 0x7fcea80c9770 con 0x7fceb80ff170 2023-03-17T08:06:45.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.942+0000 7fceb6ffd700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcea009f550 0x7fcea00a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:06:45.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.943+0000 7fceb6ffd700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcea009f550 0x7fcea00a1a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceac00b5c0 tx=0x7fceac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:06:45.760 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:42.946+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fcea8094290 con 0x7fceb80ff170 2023-03-17T08:06:45.760 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:06:43.151+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fceb8061ab0 con 0x7fcea009f550 2023-03-17T08:06:46.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:06:46.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:44 smithi078 ceph-mon[94114]: pgmap v654: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:44 smithi078 ceph-mon[94114]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:46.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:44 smithi082 ceph-mon[94281]: pgmap v654: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:46.880 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:44 smithi082 ceph-mon[94281]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:06:46.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:06:46.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:06:46.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:46.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:44 smithi035 ceph-mon[92535]: pgmap v654: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:46.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:44 smithi035 ceph-mon[92535]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi035:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:06:46.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:46 smithi078 ceph-mon[94114]: pgmap v655: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:48.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:46 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/882466078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0d57d1e-141a-4e96-8d1f-53af74dd4571"}]: dispatch 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:46 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/882466078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0d57d1e-141a-4e96-8d1f-53af74dd4571"}]': finished 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:46 smithi078 ceph-mon[94114]: osdmap e65: 10 total, 9 up, 10 in 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:46 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:46 smithi082 ceph-mon[94281]: pgmap v655: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:46 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/882466078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0d57d1e-141a-4e96-8d1f-53af74dd4571"}]: dispatch 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:46 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/882466078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0d57d1e-141a-4e96-8d1f-53af74dd4571"}]': finished 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:46 smithi082 ceph-mon[94281]: osdmap e65: 10 total, 9 up, 10 in 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:46 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:06:48.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:46 smithi035 ceph-mon[92535]: pgmap v655: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:48.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:46 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/882466078' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0d57d1e-141a-4e96-8d1f-53af74dd4571"}]: dispatch 2023-03-17T08:06:48.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:46 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/882466078' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0d57d1e-141a-4e96-8d1f-53af74dd4571"}]': finished 2023-03-17T08:06:48.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:46 smithi035 ceph-mon[92535]: osdmap e65: 10 total, 9 up, 10 in 2023-03-17T08:06:48.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:46 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:06:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:47 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/4041040007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:06:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:48 smithi078 ceph-mon[94114]: pgmap v657: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:48.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:47 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/4041040007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:06:48.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:48 smithi082 ceph-mon[94281]: pgmap v657: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:48.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:47 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4041040007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:06:48.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:48 smithi035 ceph-mon[92535]: pgmap v657: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:50.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:50 smithi035 ceph-mon[92535]: pgmap v658: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:51.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:50 smithi078 ceph-mon[94114]: pgmap v658: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:52.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:50 smithi082 ceph-mon[94281]: pgmap v658: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:52.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:52 smithi035 ceph-mon[92535]: pgmap v659: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:52.932 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:52 smithi078 ceph-mon[94114]: pgmap v659: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:52.932 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:52 smithi082 ceph-mon[94281]: pgmap v659: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:53.595 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-03-17T08:06:54.114 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:54.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-03-17T08:06:54.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:54.115 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-03-17T08:06:54.115 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:06:55.280 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:54 smithi035 ceph-mon[92535]: pgmap v660: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:55.280 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:54 smithi035 ceph-mon[92535]: Deploying daemon osd.9 on smithi035 2023-03-17T08:06:56.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:54 smithi078 ceph-mon[94114]: pgmap v660: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:57.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:54 smithi078 ceph-mon[94114]: Deploying daemon osd.9 on smithi035 2023-03-17T08:06:57.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:54 smithi082 ceph-mon[94281]: pgmap v660: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:57.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:54 smithi082 ceph-mon[94281]: Deploying daemon osd.9 on smithi035 2023-03-17T08:06:57.129 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:56 smithi035 ceph-mon[92535]: pgmap v661: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:58.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:56 smithi078 ceph-mon[94114]: pgmap v661: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:58.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:56 smithi082 ceph-mon[94281]: pgmap v661: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:58.383 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:58 smithi082 ceph-mon[94281]: pgmap v662: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:06:59.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:06:59.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:02.106 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:02.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:02.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:06:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:02.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:58 smithi035 ceph-mon[92535]: pgmap v662: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:04.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:04.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:04.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:04.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.444 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:06:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:00 smithi082 ceph-mon[94281]: pgmap v663: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:06.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:00 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:00 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.445 INFO:teuthology.orchestra.run.smithi035.stdout:Created osd(s) 9 on host 'smithi035' 2023-03-17T08:07:06.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.019+0000 7fceb4ff9700 1 -- 172.21.15.35:0/1497259243 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fceb8061ab0 con 0x7fcea009f550 2023-03-17T08:07:06.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcea009f550 msgr2=0x7fcea00a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:06.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcea009f550 0x7fcea00a1a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceac00b5c0 tx=0x7fceac005fb0 comp rx=0 tx=0).stop 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 msgr2=0x7fceb80698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 0x7fceb80698e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcea800d980 tx=0x7fcea800dc90 comp rx=0 tx=0).stop 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 shutdown_connections 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8100d00 0x7fceb819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcea009f550 0x7fcea00a1a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fceb80ff170 0x7fceb80698e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 --2- 172.21.15.35:0/1497259243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb8100370 0x7fceb819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 >> 172.21.15.35:0/1497259243 conn(0x7fceb80fa780 msgr2=0x7fceb81038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 shutdown_connections 2023-03-17T08:07:06.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:07:00.021+0000 7fcebe03c700 1 -- 172.21.15.35:0/1497259243 wait complete. 2023-03-17T08:07:06.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:00 smithi035 ceph-mon[92535]: pgmap v663: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:06.448 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:00 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.448 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:00 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:58 smithi078 ceph-mon[94114]: pgmap v662: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:06.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:06.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:06.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:07.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:06:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:00 smithi078 ceph-mon[94114]: pgmap v663: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:00 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:00 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:01 smithi078 ceph-mon[94114]: pgmap v664: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:07.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:01 smithi078 ceph-mon[94114]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:02 smithi078 ceph-mon[94114]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:02 smithi078 ceph-mon[94114]: osdmap e66: 10 total, 9 up, 10 in 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:02 smithi078 ceph-mon[94114]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:03 smithi078 ceph-mon[94114]: pgmap v666: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:09.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:03 smithi078 ceph-mon[94114]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:03 smithi078 ceph-mon[94114]: osdmap e67: 10 total, 9 up, 10 in 2023-03-17T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:07:09.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] boot 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: osdmap e68: 10 total, 10 up, 10 in 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:09.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:05 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi035 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:05 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 4293M 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:05 smithi078 ceph-mon[94114]: pgmap v669: 1 pgs: 1 active+clean; 577 KiB data, 56 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:09.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:05 smithi078 ceph-mon[94114]: osdmap e69: 10 total, 10 up, 10 in 2023-03-17T08:07:09.991 DEBUG:teuthology.orchestra.run.smithi035:osd.9> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.9.service 2023-03-17T08:07:09.992 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:07 smithi078 ceph-mon[94114]: pgmap v671: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:01 smithi035 ceph-mon[92535]: pgmap v664: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:01 smithi035 ceph-mon[92535]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:02 smithi035 ceph-mon[92535]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:02 smithi035 ceph-mon[92535]: osdmap e66: 10 total, 9 up, 10 in 2023-03-17T08:07:09.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:09.994 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:02 smithi035 ceph-mon[92535]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:07:09.994 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:03 smithi035 ceph-mon[92535]: pgmap v666: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:09.994 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:03 smithi035 ceph-mon[92535]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:07:09.994 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:03 smithi035 ceph-mon[92535]: osdmap e67: 10 total, 9 up, 10 in 2023-03-17T08:07:09.994 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:07:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:07:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] boot 2023-03-17T08:07:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: osdmap e68: 10 total, 10 up, 10 in 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:12.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:13.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:13.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:13.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:13.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:05 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi035 2023-03-17T08:07:13.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:05 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 4293M 2023-03-17T08:07:13.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:05 smithi035 ceph-mon[92535]: pgmap v669: 1 pgs: 1 active+clean; 577 KiB data, 56 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:13.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:05 smithi035 ceph-mon[92535]: osdmap e69: 10 total, 10 up, 10 in 2023-03-17T08:07:13.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:07 smithi035 ceph-mon[92535]: pgmap v671: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:13.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:01 smithi082 ceph-mon[94281]: pgmap v664: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:14.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:14.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:14.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:01 smithi082 ceph-mon[94281]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-03-17T08:07:14.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:02 smithi082 ceph-mon[94281]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-03-17T08:07:14.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:02 smithi082 ceph-mon[94281]: osdmap e66: 10 total, 9 up, 10 in 2023-03-17T08:07:14.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:14.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:02 smithi082 ceph-mon[94281]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]: dispatch 2023-03-17T08:07:15.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:03 smithi082 ceph-mon[94281]: pgmap v666: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:15.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:03 smithi082 ceph-mon[94281]: from='osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi035", "root=default"]}]': finished 2023-03-17T08:07:15.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:03 smithi082 ceph-mon[94281]: osdmap e67: 10 total, 9 up, 10 in 2023-03-17T08:07:15.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:15.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:16.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:07:16.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:07:16.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:16.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: osd.9 [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] boot 2023-03-17T08:07:16.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: osdmap e68: 10 total, 10 up, 10 in 2023-03-17T08:07:16.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:17.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:17.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:17.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:17.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:05 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi035 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:05 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 4293M 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:05 smithi082 ceph-mon[94281]: pgmap v669: 1 pgs: 1 active+clean; 577 KiB data, 56 MiB used, 805 GiB / 805 GiB avail 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:05 smithi082 ceph-mon[94281]: osdmap e69: 10 total, 10 up, 10 in 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:07 smithi082 ceph-mon[94281]: pgmap v671: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:17.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:10 smithi082 ceph-mon[94281]: pgmap v672: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:17.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:12 smithi082 ceph-mon[94281]: pgmap v673: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:17.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:10 smithi035 ceph-mon[92535]: pgmap v672: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:18.957 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:12 smithi035 ceph-mon[92535]: pgmap v673: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:18.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:14 smithi082 ceph-mon[94281]: pgmap v674: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:18.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:16 smithi082 ceph-mon[94281]: pgmap v675: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:18.958 INFO:tasks.cephadm:Deploying osd.10 on smithi078 with /dev/vg_nvme/lv_1... 2023-03-17T08:07:18.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-03-17T08:07:18.959 INFO:journalctl@ceph.osd.9.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:07:18.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:10 smithi078 ceph-mon[94114]: pgmap v672: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:18.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:12 smithi078 ceph-mon[94114]: pgmap v673: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:14 smithi078 ceph-mon[94114]: pgmap v674: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:16 smithi078 ceph-mon[94114]: pgmap v675: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:18 smithi078 ceph-mon[94114]: pgmap v676: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:14 smithi035 ceph-mon[92535]: pgmap v674: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:16 smithi035 ceph-mon[92535]: pgmap v675: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:18 smithi035 ceph-mon[92535]: pgmap v676: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:18 smithi082 ceph-mon[94281]: pgmap v676: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:20.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:20 smithi078 ceph-mon[94114]: pgmap v677: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:21.837 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:20 smithi082 ceph-mon[94281]: pgmap v677: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:21.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:20 smithi035 ceph-mon[92535]: pgmap v677: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:21.837 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T08:07:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-03-17T08:07:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-03-17T08:07:23.272 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10+0 records in 2023-03-17T08:07:24.995 INFO:teuthology.orchestra.run.smithi078.stderr:10+0 records out 2023-03-17T08:07:24.995 INFO:teuthology.orchestra.run.smithi078.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0118167 s, 887 MB/s 2023-03-17T08:07:27.269 INFO:teuthology.orchestra.run.smithi078.stderr:--> Zapping successful for: 2023-03-17T08:07:27.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:22 smithi078 ceph-mon[94114]: pgmap v678: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:27.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:22 smithi035 ceph-mon[92535]: pgmap v678: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:30.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:24 smithi035 ceph-mon[92535]: pgmap v679: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:30.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:26 smithi035 ceph-mon[92535]: pgmap v680: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:31.343 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:22 smithi082 ceph-mon[94281]: pgmap v678: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:33.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:24 smithi082 ceph-mon[94281]: pgmap v679: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:33.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:26 smithi082 ceph-mon[94281]: pgmap v680: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:34.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi078:vg_nvme/lv_1 2023-03-17T08:07:34.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:24 smithi078 ceph-mon[94114]: pgmap v679: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:34.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:26 smithi078 ceph-mon[94114]: pgmap v680: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:34.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:28 smithi078 ceph-mon[94114]: pgmap v681: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:35.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:30 smithi078 ceph-mon[94114]: pgmap v682: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:35.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:32 smithi078 ceph-mon[94114]: pgmap v683: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:35.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:34 smithi078 ceph-mon[94114]: pgmap v684: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:35.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:28 smithi035 ceph-mon[92535]: pgmap v681: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:37.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:30 smithi035 ceph-mon[92535]: pgmap v682: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:37.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:32 smithi035 ceph-mon[92535]: pgmap v683: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:37.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:34 smithi035 ceph-mon[92535]: pgmap v684: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:28 smithi082 ceph-mon[94281]: pgmap v681: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:30 smithi082 ceph-mon[94281]: pgmap v682: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:32 smithi082 ceph-mon[94281]: pgmap v683: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:34 smithi082 ceph-mon[94281]: pgmap v684: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.252 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:36 smithi035 ceph-mon[92535]: pgmap v685: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:36 smithi082 ceph-mon[94281]: pgmap v685: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.253 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.b/config 2023-03-17T08:07:38.253 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:36 smithi078 ceph-mon[94114]: pgmap v685: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:38.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3285550962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100370 msgr2=0x7f1b4c1007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3285550962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100370 0x7f1b4c1007c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009990 tx=0x7f1b48009ca0 comp rx=0 tx=0).stop 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3285550962 shutdown_connections 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3285550962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4c100d00 0x7f1b4c1075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3285550962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b4c0ff170 0x7f1b4c0ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3285550962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100370 0x7f1b4c1007c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.820+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3285550962 >> 172.21.15.78:0/3285550962 conn(0x7f1b4c0fa780 msgr2=0x7f1b4c0fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3285550962 shutdown_connections 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3285550962 wait complete. 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 Processor -- start 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 -- start start 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4c0ff170 0x7f1b4c1034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b4c100370 0x7f1b4c101af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 0x7f1b4c102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c1027b0 con 0x7f1b4c100370 2023-03-17T08:07:39.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c102920 con 0x7f1b4c100d00 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b53bbe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c19ffb0 con 0x7f1b4c0ff170 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b5215b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 0x7f1b4c102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b5215b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 0x7f1b4c102030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49464/0 (socket says 172.21.15.78:49464) 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b5215b700 1 -- 172.21.15.78:0/3547077904 learned_addr learned my addr 172.21.15.78:0/3547077904 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.821+0000 7f1b51159700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b4c100370 0x7f1b4c101af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5195a700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4c0ff170 0x7f1b4c1034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:07:39.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5215b700 1 -- 172.21.15.78:0/3547077904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4c0ff170 msgr2=0x7f1b4c1034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5215b700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4c0ff170 0x7f1b4c1034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:40.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5215b700 1 -- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b4c100370 msgr2=0x7f1b4c101af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5215b700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b4c100370 0x7f1b4c101af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5215b700 1 -- 172.21.15.78:0/3547077904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480095f0 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b5215b700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 0x7f1b4c102030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400ada0 tx=0x7f1b4400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4400f070 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b44007b30 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c10aa10 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44005280 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.822+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c10a880 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.823+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c1072f0 con 0x7f1b4c100d00 2023-03-17T08:07:41.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.824+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1b4400a090 con 0x7f1b4c100d00 2023-03-17T08:07:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.825+0000 7f1b42ffd700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1b3809f4d0 0x7f1b380a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:07:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.825+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f1b440c9560 con 0x7f1b4c100d00 2023-03-17T08:07:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.825+0000 7f1b5195a700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1b3809f4d0 0x7f1b380a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:07:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.826+0000 7f1b5195a700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1b3809f4d0 0x7f1b380a1980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c1001d0 tx=0x7f1b3c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:07:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:37.828+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mon.2 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1b44093ee0 con 0x7f1b4c100d00 2023-03-17T08:07:41.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:38.023+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b4c061b80 con 0x7f1b3809f4d0 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:38 smithi035 ceph-mon[92535]: pgmap v686: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:39 smithi035 ceph-mon[92535]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:40 smithi035 ceph-mon[92535]: pgmap v687: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:41.155 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:38 smithi082 ceph-mon[94281]: pgmap v686: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:39 smithi082 ceph-mon[94281]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:40 smithi082 ceph-mon[94281]: pgmap v687: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:38 smithi078 ceph-mon[94114]: pgmap v686: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:39 smithi078 ceph-mon[94114]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:07:41.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:40 smithi078 ceph-mon[94114]: pgmap v687: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:41.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:41 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/153236936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]: dispatch 2023-03-17T08:07:42.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:41 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]: dispatch 2023-03-17T08:07:42.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:41 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]': finished 2023-03-17T08:07:42.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:41 smithi082 ceph-mon[94281]: osdmap e70: 11 total, 10 up, 11 in 2023-03-17T08:07:42.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:41 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:07:42.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:42 smithi082 ceph-mon[94281]: pgmap v688: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:42.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:42 smithi082 ceph-mon[94281]: from='client.? 172.21.15.78:0/3068684024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:41 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/153236936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]: dispatch 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:41 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]: dispatch 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:41 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]': finished 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:41 smithi035 ceph-mon[92535]: osdmap e70: 11 total, 10 up, 11 in 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:41 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:42 smithi035 ceph-mon[92535]: pgmap v688: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:42 smithi035 ceph-mon[92535]: from='client.? 172.21.15.78:0/3068684024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:07:42.760 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:41 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/153236936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]: dispatch 2023-03-17T08:07:42.761 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:41 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]: dispatch 2023-03-17T08:07:42.761 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:41 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61299bd0-4891-41b3-b39b-24d35fe313f3"}]': finished 2023-03-17T08:07:42.761 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:41 smithi078 ceph-mon[94114]: osdmap e70: 11 total, 10 up, 11 in 2023-03-17T08:07:42.761 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:41 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:07:44.495 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:42 smithi078 ceph-mon[94114]: pgmap v688: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:44.495 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:42 smithi078 ceph-mon[94114]: from='client.? 172.21.15.78:0/3068684024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:07:44.580 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:44 smithi078 ceph-mon[94114]: pgmap v690: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:46.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:44 smithi035 ceph-mon[92535]: pgmap v690: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:46.344 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:44 smithi082 ceph-mon[94281]: pgmap v690: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:46.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:46 smithi078 ceph-mon[94114]: pgmap v691: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:48.163 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:46 smithi035 ceph-mon[92535]: pgmap v691: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:49.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:46 smithi082 ceph-mon[94281]: pgmap v691: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:49.524 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:48 smithi078 ceph-mon[94114]: pgmap v692: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:49.524 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-03-17T08:07:49.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:49.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:48 smithi035 ceph-mon[92535]: pgmap v692: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:49.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-03-17T08:07:49.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:49.525 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:48 smithi082 ceph-mon[94281]: pgmap v692: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:49.525 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-03-17T08:07:50.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:51.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:49 smithi078 ceph-mon[94114]: Deploying daemon osd.10 on smithi078 2023-03-17T08:07:52.761 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:50 smithi078 ceph-mon[94114]: pgmap v693: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:52.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:49 smithi035 ceph-mon[92535]: Deploying daemon osd.10 on smithi078 2023-03-17T08:07:52.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:50 smithi035 ceph-mon[92535]: pgmap v693: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:52.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:49 smithi082 ceph-mon[94281]: Deploying daemon osd.10 on smithi078 2023-03-17T08:07:52.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:50 smithi082 ceph-mon[94281]: pgmap v693: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:52.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:52 smithi078 ceph-mon[94114]: pgmap v694: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:52.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:52 smithi035 ceph-mon[92535]: pgmap v694: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:52.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:52 smithi082 ceph-mon[94281]: pgmap v694: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:53.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:53 smithi078 ceph-mon[94114]: pgmap v695: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:55.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:55.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:55.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:53 smithi082 ceph-mon[94281]: pgmap v695: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:53 smithi035 ceph-mon[92535]: pgmap v695: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:55.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:55.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:07:55.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.851+0000 7f1b42ffd700 1 -- 172.21.15.78:0/3547077904 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f1b4c061b80 con 0x7f1b3809f4d0 2023-03-17T08:07:56.384 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 10 on host 'smithi078' 2023-03-17T08:07:56.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1b3809f4d0 msgr2=0x7f1b380a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:56.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1b3809f4d0 0x7f1b380a1980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c1001d0 tx=0x7f1b3c009190 comp rx=0 tx=0).stop 2023-03-17T08:07:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 msgr2=0x7f1b4c102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:07:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 0x7f1b4c102030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400ada0 tx=0x7f1b4400c330 comp rx=0 tx=0).stop 2023-03-17T08:07:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 shutdown_connections 2023-03-17T08:07:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b4c100d00 0x7f1b4c102030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:57.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b4c0ff170 0x7f1b4c1034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1b3809f4d0 0x7f1b380a1980 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 --2- 172.21.15.78:0/3547077904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b4c100370 0x7f1b4c101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:07:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 >> 172.21.15.78:0/3547077904 conn(0x7f1b4c0fa780 msgr2=0x7f1b4c0fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:07:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 shutdown_connections 2023-03-17T08:07:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-03-17T08:07:55.854+0000 7f1b53bbe700 1 -- 172.21.15.78:0/3547077904 wait complete. 2023-03-17T08:07:59.081 DEBUG:teuthology.orchestra.run.smithi078:osd.10> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.10.service 2023-03-17T08:07:59.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: pgmap v696: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:07:59.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:59.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:59.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:07:59.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:07:59.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:59.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:07:59.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:00.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:08:00.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:57 smithi035 ceph-mon[92535]: from='osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-17T08:08:01.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:57 smithi035 ceph-mon[92535]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-17T08:08:01.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:58 smithi035 ceph-mon[92535]: pgmap v697: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:01.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:58 smithi035 ceph-mon[92535]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-03-17T08:08:02.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:58 smithi035 ceph-mon[92535]: osdmap e71: 11 total, 10 up, 11 in 2023-03-17T08:08:02.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:02.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:58 smithi035 ceph-mon[92535]: from='osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:08:02.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:58 smithi035 ceph-mon[92535]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:08:03.293 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: pgmap v696: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:03.293 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:03.293 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:03.293 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:05.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:08:05.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:05.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:05.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:05.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:57 smithi082 ceph-mon[94281]: from='osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:57 smithi082 ceph-mon[94281]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:58 smithi082 ceph-mon[94281]: pgmap v697: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:58 smithi082 ceph-mon[94281]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:58 smithi082 ceph-mon[94281]: osdmap e71: 11 total, 10 up, 11 in 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:06.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:58 smithi082 ceph-mon[94281]: from='osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:08:06.264 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:58 smithi082 ceph-mon[94281]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:08:06.264 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: pgmap v696: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:06.264 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:06.264 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:06.264 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:07.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:08:07.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:07.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:57 smithi078 ceph-mon[94114]: from='osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:57 smithi078 ceph-mon[94114]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:58 smithi078 ceph-mon[94114]: pgmap v697: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:58 smithi078 ceph-mon[94114]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-03-17T08:08:07.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:58 smithi078 ceph-mon[94114]: osdmap e71: 11 total, 10 up, 11 in 2023-03-17T08:08:07.279 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:07.279 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:58 smithi078 ceph-mon[94114]: from='osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:08:07.279 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:58 smithi078 ceph-mon[94114]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2023-03-17T08:08:07.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:08:08.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: osdmap e72: 11 total, 10 up, 11 in 2023-03-17T08:08:08.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:08.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:08.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:08.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:08.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:08.770 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:08.770 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:09.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:09.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:09.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:09.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] boot 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: osdmap e73: 11 total, 11 up, 11 in 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:07:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:00 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:00 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:00 smithi035 ceph-mon[92535]: pgmap v700: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:00 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi078 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:00 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 4292M 2023-03-17T08:08:09.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:00 smithi035 ceph-mon[92535]: osdmap e74: 11 total, 11 up, 11 in 2023-03-17T08:08:10.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:02 smithi035 ceph-mon[92535]: pgmap v703: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:12.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:02 smithi035 ceph-mon[92535]: osdmap e75: 11 total, 11 up, 11 in 2023-03-17T08:08:12.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:03 smithi035 ceph-mon[92535]: osdmap e76: 11 total, 11 up, 11 in 2023-03-17T08:08:12.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:04 smithi035 ceph-mon[92535]: pgmap v706: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:12.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:04 smithi035 ceph-mon[92535]: osdmap e77: 11 total, 11 up, 11 in 2023-03-17T08:08:12.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:06 smithi035 ceph-mon[92535]: pgmap v708: 1 pgs: 1 peering; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-03-17T08:08:12.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: osdmap e72: 11 total, 10 up, 11 in 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] boot 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: osdmap e73: 11 total, 11 up, 11 in 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:07:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:00 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:00 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:00 smithi082 ceph-mon[94281]: pgmap v700: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:00 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi078 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:00 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 4292M 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:00 smithi082 ceph-mon[94281]: osdmap e74: 11 total, 11 up, 11 in 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:02 smithi082 ceph-mon[94281]: pgmap v703: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:02 smithi082 ceph-mon[94281]: osdmap e75: 11 total, 11 up, 11 in 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:03 smithi082 ceph-mon[94281]: osdmap e76: 11 total, 11 up, 11 in 2023-03-17T08:08:15.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:04 smithi082 ceph-mon[94281]: pgmap v706: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:04 smithi082 ceph-mon[94281]: osdmap e77: 11 total, 11 up, 11 in 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:06 smithi082 ceph-mon[94281]: pgmap v708: 1 pgs: 1 peering; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: osdmap e72: 11 total, 10 up, 11 in 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:08:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:15.152 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: osd.10 [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] boot 2023-03-17T08:08:15.152 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: osdmap e73: 11 total, 11 up, 11 in 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:07:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:00 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:00 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:00 smithi078 ceph-mon[94114]: pgmap v700: 1 pgs: 1 active+clean; 577 KiB data, 61 MiB used, 894 GiB / 894 GiB avail 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:00 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi078 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:00 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 4292M 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:00 smithi078 ceph-mon[94114]: osdmap e74: 11 total, 11 up, 11 in 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:02 smithi078 ceph-mon[94114]: pgmap v703: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:02 smithi078 ceph-mon[94114]: osdmap e75: 11 total, 11 up, 11 in 2023-03-17T08:08:16.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:03 smithi078 ceph-mon[94114]: osdmap e76: 11 total, 11 up, 11 in 2023-03-17T08:08:17.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:04 smithi078 ceph-mon[94114]: pgmap v706: 1 pgs: 1 active+clean; 577 KiB data, 67 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:17.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:04 smithi078 ceph-mon[94114]: osdmap e77: 11 total, 11 up, 11 in 2023-03-17T08:08:17.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:06 smithi078 ceph-mon[94114]: pgmap v708: 1 pgs: 1 peering; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 136 KiB/s, 0 objects/s recovering 2023-03-17T08:08:17.218 INFO:tasks.cephadm:Deploying osd.11 on smithi082 with /dev/vg_nvme/lv_1... 2023-03-17T08:08:17.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-03-17T08:08:17.219 INFO:journalctl@ceph.osd.10.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:08:18.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:08 smithi078 ceph-mon[94114]: pgmap v709: 1 pgs: 1 peering; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.891 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:10 smithi078 ceph-mon[94114]: pgmap v710: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.891 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:12 smithi078 ceph-mon[94114]: pgmap v711: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.891 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:14 smithi078 ceph-mon[94114]: pgmap v712: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.891 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:16 smithi078 ceph-mon[94114]: pgmap v713: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:21.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:08 smithi035 ceph-mon[92535]: pgmap v709: 1 pgs: 1 peering; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:10 smithi035 ceph-mon[92535]: pgmap v710: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:12 smithi035 ceph-mon[92535]: pgmap v711: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:14 smithi035 ceph-mon[92535]: pgmap v712: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:16 smithi035 ceph-mon[92535]: pgmap v713: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:18 smithi035 ceph-mon[92535]: pgmap v714: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:20 smithi035 ceph-mon[92535]: pgmap v715: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:08 smithi082 ceph-mon[94281]: pgmap v709: 1 pgs: 1 peering; 577 KiB data, 68 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-03-17T08:08:21.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:10 smithi082 ceph-mon[94281]: pgmap v710: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2023-03-17T08:08:22.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:12 smithi082 ceph-mon[94281]: pgmap v711: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-03-17T08:08:22.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:14 smithi082 ceph-mon[94281]: pgmap v712: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-03-17T08:08:22.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:16 smithi082 ceph-mon[94281]: pgmap v713: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:22.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:18 smithi082 ceph-mon[94281]: pgmap v714: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:22.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:20 smithi082 ceph-mon[94281]: pgmap v715: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:22.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:18 smithi078 ceph-mon[94114]: pgmap v714: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:24.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:20 smithi078 ceph-mon[94114]: pgmap v715: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:24.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:22 smithi035 ceph-mon[92535]: pgmap v716: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:24.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:22 smithi078 ceph-mon[94114]: pgmap v716: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:24.318 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:08:24.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:22 smithi082 ceph-mon[94281]: pgmap v716: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:24.318 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-03-17T08:08:24.318 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-03-17T08:08:24.319 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2023-03-17T08:08:24.319 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2023-03-17T08:08:24.319 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0157305 s, 667 MB/s 2023-03-17T08:08:24.319 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2023-03-17T08:08:24.582 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:24 smithi082 ceph-mon[94281]: pgmap v717: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:25.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:24 smithi035 ceph-mon[92535]: pgmap v717: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:25.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:24 smithi078 ceph-mon[94114]: pgmap v717: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:25.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2023-03-17T08:08:26.986 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:26 smithi035 ceph-mon[92535]: pgmap v718: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:26.987 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:26 smithi078 ceph-mon[94114]: pgmap v718: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:28.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:26 smithi082 ceph-mon[94281]: pgmap v718: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:28.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:28 smithi082 ceph-mon[94281]: pgmap v719: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:29.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:28 smithi035 ceph-mon[92535]: pgmap v719: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:29.666 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:28 smithi078 ceph-mon[94114]: pgmap v719: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:29.666 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:08:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 -- 172.21.15.82:0/456643765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 msgr2=0x7f10b41075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:08:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 --2- 172.21.15.82:0/456643765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b41075e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00b0a0 tx=0x7f10ac00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:08:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 -- 172.21.15.82:0/456643765 shutdown_connections 2023-03-17T08:08:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 --2- 172.21.15.82:0/456643765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b41075e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 --2- 172.21.15.82:0/456643765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b40ff190 0x7f10b40ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 --2- 172.21.15.82:0/456643765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b4100390 0x7f10b41007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 -- 172.21.15.82:0/456643765 >> 172.21.15.82:0/456643765 conn(0x7f10b40fa7e0 msgr2=0x7f10b40fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 -- 172.21.15.82:0/456643765 shutdown_connections 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.164+0000 7f10bac47700 1 -- 172.21.15.82:0/456643765 wait complete. 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 Processor -- start 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 -- start start 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b40ff190 0x7f10b4069b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b4100390 0x7f10b419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b419d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b419dd00 con 0x7f10b40ff190 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b419de70 con 0x7f10b4100390 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10bac47700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b419e030 con 0x7f10b4100d20 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b419d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b419d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53080/0 (socket says 172.21.15.82:53080) 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 -- 172.21.15.82:0/3441779629 learned_addr learned my addr 172.21.15.82:0/3441779629 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b89e3700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b40ff190 0x7f10b4069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:08:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b3fff700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b4100390 0x7f10b419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:08:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 -- 172.21.15.82:0/3441779629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b4100390 msgr2=0x7f10b419af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:08:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b4100390 0x7f10b419af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 -- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b40ff190 msgr2=0x7f10b4069b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b40ff190 0x7f10b4069b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b91e4700 1 -- 172.21.15.82:0/3441779629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009d00 con 0x7f10b4100d20 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.165+0000 7f10b89e3700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b40ff190 0x7f10b4069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.166+0000 7f10b91e4700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b419d560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00b070 tx=0x7f10ac004db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.166+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00e040 con 0x7f10b4100d20 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.166+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10ac01bcf0 con 0x7f10b4100d20 2023-03-17T08:08:31.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.166+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b410aab0 con 0x7f10b4100d20 2023-03-17T08:08:31.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.166+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0058d0 con 0x7f10b4100d20 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:30 smithi035 ceph-mon[92535]: pgmap v720: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:31 smithi035 ceph-mon[92535]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:30 smithi078 ceph-mon[94114]: pgmap v720: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:31 smithi078 ceph-mon[94114]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:08:31.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.166+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b410a920 con 0x7f10b4100d20 2023-03-17T08:08:36.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.167+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b4106830 con 0x7f10b4100d20 2023-03-17T08:08:36.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.168+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f10ac01b860 con 0x7f10b4100d20 2023-03-17T08:08:36.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.169+0000 7f10b1ffb700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f10a409f4d0 0x7f10a40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:08:36.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.169+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f10ac0cc280 con 0x7f10b4100d20 2023-03-17T08:08:36.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.169+0000 7f10b89e3700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f10a409f4d0 0x7f10a40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:08:36.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.169+0000 7f10b89e3700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f10a409f4d0 0x7f10a40a1980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f10b41001f0 tx=0x7f10a8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:08:36.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.172+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f10ac0969b0 con 0x7f10b4100d20 2023-03-17T08:08:36.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:30.368+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f10b4061950 con 0x7f10a409f4d0 2023-03-17T08:08:36.373 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:30 smithi082 ceph-mon[94281]: pgmap v720: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:36.373 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:31 smithi082 ceph-mon[94281]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:08:37.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-03-17T08:08:37.551 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-03-17T08:08:37.551 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:37.551 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:32 smithi082 ceph-mon[94281]: pgmap v721: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:33 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/3001358667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]: dispatch 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:33 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]: dispatch 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:33 smithi082 ceph-mon[94281]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]': finished 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:33 smithi082 ceph-mon[94281]: osdmap e78: 12 total, 11 up, 12 in 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:34 smithi082 ceph-mon[94281]: pgmap v722: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:38.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:34 smithi082 ceph-mon[94281]: from='client.? 172.21.15.82:0/1946284104' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:08:38.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:36 smithi082 ceph-mon[94281]: pgmap v724: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:32 smithi035 ceph-mon[92535]: pgmap v721: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:33 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/3001358667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]: dispatch 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:33 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]: dispatch 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:33 smithi035 ceph-mon[92535]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]': finished 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:33 smithi035 ceph-mon[92535]: osdmap e78: 12 total, 11 up, 12 in 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:34 smithi035 ceph-mon[92535]: pgmap v722: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:38.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:34 smithi035 ceph-mon[92535]: from='client.? 172.21.15.82:0/1946284104' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:08:38.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:36 smithi035 ceph-mon[92535]: pgmap v724: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:39.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:32 smithi078 ceph-mon[94114]: pgmap v721: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:33 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/3001358667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]: dispatch 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:33 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]: dispatch 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:33 smithi078 ceph-mon[94114]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b477025-7de4-4b85-8c90-19d2388da71b"}]': finished 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:33 smithi078 ceph-mon[94114]: osdmap e78: 12 total, 11 up, 12 in 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:34 smithi078 ceph-mon[94114]: pgmap v722: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:39.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:34 smithi078 ceph-mon[94114]: from='client.? 172.21.15.82:0/1946284104' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-03-17T08:08:40.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:36 smithi078 ceph-mon[94114]: pgmap v724: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:40.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:38 smithi035 ceph-mon[92535]: pgmap v725: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:40.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:38 smithi078 ceph-mon[94114]: pgmap v725: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:40.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:38 smithi082 ceph-mon[94281]: pgmap v725: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:40.552 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:40 smithi082 ceph-mon[94281]: pgmap v726: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-03-17T08:08:42.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:40 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:42.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:41 smithi082 ceph-mon[94281]: Deploying daemon osd.11 on smithi082 2023-03-17T08:08:43.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:40 smithi035 ceph-mon[92535]: pgmap v726: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:40 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:41 smithi035 ceph-mon[92535]: Deploying daemon osd.11 on smithi082 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:40 smithi078 ceph-mon[94114]: pgmap v726: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:40 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:08:43.508 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:41 smithi078 ceph-mon[94114]: Deploying daemon osd.11 on smithi082 2023-03-17T08:08:43.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:42 smithi035 ceph-mon[92535]: pgmap v727: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:43.509 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:42 smithi078 ceph-mon[94114]: pgmap v727: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:43.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:42 smithi082 ceph-mon[94281]: pgmap v727: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:44.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:44 smithi082 ceph-mon[94281]: pgmap v728: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:45.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:44 smithi035 ceph-mon[92535]: pgmap v728: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:45.714 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:44 smithi078 ceph-mon[94114]: pgmap v728: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:45.812 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:45 smithi082 ceph-mon[94281]: pgmap v729: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:46.896 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:47.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:47.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:08:47.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:45 smithi035 ceph-mon[92535]: pgmap v729: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:49.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:49.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:49.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:08:49.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:45 smithi078 ceph-mon[94114]: pgmap v729: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:49.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:49.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:50.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:08:50.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.618+0000 7f10b1ffb700 1 -- 172.21.15.82:0/3441779629 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f10b4061950 con 0x7f10a409f4d0 2023-03-17T08:08:51.606 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 11 on host 'smithi082' 2023-03-17T08:08:51.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:47 smithi035 ceph-mon[92535]: pgmap v730: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:48 smithi035 ceph-mon[92535]: from='osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:48 smithi035 ceph-mon[92535]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:49 smithi035 ceph-mon[92535]: pgmap v731: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:49 smithi035 ceph-mon[92535]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:49 smithi035 ceph-mon[92535]: osdmap e79: 12 total, 11 up, 12 in 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:53.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:49 smithi035 ceph-mon[92535]: from='osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:08:53.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:49 smithi035 ceph-mon[92535]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:08:53.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:50 smithi035 ceph-mon[92535]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:50 smithi035 ceph-mon[92535]: osdmap e80: 12 total, 11 up, 12 in 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:47 smithi078 ceph-mon[94114]: pgmap v730: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:55.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:55.111 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:08:55.111 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:48 smithi078 ceph-mon[94114]: from='osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-17T08:08:55.111 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:48 smithi078 ceph-mon[94114]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-17T08:08:55.111 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:49 smithi078 ceph-mon[94114]: pgmap v731: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:49 smithi078 ceph-mon[94114]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:49 smithi078 ceph-mon[94114]: osdmap e79: 12 total, 11 up, 12 in 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:49 smithi078 ceph-mon[94114]: from='osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:49 smithi078 ceph-mon[94114]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:50 smithi078 ceph-mon[94114]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:50 smithi078 ceph-mon[94114]: osdmap e80: 12 total, 11 up, 12 in 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:57.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:08:57.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f10a409f4d0 msgr2=0x7f10a40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:08:57.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f10a409f4d0 0x7f10a40a1980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f10b41001f0 tx=0x7f10a8008040 comp rx=0 tx=0).stop 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 msgr2=0x7f10b419d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b419d560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00b070 tx=0x7f10ac004db0 comp rx=0 tx=0).stop 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 shutdown_connections 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b4100d20 0x7f10b419d560 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f10a409f4d0 0x7f10a40a1980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10b40ff190 0x7f10b4069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 --2- 172.21.15.82:0/3441779629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b4100390 0x7f10b419af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 >> 172.21.15.82:0/3441779629 conn(0x7f10b40fa7e0 msgr2=0x7f10b4103970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 shutdown_connections 2023-03-17T08:08:57.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:08:47.620+0000 7f10bac47700 1 -- 172.21.15.82:0/3441779629 wait complete. 2023-03-17T08:08:57.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:47 smithi082 ceph-mon[94281]: pgmap v730: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:57.551 DEBUG:teuthology.orchestra.run.smithi082:osd.11> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@osd.11.service 2023-03-17T08:08:58.933 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: purged_snaps scrub starts 2023-03-17T08:08:59.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: purged_snaps scrub ok 2023-03-17T08:08:59.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: pgmap v734: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:08:59.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:00.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] boot 2023-03-17T08:09:00.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: osdmap e81: 12 total, 12 up, 12 in 2023-03-17T08:09:00.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:00.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: Detected new or changed devices on smithi082 2023-03-17T08:09:00.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:00.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:00.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:02.749 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:02.749 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:03.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:03.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 4292M 2023-03-17T08:09:03.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.954 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:53 smithi035 ceph-mon[92535]: osdmap e82: 12 total, 12 up, 12 in 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:54 smithi035 ceph-mon[92535]: pgmap v737: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:56 smithi035 ceph-mon[92535]: pgmap v738: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:08:58 smithi035 ceph-mon[92535]: pgmap v739: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: purged_snaps scrub starts 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: purged_snaps scrub ok 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: pgmap v734: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:03.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] boot 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: osdmap e81: 12 total, 12 up, 12 in 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: Detected new or changed devices on smithi082 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:03.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 4292M 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:53 smithi078 ceph-mon[94114]: osdmap e82: 12 total, 12 up, 12 in 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:54 smithi078 ceph-mon[94114]: pgmap v737: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:03.957 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:56 smithi078 ceph-mon[94114]: pgmap v738: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:05.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:08:58 smithi078 ceph-mon[94114]: pgmap v739: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:05.996 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:07.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:48 smithi082 ceph-mon[94281]: from='osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:48 smithi082 ceph-mon[94281]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:49 smithi082 ceph-mon[94281]: pgmap v731: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:49 smithi082 ceph-mon[94281]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:49 smithi082 ceph-mon[94281]: osdmap e79: 12 total, 11 up, 12 in 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:07.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:49 smithi082 ceph-mon[94281]: from='osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:09:07.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:49 smithi082 ceph-mon[94281]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2023-03-17T08:09:07.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:50 smithi082 ceph-mon[94281]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2023-03-17T08:09:07.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:50 smithi082 ceph-mon[94281]: osdmap e80: 12 total, 11 up, 12 in 2023-03-17T08:09:07.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:07.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:07.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: purged_snaps scrub starts 2023-03-17T08:09:08.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: purged_snaps scrub ok 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: pgmap v734: 1 pgs: 1 active+clean; 577 KiB data, 69 MiB used, 983 GiB / 983 GiB avail 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: osd.11 [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] boot 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: osdmap e81: 12 total, 12 up, 12 in 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: Detected new or changed devices on smithi082 2023-03-17T08:09:09.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:09.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:09.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:09.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:09.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:11.837 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:09:11.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 4292M 2023-03-17T08:09:11.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:11.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:11.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:11.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:11.838 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:53 smithi082 ceph-mon[94281]: osdmap e82: 12 total, 12 up, 12 in 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:54 smithi082 ceph-mon[94281]: pgmap v737: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:56 smithi082 ceph-mon[94281]: pgmap v738: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:08:58 smithi082 ceph-mon[94281]: pgmap v739: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:12.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:00 smithi082 ceph-mon[94281]: pgmap v740: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:14.384 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:02 smithi082 ceph-mon[94281]: pgmap v741: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:14.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:04 smithi082 ceph-mon[94281]: pgmap v742: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:14.386 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-03-17T08:09:14.387 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd stat -f json 2023-03-17T08:09:14.388 INFO:journalctl@ceph.osd.11.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:09:14.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:06 smithi082 ceph-mon[94281]: pgmap v743: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:15.582 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:08 smithi082 ceph-mon[94281]: pgmap v744: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:15.582 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:10 smithi082 ceph-mon[94281]: pgmap v745: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:15.582 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:12 smithi082 ceph-mon[94281]: pgmap v746: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:15.583 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:00 smithi035 ceph-mon[92535]: pgmap v740: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:16.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:02 smithi035 ceph-mon[92535]: pgmap v741: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:16.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:04 smithi035 ceph-mon[92535]: pgmap v742: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:16.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:06 smithi035 ceph-mon[92535]: pgmap v743: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:16.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:08 smithi035 ceph-mon[92535]: pgmap v744: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:16.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:10 smithi035 ceph-mon[92535]: pgmap v745: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:16.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:12 smithi035 ceph-mon[92535]: pgmap v746: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:14 smithi035 ceph-mon[92535]: pgmap v747: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:00 smithi078 ceph-mon[94114]: pgmap v740: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:02 smithi078 ceph-mon[94114]: pgmap v741: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:04 smithi078 ceph-mon[94114]: pgmap v742: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:06 smithi078 ceph-mon[94114]: pgmap v743: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:08 smithi078 ceph-mon[94114]: pgmap v744: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:10 smithi078 ceph-mon[94114]: pgmap v745: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:12 smithi078 ceph-mon[94114]: pgmap v746: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:14 smithi078 ceph-mon[94114]: pgmap v747: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:17.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:14 smithi082 ceph-mon[94281]: pgmap v747: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:16 smithi082 ceph-mon[94281]: pgmap v748: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:20.890 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:09:20.891 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:16 smithi078 ceph-mon[94114]: pgmap v748: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:20.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:16 smithi035 ceph-mon[92535]: pgmap v748: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:20.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:18 smithi082 ceph-mon[94281]: pgmap v749: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:22.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:18 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2359485263' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-17T08:09:22.659 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:20 smithi082 ceph-mon[94281]: pgmap v750: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:22.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:18 smithi078 ceph-mon[94114]: pgmap v749: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:22.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:18 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2359485263' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-17T08:09:22.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:20 smithi078 ceph-mon[94114]: pgmap v750: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.613+0000 7fd0072e0700 1 -- 172.21.15.35:0/2701339474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100370 msgr2=0x7fd0001007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.613+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2701339474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100370 0x7fd0001007c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009990 tx=0x7fcff4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 -- 172.21.15.35:0/2701339474 shutdown_connections 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2701339474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd000100d00 0x7fd0001075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2701339474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0000ff170 0x7fd0000ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2701339474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100370 0x7fd0001007c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 -- 172.21.15.35:0/2701339474 >> 172.21.15.35:0/2701339474 conn(0x7fd0000fa780 msgr2=0x7fd0000fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 -- 172.21.15.35:0/2701339474 shutdown_connections 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 -- 172.21.15.35:0/2701339474 wait complete. 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 Processor -- start 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.614+0000 7fd0072e0700 1 -- start start 2023-03-17T08:09:22.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0000ff170 0x7fd000195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd000100370 0x7fd000196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 0x7fd00019d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00019dab0 con 0x7fd000100d00 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00019dbf0 con 0x7fd000100370 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00019dd80 con 0x7fd0000ff170 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 0x7fd00019d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 0x7fd00019d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39790/0 (socket says 172.21.15.35:39790) 2023-03-17T08:09:22.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00507c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0000ff170 0x7fd000195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 -- 172.21.15.35:0/2359485263 learned_addr learned my addr 172.21.15.35:0/2359485263 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:09:25.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00487b700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd000100370 0x7fd000196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:25.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 -- 172.21.15.35:0/2359485263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0000ff170 msgr2=0x7fd000195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:25.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0000ff170 0x7fd000195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:25.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 -- 172.21.15.35:0/2359485263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd000100370 msgr2=0x7fd000196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:25.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd000100370 0x7fd000196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:25.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 -- 172.21.15.35:0/2359485263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40095f0 con 0x7fd000100d00 2023-03-17T08:09:27.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd00587d700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 0x7fd00019d4e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcff8007f10 tx=0x7fcff800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:09:27.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800dd20 con 0x7fd000100d00 2023-03-17T08:09:27.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcff800f040 con 0x7fd000100d00 2023-03-17T08:09:27.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00010a970 con 0x7fd000100d00 2023-03-17T08:09:27.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8004870 con 0x7fd000100d00 2023-03-17T08:09:27.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.615+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00010a7e0 con 0x7fd000100d00 2023-03-17T08:09:29.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.616+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00019e410 con 0x7fd000100d00 2023-03-17T08:09:29.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.618+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fcff8003a00 con 0x7fd000100d00 2023-03-17T08:09:29.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.618+0000 7fcff27fc700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcfec09f4d0 0x7fcfec0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:29.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.618+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcff80c9e40 con 0x7fd000100d00 2023-03-17T08:09:29.617 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.618+0000 7fd00507c700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcfec09f4d0 0x7fcfec0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:29.617 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.619+0000 7fd00507c700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcfec09f4d0 0x7fcfec0a1980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0001001d0 tx=0x7fcffc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:09:29.617 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.622+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fcff80943d0 con 0x7fd000100d00 2023-03-17T08:09:29.617 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.820+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fd00019eab0 con 0x7fd000100d00 2023-03-17T08:09:29.617 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.820+0000 7fcff27fc700 1 -- 172.21.15.35:0/2359485263 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7fcff8023020 con 0x7fd000100d00 2023-03-17T08:09:29.618 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:09:29.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcfec09f4d0 msgr2=0x7fcfec0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:30.451 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcfec09f4d0 0x7fcfec0a1980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0001001d0 tx=0x7fcffc00a380 comp rx=0 tx=0).stop 2023-03-17T08:09:30.451 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 msgr2=0x7fd00019d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:34.420 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 0x7fd00019d4e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcff8007f10 tx=0x7fcff800d3b0 comp rx=0 tx=0).stop 2023-03-17T08:09:34.420 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 shutdown_connections 2023-03-17T08:09:35.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fcfec09f4d0 0x7fcfec0a1980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:35.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd000100d00 0x7fd00019d4e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:35.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0000ff170 0x7fd000195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:35.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 --2- 172.21.15.35:0/2359485263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd000100370 0x7fd000196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:35.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 >> 172.21.15.35:0/2359485263 conn(0x7fd0000fa780 msgr2=0x7fd0000685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:09:36.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 shutdown_connections 2023-03-17T08:09:36.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:17.822+0000 7fd0072e0700 1 -- 172.21.15.35:0/2359485263 wait complete. 2023-03-17T08:09:36.203 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1679040530,"num_in_osds":12,"osd_in_since":1679040512,"num_remapped_pgs":0} 2023-03-17T08:09:36.204 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd dump --format=json 2023-03-17T08:09:36.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:22 smithi082 ceph-mon[94281]: pgmap v751: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:24 smithi082 ceph-mon[94281]: pgmap v752: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:26 smithi082 ceph-mon[94281]: pgmap v753: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:28 smithi082 ceph-mon[94281]: pgmap v754: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.696 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:30 smithi082 ceph-mon[94281]: pgmap v755: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:32 smithi082 ceph-mon[94281]: pgmap v756: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:34 smithi082 ceph-mon[94281]: pgmap v757: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:22 smithi078 ceph-mon[94114]: pgmap v751: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:24 smithi078 ceph-mon[94114]: pgmap v752: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:26 smithi078 ceph-mon[94114]: pgmap v753: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:28 smithi078 ceph-mon[94114]: pgmap v754: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:30 smithi078 ceph-mon[94114]: pgmap v755: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:32 smithi078 ceph-mon[94114]: pgmap v756: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:34 smithi078 ceph-mon[94114]: pgmap v757: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:38.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:18 smithi035 ceph-mon[92535]: pgmap v749: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:18 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2359485263' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:20 smithi035 ceph-mon[92535]: pgmap v750: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:22 smithi035 ceph-mon[92535]: pgmap v751: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:24 smithi035 ceph-mon[92535]: pgmap v752: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:26 smithi035 ceph-mon[92535]: pgmap v753: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:28 smithi035 ceph-mon[92535]: pgmap v754: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:30 smithi035 ceph-mon[92535]: pgmap v755: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:32 smithi035 ceph-mon[92535]: pgmap v756: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:34 smithi035 ceph-mon[92535]: pgmap v757: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.139 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:36 smithi035 ceph-mon[92535]: pgmap v758: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:36 smithi082 ceph-mon[94281]: pgmap v758: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:38 smithi082 ceph-mon[94281]: pgmap v759: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:36 smithi078 ceph-mon[94114]: pgmap v758: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:38 smithi078 ceph-mon[94114]: pgmap v759: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:41.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:38 smithi035 ceph-mon[92535]: pgmap v759: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:43.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:40 smithi082 ceph-mon[94281]: pgmap v760: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:43.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:41 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1519081858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:09:43.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:40 smithi078 ceph-mon[94114]: pgmap v760: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:43.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:41 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1519081858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:09:43.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:42 smithi082 ceph-mon[94281]: pgmap v761: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:44.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:42 smithi078 ceph-mon[94114]: pgmap v761: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 -- 172.21.15.35:0/3701359407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 msgr2=0x7f542010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 --2- 172.21.15.35:0/3701359407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542010d100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f541800b0d0 tx=0x7f541800b3e0 comp rx=0 tx=0).stop 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 -- 172.21.15.35:0/3701359407 shutdown_connections 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 --2- 172.21.15.35:0/3701359407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542010d100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 --2- 172.21.15.35:0/3701359407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54201004e0 0x7f54201008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 --2- 172.21.15.35:0/3701359407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5420100e80 0x7f5420104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.675+0000 7f5425758700 1 -- 172.21.15.35:0/3701359407 >> 172.21.15.35:0/3701359407 conn(0x7f54200fbd80 msgr2=0x7f54200fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.676+0000 7f5425758700 1 -- 172.21.15.35:0/3701359407 shutdown_connections 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.676+0000 7f5425758700 1 -- 172.21.15.35:0/3701359407 wait complete. 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.676+0000 7f5425758700 1 Processor -- start 2023-03-17T08:09:44.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.676+0000 7f5425758700 1 -- start start 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54201004e0 0x7f5420196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5420100e80 0x7f54201968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542019b320 con 0x7f5420105580 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542019b490 con 0x7f5420100e80 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542019b650 con 0x7f54201004e0 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542019ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39802/0 (socket says 172.21.15.35:39802) 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 -- 172.21.15.35:0/1519081858 learned_addr learned my addr 172.21.15.35:0/1519081858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541effd700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54201004e0 0x7f5420196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541e7fc700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5420100e80 0x7f54201968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 -- 172.21.15.35:0/1519081858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54201004e0 msgr2=0x7f5420196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54201004e0 0x7f5420196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:44.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 -- 172.21.15.35:0/1519081858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5420100e80 msgr2=0x7f54201968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5420100e80 0x7f54201968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 -- 172.21.15.35:0/1519081858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009d00 con 0x7f5420105580 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f541f7fe700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542019ad10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5418009380 tx=0x7f54180093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800e040 con 0x7f5420105580 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5420110170 con 0x7f5420105580 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.677+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5418003e10 con 0x7f5420105580 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.678+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541801b940 con 0x7f5420105580 2023-03-17T08:09:45.030 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.678+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542010ffe0 con 0x7f5420105580 2023-03-17T08:09:45.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.678+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5420110300 con 0x7f5420105580 2023-03-17T08:09:45.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.680+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f5418005690 con 0x7f5420105580 2023-03-17T08:09:45.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.680+0000 7f5417fff700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f540c09f4d0 0x7f540c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:46.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.680+0000 7f541effd700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f540c09f4d0 0x7f540c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:46.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.680+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54180cbb70 con 0x7f5420105580 2023-03-17T08:09:46.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.681+0000 7f541effd700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f540c09f4d0 0x7f540c0a1980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5410005950 tx=0x7f541000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:09:46.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.684+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f5418096190 con 0x7f5420105580 2023-03-17T08:09:46.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:40 smithi035 ceph-mon[92535]: pgmap v760: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:47.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.881+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54201a33e0 con 0x7f5420105580 2023-03-17T08:09:47.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.882+0000 7f5417fff700 1 -- 172.21.15.35:0/1519081858 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f54180997b0 con 0x7f5420105580 2023-03-17T08:09:47.936 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:09:47.936 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":82,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:08:52.191126+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:09:48.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:44 smithi082 ceph-mon[94281]: pgmap v762: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:48.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:46 smithi082 ceph-mon[94281]: pgmap v763: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:48.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:48 smithi082 ceph-mon[94281]: pgmap v764: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:48.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:44 smithi078 ceph-mon[94114]: pgmap v762: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:48.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:46 smithi078 ceph-mon[94114]: pgmap v763: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:48.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:48 smithi078 ceph-mon[94114]: pgmap v764: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:48.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f540c09f4d0 msgr2=0x7f540c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:50.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f540c09f4d0 0x7f540c0a1980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5410005950 tx=0x7f541000a300 comp rx=0 tx=0).stop 2023-03-17T08:09:50.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 msgr2=0x7f542019ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:50.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542019ad10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5418009380 tx=0x7f54180093b0 comp rx=0 tx=0).stop 2023-03-17T08:09:50.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 shutdown_connections 2023-03-17T08:09:50.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f540c09f4d0 0x7f540c0a1980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:50.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5420105580 0x7f542019ad10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:51.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54201004e0 0x7f5420196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:51.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 --2- 172.21.15.35:0/1519081858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5420100e80 0x7f54201968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:51.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.884+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 >> 172.21.15.35:0/1519081858 conn(0x7f54200fbd80 msgr2=0x7f54200fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:09:51.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.885+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 shutdown_connections 2023-03-17T08:09:51.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:40.885+0000 7f5425758700 1 -- 172.21.15.35:0/1519081858 wait complete. 2023-03-17T08:09:51.910 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:09:53.827 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:41 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1519081858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:42 smithi035 ceph-mon[92535]: pgmap v761: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:44 smithi035 ceph-mon[92535]: pgmap v762: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:46 smithi035 ceph-mon[92535]: pgmap v763: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:48 smithi035 ceph-mon[92535]: pgmap v764: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:50 smithi035 ceph-mon[92535]: pgmap v765: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:53.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:52 smithi035 ceph-mon[92535]: pgmap v766: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:53.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:09:53.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:53.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:53.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:53.829 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:50 smithi082 ceph-mon[94281]: pgmap v765: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:54.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:52 smithi082 ceph-mon[94281]: pgmap v766: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:54.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:09:54.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:55.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:55.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:55.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:50 smithi078 ceph-mon[94114]: pgmap v765: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:55.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:52 smithi078 ceph-mon[94114]: pgmap v766: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:55.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:09:55.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:09:55.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:09:55.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:09:55.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:54 smithi082 ceph-mon[94281]: pgmap v767: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:56.530 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:54 smithi078 ceph-mon[94114]: pgmap v767: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:56.530 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:09:57.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:54 smithi035 ceph-mon[92535]: pgmap v767: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:57.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:56 smithi082 ceph-mon[94281]: pgmap v768: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:57.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:56 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/47332292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:09:57.550 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:56 smithi078 ceph-mon[94114]: pgmap v768: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:09:57.550 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:56 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/47332292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:09:57.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 -- 172.21.15.35:0/321933202 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff4068cc0 msgr2=0x7f3ff40ff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:57.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/321933202 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff4068cc0 0x7f3ff40ff4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009990 tx=0x7f3fe4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:09:57.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 -- 172.21.15.35:0/321933202 shutdown_connections 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/321933202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ff410a930 0x7f3ff410cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/321933202 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff4068cc0 0x7f3ff40ff4c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/321933202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff40ffa90 0x7f3ff40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 -- 172.21.15.35:0/321933202 >> 172.21.15.35:0/321933202 conn(0x7f3ff4074ac0 msgr2=0x7f3ff4074ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.934+0000 7f3ff99d4700 1 -- 172.21.15.35:0/321933202 shutdown_connections 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.935+0000 7f3ff99d4700 1 -- 172.21.15.35:0/321933202 wait complete. 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.935+0000 7f3ff99d4700 1 Processor -- start 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.935+0000 7f3ff99d4700 1 -- start start 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff99d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff4068cc0 0x7f3ff4196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff99d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ff40ffa90 0x7f3ff4196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff99d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 0x7f3ff419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff99d4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff419b210 con 0x7f3ff410a930 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff99d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff419b380 con 0x7f3ff4068cc0 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff99d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff419b540 con 0x7f3ff40ffa90 2023-03-17T08:09:57.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 0x7f3ff419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:58.571 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 0x7f3ff419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39816/0 (socket says 172.21.15.35:39816) 2023-03-17T08:09:58.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 -- 172.21.15.35:0/47332292 learned_addr learned my addr 172.21.15.35:0/47332292 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:09:58.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff27fc700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ff40ffa90 0x7f3ff4196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:58.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff2ffd700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff4068cc0 0x7f3ff4196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:58.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 -- 172.21.15.35:0/47332292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ff40ffa90 msgr2=0x7f3ff4196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:58.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ff40ffa90 0x7f3ff4196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 -- 172.21.15.35:0/47332292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff4068cc0 msgr2=0x7f3ff4196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff4068cc0 0x7f3ff4196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 -- 172.21.15.35:0/47332292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40095f0 con 0x7f3ff410a930 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff37fe700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 0x7f3ff419ac00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00ada0 tx=0x7f3fec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.936+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00f070 con 0x7f3ff410a930 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.937+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fec007b30 con 0x7f3ff410a930 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.937+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff4110260 con 0x7f3ff410a930 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.937+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec005280 con 0x7f3ff410a930 2023-03-17T08:09:59.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.937+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff41100d0 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.938+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff41103f0 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.939+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3fec00c8d0 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.939+0000 7f3ff89d2700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3fe009f4d0 0x7f3fe00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.939+0000 7f3ff2ffd700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3fe009f4d0 0x7f3fe00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.939+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3fec0c9360 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.940+0000 7f3ff2ffd700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3fe009f4d0 0x7f3fe00a1980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b5c0 tx=0x7f3fe4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:55.944+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3fec093980 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.140+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ff41975b0 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.141+0000 7f3ff89d2700 1 -- 172.21.15.35:0/47332292 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fec096fa0 con 0x7f3ff410a930 2023-03-17T08:09:59.595 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:09:59.597 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3fe009f4d0 msgr2=0x7f3fe00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:01.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3fe009f4d0 0x7f3fe00a1980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b5c0 tx=0x7f3fe4005fb0 comp rx=0 tx=0).stop 2023-03-17T08:10:01.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 msgr2=0x7f3ff419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:01.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 0x7f3ff419ac00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00ada0 tx=0x7f3fec00c330 comp rx=0 tx=0).stop 2023-03-17T08:10:01.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 shutdown_connections 2023-03-17T08:10:01.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3fe009f4d0 0x7f3fe00a1980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:02.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ff410a930 0x7f3ff419ac00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:02.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ff4068cc0 0x7f3ff4196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:02.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 --2- 172.21.15.35:0/47332292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ff40ffa90 0x7f3ff4196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:02.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 >> 172.21.15.35:0/47332292 conn(0x7f3ff4074ac0 msgr2=0x7f3ff41027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:10:02.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 shutdown_connections 2023-03-17T08:10:02.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:09:56.143+0000 7f3ff99d4700 1 -- 172.21.15.35:0/47332292 wait complete. 2023-03-17T08:10:02.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:56 smithi035 ceph-mon[92535]: pgmap v768: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:02.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:56 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/47332292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:10:02.920 INFO:tasks.cephadm:Adding mds.a on smithi035 2023-03-17T08:10:02.920 INFO:tasks.cephadm:Adding mds.d on smithi035 2023-03-17T08:10:02.920 INFO:tasks.cephadm:Adding mds.g on smithi035 2023-03-17T08:10:02.920 INFO:tasks.cephadm:Adding mds.j on smithi035 2023-03-17T08:10:02.920 INFO:tasks.cephadm:Adding mds.b on smithi078 2023-03-17T08:10:02.920 INFO:tasks.cephadm:Adding mds.e on smithi078 2023-03-17T08:10:02.921 INFO:tasks.cephadm:Adding mds.h on smithi078 2023-03-17T08:10:02.921 INFO:tasks.cephadm:Adding mds.k on smithi078 2023-03-17T08:10:02.921 INFO:tasks.cephadm:Adding mds.c on smithi082 2023-03-17T08:10:02.921 INFO:tasks.cephadm:Adding mds.f on smithi082 2023-03-17T08:10:02.921 INFO:tasks.cephadm:Adding mds.i on smithi082 2023-03-17T08:10:02.921 INFO:tasks.cephadm:Adding mds.l on smithi082 2023-03-17T08:10:04.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph orch apply mds all '12;smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l' 2023-03-17T08:10:04.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:09:58 smithi035 ceph-mon[92535]: pgmap v769: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:00 smithi035 ceph-mon[92535]: pgmap v770: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T08:10:04.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:02 smithi035 ceph-mon[92535]: pgmap v771: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:09:58 smithi082 ceph-mon[94281]: pgmap v769: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:00 smithi082 ceph-mon[94281]: pgmap v770: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T08:10:04.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:02 smithi082 ceph-mon[94281]: pgmap v771: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.083 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:09:58 smithi078 ceph-mon[94114]: pgmap v769: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.083 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:00 smithi078 ceph-mon[94114]: pgmap v770: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.083 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T08:10:04.083 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:02 smithi078 ceph-mon[94114]: pgmap v771: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:04.382 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:04 smithi082 ceph-mon[94281]: pgmap v772: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:05.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:04 smithi035 ceph-mon[92535]: pgmap v772: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:05.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:04 smithi078 ceph-mon[94114]: pgmap v772: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:05.326 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.c/config 2023-03-17T08:10:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 -- 172.21.15.82:0/806161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c100d00 msgr2=0x7fb87c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 --2- 172.21.15.82:0/806161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c100d00 0x7fb87c1075c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb87400b0a0 tx=0x7fb87400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:10:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 -- 172.21.15.82:0/806161371 shutdown_connections 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 --2- 172.21.15.82:0/806161371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c100d00 0x7fb87c1075c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 --2- 172.21.15.82:0/806161371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c0ff170 0x7fb87c0ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 --2- 172.21.15.82:0/806161371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87c100370 0x7fb87c1007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 -- 172.21.15.82:0/806161371 >> 172.21.15.82:0/806161371 conn(0x7fb87c0fa780 msgr2=0x7fb87c0fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 -- 172.21.15.82:0/806161371 shutdown_connections 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.051+0000 7fb881a69700 1 -- 172.21.15.82:0/806161371 wait complete. 2023-03-17T08:10:07.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 Processor -- start 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 -- start start 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 0x7fb87c194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87c100370 0x7fb87c1953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c100d00 0x7fb87c19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c19ca30 con 0x7fb87c100d00 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c19cb70 con 0x7fb87c100370 2023-03-17T08:10:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb881a69700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c19cd00 con 0x7fb87c0ff170 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 0x7fb87c194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 0x7fb87c194ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53200/0 (socket says 172.21.15.82:53200) 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb87b7fe700 1 -- 172.21.15.82:0/1288425182 learned_addr learned my addr 172.21.15.82:0/1288425182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb87affd700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87c100370 0x7fb87c1953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.052+0000 7fb87bfff700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c100d00 0x7fb87c19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87b7fe700 1 -- 172.21.15.82:0/1288425182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87c100370 msgr2=0x7fb87c1953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87b7fe700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87c100370 0x7fb87c1953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87b7fe700 1 -- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c100d00 msgr2=0x7fb87c19c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87b7fe700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c100d00 0x7fb87c19c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:08.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87b7fe700 1 -- 172.21.15.82:0/1288425182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874009d00 con 0x7fb87c0ff170 2023-03-17T08:10:08.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87bfff700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c100d00 0x7fb87c19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:10:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb87b7fe700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 0x7fb87c194ea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb87000c9c0 tx=0x7fb87000ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:10:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870007ac0 con 0x7fb87c0ff170 2023-03-17T08:10:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb870007c20 con 0x7fb87c0ff170 2023-03-17T08:10:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c10a980 con 0x7fb87c0ff170 2023-03-17T08:10:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870018660 con 0x7fb87c0ff170 2023-03-17T08:10:09.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: pgmap v773: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:09.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:09.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:09.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:10.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:10.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:10.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:10.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:10.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:10.441 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:10.441 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:07 smithi035 ceph-mon[92535]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:10:11.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:07 smithi035 ceph-mon[92535]: Saving service mds.all spec with placement smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2023-03-17T08:10:11.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:07 smithi035 ceph-mon[92535]: Deploying daemon mds.l on smithi082 2023-03-17T08:10:11.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:08 smithi035 ceph-mon[92535]: pgmap v774: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:12.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: pgmap v773: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:12.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:12.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:12.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:07 smithi078 ceph-mon[94114]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:10:12.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:07 smithi078 ceph-mon[94114]: Saving service mds.all spec with placement smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2023-03-17T08:10:12.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:07 smithi078 ceph-mon[94114]: Deploying daemon mds.l on smithi082 2023-03-17T08:10:12.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:08 smithi078 ceph-mon[94114]: pgmap v774: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:12.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.053+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c10a7f0 con 0x7fb87c0ff170 2023-03-17T08:10:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.054+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c066e30 con 0x7fb87c0ff170 2023-03-17T08:10:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.055+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb87000f450 con 0x7fb87c0ff170 2023-03-17T08:10:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.056+0000 7fb878ff9700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb86409f550 0x7fb8640a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:10:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.056+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb8700c9dd0 con 0x7fb87c0ff170 2023-03-17T08:10:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.056+0000 7fb87affd700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb86409f550 0x7fb8640a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:10:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.056+0000 7fb87affd700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb86409f550 0x7fb8640a1a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb86c005950 tx=0x7fb86c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:10:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.059+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb870094470 con 0x7fb87c0ff170 2023-03-17T08:10:14.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.254+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fb87c0692a0 con 0x7fb86409f550 2023-03-17T08:10:14.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.263+0000 7fb878ff9700 1 -- 172.21.15.82:0/1288425182 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fb87c0692a0 con 0x7fb86409f550 2023-03-17T08:10:14.992 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mds.all update... 2023-03-17T08:10:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.265+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb86409f550 msgr2=0x7fb8640a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.265+0000 7fb881a69700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb86409f550 0x7fb8640a1a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb86c005950 tx=0x7fb86c00a300 comp rx=0 tx=0).stop 2023-03-17T08:10:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.265+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 msgr2=0x7fb87c194ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:10:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 0x7fb87c194ea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb87000c9c0 tx=0x7fb87000ccd0 comp rx=0 tx=0).stop 2023-03-17T08:10:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 shutdown_connections 2023-03-17T08:10:14.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb86409f550 0x7fb8640a1a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:14.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb87c100d00 0x7fb87c19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb87c0ff170 0x7fb87c194ea0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 --2- 172.21.15.82:0/1288425182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb87c100370 0x7fb87c1953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:10:16.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 >> 172.21.15.82:0/1288425182 conn(0x7fb87c0fa780 msgr2=0x7fb87c1038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:10:16.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 shutdown_connections 2023-03-17T08:10:16.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-03-17T08:10:06.266+0000 7fb881a69700 1 -- 172.21.15.82:0/1288425182 wait complete. 2023-03-17T08:10:16.569 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: pgmap v773: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:19.806 DEBUG:teuthology.orchestra.run.smithi035:mds.a> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.a.service 2023-03-17T08:10:21.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6832/1456535346,v1:172.21.15.82:6833/1456535346] up:boot 2023-03-17T08:10:21.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: fsmap 1 up:standby 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:09 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:10 smithi035 ceph-mon[92535]: pgmap v775: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:10 smithi035 ceph-mon[92535]: Deploying daemon mds.k on smithi078 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: pgmap v776: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:21.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: Deploying daemon mds.j on smithi035 2023-03-17T08:10:22.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6832/3173843386,v1:172.21.15.78:6833/3173843386] up:boot 2023-03-17T08:10:22.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: fsmap 2 up:standby 2023-03-17T08:10:22.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-17T08:10:22.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: pgmap v777: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:23.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:23.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:23.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:23.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: Deploying daemon mds.d on smithi035 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6834/3728573608,v1:172.21.15.35:6835/3728573608] up:boot 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: fsmap 3 up:standby 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: pgmap v778: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:23.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/623104731,v1:172.21.15.35:6837/623104731] up:boot 2023-03-17T08:10:23.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: fsmap 4 up:standby 2023-03-17T08:10:23.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T08:10:23.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:23.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:23.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:23.745 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:16 smithi035 ceph-mon[92535]: Deploying daemon mds.e on smithi078 2023-03-17T08:10:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: pgmap v779: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6834/3131921401,v1:172.21.15.78:6835/3131921401] up:boot 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: fsmap 5 up:standby 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:19 smithi035 ceph-mon[92535]: Deploying daemon mds.f on smithi082 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: pgmap v780: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:20 smithi035 ceph-mon[92535]: Deploying daemon mds.c on smithi082 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:21 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] up:boot 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:21 smithi035 ceph-mon[92535]: fsmap 6 up:standby 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-17T08:10:26.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:21 smithi035 ceph-mon[92535]: pgmap v781: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6832/1456535346,v1:172.21.15.82:6833/1456535346] up:boot 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: fsmap 1 up:standby 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:09 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:10 smithi078 ceph-mon[94114]: pgmap v775: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:10 smithi078 ceph-mon[94114]: Deploying daemon mds.k on smithi078 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: pgmap v776: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: Deploying daemon mds.j on smithi035 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6832/3173843386,v1:172.21.15.78:6833/3173843386] up:boot 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: fsmap 2 up:standby 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-17T08:10:26.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: pgmap v777: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: Deploying daemon mds.d on smithi035 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6834/3728573608,v1:172.21.15.35:6835/3728573608] up:boot 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: fsmap 3 up:standby 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: pgmap v778: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/623104731,v1:172.21.15.35:6837/623104731] up:boot 2023-03-17T08:10:26.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: fsmap 4 up:standby 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:16 smithi078 ceph-mon[94114]: Deploying daemon mds.e on smithi078 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: pgmap v779: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:26.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:26.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:26.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:26.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6834/3131921401,v1:172.21.15.78:6835/3131921401] up:boot 2023-03-17T08:10:26.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: fsmap 5 up:standby 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:19 smithi078 ceph-mon[94114]: Deploying daemon mds.f on smithi082 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: pgmap v780: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:27.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:27.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:20 smithi078 ceph-mon[94114]: Deploying daemon mds.c on smithi082 2023-03-17T08:10:27.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:21 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] up:boot 2023-03-17T08:10:27.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:21 smithi078 ceph-mon[94114]: fsmap 6 up:standby 2023-03-17T08:10:27.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-17T08:10:27.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:21 smithi078 ceph-mon[94114]: pgmap v781: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:27.861 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:07 smithi082 ceph-mon[94281]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:10:29.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:07 smithi082 ceph-mon[94281]: Saving service mds.all spec with placement smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2023-03-17T08:10:29.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:07 smithi082 ceph-mon[94281]: Deploying daemon mds.l on smithi082 2023-03-17T08:10:29.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:08 smithi082 ceph-mon[94281]: pgmap v774: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:29.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6832/1456535346,v1:172.21.15.82:6833/1456535346] up:boot 2023-03-17T08:10:29.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: fsmap 1 up:standby 2023-03-17T08:10:29.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-17T08:10:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:30.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:09 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:30.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:10 smithi082 ceph-mon[94281]: pgmap v775: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:30.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:10 smithi082 ceph-mon[94281]: Deploying daemon mds.k on smithi078 2023-03-17T08:10:30.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: pgmap v776: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:30.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:30.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: Deploying daemon mds.j on smithi035 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6832/3173843386,v1:172.21.15.78:6833/3173843386] up:boot 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: fsmap 2 up:standby 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: pgmap v777: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:33.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:34.573 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:34.573 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:34.573 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:34.573 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: Deploying daemon mds.d on smithi035 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6834/3728573608,v1:172.21.15.35:6835/3728573608] up:boot 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: fsmap 3 up:standby 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: pgmap v778: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/623104731,v1:172.21.15.35:6837/623104731] up:boot 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: fsmap 4 up:standby 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:34.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:34.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:34.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:16 smithi082 ceph-mon[94281]: Deploying daemon mds.e on smithi078 2023-03-17T08:10:34.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: pgmap v779: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:35.525 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:35.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:35.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:35.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:35.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:35.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6834/3131921401,v1:172.21.15.78:6835/3131921401] up:boot 2023-03-17T08:10:36.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: fsmap 5 up:standby 2023-03-17T08:10:38.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T08:10:38.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:19 smithi082 ceph-mon[94281]: Deploying daemon mds.f on smithi082 2023-03-17T08:10:38.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: pgmap v780: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:38.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:38.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:38.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:38.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:38.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:38.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:20 smithi082 ceph-mon[94281]: Deploying daemon mds.c on smithi082 2023-03-17T08:10:38.151 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:21 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] up:boot 2023-03-17T08:10:38.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:21 smithi082 ceph-mon[94281]: fsmap 6 up:standby 2023-03-17T08:10:38.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-17T08:10:38.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:21 smithi082 ceph-mon[94281]: pgmap v781: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:38.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:38.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:38.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:38.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:39.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: Deploying daemon mds.h on smithi078 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] up:boot 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: fsmap 7 up:standby 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:23 smithi082 ceph-mon[94281]: pgmap v782: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:40.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:40.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: Deploying daemon mds.i on smithi082 2023-03-17T08:10:40.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] up:boot 2023-03-17T08:10:40.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: fsmap 8 up:standby 2023-03-17T08:10:40.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-17T08:10:40.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:26 smithi082 ceph-mon[94281]: pgmap v783: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:40.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:40.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:40.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:40.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:40.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:40.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: Deploying daemon mds.h on smithi078 2023-03-17T08:10:40.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] up:boot 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: fsmap 7 up:standby 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:23 smithi035 ceph-mon[92535]: pgmap v782: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: Deploying daemon mds.i on smithi082 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] up:boot 2023-03-17T08:10:40.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: fsmap 8 up:standby 2023-03-17T08:10:41.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-17T08:10:41.412 DEBUG:teuthology.orchestra.run.smithi035:mds.d> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service 2023-03-17T08:10:42.806 INFO:journalctl@ceph.mds.a.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:10:42.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:26 smithi035 ceph-mon[92535]: pgmap v783: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:42.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: pgmap v784: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:42.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:42.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:43.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:43.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:43.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:44.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: Deploying daemon mds.g on smithi035 2023-03-17T08:10:44.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] up:boot 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: fsmap 9 up:standby 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: pgmap v785: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:46.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:47.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: Deploying daemon mds.a on smithi035 2023-03-17T08:10:47.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6838/1982578351,v1:172.21.15.35:6839/1982578351] up:boot 2023-03-17T08:10:47.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: fsmap 10 up:standby 2023-03-17T08:10:48.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:29 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: pgmap v784: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: Deploying daemon mds.g on smithi035 2023-03-17T08:10:48.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] up:boot 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: fsmap 9 up:standby 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: pgmap v785: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:48.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: Deploying daemon mds.a on smithi035 2023-03-17T08:10:48.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6838/1982578351,v1:172.21.15.35:6839/1982578351] up:boot 2023-03-17T08:10:48.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: fsmap 10 up:standby 2023-03-17T08:10:48.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:29 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-17T08:10:48.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: pgmap v786: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:48.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: Deploying daemon mds.b on smithi078 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6840/3680182485,v1:172.21.15.35:6841/3680182485] up:boot 2023-03-17T08:10:49.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: fsmap 11 up:standby 2023-03-17T08:10:50.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: pgmap v787: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] up:boot 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: fsmap 12 up:standby 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-17T08:10:50.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: pgmap v788: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:50.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:51.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:51.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:36 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:37 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:38 smithi082 ceph-mon[94281]: pgmap v789: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:38 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: pgmap v790: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:51.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:51.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:52.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:52.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:41 smithi082 ceph-mon[94281]: pgmap v791: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:53.188 INFO:journalctl@ceph.mds.a.smithi035.stdout:Mar 17 08:10:30 smithi035 systemd[1]: Starting Ceph mds.a for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T08:10:53.188 INFO:journalctl@ceph.mds.a.smithi035.stdout:Mar 17 08:10:30 smithi035 podman[128591]: 2023-03-17T08:10:53.188 INFO:journalctl@ceph.mds.a.smithi035.stdout:Mar 17 08:10:30 smithi035 bash[128591]: 85c405cc50883fb6fbef492ce986b462111df72291a619cc9f5b3c59bba917b9 2023-03-17T08:10:53.188 INFO:journalctl@ceph.mds.a.smithi035.stdout:Mar 17 08:10:30 smithi035 ceph-mds[128631]: -- 172.21.15.35:0/2919418938 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560f1960eb60 con 0x560f195e4800 2023-03-17T08:10:53.188 INFO:journalctl@ceph.mds.a.smithi035.stdout:Mar 17 08:10:30 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-a[128607]: starting mds.a at 2023-03-17T08:10:53.188 INFO:journalctl@ceph.mds.a.smithi035.stdout:Mar 17 08:10:31 smithi035 systemd[1]: Started Ceph mds.a for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T08:10:53.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: Deploying daemon mds.h on smithi078 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] up:boot 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: fsmap 7 up:standby 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:23 smithi078 ceph-mon[94114]: pgmap v782: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: Deploying daemon mds.i on smithi082 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] up:boot 2023-03-17T08:10:53.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: fsmap 8 up:standby 2023-03-17T08:10:53.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-17T08:10:53.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:26 smithi078 ceph-mon[94114]: pgmap v783: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:53.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: pgmap v784: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:54.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:54.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:54.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:54.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: Deploying daemon mds.g on smithi035 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] up:boot 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: fsmap 9 up:standby 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: pgmap v785: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: Deploying daemon mds.a on smithi035 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6838/1982578351,v1:172.21.15.35:6839/1982578351] up:boot 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: fsmap 10 up:standby 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:29 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: pgmap v786: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: Deploying daemon mds.b on smithi078 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6840/3680182485,v1:172.21.15.35:6841/3680182485] up:boot 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: fsmap 11 up:standby 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: pgmap v787: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:54.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] up:boot 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: fsmap 12 up:standby 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: pgmap v788: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:36 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:37 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:38 smithi078 ceph-mon[94114]: pgmap v789: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:38 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: pgmap v790: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:41 smithi078 ceph-mon[94114]: pgmap v791: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:43 smithi078 ceph-mon[94114]: pgmap v792: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:46 smithi078 ceph-mon[94114]: pgmap v793: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:48 smithi078 ceph-mon[94114]: pgmap v794: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:50 smithi078 ceph-mon[94114]: pgmap v795: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:52 smithi078 ceph-mon[94114]: pgmap v796: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:56.187 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: pgmap v786: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:58.147 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:58.147 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:58.147 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-03-17T08:10:58.147 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: Deploying daemon mds.b on smithi078 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6840/3680182485,v1:172.21.15.35:6841/3680182485] up:boot 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: fsmap 11 up:standby 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: pgmap v787: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:58.148 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] up:boot 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: fsmap 12 up:standby 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: pgmap v788: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:58.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:59.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:59.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:59.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:10:59.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:11:00.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:36 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:37 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:38 smithi035 ceph-mon[92535]: pgmap v789: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:38 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: pgmap v790: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:01.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:02.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:03.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:41 smithi035 ceph-mon[92535]: pgmap v791: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:04.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:43 smithi035 ceph-mon[92535]: pgmap v792: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:04.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:46 smithi035 ceph-mon[92535]: pgmap v793: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:04.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:48 smithi035 ceph-mon[92535]: pgmap v794: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:04.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:50 smithi035 ceph-mon[92535]: pgmap v795: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:04.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:52 smithi035 ceph-mon[92535]: pgmap v796: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:04.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:54 smithi078 ceph-mon[94114]: pgmap v797: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:06.210 DEBUG:teuthology.orchestra.run.smithi035:mds.g> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.g.service 2023-03-17T08:11:06.211 INFO:journalctl@ceph.mds.d.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:11:06.212 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:54 smithi035 ceph-mon[92535]: pgmap v797: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:56 smithi035 ceph-mon[92535]: pgmap v798: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:10:58 smithi035 ceph-mon[92535]: pgmap v799: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:00 smithi035 ceph-mon[92535]: pgmap v800: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:02 smithi035 ceph-mon[92535]: pgmap v801: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.529 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:04 smithi035 ceph-mon[92535]: pgmap v802: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:43 smithi082 ceph-mon[94281]: pgmap v792: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:07.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:46 smithi082 ceph-mon[94281]: pgmap v793: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:08.464 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:48 smithi082 ceph-mon[94281]: pgmap v794: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:10.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:50 smithi082 ceph-mon[94281]: pgmap v795: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:10.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:52 smithi082 ceph-mon[94281]: pgmap v796: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:10.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:54 smithi082 ceph-mon[94281]: pgmap v797: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:10.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:56 smithi082 ceph-mon[94281]: pgmap v798: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.119 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:10:58 smithi082 ceph-mon[94281]: pgmap v799: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.119 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:00 smithi082 ceph-mon[94281]: pgmap v800: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.119 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:02 smithi082 ceph-mon[94281]: pgmap v801: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.119 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:04 smithi082 ceph-mon[94281]: pgmap v802: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:56 smithi078 ceph-mon[94114]: pgmap v798: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:10:58 smithi078 ceph-mon[94114]: pgmap v799: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:12.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:00 smithi078 ceph-mon[94114]: pgmap v800: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:13.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:02 smithi078 ceph-mon[94114]: pgmap v801: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:13.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:04 smithi078 ceph-mon[94114]: pgmap v802: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:13.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:06 smithi078 ceph-mon[94114]: pgmap v803: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:14.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:08 smithi078 ceph-mon[94114]: pgmap v804: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:14.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:10 smithi078 ceph-mon[94114]: pgmap v805: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:14.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:06 smithi035 ceph-mon[92535]: pgmap v803: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:15.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:12 smithi078 ceph-mon[94114]: pgmap v806: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:15.591 DEBUG:teuthology.orchestra.run.smithi035:mds.j> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.j.service 2023-03-17T08:11:15.592 INFO:journalctl@ceph.mds.g.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:11:16.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:06 smithi082 ceph-mon[94281]: pgmap v803: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:08 smithi082 ceph-mon[94281]: pgmap v804: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:10 smithi082 ceph-mon[94281]: pgmap v805: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:12 smithi082 ceph-mon[94281]: pgmap v806: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:14 smithi082 ceph-mon[94281]: pgmap v807: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:08 smithi035 ceph-mon[92535]: pgmap v804: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:10 smithi035 ceph-mon[92535]: pgmap v805: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:12 smithi035 ceph-mon[92535]: pgmap v806: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:14 smithi035 ceph-mon[92535]: pgmap v807: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:14 smithi078 ceph-mon[94114]: pgmap v807: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:16.222 DEBUG:teuthology.orchestra.run.smithi078:mds.b> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.b.service 2023-03-17T08:11:16.225 DEBUG:teuthology.orchestra.run.smithi078:mds.e> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service 2023-03-17T08:11:17.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:16 smithi082 ceph-mon[94281]: pgmap v808: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:17.644 INFO:journalctl@ceph.mds.j.smithi035.stdout:-- Logs begin at Fri 2023-03-17 07:25:46 UTC. -- 2023-03-17T08:11:17.644 INFO:journalctl@ceph.mds.b.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:11:17.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:16 smithi035 ceph-mon[92535]: pgmap v808: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:17.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:16 smithi078 ceph-mon[94114]: pgmap v808: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:17.685 DEBUG:teuthology.orchestra.run.smithi078:mds.h> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.h.service 2023-03-17T08:11:19.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:18 smithi035 ceph-mon[92535]: pgmap v809: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:19.383 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:18 smithi082 ceph-mon[94281]: pgmap v809: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:19.383 INFO:journalctl@ceph.mds.e.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:11:19.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:18 smithi078 ceph-mon[94114]: pgmap v809: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:19.424 DEBUG:teuthology.orchestra.run.smithi078:mds.k> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.k.service 2023-03-17T08:11:20.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:20 smithi035 ceph-mon[92535]: pgmap v810: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:21.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:20 smithi082 ceph-mon[94281]: pgmap v810: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:21.521 INFO:journalctl@ceph.mds.h.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:11:21.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:20 smithi078 ceph-mon[94114]: pgmap v810: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:21.523 DEBUG:teuthology.orchestra.run.smithi082:mds.c> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.c.service 2023-03-17T08:11:22.412 INFO:journalctl@ceph.mds.k.smithi078.stdout:-- Logs begin at Fri 2023-03-17 07:26:13 UTC. -- 2023-03-17T08:11:22.414 DEBUG:teuthology.orchestra.run.smithi082:mds.f> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.f.service 2023-03-17T08:11:22.450 INFO:journalctl@ceph.mds.c.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:11:24.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:22 smithi035 ceph-mon[92535]: pgmap v811: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:24.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:22 smithi078 ceph-mon[94114]: pgmap v811: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:24.005 DEBUG:teuthology.orchestra.run.smithi082:mds.i> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.i.service 2023-03-17T08:11:24.643 INFO:journalctl@ceph.mds.f.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:11:24.643 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:22 smithi082 ceph-mon[94281]: pgmap v811: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:24.643 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:24 smithi082 ceph-mon[94281]: pgmap v812: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:24.685 DEBUG:teuthology.orchestra.run.smithi082:mds.l> sudo journalctl -f -n 0 -u ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.l.service 2023-03-17T08:11:26.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:24 smithi035 ceph-mon[92535]: pgmap v812: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:27.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:24 smithi078 ceph-mon[94114]: pgmap v812: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:27.409 INFO:journalctl@ceph.mds.i.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:11:27.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:26 smithi035 ceph-mon[92535]: pgmap v813: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:27.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:26 smithi078 ceph-mon[94114]: pgmap v813: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:26 smithi082 ceph-mon[94281]: pgmap v813: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:27.411 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-03-17T08:11:27.412 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:11:28.270 INFO:journalctl@ceph.mds.l.smithi082.stdout:-- Logs begin at Fri 2023-03-17 07:26:14 UTC. -- 2023-03-17T08:11:28.422 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 -- 172.21.15.35:0/398643931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 msgr2=0x7fe6381074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:29.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/398643931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe6381074e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b0a0 tx=0x7fe63000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 -- 172.21.15.35:0/398643931 shutdown_connections 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/398643931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe6381074e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/398643931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6380ff0a0 0x7fe6380ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/398643931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe638100290 0x7fe6381006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 -- 172.21.15.35:0/398643931 >> 172.21.15.35:0/398643931 conn(0x7fe6380fa680 msgr2=0x7fe6380fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 -- 172.21.15.35:0/398643931 shutdown_connections 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 -- 172.21.15.35:0/398643931 wait complete. 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.417+0000 7fe63ef7c700 1 Processor -- start 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 -- start start 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380ff0a0 0x7fe638195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe638100290 0x7fe638196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:29.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe63819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63819dab0 con 0x7fe638100c20 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63819dbf0 con 0x7fe6380ff0a0 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63ef7c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63819dd80 con 0x7fe638100290 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe63819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe63819d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39884/0 (socket says 172.21.15.35:39884) 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 -- 172.21.15.35:0/887209145 learned_addr learned my addr 172.21.15.35:0/887209145 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63cd18700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380ff0a0 0x7fe638195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe637fff700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe638100290 0x7fe638196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 -- 172.21.15.35:0/887209145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe638100290 msgr2=0x7fe638196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe638100290 0x7fe638196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 -- 172.21.15.35:0/887209145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380ff0a0 msgr2=0x7fe638195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:29.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380ff0a0 0x7fe638195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:29.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 -- 172.21.15.35:0/887209145 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009d00 con 0x7fe638100c20 2023-03-17T08:11:29.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.418+0000 7fe63d519700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe63819d4e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b070 tx=0x7fe630004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:11:29.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.419+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000e040 con 0x7fe638100c20 2023-03-17T08:11:29.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.419+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63810a920 con 0x7fe638100c20 2023-03-17T08:11:29.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.419+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe630003e90 con 0x7fe638100c20 2023-03-17T08:11:29.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.419+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630004020 con 0x7fe638100c20 2023-03-17T08:11:29.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:28 smithi078 ceph-mon[94114]: pgmap v814: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:29.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:29 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/887209145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:11:29.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:28 smithi082 ceph-mon[94281]: pgmap v814: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:29.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:29 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/887209145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:11:29.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.419+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63810a790 con 0x7fe638100c20 2023-03-17T08:11:29.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.420+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe638067970 con 0x7fe638100c20 2023-03-17T08:11:29.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.421+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fe63001b660 con 0x7fe638100c20 2023-03-17T08:11:29.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.421+0000 7fe635ffb700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe62809f4d0 0x7fe6280a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.422+0000 7fe63cd18700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe62809f4d0 0x7fe6280a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.422+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe6300cbb80 con 0x7fe638100c20 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.422+0000 7fe63cd18700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe62809f4d0 0x7fe6280a1980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005950 tx=0x7fe62c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.425+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fe6300961a0 con 0x7fe638100c20 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.627+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe63819e890 con 0x7fe638100c20 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.628+0000 7fe635ffb700 1 -- 172.21.15.35:0/887209145 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fe6300997c0 con 0x7fe638100c20 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:11:29.991 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":82,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:08:52.191126+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:11:30.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe62809f4d0 msgr2=0x7fe6280a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:31.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe62809f4d0 0x7fe6280a1980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe62c005950 tx=0x7fe62c0058e0 comp rx=0 tx=0).stop 2023-03-17T08:11:31.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 msgr2=0x7fe63819d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:31.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe63819d4e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b070 tx=0x7fe630004d30 comp rx=0 tx=0).stop 2023-03-17T08:11:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 shutdown_connections 2023-03-17T08:11:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe62809f4d0 0x7fe6280a1980 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe638100c20 0x7fe63819d4e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380ff0a0 0x7fe638195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 --2- 172.21.15.35:0/887209145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe638100290 0x7fe638196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:32.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 >> 172.21.15.35:0/887209145 conn(0x7fe6380fa680 msgr2=0x7fe638067d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:11:32.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 shutdown_connections 2023-03-17T08:11:33.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:28.630+0000 7fe63ef7c700 1 -- 172.21.15.35:0/887209145 wait complete. 2023-03-17T08:11:33.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:28 smithi035 ceph-mon[92535]: pgmap v814: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:33.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:30 smithi078 ceph-mon[94114]: pgmap v815: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:34.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:32 smithi078 ceph-mon[94114]: pgmap v816: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:34.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:30 smithi082 ceph-mon[94281]: pgmap v815: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:34.690 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:32 smithi082 ceph-mon[94281]: pgmap v816: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:34.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:11:36.729 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:11:36.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:29 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/887209145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:11:36.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:30 smithi035 ceph-mon[92535]: pgmap v815: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:32 smithi035 ceph-mon[92535]: pgmap v816: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:34 smithi035 ceph-mon[92535]: pgmap v817: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:36 smithi035 ceph-mon[92535]: pgmap v818: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:34 smithi078 ceph-mon[94114]: pgmap v817: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:36 smithi078 ceph-mon[94114]: pgmap v818: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.732 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:34 smithi082 ceph-mon[94281]: pgmap v817: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.732 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:36 smithi082 ceph-mon[94281]: pgmap v818: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:36.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 -- 172.21.15.35:0/2947671443 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4101650 msgr2=0x7f52b4101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2947671443 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4101650 0x7f52b4101aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f529c009990 tx=0x7f529c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 -- 172.21.15.35:0/2947671443 shutdown_connections 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2947671443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b4101fe0 0x7f52b41088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2947671443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4100460 0x7f52b4100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2947671443 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4101650 0x7f52b4101aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 -- 172.21.15.35:0/2947671443 >> 172.21.15.35:0/2947671443 conn(0x7f52b40fbaa0 msgr2=0x7f52b40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:11:38.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 -- 172.21.15.35:0/2947671443 shutdown_connections 2023-03-17T08:11:40.158 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.869+0000 7f52b89a8700 1 -- 172.21.15.35:0/2947671443 wait complete. 2023-03-17T08:11:40.159 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:37 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2365356551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:11:40.159 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:38 smithi078 ceph-mon[94114]: pgmap v819: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:40.159 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:39 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:11:40.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:37 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2365356551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:11:40.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:38 smithi082 ceph-mon[94281]: pgmap v819: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:40.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:39 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:11:40.161 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 Processor -- start 2023-03-17T08:11:42.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 -- start start 2023-03-17T08:11:42.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 0x7f52b4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:42.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4101650 0x7f52b41987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:42.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b4101fe0 0x7f52b419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:42.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b419fe10 con 0x7f52b4100460 2023-03-17T08:11:42.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b419ff50 con 0x7f52b4101650 2023-03-17T08:11:42.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.870+0000 7f52b89a8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b41a00e0 con 0x7f52b4101fe0 2023-03-17T08:11:42.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 0x7f52b4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 0x7f52b4198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39892/0 (socket says 172.21.15.35:39892) 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 -- 172.21.15.35:0/2365356551 learned_addr learned my addr 172.21.15.35:0/2365356551 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b2d9d700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b4101fe0 0x7f52b419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b1d9b700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4101650 0x7f52b41987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 -- 172.21.15.35:0/2365356551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b4101fe0 msgr2=0x7f52b419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b4101fe0 0x7f52b419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 -- 172.21.15.35:0/2365356551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4101650 msgr2=0x7f52b41987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4101650 0x7f52b41987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 -- 172.21.15.35:0/2365356551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c0095f0 con 0x7f52b4100460 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b1d9b700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4101650 0x7f52b41987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b259c700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 0x7f52b4198290 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c990 tx=0x7f52a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4007b00 con 0x7f52b4100460 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52a4007c60 con 0x7f52b4100460 2023-03-17T08:11:42.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b410bc80 con 0x7f52b4100460 2023-03-17T08:11:42.976 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4018660 con 0x7f52b4100460 2023-03-17T08:11:43.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.871+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b410baf0 con 0x7f52b4100460 2023-03-17T08:11:43.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.872+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b4192910 con 0x7f52b4100460 2023-03-17T08:11:43.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.874+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f52a4004020 con 0x7f52b4100460 2023-03-17T08:11:43.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.874+0000 7f52ab7fe700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f52a009f550 0x7f52a00a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:44.455 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.874+0000 7f52b1d9b700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f52a009f550 0x7f52a00a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.874+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f52a40c9eb0 con 0x7f52b4100460 2023-03-17T08:11:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.875+0000 7f52b1d9b700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f52a009f550 0x7f52a00a1a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f529c000c00 tx=0x7f529c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:11:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:36.878+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f52a4094550 con 0x7f52b4100460 2023-03-17T08:11:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.076+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52b4061790 con 0x7f52b4100460 2023-03-17T08:11:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.077+0000 7f52ab7fe700 1 -- 172.21.15.35:0/2365356551 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52a4097b70 con 0x7f52b4100460 2023-03-17T08:11:44.456 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:11:44.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f52a009f550 msgr2=0x7f52a00a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f52a009f550 0x7f52a00a1a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f529c000c00 tx=0x7f529c005fb0 comp rx=0 tx=0).stop 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 msgr2=0x7f52b4198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 0x7f52b4198290 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c990 tx=0x7f52a400cd50 comp rx=0 tx=0).stop 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 shutdown_connections 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b4101fe0 0x7f52b419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f52a009f550 0x7f52a00a1a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:45.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52b4100460 0x7f52b4198290 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:45.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 --2- 172.21.15.35:0/2365356551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b4101650 0x7f52b41987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:45.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 >> 172.21.15.35:0/2365356551 conn(0x7f52b40fbaa0 msgr2=0x7f52b4107000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:11:45.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 shutdown_connections 2023-03-17T08:11:45.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:37.079+0000 7f52b89a8700 1 -- 172.21.15.35:0/2365356551 wait complete. 2023-03-17T08:11:45.730 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:11:46.058 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:40 smithi078 ceph-mon[94114]: pgmap v820: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:46.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: pgmap v821: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:46.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:46.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:46.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:46.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:46.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:11:47.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:11:47.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:44 smithi078 ceph-mon[94114]: pgmap v822: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:40 smithi082 ceph-mon[94281]: pgmap v820: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: pgmap v821: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:47.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:44 smithi082 ceph-mon[94281]: pgmap v822: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:47.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:37 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2365356551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:11:47.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:38 smithi035 ceph-mon[92535]: pgmap v819: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:47.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:39 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:11:47.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:40 smithi035 ceph-mon[92535]: pgmap v820: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:48.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: pgmap v821: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:48.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:44 smithi035 ceph-mon[92535]: pgmap v822: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:48.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:46 smithi035 ceph-mon[92535]: pgmap v823: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:48.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:46 smithi078 ceph-mon[94114]: pgmap v823: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:49.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:46 smithi082 ceph-mon[94281]: pgmap v823: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:49.041 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:48 smithi078 ceph-mon[94114]: pgmap v824: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:50.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:48 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1204628229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:11:50.020 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:48 smithi082 ceph-mon[94281]: pgmap v824: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:11:50.619 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:48 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1204628229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:11:50.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 -- 172.21.15.35:0/1587688411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b8100290 msgr2=0x7fa1b81006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:50.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1587688411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b8100290 0x7fa1b81006e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009990 tx=0x7fa1a4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:11:50.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 -- 172.21.15.35:0/1587688411 shutdown_connections 2023-03-17T08:11:50.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1587688411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100c20 0x7fa1b81074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:50.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1587688411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:50.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1587688411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b8100290 0x7fa1b81006e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:50.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 -- 172.21.15.35:0/1587688411 >> 172.21.15.35:0/1587688411 conn(0x7fa1b80fa680 msgr2=0x7fa1b80fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:11:51.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 -- 172.21.15.35:0/1587688411 shutdown_connections 2023-03-17T08:11:51.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.050+0000 7fa1bf118700 1 -- 172.21.15.35:0/1587688411 wait complete. 2023-03-17T08:11:52.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 Processor -- start 2023-03-17T08:11:52.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 -- start start 2023-03-17T08:11:53.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:53.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100290 0x7fa1b819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:53.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1b8100c20 0x7fa1b819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:53.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b819d930 con 0x7fa1b80ff0a0 2023-03-17T08:11:54.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b819daa0 con 0x7fa1b8100290 2023-03-17T08:11:54.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bf118700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b819dc60 con 0x7fa1b8100c20 2023-03-17T08:11:54.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:54.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80688c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39904/0 (socket says 172.21.15.35:39904) 2023-03-17T08:11:54.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 -- 172.21.15.35:0/1204628229 learned_addr learned my addr 172.21.15.35:0/1204628229 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:11:55.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bd6b5700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1b8100c20 0x7fa1b819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:55.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1b7fff700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100290 0x7fa1b819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 -- 172.21.15.35:0/1204628229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1b8100c20 msgr2=0x7fa1b819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1b8100c20 0x7fa1b819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 -- 172.21.15.35:0/1204628229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100290 msgr2=0x7fa1b819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100290 0x7fa1b819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1bceb4700 1 -- 172.21.15.35:0/1204628229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a40095f0 con 0x7fa1b80ff0a0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.051+0000 7fa1b7fff700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100290 0x7fa1b819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.052+0000 7fa1bceb4700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80688c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00d980 tx=0x7fa1ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.052+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac004020 con 0x7fa1b80ff0a0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.052+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1ac009730 con 0x7fa1b80ff0a0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.052+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b810a8b0 con 0x7fa1b80ff0a0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.052+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac003a00 con 0x7fa1b80ff0a0 2023-03-17T08:11:55.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.052+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b810a720 con 0x7fa1b80ff0a0 2023-03-17T08:11:57.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.053+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b8105fd0 con 0x7fa1b80ff0a0 2023-03-17T08:11:57.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.054+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fa1ac0098a0 con 0x7fa1b80ff0a0 2023-03-17T08:11:57.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.054+0000 7fa1b5ffb700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa1a809f4d0 0x7fa1a80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:11:57.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.055+0000 7fa1b7fff700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa1a809f4d0 0x7fa1a80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:11:58.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.055+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa1ac0c9b60 con 0x7fa1b80ff0a0 2023-03-17T08:11:58.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.055+0000 7fa1b7fff700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa1a809f4d0 0x7fa1a80a1980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400c010 tx=0x7fa1a400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:11:58.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.059+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fa1ac094050 con 0x7fa1b80ff0a0 2023-03-17T08:11:58.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.308+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b802d010 con 0x7fa1b80ff0a0 2023-03-17T08:11:58.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.308+0000 7fa1b5ffb700 1 -- 172.21.15.35:0/1204628229 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9586 (secure 0 0 0) 0x7fa1ac097670 con 0x7fa1b80ff0a0 2023-03-17T08:11:58.989 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:11:58.989 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24415,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24451,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-03-17T08:11:58.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa1a809f4d0 msgr2=0x7fa1a80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:01.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa1a809f4d0 0x7fa1a80a1980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400c010 tx=0x7fa1a400b540 comp rx=0 tx=0).stop 2023-03-17T08:12:01.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 msgr2=0x7fa1b80688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:01.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80688c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00d980 tx=0x7fa1ac00dc90 comp rx=0 tx=0).stop 2023-03-17T08:12:01.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 shutdown_connections 2023-03-17T08:12:01.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1b8100c20 0x7fa1b819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:02.000 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa1a809f4d0 0x7fa1a80a1980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:02.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1b80ff0a0 0x7fa1b80688c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:02.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 --2- 172.21.15.35:0/1204628229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1b8100290 0x7fa1b819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:02.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 >> 172.21.15.35:0/1204628229 conn(0x7fa1b80fa680 msgr2=0x7fa1b80fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:02.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 shutdown_connections 2023-03-17T08:12:02.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:11:48.310+0000 7fa1bf118700 1 -- 172.21.15.35:0/1204628229 wait complete. 2023-03-17T08:12:04.847 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 13 2023-03-17T08:12:04.849 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:50 smithi082 ceph-mon[94281]: pgmap v825: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:52 smithi082 ceph-mon[94281]: pgmap v826: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:54 smithi082 ceph-mon[94281]: pgmap v827: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:56 smithi082 ceph-mon[94281]: pgmap v828: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:11:58 smithi082 ceph-mon[94281]: pgmap v829: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:00 smithi082 ceph-mon[94281]: pgmap v830: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:02 smithi082 ceph-mon[94281]: pgmap v831: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:04.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:50 smithi078 ceph-mon[94114]: pgmap v825: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:05.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:52 smithi078 ceph-mon[94114]: pgmap v826: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:05.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:54 smithi078 ceph-mon[94114]: pgmap v827: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:05.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:56 smithi078 ceph-mon[94114]: pgmap v828: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:11:58 smithi078 ceph-mon[94114]: pgmap v829: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:00 smithi078 ceph-mon[94114]: pgmap v830: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:02 smithi078 ceph-mon[94114]: pgmap v831: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:04 smithi078 ceph-mon[94114]: pgmap v832: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:04 smithi082 ceph-mon[94281]: pgmap v832: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:06 smithi082 ceph-mon[94281]: pgmap v833: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:06 smithi078 ceph-mon[94114]: pgmap v833: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:48 smithi035 ceph-mon[92535]: pgmap v824: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:48 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1204628229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:12:07.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:50 smithi035 ceph-mon[92535]: pgmap v825: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:52 smithi035 ceph-mon[92535]: pgmap v826: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:07.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:54 smithi035 ceph-mon[92535]: pgmap v827: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:56 smithi035 ceph-mon[92535]: pgmap v828: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:11:58 smithi035 ceph-mon[92535]: pgmap v829: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:00 smithi035 ceph-mon[92535]: pgmap v830: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:02 smithi035 ceph-mon[92535]: pgmap v831: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:04 smithi035 ceph-mon[92535]: pgmap v832: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.035 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:06 smithi035 ceph-mon[92535]: pgmap v833: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:09.037 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:08 smithi078 ceph-mon[94114]: pgmap v834: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:11.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:08 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1485081559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:12:11.552 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:08 smithi082 ceph-mon[94281]: pgmap v834: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:11.552 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:08 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1485081559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:12:11.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:10 smithi078 ceph-mon[94114]: pgmap v835: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:11.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:10 smithi082 ceph-mon[94281]: pgmap v835: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:11.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.534+0000 7ff18d862700 1 -- 172.21.15.35:0/3474412314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1880ff0e0 msgr2=0x7ff1880ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.534+0000 7ff18d862700 1 --2- 172.21.15.35:0/3474412314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1880ff0e0 0x7ff1880ff4f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff178009990 tx=0x7ff178009ca0 comp rx=0 tx=0).stop 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 -- 172.21.15.35:0/3474412314 shutdown_connections 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 --2- 172.21.15.35:0/3474412314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff188100c60 0x7ff188107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 --2- 172.21.15.35:0/3474412314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1880ff0e0 0x7ff1880ff4f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 --2- 172.21.15.35:0/3474412314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1881002d0 0x7ff188100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 -- 172.21.15.35:0/3474412314 >> 172.21.15.35:0/3474412314 conn(0x7ff1880fa6e0 msgr2=0x7ff1880fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 -- 172.21.15.35:0/3474412314 shutdown_connections 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 -- 172.21.15.35:0/3474412314 wait complete. 2023-03-17T08:12:14.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 Processor -- start 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.535+0000 7ff18d862700 1 -- start start 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ff0e0 0x7ff188069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 0x7ff18819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff188100c60 0x7ff18819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18819d910 con 0x7ff1881002d0 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18819da80 con 0x7ff188100c60 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18819dc40 con 0x7ff1880ff0e0 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 0x7ff18819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 0x7ff18819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39920/0 (socket says 172.21.15.35:39920) 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 -- 172.21.15.35:0/1485081559 learned_addr learned my addr 172.21.15.35:0/1485081559 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff186ffd700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ff0e0 0x7ff188069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1877fe700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff188100c60 0x7ff18819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 -- 172.21.15.35:0/1485081559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ff0e0 msgr2=0x7ff188069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:14.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ff0e0 0x7ff188069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:14.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 -- 172.21.15.35:0/1485081559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff188100c60 msgr2=0x7ff18819d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:14.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff188100c60 0x7ff18819d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:15.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 -- 172.21.15.35:0/1485081559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780095f0 con 0x7ff1881002d0 2023-03-17T08:12:15.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff1867fc700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 0x7ff18819aae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c9b0 tx=0x7ff17c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:15.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007b00 con 0x7ff1881002d0 2023-03-17T08:12:16.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18810a8f0 con 0x7ff1881002d0 2023-03-17T08:12:16.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.536+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff17c007c60 con 0x7ff1881002d0 2023-03-17T08:12:16.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.537+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c018660 con 0x7ff1881002d0 2023-03-17T08:12:16.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.537+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18810a760 con 0x7ff1881002d0 2023-03-17T08:12:16.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.537+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff188106060 con 0x7ff1881002d0 2023-03-17T08:12:16.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.539+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff17c00f450 con 0x7ff1881002d0 2023-03-17T08:12:16.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.539+0000 7ff18c860700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff17009f4d0 0x7ff1700a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:16.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.539+0000 7ff186ffd700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff17009f4d0 0x7ff1700a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:17.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.539+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff17c0ca050 con 0x7ff1881002d0 2023-03-17T08:12:17.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.540+0000 7ff186ffd700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff17009f4d0 0x7ff1700a1980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b5c0 tx=0x7ff178005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:17.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.543+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff17c094670 con 0x7ff1881002d0 2023-03-17T08:12:17.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.744+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff18802d010 con 0x7ff1881002d0 2023-03-17T08:12:17.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.745+0000 7ff18c860700 1 -- 172.21.15.35:0/1485081559 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18304 (secure 0 0 0) 0x7ff17c00fe60 con 0x7ff1881002d0 2023-03-17T08:12:17.144 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:12:17.144 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":82,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:08:52.191126+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:12:17.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff17009f4d0 msgr2=0x7ff1700a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff17009f4d0 0x7ff1700a1980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b5c0 tx=0x7ff178005960 comp rx=0 tx=0).stop 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 msgr2=0x7ff18819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 0x7ff18819aae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c9b0 tx=0x7ff17c00ccc0 comp rx=0 tx=0).stop 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 shutdown_connections 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff188100c60 0x7ff18819d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ff0e0 0x7ff188069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff17009f4d0 0x7ff1700a1980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 --2- 172.21.15.35:0/1485081559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1881002d0 0x7ff18819aae0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 >> 172.21.15.35:0/1485081559 conn(0x7ff1880fa6e0 msgr2=0x7ff1880fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 shutdown_connections 2023-03-17T08:12:19.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:07.748+0000 7ff18d862700 1 -- 172.21.15.35:0/1485081559 wait complete. 2023-03-17T08:12:19.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:12:19.992 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:12:19.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:12 smithi078 ceph-mon[94114]: pgmap v836: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:19.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:14 smithi078 ceph-mon[94114]: pgmap v837: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:19.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:16 smithi078 ceph-mon[94114]: pgmap v838: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:19.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:18 smithi078 ceph-mon[94114]: pgmap v839: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:19.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:12 smithi082 ceph-mon[94281]: pgmap v836: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:19.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:14 smithi082 ceph-mon[94281]: pgmap v837: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:19.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:16 smithi082 ceph-mon[94281]: pgmap v838: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:20.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:18 smithi082 ceph-mon[94281]: pgmap v839: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:20.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:08 smithi035 ceph-mon[92535]: pgmap v834: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:20.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:08 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1485081559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:12:20.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:10 smithi035 ceph-mon[92535]: pgmap v835: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:20.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:12 smithi035 ceph-mon[92535]: pgmap v836: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:20.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:14 smithi035 ceph-mon[92535]: pgmap v837: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:20.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:16 smithi035 ceph-mon[92535]: pgmap v838: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:21.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:18 smithi035 ceph-mon[92535]: pgmap v839: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:21.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:20 smithi035 ceph-mon[92535]: pgmap v840: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:21.880 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:20 smithi082 ceph-mon[94281]: pgmap v840: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:22.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:20 smithi078 ceph-mon[94114]: pgmap v840: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:22.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:21 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/4290068646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:12:22.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:22 smithi078 ceph-mon[94114]: pgmap v841: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:22.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:21 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/4290068646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:12:22.882 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:22 smithi082 ceph-mon[94281]: pgmap v841: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:22.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 -- 172.21.15.35:0/2476026770 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5598100d50 msgr2=0x7f55981075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:24.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 --2- 172.21.15.35:0/2476026770 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5598100d50 0x7f55981075f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f559000b0a0 tx=0x7f559000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:12:24.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 -- 172.21.15.35:0/2476026770 shutdown_connections 2023-03-17T08:12:24.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 --2- 172.21.15.35:0/2476026770 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5598100d50 0x7f55981075f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:24.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 --2- 172.21.15.35:0/2476026770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55980ff110 0x7f55980ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:24.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 --2- 172.21.15.35:0/2476026770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55981003a0 0x7f5598100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:25.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 -- 172.21.15.35:0/2476026770 >> 172.21.15.35:0/2476026770 conn(0x7f55980fa730 msgr2=0x7f55980fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:25.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 -- 172.21.15.35:0/2476026770 shutdown_connections 2023-03-17T08:12:25.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.986+0000 7f559dd0e700 1 -- 172.21.15.35:0/2476026770 wait complete. 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 Processor -- start 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 -- start start 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 0x7f55980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55981003a0 0x7f559819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5598100d50 0x7f559819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559819da30 con 0x7f55980ff110 2023-03-17T08:12:25.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559819dba0 con 0x7f55981003a0 2023-03-17T08:12:26.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f559dd0e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559819dd60 con 0x7f5598100d50 2023-03-17T08:12:26.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f55977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 0x7f55980688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:26.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f55977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 0x7f55980688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39932/0 (socket says 172.21.15.35:39932) 2023-03-17T08:12:26.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f55977fe700 1 -- 172.21.15.35:0/4290068646 learned_addr learned my addr 172.21.15.35:0/4290068646 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:12:26.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.987+0000 7f5597fff700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5598100d50 0x7f559819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:28.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f5596ffd700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55981003a0 0x7f559819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:28.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f55977fe700 1 -- 172.21.15.35:0/4290068646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5598100d50 msgr2=0x7f559819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:28.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f55977fe700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5598100d50 0x7f559819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:28.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f55977fe700 1 -- 172.21.15.35:0/4290068646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55981003a0 msgr2=0x7f559819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:28.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f55977fe700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55981003a0 0x7f559819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:28.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f55977fe700 1 -- 172.21.15.35:0/4290068646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590009d00 con 0x7f55980ff110 2023-03-17T08:12:30.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f5597fff700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5598100d50 0x7f559819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:12:30.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f5596ffd700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55981003a0 0x7f559819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:12:30.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f55977fe700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 0x7f55980688e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f558800c9b0 tx=0x7f558800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:30.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588007b00 con 0x7f55980ff110 2023-03-17T08:12:30.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5588007c60 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559810a960 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588018660 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.988+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559810a7d0 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.989+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559819e3f0 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.990+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f558800f450 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.991+0000 7f5594ff9700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f558409f4d0 0x7f55840a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.991+0000 7f5596ffd700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f558409f4d0 0x7f55840a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.991+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f55880c9f50 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.991+0000 7f5596ffd700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f558409f4d0 0x7f55840a1980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5580005fd0 tx=0x7f5580005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:20.995+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f5588094440 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.192+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f559819df20 con 0x7f55980ff110 2023-03-17T08:12:30.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.193+0000 7f5594ff9700 1 -- 172.21.15.35:0/4290068646 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5588097a60 con 0x7f55980ff110 2023-03-17T08:12:30.277 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:12:30.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:24 smithi078 ceph-mon[94114]: pgmap v842: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:30.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:25 smithi078 ceph-mon[94114]: pgmap v843: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:27 smithi078 ceph-mon[94114]: pgmap v844: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.374 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:24 smithi082 ceph-mon[94281]: pgmap v842: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.374 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:25 smithi082 ceph-mon[94281]: pgmap v843: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.374 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:27 smithi082 ceph-mon[94281]: pgmap v844: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f558409f4d0 msgr2=0x7f55840a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:32.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f558409f4d0 0x7f55840a1980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5580005fd0 tx=0x7f5580005ee0 comp rx=0 tx=0).stop 2023-03-17T08:12:32.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 msgr2=0x7f55980688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 0x7f55980688e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f558800c9b0 tx=0x7f558800cd70 comp rx=0 tx=0).stop 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 shutdown_connections 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5598100d50 0x7f559819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f558409f4d0 0x7f55840a1980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55980ff110 0x7f55980688e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 --2- 172.21.15.35:0/4290068646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55981003a0 0x7f559819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 >> 172.21.15.35:0/4290068646 conn(0x7f55980fa730 msgr2=0x7f55980fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 shutdown_connections 2023-03-17T08:12:32.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:21.195+0000 7f559dd0e700 1 -- 172.21.15.35:0/4290068646 wait complete. 2023-03-17T08:12:32.376 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-17T08:12:32.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:21 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4290068646' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:12:32.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:22 smithi035 ceph-mon[92535]: pgmap v841: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:24 smithi035 ceph-mon[92535]: pgmap v842: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:25 smithi035 ceph-mon[92535]: pgmap v843: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:27 smithi035 ceph-mon[92535]: pgmap v844: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:30 smithi035 ceph-mon[92535]: pgmap v845: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:32.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:30 smithi078 ceph-mon[94114]: pgmap v845: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:34.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:30 smithi082 ceph-mon[94281]: pgmap v845: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:34.132 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:32 smithi078 ceph-mon[94114]: pgmap v846: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:34.132 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:33 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3813041895' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-03-17T08:12:34.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:32 smithi082 ceph-mon[94281]: pgmap v846: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:34.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:33 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3813041895' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-03-17T08:12:34.135 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/2181059880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac1013b0 msgr2=0x7fa8ac101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:35.435 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/2181059880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac1013b0 0x7fa8ac101800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009990 tx=0x7fa89c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/2181059880 shutdown_connections 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/2181059880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8ac101d40 0x7fa8ac108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/2181059880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8ac1001c0 0x7fa8ac1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/2181059880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac1013b0 0x7fa8ac101800 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/2181059880 >> 172.21.15.35:0/2181059880 conn(0x7fa8ac0fb7a0 msgr2=0x7fa8ac0fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/2181059880 shutdown_connections 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.513+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/2181059880 wait complete. 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 Processor -- start 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 -- start start 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8ac1001c0 0x7fa8ac195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8ac1013b0 0x7fa8ac196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 0x7fa8ac19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac19daa0 con 0x7fa8ac101d40 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac19dbe0 con 0x7fa8ac1013b0 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8b0dd4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac19dd70 con 0x7fa8ac1001c0 2023-03-17T08:12:35.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 0x7fa8ac19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 0x7fa8ac19d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39950/0 (socket says 172.21.15.35:39950) 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 -- 172.21.15.35:0/3813041895 learned_addr learned my addr 172.21.15.35:0/3813041895 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8a9d9b700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8ac1013b0 0x7fa8ac196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aa59c700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8ac1001c0 0x7fa8ac195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 -- 172.21.15.35:0/3813041895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8ac1001c0 msgr2=0x7fa8ac195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8ac1001c0 0x7fa8ac195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 -- 172.21.15.35:0/3813041895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8ac1013b0 msgr2=0x7fa8ac196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:35.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8ac1013b0 0x7fa8ac196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 -- 172.21.15.35:0/3813041895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0095f0 con 0x7fa8ac101d40 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.514+0000 7fa8aad9d700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 0x7fa8ac19d4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4007ee0 tx=0x7fa8a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.515+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4017070 con 0x7fa8ac101d40 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.515+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8a400f040 con 0x7fa8ac101d40 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.515+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4005570 con 0x7fa8ac101d40 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.515+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac10ba20 con 0x7fa8ac101d40 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.515+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac10b890 con 0x7fa8ac101d40 2023-03-17T08:12:36.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.516+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac107880 con 0x7fa8ac101d40 2023-03-17T08:12:36.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.517+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fa8a400db20 con 0x7fa8ac101d40 2023-03-17T08:12:36.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.518+0000 7fa89b7fe700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa89409f4d0 0x7fa8940a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:37.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.518+0000 7fa8aa59c700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa89409f4d0 0x7fa8940a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:37.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.518+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa8a40c9b10 con 0x7fa8ac101d40 2023-03-17T08:12:37.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.518+0000 7fa8aa59c700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa89409f4d0 0x7fa8940a1980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac101210 tx=0x7fa8a0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:37.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.521+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fa8a40940a0 con 0x7fa8ac101d40 2023-03-17T08:12:37.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:32 smithi035 ceph-mon[92535]: pgmap v846: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:37.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.725+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa8ac061690 con 0x7fa8ac101d40 2023-03-17T08:12:37.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.725+0000 7fa89b7fe700 1 -- 172.21.15.35:0/3813041895 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa8a40976c0 con 0x7fa8ac101d40 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout:[ 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout: { 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout: "poolnum": 1, 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout: "poolname": ".mgr" 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T08:12:37.319 INFO:teuthology.orchestra.run.smithi035.stdout:] 2023-03-17T08:12:39.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:34 smithi078 ceph-mon[94114]: pgmap v847: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:39.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:36 smithi078 ceph-mon[94114]: pgmap v848: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:39.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:38 smithi078 ceph-mon[94114]: pgmap v849: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:39.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:34 smithi082 ceph-mon[94281]: pgmap v847: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:39.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:36 smithi082 ceph-mon[94281]: pgmap v848: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:39.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:38 smithi082 ceph-mon[94281]: pgmap v849: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa89409f4d0 msgr2=0x7fa8940a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa89409f4d0 0x7fa8940a1980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac101210 tx=0x7fa8a0007400 comp rx=0 tx=0).stop 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 msgr2=0x7fa8ac19d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 0x7fa8ac19d4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4007ee0 tx=0x7fa8a400d3b0 comp rx=0 tx=0).stop 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 shutdown_connections 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa89409f4d0 0x7fa8940a1980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8ac101d40 0x7fa8ac19d4d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8ac1001c0 0x7fa8ac195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 --2- 172.21.15.35:0/3813041895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8ac1013b0 0x7fa8ac196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.727+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 >> 172.21.15.35:0/3813041895 conn(0x7fa8ac0fb7a0 msgr2=0x7fa8ac1049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.728+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 shutdown_connections 2023-03-17T08:12:39.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:32.728+0000 7fa8b0dd4700 1 -- 172.21.15.35:0/3813041895 wait complete. 2023-03-17T08:12:39.008 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-17T08:12:39.008 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-17T08:12:39.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:33 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3813041895' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-03-17T08:12:40.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:34 smithi035 ceph-mon[92535]: pgmap v847: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:41.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:36 smithi035 ceph-mon[92535]: pgmap v848: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:41.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:38 smithi035 ceph-mon[92535]: pgmap v849: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:41.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:40 smithi035 ceph-mon[92535]: pgmap v850: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:42.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:40 smithi078 ceph-mon[94114]: pgmap v850: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:42.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:40 smithi082 ceph-mon[94281]: pgmap v850: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:42.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:42 smithi078 ceph-mon[94114]: pgmap v851: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:42.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 -- 172.21.15.35:0/2011959221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100310 msgr2=0x7fc790100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:45.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 --2- 172.21.15.35:0/2011959221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100310 0x7fc790100760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc784009990 tx=0x7fc784009ca0 comp rx=0 tx=0).stop 2023-03-17T08:12:45.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 -- 172.21.15.35:0/2011959221 shutdown_connections 2023-03-17T08:12:45.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 --2- 172.21.15.35:0/2011959221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc790100ca0 0x7fc790107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:45.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 --2- 172.21.15.35:0/2011959221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7900ff120 0x7fc7900ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:45.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 --2- 172.21.15.35:0/2011959221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100310 0x7fc790100760 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:45.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 -- 172.21.15.35:0/2011959221 >> 172.21.15.35:0/2011959221 conn(0x7fc7900fa740 msgr2=0x7fc7900fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:45.598 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 -- 172.21.15.35:0/2011959221 shutdown_connections 2023-03-17T08:12:45.598 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 -- 172.21.15.35:0/2011959221 wait complete. 2023-03-17T08:12:45.598 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 Processor -- start 2023-03-17T08:12:45.598 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.005+0000 7fc7952c2700 1 -- start start 2023-03-17T08:12:45.598 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7900ff120 0x7fc790195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:45.598 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc790100310 0x7fc790196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 0x7fc79019d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79019d970 con 0x7fc790100ca0 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79019dab0 con 0x7fc7900ff120 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79019dc40 con 0x7fc790100310 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 0x7fc79019d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 0x7fc79019d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39964/0 (socket says 172.21.15.35:39964) 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 -- 172.21.15.35:0/1345452545 learned_addr learned my addr 172.21.15.35:0/1345452545 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78effd700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7900ff120 0x7fc790195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78e7fc700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc790100310 0x7fc790196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 -- 172.21.15.35:0/1345452545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc790100310 msgr2=0x7fc790196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc790100310 0x7fc790196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 -- 172.21.15.35:0/1345452545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7900ff120 msgr2=0x7fc790195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7900ff120 0x7fc790195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:45.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 -- 172.21.15.35:0/1345452545 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840095f0 con 0x7fc790100ca0 2023-03-17T08:12:45.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc78f7fe700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 0x7fc79019d3a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc788007d70 tx=0x7fc78800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:45.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800ad40 con 0x7fc790100ca0 2023-03-17T08:12:45.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79010a930 con 0x7fc790100ca0 2023-03-17T08:12:45.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7880128b0 con 0x7fc790100ca0 2023-03-17T08:12:45.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.006+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880115a0 con 0x7fc790100ca0 2023-03-17T08:12:45.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.007+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79010a7a0 con 0x7fc790100ca0 2023-03-17T08:12:47.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.007+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc790067e30 con 0x7fc790100ca0 2023-03-17T08:12:48.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.009+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fc788012a20 con 0x7fc790100ca0 2023-03-17T08:12:48.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.009+0000 7fc777fff700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc77809f4d0 0x7fc7780a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:12:48.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.009+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc7880ca420 con 0x7fc790100ca0 2023-03-17T08:12:48.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.009+0000 7fc78effd700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc77809f4d0 0x7fc7780a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:12:48.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.010+0000 7fc78effd700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc77809f4d0 0x7fc7780a1980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc790100170 tx=0x7fc78000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.013+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fc7880949b0 con 0x7fc790100ca0 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.216+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc79019e730 con 0x7fc790100ca0 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.708+0000 7fc777fff700 1 -- 172.21.15.35:0/1345452545 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc788016020 con 0x7fc790100ca0 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc77809f4d0 msgr2=0x7fc7780a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc77809f4d0 0x7fc7780a1980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc790100170 tx=0x7fc78000b410 comp rx=0 tx=0).stop 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 msgr2=0x7fc79019d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 0x7fc79019d3a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc788007d70 tx=0x7fc78800a340 comp rx=0 tx=0).stop 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 shutdown_connections 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fc77809f4d0 0x7fc7780a1980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:50.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc790100ca0 0x7fc79019d3a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:50.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7900ff120 0x7fc790195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:50.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 --2- 172.21.15.35:0/1345452545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc790100310 0x7fc790196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:12:50.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 >> 172.21.15.35:0/1345452545 conn(0x7fc7900fa740 msgr2=0x7fc790069050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:12:50.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 shutdown_connections 2023-03-17T08:12:50.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:42.712+0000 7fc7952c2700 1 -- 172.21.15.35:0/1345452545 wait complete. 2023-03-17T08:12:50.496 INFO:teuthology.orchestra.run.smithi035.stderr:pool 'cephfs_metadata' created 2023-03-17T08:12:50.498 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:42 smithi035 ceph-mon[92535]: pgmap v851: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:43 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1345452545' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:43 smithi035 ceph-mon[92535]: pgmap v852: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:43 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1345452545' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:43 smithi035 ceph-mon[92535]: osdmap e83: 12 total, 12 up, 12 in 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:44 smithi035 ceph-mon[92535]: osdmap e84: 12 total, 12 up, 12 in 2023-03-17T08:12:52.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: pgmap v855: 33 pgs: 1 creating+activating, 4 creating+peering, 6 unknown, 22 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: osdmap e85: 12 total, 12 up, 12 in 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:45 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:46 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:46 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:12:52.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:46 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:54.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:48 smithi035 ceph-mon[92535]: pgmap v857: 33 pgs: 1 creating+activating, 4 creating+peering, 28 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:54.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:50 smithi035 ceph-mon[92535]: pgmap v858: 33 pgs: 1 creating+activating, 32 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:54.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:43 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1345452545' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-17T08:12:56.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:43 smithi078 ceph-mon[94114]: pgmap v852: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:56.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:43 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1345452545' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-03-17T08:12:56.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:43 smithi078 ceph-mon[94114]: osdmap e83: 12 total, 12 up, 12 in 2023-03-17T08:12:56.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:12:56.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:44 smithi078 ceph-mon[94114]: osdmap e84: 12 total, 12 up, 12 in 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: pgmap v855: 33 pgs: 1 creating+activating, 4 creating+peering, 6 unknown, 22 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: osdmap e85: 12 total, 12 up, 12 in 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:45 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:46 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:46 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:46 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:48 smithi078 ceph-mon[94114]: pgmap v857: 33 pgs: 1 creating+activating, 4 creating+peering, 28 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:50 smithi078 ceph-mon[94114]: pgmap v858: 33 pgs: 1 creating+activating, 32 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:52 smithi078 ceph-mon[94114]: pgmap v859: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:42 smithi082 ceph-mon[94281]: pgmap v851: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:43 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1345452545' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:43 smithi082 ceph-mon[94281]: pgmap v852: 1 pgs: 1 active+clean; 577 KiB data, 75 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:43 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1345452545' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:43 smithi082 ceph-mon[94281]: osdmap e83: 12 total, 12 up, 12 in 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:44 smithi082 ceph-mon[94281]: osdmap e84: 12 total, 12 up, 12 in 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: pgmap v855: 33 pgs: 1 creating+activating, 4 creating+peering, 6 unknown, 22 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: osdmap e85: 12 total, 12 up, 12 in 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:45 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:46 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:12:57.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:46 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:12:57.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:46 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:12:57.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:48 smithi082 ceph-mon[94281]: pgmap v857: 33 pgs: 1 creating+activating, 4 creating+peering, 28 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:12:57.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:50 smithi082 ceph-mon[94281]: pgmap v858: 33 pgs: 1 creating+activating, 32 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:00.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:52 smithi082 ceph-mon[94281]: pgmap v859: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:00.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:52 smithi035 ceph-mon[92535]: pgmap v859: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:54 smithi082 ceph-mon[94281]: pgmap v860: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:55 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/904190785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-03-17T08:13:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:56 smithi082 ceph-mon[94281]: pgmap v861: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:56 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/904190785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-03-17T08:13:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:56 smithi082 ceph-mon[94281]: osdmap e86: 12 total, 12 up, 12 in 2023-03-17T08:13:00.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:57 smithi082 ceph-mon[94281]: osdmap e87: 12 total, 12 up, 12 in 2023-03-17T08:13:02.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:58 smithi082 ceph-mon[94281]: pgmap v864: 97 pgs: 2 creating+peering, 62 unknown, 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:02.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:12:58 smithi082 ceph-mon[94281]: osdmap e88: 12 total, 12 up, 12 in 2023-03-17T08:13:02.275 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:54 smithi078 ceph-mon[94114]: pgmap v860: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:04.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:55 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/904190785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-03-17T08:13:04.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:56 smithi078 ceph-mon[94114]: pgmap v861: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:04.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:56 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/904190785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-03-17T08:13:06.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:56 smithi078 ceph-mon[94114]: osdmap e86: 12 total, 12 up, 12 in 2023-03-17T08:13:06.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:57 smithi078 ceph-mon[94114]: osdmap e87: 12 total, 12 up, 12 in 2023-03-17T08:13:06.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:58 smithi078 ceph-mon[94114]: pgmap v864: 97 pgs: 2 creating+peering, 62 unknown, 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:12:58 smithi078 ceph-mon[94114]: osdmap e88: 12 total, 12 up, 12 in 2023-03-17T08:13:06.064 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:00 smithi082 ceph-mon[94281]: pgmap v866: 97 pgs: 2 creating+peering, 41 unknown, 54 active+clean; 577 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.064 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:02 smithi082 ceph-mon[94281]: pgmap v867: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.064 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:04 smithi082 ceph-mon[94281]: pgmap v868: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:00 smithi078 ceph-mon[94114]: pgmap v866: 97 pgs: 2 creating+peering, 41 unknown, 54 active+clean; 577 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:02 smithi078 ceph-mon[94114]: pgmap v867: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:04 smithi078 ceph-mon[94114]: pgmap v868: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:06.066 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/2146161008 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 msgr2=0x7f2b580fecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:06.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/2146161008 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b580fecb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009990 tx=0x7f2b54009ca0 comp rx=0 tx=0).stop 2023-03-17T08:13:06.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/2146161008 shutdown_connections 2023-03-17T08:13:06.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/2146161008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 0x7f2b58106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:06.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/2146161008 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b580fecb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:09.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/2146161008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b580ffb30 0x7f2b580fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:09.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/2146161008 >> 172.21.15.35:0/2146161008 conn(0x7f2b580f9ea0 msgr2=0x7f2b580fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:13:09.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/2146161008 shutdown_connections 2023-03-17T08:13:09.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.161+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/2146161008 wait complete. 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 Processor -- start 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 -- start start 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b581028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b580ffb30 0x7f2b58100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 0x7f2b58101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58101bf0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58101d60 con 0x7f2b580ffb30 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5fe9f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5819ff40 con 0x7f2b581004e0 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b581028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b581028d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39972/0 (socket says 172.21.15.35:39972) 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 -- 172.21.15.35:0/904190785 learned_addr learned my addr 172.21.15.35:0/904190785 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5d43a700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b580ffb30 0x7f2b58100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5e43c700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 0x7f2b58101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 -- 172.21.15.35:0/904190785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 msgr2=0x7f2b58101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:09.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 0x7f2b58101450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 -- 172.21.15.35:0/904190785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b580ffb30 msgr2=0x7f2b58100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b580ffb30 0x7f2b58100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 -- 172.21.15.35:0/904190785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540095f0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5e43c700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 0x7f2b58101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b5dc3b700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b581028d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005910 tx=0x7f2b54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.162+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5401d070 con 0x7f2b580fe8a0 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.163+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5810a9c0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.163+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b540054c0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.163+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54003ab0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.163+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5810a830 con 0x7f2b580fe8a0 2023-03-17T08:13:09.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.164+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b581a04e0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.165+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f2b540047a0 con 0x7f2b580fe8a0 2023-03-17T08:13:09.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.165+0000 7f2b4effd700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b4409f4d0 0x7f2b440a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:09.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.166+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f2b540cb390 con 0x7f2b580fe8a0 2023-03-17T08:13:09.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.166+0000 7f2b5d43a700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b4409f4d0 0x7f2b440a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:13:09.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.166+0000 7f2b5d43a700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b4409f4d0 0x7f2b440a1980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b48005950 tx=0x7f2b4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:13:09.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.169+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f2b540957a0 con 0x7f2b580fe8a0 2023-03-17T08:13:11.910 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:54.370+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2b581a0a90 con 0x7f2b580fe8a0 2023-03-17T08:13:11.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:54 smithi035 ceph-mon[92535]: pgmap v860: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:11.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.286+0000 7f2b4effd700 1 -- 172.21.15.35:0/904190785 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2b54098dc0 con 0x7f2b580fe8a0 2023-03-17T08:13:14.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.292+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b4409f4d0 msgr2=0x7f2b440a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:17.345 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.292+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b4409f4d0 0x7f2b440a1980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b48005950 tx=0x7f2b4800b410 comp rx=0 tx=0).stop 2023-03-17T08:13:17.345 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.292+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 msgr2=0x7f2b581028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:17.345 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.292+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b581028d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005910 tx=0x7f2b54004730 comp rx=0 tx=0).stop 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 shutdown_connections 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b581004e0 0x7f2b58101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b4409f4d0 0x7f2b440a1980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b580fe8a0 0x7f2b581028d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 --2- 172.21.15.35:0/904190785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b580ffb30 0x7f2b58100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 >> 172.21.15.35:0/904190785 conn(0x7f2b580f9ea0 msgr2=0x7f2b580fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:13:19.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 shutdown_connections 2023-03-17T08:13:20.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:12:55.295+0000 7f2b5fe9f700 1 -- 172.21.15.35:0/904190785 wait complete. 2023-03-17T08:13:20.886 INFO:teuthology.orchestra.run.smithi035.stderr:pool 'cephfs_data' created 2023-03-17T08:13:20.887 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-17T08:13:23.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:55 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/904190785' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-03-17T08:13:26.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:56 smithi035 ceph-mon[92535]: pgmap v861: 33 pgs: 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:26.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:56 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/904190785' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-03-17T08:13:26.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:56 smithi035 ceph-mon[92535]: osdmap e86: 12 total, 12 up, 12 in 2023-03-17T08:13:26.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:57 smithi035 ceph-mon[92535]: osdmap e87: 12 total, 12 up, 12 in 2023-03-17T08:13:26.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:58 smithi035 ceph-mon[92535]: pgmap v864: 97 pgs: 2 creating+peering, 62 unknown, 33 active+clean; 577 KiB data, 76 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:26.562 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:12:58 smithi035 ceph-mon[92535]: osdmap e88: 12 total, 12 up, 12 in 2023-03-17T08:13:26.562 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:00 smithi035 ceph-mon[92535]: pgmap v866: 97 pgs: 2 creating+peering, 41 unknown, 54 active+clean; 577 KiB data, 77 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:28.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:02 smithi035 ceph-mon[92535]: pgmap v867: 97 pgs: 2 creating+peering, 95 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:28.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:04 smithi035 ceph-mon[92535]: pgmap v868: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:28.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:06 smithi035 ceph-mon[92535]: pgmap v869: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:29.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:08 smithi035 ceph-mon[92535]: pgmap v870: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:29.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:10 smithi035 ceph-mon[92535]: pgmap v871: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:29.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:12 smithi035 ceph-mon[92535]: pgmap v872: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:29.941 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:14 smithi035 ceph-mon[92535]: pgmap v873: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:16 smithi035 ceph-mon[92535]: pgmap v874: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:18 smithi035 ceph-mon[92535]: pgmap v875: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:20 smithi035 ceph-mon[92535]: pgmap v876: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:22 smithi035 ceph-mon[92535]: pgmap v877: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:06 smithi082 ceph-mon[94281]: pgmap v869: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:08 smithi082 ceph-mon[94281]: pgmap v870: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:10 smithi082 ceph-mon[94281]: pgmap v871: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:12 smithi082 ceph-mon[94281]: pgmap v872: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:14 smithi082 ceph-mon[94281]: pgmap v873: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:16 smithi082 ceph-mon[94281]: pgmap v874: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:18 smithi082 ceph-mon[94281]: pgmap v875: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:20 smithi082 ceph-mon[94281]: pgmap v876: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:22 smithi082 ceph-mon[94281]: pgmap v877: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:24 smithi082 ceph-mon[94281]: pgmap v878: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:26 smithi082 ceph-mon[94281]: pgmap v879: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:28 smithi082 ceph-mon[94281]: pgmap v880: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:30 smithi082 ceph-mon[94281]: pgmap v881: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:06 smithi078 ceph-mon[94114]: pgmap v869: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:08 smithi078 ceph-mon[94114]: pgmap v870: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:10 smithi078 ceph-mon[94114]: pgmap v871: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:12 smithi078 ceph-mon[94114]: pgmap v872: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:14 smithi078 ceph-mon[94114]: pgmap v873: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:16 smithi078 ceph-mon[94114]: pgmap v874: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:31.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:18 smithi078 ceph-mon[94114]: pgmap v875: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:33.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:20 smithi078 ceph-mon[94114]: pgmap v876: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:33.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:22 smithi078 ceph-mon[94114]: pgmap v877: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:33.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:24 smithi078 ceph-mon[94114]: pgmap v878: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:26 smithi078 ceph-mon[94114]: pgmap v879: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:28 smithi078 ceph-mon[94114]: pgmap v880: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:30 smithi078 ceph-mon[94114]: pgmap v881: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:24 smithi035 ceph-mon[92535]: pgmap v878: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:26 smithi035 ceph-mon[92535]: pgmap v879: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:28 smithi035 ceph-mon[92535]: pgmap v880: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:30 smithi035 ceph-mon[92535]: pgmap v881: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:34.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: pgmap v882: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:36.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3322543717' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-03-17T08:13:36.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-03-17T08:13:36.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: osdmap e89: 12 total, 12 up, 12 in 2023-03-17T08:13:36.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3322543717' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-03-17T08:13:36.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:32 smithi078 ceph-mon[94114]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:33 smithi078 ceph-mon[94114]: pgmap v884: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:33 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] up:active 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:33 smithi078 ceph-mon[94114]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:33 smithi078 ceph-mon[94114]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: pgmap v882: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3322543717' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: osdmap e89: 12 total, 12 up, 12 in 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3322543717' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:32 smithi082 ceph-mon[94281]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-03-17T08:13:36.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:33 smithi082 ceph-mon[94281]: pgmap v884: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:36.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:33 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] up:active 2023-03-17T08:13:36.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:33 smithi082 ceph-mon[94281]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:13:36.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:33 smithi082 ceph-mon[94281]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:13:36.504 INFO:journalctl@ceph.mds.b.smithi078.stdout:Mar 17 08:13:34 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-b[120685]: 2023-03-17T08:13:34.082+0000 7f52fd0a5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-17T08:13:38.753 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:36 smithi078 ceph-mon[94114]: pgmap v885: 97 pgs: 97 active+clean; 578 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2023-03-17T08:13:40.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:38 smithi078 ceph-mon[94114]: pgmap v886: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:40.455 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:36 smithi082 ceph-mon[94281]: pgmap v885: 97 pgs: 97 active+clean; 578 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2023-03-17T08:13:40.455 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:38 smithi082 ceph-mon[94281]: pgmap v886: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:40.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.734+0000 7f7869db5700 1 -- 172.21.15.35:0/11556888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 msgr2=0x7f7864102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:40.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.734+0000 7f7869db5700 1 --2- 172.21.15.35:0/11556888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864102da0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7858009990 tx=0x7f7858009ca0 comp rx=0 tx=0).stop 2023-03-17T08:13:40.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.734+0000 7f7869db5700 1 -- 172.21.15.35:0/11556888 shutdown_connections 2023-03-17T08:13:40.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.734+0000 7f7869db5700 1 --2- 172.21.15.35:0/11556888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7864105df0 0x7f78641082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:40.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.734+0000 7f7869db5700 1 --2- 172.21.15.35:0/11556888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864102da0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:40.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.735+0000 7f7869db5700 1 --2- 172.21.15.35:0/11556888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78641032e0 0x7f7864105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:41.390 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.735+0000 7f7869db5700 1 -- 172.21.15.35:0/11556888 >> 172.21.15.35:0/11556888 conn(0x7f78640fa730 msgr2=0x7f78640fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:13:41.390 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.735+0000 7f7869db5700 1 -- 172.21.15.35:0/11556888 shutdown_connections 2023-03-17T08:13:41.390 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.735+0000 7f7869db5700 1 -- 172.21.15.35:0/11556888 wait complete. 2023-03-17T08:13:41.390 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.735+0000 7f7869db5700 1 Processor -- start 2023-03-17T08:13:41.390 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 -- start start 2023-03-17T08:13:41.390 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:42.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78641032e0 0x7f78641963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:42.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7864105df0 0x7f786419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:42.015 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786419da20 con 0x7f7864068a90 2023-03-17T08:13:42.015 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786419db60 con 0x7f7864105df0 2023-03-17T08:13:42.015 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f7869db5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786419dcf0 con 0x7f78641032e0 2023-03-17T08:13:42.015 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:13:42.015 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:39994/0 (socket says 172.21.15.35:39994) 2023-03-17T08:13:42.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 -- 172.21.15.35:0/3322543717 learned_addr learned my addr 172.21.15.35:0/3322543717 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:13:42.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 -- 172.21.15.35:0/3322543717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78641032e0 msgr2=0x7f78641963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:42.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78641032e0 0x7f78641963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:42.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 -- 172.21.15.35:0/3322543717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7864105df0 msgr2=0x7f786419d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:42.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7864105df0 0x7f786419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:42.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 -- 172.21.15.35:0/3322543717 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580095f0 con 0x7f7864068a90 2023-03-17T08:13:43.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.736+0000 7f78637fe700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864195ea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78580059d0 tx=0x7f7858004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:13:43.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.737+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785801d070 con 0x7f7864068a90 2023-03-17T08:13:43.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.737+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786410ba20 con 0x7f7864068a90 2023-03-17T08:13:43.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.737+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78580041e0 con 0x7f7864068a90 2023-03-17T08:13:44.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.737+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800f460 con 0x7f7864068a90 2023-03-17T08:13:45.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.737+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786410b890 con 0x7f7864068a90 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.738+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786419e210 con 0x7f7864068a90 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.739+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f7858022470 con 0x7f7864068a90 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.739+0000 7f7860ff9700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f784c09f4d0 0x7f784c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.739+0000 7f7862ffd700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f784c09f4d0 0x7f784c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.740+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f78580cb900 con 0x7f7864068a90 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.740+0000 7f7862ffd700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f784c09f4d0 0x7f784c0a1980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7854005950 tx=0x7f78540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:13:46.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.743+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f7858095c30 con 0x7f7864068a90 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.986+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f786419e7c0 con 0x7f7864068a90 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.991+0000 7f7860ff9700 1 -- 172.21.15.35:0/3322543717 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f78580310c0 con 0x7f7864068a90 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f784c09f4d0 msgr2=0x7f784c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f784c09f4d0 0x7f784c0a1980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7854005950 tx=0x7f78540058e0 comp rx=0 tx=0).stop 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 msgr2=0x7f7864195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864195ea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78580059d0 tx=0x7f7858004000 comp rx=0 tx=0).stop 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 shutdown_connections 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7864105df0 0x7f786419d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:46.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f784c09f4d0 0x7f784c0a1980 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:46.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7864068a90 0x7f7864195ea0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:46.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 --2- 172.21.15.35:0/3322543717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78641032e0 0x7f78641963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:13:48.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 >> 172.21.15.35:0/3322543717 conn(0x7f78640fa730 msgr2=0x7f7864101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:13:48.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 shutdown_connections 2023-03-17T08:13:48.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:13:31.993+0000 7f7869db5700 1 -- 172.21.15.35:0/3322543717 wait complete. 2023-03-17T08:13:48.312 INFO:teuthology.orchestra.run.smithi035.stderr:new fs with metadata pool 2 and data pool 3 2023-03-17T08:13:48.313 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:13:48.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:40 smithi078 ceph-mon[94114]: pgmap v887: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:50.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: pgmap v888: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:50.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-03-17T08:13:50.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-03-17T08:13:50.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-03-17T08:13:50.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-03-17T08:13:50.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2023-03-17T08:13:50.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:42 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-03-17T08:13:50.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-03-17T08:13:51.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:43 smithi078 ceph-mon[94114]: osdmap e90: 12 total, 12 up, 12 in 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:44 smithi078 ceph-mon[94114]: pgmap v890: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:44 smithi078 ceph-mon[94114]: osdmap e91: 12 total, 12 up, 12 in 2023-03-17T08:13:52.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:46 smithi078 ceph-mon[94114]: pgmap v892: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 195 B/s, 0 objects/s recovering 2023-03-17T08:13:55.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:46 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:47 smithi078 ceph-mon[94114]: pgmap v893: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 195 B/s, 0 objects/s recovering 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:47 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:47 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:47 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:47 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:47 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:40 smithi082 ceph-mon[94281]: pgmap v887: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: pgmap v888: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:42 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-03-17T08:13:55.355 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:43 smithi082 ceph-mon[94281]: osdmap e90: 12 total, 12 up, 12 in 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:44 smithi082 ceph-mon[94281]: pgmap v890: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:44 smithi082 ceph-mon[94281]: osdmap e91: 12 total, 12 up, 12 in 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:46 smithi082 ceph-mon[94281]: pgmap v892: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 195 B/s, 0 objects/s recovering 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:46 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:47 smithi082 ceph-mon[94281]: pgmap v893: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 195 B/s, 0 objects/s recovering 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:47 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:47 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:13:55.356 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:47 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:13:57.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:47 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:47 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: pgmap v882: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3322543717' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: osdmap e89: 12 total, 12 up, 12 in 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3322543717' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-03-17T08:13:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-03-17T08:13:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:32 smithi035 ceph-mon[92535]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-03-17T08:13:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:33 smithi035 ceph-mon[92535]: pgmap v884: 97 pgs: 97 active+clean; 577 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:13:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:33 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] up:active 2023-03-17T08:13:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:33 smithi035 ceph-mon[92535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:13:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:33 smithi035 ceph-mon[92535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:13:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:36 smithi035 ceph-mon[92535]: pgmap v885: 97 pgs: 97 active+clean; 578 KiB data, 78 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 3 op/s 2023-03-17T08:13:58.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:38 smithi035 ceph-mon[92535]: pgmap v886: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:58.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:40 smithi035 ceph-mon[92535]: pgmap v887: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:58.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: pgmap v888: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:13:58.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:42 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-03-17T08:14:00.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:43 smithi035 ceph-mon[92535]: osdmap e90: 12 total, 12 up, 12 in 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:44 smithi035 ceph-mon[92535]: pgmap v890: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:44 smithi035 ceph-mon[92535]: osdmap e91: 12 total, 12 up, 12 in 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:46 smithi035 ceph-mon[92535]: pgmap v892: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 195 B/s, 0 objects/s recovering 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:46 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:47 smithi035 ceph-mon[92535]: pgmap v893: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 195 B/s, 0 objects/s recovering 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:14:02.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:14:02.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:47 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:02.519 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:50 smithi035 ceph-mon[92535]: pgmap v894: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 202 B/s, 1 keys/s, 0 objects/s recovering 2023-03-17T08:14:04.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:52 smithi035 ceph-mon[92535]: pgmap v895: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 196 B/s, 1 keys/s, 0 objects/s recovering 2023-03-17T08:14:04.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:54 smithi035 ceph-mon[92535]: pgmap v896: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 161 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:04.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:56 smithi035 ceph-mon[92535]: pgmap v897: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 144 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:04.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:13:58 smithi035 ceph-mon[92535]: pgmap v898: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:04.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:00 smithi035 ceph-mon[92535]: pgmap v899: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:05.051 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:50 smithi078 ceph-mon[94114]: pgmap v894: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 202 B/s, 1 keys/s, 0 objects/s recovering 2023-03-17T08:14:07.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:52 smithi078 ceph-mon[94114]: pgmap v895: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 196 B/s, 1 keys/s, 0 objects/s recovering 2023-03-17T08:14:07.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:54 smithi078 ceph-mon[94114]: pgmap v896: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 161 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:07.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:56 smithi078 ceph-mon[94114]: pgmap v897: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 144 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:13:58 smithi078 ceph-mon[94114]: pgmap v898: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:00 smithi078 ceph-mon[94114]: pgmap v899: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:50 smithi082 ceph-mon[94281]: pgmap v894: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 202 B/s, 1 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:52 smithi082 ceph-mon[94281]: pgmap v895: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 196 B/s, 1 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:54 smithi082 ceph-mon[94281]: pgmap v896: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 161 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:56 smithi082 ceph-mon[94281]: pgmap v897: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 144 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:13:58 smithi082 ceph-mon[94281]: pgmap v898: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:00 smithi082 ceph-mon[94281]: pgmap v899: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 0 keys/s, 0 objects/s recovering 2023-03-17T08:14:08.287 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:02 smithi078 ceph-mon[94114]: pgmap v900: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:03 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2361711127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:04 smithi078 ceph-mon[94114]: pgmap v901: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:06 smithi078 ceph-mon[94114]: pgmap v902: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:02 smithi082 ceph-mon[94281]: pgmap v900: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:03 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2361711127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:04 smithi082 ceph-mon[94281]: pgmap v901: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:06 smithi082 ceph-mon[94281]: pgmap v902: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.901 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:08 smithi078 ceph-mon[94114]: pgmap v903: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.901 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:10 smithi078 ceph-mon[94114]: pgmap v904: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:08 smithi082 ceph-mon[94281]: pgmap v903: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:10 smithi082 ceph-mon[94281]: pgmap v904: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:10.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.654+0000 7fab7269b700 1 -- 172.21.15.35:0/992832864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 msgr2=0x7fab6c100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:12.713 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.654+0000 7fab7269b700 1 --2- 172.21.15.35:0/992832864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c100700 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab60009990 tx=0x7fab60009ca0 comp rx=0 tx=0).stop 2023-03-17T08:14:12.713 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 -- 172.21.15.35:0/992832864 shutdown_connections 2023-03-17T08:14:12.713 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 --2- 172.21.15.35:0/992832864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab6c100c40 0x7fab6c107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:12.713 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 --2- 172.21.15.35:0/992832864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab6c0ff0c0 0x7fab6c0ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 --2- 172.21.15.35:0/992832864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c100700 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 -- 172.21.15.35:0/992832864 >> 172.21.15.35:0/992832864 conn(0x7fab6c0fa6a0 msgr2=0x7fab6c0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 -- 172.21.15.35:0/992832864 shutdown_connections 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 -- 172.21.15.35:0/992832864 wait complete. 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 Processor -- start 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.655+0000 7fab7269b700 1 -- start start 2023-03-17T08:14:12.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab6c0ff0c0 0x7fab6c103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:12.715 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:12.715 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab6c100c40 0x7fab6c101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:12.715 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c102370 con 0x7fab6c1002b0 2023-03-17T08:14:12.715 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1024e0 con 0x7fab6c100c40 2023-03-17T08:14:12.715 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c19ff10 con 0x7fab6c0ff0c0 2023-03-17T08:14:15.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c101690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40010/0 (socket says 172.21.15.35:40010) 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 -- 172.21.15.35:0/2361711127 learned_addr learned my addr 172.21.15.35:0/2361711127 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6bfff700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab6c0ff0c0 0x7fab6c103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab70c38700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab6c100c40 0x7fab6c101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 -- 172.21.15.35:0/2361711127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab6c0ff0c0 msgr2=0x7fab6c103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab6c0ff0c0 0x7fab6c103050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 -- 172.21.15.35:0/2361711127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab6c100c40 msgr2=0x7fab6c101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab6c100c40 0x7fab6c101bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 -- 172.21.15.35:0/2361711127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600095f0 con 0x7fab6c1002b0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab6b7fe700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c101690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab60003a50 tx=0x7fab60009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6001d070 con 0x7fab6c1002b0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab60005a00 con 0x7fab6c1002b0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c10a8e0 con 0x7fab6c1002b0 2023-03-17T08:14:15.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60005020 con 0x7fab6c1002b0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.656+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c10a750 con 0x7fab6c1002b0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.657+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c1a0540 con 0x7fab6c1002b0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.658+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fab600051a0 con 0x7fab6c1002b0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.659+0000 7fab697fa700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fab5409f4d0 0x7fab540a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.659+0000 7fab6bfff700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fab5409f4d0 0x7fab540a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.659+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fab600cb810 con 0x7fab6c1002b0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.660+0000 7fab6bfff700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fab5409f4d0 0x7fab540a1980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab6c100110 tx=0x7fab5c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:15.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.663+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fab60095990 con 0x7fab6c1002b0 2023-03-17T08:14:15.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:02 smithi035 ceph-mon[92535]: pgmap v900: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:19.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.865+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab6c1a0be0 con 0x7fab6c1002b0 2023-03-17T08:14:22.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.867+0000 7fab697fa700 1 -- 172.21.15.35:0/2361711127 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7fab60030090 con 0x7fab6c1002b0 2023-03-17T08:14:22.154 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:14:22.155 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:14:22.852 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:12 smithi078 ceph-mon[94114]: pgmap v905: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:14 smithi078 ceph-mon[94114]: pgmap v906: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:16 smithi078 ceph-mon[94114]: pgmap v907: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:18 smithi078 ceph-mon[94114]: pgmap v908: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:20 smithi078 ceph-mon[94114]: pgmap v909: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:22 smithi078 ceph-mon[94114]: pgmap v910: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:12 smithi082 ceph-mon[94281]: pgmap v905: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:14 smithi082 ceph-mon[94281]: pgmap v906: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:16 smithi082 ceph-mon[94281]: pgmap v907: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:18 smithi082 ceph-mon[94281]: pgmap v908: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:20 smithi082 ceph-mon[94281]: pgmap v909: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:22 smithi082 ceph-mon[94281]: pgmap v910: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fab5409f4d0 msgr2=0x7fab540a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fab5409f4d0 0x7fab540a1980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab6c100110 tx=0x7fab5c00a380 comp rx=0 tx=0).stop 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 msgr2=0x7fab6c101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c101690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab60003a50 tx=0x7fab60009580 comp rx=0 tx=0).stop 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 shutdown_connections 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab6c100c40 0x7fab6c101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab6c0ff0c0 0x7fab6c103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fab5409f4d0 0x7fab540a1980 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 --2- 172.21.15.35:0/2361711127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fab6c1002b0 0x7fab6c101690 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 >> 172.21.15.35:0/2361711127 conn(0x7fab6c0fa6a0 msgr2=0x7fab6c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 shutdown_connections 2023-03-17T08:14:22.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:02.869+0000 7fab7269b700 1 -- 172.21.15.35:0/2361711127 wait complete. 2023-03-17T08:14:22.856 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:14:24.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:24 smithi078 ceph-mon[94114]: pgmap v911: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:24.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:24 smithi082 ceph-mon[94281]: pgmap v911: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:24.794 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:03 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2361711127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:14:26.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:04 smithi035 ceph-mon[92535]: pgmap v901: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:06 smithi035 ceph-mon[92535]: pgmap v902: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:08 smithi035 ceph-mon[92535]: pgmap v903: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:10 smithi035 ceph-mon[92535]: pgmap v904: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:12 smithi035 ceph-mon[92535]: pgmap v905: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:14 smithi035 ceph-mon[92535]: pgmap v906: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:16 smithi035 ceph-mon[92535]: pgmap v907: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:18 smithi035 ceph-mon[92535]: pgmap v908: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:20 smithi035 ceph-mon[92535]: pgmap v909: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:22 smithi035 ceph-mon[92535]: pgmap v910: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:24 smithi035 ceph-mon[92535]: pgmap v911: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:26 smithi035 ceph-mon[92535]: pgmap v912: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:26 smithi078 ceph-mon[94114]: pgmap v912: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:26 smithi082 ceph-mon[94281]: pgmap v912: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:26.851 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.848+0000 7f1c32ea3700 1 -- 172.21.15.35:0/3332677604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c0ff0a0 msgr2=0x7f1c2c0ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:28.617 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.848+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/3332677604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c0ff0a0 0x7f1c2c0ff4b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009990 tx=0x7f1c20009ca0 comp rx=0 tx=0).stop 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- 172.21.15.35:0/3332677604 shutdown_connections 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/3332677604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c100c20 0x7f1c2c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/3332677604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c0ff0a0 0x7f1c2c0ff4b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/3332677604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100290 0x7f1c2c1006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- 172.21.15.35:0/3332677604 >> 172.21.15.35:0/3332677604 conn(0x7f1c2c0fa680 msgr2=0x7f1c2c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- 172.21.15.35:0/3332677604 shutdown_connections 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- 172.21.15.35:0/3332677604 wait complete. 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 Processor -- start 2023-03-17T08:14:28.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- start start 2023-03-17T08:14:28.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:27 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2161118842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:14:28.619 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:27 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2161118842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:14:28.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c0ff0a0 0x7f1c2c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 0x7f1c2c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100c20 0x7f1c2c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c19d9f0 con 0x7f1c2c100290 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c19db30 con 0x7f1c2c100c20 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c32ea3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c19dcc0 con 0x7f1c2c0ff0a0 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.849+0000 7f1c2bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 0x7f1c2c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 0x7f1c2c1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40024/0 (socket says 172.21.15.35:40024) 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 -- 172.21.15.35:0/2161118842 learned_addr learned my addr 172.21.15.35:0/2161118842 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c30c3f700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c0ff0a0 0x7f1c2c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:29.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c31440700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100c20 0x7f1c2c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 -- 172.21.15.35:0/2161118842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c0ff0a0 msgr2=0x7f1c2c195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c0ff0a0 0x7f1c2c195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 -- 172.21.15.35:0/2161118842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100c20 msgr2=0x7f1c2c19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100c20 0x7f1c2c19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 -- 172.21.15.35:0/2161118842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200095f0 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c31440700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100c20 0x7f1c2c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c2bfff700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 0x7f1c2c1963b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800d950 tx=0x7f1c1800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18009940 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c18010460 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c10a8b0 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800f620 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.850+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c10a720 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.851+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c067970 con 0x7f1c2c100290 2023-03-17T08:14:29.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.852+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1c180105d0 con 0x7f1c2c100290 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.853+0000 7f1c29ffb700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c1c09f4d0 0x7f1c1c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.853+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1c180c9fd0 con 0x7f1c2c100290 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.853+0000 7f1c30c3f700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c1c09f4d0 0x7f1c1c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.854+0000 7f1c30c3f700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c1c09f4d0 0x7f1c1c0a1980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c20006010 tx=0x7f1c2000b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:26.857+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1c18094160 con 0x7f1c2c100290 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.058+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c2c19e910 con 0x7f1c2c100290 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.060+0000 7f1c29ffb700 1 -- 172.21.15.35:0/2161118842 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f1c18020090 con 0x7f1c2c100290 2023-03-17T08:14:29.513 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:14:33.126 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:14:33.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c1c09f4d0 msgr2=0x7f1c1c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:33.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c1c09f4d0 0x7f1c1c0a1980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c20006010 tx=0x7f1c2000b2a0 comp rx=0 tx=0).stop 2023-03-17T08:14:33.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 msgr2=0x7f1c2c1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:33.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 0x7f1c2c1963b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800d950 tx=0x7f1c1800dc60 comp rx=0 tx=0).stop 2023-03-17T08:14:33.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 shutdown_connections 2023-03-17T08:14:33.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c2c100c20 0x7f1c2c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c0ff0a0 0x7f1c2c195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c1c09f4d0 0x7f1c1c0a1980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 --2- 172.21.15.35:0/2161118842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c2c100290 0x7f1c2c1963b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 >> 172.21.15.35:0/2161118842 conn(0x7f1c2c0fa680 msgr2=0x7f1c2c067d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 shutdown_connections 2023-03-17T08:14:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:27.062+0000 7f1c32ea3700 1 -- 172.21.15.35:0/2161118842 wait complete. 2023-03-17T08:14:33.129 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-17T08:14:33.129 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:27 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2161118842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:14:36.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:28 smithi035 ceph-mon[92535]: pgmap v913: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:30 smithi035 ceph-mon[92535]: pgmap v914: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:32 smithi035 ceph-mon[92535]: pgmap v915: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.570 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:34 smithi035 ceph-mon[92535]: pgmap v916: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:28 smithi078 ceph-mon[94114]: pgmap v913: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:30 smithi078 ceph-mon[94114]: pgmap v914: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.571 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:32 smithi078 ceph-mon[94114]: pgmap v915: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.571 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:34 smithi078 ceph-mon[94114]: pgmap v916: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:28 smithi082 ceph-mon[94281]: pgmap v913: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:30 smithi082 ceph-mon[94281]: pgmap v914: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:32 smithi082 ceph-mon[94281]: pgmap v915: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:34 smithi082 ceph-mon[94281]: pgmap v916: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:36.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:36 smithi082 ceph-mon[94281]: pgmap v917: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:39.428 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:36 smithi035 ceph-mon[92535]: pgmap v917: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:39.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:37 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/880088503' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-03-17T08:14:39.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:38 smithi082 ceph-mon[94281]: pgmap v918: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:40.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:38 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/880088503' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-03-17T08:14:40.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:38 smithi082 ceph-mon[94281]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:14:40.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:36 smithi078 ceph-mon[94114]: pgmap v917: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:40.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:37 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/880088503' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-03-17T08:14:40.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:38 smithi078 ceph-mon[94114]: pgmap v918: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:40.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:38 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/880088503' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-03-17T08:14:40.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:38 smithi078 ceph-mon[94114]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:14:41.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:40 smithi078 ceph-mon[94114]: pgmap v919: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:41.619 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:40 smithi082 ceph-mon[94281]: pgmap v919: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:41.622 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 -- 172.21.15.35:0/2229998300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c0fe910 msgr2=0x7f984c0fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:42.938 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 --2- 172.21.15.35:0/2229998300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c0fe910 0x7f984c0fed60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f984400b0a0 tx=0x7f984400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:14:42.938 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 -- 172.21.15.35:0/2229998300 shutdown_connections 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 --2- 172.21.15.35:0/2229998300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c0fe910 0x7f984c0fed60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 --2- 172.21.15.35:0/2229998300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f984c101880 0x7f984c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 --2- 172.21.15.35:0/2229998300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984c1021d0 0x7f984c0fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 -- 172.21.15.35:0/2229998300 >> 172.21.15.35:0/2229998300 conn(0x7f984c0f9ea0 msgr2=0x7f984c0fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 -- 172.21.15.35:0/2229998300 shutdown_connections 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.707+0000 7f9853075700 1 -- 172.21.15.35:0/2229998300 wait complete. 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 Processor -- start 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 -- start start 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f984c0fe910 0x7f984c100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:43.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 0x7f984c0ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984c1021d0 0x7f984c0ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c1002a0 con 0x7f984c101880 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c100410 con 0x7f984c1021d0 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9853075700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c19ffc0 con 0x7f984c0fe910 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 0x7f984c0ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 0x7f984c0ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40038/0 (socket says 172.21.15.35:40038) 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 -- 172.21.15.35:0/880088503 learned_addr learned my addr 172.21.15.35:0/880088503 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9850e11700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f984c0fe910 0x7f984c100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f9851612700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984c1021d0 0x7f984c0ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 -- 172.21.15.35:0/880088503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f984c0fe910 msgr2=0x7f984c100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f984c0fe910 0x7f984c100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 -- 172.21.15.35:0/880088503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984c1021d0 msgr2=0x7f984c0ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984c1021d0 0x7f984c0ffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:43.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 -- 172.21.15.35:0/880088503 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844009d00 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.708+0000 7f984bfff700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 0x7f984c0ff5c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f983800d950 tx=0x7f983800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.709+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800f890 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.709+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f983800fe80 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.709+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800e3b0 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.709+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c10bac0 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.709+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c10b930 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.710+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c106ff0 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.711+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f9838010460 con 0x7f984c101880 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.711+0000 7f9849ffb700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f983c09f550 0x7f983c0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:43.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.712+0000 7f9850e11700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f983c09f550 0x7f983c0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.712+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f98380c9fe0 con 0x7f984c101880 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.712+0000 7f9850e11700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f983c09f550 0x7f983c0a1a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9840005950 tx=0x7f984000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.716+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f98380940f0 con 0x7f984c101880 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:36.965+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f984c061890 con 0x7f984c101880 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.371+0000 7f9849ffb700 1 -- 172.21.15.35:0/880088503 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9838020020 con 0x7f984c101880 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f983c09f550 msgr2=0x7f983c0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f983c09f550 0x7f983c0a1a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9840005950 tx=0x7f984000b410 comp rx=0 tx=0).stop 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 msgr2=0x7f984c0ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 0x7f984c0ff5c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f983800d950 tx=0x7f983800dc60 comp rx=0 tx=0).stop 2023-03-17T08:14:43.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 shutdown_connections 2023-03-17T08:14:43.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984c1021d0 0x7f984c0ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:44.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f984c0fe910 0x7f984c100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:44.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f983c09f550 0x7f983c0a1a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:44.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 --2- 172.21.15.35:0/880088503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f984c101880 0x7f984c0ff5c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:44.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 >> 172.21.15.35:0/880088503 conn(0x7f984c0f9ea0 msgr2=0x7f984c0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:44.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 shutdown_connections 2023-03-17T08:14:44.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:37.374+0000 7f9853075700 1 -- 172.21.15.35:0/880088503 wait complete. 2023-03-17T08:14:44.551 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-03-17T08:14:44.552 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-03-17T08:14:44.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:37 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/880088503' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-03-17T08:14:44.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:38 smithi035 ceph-mon[92535]: pgmap v918: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:44.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:38 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/880088503' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-03-17T08:14:44.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:38 smithi035 ceph-mon[92535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:14:44.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:40 smithi035 ceph-mon[92535]: pgmap v919: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:44.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:42 smithi035 ceph-mon[92535]: pgmap v920: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:44.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:42 smithi082 ceph-mon[94281]: pgmap v920: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:46.318 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:42 smithi078 ceph-mon[94114]: pgmap v920: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:46.319 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:44 smithi082 ceph-mon[94281]: pgmap v921: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:51.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:45 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2768159841' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-03-17T08:14:51.722 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:44 smithi078 ceph-mon[94114]: pgmap v921: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:51.722 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:45 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2768159841' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-03-17T08:14:51.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: pgmap v922: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2768159841' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:46 smithi078 ceph-mon[94114]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-03-17T08:14:53.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:47 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] up:active 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:47 smithi078 ceph-mon[94114]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:47 smithi078 ceph-mon[94114]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:47 smithi078 ceph-mon[94114]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:47 smithi078 ceph-mon[94114]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: pgmap v923: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] up:active 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-03-17T08:14:53.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-03-17T08:14:54.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-03-17T08:14:54.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:14:54.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:54.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:48 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:54.607 INFO:journalctl@ceph.mds.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-b[120685]: 2023-03-17T08:14:49.088+0000 7f52fd0a5700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: pgmap v922: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2768159841' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:46 smithi082 ceph-mon[94281]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:47 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] up:active 2023-03-17T08:14:54.608 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:47 smithi082 ceph-mon[94281]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:47 smithi082 ceph-mon[94281]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:47 smithi082 ceph-mon[94281]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:47 smithi082 ceph-mon[94281]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: pgmap v923: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] up:active 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:48 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] up:active 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: Cluster is now healthy 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-03-17T08:14:54.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:50 smithi082 ceph-mon[94281]: pgmap v924: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:50 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] up:active 2023-03-17T08:14:54.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:50 smithi082 ceph-mon[94281]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-17T08:14:55.944 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:52 smithi082 ceph-mon[94281]: pgmap v925: 97 pgs: 97 active+clean; 583 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-03-17T08:14:55.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 -- 172.21.15.35:0/11486060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd01003a0 msgr2=0x7efcd0100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:57.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 --2- 172.21.15.35:0/11486060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd01003a0 0x7efcd0100810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009990 tx=0x7efcbc009ca0 comp rx=0 tx=0).stop 2023-03-17T08:14:57.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 -- 172.21.15.35:0/11486060 shutdown_connections 2023-03-17T08:14:57.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 --2- 172.21.15.35:0/11486060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 0x7efcd01075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:57.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 --2- 172.21.15.35:0/11486060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd00ff110 0x7efcd00ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:57.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 --2- 172.21.15.35:0/11486060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd01003a0 0x7efcd0100810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:57.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 -- 172.21.15.35:0/11486060 >> 172.21.15.35:0/11486060 conn(0x7efcd00fa730 msgr2=0x7efcd00fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 -- 172.21.15.35:0/11486060 shutdown_connections 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.691+0000 7efcd7014700 1 -- 172.21.15.35:0/11486060 wait complete. 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 Processor -- start 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 -- start start 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 0x7efcd0194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd01003a0 0x7efcd0195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 0x7efcd019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd019c900 con 0x7efcd00ff110 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd019ca70 con 0x7efcd01003a0 2023-03-17T08:14:57.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd7014700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd019cc30 con 0x7efcd0100d50 2023-03-17T08:14:57.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd4db0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 0x7efcd0194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:57.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd4db0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 0x7efcd0194dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40050/0 (socket says 172.21.15.35:40050) 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.692+0000 7efcd4db0700 1 -- 172.21.15.35:0/2768159841 learned_addr learned my addr 172.21.15.35:0/2768159841 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efccffff700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd01003a0 0x7efcd0195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd55b1700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 0x7efcd019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd4db0700 1 -- 172.21.15.35:0/2768159841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 msgr2=0x7efcd019c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd4db0700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 0x7efcd019c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd4db0700 1 -- 172.21.15.35:0/2768159841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd01003a0 msgr2=0x7efcd0195300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd4db0700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd01003a0 0x7efcd0195300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:14:58.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd4db0700 1 -- 172.21.15.35:0/2768159841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0095f0 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd55b1700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 0x7efcd019c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd4db0700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 0x7efcd0194dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcc400d950 tx=0x7efcc400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4009940 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd010a960 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcc4010460 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400f620 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.693+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd010a7d0 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.694+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd019d230 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.695+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7efcc40105d0 con 0x7efcd00ff110 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.696+0000 7efccdffb700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efcc009f4d0 0x7efcc00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:14:58.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.696+0000 7efccffff700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efcc009f4d0 0x7efcc00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:14:58.655 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] up:active 2023-03-17T08:14:58.655 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-03-17T08:15:00.243 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-03-17T08:15:00.243 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: Cluster is now healthy 2023-03-17T08:15:00.243 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-03-17T08:15:00.243 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-03-17T08:15:00.243 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:50 smithi078 ceph-mon[94114]: pgmap v924: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:50 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] up:active 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:50 smithi078 ceph-mon[94114]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:52 smithi078 ceph-mon[94114]: pgmap v925: 97 pgs: 97 active+clean; 583 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-03-17T08:15:00.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:54 smithi078 ceph-mon[94114]: pgmap v926: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s wr, 12 op/s 2023-03-17T08:15:00.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:44 smithi035 ceph-mon[92535]: pgmap v921: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:15:02.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:54 smithi082 ceph-mon[94281]: pgmap v926: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s wr, 12 op/s 2023-03-17T08:15:02.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:56 smithi082 ceph-mon[94281]: pgmap v927: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2023-03-17T08:15:02.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:14:58 smithi082 ceph-mon[94281]: pgmap v928: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2023-03-17T08:15:02.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:00 smithi082 ceph-mon[94281]: pgmap v929: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 12 op/s 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.696+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7efcc40ca0c0 con 0x7efcd00ff110 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.697+0000 7efccffff700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efcc009f4d0 0x7efcc00a1980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcbc006010 tx=0x7efcbc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.700+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7efcc40941b0 con 0x7efcd00ff110 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:44.949+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7efcd0106220 con 0x7efcd00ff110 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.390+0000 7efccdffb700 1 -- 172.21.15.35:0/2768159841 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7efcc40200b0 con 0x7efcd00ff110 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.392+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efcc009f4d0 msgr2=0x7efcc00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.392+0000 7efcd7014700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efcc009f4d0 0x7efcc00a1980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcbc006010 tx=0x7efcbc005960 comp rx=0 tx=0).stop 2023-03-17T08:15:02.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.392+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 msgr2=0x7efcd0194dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.392+0000 7efcd7014700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 0x7efcd0194dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcc400d950 tx=0x7efcc400dc60 comp rx=0 tx=0).stop 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.392+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 shutdown_connections 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcd0100d50 0x7efcd019c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efcc009f4d0 0x7efcc00a1980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcd00ff110 0x7efcd0194dc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 --2- 172.21.15.35:0/2768159841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd01003a0 0x7efcd0195300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 >> 172.21.15.35:0/2768159841 conn(0x7efcd00fa730 msgr2=0x7efcd00fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 shutdown_connections 2023-03-17T08:15:02.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:14:45.393+0000 7efcd7014700 1 -- 172.21.15.35:0/2768159841 wait complete. 2023-03-17T08:15:02.851 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-03-17T08:15:02.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:02 smithi082 ceph-mon[94281]: pgmap v930: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2023-03-17T08:15:04.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:56 smithi078 ceph-mon[94114]: pgmap v927: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2023-03-17T08:15:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:14:58 smithi078 ceph-mon[94114]: pgmap v928: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2023-03-17T08:15:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:00 smithi078 ceph-mon[94114]: pgmap v929: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 12 op/s 2023-03-17T08:15:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:02 smithi078 ceph-mon[94114]: pgmap v930: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:45 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2768159841' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: pgmap v922: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2768159841' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-03-17T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:46 smithi035 ceph-mon[92535]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-03-17T08:15:06.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:47 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] up:active 2023-03-17T08:15:06.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:47 smithi035 ceph-mon[92535]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-03-17T08:15:06.220 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:47 smithi035 ceph-mon[92535]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:47 smithi035 ceph-mon[92535]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:47 smithi035 ceph-mon[92535]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: pgmap v923: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] up:active 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-03-17T08:15:07.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:15:07.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:07.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:48 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:07.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] up:active 2023-03-17T08:15:07.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-03-17T08:15:07.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-03-17T08:15:10.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: Cluster is now healthy 2023-03-17T08:15:10.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2023-03-17T08:15:10.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-03-17T08:15:10.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-03-17T08:15:10.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:15:10.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:15:10.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:10.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:50 smithi035 ceph-mon[92535]: pgmap v924: 97 pgs: 97 active+clean; 579 KiB data, 79 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:50 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] up:active 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:50 smithi035 ceph-mon[92535]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:52 smithi035 ceph-mon[92535]: pgmap v925: 97 pgs: 97 active+clean; 583 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:54 smithi035 ceph-mon[92535]: pgmap v926: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s wr, 12 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:56 smithi035 ceph-mon[92535]: pgmap v927: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:14:58 smithi035 ceph-mon[92535]: pgmap v928: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:00 smithi035 ceph-mon[92535]: pgmap v929: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 12 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:02 smithi035 ceph-mon[92535]: pgmap v930: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2023-03-17T08:15:11.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:04 smithi035 ceph-mon[92535]: pgmap v931: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2023-03-17T08:15:11.982 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:04 smithi078 ceph-mon[94114]: pgmap v931: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2023-03-17T08:15:13.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:06 smithi078 ceph-mon[94114]: pgmap v932: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2023-03-17T08:15:16.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:06 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1565657536' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-03-17T08:15:16.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:07 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1565657536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-03-17T08:15:16.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:07 smithi078 ceph-mon[94114]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-17T08:15:16.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:07 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T08:15:16.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:08 smithi078 ceph-mon[94114]: pgmap v933: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-03-17T08:15:16.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:10 smithi078 ceph-mon[94114]: pgmap v934: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2023-03-17T08:15:16.437 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:04 smithi082 ceph-mon[94281]: pgmap v931: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2023-03-17T08:15:16.437 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:06 smithi082 ceph-mon[94281]: pgmap v932: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2023-03-17T08:15:16.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:06 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1565657536' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-03-17T08:15:17.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:07 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1565657536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-03-17T08:15:17.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:07 smithi082 ceph-mon[94281]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-17T08:15:17.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:07 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T08:15:17.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:08 smithi082 ceph-mon[94281]: pgmap v933: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-03-17T08:15:17.264 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:10 smithi082 ceph-mon[94281]: pgmap v934: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2023-03-17T08:15:17.265 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:12 smithi078 ceph-mon[94114]: pgmap v935: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4 op/s 2023-03-17T08:15:19.080 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:14 smithi078 ceph-mon[94114]: pgmap v936: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5 op/s 2023-03-17T08:15:19.080 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:16 smithi078 ceph-mon[94114]: pgmap v937: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2023-03-17T08:15:19.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:12 smithi082 ceph-mon[94281]: pgmap v935: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4 op/s 2023-03-17T08:15:19.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:14 smithi082 ceph-mon[94281]: pgmap v936: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5 op/s 2023-03-17T08:15:20.050 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:16 smithi082 ceph-mon[94281]: pgmap v937: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2023-03-17T08:15:20.051 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:18 smithi078 ceph-mon[94114]: pgmap v938: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2023-03-17T08:15:20.052 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:18 smithi082 ceph-mon[94281]: pgmap v938: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2023-03-17T08:15:20.052 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 -- 172.21.15.35:0/2804790469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100cf0 msgr2=0x7f3f481075b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:21.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/2804790469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100cf0 0x7f3f481075b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000b0a0 tx=0x7f3f4000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:15:21.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 -- 172.21.15.35:0/2804790469 shutdown_connections 2023-03-17T08:15:21.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/2804790469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100cf0 0x7f3f481075b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:21.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/2804790469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f480ff170 0x7f3f480ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:21.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/2804790469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f48100360 0x7f3f481007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:21.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 -- 172.21.15.35:0/2804790469 >> 172.21.15.35:0/2804790469 conn(0x7f3f480fa790 msgr2=0x7f3f480fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:15:21.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 -- 172.21.15.35:0/2804790469 shutdown_connections 2023-03-17T08:15:21.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.874+0000 7f3f4ff75700 1 -- 172.21.15.35:0/2804790469 wait complete. 2023-03-17T08:15:21.896 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 Processor -- start 2023-03-17T08:15:21.896 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 -- start start 2023-03-17T08:15:21.897 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f480ff170 0x7f3f48195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:22.253 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 0x7f3f48196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100cf0 0x7f3f4819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4819dab0 con 0x7f3f48100360 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4819dbf0 con 0x7f3f48100cf0 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4ff75700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4819dd80 con 0x7f3f480ff170 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4d510700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 0x7f3f48196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4d510700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 0x7f3f48196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40066/0 (socket says 172.21.15.35:40066) 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4d510700 1 -- 172.21.15.35:0/1565657536 learned_addr learned my addr 172.21.15.35:0/1565657536 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.875+0000 7f3f4dd11700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f480ff170 0x7f3f48195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4e512700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100cf0 0x7f3f4819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4d510700 1 -- 172.21.15.35:0/1565657536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f480ff170 msgr2=0x7f3f48195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4d510700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f480ff170 0x7f3f48195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4d510700 1 -- 172.21.15.35:0/1565657536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100cf0 msgr2=0x7f3f4819d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4d510700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100cf0 0x7f3f4819d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:22.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4d510700 1 -- 172.21.15.35:0/1565657536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40009d00 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4d510700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 0x7f3f48196470 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800d950 tx=0x7f3f3800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800f890 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f3800fe80 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4810a990 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800e3b0 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.876+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4810a800 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.877+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4819e470 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.878+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3f38010460 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.879+0000 7f3f3effd700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f3409f4d0 0x7f3f340a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.879+0000 7f3f4dd11700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f3409f4d0 0x7f3f340a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.879+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3f380c9f30 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.879+0000 7f3f4dd11700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f3409f4d0 0x7f3f340a1980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f481001c0 tx=0x7f3f4400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:05.882+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3f380940c0 con 0x7f3f48100360 2023-03-17T08:15:22.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.131+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f3f4819ea20 con 0x7f3f48100360 2023-03-17T08:15:22.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.316+0000 7f3f3effd700 1 -- 172.21.15.35:0/1565657536 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v27) v1 ==== 121+0+0 (secure 0 0 0) 0x7f3f38020020 con 0x7f3f48100360 2023-03-17T08:15:22.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.319+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f3409f4d0 msgr2=0x7f3f340a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:22.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.319+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f3409f4d0 0x7f3f340a1980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f481001c0 tx=0x7f3f4400b410 comp rx=0 tx=0).stop 2023-03-17T08:15:22.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.319+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 msgr2=0x7f3f48196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:22.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.319+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 0x7f3f48196470 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800d950 tx=0x7f3f3800dc60 comp rx=0 tx=0).stop 2023-03-17T08:15:22.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 shutdown_connections 2023-03-17T08:15:23.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f48100cf0 0x7f3f4819d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:25.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f480ff170 0x7f3f48195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:25.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f3409f4d0 0x7f3f340a1980 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:25.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 --2- 172.21.15.35:0/1565657536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f48100360 0x7f3f48196470 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:25.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 >> 172.21.15.35:0/1565657536 conn(0x7f3f480fa790 msgr2=0x7f3f480fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:15:25.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 shutdown_connections 2023-03-17T08:15:25.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:06.320+0000 7f3f4ff75700 1 -- 172.21.15.35:0/1565657536 wait complete. 2023-03-17T08:15:25.418 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-03-17T08:15:25.419 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:06 smithi035 ceph-mon[92535]: pgmap v932: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:06 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1565657536' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:07 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1565657536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:07 smithi035 ceph-mon[92535]: fsmap cephfs:5 7 up:standby 5 up:active 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:07 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:08 smithi035 ceph-mon[92535]: pgmap v933: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:10 smithi035 ceph-mon[92535]: pgmap v934: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 0 B/s wr, 0 op/s 2023-03-17T08:15:25.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:12 smithi035 ceph-mon[92535]: pgmap v935: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4 op/s 2023-03-17T08:15:26.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:14 smithi035 ceph-mon[92535]: pgmap v936: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5 op/s 2023-03-17T08:15:26.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:16 smithi035 ceph-mon[92535]: pgmap v937: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2023-03-17T08:15:26.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:18 smithi035 ceph-mon[92535]: pgmap v938: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2023-03-17T08:15:32.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:20 smithi035 ceph-mon[92535]: pgmap v939: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2023-03-17T08:15:34.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:22 smithi035 ceph-mon[92535]: pgmap v940: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 op/s 2023-03-17T08:15:34.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:24 smithi035 ceph-mon[92535]: pgmap v941: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:34.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:26 smithi035 ceph-mon[92535]: pgmap v942: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T08:15:34.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:28 smithi035 ceph-mon[92535]: pgmap v943: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:34.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:30 smithi035 ceph-mon[92535]: pgmap v944: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:34.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:32 smithi035 ceph-mon[92535]: pgmap v945: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:34.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:34 smithi035 ceph-mon[92535]: pgmap v946: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:34.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:20 smithi078 ceph-mon[94114]: pgmap v939: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2023-03-17T08:15:36.504 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:22 smithi078 ceph-mon[94114]: pgmap v940: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 op/s 2023-03-17T08:15:36.504 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:24 smithi078 ceph-mon[94114]: pgmap v941: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:36.504 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:26 smithi078 ceph-mon[94114]: pgmap v942: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T08:15:36.504 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:28 smithi078 ceph-mon[94114]: pgmap v943: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:36.504 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:30 smithi078 ceph-mon[94114]: pgmap v944: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:32 smithi078 ceph-mon[94114]: pgmap v945: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:34 smithi078 ceph-mon[94114]: pgmap v946: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:20 smithi082 ceph-mon[94281]: pgmap v939: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 9 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:22 smithi082 ceph-mon[94281]: pgmap v940: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:24 smithi082 ceph-mon[94281]: pgmap v941: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:26 smithi082 ceph-mon[94281]: pgmap v942: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:28 smithi082 ceph-mon[94281]: pgmap v943: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:36.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:30 smithi082 ceph-mon[94281]: pgmap v944: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:39.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:32 smithi082 ceph-mon[94281]: pgmap v945: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:39.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:34 smithi082 ceph-mon[94281]: pgmap v946: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:39.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/958609449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:36 smithi078 ceph-mon[94114]: pgmap v947: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:36 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/958609449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:36 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:38 smithi078 ceph-mon[94114]: pgmap v948: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/958609449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:36 smithi082 ceph-mon[94281]: pgmap v947: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:40.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:36 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/958609449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-03-17T08:15:41.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:36 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T08:15:41.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:38 smithi082 ceph-mon[94281]: pgmap v948: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:41.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:40 smithi078 ceph-mon[94114]: pgmap v949: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:43.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:40 smithi082 ceph-mon[94281]: pgmap v949: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:43.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:42 smithi078 ceph-mon[94114]: pgmap v950: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:47.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:42 smithi082 ceph-mon[94281]: pgmap v950: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:47.602 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.921+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/4044137111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 msgr2=0x7ffb781075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.921+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/4044137111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb781075f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000b0a0 tx=0x7ffb7000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/4044137111 shutdown_connections 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/4044137111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb781075f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/4044137111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 0x7ffb780ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/4044137111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 0x7ffb78100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/4044137111 >> 172.21.15.35:0/4044137111 conn(0x7ffb780fa730 msgr2=0x7ffb780fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/4044137111 shutdown_connections 2023-03-17T08:15:47.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.922+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/4044137111 wait complete. 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 Processor -- start 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 -- start start 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 0x7ffb78194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 0x7ffb78195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb7819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7819c9b0 con 0x7ffb78100d50 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7819caf0 con 0x7ffb781003a0 2023-03-17T08:15:47.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7ccfd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7819cc80 con 0x7ffb780ff110 2023-03-17T08:15:47.605 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb7819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:47.605 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb7819c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40116/0 (socket says 172.21.15.35:40116) 2023-03-17T08:15:47.605 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 -- 172.21.15.35:0/958609449 learned_addr learned my addr 172.21.15.35:0/958609449 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:15:47.605 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7659c700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 0x7ffb78194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:47.605 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb75d9b700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 0x7ffb78195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:47.605 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 -- 172.21.15.35:0/958609449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 msgr2=0x7ffb78194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:49.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 0x7ffb78194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:49.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 -- 172.21.15.35:0/958609449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 msgr2=0x7ffb78195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:49.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 0x7ffb78195370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:49.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb76d9d700 1 -- 172.21.15.35:0/958609449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009d00 con 0x7ffb78100d50 2023-03-17T08:15:49.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb7659c700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 0x7ffb78194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:15:49.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.923+0000 7ffb75d9b700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 0x7ffb78195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:15:49.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.924+0000 7ffb76d9d700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb7819c3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000b780 tx=0x7ffb7000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:15:49.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.924+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000e040 con 0x7ffb78100d50 2023-03-17T08:15:50.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.924+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb70004e60 con 0x7ffb78100d50 2023-03-17T08:15:50.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.924+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7810a970 con 0x7ffb78100d50 2023-03-17T08:15:51.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.924+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb700052a0 con 0x7ffb78100d50 2023-03-17T08:15:51.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.924+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7810a7e0 con 0x7ffb78100d50 2023-03-17T08:15:51.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.925+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb780679e0 con 0x7ffb78100d50 2023-03-17T08:15:51.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.927+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ffb7001d990 con 0x7ffb78100d50 2023-03-17T08:15:51.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.927+0000 7ffb677fe700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ffb6009f4d0 0x7ffb600a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.927+0000 7ffb7659c700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ffb6009f4d0 0x7ffb600a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.927+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ffb700cbe60 con 0x7ffb78100d50 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.928+0000 7ffb7659c700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ffb6009f4d0 0x7ffb600a1980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009be0 tx=0x7ffb6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:34.931+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ffb70096080 con 0x7ffb78100d50 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.179+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7ffb7819d9d0 con 0x7ffb78100d50 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.372+0000 7ffb677fe700 1 -- 172.21.15.35:0/958609449 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) v1 ==== 115+0+0 (secure 0 0 0) 0x7ffb700996a0 con 0x7ffb78100d50 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ffb6009f4d0 msgr2=0x7ffb600a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ffb6009f4d0 0x7ffb600a1980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009be0 tx=0x7ffb6c009260 comp rx=0 tx=0).stop 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 msgr2=0x7ffb7819c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb7819c3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000b780 tx=0x7ffb7000bdf0 comp rx=0 tx=0).stop 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 shutdown_connections 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ffb6009f4d0 0x7ffb600a1980 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb78100d50 0x7ffb7819c3e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb780ff110 0x7ffb78194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 --2- 172.21.15.35:0/958609449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb781003a0 0x7ffb78195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 >> 172.21.15.35:0/958609449 conn(0x7ffb780fa730 msgr2=0x7ffb780fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:15:51.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.374+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 shutdown_connections 2023-03-17T08:15:51.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:35.375+0000 7ffb7ccfd700 1 -- 172.21.15.35:0/958609449 wait complete. 2023-03-17T08:15:51.035 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-03-17T08:15:51.640 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-03-17T08:15:53.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/958609449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-03-17T08:15:53.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:36 smithi035 ceph-mon[92535]: pgmap v947: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:53.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:36 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/958609449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-03-17T08:15:53.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:36 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T08:15:53.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:38 smithi035 ceph-mon[92535]: pgmap v948: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:53.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:40 smithi035 ceph-mon[92535]: pgmap v949: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:54.540 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:42 smithi035 ceph-mon[92535]: pgmap v950: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:54.540 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:44 smithi035 ceph-mon[92535]: pgmap v951: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:54.540 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:46 smithi035 ceph-mon[92535]: pgmap v952: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:54.540 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:48 smithi035 ceph-mon[92535]: pgmap v953: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:54.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:49 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:15:54.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:50 smithi035 ceph-mon[92535]: pgmap v954: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:54.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:15:55.393 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:15:55.393 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:55.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:52 smithi035 ceph-mon[92535]: pgmap v955: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:55.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:54 smithi035 ceph-mon[92535]: pgmap v956: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:44 smithi078 ceph-mon[94114]: pgmap v951: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:46 smithi078 ceph-mon[94114]: pgmap v952: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:48 smithi078 ceph-mon[94114]: pgmap v953: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:49 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:50 smithi078 ceph-mon[94114]: pgmap v954: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:15:55.913 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:59.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:52 smithi078 ceph-mon[94114]: pgmap v955: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:59.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:54 smithi078 ceph-mon[94114]: pgmap v956: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:59.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:44 smithi082 ceph-mon[94281]: pgmap v951: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:59.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:46 smithi082 ceph-mon[94281]: pgmap v952: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:59.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:48 smithi082 ceph-mon[94281]: pgmap v953: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:59.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:49 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:15:59.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:50 smithi082 ceph-mon[94281]: pgmap v954: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:59.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:15:59.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:15:59.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:15:59.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:52 smithi082 ceph-mon[94281]: pgmap v955: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:15:59.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:54 smithi082 ceph-mon[94281]: pgmap v956: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:15:59.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:56 smithi078 ceph-mon[94114]: pgmap v957: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:15:59.876 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:57 smithi078 ceph-mon[94114]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:15:59.876 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:58 smithi078 ceph-mon[94114]: pgmap v958: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:15:59.876 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:15:58 smithi078 ceph-mon[94114]: mgrmap e17: x(active, since 29m), standbys: y, z 2023-03-17T08:15:59.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:56 smithi082 ceph-mon[94281]: pgmap v957: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:16:01.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:57 smithi082 ceph-mon[94281]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:01.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:58 smithi082 ceph-mon[94281]: pgmap v958: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:16:01.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:15:58 smithi082 ceph-mon[94281]: mgrmap e17: x(active, since 29m), standbys: y, z 2023-03-17T08:16:01.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:00 smithi078 ceph-mon[94114]: pgmap v959: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:02.919 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:00 smithi082 ceph-mon[94281]: pgmap v959: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:02.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:02 smithi078 ceph-mon[94114]: pgmap v960: 97 pgs: 97 active+clean; 606 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2023-03-17T08:16:04.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:02 smithi082 ceph-mon[94281]: pgmap v960: 97 pgs: 97 active+clean; 606 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2023-03-17T08:16:04.141 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3567041353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d88100d50 msgr2=0x7f4d881075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:04.141 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3567041353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d88100d50 0x7f4d881075f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000b0a0 tx=0x7f4d8000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.141 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3567041353 shutdown_connections 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3567041353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d88100d50 0x7f4d881075f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3567041353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 0x7f4d880ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3567041353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d881003a0 0x7f4d88100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3567041353 >> 172.21.15.35:0/3567041353 conn(0x7f4d880fa730 msgr2=0x7f4d880fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3567041353 shutdown_connections 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.053+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3567041353 wait complete. 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 Processor -- start 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 -- start start 2023-03-17T08:16:04.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 0x7f4d88194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 0x7f4d88195360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100d50 0x7f4d8819c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8819c9a0 con 0x7f4d881003a0 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8819cae0 con 0x7f4d88100d50 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8d22c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8819cc70 con 0x7f4d880ff110 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 0x7f4d88195360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 0x7f4d88195360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40128/0 (socket says 172.21.15.35:40128) 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 -- 172.21.15.35:0/3804760516 learned_addr learned my addr 172.21.15.35:0/3804760516 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:16:04.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d86d9d700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 0x7f4d88194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:04.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8759e700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100d50 0x7f4d8819c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:04.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 -- 172.21.15.35:0/3804760516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 msgr2=0x7f4d88194e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:04.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 0x7f4d88194e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.144 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 -- 172.21.15.35:0/3804760516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100d50 msgr2=0x7f4d8819c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100d50 0x7f4d8819c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d8659c700 1 -- 172.21.15.35:0/3804760516 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d80009d00 con 0x7f4d881003a0 2023-03-17T08:16:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.054+0000 7f4d86d9d700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 0x7f4d88194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:16:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.055+0000 7f4d8659c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 0x7f4d88195360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800d950 tx=0x7f4d7800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.055+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78009b40 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.055+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d78009ca0 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.055+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8810a9c0 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.055+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800f620 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.055+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8810a830 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.056+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8819d2d0 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.057+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 16) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f4d78010460 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.058+0000 7f4d7ffff700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d7409f4d0 0x7f4d740a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.058+0000 7f4d86d9d700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d7409f4d0 0x7f4d740a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.058+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4d780ca560 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.058+0000 7f4d86d9d700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d7409f4d0 0x7f4d740a1980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d70005950 tx=0x7f4d700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.063+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f4d780946f0 con 0x7f4d881003a0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.296+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d88060ec0 con 0x7f4d7409f4d0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.340+0000 7f4d7ffff700 1 -- 172.21.15.35:0/3804760516 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4d88060ec0 con 0x7f4d7409f4d0 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d7409f4d0 msgr2=0x7f4d740a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d7409f4d0 0x7f4d740a1980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d70005950 tx=0x7f4d700058e0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 msgr2=0x7f4d88195360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 0x7f4d88195360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800d950 tx=0x7f4d7800dd10 comp rx=0 tx=0).stop 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 shutdown_connections 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88100d50 0x7f4d8819c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d880ff110 0x7f4d88194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d7409f4d0 0x7f4d740a1980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 --2- 172.21.15.35:0/3804760516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d881003a0 0x7f4d88195360 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 >> 172.21.15.35:0/3804760516 conn(0x7f4d880fa730 msgr2=0x7f4d880fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 shutdown_connections 2023-03-17T08:16:04.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:15:56.342+0000 7f4d8d22c700 1 -- 172.21.15.35:0/3804760516 wait complete. 2023-03-17T08:16:04.787 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-03-17T08:16:05.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:56 smithi035 ceph-mon[92535]: pgmap v957: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:16:06.600 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:15:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:15:56.301+0000 7fb76b5c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:16:08.071 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:15:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:15:56.301+0000 7fb76b5c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:16:08.071 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:15:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:15:56.301+0000 7fb76b5c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:16:08.071 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:15:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:15:56.301+0000 7fb76b5c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:16:08.071 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:15:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:15:56.301+0000 7fb76b5c2700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:57 smithi035 ceph-mon[92535]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:58 smithi035 ceph-mon[92535]: pgmap v958: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:15:58 smithi035 ceph-mon[92535]: mgrmap e17: x(active, since 29m), standbys: y, z 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:00 smithi035 ceph-mon[92535]: pgmap v959: 97 pgs: 97 active+clean; 584 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:02 smithi035 ceph-mon[92535]: pgmap v960: 97 pgs: 97 active+clean; 606 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:04 smithi035 ceph-mon[92535]: pgmap v961: 97 pgs: 97 active+clean; 606 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-03-17T08:16:08.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:06 smithi035 ceph-mon[92535]: pgmap v962: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2023-03-17T08:16:08.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:04 smithi078 ceph-mon[94114]: pgmap v961: 97 pgs: 97 active+clean; 606 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-03-17T08:16:09.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:06 smithi078 ceph-mon[94114]: pgmap v962: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2023-03-17T08:16:09.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:04 smithi082 ceph-mon[94281]: pgmap v961: 97 pgs: 97 active+clean; 606 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2023-03-17T08:16:09.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:06 smithi082 ceph-mon[94281]: pgmap v962: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2023-03-17T08:16:09.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:08 smithi078 ceph-mon[94114]: pgmap v963: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2023-03-17T08:16:09.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:08 smithi082 ceph-mon[94281]: pgmap v963: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2023-03-17T08:16:11.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:10 smithi078 ceph-mon[94114]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:11.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:10 smithi078 ceph-mon[94114]: pgmap v964: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T08:16:11.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:10 smithi082 ceph-mon[94281]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:12.837 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:10 smithi082 ceph-mon[94281]: pgmap v964: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T08:16:12.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 -- 172.21.15.35:0/3795625398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6178100d50 msgr2=0x7f61781075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 --2- 172.21.15.35:0/3795625398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6178100d50 0x7f61781075f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f617000b0a0 tx=0x7f617000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 -- 172.21.15.35:0/3795625398 shutdown_connections 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 --2- 172.21.15.35:0/3795625398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6178100d50 0x7f61781075f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 --2- 172.21.15.35:0/3795625398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61780ff110 0x7f61780ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 --2- 172.21.15.35:0/3795625398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61781003a0 0x7f6178100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 -- 172.21.15.35:0/3795625398 >> 172.21.15.35:0/3795625398 conn(0x7f61780fa730 msgr2=0x7f61780fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 -- 172.21.15.35:0/3795625398 shutdown_connections 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.211+0000 7f617df46700 1 -- 172.21.15.35:0/3795625398 wait complete. 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 Processor -- start 2023-03-17T08:16:12.839 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 -- start start 2023-03-17T08:16:12.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 0x7f6178195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:12.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61781003a0 0x7f6178196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:12.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6178100d50 0x7f617819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:12.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617819daa0 con 0x7f61780ff110 2023-03-17T08:16:12.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617819dbe0 con 0x7f61781003a0 2023-03-17T08:16:12.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f617df46700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617819dd70 con 0x7f6178100d50 2023-03-17T08:16:13.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f61777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 0x7f6178195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f61777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 0x7f6178195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40160/0 (socket says 172.21.15.35:40160) 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f61777fe700 1 -- 172.21.15.35:0/3742202113 learned_addr learned my addr 172.21.15.35:0/3742202113 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.212+0000 7f6176ffd700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61781003a0 0x7f6178196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f6177fff700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6178100d50 0x7f617819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f61777fe700 1 -- 172.21.15.35:0/3742202113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6178100d50 msgr2=0x7f617819d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f61777fe700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6178100d50 0x7f617819d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f61777fe700 1 -- 172.21.15.35:0/3742202113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61781003a0 msgr2=0x7f6178196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f61777fe700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61781003a0 0x7f6178196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f61777fe700 1 -- 172.21.15.35:0/3742202113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009d00 con 0x7f61780ff110 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f61777fe700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 0x7f6178195f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f616800d950 tx=0x7f616800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168009940 con 0x7f61780ff110 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6168010460 con 0x7f61780ff110 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617810a9c0 con 0x7f61780ff110 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800f620 con 0x7f61780ff110 2023-03-17T08:16:13.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.213+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617810a830 con 0x7f61780ff110 2023-03-17T08:16:14.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.214+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617819e340 con 0x7f61780ff110 2023-03-17T08:16:14.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.215+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7f61680105d0 con 0x7f61780ff110 2023-03-17T08:16:14.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.216+0000 7f6174ff9700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f616409f560 0x7f61640a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:14.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.216+0000 7f6176ffd700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f616409f560 0x7f61640a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:14.971 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.216+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f61680ca0f0 con 0x7f61780ff110 2023-03-17T08:16:14.971 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.216+0000 7f6176ffd700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f616409f560 0x7f61640a1a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6160005950 tx=0x7f616000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:14.971 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.220+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f6168094180 con 0x7f61780ff110 2023-03-17T08:16:14.971 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.462+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f617819e8f0 con 0x7f616409f560 2023-03-17T08:16:14.971 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.467+0000 7f6174ff9700 1 -- 172.21.15.35:0/3742202113 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f617819e8f0 con 0x7f616409f560 2023-03-17T08:16:14.971 INFO:teuthology.orchestra.run.smithi035.stdout:/volumes/_nogroup/sv_0/a19fac02-a76b-4da9-a7a8-46c7400d413c 2023-03-17T08:16:14.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f616409f560 msgr2=0x7f61640a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:15.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f616409f560 0x7f61640a1a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6160005950 tx=0x7f616000b410 comp rx=0 tx=0).stop 2023-03-17T08:16:15.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 msgr2=0x7f6178195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:15.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 0x7f6178195f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f616800d950 tx=0x7f616800dc60 comp rx=0 tx=0).stop 2023-03-17T08:16:15.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 shutdown_connections 2023-03-17T08:16:15.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6178100d50 0x7f617819d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:15.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f616409f560 0x7f61640a1a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:16.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61780ff110 0x7f6178195f20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:16.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 --2- 172.21.15.35:0/3742202113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61781003a0 0x7f6178196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:16.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 >> 172.21.15.35:0/3742202113 conn(0x7f61780fa730 msgr2=0x7f6178067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:16.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 shutdown_connections 2023-03-17T08:16:16.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:08.469+0000 7f617df46700 1 -- 172.21.15.35:0/3742202113 wait complete. 2023-03-17T08:16:16.211 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:12 smithi078 ceph-mon[94114]: pgmap v965: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2023-03-17T08:16:16.211 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:14 smithi078 ceph-mon[94114]: pgmap v966: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T08:16:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:12 smithi082 ceph-mon[94281]: pgmap v965: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2023-03-17T08:16:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:14 smithi082 ceph-mon[94281]: pgmap v966: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T08:16:16.212 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-03-17T08:16:17.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:08 smithi035 ceph-mon[92535]: pgmap v963: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2023-03-17T08:16:17.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:10 smithi035 ceph-mon[92535]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:17.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:10 smithi035 ceph-mon[92535]: pgmap v964: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T08:16:18.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:12 smithi035 ceph-mon[92535]: pgmap v965: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s 2023-03-17T08:16:18.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:14 smithi035 ceph-mon[92535]: pgmap v966: 97 pgs: 97 active+clean; 611 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T08:16:18.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:16 smithi035 ceph-mon[92535]: pgmap v967: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 12 op/s 2023-03-17T08:16:18.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:18 smithi035 ceph-mon[92535]: pgmap v968: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-03-17T08:16:18.932 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:16 smithi078 ceph-mon[94114]: pgmap v967: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 12 op/s 2023-03-17T08:16:18.932 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:18 smithi078 ceph-mon[94114]: pgmap v968: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-03-17T08:16:18.932 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:16 smithi082 ceph-mon[94281]: pgmap v967: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 12 op/s 2023-03-17T08:16:18.932 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:18 smithi082 ceph-mon[94281]: pgmap v968: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-03-17T08:16:19.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.070+0000 7fbcb88f5700 1 -- 172.21.15.35:0/3717251951 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101650 msgr2=0x7fbcb4101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.070+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/3717251951 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101650 0x7fbcb4101aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009990 tx=0x7fbca4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 -- 172.21.15.35:0/3717251951 shutdown_connections 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/3717251951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4101fe0 0x7fbcb41088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/3717251951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb4100460 0x7fbcb4100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/3717251951 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101650 0x7fbcb4101aa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 -- 172.21.15.35:0/3717251951 >> 172.21.15.35:0/3717251951 conn(0x7fbcb40fbaa0 msgr2=0x7fbcb40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:20.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 -- 172.21.15.35:0/3717251951 shutdown_connections 2023-03-17T08:16:20.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 -- 172.21.15.35:0/3717251951 wait complete. 2023-03-17T08:16:21.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:20 smithi078 ceph-mon[94114]: pgmap v969: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:16:21.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:20 smithi078 ceph-mon[94114]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:21.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:20 smithi082 ceph-mon[94281]: pgmap v969: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:16:21.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:20 smithi082 ceph-mon[94281]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:21.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 Processor -- start 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.071+0000 7fbcb88f5700 1 -- start start 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4100460 0x7fbcb41960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb4101650 0x7fbcb4196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 0x7fbcb419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb419dc50 con 0x7fbcb4101fe0 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb419dd90 con 0x7fbcb4100460 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb419df20 con 0x7fbcb4101650 2023-03-17T08:16:23.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 0x7fbcb419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 0x7fbcb419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40178/0 (socket says 172.21.15.35:40178) 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 -- 172.21.15.35:0/2347306095 learned_addr learned my addr 172.21.15.35:0/2347306095 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb1d9b700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb4101650 0x7fbcb4196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb259c700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4100460 0x7fbcb41960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 -- 172.21.15.35:0/2347306095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb4101650 msgr2=0x7fbcb4196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb4101650 0x7fbcb4196610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:23.376 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 -- 172.21.15.35:0/2347306095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4100460 msgr2=0x7fbcb41960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4100460 0x7fbcb41960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 -- 172.21.15.35:0/2347306095 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40095f0 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb259c700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4100460 0x7fbcb41960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb2d9d700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 0x7fbcb419d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ada0 tx=0x7fbcac00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00f070 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcac007b30 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb410bc80 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac005280 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.072+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb410baf0 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.073+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb406a280 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.075+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7fbcac00c980 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.075+0000 7fbcab7fe700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbca009f5e0 0x7fbca00a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.075+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fbcac0c9f10 con 0x7fbcb4101fe0 2023-03-17T08:16:24.207 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.075+0000 7fbcb259c700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbca009f5e0 0x7fbca00a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.076+0000 7fbcb259c700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbca009f5e0 0x7fbca00a1a90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c005950 tx=0x7fbc9c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.079+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fbcac094030 con 0x7fbcb4101fe0 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.313+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcb4060ec0 con 0x7fbca009f5e0 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.337+0000 7fbcab7fe700 1 -- 172.21.15.35:0/2347306095 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbcb4060ec0 con 0x7fbca009f5e0 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbca009f5e0 msgr2=0x7fbca00a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbca009f5e0 0x7fbca00a1a90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c005950 tx=0x7fbc9c0058e0 comp rx=0 tx=0).stop 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 msgr2=0x7fbcb419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 0x7fbcb419d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ada0 tx=0x7fbcac00c330 comp rx=0 tx=0).stop 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 shutdown_connections 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbca009f5e0 0x7fbca00a1a90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbcb4101fe0 0x7fbcb419d680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcb4100460 0x7fbcb41960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 --2- 172.21.15.35:0/2347306095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbcb4101650 0x7fbcb4196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.339+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 >> 172.21.15.35:0/2347306095 conn(0x7fbcb40fbaa0 msgr2=0x7fbcb40fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.340+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 shutdown_connections 2023-03-17T08:16:24.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:19.340+0000 7fbcb88f5700 1 -- 172.21.15.35:0/2347306095 wait complete. 2023-03-17T08:16:24.209 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-03-17T08:16:24.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:20 smithi035 ceph-mon[92535]: pgmap v969: 97 pgs: 97 active+clean; 612 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:16:24.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:20 smithi035 ceph-mon[92535]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:24.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:22 smithi035 ceph-mon[92535]: pgmap v970: 97 pgs: 97 active+clean; 630 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-03-17T08:16:24.211 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:22 smithi078 ceph-mon[94114]: pgmap v970: 97 pgs: 97 active+clean; 630 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-03-17T08:16:25.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:22 smithi082 ceph-mon[94281]: pgmap v970: 97 pgs: 97 active+clean; 630 KiB data, 80 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-03-17T08:16:25.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:24 smithi078 ceph-mon[94114]: pgmap v971: 97 pgs: 97 active+clean; 630 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-03-17T08:16:25.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:24 smithi082 ceph-mon[94281]: pgmap v971: 97 pgs: 97 active+clean; 630 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-03-17T08:16:25.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 -- 172.21.15.35:0/217294715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444108020 msgr2=0x7fb44410a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:27.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 --2- 172.21.15.35:0/217294715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444108020 0x7fb44410a4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00b0a0 tx=0x7fb43c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:16:27.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 -- 172.21.15.35:0/217294715 shutdown_connections 2023-03-17T08:16:27.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 --2- 172.21.15.35:0/217294715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444108020 0x7fb44410a4a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:27.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 --2- 172.21.15.35:0/217294715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444068a70 0x7fb4441051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:27.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 --2- 172.21.15.35:0/217294715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 0x7fb444107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:28.057 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.352+0000 7fb448db6700 1 -- 172.21.15.35:0/217294715 >> 172.21.15.35:0/217294715 conn(0x7fb4440fa730 msgr2=0x7fb4440fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:28.057 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.353+0000 7fb448db6700 1 -- 172.21.15.35:0/217294715 shutdown_connections 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.353+0000 7fb448db6700 1 -- 172.21.15.35:0/217294715 wait complete. 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.353+0000 7fb448db6700 1 Processor -- start 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.353+0000 7fb448db6700 1 -- start start 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 0x7fb444198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 0x7fb444198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444108020 0x7fb44419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44419fcc0 con 0x7fb444068a70 2023-03-17T08:16:28.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44419fe00 con 0x7fb444105700 2023-03-17T08:16:28.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44419ff90 con 0x7fb444108020 2023-03-17T08:16:28.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 0x7fb444198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:28.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 0x7fb444198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40190/0 (socket says 172.21.15.35:40190) 2023-03-17T08:16:28.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 -- 172.21.15.35:0/1251552826 learned_addr learned my addr 172.21.15.35:0/1251552826 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:16:28.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb442d9d700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444108020 0x7fb44419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:30.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb441d9b700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 0x7fb444198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:30.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 -- 172.21.15.35:0/1251552826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444108020 msgr2=0x7fb44419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:30.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444108020 0x7fb44419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:30.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 -- 172.21.15.35:0/1251552826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 msgr2=0x7fb444198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:31.037 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 0x7fb444198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:31.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 -- 172.21.15.35:0/1251552826 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009d00 con 0x7fb444068a70 2023-03-17T08:16:31.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb442d9d700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444108020 0x7fb44419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:16:31.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb441d9b700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 0x7fb444198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:16:31.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb44259c700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 0x7fb444198140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d980 tx=0x7fb43400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:31.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434009b40 con 0x7fb444068a70 2023-03-17T08:16:31.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb43400de60 con 0x7fb444068a70 2023-03-17T08:16:31.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44410dc60 con 0x7fb444068a70 2023-03-17T08:16:31.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400f620 con 0x7fb444068a70 2023-03-17T08:16:31.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.354+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44410dad0 con 0x7fb444068a70 2023-03-17T08:16:31.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.355+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4440fc2a0 con 0x7fb444068a70 2023-03-17T08:16:31.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.357+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7fb434010460 con 0x7fb444068a70 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.357+0000 7fb43b7fe700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb43009f5e0 0x7fb4300a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.357+0000 7fb441d9b700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb43009f5e0 0x7fb4300a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.357+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb4340c9e60 con 0x7fb444068a70 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.358+0000 7fb441d9b700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb43009f5e0 0x7fb4300a1a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009cb0 tx=0x7fb42c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.361+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb434093f70 con 0x7fb444068a70 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.597+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb444061c40 con 0x7fb43009f5e0 2023-03-17T08:16:31.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.602+0000 7fb43b7fe700 1 -- 172.21.15.35:0/1251552826 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fb444061c40 con 0x7fb43009f5e0 2023-03-17T08:16:31.237 INFO:teuthology.orchestra.run.smithi035.stdout:/volumes/_nogroup/sv_1/8d0fc3d4-8f9a-4fd4-94dc-4f6d39d0d054 2023-03-17T08:16:31.238 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.603+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb43009f5e0 msgr2=0x7fb4300a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:31.238 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.603+0000 7fb448db6700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb43009f5e0 0x7fb4300a1a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009cb0 tx=0x7fb42c009260 comp rx=0 tx=0).stop 2023-03-17T08:16:31.238 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.603+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 msgr2=0x7fb444198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.603+0000 7fb448db6700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 0x7fb444198140 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d980 tx=0x7fb43400dd40 comp rx=0 tx=0).stop 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 shutdown_connections 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb444108020 0x7fb44419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb43009f5e0 0x7fb4300a1a90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb444068a70 0x7fb444198140 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 --2- 172.21.15.35:0/1251552826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb444105700 0x7fb444198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:31.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 >> 172.21.15.35:0/1251552826 conn(0x7fb4440fa730 msgr2=0x7fb444106360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:31.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 shutdown_connections 2023-03-17T08:16:31.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:24.604+0000 7fb448db6700 1 -- 172.21.15.35:0/1251552826 wait complete. 2023-03-17T08:16:31.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:24 smithi035 ceph-mon[92535]: pgmap v971: 97 pgs: 97 active+clean; 630 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2023-03-17T08:16:31.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:26 smithi078 ceph-mon[94114]: pgmap v972: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2023-03-17T08:16:32.563 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:26 smithi078 ceph-mon[94114]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:32.564 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:28 smithi078 ceph-mon[94114]: pgmap v973: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-03-17T08:16:32.564 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:30 smithi078 ceph-mon[94114]: pgmap v974: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2023-03-17T08:16:32.566 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:26 smithi082 ceph-mon[94281]: pgmap v972: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2023-03-17T08:16:33.026 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:26 smithi082 ceph-mon[94281]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:33.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:28 smithi082 ceph-mon[94281]: pgmap v973: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-03-17T08:16:33.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:30 smithi082 ceph-mon[94281]: pgmap v974: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2023-03-17T08:16:33.039 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:16:33.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:26 smithi035 ceph-mon[92535]: pgmap v972: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2023-03-17T08:16:33.596 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:26 smithi035 ceph-mon[92535]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:16:33.596 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:28 smithi035 ceph-mon[92535]: pgmap v973: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-03-17T08:16:33.596 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:30 smithi035 ceph-mon[92535]: pgmap v974: 97 pgs: 97 active+clean; 635 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2023-03-17T08:16:33.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:32 smithi035 ceph-mon[92535]: pgmap v975: 97 pgs: 97 active+clean; 641 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-03-17T08:16:33.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:32 smithi078 ceph-mon[94114]: pgmap v975: 97 pgs: 97 active+clean; 641 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-03-17T08:16:33.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:32 smithi082 ceph-mon[94281]: pgmap v975: 97 pgs: 97 active+clean; 641 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-03-17T08:16:34.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:34 smithi078 ceph-mon[94114]: pgmap v976: 97 pgs: 97 active+clean; 641 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-03-17T08:16:36.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:34 smithi082 ceph-mon[94281]: pgmap v976: 97 pgs: 97 active+clean; 641 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-03-17T08:16:38.240 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3603729562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:16:38.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:36 smithi078 ceph-mon[94114]: pgmap v977: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T08:16:38.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3603729562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:16:38.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:36 smithi082 ceph-mon[94281]: pgmap v977: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T08:16:39.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.111+0000 7f6597ff1700 1 -- 172.21.15.35:0/252254898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 msgr2=0x7f6590108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:40.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 --2- 172.21.15.35:0/252254898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f6590108600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f658800b0a0 tx=0x7f658800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:16:40.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 -- 172.21.15.35:0/252254898 shutdown_connections 2023-03-17T08:16:40.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 --2- 172.21.15.35:0/252254898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f6590108600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:40.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 --2- 172.21.15.35:0/252254898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65901001c0 0x7f65901005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:40.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 --2- 172.21.15.35:0/252254898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65901013b0 0x7f6590101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:40.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 -- 172.21.15.35:0/252254898 >> 172.21.15.35:0/252254898 conn(0x7f65900fb7a0 msgr2=0x7f65900fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:41.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 -- 172.21.15.35:0/252254898 shutdown_connections 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 -- 172.21.15.35:0/252254898 wait complete. 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 Processor -- start 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 -- start start 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.112+0000 7f6597ff1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65901001c0 0x7f6590195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65901013b0 0x7f6590196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f659019d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659019dad0 con 0x7f6590101d40 2023-03-17T08:16:41.645 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659019dc10 con 0x7f65901013b0 2023-03-17T08:16:41.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659019dda0 con 0x7f65901001c0 2023-03-17T08:16:41.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f659019d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:41.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f659019d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40208/0 (socket says 172.21.15.35:40208) 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 -- 172.21.15.35:0/3603729562 learned_addr learned my addr 172.21.15.35:0/3603729562 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6595d8d700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65901001c0 0x7f6590195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659558c700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65901013b0 0x7f6590196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 -- 172.21.15.35:0/3603729562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65901001c0 msgr2=0x7f6590195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65901001c0 0x7f6590195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 -- 172.21.15.35:0/3603729562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65901013b0 msgr2=0x7f6590196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65901013b0 0x7f6590196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 -- 172.21.15.35:0/3603729562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009d00 con 0x7f6590101d40 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f659658e700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f659019d500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f658800bad0 tx=0x7f658800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800e040 con 0x7f6590101d40 2023-03-17T08:16:42.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659010b9f0 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6588004e40 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880053b0 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.113+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659010b860 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.114+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659019e3f0 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.115+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7f658801da90 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.116+0000 7f6586ffd700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f657c09f560 0x7f657c0a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.116+0000 7f6595d8d700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f657c09f560 0x7f657c0a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.116+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f65880cbb40 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.117+0000 7f6595d8d700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f657c09f560 0x7f657c0a1a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6590101210 tx=0x7f658c00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.120+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f6588095c60 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.370+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65901070e0 con 0x7f6590101d40 2023-03-17T08:16:42.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.371+0000 7f6586ffd700 1 -- 172.21.15.35:0/3603729562 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7f6588099280 con 0x7f6590101d40 2023-03-17T08:16:42.249 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:16:42.249 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:16:42.250 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:38 smithi078 ceph-mon[94114]: pgmap v978: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-03-17T08:16:42.250 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:40 smithi078 ceph-mon[94114]: pgmap v979: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-03-17T08:16:42.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:38 smithi082 ceph-mon[94281]: pgmap v978: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-03-17T08:16:42.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:40 smithi082 ceph-mon[94281]: pgmap v979: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-03-17T08:16:42.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f657c09f560 msgr2=0x7f657c0a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:42.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f657c09f560 0x7f657c0a1a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6590101210 tx=0x7f658c00b5b0 comp rx=0 tx=0).stop 2023-03-17T08:16:43.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 msgr2=0x7f659019d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:43.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f659019d500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f658800bad0 tx=0x7f658800bbb0 comp rx=0 tx=0).stop 2023-03-17T08:16:43.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 shutdown_connections 2023-03-17T08:16:43.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f657c09f560 0x7f657c0a1a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:43.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6590101d40 0x7f659019d500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:43.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65901001c0 0x7f6590195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:43.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 --2- 172.21.15.35:0/3603729562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65901013b0 0x7f6590196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:43.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 >> 172.21.15.35:0/3603729562 conn(0x7f65900fb7a0 msgr2=0x7f65900fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:43.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 shutdown_connections 2023-03-17T08:16:43.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:34.373+0000 7f6597ff1700 1 -- 172.21.15.35:0/3603729562 wait complete. 2023-03-17T08:16:43.255 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:16:43.256 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:16:43.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:34 smithi035 ceph-mon[92535]: pgmap v976: 97 pgs: 97 active+clean; 641 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-03-17T08:16:43.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3603729562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:16:43.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:36 smithi035 ceph-mon[92535]: pgmap v977: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T08:16:43.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:38 smithi035 ceph-mon[92535]: pgmap v978: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-03-17T08:16:43.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:40 smithi035 ceph-mon[92535]: pgmap v979: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-03-17T08:16:43.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:42 smithi035 ceph-mon[92535]: pgmap v980: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-03-17T08:16:43.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:42 smithi078 ceph-mon[94114]: pgmap v980: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-03-17T08:16:44.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:42 smithi082 ceph-mon[94281]: pgmap v980: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-03-17T08:16:44.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 -- 172.21.15.35:0/1768447722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 msgr2=0x7ff764101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:45.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/1768447722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764101840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff760009990 tx=0x7ff760009ca0 comp rx=0 tx=0).stop 2023-03-17T08:16:45.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 -- 172.21.15.35:0/1768447722 shutdown_connections 2023-03-17T08:16:45.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/1768447722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764101d80 0x7ff764108640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:45.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/1768447722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764100200 0x7ff764100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:45.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/1768447722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764101840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:46.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 -- 172.21.15.35:0/1768447722 >> 172.21.15.35:0/1768447722 conn(0x7ff7640fb820 msgr2=0x7ff7640fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 -- 172.21.15.35:0/1768447722 shutdown_connections 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 -- 172.21.15.35:0/1768447722 wait complete. 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.394+0000 7ff76c7ae700 1 Processor -- start 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 -- start start 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764100200 0x7ff764198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:46.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764101d80 0x7ff76419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:47.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76419fbc0 con 0x7ff7641013f0 2023-03-17T08:16:47.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76419fd00 con 0x7ff764101d80 2023-03-17T08:16:47.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76c7ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76419fe90 con 0x7ff764100200 2023-03-17T08:16:47.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:47.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40230/0 (socket says 172.21.15.35:40230) 2023-03-17T08:16:47.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 -- 172.21.15.35:0/4271035614 learned_addr learned my addr 172.21.15.35:0/4271035614 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:16:47.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76a54a700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764100200 0x7ff764198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:47.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76ad4b700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764101d80 0x7ff76419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:47.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 -- 172.21.15.35:0/4271035614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764100200 msgr2=0x7ff764198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:47.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764100200 0x7ff764198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:47.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 -- 172.21.15.35:0/4271035614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764101d80 msgr2=0x7ff76419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:47.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764101d80 0x7ff76419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:47.965 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 -- 172.21.15.35:0/4271035614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600095f0 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76a54a700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764100200 0x7ff764198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff76ad4b700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764101d80 0x7ff76419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff769d49700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764198580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff760003a50 tx=0x7ff760009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.395+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76001d070 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.396+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff760005a00 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.396+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76410ba10 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.396+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760005280 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.396+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76410b880 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.396+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff764192770 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.398+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7ff7600053e0 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.398+0000 7ff75b7fe700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff75009f560 0x7ff7500a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.398+0000 7ff76a54a700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff75009f560 0x7ff7500a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.398+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff7600cb930 con 0x7ff7641013f0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.399+0000 7ff76a54a700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff75009f560 0x7ff7500a1a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff754005950 tx=0x7ff7540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:16:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.402+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff760095a50 con 0x7ff7641013f0 2023-03-17T08:16:49.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.605+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff76402d010 con 0x7ff7641013f0 2023-03-17T08:16:49.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.607+0000 7ff75b7fe700 1 -- 172.21.15.35:0/4271035614 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7ff760030090 con 0x7ff7641013f0 2023-03-17T08:16:49.009 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:16:49.009 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:16:49.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff75009f560 msgr2=0x7ff7500a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:50.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff75009f560 0x7ff7500a1a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff754005950 tx=0x7ff7540058e0 comp rx=0 tx=0).stop 2023-03-17T08:16:50.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 msgr2=0x7ff764198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:50.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764198580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff760003a50 tx=0x7ff760009580 comp rx=0 tx=0).stop 2023-03-17T08:16:50.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 shutdown_connections 2023-03-17T08:16:50.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff764101d80 0x7ff76419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:50.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff764100200 0x7ff764198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:50.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff75009f560 0x7ff7500a1a10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:50.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 --2- 172.21.15.35:0/4271035614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7641013f0 0x7ff764198580 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:16:50.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 >> 172.21.15.35:0/4271035614 conn(0x7ff7640fb820 msgr2=0x7ff764106d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:16:50.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 shutdown_connections 2023-03-17T08:16:50.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:43.609+0000 7ff76c7ae700 1 -- 172.21.15.35:0/4271035614 wait complete. 2023-03-17T08:16:50.595 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-17T08:16:51.111 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-17T08:16:51.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:44 smithi035 ceph-mon[92535]: pgmap v981: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-17T08:16:51.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:44 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4271035614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:16:52.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:46 smithi035 ceph-mon[92535]: pgmap v982: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-03-17T08:16:52.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:48 smithi035 ceph-mon[92535]: pgmap v983: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:16:52.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:50 smithi035 ceph-mon[92535]: pgmap v984: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:52.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:50 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:16:53.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:44 smithi078 ceph-mon[94114]: pgmap v981: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-17T08:16:54.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:44 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/4271035614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:16:54.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:46 smithi078 ceph-mon[94114]: pgmap v982: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-03-17T08:16:54.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:48 smithi078 ceph-mon[94114]: pgmap v983: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:16:54.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:50 smithi078 ceph-mon[94114]: pgmap v984: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:54.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:50 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:16:54.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:51 smithi078 ceph-mon[94114]: pgmap v985: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:16:55.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:55.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:55.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:16:55.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:16:55.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:55.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:44 smithi082 ceph-mon[94281]: pgmap v981: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2023-03-17T08:16:55.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:44 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/4271035614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:16:55.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:46 smithi082 ceph-mon[94281]: pgmap v982: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-03-17T08:16:55.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:48 smithi082 ceph-mon[94281]: pgmap v983: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:16:55.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:50 smithi082 ceph-mon[94281]: pgmap v984: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:55.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:50 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:16:55.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:51 smithi082 ceph-mon[94281]: pgmap v985: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:16:55.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:55.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:56.732 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:16:56.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:16:56.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:56.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:51 smithi035 ceph-mon[92535]: pgmap v985: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:16:56.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:56.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:56.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:16:56.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:16:56.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:16:56.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:53 smithi078 ceph-mon[94114]: pgmap v986: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:58.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:55 smithi078 ceph-mon[94114]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:16:58.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:56 smithi078 ceph-mon[94114]: pgmap v987: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:16:58.097 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:53 smithi082 ceph-mon[94281]: pgmap v986: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:16:58.097 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:55 smithi082 ceph-mon[94281]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:16:58.097 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:56 smithi082 ceph-mon[94281]: pgmap v987: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:16:58.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 -- 172.21.15.35:0/2701995220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f66000ff0c0 msgr2=0x7f66000ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:16:59.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 --2- 172.21.15.35:0/2701995220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f66000ff0c0 0x7f66000ff4d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009990 tx=0x7f65f0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:17:00.741 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 -- 172.21.15.35:0/2701995220 shutdown_connections 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 --2- 172.21.15.35:0/2701995220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600100c40 0x7f6600107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 --2- 172.21.15.35:0/2701995220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f66000ff0c0 0x7f66000ff4d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 --2- 172.21.15.35:0/2701995220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66001002b0 0x7f6600100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 -- 172.21.15.35:0/2701995220 >> 172.21.15.35:0/2701995220 conn(0x7f66000fa6a0 msgr2=0x7f66000fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 -- 172.21.15.35:0/2701995220 shutdown_connections 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.320+0000 7f6606150700 1 -- 172.21.15.35:0/2701995220 wait complete. 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 Processor -- start 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 -- start start 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66000ff0c0 0x7f6600195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66001002b0 0x7f66001963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 0x7f660019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:04.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660019da20 con 0x7f6600100c40 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660019db60 con 0x7f66001002b0 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f6606150700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660019dcf0 con 0x7f66000ff0c0 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f65fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 0x7f660019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f65fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 0x7f660019d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40248/0 (socket says 172.21.15.35:40248) 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f65fffff700 1 -- 172.21.15.35:0/3431997793 learned_addr learned my addr 172.21.15.35:0/3431997793 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f65ff7fe700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66000ff0c0 0x7f6600195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.321+0000 7f65feffd700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66001002b0 0x7f66001963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fffff700 1 -- 172.21.15.35:0/3431997793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66000ff0c0 msgr2=0x7f6600195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fffff700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66000ff0c0 0x7f6600195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fffff700 1 -- 172.21.15.35:0/3431997793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66001002b0 msgr2=0x7f66001963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fffff700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66001002b0 0x7f66001963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fffff700 1 -- 172.21.15.35:0/3431997793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00095f0 con 0x7f6600100c40 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65ff7fe700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66000ff0c0 0x7f6600195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:17:04.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fffff700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 0x7f660019d450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f65f8007ee0 tx=0x7f65f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8017070 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f800f040 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660010a8d0 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8005710 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.322+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660010a740 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.323+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660019e370 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.324+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7f65f8005870 con 0x7f6600100c40 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.325+0000 7f65fcff9700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f65e809f5e0 0x7f65e80a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:04.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.325+0000 7f65ff7fe700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f65e809f5e0 0x7f65e80a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:06.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.325+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f65f80ca110 con 0x7f6600100c40 2023-03-17T08:17:06.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.325+0000 7f65ff7fe700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f65e809f5e0 0x7f65e80a1a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c010 tx=0x7f65f000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:17:06.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.328+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f65f80941a0 con 0x7f6600100c40 2023-03-17T08:17:06.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.525+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f660019e920 con 0x7f65e809f5e0 2023-03-17T08:17:06.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.538+0000 7f65fcff9700 1 -- 172.21.15.35:0/3431997793 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344432 (secure 0 0 0) 0x7f660019e920 con 0x7f65e809f5e0 2023-03-17T08:17:06.748 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:16:58 smithi078 ceph-mon[94114]: pgmap v988: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:08.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:00 smithi078 ceph-mon[94114]: pgmap v989: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:08.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:02 smithi078 ceph-mon[94114]: pgmap v990: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:08.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:04 smithi078 ceph-mon[94114]: pgmap v991: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:08.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:06 smithi078 ceph-mon[94114]: pgmap v992: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:08.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:16:58 smithi082 ceph-mon[94281]: pgmap v988: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:08.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:00 smithi082 ceph-mon[94281]: pgmap v989: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:11.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:02 smithi082 ceph-mon[94281]: pgmap v990: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:11.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:04 smithi082 ceph-mon[94281]: pgmap v991: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:11.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:06 smithi082 ceph-mon[94281]: pgmap v992: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:11.455 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:17:15.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:08 smithi078 ceph-mon[94114]: pgmap v993: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:15.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:10 smithi078 ceph-mon[94114]: pgmap v994: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:15.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:12 smithi078 ceph-mon[94114]: pgmap v995: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:18.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:14 smithi078 ceph-mon[94114]: pgmap v996: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:18.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:08 smithi082 ceph-mon[94281]: pgmap v993: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:18.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:10 smithi082 ceph-mon[94281]: pgmap v994: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:18.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:12 smithi082 ceph-mon[94281]: pgmap v995: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:18.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:14 smithi082 ceph-mon[94281]: pgmap v996: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f65e809f5e0 msgr2=0x7f65e80a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f65e809f5e0 0x7f65e80a1a90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c010 tx=0x7f65f000b540 comp rx=0 tx=0).stop 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 msgr2=0x7f660019d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 0x7f660019d450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f65f8007ee0 tx=0x7f65f800d3b0 comp rx=0 tx=0).stop 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 shutdown_connections 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f65e809f5e0 0x7f65e80a1a90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6600100c40 0x7f660019d450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66000ff0c0 0x7f6600195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 --2- 172.21.15.35:0/3431997793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66001002b0 0x7f66001963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 >> 172.21.15.35:0/3431997793 conn(0x7f66000fa6a0 msgr2=0x7f6600068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 shutdown_connections 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:16:53.542+0000 7f6606150700 1 -- 172.21.15.35:0/3431997793 wait complete. 2023-03-17T08:17:18.235 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:17:18.236 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":986,"stamp":"2023-03-17T08:16:52.584027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660425,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1211,"num_read_kb":733,"num_write":430,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":82720,"kb_used_data":13824,"kb_used_omap":0,"kb_used_meta":68800,"kb_avail":1124859104,"statfs":{"total":1151940427776,"available":1151855722496,"internally_reserved":0,"allocated":14155776,"data_stored":7764985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70451200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004112"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308904+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:13:43.308904+0000","last_peered":"2023-03-17T08:13:43.308904+0000","last_clean":"2023-03-17T08:13:43.308904+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:13:43.308904+0000","last_undegraded":"2023-03-17T08:13:43.308904+0000","last_fullsized":"2023-03-17T08:13:43.308904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453566+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:13:43.453566+0000","last_peered":"2023-03-17T08:13:43.453566+0000","last_clean":"2023-03-17T08:13:43.453566+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:13:43.453566+0000","last_undegraded":"2023-03-17T08:13:43.453566+0000","last_fullsized":"2023-03-17T08:13:43.453566+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453514+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:13:43.453514+0000","last_peered":"2023-03-17T08:13:43.453514+0000","last_clean":"2023-03-17T08:13:43.453514+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:13:43.453514+0000","last_undegraded":"2023-03-17T08:13:43.453514+0000","last_fullsized":"2023-03-17T08:13:43.453514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.312585+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:13:43.312585+0000","last_peered":"2023-03-17T08:13:43.312585+0000","last_clean":"2023-03-17T08:13:43.312585+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:13:43.312585+0000","last_undegraded":"2023-03-17T08:13:43.312585+0000","last_fullsized":"2023-03-17T08:13:43.312585+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309560+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:13:43.309560+0000","last_peered":"2023-03-17T08:13:43.309560+0000","last_clean":"2023-03-17T08:13:43.309560+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:13:43.309560+0000","last_undegraded":"2023-03-17T08:13:43.309560+0000","last_fullsized":"2023-03-17T08:13:43.309560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309263+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:13:43.309263+0000","last_peered":"2023-03-17T08:13:43.309263+0000","last_clean":"2023-03-17T08:13:43.309263+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:13:43.309263+0000","last_undegraded":"2023-03-17T08:13:43.309263+0000","last_fullsized":"2023-03-17T08:13:43.309263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438818+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:13:43.438818+0000","last_peered":"2023-03-17T08:13:43.438818+0000","last_clean":"2023-03-17T08:13:43.438818+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:13:43.438818+0000","last_undegraded":"2023-03-17T08:13:43.438818+0000","last_fullsized":"2023-03-17T08:13:43.438818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.310602+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:13:43.310602+0000","last_peered":"2023-03-17T08:13:43.310602+0000","last_clean":"2023-03-17T08:13:43.310602+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:13:43.310602+0000","last_undegraded":"2023-03-17T08:13:43.310602+0000","last_fullsized":"2023-03-17T08:13:43.310602+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308663+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:13:43.308663+0000","last_peered":"2023-03-17T08:13:43.308663+0000","last_clean":"2023-03-17T08:13:43.308663+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:13:43.308663+0000","last_undegraded":"2023-03-17T08:13:43.308663+0000","last_fullsized":"2023-03-17T08:13:43.308663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309595+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:13:43.309595+0000","last_peered":"2023-03-17T08:13:43.309595+0000","last_clean":"2023-03-17T08:13:43.309595+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:13:43.309595+0000","last_undegraded":"2023-03-17T08:13:43.309595+0000","last_fullsized":"2023-03-17T08:13:43.309595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439161+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:13:43.439161+0000","last_peered":"2023-03-17T08:13:43.439161+0000","last_clean":"2023-03-17T08:13:43.439161+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:13:43.439161+0000","last_undegraded":"2023-03-17T08:13:43.439161+0000","last_fullsized":"2023-03-17T08:13:43.439161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:44.701054+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:13:44.701054+0000","last_peered":"2023-03-17T08:13:44.701054+0000","last_clean":"2023-03-17T08:13:44.701054+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:13:44.701054+0000","last_undegraded":"2023-03-17T08:13:44.701054+0000","last_fullsized":"2023-03-17T08:13:44.701054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439372+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:13:43.439372+0000","last_peered":"2023-03-17T08:13:43.439372+0000","last_clean":"2023-03-17T08:13:43.439372+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:13:43.439372+0000","last_undegraded":"2023-03-17T08:13:43.439372+0000","last_fullsized":"2023-03-17T08:13:43.439372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453347+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:13:43.453347+0000","last_peered":"2023-03-17T08:13:43.453347+0000","last_clean":"2023-03-17T08:13:43.453347+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:13:43.453347+0000","last_undegraded":"2023-03-17T08:13:43.453347+0000","last_fullsized":"2023-03-17T08:13:43.453347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453290+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:13:43.453290+0000","last_peered":"2023-03-17T08:13:43.453290+0000","last_clean":"2023-03-17T08:13:43.453290+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:13:43.453290+0000","last_undegraded":"2023-03-17T08:13:43.453290+0000","last_fullsized":"2023-03-17T08:13:43.453290+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.307662+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:13:43.307662+0000","last_peered":"2023-03-17T08:13:43.307662+0000","last_clean":"2023-03-17T08:13:43.307662+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:13:43.307662+0000","last_undegraded":"2023-03-17T08:13:43.307662+0000","last_fullsized":"2023-03-17T08:13:43.307662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308665+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:13:43.308665+0000","last_peered":"2023-03-17T08:13:43.308665+0000","last_clean":"2023-03-17T08:13:43.308665+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:13:43.308665+0000","last_undegraded":"2023-03-17T08:13:43.308665+0000","last_fullsized":"2023-03-17T08:13:43.308665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.307076+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:13:43.307076+0000","last_peered":"2023-03-17T08:13:43.307076+0000","last_clean":"2023-03-17T08:13:43.307076+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:13:43.307076+0000","last_undegraded":"2023-03-17T08:13:43.307076+0000","last_fullsized":"2023-03-17T08:13:43.307076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306775+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:13:43.306775+0000","last_peered":"2023-03-17T08:13:43.306775+0000","last_clean":"2023-03-17T08:13:43.306775+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:13:43.306775+0000","last_undegraded":"2023-03-17T08:13:43.306775+0000","last_fullsized":"2023-03-17T08:13:43.306775+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":136,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:48.471943+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:16:48.471943+0000","last_peered":"2023-03-17T08:16:48.471943+0000","last_clean":"2023-03-17T08:16:48.471943+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:16:48.471943+0000","last_undegraded":"2023-03-17T08:16:48.471943+0000","last_fullsized":"2023-03-17T08:16:48.471943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311288+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:13:43.311288+0000","last_peered":"2023-03-17T08:13:43.311288+0000","last_clean":"2023-03-17T08:13:43.311288+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:13:43.311288+0000","last_undegraded":"2023-03-17T08:13:43.311288+0000","last_fullsized":"2023-03-17T08:13:43.311288+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:46.410079+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:14:46.410079+0000","last_peered":"2023-03-17T08:14:46.410079+0000","last_clean":"2023-03-17T08:14:46.410079+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:14:46.410079+0000","last_undegraded":"2023-03-17T08:14:46.410079+0000","last_fullsized":"2023-03-17T08:14:46.410079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453784+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:13:43.453784+0000","last_peered":"2023-03-17T08:13:43.453784+0000","last_clean":"2023-03-17T08:13:43.453784+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:13:43.453784+0000","last_undegraded":"2023-03-17T08:13:43.453784+0000","last_fullsized":"2023-03-17T08:13:43.453784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.325754+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:15:06.325754+0000","last_peered":"2023-03-17T08:15:06.325754+0000","last_clean":"2023-03-17T08:15:06.325754+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:15:06.325754+0000","last_undegraded":"2023-03-17T08:15:06.325754+0000","last_fullsized":"2023-03-17T08:15:06.325754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308048+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:13:43.308048+0000","last_peered":"2023-03-17T08:13:43.308048+0000","last_clean":"2023-03-17T08:13:43.308048+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:13:43.308048+0000","last_undegraded":"2023-03-17T08:13:43.308048+0000","last_fullsized":"2023-03-17T08:13:43.308048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.329356+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:15:06.329356+0000","last_peered":"2023-03-17T08:15:06.329356+0000","last_clean":"2023-03-17T08:15:06.329356+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:15:06.329356+0000","last_undegraded":"2023-03-17T08:15:06.329356+0000","last_fullsized":"2023-03-17T08:15:06.329356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.312515+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:13:43.312515+0000","last_peered":"2023-03-17T08:13:43.312515+0000","last_clean":"2023-03-17T08:13:43.312515+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:13:43.312515+0000","last_undegraded":"2023-03-17T08:13:43.312515+0000","last_fullsized":"2023-03-17T08:13:43.312515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:47.471382+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:16:47.471382+0000","last_peered":"2023-03-17T08:16:47.471382+0000","last_clean":"2023-03-17T08:16:47.471382+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:16:47.471382+0000","last_undegraded":"2023-03-17T08:16:47.471382+0000","last_fullsized":"2023-03-17T08:16:47.471382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309472+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:13:43.309472+0000","last_peered":"2023-03-17T08:13:43.309472+0000","last_clean":"2023-03-17T08:13:43.309472+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:13:43.309472+0000","last_undegraded":"2023-03-17T08:13:43.309472+0000","last_fullsized":"2023-03-17T08:13:43.309472+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:47.419241+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:14:47.419241+0000","last_peered":"2023-03-17T08:14:47.419241+0000","last_clean":"2023-03-17T08:14:47.419241+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:14:47.419241+0000","last_undegraded":"2023-03-17T08:14:47.419241+0000","last_fullsized":"2023-03-17T08:14:47.419241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.312289+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:13:43.312289+0000","last_peered":"2023-03-17T08:13:43.312289+0000","last_clean":"2023-03-17T08:13:43.312289+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:13:43.312289+0000","last_undegraded":"2023-03-17T08:13:43.312289+0000","last_fullsized":"2023-03-17T08:13:43.312289+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.427112+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:14:48.427112+0000","last_peered":"2023-03-17T08:14:48.427112+0000","last_clean":"2023-03-17T08:14:48.427112+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:14:48.427112+0000","last_undegraded":"2023-03-17T08:14:48.427112+0000","last_fullsized":"2023-03-17T08:14:48.427112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.310661+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:13:43.310661+0000","last_peered":"2023-03-17T08:13:43.310661+0000","last_clean":"2023-03-17T08:13:43.310661+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:13:43.310661+0000","last_undegraded":"2023-03-17T08:13:43.310661+0000","last_fullsized":"2023-03-17T08:13:43.310661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.330442+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:15:06.330442+0000","last_peered":"2023-03-17T08:15:06.330442+0000","last_clean":"2023-03-17T08:15:06.330442+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:15:06.330442+0000","last_undegraded":"2023-03-17T08:15:06.330442+0000","last_fullsized":"2023-03-17T08:15:06.330442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306709+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:13:43.306709+0000","last_peered":"2023-03-17T08:13:43.306709+0000","last_clean":"2023-03-17T08:13:43.306709+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:13:43.306709+0000","last_undegraded":"2023-03-17T08:13:43.306709+0000","last_fullsized":"2023-03-17T08:13:43.306709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":229,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:48.472058+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:16:48.472058+0000","last_peered":"2023-03-17T08:16:48.472058+0000","last_clean":"2023-03-17T08:16:48.472058+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:16:48.472058+0000","last_undegraded":"2023-03-17T08:16:48.472058+0000","last_fullsized":"2023-03-17T08:16:48.472058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308140+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:13:43.308140+0000","last_peered":"2023-03-17T08:13:43.308140+0000","last_clean":"2023-03-17T08:13:43.308140+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:13:43.308140+0000","last_undegraded":"2023-03-17T08:13:43.308140+0000","last_fullsized":"2023-03-17T08:13:43.308140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.428002+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:14:48.428002+0000","last_peered":"2023-03-17T08:14:48.428002+0000","last_clean":"2023-03-17T08:14:48.428002+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:14:48.428002+0000","last_undegraded":"2023-03-17T08:14:48.428002+0000","last_fullsized":"2023-03-17T08:14:48.428002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453758+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:13:43.453758+0000","last_peered":"2023-03-17T08:13:43.453758+0000","last_clean":"2023-03-17T08:13:43.453758+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:13:43.453758+0000","last_undegraded":"2023-03-17T08:13:43.453758+0000","last_fullsized":"2023-03-17T08:13:43.453758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.329455+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:15:06.329455+0000","last_peered":"2023-03-17T08:15:06.329455+0000","last_clean":"2023-03-17T08:15:06.329455+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:15:06.329455+0000","last_undegraded":"2023-03-17T08:15:06.329455+0000","last_fullsized":"2023-03-17T08:15:06.329455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308161+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:13:43.308161+0000","last_peered":"2023-03-17T08:13:43.308161+0000","last_clean":"2023-03-17T08:13:43.308161+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:13:43.308161+0000","last_undegraded":"2023-03-17T08:13:43.308161+0000","last_fullsized":"2023-03-17T08:13:43.308161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":288,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:48.471916+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:16:48.471916+0000","last_peered":"2023-03-17T08:16:48.471916+0000","last_clean":"2023-03-17T08:16:48.471916+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:16:48.471916+0000","last_undegraded":"2023-03-17T08:16:48.471916+0000","last_fullsized":"2023-03-17T08:16:48.471916+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62801,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":217,"num_read_kb":169,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309968+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:13:43.309968+0000","last_peered":"2023-03-17T08:13:43.309968+0000","last_clean":"2023-03-17T08:13:43.309968+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:13:43.309968+0000","last_undegraded":"2023-03-17T08:13:43.309968+0000","last_fullsized":"2023-03-17T08:13:43.309968+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.327880+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:15:06.327880+0000","last_peered":"2023-03-17T08:15:06.327880+0000","last_clean":"2023-03-17T08:15:06.327880+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:15:06.327880+0000","last_undegraded":"2023-03-17T08:15:06.327880+0000","last_fullsized":"2023-03-17T08:15:06.327880+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439286+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:13:43.439286+0000","last_peered":"2023-03-17T08:13:43.439286+0000","last_clean":"2023-03-17T08:13:43.439286+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:13:43.439286+0000","last_undegraded":"2023-03-17T08:13:43.439286+0000","last_fullsized":"2023-03-17T08:13:43.439286+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.324567+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:15:04.324567+0000","last_peered":"2023-03-17T08:15:04.324567+0000","last_clean":"2023-03-17T08:15:04.324567+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:15:04.324567+0000","last_undegraded":"2023-03-17T08:15:04.324567+0000","last_fullsized":"2023-03-17T08:15:04.324567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439057+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:13:43.439057+0000","last_peered":"2023-03-17T08:13:43.439057+0000","last_clean":"2023-03-17T08:13:43.439057+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:13:43.439057+0000","last_undegraded":"2023-03-17T08:13:43.439057+0000","last_fullsized":"2023-03-17T08:13:43.439057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'6","reported_seq":132,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:49.474171+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:16:49.474171+0000","last_peered":"2023-03-17T08:16:49.474171+0000","last_clean":"2023-03-17T08:16:49.474171+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:16:49.474171+0000","last_undegraded":"2023-03-17T08:16:49.474171+0000","last_fullsized":"2023-03-17T08:16:49.474171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438709+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:13:43.438709+0000","last_peered":"2023-03-17T08:13:43.438709+0000","last_clean":"2023-03-17T08:13:43.438709+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:13:43.438709+0000","last_undegraded":"2023-03-17T08:13:43.438709+0000","last_fullsized":"2023-03-17T08:13:43.438709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.389244+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:15:04.389244+0000","last_peered":"2023-03-17T08:15:04.389244+0000","last_clean":"2023-03-17T08:15:04.389244+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:15:04.389244+0000","last_undegraded":"2023-03-17T08:15:04.389244+0000","last_fullsized":"2023-03-17T08:15:04.389244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:44.701030+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:13:44.701030+0000","last_peered":"2023-03-17T08:13:44.701030+0000","last_clean":"2023-03-17T08:13:44.701030+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:13:44.701030+0000","last_undegraded":"2023-03-17T08:13:44.701030+0000","last_fullsized":"2023-03-17T08:13:44.701030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.327915+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:15:06.327915+0000","last_peered":"2023-03-17T08:15:06.327915+0000","last_clean":"2023-03-17T08:15:06.327915+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:15:06.327915+0000","last_undegraded":"2023-03-17T08:15:06.327915+0000","last_fullsized":"2023-03-17T08:15:06.327915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308626+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:13:43.308626+0000","last_peered":"2023-03-17T08:13:43.308626+0000","last_clean":"2023-03-17T08:13:43.308626+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:13:43.308626+0000","last_undegraded":"2023-03-17T08:13:43.308626+0000","last_fullsized":"2023-03-17T08:13:43.308626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:47.417939+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:14:47.417939+0000","last_peered":"2023-03-17T08:14:47.417939+0000","last_clean":"2023-03-17T08:14:47.417939+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:14:47.417939+0000","last_undegraded":"2023-03-17T08:14:47.417939+0000","last_fullsized":"2023-03-17T08:14:47.417939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'1","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.337715+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:15:04.337715+0000","last_peered":"2023-03-17T08:15:04.337715+0000","last_clean":"2023-03-17T08:15:04.337715+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:15:04.337715+0000","last_undegraded":"2023-03-17T08:15:04.337715+0000","last_fullsized":"2023-03-17T08:15:04.337715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":126,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:46.469714+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:16:46.469714+0000","last_peered":"2023-03-17T08:16:46.469714+0000","last_clean":"2023-03-17T08:16:46.469714+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:16:46.469714+0000","last_undegraded":"2023-03-17T08:16:46.469714+0000","last_fullsized":"2023-03-17T08:16:46.469714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.455273+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:13:43.455273+0000","last_peered":"2023-03-17T08:13:43.455273+0000","last_clean":"2023-03-17T08:13:43.455273+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:13:43.455273+0000","last_undegraded":"2023-03-17T08:13:43.455273+0000","last_fullsized":"2023-03-17T08:13:43.455273+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311914+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:13:43.311914+0000","last_peered":"2023-03-17T08:13:43.311914+0000","last_clean":"2023-03-17T08:13:43.311914+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:13:43.311914+0000","last_undegraded":"2023-03-17T08:13:43.311914+0000","last_fullsized":"2023-03-17T08:13:43.311914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:47.470515+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:16:47.470515+0000","last_peered":"2023-03-17T08:16:47.470515+0000","last_clean":"2023-03-17T08:16:47.470515+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:16:47.470515+0000","last_undegraded":"2023-03-17T08:16:47.470515+0000","last_fullsized":"2023-03-17T08:16:47.470515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311097+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:13:43.311097+0000","last_peered":"2023-03-17T08:13:43.311097+0000","last_clean":"2023-03-17T08:13:43.311097+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:13:43.311097+0000","last_undegraded":"2023-03-17T08:13:43.311097+0000","last_fullsized":"2023-03-17T08:13:43.311097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.326253+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:15:06.326253+0000","last_peered":"2023-03-17T08:15:06.326253+0000","last_clean":"2023-03-17T08:15:06.326253+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:15:06.326253+0000","last_undegraded":"2023-03-17T08:15:06.326253+0000","last_fullsized":"2023-03-17T08:15:06.326253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438820+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:13:43.438820+0000","last_peered":"2023-03-17T08:13:43.438820+0000","last_clean":"2023-03-17T08:13:43.438820+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:13:43.438820+0000","last_undegraded":"2023-03-17T08:13:43.438820+0000","last_fullsized":"2023-03-17T08:13:43.438820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439046+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:13:43.439046+0000","last_peered":"2023-03-17T08:13:43.439046+0000","last_clean":"2023-03-17T08:13:43.439046+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:13:43.439046+0000","last_undegraded":"2023-03-17T08:13:43.439046+0000","last_fullsized":"2023-03-17T08:13:43.439046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.427441+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:14:48.427441+0000","last_peered":"2023-03-17T08:14:48.427441+0000","last_clean":"2023-03-17T08:14:48.427441+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:14:48.427441+0000","last_undegraded":"2023-03-17T08:14:48.427441+0000","last_fullsized":"2023-03-17T08:14:48.427441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:49.387855+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:14:49.387855+0000","last_peered":"2023-03-17T08:14:49.387855+0000","last_clean":"2023-03-17T08:14:49.387855+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:14:49.387855+0000","last_undegraded":"2023-03-17T08:14:49.387855+0000","last_fullsized":"2023-03-17T08:14:49.387855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439429+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:13:43.439429+0000","last_peered":"2023-03-17T08:13:43.439429+0000","last_clean":"2023-03-17T08:13:43.439429+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:13:43.439429+0000","last_undegraded":"2023-03-17T08:13:43.439429+0000","last_fullsized":"2023-03-17T08:13:43.439429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:28.156889+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:16:28.156889+0000","last_peered":"2023-03-17T08:16:28.156889+0000","last_clean":"2023-03-17T08:16:28.156889+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:16:28.156889+0000","last_undegraded":"2023-03-17T08:16:28.156889+0000","last_fullsized":"2023-03-17T08:16:28.156889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311602+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:13:43.311602+0000","last_peered":"2023-03-17T08:13:43.311602+0000","last_clean":"2023-03-17T08:13:43.311602+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:13:43.311602+0000","last_undegraded":"2023-03-17T08:13:43.311602+0000","last_fullsized":"2023-03-17T08:13:43.311602+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:56.082449+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:14:56.082449+0000","last_peered":"2023-03-17T08:14:56.082449+0000","last_clean":"2023-03-17T08:14:56.082449+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:14:56.082449+0000","last_undegraded":"2023-03-17T08:14:56.082449+0000","last_fullsized":"2023-03-17T08:14:56.082449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453637+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:13:43.453637+0000","last_peered":"2023-03-17T08:13:43.453637+0000","last_clean":"2023-03-17T08:13:43.453637+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:13:43.453637+0000","last_undegraded":"2023-03-17T08:13:43.453637+0000","last_fullsized":"2023-03-17T08:13:43.453637+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:45.405061+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:14:45.405061+0000","last_peered":"2023-03-17T08:14:45.405061+0000","last_clean":"2023-03-17T08:14:45.405061+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:14:45.405061+0000","last_undegraded":"2023-03-17T08:14:45.405061+0000","last_fullsized":"2023-03-17T08:14:45.405061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309310+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:13:43.309310+0000","last_peered":"2023-03-17T08:13:43.309310+0000","last_clean":"2023-03-17T08:13:43.309310+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:13:43.309310+0000","last_undegraded":"2023-03-17T08:13:43.309310+0000","last_fullsized":"2023-03-17T08:13:43.309310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.427476+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:14:48.427476+0000","last_peered":"2023-03-17T08:14:48.427476+0000","last_clean":"2023-03-17T08:14:48.427476+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:14:48.427476+0000","last_undegraded":"2023-03-17T08:14:48.427476+0000","last_fullsized":"2023-03-17T08:14:48.427476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308356+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:13:43.308356+0000","last_peered":"2023-03-17T08:13:43.308356+0000","last_clean":"2023-03-17T08:13:43.308356+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:13:43.308356+0000","last_undegraded":"2023-03-17T08:13:43.308356+0000","last_fullsized":"2023-03-17T08:13:43.308356+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:49.619205+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:14:49.619205+0000","last_peered":"2023-03-17T08:14:49.619205+0000","last_clean":"2023-03-17T08:14:49.619205+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:14:49.619205+0000","last_undegraded":"2023-03-17T08:14:49.619205+0000","last_fullsized":"2023-03-17T08:14:49.619205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311427+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:13:43.311427+0000","last_peered":"2023-03-17T08:13:43.311427+0000","last_clean":"2023-03-17T08:13:43.311427+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:13:43.311427+0000","last_undegraded":"2023-03-17T08:13:43.311427+0000","last_fullsized":"2023-03-17T08:13:43.311427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:59.388795+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:14:59.388795+0000","last_peered":"2023-03-17T08:14:59.388795+0000","last_clean":"2023-03-17T08:14:59.388795+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:14:59.388795+0000","last_undegraded":"2023-03-17T08:14:59.388795+0000","last_fullsized":"2023-03-17T08:14:59.388795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438947+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:13:43.438947+0000","last_peered":"2023-03-17T08:13:43.438947+0000","last_clean":"2023-03-17T08:13:43.438947+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:13:43.438947+0000","last_undegraded":"2023-03-17T08:13:43.438947+0000","last_fullsized":"2023-03-17T08:13:43.438947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:47.471139+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:16:47.471139+0000","last_peered":"2023-03-17T08:16:47.471139+0000","last_clean":"2023-03-17T08:16:47.471139+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:16:47.471139+0000","last_undegraded":"2023-03-17T08:16:47.471139+0000","last_fullsized":"2023-03-17T08:16:47.471139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439254+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:13:43.439254+0000","last_peered":"2023-03-17T08:13:43.439254+0000","last_clean":"2023-03-17T08:13:43.439254+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:13:43.439254+0000","last_undegraded":"2023-03-17T08:13:43.439254+0000","last_fullsized":"2023-03-17T08:13:43.439254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:59.324140+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:14:59.324140+0000","last_peered":"2023-03-17T08:14:59.324140+0000","last_clean":"2023-03-17T08:14:59.324140+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:14:59.324140+0000","last_undegraded":"2023-03-17T08:14:59.324140+0000","last_fullsized":"2023-03-17T08:14:59.324140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'1","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:13.224610+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:15:13.224610+0000","last_peered":"2023-03-17T08:15:13.224610+0000","last_clean":"2023-03-17T08:15:13.224610+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:15:13.224610+0000","last_undegraded":"2023-03-17T08:15:13.224610+0000","last_fullsized":"2023-03-17T08:15:13.224610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.427277+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:14:48.427277+0000","last_peered":"2023-03-17T08:14:48.427277+0000","last_clean":"2023-03-17T08:14:48.427277+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:14:48.427277+0000","last_undegraded":"2023-03-17T08:14:48.427277+0000","last_fullsized":"2023-03-17T08:14:48.427277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439320+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:13:43.439320+0000","last_peered":"2023-03-17T08:13:43.439320+0000","last_clean":"2023-03-17T08:13:43.439320+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:13:43.439320+0000","last_undegraded":"2023-03-17T08:13:43.439320+0000","last_fullsized":"2023-03-17T08:13:43.439320+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308405+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:13:43.308405+0000","last_peered":"2023-03-17T08:13:43.308405+0000","last_clean":"2023-03-17T08:13:43.308405+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:13:43.308405+0000","last_undegraded":"2023-03-17T08:13:43.308405+0000","last_fullsized":"2023-03-17T08:13:43.308405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306446+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:13:43.306446+0000","last_peered":"2023-03-17T08:13:43.306446+0000","last_clean":"2023-03-17T08:13:43.306446+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:13:43.306446+0000","last_undegraded":"2023-03-17T08:13:43.306446+0000","last_fullsized":"2023-03-17T08:13:43.306446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306440+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:13:43.306440+0000","last_peered":"2023-03-17T08:13:43.306440+0000","last_clean":"2023-03-17T08:13:43.306440+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:13:43.306440+0000","last_undegraded":"2023-03-17T08:13:43.306440+0000","last_fullsized":"2023-03-17T08:13:43.306440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453671+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:13:43.453671+0000","last_peered":"2023-03-17T08:13:43.453671+0000","last_clean":"2023-03-17T08:13:43.453671+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:13:43.453671+0000","last_undegraded":"2023-03-17T08:13:43.453671+0000","last_fullsized":"2023-03-17T08:13:43.453671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439322+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:13:43.439322+0000","last_peered":"2023-03-17T08:13:43.439322+0000","last_clean":"2023-03-17T08:13:43.439322+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:13:43.439322+0000","last_undegraded":"2023-03-17T08:13:43.439322+0000","last_fullsized":"2023-03-17T08:13:43.439322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308544+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:13:43.308544+0000","last_peered":"2023-03-17T08:13:43.308544+0000","last_clean":"2023-03-17T08:13:43.308544+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:13:43.308544+0000","last_undegraded":"2023-03-17T08:13:43.308544+0000","last_fullsized":"2023-03-17T08:13:43.308544+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306989+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:13:43.306989+0000","last_peered":"2023-03-17T08:13:43.306989+0000","last_clean":"2023-03-17T08:13:43.306989+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:13:43.306989+0000","last_undegraded":"2023-03-17T08:13:43.306989+0000","last_fullsized":"2023-03-17T08:13:43.306989+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311522+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:13:43.311522+0000","last_peered":"2023-03-17T08:13:43.311522+0000","last_clean":"2023-03-17T08:13:43.311522+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:13:43.311522+0000","last_undegraded":"2023-03-17T08:13:43.311522+0000","last_fullsized":"2023-03-17T08:13:43.311522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311753+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:13:43.311753+0000","last_peered":"2023-03-17T08:13:43.311753+0000","last_clean":"2023-03-17T08:13:43.311753+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:13:43.311753+0000","last_undegraded":"2023-03-17T08:13:43.311753+0000","last_fullsized":"2023-03-17T08:13:43.311753+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.310730+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:13:43.310730+0000","last_peered":"2023-03-17T08:13:43.310730+0000","last_clean":"2023-03-17T08:13:43.310730+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:13:43.310730+0000","last_undegraded":"2023-03-17T08:13:43.310730+0000","last_fullsized":"2023-03-17T08:13:43.310730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.307954+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:13:43.307954+0000","last_peered":"2023-03-17T08:13:43.307954+0000","last_clean":"2023-03-17T08:13:43.307954+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:13:43.307954+0000","last_undegraded":"2023-03-17T08:13:43.307954+0000","last_fullsized":"2023-03-17T08:13:43.307954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439322+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:13:43.439322+0000","last_peered":"2023-03-17T08:13:43.439322+0000","last_clean":"2023-03-17T08:13:43.439322+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:13:43.439322+0000","last_undegraded":"2023-03-17T08:13:43.439322+0000","last_fullsized":"2023-03-17T08:13:43.439322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308473+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:13:43.308473+0000","last_peered":"2023-03-17T08:13:43.308473+0000","last_clean":"2023-03-17T08:13:43.308473+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:13:43.308473+0000","last_undegraded":"2023-03-17T08:13:43.308473+0000","last_fullsized":"2023-03-17T08:13:43.308473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69811,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1075,"num_read_kb":614,"num_write":247,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6176,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93738976,"statfs":{"total":95995035648,"available":95988711424,"internally_reserved":0,"allocated":1007616,"data_stored":483356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.878,"15min":0.878},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60599999999999998,"15min":0.62},"min":{"1min":0.41399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":0.876,"15min":0.876},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66500000000000004,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84899999999999998,"5min":0.92800000000000005,"15min":0.96699999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.80300000000000005,"5min":0.84999999999999998,"15min":1.1439999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34200000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.69099999999999995,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.503,"15min":0.49099999999999999},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.443},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81899999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.68100000000000005},"min":{"1min":0.47999999999999998,"5min":0.438,"15min":0.42299999999999999},"max":{"1min":0.87,"5min":0.997,"15min":1.0169999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67200000000000004,"15min":0.63500000000000001},"min":{"1min":0.498,"5min":0.46200000000000002,"15min":0.42299999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.59399999999999997},"min":{"1min":0.44700000000000001,"5min":0.37,"15min":0.33400000000000002},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1160000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64400000000000002,"15min":0.63100000000000001},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88700000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.53500000000000003,"5min":0.52500000000000002,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0489999999999999,"15min":1.2849999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.48899999999999999},"max":{"1min":0.88400000000000001,"5min":0.95399999999999996,"15min":1.0740000000000001},"last":0.57799999999999996}]},{"osd":8,"last update":"Fri Mar 17 08:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.752,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.49199999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93400000000000005,"5min":1.004,"15min":1.004},"last":0.53800000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91200000000000003,"5min":1.002,"15min":1.3879999999999999},"last":0.623},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.79600000000000004},"min":{"1min":0.55400000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96999999999999997,"5min":1.071,"15min":1.238},"last":0.72299999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.96399999999999997,"5min":1.0289999999999999,"15min":1.194},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76900000000000002,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":1.415},"last":0.66600000000000004}]}]},{"osd":10,"up_from":73,"seq":313532612716,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7168,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93737984,"statfs":{"total":95995035648,"available":95987695616,"internally_reserved":0,"allocated":1695744,"data_stored":1137161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72099999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.79900000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.76900000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.441,"15min":0.45800000000000002},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.60199999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.32400000000000001,"15min":0.26200000000000001},"max":{"1min":0.69199999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.29599999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.64800000000000002},"min":{"1min":0.497,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86099999999999999,"5min":0.89200000000000002,"15min":0.91200000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.47099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.66900000000000004},"min":{"1min":0.46100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.77000000000000002,"5min":0.91000000000000003,"15min":0.92200000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.75600000000000001,"5min":0.85499999999999998,"15min":0.88600000000000001},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.57799999999999996},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.53700000000000003,"15min":0.55400000000000005},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.36699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.57999999999999996,"5min":0.498,"15min":0.441},"max":{"1min":0.95899999999999996,"5min":1.117,"15min":1.117},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71799999999999997,"15min":0.76700000000000002},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.96999999999999997,"15min":1.024},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.75700000000000001},"min":{"1min":0.498,"5min":0.48499999999999999,"15min":0.38900000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.622}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.60799999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94199999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.749,"15min":0.79200000000000004},"min":{"1min":0.57299999999999995,"5min":0.496,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74199999999999999}]},{"osd":9,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.026},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76900000000000002,"15min":0.82699999999999996},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.1699999999999999},"last":0.68400000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48299999999999998},"max":{"1min":0.97599999999999998,"5min":1.026,"15min":1.026},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80600000000000005,"15min":0.80400000000000005},"min":{"1min":0.67300000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.64400000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776247,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6316,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738836,"statfs":{"total":95995035648,"available":95988568064,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48899999999999999,"15min":0.47399999999999998},"min":{"1min":0.36499999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.77700000000000002,"15min":0.79600000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33500000000000002},"max":{"1min":0.85699999999999998,"5min":0.877,"15min":0.877},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46700000000000003,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.246},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":1.1180000000000001,"15min":1.22},"last":1.298}]},{"osd":2,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65100000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.57799999999999996,"5min":0.45900000000000002,"15min":0.40899999999999997},"max":{"1min":0.85899999999999999,"5min":0.97999999999999998,"15min":1.03},"last":1.242}]},{"osd":3,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.68200000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.439},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.629}]},{"osd":4,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.438},"max":{"1min":0.95499999999999996,"5min":1.0269999999999999,"15min":1.0660000000000001},"last":1.361},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.505,"5min":0.49399999999999999,"15min":0.40600000000000003},"max":{"1min":0.876,"5min":0.98099999999999998,"15min":0.98399999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.41699999999999998},"max":{"1min":0.92800000000000005,"5min":1,"15min":1.0760000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.504,"15min":0.45000000000000001},"max":{"1min":0.84999999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.52000000000000002,"5min":0.432,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.3360000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.49399999999999999,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.306},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.51500000000000001,"5min":0.51400000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.98199999999999998}]},{"osd":8,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85799999999999998},"min":{"1min":0.66800000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1,"5min":1.0980000000000001,"15min":1.157},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83699999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.51500000000000001},"max":{"1min":1.028,"5min":1.1419999999999999,"15min":1.3380000000000001},"last":1.2190000000000001}]},{"osd":10,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.86599999999999999,"15min":0.84099999999999997},"min":{"1min":0.64800000000000002,"5min":0.56299999999999994,"15min":0.54300000000000004},"max":{"1min":1.1000000000000001,"5min":1.167,"15min":1.4179999999999999},"last":1.284},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.83199999999999996,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.95299999999999996}]}]},{"osd":8,"up_from":60,"seq":257698037889,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6500,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738652,"statfs":{"total":95995035648,"available":95988379648,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":1.127,"15min":1.127},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.83699999999999997,"5min":1.113,"15min":1.113},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63200000000000001,"15min":0.59099999999999997},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.32000000000000001},"max":{"1min":0.80300000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.47199999999999998},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.79900000000000004,"5min":1.236,"15min":1.236},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.27700000000000002},"max":{"1min":0.81899999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86899999999999999,"5min":0.92700000000000005,"15min":1.2729999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.60099999999999998},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":1.387,"15min":1.387},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.35799999999999998,"5min":0.33900000000000002,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":1.218,"15min":1.218},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.92300000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.435}]},{"osd":6,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.254,"15min":1.254},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97899999999999998,"5min":1.165,"15min":1.165},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.72299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.998,"5min":1.175,"15min":1.246},"last":0.621}]},{"osd":9,"last update":"Fri Mar 17 08:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79300000000000004,"15min":0.751},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.46400000000000002},"max":{"1min":0.96299999999999997,"5min":1.746,"15min":1.746},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.77800000000000002},"min":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.51600000000000001},"max":{"1min":1.0660000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.63700000000000001}]},{"osd":10,"last update":"Fri Mar 17 08:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.76700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.052,"5min":1.1359999999999999,"15min":1.337},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.73699999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46100000000000002},"max":{"1min":0.995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.71499999999999997}]},{"osd":11,"last update":"Fri Mar 17 08:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1180000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68300000000000005}]}]},{"osd":7,"up_from":52,"seq":223338299532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7152,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738000,"statfs":{"total":95995035648,"available":95987712000,"internally_reserved":0,"allocated":1613824,"data_stored":1076391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44600000000000001,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.84299999999999997},"last":0.441},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46100000000000002,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.26600000000000001},"max":{"1min":0.60299999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.91500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.59999999999999998},"min":{"1min":0.53600000000000003,"5min":0.42299999999999999,"15min":0.314},"max":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.92100000000000004},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":3.8140000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72499999999999998,"5min":0.77700000000000002,"15min":0.94599999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.30199999999999999},"max":{"1min":0.73799999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":0.91300000000000003,"15min":0.98199999999999998},"last":0.753},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.66100000000000003},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50800000000000001,"5min":0.498,"15min":0.436},"max":{"1min":0.85999999999999999,"5min":0.93500000000000005,"15min":1.008},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.94199999999999995,"5min":0.97399999999999998,"15min":0.98399999999999999},"last":0.78800000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.70999999999999996},"min":{"1min":0.54000000000000004,"5min":0.47799999999999998,"15min":0.41299999999999998},"max":{"1min":0.85199999999999998,"5min":1.046,"15min":1.046},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.62,"5min":0.46800000000000003,"15min":0.45700000000000002},"max":{"1min":0.97199999999999998,"5min":1.095,"15min":1.095},"last":0.70399999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.72299999999999998},"min":{"1min":0.59099999999999997,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.96299999999999997,"5min":1.167,"15min":1.167},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.73299999999999998},"min":{"1min":0.58799999999999997,"5min":0.54700000000000004,"15min":0.52100000000000002},"max":{"1min":0.98799999999999999,"5min":1.1200000000000001,"15min":3.7970000000000002},"last":0.82499999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:16:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.45700000000000002,"5min":0.40899999999999997,"15min":0.35599999999999998},"max":{"1min":0.92100000000000004,"5min":0.98199999999999998,"15min":1.099},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42799999999999999},"max":{"1min":0.84799999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80100000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81100000000000005,"15min":0.82099999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.995,"5min":1.238,"15min":1.238},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.84199999999999997},"min":{"1min":0.68799999999999994,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.96499999999999997,"5min":1.474,"15min":1.474},"last":0.86499999999999999}]}]},{"osd":6,"up_from":47,"seq":201863463064,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6424,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738728,"statfs":{"total":95995035648,"available":95988457472,"internally_reserved":0,"allocated":999424,"data_stored":482646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47499999999999998,"15min":0.436},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.219},"max":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.497,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.34200000000000003,"15min":0.33000000000000002},"max":{"1min":0.84299999999999997,"5min":0.91900000000000004,"15min":0.96699999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.62},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.33600000000000002},"max":{"1min":0.83899999999999997,"5min":0.875,"15min":0.88700000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.36499999999999999},"max":{"1min":0.80500000000000005,"5min":0.91300000000000003,"15min":0.93000000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.90700000000000003,"5min":1.01,"15min":1.01},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.83299999999999996,"5min":0.85499999999999998,"15min":0.89300000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61399999999999999,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.27800000000000002},"max":{"1min":0.81299999999999994,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.70699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.92800000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77000000000000002,"15min":0.73099999999999998},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.877},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98999999999999999,"5min":1.105,"15min":1.105},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81899999999999995,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.097},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79700000000000004,"15min":0.72699999999999998},"min":{"1min":0.56100000000000005,"5min":0.48099999999999998,"15min":0.42199999999999999},"max":{"1min":0.97399999999999998,"5min":1.105,"15min":1.1140000000000001},"last":0.89900000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81299999999999994,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.137,"15min":1.137},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81599999999999995,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.46300000000000002},"max":{"1min":1.0580000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.78700000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.80200000000000005,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.75},"min":{"1min":0.504,"5min":0.46300000000000002,"15min":0.38600000000000001},"max":{"1min":1.038,"5min":1.151,"15min":1.151},"last":0.83899999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.85899999999999999},"min":{"1min":0.57099999999999995,"5min":0.56499999999999995,"15min":0.55300000000000005},"max":{"1min":1.0569999999999999,"5min":1.125,"15min":1.1419999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.86499999999999999,"15min":0.88},"min":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.53900000000000003},"max":{"1min":1.0229999999999999,"5min":1.171,"15min":1.171},"last":0.94599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7516,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737636,"statfs":{"total":95995035648,"available":95987339264,"internally_reserved":0,"allocated":1069056,"data_stored":546627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59099999999999997,"15min":0.55800000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":4.1100000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63100000000000001,"15min":0.58199999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.27200000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":4.0499999999999998},"last":0.84199999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63200000000000001,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":0.83199999999999996,"5min":1.155,"15min":1.155},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.56100000000000005},"min":{"1min":0.45300000000000001,"5min":0.36699999999999999,"15min":0.24399999999999999},"max":{"1min":0.78900000000000003,"5min":1.044,"15min":1.044},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Mar 17 08:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":0.96999999999999997,"15min":1.05},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68700000000000006,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.83499999999999996,"5min":0.90300000000000002,"15min":1.1319999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.46100000000000002},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.60599999999999998,"5min":0.80700000000000005,"15min":1.135},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.499,"15min":0.46200000000000002},"min":{"1min":0.38,"5min":0.30099999999999999,"15min":0.24099999999999999},"max":{"1min":0.69899999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.376}]},{"osd":5,"last update":"Fri Mar 17 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":0.94399999999999995},"last":0.629},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.64700000000000002},"min":{"1min":0.56599999999999995,"5min":0.44800000000000001,"15min":0.33400000000000002},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72999999999999998,"15min":0.63700000000000001},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.39900000000000002},"max":{"1min":0.92300000000000004,"5min":1.046,"15min":1.046},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69799999999999995,"15min":0.627},"min":{"1min":0.443,"5min":0.44,"15min":0.34599999999999997},"max":{"1min":0.82999999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61499999999999999,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.85699999999999998,"5min":0.93700000000000006,"15min":1.077},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":0.94999999999999996,"5min":1.002,"15min":1.046},"last":0.58199999999999996}]},{"osd":8,"last update":"Fri Mar 17 08:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.74399999999999999},"min":{"1min":0.505,"5min":0.47499999999999998,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":1.004,"15min":1.01},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.752,"15min":0.70799999999999996},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":0.99299999999999999},"last":0.60699999999999998}]},{"osd":9,"last update":"Fri Mar 17 08:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.76600000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.45300000000000001},"max":{"1min":0.97399999999999998,"5min":1.077,"15min":1.167},"last":0.81499999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.77400000000000002},"min":{"1min":0.48899999999999999,"5min":0.44800000000000001,"15min":0.33500000000000002},"max":{"1min":0.91900000000000004,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.745},{"interface":"front","average":{"1min":0.753,"5min":0.748,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.36199999999999999},"max":{"1min":0.89100000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69399999999999995}]},{"osd":11,"last update":"Fri Mar 17 08:16:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86899999999999999,"15min":0.879},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.026},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96499999999999997,"5min":1.012,"15min":1.012},"last":0.79700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738588,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7340,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737812,"statfs":{"total":95995035648,"available":95987519488,"internally_reserved":0,"allocated":1019904,"data_stored":483979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61399999999999999,"15min":0.57699999999999996},"min":{"1min":0.439,"5min":0.39000000000000001,"15min":0.29599999999999999},"max":{"1min":0.88800000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.52800000000000002,"5min":0.45000000000000001,"15min":0.317},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":5.6849999999999996},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.367},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.96999999999999997,"15min":1.4850000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.504},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.67300000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.625},"min":{"1min":0.38,"5min":0.377,"15min":0.35299999999999998},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":1.0029999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.97999999999999998},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.64700000000000002},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.379},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.5820000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40300000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.5329999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.58699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28599999999999998},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":1.0369999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65800000000000003,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.77300000000000002},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.409},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.76000000000000001},"min":{"1min":0.55800000000000005,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.349},"last":0.70699999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.74299999999999999,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1200000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.115,"5min":1.125,"15min":1.133},"last":0.90100000000000002}]},{"osd":10,"last update":"Fri Mar 17 08:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.875},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0589999999999999,"5min":1.1499999999999999,"15min":1.2130000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83099999999999996,"15min":0.85499999999999998},"min":{"1min":0.68400000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.87}]},{"osd":11,"last update":"Fri Mar 17 08:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.81399999999999995},"min":{"1min":0.67400000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0149999999999999,"5min":1.131,"15min":1.425},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.72999999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.1479999999999999,"15min":2.9849999999999999},"last":0.73099999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411527,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7388,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737764,"statfs":{"total":95995035648,"available":95987470336,"internally_reserved":0,"allocated":1003520,"data_stored":484047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.095},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.752,"5min":0.90800000000000003,"15min":1.1639999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.61099999999999999},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri Mar 17 08:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.629},"min":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":0.96799999999999997,"15min":1.181},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.624},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.35099999999999998},"max":{"1min":0.874,"5min":0.94699999999999995,"15min":1.139},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:15:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68500000000000005,"15min":0.69599999999999995},"min":{"1min":0.51300000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85199999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77300000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.1080000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.47599999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.94799999999999995,"15min":1.1890000000000001},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.62},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":0.89200000000000002,"5min":1.02,"15min":1.02},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.51500000000000001,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80100000000000005}]},{"osd":9,"last update":"Fri Mar 17 08:16:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45600000000000002,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.079,"15min":1.1499999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.61299999999999999,"5min":0.49099999999999999,"15min":0.48999999999999999},"max":{"1min":0.91200000000000003,"5min":0.97899999999999998,"15min":1.0820000000000001},"last":0.85799999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.51100000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.64600000000000002,"5min":0.51800000000000002,"15min":0.51200000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.89500000000000002}]},{"osd":11,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99399999999999999,"5min":1.05,"15min":1.05},"last":0.876},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.86899999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6764,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738388,"statfs":{"total":95995035648,"available":95988109312,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.40999999999999998},"min":{"1min":0.36199999999999999,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":0.59699999999999998,"5min":0.753,"15min":0.753},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.42299999999999999},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.222},"max":{"1min":0.624,"5min":0.70199999999999996,"15min":0.76600000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67600000000000005,"15min":0.61499999999999999},"min":{"1min":0.51100000000000001,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":0.81399999999999995,"5min":0.97499999999999998,"15min":1.018},"last":0.629},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75,"5min":0.87,"15min":1.0189999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33100000000000002},"max":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.94299999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.35699999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.67100000000000004,"15min":0.63400000000000001},"min":{"1min":0.52600000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90700000000000003,"5min":0.96399999999999997,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.70999999999999996},"min":{"1min":0.63900000000000001,"5min":0.501,"15min":0.38300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.69499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.34000000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.2250000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.38600000000000001},"max":{"1min":0.94599999999999995,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.64000000000000001},"min":{"1min":0.46200000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.266},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.877,"5min":0.89800000000000002,"15min":0.96299999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.131},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.48999999999999999,"5min":0.46700000000000003,"15min":0.40500000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.88200000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81599999999999995,"15min":0.83699999999999997},"min":{"1min":0.64700000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.75},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66900000000000004,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.012,"5min":1.012,"15min":1.042},"last":0.57999999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76300000000000001,"15min":0.82199999999999995},"min":{"1min":0.58099999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.82599999999999996},"min":{"1min":0.60199999999999998,"5min":0.51700000000000002,"15min":0.46300000000000002},"max":{"1min":0.95599999999999996,"5min":1.042,"15min":1.101},"last":0.81899999999999995}]},{"osd":11,"last update":"Fri Mar 17 08:16:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82699999999999996,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0700000000000001,"5min":1.075,"15min":1.075},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89400000000000002,"15min":0.89200000000000002},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.89900000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888240,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6752,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738400,"statfs":{"total":95995035648,"available":95988121600,"internally_reserved":0,"allocated":1073152,"data_stored":545692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44400000000000001,"15min":0.40999999999999998},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.20399999999999999},"max":{"1min":0.59399999999999997,"5min":0.81100000000000005,"15min":0.82599999999999996},"last":0.316},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.432},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.23999999999999999},"max":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.75800000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64200000000000002,"15min":0.60299999999999998},"min":{"1min":0.45700000000000002,"5min":0.36399999999999999,"15min":0.34999999999999998},"max":{"1min":0.84399999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.61399999999999999},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.35599999999999998},"max":{"1min":0.78500000000000003,"5min":0.86599999999999999,"15min":0.93300000000000005},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.623},"min":{"1min":0.46999999999999997,"5min":0.41199999999999998,"15min":0.33400000000000002},"max":{"1min":0.83599999999999997,"5min":0.88,"15min":0.88},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63100000000000001,"15min":0.60099999999999998},"min":{"1min":0.495,"5min":0.36599999999999999,"15min":0.32900000000000001},"max":{"1min":0.92400000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33800000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.64900000000000002},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.38200000000000001},"max":{"1min":0.83799999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.39800000000000002,"15min":0.36399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.40100000000000002,"5min":0.375,"15min":0.33100000000000002},"max":{"1min":0.90800000000000003,"5min":0.97899999999999998,"15min":1.0389999999999999},"last":0.378},{"interface":"front","average":{"1min":0.745,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.41899999999999998,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.006,"15min":1.006},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Mar 17 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72899999999999998,"15min":0.70199999999999996},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.99199999999999999,"15min":1.012},"last":0.54500000000000004}]},{"osd":9,"last update":"Fri Mar 17 08:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.81599999999999995,"15min":0.78000000000000003},"min":{"1min":0.66300000000000003,"5min":0.51100000000000001,"15min":0.48999999999999999},"max":{"1min":1.026,"5min":1.091,"15min":1.091},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78800000000000003,"15min":0.76800000000000002},"min":{"1min":0.65100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97999999999999998,"5min":1.044,"15min":1.044},"last":0.505}]},{"osd":10,"last update":"Fri Mar 17 08:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.63100000000000001,"5min":0.495,"15min":0.44500000000000001},"max":{"1min":0.98699999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0029999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.41199999999999998}]},{"osd":11,"last update":"Fri Mar 17 08:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.026,"15min":1.026},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60199999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724709,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7224,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737928,"statfs":{"total":95995035648,"available":95987638272,"internally_reserved":0,"allocated":1622016,"data_stored":1075444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.56000000000000005},"min":{"1min":0.44,"5min":0.377,"15min":0.29199999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.57699999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.28699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.56100000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.28100000000000003},"max":{"1min":0.755,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.63400000000000001,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46800000000000003,"15min":0.43099999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.249},"max":{"1min":0.71599999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.372},{"interface":"front","average":{"1min":0.439,"5min":0.46999999999999997,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64300000000000002,"15min":0.60899999999999999},"min":{"1min":0.499,"5min":0.44900000000000001,"15min":0.32300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0549999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68200000000000005,"15min":0.624},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.63300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.85399999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71199999999999997,"15min":0.66700000000000004},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.33700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0580000000000001,"15min":5.1669999999999998},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.64300000000000002},"min":{"1min":0.52900000000000003,"5min":0.42399999999999999,"15min":0.39500000000000002},"max":{"1min":0.91100000000000003,"5min":0.996,"15min":1.0940000000000001},"last":0.626}]},{"osd":7,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73799999999999999,"15min":0.65500000000000003},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.39200000000000002},"max":{"1min":0.85799999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.505},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.65400000000000003},"min":{"1min":0.56599999999999995,"5min":0.46100000000000002,"15min":0.36499999999999999},"max":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48399999999999999}]},{"osd":8,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.42599999999999999,"15min":0.32900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53500000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.38500000000000001},"max":{"1min":0.99099999999999999,"5min":1.099,"15min":1.099},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":1.117,"15min":1.151},"last":0.755}]},{"osd":10,"last update":"Fri Mar 17 08:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78700000000000003,"15min":0.71999999999999997},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.39400000000000002},"max":{"1min":0.97199999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79500000000000004,"15min":0.745},"min":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.46300000000000002},"max":{"1min":0.94299999999999995,"5min":1.0149999999999999,"15min":1.129},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:17:25.173 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-17T08:17:26.345 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:16 smithi078 ceph-mon[94114]: pgmap v997: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:26.346 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:18 smithi078 ceph-mon[94114]: pgmap v998: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:27.775 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:20 smithi078 ceph-mon[94114]: pgmap v999: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:27.775 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:22 smithi078 ceph-mon[94114]: pgmap v1000: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:27.775 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:24 smithi078 ceph-mon[94114]: pgmap v1001: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:27.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:16 smithi082 ceph-mon[94281]: pgmap v997: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:27.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:18 smithi082 ceph-mon[94281]: pgmap v998: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:27.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:20 smithi082 ceph-mon[94281]: pgmap v999: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:27.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:22 smithi082 ceph-mon[94281]: pgmap v1000: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:27.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:24 smithi082 ceph-mon[94281]: pgmap v1001: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:27.777 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:26 smithi078 ceph-mon[94114]: pgmap v1002: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:28.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:26 smithi082 ceph-mon[94281]: pgmap v1002: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:28.905 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:53 smithi035 ceph-mon[92535]: pgmap v986: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:55 smithi035 ceph-mon[92535]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:56 smithi035 ceph-mon[92535]: pgmap v987: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:16:58 smithi035 ceph-mon[92535]: pgmap v988: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:00 smithi035 ceph-mon[92535]: pgmap v989: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:02 smithi035 ceph-mon[92535]: pgmap v990: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:04 smithi035 ceph-mon[92535]: pgmap v991: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:06 smithi035 ceph-mon[92535]: pgmap v992: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:08 smithi035 ceph-mon[92535]: pgmap v993: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:10 smithi035 ceph-mon[92535]: pgmap v994: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:12 smithi035 ceph-mon[92535]: pgmap v995: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:14 smithi035 ceph-mon[92535]: pgmap v996: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:16 smithi035 ceph-mon[92535]: pgmap v997: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:30.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:18 smithi035 ceph-mon[92535]: pgmap v998: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:30.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:20 smithi035 ceph-mon[92535]: pgmap v999: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:30.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:22 smithi035 ceph-mon[92535]: pgmap v1000: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:30.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:24 smithi035 ceph-mon[92535]: pgmap v1001: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:33.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:26 smithi035 ceph-mon[92535]: pgmap v1002: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:33.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:28 smithi078 ceph-mon[94114]: pgmap v1003: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:33.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:29 smithi078 ceph-mon[94114]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:17:33.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:30 smithi078 ceph-mon[94114]: pgmap v1004: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:35.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:32 smithi078 ceph-mon[94114]: pgmap v1005: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:35.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:28 smithi082 ceph-mon[94281]: pgmap v1003: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:35.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:29 smithi082 ceph-mon[94281]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:17:35.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:30 smithi082 ceph-mon[94281]: pgmap v1004: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:35.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:32 smithi082 ceph-mon[94281]: pgmap v1005: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:35.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:34 smithi078 ceph-mon[94114]: pgmap v1006: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:35.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:34 smithi082 ceph-mon[94281]: pgmap v1006: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:35.270 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 -- 172.21.15.35:0/2012484670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c0ffcf0 msgr2=0x7f8b2c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:37.253 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 --2- 172.21.15.35:0/2012484670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c0ffcf0 0x7f8b2c1075c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400b0a0 tx=0x7f8b2400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 -- 172.21.15.35:0/2012484670 shutdown_connections 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 --2- 172.21.15.35:0/2012484670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c0ffcf0 0x7f8b2c1075c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 --2- 172.21.15.35:0/2012484670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2c100630 0x7f8b2c100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 --2- 172.21.15.35:0/2012484670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0ff360 0x7f8b2c0ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.915+0000 7f8b338df700 1 -- 172.21.15.35:0/2012484670 >> 172.21.15.35:0/2012484670 conn(0x7f8b2c0f9e40 msgr2=0x7f8b2c0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 -- 172.21.15.35:0/2012484670 shutdown_connections 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 -- 172.21.15.35:0/2012484670 wait complete. 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 Processor -- start 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 -- start start 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0ff360 0x7f8b2c198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2c0ffcf0 0x7f8b2c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 0x7f8b2c19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:37.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c19fcc0 con 0x7f8b2c100630 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c19fe00 con 0x7f8b2c0ff360 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b338df700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c19ff90 con 0x7f8b2c0ffcf0 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b31e7c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 0x7f8b2c19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b31e7c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 0x7f8b2c19f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40262/0 (socket says 172.21.15.35:40262) 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.916+0000 7f8b31e7c700 1 -- 172.21.15.35:0/378508127 learned_addr learned my addr 172.21.15.35:0/378508127 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b30e7a700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2c0ffcf0 0x7f8b2c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b3167b700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0ff360 0x7f8b2c198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b31e7c700 1 -- 172.21.15.35:0/378508127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2c0ffcf0 msgr2=0x7f8b2c198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b31e7c700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2c0ffcf0 0x7f8b2c198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b31e7c700 1 -- 172.21.15.35:0/378508127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0ff360 msgr2=0x7f8b2c198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b31e7c700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0ff360 0x7f8b2c198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b31e7c700 1 -- 172.21.15.35:0/378508127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009d00 con 0x7f8b2c100630 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b31e7c700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 0x7f8b2c19f6f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8b240062a0 tx=0x7f8b24004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400e040 con 0x7f8b2c100630 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b2401db20 con 0x7f8b2c100630 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c10a8a0 con 0x7f8b2c100630 2023-03-17T08:17:37.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2401bac0 con 0x7f8b2c100630 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.917+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c10a710 con 0x7f8b2c100630 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.918+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c0670e0 con 0x7f8b2c100630 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.919+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 17) v1 ==== 133312+0+0 (secure 0 0 0) 0x7f8b2401dc90 con 0x7f8b2c100630 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.920+0000 7f8b1e7fc700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8b1809f560 0x7f8b180a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.920+0000 7f8b3167b700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8b1809f560 0x7f8b180a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.920+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f8b240cc600 con 0x7f8b2c100630 2023-03-17T08:17:37.256 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.921+0000 7f8b3167b700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8b1809f560 0x7f8b180a1a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c067ad0 tx=0x7f8b20007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:17:37.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:27.923+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f8b24096620 con 0x7f8b2c100630 2023-03-17T08:17:37.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.119+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b2c1a09b0 con 0x7f8b1809f560 2023-03-17T08:17:37.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.132+0000 7f8b1e7fc700 1 -- 172.21.15.35:0/378508127 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344548 (secure 0 0 0) 0x7f8b2c1a09b0 con 0x7f8b1809f560 2023-03-17T08:17:37.981 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:36 smithi078 ceph-mon[94114]: pgmap v1007: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:37.981 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:36 smithi082 ceph-mon[94281]: pgmap v1007: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:37.984 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:17:39.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:38 smithi078 ceph-mon[94114]: pgmap v1008: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:42.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:38 smithi082 ceph-mon[94281]: pgmap v1008: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:42.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8b1809f560 msgr2=0x7f8b180a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:42.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8b1809f560 0x7f8b180a1a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c067ad0 tx=0x7f8b20007400 comp rx=0 tx=0).stop 2023-03-17T08:17:42.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 msgr2=0x7f8b2c19f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:17:42.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 0x7f8b2c19f6f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8b240062a0 tx=0x7f8b24004d00 comp rx=0 tx=0).stop 2023-03-17T08:17:42.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 shutdown_connections 2023-03-17T08:17:42.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8b1809f560 0x7f8b180a1a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:42.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8b2c100630 0x7f8b2c19f6f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:42.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0ff360 0x7f8b2c198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:42.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 --2- 172.21.15.35:0/378508127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b2c0ffcf0 0x7f8b2c198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:17:42.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 >> 172.21.15.35:0/378508127 conn(0x7f8b2c0f9e40 msgr2=0x7f8b2c0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:17:43.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 shutdown_connections 2023-03-17T08:17:43.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:28.135+0000 7f8b338df700 1 -- 172.21.15.35:0/378508127 wait complete. 2023-03-17T08:17:44.301 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:17:44.302 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":1003,"stamp":"2023-03-17T08:17:26.595331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660425,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1561,"num_read_kb":908,"num_write":430,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":82720,"kb_used_data":13824,"kb_used_omap":0,"kb_used_meta":68800,"kb_avail":1124859104,"statfs":{"total":1151940427776,"available":1151855722496,"internally_reserved":0,"allocated":14155776,"data_stored":7764985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70451200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004002"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:01.781628+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:15:01.781628+0000","last_peered":"2023-03-17T08:15:01.781628+0000","last_clean":"2023-03-17T08:15:01.781628+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:15:01.781628+0000","last_undegraded":"2023-03-17T08:15:01.781628+0000","last_fullsized":"2023-03-17T08:15:01.781628+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:05.236672+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:15:05.236672+0000","last_peered":"2023-03-17T08:15:05.236672+0000","last_clean":"2023-03-17T08:15:05.236672+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:15:05.236672+0000","last_undegraded":"2023-03-17T08:15:05.236672+0000","last_fullsized":"2023-03-17T08:15:05.236672+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:05.236643+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:15:05.236643+0000","last_peered":"2023-03-17T08:15:05.236643+0000","last_clean":"2023-03-17T08:15:05.236643+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:15:05.236643+0000","last_undegraded":"2023-03-17T08:15:05.236643+0000","last_fullsized":"2023-03-17T08:15:05.236643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:56.082379+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:14:56.082379+0000","last_peered":"2023-03-17T08:14:56.082379+0000","last_clean":"2023-03-17T08:14:56.082379+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:14:56.082379+0000","last_undegraded":"2023-03-17T08:14:56.082379+0000","last_fullsized":"2023-03-17T08:14:56.082379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309560+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:13:43.309560+0000","last_peered":"2023-03-17T08:13:43.309560+0000","last_clean":"2023-03-17T08:13:43.309560+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:13:43.309560+0000","last_undegraded":"2023-03-17T08:13:43.309560+0000","last_fullsized":"2023-03-17T08:13:43.309560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309263+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:13:43.309263+0000","last_peered":"2023-03-17T08:13:43.309263+0000","last_clean":"2023-03-17T08:13:43.309263+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:13:43.309263+0000","last_undegraded":"2023-03-17T08:13:43.309263+0000","last_fullsized":"2023-03-17T08:13:43.309263+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438818+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:13:43.438818+0000","last_peered":"2023-03-17T08:13:43.438818+0000","last_clean":"2023-03-17T08:13:43.438818+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:13:43.438818+0000","last_undegraded":"2023-03-17T08:13:43.438818+0000","last_fullsized":"2023-03-17T08:13:43.438818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.310602+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:13:43.310602+0000","last_peered":"2023-03-17T08:13:43.310602+0000","last_clean":"2023-03-17T08:13:43.310602+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:13:43.310602+0000","last_undegraded":"2023-03-17T08:13:43.310602+0000","last_fullsized":"2023-03-17T08:13:43.310602+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308663+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:13:43.308663+0000","last_peered":"2023-03-17T08:13:43.308663+0000","last_clean":"2023-03-17T08:13:43.308663+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:13:43.308663+0000","last_undegraded":"2023-03-17T08:13:43.308663+0000","last_fullsized":"2023-03-17T08:13:43.308663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309595+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:13:43.309595+0000","last_peered":"2023-03-17T08:13:43.309595+0000","last_clean":"2023-03-17T08:13:43.309595+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:13:43.309595+0000","last_undegraded":"2023-03-17T08:13:43.309595+0000","last_fullsized":"2023-03-17T08:13:43.309595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439161+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:13:43.439161+0000","last_peered":"2023-03-17T08:13:43.439161+0000","last_clean":"2023-03-17T08:13:43.439161+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:13:43.439161+0000","last_undegraded":"2023-03-17T08:13:43.439161+0000","last_fullsized":"2023-03-17T08:13:43.439161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:44.701054+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:13:44.701054+0000","last_peered":"2023-03-17T08:13:44.701054+0000","last_clean":"2023-03-17T08:13:44.701054+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:13:44.701054+0000","last_undegraded":"2023-03-17T08:13:44.701054+0000","last_fullsized":"2023-03-17T08:13:44.701054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439372+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:13:43.439372+0000","last_peered":"2023-03-17T08:13:43.439372+0000","last_clean":"2023-03-17T08:13:43.439372+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:13:43.439372+0000","last_undegraded":"2023-03-17T08:13:43.439372+0000","last_fullsized":"2023-03-17T08:13:43.439372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453347+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:13:43.453347+0000","last_peered":"2023-03-17T08:13:43.453347+0000","last_clean":"2023-03-17T08:13:43.453347+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:13:43.453347+0000","last_undegraded":"2023-03-17T08:13:43.453347+0000","last_fullsized":"2023-03-17T08:13:43.453347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453290+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:13:43.453290+0000","last_peered":"2023-03-17T08:13:43.453290+0000","last_clean":"2023-03-17T08:13:43.453290+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:13:43.453290+0000","last_undegraded":"2023-03-17T08:13:43.453290+0000","last_fullsized":"2023-03-17T08:13:43.453290+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.307662+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:13:43.307662+0000","last_peered":"2023-03-17T08:13:43.307662+0000","last_clean":"2023-03-17T08:13:43.307662+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:13:43.307662+0000","last_undegraded":"2023-03-17T08:13:43.307662+0000","last_fullsized":"2023-03-17T08:13:43.307662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308665+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:13:43.308665+0000","last_peered":"2023-03-17T08:13:43.308665+0000","last_clean":"2023-03-17T08:13:43.308665+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:13:43.308665+0000","last_undegraded":"2023-03-17T08:13:43.308665+0000","last_fullsized":"2023-03-17T08:13:43.308665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.307076+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:13:43.307076+0000","last_peered":"2023-03-17T08:13:43.307076+0000","last_clean":"2023-03-17T08:13:43.307076+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:13:43.307076+0000","last_undegraded":"2023-03-17T08:13:43.307076+0000","last_fullsized":"2023-03-17T08:13:43.307076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306775+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:13:43.306775+0000","last_peered":"2023-03-17T08:13:43.306775+0000","last_clean":"2023-03-17T08:13:43.306775+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:13:43.306775+0000","last_undegraded":"2023-03-17T08:13:43.306775+0000","last_fullsized":"2023-03-17T08:13:43.306775+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":172,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:23.522625+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:17:23.522625+0000","last_peered":"2023-03-17T08:17:23.522625+0000","last_clean":"2023-03-17T08:17:23.522625+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:17:23.522625+0000","last_undegraded":"2023-03-17T08:17:23.522625+0000","last_fullsized":"2023-03-17T08:17:23.522625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:59.439216+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:14:59.439216+0000","last_peered":"2023-03-17T08:14:59.439216+0000","last_clean":"2023-03-17T08:14:59.439216+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:14:59.439216+0000","last_undegraded":"2023-03-17T08:14:59.439216+0000","last_fullsized":"2023-03-17T08:14:59.439216+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:46.410079+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:14:46.410079+0000","last_peered":"2023-03-17T08:14:46.410079+0000","last_clean":"2023-03-17T08:14:46.410079+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:14:46.410079+0000","last_undegraded":"2023-03-17T08:14:46.410079+0000","last_fullsized":"2023-03-17T08:14:46.410079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:05.236729+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:15:05.236729+0000","last_peered":"2023-03-17T08:15:05.236729+0000","last_clean":"2023-03-17T08:15:05.236729+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:15:05.236729+0000","last_undegraded":"2023-03-17T08:15:05.236729+0000","last_fullsized":"2023-03-17T08:15:05.236729+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.325754+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:15:06.325754+0000","last_peered":"2023-03-17T08:15:06.325754+0000","last_clean":"2023-03-17T08:15:06.325754+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:15:06.325754+0000","last_undegraded":"2023-03-17T08:15:06.325754+0000","last_fullsized":"2023-03-17T08:15:06.325754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308048+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:13:43.308048+0000","last_peered":"2023-03-17T08:13:43.308048+0000","last_clean":"2023-03-17T08:13:43.308048+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:13:43.308048+0000","last_undegraded":"2023-03-17T08:13:43.308048+0000","last_fullsized":"2023-03-17T08:13:43.308048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.329356+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:15:06.329356+0000","last_peered":"2023-03-17T08:15:06.329356+0000","last_clean":"2023-03-17T08:15:06.329356+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:15:06.329356+0000","last_undegraded":"2023-03-17T08:15:06.329356+0000","last_fullsized":"2023-03-17T08:15:06.329356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.312515+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:13:43.312515+0000","last_peered":"2023-03-17T08:13:43.312515+0000","last_clean":"2023-03-17T08:13:43.312515+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:13:43.312515+0000","last_undegraded":"2023-03-17T08:13:43.312515+0000","last_fullsized":"2023-03-17T08:13:43.312515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":165,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:22.521858+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:17:22.521858+0000","last_peered":"2023-03-17T08:17:22.521858+0000","last_clean":"2023-03-17T08:17:22.521858+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:17:22.521858+0000","last_undegraded":"2023-03-17T08:17:22.521858+0000","last_fullsized":"2023-03-17T08:17:22.521858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309472+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:13:43.309472+0000","last_peered":"2023-03-17T08:13:43.309472+0000","last_clean":"2023-03-17T08:13:43.309472+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:13:43.309472+0000","last_undegraded":"2023-03-17T08:13:43.309472+0000","last_fullsized":"2023-03-17T08:13:43.309472+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:47.419241+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:14:47.419241+0000","last_peered":"2023-03-17T08:14:47.419241+0000","last_clean":"2023-03-17T08:14:47.419241+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:14:47.419241+0000","last_undegraded":"2023-03-17T08:14:47.419241+0000","last_fullsized":"2023-03-17T08:14:47.419241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.312289+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:13:43.312289+0000","last_peered":"2023-03-17T08:13:43.312289+0000","last_clean":"2023-03-17T08:13:43.312289+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:13:43.312289+0000","last_undegraded":"2023-03-17T08:13:43.312289+0000","last_fullsized":"2023-03-17T08:13:43.312289+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.427112+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:14:48.427112+0000","last_peered":"2023-03-17T08:14:48.427112+0000","last_clean":"2023-03-17T08:14:48.427112+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:14:48.427112+0000","last_undegraded":"2023-03-17T08:14:48.427112+0000","last_fullsized":"2023-03-17T08:14:48.427112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.310661+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:13:43.310661+0000","last_peered":"2023-03-17T08:13:43.310661+0000","last_clean":"2023-03-17T08:13:43.310661+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:13:43.310661+0000","last_undegraded":"2023-03-17T08:13:43.310661+0000","last_fullsized":"2023-03-17T08:13:43.310661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.330442+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:15:06.330442+0000","last_peered":"2023-03-17T08:15:06.330442+0000","last_clean":"2023-03-17T08:15:06.330442+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:15:06.330442+0000","last_undegraded":"2023-03-17T08:15:06.330442+0000","last_fullsized":"2023-03-17T08:15:06.330442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.306709+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:13:43.306709+0000","last_peered":"2023-03-17T08:13:43.306709+0000","last_clean":"2023-03-17T08:13:43.306709+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:13:43.306709+0000","last_undegraded":"2023-03-17T08:13:43.306709+0000","last_fullsized":"2023-03-17T08:13:43.306709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'5","reported_seq":299,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:23.522659+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:17:23.522659+0000","last_peered":"2023-03-17T08:17:23.522659+0000","last_clean":"2023-03-17T08:17:23.522659+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:17:23.522659+0000","last_undegraded":"2023-03-17T08:17:23.522659+0000","last_fullsized":"2023-03-17T08:17:23.522659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":276,"num_read_kb":276,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308140+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:13:43.308140+0000","last_peered":"2023-03-17T08:13:43.308140+0000","last_clean":"2023-03-17T08:13:43.308140+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:13:43.308140+0000","last_undegraded":"2023-03-17T08:13:43.308140+0000","last_fullsized":"2023-03-17T08:13:43.308140+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.428002+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:14:48.428002+0000","last_peered":"2023-03-17T08:14:48.428002+0000","last_clean":"2023-03-17T08:14:48.428002+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:14:48.428002+0000","last_undegraded":"2023-03-17T08:14:48.428002+0000","last_fullsized":"2023-03-17T08:14:48.428002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.453758+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:13:43.453758+0000","last_peered":"2023-03-17T08:13:43.453758+0000","last_clean":"2023-03-17T08:13:43.453758+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:13:43.453758+0000","last_undegraded":"2023-03-17T08:13:43.453758+0000","last_fullsized":"2023-03-17T08:13:43.453758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.329455+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:15:06.329455+0000","last_peered":"2023-03-17T08:15:06.329455+0000","last_clean":"2023-03-17T08:15:06.329455+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:15:06.329455+0000","last_undegraded":"2023-03-17T08:15:06.329455+0000","last_fullsized":"2023-03-17T08:15:06.329455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308161+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:13:43.308161+0000","last_peered":"2023-03-17T08:13:43.308161+0000","last_clean":"2023-03-17T08:13:43.308161+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:13:43.308161+0000","last_undegraded":"2023-03-17T08:13:43.308161+0000","last_fullsized":"2023-03-17T08:13:43.308161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":359,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:23.523147+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:17:23.523147+0000","last_peered":"2023-03-17T08:17:23.523147+0000","last_clean":"2023-03-17T08:17:23.523147+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:17:23.523147+0000","last_undegraded":"2023-03-17T08:17:23.523147+0000","last_fullsized":"2023-03-17T08:17:23.523147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62801,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":204,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.309968+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:13:43.309968+0000","last_peered":"2023-03-17T08:13:43.309968+0000","last_clean":"2023-03-17T08:13:43.309968+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:13:43.309968+0000","last_undegraded":"2023-03-17T08:13:43.309968+0000","last_fullsized":"2023-03-17T08:13:43.309968+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.327880+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:15:06.327880+0000","last_peered":"2023-03-17T08:15:06.327880+0000","last_clean":"2023-03-17T08:15:06.327880+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:15:06.327880+0000","last_undegraded":"2023-03-17T08:15:06.327880+0000","last_fullsized":"2023-03-17T08:15:06.327880+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439286+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:13:43.439286+0000","last_peered":"2023-03-17T08:13:43.439286+0000","last_clean":"2023-03-17T08:13:43.439286+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:13:43.439286+0000","last_undegraded":"2023-03-17T08:13:43.439286+0000","last_fullsized":"2023-03-17T08:13:43.439286+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.325733+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:15:06.325733+0000","last_peered":"2023-03-17T08:15:06.325733+0000","last_clean":"2023-03-17T08:15:06.325733+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:15:06.325733+0000","last_undegraded":"2023-03-17T08:15:06.325733+0000","last_fullsized":"2023-03-17T08:15:06.325733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439057+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:13:43.439057+0000","last_peered":"2023-03-17T08:13:43.439057+0000","last_clean":"2023-03-17T08:13:43.439057+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:13:43.439057+0000","last_undegraded":"2023-03-17T08:13:43.439057+0000","last_fullsized":"2023-03-17T08:13:43.439057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'6","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:25.526177+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:17:25.526177+0000","last_peered":"2023-03-17T08:17:25.526177+0000","last_clean":"2023-03-17T08:17:25.526177+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:17:25.526177+0000","last_undegraded":"2023-03-17T08:17:25.526177+0000","last_fullsized":"2023-03-17T08:17:25.526177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":144,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438709+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:13:43.438709+0000","last_peered":"2023-03-17T08:13:43.438709+0000","last_clean":"2023-03-17T08:13:43.438709+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:13:43.438709+0000","last_undegraded":"2023-03-17T08:13:43.438709+0000","last_fullsized":"2023-03-17T08:13:43.438709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.328070+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:15:06.328070+0000","last_peered":"2023-03-17T08:15:06.328070+0000","last_clean":"2023-03-17T08:15:06.328070+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:15:06.328070+0000","last_undegraded":"2023-03-17T08:15:06.328070+0000","last_fullsized":"2023-03-17T08:15:06.328070+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:44.701030+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:13:44.701030+0000","last_peered":"2023-03-17T08:13:44.701030+0000","last_clean":"2023-03-17T08:13:44.701030+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:13:44.701030+0000","last_undegraded":"2023-03-17T08:13:44.701030+0000","last_fullsized":"2023-03-17T08:13:44.701030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.327915+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:15:06.327915+0000","last_peered":"2023-03-17T08:15:06.327915+0000","last_clean":"2023-03-17T08:15:06.327915+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:15:06.327915+0000","last_undegraded":"2023-03-17T08:15:06.327915+0000","last_fullsized":"2023-03-17T08:15:06.327915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308626+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:13:43.308626+0000","last_peered":"2023-03-17T08:13:43.308626+0000","last_clean":"2023-03-17T08:13:43.308626+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:13:43.308626+0000","last_undegraded":"2023-03-17T08:13:43.308626+0000","last_fullsized":"2023-03-17T08:13:43.308626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:49.707597+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:14:49.707597+0000","last_peered":"2023-03-17T08:14:49.707597+0000","last_clean":"2023-03-17T08:14:49.707597+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:14:49.707597+0000","last_undegraded":"2023-03-17T08:14:49.707597+0000","last_fullsized":"2023-03-17T08:14:49.707597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'1","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:56.338477+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:15:56.338477+0000","last_peered":"2023-03-17T08:15:56.338477+0000","last_clean":"2023-03-17T08:15:56.338477+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:15:56.338477+0000","last_undegraded":"2023-03-17T08:15:56.338477+0000","last_fullsized":"2023-03-17T08:15:56.338477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":162,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:21.520121+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:17:21.520121+0000","last_peered":"2023-03-17T08:17:21.520121+0000","last_clean":"2023-03-17T08:17:21.520121+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:17:21.520121+0000","last_undegraded":"2023-03-17T08:17:21.520121+0000","last_fullsized":"2023-03-17T08:17:21.520121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.337681+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:15:04.337681+0000","last_peered":"2023-03-17T08:15:04.337681+0000","last_clean":"2023-03-17T08:15:04.337681+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:15:04.337681+0000","last_undegraded":"2023-03-17T08:15:04.337681+0000","last_fullsized":"2023-03-17T08:15:04.337681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:59.324103+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:14:59.324103+0000","last_peered":"2023-03-17T08:14:59.324103+0000","last_clean":"2023-03-17T08:14:59.324103+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:14:59.324103+0000","last_undegraded":"2023-03-17T08:14:59.324103+0000","last_fullsized":"2023-03-17T08:14:59.324103+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:22.521053+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:17:22.521053+0000","last_peered":"2023-03-17T08:17:22.521053+0000","last_clean":"2023-03-17T08:17:22.521053+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:17:22.521053+0000","last_undegraded":"2023-03-17T08:17:22.521053+0000","last_fullsized":"2023-03-17T08:17:22.521053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.439758+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:15:04.439758+0000","last_peered":"2023-03-17T08:15:04.439758+0000","last_clean":"2023-03-17T08:15:04.439758+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:15:04.439758+0000","last_undegraded":"2023-03-17T08:15:04.439758+0000","last_fullsized":"2023-03-17T08:15:04.439758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.328243+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:15:06.328243+0000","last_peered":"2023-03-17T08:15:06.328243+0000","last_clean":"2023-03-17T08:15:06.328243+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:15:06.328243+0000","last_undegraded":"2023-03-17T08:15:06.328243+0000","last_fullsized":"2023-03-17T08:15:06.328243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.438820+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:13:43.438820+0000","last_peered":"2023-03-17T08:13:43.438820+0000","last_clean":"2023-03-17T08:13:43.438820+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:13:43.438820+0000","last_undegraded":"2023-03-17T08:13:43.438820+0000","last_fullsized":"2023-03-17T08:13:43.438820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.209622+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:15:04.209622+0000","last_peered":"2023-03-17T08:15:04.209622+0000","last_clean":"2023-03-17T08:15:04.209622+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:15:04.209622+0000","last_undegraded":"2023-03-17T08:15:04.209622+0000","last_fullsized":"2023-03-17T08:15:04.209622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:48.427441+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:14:48.427441+0000","last_peered":"2023-03-17T08:14:48.427441+0000","last_clean":"2023-03-17T08:14:48.427441+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:14:48.427441+0000","last_undegraded":"2023-03-17T08:14:48.427441+0000","last_fullsized":"2023-03-17T08:14:48.427441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.326292+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:15:06.326292+0000","last_peered":"2023-03-17T08:15:06.326292+0000","last_clean":"2023-03-17T08:15:06.326292+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:15:06.326292+0000","last_undegraded":"2023-03-17T08:15:06.326292+0000","last_fullsized":"2023-03-17T08:15:06.326292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:04.209733+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:15:04.209733+0000","last_peered":"2023-03-17T08:15:04.209733+0000","last_clean":"2023-03-17T08:15:04.209733+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:15:04.209733+0000","last_undegraded":"2023-03-17T08:15:04.209733+0000","last_fullsized":"2023-03-17T08:15:04.209733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'13","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:16:33.156846+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:16:33.156846+0000","last_peered":"2023-03-17T08:16:33.156846+0000","last_clean":"2023-03-17T08:16:33.156846+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:16:33.156846+0000","last_undegraded":"2023-03-17T08:16:33.156846+0000","last_fullsized":"2023-03-17T08:16:33.156846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:09.440539+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:15:09.440539+0000","last_peered":"2023-03-17T08:15:09.440539+0000","last_clean":"2023-03-17T08:15:09.440539+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:15:09.440539+0000","last_undegraded":"2023-03-17T08:15:09.440539+0000","last_fullsized":"2023-03-17T08:15:09.440539+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.325870+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:15:06.325870+0000","last_peered":"2023-03-17T08:15:06.325870+0000","last_clean":"2023-03-17T08:15:06.325870+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:15:06.325870+0000","last_undegraded":"2023-03-17T08:15:06.325870+0000","last_fullsized":"2023-03-17T08:15:06.325870+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:10.237136+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:15:10.237136+0000","last_peered":"2023-03-17T08:15:10.237136+0000","last_clean":"2023-03-17T08:15:10.237136+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:15:10.237136+0000","last_undegraded":"2023-03-17T08:15:10.237136+0000","last_fullsized":"2023-03-17T08:15:10.237136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:53.309503+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:14:53.309503+0000","last_peered":"2023-03-17T08:14:53.309503+0000","last_clean":"2023-03-17T08:14:53.309503+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:14:53.309503+0000","last_undegraded":"2023-03-17T08:14:53.309503+0000","last_fullsized":"2023-03-17T08:14:53.309503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:09.389942+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:15:09.389942+0000","last_peered":"2023-03-17T08:15:09.389942+0000","last_clean":"2023-03-17T08:15:09.389942+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:15:09.389942+0000","last_undegraded":"2023-03-17T08:15:09.389942+0000","last_fullsized":"2023-03-17T08:15:09.389942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:54.438449+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:14:54.438449+0000","last_peered":"2023-03-17T08:14:54.438449+0000","last_clean":"2023-03-17T08:14:54.438449+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:14:54.438449+0000","last_undegraded":"2023-03-17T08:14:54.438449+0000","last_fullsized":"2023-03-17T08:14:54.438449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.781968+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:15:06.781968+0000","last_peered":"2023-03-17T08:15:06.781968+0000","last_clean":"2023-03-17T08:15:06.781968+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:15:06.781968+0000","last_undegraded":"2023-03-17T08:15:06.781968+0000","last_fullsized":"2023-03-17T08:15:06.781968+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:53.993799+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:14:53.993799+0000","last_peered":"2023-03-17T08:14:53.993799+0000","last_clean":"2023-03-17T08:14:53.993799+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:14:53.993799+0000","last_undegraded":"2023-03-17T08:14:53.993799+0000","last_fullsized":"2023-03-17T08:14:53.993799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.311427+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:13:43.311427+0000","last_peered":"2023-03-17T08:13:43.311427+0000","last_clean":"2023-03-17T08:13:43.311427+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:13:43.311427+0000","last_undegraded":"2023-03-17T08:13:43.311427+0000","last_fullsized":"2023-03-17T08:13:43.311427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.327859+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:15:06.327859+0000","last_peered":"2023-03-17T08:15:06.327859+0000","last_clean":"2023-03-17T08:15:06.327859+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:15:06.327859+0000","last_undegraded":"2023-03-17T08:15:06.327859+0000","last_fullsized":"2023-03-17T08:15:06.327859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:08.224043+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:15:08.224043+0000","last_peered":"2023-03-17T08:15:08.224043+0000","last_clean":"2023-03-17T08:15:08.224043+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:15:08.224043+0000","last_undegraded":"2023-03-17T08:15:08.224043+0000","last_fullsized":"2023-03-17T08:15:08.224043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":164,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:17:22.521712+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:17:22.521712+0000","last_peered":"2023-03-17T08:17:22.521712+0000","last_clean":"2023-03-17T08:17:22.521712+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:17:22.521712+0000","last_undegraded":"2023-03-17T08:17:22.521712+0000","last_fullsized":"2023-03-17T08:17:22.521712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439254+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:13:43.439254+0000","last_peered":"2023-03-17T08:13:43.439254+0000","last_clean":"2023-03-17T08:13:43.439254+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:13:43.439254+0000","last_undegraded":"2023-03-17T08:13:43.439254+0000","last_fullsized":"2023-03-17T08:13:43.439254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.328056+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:15:06.328056+0000","last_peered":"2023-03-17T08:15:06.328056+0000","last_clean":"2023-03-17T08:15:06.328056+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:15:06.328056+0000","last_undegraded":"2023-03-17T08:15:06.328056+0000","last_fullsized":"2023-03-17T08:15:06.328056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'1","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:13.224610+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:15:13.224610+0000","last_peered":"2023-03-17T08:15:13.224610+0000","last_clean":"2023-03-17T08:15:13.224610+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:15:13.224610+0000","last_undegraded":"2023-03-17T08:15:13.224610+0000","last_fullsized":"2023-03-17T08:15:13.224610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:14:59.209162+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:14:59.209162+0000","last_peered":"2023-03-17T08:14:59.209162+0000","last_clean":"2023-03-17T08:14:59.209162+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:14:59.209162+0000","last_undegraded":"2023-03-17T08:14:59.209162+0000","last_fullsized":"2023-03-17T08:14:59.209162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439320+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:13:43.439320+0000","last_peered":"2023-03-17T08:13:43.439320+0000","last_clean":"2023-03-17T08:13:43.439320+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:13:43.439320+0000","last_undegraded":"2023-03-17T08:13:43.439320+0000","last_fullsized":"2023-03-17T08:13:43.439320+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:01.781559+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:15:01.781559+0000","last_peered":"2023-03-17T08:15:01.781559+0000","last_clean":"2023-03-17T08:15:01.781559+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:15:01.781559+0000","last_undegraded":"2023-03-17T08:15:01.781559+0000","last_fullsized":"2023-03-17T08:15:01.781559+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:03.994950+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:15:03.994950+0000","last_peered":"2023-03-17T08:15:03.994950+0000","last_clean":"2023-03-17T08:15:03.994950+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:15:03.994950+0000","last_undegraded":"2023-03-17T08:15:03.994950+0000","last_fullsized":"2023-03-17T08:15:03.994950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:03.995015+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:15:03.995015+0000","last_peered":"2023-03-17T08:15:03.995015+0000","last_clean":"2023-03-17T08:15:03.995015+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:15:03.995015+0000","last_undegraded":"2023-03-17T08:15:03.995015+0000","last_fullsized":"2023-03-17T08:15:03.995015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:05.236619+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:15:05.236619+0000","last_peered":"2023-03-17T08:15:05.236619+0000","last_clean":"2023-03-17T08:15:05.236619+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:15:05.236619+0000","last_undegraded":"2023-03-17T08:15:05.236619+0000","last_fullsized":"2023-03-17T08:15:05.236619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:09.210169+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:15:09.210169+0000","last_peered":"2023-03-17T08:15:09.210169+0000","last_clean":"2023-03-17T08:15:09.210169+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:15:09.210169+0000","last_undegraded":"2023-03-17T08:15:09.210169+0000","last_fullsized":"2023-03-17T08:15:09.210169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:06.782064+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:15:06.782064+0000","last_peered":"2023-03-17T08:15:06.782064+0000","last_clean":"2023-03-17T08:15:06.782064+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:15:06.782064+0000","last_undegraded":"2023-03-17T08:15:06.782064+0000","last_fullsized":"2023-03-17T08:15:06.782064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:08.995503+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:15:08.995503+0000","last_peered":"2023-03-17T08:15:08.995503+0000","last_clean":"2023-03-17T08:15:08.995503+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:15:08.995503+0000","last_undegraded":"2023-03-17T08:15:08.995503+0000","last_fullsized":"2023-03-17T08:15:08.995503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:09.440500+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:15:09.440500+0000","last_peered":"2023-03-17T08:15:09.440500+0000","last_clean":"2023-03-17T08:15:09.440500+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:15:09.440500+0000","last_undegraded":"2023-03-17T08:15:09.440500+0000","last_fullsized":"2023-03-17T08:15:09.440500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:15:09.325092+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:15:09.325092+0000","last_peered":"2023-03-17T08:15:09.325092+0000","last_clean":"2023-03-17T08:15:09.325092+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:15:09.325092+0000","last_undegraded":"2023-03-17T08:15:09.325092+0000","last_fullsized":"2023-03-17T08:15:09.325092+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.310730+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:13:43.310730+0000","last_peered":"2023-03-17T08:13:43.310730+0000","last_clean":"2023-03-17T08:13:43.310730+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:13:43.310730+0000","last_undegraded":"2023-03-17T08:13:43.310730+0000","last_fullsized":"2023-03-17T08:13:43.310730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.307954+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:13:43.307954+0000","last_peered":"2023-03-17T08:13:43.307954+0000","last_clean":"2023-03-17T08:13:43.307954+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:13:43.307954+0000","last_undegraded":"2023-03-17T08:13:43.307954+0000","last_fullsized":"2023-03-17T08:13:43.307954+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.439322+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:13:43.439322+0000","last_peered":"2023-03-17T08:13:43.439322+0000","last_clean":"2023-03-17T08:13:43.439322+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:13:43.439322+0000","last_undegraded":"2023-03-17T08:13:43.439322+0000","last_fullsized":"2023-03-17T08:13:43.439322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:13:43.308473+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:13:43.308473+0000","last_peered":"2023-03-17T08:13:43.308473+0000","last_clean":"2023-03-17T08:13:43.308473+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:13:43.308473+0000","last_undegraded":"2023-03-17T08:13:43.308473+0000","last_fullsized":"2023-03-17T08:13:43.308473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69811,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1425,"num_read_kb":789,"num_write":247,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351081,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6176,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93738976,"statfs":{"total":95995035648,"available":95988711424,"internally_reserved":0,"allocated":1007616,"data_stored":483356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":0.878},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.73499999999999999,"5min":0.876,"15min":0.876},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.64600000000000002},"min":{"1min":0.50700000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":0.92800000000000005,"15min":0.96699999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.46700000000000003,"5min":0.371,"15min":0.35499999999999998},"max":{"1min":0.84199999999999997,"5min":0.84999999999999998,"15min":1.1439999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.754,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59199999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65700000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81899999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.68500000000000005},"min":{"1min":0.59099999999999997,"5min":0.438,"15min":0.42299999999999999},"max":{"1min":0.98599999999999999,"5min":0.997,"15min":1.0169999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67700000000000005,"15min":0.64000000000000001},"min":{"1min":0.48599999999999999,"5min":0.46200000000000002,"15min":0.42299999999999999},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60499999999999998,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.38,"15min":0.33400000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":1.1160000000000001},"last":0.754},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65600000000000003,"15min":0.63400000000000001},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.59499999999999997,"5min":0.52500000000000002,"15min":0.499},"max":{"1min":1.0389999999999999,"5min":1.0489999999999999,"15min":1.2849999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73099999999999998,"15min":0.72599999999999998},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":0.95399999999999996,"15min":1.0740000000000001},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.73499999999999999},"min":{"1min":0.48999999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.69999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92800000000000005,"5min":1.004,"15min":1.004},"last":0.628}]},{"osd":9,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92800000000000005,"5min":1.002,"15min":1.3879999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81899999999999995,"15min":0.79800000000000004},"min":{"1min":0.67900000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.014,"5min":1.071,"15min":1.238},"last":0.81200000000000006}]},{"osd":10,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96699999999999997,"5min":1.0289999999999999,"15min":1.194},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.76900000000000002,"15min":0.79500000000000004},"min":{"1min":0.622,"5min":0.56699999999999995,"15min":0.51100000000000001},"max":{"1min":0.95599999999999996,"5min":0.97599999999999998,"15min":1.415},"last":0.83799999999999997}]}]},{"osd":10,"up_from":73,"seq":313532612723,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7168,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93737984,"statfs":{"total":95995035648,"available":95987695616,"internally_reserved":0,"allocated":1695744,"data_stored":1137161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72399999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44,"15min":0.45500000000000002},"min":{"1min":0.315,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":0.67900000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46300000000000002,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26200000000000001},"max":{"1min":0.65700000000000003,"5min":0.69199999999999995,"15min":0.80900000000000005},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77000000000000002,"5min":0.878,"15min":0.91200000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.438,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81999999999999995,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.623,"15min":0.66400000000000003},"min":{"1min":0.48399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77900000000000003,"5min":0.91000000000000003,"15min":0.92200000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.46999999999999997,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":0.88600000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54200000000000004,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.83499999999999996,"15min":0.89200000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91700000000000004,"5min":1.117,"15min":1.117},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.47499999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.877,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70899999999999996,"15min":0.75900000000000001},"min":{"1min":0.51300000000000001,"5min":0.47299999999999998,"15min":0.41699999999999998},"max":{"1min":0.86399999999999999,"5min":0.93899999999999995,"15min":1.024},"last":0.498},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.752},"min":{"1min":0.503,"5min":0.48499999999999999,"15min":0.38900000000000001},"max":{"1min":0.90900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74199999999999999,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.49099999999999999},"max":{"1min":0.94599999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70399999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.754,"15min":0.80100000000000005},"min":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.503},"max":{"1min":0.97199999999999998,"5min":1.0189999999999999,"15min":1.026},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.81799999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.45300000000000001},"max":{"1min":0.92700000000000005,"5min":1.056,"15min":1.1699999999999999},"last":0.72499999999999998}]},{"osd":11,"last update":"Fri Mar 17 08:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77900000000000003,"15min":0.78800000000000003},"min":{"1min":0.64100000000000001,"5min":0.50700000000000001,"15min":0.48299999999999998},"max":{"1min":0.91700000000000004,"5min":0.999,"15min":1.026},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79400000000000004,"15min":0.80100000000000005},"min":{"1min":0.60199999999999998,"5min":0.55500000000000005,"15min":0.51600000000000001},"max":{"1min":0.96599999999999997,"5min":1.093,"15min":1.093},"last":0.75900000000000001}]}]},{"osd":9,"up_from":68,"seq":292057776254,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6316,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93738836,"statfs":{"total":95995035648,"available":95988568064,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48899999999999999,"15min":0.47399999999999998},"min":{"1min":0.36499999999999999,"5min":0.28000000000000003,"15min":0.27600000000000002},"max":{"1min":0.625,"5min":0.77700000000000002,"15min":0.79600000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33500000000000002},"max":{"1min":0.85699999999999998,"5min":0.877,"15min":0.877},"last":0.34100000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.46700000000000003,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":1.1899999999999999,"15min":1.246},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80700000000000005,"5min":1.1180000000000001,"15min":1.22},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65100000000000002,"15min":0.67000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77200000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.57799999999999996,"5min":0.45900000000000002,"15min":0.40899999999999997},"max":{"1min":0.85899999999999999,"5min":0.97999999999999998,"15min":1.03},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.29899999999999999},"max":{"1min":0.68200000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.378},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.32500000000000001},"max":{"1min":0.72799999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.438},"max":{"1min":0.95499999999999996,"5min":1.0269999999999999,"15min":1.0660000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.505,"5min":0.49399999999999999,"15min":0.40600000000000003},"max":{"1min":0.876,"5min":0.98099999999999998,"15min":0.98399999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.41699999999999998},"max":{"1min":0.92800000000000005,"5min":1,"15min":1.0760000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":0.745},"min":{"1min":0.53200000000000003,"5min":0.504,"15min":0.45000000000000001},"max":{"1min":0.84999999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65000000000000002,"15min":0.64900000000000002},"min":{"1min":0.45200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.52000000000000002,"5min":0.432,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.49399999999999999,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.306},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77900000000000003,"15min":0.75800000000000001},"min":{"1min":0.51500000000000001,"5min":0.51400000000000001,"15min":0.41599999999999998},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.749}]},{"osd":8,"last update":"Fri Mar 17 08:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.85799999999999998},"min":{"1min":0.66800000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1,"5min":1.0980000000000001,"15min":1.157},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83699999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.51500000000000001},"max":{"1min":1.028,"5min":1.1419999999999999,"15min":1.3380000000000001},"last":0.76200000000000001}]},{"osd":10,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.54300000000000004},"max":{"1min":1.284,"5min":1.284,"15min":1.4179999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81999999999999995,"15min":0.79500000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.46400000000000002},"max":{"1min":0.98599999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.628}]}]},{"osd":8,"up_from":60,"seq":257698037896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6500,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738652,"statfs":{"total":95995035648,"available":95988379648,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.57999999999999996},"min":{"1min":0.373,"5min":0.312,"15min":0.312},"max":{"1min":0.85399999999999998,"5min":1.127,"15min":1.127},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"max":{"1min":0.83699999999999997,"5min":1.113,"15min":1.113},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63200000000000001,"15min":0.59099999999999997},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.32000000000000001},"max":{"1min":0.80300000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66800000000000004,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.47199999999999998},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.79900000000000004,"5min":1.236,"15min":1.236},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.36299999999999999,"5min":0.318,"15min":0.27700000000000002},"max":{"1min":0.81899999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.59999999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86899999999999999,"5min":0.92700000000000005,"15min":1.2729999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.60099999999999998},"min":{"1min":0.434,"5min":0.41399999999999998,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":1.387,"15min":1.387},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.35799999999999998,"5min":0.33900000000000002,"15min":0.32100000000000001},"max":{"1min":0.85499999999999998,"5min":1.218,"15min":1.218},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.29299999999999998},"max":{"1min":0.92300000000000004,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70499999999999996,"15min":0.67900000000000005},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.40300000000000002},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.39900000000000002},"max":{"1min":0.90500000000000003,"5min":1.254,"15min":1.254},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97899999999999998,"5min":1.165,"15min":1.165},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.72299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.998,"5min":1.175,"15min":1.246},"last":0.70699999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.46400000000000002},"max":{"1min":0.94999999999999996,"5min":1.746,"15min":1.746},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.80200000000000005,"15min":0.77700000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":0.95799999999999996,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.86099999999999999}]},{"osd":10,"last update":"Fri Mar 17 08:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77400000000000002,"15min":0.76500000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":1.1359999999999999,"15min":1.337},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.46100000000000002},"max":{"1min":0.98599999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.78400000000000003}]},{"osd":11,"last update":"Fri Mar 17 08:17:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79900000000000004,"15min":0.84199999999999997},"min":{"1min":0.55300000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.028,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.81299999999999994},"min":{"1min":0.501,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94099999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.80700000000000005}]}]},{"osd":7,"up_from":52,"seq":223338299539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7152,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738000,"statfs":{"total":95995035648,"available":95987712000,"internally_reserved":0,"allocated":1613824,"data_stored":1076391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44600000000000001,"15min":0.43099999999999999},"min":{"1min":0.31900000000000001,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.84299999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46100000000000002,"15min":0.439},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.26600000000000001},"max":{"1min":0.60299999999999998,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.46800000000000003,"5min":0.37,"15min":0.29199999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.91500000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63700000000000001,"15min":0.59999999999999998},"min":{"1min":0.53600000000000003,"5min":0.42299999999999999,"15min":0.314},"max":{"1min":0.79300000000000004,"5min":0.81599999999999995,"15min":0.92100000000000004},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.35799999999999998},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":3.8140000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72499999999999998,"5min":0.77700000000000002,"15min":0.94599999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.50800000000000001},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.30199999999999999},"max":{"1min":0.73799999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":0.91300000000000003,"15min":0.98199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.66100000000000003},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.50800000000000001,"5min":0.498,"15min":0.436},"max":{"1min":0.85999999999999999,"5min":0.93500000000000005,"15min":1.008},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.42699999999999999},"max":{"1min":0.94199999999999995,"5min":0.97399999999999998,"15min":0.98399999999999999},"last":0.73699999999999999}]},{"osd":8,"last update":"Fri Mar 17 08:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73199999999999998,"15min":0.70999999999999996},"min":{"1min":0.54000000000000004,"5min":0.47799999999999998,"15min":0.41299999999999998},"max":{"1min":0.85199999999999998,"5min":1.046,"15min":1.046},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.62,"5min":0.46800000000000003,"15min":0.45700000000000002},"max":{"1min":0.97199999999999998,"5min":1.095,"15min":1.095},"last":0.76100000000000001}]},{"osd":9,"last update":"Fri Mar 17 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76700000000000002,"15min":0.72999999999999998},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.44800000000000001},"max":{"1min":0.94999999999999996,"5min":1.167,"15min":1.167},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.54700000000000004,"15min":0.52100000000000002},"max":{"1min":0.877,"5min":1.1200000000000001,"15min":3.7970000000000002},"last":0.86299999999999999}]},{"osd":10,"last update":"Fri Mar 17 08:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68400000000000005,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.35599999999999998},"max":{"1min":0.97699999999999998,"5min":0.98199999999999998,"15min":1.099},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.67400000000000004}]},{"osd":11,"last update":"Fri Mar 17 08:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.70299999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91700000000000004,"5min":1.238,"15min":1.238},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.71899999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.94499999999999995,"5min":1.474,"15min":1.474},"last":0.94399999999999995}]}]},{"osd":6,"up_from":47,"seq":201863463071,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6424,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738728,"statfs":{"total":95995035648,"available":95988457472,"internally_reserved":0,"allocated":999424,"data_stored":482646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47499999999999998,"15min":0.436},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.219},"max":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.68300000000000005},"last":0.38},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.497,"15min":0.45500000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59999999999999998,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.34200000000000003,"15min":0.33000000000000002},"max":{"1min":0.84299999999999997,"5min":0.91900000000000004,"15min":0.96699999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.62},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.33600000000000002},"max":{"1min":0.83899999999999997,"5min":0.875,"15min":0.88700000000000001},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69199999999999995,"15min":0.65200000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.36499999999999999},"max":{"1min":0.80500000000000005,"5min":0.91300000000000003,"15min":0.93000000000000005},"last":0.622},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.90700000000000003,"5min":1.01,"15min":1.01},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.30499999999999999},"max":{"1min":0.83299999999999996,"5min":0.85499999999999998,"15min":0.89300000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61399999999999999,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.27800000000000002},"max":{"1min":0.81299999999999994,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66700000000000004,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90000000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.70699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77000000000000002,"15min":0.73099999999999998},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98999999999999999,"5min":1.105,"15min":1.105},"last":0.5}]},{"osd":7,"last update":"Fri Mar 17 08:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81899999999999995,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.95599999999999996,"5min":1.079,"15min":1.097},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79700000000000004,"15min":0.72699999999999998},"min":{"1min":0.56100000000000005,"5min":0.48099999999999998,"15min":0.42199999999999999},"max":{"1min":0.97399999999999998,"5min":1.105,"15min":1.1140000000000001},"last":0.71999999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81299999999999994,"15min":0.73399999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.137,"15min":1.137},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81599999999999995,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.46300000000000002},"max":{"1min":1.0580000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.60999999999999999}]},{"osd":9,"last update":"Fri Mar 17 08:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.80200000000000005,"15min":0.75600000000000001},"min":{"1min":0.52400000000000002,"5min":0.51300000000000001,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.75},"min":{"1min":0.504,"5min":0.46300000000000002,"15min":0.38600000000000001},"max":{"1min":1.038,"5min":1.151,"15min":1.151},"last":0.65400000000000003}]},{"osd":10,"last update":"Fri Mar 17 08:17:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.55300000000000005},"max":{"1min":1.0600000000000001,"5min":1.125,"15min":1.1419999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.877,"15min":0.877},"min":{"1min":0.64400000000000002,"5min":0.57799999999999996,"15min":0.53900000000000003},"max":{"1min":1.0229999999999999,"5min":1.171,"15min":1.171},"last":0.80900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575064,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7516,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737636,"statfs":{"total":95995035648,"available":95987339264,"internally_reserved":0,"allocated":1069056,"data_stored":546627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:17:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.60199999999999998,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.30599999999999999,"15min":0.29399999999999998},"max":{"1min":1.022,"5min":1.022,"15min":4.1100000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63300000000000001,"15min":0.59399999999999997},"min":{"1min":0.41799999999999998,"5min":0.32200000000000001,"15min":0.27200000000000002},"max":{"1min":0.84199999999999997,"5min":0.99399999999999999,"15min":4.0499999999999998},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63600000000000001,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":0.79700000000000004,"5min":0.89500000000000002,"15min":1.155},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.628,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.24399999999999999},"max":{"1min":0.91400000000000003,"5min":0.93500000000000005,"15min":1.044},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Mar 17 08:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69999999999999996,"15min":0.63500000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.317},"max":{"1min":0.88800000000000001,"5min":0.96999999999999997,"15min":1.05},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68700000000000006,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.83499999999999996,"5min":0.90300000000000002,"15min":1.1319999999999999},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Mar 17 08:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.46600000000000003},"min":{"1min":0.379,"5min":0.29299999999999998,"15min":0.26000000000000001},"max":{"1min":0.76900000000000002,"5min":0.80700000000000005,"15min":1.135},"last":0.624},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52000000000000002,"15min":0.46999999999999997},"min":{"1min":0.376,"5min":0.30099999999999999,"15min":0.24099999999999999},"max":{"1min":0.92300000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59599999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:16:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.36099999999999999},"max":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":0.94399999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.64700000000000002},"min":{"1min":0.56599999999999995,"5min":0.44800000000000001,"15min":0.33400000000000002},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.65200000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.39900000000000002},"max":{"1min":0.97499999999999998,"5min":1.046,"15min":1.046},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70199999999999996,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.44,"15min":0.34599999999999997},"max":{"1min":0.89700000000000002,"5min":1.032,"15min":1.0880000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:16:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61499999999999999,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.85699999999999998,"5min":0.93700000000000006,"15min":1.077},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.66000000000000003},"min":{"1min":0.46100000000000002,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":0.94999999999999996,"5min":1.002,"15min":1.046},"last":0.83199999999999996}]},{"osd":8,"last update":"Fri Mar 17 08:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.74399999999999999},"min":{"1min":0.505,"5min":0.47499999999999998,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":1.004,"15min":1.01},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.752,"15min":0.70799999999999996},"min":{"1min":0.54500000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":0.99299999999999999},"last":0.81899999999999995}]},{"osd":9,"last update":"Fri Mar 17 08:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77000000000000002,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45100000000000001},"max":{"1min":0.93300000000000005,"5min":1.016,"15min":1.016},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.76600000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.45300000000000001},"max":{"1min":0.97399999999999998,"5min":1.077,"15min":1.167},"last":0.97799999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.75,"15min":0.77300000000000002},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.33500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.1719999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53300000000000003,"5min":0.46500000000000002,"15min":0.36199999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.89400000000000002}]},{"osd":11,"last update":"Fri Mar 17 08:17:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.871,"15min":0.879},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.95999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738595,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7340,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":93737812,"statfs":{"total":95995035648,"available":95987519488,"internally_reserved":0,"allocated":1019904,"data_stored":483979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60599999999999998,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.29599999999999999},"max":{"1min":0.72199999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.61599999999999999},"min":{"1min":0.48599999999999999,"5min":0.45200000000000001,"15min":0.317},"max":{"1min":0.80100000000000005,"5min":0.94599999999999995,"15min":5.6849999999999996},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.36199999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.367},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.42399999999999999,"15min":0.35599999999999998},"max":{"1min":0.93500000000000005,"5min":0.96999999999999997,"15min":1.4850000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Mar 17 08:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52300000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.436},{"interface":"front","average":{"1min":0.496,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.625},"min":{"1min":0.38,"5min":0.377,"15min":0.35299999999999998},"max":{"1min":0.88800000000000001,"5min":0.94899999999999995,"15min":1.0029999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.97999999999999998},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70599999999999996,"15min":0.64700000000000002},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.379},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.5820000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.747,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40300000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.5329999999999999},"last":0.85199999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.58699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28599999999999998},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":1.0369999999999999},"last":0.629},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65800000000000003,"15min":0.59599999999999997},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0329999999999999,"5min":1.073,"15min":1.073},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79000000000000004,"15min":0.77300000000000002},"min":{"1min":0.68100000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.409},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79200000000000004,"15min":0.76000000000000001},"min":{"1min":0.55800000000000005,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.349},"last":0.83199999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.74299999999999999,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.1200000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78000000000000003,"15min":0.79000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.115,"5min":1.125,"15min":1.133},"last":0.78700000000000003}]},{"osd":10,"last update":"Fri Mar 17 08:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85899999999999999,"15min":0.871},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.52900000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.2130000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.83899999999999997,"15min":0.85099999999999998},"min":{"1min":0.61799999999999999,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.083,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76000000000000001}]},{"osd":11,"last update":"Fri Mar 17 08:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83299999999999996,"15min":0.81499999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.50600000000000001},"max":{"1min":1.131,"5min":1.131,"15min":1.425},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.86099999999999999,"15min":0.88300000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.091,"5min":1.1479999999999999,"15min":2.9849999999999999},"last":0.88500000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411534,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7388,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":93737764,"statfs":{"total":95995035648,"available":95987470336,"internally_reserved":0,"allocated":1003520,"data_stored":484047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63300000000000001,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.34599999999999997,"15min":0.311},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":1.095},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.33400000000000002},"max":{"1min":0.752,"5min":0.90800000000000003,"15min":1.1639999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.61099999999999999},"min":{"1min":0.49199999999999999,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:17:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.63800000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.96799999999999997,"15min":1.181},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67000000000000004,"15min":0.63100000000000001},"min":{"1min":0.48799999999999999,"5min":0.42899999999999999,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.94699999999999995,"15min":1.139},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68300000000000005,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.496},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.49199999999999999},"min":{"1min":0.371,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.72699999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.34999999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.1080000000000001},"last":0.754},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.47599999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.94799999999999995,"15min":1.1890000000000001},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63500000000000001,"15min":0.62},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.32100000000000001},"max":{"1min":0.89200000000000002,"5min":1.02,"15min":1.02},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.621,"15min":0.59899999999999998},"min":{"1min":0.51500000000000001,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.78800000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80000000000000004}]},{"osd":9,"last update":"Fri Mar 17 08:17:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77100000000000002,"15min":0.755},"min":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.41899999999999998},"max":{"1min":0.95399999999999996,"5min":1.079,"15min":1.1499999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73799999999999999,"15min":0.72699999999999998},"min":{"1min":0.53800000000000003,"5min":0.52300000000000002,"15min":0.48999999999999999},"max":{"1min":0.92700000000000005,"5min":0.97899999999999998,"15min":1.0820000000000001},"last":0.71699999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.52800000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88800000000000001,"5min":1.006,"15min":1.006},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.70699999999999996},"min":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.51200000000000001},"max":{"1min":0.97599999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83799999999999997}]},{"osd":11,"last update":"Fri Mar 17 08:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.99399999999999999,"5min":1.05,"15min":1.05},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.628,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.878}]}]},{"osd":3,"up_from":26,"seq":111669149886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6764,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738388,"statfs":{"total":95995035648,"available":95988109312,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.41699999999999998},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.22700000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.753},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45500000000000002,"15min":0.42999999999999999},"min":{"1min":0.313,"5min":0.28599999999999998,"15min":0.222},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.76600000000000001},"last":0.503}]},{"osd":1,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67100000000000004,"15min":0.628},"min":{"1min":0.52600000000000002,"5min":0.42599999999999999,"15min":0.373},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58599999999999997,"15min":0.56699999999999995},"min":{"1min":0.48399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82299999999999995,"5min":0.87,"15min":1.0189999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.53300000000000003,"5min":0.39900000000000002,"15min":0.33100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.94299999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68400000000000005,"15min":0.64400000000000002},"min":{"1min":0.503,"5min":0.443,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.67100000000000004,"15min":0.63400000000000001},"min":{"1min":0.52600000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90700000000000003,"5min":0.96399999999999997,"15min":0.99299999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.70999999999999996},"min":{"1min":0.63900000000000001,"5min":0.501,"15min":0.38300000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.69499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.34000000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.2250000000000001},"last":0.875},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70899999999999996,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.38600000000000001},"max":{"1min":0.94599999999999995,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.64000000000000001},"min":{"1min":0.46200000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.266},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.877,"5min":0.89800000000000002,"15min":0.96299999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.131},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75800000000000001,"15min":0.72899999999999998},"min":{"1min":0.48999999999999999,"5min":0.46700000000000003,"15min":0.40500000000000003},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.93100000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.81100000000000005,"15min":0.83099999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.44},"max":{"1min":1.1439999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.71099999999999997},"min":{"1min":0.48999999999999999,"5min":0.42999999999999999,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":1.012,"15min":1.042},"last":0.72499999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75600000000000001,"15min":0.81599999999999995},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.026,"5min":1.196,"15min":1.196},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80100000000000005,"15min":0.82299999999999995},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.46300000000000002},"max":{"1min":1.0329999999999999,"5min":1.042,"15min":1.101},"last":0.84999999999999998}]},{"osd":11,"last update":"Fri Mar 17 08:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83299999999999996,"15min":0.82399999999999995},"min":{"1min":0.61699999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89200000000000002,"15min":0.89100000000000001},"min":{"1min":0.68799999999999994,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.169,"5min":1.171,"15min":1.171},"last":0.97399999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6752,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738400,"statfs":{"total":95995035648,"available":95988121600,"internally_reserved":0,"allocated":1073152,"data_stored":545692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.434,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.308,"15min":0.20399999999999999},"max":{"1min":0.63900000000000001,"5min":0.70199999999999996,"15min":0.82599999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.34999999999999998,"5min":0.28999999999999998,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.75800000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Mar 17 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.60699999999999998},"min":{"1min":0.497,"5min":0.36399999999999999,"15min":0.34999999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.35599999999999998},"max":{"1min":0.78000000000000003,"5min":0.86599999999999999,"15min":0.93300000000000005},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Mar 17 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66800000000000004,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.33400000000000002},"max":{"1min":0.82299999999999995,"5min":0.88,"15min":0.88},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.60699999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.38900000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.439},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.64900000000000002},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.38200000000000001},"max":{"1min":0.83799999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68799999999999994,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.39800000000000002,"15min":0.36399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39100000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Mar 17 08:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.40100000000000002,"5min":0.375,"15min":0.33100000000000002},"max":{"1min":0.90800000000000003,"5min":0.97899999999999998,"15min":1.0389999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.41899999999999998,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.006,"15min":1.006},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72899999999999998,"15min":0.70199999999999996},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":0.99199999999999999,"15min":1.012},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Mar 17 08:17:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82099999999999995,"15min":0.78700000000000003},"min":{"1min":0.57099999999999995,"5min":0.51100000000000001,"15min":0.48999999999999999},"max":{"1min":1.0089999999999999,"5min":1.091,"15min":1.091},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79300000000000004,"15min":0.77300000000000002},"min":{"1min":0.505,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0209999999999999,"5min":1.044,"15min":1.044},"last":0.69699999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76700000000000002,"15min":0.78500000000000003},"min":{"1min":0.53500000000000003,"5min":0.495,"15min":0.44500000000000001},"max":{"1min":0.96699999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70399999999999996,"15min":0.72899999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92800000000000005,"5min":1.0029999999999999,"15min":1.0089999999999999},"last":0.59499999999999997}]},{"osd":11,"last update":"Fri Mar 17 08:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.98799999999999999,"5min":1.026,"15min":1.026},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60199999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81000000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724716,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7224,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737928,"statfs":{"total":95995035648,"available":95987638272,"internally_reserved":0,"allocated":1622016,"data_stored":1075444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.56000000000000005},"min":{"1min":0.44,"5min":0.377,"15min":0.29199999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.436},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.57699999999999996},"min":{"1min":0.54200000000000004,"5min":0.42799999999999999,"15min":0.28699999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":1.0740000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.56100000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.28100000000000003},"max":{"1min":0.755,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.63400000000000001,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46800000000000003,"15min":0.43099999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.249},"max":{"1min":0.71599999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.46999999999999997,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64300000000000002,"15min":0.60899999999999999},"min":{"1min":0.499,"5min":0.44900000000000001,"15min":0.32300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0549999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68200000000000005,"15min":0.624},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.308},"max":{"1min":0.85999999999999999,"5min":0.97699999999999998,"15min":0.98099999999999998},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.63300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.34699999999999998},"max":{"1min":0.85399999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71199999999999997,"15min":0.66700000000000004},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.33700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0580000000000001,"15min":5.1669999999999998},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.64300000000000002},"min":{"1min":0.52900000000000003,"5min":0.42399999999999999,"15min":0.39500000000000002},"max":{"1min":0.91100000000000003,"5min":0.996,"15min":1.0940000000000001},"last":0.60799999999999998}]},{"osd":7,"last update":"Fri Mar 17 08:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73799999999999999,"15min":0.65500000000000003},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.39200000000000002},"max":{"1min":0.85799999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72599999999999998,"15min":0.65400000000000003},"min":{"1min":0.56599999999999995,"5min":0.46100000000000002,"15min":0.36499999999999999},"max":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.67000000000000004}]},{"osd":8,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.439,"5min":0.42599999999999999,"15min":0.32900000000000001},"max":{"1min":0.95599999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.315},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58099999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77600000000000002,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.38500000000000001},"max":{"1min":0.99099999999999999,"5min":1.099,"15min":1.099},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80500000000000005,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":1.117,"15min":1.151},"last":0.72799999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:17:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.72499999999999998},"min":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.39400000000000002},"max":{"1min":0.92600000000000005,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.749},"min":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":1.0149999999999999,"15min":1.129},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:17:47.612 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-17T08:17:49.393 INFO:tasks.cephadm:Setting up client nodes... 2023-03-17T08:17:50.830 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-03-17T08:17:50.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:28 smithi035 ceph-mon[92535]: pgmap v1003: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:50.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:29 smithi035 ceph-mon[92535]: from='client.14661 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:17:50.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:30 smithi035 ceph-mon[92535]: pgmap v1004: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:50.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:32 smithi035 ceph-mon[92535]: pgmap v1005: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:50.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:34 smithi035 ceph-mon[92535]: pgmap v1006: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:50.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:36 smithi035 ceph-mon[92535]: pgmap v1007: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:17:52.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:38 smithi035 ceph-mon[92535]: pgmap v1008: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:17:54.616 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:40 smithi035 ceph-mon[92535]: pgmap v1009: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:55.549 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:42 smithi035 ceph-mon[92535]: pgmap v1010: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:17:55.549 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:44 smithi035 ceph-mon[92535]: pgmap v1011: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:17:57.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:44 smithi035 ceph-mon[92535]: mgrmap e18: x(active, since 31m), standbys: y, z 2023-03-17T08:17:57.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:46 smithi035 ceph-mon[92535]: pgmap v1012: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2023-03-17T08:17:57.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:48 smithi035 ceph-mon[92535]: pgmap v1013: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-17T08:17:57.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:50 smithi035 ceph-mon[92535]: pgmap v1014: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:17:57.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:17:58.504 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:17:58.504 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:51 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:17:58.504 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: pgmap v1015: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:17:58.504 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:17:58.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:00.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:00.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:00.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:18:00.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:18:01.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:02.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:53 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:18:02.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:53 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:18:02.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:54 smithi035 ceph-mon[92535]: pgmap v1016: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:18:02.795 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:56 smithi035 ceph-mon[92535]: pgmap v1017: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:18:02.798 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:18:03.444 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:40 smithi078 ceph-mon[94114]: pgmap v1009: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:04.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:42 smithi078 ceph-mon[94114]: pgmap v1010: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:04.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:44 smithi078 ceph-mon[94114]: pgmap v1011: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:04.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:44 smithi078 ceph-mon[94114]: mgrmap e18: x(active, since 31m), standbys: y, z 2023-03-17T08:18:04.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:46 smithi078 ceph-mon[94114]: pgmap v1012: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2023-03-17T08:18:05.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:48 smithi078 ceph-mon[94114]: pgmap v1013: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-17T08:18:05.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:50 smithi078 ceph-mon[94114]: pgmap v1014: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:18:05.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:18:05.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:07.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:51 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:07.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: pgmap v1015: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:18:07.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:07.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:07.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:09.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:09.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:18:09.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:18:09.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:09.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:53 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:18:09.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:53 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:18:09.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:54 smithi078 ceph-mon[94114]: pgmap v1016: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:18:09.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:56 smithi078 ceph-mon[94114]: pgmap v1017: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:18:09.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:17:58 smithi078 ceph-mon[94114]: pgmap v1018: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:18:09.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:00 smithi078 ceph-mon[94114]: pgmap v1019: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:10.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:00 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2443874785' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-03-17T08:18:10.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:00 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2443874785' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-03-17T08:18:10.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:40 smithi082 ceph-mon[94281]: pgmap v1009: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:10.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:42 smithi082 ceph-mon[94281]: pgmap v1010: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:10.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:44 smithi082 ceph-mon[94281]: pgmap v1011: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:10.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:44 smithi082 ceph-mon[94281]: mgrmap e18: x(active, since 31m), standbys: y, z 2023-03-17T08:18:10.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:46 smithi082 ceph-mon[94281]: pgmap v1012: 97 pgs: 97 active+clean; 645 KiB data, 81 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 12 op/s 2023-03-17T08:18:11.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:48 smithi082 ceph-mon[94281]: pgmap v1013: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2023-03-17T08:18:12.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:50 smithi082 ceph-mon[94281]: pgmap v1014: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:18:12.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:18:12.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:12.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:51 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:12.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: pgmap v1015: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:53 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:53 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:54 smithi082 ceph-mon[94281]: pgmap v1016: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:56 smithi082 ceph-mon[94281]: pgmap v1017: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:17:58 smithi082 ceph-mon[94281]: pgmap v1018: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:00 smithi082 ceph-mon[94281]: pgmap v1019: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:00 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2443874785' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-03-17T08:18:12.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:00 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2443874785' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-03-17T08:18:12.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:17:58 smithi035 ceph-mon[92535]: pgmap v1018: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:18:12.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:02 smithi082 ceph-mon[94281]: pgmap v1020: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:14.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:04 smithi082 ceph-mon[94281]: pgmap v1021: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:14.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:06 smithi082 ceph-mon[94281]: pgmap v1022: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:14.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:08 smithi082 ceph-mon[94281]: pgmap v1023: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:14.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:10 smithi082 ceph-mon[94281]: pgmap v1024: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:14.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:02 smithi078 ceph-mon[94114]: pgmap v1020: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:14.157 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:04 smithi078 ceph-mon[94114]: pgmap v1021: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:14.157 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:06 smithi078 ceph-mon[94114]: pgmap v1022: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:14.157 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:08 smithi078 ceph-mon[94114]: pgmap v1023: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:14.157 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:10 smithi078 ceph-mon[94114]: pgmap v1024: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:14.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 -- 172.21.15.35:0/177500532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 msgr2=0x7fb534105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:14.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 --2- 172.21.15.35:0/177500532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb534105a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009990 tx=0x7fb51c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:18:17.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 -- 172.21.15.35:0/177500532 shutdown_connections 2023-03-17T08:18:17.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 --2- 172.21.15.35:0/177500532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb534105f40 0x7fb5341083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:17.993 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 --2- 172.21.15.35:0/177500532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb534100d00 0x7fb5341030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 --2- 172.21.15.35:0/177500532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb534105a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 -- 172.21.15.35:0/177500532 >> 172.21.15.35:0/177500532 conn(0x7fb5340fa780 msgr2=0x7fb5340fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 -- 172.21.15.35:0/177500532 shutdown_connections 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 -- 172.21.15.35:0/177500532 wait complete. 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 Processor -- start 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 -- start start 2023-03-17T08:18:18.368 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.504+0000 7fb539e80700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb534100d00 0x7fb534100660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:18.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb5340fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:18.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb534105f40 0x7fb5340ff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:18.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340ff970 con 0x7fb534103620 2023-03-17T08:18:18.369 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340ffae0 con 0x7fb534100d00 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53419ff30 con 0x7fb534105f40 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb5340fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb5340fecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40272/0 (socket says 172.21.15.35:40272) 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 -- 172.21.15.35:0/2443874785 learned_addr learned my addr 172.21.15.35:0/2443874785 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb5337fe700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb534100d00 0x7fb534100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb533fff700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb534105f40 0x7fb5340ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:19.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 -- 172.21.15.35:0/2443874785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb534105f40 msgr2=0x7fb5340ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb534105f40 0x7fb5340ff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 -- 172.21.15.35:0/2443874785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb534100d00 msgr2=0x7fb534100660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb534100d00 0x7fb534100660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 -- 172.21.15.35:0/2443874785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c0095f0 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb52bfff700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb5340fecb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006010 tx=0x7fb51c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c01d070 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53410baf0 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb51c004080 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c022c90 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.505+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53410b960 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.506+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5340fc2f0 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.507+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb51c022470 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.508+0000 7fb5317fa700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb52009f4d0 0x7fb5200a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.508+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb51c0cb920 con 0x7fb534103620 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.508+0000 7fb5337fe700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb52009f4d0 0x7fb5200a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:19.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.508+0000 7fb5337fe700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb52009f4d0 0x7fb5200a1980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb524005950 tx=0x7fb52400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:18:19.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.512+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb51c095b40 con 0x7fb534103620 2023-03-17T08:18:19.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.791+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb53402d010 con 0x7fb534103620 2023-03-17T08:18:19.131 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.797+0000 7fb5317fa700 1 -- 172.21.15.35:0/2443874785 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v39) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb51c0041f0 con 0x7fb534103620 2023-03-17T08:18:19.131 INFO:teuthology.orchestra.run.smithi035.stdout:[client.0] 2023-03-17T08:18:19.131 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQA3IhRkt71HLxAAqMoKYMmhlWzgzekTivB5oA== 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:12 smithi082 ceph-mon[94281]: pgmap v1025: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:14 smithi082 ceph-mon[94281]: pgmap v1026: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:16 smithi082 ceph-mon[94281]: pgmap v1027: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:18 smithi082 ceph-mon[94281]: pgmap v1028: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:12 smithi078 ceph-mon[94114]: pgmap v1025: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:14 smithi078 ceph-mon[94114]: pgmap v1026: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:16 smithi078 ceph-mon[94114]: pgmap v1027: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:19.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:18 smithi078 ceph-mon[94114]: pgmap v1028: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb52009f4d0 msgr2=0x7fb5200a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb52009f4d0 0x7fb5200a1980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb524005950 tx=0x7fb52400b410 comp rx=0 tx=0).stop 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 msgr2=0x7fb5340fecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb5340fecb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006010 tx=0x7fb51c004730 comp rx=0 tx=0).stop 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 shutdown_connections 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb534105f40 0x7fb5340ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb534100d00 0x7fb534100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb52009f4d0 0x7fb5200a1980 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 --2- 172.21.15.35:0/2443874785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb534103620 0x7fb5340fecb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 >> 172.21.15.35:0/2443874785 conn(0x7fb5340fa780 msgr2=0x7fb534101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.799+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 shutdown_connections 2023-03-17T08:18:19.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:17:59.800+0000 7fb539e80700 1 -- 172.21.15.35:0/2443874785 wait complete. 2023-03-17T08:18:19.135 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T08:18:19.135 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-03-17T08:18:19.135 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:00 smithi035 ceph-mon[92535]: pgmap v1019: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:00 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2443874785' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:00 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2443874785' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:02 smithi035 ceph-mon[92535]: pgmap v1020: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:04 smithi035 ceph-mon[92535]: pgmap v1021: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:06 smithi035 ceph-mon[92535]: pgmap v1022: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:08 smithi035 ceph-mon[92535]: pgmap v1023: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:10 smithi035 ceph-mon[92535]: pgmap v1024: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:12 smithi035 ceph-mon[92535]: pgmap v1025: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:14 smithi035 ceph-mon[92535]: pgmap v1026: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:19.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:16 smithi035 ceph-mon[92535]: pgmap v1027: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:19.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:18 smithi035 ceph-mon[92535]: pgmap v1028: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:19.187 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-17T08:18:19.893 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-03-17T08:18:19.893 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph mgr dump --format=json 2023-03-17T08:18:20.556 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:18:20.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:20 smithi078 ceph-mon[94114]: pgmap v1029: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:20.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:20 smithi082 ceph-mon[94281]: pgmap v1029: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:21.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:20 smithi035 ceph-mon[92535]: pgmap v1029: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:21.742 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 -- 172.21.15.35:0/2759247789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e141004d0 msgr2=0x7f7e141008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:22.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 --2- 172.21.15.35:0/2759247789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e141004d0 0x7f7e141008a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e040099c0 tx=0x7f7e04009cd0 comp rx=0 tx=0).stop 2023-03-17T08:18:25.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 -- 172.21.15.35:0/2759247789 shutdown_connections 2023-03-17T08:18:25.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 --2- 172.21.15.35:0/2759247789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e14105570 0x7f7e1410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:25.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 --2- 172.21.15.35:0/2759247789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e141004d0 0x7f7e141008a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:25.332 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 --2- 172.21.15.35:0/2759247789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14100e70 0x7f7e14104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:25.332 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 -- 172.21.15.35:0/2759247789 >> 172.21.15.35:0/2759247789 conn(0x7f7e140fbd50 msgr2=0x7f7e140fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:18:25.332 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 -- 172.21.15.35:0/2759247789 shutdown_connections 2023-03-17T08:18:25.332 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 -- 172.21.15.35:0/2759247789 wait complete. 2023-03-17T08:18:25.332 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.739+0000 7f7e1b384700 1 Processor -- start 2023-03-17T08:18:25.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 -- start start 2023-03-17T08:18:26.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:22 smithi078 ceph-mon[94114]: pgmap v1030: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:27.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:22 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/717347172' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-03-17T08:18:27.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:24 smithi078 ceph-mon[94114]: pgmap v1031: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:27.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:22 smithi082 ceph-mon[94281]: pgmap v1030: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:27.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:22 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/717347172' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-03-17T08:18:27.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:24 smithi082 ceph-mon[94281]: pgmap v1031: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:27.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:26 smithi078 ceph-mon[94114]: pgmap v1032: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:28.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:26 smithi082 ceph-mon[94281]: pgmap v1032: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:28.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e141004d0 0x7f7e141984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:28.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 0x7f7e14198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:28.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14105570 0x7f7e1419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:28.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419d480 con 0x7f7e14100e70 2023-03-17T08:18:28.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419d5f0 con 0x7f7e14105570 2023-03-17T08:18:28.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1b384700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419d7b0 con 0x7f7e141004d0 2023-03-17T08:18:28.535 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 0x7f7e14198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:29.887 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 0x7f7e14198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40284/0 (socket says 172.21.15.35:40284) 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 -- 172.21.15.35:0/717347172 learned_addr learned my addr 172.21.15.35:0/717347172 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e19120700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e141004d0 0x7f7e141984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e19921700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14105570 0x7f7e1419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 -- 172.21.15.35:0/717347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e141004d0 msgr2=0x7f7e141984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e141004d0 0x7f7e141984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 -- 172.21.15.35:0/717347172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14105570 msgr2=0x7f7e1419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14105570 0x7f7e1419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 -- 172.21.15.35:0/717347172 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040095f0 con 0x7f7e14100e70 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e19120700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e141004d0 0x7f7e141984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.740+0000 7f7e1891f700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 0x7f7e14198a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b500 tx=0x7f7e1000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.741+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10011830 con 0x7f7e14100e70 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.741+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e10011e20 con 0x7f7e14100e70 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.741+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e141101d0 con 0x7f7e14100e70 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.741+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10010db0 con 0x7f7e14100e70 2023-03-17T08:18:29.888 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.741+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e14110040 con 0x7f7e14100e70 2023-03-17T08:18:29.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.742+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e14110360 con 0x7f7e14100e70 2023-03-17T08:18:29.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.743+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f7e10011990 con 0x7f7e14100e70 2023-03-17T08:18:29.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.743+0000 7f7e0a7fc700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e0009f4d0 0x7f7e000a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:30.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.743+0000 7f7e19120700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e0009f4d0 0x7f7e000a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:30.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.743+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f7e100c9ce0 con 0x7f7e14100e70 2023-03-17T08:18:30.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.744+0000 7f7e19120700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e0009f4d0 0x7f7e000a1980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000c00 tx=0x7f7e04005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:18:30.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:21.748+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f7e10093e70 con 0x7f7e14100e70 2023-03-17T08:18:30.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.000+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7e141a5600 con 0x7f7e14100e70 2023-03-17T08:18:30.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.005+0000 7f7e0a7fc700 1 -- 172.21.15.35:0/717347172 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+256260 (secure 0 0 0) 0x7f7e10015020 con 0x7f7e14100e70 2023-03-17T08:18:30.800 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:18:30.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:28 smithi082 ceph-mon[94281]: pgmap v1033: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:32.080 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:28 smithi078 ceph-mon[94114]: pgmap v1033: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:33.229 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:30 smithi078 ceph-mon[94114]: pgmap v1034: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:33.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e0009f4d0 msgr2=0x7f7e000a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:33.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e0009f4d0 0x7f7e000a1980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000c00 tx=0x7f7e04005fb0 comp rx=0 tx=0).stop 2023-03-17T08:18:33.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 msgr2=0x7f7e14198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:34.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 0x7f7e14198a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b500 tx=0x7f7e1000b8c0 comp rx=0 tx=0).stop 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 shutdown_connections 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e14105570 0x7f7e1419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e141004d0 0x7f7e141984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e0009f4d0 0x7f7e000a1980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 --2- 172.21.15.35:0/717347172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e14100e70 0x7f7e14198a00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 >> 172.21.15.35:0/717347172 conn(0x7f7e140fbd50 msgr2=0x7f7e140fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 shutdown_connections 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:22.008+0000 7f7e1b384700 1 -- 172.21.15.35:0/717347172 wait complete. 2023-03-17T08:18:35.381 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":18,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6800","nonce":889943724},{"type":"v1","addr":"172.21.15.35:6801","nonce":889943724}]},"active_addr":"172.21.15.35:6801/889943724","active_change":"2023-03-17T07:46:42.142482+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.35:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":1110587912}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":593305846}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":878439852}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":91259999}]}]} 2023-03-17T08:18:37.646 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-03-17T08:18:38.909 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-03-17T08:18:38.909 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd dump --format=json 2023-03-17T08:18:39.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:22 smithi035 ceph-mon[92535]: pgmap v1030: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:42.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:22 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/717347172' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-03-17T08:18:43.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:24 smithi035 ceph-mon[92535]: pgmap v1031: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:43.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:26 smithi035 ceph-mon[92535]: pgmap v1032: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:43.019 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:28 smithi035 ceph-mon[92535]: pgmap v1033: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:43.019 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:30 smithi035 ceph-mon[92535]: pgmap v1034: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:43.019 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:32 smithi035 ceph-mon[92535]: pgmap v1035: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:43.019 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:34 smithi035 ceph-mon[92535]: pgmap v1036: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:43.019 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:36 smithi035 ceph-mon[92535]: pgmap v1037: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:43.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:38 smithi035 ceph-mon[92535]: pgmap v1038: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:43.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:40 smithi035 ceph-mon[92535]: pgmap v1039: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:43.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:42 smithi035 ceph-mon[92535]: pgmap v1040: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:43.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:32 smithi078 ceph-mon[94114]: pgmap v1035: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:43.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:34 smithi078 ceph-mon[94114]: pgmap v1036: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:45.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:36 smithi078 ceph-mon[94114]: pgmap v1037: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:45.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:38 smithi078 ceph-mon[94114]: pgmap v1038: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:45.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:40 smithi078 ceph-mon[94114]: pgmap v1039: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:45.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:42 smithi078 ceph-mon[94114]: pgmap v1040: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:30 smithi082 ceph-mon[94281]: pgmap v1034: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:32 smithi082 ceph-mon[94281]: pgmap v1035: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:34 smithi082 ceph-mon[94281]: pgmap v1036: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:36 smithi082 ceph-mon[94281]: pgmap v1037: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:38 smithi082 ceph-mon[94281]: pgmap v1038: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:40 smithi082 ceph-mon[94281]: pgmap v1039: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:42 smithi082 ceph-mon[94281]: pgmap v1040: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:18:45.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:44 smithi082 ceph-mon[94281]: pgmap v1041: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:45.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:44 smithi078 ceph-mon[94114]: pgmap v1041: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:47.245 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:18:51.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:44 smithi035 ceph-mon[92535]: pgmap v1041: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:51.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:46 smithi082 ceph-mon[94281]: pgmap v1042: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:51.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:46 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/777989302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:18:52.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:48 smithi082 ceph-mon[94281]: pgmap v1043: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:52.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:50 smithi082 ceph-mon[94281]: pgmap v1044: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:52.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:46 smithi078 ceph-mon[94114]: pgmap v1042: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:18:52.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:46 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/777989302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:18:52.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:48 smithi078 ceph-mon[94114]: pgmap v1043: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:18:52.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:50 smithi078 ceph-mon[94114]: pgmap v1044: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 -- 172.21.15.35:0/2161111395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0948104500 msgr2=0x7f094810c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 --2- 172.21.15.35:0/2161111395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0948104500 0x7f094810c0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f094000b0d0 tx=0x7f094000b3e0 comp rx=0 tx=0).stop 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 -- 172.21.15.35:0/2161111395 shutdown_connections 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 --2- 172.21.15.35:0/2161111395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0948104500 0x7f094810c0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 --2- 172.21.15.35:0/2161111395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09480ffb30 0x7f09480fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 --2- 172.21.15.35:0/2161111395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481004d0 0x7f0948103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 -- 172.21.15.35:0/2161111395 >> 172.21.15.35:0/2161111395 conn(0x7f0948075830 msgr2=0x7f0948075c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 -- 172.21.15.35:0/2161111395 shutdown_connections 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 -- 172.21.15.35:0/2161111395 wait complete. 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 Processor -- start 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.882+0000 7f094f211700 1 -- start start 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094f211700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 0x7f0948196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094f211700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09481004d0 0x7f0948196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:52.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094f211700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0948104500 0x7f094819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094f211700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819b2e0 con 0x7f09480ffb30 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094f211700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819b450 con 0x7f09481004d0 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094f211700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819b610 con 0x7f0948104500 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 0x7f0948196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 0x7f0948196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40294/0 (socket says 172.21.15.35:40294) 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 -- 172.21.15.35:0/777989302 learned_addr learned my addr 172.21.15.35:0/777989302 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f0947fff700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09481004d0 0x7f0948196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094d7ae700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0948104500 0x7f094819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 -- 172.21.15.35:0/777989302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0948104500 msgr2=0x7f094819acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0948104500 0x7f094819acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 -- 172.21.15.35:0/777989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09481004d0 msgr2=0x7f0948196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09481004d0 0x7f0948196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 -- 172.21.15.35:0/777989302 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940009d00 con 0x7f09480ffb30 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f094cfad700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 0x7f0948196320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d950 tx=0x7f093c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c009940 con 0x7f09480ffb30 2023-03-17T08:18:52.917 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.883+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f093c010460 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.884+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094810f150 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.884+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00f620 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.884+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094810efc0 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.885+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094810f2e0 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.886+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f093c0105d0 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.886+0000 7f0945ffb700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f093809f4d0 0x7f09380a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.887+0000 7f0947fff700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f093809f4d0 0x7f09380a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.887+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f093c0ca0b0 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.887+0000 7f0947fff700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f093809f4d0 0x7f09380a1980 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0948197940 tx=0x7f093400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:45.891+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f093c0941a0 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.089+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0948066e30 con 0x7f09480ffb30 2023-03-17T08:18:52.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.090+0000 7f0945ffb700 1 -- 172.21.15.35:0/777989302 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f093c020090 con 0x7f09480ffb30 2023-03-17T08:18:52.919 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:18:55.404 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:18:55.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f093809f4d0 msgr2=0x7f09380a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f093809f4d0 0x7f09380a1980 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0948197940 tx=0x7f093400a380 comp rx=0 tx=0).stop 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 msgr2=0x7f0948196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 0x7f0948196320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d950 tx=0x7f093c00dc60 comp rx=0 tx=0).stop 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 shutdown_connections 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0948104500 0x7f094819acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f093809f4d0 0x7f09380a1980 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f09480ffb30 0x7f0948196320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 --2- 172.21.15.35:0/777989302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09481004d0 0x7f0948196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 >> 172.21.15.35:0/777989302 conn(0x7f0948075830 msgr2=0x7f0948102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 shutdown_connections 2023-03-17T08:18:56.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:18:46.093+0000 7f094f211700 1 -- 172.21.15.35:0/777989302 wait complete. 2023-03-17T08:18:56.883 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-03-17T08:18:58.281 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd dump --format=json 2023-03-17T08:19:00.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:52 smithi082 ceph-mon[94281]: pgmap v1045: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:00.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:52 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:19:00.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:19:00.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:19:01.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:54 smithi082 ceph-mon[94281]: pgmap v1046: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:01.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:54 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:19:01.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:54 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:19:01.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:54 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:19:02.704 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:54 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:19:02.704 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:56 smithi082 ceph-mon[94281]: pgmap v1047: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:02.704 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:18:58 smithi082 ceph-mon[94281]: pgmap v1048: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:00 smithi082 ceph-mon[94281]: pgmap v1049: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:52 smithi078 ceph-mon[94114]: pgmap v1045: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:52 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:54 smithi078 ceph-mon[94114]: pgmap v1046: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:54 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:54 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:54 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:19:05.593 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:54 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:19:07.549 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:56 smithi078 ceph-mon[94114]: pgmap v1047: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:07.549 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:18:58 smithi078 ceph-mon[94114]: pgmap v1048: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:07.549 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:00 smithi078 ceph-mon[94114]: pgmap v1049: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:07.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:46 smithi035 ceph-mon[92535]: pgmap v1042: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:07.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:46 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/777989302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:19:07.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:48 smithi035 ceph-mon[92535]: pgmap v1043: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:07.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:50 smithi035 ceph-mon[92535]: pgmap v1044: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:07.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:52 smithi035 ceph-mon[92535]: pgmap v1045: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:07.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:52 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:19:08.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:19:08.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:19:08.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:19:10.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:54 smithi035 ceph-mon[92535]: pgmap v1046: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:10.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:54 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:19:10.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:54 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:19:10.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:54 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:19:10.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:54 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:19:10.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:56 smithi035 ceph-mon[92535]: pgmap v1047: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:10.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:18:58 smithi035 ceph-mon[92535]: pgmap v1048: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:10.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:00 smithi035 ceph-mon[92535]: pgmap v1049: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:10.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:02 smithi035 ceph-mon[92535]: pgmap v1050: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:10.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:04 smithi035 ceph-mon[92535]: pgmap v1051: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:10.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:06 smithi035 ceph-mon[92535]: pgmap v1052: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:10.895 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:10.895 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:08 smithi035 ceph-mon[92535]: pgmap v1053: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:10.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:02 smithi078 ceph-mon[94114]: pgmap v1050: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:12.181 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:04 smithi078 ceph-mon[94114]: pgmap v1051: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:12.181 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:06 smithi078 ceph-mon[94114]: pgmap v1052: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:12.181 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:08 smithi078 ceph-mon[94114]: pgmap v1053: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:12.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:02 smithi082 ceph-mon[94281]: pgmap v1050: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:12.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:04 smithi082 ceph-mon[94281]: pgmap v1051: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:12.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:06 smithi082 ceph-mon[94281]: pgmap v1052: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:13.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:08 smithi082 ceph-mon[94281]: pgmap v1053: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:13.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:10 smithi082 ceph-mon[94281]: pgmap v1054: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:13.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:10 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/115209094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:19:13.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:12 smithi082 ceph-mon[94281]: pgmap v1055: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:13.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:10 smithi078 ceph-mon[94114]: pgmap v1054: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:13.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:10 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/115209094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:19:13.952 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:12 smithi078 ceph-mon[94114]: pgmap v1055: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.401+0000 7fbd23a10700 1 -- 172.21.15.35:0/3627163155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c105570 msgr2=0x7fbd1c10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.401+0000 7fbd23a10700 1 --2- 172.21.15.35:0/3627163155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c105570 0x7fbd1c10d0f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b0d0 tx=0x7fbd1400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 -- 172.21.15.35:0/3627163155 shutdown_connections 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 --2- 172.21.15.35:0/3627163155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c105570 0x7fbd1c10d0f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 --2- 172.21.15.35:0/3627163155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c1008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 --2- 172.21.15.35:0/3627163155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd1c100e70 0x7fbd1c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:15.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 -- 172.21.15.35:0/3627163155 >> 172.21.15.35:0/3627163155 conn(0x7fbd1c0fbd50 msgr2=0x7fbd1c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 -- 172.21.15.35:0/3627163155 shutdown_connections 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 -- 172.21.15.35:0/3627163155 wait complete. 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 Processor -- start 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.402+0000 7fbd23a10700 1 -- start start 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c100e70 0x7fbd1c196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd1c105570 0x7fbd1c19acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c19b2e0 con 0x7fbd1c1004d0 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c19b450 con 0x7fbd1c100e70 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c19b610 con 0x7fbd1c105570 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40306/0 (socket says 172.21.15.35:40306) 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 -- 172.21.15.35:0/115209094 learned_addr learned my addr 172.21.15.35:0/115209094 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd21fad700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd1c105570 0x7fbd1c19acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:15.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 -- 172.21.15.35:0/115209094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd1c105570 msgr2=0x7fbd1c19acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:16.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd1c105570 0x7fbd1c19acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:16.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 -- 172.21.15.35:0/115209094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c100e70 msgr2=0x7fbd1c196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:16.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd20fab700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c100e70 0x7fbd1c196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:16.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c100e70 0x7fbd1c196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:16.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 -- 172.21.15.35:0/115209094 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009d00 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd217ac700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c196320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800d950 tx=0x7fbd1800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18009b40 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c110160 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd18009ca0 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800f620 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.403+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c10ffd0 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.404+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c1102f0 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.405+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fbd18010460 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.406+0000 7fbd0e7fc700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbd0809f4d0 0x7fbd080a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.406+0000 7fbd20fab700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbd0809f4d0 0x7fbd080a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.406+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fbd180ca570 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.406+0000 7fbd20fab700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbd0809f4d0 0x7fbd080a1980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005fd0 tx=0x7fbd10005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.410+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fbd18094700 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.609+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd1c1a3400 con 0x7fbd1c1004d0 2023-03-17T08:19:16.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.610+0000 7fbd0e7fc700 1 -- 172.21.15.35:0/115209094 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7fbd18020090 con 0x7fbd1c1004d0 2023-03-17T08:19:16.049 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:19:16.049 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:19:16.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:14 smithi082 ceph-mon[94281]: pgmap v1056: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:17.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:14 smithi078 ceph-mon[94114]: pgmap v1056: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:17.386 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbd0809f4d0 msgr2=0x7fbd080a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:17.386 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbd0809f4d0 0x7fbd080a1980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd10005fd0 tx=0x7fbd10005ee0 comp rx=0 tx=0).stop 2023-03-17T08:19:17.386 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 msgr2=0x7fbd1c196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c196320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800d950 tx=0x7fbd1800dd10 comp rx=0 tx=0).stop 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 shutdown_connections 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd1c105570 0x7fbd1c19acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fbd0809f4d0 0x7fbd080a1980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd1c1004d0 0x7fbd1c196320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 --2- 172.21.15.35:0/115209094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd1c100e70 0x7fbd1c196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 >> 172.21.15.35:0/115209094 conn(0x7fbd1c0fbd50 msgr2=0x7fbd1c0fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 shutdown_connections 2023-03-17T08:19:17.387 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:09.612+0000 7fbd23a10700 1 -- 172.21.15.35:0/115209094 wait complete. 2023-03-17T08:19:17.389 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-03-17T08:19:18.776 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-03-17T08:19:18.777 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-03-17T08:19:18.777 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-03-17T08:19:18.778 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-03-17T08:19:18.778 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-03-17T08:19:19.325 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-03-17T08:19:19.325 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-03-17T08:19:19.326 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-03-17T08:19:19.326 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-03-17T08:19:19.326 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-03-17T08:19:19.327 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-03-17T08:19:19.328 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:10 smithi035 ceph-mon[92535]: pgmap v1054: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:19.328 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:10 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/115209094' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:19:19.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:12 smithi035 ceph-mon[92535]: pgmap v1055: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:19.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:14 smithi035 ceph-mon[92535]: pgmap v1056: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:19.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:16 smithi035 ceph-mon[92535]: pgmap v1057: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:19.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:18 smithi035 ceph-mon[92535]: pgmap v1058: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:19.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:16 smithi082 ceph-mon[94281]: pgmap v1057: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:20.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:18 smithi082 ceph-mon[94281]: pgmap v1058: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:20.642 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:16 smithi078 ceph-mon[94114]: pgmap v1057: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:20.642 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:18 smithi078 ceph-mon[94114]: pgmap v1058: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:20.647 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:21.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:20 smithi082 ceph-mon[94281]: pgmap v1059: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:21.623 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:20 smithi078 ceph-mon[94114]: pgmap v1059: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:22.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:20 smithi035 ceph-mon[92535]: pgmap v1059: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:22.222 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:22.222 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:23.088 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:23.270 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:23.271 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:23.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:22 smithi035 ceph-mon[92535]: pgmap v1060: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:23.271 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:23.271 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:23.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:22 smithi082 ceph-mon[94281]: pgmap v1060: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:23.714 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:22 smithi078 ceph-mon[94114]: pgmap v1060: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:24.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 -- 172.21.15.35:0/3013393404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c104490 msgr2=0x7f603c10c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:24.288 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 --2- 172.21.15.35:0/3013393404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c104490 0x7f603c10c010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f603400b0d0 tx=0x7f603400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:19:24.288 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 -- 172.21.15.35:0/3013393404 shutdown_connections 2023-03-17T08:19:24.288 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 --2- 172.21.15.35:0/3013393404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c104490 0x7f603c10c010 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:24.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 --2- 172.21.15.35:0/3013393404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0ff3f0 0x7f603c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:24.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 --2- 172.21.15.35:0/3013393404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f603c0ffd90 0x7f603c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:24.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 -- 172.21.15.35:0/3013393404 >> 172.21.15.35:0/3013393404 conn(0x7f603c077030 msgr2=0x7f603c077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:24.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 -- 172.21.15.35:0/3013393404 shutdown_connections 2023-03-17T08:19:24.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.085+0000 7f60425a8700 1 -- 172.21.15.35:0/3013393404 wait complete. 2023-03-17T08:19:25.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 Processor -- start 2023-03-17T08:19:25.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 -- start start 2023-03-17T08:19:25.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:24 smithi082 ceph-mon[94281]: pgmap v1061: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:25.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:24 smithi078 ceph-mon[94114]: pgmap v1061: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:25.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0ff3f0 0x7f603c196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:25.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c0ffd90 0x7f603c196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:25.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f603c104490 0x7f603c19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:25.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c19b3e0 con 0x7f603c0ffd90 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c19b550 con 0x7f603c0ff3f0 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f60425a8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c19b710 con 0x7f603c104490 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c0ffd90 0x7f603c196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c0ffd90 0x7f603c196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40322/0 (socket says 172.21.15.35:40322) 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 -- 172.21.15.35:0/1804149928 learned_addr learned my addr 172.21.15.35:0/1804149928 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603bfff700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0ff3f0 0x7f603c196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 -- 172.21.15.35:0/1804149928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f603c104490 msgr2=0x7f603c19add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f603c104490 0x7f603c19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:25.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 -- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0ff3f0 msgr2=0x7f603c196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f603c0ff3f0 0x7f603c196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.086+0000 7f603b7fe700 1 -- 172.21.15.35:0/1804149928 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009d00 con 0x7f603c0ffd90 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.087+0000 7f603b7fe700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c0ffd90 0x7f603c196960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f603000d980 tx=0x7f603000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.087+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030009b40 con 0x7f603c0ffd90 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.087+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f603000de60 con 0x7f603c0ffd90 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.087+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c110220 con 0x7f603c0ffd90 2023-03-17T08:19:25.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.087+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000f620 con 0x7f603c0ffd90 2023-03-17T08:19:25.982 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.087+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c110090 con 0x7f603c0ffd90 2023-03-17T08:19:25.982 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.088+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f603c0fd680 con 0x7f603c0ffd90 2023-03-17T08:19:25.982 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.089+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f6030010460 con 0x7f603c0ffd90 2023-03-17T08:19:25.982 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f60397fa700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f602409f4d0 0x7f60240a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:25.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f603bfff700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f602409f4d0 0x7f60240a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:25.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f60300ca1e0 con 0x7f603c0ffd90 2023-03-17T08:19:25.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f60397fa700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] conn(0x7f60240a8f00 0x7f60240ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:25.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 --> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60240aba60 con 0x7f60240a8f00 2023-03-17T08:19:25.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60300ca630 con 0x7f603c0ffd90 2023-03-17T08:19:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f6040b45700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] conn(0x7f60240a8f00 0x7f60240ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.090+0000 7f603bfff700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f602409f4d0 0x7f60240a1980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f602c006fd0 tx=0x7f602c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.091+0000 7f6040b45700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] conn(0x7f60240a8f00 0x7f60240ab390 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.091+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== osd.4 v2:172.21.15.78:6808/3925179759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f60240aba60 con 0x7f60240a8f00 2023-03-17T08:19:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.108+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 --> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f603c1103b0 con 0x7f60240a8f00 2023-03-17T08:19:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60397fa700 1 -- 172.21.15.35:0/1804149928 <== osd.4 v2:172.21.15.78:6808/3925179759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f603c1103b0 con 0x7f60240a8f00 2023-03-17T08:19:26.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:26 smithi082 ceph-mon[94281]: pgmap v1062: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:28.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:26 smithi078 ceph-mon[94114]: pgmap v1062: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:28.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] conn(0x7f60240a8f00 msgr2=0x7f60240ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:28.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] conn(0x7f60240a8f00 0x7f60240ab390 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:28.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f602409f4d0 msgr2=0x7f60240a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f602409f4d0 0x7f60240a1980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f602c006fd0 tx=0x7f602c008040 comp rx=0 tx=0).stop 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c0ffd90 msgr2=0x7f603c196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 --2- 172.21.15.35:0/1804149928 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f603c0ffd90 0x7f603c196960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f603000d980 tx=0x7f603000dd40 comp rx=0 tx=0).stop 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f6040b45700 1 -- 172.21.15.35:0/1804149928 reap_dead start 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 shutdown_connections 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 >> 172.21.15.35:0/1804149928 conn(0x7f603c077030 msgr2=0x7f603c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 shutdown_connections 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.109+0000 7f60425a8700 1 -- 172.21.15.35:0/1804149928 wait complete. 2023-03-17T08:19:28.138 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:28.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:24 smithi035 ceph-mon[92535]: pgmap v1061: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 -- 172.21.15.35:0/3127160158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c105590 msgr2=0x7f5b1c10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 --2- 172.21.15.35:0/3127160158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c105590 0x7f5b1c10d110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400b0d0 tx=0x7f5b1400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 -- 172.21.15.35:0/3127160158 shutdown_connections 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 --2- 172.21.15.35:0/3127160158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c105590 0x7f5b1c10d110 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 --2- 172.21.15.35:0/3127160158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c1004f0 0x7f5b1c1008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:28.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 --2- 172.21.15.35:0/3127160158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b1c100e90 0x7f5b1c104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:28.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 -- 172.21.15.35:0/3127160158 >> 172.21.15.35:0/3127160158 conn(0x7f5b1c0fbd70 msgr2=0x7f5b1c0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:28.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 -- 172.21.15.35:0/3127160158 shutdown_connections 2023-03-17T08:19:28.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.705+0000 7f5b215ab700 1 -- 172.21.15.35:0/3127160158 wait complete. 2023-03-17T08:19:28.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 Processor -- start 2023-03-17T08:19:28.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 -- start start 2023-03-17T08:19:28.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c1004f0 0x7f5b1c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:28.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c100e90 0x7f5b1c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:28.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b1c105590 0x7f5b1c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:28.755 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c19b2d0 con 0x7f5b1c100e90 2023-03-17T08:19:28.755 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c19b440 con 0x7f5b1c105590 2023-03-17T08:19:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b215ab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c19b600 con 0x7f5b1c1004f0 2023-03-17T08:19:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.706+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c100e90 0x7f5b1c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:29.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c100e90 0x7f5b1c1968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40338/0 (socket says 172.21.15.35:40338) 2023-03-17T08:19:31.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 -- 172.21.15.35:0/1018433484 learned_addr learned my addr 172.21.15.35:0/1018433484 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:19:31.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b1affd700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c1004f0 0x7f5b1c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:31.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b1b7fe700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b1c105590 0x7f5b1c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:31.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 -- 172.21.15.35:0/1018433484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c1004f0 msgr2=0x7f5b1c1963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:31.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b1c1004f0 0x7f5b1c1963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:31.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 -- 172.21.15.35:0/1018433484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b1c105590 msgr2=0x7f5b1c19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:31.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b1c105590 0x7f5b1c19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:31.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 -- 172.21.15.35:0/1018433484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009d00 con 0x7f5b1c100e90 2023-03-17T08:19:31.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b13fff700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c100e90 0x7f5b1c1968f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e970 tx=0x7f5b0400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:31.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04009790 con 0x7f5b1c100e90 2023-03-17T08:19:32.426 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c110130 con 0x7f5b1c100e90 2023-03-17T08:19:32.426 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b0400eec0 con 0x7f5b1c100e90 2023-03-17T08:19:32.426 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.707+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b040054b0 con 0x7f5b1c100e90 2023-03-17T08:19:32.426 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.708+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c10ffa0 con 0x7f5b1c100e90 2023-03-17T08:19:32.427 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.708+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b1c0fd1a0 con 0x7f5b1c100e90 2023-03-17T08:19:33.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.709+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f5b04005610 con 0x7f5b1c100e90 2023-03-17T08:19:33.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b18ff9700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5b0809f4d0 0x7f5b080a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:33.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5b04014070 con 0x7f5b1c100e90 2023-03-17T08:19:33.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b1affd700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5b0809f4d0 0x7f5b080a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b18ff9700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] conn(0x7f5b080a8f00 0x7f5b080ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 --> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b080aba60 con 0x7f5b080a8f00 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b040cab70 con 0x7f5b1c100e90 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.710+0000 7f5b1b7fe700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] conn(0x7f5b080a8f00 0x7f5b080ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.711+0000 7f5b1affd700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5b0809f4d0 0x7f5b080a1980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00ac50 tx=0x7f5b0c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.711+0000 7f5b1b7fe700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] conn(0x7f5b080a8f00 0x7f5b080ab390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.711+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== osd.0 v2:172.21.15.35:6802/1205838363 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5b080aba60 con 0x7f5b080a8f00 2023-03-17T08:19:36.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.727+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 --> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b1c1102c0 con 0x7f5b080a8f00 2023-03-17T08:19:37.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b18ff9700 1 -- 172.21.15.35:0/1018433484 <== osd.0 v2:172.21.15.35:6802/1205838363 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b1c1102c0 con 0x7f5b080a8f00 2023-03-17T08:19:37.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] conn(0x7f5b080a8f00 msgr2=0x7f5b080ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:37.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] conn(0x7f5b080a8f00 0x7f5b080ab390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:37.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5b0809f4d0 msgr2=0x7f5b080a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:37.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5b0809f4d0 0x7f5b080a1980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00ac50 tx=0x7f5b0c00a380 comp rx=0 tx=0).stop 2023-03-17T08:19:37.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c100e90 msgr2=0x7f5b1c1968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 --2- 172.21.15.35:0/1018433484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5b1c100e90 0x7f5b1c1968f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400e970 tx=0x7f5b0400ec80 comp rx=0 tx=0).stop 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b1b7fe700 1 -- 172.21.15.35:0/1018433484 reap_dead start 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 shutdown_connections 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 >> 172.21.15.35:0/1018433484 conn(0x7f5b1c0fbd70 msgr2=0x7f5b1c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 shutdown_connections 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:24.728+0000 7f5b215ab700 1 -- 172.21.15.35:0/1018433484 wait complete. 2023-03-17T08:19:37.292 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:37.293 INFO:teuthology.orchestra.run.smithi035.stdout:34359738619 2023-03-17T08:19:37.294 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-03-17T08:19:38.527 INFO:teuthology.orchestra.run.smithi035.stdout:146028888271 2023-03-17T08:19:40.146 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-03-17T08:19:40.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:26 smithi035 ceph-mon[92535]: pgmap v1062: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:40.147 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:19:40.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:28 smithi082 ceph-mon[94281]: pgmap v1063: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:40.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:30 smithi082 ceph-mon[94281]: pgmap v1064: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:19:40.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:32 smithi082 ceph-mon[94281]: pgmap v1065: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:40.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:34 smithi082 ceph-mon[94281]: pgmap v1066: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T08:19:40.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:36 smithi082 ceph-mon[94281]: pgmap v1067: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:41.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:38 smithi082 ceph-mon[94281]: pgmap v1068: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-17T08:19:41.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:28 smithi078 ceph-mon[94114]: pgmap v1063: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:19:41.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:30 smithi078 ceph-mon[94114]: pgmap v1064: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:19:41.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:32 smithi078 ceph-mon[94114]: pgmap v1065: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:19:41.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:34 smithi078 ceph-mon[94114]: pgmap v1066: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T08:19:41.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:36 smithi078 ceph-mon[94114]: pgmap v1067: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:19:41.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:38 smithi078 ceph-mon[94114]: pgmap v1068: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-17T08:19:41.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:40 smithi082 ceph-mon[94281]: pgmap v1069: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:41.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:40 smithi078 ceph-mon[94114]: pgmap v1069: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 -- 172.21.15.35:0/590305464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 msgr2=0x7f2b380ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/590305464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b380ff890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2b280099c0 tx=0x7f2b28009cd0 comp rx=0 tx=0).stop 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 -- 172.21.15.35:0/590305464 shutdown_connections 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/590305464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b38104560 0x7f2b3810c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/590305464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b380ff890 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/590305464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380ffe60 0x7f2b38103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 -- 172.21.15.35:0/590305464 >> 172.21.15.35:0/590305464 conn(0x7f2b38076060 msgr2=0x7f2b38076460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 -- 172.21.15.35:0/590305464 shutdown_connections 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.796+0000 7f2b3d26a700 1 -- 172.21.15.35:0/590305464 wait complete. 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 Processor -- start 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 -- start start 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b38196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380ffe60 0x7f2b38196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:41.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b38104560 0x7f2b3819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:41.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3819b2e0 con 0x7f2b380ff4c0 2023-03-17T08:19:41.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3819b450 con 0x7f2b38104560 2023-03-17T08:19:41.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b3d26a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3819b610 con 0x7f2b380ffe60 2023-03-17T08:19:41.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b38196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:41.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b38196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40382/0 (socket says 172.21.15.35:40382) 2023-03-17T08:19:41.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 -- 172.21.15.35:0/3357812458 learned_addr learned my addr 172.21.15.35:0/3357812458 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:19:41.807 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b38104560 0x7f2b3819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b2ffff700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380ffe60 0x7f2b38196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 -- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380ffe60 msgr2=0x7f2b38196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380ffe60 0x7f2b38196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 -- 172.21.15.35:0/3357812458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b38104560 msgr2=0x7f2b3819acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b38104560 0x7f2b3819acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.797+0000 7f2b36ffd700 1 -- 172.21.15.35:0/3357812458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280095f0 con 0x7f2b380ff4c0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b377fe700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b38104560 0x7f2b3819acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b36ffd700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b38196320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b28000c00 tx=0x7f2b28005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2801d070 con 0x7f2b380ff4c0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3810f1a0 con 0x7f2b380ff4c0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b2800fe70 con 0x7f2b380ff4c0 2023-03-17T08:19:41.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280173f0 con 0x7f2b380ff4c0 2023-03-17T08:19:41.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.798+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3810f010 con 0x7f2b380ff4c0 2023-03-17T08:19:41.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.800+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b380692d0 con 0x7f2b380ff4c0 2023-03-17T08:19:41.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.801+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f2b2800f9e0 con 0x7f2b380ff4c0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.801+0000 7f2b34ff9700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b2409f4d0 0x7f2b240a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.801+0000 7f2b2ffff700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b2409f4d0 0x7f2b240a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.801+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f2b280cb3b0 con 0x7f2b380ff4c0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.802+0000 7f2b34ff9700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] conn(0x7f2b240a8f00 0x7f2b240ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.802+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 --> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b240aba60 con 0x7f2b240a8f00 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.802+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b280cda70 con 0x7f2b380ff4c0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.802+0000 7f2b2ffff700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b2409f4d0 0x7f2b240a1980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b38197940 tx=0x7f2b20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.802+0000 7f2b377fe700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] conn(0x7f2b240a8f00 0x7f2b240ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.802+0000 7f2b377fe700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] conn(0x7f2b240a8f00 0x7f2b240ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.803+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== osd.5 v2:172.21.15.82:6808/3768446806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2b240aba60 con 0x7f2b240a8f00 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.820+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 --> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b3810f330 con 0x7f2b240a8f00 2023-03-17T08:19:42.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.821+0000 7f2b34ff9700 1 -- 172.21.15.35:0/3357812458 <== osd.5 v2:172.21.15.82:6808/3768446806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2b3810f330 con 0x7f2b240a8f00 2023-03-17T08:19:42.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] conn(0x7f2b240a8f00 msgr2=0x7f2b240ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:44.114 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] conn(0x7f2b240a8f00 0x7f2b240ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:44.114 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b2409f4d0 msgr2=0x7f2b240a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:44.114 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2b2409f4d0 0x7f2b240a1980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b38197940 tx=0x7f2b20009260 comp rx=0 tx=0).stop 2023-03-17T08:19:44.114 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 msgr2=0x7f2b38196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:46.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 --2- 172.21.15.35:0/3357812458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b380ff4c0 0x7f2b38196320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b28000c00 tx=0x7f2b28005f10 comp rx=0 tx=0).stop 2023-03-17T08:19:46.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b377fe700 1 -- 172.21.15.35:0/3357812458 reap_dead start 2023-03-17T08:19:46.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 shutdown_connections 2023-03-17T08:19:46.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 >> 172.21.15.35:0/3357812458 conn(0x7f2b38076060 msgr2=0x7f2b38103010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:46.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 shutdown_connections 2023-03-17T08:19:46.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.822+0000 7f2b3d26a700 1 -- 172.21.15.35:0/3357812458 wait complete. 2023-03-17T08:19:46.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 -- 172.21.15.35:0/2519843136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440fe7c0 msgr2=0x7f20440fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:48.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2519843136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440fe7c0 0x7f20440fec30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20380098f0 tx=0x7f2038009c00 comp rx=0 tx=0).stop 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 -- 172.21.15.35:0/2519843136 shutdown_connections 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2519843136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20440ff170 0x7f204410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2519843136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 0x7f20441055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2519843136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440fe7c0 0x7f20440fec30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 -- 172.21.15.35:0/2519843136 >> 172.21.15.35:0/2519843136 conn(0x7f2044075830 msgr2=0x7f2044075c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 -- 172.21.15.35:0/2519843136 shutdown_connections 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.539+0000 7f2048b5a700 1 -- 172.21.15.35:0/2519843136 wait complete. 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.540+0000 7f2048b5a700 1 Processor -- start 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.540+0000 7f2048b5a700 1 -- start start 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.540+0000 7f2048b5a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20440fe7c0 0x7f204410bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.540+0000 7f2048b5a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440ff170 0x7f204410c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2048b5a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 0x7f20441b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2048b5a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204410cbc0 con 0x7f2044105220 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2048b5a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20441b14b0 con 0x7f20440ff170 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2048b5a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20441b15f0 con 0x7f20440fe7c0 2023-03-17T08:19:48.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 0x7f20441b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 0x7f20441b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40372/0 (socket says 172.21.15.35:40372) 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 -- 172.21.15.35:0/2843575665 learned_addr learned my addr 172.21.15.35:0/2843575665 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f204259c700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20440fe7c0 0x7f204410bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2041d9b700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440ff170 0x7f204410c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 -- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20440fe7c0 msgr2=0x7f204410bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20440fe7c0 0x7f204410bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 -- 172.21.15.35:0/2843575665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440ff170 msgr2=0x7f204410c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20440ff170 0x7f204410c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 -- 172.21.15.35:0/2843575665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009520 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f2042d9d700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 0x7f20441b0f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f203c00ef60 tx=0x7f203c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c018070 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.541+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f203c00f040 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.542+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2044110250 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.542+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00cd00 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.542+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20441100c0 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.542+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2044104850 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.544+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f203c004ad0 con 0x7f2044105220 2023-03-17T08:19:48.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.545+0000 7f20337fe700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f202c09f4d0 0x7f202c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.545+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f203c0cab00 con 0x7f2044105220 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.545+0000 7f204259c700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f202c09f4d0 0x7f202c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.545+0000 7f20337fe700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] conn(0x7f202c0a8f00 0x7f202c0ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.545+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 --> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f202c0aba60 con 0x7f202c0a8f00 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.545+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f203c0caf50 con 0x7f2044105220 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.546+0000 7f2041d9b700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] conn(0x7f202c0a8f00 0x7f202c0ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:19:48.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.546+0000 7f204259c700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f202c09f4d0 0x7f202c0a1980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2034005fd0 tx=0x7f2034009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:48.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.546+0000 7f2041d9b700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] conn(0x7f202c0a8f00 0x7f202c0ab390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.547+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== osd.2 v2:172.21.15.82:6800/191062504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f202c0aba60 con 0x7f202c0a8f00 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.566+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 --> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20441103e0 con 0x7f202c0a8f00 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.566+0000 7f20337fe700 1 -- 172.21.15.35:0/2843575665 <== osd.2 v2:172.21.15.82:6800/191062504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20441103e0 con 0x7f202c0a8f00 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] conn(0x7f202c0a8f00 msgr2=0x7f202c0ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] conn(0x7f202c0a8f00 0x7f202c0ab390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f202c09f4d0 msgr2=0x7f202c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f202c09f4d0 0x7f202c0a1980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2034005fd0 tx=0x7f2034009310 comp rx=0 tx=0).stop 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 msgr2=0x7f20441b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:19:51.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 --2- 172.21.15.35:0/2843575665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2044105220 0x7f20441b0f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f203c00ef60 tx=0x7f203c00ef90 comp rx=0 tx=0).stop 2023-03-17T08:19:52.143 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2042d9d700 1 -- 172.21.15.35:0/2843575665 reap_dead start 2023-03-17T08:19:56.136 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 shutdown_connections 2023-03-17T08:19:56.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 >> 172.21.15.35:0/2843575665 conn(0x7f2044075830 msgr2=0x7f2044103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:19:56.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 shutdown_connections 2023-03-17T08:19:57.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.567+0000 7f2048b5a700 1 -- 172.21.15.35:0/2843575665 wait complete. 2023-03-17T08:19:57.804 INFO:teuthology.orchestra.run.smithi035.stdout:77309411559 2023-03-17T08:19:57.804 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-03-17T08:19:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:42 smithi082 ceph-mon[94281]: pgmap v1070: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:44 smithi082 ceph-mon[94281]: pgmap v1071: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:46 smithi082 ceph-mon[94281]: pgmap v1072: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:48 smithi082 ceph-mon[94281]: pgmap v1073: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:50 smithi082 ceph-mon[94281]: pgmap v1074: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:52 smithi082 ceph-mon[94281]: pgmap v1075: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:53 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:20:00.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:54 smithi082 ceph-mon[94281]: pgmap v1076: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:03.237 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:20:03.237 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:20:03.237 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:20:04.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:56 smithi082 ceph-mon[94281]: pgmap v1077: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:04.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:42 smithi078 ceph-mon[94114]: pgmap v1070: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:05.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:44 smithi078 ceph-mon[94114]: pgmap v1071: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:20:05.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:46 smithi078 ceph-mon[94114]: pgmap v1072: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T08:20:05.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:48 smithi078 ceph-mon[94114]: pgmap v1073: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T08:20:05.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:50 smithi078 ceph-mon[94114]: pgmap v1074: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:20:05.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:52 smithi078 ceph-mon[94114]: pgmap v1075: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:05.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:53 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:20:06.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:54 smithi078 ceph-mon[94114]: pgmap v1076: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:06.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:20:06.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:20:06.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:20:06.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:56 smithi078 ceph-mon[94114]: pgmap v1077: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 -- 172.21.15.35:0/1640882153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 msgr2=0x7fe0900fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 --2- 172.21.15.35:0/1640882153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0900fec30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe080009990 tx=0x7fe080009ca0 comp rx=0 tx=0).stop 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 -- 172.21.15.35:0/1640882153 shutdown_connections 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 --2- 172.21.15.35:0/1640882153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0900ff170 0x7fe09010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 --2- 172.21.15.35:0/1640882153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe090105220 0x7fe0901055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 --2- 172.21.15.35:0/1640882153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0900fec30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 -- 172.21.15.35:0/1640882153 >> 172.21.15.35:0/1640882153 conn(0x7fe090075830 msgr2=0x7fe090075c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 -- 172.21.15.35:0/1640882153 shutdown_connections 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 -- 172.21.15.35:0/1640882153 wait complete. 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.638+0000 7fe095f89700 1 Processor -- start 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 -- start start 2023-03-17T08:20:06.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0901962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0900ff170 0x7fe090196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe090105220 0x7fe09019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09019b280 con 0x7fe0900fe7c0 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09019b3f0 con 0x7fe0900ff170 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe095f89700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09019b5b0 con 0x7fe090105220 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0901962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0900ff170 0x7fe090196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0901962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40398/0 (socket says 172.21.15.35:40398) 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 -- 172.21.15.35:0/1266985863 learned_addr learned my addr 172.21.15.35:0/1266985863 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 -- 172.21.15.35:0/1266985863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe090105220 msgr2=0x7fe09019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08ffff700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe090105220 0x7fe09019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe090105220 0x7fe09019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 -- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0900ff170 msgr2=0x7fe090196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0900ff170 0x7fe090196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 -- 172.21.15.35:0/1266985863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800095f0 con 0x7fe0900fe7c0 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08effd700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0900ff170 0x7fe090196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.639+0000 7fe08f7fe700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0901962c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe08400d950 tx=0x7fe08400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:06.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.640+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084009940 con 0x7fe0900fe7c0 2023-03-17T08:20:06.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.640+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe084010460 con 0x7fe0900fe7c0 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.640+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe090110250 con 0x7fe0900fe7c0 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.640+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08400f620 con 0x7fe0900fe7c0 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.640+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0901100c0 con 0x7fe0900fe7c0 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.641+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0900fdaf0 con 0x7fe0900fe7c0 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.642+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fe0840105d0 con 0x7fe0900fe7c0 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.642+0000 7fe08cff9700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe07809f550 0x7fe0780a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:08.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.642+0000 7fe08effd700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe07809f550 0x7fe0780a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:08.091 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe0840ca460 con 0x7fe0900fe7c0 2023-03-17T08:20:08.091 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08cff9700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] conn(0x7fe0780a8f80 0x7fe0780ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:08.091 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 --> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0780abae0 con 0x7fe0780a8f80 2023-03-17T08:20:08.091 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0840ca8b0 con 0x7fe0900fe7c0 2023-03-17T08:20:08.091 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08effd700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe07809f550 0x7fe0780a1a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe0901978e0 tx=0x7fe080005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:08.091 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08ffff700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] conn(0x7fe0780a8f80 0x7fe0780ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:09.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.643+0000 7fe08ffff700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] conn(0x7fe0780a8f80 0x7fe0780ab410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:09.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.644+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== osd.7 v2:172.21.15.78:6816/403506254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe0780abae0 con 0x7fe0780a8f80 2023-03-17T08:20:09.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.660+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 --> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe0901103e0 con 0x7fe0780a8f80 2023-03-17T08:20:09.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe08cff9700 1 -- 172.21.15.35:0/1266985863 <== osd.7 v2:172.21.15.78:6816/403506254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe0901103e0 con 0x7fe0780a8f80 2023-03-17T08:20:09.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] conn(0x7fe0780a8f80 msgr2=0x7fe0780ab410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] conn(0x7fe0780a8f80 0x7fe0780ab410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe07809f550 msgr2=0x7fe0780a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe07809f550 0x7fe0780a1a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe0901978e0 tx=0x7fe080005fb0 comp rx=0 tx=0).stop 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 msgr2=0x7fe0901962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 --2- 172.21.15.35:0/1266985863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0900fe7c0 0x7fe0901962c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe08400d950 tx=0x7fe08400dc60 comp rx=0 tx=0).stop 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe08ffff700 1 -- 172.21.15.35:0/1266985863 reap_dead start 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 shutdown_connections 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 >> 172.21.15.35:0/1266985863 conn(0x7fe090075830 msgr2=0x7fe0900fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 shutdown_connections 2023-03-17T08:20:09.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:27.661+0000 7fe095f89700 1 -- 172.21.15.35:0/1266985863 wait complete. 2023-03-17T08:20:09.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 -- 172.21.15.35:0/2944374269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef24104460 msgr2=0x7fef2410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:10.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/2944374269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef24104460 0x7fef2410bfe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fc0 tx=0x7fef1c00b330 comp rx=0 tx=0).stop 2023-03-17T08:20:10.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 -- 172.21.15.35:0/2944374269 shutdown_connections 2023-03-17T08:20:10.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/2944374269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef24104460 0x7fef2410bfe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:10.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/2944374269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef240ff3c0 0x7fef240ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:10.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/2944374269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 0x7fef24103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:10.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 -- 172.21.15.35:0/2944374269 >> 172.21.15.35:0/2944374269 conn(0x7fef240fac20 msgr2=0x7fef240fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:10.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 -- 172.21.15.35:0/2944374269 shutdown_connections 2023-03-17T08:20:10.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.431+0000 7fef2b7d4700 1 -- 172.21.15.35:0/2944374269 wait complete. 2023-03-17T08:20:10.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 Processor -- start 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 -- start start 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef240ff3c0 0x7fef24197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 0x7fef241976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef24104460 0x7fef241a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24198010 con 0x7fef240ff3c0 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241a2750 con 0x7fef240ffd60 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.432+0000 7fef2b7d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241a2910 con 0x7fef24104460 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 0x7fef241976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:12.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 0x7fef241976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:42152/0 (socket says 172.21.15.35:42152) 2023-03-17T08:20:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 -- 172.21.15.35:0/1839170721 learned_addr learned my addr 172.21.15.35:0/1839170721 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:20:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef29d71700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef24104460 0x7fef241a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef29570700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef240ff3c0 0x7fef24197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 -- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef24104460 msgr2=0x7fef241a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef24104460 0x7fef241a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 -- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef240ff3c0 msgr2=0x7fef24197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:13.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fef240ff3c0 0x7fef24197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:13.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 -- 172.21.15.35:0/1839170721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009c40 con 0x7fef240ffd60 2023-03-17T08:20:13.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.433+0000 7fef28d6f700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 0x7fef241976d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef1400e9f0 tx=0x7fef1400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.434+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14009690 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.434+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1400ce50 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.434+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2410f070 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.434+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14018420 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.434+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2410eee0 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.435+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef240fc0b0 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.436+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fef1400c9c0 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.436+0000 7fef1a7fc700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fef1009f4d0 0x7fef100a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.437+0000 7fef29570700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fef1009f4d0 0x7fef100a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.437+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fef14014070 con 0x7fef240ffd60 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.437+0000 7fef1a7fc700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] conn(0x7fef100a8f00 0x7fef100ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:13.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.437+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 --> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef100aba60 con 0x7fef100a8f00 2023-03-17T08:20:14.206 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.437+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== mon.2 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef140cab00 con 0x7fef240ffd60 2023-03-17T08:20:14.206 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.437+0000 7fef29d71700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] conn(0x7fef100a8f00 0x7fef100ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:14.206 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.438+0000 7fef29570700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fef1009f4d0 0x7fef100a1980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fef20009c60 tx=0x7fef20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:14.206 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.438+0000 7fef29d71700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] conn(0x7fef100a8f00 0x7fef100ab390 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:14.206 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.438+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== osd.8 v2:172.21.15.82:6816/1378962246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fef100aba60 con 0x7fef100a8f00 2023-03-17T08:20:14.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.458+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 --> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef2410f200 con 0x7fef100a8f00 2023-03-17T08:20:15.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.459+0000 7fef1a7fc700 1 -- 172.21.15.35:0/1839170721 <== osd.8 v2:172.21.15.82:6816/1378962246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fef2410f200 con 0x7fef100a8f00 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.459+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] conn(0x7fef100a8f00 msgr2=0x7fef100ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.459+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] conn(0x7fef100a8f00 0x7fef100ab390 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.459+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fef1009f4d0 msgr2=0x7fef100a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.459+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fef1009f4d0 0x7fef100a1980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fef20009c60 tx=0x7fef20009260 comp rx=0 tx=0).stop 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 msgr2=0x7fef241976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef2b7d4700 1 --2- 172.21.15.35:0/1839170721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef240ffd60 0x7fef241976d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef1400e9f0 tx=0x7fef1400ed00 comp rx=0 tx=0).stop 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef29d71700 1 -- 172.21.15.35:0/1839170721 reap_dead start 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 shutdown_connections 2023-03-17T08:20:15.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 >> 172.21.15.35:0/1839170721 conn(0x7fef240fac20 msgr2=0x7fef240fb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:16.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 shutdown_connections 2023-03-17T08:20:16.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:26.460+0000 7fef2b7d4700 1 -- 172.21.15.35:0/1839170721 wait complete. 2023-03-17T08:20:16.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:19:58 smithi082 ceph-mon[94281]: pgmap v1078: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:16.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:00 smithi082 ceph-mon[94281]: pgmap v1079: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:16.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T08:20:16.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:02 smithi082 ceph-mon[94281]: pgmap v1080: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:16.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:04 smithi082 ceph-mon[94281]: pgmap v1081: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:16.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:06 smithi082 ceph-mon[94281]: pgmap v1082: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:16.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:08 smithi082 ceph-mon[94281]: pgmap v1083: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:16.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:10 smithi082 ceph-mon[94281]: pgmap v1084: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:18.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:12 smithi082 ceph-mon[94281]: pgmap v1085: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:18.078 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:14 smithi082 ceph-mon[94281]: pgmap v1086: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:18.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:19:58 smithi078 ceph-mon[94114]: pgmap v1078: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:19.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:00 smithi078 ceph-mon[94114]: pgmap v1079: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:19.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T08:20:19.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:02 smithi078 ceph-mon[94114]: pgmap v1080: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:19.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:04 smithi078 ceph-mon[94114]: pgmap v1081: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:20.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:06 smithi078 ceph-mon[94114]: pgmap v1082: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:24.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:08 smithi078 ceph-mon[94114]: pgmap v1083: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:24.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:10 smithi078 ceph-mon[94114]: pgmap v1084: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:24.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:12 smithi078 ceph-mon[94114]: pgmap v1085: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:24.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:14 smithi078 ceph-mon[94114]: pgmap v1086: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:24.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 -- 172.21.15.35:0/2389679467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 msgr2=0x7f894c1008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 --2- 172.21.15.35:0/2389679467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c1008a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f893c0099c0 tx=0x7f893c009cd0 comp rx=0 tx=0).stop 2023-03-17T08:20:27.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 -- 172.21.15.35:0/2389679467 shutdown_connections 2023-03-17T08:20:27.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 --2- 172.21.15.35:0/2389679467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f894c105570 0x7f894c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 --2- 172.21.15.35:0/2389679467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c1008a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 --2- 172.21.15.35:0/2389679467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f894c100e70 0x7f894c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 -- 172.21.15.35:0/2389679467 >> 172.21.15.35:0/2389679467 conn(0x7f894c0fbd50 msgr2=0x7f894c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 -- 172.21.15.35:0/2389679467 shutdown_connections 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.375+0000 7f8950995700 1 -- 172.21.15.35:0/2389679467 wait complete. 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 Processor -- start 2023-03-17T08:20:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 -- start start 2023-03-17T08:20:28.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:28.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f894c100e70 0x7f894c196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:28.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f894c105570 0x7f894c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:28.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c19b1f0 con 0x7f894c1004d0 2023-03-17T08:20:28.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c19b360 con 0x7f894c105570 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8950995700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c19b520 con 0x7f894c100e70 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f894a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f894a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40414/0 (socket says 172.21.15.35:40414) 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f894a59c700 1 -- 172.21.15.35:0/1155617668 learned_addr learned my addr 172.21.15.35:0/1155617668 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.376+0000 7f8949d9b700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f894c100e70 0x7f894c196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894ad9d700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f894c105570 0x7f894c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894a59c700 1 -- 172.21.15.35:0/1155617668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f894c100e70 msgr2=0x7f894c196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894a59c700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f894c100e70 0x7f894c196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894a59c700 1 -- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f894c105570 msgr2=0x7f894c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894a59c700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f894c105570 0x7f894c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:29.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894a59c700 1 -- 172.21.15.35:0/1155617668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0095f0 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894ad9d700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f894c105570 0x7f894c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f894a59c700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c196230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f893c005910 tx=0x7f893c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c01d070 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f893c0054e0 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c110160 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c004ab0 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.377+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c10ffd0 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.378+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f894c0fd1d0 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.380+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f893c00fb80 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f893b7fe700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f893409f4d0 0x7f89340a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f8949d9b700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f893409f4d0 0x7f89340a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f893c0cb7a0 con 0x7f894c1004d0 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f893b7fe700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] conn(0x7f89340a8f00 0x7f89340ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 --> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89340aba60 con 0x7f89340a8f00 2023-03-17T08:20:29.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f893c0cbbf0 con 0x7f894c1004d0 2023-03-17T08:20:29.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f8949d9b700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f893409f4d0 0x7f89340a1980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f894c197850 tx=0x7f8940009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:31.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.381+0000 7f894ad9d700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] conn(0x7f89340a8f00 0x7f89340ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:31.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.382+0000 7f894ad9d700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] conn(0x7f89340a8f00 0x7f89340ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:31.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.383+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== osd.1 v2:172.21.15.78:6800/3727253677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f89340aba60 con 0x7f89340a8f00 2023-03-17T08:20:31.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.400+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 --> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f894c1102f0 con 0x7f89340a8f00 2023-03-17T08:20:31.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f893b7fe700 1 -- 172.21.15.35:0/1155617668 <== osd.1 v2:172.21.15.78:6800/3727253677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f894c1102f0 con 0x7f89340a8f00 2023-03-17T08:20:31.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:16 smithi078 ceph-mon[94114]: pgmap v1087: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:31.477 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:18 smithi078 ceph-mon[94114]: pgmap v1088: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:33.126 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:20 smithi078 ceph-mon[94114]: pgmap v1089: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:33.127 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:22 smithi078 ceph-mon[94114]: pgmap v1090: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:33.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:16 smithi082 ceph-mon[94281]: pgmap v1087: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:33.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:18 smithi082 ceph-mon[94281]: pgmap v1088: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:33.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:20 smithi082 ceph-mon[94281]: pgmap v1089: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:33.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:22 smithi082 ceph-mon[94281]: pgmap v1090: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] conn(0x7f89340a8f00 msgr2=0x7f89340ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] conn(0x7f89340a8f00 0x7f89340ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f893409f4d0 msgr2=0x7f89340a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:33.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f893409f4d0 0x7f89340a1980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f894c197850 tx=0x7f8940009260 comp rx=0 tx=0).stop 2023-03-17T08:20:33.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 msgr2=0x7f894c196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:33.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 --2- 172.21.15.35:0/1155617668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f894c1004d0 0x7f894c196230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f893c005910 tx=0x7f893c00f690 comp rx=0 tx=0).stop 2023-03-17T08:20:33.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f894ad9d700 1 -- 172.21.15.35:0/1155617668 reap_dead start 2023-03-17T08:20:34.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 shutdown_connections 2023-03-17T08:20:34.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 >> 172.21.15.35:0/1155617668 conn(0x7f894c0fbd50 msgr2=0x7f894c0fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:34.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 shutdown_connections 2023-03-17T08:20:34.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.401+0000 7f8950995700 1 -- 172.21.15.35:0/1155617668 wait complete. 2023-03-17T08:20:34.502 INFO:teuthology.orchestra.run.smithi035.stdout:257698037921 2023-03-17T08:20:35.513 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-03-17T08:20:35.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:24 smithi078 ceph-mon[94114]: pgmap v1091: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:26 smithi078 ceph-mon[94114]: pgmap v1092: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:28 smithi078 ceph-mon[94114]: pgmap v1093: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:30 smithi078 ceph-mon[94114]: pgmap v1094: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:32 smithi078 ceph-mon[94114]: pgmap v1095: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:34 smithi078 ceph-mon[94114]: pgmap v1096: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:36.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:24 smithi082 ceph-mon[94281]: pgmap v1091: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:36.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:26 smithi082 ceph-mon[94281]: pgmap v1092: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:36.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:28 smithi082 ceph-mon[94281]: pgmap v1093: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:38.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:30 smithi082 ceph-mon[94281]: pgmap v1094: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:38.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:32 smithi082 ceph-mon[94281]: pgmap v1095: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:38.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:34 smithi082 ceph-mon[94281]: pgmap v1096: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:38.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:35 smithi078 ceph-mon[94114]: pgmap v1097: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:38.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:37 smithi078 ceph-mon[94114]: pgmap v1098: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:38.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:35 smithi082 ceph-mon[94281]: pgmap v1097: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:40.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:37 smithi082 ceph-mon[94281]: pgmap v1098: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 -- 172.21.15.35:0/3773980466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 msgr2=0x7fd0b8103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/3773980466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8103d60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80099c0 tx=0x7fd0a8009cd0 comp rx=0 tx=0).stop 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 -- 172.21.15.35:0/3773980466 shutdown_connections 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/3773980466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0b8104490 0x7fd0b810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/3773980466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b80ff3f0 0x7fd0b80ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/3773980466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8103d60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 -- 172.21.15.35:0/3773980466 >> 172.21.15.35:0/3773980466 conn(0x7fd0b8077030 msgr2=0x7fd0b8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 -- 172.21.15.35:0/3773980466 shutdown_connections 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.580+0000 7fd0bfc59700 1 -- 172.21.15.35:0/3773980466 wait complete. 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 Processor -- start 2023-03-17T08:20:40.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 -- start start 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0b80ff3f0 0x7fd0b8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b8104490 0x7fd0b819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b819b2d0 con 0x7fd0b80ffd90 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b819b440 con 0x7fd0b80ff3f0 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bfc59700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b819b600 con 0x7fd0b8104490 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bd1f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bd1f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40432/0 (socket says 172.21.15.35:40432) 2023-03-17T08:20:40.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.581+0000 7fd0bd1f4700 1 -- 172.21.15.35:0/124277933 learned_addr learned my addr 172.21.15.35:0/124277933 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd9f5700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0b80ff3f0 0x7fd0b8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0be1f6700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b8104490 0x7fd0b819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd1f4700 1 -- 172.21.15.35:0/124277933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b8104490 msgr2=0x7fd0b819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd1f4700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0b8104490 0x7fd0b819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd1f4700 1 -- 172.21.15.35:0/124277933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0b80ff3f0 msgr2=0x7fd0b8196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd1f4700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0b80ff3f0 0x7fd0b8196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd1f4700 1 -- 172.21.15.35:0/124277933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80095f0 con 0x7fd0b80ffd90 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bd1f4700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8196850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009990 tx=0x7fd0a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:40.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a801d070 con 0x7fd0b80ffd90 2023-03-17T08:20:41.067 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0a80054c0 con 0x7fd0b80ffd90 2023-03-17T08:20:41.067 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b810f070 con 0x7fd0b80ffd90 2023-03-17T08:20:41.665 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8003b30 con 0x7fd0b80ffd90 2023-03-17T08:20:41.665 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.582+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b810eee0 con 0x7fd0b80ffd90 2023-03-17T08:20:41.665 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.583+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0b8061180 con 0x7fd0b80ffd90 2023-03-17T08:20:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.584+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fd0a8004fc0 con 0x7fd0b80ffd90 2023-03-17T08:20:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0aeffd700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd0a409f4d0 0x7fd0a40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0bd9f5700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd0a409f4d0 0x7fd0a40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fd0a80cb8c0 con 0x7fd0b80ffd90 2023-03-17T08:20:43.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0aeffd700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] conn(0x7fd0a40a8f00 0x7fd0a40ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 --> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0a40aba60 con 0x7fd0a40a8f00 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a80cbc30 con 0x7fd0b80ffd90 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0be1f6700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] conn(0x7fd0a40a8f00 0x7fd0a40ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.585+0000 7fd0bd9f5700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd0a409f4d0 0x7fd0a40a1980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4005950 tx=0x7fd0b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.586+0000 7fd0be1f6700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] conn(0x7fd0a40a8f00 0x7fd0a40ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.586+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== osd.3 v2:172.21.15.35:6810/2296850572 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd0a40aba60 con 0x7fd0a40a8f00 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.602+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 --> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0b810f200 con 0x7fd0a40a8f00 2023-03-17T08:20:43.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0aeffd700 1 -- 172.21.15.35:0/124277933 <== osd.3 v2:172.21.15.35:6810/2296850572 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd0b810f200 con 0x7fd0a40a8f00 2023-03-17T08:20:43.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:40 smithi078 ceph-mon[94114]: pgmap v1099: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:43.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:42 smithi078 ceph-mon[94114]: pgmap v1100: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:43.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:40 smithi082 ceph-mon[94281]: pgmap v1099: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:43.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:42 smithi082 ceph-mon[94281]: pgmap v1100: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] conn(0x7fd0a40a8f00 msgr2=0x7fd0a40ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] conn(0x7fd0a40a8f00 0x7fd0a40ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd0a409f4d0 msgr2=0x7fd0a40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd0a409f4d0 0x7fd0a40a1980 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4005950 tx=0x7fd0b400b410 comp rx=0 tx=0).stop 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 msgr2=0x7fd0b8196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 --2- 172.21.15.35:0/124277933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0b80ffd90 0x7fd0b8196850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009990 tx=0x7fd0a8004730 comp rx=0 tx=0).stop 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0be1f6700 1 -- 172.21.15.35:0/124277933 reap_dead start 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 shutdown_connections 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 >> 172.21.15.35:0/124277933 conn(0x7fd0b8077030 msgr2=0x7fd0b8068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 shutdown_connections 2023-03-17T08:20:46.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:28.603+0000 7fd0bfc59700 1 -- 172.21.15.35:0/124277933 wait complete. 2023-03-17T08:20:46.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:28 smithi035 ceph-mon[92535]: pgmap v1063: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:46.331 INFO:teuthology.orchestra.run.smithi035.stdout:167503724741 2023-03-17T08:20:46.332 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-03-17T08:20:46.332 INFO:teuthology.orchestra.run.smithi035.stdout:55834575090 2023-03-17T08:20:46.332 INFO:teuthology.orchestra.run.smithi035.stdout:223338299564 2023-03-17T08:20:47.738 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-03-17T08:20:48.326 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-03-17T08:20:48.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:44 smithi078 ceph-mon[94114]: pgmap v1101: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:50.013 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:46 smithi078 ceph-mon[94114]: pgmap v1102: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:50.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:44 smithi082 ceph-mon[94281]: pgmap v1101: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:50.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:46 smithi082 ceph-mon[94281]: pgmap v1102: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:20:50.544 INFO:teuthology.orchestra.run.smithi035.stdout:111669149911 2023-03-17T08:20:50.545 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-03-17T08:20:50.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:48 smithi078 ceph-mon[94114]: pgmap v1103: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:53.402 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:48 smithi082 ceph-mon[94281]: pgmap v1103: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:20:53.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 -- 172.21.15.35:0/2363094149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a00ffd90 msgr2=0x7f75a0103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:53.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/2363094149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a00ffd90 0x7f75a0103d60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75940099c0 tx=0x7f7594009cd0 comp rx=0 tx=0).stop 2023-03-17T08:20:53.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 -- 172.21.15.35:0/2363094149 shutdown_connections 2023-03-17T08:20:54.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/2363094149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a0104490 0x7f75a010c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:54.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/2363094149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a00ff3f0 0x7f75a00ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:54.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/2363094149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a00ffd90 0x7f75a0103d60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:54.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 -- 172.21.15.35:0/2363094149 >> 172.21.15.35:0/2363094149 conn(0x7f75a0077030 msgr2=0x7f75a0077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:20:55.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 -- 172.21.15.35:0/2363094149 shutdown_connections 2023-03-17T08:20:55.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 -- 172.21.15.35:0/2363094149 wait complete. 2023-03-17T08:20:55.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.029+0000 7f75a5d8a700 1 Processor -- start 2023-03-17T08:20:55.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 -- start start 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a00ff3f0 0x7f75a01961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a00ffd90 0x7f75a0196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a0104490 0x7f75a019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a019b180 con 0x7f75a0104490 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a019b2f0 con 0x7f75a00ff3f0 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f75a5d8a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a019b4b0 con 0x7f75a00ffd90 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a0104490 0x7f75a019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a0104490 0x7f75a019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40450/0 (socket says 172.21.15.35:40450) 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 -- 172.21.15.35:0/3313794054 learned_addr learned my addr 172.21.15.35:0/3313794054 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759f7fe700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a00ff3f0 0x7f75a01961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759effd700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a00ffd90 0x7f75a0196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 -- 172.21.15.35:0/3313794054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a00ffd90 msgr2=0x7f75a0196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a00ffd90 0x7f75a0196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 -- 172.21.15.35:0/3313794054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a00ff3f0 msgr2=0x7f75a01961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a00ff3f0 0x7f75a01961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:20:55.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 -- 172.21.15.35:0/3313794054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940095f0 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759effd700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a00ffd90 0x7f75a0196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.030+0000 7f759ffff700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a0104490 0x7f75a019ab70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7598007d70 tx=0x7f759800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.031+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800ad40 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.031+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75980128b0 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.031+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a010f070 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.031+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75980115a0 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.031+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a010eee0 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.031+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75a00fcf10 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.033+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f7598012a20 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759cff9700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f758809f4d0 0x7f75880a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759f7fe700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f758809f4d0 0x7f75880a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f75980ca970 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759cff9700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] conn(0x7f75880a8ef0 0x7f75880ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 --> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75880aba50 con 0x7f75880a8ef0 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75980cadc0 con 0x7f75a0104490 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759effd700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] conn(0x7f75880a8ef0 0x7f75880ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:20:55.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.034+0000 7f759f7fe700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f758809f4d0 0x7f75880a1980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f759000ac50 tx=0x7f759000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:55.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.035+0000 7f759effd700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] conn(0x7f75880a8ef0 0x7f75880ab380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:20:58.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.035+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== osd.9 v2:172.21.15.35:6826/105910462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f75880aba50 con 0x7f75880a8ef0 2023-03-17T08:20:58.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.051+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 --> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75a010f200 con 0x7f75880a8ef0 2023-03-17T08:20:58.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.051+0000 7f759cff9700 1 -- 172.21.15.35:0/3313794054 <== osd.9 v2:172.21.15.35:6826/105910462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f75a010f200 con 0x7f75880a8ef0 2023-03-17T08:20:58.617 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:50 smithi078 ceph-mon[94114]: pgmap v1104: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:58.617 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:52 smithi078 ceph-mon[94114]: pgmap v1105: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:20:58.617 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:54 smithi078 ceph-mon[94114]: pgmap v1106: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:20:58.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:54 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:20:58.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:20:58.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:20:58.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:21:00.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:56 smithi078 ceph-mon[94114]: pgmap v1107: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:50 smithi082 ceph-mon[94281]: pgmap v1104: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:52 smithi082 ceph-mon[94281]: pgmap v1105: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:54 smithi082 ceph-mon[94281]: pgmap v1106: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:54 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:21:00.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:56 smithi082 ceph-mon[94281]: pgmap v1107: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] conn(0x7f75880a8ef0 msgr2=0x7f75880ab380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] conn(0x7f75880a8ef0 0x7f75880ab380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f758809f4d0 msgr2=0x7f75880a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f758809f4d0 0x7f75880a1980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f759000ac50 tx=0x7f759000a380 comp rx=0 tx=0).stop 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a0104490 msgr2=0x7f75a019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 --2- 172.21.15.35:0/3313794054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75a0104490 0x7f75a019ab70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7598007d70 tx=0x7f759800a340 comp rx=0 tx=0).stop 2023-03-17T08:21:00.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f759ffff700 1 -- 172.21.15.35:0/3313794054 reap_dead start 2023-03-17T08:21:00.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 shutdown_connections 2023-03-17T08:21:00.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 >> 172.21.15.35:0/3313794054 conn(0x7f75a0077030 msgr2=0x7f75a0102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:00.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 shutdown_connections 2023-03-17T08:21:00.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.052+0000 7f75a5d8a700 1 -- 172.21.15.35:0/3313794054 wait complete. 2023-03-17T08:21:00.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:30 smithi035 ceph-mon[92535]: pgmap v1064: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:21:00.506 INFO:teuthology.orchestra.run.smithi035.stdout:292057776280 2023-03-17T08:21:03.242 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-03-17T08:21:03.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:20:58 smithi078 ceph-mon[94114]: pgmap v1108: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:03.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:00 smithi078 ceph-mon[94114]: pgmap v1109: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:03.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:02 smithi078 ceph-mon[94114]: pgmap v1110: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:03.244 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:20:58 smithi082 ceph-mon[94281]: pgmap v1108: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:03.244 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:00 smithi082 ceph-mon[94281]: pgmap v1109: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:03.244 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:02 smithi082 ceph-mon[94281]: pgmap v1110: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:03.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 -- 172.21.15.35:0/2235533952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da8101de0 msgr2=0x7f2da810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:05.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/2235533952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da8101de0 0x7f2da810a2e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009990 tx=0x7f2da4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:21:07.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 -- 172.21.15.35:0/2235533952 shutdown_connections 2023-03-17T08:21:07.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/2235533952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da810a820 0x7f2da810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:07.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/2235533952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2da81014d0 0x7f2da81018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:07.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/2235533952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da8101de0 0x7f2da810a2e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:07.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 -- 172.21.15.35:0/2235533952 >> 172.21.15.35:0/2235533952 conn(0x7f2da8077030 msgr2=0x7f2da8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:07.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 -- 172.21.15.35:0/2235533952 shutdown_connections 2023-03-17T08:21:08.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 -- 172.21.15.35:0/2235533952 wait complete. 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.941+0000 7f2dafb2b700 1 Processor -- start 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 -- start start 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da81014d0 0x7f2da8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8101de0 0x7f2da8196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2da810a820 0x7f2da819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da819b2d0 con 0x7f2da81014d0 2023-03-17T08:21:08.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da819b440 con 0x7f2da810a820 2023-03-17T08:21:09.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dafb2b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da819b600 con 0x7f2da8101de0 2023-03-17T08:21:09.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da81014d0 0x7f2da8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:09.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da81014d0 0x7f2da8196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40462/0 (socket says 172.21.15.35:40462) 2023-03-17T08:21:09.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 -- 172.21.15.35:0/3366578557 learned_addr learned my addr 172.21.15.35:0/3366578557 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:21:09.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad0c6700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8101de0 0x7f2da8196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:12.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dae0c8700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2da810a820 0x7f2da819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:12.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 -- 172.21.15.35:0/3366578557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8101de0 msgr2=0x7f2da8196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:12.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8101de0 0x7f2da8196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:12.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 -- 172.21.15.35:0/3366578557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2da810a820 msgr2=0x7f2da819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:12.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2da810a820 0x7f2da819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 -- 172.21.15.35:0/3366578557 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da40095f0 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dae0c8700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2da810a820 0x7f2da819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2dad8c7700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da81014d0 0x7f2da8196310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d980 tx=0x7f2d9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.942+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004220 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.943+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8110150 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.943+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d98007640 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.943+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d980055e0 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.943+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da810ffc0 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.944+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2da80fc710 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.945+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f2d98004750 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.945+0000 7f2d9effd700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2d9409f4d0 0x7f2d940a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.945+0000 7f2dad0c6700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2d9409f4d0 0x7f2d940a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.945+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f2d980ca000 con 0x7f2da81014d0 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.946+0000 7f2d9effd700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] conn(0x7f2d940a8f00 0x7f2d940ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.946+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 --> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d940aba60 con 0x7f2d940a8f00 2023-03-17T08:21:12.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.946+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d980cc6c0 con 0x7f2da81014d0 2023-03-17T08:21:12.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.946+0000 7f2dae0c8700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] conn(0x7f2d940a8f00 0x7f2d940ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:12.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.946+0000 7f2dad0c6700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2d9409f4d0 0x7f2d940a1980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2da8197930 tx=0x7f2da4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:12.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.946+0000 7f2dae0c8700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] conn(0x7f2d940a8f00 0x7f2d940ab390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:12.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.947+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== osd.6 v2:172.21.15.35:6818/1961965339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2d940aba60 con 0x7f2d940a8f00 2023-03-17T08:21:12.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 --> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2da81102e0 con 0x7f2d940a8f00 2023-03-17T08:21:12.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2d9effd700 1 -- 172.21.15.35:0/3366578557 <== osd.6 v2:172.21.15.35:6818/1961965339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2da81102e0 con 0x7f2d940a8f00 2023-03-17T08:21:12.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] conn(0x7f2d940a8f00 msgr2=0x7f2d940ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:13.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] conn(0x7f2d940a8f00 0x7f2d940ab390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:13.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2d9409f4d0 msgr2=0x7f2d940a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:13.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f2d9409f4d0 0x7f2d940a1980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2da8197930 tx=0x7f2da4005fb0 comp rx=0 tx=0).stop 2023-03-17T08:21:13.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da81014d0 msgr2=0x7f2da8196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:13.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 --2- 172.21.15.35:0/3366578557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2da81014d0 0x7f2da8196310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d980 tx=0x7f2d9800dc90 comp rx=0 tx=0).stop 2023-03-17T08:21:14.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dae0c8700 1 -- 172.21.15.35:0/3366578557 reap_dead start 2023-03-17T08:21:14.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 shutdown_connections 2023-03-17T08:21:14.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.963+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 >> 172.21.15.35:0/3366578557 conn(0x7f2da8077030 msgr2=0x7f2da80fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:14.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.964+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 shutdown_connections 2023-03-17T08:21:14.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:30.964+0000 7f2dafb2b700 1 -- 172.21.15.35:0/3366578557 wait complete. 2023-03-17T08:21:14.608 INFO:teuthology.orchestra.run.smithi035.stdout:201863463097 2023-03-17T08:21:15.245 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-03-17T08:21:17.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:04 smithi078 ceph-mon[94114]: pgmap v1111: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:18.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:06 smithi078 ceph-mon[94114]: pgmap v1112: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:20.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:08 smithi078 ceph-mon[94114]: pgmap v1113: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:20.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:10 smithi078 ceph-mon[94114]: pgmap v1114: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:20.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:12 smithi078 ceph-mon[94114]: pgmap v1115: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:20.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:14 smithi078 ceph-mon[94114]: pgmap v1116: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:20.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:16 smithi078 ceph-mon[94114]: pgmap v1117: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:20.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:04 smithi082 ceph-mon[94281]: pgmap v1111: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:21.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:06 smithi082 ceph-mon[94281]: pgmap v1112: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:21.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:08 smithi082 ceph-mon[94281]: pgmap v1113: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:21.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:10 smithi082 ceph-mon[94281]: pgmap v1114: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:21.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:12 smithi082 ceph-mon[94281]: pgmap v1115: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:21.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:14 smithi082 ceph-mon[94281]: pgmap v1116: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:21.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:16 smithi082 ceph-mon[94281]: pgmap v1117: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:21.041 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:18 smithi078 ceph-mon[94114]: pgmap v1118: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:23.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:20 smithi078 ceph-mon[94114]: pgmap v1119: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:23.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:18 smithi082 ceph-mon[94281]: pgmap v1118: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:23.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:20 smithi082 ceph-mon[94281]: pgmap v1119: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:24.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 -- 172.21.15.35:0/3779676139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc810a820 msgr2=0x7f1fc810cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:25.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 --2- 172.21.15.35:0/3779676139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc810a820 0x7f1fc810cc60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000b0a0 tx=0x7f1fc000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:21:25.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 -- 172.21.15.35:0/3779676139 shutdown_connections 2023-03-17T08:21:25.851 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 --2- 172.21.15.35:0/3779676139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc810a820 0x7f1fc810cc60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:25.851 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 --2- 172.21.15.35:0/3779676139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc81014d0 0x7f1fc81018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:25.851 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 --2- 172.21.15.35:0/3779676139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8101de0 0x7f1fc810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:25.851 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 -- 172.21.15.35:0/3779676139 >> 172.21.15.35:0/3779676139 conn(0x7f1fc8077030 msgr2=0x7f1fc8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:27.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 -- 172.21.15.35:0/3779676139 shutdown_connections 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.703+0000 7f1fcca13700 1 -- 172.21.15.35:0/3779676139 wait complete. 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 Processor -- start 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 -- start start 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc81014d0 0x7f1fc8196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8101de0 0x7f1fc8196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc810a820 0x7f1fc819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:27.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc819b310 con 0x7f1fc81014d0 2023-03-17T08:21:28.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc819b480 con 0x7f1fc8101de0 2023-03-17T08:21:28.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fcca13700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc819b640 con 0x7f1fc810a820 2023-03-17T08:21:28.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fc659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc81014d0 0x7f1fc8196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:28.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fc659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc81014d0 0x7f1fc8196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40476/0 (socket says 172.21.15.35:40476) 2023-03-17T08:21:28.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.704+0000 7f1fc659c700 1 -- 172.21.15.35:0/1625927770 learned_addr learned my addr 172.21.15.35:0/1625927770 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:21:28.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc5d9b700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8101de0 0x7f1fc8196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc6d9d700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc810a820 0x7f1fc819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc659c700 1 -- 172.21.15.35:0/1625927770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc810a820 msgr2=0x7f1fc819ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc659c700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc810a820 0x7f1fc819ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc659c700 1 -- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8101de0 msgr2=0x7f1fc8196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc659c700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8101de0 0x7f1fc8196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc659c700 1 -- 172.21.15.35:0/1625927770 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009d00 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fc659c700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc81014d0 0x7f1fc8196350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800d950 tx=0x7f1fb800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800f890 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc81100f0 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fb800fe80 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800e3b0 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.705+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc810ff60 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.706+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fc80fc670 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1fb8010460 con 0x7f1fc81014d0 2023-03-17T08:21:28.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fb77fe700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1fb009f4d0 0x7f1fb00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:29.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1fb80ca410 con 0x7f1fc81014d0 2023-03-17T08:21:31.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fc5d9b700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1fb009f4d0 0x7f1fb00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:31.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fb77fe700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] conn(0x7f1fb00a8f00 0x7f1fb00ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:31.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 --> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fb00aba60 con 0x7f1fb00a8f00 2023-03-17T08:21:32.253 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.708+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fb80ca860 con 0x7f1fc81014d0 2023-03-17T08:21:32.253 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.709+0000 7f1fc6d9d700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] conn(0x7f1fb00a8f00 0x7f1fb00ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:32.253 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.709+0000 7f1fc5d9b700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1fb009f4d0 0x7f1fb00a1980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8197970 tx=0x7f1fbc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:32.253 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.709+0000 7f1fc6d9d700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] conn(0x7f1fb00a8f00 0x7f1fb00ab390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:32.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.710+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== osd.10 v2:172.21.15.78:6824/2850996508 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1fb00aba60 con 0x7f1fb00a8f00 2023-03-17T08:21:32.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 --> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fc8110280 con 0x7f1fb00a8f00 2023-03-17T08:21:32.254 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fb77fe700 1 -- 172.21.15.35:0/1625927770 <== osd.10 v2:172.21.15.78:6824/2850996508 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1fc8110280 con 0x7f1fb00a8f00 2023-03-17T08:21:32.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] conn(0x7f1fb00a8f00 msgr2=0x7f1fb00ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:33.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] conn(0x7f1fb00a8f00 0x7f1fb00ab390 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:33.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1fb009f4d0 msgr2=0x7f1fb00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:33.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1fb009f4d0 0x7f1fb00a1980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8197970 tx=0x7f1fbc009260 comp rx=0 tx=0).stop 2023-03-17T08:21:33.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc81014d0 msgr2=0x7f1fc8196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:33.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fcca13700 1 --2- 172.21.15.35:0/1625927770 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1fc81014d0 0x7f1fc8196350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800d950 tx=0x7f1fb800dc60 comp rx=0 tx=0).stop 2023-03-17T08:21:33.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.736+0000 7f1fc6d9d700 1 -- 172.21.15.35:0/1625927770 reap_dead start 2023-03-17T08:21:33.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.737+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 shutdown_connections 2023-03-17T08:21:35.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.737+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 >> 172.21.15.35:0/1625927770 conn(0x7f1fc8077030 msgr2=0x7f1fc80fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:35.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.737+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 shutdown_connections 2023-03-17T08:21:35.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.737+0000 7f1fcca13700 1 -- 172.21.15.35:0/1625927770 wait complete. 2023-03-17T08:21:35.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:22 smithi078 ceph-mon[94114]: pgmap v1120: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:37.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:24 smithi078 ceph-mon[94114]: pgmap v1121: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:37.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:26 smithi078 ceph-mon[94114]: pgmap v1122: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:37.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:28 smithi078 ceph-mon[94114]: pgmap v1123: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:30 smithi078 ceph-mon[94114]: pgmap v1124: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:32 smithi078 ceph-mon[94114]: pgmap v1125: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:34 smithi078 ceph-mon[94114]: pgmap v1126: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:22 smithi082 ceph-mon[94281]: pgmap v1120: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:24 smithi082 ceph-mon[94281]: pgmap v1121: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:26 smithi082 ceph-mon[94281]: pgmap v1122: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:28 smithi082 ceph-mon[94281]: pgmap v1123: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:30 smithi082 ceph-mon[94281]: pgmap v1124: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:32 smithi082 ceph-mon[94281]: pgmap v1125: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:37.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:34 smithi082 ceph-mon[94281]: pgmap v1126: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:37.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:36 smithi078 ceph-mon[94114]: pgmap v1127: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:38.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:36 smithi082 ceph-mon[94281]: pgmap v1127: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:38.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.776+0000 7f4eb5d60700 1 -- 172.21.15.35:0/496510298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 msgr2=0x7f4eb00ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:39.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.776+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/496510298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb00ff7c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00099c0 tx=0x7f4ea0009cd0 comp rx=0 tx=0).stop 2023-03-17T08:21:39.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.776+0000 7f4eb5d60700 1 -- 172.21.15.35:0/496510298 shutdown_connections 2023-03-17T08:21:39.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.776+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/496510298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eb0104490 0x7f4eb010c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:39.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.776+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/496510298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb00ff7c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.777+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/496510298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb00ffd90 0x7f4eb0103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.777+0000 7f4eb5d60700 1 -- 172.21.15.35:0/496510298 >> 172.21.15.35:0/496510298 conn(0x7f4eb0077030 msgr2=0x7f4eb0077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.777+0000 7f4eb5d60700 1 -- 172.21.15.35:0/496510298 shutdown_connections 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.777+0000 7f4eb5d60700 1 -- 172.21.15.35:0/496510298 wait complete. 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.777+0000 7f4eb5d60700 1 Processor -- start 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.777+0000 7f4eb5d60700 1 -- start start 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:39.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eb00ffd90 0x7f4eb0196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb0104490 0x7f4eb019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb019b280 con 0x7f4eb00ff3f0 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb019b3f0 con 0x7f4eb00ffd90 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb019b5b0 con 0x7f4eb0104490 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb01962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40492/0 (socket says 172.21.15.35:40492) 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 -- 172.21.15.35:0/1917690147 learned_addr learned my addr 172.21.15.35:0/1917690147 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaffff700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb0104490 0x7f4eb019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 -- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb0104490 msgr2=0x7f4eb019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaeffd700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eb00ffd90 0x7f4eb0196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:39.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eb0104490 0x7f4eb019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:39.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 -- 172.21.15.35:0/1917690147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eb00ffd90 msgr2=0x7f4eb0196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:39.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eb00ffd90 0x7f4eb0196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:39.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 -- 172.21.15.35:0/1917690147 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00095f0 con 0x7f4eb00ff3f0 2023-03-17T08:21:39.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaeffd700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eb00ffd90 0x7f4eb0196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:21:41.173 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eaf7fe700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb01962c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009f50 tx=0x7f4ea00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:41.173 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea001d070 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.173 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb010f080 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.173 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ea0004040 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.173 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.778+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0022c80 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.779+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb010eef0 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.779+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4eb0061200 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.781+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f4ea0022470 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.782+0000 7f4eacff9700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4e9809f4d0 0x7f4e980a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.782+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4ea00cc230 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.782+0000 7f4eaeffd700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4e9809f4d0 0x7f4e980a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.782+0000 7f4eacff9700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] conn(0x7f4e980a8f00 0x7f4e980ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.782+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 --> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e980aba60 con 0x7f4e980a8f00 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.782+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ea00cc680 con 0x7f4eb00ff3f0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.783+0000 7f4eaffff700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] conn(0x7f4e980a8f00 0x7f4e980ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.783+0000 7f4eaeffd700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4e9809f4d0 0x7f4e980a1980 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4005fd0 tx=0x7f4ea4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.783+0000 7f4eaffff700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] conn(0x7f4e980a8f00 0x7f4e980ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.784+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== osd.11 v2:172.21.15.82:6824/77409820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4e980aba60 con 0x7f4e980a8f00 2023-03-17T08:21:41.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.801+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 --> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4eb010f210 con 0x7f4e980a8f00 2023-03-17T08:21:42.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.801+0000 7f4eacff9700 1 -- 172.21.15.35:0/1917690147 <== osd.11 v2:172.21.15.82:6824/77409820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4eb010f210 con 0x7f4e980a8f00 2023-03-17T08:21:42.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:38 smithi078 ceph-mon[94114]: pgmap v1128: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:43.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:40 smithi078 ceph-mon[94114]: pgmap v1129: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:43.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:38 smithi082 ceph-mon[94281]: pgmap v1128: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:43.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:40 smithi082 ceph-mon[94281]: pgmap v1129: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:43.557 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] conn(0x7f4e980a8f00 msgr2=0x7f4e980ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:45.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] conn(0x7f4e980a8f00 0x7f4e980ab390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:21:46.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4e9809f4d0 msgr2=0x7f4e980a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:46.189 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4e9809f4d0 0x7f4e980a1980 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4005fd0 tx=0x7f4ea4005ee0 comp rx=0 tx=0).stop 2023-03-17T08:21:46.189 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 msgr2=0x7f4eb01962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:21:46.189 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eb5d60700 1 --2- 172.21.15.35:0/1917690147 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eb00ff3f0 0x7f4eb01962c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009f50 tx=0x7f4ea00047c0 comp rx=0 tx=0).stop 2023-03-17T08:21:46.189 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.802+0000 7f4eaffff700 1 -- 172.21.15.35:0/1917690147 reap_dead start 2023-03-17T08:21:47.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.803+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 shutdown_connections 2023-03-17T08:21:47.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.803+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 >> 172.21.15.35:0/1917690147 conn(0x7f4eb0077030 msgr2=0x7f4eb0068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:21:47.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.804+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 shutdown_connections 2023-03-17T08:21:47.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:19:31.804+0000 7f4eb5d60700 1 -- 172.21.15.35:0/1917690147 wait complete. 2023-03-17T08:21:47.526 INFO:teuthology.orchestra.run.smithi035.stdout:313532612749 2023-03-17T08:21:47.527 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-03-17T08:21:47.527 INFO:teuthology.orchestra.run.smithi035.stdout:347892351107 2023-03-17T08:21:47.528 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-03-17T08:21:50.051 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:42 smithi078 ceph-mon[94114]: pgmap v1130: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:52.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:44 smithi078 ceph-mon[94114]: pgmap v1131: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:52.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:46 smithi078 ceph-mon[94114]: pgmap v1132: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:52.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:47 smithi078 ceph-mon[94114]: pgmap v1133: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:52.307 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:42 smithi082 ceph-mon[94281]: pgmap v1130: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:52.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:44 smithi082 ceph-mon[94281]: pgmap v1131: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:52.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:46 smithi082 ceph-mon[94281]: pgmap v1132: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:52.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:47 smithi082 ceph-mon[94281]: pgmap v1133: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:52.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:50 smithi078 ceph-mon[94114]: pgmap v1134: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:52.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:52 smithi078 ceph-mon[94114]: pgmap v1135: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:52.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:50 smithi082 ceph-mon[94281]: pgmap v1134: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:52.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:52 smithi082 ceph-mon[94281]: pgmap v1135: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:52.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:32 smithi035 ceph-mon[92535]: pgmap v1065: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:54.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:34 smithi035 ceph-mon[92535]: pgmap v1066: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T08:21:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:36 smithi035 ceph-mon[92535]: pgmap v1067: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:38 smithi035 ceph-mon[92535]: pgmap v1068: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-17T08:21:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:40 smithi035 ceph-mon[92535]: pgmap v1069: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:42 smithi035 ceph-mon[92535]: pgmap v1070: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.758 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:44 smithi035 ceph-mon[92535]: pgmap v1071: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:46 smithi035 ceph-mon[92535]: pgmap v1072: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:48 smithi035 ceph-mon[92535]: pgmap v1073: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:50 smithi035 ceph-mon[92535]: pgmap v1074: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:52 smithi035 ceph-mon[92535]: pgmap v1075: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:53 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:54 smithi035 ceph-mon[92535]: pgmap v1076: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:56 smithi035 ceph-mon[92535]: pgmap v1077: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:19:58 smithi035 ceph-mon[92535]: pgmap v1078: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:00 smithi035 ceph-mon[92535]: pgmap v1079: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:02 smithi035 ceph-mon[92535]: pgmap v1080: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:04 smithi035 ceph-mon[92535]: pgmap v1081: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.759 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:06 smithi035 ceph-mon[92535]: pgmap v1082: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:08 smithi035 ceph-mon[92535]: pgmap v1083: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:10 smithi035 ceph-mon[92535]: pgmap v1084: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:12 smithi035 ceph-mon[92535]: pgmap v1085: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:14 smithi035 ceph-mon[92535]: pgmap v1086: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:16 smithi035 ceph-mon[92535]: pgmap v1087: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:18 smithi035 ceph-mon[92535]: pgmap v1088: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:20 smithi035 ceph-mon[92535]: pgmap v1089: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:22 smithi035 ceph-mon[92535]: pgmap v1090: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:24 smithi035 ceph-mon[92535]: pgmap v1091: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:26 smithi035 ceph-mon[92535]: pgmap v1092: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:28 smithi035 ceph-mon[92535]: pgmap v1093: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:30 smithi035 ceph-mon[92535]: pgmap v1094: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:32 smithi035 ceph-mon[92535]: pgmap v1095: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:34 smithi035 ceph-mon[92535]: pgmap v1096: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:35 smithi035 ceph-mon[92535]: pgmap v1097: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:37 smithi035 ceph-mon[92535]: pgmap v1098: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:55.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:40 smithi035 ceph-mon[92535]: pgmap v1099: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:42 smithi035 ceph-mon[92535]: pgmap v1100: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:55.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:44 smithi035 ceph-mon[92535]: pgmap v1101: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:55.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:46 smithi035 ceph-mon[92535]: pgmap v1102: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:56.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:48 smithi035 ceph-mon[92535]: pgmap v1103: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:56.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:50 smithi035 ceph-mon[92535]: pgmap v1104: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:56.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:52 smithi035 ceph-mon[92535]: pgmap v1105: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:56.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:54 smithi035 ceph-mon[92535]: pgmap v1106: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:56.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:54 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:56 smithi035 ceph-mon[92535]: pgmap v1107: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:20:58 smithi035 ceph-mon[92535]: pgmap v1108: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:00 smithi035 ceph-mon[92535]: pgmap v1109: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:56.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:02 smithi035 ceph-mon[92535]: pgmap v1110: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:04 smithi035 ceph-mon[92535]: pgmap v1111: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:06 smithi035 ceph-mon[92535]: pgmap v1112: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:08 smithi035 ceph-mon[92535]: pgmap v1113: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:10 smithi035 ceph-mon[92535]: pgmap v1114: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:12 smithi035 ceph-mon[92535]: pgmap v1115: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:14 smithi035 ceph-mon[92535]: pgmap v1116: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:16 smithi035 ceph-mon[92535]: pgmap v1117: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:18 smithi035 ceph-mon[92535]: pgmap v1118: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:20 smithi035 ceph-mon[92535]: pgmap v1119: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:22 smithi035 ceph-mon[92535]: pgmap v1120: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:24 smithi035 ceph-mon[92535]: pgmap v1121: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:26 smithi035 ceph-mon[92535]: pgmap v1122: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:57.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:28 smithi035 ceph-mon[92535]: pgmap v1123: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:30 smithi035 ceph-mon[92535]: pgmap v1124: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:32 smithi035 ceph-mon[92535]: pgmap v1125: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:34 smithi035 ceph-mon[92535]: pgmap v1126: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:36 smithi035 ceph-mon[92535]: pgmap v1127: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:38 smithi035 ceph-mon[92535]: pgmap v1128: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:40 smithi035 ceph-mon[92535]: pgmap v1129: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:42 smithi035 ceph-mon[92535]: pgmap v1130: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:44 smithi035 ceph-mon[92535]: pgmap v1131: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:46 smithi035 ceph-mon[92535]: pgmap v1132: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:57.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:47 smithi035 ceph-mon[92535]: pgmap v1133: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:21:58.259 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:50 smithi035 ceph-mon[92535]: pgmap v1134: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:58.260 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:21:59.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2206543134' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3170596080' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:54 smithi078 ceph-mon[94114]: pgmap v1136: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:55 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:56 smithi078 ceph-mon[94114]: pgmap v1137: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:57 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3565092729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-03-17T08:21:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:58 smithi078 ceph-mon[94114]: pgmap v1138: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:22:00.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:58 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2774382632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-03-17T08:22:00.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2206543134' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-03-17T08:22:00.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3170596080' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-03-17T08:22:00.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:54 smithi082 ceph-mon[94281]: pgmap v1136: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:00.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:22:00.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:22:00.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:22:00.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:55 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:22:00.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:56 smithi082 ceph-mon[94281]: pgmap v1137: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:22:00.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:57 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3565092729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-03-17T08:22:00.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:58 smithi082 ceph-mon[94281]: pgmap v1138: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:22:00.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:58 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2774382632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-03-17T08:22:00.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:59 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3401165532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-03-17T08:22:00.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:21:59 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/971275050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-03-17T08:22:00.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:59 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3401165532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-03-17T08:22:02.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:21:59 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/971275050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-03-17T08:22:02.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:00 smithi082 ceph-mon[94281]: pgmap v1139: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:02.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:00 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1386028432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-03-17T08:22:02.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:00 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3129538664' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-03-17T08:22:02.555 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:02.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 -- 172.21.15.35:0/146410105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ffd90 msgr2=0x7f9aa8103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:02.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/146410105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ffd90 0x7f9aa8103d60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0099c0 tx=0x7f9a9c009cd0 comp rx=0 tx=0).stop 2023-03-17T08:22:02.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 -- 172.21.15.35:0/146410105 shutdown_connections 2023-03-17T08:22:02.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/146410105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 0x7f9aa810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:03.586 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/146410105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa80ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:03.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/146410105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ffd90 0x7f9aa8103d60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:03.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 -- 172.21.15.35:0/146410105 >> 172.21.15.35:0/146410105 conn(0x7f9aa8077030 msgr2=0x7f9aa8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:04.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 -- 172.21.15.35:0/146410105 shutdown_connections 2023-03-17T08:22:04.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.342+0000 7f9aaed7c700 1 -- 172.21.15.35:0/146410105 wait complete. 2023-03-17T08:22:04.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 Processor -- start 2023-03-17T08:22:04.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 -- start start 2023-03-17T08:22:04.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa8197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:04.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80ffd90 0x7f9aa8197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:05.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 0x7f9aa81a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:05.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8197ed0 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa81a2610 con 0x7f9aa8104490 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aaed7c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa81a27d0 con 0x7f9aa80ffd90 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aacb18700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa8197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aacb18700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa8197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40506/0 (socket says 172.21.15.35:40506) 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.343+0000 7f9aacb18700 1 -- 172.21.15.35:0/2206543134 learned_addr learned my addr 172.21.15.35:0/2206543134 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aa7fff700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80ffd90 0x7f9aa8197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aad319700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 0x7f9aa81a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aacb18700 1 -- 172.21.15.35:0/2206543134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80ffd90 msgr2=0x7f9aa8197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aacb18700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80ffd90 0x7f9aa8197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aacb18700 1 -- 172.21.15.35:0/2206543134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 msgr2=0x7f9aa81a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:05.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aacb18700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 0x7f9aa81a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aacb18700 1 -- 172.21.15.35:0/2206543134 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0095f0 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.203 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aad319700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 0x7f9aa81a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:22:05.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aacb18700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa8197050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a98007e20 tx=0x7f9a9800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:05.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800ad40 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a980128b0 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980116b0 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.344+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa810f070 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.345+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa810eee0 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.345+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa810f200 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.347+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f9a98012a20 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.347+0000 7f9aa5ffb700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a9009f4d0 0x7f9a900a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.347+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f9a980ca620 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.348+0000 7f9aa7fff700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a9009f4d0 0x7f9a900a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.348+0000 7f9aa7fff700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a9009f4d0 0x7f9a900a1980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8105ab0 tx=0x7f9a9c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:05.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.351+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f9a980947b0 con 0x7f9aa80ff3f0 2023-03-17T08:22:05.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:02 smithi082 ceph-mon[94281]: pgmap v1140: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:05.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:02 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2426368017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-03-17T08:22:05.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:02 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3224543727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-03-17T08:22:05.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:02 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/188832279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-03-17T08:22:05.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:04 smithi082 ceph-mon[94281]: pgmap v1141: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:05.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:04 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2482457017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:00 smithi078 ceph-mon[94114]: pgmap v1139: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:00 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1386028432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:00 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3129538664' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:02 smithi078 ceph-mon[94114]: pgmap v1140: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:02 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2426368017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:02 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3224543727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:02 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/188832279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:04 smithi078 ceph-mon[94114]: pgmap v1141: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:05.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:04 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2482457017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 -- 172.21.15.35:0/877362154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc10cc10 msgr2=0x7f9cfc10eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 --2- 172.21.15.35:0/877362154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc10cc10 0x7f9cfc10eff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b0a0 tx=0x7f9cf400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 -- 172.21.15.35:0/877362154 shutdown_connections 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 --2- 172.21.15.35:0/877362154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc10cc10 0x7f9cfc10eff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 --2- 172.21.15.35:0/877362154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc0ff060 0x7f9cfc0ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 --2- 172.21.15.35:0/877362154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc10c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 -- 172.21.15.35:0/877362154 >> 172.21.15.35:0/877362154 conn(0x7f9cfc077030 msgr2=0x7f9cfc077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 -- 172.21.15.35:0/877362154 shutdown_connections 2023-03-17T08:22:05.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 -- 172.21.15.35:0/877362154 wait complete. 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 Processor -- start 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.533+0000 7f9d03c11700 1 -- start start 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d03c11700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cfc0ff060 0x7f9cfc1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d03c11700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d03c11700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc10cc10 0x7f9cfc19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d03c11700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc19c5c0 con 0x7f9cfc0ff970 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d03c11700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc19c730 con 0x7f9cfc0ff060 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d03c11700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc19c8f0 con 0x7f9cfc10cc10 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40520/0 (socket says 172.21.15.35:40520) 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 -- 172.21.15.35:0/3170596080 learned_addr learned my addr 172.21.15.35:0/3170596080 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d021ae700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc10cc10 0x7f9cfc19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d019ad700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cfc0ff060 0x7f9cfc1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 -- 172.21.15.35:0/3170596080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc10cc10 msgr2=0x7f9cfc19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc10cc10 0x7f9cfc19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 -- 172.21.15.35:0/3170596080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cfc0ff060 msgr2=0x7f9cfc1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cfc0ff060 0x7f9cfc1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 -- 172.21.15.35:0/3170596080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009d00 con 0x7f9cfc0ff970 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9d011ac700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc198c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00d950 tx=0x7f9cec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.534+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00f890 con 0x7f9cfc0ff970 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.535+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cec00fe80 con 0x7f9cfc0ff970 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.535+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00e3b0 con 0x7f9cfc0ff970 2023-03-17T08:22:05.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.535+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc1123b0 con 0x7f9cfc0ff970 2023-03-17T08:22:07.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.535+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc112220 con 0x7f9cfc0ff970 2023-03-17T08:22:07.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.536+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc112540 con 0x7f9cfc0ff970 2023-03-17T08:22:07.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.537+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f9cec010460 con 0x7f9cfc0ff970 2023-03-17T08:22:07.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.537+0000 7f9cf2ffd700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9ce809f4d0 0x7f9ce80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:07.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.537+0000 7f9d019ad700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9ce809f4d0 0x7f9ce80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:07.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.537+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f9cec0c9f60 con 0x7f9cfc0ff970 2023-03-17T08:22:07.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.538+0000 7f9d019ad700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9ce809f4d0 0x7f9ce80a1980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8005950 tx=0x7f9cf800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:07.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.542+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f9cec0940f0 con 0x7f9cfc0ff970 2023-03-17T08:22:07.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.573+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9aa8195760 con 0x7f9aa80ff3f0 2023-03-17T08:22:07.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.573+0000 7f9aa5ffb700 1 -- 172.21.15.35:0/2206543134 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a98097dd0 con 0x7f9aa80ff3f0 2023-03-17T08:22:07.762 INFO:teuthology.orchestra.run.smithi035.stdout:34359738649 2023-03-17T08:22:07.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:06 smithi078 ceph-mon[94114]: pgmap v1142: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:07.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:06 smithi082 ceph-mon[94281]: pgmap v1142: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:07.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a9009f4d0 msgr2=0x7f9a900a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:08.136 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a9009f4d0 0x7f9a900a1980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8105ab0 tx=0x7f9a9c009f10 comp rx=0 tx=0).stop 2023-03-17T08:22:09.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 msgr2=0x7f9aa8197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:09.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa8197050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a98007e20 tx=0x7f9a9800a340 comp rx=0 tx=0).stop 2023-03-17T08:22:09.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 shutdown_connections 2023-03-17T08:22:09.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9aa8104490 0x7f9aa81a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:09.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a9009f4d0 0x7f9a900a1980 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:09.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9aa80ff3f0 0x7f9aa8197050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:09.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 --2- 172.21.15.35:0/2206543134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa80ffd90 0x7f9aa8197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:09.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 >> 172.21.15.35:0/2206543134 conn(0x7f9aa8077030 msgr2=0x7f9aa80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:09.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 shutdown_connections 2023-03-17T08:22:09.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.575+0000 7f9aaed7c700 1 -- 172.21.15.35:0/2206543134 wait complete. 2023-03-17T08:22:09.111 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:52 smithi035 ceph-mon[92535]: pgmap v1135: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:09.112 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.758+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9cfc1a5770 con 0x7f9cfc0ff970 2023-03-17T08:22:10.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.758+0000 7f9cf2ffd700 1 -- 172.21.15.35:0/3170596080 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cec020020 con 0x7f9cfc0ff970 2023-03-17T08:22:10.152 INFO:teuthology.orchestra.run.smithi035.stdout:146028888300 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.760+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9ce809f4d0 msgr2=0x7f9ce80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.760+0000 7f9d03c11700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9ce809f4d0 0x7f9ce80a1980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8005950 tx=0x7f9cf800a300 comp rx=0 tx=0).stop 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.760+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 msgr2=0x7f9cfc198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.760+0000 7f9d03c11700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc198c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00d950 tx=0x7f9cec00dc60 comp rx=0 tx=0).stop 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 shutdown_connections 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc10cc10 0x7f9cfc19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9cfc0ff060 0x7f9cfc1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9ce809f4d0 0x7f9ce80a1980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 --2- 172.21.15.35:0/3170596080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9cfc0ff970 0x7f9cfc198c00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:10.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 >> 172.21.15.35:0/3170596080 conn(0x7f9cfc077030 msgr2=0x7f9cfc10e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:10.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 shutdown_connections 2023-03-17T08:22:10.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:52.761+0000 7f9d03c11700 1 -- 172.21.15.35:0/3170596080 wait complete. 2023-03-17T08:22:10.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:08 smithi078 ceph-mon[94114]: pgmap v1143: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:22:11.197 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:08 smithi082 ceph-mon[94281]: pgmap v1143: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:22:11.201 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:10 smithi078 ceph-mon[94114]: pgmap v1144: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:12.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:10 smithi082 ceph-mon[94281]: pgmap v1144: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:12.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738619 got 34359738649 for osd.0 2023-03-17T08:22:12.590 DEBUG:teuthology.parallel:result is None 2023-03-17T08:22:12.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888271 got 146028888300 for osd.4 2023-03-17T08:22:13.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2206543134' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-03-17T08:22:13.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3170596080' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-03-17T08:22:13.705 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:13.705 DEBUG:teuthology.parallel:result is None 2023-03-17T08:22:13.706 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:13.706 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:15.028 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:12 smithi078 ceph-mon[94114]: pgmap v1145: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:15.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:12 smithi082 ceph-mon[94281]: pgmap v1145: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:15.029 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:15.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:54 smithi035 ceph-mon[92535]: pgmap v1136: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:15.616 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:16.232 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:16.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:22:16.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:22:16.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:22:16.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:55 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:22:16.232 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:16.233 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:16.233 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:22:16.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:14 smithi078 ceph-mon[94114]: pgmap v1146: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:18.054 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:14 smithi082 ceph-mon[94281]: pgmap v1146: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:18.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 -- 172.21.15.35:0/2291910925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff224101320 msgr2=0x7ff2241016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:19.448 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 --2- 172.21.15.35:0/2291910925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff224101320 0x7ff2241016f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff214009990 tx=0x7ff214009ca0 comp rx=0 tx=0).stop 2023-03-17T08:22:21.059 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 -- 172.21.15.35:0/2291910925 shutdown_connections 2023-03-17T08:22:22.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 --2- 172.21.15.35:0/2291910925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22410a840 0x7ff22410cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:22.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 --2- 172.21.15.35:0/2291910925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff224101320 0x7ff2241016f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:22.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 --2- 172.21.15.35:0/2291910925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff22410a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:22.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 -- 172.21.15.35:0/2291910925 >> 172.21.15.35:0/2291910925 conn(0x7ff224077030 msgr2=0x7ff224077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:23.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 -- 172.21.15.35:0/2291910925 shutdown_connections 2023-03-17T08:22:23.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.357+0000 7ff229439700 1 -- 172.21.15.35:0/2291910925 wait complete. 2023-03-17T08:22:23.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.358+0000 7ff229439700 1 Processor -- start 2023-03-17T08:22:23.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.358+0000 7ff229439700 1 -- start start 2023-03-17T08:22:23.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.358+0000 7ff229439700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff224101320 0x7ff224196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:23.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.358+0000 7ff229439700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff224196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:24.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff229439700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22410a840 0x7ff22419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:24.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff229439700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419b1d0 con 0x7ff22410a840 2023-03-17T08:22:25.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff229439700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419b340 con 0x7ff224101320 2023-03-17T08:22:25.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff229439700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419b500 con 0x7ff224101c30 2023-03-17T08:22:25.987 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff224196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:26.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff224196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:60528/0 (socket says 172.21.15.35:60528) 2023-03-17T08:22:26.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 -- 172.21.15.35:0/3565092729 learned_addr learned my addr 172.21.15.35:0/3565092729 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:22:26.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 -- 172.21.15.35:0/3565092729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff224101320 msgr2=0x7ff224196210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T08:22:26.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff224101320 0x7ff224196210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:26.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 -- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22410a840 msgr2=0x7ff22419abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T08:22:26.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22410a840 0x7ff22419abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:27.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.359+0000 7ff2227fc700 1 -- 172.21.15.35:0/3565092729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140095f0 con 0x7ff224101c30 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.360+0000 7ff2227fc700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff224196750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff21800d950 tx=0x7ff21800dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.360+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218009b40 con 0x7ff224101c30 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.360+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff218009ca0 con 0x7ff224101c30 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.360+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224110160 con 0x7ff224101c30 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.360+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800f620 con 0x7ff224101c30 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.360+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22410ffd0 con 0x7ff224101c30 2023-03-17T08:22:28.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.362+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2241102f0 con 0x7ff224101c30 2023-03-17T08:22:29.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.364+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff218010460 con 0x7ff224101c30 2023-03-17T08:22:29.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.365+0000 7ff20bfff700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff20c09f620 0x7ff20c0a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:29.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.365+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff2180ca3b0 con 0x7ff224101c30 2023-03-17T08:22:29.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.365+0000 7ff222ffd700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff20c09f620 0x7ff20c0a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:29.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.365+0000 7ff222ffd700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff20c09f620 0x7ff20c0a1ad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098e0 tx=0x7ff214003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:29.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.367+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff218094520 con 0x7ff224101c30 2023-03-17T08:22:29.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.589+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff224066e30 con 0x7ff224101c30 2023-03-17T08:22:29.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.592+0000 7ff20bfff700 1 -- 172.21.15.35:0/3565092729 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff218016020 con 0x7ff224101c30 2023-03-17T08:22:29.182 INFO:teuthology.orchestra.run.smithi035.stdout:223338299594 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff20c09f620 msgr2=0x7ff20c0a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff20c09f620 0x7ff20c0a1ad0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2140098e0 tx=0x7ff214003680 comp rx=0 tx=0).stop 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 msgr2=0x7ff224196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff224196750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff21800d950 tx=0x7ff21800dd10 comp rx=0 tx=0).stop 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 shutdown_connections 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff20c09f620 0x7ff20c0a1ad0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22410a840 0x7ff22419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:29.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff224101320 0x7ff224196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:30.227 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 --2- 172.21.15.35:0/3565092729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff224101c30 0x7ff224196750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:30.227 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 >> 172.21.15.35:0/3565092729 conn(0x7ff224077030 msgr2=0x7ff2240fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:30.227 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 shutdown_connections 2023-03-17T08:22:30.227 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:56.595+0000 7ff229439700 1 -- 172.21.15.35:0/3565092729 wait complete. 2023-03-17T08:22:30.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:56 smithi035 ceph-mon[92535]: pgmap v1137: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T08:22:30.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:57 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3565092729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 -- 172.21.15.35:0/4166713804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c78104490 msgr2=0x7f1c7810c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/4166713804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c78104490 0x7f1c7810c010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b0d0 tx=0x7f1c7000b3e0 comp rx=0 tx=0).stop 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 -- 172.21.15.35:0/4166713804 shutdown_connections 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/4166713804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c78104490 0x7f1c7810c010 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/4166713804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c780ff3f0 0x7f1c780ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/4166713804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c780ffd90 0x7f1c78103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 -- 172.21.15.35:0/4166713804 >> 172.21.15.35:0/4166713804 conn(0x7f1c78077030 msgr2=0x7f1c78077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:30.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 -- 172.21.15.35:0/4166713804 shutdown_connections 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 -- 172.21.15.35:0/4166713804 wait complete. 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 Processor -- start 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.325+0000 7f1c7ea98700 1 -- start start 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c780ff3f0 0x7f1c78195020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 0x7f1c78195560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c78104490 0x7f1c78195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:31.824 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781a4860 con 0x7f1c780ffd90 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781a49d0 con 0x7f1c780ff3f0 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781a4b90 con 0x7f1c78104490 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 0x7f1c78195560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 0x7f1c78195560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40554/0 (socket says 172.21.15.35:40554) 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 -- 172.21.15.35:0/3401165532 learned_addr learned my addr 172.21.15.35:0/3401165532 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7c834700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c780ff3f0 0x7f1c78195020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7d035700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c78104490 0x7f1c78195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 -- 172.21.15.35:0/3401165532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c78104490 msgr2=0x7f1c78195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c78104490 0x7f1c78195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 -- 172.21.15.35:0/3401165532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c780ff3f0 msgr2=0x7f1c78195020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c780ff3f0 0x7f1c78195020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:32.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 -- 172.21.15.35:0/3401165532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009d00 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c77fff700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 0x7f1c78195560 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d950 tx=0x7f1c6400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400bb60 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c64007620 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7810f0d0 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.326+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640053e0 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.327+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7810ef40 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.328+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7810f260 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.328+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1c64005540 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.329+0000 7f1c75ffb700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c6809f4d0 0x7f1c680a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.329+0000 7f1c7c834700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c6809f4d0 0x7f1c680a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.329+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1c640c9ac0 con 0x7f1c780ffd90 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.330+0000 7f1c7c834700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c6809f4d0 0x7f1c680a1980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c005950 tx=0x7f1c6c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:32.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.334+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1c64093c50 con 0x7f1c780ffd90 2023-03-17T08:22:32.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:58 smithi035 ceph-mon[92535]: pgmap v1138: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:22:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:58 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2774382632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-03-17T08:22:33.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 -- 172.21.15.35:0/659662857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40581044a0 msgr2=0x7f405810c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:33.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 --2- 172.21.15.35:0/659662857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40581044a0 0x7f405810c020 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f405000b0d0 tx=0x7f405000b3e0 comp rx=0 tx=0).stop 2023-03-17T08:22:33.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 -- 172.21.15.35:0/659662857 shutdown_connections 2023-03-17T08:22:33.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 --2- 172.21.15.35:0/659662857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40581044a0 0x7f405810c020 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:33.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 --2- 172.21.15.35:0/659662857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580ff400 0x7f40580ff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:33.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 --2- 172.21.15.35:0/659662857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40580ffda0 0x7f4058103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:33.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 -- 172.21.15.35:0/659662857 >> 172.21.15.35:0/659662857 conn(0x7f4058077060 msgr2=0x7f4058077460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 -- 172.21.15.35:0/659662857 shutdown_connections 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.983+0000 7f405cee6700 1 -- 172.21.15.35:0/659662857 wait complete. 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 Processor -- start 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 -- start start 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580ff400 0x7f40581971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 0x7f4058197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40581044a0 0x7f40581a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058198040 con 0x7f40580ffda0 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40581a2780 con 0x7f40581044a0 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405cee6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40581a2940 con 0x7f40580ff400 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f4055d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 0x7f4058197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f4055d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 0x7f4058197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40542/0 (socket says 172.21.15.35:40542) 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f4055d9b700 1 -- 172.21.15.35:0/2774382632 learned_addr learned my addr 172.21.15.35:0/2774382632 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:22:34.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f405659c700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580ff400 0x7f40581971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f4056d9d700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40581044a0 0x7f40581a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f4055d9b700 1 -- 172.21.15.35:0/2774382632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580ff400 msgr2=0x7f40581971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.984+0000 7f4055d9b700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580ff400 0x7f40581971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f4055d9b700 1 -- 172.21.15.35:0/2774382632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40581044a0 msgr2=0x7f40581a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f4055d9b700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40581044a0 0x7f40581a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f4055d9b700 1 -- 172.21.15.35:0/2774382632 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050009d00 con 0x7f40580ffda0 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f4055d9b700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 0x7f4058197700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d980 tx=0x7f404c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:35.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c009930 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f404c010460 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405810f0b0 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c00f620 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.985+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405810ef20 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.986+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405810f240 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.987+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f404c0105d0 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.987+0000 7f40477fe700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f404009f550 0x7f40400a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.988+0000 7f405659c700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f404009f550 0x7f40400a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.988+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f404c0c9b70 con 0x7f40580ffda0 2023-03-17T08:22:35.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.988+0000 7f405659c700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f404009f550 0x7f40400a1a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4048005950 tx=0x7f404800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:35.071 INFO:teuthology.orchestra.run.smithi035.stdout:292057776309 2023-03-17T08:22:35.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:57.992+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f404c093d00 con 0x7f40580ffda0 2023-03-17T08:22:36.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.194+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f40581a3400 con 0x7f40580ffda0 2023-03-17T08:22:37.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.195+0000 7f40477fe700 1 -- 172.21.15.35:0/2774382632 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f404c017020 con 0x7f40580ffda0 2023-03-17T08:22:37.647 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f404009f550 msgr2=0x7f40400a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:38.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f404009f550 0x7f40400a1a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4048005950 tx=0x7f404800b410 comp rx=0 tx=0).stop 2023-03-17T08:22:38.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 msgr2=0x7f4058197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:38.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 0x7f4058197700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d980 tx=0x7f404c00dc90 comp rx=0 tx=0).stop 2023-03-17T08:22:38.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 shutdown_connections 2023-03-17T08:22:38.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40581044a0 0x7f40581a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:38.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40580ff400 0x7f40581971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:38.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f404009f550 0x7f40400a1a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:39.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 --2- 172.21.15.35:0/2774382632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40580ffda0 0x7f4058197700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:39.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 >> 172.21.15.35:0/2774382632 conn(0x7f4058077060 msgr2=0x7f40580fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:39.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 shutdown_connections 2023-03-17T08:22:39.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.197+0000 7f405cee6700 1 -- 172.21.15.35:0/2774382632 wait complete. 2023-03-17T08:22:39.803 INFO:teuthology.orchestra.run.smithi035.stdout:167503724771 2023-03-17T08:22:39.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.557+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1c781a5610 con 0x7f1c780ffd90 2023-03-17T08:22:41.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.557+0000 7f1c75ffb700 1 -- 172.21.15.35:0/3401165532 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c640c9e60 con 0x7f1c780ffd90 2023-03-17T08:22:41.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c6809f4d0 msgr2=0x7f1c680a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:41.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c6809f4d0 0x7f1c680a1980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c005950 tx=0x7f1c6c0058e0 comp rx=0 tx=0).stop 2023-03-17T08:22:41.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 msgr2=0x7f1c78195560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:41.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 0x7f1c78195560 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d950 tx=0x7f1c6400dd10 comp rx=0 tx=0).stop 2023-03-17T08:22:41.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 shutdown_connections 2023-03-17T08:22:41.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c78104490 0x7f1c78195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:41.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c780ff3f0 0x7f1c78195020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:44.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1c6809f4d0 0x7f1c680a1980 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:45.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 --2- 172.21.15.35:0/3401165532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1c780ffd90 0x7f1c78195560 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:45.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 >> 172.21.15.35:0/3401165532 conn(0x7f1c78077030 msgr2=0x7f1c780fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:45.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 shutdown_connections 2023-03-17T08:22:45.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:58.560+0000 7f1c7ea98700 1 -- 172.21.15.35:0/3401165532 wait complete. 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:16 smithi078 ceph-mon[94114]: pgmap v1147: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:18 smithi078 ceph-mon[94114]: pgmap v1148: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:20 smithi078 ceph-mon[94114]: pgmap v1149: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:22 smithi078 ceph-mon[94114]: pgmap v1150: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:23 smithi078 ceph-mon[94114]: pgmap v1151: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:26 smithi078 ceph-mon[94114]: pgmap v1152: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:28 smithi078 ceph-mon[94114]: pgmap v1153: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:30 smithi078 ceph-mon[94114]: pgmap v1154: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:32 smithi078 ceph-mon[94114]: pgmap v1155: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:34 smithi078 ceph-mon[94114]: pgmap v1156: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:36 smithi078 ceph-mon[94114]: pgmap v1157: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:45.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:38 smithi078 ceph-mon[94114]: pgmap v1158: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:16 smithi082 ceph-mon[94281]: pgmap v1147: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:18 smithi082 ceph-mon[94281]: pgmap v1148: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:20 smithi082 ceph-mon[94281]: pgmap v1149: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:22 smithi082 ceph-mon[94281]: pgmap v1150: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:23 smithi082 ceph-mon[94281]: pgmap v1151: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:26 smithi082 ceph-mon[94281]: pgmap v1152: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:28 smithi082 ceph-mon[94281]: pgmap v1153: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:30 smithi082 ceph-mon[94281]: pgmap v1154: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:32 smithi082 ceph-mon[94281]: pgmap v1155: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:45.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:34 smithi082 ceph-mon[94281]: pgmap v1156: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:46.676 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:36 smithi082 ceph-mon[94281]: pgmap v1157: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:46.676 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:38 smithi082 ceph-mon[94281]: pgmap v1158: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:46.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:59 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3401165532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-03-17T08:22:46.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:21:59 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/971275050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-03-17T08:22:46.677 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724741 got 167503724771 for osd.5 2023-03-17T08:22:47.774 DEBUG:teuthology.parallel:result is None 2023-03-17T08:22:47.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:40 smithi082 ceph-mon[94281]: pgmap v1159: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:49.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:42 smithi082 ceph-mon[94281]: pgmap v1160: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:49.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:44 smithi082 ceph-mon[94281]: pgmap v1161: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:49.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:46 smithi082 ceph-mon[94281]: pgmap v1162: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:49.253 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:40 smithi078 ceph-mon[94114]: pgmap v1159: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:49.253 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:42 smithi078 ceph-mon[94114]: pgmap v1160: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:22:49.253 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:44 smithi078 ceph-mon[94114]: pgmap v1161: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:49.253 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:46 smithi078 ceph-mon[94114]: pgmap v1162: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:22:49.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:48 smithi082 ceph-mon[94281]: pgmap v1163: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:49.254 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:48 smithi078 ceph-mon[94114]: pgmap v1163: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:22:49.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3676437635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea81014d0 msgr2=0x7f3ea81018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:49.255 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3676437635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea81014d0 0x7f3ea81018a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009990 tx=0x7f3ea4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:22:51.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3676437635 shutdown_connections 2023-03-17T08:22:51.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3676437635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea810a820 0x7f3ea810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:51.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3676437635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea81014d0 0x7f3ea81018a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3676437635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea8101de0 0x7f3ea810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3676437635 >> 172.21.15.35:0/3676437635 conn(0x7f3ea8077030 msgr2=0x7f3ea8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3676437635 shutdown_connections 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.902+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3676437635 wait complete. 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 Processor -- start 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 -- start start 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea81014d0 0x7f3ea81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 0x7f3ea8196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea810a820 0x7f3ea819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea819b2a0 con 0x7f3ea8101de0 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea819b410 con 0x7f3ea810a820 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eaff1b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea819b5d0 con 0x7f3ea81014d0 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3ead4b6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 0x7f3ea8196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3ead4b6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 0x7f3ea8196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40596/0 (socket says 172.21.15.35:40596) 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3ead4b6700 1 -- 172.21.15.35:0/3129538664 learned_addr learned my addr 172.21.15.35:0/3129538664 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:22:51.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.903+0000 7f3eae4b8700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea810a820 0x7f3ea819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:51.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3eadcb7700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea81014d0 0x7f3ea81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:51.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3ead4b6700 1 -- 172.21.15.35:0/3129538664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea81014d0 msgr2=0x7f3ea81962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:51.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3ead4b6700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea81014d0 0x7f3ea81962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:51.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3ead4b6700 1 -- 172.21.15.35:0/3129538664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea810a820 msgr2=0x7f3ea819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:51.883 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3ead4b6700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea810a820 0x7f3ea819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:51.883 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3ead4b6700 1 -- 172.21.15.35:0/3129538664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea40095f0 con 0x7f3ea8101de0 2023-03-17T08:22:51.883 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3ead4b6700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 0x7f3ea8196820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00c920 tx=0x7f3e9c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:51.883 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c004a30 con 0x7f3ea8101de0 2023-03-17T08:22:51.883 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9c0054b0 con 0x7f3ea8101de0 2023-03-17T08:22:51.883 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea81101a0 con 0x7f3ea8101de0 2023-03-17T08:22:51.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c007b50 con 0x7f3ea8101de0 2023-03-17T08:22:51.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.904+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea8110010 con 0x7f3ea8101de0 2023-03-17T08:22:51.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.905+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8110330 con 0x7f3ea8101de0 2023-03-17T08:22:51.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.906+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3e9c007cb0 con 0x7f3ea8101de0 2023-03-17T08:22:51.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.907+0000 7f3e9affd700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3e9409f4d0 0x7f3e940a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:22:53.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.907+0000 7f3eadcb7700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3e9409f4d0 0x7f3e940a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:22:53.350 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.907+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3e9c0ca0e0 con 0x7f3ea8101de0 2023-03-17T08:22:53.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.907+0000 7f3eadcb7700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3e9409f4d0 0x7f3e940a1980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400b5c0 tx=0x7f3ea4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:22:53.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.910+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3e9c094270 con 0x7f3ea8101de0 2023-03-17T08:22:54.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.108+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ea81a33f0 con 0x7f3ea8101de0 2023-03-17T08:22:54.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.109+0000 7f3e9affd700 1 -- 172.21.15.35:0/3129538664 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e9c01d070 con 0x7f3ea8101de0 2023-03-17T08:22:54.012 INFO:teuthology.orchestra.run.smithi035.stdout:77309411589 2023-03-17T08:22:54.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3e9409f4d0 msgr2=0x7f3e940a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:54.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3e9409f4d0 0x7f3e940a1980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400b5c0 tx=0x7f3ea4005ee0 comp rx=0 tx=0).stop 2023-03-17T08:22:54.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 msgr2=0x7f3ea8196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 0x7f3ea8196820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00c920 tx=0x7f3e9c00cc30 comp rx=0 tx=0).stop 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 shutdown_connections 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea810a820 0x7f3ea819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea81014d0 0x7f3ea81962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3e9409f4d0 0x7f3e940a1980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 --2- 172.21.15.35:0/3129538664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3ea8101de0 0x7f3ea8196820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 >> 172.21.15.35:0/3129538664 conn(0x7f3ea8077030 msgr2=0x7f3ea80fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:54.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 shutdown_connections 2023-03-17T08:22:56.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:00.111+0000 7f3eaff1b700 1 -- 172.21.15.35:0/3129538664 wait complete. 2023-03-17T08:22:56.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299564 got 223338299594 for osd.7 2023-03-17T08:22:56.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 -- 172.21.15.35:0/731883581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff970 msgr2=0x7f734410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:22:57.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 --2- 172.21.15.35:0/731883581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff970 0x7f734410c6d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7338009990 tx=0x7f7338009ca0 comp rx=0 tx=0).stop 2023-03-17T08:22:57.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 -- 172.21.15.35:0/731883581 shutdown_connections 2023-03-17T08:22:57.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 --2- 172.21.15.35:0/731883581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f734410cc10 0x7f734410eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:57.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 --2- 172.21.15.35:0/731883581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73440ff060 0x7f73440ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:57.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 --2- 172.21.15.35:0/731883581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff970 0x7f734410c6d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:22:57.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.179+0000 7f7349393700 1 -- 172.21.15.35:0/731883581 >> 172.21.15.35:0/731883581 conn(0x7f7344077060 msgr2=0x7f7344077460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:22:59.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.180+0000 7f7349393700 1 -- 172.21.15.35:0/731883581 shutdown_connections 2023-03-17T08:22:59.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.180+0000 7f7349393700 1 -- 172.21.15.35:0/731883581 wait complete. 2023-03-17T08:22:59.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.180+0000 7f7349393700 1 Processor -- start 2023-03-17T08:22:59.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.180+0000 7f7349393700 1 -- start start 2023-03-17T08:23:00.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.180+0000 7f7349393700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 0x7f7344198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:00.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.180+0000 7f7349393700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440ff970 0x7f7344198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:00.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7349393700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734410cc10 0x7f734419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7349393700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734419d4e0 con 0x7f73440ff060 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7349393700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734419d650 con 0x7f73440ff970 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7349393700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734419d810 con 0x7f734410cc10 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 0x7f7344198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 0x7f7344198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40566/0 (socket says 172.21.15.35:40566) 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 -- 172.21.15.35:0/971275050 learned_addr learned my addr 172.21.15.35:0/971275050 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f73437fe700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734410cc10 0x7f734419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f73427fc700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440ff970 0x7f7344198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 -- 172.21.15.35:0/971275050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734410cc10 msgr2=0x7f734419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734410cc10 0x7f734419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 -- 172.21.15.35:0/971275050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440ff970 msgr2=0x7f7344198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440ff970 0x7f7344198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 -- 172.21.15.35:0/971275050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73380095f0 con 0x7f73440ff060 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7342ffd700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 0x7f7344198520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f733400d950 tx=0x7f733400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400f890 con 0x7f73440ff060 2023-03-17T08:23:00.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f733400fe80 con 0x7f73440ff060 2023-03-17T08:23:00.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400e3b0 con 0x7f73440ff060 2023-03-17T08:23:00.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73441123b0 con 0x7f73440ff060 2023-03-17T08:23:00.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.181+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7344112220 con 0x7f73440ff060 2023-03-17T08:23:00.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.183+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7344112540 con 0x7f73440ff060 2023-03-17T08:23:00.459 DEBUG:teuthology.parallel:result is None 2023-03-17T08:23:00.459 INFO:teuthology.orchestra.run.smithi035.stdout:201863463126 2023-03-17T08:23:01.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.183+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f7334010460 con 0x7f73440ff060 2023-03-17T08:23:06.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.184+0000 7f732bfff700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f732c09f4d0 0x7f732c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:06.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.184+0000 7f73427fc700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f732c09f4d0 0x7f732c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:06.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.184+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f73340c9f90 con 0x7f73440ff060 2023-03-17T08:23:06.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.185+0000 7f73427fc700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f732c09f4d0 0x7f732c0a1980 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f73380059d0 tx=0x7f7338005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.189+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f7334094120 con 0x7f73440ff060 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.412+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7344066e30 con 0x7f73440ff060 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.412+0000 7f732bfff700 1 -- 172.21.15.35:0/971275050 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7334020020 con 0x7f73440ff060 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.414+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f732c09f4d0 msgr2=0x7f732c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.414+0000 7f7349393700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f732c09f4d0 0x7f732c0a1980 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f73380059d0 tx=0x7f7338005960 comp rx=0 tx=0).stop 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.414+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 msgr2=0x7f7344198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.414+0000 7f7349393700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 0x7f7344198520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f733400d950 tx=0x7f733400dc60 comp rx=0 tx=0).stop 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 shutdown_connections 2023-03-17T08:23:06.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f734410cc10 0x7f734419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:06.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f732c09f4d0 0x7f732c0a1980 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:06.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73440ff060 0x7f7344198520 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:06.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 --2- 172.21.15.35:0/971275050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440ff970 0x7f7344198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:06.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 >> 172.21.15.35:0/971275050 conn(0x7f7344077060 msgr2=0x7f734410e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:06.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 shutdown_connections 2023-03-17T08:23:08.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.415+0000 7f7349393700 1 -- 172.21.15.35:0/971275050 wait complete. 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 -- 172.21.15.35:0/1976469064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 msgr2=0x7f9508103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 --2- 172.21.15.35:0/1976469064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508103d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f94f40099c0 tx=0x7f94f4009cd0 comp rx=0 tx=0).stop 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 -- 172.21.15.35:0/1976469064 shutdown_connections 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 --2- 172.21.15.35:0/1976469064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 0x7f950810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 --2- 172.21.15.35:0/1976469064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95080ff3f0 0x7f95080ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 --2- 172.21.15.35:0/1976469064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508103d60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 -- 172.21.15.35:0/1976469064 >> 172.21.15.35:0/1976469064 conn(0x7f9508077030 msgr2=0x7f9508077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:08.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 -- 172.21.15.35:0/1976469064 shutdown_connections 2023-03-17T08:23:11.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.292+0000 7f950f030700 1 -- 172.21.15.35:0/1976469064 wait complete. 2023-03-17T08:23:11.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 Processor -- start 2023-03-17T08:23:11.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 -- start start 2023-03-17T08:23:11.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95080ff3f0 0x7f95081951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:11.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:11.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 0x7f9508199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:11.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950819a190 con 0x7f95080ffd90 2023-03-17T08:23:12.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950819a300 con 0x7f9508104490 2023-03-17T08:23:12.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f950f030700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950819a4c0 con 0x7f95080ff3f0 2023-03-17T08:23:13.510 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f9507fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.293+0000 7f9507fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40582/0 (socket says 172.21.15.35:40582) 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 -- 172.21.15.35:0/1386028432 learned_addr learned my addr 172.21.15.35:0/1386028432 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f950cdcc700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95080ff3f0 0x7f95081951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f950d5cd700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 0x7f9508199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 -- 172.21.15.35:0/1386028432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95080ff3f0 msgr2=0x7f95081951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95080ff3f0 0x7f95081951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 -- 172.21.15.35:0/1386028432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 msgr2=0x7f9508199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 0x7f9508199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 -- 172.21.15.35:0/1386028432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40095f0 con 0x7f95080ffd90 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f950d5cd700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 0x7f9508199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9507fff700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508195710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94f4006010 tx=0x7f94f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:13.511 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f401d070 con 0x7f95080ffd90 2023-03-17T08:23:13.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94f40041f0 con 0x7f95080ffd90 2023-03-17T08:23:13.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4004a00 con 0x7f95080ffd90 2023-03-17T08:23:14.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950810f110 con 0x7f95080ffd90 2023-03-17T08:23:14.760 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.294+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950810ef80 con 0x7f95080ffd90 2023-03-17T08:23:14.760 INFO:teuthology.orchestra.run.smithi035.stdout:55834575120 2023-03-17T08:23:14.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.295+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950810f2a0 con 0x7f95080ffd90 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.297+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f94f40052a0 con 0x7f95080ffd90 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.297+0000 7f9505ffb700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f94f809f550 0x7f94f80a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.298+0000 7f950cdcc700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f94f809f550 0x7f94f80a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.298+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f94f40cb5b0 con 0x7f95080ffd90 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.298+0000 7f950cdcc700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f94f809f550 0x7f94f80a1a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94fc005950 tx=0x7f94fc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.301+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f94f40957d0 con 0x7f95080ffd90 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.518+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9508066e30 con 0x7f95080ffd90 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.518+0000 7f9505ffb700 1 -- 172.21.15.35:0/1386028432 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94f4098df0 con 0x7f95080ffd90 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f94f809f550 msgr2=0x7f94f80a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f94f809f550 0x7f94f80a1a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94fc005950 tx=0x7f94fc00a300 comp rx=0 tx=0).stop 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 msgr2=0x7f9508195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:14.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508195710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94f4006010 tx=0x7f94f4004730 comp rx=0 tx=0).stop 2023-03-17T08:23:16.467 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 shutdown_connections 2023-03-17T08:23:16.467 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9508104490 0x7f9508199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:16.467 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95080ff3f0 0x7f95081951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:16.467 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f94f809f550 0x7f94f80a1a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:16.467 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 --2- 172.21.15.35:0/1386028432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95080ffd90 0x7f9508195710 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:17.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.521+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 >> 172.21.15.35:0/1386028432 conn(0x7f9508077030 msgr2=0x7f95080fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:17.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.522+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 shutdown_connections 2023-03-17T08:23:18.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:21:59.522+0000 7f950f030700 1 -- 172.21.15.35:0/1386028432 wait complete. 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:50 smithi082 ceph-mon[94281]: pgmap v1164: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:52 smithi082 ceph-mon[94281]: pgmap v1165: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:54 smithi082 ceph-mon[94281]: pgmap v1166: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:56 smithi082 ceph-mon[94281]: pgmap v1167: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:56 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: pgmap v1168: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:18.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:18.704 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:19.390 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:58 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:19.390 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:23:19.390 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:23:19.390 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:22:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:00 smithi082 ceph-mon[94281]: pgmap v1169: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:02 smithi082 ceph-mon[94281]: pgmap v1170: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:04 smithi082 ceph-mon[94281]: pgmap v1171: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:06 smithi082 ceph-mon[94281]: pgmap v1172: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:08 smithi082 ceph-mon[94281]: pgmap v1173: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:10 smithi082 ceph-mon[94281]: pgmap v1174: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:12 smithi082 ceph-mon[94281]: pgmap v1175: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:14 smithi082 ceph-mon[94281]: pgmap v1176: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:16 smithi082 ceph-mon[94281]: pgmap v1177: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:22.207 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:50 smithi078 ceph-mon[94114]: pgmap v1164: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:52 smithi078 ceph-mon[94114]: pgmap v1165: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:54 smithi078 ceph-mon[94114]: pgmap v1166: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:56 smithi078 ceph-mon[94114]: pgmap v1167: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:56 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: pgmap v1168: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:22.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:23.356 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:23.356 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:25.591 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:25.591 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:58 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:25.591 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:23:25.591 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:23:25.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:22:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:23:25.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:00 smithi078 ceph-mon[94114]: pgmap v1169: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:25.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:02 smithi078 ceph-mon[94114]: pgmap v1170: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:25.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:04 smithi078 ceph-mon[94114]: pgmap v1171: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:25.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:06 smithi078 ceph-mon[94114]: pgmap v1172: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:26.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:08 smithi078 ceph-mon[94114]: pgmap v1173: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:26.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:10 smithi078 ceph-mon[94114]: pgmap v1174: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:26.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:12 smithi078 ceph-mon[94114]: pgmap v1175: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:26.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:14 smithi078 ceph-mon[94114]: pgmap v1176: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:26.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:16 smithi078 ceph-mon[94114]: pgmap v1177: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:26.246 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776280 got 292057776309 for osd.9 2023-03-17T08:23:26.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:00 smithi035 ceph-mon[92535]: pgmap v1139: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:27.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:00 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1386028432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-03-17T08:23:27.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:00 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3129538664' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-03-17T08:23:27.258 DEBUG:teuthology.parallel:result is None 2023-03-17T08:23:27.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:18 smithi078 ceph-mon[94114]: pgmap v1178: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:27.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:20 smithi078 ceph-mon[94114]: pgmap v1179: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:27.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:22 smithi078 ceph-mon[94114]: pgmap v1180: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:27.829 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:24 smithi078 ceph-mon[94114]: pgmap v1181: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:28.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:26 smithi078 ceph-mon[94114]: pgmap v1182: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:18 smithi082 ceph-mon[94281]: pgmap v1178: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:20 smithi082 ceph-mon[94281]: pgmap v1179: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:22 smithi082 ceph-mon[94281]: pgmap v1180: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:24 smithi082 ceph-mon[94281]: pgmap v1181: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:28.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:26 smithi082 ceph-mon[94281]: pgmap v1182: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:28.766 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863463097 got 201863463126 for osd.6 2023-03-17T08:23:30.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411559 got 77309411589 for osd.2 2023-03-17T08:23:30.191 DEBUG:teuthology.parallel:result is None 2023-03-17T08:23:30.857 DEBUG:teuthology.parallel:result is None 2023-03-17T08:23:30.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:28 smithi078 ceph-mon[94114]: pgmap v1183: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:30.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:28 smithi082 ceph-mon[94281]: pgmap v1183: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:30.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 -- 172.21.15.35:0/2320787987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d010cc10 msgr2=0x7f25d010eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2320787987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d010cc10 0x7f25d010eff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f25c800b0a0 tx=0x7f25c800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 -- 172.21.15.35:0/2320787987 shutdown_connections 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2320787987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d010cc10 0x7f25d010eff0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2320787987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25d00ff060 0x7f25d00ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2320787987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d00ff970 0x7f25d010c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 -- 172.21.15.35:0/2320787987 >> 172.21.15.35:0/2320787987 conn(0x7f25d0077030 msgr2=0x7f25d0077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 -- 172.21.15.35:0/2320787987 shutdown_connections 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 -- 172.21.15.35:0/2320787987 wait complete. 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.413+0000 7f25d6c73700 1 Processor -- start 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 -- start start 2023-03-17T08:23:30.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 0x7f25d0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:31.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25d00ff970 0x7f25d0198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d010cc10 0x7f25d019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d019d5c0 con 0x7f25d00ff060 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d019d730 con 0x7f25d00ff970 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d6c73700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d019d8f0 con 0x7f25d010cc10 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 0x7f25d0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 0x7f25d0198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40604/0 (socket says 172.21.15.35:40604) 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 -- 172.21.15.35:0/2426368017 learned_addr learned my addr 172.21.15.35:0/2426368017 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25cffff700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25d00ff970 0x7f25d0198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:32.438 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d5210700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d010cc10 0x7f25d019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 -- 172.21.15.35:0/2426368017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d010cc10 msgr2=0x7f25d019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d010cc10 0x7f25d019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 -- 172.21.15.35:0/2426368017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25d00ff970 msgr2=0x7f25d0198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25d00ff970 0x7f25d0198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 -- 172.21.15.35:0/2426368017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8009d00 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d5210700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d010cc10 0x7f25d019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.414+0000 7f25d4a0f700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 0x7f25d0198670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25c400c920 tx=0x7f25c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.415+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4007b00 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.415+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25c400ce70 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.415+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0112360 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.415+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4005440 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.415+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d01121d0 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.417+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d01124f0 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.418+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f25c40055a0 con 0x7f25d00ff060 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.418+0000 7f25cdffb700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f25c009f4d0 0x7f25c00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.419+0000 7f25cffff700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f25c009f4d0 0x7f25c00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:32.439 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.419+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f25c40c9e40 con 0x7f25d00ff060 2023-03-17T08:23:32.440 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.419+0000 7f25cffff700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f25c009f4d0 0x7f25c00a1980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f25d0199c20 tx=0x7f25bc0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:32.440 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.423+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f25c4093f30 con 0x7f25d00ff060 2023-03-17T08:23:32.441 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834575090 got 55834575120 for osd.1 2023-03-17T08:23:33.481 DEBUG:teuthology.parallel:result is None 2023-03-17T08:23:33.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 -- 172.21.15.35:0/2788801522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 msgr2=0x7f38340ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:33.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 --2- 172.21.15.35:0/2788801522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f38340ff430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3824009990 tx=0x7f3824009ca0 comp rx=0 tx=0).stop 2023-03-17T08:23:33.483 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 -- 172.21.15.35:0/2788801522 shutdown_connections 2023-03-17T08:23:34.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 --2- 172.21.15.35:0/2788801522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f383410cc10 0x7f383410eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:34.882 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 --2- 172.21.15.35:0/2788801522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f38340ff430 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:34.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 --2- 172.21.15.35:0/2788801522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38340ff970 0x7f383410c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:36.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 -- 172.21.15.35:0/2788801522 >> 172.21.15.35:0/2788801522 conn(0x7f3834077030 msgr2=0x7f3834077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:36.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 -- 172.21.15.35:0/2788801522 shutdown_connections 2023-03-17T08:23:36.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.459+0000 7f383a796700 1 -- 172.21.15.35:0/2788801522 wait complete. 2023-03-17T08:23:36.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.460+0000 7f383a796700 1 Processor -- start 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.460+0000 7f383a796700 1 -- start start 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.460+0000 7f383a796700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f3834198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.460+0000 7f383a796700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38340ff970 0x7f38341989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.460+0000 7f383a796700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383410cc10 0x7f383419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f383a796700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383419d430 con 0x7f38340ff060 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f383a796700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383419d5a0 con 0x7f38340ff970 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f383a796700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383419d760 con 0x7f383410cc10 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f3834198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f3834198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40618/0 (socket says 172.21.15.35:40618) 2023-03-17T08:23:37.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 -- 172.21.15.35:0/3224543727 learned_addr learned my addr 172.21.15.35:0/3224543727 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:23:37.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3838d33700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383410cc10 0x7f383419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:37.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f38337fe700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38340ff970 0x7f38341989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:37.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 -- 172.21.15.35:0/3224543727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383410cc10 msgr2=0x7f383419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:37.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383410cc10 0x7f383419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:37.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 -- 172.21.15.35:0/3224543727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38340ff970 msgr2=0x7f38341989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:37.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38340ff970 0x7f38341989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 -- 172.21.15.35:0/3224543727 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240095f0 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f3833fff700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f3834198470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3824005910 tx=0x7f38240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382401d070 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3824021410 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824017650 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.461+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38341123a0 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.462+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3834112210 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.462+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3834112530 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.464+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f382400fb00 con 0x7f38340ff060 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.464+0000 7f38317fa700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f381c09f4d0 0x7f381c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:38.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.464+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f38240cbd30 con 0x7f38340ff060 2023-03-17T08:23:38.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.465+0000 7f38337fe700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f381c09f4d0 0x7f381c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:38.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.465+0000 7f38337fe700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f381c09f4d0 0x7f381c0a1980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3834199a90 tx=0x7f3828009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:23:38.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.468+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3824095f50 con 0x7f38340ff060 2023-03-17T08:23:38.443 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:23:38.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.644+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f25d01a5740 con 0x7f25d00ff060 2023-03-17T08:23:38.444 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.644+0000 7f25cdffb700 1 -- 172.21.15.35:0/2426368017 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25c401d030 con 0x7f25d00ff060 2023-03-17T08:23:38.444 INFO:teuthology.orchestra.run.smithi035.stdout:257698037952 2023-03-17T08:23:40.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.646+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f25c009f4d0 msgr2=0x7f25c00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:40.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.646+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f25c009f4d0 0x7f25c00a1980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f25d0199c20 tx=0x7f25bc0073d0 comp rx=0 tx=0).stop 2023-03-17T08:23:40.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.646+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 msgr2=0x7f25d0198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:42.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.646+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 0x7f25d0198670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25c400c920 tx=0x7f25c400cc30 comp rx=0 tx=0).stop 2023-03-17T08:23:42.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 shutdown_connections 2023-03-17T08:23:42.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25d010cc10 0x7f25d019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:42.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f25c009f4d0 0x7f25c00a1980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:42.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f25d00ff060 0x7f25d0198670 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:42.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 --2- 172.21.15.35:0/2426368017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25d00ff970 0x7f25d0198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:42.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 >> 172.21.15.35:0/2426368017 conn(0x7f25d0077030 msgr2=0x7f25d010e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:42.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 shutdown_connections 2023-03-17T08:23:42.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.647+0000 7f25d6c73700 1 -- 172.21.15.35:0/2426368017 wait complete. 2023-03-17T08:23:42.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.681+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38341a54f0 con 0x7f38340ff060 2023-03-17T08:23:43.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.681+0000 7f38317fa700 1 -- 172.21.15.35:0/3224543727 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3824099570 con 0x7f38340ff060 2023-03-17T08:23:45.566 INFO:teuthology.orchestra.run.smithi035.stdout:111669149942 2023-03-17T08:23:47.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:30 smithi078 ceph-mon[94114]: pgmap v1184: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:47.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:32 smithi078 ceph-mon[94114]: pgmap v1185: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:48.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:34 smithi078 ceph-mon[94114]: pgmap v1186: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:35 smithi078 ceph-mon[94114]: pgmap v1187: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:37 smithi078 ceph-mon[94114]: pgmap v1188: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:40 smithi078 ceph-mon[94114]: pgmap v1189: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:42 smithi078 ceph-mon[94114]: pgmap v1190: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:44 smithi078 ceph-mon[94114]: pgmap v1191: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:46 smithi078 ceph-mon[94114]: pgmap v1192: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:30 smithi082 ceph-mon[94281]: pgmap v1184: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:32 smithi082 ceph-mon[94281]: pgmap v1185: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:34 smithi082 ceph-mon[94281]: pgmap v1186: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:48.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:35 smithi082 ceph-mon[94281]: pgmap v1187: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:50.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:37 smithi082 ceph-mon[94281]: pgmap v1188: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:50.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:40 smithi082 ceph-mon[94281]: pgmap v1189: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:50.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:42 smithi082 ceph-mon[94281]: pgmap v1190: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:23:51.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:44 smithi082 ceph-mon[94281]: pgmap v1191: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:23:51.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:46 smithi082 ceph-mon[94281]: pgmap v1192: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:23:51.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.683+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f381c09f4d0 msgr2=0x7f381c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:52.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.683+0000 7f383a796700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f381c09f4d0 0x7f381c0a1980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3834199a90 tx=0x7f3828009260 comp rx=0 tx=0).stop 2023-03-17T08:23:52.457 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.683+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 msgr2=0x7f3834198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:52.460 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.683+0000 7f383a796700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f3834198470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3824005910 tx=0x7f38240047b0 comp rx=0 tx=0).stop 2023-03-17T08:23:53.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 shutdown_connections 2023-03-17T08:23:53.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383410cc10 0x7f383419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:53.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f381c09f4d0 0x7f381c0a1980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:53.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38340ff060 0x7f3834198470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:53.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 --2- 172.21.15.35:0/3224543727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38340ff970 0x7f38341989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:56.204 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 >> 172.21.15.35:0/3224543727 conn(0x7f3834077030 msgr2=0x7f383410df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:56.204 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 shutdown_connections 2023-03-17T08:23:56.204 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.684+0000 7f383a796700 1 -- 172.21.15.35:0/3224543727 wait complete. 2023-03-17T08:23:58.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/14173694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 msgr2=0x7f1bb810a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:23:58.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/14173694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb810a320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009990 tx=0x7f1ba8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/14173694 shutdown_connections 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/14173694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb810a860 0x7f1bb810cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/14173694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bb8101340 0x7f1bb8101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/14173694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb810a320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/14173694 >> 172.21.15.35:0/14173694 conn(0x7f1bb8077030 msgr2=0x7f1bb8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/14173694 shutdown_connections 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.865+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/14173694 wait complete. 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 Processor -- start 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 -- start start 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bb8101340 0x7f1bb81963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb81968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb810a860 0x7f1bb819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb819b370 con 0x7f1bb8101c50 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb819b4e0 con 0x7f1bb810a860 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbfb9f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb819b6a0 con 0x7f1bb8101340 2023-03-17T08:23:58.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbd13a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb81968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:23:59.208 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbd13a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb81968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40634/0 (socket says 172.21.15.35:40634) 2023-03-17T08:24:00.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbd13a700 1 -- 172.21.15.35:0/188832279 learned_addr learned my addr 172.21.15.35:0/188832279 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:24:00.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbe13c700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb810a860 0x7f1bb819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:00.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.866+0000 7f1bbd93b700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bb8101340 0x7f1bb81963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:00.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbd13a700 1 -- 172.21.15.35:0/188832279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bb8101340 msgr2=0x7f1bb81963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:00.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbd13a700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bb8101340 0x7f1bb81963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:00.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbd13a700 1 -- 172.21.15.35:0/188832279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb810a860 msgr2=0x7f1bb819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:00.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbd13a700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb810a860 0x7f1bb819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbd13a700 1 -- 172.21.15.35:0/188832279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80095f0 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbd13a700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb81968f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005910 tx=0x7f1ba8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba801d070 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ba8004c80 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb81101e0 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8003a30 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.867+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb8110050 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.868+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb8110370 con 0x7f1bb8101c50 2023-03-17T08:24:01.415 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.869+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1ba8004fd0 con 0x7f1bb8101c50 2023-03-17T08:24:01.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.870+0000 7f1baeffd700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1ba409f4d0 0x7f1ba40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:01.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.870+0000 7f1bbd93b700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1ba409f4d0 0x7f1ba40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:01.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.870+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1ba80cb500 con 0x7f1bb8101c50 2023-03-17T08:24:01.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.870+0000 7f1bbd93b700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1ba409f4d0 0x7f1ba40a1980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4005950 tx=0x7f1bb400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:24:02.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:01.873+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1ba8095680 con 0x7f1bb8101c50 2023-03-17T08:24:02.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.076+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f1bb8066e30 con 0x7f1bb8101c50 2023-03-17T08:24:02.580 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.076+0000 7f1baeffd700 1 -- 172.21.15.35:0/188832279 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f1ba8026020 con 0x7f1bb8101c50 2023-03-17T08:24:02.581 INFO:teuthology.orchestra.run.smithi035.stdout:313532612779 2023-03-17T08:24:02.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.078+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1ba409f4d0 msgr2=0x7f1ba40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:02.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.078+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1ba409f4d0 0x7f1ba40a1980 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4005950 tx=0x7f1bb400b410 comp rx=0 tx=0).stop 2023-03-17T08:24:02.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.078+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 msgr2=0x7f1bb81968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:02.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.078+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb81968f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005910 tx=0x7f1ba8009580 comp rx=0 tx=0).stop 2023-03-17T08:24:02.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 shutdown_connections 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb810a860 0x7f1bb819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bb8101340 0x7f1bb81963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1ba409f4d0 0x7f1ba40a1980 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 --2- 172.21.15.35:0/188832279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bb8101c50 0x7f1bb81968f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 >> 172.21.15.35:0/188832279 conn(0x7f1bb8077030 msgr2=0x7f1bb80fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 shutdown_connections 2023-03-17T08:24:03.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:02.079+0000 7f1bbfb9f700 1 -- 172.21.15.35:0/188832279 wait complete. 2023-03-17T08:24:03.386 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037921 got 257698037952 for osd.8 2023-03-17T08:24:03.387 DEBUG:teuthology.parallel:result is None 2023-03-17T08:24:03.388 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149911 got 111669149942 for osd.3 2023-03-17T08:24:05.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:02 smithi035 ceph-mon[92535]: pgmap v1140: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:05.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:02 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2426368017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-03-17T08:24:05.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:02 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3224543727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-03-17T08:24:05.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:02 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/188832279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-03-17T08:24:05.276 DEBUG:teuthology.parallel:result is None 2023-03-17T08:24:05.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:48 smithi078 ceph-mon[94114]: pgmap v1193: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:05.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:50 smithi078 ceph-mon[94114]: pgmap v1194: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:07.413 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:52 smithi078 ceph-mon[94114]: pgmap v1195: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:54 smithi078 ceph-mon[94114]: pgmap v1196: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:56 smithi078 ceph-mon[94114]: pgmap v1197: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:58 smithi078 ceph-mon[94114]: pgmap v1198: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:23:59 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:00 smithi078 ceph-mon[94114]: pgmap v1199: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:00 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:00 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:00 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:00 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:01 smithi078 ceph-mon[94114]: pgmap v1200: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:03 smithi078 ceph-mon[94114]: pgmap v1201: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:48 smithi082 ceph-mon[94281]: pgmap v1193: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:50 smithi082 ceph-mon[94281]: pgmap v1194: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:52 smithi082 ceph-mon[94281]: pgmap v1195: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:54 smithi082 ceph-mon[94281]: pgmap v1196: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:56 smithi082 ceph-mon[94281]: pgmap v1197: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:08.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:58 smithi082 ceph-mon[94281]: pgmap v1198: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:09.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:23:59 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:24:09.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:00 smithi082 ceph-mon[94281]: pgmap v1199: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:09.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:00 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:10.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:00 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:10.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:00 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:10.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:00 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:10.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:01 smithi082 ceph-mon[94281]: pgmap v1200: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:10.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:11.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:11.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:24:11.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:24:11.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:11.464 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:03 smithi082 ceph-mon[94281]: pgmap v1201: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:11.464 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612749 got 313532612779 for osd.10 2023-03-17T08:24:12.728 DEBUG:teuthology.parallel:result is None 2023-03-17T08:24:12.729 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:06 smithi082 ceph-mon[94281]: pgmap v1202: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:12.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:08 smithi082 ceph-mon[94281]: pgmap v1203: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:12.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:10 smithi082 ceph-mon[94281]: pgmap v1204: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:12.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:06 smithi078 ceph-mon[94114]: pgmap v1202: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:12.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:08 smithi078 ceph-mon[94114]: pgmap v1203: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:12.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:10 smithi078 ceph-mon[94114]: pgmap v1204: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:12.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 -- 172.21.15.35:0/2961384978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 msgr2=0x7f05c8104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:12.731 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2961384978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c8104e40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f05b00099c0 tx=0x7f05b0009cd0 comp rx=0 tx=0).stop 2023-03-17T08:24:12.731 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 -- 172.21.15.35:0/2961384978 shutdown_connections 2023-03-17T08:24:12.731 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2961384978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05c8105570 0x7f05c810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2961384978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 0x7f05c81008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2961384978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c8104e40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 -- 172.21.15.35:0/2961384978 >> 172.21.15.35:0/2961384978 conn(0x7f05c80fbd50 msgr2=0x7f05c80fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 -- 172.21.15.35:0/2961384978 shutdown_connections 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.612+0000 7f05ce95c700 1 -- 172.21.15.35:0/2961384978 wait complete. 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 Processor -- start 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 -- start start 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 0x7f05c8072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c80732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05c8105570 0x7f05c8073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:14.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c81a4680 con 0x7f05c8100e70 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c81a47f0 con 0x7f05c81004d0 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05ce95c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c81a49b0 con 0x7f05c8105570 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05c77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c80732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05c77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c80732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40644/0 (socket says 172.21.15.35:40644) 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.613+0000 7f05c77fe700 1 -- 172.21.15.35:0/2482457017 learned_addr learned my addr 172.21.15.35:0/2482457017 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c7fff700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 0x7f05c8072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05ccef9700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05c8105570 0x7f05c8073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c77fe700 1 -- 172.21.15.35:0/2482457017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05c8105570 msgr2=0x7f05c8073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c77fe700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05c8105570 0x7f05c8073840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:14.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c77fe700 1 -- 172.21.15.35:0/2482457017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 msgr2=0x7f05c8072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:15.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c77fe700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 0x7f05c8072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:15.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c77fe700 1 -- 172.21.15.35:0/2482457017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00095f0 con 0x7f05c8100e70 2023-03-17T08:24:15.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c7fff700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 0x7f05c8072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:24:15.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c77fe700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c80732c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f05b0000c00 tx=0x7f05b0005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:24:15.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b001d070 con 0x7f05c8100e70 2023-03-17T08:24:15.738 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c81101a0 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05b0022470 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0017650 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.614+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c8110010 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.615+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c8110330 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.616+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f05b00225e0 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.617+0000 7f05c57fa700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f05b409f550 0x7f05b40a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.617+0000 7f05c7fff700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f05b409f550 0x7f05b40a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.617+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f05b00cb740 con 0x7f05c8100e70 2023-03-17T08:24:15.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.617+0000 7f05c7fff700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f05b409f550 0x7f05b40a1a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05b8005fd0 tx=0x7f05b8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:24:15.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.620+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f05b0095960 con 0x7f05c8100e70 2023-03-17T08:24:15.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.824+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f05c8066e30 con 0x7f05c8100e70 2023-03-17T08:24:15.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.824+0000 7f05c57fa700 1 -- 172.21.15.35:0/2482457017 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f05b0098f80 con 0x7f05c8100e70 2023-03-17T08:24:15.740 INFO:teuthology.orchestra.run.smithi035.stdout:347892351138 2023-03-17T08:24:16.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:12 smithi082 ceph-mon[94281]: pgmap v1205: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:17.081 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:14 smithi082 ceph-mon[94281]: pgmap v1206: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:17.081 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:12 smithi078 ceph-mon[94114]: pgmap v1205: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:17.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:14 smithi078 ceph-mon[94114]: pgmap v1206: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:17.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f05b409f550 msgr2=0x7f05b40a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:17.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f05b409f550 0x7f05b40a1a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05b8005fd0 tx=0x7f05b8005e20 comp rx=0 tx=0).stop 2023-03-17T08:24:17.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 msgr2=0x7f05c80732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:17.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c80732c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f05b0000c00 tx=0x7f05b0005f10 comp rx=0 tx=0).stop 2023-03-17T08:24:17.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 shutdown_connections 2023-03-17T08:24:17.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05c8105570 0x7f05c8073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:17.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c81004d0 0x7f05c8072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:17.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f05b409f550 0x7f05b40a1a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:17.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 --2- 172.21.15.35:0/2482457017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f05c8100e70 0x7f05c80732c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:18.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 >> 172.21.15.35:0/2482457017 conn(0x7f05c80fbd50 msgr2=0x7f05c80fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:24:18.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.826+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 shutdown_connections 2023-03-17T08:24:18.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:22:03.827+0000 7f05ce95c700 1 -- 172.21.15.35:0/2482457017 wait complete. 2023-03-17T08:24:18.026 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351107 got 347892351138 for osd.11 2023-03-17T08:24:19.112 DEBUG:teuthology.parallel:result is None 2023-03-17T08:24:19.977 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-03-17T08:24:19.977 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph pg dump --format=json 2023-03-17T08:24:19.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:16 smithi082 ceph-mon[94281]: pgmap v1207: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:23.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:18 smithi082 ceph-mon[94281]: pgmap v1208: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:16 smithi078 ceph-mon[94114]: pgmap v1207: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:23.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:18 smithi078 ceph-mon[94114]: pgmap v1208: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:20 smithi082 ceph-mon[94281]: pgmap v1209: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:22 smithi082 ceph-mon[94281]: pgmap v1210: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:23.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:20 smithi078 ceph-mon[94114]: pgmap v1209: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:22 smithi078 ceph-mon[94114]: pgmap v1210: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:23.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:04 smithi035 ceph-mon[92535]: pgmap v1141: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.663 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:04 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2482457017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-03-17T08:24:23.663 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:06 smithi035 ceph-mon[92535]: pgmap v1142: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:23.663 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:08 smithi035 ceph-mon[92535]: pgmap v1143: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T08:24:23.663 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:10 smithi035 ceph-mon[92535]: pgmap v1144: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:12 smithi035 ceph-mon[92535]: pgmap v1145: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:23.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:14 smithi035 ceph-mon[92535]: pgmap v1146: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:23.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:16 smithi035 ceph-mon[92535]: pgmap v1147: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:23.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:18 smithi035 ceph-mon[92535]: pgmap v1148: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:20 smithi035 ceph-mon[92535]: pgmap v1149: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:22 smithi035 ceph-mon[92535]: pgmap v1150: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:23 smithi035 ceph-mon[92535]: pgmap v1151: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:26 smithi035 ceph-mon[92535]: pgmap v1152: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:28 smithi035 ceph-mon[92535]: pgmap v1153: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:30 smithi035 ceph-mon[92535]: pgmap v1154: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:32 smithi035 ceph-mon[92535]: pgmap v1155: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:34 smithi035 ceph-mon[92535]: pgmap v1156: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:36 smithi035 ceph-mon[92535]: pgmap v1157: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:38 smithi035 ceph-mon[92535]: pgmap v1158: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:40 smithi035 ceph-mon[92535]: pgmap v1159: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:42 smithi035 ceph-mon[92535]: pgmap v1160: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:44 smithi035 ceph-mon[92535]: pgmap v1161: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:46 smithi035 ceph-mon[92535]: pgmap v1162: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:48 smithi035 ceph-mon[92535]: pgmap v1163: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:50 smithi035 ceph-mon[92535]: pgmap v1164: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:52 smithi035 ceph-mon[92535]: pgmap v1165: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:54 smithi035 ceph-mon[92535]: pgmap v1166: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:56 smithi035 ceph-mon[92535]: pgmap v1167: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:56 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: pgmap v1168: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:58 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:24:25.110 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:22:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:26.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:00 smithi035 ceph-mon[92535]: pgmap v1169: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:26.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:02 smithi035 ceph-mon[92535]: pgmap v1170: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:26.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:04 smithi035 ceph-mon[92535]: pgmap v1171: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:26.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:06 smithi035 ceph-mon[92535]: pgmap v1172: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:28.746 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:08 smithi035 ceph-mon[92535]: pgmap v1173: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:28.746 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:10 smithi035 ceph-mon[92535]: pgmap v1174: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:29.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:12 smithi035 ceph-mon[92535]: pgmap v1175: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:29.426 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:14 smithi035 ceph-mon[92535]: pgmap v1176: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:29.426 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:16 smithi035 ceph-mon[92535]: pgmap v1177: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:30.894 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:18 smithi035 ceph-mon[92535]: pgmap v1178: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:30.894 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:20 smithi035 ceph-mon[92535]: pgmap v1179: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:31.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:22 smithi035 ceph-mon[92535]: pgmap v1180: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:31.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:24 smithi035 ceph-mon[92535]: pgmap v1181: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:31.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:26 smithi035 ceph-mon[92535]: pgmap v1182: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:31.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:28 smithi035 ceph-mon[92535]: pgmap v1183: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:31.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:30 smithi035 ceph-mon[92535]: pgmap v1184: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:31.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:32 smithi035 ceph-mon[92535]: pgmap v1185: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:34 smithi035 ceph-mon[92535]: pgmap v1186: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:35 smithi035 ceph-mon[92535]: pgmap v1187: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:37 smithi035 ceph-mon[92535]: pgmap v1188: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:40 smithi035 ceph-mon[92535]: pgmap v1189: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:42 smithi035 ceph-mon[92535]: pgmap v1190: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:44 smithi035 ceph-mon[92535]: pgmap v1191: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:46 smithi035 ceph-mon[92535]: pgmap v1192: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:48 smithi035 ceph-mon[92535]: pgmap v1193: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:50 smithi035 ceph-mon[92535]: pgmap v1194: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:52 smithi035 ceph-mon[92535]: pgmap v1195: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:32.251 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:54 smithi035 ceph-mon[92535]: pgmap v1196: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:56 smithi035 ceph-mon[92535]: pgmap v1197: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:33.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:58 smithi035 ceph-mon[92535]: pgmap v1198: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:23:59 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:24:33.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:00 smithi035 ceph-mon[92535]: pgmap v1199: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:00 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:00 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:00 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:00 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:01 smithi035 ceph-mon[92535]: pgmap v1200: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:03 smithi035 ceph-mon[92535]: pgmap v1201: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:06 smithi035 ceph-mon[92535]: pgmap v1202: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:08 smithi035 ceph-mon[92535]: pgmap v1203: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:10 smithi035 ceph-mon[92535]: pgmap v1204: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:12 smithi035 ceph-mon[92535]: pgmap v1205: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:14 smithi035 ceph-mon[92535]: pgmap v1206: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:16 smithi035 ceph-mon[92535]: pgmap v1207: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:33.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:18 smithi035 ceph-mon[92535]: pgmap v1208: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:20 smithi035 ceph-mon[92535]: pgmap v1209: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:33.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:22 smithi035 ceph-mon[92535]: pgmap v1210: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:33.904 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:24:34.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:24 smithi035 ceph-mon[92535]: pgmap v1211: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:24 smithi082 ceph-mon[94281]: pgmap v1211: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:26 smithi082 ceph-mon[94281]: pgmap v1212: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:35.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:26 smithi082 ceph-mon[94281]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:24:35.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:28 smithi082 ceph-mon[94281]: pgmap v1213: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:30 smithi082 ceph-mon[94281]: pgmap v1214: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:32 smithi082 ceph-mon[94281]: pgmap v1215: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:34 smithi082 ceph-mon[94281]: pgmap v1216: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:24 smithi078 ceph-mon[94114]: pgmap v1211: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:26 smithi078 ceph-mon[94114]: pgmap v1212: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:26 smithi078 ceph-mon[94114]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:28 smithi078 ceph-mon[94114]: pgmap v1213: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:30 smithi078 ceph-mon[94114]: pgmap v1214: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:32 smithi078 ceph-mon[94114]: pgmap v1215: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:35.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:34 smithi078 ceph-mon[94114]: pgmap v1216: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:35.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 -- 172.21.15.35:0/755658119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c104490 msgr2=0x7f3f9c10c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:36.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/755658119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c104490 0x7f3f9c10c010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400b0d0 tx=0x7f3f9400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 -- 172.21.15.35:0/755658119 shutdown_connections 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/755658119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c104490 0x7f3f9c10c010 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/755658119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/755658119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f9c0ffd90 0x7f3f9c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 -- 172.21.15.35:0/755658119 >> 172.21.15.35:0/755658119 conn(0x7f3f9c077030 msgr2=0x7f3f9c077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 -- 172.21.15.35:0/755658119 shutdown_connections 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 -- 172.21.15.35:0/755658119 wait complete. 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.931+0000 7f3fa2efb700 1 Processor -- start 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 -- start start 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c100e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f9c0ffd90 0x7f3f9c101340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:36.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f9c104490 0x7f3f9c1018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c1a4910 con 0x7f3f9c0ff3f0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c1a4a80 con 0x7f3f9c0ffd90 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa2efb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c1a4c40 con 0x7f3f9c104490 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c100e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c100e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40656/0 (socket says 172.21.15.35:40656) 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 -- 172.21.15.35:0/2501022210 learned_addr learned my addr 172.21.15.35:0/2501022210 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3f9bfff700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f9c0ffd90 0x7f3f9c101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa1498700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f9c104490 0x7f3f9c1018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 -- 172.21.15.35:0/2501022210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f9c104490 msgr2=0x7f3f9c1018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f9c104490 0x7f3f9c1018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 -- 172.21.15.35:0/2501022210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f9c0ffd90 msgr2=0x7f3f9c101340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f9c0ffd90 0x7f3f9c101340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 -- 172.21.15.35:0/2501022210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f94009d00 con 0x7f3f9c0ff3f0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.932+0000 7f3fa0c97700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c100e00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d950 tx=0x7f3f9000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.933+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000f890 con 0x7f3f9c0ff3f0 2023-03-17T08:24:37.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.933+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9000fe80 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.933+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000e3b0 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.933+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c10f110 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.933+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c10ef80 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.934+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c10f2a0 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.935+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3f90010460 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.935+0000 7f3f99ffb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f550 0x7f3f8c0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.935+0000 7f3f9bfff700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f550 0x7f3f8c0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.935+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3f900c9ff0 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.936+0000 7f3f9bfff700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f550 0x7f3f8c0a1a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c1025f0 tx=0x7f3f88009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:24.940+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3f900940e0 con 0x7f3f9c0ff3f0 2023-03-17T08:24:39.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.131+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f9c068cb0 con 0x7f3f8c09f550 2023-03-17T08:24:41.622 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.144+0000 7f3f99ffb700 1 -- 172.21.15.35:0/2501022210 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343784 (secure 0 0 0) 0x7f3f9c068cb0 con 0x7f3f8c09f550 2023-03-17T08:24:41.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:36 smithi078 ceph-mon[94114]: pgmap v1217: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:41.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:38 smithi078 ceph-mon[94114]: pgmap v1218: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:42.330 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:40 smithi078 ceph-mon[94114]: pgmap v1219: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:42.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:36 smithi082 ceph-mon[94281]: pgmap v1217: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:42.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:38 smithi082 ceph-mon[94281]: pgmap v1218: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:42.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:40 smithi082 ceph-mon[94281]: pgmap v1219: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:42.331 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:24:43.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:42 smithi078 ceph-mon[94114]: pgmap v1220: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:24:44.529 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:42 smithi082 ceph-mon[94281]: pgmap v1220: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:24:44.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f550 msgr2=0x7f3f8c0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:45.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f550 0x7f3f8c0a1a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c1025f0 tx=0x7f3f88009190 comp rx=0 tx=0).stop 2023-03-17T08:24:45.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 msgr2=0x7f3f9c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:24:45.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c100e00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d950 tx=0x7f3f9000dc60 comp rx=0 tx=0).stop 2023-03-17T08:24:45.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 shutdown_connections 2023-03-17T08:24:45.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f9c104490 0x7f3f9c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f550 0x7f3f8c0a1a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f9c0ff3f0 0x7f3f9c100e00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 --2- 172.21.15.35:0/2501022210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f9c0ffd90 0x7f3f9c101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 >> 172.21.15.35:0/2501022210 conn(0x7f3f9c077030 msgr2=0x7f3f9c0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 shutdown_connections 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:25.148+0000 7f3fa2efb700 1 -- 172.21.15.35:0/2501022210 wait complete. 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:24:45.720 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":1212,"stamp":"2023-03-17T08:24:24.731862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660956,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":5756,"num_read_kb":3010,"num_write":439,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":860,"ondisk_log_size":860,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":83680,"kb_used_data":13824,"kb_used_omap":0,"kb_used_meta":69760,"kb_avail":1124858144,"statfs":{"total":1151940427776,"available":1151854739456,"internally_reserved":0,"allocated":14155776,"data_stored":7766578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71434240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":75,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004068"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:16.823595+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:21:16.823595+0000","last_peered":"2023-03-17T08:21:16.823595+0000","last_clean":"2023-03-17T08:21:16.823595+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:21:16.823595+0000","last_undegraded":"2023-03-17T08:21:16.823595+0000","last_fullsized":"2023-03-17T08:21:16.823595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277175+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:21:20.277175+0000","last_peered":"2023-03-17T08:21:20.277175+0000","last_clean":"2023-03-17T08:21:20.277175+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:21:20.277175+0000","last_undegraded":"2023-03-17T08:21:20.277175+0000","last_fullsized":"2023-03-17T08:21:20.277175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277164+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:21:20.277164+0000","last_peered":"2023-03-17T08:21:20.277164+0000","last_clean":"2023-03-17T08:21:20.277164+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:21:20.277164+0000","last_undegraded":"2023-03-17T08:21:20.277164+0000","last_fullsized":"2023-03-17T08:21:20.277164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:01.041289+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:21:01.041289+0000","last_peered":"2023-03-17T08:21:01.041289+0000","last_clean":"2023-03-17T08:21:01.041289+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:21:01.041289+0000","last_undegraded":"2023-03-17T08:21:01.041289+0000","last_fullsized":"2023-03-17T08:21:01.041289+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.425329+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:20:29.425329+0000","last_peered":"2023-03-17T08:20:29.425329+0000","last_clean":"2023-03-17T08:20:29.425329+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:20:29.425329+0000","last_undegraded":"2023-03-17T08:20:29.425329+0000","last_fullsized":"2023-03-17T08:20:29.425329+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.372613+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:20:29.372613+0000","last_peered":"2023-03-17T08:20:29.372613+0000","last_clean":"2023-03-17T08:20:29.372613+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:20:29.372613+0000","last_undegraded":"2023-03-17T08:20:29.372613+0000","last_fullsized":"2023-03-17T08:20:29.372613+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:28.168883+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:20:28.168883+0000","last_peered":"2023-03-17T08:20:28.168883+0000","last_clean":"2023-03-17T08:20:28.168883+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:20:28.168883+0000","last_undegraded":"2023-03-17T08:20:28.168883+0000","last_fullsized":"2023-03-17T08:20:28.168883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.398095+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:20:29.398095+0000","last_peered":"2023-03-17T08:20:29.398095+0000","last_clean":"2023-03-17T08:20:29.398095+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:20:29.398095+0000","last_undegraded":"2023-03-17T08:20:29.398095+0000","last_fullsized":"2023-03-17T08:20:29.398095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:18.343884+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:20:18.343884+0000","last_peered":"2023-03-17T08:20:18.343884+0000","last_clean":"2023-03-17T08:20:18.343884+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:20:18.343884+0000","last_undegraded":"2023-03-17T08:20:18.343884+0000","last_fullsized":"2023-03-17T08:20:18.343884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.370745+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:20:14.370745+0000","last_peered":"2023-03-17T08:20:14.370745+0000","last_clean":"2023-03-17T08:20:14.370745+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:20:14.370745+0000","last_undegraded":"2023-03-17T08:20:14.370745+0000","last_fullsized":"2023-03-17T08:20:14.370745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:13.260579+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:20:13.260579+0000","last_peered":"2023-03-17T08:20:13.260579+0000","last_clean":"2023-03-17T08:20:13.260579+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:20:13.260579+0000","last_undegraded":"2023-03-17T08:20:13.260579+0000","last_fullsized":"2023-03-17T08:20:13.260579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:59.748930+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:20:59.748930+0000","last_peered":"2023-03-17T08:20:59.748930+0000","last_clean":"2023-03-17T08:20:59.748930+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:20:59.748930+0000","last_undegraded":"2023-03-17T08:20:59.748930+0000","last_fullsized":"2023-03-17T08:20:59.748930+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.160579+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:20:14.160579+0000","last_peered":"2023-03-17T08:20:14.160579+0000","last_clean":"2023-03-17T08:20:14.160579+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:20:14.160579+0000","last_undegraded":"2023-03-17T08:20:14.160579+0000","last_fullsized":"2023-03-17T08:20:14.160579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:00.267828+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:20:00.267828+0000","last_peered":"2023-03-17T08:20:00.267828+0000","last_clean":"2023-03-17T08:20:00.267828+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:20:00.267828+0000","last_undegraded":"2023-03-17T08:20:00.267828+0000","last_fullsized":"2023-03-17T08:20:00.267828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:00.267798+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:20:00.267798+0000","last_peered":"2023-03-17T08:20:00.267798+0000","last_clean":"2023-03-17T08:20:00.267798+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:20:00.267798+0000","last_undegraded":"2023-03-17T08:20:00.267798+0000","last_fullsized":"2023-03-17T08:20:00.267798+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:58.341396+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:19:58.341396+0000","last_peered":"2023-03-17T08:19:58.341396+0000","last_clean":"2023-03-17T08:19:58.341396+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:19:58.341396+0000","last_undegraded":"2023-03-17T08:19:58.341396+0000","last_fullsized":"2023-03-17T08:19:58.341396+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:56.814627+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:19:56.814627+0000","last_peered":"2023-03-17T08:19:56.814627+0000","last_clean":"2023-03-17T08:19:56.814627+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:19:56.814627+0000","last_undegraded":"2023-03-17T08:19:56.814627+0000","last_fullsized":"2023-03-17T08:19:56.814627+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:59.742447+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:19:59.742447+0000","last_peered":"2023-03-17T08:19:59.742447+0000","last_clean":"2023-03-17T08:19:59.742447+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:19:59.742447+0000","last_undegraded":"2023-03-17T08:19:59.742447+0000","last_fullsized":"2023-03-17T08:19:59.742447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.040157+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:21:59.040157+0000","last_peered":"2023-03-17T08:21:59.040157+0000","last_clean":"2023-03-17T08:21:59.040157+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:21:59.040157+0000","last_undegraded":"2023-03-17T08:21:59.040157+0000","last_fullsized":"2023-03-17T08:21:59.040157+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":594,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:23.171527+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:24:23.171527+0000","last_peered":"2023-03-17T08:24:23.171527+0000","last_clean":"2023-03-17T08:24:23.171527+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:24:23.171527+0000","last_undegraded":"2023-03-17T08:24:23.171527+0000","last_fullsized":"2023-03-17T08:24:23.171527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":559,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:04.402069+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:21:04.402069+0000","last_peered":"2023-03-17T08:21:04.402069+0000","last_clean":"2023-03-17T08:21:04.402069+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:21:04.402069+0000","last_undegraded":"2023-03-17T08:21:04.402069+0000","last_fullsized":"2023-03-17T08:21:04.402069+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:49.400602+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:20:49.400602+0000","last_peered":"2023-03-17T08:20:49.400602+0000","last_clean":"2023-03-17T08:20:49.400602+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:20:49.400602+0000","last_undegraded":"2023-03-17T08:20:49.400602+0000","last_fullsized":"2023-03-17T08:20:49.400602+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277236+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:21:20.277236+0000","last_peered":"2023-03-17T08:21:20.277236+0000","last_clean":"2023-03-17T08:21:20.277236+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:21:20.277236+0000","last_undegraded":"2023-03-17T08:21:20.277236+0000","last_fullsized":"2023-03-17T08:21:20.277236+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.423884+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:20:14.423884+0000","last_peered":"2023-03-17T08:20:14.423884+0000","last_clean":"2023-03-17T08:20:14.423884+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:20:14.423884+0000","last_undegraded":"2023-03-17T08:20:14.423884+0000","last_fullsized":"2023-03-17T08:20:14.423884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:28.344832+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:20:28.344832+0000","last_peered":"2023-03-17T08:20:28.344832+0000","last_clean":"2023-03-17T08:20:28.344832+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:20:28.344832+0000","last_undegraded":"2023-03-17T08:20:28.344832+0000","last_fullsized":"2023-03-17T08:20:28.344832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.423832+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:20:14.423832+0000","last_peered":"2023-03-17T08:20:14.423832+0000","last_clean":"2023-03-17T08:20:14.423832+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:20:14.423832+0000","last_undegraded":"2023-03-17T08:20:14.423832+0000","last_fullsized":"2023-03-17T08:20:14.423832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.360344+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:20:29.360344+0000","last_peered":"2023-03-17T08:20:29.360344+0000","last_clean":"2023-03-17T08:20:29.360344+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:20:29.360344+0000","last_undegraded":"2023-03-17T08:20:29.360344+0000","last_fullsized":"2023-03-17T08:20:29.360344+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":590,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:23.131547+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:24:23.131547+0000","last_peered":"2023-03-17T08:24:23.131547+0000","last_clean":"2023-03-17T08:24:23.131547+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:24:23.131547+0000","last_undegraded":"2023-03-17T08:24:23.131547+0000","last_fullsized":"2023-03-17T08:24:23.131547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":562,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.425303+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:20:29.425303+0000","last_peered":"2023-03-17T08:20:29.425303+0000","last_clean":"2023-03-17T08:20:29.425303+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:20:29.425303+0000","last_undegraded":"2023-03-17T08:20:29.425303+0000","last_fullsized":"2023-03-17T08:20:29.425303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.370672+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:20:14.370672+0000","last_peered":"2023-03-17T08:20:14.370672+0000","last_clean":"2023-03-17T08:20:14.370672+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:20:14.370672+0000","last_undegraded":"2023-03-17T08:20:14.370672+0000","last_fullsized":"2023-03-17T08:20:14.370672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.360278+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:20:29.360278+0000","last_peered":"2023-03-17T08:20:29.360278+0000","last_clean":"2023-03-17T08:20:29.360278+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:20:29.360278+0000","last_undegraded":"2023-03-17T08:20:29.360278+0000","last_fullsized":"2023-03-17T08:20:29.360278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:04.159219+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:20:04.159219+0000","last_peered":"2023-03-17T08:20:04.159219+0000","last_clean":"2023-03-17T08:20:04.159219+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:20:04.159219+0000","last_undegraded":"2023-03-17T08:20:04.159219+0000","last_fullsized":"2023-03-17T08:20:04.159219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.396594+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:20:14.396594+0000","last_peered":"2023-03-17T08:20:14.396594+0000","last_clean":"2023-03-17T08:20:14.396594+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:20:14.396594+0000","last_undegraded":"2023-03-17T08:20:14.396594+0000","last_fullsized":"2023-03-17T08:20:14.396594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:59.357057+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:19:59.357057+0000","last_peered":"2023-03-17T08:19:59.357057+0000","last_clean":"2023-03-17T08:19:59.357057+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:19:59.357057+0000","last_undegraded":"2023-03-17T08:19:59.357057+0000","last_fullsized":"2023-03-17T08:19:59.357057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.743889+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:20:14.743889+0000","last_peered":"2023-03-17T08:20:14.743889+0000","last_clean":"2023-03-17T08:20:14.743889+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:20:14.743889+0000","last_undegraded":"2023-03-17T08:20:14.743889+0000","last_fullsized":"2023-03-17T08:20:14.743889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":1143,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:24.132391+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:24:24.132391+0000","last_peered":"2023-03-17T08:24:24.132391+0000","last_clean":"2023-03-17T08:24:24.132391+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:24:24.132391+0000","last_undegraded":"2023-03-17T08:24:24.132391+0000","last_fullsized":"2023-03-17T08:24:24.132391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1116,"num_read_kb":1116,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:13.343293+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:20:13.343293+0000","last_peered":"2023-03-17T08:20:13.343293+0000","last_clean":"2023-03-17T08:20:13.343293+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:20:13.343293+0000","last_undegraded":"2023-03-17T08:20:13.343293+0000","last_fullsized":"2023-03-17T08:20:13.343293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:58.258849+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:19:58.258849+0000","last_peered":"2023-03-17T08:19:58.258849+0000","last_clean":"2023-03-17T08:19:58.258849+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:19:58.258849+0000","last_undegraded":"2023-03-17T08:19:58.258849+0000","last_fullsized":"2023-03-17T08:19:58.258849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:15.269598+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:20:15.269598+0000","last_peered":"2023-03-17T08:20:15.269598+0000","last_clean":"2023-03-17T08:20:15.269598+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:20:15.269598+0000","last_undegraded":"2023-03-17T08:20:15.269598+0000","last_fullsized":"2023-03-17T08:20:15.269598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:59.357140+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:19:59.357140+0000","last_peered":"2023-03-17T08:19:59.357140+0000","last_clean":"2023-03-17T08:19:59.357140+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:19:59.357140+0000","last_undegraded":"2023-03-17T08:19:59.357140+0000","last_fullsized":"2023-03-17T08:19:59.357140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:03.341986+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:20:03.341986+0000","last_peered":"2023-03-17T08:20:03.341986+0000","last_clean":"2023-03-17T08:20:03.341986+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:20:03.341986+0000","last_undegraded":"2023-03-17T08:20:03.341986+0000","last_fullsized":"2023-03-17T08:20:03.341986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'37","reported_seq":1205,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:24.132237+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:24:24.132237+0000","last_peered":"2023-03-17T08:24:24.132237+0000","last_clean":"2023-03-17T08:24:24.132237+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:24:24.132237+0000","last_undegraded":"2023-03-17T08:24:24.132237+0000","last_fullsized":"2023-03-17T08:24:24.132237+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63050,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1128,"num_read_kb":625,"num_write":39,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.423855+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:20:14.423855+0000","last_peered":"2023-03-17T08:20:14.423855+0000","last_clean":"2023-03-17T08:20:14.423855+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:20:14.423855+0000","last_undegraded":"2023-03-17T08:20:14.423855+0000","last_fullsized":"2023-03-17T08:20:14.423855+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:46.819966+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:20:46.819966+0000","last_peered":"2023-03-17T08:20:46.819966+0000","last_clean":"2023-03-17T08:20:46.819966+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:20:46.819966+0000","last_undegraded":"2023-03-17T08:20:46.819966+0000","last_fullsized":"2023-03-17T08:20:46.819966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:59.158716+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:19:59.158716+0000","last_peered":"2023-03-17T08:19:59.158716+0000","last_clean":"2023-03-17T08:19:59.158716+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:19:59.158716+0000","last_undegraded":"2023-03-17T08:19:59.158716+0000","last_fullsized":"2023-03-17T08:19:59.158716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:04.370883+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:22:04.370883+0000","last_peered":"2023-03-17T08:22:04.370883+0000","last_clean":"2023-03-17T08:22:04.370883+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:22:04.370883+0000","last_undegraded":"2023-03-17T08:22:04.370883+0000","last_fullsized":"2023-03-17T08:22:04.370883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:58.258816+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:19:58.258816+0000","last_peered":"2023-03-17T08:19:58.258816+0000","last_clean":"2023-03-17T08:19:58.258816+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:19:58.258816+0000","last_undegraded":"2023-03-17T08:19:58.258816+0000","last_fullsized":"2023-03-17T08:19:58.258816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":586,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:19.166589+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:24:19.166589+0000","last_peered":"2023-03-17T08:24:19.166589+0000","last_clean":"2023-03-17T08:24:19.166589+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:24:19.166589+0000","last_undegraded":"2023-03-17T08:24:19.166589+0000","last_fullsized":"2023-03-17T08:24:19.166589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:19:58.258767+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:19:58.258767+0000","last_peered":"2023-03-17T08:19:58.258767+0000","last_clean":"2023-03-17T08:19:58.258767+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:19:58.258767+0000","last_undegraded":"2023-03-17T08:19:58.258767+0000","last_fullsized":"2023-03-17T08:19:58.258767+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:04.435792+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:22:04.435792+0000","last_peered":"2023-03-17T08:22:04.435792+0000","last_clean":"2023-03-17T08:22:04.435792+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:22:04.435792+0000","last_undegraded":"2023-03-17T08:22:04.435792+0000","last_fullsized":"2023-03-17T08:22:04.435792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:44.747314+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:20:44.747314+0000","last_peered":"2023-03-17T08:20:44.747314+0000","last_clean":"2023-03-17T08:20:44.747314+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:20:44.747314+0000","last_undegraded":"2023-03-17T08:20:44.747314+0000","last_fullsized":"2023-03-17T08:20:44.747314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:31.818278+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:20:31.818278+0000","last_peered":"2023-03-17T08:20:31.818278+0000","last_clean":"2023-03-17T08:20:31.818278+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:20:31.818278+0000","last_undegraded":"2023-03-17T08:20:31.818278+0000","last_fullsized":"2023-03-17T08:20:31.818278+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:56.828329+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:21:56.828329+0000","last_peered":"2023-03-17T08:21:56.828329+0000","last_clean":"2023-03-17T08:21:56.828329+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:21:56.828329+0000","last_undegraded":"2023-03-17T08:21:56.828329+0000","last_fullsized":"2023-03-17T08:21:56.828329+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:04.749561+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:21:04.749561+0000","last_peered":"2023-03-17T08:21:04.749561+0000","last_clean":"2023-03-17T08:21:04.749561+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:21:04.749561+0000","last_undegraded":"2023-03-17T08:21:04.749561+0000","last_fullsized":"2023-03-17T08:21:04.749561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.377873+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:21:19.377873+0000","last_peered":"2023-03-17T08:21:19.377873+0000","last_clean":"2023-03-17T08:21:19.377873+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:21:19.377873+0000","last_undegraded":"2023-03-17T08:21:19.377873+0000","last_fullsized":"2023-03-17T08:21:19.377873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":585,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:22.170696+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:24:22.170696+0000","last_peered":"2023-03-17T08:24:22.170696+0000","last_clean":"2023-03-17T08:24:22.170696+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:24:22.170696+0000","last_undegraded":"2023-03-17T08:24:22.170696+0000","last_fullsized":"2023-03-17T08:24:22.170696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.377818+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:21:19.377818+0000","last_peered":"2023-03-17T08:21:19.377818+0000","last_clean":"2023-03-17T08:21:19.377818+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:21:19.377818+0000","last_undegraded":"2023-03-17T08:21:19.377818+0000","last_fullsized":"2023-03-17T08:21:19.377818+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:59.363335+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:20:59.363335+0000","last_peered":"2023-03-17T08:20:59.363335+0000","last_clean":"2023-03-17T08:20:59.363335+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:20:59.363335+0000","last_undegraded":"2023-03-17T08:20:59.363335+0000","last_fullsized":"2023-03-17T08:20:59.363335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'7","reported_seq":588,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:23.171550+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:24:23.171550+0000","last_peered":"2023-03-17T08:24:23.171550+0000","last_clean":"2023-03-17T08:24:23.171550+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:24:23.171550+0000","last_undegraded":"2023-03-17T08:24:23.171550+0000","last_fullsized":"2023-03-17T08:24:23.171550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":559,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.403678+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:21:19.403678+0000","last_peered":"2023-03-17T08:21:19.403678+0000","last_clean":"2023-03-17T08:21:19.403678+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:21:19.403678+0000","last_undegraded":"2023-03-17T08:21:19.403678+0000","last_fullsized":"2023-03-17T08:21:19.403678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:06.041923+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:21:06.041923+0000","last_peered":"2023-03-17T08:21:06.041923+0000","last_clean":"2023-03-17T08:21:06.041923+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:21:06.041923+0000","last_undegraded":"2023-03-17T08:21:06.041923+0000","last_fullsized":"2023-03-17T08:21:06.041923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:33.176756+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:21:33.176756+0000","last_peered":"2023-03-17T08:21:33.176756+0000","last_clean":"2023-03-17T08:21:33.176756+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:21:33.176756+0000","last_undegraded":"2023-03-17T08:21:33.176756+0000","last_fullsized":"2023-03-17T08:21:33.176756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.167398+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:21:19.167398+0000","last_peered":"2023-03-17T08:21:19.167398+0000","last_clean":"2023-03-17T08:21:19.167398+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:21:19.167398+0000","last_undegraded":"2023-03-17T08:21:19.167398+0000","last_fullsized":"2023-03-17T08:21:19.167398+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:48.171346+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:20:48.171346+0000","last_peered":"2023-03-17T08:20:48.171346+0000","last_clean":"2023-03-17T08:20:48.171346+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:20:48.171346+0000","last_undegraded":"2023-03-17T08:20:48.171346+0000","last_fullsized":"2023-03-17T08:20:48.171346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:04.428950+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:21:04.428950+0000","last_peered":"2023-03-17T08:21:04.428950+0000","last_clean":"2023-03-17T08:21:04.428950+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:21:04.428950+0000","last_undegraded":"2023-03-17T08:21:04.428950+0000","last_fullsized":"2023-03-17T08:21:04.428950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.167468+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:21:19.167468+0000","last_peered":"2023-03-17T08:21:19.167468+0000","last_clean":"2023-03-17T08:21:19.167468+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:21:19.167468+0000","last_undegraded":"2023-03-17T08:21:19.167468+0000","last_fullsized":"2023-03-17T08:21:19.167468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:24.751869+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:21:24.751869+0000","last_peered":"2023-03-17T08:21:24.751869+0000","last_clean":"2023-03-17T08:21:24.751869+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:21:24.751869+0000","last_undegraded":"2023-03-17T08:21:24.751869+0000","last_fullsized":"2023-03-17T08:21:24.751869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.405778+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:21:39.405778+0000","last_peered":"2023-03-17T08:21:39.405778+0000","last_clean":"2023-03-17T08:21:39.405778+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:21:39.405778+0000","last_undegraded":"2023-03-17T08:21:39.405778+0000","last_fullsized":"2023-03-17T08:21:39.405778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:26.044006+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:21:26.044006+0000","last_peered":"2023-03-17T08:21:26.044006+0000","last_clean":"2023-03-17T08:21:26.044006+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:21:26.044006+0000","last_undegraded":"2023-03-17T08:21:26.044006+0000","last_fullsized":"2023-03-17T08:21:26.044006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:40.279423+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:21:40.279423+0000","last_peered":"2023-03-17T08:21:40.279423+0000","last_clean":"2023-03-17T08:21:40.279423+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:21:40.279423+0000","last_undegraded":"2023-03-17T08:21:40.279423+0000","last_fullsized":"2023-03-17T08:21:40.279423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:23.350573+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:21:23.350573+0000","last_peered":"2023-03-17T08:21:23.350573+0000","last_clean":"2023-03-17T08:21:23.350573+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:21:23.350573+0000","last_undegraded":"2023-03-17T08:21:23.350573+0000","last_fullsized":"2023-03-17T08:21:23.350573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.433233+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:21:39.433233+0000","last_peered":"2023-03-17T08:21:39.433233+0000","last_clean":"2023-03-17T08:21:39.433233+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:21:39.433233+0000","last_undegraded":"2023-03-17T08:21:39.433233+0000","last_fullsized":"2023-03-17T08:21:39.433233+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:24.404177+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:21:24.404177+0000","last_peered":"2023-03-17T08:21:24.404177+0000","last_clean":"2023-03-17T08:21:24.404177+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:21:24.404177+0000","last_undegraded":"2023-03-17T08:21:24.404177+0000","last_fullsized":"2023-03-17T08:21:24.404177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:36.825838+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:21:36.825838+0000","last_peered":"2023-03-17T08:21:36.825838+0000","last_clean":"2023-03-17T08:21:36.825838+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:21:36.825838+0000","last_undegraded":"2023-03-17T08:21:36.825838+0000","last_fullsized":"2023-03-17T08:21:36.825838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:24.036483+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:21:24.036483+0000","last_peered":"2023-03-17T08:21:24.036483+0000","last_clean":"2023-03-17T08:21:24.036483+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:21:24.036483+0000","last_undegraded":"2023-03-17T08:21:24.036483+0000","last_fullsized":"2023-03-17T08:21:24.036483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.408170+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:21:59.408170+0000","last_peered":"2023-03-17T08:21:59.408170+0000","last_clean":"2023-03-17T08:21:59.408170+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:21:59.408170+0000","last_undegraded":"2023-03-17T08:21:59.408170+0000","last_fullsized":"2023-03-17T08:21:59.408170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.433276+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:21:39.433276+0000","last_peered":"2023-03-17T08:21:39.433276+0000","last_clean":"2023-03-17T08:21:39.433276+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:21:39.433276+0000","last_undegraded":"2023-03-17T08:21:39.433276+0000","last_fullsized":"2023-03-17T08:21:39.433276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:43.177926+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:21:43.177926+0000","last_peered":"2023-03-17T08:21:43.177926+0000","last_clean":"2023-03-17T08:21:43.177926+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:21:43.177926+0000","last_undegraded":"2023-03-17T08:21:43.177926+0000","last_fullsized":"2023-03-17T08:21:43.177926+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":586,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:22.298332+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:24:22.298332+0000","last_peered":"2023-03-17T08:24:22.298332+0000","last_clean":"2023-03-17T08:24:22.298332+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:24:22.298332+0000","last_undegraded":"2023-03-17T08:24:22.298332+0000","last_fullsized":"2023-03-17T08:24:22.298332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:58.179871+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:21:58.179871+0000","last_peered":"2023-03-17T08:21:58.179871+0000","last_clean":"2023-03-17T08:21:58.179871+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:21:58.179871+0000","last_undegraded":"2023-03-17T08:21:58.179871+0000","last_fullsized":"2023-03-17T08:21:58.179871+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:44.368364+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:21:44.368364+0000","last_peered":"2023-03-17T08:21:44.368364+0000","last_clean":"2023-03-17T08:21:44.368364+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:21:44.368364+0000","last_undegraded":"2023-03-17T08:21:44.368364+0000","last_fullsized":"2023-03-17T08:21:44.368364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:58.179843+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:21:58.179843+0000","last_peered":"2023-03-17T08:21:58.179843+0000","last_clean":"2023-03-17T08:21:58.179843+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:21:58.179843+0000","last_undegraded":"2023-03-17T08:21:58.179843+0000","last_fullsized":"2023-03-17T08:21:58.179843+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:44.170319+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:21:44.170319+0000","last_peered":"2023-03-17T08:21:44.170319+0000","last_clean":"2023-03-17T08:21:44.170319+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:21:44.170319+0000","last_undegraded":"2023-03-17T08:21:44.170319+0000","last_fullsized":"2023-03-17T08:21:44.170319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:03.180538+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:22:03.180538+0000","last_peered":"2023-03-17T08:22:03.180538+0000","last_clean":"2023-03-17T08:22:03.180538+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:22:03.180538+0000","last_undegraded":"2023-03-17T08:22:03.180538+0000","last_fullsized":"2023-03-17T08:22:03.180538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:16.823525+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:21:16.823525+0000","last_peered":"2023-03-17T08:21:16.823525+0000","last_clean":"2023-03-17T08:21:16.823525+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:21:16.823525+0000","last_undegraded":"2023-03-17T08:21:16.823525+0000","last_fullsized":"2023-03-17T08:21:16.823525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.035791+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:21:19.035791+0000","last_peered":"2023-03-17T08:21:19.035791+0000","last_clean":"2023-03-17T08:21:19.035791+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:21:19.035791+0000","last_undegraded":"2023-03-17T08:21:19.035791+0000","last_fullsized":"2023-03-17T08:21:19.035791+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.035807+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:21:19.035807+0000","last_peered":"2023-03-17T08:21:19.035807+0000","last_clean":"2023-03-17T08:21:19.035807+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:21:19.035807+0000","last_undegraded":"2023-03-17T08:21:19.035807+0000","last_fullsized":"2023-03-17T08:21:19.035807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277148+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:21:20.277148+0000","last_peered":"2023-03-17T08:21:20.277148+0000","last_clean":"2023-03-17T08:21:20.277148+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:21:20.277148+0000","last_undegraded":"2023-03-17T08:21:20.277148+0000","last_fullsized":"2023-03-17T08:21:20.277148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.169778+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:21:39.169778+0000","last_peered":"2023-03-17T08:21:39.169778+0000","last_clean":"2023-03-17T08:21:39.169778+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:21:39.169778+0000","last_undegraded":"2023-03-17T08:21:39.169778+0000","last_fullsized":"2023-03-17T08:21:39.169778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:36.825894+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:21:36.825894+0000","last_peered":"2023-03-17T08:21:36.825894+0000","last_clean":"2023-03-17T08:21:36.825894+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:21:36.825894+0000","last_undegraded":"2023-03-17T08:21:36.825894+0000","last_fullsized":"2023-03-17T08:21:36.825894+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.038216+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:21:39.038216+0000","last_peered":"2023-03-17T08:21:39.038216+0000","last_clean":"2023-03-17T08:21:39.038216+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:21:39.038216+0000","last_undegraded":"2023-03-17T08:21:39.038216+0000","last_fullsized":"2023-03-17T08:21:39.038216+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.405763+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:21:39.405763+0000","last_peered":"2023-03-17T08:21:39.405763+0000","last_clean":"2023-03-17T08:21:39.405763+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:21:39.405763+0000","last_undegraded":"2023-03-17T08:21:39.405763+0000","last_fullsized":"2023-03-17T08:21:39.405763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.367634+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:21:39.367634+0000","last_peered":"2023-03-17T08:21:39.367634+0000","last_clean":"2023-03-17T08:21:39.367634+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:21:39.367634+0000","last_undegraded":"2023-03-17T08:21:39.367634+0000","last_fullsized":"2023-03-17T08:21:39.367634+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.408108+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:21:59.408108+0000","last_peered":"2023-03-17T08:21:59.408108+0000","last_clean":"2023-03-17T08:21:59.408108+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:21:59.408108+0000","last_undegraded":"2023-03-17T08:21:59.408108+0000","last_fullsized":"2023-03-17T08:21:59.408108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:58.354086+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:21:58.354086+0000","last_peered":"2023-03-17T08:21:58.354086+0000","last_clean":"2023-03-17T08:21:58.354086+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:21:58.354086+0000","last_undegraded":"2023-03-17T08:21:58.354086+0000","last_fullsized":"2023-03-17T08:21:58.354086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.171909+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:21:59.171909+0000","last_peered":"2023-03-17T08:21:59.171909+0000","last_clean":"2023-03-17T08:21:59.171909+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:21:59.171909+0000","last_undegraded":"2023-03-17T08:21:59.171909+0000","last_fullsized":"2023-03-17T08:21:59.171909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:56.828303+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:21:56.828303+0000","last_peered":"2023-03-17T08:21:56.828303+0000","last_clean":"2023-03-17T08:21:56.828303+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:21:56.828303+0000","last_undegraded":"2023-03-17T08:21:56.828303+0000","last_fullsized":"2023-03-17T08:21:56.828303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70342,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":5620,"num_read_kb":2891,"num_write":256,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":211026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":1007616,"data_stored":483356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.40799999999999997,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":1.581,"15min":1.581},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.316},"max":{"1min":0.72799999999999998,"5min":1.536,"15min":1.536},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.66100000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.96699999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.624,"15min":0.60699999999999998},"min":{"1min":0.5,"5min":0.45300000000000001,"15min":0.35499999999999998},"max":{"1min":0.746,"5min":0.81999999999999995,"15min":1.1439999999999999},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.315,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.76100000000000001,"15min":0.82099999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.315,"5min":0.315,"15min":0.28999999999999998},"max":{"1min":0.83199999999999996,"5min":0.83599999999999997,"15min":0.85399999999999998},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.67400000000000004,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.73799999999999999,"5min":8.5410000000000004,"15min":8.5410000000000004},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83399999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.628}]},{"osd":4,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72399999999999998,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":1.0169999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.85699999999999998,"5min":0.90800000000000003,"15min":1.2250000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80500000000000005,"5min":0.96299999999999997,"15min":1.1160000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.68899999999999995,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.92500000000000004,"5min":1.026,"15min":1.026},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78700000000000003,"15min":0.76600000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95999999999999996,"5min":1.032,"15min":1.2849999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.72999999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.1879999999999999},"last":0.65400000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.40300000000000002},"max":{"1min":0.98499999999999999,"5min":1.0009999999999999,"15min":1.0469999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89300000000000002,"5min":0.96099999999999997,"15min":1.004},"last":0.69299999999999995}]},{"osd":9,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.77100000000000002,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.38600000000000001},"max":{"1min":0.90200000000000002,"5min":0.97599999999999998,"15min":1.3879999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84499999999999997,"15min":0.81499999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":1.49,"15min":1.49},"last":0.84099999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79800000000000004,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.499},"max":{"1min":0.94699999999999995,"5min":0.98799999999999999,"15min":1.194},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.78500000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":0.98299999999999998,"15min":1.415},"last":0.78400000000000003}]}]},{"osd":10,"up_from":73,"seq":313532612808,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7232,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93737920,"statfs":{"total":95995035648,"available":95987630080,"internally_reserved":0,"allocated":1695744,"data_stored":1137551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56999999999999995,"15min":0.60099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30399999999999999},"max":{"1min":0.87,"5min":0.87,"15min":6.0250000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.28100000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":2.2269999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.439,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.63600000000000001,"5min":0.75900000000000001,"15min":5.984},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.35699999999999998,"5min":0.32300000000000001,"15min":0.26200000000000001},"max":{"1min":0.61099999999999999,"5min":0.78900000000000003,"15min":1.1539999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.629,"15min":0.627},"min":{"1min":0.432,"5min":0.40200000000000002,"15min":0.34000000000000002},"max":{"1min":0.79300000000000004,"5min":0.88400000000000001,"15min":1.3069999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63200000000000001,"15min":0.65000000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":5.8220000000000001},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70899999999999996,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.41699999999999998,"15min":0.377},"max":{"1min":0.73799999999999999,"5min":10.16,"15min":10.16},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.42999999999999999,"15min":0.36299999999999999},"max":{"1min":0.75,"5min":1.0209999999999999,"15min":1.617},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":2.746},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53900000000000003,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35699999999999998,"15min":0.31},"max":{"1min":0.71899999999999997,"5min":0.86499999999999999,"15min":7.0670000000000002},"last":0.38400000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":0.83899999999999997,"5min":1.0069999999999999,"15min":1.2709999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.42499999999999999},"max":{"1min":0.88600000000000001,"5min":0.91800000000000004,"15min":5.8639999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.52500000000000002,"5min":0.44,"15min":0.41699999999999998},"max":{"1min":0.92300000000000004,"5min":1.99,"15min":5.952},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.52400000000000002,"5min":0.48299999999999998,"15min":0.38900000000000001},"max":{"1min":0.86399999999999999,"5min":1.0109999999999999,"15min":1.1839999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.41199999999999998},"max":{"1min":0.85899999999999999,"5min":0.96499999999999997,"15min":1.085},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.75},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.49099999999999999},"max":{"1min":0.88700000000000001,"5min":1.0029999999999999,"15min":1.3360000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Fri Mar 17 08:23:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.52000000000000002,"15min":0.503},"max":{"1min":0.90600000000000003,"5min":1.0229999999999999,"15min":8.2270000000000003},"last":0.626},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.77800000000000002},"min":{"1min":0.56899999999999995,"5min":0.50700000000000001,"15min":0.45300000000000001},"max":{"1min":0.92100000000000004,"5min":1.0009999999999999,"15min":5.375},"last":0.56200000000000006}]},{"osd":11,"last update":"Fri Mar 17 08:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":0.995,"15min":1.123},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.79100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51600000000000001},"max":{"1min":0.95099999999999996,"5min":1.0449999999999999,"15min":1.3859999999999999},"last":0.70399999999999996}]}]},{"osd":9,"up_from":68,"seq":292057776339,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46000000000000002,"15min":0.46600000000000003},"min":{"1min":0.35699999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66600000000000004,"5min":1.639,"15min":1.639},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.68000000000000005,"5min":1.669,"15min":1.669},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.62,"15min":0.624},"min":{"1min":0.51000000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.68400000000000005},"min":{"1min":0.57799999999999996,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.83199999999999996,"5min":0.995,"15min":1.298},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.48099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80600000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68300000000000005,"15min":0.69499999999999995},"min":{"1min":0.55800000000000005,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.242},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.499,"15min":0.498},"min":{"1min":0.377,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60099999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.60799999999999998,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.32500000000000001},"max":{"1min":0.625,"5min":6.1890000000000001,"15min":6.1890000000000001},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69799999999999995,"15min":0.71399999999999997},"min":{"1min":0.60199999999999998,"5min":0.46000000000000002,"15min":0.42199999999999999},"max":{"1min":0.93000000000000005,"5min":0.995,"15min":1.361},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.67800000000000005},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.90200000000000002,"15min":0.98399999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.69099999999999995},"min":{"1min":0.51100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79100000000000004,"5min":0.93200000000000005,"15min":1.002},"last":0.625},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82699999999999996,"5min":1.288,"15min":1.288},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.62,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.89000000000000001,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.755},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":1.913,"15min":1.913},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.58199999999999996,"5min":0.48999999999999999,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":1.0820000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.746,"15min":0.752},"min":{"1min":0.626,"5min":0.47499999999999998,"15min":0.41599999999999998},"max":{"1min":0.93200000000000005,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.61299999999999999}]},{"osd":8,"last update":"Fri Mar 17 08:23:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.68500000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0129999999999999,"5min":1.2330000000000001,"15min":1.3859999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.68999999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":0.93200000000000005,"5min":1.022,"15min":1.2190000000000001},"last":0.69799999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79000000000000004,"15min":0.82299999999999995},"min":{"1min":0.76000000000000001,"5min":0.58199999999999996,"15min":0.53500000000000003},"max":{"1min":0.96199999999999997,"5min":1.0820000000000001,"15min":1.4179999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.66700000000000004,"5min":0.50600000000000001,"15min":0.46400000000000002},"max":{"1min":1.0189999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66700000000000004}]}]},{"osd":8,"up_from":60,"seq":257698037981,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6564,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738588,"statfs":{"total":95995035648,"available":95988314112,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.38800000000000001,"15min":0.312},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":1.127},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.34599999999999997},"max":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":1.113},"last":0.63}]},{"osd":1,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.46899999999999997,"5min":0.36799999999999999,"15min":0.32000000000000001},"max":{"1min":0.80900000000000005,"5min":0.875,"15min":0.89700000000000002},"last":0.5},{"interface":"front","average":{"1min":0.628,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":0.97999999999999998,"15min":1.0149999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.33300000000000002,"15min":0.254},"max":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":1.236},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":1.0780000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.86399999999999999,"5min":0.87,"15min":1.2729999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.44,"15min":0.38200000000000001},"max":{"1min":0.80200000000000005,"5min":0.85599999999999998,"15min":1.387},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.89600000000000002,"5min":1.026,"15min":1.218},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.29299999999999998},"max":{"1min":0.77100000000000002,"5min":0.86399999999999999,"15min":1.4139999999999999},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.40300000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.52600000000000002,"5min":0.49099999999999999,"15min":0.39900000000000002},"max":{"1min":0.99299999999999999,"5min":1.0600000000000001,"15min":1.254},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.46400000000000002,"15min":0.434},"max":{"1min":1.0389999999999999,"5min":1.1140000000000001,"15min":1.165},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73099999999999998,"15min":0.73199999999999998},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.39400000000000002},"max":{"1min":0.93200000000000005,"5min":1.002,"15min":1.246},"last":0.51600000000000001}]},{"osd":9,"last update":"Fri Mar 17 08:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.64700000000000002,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.746},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79000000000000004,"15min":0.78900000000000003},"min":{"1min":0.64000000000000001,"5min":0.55200000000000005,"15min":0.51600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.8360000000000001},"last":0.73899999999999999}]},{"osd":10,"last update":"Fri Mar 17 08:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78000000000000003,"15min":0.77700000000000002},"min":{"1min":0.63900000000000001,"5min":0.54600000000000004,"15min":0.40699999999999997},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.337},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77800000000000002,"15min":0.76300000000000001},"min":{"1min":0.625,"5min":0.56499999999999995,"15min":0.46100000000000002},"max":{"1min":0.98199999999999998,"5min":1.026,"15min":1.1020000000000001},"last":0.55900000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.0509999999999999,"15min":1.3740000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.66300000000000003,"5min":0.55100000000000005,"15min":0.48199999999999998},"max":{"1min":0.93000000000000005,"5min":1.014,"15min":1.0489999999999999},"last":0.59599999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299624,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7216,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737936,"statfs":{"total":95995035648,"available":95987646464,"internally_reserved":0,"allocated":1613824,"data_stored":1076673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46000000000000002,"15min":0.44500000000000001},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.26000000000000001},"max":{"1min":0.58499999999999996,"5min":0.752,"15min":0.84299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.34300000000000003,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.627},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.29199999999999998},"max":{"1min":0.76500000000000001,"5min":0.80700000000000005,"15min":0.89000000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":0.81599999999999995,"5min":0.90700000000000003,"15min":0.92100000000000004},"last":0.622}]},{"osd":3,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66600000000000004,"15min":0.64400000000000002},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.88,"15min":3.8140000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.83699999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.82799999999999996,"15min":1.1200000000000001},"last":0.433}]},{"osd":5,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68999999999999995,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.378},"max":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71899999999999997,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41899999999999998},"max":{"1min":0.83299999999999996,"5min":1.0629999999999999,"15min":1.212},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.71099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.374},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.503}]},{"osd":8,"last update":"Fri Mar 17 08:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.61299999999999999,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99299999999999999,"5min":1.163,"15min":1.163},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79000000000000004,"15min":0.76600000000000001},"min":{"1min":0.66900000000000004,"5min":0.56499999999999995,"15min":0.45700000000000002},"max":{"1min":1.014,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69999999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.61899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0009999999999999,"5min":1.036,"15min":1.167},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.754},"min":{"1min":0.57499999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93799999999999994,"5min":0.98999999999999999,"15min":3.7970000000000002},"last":0.75600000000000001}]},{"osd":10,"last update":"Fri Mar 17 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.47599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.0469999999999999,"15min":1.0589999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.72499999999999998},"min":{"1min":0.59599999999999997,"5min":0.53600000000000003,"15min":0.39300000000000002},"max":{"1min":0.91000000000000003,"5min":0.997,"15min":1.4279999999999999},"last":0.67900000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.52700000000000002},"max":{"1min":0.98899999999999999,"5min":1.1759999999999999,"15min":1.238},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.58799999999999997},"max":{"1min":1.012,"5min":1.252,"15min":1.474},"last":0.82399999999999995}]}]},{"osd":6,"up_from":47,"seq":201863463156,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":999424,"data_stored":482646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.82399999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.372},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51100000000000001,"15min":0.48599999999999999},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":1.724,"15min":1.724},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.84599999999999997,"5min":6.5599999999999996,"15min":6.5599999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67600000000000005,"15min":0.65800000000000003},"min":{"1min":0.53000000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.876,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.68700000000000006},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":0.84799999999999998,"5min":1.597,"15min":1.597},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71799999999999997,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.38,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":6.5869999999999997,"15min":6.5869999999999997},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.93999999999999995,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83399999999999996,"5min":1.698,"15min":1.698},"last":0.503}]},{"osd":4,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.432,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":6.5,"15min":6.5},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.751,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":1.046,"5min":1.276,"15min":1.276},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":1.0229999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.73299999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":1.081,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Mar 17 08:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.61199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.121,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.77900000000000003},"min":{"1min":0.61099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":1.536,"15min":1.536},"last":0.58299999999999996}]},{"osd":8,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.622,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":1.0640000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.746},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84299999999999997,"15min":0.80600000000000005},"min":{"1min":0.66200000000000003,"5min":0.50700000000000001,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.64800000000000002}]},{"osd":9,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81699999999999995,"15min":0.79700000000000004},"min":{"1min":0.69599999999999995,"5min":0.438,"15min":0.438},"max":{"1min":1.0369999999999999,"5min":1.756,"15min":1.756},"last":0.625},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.91000000000000003,"15min":0.80600000000000005},"min":{"1min":0.56899999999999995,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.53900000000000003}]},{"osd":10,"last update":"Fri Mar 17 08:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.83799999999999997,"15min":0.83599999999999997},"min":{"1min":0.71099999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1619999999999999,"5min":1.369,"15min":1.369},"last":0.62},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.70899999999999996,"5min":0.54700000000000004,"15min":0.53900000000000003},"max":{"1min":1.105,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575149,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7644,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":93737508,"statfs":{"total":95995035648,"available":95987208192,"internally_reserved":0,"allocated":1069056,"data_stored":546876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.749,"5min":0.85399999999999998,"15min":1.022},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.44,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83299999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.32800000000000001},"max":{"1min":0.88700000000000001,"5min":0.98299999999999998,"15min":1.155},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.436,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.92400000000000004,"15min":1.1910000000000001},"last":0.78200000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69699999999999995,"15min":0.69499999999999995},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85099999999999998,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.34599999999999997},"max":{"1min":0.82199999999999995,"5min":0.93600000000000005,"15min":1.1319999999999999},"last":0.875}]},{"osd":4,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.505,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.26000000000000001},"max":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.85099999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":0.873,"15min":1.1459999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Mar 17 08:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.48499999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.71299999999999997},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.40999999999999998},"max":{"1min":0.92000000000000004,"5min":0.96799999999999997,"15min":1.23},"last":0.81999999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.41899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":1.071,"15min":1.071},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.36899999999999999},"max":{"1min":0.871,"5min":0.89000000000000001,"15min":1.0880000000000001},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.0129999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.69699999999999995},"min":{"1min":0.47199999999999998,"5min":0.42199999999999999,"15min":0.35699999999999998},"max":{"1min":0.93000000000000005,"5min":1.0489999999999999,"15min":1.0920000000000001},"last":0.76900000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78700000000000003,"15min":0.77900000000000003},"min":{"1min":0.53900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.016,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.61099999999999999,"5min":0.48499999999999999,"15min":0.45000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.79200000000000004}]},{"osd":9,"last update":"Fri Mar 17 08:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.76700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96499999999999997,"5min":1.083,"15min":1.3109999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83899999999999997,"15min":0.83299999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.45300000000000001},"max":{"1min":1.008,"5min":1.1140000000000001,"15min":1.1339999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.63700000000000001,"5min":0.40400000000000003,"15min":0.33500000000000002},"max":{"1min":0.90500000000000003,"5min":0.96599999999999997,"15min":1.1719999999999999},"last":0.75},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.627,"5min":0.502,"15min":0.36199999999999999},"max":{"1min":0.89600000000000002,"5min":1.03,"15min":1.3480000000000001},"last":0.72199999999999998}]},{"osd":11,"last update":"Fri Mar 17 08:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.85599999999999998,"15min":0.871},"min":{"1min":0.72399999999999998,"5min":0.63200000000000001,"15min":0.624},"max":{"1min":1.038,"5min":1.1240000000000001,"15min":1.163},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.626,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94399999999999995,"5min":1.119,"15min":1.3859999999999999},"last":0.85099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738679,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":483979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.999,"15min":0.999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.751,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88600000000000001,"5min":6.673,"15min":6.673},"last":0.62},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93899999999999995,"5min":1.0289999999999999,"15min":1.4850000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.61899999999999999,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72199999999999998,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61799999999999999,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":6.7549999999999999,"15min":6.7549999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.997,"5min":0.997,"15min":1.0029999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.60199999999999998,"5min":0.40200000000000002,"15min":0.33700000000000002},"max":{"1min":0.89200000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79300000000000004,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.91000000000000003,"5min":6.7000000000000002,"15min":6.7000000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.98999999999999999,"15min":1.5329999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68700000000000006,"15min":0.65200000000000002},"min":{"1min":0.45500000000000002,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":0.96399999999999997,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.745,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.29499999999999998},"max":{"1min":0.98199999999999998,"5min":6.7270000000000003,"15min":6.7270000000000003},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.38100000000000001},"max":{"1min":0.96399999999999997,"5min":1.075,"15min":1.409},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80300000000000005,"15min":0.79300000000000004},"min":{"1min":0.54600000000000004,"5min":0.48099999999999998,"15min":0.35699999999999998},"max":{"1min":1.016,"5min":1.0649999999999999,"15min":1.349},"last":0.78500000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84099999999999997,"15min":0.76500000000000001},"min":{"1min":0.48099999999999998,"5min":0.39100000000000001,"15min":0.34300000000000003},"max":{"1min":1.0569999999999999,"5min":6.6440000000000001,"15min":6.6440000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.40500000000000003,"5min":0.378,"15min":0.35499999999999998},"max":{"1min":1.0289999999999999,"5min":1.097,"15min":1.125},"last":0.81799999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.871,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1399999999999999,"5min":1.1539999999999999,"15min":1.1850000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83699999999999997},"min":{"1min":0.73899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0860000000000001,"5min":1.095,"15min":1.1499999999999999},"last":0.75600000000000001}]},{"osd":11,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91800000000000004,"15min":0.85699999999999998},"min":{"1min":0.67900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0269999999999999,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.874},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.042,"5min":1.1319999999999999,"15min":2.9849999999999999},"last":0.83499999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411619,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7452,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737700,"statfs":{"total":95995035648,"available":95987404800,"internally_reserved":0,"allocated":1003520,"data_stored":484188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90200000000000002,"15min":1.095},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90400000000000003,"15min":1.1639999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35699999999999998},"max":{"1min":0.77000000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.621},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Mar 17 08:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.371,"15min":0.35299999999999998},"max":{"1min":0.90900000000000003,"5min":1.157,"15min":1.903},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.44400000000000001,"5min":0.36599999999999999,"15min":0.35099999999999998},"max":{"1min":0.80700000000000005,"5min":0.88600000000000001,"15min":1.952},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78900000000000003,"5min":1.085,"15min":1.085},"last":0.748},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.437,"5min":0.437,"15min":0.376},"max":{"1min":0.79000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56399999999999995,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.80500000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.53400000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":1.103,"15min":1.103},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.38400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.1080000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":1.03,"15min":1.1890000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67800000000000005,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.32100000000000001},"max":{"1min":0.93500000000000005,"5min":1.167,"15min":1.167},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.627},"min":{"1min":0.48699999999999999,"5min":0.39800000000000002,"15min":0.35399999999999998},"max":{"1min":0.90500000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76400000000000001}]},{"osd":9,"last update":"Fri Mar 17 08:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.77400000000000002},"min":{"1min":0.60499999999999998,"5min":0.54600000000000004,"15min":0.41899999999999998},"max":{"1min":0.97799999999999998,"5min":1.1439999999999999,"15min":1.1499999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.73599999999999999},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.48999999999999999},"max":{"1min":0.89600000000000002,"5min":1.05,"15min":1.0820000000000001},"last":0.87}]},{"osd":10,"last update":"Fri Mar 17 08:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76200000000000001,"15min":0.74199999999999999},"min":{"1min":0.57599999999999996,"5min":0.51000000000000001,"15min":0.42599999999999999},"max":{"1min":0.98199999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77500000000000002,"15min":0.74399999999999999},"min":{"1min":0.63900000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.012,"5min":1.073,"15min":1.073},"last":0.84299999999999997}]},{"osd":11,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81599999999999995,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":0.91000000000000003,"5min":1.119,"15min":1.119},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.75800000000000001},"min":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.89300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149971,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6828,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738324,"statfs":{"total":95995035648,"available":95988043776,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.44900000000000001},"min":{"1min":0.32600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67200000000000004,"5min":1.161,"15min":1.161},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61699999999999999,"5min":1.387,"15min":1.387},"last":0.37}]},{"osd":1,"last update":"Fri Mar 17 08:23:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68400000000000005,"15min":0.67900000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41499999999999998},"max":{"1min":0.995,"5min":1.004,"15min":1.03},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.78300000000000003,"5min":0.90400000000000003,"15min":1.0189999999999999},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:23:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.64500000000000002},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94899999999999995,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.86599999999999999,"5min":1.101,"15min":1.101},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.68000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.044,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.496},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.433},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.2250000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0840000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44400000000000001,"5min":0.39500000000000002,"15min":0.34000000000000002},"max":{"1min":1.0549999999999999,"5min":1.1299999999999999,"15min":1.266},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80400000000000005,"5min":0.88400000000000001,"15min":0.96299999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.131},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.58999999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:23:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.073,"5min":1.091,"15min":1.2270000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.67800000000000005},"min":{"1min":0.42199999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91700000000000004,"5min":0.97499999999999998,"15min":1.042},"last":0.67600000000000005}]},{"osd":10,"last update":"Fri Mar 17 08:23:26 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97899999999999998,"5min":1.026,"15min":1.196},"last":0.755},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.056,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74299999999999999}]},{"osd":11,"last update":"Fri Mar 17 08:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.63300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.357,"15min":1.357},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.86499999999999999,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.84199999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888331,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6880,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738272,"statfs":{"total":95995035648,"available":95987990528,"internally_reserved":0,"allocated":1073152,"data_stored":546082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.26500000000000001},"max":{"1min":0.53000000000000003,"5min":0.63600000000000001,"15min":0.81100000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.45500000000000002},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.27500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75800000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.433},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.38400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.498,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.51900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":0.871,"5min":0.89200000000000002,"15min":0.98499999999999999},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Mar 17 08:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.96599999999999997},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.56599999999999995,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.51200000000000001,"5min":0.47299999999999998,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.91400000000000003,"15min":1.0169999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.44,"15min":0.39400000000000002},"max":{"1min":0.93300000000000005,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Mar 17 08:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.33100000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.0389999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.435,"15min":0.375},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.006},"last":0.53000000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.53300000000000003,"5min":0.51900000000000002,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.51800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.012},"last":0.68700000000000006}]},{"osd":9,"last update":"Fri Mar 17 08:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.67400000000000004,"5min":0.51700000000000002,"15min":0.48999999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.091},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.60799999999999998,"5min":0.50800000000000001,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.044},"last":0.74099999999999999}]},{"osd":10,"last update":"Fri Mar 17 08:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.44500000000000001},"max":{"1min":0.91500000000000004,"5min":0.95599999999999996,"15min":1.0569999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.70599999999999996},"min":{"1min":0.56000000000000005,"5min":0.42699999999999999,"15min":0.41199999999999998},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.67600000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.53500000000000003},"max":{"1min":0.93600000000000005,"5min":1.0289999999999999,"15min":1.0389999999999999},"last":0.755},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.81899999999999995},"min":{"1min":0.64900000000000002,"5min":0.59299999999999997,"15min":0.48899999999999999},"max":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":1.1240000000000001},"last":0.72499999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724801,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7288,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93737864,"statfs":{"total":95995035648,"available":95987572736,"internally_reserved":0,"allocated":1622016,"data_stored":1075585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.95799999999999996},"last":0.495},{"interface":"front","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.875,"15min":0.88900000000000001},"last":0.67100000000000004}]},{"osd":1,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":0.88,"15min":0.91100000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.81799999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.254},"max":{"1min":0.754,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.26200000000000001},"max":{"1min":0.63600000000000001,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.93300000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.95499999999999996,"15min":0.97699999999999998},"last":0.504}]},{"osd":4,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67000000000000004},"min":{"1min":0.498,"5min":0.47999999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.93100000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91700000000000004,"5min":0.92000000000000004,"15min":5.1669999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46000000000000002,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.996},"last":0.63}]},{"osd":7,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.70899999999999996},"min":{"1min":0.46700000000000003,"5min":0.46300000000000002,"15min":0.41399999999999998},"max":{"1min":0.93000000000000005,"5min":1.014,"15min":1.0840000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.70399999999999996},"min":{"1min":0.46700000000000003,"5min":0.44,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71499999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.32900000000000001},"max":{"1min":0.89000000000000001,"5min":1.04,"15min":1.0429999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.315},"max":{"1min":0.82499999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.51700000000000002}]},{"osd":9,"last update":"Fri Mar 17 08:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.748,"15min":0.745},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.38500000000000001},"max":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.099},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.59799999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":1.081,"15min":1.117},"last":0.54900000000000004}]},{"osd":10,"last update":"Fri Mar 17 08:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76200000000000001,"15min":0.75600000000000001},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.39400000000000002},"max":{"1min":0.83699999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.46300000000000002},"max":{"1min":0.87,"5min":1.1020000000000001,"15min":1.129},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:24:51.110 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph pg dump --format=json 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:26 smithi035 ceph-mon[92535]: pgmap v1212: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:26 smithi035 ceph-mon[92535]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:28 smithi035 ceph-mon[92535]: pgmap v1213: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:30 smithi035 ceph-mon[92535]: pgmap v1214: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:32 smithi035 ceph-mon[92535]: pgmap v1215: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:34 smithi035 ceph-mon[92535]: pgmap v1216: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:52.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:36 smithi035 ceph-mon[92535]: pgmap v1217: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:53.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:38 smithi035 ceph-mon[92535]: pgmap v1218: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:53.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:40 smithi035 ceph-mon[92535]: pgmap v1219: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:53.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:42 smithi035 ceph-mon[92535]: pgmap v1220: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:24:56.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:44 smithi035 ceph-mon[92535]: pgmap v1221: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:56.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:46 smithi035 ceph-mon[92535]: pgmap v1222: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:56.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:48 smithi035 ceph-mon[92535]: pgmap v1223: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:56.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:50 smithi035 ceph-mon[92535]: pgmap v1224: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:56.627 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:52 smithi035 ceph-mon[92535]: pgmap v1225: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:56.627 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:54 smithi035 ceph-mon[92535]: pgmap v1226: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:56.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:44 smithi078 ceph-mon[94114]: pgmap v1221: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:57.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:46 smithi078 ceph-mon[94114]: pgmap v1222: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:57.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:48 smithi078 ceph-mon[94114]: pgmap v1223: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:57.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:50 smithi078 ceph-mon[94114]: pgmap v1224: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:57.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:52 smithi078 ceph-mon[94114]: pgmap v1225: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:57.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:54 smithi078 ceph-mon[94114]: pgmap v1226: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:57.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:44 smithi082 ceph-mon[94281]: pgmap v1221: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:59.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:46 smithi082 ceph-mon[94281]: pgmap v1222: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:59.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:48 smithi082 ceph-mon[94281]: pgmap v1223: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:59.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:50 smithi082 ceph-mon[94281]: pgmap v1224: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:24:59.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:52 smithi082 ceph-mon[94281]: pgmap v1225: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:59.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:54 smithi082 ceph-mon[94281]: pgmap v1226: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:59.470 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:56 smithi035 ceph-mon[92535]: pgmap v1227: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:59.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:56 smithi078 ceph-mon[94114]: pgmap v1227: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:59.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:24:58 smithi078 ceph-mon[94114]: pgmap v1228: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:59.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:56 smithi082 ceph-mon[94281]: pgmap v1227: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:24:59.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:24:58 smithi082 ceph-mon[94281]: pgmap v1228: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:24:59.472 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 -- 172.21.15.35:0/2446021068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 msgr2=0x7fda68103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 --2- 172.21.15.35:0/2446021068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68103d60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0099c0 tx=0x7fda5c009cd0 comp rx=0 tx=0).stop 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 -- 172.21.15.35:0/2446021068 shutdown_connections 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 --2- 172.21.15.35:0/2446021068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda68104490 0x7fda6810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 --2- 172.21.15.35:0/2446021068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda680ff3f0 0x7fda680ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 --2- 172.21.15.35:0/2446021068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68103d60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 -- 172.21.15.35:0/2446021068 >> 172.21.15.35:0/2446021068 conn(0x7fda68077030 msgr2=0x7fda68077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 -- 172.21.15.35:0/2446021068 shutdown_connections 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.509+0000 7fda6e886700 1 -- 172.21.15.35:0/2446021068 wait complete. 2023-03-17T08:25:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 Processor -- start 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 -- start start 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda680ff3f0 0x7fda68197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda68104490 0x7fda681a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68197f90 con 0x7fda680ffd90 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda681a2700 con 0x7fda680ff3f0 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6e886700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda681a2870 con 0x7fda68104490 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40670/0 (socket says 172.21.15.35:40670) 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 -- 172.21.15.35:0/144515264 learned_addr learned my addr 172.21.15.35:0/144515264 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda67fff700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda680ff3f0 0x7fda68197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda6ce23700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda68104490 0x7fda681a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 -- 172.21.15.35:0/144515264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda68104490 msgr2=0x7fda681a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda68104490 0x7fda681a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 -- 172.21.15.35:0/144515264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda680ff3f0 msgr2=0x7fda68197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda680ff3f0 0x7fda68197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.510+0000 7fda677fe700 1 -- 172.21.15.35:0/144515264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0095f0 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.511+0000 7fda677fe700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68197680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c010 tx=0x7fda5c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.511+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c01d070 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.511+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda5c004040 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.511+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6810f0c0 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.511+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c005290 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.511+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6810ef30 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.512+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6810f250 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.513+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fda5c0048a0 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.513+0000 7fda657fa700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fda5009f4d0 0x7fda500a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.514+0000 7fda67fff700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fda5009f4d0 0x7fda500a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.514+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fda5c0caf70 con 0x7fda680ffd90 2023-03-17T08:25:00.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.514+0000 7fda67fff700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fda5009f4d0 0x7fda500a1980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda5800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:01.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.518+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fda5c0950f0 con 0x7fda680ffd90 2023-03-17T08:25:01.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.714+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda680fd3b0 con 0x7fda5009f4d0 2023-03-17T08:25:01.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.726+0000 7fda657fa700 1 -- 172.21.15.35:0/144515264 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344244 (secure 0 0 0) 0x7fda680fd3b0 con 0x7fda5009f4d0 2023-03-17T08:25:01.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:00 smithi078 ceph-mon[94114]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:25:03.053 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:00 smithi078 ceph-mon[94114]: pgmap v1229: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:03.053 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:00 smithi082 ceph-mon[94281]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:25:03.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:00 smithi082 ceph-mon[94281]: pgmap v1229: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:03.671 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:25:05.019 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fda5009f4d0 msgr2=0x7fda500a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fda5009f4d0 0x7fda500a1980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda5800a560 comp rx=0 tx=0).stop 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 msgr2=0x7fda68197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68197680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c010 tx=0x7fda5c009510 comp rx=0 tx=0).stop 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 shutdown_connections 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda68104490 0x7fda681a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda680ff3f0 0x7fda68197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:05.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fda5009f4d0 0x7fda500a1980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:06.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 --2- 172.21.15.35:0/144515264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda680ffd90 0x7fda68197680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:06.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 >> 172.21.15.35:0/144515264 conn(0x7fda68077030 msgr2=0x7fda680fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:06.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 shutdown_connections 2023-03-17T08:25:06.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:24:58.730+0000 7fda6e886700 1 -- 172.21.15.35:0/144515264 wait complete. 2023-03-17T08:25:06.182 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:25:06.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:24:58 smithi035 ceph-mon[92535]: pgmap v1228: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:06.183 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":1228,"stamp":"2023-03-17T08:24:56.743116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660956,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":6058,"num_read_kb":3158,"num_write":439,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":860,"ondisk_log_size":860,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":83680,"kb_used_data":13824,"kb_used_omap":0,"kb_used_meta":69760,"kb_avail":1124858144,"statfs":{"total":1151940427776,"available":1151854739456,"internally_reserved":0,"allocated":14155776,"data_stored":7766578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71434240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004387"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:16.823595+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:21:16.823595+0000","last_peered":"2023-03-17T08:21:16.823595+0000","last_clean":"2023-03-17T08:21:16.823595+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:21:16.823595+0000","last_undegraded":"2023-03-17T08:21:16.823595+0000","last_fullsized":"2023-03-17T08:21:16.823595+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277175+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:21:20.277175+0000","last_peered":"2023-03-17T08:21:20.277175+0000","last_clean":"2023-03-17T08:21:20.277175+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:21:20.277175+0000","last_undegraded":"2023-03-17T08:21:20.277175+0000","last_fullsized":"2023-03-17T08:21:20.277175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277164+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:21:20.277164+0000","last_peered":"2023-03-17T08:21:20.277164+0000","last_clean":"2023-03-17T08:21:20.277164+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:21:20.277164+0000","last_undegraded":"2023-03-17T08:21:20.277164+0000","last_fullsized":"2023-03-17T08:21:20.277164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:01.041289+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:21:01.041289+0000","last_peered":"2023-03-17T08:21:01.041289+0000","last_clean":"2023-03-17T08:21:01.041289+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:21:01.041289+0000","last_undegraded":"2023-03-17T08:21:01.041289+0000","last_fullsized":"2023-03-17T08:21:01.041289+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.425329+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:20:29.425329+0000","last_peered":"2023-03-17T08:20:29.425329+0000","last_clean":"2023-03-17T08:20:29.425329+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:20:29.425329+0000","last_undegraded":"2023-03-17T08:20:29.425329+0000","last_fullsized":"2023-03-17T08:20:29.425329+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.372613+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:20:29.372613+0000","last_peered":"2023-03-17T08:20:29.372613+0000","last_clean":"2023-03-17T08:20:29.372613+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:20:29.372613+0000","last_undegraded":"2023-03-17T08:20:29.372613+0000","last_fullsized":"2023-03-17T08:20:29.372613+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:28.168883+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:20:28.168883+0000","last_peered":"2023-03-17T08:20:28.168883+0000","last_clean":"2023-03-17T08:20:28.168883+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:20:28.168883+0000","last_undegraded":"2023-03-17T08:20:28.168883+0000","last_fullsized":"2023-03-17T08:20:28.168883+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.398095+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:20:29.398095+0000","last_peered":"2023-03-17T08:20:29.398095+0000","last_clean":"2023-03-17T08:20:29.398095+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:20:29.398095+0000","last_undegraded":"2023-03-17T08:20:29.398095+0000","last_fullsized":"2023-03-17T08:20:29.398095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:18.343884+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:20:18.343884+0000","last_peered":"2023-03-17T08:20:18.343884+0000","last_clean":"2023-03-17T08:20:18.343884+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:20:18.343884+0000","last_undegraded":"2023-03-17T08:20:18.343884+0000","last_fullsized":"2023-03-17T08:20:18.343884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.370745+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:20:14.370745+0000","last_peered":"2023-03-17T08:20:14.370745+0000","last_clean":"2023-03-17T08:20:14.370745+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:20:14.370745+0000","last_undegraded":"2023-03-17T08:20:14.370745+0000","last_fullsized":"2023-03-17T08:20:14.370745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:13.260579+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:20:13.260579+0000","last_peered":"2023-03-17T08:20:13.260579+0000","last_clean":"2023-03-17T08:20:13.260579+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:20:13.260579+0000","last_undegraded":"2023-03-17T08:20:13.260579+0000","last_fullsized":"2023-03-17T08:20:13.260579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:59.748930+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:20:59.748930+0000","last_peered":"2023-03-17T08:20:59.748930+0000","last_clean":"2023-03-17T08:20:59.748930+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:20:59.748930+0000","last_undegraded":"2023-03-17T08:20:59.748930+0000","last_fullsized":"2023-03-17T08:20:59.748930+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.160579+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:20:14.160579+0000","last_peered":"2023-03-17T08:20:14.160579+0000","last_clean":"2023-03-17T08:20:14.160579+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:20:14.160579+0000","last_undegraded":"2023-03-17T08:20:14.160579+0000","last_fullsized":"2023-03-17T08:20:14.160579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:20.283662+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:22:20.283662+0000","last_peered":"2023-03-17T08:22:20.283662+0000","last_clean":"2023-03-17T08:22:20.283662+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:22:20.283662+0000","last_undegraded":"2023-03-17T08:22:20.283662+0000","last_fullsized":"2023-03-17T08:22:20.283662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:20.283642+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:22:20.283642+0000","last_peered":"2023-03-17T08:22:20.283642+0000","last_clean":"2023-03-17T08:22:20.283642+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:22:20.283642+0000","last_undegraded":"2023-03-17T08:22:20.283642+0000","last_fullsized":"2023-03-17T08:22:20.283642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:18.356164+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:22:18.356164+0000","last_peered":"2023-03-17T08:22:18.356164+0000","last_clean":"2023-03-17T08:22:18.356164+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:22:18.356164+0000","last_undegraded":"2023-03-17T08:22:18.356164+0000","last_fullsized":"2023-03-17T08:22:18.356164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:16.830560+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:22:16.830560+0000","last_peered":"2023-03-17T08:22:16.830560+0000","last_clean":"2023-03-17T08:22:16.830560+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:22:16.830560+0000","last_undegraded":"2023-03-17T08:22:16.830560+0000","last_fullsized":"2023-03-17T08:22:16.830560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:19.671456+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:22:19.671456+0000","last_peered":"2023-03-17T08:22:19.671456+0000","last_clean":"2023-03-17T08:22:19.671456+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:22:19.671456+0000","last_undegraded":"2023-03-17T08:22:19.671456+0000","last_fullsized":"2023-03-17T08:22:19.671456+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.040157+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:21:59.040157+0000","last_peered":"2023-03-17T08:21:59.040157+0000","last_clean":"2023-03-17T08:21:59.040157+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:21:59.040157+0000","last_undegraded":"2023-03-17T08:21:59.040157+0000","last_fullsized":"2023-03-17T08:21:59.040157+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'13","reported_seq":624,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:53.215613+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:24:53.215613+0000","last_peered":"2023-03-17T08:24:53.215613+0000","last_clean":"2023-03-17T08:24:53.215613+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:24:53.215613+0000","last_undegraded":"2023-03-17T08:24:53.215613+0000","last_fullsized":"2023-03-17T08:24:53.215613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":589,"num_read_kb":589,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:04.402069+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:21:04.402069+0000","last_peered":"2023-03-17T08:21:04.402069+0000","last_clean":"2023-03-17T08:21:04.402069+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:21:04.402069+0000","last_undegraded":"2023-03-17T08:21:04.402069+0000","last_fullsized":"2023-03-17T08:21:04.402069+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:49.413622+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:22:49.413622+0000","last_peered":"2023-03-17T08:22:49.413622+0000","last_clean":"2023-03-17T08:22:49.413622+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:22:49.413622+0000","last_undegraded":"2023-03-17T08:22:49.413622+0000","last_fullsized":"2023-03-17T08:22:49.413622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277236+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:21:20.277236+0000","last_peered":"2023-03-17T08:21:20.277236+0000","last_clean":"2023-03-17T08:21:20.277236+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:21:20.277236+0000","last_undegraded":"2023-03-17T08:21:20.277236+0000","last_fullsized":"2023-03-17T08:21:20.277236+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.423884+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:20:14.423884+0000","last_peered":"2023-03-17T08:20:14.423884+0000","last_clean":"2023-03-17T08:20:14.423884+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:20:14.423884+0000","last_undegraded":"2023-03-17T08:20:14.423884+0000","last_fullsized":"2023-03-17T08:20:14.423884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:28.344832+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:20:28.344832+0000","last_peered":"2023-03-17T08:20:28.344832+0000","last_clean":"2023-03-17T08:20:28.344832+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:20:28.344832+0000","last_undegraded":"2023-03-17T08:20:28.344832+0000","last_fullsized":"2023-03-17T08:20:28.344832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.423832+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:20:14.423832+0000","last_peered":"2023-03-17T08:20:14.423832+0000","last_clean":"2023-03-17T08:20:14.423832+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:20:14.423832+0000","last_undegraded":"2023-03-17T08:20:14.423832+0000","last_fullsized":"2023-03-17T08:20:14.423832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.360344+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:20:29.360344+0000","last_peered":"2023-03-17T08:20:29.360344+0000","last_clean":"2023-03-17T08:20:29.360344+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:20:29.360344+0000","last_undegraded":"2023-03-17T08:20:29.360344+0000","last_fullsized":"2023-03-17T08:20:29.360344+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":620,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:53.174184+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:24:53.174184+0000","last_peered":"2023-03-17T08:24:53.174184+0000","last_clean":"2023-03-17T08:24:53.174184+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:24:53.174184+0000","last_undegraded":"2023-03-17T08:24:53.174184+0000","last_fullsized":"2023-03-17T08:24:53.174184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":592,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.425303+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:20:29.425303+0000","last_peered":"2023-03-17T08:20:29.425303+0000","last_clean":"2023-03-17T08:20:29.425303+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:20:29.425303+0000","last_undegraded":"2023-03-17T08:20:29.425303+0000","last_fullsized":"2023-03-17T08:20:29.425303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.370672+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:20:14.370672+0000","last_peered":"2023-03-17T08:20:14.370672+0000","last_clean":"2023-03-17T08:20:14.370672+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:20:14.370672+0000","last_undegraded":"2023-03-17T08:20:14.370672+0000","last_fullsized":"2023-03-17T08:20:14.370672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:29.360278+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:20:29.360278+0000","last_peered":"2023-03-17T08:20:29.360278+0000","last_clean":"2023-03-17T08:20:29.360278+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:20:29.360278+0000","last_undegraded":"2023-03-17T08:20:29.360278+0000","last_fullsized":"2023-03-17T08:20:29.360278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:29.175239+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:22:29.175239+0000","last_peered":"2023-03-17T08:22:29.175239+0000","last_clean":"2023-03-17T08:22:29.175239+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:22:29.175239+0000","last_undegraded":"2023-03-17T08:22:29.175239+0000","last_fullsized":"2023-03-17T08:22:29.175239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.396594+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:20:14.396594+0000","last_peered":"2023-03-17T08:20:14.396594+0000","last_clean":"2023-03-17T08:20:14.396594+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:20:14.396594+0000","last_undegraded":"2023-03-17T08:20:14.396594+0000","last_fullsized":"2023-03-17T08:20:14.396594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:24.373107+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:22:24.373107+0000","last_peered":"2023-03-17T08:22:24.373107+0000","last_clean":"2023-03-17T08:22:24.373107+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:22:24.373107+0000","last_undegraded":"2023-03-17T08:22:24.373107+0000","last_fullsized":"2023-03-17T08:22:24.373107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.743889+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:20:14.743889+0000","last_peered":"2023-03-17T08:20:14.743889+0000","last_clean":"2023-03-17T08:20:14.743889+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:20:14.743889+0000","last_undegraded":"2023-03-17T08:20:14.743889+0000","last_fullsized":"2023-03-17T08:20:14.743889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":1203,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:53.355064+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:24:53.355064+0000","last_peered":"2023-03-17T08:24:53.355064+0000","last_clean":"2023-03-17T08:24:53.355064+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:24:53.355064+0000","last_undegraded":"2023-03-17T08:24:53.355064+0000","last_fullsized":"2023-03-17T08:24:53.355064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1175,"num_read_kb":1175,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:13.343293+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:20:13.343293+0000","last_peered":"2023-03-17T08:20:13.343293+0000","last_clean":"2023-03-17T08:20:13.343293+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:20:13.343293+0000","last_undegraded":"2023-03-17T08:20:13.343293+0000","last_fullsized":"2023-03-17T08:20:13.343293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:23.182981+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:22:23.182981+0000","last_peered":"2023-03-17T08:22:23.182981+0000","last_clean":"2023-03-17T08:22:23.182981+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:22:23.182981+0000","last_undegraded":"2023-03-17T08:22:23.182981+0000","last_fullsized":"2023-03-17T08:22:23.182981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:15.269598+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:20:15.269598+0000","last_peered":"2023-03-17T08:20:15.269598+0000","last_clean":"2023-03-17T08:20:15.269598+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:20:15.269598+0000","last_undegraded":"2023-03-17T08:20:15.269598+0000","last_fullsized":"2023-03-17T08:20:15.269598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:24.373182+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:22:24.373182+0000","last_peered":"2023-03-17T08:22:24.373182+0000","last_clean":"2023-03-17T08:22:24.373182+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:22:24.373182+0000","last_undegraded":"2023-03-17T08:22:24.373182+0000","last_fullsized":"2023-03-17T08:22:24.373182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:23.356678+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:22:23.356678+0000","last_peered":"2023-03-17T08:22:23.356678+0000","last_clean":"2023-03-17T08:22:23.356678+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:22:23.356678+0000","last_undegraded":"2023-03-17T08:22:23.356678+0000","last_fullsized":"2023-03-17T08:22:23.356678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'37","reported_seq":1266,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:54.174855+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:24:54.174855+0000","last_peered":"2023-03-17T08:24:54.174855+0000","last_clean":"2023-03-17T08:24:54.174855+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:24:54.174855+0000","last_undegraded":"2023-03-17T08:24:54.174855+0000","last_fullsized":"2023-03-17T08:24:54.174855+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63050,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":655,"num_write":39,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:14.423855+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:20:14.423855+0000","last_peered":"2023-03-17T08:20:14.423855+0000","last_clean":"2023-03-17T08:20:14.423855+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:20:14.423855+0000","last_undegraded":"2023-03-17T08:20:14.423855+0000","last_fullsized":"2023-03-17T08:20:14.423855+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:46.819966+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:20:46.819966+0000","last_peered":"2023-03-17T08:20:46.819966+0000","last_clean":"2023-03-17T08:20:46.819966+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:20:46.819966+0000","last_undegraded":"2023-03-17T08:20:46.819966+0000","last_fullsized":"2023-03-17T08:20:46.819966+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:19.174128+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:22:19.174128+0000","last_peered":"2023-03-17T08:22:19.174128+0000","last_clean":"2023-03-17T08:22:19.174128+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:22:19.174128+0000","last_undegraded":"2023-03-17T08:22:19.174128+0000","last_fullsized":"2023-03-17T08:22:19.174128+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:04.370883+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:22:04.370883+0000","last_peered":"2023-03-17T08:22:04.370883+0000","last_clean":"2023-03-17T08:22:04.370883+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:22:04.370883+0000","last_undegraded":"2023-03-17T08:22:04.370883+0000","last_fullsized":"2023-03-17T08:22:04.370883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:18.182313+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:22:18.182313+0000","last_peered":"2023-03-17T08:22:18.182313+0000","last_clean":"2023-03-17T08:22:18.182313+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:22:18.182313+0000","last_undegraded":"2023-03-17T08:22:18.182313+0000","last_fullsized":"2023-03-17T08:22:18.182313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":622,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:54.217590+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:24:54.217590+0000","last_peered":"2023-03-17T08:24:54.217590+0000","last_clean":"2023-03-17T08:24:54.217590+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:24:54.217590+0000","last_undegraded":"2023-03-17T08:24:54.217590+0000","last_fullsized":"2023-03-17T08:24:54.217590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":594,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:18.182252+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:22:18.182252+0000","last_peered":"2023-03-17T08:22:18.182252+0000","last_clean":"2023-03-17T08:22:18.182252+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:22:18.182252+0000","last_undegraded":"2023-03-17T08:22:18.182252+0000","last_fullsized":"2023-03-17T08:22:18.182252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:04.435792+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:22:04.435792+0000","last_peered":"2023-03-17T08:22:04.435792+0000","last_clean":"2023-03-17T08:22:04.435792+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:22:04.435792+0000","last_undegraded":"2023-03-17T08:22:04.435792+0000","last_fullsized":"2023-03-17T08:22:04.435792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:44.747314+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:20:44.747314+0000","last_peered":"2023-03-17T08:20:44.747314+0000","last_clean":"2023-03-17T08:20:44.747314+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:20:44.747314+0000","last_undegraded":"2023-03-17T08:20:44.747314+0000","last_fullsized":"2023-03-17T08:20:44.747314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:31.818278+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:20:31.818278+0000","last_peered":"2023-03-17T08:20:31.818278+0000","last_clean":"2023-03-17T08:20:31.818278+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:20:31.818278+0000","last_undegraded":"2023-03-17T08:20:31.818278+0000","last_fullsized":"2023-03-17T08:20:31.818278+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:56.828329+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:21:56.828329+0000","last_peered":"2023-03-17T08:21:56.828329+0000","last_clean":"2023-03-17T08:21:56.828329+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:21:56.828329+0000","last_undegraded":"2023-03-17T08:21:56.828329+0000","last_fullsized":"2023-03-17T08:21:56.828329+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:04.749561+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:21:04.749561+0000","last_peered":"2023-03-17T08:21:04.749561+0000","last_clean":"2023-03-17T08:21:04.749561+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:21:04.749561+0000","last_undegraded":"2023-03-17T08:21:04.749561+0000","last_fullsized":"2023-03-17T08:21:04.749561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.377873+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:21:19.377873+0000","last_peered":"2023-03-17T08:21:19.377873+0000","last_clean":"2023-03-17T08:21:19.377873+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:21:19.377873+0000","last_undegraded":"2023-03-17T08:21:19.377873+0000","last_fullsized":"2023-03-17T08:21:19.377873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'5","reported_seq":614,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:51.213285+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:24:51.213285+0000","last_peered":"2023-03-17T08:24:51.213285+0000","last_clean":"2023-03-17T08:24:51.213285+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:24:51.213285+0000","last_undegraded":"2023-03-17T08:24:51.213285+0000","last_fullsized":"2023-03-17T08:24:51.213285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":587,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.377818+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:21:19.377818+0000","last_peered":"2023-03-17T08:21:19.377818+0000","last_clean":"2023-03-17T08:21:19.377818+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:21:19.377818+0000","last_undegraded":"2023-03-17T08:21:19.377818+0000","last_fullsized":"2023-03-17T08:21:19.377818+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:20:59.363335+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:20:59.363335+0000","last_peered":"2023-03-17T08:20:59.363335+0000","last_clean":"2023-03-17T08:20:59.363335+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:20:59.363335+0000","last_undegraded":"2023-03-17T08:20:59.363335+0000","last_fullsized":"2023-03-17T08:20:59.363335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'7","reported_seq":617,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:52.214103+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:24:52.214103+0000","last_peered":"2023-03-17T08:24:52.214103+0000","last_clean":"2023-03-17T08:24:52.214103+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:24:52.214103+0000","last_undegraded":"2023-03-17T08:24:52.214103+0000","last_fullsized":"2023-03-17T08:24:52.214103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":588,"num_read_kb":588,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.403678+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:21:19.403678+0000","last_peered":"2023-03-17T08:21:19.403678+0000","last_clean":"2023-03-17T08:21:19.403678+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:21:19.403678+0000","last_undegraded":"2023-03-17T08:21:19.403678+0000","last_fullsized":"2023-03-17T08:21:19.403678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:06.041923+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:21:06.041923+0000","last_peered":"2023-03-17T08:21:06.041923+0000","last_clean":"2023-03-17T08:21:06.041923+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:21:06.041923+0000","last_undegraded":"2023-03-17T08:21:06.041923+0000","last_fullsized":"2023-03-17T08:21:06.041923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:33.176756+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:21:33.176756+0000","last_peered":"2023-03-17T08:21:33.176756+0000","last_clean":"2023-03-17T08:21:33.176756+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:21:33.176756+0000","last_undegraded":"2023-03-17T08:21:33.176756+0000","last_fullsized":"2023-03-17T08:21:33.176756+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.167398+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:21:19.167398+0000","last_peered":"2023-03-17T08:21:19.167398+0000","last_clean":"2023-03-17T08:21:19.167398+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:21:19.167398+0000","last_undegraded":"2023-03-17T08:21:19.167398+0000","last_fullsized":"2023-03-17T08:21:19.167398+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:48.185875+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:22:48.185875+0000","last_peered":"2023-03-17T08:22:48.185875+0000","last_clean":"2023-03-17T08:22:48.185875+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:22:48.185875+0000","last_undegraded":"2023-03-17T08:22:48.185875+0000","last_fullsized":"2023-03-17T08:22:48.185875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:04.428950+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:21:04.428950+0000","last_peered":"2023-03-17T08:21:04.428950+0000","last_clean":"2023-03-17T08:21:04.428950+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:21:04.428950+0000","last_undegraded":"2023-03-17T08:21:04.428950+0000","last_fullsized":"2023-03-17T08:21:04.428950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.167468+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:21:19.167468+0000","last_peered":"2023-03-17T08:21:19.167468+0000","last_clean":"2023-03-17T08:21:19.167468+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:21:19.167468+0000","last_undegraded":"2023-03-17T08:21:19.167468+0000","last_fullsized":"2023-03-17T08:21:19.167468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'14","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:24.751869+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:21:24.751869+0000","last_peered":"2023-03-17T08:21:24.751869+0000","last_clean":"2023-03-17T08:21:24.751869+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:21:24.751869+0000","last_undegraded":"2023-03-17T08:21:24.751869+0000","last_fullsized":"2023-03-17T08:21:24.751869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.405778+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:21:39.405778+0000","last_peered":"2023-03-17T08:21:39.405778+0000","last_clean":"2023-03-17T08:21:39.405778+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:21:39.405778+0000","last_undegraded":"2023-03-17T08:21:39.405778+0000","last_fullsized":"2023-03-17T08:21:39.405778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:26.044006+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:21:26.044006+0000","last_peered":"2023-03-17T08:21:26.044006+0000","last_clean":"2023-03-17T08:21:26.044006+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:21:26.044006+0000","last_undegraded":"2023-03-17T08:21:26.044006+0000","last_fullsized":"2023-03-17T08:21:26.044006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:40.279423+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:21:40.279423+0000","last_peered":"2023-03-17T08:21:40.279423+0000","last_clean":"2023-03-17T08:21:40.279423+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:21:40.279423+0000","last_undegraded":"2023-03-17T08:21:40.279423+0000","last_fullsized":"2023-03-17T08:21:40.279423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:23.350573+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:21:23.350573+0000","last_peered":"2023-03-17T08:21:23.350573+0000","last_clean":"2023-03-17T08:21:23.350573+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:21:23.350573+0000","last_undegraded":"2023-03-17T08:21:23.350573+0000","last_fullsized":"2023-03-17T08:21:23.350573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.433233+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:21:39.433233+0000","last_peered":"2023-03-17T08:21:39.433233+0000","last_clean":"2023-03-17T08:21:39.433233+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:21:39.433233+0000","last_undegraded":"2023-03-17T08:21:39.433233+0000","last_fullsized":"2023-03-17T08:21:39.433233+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:24.404177+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:21:24.404177+0000","last_peered":"2023-03-17T08:21:24.404177+0000","last_clean":"2023-03-17T08:21:24.404177+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:21:24.404177+0000","last_undegraded":"2023-03-17T08:21:24.404177+0000","last_fullsized":"2023-03-17T08:21:24.404177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:36.825838+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:21:36.825838+0000","last_peered":"2023-03-17T08:21:36.825838+0000","last_clean":"2023-03-17T08:21:36.825838+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:21:36.825838+0000","last_undegraded":"2023-03-17T08:21:36.825838+0000","last_fullsized":"2023-03-17T08:21:36.825838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:24.036483+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:21:24.036483+0000","last_peered":"2023-03-17T08:21:24.036483+0000","last_clean":"2023-03-17T08:21:24.036483+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:21:24.036483+0000","last_undegraded":"2023-03-17T08:21:24.036483+0000","last_fullsized":"2023-03-17T08:21:24.036483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.408170+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:21:59.408170+0000","last_peered":"2023-03-17T08:21:59.408170+0000","last_clean":"2023-03-17T08:21:59.408170+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:21:59.408170+0000","last_undegraded":"2023-03-17T08:21:59.408170+0000","last_fullsized":"2023-03-17T08:21:59.408170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.433276+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:21:39.433276+0000","last_peered":"2023-03-17T08:21:39.433276+0000","last_clean":"2023-03-17T08:21:39.433276+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:21:39.433276+0000","last_undegraded":"2023-03-17T08:21:39.433276+0000","last_fullsized":"2023-03-17T08:21:39.433276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:43.177926+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:21:43.177926+0000","last_peered":"2023-03-17T08:21:43.177926+0000","last_clean":"2023-03-17T08:21:43.177926+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:21:43.177926+0000","last_undegraded":"2023-03-17T08:21:43.177926+0000","last_fullsized":"2023-03-17T08:21:43.177926+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'5","reported_seq":616,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:24:52.353861+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:24:52.353861+0000","last_peered":"2023-03-17T08:24:52.353861+0000","last_clean":"2023-03-17T08:24:52.353861+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:24:52.353861+0000","last_undegraded":"2023-03-17T08:24:52.353861+0000","last_fullsized":"2023-03-17T08:24:52.353861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:58.179871+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:21:58.179871+0000","last_peered":"2023-03-17T08:21:58.179871+0000","last_clean":"2023-03-17T08:21:58.179871+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:21:58.179871+0000","last_undegraded":"2023-03-17T08:21:58.179871+0000","last_fullsized":"2023-03-17T08:21:58.179871+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:44.368364+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:21:44.368364+0000","last_peered":"2023-03-17T08:21:44.368364+0000","last_clean":"2023-03-17T08:21:44.368364+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:21:44.368364+0000","last_undegraded":"2023-03-17T08:21:44.368364+0000","last_fullsized":"2023-03-17T08:21:44.368364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:58.179843+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:21:58.179843+0000","last_peered":"2023-03-17T08:21:58.179843+0000","last_clean":"2023-03-17T08:21:58.179843+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:21:58.179843+0000","last_undegraded":"2023-03-17T08:21:58.179843+0000","last_fullsized":"2023-03-17T08:21:58.179843+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:44.170319+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:21:44.170319+0000","last_peered":"2023-03-17T08:21:44.170319+0000","last_clean":"2023-03-17T08:21:44.170319+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:21:44.170319+0000","last_undegraded":"2023-03-17T08:21:44.170319+0000","last_fullsized":"2023-03-17T08:21:44.170319+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:22:03.180538+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:22:03.180538+0000","last_peered":"2023-03-17T08:22:03.180538+0000","last_clean":"2023-03-17T08:22:03.180538+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:22:03.180538+0000","last_undegraded":"2023-03-17T08:22:03.180538+0000","last_fullsized":"2023-03-17T08:22:03.180538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:16.823525+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:21:16.823525+0000","last_peered":"2023-03-17T08:21:16.823525+0000","last_clean":"2023-03-17T08:21:16.823525+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:21:16.823525+0000","last_undegraded":"2023-03-17T08:21:16.823525+0000","last_fullsized":"2023-03-17T08:21:16.823525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.035791+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:21:19.035791+0000","last_peered":"2023-03-17T08:21:19.035791+0000","last_clean":"2023-03-17T08:21:19.035791+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:21:19.035791+0000","last_undegraded":"2023-03-17T08:21:19.035791+0000","last_fullsized":"2023-03-17T08:21:19.035791+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:19.035807+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:21:19.035807+0000","last_peered":"2023-03-17T08:21:19.035807+0000","last_clean":"2023-03-17T08:21:19.035807+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:21:19.035807+0000","last_undegraded":"2023-03-17T08:21:19.035807+0000","last_fullsized":"2023-03-17T08:21:19.035807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:20.277148+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:21:20.277148+0000","last_peered":"2023-03-17T08:21:20.277148+0000","last_clean":"2023-03-17T08:21:20.277148+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:21:20.277148+0000","last_undegraded":"2023-03-17T08:21:20.277148+0000","last_fullsized":"2023-03-17T08:21:20.277148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.169778+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:21:39.169778+0000","last_peered":"2023-03-17T08:21:39.169778+0000","last_clean":"2023-03-17T08:21:39.169778+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:21:39.169778+0000","last_undegraded":"2023-03-17T08:21:39.169778+0000","last_fullsized":"2023-03-17T08:21:39.169778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:36.825894+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:21:36.825894+0000","last_peered":"2023-03-17T08:21:36.825894+0000","last_clean":"2023-03-17T08:21:36.825894+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:21:36.825894+0000","last_undegraded":"2023-03-17T08:21:36.825894+0000","last_fullsized":"2023-03-17T08:21:36.825894+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.038216+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:21:39.038216+0000","last_peered":"2023-03-17T08:21:39.038216+0000","last_clean":"2023-03-17T08:21:39.038216+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:21:39.038216+0000","last_undegraded":"2023-03-17T08:21:39.038216+0000","last_fullsized":"2023-03-17T08:21:39.038216+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.405763+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:21:39.405763+0000","last_peered":"2023-03-17T08:21:39.405763+0000","last_clean":"2023-03-17T08:21:39.405763+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:21:39.405763+0000","last_undegraded":"2023-03-17T08:21:39.405763+0000","last_fullsized":"2023-03-17T08:21:39.405763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:39.367634+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:21:39.367634+0000","last_peered":"2023-03-17T08:21:39.367634+0000","last_clean":"2023-03-17T08:21:39.367634+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:21:39.367634+0000","last_undegraded":"2023-03-17T08:21:39.367634+0000","last_fullsized":"2023-03-17T08:21:39.367634+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.408108+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:21:59.408108+0000","last_peered":"2023-03-17T08:21:59.408108+0000","last_clean":"2023-03-17T08:21:59.408108+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:21:59.408108+0000","last_undegraded":"2023-03-17T08:21:59.408108+0000","last_fullsized":"2023-03-17T08:21:59.408108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:58.354086+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:21:58.354086+0000","last_peered":"2023-03-17T08:21:58.354086+0000","last_clean":"2023-03-17T08:21:58.354086+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:21:58.354086+0000","last_undegraded":"2023-03-17T08:21:58.354086+0000","last_fullsized":"2023-03-17T08:21:58.354086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:59.171909+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:21:59.171909+0000","last_peered":"2023-03-17T08:21:59.171909+0000","last_clean":"2023-03-17T08:21:59.171909+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:21:59.171909+0000","last_undegraded":"2023-03-17T08:21:59.171909+0000","last_fullsized":"2023-03-17T08:21:59.171909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:21:56.828303+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:21:56.828303+0000","last_peered":"2023-03-17T08:21:56.828303+0000","last_clean":"2023-03-17T08:21:56.828303+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:21:56.828303+0000","last_undegraded":"2023-03-17T08:21:56.828303+0000","last_fullsized":"2023-03-17T08:21:56.828303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70342,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":5922,"num_read_kb":3039,"num_write":256,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":211026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":1007616,"data_stored":483356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.629,"15min":0.60699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.581,"15min":1.581},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.316},"max":{"1min":0.76400000000000001,"5min":1.536,"15min":1.536},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68200000000000005,"15min":0.66500000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.88200000000000001,"15min":0.96699999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.35499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":1.1439999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":0.76100000000000001,"15min":0.82099999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.35599999999999998,"5min":0.315,"15min":0.28999999999999998},"max":{"1min":0.73899999999999999,"5min":0.83599999999999997,"15min":0.85399999999999998},"last":0.47799999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.67400000000000004,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.36799999999999999},"max":{"1min":0.73799999999999999,"5min":8.5410000000000004,"15min":8.5410000000000004},"last":0.441},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83399999999999996,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.53600000000000003,"5min":0.44900000000000001,"15min":0.42299999999999999},"max":{"1min":0.91800000000000004,"5min":0.94899999999999995,"15min":1.0169999999999999},"last":0.754},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.505,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.87,"5min":0.873,"15min":1.2250000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93100000000000005,"5min":0.96299999999999997,"15min":1.1160000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.81399999999999995,"5min":1.026,"15min":1.026},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78600000000000003,"15min":0.76800000000000002},"min":{"1min":0.63400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94799999999999995,"5min":1.0029999999999999,"15min":1.2849999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90000000000000002,"5min":0.93200000000000005,"15min":1.1879999999999999},"last":0.65700000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.754},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.40300000000000002},"max":{"1min":0.92200000000000004,"5min":0.98499999999999999,"15min":1.0469999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":0.93799999999999994,"15min":1.004},"last":0.78000000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.54700000000000004,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":1.3879999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.68700000000000006,"5min":0.58699999999999997,"15min":0.55300000000000005},"max":{"1min":0.96699999999999997,"5min":1.49,"15min":1.49},"last":0.81999999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.499},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.194},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.60299999999999998,"15min":0.51100000000000001},"max":{"1min":0.91200000000000003,"5min":0.98299999999999998,"15min":1.415},"last":0.76900000000000002}]}]},{"osd":10,"up_from":73,"seq":313532612814,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7232,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93737920,"statfs":{"total":95995035648,"available":95987630080,"internally_reserved":0,"allocated":1695744,"data_stored":1137551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56999999999999995,"15min":0.60099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.30399999999999999},"max":{"1min":0.87,"5min":0.87,"15min":6.0250000000000004},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.42599999999999999,"5min":0.34200000000000003,"15min":0.28100000000000003},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":2.2269999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.432,"15min":0.45200000000000001},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":5.984},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26200000000000001},"max":{"1min":0.60299999999999998,"5min":0.61899999999999999,"15min":1.1539999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.44,"5min":0.40999999999999998,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.88400000000000001,"15min":1.3069999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":5.8220000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":10.16,"15min":10.16},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36299999999999999},"max":{"1min":0.90200000000000002,"5min":1.0209999999999999,"15min":1.617},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53700000000000003,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.34100000000000003,"15min":0.31},"max":{"1min":0.62,"5min":0.752,"15min":2.746},"last":0.626},{"interface":"front","average":{"1min":0.501,"5min":0.52300000000000002,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.86499999999999999,"15min":7.0670000000000002},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.47399999999999998,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":0.85699999999999998,"5min":1.0069999999999999,"15min":1.2709999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.42499999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":5.8639999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41699999999999998},"max":{"1min":0.83299999999999996,"5min":1.99,"15min":5.952},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":1.0109999999999999,"15min":1.1839999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.41199999999999998},"max":{"1min":0.82599999999999996,"5min":0.95899999999999996,"15min":1.085},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.88800000000000001,"5min":0.98199999999999998,"15min":1.3360000000000001},"last":0.81399999999999995}]},{"osd":9,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.746,"15min":0.77800000000000002},"min":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.503},"max":{"1min":0.89400000000000002,"5min":1.0229999999999999,"15min":8.2270000000000003},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.45300000000000001},"max":{"1min":0.84899999999999998,"5min":1.0009999999999999,"15min":5.375},"last":0.85299999999999998}]},{"osd":11,"last update":"Fri Mar 17 08:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":0.995,"15min":1.123},"last":0.871},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78700000000000003,"15min":0.79100000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51600000000000001},"max":{"1min":0.95099999999999996,"5min":1.0449999999999999,"15min":1.3859999999999999},"last":0.88300000000000001}]}]},{"osd":9,"up_from":68,"seq":292057776345,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26700000000000002},"max":{"1min":0.66000000000000003,"5min":0.75,"15min":1.639},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.23200000000000001},"max":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":1.669},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.629,"15min":0.623},"min":{"1min":0.42199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":0.93500000000000005,"5min":0.995,"15min":1.298},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79000000000000004,"5min":0.89700000000000002,"15min":1.2589999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90400000000000003,"5min":0.97499999999999998,"15min":1.242},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.495,"15min":0.499},"min":{"1min":0.307,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":0.75900000000000001,"5min":1.4079999999999999,"15min":2.1589999999999998},"last":0.878},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.71699999999999997,"5min":4.1399999999999997,"15min":6.1890000000000001},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70799999999999996,"15min":0.71499999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.361},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.503,"5min":0.439,"15min":0.40600000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68799999999999994,"15min":0.69299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.39100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.288},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.438,"5min":0.40500000000000003,"15min":0.35099999999999998},"max":{"1min":0.88200000000000001,"5min":0.92700000000000005,"15min":2.0699999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":0.95499999999999996,"5min":1.0800000000000001,"15min":1.913},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.55900000000000005,"5min":0.48999999999999999,"15min":0.46999999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0820000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.41599999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1970000000000001},"last":0.79500000000000004}]},{"osd":8,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81899999999999995,"15min":0.81999999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0389999999999999,"5min":1.2330000000000001,"15min":1.3859999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.022,"15min":1.2190000000000001},"last":0.92600000000000005}]},{"osd":10,"last update":"Fri Mar 17 08:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.82299999999999995},"min":{"1min":0.58799999999999997,"5min":0.58199999999999996,"15min":0.53500000000000003},"max":{"1min":1.0389999999999999,"5min":1.0820000000000001,"15min":1.284},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":1.0389999999999999,"5min":1.05,"15min":1.2290000000000001},"last":0.76400000000000001}]}]},{"osd":8,"up_from":60,"seq":257698037987,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6564,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738588,"statfs":{"total":95995035648,"available":95988314112,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.92600000000000005,"15min":1.127},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.34599999999999997},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.113},"last":0.74299999999999999}]},{"osd":1,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.36799999999999999,"15min":0.36599999999999999},"max":{"1min":0.81899999999999995,"5min":0.875,"15min":0.89700000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.38900000000000001},"max":{"1min":0.83499999999999996,"5min":0.97999999999999998,"15min":1.0149999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.34799999999999998,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.236},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.88300000000000001,"15min":1.0780000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.63},"min":{"1min":0.45100000000000001,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.75700000000000001,"5min":0.87,"15min":0.92700000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.44,"15min":0.40100000000000002},"max":{"1min":0.80300000000000005,"5min":0.85599999999999998,"15min":1.387},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.31},"max":{"1min":0.84599999999999997,"5min":1.026,"15min":1.218},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":0.86399999999999999,"15min":1.4139999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.46100000000000002,"5min":0.45800000000000002,"15min":0.40799999999999997},"max":{"1min":0.82099999999999995,"5min":1.024,"15min":1.024},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.48199999999999998},"max":{"1min":0.98599999999999999,"5min":1.0600000000000001,"15min":1.254},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Mar 17 08:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.75600000000000001,"15min":0.746},"min":{"1min":0.55900000000000005,"5min":0.46400000000000002,"15min":0.434},"max":{"1min":0.94399999999999995,"5min":1.1140000000000001,"15min":1.165},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48999999999999999,"15min":0.39400000000000002},"max":{"1min":0.92500000000000004,"5min":0.998,"15min":1.175},"last":0.61599999999999999}]},{"osd":9,"last update":"Fri Mar 17 08:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":1.746},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.79000000000000004,"15min":0.79200000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97999999999999998,"5min":1.089,"15min":1.8360000000000001},"last":0.72899999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.40699999999999997},"max":{"1min":0.995,"5min":1.0409999999999999,"15min":1.1359999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77700000000000002,"15min":0.76600000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.51900000000000002},"max":{"1min":0.91400000000000003,"5min":0.98199999999999998,"15min":1.1020000000000001},"last":0.70299999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.0509999999999999,"15min":1.3740000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.66300000000000003,"5min":0.55100000000000005,"15min":0.48199999999999998},"max":{"1min":0.93000000000000005,"5min":1.014,"15min":1.0489999999999999},"last":0.755}]}]},{"osd":7,"up_from":52,"seq":223338299630,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7216,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737936,"statfs":{"total":95995035648,"available":95987646464,"internally_reserved":0,"allocated":1613824,"data_stored":1076673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46000000000000002,"15min":0.44500000000000001},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.26000000000000001},"max":{"1min":0.58499999999999996,"5min":0.752,"15min":0.84299999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48699999999999999,"15min":0.46200000000000002},"min":{"1min":0.34300000000000003,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.65900000000000003,"5min":0.75600000000000001,"15min":0.79600000000000004},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.627},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.29199999999999998},"max":{"1min":0.76500000000000001,"5min":0.80700000000000005,"15min":0.89000000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.35099999999999998},"max":{"1min":0.81599999999999995,"5min":0.90700000000000003,"15min":0.92100000000000004},"last":0.88300000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66600000000000004,"15min":0.64400000000000002},"min":{"1min":0.48399999999999999,"5min":0.44900000000000001,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.88,"15min":3.8140000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56200000000000006}]},{"osd":4,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.40100000000000002,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.70499999999999996,"5min":0.80700000000000005,"15min":0.83699999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.317},"max":{"1min":0.68500000000000005,"5min":0.82799999999999996,"15min":1.1200000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.68999999999999995,"15min":0.67700000000000005},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.378},"max":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71899999999999997,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41899999999999998},"max":{"1min":0.83299999999999996,"5min":1.0629999999999999,"15min":1.212},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71199999999999997,"15min":0.69399999999999995},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.71099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.374},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71899999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.754,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.41299999999999998},"max":{"1min":1.0149999999999999,"5min":1.018,"15min":1.163},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.58299999999999996,"5min":0.56499999999999995,"15min":0.45700000000000002},"max":{"1min":0.96399999999999997,"5min":1.0580000000000001,"15min":1.1040000000000001},"last":0.86899999999999999}]},{"osd":9,"last update":"Fri Mar 17 08:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.80100000000000005,"15min":0.76700000000000002},"min":{"1min":0.61199999999999999,"5min":0.54000000000000004,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.036,"15min":1.167},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.75600000000000001},"min":{"1min":0.624,"5min":0.57499999999999996,"15min":0.46600000000000003},"max":{"1min":0.89800000000000002,"5min":0.98999999999999999,"15min":3.7970000000000002},"last":0.78800000000000003}]},{"osd":10,"last update":"Fri Mar 17 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75,"15min":0.70899999999999996},"min":{"1min":0.51900000000000002,"5min":0.47599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.0469999999999999,"15min":1.0589999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.72499999999999998},"min":{"1min":0.59599999999999997,"5min":0.53600000000000003,"15min":0.39300000000000002},"max":{"1min":0.91000000000000003,"5min":0.997,"15min":1.4279999999999999},"last":0.92100000000000004}]},{"osd":11,"last update":"Fri Mar 17 08:24:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.52700000000000002},"max":{"1min":0.98899999999999999,"5min":1.1759999999999999,"15min":1.238},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.83899999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.58799999999999997},"max":{"1min":1.012,"5min":1.252,"15min":1.474},"last":0.97999999999999998}]}]},{"osd":6,"up_from":47,"seq":201863463162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":999424,"data_stored":482646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.82399999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51100000000000001,"15min":0.48599999999999999},"min":{"1min":0.42199999999999999,"5min":0.27100000000000002,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":1.724,"15min":1.724},"last":0.497}]},{"osd":1,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.84599999999999997,"5min":6.5599999999999996,"15min":6.5599999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67600000000000005,"15min":0.65800000000000003},"min":{"1min":0.53000000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.876,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.68700000000000006},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.432},"max":{"1min":0.84799999999999998,"5min":1.597,"15min":1.597},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71799999999999997,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.38,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":6.5869999999999997,"15min":6.5869999999999997},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.93999999999999995,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83399999999999996,"5min":1.698,"15min":1.698},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.432,"15min":0.33300000000000002},"max":{"1min":0.97699999999999998,"5min":6.5,"15min":6.5},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.751,"15min":0.73399999999999999},"min":{"1min":0.58999999999999997,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":1.046,"5min":1.276,"15min":1.276},"last":0.876}]},{"osd":5,"last update":"Fri Mar 17 08:24:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.47599999999999998,"15min":0.41399999999999998},"max":{"1min":1.0229999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.73299999999999998},"min":{"1min":0.54500000000000004,"5min":0.42199999999999999,"15min":0.40699999999999997},"max":{"1min":1.081,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.61199999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.121,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.77900000000000003},"min":{"1min":0.61099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95799999999999996,"5min":1.536,"15min":1.536},"last":0.94099999999999995}]},{"osd":8,"last update":"Fri Mar 17 08:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82899999999999996,"15min":0.80100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85999999999999999,"15min":0.80700000000000005},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.46300000000000002},"max":{"1min":1.0409999999999999,"5min":6.5309999999999997,"15min":6.5309999999999997},"last":0.84099999999999997}]},{"osd":9,"last update":"Fri Mar 17 08:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.79300000000000004},"min":{"1min":0.56899999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.92700000000000005,"5min":1.756,"15min":1.756},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.46400000000000002,"15min":0.37},"max":{"1min":1.056,"5min":16.013000000000002,"15min":16.013000000000002},"last":0.89100000000000001}]},{"osd":10,"last update":"Fri Mar 17 08:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.369,"15min":1.369},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.88500000000000001,"15min":0.85499999999999998},"min":{"1min":0.64900000000000002,"5min":0.58299999999999996,"15min":0.53900000000000003},"max":{"1min":1.032,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.96499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575155,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7644,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":93737508,"statfs":{"total":95995035648,"available":95987208192,"internally_reserved":0,"allocated":1069056,"data_stored":546876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.36799999999999999,"15min":0.30599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.022},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.621},"min":{"1min":0.47099999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":0.93799999999999994,"15min":1.0009999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.32800000000000001},"max":{"1min":0.88700000000000001,"5min":0.98299999999999998,"15min":1.155},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.436,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.92400000000000004,"15min":1.1910000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.48899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67100000000000004,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.39800000000000002,"15min":0.34599999999999997},"max":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":1.1319999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.505,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.26000000000000001},"max":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.85099999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":0.873,"15min":1.1459999999999999},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.95199999999999996,"5min":0.98199999999999998,"15min":1.0409999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.58899999999999997,"5min":0.51200000000000001,"15min":0.40999999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.23},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:24:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.41899999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":1.071,"15min":1.071},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69899999999999995,"15min":0.68999999999999995},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.36899999999999999},"max":{"1min":0.871,"5min":0.89000000000000001,"15min":1.0880000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.44800000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.0129999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.69699999999999995},"min":{"1min":0.47199999999999998,"5min":0.42199999999999999,"15min":0.35699999999999998},"max":{"1min":0.93000000000000005,"5min":1.0489999999999999,"15min":1.0920000000000001},"last":0.72599999999999998}]},{"osd":8,"last update":"Fri Mar 17 08:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.64700000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0940000000000001},"last":0.752},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.748},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.45000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.623}]},{"osd":9,"last update":"Fri Mar 17 08:24:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78200000000000003,"15min":0.77000000000000002},"min":{"1min":0.54000000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0109999999999999,"5min":1.083,"15min":1.3109999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.83799999999999997,"15min":0.83199999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45300000000000001},"max":{"1min":0.96499999999999997,"5min":1.101,"15min":1.1339999999999999},"last":0.82999999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.752,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.48599999999999999,"15min":0.33500000000000002},"max":{"1min":0.93999999999999995,"5min":0.96599999999999997,"15min":1.1719999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.76100000000000001},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.36199999999999999},"max":{"1min":0.94099999999999995,"5min":1.03,"15min":1.3480000000000001},"last":0.70799999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85999999999999999,"15min":0.86899999999999999},"min":{"1min":0.73099999999999998,"5min":0.64900000000000002,"15min":0.624},"max":{"1min":1.0349999999999999,"5min":1.1240000000000001,"15min":1.163},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83099999999999996,"15min":0.83199999999999996},"min":{"1min":0.73799999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97299999999999998,"5min":1.119,"15min":1.3859999999999999},"last":0.81499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738686,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":483979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.999,"15min":0.999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.41499999999999998,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.81599999999999995,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.751,"15min":0.68600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88600000000000001,"5min":6.673,"15min":6.673},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93899999999999995,"5min":1.0289999999999999,"15min":1.4850000000000001},"last":0.746}]},{"osd":3,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.61899999999999999,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72199999999999998,"5min":7.7140000000000004,"15min":7.7140000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.61799999999999999,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":6.7549999999999999,"15min":6.7549999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.997,"5min":0.997,"15min":1.0029999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.60199999999999998,"5min":0.40200000000000002,"15min":0.33700000000000002},"max":{"1min":0.89200000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79300000000000004,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.39100000000000001,"15min":0.379},"max":{"1min":0.91000000000000003,"5min":6.7000000000000002,"15min":6.7000000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.98999999999999999,"15min":1.5329999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68700000000000006,"15min":0.65200000000000002},"min":{"1min":0.45500000000000002,"5min":0.33600000000000002,"15min":0.29499999999999998},"max":{"1min":0.96399999999999997,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.745,"15min":0.66800000000000004},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.29499999999999998},"max":{"1min":0.98199999999999998,"5min":6.7270000000000003,"15min":6.7270000000000003},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.59999999999999998,"5min":0.46200000000000002,"15min":0.38100000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.409},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.63100000000000001,"5min":0.53500000000000003,"15min":0.35699999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.349},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri Mar 17 08:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.34300000000000003},"max":{"1min":1.052,"5min":1.0569999999999999,"15min":6.6440000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80800000000000005,"15min":0.78700000000000003},"min":{"1min":0.499,"5min":0.378,"15min":0.35499999999999998},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.125},"last":0.58999999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.871,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1399999999999999,"5min":1.1539999999999999,"15min":1.1850000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83699999999999997},"min":{"1min":0.73899999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0860000000000001,"5min":1.095,"15min":1.1499999999999999},"last":0.70999999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.91800000000000004,"15min":0.85699999999999998},"min":{"1min":0.67900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0269999999999999,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.874},"min":{"1min":0.629,"5min":0.505,"15min":0.505},"max":{"1min":1.042,"5min":1.1319999999999999,"15min":2.9849999999999999},"last":0.80900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7452,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737700,"statfs":{"total":95995035648,"available":95987404800,"internally_reserved":0,"allocated":1003520,"data_stored":484188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.621},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90200000000000002,"15min":1.095},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90000000000000002,"5min":0.90400000000000003,"15min":1.1639999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.61399999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35699999999999998},"max":{"1min":0.77000000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.754},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.70499999999999996,"15min":0.67000000000000004},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Mar 17 08:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.35299999999999998},"max":{"1min":0.88300000000000001,"5min":1.157,"15min":1.903},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.66500000000000004},"min":{"1min":0.44900000000000001,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.872,"15min":1.952},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78900000000000003,"5min":1.085,"15min":1.085},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.628},"min":{"1min":0.437,"5min":0.437,"15min":0.376},"max":{"1min":0.79000000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Mar 17 08:23:53 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56399999999999995,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.33200000000000002,"15min":0.28999999999999998},"max":{"1min":0.80500000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.624},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.53400000000000003},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":1.103,"15min":1.103},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.66500000000000004},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.38400000000000001},"max":{"1min":0.85499999999999998,"5min":1.0329999999999999,"15min":1.1080000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.38800000000000001},"max":{"1min":0.92000000000000004,"5min":1.03,"15min":1.1890000000000001},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68600000000000005,"15min":0.65600000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":1.167,"15min":1.167},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66200000000000003,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.46800000000000003,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64700000000000002}]},{"osd":9,"last update":"Fri Mar 17 08:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80900000000000005,"15min":0.78200000000000003},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.45600000000000002},"max":{"1min":0.95699999999999996,"5min":1.1439999999999999,"15min":1.1499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":1.05,"15min":1.0820000000000001},"last":0.74199999999999999}]},{"osd":10,"last update":"Fri Mar 17 08:24:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.745},"min":{"1min":0.56899999999999995,"5min":0.51000000000000001,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77400000000000002,"15min":0.75},"min":{"1min":0.58099999999999996,"5min":0.496,"15min":0.496},"max":{"1min":0.86399999999999999,"5min":1.073,"15min":1.073},"last":0.78500000000000003}]},{"osd":11,"last update":"Fri Mar 17 08:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81599999999999995,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":0.91000000000000003,"5min":1.119,"15min":1.119},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.75800000000000001},"min":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.80900000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149977,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6828,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738324,"statfs":{"total":95995035648,"available":95988043776,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.315,"5min":0.28100000000000003,"15min":0.25600000000000001},"max":{"1min":0.626,"5min":1.161,"15min":1.161},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.36399999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.95999999999999996,"5min":1.387,"15min":1.387},"last":0.501}]},{"osd":1,"last update":"Fri Mar 17 08:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46100000000000002,"5min":0.41999999999999998,"15min":0.41499999999999998},"max":{"1min":0.93899999999999995,"5min":1.004,"15min":1.03},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Mar 17 08:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.64600000000000002},"min":{"1min":0.48299999999999998,"5min":0.41599999999999998,"15min":0.38900000000000001},"max":{"1min":0.91200000000000003,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70799999999999996,"15min":0.68999999999999995},"min":{"1min":0.49299999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.90400000000000003,"5min":1.101,"15min":1.101},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.68000000000000005},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.044,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.54200000000000004,"5min":0.45900000000000002,"15min":0.433},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.2250000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0840000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.69299999999999995},"min":{"1min":0.44400000000000001,"5min":0.39500000000000002,"15min":0.34000000000000002},"max":{"1min":1.0549999999999999,"5min":1.1299999999999999,"15min":1.266},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80400000000000005,"5min":0.88400000000000001,"15min":0.96299999999999997},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Mar 17 08:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.131},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.40500000000000003},"max":{"1min":1.111,"5min":1.268,"15min":1.268},"last":0.88300000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:24:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78200000000000003,"15min":0.79700000000000004},"min":{"1min":0.49399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.2270000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.36499999999999999},"max":{"1min":0.97399999999999998,"5min":0.97499999999999998,"15min":1.012},"last":0.58299999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:24:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.53600000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.04,"5min":1.04,"15min":1.196},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.57399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1619999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.82599999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:24:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.63300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.137,"5min":1.357,"15min":1.357},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.86499999999999999,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.95699999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888338,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6880,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738272,"statfs":{"total":95995035648,"available":95987990528,"internally_reserved":0,"allocated":1073152,"data_stored":546082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.29999999999999999,"15min":0.26500000000000001},"max":{"1min":0.53000000000000003,"5min":0.63600000000000001,"15min":0.81100000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.45500000000000002},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.27500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.75800000000000001},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.38400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:24:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.498,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.51900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":0.871,"5min":0.89200000000000002,"15min":0.98499999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95599999999999996,"5min":0.96299999999999997,"15min":0.96599999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.56599999999999995,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.51200000000000001,"5min":0.47299999999999998,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.91400000000000003,"15min":1.0169999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.44800000000000001,"5min":0.44,"15min":0.39400000000000002},"max":{"1min":0.93300000000000005,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Mar 17 08:23:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.33100000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.0389999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.435,"15min":0.375},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.006},"last":0.95299999999999996}]},{"osd":8,"last update":"Fri Mar 17 08:24:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.749,"15min":0.73199999999999998},"min":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.40899999999999997},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.57899999999999996,"5min":0.55300000000000005,"15min":0.51800000000000002},"max":{"1min":0.86499999999999999,"5min":0.97599999999999998,"15min":0.99199999999999999},"last":0.83399999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.82599999999999996,"15min":0.81299999999999994},"min":{"1min":0.627,"5min":0.627,"15min":0.48999999999999999},"max":{"1min":0.94399999999999995,"5min":1.026,"15min":1.091},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.58099999999999996,"5min":0.55400000000000005,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.044},"last":0.90700000000000003}]},{"osd":10,"last update":"Fri Mar 17 08:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.59299999999999997,"5min":0.502,"15min":0.44500000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0569999999999999},"last":0.875},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.84699999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.89100000000000001}]},{"osd":11,"last update":"Fri Mar 17 08:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82299999999999995,"15min":0.80700000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.53500000000000003},"max":{"1min":0.93600000000000005,"5min":1.0289999999999999,"15min":1.0389999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.81899999999999995},"min":{"1min":0.64900000000000002,"5min":0.59299999999999997,"15min":0.48899999999999999},"max":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":1.1240000000000001},"last":0.81299999999999994}]}]},{"osd":5,"up_from":39,"seq":167503724807,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7288,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93737864,"statfs":{"total":95995035648,"available":95987572736,"internally_reserved":0,"allocated":1622016,"data_stored":1075585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.95799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.45400000000000001,"5min":0.36099999999999999,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.875,"15min":0.88900000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":0.88,"15min":0.91100000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.37,"15min":0.37},"max":{"1min":0.81799999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"min":{"1min":0.34300000000000003,"5min":0.308,"15min":0.254},"max":{"1min":0.754,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46600000000000003,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.26200000000000001},"max":{"1min":0.63600000000000001,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.38300000000000001},"max":{"1min":0.82799999999999996,"5min":0.90600000000000003,"15min":0.93300000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.95499999999999996,"15min":0.97699999999999998},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67500000000000004,"15min":0.67000000000000004},"min":{"1min":0.498,"5min":0.47999999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.93100000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91700000000000004,"5min":0.92000000000000004,"15min":5.1669999999999998},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Mar 17 08:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46000000000000002,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.996},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Mar 17 08:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.70899999999999996},"min":{"1min":0.46700000000000003,"5min":0.46300000000000002,"15min":0.41399999999999998},"max":{"1min":0.93000000000000005,"5min":1.014,"15min":1.0840000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71299999999999997,"15min":0.70399999999999996},"min":{"1min":0.46700000000000003,"5min":0.44,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72099999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.40899999999999997,"5min":0.38600000000000001,"15min":0.33800000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.0429999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.36199999999999999},"max":{"1min":0.90600000000000003,"5min":0.92200000000000004,"15min":1.0029999999999999},"last":0.83299999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.53700000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.85599999999999998,"5min":0.94999999999999996,"15min":1.099},"last":0.749},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.117},"last":0.84199999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.66200000000000003,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":0.95699999999999996,"5min":0.96099999999999997,"15min":1.0529999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94499999999999995,"5min":0.98299999999999998,"15min":1.1020000000000001},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:25:11.862 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-03-17T08:25:13.505 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-17T08:25:13.505 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-03-17T08:25:13.505 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph health --format=json 2023-03-17T08:25:13.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:00 smithi035 ceph-mon[92535]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:25:14.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:00 smithi035 ceph-mon[92535]: pgmap v1229: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:14.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:25:14.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:14.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:01 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:02 smithi035 ceph-mon[92535]: pgmap v1230: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:03 smithi035 ceph-mon[92535]: pgmap v1231: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:06 smithi035 ceph-mon[92535]: pgmap v1232: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:08 smithi035 ceph-mon[92535]: pgmap v1233: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:10 smithi035 ceph-mon[92535]: pgmap v1234: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:14.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:12 smithi035 ceph-mon[92535]: pgmap v1235: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:14.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:01 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:02 smithi078 ceph-mon[94114]: pgmap v1230: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:03 smithi078 ceph-mon[94114]: pgmap v1231: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:16.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:06 smithi078 ceph-mon[94114]: pgmap v1232: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:08 smithi078 ceph-mon[94114]: pgmap v1233: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:10 smithi078 ceph-mon[94114]: pgmap v1234: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:12 smithi078 ceph-mon[94114]: pgmap v1235: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:01 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:17.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:02 smithi082 ceph-mon[94281]: pgmap v1230: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:17.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:25:17.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:25:17.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:03 smithi082 ceph-mon[94281]: pgmap v1231: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:06 smithi082 ceph-mon[94281]: pgmap v1232: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:08 smithi082 ceph-mon[94281]: pgmap v1233: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:10 smithi082 ceph-mon[94281]: pgmap v1234: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:12 smithi082 ceph-mon[94281]: pgmap v1235: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:14 smithi082 ceph-mon[94281]: pgmap v1236: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:16 smithi082 ceph-mon[94281]: pgmap v1237: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:21.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:14 smithi035 ceph-mon[92535]: pgmap v1236: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:21.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:17 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/321798334' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-03-17T08:25:22.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:18 smithi082 ceph-mon[94281]: pgmap v1238: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:22.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:20 smithi082 ceph-mon[94281]: pgmap v1239: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:23.290 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:14 smithi078 ceph-mon[94114]: pgmap v1236: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:23.290 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:16 smithi078 ceph-mon[94114]: pgmap v1237: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:23.290 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:17 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/321798334' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-03-17T08:25:23.290 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:18 smithi078 ceph-mon[94114]: pgmap v1238: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:23.290 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:20 smithi078 ceph-mon[94114]: pgmap v1239: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:23.290 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:22 smithi078 ceph-mon[94114]: pgmap v1240: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:23.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:22 smithi082 ceph-mon[94281]: pgmap v1240: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:23.292 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:25:24.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 -- 172.21.15.35:0/2568576431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 msgr2=0x7f1dc8103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:24.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/2568576431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8103d60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1db00099c0 tx=0x7f1db0009cd0 comp rx=0 tx=0).stop 2023-03-17T08:25:24.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 -- 172.21.15.35:0/2568576431 shutdown_connections 2023-03-17T08:25:24.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/2568576431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dc8104490 0x7f1dc810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:24.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/2568576431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 0x7f1dc80ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:24.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/2568576431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8103d60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:24.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 -- 172.21.15.35:0/2568576431 >> 172.21.15.35:0/2568576431 conn(0x7f1dc8077030 msgr2=0x7f1dc8077430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:24.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 -- 172.21.15.35:0/2568576431 shutdown_connections 2023-03-17T08:25:24.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.804+0000 7f1dcdae4700 1 -- 172.21.15.35:0/2568576431 wait complete. 2023-03-17T08:25:24.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 Processor -- start 2023-03-17T08:25:24.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 -- start start 2023-03-17T08:25:24.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 0x7f1dc8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:24.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:24.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dc8104490 0x7f1dc819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:25.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc819d4f0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc819d660 con 0x7f1dc80ff3f0 2023-03-17T08:25:25.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dcdae4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc819d820 con 0x7f1dc8104490 2023-03-17T08:25:25.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dc6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:25.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dc6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40688/0 (socket says 172.21.15.35:40688) 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.805+0000 7f1dc6ffd700 1 -- 172.21.15.35:0/321798334 learned_addr learned my addr 172.21.15.35:0/321798334 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc7fff700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dc8104490 0x7f1dc819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc77fe700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 0x7f1dc8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc6ffd700 1 -- 172.21.15.35:0/321798334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dc8104490 msgr2=0x7f1dc819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc6ffd700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dc8104490 0x7f1dc819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc6ffd700 1 -- 172.21.15.35:0/321798334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 msgr2=0x7f1dc8198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc6ffd700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 0x7f1dc8198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc6ffd700 1 -- 172.21.15.35:0/321798334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00095f0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc77fe700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 0x7f1dc8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc6ffd700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8198a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009990 tx=0x7f1db0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db001d070 con 0x7f1dc80ffd90 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1db00054c0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc810f070 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0003b30 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.806+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc810eee0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.807+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc810f200 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.808+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1db0004fc0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.809+0000 7f1dc4ff9700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1db409f4d0 0x7f1db40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.809+0000 7f1dc77fe700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1db409f4d0 0x7f1db40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.809+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1db00cb110 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.810+0000 7f1dc77fe700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1db409f4d0 0x7f1db40a1980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005950 tx=0x7f1db8005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:25.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:16.814+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1db0095290 con 0x7f1dc80ffd90 2023-03-17T08:25:25.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:16 smithi035 ceph-mon[92535]: pgmap v1237: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:25.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.055+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1dc81998e0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.055+0000 7f1dc4ff9700 1 -- 172.21.15.35:0/321798334 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1db00988b0 con 0x7f1dc80ffd90 2023-03-17T08:25:25.785 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:25:25.785 INFO:teuthology.orchestra.run.smithi035.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-17T08:25:25.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:24 smithi078 ceph-mon[94114]: pgmap v1241: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:26.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:24 smithi082 ceph-mon[94281]: pgmap v1241: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:26.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1db409f4d0 msgr2=0x7f1db40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:26.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1db409f4d0 0x7f1db40a1980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005950 tx=0x7f1db8005f50 comp rx=0 tx=0).stop 2023-03-17T08:25:26.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 msgr2=0x7f1dc8198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:26.173 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8198a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009990 tx=0x7f1db0004730 comp rx=0 tx=0).stop 2023-03-17T08:25:28.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 shutdown_connections 2023-03-17T08:25:28.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dc8104490 0x7f1dc819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:28.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dc80ff3f0 0x7f1dc8198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:28.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1db409f4d0 0x7f1db40a1980 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:28.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 --2- 172.21.15.35:0/321798334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dc80ffd90 0x7f1dc8198a70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:28.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 >> 172.21.15.35:0/321798334 conn(0x7f1dc8077030 msgr2=0x7f1dc80685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:28.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 shutdown_connections 2023-03-17T08:25:28.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:17.057+0000 7f1dcdae4700 1 -- 172.21.15.35:0/321798334 wait complete. 2023-03-17T08:25:28.367 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-03-17T08:25:28.367 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:25:29.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:17 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/321798334' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-03-17T08:25:29.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:18 smithi035 ceph-mon[92535]: pgmap v1238: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:29.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:20 smithi035 ceph-mon[92535]: pgmap v1239: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:29.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:22 smithi035 ceph-mon[92535]: pgmap v1240: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:29.804 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:24 smithi035 ceph-mon[92535]: pgmap v1241: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:26 smithi035 ceph-mon[92535]: pgmap v1242: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:32.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:28 smithi035 ceph-mon[92535]: pgmap v1243: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:30 smithi035 ceph-mon[92535]: pgmap v1244: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:26 smithi078 ceph-mon[94114]: pgmap v1242: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:32.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:28 smithi078 ceph-mon[94114]: pgmap v1243: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:30 smithi078 ceph-mon[94114]: pgmap v1244: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.194 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:26 smithi082 ceph-mon[94281]: pgmap v1242: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:32.194 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:28 smithi082 ceph-mon[94281]: pgmap v1243: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.195 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:30 smithi082 ceph-mon[94281]: pgmap v1244: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:32.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 -- 172.21.15.35:0/3730924162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff8100c30 msgr2=0x7f8ff81074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 --2- 172.21.15.35:0/3730924162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff8100c30 0x7f8ff81074f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b0a0 tx=0x7f8ff000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 -- 172.21.15.35:0/3730924162 shutdown_connections 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 --2- 172.21.15.35:0/3730924162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff8100c30 0x7f8ff81074f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 --2- 172.21.15.35:0/3730924162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff80ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 --2- 172.21.15.35:0/3730924162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81002a0 0x7f8ff81006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 -- 172.21.15.35:0/3730924162 >> 172.21.15.35:0/3730924162 conn(0x7f8ff80fa6b0 msgr2=0x7f8ff80fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 -- 172.21.15.35:0/3730924162 shutdown_connections 2023-03-17T08:25:33.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.335+0000 7f8fff80d700 1 -- 172.21.15.35:0/3730924162 wait complete. 2023-03-17T08:25:33.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:32 smithi078 ceph-mon[94114]: pgmap v1245: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:33.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:32 smithi082 ceph-mon[94281]: pgmap v1245: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 Processor -- start 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 -- start start 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff8194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81002a0 0x7f8ff81953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8100c30 0x7f8ff819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff819ca30 con 0x7f8ff80ff0b0 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff819cb70 con 0x7f8ff8100c30 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8fff80d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff819cd00 con 0x7f8ff81002a0 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8ffd5a9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff8194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8ffd5a9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff8194eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40700/0 (socket says 172.21.15.35:40700) 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8ffd5a9700 1 -- 172.21.15.35:0/2151850989 learned_addr learned my addr 172.21.15.35:0/2151850989 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:25:33.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.336+0000 7f8ffcda8700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81002a0 0x7f8ff81953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:33.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffddaa700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8100c30 0x7f8ff819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:33.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffd5a9700 1 -- 172.21.15.35:0/2151850989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81002a0 msgr2=0x7f8ff81953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:35.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffd5a9700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81002a0 0x7f8ff81953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:35.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffd5a9700 1 -- 172.21.15.35:0/2151850989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8100c30 msgr2=0x7f8ff819c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:35.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffd5a9700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8100c30 0x7f8ff819c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:35.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffd5a9700 1 -- 172.21.15.35:0/2151850989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0009d00 con 0x7f8ff80ff0b0 2023-03-17T08:25:35.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffddaa700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8100c30 0x7f8ff819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:25:35.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8ffd5a9700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff8194eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400d980 tx=0x7f8ff400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:35.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4004020 con 0x7f8ff80ff0b0 2023-03-17T08:25:35.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ff4009730 con 0x7f8ff80ff0b0 2023-03-17T08:25:35.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff810a8c0 con 0x7f8ff80ff0b0 2023-03-17T08:25:36.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4003a00 con 0x7f8ff80ff0b0 2023-03-17T08:25:36.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.337+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff810a730 con 0x7f8ff80ff0b0 2023-03-17T08:25:36.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.338+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff8067dc0 con 0x7f8ff80ff0b0 2023-03-17T08:25:36.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.339+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f8ff40098a0 con 0x7f8ff80ff0b0 2023-03-17T08:25:37.879 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.340+0000 7f8fee7fc700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8fe409f550 0x7f8fe40a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:37.879 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.340+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f8ff40ca1c0 con 0x7f8ff80ff0b0 2023-03-17T08:25:37.879 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.340+0000 7f8ffcda8700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8fe409f550 0x7f8fe40a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:37.910 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.340+0000 7f8ffcda8700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8fe409f550 0x7f8fe40a1a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8005950 tx=0x7f8fe800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:37.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.343+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f8ff40943d0 con 0x7f8ff80ff0b0 2023-03-17T08:25:37.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:32 smithi035 ceph-mon[92535]: pgmap v1245: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:37.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.544+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ff8106030 con 0x7f8ff80ff0b0 2023-03-17T08:25:37.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.546+0000 7f8fee7fc700 1 -- 172.21.15.35:0/2151850989 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f8ff40979f0 con 0x7f8ff80ff0b0 2023-03-17T08:25:37.912 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:25:38.701 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:25:38.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8fe409f550 msgr2=0x7f8fe40a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:39.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8fe409f550 0x7f8fe40a1a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8005950 tx=0x7f8fe800b410 comp rx=0 tx=0).stop 2023-03-17T08:25:39.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 msgr2=0x7f8ff8194eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:39.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff8194eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400d980 tx=0x7f8ff400dc90 comp rx=0 tx=0).stop 2023-03-17T08:25:39.291 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 shutdown_connections 2023-03-17T08:25:40.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8100c30 0x7f8ff819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:40.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8fe409f550 0x7f8fe40a1a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:40.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ff80ff0b0 0x7f8ff8194eb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:40.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 --2- 172.21.15.35:0/2151850989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff81002a0 0x7f8ff81953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:40.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 >> 172.21.15.35:0/2151850989 conn(0x7f8ff80fa6b0 msgr2=0x7f8ff80fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:40.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 shutdown_connections 2023-03-17T08:25:40.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:32.548+0000 7f8fff80d700 1 -- 172.21.15.35:0/2151850989 wait complete. 2023-03-17T08:25:40.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-17T08:12:42.651944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-17T08:12:54.803875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:25:40.135 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:25:40.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:33 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2151850989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:25:41.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:34 smithi035 ceph-mon[92535]: pgmap v1246: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:41.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:36 smithi035 ceph-mon[92535]: pgmap v1247: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:41.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:38 smithi035 ceph-mon[92535]: pgmap v1248: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:41.279 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:33 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2151850989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:25:41.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:34 smithi078 ceph-mon[94114]: pgmap v1246: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:41.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:36 smithi078 ceph-mon[94114]: pgmap v1247: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:41.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:38 smithi078 ceph-mon[94114]: pgmap v1248: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:41.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:40 smithi078 ceph-mon[94114]: pgmap v1249: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:42.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:33 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2151850989' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:25:42.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:34 smithi082 ceph-mon[94281]: pgmap v1246: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:42.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:36 smithi082 ceph-mon[94281]: pgmap v1247: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:43.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:38 smithi082 ceph-mon[94281]: pgmap v1248: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:43.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:40 smithi082 ceph-mon[94281]: pgmap v1249: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:43.179 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:40 smithi035 ceph-mon[92535]: pgmap v1249: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:43.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:42 smithi078 ceph-mon[94114]: pgmap v1250: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:43.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:42 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2292357610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:25:43.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:42 smithi082 ceph-mon[94281]: pgmap v1250: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:45.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:42 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2292357610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:25:45.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:44 smithi078 ceph-mon[94114]: pgmap v1251: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:46.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:44 smithi082 ceph-mon[94281]: pgmap v1251: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:46.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 -- 172.21.15.35:0/1419181427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c4100d50 msgr2=0x7fb9c41075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:46.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/1419181427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c4100d50 0x7fb9c41075f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00b0a0 tx=0x7fb9bc00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:25:47.092 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 -- 172.21.15.35:0/1419181427 shutdown_connections 2023-03-17T08:25:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/1419181427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c4100d50 0x7fb9c41075f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/1419181427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c40ff110 0x7fb9c40ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/1419181427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c41003a0 0x7fb9c4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 -- 172.21.15.35:0/1419181427 >> 172.21.15.35:0/1419181427 conn(0x7fb9c40fa730 msgr2=0x7fb9c40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 -- 172.21.15.35:0/1419181427 shutdown_connections 2023-03-17T08:25:48.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 -- 172.21.15.35:0/1419181427 wait complete. 2023-03-17T08:25:48.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.420+0000 7fb9c9a07700 1 Processor -- start 2023-03-17T08:25:48.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 -- start start 2023-03-17T08:25:49.238 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c40ff110 0x7fb9c40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:49.238 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 0x7fb9c419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:49.238 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c4100d50 0x7fb9c419d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:49.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c419da80 con 0x7fb9c41003a0 2023-03-17T08:25:49.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c419dbf0 con 0x7fb9c4100d50 2023-03-17T08:25:49.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c9a07700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c419ddb0 con 0x7fb9c40ff110 2023-03-17T08:25:49.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 0x7fb9c419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:49.802 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 0x7fb9c419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40716/0 (socket says 172.21.15.35:40716) 2023-03-17T08:25:50.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 -- 172.21.15.35:0/2292357610 learned_addr learned my addr 172.21.15.35:0/2292357610 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:25:50.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c2ffd700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c40ff110 0x7fb9c40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c37fe700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c4100d50 0x7fb9c419d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 -- 172.21.15.35:0/2292357610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c40ff110 msgr2=0x7fb9c40688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c40ff110 0x7fb9c40688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 -- 172.21.15.35:0/2292357610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c4100d50 msgr2=0x7fb9c419d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c4100d50 0x7fb9c419d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 -- 172.21.15.35:0/2292357610 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009d00 con 0x7fb9c41003a0 2023-03-17T08:25:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c2ffd700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c40ff110 0x7fb9c40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:25:51.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c37fe700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c4100d50 0x7fb9c419d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:25:51.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.421+0000 7fb9c27fc700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 0x7fb9c419ac60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400d950 tx=0x7fb9b400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:51.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.422+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4009b40 con 0x7fb9c41003a0 2023-03-17T08:25:51.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.422+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9b4009ca0 con 0x7fb9c41003a0 2023-03-17T08:25:51.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.422+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c410a960 con 0x7fb9c41003a0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.422+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400f620 con 0x7fb9c41003a0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.422+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c410a7d0 con 0x7fb9c41003a0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.423+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c4106190 con 0x7fb9c41003a0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.424+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb9b4010460 con 0x7fb9c41003a0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.425+0000 7fb9c8a05700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb9b009f4d0 0x7fb9b00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.425+0000 7fb9c2ffd700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb9b009f4d0 0x7fb9b00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.425+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb9b40ca570 con 0x7fb9c41003a0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.425+0000 7fb9c2ffd700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb9b009f4d0 0x7fb9b00a1980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac005950 tx=0x7fb9ac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:25:51.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.428+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb9b4094700 con 0x7fb9c41003a0 2023-03-17T08:25:51.932 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.628+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9c4061ab0 con 0x7fb9c41003a0 2023-03-17T08:25:51.932 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.628+0000 7fb9c8a05700 1 -- 172.21.15.35:0/2292357610 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9b4020020 con 0x7fb9c41003a0 2023-03-17T08:25:51.932 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:25:53.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:46 smithi078 ceph-mon[94114]: pgmap v1252: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:53.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:48 smithi078 ceph-mon[94114]: pgmap v1253: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:53.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:50 smithi078 ceph-mon[94114]: pgmap v1254: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:53.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:52 smithi078 ceph-mon[94114]: pgmap v1255: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:55.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:46 smithi082 ceph-mon[94281]: pgmap v1252: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:55.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:48 smithi082 ceph-mon[94281]: pgmap v1253: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:56.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:50 smithi082 ceph-mon[94281]: pgmap v1254: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:56.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:52 smithi082 ceph-mon[94281]: pgmap v1255: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:56.532 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb9b009f4d0 msgr2=0x7fb9b00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:56.532 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb9b009f4d0 0x7fb9b00a1980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac005950 tx=0x7fb9ac0058e0 comp rx=0 tx=0).stop 2023-03-17T08:25:57.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 msgr2=0x7fb9c419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:25:57.559 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 0x7fb9c419ac60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400d950 tx=0x7fb9b400dd10 comp rx=0 tx=0).stop 2023-03-17T08:25:57.559 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 shutdown_connections 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9c4100d50 0x7fb9c419d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c40ff110 0x7fb9c40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb9b009f4d0 0x7fb9b00a1980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 --2- 172.21.15.35:0/2292357610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9c41003a0 0x7fb9c419ac60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 >> 172.21.15.35:0/2292357610 conn(0x7fb9c40fa730 msgr2=0x7fb9c40fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 shutdown_connections 2023-03-17T08:25:58.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:25:41.630+0000 7fb9c9a07700 1 -- 172.21.15.35:0/2292357610 wait complete. 2023-03-17T08:25:58.381 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:42 smithi035 ceph-mon[92535]: pgmap v1250: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:42 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2292357610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:44 smithi035 ceph-mon[92535]: pgmap v1251: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:46 smithi035 ceph-mon[92535]: pgmap v1252: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:48 smithi035 ceph-mon[92535]: pgmap v1253: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:50 smithi035 ceph-mon[92535]: pgmap v1254: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:52 smithi035 ceph-mon[92535]: pgmap v1255: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:25:59.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:54 smithi035 ceph-mon[92535]: pgmap v1256: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:01.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:56 smithi035 ceph-mon[92535]: pgmap v1257: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:01.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:25:58 smithi035 ceph-mon[92535]: pgmap v1258: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:01.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:00 smithi035 ceph-mon[92535]: pgmap v1259: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:01.827 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:54 smithi078 ceph-mon[94114]: pgmap v1256: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:03.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:56 smithi078 ceph-mon[94114]: pgmap v1257: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:03.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:25:58 smithi078 ceph-mon[94114]: pgmap v1258: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:03.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:00 smithi078 ceph-mon[94114]: pgmap v1259: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:03.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:54 smithi082 ceph-mon[94281]: pgmap v1256: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:03.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:56 smithi082 ceph-mon[94281]: pgmap v1257: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:03.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:25:58 smithi082 ceph-mon[94281]: pgmap v1258: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:03.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:00 smithi082 ceph-mon[94281]: pgmap v1259: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:03.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:01 smithi035 ceph-mon[92535]: pgmap v1260: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:05.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:01 smithi078 ceph-mon[94114]: pgmap v1260: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:07.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:02 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:26:07.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:02 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2805220333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:26:07.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:01 smithi082 ceph-mon[94281]: pgmap v1260: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:09.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:02 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:26:09.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:02 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2805220333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:26:12.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:03 smithi078 ceph-mon[94114]: pgmap v1261: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:06 smithi078 ceph-mon[94114]: pgmap v1262: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:08 smithi078 ceph-mon[94114]: pgmap v1263: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:10 smithi078 ceph-mon[94114]: pgmap v1264: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:26:12.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:26:13.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:26:13.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:03 smithi082 ceph-mon[94281]: pgmap v1261: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:13.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:06 smithi082 ceph-mon[94281]: pgmap v1262: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:13.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:08 smithi082 ceph-mon[94281]: pgmap v1263: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:13.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:10 smithi082 ceph-mon[94281]: pgmap v1264: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:13.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/3181074571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 msgr2=0x7f0eb80ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:15.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/3181074571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb80ff580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009990 tx=0x7f0ea8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/3181074571 shutdown_connections 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/3181074571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100cf0 0x7f0eb81075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/3181074571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb80ff580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/3181074571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100360 0x7f0eb81007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/3181074571 >> 172.21.15.35:0/3181074571 conn(0x7f0eb80fa790 msgr2=0x7f0eb80fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/3181074571 shutdown_connections 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.969+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/3181074571 wait complete. 2023-03-17T08:26:15.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 Processor -- start 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 -- start start 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb8194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100360 0x7f0eb8195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100cf0 0x7f0eb819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb819c880 con 0x7f0eb80ff170 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb819c9f0 con 0x7f0eb8100360 2023-03-17T08:26:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebe9b4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb819cbb0 con 0x7f0eb8100cf0 2023-03-17T08:26:17.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb8194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:17.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb8194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40728/0 (socket says 172.21.15.35:40728) 2023-03-17T08:26:17.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0eb7fff700 1 -- 172.21.15.35:0/2805220333 learned_addr learned my addr 172.21.15.35:0/2805220333 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:26:17.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0eb77fe700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100360 0x7f0eb8195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:17.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.970+0000 7f0ebcf51700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100cf0 0x7f0eb819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:17.930 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb7fff700 1 -- 172.21.15.35:0/2805220333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100cf0 msgr2=0x7f0eb819c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:18.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb7fff700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100cf0 0x7f0eb819c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:18.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb7fff700 1 -- 172.21.15.35:0/2805220333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100360 msgr2=0x7f0eb8195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:18.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb7fff700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100360 0x7f0eb8195280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:18.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb7fff700 1 -- 172.21.15.35:0/2805220333 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80095f0 con 0x7f0eb80ff170 2023-03-17T08:26:18.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0ebcf51700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100cf0 0x7f0eb819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:26:18.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb77fe700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100360 0x7f0eb8195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:26:18.749 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb7fff700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb8194d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800b5c0 tx=0x7f0ea8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:26:18.749 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea801d070 con 0x7f0eb80ff170 2023-03-17T08:26:19.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb810a990 con 0x7f0eb80ff170 2023-03-17T08:26:19.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ea8004080 con 0x7f0eb80ff170 2023-03-17T08:26:19.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8022cd0 con 0x7f0eb80ff170 2023-03-17T08:26:20.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.971+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb810a800 con 0x7f0eb80ff170 2023-03-17T08:26:20.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.972+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb8106780 con 0x7f0eb80ff170 2023-03-17T08:26:20.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.973+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f0ea8022470 con 0x7f0eb80ff170 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.974+0000 7f0eb57fa700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0ea009f4d0 0x7f0ea00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.974+0000 7f0eb77fe700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0ea009f4d0 0x7f0ea00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.974+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f0ea80cbf70 con 0x7f0eb80ff170 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.974+0000 7f0eb77fe700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0ea009f4d0 0x7f0ea00a1980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0eac005fd0 tx=0x7f0eac005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:01.977+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f0ea80960f0 con 0x7f0eb80ff170 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.177+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0eb80618c0 con 0x7f0eb80ff170 2023-03-17T08:26:22.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.178+0000 7f0eb57fa700 1 -- 172.21.15.35:0/2805220333 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ea80270a0 con 0x7f0eb80ff170 2023-03-17T08:26:22.310 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 32 2023-03-17T08:26:22.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:12 smithi078 ceph-mon[94114]: pgmap v1265: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:22.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:14 smithi078 ceph-mon[94114]: pgmap v1266: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:22.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:16 smithi078 ceph-mon[94114]: pgmap v1267: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:22.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:18 smithi078 ceph-mon[94114]: pgmap v1268: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:22.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:20 smithi078 ceph-mon[94114]: pgmap v1269: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:22.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:12 smithi082 ceph-mon[94281]: pgmap v1265: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:23.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:14 smithi082 ceph-mon[94281]: pgmap v1266: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:23.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:16 smithi082 ceph-mon[94281]: pgmap v1267: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:23.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:18 smithi082 ceph-mon[94281]: pgmap v1268: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:23.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:20 smithi082 ceph-mon[94281]: pgmap v1269: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:23.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0ea009f4d0 msgr2=0x7f0ea00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:23.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0ea009f4d0 0x7f0ea00a1980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0eac005fd0 tx=0x7f0eac005e30 comp rx=0 tx=0).stop 2023-03-17T08:26:23.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 msgr2=0x7f0eb8194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb8194d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800b5c0 tx=0x7f0ea8005ef0 comp rx=0 tx=0).stop 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 shutdown_connections 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb8100cf0 0x7f0eb819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f0ea009f4d0 0x7f0ea00a1980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0eb80ff170 0x7f0eb8194d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 --2- 172.21.15.35:0/2805220333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0eb8100360 0x7f0eb8195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 >> 172.21.15.35:0/2805220333 conn(0x7f0eb80fa790 msgr2=0x7f0eb81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 shutdown_connections 2023-03-17T08:26:23.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:02.180+0000 7f0ebe9b4700 1 -- 172.21.15.35:0/2805220333 wait complete. 2023-03-17T08:26:23.727 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-17T08:26:24.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:22 smithi078 ceph-mon[94114]: pgmap v1270: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:24.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:22 smithi082 ceph-mon[94281]: pgmap v1270: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:24.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:02 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:26:24.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:02 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2805220333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:26:24.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:26:24.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:26:24.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:26:24.338 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:03 smithi035 ceph-mon[92535]: pgmap v1261: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:06 smithi035 ceph-mon[92535]: pgmap v1262: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:08 smithi035 ceph-mon[92535]: pgmap v1263: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:10 smithi035 ceph-mon[92535]: pgmap v1264: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:12 smithi035 ceph-mon[92535]: pgmap v1265: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:14 smithi035 ceph-mon[92535]: pgmap v1266: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:16 smithi035 ceph-mon[92535]: pgmap v1267: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:18 smithi035 ceph-mon[92535]: pgmap v1268: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:20 smithi035 ceph-mon[92535]: pgmap v1269: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:22 smithi035 ceph-mon[92535]: pgmap v1270: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:26.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:24 smithi035 ceph-mon[92535]: pgmap v1271: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.199 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:24 smithi078 ceph-mon[94114]: pgmap v1271: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.200 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:24 smithi082 ceph-mon[94281]: pgmap v1271: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:26.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 -- 172.21.15.35:0/566305954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 msgr2=0x7fb648101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:26.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 --2- 172.21.15.35:0/566305954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648101aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009990 tx=0x7fb63c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:26:26.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 -- 172.21.15.35:0/566305954 shutdown_connections 2023-03-17T08:26:26.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 --2- 172.21.15.35:0/566305954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb648101fe0 0x7fb6481088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:26.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 --2- 172.21.15.35:0/566305954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb648100460 0x7fb648100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:26.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 --2- 172.21.15.35:0/566305954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648101aa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:26.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 -- 172.21.15.35:0/566305954 >> 172.21.15.35:0/566305954 conn(0x7fb6480fbaa0 msgr2=0x7fb6480fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:26:26.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 -- 172.21.15.35:0/566305954 shutdown_connections 2023-03-17T08:26:27.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 -- 172.21.15.35:0/566305954 wait complete. 2023-03-17T08:26:27.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.340+0000 7fb64e14e700 1 Processor -- start 2023-03-17T08:26:27.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:26 smithi078 ceph-mon[94114]: pgmap v1272: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:27.687 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:26 smithi082 ceph-mon[94281]: pgmap v1272: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:28.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:27 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/22047102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:26:30.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:27 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/22047102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:26:30.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 -- start start 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb648100460 0x7fb6481960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb648101fe0 0x7fb64819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64819dc60 con 0x7fb648101650 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64819dda0 con 0x7fb648100460 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb64e14e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64819df30 con 0x7fb648101fe0 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40744/0 (socket says 172.21.15.35:40744) 2023-03-17T08:26:33.744 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 -- 172.21.15.35:0/22047102 learned_addr learned my addr 172.21.15.35:0/22047102 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb6477fe700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb648100460 0x7fb6481960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb647fff700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb648101fe0 0x7fb64819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 -- 172.21.15.35:0/22047102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb648101fe0 msgr2=0x7fb64819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb648101fe0 0x7fb64819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 -- 172.21.15.35:0/22047102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb648100460 msgr2=0x7fb6481960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb648100460 0x7fb6481960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 -- 172.21.15.35:0/22047102 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0095f0 con 0x7fb648101650 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.341+0000 7fb646ffd700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648196620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0095c0 tx=0x7fb63c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.342+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c01d070 con 0x7fb648101650 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.342+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb63c003ec0 con 0x7fb648101650 2023-03-17T08:26:33.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.342+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64810bca0 con 0x7fb648101650 2023-03-17T08:26:33.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.342+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c022c00 con 0x7fb648101650 2023-03-17T08:26:33.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.342+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64810bb10 con 0x7fb648101650 2023-03-17T08:26:33.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.343+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64806a280 con 0x7fb648101650 2023-03-17T08:26:33.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.344+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb63c004030 con 0x7fb648101650 2023-03-17T08:26:35.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.345+0000 7fb644ff9700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb63009f550 0x7fb6300a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:35.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.345+0000 7fb6477fe700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb63009f550 0x7fb6300a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:35.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.345+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb63c0cbdf0 con 0x7fb648101650 2023-03-17T08:26:35.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.345+0000 7fb6477fe700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb63009f550 0x7fb6300a1a00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6481014b0 tx=0x7fb638007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:26:35.602 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.349+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb63c096010 con 0x7fb648101650 2023-03-17T08:26:35.602 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.547+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb64819ea40 con 0x7fb648101650 2023-03-17T08:26:35.602 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.547+0000 7fb644ff9700 1 -- 172.21.15.35:0/22047102 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb63c0270a0 con 0x7fb648101650 2023-03-17T08:26:35.602 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 64 2023-03-17T08:26:37.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb63009f550 msgr2=0x7fb6300a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:37.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb63009f550 0x7fb6300a1a00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6481014b0 tx=0x7fb638007400 comp rx=0 tx=0).stop 2023-03-17T08:26:37.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 msgr2=0x7fb648196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:37.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648196620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0095c0 tx=0x7fb63c005740 comp rx=0 tx=0).stop 2023-03-17T08:26:37.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 shutdown_connections 2023-03-17T08:26:37.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb648101fe0 0x7fb64819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:39.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb648100460 0x7fb6481960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:39.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb63009f550 0x7fb6300a1a00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:39.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 --2- 172.21.15.35:0/22047102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb648101650 0x7fb648196620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:39.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 >> 172.21.15.35:0/22047102 conn(0x7fb6480fbaa0 msgr2=0x7fb6480fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:26:39.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 shutdown_connections 2023-03-17T08:26:39.543 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:26.549+0000 7fb64e14e700 1 -- 172.21.15.35:0/22047102 wait complete. 2023-03-17T08:26:39.544 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:26:39.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:26 smithi035 ceph-mon[92535]: pgmap v1272: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:40.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:27 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/22047102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:26:40.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:28 smithi035 ceph-mon[92535]: pgmap v1273: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:30 smithi035 ceph-mon[92535]: pgmap v1274: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:32 smithi035 ceph-mon[92535]: pgmap v1275: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:34 smithi035 ceph-mon[92535]: pgmap v1276: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:36 smithi035 ceph-mon[92535]: pgmap v1277: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:38 smithi035 ceph-mon[92535]: pgmap v1278: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:28 smithi078 ceph-mon[94114]: pgmap v1273: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:30 smithi078 ceph-mon[94114]: pgmap v1274: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:32 smithi078 ceph-mon[94114]: pgmap v1275: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:34 smithi078 ceph-mon[94114]: pgmap v1276: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:36 smithi078 ceph-mon[94114]: pgmap v1277: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:38 smithi078 ceph-mon[94114]: pgmap v1278: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:28 smithi082 ceph-mon[94281]: pgmap v1273: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:30 smithi082 ceph-mon[94281]: pgmap v1274: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:32 smithi082 ceph-mon[94281]: pgmap v1275: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:34 smithi082 ceph-mon[94281]: pgmap v1276: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:36 smithi082 ceph-mon[94281]: pgmap v1277: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:40.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:38 smithi082 ceph-mon[94281]: pgmap v1278: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:40.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 -- 172.21.15.35:0/1301756853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 msgr2=0x7f35d4107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:41.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 --2- 172.21.15.35:0/1301756853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d4107520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b0a0 tx=0x7f35cc00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:26:41.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 -- 172.21.15.35:0/1301756853 shutdown_connections 2023-03-17T08:26:41.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 --2- 172.21.15.35:0/1301756853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d4107520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:41.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 --2- 172.21.15.35:0/1301756853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 0x7f35d40ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:41.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 --2- 172.21.15.35:0/1301756853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d41002d0 0x7f35d4100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:41.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 -- 172.21.15.35:0/1301756853 >> 172.21.15.35:0/1301756853 conn(0x7f35d40fa6e0 msgr2=0x7f35d40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:26:41.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 -- 172.21.15.35:0/1301756853 shutdown_connections 2023-03-17T08:26:41.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 -- 172.21.15.35:0/1301756853 wait complete. 2023-03-17T08:26:41.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 Processor -- start 2023-03-17T08:26:41.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:40 smithi078 ceph-mon[94114]: pgmap v1279: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:41.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:41 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3859083047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:26:41.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:40 smithi082 ceph-mon[94281]: pgmap v1279: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:41.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:41 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3859083047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:26:42.848 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.688+0000 7f35d9771700 1 -- start start 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 0x7f35d4194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d41002d0 0x7f35d4195400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d419ca40 con 0x7f35d4100c60 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d419cb80 con 0x7f35d40ff0e0 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d419cd10 con 0x7f35d41002d0 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:44.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40760/0 (socket says 172.21.15.35:40760) 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 -- 172.21.15.35:0/3859083047 learned_addr learned my addr 172.21.15.35:0/3859083047 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d2ffd700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 0x7f35d4194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d27fc700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d41002d0 0x7f35d4195400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 -- 172.21.15.35:0/3859083047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d41002d0 msgr2=0x7f35d4195400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d41002d0 0x7f35d4195400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 -- 172.21.15.35:0/3859083047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 msgr2=0x7f35d4194ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 0x7f35d4194ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 -- 172.21.15.35:0/3859083047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc009d00 con 0x7f35d4100c60 2023-03-17T08:26:44.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d2ffd700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 0x7f35d4194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:26:45.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d37fe700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d419c470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001220 tx=0x7f35cc009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:26:45.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00e040 con 0x7f35d4100c60 2023-03-17T08:26:45.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35cc0060a0 con 0x7f35d4100c60 2023-03-17T08:26:45.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d410a910 con 0x7f35d4100c60 2023-03-17T08:26:45.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc01b8d0 con 0x7f35d4100c60 2023-03-17T08:26:46.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.689+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d410a780 con 0x7f35d4100c60 2023-03-17T08:26:49.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.690+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d4067dc0 con 0x7f35d4100c60 2023-03-17T08:26:49.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.692+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f35cc01ba30 con 0x7f35d4100c60 2023-03-17T08:26:49.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.692+0000 7f35bbfff700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f35bc09f4d0 0x7f35bc0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:26:49.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.692+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f35cc0cc020 con 0x7f35d4100c60 2023-03-17T08:26:49.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.692+0000 7f35d2ffd700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f35bc09f4d0 0x7f35bc0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:26:49.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.693+0000 7f35d2ffd700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f35bc09f4d0 0x7f35bc0a1980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35c4005d90 tx=0x7f35c4005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:26:50.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.696+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f35cc096240 con 0x7f35d4100c60 2023-03-17T08:26:50.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.942+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35d4106490 con 0x7f35d4100c60 2023-03-17T08:26:50.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.943+0000 7f35bbfff700 1 -- 172.21.15.35:0/3859083047 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7f35cc021090 con 0x7f35d4100c60 2023-03-17T08:26:50.071 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:26:50.602 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:26:50.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f35bc09f4d0 msgr2=0x7f35bc0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:51.342 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f35bc09f4d0 0x7f35bc0a1980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35c4005d90 tx=0x7f35c4005d00 comp rx=0 tx=0).stop 2023-03-17T08:26:52.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 msgr2=0x7f35d419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:26:52.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d419c470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001220 tx=0x7f35cc009430 comp rx=0 tx=0).stop 2023-03-17T08:26:52.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 shutdown_connections 2023-03-17T08:26:52.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f35bc09f4d0 0x7f35bc0a1980 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:52.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d4100c60 0x7f35d419c470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:52.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d40ff0e0 0x7f35d4194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:53.051 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 --2- 172.21.15.35:0/3859083047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d41002d0 0x7f35d4195400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:26:53.051 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 >> 172.21.15.35:0/3859083047 conn(0x7f35d40fa6e0 msgr2=0x7f35d41037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:26:53.051 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 shutdown_connections 2023-03-17T08:26:53.051 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:40.945+0000 7f35d9771700 1 -- 172.21.15.35:0/3859083047 wait complete. 2023-03-17T08:26:53.052 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:40 smithi035 ceph-mon[92535]: pgmap v1279: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:53.053 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:26:53.054 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-03-17T08:13:31.987985+0000', 'modified': '2023-03-17T08:15:35.363809+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24452, 'mds_1': 24451, 'mds_2': 24445, 'mds_3': 24439, 'mds_4': 24431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14511': {'gid': 14511, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.35:6839/1982578351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.35:6838', 'nonce': 1982578351}, {'type': 'v1', 'addr': '172.21.15.35:6839', 'nonce': 1982578351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14517': {'gid': 14517, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.35:6841/3680182485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.35:6840', 'nonce': 3680182485}, {'type': 'v1', 'addr': '172.21.15.35:6841', 'nonce': 3680182485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.78:6833/3173843386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 3173843386}, {'type': 'v1', 'addr': '172.21.15.78:6833', 'nonce': 3173843386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24415': {'gid': 24415, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6833/1456535346', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 1456535346}, {'type': 'v1', 'addr': '172.21.15.82:6833', 'nonce': 1456535346}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24419': {'gid': 24419, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.78:6835/3131921401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3131921401}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3131921401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24431': {'gid': 24431, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 68, 'addr': '172.21.15.78:6837/2030646762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 2030646762}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 2030646762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 68, 'addr': '172.21.15.82:6835/3844512343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 3844512343}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 3844512343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24445': {'gid': 24445, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 68, 'addr': '172.21.15.82:6837/1283255314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 1283255314}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1283255314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 66, 'addr': '172.21.15.82:6839/2918814393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 2918814393}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 2918814393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 46, 'addr': '172.21.15.78:6839/3357054531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6838', 'nonce': 3357054531}, {'type': 'v1', 'addr': '172.21.15.78:6839', 'nonce': 3357054531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-17T08:26:54.448 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-03-17T08:26:54.448 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-03-17T08:26:54.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:41 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3859083047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:26:54.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:42 smithi035 ceph-mon[92535]: pgmap v1280: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:55.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:44 smithi035 ceph-mon[92535]: pgmap v1281: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:55.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:45 smithi035 ceph-mon[92535]: pgmap v1282: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:56.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:47 smithi035 ceph-mon[92535]: pgmap v1283: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:56.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:50 smithi035 ceph-mon[92535]: pgmap v1284: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:56.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:52 smithi035 ceph-mon[92535]: pgmap v1285: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:56.250 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:42 smithi078 ceph-mon[94114]: pgmap v1280: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:56.250 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:44 smithi078 ceph-mon[94114]: pgmap v1281: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:56.251 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:45 smithi078 ceph-mon[94114]: pgmap v1282: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:57.251 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:47 smithi078 ceph-mon[94114]: pgmap v1283: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:57.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:50 smithi078 ceph-mon[94114]: pgmap v1284: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:57.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:52 smithi078 ceph-mon[94114]: pgmap v1285: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:57.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:54 smithi078 ceph-mon[94114]: pgmap v1286: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:42 smithi082 ceph-mon[94281]: pgmap v1280: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:44 smithi082 ceph-mon[94281]: pgmap v1281: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:45 smithi082 ceph-mon[94281]: pgmap v1282: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:47 smithi082 ceph-mon[94281]: pgmap v1283: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:50 smithi082 ceph-mon[94281]: pgmap v1284: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:52 smithi082 ceph-mon[94281]: pgmap v1285: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:26:57.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:54 smithi082 ceph-mon[94281]: pgmap v1286: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:57.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:54 smithi035 ceph-mon[92535]: pgmap v1286: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:26:59.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:56 smithi078 ceph-mon[94114]: pgmap v1287: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:59.688 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:56 smithi082 ceph-mon[94281]: pgmap v1287: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:26:59.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:26:58 smithi078 ceph-mon[94114]: pgmap v1288: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:00.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:26:58 smithi082 ceph-mon[94281]: pgmap v1288: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:00.932 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:00 smithi082 ceph-mon[94281]: pgmap v1289: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 -- 172.21.15.35:0/3316264797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 msgr2=0x7f6a501075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:02.066 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 --2- 172.21.15.35:0/3316264797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a501075f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800b0a0 tx=0x7f6a4800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:27:02.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 -- 172.21.15.35:0/3316264797 shutdown_connections 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 --2- 172.21.15.35:0/3316264797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a501075f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 --2- 172.21.15.35:0/3316264797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 0x7f6a500ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 --2- 172.21.15.35:0/3316264797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a501003a0 0x7f6a50100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 -- 172.21.15.35:0/3316264797 >> 172.21.15.35:0/3316264797 conn(0x7f6a500fa730 msgr2=0x7f6a500fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 -- 172.21.15.35:0/3316264797 shutdown_connections 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.402+0000 7f6a54f91700 1 -- 172.21.15.35:0/3316264797 wait complete. 2023-03-17T08:27:03.853 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 Processor -- start 2023-03-17T08:27:04.789 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 -- start start 2023-03-17T08:27:04.789 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 0x7f6a500688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:04.789 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a501003a0 0x7f6a5019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a5019d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5019da80 con 0x7f6a50100d50 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5019dbf0 con 0x7f6a500ff110 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a54f91700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5019ddb0 con 0x7f6a501003a0 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.403+0000 7f6a4ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a5019d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a5019d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40772/0 (socket says 172.21.15.35:40772) 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/2430939049 learned_addr learned my addr 172.21.15.35:0/2430939049 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 0x7f6a500688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:04.790 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a501003a0 0x7f6a5019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:04.791 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/2430939049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a501003a0 msgr2=0x7f6a5019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:05.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a501003a0 0x7f6a5019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:06.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/2430939049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 msgr2=0x7f6a500688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:06.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 0x7f6a500688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:06.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/2430939049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009d00 con 0x7f6a50100d50 2023-03-17T08:27:06.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 0x7f6a500688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:27:06.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a5019d2e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6a480062a0 tx=0x7f6a48004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a3f7fe700 1 -- 172.21.15.35:0/2430939049 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800e040 con 0x7f6a50100d50 2023-03-17T08:27:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5010a9c0 con 0x7f6a50100d50 2023-03-17T08:27:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a3f7fe700 1 -- 172.21.15.35:0/2430939049 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a480094c0 con 0x7f6a50100d50 2023-03-17T08:27:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a3f7fe700 1 -- 172.21.15.35:0/2430939049 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4801bc70 con 0x7f6a50100d50 2023-03-17T08:27:07.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.404+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5010a830 con 0x7f6a50100d50 2023-03-17T08:27:07.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.406+0000 7f6a3f7fe700 1 -- 172.21.15.35:0/2430939049 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f6a4801d890 con 0x7f6a50100d50 2023-03-17T08:27:07.624 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.407+0000 7f6a3f7fe700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6a3809f4d0 0x7f6a380a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:07.624 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.407+0000 7f6a3f7fe700 1 -- 172.21.15.35:0/2430939049 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6a480cc2e0 con 0x7f6a50100d50 2023-03-17T08:27:08.122 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.407+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6a3809f4d0 0x7f6a380a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:08.122 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.407+0000 7f6a6111eb80 1 Processor -- start 2023-03-17T08:27:08.122 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6a3809f4d0 0x7f6a380a1980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005950 tx=0x7f6a44005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:08.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 -- start start 2023-03-17T08:27:08.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f96ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:08.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2f95670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:09.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:09.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2e9c020 con 0x5586e2f96a90 2023-03-17T08:27:09.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2eee960 con 0x5586e2f95c50 2023-03-17T08:27:09.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2ee7df0 con 0x5586e2f973e0 2023-03-17T08:27:09.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f96ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:09.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f96ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40776/0 (socket says 172.21.15.35:40776) 2023-03-17T08:27:10.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 -- 172.21.15.35:0/4099108639 learned_addr learned my addr 172.21.15.35:0/4099108639 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:10.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:11.755 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2f95670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:11.756 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 -- 172.21.15.35:0/4099108639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 msgr2=0x5586e2f95670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:11.756 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2f95670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:11.756 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 -- 172.21.15.35:0/4099108639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 msgr2=0x5586e2f960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:11.756 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:12.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4e59c700 1 -- 172.21.15.35:0/4099108639 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586e2d695e0 con 0x5586e2f96a90 2023-03-17T08:27:13.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.408+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2f95670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:27:13.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.409+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f96ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400ed30 tx=0x7f6a44011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777fc0b9ea8ea696 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:14.543 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.409+0000 7f6a3cff9700 1 -- 172.21.15.35:0/4099108639 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44010cd0 con 0x5586e2f96a90 2023-03-17T08:27:14.543 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.409+0000 7f6a3cff9700 1 -- 172.21.15.35:0/4099108639 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a44010e30 con 0x5586e2f96a90 2023-03-17T08:27:14.543 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.409+0000 7f6a3cff9700 1 -- 172.21.15.35:0/4099108639 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4401d450 con 0x5586e2f96a90 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4099108639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 msgr2=0x5586e2f96ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f96ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400ed30 tx=0x7f6a44011000 comp rx=0 tx=0).stop 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4099108639 shutdown_connections 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f96ea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4099108639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2f95670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4099108639 >> 172.21.15.35:0/4099108639 conn(0x5586e2f91c00 msgr2=0x5586e2f8ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4099108639 shutdown_connections 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4099108639 wait complete. 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- start start 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 Processor -- start 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f96a90 0x5586e2f9f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 0x5586e2fa69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2d6b8d0 con 0x5586e2f973e0 2023-03-17T08:27:14.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2fa6f30 con 0x5586e2f96a90 2023-03-17T08:27:14.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.410+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2fa70c0 con 0x5586e2f95c50 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a6111eb80 10 client.0 _ll_register_callbacks cb 0x5586e2d8d240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 0x5586e2fa69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 0x5586e2fa69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40786/0 (socket says 172.21.15.35:40786) 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/1181028631 learned_addr learned my addr 172.21.15.35:0/1181028631 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f96a90 0x5586e2f9f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/1181028631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 msgr2=0x5586e2f9f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:16.236 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:16.237 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f96a90 msgr2=0x5586e2f9f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:16.237 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f96a90 0x5586e2f9f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:16.237 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 -- 172.21.15.35:0/1181028631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4400ea10 con 0x5586e2f973e0 2023-03-17T08:27:16.237 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f96a90 0x5586e2f9f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:27:16.237 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 0x5586e2fa69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fd0 tx=0x7f6a48099a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1d79c815d9edac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:18.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:27:18.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a35ffb700 1 -- 172.21.15.35:0/1181028631 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a2280 con 0x5586e2f973e0 2023-03-17T08:27:18.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a35ffb700 1 -- 172.21.15.35:0/1181028631 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6a4801b450 con 0x5586e2f973e0 2023-03-17T08:27:18.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586e2eaa3a0 con 0x5586e2f973e0 2023-03-17T08:27:18.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a35ffb700 1 -- 172.21.15.35:0/1181028631 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a480b2260 con 0x5586e2f973e0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a6111eb80 10 client.14886 fetch_fsmap learned FSMap version 29 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.411+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5586e2d15d90 con 0x5586e2f973e0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a35ffb700 1 -- 172.21.15.35:0/1181028631 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a480b6080 con 0x5586e2f973e0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a35ffb700 1 -- 172.21.15.35:0/1181028631 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a4809a410 con 0x5586e2f973e0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a6111eb80 10 client.14886 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a6111eb80 10 client.14886 resolve_mds: resolved name 'h' to daemon mds.h 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a6111eb80 20 client.14886 populate_metadata read hostname 'smithi035' 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e2faa6a0 0x5586e2fa9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a6111eb80 4 client.14886 mds_command: new command op to 24431 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586e2eb6610 con 0x5586e2faa6a0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e2faa6a0 0x5586e2fa9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a35ffb700 10 client.14886 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.412+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e2faa6a0 0x5586e2fa9b10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b4604e436c0c25e server_cookie=186716004e0ef854 in_seq=0 out_seq=0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a35ffb700 1 -- 172.21.15.35:0/1181028631 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5586e2eb6610 con 0x5586e2faa6a0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a35ffb700 10 client.14886 handle_command_reply: tid=0 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 client.14886 shutdown 2023-03-17T08:27:18.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 msgr2=0x5586e2fa69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 0x5586e2fa69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009fd0 tx=0x7f6a48099a80 comp rx=0 tx=0).stop 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 shutdown_connections 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f973e0 0x5586e2fa69f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e2faa6a0 0x5586e2fa9b10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/1181028631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f96a90 0x5586e2f9f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a35ffb700 0 client.14886 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.413+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 >> 172.21.15.35:0/1181028631 conn(0x5586e2f91c00 msgr2=0x5586e2f8f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.414+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 shutdown_connections 2023-03-17T08:27:18.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.414+0000 7f6a6111eb80 1 -- 172.21.15.35:0/1181028631 wait complete. 2023-03-17T08:27:19.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.414+0000 7f6a6111eb80 20 client.14886 trim_cache size 0 max 16384 2023-03-17T08:27:19.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 Processor -- start 2023-03-17T08:27:19.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 -- start start 2023-03-17T08:27:19.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f95590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:19.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2fa7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:19.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2fa9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2eb6610 con 0x5586e2f96a90 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2e91730 con 0x5586e2f95c50 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.431+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e2eb5e00 con 0x5586e2f973e0 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2fa7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2fa7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40792/0 (socket says 172.21.15.35:40792) 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/4255234655 learned_addr learned my addr 172.21.15.35:0/4255234655 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f95590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:20.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2fa9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:21.703 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/4255234655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 msgr2=0x5586e2fa9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:21.703 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2fa9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:21.703 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/4255234655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 msgr2=0x5586e2f95590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:21.703 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f95590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:21.703 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/4255234655 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586e2f90270 con 0x5586e2f96a90 2023-03-17T08:27:21.704 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f95590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:27:21.704 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2fa7440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000cc80 tx=0x7f6a4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6006d467c0ac0729 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:21.704 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a3d7fa700 1 -- 172.21.15.35:0/4255234655 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40011ca0 con 0x5586e2f96a90 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a3d7fa700 1 -- 172.21.15.35:0/4255234655 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a4000c730 con 0x5586e2f96a90 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.432+0000 7f6a3d7fa700 1 -- 172.21.15.35:0/4255234655 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000f730 con 0x5586e2f96a90 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4255234655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 msgr2=0x5586e2fa7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2fa7440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000cc80 tx=0x7f6a4000cf90 comp rx=0 tx=0).stop 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4255234655 shutdown_connections 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f973e0 0x5586e2fa9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:23.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f95c50 0x5586e2f95590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:23.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/4255234655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2fa7440 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:23.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4255234655 >> 172.21.15.35:0/4255234655 conn(0x5586e2f91c00 msgr2=0x5586e2f9e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:23.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4255234655 shutdown_connections 2023-03-17T08:27:23.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- 172.21.15.35:0/4255234655 wait complete. 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- start start 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 Processor -- start 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f973e0 0x5586e3002640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e3002d80 con 0x5586e2f96a90 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e3002ef0 con 0x5586e2f973e0 2023-03-17T08:27:23.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e30030b0 con 0x5586e2f95c50 2023-03-17T08:27:23.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a6111eb80 10 client.0 _ll_register_callbacks cb 0x5586e2d8d240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:27:23.840 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a4dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.433+0000 7f6a4dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f9c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40798/0 (socket says 172.21.15.35:40798) 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/2492367790 learned_addr learned my addr 172.21.15.35:0/2492367790 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f973e0 0x5586e3002640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/2492367790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 msgr2=0x5586e2f9c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f973e0 msgr2=0x5586e3002640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:24.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f973e0 0x5586e3002640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 -- 172.21.15.35:0/2492367790 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4000c8b0 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4ed9d700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f973e0 0x5586e3002640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a4dd9b700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f9c760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6a40012ef0 tx=0x7f6a40012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbad9b3756d9ec9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a35ffb700 1 -- 172.21.15.35:0/2492367790 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40005450 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a35ffb700 1 -- 172.21.15.35:0/2492367790 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6a400129d0 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586e2d6bf10 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a35ffb700 1 -- 172.21.15.35:0/2492367790 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a4000c730 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a6111eb80 10 client.14892 fetch_fsmap learned FSMap version 29 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5586e2cfec10 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.434+0000 7f6a35ffb700 1 -- 172.21.15.35:0/2492367790 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5586e2d6bf10 con 0x5586e2f96a90 2023-03-17T08:27:24.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a35ffb700 1 -- 172.21.15.35:0/2492367790 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a4000f640 con 0x5586e2f96a90 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a6111eb80 10 client.14892 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a6111eb80 10 client.14892 resolve_mds: resolved name 'h' to daemon mds.h 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a6111eb80 20 client.14892 populate_metadata read hostname 'smithi035' 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e3007d40 0x5586e3004650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a6111eb80 4 client.14892 mds_command: new command op to 24431 tid=0[{"prefix": "status"}] 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5586e2ea4370 con 0x5586e3007d40 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e3007d40 0x5586e3004650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a35ffb700 10 client.14892 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T08:27:24.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.435+0000 7f6a4e59c700 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e3007d40 0x5586e3004650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4a31d7d2f3daaeb2 server_cookie=1f51a7ae566925b8 in_seq=0 out_seq=0 2023-03-17T08:27:24.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a35ffb700 1 -- 172.21.15.35:0/2492367790 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5586e2ea4370 con 0x5586e3007d40 2023-03-17T08:27:24.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a35ffb700 10 client.14892 handle_command_reply: tid=0 2023-03-17T08:27:24.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 client.14892 shutdown 2023-03-17T08:27:24.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 msgr2=0x5586e2f9c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:24.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f9c760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6a40012ef0 tx=0x7f6a40012730 comp rx=0 tx=0).stop 2023-03-17T08:27:26.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 shutdown_connections 2023-03-17T08:27:26.987 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5586e3007d40 0x5586e3004650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:26.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586e2f973e0 0x5586e3002640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:26.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586e2f95c50 0x5586e2f9c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:26.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a35ffb700 0 client.14892 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T08:27:26.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 --2- 172.21.15.35:0/2492367790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586e2f96a90 0x5586e2f9c760 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:27.767 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 >> 172.21.15.35:0/2492367790 conn(0x5586e2f91c00 msgr2=0x5586e2fa9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:27.767 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 shutdown_connections 2023-03-17T08:27:27.767 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 1 -- 172.21.15.35:0/2492367790 wait complete. 2023-03-17T08:27:29.190 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a6111eb80 20 client.14892 trim_cache size 0 max 16384 2023-03-17T08:27:29.191 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:27:29.191 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:27:29.191 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 4, 2023-03-17T08:27:29.191 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24431, 2023-03-17T08:27:31.269 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:27:31.269 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 728.01668586400001, 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 992.42689100500002 2023-03-17T08:27:31.270 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:27:31.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6a3809f4d0 msgr2=0x7f6a380a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:32.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6a3809f4d0 0x7f6a380a1980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005950 tx=0x7f6a44005f50 comp rx=0 tx=0).stop 2023-03-17T08:27:32.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 msgr2=0x7f6a5019d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:32.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a5019d2e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6a480062a0 tx=0x7f6a48004db0 comp rx=0 tx=0).stop 2023-03-17T08:27:32.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 shutdown_connections 2023-03-17T08:27:32.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6a3809f4d0 0x7f6a380a1980 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:32.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a50100d50 0x7f6a5019d2e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:32.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a500ff110 0x7f6a500688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:32.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 --2- 172.21.15.35:0/2430939049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a501003a0 0x7f6a5019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:32.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 >> 172.21.15.35:0/2430939049 conn(0x7f6a500fa730 msgr2=0x7f6a500fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:32.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.436+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 shutdown_connections 2023-03-17T08:27:32.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:26:56.437+0000 7f6a54f91700 1 -- 172.21.15.35:0/2430939049 wait complete. 2023-03-17T08:27:34.910 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-03-17T08:27:34.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:56 smithi035 ceph-mon[92535]: pgmap v1287: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:36.962 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:26:58 smithi035 ceph-mon[92535]: pgmap v1288: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:38.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:00 smithi035 ceph-mon[92535]: pgmap v1289: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:38.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:02 smithi035 ceph-mon[92535]: pgmap v1290: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:38.922 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:03 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:27:38.922 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:04 smithi035 ceph-mon[92535]: pgmap v1291: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:38.922 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:27:38.922 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:27:38.922 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:27:38.922 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:06 smithi035 ceph-mon[92535]: pgmap v1292: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:38.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:08 smithi035 ceph-mon[92535]: pgmap v1293: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:38.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:10 smithi035 ceph-mon[92535]: pgmap v1294: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:38.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:12 smithi035 ceph-mon[92535]: pgmap v1295: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:14 smithi035 ceph-mon[92535]: pgmap v1296: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:16 smithi035 ceph-mon[92535]: pgmap v1297: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:18 smithi035 ceph-mon[92535]: pgmap v1298: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:20 smithi035 ceph-mon[92535]: pgmap v1299: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:22 smithi035 ceph-mon[92535]: pgmap v1300: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:24 smithi035 ceph-mon[92535]: pgmap v1301: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:26 smithi035 ceph-mon[92535]: pgmap v1302: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:28 smithi035 ceph-mon[92535]: pgmap v1303: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:30 smithi035 ceph-mon[92535]: pgmap v1304: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:39.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:32 smithi035 ceph-mon[92535]: pgmap v1305: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:39.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:02 smithi082 ceph-mon[94281]: pgmap v1290: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:41.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:03 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:04 smithi082 ceph-mon[94281]: pgmap v1291: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:06 smithi082 ceph-mon[94281]: pgmap v1292: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:08 smithi082 ceph-mon[94281]: pgmap v1293: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:10 smithi082 ceph-mon[94281]: pgmap v1294: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:12 smithi082 ceph-mon[94281]: pgmap v1295: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:14 smithi082 ceph-mon[94281]: pgmap v1296: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:16 smithi082 ceph-mon[94281]: pgmap v1297: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:18 smithi082 ceph-mon[94281]: pgmap v1298: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:20 smithi082 ceph-mon[94281]: pgmap v1299: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:22 smithi082 ceph-mon[94281]: pgmap v1300: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:24 smithi082 ceph-mon[94281]: pgmap v1301: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:26 smithi082 ceph-mon[94281]: pgmap v1302: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:41.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:28 smithi082 ceph-mon[94281]: pgmap v1303: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:30 smithi082 ceph-mon[94281]: pgmap v1304: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:41.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:32 smithi082 ceph-mon[94281]: pgmap v1305: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:43.490 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:34 smithi082 ceph-mon[94281]: pgmap v1306: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:43.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:00 smithi078 ceph-mon[94114]: pgmap v1289: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:43.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:02 smithi078 ceph-mon[94114]: pgmap v1290: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:43.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:03 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:04 smithi078 ceph-mon[94114]: pgmap v1291: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:06 smithi078 ceph-mon[94114]: pgmap v1292: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:08 smithi078 ceph-mon[94114]: pgmap v1293: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:45.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:10 smithi078 ceph-mon[94114]: pgmap v1294: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:46.420 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:12 smithi078 ceph-mon[94114]: pgmap v1295: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:14 smithi078 ceph-mon[94114]: pgmap v1296: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:16 smithi078 ceph-mon[94114]: pgmap v1297: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:18 smithi078 ceph-mon[94114]: pgmap v1298: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:20 smithi078 ceph-mon[94114]: pgmap v1299: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:22 smithi078 ceph-mon[94114]: pgmap v1300: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:24 smithi078 ceph-mon[94114]: pgmap v1301: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:26 smithi078 ceph-mon[94114]: pgmap v1302: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:28 smithi078 ceph-mon[94114]: pgmap v1303: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:30 smithi078 ceph-mon[94114]: pgmap v1304: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:48.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:32 smithi078 ceph-mon[94114]: pgmap v1305: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:48.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:34 smithi035 ceph-mon[92535]: pgmap v1306: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:49.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:36 smithi035 ceph-mon[92535]: pgmap v1307: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:49.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:38 smithi035 ceph-mon[92535]: pgmap v1308: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:49.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:36 smithi082 ceph-mon[94281]: pgmap v1307: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:49.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:38 smithi082 ceph-mon[94281]: pgmap v1308: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:49.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:40 smithi082 ceph-mon[94281]: pgmap v1309: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:49.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:41 smithi082 ceph-mon[94281]: pgmap v1310: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:49.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:43 smithi082 ceph-mon[94281]: pgmap v1311: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.121 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:46 smithi082 ceph-mon[94281]: pgmap v1312: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:51.121 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:48 smithi082 ceph-mon[94281]: pgmap v1313: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:34 smithi078 ceph-mon[94114]: pgmap v1306: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:36 smithi078 ceph-mon[94114]: pgmap v1307: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:38 smithi078 ceph-mon[94114]: pgmap v1308: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:40 smithi078 ceph-mon[94114]: pgmap v1309: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:41 smithi078 ceph-mon[94114]: pgmap v1310: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:43 smithi078 ceph-mon[94114]: pgmap v1311: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:46 smithi078 ceph-mon[94114]: pgmap v1312: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:48 smithi078 ceph-mon[94114]: pgmap v1313: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:50 smithi078 ceph-mon[94114]: pgmap v1314: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.123 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:50 smithi082 ceph-mon[94281]: pgmap v1314: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:27:51.132 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 -- 172.21.15.35:0/2544004169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c00ff110 msgr2=0x7f89c00ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 --2- 172.21.15.35:0/2544004169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c00ff110 0x7f89c00ff520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009990 tx=0x7f89b0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 -- 172.21.15.35:0/2544004169 shutdown_connections 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 --2- 172.21.15.35:0/2544004169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 0x7f89c01075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 --2- 172.21.15.35:0/2544004169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c00ff110 0x7f89c00ff520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 --2- 172.21.15.35:0/2544004169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c01003a0 0x7f89c0100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.926+0000 7f89c67b4700 1 -- 172.21.15.35:0/2544004169 >> 172.21.15.35:0/2544004169 conn(0x7f89c00fa730 msgr2=0x7f89c00fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:52.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.927+0000 7f89c67b4700 1 -- 172.21.15.35:0/2544004169 shutdown_connections 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.927+0000 7f89c67b4700 1 -- 172.21.15.35:0/2544004169 wait complete. 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.927+0000 7f89c67b4700 1 Processor -- start 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.927+0000 7f89c67b4700 1 -- start start 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.927+0000 7f89c67b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c00ff110 0x7f89c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 0x7f89c019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 0x7f89c019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c019d9c0 con 0x7f89c01003a0 2023-03-17T08:27:54.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c019db30 con 0x7f89c0100d50 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c019dcf0 con 0x7f89c00ff110 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 0x7f89c019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c00ff110 0x7f89c00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 0x7f89c019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40812/0 (socket says 172.21.15.35:40812) 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 -- 172.21.15.35:0/1011667136 learned_addr learned my addr 172.21.15.35:0/1011667136 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c4d51700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 0x7f89c019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 -- 172.21.15.35:0/1011667136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c00ff110 msgr2=0x7f89c00688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c00ff110 0x7f89c00688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 -- 172.21.15.35:0/1011667136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 msgr2=0x7f89c019d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 0x7f89c019d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 -- 172.21.15.35:0/1011667136 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00095f0 con 0x7f89c01003a0 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c4d51700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 0x7f89c019d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 0x7f89c019aba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f89b400d950 tx=0x7f89b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bd7fa700 1 -- 172.21.15.35:0/1011667136 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4009940 con 0x7f89c01003a0 2023-03-17T08:27:54.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c010a9b0 con 0x7f89c01003a0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bd7fa700 1 -- 172.21.15.35:0/1011667136 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b4010460 con 0x7f89c01003a0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89bd7fa700 1 -- 172.21.15.35:0/1011667136 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400f620 con 0x7f89c01003a0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.928+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c010a820 con 0x7f89c01003a0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.931+0000 7f89bd7fa700 1 -- 172.21.15.35:0/1011667136 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f89b40105d0 con 0x7f89c01003a0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.932+0000 7f89bd7fa700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f89a809f4d0 0x7f89a80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.932+0000 7f89bd7fa700 1 -- 172.21.15.35:0/1011667136 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f89b40ca470 con 0x7f89c01003a0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.932+0000 7f89bffff700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f89a809f4d0 0x7f89a80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.932+0000 7f89bffff700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f89a809f4d0 0x7f89a80a1980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89b0006010 tx=0x7f89b000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.932+0000 7f89d2941b80 1 Processor -- start 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 -- start start 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1695f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1695da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1695e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d16860020 con 0x560d1695e060 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d168b2960 con 0x560d1695eea0 2023-03-17T08:27:54.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89d2941b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d168abdf0 con 0x560d1695f7f0 2023-03-17T08:27:54.676 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1695e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:54.676 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1695e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40822/0 (socket says 172.21.15.35:40822) 2023-03-17T08:27:54.676 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 -- 172.21.15.35:0/4267186187 learned_addr learned my addr 172.21.15.35:0/4267186187 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1695da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89bffff700 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1695f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 -- 172.21.15.35:0/4267186187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 msgr2=0x560d1695da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1695da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 -- 172.21.15.35:0/4267186187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 msgr2=0x560d1695f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1695f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 -- 172.21.15.35:0/4267186187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d1672d5e0 con 0x560d1695e060 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.933+0000 7f89c4d51700 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1695e4d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009440 tx=0x7f89b8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b654a88a06bb24c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:27:58.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89a67fc700 1 -- 172.21.15.35:0/4267186187 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b800e070 con 0x560d1695e060 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89a67fc700 1 -- 172.21.15.35:0/4267186187 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b800f040 con 0x560d1695e060 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89a67fc700 1 -- 172.21.15.35:0/4267186187 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8015b30 con 0x560d1695e060 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 -- 172.21.15.35:0/4267186187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 msgr2=0x560d1695e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1695e4d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009440 tx=0x7f89b8009920 comp rx=0 tx=0).stop 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 -- 172.21.15.35:0/4267186187 shutdown_connections 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1695e4d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:58.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1695f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:59.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 --2- 172.21.15.35:0/4267186187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1695da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:27:59.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 -- 172.21.15.35:0/4267186187 >> 172.21.15.35:0/4267186187 conn(0x560d16955c00 msgr2=0x560d16953fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:27:59.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 -- 172.21.15.35:0/4267186187 shutdown_connections 2023-03-17T08:27:59.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.934+0000 7f89d2941b80 1 -- 172.21.15.35:0/4267186187 wait complete. 2023-03-17T08:27:59.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 -- start start 2023-03-17T08:28:01.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 Processor -- start 2023-03-17T08:28:01.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d169678a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:01.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d16967de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1696ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1672f8d0 con 0x560d1695e060 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1696f360 con 0x560d1695eea0 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1696f4f0 con 0x560d1695f7f0 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89d2941b80 10 client.0 _ll_register_callbacks cb 0x560d16751240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89bffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d169678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:02.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89bffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d169678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40824/0 (socket says 172.21.15.35:40824) 2023-03-17T08:28:02.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.935+0000 7f89bffff700 1 -- 172.21.15.35:0/3590397279 learned_addr learned my addr 172.21.15.35:0/3590397279 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:02.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89c4d51700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1696ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:04.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d16967de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:04.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bffff700 1 -- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 msgr2=0x560d1696ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:04.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bffff700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1696ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:04.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bffff700 1 -- 172.21.15.35:0/3590397279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 msgr2=0x560d16967de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:04.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bffff700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d16967de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:04.007 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bffff700 1 -- 172.21.15.35:0/3590397279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b80090f0 con 0x560d1695e060 2023-03-17T08:28:04.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89bffff700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d169678a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89b0015000 tx=0x7f89b001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef6f54712e847a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:05.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f899f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:28:05.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f899f7fe700 1 -- 172.21.15.35:0/3590397279 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000bdb0 con 0x560d1695e060 2023-03-17T08:28:05.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f899f7fe700 1 -- 172.21.15.35:0/3590397279 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f89b0004500 con 0x560d1695e060 2023-03-17T08:28:05.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d1686e3a0 con 0x560d1695e060 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f899f7fe700 1 -- 172.21.15.35:0/3590397279 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89b00046c0 con 0x560d1695e060 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89d2941b80 10 client.14904 fetch_fsmap learned FSMap version 29 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560d166d9d90 con 0x560d1695e060 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.936+0000 7f899f7fe700 1 -- 172.21.15.35:0/3590397279 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d1686e3a0 con 0x560d1695e060 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f899f7fe700 1 -- 172.21.15.35:0/3590397279 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f89b000f690 con 0x560d1695e060 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89d2941b80 10 client.14904 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:28:06.320 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89d2941b80 10 client.14904 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-17T08:28:06.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89d2941b80 20 client.14904 populate_metadata read hostname 'smithi035' 2023-03-17T08:28:06.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89d2941b80 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d16972d70 0x560d169721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:06.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89d2941b80 4 client.14904 mds_command: new command op to 24439 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:28:06.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d1687a610 con 0x560d16972d70 2023-03-17T08:28:06.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d16972d70 0x560d169721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:06.868 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f899f7fe700 10 client.14904 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T08:28:06.868 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.937+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d16972d70 0x560d169721a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4d1e85dce9541e96 server_cookie=b421984dc2a8b682 in_seq=0 out_seq=0 2023-03-17T08:28:06.868 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f899f7fe700 1 -- 172.21.15.35:0/3590397279 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560d1687a610 con 0x560d16972d70 2023-03-17T08:28:06.868 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f899f7fe700 10 client.14904 handle_command_reply: tid=0 2023-03-17T08:28:06.868 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 client.14904 shutdown 2023-03-17T08:28:06.868 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 msgr2=0x560d169678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d169678a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89b0015000 tx=0x7f89b001a050 comp rx=0 tx=0).stop 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 shutdown_connections 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d16972d70 0x560d169721a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d1696ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d169678a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f89d2941b80 1 --2- 172.21.15.35:0/3590397279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d16967de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.938+0000 7f899f7fe700 0 client.14904 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.939+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 >> 172.21.15.35:0/3590397279 conn(0x560d16955c00 msgr2=0x560d169536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:06.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.939+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 shutdown_connections 2023-03-17T08:28:07.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.939+0000 7f89d2941b80 1 -- 172.21.15.35:0/3590397279 wait complete. 2023-03-17T08:28:07.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.939+0000 7f89d2941b80 20 client.14904 trim_cache size 0 max 16384 2023-03-17T08:28:07.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 Processor -- start 2023-03-17T08:28:07.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 -- start start 2023-03-17T08:28:07.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1696f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:07.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1696edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:08.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d169721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1686e3a0 con 0x560d1695e060 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d16855730 con 0x560d1695eea0 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89d2941b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1686db70 con 0x560d1695f7f0 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1696f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1696f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40832/0 (socket says 172.21.15.35:40832) 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 -- 172.21.15.35:0/1159962520 learned_addr learned my addr 172.21.15.35:0/1159962520 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89c4d51700 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d169721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 -- 172.21.15.35:0/1159962520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 msgr2=0x560d169721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:08.799 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d169721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 -- 172.21.15.35:0/1159962520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 msgr2=0x560d1696edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1696edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1696edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89bffff700 1 -- 172.21.15.35:0/1159962520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d1695dc70 con 0x560d1695e060 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.957+0000 7f89c4d51700 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d169721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89bffff700 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1696f8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89b00098e0 tx=0x7f89b0009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50a15f01e2781fa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89a6ffd700 1 -- 172.21.15.35:0/1159962520 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000b9f0 con 0x560d1695e060 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89a6ffd700 1 -- 172.21.15.35:0/1159962520 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b001e040 con 0x560d1695e060 2023-03-17T08:28:08.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89a6ffd700 1 -- 172.21.15.35:0/1159962520 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0004720 con 0x560d1695e060 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 -- 172.21.15.35:0/1159962520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 msgr2=0x560d1696f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1696f8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89b00098e0 tx=0x7f89b0009290 comp rx=0 tx=0).stop 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 -- 172.21.15.35:0/1159962520 shutdown_connections 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695f7f0 0x560d169721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695e060 0x560d1696f8d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 --2- 172.21.15.35:0/1159962520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695eea0 0x560d1696edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:08.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 -- 172.21.15.35:0/1159962520 >> 172.21.15.35:0/1159962520 conn(0x560d16955c00 msgr2=0x560d1695e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:09.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 -- 172.21.15.35:0/1159962520 shutdown_connections 2023-03-17T08:28:09.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.958+0000 7f89d2941b80 1 -- 172.21.15.35:0/1159962520 wait complete. 2023-03-17T08:28:09.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 -- start start 2023-03-17T08:28:09.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 Processor -- start 2023-03-17T08:28:09.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695e060 0x560d1696a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 0x560d1696a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695f7f0 0x560d1696d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1696db70 con 0x560d1695eea0 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1696dce0 con 0x560d1695f7f0 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1696dea0 con 0x560d1695e060 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89d2941b80 10 client.0 _ll_register_callbacks cb 0x560d16751240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 0x560d1696a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 0x560d1696a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40840/0 (socket says 172.21.15.35:40840) 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89bf7fe700 1 -- 172.21.15.35:0/316865583 learned_addr learned my addr 172.21.15.35:0/316865583 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89bffff700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695e060 0x560d1696a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.959+0000 7f89c4d51700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695f7f0 0x560d1696d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:09.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bf7fe700 1 -- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695e060 msgr2=0x560d1696a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:10.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695e060 0x560d1696a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:10.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bf7fe700 1 -- 172.21.15.35:0/316865583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695f7f0 msgr2=0x560d1696d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:10.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695f7f0 0x560d1696d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:10.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bf7fe700 1 -- 172.21.15.35:0/316865583 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d166d9d90 con 0x560d1695eea0 2023-03-17T08:28:10.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bffff700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695e060 0x560d1696a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:28:10.977 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89c4d51700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695f7f0 0x560d1696d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89bf7fe700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 0x560d1696a610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89b4097f20 tx=0x7f89b4097e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d32acf9df5562d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f899f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f899f7fe700 1 -- 172.21.15.35:0/316865583 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40c7a40 con 0x560d1695eea0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f899f7fe700 1 -- 172.21.15.35:0/316865583 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f89b40c7ba0 con 0x560d1695eea0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d169291f0 con 0x560d1695eea0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f899f7fe700 1 -- 172.21.15.35:0/316865583 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89b40b61e0 con 0x560d1695eea0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 10 client.14910 fetch_fsmap learned FSMap version 29 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560d166c2c10 con 0x560d1695eea0 2023-03-17T08:28:10.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f899f7fe700 1 -- 172.21.15.35:0/316865583 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b4062080 con 0x560d1695eea0 2023-03-17T08:28:10.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f899f7fe700 1 -- 172.21.15.35:0/316865583 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f89b40977a0 con 0x560d1695eea0 2023-03-17T08:28:12.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 10 client.14910 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:28:12.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 10 client.14910 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-17T08:28:12.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 20 client.14910 populate_metadata read hostname 'smithi035' 2023-03-17T08:28:12.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d169cc3a0 0x560d169c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:13.063 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 4 client.14910 mds_command: new command op to 24439 tid=0[{"prefix": "status"}] 2023-03-17T08:28:13.063 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.960+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560d1672ff10 con 0x560d169cc3a0 2023-03-17T08:28:13.063 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f89bffff700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d169cc3a0 0x560d169c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:13.063 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f899f7fe700 10 client.14910 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T08:28:14.231 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f89bffff700 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d169cc3a0 0x560d169c8d10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=335287a3914497b4 server_cookie=ce966a8ab00351a in_seq=0 out_seq=0 2023-03-17T08:28:14.231 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f899f7fe700 1 -- 172.21.15.35:0/316865583 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x560d1672ff10 con 0x560d169cc3a0 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f899f7fe700 10 client.14910 handle_command_reply: tid=0 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f89d2941b80 1 client.14910 shutdown 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 msgr2=0x560d1696a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f89d2941b80 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 0x560d1696a610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89b4097f20 tx=0x7f89b4097e90 comp rx=0 tx=0).stop 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.961+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 shutdown_connections 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x560d169cc3a0 0x560d169c8d10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1695f7f0 0x560d1696d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1695e060 0x560d1696a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:14.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 --2- 172.21.15.35:0/316865583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1695eea0 0x560d1696a610 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:14.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f899f7fe700 0 client.14910 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T08:28:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 >> 172.21.15.35:0/316865583 conn(0x560d16955c00 msgr2=0x560d1696f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 shutdown_connections 2023-03-17T08:28:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 1 -- 172.21.15.35:0/316865583 wait complete. 2023-03-17T08:28:15.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89d2941b80 20 client.14910 trim_cache size 0 max 16384 2023-03-17T08:28:15.481 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:28:15.482 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:28:15.482 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 3, 2023-03-17T08:28:15.482 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24439, 2023-03-17T08:28:16.689 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:28:16.689 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:28:16.689 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:28:16.689 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 772.55355302600003, 2023-03-17T08:28:16.689 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:28:16.689 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:28:17.602 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:28:17.602 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1040.353301012 2023-03-17T08:28:17.602 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:28:17.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f89a809f4d0 msgr2=0x7f89a80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:18.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f89a809f4d0 0x7f89a80a1980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89b0006010 tx=0x7f89b000b260 comp rx=0 tx=0).stop 2023-03-17T08:28:18.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 msgr2=0x7f89c019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:18.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 0x7f89c019aba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f89b400d950 tx=0x7f89b400dc60 comp rx=0 tx=0).stop 2023-03-17T08:28:18.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 shutdown_connections 2023-03-17T08:28:18.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89c0100d50 0x7f89c019d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:20.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89c00ff110 0x7f89c00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:20.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f89a809f4d0 0x7f89a80a1980 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:22.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 --2- 172.21.15.35:0/1011667136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89c01003a0 0x7f89c019aba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:22.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 >> 172.21.15.35:0/1011667136 conn(0x7f89c00fa730 msgr2=0x7f89c00fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:22.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 shutdown_connections 2023-03-17T08:28:23.676 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:27:39.962+0000 7f89c67b4700 1 -- 172.21.15.35:0/1011667136 wait complete. 2023-03-17T08:28:23.677 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-17T08:28:23.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:52 smithi078 ceph-mon[94114]: pgmap v1315: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:24.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:54 smithi078 ceph-mon[94114]: pgmap v1316: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:24.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:56 smithi078 ceph-mon[94114]: pgmap v1317: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:24.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:27:58 smithi078 ceph-mon[94114]: pgmap v1318: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:24.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:00 smithi078 ceph-mon[94114]: pgmap v1319: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:24.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:02 smithi078 ceph-mon[94114]: pgmap v1320: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:24.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:04 smithi078 ceph-mon[94114]: pgmap v1321: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:24.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:28:24.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:24.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:04 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:24.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:26.652 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:26.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:26.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:26.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:28:26.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:28:26.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:27.610 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:06 smithi078 ceph-mon[94114]: pgmap v1322: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:08 smithi078 ceph-mon[94114]: pgmap v1323: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:10 smithi078 ceph-mon[94114]: pgmap v1324: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:12 smithi078 ceph-mon[94114]: pgmap v1325: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:14 smithi078 ceph-mon[94114]: pgmap v1326: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:16 smithi078 ceph-mon[94114]: pgmap v1327: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:18 smithi078 ceph-mon[94114]: pgmap v1328: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:20 smithi078 ceph-mon[94114]: pgmap v1329: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:22 smithi078 ceph-mon[94114]: pgmap v1330: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:52 smithi082 ceph-mon[94281]: pgmap v1315: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:54 smithi082 ceph-mon[94281]: pgmap v1316: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:56 smithi082 ceph-mon[94281]: pgmap v1317: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:27:58 smithi082 ceph-mon[94281]: pgmap v1318: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:00 smithi082 ceph-mon[94281]: pgmap v1319: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:02 smithi082 ceph-mon[94281]: pgmap v1320: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:04 smithi082 ceph-mon[94281]: pgmap v1321: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:04 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:28.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:28:28.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:28:28.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:29.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:28:29.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:28:29.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:06 smithi082 ceph-mon[94281]: pgmap v1322: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:29.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:08 smithi082 ceph-mon[94281]: pgmap v1323: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:29.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:10 smithi082 ceph-mon[94281]: pgmap v1324: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:29.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:12 smithi082 ceph-mon[94281]: pgmap v1325: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:31.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:14 smithi082 ceph-mon[94281]: pgmap v1326: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:31.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:16 smithi082 ceph-mon[94281]: pgmap v1327: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:31.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:18 smithi082 ceph-mon[94281]: pgmap v1328: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:31.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:20 smithi082 ceph-mon[94281]: pgmap v1329: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:31.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:22 smithi082 ceph-mon[94281]: pgmap v1330: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:31.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:40 smithi035 ceph-mon[92535]: pgmap v1309: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:32.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:41 smithi035 ceph-mon[92535]: pgmap v1310: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:32.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:43 smithi035 ceph-mon[92535]: pgmap v1311: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:32.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:46 smithi035 ceph-mon[92535]: pgmap v1312: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:32.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:48 smithi035 ceph-mon[92535]: pgmap v1313: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:32.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:50 smithi035 ceph-mon[92535]: pgmap v1314: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:34.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:52 smithi035 ceph-mon[92535]: pgmap v1315: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:34.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:54 smithi035 ceph-mon[92535]: pgmap v1316: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:34.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:56 smithi035 ceph-mon[92535]: pgmap v1317: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:34.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:27:58 smithi035 ceph-mon[92535]: pgmap v1318: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:34.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:00 smithi035 ceph-mon[92535]: pgmap v1319: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:34.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:02 smithi035 ceph-mon[92535]: pgmap v1320: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:36.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:04 smithi035 ceph-mon[92535]: pgmap v1321: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:36.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:28:36.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:36.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:04 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:36.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:36.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:36.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:36.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:28:36.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:28:36.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:06 smithi035 ceph-mon[92535]: pgmap v1322: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:36.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:08 smithi035 ceph-mon[92535]: pgmap v1323: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:36.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:10 smithi035 ceph-mon[92535]: pgmap v1324: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:36.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:12 smithi035 ceph-mon[92535]: pgmap v1325: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:37.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:14 smithi035 ceph-mon[92535]: pgmap v1326: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:37.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:16 smithi035 ceph-mon[92535]: pgmap v1327: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:18 smithi035 ceph-mon[92535]: pgmap v1328: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:20 smithi035 ceph-mon[92535]: pgmap v1329: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:22 smithi035 ceph-mon[92535]: pgmap v1330: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:24 smithi035 ceph-mon[92535]: pgmap v1331: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:26 smithi035 ceph-mon[92535]: pgmap v1332: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:28 smithi035 ceph-mon[92535]: pgmap v1333: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:37.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:30 smithi035 ceph-mon[92535]: pgmap v1334: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:37.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:24 smithi082 ceph-mon[94281]: pgmap v1331: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:26 smithi082 ceph-mon[94281]: pgmap v1332: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:28 smithi082 ceph-mon[94281]: pgmap v1333: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:30 smithi082 ceph-mon[94281]: pgmap v1334: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:32 smithi082 ceph-mon[94281]: pgmap v1335: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:34 smithi082 ceph-mon[94281]: pgmap v1336: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:35 smithi082 ceph-mon[94281]: pgmap v1337: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:24 smithi078 ceph-mon[94114]: pgmap v1331: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:26 smithi078 ceph-mon[94114]: pgmap v1332: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:28 smithi078 ceph-mon[94114]: pgmap v1333: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:30 smithi078 ceph-mon[94114]: pgmap v1334: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:38.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:32 smithi078 ceph-mon[94114]: pgmap v1335: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:28:40.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:34 smithi078 ceph-mon[94114]: pgmap v1336: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:40.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:35 smithi078 ceph-mon[94114]: pgmap v1337: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:28:40.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:37 smithi082 ceph-mon[94281]: pgmap v1338: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:40.548 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:37 smithi078 ceph-mon[94114]: pgmap v1338: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:28:40.557 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 -- 172.21.15.35:0/1148303533 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe320100d50 msgr2=0x7fe3201075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 --2- 172.21.15.35:0/1148303533 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe320100d50 0x7fe3201075f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe31800b0a0 tx=0x7fe31800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 -- 172.21.15.35:0/1148303533 shutdown_connections 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 --2- 172.21.15.35:0/1148303533 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe320100d50 0x7fe3201075f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 --2- 172.21.15.35:0/1148303533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3200ff110 0x7fe3200ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 --2- 172.21.15.35:0/1148303533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3201003a0 0x7fe320100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 -- 172.21.15.35:0/1148303533 >> 172.21.15.35:0/1148303533 conn(0x7fe3200fa730 msgr2=0x7fe3200fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 -- 172.21.15.35:0/1148303533 shutdown_connections 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.241+0000 7fe326613700 1 -- 172.21.15.35:0/1148303533 wait complete. 2023-03-17T08:28:42.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 Processor -- start 2023-03-17T08:28:43.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 -- start start 2023-03-17T08:28:43.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3200ff110 0x7fe320103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:43.400 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 0x7fe320101780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:43.400 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe320100d50 0x7fe320101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:43.400 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe320102460 con 0x7fe3201003a0 2023-03-17T08:28:43.400 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3201025d0 con 0x7fe3200ff110 2023-03-17T08:28:43.400 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe326613700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32019ffa0 con 0x7fe320100d50 2023-03-17T08:28:43.400 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe317fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 0x7fe320101780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe317fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 0x7fe320101780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40854/0 (socket says 172.21.15.35:40854) 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe317fff700 1 -- 172.21.15.35:0/1114435200 learned_addr learned my addr 172.21.15.35:0/1114435200 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.242+0000 7fe324bb0700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe320100d50 0x7fe320101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe31ffff700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3200ff110 0x7fe320103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe317fff700 1 -- 172.21.15.35:0/1114435200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe320100d50 msgr2=0x7fe320101cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe317fff700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe320100d50 0x7fe320101cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe317fff700 1 -- 172.21.15.35:0/1114435200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3200ff110 msgr2=0x7fe320103140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe317fff700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3200ff110 0x7fe320103140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe317fff700 1 -- 172.21.15.35:0/1114435200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318009d00 con 0x7fe3201003a0 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe317fff700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 0x7fe320101780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c9b0 tx=0x7fe30800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:44.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe31dffb700 1 -- 172.21.15.35:0/1114435200 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308007b00 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe31dffb700 1 -- 172.21.15.35:0/1114435200 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe30800ce50 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32010a9c0 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe31dffb700 1 -- 172.21.15.35:0/1114435200 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308018420 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.243+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32010a830 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.245+0000 7fe31dffb700 1 -- 172.21.15.35:0/1114435200 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fe30800f450 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.246+0000 7fe31dffb700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe30c09f550 0x7fe30c0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.246+0000 7fe31ffff700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe30c09f550 0x7fe30c0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.246+0000 7fe31dffb700 1 -- 172.21.15.35:0/1114435200 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe3080ca0b0 con 0x7fe3201003a0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.246+0000 7fe31ffff700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe30c09f550 0x7fe30c0a1a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe310005950 tx=0x7fe31000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 Processor -- start 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 -- start start 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b466249ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b46624a3e0 0x55b466248670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662490c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46614f020 con 0x55b466249a90 2023-03-17T08:28:44.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4661a1960 con 0x55b46624a3e0 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46619adf0 con 0x55b466248c50 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b466249ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b466249ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40860/0 (socket says 172.21.15.35:40860) 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 -- 172.21.15.35:0/2710731596 learned_addr learned my addr 172.21.15.35:0/2710731596 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe317fff700 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b46624a3e0 0x55b466248670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe324bb0700 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 -- 172.21.15.35:0/2710731596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 msgr2=0x55b4662490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 -- 172.21.15.35:0/2710731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b46624a3e0 msgr2=0x55b466248670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b46624a3e0 0x55b466248670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe31ffff700 1 -- 172.21.15.35:0/2710731596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b46601c5e0 con 0x55b466249a90 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.247+0000 7fe324bb0700 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe31ffff700 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b466249ea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe310010fa0 tx=0x7fe310013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ccf9b8cf0a980a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3167fc700 1 -- 172.21.15.35:0/2710731596 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31001e620 con 0x55b466249a90 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3167fc700 1 -- 172.21.15.35:0/2710731596 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe310015070 con 0x55b466249a90 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3167fc700 1 -- 172.21.15.35:0/2710731596 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31001c8b0 con 0x55b466249a90 2023-03-17T08:28:44.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 -- 172.21.15.35:0/2710731596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 msgr2=0x55b466249ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b466249ea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe310010fa0 tx=0x7fe310013000 comp rx=0 tx=0).stop 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 -- 172.21.15.35:0/2710731596 shutdown_connections 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b466249ea0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/2710731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b46624a3e0 0x55b466248670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 -- 172.21.15.35:0/2710731596 >> 172.21.15.35:0/2710731596 conn(0x55b466244c00 msgr2=0x55b466242fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.248+0000 7fe3327a0b80 1 -- 172.21.15.35:0/2710731596 shutdown_connections 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 -- 172.21.15.35:0/2710731596 wait complete. 2023-03-17T08:28:44.812 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 -- start start 2023-03-17T08:28:46.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 Processor -- start 2023-03-17T08:28:46.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b466252450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b466252990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46601e8d0 con 0x55b46624a3e0 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b466259f10 con 0x55b466249a90 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46625a0a0 con 0x55b466248c50 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe3327a0b80 10 client.0 _ll_register_callbacks cb 0x55b466040240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe324bb0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:46.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe324bb0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40870/0 (socket says 172.21.15.35:40870) 2023-03-17T08:28:46.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.249+0000 7fe324bb0700 1 -- 172.21.15.35:0/3630534543 learned_addr learned my addr 172.21.15.35:0/3630534543 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:46.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe31ffff700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b466252450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:46.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe317fff700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b466252990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe324bb0700 1 -- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 msgr2=0x55b466252450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe324bb0700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b466252450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe324bb0700 1 -- 172.21.15.35:0/3630534543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 msgr2=0x55b466252990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe324bb0700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b466252990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe324bb0700 1 -- 172.21.15.35:0/3630534543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe310010c50 con 0x55b46624a3e0 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe317fff700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b466252990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe324bb0700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662599d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe318015000 tx=0x7fe318009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfc1da84e108bdd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe2ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/3630534543 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800e040 con 0x55b46624a3e0 2023-03-17T08:28:48.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/3630534543 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe318003c10 con 0x55b46624a3e0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b46615d3a0 con 0x55b46624a3e0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/3630534543 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe318003dd0 con 0x55b46624a3e0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe3327a0b80 10 client.14922 fetch_fsmap learned FSMap version 29 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b465fc8d90 con 0x55b46624a3e0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.250+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/3630534543 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b46615d3a0 con 0x55b46624a3e0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/3630534543 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe318019070 con 0x55b46624a3e0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe3327a0b80 10 client.14922 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe3327a0b80 10 client.14922 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe3327a0b80 20 client.14922 populate_metadata read hostname 'smithi035' 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b46625d8c0 0x55b46625cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe3327a0b80 4 client.14922 mds_command: new command op to 24445 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b466169610 con 0x55b46625d8c0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe31ffff700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b46625d8c0 0x55b46625cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe2ff7fe700 10 client.14922 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T08:28:48.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.251+0000 7fe31ffff700 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b46625d8c0 0x55b46625cc70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb975e9b0f2e6d99 server_cookie=46c7be54ac239120 in_seq=0 out_seq=0 2023-03-17T08:28:48.622 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/3630534543 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b466169610 con 0x55b46625d8c0 2023-03-17T08:28:49.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe2ff7fe700 10 client.14922 handle_command_reply: tid=0 2023-03-17T08:28:49.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 client.14922 shutdown 2023-03-17T08:28:50.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 msgr2=0x55b4662599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:50.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662599d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe318015000 tx=0x7fe318009440 comp rx=0 tx=0).stop 2023-03-17T08:28:50.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 shutdown_connections 2023-03-17T08:28:50.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b46625d8c0 0x55b46625cc70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:50.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662599d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:50.954 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe2ff7fe700 0 client.14922 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b466252450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/3630534543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b466252990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 >> 172.21.15.35:0/3630534543 conn(0x55b466244c00 msgr2=0x55b4662426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 shutdown_connections 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.252+0000 7fe3327a0b80 1 -- 172.21.15.35:0/3630534543 wait complete. 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.253+0000 7fe3327a0b80 20 client.14922 trim_cache size 0 max 16384 2023-03-17T08:28:50.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 Processor -- start 2023-03-17T08:28:50.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 -- start start 2023-03-17T08:28:50.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466248c50 0x55b466248590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:50.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b4662598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:50.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46624a3e0 0x55b46625a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:50.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b466168e40 con 0x55b466249a90 2023-03-17T08:28:50.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46615cba0 con 0x55b466248c50 2023-03-17T08:28:52.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b466136bf0 con 0x55b46624a3e0 2023-03-17T08:28:52.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b4662598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:52.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b4662598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40876/0 (socket says 172.21.15.35:40876) 2023-03-17T08:28:52.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 -- 172.21.15.35:0/174572016 learned_addr learned my addr 172.21.15.35:0/174572016 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe31ffff700 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466248c50 0x55b466248590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe324bb0700 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46624a3e0 0x55b46625a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 -- 172.21.15.35:0/174572016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46624a3e0 msgr2=0x55b46625a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46624a3e0 0x55b46625a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 -- 172.21.15.35:0/174572016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466248c50 msgr2=0x55b466248590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466248c50 0x55b466248590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:52.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe317fff700 1 -- 172.21.15.35:0/174572016 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b46623fa00 con 0x55b466249a90 2023-03-17T08:28:54.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.271+0000 7fe324bb0700 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46624a3e0 0x55b46625a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:28:54.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe317fff700 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b4662598f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe308097df0 tx=0x7fe308097aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670d36fe8cf7d304 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:54.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe316ffd700 1 -- 172.21.15.35:0/174572016 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308007c60 con 0x55b466249a90 2023-03-17T08:28:54.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe316ffd700 1 -- 172.21.15.35:0/174572016 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3080af070 con 0x55b466249a90 2023-03-17T08:28:54.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe316ffd700 1 -- 172.21.15.35:0/174572016 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308097350 con 0x55b466249a90 2023-03-17T08:28:54.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 -- 172.21.15.35:0/174572016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 msgr2=0x55b4662598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:54.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b4662598f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe308097df0 tx=0x7fe308097aa0 comp rx=0 tx=0).stop 2023-03-17T08:28:55.498 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 -- 172.21.15.35:0/174572016 shutdown_connections 2023-03-17T08:28:55.498 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b46624a3e0 0x55b46625a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:55.498 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466248c50 0x55b466248590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:55.498 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/174572016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b466249a90 0x55b4662598f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:56.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 -- 172.21.15.35:0/174572016 >> 172.21.15.35:0/174572016 conn(0x55b466244c00 msgr2=0x55b466249020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:56.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 -- 172.21.15.35:0/174572016 shutdown_connections 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.272+0000 7fe3327a0b80 1 -- 172.21.15.35:0/174572016 wait complete. 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 -- start start 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 Processor -- start 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b4662af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4662b2390 con 0x55b46624a3e0 2023-03-17T08:28:56.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4662b2500 con 0x55b466249a90 2023-03-17T08:28:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4662b26c0 con 0x55b466248c50 2023-03-17T08:28:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe3327a0b80 10 client.0 _ll_register_callbacks cb 0x55b466040240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe324bb0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe324bb0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40884/0 (socket says 172.21.15.35:40884) 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe324bb0700 1 -- 172.21.15.35:0/4077830657 learned_addr learned my addr 172.21.15.35:0/4077830657 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe31ffff700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe317fff700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b4662af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe324bb0700 1 -- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 msgr2=0x55b4662578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.273+0000 7fe324bb0700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:58.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe324bb0700 1 -- 172.21.15.35:0/4077830657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 msgr2=0x55b4662af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe324bb0700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b4662af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe324bb0700 1 -- 172.21.15.35:0/4077830657 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32010a830 con 0x55b46624a3e0 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe324bb0700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662b1c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe318009a20 tx=0x7fe31801b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45f8b6dc7fb0221 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe2ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/4077830657 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800e020 con 0x55b46624a3e0 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4662181f0 con 0x55b46624a3e0 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/4077830657 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fe3180056d0 con 0x55b46624a3e0 2023-03-17T08:28:59.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/4077830657 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe318005300 con 0x55b46624a3e0 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 10 client.14928 fetch_fsmap learned FSMap version 29 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b465fb1c10 con 0x55b46624a3e0 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/4077830657 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b4662181f0 con 0x55b46624a3e0 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/4077830657 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe31800b4d0 con 0x55b46624a3e0 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 10 client.14928 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 10 client.14928 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 20 client.14928 populate_metadata read hostname 'smithi035' 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b4662b7110 0x55b4662b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 4 client.14928 mds_command: new command op to 24445 tid=0[{"prefix": "status"}] 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.274+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b46601ef10 con 0x55b4662b7110 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe31ffff700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b4662b7110 0x55b4662b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe2ff7fe700 10 client.14928 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe31ffff700 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b4662b7110 0x55b4662b3ac0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=106007705f910a78 server_cookie=e8835532ea937a61 in_seq=0 out_seq=0 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe2ff7fe700 1 -- 172.21.15.35:0/4077830657 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b46601ef10 con 0x55b4662b7110 2023-03-17T08:28:59.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe2ff7fe700 10 client.14928 handle_command_reply: tid=0 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 client.14928 shutdown 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 msgr2=0x55b4662b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662b1c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe318009a20 tx=0x7fe31801b3a0 comp rx=0 tx=0).stop 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 shutdown_connections 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55b4662b7110 0x55b4662b3ac0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b46624a3e0 0x55b4662b1c80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b466248c50 0x55b4662578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 --2- 172.21.15.35:0/4077830657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b466249a90 0x55b4662af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe2ff7fe700 0 client.14928 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.275+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 >> 172.21.15.35:0/4077830657 conn(0x55b466244c00 msgr2=0x55b46625a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 shutdown_connections 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe3327a0b80 1 -- 172.21.15.35:0/4077830657 wait complete. 2023-03-17T08:28:59.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe3327a0b80 20 client.14928 trim_cache size 0 max 16384 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 2, 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24445, 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:28:59.907 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:29:01.804 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 824.87711660800005, 2023-03-17T08:29:01.804 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:29:01.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:29:01.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:29:01.805 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1089.3933088250001 2023-03-17T08:29:01.805 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:29:01.807 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe30c09f550 msgr2=0x7fe30c0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:04.245 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe30c09f550 0x7fe30c0a1a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe310005950 tx=0x7fe31000b410 comp rx=0 tx=0).stop 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 msgr2=0x7fe320101780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 0x7fe320101780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c9b0 tx=0x7fe30800ccc0 comp rx=0 tx=0).stop 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 shutdown_connections 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe320100d50 0x7fe320101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3200ff110 0x7fe320103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fe30c09f550 0x7fe30c0a1a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 --2- 172.21.15.35:0/1114435200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3201003a0 0x7fe320101780 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 >> 172.21.15.35:0/1114435200 conn(0x7fe3200fa730 msgr2=0x7fe320067d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 shutdown_connections 2023-03-17T08:29:04.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:28:31.276+0000 7fe326613700 1 -- 172.21.15.35:0/1114435200 wait complete. 2023-03-17T08:29:04.247 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-03-17T08:29:04.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:40 smithi078 ceph-mon[94114]: pgmap v1339: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:05.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:42 smithi078 ceph-mon[94114]: pgmap v1340: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:05.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:44 smithi078 ceph-mon[94114]: pgmap v1341: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:05.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:46 smithi078 ceph-mon[94114]: pgmap v1342: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:05.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:48 smithi078 ceph-mon[94114]: pgmap v1343: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:05.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:50 smithi078 ceph-mon[94114]: pgmap v1344: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:05.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:52 smithi078 ceph-mon[94114]: pgmap v1345: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:54 smithi078 ceph-mon[94114]: pgmap v1346: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:56 smithi078 ceph-mon[94114]: pgmap v1347: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:28:58 smithi078 ceph-mon[94114]: pgmap v1348: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:00 smithi078 ceph-mon[94114]: pgmap v1349: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:02 smithi078 ceph-mon[94114]: pgmap v1350: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:40 smithi082 ceph-mon[94281]: pgmap v1339: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:42 smithi082 ceph-mon[94281]: pgmap v1340: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:06.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:44 smithi082 ceph-mon[94281]: pgmap v1341: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:06.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:46 smithi082 ceph-mon[94281]: pgmap v1342: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:06.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:48 smithi082 ceph-mon[94281]: pgmap v1343: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:07.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:50 smithi082 ceph-mon[94281]: pgmap v1344: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:07.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:52 smithi082 ceph-mon[94281]: pgmap v1345: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:07.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:54 smithi082 ceph-mon[94281]: pgmap v1346: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:07.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:56 smithi082 ceph-mon[94281]: pgmap v1347: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:07.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:28:58 smithi082 ceph-mon[94281]: pgmap v1348: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:07.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:00 smithi082 ceph-mon[94281]: pgmap v1349: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:07.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:02 smithi082 ceph-mon[94281]: pgmap v1350: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:32 smithi035 ceph-mon[92535]: pgmap v1335: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:34 smithi035 ceph-mon[92535]: pgmap v1336: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:35 smithi035 ceph-mon[92535]: pgmap v1337: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:37 smithi035 ceph-mon[92535]: pgmap v1338: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:40 smithi035 ceph-mon[92535]: pgmap v1339: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:42 smithi035 ceph-mon[92535]: pgmap v1340: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:09.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:44 smithi035 ceph-mon[92535]: pgmap v1341: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:46 smithi035 ceph-mon[92535]: pgmap v1342: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:48 smithi035 ceph-mon[92535]: pgmap v1343: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:50 smithi035 ceph-mon[92535]: pgmap v1344: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:52 smithi035 ceph-mon[92535]: pgmap v1345: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:54 smithi035 ceph-mon[92535]: pgmap v1346: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:56 smithi035 ceph-mon[92535]: pgmap v1347: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:09.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:28:58 smithi035 ceph-mon[92535]: pgmap v1348: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:10.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:00 smithi035 ceph-mon[92535]: pgmap v1349: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:10.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:02 smithi035 ceph-mon[92535]: pgmap v1350: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:10.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:04 smithi035 ceph-mon[92535]: pgmap v1351: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:10.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:05 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:06 smithi035 ceph-mon[92535]: pgmap v1352: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:29:10.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:08 smithi035 ceph-mon[92535]: pgmap v1353: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:10.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:04 smithi082 ceph-mon[94281]: pgmap v1351: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:10.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:29:10.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:10.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:05 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:06 smithi082 ceph-mon[94281]: pgmap v1352: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:29:11.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:29:12.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:29:12.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:29:12.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:08 smithi082 ceph-mon[94281]: pgmap v1353: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:12.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:04 smithi078 ceph-mon[94114]: pgmap v1351: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:12.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:29:12.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:12.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:05 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:06 smithi078 ceph-mon[94114]: pgmap v1352: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:29:13.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:29:14.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:08 smithi078 ceph-mon[94114]: pgmap v1353: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:14.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:10 smithi082 ceph-mon[94281]: pgmap v1354: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:14.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:12 smithi082 ceph-mon[94281]: pgmap v1355: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:14.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:10 smithi078 ceph-mon[94114]: pgmap v1354: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:14.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:12 smithi078 ceph-mon[94114]: pgmap v1355: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:14.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 -- 172.21.15.35:0/4203937045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc1003a0 msgr2=0x7f15fc100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:15.768 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 --2- 172.21.15.35:0/4203937045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc1003a0 0x7f15fc100810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009990 tx=0x7f15f0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:29:15.768 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 -- 172.21.15.35:0/4203937045 shutdown_connections 2023-03-17T08:29:15.768 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 --2- 172.21.15.35:0/4203937045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc100d50 0x7f15fc1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 --2- 172.21.15.35:0/4203937045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15fc0ff110 0x7f15fc0ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 --2- 172.21.15.35:0/4203937045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc1003a0 0x7f15fc100810 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 -- 172.21.15.35:0/4203937045 >> 172.21.15.35:0/4203937045 conn(0x7f15fc0fa730 msgr2=0x7f15fc0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 -- 172.21.15.35:0/4203937045 shutdown_connections 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.281+0000 7f1602a17700 1 -- 172.21.15.35:0/4203937045 wait complete. 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.282+0000 7f1602a17700 1 Processor -- start 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.282+0000 7f1602a17700 1 -- start start 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1602a17700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15fc0ff110 0x7f15fc0688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1602a17700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1003a0 0x7f15fc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1602a17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 0x7f15fc19d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:15.769 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1602a17700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc19d960 con 0x7f15fc100d50 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1602a17700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc19dad0 con 0x7f15fc0ff110 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1602a17700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc19dc90 con 0x7f15fc1003a0 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 0x7f15fc19d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 0x7f15fc19d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40900/0 (socket says 172.21.15.35:40900) 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 -- 172.21.15.35:0/612410260 learned_addr learned my addr 172.21.15.35:0/612410260 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f15fbfff700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15fc0ff110 0x7f15fc0688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1003a0 0x7f15fc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 -- 172.21.15.35:0/612410260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1003a0 msgr2=0x7f15fc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1003a0 0x7f15fc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 -- 172.21.15.35:0/612410260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15fc0ff110 msgr2=0x7f15fc0688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15fc0ff110 0x7f15fc0688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 -- 172.21.15.35:0/612410260 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00095f0 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1003a0 0x7f15fc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.283+0000 7f1600fb4700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 0x7f15fc19d1c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15f400ef30 tx=0x7f15f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.284+0000 7f15f97fa700 1 -- 172.21.15.35:0/612410260 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4018070 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.284+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc10a9b0 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.284+0000 7f15f97fa700 1 -- 172.21.15.35:0/612410260 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15f400f040 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.284+0000 7f15f97fa700 1 -- 172.21.15.35:0/612410260 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400cc70 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.284+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc10a820 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.286+0000 7f15f97fa700 1 -- 172.21.15.35:0/612410260 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f15f4007500 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.287+0000 7f15f97fa700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f15e409f4d0 0x7f15e40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.287+0000 7f15fbfff700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f15e409f4d0 0x7f15e40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.287+0000 7f15f97fa700 1 -- 172.21.15.35:0/612410260 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f15f40c9d50 con 0x7f15fc100d50 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 Processor -- start 2023-03-17T08:29:16.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f15fbfff700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f15e409f4d0 0x7f15e40a1980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00ac50 tx=0x7f15ec00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 -- start start 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56cda90 0x55cfc56cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc55d3020 con 0x55cfc56ccc50 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc5625960 con 0x55cfc56ce3e0 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f160eba4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc561edf0 con 0x55cfc56cda90 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40908/0 (socket says 172.21.15.35:40908) 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 -- 172.21.15.35:0/2620709039 learned_addr learned my addr 172.21.15.35:0/2620709039 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f15fbfff700 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56cda90 0x55cfc56cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:16.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 -- 172.21.15.35:0/2620709039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56cda90 msgr2=0x55cfc56cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56cda90 0x55cfc56cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 -- 172.21.15.35:0/2620709039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 msgr2=0x55cfc56cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 -- 172.21.15.35:0/2620709039 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfc54a05e0 con 0x55cfc56ccc50 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.288+0000 7f1600fb4700 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56cd0c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f15f40090a0 tx=0x7f15f4097840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add6cc4d2aa534c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:17.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f15e27fc700 1 -- 172.21.15.35:0/2620709039 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f409b070 con 0x55cfc56ccc50 2023-03-17T08:29:17.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f15e27fc700 1 -- 172.21.15.35:0/2620709039 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15f409fd90 con 0x55cfc56ccc50 2023-03-17T08:29:17.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f15e27fc700 1 -- 172.21.15.35:0/2620709039 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4097360 con 0x55cfc56ccc50 2023-03-17T08:29:17.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 -- 172.21.15.35:0/2620709039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 msgr2=0x55cfc56cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:19.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56cd0c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f15f40090a0 tx=0x7f15f4097840 comp rx=0 tx=0).stop 2023-03-17T08:29:19.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 -- 172.21.15.35:0/2620709039 shutdown_connections 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56cd0c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56cda90 0x55cfc56cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2620709039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 -- 172.21.15.35:0/2620709039 >> 172.21.15.35:0/2620709039 conn(0x55cfc56c8c00 msgr2=0x55cfc56c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 -- 172.21.15.35:0/2620709039 shutdown_connections 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.289+0000 7f160eba4b80 1 -- 172.21.15.35:0/2620709039 wait complete. 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 -- start start 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 Processor -- start 2023-03-17T08:29:19.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56d6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ce3e0 0x55cfc56dd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc54a28d0 con 0x55cfc56ccc50 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc56ddf10 con 0x55cfc56cda90 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc56de0a0 con 0x55cfc56ce3e0 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f160eba4b80 10 client.0 _ll_register_callbacks cb 0x55cfc54c4240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:29:19.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f15fbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56d6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:19.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f15fbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56d6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40910/0 (socket says 172.21.15.35:40910) 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.290+0000 7f15fbfff700 1 -- 172.21.15.35:0/985589915 learned_addr learned my addr 172.21.15.35:0/985589915 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f1600fb4700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ce3e0 0x55cfc56dd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fbfff700 1 -- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ce3e0 msgr2=0x55cfc56dd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fbfff700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ce3e0 0x55cfc56dd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fbfff700 1 -- 172.21.15.35:0/985589915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 msgr2=0x55cfc56d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:19.855 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fbfff700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:19.856 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fbfff700 1 -- 172.21.15.35:0/985589915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc10a820 con 0x55cfc56ccc50 2023-03-17T08:29:19.856 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:29:21.186 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f1600fb4700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ce3e0 0x55cfc56dd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:29:21.186 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15fbfff700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56d6450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f15ec003680 tx=0x7f15ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4476e1c0a176ee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:21.186 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15db7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:29:21.186 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15db7fe700 1 -- 172.21.15.35:0/985589915 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec010840 con 0x55cfc56ccc50 2023-03-17T08:29:21.186 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15db7fe700 1 -- 172.21.15.35:0/985589915 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f15ec0109a0 con 0x55cfc56ccc50 2023-03-17T08:29:21.186 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfc55e13a0 con 0x55cfc56ccc50 2023-03-17T08:29:21.897 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15db7fe700 1 -- 172.21.15.35:0/985589915 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15ec010b60 con 0x55cfc56ccc50 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f160eba4b80 10 client.14940 fetch_fsmap learned FSMap version 29 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55cfc544cd90 con 0x55cfc56ccc50 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.291+0000 7f15db7fe700 1 -- 172.21.15.35:0/985589915 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cfc55e13a0 con 0x55cfc56ccc50 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f15db7fe700 1 -- 172.21.15.35:0/985589915 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f15ec01ed20 con 0x55cfc56ccc50 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f160eba4b80 10 client.14940 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f160eba4b80 10 client.14940 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f160eba4b80 20 client.14940 populate_metadata read hostname 'smithi035' 2023-03-17T08:29:21.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f160eba4b80 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc56e1980 0x55cfc56e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:21.899 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f160eba4b80 4 client.14940 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:29:21.899 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfc55ed610 con 0x55cfc56e1980 2023-03-17T08:29:23.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc56e1980 0x55cfc56e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:24.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f15db7fe700 10 client.14940 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T08:29:24.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.292+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc56e1980 0x55cfc56e0db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=510d440237a40850 server_cookie=8f9fc6f2c7003a1c in_seq=0 out_seq=0 2023-03-17T08:29:24.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f15db7fe700 1 -- 172.21.15.35:0/985589915 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55cfc55ed610 con 0x55cfc56e1980 2023-03-17T08:29:24.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f15db7fe700 10 client.14940 handle_command_reply: tid=0 2023-03-17T08:29:24.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 client.14940 shutdown 2023-03-17T08:29:24.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 msgr2=0x55cfc56d6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:24.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56d6450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f15ec003680 tx=0x7f15ec0047c0 comp rx=0 tx=0).stop 2023-03-17T08:29:24.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 shutdown_connections 2023-03-17T08:29:24.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ce3e0 0x55cfc56dd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:24.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc56e1980 0x55cfc56e0db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:24.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ccc50 0x55cfc56d6450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 --2- 172.21.15.35:0/985589915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f15db7fe700 0 client.14940 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 >> 172.21.15.35:0/985589915 conn(0x55cfc56c8c00 msgr2=0x55cfc56c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 shutdown_connections 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 1 -- 172.21.15.35:0/985589915 wait complete. 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.293+0000 7f160eba4b80 20 client.14940 trim_cache size 0 max 16384 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.311+0000 7f160eba4b80 1 Processor -- start 2023-03-17T08:29:25.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.311+0000 7f160eba4b80 1 -- start start 2023-03-17T08:29:25.807 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.311+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56de420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:26.401 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.311+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 0x55cfc56dd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:26.401 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:26.401 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f160eba4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc55e13a0 con 0x55cfc56cda90 2023-03-17T08:29:28.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f160eba4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc56cd730 con 0x55cfc56ce3e0 2023-03-17T08:29:28.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f160eba4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc55c8730 con 0x55cfc56ccc50 2023-03-17T08:29:29.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 0x55cfc56dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:29.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 0x55cfc56dd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40920/0 (socket says 172.21.15.35:40920) 2023-03-17T08:29:30.147 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 -- 172.21.15.35:0/3375862551 learned_addr learned my addr 172.21.15.35:0/3375862551 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:30.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fbfff700 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56de420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:31.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 -- 172.21.15.35:0/3375862551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 msgr2=0x55cfc56de420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:31.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56de420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:31.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 -- 172.21.15.35:0/3375862551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 msgr2=0x55cfc56e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:31.300 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:32.923 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 -- 172.21.15.35:0/3375862551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfc55e5140 con 0x55cfc56cda90 2023-03-17T08:29:32.923 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 0x55cfc56dd990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005910 tx=0x7f15f0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92791b3e50298db server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:32.923 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15e2ffd700 1 -- 172.21.15.35:0/3375862551 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f002b030 con 0x55cfc56cda90 2023-03-17T08:29:32.923 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15e2ffd700 1 -- 172.21.15.35:0/3375862551 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15f0026e70 con 0x55cfc56cda90 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.312+0000 7f15e2ffd700 1 -- 172.21.15.35:0/3375862551 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0003bd0 con 0x55cfc56cda90 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 -- 172.21.15.35:0/3375862551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 msgr2=0x55cfc56dd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 0x55cfc56dd990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f15f0005910 tx=0x7f15f0004260 comp rx=0 tx=0).stop 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 -- 172.21.15.35:0/3375862551 shutdown_connections 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56ce3e0 0x55cfc56e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56de420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 --2- 172.21.15.35:0/3375862551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56cda90 0x55cfc56dd990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 -- 172.21.15.35:0/3375862551 >> 172.21.15.35:0/3375862551 conn(0x55cfc56c8c00 msgr2=0x55cfc56cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 -- 172.21.15.35:0/3375862551 shutdown_connections 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 -- 172.21.15.35:0/3375862551 wait complete. 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 -- start start 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.313+0000 7f160eba4b80 1 Processor -- start 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56d8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:32.924 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:32.925 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 0x55cfc5735820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc56d9490 con 0x55cfc56ce3e0 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc5735d60 con 0x55cfc56cda90 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfc5735f20 con 0x55cfc56ccc50 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 10 client.0 _ll_register_callbacks cb 0x55cfc54c4240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 0x55cfc5735820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 0x55cfc5735820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40928/0 (socket says 172.21.15.35:40928) 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 -- 172.21.15.35:0/2577886529 learned_addr learned my addr 172.21.15.35:0/2577886529 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f15fbfff700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56d8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f15fb7fe700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:33.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 -- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 msgr2=0x55cfc56d8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56d8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 -- 172.21.15.35:0/2577886529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 msgr2=0x55cfc56d8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 -- 172.21.15.35:0/2577886529 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f0020040 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f1600fb4700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 0x55cfc5735820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f15f409f860 tx=0x7f15f4097770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c2e52ae59c4bf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f15db7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f15db7fe700 1 -- 172.21.15.35:0/2577886529 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f409b040 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f15db7fe700 1 -- 172.21.15.35:0/2577886529 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f15f409fd90 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.314+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfc569c1f0 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f15db7fe700 1 -- 172.21.15.35:0/2577886529 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f4095fd0 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 10 client.14946 fetch_fsmap learned FSMap version 29 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55cfc5473200 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f15db7fe700 1 -- 172.21.15.35:0/2577886529 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15f4064020 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f15db7fe700 1 -- 172.21.15.35:0/2577886529 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f15f4096b90 con 0x55cfc56ce3e0 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 10 client.14946 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 10 client.14946 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 20 client.14946 populate_metadata read hostname 'smithi035' 2023-03-17T08:29:33.652 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc573a960 0x55cfc5737310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:33.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 4 client.14946 mds_command: new command op to 24451 tid=0[{"prefix": "status"}] 2023-03-17T08:29:33.653 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cfc54a2f10 con 0x55cfc573a960 2023-03-17T08:29:34.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.315+0000 7f15fbfff700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc573a960 0x55cfc5737310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:34.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f15db7fe700 10 client.14946 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f15fbfff700 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc573a960 0x55cfc5737310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=523420df6fe53a06 server_cookie=421069707eb45662 in_seq=0 out_seq=0 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f15db7fe700 1 -- 172.21.15.35:0/2577886529 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cfc54a2f10 con 0x55cfc573a960 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f15db7fe700 10 client.14946 handle_command_reply: tid=0 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 client.14946 shutdown 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 msgr2=0x55cfc5735820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 0x55cfc5735820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f15f409f860 tx=0x7f15f4097770 comp rx=0 tx=0).stop 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 shutdown_connections 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55cfc573a960 0x55cfc5737310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cfc56ce3e0 0x55cfc5735820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:34.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f15db7fe700 0 client.14946 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T08:29:34.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfc56ccc50 0x55cfc56d8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:34.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 --2- 172.21.15.35:0/2577886529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfc56cda90 0x55cfc56d8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:35.958 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 >> 172.21.15.35:0/2577886529 conn(0x55cfc56c8c00 msgr2=0x55cfc56e0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:35.959 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 shutdown_connections 2023-03-17T08:29:35.959 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 1 -- 172.21.15.35:0/2577886529 wait complete. 2023-03-17T08:29:35.959 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.316+0000 7f160eba4b80 20 client.14946 trim_cache size 0 max 16384 2023-03-17T08:29:36.971 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:29:36.971 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 1, 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24451, 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 863.92167552700005, 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1122.8562119789999 2023-03-17T08:29:36.972 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:29:36.974 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f15e409f4d0 msgr2=0x7f15e40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f15e409f4d0 0x7f15e40a1980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00ac50 tx=0x7f15ec00a380 comp rx=0 tx=0).stop 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 msgr2=0x7f15fc19d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 0x7f15fc19d1c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15f400ef30 tx=0x7f15f400c3a0 comp rx=0 tx=0).stop 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 shutdown_connections 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f15e409f4d0 0x7f15e40a1980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f15fc100d50 0x7f15fc19d1c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:38.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15fc0ff110 0x7f15fc0688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:38.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 --2- 172.21.15.35:0/612410260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15fc1003a0 0x7f15fc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:38.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 >> 172.21.15.35:0/612410260 conn(0x7f15fc0fa730 msgr2=0x7f15fc0fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:38.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 shutdown_connections 2023-03-17T08:29:38.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:09.317+0000 7f1602a17700 1 -- 172.21.15.35:0/612410260 wait complete. 2023-03-17T08:29:38.747 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-17T08:29:38.749 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:14 smithi078 ceph-mon[94114]: pgmap v1356: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:38.749 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:16 smithi078 ceph-mon[94114]: pgmap v1357: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:41.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:18 smithi078 ceph-mon[94114]: pgmap v1358: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:20 smithi078 ceph-mon[94114]: pgmap v1359: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:22 smithi078 ceph-mon[94114]: pgmap v1360: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:24 smithi078 ceph-mon[94114]: pgmap v1361: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:25 smithi078 ceph-mon[94114]: pgmap v1362: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:27 smithi078 ceph-mon[94114]: pgmap v1363: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:30 smithi078 ceph-mon[94114]: pgmap v1364: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:32 smithi078 ceph-mon[94114]: pgmap v1365: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:34 smithi078 ceph-mon[94114]: pgmap v1366: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:36 smithi078 ceph-mon[94114]: pgmap v1367: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:14 smithi082 ceph-mon[94281]: pgmap v1356: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:16 smithi082 ceph-mon[94281]: pgmap v1357: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:18 smithi082 ceph-mon[94281]: pgmap v1358: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:20 smithi082 ceph-mon[94281]: pgmap v1359: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:22 smithi082 ceph-mon[94281]: pgmap v1360: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:24 smithi082 ceph-mon[94281]: pgmap v1361: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:25 smithi082 ceph-mon[94281]: pgmap v1362: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:27 smithi082 ceph-mon[94281]: pgmap v1363: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:30 smithi082 ceph-mon[94281]: pgmap v1364: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:32 smithi082 ceph-mon[94281]: pgmap v1365: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:34 smithi082 ceph-mon[94281]: pgmap v1366: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:41.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:36 smithi082 ceph-mon[94281]: pgmap v1367: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:41.132 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:10 smithi035 ceph-mon[92535]: pgmap v1354: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:42.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:12 smithi035 ceph-mon[92535]: pgmap v1355: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:42.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:14 smithi035 ceph-mon[92535]: pgmap v1356: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:42.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:16 smithi035 ceph-mon[92535]: pgmap v1357: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:42.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:18 smithi035 ceph-mon[92535]: pgmap v1358: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:42.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:20 smithi035 ceph-mon[92535]: pgmap v1359: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:42.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:22 smithi035 ceph-mon[92535]: pgmap v1360: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:42.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:24 smithi035 ceph-mon[92535]: pgmap v1361: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:42.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:25 smithi035 ceph-mon[92535]: pgmap v1362: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:43.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:27 smithi035 ceph-mon[92535]: pgmap v1363: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:43.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:30 smithi035 ceph-mon[92535]: pgmap v1364: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:43.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:32 smithi035 ceph-mon[92535]: pgmap v1365: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:43.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:34 smithi035 ceph-mon[92535]: pgmap v1366: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:43.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:36 smithi035 ceph-mon[92535]: pgmap v1367: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:29:43.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:38 smithi035 ceph-mon[92535]: pgmap v1368: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:43.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:40 smithi035 ceph-mon[92535]: pgmap v1369: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:43.559 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:38 smithi082 ceph-mon[94281]: pgmap v1368: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:44.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:40 smithi082 ceph-mon[94281]: pgmap v1369: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:44.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:42 smithi082 ceph-mon[94281]: pgmap v1370: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:44.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:38 smithi078 ceph-mon[94114]: pgmap v1368: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:44.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:40 smithi078 ceph-mon[94114]: pgmap v1369: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:29:44.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:42 smithi078 ceph-mon[94114]: pgmap v1370: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:29:44.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 -- 172.21.15.35:0/186402622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 msgr2=0x7f4a28100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:46.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 --2- 172.21.15.35:0/186402622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28100770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009990 tx=0x7f4a1c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:29:46.049 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 -- 172.21.15.35:0/186402622 shutdown_connections 2023-03-17T08:29:47.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 --2- 172.21.15.35:0/186402622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a28100cb0 0x7f4a28107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:47.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 --2- 172.21.15.35:0/186402622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a280ff130 0x7f4a280ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:47.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 --2- 172.21.15.35:0/186402622 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28100770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:47.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 -- 172.21.15.35:0/186402622 >> 172.21.15.35:0/186402622 conn(0x7f4a280fa750 msgr2=0x7f4a280fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:47.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 -- 172.21.15.35:0/186402622 shutdown_connections 2023-03-17T08:29:47.965 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.270+0000 7f4a2d542700 1 -- 172.21.15.35:0/186402622 wait complete. 2023-03-17T08:29:47.965 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 Processor -- start 2023-03-17T08:29:47.965 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 -- start start 2023-03-17T08:29:47.965 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280ff130 0x7f4a28198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a28100cb0 0x7f4a2819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2819fbd0 con 0x7f4a28100320 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.271+0000 7f4a2d542700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2819fd10 con 0x7f4a280ff130 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a2d542700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2819fea0 con 0x7f4a28100cb0 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40938/0 (socket says 172.21.15.35:40938) 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 -- 172.21.15.35:0/3695125851 learned_addr learned my addr 172.21.15.35:0/3695125851 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a277fe700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a28100cb0 0x7f4a2819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280ff130 0x7f4a28198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 -- 172.21.15.35:0/3695125851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a28100cb0 msgr2=0x7f4a2819f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a28100cb0 0x7f4a2819f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 -- 172.21.15.35:0/3695125851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280ff130 msgr2=0x7f4a28198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280ff130 0x7f4a28198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:47.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 -- 172.21.15.35:0/3695125851 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0095f0 con 0x7f4a28100320 2023-03-17T08:29:48.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28198590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c003a50 tx=0x7f4a1c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:48.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a0ffff700 1 -- 172.21.15.35:0/3695125851 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c01d070 con 0x7f4a28100320 2023-03-17T08:29:48.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2810a940 con 0x7f4a28100320 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a0ffff700 1 -- 172.21.15.35:0/3695125851 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a1c005a00 con 0x7f4a28100320 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a0ffff700 1 -- 172.21.15.35:0/3695125851 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c005020 con 0x7f4a28100320 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.272+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2810a7b0 con 0x7f4a28100320 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.275+0000 7f4a0ffff700 1 -- 172.21.15.35:0/3695125851 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f4a1c0051a0 con 0x7f4a28100320 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.275+0000 7f4a0ffff700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4a1009f4d0 0x7f4a100a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.275+0000 7f4a0ffff700 1 -- 172.21.15.35:0/3695125851 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4a1c0cb310 con 0x7f4a28100320 2023-03-17T08:29:49.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.275+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4a1009f4d0 0x7f4a100a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4a1009f4d0 0x7f4a100a1980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a18005950 tx=0x7f4a180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 Processor -- start 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 -- start start 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 0x55c2a300eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a300d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a300e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2f14020 con 0x55c2a300ea90 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2f66960 con 0x55c2a300f3e0 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2f5fdf0 con 0x55c2a300dc50 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 0x55c2a300eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 0x55c2a300eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40944/0 (socket says 172.21.15.35:40944) 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.276+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3490560523 learned_addr learned my addr 172.21.15.35:0/3490560523 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:49.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a277fe700 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a300e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:49.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3490560523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 msgr2=0x55c2a300e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:49.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a300e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:50.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a300d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:50.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3490560523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 msgr2=0x55c2a300d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:50.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a300d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:50.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3490560523 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2a2de15e0 con 0x55c2a300ea90 2023-03-17T08:29:50.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 0x55c2a300eea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b570 tx=0x7f4a18012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a263b1d974d6277c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:50.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a0d7fa700 1 -- 172.21.15.35:0/3490560523 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18011b50 con 0x55c2a300ea90 2023-03-17T08:29:51.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a0d7fa700 1 -- 172.21.15.35:0/3490560523 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a18011cb0 con 0x55c2a300ea90 2023-03-17T08:29:51.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.277+0000 7f4a0d7fa700 1 -- 172.21.15.35:0/3490560523 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1801d5b0 con 0x55c2a300ea90 2023-03-17T08:29:51.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3490560523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 msgr2=0x55c2a300eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:51.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 0x55c2a300eea0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b570 tx=0x7f4a18012000 comp rx=0 tx=0).stop 2023-03-17T08:29:51.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3490560523 shutdown_connections 2023-03-17T08:29:51.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a300e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:51.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300ea90 0x55c2a300eea0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:51.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3490560523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a300d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:52.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3490560523 >> 172.21.15.35:0/3490560523 conn(0x55c2a3009c00 msgr2=0x55c2a3007fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3490560523 shutdown_connections 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3490560523 wait complete. 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 -- start start 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 Processor -- start 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a3017420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a3017960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.278+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 0x55c2a301e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2de38d0 con 0x55c2a300f3e0 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a301eee0 con 0x55c2a300ea90 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a301f070 con 0x55c2a300dc50 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 10 client.0 _ll_register_callbacks cb 0x55c2a2e05240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:29:52.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 0x55c2a301e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 0x55c2a301e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40954/0 (socket says 172.21.15.35:40954) 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a3017420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 -- 172.21.15.35:0/1562546933 learned_addr learned my addr 172.21.15.35:0/1562546933 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 -- 172.21.15.35:0/1562546933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 msgr2=0x55c2a3017420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a3017420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 -- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 msgr2=0x55c2a3017960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a3017960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 -- 172.21.15.35:0/1562546933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1800fa10 con 0x55c2a300f3e0 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a277fe700 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 0x55c2a301e9a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a200042c0 tx=0x7f4a200045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b93eabec9e30d28 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:29:54.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a0aff5700 1 -- 172.21.15.35:0/1562546933 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007a30 con 0x55c2a300f3e0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a0aff5700 1 -- 172.21.15.35:0/1562546933 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4a20007b90 con 0x55c2a300f3e0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2a2f223a0 con 0x55c2a300f3e0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a0aff5700 1 -- 172.21.15.35:0/1562546933 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a20007d50 con 0x55c2a300f3e0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 10 client.14958 fetch_fsmap learned FSMap version 29 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.279+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c2a2d8dd90 con 0x55c2a300f3e0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a0aff5700 1 -- 172.21.15.35:0/1562546933 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c2a2f223a0 con 0x55c2a300f3e0 2023-03-17T08:29:54.889 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a0aff5700 1 -- 172.21.15.35:0/1562546933 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4a20014040 con 0x55c2a300f3e0 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a396cfb80 10 client.14958 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a396cfb80 10 client.14958 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a396cfb80 20 client.14958 populate_metadata read hostname 'smithi035' 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a30229f0 0x55c2a3021d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a396cfb80 4 client.14958 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2a2f2e610 con 0x55c2a30229f0 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a30229f0 0x55c2a3021d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a0aff5700 10 client.14958 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.280+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a30229f0 0x55c2a3021d80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e15a7c9072024ad server_cookie=8905a2107d91a25d in_seq=0 out_seq=0 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a0aff5700 1 -- 172.21.15.35:0/1562546933 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c2a2f2e610 con 0x55c2a30229f0 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a0aff5700 10 client.14958 handle_command_reply: tid=0 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 client.14958 shutdown 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 msgr2=0x55c2a301e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 0x55c2a301e9a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a200042c0 tx=0x7f4a200045d0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 shutdown_connections 2023-03-17T08:29:54.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a30229f0 0x55c2a3021d80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300f3e0 0x55c2a301e9a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a0aff5700 0 client.14958 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300dc50 0x55c2a3017420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/1562546933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a3017960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.281+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 >> 172.21.15.35:0/1562546933 conn(0x55c2a3009c00 msgr2=0x55c2a30076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.282+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 shutdown_connections 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.282+0000 7f4a396cfb80 1 -- 172.21.15.35:0/1562546933 wait complete. 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.282+0000 7f4a396cfb80 20 client.14958 trim_cache size 0 max 16384 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 Processor -- start 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 -- start start 2023-03-17T08:29:54.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a300d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:57.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a301e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:57.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300f3e0 0x55c2a3015180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:29:57.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2f2de00 con 0x55c2a300dc50 2023-03-17T08:29:57.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2f21b70 con 0x55c2a300ea90 2023-03-17T08:30:00.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a2e6bed0 con 0x55c2a300f3e0 2023-03-17T08:30:00.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a300d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:00.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a300d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40958/0 (socket says 172.21.15.35:40958) 2023-03-17T08:30:00.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 -- 172.21.15.35:0/950621122 learned_addr learned my addr 172.21.15.35:0/950621122 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:30:00.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a267fc700 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a301e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:00.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 -- 172.21.15.35:0/950621122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300f3e0 msgr2=0x55c2a3015180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:30:01.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300f3e0 0x55c2a3015180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:01.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 -- 172.21.15.35:0/950621122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 msgr2=0x55c2a301e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:30:03.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a301e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:03.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 -- 172.21.15.35:0/950621122 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2a30164a0 con 0x55c2a300dc50 2023-03-17T08:30:03.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a267fc700 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a301e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:30:03.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.300+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a300d590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4a18010010 tx=0x7f4a1800ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2edf2ef5c56773 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:30:03.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a0dffb700 1 -- 172.21.15.35:0/950621122 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1802d070 con 0x55c2a300dc50 2023-03-17T08:30:03.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a0dffb700 1 -- 172.21.15.35:0/950621122 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a1802e040 con 0x55c2a300dc50 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a0dffb700 1 -- 172.21.15.35:0/950621122 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18036570 con 0x55c2a300dc50 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 -- 172.21.15.35:0/950621122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 msgr2=0x55c2a300d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a300d590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4a18010010 tx=0x7f4a1800ba80 comp rx=0 tx=0).stop 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 -- 172.21.15.35:0/950621122 shutdown_connections 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300f3e0 0x55c2a3015180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a300d590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/950621122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300ea90 0x55c2a301e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 -- 172.21.15.35:0/950621122 >> 172.21.15.35:0/950621122 conn(0x55c2a3009c00 msgr2=0x55c2a301f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 -- 172.21.15.35:0/950621122 shutdown_connections 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.301+0000 7f4a396cfb80 1 -- 172.21.15.35:0/950621122 wait complete. 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 -- start start 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 Processor -- start 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a3019d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:03.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300ea90 0x55c2a301a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a301d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a301d780 con 0x55c2a300dc50 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a301d8f0 con 0x55c2a300f3e0 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2a301dab0 con 0x55c2a300ea90 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a396cfb80 10 client.0 _ll_register_callbacks cb 0x55c2a2e05240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a3019d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a3019d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:40964/0 (socket says 172.21.15.35:40964) 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3523123140 learned_addr learned my addr 172.21.15.35:0/3523123140 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a277fe700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a301d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:03.354 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300ea90 0x55c2a301a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:05.950 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3523123140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300ea90 msgr2=0x55c2a301a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:30:05.950 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300ea90 0x55c2a301a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:05.950 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 msgr2=0x55c2a301d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:30:06.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a301d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:06.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 -- 172.21.15.35:0/3523123140 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2a2de15e0 con 0x55c2a300dc50 2023-03-17T08:30:06.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a26ffd700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a3019d10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800fd00 tx=0x7f4a18036520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f93f37df65e9086 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:30:06.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.302+0000 7f4a0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:30:06.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a0aff5700 1 -- 172.21.15.35:0/3523123140 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1802d070 con 0x55c2a300dc50 2023-03-17T08:30:06.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a0aff5700 1 -- 172.21.15.35:0/3523123140 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4a18011a50 con 0x55c2a300dc50 2023-03-17T08:30:06.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2a2fdd1f0 con 0x55c2a300dc50 2023-03-17T08:30:08.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a0aff5700 1 -- 172.21.15.35:0/3523123140 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a18036e70 con 0x55c2a300dc50 2023-03-17T08:30:09.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 10 client.14964 fetch_fsmap learned FSMap version 29 2023-03-17T08:30:09.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c2a2d76c10 con 0x55c2a300dc50 2023-03-17T08:30:09.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a0aff5700 1 -- 172.21.15.35:0/3523123140 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a1804d020 con 0x55c2a300dc50 2023-03-17T08:30:09.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a0aff5700 1 -- 172.21.15.35:0/3523123140 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4a18005220 con 0x55c2a300dc50 2023-03-17T08:30:09.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 10 client.14964 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:30:11.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 10 client.14964 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-17T08:30:11.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 20 client.14964 populate_metadata read hostname 'smithi035' 2023-03-17T08:30:11.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a307bcd0 0x55c2a30788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:11.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 4 client.14964 mds_command: new command op to 24452 tid=0[{"prefix": "status"}] 2023-03-17T08:30:11.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.303+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c2a2de3f10 con 0x55c2a307bcd0 2023-03-17T08:30:11.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a307bcd0 0x55c2a30788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:11.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a0aff5700 10 client.14964 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:30:13.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a267fc700 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a307bcd0 0x55c2a30788a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f81d5048b89846b server_cookie=7280ab95f101190e in_seq=0 out_seq=0 2023-03-17T08:30:13.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a0aff5700 1 -- 172.21.15.35:0/3523123140 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c2a2de3f10 con 0x55c2a307bcd0 2023-03-17T08:30:13.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a0aff5700 10 client.14964 handle_command_reply: tid=0 2023-03-17T08:30:13.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 client.14964 shutdown 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 msgr2=0x55c2a3019d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a3019d10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800fd00 tx=0x7f4a18036520 comp rx=0 tx=0).stop 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 shutdown_connections 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2a307bcd0 0x55c2a30788a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2a300f3e0 0x55c2a301d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2a300dc50 0x55c2a3019d10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a0aff5700 0 client.14964 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:30:13.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 --2- 172.21.15.35:0/3523123140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2a300ea90 0x55c2a301a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:13.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 >> 172.21.15.35:0/3523123140 conn(0x55c2a3009c00 msgr2=0x55c2a3015180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:13.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.304+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 shutdown_connections 2023-03-17T08:30:13.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a396cfb80 1 -- 172.21.15.35:0/3523123140 wait complete. 2023-03-17T08:30:13.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a396cfb80 20 client.14964 trim_cache size 0 max 16384 2023-03-17T08:30:13.087 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:30:15.087 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:30:15.087 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 0, 2023-03-17T08:30:15.087 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24452, 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 969.31414390500004, 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1148.1608826260001 2023-03-17T08:30:15.088 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:30:15.090 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4a1009f4d0 msgr2=0x7f4a100a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:15.929 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4a1009f4d0 0x7f4a100a1980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a18005950 tx=0x7f4a180058e0 comp rx=0 tx=0).stop 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 msgr2=0x7f4a28198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28198590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c003a50 tx=0x7f4a1c009580 comp rx=0 tx=0).stop 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 shutdown_connections 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a28100cb0 0x7f4a2819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280ff130 0x7f4a28198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4a1009f4d0 0x7f4a100a1980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 --2- 172.21.15.35:0/3695125851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a28100320 0x7f4a28198590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:17.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 >> 172.21.15.35:0/3695125851 conn(0x7f4a280fa750 msgr2=0x7f4a28069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:17.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 shutdown_connections 2023-03-17T08:30:19.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:29:41.305+0000 7f4a2d542700 1 -- 172.21.15.35:0/3695125851 wait complete. 2023-03-17T08:30:19.186 INFO:tasks.cephadm:Setup complete, yielding 2023-03-17T08:30:20.900 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-03-17T08:30:20.915 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T08:30:21.866 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph orch status' 2023-03-17T08:30:21.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:42 smithi035 ceph-mon[92535]: pgmap v1370: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:44 smithi035 ceph-mon[92535]: pgmap v1371: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:46 smithi035 ceph-mon[92535]: pgmap v1372: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:48 smithi035 ceph-mon[92535]: pgmap v1373: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:50 smithi035 ceph-mon[92535]: pgmap v1374: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:52 smithi035 ceph-mon[92535]: pgmap v1375: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:54 smithi035 ceph-mon[92535]: pgmap v1376: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:22.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:56 smithi035 ceph-mon[92535]: pgmap v1377: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:22.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:29:58 smithi035 ceph-mon[92535]: pgmap v1378: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:22.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:00 smithi035 ceph-mon[92535]: pgmap v1379: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:22.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T08:30:23.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:02 smithi035 ceph-mon[92535]: pgmap v1380: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:23.565 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:04 smithi035 ceph-mon[92535]: pgmap v1381: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:23.565 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:06 smithi035 ceph-mon[92535]: pgmap v1382: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:23.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:30:23.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:30:23.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:30:23.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:30:24.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:08 smithi035 ceph-mon[92535]: pgmap v1383: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:24.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:10 smithi035 ceph-mon[92535]: pgmap v1384: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:24.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:12 smithi035 ceph-mon[92535]: pgmap v1385: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:24.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:13 smithi035 ceph-mon[92535]: pgmap v1386: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:24.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:16 smithi035 ceph-mon[92535]: pgmap v1387: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:24.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:18 smithi035 ceph-mon[92535]: pgmap v1388: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:24.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:20 smithi035 ceph-mon[92535]: pgmap v1389: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:24.914 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:44 smithi078 ceph-mon[94114]: pgmap v1371: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:46 smithi078 ceph-mon[94114]: pgmap v1372: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:48 smithi078 ceph-mon[94114]: pgmap v1373: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:50 smithi078 ceph-mon[94114]: pgmap v1374: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:52 smithi078 ceph-mon[94114]: pgmap v1375: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:54 smithi078 ceph-mon[94114]: pgmap v1376: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:56 smithi078 ceph-mon[94114]: pgmap v1377: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:29:58 smithi078 ceph-mon[94114]: pgmap v1378: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:00 smithi078 ceph-mon[94114]: pgmap v1379: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:02 smithi078 ceph-mon[94114]: pgmap v1380: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:04 smithi078 ceph-mon[94114]: pgmap v1381: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:06 smithi078 ceph-mon[94114]: pgmap v1382: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:08 smithi078 ceph-mon[94114]: pgmap v1383: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:26.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:10 smithi078 ceph-mon[94114]: pgmap v1384: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:28.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:12 smithi078 ceph-mon[94114]: pgmap v1385: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:28.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:13 smithi078 ceph-mon[94114]: pgmap v1386: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:28.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:16 smithi078 ceph-mon[94114]: pgmap v1387: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:28.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:18 smithi078 ceph-mon[94114]: pgmap v1388: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:28.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:20 smithi078 ceph-mon[94114]: pgmap v1389: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:29.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:22 smithi078 ceph-mon[94114]: pgmap v1390: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:29.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:22 smithi035 ceph-mon[92535]: pgmap v1390: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:30.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:44 smithi082 ceph-mon[94281]: pgmap v1371: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:46 smithi082 ceph-mon[94281]: pgmap v1372: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:48 smithi082 ceph-mon[94281]: pgmap v1373: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:50 smithi082 ceph-mon[94281]: pgmap v1374: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:52 smithi082 ceph-mon[94281]: pgmap v1375: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:54 smithi082 ceph-mon[94281]: pgmap v1376: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:56 smithi082 ceph-mon[94281]: pgmap v1377: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:29:58 smithi082 ceph-mon[94281]: pgmap v1378: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:00 smithi082 ceph-mon[94281]: pgmap v1379: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:02 smithi082 ceph-mon[94281]: pgmap v1380: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:30.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:04 smithi082 ceph-mon[94281]: pgmap v1381: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:32.340 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:06 smithi082 ceph-mon[94281]: pgmap v1382: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:32.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:30:32.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:30:32.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:30:32.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:30:32.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:08 smithi082 ceph-mon[94281]: pgmap v1383: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:32.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:10 smithi082 ceph-mon[94281]: pgmap v1384: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:12 smithi082 ceph-mon[94281]: pgmap v1385: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:13 smithi082 ceph-mon[94281]: pgmap v1386: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:16 smithi082 ceph-mon[94281]: pgmap v1387: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:18 smithi082 ceph-mon[94281]: pgmap v1388: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:20 smithi082 ceph-mon[94281]: pgmap v1389: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:22 smithi082 ceph-mon[94281]: pgmap v1390: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:24 smithi082 ceph-mon[94281]: pgmap v1391: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:26 smithi082 ceph-mon[94281]: pgmap v1392: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:33.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:28 smithi082 ceph-mon[94281]: pgmap v1393: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.799 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:28 smithi082 ceph-mon[94281]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:30:33.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:24 smithi035 ceph-mon[92535]: pgmap v1391: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:24 smithi078 ceph-mon[94114]: pgmap v1391: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:26 smithi078 ceph-mon[94114]: pgmap v1392: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:33.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:28 smithi078 ceph-mon[94114]: pgmap v1393: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:33.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:28 smithi078 ceph-mon[94114]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:30:33.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:30 smithi078 ceph-mon[94114]: pgmap v1394: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:35.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:32 smithi078 ceph-mon[94114]: pgmap v1395: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:35.521 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:30:35.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:26 smithi035 ceph-mon[92535]: pgmap v1392: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:35.522 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:34 smithi078 ceph-mon[94114]: pgmap v1396: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:37.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:30 smithi082 ceph-mon[94281]: pgmap v1394: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:37.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:32 smithi082 ceph-mon[94281]: pgmap v1395: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:37.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:34 smithi082 ceph-mon[94281]: pgmap v1396: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:37.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:36 smithi082 ceph-mon[94281]: pgmap v1397: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:37.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:36 smithi078 ceph-mon[94114]: pgmap v1397: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:39.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.985+0000 7f9b6956a700 1 -- 172.21.15.35:0/136289926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 msgr2=0x7f9b64107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:41.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.985+0000 7f9b6956a700 1 --2- 172.21.15.35:0/136289926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b64107570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00b0a0 tx=0x7f9b5c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:30:41.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.985+0000 7f9b6956a700 1 -- 172.21.15.35:0/136289926 shutdown_connections 2023-03-17T08:30:41.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.985+0000 7f9b6956a700 1 --2- 172.21.15.35:0/136289926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b64107570 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:41.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.985+0000 7f9b6956a700 1 --2- 172.21.15.35:0/136289926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b640ff120 0x7f9b640ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:43.176 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.985+0000 7f9b6956a700 1 --2- 172.21.15.35:0/136289926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b64100320 0x7f9b64100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:43.176 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.986+0000 7f9b6956a700 1 -- 172.21.15.35:0/136289926 >> 172.21.15.35:0/136289926 conn(0x7f9b640fa770 msgr2=0x7f9b640fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.986+0000 7f9b6956a700 1 -- 172.21.15.35:0/136289926 shutdown_connections 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.986+0000 7f9b6956a700 1 -- 172.21.15.35:0/136289926 wait complete. 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.986+0000 7f9b6956a700 1 Processor -- start 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.986+0000 7f9b6956a700 1 -- start start 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b640ff120 0x7f9b64194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b64100320 0x7f9b64195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b6419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6419c990 con 0x7f9b64100cb0 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6419cad0 con 0x7f9b640ff120 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6419cc60 con 0x7f9b64100320 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b6419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b6419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41002/0 (socket says 172.21.15.35:41002) 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 -- 172.21.15.35:0/1436968553 learned_addr learned my addr 172.21.15.35:0/1436968553 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:30:44.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b627fc700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b64100320 0x7f9b64195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b62ffd700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b640ff120 0x7f9b64194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 -- 172.21.15.35:0/1436968553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b64100320 msgr2=0x7f9b64195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b64100320 0x7f9b64195340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 -- 172.21.15.35:0/1436968553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b640ff120 msgr2=0x7f9b64194e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b640ff120 0x7f9b64194e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 -- 172.21.15.35:0/1436968553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c009d00 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b62ffd700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b640ff120 0x7f9b64194e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b637fe700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b6419c3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c007a30 tx=0x7f9b5c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00e040 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6410a920 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b5c01ab60 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0057c0 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.987+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6410a790 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.988+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6404e8c0 con 0x7f9b64100cb0 2023-03-17T08:30:44.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.990+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f9b5c005920 con 0x7f9b64100cb0 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.990+0000 7f9b4bfff700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9b4c09f4d0 0x7f9b4c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.990+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f9b5c0cd780 con 0x7f9b64100cb0 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.990+0000 7f9b62ffd700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9b4c09f4d0 0x7f9b4c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.991+0000 7f9b62ffd700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9b4c09f4d0 0x7f9b4c0a1980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b54005fd0 tx=0x7f9b54005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:26.994+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f9b5c0979a0 con 0x7f9b64100cb0 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.207+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b64069f50 con 0x7f9b4c09f4d0 2023-03-17T08:30:46.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.208+0000 7f9b4bfff700 1 -- 172.21.15.35:0/1436968553 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9b64069f50 con 0x7f9b4c09f4d0 2023-03-17T08:30:46.154 INFO:teuthology.orchestra.run.smithi035.stdout:Backend: cephadm 2023-03-17T08:30:46.154 INFO:teuthology.orchestra.run.smithi035.stdout:Available: Yes 2023-03-17T08:30:46.154 INFO:teuthology.orchestra.run.smithi035.stdout:Paused: No 2023-03-17T08:30:46.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9b4c09f4d0 msgr2=0x7f9b4c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:46.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9b4c09f4d0 0x7f9b4c0a1980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b54005fd0 tx=0x7f9b54005f00 comp rx=0 tx=0).stop 2023-03-17T08:30:46.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 msgr2=0x7f9b6419c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:46.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b6419c3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c007a30 tx=0x7f9b5c004d00 comp rx=0 tx=0).stop 2023-03-17T08:30:46.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 shutdown_connections 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9b4c09f4d0 0x7f9b4c0a1980 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9b64100cb0 0x7f9b6419c3c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b640ff120 0x7f9b64194e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 --2- 172.21.15.35:0/1436968553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b64100320 0x7f9b64195340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 >> 172.21.15.35:0/1436968553 conn(0x7f9b640fa770 msgr2=0x7f9b640fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 shutdown_connections 2023-03-17T08:30:46.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:27.210+0000 7f9b6956a700 1 -- 172.21.15.35:0/1436968553 wait complete. 2023-03-17T08:30:46.579 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph orch ps' 2023-03-17T08:30:46.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:28 smithi035 ceph-mon[92535]: pgmap v1393: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.391 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:28 smithi035 ceph-mon[92535]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:30:47.391 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:30 smithi035 ceph-mon[92535]: pgmap v1394: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.391 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:32 smithi035 ceph-mon[92535]: pgmap v1395: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:34 smithi035 ceph-mon[92535]: pgmap v1396: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:36 smithi035 ceph-mon[92535]: pgmap v1397: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:38 smithi035 ceph-mon[92535]: pgmap v1398: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:40 smithi035 ceph-mon[92535]: pgmap v1399: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:42 smithi035 ceph-mon[92535]: pgmap v1400: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:44 smithi035 ceph-mon[92535]: pgmap v1401: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:38 smithi082 ceph-mon[94281]: pgmap v1398: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:40 smithi082 ceph-mon[94281]: pgmap v1399: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:42 smithi082 ceph-mon[94281]: pgmap v1400: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:44 smithi082 ceph-mon[94281]: pgmap v1401: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:46 smithi082 ceph-mon[94281]: pgmap v1402: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:38 smithi078 ceph-mon[94114]: pgmap v1398: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:40 smithi078 ceph-mon[94114]: pgmap v1399: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:42 smithi078 ceph-mon[94114]: pgmap v1400: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:44 smithi078 ceph-mon[94114]: pgmap v1401: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:47.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:46 smithi078 ceph-mon[94114]: pgmap v1402: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:47.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:46 smithi035 ceph-mon[92535]: pgmap v1402: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:30:48.473 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:30:48.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:48 smithi082 ceph-mon[94281]: pgmap v1403: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:49.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:48 smithi035 ceph-mon[92535]: pgmap v1403: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:50.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:48 smithi078 ceph-mon[94114]: pgmap v1403: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:50.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 -- 172.21.15.35:0/2226984531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba180ff170 msgr2=0x7fba180ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 --2- 172.21.15.35:0/2226984531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba180ff170 0x7fba180ff580 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009990 tx=0x7fba0c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 -- 172.21.15.35:0/2226984531 shutdown_connections 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 --2- 172.21.15.35:0/2226984531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 0x7fba181075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 --2- 172.21.15.35:0/2226984531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba180ff170 0x7fba180ff580 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 --2- 172.21.15.35:0/2226984531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba18100370 0x7fba181007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 -- 172.21.15.35:0/2226984531 >> 172.21.15.35:0/2226984531 conn(0x7fba180fa780 msgr2=0x7fba180fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 -- 172.21.15.35:0/2226984531 shutdown_connections 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 -- 172.21.15.35:0/2226984531 wait complete. 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.255+0000 7fba1d67a700 1 Processor -- start 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 -- start start 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba180ff170 0x7fba180690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 0x7fba1819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:51.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 0x7fba1819d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1819da60 con 0x7fba18100370 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1819dbd0 con 0x7fba180ff170 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba1d67a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1819dd90 con 0x7fba18100d00 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 0x7fba1819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 0x7fba1819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41016/0 (socket says 172.21.15.35:41016) 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 -- 172.21.15.35:0/3775171937 learned_addr learned my addr 172.21.15.35:0/3775171937 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba16ffd700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba180ff170 0x7fba180690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba177fe700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 0x7fba1819d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 -- 172.21.15.35:0/3775171937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 msgr2=0x7fba1819d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 0x7fba1819d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 -- 172.21.15.35:0/3775171937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba180ff170 msgr2=0x7fba180690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba180ff170 0x7fba180690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:51.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba167fc700 1 -- 172.21.15.35:0/3775171937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0095f0 con 0x7fba18100370 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.256+0000 7fba177fe700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 0x7fba1819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.257+0000 7fba167fc700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 0x7fba1819ac70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fba0800d950 tx=0x7fba0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.257+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08009940 con 0x7fba18100370 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.257+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1810a970 con 0x7fba18100370 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.257+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba08010460 con 0x7fba18100370 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.257+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800f620 con 0x7fba18100370 2023-03-17T08:30:51.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.257+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1810a7e0 con 0x7fba18100370 2023-03-17T08:30:52.275 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.258+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1819e4c0 con 0x7fba18100370 2023-03-17T08:30:52.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.259+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fba080105d0 con 0x7fba18100370 2023-03-17T08:30:53.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.259+0000 7fb9fffff700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fba0009f550 0x7fba000a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:30:53.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.260+0000 7fba16ffd700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fba0009f550 0x7fba000a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:30:53.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.260+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fba080c9b20 con 0x7fba18100370 2023-03-17T08:30:53.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.260+0000 7fba16ffd700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fba0009f550 0x7fba000a1a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00b5c0 tx=0x7fba0c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:30:53.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.264+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fba08093c10 con 0x7fba18100370 2023-03-17T08:30:53.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.472+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fba1819eb30 con 0x7fba0009f550 2023-03-17T08:30:54.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.492+0000 7fb9fffff700 1 -- 172.21.15.35:0/3775171937 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4123 (secure 0 0 0) 0x7fba1819eb30 con 0x7fba0009f550 2023-03-17T08:30:54.235 INFO:teuthology.orchestra.run.smithi035.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-03-17T08:30:54.235 INFO:teuthology.orchestra.run.smithi035.stdout:mds.a smithi035 running (20m) 7m ago 20m 31.0M - 18.0.0-3051-g4aa791bf ba7c89c57330 85c405cc5088 2023-03-17T08:30:54.235 INFO:teuthology.orchestra.run.smithi035.stdout:mds.b smithi078 running (20m) 7m ago 20m 35.4M - 18.0.0-3051-g4aa791bf ba7c89c57330 ecd144cc6084 2023-03-17T08:30:54.235 INFO:teuthology.orchestra.run.smithi035.stdout:mds.c smithi082 running (20m) 7m ago 20m 28.9M - 18.0.0-3051-g4aa791bf ba7c89c57330 1ff1f1a1cfec 2023-03-17T08:30:54.235 INFO:teuthology.orchestra.run.smithi035.stdout:mds.d smithi035 running (20m) 7m ago 20m 19.5M - 18.0.0-3051-g4aa791bf ba7c89c57330 9b5560e29819 2023-03-17T08:30:54.966 INFO:teuthology.orchestra.run.smithi035.stdout:mds.e smithi078 running (20m) 7m ago 20m 31.6M - 18.0.0-3051-g4aa791bf ba7c89c57330 0e3047f626fb 2023-03-17T08:30:54.966 INFO:teuthology.orchestra.run.smithi035.stdout:mds.f smithi082 running (20m) 7m ago 20m 28.6M - 18.0.0-3051-g4aa791bf ba7c89c57330 1640c1c5d31b 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mds.g smithi035 running (20m) 7m ago 20m 28.1M - 18.0.0-3051-g4aa791bf ba7c89c57330 d8164a158f7b 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mds.h smithi078 running (20m) 7m ago 20m 28.6M - 18.0.0-3051-g4aa791bf ba7c89c57330 19782e3254e5 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mds.i smithi082 running (20m) 7m ago 20m 31.2M - 18.0.0-3051-g4aa791bf ba7c89c57330 3cda377dbab5 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mds.j smithi035 running (20m) 7m ago 20m 19.5M - 18.0.0-3051-g4aa791bf ba7c89c57330 e73cf916d0d4 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mds.k smithi078 running (20m) 7m ago 20m 29.0M - 18.0.0-3051-g4aa791bf ba7c89c57330 b6db45468faf 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mds.l smithi082 running (20m) 7m ago 20m 29.1M - 18.0.0-3051-g4aa791bf ba7c89c57330 26a5ffe83c01 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mgr.x smithi035 *:9283,8765 running (44m) 7m ago 44m 530M - 18.0.0-3051-g4aa791bf ba7c89c57330 d60dfc6aaed7 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mgr.y smithi078 *:8443,8765 running (35m) 7m ago 35m 451M - 18.0.0-3051-g4aa791bf ba7c89c57330 9bf5c8b3e37b 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mgr.z smithi082 *:8443,8765 running (35m) 7m ago 35m 451M - 18.0.0-3051-g4aa791bf ba7c89c57330 54d80a4fff77 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mon.a smithi035 running (44m) 7m ago 45m 177M 2048M 18.0.0-3051-g4aa791bf ba7c89c57330 3af5f75e6da0 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mon.b smithi078 running (36m) 7m ago 36m 100M 2048M 18.0.0-3051-g4aa791bf ba7c89c57330 e704ddbe5e5a 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:mon.c smithi082 running (36m) 7m ago 36m 95.7M 2048M 18.0.0-3051-g4aa791bf ba7c89c57330 8ec5c335baee 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:osd.0 smithi035 running (32m) 7m ago 32m 94.3M 4293M 18.0.0-3051-g4aa791bf ba7c89c57330 20a28e85a1cf 2023-03-17T08:30:54.967 INFO:teuthology.orchestra.run.smithi035.stdout:osd.1 smithi078 running (31m) 7m ago 31m 102M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 9b1791e0e90f 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.2 smithi082 running (30m) 7m ago 30m 100M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 7d259bf6d353 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.3 smithi035 running (29m) 7m ago 29m 97.7M 4293M 18.0.0-3051-g4aa791bf ba7c89c57330 b3e3cb5a97c6 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.4 smithi078 running (28m) 7m ago 28m 92.9M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 732a4994bd63 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.5 smithi082 running (27m) 7m ago 27m 108M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 704f07feb7ce 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.6 smithi035 running (26m) 7m ago 26m 94.3M 4293M 18.0.0-3051-g4aa791bf ba7c89c57330 afc54d4c795b 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.7 smithi078 running (25m) 7m ago 25m 99.5M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 e642a0855d89 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.8 smithi082 running (24m) 7m ago 24m 91.4M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 d6753d7e3c7e 2023-03-17T08:30:57.160 INFO:teuthology.orchestra.run.smithi035.stdout:osd.9 smithi035 running (23m) 7m ago 23m 87.8M 4293M 18.0.0-3051-g4aa791bf ba7c89c57330 f85f884932a6 2023-03-17T08:30:57.161 INFO:teuthology.orchestra.run.smithi035.stdout:osd.10 smithi078 running (22m) 7m ago 22m 112M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 c6f443279014 2023-03-17T08:30:57.161 INFO:teuthology.orchestra.run.smithi035.stdout:osd.11 smithi082 running (22m) 7m ago 22m 80.2M 4292M 18.0.0-3051-g4aa791bf ba7c89c57330 13d3b48b4766 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fba0009f550 msgr2=0x7fba000a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fba0009f550 0x7fba000a1a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00b5c0 tx=0x7fba0c005fd0 comp rx=0 tx=0).stop 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 msgr2=0x7fba1819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 0x7fba1819ac70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fba0800d950 tx=0x7fba0800dc60 comp rx=0 tx=0).stop 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 shutdown_connections 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba18100d00 0x7fba1819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba180ff170 0x7fba180690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fba0009f550 0x7fba000a1a00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:57.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.494+0000 7fba1d67a700 1 --2- 172.21.15.35:0/3775171937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fba18100370 0x7fba1819ac70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:30:58.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.495+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 >> 172.21.15.35:0/3775171937 conn(0x7fba180fa780 msgr2=0x7fba180fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:30:58.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.495+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 shutdown_connections 2023-03-17T08:30:58.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:30:49.495+0000 7fba1d67a700 1 -- 172.21.15.35:0/3775171937 wait complete. 2023-03-17T08:30:58.688 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph orch ls' 2023-03-17T08:30:58.689 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:50 smithi035 ceph-mon[92535]: pgmap v1404: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:30:58.689 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:50 smithi035 ceph-mon[92535]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:00.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:52 smithi035 ceph-mon[92535]: pgmap v1405: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:00.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:54 smithi035 ceph-mon[92535]: pgmap v1406: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:00.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:55 smithi035 ceph-mon[92535]: pgmap v1407: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:00.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:30:57 smithi035 ceph-mon[92535]: pgmap v1408: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:00.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:50 smithi078 ceph-mon[94114]: pgmap v1404: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:31:01.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:50 smithi078 ceph-mon[94114]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:01.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:52 smithi078 ceph-mon[94114]: pgmap v1405: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:01.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:54 smithi078 ceph-mon[94114]: pgmap v1406: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:01.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:55 smithi078 ceph-mon[94114]: pgmap v1407: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:01.592 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:30:57 smithi078 ceph-mon[94114]: pgmap v1408: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:50 smithi082 ceph-mon[94281]: pgmap v1404: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:50 smithi082 ceph-mon[94281]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:52 smithi082 ceph-mon[94281]: pgmap v1405: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:54 smithi082 ceph-mon[94281]: pgmap v1406: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:55 smithi082 ceph-mon[94281]: pgmap v1407: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:30:57 smithi082 ceph-mon[94281]: pgmap v1408: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:01.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:00 smithi082 ceph-mon[94281]: pgmap v1409: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:01.594 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:00 smithi078 ceph-mon[94114]: pgmap v1409: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:02.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:00 smithi035 ceph-mon[92535]: pgmap v1409: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:02.845 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:31:02.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:02 smithi035 ceph-mon[92535]: pgmap v1410: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:02.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 -- 172.21.15.35:0/3601345116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700101e40 msgr2=0x7fa700108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:05.057 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 --2- 172.21.15.35:0/3601345116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700101e40 0x7fa700108700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800b0a0 tx=0x7fa6f800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:31:05.057 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 -- 172.21.15.35:0/3601345116 shutdown_connections 2023-03-17T08:31:05.057 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 --2- 172.21.15.35:0/3601345116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700101e40 0x7fa700108700 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:06.287 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 --2- 172.21.15.35:0/3601345116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001002b0 0x7fa7001006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:06.287 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 --2- 172.21.15.35:0/3601345116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7001014b0 0x7fa700101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:06.287 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 -- 172.21.15.35:0/3601345116 >> 172.21.15.35:0/3601345116 conn(0x7fa7000fb900 msgr2=0x7fa7000fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:31:06.287 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 -- 172.21.15.35:0/3601345116 shutdown_connections 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.798+0000 7fa706562700 1 -- 172.21.15.35:0/3601345116 wait complete. 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 Processor -- start 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 -- start start 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 0x7fa700195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001014b0 0x7fa700196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa700101e40 0x7fa70019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019da60 con 0x7fa7001002b0 2023-03-17T08:31:07.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019dba0 con 0x7fa700101e40 2023-03-17T08:31:07.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa706562700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019dd30 con 0x7fa7001014b0 2023-03-17T08:31:07.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 0x7fa700195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:07.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 0x7fa700195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41028/0 (socket says 172.21.15.35:41028) 2023-03-17T08:31:07.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 -- 172.21.15.35:0/1429894980 learned_addr learned my addr 172.21.15.35:0/1429894980 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:31:07.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6ff7fe700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001014b0 0x7fa700196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:08.625 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa704aff700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa700101e40 0x7fa70019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:10.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 -- 172.21.15.35:0/1429894980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001014b0 msgr2=0x7fa700196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:10.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001014b0 0x7fa700196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:10.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 -- 172.21.15.35:0/1429894980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa700101e40 msgr2=0x7fa70019d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:10.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa700101e40 0x7fa70019d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:10.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa6fffff700 1 -- 172.21.15.35:0/1429894980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009d00 con 0x7fa7001002b0 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa6ff7fe700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001014b0 0x7fa700196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.799+0000 7fa704aff700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa700101e40 0x7fa70019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa6fffff700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 0x7fa700195ed0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000c9c0 tx=0x7fa6f000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0007ac0 con 0x7fa7001002b0 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f0007c20 con 0x7fa7001002b0 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70010bad0 con 0x7fa7001002b0 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0018660 con 0x7fa7001002b0 2023-03-17T08:31:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.800+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70010b940 con 0x7fa7001002b0 2023-03-17T08:31:11.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.801+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa700107770 con 0x7fa7001002b0 2023-03-17T08:31:11.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.802+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fa6f000f450 con 0x7fa7001002b0 2023-03-17T08:31:11.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.803+0000 7fa6fd7fa700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa6e809f4d0 0x7fa6e80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:11.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.803+0000 7fa6ff7fe700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa6e809f4d0 0x7fa6e80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:11.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.803+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa6f00ca260 con 0x7fa7001002b0 2023-03-17T08:31:11.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.803+0000 7fa6ff7fe700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa6e809f4d0 0x7fa6e80a1980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4005fd0 tx=0x7fa6f4005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:31:12.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:02.807+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fa6f0094480 con 0x7fa7001002b0 2023-03-17T08:31:12.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.011+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa70019def0 con 0x7fa6e809f4d0 2023-03-17T08:31:14.112 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.018+0000 7fa6fd7fa700 1 -- 172.21.15.35:0/1429894980 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fa6f4008720 con 0x7fa6e809f4d0 2023-03-17T08:31:14.113 INFO:teuthology.orchestra.run.smithi035.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-03-17T08:31:16.450 INFO:teuthology.orchestra.run.smithi035.stdout:mds.all 12/12 8m ago 20m smithi035=a;smithi035=d;smithi035=g;smithi035=j;smithi078=b;smithi078=e;smithi078=h;smithi078=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2023-03-17T08:31:16.450 INFO:teuthology.orchestra.run.smithi035.stdout:mgr 3/3 8m ago 35m smithi035=x;smithi078=y;smithi082=z;count:3 2023-03-17T08:31:16.450 INFO:teuthology.orchestra.run.smithi035.stdout:mon 3/3 8m ago 37m smithi035:172.21.15.35=a;smithi078:172.21.15.78=b;smithi082:172.21.15.82=c;count:3 2023-03-17T08:31:16.450 INFO:teuthology.orchestra.run.smithi035.stdout:osd 12 8m ago - 2023-03-17T08:31:16.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:02 smithi078 ceph-mon[94114]: pgmap v1410: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:04 smithi078 ceph-mon[94114]: pgmap v1411: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:04 smithi078 ceph-mon[94114]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:06 smithi078 ceph-mon[94114]: pgmap v1412: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:06 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:07 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:07 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:31:17.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:07 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:31:20.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:08 smithi078 ceph-mon[94114]: pgmap v1413: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:10 smithi078 ceph-mon[94114]: pgmap v1414: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:12 smithi078 ceph-mon[94114]: pgmap v1415: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:20.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:14 smithi078 ceph-mon[94114]: pgmap v1416: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:02 smithi082 ceph-mon[94281]: pgmap v1410: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:04 smithi082 ceph-mon[94281]: pgmap v1411: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:04 smithi082 ceph-mon[94281]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:06 smithi082 ceph-mon[94281]: pgmap v1412: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:06 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:07 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:07 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:31:20.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:07 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:31:20.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:08 smithi082 ceph-mon[94281]: pgmap v1413: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:10 smithi082 ceph-mon[94281]: pgmap v1414: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:12 smithi082 ceph-mon[94281]: pgmap v1415: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:20.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:14 smithi082 ceph-mon[94281]: pgmap v1416: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:20.216 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:16 smithi078 ceph-mon[94114]: pgmap v1417: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:21.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:18 smithi078 ceph-mon[94114]: pgmap v1418: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:21.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.020+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa6e809f4d0 msgr2=0x7fa6e80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:24.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.020+0000 7fa706562700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa6e809f4d0 0x7fa6e80a1980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4005fd0 tx=0x7fa6f4005e20 comp rx=0 tx=0).stop 2023-03-17T08:31:24.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 msgr2=0x7fa700195ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:24.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 0x7fa700195ed0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000c9c0 tx=0x7fa6f000cd80 comp rx=0 tx=0).stop 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 shutdown_connections 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa700101e40 0x7fa70019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa6e809f4d0 0x7fa6e80a1980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7001002b0 0x7fa700195ed0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 --2- 172.21.15.35:0/1429894980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7001014b0 0x7fa700196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 >> 172.21.15.35:0/1429894980 conn(0x7fa7000fb900 msgr2=0x7fa7001048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 shutdown_connections 2023-03-17T08:31:24.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:03.021+0000 7fa706562700 1 -- 172.21.15.35:0/1429894980 wait complete. 2023-03-17T08:31:24.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:16 smithi082 ceph-mon[94281]: pgmap v1417: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:24.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:18 smithi082 ceph-mon[94281]: pgmap v1418: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:24.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:20 smithi082 ceph-mon[94281]: pgmap v1419: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:24.780 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph orch host ls' 2023-03-17T08:31:24.781 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:04 smithi035 ceph-mon[92535]: pgmap v1411: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:26.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:04 smithi035 ceph-mon[92535]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:26.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:06 smithi035 ceph-mon[92535]: pgmap v1412: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:26.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:06 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:31:26.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:31:26.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:31:26.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:08 smithi035 ceph-mon[92535]: pgmap v1413: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:10 smithi035 ceph-mon[92535]: pgmap v1414: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:12 smithi035 ceph-mon[92535]: pgmap v1415: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:14 smithi035 ceph-mon[92535]: pgmap v1416: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:16 smithi035 ceph-mon[92535]: pgmap v1417: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:18 smithi035 ceph-mon[92535]: pgmap v1418: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:20 smithi035 ceph-mon[92535]: pgmap v1419: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:26.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:22 smithi035 ceph-mon[92535]: pgmap v1420: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:26.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:24 smithi035 ceph-mon[92535]: pgmap v1421: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:27.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:22 smithi082 ceph-mon[94281]: pgmap v1420: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:27.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:24 smithi082 ceph-mon[94281]: pgmap v1421: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:27.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:26 smithi082 ceph-mon[94281]: pgmap v1422: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:27.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:20 smithi078 ceph-mon[94114]: pgmap v1419: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:27.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:22 smithi078 ceph-mon[94114]: pgmap v1420: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:27.131 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:24 smithi078 ceph-mon[94114]: pgmap v1421: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:27.131 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:26 smithi078 ceph-mon[94114]: pgmap v1422: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:27.498 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:26 smithi035 ceph-mon[92535]: pgmap v1422: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:28.525 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 -- 172.21.15.35:0/1329479063 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 msgr2=0x7efc140ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 --2- 172.21.15.35:0/1329479063 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc140ff580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00b0a0 tx=0x7efc0c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 -- 172.21.15.35:0/1329479063 shutdown_connections 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 --2- 172.21.15.35:0/1329479063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc14100d00 0x7efc141075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 --2- 172.21.15.35:0/1329479063 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc140ff580 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 --2- 172.21.15.35:0/1329479063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc14100370 0x7efc141007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 -- 172.21.15.35:0/1329479063 >> 172.21.15.35:0/1329479063 conn(0x7efc140fa780 msgr2=0x7efc140fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 -- 172.21.15.35:0/1329479063 shutdown_connections 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.200+0000 7efc1a161700 1 -- 172.21.15.35:0/1329479063 wait complete. 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 Processor -- start 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 -- start start 2023-03-17T08:31:28.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc14103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:30.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc14100370 0x7efc14101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc14100d00 0x7efc14101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14102410 con 0x7efc140ff170 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14102580 con 0x7efc14100370 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc1a161700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc141a01e0 con 0x7efc14100d00 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc14103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc14103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41042/0 (socket says 172.21.15.35:41042) 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 -- 172.21.15.35:0/3184395946 learned_addr learned my addr 172.21.15.35:0/3184395946 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc12ffd700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc14100370 0x7efc14101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:30.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc13fff700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc14100d00 0x7efc14101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:30.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 -- 172.21.15.35:0/3184395946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc14100d00 msgr2=0x7efc14101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc14100d00 0x7efc14101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 -- 172.21.15.35:0/3184395946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc14100370 msgr2=0x7efc14101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc14100370 0x7efc14101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.201+0000 7efc137fe700 1 -- 172.21.15.35:0/3184395946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009d00 con 0x7efc140ff170 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.202+0000 7efc137fe700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc14103100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00b830 tx=0x7efc0c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.202+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00e040 con 0x7efc140ff170 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.202+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc0c003e90 con 0x7efc140ff170 2023-03-17T08:31:31.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.202+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c004020 con 0x7efc140ff170 2023-03-17T08:31:31.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.202+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1410aa40 con 0x7efc140ff170 2023-03-17T08:31:31.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.202+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1410a8b0 con 0x7efc140ff170 2023-03-17T08:31:31.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.203+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14066e30 con 0x7efc140ff170 2023-03-17T08:31:31.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.205+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7efc0c003a00 con 0x7efc140ff170 2023-03-17T08:31:31.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.205+0000 7efc10ff9700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efbfc09f4d0 0x7efbfc0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:31.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.205+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7efc0c0cc200 con 0x7efc140ff170 2023-03-17T08:31:31.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.205+0000 7efc12ffd700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efbfc09f4d0 0x7efbfc0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:31.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.206+0000 7efc12ffd700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efbfc09f4d0 0x7efbfc0a1980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efc08005950 tx=0x7efc0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:31:31.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.208+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7efc0c096420 con 0x7efc140ff170 2023-03-17T08:31:31.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.414+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efc141a0ce0 con 0x7efbfc09f4d0 2023-03-17T08:31:31.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.416+0000 7efc10ff9700 1 -- 172.21.15.35:0/3184395946 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+187 (secure 0 0 0) 0x7efc141a0ce0 con 0x7efbfc09f4d0 2023-03-17T08:31:31.701 INFO:teuthology.orchestra.run.smithi035.stdout:HOST ADDR LABELS STATUS 2023-03-17T08:31:32.740 INFO:teuthology.orchestra.run.smithi035.stdout:smithi035 172.21.15.35 2023-03-17T08:31:32.741 INFO:teuthology.orchestra.run.smithi035.stdout:smithi078 172.21.15.78 2023-03-17T08:31:32.741 INFO:teuthology.orchestra.run.smithi035.stdout:smithi082 172.21.15.82 2023-03-17T08:31:32.741 INFO:teuthology.orchestra.run.smithi035.stdout:3 hosts in cluster 2023-03-17T08:31:32.742 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efbfc09f4d0 msgr2=0x7efbfc0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:35.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efbfc09f4d0 0x7efbfc0a1980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efc08005950 tx=0x7efc0800b410 comp rx=0 tx=0).stop 2023-03-17T08:31:36.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 msgr2=0x7efc14103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:36.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc14103100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00b830 tx=0x7efc0c004d00 comp rx=0 tx=0).stop 2023-03-17T08:31:36.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 shutdown_connections 2023-03-17T08:31:36.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc14100d00 0x7efc14101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:36.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7efbfc09f4d0 0x7efbfc0a1980 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:36.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efc140ff170 0x7efc14103100 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:36.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 --2- 172.21.15.35:0/3184395946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc14100370 0x7efc14101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:36.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 >> 172.21.15.35:0/3184395946 conn(0x7efc140fa780 msgr2=0x7efc140685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:31:36.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 shutdown_connections 2023-03-17T08:31:36.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:28.418+0000 7efc1a161700 1 -- 172.21.15.35:0/3184395946 wait complete. 2023-03-17T08:31:36.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:28 smithi035 ceph-mon[92535]: pgmap v1423: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:36.539 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph orch device ls' 2023-03-17T08:31:37.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:29 smithi035 ceph-mon[92535]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:39.065 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:30 smithi035 ceph-mon[92535]: pgmap v1424: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.065 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:31 smithi035 ceph-mon[92535]: pgmap v1425: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:39.065 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:33 smithi035 ceph-mon[92535]: pgmap v1426: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:36 smithi035 ceph-mon[92535]: pgmap v1427: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:39.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:38 smithi035 ceph-mon[92535]: pgmap v1428: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:28 smithi078 ceph-mon[94114]: pgmap v1423: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:29 smithi078 ceph-mon[94114]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:30 smithi078 ceph-mon[94114]: pgmap v1424: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:31 smithi078 ceph-mon[94114]: pgmap v1425: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:33 smithi078 ceph-mon[94114]: pgmap v1426: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:36 smithi078 ceph-mon[94114]: pgmap v1427: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:38 smithi078 ceph-mon[94114]: pgmap v1428: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:28 smithi082 ceph-mon[94281]: pgmap v1423: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:29 smithi082 ceph-mon[94281]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:39.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:30 smithi082 ceph-mon[94281]: pgmap v1424: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:31 smithi082 ceph-mon[94281]: pgmap v1425: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:39.673 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:33 smithi082 ceph-mon[94281]: pgmap v1426: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.673 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:36 smithi082 ceph-mon[94281]: pgmap v1427: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:39.673 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:38 smithi082 ceph-mon[94281]: pgmap v1428: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:39.729 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:31:41.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:40 smithi078 ceph-mon[94114]: pgmap v1429: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:42.145 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:40 smithi082 ceph-mon[94281]: pgmap v1429: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:42.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:40 smithi035 ceph-mon[92535]: pgmap v1429: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:42.787 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 -- 172.21.15.35:0/3169833664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd01014f0 msgr2=0x7f5bd0101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3169833664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd01014f0 0x7f5bd0101940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009990 tx=0x7f5bc4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 -- 172.21.15.35:0/3169833664 shutdown_connections 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3169833664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd0101e80 0x7f5bd0108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3169833664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01002f0 0x7f5bd0100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3169833664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd01014f0 0x7f5bd0101940 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.953+0000 7f5bd7757700 1 -- 172.21.15.35:0/3169833664 >> 172.21.15.35:0/3169833664 conn(0x7f5bd00fb900 msgr2=0x7f5bd00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:31:45.233 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 -- 172.21.15.35:0/3169833664 shutdown_connections 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 -- 172.21.15.35:0/3169833664 wait complete. 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 Processor -- start 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 -- start start 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd01002f0 0x7f5bd0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01014f0 0x7f5bd0198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 0x7f5bd019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd019fcd0 con 0x7f5bd0101e80 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd019fe10 con 0x7f5bd01002f0 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd7757700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd019ffa0 con 0x7f5bd01014f0 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.954+0000 7f5bd5cf4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 0x7f5bd019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 0x7f5bd019f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41058/0 (socket says 172.21.15.35:41058) 2023-03-17T08:31:45.234 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 -- 172.21.15.35:0/3607180161 learned_addr learned my addr 172.21.15.35:0/3607180161 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:31:47.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd54f3700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd01002f0 0x7f5bd0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:47.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd4cf2700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01014f0 0x7f5bd0198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:47.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 -- 172.21.15.35:0/3607180161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01014f0 msgr2=0x7f5bd0198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:47.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01014f0 0x7f5bd0198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:47.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 -- 172.21.15.35:0/3607180161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd01002f0 msgr2=0x7f5bd0198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:48.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd01002f0 0x7f5bd0198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:48.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 -- 172.21.15.35:0/3607180161 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc40095f0 con 0x7f5bd0101e80 2023-03-17T08:31:48.921 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd4cf2700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01014f0 0x7f5bd0198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:31:48.922 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd54f3700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd01002f0 0x7f5bd0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:31:48.922 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd5cf4700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 0x7f5bd019f700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800ef60 tx=0x7f5bc800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:31:48.922 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8018070 con 0x7f5bd0101e80 2023-03-17T08:31:48.922 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bc800f040 con 0x7f5bd0101e80 2023-03-17T08:31:48.922 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8003d30 con 0x7f5bd0101e80 2023-03-17T08:31:50.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd010bba0 con 0x7f5bd0101e80 2023-03-17T08:31:52.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.955+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd010ba10 con 0x7f5bd0101e80 2023-03-17T08:31:52.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.956+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd01a0650 con 0x7f5bd0101e80 2023-03-17T08:31:52.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.957+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f5bc8004ad0 con 0x7f5bd0101e80 2023-03-17T08:31:52.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.958+0000 7f5bc27fc700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5bbc09f4d0 0x7f5bbc0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:31:52.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.958+0000 7f5bd54f3700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5bbc09f4d0 0x7f5bbc0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:31:52.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.958+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5bc80ca800 con 0x7f5bd0101e80 2023-03-17T08:31:52.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.959+0000 7f5bd54f3700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5bbc09f4d0 0x7f5bbc0a1980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0101350 tx=0x7f5bcc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:31:54.022 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:40.962+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f5bc8094a20 con 0x7f5bd0101e80 2023-03-17T08:31:54.022 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.167+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bd0107f20 con 0x7f5bbc09f4d0 2023-03-17T08:31:54.022 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.169+0000 7f5bc27fc700 1 -- 172.21.15.35:0/3607180161 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7f5bd0107f20 con 0x7f5bbc09f4d0 2023-03-17T08:31:54.023 INFO:teuthology.orchestra.run.smithi035.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-03-17T08:31:54.023 INFO:teuthology.orchestra.run.smithi035.stdout:smithi035 /dev/nvme0n1 ssd INTEL_SSDPEDMX012T4_CVPD5170000L1P2LGN 1200G No 24m ago LVM detected, locked 2023-03-17T08:31:54.023 INFO:teuthology.orchestra.run.smithi035.stdout:smithi078 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QR400BGN 400G No 23m ago LVM detected, locked 2023-03-17T08:31:54.023 INFO:teuthology.orchestra.run.smithi035.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 400G No 22m ago LVM detected, locked 2023-03-17T08:31:54.024 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5bbc09f4d0 msgr2=0x7f5bbc0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:54.024 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5bbc09f4d0 0x7f5bbc0a1980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0101350 tx=0x7f5bcc008040 comp rx=0 tx=0).stop 2023-03-17T08:31:54.024 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 msgr2=0x7f5bd019f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 0x7f5bd019f700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800ef60 tx=0x7f5bc800ef90 comp rx=0 tx=0).stop 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 shutdown_connections 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5bbc09f4d0 0x7f5bbc0a1980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bd0101e80 0x7f5bd019f700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd01002f0 0x7f5bd0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 --2- 172.21.15.35:0/3607180161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bd01014f0 0x7f5bd0198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 >> 172.21.15.35:0/3607180161 conn(0x7f5bd00fb900 msgr2=0x7f5bd00fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 shutdown_connections 2023-03-17T08:31:54.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:41.171+0000 7f5bd7757700 1 -- 172.21.15.35:0/3607180161 wait complete. 2023-03-17T08:31:54.025 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-03-17T08:31:54.035 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T08:31:55.539 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph fs dump' 2023-03-17T08:31:55.540 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:42 smithi035 ceph-mon[92535]: pgmap v1430: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:55.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:42 smithi035 ceph-mon[92535]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:55.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:44 smithi035 ceph-mon[92535]: pgmap v1431: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:55.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:46 smithi035 ceph-mon[92535]: pgmap v1432: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:55.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:48 smithi035 ceph-mon[92535]: pgmap v1433: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:55.541 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:50 smithi035 ceph-mon[92535]: pgmap v1434: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:52 smithi035 ceph-mon[92535]: pgmap v1435: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:56.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:54 smithi035 ceph-mon[92535]: pgmap v1436: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:56.152 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:42 smithi078 ceph-mon[94114]: pgmap v1430: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:57.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:42 smithi078 ceph-mon[94114]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:57.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:44 smithi078 ceph-mon[94114]: pgmap v1431: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:58.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:46 smithi078 ceph-mon[94114]: pgmap v1432: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:59.962 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:48 smithi078 ceph-mon[94114]: pgmap v1433: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.962 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:50 smithi078 ceph-mon[94114]: pgmap v1434: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.962 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:52 smithi078 ceph-mon[94114]: pgmap v1435: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:59.962 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:54 smithi078 ceph-mon[94114]: pgmap v1436: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:42 smithi082 ceph-mon[94281]: pgmap v1430: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:59.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:42 smithi082 ceph-mon[94281]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:31:59.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:44 smithi082 ceph-mon[94281]: pgmap v1431: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:46 smithi082 ceph-mon[94281]: pgmap v1432: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:31:59.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:48 smithi082 ceph-mon[94281]: pgmap v1433: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:50 smithi082 ceph-mon[94281]: pgmap v1434: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:52 smithi082 ceph-mon[94281]: pgmap v1435: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:31:59.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:54 smithi082 ceph-mon[94281]: pgmap v1436: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:31:59.965 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:32:01.153 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:56 smithi078 ceph-mon[94114]: pgmap v1437: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:01.153 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:58 smithi078 ceph-mon[94114]: pgmap v1438: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:01.153 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:31:58 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3466577708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-03-17T08:32:01.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:56 smithi082 ceph-mon[94281]: pgmap v1437: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:01.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:58 smithi082 ceph-mon[94281]: pgmap v1438: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:01.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:31:58 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3466577708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-03-17T08:32:02.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:56 smithi035 ceph-mon[92535]: pgmap v1437: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:02.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:00 smithi078 ceph-mon[94114]: pgmap v1439: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:02.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:00 smithi082 ceph-mon[94281]: pgmap v1439: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:02.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 -- 172.21.15.35:0/2701836550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 msgr2=0x7f62d01075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:02.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 --2- 172.21.15.35:0/2701836550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d01075c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f62c800b0a0 tx=0x7f62c800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:32:02.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 -- 172.21.15.35:0/2701836550 shutdown_connections 2023-03-17T08:32:02.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 --2- 172.21.15.35:0/2701836550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d01075c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:02.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 --2- 172.21.15.35:0/2701836550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d00ff170 0x7f62d00ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:02.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 --2- 172.21.15.35:0/2701836550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0100370 0x7f62d01007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:02.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 -- 172.21.15.35:0/2701836550 >> 172.21.15.35:0/2701836550 conn(0x7f62d00fa780 msgr2=0x7f62d00fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:02.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 -- 172.21.15.35:0/2701836550 shutdown_connections 2023-03-17T08:32:03.427 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.028+0000 7f62d657a700 1 -- 172.21.15.35:0/2701836550 wait complete. 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 Processor -- start 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 -- start start 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d00ff170 0x7f62d0194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d0100370 0x7f62d01953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d019c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d019ca30 con 0x7f62d0100d00 2023-03-17T08:32:04.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d019cb70 con 0x7f62d0100370 2023-03-17T08:32:05.136 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d657a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d019cd00 con 0x7f62d00ff170 2023-03-17T08:32:05.136 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d4b17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d019c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:05.136 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d4b17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d019c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41082/0 (socket says 172.21.15.35:41082) 2023-03-17T08:32:05.136 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62d4b17700 1 -- 172.21.15.35:0/3466577708 learned_addr learned my addr 172.21.15.35:0/3466577708 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:32:05.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.029+0000 7f62cffff700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d00ff170 0x7f62d0194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:05.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62cf7fe700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d0100370 0x7f62d01953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:05.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d4b17700 1 -- 172.21.15.35:0/3466577708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d00ff170 msgr2=0x7f62d0194ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:05.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d4b17700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d00ff170 0x7f62d0194ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:05.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d4b17700 1 -- 172.21.15.35:0/3466577708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d0100370 msgr2=0x7f62d01953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d4b17700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d0100370 0x7f62d01953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d4b17700 1 -- 172.21.15.35:0/3466577708 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c8009d00 con 0x7f62d0100d00 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62cf7fe700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d0100370 0x7f62d01953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d4b17700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d019c460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62c800b070 tx=0x7f62c8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800e040 con 0x7f62d0100d00 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d010a980 con 0x7f62d0100d00 2023-03-17T08:32:05.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62c8003c00 con 0x7f62d0100d00 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8004280 con 0x7f62d0100d00 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.030+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d010a7f0 con 0x7f62d0100d00 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.031+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d00688a0 con 0x7f62d0100d00 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.032+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f62c801a6d0 con 0x7f62d0100d00 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.033+0000 7f62cd7fa700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f62b809f4d0 0x7f62b80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.033+0000 7f62cffff700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f62b809f4d0 0x7f62b80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.033+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f62c80cd830 con 0x7f62d0100d00 2023-03-17T08:32:05.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.033+0000 7f62cffff700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f62b809f4d0 0x7f62b80a1980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62d01001d0 tx=0x7f62c000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:05.657 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.037+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f62c80979b0 con 0x7f62d0100d00 2023-03-17T08:32:05.657 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.280+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62d01060c0 con 0x7f62d0100d00 2023-03-17T08:32:05.657 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.280+0000 7f62cd7fa700 1 -- 172.21.15.35:0/3466577708 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+2920 (secure 0 0 0) 0x7f62c809afd0 con 0x7f62d0100d00 2023-03-17T08:32:05.657 INFO:teuthology.orchestra.run.smithi035.stdout:e29 2023-03-17T08:32:06.937 INFO:teuthology.orchestra.run.smithi035.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-03-17T08:32:06.937 INFO:teuthology.orchestra.run.smithi035.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-17T08:32:06.937 INFO:teuthology.orchestra.run.smithi035.stdout:legacy client fscid: 1 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:Filesystem 'cephfs' (1) 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:fs_name cephfs 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:epoch 29 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:created 2023-03-17T08:13:31.987985+0000 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:modified 2023-03-17T08:15:35.363809+0000 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:tableserver 0 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:root 0 2023-03-17T08:32:07.535 INFO:teuthology.orchestra.run.smithi035.stdout:session_timeout 300 2023-03-17T08:32:09.276 INFO:teuthology.orchestra.run.smithi035.stdout:session_autoclose 300 2023-03-17T08:32:09.276 INFO:teuthology.orchestra.run.smithi035.stdout:max_file_size 1099511627776 2023-03-17T08:32:09.276 INFO:teuthology.orchestra.run.smithi035.stdout:max_xattr_size 65536 2023-03-17T08:32:09.276 INFO:teuthology.orchestra.run.smithi035.stdout:required_client_features {} 2023-03-17T08:32:09.276 INFO:teuthology.orchestra.run.smithi035.stdout:last_failure 0 2023-03-17T08:32:09.276 INFO:teuthology.orchestra.run.smithi035.stdout:last_failure_osd_epoch 0 2023-03-17T08:32:09.277 INFO:teuthology.orchestra.run.smithi035.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-03-17T08:32:09.826 INFO:teuthology.orchestra.run.smithi035.stdout:max_mds 5 2023-03-17T08:32:09.826 INFO:teuthology.orchestra.run.smithi035.stdout:in 0,1,2,3,4 2023-03-17T08:32:09.826 INFO:teuthology.orchestra.run.smithi035.stdout:up {0=24452,1=24451,2=24445,3=24439,4=24431} 2023-03-17T08:32:10.520 INFO:teuthology.orchestra.run.smithi035.stdout:failed 2023-03-17T08:32:10.520 INFO:teuthology.orchestra.run.smithi035.stdout:damaged 2023-03-17T08:32:10.520 INFO:teuthology.orchestra.run.smithi035.stdout:stopped 2023-03-17T08:32:10.520 INFO:teuthology.orchestra.run.smithi035.stdout:data_pools [3] 2023-03-17T08:32:10.520 INFO:teuthology.orchestra.run.smithi035.stdout:metadata_pool 2 2023-03-17T08:32:10.521 INFO:teuthology.orchestra.run.smithi035.stdout:inline_data disabled 2023-03-17T08:32:10.521 INFO:teuthology.orchestra.run.smithi035.stdout:balancer 2023-03-17T08:32:10.521 INFO:teuthology.orchestra.run.smithi035.stdout:bal_rank_mask -1 2023-03-17T08:32:11.710 INFO:teuthology.orchestra.run.smithi035.stdout:standby_count_wanted 0 2023-03-17T08:32:11.710 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.b{0:24452} state up:active seq 46 addr [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:11.710 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.e{0:24419} state up:standby-replay seq 1 addr [v2:172.21.15.78:6834/3131921401,v1:172.21.15.78:6835/3131921401] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:11.710 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.i{1:24451} state up:active seq 66 addr [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.l{1:24415} state up:standby-replay seq 1 addr [v2:172.21.15.82:6832/1456535346,v1:172.21.15.82:6833/1456535346] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.c{2:24445} state up:active seq 68 addr [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.k{2:24404} state up:standby-replay seq 1 addr [v2:172.21.15.78:6832/3173843386,v1:172.21.15.78:6833/3173843386] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.f{3:24439} state up:active seq 68 addr [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.a{3:14517} state up:standby-replay seq 1 addr [v2:172.21.15.35:6840/3680182485,v1:172.21.15.35:6841/3680182485] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.h{4:24431} state up:active seq 68 addr [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.g{4:14511} state up:standby-replay seq 1 addr [v2:172.21.15.35:6838/1982578351,v1:172.21.15.35:6839/1982578351] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout:Standby daemons: 2023-03-17T08:32:12.305 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:32:12.306 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.j{-1:14481} state up:standby seq 1 addr [v2:172.21.15.35:6834/3728573608,v1:172.21.15.35:6835/3728573608] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.306 INFO:teuthology.orchestra.run.smithi035.stdout:[mds.d{-1:14487} state up:standby seq 1 addr [v2:172.21.15.35:6836/623104731,v1:172.21.15.35:6837/623104731] compat {c=[1],r=[1],i=[7ff]}] 2023-03-17T08:32:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.282+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f62b809f4d0 msgr2=0x7f62b80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.282+0000 7f62d657a700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f62b809f4d0 0x7f62b80a1980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62d01001d0 tx=0x7f62c000a380 comp rx=0 tx=0).stop 2023-03-17T08:32:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.282+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 msgr2=0x7f62d019c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.282+0000 7f62d657a700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d019c460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f62c800b070 tx=0x7f62c8004c80 comp rx=0 tx=0).stop 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 shutdown_connections 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f62b809f4d0 0x7f62b80a1980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f62d0100d00 0x7f62d019c460 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d00ff170 0x7f62d0194ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 --2- 172.21.15.35:0/3466577708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62d0100370 0x7f62d01953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 >> 172.21.15.35:0/3466577708 conn(0x7f62d00fa780 msgr2=0x7f62d00fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 shutdown_connections 2023-03-17T08:32:13.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:31:58.283+0000 7f62d657a700 1 -- 172.21.15.35:0/3466577708 wait complete. 2023-03-17T08:32:13.702 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:32:13.702 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- bash -c 'ceph osd dump' 2023-03-17T08:32:13.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:02 smithi078 ceph-mon[94114]: pgmap v1440: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:15.161 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:04 smithi078 ceph-mon[94114]: pgmap v1441: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:06 smithi078 ceph-mon[94114]: pgmap v1442: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:07 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:08 smithi078 ceph-mon[94114]: pgmap v1443: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:10 smithi078 ceph-mon[94114]: pgmap v1444: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:12 smithi078 ceph-mon[94114]: pgmap v1445: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:02 smithi082 ceph-mon[94281]: pgmap v1440: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:04 smithi082 ceph-mon[94281]: pgmap v1441: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:06 smithi082 ceph-mon[94281]: pgmap v1442: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:07 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:08 smithi082 ceph-mon[94281]: pgmap v1443: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:10 smithi082 ceph-mon[94281]: pgmap v1444: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:12 smithi082 ceph-mon[94281]: pgmap v1445: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:58 smithi035 ceph-mon[92535]: pgmap v1438: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:31:58 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3466577708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:00 smithi035 ceph-mon[92535]: pgmap v1439: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:02 smithi035 ceph-mon[92535]: pgmap v1440: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:04 smithi035 ceph-mon[92535]: pgmap v1441: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:06 smithi035 ceph-mon[92535]: pgmap v1442: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:07 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:32:16.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:08 smithi035 ceph-mon[92535]: pgmap v1443: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:32:16.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:32:16.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:32:16.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:10 smithi035 ceph-mon[92535]: pgmap v1444: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:16.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:12 smithi035 ceph-mon[92535]: pgmap v1445: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:16.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:14 smithi035 ceph-mon[92535]: pgmap v1446: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:17.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:14 smithi078 ceph-mon[94114]: pgmap v1446: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:17.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:14 smithi082 ceph-mon[94281]: pgmap v1446: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:17.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:16 smithi078 ceph-mon[94114]: pgmap v1447: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:19.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:16 smithi082 ceph-mon[94281]: pgmap v1447: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:19.200 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:32:19.200 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:16 smithi035 ceph-mon[92535]: pgmap v1447: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:19.202 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:18 smithi078 ceph-mon[94114]: pgmap v1448: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:21.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:18 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/453384839' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-03-17T08:32:21.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:18 smithi082 ceph-mon[94281]: pgmap v1448: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:21.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:18 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/453384839' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-03-17T08:32:21.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 -- 172.21.15.35:0/3726773119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d90100d00 msgr2=0x7f4d901075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:23.209 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 --2- 172.21.15.35:0/3726773119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d90100d00 0x7f4d901075c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800b0a0 tx=0x7f4d8800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:32:23.209 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 -- 172.21.15.35:0/3726773119 shutdown_connections 2023-03-17T08:32:23.209 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 --2- 172.21.15.35:0/3726773119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d90100d00 0x7f4d901075c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 --2- 172.21.15.35:0/3726773119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d900ff170 0x7f4d900ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 --2- 172.21.15.35:0/3726773119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100370 0x7f4d901007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.059+0000 7f4d96add700 1 -- 172.21.15.35:0/3726773119 >> 172.21.15.35:0/3726773119 conn(0x7f4d900fa780 msgr2=0x7f4d900fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.060+0000 7f4d96add700 1 -- 172.21.15.35:0/3726773119 shutdown_connections 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.060+0000 7f4d96add700 1 -- 172.21.15.35:0/3726773119 wait complete. 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 Processor -- start 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 -- start start 2023-03-17T08:32:23.210 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 0x7f4d901961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:23.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d90100370 0x7f4d901966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:23.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100d00 0x7f4d9019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:23.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9019dd30 con 0x7f4d900ff170 2023-03-17T08:32:23.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9019de70 con 0x7f4d90100d00 2023-03-17T08:32:23.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d96add700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9019e000 con 0x7f4d90100370 2023-03-17T08:32:24.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d94879700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 0x7f4d901961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:24.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d94879700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 0x7f4d901961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41092/0 (socket says 172.21.15.35:41092) 2023-03-17T08:32:24.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d94879700 1 -- 172.21.15.35:0/453384839 learned_addr learned my addr 172.21.15.35:0/453384839 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:32:26.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d9507a700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100d00 0x7f4d9019d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:26.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.061+0000 7f4d8ffff700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d90100370 0x7f4d901966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:26.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d94879700 1 -- 172.21.15.35:0/453384839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d90100370 msgr2=0x7f4d901966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:26.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d94879700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d90100370 0x7f4d901966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:26.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d94879700 1 -- 172.21.15.35:0/453384839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100d00 msgr2=0x7f4d9019d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:26.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d94879700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100d00 0x7f4d9019d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:26.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d94879700 1 -- 172.21.15.35:0/453384839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88009d00 con 0x7f4d900ff170 2023-03-17T08:32:27.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d9507a700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100d00 0x7f4d9019d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:32:27.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d94879700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 0x7f4d901961a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400b530 tx=0x7f4d8400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:27.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84011830 con 0x7f4d900ff170 2023-03-17T08:32:27.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d84011e20 con 0x7f4d900ff170 2023-03-17T08:32:27.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9010aa90 con 0x7f4d900ff170 2023-03-17T08:32:27.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84010dd0 con 0x7f4d900ff170 2023-03-17T08:32:27.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.062+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9010a900 con 0x7f4d900ff170 2023-03-17T08:32:27.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.063+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9019e810 con 0x7f4d900ff170 2023-03-17T08:32:27.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.064+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f4d84011990 con 0x7f4d900ff170 2023-03-17T08:32:27.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.065+0000 7f4d8dffb700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d8009f550 0x7f4d800a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.065+0000 7f4d8ffff700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d8009f550 0x7f4d800a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.065+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4d840c9d10 con 0x7f4d900ff170 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.065+0000 7f4d8ffff700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d8009f550 0x7f4d800a1a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.069+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f4d840cf020 con 0x7f4d900ff170 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.267+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f4d9019edc0 con 0x7f4d900ff170 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.268+0000 7f4d8dffb700 1 -- 172.21.15.35:0/453384839 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) v1 ==== 56+0+5193 (secure 0 0 0) 0x7f4d84015070 con 0x7f4d900ff170 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stdout:epoch 91 2023-03-17T08:32:28.826 INFO:teuthology.orchestra.run.smithi035.stdout:fsid 80b32574-c497-11ed-9afb-001a4aab830c 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:created 2023-03-17T07:45:49.222602+0000 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:modified 2023-03-17T08:13:43.298886+0000 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:crush_version 26 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:full_ratio 0.95 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:backfillfull_ratio 0.9 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:nearfull_ratio 0.85 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:require_min_compat_client luminous 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:min_compat_client luminous 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:require_osd_release reef 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:stretch_mode_enabled false 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:max_osd 12 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.35:6802/1205838363,v1:172.21.15.35:6803/1205838363] [v2:172.21.15.35:6804/1205838363,v1:172.21.15.35:6805/1205838363] exists,up 747adca4-1ffd-4d6f-959f-8f2cc8b71782 2023-03-17T08:32:28.827 INFO:teuthology.orchestra.run.smithi035.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6800/3727253677,v1:172.21.15.78:6801/3727253677] [v2:172.21.15.78:6802/3727253677,v1:172.21.15.78:6803/3727253677] exists,up 1ec58882-7916-437c-b210-38afc3a391f6 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/191062504,v1:172.21.15.82:6801/191062504] [v2:172.21.15.82:6802/191062504,v1:172.21.15.82:6803/191062504] exists,up 2359345e-1870-4b03-803a-5ab6ae403e78 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.3 up in weight 1 up_from 26 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.35:6810/2296850572,v1:172.21.15.35:6811/2296850572] [v2:172.21.15.35:6812/2296850572,v1:172.21.15.35:6813/2296850572] exists,up 2c236cee-6090-4bd3-855b-1b0807335333 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.4 up in weight 1 up_from 34 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6808/3925179759,v1:172.21.15.78:6809/3925179759] [v2:172.21.15.78:6810/3925179759,v1:172.21.15.78:6811/3925179759] exists,up c2a94d43-e076-49ee-85bc-723575af1907 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.5 up in weight 1 up_from 39 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6808/3768446806,v1:172.21.15.82:6809/3768446806] [v2:172.21.15.82:6810/3768446806,v1:172.21.15.82:6811/3768446806] exists,up 955eccc0-b6f3-4b18-a929-577d360f315d 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.6 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.35:6818/1961965339,v1:172.21.15.35:6819/1961965339] [v2:172.21.15.35:6820/1961965339,v1:172.21.15.35:6821/1961965339] exists,up bf1b5136-d013-4824-8907-958e6fe0f471 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.7 up in weight 1 up_from 52 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6816/403506254,v1:172.21.15.78:6817/403506254] [v2:172.21.15.78:6818/403506254,v1:172.21.15.78:6819/403506254] exists,up 9212f7b3-e1a7-4ea7-8666-55936c0c401d 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.8 up in weight 1 up_from 60 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6816/1378962246,v1:172.21.15.82:6817/1378962246] [v2:172.21.15.82:6818/1378962246,v1:172.21.15.82:6819/1378962246] exists,up 402f50a6-8d44-4cad-ba4b-273831715b55 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.9 up in weight 1 up_from 68 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.35:6826/105910462,v1:172.21.15.35:6827/105910462] [v2:172.21.15.35:6828/105910462,v1:172.21.15.35:6829/105910462] exists,up c0d57d1e-141a-4e96-8d1f-53af74dd4571 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.10 up in weight 1 up_from 73 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6824/2850996508,v1:172.21.15.78:6825/2850996508] [v2:172.21.15.78:6826/2850996508,v1:172.21.15.78:6827/2850996508] exists,up 61299bd0-4891-41b3-b39b-24d35fe313f3 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:osd.11 up in weight 1 up_from 81 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6824/77409820,v1:172.21.15.82:6825/77409820] [v2:172.21.15.82:6826/77409820,v1:172.21.15.82:6827/77409820] exists,up 2b477025-7de4-4b85-8c90-19d2388da71b 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:pg_upmap_items 2.f [8,11] 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:pg_upmap_items 2.13 [2,11] 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:pg_upmap_items 2.14 [2,4] 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:pg_upmap_items 3.3 [4,9] 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:pg_upmap_items 3.11 [5,9] 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:pg_upmap_items 3.34 [4,9] 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:0/3966835438 expires 2023-03-18T07:46:42.142153+0000 2023-03-17T08:32:28.828 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:6801/1582063547 expires 2023-03-18T07:46:42.142153+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:6800/1582063547 expires 2023-03-18T07:46:42.142153+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:0/1410246946 expires 2023-03-18T07:46:42.142153+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:0/1232863299 expires 2023-03-18T07:46:16.818211+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:6801/3695297381 expires 2023-03-18T07:46:16.818211+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:0/2484789635 expires 2023-03-18T07:46:16.818211+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:0/1276660583 expires 2023-03-18T07:46:16.818211+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:6800/3695297381 expires 2023-03-18T07:46:16.818211+0000 2023-03-17T08:32:28.829 INFO:teuthology.orchestra.run.smithi035.stdout:blocklist 172.21.15.35:0/2098044192 expires 2023-03-18T07:46:42.142153+0000 2023-03-17T08:32:28.830 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d8009f550 msgr2=0x7f4d800a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:29.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d8009f550 0x7f4d800a1a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c006fd0 tx=0x7f4d7c008040 comp rx=0 tx=0).stop 2023-03-17T08:32:29.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 msgr2=0x7f4d901961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:29.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 0x7f4d901961a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400b530 tx=0x7f4d8400b8f0 comp rx=0 tx=0).stop 2023-03-17T08:32:29.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 shutdown_connections 2023-03-17T08:32:29.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d90100d00 0x7f4d9019d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:30.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d8009f550 0x7f4d800a1a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:31.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d900ff170 0x7f4d901961a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:31.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 --2- 172.21.15.35:0/453384839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d90100370 0x7f4d901966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:31.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 >> 172.21.15.35:0/453384839 conn(0x7f4d900fa780 msgr2=0x7f4d900fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:31.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 shutdown_connections 2023-03-17T08:32:31.459 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:18.270+0000 7f4d96add700 1 -- 172.21.15.35:0/453384839 wait complete. 2023-03-17T08:32:31.460 INFO:teuthology.run_tasks:Running task fs.ready... 2023-03-17T08:32:31.472 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:32:32.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:18 smithi035 ceph-mon[92535]: pgmap v1448: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:18 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/453384839' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-03-17T08:32:33.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:20 smithi035 ceph-mon[92535]: pgmap v1449: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:22 smithi035 ceph-mon[92535]: pgmap v1450: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:33.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:24 smithi035 ceph-mon[92535]: pgmap v1451: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:26 smithi035 ceph-mon[92535]: pgmap v1452: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:33.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:28 smithi035 ceph-mon[92535]: pgmap v1453: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:30 smithi035 ceph-mon[92535]: pgmap v1454: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.539 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:20 smithi078 ceph-mon[94114]: pgmap v1449: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.540 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:22 smithi078 ceph-mon[94114]: pgmap v1450: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:33.540 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:24 smithi078 ceph-mon[94114]: pgmap v1451: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:33.540 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:26 smithi078 ceph-mon[94114]: pgmap v1452: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:33.540 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:28 smithi078 ceph-mon[94114]: pgmap v1453: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:34.359 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:30 smithi078 ceph-mon[94114]: pgmap v1454: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:36.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:32 smithi078 ceph-mon[94114]: pgmap v1455: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:37.106 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:20 smithi082 ceph-mon[94281]: pgmap v1449: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:37.106 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:22 smithi082 ceph-mon[94281]: pgmap v1450: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:37.106 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:24 smithi082 ceph-mon[94281]: pgmap v1451: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:38.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:26 smithi082 ceph-mon[94281]: pgmap v1452: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:40.372 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:28 smithi082 ceph-mon[94281]: pgmap v1453: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:40.375 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:30 smithi082 ceph-mon[94281]: pgmap v1454: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:40.375 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:32 smithi082 ceph-mon[94281]: pgmap v1455: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:40.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:32 smithi035 ceph-mon[92535]: pgmap v1455: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:41.020 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:34 smithi082 ceph-mon[94281]: pgmap v1456: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:41.364 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:34 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2060774175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:32:41.364 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:36 smithi082 ceph-mon[94281]: pgmap v1457: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:41.364 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:38 smithi082 ceph-mon[94281]: pgmap v1458: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:41.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:34 smithi078 ceph-mon[94114]: pgmap v1456: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:42.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:34 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2060774175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:32:42.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:36 smithi078 ceph-mon[94114]: pgmap v1457: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:42.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:38 smithi078 ceph-mon[94114]: pgmap v1458: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:42.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:40 smithi078 ceph-mon[94114]: pgmap v1459: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:42.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:40 smithi082 ceph-mon[94281]: pgmap v1459: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:42.221 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 -- 172.21.15.35:0/3348061070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0103600 msgr2=0x7f46d01059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 --2- 172.21.15.35:0/3348061070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0103600 0x7f46d01059e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009990 tx=0x7f46cc009ca0 comp rx=0 tx=0).stop 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 -- 172.21.15.35:0/3348061070 shutdown_connections 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 --2- 172.21.15.35:0/3348061070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d0105f20 0x7f46d0108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 --2- 172.21.15.35:0/3348061070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0100ce0 0x7f46d01030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 --2- 172.21.15.35:0/3348061070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0103600 0x7f46d01059e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 -- 172.21.15.35:0/3348061070 >> 172.21.15.35:0/3348061070 conn(0x7f46d00fa760 msgr2=0x7f46d00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 -- 172.21.15.35:0/3348061070 shutdown_connections 2023-03-17T08:32:42.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.681+0000 7f46d73ed700 1 -- 172.21.15.35:0/3348061070 wait complete. 2023-03-17T08:32:44.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 Processor -- start 2023-03-17T08:32:44.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 -- start start 2023-03-17T08:32:44.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 0x7f46d0195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:44.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d0103600 0x7f46d01962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:44.211 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0105f20 0x7f46d019d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:46.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d019d8f0 con 0x7f46d0100ce0 2023-03-17T08:32:46.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d019da60 con 0x7f46d0105f20 2023-03-17T08:32:46.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d73ed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d019dc20 con 0x7f46d0103600 2023-03-17T08:32:46.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d5189700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 0x7f46d0195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:46.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d5189700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 0x7f46d0195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41106/0 (socket says 172.21.15.35:41106) 2023-03-17T08:32:46.905 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d5189700 1 -- 172.21.15.35:0/2060774175 learned_addr learned my addr 172.21.15.35:0/2060774175 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:32:47.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.682+0000 7f46d4988700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d0103600 0x7f46d01962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:48.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d598a700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0105f20 0x7f46d019d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:48.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d5189700 1 -- 172.21.15.35:0/2060774175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d0103600 msgr2=0x7f46d01962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:48.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d5189700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d0103600 0x7f46d01962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:48.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d5189700 1 -- 172.21.15.35:0/2060774175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0105f20 msgr2=0x7f46d019d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:48.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d5189700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0105f20 0x7f46d019d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:48.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d5189700 1 -- 172.21.15.35:0/2060774175 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc0095f0 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d598a700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0105f20 0x7f46d019d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d5189700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 0x7f46d0195db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c9b0 tx=0x7f46c000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0007b00 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c0007c60 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d010ba60 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0018660 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.683+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d010b8d0 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.684+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d00fc2d0 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.685+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f46c000f450 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.686+0000 7f46c67fc700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f46bc09f4d0 0x7f46bc0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.686+0000 7f46d4988700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f46bc09f4d0 0x7f46bc0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.686+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f46c00ca280 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.686+0000 7f46d4988700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f46bc09f4d0 0x7f46bc0a1980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00b5c0 tx=0x7f46cc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.690+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f46c0094370 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.890+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46d002d010 con 0x7f46d0100ce0 2023-03-17T08:32:48.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.892+0000 7f46c67fc700 1 -- 172.21.15.35:0/2060774175 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f46c000fe60 con 0x7f46d0100ce0 2023-03-17T08:32:48.411 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:32:48.411 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:42 smithi078 ceph-mon[94114]: pgmap v1460: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:44 smithi078 ceph-mon[94114]: pgmap v1461: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:45 smithi078 ceph-mon[94114]: pgmap v1462: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:47 smithi078 ceph-mon[94114]: pgmap v1463: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:42 smithi082 ceph-mon[94281]: pgmap v1460: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:44 smithi082 ceph-mon[94281]: pgmap v1461: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:45 smithi082 ceph-mon[94281]: pgmap v1462: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:49.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:47 smithi082 ceph-mon[94281]: pgmap v1463: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:49.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f46bc09f4d0 msgr2=0x7f46bc0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:49.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f46bc09f4d0 0x7f46bc0a1980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00b5c0 tx=0x7f46cc005fd0 comp rx=0 tx=0).stop 2023-03-17T08:32:49.162 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 msgr2=0x7f46d0195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:49.163 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 0x7f46d0195db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c9b0 tx=0x7f46c000ccc0 comp rx=0 tx=0).stop 2023-03-17T08:32:49.163 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 shutdown_connections 2023-03-17T08:32:50.218 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0105f20 0x7f46d019d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:50.218 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f46bc09f4d0 0x7f46bc0a1980 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:50.218 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f46d0100ce0 0x7f46d0195db0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:50.218 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 --2- 172.21.15.35:0/2060774175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d0103600 0x7f46d01962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:50.218 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 >> 172.21.15.35:0/2060774175 conn(0x7f46d00fa760 msgr2=0x7f46d0101940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:50.218 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 shutdown_connections 2023-03-17T08:32:50.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:33.894+0000 7f46d73ed700 1 -- 172.21.15.35:0/2060774175 wait complete. 2023-03-17T08:32:50.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-17T08:12:42.651944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-17T08:12:54.803875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:32:50.220 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:32:50.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:34 smithi035 ceph-mon[92535]: pgmap v1456: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:50.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:34 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2060774175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:32:50.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:36 smithi035 ceph-mon[92535]: pgmap v1457: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:50.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:38 smithi035 ceph-mon[92535]: pgmap v1458: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:50.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:40 smithi035 ceph-mon[92535]: pgmap v1459: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:50.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:42 smithi035 ceph-mon[92535]: pgmap v1460: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:52.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:44 smithi035 ceph-mon[92535]: pgmap v1461: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:52.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:45 smithi035 ceph-mon[92535]: pgmap v1462: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:52.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:47 smithi035 ceph-mon[92535]: pgmap v1463: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:52.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:50 smithi035 ceph-mon[92535]: pgmap v1464: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:52.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:50 smithi078 ceph-mon[94114]: pgmap v1464: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:52.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:50 smithi082 ceph-mon[94281]: pgmap v1464: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:52.610 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 -- 172.21.15.35:0/2705773032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa4108000 msgr2=0x7f3fa410a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:54.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/2705773032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa4108000 0x7f3fa410a4b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00b0a0 tx=0x7f3f9c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:32:54.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 -- 172.21.15.35:0/2705773032 shutdown_connections 2023-03-17T08:32:54.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/2705773032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa4108000 0x7f3fa410a4b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:54.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/2705773032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 0x7f3fa41051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:55.050 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/2705773032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa41056e0 0x7f3fa4107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:55.050 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 -- 172.21.15.35:0/2705773032 >> 172.21.15.35:0/2705773032 conn(0x7f3fa40fa730 msgr2=0x7f3fa40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:55.050 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 -- 172.21.15.35:0/2705773032 shutdown_connections 2023-03-17T08:32:56.898 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.609+0000 7f3fa8a88700 1 -- 172.21.15.35:0/2705773032 wait complete. 2023-03-17T08:32:56.900 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:52 smithi078 ceph-mon[94114]: pgmap v1465: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:56.900 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/993317142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:32:56.900 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:54 smithi078 ceph-mon[94114]: pgmap v1466: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:56.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:52 smithi082 ceph-mon[94281]: pgmap v1465: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:32:56.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/993317142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:32:56.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:54 smithi082 ceph-mon[94281]: pgmap v1466: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:32:56.901 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:56 smithi082 ceph-mon[94281]: pgmap v1467: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:32:56.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.610+0000 7f3fa8a88700 1 Processor -- start 2023-03-17T08:32:56.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.610+0000 7f3fa8a88700 1 -- start start 2023-03-17T08:32:56.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 0x7f3fa4198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:56.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 0x7f3fa41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:56.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa4108000 0x7f3fa419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:57.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa419fd10 con 0x7f3fa41056e0 2023-03-17T08:32:57.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa419fe50 con 0x7f3fa4068a90 2023-03-17T08:32:57.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa419ffe0 con 0x7f3fa4108000 2023-03-17T08:32:57.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 0x7f3fa41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:57.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 0x7f3fa41986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41122/0 (socket says 172.21.15.35:41122) 2023-03-17T08:32:57.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 -- 172.21.15.35:0/993317142 learned_addr learned my addr 172.21.15.35:0/993317142 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa2d9d700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa4108000 0x7f3fa419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa259c700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 0x7f3fa4198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 -- 172.21.15.35:0/993317142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa4108000 msgr2=0x7f3fa419f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa4108000 0x7f3fa419f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 -- 172.21.15.35:0/993317142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 msgr2=0x7f3fa4198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 0x7f3fa4198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:58.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 -- 172.21.15.35:0/993317142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009d00 con 0x7f3fa41056e0 2023-03-17T08:32:58.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa259c700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 0x7f3fa4198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:32:58.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa1d9b700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 0x7f3fa41986d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800d980 tx=0x7f3f9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98004220 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f98007640 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa410dc40 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980055e0 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.611+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa410dab0 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.612+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa40fc2a0 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.614+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3f98004750 con 0x7f3fa41056e0 2023-03-17T08:32:58.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.615+0000 7f3f937fe700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f4d0 0x7f3f8c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:32:58.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.615+0000 7f3fa259c700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f4d0 0x7f3f8c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:32:58.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.615+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3f980ca5c0 con 0x7f3fa41056e0 2023-03-17T08:32:58.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.615+0000 7f3fa259c700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f4d0 0x7f3f8c0a1980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40687b0 tx=0x7f3f94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:32:58.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.618+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3f980946b0 con 0x7f3fa41056e0 2023-03-17T08:32:58.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.821+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fa40616c0 con 0x7f3fa41056e0 2023-03-17T08:32:58.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.821+0000 7f3f937fe700 1 -- 172.21.15.35:0/993317142 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f98016070 con 0x7f3fa41056e0 2023-03-17T08:32:58.797 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:32:58.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f4d0 msgr2=0x7f3f8c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:59.751 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f4d0 0x7f3f8c0a1980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40687b0 tx=0x7f3f94009260 comp rx=0 tx=0).stop 2023-03-17T08:32:59.752 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 msgr2=0x7f3fa41986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:32:59.752 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 0x7f3fa41986d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800d980 tx=0x7f3f9800dc90 comp rx=0 tx=0).stop 2023-03-17T08:32:59.752 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 shutdown_connections 2023-03-17T08:32:59.752 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fa4108000 0x7f3fa419f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:59.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fa4068a90 0x7f3fa4198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:59.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3f8c09f4d0 0x7f3f8c0a1980 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:59.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 --2- 172.21.15.35:0/993317142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3fa41056e0 0x7f3fa41986d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:32:59.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 >> 172.21.15.35:0/993317142 conn(0x7f3fa40fa730 msgr2=0x7f3fa4106340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:32:59.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 shutdown_connections 2023-03-17T08:32:59.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:32:52.823+0000 7f3fa8a88700 1 -- 172.21.15.35:0/993317142 wait complete. 2023-03-17T08:32:59.962 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:52 smithi035 ceph-mon[92535]: pgmap v1465: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:00.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:32:58 smithi082 ceph-mon[94281]: pgmap v1468: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:00.767 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:56 smithi078 ceph-mon[94114]: pgmap v1467: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:00.767 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:32:58 smithi078 ceph-mon[94114]: pgmap v1468: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:00.767 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-17T08:33:00.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/993317142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:33:00.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:54 smithi035 ceph-mon[92535]: pgmap v1466: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:00.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:56 smithi035 ceph-mon[92535]: pgmap v1467: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:00.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:32:58 smithi035 ceph-mon[92535]: pgmap v1468: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:00.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:00 smithi082 ceph-mon[94281]: pgmap v1469: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:01.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:00 smithi078 ceph-mon[94114]: pgmap v1469: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:01.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.911+0000 7f28c56a9700 1 -- 172.21.15.35:0/3922210285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c00ff130 msgr2=0x7f28c00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3922210285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c00ff130 0x7f28c00ff540 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009990 tx=0x7f28b0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 -- 172.21.15.35:0/3922210285 shutdown_connections 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3922210285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 0x7f28c0107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3922210285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c00ff130 0x7f28c00ff540 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3922210285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c0100320 0x7f28c0100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 -- 172.21.15.35:0/3922210285 >> 172.21.15.35:0/3922210285 conn(0x7f28c00fa750 msgr2=0x7f28c00fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:02.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 -- 172.21.15.35:0/3922210285 shutdown_connections 2023-03-17T08:33:02.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 -- 172.21.15.35:0/3922210285 wait complete. 2023-03-17T08:33:02.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 Processor -- start 2023-03-17T08:33:02.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.912+0000 7f28c56a9700 1 -- start start 2023-03-17T08:33:02.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28c56a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00ff130 0x7f28c0069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:03.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28c56a9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 0x7f28c019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:03.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28c56a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 0x7f28c019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:03.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28c56a9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c019d9e0 con 0x7f28c0100320 2023-03-17T08:33:03.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28c56a9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c019db50 con 0x7f28c00ff130 2023-03-17T08:33:03.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28c56a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c019dd10 con 0x7f28c0100cb0 2023-03-17T08:33:03.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 0x7f28c019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:03.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 0x7f28c019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41136/0 (socket says 172.21.15.35:41136) 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 -- 172.21.15.35:0/3345875906 learned_addr learned my addr 172.21.15.35:0/3345875906 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28beffd700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00ff130 0x7f28c0069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28bf7fe700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 0x7f28c019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 -- 172.21.15.35:0/3345875906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 msgr2=0x7f28c019d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 0x7f28c019d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 -- 172.21.15.35:0/3345875906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00ff130 msgr2=0x7f28c0069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00ff130 0x7f28c0069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:03.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 -- 172.21.15.35:0/3345875906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00095f0 con 0x7f28c0100320 2023-03-17T08:33:04.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28bf7fe700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 0x7f28c019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:33:05.161 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28be7fc700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 0x7f28c019ac00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f28b400c9b0 tx=0x7f28b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:05.161 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.913+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4007b00 con 0x7f28c0100320 2023-03-17T08:33:05.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.914+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28b4007c60 con 0x7f28c0100320 2023-03-17T08:33:05.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.914+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c010a9a0 con 0x7f28c0100320 2023-03-17T08:33:05.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.914+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4018660 con 0x7f28c0100320 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.914+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c010a810 con 0x7f28c0100320 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.914+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c0067e30 con 0x7f28c0100320 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.916+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f28b400f450 con 0x7f28c0100320 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.916+0000 7f28a7fff700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f28a809f4d0 0x7f28a80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.916+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f28b40ca1c0 con 0x7f28c0100320 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.916+0000 7f28beffd700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f28a809f4d0 0x7f28a80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.917+0000 7f28beffd700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f28a809f4d0 0x7f28a80a1980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c010 tx=0x7f28b0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:05.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:00.921+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f28b4094350 con 0x7f28c0100320 2023-03-17T08:33:05.991 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:00 smithi035 ceph-mon[92535]: pgmap v1469: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:05.992 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.120+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28c019ec70 con 0x7f28c0100320 2023-03-17T08:33:06.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.121+0000 7f28a7fff700 1 -- 172.21.15.35:0/3345875906 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28b400fe60 con 0x7f28c0100320 2023-03-17T08:33:07.655 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 32 2023-03-17T08:33:07.656 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f28a809f4d0 msgr2=0x7f28a80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:07.657 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f28a809f4d0 0x7f28a80a1980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c010 tx=0x7f28b0005fd0 comp rx=0 tx=0).stop 2023-03-17T08:33:07.657 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 msgr2=0x7f28c019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:08.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 0x7f28c019ac00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f28b400c9b0 tx=0x7f28b400ccc0 comp rx=0 tx=0).stop 2023-03-17T08:33:08.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 shutdown_connections 2023-03-17T08:33:08.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c0100cb0 0x7f28c019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:08.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00ff130 0x7f28c0069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:08.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f28a809f4d0 0x7f28a80a1980 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:08.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 --2- 172.21.15.35:0/3345875906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f28c0100320 0x7f28c019ac00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:08.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 >> 172.21.15.35:0/3345875906 conn(0x7f28c00fa750 msgr2=0x7f28c00fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:08.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 shutdown_connections 2023-03-17T08:33:08.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:01.123+0000 7f28c56a9700 1 -- 172.21.15.35:0/3345875906 wait complete. 2023-03-17T08:33:08.566 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-17T08:33:08.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:01 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3345875906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:33:11.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:02 smithi035 ceph-mon[92535]: pgmap v1470: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:12.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:04 smithi035 ceph-mon[92535]: pgmap v1471: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:12.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:06 smithi035 ceph-mon[92535]: pgmap v1472: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:12.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:01 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3345875906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:33:12.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:02 smithi082 ceph-mon[94281]: pgmap v1470: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:12.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:04 smithi082 ceph-mon[94281]: pgmap v1471: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:12.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:06 smithi082 ceph-mon[94281]: pgmap v1472: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:12.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:08 smithi082 ceph-mon[94281]: pgmap v1473: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:12.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:08 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:33:12.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:10 smithi082 ceph-mon[94281]: pgmap v1474: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:12.882 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: pgmap v1475: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:13.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:33:13.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:33:13.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:11 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:13.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:01 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3345875906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:33:13.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:02 smithi078 ceph-mon[94114]: pgmap v1470: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:14.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:04 smithi078 ceph-mon[94114]: pgmap v1471: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:14.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:06 smithi078 ceph-mon[94114]: pgmap v1472: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:14.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:08 smithi078 ceph-mon[94114]: pgmap v1473: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:14.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:08 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:33:14.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:10 smithi078 ceph-mon[94114]: pgmap v1474: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: pgmap v1475: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.352 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:33:15.352 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:33:15.352 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:11 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:15.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:12 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/735123105' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:13 smithi082 ceph-mon[94281]: pgmap v1476: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:12 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/735123105' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:13 smithi078 ceph-mon[94114]: pgmap v1476: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:08 smithi035 ceph-mon[92535]: pgmap v1473: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:08 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:10 smithi035 ceph-mon[92535]: pgmap v1474: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: pgmap v1475: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:17.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:19.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:19.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:19.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:19.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:33:19.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:33:19.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:11 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:33:19.436 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:16 smithi082 ceph-mon[94281]: pgmap v1477: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:21.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:18 smithi082 ceph-mon[94281]: pgmap v1478: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:21.257 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:16 smithi078 ceph-mon[94114]: pgmap v1477: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:21.257 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:18 smithi078 ceph-mon[94114]: pgmap v1478: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 -- 172.21.15.35:0/529763823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff710100d50 msgr2=0x7ff7101075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 --2- 172.21.15.35:0/529763823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff710100d50 0x7ff7101075f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff70800b0a0 tx=0x7ff70800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 -- 172.21.15.35:0/529763823 shutdown_connections 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 --2- 172.21.15.35:0/529763823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff710100d50 0x7ff7101075f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 --2- 172.21.15.35:0/529763823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7100ff110 0x7ff7100ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 --2- 172.21.15.35:0/529763823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7101003a0 0x7ff710100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:21.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.553+0000 7ff715dc4700 1 -- 172.21.15.35:0/529763823 >> 172.21.15.35:0/529763823 conn(0x7ff7100fa730 msgr2=0x7ff7100fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:21.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 -- 172.21.15.35:0/529763823 shutdown_connections 2023-03-17T08:33:21.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 -- 172.21.15.35:0/529763823 wait complete. 2023-03-17T08:33:21.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 Processor -- start 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 -- start start 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 0x7ff7100688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7101003a0 0x7ff71019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff710100d50 0x7ff71019d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.554+0000 7ff715dc4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019da30 con 0x7ff7100ff110 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff715dc4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019dba0 con 0x7ff710100d50 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff715dc4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019dd60 con 0x7ff7101003a0 2023-03-17T08:33:22.078 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 0x7ff7100688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:22.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 0x7ff7100688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41146/0 (socket says 172.21.15.35:41146) 2023-03-17T08:33:22.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 -- 172.21.15.35:0/735123105 learned_addr learned my addr 172.21.15.35:0/735123105 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:33:22.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70effd700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7101003a0 0x7ff71019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:22.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 -- 172.21.15.35:0/735123105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7101003a0 msgr2=0x7ff71019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:24.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7101003a0 0x7ff71019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:24.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70ffff700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff710100d50 0x7ff71019d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:24.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 -- 172.21.15.35:0/735123105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff710100d50 msgr2=0x7ff71019d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:24.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff710100d50 0x7ff71019d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:24.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 -- 172.21.15.35:0/735123105 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009d00 con 0x7ff7100ff110 2023-03-17T08:33:24.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70f7fe700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 0x7ff7100688e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff70000d980 tx=0x7ff70000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700004220 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff700007640 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71010a960 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000055e0 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.555+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71010a7d0 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.556+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71019e390 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.557+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff700004750 con 0x7ff7100ff110 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.558+0000 7ff70cff9700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff6fc09f4d0 0x7ff6fc0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:24.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.558+0000 7ff70effd700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff6fc09f4d0 0x7ff6fc0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:24.342 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.558+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff7000ca090 con 0x7ff7100ff110 2023-03-17T08:33:25.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.559+0000 7ff70effd700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff6fc09f4d0 0x7ff6fc0a1980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff710068650 tx=0x7ff6f800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:25.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.562+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff700094220 con 0x7ff7100ff110 2023-03-17T08:33:25.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.765+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff710106100 con 0x7ff7100ff110 2023-03-17T08:33:25.620 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.765+0000 7ff70cff9700 1 -- 172.21.15.35:0/735123105 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff700016070 con 0x7ff7100ff110 2023-03-17T08:33:25.621 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 64 2023-03-17T08:33:25.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:20 smithi082 ceph-mon[94281]: pgmap v1479: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:25.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:22 smithi082 ceph-mon[94281]: pgmap v1480: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:25.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:24 smithi082 ceph-mon[94281]: pgmap v1481: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:26.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:20 smithi078 ceph-mon[94114]: pgmap v1479: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:26.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:22 smithi078 ceph-mon[94114]: pgmap v1480: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:26.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:24 smithi078 ceph-mon[94114]: pgmap v1481: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:26.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff6fc09f4d0 msgr2=0x7ff6fc0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:28.009 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff6fc09f4d0 0x7ff6fc0a1980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff710068650 tx=0x7ff6f800a380 comp rx=0 tx=0).stop 2023-03-17T08:33:28.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 msgr2=0x7ff7100688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:28.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 0x7ff7100688e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff70000d980 tx=0x7ff70000dc90 comp rx=0 tx=0).stop 2023-03-17T08:33:28.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 shutdown_connections 2023-03-17T08:33:28.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff710100d50 0x7ff71019d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:28.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff6fc09f4d0 0x7ff6fc0a1980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:28.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7100ff110 0x7ff7100688e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:28.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 --2- 172.21.15.35:0/735123105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7101003a0 0x7ff71019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:28.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.767+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 >> 172.21.15.35:0/735123105 conn(0x7ff7100fa730 msgr2=0x7ff7100fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:28.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.768+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 shutdown_connections 2023-03-17T08:33:28.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:12.768+0000 7ff715dc4700 1 -- 172.21.15.35:0/735123105 wait complete. 2023-03-17T08:33:28.609 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:33:28.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:26 smithi082 ceph-mon[94281]: pgmap v1482: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:30.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:26 smithi078 ceph-mon[94114]: pgmap v1482: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:30.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:12 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/735123105' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:13 smithi035 ceph-mon[92535]: pgmap v1476: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:16 smithi035 ceph-mon[92535]: pgmap v1477: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:18 smithi035 ceph-mon[92535]: pgmap v1478: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:20 smithi035 ceph-mon[92535]: pgmap v1479: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:22 smithi035 ceph-mon[92535]: pgmap v1480: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:24 smithi035 ceph-mon[92535]: pgmap v1481: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:26 smithi035 ceph-mon[92535]: pgmap v1482: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:31.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:28 smithi035 ceph-mon[92535]: pgmap v1483: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:31.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:28 smithi082 ceph-mon[94281]: pgmap v1483: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:31.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:30 smithi082 ceph-mon[94281]: pgmap v1484: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:32.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:28 smithi078 ceph-mon[94114]: pgmap v1483: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:32.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:30 smithi078 ceph-mon[94114]: pgmap v1484: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:32.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:31 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3838176539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:33:34.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:31 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3838176539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:33:34.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 -- 172.21.15.35:0/2950451464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8100cc0 msgr2=0x7fedf81030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:34.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 --2- 172.21.15.35:0/2950451464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8100cc0 0x7fedf81030a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fede8009990 tx=0x7fede8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:33:34.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 -- 172.21.15.35:0/2950451464 shutdown_connections 2023-03-17T08:33:34.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 --2- 172.21.15.35:0/2950451464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf8105f00 0x7fedf8108300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:35.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 --2- 172.21.15.35:0/2950451464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8100cc0 0x7fedf81030a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 --2- 172.21.15.35:0/2950451464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf81035e0 0x7fedf81059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 -- 172.21.15.35:0/2950451464 >> 172.21.15.35:0/2950451464 conn(0x7fedf80fa6e0 msgr2=0x7fedf80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 -- 172.21.15.35:0/2950451464 shutdown_connections 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.641+0000 7fedfd423700 1 -- 172.21.15.35:0/2950451464 wait complete. 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 Processor -- start 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 -- start start 2023-03-17T08:33:36.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf8100cc0 0x7fedf8195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:36.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf81035e0 0x7fedf81962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:36.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 0x7fedf819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:37.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf819d8f0 con 0x7fedf8105f00 2023-03-17T08:33:37.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf819da60 con 0x7fedf8100cc0 2023-03-17T08:33:37.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.642+0000 7fedfd423700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf819dc20 con 0x7fedf81035e0 2023-03-17T08:33:37.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 0x7fedf819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:37.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 0x7fedf819d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41164/0 (socket says 172.21.15.35:41164) 2023-03-17T08:33:38.455 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 -- 172.21.15.35:0/3838176539 learned_addr learned my addr 172.21.15.35:0/3838176539 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:33:38.455 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf6ffd700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf8100cc0 0x7fedf8195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:38.455 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf67fc700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf81035e0 0x7fedf81962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:38.455 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 -- 172.21.15.35:0/3838176539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf81035e0 msgr2=0x7fedf81962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:38.455 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf81035e0 0x7fedf81962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:39.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 -- 172.21.15.35:0/3838176539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf8100cc0 msgr2=0x7fedf8195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:39.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf8100cc0 0x7fedf8195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:39.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 -- 172.21.15.35:0/3838176539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede80095f0 con 0x7fedf8105f00 2023-03-17T08:33:39.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedf77fe700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 0x7fedf819d320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007970 tx=0x7fedf0007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:39.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0017070 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedf000f040 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf810b9f0 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00139b0 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.643+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf810b860 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.644+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf80fc250 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.645+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fedf000d5e0 con 0x7fedf8105f00 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.646+0000 7feddffff700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fede009f4d0 0x7fede00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.646+0000 7fedf6ffd700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fede009f4d0 0x7fede00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:39.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.647+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fedf00c9fb0 con 0x7fedf8105f00 2023-03-17T08:33:41.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.647+0000 7fedf6ffd700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fede009f4d0 0x7fede00a1980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fede800b5c0 tx=0x7fede8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:41.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.650+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fedf0094140 con 0x7fedf8105f00 2023-03-17T08:33:41.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.901+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf802d010 con 0x7fedf8105f00 2023-03-17T08:33:41.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.902+0000 7feddffff700 1 -- 172.21.15.35:0/3838176539 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7fedf0097760 con 0x7fedf8105f00 2023-03-17T08:33:41.355 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:33:41.356 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fede009f4d0 msgr2=0x7fede00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fede009f4d0 0x7fede00a1980 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fede800b5c0 tx=0x7fede8005fb0 comp rx=0 tx=0).stop 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 msgr2=0x7fedf819d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 0x7fedf819d320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007970 tx=0x7fedf0007c80 comp rx=0 tx=0).stop 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 shutdown_connections 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fede009f4d0 0x7fede00a1980 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:41.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedf8105f00 0x7fedf819d320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:41.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf8100cc0 0x7fedf8195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:41.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 --2- 172.21.15.35:0/3838176539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf81035e0 0x7fedf81962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:41.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 >> 172.21.15.35:0/3838176539 conn(0x7fedf80fa6e0 msgr2=0x7fedf8101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:41.995 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 shutdown_connections 2023-03-17T08:33:41.995 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:30.904+0000 7fedfd423700 1 -- 172.21.15.35:0/3838176539 wait complete. 2023-03-17T08:33:41.995 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:33:41.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:30 smithi035 ceph-mon[92535]: pgmap v1484: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:41.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:32 smithi082 ceph-mon[94281]: pgmap v1485: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:41.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:34 smithi082 ceph-mon[94281]: pgmap v1486: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:36 smithi082 ceph-mon[94281]: pgmap v1487: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:38 smithi082 ceph-mon[94281]: pgmap v1488: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:40 smithi082 ceph-mon[94281]: pgmap v1489: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:32 smithi078 ceph-mon[94114]: pgmap v1485: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:34 smithi078 ceph-mon[94114]: pgmap v1486: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:36 smithi078 ceph-mon[94114]: pgmap v1487: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:38 smithi078 ceph-mon[94114]: pgmap v1488: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:42.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:40 smithi078 ceph-mon[94114]: pgmap v1489: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:44.083 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:33:44.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:42 smithi082 ceph-mon[94281]: pgmap v1490: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:45.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:42 smithi078 ceph-mon[94114]: pgmap v1490: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:45.527 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:43 smithi078 ceph-mon[94114]: pgmap v1491: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:45.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:31 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3838176539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:33:45.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:32 smithi035 ceph-mon[92535]: pgmap v1485: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:47.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:34 smithi035 ceph-mon[92535]: pgmap v1486: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:47.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:36 smithi035 ceph-mon[92535]: pgmap v1487: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:47.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:38 smithi035 ceph-mon[92535]: pgmap v1488: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:48.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:40 smithi035 ceph-mon[92535]: pgmap v1489: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:48.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:42 smithi035 ceph-mon[92535]: pgmap v1490: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:48.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:43 smithi035 ceph-mon[92535]: pgmap v1491: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:48.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:46 smithi035 ceph-mon[92535]: pgmap v1492: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:48.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:46 smithi078 ceph-mon[94114]: pgmap v1492: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:48.143 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:43 smithi082 ceph-mon[94281]: pgmap v1491: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:48.143 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:46 smithi082 ceph-mon[94281]: pgmap v1492: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:49.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:48 smithi082 ceph-mon[94281]: pgmap v1493: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:49.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:48 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/4187437081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:33:50.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:48 smithi078 ceph-mon[94114]: pgmap v1493: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:50.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:48 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/4187437081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:33:50.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 -- 172.21.15.35:0/4043025756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1017a0 msgr2=0x7f03ac101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 --2- 172.21.15.35:0/4043025756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1017a0 0x7f03ac101bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009990 tx=0x7f03a0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 -- 172.21.15.35:0/4043025756 shutdown_connections 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 --2- 172.21.15.35:0/4043025756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03ac0febc0 0x7f03ac108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 --2- 172.21.15.35:0/4043025756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac1017a0 0x7f03ac101bb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 --2- 172.21.15.35:0/4043025756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ac0fe210 0x7f03ac0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 -- 172.21.15.35:0/4043025756 >> 172.21.15.35:0/4043025756 conn(0x7f03ac0f9e40 msgr2=0x7f03ac0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 -- 172.21.15.35:0/4043025756 shutdown_connections 2023-03-17T08:33:52.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.279+0000 7f03b192b700 1 -- 172.21.15.35:0/4043025756 wait complete. 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 Processor -- start 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 -- start start 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 0x7f03ac100ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03ac0febc0 0x7f03ac0ff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ac1017a0 0x7f03ac0ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac1001c0 con 0x7f03ac0fe210 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac100330 con 0x7f03ac0febc0 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03b192b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac19ff10 con 0x7f03ac1017a0 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03aaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 0x7f03ac100ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03aaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 0x7f03ac100ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41174/0 (socket says 172.21.15.35:41174) 2023-03-17T08:33:52.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03aaffd700 1 -- 172.21.15.35:0/4187437081 learned_addr learned my addr 172.21.15.35:0/4187437081 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03aa7fc700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03ac0febc0 0x7f03ac0ff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03ab7fe700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ac1017a0 0x7f03ac0ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.280+0000 7f03aaffd700 1 -- 172.21.15.35:0/4187437081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ac1017a0 msgr2=0x7f03ac0ffa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03aaffd700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ac1017a0 0x7f03ac0ffa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03aaffd700 1 -- 172.21.15.35:0/4187437081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03ac0febc0 msgr2=0x7f03ac0ff4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03aaffd700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03ac0febc0 0x7f03ac0ff4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03aaffd700 1 -- 172.21.15.35:0/4187437081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00095f0 con 0x7f03ac0fe210 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03aaffd700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 0x7f03ac100ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f03a00059d0 tx=0x7f03a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:52.311 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a001d070 con 0x7f03ac0fe210 2023-03-17T08:33:52.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03a000beb0 con 0x7f03ac0fe210 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0022e40 con 0x7f03ac0fe210 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac10b9c0 con 0x7f03ac0fe210 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.281+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac10b830 con 0x7f03ac0fe210 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.282+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac1079d0 con 0x7f03ac0fe210 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.283+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f03a0022600 con 0x7f03ac0fe210 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.283+0000 7f03b0929700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f039409f4d0 0x7f03940a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:33:53.142 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.284+0000 7f03aa7fc700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f039409f4d0 0x7f03940a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:33:53.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.284+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f03a00cb9b0 con 0x7f03ac0fe210 2023-03-17T08:33:53.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.284+0000 7f03aa7fc700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f039409f4d0 0x7f03940a1980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f03ac067cc0 tx=0x7f039c007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:33:53.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.287+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f03a0095bd0 con 0x7f03ac0fe210 2023-03-17T08:33:53.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.488+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03ac02d010 con 0x7f03ac0fe210 2023-03-17T08:33:53.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.490+0000 7f03b0929700 1 -- 172.21.15.35:0/4187437081 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f03a00991f0 con 0x7f03ac0fe210 2023-03-17T08:33:53.681 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:33:53.681 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:33:53.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f039409f4d0 msgr2=0x7f03940a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f039409f4d0 0x7f03940a1980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f03ac067cc0 tx=0x7f039c007400 comp rx=0 tx=0).stop 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 msgr2=0x7f03ac100ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 0x7f03ac100ea0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f03a00059d0 tx=0x7f03a0004730 comp rx=0 tx=0).stop 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 shutdown_connections 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03ac1017a0 0x7f03ac0ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f039409f4d0 0x7f03940a1980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f03ac0fe210 0x7f03ac100ea0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 --2- 172.21.15.35:0/4187437081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03ac0febc0 0x7f03ac0ff4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 >> 172.21.15.35:0/4187437081 conn(0x7f03ac0f9e40 msgr2=0x7f03ac104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 shutdown_connections 2023-03-17T08:33:55.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:33:48.492+0000 7f03b192b700 1 -- 172.21.15.35:0/4187437081 wait complete. 2023-03-17T08:33:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-17T08:12:42.651944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-17T08:12:54.803875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:33:57.905 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:50 smithi078 ceph-mon[94114]: pgmap v1494: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:52 smithi078 ceph-mon[94114]: pgmap v1495: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:54 smithi078 ceph-mon[94114]: pgmap v1496: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:56 smithi078 ceph-mon[94114]: pgmap v1497: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:50 smithi082 ceph-mon[94281]: pgmap v1494: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:52 smithi082 ceph-mon[94281]: pgmap v1495: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:54 smithi082 ceph-mon[94281]: pgmap v1496: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:56 smithi082 ceph-mon[94281]: pgmap v1497: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:33:57.907 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:48 smithi035 ceph-mon[92535]: pgmap v1493: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:33:59.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:48 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4187437081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:33:59.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:50 smithi035 ceph-mon[92535]: pgmap v1494: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:34:00.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:52 smithi035 ceph-mon[92535]: pgmap v1495: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:00.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:54 smithi035 ceph-mon[92535]: pgmap v1496: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:00.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:56 smithi035 ceph-mon[92535]: pgmap v1497: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:00.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:33:58 smithi035 ceph-mon[92535]: pgmap v1498: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:02.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:33:58 smithi078 ceph-mon[94114]: pgmap v1498: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:02.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:33:58 smithi082 ceph-mon[94281]: pgmap v1498: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:02.273 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:00 smithi035 ceph-mon[92535]: pgmap v1499: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:03.752 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:00 smithi078 ceph-mon[94114]: pgmap v1499: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:03.752 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:01 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2723178426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:34:03.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:00 smithi082 ceph-mon[94281]: pgmap v1499: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:03.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:01 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2723178426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:34:03.754 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:02 smithi078 ceph-mon[94114]: pgmap v1500: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:04.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:02 smithi082 ceph-mon[94281]: pgmap v1500: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:06.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 -- 172.21.15.35:0/2330725127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101650 msgr2=0x7ff008101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:07.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 --2- 172.21.15.35:0/2330725127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101650 0x7ff008101aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feff0009990 tx=0x7feff0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:34:07.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 -- 172.21.15.35:0/2330725127 shutdown_connections 2023-03-17T08:34:07.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 --2- 172.21.15.35:0/2330725127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff008101fe0 0x7ff0081088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:09.603 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 --2- 172.21.15.35:0/2330725127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008100460 0x7ff008100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:09.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 --2- 172.21.15.35:0/2330725127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101650 0x7ff008101aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:09.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 -- 172.21.15.35:0/2330725127 >> 172.21.15.35:0/2330725127 conn(0x7ff0080fbaa0 msgr2=0x7ff0080fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:09.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 -- 172.21.15.35:0/2330725127 shutdown_connections 2023-03-17T08:34:09.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.960+0000 7ff00c898700 1 -- 172.21.15.35:0/2330725127 wait complete. 2023-03-17T08:34:09.604 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 Processor -- start 2023-03-17T08:34:10.483 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 -- start start 2023-03-17T08:34:10.483 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff008100460 0x7ff008196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:10.483 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008101650 0x7ff008196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 0x7ff00819d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819dbc0 con 0x7ff008101fe0 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819dd00 con 0x7ff008101650 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00c898700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819de90 con 0x7ff008100460 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff006d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 0x7ff00819d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff006d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 0x7ff00819d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41190/0 (socket says 172.21.15.35:41190) 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff00659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff008100460 0x7ff008196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.961+0000 7ff006d9d700 1 -- 172.21.15.35:0/2723178426 learned_addr learned my addr 172.21.15.35:0/2723178426 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff005d9b700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008101650 0x7ff008196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff006d9d700 1 -- 172.21.15.35:0/2723178426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff008100460 msgr2=0x7ff008196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff006d9d700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff008100460 0x7ff008196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:10.484 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff006d9d700 1 -- 172.21.15.35:0/2723178426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008101650 msgr2=0x7ff008196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:12.458 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff006d9d700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008101650 0x7ff008196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff006d9d700 1 -- 172.21.15.35:0/2723178426 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00095f0 con 0x7ff008101fe0 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff006d9d700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 0x7ff00819d5f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff000007d70 tx=0x7ff00000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000ac90 con 0x7ff008101fe0 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff00000adf0 con 0x7ff008101fe0 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00810bc80 con 0x7ff008101fe0 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000115e0 con 0x7ff008101fe0 2023-03-17T08:34:13.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.962+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00810baf0 con 0x7ff008101fe0 2023-03-17T08:34:13.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.963+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00806a280 con 0x7ff008101fe0 2023-03-17T08:34:13.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.964+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff000004ad0 con 0x7ff008101fe0 2023-03-17T08:34:13.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.965+0000 7fefff7fe700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7feff409f4d0 0x7feff40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:13.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.965+0000 7ff00659c700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7feff409f4d0 0x7feff40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:13.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.965+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff0000ca830 con 0x7ff008101fe0 2023-03-17T08:34:15.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.965+0000 7ff00659c700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7feff409f4d0 0x7feff40a1980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff0081014b0 tx=0x7feff800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:15.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:00.968+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff000094920 con 0x7ff008101fe0 2023-03-17T08:34:15.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.168+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff008107410 con 0x7ff008101fe0 2023-03-17T08:34:15.099 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.168+0000 7fefff7fe700 1 -- 172.21.15.35:0/2723178426 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff000016030 con 0x7ff008101fe0 2023-03-17T08:34:15.100 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:04 smithi078 ceph-mon[94114]: pgmap v1501: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:06 smithi078 ceph-mon[94114]: pgmap v1502: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:08 smithi078 ceph-mon[94114]: pgmap v1503: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:10 smithi078 ceph-mon[94114]: pgmap v1504: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:12 smithi078 ceph-mon[94114]: pgmap v1505: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:12 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:13 smithi078 ceph-mon[94114]: pgmap v1506: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:16 smithi078 ceph-mon[94114]: pgmap v1507: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:17.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:04 smithi082 ceph-mon[94281]: pgmap v1501: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:06 smithi082 ceph-mon[94281]: pgmap v1502: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:17.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:08 smithi082 ceph-mon[94281]: pgmap v1503: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:10 smithi082 ceph-mon[94281]: pgmap v1504: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:17.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:12 smithi082 ceph-mon[94281]: pgmap v1505: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:19.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:12 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:13 smithi082 ceph-mon[94281]: pgmap v1506: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:21.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:16 smithi082 ceph-mon[94281]: pgmap v1507: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:21.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7feff409f4d0 msgr2=0x7feff40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:21.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7feff409f4d0 0x7feff40a1980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff0081014b0 tx=0x7feff800b410 comp rx=0 tx=0).stop 2023-03-17T08:34:21.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 msgr2=0x7ff00819d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:21.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 0x7ff00819d5f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff000007d70 tx=0x7ff00000a340 comp rx=0 tx=0).stop 2023-03-17T08:34:21.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 shutdown_connections 2023-03-17T08:34:21.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7feff409f4d0 0x7feff40a1980 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:21.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff008101fe0 0x7ff00819d5f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:21.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff008100460 0x7ff008196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:21.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 --2- 172.21.15.35:0/2723178426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff008101650 0x7ff008196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:21.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.170+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 >> 172.21.15.35:0/2723178426 conn(0x7ff0080fbaa0 msgr2=0x7ff0080fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:21.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.171+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 shutdown_connections 2023-03-17T08:34:21.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:01.171+0000 7ff00c898700 1 -- 172.21.15.35:0/2723178426 wait complete. 2023-03-17T08:34:21.685 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-17T08:34:22.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:18 smithi078 ceph-mon[94114]: pgmap v1508: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:25.738 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:20 smithi078 ceph-mon[94114]: pgmap v1509: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:25.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:18 smithi082 ceph-mon[94281]: pgmap v1508: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:25.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:20 smithi082 ceph-mon[94281]: pgmap v1509: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:25.740 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:01 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2723178426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:34:26.755 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:02 smithi035 ceph-mon[92535]: pgmap v1500: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:04 smithi035 ceph-mon[92535]: pgmap v1501: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:06 smithi035 ceph-mon[92535]: pgmap v1502: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:08 smithi035 ceph-mon[92535]: pgmap v1503: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:10 smithi035 ceph-mon[92535]: pgmap v1504: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:12 smithi035 ceph-mon[92535]: pgmap v1505: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:26.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:12 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:26.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:34:27.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:34:27.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:34:30.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:13 smithi035 ceph-mon[92535]: pgmap v1506: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:30.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:16 smithi035 ceph-mon[92535]: pgmap v1507: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:30.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:18 smithi035 ceph-mon[92535]: pgmap v1508: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:30.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:20 smithi035 ceph-mon[92535]: pgmap v1509: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:30.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:22 smithi035 ceph-mon[92535]: pgmap v1510: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:31.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:24 smithi035 ceph-mon[92535]: pgmap v1511: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:31.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:22 smithi078 ceph-mon[94114]: pgmap v1510: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:31.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:24 smithi078 ceph-mon[94114]: pgmap v1511: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:31.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:26 smithi078 ceph-mon[94114]: pgmap v1512: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:26 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1981823173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:28 smithi078 ceph-mon[94114]: pgmap v1513: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:30 smithi078 ceph-mon[94114]: pgmap v1514: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:22 smithi082 ceph-mon[94281]: pgmap v1510: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:24 smithi082 ceph-mon[94281]: pgmap v1511: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:26 smithi082 ceph-mon[94281]: pgmap v1512: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:31.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:26 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1981823173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:34:32.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:28 smithi082 ceph-mon[94281]: pgmap v1513: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:32.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:30 smithi082 ceph-mon[94281]: pgmap v1514: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:32.986 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:32 smithi078 ceph-mon[94114]: pgmap v1515: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 -- 172.21.15.35:0/511007253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69501003a0 msgr2=0x7f6950100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 --2- 172.21.15.35:0/511007253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69501003a0 0x7f6950100810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6944009990 tx=0x7f6944009ca0 comp rx=0 tx=0).stop 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 -- 172.21.15.35:0/511007253 shutdown_connections 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 --2- 172.21.15.35:0/511007253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6950100d50 0x7f69501075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 --2- 172.21.15.35:0/511007253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69500ff110 0x7f69500ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 --2- 172.21.15.35:0/511007253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69501003a0 0x7f6950100810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:33.972 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 -- 172.21.15.35:0/511007253 >> 172.21.15.35:0/511007253 conn(0x7f69500fa730 msgr2=0x7f69500fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:33.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 -- 172.21.15.35:0/511007253 shutdown_connections 2023-03-17T08:34:33.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.881+0000 7f69564ad700 1 -- 172.21.15.35:0/511007253 wait complete. 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 Processor -- start 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 -- start start 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 0x7f6950103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69501003a0 0x7f6950101780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6950100d50 0x7f6950101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6950102460 con 0x7f69500ff110 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69501025d0 con 0x7f6950100d50 2023-03-17T08:34:34.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f69564ad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695019fe60 con 0x7f69501003a0 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 0x7f6950103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 0x7f6950103140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41202/0 (socket says 172.21.15.35:41202) 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 -- 172.21.15.35:0/1981823173 learned_addr learned my addr 172.21.15.35:0/1981823173 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f6954a4a700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6950100d50 0x7f6950101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694f7fe700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69501003a0 0x7f6950101780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 -- 172.21.15.35:0/1981823173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69501003a0 msgr2=0x7f6950101780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69501003a0 0x7f6950101780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 -- 172.21.15.35:0/1981823173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6950100d50 msgr2=0x7f6950101cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6950100d50 0x7f6950101cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.882+0000 7f694ffff700 1 -- 172.21.15.35:0/1981823173 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69440095f0 con 0x7f69500ff110 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.883+0000 7f694ffff700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 0x7f6950103140 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f694000e9a0 tx=0x7f694000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.883+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940009790 con 0x7f69500ff110 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.883+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695010aa10 con 0x7f69500ff110 2023-03-17T08:34:34.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.883+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f694000cbd0 con 0x7f69500ff110 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.883+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940018680 con 0x7f69500ff110 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.883+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695010a880 con 0x7f69500ff110 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.884+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69500679e0 con 0x7f69500ff110 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.885+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f694000cd40 con 0x7f69500ff110 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.886+0000 7f694d7fa700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f693809f4d0 0x7f69380a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.886+0000 7f694f7fe700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f693809f4d0 0x7f69380a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:35.406 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.886+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6940014070 con 0x7f69500ff110 2023-03-17T08:34:35.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.886+0000 7f694f7fe700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f693809f4d0 0x7f69380a1980 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69440098e0 tx=0x7f6944005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:35.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:25.889+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f6940094b00 con 0x7f69500ff110 2023-03-17T08:34:35.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.088+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69501a0970 con 0x7f69500ff110 2023-03-17T08:34:35.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.088+0000 7f694d7fa700 1 -- 172.21.15.35:0/1981823173 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69400260a0 con 0x7f69500ff110 2023-03-17T08:34:35.827 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 32 2023-03-17T08:34:35.828 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:34 smithi078 ceph-mon[94114]: pgmap v1516: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:35.829 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:32 smithi082 ceph-mon[94281]: pgmap v1515: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:36.799 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:34 smithi082 ceph-mon[94281]: pgmap v1516: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:36.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f693809f4d0 msgr2=0x7f69380a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:36.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f693809f4d0 0x7f69380a1980 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69440098e0 tx=0x7f6944005c20 comp rx=0 tx=0).stop 2023-03-17T08:34:36.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 msgr2=0x7f6950103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:37.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 0x7f6950103140 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f694000e9a0 tx=0x7f694000ed60 comp rx=0 tx=0).stop 2023-03-17T08:34:37.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 shutdown_connections 2023-03-17T08:34:37.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6950100d50 0x7f6950101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:38.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f693809f4d0 0x7f69380a1980 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:38.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69500ff110 0x7f6950103140 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:38.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 --2- 172.21.15.35:0/1981823173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69501003a0 0x7f6950101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:38.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.090+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 >> 172.21.15.35:0/1981823173 conn(0x7f69500fa730 msgr2=0x7f6950067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:38.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.091+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 shutdown_connections 2023-03-17T08:34:38.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:26.091+0000 7f69564ad700 1 -- 172.21.15.35:0/1981823173 wait complete. 2023-03-17T08:34:38.084 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-17T08:34:38.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:26 smithi035 ceph-mon[92535]: pgmap v1512: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:39.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:26 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1981823173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:34:39.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:28 smithi035 ceph-mon[92535]: pgmap v1513: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:39.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:30 smithi035 ceph-mon[92535]: pgmap v1514: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:39.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:32 smithi035 ceph-mon[92535]: pgmap v1515: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:39.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:34 smithi035 ceph-mon[92535]: pgmap v1516: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:39.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:36 smithi035 ceph-mon[92535]: pgmap v1517: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:39.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:38 smithi035 ceph-mon[92535]: pgmap v1518: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:40.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:36 smithi082 ceph-mon[94281]: pgmap v1517: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:40.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:38 smithi082 ceph-mon[94281]: pgmap v1518: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:40.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:36 smithi078 ceph-mon[94114]: pgmap v1517: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:40.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:38 smithi078 ceph-mon[94114]: pgmap v1518: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:40.396 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.608+0000 7f4db06c5700 1 -- 172.21.15.35:0/3870312676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da81003a0 msgr2=0x7f4da8100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:41.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.608+0000 7f4db06c5700 1 --2- 172.21.15.35:0/3870312676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da81003a0 0x7f4da8100810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009990 tx=0x7f4d98009ca0 comp rx=0 tx=0).stop 2023-03-17T08:34:41.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- 172.21.15.35:0/3870312676 shutdown_connections 2023-03-17T08:34:41.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 --2- 172.21.15.35:0/3870312676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4da8100d50 0x7f4da81075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:41.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 --2- 172.21.15.35:0/3870312676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da80ff110 0x7f4da80ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:41.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 --2- 172.21.15.35:0/3870312676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da81003a0 0x7f4da8100810 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:41.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- 172.21.15.35:0/3870312676 >> 172.21.15.35:0/3870312676 conn(0x7f4da80fa730 msgr2=0x7f4da80fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- 172.21.15.35:0/3870312676 shutdown_connections 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- 172.21.15.35:0/3870312676 wait complete. 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 Processor -- start 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- start start 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 0x7f4da8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4da81003a0 0x7f4da8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:41.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da8100d50 0x7f4da819d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da819da70 con 0x7f4da80ff110 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da819dbb0 con 0x7f4da8100d50 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.609+0000 7f4db06c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da819dd40 con 0x7f4da81003a0 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 0x7f4da8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 0x7f4da8195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41216/0 (socket says 172.21.15.35:41216) 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 -- 172.21.15.35:0/1024859477 learned_addr learned my addr 172.21.15.35:0/1024859477 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:34:41.120 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dadc60700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4da81003a0 0x7f4da8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:41.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4daec62700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da8100d50 0x7f4da819d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:41.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 -- 172.21.15.35:0/1024859477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4da81003a0 msgr2=0x7f4da8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:41.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4da81003a0 0x7f4da8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 -- 172.21.15.35:0/1024859477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da8100d50 msgr2=0x7f4da819d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da8100d50 0x7f4da819d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 -- 172.21.15.35:0/1024859477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980095f0 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4daec62700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da8100d50 0x7f4da819d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4dae461700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 0x7f4da8195ef0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4da400d950 tx=0x7f4da400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4009b40 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da4009ca0 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da810aa10 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400f620 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.610+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da810a880 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.611+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da819e390 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.612+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f4da4010460 con 0x7f4da80ff110 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.613+0000 7f4d9f7fe700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d9409f4d0 0x7f4d940a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:43.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.613+0000 7f4dadc60700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d9409f4d0 0x7f4d940a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:43.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.613+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4da40ca4f0 con 0x7f4da80ff110 2023-03-17T08:34:44.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.614+0000 7f4dadc60700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d9409f4d0 0x7f4d940a1980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800b5c0 tx=0x7f4d98005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:44.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.617+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f4da4094680 con 0x7f4da80ff110 2023-03-17T08:34:44.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.816+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4da819e940 con 0x7f4da80ff110 2023-03-17T08:34:44.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.816+0000 7f4d9f7fe700 1 -- 172.21.15.35:0/1024859477 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4da40160a0 con 0x7f4da80ff110 2023-03-17T08:34:44.844 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 64 2023-03-17T08:34:44.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d9409f4d0 msgr2=0x7f4d940a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:46.121 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d9409f4d0 0x7f4d940a1980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800b5c0 tx=0x7f4d98005fb0 comp rx=0 tx=0).stop 2023-03-17T08:34:46.121 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 msgr2=0x7f4da8195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:46.121 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 0x7f4da8195ef0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4da400d950 tx=0x7f4da400dd10 comp rx=0 tx=0).stop 2023-03-17T08:34:46.121 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 shutdown_connections 2023-03-17T08:34:46.121 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4da8100d50 0x7f4da819d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:46.121 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f4d9409f4d0 0x7f4d940a1980 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:47.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4da80ff110 0x7f4da8195ef0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:47.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 --2- 172.21.15.35:0/1024859477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4da81003a0 0x7f4da8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:47.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 >> 172.21.15.35:0/1024859477 conn(0x7f4da80fa730 msgr2=0x7f4da8067db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:47.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 shutdown_connections 2023-03-17T08:34:47.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:39.818+0000 7f4db06c5700 1 -- 172.21.15.35:0/1024859477 wait complete. 2023-03-17T08:34:47.377 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:34:49.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:40 smithi035 ceph-mon[92535]: pgmap v1519: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:51.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:40 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1024859477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:34:51.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:42 smithi035 ceph-mon[92535]: pgmap v1520: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:51.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:43 smithi035 ceph-mon[92535]: pgmap v1521: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:51.650 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:46 smithi035 ceph-mon[92535]: pgmap v1522: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:51.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:48 smithi035 ceph-mon[92535]: pgmap v1523: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:52.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:40 smithi082 ceph-mon[94281]: pgmap v1519: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:52.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:40 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1024859477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:42 smithi082 ceph-mon[94281]: pgmap v1520: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:43 smithi082 ceph-mon[94281]: pgmap v1521: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:46 smithi082 ceph-mon[94281]: pgmap v1522: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:48 smithi082 ceph-mon[94281]: pgmap v1523: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:50 smithi082 ceph-mon[94281]: pgmap v1524: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:40 smithi078 ceph-mon[94114]: pgmap v1519: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:40 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1024859477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:42 smithi078 ceph-mon[94114]: pgmap v1520: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:43 smithi078 ceph-mon[94114]: pgmap v1521: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:46 smithi078 ceph-mon[94114]: pgmap v1522: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:53.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:48 smithi078 ceph-mon[94114]: pgmap v1523: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:54.411 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:50 smithi078 ceph-mon[94114]: pgmap v1524: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:54.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:50 smithi035 ceph-mon[92535]: pgmap v1524: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:54.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:52 smithi082 ceph-mon[94281]: pgmap v1525: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:56.301 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1769243898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:34:56.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:52 smithi078 ceph-mon[94114]: pgmap v1525: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:34:56.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1769243898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:34:56.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:54 smithi082 ceph-mon[94281]: pgmap v1526: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:56.304 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:54 smithi078 ceph-mon[94114]: pgmap v1526: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:56.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 -- 172.21.15.35:0/3906448257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 msgr2=0x7f6c34108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:56.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/3906448257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c34108760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b0a0 tx=0x7f6c2c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:34:56.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 -- 172.21.15.35:0/3906448257 shutdown_connections 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/3906448257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c34108760 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/3906448257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c34101780 0x7f6c34101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/3906448257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340fe1f0 0x7f6c340fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.441+0000 7f6c3bb92700 1 -- 172.21.15.35:0/3906448257 >> 172.21.15.35:0/3906448257 conn(0x7f6c340f9e40 msgr2=0x7f6c340fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 -- 172.21.15.35:0/3906448257 shutdown_connections 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 -- 172.21.15.35:0/3906448257 wait complete. 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 Processor -- start 2023-03-17T08:34:58.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 -- start start 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340fe1f0 0x7f6c34100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c340ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c34101780 0x7f6c340ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341001a0 con 0x7f6c340feb80 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34100310 con 0x7f6c340fe1f0 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.442+0000 7f6c3bb92700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3419ff80 con 0x7f6c34101780 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c340ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c340ff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41232/0 (socket says 172.21.15.35:41232) 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 -- 172.21.15.35:0/1769243898 learned_addr learned my addr 172.21.15.35:0/1769243898 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3992e700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340fe1f0 0x7f6c34100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3a12f700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c34101780 0x7f6c340ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 -- 172.21.15.35:0/1769243898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c34101780 msgr2=0x7f6c340ffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c34101780 0x7f6c340ffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 -- 172.21.15.35:0/1769243898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340fe1f0 msgr2=0x7f6c34100e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340fe1f0 0x7f6c34100e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 -- 172.21.15.35:0/1769243898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009d00 con 0x7f6c340feb80 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3912d700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c340ff4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e9a0 tx=0x7f6c2400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:58.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24009790 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c24010430 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400cea0 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3410b9e0 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.443+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3410b850 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.444+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c341a0640 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.445+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f6c240105a0 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.446+0000 7f6c2affd700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6c2009f550 0x7f6c200a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.446+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6c24014070 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.446+0000 7f6c3992e700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6c2009f550 0x7f6c200a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.446+0000 7f6c3992e700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6c2009f550 0x7f6c200a1a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c34067a70 tx=0x7f6c3000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.449+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f6c240948e0 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.697+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c34107260 con 0x7f6c340feb80 2023-03-17T08:34:58.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.698+0000 7f6c2affd700 1 -- 172.21.15.35:0/1769243898 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7f6c24026070 con 0x7f6c340feb80 2023-03-17T08:34:58.640 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:34:58.640 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:34:59.594 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:56 smithi082 ceph-mon[94281]: pgmap v1527: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:59.594 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:34:58 smithi082 ceph-mon[94281]: pgmap v1528: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:59.594 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:56 smithi078 ceph-mon[94114]: pgmap v1527: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:34:59.594 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:34:58 smithi078 ceph-mon[94114]: pgmap v1528: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:34:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6c2009f550 msgr2=0x7f6c200a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:34:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6c2009f550 0x7f6c200a1a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c34067a70 tx=0x7f6c3000b410 comp rx=0 tx=0).stop 2023-03-17T08:34:59.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 msgr2=0x7f6c340ff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c340ff4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e9a0 tx=0x7f6c2400ecb0 comp rx=0 tx=0).stop 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 shutdown_connections 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c34101780 0x7f6c340ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340fe1f0 0x7f6c34100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f6c2009f550 0x7f6c200a1a00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 --2- 172.21.15.35:0/1769243898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6c340feb80 0x7f6c340ff4c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.700+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 >> 172.21.15.35:0/1769243898 conn(0x7f6c340f9e40 msgr2=0x7f6c340fc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.701+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 shutdown_connections 2023-03-17T08:35:00.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:34:52.701+0000 7f6c3bb92700 1 -- 172.21.15.35:0/1769243898 wait complete. 2023-03-17T08:35:01.227 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:35:01.227 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:35:01.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:52 smithi035 ceph-mon[92535]: pgmap v1525: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:01.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1769243898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:35:01.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:54 smithi035 ceph-mon[92535]: pgmap v1526: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:01.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:56 smithi035 ceph-mon[92535]: pgmap v1527: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:01.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:34:58 smithi035 ceph-mon[92535]: pgmap v1528: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:01.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:00 smithi035 ceph-mon[92535]: pgmap v1529: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:01.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:00 smithi082 ceph-mon[94281]: pgmap v1529: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:02.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:00 smithi078 ceph-mon[94114]: pgmap v1529: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:02.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:01 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3419108788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:35:03.100 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:01 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3419108788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:35:03.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:02 smithi078 ceph-mon[94114]: pgmap v1530: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:04.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.366+0000 7ff8559e1700 1 -- 172.21.15.35:0/3549897297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff850100c60 msgr2=0x7ff850107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:04.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.366+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3549897297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff850100c60 0x7ff850107520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff84800b0a0 tx=0x7ff84800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:35:04.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 -- 172.21.15.35:0/3549897297 shutdown_connections 2023-03-17T08:35:04.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3549897297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff850100c60 0x7ff850107520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:04.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3549897297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8500ff0e0 0x7ff8500ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:04.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3549897297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8501002d0 0x7ff850100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 -- 172.21.15.35:0/3549897297 >> 172.21.15.35:0/3549897297 conn(0x7ff8500fa6e0 msgr2=0x7ff8500fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 -- 172.21.15.35:0/3549897297 shutdown_connections 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 -- 172.21.15.35:0/3549897297 wait complete. 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.367+0000 7ff8559e1700 1 Processor -- start 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 -- start start 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8500ff0e0 0x7ff850194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 0x7ff850195400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:04.367 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff850100c60 0x7ff85019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:05.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85019ca40 con 0x7ff8501002d0 2023-03-17T08:35:05.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85019cb80 con 0x7ff850100c60 2023-03-17T08:35:05.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff8559e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85019cd10 con 0x7ff8500ff0e0 2023-03-17T08:35:05.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 0x7ff850195400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 0x7ff850195400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41246/0 (socket says 172.21.15.35:41246) 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 -- 172.21.15.35:0/3419108788 learned_addr learned my addr 172.21.15.35:0/3419108788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84f7fe700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff850100c60 0x7ff85019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84effd700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8500ff0e0 0x7ff850194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 -- 172.21.15.35:0/3419108788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8500ff0e0 msgr2=0x7ff850194ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8500ff0e0 0x7ff850194ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 -- 172.21.15.35:0/3419108788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff850100c60 msgr2=0x7ff85019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:06.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff850100c60 0x7ff85019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.368+0000 7ff84e7fc700 1 -- 172.21.15.35:0/3419108788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009d00 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.369+0000 7ff84e7fc700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 0x7ff850195400 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff84400e9c0 tx=0x7ff84400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.369+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8440097b0 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.369+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff844004cc0 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.369+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85010a910 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.369+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844005530 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.369+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85010a780 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.370+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8501066d0 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.371+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff844004750 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.371+0000 7ff8549df700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff83809f4d0 0x7ff8380a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.372+0000 7ff84effd700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff83809f4d0 0x7ff8380a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.372+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff844014070 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.372+0000 7ff84effd700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff83809f4d0 0x7ff8380a1980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff840005950 tx=0x7ff8400058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.376+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff844094820 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.578+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff85002d060 con 0x7ff8501002d0 2023-03-17T08:35:06.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.580+0000 7ff8549df700 1 -- 172.21.15.35:0/3419108788 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7ff844097e40 con 0x7ff8501002d0 2023-03-17T08:35:06.195 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:35:06.195 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:35:06.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:03 smithi078 ceph-mon[94114]: pgmap v1531: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:06.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff83809f4d0 msgr2=0x7ff8380a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:06.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff83809f4d0 0x7ff8380a1980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff840005950 tx=0x7ff8400058e0 comp rx=0 tx=0).stop 2023-03-17T08:35:06.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 msgr2=0x7ff850195400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:06.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 0x7ff850195400 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff84400e9c0 tx=0x7ff84400ecd0 comp rx=0 tx=0).stop 2023-03-17T08:35:09.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 shutdown_connections 2023-03-17T08:35:09.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff850100c60 0x7ff85019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:09.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8500ff0e0 0x7ff850194ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:09.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff83809f4d0 0x7ff8380a1980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:09.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 --2- 172.21.15.35:0/3419108788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8501002d0 0x7ff850195400 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:09.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 >> 172.21.15.35:0/3419108788 conn(0x7ff8500fa6e0 msgr2=0x7ff850103810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:09.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 shutdown_connections 2023-03-17T08:35:09.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:01.582+0000 7ff8559e1700 1 -- 172.21.15.35:0/3419108788 wait complete. 2023-03-17T08:35:09.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:02 smithi082 ceph-mon[94281]: pgmap v1530: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:09.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:03 smithi082 ceph-mon[94281]: pgmap v1531: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:09.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-03-17T08:13:31.987985+0000', 'modified': '2023-03-17T08:15:35.363809+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24452, 'mds_1': 24451, 'mds_2': 24445, 'mds_3': 24439, 'mds_4': 24431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14511': {'gid': 14511, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.35:6839/1982578351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.35:6838', 'nonce': 1982578351}, {'type': 'v1', 'addr': '172.21.15.35:6839', 'nonce': 1982578351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14517': {'gid': 14517, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.35:6841/3680182485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.35:6840', 'nonce': 3680182485}, {'type': 'v1', 'addr': '172.21.15.35:6841', 'nonce': 3680182485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.78:6833/3173843386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 3173843386}, {'type': 'v1', 'addr': '172.21.15.78:6833', 'nonce': 3173843386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24415': {'gid': 24415, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6833/1456535346', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6832', 'nonce': 1456535346}, {'type': 'v1', 'addr': '172.21.15.82:6833', 'nonce': 1456535346}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24419': {'gid': 24419, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.78:6835/3131921401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3131921401}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3131921401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24431': {'gid': 24431, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 68, 'addr': '172.21.15.78:6837/2030646762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 2030646762}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 2030646762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 68, 'addr': '172.21.15.82:6835/3844512343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 3844512343}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 3844512343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24445': {'gid': 24445, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 68, 'addr': '172.21.15.82:6837/1283255314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 1283255314}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1283255314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24451': {'gid': 24451, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 66, 'addr': '172.21.15.82:6839/2918814393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 2918814393}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 2918814393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 46, 'addr': '172.21.15.78:6839/3357054531', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6838', 'nonce': 3357054531}, {'type': 'v1', 'addr': '172.21.15.78:6839', 'nonce': 3357054531}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-17T08:35:09.795 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-03-17T08:35:09.795 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-03-17T08:35:10.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:01 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3419108788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:35:12.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:02 smithi035 ceph-mon[92535]: pgmap v1530: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:12.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:03 smithi035 ceph-mon[92535]: pgmap v1531: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:06 smithi035 ceph-mon[92535]: pgmap v1532: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:12.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:08 smithi035 ceph-mon[92535]: pgmap v1533: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.254 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:10 smithi035 ceph-mon[92535]: pgmap v1534: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:06 smithi082 ceph-mon[94281]: pgmap v1532: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:12.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:08 smithi082 ceph-mon[94281]: pgmap v1533: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:10 smithi082 ceph-mon[94281]: pgmap v1534: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:06 smithi078 ceph-mon[94114]: pgmap v1532: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:12.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:08 smithi078 ceph-mon[94114]: pgmap v1533: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:10 smithi078 ceph-mon[94114]: pgmap v1534: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:12.396 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 -- 172.21.15.35:0/547687914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0ffb50 msgr2=0x7f5e4c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:13.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 --2- 172.21.15.35:0/547687914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c0fffa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009990 tx=0x7f5e34009ca0 comp rx=0 tx=0).stop 2023-03-17T08:35:13.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 -- 172.21.15.35:0/547687914 shutdown_connections 2023-03-17T08:35:13.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 --2- 172.21.15.35:0/547687914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e4c1004e0 0x7f5e4c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:13.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 --2- 172.21.15.35:0/547687914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c0fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:13.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 --2- 172.21.15.35:0/547687914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c0fffa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:13.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 -- 172.21.15.35:0/547687914 >> 172.21.15.35:0/547687914 conn(0x7f5e4c0f9fa0 msgr2=0x7f5e4c0fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:13.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.394+0000 7f5e51472700 1 -- 172.21.15.35:0/547687914 shutdown_connections 2023-03-17T08:35:13.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 -- 172.21.15.35:0/547687914 wait complete. 2023-03-17T08:35:13.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 Processor -- start 2023-03-17T08:35:13.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:12 smithi082 ceph-mon[94281]: pgmap v1535: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:13.770 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:12 smithi078 ceph-mon[94114]: pgmap v1535: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:13.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 -- start start 2023-03-17T08:35:14.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c10b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:14.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:14.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e4c1004e0 0x7f5e4c19d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:14.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.395+0000 7f5e51472700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c19d9f0 con 0x7f5e4c0fe960 2023-03-17T08:35:14.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e51472700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c19db60 con 0x7f5e4c1004e0 2023-03-17T08:35:14.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e51472700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c19dd20 con 0x7f5e4c0ffb50 2023-03-17T08:35:15.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c10b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:15.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c10b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41258/0 (socket says 172.21.15.35:41258) 2023-03-17T08:35:15.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 -- 172.21.15.35:0/960080667 learned_addr learned my addr 172.21.15.35:0/960080667 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:15.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:15.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e4c1004e0 0x7f5e4c19d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:15.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 -- 172.21.15.35:0/960080667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0ffb50 msgr2=0x7f5e4c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:15.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:15.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 -- 172.21.15.35:0/960080667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e4c1004e0 msgr2=0x7f5e4c19d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:15.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e4c1004e0 0x7f5e4c19d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:15.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 -- 172.21.15.35:0/960080667 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340095f0 con 0x7f5e4c0fe960 2023-03-17T08:35:15.714 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:35:15.875 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e4affd700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c10b530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c990 tx=0x7f5e3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:15.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e43fff700 1 -- 172.21.15.35:0/960080667 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c007b00 con 0x7f5e4c0fe960 2023-03-17T08:35:15.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c10a1c0 con 0x7f5e4c0fe960 2023-03-17T08:35:15.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e43fff700 1 -- 172.21.15.35:0/960080667 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e3c007c60 con 0x7f5e4c0fe960 2023-03-17T08:35:15.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e43fff700 1 -- 172.21.15.35:0/960080667 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c018660 con 0x7f5e4c0fe960 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.396+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c10a030 con 0x7f5e4c0fe960 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.398+0000 7f5e43fff700 1 -- 172.21.15.35:0/960080667 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f5e3c00f450 con 0x7f5e4c0fe960 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.399+0000 7f5e43fff700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5e3809f4d0 0x7f5e380a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.399+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5e3809f4d0 0x7f5e380a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.399+0000 7f5e43fff700 1 -- 172.21.15.35:0/960080667 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5e3c0ca2b0 con 0x7f5e4c0fe960 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.399+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5e3809f4d0 0x7f5e380a1980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400b5c0 tx=0x7f5e34005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 Processor -- start 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 -- start start 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f8266eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:16.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8266d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f8266e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f82574020 con 0x562f8266f3e0 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f825c6960 con 0x562f8266dc50 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.400+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f825bfdf0 con 0x562f8266ea90 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8266d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8266d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41268/0 (socket says 172.21.15.35:41268) 2023-03-17T08:35:18.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f8266eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4268593618 learned_addr learned my addr 172.21.15.35:0/4268593618 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f8266e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4268593618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 msgr2=0x562f8266eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f8266eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4268593618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 msgr2=0x562f8266e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f8266e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4268593618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f824415e0 con 0x562f8266f3e0 2023-03-17T08:35:18.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8266d670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009990 tx=0x7f5e3401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7ae4d0d2a0de2c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e417fa700 1 -- 172.21.15.35:0/4268593618 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3402b070 con 0x562f8266f3e0 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e417fa700 1 -- 172.21.15.35:0/4268593618 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e3401e040 con 0x562f8266f3e0 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.401+0000 7f5e417fa700 1 -- 172.21.15.35:0/4268593618 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004cb0 con 0x562f8266f3e0 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4268593618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 msgr2=0x562f8266d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8266d670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009990 tx=0x7f5e3401f000 comp rx=0 tx=0).stop 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4268593618 shutdown_connections 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f8266e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f8266eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:18.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4268593618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8266d670 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4268593618 >> 172.21.15.35:0/4268593618 conn(0x562f82669c00 msgr2=0x562f82667fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4268593618 shutdown_connections 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4268593618 wait complete. 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.402+0000 7f5e5d5ffb80 1 -- start start 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 Processor -- start 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266dc50 0x562f826773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 0x562f826778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266f3e0 0x562f8267e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:18.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f824438d0 con 0x562f8266ea90 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f8267ee60 con 0x562f8266f3e0 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f8267eff0 con 0x562f8266dc50 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e5d5ffb80 10 client.0 _ll_register_callbacks cb 0x562f82465240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 0x562f826778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 0x562f826778e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41274/0 (socket says 172.21.15.35:41274) 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4254785139 learned_addr learned my addr 172.21.15.35:0/4254785139 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266f3e0 0x562f8267e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4affd700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266dc50 0x562f826773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4254785139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266dc50 msgr2=0x562f826773a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:20.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266dc50 0x562f826773a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:21.560 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266f3e0 msgr2=0x562f8267e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:21.560 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266f3e0 0x562f8267e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:21.560 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 -- 172.21.15.35:0/4254785139 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c1076d0 con 0x562f8266ea90 2023-03-17T08:35:21.560 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4affd700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266dc50 0x562f826773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:35:21.560 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 0x562f826778e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400bfd0 tx=0x7f5e34009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c06388f28f4b52 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:22.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.403+0000 7f5e327fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:35:22.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e327fc700 1 -- 172.21.15.35:0/4254785139 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3402b070 con 0x562f8266ea90 2023-03-17T08:35:22.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e327fc700 1 -- 172.21.15.35:0/4254785139 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5e34004ca0 con 0x562f8266ea90 2023-03-17T08:35:22.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f825823a0 con 0x562f8266ea90 2023-03-17T08:35:22.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e327fc700 1 -- 172.21.15.35:0/4254785139 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e34004e60 con 0x562f8266ea90 2023-03-17T08:35:22.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 10 client.15084 fetch_fsmap learned FSMap version 29 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562f823edd90 con 0x562f8266ea90 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e327fc700 1 -- 172.21.15.35:0/4254785139 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f825823a0 con 0x562f8266ea90 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e327fc700 1 -- 172.21.15.35:0/4254785139 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5e3400f580 con 0x562f8266ea90 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 10 client.15084 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 20 client.15084 populate_metadata read hostname 'smithi035' 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826823c0 0x562f82681ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:22.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 4 client.15084 mds_command: new command op to 24431 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.404+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f8258e610 con 0x562f826823c0 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.405+0000 7f5e4affd700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826823c0 0x562f82681ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.405+0000 7f5e4affd700 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826823c0 0x562f82681ad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d519f25be08d2b6 server_cookie=cf47799ffde96d5b in_seq=0 out_seq=0 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.405+0000 7f5e327fc700 10 client.15084 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e327fc700 1 -- 172.21.15.35:0/4254785139 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562f8258e610 con 0x562f826823c0 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e327fc700 10 client.15084 handle_command_reply: tid=0 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 client.15084 shutdown 2023-03-17T08:35:22.990 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 msgr2=0x562f826778e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 0x562f826778e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400bfd0 tx=0x7f5e34009ca0 comp rx=0 tx=0).stop 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 shutdown_connections 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826823c0 0x562f82681ad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266f3e0 0x562f8267e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e327fc700 0 client.15084 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266dc50 0x562f826773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:22.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/4254785139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266ea90 0x562f826778e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 >> 172.21.15.35:0/4254785139 conn(0x562f82669c00 msgr2=0x562f826676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 shutdown_connections 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/4254785139 wait complete. 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.406+0000 7f5e5d5ffb80 20 client.15084 trim_cache size 0 max 16384 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 Processor -- start 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 -- start start 2023-03-17T08:35:23.326 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f82671d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82672290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f825823a0 con 0x562f8266f3e0 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f82678590 con 0x562f8266dc50 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f82569730 con 0x562f8266ea90 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e4b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e4affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f82671d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:23.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e4b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41284/0 (socket says 172.21.15.35:41284) 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e4affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f82671d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:43076/0 (socket says 172.21.15.35:43076) 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.424+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/3725989528 learned_addr learned my addr 172.21.15.35:0/3725989528 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82672290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/3725989528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 msgr2=0x562f82672290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82672290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/3725989528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 msgr2=0x562f82671d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f82671d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/3725989528 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f82586140 con 0x562f8266f3e0 2023-03-17T08:35:23.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4affd700 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f82671d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:35:23.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267e8e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5e44008f20 tx=0x7f5e44007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c99f67ecda605c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e41ffb700 1 -- 172.21.15.35:0/3725989528 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44007e90 con 0x562f8266f3e0 2023-03-17T08:35:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e41ffb700 1 -- 172.21.15.35:0/3725989528 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e44016900 con 0x562f8266f3e0 2023-03-17T08:35:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.425+0000 7f5e41ffb700 1 -- 172.21.15.35:0/3725989528 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44015940 con 0x562f8266f3e0 2023-03-17T08:35:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/3725989528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 msgr2=0x562f8267e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267e8e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5e44008f20 tx=0x7f5e44007660 comp rx=0 tx=0).stop 2023-03-17T08:35:24.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/3725989528 shutdown_connections 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267e8e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f82671d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/3725989528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82672290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/3725989528 >> 172.21.15.35:0/3725989528 conn(0x562f82669c00 msgr2=0x562f8267f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/3725989528 shutdown_connections 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/3725989528 wait complete. 2023-03-17T08:35:24.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 -- start start 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 Processor -- start 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.426+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f826799c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82679f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f8267d460 con 0x562f8266f3e0 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f8267d5d0 con 0x562f8266dc50 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f8267d790 con 0x562f8266ea90 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 10 client.0 _ll_register_callbacks cb 0x562f82465240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41290/0 (socket says 172.21.15.35:41290) 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/1144488126 learned_addr learned my addr 172.21.15.35:0/1144488126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4a7fc700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82679f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4affd700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f826799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/1144488126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 msgr2=0x562f82679f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82679f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:24.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 msgr2=0x562f826799c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f826799c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 -- 172.21.15.35:0/1144488126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c10a030 con 0x562f8266f3e0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e4b7fe700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267cf20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5e44008ef0 tx=0x7f5e44016d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0843642cdff0caf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e327fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e327fc700 1 -- 172.21.15.35:0/1144488126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44007e90 con 0x562f8266f3e0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e327fc700 1 -- 172.21.15.35:0/1144488126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f5e44004ce0 con 0x562f8266f3e0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f8263d1f0 con 0x562f8266f3e0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.427+0000 7f5e327fc700 1 -- 172.21.15.35:0/1144488126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e44004ea0 con 0x562f8266f3e0 2023-03-17T08:35:24.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 10 client.15090 fetch_fsmap learned FSMap version 29 2023-03-17T08:35:26.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f5e44010040 con 0x562f8266f3e0 2023-03-17T08:35:26.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e327fc700 1 -- 172.21.15.35:0/1144488126 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f8263d1f0 con 0x562f8266f3e0 2023-03-17T08:35:26.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e327fc700 1 -- 172.21.15.35:0/1144488126 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5e4401f740 con 0x562f8266f3e0 2023-03-17T08:35:26.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 10 client.15090 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:35:26.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 10 client.15090 resolve_mds: resolved name 'h' to daemon mds.h 2023-03-17T08:35:26.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 20 client.15090 populate_metadata read hostname 'smithi035' 2023-03-17T08:35:26.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826db7c0 0x562f826d8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:26.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 4 client.15090 mds_command: new command op to 24431 tid=0[{"prefix": "status"}] 2023-03-17T08:35:26.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f82443f10 con 0x562f826db7c0 2023-03-17T08:35:26.504 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.428+0000 7f5e4affd700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826db7c0 0x562f826d8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e327fc700 10 client.15090 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e4affd700 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826db7c0 0x562f826d8230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=15ec0ff1226546cd server_cookie=eae3042a10c47536 in_seq=0 out_seq=0 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e327fc700 1 -- 172.21.15.35:0/1144488126 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x562f82443f10 con 0x562f826db7c0 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e327fc700 10 client.15090 handle_command_reply: tid=0 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e5d5ffb80 1 client.15090 shutdown 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 msgr2=0x562f8267cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.429+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267cf20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5e44008ef0 tx=0x7f5e44016d20 comp rx=0 tx=0).stop 2023-03-17T08:35:26.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 shutdown_connections 2023-03-17T08:35:26.508 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f8266f3e0 0x562f8267cf20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:27.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x562f826db7c0 0x562f826d8230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:27.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f8266dc50 0x562f826799c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:27.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e327fc700 0 client.15090 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T08:35:29.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 --2- 172.21.15.35:0/1144488126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f8266ea90 0x562f82679f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:29.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 >> 172.21.15.35:0/1144488126 conn(0x562f82669c00 msgr2=0x562f82671d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:29.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 shutdown_connections 2023-03-17T08:35:29.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 1 -- 172.21.15.35:0/1144488126 wait complete. 2023-03-17T08:35:29.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e5d5ffb80 20 client.15090 trim_cache size 0 max 16384 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 4, 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24431, 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 1224.009979145, 2023-03-17T08:35:29.278 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:35:29.279 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:35:29.279 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:35:29.279 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1488.4201960390001 2023-03-17T08:35:29.279 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:35:29.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5e3809f4d0 msgr2=0x7f5e380a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:30.059 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5e3809f4d0 0x7f5e380a1980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400b5c0 tx=0x7f5e34005fd0 comp rx=0 tx=0).stop 2023-03-17T08:35:30.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 msgr2=0x7f5e4c10b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:30.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c10b530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c990 tx=0x7f5e3c00cd50 comp rx=0 tx=0).stop 2023-03-17T08:35:30.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 shutdown_connections 2023-03-17T08:35:30.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e4c1004e0 0x7f5e4c19d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:30.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f5e3809f4d0 0x7f5e380a1980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:31.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e4c0fe960 0x7f5e4c10b530 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:31.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 --2- 172.21.15.35:0/960080667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4c0ffb50 0x7f5e4c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:31.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 >> 172.21.15.35:0/960080667 conn(0x7f5e4c0f9fa0 msgr2=0x7f5e4c0fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:31.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 shutdown_connections 2023-03-17T08:35:31.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:12.430+0000 7f5e51472700 1 -- 172.21.15.35:0/960080667 wait complete. 2023-03-17T08:35:31.182 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-03-17T08:35:31.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:35:32.239 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.239 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:13 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:14 smithi082 ceph-mon[94281]: pgmap v1536: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:16 smithi082 ceph-mon[94281]: pgmap v1537: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:18 smithi082 ceph-mon[94281]: pgmap v1538: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:20 smithi082 ceph-mon[94281]: pgmap v1539: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:22 smithi082 ceph-mon[94281]: pgmap v1540: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:24 smithi082 ceph-mon[94281]: pgmap v1541: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:25 smithi082 ceph-mon[94281]: pgmap v1542: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:28 smithi082 ceph-mon[94281]: pgmap v1543: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:30 smithi082 ceph-mon[94281]: pgmap v1544: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.240 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:13 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:14 smithi078 ceph-mon[94114]: pgmap v1536: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:16 smithi078 ceph-mon[94114]: pgmap v1537: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:18 smithi078 ceph-mon[94114]: pgmap v1538: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:20 smithi078 ceph-mon[94114]: pgmap v1539: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:22 smithi078 ceph-mon[94114]: pgmap v1540: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:24 smithi078 ceph-mon[94114]: pgmap v1541: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:25 smithi078 ceph-mon[94114]: pgmap v1542: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:32.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:28 smithi078 ceph-mon[94114]: pgmap v1543: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.867 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:30 smithi078 ceph-mon[94114]: pgmap v1544: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:12 smithi035 ceph-mon[92535]: pgmap v1535: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:32.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:35:32.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:13 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:32.868 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:14 smithi035 ceph-mon[92535]: pgmap v1536: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:32.868 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:35:34.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:35:34.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:35:34.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:16 smithi035 ceph-mon[92535]: pgmap v1537: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:18 smithi035 ceph-mon[92535]: pgmap v1538: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:20 smithi035 ceph-mon[92535]: pgmap v1539: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:22 smithi035 ceph-mon[92535]: pgmap v1540: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:24 smithi035 ceph-mon[92535]: pgmap v1541: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:25 smithi035 ceph-mon[92535]: pgmap v1542: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:28 smithi035 ceph-mon[92535]: pgmap v1543: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:34.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:30 smithi035 ceph-mon[92535]: pgmap v1544: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:34.548 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:32 smithi035 ceph-mon[92535]: pgmap v1545: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:36.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:32 smithi078 ceph-mon[94114]: pgmap v1545: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:36.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:32 smithi082 ceph-mon[94281]: pgmap v1545: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:36.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:34 smithi078 ceph-mon[94114]: pgmap v1546: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:37.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:34 smithi082 ceph-mon[94281]: pgmap v1546: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:35:37.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:36 smithi078 ceph-mon[94114]: pgmap v1547: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:39.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:36 smithi082 ceph-mon[94281]: pgmap v1547: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:35:39.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:38 smithi078 ceph-mon[94114]: pgmap v1548: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:35:39.103 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 -- 172.21.15.35:0/4247687978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c1002a0 msgr2=0x7fec3c1006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:40.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 --2- 172.21.15.35:0/4247687978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c1002a0 0x7fec3c1006b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec38009990 tx=0x7fec38009ca0 comp rx=0 tx=0).stop 2023-03-17T08:35:40.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 -- 172.21.15.35:0/4247687978 shutdown_connections 2023-03-17T08:35:40.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 --2- 172.21.15.35:0/4247687978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c101e20 0x7fec3c1086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:40.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 --2- 172.21.15.35:0/4247687978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c1002a0 0x7fec3c1006b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:40.529 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 --2- 172.21.15.35:0/4247687978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c101490 0x7fec3c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 -- 172.21.15.35:0/4247687978 >> 172.21.15.35:0/4247687978 conn(0x7fec3c0fb8e0 msgr2=0x7fec3c0fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 -- 172.21.15.35:0/4247687978 shutdown_connections 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.688+0000 7fec43eaa700 1 -- 172.21.15.35:0/4247687978 wait complete. 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 Processor -- start 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 -- start start 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c1002a0 0x7fec3c074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 0x7fec3c072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c101e20 0x7fec3c0733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c073b50 con 0x7fec3c101490 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c073cc0 con 0x7fec3c1002a0 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec43eaa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c19ff40 con 0x7fec3c101e20 2023-03-17T08:35:40.530 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 0x7fec3c072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:42.774 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 0x7fec3c072e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41302/0 (socket says 172.21.15.35:41302) 2023-03-17T08:35:42.774 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 -- 172.21.15.35:0/238314976 learned_addr learned my addr 172.21.15.35:0/238314976 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:42.774 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41c46700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c1002a0 0x7fec3c074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:42.775 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec42447700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c101e20 0x7fec3c0733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:43.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 -- 172.21.15.35:0/238314976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c101e20 msgr2=0x7fec3c0733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c101e20 0x7fec3c0733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 -- 172.21.15.35:0/238314976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c1002a0 msgr2=0x7fec3c074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.689+0000 7fec41445700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c1002a0 0x7fec3c074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec41445700 1 -- 172.21.15.35:0/238314976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380095f0 con 0x7fec3c101490 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec41445700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 0x7fec3c072e70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00d950 tx=0x7fec2c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec32ffd700 1 -- 172.21.15.35:0/238314976 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c009940 con 0x7fec3c101490 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec32ffd700 1 -- 172.21.15.35:0/238314976 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec2c010460 con 0x7fec3c101490 2023-03-17T08:35:43.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c10ba90 con 0x7fec3c101490 2023-03-17T08:35:43.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec32ffd700 1 -- 172.21.15.35:0/238314976 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00f620 con 0x7fec3c101490 2023-03-17T08:35:43.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.690+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c10b900 con 0x7fec3c101490 2023-03-17T08:35:43.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.693+0000 7fec32ffd700 1 -- 172.21.15.35:0/238314976 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fec2c0105d0 con 0x7fec3c101490 2023-03-17T08:35:43.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.693+0000 7fec32ffd700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec2809f4d0 0x7fec280a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:43.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.693+0000 7fec32ffd700 1 -- 172.21.15.35:0/238314976 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fec2c0ca010 con 0x7fec3c101490 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.693+0000 7fec41c46700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec2809f4d0 0x7fec280a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec41c46700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec2809f4d0 0x7fec280a1980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fec38006010 tx=0x7fec38005ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 Processor -- start 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 -- start start 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6e6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd5ed020 con 0x562edd6e83e0 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd63f960 con 0x562edd6e7a90 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.694+0000 7fec50037b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd638df0 con 0x562edd6e6c50 2023-03-17T08:35:45.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:45.694 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6e6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41310/0 (socket says 172.21.15.35:41310) 2023-03-17T08:35:46.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 -- 172.21.15.35:0/3438213417 learned_addr learned my addr 172.21.15.35:0/3438213417 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:46.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec42447700 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:46.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41c46700 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:46.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 -- 172.21.15.35:0/3438213417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 msgr2=0x562edd6e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:46.474 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 -- 172.21.15.35:0/3438213417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 msgr2=0x562edd6e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 -- 172.21.15.35:0/3438213417 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562edd4ba5e0 con 0x562edd6e83e0 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec42447700 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec41445700 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6e6670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0948d0 tx=0x7fec2c097840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5393dfa2d45e0fe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec27fff700 1 -- 172.21.15.35:0/3438213417 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0b0210 con 0x562edd6e83e0 2023-03-17T08:35:47.960 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec27fff700 1 -- 172.21.15.35:0/3438213417 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec2c097e60 con 0x562edd6e83e0 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.695+0000 7fec27fff700 1 -- 172.21.15.35:0/3438213417 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c09fe20 con 0x562edd6e83e0 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 -- 172.21.15.35:0/3438213417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 msgr2=0x562edd6e6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6e6670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0948d0 tx=0x7fec2c097840 comp rx=0 tx=0).stop 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 -- 172.21.15.35:0/3438213417 shutdown_connections 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 --2- 172.21.15.35:0/3438213417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6e6670 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 -- 172.21.15.35:0/3438213417 >> 172.21.15.35:0/3438213417 conn(0x562edd6e2c00 msgr2=0x562edd6e0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 -- 172.21.15.35:0/3438213417 shutdown_connections 2023-03-17T08:35:48.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 -- 172.21.15.35:0/3438213417 wait complete. 2023-03-17T08:35:49.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.696+0000 7fec50037b80 1 -- start start 2023-03-17T08:35:49.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 Processor -- start 2023-03-17T08:35:49.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6f0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:49.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:49.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:49.171 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd4bc8d0 con 0x562edd6e83e0 2023-03-17T08:35:49.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd6f7f20 con 0x562edd6e7a90 2023-03-17T08:35:49.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd6f80b0 con 0x562edd6e6c50 2023-03-17T08:35:49.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec50037b80 10 client.0 _ll_register_callbacks cb 0x562edd4de240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:35:49.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:49.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41318/0 (socket says 172.21.15.35:41318) 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 -- 172.21.15.35:0/1514297773 learned_addr learned my addr 172.21.15.35:0/1514297773 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec41445700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec41c46700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 -- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 msgr2=0x562edd6f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 -- 172.21.15.35:0/1514297773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 msgr2=0x562edd6f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec42447700 1 -- 172.21.15.35:0/1514297773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c10b900 con 0x562edd6e83e0 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.697+0000 7fec41c46700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec42447700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f79e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fec34007950 tx=0x7fec34007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbe1e0c2e5627c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec257fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec257fa700 1 -- 172.21.15.35:0/1514297773 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34007ea0 con 0x562edd6e83e0 2023-03-17T08:35:49.638 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec257fa700 1 -- 172.21.15.35:0/1514297773 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fec340107e0 con 0x562edd6e83e0 2023-03-17T08:35:50.319 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562edd5fb3a0 con 0x562edd6e83e0 2023-03-17T08:35:51.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec257fa700 1 -- 172.21.15.35:0/1514297773 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec340109a0 con 0x562edd6e83e0 2023-03-17T08:35:51.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 10 client.15102 fetch_fsmap learned FSMap version 29 2023-03-17T08:35:51.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562edd466d90 con 0x562edd6e83e0 2023-03-17T08:35:51.737 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec257fa700 1 -- 172.21.15.35:0/1514297773 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562edd5fb3a0 con 0x562edd6e83e0 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec257fa700 1 -- 172.21.15.35:0/1514297773 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fec34020c00 con 0x562edd6e83e0 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 10 client.15102 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 10 client.15102 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 20 client.15102 populate_metadata read hostname 'smithi035' 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd6fad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 4 client.15102 mds_command: new command op to 24439 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.698+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562edd607610 con 0x562edd6fba00 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.699+0000 7fec41c46700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd6fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.699+0000 7fec257fa700 10 client.15102 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T08:35:52.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.699+0000 7fec41c46700 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd6fad80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f0f5c0f4e8caef1f server_cookie=cf622559ab7efd95 in_seq=0 out_seq=0 2023-03-17T08:35:52.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec257fa700 1 -- 172.21.15.35:0/1514297773 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562edd607610 con 0x562edd6fba00 2023-03-17T08:35:52.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec257fa700 10 client.15102 handle_command_reply: tid=0 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 client.15102 shutdown 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 msgr2=0x562edd6f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f79e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fec34007950 tx=0x7fec34007c60 comp rx=0 tx=0).stop 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 shutdown_connections 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd6fad80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f79e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec257fa700 0 client.15102 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T08:35:55.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e6c50 0x562edd6f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 --2- 172.21.15.35:0/1514297773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e7a90 0x562edd6f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 >> 172.21.15.35:0/1514297773 conn(0x562edd6e2c00 msgr2=0x562edd6e06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 shutdown_connections 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 1 -- 172.21.15.35:0/1514297773 wait complete. 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.700+0000 7fec50037b80 20 client.15102 trim_cache size 0 max 16384 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 Processor -- start 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 -- start start 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6fad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd5fb3a0 con 0x562edd6e83e0 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd606e00 con 0x562edd6e6c50 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.718+0000 7fec50037b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd5fab70 con 0x562edd6e7a90 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41326/0 (socket says 172.21.15.35:41326) 2023-03-17T08:35:55.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 -- 172.21.15.35:0/714696432 learned_addr learned my addr 172.21.15.35:0/714696432 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec41445700 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec41c46700 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 -- 172.21.15.35:0/714696432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 msgr2=0x562edd6fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 -- 172.21.15.35:0/714696432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 msgr2=0x562edd6fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 -- 172.21.15.35:0/714696432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562edd6dda00 con 0x562edd6e83e0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec41445700 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec42447700 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f7900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fec340104f0 tx=0x7fec34007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa194205381d4fe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec30ff9700 1 -- 172.21.15.35:0/714696432 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340093d0 con 0x562edd6e83e0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec30ff9700 1 -- 172.21.15.35:0/714696432 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec34015a30 con 0x562edd6e83e0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.719+0000 7fec30ff9700 1 -- 172.21.15.35:0/714696432 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34020430 con 0x562edd6e83e0 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 -- 172.21.15.35:0/714696432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 msgr2=0x562edd6f7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f7900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fec340104f0 tx=0x7fec34007ea0 comp rx=0 tx=0).stop 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 -- 172.21.15.35:0/714696432 shutdown_connections 2023-03-17T08:35:55.488 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f7900 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 --2- 172.21.15.35:0/714696432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 -- 172.21.15.35:0/714696432 >> 172.21.15.35:0/714696432 conn(0x562edd6e2c00 msgr2=0x562edd6ee1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 -- 172.21.15.35:0/714696432 shutdown_connections 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 -- 172.21.15.35:0/714696432 wait complete. 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 -- start start 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.720+0000 7fec50037b80 1 Processor -- start 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd6f6460 con 0x562edd6e83e0 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd6f65d0 con 0x562edd6e6c50 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562edd6f6790 con 0x562edd6e7a90 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 10 client.0 _ll_register_callbacks cb 0x562edd4de240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec41445700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:56.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41332/0 (socket says 172.21.15.35:41332) 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 -- 172.21.15.35:0/4187875451 learned_addr learned my addr 172.21.15.35:0/4187875451 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec41c46700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 -- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 msgr2=0x562edd6f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 -- 172.21.15.35:0/4187875451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 msgr2=0x562edd6f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 -- 172.21.15.35:0/4187875451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562edd466d90 con 0x562edd6e83e0 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec41c46700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec42447700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f5f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec3402d000 tx=0x7fec34015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a12ddd1d0f70183 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec257fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec257fa700 1 -- 172.21.15.35:0/4187875451 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340093d0 con 0x562edd6e83e0 2023-03-17T08:35:56.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec257fa700 1 -- 172.21.15.35:0/4187875451 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fec340109f0 con 0x562edd6e83e0 2023-03-17T08:35:56.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.721+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562edd6b61f0 con 0x562edd6e83e0 2023-03-17T08:35:56.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec257fa700 1 -- 172.21.15.35:0/4187875451 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec34010bb0 con 0x562edd6e83e0 2023-03-17T08:35:56.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 10 client.15108 fetch_fsmap learned FSMap version 29 2023-03-17T08:35:56.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562edd44fc10 con 0x562edd6e83e0 2023-03-17T08:35:56.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec257fa700 1 -- 172.21.15.35:0/4187875451 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec34042020 con 0x562edd6e83e0 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec257fa700 1 -- 172.21.15.35:0/4187875451 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fec34029570 con 0x562edd6e83e0 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 10 client.15108 resolve_mds: resolved name 'f' to daemon mds.f 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 20 client.15108 populate_metadata read hostname 'smithi035' 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd751850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 4 client.15108 mds_command: new command op to 24439 tid=0[{"prefix": "status"}] 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562edd4bcf10 con 0x562edd6fba00 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.722+0000 7fec41c46700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd751850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:35:56.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec257fa700 10 client.15108 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec41c46700 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd751850 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b71c77caff8a4ab2 server_cookie=6820b83857bb9b3d in_seq=0 out_seq=0 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec257fa700 1 -- 172.21.15.35:0/4187875451 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x562edd4bcf10 con 0x562edd6fba00 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec257fa700 10 client.15108 handle_command_reply: tid=0 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 client.15108 shutdown 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 msgr2=0x562edd6f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f5f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec3402d000 tx=0x7fec34015760 comp rx=0 tx=0).stop 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 shutdown_connections 2023-03-17T08:35:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x562edd6fba00 0x562edd751850 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562edd6e83e0 0x562edd6f5f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562edd6e6c50 0x562edd6f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec257fa700 0 client.15108 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 --2- 172.21.15.35:0/4187875451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562edd6e7a90 0x562edd6f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 >> 172.21.15.35:0/4187875451 conn(0x562edd6e2c00 msgr2=0x562edd6fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 shutdown_connections 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 1 -- 172.21.15.35:0/4187875451 wait complete. 2023-03-17T08:35:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.723+0000 7fec50037b80 20 client.15108 trim_cache size 0 max 16384 2023-03-17T08:35:56.198 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 3, 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24439, 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:35:57.488 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 1247.3151798700001, 2023-03-17T08:35:57.489 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:35:57.489 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:35:57.489 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:35:57.489 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1515.114928039 2023-03-17T08:35:57.489 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:35:57.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec2809f4d0 msgr2=0x7fec280a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec2809f4d0 0x7fec280a1980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fec38006010 tx=0x7fec38005ad0 comp rx=0 tx=0).stop 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 msgr2=0x7fec3c072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 0x7fec3c072e70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00d950 tx=0x7fec2c00dc60 comp rx=0 tx=0).stop 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 shutdown_connections 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec3c101e20 0x7fec3c0733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec3c1002a0 0x7fec3c074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:59.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec2809f4d0 0x7fec280a1980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:59.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 --2- 172.21.15.35:0/238314976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec3c101490 0x7fec3c072e70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:35:59.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 >> 172.21.15.35:0/238314976 conn(0x7fec3c0fb8e0 msgr2=0x7fec3c0fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:35:59.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 shutdown_connections 2023-03-17T08:35:59.140 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:35:34.724+0000 7fec43eaa700 1 -- 172.21.15.35:0/238314976 wait complete. 2023-03-17T08:35:59.141 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-17T08:36:00.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:34 smithi035 ceph-mon[92535]: pgmap v1546: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:02.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:36 smithi035 ceph-mon[92535]: pgmap v1547: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:02.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:38 smithi035 ceph-mon[92535]: pgmap v1548: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:02.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:40 smithi035 ceph-mon[92535]: pgmap v1549: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:03.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:42 smithi035 ceph-mon[92535]: pgmap v1550: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:03.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:44 smithi035 ceph-mon[92535]: pgmap v1551: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:03.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:46 smithi035 ceph-mon[92535]: pgmap v1552: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:03.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:48 smithi035 ceph-mon[92535]: pgmap v1553: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:03.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:50 smithi035 ceph-mon[92535]: pgmap v1554: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:03.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:52 smithi035 ceph-mon[92535]: pgmap v1555: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:03.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:53 smithi035 ceph-mon[92535]: pgmap v1556: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:03.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:56 smithi035 ceph-mon[92535]: pgmap v1557: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:03.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:35:58 smithi035 ceph-mon[92535]: pgmap v1558: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:03.749 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:40 smithi078 ceph-mon[94114]: pgmap v1549: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:05.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:42 smithi078 ceph-mon[94114]: pgmap v1550: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:05.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:44 smithi078 ceph-mon[94114]: pgmap v1551: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:05.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:46 smithi078 ceph-mon[94114]: pgmap v1552: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:05.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:48 smithi078 ceph-mon[94114]: pgmap v1553: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:05.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:50 smithi078 ceph-mon[94114]: pgmap v1554: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:05.685 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:52 smithi078 ceph-mon[94114]: pgmap v1555: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:05.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:53 smithi078 ceph-mon[94114]: pgmap v1556: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:05.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:56 smithi078 ceph-mon[94114]: pgmap v1557: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:08.529 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:35:58 smithi078 ceph-mon[94114]: pgmap v1558: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:38 smithi082 ceph-mon[94281]: pgmap v1548: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:40 smithi082 ceph-mon[94281]: pgmap v1549: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:42 smithi082 ceph-mon[94281]: pgmap v1550: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:44 smithi082 ceph-mon[94281]: pgmap v1551: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:46 smithi082 ceph-mon[94281]: pgmap v1552: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:48 smithi082 ceph-mon[94281]: pgmap v1553: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:50 smithi082 ceph-mon[94281]: pgmap v1554: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:52 smithi082 ceph-mon[94281]: pgmap v1555: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:53 smithi082 ceph-mon[94281]: pgmap v1556: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:56 smithi082 ceph-mon[94281]: pgmap v1557: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:08.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:35:58 smithi082 ceph-mon[94281]: pgmap v1558: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:08.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:00 smithi082 ceph-mon[94281]: pgmap v1559: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:08.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:02 smithi082 ceph-mon[94281]: pgmap v1560: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:08.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:04 smithi082 ceph-mon[94281]: pgmap v1561: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:08.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:06 smithi082 ceph-mon[94281]: pgmap v1562: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:08.531 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:00 smithi035 ceph-mon[92535]: pgmap v1559: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:09.190 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:02 smithi035 ceph-mon[92535]: pgmap v1560: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:09.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:00 smithi078 ceph-mon[94114]: pgmap v1559: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:10.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:02 smithi078 ceph-mon[94114]: pgmap v1560: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:10.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:04 smithi078 ceph-mon[94114]: pgmap v1561: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:10.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:06 smithi078 ceph-mon[94114]: pgmap v1562: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:10.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:08 smithi078 ceph-mon[94114]: pgmap v1563: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:10.193 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:08 smithi082 ceph-mon[94281]: pgmap v1563: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:12.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:10 smithi078 ceph-mon[94114]: pgmap v1564: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:12.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:11 smithi078 ceph-mon[94114]: pgmap v1565: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:12.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:10 smithi082 ceph-mon[94281]: pgmap v1564: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:12.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:11 smithi082 ceph-mon[94281]: pgmap v1565: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:12.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 -- 172.21.15.35:0/1376780342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5108100cd0 msgr2=0x7f5108107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 --2- 172.21.15.35:0/1376780342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5108100cd0 0x7f5108107590 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f510000b0a0 tx=0x7f510000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 -- 172.21.15.35:0/1376780342 shutdown_connections 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 --2- 172.21.15.35:0/1376780342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5108100cd0 0x7f5108107590 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 --2- 172.21.15.35:0/1376780342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51080ff150 0x7f51080ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 --2- 172.21.15.35:0/1376780342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5108100340 0x7f5108100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 -- 172.21.15.35:0/1376780342 >> 172.21.15.35:0/1376780342 conn(0x7f51080fa750 msgr2=0x7f51080fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 -- 172.21.15.35:0/1376780342 shutdown_connections 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.889+0000 7f510d2a9700 1 -- 172.21.15.35:0/1376780342 wait complete. 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 Processor -- start 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 -- start start 2023-03-17T08:36:14.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 0x7f5108194ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5108100340 0x7f51081953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5108100cd0 0x7f510819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510819ca20 con 0x7f51080ff150 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510819cb60 con 0x7f5108100cd0 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f510d2a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510819ccf0 con 0x7f5108100340 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 0x7f5108194ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 0x7f5108194ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41342/0 (socket says 172.21.15.35:41342) 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f5106ffd700 1 -- 172.21.15.35:0/2856633280 learned_addr learned my addr 172.21.15.35:0/2856633280 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.890+0000 7f51077fe700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5108100cd0 0x7f510819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f5106ffd700 1 -- 172.21.15.35:0/2856633280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5108100340 msgr2=0x7f51081953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f51067fc700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5108100340 0x7f51081953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:14.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f5106ffd700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5108100340 0x7f51081953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:15.501 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f5106ffd700 1 -- 172.21.15.35:0/2856633280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5108100cd0 msgr2=0x7f510819c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:16.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f5106ffd700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5108100cd0 0x7f510819c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f5106ffd700 1 -- 172.21.15.35:0/2856633280 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100009d00 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f51077fe700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5108100cd0 0x7f510819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f5106ffd700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 0x7f5108194ea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00d980 tx=0x7f50fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f50effff700 1 -- 172.21.15.35:0/2856633280 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00de60 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f50effff700 1 -- 172.21.15.35:0/2856633280 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50fc0044b0 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510810a970 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f50effff700 1 -- 172.21.15.35:0/2856633280 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc003b40 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.891+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510810a7e0 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.893+0000 7f50effff700 1 -- 172.21.15.35:0/2856633280 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f50fc003ca0 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.894+0000 7f50effff700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f50f009f550 0x7f50f00a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.894+0000 7f51067fc700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f50f009f550 0x7f50f00a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.894+0000 7f50effff700 1 -- 172.21.15.35:0/2856633280 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f50fc0c9ef0 con 0x7f51080ff150 2023-03-17T08:36:16.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.894+0000 7f51067fc700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f50f009f550 0x7f50f00a1a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50f8005950 tx=0x7f50f8005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 Processor -- start 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 -- start start 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b1eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b1d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b1e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6a24020 con 0x55f9b6b1f3e0 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6a76960 con 0x55f9b6b1dc50 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5119436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6a6fdf0 con 0x55f9b6b1ea90 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b1d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b1d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41352/0 (socket says 172.21.15.35:41352) 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 -- 172.21.15.35:0/4238577036 learned_addr learned my addr 172.21.15.35:0/4238577036 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f5106ffd700 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b1eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51077fe700 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b1e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 -- 172.21.15.35:0/4238577036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 msgr2=0x55f9b6b1eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b1eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:16.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 -- 172.21.15.35:0/4238577036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1dc50 msgr2=0x55f9b6b1e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:17.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b1e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.895+0000 7f51067fc700 1 -- 172.21.15.35:0/4238577036 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9b68f15e0 con 0x55f9b6b1f3e0 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f51067fc700 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b1d670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f50f800dbe0 tx=0x7f50f8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3391c91b820deca5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f50ed7fa700 1 -- 172.21.15.35:0/4238577036 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8004a30 con 0x55f9b6b1f3e0 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f50ed7fa700 1 -- 172.21.15.35:0/4238577036 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50f80054b0 con 0x55f9b6b1f3e0 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f50ed7fa700 1 -- 172.21.15.35:0/4238577036 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f800fab0 con 0x55f9b6b1f3e0 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 -- 172.21.15.35:0/4238577036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 msgr2=0x55f9b6b1d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b1d670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f50f800dbe0 tx=0x7f50f8010000 comp rx=0 tx=0).stop 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 -- 172.21.15.35:0/4238577036 shutdown_connections 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b1e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b1eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 --2- 172.21.15.35:0/4238577036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b1d670 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 -- 172.21.15.35:0/4238577036 >> 172.21.15.35:0/4238577036 conn(0x55f9b6b19c00 msgr2=0x55f9b6b17fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.896+0000 7f5119436b80 1 -- 172.21.15.35:0/4238577036 shutdown_connections 2023-03-17T08:36:17.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 -- 172.21.15.35:0/4238577036 wait complete. 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 -- start start 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 Processor -- start 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b27980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b2e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b68f38d0 con 0x55f9b6b1dc50 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b2ef00 con 0x55f9b6b1f3e0 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b2f090 con 0x55f9b6b1ea90 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5119436b80 10 client.0 _ll_register_callbacks cb 0x55f9b6915240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:17.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b27440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41356/0 (socket says 172.21.15.35:41356) 2023-03-17T08:36:17.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f5106ffd700 1 -- 172.21.15.35:0/862465990 learned_addr learned my addr 172.21.15.35:0/862465990 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:17.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f51077fe700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b2e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.897+0000 7f51067fc700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b27980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5106ffd700 1 -- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 msgr2=0x55f9b6b27980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5106ffd700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b27980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5106ffd700 1 -- 172.21.15.35:0/862465990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1f3e0 msgr2=0x55f9b6b2e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5106ffd700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b2e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5106ffd700 1 -- 172.21.15.35:0/862465990 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f800d890 con 0x55f9b6b1dc50 2023-03-17T08:36:18.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5106ffd700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b27440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009520 tx=0x7f50fc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c263d8834c744e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:18.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f50eaff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:36:18.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f50eaff5700 1 -- 172.21.15.35:0/862465990 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc097390 con 0x55f9b6b1dc50 2023-03-17T08:36:18.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f50eaff5700 1 -- 172.21.15.35:0/862465990 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f50fc09fe90 con 0x55f9b6b1dc50 2023-03-17T08:36:18.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9b6a323a0 con 0x55f9b6b1dc50 2023-03-17T08:36:18.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f50eaff5700 1 -- 172.21.15.35:0/862465990 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc09fa00 con 0x55f9b6b1dc50 2023-03-17T08:36:18.952 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5119436b80 10 client.15120 fetch_fsmap learned FSMap version 29 2023-03-17T08:36:19.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f9b689dd90 con 0x55f9b6b1dc50 2023-03-17T08:36:19.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f50eaff5700 1 -- 172.21.15.35:0/862465990 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f9b6a323a0 con 0x55f9b6b1dc50 2023-03-17T08:36:19.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.898+0000 7f50eaff5700 1 -- 172.21.15.35:0/862465990 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f50fc0c1d20 con 0x55f9b6b1dc50 2023-03-17T08:36:19.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f5119436b80 10 client.15120 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:36:19.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f5119436b80 10 client.15120 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-17T08:36:19.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f5119436b80 20 client.15120 populate_metadata read hostname 'smithi035' 2023-03-17T08:36:19.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f5119436b80 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b32930 0x55f9b6b31d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:19.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f5119436b80 4 client.15120 mds_command: new command op to 24445 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9b6a3e610 con 0x55f9b6b32930 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f51067fc700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b32930 0x55f9b6b31d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f50eaff5700 10 client.15120 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.899+0000 7f51067fc700 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b32930 0x55f9b6b31d40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=409760e8225d17c server_cookie=1fa8d88d8d9fa52d in_seq=0 out_seq=0 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f50eaff5700 1 -- 172.21.15.35:0/862465990 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f9b6a3e610 con 0x55f9b6b32930 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f50eaff5700 10 client.15120 handle_command_reply: tid=0 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 client.15120 shutdown 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 msgr2=0x55f9b6b27440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:19.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b27440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009520 tx=0x7f50fc0099b0 comp rx=0 tx=0).stop 2023-03-17T08:36:20.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 shutdown_connections 2023-03-17T08:36:20.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b32930 0x55f9b6b31d40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:20.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1f3e0 0x55f9b6b2e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:20.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b27440 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:20.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f50eaff5700 0 client.15120 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 --2- 172.21.15.35:0/862465990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b27980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 >> 172.21.15.35:0/862465990 conn(0x55f9b6b19c00 msgr2=0x55f9b6b176c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 shutdown_connections 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 1 -- 172.21.15.35:0/862465990 wait complete. 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.900+0000 7f5119436b80 20 client.15120 trim_cache size 0 max 16384 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 Processor -- start 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 -- start start 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b19c00 0x55f9b6b2f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b251d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b12bc0 con 0x55f9b6b1dc50 2023-03-17T08:36:20.946 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b18cd0 con 0x55f9b6b1ea90 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f5119436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6a3e610 con 0x55f9b6b19c00 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.918+0000 7f51067fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41366/0 (socket says 172.21.15.35:41366) 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 -- 172.21.15.35:0/1455422255 learned_addr learned my addr 172.21.15.35:0/1455422255 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51077fe700 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f5106ffd700 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b19c00 0x55f9b6b2f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 -- 172.21.15.35:0/1455422255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b19c00 msgr2=0x55f9b6b2f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:22.321 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b19c00 0x55f9b6b2f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 -- 172.21.15.35:0/1455422255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 msgr2=0x55f9b6b251d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b251d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 -- 172.21.15.35:0/1455422255 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9b6a36140 con 0x55f9b6b1dc50 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f5106ffd700 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b19c00 0x55f9b6b2f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f51067fc700 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d620 tx=0x7f50f800d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df294adc2341eea3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f50edffb700 1 -- 172.21.15.35:0/1455422255 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80323b0 con 0x55f9b6b1dc50 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f50edffb700 1 -- 172.21.15.35:0/1455422255 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50f8004ce0 con 0x55f9b6b1dc50 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.919+0000 7f50edffb700 1 -- 172.21.15.35:0/1455422255 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8005140 con 0x55f9b6b1dc50 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- 172.21.15.35:0/1455422255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 msgr2=0x55f9b6b2e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d620 tx=0x7f50f800d6d0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- 172.21.15.35:0/1455422255 shutdown_connections 2023-03-17T08:36:22.322 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b251d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b19c00 0x55f9b6b2f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- 172.21.15.35:0/1455422255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- 172.21.15.35:0/1455422255 >> 172.21.15.35:0/1455422255 conn(0x55f9b6b1d880 msgr2=0x55f9b6b1e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- 172.21.15.35:0/1455422255 shutdown_connections 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- 172.21.15.35:0/1455422255 wait complete. 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- start start 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 Processor -- start 2023-03-17T08:36:22.793 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 0x55f9b6b246e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b86830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b86f90 con 0x55f9b6b19c00 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b87100 con 0x55f9b6b1ea90 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6b872c0 con 0x55f9b6b1dc50 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5119436b80 10 client.0 _ll_register_callbacks cb 0x55f9b6915240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 0x55f9b6b246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 0x55f9b6b246e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41370/0 (socket says 172.21.15.35:41370) 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.920+0000 7f5106ffd700 1 -- 172.21.15.35:0/2878964466 learned_addr learned my addr 172.21.15.35:0/2878964466 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f51067fc700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5106ffd700 1 -- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1dc50 msgr2=0x55f9b6b2e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5106ffd700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5106ffd700 1 -- 172.21.15.35:0/2878964466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 msgr2=0x55f9b6b86830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5106ffd700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b86830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5106ffd700 1 -- 172.21.15.35:0/2878964466 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f802c040 con 0x55f9b6b19c00 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f51067fc700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:36:22.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5106ffd700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 0x55f9b6b246e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009fd0 tx=0x7f50fc096250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9decc06fcceb5de9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f50eaff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f50eaff5700 1 -- 172.21.15.35:0/2878964466 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0c78c0 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f50eaff5700 1 -- 172.21.15.35:0/2878964466 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f50fc096c00 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9b68f3f10 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f50eaff5700 1 -- 172.21.15.35:0/2878964466 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50fc09fe90 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5119436b80 10 client.15126 fetch_fsmap learned FSMap version 29 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f9b68c4200 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.921+0000 7f50eaff5700 1 -- 172.21.15.35:0/2878964466 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f9b68f3f10 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f50eaff5700 1 -- 172.21.15.35:0/2878964466 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f50fc0943b0 con 0x55f9b6b19c00 2023-03-17T08:36:22.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f5119436b80 10 client.15126 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f5119436b80 10 client.15126 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f5119436b80 20 client.15126 populate_metadata read hostname 'smithi035' 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f5119436b80 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b1f3e0 0x55f9b6b885d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f5119436b80 4 client.15126 mds_command: new command op to 24445 tid=0[{"prefix": "status"}] 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f9b6a2c370 con 0x55f9b6b1f3e0 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f51067fc700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b1f3e0 0x55f9b6b885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:24.213 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f50eaff5700 10 client.15126 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.922+0000 7f51067fc700 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b1f3e0 0x55f9b6b885d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc47636874840406 server_cookie=1d68df5aaa9c8120 in_seq=0 out_seq=0 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f50eaff5700 1 -- 172.21.15.35:0/2878964466 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f9b6a2c370 con 0x55f9b6b1f3e0 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f50eaff5700 10 client.15126 handle_command_reply: tid=0 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 client.15126 shutdown 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 msgr2=0x55f9b6b246e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 0x55f9b6b246e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009fd0 tx=0x7f50fc096250 comp rx=0 tx=0).stop 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 shutdown_connections 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55f9b6b1f3e0 0x55f9b6b885d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:24.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f9b6b1ea90 0x55f9b6b86830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:25.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f50eaff5700 0 client.15126 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T08:36:26.421 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f9b6b19c00 0x55f9b6b246e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:26.422 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 --2- 172.21.15.35:0/2878964466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9b6b1dc50 0x55f9b6b2e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:27.214 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 >> 172.21.15.35:0/2878964466 conn(0x55f9b6b1d880 msgr2=0x55f9b6b2f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:29.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 shutdown_connections 2023-03-17T08:36:29.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 1 -- 172.21.15.35:0/2878964466 wait complete. 2023-03-17T08:36:29.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f5119436b80 20 client.15126 trim_cache size 0 max 16384 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 2, 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24445, 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 1277.5246099169999, 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1542.0408023699999 2023-03-17T08:36:29.086 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f50f009f550 msgr2=0x7f50f00a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f510d2a9700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f50f009f550 0x7f50f00a1a00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50f8005950 tx=0x7f50f8005cf0 comp rx=0 tx=0).stop 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 msgr2=0x7f5108194ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.923+0000 7f510d2a9700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 0x7f5108194ea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00d980 tx=0x7f50fc00dd40 comp rx=0 tx=0).stop 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 shutdown_connections 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5108100cd0 0x7f510819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f50f009f550 0x7f50f00a1a00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51080ff150 0x7f5108194ea0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 --2- 172.21.15.35:0/2856633280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5108100340 0x7f51081953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 >> 172.21.15.35:0/2856633280 conn(0x7f51080fa750 msgr2=0x7f51081038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 shutdown_connections 2023-03-17T08:36:29.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:03.924+0000 7f510d2a9700 1 -- 172.21.15.35:0/2856633280 wait complete. 2023-03-17T08:36:29.089 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-03-17T08:36:29.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:14 smithi078 ceph-mon[94114]: pgmap v1566: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:29.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:14 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:36:29.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:16 smithi078 ceph-mon[94114]: pgmap v1567: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:18 smithi078 ceph-mon[94114]: pgmap v1568: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:20 smithi078 ceph-mon[94114]: pgmap v1569: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:22 smithi078 ceph-mon[94114]: pgmap v1570: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:31.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:24 smithi078 ceph-mon[94114]: pgmap v1571: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:25 smithi078 ceph-mon[94114]: pgmap v1572: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:31.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:28 smithi078 ceph-mon[94114]: pgmap v1573: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:31.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:14 smithi082 ceph-mon[94281]: pgmap v1566: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:31.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:14 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:36:31.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:36:32.319 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:16 smithi082 ceph-mon[94281]: pgmap v1567: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:18 smithi082 ceph-mon[94281]: pgmap v1568: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:20 smithi082 ceph-mon[94281]: pgmap v1569: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:22 smithi082 ceph-mon[94281]: pgmap v1570: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:24 smithi082 ceph-mon[94281]: pgmap v1571: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:25 smithi082 ceph-mon[94281]: pgmap v1572: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:32.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:28 smithi082 ceph-mon[94281]: pgmap v1573: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:32.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:04 smithi035 ceph-mon[92535]: pgmap v1561: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:32.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:06 smithi035 ceph-mon[92535]: pgmap v1562: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:32.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:08 smithi035 ceph-mon[92535]: pgmap v1563: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:32.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:10 smithi035 ceph-mon[92535]: pgmap v1564: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:32.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:11 smithi035 ceph-mon[92535]: pgmap v1565: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:32.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:14 smithi035 ceph-mon[92535]: pgmap v1566: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:14 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:16 smithi035 ceph-mon[92535]: pgmap v1567: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:18 smithi035 ceph-mon[92535]: pgmap v1568: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:33.542 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:20 smithi035 ceph-mon[92535]: pgmap v1569: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:33.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:22 smithi035 ceph-mon[92535]: pgmap v1570: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:33.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:24 smithi035 ceph-mon[92535]: pgmap v1571: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:33.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:25 smithi035 ceph-mon[92535]: pgmap v1572: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:36:33.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:28 smithi035 ceph-mon[92535]: pgmap v1573: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:36:33.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:30 smithi035 ceph-mon[92535]: pgmap v1574: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:33.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:30 smithi078 ceph-mon[94114]: pgmap v1574: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:34.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:32 smithi078 ceph-mon[94114]: pgmap v1575: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:34.384 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:30 smithi082 ceph-mon[94281]: pgmap v1574: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:36:34.384 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:32 smithi082 ceph-mon[94281]: pgmap v1575: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:36:34.743 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 -- 172.21.15.35:0/2485488816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7900ff110 msgr2=0x7ff7900ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:35.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 --2- 172.21.15.35:0/2485488816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7900ff110 0x7ff7900ff520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009990 tx=0x7ff78c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:36:35.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 -- 172.21.15.35:0/2485488816 shutdown_connections 2023-03-17T08:36:35.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 --2- 172.21.15.35:0/2485488816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790100d50 0x7ff7901075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:35.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 --2- 172.21.15.35:0/2485488816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7900ff110 0x7ff7900ff520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:35.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 --2- 172.21.15.35:0/2485488816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7901003a0 0x7ff790100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:35.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 -- 172.21.15.35:0/2485488816 >> 172.21.15.35:0/2485488816 conn(0x7ff7900fa730 msgr2=0x7ff7900fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:35.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 -- 172.21.15.35:0/2485488816 shutdown_connections 2023-03-17T08:36:35.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.460+0000 7ff7977a5700 1 -- 172.21.15.35:0/2485488816 wait complete. 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 Processor -- start 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 -- start start 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7900ff110 0x7ff7900688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 0x7ff79019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff790100d50 0x7ff79019d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79019d9a0 con 0x7ff7901003a0 2023-03-17T08:36:36.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79019db10 con 0x7ff7900ff110 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff7977a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79019dcd0 con 0x7ff790100d50 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 0x7ff79019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 0x7ff79019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41386/0 (socket says 172.21.15.35:41386) 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 -- 172.21.15.35:0/1295813909 learned_addr learned my addr 172.21.15.35:0/1295813909 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff795541700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7900ff110 0x7ff7900688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff795d42700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff790100d50 0x7ff79019d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 -- 172.21.15.35:0/1295813909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff790100d50 msgr2=0x7ff79019d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff790100d50 0x7ff79019d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:36.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 -- 172.21.15.35:0/1295813909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7900ff110 msgr2=0x7ff7900688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:36.602 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7900ff110 0x7ff7900688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:36.602 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 -- 172.21.15.35:0/1295813909 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0095f0 con 0x7ff7901003a0 2023-03-17T08:36:38.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.461+0000 7ff794d40700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 0x7ff79019abc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff78000d950 tx=0x7ff78000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:39.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.462+0000 7ff7867fc700 1 -- 172.21.15.35:0/1295813909 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780009940 con 0x7ff7901003a0 2023-03-17T08:36:39.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.462+0000 7ff7867fc700 1 -- 172.21.15.35:0/1295813909 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff780010460 con 0x7ff7901003a0 2023-03-17T08:36:40.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.462+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79010a9b0 con 0x7ff7901003a0 2023-03-17T08:36:40.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.462+0000 7ff7867fc700 1 -- 172.21.15.35:0/1295813909 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78000f620 con 0x7ff7901003a0 2023-03-17T08:36:40.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.462+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79010a820 con 0x7ff7901003a0 2023-03-17T08:36:40.487 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.464+0000 7ff7867fc700 1 -- 172.21.15.35:0/1295813909 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff7800105d0 con 0x7ff7901003a0 2023-03-17T08:36:40.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.464+0000 7ff7867fc700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff77c09f4d0 0x7ff77c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:41.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.465+0000 7ff7867fc700 1 -- 172.21.15.35:0/1295813909 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff7800c9fd0 con 0x7ff7901003a0 2023-03-17T08:36:41.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.465+0000 7ff795541700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff77c09f4d0 0x7ff77c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:41.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.465+0000 7ff795541700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff77c09f4d0 0x7ff77c0a1980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00b5c0 tx=0x7ff78c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:41.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 Processor -- start 2023-03-17T08:36:44.364 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 -- start start 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b23ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b22670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b230c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32a29020 con 0x55ab32b243e0 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32a7b960 con 0x55ab32b22c50 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32a74df0 con 0x55ab32b23a90 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b22670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:44.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b22670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41394/0 (socket says 172.21.15.35:41394) 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 -- 172.21.15.35:0/2038720703 learned_addr learned my addr 172.21.15.35:0/2038720703 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff795541700 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b23ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff795d42700 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 -- 172.21.15.35:0/2038720703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 msgr2=0x55ab32b23ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b23ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 -- 172.21.15.35:0/2038720703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 msgr2=0x55ab32b230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:44.366 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 -- 172.21.15.35:0/2038720703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab328f65e0 con 0x55ab32b243e0 2023-03-17T08:36:46.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff795d42700 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:36:46.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.466+0000 7ff794d40700 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b22670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff780094890 tx=0x7ff780097a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c1dc4633c216d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:46.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff77b7fe700 1 -- 172.21.15.35:0/2038720703 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780097e20 con 0x55ab32b243e0 2023-03-17T08:36:46.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff77b7fe700 1 -- 172.21.15.35:0/2038720703 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7800a0010 con 0x55ab32b243e0 2023-03-17T08:36:46.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff77b7fe700 1 -- 172.21.15.35:0/2038720703 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78009fe00 con 0x55ab32b243e0 2023-03-17T08:36:46.890 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2038720703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 msgr2=0x55ab32b22670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b22670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff780094890 tx=0x7ff780097a60 comp rx=0 tx=0).stop 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2038720703 shutdown_connections 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b23ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2038720703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b22670 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2038720703 >> 172.21.15.35:0/2038720703 conn(0x55ab32b1ec00 msgr2=0x55ab32b1cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2038720703 shutdown_connections 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.467+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2038720703 wait complete. 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 -- start start 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 Processor -- start 2023-03-17T08:36:46.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 0x55ab32b2c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:46.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b2ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:46.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b33aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:46.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab328f88d0 con 0x55ab32b22c50 2023-03-17T08:36:46.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b33fe0 con 0x55ab32b243e0 2023-03-17T08:36:46.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b34170 con 0x55ab32b23a90 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff7a3932b80 10 client.0 _ll_register_callbacks cb 0x55ab3291a240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff795541700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 0x55ab32b2c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff795541700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 0x55ab32b2c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41398/0 (socket says 172.21.15.35:41398) 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff794d40700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b2ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff795541700 1 -- 172.21.15.35:0/2313967610 learned_addr learned my addr 172.21.15.35:0/2313967610 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.468+0000 7ff795d42700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b33aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:50.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff794d40700 1 -- 172.21.15.35:0/2313967610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 msgr2=0x55ab32b33aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:50.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff794d40700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b33aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:50.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff794d40700 1 -- 172.21.15.35:0/2313967610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 msgr2=0x55ab32b2c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:36:50.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff794d40700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 0x55ab32b2c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:52.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff794d40700 1 -- 172.21.15.35:0/2313967610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79010a820 con 0x55ab32b23a90 2023-03-17T08:36:52.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff795541700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 0x55ab32b2c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:36:52.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff794d40700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b2ca60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7800c7bc0 tx=0x7ff780010c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff3e12308b442d1e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:36:54.360 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff778ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T08:36:54.360 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff778ff9700 1 -- 172.21.15.35:0/2313967610 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800c1ea0 con 0x55ab32b23a90 2023-03-17T08:36:55.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff778ff9700 1 -- 172.21.15.35:0/2313967610 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff780097310 con 0x55ab32b23a90 2023-03-17T08:36:55.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab32a373a0 con 0x55ab32b23a90 2023-03-17T08:36:55.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff778ff9700 1 -- 172.21.15.35:0/2313967610 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7800a0010 con 0x55ab32b23a90 2023-03-17T08:36:55.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff7a3932b80 10 client.24940 fetch_fsmap learned FSMap version 29 2023-03-17T08:36:56.196 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ab328a2d90 con 0x55ab32b23a90 2023-03-17T08:36:56.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.469+0000 7ff778ff9700 1 -- 172.21.15.35:0/2313967610 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ab32a373a0 con 0x55ab32b23a90 2023-03-17T08:36:57.636 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff778ff9700 1 -- 172.21.15.35:0/2313967610 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff780009aa0 con 0x55ab32b23a90 2023-03-17T08:36:57.636 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff7a3932b80 10 client.24940 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:36:57.636 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff7a3932b80 10 client.24940 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-17T08:36:57.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff7a3932b80 20 client.24940 populate_metadata read hostname 'smithi035' 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b37910 0x55ab32b36bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff7a3932b80 4 client.24940 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab32a43610 con 0x55ab32b37910 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff795541700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b37910 0x55ab32b36bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff778ff9700 10 client.24940 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.470+0000 7ff795541700 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b37910 0x55ab32b36bc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1713f417e1ef9c server_cookie=99ae9ee647cc4b50 in_seq=0 out_seq=0 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff778ff9700 1 -- 172.21.15.35:0/2313967610 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ab32a43610 con 0x55ab32b37910 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff778ff9700 10 client.24940 handle_command_reply: tid=0 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 client.24940 shutdown 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 msgr2=0x55ab32b2ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b2ca60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7800c7bc0 tx=0x7ff780010c40 comp rx=0 tx=0).stop 2023-03-17T08:36:59.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 shutdown_connections 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b33aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b37910 0x55ab32b36bc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b22c50 0x55ab32b2c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2313967610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b2ca60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff778ff9700 0 client.24940 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 >> 172.21.15.35:0/2313967610 conn(0x55ab32b1ec00 msgr2=0x55ab32b1c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 shutdown_connections 2023-03-17T08:36:59.358 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2313967610 wait complete. 2023-03-17T08:37:00.800 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.471+0000 7ff7a3932b80 20 client.24940 trim_cache size 0 max 16384 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 Processor -- start 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 -- start start 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b22c50 0x55ab32b2a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 0x55ab32b2a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b26d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b1e4b0 con 0x55ab32b23a90 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b1e2c0 con 0x55ab32b243e0 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b38600 con 0x55ab32b22c50 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 0x55ab32b2a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 0x55ab32b2a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41408/0 (socket says 172.21.15.35:41408) 2023-03-17T08:37:00.801 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 -- 172.21.15.35:0/2816573279 learned_addr learned my addr 172.21.15.35:0/2816573279 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:01.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff795541700 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b22c50 0x55ab32b2a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:01.731 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff795d42700 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b26d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:01.731 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 -- 172.21.15.35:0/2816573279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b22c50 msgr2=0x55ab32b2a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:02.468 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b22c50 0x55ab32b2a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:02.468 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 -- 172.21.15.35:0/2816573279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 msgr2=0x55ab32b26d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:03.462 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b26d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:03.462 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 -- 172.21.15.35:0/2816573279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab32a3b140 con 0x55ab32b23a90 2023-03-17T08:37:03.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff795d42700 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b26d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:37:03.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff794d40700 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 0x55ab32b2a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff780060040 tx=0x7ff7800963d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda8fecacd4543f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:03.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.490+0000 7ff77bfff700 1 -- 172.21.15.35:0/2816573279 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800c1ea0 con 0x55ab32b23a90 2023-03-17T08:37:03.463 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff77bfff700 1 -- 172.21.15.35:0/2816573279 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7800a0010 con 0x55ab32b23a90 2023-03-17T08:37:04.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff77bfff700 1 -- 172.21.15.35:0/2816573279 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780097590 con 0x55ab32b23a90 2023-03-17T08:37:04.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2816573279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 msgr2=0x55ab32b2a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:04.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 0x55ab32b2a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff780060040 tx=0x7ff7800963d0 comp rx=0 tx=0).stop 2023-03-17T08:37:05.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2816573279 shutdown_connections 2023-03-17T08:37:05.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b243e0 0x55ab32b26d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:05.127 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b22c50 0x55ab32b2a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:06.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/2816573279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b23a90 0x55ab32b2a7a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:06.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2816573279 >> 172.21.15.35:0/2816573279 conn(0x55ab32b1ec00 msgr2=0x55ab32b23020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:07.581 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2816573279 shutdown_connections 2023-03-17T08:37:08.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 -- 172.21.15.35:0/2816573279 wait complete. 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.491+0000 7ff7a3932b80 1 -- start start 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 Processor -- start 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b28a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b28f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b8f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b8f8e0 con 0x55ab32b243e0 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b8fa50 con 0x55ab32b22c50 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab32b8fc10 con 0x55ab32b23a90 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff7a3932b80 10 client.0 _ll_register_callbacks cb 0x55ab3291a240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:37:08.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795d42700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b8f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b28a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795d42700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b8f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41416/0 (socket says 172.21.15.35:41416) 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795d42700 1 -- 172.21.15.35:0/1402430676 learned_addr learned my addr 172.21.15.35:0/1402430676 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b28a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:43208/0 (socket says 172.21.15.35:43208) 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff794d40700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b28f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 -- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 msgr2=0x55ab32b28f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:08.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b28f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 -- 172.21.15.35:0/1402430676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 msgr2=0x55ab32b8f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b8f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.492+0000 7ff795541700 1 -- 172.21.15.35:0/1402430676 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab328a2d90 con 0x55ab32b22c50 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff795d42700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b8f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff795541700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b28a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55ab32b385d0 tx=0x7ff78c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99e8bcf89630831 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff778ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff778ff9700 1 -- 172.21.15.35:0/1402430676 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c02b040 con 0x55ab32b22c50 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab32af21f0 con 0x55ab32b22c50 2023-03-17T08:37:09.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff778ff9700 1 -- 172.21.15.35:0/1402430676 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff78c0350e0 con 0x55ab32b22c50 2023-03-17T08:37:09.422 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff778ff9700 1 -- 172.21.15.35:0/1402430676 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff78c0352a0 con 0x55ab32b22c50 2023-03-17T08:37:09.422 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff7a3932b80 10 client.24890 fetch_fsmap learned FSMap version 29 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ab328c9200 con 0x55ab32b22c50 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.493+0000 7ff778ff9700 1 -- 172.21.15.35:0/1402430676 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ab32af21f0 con 0x55ab32b22c50 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff778ff9700 1 -- 172.21.15.35:0/1402430676 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff78c003820 con 0x55ab32b22c50 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff7a3932b80 10 client.24890 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff7a3932b80 10 client.24890 resolve_mds: resolved name 'i' to daemon mds.i 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff7a3932b80 20 client.24890 populate_metadata read hostname 'smithi035' 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b948d0 0x55ab32b91280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff7a3932b80 4 client.24890 mds_command: new command op to 24451 tid=0[{"prefix": "status"}] 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ab328f8f10 con 0x55ab32b948d0 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff794d40700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b948d0 0x55ab32b91280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff778ff9700 10 client.24890 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff794d40700 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b948d0 0x55ab32b91280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=255c1010e8d5bfe3 server_cookie=252f6ab7835168fc in_seq=0 out_seq=0 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff778ff9700 1 -- 172.21.15.35:0/1402430676 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55ab328f8f10 con 0x55ab32b948d0 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.494+0000 7ff778ff9700 10 client.24890 handle_command_reply: tid=0 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 client.24890 shutdown 2023-03-17T08:37:09.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 msgr2=0x55ab32b28a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b28a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55ab32b385d0 tx=0x7ff78c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 shutdown_connections 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55ab32b948d0 0x55ab32b91280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ab32b243e0 0x55ab32b8f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff778ff9700 0 client.24890 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ab32b22c50 0x55ab32b28a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 --2- 172.21.15.35:0/1402430676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab32b23a90 0x55ab32b28f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 >> 172.21.15.35:0/1402430676 conn(0x55ab32b1ec00 msgr2=0x55ab32b2a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 shutdown_connections 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 1 -- 172.21.15.35:0/1402430676 wait complete. 2023-03-17T08:37:09.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7a3932b80 20 client.24890 trim_cache size 0 max 16384 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 1, 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24451, 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 1307.100381945, 2023-03-17T08:37:09.425 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:37:09.426 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:37:09.426 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:37:09.426 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1566.034920632 2023-03-17T08:37:10.124 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:37:10.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff77c09f4d0 msgr2=0x7ff77c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:10.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff77c09f4d0 0x7ff77c0a1980 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00b5c0 tx=0x7ff78c005fb0 comp rx=0 tx=0).stop 2023-03-17T08:37:10.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 msgr2=0x7ff79019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:11.412 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 0x7ff79019abc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff78000d950 tx=0x7ff78000dc60 comp rx=0 tx=0).stop 2023-03-17T08:37:11.412 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 shutdown_connections 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff790100d50 0x7ff79019d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7900ff110 0x7ff7900688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff77c09f4d0 0x7ff77c0a1980 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 --2- 172.21.15.35:0/1295813909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff7901003a0 0x7ff79019abc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.495+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 >> 172.21.15.35:0/1295813909 conn(0x7ff7900fa730 msgr2=0x7ff7900fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.496+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 shutdown_connections 2023-03-17T08:37:11.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:36:32.496+0000 7ff7977a5700 1 -- 172.21.15.35:0/1295813909 wait complete. 2023-03-17T08:37:11.414 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-17T08:37:11.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:32 smithi035 ceph-mon[92535]: pgmap v1575: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:12.380 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:34 smithi035 ceph-mon[92535]: pgmap v1576: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:12.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:36 smithi035 ceph-mon[92535]: pgmap v1577: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:12.817 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:38 smithi035 ceph-mon[92535]: pgmap v1578: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:40 smithi035 ceph-mon[92535]: pgmap v1579: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:42 smithi035 ceph-mon[92535]: pgmap v1580: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:44 smithi035 ceph-mon[92535]: pgmap v1581: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:46 smithi035 ceph-mon[92535]: pgmap v1582: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:47 smithi035 ceph-mon[92535]: pgmap v1583: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:50 smithi035 ceph-mon[92535]: pgmap v1584: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:15.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:52 smithi035 ceph-mon[92535]: pgmap v1585: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:54 smithi035 ceph-mon[92535]: pgmap v1586: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:56 smithi035 ceph-mon[92535]: pgmap v1587: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:36:58 smithi035 ceph-mon[92535]: pgmap v1588: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:00 smithi035 ceph-mon[92535]: pgmap v1589: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:02 smithi035 ceph-mon[92535]: pgmap v1590: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:04 smithi035 ceph-mon[92535]: pgmap v1591: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:06 smithi035 ceph-mon[92535]: pgmap v1592: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:07 smithi035 ceph-mon[92535]: pgmap v1593: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:15.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:10 smithi035 ceph-mon[92535]: pgmap v1594: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:15.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:12 smithi035 ceph-mon[92535]: pgmap v1595: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:16.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:14 smithi035 ceph-mon[92535]: pgmap v1596: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:34 smithi082 ceph-mon[94281]: pgmap v1576: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:36 smithi082 ceph-mon[94281]: pgmap v1577: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:17.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:38 smithi082 ceph-mon[94281]: pgmap v1578: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:40 smithi082 ceph-mon[94281]: pgmap v1579: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:17.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:42 smithi082 ceph-mon[94281]: pgmap v1580: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:44 smithi082 ceph-mon[94281]: pgmap v1581: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:46 smithi082 ceph-mon[94281]: pgmap v1582: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:47 smithi082 ceph-mon[94281]: pgmap v1583: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:50 smithi082 ceph-mon[94281]: pgmap v1584: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:52 smithi082 ceph-mon[94281]: pgmap v1585: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:54 smithi082 ceph-mon[94281]: pgmap v1586: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:56 smithi082 ceph-mon[94281]: pgmap v1587: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:36:58 smithi082 ceph-mon[94281]: pgmap v1588: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:00 smithi082 ceph-mon[94281]: pgmap v1589: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:02 smithi082 ceph-mon[94281]: pgmap v1590: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:04 smithi082 ceph-mon[94281]: pgmap v1591: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:06 smithi082 ceph-mon[94281]: pgmap v1592: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:07 smithi082 ceph-mon[94281]: pgmap v1593: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:10 smithi082 ceph-mon[94281]: pgmap v1594: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:12 smithi082 ceph-mon[94281]: pgmap v1595: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:17.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:14 smithi082 ceph-mon[94281]: pgmap v1596: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:17.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:34 smithi078 ceph-mon[94114]: pgmap v1576: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.727 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:36 smithi078 ceph-mon[94114]: pgmap v1577: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:18.727 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:38 smithi078 ceph-mon[94114]: pgmap v1578: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:40 smithi078 ceph-mon[94114]: pgmap v1579: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:42 smithi078 ceph-mon[94114]: pgmap v1580: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:44 smithi078 ceph-mon[94114]: pgmap v1581: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:46 smithi078 ceph-mon[94114]: pgmap v1582: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:47 smithi078 ceph-mon[94114]: pgmap v1583: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:50 smithi078 ceph-mon[94114]: pgmap v1584: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:52 smithi078 ceph-mon[94114]: pgmap v1585: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:54 smithi078 ceph-mon[94114]: pgmap v1586: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:56 smithi078 ceph-mon[94114]: pgmap v1587: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:36:58 smithi078 ceph-mon[94114]: pgmap v1588: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:00 smithi078 ceph-mon[94114]: pgmap v1589: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:02 smithi078 ceph-mon[94114]: pgmap v1590: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:04 smithi078 ceph-mon[94114]: pgmap v1591: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:18.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:06 smithi078 ceph-mon[94114]: pgmap v1592: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:20.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:07 smithi078 ceph-mon[94114]: pgmap v1593: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:20.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:10 smithi078 ceph-mon[94114]: pgmap v1594: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:20.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:12 smithi078 ceph-mon[94114]: pgmap v1595: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:20.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:14 smithi078 ceph-mon[94114]: pgmap v1596: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:20.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:15 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:37:20.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:16 smithi078 ceph-mon[94114]: pgmap v1597: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:20.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:18 smithi078 ceph-mon[94114]: pgmap v1598: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:20.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:37:20.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:37:20.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:37:20.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:37:20.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:37:20.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:15 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:37:21.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:16 smithi082 ceph-mon[94281]: pgmap v1597: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:21.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:18 smithi082 ceph-mon[94281]: pgmap v1598: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:21.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:37:21.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:37:22.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:37:22.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:37:22.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:37:22.995 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:20 smithi078 ceph-mon[94114]: pgmap v1599: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:24.211 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:21 smithi078 ceph-mon[94114]: pgmap v1600: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:24.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:20 smithi082 ceph-mon[94281]: pgmap v1599: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:24.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:21 smithi082 ceph-mon[94281]: pgmap v1600: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:24.220 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 -- 172.21.15.35:0/1439485121 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4103650 msgr2=0x7f55c4105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:25.669 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 --2- 172.21.15.35:0/1439485121 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4103650 0x7f55c4105a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009990 tx=0x7f55b0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:37:25.669 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 -- 172.21.15.35:0/1439485121 shutdown_connections 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 --2- 172.21.15.35:0/1439485121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55c4105f70 0x7f55c4108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 --2- 172.21.15.35:0/1439485121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c4100d30 0x7f55c4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 --2- 172.21.15.35:0/1439485121 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4103650 0x7f55c4105a30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 -- 172.21.15.35:0/1439485121 >> 172.21.15.35:0/1439485121 conn(0x7f55c40fa730 msgr2=0x7f55c40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 -- 172.21.15.35:0/1439485121 shutdown_connections 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.614+0000 7f55cb159700 1 -- 172.21.15.35:0/1439485121 wait complete. 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 Processor -- start 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 -- start start 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c4100d30 0x7f55c4195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55c4103650 0x7f55c4196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 0x7f55c419d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c419d9a0 con 0x7f55c4105f70 2023-03-17T08:37:26.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c419dae0 con 0x7f55c4103650 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55cb159700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c419dc70 con 0x7f55c4100d30 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55c96f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 0x7f55c419d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55c96f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 0x7f55c419d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41432/0 (socket says 172.21.15.35:41432) 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55c8ef5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c4100d30 0x7f55c4195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.615+0000 7f55c96f6700 1 -- 172.21.15.35:0/2393433798 learned_addr learned my addr 172.21.15.35:0/2393433798 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c3fff700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55c4103650 0x7f55c4196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c96f6700 1 -- 172.21.15.35:0/2393433798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c4100d30 msgr2=0x7f55c4195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c96f6700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c4100d30 0x7f55c4195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c96f6700 1 -- 172.21.15.35:0/2393433798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55c4103650 msgr2=0x7f55c4196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c96f6700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55c4103650 0x7f55c4196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c96f6700 1 -- 172.21.15.35:0/2393433798 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00095f0 con 0x7f55c4105f70 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c96f6700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 0x7f55c419d3d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00dc70 tx=0x7f55bc00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c1ffb700 1 -- 172.21.15.35:0/2393433798 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc001e00 con 0x7f55c4105f70 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c1ffb700 1 -- 172.21.15.35:0/2393433798 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55bc008aa0 con 0x7f55c4105f70 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c410ba50 con 0x7f55c4105f70 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55c1ffb700 1 -- 172.21.15.35:0/2393433798 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0125e0 con 0x7f55c4105f70 2023-03-17T08:37:26.980 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.616+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c410b8c0 con 0x7f55c4105f70 2023-03-17T08:37:26.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.618+0000 7f55c1ffb700 1 -- 172.21.15.35:0/2393433798 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f55bc013420 con 0x7f55c4105f70 2023-03-17T08:37:26.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.619+0000 7f55c1ffb700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f55b409f550 0x7f55b40a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:26.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.619+0000 7f55c1ffb700 1 -- 172.21.15.35:0/2393433798 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f55bc0ca1f0 con 0x7f55c4105f70 2023-03-17T08:37:26.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.619+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f55b409f550 0x7f55b40a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.619+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f55b409f550 0x7f55b40a1a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f55b8005950 tx=0x7f55b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 Processor -- start 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 -- start start 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bdcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bdb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdbc50 0x562d66bdc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66ae2020 con 0x562d66bdca90 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66b34960 con 0x562d66bdd3e0 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66b2ddf0 con 0x562d66bdbc50 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bdcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bdcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41436/0 (socket says 172.21.15.35:41436) 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 -- 172.21.15.35:0/244158233 learned_addr learned my addr 172.21.15.35:0/244158233 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:28.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c3fff700 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bdb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:28.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c96f6700 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdbc50 0x562d66bdc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 -- 172.21.15.35:0/244158233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdbc50 msgr2=0x562d66bdc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdbc50 0x562d66bdc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 -- 172.21.15.35:0/244158233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 msgr2=0x562d66bdb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bdb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.620+0000 7f55c8ef5700 1 -- 172.21.15.35:0/244158233 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d669af5e0 con 0x562d66bdca90 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.621+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bdcea0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55b8010f70 tx=0x7f55b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcefa6d1bfcdb9f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:29.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.621+0000 7f55aeffd700 1 -- 172.21.15.35:0/244158233 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8011db0 con 0x562d66bdca90 2023-03-17T08:37:30.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.621+0000 7f55aeffd700 1 -- 172.21.15.35:0/244158233 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55b8015070 con 0x562d66bdca90 2023-03-17T08:37:30.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.621+0000 7f55aeffd700 1 -- 172.21.15.35:0/244158233 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b801c610 con 0x562d66bdca90 2023-03-17T08:37:30.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- 172.21.15.35:0/244158233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 msgr2=0x562d66bdcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:30.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bdcea0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55b8010f70 tx=0x7f55b8013000 comp rx=0 tx=0).stop 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- 172.21.15.35:0/244158233 shutdown_connections 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdbc50 0x562d66bdc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bdcea0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/244158233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bdb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- 172.21.15.35:0/244158233 >> 172.21.15.35:0/244158233 conn(0x562d66bd7c00 msgr2=0x562d66bd5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- 172.21.15.35:0/244158233 shutdown_connections 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- 172.21.15.35:0/244158233 wait complete. 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- start start 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 Processor -- start 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66be5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d669b18d0 con 0x562d66bdbc50 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66becee0 con 0x562d66bdd3e0 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.622+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66bed070 con 0x562d66bdca90 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55d72e6b80 10 client.0 _ll_register_callbacks cb 0x562d669d3240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:37:30.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66be5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c8ef5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66be5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:33210/0 (socket says 172.21.15.35:33210) 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 -- 172.21.15.35:0/1576382894 learned_addr learned my addr 172.21.15.35:0/1576382894 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c96f6700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 -- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 msgr2=0x562d66bec9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bec9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 -- 172.21.15.35:0/1576382894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 msgr2=0x562d66be5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 -- 172.21.15.35:0/1576382894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b8010c20 con 0x562d66bdca90 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55c3fff700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66be5960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009990 tx=0x7f55b0005c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c6edf9f7490670 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55a3fff700 1 -- 172.21.15.35:0/1576382894 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0005590 con 0x562d66bdca90 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55a3fff700 1 -- 172.21.15.35:0/1576382894 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f55b0004500 con 0x562d66bdca90 2023-03-17T08:37:30.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d66af03a0 con 0x562d66bdca90 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.623+0000 7f55a3fff700 1 -- 172.21.15.35:0/1576382894 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55b00056f0 con 0x562d66bdca90 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 10 client.24958 fetch_fsmap learned FSMap version 29 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562d6695bd90 con 0x562d66bdca90 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55a3fff700 1 -- 172.21.15.35:0/1576382894 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55b0033020 con 0x562d66bdca90 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55a3fff700 1 -- 172.21.15.35:0/1576382894 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f55b0003ae0 con 0x562d66bdca90 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 10 client.24958 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 10 client.24958 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-17T08:37:30.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 20 client.24958 populate_metadata read hostname 'smithi035' 2023-03-17T08:37:30.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66bf0990 0x562d66befd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:30.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 4 client.24958 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:37:31.280 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d66afc610 con 0x562d66bf0990 2023-03-17T08:37:31.280 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66bf0990 0x562d66befd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55a3fff700 10 client.24958 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.624+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66bf0990 0x562d66befd70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89bb7e58c206364 server_cookie=b7327b7ec9cc78d1 in_seq=0 out_seq=0 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55a3fff700 1 -- 172.21.15.35:0/1576382894 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562d66afc610 con 0x562d66bf0990 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55a3fff700 10 client.24958 handle_command_reply: tid=0 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 client.24958 shutdown 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 msgr2=0x562d66be5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66be5960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009990 tx=0x7f55b0005c20 comp rx=0 tx=0).stop 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 shutdown_connections 2023-03-17T08:37:31.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66bf0990 0x562d66befd70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:31.659 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66bec9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:31.659 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55a3fff700 0 client.24958 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:37:32.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:34.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/1576382894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66be5960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:34.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 >> 172.21.15.35:0/1576382894 conn(0x562d66bd7c00 msgr2=0x562d66bd56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:34.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 shutdown_connections 2023-03-17T08:37:34.290 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.625+0000 7f55d72e6b80 1 -- 172.21.15.35:0/1576382894 wait complete. 2023-03-17T08:37:37.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.626+0000 7f55d72e6b80 20 client.24958 trim_cache size 0 max 16384 2023-03-17T08:37:39.610 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.643+0000 7f55d72e6b80 1 Processor -- start 2023-03-17T08:37:39.611 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 -- start start 2023-03-17T08:37:39.611 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdbc50 0x562d66bdb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdd3e0 0x562d66bed450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66afbe00 con 0x562d66bdca90 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66aefb70 con 0x562d66bdbc50 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66a39ed0 con 0x562d66bdd3e0 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41450/0 (socket says 172.21.15.35:41450) 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 -- 172.21.15.35:0/456357485 learned_addr learned my addr 172.21.15.35:0/456357485 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdbc50 0x562d66bdb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c96f6700 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdd3e0 0x562d66bed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 -- 172.21.15.35:0/456357485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdd3e0 msgr2=0x562d66bed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdd3e0 0x562d66bed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 -- 172.21.15.35:0/456357485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdbc50 msgr2=0x562d66bdb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:41.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdbc50 0x562d66bdb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 -- 172.21.15.35:0/456357485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d66af4140 con 0x562d66bdca90 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdbc50 0x562d66bdb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.644+0000 7f55c3fff700 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bec960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c010 tx=0x7f55b0005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33887f443e958f76 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55af7fe700 1 -- 172.21.15.35:0/456357485 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000b540 con 0x562d66bdca90 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55af7fe700 1 -- 172.21.15.35:0/456357485 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55b0033070 con 0x562d66bdca90 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55af7fe700 1 -- 172.21.15.35:0/456357485 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0004860 con 0x562d66bdca90 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 -- 172.21.15.35:0/456357485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 msgr2=0x562d66bec960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:41.153 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bec960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c010 tx=0x7f55b0005cd0 comp rx=0 tx=0).stop 2023-03-17T08:37:42.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 -- 172.21.15.35:0/456357485 shutdown_connections 2023-03-17T08:37:42.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdd3e0 0x562d66bed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdbc50 0x562d66bdb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/456357485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 -- 172.21.15.35:0/456357485 >> 172.21.15.35:0/456357485 conn(0x562d66bd7c00 msgr2=0x562d66be4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.645+0000 7f55d72e6b80 1 -- 172.21.15.35:0/456357485 shutdown_connections 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 -- 172.21.15.35:0/456357485 wait complete. 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 -- start start 2023-03-17T08:37:43.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 Processor -- start 2023-03-17T08:37:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:45.690 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:45.690 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66be2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:45.690 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66c448b0 con 0x562d66bdbc50 2023-03-17T08:37:46.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66c44a20 con 0x562d66bdd3e0 2023-03-17T08:37:46.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d66c44be0 con 0x562d66bdca90 2023-03-17T08:37:46.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55d72e6b80 10 client.0 _ll_register_callbacks cb 0x562d669d3240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:37:46.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55c8ef5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55c8ef5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41454/0 (socket says 172.21.15.35:41454) 2023-03-17T08:37:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55c3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.646+0000 7f55c8ef5700 1 -- 172.21.15.35:0/2625779962 learned_addr learned my addr 172.21.15.35:0/2625779962 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:37:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c96f6700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66be2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:48.536 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c8ef5700 1 -- 172.21.15.35:0/2625779962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 msgr2=0x562d66bec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:49.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c8ef5700 1 -- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 msgr2=0x562d66be2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66be2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c8ef5700 1 -- 172.21.15.35:0/2625779962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d669af5e0 con 0x562d66bdbc50 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c96f6700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66be2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55c8ef5700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be2020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f55b8010f10 tx=0x7f55b800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c051aedde41b3a49 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55a3fff700 1 -- 172.21.15.35:0/2625779962 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b802b030 con 0x562d66bdbc50 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55a3fff700 1 -- 172.21.15.35:0/2625779962 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f55b8017070 con 0x562d66bdbc50 2023-03-17T08:37:49.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d66bab1f0 con 0x562d66bdbc50 2023-03-17T08:37:49.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55a3fff700 1 -- 172.21.15.35:0/2625779962 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55b8011b70 con 0x562d66bdbc50 2023-03-17T08:37:50.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55d72e6b80 10 client.15162 fetch_fsmap learned FSMap version 29 2023-03-17T08:37:50.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.647+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562d6695bd90 con 0x562d66bdbc50 2023-03-17T08:37:50.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55a3fff700 1 -- 172.21.15.35:0/2625779962 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d66bab1f0 con 0x562d66bdbc50 2023-03-17T08:37:50.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55a3fff700 1 -- 172.21.15.35:0/2625779962 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f55b803a020 con 0x562d66bdbc50 2023-03-17T08:37:50.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55d72e6b80 10 client.15162 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:37:51.593 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55d72e6b80 10 client.15162 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-17T08:37:53.446 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55d72e6b80 20 client.15162 populate_metadata read hostname 'smithi035' 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66c497e0 0x562d66c46110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55d72e6b80 4 client.15162 mds_command: new command op to 24452 tid=0[{"prefix": "status"}] 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d669b1f10 con 0x562d66c497e0 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.648+0000 7f55c3fff700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66c497e0 0x562d66c46110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55c3fff700 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66c497e0 0x562d66c46110 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=430f242f21e5cdf8 server_cookie=e9d87435dc0cfb9d in_seq=0 out_seq=0 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55a3fff700 10 client.15162 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:37:53.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55a3fff700 1 -- 172.21.15.35:0/2625779962 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x562d669b1f10 con 0x562d66c497e0 2023-03-17T08:37:53.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55a3fff700 10 client.15162 handle_command_reply: tid=0 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 client.15162 shutdown 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 msgr2=0x562d66be2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be2020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f55b8010f10 tx=0x7f55b800bf60 comp rx=0 tx=0).stop 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 shutdown_connections 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562d66c497e0 0x562d66c46110 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562d66bdd3e0 0x562d66be2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562d66bdbc50 0x562d66be2020 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55a3fff700 0 client.15162 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 --2- 172.21.15.35:0/2625779962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562d66bdca90 0x562d66bec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 >> 172.21.15.35:0/2625779962 conn(0x562d66bd7c00 msgr2=0x562d66bed450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:54.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 shutdown_connections 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 1 -- 172.21.15.35:0/2625779962 wait complete. 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.649+0000 7f55d72e6b80 20 client.15162 trim_cache size 0 max 16384 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_fsid": "80b32574-c497-11ed-9afb-001a4aab830c", 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stdout: "whoami": 0, 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 24452, 2023-03-17T08:37:54.514 INFO:teuthology.orchestra.run.smithi035.stdout: "want_state": "up:active", 2023-03-17T08:37:55.544 INFO:teuthology.orchestra.run.smithi035.stdout: "state": "up:active", 2023-03-17T08:37:55.544 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs", 2023-03-17T08:37:55.544 INFO:teuthology.orchestra.run.smithi035.stdout: "rank_uptime": 1423.6586363680001, 2023-03-17T08:37:55.544 INFO:teuthology.orchestra.run.smithi035.stdout: "mdsmap_epoch": 29, 2023-03-17T08:37:55.544 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch": 91, 2023-03-17T08:37:55.544 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_epoch_barrier": 91, 2023-03-17T08:37:55.545 INFO:teuthology.orchestra.run.smithi035.stdout: "uptime": 1602.5053738019999 2023-03-17T08:37:56.077 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:37:56.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f55b409f550 msgr2=0x7f55b40a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:56.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f55b409f550 0x7f55b40a1a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f55b8005950 tx=0x7f55b800b410 comp rx=0 tx=0).stop 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 msgr2=0x7f55c419d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 0x7f55c419d3d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00dc70 tx=0x7f55bc00df80 comp rx=0 tx=0).stop 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 shutdown_connections 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f55b409f550 0x7f55b40a1a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55c4105f70 0x7f55c419d3d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55c4100d30 0x7f55c4195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 --2- 172.21.15.35:0/2393433798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55c4103650 0x7f55c4196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 >> 172.21.15.35:0/2393433798 conn(0x7f55c40fa730 msgr2=0x7f55c4101990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 shutdown_connections 2023-03-17T08:37:56.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:37:15.650+0000 7f55cb159700 1 -- 172.21.15.35:0/2393433798 wait complete. 2023-03-17T08:37:56.957 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-03-17T08:37:56.984 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-03-17T08:37:57.919 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-03-17T08:37:57.919 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2023-03-17T08:37:57.919 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-17T08:37:57.920 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-17T08:37:58.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:37:59.085 DEBUG:teuthology.orchestra.run.smithi035:> ip netns list 2023-03-17T08:37:59.088 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:24 smithi078 ceph-mon[94114]: pgmap v1601: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:59.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:26 smithi078 ceph-mon[94114]: pgmap v1602: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:37:59.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:28 smithi078 ceph-mon[94114]: pgmap v1603: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:59.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:30 smithi078 ceph-mon[94114]: pgmap v1604: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:37:59.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:32 smithi078 ceph-mon[94114]: pgmap v1605: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:37:59.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:33 smithi078 ceph-mon[94114]: pgmap v1606: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:37:59.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:36 smithi078 ceph-mon[94114]: pgmap v1607: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:00.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:38 smithi078 ceph-mon[94114]: pgmap v1608: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:00.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:40 smithi078 ceph-mon[94114]: pgmap v1609: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:00.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:42 smithi078 ceph-mon[94114]: pgmap v1610: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:00.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:44 smithi078 ceph-mon[94114]: pgmap v1611: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:00.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:46 smithi078 ceph-mon[94114]: pgmap v1612: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:48 smithi078 ceph-mon[94114]: pgmap v1613: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:50 smithi078 ceph-mon[94114]: pgmap v1614: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:52 smithi078 ceph-mon[94114]: pgmap v1615: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:54 smithi078 ceph-mon[94114]: pgmap v1616: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:56 smithi078 ceph-mon[94114]: pgmap v1617: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:24 smithi082 ceph-mon[94281]: pgmap v1601: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:26 smithi082 ceph-mon[94281]: pgmap v1602: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:28 smithi082 ceph-mon[94281]: pgmap v1603: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:30 smithi082 ceph-mon[94281]: pgmap v1604: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:01.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:32 smithi082 ceph-mon[94281]: pgmap v1605: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:33 smithi082 ceph-mon[94281]: pgmap v1606: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:36 smithi082 ceph-mon[94281]: pgmap v1607: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:38 smithi082 ceph-mon[94281]: pgmap v1608: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:40 smithi082 ceph-mon[94281]: pgmap v1609: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:42 smithi082 ceph-mon[94281]: pgmap v1610: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:44 smithi082 ceph-mon[94281]: pgmap v1611: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:46 smithi082 ceph-mon[94281]: pgmap v1612: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:48 smithi082 ceph-mon[94281]: pgmap v1613: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:50 smithi082 ceph-mon[94281]: pgmap v1614: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:52 smithi082 ceph-mon[94281]: pgmap v1615: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:01.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:54 smithi082 ceph-mon[94281]: pgmap v1616: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:02.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:56 smithi082 ceph-mon[94281]: pgmap v1617: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:02.804 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:15 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:38:05.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:16 smithi035 ceph-mon[92535]: pgmap v1597: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:18 smithi035 ceph-mon[92535]: pgmap v1598: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:20 smithi035 ceph-mon[92535]: pgmap v1599: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:21 smithi035 ceph-mon[92535]: pgmap v1600: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:24 smithi035 ceph-mon[92535]: pgmap v1601: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:26 smithi035 ceph-mon[92535]: pgmap v1602: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:05.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:28 smithi035 ceph-mon[92535]: pgmap v1603: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:08.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:30 smithi035 ceph-mon[92535]: pgmap v1604: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:08.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:32 smithi035 ceph-mon[92535]: pgmap v1605: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:08.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:33 smithi035 ceph-mon[92535]: pgmap v1606: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:08.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:36 smithi035 ceph-mon[92535]: pgmap v1607: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:08.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:38 smithi035 ceph-mon[92535]: pgmap v1608: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:11.393 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:40 smithi035 ceph-mon[92535]: pgmap v1609: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:42 smithi035 ceph-mon[92535]: pgmap v1610: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:44 smithi035 ceph-mon[92535]: pgmap v1611: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:46 smithi035 ceph-mon[92535]: pgmap v1612: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:48 smithi035 ceph-mon[92535]: pgmap v1613: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:50 smithi035 ceph-mon[92535]: pgmap v1614: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:52 smithi035 ceph-mon[92535]: pgmap v1615: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:54 smithi035 ceph-mon[92535]: pgmap v1616: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:56 smithi035 ceph-mon[92535]: pgmap v1617: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:37:58 smithi035 ceph-mon[92535]: pgmap v1618: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:00 smithi035 ceph-mon[92535]: pgmap v1619: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:11.394 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:01 smithi035 ceph-mon[92535]: pgmap v1620: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:11.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:38:14.560 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip link delete ceph-brx 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:37:58 smithi078 ceph-mon[94114]: pgmap v1618: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:00 smithi078 ceph-mon[94114]: pgmap v1619: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:01 smithi078 ceph-mon[94114]: pgmap v1620: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:04 smithi078 ceph-mon[94114]: pgmap v1621: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:06 smithi078 ceph-mon[94114]: pgmap v1622: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:08 smithi078 ceph-mon[94114]: pgmap v1623: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:10 smithi078 ceph-mon[94114]: pgmap v1624: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:37:58 smithi082 ceph-mon[94281]: pgmap v1618: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:00 smithi082 ceph-mon[94281]: pgmap v1619: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:01 smithi082 ceph-mon[94281]: pgmap v1620: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:14.561 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:04 smithi082 ceph-mon[94281]: pgmap v1621: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.562 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:06 smithi082 ceph-mon[94281]: pgmap v1622: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:14.562 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:08 smithi082 ceph-mon[94281]: pgmap v1623: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.562 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:10 smithi082 ceph-mon[94281]: pgmap v1624: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:14.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:12 smithi078 ceph-mon[94114]: pgmap v1625: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:14.563 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:12 smithi082 ceph-mon[94281]: pgmap v1625: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:14.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:04 smithi035 ceph-mon[92535]: pgmap v1621: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:14.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:06 smithi035 ceph-mon[92535]: pgmap v1622: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:15.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:08 smithi035 ceph-mon[92535]: pgmap v1623: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:15.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:10 smithi035 ceph-mon[92535]: pgmap v1624: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:15.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:12 smithi035 ceph-mon[92535]: pgmap v1625: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:15.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:14 smithi035 ceph-mon[92535]: pgmap v1626: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:15.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:14 smithi078 ceph-mon[94114]: pgmap v1626: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:15.661 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:14 smithi082 ceph-mon[94281]: pgmap v1626: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:15.712 INFO:teuthology.orchestra.run.smithi035.stderr:Cannot find device "ceph-brx" 2023-03-17T08:38:16.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-17T08:38:20.061 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-03-17T08:38:20.062 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph fs ls 2023-03-17T08:38:20.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:16 smithi035 ceph-mon[92535]: pgmap v1627: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:20.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:17 smithi035 ceph-mon[92535]: pgmap v1628: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:20.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:38:20.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:20.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:18 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: pgmap v1629: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:22.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:38:23.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:38:23.734 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:16 smithi078 ceph-mon[94114]: pgmap v1627: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:23.734 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:17 smithi078 ceph-mon[94114]: pgmap v1628: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:23.734 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:38:24.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:24.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:18 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:24.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: pgmap v1629: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:25.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:25.995 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:25.995 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:25.995 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:26.381 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:38:26.381 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:38:26.381 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:22 smithi078 ceph-mon[94114]: pgmap v1630: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:26.381 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:26.381 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:26.761 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:38:26.762 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:38:26.762 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:26.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:16 smithi082 ceph-mon[94281]: pgmap v1627: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:28.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:17 smithi082 ceph-mon[94281]: pgmap v1628: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:28.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:38:28.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:28.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:18 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:28.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: pgmap v1629: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:28.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:22 smithi082 ceph-mon[94281]: pgmap v1630: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:38:28.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:28.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:22 smithi035 ceph-mon[92535]: pgmap v1630: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:30.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:30.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:30.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:38:30.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:38:30.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:38:30.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:24 smithi078 ceph-mon[94114]: pgmap v1631: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:30.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:25 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2641893724' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-03-17T08:38:30.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:26 smithi078 ceph-mon[94114]: pgmap v1632: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:30.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:24 smithi082 ceph-mon[94281]: pgmap v1631: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:30.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:25 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2641893724' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-03-17T08:38:31.947 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:26 smithi082 ceph-mon[94281]: pgmap v1632: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:31.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:28 smithi078 ceph-mon[94114]: pgmap v1633: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:33.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:30 smithi078 ceph-mon[94114]: pgmap v1634: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:33.417 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:28 smithi082 ceph-mon[94281]: pgmap v1633: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:33.417 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:30 smithi082 ceph-mon[94281]: pgmap v1634: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:35.723 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T08:38:38.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 -- 172.21.15.35:0/2241104321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb4101d40 msgr2=0x7fecb410a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:38:38.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2241104321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb4101d40 0x7fecb410a240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feca8009990 tx=0x7feca8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:38:38.506 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 -- 172.21.15.35:0/2241104321 shutdown_connections 2023-03-17T08:38:38.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2241104321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb410a810 0x7fecb410cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:38.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2241104321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb4101430 0x7fecb4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:38.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2241104321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb4101d40 0x7fecb410a240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:39.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 -- 172.21.15.35:0/2241104321 >> 172.21.15.35:0/2241104321 conn(0x7fecb40fac50 msgr2=0x7fecb40fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 -- 172.21.15.35:0/2241104321 shutdown_connections 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.690+0000 7fecba6ae700 1 -- 172.21.15.35:0/2241104321 wait complete. 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 Processor -- start 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 -- start start 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb4101430 0x7fecb40ff090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb4101d40 0x7fecb40ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 0x7fecb40ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:38:42.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41a46b0 con 0x7fecb410a810 2023-03-17T08:38:42.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41a4820 con 0x7fecb4101d40 2023-03-17T08:38:42.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecba6ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41a49e0 con 0x7fecb4101430 2023-03-17T08:38:42.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecb8c4b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 0x7fecb40ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:38:42.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecb8c4b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 0x7fecb40ffb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41470/0 (socket says 172.21.15.35:41470) 2023-03-17T08:38:42.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.691+0000 7fecb8c4b700 1 -- 172.21.15.35:0/2641893724 learned_addr learned my addr 172.21.15.35:0/2641893724 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb3fff700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb4101430 0x7fecb40ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb37fe700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb4101d40 0x7fecb40ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb8c4b700 1 -- 172.21.15.35:0/2641893724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb4101430 msgr2=0x7fecb40ff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb8c4b700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb4101430 0x7fecb40ff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb8c4b700 1 -- 172.21.15.35:0/2641893724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb4101d40 msgr2=0x7fecb40ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb8c4b700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb4101d40 0x7fecb40ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb8c4b700 1 -- 172.21.15.35:0/2641893724 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80095f0 con 0x7fecb410a810 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb8c4b700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 0x7fecb40ffb50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fecac00ef30 tx=0x7fecac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:38:42.182 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac018070 con 0x7fecb410a810 2023-03-17T08:38:42.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb4110130 con 0x7fecb410a810 2023-03-17T08:38:42.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecac00f040 con 0x7fecb410a810 2023-03-17T08:38:42.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00cc70 con 0x7fecb410a810 2023-03-17T08:38:42.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.692+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb410ffa0 con 0x7fecb410a810 2023-03-17T08:38:42.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.693+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb41102c0 con 0x7fecb410a810 2023-03-17T08:38:42.183 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.694+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fecac007500 con 0x7fecb410a810 2023-03-17T08:38:42.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.695+0000 7fecb17fa700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec9c09f550 0x7fec9c0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:38:42.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.695+0000 7fecb3fff700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec9c09f550 0x7fec9c0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:38:42.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.695+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fecac0c9bf0 con 0x7fecb410a810 2023-03-17T08:38:42.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.695+0000 7fecb3fff700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec9c09f550 0x7fec9c0a1a00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feca4007be0 tx=0x7feca40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:38:44.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.699+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fecac093e10 con 0x7fecb410a810 2023-03-17T08:38:44.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.945+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fecb4066e30 con 0x7fecb410a810 2023-03-17T08:38:44.482 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.946+0000 7fecb17fa700 1 -- 172.21.15.35:0/2641893724 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) v1 ==== 53+0+73 (secure 0 0 0) 0x7fecac097430 con 0x7fecb410a810 2023-03-17T08:38:45.143 INFO:teuthology.orchestra.run.smithi035.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-17T08:38:45.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:24 smithi035 ceph-mon[92535]: pgmap v1631: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:45.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec9c09f550 msgr2=0x7fec9c0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec9c09f550 0x7fec9c0a1a00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feca4007be0 tx=0x7feca40073d0 comp rx=0 tx=0).stop 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 msgr2=0x7fecb40ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 0x7fecb40ffb50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fecac00ef30 tx=0x7fecac00c3a0 comp rx=0 tx=0).stop 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 shutdown_connections 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec9c09f550 0x7fec9c0a1a00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fecb410a810 0x7fecb40ffb50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:46.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb4101430 0x7fecb40ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:46.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 --2- 172.21.15.35:0/2641893724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb4101d40 0x7fecb40ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:38:46.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 >> 172.21.15.35:0/2641893724 conn(0x7fecb40fac50 msgr2=0x7fecb410ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:38:46.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 shutdown_connections 2023-03-17T08:38:46.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:38:24.948+0000 7fecba6ae700 1 -- 172.21.15.35:0/2641893724 wait complete. 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi035.front.sepia.ceph.com 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-17T08:38:46.863 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-17T08:38:47.882 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-17T08:38:47.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:38:47.882 DEBUG:teuthology.orchestra.run.smithi035:> ip addr 2023-03-17T08:38:47.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:31 smithi078 ceph-mon[94114]: pgmap v1635: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:50.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:34 smithi078 ceph-mon[94114]: pgmap v1636: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:50.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:36 smithi078 ceph-mon[94114]: pgmap v1637: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:50.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:38 smithi078 ceph-mon[94114]: pgmap v1638: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:51.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:40 smithi078 ceph-mon[94114]: pgmap v1639: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:51.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:42 smithi078 ceph-mon[94114]: pgmap v1640: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:51.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:43 smithi078 ceph-mon[94114]: pgmap v1641: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:51.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:46 smithi078 ceph-mon[94114]: pgmap v1642: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:51.218 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:31 smithi082 ceph-mon[94281]: pgmap v1635: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:51.218 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:34 smithi082 ceph-mon[94281]: pgmap v1636: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:51.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:36 smithi082 ceph-mon[94281]: pgmap v1637: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:51.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:38 smithi082 ceph-mon[94281]: pgmap v1638: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:51.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:40 smithi082 ceph-mon[94281]: pgmap v1639: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:51.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:42 smithi082 ceph-mon[94281]: pgmap v1640: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:51.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:43 smithi082 ceph-mon[94281]: pgmap v1641: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:51.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:46 smithi082 ceph-mon[94281]: pgmap v1642: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:48 smithi078 ceph-mon[94114]: pgmap v1643: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:52.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:50 smithi078 ceph-mon[94114]: pgmap v1644: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:52.476 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:48 smithi082 ceph-mon[94281]: pgmap v1643: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:52.476 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:50 smithi082 ceph-mon[94281]: pgmap v1644: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:52.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:25 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2641893724' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-03-17T08:38:52.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:26 smithi035 ceph-mon[92535]: pgmap v1632: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:52.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:28 smithi035 ceph-mon[92535]: pgmap v1633: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:52.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:30 smithi035 ceph-mon[92535]: pgmap v1634: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:52.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:31 smithi035 ceph-mon[92535]: pgmap v1635: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:52.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:34 smithi035 ceph-mon[92535]: pgmap v1636: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:54.108 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:36 smithi035 ceph-mon[92535]: pgmap v1637: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:38:55.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:38 smithi035 ceph-mon[92535]: pgmap v1638: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:55.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:40 smithi035 ceph-mon[92535]: pgmap v1639: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:55.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:42 smithi035 ceph-mon[92535]: pgmap v1640: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:55.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:43 smithi035 ceph-mon[92535]: pgmap v1641: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:55.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:46 smithi035 ceph-mon[92535]: pgmap v1642: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:55.670 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:48 smithi035 ceph-mon[92535]: pgmap v1643: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:55.670 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:50 smithi035 ceph-mon[92535]: pgmap v1644: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:38:55.671 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:52 smithi078 ceph-mon[94114]: pgmap v1645: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:55.671 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:53 smithi078 ceph-mon[94114]: pgmap v1646: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:55.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:52 smithi082 ceph-mon[94281]: pgmap v1645: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:55.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:53 smithi082 ceph-mon[94281]: pgmap v1646: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout: inet 127.0.0.1/8 scope host lo 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout: valid_lft forever preferred_lft forever 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout: inet6 ::1/128 scope host 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout: valid_lft forever preferred_lft forever 2023-03-17T08:38:55.672 INFO:teuthology.orchestra.run.smithi035.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-17T08:38:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: link/ether 0c:c4:7a:6b:fe:2a brd ff:ff:ff:ff:ff:ff 2023-03-17T08:38:56.793 INFO:teuthology.orchestra.run.smithi035.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-17T08:38:57.479 INFO:teuthology.orchestra.run.smithi035.stdout: link/ether 0c:c4:7a:6b:fe:2b brd ff:ff:ff:ff:ff:ff 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout: link/ether ac:1f:6b:f8:25:f6 brd ff:ff:ff:ff:ff:ff 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout: inet 172.21.15.35/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout: valid_lft 38830sec preferred_lft 38830sec 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout: inet6 fe80::ae1f:6bff:fef8:25f6/64 scope link 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout: valid_lft forever preferred_lft forever 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-17T08:38:58.305 INFO:teuthology.orchestra.run.smithi035.stdout: link/ether ac:1f:6b:f8:25:f7 brd ff:ff:ff:ff:ff:ff 2023-03-17T08:38:58.306 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-17T08:38:58.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:38:58.306 DEBUG:teuthology.orchestra.run.smithi035:> (cd / && exec bash -c ' 2023-03-17T08:38:58.306 DEBUG:teuthology.orchestra.run.smithi035:> set -e 2023-03-17T08:38:58.306 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip link add name ceph-brx type bridge 2023-03-17T08:38:58.307 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip addr flush dev ceph-brx 2023-03-17T08:38:58.307 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip link set ceph-brx up 2023-03-17T08:38:58.307 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-17T08:38:58.307 DEBUG:teuthology.orchestra.run.smithi035:> ') 2023-03-17T08:38:59.787 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:52 smithi035 ceph-mon[92535]: pgmap v1645: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:38:59.787 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:53 smithi035 ceph-mon[92535]: pgmap v1646: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:38:59.787 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:55 smithi035 ceph-mon[92535]: pgmap v1647: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:00.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:38:58 smithi035 ceph-mon[92535]: pgmap v1648: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:01.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:00 smithi035 ceph-mon[92535]: pgmap v1649: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:01.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:55 smithi078 ceph-mon[94114]: pgmap v1647: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:01.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:38:58 smithi078 ceph-mon[94114]: pgmap v1648: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:01.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:00 smithi078 ceph-mon[94114]: pgmap v1649: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:01.618 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:55 smithi082 ceph-mon[94281]: pgmap v1647: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:01.618 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:38:58 smithi082 ceph-mon[94281]: pgmap v1648: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:01.619 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:00 smithi082 ceph-mon[94281]: pgmap v1649: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:01.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:02.704 DEBUG:teuthology.orchestra.run.smithi035:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-17T08:39:02.705 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:01 smithi082 ceph-mon[94281]: pgmap v1650: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:02.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:01 smithi078 ceph-mon[94114]: pgmap v1650: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:01 smithi035 ceph-mon[92535]: pgmap v1650: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:02.740 INFO:teuthology.orchestra.run.smithi035.stdout:1 2023-03-17T08:39:04.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:04.122 DEBUG:teuthology.orchestra.run.smithi035:> route 2023-03-17T08:39:04.203 INFO:teuthology.orchestra.run.smithi035.stdout:Kernel IP routing table 2023-03-17T08:39:06.229 INFO:teuthology.orchestra.run.smithi035.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-17T08:39:06.229 INFO:teuthology.orchestra.run.smithi035.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-17T08:39:06.229 INFO:teuthology.orchestra.run.smithi035.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-17T08:39:08.130 INFO:teuthology.orchestra.run.smithi035.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-17T08:39:08.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:11.879 DEBUG:teuthology.orchestra.run.smithi035:> (cd / && exec bash -c ' 2023-03-17T08:39:11.879 DEBUG:teuthology.orchestra.run.smithi035:> set -e 2023-03-17T08:39:11.879 DEBUG:teuthology.orchestra.run.smithi035:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-17T08:39:11.879 DEBUG:teuthology.orchestra.run.smithi035:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-17T08:39:11.879 DEBUG:teuthology.orchestra.run.smithi035:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-17T08:39:11.879 DEBUG:teuthology.orchestra.run.smithi035:> ') 2023-03-17T08:39:11.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:04 smithi078 ceph-mon[94114]: pgmap v1651: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:11.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:06 smithi078 ceph-mon[94114]: pgmap v1652: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:11.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:07 smithi078 ceph-mon[94114]: pgmap v1653: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:13.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:10 smithi078 ceph-mon[94114]: pgmap v1654: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:13.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:04 smithi082 ceph-mon[94281]: pgmap v1651: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:13.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:06 smithi082 ceph-mon[94281]: pgmap v1652: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:13.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:07 smithi082 ceph-mon[94281]: pgmap v1653: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:15.001 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:10 smithi082 ceph-mon[94281]: pgmap v1654: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:15.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:04 smithi035 ceph-mon[92535]: pgmap v1651: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:15.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:06 smithi035 ceph-mon[92535]: pgmap v1652: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:15.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:07 smithi035 ceph-mon[92535]: pgmap v1653: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:15.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:10 smithi035 ceph-mon[92535]: pgmap v1654: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:15.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:11 smithi078 ceph-mon[94114]: pgmap v1655: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:17.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:14 smithi078 ceph-mon[94114]: pgmap v1656: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:17.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:11 smithi082 ceph-mon[94281]: pgmap v1655: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:17.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:14 smithi082 ceph-mon[94281]: pgmap v1656: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:17.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:11 smithi035 ceph-mon[92535]: pgmap v1655: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:17.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:14 smithi035 ceph-mon[92535]: pgmap v1656: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:18.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:16 smithi078 ceph-mon[94114]: pgmap v1657: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:19.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:17 smithi078 ceph-mon[94114]: pgmap v1658: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:19.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:16 smithi082 ceph-mon[94281]: pgmap v1657: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:19.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:17 smithi082 ceph-mon[94281]: pgmap v1658: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:19.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:19.261 DEBUG:teuthology.orchestra.run.smithi035:> ip netns list 2023-03-17T08:39:19.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:16 smithi035 ceph-mon[92535]: pgmap v1657: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:19.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:17 smithi035 ceph-mon[92535]: pgmap v1658: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:19.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:20.690 DEBUG:teuthology.orchestra.run.smithi035:> ip netns list-id 2023-03-17T08:39:21.504 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:20 smithi078 ceph-mon[94114]: pgmap v1659: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:21.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:20 smithi082 ceph-mon[94281]: pgmap v1659: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:21.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:20 smithi035 ceph-mon[92535]: pgmap v1659: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:22.527 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:21 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:39:22.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:21 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:39:22.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:21 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:39:22.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:23.738 DEBUG:teuthology.orchestra.run.smithi035:> (cd / && exec bash -c ' 2023-03-17T08:39:23.739 DEBUG:teuthology.orchestra.run.smithi035:> set -e 2023-03-17T08:39:23.739 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-17T08:39:23.739 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-17T08:39:23.739 DEBUG:teuthology.orchestra.run.smithi035:> ') 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: pgmap v1660: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:39:23.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:22 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: pgmap v1660: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:22 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:39:23.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: pgmap v1660: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:24.122 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:24.122 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:24.122 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:24.122 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:25.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:39:25.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:22 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:39:25.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:23 smithi078 ceph-mon[94114]: pgmap v1661: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:25.217 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:23 smithi082 ceph-mon[94281]: pgmap v1661: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:25.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:23 smithi035 ceph-mon[92535]: pgmap v1661: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:25.280 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-17T08:39:25.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> (cd / && exec bash -c ' 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> set -e 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-17T08:39:25.880 DEBUG:teuthology.orchestra.run.smithi035:> ') 2023-03-17T08:39:26.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:27.015 DEBUG:teuthology.orchestra.run.smithi035:> (cd / && exec bash -c ' 2023-03-17T08:39:27.015 DEBUG:teuthology.orchestra.run.smithi035:> set -e 2023-03-17T08:39:27.015 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip link set brx.0 up 2023-03-17T08:39:27.015 DEBUG:teuthology.orchestra.run.smithi035:> sudo ip link set dev brx.0 master ceph-brx 2023-03-17T08:39:27.015 DEBUG:teuthology.orchestra.run.smithi035:> ') 2023-03-17T08:39:27.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: pgmap v1662: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:27.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:27.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:27.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: pgmap v1662: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:27.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:39:27.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:39:27.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:39:27.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:39:27.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:27.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: pgmap v1662: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:28.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:28.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:28.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:28.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:28.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:28.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:39:29.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:39:29.300 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:39:29.300 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:39:29.300 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:39:29.300 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:39:29.301 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:28 smithi082 ceph-mon[94281]: pgmap v1663: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:29.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:28 smithi078 ceph-mon[94114]: pgmap v1663: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:29.302 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:28 smithi035 ceph-mon[92535]: pgmap v1663: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:29.410 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2023-03-17T08:39:31.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-17T08:39:31.025 DEBUG:teuthology.orchestra.run.smithi035:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-17T08:39:31.046 INFO:teuthology.orchestra.run.smithi035.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-17T08:39:32.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-17T08:39:32.562 DEBUG:teuthology.orchestra.run.smithi035:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-17T08:39:32.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:30 smithi078 ceph-mon[94114]: pgmap v1664: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:33.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:31 smithi078 ceph-mon[94114]: pgmap v1665: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2023-03-17T08:39:33.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:30 smithi082 ceph-mon[94281]: pgmap v1664: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:33.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:31 smithi082 ceph-mon[94281]: pgmap v1665: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2023-03-17T08:39:33.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:30 smithi035 ceph-mon[92535]: pgmap v1664: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:33.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:31 smithi035 ceph-mon[92535]: pgmap v1665: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2023-03-17T08:39:33.945 DEBUG:teuthology.orchestra.run.smithi035:> sudo modprobe fuse 2023-03-17T08:39:34.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:34 smithi078 ceph-mon[94114]: pgmap v1666: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:36.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:34 smithi082 ceph-mon[94281]: pgmap v1666: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:36.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:34 smithi035 ceph-mon[92535]: pgmap v1666: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:36.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:35 smithi078 ceph-mon[94114]: pgmap v1667: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:39:36.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:35 smithi082 ceph-mon[94281]: pgmap v1667: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:39:39.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:35 smithi035 ceph-mon[92535]: pgmap v1667: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T08:39:39.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:38 smithi078 ceph-mon[94114]: pgmap v1668: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:39.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:38 smithi082 ceph-mon[94281]: pgmap v1668: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:39.007 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-17T08:39:41.834 DEBUG:teuthology.orchestra.run.smithi035:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-17T08:39:41.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:38 smithi035 ceph-mon[92535]: pgmap v1668: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:42.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:40 smithi078 ceph-mon[94114]: pgmap v1669: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:42.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:42 smithi078 ceph-mon[94114]: pgmap v1670: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2023-03-17T08:39:42.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:40 smithi082 ceph-mon[94281]: pgmap v1669: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:44.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:42 smithi082 ceph-mon[94281]: pgmap v1670: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2023-03-17T08:39:47.698 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:40 smithi035 ceph-mon[92535]: pgmap v1669: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:39:47.698 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:42 smithi035 ceph-mon[92535]: pgmap v1670: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2023-03-17T08:39:47.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:44 smithi078 ceph-mon[94114]: pgmap v1671: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:47.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:45 smithi078 ceph-mon[94114]: pgmap v1672: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:47.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:44 smithi082 ceph-mon[94281]: pgmap v1671: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:47.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:45 smithi082 ceph-mon[94281]: pgmap v1672: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:47.700 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-17T08:39:47.700 INFO:teuthology.orchestra.run.smithi035.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-17T08:39:47.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:39:48.705 DEBUG:teuthology.orchestra.run.smithi035:> ls /sys/fs/fuse/connections 2023-03-17T08:39:48.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:44 smithi035 ceph-mon[92535]: pgmap v1671: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:48.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:45 smithi035 ceph-mon[92535]: pgmap v1672: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:39:48.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:48 smithi035 ceph-mon[92535]: pgmap v1673: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:48.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:48 smithi078 ceph-mon[94114]: pgmap v1673: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:48.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:48 smithi082 ceph-mon[94281]: pgmap v1673: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:39:48.727 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-03-17T08:39:50.603 DEBUG:teuthology.orchestra.run.smithi035:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/a19fac02-a76b-4da9-a7a8-46c7400d413c --client_fs=cephfs) 2023-03-17T08:39:50.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:50 smithi078 ceph-mon[94114]: pgmap v1674: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:50.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:50 smithi082 ceph-mon[94281]: pgmap v1674: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:50.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:50 smithi035 ceph-mon[92535]: pgmap v1674: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:39:50.608 DEBUG:teuthology.orchestra.run.smithi035:> sudo modprobe fuse 2023-03-17T08:39:51.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi035.stderr:2023-03-17T08:39:50.728+0000 7f31ba5175c0 -1 init, newargv = 0x555a2b7840d0 newargc=15 2023-03-17T08:39:51.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi035.stderr:ceph-fuse[147537]: starting ceph client 2023-03-17T08:39:51.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi035.stderr:ceph-fuse[147537]: starting fuse 2023-03-17T08:39:52.023 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-17T08:39:53.895 DEBUG:teuthology.orchestra.run.smithi035:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-17T08:39:53.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:52 smithi078 ceph-mon[94114]: pgmap v1675: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:56.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:52 smithi082 ceph-mon[94281]: pgmap v1675: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:56.189 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:52 smithi035 ceph-mon[92535]: pgmap v1675: 97 pgs: 97 active+clean; 645 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:39:56.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:54 smithi078 ceph-mon[94114]: pgmap v1676: 97 pgs: 97 active+clean; 646 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:39:56.191 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:54 smithi035 ceph-mon[92535]: pgmap v1676: 97 pgs: 97 active+clean; 646 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:39:56.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:54 smithi082 ceph-mon[94281]: pgmap v1676: 97 pgs: 97 active+clean; 646 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:39:56.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:55 smithi082 ceph-mon[94281]: pgmap v1677: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:39:56.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:55 smithi078 ceph-mon[94114]: pgmap v1677: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:39:59.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:39:58 smithi082 ceph-mon[94281]: pgmap v1678: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-03-17T08:39:59.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:55 smithi035 ceph-mon[92535]: pgmap v1677: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:39:59.207 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:39:58 smithi078 ceph-mon[94114]: pgmap v1678: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-03-17T08:39:59.207 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-17T08:40:02.256 INFO:teuthology.orchestra.run.smithi035.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-17T08:40:02.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:40:03.926 DEBUG:teuthology.orchestra.run.smithi035:> ls /sys/fs/fuse/connections 2023-03-17T08:40:04.525 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:39:58 smithi035 ceph-mon[92535]: pgmap v1678: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-03-17T08:40:07.025 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:00 smithi035 ceph-mon[92535]: pgmap v1679: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-03-17T08:40:07.025 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T08:40:07.025 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:02 smithi035 ceph-mon[92535]: pgmap v1680: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-03-17T08:40:07.026 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:04 smithi035 ceph-mon[92535]: pgmap v1681: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-03-17T08:40:07.027 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:05 smithi035 ceph-mon[92535]: pgmap v1682: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T08:40:07.027 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:00 smithi082 ceph-mon[94281]: pgmap v1679: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-03-17T08:40:07.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T08:40:07.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:02 smithi082 ceph-mon[94281]: pgmap v1680: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-03-17T08:40:07.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:04 smithi082 ceph-mon[94281]: pgmap v1681: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-03-17T08:40:08.288 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:05 smithi082 ceph-mon[94281]: pgmap v1682: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T08:40:08.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:00 smithi078 ceph-mon[94114]: pgmap v1679: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-03-17T08:40:09.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T08:40:09.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:02 smithi078 ceph-mon[94114]: pgmap v1680: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-03-17T08:40:09.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:04 smithi078 ceph-mon[94114]: pgmap v1681: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-03-17T08:40:09.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:05 smithi078 ceph-mon[94114]: pgmap v1682: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T08:40:09.424 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:08 smithi082 ceph-mon[94281]: pgmap v1683: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-17T08:40:09.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:08 smithi078 ceph-mon[94114]: pgmap v1683: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-17T08:40:09.425 INFO:teuthology.orchestra.run.smithi035.stdout:124 2023-03-17T08:40:10.235 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-03-17T08:40:10.235 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-03-17T08:40:10.235 DEBUG:teuthology.orchestra.run.smithi035:> import glob 2023-03-17T08:40:10.236 DEBUG:teuthology.orchestra.run.smithi035:> import re 2023-03-17T08:40:10.236 DEBUG:teuthology.orchestra.run.smithi035:> import os 2023-03-17T08:40:10.602 DEBUG:teuthology.orchestra.run.smithi035:> import subprocess 2023-03-17T08:40:11.576 DEBUG:teuthology.orchestra.run.smithi035:> 2023-03-17T08:40:11.576 DEBUG:teuthology.orchestra.run.smithi035:> def _find_admin_socket(client_name): 2023-03-17T08:40:11.576 DEBUG:teuthology.orchestra.run.smithi035:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-03-17T08:40:11.576 DEBUG:teuthology.orchestra.run.smithi035:> files = glob.glob(asok_path) 2023-03-17T08:40:11.576 DEBUG:teuthology.orchestra.run.smithi035:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> # Given a non-glob path, it better be there 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> if "*" not in asok_path: 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> assert(len(files) == 1) 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> return files[0] 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> for f in files: 2023-03-17T08:40:11.577 DEBUG:teuthology.orchestra.run.smithi035:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> if os.path.exists("/proc/{0}".format(pid)): 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> contents = proc_f.read() 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> if mountpoint in contents: 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> return f 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> 2023-03-17T08:40:11.578 DEBUG:teuthology.orchestra.run.smithi035:> print(_find_admin_socket("client.0")) 2023-03-17T08:40:12.229 DEBUG:teuthology.orchestra.run.smithi035:> ' 2023-03-17T08:40:12.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:08 smithi035 ceph-mon[92535]: pgmap v1683: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2023-03-17T08:40:12.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:10 smithi082 ceph-mon[94281]: pgmap v1684: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:40:12.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:10 smithi035 ceph-mon[92535]: pgmap v1684: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:40:12.861 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:10 smithi078 ceph-mon[94114]: pgmap v1684: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:40:12.861 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:12 smithi082 ceph-mon[94281]: pgmap v1685: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:13.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:12 smithi035 ceph-mon[92535]: pgmap v1685: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:13.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:12 smithi078 ceph-mon[94114]: pgmap v1685: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:13.799 INFO:teuthology.orchestra.run.smithi035.stdout:/var/run/ceph/ceph-client.0.147537.asok 2023-03-17T08:40:15.575 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.147537.asok 2023-03-17T08:40:15.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:40:15.576 DEBUG:teuthology.orchestra.run.smithi035:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.147537.asok status 2023-03-17T08:40:15.577 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:14 smithi078 ceph-mon[94114]: pgmap v1686: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:16.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:14 smithi082 ceph-mon[94281]: pgmap v1686: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:16.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:14 smithi035 ceph-mon[92535]: pgmap v1686: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:16.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:15 smithi078 ceph-mon[94114]: pgmap v1687: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:16.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:15 smithi082 ceph-mon[94281]: pgmap v1687: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:16.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:15 smithi035 ceph-mon[92535]: pgmap v1687: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:17.620 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:40:17.620 INFO:teuthology.orchestra.run.smithi035.stdout: "metadata": { 2023-03-17T08:40:17.620 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_sha1": "4aa791bf129eece187e94ddbfa7c2b475588cf0c", 2023-03-17T08:40:17.620 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_version": "ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev)", 2023-03-17T08:40:17.620 INFO:teuthology.orchestra.run.smithi035.stdout: "entity_id": "0", 2023-03-17T08:40:17.620 INFO:teuthology.orchestra.run.smithi035.stdout: "hostname": "smithi035", 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "pid": "147537", 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "root": "/volumes/_nogroup/sv_0/a19fac02-a76b-4da9-a7a8-46c7400d413c" 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "dentry_count": 0, 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "dentry_pinned_count": 0, 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "id": 15174, 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "inst": { 2023-03-17T08:40:17.621 INFO:teuthology.orchestra.run.smithi035.stdout: "name": { 2023-03-17T08:40:17.622 INFO:teuthology.orchestra.run.smithi035.stdout: "type": "client", 2023-03-17T08:40:18.866 INFO:teuthology.orchestra.run.smithi035.stdout: "num": 15174 2023-03-17T08:40:18.866 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T08:40:18.866 INFO:teuthology.orchestra.run.smithi035.stdout: "addr": { 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "type": "v1", 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "addr": "192.168.0.1:0", 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "nonce": 2647589313 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "addr": { 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "type": "v1", 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "addr": "192.168.0.1:0", 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "nonce": 2647589313 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "inst_str": "client.15174 192.168.0.1:0/2647589313", 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "addr_str": "192.168.0.1:0/2647589313", 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "inode_count": 5, 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_epoch": 29, 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_epoch": 91, 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_epoch_barrier": 0, 2023-03-17T08:40:18.867 INFO:teuthology.orchestra.run.smithi035.stdout: "blocklisted": false, 2023-03-17T08:40:18.868 INFO:teuthology.orchestra.run.smithi035.stdout: "fs_name": "cephfs" 2023-03-17T08:40:18.868 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:40:18.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:40:18.868 DEBUG:teuthology.orchestra.run.smithi035:> stat --file-system '--printf=%T 2023-03-17T08:40:18.868 DEBUG:teuthology.orchestra.run.smithi035:> ' -- /home/ubuntu/cephtest/mnt.0 2023-03-17T08:40:18.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:18 smithi078 ceph-mon[94114]: pgmap v1688: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:18.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:18 smithi082 ceph-mon[94281]: pgmap v1688: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:18.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:18 smithi035 ceph-mon[92535]: pgmap v1688: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:18.890 INFO:teuthology.orchestra.run.smithi035.stdout:fuseblk 2023-03-17T08:40:22.537 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-03-17T08:40:23.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-17T08:40:23.765 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-17T08:40:23.767 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:20 smithi078 ceph-mon[94114]: pgmap v1689: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:23.767 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:22 smithi078 ceph-mon[94114]: pgmap v1690: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:24.243 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:20 smithi082 ceph-mon[94281]: pgmap v1689: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:24.243 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:22 smithi082 ceph-mon[94281]: pgmap v1690: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:24.243 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:20 smithi035 ceph-mon[92535]: pgmap v1689: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:25.806 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:22 smithi035 ceph-mon[92535]: pgmap v1690: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:25.807 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:24 smithi078 ceph-mon[94114]: pgmap v1691: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:25.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:24 smithi082 ceph-mon[94281]: pgmap v1691: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:25.808 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:24 smithi035 ceph-mon[92535]: pgmap v1691: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:25.837 INFO:teuthology.run_tasks:Running task check-counter... 2023-03-17T08:40:27.087 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-03-17T08:40:28.686 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:40:29.843 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:25 smithi082 ceph-mon[94281]: pgmap v1692: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:30.332 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:25 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:40:30.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:27 smithi082 ceph-mon[94281]: pgmap v1693: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:25 smithi078 ceph-mon[94114]: pgmap v1692: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:25 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:40:33.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:40:33.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:27 smithi078 ceph-mon[94114]: pgmap v1693: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:33.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:25 smithi035 ceph-mon[92535]: pgmap v1692: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:33.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:25 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:40:33.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:40:33.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:40:34.692 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:40:34.692 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:27 smithi035 ceph-mon[92535]: pgmap v1693: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:34.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:30 smithi082 ceph-mon[94281]: pgmap v1694: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:34.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:32 smithi082 ceph-mon[94281]: pgmap v1695: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-03-17T08:40:34.694 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:34 smithi082 ceph-mon[94281]: pgmap v1696: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:34.694 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:30 smithi078 ceph-mon[94114]: pgmap v1694: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:34.694 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:32 smithi078 ceph-mon[94114]: pgmap v1695: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-03-17T08:40:36.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:34 smithi078 ceph-mon[94114]: pgmap v1696: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:36.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:30 smithi035 ceph-mon[92535]: pgmap v1694: 97 pgs: 97 active+clean; 648 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:36.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:32 smithi035 ceph-mon[92535]: pgmap v1695: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-03-17T08:40:36.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:34 smithi035 ceph-mon[92535]: pgmap v1696: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:36.050 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 -- 172.21.15.35:0/1183139174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b541001c0 msgr2=0x7f3b541005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:37.892 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 --2- 172.21.15.35:0/1183139174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b541001c0 0x7f3b541005d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009990 tx=0x7f3b44009ca0 comp rx=0 tx=0).stop 2023-03-17T08:40:39.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 -- 172.21.15.35:0/1183139174 shutdown_connections 2023-03-17T08:40:39.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 --2- 172.21.15.35:0/1183139174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b54101d40 0x7f3b54108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:39.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 --2- 172.21.15.35:0/1183139174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b541001c0 0x7f3b541005d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:39.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 --2- 172.21.15.35:0/1183139174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b541013b0 0x7f3b54101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:39.201 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 -- 172.21.15.35:0/1183139174 >> 172.21.15.35:0/1183139174 conn(0x7f3b540fb7a0 msgr2=0x7f3b540fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:40:39.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 -- 172.21.15.35:0/1183139174 shutdown_connections 2023-03-17T08:40:39.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 -- 172.21.15.35:0/1183139174 wait complete. 2023-03-17T08:40:39.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.829+0000 7f3b58e12700 1 Processor -- start 2023-03-17T08:40:39.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 -- start start 2023-03-17T08:40:39.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b541001c0 0x7f3b54074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b541013b0 0x7f3b54072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 0x7f3b540733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54073b50 con 0x7f3b54101d40 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54073cc0 con 0x7f3b541001c0 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b58e12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5419ff00 con 0x7f3b541013b0 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 0x7f3b540733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 0x7f3b540733b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41532/0 (socket says 172.21.15.35:41532) 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 -- 172.21.15.35:0/2610872520 learned_addr learned my addr 172.21.15.35:0/2610872520 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:40:39.871 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b51d9b700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b541013b0 0x7f3b54072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:40.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b5259c700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b541001c0 0x7f3b54074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:40.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 -- 172.21.15.35:0/2610872520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b541013b0 msgr2=0x7f3b54072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:40.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b541013b0 0x7f3b54072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:42.471 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 -- 172.21.15.35:0/2610872520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b541001c0 msgr2=0x7f3b54074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b541001c0 0x7f3b54074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 -- 172.21.15.35:0/2610872520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440095f0 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b51d9b700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b541013b0 0x7f3b54072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.830+0000 7f3b52d9d700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 0x7f3b540733b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c007ee0 tx=0x7f3b4c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.831+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c017070 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.831+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b4c00f040 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.831+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5410b9d0 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.831+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c005710 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.831+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5410b840 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.832+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54107850 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.833+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f3b4c005870 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.833+0000 7f3b437fe700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3b3c09f4d0 0x7f3b3c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.833+0000 7f3b5259c700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3b3c09f4d0 0x7f3b3c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.834+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f3b4c0ca110 con 0x7f3b54101d40 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.834+0000 7f3b5259c700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3b3c09f4d0 0x7f3b3c0a1980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b44006010 tx=0x7f3b44005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:40:42.472 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:34.837+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f3b4c0942a0 con 0x7f3b54101d40 2023-03-17T08:40:42.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.038+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b5402d010 con 0x7f3b54101d40 2023-03-17T08:40:42.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.039+0000 7f3b437fe700 1 -- 172.21.15.35:0/2610872520 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f3b4c0978c0 con 0x7f3b54101d40 2023-03-17T08:40:42.473 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:40:42.473 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:40:43.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3b3c09f4d0 msgr2=0x7f3b3c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:43.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3b3c09f4d0 0x7f3b3c0a1980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b44006010 tx=0x7f3b44005940 comp rx=0 tx=0).stop 2023-03-17T08:40:43.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 msgr2=0x7f3b540733b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 0x7f3b540733b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c007ee0 tx=0x7f3b4c00d3b0 comp rx=0 tx=0).stop 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 shutdown_connections 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f3b3c09f4d0 0x7f3b3c0a1980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3b54101d40 0x7f3b540733b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b541001c0 0x7f3b54074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 --2- 172.21.15.35:0/2610872520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b541013b0 0x7f3b54072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 >> 172.21.15.35:0/2610872520 conn(0x7f3b540fb7a0 msgr2=0x7f3b54104990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 shutdown_connections 2023-03-17T08:40:45.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:35.042+0000 7f3b58e12700 1 -- 172.21.15.35:0/2610872520 wait complete. 2023-03-17T08:40:45.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-17T08:12:42.651944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-17T08:12:54.803875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:40:45.060 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:40:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2610872520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:40:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:35 smithi035 ceph-mon[92535]: pgmap v1697: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:40:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:38 smithi035 ceph-mon[92535]: pgmap v1698: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:40 smithi035 ceph-mon[92535]: pgmap v1699: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:45.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:42 smithi035 ceph-mon[92535]: pgmap v1700: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-03-17T08:40:46.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:44 smithi035 ceph-mon[92535]: pgmap v1701: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2610872520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:35 smithi078 ceph-mon[94114]: pgmap v1697: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:38 smithi078 ceph-mon[94114]: pgmap v1698: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:40 smithi078 ceph-mon[94114]: pgmap v1699: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:42 smithi078 ceph-mon[94114]: pgmap v1700: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:44 smithi078 ceph-mon[94114]: pgmap v1701: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:45 smithi078 ceph-mon[94114]: pgmap v1702: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2610872520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:35 smithi082 ceph-mon[94281]: pgmap v1697: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:38 smithi082 ceph-mon[94281]: pgmap v1698: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:40 smithi082 ceph-mon[94281]: pgmap v1699: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:40:46.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:42 smithi082 ceph-mon[94281]: pgmap v1700: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2023-03-17T08:40:46.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:44 smithi082 ceph-mon[94281]: pgmap v1701: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:46.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:45 smithi082 ceph-mon[94281]: pgmap v1702: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:46.469 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:45 smithi035 ceph-mon[92535]: pgmap v1702: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:46.609 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 -- 172.21.15.35:0/4187271180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 msgr2=0x7ff22c0ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:47.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 --2- 172.21.15.35:0/4187271180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c0ff520 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff220009990 tx=0x7ff220009ca0 comp rx=0 tx=0).stop 2023-03-17T08:40:48.395 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 -- 172.21.15.35:0/4187271180 shutdown_connections 2023-03-17T08:40:48.395 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 --2- 172.21.15.35:0/4187271180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22c100d50 0x7ff22c1075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:48.395 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 --2- 172.21.15.35:0/4187271180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c0ff520 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:49.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 --2- 172.21.15.35:0/4187271180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c1003a0 0x7ff22c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:49.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 -- 172.21.15.35:0/4187271180 >> 172.21.15.35:0/4187271180 conn(0x7ff22c0fa730 msgr2=0x7ff22c0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:40:49.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 -- 172.21.15.35:0/4187271180 shutdown_connections 2023-03-17T08:40:49.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 -- 172.21.15.35:0/4187271180 wait complete. 2023-03-17T08:40:49.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:46 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2227014404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:40:49.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:47 smithi078 ceph-mon[94114]: pgmap v1703: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:50.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:46 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2227014404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:40:50.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:47 smithi082 ceph-mon[94281]: pgmap v1703: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:51.095 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:50 smithi078 ceph-mon[94114]: pgmap v1704: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:51.095 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:50 smithi082 ceph-mon[94281]: pgmap v1704: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:51.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 Processor -- start 2023-03-17T08:40:53.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.607+0000 7ff232f96700 1 -- start start 2023-03-17T08:40:53.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff232f96700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:53.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff232f96700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22c1003a0 0x7ff22c1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:53.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff232f96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c100d50 0x7ff22c19d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:53.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff232f96700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c19d9e0 con 0x7ff22c0ff110 2023-03-17T08:40:54.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff232f96700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c19db20 con 0x7ff22c1003a0 2023-03-17T08:40:54.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff232f96700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c19dcb0 con 0x7ff22c100d50 2023-03-17T08:40:54.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41542/0 (socket says 172.21.15.35:41542) 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 -- 172.21.15.35:0/2227014404 learned_addr learned my addr 172.21.15.35:0/2227014404 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff231533700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c100d50 0x7ff22c19d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff22bfff700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22c1003a0 0x7ff22c1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 -- 172.21.15.35:0/2227014404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c100d50 msgr2=0x7ff22c19d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c100d50 0x7ff22c19d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 -- 172.21.15.35:0/2227014404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22c1003a0 msgr2=0x7ff22c1963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:55.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22c1003a0 0x7ff22c1963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 -- 172.21.15.35:0/2227014404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200095f0 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff230d32700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c195e60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff220005910 tx=0x7ff220004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22001d070 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.608+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff220004c70 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.609+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c10a9b0 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.609+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220003a30 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.609+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c10a820 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.610+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c19e1d0 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.611+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7ff220005000 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.611+0000 7ff229ffb700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff21c09f550 0x7ff21c0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.612+0000 7ff22bfff700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff21c09f550 0x7ff21c0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.612+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7ff2200cb470 con 0x7ff22c0ff110 2023-03-17T08:40:55.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.612+0000 7ff22bfff700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff21c09f550 0x7ff21c0a1a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff218005950 tx=0x7ff21800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:40:55.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.615+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7ff220095690 con 0x7ff22c0ff110 2023-03-17T08:40:55.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.815+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff22c19e780 con 0x7ff22c0ff110 2023-03-17T08:40:55.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.815+0000 7ff229ffb700 1 -- 172.21.15.35:0/2227014404 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff220026020 con 0x7ff22c0ff110 2023-03-17T08:40:55.085 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:40:55.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff21c09f550 msgr2=0x7ff21c0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:55.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff21c09f550 0x7ff21c0a1a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff218005950 tx=0x7ff21800b410 comp rx=0 tx=0).stop 2023-03-17T08:40:55.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 msgr2=0x7ff22c195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c195e60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff220005910 tx=0x7ff220004730 comp rx=0 tx=0).stop 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 shutdown_connections 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c100d50 0x7ff22c19d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7ff21c09f550 0x7ff21c0a1a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff22c0ff110 0x7ff22c195e60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 --2- 172.21.15.35:0/2227014404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22c1003a0 0x7ff22c1963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 >> 172.21.15.35:0/2227014404 conn(0x7ff22c0fa730 msgr2=0x7ff22c0fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 shutdown_connections 2023-03-17T08:40:55.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:46.817+0000 7ff232f96700 1 -- 172.21.15.35:0/2227014404 wait complete. 2023-03-17T08:40:55.088 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-17T08:40:55.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:52 smithi078 ceph-mon[94114]: pgmap v1705: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:56.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:54 smithi078 ceph-mon[94114]: pgmap v1706: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:56.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:52 smithi082 ceph-mon[94281]: pgmap v1705: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:56.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:54 smithi082 ceph-mon[94281]: pgmap v1706: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:56.590 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:46 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2227014404' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:40:56.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:47 smithi035 ceph-mon[92535]: pgmap v1703: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:56.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:50 smithi035 ceph-mon[92535]: pgmap v1704: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:40:56.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:52 smithi035 ceph-mon[92535]: pgmap v1705: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:40:57.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:54 smithi035 ceph-mon[92535]: pgmap v1706: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:58.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:55 smithi035 ceph-mon[92535]: pgmap v1707: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:58.601 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:55 smithi078 ceph-mon[94114]: pgmap v1707: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:58.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:56 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3946445430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:40:58.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:40:58 smithi078 ceph-mon[94114]: pgmap v1708: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:40:58.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:55 smithi082 ceph-mon[94281]: pgmap v1707: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:40:58.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:56 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3946445430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:41:00.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:40:58 smithi082 ceph-mon[94281]: pgmap v1708: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:00.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:00 smithi078 ceph-mon[94114]: pgmap v1709: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:02.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:00 smithi082 ceph-mon[94281]: pgmap v1709: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:02.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 -- 172.21.15.35:0/3232513354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41981003a0 msgr2=0x7f4198100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:03.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3232513354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41981003a0 0x7f4198100810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f418c009990 tx=0x7f418c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:41:03.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 -- 172.21.15.35:0/3232513354 shutdown_connections 2023-03-17T08:41:03.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3232513354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4198100d50 0x7f41981075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:03.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3232513354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41980ff110 0x7f41980ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:03.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3232513354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41981003a0 0x7f4198100810 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:03.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 -- 172.21.15.35:0/3232513354 >> 172.21.15.35:0/3232513354 conn(0x7f41980fa730 msgr2=0x7f41980fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:03.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 -- 172.21.15.35:0/3232513354 shutdown_connections 2023-03-17T08:41:03.988 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.732+0000 7f419c9cd700 1 -- 172.21.15.35:0/3232513354 wait complete. 2023-03-17T08:41:04.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 Processor -- start 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 -- start start 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 0x7f41980688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41981003a0 0x7f419819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100d50 0x7f419819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419819d8f0 con 0x7f41980ff110 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419819da60 con 0x7f41981003a0 2023-03-17T08:41:04.730 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419c9cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419819dc20 con 0x7f4198100d50 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 0x7f41980688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 0x7f41980688c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41556/0 (socket says 172.21.15.35:41556) 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 -- 172.21.15.35:0/3946445430 learned_addr learned my addr 172.21.15.35:0/3946445430 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f4195d9b700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41981003a0 0x7f419819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f4196d9d700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100d50 0x7f419819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 -- 172.21.15.35:0/3946445430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100d50 msgr2=0x7f419819d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:06.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100d50 0x7f419819d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:07.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 -- 172.21.15.35:0/3946445430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41981003a0 msgr2=0x7f419819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:07.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41981003a0 0x7f419819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:07.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.733+0000 7f419659c700 1 -- 172.21.15.35:0/3946445430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0095f0 con 0x7f41980ff110 2023-03-17T08:41:07.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.734+0000 7f419659c700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 0x7f41980688c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f418800e9a0 tx=0x7f418800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:41:07.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.734+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188009790 con 0x7f41980ff110 2023-03-17T08:41:07.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.734+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f418800cbd0 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.734+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419810a9c0 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.734+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188018680 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.734+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419810a830 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.735+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419819e230 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.736+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f418800cd40 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.737+0000 7f41877fe700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f418009f4d0 0x7f41800a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.737+0000 7f4195d9b700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f418009f4d0 0x7f41800a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.737+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f4188014070 con 0x7f41980ff110 2023-03-17T08:41:09.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.737+0000 7f4195d9b700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f418009f4d0 0x7f41800a1980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f418c006010 tx=0x7f418c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:41:09.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.741+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f41880515b0 con 0x7f41980ff110 2023-03-17T08:41:09.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.943+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4198106180 con 0x7f41980ff110 2023-03-17T08:41:09.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.944+0000 7f41877fe700 1 -- 172.21.15.35:0/3946445430 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4188094710 con 0x7f41980ff110 2023-03-17T08:41:09.548 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 32 2023-03-17T08:41:09.550 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f418009f4d0 msgr2=0x7f41800a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:12.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f418009f4d0 0x7f41800a1980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f418c006010 tx=0x7f418c005960 comp rx=0 tx=0).stop 2023-03-17T08:41:12.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 msgr2=0x7f41980688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:12.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 0x7f41980688c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f418800e9a0 tx=0x7f418800ecb0 comp rx=0 tx=0).stop 2023-03-17T08:41:13.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 shutdown_connections 2023-03-17T08:41:13.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100d50 0x7f419819d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:13.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f418009f4d0 0x7f41800a1980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:13.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41980ff110 0x7f41980688c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:13.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 --2- 172.21.15.35:0/3946445430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41981003a0 0x7f419819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:13.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 >> 172.21.15.35:0/3946445430 conn(0x7f41980fa730 msgr2=0x7f41980fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:13.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 shutdown_connections 2023-03-17T08:41:13.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:40:56.946+0000 7f419c9cd700 1 -- 172.21.15.35:0/3946445430 wait complete. 2023-03-17T08:41:13.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:02 smithi078 ceph-mon[94114]: pgmap v1710: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:15.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:04 smithi078 ceph-mon[94114]: pgmap v1711: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:15.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:05 smithi078 ceph-mon[94114]: pgmap v1712: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:15.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:08 smithi078 ceph-mon[94114]: pgmap v1713: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:15.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:02 smithi082 ceph-mon[94281]: pgmap v1710: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:20.284 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:04 smithi082 ceph-mon[94281]: pgmap v1711: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:20.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:05 smithi082 ceph-mon[94281]: pgmap v1712: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:20.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:08 smithi082 ceph-mon[94281]: pgmap v1713: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:20.285 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-17T08:41:20.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:56 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3946445430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:41:21.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:40:58 smithi035 ceph-mon[92535]: pgmap v1708: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:00 smithi035 ceph-mon[92535]: pgmap v1709: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:02 smithi035 ceph-mon[92535]: pgmap v1710: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:04 smithi035 ceph-mon[92535]: pgmap v1711: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:05 smithi035 ceph-mon[92535]: pgmap v1712: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:08 smithi035 ceph-mon[92535]: pgmap v1713: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:10 smithi035 ceph-mon[92535]: pgmap v1714: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:12 smithi035 ceph-mon[92535]: pgmap v1715: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:14 smithi035 ceph-mon[92535]: pgmap v1716: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:15 smithi035 ceph-mon[92535]: pgmap v1717: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:22.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:18 smithi035 ceph-mon[92535]: pgmap v1718: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:10 smithi078 ceph-mon[94114]: pgmap v1714: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:12 smithi078 ceph-mon[94114]: pgmap v1715: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:14 smithi078 ceph-mon[94114]: pgmap v1716: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:15 smithi078 ceph-mon[94114]: pgmap v1717: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:18 smithi078 ceph-mon[94114]: pgmap v1718: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:20 smithi078 ceph-mon[94114]: pgmap v1719: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:22 smithi078 ceph-mon[94114]: pgmap v1720: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:10 smithi082 ceph-mon[94281]: pgmap v1714: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:22.983 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:12 smithi082 ceph-mon[94281]: pgmap v1715: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:22.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:14 smithi082 ceph-mon[94281]: pgmap v1716: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:15 smithi082 ceph-mon[94281]: pgmap v1717: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:22.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:18 smithi082 ceph-mon[94281]: pgmap v1718: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:22.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:20 smithi082 ceph-mon[94281]: pgmap v1719: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:22.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:22 smithi082 ceph-mon[94281]: pgmap v1720: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:22.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:20 smithi035 ceph-mon[92535]: pgmap v1719: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:23.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:22 smithi035 ceph-mon[92535]: pgmap v1720: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:23.891 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 -- 172.21.15.35:0/1720847088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c01003a0 msgr2=0x7f17c0100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:26.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/1720847088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c01003a0 0x7f17c0100810 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009990 tx=0x7f17a8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:41:26.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 -- 172.21.15.35:0/1720847088 shutdown_connections 2023-03-17T08:41:26.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/1720847088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c0100d50 0x7f17c01075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:26.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/1720847088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c00ff110 0x7f17c00ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:26.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/1720847088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c01003a0 0x7f17c0100810 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 -- 172.21.15.35:0/1720847088 >> 172.21.15.35:0/1720847088 conn(0x7f17c00fa730 msgr2=0x7f17c00fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 -- 172.21.15.35:0/1720847088 shutdown_connections 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.121+0000 7f17c5fa4700 1 -- 172.21.15.35:0/1720847088 wait complete. 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 Processor -- start 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 -- start start 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c00ff110 0x7f17c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c01003a0 0x7f17c019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 0x7f17c019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019d9c0 con 0x7f17c0100d50 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019db30 con 0x7f17c00ff110 2023-03-17T08:41:26.375 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17c5fa4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019dcf0 con 0x7f17c01003a0 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17bffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 0x7f17c019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17bffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 0x7f17c019d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41574/0 (socket says 172.21.15.35:41574) 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.122+0000 7f17bffff700 1 -- 172.21.15.35:0/3432963263 learned_addr learned my addr 172.21.15.35:0/3432963263 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bf7fe700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c00ff110 0x7f17c00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17beffd700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c01003a0 0x7f17c019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bffff700 1 -- 172.21.15.35:0/3432963263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c01003a0 msgr2=0x7f17c019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bffff700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c01003a0 0x7f17c019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bffff700 1 -- 172.21.15.35:0/3432963263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c00ff110 msgr2=0x7f17c00688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bffff700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c00ff110 0x7f17c00688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bffff700 1 -- 172.21.15.35:0/3432963263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a80095f0 con 0x7f17c0100d50 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bffff700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 0x7f17c019d1f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f17b800ef30 tx=0x7f17b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:41:28.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8018070 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c010a960 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b800f040 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800cbc0 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.123+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c010a7d0 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.124+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c0106220 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.125+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f17b8007500 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.126+0000 7f17bcff9700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f17ac09f4d0 0x7f17ac0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.126+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f17b80c9c40 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.126+0000 7f17bf7fe700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f17ac09f4d0 0x7f17ac0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.126+0000 7f17bf7fe700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f17ac09f4d0 0x7f17ac0a1980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17b0007c60 tx=0x7f17b00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.130+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f17b8093e60 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.334+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17c00679e0 con 0x7f17c0100d50 2023-03-17T08:41:28.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.334+0000 7f17bcff9700 1 -- 172.21.15.35:0/3432963263 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17b8097480 con 0x7f17c0100d50 2023-03-17T08:41:28.847 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 64 2023-03-17T08:41:29.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f17ac09f4d0 msgr2=0x7f17ac0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:31.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f17ac09f4d0 0x7f17ac0a1980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17b0007c60 tx=0x7f17b00073d0 comp rx=0 tx=0).stop 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 msgr2=0x7f17c019d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 0x7f17c019d1f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f17b800ef30 tx=0x7f17b800c3a0 comp rx=0 tx=0).stop 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 shutdown_connections 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f17ac09f4d0 0x7f17ac0a1980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17c0100d50 0x7f17c019d1f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c00ff110 0x7f17c00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 --2- 172.21.15.35:0/3432963263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c01003a0 0x7f17c019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:31.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 >> 172.21.15.35:0/3432963263 conn(0x7f17c00fa730 msgr2=0x7f17c00fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 shutdown_connections 2023-03-17T08:41:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:23.336+0000 7f17c5fa4700 1 -- 172.21.15.35:0/3432963263 wait complete. 2023-03-17T08:41:31.713 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:41:32.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:24 smithi035 ceph-mon[92535]: pgmap v1721: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:24 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3432963263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:25 smithi035 ceph-mon[92535]: pgmap v1722: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:26 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:27 smithi035 ceph-mon[92535]: pgmap v1723: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:30 smithi035 ceph-mon[92535]: pgmap v1724: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:34.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:32 smithi035 ceph-mon[92535]: pgmap v1725: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:34.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:24 smithi082 ceph-mon[94281]: pgmap v1721: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:34.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:24 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3432963263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:41:34.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:25 smithi082 ceph-mon[94281]: pgmap v1722: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:34.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:26 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:41:34.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:41:34.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:41:34.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:41:35.712 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:27 smithi082 ceph-mon[94281]: pgmap v1723: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:35.712 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:30 smithi082 ceph-mon[94281]: pgmap v1724: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:32 smithi082 ceph-mon[94281]: pgmap v1725: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:24 smithi078 ceph-mon[94114]: pgmap v1721: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:24 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3432963263' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:25 smithi078 ceph-mon[94114]: pgmap v1722: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:26 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:27 smithi078 ceph-mon[94114]: pgmap v1723: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:30 smithi078 ceph-mon[94114]: pgmap v1724: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:32 smithi078 ceph-mon[94114]: pgmap v1725: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:35.713 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:34 smithi078 ceph-mon[94114]: pgmap v1726: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:41:35.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:34 smithi035 ceph-mon[92535]: pgmap v1726: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:41:39.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:34 smithi082 ceph-mon[94281]: pgmap v1726: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:41:39.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2952777696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:41:39.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:35 smithi078 ceph-mon[94114]: pgmap v1727: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:39.288 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:38 smithi078 ceph-mon[94114]: pgmap v1728: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:41:39.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2952777696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:41:39.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:35 smithi082 ceph-mon[94281]: pgmap v1727: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:40.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:38 smithi082 ceph-mon[94281]: pgmap v1728: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:41:40.630 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 -- 172.21.15.35:0/2254808501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff24101d40 msgr2=0x7eff24108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:40.630 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 --2- 172.21.15.35:0/2254808501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff24101d40 0x7eff24108600 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b0a0 tx=0x7eff1c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:41:40.630 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 -- 172.21.15.35:0/2254808501 shutdown_connections 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 --2- 172.21.15.35:0/2254808501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff24101d40 0x7eff24108600 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 --2- 172.21.15.35:0/2254808501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff241001c0 0x7eff241005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 --2- 172.21.15.35:0/2254808501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff241013b0 0x7eff24101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 -- 172.21.15.35:0/2254808501 >> 172.21.15.35:0/2254808501 conn(0x7eff240fb7a0 msgr2=0x7eff240fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 -- 172.21.15.35:0/2254808501 shutdown_connections 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.693+0000 7eff2b067700 1 -- 172.21.15.35:0/2254808501 wait complete. 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 Processor -- start 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 -- start start 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 0x7eff24074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff241013b0 0x7eff24072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff24101d40 0x7eff240733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff24073b50 con 0x7eff241001c0 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff24073cc0 con 0x7eff24101d40 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff2b067700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2419ffb0 con 0x7eff241013b0 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 0x7eff24074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:40.631 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 0x7eff24074830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41584/0 (socket says 172.21.15.35:41584) 2023-03-17T08:41:40.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 -- 172.21.15.35:0/2952777696 learned_addr learned my addr 172.21.15.35:0/2952777696 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:41:40.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff23fff700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff241013b0 0x7eff24072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:41.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff29604700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff24101d40 0x7eff240733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:41.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 -- 172.21.15.35:0/2952777696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff241013b0 msgr2=0x7eff24072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:41.663 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff241013b0 0x7eff24072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:41.663 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 -- 172.21.15.35:0/2952777696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff24101d40 msgr2=0x7eff240733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:41.663 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff24101d40 0x7eff240733b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:41.663 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.694+0000 7eff28e03700 1 -- 172.21.15.35:0/2952777696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009d00 con 0x7eff241001c0 2023-03-17T08:41:42.766 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.695+0000 7eff28e03700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 0x7eff24074830 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e970 tx=0x7eff1800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:41:42.766 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.695+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18009790 con 0x7eff241001c0 2023-03-17T08:41:42.766 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.695+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff1800c7e0 con 0x7eff241001c0 2023-03-17T08:41:43.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.695+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2410b9f0 con 0x7eff241001c0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.695+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18003bd0 con 0x7eff241001c0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.695+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2410b860 con 0x7eff241001c0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.696+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff24067970 con 0x7eff241001c0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.697+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7eff1800c950 con 0x7eff241001c0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.698+0000 7eff21ffb700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7eff1409f4d0 0x7eff140a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.698+0000 7eff23fff700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7eff1409f4d0 0x7eff140a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.698+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7eff18014070 con 0x7eff241001c0 2023-03-17T08:41:43.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.698+0000 7eff23fff700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7eff1409f4d0 0x7eff140a1980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff10009c60 tx=0x7eff10009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:41:43.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.703+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7eff18094690 con 0x7eff241001c0 2023-03-17T08:41:43.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.903+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff241070c0 con 0x7eff241001c0 2023-03-17T08:41:43.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.904+0000 7eff21ffb700 1 -- 172.21.15.35:0/2952777696 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7eff18097cb0 con 0x7eff241001c0 2023-03-17T08:41:43.915 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:41:45.479 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:41:46.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:40 smithi078 ceph-mon[94114]: pgmap v1729: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T08:41:46.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:42 smithi078 ceph-mon[94114]: pgmap v1730: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:46.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:44 smithi078 ceph-mon[94114]: pgmap v1731: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:47.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:45 smithi078 ceph-mon[94114]: pgmap v1732: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:47.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:40 smithi082 ceph-mon[94281]: pgmap v1729: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T08:41:47.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:42 smithi082 ceph-mon[94281]: pgmap v1730: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:50.836 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:44 smithi082 ceph-mon[94281]: pgmap v1731: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:50.836 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:45 smithi082 ceph-mon[94281]: pgmap v1732: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:50.836 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7eff1409f4d0 msgr2=0x7eff140a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:50.836 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7eff1409f4d0 0x7eff140a1980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff10009c60 tx=0x7eff10009260 comp rx=0 tx=0).stop 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 msgr2=0x7eff24074830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 0x7eff24074830 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff1800e970 tx=0x7eff1800ec80 comp rx=0 tx=0).stop 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 shutdown_connections 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff24101d40 0x7eff240733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7eff1409f4d0 0x7eff140a1980 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff241001c0 0x7eff24074830 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 --2- 172.21.15.35:0/2952777696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff241013b0 0x7eff24072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 >> 172.21.15.35:0/2952777696 conn(0x7eff240fb7a0 msgr2=0x7eff240fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:50.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 shutdown_connections 2023-03-17T08:41:50.838 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:34.906+0000 7eff2b067700 1 -- 172.21.15.35:0/2952777696 wait complete. 2023-03-17T08:41:50.839 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-17T08:12:42.651944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-17T08:12:54.803875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:41:53.500 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:41:55.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2952777696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:35 smithi035 ceph-mon[92535]: pgmap v1727: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:38 smithi035 ceph-mon[92535]: pgmap v1728: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:40 smithi035 ceph-mon[92535]: pgmap v1729: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:42 smithi035 ceph-mon[92535]: pgmap v1730: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:44 smithi035 ceph-mon[92535]: pgmap v1731: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:45 smithi035 ceph-mon[92535]: pgmap v1732: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:48 smithi035 ceph-mon[92535]: pgmap v1733: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:50 smithi035 ceph-mon[92535]: pgmap v1734: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:52 smithi035 ceph-mon[92535]: pgmap v1735: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:55.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:54 smithi035 ceph-mon[92535]: pgmap v1736: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:48 smithi078 ceph-mon[94114]: pgmap v1733: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:50 smithi078 ceph-mon[94114]: pgmap v1734: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:55.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:52 smithi078 ceph-mon[94114]: pgmap v1735: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:55.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:54 smithi078 ceph-mon[94114]: pgmap v1736: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:48 smithi082 ceph-mon[94281]: pgmap v1733: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:50 smithi082 ceph-mon[94281]: pgmap v1734: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:41:55.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:52 smithi082 ceph-mon[94281]: pgmap v1735: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:41:55.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:54 smithi082 ceph-mon[94281]: pgmap v1736: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:41:55.475 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 -- 172.21.15.35:0/174073078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 msgr2=0x7fb168108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:56.762 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 --2- 172.21.15.35:0/174073078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb168108380 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb16000b0a0 tx=0x7fb16000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 -- 172.21.15.35:0/174073078 shutdown_connections 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 --2- 172.21.15.35:0/174073078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb168108380 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 --2- 172.21.15.35:0/174073078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb168100d40 0x7fb168103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 --2- 172.21.15.35:0/174073078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb168103660 0x7fb168105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 -- 172.21.15.35:0/174073078 >> 172.21.15.35:0/174073078 conn(0x7fb1680fa760 msgr2=0x7fb1680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 -- 172.21.15.35:0/174073078 shutdown_connections 2023-03-17T08:41:56.763 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.472+0000 7fb16cb40700 1 -- 172.21.15.35:0/174073078 wait complete. 2023-03-17T08:41:56.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:55 smithi078 ceph-mon[94114]: pgmap v1737: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:57.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:55 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1404538537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:41:57.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:55 smithi082 ceph-mon[94281]: pgmap v1737: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:41:57.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:55 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1404538537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:41:57.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 Processor -- start 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 -- start start 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb168100d40 0x7fb1681006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb168103660 0x7fb1680fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb1680ff230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680ff9d0 con 0x7fb168105f80 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680ffb40 con 0x7fb168100d40 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.473+0000 7fb16cb40700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16819ff00 con 0x7fb168103660 2023-03-17T08:41:58.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb1680ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:58.524 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb1680ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41602/0 (socket says 172.21.15.35:41602) 2023-03-17T08:41:58.524 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 -- 172.21.15.35:0/1404538537 learned_addr learned my addr 172.21.15.35:0/1404538537 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:41:58.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb16659c700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb168100d40 0x7fb1681006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:58.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb165d9b700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb168103660 0x7fb1680fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:41:58.525 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 -- 172.21.15.35:0/1404538537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb168103660 msgr2=0x7fb1680fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:41:59.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb168103660 0x7fb1680fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:41:59.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 -- 172.21.15.35:0/1404538537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb168100d40 msgr2=0x7fb1681006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb168100d40 0x7fb1681006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 -- 172.21.15.35:0/1404538537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009d00 con 0x7fb168105f80 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb166d9d700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb1680ff230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb16000b780 tx=0x7fb16000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000e040 con 0x7fb168105f80 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16810ba20 con 0x7fb168105f80 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb160004e60 con 0x7fb168105f80 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1600052a0 con 0x7fb168105f80 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.474+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16810b890 con 0x7fb168105f80 2023-03-17T08:42:00.765 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.475+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1680fc2d0 con 0x7fb168105f80 2023-03-17T08:42:04.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.476+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb16001d990 con 0x7fb168105f80 2023-03-17T08:42:04.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.477+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb15409f4d0 0x7fb1540a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:04.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.477+0000 7fb16659c700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb15409f4d0 0x7fb1540a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:04.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.477+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb1600cbf10 con 0x7fb168105f80 2023-03-17T08:42:06.056 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.477+0000 7fb16659c700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb15409f4d0 0x7fb1540a1980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb150005ea0 tx=0x7fb150005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:06.056 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.480+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fb160096090 con 0x7fb168105f80 2023-03-17T08:42:06.056 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.678+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb168067150 con 0x7fb168105f80 2023-03-17T08:42:06.056 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.678+0000 7fb15f7fe700 1 -- 172.21.15.35:0/1404538537 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1600996b0 con 0x7fb168105f80 2023-03-17T08:42:06.056 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:42:06.057 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb15409f4d0 msgr2=0x7fb1540a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb15409f4d0 0x7fb1540a1980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb150005ea0 tx=0x7fb150005e30 comp rx=0 tx=0).stop 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 msgr2=0x7fb1680ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb1680ff230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb16000b780 tx=0x7fb16000bdf0 comp rx=0 tx=0).stop 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 shutdown_connections 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb15409f4d0 0x7fb1540a1980 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb168105f80 0x7fb1680ff230 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb168100d40 0x7fb1681006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 --2- 172.21.15.35:0/1404538537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb168103660 0x7fb1680fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 >> 172.21.15.35:0/1404538537 conn(0x7fb1680fa760 msgr2=0x7fb1681019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 shutdown_connections 2023-03-17T08:42:06.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:41:55.681+0000 7fb16cb40700 1 -- 172.21.15.35:0/1404538537 wait complete. 2023-03-17T08:42:06.058 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-17T08:42:06.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:55 smithi035 ceph-mon[92535]: pgmap v1737: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:08.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:55 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1404538537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:42:08.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:41:58 smithi035 ceph-mon[92535]: pgmap v1738: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:08.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:00 smithi035 ceph-mon[92535]: pgmap v1739: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:08.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:02 smithi035 ceph-mon[92535]: pgmap v1740: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:08.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:04 smithi035 ceph-mon[92535]: pgmap v1741: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:08.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:05 smithi035 ceph-mon[92535]: pgmap v1742: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:10.665 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:08 smithi035 ceph-mon[92535]: pgmap v1743: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:10.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:41:58 smithi082 ceph-mon[94281]: pgmap v1738: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:10.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:00 smithi082 ceph-mon[94281]: pgmap v1739: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:10.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:02 smithi082 ceph-mon[94281]: pgmap v1740: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:10.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:04 smithi082 ceph-mon[94281]: pgmap v1741: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:10.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:05 smithi082 ceph-mon[94281]: pgmap v1742: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:10.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:08 smithi082 ceph-mon[94281]: pgmap v1743: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:10.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:09 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/2128739728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:42:10.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:10 smithi082 ceph-mon[94281]: pgmap v1744: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:10.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:41:58 smithi078 ceph-mon[94114]: pgmap v1738: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:10.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:00 smithi078 ceph-mon[94114]: pgmap v1739: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:12.287 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:02 smithi078 ceph-mon[94114]: pgmap v1740: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:12.287 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:04 smithi078 ceph-mon[94114]: pgmap v1741: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:12.287 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:05 smithi078 ceph-mon[94114]: pgmap v1742: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:12.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:08 smithi078 ceph-mon[94114]: pgmap v1743: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:12.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:09 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/2128739728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:42:14.081 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:10 smithi078 ceph-mon[94114]: pgmap v1744: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:14.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:12 smithi082 ceph-mon[94281]: pgmap v1745: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:12 smithi078 ceph-mon[94114]: pgmap v1745: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:17.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:14 smithi082 ceph-mon[94281]: pgmap v1746: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:20.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:15 smithi082 ceph-mon[94281]: pgmap v1747: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:20.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:14 smithi078 ceph-mon[94114]: pgmap v1746: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:20.137 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:15 smithi078 ceph-mon[94114]: pgmap v1747: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:20.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.903+0000 7f83a8fa3700 1 -- 172.21.15.35:0/3943455883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 msgr2=0x7f83a4107590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:20.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.903+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/3943455883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a4107590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f839c00b0a0 tx=0x7f839c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 -- 172.21.15.35:0/3943455883 shutdown_connections 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/3943455883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a4107590 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/3943455883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a40ff150 0x7f83a40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/3943455883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a4100340 0x7f83a4100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 -- 172.21.15.35:0/3943455883 >> 172.21.15.35:0/3943455883 conn(0x7f83a40fa790 msgr2=0x7f83a40fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 -- 172.21.15.35:0/3943455883 shutdown_connections 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 -- 172.21.15.35:0/3943455883 wait complete. 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 Processor -- start 2023-03-17T08:42:20.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.904+0000 7f83a8fa3700 1 -- start start 2023-03-17T08:42:21.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a8fa3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40ff150 0x7f83a4194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:21.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a8fa3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a4100340 0x7f83a4195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:21.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a8fa3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:21.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a8fa3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a419c9b0 con 0x7f83a4100cd0 2023-03-17T08:42:21.413 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a8fa3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a419caf0 con 0x7f83a4100340 2023-03-17T08:42:22.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a8fa3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a419cc80 con 0x7f83a40ff150 2023-03-17T08:42:22.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:22.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a419c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41616/0 (socket says 172.21.15.35:41616) 2023-03-17T08:42:22.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 -- 172.21.15.35:0/2128739728 learned_addr learned my addr 172.21.15.35:0/2128739728 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:42:22.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a259c700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40ff150 0x7f83a4194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:23.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a1d9b700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a4100340 0x7f83a4195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:23.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 -- 172.21.15.35:0/2128739728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40ff150 msgr2=0x7f83a4194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:23.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40ff150 0x7f83a4194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:23.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 -- 172.21.15.35:0/2128739728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a4100340 msgr2=0x7f83a4195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:23.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a4100340 0x7f83a4195370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:24.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 -- 172.21.15.35:0/2128739728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009d00 con 0x7f83a4100cd0 2023-03-17T08:42:24.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a1d9b700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a4100340 0x7f83a4195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:42:24.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83a2d9d700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a419c3e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f839c00b830 tx=0x7f839c004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:24.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00e040 con 0x7f83a4100cd0 2023-03-17T08:42:24.935 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.905+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839c009440 con 0x7f83a4100cd0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.906+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c01dbe0 con 0x7f83a4100cd0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.906+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a410a970 con 0x7f83a4100cd0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.906+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a410a7e0 con 0x7f83a4100cd0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.906+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a419d140 con 0x7f83a4100cd0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.908+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f839c005450 con 0x7f83a4100cd0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.908+0000 7f83937fe700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f838c09f4d0 0x7f838c0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.909+0000 7f83a259c700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f838c09f4d0 0x7f838c0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:24.936 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.909+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f839c0cc1e0 con 0x7f83a4100cd0 2023-03-17T08:42:24.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.909+0000 7f83a259c700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f838c09f4d0 0x7f838c0a1980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8394005950 tx=0x7f83940058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:24.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:08.912+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f839c096360 con 0x7f83a4100cd0 2023-03-17T08:42:24.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.114+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83a4106070 con 0x7f83a4100cd0 2023-03-17T08:42:24.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.114+0000 7f83937fe700 1 -- 172.21.15.35:0/2128739728 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f839c099980 con 0x7f83a4100cd0 2023-03-17T08:42:24.937 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 32 2023-03-17T08:42:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f838c09f4d0 msgr2=0x7f838c0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:30.872 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f838c09f4d0 0x7f838c0a1980 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8394005950 tx=0x7f83940058e0 comp rx=0 tx=0).stop 2023-03-17T08:42:30.872 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 msgr2=0x7f83a419c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a419c3e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f839c00b830 tx=0x7f839c004d90 comp rx=0 tx=0).stop 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 shutdown_connections 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f838c09f4d0 0x7f838c0a1980 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83a4100cd0 0x7f83a419c3e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40ff150 0x7f83a4194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 --2- 172.21.15.35:0/2128739728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83a4100340 0x7f83a4195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.116+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 >> 172.21.15.35:0/2128739728 conn(0x7f83a40fa790 msgr2=0x7f83a40fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.117+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 shutdown_connections 2023-03-17T08:42:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:09.117+0000 7f83a8fa3700 1 -- 172.21.15.35:0/2128739728 wait complete. 2023-03-17T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:18 smithi082 ceph-mon[94281]: pgmap v1748: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:20 smithi082 ceph-mon[94281]: pgmap v1749: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:32.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:22 smithi082 ceph-mon[94281]: pgmap v1750: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:33.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:24 smithi082 ceph-mon[94281]: pgmap v1751: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:33.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:25 smithi082 ceph-mon[94281]: pgmap v1752: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:33.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:18 smithi078 ceph-mon[94114]: pgmap v1748: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:33.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:20 smithi078 ceph-mon[94114]: pgmap v1749: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:33.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:22 smithi078 ceph-mon[94114]: pgmap v1750: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:33.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:24 smithi078 ceph-mon[94114]: pgmap v1751: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:33.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:25 smithi078 ceph-mon[94114]: pgmap v1752: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:33.668 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-17T08:42:33.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:27 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:42:34.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:28 smithi082 ceph-mon[94281]: pgmap v1753: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:34.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:42:34.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:42:34.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:42:35.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:30 smithi082 ceph-mon[94281]: pgmap v1754: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:35.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:32 smithi082 ceph-mon[94281]: pgmap v1755: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:35.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:27 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:42:36.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:28 smithi078 ceph-mon[94114]: pgmap v1753: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:36.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:42:36.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:42:36.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:42:36.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:30 smithi078 ceph-mon[94114]: pgmap v1754: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:36.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:32 smithi078 ceph-mon[94114]: pgmap v1755: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:36.965 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:09 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/2128739728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:42:36.965 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:10 smithi035 ceph-mon[92535]: pgmap v1744: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:37.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:12 smithi035 ceph-mon[92535]: pgmap v1745: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:37.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:14 smithi035 ceph-mon[92535]: pgmap v1746: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:37.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:15 smithi035 ceph-mon[92535]: pgmap v1747: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:37.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:18 smithi035 ceph-mon[92535]: pgmap v1748: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:37.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:20 smithi035 ceph-mon[92535]: pgmap v1749: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:37.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:22 smithi035 ceph-mon[92535]: pgmap v1750: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:37.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:24 smithi035 ceph-mon[92535]: pgmap v1751: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:37.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:25 smithi035 ceph-mon[92535]: pgmap v1752: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:37.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:27 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:42:37.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:28 smithi035 ceph-mon[92535]: pgmap v1753: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:37.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:42:37.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:42:37.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:42:37.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:30 smithi035 ceph-mon[92535]: pgmap v1754: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:37.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:32 smithi035 ceph-mon[92535]: pgmap v1755: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:37.628 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:34 smithi035 ceph-mon[92535]: pgmap v1756: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:42:38.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:35 smithi035 ceph-mon[92535]: pgmap v1757: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:38.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:34 smithi082 ceph-mon[94281]: pgmap v1756: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:42:38.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:35 smithi082 ceph-mon[94281]: pgmap v1757: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:38.413 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:34 smithi078 ceph-mon[94114]: pgmap v1756: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:42:38.413 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:35 smithi078 ceph-mon[94114]: pgmap v1757: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:38.416 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1833401045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 msgr2=0x7f7e441088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:39.138 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1833401045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e441088a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00b0a0 tx=0x7f7e3c00b3b0 comp rx=0 tx=0).stop 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1833401045 shutdown_connections 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1833401045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e441088a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1833401045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44100460 0x7f7e44100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1833401045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e44101650 0x7f7e44101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1833401045 >> 172.21.15.35:0/1833401045 conn(0x7f7e440fbaa0 msgr2=0x7f7e440fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1833401045 shutdown_connections 2023-03-17T08:42:39.139 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.766+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1833401045 wait complete. 2023-03-17T08:42:40.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 Processor -- start 2023-03-17T08:42:40.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 -- start start 2023-03-17T08:42:40.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e44100460 0x7f7e44074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:40.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44101650 0x7f7e44072e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:40.337 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e440733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:40.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44073b50 con 0x7f7e44101fe0 2023-03-17T08:42:40.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e44073cc0 con 0x7f7e44101650 2023-03-17T08:42:40.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e4ab8a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e441a0270 con 0x7f7e44100460 2023-03-17T08:42:40.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e440733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:40.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e440733b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41630/0 (socket says 172.21.15.35:41630) 2023-03-17T08:42:40.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 -- 172.21.15.35:0/1736723654 learned_addr learned my addr 172.21.15.35:0/1736723654 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:42:41.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e43fff700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44101650 0x7f7e44072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:41.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e48926700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e44100460 0x7f7e44074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:41.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 -- 172.21.15.35:0/1736723654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e44100460 msgr2=0x7f7e44074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:41.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e44100460 0x7f7e44074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:41.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 -- 172.21.15.35:0/1736723654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44101650 msgr2=0x7f7e44072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:41.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44101650 0x7f7e44072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:41.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e49127700 1 -- 172.21.15.35:0/1736723654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009d00 con 0x7f7e44101fe0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.767+0000 7f7e43fff700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44101650 0x7f7e44072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.768+0000 7f7e49127700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e440733b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009fd0 tx=0x7f7e3c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.768+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00e040 con 0x7f7e44101fe0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.768+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e3c003e10 con 0x7f7e44101fe0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.768+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4410bcd0 con 0x7f7e44101fe0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.768+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c01b6c0 con 0x7f7e44101fe0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.768+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4410bb40 con 0x7f7e44101fe0 2023-03-17T08:42:41.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.769+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4406a280 con 0x7f7e44101fe0 2023-03-17T08:42:41.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.770+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f7e3c01d990 con 0x7f7e44101fe0 2023-03-17T08:42:42.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.771+0000 7f7e41ffb700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e3409f4d0 0x7f7e340a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:42.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.771+0000 7f7e48926700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e3409f4d0 0x7f7e340a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:42.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.771+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f7e3c0cb470 con 0x7f7e44101fe0 2023-03-17T08:42:42.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.771+0000 7f7e48926700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e3409f4d0 0x7f7e340a1980 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e38005950 tx=0x7f7e380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:42.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.775+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f7e3c0955f0 con 0x7f7e44101fe0 2023-03-17T08:42:42.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.974+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e44107420 con 0x7f7e44101fe0 2023-03-17T08:42:42.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.975+0000 7f7e41ffb700 1 -- 172.21.15.35:0/1736723654 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e3c098c10 con 0x7f7e44101fe0 2023-03-17T08:42:42.987 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 64 2023-03-17T08:42:42.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e3409f4d0 msgr2=0x7f7e340a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:44.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e3409f4d0 0x7f7e340a1980 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e38005950 tx=0x7f7e380058e0 comp rx=0 tx=0).stop 2023-03-17T08:42:44.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 msgr2=0x7f7e440733b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:44.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e440733b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009fd0 tx=0x7f7e3c00bd30 comp rx=0 tx=0).stop 2023-03-17T08:42:44.194 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 shutdown_connections 2023-03-17T08:42:44.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f7e3409f4d0 0x7f7e340a1980 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:44.195 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7e44101fe0 0x7f7e440733b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:45.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e44100460 0x7f7e44074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:45.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 --2- 172.21.15.35:0/1736723654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e44101650 0x7f7e44072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:45.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 >> 172.21.15.35:0/1736723654 conn(0x7f7e440fbaa0 msgr2=0x7f7e440fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:42:45.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 shutdown_connections 2023-03-17T08:42:45.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:37.977+0000 7f7e4ab8a700 1 -- 172.21.15.35:0/1736723654 wait complete. 2023-03-17T08:42:45.277 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-03-17T08:42:45.277 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:42:45.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:38 smithi035 ceph-mon[92535]: pgmap v1758: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:42:45.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:38 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1736723654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:42:45.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:40 smithi035 ceph-mon[92535]: pgmap v1759: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T08:42:45.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:42 smithi035 ceph-mon[92535]: pgmap v1760: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:47.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:44 smithi035 ceph-mon[92535]: pgmap v1761: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:47.126 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:38 smithi082 ceph-mon[94281]: pgmap v1758: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:42:49.397 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:38 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1736723654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:42:49.397 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:40 smithi082 ceph-mon[94281]: pgmap v1759: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T08:42:49.397 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:42 smithi082 ceph-mon[94281]: pgmap v1760: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:49.397 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:44 smithi082 ceph-mon[94281]: pgmap v1761: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:50.836 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:45 smithi082 ceph-mon[94281]: pgmap v1762: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:52.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:38 smithi078 ceph-mon[94114]: pgmap v1758: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T08:42:52.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:38 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1736723654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:42:52.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:40 smithi078 ceph-mon[94114]: pgmap v1759: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T08:42:52.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:42 smithi078 ceph-mon[94114]: pgmap v1760: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:52.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:44 smithi078 ceph-mon[94114]: pgmap v1761: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:52.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:45 smithi078 ceph-mon[94114]: pgmap v1762: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:52.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:45 smithi035 ceph-mon[92535]: pgmap v1762: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:42:53.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:48 smithi082 ceph-mon[94281]: pgmap v1763: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:48 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/4145182436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:50 smithi082 ceph-mon[94281]: pgmap v1764: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:52 smithi082 ceph-mon[94281]: pgmap v1765: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:48 smithi078 ceph-mon[94114]: pgmap v1763: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:48 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/4145182436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:50 smithi078 ceph-mon[94114]: pgmap v1764: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:42:55.040 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:52 smithi078 ceph-mon[94114]: pgmap v1765: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:42:55.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:54 smithi082 ceph-mon[94281]: pgmap v1766: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:55.042 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:54 smithi078 ceph-mon[94114]: pgmap v1766: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:42:55.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 -- 172.21.15.35:0/2281083043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 msgr2=0x7f9a94100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:57.361 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/2281083043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a94100730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009990 tx=0x7f9a80009ca0 comp rx=0 tx=0).stop 2023-03-17T08:42:57.361 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 -- 172.21.15.35:0/2281083043 shutdown_connections 2023-03-17T08:42:57.361 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/2281083043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a94100c70 0x7f9a94107530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:57.361 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/2281083043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a940ff0f0 0x7f9a940ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:57.361 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/2281083043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a94100730 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.259+0000 7f9a9ad13700 1 -- 172.21.15.35:0/2281083043 >> 172.21.15.35:0/2281083043 conn(0x7f9a940fa710 msgr2=0x7f9a940fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 -- 172.21.15.35:0/2281083043 shutdown_connections 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 -- 172.21.15.35:0/2281083043 wait complete. 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 Processor -- start 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 -- start start 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a940ff0f0 0x7f9a94069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a9419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a94100c70 0x7f9a9419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9419d960 con 0x7f9a941002e0 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9419dad0 con 0x7f9a94100c70 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a9ad13700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9419dc90 con 0x7f9a940ff0f0 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.260+0000 7f9a93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a9419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a9419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41642/0 (socket says 172.21.15.35:41642) 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a940ff0f0 0x7f9a94069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a93fff700 1 -- 172.21.15.35:0/4145182436 learned_addr learned my addr 172.21.15.35:0/4145182436 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:42:57.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a992b0700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a94100c70 0x7f9a9419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 -- 172.21.15.35:0/4145182436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a94100c70 msgr2=0x7f9a9419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a94100c70 0x7f9a9419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 -- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 msgr2=0x7f9a9419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a9419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 -- 172.21.15.35:0/4145182436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800095f0 con 0x7f9a940ff0f0 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a93fff700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a9419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a992b0700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a94100c70 0x7f9a9419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:42:57.363 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a98aaf700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a940ff0f0 0x7f9a94069900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800d740 tx=0x7f9a8800da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:42:58.499 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88004220 con 0x7f9a940ff0f0 2023-03-17T08:42:58.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9410a910 con 0x7f9a940ff0f0 2023-03-17T08:42:58.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a88004380 con 0x7f9a940ff0f0 2023-03-17T08:42:58.500 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.261+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88003bc0 con 0x7f9a940ff0f0 2023-03-17T08:42:58.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.262+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9410a780 con 0x7f9a940ff0f0 2023-03-17T08:42:58.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.263+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94106070 con 0x7f9a940ff0f0 2023-03-17T08:42:58.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.264+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f9a88003d20 con 0x7f9a940ff0f0 2023-03-17T08:42:58.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.264+0000 7f9a91ffb700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a8409f4d0 0x7f9a840a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:42:58.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.265+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f9a880c9da0 con 0x7f9a940ff0f0 2023-03-17T08:42:58.994 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.265+0000 7f9a93fff700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a8409f4d0 0x7f9a840a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:00.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.265+0000 7f9a93fff700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a8409f4d0 0x7f9a840a1980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000b2e0 tx=0x7f9a80004500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:43:00.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.268+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f9a88093f30 con 0x7f9a940ff0f0 2023-03-17T08:43:00.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.515+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a9402d010 con 0x7f9a940ff0f0 2023-03-17T08:43:00.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.517+0000 7f9a91ffb700 1 -- 172.21.15.35:0/4145182436 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7f9a88017090 con 0x7f9a940ff0f0 2023-03-17T08:43:00.466 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:43:00.466 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:43:00.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:55 smithi082 ceph-mon[94281]: pgmap v1767: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:04.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:42:58 smithi082 ceph-mon[94281]: pgmap v1768: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:04.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:55 smithi078 ceph-mon[94114]: pgmap v1767: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:06.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:42:58 smithi078 ceph-mon[94114]: pgmap v1768: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:06.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:00 smithi078 ceph-mon[94114]: pgmap v1769: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:06.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:02 smithi078 ceph-mon[94114]: pgmap v1770: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:06.471 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a8409f4d0 msgr2=0x7f9a840a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:08.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a8409f4d0 0x7f9a840a1980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000b2e0 tx=0x7f9a80004500 comp rx=0 tx=0).stop 2023-03-17T08:43:08.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a940ff0f0 msgr2=0x7f9a94069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:08.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a940ff0f0 0x7f9a94069900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800d740 tx=0x7f9a8800da50 comp rx=0 tx=0).stop 2023-03-17T08:43:08.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 shutdown_connections 2023-03-17T08:43:08.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a94100c70 0x7f9a9419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a940ff0f0 0x7f9a94069900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f9a8409f4d0 0x7f9a840a1980 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 --2- 172.21.15.35:0/4145182436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9a941002e0 0x7f9a9419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.518+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 >> 172.21.15.35:0/4145182436 conn(0x7f9a940fa710 msgr2=0x7f9a940fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.519+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 shutdown_connections 2023-03-17T08:43:09.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:42:47.519+0000 7f9a9ad13700 1 -- 172.21.15.35:0/4145182436 wait complete. 2023-03-17T08:43:09.821 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:43:09.822 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-03-17T08:43:09.822 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-03-17T08:43:09.822 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-17T08:43:09.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:48 smithi035 ceph-mon[92535]: pgmap v1763: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:48 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4145182436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:50 smithi035 ceph-mon[92535]: pgmap v1764: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:52 smithi035 ceph-mon[92535]: pgmap v1765: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:54 smithi035 ceph-mon[92535]: pgmap v1766: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:55 smithi035 ceph-mon[92535]: pgmap v1767: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:42:58 smithi035 ceph-mon[92535]: pgmap v1768: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:00 smithi035 ceph-mon[92535]: pgmap v1769: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:02 smithi035 ceph-mon[92535]: pgmap v1770: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:14.100 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:04 smithi035 ceph-mon[92535]: pgmap v1771: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:05 smithi035 ceph-mon[92535]: pgmap v1772: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:14.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:08 smithi035 ceph-mon[92535]: pgmap v1773: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:10 smithi035 ceph-mon[92535]: pgmap v1774: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:14.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:12 smithi035 ceph-mon[92535]: pgmap v1775: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:04 smithi078 ceph-mon[94114]: pgmap v1771: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:05 smithi078 ceph-mon[94114]: pgmap v1772: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:08 smithi078 ceph-mon[94114]: pgmap v1773: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:10 smithi078 ceph-mon[94114]: pgmap v1774: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:12 smithi078 ceph-mon[94114]: pgmap v1775: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:00 smithi082 ceph-mon[94281]: pgmap v1769: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:02 smithi082 ceph-mon[94281]: pgmap v1770: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:14.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:04 smithi082 ceph-mon[94281]: pgmap v1771: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:16.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:05 smithi082 ceph-mon[94281]: pgmap v1772: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:16.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:08 smithi082 ceph-mon[94281]: pgmap v1773: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:16.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:10 smithi082 ceph-mon[94281]: pgmap v1774: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:16.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:12 smithi082 ceph-mon[94281]: pgmap v1775: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:16.626 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:14 smithi082 ceph-mon[94281]: pgmap v1776: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:16.626 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:15 smithi082 ceph-mon[94281]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:43:16.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:14 smithi078 ceph-mon[94114]: pgmap v1776: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:16.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:15 smithi078 ceph-mon[94114]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:43:16.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:16 smithi078 ceph-mon[94114]: pgmap v1777: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:18.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:16 smithi082 ceph-mon[94281]: pgmap v1777: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:18.260 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 -- 172.21.15.35:0/888464787 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc80ff0a0 msgr2=0x7fddc80ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:18.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 --2- 172.21.15.35:0/888464787 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc80ff0a0 0x7fddc80ff4b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009990 tx=0x7fddc4009ca0 comp rx=0 tx=0).stop 2023-03-17T08:43:18.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 -- 172.21.15.35:0/888464787 shutdown_connections 2023-03-17T08:43:18.944 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 --2- 172.21.15.35:0/888464787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc8100c20 0x7fddc81074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 --2- 172.21.15.35:0/888464787 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc80ff0a0 0x7fddc80ff4b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 --2- 172.21.15.35:0/888464787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc8100290 0x7fddc81006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 -- 172.21.15.35:0/888464787 >> 172.21.15.35:0/888464787 conn(0x7fddc80fa680 msgr2=0x7fddc80fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 -- 172.21.15.35:0/888464787 shutdown_connections 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.237+0000 7fddd01fb700 1 -- 172.21.15.35:0/888464787 wait complete. 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 Processor -- start 2023-03-17T08:43:19.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 -- start start 2023-03-17T08:43:20.611 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc80ff0a0 0x7fddc80688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:21.741 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc8100290 0x7fddc819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:21.741 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 0x7fddc819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:21.741 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc819d940 con 0x7fddc8100c20 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc819dab0 con 0x7fddc8100290 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddd01fb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc819dc70 con 0x7fddc80ff0a0 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddce798700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 0x7fddc819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddce798700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 0x7fddc819d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41658/0 (socket says 172.21.15.35:41658) 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddce798700 1 -- 172.21.15.35:0/228588128 learned_addr learned my addr 172.21.15.35:0/228588128 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddcdf97700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc80ff0a0 0x7fddc80688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.238+0000 7fddcd796700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc8100290 0x7fddc819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddce798700 1 -- 172.21.15.35:0/228588128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc80ff0a0 msgr2=0x7fddc80688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddce798700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc80ff0a0 0x7fddc80688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddce798700 1 -- 172.21.15.35:0/228588128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc8100290 msgr2=0x7fddc819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddce798700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc8100290 0x7fddc819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddce798700 1 -- 172.21.15.35:0/228588128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40095f0 con 0x7fddc8100c20 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddce798700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 0x7fddc819d1a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddc000ef30 tx=0x7fddc000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0018070 con 0x7fddc8100c20 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fddc000f040 con 0x7fddc8100c20 2023-03-17T08:43:23.168 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc810a8b0 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000cc70 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.239+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc810a720 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.240+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc819e270 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.242+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fddc0003a00 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.242+0000 7fddbaffd700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fddb409f550 0x7fddb40a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.243+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fddc00ca360 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.243+0000 7fddcdf97700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fddb409f550 0x7fddb40a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.243+0000 7fddcdf97700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fddb409f550 0x7fddb40a1a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fddc4006010 tx=0x7fddc400b2a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.246+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fddc00944e0 con 0x7fddc8100c20 2023-03-17T08:43:23.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.441+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddc8060ec0 con 0x7fddb409f550 2023-03-17T08:43:23.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:14 smithi035 ceph-mon[92535]: pgmap v1776: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:25.012 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.454+0000 7fddbaffd700 1 -- 172.21.15.35:0/228588128 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344912 (secure 0 0 0) 0x7fddc8060ec0 con 0x7fddb409f550 2023-03-17T08:43:25.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:18 smithi078 ceph-mon[94114]: pgmap v1778: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:25.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:20 smithi078 ceph-mon[94114]: pgmap v1779: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:25.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:22 smithi078 ceph-mon[94114]: pgmap v1780: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:26.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:24 smithi078 ceph-mon[94114]: pgmap v1781: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:26.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:18 smithi082 ceph-mon[94281]: pgmap v1778: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:26.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:20 smithi082 ceph-mon[94281]: pgmap v1779: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:26.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:22 smithi082 ceph-mon[94281]: pgmap v1780: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:26.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:24 smithi082 ceph-mon[94281]: pgmap v1781: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:26.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:25 smithi078 ceph-mon[94114]: pgmap v1782: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:27.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:25 smithi082 ceph-mon[94281]: pgmap v1782: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:27.254 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:43:27.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fddb409f550 msgr2=0x7fddb40a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:29.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fddb409f550 0x7fddb40a1a00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fddc4006010 tx=0x7fddc400b2a0 comp rx=0 tx=0).stop 2023-03-17T08:43:29.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 msgr2=0x7fddc819d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:29.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 0x7fddc819d1a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fddc000ef30 tx=0x7fddc000c3a0 comp rx=0 tx=0).stop 2023-03-17T08:43:29.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 shutdown_connections 2023-03-17T08:43:29.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fddb409f550 0x7fddb40a1a00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fddc8100c20 0x7fddc819d1a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc80ff0a0 0x7fddc80688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 --2- 172.21.15.35:0/228588128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddc8100290 0x7fddc819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 >> 172.21.15.35:0/228588128 conn(0x7fddc80fa680 msgr2=0x7fddc80fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 shutdown_connections 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:14.458+0000 7fddd01fb700 1 -- 172.21.15.35:0/228588128 wait complete. 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:43:29.157 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":1776,"stamp":"2023-03-17T08:43:13.106850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667771,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":16997,"num_read_kb":8634,"num_write":461,"num_write_kb":3108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":877,"ondisk_log_size":877,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":83820,"kb_used_data":13836,"kb_used_omap":0,"kb_used_meta":69888,"kb_avail":1124858004,"statfs":{"total":1151940427776,"available":1151854596096,"internally_reserved":0,"allocated":14168064,"data_stored":7787023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71565312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004164"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:01.757678+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:40:01.757678+0000","last_peered":"2023-03-17T08:40:01.757678+0000","last_clean":"2023-03-17T08:40:01.757678+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:40:01.757678+0000","last_undegraded":"2023-03-17T08:40:01.757678+0000","last_fullsized":"2023-03-17T08:40:01.757678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233812+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:40:05.233812+0000","last_peered":"2023-03-17T08:40:05.233812+0000","last_clean":"2023-03-17T08:40:05.233812+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:40:05.233812+0000","last_undegraded":"2023-03-17T08:40:05.233812+0000","last_fullsized":"2023-03-17T08:40:05.233812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233769+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:40:05.233769+0000","last_peered":"2023-03-17T08:40:05.233769+0000","last_clean":"2023-03-17T08:40:05.233769+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:40:05.233769+0000","last_undegraded":"2023-03-17T08:40:05.233769+0000","last_fullsized":"2023-03-17T08:40:05.233769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:01.165523+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:41:01.165523+0000","last_peered":"2023-03-17T08:41:01.165523+0000","last_clean":"2023-03-17T08:41:01.165523+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:41:01.165523+0000","last_undegraded":"2023-03-17T08:41:01.165523+0000","last_fullsized":"2023-03-17T08:41:01.165523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.371373+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:40:29.371373+0000","last_peered":"2023-03-17T08:40:29.371373+0000","last_clean":"2023-03-17T08:40:29.371373+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:40:29.371373+0000","last_undegraded":"2023-03-17T08:40:29.371373+0000","last_fullsized":"2023-03-17T08:40:29.371373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.413928+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:40:29.413928+0000","last_peered":"2023-03-17T08:40:29.413928+0000","last_clean":"2023-03-17T08:40:29.413928+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:40:29.413928+0000","last_undegraded":"2023-03-17T08:40:29.413928+0000","last_fullsized":"2023-03-17T08:40:29.413928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:28.311581+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:40:28.311581+0000","last_peered":"2023-03-17T08:40:28.311581+0000","last_clean":"2023-03-17T08:40:28.311581+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:40:28.311581+0000","last_undegraded":"2023-03-17T08:40:28.311581+0000","last_fullsized":"2023-03-17T08:40:28.311581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.432368+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:40:29.432368+0000","last_peered":"2023-03-17T08:40:29.432368+0000","last_clean":"2023-03-17T08:40:29.432368+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:40:29.432368+0000","last_undegraded":"2023-03-17T08:40:29.432368+0000","last_fullsized":"2023-03-17T08:40:29.432368+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:43.372194+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:39:43.372194+0000","last_peered":"2023-03-17T08:39:43.372194+0000","last_clean":"2023-03-17T08:39:43.372194+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:39:43.372194+0000","last_undegraded":"2023-03-17T08:39:43.372194+0000","last_fullsized":"2023-03-17T08:39:43.372194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.407892+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:39:34.407892+0000","last_peered":"2023-03-17T08:39:34.407892+0000","last_clean":"2023-03-17T08:39:34.407892+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:39:34.407892+0000","last_undegraded":"2023-03-17T08:39:34.407892+0000","last_fullsized":"2023-03-17T08:39:34.407892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.304324+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:39:33.304324+0000","last_peered":"2023-03-17T08:39:33.304324+0000","last_clean":"2023-03-17T08:39:33.304324+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:39:33.304324+0000","last_undegraded":"2023-03-17T08:39:33.304324+0000","last_fullsized":"2023-03-17T08:39:33.304324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:19.691171+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:40:19.691171+0000","last_peered":"2023-03-17T08:40:19.691171+0000","last_clean":"2023-03-17T08:40:19.691171+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:40:19.691171+0000","last_undegraded":"2023-03-17T08:40:19.691171+0000","last_fullsized":"2023-03-17T08:40:19.691171+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.190314+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:39:34.190314+0000","last_peered":"2023-03-17T08:39:34.190314+0000","last_clean":"2023-03-17T08:39:34.190314+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:39:34.190314+0000","last_undegraded":"2023-03-17T08:39:34.190314+0000","last_fullsized":"2023-03-17T08:39:34.190314+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:45.224549+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:38:45.224549+0000","last_peered":"2023-03-17T08:38:45.224549+0000","last_clean":"2023-03-17T08:38:45.224549+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:38:45.224549+0000","last_undegraded":"2023-03-17T08:38:45.224549+0000","last_fullsized":"2023-03-17T08:38:45.224549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:40.223924+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:38:40.223924+0000","last_peered":"2023-03-17T08:38:40.223924+0000","last_clean":"2023-03-17T08:38:40.223924+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:38:40.223924+0000","last_undegraded":"2023-03-17T08:38:40.223924+0000","last_fullsized":"2023-03-17T08:38:40.223924+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:38.364968+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:38:38.364968+0000","last_peered":"2023-03-17T08:38:38.364968+0000","last_clean":"2023-03-17T08:38:38.364968+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:38:38.364968+0000","last_undegraded":"2023-03-17T08:38:38.364968+0000","last_fullsized":"2023-03-17T08:38:38.364968+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:36.848067+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:38:36.848067+0000","last_peered":"2023-03-17T08:38:36.848067+0000","last_clean":"2023-03-17T08:38:36.848067+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:38:36.848067+0000","last_undegraded":"2023-03-17T08:38:36.848067+0000","last_fullsized":"2023-03-17T08:38:36.848067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:39.680426+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:38:39.680426+0000","last_peered":"2023-03-17T08:38:39.680426+0000","last_clean":"2023-03-17T08:38:39.680426+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:38:39.680426+0000","last_undegraded":"2023-03-17T08:38:39.680426+0000","last_fullsized":"2023-03-17T08:38:39.680426+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985610+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:40:03.985610+0000","last_peered":"2023-03-17T08:40:03.985610+0000","last_clean":"2023-03-17T08:40:03.985610+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:40:03.985610+0000","last_undegraded":"2023-03-17T08:40:03.985610+0000","last_fullsized":"2023-03-17T08:40:03.985610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":1727,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:07.857291+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:43:07.857291+0000","last_peered":"2023-03-17T08:43:07.857291+0000","last_clean":"2023-03-17T08:43:07.857291+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:43:07.857291+0000","last_undegraded":"2023-03-17T08:43:07.857291+0000","last_fullsized":"2023-03-17T08:43:07.857291+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1682,"num_read_kb":1682,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437251+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:41:09.437251+0000","last_peered":"2023-03-17T08:41:09.437251+0000","last_clean":"2023-03-17T08:41:09.437251+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:41:09.437251+0000","last_undegraded":"2023-03-17T08:41:09.437251+0000","last_fullsized":"2023-03-17T08:41:09.437251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.435554+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:40:54.435554+0000","last_peered":"2023-03-17T08:40:54.435554+0000","last_clean":"2023-03-17T08:40:54.435554+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:40:54.435554+0000","last_undegraded":"2023-03-17T08:40:54.435554+0000","last_fullsized":"2023-03-17T08:40:54.435554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233857+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:40:05.233857+0000","last_peered":"2023-03-17T08:40:05.233857+0000","last_clean":"2023-03-17T08:40:05.233857+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:40:05.233857+0000","last_undegraded":"2023-03-17T08:40:05.233857+0000","last_fullsized":"2023-03-17T08:40:05.233857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.369561+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:40:14.369561+0000","last_peered":"2023-03-17T08:40:14.369561+0000","last_clean":"2023-03-17T08:40:14.369561+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:40:14.369561+0000","last_undegraded":"2023-03-17T08:40:14.369561+0000","last_fullsized":"2023-03-17T08:40:14.369561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:28.377554+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:40:28.377554+0000","last_peered":"2023-03-17T08:40:28.377554+0000","last_clean":"2023-03-17T08:40:28.377554+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:40:28.377554+0000","last_undegraded":"2023-03-17T08:40:28.377554+0000","last_fullsized":"2023-03-17T08:40:28.377554+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.369528+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:40:14.369528+0000","last_peered":"2023-03-17T08:40:14.369528+0000","last_clean":"2023-03-17T08:40:14.369528+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:40:14.369528+0000","last_undegraded":"2023-03-17T08:40:14.369528+0000","last_fullsized":"2023-03-17T08:40:14.369528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.311820+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:40:29.311820+0000","last_peered":"2023-03-17T08:40:29.311820+0000","last_clean":"2023-03-17T08:40:29.311820+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:40:29.311820+0000","last_undegraded":"2023-03-17T08:40:29.311820+0000","last_fullsized":"2023-03-17T08:40:29.311820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'8","reported_seq":1723,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:07.714321+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:43:07.714321+0000","last_peered":"2023-03-17T08:43:07.714321+0000","last_clean":"2023-03-17T08:43:07.714321+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:43:07.714321+0000","last_undegraded":"2023-03-17T08:43:07.714321+0000","last_fullsized":"2023-03-17T08:43:07.714321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1686,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.371351+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:40:29.371351+0000","last_peered":"2023-03-17T08:40:29.371351+0000","last_clean":"2023-03-17T08:40:29.371351+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:40:29.371351+0000","last_undegraded":"2023-03-17T08:40:29.371351+0000","last_fullsized":"2023-03-17T08:40:29.371351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.412275+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:40:14.412275+0000","last_peered":"2023-03-17T08:40:14.412275+0000","last_clean":"2023-03-17T08:40:14.412275+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:40:14.412275+0000","last_undegraded":"2023-03-17T08:40:14.412275+0000","last_fullsized":"2023-03-17T08:40:14.412275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.311793+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:40:29.311793+0000","last_peered":"2023-03-17T08:40:29.311793+0000","last_clean":"2023-03-17T08:40:29.311793+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:40:29.311793+0000","last_undegraded":"2023-03-17T08:40:29.311793+0000","last_fullsized":"2023-03-17T08:40:29.311793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:29.189785+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:39:29.189785+0000","last_peered":"2023-03-17T08:39:29.189785+0000","last_clean":"2023-03-17T08:39:29.189785+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:39:29.189785+0000","last_undegraded":"2023-03-17T08:39:29.189785+0000","last_fullsized":"2023-03-17T08:39:29.189785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.425942+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:39:34.425942+0000","last_peered":"2023-03-17T08:39:34.425942+0000","last_clean":"2023-03-17T08:39:34.425942+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:39:34.425942+0000","last_undegraded":"2023-03-17T08:39:34.425942+0000","last_fullsized":"2023-03-17T08:39:34.425942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:19.304011+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:39:19.304011+0000","last_peered":"2023-03-17T08:39:19.304011+0000","last_clean":"2023-03-17T08:39:19.304011+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:39:19.304011+0000","last_undegraded":"2023-03-17T08:39:19.304011+0000","last_fullsized":"2023-03-17T08:39:19.304011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.686970+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:39:44.686970+0000","last_peered":"2023-03-17T08:39:44.686970+0000","last_clean":"2023-03-17T08:39:44.686970+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:39:44.686970+0000","last_undegraded":"2023-03-17T08:39:44.686970+0000","last_fullsized":"2023-03-17T08:39:44.686970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'8","reported_seq":3398,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:08.507216+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:43:08.507216+0000","last_peered":"2023-03-17T08:43:08.507216+0000","last_clean":"2023-03-17T08:43:08.507216+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:43:08.507216+0000","last_undegraded":"2023-03-17T08:43:08.507216+0000","last_fullsized":"2023-03-17T08:43:08.507216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3361,"num_read_kb":3361,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.371197+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:39:33.371197+0000","last_peered":"2023-03-17T08:39:33.371197+0000","last_clean":"2023-03-17T08:39:33.371197+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:39:33.371197+0000","last_undegraded":"2023-03-17T08:39:33.371197+0000","last_fullsized":"2023-03-17T08:39:33.371197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:18.302494+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:39:18.302494+0000","last_peered":"2023-03-17T08:39:18.302494+0000","last_clean":"2023-03-17T08:39:18.302494+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:39:18.302494+0000","last_undegraded":"2023-03-17T08:39:18.302494+0000","last_fullsized":"2023-03-17T08:39:18.302494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:35.230447+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:39:35.230447+0000","last_peered":"2023-03-17T08:39:35.230447+0000","last_clean":"2023-03-17T08:39:35.230447+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:39:35.230447+0000","last_undegraded":"2023-03-17T08:39:35.230447+0000","last_fullsized":"2023-03-17T08:39:35.230447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:19.304103+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:39:19.304103+0000","last_peered":"2023-03-17T08:39:19.304103+0000","last_clean":"2023-03-17T08:39:19.304103+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:39:19.304103+0000","last_undegraded":"2023-03-17T08:39:19.304103+0000","last_fullsized":"2023-03-17T08:39:19.304103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:48.366174+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:38:48.366174+0000","last_peered":"2023-03-17T08:38:48.366174+0000","last_clean":"2023-03-17T08:38:48.366174+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:38:48.366174+0000","last_undegraded":"2023-03-17T08:38:48.366174+0000","last_fullsized":"2023-03-17T08:38:48.366174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'41","reported_seq":3466,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:08.715324+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:43:08.715324+0000","last_peered":"2023-03-17T08:43:08.715324+0000","last_clean":"2023-03-17T08:43:08.715324+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:43:08.715324+0000","last_undegraded":"2023-03-17T08:43:08.715324+0000","last_fullsized":"2023-03-17T08:43:08.715324+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67869,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3376,"num_read_kb":1754,"num_write":43,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.365178+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:39:34.365178+0000","last_peered":"2023-03-17T08:39:34.365178+0000","last_clean":"2023-03-17T08:39:34.365178+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:39:34.365178+0000","last_undegraded":"2023-03-17T08:39:34.365178+0000","last_fullsized":"2023-03-17T08:39:34.365178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:26.753545+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:39:26.753545+0000","last_peered":"2023-03-17T08:39:26.753545+0000","last_clean":"2023-03-17T08:39:26.753545+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:39:26.753545+0000","last_undegraded":"2023-03-17T08:39:26.753545+0000","last_fullsized":"2023-03-17T08:39:26.753545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:39.184294+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:38:39.184294+0000","last_peered":"2023-03-17T08:38:39.184294+0000","last_clean":"2023-03-17T08:38:39.184294+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:38:39.184294+0000","last_undegraded":"2023-03-17T08:38:39.184294+0000","last_fullsized":"2023-03-17T08:38:39.184294+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:44.313323+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:40:44.313323+0000","last_peered":"2023-03-17T08:40:44.313323+0000","last_clean":"2023-03-17T08:40:44.313323+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:40:44.313323+0000","last_undegraded":"2023-03-17T08:40:44.313323+0000","last_fullsized":"2023-03-17T08:40:44.313323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:38.297577+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:38:38.297577+0000","last_peered":"2023-03-17T08:38:38.297577+0000","last_clean":"2023-03-17T08:38:38.297577+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:38:38.297577+0000","last_undegraded":"2023-03-17T08:38:38.297577+0000","last_fullsized":"2023-03-17T08:38:38.297577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'8","reported_seq":1726,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:09.861306+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:43:09.861306+0000","last_peered":"2023-03-17T08:43:09.861306+0000","last_clean":"2023-03-17T08:43:09.861306+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:43:09.861306+0000","last_undegraded":"2023-03-17T08:43:09.861306+0000","last_fullsized":"2023-03-17T08:43:09.861306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1570,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1689,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:38.297515+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:38:38.297515+0000","last_peered":"2023-03-17T08:38:38.297515+0000","last_clean":"2023-03-17T08:38:38.297515+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:38:38.297515+0000","last_undegraded":"2023-03-17T08:38:38.297515+0000","last_fullsized":"2023-03-17T08:38:38.297515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:44.373130+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:40:44.373130+0000","last_peered":"2023-03-17T08:40:44.373130+0000","last_clean":"2023-03-17T08:40:44.373130+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:40:44.373130+0000","last_undegraded":"2023-03-17T08:40:44.373130+0000","last_fullsized":"2023-03-17T08:40:44.373130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:24.685082+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:39:24.685082+0000","last_peered":"2023-03-17T08:39:24.685082+0000","last_clean":"2023-03-17T08:39:24.685082+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:39:24.685082+0000","last_undegraded":"2023-03-17T08:39:24.685082+0000","last_fullsized":"2023-03-17T08:39:24.685082+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.763614+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:40:56.763614+0000","last_peered":"2023-03-17T08:40:56.763614+0000","last_clean":"2023-03-17T08:40:56.763614+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:40:56.763614+0000","last_undegraded":"2023-03-17T08:40:56.763614+0000","last_fullsized":"2023-03-17T08:40:56.763614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:56.756928+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:39:56.756928+0000","last_peered":"2023-03-17T08:39:56.756928+0000","last_clean":"2023-03-17T08:39:56.756928+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:39:56.756928+0000","last_undegraded":"2023-03-17T08:39:56.756928+0000","last_fullsized":"2023-03-17T08:39:56.756928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:49.687770+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:39:49.687770+0000","last_peered":"2023-03-17T08:39:49.687770+0000","last_clean":"2023-03-17T08:39:49.687770+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:39:49.687770+0000","last_undegraded":"2023-03-17T08:39:49.687770+0000","last_fullsized":"2023-03-17T08:39:49.687770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:09.411844+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:40:09.411844+0000","last_peered":"2023-03-17T08:40:09.411844+0000","last_clean":"2023-03-17T08:40:09.411844+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:40:09.411844+0000","last_undegraded":"2023-03-17T08:40:09.411844+0000","last_fullsized":"2023-03-17T08:40:09.411844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":1719,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:06.856445+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:43:06.856445+0000","last_peered":"2023-03-17T08:43:06.856445+0000","last_clean":"2023-03-17T08:43:06.856445+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:43:06.856445+0000","last_undegraded":"2023-03-17T08:43:06.856445+0000","last_fullsized":"2023-03-17T08:43:06.856445+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1682,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.411151+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:40:04.411151+0000","last_peered":"2023-03-17T08:40:04.411151+0000","last_clean":"2023-03-17T08:40:04.411151+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:40:04.411151+0000","last_undegraded":"2023-03-17T08:40:04.411151+0000","last_fullsized":"2023-03-17T08:40:04.411151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:04.315516+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:41:04.315516+0000","last_peered":"2023-03-17T08:41:04.315516+0000","last_clean":"2023-03-17T08:41:04.315516+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:41:04.315516+0000","last_undegraded":"2023-03-17T08:41:04.315516+0000","last_fullsized":"2023-03-17T08:41:04.315516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'8","reported_seq":1721,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:07.857320+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:43:07.857320+0000","last_peered":"2023-03-17T08:43:07.857320+0000","last_clean":"2023-03-17T08:43:07.857320+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:43:07.857320+0000","last_undegraded":"2023-03-17T08:43:07.857320+0000","last_fullsized":"2023-03-17T08:43:07.857320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1682,"num_read_kb":1682,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.429369+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:40:04.429369+0000","last_peered":"2023-03-17T08:40:04.429369+0000","last_clean":"2023-03-17T08:40:04.429369+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:40:04.429369+0000","last_undegraded":"2023-03-17T08:40:04.429369+0000","last_fullsized":"2023-03-17T08:40:04.429369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:51.157940+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:39:51.157940+0000","last_peered":"2023-03-17T08:39:51.157940+0000","last_clean":"2023-03-17T08:39:51.157940+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:39:51.157940+0000","last_undegraded":"2023-03-17T08:39:51.157940+0000","last_fullsized":"2023-03-17T08:39:51.157940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":358,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.304257+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:39:33.304257+0000","last_peered":"2023-03-17T08:39:33.304257+0000","last_clean":"2023-03-17T08:39:33.304257+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:39:33.304257+0000","last_undegraded":"2023-03-17T08:39:33.304257+0000","last_fullsized":"2023-03-17T08:39:33.304257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.194045+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:40:04.194045+0000","last_peered":"2023-03-17T08:40:04.194045+0000","last_clean":"2023-03-17T08:40:04.194045+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:40:04.194045+0000","last_undegraded":"2023-03-17T08:40:04.194045+0000","last_fullsized":"2023-03-17T08:40:04.194045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:48.313783+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:40:48.313783+0000","last_peered":"2023-03-17T08:40:48.313783+0000","last_clean":"2023-03-17T08:40:48.313783+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:40:48.313783+0000","last_undegraded":"2023-03-17T08:40:48.313783+0000","last_fullsized":"2023-03-17T08:40:48.313783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:54.367572+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:39:54.367572+0000","last_peered":"2023-03-17T08:39:54.367572+0000","last_clean":"2023-03-17T08:39:54.367572+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:39:54.367572+0000","last_undegraded":"2023-03-17T08:39:54.367572+0000","last_fullsized":"2023-03-17T08:39:54.367572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.194176+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:40:04.194176+0000","last_peered":"2023-03-17T08:40:04.194176+0000","last_clean":"2023-03-17T08:40:04.194176+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:40:04.194176+0000","last_undegraded":"2023-03-17T08:40:04.194176+0000","last_fullsized":"2023-03-17T08:40:04.194176+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'16","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.695292+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:40:54.695292+0000","last_peered":"2023-03-17T08:40:54.695292+0000","last_clean":"2023-03-17T08:40:54.695292+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:40:54.695292+0000","last_undegraded":"2023-03-17T08:40:54.695292+0000","last_fullsized":"2023-03-17T08:40:54.695292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:59.422110+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:38:59.422110+0000","last_peered":"2023-03-17T08:38:59.422110+0000","last_clean":"2023-03-17T08:38:59.422110+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:38:59.422110+0000","last_undegraded":"2023-03-17T08:38:59.422110+0000","last_fullsized":"2023-03-17T08:38:59.422110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.164948+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:40:56.164948+0000","last_peered":"2023-03-17T08:40:56.164948+0000","last_clean":"2023-03-17T08:40:56.164948+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:40:56.164948+0000","last_undegraded":"2023-03-17T08:40:56.164948+0000","last_fullsized":"2023-03-17T08:40:56.164948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:00.226205+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:39:00.226205+0000","last_peered":"2023-03-17T08:39:00.226205+0000","last_clean":"2023-03-17T08:39:00.226205+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:39:00.226205+0000","last_undegraded":"2023-03-17T08:39:00.226205+0000","last_fullsized":"2023-03-17T08:39:00.226205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:53.380424+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:40:53.380424+0000","last_peered":"2023-03-17T08:40:53.380424+0000","last_clean":"2023-03-17T08:40:53.380424+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:40:53.380424+0000","last_undegraded":"2023-03-17T08:40:53.380424+0000","last_fullsized":"2023-03-17T08:40:53.380424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:59.361070+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:38:59.361070+0000","last_peered":"2023-03-17T08:38:59.361070+0000","last_clean":"2023-03-17T08:38:59.361070+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:38:59.361070+0000","last_undegraded":"2023-03-17T08:38:59.361070+0000","last_fullsized":"2023-03-17T08:38:59.361070+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.435504+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:40:54.435504+0000","last_peered":"2023-03-17T08:40:54.435504+0000","last_clean":"2023-03-17T08:40:54.435504+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:40:54.435504+0000","last_undegraded":"2023-03-17T08:40:54.435504+0000","last_fullsized":"2023-03-17T08:40:54.435504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:56.750471+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:38:56.750471+0000","last_peered":"2023-03-17T08:38:56.750471+0000","last_clean":"2023-03-17T08:38:56.750471+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:38:56.750471+0000","last_undegraded":"2023-03-17T08:38:56.750471+0000","last_fullsized":"2023-03-17T08:38:56.750471+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.991732+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:40:58.991732+0000","last_peered":"2023-03-17T08:40:58.991732+0000","last_clean":"2023-03-17T08:40:58.991732+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:40:58.991732+0000","last_undegraded":"2023-03-17T08:40:58.991732+0000","last_fullsized":"2023-03-17T08:40:58.991732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.428902+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:39:59.428902+0000","last_peered":"2023-03-17T08:39:59.428902+0000","last_clean":"2023-03-17T08:39:59.428902+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:39:59.428902+0000","last_undegraded":"2023-03-17T08:39:59.428902+0000","last_fullsized":"2023-03-17T08:39:59.428902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:39.365715+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:39:39.365715+0000","last_peered":"2023-03-17T08:39:39.365715+0000","last_clean":"2023-03-17T08:39:39.365715+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:39:39.365715+0000","last_undegraded":"2023-03-17T08:39:39.365715+0000","last_fullsized":"2023-03-17T08:39:39.365715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:03.300558+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:39:03.300558+0000","last_peered":"2023-03-17T08:39:03.300558+0000","last_clean":"2023-03-17T08:39:03.300558+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:39:03.300558+0000","last_undegraded":"2023-03-17T08:39:03.300558+0000","last_fullsized":"2023-03-17T08:39:03.300558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":1719,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:07.506232+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:43:07.506232+0000","last_peered":"2023-03-17T08:43:07.506232+0000","last_clean":"2023-03-17T08:43:07.506232+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:43:07.506232+0000","last_undegraded":"2023-03-17T08:43:07.506232+0000","last_fullsized":"2023-03-17T08:43:07.506232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1621,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1683,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.307459+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:39:58.307459+0000","last_peered":"2023-03-17T08:39:58.307459+0000","last_clean":"2023-03-17T08:39:58.307459+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:39:58.307459+0000","last_undegraded":"2023-03-17T08:39:58.307459+0000","last_fullsized":"2023-03-17T08:39:58.307459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.306762+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:39:44.306762+0000","last_peered":"2023-03-17T08:39:44.306762+0000","last_clean":"2023-03-17T08:39:44.306762+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:39:44.306762+0000","last_undegraded":"2023-03-17T08:39:44.306762+0000","last_fullsized":"2023-03-17T08:39:44.306762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.307434+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:39:58.307434+0000","last_peered":"2023-03-17T08:39:58.307434+0000","last_clean":"2023-03-17T08:39:58.307434+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:39:58.307434+0000","last_undegraded":"2023-03-17T08:39:58.307434+0000","last_fullsized":"2023-03-17T08:39:58.307434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.191515+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:39:44.191515+0000","last_peered":"2023-03-17T08:39:44.191515+0000","last_clean":"2023-03-17T08:39:44.191515+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:39:44.191515+0000","last_undegraded":"2023-03-17T08:39:44.191515+0000","last_fullsized":"2023-03-17T08:39:44.191515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.308036+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:40:03.308036+0000","last_peered":"2023-03-17T08:40:03.308036+0000","last_clean":"2023-03-17T08:40:03.308036+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:40:03.308036+0000","last_undegraded":"2023-03-17T08:40:03.308036+0000","last_fullsized":"2023-03-17T08:40:03.308036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:01.757587+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:40:01.757587+0000","last_peered":"2023-03-17T08:40:01.757587+0000","last_clean":"2023-03-17T08:40:01.757587+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:40:01.757587+0000","last_undegraded":"2023-03-17T08:40:01.757587+0000","last_fullsized":"2023-03-17T08:40:01.757587+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985558+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:40:03.985558+0000","last_peered":"2023-03-17T08:40:03.985558+0000","last_clean":"2023-03-17T08:40:03.985558+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:40:03.985558+0000","last_undegraded":"2023-03-17T08:40:03.985558+0000","last_fullsized":"2023-03-17T08:40:03.985558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985580+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:40:03.985580+0000","last_peered":"2023-03-17T08:40:03.985580+0000","last_clean":"2023-03-17T08:40:03.985580+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:40:03.985580+0000","last_undegraded":"2023-03-17T08:40:03.985580+0000","last_fullsized":"2023-03-17T08:40:03.985580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:10.234444+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:40:10.234444+0000","last_peered":"2023-03-17T08:40:10.234444+0000","last_clean":"2023-03-17T08:40:10.234444+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:40:10.234444+0000","last_undegraded":"2023-03-17T08:40:10.234444+0000","last_fullsized":"2023-03-17T08:40:10.234444+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:59.186459+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:38:59.186459+0000","last_peered":"2023-03-17T08:38:59.186459+0000","last_clean":"2023-03-17T08:38:59.186459+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:38:59.186459+0000","last_undegraded":"2023-03-17T08:38:59.186459+0000","last_fullsized":"2023-03-17T08:38:59.186459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:56.750509+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:38:56.750509+0000","last_peered":"2023-03-17T08:38:56.750509+0000","last_clean":"2023-03-17T08:38:56.750509+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:38:56.750509+0000","last_undegraded":"2023-03-17T08:38:56.750509+0000","last_fullsized":"2023-03-17T08:38:56.750509+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:58.978319+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:38:58.978319+0000","last_peered":"2023-03-17T08:38:58.978319+0000","last_clean":"2023-03-17T08:38:58.978319+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:38:58.978319+0000","last_undegraded":"2023-03-17T08:38:58.978319+0000","last_fullsized":"2023-03-17T08:38:58.978319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:38:59.422078+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:38:59.422078+0000","last_peered":"2023-03-17T08:38:59.422078+0000","last_clean":"2023-03-17T08:38:59.422078+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:38:59.422078+0000","last_undegraded":"2023-03-17T08:38:59.422078+0000","last_fullsized":"2023-03-17T08:38:59.422078+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:04.302332+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:39:04.302332+0000","last_peered":"2023-03-17T08:39:04.302332+0000","last_clean":"2023-03-17T08:39:04.302332+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:39:04.302332+0000","last_undegraded":"2023-03-17T08:39:04.302332+0000","last_fullsized":"2023-03-17T08:39:04.302332+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.428856+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:39:59.428856+0000","last_peered":"2023-03-17T08:39:59.428856+0000","last_clean":"2023-03-17T08:39:59.428856+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:39:59.428856+0000","last_undegraded":"2023-03-17T08:39:59.428856+0000","last_fullsized":"2023-03-17T08:39:59.428856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.373843+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:39:58.373843+0000","last_peered":"2023-03-17T08:39:58.373843+0000","last_clean":"2023-03-17T08:39:58.373843+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:39:58.373843+0000","last_undegraded":"2023-03-17T08:39:58.373843+0000","last_fullsized":"2023-03-17T08:39:58.373843+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.193505+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:39:59.193505+0000","last_peered":"2023-03-17T08:39:59.193505+0000","last_clean":"2023-03-17T08:39:59.193505+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:39:59.193505+0000","last_undegraded":"2023-03-17T08:39:59.193505+0000","last_fullsized":"2023-03-17T08:39:59.193505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:56.756904+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:39:56.756904+0000","last_peered":"2023-03-17T08:39:56.756904+0000","last_clean":"2023-03-17T08:39:56.756904+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:39:56.756904+0000","last_undegraded":"2023-03-17T08:39:56.756904+0000","last_fullsized":"2023-03-17T08:39:56.756904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77157,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":16861,"num_read_kb":8515,"num_write":278,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":231471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":238,"ondisk_log_size":238,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351392,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":1007616,"data_stored":483855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.81000000000000005,"5min":0.878,"15min":0.90500000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.496,"5min":0.46999999999999997,"15min":0.36599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.84899999999999998},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.52000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.92600000000000005,"15min":0.93300000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.77300000000000002,"5min":0.874,"15min":0.93899999999999995},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70199999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.872,"15min":0.872},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Mar 17 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.85399999999999998,"15min":0.98199999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.495,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.95399999999999996},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.90400000000000003,"15min":0.90500000000000003},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.88100000000000001,"5min":0.89800000000000002,"15min":0.91200000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83199999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.74299999999999999}]},{"osd":8,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.92700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.47899999999999998,"5min":0.40200000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.65800000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.626,"5min":0.498,"15min":0.498},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.105},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.64300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80400000000000005}]},{"osd":10,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.55500000000000005},"max":{"1min":1.0149999999999999,"5min":1.0229999999999999,"15min":1.0640000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.65200000000000002,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":0.93899999999999995,"5min":0.96999999999999997,"15min":1.0109999999999999},"last":0.67200000000000004}]}]},{"osd":10,"up_from":73,"seq":313532613033,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7300,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737852,"statfs":{"total":95995035648,"available":95987560448,"internally_reserved":0,"allocated":1699840,"data_stored":1142869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.48399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71299999999999997,"5min":0.83599999999999997,"15min":0.84399999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84099999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.34599999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.76600000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88300000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.33300000000000002},"max":{"1min":0.80300000000000005,"5min":0.82899999999999996,"15min":0.92900000000000005},"last":0.505}]},{"osd":3,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78900000000000003,"5min":0.88800000000000001,"15min":1.0229999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.91800000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.83799999999999997},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.40000000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.0820000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.39600000000000002},"max":{"1min":0.93999999999999995,"5min":1.0069999999999999,"15min":1.2629999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.48299999999999998,"5min":0.42099999999999999,"15min":0.39500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0529999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.73399999999999999},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":1.036},"last":0.748}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72299999999999998,"15min":0.73899999999999999},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.42099999999999999},"max":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72599999999999998}]},{"osd":9,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93500000000000005,"5min":0.98499999999999999,"15min":1.04},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55200000000000005,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":0.95699999999999996,"15min":1.052},"last":0.76900000000000002}]},{"osd":11,"last update":"Fri Mar 17 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.65400000000000003,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":0.98799999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79500000000000004},"min":{"1min":0.65800000000000003,"5min":0.60999999999999999,"15min":0.57599999999999996},"max":{"1min":0.97599999999999998,"5min":1.024,"15min":1.0389999999999999},"last":0.80100000000000005}]}]},{"osd":9,"up_from":68,"seq":292057776564,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.497,"15min":0.47499999999999998},"min":{"1min":0.34499999999999997,"5min":0.28299999999999997,"15min":0.27700000000000002},"max":{"1min":0.64400000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.57699999999999996},"min":{"1min":0.501,"5min":0.35199999999999998,"15min":0.28699999999999998},"max":{"1min":0.79700000000000004,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.42499999999999999,"15min":0.374},"max":{"1min":0.86499999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75600000000000001,"15min":0.71699999999999997},"min":{"1min":0.63500000000000001,"5min":0.46899999999999997,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":1.004,"15min":1.004},"last":0.70799999999999996}]},{"osd":2,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.91700000000000004,"5min":0.92600000000000005,"15min":1.6970000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.747,"15min":0.72299999999999998},"min":{"1min":0.57599999999999996,"5min":0.41999999999999998,"15min":0.41299999999999998},"max":{"1min":1.0289999999999999,"5min":1.085,"15min":1.085},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.40899999999999997,"5min":0.34999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":1.45,"15min":1.45},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.30299999999999999,"15min":0.30199999999999999},"max":{"1min":0.70999999999999996,"5min":1.1359999999999999,"15min":1.476},"last":0.745}]},{"osd":4,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.63800000000000001,"5min":0.497,"15min":0.434},"max":{"1min":0.98399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.505,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":0.98099999999999998,"15min":1.329},"last":0.628}]},{"osd":5,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.40699999999999997},"max":{"1min":1.0009999999999999,"5min":1.0660000000000001,"15min":1.417},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.57699999999999996,"5min":0.46899999999999997,"15min":0.437},"max":{"1min":1.016,"5min":1.016,"15min":1.6739999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.53300000000000003,"5min":0.374,"15min":0.32900000000000001},"max":{"1min":0.86599999999999999,"5min":1.034,"15min":1.5660000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.80100000000000005,"15min":0.77400000000000002},"min":{"1min":0.60199999999999998,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":1.0760000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78500000000000003},"min":{"1min":0.60599999999999998,"5min":0.54500000000000004,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.0529999999999999,"15min":1.391},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.80700000000000005,"15min":0.78300000000000003},"min":{"1min":0.67200000000000004,"5min":0.52800000000000002,"15min":0.434},"max":{"1min":0.96799999999999997,"5min":1.1659999999999999,"15min":1.6000000000000001},"last":0.89300000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.876,"15min":0.84599999999999997},"min":{"1min":0.69799999999999995,"5min":0.47899999999999998,"15min":0.47399999999999998},"max":{"1min":1.1359999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.59899999999999998,"5min":0.48499999999999999,"15min":0.47199999999999998},"max":{"1min":1.0580000000000001,"5min":1.107,"15min":1.4370000000000001},"last":0.92800000000000005}]},{"osd":10,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86599999999999999,"15min":0.84599999999999997},"min":{"1min":0.71599999999999997,"5min":0.54500000000000004,"15min":0.50700000000000001},"max":{"1min":1.111,"5min":1.393,"15min":1.393},"last":0.876},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83699999999999997,"15min":0.82399999999999995},"min":{"1min":0.70899999999999996,"5min":0.59599999999999997,"15min":0.501},"max":{"1min":1.046,"5min":1.1990000000000001,"15min":1.6299999999999999},"last":1.0029999999999999}]}]},{"osd":8,"up_from":60,"seq":257698038206,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6564,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738588,"statfs":{"total":95995035648,"available":95988314112,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.33300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32500000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88800000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.753,"5min":0.874,"15min":0.92000000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63500000000000001,"15min":0.64600000000000002},"min":{"1min":0.51300000000000001,"5min":0.433,"15min":0.38700000000000001},"max":{"1min":0.78800000000000003,"5min":0.84499999999999997,"15min":0.88200000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.39700000000000002,"5min":0.33400000000000002,"15min":0.314},"max":{"1min":0.74399999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.77500000000000002,"5min":0.87,"15min":0.87},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.48799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85899999999999999,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.377},"max":{"1min":0.85499999999999998,"5min":0.89600000000000002,"15min":0.98099999999999998},"last":0.61799999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.42899999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.81599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55000000000000004,"15min":0.56499999999999995},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.88100000000000001,"15min":0.95599999999999996},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.54400000000000004,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":1.018,"15min":1.018},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.59599999999999997,"5min":0.44600000000000001,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":1.593,"15min":1.593},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.57199999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93400000000000005,"5min":1.006,"15min":1.0349999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71999999999999997,"15min":0.73099999999999998},"min":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93600000000000005,"5min":1.026,"15min":1.101},"last":0.67600000000000005}]},{"osd":9,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76700000000000002,"15min":0.77100000000000002},"min":{"1min":0.60999999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":1.0600000000000001,"15min":1.0629999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.68100000000000005,"5min":0.505,"15min":0.49299999999999999},"max":{"1min":0.93700000000000006,"5min":1.0149999999999999,"15min":1.052},"last":0.85799999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75800000000000001,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.441},"max":{"1min":0.97699999999999998,"5min":1.034,"15min":1.0760000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.61299999999999999,"5min":0.52700000000000002,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":1.054,"15min":1.1220000000000001},"last":0.70099999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.753},"min":{"1min":0.61699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91400000000000003,"5min":0.98499999999999999,"15min":1.085},"last":0.72699999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299849,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7216,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737936,"statfs":{"total":95995035648,"available":95987646464,"internally_reserved":0,"allocated":1613824,"data_stored":1078170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.436,"15min":0.43099999999999999},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60799999999999998,"5min":0.746,"15min":0.746},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.39300000000000002,"5min":0.30599999999999999,"15min":0.29899999999999999},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.51900000000000002,"5min":0.45800000000000002,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.71299999999999997}]},{"osd":3,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.622},{"interface":"front","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.40300000000000002},"max":{"1min":0.75800000000000001,"5min":0.88900000000000001,"15min":0.92700000000000005},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.76700000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.78500000000000003},"last":0.495}]},{"osd":5,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.84599999999999997,"5min":0.877,"15min":0.93600000000000005},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":1.0029999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.41399999999999998},"max":{"1min":0.83099999999999996,"5min":0.999,"15min":0.999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71699999999999997,"15min":0.70499999999999996},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.39900000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68000000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.55900000000000005,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.0589999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.57799999999999996,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":1.002},"last":0.89100000000000001}]},{"osd":9,"last update":"Fri Mar 17 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.60499999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97399999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":0.86399999999999999,"5min":0.95099999999999996,"15min":0.95999999999999996},"last":0.79500000000000004}]},{"osd":10,"last update":"Fri Mar 17 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77800000000000002}]},{"osd":11,"last update":"Fri Mar 17 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.65400000000000003,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.034},"last":0.878},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.70899999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0329999999999999,"5min":1.056,"15min":1.056},"last":0.89800000000000002}]}]},{"osd":6,"up_from":47,"seq":201863463381,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":999424,"data_stored":483145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48399999999999999,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":1.478,"15min":1.478},"last":0.442},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.495},"min":{"1min":0.313,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":1.51,"15min":1.51},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.626,"15min":0.623},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":1.546,"15min":1.546},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.501,"15min":0.371},"max":{"1min":0.84399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72899999999999998,"15min":0.69199999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38300000000000001},"max":{"1min":0.86199999999999999,"5min":1.77,"15min":1.77},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71599999999999997,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.62,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.307},"max":{"1min":0.91900000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":0.93999999999999995,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0369999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.748}]},{"osd":5,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.50800000000000001,"5min":0.45500000000000002,"15min":0.40000000000000002},"max":{"1min":0.88400000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.48799999999999999,"15min":0.47799999999999998},"max":{"1min":1.1080000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.877},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.79300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.845,"15min":1.845},"last":0.96799999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.83599999999999997,"15min":0.81000000000000005},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.434},"max":{"1min":1.1259999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83399999999999996,"15min":0.80600000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.51700000000000002},"max":{"1min":1.006,"5min":1.946,"15min":1.946},"last":0.91500000000000004}]},{"osd":9,"last update":"Fri Mar 17 08:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.60499999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.085,"5min":1.994,"15min":1.994},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78300000000000003,"15min":0.76000000000000001},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.38800000000000001},"max":{"1min":1.038,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.94799999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.87,"15min":0.85199999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.54700000000000004},"max":{"1min":1.081,"5min":2.028,"15min":2.028},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89200000000000002,"15min":0.86899999999999999},"min":{"1min":0.629,"5min":0.626,"15min":0.498},"max":{"1min":1.1120000000000001,"5min":2.04,"15min":2.04},"last":1.0189999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575374,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7648,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":93737504,"statfs":{"total":95995035648,"available":95987204096,"internally_reserved":0,"allocated":1073152,"data_stored":552194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.38600000000000001},"max":{"1min":0.81499999999999995,"5min":0.84899999999999998,"15min":0.94299999999999995},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":1.008,"15min":1.022},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.107,"15min":1.107},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.89200000000000002},"last":0.5}]},{"osd":3,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.72599999999999998},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.99399999999999999,"5min":1.024,"15min":1.024},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.53500000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89500000000000002,"5min":0.92400000000000004,"15min":0.92800000000000005},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Mar 17 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.5,"15min":0.503},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.498,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.30399999999999999},"max":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":1.105},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.746},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":1.0089999999999999,"15min":1.04},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.51400000000000001,"15min":0.47699999999999998},"max":{"1min":0.84999999999999998,"5min":0.92400000000000004,"15min":1.038},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.70599999999999996},"min":{"1min":0.54200000000000004,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":1.048,"15min":1.048},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":1.0609999999999999,"15min":1.0920000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52200000000000002,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.96199999999999997,"5min":1.224,"15min":1.224},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.628,"5min":0.52400000000000002,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":1.153,"15min":1.153},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77100000000000002,"15min":0.77200000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46400000000000002},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":1.1200000000000001},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78600000000000003,"15min":0.78300000000000003},"min":{"1min":0.625,"5min":0.432,"15min":0.432},"max":{"1min":0.95399999999999996,"5min":1.042,"15min":1.042},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.71099999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0189999999999999,"5min":1.272,"15min":1.272},"last":0.83599999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.76300000000000001},"min":{"1min":0.60599999999999998,"5min":0.441,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.98599999999999999,"15min":1.1579999999999999},"last":0.62},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78200000000000003,"15min":0.78500000000000003},"min":{"1min":0.61499999999999999,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.93300000000000005,"5min":1.256,"15min":1.256},"last":0.747}]},{"osd":11,"last update":"Fri Mar 17 08:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.88600000000000001,"15min":0.88800000000000001},"min":{"1min":0.64700000000000002,"5min":0.62,"15min":0.61699999999999999},"max":{"1min":1.046,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83999999999999997,"15min":0.84499999999999997},"min":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.57999999999999996},"max":{"1min":0.97599999999999998,"5min":1.044,"15min":1.133},"last":0.70199999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":484478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89500000000000002,"5min":0.92000000000000004,"15min":0.94299999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.95999999999999996},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67700000000000005,"15min":0.67000000000000004},"min":{"1min":0.45600000000000002,"5min":0.44900000000000001,"15min":0.36699999999999999},"max":{"1min":0.80800000000000005,"5min":0.91200000000000003,"15min":1.038},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70399999999999996,"15min":0.67900000000000005},"min":{"1min":0.55900000000000005,"5min":0.42599999999999999,"15min":0.34100000000000003},"max":{"1min":0.90800000000000003,"5min":0.95899999999999996,"15min":1.0089999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54200000000000004,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.28399999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Mar 17 08:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69099999999999995,"15min":0.66700000000000004},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.39500000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72599999999999998,"15min":0.70999999999999996},"min":{"1min":0.57199999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.72099999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.74199999999999999,"15min":0.73299999999999998},"min":{"1min":0.57999999999999996,"5min":0.53300000000000003,"15min":0.372},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.05},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:42:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.67500000000000004},"min":{"1min":0.505,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.42999999999999999,"15min":0.29799999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79100000000000004,"15min":0.79000000000000004},"min":{"1min":0.55400000000000005,"5min":0.54000000000000004,"15min":0.42399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.115},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.81399999999999995,"15min":0.80100000000000005},"min":{"1min":0.623,"5min":0.54000000000000004,"15min":0.435},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.85299999999999998}]},{"osd":9,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.435,"15min":0.35399999999999998},"max":{"1min":1.046,"5min":1.119,"15min":1.119},"last":0.88},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80900000000000005,"15min":0.79900000000000004},"min":{"1min":0.51400000000000001,"5min":0.436,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.129,"15min":1.165},"last":0.83499999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.878,"15min":0.86499999999999999},"min":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.47399999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.2050000000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.48299999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.92000000000000004}]},{"osd":11,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84999999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.45000000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.1739999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.88300000000000001,"15min":0.873},"min":{"1min":0.69399999999999995,"5min":0.64700000000000002,"15min":0.57199999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.94399999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411844,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7452,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737700,"statfs":{"total":95995035648,"available":95987404800,"internally_reserved":0,"allocated":1003520,"data_stored":485186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90300000000000002},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.377},"max":{"1min":0.82699999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.67500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91700000000000004,"5min":0.93100000000000005,"15min":1.0209999999999999},"last":0.71399999999999997}]},{"osd":3,"last update":"Fri Mar 17 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.71499999999999997},"min":{"1min":0.503,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.36299999999999999},"max":{"1min":0.84099999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":0.98099999999999998,"15min":0.998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89100000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69799999999999995,"15min":0.67600000000000005},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.36599999999999999},"max":{"1min":1.0049999999999999,"5min":1.0640000000000001,"15min":1.0700000000000001},"last":0.44},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.66300000000000003,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.40100000000000002,"15min":0.38200000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":1.0029999999999999},"last":0.51100000000000001}]},{"osd":9,"last update":"Fri Mar 17 08:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81200000000000006,"15min":0.80200000000000005},"min":{"1min":0.61899999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.083,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76700000000000002,"15min":0.75800000000000001},"min":{"1min":0.624,"5min":0.47799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0169999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59399999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.52900000000000003},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.083},"last":0.65500000000000003}]},{"osd":11,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83299999999999996,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":1,"5min":1.087,"15min":1.143},"last":0.629},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46500000000000002},"max":{"1min":0.92500000000000004,"5min":0.99099999999999999,"15min":1.046},"last":0.61699999999999999}]}]},{"osd":3,"up_from":26,"seq":111669150196,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6828,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738324,"statfs":{"total":95995035648,"available":95988043776,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.29899999999999999,"5min":0.28399999999999997,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":0.83299999999999996,"15min":0.872},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":0.58899999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71499999999999997,"15min":0.69499999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.42299999999999999},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38600000000000001},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Mar 17 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67500000000000004,"15min":0.66400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":0.94999999999999996,"15min":0.95299999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86599999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.50900000000000001,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.054},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80000000000000004,"15min":0.78300000000000003},"min":{"1min":0.63700000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.0309999999999999,"15min":1.054},"last":0.88800000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.77900000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.0289999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.749},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76200000000000001,"15min":0.71699999999999997},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.33500000000000002},"max":{"1min":1.0600000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.872,"5min":0.88100000000000001,"15min":1.0149999999999999},"last":0.439}]},{"osd":7,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.72099999999999997},"min":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.505},"max":{"1min":0.96499999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.52500000000000002},"max":{"1min":1.073,"5min":1.113,"15min":1.113},"last":0.86799999999999999}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.83599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":0.98199999999999998,"5min":1.129,"15min":1.129},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.85599999999999998,"5min":0.999,"15min":1.0389999999999999},"last":0.54200000000000004}]},{"osd":10,"last update":"Fri Mar 17 08:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.80100000000000005,"15min":0.78600000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.47199999999999998},"max":{"1min":0.97499999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.56399999999999995},"max":{"1min":1.0129999999999999,"5min":1.085,"15min":1.085},"last":0.80400000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88900000000000001,"15min":0.86199999999999999},"min":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.121},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.90100000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.119,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91700000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888557,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6884,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738268,"statfs":{"total":95995035648,"available":95987986432,"internally_reserved":0,"allocated":1077248,"data_stored":551400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.443,"15min":0.438},"min":{"1min":0.31,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.63100000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.72499999999999998,"15min":0.752},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.438,"5min":0.36499999999999999,"15min":0.313},"max":{"1min":0.83299999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.41799999999999998},"max":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.58299999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.97399999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.67300000000000004},"min":{"1min":0.54000000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Mar 17 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65700000000000003,"15min":0.63900000000000001},"min":{"1min":0.46500000000000002,"5min":0.39800000000000002,"15min":0.38900000000000001},"max":{"1min":0.93300000000000005,"5min":1.022,"15min":1.022},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.55300000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85899999999999999,"5min":0.90900000000000003,"15min":0.94999999999999996},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.66400000000000003,"5min":0.50700000000000001,"15min":0.46400000000000002},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.61799999999999999,"5min":0.44700000000000001,"15min":0.40300000000000002},"max":{"1min":0.90400000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.623}]},{"osd":7,"last update":"Fri Mar 17 08:42:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.98599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93400000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.73099999999999998}]},{"osd":8,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.59499999999999997,"5min":0.45400000000000001,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.998,"15min":0.998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.495},"max":{"1min":0.92800000000000005,"5min":0.98899999999999999,"15min":1.0309999999999999},"last":0.68799999999999994}]},{"osd":9,"last update":"Fri Mar 17 08:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82699999999999996,"15min":0.81799999999999995},"min":{"1min":0.59299999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.99099999999999999,"5min":1.056,"15min":1.0820000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80400000000000005,"15min":0.79300000000000004},"min":{"1min":0.63900000000000001,"5min":0.53300000000000003,"15min":0.41799999999999998},"max":{"1min":0.96199999999999997,"5min":1.014,"15min":1.0760000000000001},"last":0.746}]},{"osd":10,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.38400000000000001},"max":{"1min":0.93400000000000005,"5min":0.95299999999999996,"15min":1.056},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71299999999999997}]},{"osd":11,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.74399999999999999,"5min":0.60499999999999998,"15min":0.57399999999999995},"max":{"1min":0.98599999999999999,"5min":1.0389999999999999,"15min":1.048},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.84399999999999997,"15min":0.83199999999999996},"min":{"1min":0.64900000000000002,"5min":0.64700000000000002,"15min":0.56100000000000005},"max":{"1min":1.006,"5min":1.006,"15min":1.107},"last":0.69999999999999996}]}]},{"osd":5,"up_from":39,"seq":167503725026,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":1622016,"data_stored":1076084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.318},"max":{"1min":0.81299999999999994,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33100000000000002},"max":{"1min":0.81399999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.31},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.439,"5min":0.435,"15min":0.36299999999999999},"max":{"1min":0.70199999999999996,"5min":0.91200000000000003,"15min":0.91400000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47899999999999998,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29099999999999998},"max":{"1min":0.60599999999999998,"5min":1.46,"15min":1.46},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47499999999999998,"15min":0.46600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.30099999999999999},"max":{"1min":0.55300000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.45600000000000002,"5min":0.41299999999999998,"15min":0.377},"max":{"1min":0.88400000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.755},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67000000000000004,"15min":0.65900000000000003},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.378},"max":{"1min":0.84399999999999997,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.746}]},{"osd":4,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66700000000000004,"15min":0.66400000000000003},"min":{"1min":0.53200000000000003,"5min":0.47499999999999998,"15min":0.39600000000000002},"max":{"1min":0.83199999999999996,"5min":0.89100000000000001,"15min":0.93000000000000005},"last":0.627},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69399999999999995,"15min":0.68500000000000005},"min":{"1min":0.495,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":0.79600000000000004,"5min":0.995,"15min":0.995},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.67100000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.41499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96799999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.68500000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93400000000000005,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Mar 17 08:42:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73899999999999999,"15min":0.72299999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.90600000000000003,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":0.879,"5min":0.97399999999999998,"15min":1.0740000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.498,"5min":0.41799999999999998,"15min":0.35699999999999998},"max":{"1min":0.91400000000000003,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.80300000000000005}]},{"osd":9,"last update":"Fri Mar 17 08:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76200000000000001,"15min":0.75},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.47399999999999998},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":1.026},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80900000000000005,"15min":0.79200000000000004},"min":{"1min":0.67700000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":0.95999999999999996,"5min":1.663,"15min":1.663},"last":0.82399999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.76600000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.46100000000000002},"max":{"1min":0.95399999999999996,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.79600000000000004,"15min":0.79000000000000004},"min":{"1min":0.64600000000000002,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.008,"5min":1.167,"15min":1.167},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:43:31.651 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-17T08:43:32.596 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:15 smithi035 ceph-mon[92535]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:43:33.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:16 smithi035 ceph-mon[92535]: pgmap v1777: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:33.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:18 smithi035 ceph-mon[92535]: pgmap v1778: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:33.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:20 smithi035 ceph-mon[92535]: pgmap v1779: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:33.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:22 smithi035 ceph-mon[92535]: pgmap v1780: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:24 smithi035 ceph-mon[92535]: pgmap v1781: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:25 smithi035 ceph-mon[92535]: pgmap v1782: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:28 smithi035 ceph-mon[92535]: pgmap v1783: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:28 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:30 smithi035 ceph-mon[92535]: pgmap v1784: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:33.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:34.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:43:34.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:43:34.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:31 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:34.622 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:28 smithi078 ceph-mon[94114]: pgmap v1783: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:35.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:28 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:43:35.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:30 smithi078 ceph-mon[94114]: pgmap v1784: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:35.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:31 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:32 smithi078 ceph-mon[94114]: pgmap v1785: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:28 smithi082 ceph-mon[94281]: pgmap v1783: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:28 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:30 smithi082 ceph-mon[94281]: pgmap v1784: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:37.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:31 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:43:38.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:32 smithi082 ceph-mon[94281]: pgmap v1785: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:38.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:32 smithi035 ceph-mon[92535]: pgmap v1785: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:39.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:34 smithi078 ceph-mon[94114]: pgmap v1786: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:39.362 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:35 smithi078 ceph-mon[94114]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:43:40.580 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:35 smithi078 ceph-mon[94114]: pgmap v1787: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:40.580 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:38 smithi078 ceph-mon[94114]: pgmap v1788: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:40.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:34 smithi082 ceph-mon[94281]: pgmap v1786: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:40.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:35 smithi082 ceph-mon[94281]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:43:40.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:35 smithi082 ceph-mon[94281]: pgmap v1787: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:40.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:38 smithi082 ceph-mon[94281]: pgmap v1788: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:40.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:40 smithi078 ceph-mon[94114]: pgmap v1789: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:40.584 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/4078739259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 msgr2=0x7fd3dc1005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:42.000 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/4078739259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc1005f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009990 tx=0x7fd3d8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/4078739259 shutdown_connections 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/4078739259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 0x7fd3dc108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/4078739259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc1005f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/4078739259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 0x7fd3dc101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/4078739259 >> 172.21.15.35:0/4078739259 conn(0x7fd3dc0fb7e0 msgr2=0x7fd3dc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/4078739259 shutdown_connections 2023-03-17T08:43:42.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.774+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/4078739259 wait complete. 2023-03-17T08:43:43.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 Processor -- start 2023-03-17T08:43:43.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 -- start start 2023-03-17T08:43:43.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:43.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 0x7fd3dc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:43.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 0x7fd3dc19d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc19d940 con 0x7fd3dc1001e0 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc19da80 con 0x7fd3dc1013d0 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e3e5c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc19dc10 con 0x7fd3dc101d60 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e1bf8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e1bf8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41668/0 (socket says 172.21.15.35:41668) 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.775+0000 7fd3e1bf8700 1 -- 172.21.15.35:0/2170932492 learned_addr learned my addr 172.21.15.35:0/2170932492 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e13f7700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 0x7fd3dc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:44.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e23f9700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 0x7fd3dc19d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:48.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e1bf8700 1 -- 172.21.15.35:0/2170932492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 msgr2=0x7fd3dc19d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:48.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e1bf8700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 0x7fd3dc19d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:48.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e1bf8700 1 -- 172.21.15.35:0/2170932492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 msgr2=0x7fd3dc196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:48.100 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e1bf8700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 0x7fd3dc196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e1bf8700 1 -- 172.21.15.35:0/2170932492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80095f0 con 0x7fd3dc1001e0 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e13f7700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 0x7fd3dc196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e23f9700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 0x7fd3dc19d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e1bf8700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc195dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8004730 tx=0x7fd3d8004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d801d070 con 0x7fd3dc1001e0 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3d8004220 con 0x7fd3dc1001e0 2023-03-17T08:43:48.101 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc10ba50 con 0x7fd3dc1001e0 2023-03-17T08:43:48.766 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8005290 con 0x7fd3dc1001e0 2023-03-17T08:43:48.767 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.776+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc10b8c0 con 0x7fd3dc1001e0 2023-03-17T08:43:48.767 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.777+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc19e120 con 0x7fd3dc1001e0 2023-03-17T08:43:51.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.779+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fd3d8004960 con 0x7fd3dc1001e0 2023-03-17T08:43:51.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.780+0000 7fd3d2ffd700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd3c809f4d0 0x7fd3c80a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:43:51.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.780+0000 7fd3e13f7700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd3c809f4d0 0x7fd3c80a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:43:51.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.780+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fd3d80cb7f0 con 0x7fd3dc1001e0 2023-03-17T08:43:51.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.780+0000 7fd3e13f7700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd3c809f4d0 0x7fd3c80a1980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc005fd0 tx=0x7fd3cc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:43:51.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.783+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fd3d8095a10 con 0x7fd3dc1001e0 2023-03-17T08:43:51.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:34 smithi035 ceph-mon[92535]: pgmap v1786: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:51.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.981+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3dc19e6d0 con 0x7fd3c809f4d0 2023-03-17T08:43:51.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.993+0000 7fd3d2ffd700 1 -- 172.21.15.35:0/2170932492 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344604 (secure 0 0 0) 0x7fd3dc19e6d0 con 0x7fd3c809f4d0 2023-03-17T08:43:51.520 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:42 smithi078 ceph-mon[94114]: pgmap v1790: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:53.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:44 smithi078 ceph-mon[94114]: pgmap v1791: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:53.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:45 smithi078 ceph-mon[94114]: pgmap v1792: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:53.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:48 smithi078 ceph-mon[94114]: pgmap v1793: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:53.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:50 smithi078 ceph-mon[94114]: pgmap v1794: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:53.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:40 smithi082 ceph-mon[94281]: pgmap v1789: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:53.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:42 smithi082 ceph-mon[94281]: pgmap v1790: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:53.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:44 smithi082 ceph-mon[94281]: pgmap v1791: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:53.026 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:45 smithi082 ceph-mon[94281]: pgmap v1792: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:43:53.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:48 smithi082 ceph-mon[94281]: pgmap v1793: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:43:53.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:50 smithi082 ceph-mon[94281]: pgmap v1794: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:43:53.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:52 smithi082 ceph-mon[94281]: pgmap v1795: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:53.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:52 smithi078 ceph-mon[94114]: pgmap v1795: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:43:53.557 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:43:54.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.996+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd3c809f4d0 msgr2=0x7fd3c80a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:54.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.996+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd3c809f4d0 0x7fd3c80a1980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc005fd0 tx=0x7fd3cc005e30 comp rx=0 tx=0).stop 2023-03-17T08:43:54.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.996+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 msgr2=0x7fd3dc195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:43:54.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.996+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc195dc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8004730 tx=0x7fd3d8004760 comp rx=0 tx=0).stop 2023-03-17T08:43:54.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 shutdown_connections 2023-03-17T08:43:56.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101d60 0x7fd3dc19d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:56.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fd3c809f4d0 0x7fd3c80a1980 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:56.708 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3dc1001e0 0x7fd3dc195dc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:57.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 --2- 172.21.15.35:0/2170932492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3dc1013d0 0x7fd3dc196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:43:57.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 >> 172.21.15.35:0/2170932492 conn(0x7fd3dc0fb7e0 msgr2=0x7fd3dc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:43:59.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 shutdown_connections 2023-03-17T08:43:59.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:43:34.997+0000 7fd3e3e5c700 1 -- 172.21.15.35:0/2170932492 wait complete. 2023-03-17T08:43:59.045 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:43:59.045 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":1786,"stamp":"2023-03-17T08:43:33.113472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667771,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":17197,"num_read_kb":8734,"num_write":461,"num_write_kb":3108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":877,"ondisk_log_size":877,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":83820,"kb_used_data":13836,"kb_used_omap":0,"kb_used_meta":69888,"kb_avail":1124858004,"statfs":{"total":1151940427776,"available":1151854596096,"internally_reserved":0,"allocated":14168064,"data_stored":7787023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71565312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003837"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:01.757678+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:40:01.757678+0000","last_peered":"2023-03-17T08:40:01.757678+0000","last_clean":"2023-03-17T08:40:01.757678+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:40:01.757678+0000","last_undegraded":"2023-03-17T08:40:01.757678+0000","last_fullsized":"2023-03-17T08:40:01.757678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233812+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:40:05.233812+0000","last_peered":"2023-03-17T08:40:05.233812+0000","last_clean":"2023-03-17T08:40:05.233812+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:40:05.233812+0000","last_undegraded":"2023-03-17T08:40:05.233812+0000","last_fullsized":"2023-03-17T08:40:05.233812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233769+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:40:05.233769+0000","last_peered":"2023-03-17T08:40:05.233769+0000","last_clean":"2023-03-17T08:40:05.233769+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:40:05.233769+0000","last_undegraded":"2023-03-17T08:40:05.233769+0000","last_fullsized":"2023-03-17T08:40:05.233769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:01.165523+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:41:01.165523+0000","last_peered":"2023-03-17T08:41:01.165523+0000","last_clean":"2023-03-17T08:41:01.165523+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:41:01.165523+0000","last_undegraded":"2023-03-17T08:41:01.165523+0000","last_fullsized":"2023-03-17T08:41:01.165523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.371373+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:40:29.371373+0000","last_peered":"2023-03-17T08:40:29.371373+0000","last_clean":"2023-03-17T08:40:29.371373+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:40:29.371373+0000","last_undegraded":"2023-03-17T08:40:29.371373+0000","last_fullsized":"2023-03-17T08:40:29.371373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.413928+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:40:29.413928+0000","last_peered":"2023-03-17T08:40:29.413928+0000","last_clean":"2023-03-17T08:40:29.413928+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:40:29.413928+0000","last_undegraded":"2023-03-17T08:40:29.413928+0000","last_fullsized":"2023-03-17T08:40:29.413928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:28.311581+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:40:28.311581+0000","last_peered":"2023-03-17T08:40:28.311581+0000","last_clean":"2023-03-17T08:40:28.311581+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:40:28.311581+0000","last_undegraded":"2023-03-17T08:40:28.311581+0000","last_fullsized":"2023-03-17T08:40:28.311581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.432368+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:40:29.432368+0000","last_peered":"2023-03-17T08:40:29.432368+0000","last_clean":"2023-03-17T08:40:29.432368+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:40:29.432368+0000","last_undegraded":"2023-03-17T08:40:29.432368+0000","last_fullsized":"2023-03-17T08:40:29.432368+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:43.372194+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:39:43.372194+0000","last_peered":"2023-03-17T08:39:43.372194+0000","last_clean":"2023-03-17T08:39:43.372194+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:39:43.372194+0000","last_undegraded":"2023-03-17T08:39:43.372194+0000","last_fullsized":"2023-03-17T08:39:43.372194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.407892+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:39:34.407892+0000","last_peered":"2023-03-17T08:39:34.407892+0000","last_clean":"2023-03-17T08:39:34.407892+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:39:34.407892+0000","last_undegraded":"2023-03-17T08:39:34.407892+0000","last_fullsized":"2023-03-17T08:39:34.407892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.304324+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:39:33.304324+0000","last_peered":"2023-03-17T08:39:33.304324+0000","last_clean":"2023-03-17T08:39:33.304324+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:39:33.304324+0000","last_undegraded":"2023-03-17T08:39:33.304324+0000","last_fullsized":"2023-03-17T08:39:33.304324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:19.691171+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:40:19.691171+0000","last_peered":"2023-03-17T08:40:19.691171+0000","last_clean":"2023-03-17T08:40:19.691171+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:40:19.691171+0000","last_undegraded":"2023-03-17T08:40:19.691171+0000","last_fullsized":"2023-03-17T08:40:19.691171+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.190314+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:39:34.190314+0000","last_peered":"2023-03-17T08:39:34.190314+0000","last_clean":"2023-03-17T08:39:34.190314+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:39:34.190314+0000","last_undegraded":"2023-03-17T08:39:34.190314+0000","last_fullsized":"2023-03-17T08:39:34.190314+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:05.240719+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:41:05.240719+0000","last_peered":"2023-03-17T08:41:05.240719+0000","last_clean":"2023-03-17T08:41:05.240719+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:41:05.240719+0000","last_undegraded":"2023-03-17T08:41:05.240719+0000","last_fullsized":"2023-03-17T08:41:05.240719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:00.240149+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:41:00.240149+0000","last_peered":"2023-03-17T08:41:00.240149+0000","last_clean":"2023-03-17T08:41:00.240149+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:41:00.240149+0000","last_undegraded":"2023-03-17T08:41:00.240149+0000","last_fullsized":"2023-03-17T08:41:00.240149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.380975+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:40:58.380975+0000","last_peered":"2023-03-17T08:40:58.380975+0000","last_clean":"2023-03-17T08:40:58.380975+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:40:58.380975+0000","last_undegraded":"2023-03-17T08:40:58.380975+0000","last_fullsized":"2023-03-17T08:40:58.380975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.763632+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:40:56.763632+0000","last_peered":"2023-03-17T08:40:56.763632+0000","last_clean":"2023-03-17T08:40:56.763632+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:40:56.763632+0000","last_undegraded":"2023-03-17T08:40:56.763632+0000","last_fullsized":"2023-03-17T08:40:56.763632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:59.695751+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:40:59.695751+0000","last_peered":"2023-03-17T08:40:59.695751+0000","last_clean":"2023-03-17T08:40:59.695751+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:40:59.695751+0000","last_undegraded":"2023-03-17T08:40:59.695751+0000","last_fullsized":"2023-03-17T08:40:59.695751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985610+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:40:03.985610+0000","last_peered":"2023-03-17T08:40:03.985610+0000","last_clean":"2023-03-17T08:40:03.985610+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:40:03.985610+0000","last_undegraded":"2023-03-17T08:40:03.985610+0000","last_fullsized":"2023-03-17T08:40:03.985610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":1747,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:27.888293+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:43:27.888293+0000","last_peered":"2023-03-17T08:43:27.888293+0000","last_clean":"2023-03-17T08:43:27.888293+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:43:27.888293+0000","last_undegraded":"2023-03-17T08:43:27.888293+0000","last_fullsized":"2023-03-17T08:43:27.888293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1702,"num_read_kb":1702,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437251+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:41:09.437251+0000","last_peered":"2023-03-17T08:41:09.437251+0000","last_clean":"2023-03-17T08:41:09.437251+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:41:09.437251+0000","last_undegraded":"2023-03-17T08:41:09.437251+0000","last_fullsized":"2023-03-17T08:41:09.437251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.435554+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:40:54.435554+0000","last_peered":"2023-03-17T08:40:54.435554+0000","last_clean":"2023-03-17T08:40:54.435554+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:40:54.435554+0000","last_undegraded":"2023-03-17T08:40:54.435554+0000","last_fullsized":"2023-03-17T08:40:54.435554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233857+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:40:05.233857+0000","last_peered":"2023-03-17T08:40:05.233857+0000","last_clean":"2023-03-17T08:40:05.233857+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:40:05.233857+0000","last_undegraded":"2023-03-17T08:40:05.233857+0000","last_fullsized":"2023-03-17T08:40:05.233857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.369561+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:40:14.369561+0000","last_peered":"2023-03-17T08:40:14.369561+0000","last_clean":"2023-03-17T08:40:14.369561+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:40:14.369561+0000","last_undegraded":"2023-03-17T08:40:14.369561+0000","last_fullsized":"2023-03-17T08:40:14.369561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:28.377554+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:40:28.377554+0000","last_peered":"2023-03-17T08:40:28.377554+0000","last_clean":"2023-03-17T08:40:28.377554+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:40:28.377554+0000","last_undegraded":"2023-03-17T08:40:28.377554+0000","last_fullsized":"2023-03-17T08:40:28.377554+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.369528+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:40:14.369528+0000","last_peered":"2023-03-17T08:40:14.369528+0000","last_clean":"2023-03-17T08:40:14.369528+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:40:14.369528+0000","last_undegraded":"2023-03-17T08:40:14.369528+0000","last_fullsized":"2023-03-17T08:40:14.369528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.311820+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:40:29.311820+0000","last_peered":"2023-03-17T08:40:29.311820+0000","last_clean":"2023-03-17T08:40:29.311820+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:40:29.311820+0000","last_undegraded":"2023-03-17T08:40:29.311820+0000","last_fullsized":"2023-03-17T08:40:29.311820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'8","reported_seq":1743,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:27.741190+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:43:27.741190+0000","last_peered":"2023-03-17T08:43:27.741190+0000","last_clean":"2023-03-17T08:43:27.741190+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:43:27.741190+0000","last_undegraded":"2023-03-17T08:43:27.741190+0000","last_fullsized":"2023-03-17T08:43:27.741190+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1706,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.371351+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:40:29.371351+0000","last_peered":"2023-03-17T08:40:29.371351+0000","last_clean":"2023-03-17T08:40:29.371351+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:40:29.371351+0000","last_undegraded":"2023-03-17T08:40:29.371351+0000","last_fullsized":"2023-03-17T08:40:29.371351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.412275+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:40:14.412275+0000","last_peered":"2023-03-17T08:40:14.412275+0000","last_clean":"2023-03-17T08:40:14.412275+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:40:14.412275+0000","last_undegraded":"2023-03-17T08:40:14.412275+0000","last_fullsized":"2023-03-17T08:40:14.412275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.311793+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:40:29.311793+0000","last_peered":"2023-03-17T08:40:29.311793+0000","last_clean":"2023-03-17T08:40:29.311793+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:40:29.311793+0000","last_undegraded":"2023-03-17T08:40:29.311793+0000","last_fullsized":"2023-03-17T08:40:29.311793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:29.189785+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:39:29.189785+0000","last_peered":"2023-03-17T08:39:29.189785+0000","last_clean":"2023-03-17T08:39:29.189785+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:39:29.189785+0000","last_undegraded":"2023-03-17T08:39:29.189785+0000","last_fullsized":"2023-03-17T08:39:29.189785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.425942+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:39:34.425942+0000","last_peered":"2023-03-17T08:39:34.425942+0000","last_clean":"2023-03-17T08:39:34.425942+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:39:34.425942+0000","last_undegraded":"2023-03-17T08:39:34.425942+0000","last_fullsized":"2023-03-17T08:39:34.425942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:19.304011+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:39:19.304011+0000","last_peered":"2023-03-17T08:39:19.304011+0000","last_clean":"2023-03-17T08:39:19.304011+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:39:19.304011+0000","last_undegraded":"2023-03-17T08:39:19.304011+0000","last_fullsized":"2023-03-17T08:39:19.304011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.686970+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:39:44.686970+0000","last_peered":"2023-03-17T08:39:44.686970+0000","last_clean":"2023-03-17T08:39:44.686970+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:39:44.686970+0000","last_undegraded":"2023-03-17T08:39:44.686970+0000","last_fullsized":"2023-03-17T08:39:44.686970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'8","reported_seq":3438,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:28.546014+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:43:28.546014+0000","last_peered":"2023-03-17T08:43:28.546014+0000","last_clean":"2023-03-17T08:43:28.546014+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:43:28.546014+0000","last_undegraded":"2023-03-17T08:43:28.546014+0000","last_fullsized":"2023-03-17T08:43:28.546014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3401,"num_read_kb":3401,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.371197+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:39:33.371197+0000","last_peered":"2023-03-17T08:39:33.371197+0000","last_clean":"2023-03-17T08:39:33.371197+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:39:33.371197+0000","last_undegraded":"2023-03-17T08:39:33.371197+0000","last_fullsized":"2023-03-17T08:39:33.371197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:18.302494+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:39:18.302494+0000","last_peered":"2023-03-17T08:39:18.302494+0000","last_clean":"2023-03-17T08:39:18.302494+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:39:18.302494+0000","last_undegraded":"2023-03-17T08:39:18.302494+0000","last_fullsized":"2023-03-17T08:39:18.302494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:35.230447+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:39:35.230447+0000","last_peered":"2023-03-17T08:39:35.230447+0000","last_clean":"2023-03-17T08:39:35.230447+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:39:35.230447+0000","last_undegraded":"2023-03-17T08:39:35.230447+0000","last_fullsized":"2023-03-17T08:39:35.230447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:19.304103+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:39:19.304103+0000","last_peered":"2023-03-17T08:39:19.304103+0000","last_clean":"2023-03-17T08:39:19.304103+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:39:19.304103+0000","last_undegraded":"2023-03-17T08:39:19.304103+0000","last_fullsized":"2023-03-17T08:39:19.304103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:08.382224+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:41:08.382224+0000","last_peered":"2023-03-17T08:41:08.382224+0000","last_clean":"2023-03-17T08:41:08.382224+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:41:08.382224+0000","last_undegraded":"2023-03-17T08:41:08.382224+0000","last_fullsized":"2023-03-17T08:41:08.382224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'41","reported_seq":3506,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:28.741389+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:43:28.741389+0000","last_peered":"2023-03-17T08:43:28.741389+0000","last_clean":"2023-03-17T08:43:28.741389+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:43:28.741389+0000","last_undegraded":"2023-03-17T08:43:28.741389+0000","last_fullsized":"2023-03-17T08:43:28.741389+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67869,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3416,"num_read_kb":1774,"num_write":43,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.365178+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:39:34.365178+0000","last_peered":"2023-03-17T08:39:34.365178+0000","last_clean":"2023-03-17T08:39:34.365178+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:39:34.365178+0000","last_undegraded":"2023-03-17T08:39:34.365178+0000","last_fullsized":"2023-03-17T08:39:34.365178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:26.753545+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:39:26.753545+0000","last_peered":"2023-03-17T08:39:26.753545+0000","last_clean":"2023-03-17T08:39:26.753545+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:39:26.753545+0000","last_undegraded":"2023-03-17T08:39:26.753545+0000","last_fullsized":"2023-03-17T08:39:26.753545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:59.200304+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:40:59.200304+0000","last_peered":"2023-03-17T08:40:59.200304+0000","last_clean":"2023-03-17T08:40:59.200304+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:40:59.200304+0000","last_undegraded":"2023-03-17T08:40:59.200304+0000","last_fullsized":"2023-03-17T08:40:59.200304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:44.313323+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:40:44.313323+0000","last_peered":"2023-03-17T08:40:44.313323+0000","last_clean":"2023-03-17T08:40:44.313323+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:40:44.313323+0000","last_undegraded":"2023-03-17T08:40:44.313323+0000","last_fullsized":"2023-03-17T08:40:44.313323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.314906+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:40:58.314906+0000","last_peered":"2023-03-17T08:40:58.314906+0000","last_clean":"2023-03-17T08:40:58.314906+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:40:58.314906+0000","last_undegraded":"2023-03-17T08:40:58.314906+0000","last_fullsized":"2023-03-17T08:40:58.314906+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'8","reported_seq":1746,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:29.891363+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:43:29.891363+0000","last_peered":"2023-03-17T08:43:29.891363+0000","last_clean":"2023-03-17T08:43:29.891363+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:43:29.891363+0000","last_undegraded":"2023-03-17T08:43:29.891363+0000","last_fullsized":"2023-03-17T08:43:29.891363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1570,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1709,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.314848+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:40:58.314848+0000","last_peered":"2023-03-17T08:40:58.314848+0000","last_clean":"2023-03-17T08:40:58.314848+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:40:58.314848+0000","last_undegraded":"2023-03-17T08:40:58.314848+0000","last_fullsized":"2023-03-17T08:40:58.314848+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:44.373130+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:40:44.373130+0000","last_peered":"2023-03-17T08:40:44.373130+0000","last_clean":"2023-03-17T08:40:44.373130+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:40:44.373130+0000","last_undegraded":"2023-03-17T08:40:44.373130+0000","last_fullsized":"2023-03-17T08:40:44.373130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:24.685082+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:39:24.685082+0000","last_peered":"2023-03-17T08:39:24.685082+0000","last_clean":"2023-03-17T08:39:24.685082+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:39:24.685082+0000","last_undegraded":"2023-03-17T08:39:24.685082+0000","last_fullsized":"2023-03-17T08:39:24.685082+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.763614+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:40:56.763614+0000","last_peered":"2023-03-17T08:40:56.763614+0000","last_clean":"2023-03-17T08:40:56.763614+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:40:56.763614+0000","last_undegraded":"2023-03-17T08:40:56.763614+0000","last_fullsized":"2023-03-17T08:40:56.763614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:56.756928+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:39:56.756928+0000","last_peered":"2023-03-17T08:39:56.756928+0000","last_clean":"2023-03-17T08:39:56.756928+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:39:56.756928+0000","last_undegraded":"2023-03-17T08:39:56.756928+0000","last_fullsized":"2023-03-17T08:39:56.756928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:49.687770+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:39:49.687770+0000","last_peered":"2023-03-17T08:39:49.687770+0000","last_clean":"2023-03-17T08:39:49.687770+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:39:49.687770+0000","last_undegraded":"2023-03-17T08:39:49.687770+0000","last_fullsized":"2023-03-17T08:39:49.687770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:09.411844+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:40:09.411844+0000","last_peered":"2023-03-17T08:40:09.411844+0000","last_clean":"2023-03-17T08:40:09.411844+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:40:09.411844+0000","last_undegraded":"2023-03-17T08:40:09.411844+0000","last_fullsized":"2023-03-17T08:40:09.411844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":1739,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:26.887330+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:43:26.887330+0000","last_peered":"2023-03-17T08:43:26.887330+0000","last_clean":"2023-03-17T08:43:26.887330+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:43:26.887330+0000","last_undegraded":"2023-03-17T08:43:26.887330+0000","last_fullsized":"2023-03-17T08:43:26.887330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1702,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.411151+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:40:04.411151+0000","last_peered":"2023-03-17T08:40:04.411151+0000","last_clean":"2023-03-17T08:40:04.411151+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:40:04.411151+0000","last_undegraded":"2023-03-17T08:40:04.411151+0000","last_fullsized":"2023-03-17T08:40:04.411151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:04.315516+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:41:04.315516+0000","last_peered":"2023-03-17T08:41:04.315516+0000","last_clean":"2023-03-17T08:41:04.315516+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:41:04.315516+0000","last_undegraded":"2023-03-17T08:41:04.315516+0000","last_fullsized":"2023-03-17T08:41:04.315516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'8","reported_seq":1741,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:27.888293+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:43:27.888293+0000","last_peered":"2023-03-17T08:43:27.888293+0000","last_clean":"2023-03-17T08:43:27.888293+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:43:27.888293+0000","last_undegraded":"2023-03-17T08:43:27.888293+0000","last_fullsized":"2023-03-17T08:43:27.888293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1702,"num_read_kb":1702,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.429369+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:40:04.429369+0000","last_peered":"2023-03-17T08:40:04.429369+0000","last_clean":"2023-03-17T08:40:04.429369+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:40:04.429369+0000","last_undegraded":"2023-03-17T08:40:04.429369+0000","last_fullsized":"2023-03-17T08:40:04.429369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:51.157940+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:39:51.157940+0000","last_peered":"2023-03-17T08:39:51.157940+0000","last_clean":"2023-03-17T08:39:51.157940+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:39:51.157940+0000","last_undegraded":"2023-03-17T08:39:51.157940+0000","last_fullsized":"2023-03-17T08:39:51.157940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":358,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.304257+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:39:33.304257+0000","last_peered":"2023-03-17T08:39:33.304257+0000","last_clean":"2023-03-17T08:39:33.304257+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:39:33.304257+0000","last_undegraded":"2023-03-17T08:39:33.304257+0000","last_fullsized":"2023-03-17T08:39:33.304257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.194045+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:40:04.194045+0000","last_peered":"2023-03-17T08:40:04.194045+0000","last_clean":"2023-03-17T08:40:04.194045+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:40:04.194045+0000","last_undegraded":"2023-03-17T08:40:04.194045+0000","last_fullsized":"2023-03-17T08:40:04.194045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:48.313783+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:40:48.313783+0000","last_peered":"2023-03-17T08:40:48.313783+0000","last_clean":"2023-03-17T08:40:48.313783+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:40:48.313783+0000","last_undegraded":"2023-03-17T08:40:48.313783+0000","last_fullsized":"2023-03-17T08:40:48.313783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:54.367572+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:39:54.367572+0000","last_peered":"2023-03-17T08:39:54.367572+0000","last_clean":"2023-03-17T08:39:54.367572+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:39:54.367572+0000","last_undegraded":"2023-03-17T08:39:54.367572+0000","last_fullsized":"2023-03-17T08:39:54.367572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.194176+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:40:04.194176+0000","last_peered":"2023-03-17T08:40:04.194176+0000","last_clean":"2023-03-17T08:40:04.194176+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:40:04.194176+0000","last_undegraded":"2023-03-17T08:40:04.194176+0000","last_fullsized":"2023-03-17T08:40:04.194176+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'16","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.695292+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:40:54.695292+0000","last_peered":"2023-03-17T08:40:54.695292+0000","last_clean":"2023-03-17T08:40:54.695292+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:40:54.695292+0000","last_undegraded":"2023-03-17T08:40:54.695292+0000","last_fullsized":"2023-03-17T08:40:54.695292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437295+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:41:09.437295+0000","last_peered":"2023-03-17T08:41:09.437295+0000","last_clean":"2023-03-17T08:41:09.437295+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:41:09.437295+0000","last_undegraded":"2023-03-17T08:41:09.437295+0000","last_fullsized":"2023-03-17T08:41:09.437295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.164948+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:40:56.164948+0000","last_peered":"2023-03-17T08:40:56.164948+0000","last_clean":"2023-03-17T08:40:56.164948+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:40:56.164948+0000","last_undegraded":"2023-03-17T08:40:56.164948+0000","last_fullsized":"2023-03-17T08:40:56.164948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:10.241458+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:41:10.241458+0000","last_peered":"2023-03-17T08:41:10.241458+0000","last_clean":"2023-03-17T08:41:10.241458+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:41:10.241458+0000","last_undegraded":"2023-03-17T08:41:10.241458+0000","last_fullsized":"2023-03-17T08:41:10.241458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:53.380424+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:40:53.380424+0000","last_peered":"2023-03-17T08:40:53.380424+0000","last_clean":"2023-03-17T08:40:53.380424+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:40:53.380424+0000","last_undegraded":"2023-03-17T08:40:53.380424+0000","last_fullsized":"2023-03-17T08:40:53.380424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.375665+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:41:09.375665+0000","last_peered":"2023-03-17T08:41:09.375665+0000","last_clean":"2023-03-17T08:41:09.375665+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:41:09.375665+0000","last_undegraded":"2023-03-17T08:41:09.375665+0000","last_fullsized":"2023-03-17T08:41:09.375665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.435504+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:40:54.435504+0000","last_peered":"2023-03-17T08:40:54.435504+0000","last_clean":"2023-03-17T08:40:54.435504+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:40:54.435504+0000","last_undegraded":"2023-03-17T08:40:54.435504+0000","last_fullsized":"2023-03-17T08:40:54.435504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:06.764605+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:41:06.764605+0000","last_peered":"2023-03-17T08:41:06.764605+0000","last_clean":"2023-03-17T08:41:06.764605+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:41:06.764605+0000","last_undegraded":"2023-03-17T08:41:06.764605+0000","last_fullsized":"2023-03-17T08:41:06.764605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.991732+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:40:58.991732+0000","last_peered":"2023-03-17T08:40:58.991732+0000","last_clean":"2023-03-17T08:40:58.991732+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:40:58.991732+0000","last_undegraded":"2023-03-17T08:40:58.991732+0000","last_fullsized":"2023-03-17T08:40:58.991732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.428902+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:39:59.428902+0000","last_peered":"2023-03-17T08:39:59.428902+0000","last_clean":"2023-03-17T08:39:59.428902+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:39:59.428902+0000","last_undegraded":"2023-03-17T08:39:59.428902+0000","last_fullsized":"2023-03-17T08:39:59.428902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:39.365715+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:39:39.365715+0000","last_peered":"2023-03-17T08:39:39.365715+0000","last_clean":"2023-03-17T08:39:39.365715+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:39:39.365715+0000","last_undegraded":"2023-03-17T08:39:39.365715+0000","last_fullsized":"2023-03-17T08:39:39.365715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:13.316741+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:41:13.316741+0000","last_peered":"2023-03-17T08:41:13.316741+0000","last_clean":"2023-03-17T08:41:13.316741+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:41:13.316741+0000","last_undegraded":"2023-03-17T08:41:13.316741+0000","last_fullsized":"2023-03-17T08:41:13.316741+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":1739,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:43:27.544937+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:43:27.544937+0000","last_peered":"2023-03-17T08:43:27.544937+0000","last_clean":"2023-03-17T08:43:27.544937+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:43:27.544937+0000","last_undegraded":"2023-03-17T08:43:27.544937+0000","last_fullsized":"2023-03-17T08:43:27.544937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1621,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1703,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.307459+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:39:58.307459+0000","last_peered":"2023-03-17T08:39:58.307459+0000","last_clean":"2023-03-17T08:39:58.307459+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:39:58.307459+0000","last_undegraded":"2023-03-17T08:39:58.307459+0000","last_fullsized":"2023-03-17T08:39:58.307459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.306762+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:39:44.306762+0000","last_peered":"2023-03-17T08:39:44.306762+0000","last_clean":"2023-03-17T08:39:44.306762+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:39:44.306762+0000","last_undegraded":"2023-03-17T08:39:44.306762+0000","last_fullsized":"2023-03-17T08:39:44.306762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.307434+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:39:58.307434+0000","last_peered":"2023-03-17T08:39:58.307434+0000","last_clean":"2023-03-17T08:39:58.307434+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:39:58.307434+0000","last_undegraded":"2023-03-17T08:39:58.307434+0000","last_fullsized":"2023-03-17T08:39:58.307434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.191515+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:39:44.191515+0000","last_peered":"2023-03-17T08:39:44.191515+0000","last_clean":"2023-03-17T08:39:44.191515+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:39:44.191515+0000","last_undegraded":"2023-03-17T08:39:44.191515+0000","last_fullsized":"2023-03-17T08:39:44.191515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.308036+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:40:03.308036+0000","last_peered":"2023-03-17T08:40:03.308036+0000","last_clean":"2023-03-17T08:40:03.308036+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:40:03.308036+0000","last_undegraded":"2023-03-17T08:40:03.308036+0000","last_fullsized":"2023-03-17T08:40:03.308036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:01.757587+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:40:01.757587+0000","last_peered":"2023-03-17T08:40:01.757587+0000","last_clean":"2023-03-17T08:40:01.757587+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:40:01.757587+0000","last_undegraded":"2023-03-17T08:40:01.757587+0000","last_fullsized":"2023-03-17T08:40:01.757587+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985558+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:40:03.985558+0000","last_peered":"2023-03-17T08:40:03.985558+0000","last_clean":"2023-03-17T08:40:03.985558+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:40:03.985558+0000","last_undegraded":"2023-03-17T08:40:03.985558+0000","last_fullsized":"2023-03-17T08:40:03.985558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985580+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:40:03.985580+0000","last_peered":"2023-03-17T08:40:03.985580+0000","last_clean":"2023-03-17T08:40:03.985580+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:40:03.985580+0000","last_undegraded":"2023-03-17T08:40:03.985580+0000","last_fullsized":"2023-03-17T08:40:03.985580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:10.234444+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:40:10.234444+0000","last_peered":"2023-03-17T08:40:10.234444+0000","last_clean":"2023-03-17T08:40:10.234444+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:40:10.234444+0000","last_undegraded":"2023-03-17T08:40:10.234444+0000","last_fullsized":"2023-03-17T08:40:10.234444+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.201598+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:41:09.201598+0000","last_peered":"2023-03-17T08:41:09.201598+0000","last_clean":"2023-03-17T08:41:09.201598+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:41:09.201598+0000","last_undegraded":"2023-03-17T08:41:09.201598+0000","last_fullsized":"2023-03-17T08:41:09.201598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:06.764665+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:41:06.764665+0000","last_peered":"2023-03-17T08:41:06.764665+0000","last_clean":"2023-03-17T08:41:06.764665+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:41:06.764665+0000","last_undegraded":"2023-03-17T08:41:06.764665+0000","last_fullsized":"2023-03-17T08:41:06.764665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:08.992970+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:41:08.992970+0000","last_peered":"2023-03-17T08:41:08.992970+0000","last_clean":"2023-03-17T08:41:08.992970+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:41:08.992970+0000","last_undegraded":"2023-03-17T08:41:08.992970+0000","last_fullsized":"2023-03-17T08:41:08.992970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437279+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:41:09.437279+0000","last_peered":"2023-03-17T08:41:09.437279+0000","last_clean":"2023-03-17T08:41:09.437279+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:41:09.437279+0000","last_undegraded":"2023-03-17T08:41:09.437279+0000","last_fullsized":"2023-03-17T08:41:09.437279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:14.316748+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:41:14.316748+0000","last_peered":"2023-03-17T08:41:14.316748+0000","last_clean":"2023-03-17T08:41:14.316748+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:41:14.316748+0000","last_undegraded":"2023-03-17T08:41:14.316748+0000","last_fullsized":"2023-03-17T08:41:14.316748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.428856+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:39:59.428856+0000","last_peered":"2023-03-17T08:39:59.428856+0000","last_clean":"2023-03-17T08:39:59.428856+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:39:59.428856+0000","last_undegraded":"2023-03-17T08:39:59.428856+0000","last_fullsized":"2023-03-17T08:39:59.428856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.373843+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:39:58.373843+0000","last_peered":"2023-03-17T08:39:58.373843+0000","last_clean":"2023-03-17T08:39:58.373843+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:39:58.373843+0000","last_undegraded":"2023-03-17T08:39:58.373843+0000","last_fullsized":"2023-03-17T08:39:58.373843+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.193505+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:39:59.193505+0000","last_peered":"2023-03-17T08:39:59.193505+0000","last_clean":"2023-03-17T08:39:59.193505+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:39:59.193505+0000","last_undegraded":"2023-03-17T08:39:59.193505+0000","last_fullsized":"2023-03-17T08:39:59.193505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:56.756904+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:39:56.756904+0000","last_peered":"2023-03-17T08:39:56.756904+0000","last_clean":"2023-03-17T08:39:56.756904+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:39:56.756904+0000","last_undegraded":"2023-03-17T08:39:56.756904+0000","last_fullsized":"2023-03-17T08:39:56.756904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77157,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":17061,"num_read_kb":8615,"num_write":278,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":231471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":238,"ondisk_log_size":238,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351396,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":1007616,"data_stored":483855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.81000000000000005,"5min":0.878,"15min":0.90500000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.496,"5min":0.46999999999999997,"15min":0.36599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.84899999999999998},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.52000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.92600000000000005,"15min":0.93300000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.77300000000000002,"5min":0.874,"15min":0.93899999999999995},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70199999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.872,"15min":0.872},"last":0.622}]},{"osd":3,"last update":"Fri Mar 17 08:42:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78100000000000003,"5min":0.85399999999999998,"15min":0.98199999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.495,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.95399999999999996},"last":0.497}]},{"osd":4,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.90400000000000003,"15min":0.90500000000000003},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.88100000000000001,"5min":0.89800000000000002,"15min":0.91200000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83199999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.55900000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.92700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.47899999999999998,"5min":0.40200000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58299999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.626,"5min":0.498,"15min":0.498},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.105},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.64300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70099999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.55500000000000005},"max":{"1min":1.0149999999999999,"5min":1.0229999999999999,"15min":1.0640000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.65200000000000002,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":0.93899999999999995,"5min":0.96999999999999997,"15min":1.0109999999999999},"last":0.57599999999999996}]}]},{"osd":10,"up_from":73,"seq":313532613037,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7300,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737852,"statfs":{"total":95995035648,"available":95987560448,"internally_reserved":0,"allocated":1699840,"data_stored":1142869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.48399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71299999999999997,"5min":0.83599999999999997,"15min":0.84399999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.84099999999999997},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44,"15min":0.44800000000000001},"min":{"1min":0.34599999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81200000000000006,"5min":0.85499999999999998,"15min":0.88300000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.33300000000000002},"max":{"1min":0.80300000000000005,"5min":0.82899999999999996,"15min":0.92900000000000005},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78900000000000003,"5min":0.88800000000000001,"15min":1.0229999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.755}]},{"osd":4,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.91800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.32100000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.83799999999999997},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.40000000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.0820000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.70799999999999996},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.39600000000000002},"max":{"1min":0.93999999999999995,"5min":1.0069999999999999,"15min":1.2629999999999999},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.48299999999999998,"5min":0.42099999999999999,"15min":0.39500000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0529999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.73399999999999999},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":1.036},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72299999999999998,"15min":0.73899999999999999},"min":{"1min":0.55800000000000005,"5min":0.50700000000000001,"15min":0.42099999999999999},"max":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":1.0329999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.746,"15min":0.74399999999999999},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85499999999999998}]},{"osd":9,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.61499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93500000000000005,"5min":0.98499999999999999,"15min":1.04},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55200000000000005,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.94399999999999995,"5min":0.95699999999999996,"15min":1.052},"last":0.82999999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.65400000000000003,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":0.98799999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79500000000000004},"min":{"1min":0.65800000000000003,"5min":0.60999999999999999,"15min":0.57599999999999996},"max":{"1min":0.97599999999999998,"5min":1.024,"15min":1.0389999999999999},"last":0.77500000000000002}]}]},{"osd":9,"up_from":68,"seq":292057776568,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.47799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":0.81999999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.28699999999999998},"max":{"1min":0.91300000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.76300000000000001,"15min":0.71999999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.004},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.53000000000000003,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.6970000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1.03,"5min":1.085,"15min":1.085},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51200000000000001},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":1.45,"15min":1.45},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56599999999999995,"15min":0.54900000000000004},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.30199999999999999},"max":{"1min":0.745,"5min":1.1359999999999999,"15min":1.476},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78100000000000003,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.497,"15min":0.434},"max":{"1min":1.006,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.55400000000000005,"5min":0.505,"15min":0.41899999999999998},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.329},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.40699999999999997},"max":{"1min":0.98399999999999999,"5min":1.0660000000000001,"15min":1.417},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.437},"max":{"1min":0.97299999999999998,"5min":1.016,"15min":1.6739999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.32900000000000001},"max":{"1min":1.0249999999999999,"5min":1.034,"15min":1.5660000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81799999999999995,"15min":0.77900000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.34499999999999997},"max":{"1min":1.073,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.627}]},{"osd":7,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.78700000000000003},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.47599999999999998},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.391},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.1659999999999999,"15min":1.6000000000000001},"last":0.60399999999999998}]},{"osd":8,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.88700000000000001,"15min":0.85099999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0840000000000001,"5min":1.107,"15min":1.4370000000000001},"last":0.57199999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.84799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.50700000000000001},"max":{"1min":1.117,"5min":1.393,"15min":1.393},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.65500000000000003,"5min":0.628,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.1990000000000001,"15min":1.6299999999999999},"last":0.71099999999999997}]}]},{"osd":8,"up_from":60,"seq":257698038210,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6564,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738588,"statfs":{"total":95995035648,"available":95988314112,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.47299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82999999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32500000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.874,"15min":0.92000000000000004},"last":0.503},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.64400000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.88200000000000001},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.73999999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.72699999999999998,"5min":0.87,"15min":0.87},"last":0.375}]},{"osd":3,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.439},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.377},"max":{"1min":0.86599999999999999,"5min":0.89600000000000002,"15min":0.98099999999999998},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83399999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.88100000000000001,"15min":0.95599999999999996},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.85599999999999998,"5min":1.018,"15min":1.018},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44600000000000001,"15min":0.42699999999999999},"max":{"1min":0.95099999999999996,"5min":1.593,"15min":1.593},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.55500000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.0349999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.58199999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83599999999999997,"5min":1.026,"15min":1.073},"last":0.91800000000000004}]},{"osd":9,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.64300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89400000000000002,"5min":1.0600000000000001,"15min":1.0629999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.63300000000000001,"5min":0.505,"15min":0.49299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.052},"last":0.54100000000000004}]},{"osd":10,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.441},"max":{"1min":0.94799999999999995,"5min":1.034,"15min":1.069},"last":0.753},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.65500000000000003,"5min":0.52700000000000002,"15min":0.505},"max":{"1min":0.88800000000000001,"5min":1.054,"15min":1.1220000000000001},"last":0.626}]},{"osd":11,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.753},"min":{"1min":0.61699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91400000000000003,"5min":0.98499999999999999,"15min":1.085},"last":0.55900000000000005}]}]},{"osd":7,"up_from":52,"seq":223338299853,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7216,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737936,"statfs":{"total":95995035648,"available":95987646464,"internally_reserved":0,"allocated":1613824,"data_stored":1078170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.436,"15min":0.43099999999999999},"min":{"1min":0.315,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60799999999999998,"5min":0.746,"15min":0.746},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.39300000000000002,"5min":0.30599999999999999,"15min":0.29899999999999999},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.51900000000000002,"5min":0.45800000000000002,"15min":0.41099999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.51000000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84499999999999997,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.40300000000000002},"max":{"1min":0.75800000000000001,"5min":0.88900000000000001,"15min":0.92700000000000005},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.76700000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.78500000000000003},"last":0.502}]},{"osd":5,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.84599999999999997,"5min":0.877,"15min":0.93600000000000005},"last":0.745},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.53900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":1.0029999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:42:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.41399999999999998},"max":{"1min":0.83099999999999996,"5min":0.999,"15min":0.999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71699999999999997,"15min":0.70499999999999996},"min":{"1min":0.49199999999999999,"5min":0.435,"15min":0.39900000000000002},"max":{"1min":0.94099999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.85699999999999998}]},{"osd":8,"last update":"Fri Mar 17 08:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.57099999999999995,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.88600000000000001,"5min":0.92000000000000004,"15min":1.008},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.002},"last":0.82599999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.0369999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.60399999999999998,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":0.93000000000000005,"5min":0.95099999999999996,"15min":0.95999999999999996},"last":0.97199999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.80400000000000005}]},{"osd":11,"last update":"Fri Mar 17 08:43:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.65400000000000003,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.034},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.70899999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0329999999999999,"5min":1.056,"15min":1.056},"last":0.874}]}]},{"osd":6,"up_from":47,"seq":201863463385,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":999424,"data_stored":483145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48399999999999999,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.26300000000000001},"max":{"1min":0.59099999999999997,"5min":1.478,"15min":1.478},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.495},"min":{"1min":0.313,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":1.51,"15min":1.51},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.626,"15min":0.623},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":1.546,"15min":1.546},"last":0.751},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69399999999999995,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.501,"15min":0.371},"max":{"1min":0.84399999999999997,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72899999999999998,"15min":0.69199999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38300000000000001},"max":{"1min":0.86199999999999999,"5min":1.77,"15min":1.77},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71599999999999997,"15min":0.66700000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.62,"15min":0.59399999999999997},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.32300000000000001},"max":{"1min":0.82699999999999996,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.307},"max":{"1min":0.91900000000000004,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.67100000000000004},"min":{"1min":0.48099999999999998,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":0.93999999999999995,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0369999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.876}]},{"osd":5,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.41699999999999998},"max":{"1min":0.97299999999999998,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.72599999999999998},"min":{"1min":0.50800000000000001,"5min":0.45500000000000002,"15min":0.40000000000000002},"max":{"1min":0.88400000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.58499999999999996,"5min":0.48799999999999999,"15min":0.47799999999999998},"max":{"1min":1.1080000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79800000000000004,"15min":0.79300000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.845,"15min":1.845},"last":0.78400000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.81100000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.434},"max":{"1min":1.0109999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.946,"15min":1.946},"last":0.999}]},{"osd":9,"last update":"Fri Mar 17 08:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83399999999999996,"15min":0.80900000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.044,"5min":1.994,"15min":1.994},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.95499999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.874,"15min":0.85099999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54700000000000004},"max":{"1min":1.107,"5min":2.028,"15min":2.028},"last":1.014},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.86799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.498},"max":{"1min":1.1000000000000001,"5min":2.04,"15min":2.04},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575378,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7648,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":93737504,"statfs":{"total":95995035648,"available":95987204096,"internally_reserved":0,"allocated":1073152,"data_stored":552194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.435,"5min":0.39800000000000002,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.84899999999999998,"15min":0.94299999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.48699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.022},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Mar 17 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.107,"15min":1.107},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.89200000000000002},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":1.024,"15min":1.024},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.92400000000000004,"15min":0.92800000000000005},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.5,"15min":0.503},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.498,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.33200000000000002,"15min":0.30399999999999999},"max":{"1min":0.75900000000000001,"5min":0.83399999999999996,"15min":1.105},"last":0.33600000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.74199999999999999},"min":{"1min":0.46400000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95699999999999996,"5min":1.0089999999999999,"15min":1.04},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.47699999999999998},"max":{"1min":0.88800000000000001,"5min":0.92400000000000004,"15min":1.038},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.48399999999999999,"5min":0.47599999999999998,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70099999999999996,"15min":0.70599999999999996},"min":{"1min":0.54200000000000004,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":1.048,"15min":1.048},"last":0.499}]},{"osd":7,"last update":"Fri Mar 17 08:42:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":1.0609999999999999,"15min":1.0920000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52200000000000002,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.96199999999999997,"5min":1.224,"15min":1.224},"last":0.65100000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":1.153,"15min":1.153},"last":0.622},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.1200000000000001},"last":0.52400000000000002}]},{"osd":9,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":1.042,"15min":1.042},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85199999999999998},"min":{"1min":0.67300000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98699999999999999,"5min":1.272,"15min":1.272},"last":0.60199999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76300000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.441,"15min":0.41499999999999998},"max":{"1min":0.871,"5min":0.98599999999999999,"15min":1.1579999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.97199999999999998,"5min":1.256,"15min":1.256},"last":0.57599999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.61699999999999999},"max":{"1min":1.028,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83599999999999997,"15min":0.84499999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.57999999999999996},"max":{"1min":1.018,"5min":1.044,"15min":1.133},"last":0.63900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":484478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.47299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89500000000000002,"5min":0.92000000000000004,"15min":0.94299999999999995},"last":0.437},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.65300000000000002},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.32100000000000001},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.95999999999999996},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.36699999999999999},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":1.038},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.68100000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.95899999999999996,"15min":0.99199999999999999},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54200000000000004,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.28399999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.53000000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90200000000000002,"5min":1.105,"15min":1.105},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":1.081,"15min":1.081},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":0.92100000000000004,"5min":0.98199999999999998,"15min":1.05},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0009999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.69899999999999995,"15min":0.69199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0529999999999999,"15min":1.115},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81399999999999995,"15min":0.80500000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.51200000000000001},"max":{"1min":1.044,"5min":1.123,"15min":1.123},"last":0.48299999999999998}]},{"osd":9,"last update":"Fri Mar 17 08:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.119,"15min":1.119},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.79800000000000004},"min":{"1min":0.439,"5min":0.436,"15min":0.40899999999999997},"max":{"1min":1.075,"5min":1.129,"15min":1.165},"last":0.623}]},{"osd":10,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.878,"15min":0.86499999999999999},"min":{"1min":0.67000000000000004,"5min":0.60599999999999998,"15min":0.47399999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.2050000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85899999999999999,"15min":0.84499999999999997},"min":{"1min":0.71799999999999997,"5min":0.60599999999999998,"15min":0.48299999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.501}]},{"osd":11,"last update":"Fri Mar 17 08:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85799999999999998,"15min":0.84999999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.45000000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.1739999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.88300000000000001,"15min":0.873},"min":{"1min":0.69399999999999995,"5min":0.64700000000000002,"15min":0.57199999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57499999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411848,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7452,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737700,"statfs":{"total":95995035648,"available":95987404800,"internally_reserved":0,"allocated":1003520,"data_stored":485186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90300000000000002},"last":0.627}]},{"osd":1,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.377},"max":{"1min":0.82699999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.67500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91700000000000004,"5min":0.93100000000000005,"15min":1.0209999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.50600000000000001,"5min":0.43099999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":0.98099999999999998,"15min":0.998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri Mar 17 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.747},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89100000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":1.0640000000000001,"15min":1.0700000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":0.96199999999999997,"15min":1.0029999999999999},"last":0.66300000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81299999999999994,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98999999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.56799999999999995,"5min":0.47799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95499999999999996,"5min":1.042,"15min":1.0920000000000001},"last":0.874}]},{"osd":10,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.52900000000000003},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.083},"last":0.78600000000000003}]},{"osd":11,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83299999999999996,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":1,"5min":1.087,"15min":1.143},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46500000000000002},"max":{"1min":0.92500000000000004,"5min":0.99099999999999999,"15min":1.046},"last":0.81000000000000005}]}]},{"osd":3,"up_from":26,"seq":111669150200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6828,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738324,"statfs":{"total":95995035648,"available":95988043776,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.40200000000000002,"5min":0.28399999999999997,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.872},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.41499999999999998,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.42299999999999999},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39400000000000002},"max":{"1min":0.77300000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.374}]},{"osd":2,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68300000000000005,"15min":0.66600000000000004},"min":{"1min":0.52600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.61899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.50900000000000001,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.054},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80000000000000004,"15min":0.78300000000000003},"min":{"1min":0.63700000000000001,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.97399999999999998,"5min":1.0309999999999999,"15min":1.054},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.77900000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":1.0289999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.5}]},{"osd":6,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76200000000000001,"15min":0.71699999999999997},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.33500000000000002},"max":{"1min":1.0600000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.872,"5min":0.88100000000000001,"15min":1.0149999999999999},"last":0.437}]},{"osd":7,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.72099999999999997},"min":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.505},"max":{"1min":0.96499999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83099999999999996,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.628,"15min":0.52500000000000002},"max":{"1min":1.073,"5min":1.113,"15min":1.113},"last":0.53300000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.874,"15min":0.83699999999999997},"min":{"1min":0.59699999999999998,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.68000000000000005},"min":{"1min":0.54200000000000004,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.91100000000000003,"5min":0.999,"15min":1.0389999999999999},"last":0.629}]},{"osd":10,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.70199999999999996,"5min":0.56599999999999995,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.73299999999999998,"5min":0.60399999999999998,"15min":0.56399999999999995},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.56299999999999994}]},{"osd":11,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88900000000000001,"15min":0.86199999999999999},"min":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.121},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.93200000000000005,"15min":0.90100000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.119,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68000000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6884,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738268,"statfs":{"total":95995035648,"available":95987986432,"internally_reserved":0,"allocated":1077248,"data_stored":551400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.443,"15min":0.438},"min":{"1min":0.31,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.63100000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.36299999999999999,"5min":0.32300000000000001,"15min":0.317},"max":{"1min":0.64800000000000002,"5min":0.72499999999999998,"15min":0.752},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.438,"5min":0.36499999999999999,"15min":0.313},"max":{"1min":0.83299999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.57299999999999995,"5min":0.433,"15min":0.41799999999999998},"max":{"1min":0.77600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Mar 17 08:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.58299999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85299999999999998,"5min":0.91800000000000004,"15min":0.97399999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.67300000000000004},"min":{"1min":0.54000000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":1.022,"15min":1.022},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77000000000000002,"5min":0.90400000000000003,"15min":0.94999999999999996},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71299999999999997,"15min":0.69599999999999995},"min":{"1min":0.66400000000000003,"5min":0.50700000000000001,"15min":0.46400000000000002},"max":{"1min":0.82499999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.61799999999999999,"5min":0.44700000000000001,"15min":0.40300000000000002},"max":{"1min":0.90400000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":1.0029999999999999,"15min":1.0820000000000001},"last":0.432}]},{"osd":8,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.59999999999999998,"5min":0.45400000000000001,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":0.998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.67400000000000004,"5min":0.52100000000000002,"15min":0.495},"max":{"1min":0.92900000000000005,"5min":0.98899999999999999,"15min":1.016},"last":0.64000000000000001}]},{"osd":9,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64200000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0820000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.41799999999999998},"max":{"1min":0.995,"5min":0.995,"15min":1.018},"last":0.70599999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.38400000000000001},"max":{"1min":0.93400000000000005,"5min":0.95299999999999996,"15min":1.056},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77500000000000002}]},{"osd":11,"last update":"Fri Mar 17 08:42:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.74399999999999999,"5min":0.60499999999999998,"15min":0.57399999999999995},"max":{"1min":0.98599999999999999,"5min":1.0389999999999999,"15min":1.048},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.84399999999999997,"15min":0.83199999999999996},"min":{"1min":0.64900000000000002,"5min":0.64700000000000002,"15min":0.56100000000000005},"max":{"1min":1.006,"5min":1.006,"15min":1.107},"last":0.65100000000000002}]}]},{"osd":5,"up_from":39,"seq":167503725030,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":1622016,"data_stored":1076084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79300000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.373},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.36299999999999999},"max":{"1min":0.76700000000000002,"5min":0.91200000000000003,"15min":0.91400000000000003},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.29099999999999998},"max":{"1min":0.68899999999999995,"5min":0.73999999999999999,"15min":1.46},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.30099999999999999},"max":{"1min":0.63500000000000001,"5min":0.67200000000000004,"15min":1.0349999999999999},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.41299999999999998,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.97499999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.65800000000000003},"min":{"1min":0.46500000000000002,"5min":0.38600000000000001,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":1.5469999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.66800000000000004},"min":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.39600000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.93000000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.68400000000000005},"min":{"1min":0.48799999999999999,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":0.995,"15min":0.995},"last":0.497}]},{"osd":6,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.47199999999999998,"5min":0.45600000000000002,"15min":0.41499999999999998},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":0.96799999999999997},"last":0.503},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":1.0049999999999999,"15min":1.3440000000000001},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.96799999999999997,"15min":1.6040000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.71099999999999997},"min":{"1min":0.54200000000000004,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":0.92100000000000004,"5min":0.97399999999999998,"15min":1.0740000000000001},"last":0.56100000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69699999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38100000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":1.6359999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.41799999999999998,"15min":0.35699999999999998},"max":{"1min":0.85699999999999998,"5min":0.91400000000000003,"15min":1.4830000000000001},"last":0.627}]},{"osd":9,"last update":"Fri Mar 17 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76900000000000002,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.47399999999999998},"max":{"1min":0.93300000000000005,"5min":0.98099999999999998,"15min":1.026},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.663},"last":0.65300000000000002}]},{"osd":10,"last update":"Fri Mar 17 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77400000000000002,"15min":0.76600000000000001},"min":{"1min":0.628,"5min":0.55500000000000005,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2110000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":0.78800000000000003},"min":{"1min":0.623,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.167},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:44:03.155 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-03-17T08:44:04.198 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-17T08:44:05.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:54 smithi082 ceph-mon[94281]: pgmap v1796: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:55 smithi082 ceph-mon[94281]: pgmap v1797: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:07.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:43:58 smithi082 ceph-mon[94281]: pgmap v1798: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:00 smithi082 ceph-mon[94281]: pgmap v1799: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:02 smithi082 ceph-mon[94281]: pgmap v1800: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:04 smithi082 ceph-mon[94281]: pgmap v1801: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:54 smithi078 ceph-mon[94114]: pgmap v1796: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:55 smithi078 ceph-mon[94114]: pgmap v1797: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:43:58 smithi078 ceph-mon[94114]: pgmap v1798: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:00 smithi078 ceph-mon[94114]: pgmap v1799: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:02 smithi078 ceph-mon[94114]: pgmap v1800: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:07.850 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:04 smithi078 ceph-mon[94114]: pgmap v1801: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.851 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:35 smithi035 ceph-mon[92535]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:44:07.851 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:35 smithi035 ceph-mon[92535]: pgmap v1787: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:38 smithi035 ceph-mon[92535]: pgmap v1788: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:40 smithi035 ceph-mon[92535]: pgmap v1789: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:42 smithi035 ceph-mon[92535]: pgmap v1790: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:44 smithi035 ceph-mon[92535]: pgmap v1791: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:45 smithi035 ceph-mon[92535]: pgmap v1792: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:48 smithi035 ceph-mon[92535]: pgmap v1793: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:50 smithi035 ceph-mon[92535]: pgmap v1794: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:07.852 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:52 smithi035 ceph-mon[92535]: pgmap v1795: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:09.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:54 smithi035 ceph-mon[92535]: pgmap v1796: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:09.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:55 smithi035 ceph-mon[92535]: pgmap v1797: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:09.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:43:58 smithi035 ceph-mon[92535]: pgmap v1798: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:09.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:00 smithi035 ceph-mon[92535]: pgmap v1799: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:09.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:02 smithi035 ceph-mon[92535]: pgmap v1800: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:09.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:04 smithi035 ceph-mon[92535]: pgmap v1801: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:09.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:05 smithi035 ceph-mon[92535]: pgmap v1802: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:10.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:05 smithi082 ceph-mon[94281]: pgmap v1802: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:10.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:05 smithi078 ceph-mon[94114]: pgmap v1802: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:12.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:08 smithi082 ceph-mon[94281]: pgmap v1803: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:13.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:09 smithi082 ceph-mon[94281]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:44:13.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:10 smithi082 ceph-mon[94281]: pgmap v1804: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:13.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:08 smithi078 ceph-mon[94114]: pgmap v1803: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:13.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:09 smithi078 ceph-mon[94114]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:44:13.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:10 smithi078 ceph-mon[94114]: pgmap v1804: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:13.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:12 smithi082 ceph-mon[94281]: pgmap v1805: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:15.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:12 smithi078 ceph-mon[94114]: pgmap v1805: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:15.713 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.987+0000 7faf3410f700 1 -- 172.21.15.35:0/2134092973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100c20 msgr2=0x7faf2c1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:17.346 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.987+0000 7faf3410f700 1 --2- 172.21.15.35:0/2134092973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100c20 0x7faf2c1074e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf2400b0a0 tx=0x7faf2400b3b0 comp rx=0 tx=0).stop 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- 172.21.15.35:0/2134092973 shutdown_connections 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 --2- 172.21.15.35:0/2134092973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100c20 0x7faf2c1074e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 --2- 172.21.15.35:0/2134092973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2c0ff0a0 0x7faf2c0ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 --2- 172.21.15.35:0/2134092973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf2c100290 0x7faf2c1006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- 172.21.15.35:0/2134092973 >> 172.21.15.35:0/2134092973 conn(0x7faf2c0fa680 msgr2=0x7faf2c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- 172.21.15.35:0/2134092973 shutdown_connections 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- 172.21.15.35:0/2134092973 wait complete. 2023-03-17T08:44:17.347 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 Processor -- start 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- start start 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf2c0ff0a0 0x7faf2c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 0x7faf2c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2c100c20 0x7faf2c19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c19fd00 con 0x7faf2c100290 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c19fe40 con 0x7faf2c0ff0a0 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.988+0000 7faf3410f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c19ffd0 con 0x7faf2c100c20 2023-03-17T08:44:17.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 0x7faf2c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:19.444 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 0x7faf2c1986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41684/0 (socket says 172.21.15.35:41684) 2023-03-17T08:44:19.444 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 -- 172.21.15.35:0/2413216528 learned_addr learned my addr 172.21.15.35:0/2413216528 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:44:19.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf31eab700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf2c0ff0a0 0x7faf2c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:19.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf326ac700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2c100c20 0x7faf2c19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:19.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 -- 172.21.15.35:0/2413216528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2c100c20 msgr2=0x7faf2c19f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:19.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2c100c20 0x7faf2c19f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:19.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 -- 172.21.15.35:0/2413216528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf2c0ff0a0 msgr2=0x7faf2c198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:19.445 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf2c0ff0a0 0x7faf2c198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:20.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 -- 172.21.15.35:0/2413216528 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24009d00 con 0x7faf2c100290 2023-03-17T08:44:20.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf316aa700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 0x7faf2c1986c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf2800d950 tx=0x7faf2800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:44:20.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800f890 con 0x7faf2c100290 2023-03-17T08:44:20.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c10a8b0 con 0x7faf2c100290 2023-03-17T08:44:20.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf2800fe80 con 0x7faf2c100290 2023-03-17T08:44:20.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800e3b0 con 0x7faf2c100290 2023-03-17T08:44:20.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.989+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c10a720 con 0x7faf2c100290 2023-03-17T08:44:21.624 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.990+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c067970 con 0x7faf2c100290 2023-03-17T08:44:23.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.992+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7faf28010460 con 0x7faf2c100290 2023-03-17T08:44:23.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.992+0000 7faf22ffd700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7faf1809f4d0 0x7faf180a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:23.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.992+0000 7faf31eab700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7faf1809f4d0 0x7faf180a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:23.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.992+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7faf280c9f30 con 0x7faf2c100290 2023-03-17T08:44:23.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.993+0000 7faf31eab700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7faf1809f4d0 0x7faf180a1980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faf2c1000f0 tx=0x7faf1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:44:23.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:07.995+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7faf280940c0 con 0x7faf2c100290 2023-03-17T08:44:23.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.194+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 --> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf2c1a0b30 con 0x7faf1809f4d0 2023-03-17T08:44:23.035 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.206+0000 7faf22ffd700 1 -- 172.21.15.35:0/2413216528 <== mgr.14152 v2:172.21.15.35:6800/889943724 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344607 (secure 0 0 0) 0x7faf2c1a0b30 con 0x7faf1809f4d0 2023-03-17T08:44:23.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:14 smithi082 ceph-mon[94281]: pgmap v1806: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:24.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:15 smithi082 ceph-mon[94281]: pgmap v1807: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:18 smithi082 ceph-mon[94281]: pgmap v1808: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:20 smithi082 ceph-mon[94281]: pgmap v1809: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:22 smithi082 ceph-mon[94281]: pgmap v1810: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:14 smithi078 ceph-mon[94114]: pgmap v1806: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:15 smithi078 ceph-mon[94114]: pgmap v1807: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:18 smithi078 ceph-mon[94114]: pgmap v1808: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:20 smithi078 ceph-mon[94114]: pgmap v1809: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:25.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:22 smithi078 ceph-mon[94114]: pgmap v1810: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:25.324 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:44:25.326 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:24 smithi082 ceph-mon[94281]: pgmap v1811: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:26.753 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:24 smithi078 ceph-mon[94114]: pgmap v1811: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7faf1809f4d0 msgr2=0x7faf180a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7faf1809f4d0 0x7faf180a1980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faf2c1000f0 tx=0x7faf1c00b410 comp rx=0 tx=0).stop 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 msgr2=0x7faf2c1986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 0x7faf2c1986c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf2800d950 tx=0x7faf2800dc60 comp rx=0 tx=0).stop 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 shutdown_connections 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf2c100c20 0x7faf2c19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:26.754 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf2c0ff0a0 0x7faf2c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:29.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7faf1809f4d0 0x7faf180a1980 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:29.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 --2- 172.21.15.35:0/2413216528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf2c100290 0x7faf2c1986c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:29.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 >> 172.21.15.35:0/2413216528 conn(0x7faf2c0fa680 msgr2=0x7faf2c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:44:29.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 shutdown_connections 2023-03-17T08:44:29.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:08.210+0000 7faf3410f700 1 -- 172.21.15.35:0/2413216528 wait complete. 2023-03-17T08:44:29.095 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-03-17T08:44:29.096 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":1803,"stamp":"2023-03-17T08:44:07.125517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667771,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":17547,"num_read_kb":8909,"num_write":461,"num_write_kb":3108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182356,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":877,"ondisk_log_size":877,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":83820,"kb_used_data":13836,"kb_used_omap":0,"kb_used_meta":69888,"kb_avail":1124858004,"statfs":{"total":1151940427776,"available":1151854596096,"internally_reserved":0,"allocated":14168064,"data_stored":7787023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71565312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003969"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:01.757678+0000","last_change":"2023-03-17T08:12:56.313876+0000","last_active":"2023-03-17T08:40:01.757678+0000","last_peered":"2023-03-17T08:40:01.757678+0000","last_clean":"2023-03-17T08:40:01.757678+0000","last_became_active":"2023-03-17T08:12:56.313523+0000","last_became_peered":"2023-03-17T08:12:56.313523+0000","last_unstale":"2023-03-17T08:40:01.757678+0000","last_undegraded":"2023-03-17T08:40:01.757678+0000","last_fullsized":"2023-03-17T08:40:01.757678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:58:57.449695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233812+0000","last_change":"2023-03-17T08:12:56.309255+0000","last_active":"2023-03-17T08:40:05.233812+0000","last_peered":"2023-03-17T08:40:05.233812+0000","last_clean":"2023-03-17T08:40:05.233812+0000","last_became_active":"2023-03-17T08:12:56.307844+0000","last_became_peered":"2023-03-17T08:12:56.307844+0000","last_unstale":"2023-03-17T08:40:05.233812+0000","last_undegraded":"2023-03-17T08:40:05.233812+0000","last_fullsized":"2023-03-17T08:40:05.233812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:28:27.546623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233769+0000","last_change":"2023-03-17T08:12:56.307540+0000","last_active":"2023-03-17T08:40:05.233769+0000","last_peered":"2023-03-17T08:40:05.233769+0000","last_clean":"2023-03-17T08:40:05.233769+0000","last_became_active":"2023-03-17T08:12:56.306324+0000","last_became_peered":"2023-03-17T08:12:56.306324+0000","last_unstale":"2023-03-17T08:40:05.233769+0000","last_undegraded":"2023-03-17T08:40:05.233769+0000","last_fullsized":"2023-03-17T08:40:05.233769+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:31:45.786701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:01.165523+0000","last_change":"2023-03-17T08:12:56.309184+0000","last_active":"2023-03-17T08:41:01.165523+0000","last_peered":"2023-03-17T08:41:01.165523+0000","last_clean":"2023-03-17T08:41:01.165523+0000","last_became_active":"2023-03-17T08:12:56.308656+0000","last_became_peered":"2023-03-17T08:12:56.308656+0000","last_unstale":"2023-03-17T08:41:01.165523+0000","last_undegraded":"2023-03-17T08:41:01.165523+0000","last_fullsized":"2023-03-17T08:41:01.165523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:08:37.180719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.371373+0000","last_change":"2023-03-17T08:12:56.300641+0000","last_active":"2023-03-17T08:40:29.371373+0000","last_peered":"2023-03-17T08:40:29.371373+0000","last_clean":"2023-03-17T08:40:29.371373+0000","last_became_active":"2023-03-17T08:12:56.300326+0000","last_became_peered":"2023-03-17T08:12:56.300326+0000","last_unstale":"2023-03-17T08:40:29.371373+0000","last_undegraded":"2023-03-17T08:40:29.371373+0000","last_fullsized":"2023-03-17T08:40:29.371373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:57:15.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.413928+0000","last_change":"2023-03-17T08:12:56.302188+0000","last_active":"2023-03-17T08:40:29.413928+0000","last_peered":"2023-03-17T08:40:29.413928+0000","last_clean":"2023-03-17T08:40:29.413928+0000","last_became_active":"2023-03-17T08:12:56.301843+0000","last_became_peered":"2023-03-17T08:12:56.301843+0000","last_unstale":"2023-03-17T08:40:29.413928+0000","last_undegraded":"2023-03-17T08:40:29.413928+0000","last_fullsized":"2023-03-17T08:40:29.413928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:33:36.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:28.311581+0000","last_change":"2023-03-17T08:12:56.307902+0000","last_active":"2023-03-17T08:40:28.311581+0000","last_peered":"2023-03-17T08:40:28.311581+0000","last_clean":"2023-03-17T08:40:28.311581+0000","last_became_active":"2023-03-17T08:12:56.307457+0000","last_became_peered":"2023-03-17T08:12:56.307457+0000","last_unstale":"2023-03-17T08:40:28.311581+0000","last_undegraded":"2023-03-17T08:40:28.311581+0000","last_fullsized":"2023-03-17T08:40:28.311581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:45:17.145819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.432368+0000","last_change":"2023-03-17T08:12:56.310029+0000","last_active":"2023-03-17T08:40:29.432368+0000","last_peered":"2023-03-17T08:40:29.432368+0000","last_clean":"2023-03-17T08:40:29.432368+0000","last_became_active":"2023-03-17T08:12:56.309400+0000","last_became_peered":"2023-03-17T08:12:56.309400+0000","last_unstale":"2023-03-17T08:40:29.432368+0000","last_undegraded":"2023-03-17T08:40:29.432368+0000","last_fullsized":"2023-03-17T08:40:29.432368+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:41:51.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:43.372194+0000","last_change":"2023-03-17T08:12:56.304611+0000","last_active":"2023-03-17T08:39:43.372194+0000","last_peered":"2023-03-17T08:39:43.372194+0000","last_clean":"2023-03-17T08:39:43.372194+0000","last_became_active":"2023-03-17T08:12:56.304300+0000","last_became_peered":"2023-03-17T08:12:56.304300+0000","last_unstale":"2023-03-17T08:39:43.372194+0000","last_undegraded":"2023-03-17T08:39:43.372194+0000","last_fullsized":"2023-03-17T08:39:43.372194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:41:42.715075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.407892+0000","last_change":"2023-03-17T08:12:56.307496+0000","last_active":"2023-03-17T08:39:34.407892+0000","last_peered":"2023-03-17T08:39:34.407892+0000","last_clean":"2023-03-17T08:39:34.407892+0000","last_became_active":"2023-03-17T08:12:56.307064+0000","last_became_peered":"2023-03-17T08:12:56.307064+0000","last_unstale":"2023-03-17T08:39:34.407892+0000","last_undegraded":"2023-03-17T08:39:34.407892+0000","last_fullsized":"2023-03-17T08:39:34.407892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:20.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.304324+0000","last_change":"2023-03-17T08:12:56.313782+0000","last_active":"2023-03-17T08:39:33.304324+0000","last_peered":"2023-03-17T08:39:33.304324+0000","last_clean":"2023-03-17T08:39:33.304324+0000","last_became_active":"2023-03-17T08:12:56.313408+0000","last_became_peered":"2023-03-17T08:12:56.313408+0000","last_unstale":"2023-03-17T08:39:33.304324+0000","last_undegraded":"2023-03-17T08:39:33.304324+0000","last_fullsized":"2023-03-17T08:39:33.304324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:00:26.744954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:19.691171+0000","last_change":"2023-03-17T08:13:43.311956+0000","last_active":"2023-03-17T08:40:19.691171+0000","last_peered":"2023-03-17T08:40:19.691171+0000","last_clean":"2023-03-17T08:40:19.691171+0000","last_became_active":"2023-03-17T08:13:43.311465+0000","last_became_peered":"2023-03-17T08:13:43.311465+0000","last_unstale":"2023-03-17T08:40:19.691171+0000","last_undegraded":"2023-03-17T08:40:19.691171+0000","last_fullsized":"2023-03-17T08:40:19.691171+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:46:28.751332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.190314+0000","last_change":"2023-03-17T08:12:56.304563+0000","last_active":"2023-03-17T08:39:34.190314+0000","last_peered":"2023-03-17T08:39:34.190314+0000","last_clean":"2023-03-17T08:39:34.190314+0000","last_became_active":"2023-03-17T08:12:56.304192+0000","last_became_peered":"2023-03-17T08:12:56.304192+0000","last_unstale":"2023-03-17T08:39:34.190314+0000","last_undegraded":"2023-03-17T08:39:34.190314+0000","last_fullsized":"2023-03-17T08:39:34.190314+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:17:54.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:05.240719+0000","last_change":"2023-03-17T08:12:56.304145+0000","last_active":"2023-03-17T08:41:05.240719+0000","last_peered":"2023-03-17T08:41:05.240719+0000","last_clean":"2023-03-17T08:41:05.240719+0000","last_became_active":"2023-03-17T08:12:56.303707+0000","last_became_peered":"2023-03-17T08:12:56.303707+0000","last_unstale":"2023-03-17T08:41:05.240719+0000","last_undegraded":"2023-03-17T08:41:05.240719+0000","last_fullsized":"2023-03-17T08:41:05.240719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:29:57.316876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:00.240149+0000","last_change":"2023-03-17T08:12:56.304049+0000","last_active":"2023-03-17T08:41:00.240149+0000","last_peered":"2023-03-17T08:41:00.240149+0000","last_clean":"2023-03-17T08:41:00.240149+0000","last_became_active":"2023-03-17T08:12:56.303656+0000","last_became_peered":"2023-03-17T08:12:56.303656+0000","last_unstale":"2023-03-17T08:41:00.240149+0000","last_undegraded":"2023-03-17T08:41:00.240149+0000","last_fullsized":"2023-03-17T08:41:00.240149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:46:55.144221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.380975+0000","last_change":"2023-03-17T08:12:56.307186+0000","last_active":"2023-03-17T08:40:58.380975+0000","last_peered":"2023-03-17T08:40:58.380975+0000","last_clean":"2023-03-17T08:40:58.380975+0000","last_became_active":"2023-03-17T08:12:56.306842+0000","last_became_peered":"2023-03-17T08:12:56.306842+0000","last_unstale":"2023-03-17T08:40:58.380975+0000","last_undegraded":"2023-03-17T08:40:58.380975+0000","last_fullsized":"2023-03-17T08:40:58.380975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:32:38.655348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.763632+0000","last_change":"2023-03-17T08:12:56.314160+0000","last_active":"2023-03-17T08:40:56.763632+0000","last_peered":"2023-03-17T08:40:56.763632+0000","last_clean":"2023-03-17T08:40:56.763632+0000","last_became_active":"2023-03-17T08:12:56.313558+0000","last_became_peered":"2023-03-17T08:12:56.313558+0000","last_unstale":"2023-03-17T08:40:56.763632+0000","last_undegraded":"2023-03-17T08:40:56.763632+0000","last_fullsized":"2023-03-17T08:40:56.763632+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:13:46.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:59.695751+0000","last_change":"2023-03-17T08:12:56.308094+0000","last_active":"2023-03-17T08:40:59.695751+0000","last_peered":"2023-03-17T08:40:59.695751+0000","last_clean":"2023-03-17T08:40:59.695751+0000","last_became_active":"2023-03-17T08:12:56.307692+0000","last_became_peered":"2023-03-17T08:12:56.307692+0000","last_unstale":"2023-03-17T08:40:59.695751+0000","last_undegraded":"2023-03-17T08:40:59.695751+0000","last_fullsized":"2023-03-17T08:40:59.695751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:31:11.339374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985610+0000","last_change":"2023-03-17T08:12:56.307443+0000","last_active":"2023-03-17T08:40:03.985610+0000","last_peered":"2023-03-17T08:40:03.985610+0000","last_clean":"2023-03-17T08:40:03.985610+0000","last_became_active":"2023-03-17T08:12:56.307122+0000","last_became_peered":"2023-03-17T08:12:56.307122+0000","last_unstale":"2023-03-17T08:40:03.985610+0000","last_undegraded":"2023-03-17T08:40:03.985610+0000","last_fullsized":"2023-03-17T08:40:03.985610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:01:23.823824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":1783,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:02.940848+0000","last_change":"2023-03-17T08:12:43.714900+0000","last_active":"2023-03-17T08:44:02.940848+0000","last_peered":"2023-03-17T08:44:02.940848+0000","last_clean":"2023-03-17T08:44:02.940848+0000","last_became_active":"2023-03-17T08:12:43.714623+0000","last_became_peered":"2023-03-17T08:12:43.714623+0000","last_unstale":"2023-03-17T08:44:02.940848+0000","last_undegraded":"2023-03-17T08:44:02.940848+0000","last_fullsized":"2023-03-17T08:44:02.940848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:30:54.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1737,"num_read_kb":1737,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437251+0000","last_change":"2023-03-17T08:12:56.311023+0000","last_active":"2023-03-17T08:41:09.437251+0000","last_peered":"2023-03-17T08:41:09.437251+0000","last_clean":"2023-03-17T08:41:09.437251+0000","last_became_active":"2023-03-17T08:12:56.310661+0000","last_became_peered":"2023-03-17T08:12:56.310661+0000","last_unstale":"2023-03-17T08:41:09.437251+0000","last_undegraded":"2023-03-17T08:41:09.437251+0000","last_fullsized":"2023-03-17T08:41:09.437251+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:12.967595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"91'2","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.435554+0000","last_change":"2023-03-17T08:12:44.015168+0000","last_active":"2023-03-17T08:40:54.435554+0000","last_peered":"2023-03-17T08:40:54.435554+0000","last_clean":"2023-03-17T08:40:54.435554+0000","last_became_active":"2023-03-17T08:12:44.014810+0000","last_became_peered":"2023-03-17T08:12:44.014810+0000","last_unstale":"2023-03-17T08:40:54.435554+0000","last_undegraded":"2023-03-17T08:40:54.435554+0000","last_fullsized":"2023-03-17T08:40:54.435554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:57:42.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:05.233857+0000","last_change":"2023-03-17T08:12:56.304326+0000","last_active":"2023-03-17T08:40:05.233857+0000","last_peered":"2023-03-17T08:40:05.233857+0000","last_clean":"2023-03-17T08:40:05.233857+0000","last_became_active":"2023-03-17T08:12:56.303695+0000","last_became_peered":"2023-03-17T08:12:56.303695+0000","last_unstale":"2023-03-17T08:40:05.233857+0000","last_undegraded":"2023-03-17T08:40:05.233857+0000","last_fullsized":"2023-03-17T08:40:05.233857+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:59:57.189673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.369561+0000","last_change":"2023-03-17T08:12:43.716086+0000","last_active":"2023-03-17T08:40:14.369561+0000","last_peered":"2023-03-17T08:40:14.369561+0000","last_clean":"2023-03-17T08:40:14.369561+0000","last_became_active":"2023-03-17T08:12:43.715821+0000","last_became_peered":"2023-03-17T08:12:43.715821+0000","last_unstale":"2023-03-17T08:40:14.369561+0000","last_undegraded":"2023-03-17T08:40:14.369561+0000","last_fullsized":"2023-03-17T08:40:14.369561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:21:20.034400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:28.377554+0000","last_change":"2023-03-17T08:12:56.308925+0000","last_active":"2023-03-17T08:40:28.377554+0000","last_peered":"2023-03-17T08:40:28.377554+0000","last_clean":"2023-03-17T08:40:28.377554+0000","last_became_active":"2023-03-17T08:12:56.308603+0000","last_became_peered":"2023-03-17T08:12:56.308603+0000","last_unstale":"2023-03-17T08:40:28.377554+0000","last_undegraded":"2023-03-17T08:40:28.377554+0000","last_fullsized":"2023-03-17T08:40:28.377554+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:54:20.782507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.369528+0000","last_change":"2023-03-17T08:12:43.715361+0000","last_active":"2023-03-17T08:40:14.369528+0000","last_peered":"2023-03-17T08:40:14.369528+0000","last_clean":"2023-03-17T08:40:14.369528+0000","last_became_active":"2023-03-17T08:12:43.714967+0000","last_became_peered":"2023-03-17T08:12:43.714967+0000","last_unstale":"2023-03-17T08:40:14.369528+0000","last_undegraded":"2023-03-17T08:40:14.369528+0000","last_fullsized":"2023-03-17T08:40:14.369528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:12:44.211590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.311820+0000","last_change":"2023-03-17T08:12:56.312776+0000","last_active":"2023-03-17T08:40:29.311820+0000","last_peered":"2023-03-17T08:40:29.311820+0000","last_clean":"2023-03-17T08:40:29.311820+0000","last_became_active":"2023-03-17T08:12:56.311909+0000","last_became_peered":"2023-03-17T08:12:56.311909+0000","last_unstale":"2023-03-17T08:40:29.311820+0000","last_undegraded":"2023-03-17T08:40:29.311820+0000","last_fullsized":"2023-03-17T08:40:29.311820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:25:52.984006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'8","reported_seq":1778,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:02.786965+0000","last_change":"2023-03-17T08:12:43.713898+0000","last_active":"2023-03-17T08:44:02.786965+0000","last_peered":"2023-03-17T08:44:02.786965+0000","last_clean":"2023-03-17T08:44:02.786965+0000","last_became_active":"2023-03-17T08:12:43.713561+0000","last_became_peered":"2023-03-17T08:12:43.713561+0000","last_unstale":"2023-03-17T08:44:02.786965+0000","last_undegraded":"2023-03-17T08:44:02.786965+0000","last_fullsized":"2023-03-17T08:44:02.786965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:28:41.455827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1741,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.371351+0000","last_change":"2023-03-17T08:12:56.303716+0000","last_active":"2023-03-17T08:40:29.371351+0000","last_peered":"2023-03-17T08:40:29.371351+0000","last_clean":"2023-03-17T08:40:29.371351+0000","last_became_active":"2023-03-17T08:12:56.303426+0000","last_became_peered":"2023-03-17T08:12:56.303426+0000","last_unstale":"2023-03-17T08:40:29.371351+0000","last_undegraded":"2023-03-17T08:40:29.371351+0000","last_fullsized":"2023-03-17T08:40:29.371351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:48:38.558124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:14.412275+0000","last_change":"2023-03-17T08:12:43.718190+0000","last_active":"2023-03-17T08:40:14.412275+0000","last_peered":"2023-03-17T08:40:14.412275+0000","last_clean":"2023-03-17T08:40:14.412275+0000","last_became_active":"2023-03-17T08:12:43.717867+0000","last_became_peered":"2023-03-17T08:12:43.717867+0000","last_unstale":"2023-03-17T08:40:14.412275+0000","last_undegraded":"2023-03-17T08:40:14.412275+0000","last_fullsized":"2023-03-17T08:40:14.412275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:05:26.022813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:29.311793+0000","last_change":"2023-03-17T08:12:56.311846+0000","last_active":"2023-03-17T08:40:29.311793+0000","last_peered":"2023-03-17T08:40:29.311793+0000","last_clean":"2023-03-17T08:40:29.311793+0000","last_became_active":"2023-03-17T08:12:56.310900+0000","last_became_peered":"2023-03-17T08:12:56.310900+0000","last_unstale":"2023-03-17T08:40:29.311793+0000","last_undegraded":"2023-03-17T08:40:29.311793+0000","last_fullsized":"2023-03-17T08:40:29.311793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:42:33.633072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"91'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:29.189785+0000","last_change":"2023-03-17T08:12:43.717772+0000","last_active":"2023-03-17T08:39:29.189785+0000","last_peered":"2023-03-17T08:39:29.189785+0000","last_clean":"2023-03-17T08:39:29.189785+0000","last_became_active":"2023-03-17T08:12:43.717428+0000","last_became_peered":"2023-03-17T08:12:43.717428+0000","last_unstale":"2023-03-17T08:39:29.189785+0000","last_undegraded":"2023-03-17T08:39:29.189785+0000","last_fullsized":"2023-03-17T08:39:29.189785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:35:31.563606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.425942+0000","last_change":"2023-03-17T08:12:56.311929+0000","last_active":"2023-03-17T08:39:34.425942+0000","last_peered":"2023-03-17T08:39:34.425942+0000","last_clean":"2023-03-17T08:39:34.425942+0000","last_became_active":"2023-03-17T08:12:56.311602+0000","last_became_peered":"2023-03-17T08:12:56.311602+0000","last_unstale":"2023-03-17T08:39:34.425942+0000","last_undegraded":"2023-03-17T08:39:34.425942+0000","last_fullsized":"2023-03-17T08:39:34.425942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:07:01.492523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"91'3","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:19.304011+0000","last_change":"2023-03-17T08:12:43.715966+0000","last_active":"2023-03-17T08:39:19.304011+0000","last_peered":"2023-03-17T08:39:19.304011+0000","last_clean":"2023-03-17T08:39:19.304011+0000","last_became_active":"2023-03-17T08:12:43.715745+0000","last_became_peered":"2023-03-17T08:12:43.715745+0000","last_unstale":"2023-03-17T08:39:19.304011+0000","last_undegraded":"2023-03-17T08:39:19.304011+0000","last_fullsized":"2023-03-17T08:39:19.304011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:43:27.046667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.686970+0000","last_change":"2023-03-17T08:12:56.301853+0000","last_active":"2023-03-17T08:39:44.686970+0000","last_peered":"2023-03-17T08:39:44.686970+0000","last_clean":"2023-03-17T08:39:44.686970+0000","last_became_active":"2023-03-17T08:12:56.301500+0000","last_became_peered":"2023-03-17T08:12:56.301500+0000","last_unstale":"2023-03-17T08:39:44.686970+0000","last_undegraded":"2023-03-17T08:39:44.686970+0000","last_fullsized":"2023-03-17T08:39:44.686970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:28:41.206825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"91'8","reported_seq":3508,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:03.615948+0000","last_change":"2023-03-17T08:12:43.717984+0000","last_active":"2023-03-17T08:44:03.615948+0000","last_peered":"2023-03-17T08:44:03.615948+0000","last_clean":"2023-03-17T08:44:03.615948+0000","last_became_active":"2023-03-17T08:12:43.717756+0000","last_became_peered":"2023-03-17T08:12:43.717756+0000","last_unstale":"2023-03-17T08:44:03.615948+0000","last_undegraded":"2023-03-17T08:44:03.615948+0000","last_fullsized":"2023-03-17T08:44:03.615948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:38:48.051789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3471,"num_read_kb":3471,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:33.371197+0000","last_change":"2023-03-17T08:12:56.303805+0000","last_active":"2023-03-17T08:39:33.371197+0000","last_peered":"2023-03-17T08:39:33.371197+0000","last_clean":"2023-03-17T08:39:33.371197+0000","last_became_active":"2023-03-17T08:12:56.302237+0000","last_became_peered":"2023-03-17T08:12:56.302237+0000","last_unstale":"2023-03-17T08:39:33.371197+0000","last_undegraded":"2023-03-17T08:39:33.371197+0000","last_fullsized":"2023-03-17T08:39:33.371197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:29:26.655931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:18.302494+0000","last_change":"2023-03-17T08:12:43.716014+0000","last_active":"2023-03-17T08:39:18.302494+0000","last_peered":"2023-03-17T08:39:18.302494+0000","last_clean":"2023-03-17T08:39:18.302494+0000","last_became_active":"2023-03-17T08:12:43.715767+0000","last_became_peered":"2023-03-17T08:12:43.715767+0000","last_unstale":"2023-03-17T08:39:18.302494+0000","last_undegraded":"2023-03-17T08:39:18.302494+0000","last_fullsized":"2023-03-17T08:39:18.302494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:03:34.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:35.230447+0000","last_change":"2023-03-17T08:12:56.304092+0000","last_active":"2023-03-17T08:39:35.230447+0000","last_peered":"2023-03-17T08:39:35.230447+0000","last_clean":"2023-03-17T08:39:35.230447+0000","last_became_active":"2023-03-17T08:12:56.303243+0000","last_became_peered":"2023-03-17T08:12:56.303243+0000","last_unstale":"2023-03-17T08:39:35.230447+0000","last_undegraded":"2023-03-17T08:39:35.230447+0000","last_fullsized":"2023-03-17T08:39:35.230447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:03:39.228918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:19.304103+0000","last_change":"2023-03-17T08:12:44.015214+0000","last_active":"2023-03-17T08:39:19.304103+0000","last_peered":"2023-03-17T08:39:19.304103+0000","last_clean":"2023-03-17T08:39:19.304103+0000","last_became_active":"2023-03-17T08:12:44.014912+0000","last_became_peered":"2023-03-17T08:12:44.014912+0000","last_unstale":"2023-03-17T08:39:19.304103+0000","last_undegraded":"2023-03-17T08:39:19.304103+0000","last_fullsized":"2023-03-17T08:39:19.304103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:19:35.522109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:08.382224+0000","last_change":"2023-03-17T08:12:56.309797+0000","last_active":"2023-03-17T08:41:08.382224+0000","last_peered":"2023-03-17T08:41:08.382224+0000","last_clean":"2023-03-17T08:41:08.382224+0000","last_became_active":"2023-03-17T08:12:56.309454+0000","last_became_peered":"2023-03-17T08:12:56.309454+0000","last_unstale":"2023-03-17T08:41:08.382224+0000","last_undegraded":"2023-03-17T08:41:08.382224+0000","last_fullsized":"2023-03-17T08:41:08.382224+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:53:24.251423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'41","reported_seq":3576,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:03.786995+0000","last_change":"2023-03-17T08:13:43.321426+0000","last_active":"2023-03-17T08:44:03.786995+0000","last_peered":"2023-03-17T08:44:03.786995+0000","last_clean":"2023-03-17T08:44:03.786995+0000","last_became_active":"2023-03-17T08:13:43.313523+0000","last_became_peered":"2023-03-17T08:13:43.313523+0000","last_unstale":"2023-03-17T08:44:03.786995+0000","last_undegraded":"2023-03-17T08:44:03.786995+0000","last_fullsized":"2023-03-17T08:44:03.786995+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:56.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67869,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3486,"num_read_kb":1809,"num_write":43,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:34.365178+0000","last_change":"2023-03-17T08:12:56.302819+0000","last_active":"2023-03-17T08:39:34.365178+0000","last_peered":"2023-03-17T08:39:34.365178+0000","last_clean":"2023-03-17T08:39:34.365178+0000","last_became_active":"2023-03-17T08:12:56.302484+0000","last_became_peered":"2023-03-17T08:12:56.302484+0000","last_unstale":"2023-03-17T08:39:34.365178+0000","last_undegraded":"2023-03-17T08:39:34.365178+0000","last_fullsized":"2023-03-17T08:39:34.365178+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:42:41.675082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:46.769070+0000","last_change":"2023-03-17T08:13:43.317713+0000","last_active":"2023-03-17T08:41:46.769070+0000","last_peered":"2023-03-17T08:41:46.769070+0000","last_clean":"2023-03-17T08:41:46.769070+0000","last_became_active":"2023-03-17T08:13:43.312324+0000","last_became_peered":"2023-03-17T08:13:43.312324+0000","last_unstale":"2023-03-17T08:41:46.769070+0000","last_undegraded":"2023-03-17T08:41:46.769070+0000","last_fullsized":"2023-03-17T08:41:46.769070+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:57:05.919221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:59.200304+0000","last_change":"2023-03-17T08:12:56.314540+0000","last_active":"2023-03-17T08:40:59.200304+0000","last_peered":"2023-03-17T08:40:59.200304+0000","last_clean":"2023-03-17T08:40:59.200304+0000","last_became_active":"2023-03-17T08:12:56.314192+0000","last_became_peered":"2023-03-17T08:12:56.314192+0000","last_unstale":"2023-03-17T08:40:59.200304+0000","last_undegraded":"2023-03-17T08:40:59.200304+0000","last_fullsized":"2023-03-17T08:40:59.200304+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:37:25.881660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:44.313323+0000","last_change":"2023-03-17T08:12:43.715223+0000","last_active":"2023-03-17T08:40:44.313323+0000","last_peered":"2023-03-17T08:40:44.313323+0000","last_clean":"2023-03-17T08:40:44.313323+0000","last_became_active":"2023-03-17T08:12:43.714868+0000","last_became_peered":"2023-03-17T08:12:43.714868+0000","last_unstale":"2023-03-17T08:40:44.313323+0000","last_undegraded":"2023-03-17T08:40:44.313323+0000","last_fullsized":"2023-03-17T08:40:44.313323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:36:42.378852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.314906+0000","last_change":"2023-03-17T08:12:56.314717+0000","last_active":"2023-03-17T08:40:58.314906+0000","last_peered":"2023-03-17T08:40:58.314906+0000","last_clean":"2023-03-17T08:40:58.314906+0000","last_became_active":"2023-03-17T08:12:56.314383+0000","last_became_peered":"2023-03-17T08:12:56.314383+0000","last_unstale":"2023-03-17T08:40:58.314906+0000","last_undegraded":"2023-03-17T08:40:58.314906+0000","last_fullsized":"2023-03-17T08:40:58.314906+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:14:19.308302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'8","reported_seq":1781,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:04.944867+0000","last_change":"2023-03-17T08:12:43.718328+0000","last_active":"2023-03-17T08:44:04.944867+0000","last_peered":"2023-03-17T08:44:04.944867+0000","last_clean":"2023-03-17T08:44:04.944867+0000","last_became_active":"2023-03-17T08:12:43.717988+0000","last_became_peered":"2023-03-17T08:12:43.717988+0000","last_unstale":"2023-03-17T08:44:04.944867+0000","last_undegraded":"2023-03-17T08:44:04.944867+0000","last_fullsized":"2023-03-17T08:44:04.944867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:04:02.422169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1570,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1744,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.314848+0000","last_change":"2023-03-17T08:12:56.302229+0000","last_active":"2023-03-17T08:40:58.314848+0000","last_peered":"2023-03-17T08:40:58.314848+0000","last_clean":"2023-03-17T08:40:58.314848+0000","last_became_active":"2023-03-17T08:12:56.301825+0000","last_became_peered":"2023-03-17T08:12:56.301825+0000","last_unstale":"2023-03-17T08:40:58.314848+0000","last_undegraded":"2023-03-17T08:40:58.314848+0000","last_fullsized":"2023-03-17T08:40:58.314848+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:15:56.269790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"91'17","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:44.373130+0000","last_change":"2023-03-17T08:12:44.015167+0000","last_active":"2023-03-17T08:40:44.373130+0000","last_peered":"2023-03-17T08:40:44.373130+0000","last_clean":"2023-03-17T08:40:44.373130+0000","last_became_active":"2023-03-17T08:12:44.014835+0000","last_became_peered":"2023-03-17T08:12:44.014835+0000","last_unstale":"2023-03-17T08:40:44.373130+0000","last_undegraded":"2023-03-17T08:40:44.373130+0000","last_fullsized":"2023-03-17T08:40:44.373130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:10:38.972066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:44.700447+0000","last_change":"2023-03-17T08:13:43.312788+0000","last_active":"2023-03-17T08:41:44.700447+0000","last_peered":"2023-03-17T08:41:44.700447+0000","last_clean":"2023-03-17T08:41:44.700447+0000","last_became_active":"2023-03-17T08:13:43.312148+0000","last_became_peered":"2023-03-17T08:13:43.312148+0000","last_unstale":"2023-03-17T08:41:44.700447+0000","last_undegraded":"2023-03-17T08:41:44.700447+0000","last_fullsized":"2023-03-17T08:41:44.700447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:41:44.391862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.763614+0000","last_change":"2023-03-17T08:13:43.324188+0000","last_active":"2023-03-17T08:40:56.763614+0000","last_peered":"2023-03-17T08:40:56.763614+0000","last_clean":"2023-03-17T08:40:56.763614+0000","last_became_active":"2023-03-17T08:13:43.313266+0000","last_became_peered":"2023-03-17T08:13:43.313266+0000","last_unstale":"2023-03-17T08:40:56.763614+0000","last_undegraded":"2023-03-17T08:40:56.763614+0000","last_fullsized":"2023-03-17T08:40:56.763614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:24:30.744500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:56.756928+0000","last_change":"2023-03-17T08:12:56.305106+0000","last_active":"2023-03-17T08:39:56.756928+0000","last_peered":"2023-03-17T08:39:56.756928+0000","last_clean":"2023-03-17T08:39:56.756928+0000","last_became_active":"2023-03-17T08:12:56.304736+0000","last_became_peered":"2023-03-17T08:12:56.304736+0000","last_unstale":"2023-03-17T08:39:56.756928+0000","last_undegraded":"2023-03-17T08:39:56.756928+0000","last_fullsized":"2023-03-17T08:39:56.756928+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:43:53.935528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"91'1","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:54.701399+0000","last_change":"2023-03-17T08:12:44.015025+0000","last_active":"2023-03-17T08:41:54.701399+0000","last_peered":"2023-03-17T08:41:54.701399+0000","last_clean":"2023-03-17T08:41:54.701399+0000","last_became_active":"2023-03-17T08:12:44.014663+0000","last_became_peered":"2023-03-17T08:12:44.014663+0000","last_unstale":"2023-03-17T08:41:54.701399+0000","last_undegraded":"2023-03-17T08:41:54.701399+0000","last_fullsized":"2023-03-17T08:41:54.701399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:59:22.603171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:09.411844+0000","last_change":"2023-03-17T08:12:56.308116+0000","last_active":"2023-03-17T08:40:09.411844+0000","last_peered":"2023-03-17T08:40:09.411844+0000","last_clean":"2023-03-17T08:40:09.411844+0000","last_became_active":"2023-03-17T08:12:56.307808+0000","last_became_peered":"2023-03-17T08:12:56.307808+0000","last_unstale":"2023-03-17T08:40:09.411844+0000","last_undegraded":"2023-03-17T08:40:09.411844+0000","last_fullsized":"2023-03-17T08:40:09.411844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:17:52.877199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":1775,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:01.939898+0000","last_change":"2023-03-17T08:12:43.715176+0000","last_active":"2023-03-17T08:44:01.939898+0000","last_peered":"2023-03-17T08:44:01.939898+0000","last_clean":"2023-03-17T08:44:01.939898+0000","last_became_active":"2023-03-17T08:12:43.714870+0000","last_became_peered":"2023-03-17T08:12:43.714870+0000","last_unstale":"2023-03-17T08:44:01.939898+0000","last_undegraded":"2023-03-17T08:44:01.939898+0000","last_fullsized":"2023-03-17T08:44:01.939898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:03:49.113671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1737,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.411151+0000","last_change":"2023-03-17T08:13:43.454867+0000","last_active":"2023-03-17T08:40:04.411151+0000","last_peered":"2023-03-17T08:40:04.411151+0000","last_clean":"2023-03-17T08:40:04.411151+0000","last_became_active":"2023-03-17T08:13:43.454457+0000","last_became_peered":"2023-03-17T08:13:43.454457+0000","last_unstale":"2023-03-17T08:40:04.411151+0000","last_undegraded":"2023-03-17T08:40:04.411151+0000","last_fullsized":"2023-03-17T08:40:04.411151+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:41:52.724548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:04.315516+0000","last_change":"2023-03-17T08:12:56.312117+0000","last_active":"2023-03-17T08:41:04.315516+0000","last_peered":"2023-03-17T08:41:04.315516+0000","last_clean":"2023-03-17T08:41:04.315516+0000","last_became_active":"2023-03-17T08:12:56.310335+0000","last_became_peered":"2023-03-17T08:12:56.310335+0000","last_unstale":"2023-03-17T08:41:04.315516+0000","last_undegraded":"2023-03-17T08:41:04.315516+0000","last_fullsized":"2023-03-17T08:41:04.315516+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:11:14.755773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'8","reported_seq":1777,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:02.941153+0000","last_change":"2023-03-17T08:12:44.015022+0000","last_active":"2023-03-17T08:44:02.941153+0000","last_peered":"2023-03-17T08:44:02.941153+0000","last_clean":"2023-03-17T08:44:02.941153+0000","last_became_active":"2023-03-17T08:12:44.014443+0000","last_became_peered":"2023-03-17T08:12:44.014443+0000","last_unstale":"2023-03-17T08:44:02.941153+0000","last_undegraded":"2023-03-17T08:44:02.941153+0000","last_fullsized":"2023-03-17T08:44:02.941153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:44:17.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1737,"num_read_kb":1737,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.429369+0000","last_change":"2023-03-17T08:12:56.311692+0000","last_active":"2023-03-17T08:40:04.429369+0000","last_peered":"2023-03-17T08:40:04.429369+0000","last_clean":"2023-03-17T08:40:04.429369+0000","last_became_active":"2023-03-17T08:12:56.311363+0000","last_became_peered":"2023-03-17T08:12:56.311363+0000","last_unstale":"2023-03-17T08:40:04.429369+0000","last_undegraded":"2023-03-17T08:40:04.429369+0000","last_fullsized":"2023-03-17T08:40:04.429369+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:26:28.229738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"91'6","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:56.171390+0000","last_change":"2023-03-17T08:12:43.718535+0000","last_active":"2023-03-17T08:41:56.171390+0000","last_peered":"2023-03-17T08:41:56.171390+0000","last_clean":"2023-03-17T08:41:56.171390+0000","last_became_active":"2023-03-17T08:12:43.718015+0000","last_became_peered":"2023-03-17T08:12:43.718015+0000","last_unstale":"2023-03-17T08:41:56.171390+0000","last_undegraded":"2023-03-17T08:41:56.171390+0000","last_fullsized":"2023-03-17T08:41:56.171390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:09:08.866057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":359,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:33.319040+0000","last_change":"2023-03-17T08:08:03.320638+0000","last_active":"2023-03-17T08:41:33.319040+0000","last_peered":"2023-03-17T08:41:33.319040+0000","last_clean":"2023-03-17T08:41:33.319040+0000","last_became_active":"2023-03-17T08:08:03.320176+0000","last_became_peered":"2023-03-17T08:08:03.320176+0000","last_unstale":"2023-03-17T08:41:33.319040+0000","last_undegraded":"2023-03-17T08:41:33.319040+0000","last_fullsized":"2023-03-17T08:41:33.319040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:00:25.080219+0000","last_clean_scrub_stamp":"2023-03-17T08:00:25.080219+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T18:17:37.097940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.194045+0000","last_change":"2023-03-17T08:12:56.311689+0000","last_active":"2023-03-17T08:40:04.194045+0000","last_peered":"2023-03-17T08:40:04.194045+0000","last_clean":"2023-03-17T08:40:04.194045+0000","last_became_active":"2023-03-17T08:12:56.306161+0000","last_became_peered":"2023-03-17T08:12:56.306161+0000","last_unstale":"2023-03-17T08:40:04.194045+0000","last_undegraded":"2023-03-17T08:40:04.194045+0000","last_fullsized":"2023-03-17T08:40:04.194045+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:31:37.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"91'4","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:48.313783+0000","last_change":"2023-03-17T08:12:43.719362+0000","last_active":"2023-03-17T08:40:48.313783+0000","last_peered":"2023-03-17T08:40:48.313783+0000","last_clean":"2023-03-17T08:40:48.313783+0000","last_became_active":"2023-03-17T08:12:43.719054+0000","last_became_peered":"2023-03-17T08:12:43.719054+0000","last_unstale":"2023-03-17T08:40:48.313783+0000","last_undegraded":"2023-03-17T08:40:48.313783+0000","last_fullsized":"2023-03-17T08:40:48.313783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:58:59.304236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"91'4","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:59.381189+0000","last_change":"2023-03-17T08:12:44.014952+0000","last_active":"2023-03-17T08:41:59.381189+0000","last_peered":"2023-03-17T08:41:59.381189+0000","last_clean":"2023-03-17T08:41:59.381189+0000","last_became_active":"2023-03-17T08:12:44.014658+0000","last_became_peered":"2023-03-17T08:12:44.014658+0000","last_unstale":"2023-03-17T08:41:59.381189+0000","last_undegraded":"2023-03-17T08:41:59.381189+0000","last_fullsized":"2023-03-17T08:41:59.381189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:15:14.464350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:04.194176+0000","last_change":"2023-03-17T08:12:56.305387+0000","last_active":"2023-03-17T08:40:04.194176+0000","last_peered":"2023-03-17T08:40:04.194176+0000","last_clean":"2023-03-17T08:40:04.194176+0000","last_became_active":"2023-03-17T08:12:56.305025+0000","last_became_peered":"2023-03-17T08:12:56.305025+0000","last_unstale":"2023-03-17T08:40:04.194176+0000","last_undegraded":"2023-03-17T08:40:04.194176+0000","last_fullsized":"2023-03-17T08:40:04.194176+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:07:11.837842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'16","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.695292+0000","last_change":"2023-03-17T08:12:43.712579+0000","last_active":"2023-03-17T08:40:54.695292+0000","last_peered":"2023-03-17T08:40:54.695292+0000","last_clean":"2023-03-17T08:40:54.695292+0000","last_became_active":"2023-03-17T08:12:43.712217+0000","last_became_peered":"2023-03-17T08:12:43.712217+0000","last_unstale":"2023-03-17T08:40:54.695292+0000","last_undegraded":"2023-03-17T08:40:54.695292+0000","last_fullsized":"2023-03-17T08:40:54.695292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:37:08.374951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437295+0000","last_change":"2023-03-17T08:12:56.316897+0000","last_active":"2023-03-17T08:41:09.437295+0000","last_peered":"2023-03-17T08:41:09.437295+0000","last_clean":"2023-03-17T08:41:09.437295+0000","last_became_active":"2023-03-17T08:12:56.316522+0000","last_became_peered":"2023-03-17T08:12:56.316522+0000","last_unstale":"2023-03-17T08:41:09.437295+0000","last_undegraded":"2023-03-17T08:41:09.437295+0000","last_fullsized":"2023-03-17T08:41:09.437295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T20:04:01.056628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"91'7","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:56.164948+0000","last_change":"2023-03-17T08:12:43.841131+0000","last_active":"2023-03-17T08:40:56.164948+0000","last_peered":"2023-03-17T08:40:56.164948+0000","last_clean":"2023-03-17T08:40:56.164948+0000","last_became_active":"2023-03-17T08:12:43.840746+0000","last_became_peered":"2023-03-17T08:12:43.840746+0000","last_unstale":"2023-03-17T08:40:56.164948+0000","last_undegraded":"2023-03-17T08:40:56.164948+0000","last_fullsized":"2023-03-17T08:40:56.164948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:57.292918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:10.241458+0000","last_change":"2023-03-17T08:12:56.302005+0000","last_active":"2023-03-17T08:41:10.241458+0000","last_peered":"2023-03-17T08:41:10.241458+0000","last_clean":"2023-03-17T08:41:10.241458+0000","last_became_active":"2023-03-17T08:12:56.301362+0000","last_became_peered":"2023-03-17T08:12:56.301362+0000","last_unstale":"2023-03-17T08:41:10.241458+0000","last_undegraded":"2023-03-17T08:41:10.241458+0000","last_fullsized":"2023-03-17T08:41:10.241458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:45:23.221872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"91'2","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:53.380424+0000","last_change":"2023-03-17T08:12:44.014883+0000","last_active":"2023-03-17T08:40:53.380424+0000","last_peered":"2023-03-17T08:40:53.380424+0000","last_clean":"2023-03-17T08:40:53.380424+0000","last_became_active":"2023-03-17T08:12:44.014596+0000","last_became_peered":"2023-03-17T08:12:44.014596+0000","last_unstale":"2023-03-17T08:40:53.380424+0000","last_undegraded":"2023-03-17T08:40:53.380424+0000","last_fullsized":"2023-03-17T08:40:53.380424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:04:02.229088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.375665+0000","last_change":"2023-03-17T08:12:56.301687+0000","last_active":"2023-03-17T08:41:09.375665+0000","last_peered":"2023-03-17T08:41:09.375665+0000","last_clean":"2023-03-17T08:41:09.375665+0000","last_became_active":"2023-03-17T08:12:56.301383+0000","last_became_peered":"2023-03-17T08:12:56.301383+0000","last_unstale":"2023-03-17T08:41:09.375665+0000","last_undegraded":"2023-03-17T08:41:09.375665+0000","last_fullsized":"2023-03-17T08:41:09.375665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:07:56.609736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"91'7","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:54.435504+0000","last_change":"2023-03-17T08:12:43.718257+0000","last_active":"2023-03-17T08:40:54.435504+0000","last_peered":"2023-03-17T08:40:54.435504+0000","last_clean":"2023-03-17T08:40:54.435504+0000","last_became_active":"2023-03-17T08:12:43.717711+0000","last_became_peered":"2023-03-17T08:12:43.717711+0000","last_unstale":"2023-03-17T08:40:54.435504+0000","last_undegraded":"2023-03-17T08:40:54.435504+0000","last_fullsized":"2023-03-17T08:40:54.435504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:02:53.751853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:06.764605+0000","last_change":"2023-03-17T08:12:56.309026+0000","last_active":"2023-03-17T08:41:06.764605+0000","last_peered":"2023-03-17T08:41:06.764605+0000","last_clean":"2023-03-17T08:41:06.764605+0000","last_became_active":"2023-03-17T08:12:56.308636+0000","last_became_peered":"2023-03-17T08:12:56.308636+0000","last_unstale":"2023-03-17T08:41:06.764605+0000","last_undegraded":"2023-03-17T08:41:06.764605+0000","last_fullsized":"2023-03-17T08:41:06.764605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:23:25.302366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'5","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:58.991732+0000","last_change":"2023-03-17T08:12:43.716568+0000","last_active":"2023-03-17T08:40:58.991732+0000","last_peered":"2023-03-17T08:40:58.991732+0000","last_clean":"2023-03-17T08:40:58.991732+0000","last_became_active":"2023-03-17T08:12:43.716236+0000","last_became_peered":"2023-03-17T08:12:43.716236+0000","last_unstale":"2023-03-17T08:40:58.991732+0000","last_undegraded":"2023-03-17T08:40:58.991732+0000","last_fullsized":"2023-03-17T08:40:58.991732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:51:01.787084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.428902+0000","last_change":"2023-03-17T08:12:56.310175+0000","last_active":"2023-03-17T08:39:59.428902+0000","last_peered":"2023-03-17T08:39:59.428902+0000","last_clean":"2023-03-17T08:39:59.428902+0000","last_became_active":"2023-03-17T08:12:56.308754+0000","last_became_peered":"2023-03-17T08:12:56.308754+0000","last_unstale":"2023-03-17T08:39:59.428902+0000","last_undegraded":"2023-03-17T08:39:59.428902+0000","last_fullsized":"2023-03-17T08:39:59.428902+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:30:31.444423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"91'4","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:39.365715+0000","last_change":"2023-03-17T08:12:43.715828+0000","last_active":"2023-03-17T08:39:39.365715+0000","last_peered":"2023-03-17T08:39:39.365715+0000","last_clean":"2023-03-17T08:39:39.365715+0000","last_became_active":"2023-03-17T08:12:43.715522+0000","last_became_peered":"2023-03-17T08:12:43.715522+0000","last_unstale":"2023-03-17T08:39:39.365715+0000","last_undegraded":"2023-03-17T08:39:39.365715+0000","last_fullsized":"2023-03-17T08:39:39.365715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:33:46.250385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:13.316741+0000","last_change":"2023-03-17T08:12:56.312308+0000","last_active":"2023-03-17T08:41:13.316741+0000","last_peered":"2023-03-17T08:41:13.316741+0000","last_clean":"2023-03-17T08:41:13.316741+0000","last_became_active":"2023-03-17T08:12:56.311917+0000","last_became_peered":"2023-03-17T08:12:56.311917+0000","last_unstale":"2023-03-17T08:41:13.316741+0000","last_undegraded":"2023-03-17T08:41:13.316741+0000","last_fullsized":"2023-03-17T08:41:13.316741+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:12:49.617050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":1774,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:44:02.614694+0000","last_change":"2023-03-17T08:12:44.015248+0000","last_active":"2023-03-17T08:44:02.614694+0000","last_peered":"2023-03-17T08:44:02.614694+0000","last_clean":"2023-03-17T08:44:02.614694+0000","last_became_active":"2023-03-17T08:12:44.014904+0000","last_became_peered":"2023-03-17T08:12:44.014904+0000","last_unstale":"2023-03-17T08:44:02.614694+0000","last_undegraded":"2023-03-17T08:44:02.614694+0000","last_fullsized":"2023-03-17T08:44:02.614694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:05:00.738216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1621,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1738,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.307459+0000","last_change":"2023-03-17T08:12:56.304882+0000","last_active":"2023-03-17T08:39:58.307459+0000","last_peered":"2023-03-17T08:39:58.307459+0000","last_clean":"2023-03-17T08:39:58.307459+0000","last_became_active":"2023-03-17T08:12:56.304540+0000","last_became_peered":"2023-03-17T08:12:56.304540+0000","last_unstale":"2023-03-17T08:39:58.307459+0000","last_undegraded":"2023-03-17T08:39:58.307459+0000","last_fullsized":"2023-03-17T08:39:58.307459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T16:49:58.035024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'3","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.306762+0000","last_change":"2023-03-17T08:12:43.714764+0000","last_active":"2023-03-17T08:39:44.306762+0000","last_peered":"2023-03-17T08:39:44.306762+0000","last_clean":"2023-03-17T08:39:44.306762+0000","last_became_active":"2023-03-17T08:12:43.714442+0000","last_became_peered":"2023-03-17T08:12:43.714442+0000","last_unstale":"2023-03-17T08:39:44.306762+0000","last_undegraded":"2023-03-17T08:39:44.306762+0000","last_fullsized":"2023-03-17T08:39:44.306762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:11:41.035392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.307434+0000","last_change":"2023-03-17T08:12:56.312526+0000","last_active":"2023-03-17T08:39:58.307434+0000","last_peered":"2023-03-17T08:39:58.307434+0000","last_clean":"2023-03-17T08:39:58.307434+0000","last_became_active":"2023-03-17T08:12:56.312117+0000","last_became_peered":"2023-03-17T08:12:56.312117+0000","last_unstale":"2023-03-17T08:39:58.307434+0000","last_undegraded":"2023-03-17T08:39:58.307434+0000","last_fullsized":"2023-03-17T08:39:58.307434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T10:40:10.876741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:44.191515+0000","last_change":"2023-03-17T08:12:43.713179+0000","last_active":"2023-03-17T08:39:44.191515+0000","last_peered":"2023-03-17T08:39:44.191515+0000","last_clean":"2023-03-17T08:39:44.191515+0000","last_became_active":"2023-03-17T08:12:43.712856+0000","last_became_peered":"2023-03-17T08:12:43.712856+0000","last_unstale":"2023-03-17T08:39:44.191515+0000","last_undegraded":"2023-03-17T08:39:44.191515+0000","last_fullsized":"2023-03-17T08:39:44.191515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:42.702150+0000","last_clean_scrub_stamp":"2023-03-17T08:12:42.702150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:14:38.544708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.308036+0000","last_change":"2023-03-17T08:12:56.313566+0000","last_active":"2023-03-17T08:40:03.308036+0000","last_peered":"2023-03-17T08:40:03.308036+0000","last_clean":"2023-03-17T08:40:03.308036+0000","last_became_active":"2023-03-17T08:12:56.313216+0000","last_became_peered":"2023-03-17T08:12:56.313216+0000","last_unstale":"2023-03-17T08:40:03.308036+0000","last_undegraded":"2023-03-17T08:40:03.308036+0000","last_fullsized":"2023-03-17T08:40:03.308036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T13:42:00.438252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:01.757587+0000","last_change":"2023-03-17T08:12:56.308162+0000","last_active":"2023-03-17T08:40:01.757587+0000","last_peered":"2023-03-17T08:40:01.757587+0000","last_clean":"2023-03-17T08:40:01.757587+0000","last_became_active":"2023-03-17T08:12:56.307758+0000","last_became_peered":"2023-03-17T08:12:56.307758+0000","last_unstale":"2023-03-17T08:40:01.757587+0000","last_undegraded":"2023-03-17T08:40:01.757587+0000","last_fullsized":"2023-03-17T08:40:01.757587+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T11:47:21.639612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985558+0000","last_change":"2023-03-17T08:12:56.306164+0000","last_active":"2023-03-17T08:40:03.985558+0000","last_peered":"2023-03-17T08:40:03.985558+0000","last_clean":"2023-03-17T08:40:03.985558+0000","last_became_active":"2023-03-17T08:12:56.305845+0000","last_became_peered":"2023-03-17T08:12:56.305845+0000","last_unstale":"2023-03-17T08:40:03.985558+0000","last_undegraded":"2023-03-17T08:40:03.985558+0000","last_fullsized":"2023-03-17T08:40:03.985558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T08:30:51.025366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:03.985580+0000","last_change":"2023-03-17T08:12:56.310443+0000","last_active":"2023-03-17T08:40:03.985580+0000","last_peered":"2023-03-17T08:40:03.985580+0000","last_clean":"2023-03-17T08:40:03.985580+0000","last_became_active":"2023-03-17T08:12:56.310117+0000","last_became_peered":"2023-03-17T08:12:56.310117+0000","last_unstale":"2023-03-17T08:40:03.985580+0000","last_undegraded":"2023-03-17T08:40:03.985580+0000","last_fullsized":"2023-03-17T08:40:03.985580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:52:02.076302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:40:10.234444+0000","last_change":"2023-03-17T08:12:56.305637+0000","last_active":"2023-03-17T08:40:10.234444+0000","last_peered":"2023-03-17T08:40:10.234444+0000","last_clean":"2023-03-17T08:40:10.234444+0000","last_became_active":"2023-03-17T08:12:56.304657+0000","last_became_peered":"2023-03-17T08:12:56.304657+0000","last_unstale":"2023-03-17T08:40:10.234444+0000","last_undegraded":"2023-03-17T08:40:10.234444+0000","last_fullsized":"2023-03-17T08:40:10.234444+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:14:27.663982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.201598+0000","last_change":"2023-03-17T08:12:56.310243+0000","last_active":"2023-03-17T08:41:09.201598+0000","last_peered":"2023-03-17T08:41:09.201598+0000","last_clean":"2023-03-17T08:41:09.201598+0000","last_became_active":"2023-03-17T08:12:56.309846+0000","last_became_peered":"2023-03-17T08:12:56.309846+0000","last_unstale":"2023-03-17T08:41:09.201598+0000","last_undegraded":"2023-03-17T08:41:09.201598+0000","last_fullsized":"2023-03-17T08:41:09.201598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:54:08.554990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:06.764665+0000","last_change":"2023-03-17T08:12:56.305594+0000","last_active":"2023-03-17T08:41:06.764665+0000","last_peered":"2023-03-17T08:41:06.764665+0000","last_clean":"2023-03-17T08:41:06.764665+0000","last_became_active":"2023-03-17T08:12:56.305269+0000","last_became_peered":"2023-03-17T08:12:56.305269+0000","last_unstale":"2023-03-17T08:41:06.764665+0000","last_undegraded":"2023-03-17T08:41:06.764665+0000","last_fullsized":"2023-03-17T08:41:06.764665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:07:05.010296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:08.992970+0000","last_change":"2023-03-17T08:12:56.305700+0000","last_active":"2023-03-17T08:41:08.992970+0000","last_peered":"2023-03-17T08:41:08.992970+0000","last_clean":"2023-03-17T08:41:08.992970+0000","last_became_active":"2023-03-17T08:12:56.305321+0000","last_became_peered":"2023-03-17T08:12:56.305321+0000","last_unstale":"2023-03-17T08:41:08.992970+0000","last_undegraded":"2023-03-17T08:41:08.992970+0000","last_fullsized":"2023-03-17T08:41:08.992970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T12:32:57.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:09.437279+0000","last_change":"2023-03-17T08:12:56.316187+0000","last_active":"2023-03-17T08:41:09.437279+0000","last_peered":"2023-03-17T08:41:09.437279+0000","last_clean":"2023-03-17T08:41:09.437279+0000","last_became_active":"2023-03-17T08:12:56.315818+0000","last_became_peered":"2023-03-17T08:12:56.315818+0000","last_unstale":"2023-03-17T08:41:09.437279+0000","last_undegraded":"2023-03-17T08:41:09.437279+0000","last_fullsized":"2023-03-17T08:41:09.437279+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T17:03:53.627132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:41:14.316748+0000","last_change":"2023-03-17T08:12:56.301953+0000","last_active":"2023-03-17T08:41:14.316748+0000","last_peered":"2023-03-17T08:41:14.316748+0000","last_clean":"2023-03-17T08:41:14.316748+0000","last_became_active":"2023-03-17T08:12:56.301593+0000","last_became_peered":"2023-03-17T08:12:56.301593+0000","last_unstale":"2023-03-17T08:41:14.316748+0000","last_undegraded":"2023-03-17T08:41:14.316748+0000","last_fullsized":"2023-03-17T08:41:14.316748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:21:22.111310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.428856+0000","last_change":"2023-03-17T08:12:56.312692+0000","last_active":"2023-03-17T08:39:59.428856+0000","last_peered":"2023-03-17T08:39:59.428856+0000","last_clean":"2023-03-17T08:39:59.428856+0000","last_became_active":"2023-03-17T08:12:56.312370+0000","last_became_peered":"2023-03-17T08:12:56.312370+0000","last_unstale":"2023-03-17T08:39:59.428856+0000","last_undegraded":"2023-03-17T08:39:59.428856+0000","last_fullsized":"2023-03-17T08:39:59.428856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T19:27:52.367867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:58.373843+0000","last_change":"2023-03-17T08:12:56.315298+0000","last_active":"2023-03-17T08:39:58.373843+0000","last_peered":"2023-03-17T08:39:58.373843+0000","last_clean":"2023-03-17T08:39:58.373843+0000","last_became_active":"2023-03-17T08:12:56.314962+0000","last_became_peered":"2023-03-17T08:12:56.314962+0000","last_unstale":"2023-03-17T08:39:58.373843+0000","last_undegraded":"2023-03-17T08:39:58.373843+0000","last_fullsized":"2023-03-17T08:39:58.373843+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T14:08:47.292784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:59.193505+0000","last_change":"2023-03-17T08:12:56.313966+0000","last_active":"2023-03-17T08:39:59.193505+0000","last_peered":"2023-03-17T08:39:59.193505+0000","last_clean":"2023-03-17T08:39:59.193505+0000","last_became_active":"2023-03-17T08:12:56.313598+0000","last_became_peered":"2023-03-17T08:12:56.313598+0000","last_unstale":"2023-03-17T08:39:59.193505+0000","last_undegraded":"2023-03-17T08:39:59.193505+0000","last_fullsized":"2023-03-17T08:39:59.193505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T09:04:40.402329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-03-17T08:39:56.756904+0000","last_change":"2023-03-17T08:12:56.308877+0000","last_active":"2023-03-17T08:39:56.756904+0000","last_peered":"2023-03-17T08:39:56.756904+0000","last_clean":"2023-03-17T08:39:56.756904+0000","last_became_active":"2023-03-17T08:12:56.308461+0000","last_became_peered":"2023-03-17T08:12:56.308461+0000","last_unstale":"2023-03-17T08:39:56.756904+0000","last_undegraded":"2023-03-17T08:39:56.756904+0000","last_fullsized":"2023-03-17T08:39:56.756904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-17T08:12:55.277951+0000","last_clean_scrub_stamp":"2023-03-17T08:12:55.277951+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-18T15:37:39.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77157,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":17411,"num_read_kb":8790,"num_write":278,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1620,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":231471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":238,"ondisk_log_size":238,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351403,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":1007616,"data_stored":483855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.81000000000000005,"5min":0.878,"15min":0.90500000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.496,"5min":0.46999999999999997,"15min":0.36599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.84899999999999998},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.52000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85599999999999998,"5min":0.92600000000000005,"15min":0.93300000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.496,"5min":0.39900000000000002,"15min":0.36899999999999999},"max":{"1min":0.77300000000000002,"5min":0.874,"15min":0.93899999999999995},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70199999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64900000000000002,"5min":0.872,"15min":0.872},"last":0.501}]},{"osd":3,"last update":"Fri Mar 17 08:43:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.42499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.98199999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.497,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.95399999999999996},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.60499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.90400000000000003,"15min":0.90500000000000003},"last":0.71099999999999997}]},{"osd":5,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.88100000000000001,"5min":0.89800000000000002,"15min":0.91200000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83199999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Mar 17 08:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48699999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.629},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93999999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94999999999999996,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.67000000000000004}]},{"osd":8,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.52800000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.92700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.753},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.47899999999999998,"5min":0.40200000000000002,"15min":0.39600000000000002},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78700000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.626,"5min":0.498,"15min":0.498},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.105},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.64300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81499999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:43:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.55500000000000005},"max":{"1min":1.0149999999999999,"5min":1.0229999999999999,"15min":1.0640000000000001},"last":0.746},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77400000000000002},"min":{"1min":0.65200000000000002,"5min":0.57699999999999996,"15min":0.56799999999999995},"max":{"1min":0.93899999999999995,"5min":0.96999999999999997,"15min":1.0109999999999999},"last":0.874}]}]},{"osd":10,"up_from":73,"seq":313532613044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7300,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737852,"statfs":{"total":95995035648,"available":95987560448,"internally_reserved":0,"allocated":1699840,"data_stored":1142869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.84399999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.82199999999999995,"15min":0.84099999999999997},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.436,"15min":0.45100000000000001},"min":{"1min":0.35099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76600000000000001},"last":0.375},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":0.67600000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.88300000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.625,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.92900000000000005},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":1.0229999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64100000000000001,"15min":0.64800000000000002},"min":{"1min":0.47299999999999998,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.91800000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.028,"5min":1.028,"15min":1.0820000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69099999999999995,"15min":0.70699999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.39600000000000002},"max":{"1min":0.95799999999999996,"5min":1.0069999999999999,"15min":1.2629999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.42099999999999999,"15min":0.39500000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0529999999999999},"last":0.754},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.55500000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Mar 17 08:12:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65300000000000002,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72199999999999998,"15min":0.78200000000000003},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76400000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.42099999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.44600000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.61599999999999999,"5min":0.51800000000000002,"15min":0.48499999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.04},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.754,"15min":0.76500000000000001},"min":{"1min":0.57099999999999995,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.052},"last":0.74399999999999999}]},{"osd":11,"last update":"Fri Mar 17 08:43:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.54000000000000004},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.68700000000000006}]}]},{"osd":9,"up_from":68,"seq":292057776575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6380,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":93738772,"statfs":{"total":95995035648,"available":95988502528,"internally_reserved":0,"allocated":1019904,"data_stored":483244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.47799999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":0.81999999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.28699999999999998},"max":{"1min":0.91300000000000003,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.374},"max":{"1min":0.83499999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.76300000000000001,"15min":0.71999999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.004},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.53000000000000003,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.6970000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1.03,"5min":1.085,"15min":1.085},"last":0.748}]},{"osd":3,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51200000000000001},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":1.45,"15min":1.45},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56599999999999995,"15min":0.54900000000000004},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.30199999999999999},"max":{"1min":0.745,"5min":1.1359999999999999,"15min":1.476},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78100000000000003,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.497,"15min":0.434},"max":{"1min":1.006,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.55400000000000005,"5min":0.505,"15min":0.41899999999999998},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":1.329},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.40699999999999997},"max":{"1min":0.98399999999999999,"5min":1.0660000000000001,"15min":1.417},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.437},"max":{"1min":0.97299999999999998,"5min":1.016,"15min":1.6739999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.32900000000000001},"max":{"1min":1.0249999999999999,"5min":1.034,"15min":1.5660000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81799999999999995,"15min":0.77900000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.34499999999999997},"max":{"1min":1.073,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.78700000000000003},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.47599999999999998},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.391},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.1659999999999999,"15min":1.6000000000000001},"last":0.90700000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.88700000000000001,"15min":0.85099999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47399999999999998},"max":{"1min":1.1220000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0840000000000001,"5min":1.107,"15min":1.4370000000000001},"last":0.73099999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.84799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.50700000000000001},"max":{"1min":1.117,"5min":1.393,"15min":1.393},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.65500000000000003,"5min":0.628,"15min":0.501},"max":{"1min":1.0680000000000001,"5min":1.1990000000000001,"15min":1.6299999999999999},"last":0.94199999999999995}]}]},{"osd":8,"up_from":60,"seq":257698038217,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6564,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738588,"statfs":{"total":95995035648,"available":95988314112,"internally_reserved":0,"allocated":1011712,"data_stored":483600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.47299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.82999999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.32500000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.45300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.874,"15min":0.92000000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.64400000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.88200000000000001},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48099999999999998,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.73999999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.34899999999999998,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.72699999999999998,"5min":0.87,"15min":0.87},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.878,"5min":0.89300000000000002,"15min":0.95799999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66900000000000004,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.46100000000000002,"15min":0.377},"max":{"1min":0.86599999999999999,"5min":0.89600000000000002,"15min":0.98099999999999998},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Mar 17 08:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.622},"min":{"1min":0.376,"5min":0.373,"15min":0.373},"max":{"1min":0.86399999999999999,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65100000000000002,"15min":0.64400000000000002},"min":{"1min":0.48499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83399999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68700000000000006,"5min":0.88100000000000001,"15min":0.95599999999999996},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.85599999999999998,"5min":1.018,"15min":1.018},"last":0.629},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44600000000000001,"15min":0.42699999999999999},"max":{"1min":0.95099999999999996,"5min":1.593,"15min":1.593},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.55500000000000005,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.0349999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.58199999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83599999999999997,"5min":1.026,"15min":1.073},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.64300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89400000000000002,"5min":1.0600000000000001,"15min":1.0629999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.63300000000000001,"5min":0.505,"15min":0.49299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0149999999999999,"15min":1.052},"last":0.876}]},{"osd":10,"last update":"Fri Mar 17 08:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.441},"max":{"1min":0.94799999999999995,"5min":1.034,"15min":1.069},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.65500000000000003,"5min":0.52700000000000002,"15min":0.505},"max":{"1min":0.88800000000000001,"5min":1.054,"15min":1.1220000000000001},"last":0.76400000000000001}]},{"osd":11,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.753},"min":{"1min":0.61699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91400000000000003,"5min":0.98499999999999999,"15min":1.085},"last":0.79200000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299860,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7216,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93737936,"statfs":{"total":95995035648,"available":95987646464,"internally_reserved":0,"allocated":1613824,"data_stored":1078170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.43099999999999999},"min":{"1min":0.28599999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55100000000000005,"5min":0.63100000000000001,"15min":0.746},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.29899999999999999},"max":{"1min":0.61299999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Mar 17 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.34599999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.432}]},{"osd":3,"last update":"Fri Mar 17 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.65500000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.39800000000000002},"max":{"1min":0.878,"5min":0.89500000000000002,"15min":0.94399999999999995},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40300000000000002},"max":{"1min":0.77700000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Mar 17 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.76700000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69899999999999995,"5min":0.73699999999999999,"15min":0.78500000000000003},"last":0.62}]},{"osd":5,"last update":"Fri Mar 17 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.93600000000000005},"last":0.503},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85399999999999998,"5min":0.90100000000000002,"15min":0.94399999999999995},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Mar 17 08:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45400000000000001,"15min":0.41399999999999998},"max":{"1min":0.85999999999999999,"5min":0.97799999999999998,"15min":0.999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71699999999999997,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.435,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54200000000000004}]},{"osd":8,"last update":"Fri Mar 17 08:43:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.71499999999999997},"min":{"1min":0.57099999999999995,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.88600000000000001,"5min":0.92000000000000004,"15min":1.008},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.002},"last":0.73899999999999999}]},{"osd":9,"last update":"Fri Mar 17 08:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96999999999999997,"5min":1.024,"15min":1.0369999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.60399999999999998,"5min":0.52100000000000002,"15min":0.504},"max":{"1min":0.93000000000000005,"5min":0.95099999999999996,"15min":0.95999999999999996},"last":0.71299999999999997}]},{"osd":10,"last update":"Fri Mar 17 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94399999999999995,"5min":0.97399999999999998,"15min":1.0269999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":1.0149999999999999},"last":0.78700000000000003}]},{"osd":11,"last update":"Fri Mar 17 08:44:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.034},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82499999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.002,"5min":1.056,"15min":1.056},"last":0.83799999999999997}]}]},{"osd":6,"up_from":47,"seq":201863463392,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":999424,"data_stored":483145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48399999999999999,"15min":0.46300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":1.478,"15min":1.478},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51100000000000001,"15min":0.49399999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":1.51,"15min":1.51},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89000000000000001,"5min":1.546,"15min":1.546},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.371},"max":{"1min":0.88300000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73399999999999999,"15min":0.69399999999999995},"min":{"1min":0.48799999999999999,"5min":0.40699999999999997,"15min":0.38300000000000001},"max":{"1min":1.0569999999999999,"5min":1.77,"15min":1.77},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.67200000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.038,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":0.80900000000000005,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63400000000000001,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.34300000000000003,"15min":0.307},"max":{"1min":0.92800000000000005,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.49099999999999999,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":0.997,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.746},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.443},"max":{"1min":1.022,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79600000000000004,"15min":0.76400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96899999999999997,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.72899999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.623}]},{"osd":7,"last update":"Fri Mar 17 08:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82299999999999995,"15min":0.81000000000000005},"min":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.47799999999999998},"max":{"1min":1.0740000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80000000000000004,"15min":0.79000000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0609999999999999,"5min":1.845,"15min":1.845},"last":0.84599999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.84399999999999997,"15min":0.81100000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.434},"max":{"1min":1.0109999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.80600000000000005},"min":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.51700000000000002},"max":{"1min":1.04,"5min":1.946,"15min":1.946},"last":0.879}]},{"osd":9,"last update":"Fri Mar 17 08:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83399999999999996,"15min":0.80900000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.044,"5min":1.994,"15min":1.994},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77900000000000003,"15min":0.75600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38800000000000001},"max":{"1min":0.99299999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.82499999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.874,"15min":0.85099999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.54700000000000004},"max":{"1min":1.107,"5min":2.028,"15min":2.028},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89400000000000002,"15min":0.86799999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.498},"max":{"1min":1.1000000000000001,"5min":2.04,"15min":2.04},"last":0.89800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575385,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7648,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":93737504,"statfs":{"total":95995035648,"available":95987204096,"internally_reserved":0,"allocated":1073152,"data_stored":552194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.435,"5min":0.39800000000000002,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":0.84899999999999998,"15min":0.94299999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.48699999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93300000000000005,"5min":1.008,"15min":1.022},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.42099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.90200000000000002,"5min":1.107,"15min":1.107},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63700000000000001,"15min":0.64700000000000002},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76900000000000002,"5min":0.82599999999999996,"15min":0.89200000000000002},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.95799999999999996,"5min":1.024,"15min":1.024},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68999999999999995,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.92400000000000004,"15min":0.92800000000000005},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.5,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.30399999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":1.105},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.74199999999999999},"min":{"1min":0.46400000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95699999999999996,"5min":1.0089999999999999,"15min":1.04},"last":0.748},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.47699999999999998},"max":{"1min":0.88800000000000001,"5min":0.92400000000000004,"15min":1.038},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.73099999999999998,"15min":0.72199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40400000000000003},"max":{"1min":0.874,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.70199999999999996},"min":{"1min":0.499,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.81999999999999995,"5min":1.048,"15min":1.048},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Mar 17 08:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.46600000000000003,"5min":0.41399999999999998,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":1.0609999999999999,"15min":1.0920000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.92300000000000004,"5min":1.224,"15min":1.224},"last":0.78000000000000003}]},{"osd":8,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48699999999999999},"max":{"1min":0.94799999999999995,"5min":1.153,"15min":1.153},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":0.91900000000000004,"5min":0.99299999999999999,"15min":1.1200000000000001},"last":0.69599999999999995}]},{"osd":9,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":1.042,"15min":1.042},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.85099999999999998,"15min":0.85199999999999998},"min":{"1min":0.67300000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98699999999999999,"5min":1.272,"15min":1.272},"last":0.85599999999999998}]},{"osd":10,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.76300000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.441,"15min":0.41499999999999998},"max":{"1min":0.871,"5min":0.98599999999999999,"15min":1.1579999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.42499999999999999},"max":{"1min":0.97199999999999998,"5min":1.256,"15min":1.256},"last":0.83199999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.61699999999999999},"max":{"1min":1.028,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83599999999999997,"15min":0.84499999999999997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.57999999999999996},"max":{"1min":1.018,"5min":1.044,"15min":1.133},"last":0.872}]}]},{"osd":0,"up_from":8,"seq":34359738916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7468,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737684,"statfs":{"total":95995035648,"available":95987388416,"internally_reserved":0,"allocated":1019904,"data_stored":484478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69899999999999995,"5min":0.92000000000000004,"15min":0.94299999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83699999999999997,"5min":0.84299999999999997,"15min":0.95999999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.48799999999999999,"5min":0.44900000000000001,"15min":0.36699999999999999},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":1.038},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70899999999999996,"15min":0.68100000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":0.95899999999999996,"15min":0.99199999999999999},"last":0.5}]},{"osd":3,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53800000000000003,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.89600000000000002,"15min":0.999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.875,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.75}]},{"osd":4,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90200000000000002,"5min":1.105,"15min":1.105},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71499999999999997,"15min":0.70899999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.42199999999999999},"max":{"1min":0.82499999999999996,"5min":1.081,"15min":1.081},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.52400000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0149999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.442},"max":{"1min":0.92100000000000004,"5min":0.98199999999999998,"15min":1.05},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0009999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.69899999999999995,"15min":0.69199999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Mar 17 08:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92500000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80800000000000005,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90100000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Fri Mar 17 08:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0529999999999999,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81399999999999995,"15min":0.80500000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.51200000000000001},"max":{"1min":1.044,"5min":1.123,"15min":1.123},"last":0.73099999999999998}]},{"osd":9,"last update":"Fri Mar 17 08:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":1.0589999999999999,"5min":1.119,"15min":1.119},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.79800000000000004},"min":{"1min":0.439,"5min":0.436,"15min":0.40899999999999997},"max":{"1min":1.075,"5min":1.129,"15min":1.165},"last":0.81000000000000005}]},{"osd":10,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.50700000000000001},"max":{"1min":0.96599999999999997,"5min":1.147,"15min":1.2050000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.2250000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82799999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84199999999999997,"15min":0.84999999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.1739999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.88300000000000001,"15min":0.877},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.169,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.85999999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7452,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":93737700,"statfs":{"total":95995035648,"available":95987404800,"internally_reserved":0,"allocated":1003520,"data_stored":485186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.90300000000000002},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.377},"max":{"1min":0.82699999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.67500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91700000000000004,"5min":0.93100000000000005,"15min":1.0209999999999999},"last":0.79600000000000004}]},{"osd":3,"last update":"Fri Mar 17 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.67200000000000004},"min":{"1min":0.50600000000000001,"5min":0.43099999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70199999999999996,"15min":0.68799999999999994},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95299999999999996,"5min":0.98099999999999998,"15min":0.998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Mar 17 08:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.439,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75700000000000001,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.32000000000000001,"15min":0.308},"max":{"1min":0.75700000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.85499999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.749},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89100000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:12:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66800000000000004,"15min":0.64900000000000002},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.38900000000000001},"max":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71299999999999997,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.437,"15min":0.433},"max":{"1min":0.84099999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Mar 17 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69199999999999995,"15min":0.67400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":1.0640000000000001,"15min":1.0700000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":0.96199999999999997,"15min":1.0029999999999999},"last":0.71199999999999997}]},{"osd":9,"last update":"Fri Mar 17 08:43:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81299999999999994,"15min":0.79900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.98999999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.56799999999999995,"5min":0.47799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95499999999999996,"5min":1.042,"15min":1.0920000000000001},"last":0.86099999999999999}]},{"osd":10,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.57899999999999996,"5min":0.57299999999999995,"15min":0.52900000000000003},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.083},"last":0.83399999999999996}]},{"osd":11,"last update":"Fri Mar 17 08:43:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.83299999999999996,"15min":0.81499999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":1,"5min":1.087,"15min":1.143},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46500000000000002},"max":{"1min":0.92500000000000004,"5min":0.99099999999999999,"15min":1.046},"last":0.88100000000000001}]}]},{"osd":3,"up_from":26,"seq":111669150207,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6828,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738324,"statfs":{"total":95995035648,"available":95988043776,"internally_reserved":0,"allocated":1019904,"data_stored":482798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.40200000000000002,"5min":0.28399999999999997,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.83299999999999996,"15min":0.872},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.48999999999999999,"15min":0.47899999999999998},"min":{"1min":0.41499999999999998,"5min":0.317,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.502}]},{"osd":1,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70699999999999996,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.42299999999999999},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.39900000000000002,"15min":0.39400000000000002},"max":{"1min":0.77300000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68300000000000005,"15min":0.66600000000000004},"min":{"1min":0.52600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.61899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Mar 17 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73099999999999998,"15min":0.71299999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91200000000000003,"5min":1.054,"15min":1.054},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.81899999999999995,"15min":0.78900000000000003},"min":{"1min":0.59699999999999998,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Mar 17 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81399999999999995,"15min":0.78200000000000003},"min":{"1min":0.63700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.76500000000000001,"15min":0.73999999999999999},"min":{"1min":0.5,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.72399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.33500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.871},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Mar 17 08:43:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.72699999999999998},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.505},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.83499999999999996,"15min":0.80000000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.52500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.88500000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:12:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84999999999999998,"15min":0.747},"min":{"1min":0.495,"5min":0.495,"15min":0.47099999999999997},"max":{"1min":0.98699999999999999,"5min":1.121,"15min":1.121},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.47699999999999998},"max":{"1min":0.90300000000000002,"5min":1.252,"15min":1.252},"last":0.58499999999999996}]},{"osd":9,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.874,"15min":0.83699999999999997},"min":{"1min":0.59699999999999998,"5min":0.438,"15min":0.40100000000000002},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.68000000000000005},"min":{"1min":0.54200000000000004,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.91100000000000003,"5min":0.999,"15min":1.0389999999999999},"last":0.77500000000000002}]},{"osd":10,"last update":"Fri Mar 17 08:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81299999999999994,"15min":0.78500000000000003},"min":{"1min":0.70199999999999996,"5min":0.56599999999999995,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.83999999999999997},"min":{"1min":0.73299999999999998,"5min":0.60399999999999998,"15min":0.56399999999999995},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.85199999999999998}]},{"osd":11,"last update":"Fri Mar 17 08:44:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89100000000000001,"15min":0.86699999999999999},"min":{"1min":0.61199999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1100000000000001,"5min":1.115,"15min":1.121},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.93799999999999994,"15min":0.90700000000000003},"min":{"1min":0.68000000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.92000000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888568,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6884,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738268,"statfs":{"total":95995035648,"available":95987986432,"internally_reserved":0,"allocated":1077248,"data_stored":551400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59699999999999998,"15min":0.55200000000000005},"min":{"1min":0.495,"5min":0.34200000000000003,"15min":0.27500000000000002},"max":{"1min":0.90700000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.51400000000000001,"5min":0.33700000000000002,"15min":0.28599999999999998},"max":{"1min":0.85499999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Mar 17 08:44:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.438,"15min":0.438},"min":{"1min":0.33600000000000002,"5min":0.29699999999999999,"15min":0.26400000000000001},"max":{"1min":0.621,"5min":0.622,"15min":0.63100000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45800000000000002,"15min":0.45700000000000002},"min":{"1min":0.35999999999999999,"5min":0.32300000000000001,"15min":0.317},"max":{"1min":0.65300000000000002,"5min":0.72499999999999998,"15min":0.752},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Mar 17 08:44:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.62,"15min":0.626},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.313},"max":{"1min":0.73999999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.41799999999999998},"max":{"1min":0.81899999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Mar 17 08:44:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.97399999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68300000000000005,"15min":0.67200000000000004},"min":{"1min":0.50800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91300000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Mar 17 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.46300000000000002,"5min":0.39800000000000002,"15min":0.38900000000000001},"max":{"1min":0.83899999999999997,"5min":1.022,"15min":1.022},"last":0.75},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.49199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77000000000000002,"5min":0.90400000000000003,"15min":0.94999999999999996},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Mar 17 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.46400000000000002},"max":{"1min":0.87,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72699999999999998,"15min":0.71299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Mar 17 08:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.48099999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67800000000000005,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":1.0029999999999999,"15min":1.0820000000000001},"last":0.63100000000000001}]},{"osd":8,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73499999999999999,"15min":0.73299999999999998},"min":{"1min":0.59999999999999998,"5min":0.45400000000000001,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":0.98699999999999999,"15min":0.998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.67400000000000004,"5min":0.52100000000000002,"15min":0.495},"max":{"1min":0.92900000000000005,"5min":0.98899999999999999,"15min":1.016},"last":0.78500000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64200000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0820000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.41799999999999998},"max":{"1min":0.995,"5min":0.995,"15min":1.018},"last":0.83199999999999996}]},{"osd":10,"last update":"Fri Mar 17 08:44:02 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.38400000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.056},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.86199999999999999}]},{"osd":11,"last update":"Fri Mar 17 08:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.82399999999999995},"min":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.60199999999999998},"max":{"1min":1.0329999999999999,"5min":1.0389999999999999,"15min":1.042},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83599999999999997,"15min":0.83199999999999996},"min":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.56100000000000005},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.107},"last":0.879}]}]},{"osd":5,"up_from":39,"seq":167503725037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":7352,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93737800,"statfs":{"total":95995035648,"available":95987507200,"internally_reserved":0,"allocated":1622016,"data_stored":1076084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.318},"max":{"1min":0.79300000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.38900000000000001,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.92900000000000005},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.31},"max":{"1min":0.72799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.624},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.36299999999999999},"max":{"1min":0.76700000000000002,"5min":0.91200000000000003,"15min":0.91400000000000003},"last":0.499}]},{"osd":2,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46100000000000002,"15min":0.46700000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.29099999999999998},"max":{"1min":0.68899999999999995,"5min":0.73999999999999999,"15min":1.46},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46600000000000003,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.30099999999999999},"max":{"1min":0.63500000000000001,"5min":0.67200000000000004,"15min":1.0349999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50800000000000001,"5min":0.41299999999999998,"15min":0.377},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.97499999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65700000000000003,"15min":0.65800000000000003},"min":{"1min":0.46500000000000002,"5min":0.38600000000000001,"15min":0.378},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":1.5469999999999999},"last":0.621}]},{"osd":4,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.66800000000000004},"min":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.39600000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.93000000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.68400000000000005},"min":{"1min":0.48799999999999999,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":0.995,"15min":0.995},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.47199999999999998,"5min":0.45600000000000002,"15min":0.41499999999999998},"max":{"1min":0.82399999999999995,"5min":0.92000000000000004,"15min":0.96799999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":1.0049999999999999,"15min":1.3440000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Mar 17 08:43:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.42499999999999999,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.96799999999999997,"15min":1.6040000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.71099999999999997},"min":{"1min":0.54200000000000004,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":0.92100000000000004,"5min":0.97399999999999998,"15min":1.0740000000000001},"last":0.65100000000000002}]},{"osd":8,"last update":"Fri Mar 17 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.69699999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38100000000000001},"max":{"1min":0.91900000000000004,"5min":0.94999999999999996,"15min":1.6359999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.67300000000000004},"min":{"1min":0.45900000000000002,"5min":0.41799999999999998,"15min":0.35699999999999998},"max":{"1min":0.85699999999999998,"5min":0.91400000000000003,"15min":1.4830000000000001},"last":0.53600000000000003}]},{"osd":9,"last update":"Fri Mar 17 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76900000000000002,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.47399999999999998},"max":{"1min":0.93300000000000005,"5min":0.98099999999999998,"15min":1.026},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.52600000000000002},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.663},"last":0.68899999999999995}]},{"osd":10,"last update":"Fri Mar 17 08:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77400000000000002,"15min":0.76600000000000001},"min":{"1min":0.628,"5min":0.55500000000000005,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":1.2110000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":0.78800000000000003},"min":{"1min":0.623,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.167},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-17T08:44:33.245 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:08 smithi035 ceph-mon[92535]: pgmap v1803: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:09 smithi035 ceph-mon[92535]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:10 smithi035 ceph-mon[92535]: pgmap v1804: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:12 smithi035 ceph-mon[92535]: pgmap v1805: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:14 smithi035 ceph-mon[92535]: pgmap v1806: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:15 smithi035 ceph-mon[92535]: pgmap v1807: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:18 smithi035 ceph-mon[92535]: pgmap v1808: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:20 smithi035 ceph-mon[92535]: pgmap v1809: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:22 smithi035 ceph-mon[92535]: pgmap v1810: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:33.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:24 smithi035 ceph-mon[92535]: pgmap v1811: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:33.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:25 smithi035 ceph-mon[92535]: pgmap v1812: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:33.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:28 smithi035 ceph-mon[92535]: pgmap v1813: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:35.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:30 smithi035 ceph-mon[92535]: pgmap v1814: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:35.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:32 smithi035 ceph-mon[92535]: pgmap v1815: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:35.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:44:35.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:35.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:32 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:35.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:25 smithi082 ceph-mon[94281]: pgmap v1812: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:37.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:28 smithi082 ceph-mon[94281]: pgmap v1813: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:39.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:30 smithi082 ceph-mon[94281]: pgmap v1814: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:39.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:32 smithi082 ceph-mon[94281]: pgmap v1815: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:39.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:44:39.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:41.197 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:32 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:42.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:44:42.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:34 smithi082 ceph-mon[94281]: pgmap v1816: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:25 smithi078 ceph-mon[94114]: pgmap v1812: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:28 smithi078 ceph-mon[94114]: pgmap v1813: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:30 smithi078 ceph-mon[94114]: pgmap v1814: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:32 smithi078 ceph-mon[94114]: pgmap v1815: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:32 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:44:44.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:44:45.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:45.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:34 smithi078 ceph-mon[94114]: pgmap v1816: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:45.108 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:44:45.108 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:44:45.108 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:44:45.109 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:34 smithi035 ceph-mon[92535]: pgmap v1816: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:45.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:35 smithi082 ceph-mon[94281]: pgmap v1817: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:46.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/482442640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:38 smithi082 ceph-mon[94281]: pgmap v1818: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:40 smithi082 ceph-mon[94281]: pgmap v1819: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:42 smithi082 ceph-mon[94281]: pgmap v1820: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:44 smithi082 ceph-mon[94281]: pgmap v1821: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:35 smithi078 ceph-mon[94114]: pgmap v1817: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/482442640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:38 smithi078 ceph-mon[94114]: pgmap v1818: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:40 smithi078 ceph-mon[94114]: pgmap v1819: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:42 smithi078 ceph-mon[94114]: pgmap v1820: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:46.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:44 smithi078 ceph-mon[94114]: pgmap v1821: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:46.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:45 smithi082 ceph-mon[94281]: pgmap v1822: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:46.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:45 smithi078 ceph-mon[94114]: pgmap v1822: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:48.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 -- 172.21.15.35:0/1435602545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 msgr2=0x7fa808103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:49.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/1435602545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa808103060 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009990 tx=0x7fa7f8009ca0 comp rx=0 tx=0).stop 2023-03-17T08:44:49.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 -- 172.21.15.35:0/1435602545 shutdown_connections 2023-03-17T08:44:49.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/1435602545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa808105ec0 0x7fa8081082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:49.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/1435602545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa808103060 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:50.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/1435602545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8081035a0 0x7fa808105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:50.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 -- 172.21.15.35:0/1435602545 >> 172.21.15.35:0/1435602545 conn(0x7fa8080fa680 msgr2=0x7fa8080fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:44:52.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 -- 172.21.15.35:0/1435602545 shutdown_connections 2023-03-17T08:44:52.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.239+0000 7fa80d1d6700 1 -- 172.21.15.35:0/1435602545 wait complete. 2023-03-17T08:44:52.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 Processor -- start 2023-03-17T08:44:52.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 -- start start 2023-03-17T08:44:52.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa8081005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8081035a0 0x7fa8080fec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa808105ec0 0x7fa8080ff170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080ff910 con 0x7fa808100c80 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080ffa80 con 0x7fa8081035a0 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80d1d6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80819fe50 con 0x7fa808105ec0 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa806d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa8081005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa806d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa8081005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41696/0 (socket says 172.21.15.35:41696) 2023-03-17T08:44:53.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa806d9d700 1 -- 172.21.15.35:0/482442640 learned_addr learned my addr 172.21.15.35:0/482442640 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:44:53.066 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80659c700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8081035a0 0x7fa8080fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:54.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.240+0000 7fa80759e700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa808105ec0 0x7fa8080ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:54.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa806d9d700 1 -- 172.21.15.35:0/482442640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa808105ec0 msgr2=0x7fa8080ff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:54.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa806d9d700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa808105ec0 0x7fa8080ff170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:54.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa806d9d700 1 -- 172.21.15.35:0/482442640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8081035a0 msgr2=0x7fa8080fec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:54.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa806d9d700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8081035a0 0x7fa8080fec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:55.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa806d9d700 1 -- 172.21.15.35:0/482442640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80095f0 con 0x7fa808100c80 2023-03-17T08:44:55.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa806d9d700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa8081005f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80059d0 tx=0x7fa7f8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f801d070 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7f800beb0 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80810b9b0 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800fdb0 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.241+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80810b820 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.242+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8080fc1f0 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.243+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fa7f800f460 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.244+0000 7fa7fffff700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa7f409f550 0x7fa7f40a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.244+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fa7f80cb5e0 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.244+0000 7fa80659c700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa7f409f550 0x7fa7f40a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.244+0000 7fa80659c700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa7f409f550 0x7fa7f40a1a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005950 tx=0x7fa7f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.248+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fa7f8095800 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.452+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa80802d010 con 0x7fa808100c80 2023-03-17T08:44:55.310 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.453+0000 7fa7fffff700 1 -- 172.21.15.35:0/482442640 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7fa7f8098e20 con 0x7fa808100c80 2023-03-17T08:44:55.311 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:44:55.311 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:44:55.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa7f409f550 msgr2=0x7fa7f40a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:55.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa7f409f550 0x7fa7f40a1a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005950 tx=0x7fa7f000b410 comp rx=0 tx=0).stop 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 msgr2=0x7fa8081005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa8081005f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80059d0 tx=0x7fa7f8004790 comp rx=0 tx=0).stop 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 shutdown_connections 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa808105ec0 0x7fa8080ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fa7f409f550 0x7fa7f40a1a00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa808100c80 0x7fa8081005f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 --2- 172.21.15.35:0/482442640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8081035a0 0x7fa8080fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 >> 172.21.15.35:0/482442640 conn(0x7fa8080fa680 msgr2=0x7fa8081018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 shutdown_connections 2023-03-17T08:44:55.918 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:35.456+0000 7fa80d1d6700 1 -- 172.21.15.35:0/482442640 wait complete. 2023-03-17T08:44:55.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-17T08:00:24.921490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-17T08:12:42.651944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-03-17T08:12:54.803875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-17T08:44:55.920 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:35 smithi035 ceph-mon[92535]: pgmap v1817: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/482442640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:38 smithi035 ceph-mon[92535]: pgmap v1818: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:40 smithi035 ceph-mon[92535]: pgmap v1819: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:42 smithi035 ceph-mon[92535]: pgmap v1820: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:44 smithi035 ceph-mon[92535]: pgmap v1821: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:45 smithi035 ceph-mon[92535]: pgmap v1822: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:48 smithi035 ceph-mon[92535]: pgmap v1823: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:50 smithi035 ceph-mon[92535]: pgmap v1824: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:52 smithi035 ceph-mon[92535]: pgmap v1825: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:55.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:54 smithi035 ceph-mon[92535]: pgmap v1826: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:55.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:48 smithi078 ceph-mon[94114]: pgmap v1823: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:57.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:50 smithi078 ceph-mon[94114]: pgmap v1824: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:57.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:52 smithi078 ceph-mon[94114]: pgmap v1825: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:57.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:54 smithi078 ceph-mon[94114]: pgmap v1826: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:57.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:48 smithi082 ceph-mon[94281]: pgmap v1823: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:57.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:50 smithi082 ceph-mon[94281]: pgmap v1824: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:44:57.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:52 smithi082 ceph-mon[94281]: pgmap v1825: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:44:57.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:54 smithi082 ceph-mon[94281]: pgmap v1826: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:57.388 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:55 smithi078 ceph-mon[94114]: pgmap v1827: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:58.622 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:56 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3249506313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:44:58.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:55 smithi082 ceph-mon[94281]: pgmap v1827: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:44:58.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:56 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3249506313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:44:58.624 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:44:57 smithi078 ceph-mon[94114]: pgmap v1828: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:58.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:44:57 smithi082 ceph-mon[94281]: pgmap v1828: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:44:58.626 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/455133981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8101fe0 msgr2=0x7f8bb81088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:44:59.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/455133981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8101fe0 0x7f8bb81088a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b0a0 tx=0x7f8bb000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:44:59.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/455133981 shutdown_connections 2023-03-17T08:44:59.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/455133981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8101fe0 0x7f8bb81088a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:59.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/455133981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8100460 0x7f8bb8100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:44:59.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/455133981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8101650 0x7f8bb8101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/455133981 >> 172.21.15.35:0/455133981 conn(0x7f8bb80fbaa0 msgr2=0x7f8bb80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/455133981 shutdown_connections 2023-03-17T08:45:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.059+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/455133981 wait complete. 2023-03-17T08:45:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 Processor -- start 2023-03-17T08:45:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 -- start start 2023-03-17T08:45:00.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 0x7f8bb8196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:00.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8101650 0x7f8bb81966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:02.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8101fe0 0x7f8bb819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:02.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819dcf0 con 0x7f8bb8100460 2023-03-17T08:45:02.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819de30 con 0x7f8bb8101650 2023-03-17T08:45:02.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bbd4f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819dfc0 con 0x7f8bb8101fe0 2023-03-17T08:45:02.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bb6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 0x7f8bb8196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:02.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bb6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 0x7f8bb8196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41710/0 (socket says 172.21.15.35:41710) 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bb6ffd700 1 -- 172.21.15.35:0/3249506313 learned_addr learned my addr 172.21.15.35:0/3249506313 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bb67fc700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8101650 0x7f8bb81966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.060+0000 7f8bb77fe700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8101fe0 0x7f8bb819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb6ffd700 1 -- 172.21.15.35:0/3249506313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8101fe0 msgr2=0x7f8bb819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb6ffd700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8101fe0 0x7f8bb819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb6ffd700 1 -- 172.21.15.35:0/3249506313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8101650 msgr2=0x7f8bb81966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb6ffd700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8101650 0x7f8bb81966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb6ffd700 1 -- 172.21.15.35:0/3249506313 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009d00 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb77fe700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8101fe0 0x7f8bb819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bb6ffd700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 0x7f8bb8196170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800d980 tx=0x7f8ba800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004020 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ba8009730 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb810bc80 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8003a00 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.061+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb810baf0 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.062+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8067150 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.063+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f8ba80098a0 con 0x7f8bb8100460 2023-03-17T08:45:02.779 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.064+0000 7f8b9ffff700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8ba009f4d0 0x7f8ba00a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:02.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.064+0000 7f8bb67fc700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8ba009f4d0 0x7f8ba00a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:02.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.064+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f8ba80ca2c0 con 0x7f8bb8100460 2023-03-17T08:45:02.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.064+0000 7f8bb67fc700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8ba009f4d0 0x7f8ba00a1980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8bac007be0 tx=0x7f8bac0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:02.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.067+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f8ba80943b0 con 0x7f8bb8100460 2023-03-17T08:45:02.780 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:55 smithi035 ceph-mon[92535]: pgmap v1827: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:02.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.269+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bb819ed60 con 0x7f8bb8100460 2023-03-17T08:45:02.781 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.269+0000 7f8b9ffff700 1 -- 172.21.15.35:0/3249506313 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ba80979d0 con 0x7f8bb8100460 2023-03-17T08:45:02.781 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 1 2023-03-17T08:45:02.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:00 smithi078 ceph-mon[94114]: pgmap v1829: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:02.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:02 smithi078 ceph-mon[94114]: pgmap v1830: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:02.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:00 smithi082 ceph-mon[94281]: pgmap v1829: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:02.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:02 smithi082 ceph-mon[94281]: pgmap v1830: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8ba009f4d0 msgr2=0x7f8ba00a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8ba009f4d0 0x7f8ba00a1980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8bac007be0 tx=0x7f8bac0073d0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 msgr2=0x7f8bb8196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 0x7f8bb8196170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800d980 tx=0x7f8ba800dc90 comp rx=0 tx=0).stop 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 shutdown_connections 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bb8101fe0 0x7f8bb819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f8ba009f4d0 0x7f8ba00a1980 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8bb8100460 0x7f8bb8196170 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 --2- 172.21.15.35:0/3249506313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8101650 0x7f8bb81966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:02.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.271+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 >> 172.21.15.35:0/3249506313 conn(0x7f8bb80fbaa0 msgr2=0x7f8bb80fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:02.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.272+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 shutdown_connections 2023-03-17T08:45:04.630 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:44:56.272+0000 7f8bbd4f8700 1 -- 172.21.15.35:0/3249506313 wait complete. 2023-03-17T08:45:04.631 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-17T08:45:04.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:56 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3249506313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-03-17T08:45:04.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:44:57 smithi035 ceph-mon[92535]: pgmap v1828: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:04.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:00 smithi035 ceph-mon[92535]: pgmap v1829: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:04.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:02 smithi035 ceph-mon[92535]: pgmap v1830: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:04.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:04 smithi082 ceph-mon[94281]: pgmap v1831: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:07.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:05 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/272361336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:45:07.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:05 smithi082 ceph-mon[94281]: pgmap v1832: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:07.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:04 smithi078 ceph-mon[94114]: pgmap v1831: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:07.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:05 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/272361336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:45:07.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:05 smithi078 ceph-mon[94114]: pgmap v1832: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:07.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:04 smithi035 ceph-mon[92535]: pgmap v1831: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:07.288 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 -- 172.21.15.35:0/3043016948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100310 msgr2=0x7f4460100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:07.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 --2- 172.21.15.35:0/3043016948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100310 0x7f4460100760 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4454009990 tx=0x7f4454009ca0 comp rx=0 tx=0).stop 2023-03-17T08:45:08.627 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 -- 172.21.15.35:0/3043016948 shutdown_connections 2023-03-17T08:45:09.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 --2- 172.21.15.35:0/3043016948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4460100ca0 0x7f4460107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:09.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 --2- 172.21.15.35:0/3043016948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44600ff120 0x7f44600ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:09.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 --2- 172.21.15.35:0/3043016948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100310 0x7f4460100760 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:09.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 -- 172.21.15.35:0/3043016948 >> 172.21.15.35:0/3043016948 conn(0x7f44600fa740 msgr2=0x7f44600fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:09.795 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 -- 172.21.15.35:0/3043016948 shutdown_connections 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.771+0000 7f4465571700 1 -- 172.21.15.35:0/3043016948 wait complete. 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 Processor -- start 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 -- start start 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44600ff120 0x7f4460069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4460100310 0x7f446019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 0x7f446019d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019d9c0 con 0x7f4460100ca0 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019db30 con 0x7f44600ff120 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.772+0000 7f4465571700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446019dcf0 con 0x7f4460100310 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 0x7f446019d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 0x7f446019d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41728/0 (socket says 172.21.15.35:41728) 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 -- 172.21.15.35:0/272361336 learned_addr learned my addr 172.21.15.35:0/272361336 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445e7fc700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4460100310 0x7f446019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445effd700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44600ff120 0x7f4460069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 -- 172.21.15.35:0/272361336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4460100310 msgr2=0x7f446019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:09.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4460100310 0x7f446019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 -- 172.21.15.35:0/272361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44600ff120 msgr2=0x7f4460069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44600ff120 0x7f4460069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 -- 172.21.15.35:0/272361336 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540095f0 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f445f7fe700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 0x7f446019d220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f445800ada0 tx=0x7f445800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445800f070 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4458007b30 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446010a960 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4458005280 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.773+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446010a7d0 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.774+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4460067e30 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.776+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f445800c980 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.777+0000 7f4447fff700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f444809f4d0 0x7f44480a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.777+0000 7f445effd700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f444809f4d0 0x7f44480a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.777+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f44580c9f20 con 0x7f4460100ca0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.777+0000 7f445effd700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f444809f4d0 0x7f44480a1980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4450005950 tx=0x7f44500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:09.797 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.780+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f44580940a0 con 0x7f4460100ca0 2023-03-17T08:45:09.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.981+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f446019eba0 con 0x7f4460100ca0 2023-03-17T08:45:09.798 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.981+0000 7f4447fff700 1 -- 172.21.15.35:0/272361336 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f445800cc30 con 0x7f4460100ca0 2023-03-17T08:45:09.798 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 32 2023-03-17T08:45:10.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:08 smithi078 ceph-mon[94114]: pgmap v1833: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:10.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:10 smithi078 ceph-mon[94114]: pgmap v1834: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:11.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:08 smithi082 ceph-mon[94281]: pgmap v1833: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:12.821 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:10 smithi082 ceph-mon[94281]: pgmap v1834: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:12.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.983+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f444809f4d0 msgr2=0x7f44480a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.983+0000 7f4465571700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f444809f4d0 0x7f44480a1980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4450005950 tx=0x7f44500058e0 comp rx=0 tx=0).stop 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.983+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 msgr2=0x7f446019d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.983+0000 7f4465571700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 0x7f446019d220 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f445800ada0 tx=0x7f445800c330 comp rx=0 tx=0).stop 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.983+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 shutdown_connections 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f444809f4d0 0x7f44480a1980 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4460100ca0 0x7f446019d220 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44600ff120 0x7f4460069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 --2- 172.21.15.35:0/272361336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4460100310 0x7f446019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:15.359 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 >> 172.21.15.35:0/272361336 conn(0x7f44600fa740 msgr2=0x7f44600fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:15.360 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 shutdown_connections 2023-03-17T08:45:15.360 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:04.984+0000 7f4465571700 1 -- 172.21.15.35:0/272361336 wait complete. 2023-03-17T08:45:15.360 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-17T08:45:15.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:05 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/272361336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-03-17T08:45:15.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:05 smithi035 ceph-mon[92535]: pgmap v1832: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:15.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:08 smithi035 ceph-mon[92535]: pgmap v1833: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:15.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:10 smithi035 ceph-mon[92535]: pgmap v1834: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:15.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:12 smithi035 ceph-mon[92535]: pgmap v1835: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:15.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:14 smithi035 ceph-mon[92535]: pgmap v1836: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:17.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:15 smithi035 ceph-mon[92535]: pgmap v1837: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:17.041 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:12 smithi078 ceph-mon[94114]: pgmap v1835: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:17.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:14 smithi078 ceph-mon[94114]: pgmap v1836: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:17.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:15 smithi078 ceph-mon[94114]: pgmap v1837: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:17.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:12 smithi082 ceph-mon[94281]: pgmap v1835: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:17.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:14 smithi082 ceph-mon[94281]: pgmap v1836: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:17.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:15 smithi082 ceph-mon[94281]: pgmap v1837: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:17.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 -- 172.21.15.35:0/852978054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd80ff110 msgr2=0x7f1cd80ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:19.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 --2- 172.21.15.35:0/852978054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd80ff110 0x7f1cd80ff520 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800b0a0 tx=0x7f1cc800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 -- 172.21.15.35:0/852978054 shutdown_connections 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 --2- 172.21.15.35:0/852978054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8100d50 0x7f1cd81075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 --2- 172.21.15.35:0/852978054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd80ff110 0x7f1cd80ff520 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 --2- 172.21.15.35:0/852978054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cd81003a0 0x7f1cd8100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 -- 172.21.15.35:0/852978054 >> 172.21.15.35:0/852978054 conn(0x7f1cd80fa730 msgr2=0x7f1cd80fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 -- 172.21.15.35:0/852978054 shutdown_connections 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.177+0000 7f1cdda24700 1 -- 172.21.15.35:0/852978054 wait complete. 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.178+0000 7f1cdda24700 1 Processor -- start 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.178+0000 7f1cdda24700 1 -- start start 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80ff110 0x7f1cd8194ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 0x7f1cd8195410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cd8100d50 0x7f1cd819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd819ca50 con 0x7f1cd81003a0 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd819cb90 con 0x7f1cd80ff110 2023-03-17T08:45:19.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd819cd20 con 0x7f1cd8100d50 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 0x7f1cd8195410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 0x7f1cd8195410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41748/0 (socket says 172.21.15.35:41748) 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 -- 172.21.15.35:0/1636187616 learned_addr learned my addr 172.21.15.35:0/1636187616 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd77fe700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cd8100d50 0x7f1cd819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd6ffd700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80ff110 0x7f1cd8194ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 -- 172.21.15.35:0/1636187616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cd8100d50 msgr2=0x7f1cd819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cd8100d50 0x7f1cd819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 -- 172.21.15.35:0/1636187616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80ff110 msgr2=0x7f1cd8194ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80ff110 0x7f1cd8194ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 -- 172.21.15.35:0/1636187616 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc8009d00 con 0x7f1cd81003a0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cd67fc700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 0x7f1cd8195410 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000eab0 tx=0x7f1cc000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0013070 con 0x7f1cd81003a0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cc000be50 con 0x7f1cd81003a0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd810a920 con 0x7f1cd81003a0 2023-03-17T08:45:19.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.179+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0017e60 con 0x7f1cd81003a0 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.180+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd810a790 con 0x7f1cd81003a0 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.180+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd80689f0 con 0x7f1cd81003a0 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.182+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f1cc000b9c0 con 0x7f1cd81003a0 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.182+0000 7f1cdca22700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1cc409f4d0 0x7f1cc40a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.182+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f1cc00cbc60 con 0x7f1cd81003a0 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.182+0000 7f1cd6ffd700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1cc409f4d0 0x7f1cc40a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:19.088 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.183+0000 7f1cd6ffd700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1cc409f4d0 0x7f1cc40a1980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80079c0 tx=0x7f1cc800b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:20.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.186+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1cc0095d50 con 0x7f1cd81003a0 2023-03-17T08:45:20.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.384+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1cd8106290 con 0x7f1cd81003a0 2023-03-17T08:45:20.109 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.384+0000 7f1cdca22700 1 -- 172.21.15.35:0/1636187616 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1cc001c0a0 con 0x7f1cd81003a0 2023-03-17T08:45:20.109 INFO:teuthology.orchestra.run.smithi035.stdout:pg_num: 64 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.386+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1cc409f4d0 msgr2=0x7f1cc40a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.386+0000 7f1cdda24700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1cc409f4d0 0x7f1cc40a1980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80079c0 tx=0x7f1cc800b700 comp rx=0 tx=0).stop 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.386+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 msgr2=0x7f1cd8195410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.386+0000 7f1cdda24700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 0x7f1cd8195410 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000eab0 tx=0x7f1cc000edc0 comp rx=0 tx=0).stop 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 shutdown_connections 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1cd8100d50 0x7f1cd819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd80ff110 0x7f1cd8194ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:20.110 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f1cc409f4d0 0x7f1cc40a1980 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:20.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 --2- 172.21.15.35:0/1636187616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1cd81003a0 0x7f1cd8195410 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:20.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 >> 172.21.15.35:0/1636187616 conn(0x7f1cd80fa730 msgr2=0x7f1cd81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:21.568 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 shutdown_connections 2023-03-17T08:45:21.568 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:17.387+0000 7f1cdda24700 1 -- 172.21.15.35:0/1636187616 wait complete. 2023-03-17T08:45:21.569 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:45:21.570 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:18 smithi035 ceph-mon[92535]: pgmap v1838: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:21.570 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:18 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1636187616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:45:21.570 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:20 smithi035 ceph-mon[92535]: pgmap v1839: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:21.571 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:18 smithi078 ceph-mon[94114]: pgmap v1838: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:21.571 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:18 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1636187616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:45:21.571 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:20 smithi078 ceph-mon[94114]: pgmap v1839: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:21.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:18 smithi082 ceph-mon[94281]: pgmap v1838: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:21.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:18 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1636187616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-03-17T08:45:21.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:20 smithi082 ceph-mon[94281]: pgmap v1839: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:21.709 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 -- 172.21.15.35:0/550188128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580fea90 msgr2=0x7fec580feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:22.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 --2- 172.21.15.35:0/550188128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580fea90 0x7fec580feea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec48009990 tx=0x7fec48009ca0 comp rx=0 tx=0).stop 2023-03-17T08:45:22.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 -- 172.21.15.35:0/550188128 shutdown_connections 2023-03-17T08:45:22.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 --2- 172.21.15.35:0/550188128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec580ffd90 0x7fec58100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:22.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 --2- 172.21.15.35:0/550188128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580fea90 0x7fec580feea0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:22.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 --2- 172.21.15.35:0/550188128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ff3e0 0x7fec580ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:22.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 -- 172.21.15.35:0/550188128 >> 172.21.15.35:0/550188128 conn(0x7fec580fa680 msgr2=0x7fec580fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:22.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 -- 172.21.15.35:0/550188128 shutdown_connections 2023-03-17T08:45:24.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.704+0000 7fec5e47c700 1 -- 172.21.15.35:0/550188128 wait complete. 2023-03-17T08:45:24.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 Processor -- start 2023-03-17T08:45:24.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 -- start start 2023-03-17T08:45:24.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:22 smithi078 ceph-mon[94114]: pgmap v1840: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:24.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:22 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/183736270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:45:24.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:22 smithi082 ceph-mon[94281]: pgmap v1840: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:24.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:22 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/183736270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:45:24.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:24 smithi082 ceph-mon[94281]: pgmap v1841: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:24.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec580fea90 0x7fec58198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:24.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 0x7fec581985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:24.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ffd90 0x7fec5819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:24.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5819fc00 con 0x7fec580ff3e0 2023-03-17T08:45:24.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5819fd40 con 0x7fec580ffd90 2023-03-17T08:45:25.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5e47c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5819fed0 con 0x7fec580fea90 2023-03-17T08:45:25.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 0x7fec581985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:25.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 0x7fec581985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41762/0 (socket says 172.21.15.35:41762) 2023-03-17T08:45:25.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec577fe700 1 -- 172.21.15.35:0/183736270 learned_addr learned my addr 172.21.15.35:0/183736270 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:45:26.557 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec57fff700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec580fea90 0x7fec58198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:26.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.705+0000 7fec5ca19700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ffd90 0x7fec5819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:26.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec577fe700 1 -- 172.21.15.35:0/183736270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec580fea90 msgr2=0x7fec58198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:26.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec577fe700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec580fea90 0x7fec58198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:26.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec577fe700 1 -- 172.21.15.35:0/183736270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ffd90 msgr2=0x7fec5819f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:26.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec577fe700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ffd90 0x7fec5819f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:27.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec577fe700 1 -- 172.21.15.35:0/183736270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec480095f0 con 0x7fec580ff3e0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec5ca19700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ffd90 0x7fec5819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec577fe700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 0x7fec581985c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00d950 tx=0x7fec4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c009940 con 0x7fec580ff3e0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec4c010460 con 0x7fec580ff3e0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5810dbf0 con 0x7fec580ff3e0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00f620 con 0x7fec580ff3e0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.706+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5810da60 con 0x7fec580ff3e0 2023-03-17T08:45:27.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.707+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58109870 con 0x7fec580ff3e0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.708+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fec4c0105d0 con 0x7fec580ff3e0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.709+0000 7fec557fa700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec4009f4d0 0x7fec400a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.709+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fec4c0ca0b0 con 0x7fec580ff3e0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.709+0000 7fec57fff700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec4009f4d0 0x7fec400a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.709+0000 7fec57fff700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec4009f4d0 0x7fec400a1980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c010 tx=0x7fec48005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.713+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fec4c0941a0 con 0x7fec580ff3e0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.963+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec5802d010 con 0x7fec580ff3e0 2023-03-17T08:45:29.811 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.964+0000 7fec557fa700 1 -- 172.21.15.35:0/183736270 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7fec4c020090 con 0x7fec580ff3e0 2023-03-17T08:45:29.812 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:45:29.812 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:45:31.050 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec4009f4d0 msgr2=0x7fec400a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:31.050 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec4009f4d0 0x7fec400a1980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c010 tx=0x7fec48005fb0 comp rx=0 tx=0).stop 2023-03-17T08:45:31.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 msgr2=0x7fec581985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:32.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 0x7fec581985c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00d950 tx=0x7fec4c00dc60 comp rx=0 tx=0).stop 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 shutdown_connections 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec580ffd90 0x7fec5819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec580fea90 0x7fec58198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fec4009f4d0 0x7fec400a1980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 --2- 172.21.15.35:0/183736270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec580ff3e0 0x7fec581985c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 >> 172.21.15.35:0/183736270 conn(0x7fec580fa680 msgr2=0x7fec580fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 shutdown_connections 2023-03-17T08:45:33.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:21.966+0000 7fec5e47c700 1 -- 172.21.15.35:0/183736270 wait complete. 2023-03-17T08:45:33.907 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:45:33.908 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-17T08:45:33.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:22 smithi035 ceph-mon[92535]: pgmap v1840: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:33.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:22 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/183736270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:45:33.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:24 smithi035 ceph-mon[92535]: pgmap v1841: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:33.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:25 smithi035 ceph-mon[92535]: pgmap v1842: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:33.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:28 smithi035 ceph-mon[92535]: pgmap v1843: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:33.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:30 smithi035 ceph-mon[92535]: pgmap v1844: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:33.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:32 smithi035 ceph-mon[92535]: pgmap v1845: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:33.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:45:33.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:33 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:33.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:25 smithi082 ceph-mon[94281]: pgmap v1842: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:34.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:28 smithi082 ceph-mon[94281]: pgmap v1843: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:34.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:30 smithi082 ceph-mon[94281]: pgmap v1844: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:34.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:32 smithi082 ceph-mon[94281]: pgmap v1845: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:34.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:45:35.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:33 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:35.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:24 smithi078 ceph-mon[94114]: pgmap v1841: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:35.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:25 smithi078 ceph-mon[94114]: pgmap v1842: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:36.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:28 smithi078 ceph-mon[94114]: pgmap v1843: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:36.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:30 smithi078 ceph-mon[94114]: pgmap v1844: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:36.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:32 smithi078 ceph-mon[94114]: pgmap v1845: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:36.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:45:36.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:33 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:36.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:34 smithi078 ceph-mon[94114]: pgmap v1846: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:36.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:36.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:45:36.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:45:36.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:34 smithi078 ceph-mon[94114]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:38.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/204642207' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:45:38.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:36 smithi078 ceph-mon[94114]: pgmap v1847: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:38.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:34 smithi082 ceph-mon[94281]: pgmap v1846: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:40.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:40.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:45:40.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:45:40.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:34 smithi082 ceph-mon[94281]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:40.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/204642207' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:45:40.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:36 smithi082 ceph-mon[94281]: pgmap v1847: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:40.343 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:38 smithi078 ceph-mon[94114]: pgmap v1848: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:40.343 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:38 smithi082 ceph-mon[94281]: pgmap v1848: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:40.344 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 -- 172.21.15.35:0/172749953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 msgr2=0x7f14e01006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:41.478 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 --2- 172.21.15.35:0/172749953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01006e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009a10 tx=0x7f14c8009d20 comp rx=0 tx=0).stop 2023-03-17T08:45:41.478 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 -- 172.21.15.35:0/172749953 shutdown_connections 2023-03-17T08:45:41.966 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 --2- 172.21.15.35:0/172749953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14e0100c20 0x7f14e01074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:44.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 --2- 172.21.15.35:0/172749953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14e00ff0a0 0x7f14e00ff4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:44.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 --2- 172.21.15.35:0/172749953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01006e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:44.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 -- 172.21.15.35:0/172749953 >> 172.21.15.35:0/172749953 conn(0x7f14e00fa680 msgr2=0x7f14e00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:44.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 -- 172.21.15.35:0/172749953 shutdown_connections 2023-03-17T08:45:44.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 -- 172.21.15.35:0/172749953 wait complete. 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.033+0000 7f14e51b8700 1 Processor -- start 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 -- start start 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14e00ff0a0 0x7f14e0198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14e0100c20 0x7f14e019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e019fbe0 con 0x7f14e0100290 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e019fd20 con 0x7f14e00ff0a0 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14e51b8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e019feb0 con 0x7f14e0100c20 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41788/0 (socket says 172.21.15.35:41788) 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 -- 172.21.15.35:0/204642207 learned_addr learned my addr 172.21.15.35:0/204642207 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14ded9d700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14e00ff0a0 0x7f14e0198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14df59e700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14e0100c20 0x7f14e019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 -- 172.21.15.35:0/204642207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14e0100c20 msgr2=0x7f14e019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14e0100c20 0x7f14e019f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 -- 172.21.15.35:0/204642207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14e00ff0a0 msgr2=0x7f14e0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:44.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14e00ff0a0 0x7f14e0198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.034+0000 7f14de59c700 1 -- 172.21.15.35:0/204642207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80095f0 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.035+0000 7f14de59c700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01985a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f14c8000c00 tx=0x7f14c8003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.035+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800b8f0 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.035+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14c8005e10 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.035+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e0109880 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.035+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8010440 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.035+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e01096f0 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.036+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e0067970 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.037+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f14c801f440 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.037+0000 7f14d7fff700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f14cc09f4d0 0x7f14cc0a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.038+0000 7f14ded9d700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f14cc09f4d0 0x7f14cc0a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.038+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f14c80ccca0 con 0x7f14e0100290 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.038+0000 7f14ded9d700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f14cc09f4d0 0x7f14cc0a1980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f14e01000f0 tx=0x7f14d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:45:44.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.041+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f14c8096e20 con 0x7f14e0100290 2023-03-17T08:45:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.242+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14e0105ff0 con 0x7f14e0100290 2023-03-17T08:45:44.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.243+0000 7f14d7fff700 1 -- 172.21.15.35:0/204642207 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22341 (secure 0 0 0) 0x7f14c8005c00 con 0x7f14e0100290 2023-03-17T08:45:44.456 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:45:44.457 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":91,"fsid":"80b32574-c497-11ed-9afb-001a4aab830c","created":"2023-03-17T07:45:49.222602+0000","modified":"2023-03-17T08:13:43.298886+0000","last_up_change":"2023-03-17T08:08:50.746288+0000","last_in_change":"2023-03-17T08:08:32.878147+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-17T08:00:24.921490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-03-17T08:12:42.651944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-03-17T08:12:54.803875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"747adca4-1ffd-4d6f-959f-8f2cc8b71782","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6802","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6803","nonce":1205838363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6804","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6805","nonce":1205838363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6808","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6809","nonce":1205838363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6806","nonce":1205838363},{"type":"v1","addr":"172.21.15.35:6807","nonce":1205838363}]},"public_addr":"172.21.15.35:6803/1205838363","cluster_addr":"172.21.15.35:6805/1205838363","heartbeat_back_addr":"172.21.15.35:6809/1205838363","heartbeat_front_addr":"172.21.15.35:6807/1205838363","state":["exists","up"]},{"osd":1,"uuid":"1ec58882-7916-437c-b210-38afc3a391f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6801","nonce":3727253677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6803","nonce":3727253677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6807","nonce":3727253677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3727253677},{"type":"v1","addr":"172.21.15.78:6805","nonce":3727253677}]},"public_addr":"172.21.15.78:6801/3727253677","cluster_addr":"172.21.15.78:6803/3727253677","heartbeat_back_addr":"172.21.15.78:6807/3727253677","heartbeat_front_addr":"172.21.15.78:6805/3727253677","state":["exists","up"]},{"osd":2,"uuid":"2359345e-1870-4b03-803a-5ab6ae403e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6801","nonce":191062504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6803","nonce":191062504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6807","nonce":191062504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":191062504},{"type":"v1","addr":"172.21.15.82:6805","nonce":191062504}]},"public_addr":"172.21.15.82:6801/191062504","cluster_addr":"172.21.15.82:6803/191062504","heartbeat_back_addr":"172.21.15.82:6807/191062504","heartbeat_front_addr":"172.21.15.82:6805/191062504","state":["exists","up"]},{"osd":3,"uuid":"2c236cee-6090-4bd3-855b-1b0807335333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6810","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6811","nonce":2296850572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6812","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6813","nonce":2296850572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6816","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6817","nonce":2296850572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6814","nonce":2296850572},{"type":"v1","addr":"172.21.15.35:6815","nonce":2296850572}]},"public_addr":"172.21.15.35:6811/2296850572","cluster_addr":"172.21.15.35:6813/2296850572","heartbeat_back_addr":"172.21.15.35:6817/2296850572","heartbeat_front_addr":"172.21.15.35:6815/2296850572","state":["exists","up"]},{"osd":4,"uuid":"c2a94d43-e076-49ee-85bc-723575af1907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6809","nonce":3925179759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6811","nonce":3925179759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6815","nonce":3925179759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3925179759},{"type":"v1","addr":"172.21.15.78:6813","nonce":3925179759}]},"public_addr":"172.21.15.78:6809/3925179759","cluster_addr":"172.21.15.78:6811/3925179759","heartbeat_back_addr":"172.21.15.78:6815/3925179759","heartbeat_front_addr":"172.21.15.78:6813/3925179759","state":["exists","up"]},{"osd":5,"uuid":"955eccc0-b6f3-4b18-a929-577d360f315d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6809","nonce":3768446806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6811","nonce":3768446806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6815","nonce":3768446806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3768446806},{"type":"v1","addr":"172.21.15.82:6813","nonce":3768446806}]},"public_addr":"172.21.15.82:6809/3768446806","cluster_addr":"172.21.15.82:6811/3768446806","heartbeat_back_addr":"172.21.15.82:6815/3768446806","heartbeat_front_addr":"172.21.15.82:6813/3768446806","state":["exists","up"]},{"osd":6,"uuid":"bf1b5136-d013-4824-8907-958e6fe0f471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6818","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6819","nonce":1961965339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6820","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6821","nonce":1961965339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6824","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6825","nonce":1961965339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6822","nonce":1961965339},{"type":"v1","addr":"172.21.15.35:6823","nonce":1961965339}]},"public_addr":"172.21.15.35:6819/1961965339","cluster_addr":"172.21.15.35:6821/1961965339","heartbeat_back_addr":"172.21.15.35:6825/1961965339","heartbeat_front_addr":"172.21.15.35:6823/1961965339","state":["exists","up"]},{"osd":7,"uuid":"9212f7b3-e1a7-4ea7-8666-55936c0c401d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6817","nonce":403506254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6819","nonce":403506254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6823","nonce":403506254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":403506254},{"type":"v1","addr":"172.21.15.78:6821","nonce":403506254}]},"public_addr":"172.21.15.78:6817/403506254","cluster_addr":"172.21.15.78:6819/403506254","heartbeat_back_addr":"172.21.15.78:6823/403506254","heartbeat_front_addr":"172.21.15.78:6821/403506254","state":["exists","up"]},{"osd":8,"uuid":"402f50a6-8d44-4cad-ba4b-273831715b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6817","nonce":1378962246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6819","nonce":1378962246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6823","nonce":1378962246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1378962246},{"type":"v1","addr":"172.21.15.82:6821","nonce":1378962246}]},"public_addr":"172.21.15.82:6817/1378962246","cluster_addr":"172.21.15.82:6819/1378962246","heartbeat_back_addr":"172.21.15.82:6823/1378962246","heartbeat_front_addr":"172.21.15.82:6821/1378962246","state":["exists","up"]},{"osd":9,"uuid":"c0d57d1e-141a-4e96-8d1f-53af74dd4571","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6826","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6827","nonce":105910462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6828","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6829","nonce":105910462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6832","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6833","nonce":105910462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6830","nonce":105910462},{"type":"v1","addr":"172.21.15.35:6831","nonce":105910462}]},"public_addr":"172.21.15.35:6827/105910462","cluster_addr":"172.21.15.35:6829/105910462","heartbeat_back_addr":"172.21.15.35:6833/105910462","heartbeat_front_addr":"172.21.15.35:6831/105910462","state":["exists","up"]},{"osd":10,"uuid":"61299bd0-4891-41b3-b39b-24d35fe313f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6825","nonce":2850996508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6827","nonce":2850996508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6831","nonce":2850996508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":2850996508},{"type":"v1","addr":"172.21.15.78:6829","nonce":2850996508}]},"public_addr":"172.21.15.78:6825/2850996508","cluster_addr":"172.21.15.78:6827/2850996508","heartbeat_back_addr":"172.21.15.78:6831/2850996508","heartbeat_front_addr":"172.21.15.78:6829/2850996508","state":["exists","up"]},{"osd":11,"uuid":"2b477025-7de4-4b85-8c90-19d2388da71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6825","nonce":77409820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6827","nonce":77409820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6831","nonce":77409820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":77409820},{"type":"v1","addr":"172.21.15.82:6829","nonce":77409820}]},"public_addr":"172.21.15.82:6825/77409820","cluster_addr":"172.21.15.82:6827/77409820","heartbeat_back_addr":"172.21.15.82:6831/77409820","heartbeat_front_addr":"172.21.15.82:6829/77409820","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:58:42.739443+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T07:59:32.032074+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:00:21.637428+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:01:46.945475+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:02:23.620376+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:03:12.979164+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:04:21.888725+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:05:20.269074+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:06:08.208710+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:02.126412+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:07:57.651582+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-17T08:08:49.445229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.35:0/3966835438":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6801/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:6800/1582063547":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1410246946":"2023-03-18T07:46:42.142153+0000","172.21.15.35:0/1232863299":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6801/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2484789635":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/1276660583":"2023-03-18T07:46:16.818211+0000","172.21.15.35:6800/3695297381":"2023-03-18T07:46:16.818211+0000","172.21.15.35:0/2098044192":"2023-03-18T07:46:42.142153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-17T08:45:44.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:40 smithi078 ceph-mon[94114]: pgmap v1849: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:45.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:42 smithi078 ceph-mon[94114]: pgmap v1850: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:45.791 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:40 smithi082 ceph-mon[94281]: pgmap v1849: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:45.791 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:42 smithi082 ceph-mon[94281]: pgmap v1850: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f14cc09f4d0 msgr2=0x7f14cc0a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f14cc09f4d0 0x7f14cc0a1980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f14e01000f0 tx=0x7f14d000b410 comp rx=0 tx=0).stop 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 msgr2=0x7f14e01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01985a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f14c8000c00 tx=0x7f14c8003f30 comp rx=0 tx=0).stop 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 shutdown_connections 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14e0100c20 0x7f14e019f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14e00ff0a0 0x7f14e0198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f14cc09f4d0 0x7f14cc0a1980 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 --2- 172.21.15.35:0/204642207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14e0100290 0x7f14e01985a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:45:45.792 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 >> 172.21.15.35:0/204642207 conn(0x7f14e00fa680 msgr2=0x7f14e00fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:45:47.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 shutdown_connections 2023-03-17T08:45:47.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:34.246+0000 7f14e51b8700 1 -- 172.21.15.35:0/204642207 wait complete. 2023-03-17T08:45:47.326 DEBUG:tasks.fwd_scrub:Yielding 2023-03-17T08:45:47.326 INFO:teuthology.run_tasks:Running task exec... 2023-03-17T08:45:47.343 INFO:teuthology.task.exec:Executing custom commands... 2023-03-17T08:45:49.213 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T08:45:49.213 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-03-17T08:45:49.213 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-03-17T08:45:49.988 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-17T08:45:50.573 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-17T08:45:50.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:34 smithi035 ceph-mon[92535]: pgmap v1846: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:50.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:51.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:34 smithi035 ceph-mon[92535]: from='mgr.14152 172.21.15.35:0/3508683687' entity='mgr.x' 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/204642207' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:36 smithi035 ceph-mon[92535]: pgmap v1847: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:38 smithi035 ceph-mon[92535]: pgmap v1848: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:40 smithi035 ceph-mon[92535]: pgmap v1849: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:42 smithi035 ceph-mon[92535]: pgmap v1850: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:44 smithi035 ceph-mon[92535]: pgmap v1851: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:45 smithi035 ceph-mon[92535]: pgmap v1852: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:51.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:48 smithi035 ceph-mon[92535]: pgmap v1853: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:51.243 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:50 smithi035 ceph-mon[92535]: pgmap v1854: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:52.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:44 smithi078 ceph-mon[94114]: pgmap v1851: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:45 smithi078 ceph-mon[94114]: pgmap v1852: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:48 smithi078 ceph-mon[94114]: pgmap v1853: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:50 smithi078 ceph-mon[94114]: pgmap v1854: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mon[94114]: pgmap v1855: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mon[94114]: scrub queued for path: / 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mon[94114]: scrub summary: idle+waiting paths [/] 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mon[94114]: scrub summary: active paths [/] 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mon[94114]: scrub summary: idle+waiting paths [/] 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/68715587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:44 smithi082 ceph-mon[94281]: pgmap v1851: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:52.684 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:45 smithi082 ceph-mon[94281]: pgmap v1852: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:48 smithi082 ceph-mon[94281]: pgmap v1853: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:50 smithi082 ceph-mon[94281]: pgmap v1854: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mon[94281]: pgmap v1855: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mon[94281]: scrub queued for path: / 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mon[94281]: scrub summary: idle+waiting paths [/] 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mon[94281]: scrub summary: active paths [/] 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mon[94281]: scrub summary: idle+waiting paths [/] 2023-03-17T08:45:54.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/68715587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: ignoring --setuser ceph since I am not root 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: ignoring --setgroup ceph since I am not root 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-mgr[95600]: -- 172.21.15.78:0/3592465366 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f451ce2b60 con 0x55f451cb9000 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:52.412+0000 7f1a26f0a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:52.492+0000 7f1a26f0a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: ignoring --setuser ceph since I am not root 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: ignoring --setgroup ceph since I am not root 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-mgr[96108]: -- 172.21.15.82:0/4101585713 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557158320b60 con 0x5571582f6800 2023-03-17T08:45:54.926 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:52.402+0000 7f9f5b1fe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-17T08:45:55.541 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:52.483+0000 7f9f5b1fe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-17T08:45:55.541 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:52.571+0000 7f9f5b1fe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-17T08:45:55.541 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:52.663+0000 7f9f5b1fe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-17T08:45:55.541 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:52 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:52.829+0000 7f9f5b1fe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-17T08:45:55.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/68715587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-03-17T08:45:55.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-mon[94281]: mgrmap e19: x(active, since 59m), standbys: y, z 2023-03-17T08:45:55.542 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:53.132+0000 7f9f5b1fe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-17T08:45:55.542 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:53.220+0000 7f9f5b1fe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-17T08:45:55.953 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:53.348+0000 7f9f5b1fe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-17T08:45:55.953 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:53.440+0000 7f9f5b1fe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-17T08:45:55.953 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:53 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:53.858+0000 7f9f5b1fe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-17T08:45:55.953 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:54 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:54.414+0000 7f9f5b1fe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-17T08:45:55.953 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:54 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:54.582+0000 7f9f5b1fe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-17T08:45:55.954 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:55 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:55.330+0000 7f9f5b1fe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-17T08:45:57.157 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:55 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:55.420+0000 7f9f5b1fe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-17T08:45:57.159 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:52.581+0000 7f1a26f0a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-17T08:45:58.690 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:52.673+0000 7f1a26f0a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-17T08:45:58.690 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:52 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:52.841+0000 7f1a26f0a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-17T08:45:58.690 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:53.146+0000 7f1a26f0a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-17T08:45:58.691 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:53.235+0000 7f1a26f0a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-17T08:45:58.691 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:53.364+0000 7f1a26f0a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-17T08:45:58.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/68715587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-03-17T08:45:58.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-mon[94114]: mgrmap e19: x(active, since 59m), standbys: y, z 2023-03-17T08:45:58.693 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:55 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:55.590+0000 7f9f5b1fe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-17T08:45:58.697 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:55 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:55.864+0000 7f9f5b1fe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-17T08:45:59.144 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:55 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:55.951+0000 7f9f5b1fe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-17T08:46:00.632 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:56 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:56.236+0000 7f9f5b1fe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-17T08:46:00.633 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:56 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:56.493+0000 7f9f5b1fe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-17T08:46:00.633 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:57 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:57.186+0000 7f9f5b1fe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-17T08:46:00.633 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:57 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:57.316+0000 7f9f5b1fe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-17T08:46:00.633 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:57 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:57.502+0000 7f9f5b1fe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-17T08:46:00.633 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:57 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:57.614+0000 7f9f5b1fe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-17T08:46:00.633 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:57 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:57.825+0000 7f9f5b1fe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:53.457+0000 7f1a26f0a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:53 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:53.876+0000 7f1a26f0a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:54 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:54.437+0000 7f1a26f0a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:54 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:54.606+0000 7f1a26f0a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:55 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:55.356+0000 7f1a26f0a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:55 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:55.446+0000 7f1a26f0a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-17T08:46:00.634 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:55 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:55.614+0000 7f1a26f0a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-17T08:46:00.635 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:55 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:55.887+0000 7f1a26f0a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-17T08:46:00.635 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:55 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:55.976+0000 7f1a26f0a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-17T08:46:00.635 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:56 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:56.261+0000 7f1a26f0a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-17T08:46:00.635 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:56 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:56.517+0000 7f1a26f0a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-17T08:46:00.635 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:57 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:57.209+0000 7f1a26f0a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-17T08:46:00.635 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:57 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:57.338+0000 7f1a26f0a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-17T08:46:01.017 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:57 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:57.525+0000 7f1a26f0a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-17T08:46:01.903 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:57 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:57.637+0000 7f1a26f0a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-17T08:46:01.903 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:57 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:57.849+0000 7f1a26f0a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-17T08:46:01.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 -- 172.21.15.35:0/697058501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 msgr2=0x7f6640101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:01.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 --2- 172.21.15.35:0/697058501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f6640101c60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f663c009990 tx=0x7f663c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:46:01.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 -- 172.21.15.35:0/697058501 shutdown_connections 2023-03-17T08:46:02.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 --2- 172.21.15.35:0/697058501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66400fe8e0 0x7f66400fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:02.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 --2- 172.21.15.35:0/697058501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f6640101c60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:02.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 --2- 172.21.15.35:0/697058501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66401021a0 0x7f66400fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:02.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 -- 172.21.15.35:0/697058501 >> 172.21.15.35:0/697058501 conn(0x7f66400f9e70 msgr2=0x7f66400fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 -- 172.21.15.35:0/697058501 shutdown_connections 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.379+0000 7f6647404700 1 -- 172.21.15.35:0/697058501 wait complete. 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 Processor -- start 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 -- start start 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400fe8e0 0x7f6640195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f66401963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66401021a0 0x7f664019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664019da00 con 0x7f6640101850 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664019db40 con 0x7f66400fe8e0 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f6647404700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400ff3d0 con 0x7f66401021a0 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f664499f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f66401963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f664499f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f66401963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41808/0 (socket says 172.21.15.35:41808) 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f664499f700 1 -- 172.21.15.35:0/68715587 learned_addr learned my addr 172.21.15.35:0/68715587 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:46:02.822 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f66451a0700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400fe8e0 0x7f6640195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.380+0000 7f66459a1700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66401021a0 0x7f664019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f664499f700 1 -- 172.21.15.35:0/68715587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66401021a0 msgr2=0x7f664019d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f664499f700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66401021a0 0x7f664019d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f664499f700 1 -- 172.21.15.35:0/68715587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400fe8e0 msgr2=0x7f6640195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f664499f700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400fe8e0 0x7f6640195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f664499f700 1 -- 172.21.15.35:0/68715587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0095f0 con 0x7f6640101850 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f664499f700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f66401963c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f663000e9a0 tx=0x7f663000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630009790 con 0x7f6640101850 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6630010430 con 0x7f6640101850 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664010ba30 con 0x7f6640101850 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000cea0 con 0x7f6640101850 2023-03-17T08:46:02.823 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.381+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664010b8a0 con 0x7f6640101850 2023-03-17T08:46:02.824 INFO:journalctl@ceph.mgr.y.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-y[95575]: 2023-03-17T08:45:58.695+0000 7f1a26f0a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-17T08:46:04.402 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-z[96084]: 2023-03-17T08:45:58.668+0000 7f9f5b1fe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-17T08:46:04.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 -- 172.21.15.35:0/2851353893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1980ff170 msgr2=0x7fb1980ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/2851353893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1980ff170 0x7fb1980ff580 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb188009990 tx=0x7fb188009ca0 comp rx=0 tx=0).stop 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 -- 172.21.15.35:0/2851353893 shutdown_connections 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/2851353893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb198100cf0 0x7fb1981075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/2851353893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1980ff170 0x7fb1980ff580 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/2851353893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb198100360 0x7fb1981007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 -- 172.21.15.35:0/2851353893 >> 172.21.15.35:0/2851353893 conn(0x7fb1980fa790 msgr2=0x7fb1980fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 -- 172.21.15.35:0/2851353893 shutdown_connections 2023-03-17T08:46:04.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7fb19cc7f700 1 -- 172.21.15.35:0/2851353893 wait complete. 2023-03-17T08:46:05.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.382+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640106fc0 con 0x7f6640101850 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: Standby manager daemon z restarted 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: Standby manager daemon z started 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: Standby manager daemon y restarted 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: Standby manager daemon y started 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-17T08:46:05.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:58 smithi078 ceph-mon[94114]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:45:59 smithi078 ceph-mon[94114]: mgrmap e20: x(active, since 59m), standbys: y, z 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:00 smithi078 ceph-mon[94114]: Active manager daemon x restarted 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:00 smithi078 ceph-mon[94114]: Activating manager daemon x 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:00 smithi078 ceph-mon[94114]: osdmap e92: 12 total, 12 up, 12 in 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: mgrmap e21: x(active, starting, since 0.584491s), standbys: y, z 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:46:05.121 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:46:07.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:46:07.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-17T08:46:07.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T08:46:07.871 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-17T08:46:07.872 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-17T08:46:10.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-17T08:46:10.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T08:46:10.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T08:46:10.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:46:11.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:46:11.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:46:11.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:46:11.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:46:11.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:46:11.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: Manager daemon x is now available 2023-03-17T08:46:11.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:46:11.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:46:11.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-17T08:46:11.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-17T08:46:11.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:02 smithi078 ceph-mon[94114]: mgrmap e22: x(active, since 1.58954s), standbys: y, z 2023-03-17T08:46:11.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:02 smithi078 ceph-mon[94114]: [17/Mar/2023:08:46:01] ENGINE Bus STARTING 2023-03-17T08:46:11.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:02 smithi078 ceph-mon[94114]: [17/Mar/2023:08:46:02] ENGINE Serving on https://172.21.15.35:7150 2023-03-17T08:46:11.855 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:02 smithi078 ceph-mon[94114]: [17/Mar/2023:08:46:02] ENGINE Serving on http://172.21.15.35:8765 2023-03-17T08:46:11.855 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:02 smithi078 ceph-mon[94114]: [17/Mar/2023:08:46:02] ENGINE Bus STARTED 2023-03-17T08:46:11.855 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:03 smithi078 ceph-mon[94114]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:46:15.027 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:03 smithi078 ceph-mon[94114]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-03-17T08:46:15.027 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:03 smithi078 ceph-mon[94114]: scrub summary: idle 2023-03-17T08:46:15.027 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: Standby manager daemon z restarted 2023-03-17T08:46:15.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: Standby manager daemon z started 2023-03-17T08:46:15.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-17T08:46:15.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T08:46:15.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-17T08:46:16.565 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T08:46:16.565 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: Standby manager daemon y restarted 2023-03-17T08:46:17.417 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: Standby manager daemon y started 2023-03-17T08:46:18.655 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-17T08:46:18.655 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T08:46:19.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-17T08:46:19.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:58 smithi082 ceph-mon[94281]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T08:46:19.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:45:59 smithi082 ceph-mon[94281]: mgrmap e20: x(active, since 59m), standbys: y, z 2023-03-17T08:46:19.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:00 smithi082 ceph-mon[94281]: Active manager daemon x restarted 2023-03-17T08:46:19.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:00 smithi082 ceph-mon[94281]: Activating manager daemon x 2023-03-17T08:46:19.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:00 smithi082 ceph-mon[94281]: osdmap e92: 12 total, 12 up, 12 in 2023-03-17T08:46:19.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: mgrmap e21: x(active, starting, since 0.584491s), standbys: y, z 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-17T08:46:19.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-17T08:46:20.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-17T08:46:20.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T08:46:20.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-17T08:46:20.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-17T08:46:21.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-17T08:46:21.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-17T08:46:22.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-17T08:46:22.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-17T08:46:23.864 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-17T08:46:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-17T08:46:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T08:46:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T08:46:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:46:23.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:46:26.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:46:26.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:46:26.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:46:26.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: Manager daemon x is now available 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:46:27.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-17T08:46:28.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-17T08:46:28.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:02 smithi082 ceph-mon[94281]: mgrmap e22: x(active, since 1.58954s), standbys: y, z 2023-03-17T08:46:28.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:02 smithi082 ceph-mon[94281]: [17/Mar/2023:08:46:01] ENGINE Bus STARTING 2023-03-17T08:46:28.995 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:02 smithi082 ceph-mon[94281]: [17/Mar/2023:08:46:02] ENGINE Serving on https://172.21.15.35:7150 2023-03-17T08:46:28.995 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:02 smithi082 ceph-mon[94281]: [17/Mar/2023:08:46:02] ENGINE Serving on http://172.21.15.35:8765 2023-03-17T08:46:28.995 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:02 smithi082 ceph-mon[94281]: [17/Mar/2023:08:46:02] ENGINE Bus STARTED 2023-03-17T08:46:28.995 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:03 smithi082 ceph-mon[94281]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:46:30.325 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:03 smithi082 ceph-mon[94281]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-03-17T08:46:30.325 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:03 smithi082 ceph-mon[94281]: scrub summary: idle 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 Processor -- start 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 -- start start 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980ff170 0x7fb198069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 0x7fb19819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb198100cf0 0x7fb19819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19819da10 con 0x7fb198100360 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19819db80 con 0x7fb198100cf0 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19cc7f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19819dd40 con 0x7fb1980ff170 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 0x7fb19819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 0x7fb19819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41814/0 (socket says 172.21.15.35:41814) 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb19659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980ff170 0x7fb198069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:30.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.383+0000 7fb195d9b700 1 -- 172.21.15.35:0/4152735503 learned_addr learned my addr 172.21.15.35:0/4152735503 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb196d9d700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb198100cf0 0x7fb19819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19659c700 1 -- 172.21.15.35:0/4152735503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb198100cf0 msgr2=0x7fb19819d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19659c700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb198100cf0 0x7fb19819d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19659c700 1 -- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 msgr2=0x7fb19819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19659c700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 0x7fb19819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19659c700 1 -- 172.21.15.35:0/4152735503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880095f0 con 0x7fb1980ff170 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb195d9b700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 0x7fb19819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19659c700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980ff170 0x7fb198069b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb188000c00 tx=0x7fb1880057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb1877fe700 1 -- 172.21.15.35:0/4152735503 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18801d070 con 0x7fb1980ff170 2023-03-17T08:46:30.328 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7f66300105a0 con 0x7f6640101850 2023-03-17T08:46:30.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19810a990 con 0x7fb1980ff170 2023-03-17T08:46:30.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb1877fe700 1 -- 172.21.15.35:0/4152735503 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb18800be90 con 0x7fb1980ff170 2023-03-17T08:46:30.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb1877fe700 1 -- 172.21.15.35:0/4152735503 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800f460 con 0x7fb1980ff170 2023-03-17T08:46:30.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.384+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19810a800 con 0x7fb1980ff170 2023-03-17T08:46:30.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.385+0000 7f66367fc700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f662c09f550 0x7f662c0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:30.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.385+0000 7f66451a0700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f662c09f550 0x7f662c0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:30.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.385+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7f6630014070 con 0x7f6640101850 2023-03-17T08:46:30.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.386+0000 7f66451a0700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f662c09f550 0x7f662c0a1a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f663c006010 tx=0x7f663c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:30.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:30.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:31.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:46:31.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:32.420 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:46:32.420 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:46:32.420 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:32.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:32.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:32.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:32.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:32.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:32.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:46:32.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:46:32.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:46:32.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:46:32.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T08:46:34.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T08:46:34.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T08:46:34.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi035:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:46:35.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:46:35.683 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:08 smithi078 ceph-mon[94114]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 205 B/s rd, 205 B/s wr, 2 op/s 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:10 smithi078 ceph-mon[94114]: pgmap v7: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 146 B/s wr, 7 op/s 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:12 smithi078 ceph-mon[94114]: pgmap v8: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 113 B/s wr, 6 op/s 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:14 smithi078 ceph-mon[94114]: pgmap v9: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:15 smithi078 ceph-mon[94114]: pgmap v10: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:17 smithi078 ceph-mon[94114]: pgmap v11: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:46:36.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:19 smithi078 ceph-mon[94114]: pgmap v12: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2023-03-17T08:46:36.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:21 smithi078 ceph-mon[94114]: pgmap v13: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:36.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:23 smithi078 ceph-mon[94114]: pgmap v14: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:36.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:25 smithi078 ceph-mon[94114]: pgmap v15: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:36.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:27 smithi078 ceph-mon[94114]: pgmap v16: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T08:46:36.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:29 smithi078 ceph-mon[94114]: pgmap v17: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:37.463 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:46:38.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:39.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:39.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi035:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:46:39.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:40.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:40.198 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:40.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:40.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:46:40.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:46:40.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:46:40.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:46:40.811 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:08 smithi082 ceph-mon[94281]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 205 B/s rd, 205 B/s wr, 2 op/s 2023-03-17T08:46:41.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:10 smithi082 ceph-mon[94281]: pgmap v7: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 146 B/s wr, 7 op/s 2023-03-17T08:46:41.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:12 smithi082 ceph-mon[94281]: pgmap v8: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 113 B/s wr, 6 op/s 2023-03-17T08:46:41.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:14 smithi082 ceph-mon[94281]: pgmap v9: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T08:46:41.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:15 smithi082 ceph-mon[94281]: pgmap v10: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:46:41.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:17 smithi082 ceph-mon[94281]: pgmap v11: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:46:41.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:19 smithi082 ceph-mon[94281]: pgmap v12: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2023-03-17T08:46:41.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:21 smithi082 ceph-mon[94281]: pgmap v13: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:42.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:23 smithi082 ceph-mon[94281]: pgmap v14: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:42.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:25 smithi082 ceph-mon[94281]: pgmap v15: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:42.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:27 smithi082 ceph-mon[94281]: pgmap v16: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.387+0000 7fb1877fe700 1 -- 172.21.15.35:0/4152735503 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 133261+0+0 (secure 0 0 0) 0x7fb18800ba00 con 0x7fb1980ff170 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.387+0000 7fb1877fe700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb18009f4d0 0x7fb1800a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.387+0000 7fb195d9b700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb18009f4d0 0x7fb1800a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.387+0000 7fb1877fe700 1 -- 172.21.15.35:0/4152735503 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb1880cb640 con 0x7fb1980ff170 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb195d9b700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb18009f4d0 0x7fb1800a1980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0104e0 tx=0x7fb18c007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 Processor -- start 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 -- start start 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4a5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a5d20 0x55774f4a6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f3ac0f0 con 0x55774f4a74b0 2023-03-17T08:46:42.278 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f3fea30 con 0x55774f4a6b60 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f3f7ec0 con 0x55774f4a5d20 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41824/0 (socket says 172.21.15.35:41824) 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.388+0000 7fb195d9b700 1 -- 172.21.15.35:0/2619316795 learned_addr learned my addr 172.21.15.35:0/2619316795 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb196d9d700 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a5d20 0x55774f4a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb19659c700 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb195d9b700 1 -- 172.21.15.35:0/2619316795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a5d20 msgr2=0x55774f4a6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb195d9b700 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a5d20 0x55774f4a6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb195d9b700 1 -- 172.21.15.35:0/2619316795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 msgr2=0x55774f4a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb195d9b700 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4a6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb195d9b700 1 -- 172.21.15.35:0/2619316795 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774f2796b0 con 0x55774f4a74b0 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb19659c700 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:46:42.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb195d9b700 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4a5740 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb18c011850 tx=0x7fb18c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d597b51b5f8ad808 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:42.280 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f6630094c70 con 0x7f6640101850 2023-03-17T08:46:42.281 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:31 smithi078 ceph-mon[94114]: pgmap v18: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:43.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:33 smithi078 ceph-mon[94114]: pgmap v19: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:43.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:35 smithi078 ceph-mon[94114]: pgmap v20: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:43.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:37 smithi078 ceph-mon[94114]: pgmap v21: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-17T08:46:43.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:39 smithi078 ceph-mon[94114]: pgmap v22: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T08:46:43.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:41 smithi078 ceph-mon[94114]: pgmap v23: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:43.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:29 smithi082 ceph-mon[94281]: pgmap v17: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:46:43.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:31 smithi082 ceph-mon[94281]: pgmap v18: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:43.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:33 smithi082 ceph-mon[94281]: pgmap v19: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:43.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:35 smithi082 ceph-mon[94281]: pgmap v20: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:43.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:37 smithi082 ceph-mon[94281]: pgmap v21: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-17T08:46:43.080 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:39 smithi082 ceph-mon[94281]: pgmap v22: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T08:46:43.081 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:41 smithi082 ceph-mon[94281]: pgmap v23: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:43.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb184ff9700 1 -- 172.21.15.35:0/2619316795 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c01e620 con 0x55774f4a74b0 2023-03-17T08:46:44.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb184ff9700 1 -- 172.21.15.35:0/2619316795 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb18c015070 con 0x55774f4a74b0 2023-03-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.389+0000 7fb184ff9700 1 -- 172.21.15.35:0/2619316795 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c026b00 con 0x55774f4a74b0 2023-03-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2619316795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 msgr2=0x55774f4a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:44.147 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4a5740 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb18c011850 tx=0x7fb18c013000 comp rx=0 tx=0).stop 2023-03-17T08:46:44.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2619316795 shutdown_connections 2023-03-17T08:46:44.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a5d20 0x55774f4a6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:44.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:44.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2619316795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4a5740 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:44.516 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2619316795 >> 172.21.15.35:0/2619316795 conn(0x55774f4a1cd0 msgr2=0x55774f4a00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:44.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2619316795 shutdown_connections 2023-03-17T08:46:44.517 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.390+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2619316795 wait complete. 2023-03-17T08:46:44.961 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 -- start start 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 Processor -- start 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 0x55774f4afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f27b9a0 con 0x55774f4a6b60 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4b7060 con 0x55774f4a5d20 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4b71f0 con 0x55774f4a74b0 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb1a8e0cb80 10 client.0 _ll_register_callbacks cb 0x55774f29d310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:46:44.962 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 0x55774f4afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:45.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb195d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 0x55774f4afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41830/0 (socket says 172.21.15.35:41830) 2023-03-17T08:46:45.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.391+0000 7fb195d9b700 1 -- 172.21.15.35:0/3280495043 learned_addr learned my addr 172.21.15.35:0/3280495043 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:46:45.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb19659c700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb196d9d700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb195d9b700 1 -- 172.21.15.35:0/3280495043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 msgr2=0x55774f4b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb195d9b700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb195d9b700 1 -- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 msgr2=0x55774f4af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb195d9b700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb195d9b700 1 -- 172.21.15.35:0/3280495043 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c011500 con 0x55774f4a6b60 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb19659c700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb195d9b700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 0x55774f4afae0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007720 tx=0x7fb18c026a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4ace2dc12441a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb17dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb17dffb700 1 -- 172.21.15.35:0/3280495043 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c01e620 con 0x55774f4a6b60 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb17dffb700 1 -- 172.21.15.35:0/3280495043 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb18c017070 con 0x55774f4a6b60 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55774f3ba470 con 0x55774f4a6b60 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb17dffb700 1 -- 172.21.15.35:0/3280495043 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb18c026e70 con 0x55774f4a6b60 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.392+0000 7fb1a8e0cb80 10 client.15300 fetch_fsmap learned FSMap version 29 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55774f225e60 con 0x55774f4a6b60 2023-03-17T08:46:45.907 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb17dffb700 1 -- 172.21.15.35:0/3280495043 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55774f3ba470 con 0x55774f4a6b60 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb17dffb700 1 -- 172.21.15.35:0/3280495043 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb18c024020 con 0x55774f4a6b60 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 10 client.15300 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 20 client.15300 populate_metadata read hostname 'smithi035' 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f4bb520 0x55774f4bd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 4 client.15300 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55774f3c66e0 con 0x55774f4bb520 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.393+0000 7fb19659c700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f4bb520 0x55774f4bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.394+0000 7fb17dffb700 10 client.15300 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.394+0000 7fb19659c700 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f4bb520 0x55774f4bd930 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f5a2b67747d629 server_cookie=435a8d1ace64707 in_seq=0 out_seq=0 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.394+0000 7fb17dffb700 1 -- 172.21.15.35:0/3280495043 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55774f3c66e0 con 0x55774f4bb520 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.394+0000 7fb17dffb700 10 client.15300 handle_command_reply: tid=0 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.394+0000 7fb1a8e0cb80 1 client.15300 shutdown 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 msgr2=0x55774f4afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 0x55774f4afae0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007720 tx=0x7fb18c026a30 comp rx=0 tx=0).stop 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 shutdown_connections 2023-03-17T08:46:45.908 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f4bb520 0x55774f4bd930 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb17dffb700 0 client.15300 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3280495043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a6b60 0x55774f4afae0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 >> 172.21.15.35:0/3280495043 conn(0x55774f4a1cd0 msgr2=0x55774f49f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 shutdown_connections 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3280495043 wait complete. 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.395+0000 7fb1a8e0cb80 20 client.15300 trim_cache size 0 max 16384 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 Processor -- start 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 -- start start 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a6b60 0x55774f4b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:45.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4af110 con 0x55774f4a74b0 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4ade40 con 0x55774f4a5d20 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4adb50 con 0x55774f4a6b60 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb196d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb196d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41840/0 (socket says 172.21.15.35:41840) 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.412+0000 7fb196d9d700 1 -- 172.21.15.35:0/3513255606 learned_addr learned my addr 172.21.15.35:0/3513255606 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:46:47.963 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb19659c700 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb195d9b700 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a6b60 0x55774f4b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb196d9d700 1 -- 172.21.15.35:0/3513255606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a6b60 msgr2=0x55774f4b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb196d9d700 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a6b60 0x55774f4b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb196d9d700 1 -- 172.21.15.35:0/3513255606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 msgr2=0x55774f4af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb196d9d700 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb196d9d700 1 -- 172.21.15.35:0/3513255606 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55774f49cad0 con 0x55774f4a74b0 2023-03-17T08:46:48.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb196d9d700 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4af890 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb1900119d0 tx=0x7fb190009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2424dee950eea31 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:48.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb1857fa700 1 -- 172.21.15.35:0/3513255606 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19000e040 con 0x55774f4a74b0 2023-03-17T08:46:48.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb1857fa700 1 -- 172.21.15.35:0/3513255606 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb19000f040 con 0x55774f4a74b0 2023-03-17T08:46:48.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.413+0000 7fb1857fa700 1 -- 172.21.15.35:0/3513255606 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190007a90 con 0x55774f4a74b0 2023-03-17T08:46:48.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3513255606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 msgr2=0x55774f4af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:48.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4af890 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb1900119d0 tx=0x7fb190009920 comp rx=0 tx=0).stop 2023-03-17T08:46:48.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3513255606 shutdown_connections 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a74b0 0x55774f4af890 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a5d20 0x55774f4af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/3513255606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a6b60 0x55774f4b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3513255606 >> 172.21.15.35:0/3513255606 conn(0x55774f4a1cd0 msgr2=0x55774f4a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3513255606 shutdown_connections 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/3513255606 wait complete. 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 -- start start 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.414+0000 7fb1a8e0cb80 1 Processor -- start 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 0x55774f4b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:48.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:51.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4b5820 con 0x55774f4a5d20 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4b5990 con 0x55774f4a6b60 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55774f4b5b50 con 0x55774f4a74b0 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb1a8e0cb80 10 client.0 _ll_register_callbacks cb 0x55774f29d310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 0x55774f4b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 0x55774f4b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:41842/0 (socket says 172.21.15.35:41842) 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 -- 172.21.15.35:0/2831134142 learned_addr learned my addr 172.21.15.35:0/2831134142 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb195d9b700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb196d9d700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 -- 172.21.15.35:0/2831134142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 msgr2=0x55774f4b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 -- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 msgr2=0x55774f4b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 -- 172.21.15.35:0/2831134142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1900116b0 con 0x55774f4a5d20 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb196d9d700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb19659c700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 0x55774f4b3d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb188095a20 tx=0x7fb1880cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57203f7cafd0b11a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:46:51.356 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb17dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.415+0000 7fb17dffb700 1 -- 172.21.15.35:0/2831134142 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188095040 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb17dffb700 1 -- 172.21.15.35:0/2831134142 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8153+0+0 (secure 0 0 0) 0x7fb1880a1680 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55774f4752c0 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb17dffb700 1 -- 172.21.15.35:0/2831134142 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1880978c0 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 10 client.15306 fetch_fsmap learned FSMap version 29 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55774f20ece0 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb17dffb700 1 -- 172.21.15.35:0/2831134142 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55774f4752c0 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb17dffb700 1 -- 172.21.15.35:0/2831134142 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb188099780 con 0x55774f4a5d20 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 10 client.15306 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 20 client.15306 populate_metadata read hostname 'smithi035' 2023-03-17T08:46:51.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f511480 0x55774f513890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:46:52.705 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 4 client.15306 mds_command: new command op to 24452 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-17T08:46:52.705 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55774f27bfe0 con 0x55774f511480 2023-03-17T08:46:52.705 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.416+0000 7fb195d9b700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f511480 0x55774f513890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:46:52.705 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.417+0000 7fb17dffb700 10 client.15306 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:46:52.705 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.417+0000 7fb195d9b700 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f511480 0x55774f513890 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c953f60629d338 server_cookie=90357b018d69b266 in_seq=0 out_seq=0 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb17dffb700 1 -- 172.21.15.35:0/2831134142 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55774f27bfe0 con 0x55774f511480 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb17dffb700 10 client.15306 handle_command_reply: tid=0 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 client.15306 shutdown 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 msgr2=0x55774f4b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 0x55774f4b3d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb188095a20 tx=0x7fb1880cb040 comp rx=0 tx=0).stop 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 shutdown_connections 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55774f511480 0x55774f513890 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774f4a74b0 0x55774f4b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:52.706 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55774f4a5d20 0x55774f4b3d90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:52.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb17dffb700 0 client.15306 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:46:52.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 --2- 172.21.15.35:0/2831134142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55774f4a6b60 0x55774f4b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:52.707 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 >> 172.21.15.35:0/2831134142 conn(0x55774f4a1cd0 msgr2=0x55774f4af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:53.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 shutdown_connections 2023-03-17T08:46:53.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 1 -- 172.21.15.35:0/2831134142 wait complete. 2023-03-17T08:46:53.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.418+0000 7fb1a8e0cb80 20 client.15306 trim_cache size 0 max 16384 2023-03-17T08:46:53.248 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:46:53.249 INFO:teuthology.orchestra.run.smithi035.stdout: "return_code": 0, 2023-03-17T08:46:53.249 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_tag": "c87c7480-e41c-4c64-ad6f-35c91c6c1737", 2023-03-17T08:46:53.249 INFO:teuthology.orchestra.run.smithi035.stdout: "mode": "asynchronous" 2023-03-17T08:46:53.249 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb18009f4d0 msgr2=0x7fb1800a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb18009f4d0 0x7fb1800a1980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0104e0 tx=0x7fb18c007480 comp rx=0 tx=0).stop 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980ff170 msgr2=0x7fb198069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980ff170 0x7fb198069b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb188000c00 tx=0x7fb1880057b0 comp rx=0 tx=0).stop 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 shutdown_connections 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb198100cf0 0x7fb19819d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1980ff170 0x7fb198069b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7fb18009f4d0 0x7fb1800a1980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:53.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 --2- 172.21.15.35:0/4152735503 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb198100360 0x7fb19819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:54.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 >> 172.21.15.35:0/4152735503 conn(0x7fb1980fa790 msgr2=0x7fb1980fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:54.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 shutdown_connections 2023-03-17T08:46:54.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.419+0000 7fb19cc7f700 1 -- 172.21.15.35:0/4152735503 wait complete. 2023-03-17T08:46:54.545 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:43 smithi078 ceph-mon[94114]: pgmap v24: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:45 smithi078 ceph-mon[94114]: pgmap v25: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:47 smithi078 ceph-mon[94114]: pgmap v26: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:49 smithi078 ceph-mon[94114]: pgmap v27: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:51 smithi078 ceph-mon[94114]: pgmap v28: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:53 smithi078 ceph-mon[94114]: pgmap v29: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:43 smithi082 ceph-mon[94281]: pgmap v24: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:54.547 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:45 smithi082 ceph-mon[94281]: pgmap v25: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:55.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:47 smithi082 ceph-mon[94281]: pgmap v26: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:55.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:49 smithi082 ceph-mon[94281]: pgmap v27: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-17T08:46:55.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:51 smithi082 ceph-mon[94281]: pgmap v28: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:55.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:53 smithi082 ceph-mon[94281]: pgmap v29: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:46:56.501 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:55 smithi078 ceph-mon[94114]: pgmap v30: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:56.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:55 smithi082 ceph-mon[94281]: pgmap v30: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:46:56.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:51.650+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f6640100c90 con 0x7f6640101850 2023-03-17T08:46:56.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.231+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mgrmap(e 19) v1 ==== 133278+0+0 (secure 0 0 0) 0x7f6630095040 con 0x7f6640101850 2023-03-17T08:46:56.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.233+0000 7f66367fc700 1 -- 172.21.15.35:0/68715587 <== mon.0 v2:172.21.15.35:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f6630098700 con 0x7f6640101850 2023-03-17T08:46:56.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f662c09f550 msgr2=0x7f662c0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:56.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f662c09f550 0x7f662c0a1a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f663c006010 tx=0x7f663c005960 comp rx=0 tx=0).stop 2023-03-17T08:46:56.873 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 msgr2=0x7f66401963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f66401963c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f663000e9a0 tx=0x7f663000ecb0 comp rx=0 tx=0).stop 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 shutdown_connections 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66401021a0 0x7f664019d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66400fe8e0 0x7f6640195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:6800/889943724,v1:172.21.15.35:6801/889943724] conn(0x7f662c09f550 0x7f662c0a1a00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 --2- 172.21.15.35:0/68715587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6640101850 0x7f66401963c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 >> 172.21.15.35:0/68715587 conn(0x7f66400f9e70 msgr2=0x7f66400fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 shutdown_connections 2023-03-17T08:46:56.874 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:45:52.236+0000 7f6647404700 1 -- 172.21.15.35:0/68715587 wait complete. 2023-03-17T08:46:56.874 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-03-17T08:46:58.414 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mon[92535]: pgmap v1855: 97 pgs: 97 active+clean; 652 KiB data, 82 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:46:58.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mon[92535]: scrub queued for path: / 2023-03-17T08:46:59.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mon[92535]: scrub summary: idle+waiting paths [/] 2023-03-17T08:46:59.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mon[92535]: scrub summary: active paths [/] 2023-03-17T08:46:59.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mon[92535]: scrub summary: idle+waiting paths [/] 2023-03-17T08:46:59.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/68715587' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-03-17T08:46:59.231 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: ignoring --setuser ceph since I am not root 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: ignoring --setgroup ceph since I am not root 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-mgr[92805]: -- 172.21.15.35:0/1850374392 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a552710b60 con 0x55a5526e6c00 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:52.426+0000 7f6a4d0ce200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:52.523+0000 7f6a4d0ce200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:52.632+0000 7f6a4d0ce200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:52.744+0000 7f6a4d0ce200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:52 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:52.951+0000 7f6a4d0ce200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:53 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/68715587' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-03-17T08:46:59.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:53 smithi035 ceph-mon[92535]: mgrmap e19: x(active, since 59m), standbys: y, z 2023-03-17T08:46:59.924 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:53 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:53.346+0000 7f6a4d0ce200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-17T08:47:00.427 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:53 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:53.454+0000 7f6a4d0ce200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-17T08:47:00.427 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:53 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:53.607+0000 7f6a4d0ce200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-17T08:47:00.427 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:53 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:53.722+0000 7f6a4d0ce200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-17T08:47:00.427 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:54 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:54.238+0000 7f6a4d0ce200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-17T08:47:00.428 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:54 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:54.925+0000 7f6a4d0ce200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-17T08:47:01.677 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:55 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:55.119+0000 7f6a4d0ce200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:56.074+0000 7f6a4d0ce200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:56.187+0000 7f6a4d0ce200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:56.406+0000 7f6a4d0ce200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:56.756+0000 7f6a4d0ce200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:56 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:56.864+0000 7f6a4d0ce200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:57 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:57.197+0000 7f6a4d0ce200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:57 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:57.528+0000 7f6a4d0ce200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:58.368+0000 7f6a4d0ce200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-17T08:47:01.678 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:58.528+0000 7f6a4d0ce200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-17T08:47:02.014 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:58.776+0000 7f6a4d0ce200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-17T08:47:02.014 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:58.914+0000 7f6a4d0ce200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-17T08:47:02.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: Standby manager daemon z restarted 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: Standby manager daemon z started 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.82:0/342499591' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: Standby manager daemon y restarted 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: Standby manager daemon y started 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-03-17T08:47:02.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:58 smithi035 ceph-mon[92535]: from='mgr.? 172.21.15.78:0/2328112804' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-03-17T08:47:02.016 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:45:59 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:45:59.186+0000 7f6a4d0ce200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-17T08:47:02.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:45:59 smithi035 ceph-mon[92535]: mgrmap e20: x(active, since 59m), standbys: y, z 2023-03-17T08:47:03.184 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:57 smithi078 ceph-mon[94114]: pgmap v31: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:03.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:46:59 smithi078 ceph-mon[94114]: pgmap v32: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:01 smithi078 ceph-mon[94114]: pgmap v33: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:57 smithi082 ceph-mon[94281]: pgmap v31: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:46:59 smithi082 ceph-mon[94281]: pgmap v32: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:01 smithi082 ceph-mon[94281]: pgmap v33: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:00.233+0000 7f6a4d0ce200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:00 smithi035 ceph-mon[92535]: Active manager daemon x restarted 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:00 smithi035 ceph-mon[92535]: Activating manager daemon x 2023-03-17T08:47:03.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:00 smithi035 ceph-mon[92535]: osdmap e92: 12 total, 12 up, 12 in 2023-03-17T08:47:03.622 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.051+0000 7f69b0636700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:04.933 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.051+0000 7f69b0636700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:04.933 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.051+0000 7f69b0636700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:04.933 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.051+0000 7f69b0636700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:04.933 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.051+0000 7f69b0636700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:04.933 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.052+0000 7f69b2e3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:06.410 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.052+0000 7f69b2e3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:11.964 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.052+0000 7f69b2e3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:13.448 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.052+0000 7f69b2e3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:13.448 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:46:01.052+0000 7f69b2e3b700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:47:13.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:03 smithi078 ceph-mon[94114]: pgmap v34: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:14.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:05 smithi078 ceph-mon[94114]: pgmap v35: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:14.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:14.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:07 smithi078 ceph-mon[94114]: pgmap v36: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:14.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:14.875 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:14.875 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:09 smithi078 ceph-mon[94114]: pgmap v37: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:11 smithi078 ceph-mon[94114]: pgmap v38: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:03 smithi082 ceph-mon[94281]: pgmap v34: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:05 smithi082 ceph-mon[94281]: pgmap v35: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:07 smithi082 ceph-mon[94281]: pgmap v36: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:15.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:15.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:15.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:15.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:09 smithi082 ceph-mon[94281]: pgmap v37: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:15.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:11 smithi082 ceph-mon[94281]: pgmap v38: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:15.229 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:13 smithi078 ceph-mon[94114]: pgmap v39: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:15.955 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:13 smithi082 ceph-mon[94281]: pgmap v39: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:15.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: mgrmap e21: x(active, starting, since 0.584491s), standbys: y, z 2023-03-17T08:47:16.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-03-17T08:47:16.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-03-17T08:47:16.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-03-17T08:47:16.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-03-17T08:47:17.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-03-17T08:47:17.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-03-17T08:47:17.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-03-17T08:47:17.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-03-17T08:47:17.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-03-17T08:47:17.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: Manager daemon x is now available 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:02 smithi035 ceph-mon[92535]: mgrmap e22: x(active, since 1.58954s), standbys: y, z 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:02 smithi035 ceph-mon[92535]: [17/Mar/2023:08:46:01] ENGINE Bus STARTING 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:02 smithi035 ceph-mon[92535]: [17/Mar/2023:08:46:02] ENGINE Serving on https://172.21.15.35:7150 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:02 smithi035 ceph-mon[92535]: [17/Mar/2023:08:46:02] ENGINE Serving on http://172.21.15.35:8765 2023-03-17T08:47:17.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:02 smithi035 ceph-mon[92535]: [17/Mar/2023:08:46:02] ENGINE Bus STARTED 2023-03-17T08:47:17.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:03 smithi035 ceph-mon[92535]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:47:17.643 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:03 smithi035 ceph-mon[92535]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-03-17T08:47:17.643 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:03 smithi035 ceph-mon[92535]: scrub summary: idle 2023-03-17T08:47:17.643 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.643 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.643 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.643 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:17.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:18.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:47:18.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:47:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:47:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:47:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:19.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:20.003 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:20.003 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:20.003 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:47:20.003 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:47:20.003 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Updating smithi035:/etc/ceph/ceph.conf 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Updating smithi078:/etc/ceph/ceph.conf 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: Updating smithi082:/etc/ceph/ceph.conf 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.conf 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi035:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:47:20.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi078:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: Updating smithi082:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/config/ceph.client.admin.keyring 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:08 smithi035 ceph-mon[92535]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 205 B/s rd, 205 B/s wr, 2 op/s 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:10 smithi035 ceph-mon[92535]: pgmap v7: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 146 B/s wr, 7 op/s 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:12 smithi035 ceph-mon[92535]: pgmap v8: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 113 B/s wr, 6 op/s 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:14 smithi035 ceph-mon[92535]: pgmap v9: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:15 smithi035 ceph-mon[92535]: pgmap v10: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:47:20.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:17 smithi035 ceph-mon[92535]: pgmap v11: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:19 smithi035 ceph-mon[92535]: pgmap v12: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:21 smithi035 ceph-mon[92535]: pgmap v13: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:23 smithi035 ceph-mon[92535]: pgmap v14: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:25 smithi035 ceph-mon[92535]: pgmap v15: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:27 smithi035 ceph-mon[92535]: pgmap v16: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:29 smithi035 ceph-mon[92535]: pgmap v17: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:31 smithi035 ceph-mon[92535]: pgmap v18: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:33 smithi035 ceph-mon[92535]: pgmap v19: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:20.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:35 smithi035 ceph-mon[92535]: pgmap v20: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:21.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:37 smithi035 ceph-mon[92535]: pgmap v21: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2023-03-17T08:47:21.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:39 smithi035 ceph-mon[92535]: pgmap v22: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T08:47:21.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:41 smithi035 ceph-mon[92535]: pgmap v23: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:21.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:43 smithi035 ceph-mon[92535]: pgmap v24: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:21.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:45 smithi035 ceph-mon[92535]: pgmap v25: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:21.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:47 smithi035 ceph-mon[92535]: pgmap v26: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:21.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:49 smithi035 ceph-mon[92535]: pgmap v27: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:51 smithi035 ceph-mon[92535]: pgmap v28: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:53 smithi035 ceph-mon[92535]: pgmap v29: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:55 smithi035 ceph-mon[92535]: pgmap v30: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:57 smithi035 ceph-mon[92535]: pgmap v31: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:46:59 smithi035 ceph-mon[92535]: pgmap v32: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:01 smithi035 ceph-mon[92535]: pgmap v33: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:03 smithi035 ceph-mon[92535]: pgmap v34: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:22.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:05 smithi035 ceph-mon[92535]: pgmap v35: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.380 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:22.380 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:07 smithi035 ceph-mon[92535]: pgmap v36: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:22.380 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:22.380 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:22.380 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:22.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:09 smithi035 ceph-mon[92535]: pgmap v37: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:11 smithi035 ceph-mon[92535]: pgmap v38: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:22.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:13 smithi035 ceph-mon[92535]: pgmap v39: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:24.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:15 smithi078 ceph-mon[94114]: pgmap v40: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:25.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:17 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3116260154' entity='client.admin' 2023-03-17T08:47:25.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:25.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:25.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:25.489 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:26.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:17 smithi078 ceph-mon[94114]: pgmap v41: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:26.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:19 smithi078 ceph-mon[94114]: pgmap v42: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:21 smithi078 ceph-mon[94114]: pgmap v43: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:23 smithi078 ceph-mon[94114]: pgmap v44: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:15 smithi082 ceph-mon[94281]: pgmap v40: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:17 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3116260154' entity='client.admin' 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:17 smithi082 ceph-mon[94281]: pgmap v41: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:19 smithi082 ceph-mon[94281]: pgmap v42: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:21 smithi082 ceph-mon[94281]: pgmap v43: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:27.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:23 smithi082 ceph-mon[94281]: pgmap v44: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:27.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3370318568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe481054f0 msgr2=0x7fbe4810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:27.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3370318568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe481054f0 0x7fbe4810d0e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000b0d0 tx=0x7fbe4000b3e0 comp rx=0 tx=0).stop 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3370318568 shutdown_connections 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3370318568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe481054f0 0x7fbe4810d0e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3370318568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe48100be0 0x7fbe48100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3370318568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48101580 0x7fbe48104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3370318568 >> 172.21.15.35:0/3370318568 conn(0x7fbe480774b0 msgr2=0x7fbe480778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3370318568 shutdown_connections 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 -- 172.21.15.35:0/349667302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 msgr2=0x7fc4cc10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:27.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/349667302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 0x7fc4cc10bf90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400b0d0 tx=0x7fc4c400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:47:27.412 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3370318568 wait complete. 2023-03-17T08:47:27.412 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:25 smithi078 ceph-mon[94114]: pgmap v45: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:27.412 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:25 smithi082 ceph-mon[94281]: pgmap v45: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:28.958 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 -- 172.21.15.35:0/349667302 shutdown_connections 2023-03-17T08:47:28.958 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/349667302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 0x7fc4cc10bf90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:28.958 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/349667302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc0ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:28.958 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/349667302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ffd20 0x7fc4cc103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:28.958 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.097+0000 7fc4d13d9700 1 -- 172.21.15.35:0/349667302 >> 172.21.15.35:0/349667302 conn(0x7fc4cc076300 msgr2=0x7fc4cc076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:47:29.932 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.098+0000 7fc4d13d9700 1 -- 172.21.15.35:0/349667302 shutdown_connections 2023-03-17T08:47:29.932 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.098+0000 7fc4d13d9700 1 -- 172.21.15.35:0/349667302 wait complete. 2023-03-17T08:47:29.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.098+0000 7fbe4e9d9700 1 Processor -- start 2023-03-17T08:47:29.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.098+0000 7fbe4e9d9700 1 -- start start 2023-03-17T08:47:29.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.098+0000 7fc4d13d9700 1 Processor -- start 2023-03-17T08:47:29.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.098+0000 7fc4d13d9700 1 -- start start 2023-03-17T08:47:29.934 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4e9d9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 0x7fbe48196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:31.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4e9d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48101580 0x7fbe48196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:31.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4e9d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe481054f0 0x7fbe4819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:31.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4e9d9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4819b420 con 0x7fbe48100be0 2023-03-17T08:47:31.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4e9d9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4819b590 con 0x7fbe481054f0 2023-03-17T08:47:31.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4e9d9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4819b750 con 0x7fbe48101580 2023-03-17T08:47:31.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 0x7fbe48196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:31.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4d13d9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:31.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4d13d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4cc0ffd20 0x7fc4cc1968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:31.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4d13d9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 0x7fc4cc19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:31.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4d13d9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc19b370 con 0x7fc4cc1043c0 2023-03-17T08:47:31.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4d13d9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc19b4e0 con 0x7fc4cc0ff380 2023-03-17T08:47:31.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4d13d9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc19b6a0 con 0x7fc4cc0ffd20 2023-03-17T08:47:31.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe477fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48101580 0x7fbe48196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:31.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 0x7fbe48196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42260/0 (socket says 172.21.15.35:42260) 2023-03-17T08:47:33.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 -- 172.21.15.35:0/3116260154 learned_addr learned my addr 172.21.15.35:0/3116260154 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:47:33.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe4cf76700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe481054f0 0x7fbe4819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:33.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:33.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:44062/0 (socket says 172.21.15.35:44062) 2023-03-17T08:47:33.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 -- 172.21.15.35:0/1311578604 learned_addr learned my addr 172.21.15.35:0/1311578604 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:47:34.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 0x7fc4cc19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:34.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4cc0ffd20 0x7fc4cc1968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:34.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 -- 172.21.15.35:0/3116260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48101580 msgr2=0x7fbe48196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:34.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48101580 0x7fbe48196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:36.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 -- 172.21.15.35:0/3116260154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe481054f0 msgr2=0x7fbe4819ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:36.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe481054f0 0x7fbe4819ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:36.031 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 -- 172.21.15.35:0/3116260154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40009d00 con 0x7fbe48100be0 2023-03-17T08:47:36.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 -- 172.21.15.35:0/1311578604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4cc0ffd20 msgr2=0x7fc4cc1968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:36.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4cc0ffd20 0x7fc4cc1968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:36.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 -- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 msgr2=0x7fc4cc19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:36.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 0x7fc4cc19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:36.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fc4caffd700 1 -- 172.21.15.35:0/1311578604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4009d00 con 0x7fc4cc0ff380 2023-03-17T08:47:36.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.099+0000 7fbe47fff700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 0x7fbe48196440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e9a0 tx=0x7fbe3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:47:37.198 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:27 smithi078 ceph-mon[94114]: pgmap v46: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:37.198 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:29 smithi078 ceph-mon[94114]: pgmap v47: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:37.198 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:31 smithi078 ceph-mon[94114]: pgmap v48: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:33 smithi078 ceph-mon[94114]: pgmap v49: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:33 smithi078 ceph-mon[94114]: mgrmap e24: x(active, since 92s), standbys: y, z 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:27 smithi082 ceph-mon[94281]: pgmap v46: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:29 smithi082 ceph-mon[94281]: pgmap v47: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:31 smithi082 ceph-mon[94281]: pgmap v48: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:33 smithi082 ceph-mon[94281]: pgmap v49: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T08:47:37.199 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:33 smithi082 ceph-mon[94281]: mgrmap e24: x(active, since 92s), standbys: y, z 2023-03-17T08:47:37.200 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc196390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00e9a0 tx=0x7fc4bc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:47:37.200 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38009790 con 0x7fbe48100be0 2023-03-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe48110140 con 0x7fbe48100be0 2023-03-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe3800cbd0 con 0x7fbe48100be0 2023-03-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38018680 con 0x7fbe48100be0 2023-03-17T08:47:40.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fc4b3fff700 1 -- 172.21.15.35:0/1311578604 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc009790 con 0x7fc4cc0ff380 2023-03-17T08:47:41.408 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4810ffb0 con 0x7fbe48100be0 2023-03-17T08:47:42.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fc4b3fff700 1 -- 172.21.15.35:0/1311578604 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4bc010430 con 0x7fc4cc0ff380 2023-03-17T08:47:42.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.100+0000 7fc4b3fff700 1 -- 172.21.15.35:0/1311578604 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00cea0 con 0x7fc4cc0ff380 2023-03-17T08:47:42.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.101+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc10f040 con 0x7fc4cc0ff380 2023-03-17T08:47:42.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.101+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc10eeb0 con 0x7fc4cc0ff380 2023-03-17T08:47:42.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:35 smithi078 ceph-mon[94114]: pgmap v50: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T08:47:44.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:37 smithi078 ceph-mon[94114]: pgmap v51: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T08:47:44.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:39 smithi078 ceph-mon[94114]: pgmap v52: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T08:47:44.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:41 smithi078 ceph-mon[94114]: pgmap v53: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T08:47:44.434 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:35 smithi082 ceph-mon[94281]: pgmap v50: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T08:47:46.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:37 smithi082 ceph-mon[94281]: pgmap v51: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T08:47:46.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:39 smithi082 ceph-mon[94281]: pgmap v52: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T08:47:47.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:41 smithi082 ceph-mon[94281]: pgmap v53: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T08:47:47.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.101+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe481102d0 con 0x7fbe48100be0 2023-03-17T08:47:47.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.103+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 23) v1 ==== 133437+0+0 (secure 0 0 0) 0x7fbe3800cd40 con 0x7fbe48100be0 2023-03-17T08:47:47.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.104+0000 7fbe457fa700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbe3009f6d0 0x7fbe300a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:47.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.104+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fbe38014070 con 0x7fbe48100be0 2023-03-17T08:47:47.825 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.104+0000 7fc4b3fff700 1 -- 172.21.15.35:0/1311578604 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) v1 ==== 133437+0+0 (secure 0 0 0) 0x7fc4bc0105a0 con 0x7fc4cc0ff380 2023-03-17T08:47:47.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.104+0000 7fbe477fe700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbe3009f6d0 0x7fbe300a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:49.584 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fbe477fe700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbe3009f6d0 0x7fbe300a1b80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe48197a50 tx=0x7fbe3c0073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:47:49.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:43 smithi078 ceph-mon[94114]: pgmap v54: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T08:47:49.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:45 smithi078 ceph-mon[94114]: pgmap v55: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:47:49.586 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:47 smithi078 ceph-mon[94114]: pgmap v56: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:47:49.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:43 smithi082 ceph-mon[94281]: pgmap v54: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T08:47:49.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:45 smithi082 ceph-mon[94281]: pgmap v55: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:47:49.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:47 smithi082 ceph-mon[94281]: pgmap v56: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:47:49.587 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fc4b3fff700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc4b409f6d0 0x7fc4b40a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:51.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc4b409f6d0 0x7fc4b40a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:51.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fc4b3fff700 1 -- 172.21.15.35:0/1311578604 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc4bc014070 con 0x7fc4cc0ff380 2023-03-17T08:47:51.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fc4dd566b80 1 Processor -- start 2023-03-17T08:47:51.178 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fc4dd566b80 1 -- start start 2023-03-17T08:47:51.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.105+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc4b409f6d0 0x7fc4b40a1b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc1979a0 tx=0x7fc4c0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:47:51.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 0x5604d0f71ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:51.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f760f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:51.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f76630 0x5604d0f76a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:47:52.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0e78070 con 0x5604d0f717d0 2023-03-17T08:47:52.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0eca9b0 con 0x5604d0f76630 2023-03-17T08:47:52.480 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0ec3e40 con 0x5604d0f720e0 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 0x5604d0f71ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 0x5604d0f71ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42276/0 (socket says 172.21.15.35:42276) 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 -- 172.21.15.35:0/1420621077 learned_addr learned my addr 172.21.15.35:0/1420621077 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f760f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f76630 0x5604d0f76a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 -- 172.21.15.35:0/1420621077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 msgr2=0x5604d0f760f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:47:52.481 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f760f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 -- 172.21.15.35:0/1420621077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f76630 msgr2=0x5604d0f76a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f76630 0x5604d0f76a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 -- 172.21.15.35:0/1420621077 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604d0d45630 con 0x5604d0f717d0 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.106+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 0x5604d0f71ba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc021000 tx=0x7fc4bc098550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc136038c7e0b62 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.107+0000 7fc4b17fa700 1 -- 172.21.15.35:0/1420621077 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0c8690 con 0x5604d0f717d0 2023-03-17T08:47:52.826 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.107+0000 7fc4b17fa700 1 -- 172.21.15.35:0/1420621077 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4bc0c87f0 con 0x5604d0f717d0 2023-03-17T08:47:52.827 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.107+0000 7fc4b17fa700 1 -- 172.21.15.35:0/1420621077 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc097db0 con 0x5604d0f717d0 2023-03-17T08:47:52.827 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fbe38094c10 con 0x7fbe48100be0 2023-03-17T08:47:52.828 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:49 smithi078 ceph-mon[94114]: pgmap v57: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:53.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:51 smithi078 ceph-mon[94114]: pgmap v58: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:53.559 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:49 smithi082 ceph-mon[94281]: pgmap v57: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:53.559 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:51 smithi082 ceph-mon[94281]: pgmap v58: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:47:53.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1420621077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 msgr2=0x5604d0f71ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:47:54.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 0x5604d0f71ba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc021000 tx=0x7fc4bc098550 comp rx=0 tx=0).stop 2023-03-17T08:47:55.879 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1420621077 shutdown_connections 2023-03-17T08:47:55.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f76630 0x5604d0f76a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:55.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f717d0 0x5604d0f71ba0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:55.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1420621077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:47:55.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1420621077 >> 172.21.15.35:0/1420621077 conn(0x5604d0f6c030 msgr2=0x5604d0f6c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:47:55.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1420621077 shutdown_connections 2023-03-17T08:47:58.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.108+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1420621077 wait complete. 2023-03-17T08:47:58.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 -- start start 2023-03-17T08:47:58.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 Processor -- start 2023-03-17T08:48:00.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:00.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:00.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f7b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:00.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0d47920 con 0x5604d0f76630 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f7bf00 con 0x5604d0f720e0 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f878e0 con 0x5604d0f717d0 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4dd566b80 10 client.0 _ll_register_callbacks cb 0x5604d0d69290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f7b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f7b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42286/0 (socket says 172.21.15.35:42286) 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/2726359939 learned_addr learned my addr 172.21.15.35:0/2726359939 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4caffd700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:00.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/2726359939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 msgr2=0x5604d0f7ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:48:00.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.109+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:00.534 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 msgr2=0x5604d0f7b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:48:00.945 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:01.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/2726359939 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc10eeb0 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4caffd700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f7b790 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009610 tx=0x7fc4c400baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1f2c9372d3c54e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4aeff5700 1 -- 172.21.15.35:0/2726359939 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400e040 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4aeff5700 1 -- 172.21.15.35:0/2726359939 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc4c4003a00 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604d0e863f0 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4aeff5700 1 -- 172.21.15.35:0/2726359939 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c40078f0 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 10 client.15378 fetch_fsmap learned FSMap version 29 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5604d0cf1de0 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4aeff5700 1 -- 172.21.15.35:0/2726359939 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604d0e863f0 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4aeff5700 1 -- 172.21.15.35:0/2726359939 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc4c4019070 con 0x5604d0f76630 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 10 client.15378 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:48:01.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 20 client.15378 populate_metadata read hostname 'smithi035' 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.110+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0f8ba00 0x5604d0f8de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.111+0000 7fc4dd566b80 4 client.15378 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.111+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604d0e92660 con 0x5604d0f8ba00 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.111+0000 7fc4caffd700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0f8ba00 0x5604d0f8de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.111+0000 7fc4aeff5700 10 client.15378 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.111+0000 7fc4caffd700 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0f8ba00 0x5604d0f8de10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a047c96b90d4ed2c server_cookie=709e9ffd39ba71e5 in_seq=0 out_seq=0 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4aeff5700 1 -- 172.21.15.35:0/2726359939 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5604d0e92660 con 0x5604d0f8ba00 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4aeff5700 10 client.15378 handle_command_reply: tid=0 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 client.15378 shutdown 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 msgr2=0x5604d0f7b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f7b790 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009610 tx=0x7fc4c400baa0 comp rx=0 tx=0).stop 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 shutdown_connections 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0f8ba00 0x5604d0f8de10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:01.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f7b790 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/2726359939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 >> 172.21.15.35:0/2726359939 conn(0x5604d0f6c030 msgr2=0x5604d0f6b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:03.231 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4aeff5700 0 client.15378 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 shutdown_connections 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 1 -- 172.21.15.35:0/2726359939 wait complete. 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.112+0000 7fc4dd566b80 20 client.15378 trim_cache size 0 max 16384 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 Processor -- start 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 -- start start 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f717d0 0x5604d0f8da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f7d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:03.649 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f6d320 con 0x5604d0f76630 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f645b0 con 0x5604d0f717d0 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f88400 con 0x5604d0f720e0 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f77080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42294/0 (socket says 172.21.15.35:42294) 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1752491822 learned_addr learned my addr 172.21.15.35:0/1752491822 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f717d0 0x5604d0f8da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f7d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1752491822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 msgr2=0x5604d0f7d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f7d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1752491822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f717d0 msgr2=0x5604d0f8da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f717d0 0x5604d0f8da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1752491822 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604d0f6c6d0 con 0x5604d0f76630 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f717d0 0x5604d0f8da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.135+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f7d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.136+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f77080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009a20 tx=0x7fc4c400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a70d98083f0ed3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:03.650 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.136+0000 7fc4b1ffb700 1 -- 172.21.15.35:0/1752491822 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400e030 con 0x5604d0f76630 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.136+0000 7fc4b1ffb700 1 -- 172.21.15.35:0/1752491822 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4c40078f0 con 0x5604d0f76630 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.136+0000 7fc4b1ffb700 1 -- 172.21.15.35:0/1752491822 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4005460 con 0x5604d0f76630 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1752491822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 msgr2=0x5604d0f77080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f77080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009a20 tx=0x7fc4c400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1752491822 shutdown_connections 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f77080 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f717d0 0x5604d0f8da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1752491822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f720e0 0x5604d0f7d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:03.651 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1752491822 >> 172.21.15.35:0/1752491822 conn(0x5604d0f6c030 msgr2=0x5604d0f6b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1752491822 shutdown_connections 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1752491822 wait complete. 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- start start 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 Processor -- start 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f79dd0 con 0x5604d0f76630 2023-03-17T08:48:04.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f79f40 con 0x5604d0f720e0 2023-03-17T08:48:04.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d0f7a100 con 0x5604d0f717d0 2023-03-17T08:48:04.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4dd566b80 10 client.0 _ll_register_callbacks cb 0x5604d0d69290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:48:04.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.137+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f79800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42300/0 (socket says 172.21.15.35:42300) 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1014451920 learned_addr learned my addr 172.21.15.35:0/1014451920 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4ca7fc700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1014451920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 msgr2=0x5604d0f7ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:05.013 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 msgr2=0x5604d0f7b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 -- 172.21.15.35:0/1014451920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604d0cf1de0 con 0x5604d0f76630 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4cb7fe700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f79800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40059a0 tx=0x7fc4c4004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789f3da65a95c99a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4aeff5700 1 -- 172.21.15.35:0/1014451920 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c401d470 con 0x5604d0f76630 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604d0f41240 con 0x5604d0f76630 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4aeff5700 1 -- 172.21.15.35:0/1014451920 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc4c4005250 con 0x5604d0f76630 2023-03-17T08:48:05.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4aeff5700 1 -- 172.21.15.35:0/1014451920 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c4005410 con 0x5604d0f76630 2023-03-17T08:48:05.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4dd566b80 10 client.15384 fetch_fsmap learned FSMap version 29 2023-03-17T08:48:05.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.138+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5604d0cdac60 con 0x5604d0f76630 2023-03-17T08:48:05.544 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4aeff5700 1 -- 172.21.15.35:0/1014451920 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4c4049020 con 0x5604d0f76630 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4aeff5700 1 -- 172.21.15.35:0/1014451920 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc4c4019070 con 0x5604d0f76630 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4dd566b80 10 client.15384 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4dd566b80 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4dd566b80 20 client.15384 populate_metadata read hostname 'smithi035' 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0fe0390 0x5604d0fe2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4dd566b80 4 client.15384 mds_command: new command op to 24452 tid=0[{"prefix": "scrub status"}] 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5604d0d47f60 con 0x5604d0fe0390 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0fe0390 0x5604d0fe2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:05.545 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4aeff5700 10 client.15384 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:48:06.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.139+0000 7fc4caffd700 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0fe0390 0x5604d0fe2770 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fdb50656f8b9d5b server_cookie=8ed46768fa52fd67 in_seq=0 out_seq=0 2023-03-17T08:48:06.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4aeff5700 1 -- 172.21.15.35:0/1014451920 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5604d0d47f60 con 0x5604d0fe0390 2023-03-17T08:48:06.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4aeff5700 10 client.15384 handle_command_reply: tid=0 2023-03-17T08:48:08.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 client.15384 shutdown 2023-03-17T08:48:08.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 msgr2=0x5604d0f79800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f79800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40059a0 tx=0x7fc4c4004cc0 comp rx=0 tx=0).stop 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 shutdown_connections 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604d0fe0390 0x5604d0fe2770 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604d0f76630 0x5604d0f79800 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4aeff5700 0 client.15384 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604d0f717d0 0x5604d0f7ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 --2- 172.21.15.35:0/1014451920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604d0f720e0 0x5604d0f7b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 >> 172.21.15.35:0/1014451920 conn(0x5604d0f6c030 msgr2=0x5604d0f8da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:08.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 shutdown_connections 2023-03-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 1 -- 172.21.15.35:0/1014451920 wait complete. 2023-03-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4dd566b80 20 client.15384 trim_cache size 0 max 16384 2023-03-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi035.stdout: "status": "no active scrubs running", 2023-03-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi035.stdout: "scrubs": {} 2023-03-17T08:48:09.468 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc4b409f6d0 msgr2=0x7fc4b40a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc4b409f6d0 0x7fc4b40a1b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc1979a0 tx=0x7fc4c0009260 comp rx=0 tx=0).stop 2023-03-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 msgr2=0x7fc4cc196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.140+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc196390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00e9a0 tx=0x7fc4bc00ecb0 comp rx=0 tx=0).stop 2023-03-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 shutdown_connections 2023-03-17T08:48:09.469 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc4b409f6d0 0x7fc4b40a1b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:09.470 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4cc1043c0 0x7fc4cc19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:09.470 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4cc0ff380 0x7fc4cc196390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:09.470 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 --2- 172.21.15.35:0/1311578604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4cc0ffd20 0x7fc4cc1968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:09.470 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 >> 172.21.15.35:0/1311578604 conn(0x7fc4cc076300 msgr2=0x7fc4cc067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:09.470 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 shutdown_connections 2023-03-17T08:48:09.470 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.141+0000 7fc4d13d9700 1 -- 172.21.15.35:0/1311578604 wait complete. 2023-03-17T08:48:09.470 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:15 smithi035 ceph-mon[92535]: pgmap v40: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:09.471 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-03-17T08:48:11.367 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T08:48:12.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:53 smithi082 ceph-mon[94281]: pgmap v59: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:14.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:55 smithi082 ceph-mon[94281]: pgmap v60: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:14.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:57 smithi082 ceph-mon[94281]: pgmap v61: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:15.861 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:47:59 smithi082 ceph-mon[94281]: pgmap v62: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:18.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:01 smithi082 ceph-mon[94281]: pgmap v63: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:18.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:03 smithi082 ceph-mon[94281]: pgmap v64: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:18.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:05 smithi082 ceph-mon[94281]: pgmap v65: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:18.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:07 smithi082 ceph-mon[94281]: pgmap v66: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:18.104 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:09 smithi082 ceph-mon[94281]: pgmap v67: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:18.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.315+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fbe48068010 con 0x7fbe48100be0 2023-03-17T08:48:18.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.320+0000 7fbe457fa700 1 -- 172.21.15.35:0/3116260154 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbe38026070 con 0x7fbe48100be0 2023-03-17T08:48:18.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbe3009f6d0 msgr2=0x7fbe300a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:18.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbe3009f6d0 0x7fbe300a1b80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe48197a50 tx=0x7fbe3c0073d0 comp rx=0 tx=0).stop 2023-03-17T08:48:18.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 msgr2=0x7fbe48196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:18.106 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 0x7fbe48196440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e9a0 tx=0x7fbe3800ecb0 comp rx=0 tx=0).stop 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 shutdown_connections 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbe3009f6d0 0x7fbe300a1b80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe481054f0 0x7fbe4819ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe48100be0 0x7fbe48196440 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 --2- 172.21.15.35:0/3116260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe48101580 0x7fbe48196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 >> 172.21.15.35:0/3116260154 conn(0x7fbe480774b0 msgr2=0x7fbe48100140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:18.915 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 shutdown_connections 2023-03-17T08:48:18.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:47:16.322+0000 7fbe4e9d9700 1 -- 172.21.15.35:0/3116260154 wait complete. 2023-03-17T08:48:18.916 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-03-17T08:48:18.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:53 smithi078 ceph-mon[94114]: pgmap v59: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:20.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:55 smithi078 ceph-mon[94114]: pgmap v60: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:20.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:57 smithi078 ceph-mon[94114]: pgmap v61: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:20.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:47:59 smithi078 ceph-mon[94114]: pgmap v62: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:20.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:01 smithi078 ceph-mon[94114]: pgmap v63: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:20.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:03 smithi078 ceph-mon[94114]: pgmap v64: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:20.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:05 smithi078 ceph-mon[94114]: pgmap v65: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:20.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:07 smithi078 ceph-mon[94114]: pgmap v66: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:20.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:09 smithi078 ceph-mon[94114]: pgmap v67: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:20.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:11 smithi078 ceph-mon[94114]: pgmap v68: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:13 smithi078 ceph-mon[94114]: pgmap v69: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:15 smithi078 ceph-mon[94114]: pgmap v70: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:17 smithi078 ceph-mon[94114]: pgmap v71: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:48:21.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:21.577 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:19 smithi078 ceph-mon[94114]: pgmap v72: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:23.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:11 smithi082 ceph-mon[94281]: pgmap v68: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:23.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:13 smithi082 ceph-mon[94281]: pgmap v69: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:23.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:15 smithi082 ceph-mon[94281]: pgmap v70: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:23.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:48:23.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:17 smithi082 ceph-mon[94281]: pgmap v71: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:23.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:48:23.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:48:24.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:24.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:19 smithi082 ceph-mon[94281]: pgmap v72: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:24.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:21 smithi082 ceph-mon[94281]: pgmap v73: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:24.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:23 smithi082 ceph-mon[94281]: pgmap v74: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:21 smithi078 ceph-mon[94114]: pgmap v73: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:23 smithi078 ceph-mon[94114]: pgmap v74: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:17 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3116260154' entity='client.admin' 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:17 smithi035 ceph-mon[92535]: pgmap v41: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:24.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:19 smithi035 ceph-mon[92535]: pgmap v42: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:24.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:21 smithi035 ceph-mon[92535]: pgmap v43: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:24.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:23 smithi035 ceph-mon[92535]: pgmap v44: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:24.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:25 smithi035 ceph-mon[92535]: pgmap v45: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:24.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:27 smithi035 ceph-mon[92535]: pgmap v46: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:24.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:29 smithi035 ceph-mon[92535]: pgmap v47: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:26.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:31 smithi035 ceph-mon[92535]: pgmap v48: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:33 smithi035 ceph-mon[92535]: pgmap v49: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:33 smithi035 ceph-mon[92535]: mgrmap e24: x(active, since 92s), standbys: y, z 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:35 smithi035 ceph-mon[92535]: pgmap v50: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:37 smithi035 ceph-mon[92535]: pgmap v51: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:39 smithi035 ceph-mon[92535]: pgmap v52: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:41 smithi035 ceph-mon[92535]: pgmap v53: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:43 smithi035 ceph-mon[92535]: pgmap v54: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T08:48:26.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:45 smithi035 ceph-mon[92535]: pgmap v55: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:48:26.032 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:47 smithi035 ceph-mon[92535]: pgmap v56: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:48:26.032 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:49 smithi035 ceph-mon[92535]: pgmap v57: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:26.032 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:51 smithi035 ceph-mon[92535]: pgmap v58: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:27.774 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:53 smithi035 ceph-mon[92535]: pgmap v59: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:27.774 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:55 smithi035 ceph-mon[92535]: pgmap v60: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:27.775 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:57 smithi035 ceph-mon[92535]: pgmap v61: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:27.775 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:47:59 smithi035 ceph-mon[92535]: pgmap v62: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:27.775 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:01 smithi035 ceph-mon[92535]: pgmap v63: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:27.775 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:03 smithi035 ceph-mon[92535]: pgmap v64: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:27.775 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:05 smithi035 ceph-mon[92535]: pgmap v65: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:28.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:07 smithi035 ceph-mon[92535]: pgmap v66: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:28.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:09 smithi035 ceph-mon[92535]: pgmap v67: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:11 smithi035 ceph-mon[92535]: pgmap v68: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:13 smithi035 ceph-mon[92535]: pgmap v69: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:15 smithi035 ceph-mon[92535]: pgmap v70: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:17 smithi035 ceph-mon[92535]: pgmap v71: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:19 smithi035 ceph-mon[92535]: pgmap v72: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:21 smithi035 ceph-mon[92535]: pgmap v73: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:28.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:23 smithi035 ceph-mon[92535]: pgmap v74: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:28.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: pgmap v75: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:29.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/3236576474' entity='client.admin' 2023-03-17T08:48:29.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:48:29.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/4191756018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:48:29.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:31.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:32.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:48:32.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:48:32.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:32.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:27 smithi082 ceph-mon[94281]: pgmap v76: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: pgmap v75: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/3236576474' entity='client.admin' 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/4191756018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:32.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:48:32.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:48:32.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:48:32.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:27 smithi078 ceph-mon[94114]: pgmap v76: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:32.999 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.092+0000 7f273477c700 1 -- 172.21.15.35:0/2700111991 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c104380 msgr2=0x7f272c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:33.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.092+0000 7f273477c700 1 --2- 172.21.15.35:0/2700111991 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c104380 0x7f272c10bf50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f272400b0d0 tx=0x7f272400b3e0 comp rx=0 tx=0).stop 2023-03-17T08:48:33.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 -- 172.21.15.35:0/2700111991 shutdown_connections 2023-03-17T08:48:35.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 --2- 172.21.15.35:0/2700111991 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c104380 0x7f272c10bf50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:35.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 --2- 172.21.15.35:0/2700111991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 0x7f272c0ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:35.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 --2- 172.21.15.35:0/2700111991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272c0ffce0 0x7f272c103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:35.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 -- 172.21.15.35:0/2700111991 >> 172.21.15.35:0/2700111991 conn(0x7f272c075f00 msgr2=0x7f272c076300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:35.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 -- 172.21.15.35:0/2700111991 shutdown_connections 2023-03-17T08:48:35.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 -- 172.21.15.35:0/2700111991 wait complete. 2023-03-17T08:48:35.695 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 Processor -- start 2023-03-17T08:48:35.695 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.093+0000 7f273477c700 1 -- start start 2023-03-17T08:48:35.695 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f273477c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 0x7f272c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:35.695 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f273477c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 0x7f272c1976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:36.231 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f273477c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272c104380 0x7f272c1a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:36.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f273477c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c197ff0 con 0x7f272c0ffce0 2023-03-17T08:48:37.365 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f273477c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1a2730 con 0x7f272c104380 2023-03-17T08:48:38.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f273477c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1a28f0 con 0x7f272c0ff340 2023-03-17T08:48:41.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 0x7f272c1976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:41.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2732518700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 0x7f272c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 0x7f272c1976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42312/0 (socket says 172.21.15.35:42312) 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 -- 172.21.15.35:0/4191756018 learned_addr learned my addr 172.21.15.35:0/4191756018 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2732d19700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272c104380 0x7f272c1a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 -- 172.21.15.35:0/4191756018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 msgr2=0x7f272c197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 0x7f272c197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 -- 172.21.15.35:0/4191756018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272c104380 msgr2=0x7f272c1a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272c104380 0x7f272c1a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2731d17700 1 -- 172.21.15.35:0/4191756018 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009d00 con 0x7f272c0ffce0 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.094+0000 7f2732518700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 0x7f272c197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.095+0000 7f2731d17700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 0x7f272c1976b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f271c00d950 tx=0x7f271c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.095+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00f890 con 0x7f272c0ffce0 2023-03-17T08:48:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.095+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271c00fe80 con 0x7f272c0ffce0 2023-03-17T08:48:41.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.095+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c10f000 con 0x7f272c0ffce0 2023-03-17T08:48:41.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.095+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00e3b0 con 0x7f272c0ffce0 2023-03-17T08:48:41.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.095+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c10ee70 con 0x7f272c0ffce0 2023-03-17T08:48:41.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.096+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c10f190 con 0x7f272c0ffce0 2023-03-17T08:48:41.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 -- 172.21.15.35:0/3066034196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76281013d0 msgr2=0x7f76281017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:41.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 --2- 172.21.15.35:0/3066034196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76281013d0 0x7f76281017a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f761c009990 tx=0x7f761c009ca0 comp rx=0 tx=0).stop 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 -- 172.21.15.35:0/3066034196 shutdown_connections 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 --2- 172.21.15.35:0/3066034196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 0x7f762810cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 --2- 172.21.15.35:0/3066034196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76281013d0 0x7f76281017a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 --2- 172.21.15.35:0/3066034196 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7628101ce0 0x7f762810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 -- 172.21.15.35:0/3066034196 >> 172.21.15.35:0/3066034196 conn(0x7f7628076160 msgr2=0x7f7628076560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 -- 172.21.15.35:0/3066034196 shutdown_connections 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 -- 172.21.15.35:0/3066034196 wait complete. 2023-03-17T08:48:41.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 24) v1 ==== 133335+0+0 (secure 0 0 0) 0x7f271c00f9f0 con 0x7f272c0ffce0 2023-03-17T08:48:42.193 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:29 smithi082 ceph-mon[94281]: pgmap v77: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:43.949 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:31 smithi082 ceph-mon[94281]: pgmap v78: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:43.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:33 smithi082 ceph-mon[94281]: pgmap v79: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:43.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:35 smithi082 ceph-mon[94281]: pgmap v80: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:43.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:37 smithi082 ceph-mon[94281]: pgmap v81: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:45.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:39 smithi082 ceph-mon[94281]: pgmap v82: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:45.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:29 smithi078 ceph-mon[94114]: pgmap v77: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:45.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:31 smithi078 ceph-mon[94114]: pgmap v78: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:45.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:33 smithi078 ceph-mon[94114]: pgmap v79: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:45.281 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:35 smithi078 ceph-mon[94114]: pgmap v80: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:45.281 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:37 smithi078 ceph-mon[94114]: pgmap v81: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:45.281 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:39 smithi078 ceph-mon[94114]: pgmap v82: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:45.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.097+0000 7f762ed13700 1 Processor -- start 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 -- start start 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 0x7f7628196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7628101ce0 0x7f7628196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 0x7f762819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762819b210 con 0x7f76281013d0 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762819b380 con 0x7f7628101ce0 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762ed13700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762819b540 con 0x7f762810a7a0 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762caaf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 0x7f7628196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:45.282 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762caaf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 0x7f7628196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42322/0 (socket says 172.21.15.35:42322) 2023-03-17T08:48:47.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762caaf700 1 -- 172.21.15.35:0/3236576474 learned_addr learned my addr 172.21.15.35:0/3236576474 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:48:47.567 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f7627fff700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7628101ce0 0x7f7628196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:47.568 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f27237fe700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f271809f630 0x7f27180a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:47.568 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762d2b0700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 0x7f762819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:47.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f2732518700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f271809f630 0x7f27180a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:47.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f271c0c9f20 con 0x7f272c0ffce0 2023-03-17T08:48:47.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:41 smithi082 ceph-mon[94281]: pgmap v83: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:47.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:43 smithi082 ceph-mon[94281]: pgmap v84: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:47.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:45 smithi082 ceph-mon[94281]: pgmap v85: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:47.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:41 smithi078 ceph-mon[94114]: pgmap v83: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:48.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:43 smithi078 ceph-mon[94114]: pgmap v84: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:48.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:45 smithi078 ceph-mon[94114]: pgmap v85: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:48.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.098+0000 7f762caaf700 1 -- 172.21.15.35:0/3236576474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 msgr2=0x7f762819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:48.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f762caaf700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 0x7f762819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:48.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f762caaf700 1 -- 172.21.15.35:0/3236576474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7628101ce0 msgr2=0x7f7628196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:48.857 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f762caaf700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7628101ce0 0x7f7628196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:49.900 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f762caaf700 1 -- 172.21.15.35:0/3236576474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614009520 con 0x7f76281013d0 2023-03-17T08:48:49.900 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f7627fff700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7628101ce0 0x7f7628196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:48:49.900 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f762d2b0700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 0x7f762819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:48:49.900 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f762caaf700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 0x7f7628196230 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f761c005770 tx=0x7f761c0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:49.901 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.099+0000 7f2732518700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f271809f630 0x7f27180a1ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2728005950 tx=0x7f272800b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:49.901 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.103+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c01d070 con 0x7f76281013d0 2023-03-17T08:48:50.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.103+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f761c021410 con 0x7f76281013d0 2023-03-17T08:48:50.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.103+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7620009c40 con 0x7f76281013d0 2023-03-17T08:48:50.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.103+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c0173f0 con 0x7f76281013d0 2023-03-17T08:48:50.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.103+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f271c093e00 con 0x7f272c0ffce0 2023-03-17T08:48:50.861 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:47 smithi082 ceph-mon[94281]: pgmap v86: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:50.861 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:49 smithi082 ceph-mon[94281]: pgmap v87: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:50.861 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:47 smithi078 ceph-mon[94114]: pgmap v86: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:48:50.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:49 smithi078 ceph-mon[94114]: pgmap v87: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:50.863 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.103+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c0095f0 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.105+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 24) v1 ==== 133335+0+0 (secure 0 0 0) 0x7f761c00fac0 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.106+0000 7f7625ffb700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f761809f630 0x7f76180a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.106+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7628105030 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.106+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f761c0cb5f0 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.106+0000 7f7627fff700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f761809f630 0x7f76180a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.107+0000 7f7627fff700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f761809f630 0x7f76180a1ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7614009fd0 tx=0x7f7614009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.111+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f761c05b5b0 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.318+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f7628067fe0 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.322+0000 7f7625ffb700 1 -- 172.21.15.35:0/3236576474 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f761c026070 con 0x7f76281013d0 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f761809f630 msgr2=0x7f76180a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:52.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f761809f630 0x7f76180a1ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7614009fd0 tx=0x7f7614009260 comp rx=0 tx=0).stop 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 msgr2=0x7f7628196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 0x7f7628196230 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f761c005770 tx=0x7f761c0057a0 comp rx=0 tx=0).stop 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 shutdown_connections 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f761809f630 0x7f76180a1ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762810a7a0 0x7f762819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f76281013d0 0x7f7628196230 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 --2- 172.21.15.35:0/3236576474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7628101ce0 0x7f7628196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 >> 172.21.15.35:0/3236576474 conn(0x7f7628076160 msgr2=0x7f7628102170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 shutdown_connections 2023-03-17T08:48:52.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.325+0000 7f762ed13700 1 -- 172.21.15.35:0/3236576474 wait complete. 2023-03-17T08:48:52.152 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-03-17T08:48:52.152 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.361+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f272c067970 con 0x7f272c0ffce0 2023-03-17T08:48:53.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.362+0000 7f27237fe700 1 -- 172.21.15.35:0/4191756018 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10842 (secure 0 0 0) 0x7f271c021090 con 0x7f272c0ffce0 2023-03-17T08:48:53.334 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T08:48:53.336 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T08:15:35.363809+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24419":{"gid":24419,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6835/3131921401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3131921401},{"type":"v1","addr":"172.21.15.78:6835","nonce":3131921401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T08:48:53.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:51 smithi082 ceph-mon[94281]: pgmap v88: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:57.540 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:51 smithi078 ceph-mon[94114]: pgmap v88: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f271809f630 msgr2=0x7f27180a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f271809f630 0x7f27180a1ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2728005950 tx=0x7f272800b410 comp rx=0 tx=0).stop 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 msgr2=0x7f272c1976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 0x7f272c1976b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f271c00d950 tx=0x7f271c00dc60 comp rx=0 tx=0).stop 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 shutdown_connections 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f271809f630 0x7f27180a1ae0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272c104380 0x7f272c1a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:48:57.542 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f272c0ff340 0x7f272c197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:00.113 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 --2- 172.21.15.35:0/4191756018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f272c0ffce0 0x7f272c1976b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:02.105 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 >> 172.21.15.35:0/4191756018 conn(0x7f272c075f00 msgr2=0x7f272c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:02.106 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 shutdown_connections 2023-03-17T08:49:02.106 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:48:25.364+0000 7f273477c700 1 -- 172.21.15.35:0/4191756018 wait complete. 2023-03-17T08:49:02.106 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 29 2023-03-17T08:49:02.107 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-03-17T08:49:02.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:53 smithi082 ceph-mon[94281]: pgmap v89: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:03.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:55 smithi082 ceph-mon[94281]: pgmap v90: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:03.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:57 smithi082 ceph-mon[94281]: pgmap v91: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:03.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:48:59 smithi082 ceph-mon[94281]: pgmap v92: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:03.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:53 smithi078 ceph-mon[94114]: pgmap v89: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:05.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:55 smithi078 ceph-mon[94114]: pgmap v90: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:05.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:57 smithi078 ceph-mon[94114]: pgmap v91: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:05.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:48:59 smithi078 ceph-mon[94114]: pgmap v92: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:05.268 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: pgmap v75: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:05.268 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/3236576474' entity='client.admin' 2023-03-17T08:49:05.268 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:49:05.268 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/4191756018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T08:49:05.268 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:49:05.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:49:05.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:49:05.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:49:05.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:49:05.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:27 smithi035 ceph-mon[92535]: pgmap v76: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:05.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:29 smithi035 ceph-mon[92535]: pgmap v77: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:05.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:31 smithi035 ceph-mon[92535]: pgmap v78: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:05.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:33 smithi035 ceph-mon[92535]: pgmap v79: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:05.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:35 smithi035 ceph-mon[92535]: pgmap v80: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:05.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:37 smithi035 ceph-mon[92535]: pgmap v81: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:07.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:39 smithi035 ceph-mon[92535]: pgmap v82: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:07.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:41 smithi035 ceph-mon[92535]: pgmap v83: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:07.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:43 smithi035 ceph-mon[92535]: pgmap v84: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:07.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:45 smithi035 ceph-mon[92535]: pgmap v85: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:07.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:47 smithi035 ceph-mon[92535]: pgmap v86: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:07.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:49 smithi035 ceph-mon[92535]: pgmap v87: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:07.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:51 smithi035 ceph-mon[92535]: pgmap v88: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:08.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:53 smithi035 ceph-mon[92535]: pgmap v89: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:08.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:55 smithi035 ceph-mon[92535]: pgmap v90: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:08.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:57 smithi035 ceph-mon[92535]: pgmap v91: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:08.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:48:59 smithi035 ceph-mon[92535]: pgmap v92: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:08.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:01 smithi035 ceph-mon[92535]: pgmap v93: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:08.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:03 smithi035 ceph-mon[92535]: pgmap v94: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:08.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:01 smithi082 ceph-mon[94281]: pgmap v93: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:09.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:03 smithi082 ceph-mon[94281]: pgmap v94: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:09.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:05 smithi082 ceph-mon[94281]: pgmap v95: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:09.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:06 smithi082 ceph-mon[94281]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:49:10.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:07 smithi082 ceph-mon[94281]: pgmap v96: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:49:10.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:01 smithi078 ceph-mon[94114]: pgmap v93: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:10.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:03 smithi078 ceph-mon[94114]: pgmap v94: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:12.652 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:05 smithi078 ceph-mon[94114]: pgmap v95: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:12.652 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:06 smithi078 ceph-mon[94114]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:49:12.652 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:07 smithi078 ceph-mon[94114]: pgmap v96: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:49:12.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:09 smithi082 ceph-mon[94281]: pgmap v97: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:49:12.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:11 smithi082 ceph-mon[94281]: pgmap v98: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:49:12.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:09 smithi078 ceph-mon[94114]: pgmap v97: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:49:12.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:11 smithi078 ceph-mon[94114]: pgmap v98: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:49:12.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 -- 172.21.15.35:0/3192912557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c101d70 msgr2=0x7f739c10a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:12.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 --2- 172.21.15.35:0/3192912557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c101d70 0x7f739c10a260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7390009990 tx=0x7f7390009ca0 comp rx=0 tx=0).stop 2023-03-17T08:49:12.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 -- 172.21.15.35:0/3192912557 shutdown_connections 2023-03-17T08:49:12.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 --2- 172.21.15.35:0/3192912557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c10a7a0 0x7f739c10cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:12.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 --2- 172.21.15.35:0/3192912557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f739c101460 0x7f739c101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:12.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 --2- 172.21.15.35:0/3192912557 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c101d70 0x7f739c10a260 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 -- 172.21.15.35:0/3192912557 >> 172.21.15.35:0/3192912557 conn(0x7f739c076300 msgr2=0x7f739c076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 -- 172.21.15.35:0/3192912557 shutdown_connections 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.427+0000 7f73a16ea700 1 -- 172.21.15.35:0/3192912557 wait complete. 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 Processor -- start 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 -- start start 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c101460 0x7f739c0ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f739c101d70 0x7f739c0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 0x7f739c1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c0ffe20 con 0x7f739c10a7a0 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1a4940 con 0x7f739c101d70 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f73a16ea700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1a4a80 con 0x7f739c101460 2023-03-17T08:49:12.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f739b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 0x7f739c1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:14.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f739affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c101460 0x7f739c0ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:14.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f739b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 0x7f739c1a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42348/0 (socket says 172.21.15.35:42348) 2023-03-17T08:49:14.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f739b7fe700 1 -- 172.21.15.35:0/82619206 learned_addr learned my addr 172.21.15.35:0/82619206 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:49:14.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7f739a7fc700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f739c101d70 0x7f739c0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:14.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7fee4d7db700 1 -- 172.21.15.35:0/41948943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 msgr2=0x7fee481017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:17.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7fee4d7db700 1 --2- 172.21.15.35:0/41948943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee481017e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fee38009990 tx=0x7fee38009ca0 comp rx=0 tx=0).stop 2023-03-17T08:49:17.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7fee4d7db700 1 -- 172.21.15.35:0/41948943 shutdown_connections 2023-03-17T08:49:17.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7fee4d7db700 1 --2- 172.21.15.35:0/41948943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee4810a750 0x7fee4810cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:17.512 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.428+0000 7fee4d7db700 1 --2- 172.21.15.35:0/41948943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee481017e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:17.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7fee4d7db700 1 --2- 172.21.15.35:0/41948943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee48101d20 0x7fee4810a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:17.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7fee4d7db700 1 -- 172.21.15.35:0/41948943 >> 172.21.15.35:0/41948943 conn(0x7fee48076330 msgr2=0x7fee48076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:17.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7fee4d7db700 1 -- 172.21.15.35:0/41948943 shutdown_connections 2023-03-17T08:49:17.513 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7fee4d7db700 1 -- 172.21.15.35:0/41948943 wait complete. 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739affd700 1 -- 172.21.15.35:0/82619206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f739c101d70 msgr2=0x7f739c0ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739affd700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f739c101d70 0x7f739c0ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739affd700 1 -- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 msgr2=0x7f739c1a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739affd700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 0x7f739c1a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739affd700 1 -- 172.21.15.35:0/82619206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900095f0 con 0x7f739c101460 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739b7fe700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 0x7f739c1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f739affd700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c101460 0x7f739c0ff0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f738c00e9f0 tx=0x7f738c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f7383fff700 1 -- 172.21.15.35:0/82619206 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00c9c0 con 0x7f739c101460 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c110140 con 0x7f739c101460 2023-03-17T08:49:17.514 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7fee4d7db700 1 Processor -- start 2023-03-17T08:49:17.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f7383fff700 1 -- 172.21.15.35:0/82619206 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f738c010430 con 0x7f739c101460 2023-03-17T08:49:17.515 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f7383fff700 1 -- 172.21.15.35:0/82619206 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c018680 con 0x7f739c101460 2023-03-17T08:49:18.919 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c10ffb0 con 0x7f739c101460 2023-03-17T08:49:18.919 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:13 smithi082 ceph-mon[94281]: pgmap v99: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:49:18.919 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:15 smithi082 ceph-mon[94281]: pgmap v100: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:49:21.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:13 smithi078 ceph-mon[94114]: pgmap v99: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:49:21.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:15 smithi078 ceph-mon[94114]: pgmap v100: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:49:21.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.429+0000 7fee4d7db700 1 -- start start 2023-03-17T08:49:21.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee4d7db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee48196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:21.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee4d7db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee48101d20 0x7fee48196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:21.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee4d7db700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee4810a750 0x7fee4819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:21.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee4d7db700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4819b120 con 0x7fee48101410 2023-03-17T08:49:21.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee4d7db700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4819b290 con 0x7fee48101d20 2023-03-17T08:49:21.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee4d7db700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4819b450 con 0x7fee4810a750 2023-03-17T08:49:21.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee48196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:21.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee48196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42350/0 (socket says 172.21.15.35:42350) 2023-03-17T08:49:21.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee467fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee48101d20 0x7fee48196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:21.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 -- 172.21.15.35:0/27448221 learned_addr learned my addr 172.21.15.35:0/27448221 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:49:21.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee477fe700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee4810a750 0x7fee4819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:21.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 -- 172.21.15.35:0/27448221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee4810a750 msgr2=0x7fee4819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:21.698 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee4810a750 0x7fee4819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 -- 172.21.15.35:0/27448221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee48101d20 msgr2=0x7fee48196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee48101d20 0x7fee48196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 -- 172.21.15.35:0/27448221 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380095f0 con 0x7fee48101410 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee477fe700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee4810a750 0x7fee4819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee467fc700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee48101d20 0x7fee48196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee46ffd700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee48196140 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee38006010 tx=0x7fee38005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.430+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3801d070 con 0x7fee48101410 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.431+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee481100b0 con 0x7fee48101410 2023-03-17T08:49:21.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.431+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee38004000 con 0x7fee48101410 2023-03-17T08:49:22.909 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.431+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38022c00 con 0x7fee48101410 2023-03-17T08:49:24.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.431+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4810ff20 con 0x7fee48101410 2023-03-17T08:49:24.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.432+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee48110240 con 0x7fee48101410 2023-03-17T08:49:24.312 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.432+0000 7f7383fff700 1 -- 172.21.15.35:0/82619206 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) v1 ==== 133335+0+0 (secure 0 0 0) 0x7f738c0105a0 con 0x7f739c101460 2023-03-17T08:49:28.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.432+0000 7f7383fff700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f738409f5b0 0x7f73840a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:28.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.433+0000 7f739a7fc700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f738409f5b0 0x7f73840a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:28.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.433+0000 7f7383fff700 1 -- 172.21.15.35:0/82619206 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f738c014070 con 0x7f739c101460 2023-03-17T08:49:28.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.433+0000 7f739a7fc700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f738409f5b0 0x7f73840a1a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f739c1008a0 tx=0x7f739000b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:28.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:17 smithi082 ceph-mon[94281]: pgmap v101: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:49:28.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:19 smithi082 ceph-mon[94281]: pgmap v102: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:28.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:21 smithi082 ceph-mon[94281]: pgmap v103: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:28.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:17 smithi078 ceph-mon[94114]: pgmap v101: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:49:28.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:19 smithi078 ceph-mon[94114]: pgmap v102: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:28.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:21 smithi078 ceph-mon[94114]: pgmap v103: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:28.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.433+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 24) v1 ==== 133335+0+0 (secure 0 0 0) 0x7fee38022470 con 0x7fee48101410 2023-03-17T08:49:28.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.433+0000 7f73ad877b80 1 Processor -- start 2023-03-17T08:49:30.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.433+0000 7f73ad877b80 1 -- start start 2023-03-17T08:49:30.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:30.758 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c4f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c4fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f73ad877b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7b51070 con 0x5580e7c4a7d0 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f73ad877b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7ba39b0 con 0x5580e7c4f630 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f73ad877b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7b9ce40 con 0x5580e7c4b0e0 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c4aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42358/0 (socket says 172.21.15.35:42358) 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 -- 172.21.15.35:0/4289725691 learned_addr learned my addr 172.21.15.35:0/4289725691 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7fee2ffff700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fee3009f5b0 0x7fee300a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7fee467fc700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fee3009f5b0 0x7fee300a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:30.759 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fee380cc220 con 0x7fee48101410 2023-03-17T08:49:30.760 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739b7fe700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c4fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739a7fc700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c4f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 -- 172.21.15.35:0/4289725691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 msgr2=0x5580e7c4f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c4f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 -- 172.21.15.35:0/4289725691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 msgr2=0x5580e7c4fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c4fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739affd700 1 -- 172.21.15.35:0/4289725691 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580e7a1e630 con 0x5580e7c4a7d0 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739b7fe700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c4fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.434+0000 7f739a7fc700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c4f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:49:30.761 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.435+0000 7fee467fc700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fee3009f5b0 0x7fee300a1a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee48197750 tx=0x7fee3c0073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:30.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:23 smithi082 ceph-mon[94281]: pgmap v104: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:30.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:25 smithi082 ceph-mon[94281]: pgmap v105: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:30.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:49:30.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:49:30.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:27 smithi082 ceph-mon[94281]: pgmap v106: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:29 smithi082 ceph-mon[94281]: pgmap v107: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:23 smithi078 ceph-mon[94114]: pgmap v104: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:25 smithi078 ceph-mon[94114]: pgmap v105: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:27 smithi078 ceph-mon[94114]: pgmap v106: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:31.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:29 smithi078 ceph-mon[94114]: pgmap v107: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.435+0000 7f739affd700 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c4aba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f738c09fff0 tx=0x7f738c097ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65adc55bd03a8f7d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.438+0000 7f73817fa700 1 -- 172.21.15.35:0/4289725691 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c09c170 con 0x5580e7c4a7d0 2023-03-17T08:49:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.438+0000 7f73817fa700 1 -- 172.21.15.35:0/4289725691 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f738c010880 con 0x5580e7c4a7d0 2023-03-17T08:49:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.438+0000 7f73817fa700 1 -- 172.21.15.35:0/4289725691 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0abbd0 con 0x5580e7c4a7d0 2023-03-17T08:49:31.712 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.438+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fee38096190 con 0x7fee48101410 2023-03-17T08:49:31.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 -- 172.21.15.35:0/4289725691 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 msgr2=0x5580e7c4aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:34.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c4aba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f738c09fff0 tx=0x7f738c097ef0 comp rx=0 tx=0).stop 2023-03-17T08:49:34.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 -- 172.21.15.35:0/4289725691 shutdown_connections 2023-03-17T08:49:34.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c4fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:34.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c4aba0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:34.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 --2- 172.21.15.35:0/4289725691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c4f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:34.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 -- 172.21.15.35:0/4289725691 >> 172.21.15.35:0/4289725691 conn(0x5580e7c45030 msgr2=0x5580e7c45400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:34.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 -- 172.21.15.35:0/4289725691 shutdown_connections 2023-03-17T08:49:34.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 -- 172.21.15.35:0/4289725691 wait complete. 2023-03-17T08:49:34.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 -- start start 2023-03-17T08:49:34.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.439+0000 7f73ad877b80 1 Processor -- start 2023-03-17T08:49:34.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4a7d0 0x5580e7c56d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:35.938 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c53f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:35.938 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 0x5580e7c54580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:35.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7a20920 con 0x5580e7c4f630 2023-03-17T08:49:35.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c54c80 con 0x5580e7c4a7d0 2023-03-17T08:49:35.939 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c54e40 con 0x5580e7c4b0e0 2023-03-17T08:49:35.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f73ad877b80 10 client.0 _ll_register_callbacks cb 0x5580e7a42290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:49:35.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 0x5580e7c54580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:35.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 0x5580e7c54580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42370/0 (socket says 172.21.15.35:42370) 2023-03-17T08:49:35.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 -- 172.21.15.35:0/1785684141 learned_addr learned my addr 172.21.15.35:0/1785684141 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:49:35.940 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739a7fc700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c53f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:36.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739affd700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4a7d0 0x5580e7c56d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:36.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 -- 172.21.15.35:0/1785684141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 msgr2=0x5580e7c53f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:36.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c53f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:38.355 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 -- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4a7d0 msgr2=0x5580e7c56d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:40.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4a7d0 0x5580e7c56d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:40.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 -- 172.21.15.35:0/1785684141 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c10ffb0 con 0x5580e7c4f630 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f739b7fe700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 0x5580e7c54580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7394007f70 tx=0x7f73940114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386a5dfe3cd9243c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f737eff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.440+0000 7f737eff5700 1 -- 172.21.15.35:0/1785684141 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394011c80 con 0x5580e7c4f630 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f737eff5700 1 -- 172.21.15.35:0/1785684141 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f7394011de0 con 0x5580e7c4f630 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580e7b5f3f0 con 0x5580e7c4f630 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f737eff5700 1 -- 172.21.15.35:0/1785684141 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7394016450 con 0x5580e7c4f630 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 10 client.15414 fetch_fsmap learned FSMap version 29 2023-03-17T08:49:40.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5580e79cade0 con 0x5580e7c4f630 2023-03-17T08:49:40.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f737eff5700 1 -- 172.21.15.35:0/1785684141 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5580e7b5f3f0 con 0x5580e7c4f630 2023-03-17T08:49:41.696 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f737eff5700 1 -- 172.21.15.35:0/1785684141 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7394014070 con 0x5580e7c4f630 2023-03-17T08:49:41.696 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 10 client.15414 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:49:41.696 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 10 client.15414 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-03-17T08:49:41.696 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 20 client.15414 populate_metadata read hostname 'smithi035' 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7c649b0 0x5580e7c66dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 4 client.15414 mds_command: new command op to 24431 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.441+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580e7b6b660 con 0x5580e7c649b0 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.442+0000 7f739affd700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7c649b0 0x5580e7c66dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.442+0000 7f737eff5700 10 client.15414 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.442+0000 7f739affd700 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7c649b0 0x5580e7c66dc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=684bb289623fab79 server_cookie=8e7892d061fd7f74 in_seq=0 out_seq=0 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f737eff5700 1 -- 172.21.15.35:0/1785684141 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5580e7b6b660 con 0x5580e7c649b0 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f737eff5700 10 client.15414 handle_command_reply: tid=0 2023-03-17T08:49:41.697 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 client.15414 shutdown 2023-03-17T08:49:42.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 msgr2=0x5580e7c54580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:42.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 0x5580e7c54580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7394007f70 tx=0x7f73940114b0 comp rx=0 tx=0).stop 2023-03-17T08:49:42.805 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 shutdown_connections 2023-03-17T08:49:42.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4f630 0x5580e7c54580 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:42.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7c649b0 0x5580e7c66dc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:42.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4a7d0 0x5580e7c56d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:43.190 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f737eff5700 0 client.15414 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T08:49:43.190 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1785684141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c53f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:43.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 >> 172.21.15.35:0/1785684141 conn(0x5580e7c45030 msgr2=0x5580e7c44710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:44.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 shutdown_connections 2023-03-17T08:49:44.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 1 -- 172.21.15.35:0/1785684141 wait complete. 2023-03-17T08:49:44.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.443+0000 7f73ad877b80 20 client.15414 trim_cache size 0 max 16384 2023-03-17T08:49:44.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 Processor -- start 2023-03-17T08:49:44.911 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 -- start start 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c51990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c44710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c60bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c60700 con 0x5580e7c4a7d0 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c51ed0 con 0x5580e7c4f630 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f73ad877b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c66d90 con 0x5580e7c4b0e0 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f739affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f739affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c51990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42374/0 (socket says 172.21.15.35:42374) 2023-03-17T08:49:44.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.456+0000 7f739affd700 1 -- 172.21.15.35:0/2406022711 learned_addr learned my addr 172.21.15.35:0/2406022711 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739a7fc700 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c44710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739b7fe700 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c60bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739affd700 1 -- 172.21.15.35:0/2406022711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 msgr2=0x5580e7c44710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739affd700 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c44710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739affd700 1 -- 172.21.15.35:0/2406022711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 msgr2=0x5580e7c60bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739affd700 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c60bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:44.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739affd700 1 -- 172.21.15.35:0/2406022711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580e7b63190 con 0x5580e7c4a7d0 2023-03-17T08:49:45.394 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f739affd700 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c51990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f738c094830 tx=0x7f738c094050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74cda386fe55ac1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:45.394 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f7381ffb700 1 -- 172.21.15.35:0/2406022711 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c097c90 con 0x5580e7c4a7d0 2023-03-17T08:49:46.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f7381ffb700 1 -- 172.21.15.35:0/2406022711 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f738c0c7070 con 0x5580e7c4a7d0 2023-03-17T08:49:46.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.457+0000 7f7381ffb700 1 -- 172.21.15.35:0/2406022711 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c097a80 con 0x5580e7c4a7d0 2023-03-17T08:49:46.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 -- 172.21.15.35:0/2406022711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 msgr2=0x5580e7c51990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:46.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c51990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f738c094830 tx=0x7f738c094050 comp rx=0 tx=0).stop 2023-03-17T08:49:46.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 -- 172.21.15.35:0/2406022711 shutdown_connections 2023-03-17T08:49:46.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c60bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:48.261 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c51990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:48.261 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 --2- 172.21.15.35:0/2406022711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c44710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:48.261 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 -- 172.21.15.35:0/2406022711 >> 172.21.15.35:0/2406022711 conn(0x5580e7c45030 msgr2=0x5580e7c5fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 -- 172.21.15.35:0/2406022711 shutdown_connections 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 -- 172.21.15.35:0/2406022711 wait complete. 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 -- start start 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 Processor -- start 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.458+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c5b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c5ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c59a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c5a150 con 0x5580e7c4a7d0 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c5a2c0 con 0x5580e7c4f630 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580e7c5a480 con 0x5580e7c4b0e0 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 10 client.0 _ll_register_callbacks cb 0x5580e7a42290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c5b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c5b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42380/0 (socket says 172.21.15.35:42380) 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 -- 172.21.15.35:0/1045623437 learned_addr learned my addr 172.21.15.35:0/1045623437 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739b7fe700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c59a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739a7fc700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c5ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:48.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 -- 172.21.15.35:0/1045623437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 msgr2=0x5580e7c5ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c5ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 -- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 msgr2=0x5580e7c59a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c59a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 -- 172.21.15.35:0/1045623437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580e7a1e630 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f739affd700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c5b4d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f738c000c00 tx=0x7f738c0c7fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f75b02eb1698f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f737eff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f737eff5700 1 -- 172.21.15.35:0/1045623437 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c010880 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f737eff5700 1 -- 172.21.15.35:0/1045623437 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f738c0b4030 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.459+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580e7c1a240 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f737eff5700 1 -- 172.21.15.35:0/1045623437 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f738c098330 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 10 client.15420 fetch_fsmap learned FSMap version 29 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5580e79f1250 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f737eff5700 1 -- 172.21.15.35:0/1045623437 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5580e7c1a240 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f737eff5700 1 -- 172.21.15.35:0/1045623437 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f738c0a0090 con 0x5580e7c4a7d0 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 10 client.15420 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:49:48.263 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 10 client.15420 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-03-17T08:49:48.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 20 client.15420 populate_metadata read hostname 'smithi035' 2023-03-17T08:49:48.835 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7cb9670 0x5580e7cbba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:49:48.835 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 4 client.15420 mds_command: new command op to 24431 tid=0[{"prefix": "damage ls"}] 2023-03-17T08:49:48.835 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5580e7a20f60 con 0x5580e7cb9670 2023-03-17T08:49:48.835 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.460+0000 7f739a7fc700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7cb9670 0x5580e7cbba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:49:48.836 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f737eff5700 10 client.15420 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T08:49:48.836 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f739a7fc700 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7cb9670 0x5580e7cbba50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a3b47f082f30856c server_cookie=280dc4981f954852 in_seq=0 out_seq=0 2023-03-17T08:49:49.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f737eff5700 1 -- 172.21.15.35:0/1045623437 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5580e7a20f60 con 0x5580e7cb9670 2023-03-17T08:49:49.881 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f737eff5700 10 client.15420 handle_command_reply: tid=0 2023-03-17T08:49:49.881 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 client.15420 shutdown 2023-03-17T08:49:49.881 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 msgr2=0x5580e7c5b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:49.881 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c5b4d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f738c000c00 tx=0x7f738c0c7fd0 comp rx=0 tx=0).stop 2023-03-17T08:49:49.881 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 shutdown_connections 2023-03-17T08:49:50.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5580e7cb9670 0x5580e7cbba50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:50.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5580e7c4f630 0x5580e7c59a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:50.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f737eff5700 0 client.15420 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T08:49:50.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5580e7c4a7d0 0x5580e7c5b4d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:50.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 --2- 172.21.15.35:0/1045623437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580e7c4b0e0 0x5580e7c5ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:51.919 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 >> 172.21.15.35:0/1045623437 conn(0x5580e7c45030 msgr2=0x5580e7c44710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:51.919 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 shutdown_connections 2023-03-17T08:49:53.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 1 -- 172.21.15.35:0/1045623437 wait complete. 2023-03-17T08:49:53.357 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.461+0000 7f73ad877b80 20 client.15420 trim_cache size 0 max 16384 2023-03-17T08:49:53.358 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T08:49:53.360 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f738409f5b0 msgr2=0x7f73840a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:54.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f738409f5b0 0x7f73840a1a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f739c1008a0 tx=0x7f739000b260 comp rx=0 tx=0).stop 2023-03-17T08:49:54.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c101460 msgr2=0x7f739c0ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:49:54.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c101460 0x7f739c0ff0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f738c00e9f0 tx=0x7f738c00ed00 comp rx=0 tx=0).stop 2023-03-17T08:49:54.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 shutdown_connections 2023-03-17T08:49:54.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f738409f5b0 0x7f73840a1a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:55.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f739c10a7a0 0x7f739c1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:55.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f739c101460 0x7f739c0ff0b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:55.062 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 --2- 172.21.15.35:0/82619206 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f739c101d70 0x7f739c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:49:55.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 >> 172.21.15.35:0/82619206 conn(0x7f739c076300 msgr2=0x7f739c102200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:49:55.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 shutdown_connections 2023-03-17T08:49:55.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.462+0000 7f73a16ea700 1 -- 172.21.15.35:0/82619206 wait complete. 2023-03-17T08:49:55.663 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-03-17T08:49:57.756 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.670+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 --> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fee480fdfb0 con 0x7fee3009f5b0 2023-03-17T08:49:57.756 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.732+0000 7fee2ffff700 1 -- 172.21.15.35:0/27448221 <== mgr.15318 v2:172.21.15.35:6800/1224511514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fee480fdfb0 con 0x7fee3009f5b0 2023-03-17T08:49:57.756 INFO:teuthology.orchestra.run.smithi035.stdout:Schedule set for path / 2023-03-17T08:49:57.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:31 smithi078 ceph-mon[94114]: pgmap v108: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:58.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:33 smithi078 ceph-mon[94114]: pgmap v109: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:58.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:35 smithi078 ceph-mon[94114]: pgmap v110: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:58.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:37 smithi078 ceph-mon[94114]: pgmap v111: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:58.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:39 smithi078 ceph-mon[94114]: pgmap v112: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:58.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:41 smithi078 ceph-mon[94114]: pgmap v113: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:58.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:43 smithi078 ceph-mon[94114]: pgmap v114: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:58.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:45 smithi078 ceph-mon[94114]: pgmap v115: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:58.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:47 smithi078 ceph-mon[94114]: pgmap v116: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:49:58.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:49 smithi078 ceph-mon[94114]: pgmap v117: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:49:59.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:51 smithi078 ceph-mon[94114]: pgmap v118: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:00.265 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:53 smithi078 ceph-mon[94114]: pgmap v119: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:01.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:55 smithi078 ceph-mon[94114]: pgmap v120: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:01.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:31 smithi082 ceph-mon[94281]: pgmap v108: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:03.538 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:33 smithi082 ceph-mon[94281]: pgmap v109: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:03.538 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:35 smithi082 ceph-mon[94281]: pgmap v110: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:03.538 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:37 smithi082 ceph-mon[94281]: pgmap v111: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:06.714 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:39 smithi082 ceph-mon[94281]: pgmap v112: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:08.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:41 smithi082 ceph-mon[94281]: pgmap v113: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:08.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:43 smithi082 ceph-mon[94281]: pgmap v114: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:08.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:45 smithi082 ceph-mon[94281]: pgmap v115: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:08.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:47 smithi082 ceph-mon[94281]: pgmap v116: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:08.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:49 smithi082 ceph-mon[94281]: pgmap v117: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:08.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:51 smithi082 ceph-mon[94281]: pgmap v118: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:08.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:53 smithi082 ceph-mon[94281]: pgmap v119: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:08.699 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:55 smithi082 ceph-mon[94281]: pgmap v120: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fee3009f5b0 msgr2=0x7fee300a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fee3009f5b0 0x7fee300a1a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee48197750 tx=0x7fee3c0073d0 comp rx=0 tx=0).stop 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 msgr2=0x7fee48196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee48196140 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee38006010 tx=0x7fee38005740 comp rx=0 tx=0).stop 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 shutdown_connections 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fee3009f5b0 0x7fee300a1a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee4810a750 0x7fee4819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fee48101410 0x7fee48196140 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 --2- 172.21.15.35:0/27448221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee48101d20 0x7fee48196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 >> 172.21.15.35:0/27448221 conn(0x7fee48076330 msgr2=0x7fee480fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:10.341 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 shutdown_connections 2023-03-17T08:50:12.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:49:05.735+0000 7fee4d7db700 1 -- 172.21.15.35:0/27448221 wait complete. 2023-03-17T08:50:12.026 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-03-17T08:50:12.028 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:57 smithi082 ceph-mon[94281]: pgmap v121: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:49:59 smithi082 ceph-mon[94281]: pgmap v122: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:01 smithi082 ceph-mon[94281]: pgmap v123: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:02 smithi082 ceph-mon[94281]: mgrmap e25: x(active, since 4m), standbys: y, z 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:03 smithi082 ceph-mon[94281]: pgmap v124: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:05 smithi082 ceph-mon[94281]: pgmap v125: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:14.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:07 smithi082 ceph-mon[94281]: pgmap v126: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T08:50:14.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:09 smithi082 ceph-mon[94281]: pgmap v127: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:57 smithi078 ceph-mon[94114]: pgmap v121: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:49:59 smithi078 ceph-mon[94114]: pgmap v122: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:01 smithi078 ceph-mon[94114]: pgmap v123: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:02 smithi078 ceph-mon[94114]: mgrmap e25: x(active, since 4m), standbys: y, z 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:03 smithi078 ceph-mon[94114]: pgmap v124: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:05 smithi078 ceph-mon[94114]: pgmap v125: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:07 smithi078 ceph-mon[94114]: pgmap v126: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T08:50:16.368 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:09 smithi078 ceph-mon[94114]: pgmap v127: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:16.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:05 smithi035 ceph-mon[92535]: pgmap v95: 97 pgs: 97 active+clean; 1.0 MiB data, 84 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:16.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:06 smithi035 ceph-mon[92535]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:50:16.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:07 smithi035 ceph-mon[92535]: pgmap v96: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:09 smithi035 ceph-mon[92535]: pgmap v97: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:11 smithi035 ceph-mon[92535]: pgmap v98: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:13 smithi035 ceph-mon[92535]: pgmap v99: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:15 smithi035 ceph-mon[92535]: pgmap v100: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 54 KiB/s wr, 20 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:17 smithi035 ceph-mon[92535]: pgmap v101: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 24 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:19 smithi035 ceph-mon[92535]: pgmap v102: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:21 smithi035 ceph-mon[92535]: pgmap v103: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:16.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:23 smithi035 ceph-mon[92535]: pgmap v104: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:19.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:25 smithi035 ceph-mon[92535]: pgmap v105: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:19.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:50:19.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:50:19.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:50:19.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:50:19.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:27 smithi035 ceph-mon[92535]: pgmap v106: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:29 smithi035 ceph-mon[92535]: pgmap v107: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:31 smithi035 ceph-mon[92535]: pgmap v108: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:33 smithi035 ceph-mon[92535]: pgmap v109: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:35 smithi035 ceph-mon[92535]: pgmap v110: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:37 smithi035 ceph-mon[92535]: pgmap v111: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:39 smithi035 ceph-mon[92535]: pgmap v112: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:41 smithi035 ceph-mon[92535]: pgmap v113: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:43 smithi035 ceph-mon[92535]: pgmap v114: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:45 smithi035 ceph-mon[92535]: pgmap v115: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:47 smithi035 ceph-mon[92535]: pgmap v116: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:49 smithi035 ceph-mon[92535]: pgmap v117: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:51 smithi035 ceph-mon[92535]: pgmap v118: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:53 smithi035 ceph-mon[92535]: pgmap v119: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:55 smithi035 ceph-mon[92535]: pgmap v120: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:57 smithi035 ceph-mon[92535]: pgmap v121: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:49:59 smithi035 ceph-mon[92535]: pgmap v122: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:20.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T08:50:20.839 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:50:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:50:00.747+0000 7f69ab62c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:50:20.839 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:50:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:50:00.747+0000 7f69ab62c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:50:20.839 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:50:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:50:00.747+0000 7f69ab62c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:50:20.839 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:50:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:50:00.747+0000 7f69ab62c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:50:20.839 INFO:journalctl@ceph.mgr.x.smithi035.stdout:Mar 17 08:50:00 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mgr-x[92781]: 2023-03-17T08:50:00.747+0000 7f69ab62c700 -1 client.0 error registering admin socket command: (17) File exists 2023-03-17T08:50:20.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:11 smithi082 ceph-mon[94281]: pgmap v128: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:22.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:13 smithi082 ceph-mon[94281]: pgmap v129: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2023-03-17T08:50:22.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:15 smithi082 ceph-mon[94281]: pgmap v130: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:50:22.526 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:17 smithi082 ceph-mon[94281]: pgmap v131: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:50:23.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:19 smithi082 ceph-mon[94281]: pgmap v132: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:50:23.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:11 smithi078 ceph-mon[94114]: pgmap v128: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:23.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:13 smithi078 ceph-mon[94114]: pgmap v129: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2023-03-17T08:50:23.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:15 smithi078 ceph-mon[94114]: pgmap v130: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:50:23.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:17 smithi078 ceph-mon[94114]: pgmap v131: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:50:23.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:19 smithi078 ceph-mon[94114]: pgmap v132: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:01 smithi035 ceph-mon[92535]: pgmap v123: 97 pgs: 97 active+clean; 1.3 MiB data, 85 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:02 smithi035 ceph-mon[92535]: mgrmap e25: x(active, since 4m), standbys: y, z 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:03 smithi035 ceph-mon[92535]: pgmap v124: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:05 smithi035 ceph-mon[92535]: pgmap v125: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:07 smithi035 ceph-mon[92535]: pgmap v126: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:09 smithi035 ceph-mon[92535]: pgmap v127: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:11 smithi035 ceph-mon[92535]: pgmap v128: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:13 smithi035 ceph-mon[92535]: pgmap v129: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 26 op/s 2023-03-17T08:50:23.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:15 smithi035 ceph-mon[92535]: pgmap v130: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:50:23.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:21 smithi082 ceph-mon[94281]: pgmap v133: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:50:25.722 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:21 smithi078 ceph-mon[94114]: pgmap v133: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:50:25.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:23 smithi082 ceph-mon[94281]: pgmap v134: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:50:27.810 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:24 smithi082 ceph-mon[94281]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:50:27.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:23 smithi078 ceph-mon[94114]: pgmap v134: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:50:27.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:24 smithi078 ceph-mon[94114]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:50:27.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:25 smithi082 ceph-mon[94281]: pgmap v135: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:29.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:50:31.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:25 smithi078 ceph-mon[94114]: pgmap v135: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:50:31.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:50:31.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:27 smithi082 ceph-mon[94281]: pgmap v136: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:50:31.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:50:32.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:50:33.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:50:33.915 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:29 smithi082 ceph-mon[94281]: pgmap v137: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:50:33.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:27 smithi078 ceph-mon[94114]: pgmap v136: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:50:34.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:50:34.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:50:34.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:50:34.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:29 smithi078 ceph-mon[94114]: pgmap v137: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:50:34.701 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:31 smithi082 ceph-mon[94281]: pgmap v138: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:50:34.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:33 smithi082 ceph-mon[94281]: pgmap v139: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:50:35.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:31 smithi078 ceph-mon[94114]: pgmap v138: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:50:35.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:33 smithi078 ceph-mon[94114]: pgmap v139: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:50:35.931 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 -- 172.21.15.35:0/492737793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 msgr2=0x7f96f00ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:37.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 --2- 172.21.15.35:0/492737793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f00ff750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f96e00099c0 tx=0x7f96e0009cd0 comp rx=0 tx=0).stop 2023-03-17T08:50:37.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 -- 172.21.15.35:0/492737793 shutdown_connections 2023-03-17T08:50:37.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 --2- 172.21.15.35:0/492737793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f01043c0 0x7f96f010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:37.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 --2- 172.21.15.35:0/492737793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f00ff750 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:37.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 --2- 172.21.15.35:0/492737793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f00ffd20 0x7f96f0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:37.978 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 -- 172.21.15.35:0/492737793 >> 172.21.15.35:0/492737793 conn(0x7f96f0076300 msgr2=0x7f96f0076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:37.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 -- 172.21.15.35:0/492737793 shutdown_connections 2023-03-17T08:50:37.979 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.511+0000 7f96f63c5700 1 -- 172.21.15.35:0/492737793 wait complete. 2023-03-17T08:50:39.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 Processor -- start 2023-03-17T08:50:39.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 -- start start 2023-03-17T08:50:39.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f010caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:39.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f00ffd20 0x7f96f010d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:39.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f01043c0 0x7f96f01a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:39.641 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f010d860 con 0x7f96f00ff380 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a4a00 con 0x7f96f00ffd20 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96f63c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f01a4b40 con 0x7f96f01043c0 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.512+0000 7f96effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f010caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f010caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42414/0 (socket says 172.21.15.35:42414) 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 -- 172.21.15.35:0/556112536 learned_addr learned my addr 172.21.15.35:0/556112536 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f00ffd20 0x7f96f010d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96f4962700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f01043c0 0x7f96f01a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:39.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 -- 172.21.15.35:0/556112536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f01043c0 msgr2=0x7f96f01a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:39.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f01043c0 0x7f96f01a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:39.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 -- 172.21.15.35:0/556112536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f00ffd20 msgr2=0x7f96f010d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:39.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f00ffd20 0x7f96f010d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:39.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 -- 172.21.15.35:0/556112536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00095f0 con 0x7f96f00ff380 2023-03-17T08:50:40.475 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96f4962700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f01043c0 0x7f96f01a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96effff700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f010caf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009fd0 tx=0x7f96e000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96ed7fa700 1 -- 172.21.15.35:0/556112536 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e001d070 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96ed7fa700 1 -- 172.21.15.35:0/556112536 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96e00054c0 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f0110150 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96ed7fa700 1 -- 172.21.15.35:0/556112536 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0004a90 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.513+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f010ffc0 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.515+0000 7f96ed7fa700 1 -- 172.21.15.35:0/556112536 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f96e000fb80 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.516+0000 7f96ed7fa700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f96d809f640 0x7f96d80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.516+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f96d809f640 0x7f96d80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.516+0000 7f96ed7fa700 1 -- 172.21.15.35:0/556112536 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f96e00cb3c0 con 0x7f96f00ff380 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.516+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f96d809f640 0x7f96d80a1af0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f96f010e2e0 tx=0x7f96e4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 Processor -- start 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 -- start start 2023-03-17T08:50:40.476 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a83a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979985070 con 0x55a979a83630 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9799d79b0 con 0x55a979a7f0e0 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f9702552b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9799d0e40 con 0x55a979a7e7d0 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f96f4962700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a83a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f96f4962700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a83a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42426/0 (socket says 172.21.15.35:42426) 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f96f4962700 1 -- 172.21.15.35:0/1165637673 learned_addr learned my addr 172.21.15.35:0/1165637673 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.517+0000 7f96effff700 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96f4962700 1 -- 172.21.15.35:0/1165637673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 msgr2=0x55a979a7eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96f4962700 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a7eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96f4962700 1 -- 172.21.15.35:0/1165637673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 msgr2=0x55a979a830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:40.477 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96f4962700 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a830f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96f4962700 1 -- 172.21.15.35:0/1165637673 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a979852630 con 0x55a979a83630 2023-03-17T08:50:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:50:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96f4962700 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a83a80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009c70 tx=0x7f96e8009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76faf71dd1018af6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:50:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96d67fc700 1 -- 172.21.15.35:0/1165637673 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8004bb0 con 0x55a979a83630 2023-03-17T08:50:41.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96d67fc700 1 -- 172.21.15.35:0/1165637673 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96e8004d10 con 0x55a979a83630 2023-03-17T08:50:44.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.518+0000 7f96d67fc700 1 -- 172.21.15.35:0/1165637673 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8014660 con 0x55a979a83630 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 -- 172.21.15.35:0/1165637673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 msgr2=0x55a979a83a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a83a80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009c70 tx=0x7f96e8009f80 comp rx=0 tx=0).stop 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 -- 172.21.15.35:0/1165637673 shutdown_connections 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a83a80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a7eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 --2- 172.21.15.35:0/1165637673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 -- 172.21.15.35:0/1165637673 >> 172.21.15.35:0/1165637673 conn(0x55a979a79030 msgr2=0x55a979a79400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:44.039 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 -- 172.21.15.35:0/1165637673 shutdown_connections 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 -- 172.21.15.35:0/1165637673 wait complete. 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 -- start start 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 Processor -- start 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.519+0000 7f9702552b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a8ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a88000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a83630 0x55a979a88630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979854920 con 0x55a979a7f0e0 2023-03-17T08:50:44.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979a88d60 con 0x55a979a83630 2023-03-17T08:50:44.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979a94910 con 0x55a979a7e7d0 2023-03-17T08:50:44.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:44.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 10 client.0 _ll_register_callbacks cb 0x55a979876290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:50:44.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a88000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42430/0 (socket says 172.21.15.35:42430) 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 -- 172.21.15.35:0/3584978897 learned_addr learned my addr 172.21.15.35:0/3584978897 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96effff700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a8ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96f4962700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a83630 0x55a979a88630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 -- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 msgr2=0x55a979a8ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a8ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 -- 172.21.15.35:0/3584978897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a83630 msgr2=0x55a979a88630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a83630 0x55a979a88630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 -- 172.21.15.35:0/3584978897 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e80098a0 con 0x55a979a7f0e0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a88000 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f96e4004520 tx=0x7f96e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1fa4b750713dc6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96cf7fe700 1 -- 172.21.15.35:0/3584978897 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4022070 con 0x55a979a7f0e0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96cf7fe700 1 -- 172.21.15.35:0/3584978897 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f96e4003e20 con 0x55a979a7f0e0 2023-03-17T08:50:46.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9799933f0 con 0x55a979a7f0e0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.520+0000 7f96cf7fe700 1 -- 172.21.15.35:0/3584978897 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96e4004550 con 0x55a979a7f0e0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 10 client.15438 fetch_fsmap learned FSMap version 29 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a9797fede0 con 0x55a979a7f0e0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f96cf7fe700 1 -- 172.21.15.35:0/3584978897 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a9799933f0 con 0x55a979a7f0e0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f96cf7fe700 1 -- 172.21.15.35:0/3584978897 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f96e40277f0 con 0x55a979a7f0e0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 10 client.15438 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 10 client.15438 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 20 client.15438 populate_metadata read hostname 'smithi035' 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979a98a80 0x55a979a9ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 4 client.15438 mds_command: new command op to 24439 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a97999f660 con 0x55a979a98a80 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.521+0000 7f96effff700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979a98a80 0x55a979a9ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f96cf7fe700 10 client.15438 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f96effff700 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979a98a80 0x55a979a9ae90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=27df2a52392adde6 server_cookie=2e599fa6429acad3 in_seq=0 out_seq=0 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f96cf7fe700 1 -- 172.21.15.35:0/3584978897 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a97999f660 con 0x55a979a98a80 2023-03-17T08:50:46.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f96cf7fe700 10 client.15438 handle_command_reply: tid=0 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f9702552b80 1 client.15438 shutdown 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 msgr2=0x55a979a88000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.522+0000 7f9702552b80 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a88000 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f96e4004520 tx=0x7f96e40047c0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 shutdown_connections 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979a98a80 0x55a979a9ae90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a83630 0x55a979a88630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a8ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 --2- 172.21.15.35:0/3584978897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a88000 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f96cf7fe700 0 client.15438 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 >> 172.21.15.35:0/3584978897 conn(0x55a979a79030 msgr2=0x55a979a78710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 shutdown_connections 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 1 -- 172.21.15.35:0/3584978897 wait complete. 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.523+0000 7f9702552b80 20 client.15438 trim_cache size 0 max 16384 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 Processor -- start 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 -- start start 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a78710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:46.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a85a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979a7b150 con 0x55a979a83630 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979a7f730 con 0x55a979a7f0e0 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f9702552b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979a7f5a0 con 0x55a979a7e7d0 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a85a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a85a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42440/0 (socket says 172.21.15.35:42440) 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 -- 172.21.15.35:0/3141373392 learned_addr learned my addr 172.21.15.35:0/3141373392 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96effff700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a78710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 -- 172.21.15.35:0/3141373392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 msgr2=0x55a979a78710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a78710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 -- 172.21.15.35:0/3141373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 msgr2=0x55a979a93ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a93ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 -- 172.21.15.35:0/3141373392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a979a796d0 con 0x55a979a83630 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96effff700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a78710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a93ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.536+0000 7f96f4962700 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a85a10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009790 tx=0x7f96e80090b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d53039374d3e2de server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:50:46.096 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f96d6ffd700 1 -- 172.21.15.35:0/3141373392 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8003a00 con 0x55a979a83630 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f96d6ffd700 1 -- 172.21.15.35:0/3141373392 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96e80050d0 con 0x55a979a83630 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f96d6ffd700 1 -- 172.21.15.35:0/3141373392 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e801e840 con 0x55a979a83630 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 -- 172.21.15.35:0/3141373392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 msgr2=0x55a979a85a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a85a10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009790 tx=0x7f96e80090b0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 -- 172.21.15.35:0/3141373392 shutdown_connections 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a83630 0x55a979a85a10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:46.097 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a7e7d0 0x55a979a78710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 --2- 172.21.15.35:0/3141373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7f0e0 0x55a979a93ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 -- 172.21.15.35:0/3141373392 >> 172.21.15.35:0/3141373392 conn(0x55a979a79030 msgr2=0x55a979a94c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 -- 172.21.15.35:0/3141373392 shutdown_connections 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.537+0000 7f9702552b80 1 -- 172.21.15.35:0/3141373392 wait complete. 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 -- start start 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 Processor -- start 2023-03-17T08:50:47.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7e7d0 0x55a979a8d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:47.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a8dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:47.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a83630 0x55a979aeb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:47.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979aebe60 con 0x55a979a7f0e0 2023-03-17T08:50:48.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979aebfa0 con 0x55a979a7e7d0 2023-03-17T08:50:48.447 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a979aec110 con 0x55a979a83630 2023-03-17T08:50:49.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f9702552b80 10 client.0 _ll_register_callbacks cb 0x55a979876290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:50:49.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a8dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:49.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a8dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42444/0 (socket says 172.21.15.35:42444) 2023-03-17T08:50:49.325 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f96ef7fe700 1 -- 172.21.15.35:0/1423748561 learned_addr learned my addr 172.21.15.35:0/1423748561 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:50:50.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f96effff700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7e7d0 0x55a979a8d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.538+0000 7f96ef7fe700 1 -- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a83630 msgr2=0x55a979aeb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96f4962700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a83630 0x55a979aeb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a83630 0x55a979aeb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:50.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96ef7fe700 1 -- 172.21.15.35:0/1423748561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7e7d0 msgr2=0x55a979a8d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:50:51.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7e7d0 0x55a979a8d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:51.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96ef7fe700 1 -- 172.21.15.35:0/1423748561 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a979852630 con 0x55a979a7f0e0 2023-03-17T08:50:51.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96ef7fe700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a8dbf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f96e4016040 tx=0x7f96e40276d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c002147c9118f6ee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96cf7fe700 1 -- 172.21.15.35:0/1423748561 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4022030 con 0x55a979a7f0e0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96cf7fe700 1 -- 172.21.15.35:0/1423748561 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f96e4023070 con 0x55a979a7f0e0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a979a4e240 con 0x55a979a7f0e0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96cf7fe700 1 -- 172.21.15.35:0/1423748561 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96e4027970 con 0x55a979a7f0e0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 10 client.15444 fetch_fsmap learned FSMap version 29 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a9797e7c60 con 0x55a979a7f0e0 2023-03-17T08:50:51.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96cf7fe700 1 -- 172.21.15.35:0/1423748561 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a979a4e240 con 0x55a979a7f0e0 2023-03-17T08:50:51.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f96cf7fe700 1 -- 172.21.15.35:0/1423748561 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f96e4036030 con 0x55a979a7f0e0 2023-03-17T08:50:52.996 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 10 client.15444 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 10 client.15444 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 20 client.15444 populate_metadata read hostname 'smithi035' 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979aed850 0x55a979aefc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 4 client.15444 mds_command: new command op to 24439 tid=0[{"prefix": "damage ls"}] 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.539+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a979854f60 con 0x55a979aed850 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f96effff700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979aed850 0x55a979aefc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f96cf7fe700 10 client.15444 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f96effff700 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979aed850 0x55a979aefc60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b10b2b63e47179c server_cookie=a4a34300a27d55b6 in_seq=0 out_seq=0 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f96cf7fe700 1 -- 172.21.15.35:0/1423748561 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a979854f60 con 0x55a979aed850 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f96cf7fe700 10 client.15444 handle_command_reply: tid=0 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 client.15444 shutdown 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 msgr2=0x55a979a8dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a8dbf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f96e4016040 tx=0x7f96e40276d0 comp rx=0 tx=0).stop 2023-03-17T08:50:52.997 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 shutdown_connections 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x55a979aed850 0x55a979aefc60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a979a83630 0x55a979aeb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f96cf7fe700 0 client.15444 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a979a7e7d0 0x55a979a8d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 --2- 172.21.15.35:0/1423748561 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a979a7f0e0 0x55a979a8dbf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.540+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 >> 172.21.15.35:0/1423748561 conn(0x55a979a79030 msgr2=0x55a979a78710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 shutdown_connections 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f9702552b80 1 -- 172.21.15.35:0/1423748561 wait complete. 2023-03-17T08:50:52.998 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f9702552b80 20 client.15444 trim_cache size 0 max 16384 2023-03-17T08:50:52.999 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T08:50:54.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f96d809f640 msgr2=0x7f96d80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:55.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f96d809f640 0x7f96d80a1af0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f96f010e2e0 tx=0x7f96e4009260 comp rx=0 tx=0).stop 2023-03-17T08:50:55.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 msgr2=0x7f96f010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:50:55.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f010caf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009fd0 tx=0x7f96e000f690 comp rx=0 tx=0).stop 2023-03-17T08:50:55.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 shutdown_connections 2023-03-17T08:50:55.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f96d809f640 0x7f96d80a1af0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:55.666 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f01043c0 0x7f96f01a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:55.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96f00ff380 0x7f96f010caf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:55.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 --2- 172.21.15.35:0/556112536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96f00ffd20 0x7f96f010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:50:55.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 >> 172.21.15.35:0/556112536 conn(0x7f96f0076300 msgr2=0x7f96f0103550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:50:55.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 shutdown_connections 2023-03-17T08:50:55.667 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:16.541+0000 7f96f63c5700 1 -- 172.21.15.35:0/556112536 wait complete. 2023-03-17T08:50:57.102 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-03-17T08:50:57.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:17 smithi035 ceph-mon[92535]: pgmap v131: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:50:59.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:19 smithi035 ceph-mon[92535]: pgmap v132: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:50:59.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:21 smithi035 ceph-mon[92535]: pgmap v133: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:50:59.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:35 smithi082 ceph-mon[94281]: pgmap v140: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:00.284 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:37 smithi082 ceph-mon[94281]: pgmap v141: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:39 smithi082 ceph-mon[94281]: pgmap v142: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:41 smithi082 ceph-mon[94281]: pgmap v143: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:43 smithi082 ceph-mon[94281]: pgmap v144: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:45 smithi082 ceph-mon[94281]: pgmap v145: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:47 smithi082 ceph-mon[94281]: pgmap v146: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:49 smithi082 ceph-mon[94281]: pgmap v147: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:51 smithi082 ceph-mon[94281]: pgmap v148: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:53 smithi082 ceph-mon[94281]: pgmap v149: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:55 smithi082 ceph-mon[94281]: pgmap v150: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:57 smithi082 ceph-mon[94281]: pgmap v151: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:00.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:35 smithi078 ceph-mon[94114]: pgmap v140: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:01.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:37 smithi078 ceph-mon[94114]: pgmap v141: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:01.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:39 smithi078 ceph-mon[94114]: pgmap v142: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:41 smithi078 ceph-mon[94114]: pgmap v143: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:43 smithi078 ceph-mon[94114]: pgmap v144: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:01.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:45 smithi078 ceph-mon[94114]: pgmap v145: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:47 smithi078 ceph-mon[94114]: pgmap v146: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:01.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:49 smithi078 ceph-mon[94114]: pgmap v147: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:51 smithi078 ceph-mon[94114]: pgmap v148: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:53 smithi078 ceph-mon[94114]: pgmap v149: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:01.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:55 smithi078 ceph-mon[94114]: pgmap v150: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:57 smithi078 ceph-mon[94114]: pgmap v151: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:01.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:50:59 smithi078 ceph-mon[94114]: pgmap v152: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.382 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:50:59 smithi082 ceph-mon[94281]: pgmap v152: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 -- 172.21.15.35:0/363383441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 msgr2=0x7f4a2010cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 --2- 172.21.15.35:0/363383441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2010cbc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b0a0 tx=0x7f4a1800b3b0 comp rx=0 tx=0).stop 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 -- 172.21.15.35:0/363383441 shutdown_connections 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 --2- 172.21.15.35:0/363383441 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2010cbc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 --2- 172.21.15.35:0/363383441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a20101410 0x7f4a201017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 --2- 172.21.15.35:0/363383441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a20101d20 0x7f4a2010a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.005+0000 7f4a27bde700 1 -- 172.21.15.35:0/363383441 >> 172.21.15.35:0/363383441 conn(0x7f4a20076330 msgr2=0x7f4a20076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:51:01.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 -- 172.21.15.35:0/363383441 shutdown_connections 2023-03-17T08:51:02.636 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 -- 172.21.15.35:0/363383441 wait complete. 2023-03-17T08:51:02.636 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 Processor -- start 2023-03-17T08:51:02.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 -- start start 2023-03-17T08:51:02.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a20101410 0x7f4a201962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:02.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a20101d20 0x7f4a20196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:02.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:02.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.006+0000 7f4a27bde700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2019b2d0 con 0x7f4a2010a750 2023-03-17T08:51:02.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a27bde700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2019b440 con 0x7f4a20101410 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a27bde700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2019b600 con 0x7f4a20101d20 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42460/0 (socket says 172.21.15.35:42460) 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 -- 172.21.15.35:0/2660986165 learned_addr learned my addr 172.21.15.35:0/2660986165 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a25179700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a20101d20 0x7f4a20196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2597a700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a20101410 0x7f4a201962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 -- 172.21.15.35:0/2660986165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a20101d20 msgr2=0x7f4a20196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:03.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a20101d20 0x7f4a20196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 -- 172.21.15.35:0/2660986165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a20101410 msgr2=0x7f4a201962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a20101410 0x7f4a201962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 -- 172.21.15.35:0/2660986165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009d00 con 0x7f4a2010a750 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a2617b700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2019ac90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b830 tx=0x7f4a180094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800e040 con 0x7f4a2010a750 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a18003e90 con 0x7f4a2010a750 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a201100a0 con 0x7f4a2010a750 2023-03-17T08:51:03.688 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1801d480 con 0x7f4a2010a750 2023-03-17T08:51:03.689 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.007+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2010ff10 con 0x7f4a2010a750 2023-03-17T08:51:04.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.008+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a20110230 con 0x7f4a2010a750 2023-03-17T08:51:04.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.009+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4a18003a00 con 0x7f4a2010a750 2023-03-17T08:51:04.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.010+0000 7f4a16ffd700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a0c09f640 0x7f4a0c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:04.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.010+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4a180cbda0 con 0x7f4a2010a750 2023-03-17T08:51:04.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.010+0000 7f4a2597a700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a0c09f640 0x7f4a0c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:04.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.011+0000 7f4a2597a700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a0c09f640 0x7f4a0c0a1af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c005fd0 tx=0x7f4a1c00a560 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:05.837 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.014+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f4a18095c50 con 0x7f4a2010a750 2023-03-17T08:51:05.838 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:23 smithi035 ceph-mon[92535]: pgmap v134: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:51:06.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.242+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 --> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a201976e0 con 0x7f4a0c09f640 2023-03-17T08:51:07.981 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.298+0000 7f4a16ffd700 1 -- 172.21.15.35:0/2660986165 <== mgr.15318 v2:172.21.15.35:6800/1224511514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f4a201976e0 con 0x7f4a0c09f640 2023-03-17T08:51:07.981 INFO:teuthology.orchestra.run.smithi035.stdout:Retention added to path / 2023-03-17T08:51:07.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:01 smithi078 ceph-mon[94114]: pgmap v153: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:09.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:03 smithi078 ceph-mon[94114]: pgmap v154: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:09.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:05 smithi078 ceph-mon[94114]: pgmap v155: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:09.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:01 smithi082 ceph-mon[94281]: pgmap v153: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:09.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:03 smithi082 ceph-mon[94281]: pgmap v154: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:09.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:05 smithi082 ceph-mon[94281]: pgmap v155: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:10.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a0c09f640 msgr2=0x7f4a0c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:10.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a0c09f640 0x7f4a0c0a1af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c005fd0 tx=0x7f4a1c00a560 comp rx=0 tx=0).stop 2023-03-17T08:51:10.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 msgr2=0x7f4a2019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:10.803 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2019ac90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b830 tx=0x7f4a180094e0 comp rx=0 tx=0).stop 2023-03-17T08:51:11.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 shutdown_connections 2023-03-17T08:51:11.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a0c09f640 0x7f4a0c0a1af0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:11.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a2010a750 0x7f4a2019ac90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:11.384 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a20101410 0x7f4a201962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:11.384 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 --2- 172.21.15.35:0/2660986165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a20101d20 0x7f4a20196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:11.386 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 >> 172.21.15.35:0/2660986165 conn(0x7f4a20076330 msgr2=0x7f4a201021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:51:11.386 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 shutdown_connections 2023-03-17T08:51:11.975 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:50:24.301+0000 7f4a27bde700 1 -- 172.21.15.35:0/2660986165 wait complete. 2023-03-17T08:51:11.975 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-03-17T08:51:13.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:07 smithi078 ceph-mon[94114]: pgmap v156: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:51:14.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:09 smithi078 ceph-mon[94114]: pgmap v157: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:14.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:11 smithi078 ceph-mon[94114]: pgmap v158: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:14.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:07 smithi082 ceph-mon[94281]: pgmap v156: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:51:14.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:09 smithi082 ceph-mon[94281]: pgmap v157: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:14.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:11 smithi082 ceph-mon[94281]: pgmap v158: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:14.724 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:24 smithi035 ceph-mon[92535]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:51:15.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:25 smithi035 ceph-mon[92535]: pgmap v135: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:17.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:51:17.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:27 smithi035 ceph-mon[92535]: pgmap v136: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:17.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:51:17.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:51:17.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:29 smithi035 ceph-mon[92535]: pgmap v137: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:31 smithi035 ceph-mon[92535]: pgmap v138: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:33 smithi035 ceph-mon[92535]: pgmap v139: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:35 smithi035 ceph-mon[92535]: pgmap v140: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:37 smithi035 ceph-mon[92535]: pgmap v141: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:39 smithi035 ceph-mon[92535]: pgmap v142: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:41 smithi035 ceph-mon[92535]: pgmap v143: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:17.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:43 smithi035 ceph-mon[92535]: pgmap v144: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:17.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:45 smithi035 ceph-mon[92535]: pgmap v145: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:17.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:47 smithi035 ceph-mon[92535]: pgmap v146: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:17.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:49 smithi035 ceph-mon[92535]: pgmap v147: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:18.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:51 smithi035 ceph-mon[92535]: pgmap v148: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:18.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:53 smithi035 ceph-mon[92535]: pgmap v149: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:18.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:55 smithi035 ceph-mon[92535]: pgmap v150: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:19.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:57 smithi035 ceph-mon[92535]: pgmap v151: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:19.986 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:50:59 smithi035 ceph-mon[92535]: pgmap v152: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:19.986 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:01 smithi035 ceph-mon[92535]: pgmap v153: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:20.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:03 smithi035 ceph-mon[92535]: pgmap v154: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:51:22.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:05 smithi035 ceph-mon[92535]: pgmap v155: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:22.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:07 smithi035 ceph-mon[92535]: pgmap v156: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:51:22.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:09 smithi035 ceph-mon[92535]: pgmap v157: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:22.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:11 smithi035 ceph-mon[92535]: pgmap v158: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:51:22.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:13 smithi035 ceph-mon[92535]: pgmap v159: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:51:22.267 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:13 smithi078 ceph-mon[94114]: pgmap v159: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:51:23.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:15 smithi078 ceph-mon[94114]: pgmap v160: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:51:24.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:15 smithi078 ceph-mon[94114]: from='client.25237 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:51:24.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:17 smithi078 ceph-mon[94114]: pgmap v161: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 170 B/s wr, 14 op/s 2023-03-17T08:51:24.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:19 smithi078 ceph-mon[94114]: pgmap v162: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:51:24.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:13 smithi082 ceph-mon[94281]: pgmap v159: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:51:26.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:15 smithi082 ceph-mon[94281]: pgmap v160: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:51:27.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:15 smithi082 ceph-mon[94281]: from='client.25237 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:51:27.040 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:17 smithi082 ceph-mon[94281]: pgmap v161: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 170 B/s wr, 14 op/s 2023-03-17T08:51:27.040 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:19 smithi082 ceph-mon[94281]: pgmap v162: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 -- 172.21.15.35:0/4260411036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 msgr2=0x7f4e380ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 --2- 172.21.15.35:0/4260411036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e380ff750 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e280099c0 tx=0x7f4e28009cd0 comp rx=0 tx=0).stop 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 -- 172.21.15.35:0/4260411036 shutdown_connections 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 --2- 172.21.15.35:0/4260411036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 0x7f4e3810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 --2- 172.21.15.35:0/4260411036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e380ff750 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 --2- 172.21.15.35:0/4260411036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 0x7f4e38103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:27.040 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 -- 172.21.15.35:0/4260411036 >> 172.21.15.35:0/4260411036 conn(0x7f4e38076300 msgr2=0x7f4e38076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:51:27.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 -- 172.21.15.35:0/4260411036 shutdown_connections 2023-03-17T08:51:27.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.864+0000 7f4e3db44700 1 -- 172.21.15.35:0/4260411036 wait complete. 2023-03-17T08:51:27.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 -- 172.21.15.35:0/3018413719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70105500 msgr2=0x7f7d7010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:27.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 --2- 172.21.15.35:0/3018413719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70105500 0x7f7d7010d0b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b0d0 tx=0x7f7d6800b3e0 comp rx=0 tx=0).stop 2023-03-17T08:51:28.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 -- 172.21.15.35:0/3018413719 shutdown_connections 2023-03-17T08:51:30.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 --2- 172.21.15.35:0/3018413719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70105500 0x7f7d7010d0b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:31.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 --2- 172.21.15.35:0/3018413719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 0x7f7d70069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:31.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 --2- 172.21.15.35:0/3018413719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70069e10 0x7f7d70104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:31.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 -- 172.21.15.35:0/3018413719 >> 172.21.15.35:0/3018413719 conn(0x7f7d70076f80 msgr2=0x7f7d70077380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:51:31.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f7d76696700 1 -- 172.21.15.35:0/3018413719 shutdown_connections 2023-03-17T08:51:31.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f4e3db44700 1 Processor -- start 2023-03-17T08:51:32.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.865+0000 7f4e3db44700 1 -- start start 2023-03-17T08:51:32.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f7d76696700 1 -- 172.21.15.35:0/3018413719 wait complete. 2023-03-17T08:51:34.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:21 smithi078 ceph-mon[94114]: pgmap v163: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:23 smithi078 ceph-mon[94114]: pgmap v164: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 13 op/s 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:25 smithi078 ceph-mon[94114]: pgmap v165: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:27 smithi078 ceph-mon[94114]: pgmap v166: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:51:34.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:30 smithi078 ceph-mon[94114]: pgmap v167: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:34.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:32 smithi078 ceph-mon[94114]: pgmap v168: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:34.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:33 smithi078 ceph-mon[94114]: pgmap v169: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:34.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:21 smithi082 ceph-mon[94281]: pgmap v163: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:51:37.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:23 smithi082 ceph-mon[94281]: pgmap v164: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 13 op/s 2023-03-17T08:51:37.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:25 smithi082 ceph-mon[94281]: pgmap v165: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:51:37.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:27 smithi082 ceph-mon[94281]: pgmap v166: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:51:37.233 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:51:37.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:51:37.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:51:37.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:51:37.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:30 smithi082 ceph-mon[94281]: pgmap v167: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:37.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:32 smithi082 ceph-mon[94281]: pgmap v168: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:38.423 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:33 smithi082 ceph-mon[94281]: pgmap v169: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:38.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:35 smithi078 ceph-mon[94114]: pgmap v170: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:39.432 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:35 smithi082 ceph-mon[94281]: pgmap v170: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:39.432 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:37 smithi082 ceph-mon[94281]: pgmap v171: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:39.432 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e3db44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e38100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e3db44700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 0x7f4e381012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e3db44700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 0x7f4e381a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e3db44700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38101af0 con 0x7f4e380ff380 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e3db44700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381a4960 con 0x7f4e380ffd20 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e3db44700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381a4aa0 con 0x7f4e381043c0 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e38100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e38100d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42474/0 (socket says 172.21.15.35:42474) 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 -- 172.21.15.35:0/2637961959 learned_addr learned my addr 172.21.15.35:0/2637961959 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 0x7f4e381012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:39.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e37fff700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 0x7f4e381a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:40.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 -- 172.21.15.35:0/2637961959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 msgr2=0x7f4e381a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:40.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 0x7f4e381a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:40.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 -- 172.21.15.35:0/2637961959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 msgr2=0x7f4e381012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:40.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 0x7f4e381012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:40.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 -- 172.21.15.35:0/2637961959 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280095f0 con 0x7f4e380ff380 2023-03-17T08:51:40.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 0x7f4e381012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:51:40.249 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e37fff700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 0x7f4e381a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:51:40.250 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f7d76696700 1 Processor -- start 2023-03-17T08:51:40.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f7d76696700 1 -- start start 2023-03-17T08:51:40.435 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e377fe700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e38100d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009fd0 tx=0x7f4e2800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:40.842 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.866+0000 7f4e34ff9700 1 -- 172.21.15.35:0/2637961959 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2801d070 con 0x7f4e380ff380 2023-03-17T08:51:40.842 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f4e34ff9700 1 -- 172.21.15.35:0/2637961959 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e280054c0 con 0x7f4e380ff380 2023-03-17T08:51:40.842 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3810f030 con 0x7f4e380ff380 2023-03-17T08:51:40.842 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f4e34ff9700 1 -- 172.21.15.35:0/2637961959 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28004b30 con 0x7f4e380ff380 2023-03-17T08:51:40.842 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3810eea0 con 0x7f4e380ff380 2023-03-17T08:51:40.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:39 smithi082 ceph-mon[94281]: pgmap v172: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:41.868 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:37 smithi078 ceph-mon[94114]: pgmap v171: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:41.868 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:39 smithi078 ceph-mon[94114]: pgmap v172: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:41.869 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d76696700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 0x7f7d701962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:41.870 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d76696700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 0x7f7d701967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d76696700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70105500 0x7f7d7019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d76696700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019b290 con 0x7f7d70069e10 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d76696700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019b400 con 0x7f7d70105500 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d76696700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7019b5c0 con 0x7f7d70069470 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 0x7f7d701967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 0x7f7d701967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42484/0 (socket says 172.21.15.35:42484) 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 0x7f7d701962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/1230977007 learned_addr learned my addr 172.21.15.35:0/1230977007 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d74c33700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70105500 0x7f7d7019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1230977007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70105500 msgr2=0x7f7d7019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:43.526 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70105500 0x7f7d7019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 msgr2=0x7f7d701967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 0x7f7d701967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1230977007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009520 con 0x7f7d70069470 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.867+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 0x7f7d701967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.868+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 0x7f7d701962b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000ea10 tx=0x7f7d6000ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.868+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60013be0 con 0x7f7d70069470 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.868+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d6000ee50 con 0x7f7d70069470 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.868+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000cdd0 con 0x7f7d70069470 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.868+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d68009d00 con 0x7f7d70069470 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.868+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d701100f0 con 0x7f7d70069470 2023-03-17T08:51:43.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.869+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7010ff60 con 0x7f7d70069470 2023-03-17T08:51:43.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.870+0000 7f4e34ff9700 1 -- 172.21.15.35:0/2637961959 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4e2800fc30 con 0x7f4e380ff380 2023-03-17T08:51:44.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.870+0000 7f4e34ff9700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e2009f640 0x7f4e200a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:44.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e2009f640 0x7f4e200a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:44.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e34ff9700 1 -- 172.21.15.35:0/2637961959 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4e280cb3c0 con 0x7f4e380ff380 2023-03-17T08:51:44.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7d6001b430 con 0x7f7d70069470 2023-03-17T08:51:44.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:41 smithi078 ceph-mon[94114]: pgmap v173: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:44.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:44 smithi078 ceph-mon[94114]: pgmap v174: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:44.833 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:41 smithi082 ceph-mon[94281]: pgmap v173: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:45.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:44 smithi082 ceph-mon[94281]: pgmap v174: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:46.858 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 Processor -- start 2023-03-17T08:51:48.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 -- start start 2023-03-17T08:51:48.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acf2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:48.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf30e0 0x55974acf70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:48.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974acf7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:48.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974abf9070 con 0x55974acf30e0 2023-03-17T08:51:48.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974ac4b9b0 con 0x55974acf7630 2023-03-17T08:51:49.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974ac44e40 con 0x55974acf27d0 2023-03-17T08:51:49.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e2009f640 0x7f4e200a1af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e38102570 tx=0x7f4e2c00b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:49.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.871+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acf2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:49.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acf2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:34254/0 (socket says 172.21.15.35:34254) 2023-03-17T08:51:49.658 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 -- 172.21.15.35:0/2296140456 learned_addr learned my addr 172.21.15.35:0/2296140456 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:51:49.659 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf30e0 0x55974acf70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:49.659 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e37fff700 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974acf7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:49.659 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f7d6d7fa700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f640 0x7f7d580a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:51:50.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f640 0x7f7d580a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:51:50.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 -- 172.21.15.35:0/2296140456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 msgr2=0x55974acf7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:51:50.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974acf7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:50.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 -- 172.21.15.35:0/2296140456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf30e0 msgr2=0x55974acf70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:51:51.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf30e0 0x55974acf70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:51:51.303 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f7d600ced60 con 0x7f7d70069470 2023-03-17T08:51:52.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 -- 172.21.15.35:0/2296140456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974aac6630 con 0x55974acf27d0 2023-03-17T08:51:52.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f4e377fe700 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acf2ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000c00 tx=0x7f4e28098960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5881a8b9eefd638 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:52.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.872+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f640 0x7f7d580a1af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d701978c0 tx=0x7f7d64007450 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:51:52.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.874+0000 7f4e1dffb700 1 -- 172.21.15.35:0/2296140456 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280a1090 con 0x55974acf27d0 2023-03-17T08:51:52.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.874+0000 7f4e1dffb700 1 -- 172.21.15.35:0/2296140456 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e28099190 con 0x55974acf27d0 2023-03-17T08:51:52.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.874+0000 7f4e1dffb700 1 -- 172.21.15.35:0/2296140456 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280a0e60 con 0x55974acf27d0 2023-03-17T08:51:52.904 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f7d60098c90 con 0x7f7d70069470 2023-03-17T08:51:52.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:45 smithi078 ceph-mon[94114]: pgmap v175: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:55.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:47 smithi078 ceph-mon[94114]: pgmap v176: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:55.413 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:50 smithi078 ceph-mon[94114]: pgmap v177: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:56.571 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:52 smithi078 ceph-mon[94114]: pgmap v178: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:56.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:45 smithi082 ceph-mon[94281]: pgmap v175: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:56.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:47 smithi082 ceph-mon[94281]: pgmap v176: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:56.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:50 smithi082 ceph-mon[94281]: pgmap v177: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:56.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:52 smithi082 ceph-mon[94281]: pgmap v178: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:57.184 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:54 smithi078 ceph-mon[94114]: pgmap v179: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:58.413 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:55 smithi078 ceph-mon[94114]: pgmap v180: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:58.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:54 smithi082 ceph-mon[94281]: pgmap v179: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:58.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:55 smithi082 ceph-mon[94281]: pgmap v180: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:51:58.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:51:58 smithi082 ceph-mon[94281]: pgmap v181: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:51:58.419 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/2296140456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 msgr2=0x55974acf2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:00.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acf2ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000c00 tx=0x7f4e28098960 comp rx=0 tx=0).stop 2023-03-17T08:52:00.197 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/2296140456 shutdown_connections 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974acf7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acf2ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/2296140456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf30e0 0x55974acf70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/2296140456 >> 172.21.15.35:0/2296140456 conn(0x55974aced030 msgr2=0x55974aced400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/2296140456 shutdown_connections 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/2296140456 wait complete. 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.875+0000 7f4e49cd1b80 1 -- start start 2023-03-17T08:52:00.198 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 Processor -- start 2023-03-17T08:52:00.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:00.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:00.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:00.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974aac8920 con 0x55974acf7630 2023-03-17T08:52:00.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974acfced0 con 0x55974acf30e0 2023-03-17T08:52:00.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974ad085d0 con 0x55974acf27d0 2023-03-17T08:52:01.222 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e49cd1b80 10 client.0 _ll_register_callbacks cb 0x55974aaea290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:34262/0 (socket says 172.21.15.35:34262) 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42500/0 (socket says 172.21.15.35:42500) 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e377fe700 1 -- 172.21.15.35:0/1560899957 learned_addr learned my addr 172.21.15.35:0/1560899957 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.876+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e377fe700 1 -- 172.21.15.35:0/1560899957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 msgr2=0x55974acfc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e377fe700 1 -- 172.21.15.35:0/1560899957 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 msgr2=0x55974acfc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e377fe700 1 -- 172.21.15.35:0/1560899957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3810eea0 con 0x55974acf27d0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e37fff700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfee40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e280c8c30 tx=0x7f4e280986d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58932b62e9bf9512 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1560899957 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280a1090 con 0x55974acf27d0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1560899957 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4e280a0e10 con 0x55974acf27d0 2023-03-17T08:52:01.223 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55974ac073f0 con 0x55974acf27d0 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1560899957 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e28093b40 con 0x55974acf27d0 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e49cd1b80 10 client.25243 fetch_fsmap learned FSMap version 29 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.877+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55974aa72de0 con 0x55974acf27d0 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1560899957 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e28063020 con 0x55974acf27d0 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1560899957 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4e28098000 con 0x55974acf27d0 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e49cd1b80 10 client.25243 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e49cd1b80 10 client.25243 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e49cd1b80 20 client.25243 populate_metadata read hostname 'smithi035' 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad0c290 0x55974ad0e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e49cd1b80 4 client.25243 mds_command: new command op to 24445 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55974ac13660 con 0x55974ad0c290 2023-03-17T08:52:01.224 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad0c290 0x55974ad0e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:01.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e16ffd700 10 client.25243 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T08:52:01.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.878+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad0c290 0x55974ad0e6a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eda2ef24917c93f1 server_cookie=aee35053dfd2f4dd in_seq=0 out_seq=0 2023-03-17T08:52:01.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1560899957 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55974ac13660 con 0x55974ad0c290 2023-03-17T08:52:01.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e16ffd700 10 client.25243 handle_command_reply: tid=0 2023-03-17T08:52:01.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 client.25243 shutdown 2023-03-17T08:52:01.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 msgr2=0x55974acfee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:02.880 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfee40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e280c8c30 tx=0x7f4e280986d0 comp rx=0 tx=0).stop 2023-03-17T08:52:03.780 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 shutdown_connections 2023-03-17T08:52:04.634 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad0c290 0x55974ad0e6a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:04.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:04.635 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfee40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:05.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e16ffd700 0 client.25243 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1560899957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 >> 172.21.15.35:0/1560899957 conn(0x55974aced030 msgr2=0x55974acec710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 shutdown_connections 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.879+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1560899957 wait complete. 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.880+0000 7f4e49cd1b80 20 client.25243 trim_cache size 0 max 16384 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 Processor -- start 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 -- start start 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 0x55974acf4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf30e0 0x55974ad03590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974ad08a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:05.576 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974acfd6a0 con 0x55974acf27d0 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974ace7e30 con 0x55974acf7630 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974ad0ed00 con 0x55974acf30e0 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 0x55974acf4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 0x55974acf4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42504/0 (socket says 172.21.15.35:42504) 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 -- 172.21.15.35:0/1409570784 learned_addr learned my addr 172.21.15.35:0/1409570784 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e37fff700 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974ad08a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf30e0 0x55974ad03590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 -- 172.21.15.35:0/1409570784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf30e0 msgr2=0x55974ad03590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf30e0 0x55974ad03590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:05.577 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 -- 172.21.15.35:0/1409570784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 msgr2=0x55974ad08a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:52:05.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974ad08a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:05.578 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e377fe700 1 -- 172.21.15.35:0/1409570784 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974ac0b190 con 0x55974acf27d0 2023-03-17T08:52:09.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.893+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf30e0 0x55974ad03590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:52:09.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.894+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 0x55974acf4f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4e28005910 tx=0x7f4e280c8c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b0d8b00c0160f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:52:09.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.894+0000 7f4e1e7fc700 1 -- 172.21.15.35:0/1409570784 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28099d60 con 0x55974acf27d0 2023-03-17T08:52:09.351 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.894+0000 7f4e1e7fc700 1 -- 172.21.15.35:0/1409570784 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e28063030 con 0x55974acf27d0 2023-03-17T08:52:09.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.894+0000 7f4e1e7fc700 1 -- 172.21.15.35:0/1409570784 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28099f50 con 0x55974acf27d0 2023-03-17T08:52:09.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.894+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1409570784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 msgr2=0x55974acf4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.894+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 0x55974acf4f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4e28005910 tx=0x7f4e280c8c30 comp rx=0 tx=0).stop 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1409570784 shutdown_connections 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf7630 0x55974ad08a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf27d0 0x55974acf4f20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1409570784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf30e0 0x55974ad03590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1409570784 >> 172.21.15.35:0/1409570784 conn(0x55974aced030 msgr2=0x55974ad12fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:11.670 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1409570784 shutdown_connections 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1409570784 wait complete. 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 -- start start 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 Processor -- start 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.895+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974acfba60 con 0x55974acf7630 2023-03-17T08:52:11.671 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974acfbbd0 con 0x55974acf30e0 2023-03-17T08:52:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974acfbd90 con 0x55974acf27d0 2023-03-17T08:52:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 10 client.0 _ll_register_callbacks cb 0x55974aaea290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:52:11.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:13.015 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42514/0 (socket says 172.21.15.35:42514) 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 -- 172.21.15.35:0/1862713689 learned_addr learned my addr 172.21.15.35:0/1862713689 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 -- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 msgr2=0x55974acfa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 -- 172.21.15.35:0/1862713689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 msgr2=0x55974acfaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 -- 172.21.15.35:0/1862713689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55974aa72de0 con 0x55974acf7630 2023-03-17T08:52:13.970 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e36ffd700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:52:15.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e37fff700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfb440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4e30016360 tx=0x7f4e30009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6027d1992bc58c1a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:52:15.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:52:15.135 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1862713689 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30016ec0 con 0x55974acf7630 2023-03-17T08:52:16.163 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1862713689 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4e30004bb0 con 0x55974acf7630 2023-03-17T08:52:16.163 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.896+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55974acc2240 con 0x55974acf7630 2023-03-17T08:52:16.163 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1862713689 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e30004d70 con 0x55974acf7630 2023-03-17T08:52:17.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 10 client.15474 fetch_fsmap learned FSMap version 29 2023-03-17T08:52:17.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55974aa99250 con 0x55974acf7630 2023-03-17T08:52:17.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1862713689 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55974acc2240 con 0x55974acf7630 2023-03-17T08:52:17.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1862713689 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4e300215f0 con 0x55974acf7630 2023-03-17T08:52:17.248 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 10 client.15474 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:52:19.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 10 client.15474 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-17T08:52:19.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 20 client.15474 populate_metadata read hostname 'smithi035' 2023-03-17T08:52:19.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad60ee0 0x55974ad632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:19.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 4 client.15474 mds_command: new command op to 24445 tid=0[{"prefix": "damage ls"}] 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55974aac8f60 con 0x55974ad60ee0 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.897+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad60ee0 0x55974ad632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e16ffd700 10 client.15474 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e377fe700 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad60ee0 0x55974ad632f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3f6ef3441cc7d00 server_cookie=abb7abfca01ca9d1 in_seq=0 out_seq=0 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e16ffd700 1 -- 172.21.15.35:0/1862713689 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55974aac8f60 con 0x55974ad60ee0 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e16ffd700 10 client.15474 handle_command_reply: tid=0 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 client.15474 shutdown 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 msgr2=0x55974acfb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:20.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfb440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4e30016360 tx=0x7f4e30009920 comp rx=0 tx=0).stop 2023-03-17T08:52:21.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 shutdown_connections 2023-03-17T08:52:21.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55974ad60ee0 0x55974ad632f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:21.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55974acf7630 0x55974acfb440 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:21.572 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55974acf27d0 0x55974acfa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:21.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e16ffd700 0 client.15474 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T08:52:21.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 --2- 172.21.15.35:0/1862713689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55974acf30e0 0x55974acfaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:23.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 >> 172.21.15.35:0/1862713689 conn(0x55974aced030 msgr2=0x55974ad08a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:23.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 shutdown_connections 2023-03-17T08:52:23.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 1 -- 172.21.15.35:0/1862713689 wait complete. 2023-03-17T08:52:23.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.898+0000 7f4e49cd1b80 20 client.15474 trim_cache size 0 max 16384 2023-03-17T08:52:23.379 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T08:52:23.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e2009f640 msgr2=0x7f4e200a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:23.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e2009f640 0x7f4e200a1af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e38102570 tx=0x7f4e2c00b5f0 comp rx=0 tx=0).stop 2023-03-17T08:52:23.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 msgr2=0x7f4e38100d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:23.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e38100d80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009fd0 tx=0x7f4e2800f740 comp rx=0 tx=0).stop 2023-03-17T08:52:25.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 shutdown_connections 2023-03-17T08:52:25.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e2009f640 0x7f4e200a1af0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:25.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e381043c0 0x7f4e381a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:25.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e380ff380 0x7f4e38100d80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:25.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 --2- 172.21.15.35:0/2637961959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e380ffd20 0x7f4e381012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:25.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 >> 172.21.15.35:0/2637961959 conn(0x7f4e38076300 msgr2=0x7f4e38067db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:25.006 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 shutdown_connections 2023-03-17T08:52:25.006 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:14.899+0000 7f4e3db44700 1 -- 172.21.15.35:0/2637961959 wait complete. 2023-03-17T08:52:25.007 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-03-17T08:52:27.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.105+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 --> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d70110280 con 0x7f7d5809f640 2023-03-17T08:52:30.659 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.112+0000 7f7d6d7fa700 1 -- 172.21.15.35:0/1230977007 <== mgr.15318 v2:172.21.15.35:6800/1224511514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+317 (secure 0 0 0) 0x7f7d70110280 con 0x7f7d5809f640 2023-03-17T08:52:30.659 INFO:teuthology.orchestra.run.smithi035.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-03-17T00:00:00", "created": "2023-03-17T08:49:05", "first": "2023-03-17T08:50:00", "last": "2023-03-17T08:51:00", "last_pruned": null, "created_count": 2, "pruned_count": 0, "active": true} 2023-03-17T08:52:32.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f640 msgr2=0x7f7d580a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:34.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f640 0x7f7d580a1af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d701978c0 tx=0x7f7d64007450 comp rx=0 tx=0).stop 2023-03-17T08:52:34.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 msgr2=0x7f7d701962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:34.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 0x7f7d701962b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000ea10 tx=0x7f7d6000ed20 comp rx=0 tx=0).stop 2023-03-17T08:52:36.384 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 shutdown_connections 2023-03-17T08:52:36.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f640 0x7f7d580a1af0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:36.385 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70105500 0x7f7d7019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:37.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d70069470 0x7f7d701962b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:37.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 --2- 172.21.15.35:0/1230977007 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70069e10 0x7f7d701967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:37.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 >> 172.21.15.35:0/1230977007 conn(0x7f7d70076f80 msgr2=0x7f7d700fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:37.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.114+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 shutdown_connections 2023-03-17T08:52:37.933 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:51:15.115+0000 7f7d76696700 1 -- 172.21.15.35:0/1230977007 wait complete. 2023-03-17T08:52:37.934 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-03-17T08:52:37.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:00 smithi082 ceph-mon[94281]: pgmap v182: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:37.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:02 smithi082 ceph-mon[94281]: pgmap v183: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:37.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:04 smithi082 ceph-mon[94281]: pgmap v184: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:52:37.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:05 smithi082 ceph-mon[94281]: pgmap v185: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:39.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:08 smithi082 ceph-mon[94281]: pgmap v186: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:52:39.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:10 smithi082 ceph-mon[94281]: pgmap v187: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:39.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:12 smithi082 ceph-mon[94281]: pgmap v188: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:39.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:14 smithi082 ceph-mon[94281]: pgmap v189: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:52:39.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:15 smithi082 ceph-mon[94281]: pgmap v190: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:52:39.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:18 smithi082 ceph-mon[94281]: pgmap v191: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:52:39.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:20 smithi082 ceph-mon[94281]: pgmap v192: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:52:39.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:22 smithi082 ceph-mon[94281]: pgmap v193: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:52:39.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:24 smithi082 ceph-mon[94281]: pgmap v194: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:52:39.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:25 smithi082 ceph-mon[94281]: pgmap v195: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:39.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:28 smithi082 ceph-mon[94281]: pgmap v196: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:40.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:52:40.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:30 smithi082 ceph-mon[94281]: pgmap v197: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:40.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:52:40.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:52:40.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:52:40.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:32 smithi082 ceph-mon[94281]: pgmap v198: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:40.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:34 smithi082 ceph-mon[94281]: pgmap v199: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:40.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:35 smithi082 ceph-mon[94281]: pgmap v200: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:41.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:51:58 smithi078 ceph-mon[94114]: pgmap v181: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:41.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:00 smithi078 ceph-mon[94114]: pgmap v182: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:41.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:02 smithi078 ceph-mon[94114]: pgmap v183: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:41.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:04 smithi078 ceph-mon[94114]: pgmap v184: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:52:41.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:05 smithi078 ceph-mon[94114]: pgmap v185: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:41.298 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:08 smithi078 ceph-mon[94114]: pgmap v186: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:10 smithi078 ceph-mon[94114]: pgmap v187: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:12 smithi078 ceph-mon[94114]: pgmap v188: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:14 smithi078 ceph-mon[94114]: pgmap v189: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:15 smithi078 ceph-mon[94114]: pgmap v190: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:18 smithi078 ceph-mon[94114]: pgmap v191: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:20 smithi078 ceph-mon[94114]: pgmap v192: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:22 smithi078 ceph-mon[94114]: pgmap v193: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:24 smithi078 ceph-mon[94114]: pgmap v194: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:25 smithi078 ceph-mon[94114]: pgmap v195: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:28 smithi078 ceph-mon[94114]: pgmap v196: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:30 smithi078 ceph-mon[94114]: pgmap v197: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:52:41.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:52:42.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:32 smithi078 ceph-mon[94114]: pgmap v198: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:42.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:34 smithi078 ceph-mon[94114]: pgmap v199: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:42.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:35 smithi078 ceph-mon[94114]: pgmap v200: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:42.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:38 smithi078 ceph-mon[94114]: pgmap v201: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:42.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:40 smithi078 ceph-mon[94114]: pgmap v202: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:42.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:38 smithi082 ceph-mon[94281]: pgmap v201: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:42.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:40 smithi082 ceph-mon[94281]: pgmap v202: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:42.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:15 smithi035 ceph-mon[92535]: pgmap v160: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:15 smithi035 ceph-mon[92535]: from='client.25237 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:17 smithi035 ceph-mon[92535]: pgmap v161: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 170 B/s wr, 14 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:19 smithi035 ceph-mon[92535]: pgmap v162: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:21 smithi035 ceph-mon[92535]: pgmap v163: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:23 smithi035 ceph-mon[92535]: pgmap v164: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 13 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:25 smithi035 ceph-mon[92535]: pgmap v165: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:27 smithi035 ceph-mon[92535]: pgmap v166: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:52:42.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:52:42.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:52:42.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:52:42.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:52:42.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:30 smithi035 ceph-mon[92535]: pgmap v167: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:42.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:32 smithi035 ceph-mon[92535]: pgmap v168: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:42.996 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:33 smithi035 ceph-mon[92535]: pgmap v169: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:43.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:35 smithi035 ceph-mon[92535]: pgmap v170: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:43.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:37 smithi035 ceph-mon[92535]: pgmap v171: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:43.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:39 smithi035 ceph-mon[92535]: pgmap v172: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:43.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:41 smithi035 ceph-mon[92535]: pgmap v173: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:43.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:44 smithi035 ceph-mon[92535]: pgmap v174: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:43.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:45 smithi035 ceph-mon[92535]: pgmap v175: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:47 smithi035 ceph-mon[92535]: pgmap v176: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:44.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:49 smithi035 ceph-mon[92535]: pgmap v177: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:52 smithi035 ceph-mon[92535]: pgmap v178: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:54 smithi035 ceph-mon[92535]: pgmap v179: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:44.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:55 smithi035 ceph-mon[92535]: pgmap v180: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:51:57 smithi035 ceph-mon[92535]: pgmap v181: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:44.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:00 smithi035 ceph-mon[92535]: pgmap v182: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.462 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:02 smithi035 ceph-mon[92535]: pgmap v183: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:04 smithi035 ceph-mon[92535]: pgmap v184: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:05 smithi035 ceph-mon[92535]: pgmap v185: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:08 smithi035 ceph-mon[92535]: pgmap v186: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:10 smithi035 ceph-mon[92535]: pgmap v187: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:12 smithi035 ceph-mon[92535]: pgmap v188: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:14 smithi035 ceph-mon[92535]: pgmap v189: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:15 smithi035 ceph-mon[92535]: pgmap v190: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:52:44.463 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:18 smithi035 ceph-mon[92535]: pgmap v191: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:52:44.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:20 smithi035 ceph-mon[92535]: pgmap v192: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:52:44.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:22 smithi035 ceph-mon[92535]: pgmap v193: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:52:44.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:24 smithi035 ceph-mon[92535]: pgmap v194: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:52:44.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:25 smithi035 ceph-mon[92535]: pgmap v195: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:44.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:28 smithi035 ceph-mon[92535]: pgmap v196: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:45.205 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:52:45.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:30 smithi035 ceph-mon[92535]: pgmap v197: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:45.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:52:45.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:52:45.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:52:45.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:32 smithi035 ceph-mon[92535]: pgmap v198: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:45.206 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:34 smithi035 ceph-mon[92535]: pgmap v199: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:48.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:35 smithi035 ceph-mon[92535]: pgmap v200: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:48.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:38 smithi035 ceph-mon[92535]: pgmap v201: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:48.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:40 smithi035 ceph-mon[92535]: pgmap v202: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:48.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:42 smithi078 ceph-mon[94114]: pgmap v203: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:48.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:44 smithi078 ceph-mon[94114]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:52:48.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:44 smithi078 ceph-mon[94114]: pgmap v204: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:48.655 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:45 smithi078 ceph-mon[94114]: pgmap v205: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:48.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:42 smithi082 ceph-mon[94281]: pgmap v203: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:48.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:44 smithi082 ceph-mon[94281]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:52:48.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:44 smithi082 ceph-mon[94281]: pgmap v204: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:52:48.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:45 smithi082 ceph-mon[94281]: pgmap v205: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:52:48.657 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:48 smithi078 ceph-mon[94114]: pgmap v206: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:52:49.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:48 smithi082 ceph-mon[94281]: pgmap v206: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:52:49.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 -- 172.21.15.35:0/1837798875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75480ff380 msgr2=0x7f75480ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:52.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 --2- 172.21.15.35:0/1837798875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75480ff380 0x7f75480ff750 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f75380099c0 tx=0x7f7538009cd0 comp rx=0 tx=0).stop 2023-03-17T08:52:52.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 -- 172.21.15.35:0/1837798875 shutdown_connections 2023-03-17T08:52:52.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 --2- 172.21.15.35:0/1837798875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75481043c0 0x7f754810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:52.041 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 --2- 172.21.15.35:0/1837798875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75480ff380 0x7f75480ff750 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 --2- 172.21.15.35:0/1837798875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 0x7f7548103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 -- 172.21.15.35:0/1837798875 >> 172.21.15.35:0/1837798875 conn(0x7f7548076300 msgr2=0x7f7548076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 -- 172.21.15.35:0/1837798875 shutdown_connections 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.304+0000 7f754e247700 1 -- 172.21.15.35:0/1837798875 wait complete. 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.305+0000 7f754e247700 1 Processor -- start 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.305+0000 7f754e247700 1 -- start start 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.305+0000 7f754e247700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ff380 0x7f75481951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.305+0000 7f754e247700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 0x7f7548195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.305+0000 7f754e247700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75481043c0 0x7f7548199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f754e247700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754819a1c0 con 0x7f75481043c0 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f754e247700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754819a330 con 0x7f75480ff380 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f754e247700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754819a4f0 con 0x7f75480ffd20 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7547fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75481043c0 0x7f7548199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7546ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 0x7f7548195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7547fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75481043c0 0x7f7548199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42530/0 (socket says 172.21.15.35:42530) 2023-03-17T08:52:52.042 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7547fff700 1 -- 172.21.15.35:0/1160527362 learned_addr learned my addr 172.21.15.35:0/1160527362 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f75477fe700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ff380 0x7f75481951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7546ffd700 1 -- 172.21.15.35:0/1160527362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ff380 msgr2=0x7f75481951e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7546ffd700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ff380 0x7f75481951e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7546ffd700 1 -- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75481043c0 msgr2=0x7f7548199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7546ffd700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75481043c0 0x7f7548199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.306+0000 7f7546ffd700 1 -- 172.21.15.35:0/1160527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380095f0 con 0x7f75480ffd20 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.307+0000 7f7546ffd700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 0x7f7548195720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f754806a370 tx=0x7f753c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.307+0000 7f7544ff9700 1 -- 172.21.15.35:0/1160527362 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00f890 con 0x7f75480ffd20 2023-03-17T08:52:52.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.307+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754810f030 con 0x7f75480ffd20 2023-03-17T08:52:52.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.307+0000 7f7544ff9700 1 -- 172.21.15.35:0/1160527362 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f753c00fe80 con 0x7f75480ffd20 2023-03-17T08:52:52.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.307+0000 7f7544ff9700 1 -- 172.21.15.35:0/1160527362 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c019360 con 0x7f75480ffd20 2023-03-17T08:52:54.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.307+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754810eea0 con 0x7f75480ffd20 2023-03-17T08:52:54.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:50 smithi078 ceph-mon[94114]: pgmap v207: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:52:55.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:52 smithi078 ceph-mon[94114]: pgmap v208: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:52:57.534 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:54 smithi078 ceph-mon[94114]: pgmap v209: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:52:57.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:50 smithi082 ceph-mon[94281]: pgmap v207: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:52:57.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:52 smithi082 ceph-mon[94281]: pgmap v208: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:52:58.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:54 smithi082 ceph-mon[94281]: pgmap v209: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 -- 172.21.15.35:0/2394284893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ff350 msgr2=0x7f1dac0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 --2- 172.21.15.35:0/2394284893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ff350 0x7f1dac0ff720 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009990 tx=0x7f1da0009ca0 comp rx=0 tx=0).stop 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 -- 172.21.15.35:0/2394284893 shutdown_connections 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 --2- 172.21.15.35:0/2394284893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac104390 0x7f1dac10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 --2- 172.21.15.35:0/2394284893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ff350 0x7f1dac0ff720 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 --2- 172.21.15.35:0/2394284893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 -- 172.21.15.35:0/2394284893 >> 172.21.15.35:0/2394284893 conn(0x7f1dac076330 msgr2=0x7f1dac076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 -- 172.21.15.35:0/2394284893 shutdown_connections 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 -- 172.21.15.35:0/2394284893 wait complete. 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 Processor -- start 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.308+0000 7f1db2f57700 1 -- start start 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db2f57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac0ff350 0x7f1dac198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:58.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db2f57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db2f57700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac104390 0x7f1dac19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db2f57700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac19d430 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db2f57700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac19d5a0 con 0x7f1dac104390 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db2f57700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac19d760 con 0x7f1dac0ff350 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42536/0 (socket says 172.21.15.35:42536) 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db0cf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac0ff350 0x7f1dac198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 -- 172.21.15.35:0/1208088093 learned_addr learned my addr 172.21.15.35:0/1208088093 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db14f4700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac104390 0x7f1dac19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 -- 172.21.15.35:0/1208088093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac0ff350 msgr2=0x7f1dac198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac0ff350 0x7f1dac198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 -- 172.21.15.35:0/1208088093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac104390 msgr2=0x7f1dac19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac104390 0x7f1dac19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 -- 172.21.15.35:0/1208088093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00095f0 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1db0cf3700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac0ff350 0x7f1dac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.309+0000 7f1dabfff700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac198990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e940 tx=0x7f1d9800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.310+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98009730 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.310+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac10df30 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.310+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d9800ce70 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.310+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98018420 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.310+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac10dda0 con 0x7f1dac0ffcf0 2023-03-17T08:52:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f7544ff9700 1 -- 172.21.15.35:0/1160527362 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f753c00f9f0 con 0x7f75480ffd20 2023-03-17T08:52:58.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 Processor -- start 2023-03-17T08:52:59.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 -- start start 2023-03-17T08:52:59.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac10e0c0 con 0x7f1dac0ffcf0 2023-03-17T08:53:00.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:55 smithi078 ceph-mon[94114]: pgmap v210: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:53:00.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:52:58 smithi078 ceph-mon[94114]: pgmap v211: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:53:00.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:00 smithi078 ceph-mon[94114]: pgmap v212: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:00.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:55 smithi082 ceph-mon[94281]: pgmap v210: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:53:00.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:52:58 smithi082 ceph-mon[94281]: pgmap v211: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:53:01.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:00 smithi082 ceph-mon[94281]: pgmap v212: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbce7d0 0x564edbbceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbd3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbad5070 con 0x564edbbd3630 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbb279b0 con 0x564edbbcf0e0 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbb20e40 con 0x564edbbce7d0 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.311+0000 7f7544ff9700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f753009f6c0 0x7f75300a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:01.379 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbd3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:01.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbd3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42544/0 (socket says 172.21.15.35:42544) 2023-03-17T08:53:01.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 -- 172.21.15.35:0/3562010353 learned_addr learned my addr 172.21.15.35:0/3562010353 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:53:01.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7547fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbce7d0 0x564edbbceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:01.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f75477fe700 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:01.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7547fff700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f753009f6c0 0x7f75300a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:01.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7544ff9700 1 -- 172.21.15.35:0/1160527362 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f753c0ca380 con 0x7f75480ffd20 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 -- 172.21.15.35:0/3562010353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbce7d0 msgr2=0x564edbbceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbce7d0 0x564edbbceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 -- 172.21.15.35:0/3562010353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 msgr2=0x564edbbd30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 -- 172.21.15.35:0/3562010353 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564edb9a2630 con 0x564edbbd3630 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7547fff700 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbce7d0 0x564edbbceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f75477fe700 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbd3a80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f753c010a30 tx=0x7f753c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea74030323172a7e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:53:03.188 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.312+0000 7f7547fff700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f753009f6c0 0x7f75300a1b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7540009fd0 tx=0x7f75400091b0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:53:03.189 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.313+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1d9800c9e0 con 0x7f1dac0ffcf0 2023-03-17T08:53:04.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.313+0000 7f1da9ffb700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d9c09f640 0x7f1d9c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:04.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.314+0000 7f1db0cf3700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d9c09f640 0x7f1d9c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:04.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.314+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f1d98014070 con 0x7f1dac0ffcf0 2023-03-17T08:53:04.226 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.314+0000 7f1db0cf3700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d9c09f640 0x7f1d9c0a1af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1da0006010 tx=0x7f1da000b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:53:07.647 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.317+0000 7f752dffb700 1 -- 172.21.15.35:0/3562010353 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c00fca0 con 0x564edbbd3630 2023-03-17T08:53:07.647 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.317+0000 7f752dffb700 1 -- 172.21.15.35:0/3562010353 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f753c097e00 con 0x564edbbd3630 2023-03-17T08:53:07.648 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.317+0000 7f752dffb700 1 -- 172.21.15.35:0/3562010353 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c007c90 con 0x564edbbd3630 2023-03-17T08:53:07.648 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.317+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f1d98094860 con 0x7f1dac0ffcf0 2023-03-17T08:53:07.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:02 smithi078 ceph-mon[94114]: pgmap v213: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:07.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:04 smithi078 ceph-mon[94114]: pgmap v214: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:53:07.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:05 smithi078 ceph-mon[94114]: pgmap v215: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:07.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:02 smithi082 ceph-mon[94281]: pgmap v213: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:07.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:04 smithi082 ceph-mon[94281]: pgmap v214: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:53:07.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:05 smithi082 ceph-mon[94281]: pgmap v215: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:07.655 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3562010353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 msgr2=0x564edbbd3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:09.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbd3a80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f753c010a30 tx=0x7f753c000bc0 comp rx=0 tx=0).stop 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3562010353 shutdown_connections 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbd3a80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbce7d0 0x564edbbceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3562010353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3562010353 >> 172.21.15.35:0/3562010353 conn(0x564edbbc9030 msgr2=0x564edbbc9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3562010353 shutdown_connections 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.318+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3562010353 wait complete. 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.319+0000 7f755a3d4b80 1 -- start start 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.319+0000 7f755a3d4b80 1 Processor -- start 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.319+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.319+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:10.687 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.319+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:12.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.319+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edb9a4920 con 0x564edbbce7d0 2023-03-17T08:53:12.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbdb230 con 0x564edbbcf0e0 2023-03-17T08:53:12.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbe4820 con 0x564edbbd3630 2023-03-17T08:53:12.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f755a3d4b80 10 client.0 _ll_register_callbacks cb 0x564edb9c6290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:53:12.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:12.306 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42550/0 (socket says 172.21.15.35:42550) 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 -- 172.21.15.35:0/3590560517 learned_addr learned my addr 172.21.15.35:0/3590560517 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f7547fff700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 -- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 msgr2=0x564edbbd8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 -- 172.21.15.35:0/3590560517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 msgr2=0x564edbbd85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 -- 172.21.15.35:0/3590560517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754810eea0 con 0x564edbbce7d0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f75477fe700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8090 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f75380099c0 tx=0x7f7538005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccb3747900aa1a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f7526ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f7526ffd700 1 -- 172.21.15.35:0/3590560517 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538023e60 con 0x564edbbce7d0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f7526ffd700 1 -- 172.21.15.35:0/3590560517 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f753800b790 con 0x564edbbce7d0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.320+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564edbae33f0 con 0x564edbbce7d0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f7526ffd700 1 -- 172.21.15.35:0/3590560517 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f753800b950 con 0x564edbbce7d0 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 10 client.15492 fetch_fsmap learned FSMap version 29 2023-03-17T08:53:12.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564edb94ede0 con 0x564edbbce7d0 2023-03-17T08:53:12.308 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f7526ffd700 1 -- 172.21.15.35:0/3590560517 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564edbae33f0 con 0x564edbbce7d0 2023-03-17T08:53:12.308 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f7526ffd700 1 -- 172.21.15.35:0/3590560517 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7538004b80 con 0x564edbbce7d0 2023-03-17T08:53:12.308 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 10 client.15492 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:53:12.308 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 10 client.15492 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-17T08:53:12.308 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 20 client.15492 populate_metadata read hostname 'smithi035' 2023-03-17T08:53:12.308 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbbe8940 0x564edbbead50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 4 client.15492 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564edbaef660 con 0x564edbbe8940 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.321+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbbe8940 0x564edbbead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.322+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbbe8940 0x564edbbead50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa9b38ea5f02467b server_cookie=3bec07ec1a4910a1 in_seq=0 out_seq=0 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.322+0000 7f7526ffd700 10 client.15492 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.322+0000 7f7526ffd700 1 -- 172.21.15.35:0/3590560517 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564edbaef660 con 0x564edbbe8940 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f7526ffd700 10 client.15492 handle_command_reply: tid=0 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 client.15492 shutdown 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 msgr2=0x564edbbd8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8090 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f75380099c0 tx=0x7f7538005270 comp rx=0 tx=0).stop 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 shutdown_connections 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbbe8940 0x564edbbead50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8090 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3590560517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbd85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f7526ffd700 0 client.15492 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 >> 172.21.15.35:0/3590560517 conn(0x564edbbc9030 msgr2=0x564edbbc8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 shutdown_connections 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3590560517 wait complete. 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.323+0000 7f755a3d4b80 20 client.15492 trim_cache size 0 max 16384 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.336+0000 7f755a3d4b80 1 Processor -- start 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.336+0000 7f755a3d4b80 1 -- start start 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbe3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbc15b0 con 0x564edbbce7d0 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbcb0e0 con 0x564edbbcf0e0 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbcf700 con 0x564edbbd3630 2023-03-17T08:53:13.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42558/0 (socket says 172.21.15.35:42558) 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 -- 172.21.15.35:0/2188957623 learned_addr learned my addr 172.21.15.35:0/2188957623 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f7547fff700 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f7546ffd700 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbe3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 -- 172.21.15.35:0/2188957623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 msgr2=0x564edbbd27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 -- 172.21.15.35:0/2188957623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 msgr2=0x564edbbe3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbe3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 -- 172.21.15.35:0/2188957623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564edbae7190 con 0x564edbbce7d0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f75477fe700 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7538006010 tx=0x7f7538005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f87bae0f1f23f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f752e7fc700 1 -- 172.21.15.35:0/2188957623 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538003910 con 0x564edbbce7d0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f752e7fc700 1 -- 172.21.15.35:0/2188957623 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7538029040 con 0x564edbbce7d0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.337+0000 7f752e7fc700 1 -- 172.21.15.35:0/2188957623 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380163a0 con 0x564edbbce7d0 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 -- 172.21.15.35:0/2188957623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 msgr2=0x564edbbd8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:13.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7538006010 tx=0x7f7538005a20 comp rx=0 tx=0).stop 2023-03-17T08:53:13.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 -- 172.21.15.35:0/2188957623 shutdown_connections 2023-03-17T08:53:13.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbd3630 0x564edbbd27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbce7d0 0x564edbbd8910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/2188957623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbcf0e0 0x564edbbe3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:13.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 -- 172.21.15.35:0/2188957623 >> 172.21.15.35:0/2188957623 conn(0x564edbbc9030 msgr2=0x564edbbc8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:53:14.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 -- 172.21.15.35:0/2188957623 shutdown_connections 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.338+0000 7f755a3d4b80 1 -- 172.21.15.35:0/2188957623 wait complete. 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 -- start start 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 Processor -- start 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbce7d0 0x564edbbdf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbcf0e0 0x564edbbdd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:14.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbdfda0 con 0x564edbbd3630 2023-03-17T08:53:15.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbde270 con 0x564edbbce7d0 2023-03-17T08:53:15.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564edbbde3e0 con 0x564edbbcf0e0 2023-03-17T08:53:15.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f755a3d4b80 10 client.0 _ll_register_callbacks cb 0x564edb9c6290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:53:15.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f7547fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:15.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f7547fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbddd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42568/0 (socket says 172.21.15.35:42568) 2023-03-17T08:53:15.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f7547fff700 1 -- 172.21.15.35:0/3718095450 learned_addr learned my addr 172.21.15.35:0/3718095450 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:53:15.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f75477fe700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbce7d0 0x564edbbdf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:21.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.339+0000 7f7546ffd700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbcf0e0 0x564edbbdd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:21.277 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7547fff700 1 -- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbcf0e0 msgr2=0x564edbbdd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7547fff700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbcf0e0 0x564edbbdd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7547fff700 1 -- 172.21.15.35:0/3718095450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbce7d0 msgr2=0x564edbbdf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7547fff700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbce7d0 0x564edbbdf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7547fff700 1 -- 172.21.15.35:0/3718095450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564edb94ede0 con 0x564edbbd3630 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f75477fe700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbce7d0 0x564edbbdf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7547fff700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbddd30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f75400090a0 tx=0x7f7540004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2740f1ea14915734 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7526ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7526ffd700 1 -- 172.21.15.35:0/3718095450 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540021070 con 0x564edbbd3630 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564edbb9e240 con 0x564edbbd3630 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7526ffd700 1 -- 172.21.15.35:0/3718095450 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f7540004bb0 con 0x564edbbd3630 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7526ffd700 1 -- 172.21.15.35:0/3718095450 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7540004d70 con 0x564edbbd3630 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f755a3d4b80 10 client.15498 fetch_fsmap learned FSMap version 29 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564edb975250 con 0x564edbbd3630 2023-03-17T08:53:23.083 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7526ffd700 1 -- 172.21.15.35:0/3718095450 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564edbb9e240 con 0x564edbbd3630 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.340+0000 7f7526ffd700 1 -- 172.21.15.35:0/3718095450 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f75400289b0 con 0x564edbbd3630 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 10 client.15498 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 10 client.15498 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 20 client.15498 populate_metadata read hostname 'smithi035' 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbc3dba0 0x564edbc3ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 4 client.15498 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564edb9a4f60 con 0x564edbc3dba0 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f75477fe700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbc3dba0 0x564edbc3ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f7526ffd700 10 client.15498 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f75477fe700 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbc3dba0 0x564edbc3ffb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d66d1443ccea1418 server_cookie=8873cc9db3301589 in_seq=0 out_seq=0 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f7526ffd700 1 -- 172.21.15.35:0/3718095450 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564edb9a4f60 con 0x564edbc3dba0 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f7526ffd700 10 client.15498 handle_command_reply: tid=0 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.341+0000 7f755a3d4b80 1 client.15498 shutdown 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 msgr2=0x564edbbddd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbddd30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f75400090a0 tx=0x7f7540004b40 comp rx=0 tx=0).stop 2023-03-17T08:53:23.084 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 shutdown_connections 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x564edbc3dba0 0x564edbc3ffb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564edbbd3630 0x564edbbddd30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564edbbce7d0 0x564edbbdf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f7526ffd700 0 client.15498 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 --2- 172.21.15.35:0/3718095450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564edbbcf0e0 0x564edbbdd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 >> 172.21.15.35:0/3718095450 conn(0x564edbbc9030 msgr2=0x564edbbe3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 shutdown_connections 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 1 -- 172.21.15.35:0/3718095450 wait complete. 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f755a3d4b80 20 client.15498 trim_cache size 0 max 16384 2023-03-17T08:53:23.085 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T08:53:24.989 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f753009f6c0 msgr2=0x7f75300a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f753009f6c0 0x7f75300a1b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7540009fd0 tx=0x7f75400091b0 comp rx=0 tx=0).stop 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 msgr2=0x7f7548195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 0x7f7548195720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f754806a370 tx=0x7f753c00dc30 comp rx=0 tx=0).stop 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 shutdown_connections 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f753009f6c0 0x7f75300a1b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75481043c0 0x7f7548199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:26.893 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ff380 0x7f75481951e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:26.896 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 --2- 172.21.15.35:0/1160527362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75480ffd20 0x7f7548195720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:26.896 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 >> 172.21.15.35:0/1160527362 conn(0x7f7548076300 msgr2=0x7f7548103550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:53:26.897 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.342+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 shutdown_connections 2023-03-17T08:53:26.897 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.343+0000 7f754e247700 1 -- 172.21.15.35:0/1160527362 wait complete. 2023-03-17T08:53:26.897 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:42 smithi035 ceph-mon[92535]: pgmap v203: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:28.237 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-03-17T08:53:30.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.552+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 --> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1dac1998b0 con 0x7f1d9c09f640 2023-03-17T08:53:30.014 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.559+0000 7f1da9ffb700 1 -- 172.21.15.35:0/1208088093 <== mgr.15318 v2:172.21.15.35:6800/1224511514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f1dac1998b0 con 0x7f1d9c09f640 2023-03-17T08:53:30.014 INFO:teuthology.orchestra.run.smithi035.stdout:/ 1M 6M3h 2023-03-17T08:53:30.016 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d9c09f640 msgr2=0x7f1d9c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:30.016 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d9c09f640 0x7f1d9c0a1af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1da0006010 tx=0x7f1da000b260 comp rx=0 tx=0).stop 2023-03-17T08:53:30.016 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 msgr2=0x7f1dac198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:30.016 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac198990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e940 tx=0x7f1d9800ec50 comp rx=0 tx=0).stop 2023-03-17T08:53:30.016 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 shutdown_connections 2023-03-17T08:53:30.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d9c09f640 0x7f1d9c0a1af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:30.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac104390 0x7f1dac19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:30.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dac0ff350 0x7f1dac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:30.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 --2- 172.21.15.35:0/1208088093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1dac0ffcf0 0x7f1dac198990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:30.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 >> 172.21.15.35:0/1208088093 conn(0x7f1dac076330 msgr2=0x7f1dac0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:53:30.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 shutdown_connections 2023-03-17T08:53:30.794 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:52:42.561+0000 7f1db2f57700 1 -- 172.21.15.35:0/1208088093 wait complete. 2023-03-17T08:53:30.795 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-03-17T08:53:30.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:08 smithi078 ceph-mon[94114]: pgmap v216: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:53:30.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:10 smithi078 ceph-mon[94114]: pgmap v217: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:30.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:12 smithi078 ceph-mon[94114]: pgmap v218: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:14 smithi078 ceph-mon[94114]: pgmap v219: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:15 smithi078 ceph-mon[94114]: pgmap v220: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:18 smithi078 ceph-mon[94114]: pgmap v221: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:20 smithi078 ceph-mon[94114]: pgmap v222: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:22 smithi078 ceph-mon[94114]: pgmap v223: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:24 smithi078 ceph-mon[94114]: pgmap v224: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:53:31.440 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:25 smithi078 ceph-mon[94114]: pgmap v225: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:28 smithi078 ceph-mon[94114]: pgmap v226: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:30 smithi078 ceph-mon[94114]: pgmap v227: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:08 smithi082 ceph-mon[94281]: pgmap v216: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:10 smithi082 ceph-mon[94281]: pgmap v217: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:31.441 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:12 smithi082 ceph-mon[94281]: pgmap v218: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:31.443 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:14 smithi082 ceph-mon[94281]: pgmap v219: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:53:31.443 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:15 smithi082 ceph-mon[94281]: pgmap v220: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:53:31.443 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:18 smithi082 ceph-mon[94281]: pgmap v221: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:53:31.443 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:20 smithi082 ceph-mon[94281]: pgmap v222: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:53:31.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:22 smithi082 ceph-mon[94281]: pgmap v223: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:53:31.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:24 smithi082 ceph-mon[94281]: pgmap v224: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:53:33.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:25 smithi082 ceph-mon[94281]: pgmap v225: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:33.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:28 smithi082 ceph-mon[94281]: pgmap v226: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:33.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:30 smithi082 ceph-mon[94281]: pgmap v227: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:33.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:53:33.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:53:33.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:53:33.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:53:33.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:32 smithi082 ceph-mon[94281]: pgmap v228: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:32 smithi078 ceph-mon[94114]: pgmap v228: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:44 smithi035 ceph-mon[92535]: from='client.15486 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:44 smithi035 ceph-mon[92535]: pgmap v204: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:45 smithi035 ceph-mon[92535]: pgmap v205: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:48 smithi035 ceph-mon[92535]: pgmap v206: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:50 smithi035 ceph-mon[92535]: pgmap v207: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:52 smithi035 ceph-mon[92535]: pgmap v208: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:54 smithi035 ceph-mon[92535]: pgmap v209: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:53:34.946 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:55 smithi035 ceph-mon[92535]: pgmap v210: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:52:58 smithi035 ceph-mon[92535]: pgmap v211: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:00 smithi035 ceph-mon[92535]: pgmap v212: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:02 smithi035 ceph-mon[92535]: pgmap v213: 97 pgs: 97 active+clean; 1.3 MiB data, 86 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:04 smithi035 ceph-mon[92535]: pgmap v214: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:05 smithi035 ceph-mon[92535]: pgmap v215: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:08 smithi035 ceph-mon[92535]: pgmap v216: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:10 smithi035 ceph-mon[92535]: pgmap v217: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:12 smithi035 ceph-mon[92535]: pgmap v218: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:14 smithi035 ceph-mon[92535]: pgmap v219: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:15 smithi035 ceph-mon[92535]: pgmap v220: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:18 smithi035 ceph-mon[92535]: pgmap v221: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:20 smithi035 ceph-mon[92535]: pgmap v222: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:22 smithi035 ceph-mon[92535]: pgmap v223: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:24 smithi035 ceph-mon[92535]: pgmap v224: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:25 smithi035 ceph-mon[92535]: pgmap v225: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:28 smithi035 ceph-mon[92535]: pgmap v226: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:30 smithi035 ceph-mon[92535]: pgmap v227: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.947 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:53:34.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:53:34.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:53:34.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:53:34.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:32 smithi035 ceph-mon[92535]: pgmap v228: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:34.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:34 smithi035 ceph-mon[92535]: pgmap v229: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:34.949 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:34 smithi082 ceph-mon[94281]: pgmap v229: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:34.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:34 smithi078 ceph-mon[94114]: pgmap v229: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:34.984 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-03-17T08:53:36.427 INFO:teuthology.run_tasks:Running task background_exec... 2023-03-17T08:53:37.841 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T08:53:38.637 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-03-17T08:53:40.754 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:35 smithi078 ceph-mon[94114]: pgmap v230: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:43.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:38 smithi078 ceph-mon[94114]: pgmap v231: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:43.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:40 smithi078 ceph-mon[94114]: pgmap v232: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:44.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:35 smithi082 ceph-mon[94281]: pgmap v230: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:44.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:38 smithi082 ceph-mon[94281]: pgmap v231: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:44.531 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:40 smithi082 ceph-mon[94281]: pgmap v232: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:44.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:42 smithi078 ceph-mon[94114]: pgmap v233: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:47.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:44 smithi078 ceph-mon[94114]: pgmap v234: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:49.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:42 smithi082 ceph-mon[94281]: pgmap v233: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:49.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:44 smithi082 ceph-mon[94281]: pgmap v234: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:49.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:45 smithi078 ceph-mon[94114]: pgmap v235: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:51.084 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:48 smithi078 ceph-mon[94114]: pgmap v236: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:51.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:45 smithi082 ceph-mon[94281]: pgmap v235: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:51.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:48 smithi082 ceph-mon[94281]: pgmap v236: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:51.087 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:50 smithi078 ceph-mon[94114]: pgmap v237: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:53.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:50 smithi082 ceph-mon[94281]: pgmap v237: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:53.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:52 smithi078 ceph-mon[94114]: pgmap v238: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:56.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:52 smithi082 ceph-mon[94281]: pgmap v238: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:56.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:54 smithi078 ceph-mon[94114]: pgmap v239: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:58.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:54 smithi082 ceph-mon[94281]: pgmap v239: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:53:58.369 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:55 smithi078 ceph-mon[94114]: pgmap v240: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:58.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:55 smithi082 ceph-mon[94281]: pgmap v240: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:53:58.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 -- 172.21.15.35:0/3494235814 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 msgr2=0x7ff6a010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:53:58.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 --2- 172.21.15.35:0/3494235814 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a010bf90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff69800b0d0 tx=0x7ff69800b3e0 comp rx=0 tx=0).stop 2023-03-17T08:53:58.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 -- 172.21.15.35:0/3494235814 shutdown_connections 2023-03-17T08:53:58.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 --2- 172.21.15.35:0/3494235814 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a010bf90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:53:58.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 --2- 172.21.15.35:0/3494235814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 0x7ff6a00ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:00.239 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 --2- 172.21.15.35:0/3494235814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 0x7ff6a0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:00.239 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 -- 172.21.15.35:0/3494235814 >> 172.21.15.35:0/3494235814 conn(0x7ff6a0076300 msgr2=0x7ff6a0076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 -- 172.21.15.35:0/3494235814 shutdown_connections 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.084+0000 7ff6a668d700 1 -- 172.21.15.35:0/3494235814 wait complete. 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 Processor -- start 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 -- start start 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 0x7ff6a0100d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 0x7ff6a01012c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a01a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0101af0 con 0x7ff6a01043c0 2023-03-17T08:54:00.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a01a4af0 con 0x7ff6a00ff380 2023-03-17T08:54:01.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a668d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a01a4c30 con 0x7ff6a00ffd20 2023-03-17T08:54:01.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.085+0000 7ff6a4c2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a01a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:01.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a01a45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42582/0 (socket says 172.21.15.35:42582) 2023-03-17T08:54:01.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1709564992 learned_addr learned my addr 172.21.15.35:0/1709564992 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:01.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69ffff700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 0x7ff6a0100d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:01.128 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 0x7ff6a01012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1709564992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 msgr2=0x7ff6a01012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 0x7ff6a01012c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1709564992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 msgr2=0x7ff6a0100d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 0x7ff6a0100d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1709564992 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698009d00 con 0x7ff6a01043c0 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 0x7ff6a01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:54:01.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69ffff700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 0x7ff6a0100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a01a45b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff698008ec0 tx=0x7ff698008fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69d7fa700 1 -- 172.21.15.35:0/1709564992 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800e040 con 0x7ff6a01043c0 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69d7fa700 1 -- 172.21.15.35:0/1709564992 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff698003c00 con 0x7ff6a01043c0 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a010eff0 con 0x7ff6a01043c0 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff69d7fa700 1 -- 172.21.15.35:0/1709564992 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69801b730 con 0x7ff6a01043c0 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.086+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a010ee60 con 0x7ff6a01043c0 2023-03-17T08:54:02.061 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.089+0000 7ff69d7fa700 1 -- 172.21.15.35:0/1709564992 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff698005080 con 0x7ff6a01043c0 2023-03-17T08:54:06.636 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.090+0000 7ff69d7fa700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff68809f640 0x7ff6880a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.090+0000 7ff69ffff700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff68809f640 0x7ff6880a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.090+0000 7ff69d7fa700 1 -- 172.21.15.35:0/1709564992 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7ff6980cb3c0 con 0x7ff6a01043c0 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.090+0000 7ff69ffff700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff68809f640 0x7ff6880a1af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff690005950 tx=0x7ff6900058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.090+0000 7ff6b281ab80 1 Processor -- start 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 -- start start 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac8dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac920f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac92a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:06.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8ab94070 con 0x563c8ac92630 2023-03-17T08:54:08.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8abe69b0 con 0x563c8ac8d7d0 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8abdfe40 con 0x563c8ac8e0e0 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac92a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac92a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42590/0 (socket says 172.21.15.35:42590) 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1336887236 learned_addr learned my addr 172.21.15.35:0/1336887236 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff69ffff700 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac8dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1336887236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 msgr2=0x563c8ac920f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac920f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:08.913 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1336887236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 msgr2=0x563c8ac8dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac8dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/1336887236 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c8aa61630 con 0x563c8ac92630 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.091+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac92a80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6980a0b00 tx=0x7ff698098d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f188de9cdc2465 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6867fc700 1 -- 172.21.15.35:0/1336887236 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698098ed0 con 0x563c8ac92630 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6867fc700 1 -- 172.21.15.35:0/1336887236 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6980a1030 con 0x563c8ac92630 2023-03-17T08:54:08.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6867fc700 1 -- 172.21.15.35:0/1336887236 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698099130 con 0x563c8ac92630 2023-03-17T08:54:11.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 -- 172.21.15.35:0/1336887236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 msgr2=0x563c8ac92a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:11.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac92a80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6980a0b00 tx=0x7ff698098d20 comp rx=0 tx=0).stop 2023-03-17T08:54:11.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 -- 172.21.15.35:0/1336887236 shutdown_connections 2023-03-17T08:54:11.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac92a80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:11.362 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac8dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/1336887236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 -- 172.21.15.35:0/1336887236 >> 172.21.15.35:0/1336887236 conn(0x563c8ac88030 msgr2=0x563c8ac88400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 -- 172.21.15.35:0/1336887236 shutdown_connections 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.092+0000 7ff6b281ab80 1 -- 172.21.15.35:0/1336887236 wait complete. 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 -- start start 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 Processor -- start 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8d7d0 0x563c8ac970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 0x563c8ac97620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac97b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8aa63920 con 0x563c8ac8e0e0 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8aca3610 con 0x563c8ac92630 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8aca3750 con 0x563c8ac8d7d0 2023-03-17T08:54:14.119 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff6b281ab80 10 client.0 _ll_register_callbacks cb 0x563c8aa85290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:54:15.329 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff69f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 0x563c8ac97620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:15.330 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.093+0000 7ff69f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 0x563c8ac97620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42594/0 (socket says 172.21.15.35:42594) 2023-03-17T08:54:15.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 -- 172.21.15.35:0/3706428024 learned_addr learned my addr 172.21.15.35:0/3706428024 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:15.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69ffff700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8d7d0 0x563c8ac970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:15.710 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac97b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:16.370 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 -- 172.21.15.35:0/3706428024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8d7d0 msgr2=0x563c8ac970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:16.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8d7d0 0x563c8ac970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:16.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 -- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 msgr2=0x563c8ac97b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:16.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac97b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:16.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 -- 172.21.15.35:0/3706428024 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a010ee60 con 0x563c8ac8e0e0 2023-03-17T08:54:16.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69ffff700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8d7d0 0x563c8ac970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:54:16.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac97b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 0x563c8ac97620 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff694010650 tx=0x7ff694010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a694d1be4e8395 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff67f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff67f7fe700 1 -- 172.21.15.35:0/3706428024 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694004220 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff67f7fe700 1 -- 172.21.15.35:0/3706428024 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7ff694017070 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c8aba23f0 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff67f7fe700 1 -- 172.21.15.35:0/3706428024 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff694004380 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff6b281ab80 10 client.15510 fetch_fsmap learned FSMap version 29 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563c8aa0dde0 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.094+0000 7ff67f7fe700 1 -- 172.21.15.35:0/3706428024 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563c8aba23f0 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff67f7fe700 1 -- 172.21.15.35:0/3706428024 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff694003840 con 0x563c8ac8e0e0 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff6b281ab80 10 client.15510 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff6b281ab80 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:54:17.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff6b281ab80 20 client.15510 populate_metadata read hostname 'smithi035' 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8aca7730 0x563c8aca9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff6b281ab80 4 client.15510 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c8abae660 con 0x563c8aca7730 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff69ffff700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8aca7730 0x563c8aca9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff67f7fe700 10 client.15510 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.095+0000 7ff69ffff700 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8aca7730 0x563c8aca9b40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb40cd3cc9c55e7e server_cookie=32ae58bf5dd05d24 in_seq=0 out_seq=0 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff67f7fe700 1 -- 172.21.15.35:0/3706428024 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563c8abae660 con 0x563c8aca7730 2023-03-17T08:54:17.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff67f7fe700 10 client.15510 handle_command_reply: tid=0 2023-03-17T08:54:18.199 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 client.15510 shutdown 2023-03-17T08:54:18.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 msgr2=0x563c8ac97620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:18.202 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 0x563c8ac97620 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff694010650 tx=0x7ff694010a10 comp rx=0 tx=0).stop 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 shutdown_connections 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8aca7730 0x563c8aca9b40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac97b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8d7d0 0x563c8ac970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3706428024 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8e0e0 0x563c8ac97620 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff67f7fe700 0 client.15510 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.096+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 >> 172.21.15.35:0/3706428024 conn(0x563c8ac88030 msgr2=0x563c8ac87710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.097+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 shutdown_connections 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.097+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3706428024 wait complete. 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.097+0000 7ff6b281ab80 20 client.15510 trim_cache size 0 max 16384 2023-03-17T08:54:19.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 Processor -- start 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 -- start start 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac87710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac90710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8aca4160 con 0x563c8ac92630 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8ac97f20 con 0x563c8ac8d7d0 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8ac95090 con 0x563c8ac8e0e0 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac90710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac90710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42604/0 (socket says 172.21.15.35:42604) 2023-03-17T08:54:19.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/3479607250 learned_addr learned my addr 172.21.15.35:0/3479607250 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:20.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac87710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:20.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff69ffff700 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:20.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/3479607250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 msgr2=0x563c8ac87710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:20.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac87710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/3479607250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 msgr2=0x563c8ac979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 -- 172.21.15.35:0/3479607250 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c8aba6190 con 0x563c8ac92630 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.110+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac90710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff698009fd0 tx=0x7ff69800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a04c5ac968a1e5b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff686ffd700 1 -- 172.21.15.35:0/3479607250 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980a1030 con 0x563c8ac92630 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff686ffd700 1 -- 172.21.15.35:0/3479607250 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff698098ed0 con 0x563c8ac92630 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff686ffd700 1 -- 172.21.15.35:0/3479607250 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698097360 con 0x563c8ac92630 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3479607250 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 msgr2=0x563c8ac90710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac90710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff698009fd0 tx=0x7ff69800bf50 comp rx=0 tx=0).stop 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3479607250 shutdown_connections 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac92630 0x563c8ac90710 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac8d7d0 0x563c8ac979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/3479607250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac87710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:20.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3479607250 >> 172.21.15.35:0/3479607250 conn(0x563c8ac88030 msgr2=0x563c8aca3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3479607250 shutdown_connections 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.111+0000 7ff6b281ab80 1 -- 172.21.15.35:0/3479607250 wait complete. 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 -- start start 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 Processor -- start 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 0x563c8ac9e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac9e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac9a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:20.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8ac9ad70 con 0x563c8ac8d7d0 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8ac9aee0 con 0x563c8ac92630 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8ac9b0a0 con 0x563c8ac8e0e0 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6b281ab80 10 client.0 _ll_register_callbacks cb 0x563c8aa85290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff69ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 0x563c8ac9e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff69ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 0x563c8ac9e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42606/0 (socket says 172.21.15.35:42606) 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff69ffff700 1 -- 172.21.15.35:0/2059836849 learned_addr learned my addr 172.21.15.35:0/2059836849 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac9e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.112+0000 7ff6a4c2a700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac9a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff69ffff700 1 -- 172.21.15.35:0/2059836849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 msgr2=0x563c8ac9e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff69ffff700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac9e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff69ffff700 1 -- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 msgr2=0x563c8ac9a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff69ffff700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac9a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff69ffff700 1 -- 172.21.15.35:0/2059836849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c8aa61630 con 0x563c8ac8d7d0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff69ffff700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 0x563c8ac9e1a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff69000b5d0 tx=0x7ff690015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff715194d384ac3a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff67f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff67f7fe700 1 -- 172.21.15.35:0/2059836849 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690017040 con 0x563c8ac8d7d0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff67f7fe700 1 -- 172.21.15.35:0/2059836849 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7ff690004510 con 0x563c8ac8d7d0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c8ac5d240 con 0x563c8ac8d7d0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff67f7fe700 1 -- 172.21.15.35:0/2059836849 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff690028520 con 0x563c8ac8d7d0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff6b281ab80 10 client.15516 fetch_fsmap learned FSMap version 29 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563c8aa34250 con 0x563c8ac8d7d0 2023-03-17T08:54:21.018 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.113+0000 7ff67f7fe700 1 -- 172.21.15.35:0/2059836849 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563c8ac5d240 con 0x563c8ac8d7d0 2023-03-17T08:54:22.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff67f7fe700 1 -- 172.21.15.35:0/2059836849 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff690003b30 con 0x563c8ac8d7d0 2023-03-17T08:54:22.639 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 10 client.15516 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:54:23.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:54:23.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 20 client.15516 populate_metadata read hostname 'smithi035' 2023-03-17T08:54:24.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8acfc820 0x563c8acfec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:24.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 4 client.15516 mds_command: new command op to 24452 tid=0[{"prefix": "damage ls"}] 2023-03-17T08:54:24.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563c8aa63f60 con 0x563c8acfc820 2023-03-17T08:54:24.672 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8acfc820 0x563c8acfec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff67f7fe700 10 client.15516 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff69f7fe700 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8acfc820 0x563c8acfec30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae21dc5e29908cfa server_cookie=d7d37bc79b7c4c0a in_seq=0 out_seq=0 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff67f7fe700 1 -- 172.21.15.35:0/2059836849 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563c8aa63f60 con 0x563c8acfc820 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff67f7fe700 10 client.15516 handle_command_reply: tid=0 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.114+0000 7ff6b281ab80 1 client.15516 shutdown 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 msgr2=0x563c8ac9e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 0x563c8ac9e1a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff69000b5d0 tx=0x7ff690015000 comp rx=0 tx=0).stop 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 shutdown_connections 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c8acfc820 0x563c8acfec30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c8ac92630 0x563c8ac9a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c8ac8d7d0 0x563c8ac9e1a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff67f7fe700 0 client.15516 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:54:24.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 --2- 172.21.15.35:0/2059836849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c8ac8e0e0 0x563c8ac9e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:24.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 >> 172.21.15.35:0/2059836849 conn(0x563c8ac88030 msgr2=0x563c8aca3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:24.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 shutdown_connections 2023-03-17T08:54:24.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 1 -- 172.21.15.35:0/2059836849 wait complete. 2023-03-17T08:54:24.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6b281ab80 20 client.15516 trim_cache size 0 max 16384 2023-03-17T08:54:24.674 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T08:54:25.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff68809f640 msgr2=0x7ff6880a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:26.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff68809f640 0x7ff6880a1af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff690005950 tx=0x7ff6900058e0 comp rx=0 tx=0).stop 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 msgr2=0x7ff6a01a45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a01a45b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff698008ec0 tx=0x7ff698008fa0 comp rx=0 tx=0).stop 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 shutdown_connections 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff68809f640 0x7ff6880a1af0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6a01043c0 0x7ff6a01a45b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6a00ff380 0x7ff6a0100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 --2- 172.21.15.35:0/1709564992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a00ffd20 0x7ff6a01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 >> 172.21.15.35:0/1709564992 conn(0x7ff6a0076300 msgr2=0x7ff6a0067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:27.402 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.115+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 shutdown_connections 2023-03-17T08:54:27.403 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:53:35.116+0000 7ff6a668d700 1 -- 172.21.15.35:0/1709564992 wait complete. 2023-03-17T08:54:27.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:35 smithi035 ceph-mon[92535]: pgmap v230: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:38 smithi035 ceph-mon[92535]: pgmap v231: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:29.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:40 smithi035 ceph-mon[92535]: pgmap v232: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:42 smithi035 ceph-mon[92535]: pgmap v233: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:44 smithi035 ceph-mon[92535]: pgmap v234: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:29.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:45 smithi035 ceph-mon[92535]: pgmap v235: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:48 smithi035 ceph-mon[92535]: pgmap v236: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:50 smithi035 ceph-mon[92535]: pgmap v237: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:52 smithi035 ceph-mon[92535]: pgmap v238: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:54 smithi035 ceph-mon[92535]: pgmap v239: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:55 smithi035 ceph-mon[92535]: pgmap v240: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:53:58 smithi035 ceph-mon[92535]: pgmap v241: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:00 smithi035 ceph-mon[92535]: pgmap v242: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:02 smithi035 ceph-mon[92535]: pgmap v243: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:29.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:04 smithi035 ceph-mon[92535]: pgmap v244: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:54:33.498 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:05 smithi035 ceph-mon[92535]: pgmap v245: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:35.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:08 smithi035 ceph-mon[92535]: pgmap v246: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:54:35.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:10 smithi035 ceph-mon[92535]: pgmap v247: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:35.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:12 smithi035 ceph-mon[92535]: pgmap v248: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:35.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:14 smithi035 ceph-mon[92535]: pgmap v249: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:54:36.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:15 smithi035 ceph-mon[92535]: pgmap v250: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:54:36.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:18 smithi035 ceph-mon[92535]: pgmap v251: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:54:36.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:20 smithi035 ceph-mon[92535]: pgmap v252: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:54:36.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:22 smithi035 ceph-mon[92535]: pgmap v253: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:54:38.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:24 smithi035 ceph-mon[92535]: pgmap v254: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:54:38.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:25 smithi035 ceph-mon[92535]: pgmap v255: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:38.215 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:53:58 smithi078 ceph-mon[94114]: pgmap v241: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:38.215 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:00 smithi078 ceph-mon[94114]: pgmap v242: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:38.215 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:02 smithi078 ceph-mon[94114]: pgmap v243: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:38.215 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:04 smithi078 ceph-mon[94114]: pgmap v244: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:54:38.215 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:05 smithi078 ceph-mon[94114]: pgmap v245: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:38.216 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:08 smithi078 ceph-mon[94114]: pgmap v246: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:54:38.216 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:10 smithi078 ceph-mon[94114]: pgmap v247: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:38.216 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:12 smithi078 ceph-mon[94114]: pgmap v248: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:38.216 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:14 smithi078 ceph-mon[94114]: pgmap v249: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:54:38.216 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:15 smithi078 ceph-mon[94114]: pgmap v250: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:18 smithi078 ceph-mon[94114]: pgmap v251: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:20 smithi078 ceph-mon[94114]: pgmap v252: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:22 smithi078 ceph-mon[94114]: pgmap v253: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:24 smithi078 ceph-mon[94114]: pgmap v254: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:25 smithi078 ceph-mon[94114]: pgmap v255: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:53:58 smithi082 ceph-mon[94281]: pgmap v241: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:00 smithi082 ceph-mon[94281]: pgmap v242: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:42.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:02 smithi082 ceph-mon[94281]: pgmap v243: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:04 smithi082 ceph-mon[94281]: pgmap v244: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:05 smithi082 ceph-mon[94281]: pgmap v245: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:08 smithi082 ceph-mon[94281]: pgmap v246: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:10 smithi082 ceph-mon[94281]: pgmap v247: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:12 smithi082 ceph-mon[94281]: pgmap v248: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:14 smithi082 ceph-mon[94281]: pgmap v249: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:15 smithi082 ceph-mon[94281]: pgmap v250: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:18 smithi082 ceph-mon[94281]: pgmap v251: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:20 smithi082 ceph-mon[94281]: pgmap v252: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:22 smithi082 ceph-mon[94281]: pgmap v253: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:24 smithi082 ceph-mon[94281]: pgmap v254: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T08:54:43.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:25 smithi082 ceph-mon[94281]: pgmap v255: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:43.936 INFO:teuthology.run_tasks:Running task workunit... 2023-03-17T08:54:43.951 INFO:tasks.workunit:Pulling workunits from ref 4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T08:54:44.905 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-03-17T08:54:44.905 INFO:tasks.workunit:timeout=3h 2023-03-17T08:54:44.905 INFO:tasks.workunit:cleanup=True 2023-03-17T08:54:45.502 DEBUG:teuthology.orchestra.run.smithi035:> stat -- /home/ubuntu/cephtest/mnt.0 2023-03-17T08:54:45.502 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-17T08:54:45.503 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:28 smithi035 ceph-mon[92535]: pgmap v256: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:30 smithi035 ceph-mon[92535]: pgmap v257: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:32 smithi035 ceph-mon[92535]: pgmap v258: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:34 smithi035 ceph-mon[92535]: pgmap v259: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:35 smithi035 ceph-mon[92535]: pgmap v260: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:38 smithi035 ceph-mon[92535]: pgmap v261: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T08:54:45.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:40 smithi035 ceph-mon[92535]: pgmap v262: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:45.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:28 smithi078 ceph-mon[94114]: pgmap v256: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:30 smithi078 ceph-mon[94114]: pgmap v257: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:32 smithi078 ceph-mon[94114]: pgmap v258: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:34 smithi078 ceph-mon[94114]: pgmap v259: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:35 smithi078 ceph-mon[94114]: pgmap v260: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:38 smithi078 ceph-mon[94114]: pgmap v261: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:40 smithi078 ceph-mon[94114]: pgmap v262: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:47.274 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:42 smithi078 ceph-mon[94114]: pgmap v263: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:44 smithi078 ceph-mon[94114]: pgmap v264: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:28 smithi082 ceph-mon[94281]: pgmap v256: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:30 smithi082 ceph-mon[94281]: pgmap v257: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:32 smithi082 ceph-mon[94281]: pgmap v258: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:34 smithi082 ceph-mon[94281]: pgmap v259: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:35 smithi082 ceph-mon[94281]: pgmap v260: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:38 smithi082 ceph-mon[94281]: pgmap v261: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:40 smithi082 ceph-mon[94281]: pgmap v262: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:42 smithi082 ceph-mon[94281]: pgmap v263: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:54:47.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:44 smithi082 ceph-mon[94281]: pgmap v264: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:54:47.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:45 smithi078 ceph-mon[94114]: pgmap v265: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:54:49.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:45 smithi082 ceph-mon[94281]: pgmap v265: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:54:49.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:48 smithi078 ceph-mon[94114]: pgmap v266: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:54:51.319 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:48 smithi082 ceph-mon[94281]: pgmap v266: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:54:51.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:50 smithi078 ceph-mon[94114]: pgmap v267: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:54:51.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:50 smithi082 ceph-mon[94281]: pgmap v267: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:54:52.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:52 smithi078 ceph-mon[94114]: pgmap v268: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:54:53.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:52 smithi082 ceph-mon[94281]: pgmap v268: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:54:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 -- 172.21.15.35:0/1748284545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 msgr2=0x7fce04103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 --2- 172.21.15.35:0/1748284545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce04103cb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40099c0 tx=0x7fcdf4009cd0 comp rx=0 tx=0).stop 2023-03-17T08:54:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 -- 172.21.15.35:0/1748284545 shutdown_connections 2023-03-17T08:54:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 --2- 172.21.15.35:0/1748284545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce04104390 0x7fce0410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:54.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 --2- 172.21.15.35:0/1748284545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce040ff350 0x7fce040ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 --2- 172.21.15.35:0/1748284545 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce04103cb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 -- 172.21.15.35:0/1748284545 >> 172.21.15.35:0/1748284545 conn(0x7fce04076330 msgr2=0x7fce04076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 -- 172.21.15.35:0/1748284545 shutdown_connections 2023-03-17T08:54:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 -- 172.21.15.35:0/1748284545 wait complete. 2023-03-17T08:54:55.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.590+0000 7fce0c521700 1 Processor -- start 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 -- start start 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce040ff350 0x7fce04196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce041967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce04104390 0x7fce0419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0419b240 con 0x7fce040ffcf0 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0419b3b0 con 0x7fce04104390 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0c521700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0419b570 con 0x7fce040ff350 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce041967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce041967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42618/0 (socket says 172.21.15.35:42618) 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 -- 172.21.15.35:0/1388361284 learned_addr learned my addr 172.21.15.35:0/1388361284 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0aabe700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce04104390 0x7fce0419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce040ff350 0x7fce04196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 -- 172.21.15.35:0/1388361284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce040ff350 msgr2=0x7fce04196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce040ff350 0x7fce04196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:55.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 -- 172.21.15.35:0/1388361284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce04104390 msgr2=0x7fce0419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:55.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce04104390 0x7fce0419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:55.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 -- 172.21.15.35:0/1388361284 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc009c40 con 0x7fce040ffcf0 2023-03-17T08:54:55.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.591+0000 7fce09abc700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce041967a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009fd0 tx=0x7fcdf4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.592+0000 7fcdfb7fe700 1 -- 172.21.15.35:0/1388361284 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf401d070 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.592+0000 7fcdfb7fe700 1 -- 172.21.15.35:0/1388361284 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcdf40059a0 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.592+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40095f0 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.592+0000 7fcdfb7fe700 1 -- 172.21.15.35:0/1388361284 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4022dc0 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.592+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0410efc0 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.594+0000 7fcdfb7fe700 1 -- 172.21.15.35:0/1388361284 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcdf400fc50 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.595+0000 7fcdfb7fe700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcdf009f640 0x7fcdf00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.595+0000 7fcdfb7fe700 1 -- 172.21.15.35:0/1388361284 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fcdf40cb660 con 0x7fce040ffcf0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.595+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcdf009f640 0x7fcdf00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.595+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcdf009f640 0x7fcdf00a1af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fce00009bf0 tx=0x7fce00009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 Processor -- start 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 -- start start 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc16420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc16d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedb1d010 con 0x564cedc1c4f0 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedb6f950 con 0x564cedc1bbe0 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce186aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedb68de0 con 0x564cedc16960 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.596+0000 7fce09abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc16420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce09abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc16420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42626/0 (socket says 172.21.15.35:42626) 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce09abc700 1 -- 172.21.15.35:0/1249987067 learned_addr learned my addr 172.21.15.35:0/1249987067 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0aabe700 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc16d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 -- 172.21.15.35:0/1249987067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 msgr2=0x564cedc16d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc16d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 -- 172.21.15.35:0/1249987067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 msgr2=0x564cedc16420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc16420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 -- 172.21.15.35:0/1249987067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ced9ea5d0 con 0x564cedc1bbe0 2023-03-17T08:54:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0aabe700 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc16d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:54:55.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1bfb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce00011d80 tx=0x7fce00014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c84e698c076176 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fcdf8ff9700 1 -- 172.21.15.35:0/1249987067 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00012dc0 con 0x564cedc1bbe0 2023-03-17T08:54:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fcdf8ff9700 1 -- 172.21.15.35:0/1249987067 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce00016070 con 0x564cedc1bbe0 2023-03-17T08:54:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.597+0000 7fcdf8ff9700 1 -- 172.21.15.35:0/1249987067 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00003be0 con 0x564cedc1bbe0 2023-03-17T08:54:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 -- 172.21.15.35:0/1249987067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 msgr2=0x564cedc1bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:54:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1bfb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce00011d80 tx=0x7fce00014000 comp rx=0 tx=0).stop 2023-03-17T08:54:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 -- 172.21.15.35:0/1249987067 shutdown_connections 2023-03-17T08:54:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc16d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1bfb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1249987067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc16420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 -- 172.21.15.35:0/1249987067 >> 172.21.15.35:0/1249987067 conn(0x564ceda736b0 msgr2=0x564cedc10a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:54:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 -- 172.21.15.35:0/1249987067 shutdown_connections 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.598+0000 7fce186aeb80 1 -- 172.21.15.35:0/1249987067 wait complete. 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 -- start start 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 Processor -- start 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc1fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ced9ec8c0 con 0x564cedc1c4f0 2023-03-17T08:54:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc204e0 con 0x564cedc1bbe0 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc2c000 con 0x564cedc16960 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce186aeb80 10 client.0 _ll_register_callbacks cb 0x564ceda0e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc1fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc1fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42634/0 (socket says 172.21.15.35:42634) 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 -- 172.21.15.35:0/2123751693 learned_addr learned my addr 172.21.15.35:0/2123751693 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce09abc700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 -- 172.21.15.35:0/2123751693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 msgr2=0x564cedc224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc224c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 -- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 msgr2=0x564cedc1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:54:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce0aabe700 1 -- 172.21.15.35:0/2123751693 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce00011a60 con 0x564cedc1c4f0 2023-03-17T08:54:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.599+0000 7fce09abc700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:54:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce0aabe700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc1fd70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc007cb0 tx=0x7fcdfc007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cce09d3c297b913 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:54:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fcdedffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:54:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fcdedffb700 1 -- 172.21.15.35:0/2123751693 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00e040 con 0x564cedc1c4f0 2023-03-17T08:54:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fcdedffb700 1 -- 172.21.15.35:0/2123751693 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fcdfc007e10 con 0x564cedc1c4f0 2023-03-17T08:54:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cedb2b390 con 0x564cedc1c4f0 2023-03-17T08:54:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fcdedffb700 1 -- 172.21.15.35:0/2123751693 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdfc013b30 con 0x564cedc1c4f0 2023-03-17T08:54:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 10 client.15528 fetch_fsmap learned FSMap version 29 2023-03-17T08:54:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564ced996d80 con 0x564cedc1c4f0 2023-03-17T08:54:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fcdedffb700 1 -- 172.21.15.35:0/2123751693 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564cedb2b390 con 0x564cedc1c4f0 2023-03-17T08:54:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fcdedffb700 1 -- 172.21.15.35:0/2123751693 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcdfc0203b0 con 0x564cedc1c4f0 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 10 client.15528 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 20 client.15528 populate_metadata read hostname 'smithi035' 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.600+0000 7fce186aeb80 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc300f0 0x564cedc32500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.601+0000 7fce186aeb80 4 client.15528 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.601+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cedb37600 con 0x564cedc300f0 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.601+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc300f0 0x564cedc32500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:54:59.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.601+0000 7fcdedffb700 10 client.15528 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:54:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.601+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc300f0 0x564cedc32500 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3846dd6887c936bb server_cookie=7e04bb7bd9506f5a in_seq=0 out_seq=0 2023-03-17T08:54:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fcdedffb700 1 -- 172.21.15.35:0/2123751693 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564cedb37600 con 0x564cedc300f0 2023-03-17T08:54:59.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fcdedffb700 10 client.15528 handle_command_reply: tid=0 2023-03-17T08:55:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 client.15528 shutdown 2023-03-17T08:55:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 msgr2=0x564cedc1fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc1fd70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc007cb0 tx=0x7fcdfc007ce0 comp rx=0 tx=0).stop 2023-03-17T08:55:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 shutdown_connections 2023-03-17T08:55:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc300f0 0x564cedc32500 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc1fd70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fcdedffb700 0 client.15528 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 --2- 172.21.15.35:0/2123751693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 >> 172.21.15.35:0/2123751693 conn(0x564ceda736b0 msgr2=0x564cedc15410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 shutdown_connections 2023-03-17T08:55:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 1 -- 172.21.15.35:0/2123751693 wait complete. 2023-03-17T08:55:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.602+0000 7fce186aeb80 20 client.15528 trim_cache size 0 max 16384 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 Processor -- start 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 -- start start 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc10ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc26f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc2b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc11000 con 0x564cedc1c4f0 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc0c0d0 con 0x564cedc1bbe0 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.617+0000 7fce186aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc124a0 con 0x564cedc16960 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc2b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc2b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42642/0 (socket says 172.21.15.35:42642) 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 -- 172.21.15.35:0/1445337640 learned_addr learned my addr 172.21.15.35:0/1445337640 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc10ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce09abc700 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc26f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 -- 172.21.15.35:0/1445337640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 msgr2=0x564cedc10ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc10ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 -- 172.21.15.35:0/1445337640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 msgr2=0x564cedc26f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc26f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 -- 172.21.15.35:0/1445337640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cedb2f130 con 0x564cedc1c4f0 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce09abc700 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc26f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fce0aabe700 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc2b6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc007c80 tx=0x7fcdfc006080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cadf59beef98ad1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fcdf97fa700 1 -- 172.21.15.35:0/1445337640 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00e040 con 0x564cedc1c4f0 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fcdf97fa700 1 -- 172.21.15.35:0/1445337640 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcdfc00f040 con 0x564cedc1c4f0 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.618+0000 7fcdf97fa700 1 -- 172.21.15.35:0/1445337640 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc021440 con 0x564cedc1c4f0 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- 172.21.15.35:0/1445337640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 msgr2=0x564cedc2b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc2b6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc007c80 tx=0x7fcdfc006080 comp rx=0 tx=0).stop 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- 172.21.15.35:0/1445337640 shutdown_connections 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1c4f0 0x564cedc2b6e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc16960 0x564cedc10ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- 172.21.15.35:0/1445337640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc1bbe0 0x564cedc26f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- 172.21.15.35:0/1445337640 >> 172.21.15.35:0/1445337640 conn(0x564ceda736b0 msgr2=0x564cedc15c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- 172.21.15.35:0/1445337640 shutdown_connections 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- 172.21.15.35:0/1445337640 wait complete. 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- start start 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 Processor -- start 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc16960 0x564cedc78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 0x564cedc78650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc1c4f0 0x564cedc7d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc7d600 con 0x564cedc1bbe0 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc7d770 con 0x564cedc16960 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cedc7d930 con 0x564cedc1c4f0 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.619+0000 7fce186aeb80 10 client.0 _ll_register_callbacks cb 0x564ceda0e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 0x564cedc78650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:02.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 0x564cedc78650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42646/0 (socket says 172.21.15.35:42646) 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 -- 172.21.15.35:0/3429006809 learned_addr learned my addr 172.21.15.35:0/3429006809 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce0aabe700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc1c4f0 0x564cedc7d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc16960 0x564cedc78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 -- 172.21.15.35:0/3429006809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc1c4f0 msgr2=0x564cedc7d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc1c4f0 0x564cedc7d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 -- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc16960 msgr2=0x564cedc78110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc16960 0x564cedc78110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 -- 172.21.15.35:0/3429006809 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ced996d80 con 0x564cedc1bbe0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc16960 0x564cedc78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce09abc700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 0x564cedc78650 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40c9420 tx=0x7fcdf4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7239e2ada3bc0c10 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fcdedffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fcdedffb700 1 -- 172.21.15.35:0/3429006809 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40991d0 con 0x564cedc1bbe0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fcdedffb700 1 -- 172.21.15.35:0/3429006809 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fcdf40a1330 con 0x564cedc1bbe0 2023-03-17T08:55:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cedbe61e0 con 0x564cedc1bbe0 2023-03-17T08:55:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fcdedffb700 1 -- 172.21.15.35:0/3429006809 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdf4022470 con 0x564cedc1bbe0 2023-03-17T08:55:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce186aeb80 10 client.15534 fetch_fsmap learned FSMap version 29 2023-03-17T08:55:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.620+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564ced9bd1f0 con 0x564cedc1bbe0 2023-03-17T08:55:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fcdedffb700 1 -- 172.21.15.35:0/3429006809 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcdf4063020 con 0x564cedc1bbe0 2023-03-17T08:55:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fcdedffb700 1 -- 172.21.15.35:0/3429006809 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcdf40983a0 con 0x564cedc1bbe0 2023-03-17T08:55:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce186aeb80 10 client.15534 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:55:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce186aeb80 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:55:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce186aeb80 20 client.15534 populate_metadata read hostname 'smithi035' 2023-03-17T08:55:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce186aeb80 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc84d20 0x564cedc87130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce186aeb80 4 client.15534 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:55:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564ced9ecf00 con 0x564cedc84d20 2023-03-17T08:55:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc84d20 0x564cedc87130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:07.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fcdedffb700 10 client.15534 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.621+0000 7fce0a2bd700 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc84d20 0x564cedc87130 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816fdb7e27a93cbc server_cookie=d6a1cdc35713f1a9 in_seq=0 out_seq=0 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fcdedffb700 1 -- 172.21.15.35:0/3429006809 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564ced9ecf00 con 0x564cedc84d20 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fcdedffb700 10 client.15534 handle_command_reply: tid=0 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 client.15534 shutdown 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 msgr2=0x564cedc78650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 0x564cedc78650 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40c9420 tx=0x7fcdf4005fd0 comp rx=0 tx=0).stop 2023-03-17T08:55:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 shutdown_connections 2023-03-17T08:55:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564cedc84d20 0x564cedc87130 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564cedc1c4f0 0x564cedc7d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564cedc16960 0x564cedc78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fcdedffb700 0 client.15534 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 --2- 172.21.15.35:0/3429006809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564cedc1bbe0 0x564cedc78650 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 >> 172.21.15.35:0/3429006809 conn(0x564ceda736b0 msgr2=0x564cedc2c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.632+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 shutdown_connections 2023-03-17T08:55:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce186aeb80 1 -- 172.21.15.35:0/3429006809 wait complete. 2023-03-17T08:55:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce186aeb80 20 client.15534 trim_cache size 0 max 16384 2023-03-17T08:55:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:55:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:55:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:55:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcdf009f640 msgr2=0x7fcdf00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcdf009f640 0x7fcdf00a1af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fce00009bf0 tx=0x7fce00009260 comp rx=0 tx=0).stop 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 msgr2=0x7fce041967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce041967a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009fd0 tx=0x7fcdf4009580 comp rx=0 tx=0).stop 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 shutdown_connections 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcdf009f640 0x7fcdf00a1af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce04104390 0x7fce0419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce040ff350 0x7fce04196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 --2- 172.21.15.35:0/1388361284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fce040ffcf0 0x7fce041967a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 >> 172.21.15.35:0/1388361284 conn(0x7fce04076330 msgr2=0x7fce040680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 shutdown_connections 2023-03-17T08:55:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:40.633+0000 7fce0c521700 1 -- 172.21.15.35:0/1388361284 wait complete. 2023-03-17T08:55:10.012 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:42 smithi035 ceph-mon[92535]: pgmap v263: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T08:55:10.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:44 smithi035 ceph-mon[92535]: pgmap v264: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:55:10.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:45 smithi035 ceph-mon[92535]: pgmap v265: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:55:10.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:48 smithi035 ceph-mon[92535]: pgmap v266: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:55:10.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:50 smithi035 ceph-mon[92535]: pgmap v267: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:55:10.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:52 smithi035 ceph-mon[92535]: pgmap v268: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-03-17T08:55:10.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:54 smithi078 ceph-mon[94114]: pgmap v269: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:55:10.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:55 smithi078 ceph-mon[94114]: pgmap v270: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:55:10.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:54:58 smithi078 ceph-mon[94114]: pgmap v271: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:10.014 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:00 smithi078 ceph-mon[94114]: pgmap v272: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:11.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:02 smithi078 ceph-mon[94114]: pgmap v273: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:11.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:04 smithi078 ceph-mon[94114]: pgmap v274: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:55:11.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:05 smithi078 ceph-mon[94114]: pgmap v275: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:11.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:08 smithi078 ceph-mon[94114]: pgmap v276: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:55:11.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:54 smithi082 ceph-mon[94281]: pgmap v269: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:55:12.001 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:55 smithi082 ceph-mon[94281]: pgmap v270: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:55:12.001 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:54:58 smithi082 ceph-mon[94281]: pgmap v271: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:12.001 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:00 smithi082 ceph-mon[94281]: pgmap v272: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:13.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:02 smithi082 ceph-mon[94281]: pgmap v273: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:13.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:04 smithi082 ceph-mon[94281]: pgmap v274: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:55:13.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:05 smithi082 ceph-mon[94281]: pgmap v275: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:13.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:08 smithi082 ceph-mon[94281]: pgmap v276: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:55:13.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:10 smithi078 ceph-mon[94114]: pgmap v277: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:11 smithi078 ceph-mon[94114]: scrub queued for path: / 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:11 smithi078 ceph-mon[94114]: scrub summary: idle+waiting paths [/] 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:11 smithi078 ceph-mon[94114]: scrub summary: active paths [/] 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:11 smithi078 ceph-mon[94114]: scrub summary: idle+waiting paths [/] 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:12 smithi078 ceph-mon[94114]: pgmap v278: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:10 smithi082 ceph-mon[94281]: pgmap v277: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:13.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:11 smithi082 ceph-mon[94281]: scrub queued for path: / 2023-03-17T08:55:13.150 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:11 smithi082 ceph-mon[94281]: scrub summary: idle+waiting paths [/] 2023-03-17T08:55:14.278 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:11 smithi082 ceph-mon[94281]: scrub summary: active paths [/] 2023-03-17T08:55:14.701 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:11 smithi082 ceph-mon[94281]: scrub summary: idle+waiting paths [/] 2023-03-17T08:55:14.701 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:12 smithi082 ceph-mon[94281]: pgmap v278: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:14.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:14 smithi078 ceph-mon[94114]: pgmap v279: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2023-03-17T08:55:14.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:14 smithi078 ceph-mon[94114]: scrub summary: idle 2023-03-17T08:55:14.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:14 smithi082 ceph-mon[94281]: pgmap v279: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2023-03-17T08:55:14.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:14 smithi082 ceph-mon[94281]: scrub summary: idle 2023-03-17T08:55:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 -- 172.21.15.35:0/3491007034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 msgr2=0x7f91e01016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 --2- 172.21.15.35:0/3491007034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01016c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009990 tx=0x7f91dc009ca0 comp rx=0 tx=0).stop 2023-03-17T08:55:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 -- 172.21.15.35:0/3491007034 shutdown_connections 2023-03-17T08:55:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 --2- 172.21.15.35:0/3491007034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e010a810 0x7f91e010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 --2- 172.21.15.35:0/3491007034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01016c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 --2- 172.21.15.35:0/3491007034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e0101c00 0x7f91e010a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 -- 172.21.15.35:0/3491007034 >> 172.21.15.35:0/3491007034 conn(0x7f91e0075f30 msgr2=0x7f91e0076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 -- 172.21.15.35:0/3491007034 shutdown_connections 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 -- 172.21.15.35:0/3491007034 wait complete. 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.756+0000 7f91e8383700 1 Processor -- start 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 -- start start 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e0101c00 0x7f91e0196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e010a810 0x7f91e019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e019b2d0 con 0x7f91e01012f0 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e019b440 con 0x7f91e010a810 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e8383700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e019b600 con 0x7f91e0101c00 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42658/0 (socket says 172.21.15.35:42658) 2023-03-17T08:55:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 -- 172.21.15.35:0/332095668 learned_addr learned my addr 172.21.15.35:0/332095668 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e6920700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e010a810 0x7f91e019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e591e700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e0101c00 0x7f91e0196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 -- 172.21.15.35:0/332095668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e0101c00 msgr2=0x7f91e0196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e0101c00 0x7f91e0196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 -- 172.21.15.35:0/332095668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e010a810 msgr2=0x7f91e019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e010a810 0x7f91e019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 -- 172.21.15.35:0/332095668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0095f0 con 0x7f91e01012f0 2023-03-17T08:55:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.757+0000 7f91e611f700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01962f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005910 tx=0x7f91dc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.758+0000 7f91d77fe700 1 -- 172.21.15.35:0/332095668 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc01d070 con 0x7f91e01012f0 2023-03-17T08:55:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.758+0000 7f91d77fe700 1 -- 172.21.15.35:0/332095668 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91dc003f40 con 0x7f91e01012f0 2023-03-17T08:55:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.758+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e0110180 con 0x7f91e01012f0 2023-03-17T08:55:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.758+0000 7f91d77fe700 1 -- 172.21.15.35:0/332095668 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00fc60 con 0x7f91e01012f0 2023-03-17T08:55:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.758+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e010fff0 con 0x7f91e01012f0 2023-03-17T08:55:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.760+0000 7f91d77fe700 1 -- 172.21.15.35:0/332095668 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f91dc0040b0 con 0x7f91e01012f0 2023-03-17T08:55:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.761+0000 7f91d77fe700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f91cc09f640 0x7f91cc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.761+0000 7f91e591e700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f91cc09f640 0x7f91cc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.761+0000 7f91d77fe700 1 -- 172.21.15.35:0/332095668 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f91dc0cb640 con 0x7f91e01012f0 2023-03-17T08:55:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.761+0000 7f91e591e700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f91cc09f640 0x7f91cc0a1af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005950 tx=0x7f91d00058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.761+0000 7f91f4510b80 1 Processor -- start 2023-03-17T08:55:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 -- start start 2023-03-17T08:55:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1632fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1534010 con 0x5598b162d960 2023-03-17T08:55:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1586950 con 0x5598b16334f0 2023-03-17T08:55:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91f4510b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b157fde0 con 0x5598b1632be0 2023-03-17T08:55:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:22.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42670/0 (socket says 172.21.15.35:42670) 2023-03-17T08:55:22.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 -- 172.21.15.35:0/42512658 learned_addr learned my addr 172.21.15.35:0/42512658 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e591e700 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e611f700 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1632fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 -- 172.21.15.35:0/42512658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 msgr2=0x5598b1632fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1632fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 -- 172.21.15.35:0/42512658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 msgr2=0x5598b162d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.762+0000 7f91e6920700 1 -- 172.21.15.35:0/42512658 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b14015d0 con 0x5598b162d960 2023-03-17T08:55:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.763+0000 7f91e6920700 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162dd90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009710 tx=0x7f91d8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8409ba86a545115c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.763+0000 7f91d4dae700 1 -- 172.21.15.35:0/42512658 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8015470 con 0x5598b162d960 2023-03-17T08:55:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.763+0000 7f91d4dae700 1 -- 172.21.15.35:0/42512658 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91d800f050 con 0x5598b162d960 2023-03-17T08:55:26.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.763+0000 7f91d4dae700 1 -- 172.21.15.35:0/42512658 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8014740 con 0x5598b162d960 2023-03-17T08:55:26.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- 172.21.15.35:0/42512658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 msgr2=0x5598b162dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:26.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162dd90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009710 tx=0x7f91d8009f60 comp rx=0 tx=0).stop 2023-03-17T08:55:26.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- 172.21.15.35:0/42512658 shutdown_connections 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162dd90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1632fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- 172.21.15.35:0/42512658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- 172.21.15.35:0/42512658 >> 172.21.15.35:0/42512658 conn(0x5598b148a6b0 msgr2=0x5598b1627a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- 172.21.15.35:0/42512658 shutdown_connections 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- 172.21.15.35:0/42512658 wait complete. 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- start start 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 Processor -- start 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b162d960 0x5598b1639430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 0x5598b1636640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b1636be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b14038c0 con 0x5598b1632be0 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1637320 con 0x5598b16334f0 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b16374e0 con 0x5598b162d960 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.764+0000 7f91f4510b80 10 client.0 _ll_register_callbacks cb 0x5598b1425230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:55:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 0x5598b1636640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 0x5598b1636640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42674/0 (socket says 172.21.15.35:42674) 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 -- 172.21.15.35:0/2731194232 learned_addr learned my addr 172.21.15.35:0/2731194232 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e6920700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b1636be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e611f700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b162d960 0x5598b1639430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 -- 172.21.15.35:0/2731194232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b162d960 msgr2=0x5598b1639430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b162d960 0x5598b1639430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 -- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 msgr2=0x5598b1636be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b1636be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 -- 172.21.15.35:0/2731194232 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d80098e0 con 0x5598b1632be0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91e591e700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 0x5598b1636640 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f91d000ff90 tx=0x7f91d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922922a84ca29fad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91c9ffb700 1 -- 172.21.15.35:0/2731194232 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0028670 con 0x5598b1632be0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91c9ffb700 1 -- 172.21.15.35:0/2731194232 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f91d00287d0 con 0x5598b1632be0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598b1542390 con 0x5598b1632be0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91c9ffb700 1 -- 172.21.15.35:0/2731194232 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d0028990 con 0x5598b1632be0 2023-03-17T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91f4510b80 10 client.15546 fetch_fsmap learned FSMap version 29 2023-03-17T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.765+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5598b13add80 con 0x5598b1632be0 2023-03-17T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91c9ffb700 1 -- 172.21.15.35:0/2731194232 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598b1542390 con 0x5598b1632be0 2023-03-17T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91c9ffb700 1 -- 172.21.15.35:0/2731194232 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f91d0032410 con 0x5598b1632be0 2023-03-17T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91f4510b80 10 client.15546 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91f4510b80 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91f4510b80 20 client.15546 populate_metadata read hostname 'smithi035' 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91f4510b80 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b1647100 0x5598b1649510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91f4510b80 4 client.15546 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598b154e600 con 0x5598b1647100 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.766+0000 7f91e611f700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b1647100 0x5598b1649510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91c9ffb700 10 client.15546 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91e611f700 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b1647100 0x5598b1649510 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45246d79a0b7689 server_cookie=91eafc70ed1d2ce2 in_seq=0 out_seq=0 2023-03-17T08:55:29.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91c9ffb700 1 -- 172.21.15.35:0/2731194232 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5598b154e600 con 0x5598b1647100 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91c9ffb700 10 client.15546 handle_command_reply: tid=0 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 client.15546 shutdown 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 msgr2=0x5598b1636640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 0x5598b1636640 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f91d000ff90 tx=0x7f91d0004750 comp rx=0 tx=0).stop 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 shutdown_connections 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b1647100 0x5598b1649510 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b1636be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91c9ffb700 0 client.15546 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b162d960 0x5598b1639430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 --2- 172.21.15.35:0/2731194232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b1632be0 0x5598b1636640 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 >> 172.21.15.35:0/2731194232 conn(0x5598b148a6b0 msgr2=0x5598b1627a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 shutdown_connections 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.767+0000 7f91f4510b80 1 -- 172.21.15.35:0/2731194232 wait complete. 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.768+0000 7f91f4510b80 20 client.15546 trim_cache size 0 max 16384 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.782+0000 7f91f4510b80 1 Processor -- start 2023-03-17T08:55:29.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 -- start start 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b162d960 0x5598b162d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1627ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 0x5598b16340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1542390 con 0x5598b16334f0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1628000 con 0x5598b162d960 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91f4510b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1623100 con 0x5598b1632be0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 0x5598b16340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 0x5598b16340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42684/0 (socket says 172.21.15.35:42684) 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 -- 172.21.15.35:0/3923844806 learned_addr learned my addr 172.21.15.35:0/3923844806 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e611f700 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b162d960 0x5598b162d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e591e700 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1627ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 -- 172.21.15.35:0/3923844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 msgr2=0x5598b1627ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1627ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 -- 172.21.15.35:0/3923844806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b162d960 msgr2=0x5598b162d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b162d960 0x5598b162d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 -- 172.21.15.35:0/3923844806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b1546130 con 0x5598b16334f0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.783+0000 7f91e6920700 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 0x5598b16340a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5598b1633960 tx=0x7f91d8009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849872bdd6ca76d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:29.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91d55af700 1 -- 172.21.15.35:0/3923844806 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8004d90 con 0x5598b16334f0 2023-03-17T08:55:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91d55af700 1 -- 172.21.15.35:0/3923844806 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91d8028910 con 0x5598b16334f0 2023-03-17T08:55:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91d55af700 1 -- 172.21.15.35:0/3923844806 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80157f0 con 0x5598b16334f0 2023-03-17T08:55:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 -- 172.21.15.35:0/3923844806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 msgr2=0x5598b16340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 0x5598b16340a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5598b1633960 tx=0x7f91d8009110 comp rx=0 tx=0).stop 2023-03-17T08:55:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 -- 172.21.15.35:0/3923844806 shutdown_connections 2023-03-17T08:55:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b16334f0 0x5598b16340a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b162d960 0x5598b162d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3923844806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b1627ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 -- 172.21.15.35:0/3923844806 >> 172.21.15.35:0/3923844806 conn(0x5598b148a6b0 msgr2=0x5598b1633990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 -- 172.21.15.35:0/3923844806 shutdown_connections 2023-03-17T08:55:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.784+0000 7f91f4510b80 1 -- 172.21.15.35:0/3923844806 wait complete. 2023-03-17T08:55:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 -- start start 2023-03-17T08:55:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 Processor -- start 2023-03-17T08:55:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b162e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1630330 con 0x5598b162d960 2023-03-17T08:55:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b162f120 con 0x5598b16334f0 2023-03-17T08:55:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b162f2e0 con 0x5598b1632be0 2023-03-17T08:55:40.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91f4510b80 10 client.0 _ll_register_callbacks cb 0x5598b1425230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42686/0 (socket says 172.21.15.35:42686) 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 -- 172.21.15.35:0/3942984149 learned_addr learned my addr 172.21.15.35:0/3942984149 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e6920700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e591e700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b162e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 -- 172.21.15.35:0/3942984149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 msgr2=0x5598b162e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b162e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 -- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 msgr2=0x5598b162ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.785+0000 7f91e611f700 1 -- 172.21.15.35:0/3942984149 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598b14015d0 con 0x5598b162d960 2023-03-17T08:55:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91e611f700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162fbf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0956b0 tx=0x7f91dc005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f434d4cda041729 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91c9ffb700 1 -- 172.21.15.35:0/3942984149 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc097550 con 0x5598b162d960 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91c9ffb700 1 -- 172.21.15.35:0/3942984149 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f91dc0c8940 con 0x5598b162d960 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598b15fd1e0 con 0x5598b162d960 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91c9ffb700 1 -- 172.21.15.35:0/3942984149 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91dc0c8b00 con 0x5598b162d960 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 10 client.15552 fetch_fsmap learned FSMap version 29 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5598b13d41f0 con 0x5598b162d960 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91c9ffb700 1 -- 172.21.15.35:0/3942984149 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91dc0b7020 con 0x5598b162d960 2023-03-17T08:55:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91c9ffb700 1 -- 172.21.15.35:0/3942984149 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f91dc099530 con 0x5598b162d960 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 10 client.15552 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 20 client.15552 populate_metadata read hostname 'smithi035' 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b169bea0 0x5598b169e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 4 client.15552 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5598b1403f00 con 0x5598b169bea0 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.786+0000 7f91e591e700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b169bea0 0x5598b169e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.787+0000 7f91e591e700 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b169bea0 0x5598b169e2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d842b3e6a6c0a2 server_cookie=a5d57de92f2757a5 in_seq=0 out_seq=0 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.787+0000 7f91c9ffb700 10 client.15552 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91c9ffb700 1 -- 172.21.15.35:0/3942984149 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5598b1403f00 con 0x5598b169bea0 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91c9ffb700 10 client.15552 handle_command_reply: tid=0 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 client.15552 shutdown 2023-03-17T08:55:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 msgr2=0x5598b162fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162fbf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0956b0 tx=0x7f91dc005bc0 comp rx=0 tx=0).stop 2023-03-17T08:55:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 shutdown_connections 2023-03-17T08:55:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598b169bea0 0x5598b169e2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598b16334f0 0x5598b162ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91c9ffb700 0 client.15552 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:55:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598b162d960 0x5598b162fbf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 --2- 172.21.15.35:0/3942984149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598b1632be0 0x5598b162e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 >> 172.21.15.35:0/3942984149 conn(0x5598b148a6b0 msgr2=0x5598b1634e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 shutdown_connections 2023-03-17T08:55:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 1 -- 172.21.15.35:0/3942984149 wait complete. 2023-03-17T08:55:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.791+0000 7f91f4510b80 20 client.15552 trim_cache size 0 max 16384 2023-03-17T08:55:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:55:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:55:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:55:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:55:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f91cc09f640 msgr2=0x7f91cc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f91cc09f640 0x7f91cc0a1af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005950 tx=0x7f91d00058e0 comp rx=0 tx=0).stop 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 msgr2=0x7f91e01962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01962f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005910 tx=0x7f91dc009580 comp rx=0 tx=0).stop 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 shutdown_connections 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f91cc09f640 0x7f91cc0a1af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91e010a810 0x7f91e019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:47.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91e01012f0 0x7f91e01962f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 --2- 172.21.15.35:0/332095668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e0101c00 0x7f91e0196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 >> 172.21.15.35:0/332095668 conn(0x7f91e0075f30 msgr2=0x7f91e00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 shutdown_connections 2023-03-17T08:55:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:54:53.792+0000 7f91e8383700 1 -- 172.21.15.35:0/332095668 wait complete. 2023-03-17T08:55:48.724 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:54 smithi035 ceph-mon[92535]: pgmap v269: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 16 op/s 2023-03-17T08:55:48.724 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:55 smithi035 ceph-mon[92535]: pgmap v270: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:55:48.725 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:54:58 smithi035 ceph-mon[92535]: pgmap v271: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:48.725 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:00 smithi035 ceph-mon[92535]: pgmap v272: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:48.725 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:02 smithi035 ceph-mon[92535]: pgmap v273: 97 pgs: 97 active+clean; 1.3 MiB data, 87 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:48.725 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:04 smithi035 ceph-mon[92535]: pgmap v274: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:55:48.725 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:05 smithi035 ceph-mon[92535]: pgmap v275: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:55:48.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:15 smithi078 ceph-mon[94114]: pgmap v280: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 10 op/s 2023-03-17T08:55:49.752 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:18 smithi078 ceph-mon[94114]: pgmap v281: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 682 B/s wr, 14 op/s 2023-03-17T08:55:50.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:20 smithi078 ceph-mon[94114]: pgmap v282: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:55:50.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:22 smithi078 ceph-mon[94114]: pgmap v283: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:55:50.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:24 smithi078 ceph-mon[94114]: pgmap v284: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 853 B/s wr, 14 op/s 2023-03-17T08:55:50.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:25 smithi078 ceph-mon[94114]: pgmap v285: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:50.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:28 smithi078 ceph-mon[94114]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:30 smithi078 ceph-mon[94114]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:32 smithi078 ceph-mon[94114]: pgmap v288: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:55:50.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:34 smithi078 ceph-mon[94114]: pgmap v289: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:51.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:35 smithi078 ceph-mon[94114]: pgmap v290: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:55:51.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:38 smithi078 ceph-mon[94114]: pgmap v291: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:51.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:40 smithi078 ceph-mon[94114]: pgmap v292: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:51.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:42 smithi078 ceph-mon[94114]: pgmap v293: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:51.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:44 smithi078 ceph-mon[94114]: pgmap v294: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:51.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:45 smithi078 ceph-mon[94114]: pgmap v295: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:51.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:48 smithi078 ceph-mon[94114]: pgmap v296: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T08:55:51.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:15 smithi082 ceph-mon[94281]: pgmap v280: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 10 op/s 2023-03-17T08:55:51.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:18 smithi082 ceph-mon[94281]: pgmap v281: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 682 B/s wr, 14 op/s 2023-03-17T08:55:51.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:20 smithi082 ceph-mon[94281]: pgmap v282: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:55:51.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:22 smithi082 ceph-mon[94281]: pgmap v283: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:55:51.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:24 smithi082 ceph-mon[94281]: pgmap v284: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 853 B/s wr, 14 op/s 2023-03-17T08:55:51.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:25 smithi082 ceph-mon[94281]: pgmap v285: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:51.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:28 smithi082 ceph-mon[94281]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:52.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:30 smithi082 ceph-mon[94281]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:52.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:55:52.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:32 smithi082 ceph-mon[94281]: pgmap v288: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:52.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:55:53.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:34 smithi082 ceph-mon[94281]: pgmap v289: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:35 smithi082 ceph-mon[94281]: pgmap v290: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:38 smithi082 ceph-mon[94281]: pgmap v291: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:40 smithi082 ceph-mon[94281]: pgmap v292: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:42 smithi082 ceph-mon[94281]: pgmap v293: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:44 smithi082 ceph-mon[94281]: pgmap v294: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:45 smithi082 ceph-mon[94281]: pgmap v295: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:53.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:48 smithi082 ceph-mon[94281]: pgmap v296: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T08:55:53.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:50 smithi082 ceph-mon[94281]: pgmap v297: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:54.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:52 smithi082 ceph-mon[94281]: pgmap v298: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:54.171 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:50 smithi078 ceph-mon[94114]: pgmap v297: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:54.171 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:52 smithi078 ceph-mon[94114]: pgmap v298: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:55:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 -- 172.21.15.35:0/818030564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 msgr2=0x7fa9dc103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/818030564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc103ec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40099c0 tx=0x7fa9c4009cd0 comp rx=0 tx=0).stop 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 -- 172.21.15.35:0/818030564 shutdown_connections 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/818030564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9dc1045a0 0x7fa9dc10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/818030564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc0ffa80 0x7fa9dc0ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/818030564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc103ec0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 -- 172.21.15.35:0/818030564 >> 172.21.15.35:0/818030564 conn(0x7fa9dc0757a0 msgr2=0x7fa9dc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:55:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 -- 172.21.15.35:0/818030564 shutdown_connections 2023-03-17T08:55:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.915+0000 7fa9e27a0700 1 -- 172.21.15.35:0/818030564 wait complete. 2023-03-17T08:55:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 Processor -- start 2023-03-17T08:55:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 -- start start 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc0ffa80 0x7fa9dc195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9dc1045a0 0x7fa9dc199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc19a310 con 0x7fa9dc100420 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc19a480 con 0x7fa9dc1045a0 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9e27a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc19a640 con 0x7fa9dc0ffa80 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9db7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9db7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42702/0 (socket says 172.21.15.35:42702) 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.916+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3312547047 learned_addr learned my addr 172.21.15.35:0/3312547047 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9dc1045a0 0x7fa9dc199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc0ffa80 0x7fa9dc195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3312547047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc0ffa80 msgr2=0x7fa9dc195330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc0ffa80 0x7fa9dc195330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:57.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3312547047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9dc1045a0 msgr2=0x7fa9dc199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9dc1045a0 0x7fa9dc199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3312547047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40095f0 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc195870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009fd0 tx=0x7fa9c400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9d97fa700 1 -- 172.21.15.35:0/3312547047 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c401d070 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc10f1d0 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9d97fa700 1 -- 172.21.15.35:0/3312547047 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9c40059a0 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9d97fa700 1 -- 172.21.15.35:0/3312547047 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4022e90 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.917+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc10f040 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.920+0000 7fa9d97fa700 1 -- 172.21.15.35:0/3312547047 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa9c4022470 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.921+0000 7fa9d97fa700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa9c809f640 0x7fa9c80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.921+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa9c809f640 0x7fa9c80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.921+0000 7fa9d97fa700 1 -- 172.21.15.35:0/3312547047 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fa9c40cb600 con 0x7fa9dc100420 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.921+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa9c809f640 0x7fa9c80a1af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009bf0 tx=0x7fa9cc009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.921+0000 7fa9ee92db80 1 Processor -- start 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 -- start start 2023-03-17T08:55:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2286c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a22866630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a22866fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2276b010 con 0x555a2286c6a0 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a227bd950 con 0x555a2286bd90 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a227b6de0 con 0x555a22866b70 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a22866630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a22866630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42710/0 (socket says 172.21.15.35:42710) 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3323918971 learned_addr learned my addr 172.21.15.35:0/3323918971 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2286c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a22866fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3323918971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 msgr2=0x555a22866fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a22866fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3323918971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 msgr2=0x555a2286c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2286c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 -- 172.21.15.35:0/3323918971 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a226385d0 con 0x555a2286c6a0 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.922+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a22866630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4095b80 tx=0x7fa9c4094db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa61516d0d05ed4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:55:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9d27fc700 1 -- 172.21.15.35:0/3323918971 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40b0070 con 0x555a2286c6a0 2023-03-17T08:55:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9d27fc700 1 -- 172.21.15.35:0/3323918971 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9c409e040 con 0x555a2286c6a0 2023-03-17T08:55:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9d27fc700 1 -- 172.21.15.35:0/3323918971 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40b1270 con 0x555a2286c6a0 2023-03-17T08:55:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 -- 172.21.15.35:0/3323918971 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 msgr2=0x555a22866630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:56:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a22866630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4095b80 tx=0x7fa9c4094db0 comp rx=0 tx=0).stop 2023-03-17T08:56:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 -- 172.21.15.35:0/3323918971 shutdown_connections 2023-03-17T08:56:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a22866fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2286c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:01.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/3323918971 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a22866630 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:01.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 -- 172.21.15.35:0/3323918971 >> 172.21.15.35:0/3323918971 conn(0x555a226c16b0 msgr2=0x555a2285ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:56:01.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 -- 172.21.15.35:0/3323918971 shutdown_connections 2023-03-17T08:56:01.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.923+0000 7fa9ee92db80 1 -- 172.21.15.35:0/3323918971 wait complete. 2023-03-17T08:56:01.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 -- start start 2023-03-17T08:56:01.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 Processor -- start 2023-03-17T08:56:01.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a22866b70 0x555a2286f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286bd90 0x555a2286fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2263a8c0 con 0x555a2286c6a0 2023-03-17T08:56:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a22872ae0 con 0x555a22866b70 2023-03-17T08:56:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2287bf20 con 0x555a2286bd90 2023-03-17T08:56:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.924+0000 7fa9ee92db80 10 client.0 _ll_register_callbacks cb 0x555a2265c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:56:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42718/0 (socket says 172.21.15.35:42718) 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/4220609472 learned_addr learned my addr 172.21.15.35:0/4220609472 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286bd90 0x555a2286fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a22866b70 0x555a2286f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/4220609472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286bd90 msgr2=0x555a2286fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286bd90 0x555a2286fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a22866b70 msgr2=0x555a2286f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a22866b70 0x555a2286f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/4220609472 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc10f040 con 0x555a2286c6a0 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228703c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4003fd0 tx=0x7fa9d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4ef1f854a4dc7e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/4220609472 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4004db0 con 0x555a2286c6a0 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/4220609472 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fa9d40048d0 con 0x555a2286c6a0 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a22779390 con 0x555a2286c6a0 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/4220609472 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9d4007500 con 0x555a2286c6a0 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.925+0000 7fa9ee92db80 10 client.15564 fetch_fsmap learned FSMap version 29 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555a225e4d80 con 0x555a2286c6a0 2023-03-17T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/4220609472 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555a22779390 con 0x555a2286c6a0 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/4220609472 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa9d4016800 con 0x555a2286c6a0 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 10 client.15564 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 20 client.15564 populate_metadata read hostname 'smithi035' 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228800d0 0x555a228824e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 4 client.15564 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a22785600 con 0x555a228800d0 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.926+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228800d0 0x555a228824e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.927+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228800d0 0x555a228824e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da3b0327c7afd1e7 server_cookie=e44c0f7ae9ebe538 in_seq=0 out_seq=0 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.927+0000 7fa9bb7fe700 10 client.15564 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:56:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.927+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/4220609472 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555a22785600 con 0x555a228800d0 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.927+0000 7fa9bb7fe700 10 client.15564 handle_command_reply: tid=0 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.927+0000 7fa9ee92db80 1 client.15564 shutdown 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 msgr2=0x555a228703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228703c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4003fd0 tx=0x7fa9d4004040 comp rx=0 tx=0).stop 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 shutdown_connections 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228800d0 0x555a228824e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228703c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a22866b70 0x555a2286f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/4220609472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286bd90 0x555a2286fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9bb7fe700 0 client.15564 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:56:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 >> 172.21.15.35:0/4220609472 conn(0x555a226c16b0 msgr2=0x555a22863410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:56:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 shutdown_connections 2023-03-17T08:56:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 1 -- 172.21.15.35:0/4220609472 wait complete. 2023-03-17T08:56:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.928+0000 7fa9ee92db80 20 client.15564 trim_cache size 0 max 16384 2023-03-17T08:56:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 Processor -- start 2023-03-17T08:56:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 -- start start 2023-03-17T08:56:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 0x555a22863b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2285eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286c6a0 0x555a22876ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2287d780 con 0x555a22866b70 2023-03-17T08:56:10.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2285f000 con 0x555a2286bd90 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2285a100 con 0x555a2286c6a0 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 0x555a22863b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 0x555a22863b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42722/0 (socket says 172.21.15.35:42722) 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9dbfff700 1 -- 172.21.15.35:0/1467060128 learned_addr learned my addr 172.21.15.35:0/1467060128 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2285eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.943+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286c6a0 0x555a22876ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9dbfff700 1 -- 172.21.15.35:0/1467060128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286c6a0 msgr2=0x555a22876ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286c6a0 0x555a22876ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9dbfff700 1 -- 172.21.15.35:0/1467060128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 msgr2=0x555a2285eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2285eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9dbfff700 1 -- 172.21.15.35:0/1467060128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a2277d130 con 0x555a22866b70 2023-03-17T08:56:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2285eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:56:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 0x555a22863b20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x555a22882df0 tx=0x7fa9cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da5659e54d02d70 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:56:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9d2ffd700 1 -- 172.21.15.35:0/1467060128 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc02f070 con 0x555a22866b70 2023-03-17T08:56:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9d2ffd700 1 -- 172.21.15.35:0/1467060128 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9cc016070 con 0x555a22866b70 2023-03-17T08:56:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9d2ffd700 1 -- 172.21.15.35:0/1467060128 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc025040 con 0x555a22866b70 2023-03-17T08:56:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 -- 172.21.15.35:0/1467060128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 msgr2=0x555a22863b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:56:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 0x555a22863b20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x555a22882df0 tx=0x7fa9cc014000 comp rx=0 tx=0).stop 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 -- 172.21.15.35:0/1467060128 shutdown_connections 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2286c6a0 0x555a22876ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a22866b70 0x555a22863b20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/1467060128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a2285eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.944+0000 7fa9ee92db80 1 -- 172.21.15.35:0/1467060128 >> 172.21.15.35:0/1467060128 conn(0x555a226c16b0 msgr2=0x555a22863410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 -- 172.21.15.35:0/1467060128 shutdown_connections 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 -- 172.21.15.35:0/1467060128 wait complete. 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 -- start start 2023-03-17T08:56:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 Processor -- start 2023-03-17T08:56:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a228c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:13.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a228c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a228cc560 con 0x555a2286c6a0 2023-03-17T08:56:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a228cc6d0 con 0x555a2286bd90 2023-03-17T08:56:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a228cc890 con 0x555a22866b70 2023-03-17T08:56:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.945+0000 7fa9ee92db80 10 client.0 _ll_register_callbacks cb 0x555a2265c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:56:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42732/0 (socket says 172.21.15.35:42732) 2023-03-17T08:56:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a228c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/2450007117 learned_addr learned my addr 172.21.15.35:0/2450007117 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:56:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a228c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/2450007117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 msgr2=0x555a228c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:56:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a228c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 msgr2=0x555a228c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:56:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a228c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 -- 172.21.15.35:0/2450007117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc011d20 con 0x555a2286c6a0 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9db7fe700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a228c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a228c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9e0d3d700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228cbfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000f80 tx=0x7fa9d4017d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac901a199f0bbf5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/2450007117 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4016430 con 0x555a2286c6a0 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/2450007117 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fa9d4016590 con 0x555a2286c6a0 2023-03-17T08:56:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a228341e0 con 0x555a2286c6a0 2023-03-17T08:56:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/2450007117 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9d4016750 con 0x555a2286c6a0 2023-03-17T08:56:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9ee92db80 10 client.15570 fetch_fsmap learned FSMap version 29 2023-03-17T08:56:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.946+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555a2260b1f0 con 0x555a2286c6a0 2023-03-17T08:56:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/2450007117 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555a228341e0 con 0x555a2286c6a0 2023-03-17T08:56:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/2450007117 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa9d401c5c0 con 0x555a2286c6a0 2023-03-17T08:56:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9ee92db80 10 client.15570 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9ee92db80 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9ee92db80 20 client.15570 populate_metadata read hostname 'smithi035' 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228d5130 0x555a228d7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9ee92db80 4 client.15570 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555a2263af00 con 0x555a228d5130 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228d5130 0x555a228d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9bb7fe700 10 client.15570 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.947+0000 7fa9dbfff700 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228d5130 0x555a228d7540 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7cd799fc6b890f server_cookie=bed573a1e3e223c4 in_seq=0 out_seq=0 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.954+0000 7fa9bb7fe700 1 -- 172.21.15.35:0/2450007117 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555a2263af00 con 0x555a228d5130 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.954+0000 7fa9bb7fe700 10 client.15570 handle_command_reply: tid=0 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.954+0000 7fa9ee92db80 1 client.15570 shutdown 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.954+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 msgr2=0x555a228cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.954+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228cbfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000f80 tx=0x7fa9d4017d40 comp rx=0 tx=0).stop 2023-03-17T08:56:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 shutdown_connections 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a228d5130 0x555a228d7540 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2286c6a0 0x555a228cbfb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a22866b70 0x555a228c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9bb7fe700 0 client.15570 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 --2- 172.21.15.35:0/2450007117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2286bd90 0x555a228c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 >> 172.21.15.35:0/2450007117 conn(0x555a226c16b0 msgr2=0x555a22869860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 shutdown_connections 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 1 -- 172.21.15.35:0/2450007117 wait complete. 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9ee92db80 20 client.15570 trim_cache size 0 max 16384 2023-03-17T08:56:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa9c809f640 msgr2=0x7fa9c80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa9c809f640 0x7fa9c80a1af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009bf0 tx=0x7fa9cc009260 comp rx=0 tx=0).stop 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 msgr2=0x7fa9dc195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc195870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009fd0 tx=0x7fa9c400f690 comp rx=0 tx=0).stop 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 shutdown_connections 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa9c809f640 0x7fa9c80a1af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9dc1045a0 0x7fa9dc199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc0ffa80 0x7fa9dc195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 --2- 172.21.15.35:0/3312547047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9dc100420 0x7fa9dc195870 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 >> 172.21.15.35:0/3312547047 conn(0x7fa9dc0757a0 msgr2=0x7fa9dc0fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.955+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 shutdown_connections 2023-03-17T08:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:06.956+0000 7fa9e27a0700 1 -- 172.21.15.35:0/3312547047 wait complete. 2023-03-17T08:56:20.685 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:08 smithi035 ceph-mon[92535]: pgmap v276: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T08:56:20.688 INFO:teuthology.orchestra.run.smithi035.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-03-17T08:56:21.708 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-03-17T08:56:22.750 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 7ch/124d Inode: 1 Links: 2 2023-03-17T08:56:23.769 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-17T08:56:23.769 INFO:teuthology.orchestra.run.smithi035.stdout:Context: system_u:object_r:fusefs_t:s0 2023-03-17T08:56:23.769 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-03-17 08:15:56.323522534 +0000 2023-03-17T08:56:23.769 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-03-17 08:15:56.323522534 +0000 2023-03-17T08:56:24.624 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-03-17 08:40:25.832513820 +0000 2023-03-17T08:56:25.115 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-03-17T08:56:25.116 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-03-17T08:56:25.445 DEBUG:teuthology.orchestra.run.smithi035:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-03-17T08:56:26.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:54 smithi078 ceph-mon[94114]: pgmap v299: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:28.572 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:55 smithi078 ceph-mon[94114]: pgmap v300: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:55:58 smithi078 ceph-mon[94114]: pgmap v301: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:00 smithi078 ceph-mon[94114]: pgmap v302: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:02 smithi078 ceph-mon[94114]: pgmap v303: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:04 smithi078 ceph-mon[94114]: pgmap v304: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:05 smithi078 ceph-mon[94114]: pgmap v305: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:08 smithi078 ceph-mon[94114]: pgmap v306: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:10 smithi078 ceph-mon[94114]: pgmap v307: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:10 smithi078 ceph-mon[94114]: osdmap e93: 12 total, 12 up, 12 in 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:12 smithi078 ceph-mon[94114]: pgmap v309: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:14 smithi078 ceph-mon[94114]: pgmap v310: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:15 smithi078 ceph-mon[94114]: osdmap e94: 12 total, 12 up, 12 in 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:15 smithi078 ceph-mon[94114]: pgmap v312: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:18 smithi078 ceph-mon[94114]: pgmap v313: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:56:28.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:20 smithi078 ceph-mon[94114]: pgmap v314: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 823 B/s wr, 11 op/s 2023-03-17T08:56:29.202 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:22 smithi078 ceph-mon[94114]: pgmap v315: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:56:29.202 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:24 smithi078 ceph-mon[94114]: pgmap v316: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:26 smithi078 ceph-mon[94114]: pgmap v317: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 714 B/s wr, 10 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:54 smithi082 ceph-mon[94281]: pgmap v299: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:55 smithi082 ceph-mon[94281]: pgmap v300: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:55:58 smithi082 ceph-mon[94281]: pgmap v301: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:00 smithi082 ceph-mon[94281]: pgmap v302: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:02 smithi082 ceph-mon[94281]: pgmap v303: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:30.414 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:04 smithi082 ceph-mon[94281]: pgmap v304: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:56:31.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:05 smithi082 ceph-mon[94281]: pgmap v305: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:56:31.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:08 smithi082 ceph-mon[94281]: pgmap v306: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:56:31.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:10 smithi082 ceph-mon[94281]: pgmap v307: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:10 smithi082 ceph-mon[94281]: osdmap e93: 12 total, 12 up, 12 in 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:12 smithi082 ceph-mon[94281]: pgmap v309: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:14 smithi082 ceph-mon[94281]: pgmap v310: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:15 smithi082 ceph-mon[94281]: osdmap e94: 12 total, 12 up, 12 in 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:15 smithi082 ceph-mon[94281]: pgmap v312: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:18 smithi082 ceph-mon[94281]: pgmap v313: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:20 smithi082 ceph-mon[94281]: pgmap v314: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 823 B/s wr, 11 op/s 2023-03-17T08:56:32.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:22 smithi082 ceph-mon[94281]: pgmap v315: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:56:32.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:24 smithi082 ceph-mon[94281]: pgmap v316: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T08:56:32.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:26 smithi082 ceph-mon[94281]: pgmap v317: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 714 B/s wr, 10 op/s 2023-03-17T08:56:32.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:28 smithi082 ceph-mon[94281]: pgmap v318: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T08:56:34.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:30 smithi082 ceph-mon[94281]: pgmap v319: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:34.855 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:28 smithi078 ceph-mon[94114]: pgmap v318: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T08:56:34.855 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:30 smithi078 ceph-mon[94114]: pgmap v319: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:34.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:32 smithi082 ceph-mon[94281]: pgmap v320: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:37.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:56:37.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:37.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:38.276 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:34 smithi082 ceph-mon[94281]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:38.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:32 smithi078 ceph-mon[94114]: pgmap v320: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:38.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:56:38.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:38.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:38.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:34 smithi078 ceph-mon[94114]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:38.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:40.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:40.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:40.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:40.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:40.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:56:40.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:56:42.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:56:42.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:56:42.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.897 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.897 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:42.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:42.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:42.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:42.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:42.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:43.594 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:43.594 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:43.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:43.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:43.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:44.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:44.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T08:56:45.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:56:45.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T08:56:45.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T08:56:45.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:46.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:46.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:46.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T08:56:48.535 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T08:56:52.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T08:56:52.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:56:52.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:56:52.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:56:52.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:38 smithi082 ceph-mon[94281]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:53.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:40 smithi082 ceph-mon[94281]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:53.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:42 smithi082 ceph-mon[94281]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:53.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:44 smithi082 ceph-mon[94281]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:53.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:46 smithi082 ceph-mon[94281]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:53.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:48 smithi082 ceph-mon[94281]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:53.691 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:50 smithi082 ceph-mon[94281]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:53.692 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:38 smithi078 ceph-mon[94114]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:55.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:40 smithi078 ceph-mon[94114]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:55.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:42 smithi078 ceph-mon[94114]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:55.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:44 smithi078 ceph-mon[94114]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:55.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:46 smithi078 ceph-mon[94114]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:55.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:48 smithi078 ceph-mon[94114]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:55.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:50 smithi078 ceph-mon[94114]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:55.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:52 smithi082 ceph-mon[94281]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:57.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:54 smithi082 ceph-mon[94281]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:57.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:52 smithi078 ceph-mon[94114]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:56:57.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:54 smithi078 ceph-mon[94114]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:59.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:56 smithi082 ceph-mon[94281]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:59.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:56:58 smithi082 ceph-mon[94281]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:59.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:56 smithi078 ceph-mon[94114]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:56:59.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:56:58 smithi078 ceph-mon[94114]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:56:59.397 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 -- 172.21.15.35:0/445633967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa04810a760 msgr2=0x7fa04810cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:02.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 --2- 172.21.15.35:0/445633967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa04810a760 0x7fa04810cbf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa04000b0a0 tx=0x7fa04000b3b0 comp rx=0 tx=0).stop 2023-03-17T08:57:02.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 -- 172.21.15.35:0/445633967 shutdown_connections 2023-03-17T08:57:02.582 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 --2- 172.21.15.35:0/445633967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa04810a760 0x7fa04810cbf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 --2- 172.21.15.35:0/445633967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa048101420 0x7fa0481017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 --2- 172.21.15.35:0/445633967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa048101d30 0x7fa04810a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 -- 172.21.15.35:0/445633967 >> 172.21.15.35:0/445633967 conn(0x7fa048076300 msgr2=0x7fa048076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 -- 172.21.15.35:0/445633967 shutdown_connections 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.149+0000 7fa0505dc700 1 -- 172.21.15.35:0/445633967 wait complete. 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 Processor -- start 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 -- start start 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa048101420 0x7fa0481963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 0x7fa048196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa04810a760 0x7fa04819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:02.583 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04819b3c0 con 0x7fa048101d30 2023-03-17T08:57:04.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04819b530 con 0x7fa048101420 2023-03-17T08:57:04.027 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa0505dc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04819b6f0 con 0x7fa04810a760 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa04db77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 0x7fa048196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa04db77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 0x7fa048196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42744/0 (socket says 172.21.15.35:42744) 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa04db77700 1 -- 172.21.15.35:0/1364030454 learned_addr learned my addr 172.21.15.35:0/1364030454 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.150+0000 7fa04e378700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa048101420 0x7fa0481963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04eb79700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa04810a760 0x7fa04819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04db77700 1 -- 172.21.15.35:0/1364030454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa04810a760 msgr2=0x7fa04819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04db77700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa04810a760 0x7fa04819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:04.029 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04db77700 1 -- 172.21.15.35:0/1364030454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa048101420 msgr2=0x7fa0481963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:05.179 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04db77700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa048101420 0x7fa0481963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:05.180 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04db77700 1 -- 172.21.15.35:0/1364030454 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040009d00 con 0x7fa048101d30 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04eb79700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa04810a760 0x7fa04819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa04db77700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 0x7fa048196920 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b530 tx=0x7fa03800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa03f7fe700 1 -- 172.21.15.35:0/1364030454 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038011830 con 0x7fa048101d30 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa03f7fe700 1 -- 172.21.15.35:0/1364030454 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa038011e20 con 0x7fa048101d30 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa048110150 con 0x7fa048101d30 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa03f7fe700 1 -- 172.21.15.35:0/1364030454 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038010dd0 con 0x7fa048101d30 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.151+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04810ffc0 con 0x7fa048101d30 2023-03-17T08:57:05.509 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.153+0000 7fa03f7fe700 1 -- 172.21.15.35:0/1364030454 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa038011990 con 0x7fa048101d30 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.154+0000 7fa03f7fe700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa03409f6c0 0x7fa0340a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.154+0000 7fa04e378700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa03409f6c0 0x7fa0340a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.154+0000 7fa03f7fe700 1 -- 172.21.15.35:0/1364030454 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fa0380ca0b0 con 0x7fa048101d30 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.154+0000 7fa04e378700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa03409f6c0 0x7fa0340a1b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa044005fd0 tx=0x7fa044005f60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.154+0000 7fa05c769b80 1 Processor -- start 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 -- start start 2023-03-17T08:57:06.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a5ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a5f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a5fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f29610f0 con 0x55f3f2a5a850 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f29b3a30 con 0x55f3f2a5b160 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa05c769b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f29acec0 con 0x55f3f2a5f6b0 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04e378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a5ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04e378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a5ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42750/0 (socket says 172.21.15.35:42750) 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04e378700 1 -- 172.21.15.35:0/3997027973 learned_addr learned my addr 172.21.15.35:0/3997027973 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04db77700 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a5f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04eb79700 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a5fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04e378700 1 -- 172.21.15.35:0/3997027973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 msgr2=0x55f3f2a5fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.155+0000 7fa04e378700 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a5fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa04e378700 1 -- 172.21.15.35:0/3997027973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 msgr2=0x55f3f2a5f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa04e378700 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a5f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa04e378700 1 -- 172.21.15.35:0/3997027973 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f282e6b0 con 0x55f3f2a5a850 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa04db77700 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a5f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa04e378700 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a5ac20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa04400fc90 tx=0x7fa044012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f9077130cd00ab server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:06.562 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa03cff9700 1 -- 172.21.15.35:0/3997027973 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011b80 con 0x55f3f2a5a850 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa03cff9700 1 -- 172.21.15.35:0/3997027973 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa044011ce0 con 0x55f3f2a5a850 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.156+0000 7fa03cff9700 1 -- 172.21.15.35:0/3997027973 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04401d610 con 0x55f3f2a5a850 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 -- 172.21.15.35:0/3997027973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 msgr2=0x55f3f2a5ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a5ac20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa04400fc90 tx=0x7fa044012000 comp rx=0 tx=0).stop 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 -- 172.21.15.35:0/3997027973 shutdown_connections 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a5fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a5ac20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3997027973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a5f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 -- 172.21.15.35:0/3997027973 >> 172.21.15.35:0/3997027973 conn(0x55f3f2a550b0 msgr2=0x55f3f2a55480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 -- 172.21.15.35:0/3997027973 shutdown_connections 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 -- 172.21.15.35:0/3997027973 wait complete. 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 -- start start 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 Processor -- start 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.157+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a66e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a64080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f28309a0 con 0x55f3f2a5a850 2023-03-17T08:57:06.563 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2a64e50 con 0x55f3f2a5b160 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2a70960 con 0x55f3f2a5f6b0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 10 client.0 _ll_register_callbacks cb 0x55f3f2852310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a66e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a66e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42756/0 (socket says 172.21.15.35:42756) 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 -- 172.21.15.35:0/2302077389 learned_addr learned my addr 172.21.15.35:0/2302077389 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04eb79700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04db77700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a64080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 -- 172.21.15.35:0/2302077389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 msgr2=0x55f3f2a646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 -- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 msgr2=0x55f3f2a64080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a64080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 -- 172.21.15.35:0/2302077389 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04400f970 con 0x55f3f2a5a850 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa04e378700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a66e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa044005810 tx=0x7fa044011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2539c621534c28f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa031ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa031ffb700 1 -- 172.21.15.35:0/2302077389 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04402d070 con 0x55f3f2a5a850 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3f296f470 con 0x55f3f2a5a850 2023-03-17T08:57:06.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa031ffb700 1 -- 172.21.15.35:0/2302077389 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fa044005260 con 0x55f3f2a5a850 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa031ffb700 1 -- 172.21.15.35:0/2302077389 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa044005460 con 0x55f3f2a5a850 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.158+0000 7fa05c769b80 10 client.15582 fetch_fsmap learned FSMap version 29 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f3f27dae60 con 0x55f3f2a5a850 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa031ffb700 1 -- 172.21.15.35:0/2302077389 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3f296f470 con 0x55f3f2a5a850 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa031ffb700 1 -- 172.21.15.35:0/2302077389 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa04401e730 con 0x55f3f2a5a850 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 10 client.15582 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 20 client.15582 populate_metadata read hostname 'smithi035' 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2a74990 0x55f3f2a76d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 4 client.15582 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3f297b6e0 con 0x55f3f2a74990 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.159+0000 7fa04db77700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2a74990 0x55f3f2a76d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.160+0000 7fa031ffb700 10 client.15582 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.160+0000 7fa04db77700 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2a74990 0x55f3f2a76d70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd16a263fda7902d server_cookie=e87e7d49eeb0d602 in_seq=0 out_seq=0 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.160+0000 7fa031ffb700 1 -- 172.21.15.35:0/2302077389 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f3f297b6e0 con 0x55f3f2a74990 2023-03-17T08:57:06.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.160+0000 7fa031ffb700 10 client.15582 handle_command_reply: tid=0 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.160+0000 7fa05c769b80 1 client.15582 shutdown 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.160+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 msgr2=0x55f3f2a66e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a66e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa044005810 tx=0x7fa044011dd0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 shutdown_connections 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2a74990 0x55f3f2a76d70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa031ffb700 0 client.15582 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5a850 0x55f3f2a66e00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 --2- 172.21.15.35:0/2302077389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5b160 0x55f3f2a64080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 >> 172.21.15.35:0/2302077389 conn(0x55f3f2a550b0 msgr2=0x55f3f2a54790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 shutdown_connections 2023-03-17T08:57:06.566 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 1 -- 172.21.15.35:0/2302077389 wait complete. 2023-03-17T08:57:07.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.161+0000 7fa05c769b80 20 client.15582 trim_cache size 0 max 16384 2023-03-17T08:57:07.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 Processor -- start 2023-03-17T08:57:07.147 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 -- start start 2023-03-17T08:57:07.147 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2a621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2a669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a63840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2a5b9c0 con 0x55f3f2a5b160 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2a74770 con 0x55f3f2a5a850 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa05c769b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2a65630 con 0x55f3f2a5f6b0 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.178+0000 7fa04db77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2a669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2a669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42766/0 (socket says 172.21.15.35:42766) 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 -- 172.21.15.35:0/3121029880 learned_addr learned my addr 172.21.15.35:0/3121029880 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04e378700 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2a621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04eb79700 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a63840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 -- 172.21.15.35:0/3121029880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 msgr2=0x55f3f2a63840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:07.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a63840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 -- 172.21.15.35:0/3121029880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 msgr2=0x55f3f2a621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2a621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 -- 172.21.15.35:0/3121029880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3f2973210 con 0x55f3f2a5b160 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa04db77700 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2a669a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa038097bd0 tx=0x7fa03801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ea60de4757832 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa03d7fa700 1 -- 172.21.15.35:0/3121029880 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038097c40 con 0x55f3f2a5b160 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa03d7fa700 1 -- 172.21.15.35:0/3121029880 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa03809fe30 con 0x55f3f2a5b160 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.179+0000 7fa03d7fa700 1 -- 172.21.15.35:0/3121029880 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038098100 con 0x55f3f2a5b160 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 -- 172.21.15.35:0/3121029880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 msgr2=0x55f3f2a669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2a669a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa038097bd0 tx=0x7fa03801c040 comp rx=0 tx=0).stop 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 -- 172.21.15.35:0/3121029880 shutdown_connections 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2a63840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2a621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3121029880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2a669a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 -- 172.21.15.35:0/3121029880 >> 172.21.15.35:0/3121029880 conn(0x55f3f2a550b0 msgr2=0x55f3f2a61a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 -- 172.21.15.35:0/3121029880 shutdown_connections 2023-03-17T08:57:07.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 -- 172.21.15.35:0/3121029880 wait complete. 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 -- start start 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.180+0000 7fa05c769b80 1 Processor -- start 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2ac77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2ac7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2ac1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2ac2130 con 0x55f3f2a5b160 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2ac22a0 con 0x55f3f2a5a850 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3f2ac2460 con 0x55f3f2a5f6b0 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 10 client.0 _ll_register_callbacks cb 0x55f3f2852310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2ac7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2ac7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42772/0 (socket says 172.21.15.35:42772) 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 -- 172.21.15.35:0/3749651075 learned_addr learned my addr 172.21.15.35:0/3749651075 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04eb79700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2ac1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04e378700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2ac77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 -- 172.21.15.35:0/3749651075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 msgr2=0x55f3f2ac1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2ac1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 -- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 msgr2=0x55f3f2ac77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:07.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2ac77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:07.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 -- 172.21.15.35:0/3749651075 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04810ffc0 con 0x55f3f2a5b160 2023-03-17T08:57:07.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04e378700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2ac77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:57:07.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa04db77700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2ac7cf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa038097940 tx=0x7fa038011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadbefa20f36fe48 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:07.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa031ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa031ffb700 1 -- 172.21.15.35:0/3749651075 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038097c40 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa031ffb700 1 -- 172.21.15.35:0/3749651075 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fa038097130 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3f2a2a2c0 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa031ffb700 1 -- 172.21.15.35:0/3749651075 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0380972f0 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.181+0000 7fa05c769b80 10 client.15588 fetch_fsmap learned FSMap version 29 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f3f28012d0 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa031ffb700 1 -- 172.21.15.35:0/3749651075 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3f2a2a2c0 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa031ffb700 1 -- 172.21.15.35:0/3749651075 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa03809f9a0 con 0x55f3f2a5b160 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 10 client.15588 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T08:57:08.607 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 20 client.15588 populate_metadata read hostname 'smithi035' 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2acf240 0x55f3f2ad1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 4 client.15588 mds_command: new command op to 24452 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f3f2830fe0 con 0x55f3f2acf240 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa04e378700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2acf240 0x55f3f2ad1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa031ffb700 10 client.15588 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.182+0000 7fa04e378700 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2acf240 0x55f3f2ad1650 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292ae494d95ebdf3 server_cookie=a2ea9f26a74568ee in_seq=0 out_seq=0 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa031ffb700 1 -- 172.21.15.35:0/3749651075 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f3f2830fe0 con 0x55f3f2acf240 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa031ffb700 10 client.15588 handle_command_reply: tid=0 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 client.15588 shutdown 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 msgr2=0x55f3f2ac7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2ac7cf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa038097940 tx=0x7fa038011d00 comp rx=0 tx=0).stop 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 shutdown_connections 2023-03-17T08:57:08.608 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3f2acf240 0x55f3f2ad1650 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3f2a5f6b0 0x55f3f2ac1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3f2a5a850 0x55f3f2ac77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa031ffb700 0 client.15588 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 --2- 172.21.15.35:0/3749651075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3f2a5b160 0x55f3f2ac7cf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 >> 172.21.15.35:0/3749651075 conn(0x55f3f2a550b0 msgr2=0x55f3f2a5ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 shutdown_connections 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 1 -- 172.21.15.35:0/3749651075 wait complete. 2023-03-17T08:57:09.305 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.184+0000 7fa05c769b80 20 client.15588 trim_cache size 0 max 16384 2023-03-17T08:57:09.306 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T08:57:09.306 INFO:teuthology.orchestra.run.smithi035.stdout: "return_code": 0, 2023-03-17T08:57:09.306 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_tag": "b4ccfd73-4bf0-45ee-afb7-034268753439", 2023-03-17T08:57:09.306 INFO:teuthology.orchestra.run.smithi035.stdout: "mode": "asynchronous" 2023-03-17T08:57:09.306 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T08:57:09.307 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa03409f6c0 msgr2=0x7fa0340a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:10.294 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa03409f6c0 0x7fa0340a1b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa044005fd0 tx=0x7fa044005f60 comp rx=0 tx=0).stop 2023-03-17T08:57:10.294 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 msgr2=0x7fa048196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:10.294 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 0x7fa048196920 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b530 tx=0x7fa03800b8f0 comp rx=0 tx=0).stop 2023-03-17T08:57:10.294 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 shutdown_connections 2023-03-17T08:57:10.294 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa03409f6c0 0x7fa0340a1b70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:10.294 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa04810a760 0x7fa04819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:10.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa048101420 0x7fa0481963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:10.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 --2- 172.21.15.35:0/1364030454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa048101d30 0x7fa048196920 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:10.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 >> 172.21.15.35:0/1364030454 conn(0x7fa048076300 msgr2=0x7fa0481021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:10.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 shutdown_connections 2023-03-17T08:57:10.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T08:55:10.185+0000 7fa0505dc700 1 -- 172.21.15.35:0/1364030454 wait complete. 2023-03-17T08:57:10.296 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-17T08:57:10.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:10 smithi035 ceph-mon[92535]: pgmap v277: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:57:11.057 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:11 smithi035 ceph-mon[92535]: scrub queued for path: / 2023-03-17T08:57:11.057 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:11 smithi035 ceph-mon[92535]: scrub summary: idle+waiting paths [/] 2023-03-17T08:57:11.057 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:11 smithi035 ceph-mon[92535]: scrub summary: active paths [/] 2023-03-17T08:57:11.057 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:11 smithi035 ceph-mon[92535]: scrub summary: idle+waiting paths [/] 2023-03-17T08:57:11.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:12 smithi035 ceph-mon[92535]: pgmap v278: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T08:57:11.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:14 smithi035 ceph-mon[92535]: pgmap v279: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2023-03-17T08:57:11.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:14 smithi035 ceph-mon[92535]: scrub summary: idle 2023-03-17T08:57:11.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:15 smithi035 ceph-mon[92535]: pgmap v280: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 10 op/s 2023-03-17T08:57:11.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:18 smithi035 ceph-mon[92535]: pgmap v281: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 682 B/s wr, 14 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:00 smithi082 ceph-mon[94281]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:02 smithi082 ceph-mon[94281]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:04 smithi082 ceph-mon[94281]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:06 smithi082 ceph-mon[94281]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:08 smithi082 ceph-mon[94281]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:00 smithi078 ceph-mon[94114]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:02 smithi078 ceph-mon[94114]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:04 smithi078 ceph-mon[94114]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:06 smithi078 ceph-mon[94114]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:57:11.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:08 smithi078 ceph-mon[94114]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T08:57:11.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:10 smithi082 ceph-mon[94281]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T08:57:12.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:10 smithi082 ceph-mon[94281]: osdmap e95: 12 total, 12 up, 12 in 2023-03-17T08:57:12.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:10 smithi078 ceph-mon[94114]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T08:57:12.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:10 smithi078 ceph-mon[94114]: osdmap e95: 12 total, 12 up, 12 in 2023-03-17T08:57:12.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:12 smithi082 ceph-mon[94281]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T08:57:12.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:12 smithi078 ceph-mon[94114]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T08:57:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2713915562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 msgr2=0x7f89b40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2713915562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b40ff720 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f89b00099c0 tx=0x7f89b0009cd0 comp rx=0 tx=0).stop 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2713915562 shutdown_connections 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2713915562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89b4104390 0x7f89b410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2713915562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b40ff720 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2713915562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89b40ffcf0 0x7f89b4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2713915562 >> 172.21.15.35:0/2713915562 conn(0x7f89b4076330 msgr2=0x7f89b4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2713915562 shutdown_connections 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2713915562 wait complete. 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 Processor -- start 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.080+0000 7f89bbcb0700 1 -- start start 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b4100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89b40ffcf0 0x7f89b4101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89b4104390 0x7f89b41a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4101ac0 con 0x7f89b40ff350 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b41a4990 con 0x7f89b4104390 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b41a4ad0 con 0x7f89b40ffcf0 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b4100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b4100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42784/0 (socket says 172.21.15.35:42784) 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 -- 172.21.15.35:0/2269138958 learned_addr learned my addr 172.21.15.35:0/2269138958 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b924b700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89b40ffcf0 0x7f89b4101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:14.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89ba24d700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89b4104390 0x7f89b41a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:14.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 -- 172.21.15.35:0/2269138958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89b40ffcf0 msgr2=0x7f89b4101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89b40ffcf0 0x7f89b4101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 -- 172.21.15.35:0/2269138958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89b4104390 msgr2=0x7f89b41a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89b4104390 0x7f89b41a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 -- 172.21.15.35:0/2269138958 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00095f0 con 0x7f89b40ff350 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b4100d50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009fd0 tx=0x7f89b000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89aaffd700 1 -- 172.21.15.35:0/2269138958 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b001d070 con 0x7f89b40ff350 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89aaffd700 1 -- 172.21.15.35:0/2269138958 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b00054c0 con 0x7f89b40ff350 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.081+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b410f000 con 0x7f89b40ff350 2023-03-17T08:57:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.082+0000 7f89aaffd700 1 -- 172.21.15.35:0/2269138958 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0004a90 con 0x7f89b40ff350 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.082+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b410ee70 con 0x7f89b40ff350 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.084+0000 7f89aaffd700 1 -- 172.21.15.35:0/2269138958 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f89b000fb80 con 0x7f89b40ff350 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.085+0000 7f89aaffd700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f89a009f640 0x7f89a00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.085+0000 7f89aaffd700 1 -- 172.21.15.35:0/2269138958 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f89b00cb420 con 0x7f89b40ff350 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.085+0000 7f89b924b700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f89a009f640 0x7f89a00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.085+0000 7f89b924b700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f89a009f640 0x7f89a00a1af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89b4102540 tx=0x7f89a4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 Processor -- start 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 -- start start 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a81fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a7c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a7cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5983010 con 0x55bea5a81be0 2023-03-17T08:57:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea59d5950 con 0x55bea5a7c960 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.086+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea59cede0 con 0x55bea5a824f0 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a81fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a81fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42792/0 (socket says 172.21.15.35:42792) 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 -- 172.21.15.35:0/49671106 learned_addr learned my addr 172.21.15.35:0/49671106 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b924b700 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a7c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89ba24d700 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a7cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 -- 172.21.15.35:0/49671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 msgr2=0x55bea5a7c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a7c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 -- 172.21.15.35:0/49671106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 msgr2=0x55bea5a7cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a7cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 -- 172.21.15.35:0/49671106 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bea58505d0 con 0x55bea5a81be0 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a81fb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f89b00a0bc0 tx=0x7f89b0098c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a4e6bb77bf6e43 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f899ffff700 1 -- 172.21.15.35:0/49671106 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0097190 con 0x55bea5a81be0 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f899ffff700 1 -- 172.21.15.35:0/49671106 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b00991f0 con 0x55bea5a81be0 2023-03-17T08:57:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.087+0000 7f899ffff700 1 -- 172.21.15.35:0/49671106 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00a0ec0 con 0x55bea5a81be0 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 -- 172.21.15.35:0/49671106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 msgr2=0x55bea5a81fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a81fb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f89b00a0bc0 tx=0x7f89b0098c00 comp rx=0 tx=0).stop 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 -- 172.21.15.35:0/49671106 shutdown_connections 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a7cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a81fb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/49671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a7c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 -- 172.21.15.35:0/49671106 >> 172.21.15.35:0/49671106 conn(0x55bea58d96b0 msgr2=0x55bea5a76a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 -- 172.21.15.35:0/49671106 shutdown_connections 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 -- 172.21.15.35:0/49671106 wait complete. 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.088+0000 7f89c7e3db80 1 -- start start 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 Processor -- start 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a7c960 0x55bea5a88440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a856c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a85d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea58528c0 con 0x55bea5a81be0 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a86480 con 0x55bea5a824f0 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a91cf0 con 0x55bea5a7c960 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89c7e3db80 10 client.0 _ll_register_callbacks cb 0x55bea5874230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b924b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b924b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a856c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42800/0 (socket says 172.21.15.35:42800) 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b924b700 1 -- 172.21.15.35:0/542166076 learned_addr learned my addr 172.21.15.35:0/542166076 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a7c960 0x55bea5a88440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89ba24d700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a85d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b924b700 1 -- 172.21.15.35:0/542166076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a7c960 msgr2=0x55bea5a88440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b924b700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a7c960 0x55bea5a88440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.089+0000 7f89b924b700 1 -- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 msgr2=0x55bea5a85d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89b924b700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a85d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89b924b700 1 -- 172.21.15.35:0/542166076 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b410ee70 con 0x55bea5a81be0 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89ba24d700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a85d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a7c960 0x55bea5a88440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89b924b700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a856c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f89a4004520 tx=0x7f89a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cb5f2a2a7e52df server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f899d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:57:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f899d7fa700 1 -- 172.21.15.35:0/542166076 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4022070 con 0x55bea5a81be0 2023-03-17T08:57:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f899d7fa700 1 -- 172.21.15.35:0/542166076 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f89a4004550 con 0x55bea5a81be0 2023-03-17T08:57:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bea5991390 con 0x55bea5a81be0 2023-03-17T08:57:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f899d7fa700 1 -- 172.21.15.35:0/542166076 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89a4027420 con 0x55bea5a81be0 2023-03-17T08:57:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89c7e3db80 10 client.15600 fetch_fsmap learned FSMap version 29 2023-03-17T08:57:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bea57fcd80 con 0x55bea5a81be0 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f899d7fa700 1 -- 172.21.15.35:0/542166076 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bea5991390 con 0x55bea5a81be0 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.090+0000 7f899d7fa700 1 -- 172.21.15.35:0/542166076 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f89a401d890 con 0x55bea5a81be0 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89c7e3db80 10 client.15600 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89c7e3db80 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89c7e3db80 20 client.15600 populate_metadata read hostname 'smithi035' 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5a95e90 0x55bea5a982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89c7e3db80 4 client.15600 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bea599d600 con 0x55bea5a95e90 2023-03-17T08:57:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5a95e90 0x55bea5a982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f899d7fa700 10 client.15600 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.091+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5a95e90 0x55bea5a982a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680640b1c4eb3ac1 server_cookie=6e4cb7d3243fd560 in_seq=0 out_seq=0 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.092+0000 7f899d7fa700 1 -- 172.21.15.35:0/542166076 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55bea599d600 con 0x55bea5a95e90 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.092+0000 7f899d7fa700 10 client.15600 handle_command_reply: tid=0 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.092+0000 7f89c7e3db80 1 client.15600 shutdown 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 msgr2=0x55bea5a856c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a856c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f89a4004520 tx=0x7f89a40047c0 comp rx=0 tx=0).stop 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 shutdown_connections 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5a95e90 0x55bea5a982a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a85d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a7c960 0x55bea5a88440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/542166076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a856c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f899d7fa700 0 client.15600 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 >> 172.21.15.35:0/542166076 conn(0x55bea58d96b0 msgr2=0x55bea5a7b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 shutdown_connections 2023-03-17T08:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 1 -- 172.21.15.35:0/542166076 wait complete. 2023-03-17T08:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.093+0000 7f89c7e3db80 20 client.15600 trim_cache size 0 max 16384 2023-03-17T08:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 Processor -- start 2023-03-17T08:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 -- start start 2023-03-17T08:57:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a76ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a8ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a82990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a83af0 con 0x55bea5a81be0 2023-03-17T08:57:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a91b60 con 0x55bea5a7c960 2023-03-17T08:57:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a77000 con 0x55bea5a824f0 2023-03-17T08:57:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89b924b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a8ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89b924b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a8ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42808/0 (socket says 172.21.15.35:42808) 2023-03-17T08:57:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89b924b700 1 -- 172.21.15.35:0/2111284917 learned_addr learned my addr 172.21.15.35:0/2111284917 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a76ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89ba24d700 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a82990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.108+0000 7f89b924b700 1 -- 172.21.15.35:0/2111284917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 msgr2=0x55bea5a82990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89b924b700 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a82990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89b924b700 1 -- 172.21.15.35:0/2111284917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 msgr2=0x55bea5a76ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89b924b700 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a76ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89b924b700 1 -- 172.21.15.35:0/2111284917 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bea5995130 con 0x55bea5a81be0 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a76ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89b924b700 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a8ccc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f89a4016040 tx=0x7f89a40092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dba6258b86011f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89a8dae700 1 -- 172.21.15.35:0/2111284917 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4022070 con 0x55bea5a81be0 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89a8dae700 1 -- 172.21.15.35:0/2111284917 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89a4004550 con 0x55bea5a81be0 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89a8dae700 1 -- 172.21.15.35:0/2111284917 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4027d50 con 0x55bea5a81be0 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 -- 172.21.15.35:0/2111284917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 msgr2=0x55bea5a8ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a8ccc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f89a4016040 tx=0x7f89a40092d0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 -- 172.21.15.35:0/2111284917 shutdown_connections 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a824f0 0x55bea5a82990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a7c960 0x55bea5a76ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/2111284917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a81be0 0x55bea5a8ccc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 -- 172.21.15.35:0/2111284917 >> 172.21.15.35:0/2111284917 conn(0x55bea58d96b0 msgr2=0x55bea5a91450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.109+0000 7f89c7e3db80 1 -- 172.21.15.35:0/2111284917 shutdown_connections 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 -- 172.21.15.35:0/2111284917 wait complete. 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 -- start start 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 Processor -- start 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 0x55bea5ae3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a81be0 0x55bea5ae36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a8aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a8b3b0 con 0x55bea5a7c960 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a8b520 con 0x55bea5a824f0 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bea5a8b6e0 con 0x55bea5a81be0 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89c7e3db80 10 client.0 _ll_register_callbacks cb 0x55bea5874230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89b9a4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 0x55bea5ae3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89b9a4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 0x55bea5ae3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42812/0 (socket says 172.21.15.35:42812) 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.110+0000 7f89b9a4c700 1 -- 172.21.15.35:0/1430356686 learned_addr learned my addr 172.21.15.35:0/1430356686 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89ba24d700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a8aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b924b700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a81be0 0x55bea5ae36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b9a4c700 1 -- 172.21.15.35:0/1430356686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a81be0 msgr2=0x55bea5ae36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a81be0 0x55bea5ae36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b9a4c700 1 -- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 msgr2=0x55bea5a8aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a8aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b9a4c700 1 -- 172.21.15.35:0/1430356686 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bea58505d0 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89ba24d700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a8aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b924b700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a81be0 0x55bea5ae36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89b9a4c700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 0x55bea5ae3160 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f89b0098f20 tx=0x7f89b0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb0003d2f015479 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f899d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f899d7fa700 1 -- 172.21.15.35:0/1430356686 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00b1250 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f899d7fa700 1 -- 172.21.15.35:0/1430356686 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f89b0098480 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bea5a4c1e0 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f899d7fa700 1 -- 172.21.15.35:0/1430356686 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89b0098640 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89c7e3db80 10 client.15606 fetch_fsmap learned FSMap version 29 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bea57fcd80 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.111+0000 7f899d7fa700 1 -- 172.21.15.35:0/1430356686 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b0063080 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f899d7fa700 1 -- 172.21.15.35:0/1430356686 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f89b0093c30 con 0x55bea5a7c960 2023-03-17T08:57:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89c7e3db80 10 client.15606 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89c7e3db80 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89c7e3db80 20 client.15606 populate_metadata read hostname 'smithi035' 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5aeaaa0 0x55bea5aece80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89c7e3db80 4 client.15606 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bea5852f00 con 0x55bea5aeaaa0 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89b924b700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5aeaaa0 0x55bea5aece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f89b924b700 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5aeaaa0 0x55bea5aece80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf6acc159b5163f6 server_cookie=1781967a9b7688ac in_seq=0 out_seq=0 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.112+0000 7f899d7fa700 10 client.15606 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.116+0000 7f899d7fa700 1 -- 172.21.15.35:0/1430356686 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bea5852f00 con 0x55bea5aeaaa0 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.116+0000 7f899d7fa700 10 client.15606 handle_command_reply: tid=0 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.116+0000 7f89c7e3db80 1 client.15606 shutdown 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.116+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 msgr2=0x55bea5ae3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.116+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 0x55bea5ae3160 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f89b0098f20 tx=0x7f89b0005e80 comp rx=0 tx=0).stop 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 shutdown_connections 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bea5aeaaa0 0x55bea5aece80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bea5a824f0 0x55bea5a8aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bea5a7c960 0x55bea5ae3160 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f899d7fa700 0 client.15606 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 --2- 172.21.15.35:0/1430356686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bea5a81be0 0x55bea5ae36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 >> 172.21.15.35:0/1430356686 conn(0x55bea58d96b0 msgr2=0x55bea5a920b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 shutdown_connections 2023-03-17T08:57:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 1 -- 172.21.15.35:0/1430356686 wait complete. 2023-03-17T08:57:22.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89c7e3db80 20 client.15606 trim_cache size 0 max 16384 2023-03-17T08:57:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:57:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:57:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:57:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:57:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f89a009f640 msgr2=0x7f89a00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f89a009f640 0x7f89a00a1af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89b4102540 tx=0x7f89a4009260 comp rx=0 tx=0).stop 2023-03-17T08:57:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 msgr2=0x7f89b4100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b4100d50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009fd0 tx=0x7f89b000f690 comp rx=0 tx=0).stop 2023-03-17T08:57:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 shutdown_connections 2023-03-17T08:57:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f89a009f640 0x7f89a00a1af0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89b4104390 0x7f89b41a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f89b40ff350 0x7f89b4100d50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 --2- 172.21.15.35:0/2269138958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89b40ffcf0 0x7f89b4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 >> 172.21.15.35:0/2269138958 conn(0x7f89b4076330 msgr2=0x7f89b4068de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 shutdown_connections 2023-03-17T08:57:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:20.117+0000 7f89bbcb0700 1 -- 172.21.15.35:0/2269138958 wait complete. 2023-03-17T08:57:23.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:14 smithi078 ceph-mon[94114]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:57:24.412 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:16 smithi078 ceph-mon[94114]: osdmap e96: 12 total, 12 up, 12 in 2023-03-17T08:57:24.412 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:16 smithi078 ceph-mon[94114]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T08:57:24.794 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:18 smithi078 ceph-mon[94114]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T08:57:24.794 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:20 smithi078 ceph-mon[94114]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:57:24.794 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:22 smithi078 ceph-mon[94114]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:57:24.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:14 smithi082 ceph-mon[94281]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:57:24.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:16 smithi082 ceph-mon[94281]: osdmap e96: 12 total, 12 up, 12 in 2023-03-17T08:57:24.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:16 smithi082 ceph-mon[94281]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T08:57:24.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:18 smithi082 ceph-mon[94281]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T08:57:24.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:20 smithi082 ceph-mon[94281]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:57:24.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:22 smithi082 ceph-mon[94281]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:20 smithi035 ceph-mon[92535]: pgmap v282: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:22 smithi035 ceph-mon[92535]: pgmap v283: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 597 B/s wr, 9 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:24 smithi035 ceph-mon[92535]: pgmap v284: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 853 B/s wr, 14 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:25 smithi035 ceph-mon[92535]: pgmap v285: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:28 smithi035 ceph-mon[92535]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:30 smithi035 ceph-mon[92535]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:32 smithi035 ceph-mon[92535]: pgmap v288: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:57:25.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:57:25.754 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:24 smithi078 ceph-mon[94114]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T08:57:26.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:24 smithi082 ceph-mon[94281]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T08:57:26.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:26 smithi078 ceph-mon[94114]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 510 B/s wr, 10 op/s 2023-03-17T08:57:26.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:26 smithi082 ceph-mon[94281]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 510 B/s wr, 10 op/s 2023-03-17T08:57:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 -- 172.21.15.35:0/3849353577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36900ffd50 msgr2=0x7f3690103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 --2- 172.21.15.35:0/3849353577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36900ffd50 0x7f3690103d10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f368c0099c0 tx=0x7f368c009cd0 comp rx=0 tx=0).stop 2023-03-17T08:57:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 -- 172.21.15.35:0/3849353577 shutdown_connections 2023-03-17T08:57:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 --2- 172.21.15.35:0/3849353577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36901043f0 0x7f369010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 --2- 172.21.15.35:0/3849353577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900ff3b0 0x7f36900ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:28.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 --2- 172.21.15.35:0/3849353577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36900ffd50 0x7f3690103d10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:28.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 -- 172.21.15.35:0/3849353577 >> 172.21.15.35:0/3849353577 conn(0x7f3690075f60 msgr2=0x7f3690076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:28.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 -- 172.21.15.35:0/3849353577 shutdown_connections 2023-03-17T08:57:28.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 -- 172.21.15.35:0/3849353577 wait complete. 2023-03-17T08:57:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.232+0000 7f36978b3700 1 Processor -- start 2023-03-17T08:57:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 -- start start 2023-03-17T08:57:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ff3b0 0x7f3690196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900ffd50 0x7f36901967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 0x7f369019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369019b270 con 0x7f36901043f0 2023-03-17T08:57:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369019b3e0 con 0x7f36900ffd50 2023-03-17T08:57:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36978b3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369019b5a0 con 0x7f36900ff3b0 2023-03-17T08:57:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 0x7f369019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 0x7f369019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42830/0 (socket says 172.21.15.35:42830) 2023-03-17T08:57:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 -- 172.21.15.35:0/1922710652 learned_addr learned my addr 172.21.15.35:0/1922710652 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3694e4e700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900ffd50 0x7f36901967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f369564f700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ff3b0 0x7f3690196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 -- 172.21.15.35:0/1922710652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ff3b0 msgr2=0x7f3690196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ff3b0 0x7f3690196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 -- 172.21.15.35:0/1922710652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900ffd50 msgr2=0x7f36901967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900ffd50 0x7f36901967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:31.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 -- 172.21.15.35:0/1922710652 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0095f0 con 0x7f36901043f0 2023-03-17T08:57:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f3695e50700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 0x7f369019ac30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3688007d70 tx=0x7f368800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.233+0000 7f36867fc700 1 -- 172.21.15.35:0/1922710652 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800ac90 con 0x7f36901043f0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.234+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369010f070 con 0x7f36901043f0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.234+0000 7f36867fc700 1 -- 172.21.15.35:0/1922710652 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f368800adf0 con 0x7f36901043f0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.234+0000 7f36867fc700 1 -- 172.21.15.35:0/1922710652 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880115e0 con 0x7f36901043f0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.234+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369010eee0 con 0x7f36901043f0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.236+0000 7f36867fc700 1 -- 172.21.15.35:0/1922710652 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3688012420 con 0x7f36901043f0 2023-03-17T08:57:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.236+0000 7f36867fc700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f367c09f640 0x7f367c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.236+0000 7f36867fc700 1 -- 172.21.15.35:0/1922710652 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f36880ca650 con 0x7f36901043f0 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.236+0000 7f369564f700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f367c09f640 0x7f367c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.237+0000 7f369564f700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f367c09f640 0x7f367c0a1af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3680009c60 tx=0x7f3680009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.237+0000 7f36a3a40b80 1 Processor -- start 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.237+0000 7f36a3a40b80 1 -- start start 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.237+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a475410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a46fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a47bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a372010 con 0x562a6a4701e0 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a3c4950 con 0x562a6a46f830 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a3bdde0 con 0x562a6a475040 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a47bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a47bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42838/0 (socket says 172.21.15.35:42838) 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f369564f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a475410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 -- 172.21.15.35:0/1806133940 learned_addr learned my addr 172.21.15.35:0/1806133940 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3694e4e700 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a46fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 -- 172.21.15.35:0/1806133940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 msgr2=0x562a6a475410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a475410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 -- 172.21.15.35:0/1806133940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 msgr2=0x562a6a46fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a46fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 -- 172.21.15.35:0/1806133940 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a6a23f5d0 con 0x562a6a4701e0 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f369564f700 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a475410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f3695e50700 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a47bdd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3688094740 tx=0x7f3688097ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2046b0f981c530 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f367b7fe700 1 -- 172.21.15.35:0/1806133940 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880a0430 con 0x562a6a4701e0 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f367b7fe700 1 -- 172.21.15.35:0/1806133940 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36880984a0 con 0x562a6a4701e0 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.238+0000 7f367b7fe700 1 -- 172.21.15.35:0/1806133940 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880a0200 con 0x562a6a4701e0 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1806133940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 msgr2=0x562a6a47bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a47bdd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3688094740 tx=0x7f3688097ba0 comp rx=0 tx=0).stop 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1806133940 shutdown_connections 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a47bdd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a475410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1806133940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a46fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1806133940 >> 172.21.15.35:0/1806133940 conn(0x562a6a2c86b0 msgr2=0x562a6a465a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1806133940 shutdown_connections 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1806133940 wait complete. 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.239+0000 7f36a3a40b80 1 -- start start 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 Processor -- start 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a47bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a478fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a479640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a2418c0 con 0x562a6a4701e0 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a479d70 con 0x562a6a46f830 2023-03-17T08:57:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a485480 con 0x562a6a475040 2023-03-17T08:57:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f36a3a40b80 10 client.0 _ll_register_callbacks cb 0x562a6a263230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:57:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f3694e4e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a478fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f3694e4e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a478fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42842/0 (socket says 172.21.15.35:42842) 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f3694e4e700 1 -- 172.21.15.35:0/2469335972 learned_addr learned my addr 172.21.15.35:0/2469335972 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f369564f700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a47bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.240+0000 7f3695e50700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a479640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3694e4e700 1 -- 172.21.15.35:0/2469335972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 msgr2=0x562a6a479640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3694e4e700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a479640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3694e4e700 1 -- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 msgr2=0x562a6a47bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3694e4e700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a47bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3694e4e700 1 -- 172.21.15.35:0/2469335972 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369010eee0 con 0x562a6a4701e0 2023-03-17T08:57:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3695e50700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a479640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:57:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3694e4e700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a478fc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f368c009990 tx=0x7f368c005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d23cdf01ee803b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3678ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:57:36.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3678ff9700 1 -- 172.21.15.35:0/2469335972 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c005600 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3678ff9700 1 -- 172.21.15.35:0/2469335972 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f368c003760 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a6a380390 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3678ff9700 1 -- 172.21.15.35:0/2469335972 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368c003920 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f36a3a40b80 10 client.15618 fetch_fsmap learned FSMap version 29 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562a6a1ebd80 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3678ff9700 1 -- 172.21.15.35:0/2469335972 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f368c031020 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f3678ff9700 1 -- 172.21.15.35:0/2469335972 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f368c00f9a0 con 0x562a6a4701e0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.241+0000 7f36a3a40b80 10 client.15618 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f36a3a40b80 10 client.15618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f36a3a40b80 20 client.15618 populate_metadata read hostname 'smithi035' 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a489550 0x562a6a48b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f36a3a40b80 4 client.15618 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a6a38c600 con 0x562a6a489550 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f369564f700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a489550 0x562a6a48b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:36.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f3678ff9700 10 client.15618 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.242+0000 7f369564f700 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a489550 0x562a6a48b960 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e62b9454d59861 server_cookie=aa43b0f7db22cb87 in_seq=0 out_seq=0 2023-03-17T08:57:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f3678ff9700 1 -- 172.21.15.35:0/2469335972 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562a6a38c600 con 0x562a6a489550 2023-03-17T08:57:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f3678ff9700 10 client.15618 handle_command_reply: tid=0 2023-03-17T08:57:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 client.15618 shutdown 2023-03-17T08:57:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 msgr2=0x562a6a478fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:37.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a478fc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f368c009990 tx=0x7f368c005c40 comp rx=0 tx=0).stop 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 shutdown_connections 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a489550 0x562a6a48b960 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a479640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f3678ff9700 0 client.15618 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a47bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/2469335972 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a478fc0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 >> 172.21.15.35:0/2469335972 conn(0x562a6a2c86b0 msgr2=0x562a6a46a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 shutdown_connections 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 1 -- 172.21.15.35:0/2469335972 wait complete. 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.243+0000 7f36a3a40b80 20 client.15618 trim_cache size 0 max 16384 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.258+0000 7f36a3a40b80 1 Processor -- start 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.258+0000 7f36a3a40b80 1 -- start start 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a465ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a4803d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a478780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a466000 con 0x562a6a4701e0 2023-03-17T08:57:38.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a4610d0 con 0x562a6a46f830 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a4625c0 con 0x562a6a475040 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a4803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a4803d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42850/0 (socket says 172.21.15.35:42850) 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 -- 172.21.15.35:0/3143979595 learned_addr learned my addr 172.21.15.35:0/3143979595 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3695e50700 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a478780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 -- 172.21.15.35:0/3143979595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 msgr2=0x562a6a478780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a478780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 -- 172.21.15.35:0/3143979595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 msgr2=0x562a6a465ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f369564f700 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a465ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a465ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 -- 172.21.15.35:0/3143979595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a6a384130 con 0x562a6a4701e0 2023-03-17T08:57:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3695e50700 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a478780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:57:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f3694e4e700 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a4803d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f368c000c00 tx=0x7f368c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb435bac196492a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f367bfff700 1 -- 172.21.15.35:0/3143979595 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c005600 con 0x562a6a4701e0 2023-03-17T08:57:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f367bfff700 1 -- 172.21.15.35:0/3143979595 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f368c031070 con 0x562a6a4701e0 2023-03-17T08:57:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.259+0000 7f367bfff700 1 -- 172.21.15.35:0/3143979595 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00f6e0 con 0x562a6a4701e0 2023-03-17T08:57:40.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 -- 172.21.15.35:0/3143979595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 msgr2=0x562a6a4803d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a4803d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f368c000c00 tx=0x7f368c009cd0 comp rx=0 tx=0).stop 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 -- 172.21.15.35:0/3143979595 shutdown_connections 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a478780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a46f830 0x562a6a465ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/3143979595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a4701e0 0x562a6a4803d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 -- 172.21.15.35:0/3143979595 >> 172.21.15.35:0/3143979595 conn(0x562a6a2c86b0 msgr2=0x562a6a474250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 -- 172.21.15.35:0/3143979595 shutdown_connections 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 -- 172.21.15.35:0/3143979595 wait complete. 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 -- start start 2023-03-17T08:57:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.260+0000 7f36a3a40b80 1 Processor -- start 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 0x562a6a47eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a4701e0 0x562a6a47f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a47f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a4dd450 con 0x562a6a46f830 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a4dd590 con 0x562a6a4701e0 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a6a4dd750 con 0x562a6a475040 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f36a3a40b80 10 client.0 _ll_register_callbacks cb 0x562a6a263230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 0x562a6a47eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 0x562a6a47eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42854/0 (socket says 172.21.15.35:42854) 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 -- 172.21.15.35:0/1165925855 learned_addr learned my addr 172.21.15.35:0/1165925855 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f3694e4e700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a4701e0 0x562a6a47f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f3695e50700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a47f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 -- 172.21.15.35:0/1165925855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 msgr2=0x562a6a47f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a47f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 -- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a4701e0 msgr2=0x562a6a47f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:57:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a4701e0 0x562a6a47f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 -- 172.21.15.35:0/1165925855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a6a1ebd80 con 0x562a6a46f830 2023-03-17T08:57:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f3694e4e700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a4701e0 0x562a6a47f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:57:43.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f369564f700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 0x562a6a47eba0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x562a6a48c230 tx=0x7f36800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f495336d3492 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.261+0000 7f3678ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f3678ff9700 1 -- 172.21.15.35:0/1165925855 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680022040 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f3678ff9700 1 -- 172.21.15.35:0/1165925855 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f368002b2f0 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a6a43b1e0 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f3678ff9700 1 -- 172.21.15.35:0/1165925855 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368002b4b0 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 10 client.15624 fetch_fsmap learned FSMap version 29 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562a6a2121f0 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f3678ff9700 1 -- 172.21.15.35:0/1165925855 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a6a43b1e0 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f3678ff9700 1 -- 172.21.15.35:0/1165925855 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3680035530 con 0x562a6a46f830 2023-03-17T08:57:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 10 client.15624 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 10 client.15624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 20 client.15624 populate_metadata read hostname 'smithi035' 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a4dede0 0x562a6a4e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 4 client.15624 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a6a241f00 con 0x562a6a4dede0 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.262+0000 7f3694e4e700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a4dede0 0x562a6a4e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:57:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.263+0000 7f3678ff9700 10 client.15624 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.263+0000 7f3694e4e700 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a4dede0 0x562a6a4e11f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d7b22c108752f5 server_cookie=d3156d05fafefebe in_seq=0 out_seq=0 2023-03-17T08:57:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f3678ff9700 1 -- 172.21.15.35:0/1165925855 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a6a241f00 con 0x562a6a4dede0 2023-03-17T08:57:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f3678ff9700 10 client.15624 handle_command_reply: tid=0 2023-03-17T08:57:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 client.15624 shutdown 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 msgr2=0x562a6a47eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 0x562a6a47eba0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x562a6a48c230 tx=0x7f36800047c0 comp rx=0 tx=0).stop 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 shutdown_connections 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a6a4dede0 0x562a6a4e11f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a6a475040 0x562a6a47f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a6a46f830 0x562a6a47eba0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f3678ff9700 0 client.15624 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 --2- 172.21.15.35:0/1165925855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a6a4701e0 0x562a6a47f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 >> 172.21.15.35:0/1165925855 conn(0x562a6a2c86b0 msgr2=0x562a6a47a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 shutdown_connections 2023-03-17T08:57:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 1 -- 172.21.15.35:0/1165925855 wait complete. 2023-03-17T08:57:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36a3a40b80 20 client.15624 trim_cache size 0 max 16384 2023-03-17T08:57:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:57:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:57:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:57:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:57:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f367c09f640 msgr2=0x7f367c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36978b3700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f367c09f640 0x7f367c0a1af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3680009c60 tx=0x7f3680009260 comp rx=0 tx=0).stop 2023-03-17T08:57:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 msgr2=0x7f369019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36978b3700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 0x7f369019ac30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3688007d70 tx=0x7f368800a340 comp rx=0 tx=0).stop 2023-03-17T08:57:47.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 shutdown_connections 2023-03-17T08:57:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.267+0000 7f36978b3700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f367c09f640 0x7f367c0a1af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.268+0000 7f36978b3700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f36901043f0 0x7f369019ac30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.268+0000 7f36978b3700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36900ff3b0 0x7f3690196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.268+0000 7f36978b3700 1 --2- 172.21.15.35:0/1922710652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900ffd50 0x7f36901967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.268+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 >> 172.21.15.35:0/1922710652 conn(0x7f3690075f60 msgr2=0x7f3690068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:49.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.268+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 shutdown_connections 2023-03-17T08:57:49.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:33.268+0000 7f36978b3700 1 -- 172.21.15.35:0/1922710652 wait complete. 2023-03-17T08:57:49.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:34 smithi035 ceph-mon[92535]: pgmap v289: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:35 smithi035 ceph-mon[92535]: pgmap v290: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:38 smithi035 ceph-mon[92535]: pgmap v291: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:40 smithi035 ceph-mon[92535]: pgmap v292: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:42 smithi035 ceph-mon[92535]: pgmap v293: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:49.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:44 smithi035 ceph-mon[92535]: pgmap v294: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:49.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:28 smithi078 ceph-mon[94114]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T08:57:51.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:30 smithi078 ceph-mon[94114]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:57:51.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:32 smithi078 ceph-mon[94114]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:57:51.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:34 smithi078 ceph-mon[94114]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:57:51.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:36 smithi078 ceph-mon[94114]: pgmap v354: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:51.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:57:51.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:38 smithi078 ceph-mon[94114]: pgmap v355: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:40 smithi078 ceph-mon[94114]: pgmap v356: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:42 smithi078 ceph-mon[94114]: pgmap v357: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:44 smithi078 ceph-mon[94114]: pgmap v358: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:52.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:46 smithi078 ceph-mon[94114]: pgmap v359: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:57:52.348 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:48 smithi078 ceph-mon[94114]: pgmap v360: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:52.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:28 smithi082 ceph-mon[94281]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T08:57:53.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:30 smithi082 ceph-mon[94281]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:57:53.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:32 smithi082 ceph-mon[94281]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:57:53.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:34 smithi082 ceph-mon[94281]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T08:57:53.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:36 smithi082 ceph-mon[94281]: pgmap v354: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:53.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:57:54.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:57:54.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:57:54.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:57:54.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:38 smithi082 ceph-mon[94281]: pgmap v355: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:54.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:40 smithi082 ceph-mon[94281]: pgmap v356: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:54.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:42 smithi082 ceph-mon[94281]: pgmap v357: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:54.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:44 smithi082 ceph-mon[94281]: pgmap v358: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:54.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:46 smithi082 ceph-mon[94281]: pgmap v359: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:57:54.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:48 smithi082 ceph-mon[94281]: pgmap v360: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:54.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:50 smithi078 ceph-mon[94114]: pgmap v361: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:55.381 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:52 smithi078 ceph-mon[94114]: pgmap v362: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:55.381 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:50 smithi082 ceph-mon[94281]: pgmap v361: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:55.381 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:52 smithi082 ceph-mon[94281]: pgmap v362: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:55.383 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:54 smithi078 ceph-mon[94114]: pgmap v363: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:56.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:54 smithi082 ceph-mon[94281]: pgmap v363: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:57:56.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:56 smithi082 ceph-mon[94281]: pgmap v364: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:57.912 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:56 smithi078 ceph-mon[94114]: pgmap v364: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:57:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 -- 172.21.15.35:0/4259024002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a40fe850 msgr2=0x7fd7a40fecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:57:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 --2- 172.21.15.35:0/4259024002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a40fe850 0x7fd7a40fecc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd798009990 tx=0x7fd798009ca0 comp rx=0 tx=0).stop 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 -- 172.21.15.35:0/4259024002 shutdown_connections 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 --2- 172.21.15.35:0/4259024002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 0x7fd7a410b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 --2- 172.21.15.35:0/4259024002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a4104860 0x7fd7a4104c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 --2- 172.21.15.35:0/4259024002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a40fe850 0x7fd7a40fecc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 -- 172.21.15.35:0/4259024002 >> 172.21.15.35:0/4259024002 conn(0x7fd7a40757a0 msgr2=0x7fd7a4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 -- 172.21.15.35:0/4259024002 shutdown_connections 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.389+0000 7fd7abb54700 1 -- 172.21.15.35:0/4259024002 wait complete. 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 Processor -- start 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 -- start start 2023-03-17T08:57:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40fe850 0x7fd7a4100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 0x7fd7a41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:57:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 0x7fd7a41a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41011d0 con 0x7fd7a4104860 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41a4a40 con 0x7fd7a40fe850 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7abb54700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a41a4b80 con 0x7fd7a40ff200 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7aa0f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 0x7fd7a41a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7aa0f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 0x7fd7a41a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42872/0 (socket says 172.21.15.35:42872) 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/526495463 learned_addr learned my addr 172.21.15.35:0/526495463 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40fe850 0x7fd7a4100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.390+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 0x7fd7a41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/526495463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 msgr2=0x7fd7a41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 0x7fd7a41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/526495463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40fe850 msgr2=0x7fd7a4100460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40fe850 0x7fd7a4100460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/526495463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7980095f0 con 0x7fd7a4104860 2023-03-17T08:58:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 0x7fd7a41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:58:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 0x7fd7a41a4500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00ef30 tx=0x7fd79c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:02.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd796ffd700 1 -- 172.21.15.35:0/526495463 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c018070 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd796ffd700 1 -- 172.21.15.35:0/526495463 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd79c00f040 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a410e790 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd796ffd700 1 -- 172.21.15.35:0/526495463 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c00cc70 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.391+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a410e600 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.393+0000 7fd796ffd700 1 -- 172.21.15.35:0/526495463 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd79c007500 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.394+0000 7fd796ffd700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd79009f6c0 0x7fd7900a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.394+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd79009f6c0 0x7fd7900a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.394+0000 7fd796ffd700 1 -- 172.21.15.35:0/526495463 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd79c0ca170 con 0x7fd7a4104860 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd79009f6c0 0x7fd7900a1b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40ff990 tx=0x7fd7a0007400 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 Processor -- start 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 -- start start 2023-03-17T08:58:02.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed56ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed56a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 0x55efed56ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed471010 con 0x55efed56a960 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed4c3950 con 0x55efed56fbe0 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.395+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed4bcde0 con 0x55efed5704f0 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 0x55efed56ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 0x55efed56ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42880/0 (socket says 172.21.15.35:42880) 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/2257217914 learned_addr learned my addr 172.21.15.35:0/2257217914 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed56a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed56ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/2257217914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 msgr2=0x55efed56a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed56a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/2257217914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 msgr2=0x55efed56ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed56ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/2257217914 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efed33e5d0 con 0x55efed56a960 2023-03-17T08:58:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 0x55efed56ad90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd79c09f8b0 tx=0x7fd79c097b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ae5089ab9d227 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd78ffff700 1 -- 172.21.15.35:0/2257217914 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0af070 con 0x55efed56a960 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd78ffff700 1 -- 172.21.15.35:0/2257217914 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd79c00ce50 con 0x55efed56a960 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.396+0000 7fd78ffff700 1 -- 172.21.15.35:0/2257217914 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c097370 con 0x55efed56a960 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2257217914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 msgr2=0x55efed56ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 0x55efed56ad90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd79c09f8b0 tx=0x7fd79c097b80 comp rx=0 tx=0).stop 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2257217914 shutdown_connections 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56a960 0x55efed56ad90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed56ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2257217914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed56a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2257217914 >> 172.21.15.35:0/2257217914 conn(0x55efed3c76b0 msgr2=0x55efed564a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2257217914 shutdown_connections 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.397+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2257217914 wait complete. 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 -- start start 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 Processor -- start 2023-03-17T08:58:02.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed576480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed573700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 0x55efed573da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed3408c0 con 0x55efed5704f0 2023-03-17T08:58:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed574510 con 0x55efed56fbe0 2023-03-17T08:58:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed580030 con 0x55efed56a960 2023-03-17T08:58:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7b7ce1b80 10 client.0 _ll_register_callbacks cb 0x55efed362230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:58:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7aa0f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 0x55efed573da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7aa0f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 0x55efed573da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42886/0 (socket says 172.21.15.35:42886) 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/3567314280 learned_addr learned my addr 172.21.15.35:0/3567314280 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed576480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.398+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed573700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/3567314280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 msgr2=0x55efed576480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed576480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 msgr2=0x55efed573700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed573700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7aa0f1700 1 -- 172.21.15.35:0/3567314280 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a410e600 con 0x55efed5704f0 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 0x55efed573da0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0c7e50 tx=0x7fd79c097530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b891d807ff797e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd78d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:58:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd78d7fa700 1 -- 172.21.15.35:0/3567314280 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0c7070 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd78d7fa700 1 -- 172.21.15.35:0/3567314280 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd79c0980e0 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efed47f390 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd78d7fa700 1 -- 172.21.15.35:0/3567314280 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd79c0af070 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7b7ce1b80 10 client.15636 fetch_fsmap learned FSMap version 29 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55efed2ead80 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.399+0000 7fd78d7fa700 1 -- 172.21.15.35:0/3567314280 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55efed47f390 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd78d7fa700 1 -- 172.21.15.35:0/3567314280 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd79c096d00 con 0x55efed5704f0 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7b7ce1b80 10 client.15636 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7b7ce1b80 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7b7ce1b80 20 client.15636 populate_metadata read hostname 'smithi035' 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed583d10 0x55efed586120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7b7ce1b80 4 client.15636 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efed48b600 con 0x55efed583d10 2023-03-17T08:58:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed583d10 0x55efed586120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd78d7fa700 10 client.15636 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.400+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed583d10 0x55efed586120 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abc0a1f1388fe007 server_cookie=4c8c9c8a14c3404 in_seq=0 out_seq=0 2023-03-17T08:58:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd78d7fa700 1 -- 172.21.15.35:0/3567314280 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55efed48b600 con 0x55efed583d10 2023-03-17T08:58:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd78d7fa700 10 client.15636 handle_command_reply: tid=0 2023-03-17T08:58:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 client.15636 shutdown 2023-03-17T08:58:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 msgr2=0x55efed573da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 0x55efed573da0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd79c0c7e50 tx=0x7fd79c097530 comp rx=0 tx=0).stop 2023-03-17T08:58:04.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 shutdown_connections 2023-03-17T08:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed583d10 0x55efed586120 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed5704f0 0x55efed573da0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd78d7fa700 0 client.15636 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed576480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/3567314280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56fbe0 0x55efed573700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.401+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 >> 172.21.15.35:0/3567314280 conn(0x55efed3c76b0 msgr2=0x55efed569410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.402+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 shutdown_connections 2023-03-17T08:58:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.402+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/3567314280 wait complete. 2023-03-17T08:58:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.402+0000 7fd7b7ce1b80 20 client.15636 trim_cache size 0 max 16384 2023-03-17T08:58:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 Processor -- start 2023-03-17T08:58:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 -- start start 2023-03-17T08:58:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed56ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed57af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed5704f0 0x55efed576020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed5615c0 con 0x55efed56fbe0 2023-03-17T08:58:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed5663d0 con 0x55efed5704f0 2023-03-17T08:58:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed574650 con 0x55efed56a960 2023-03-17T08:58:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed57af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed57af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42892/0 (socket says 172.21.15.35:42892) 2023-03-17T08:58:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 -- 172.21.15.35:0/2956464455 learned_addr learned my addr 172.21.15.35:0/2956464455 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed5704f0 0x55efed576020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed56ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 -- 172.21.15.35:0/2956464455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 msgr2=0x55efed56ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed56ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 -- 172.21.15.35:0/2956464455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed5704f0 msgr2=0x55efed576020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed5704f0 0x55efed576020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.417+0000 7fd7a90ef700 1 -- 172.21.15.35:0/2956464455 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efed56b020 con 0x55efed56fbe0 2023-03-17T08:58:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed57af80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd798005910 tx=0x7fd7980056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8daa136a7b1b7924 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd794dae700 1 -- 172.21.15.35:0/2956464455 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798005310 con 0x55efed56fbe0 2023-03-17T08:58:08.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd794dae700 1 -- 172.21.15.35:0/2956464455 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd79801e040 con 0x55efed56fbe0 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd794dae700 1 -- 172.21.15.35:0/2956464455 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798004a60 con 0x55efed56fbe0 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2956464455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 msgr2=0x55efed57af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed57af80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd798005910 tx=0x7fd7980056c0 comp rx=0 tx=0).stop 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2956464455 shutdown_connections 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed5704f0 0x55efed576020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed56a960 0x55efed56ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/2956464455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed57af80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2956464455 >> 172.21.15.35:0/2956464455 conn(0x55efed3c76b0 msgr2=0x55efed56d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2956464455 shutdown_connections 2023-03-17T08:58:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.418+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/2956464455 wait complete. 2023-03-17T08:58:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 -- start start 2023-03-17T08:58:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 Processor -- start 2023-03-17T08:58:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56a960 0x55efed5d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed5d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:16.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed5cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed5cc1a0 con 0x55efed56fbe0 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed5cc310 con 0x55efed56a960 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efed5cc4d0 con 0x55efed5704f0 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7b7ce1b80 10 client.0 _ll_register_callbacks cb 0x55efed362230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7a90ef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed5d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7a90ef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed5d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42898/0 (socket says 172.21.15.35:42898) 2023-03-17T08:58:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.419+0000 7fd7a90ef700 1 -- 172.21.15.35:0/1742945729 learned_addr learned my addr 172.21.15.35:0/1742945729 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56a960 0x55efed5d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7aa0f1700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed5cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a90ef700 1 -- 172.21.15.35:0/1742945729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 msgr2=0x55efed5cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed5cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a90ef700 1 -- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56a960 msgr2=0x55efed5d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56a960 0x55efed5d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a90ef700 1 -- 172.21.15.35:0/1742945729 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a410bf90 con 0x55efed56fbe0 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7a90ef700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed5d06d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd798005850 tx=0x7fd79800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beffe782a973c5fa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd78d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd78d7fa700 1 -- 172.21.15.35:0/1742945729 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798005480 con 0x55efed56fbe0 2023-03-17T08:58:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd78d7fa700 1 -- 172.21.15.35:0/1742945729 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd798004500 con 0x55efed56fbe0 2023-03-17T08:58:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efed53a1e0 con 0x55efed56fbe0 2023-03-17T08:58:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd78d7fa700 1 -- 172.21.15.35:0/1742945729 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7980046c0 con 0x55efed56fbe0 2023-03-17T08:58:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7b7ce1b80 10 client.15642 fetch_fsmap learned FSMap version 29 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.420+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55efed2d3c00 con 0x55efed56fbe0 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd78d7fa700 1 -- 172.21.15.35:0/1742945729 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55efed53a1e0 con 0x55efed56fbe0 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd78d7fa700 1 -- 172.21.15.35:0/1742945729 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd79800f9c0 con 0x55efed56fbe0 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7b7ce1b80 10 client.15642 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7b7ce1b80 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7b7ce1b80 20 client.15642 populate_metadata read hostname 'smithi035' 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed5d8c30 0x55efed5db040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7b7ce1b80 4 client.15642 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:58:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55efed340f00 con 0x55efed5d8c30 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed5d8c30 0x55efed5db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd78d7fa700 10 client.15642 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.421+0000 7fd7a98f0700 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed5d8c30 0x55efed5db040 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c27f68916e1556 server_cookie=fc3aadf66fff419d in_seq=0 out_seq=0 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd78d7fa700 1 -- 172.21.15.35:0/1742945729 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55efed340f00 con 0x55efed5d8c30 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd78d7fa700 10 client.15642 handle_command_reply: tid=0 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd7b7ce1b80 1 client.15642 shutdown 2023-03-17T08:58:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 msgr2=0x55efed5d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed5d06d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd798005850 tx=0x7fd79800b9c0 comp rx=0 tx=0).stop 2023-03-17T08:58:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 shutdown_connections 2023-03-17T08:58:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.425+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efed5d8c30 0x55efed5db040 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efed5704f0 0x55efed5cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efed56a960 0x55efed5d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd78d7fa700 0 client.15642 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:22.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 1 --2- 172.21.15.35:0/1742945729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efed56fbe0 0x55efed5d06d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:22.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 >> 172.21.15.35:0/1742945729 conn(0x55efed3c76b0 msgr2=0x55efed56e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:22.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 shutdown_connections 2023-03-17T08:58:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 1 -- 172.21.15.35:0/1742945729 wait complete. 2023-03-17T08:58:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7b7ce1b80 20 client.15642 trim_cache size 0 max 16384 2023-03-17T08:58:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:58:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:58:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:58:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd79009f6c0 msgr2=0x7fd7900a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd79009f6c0 0x7fd7900a1b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40ff990 tx=0x7fd7a0007400 comp rx=0 tx=0).stop 2023-03-17T08:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 msgr2=0x7fd7a41a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 0x7fd7a41a4500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00ef30 tx=0x7fd79c00c3a0 comp rx=0 tx=0).stop 2023-03-17T08:58:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 shutdown_connections 2023-03-17T08:58:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd79009f6c0 0x7fd7900a1b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd7a4104860 0x7fd7a41a4500 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7a40fe850 0x7fd7a4100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 --2- 172.21.15.35:0/526495463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7a40ff200 0x7fd7a41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 >> 172.21.15.35:0/526495463 conn(0x7fd7a40757a0 msgr2=0x7fd7a40fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 shutdown_connections 2023-03-17T08:58:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:46.426+0000 7fd7abb54700 1 -- 172.21.15.35:0/526495463 wait complete. 2023-03-17T08:58:28.187 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:45 smithi035 ceph-mon[92535]: pgmap v295: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:29.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:48 smithi035 ceph-mon[92535]: pgmap v296: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T08:58:29.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:50 smithi035 ceph-mon[92535]: pgmap v297: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:29.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:52 smithi035 ceph-mon[92535]: pgmap v298: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:29.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:54 smithi035 ceph-mon[92535]: pgmap v299: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:29.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:55 smithi035 ceph-mon[92535]: pgmap v300: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:29.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:55:58 smithi035 ceph-mon[92535]: pgmap v301: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:29.012 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:57:58 smithi082 ceph-mon[94281]: pgmap v365: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:31.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:00 smithi082 ceph-mon[94281]: pgmap v366: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:31.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:02 smithi082 ceph-mon[94281]: pgmap v367: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:31.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:04 smithi082 ceph-mon[94281]: pgmap v368: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:58:31.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:06 smithi082 ceph-mon[94281]: pgmap v369: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:08 smithi082 ceph-mon[94281]: pgmap v370: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:10 smithi082 ceph-mon[94281]: pgmap v371: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:10 smithi082 ceph-mon[94281]: osdmap e97: 12 total, 12 up, 12 in 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:12 smithi082 ceph-mon[94281]: pgmap v373: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:14 smithi082 ceph-mon[94281]: pgmap v374: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:16 smithi082 ceph-mon[94281]: osdmap e98: 12 total, 12 up, 12 in 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:16 smithi082 ceph-mon[94281]: pgmap v376: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T08:58:31.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:18 smithi082 ceph-mon[94281]: pgmap v377: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:20 smithi082 ceph-mon[94281]: pgmap v378: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 824 B/s wr, 11 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:22 smithi082 ceph-mon[94281]: pgmap v379: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:24 smithi082 ceph-mon[94281]: pgmap v380: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:26 smithi082 ceph-mon[94281]: pgmap v381: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:28 smithi082 ceph-mon[94281]: pgmap v382: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:57:58 smithi078 ceph-mon[94114]: pgmap v365: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:31.908 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:00 smithi078 ceph-mon[94114]: pgmap v366: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:02 smithi078 ceph-mon[94114]: pgmap v367: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:04 smithi078 ceph-mon[94114]: pgmap v368: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:06 smithi078 ceph-mon[94114]: pgmap v369: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:08 smithi078 ceph-mon[94114]: pgmap v370: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:10 smithi078 ceph-mon[94114]: pgmap v371: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:10 smithi078 ceph-mon[94114]: osdmap e97: 12 total, 12 up, 12 in 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:12 smithi078 ceph-mon[94114]: pgmap v373: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T08:58:31.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:14 smithi078 ceph-mon[94114]: pgmap v374: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T08:58:31.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:16 smithi078 ceph-mon[94114]: osdmap e98: 12 total, 12 up, 12 in 2023-03-17T08:58:31.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:16 smithi078 ceph-mon[94114]: pgmap v376: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T08:58:33.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:18 smithi078 ceph-mon[94114]: pgmap v377: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:58:33.304 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:20 smithi078 ceph-mon[94114]: pgmap v378: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 824 B/s wr, 11 op/s 2023-03-17T08:58:33.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:22 smithi078 ceph-mon[94114]: pgmap v379: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:58:33.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:24 smithi078 ceph-mon[94114]: pgmap v380: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T08:58:33.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:26 smithi078 ceph-mon[94114]: pgmap v381: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T08:58:33.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:28 smithi078 ceph-mon[94114]: pgmap v382: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:33.861 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:30 smithi082 ceph-mon[94281]: pgmap v383: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:34.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:32 smithi082 ceph-mon[94281]: pgmap v384: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:34.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:30 smithi078 ceph-mon[94114]: pgmap v383: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:34.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:32 smithi078 ceph-mon[94114]: pgmap v384: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:34.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:34 smithi078 ceph-mon[94114]: pgmap v385: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:34.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:34 smithi082 ceph-mon[94281]: pgmap v385: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.548+0000 7f8f337bc700 1 -- 172.21.15.35:0/3895600491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ffcf0 msgr2=0x7f8f2c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.548+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3895600491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ffcf0 0x7f8f2c103cb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0099c0 tx=0x7f8f1c009cd0 comp rx=0 tx=0).stop 2023-03-17T08:58:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 -- 172.21.15.35:0/3895600491 shutdown_connections 2023-03-17T08:58:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3895600491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c104390 0x7f8f2c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3895600491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3895600491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ffcf0 0x7f8f2c103cb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 -- 172.21.15.35:0/3895600491 >> 172.21.15.35:0/3895600491 conn(0x7f8f2c076330 msgr2=0x7f8f2c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 -- 172.21.15.35:0/3895600491 shutdown_connections 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 -- 172.21.15.35:0/3895600491 wait complete. 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 Processor -- start 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.549+0000 7f8f337bc700 1 -- start start 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f337bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f337bc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0ffcf0 0x7f8f2c197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f337bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c104390 0x7f8f2c1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f337bc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c197f50 con 0x7f8f2c0ff350 2023-03-17T08:58:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f337bc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1a26c0 con 0x7f8f2c0ffcf0 2023-03-17T08:58:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f337bc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c1a2830 con 0x7f8f2c104390 2023-03-17T08:58:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42910/0 (socket says 172.21.15.35:42910) 2023-03-17T08:58:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 -- 172.21.15.35:0/3508932437 learned_addr learned my addr 172.21.15.35:0/3508932437 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f30d57700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0ffcf0 0x7f8f2c197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31d59700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c104390 0x7f8f2c1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 -- 172.21.15.35:0/3508932437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c104390 msgr2=0x7f8f2c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c104390 0x7f8f2c1a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 -- 172.21.15.35:0/3508932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0ffcf0 msgr2=0x7f8f2c197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0ffcf0 0x7f8f2c197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.550+0000 7f8f31558700 1 -- 172.21.15.35:0/3508932437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0095f0 con 0x7f8f2c0ff350 2023-03-17T08:58:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.551+0000 7f8f31558700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c197100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800e9a0 tx=0x7f8f2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.551+0000 7f8f227fc700 1 -- 172.21.15.35:0/3508932437 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28009790 con 0x7f8f2c0ff350 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.551+0000 7f8f227fc700 1 -- 172.21.15.35:0/3508932437 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f28010430 con 0x7f8f2c0ff350 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.551+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c10efc0 con 0x7f8f2c0ff350 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.551+0000 7f8f227fc700 1 -- 172.21.15.35:0/3508932437 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800cea0 con 0x7f8f2c0ff350 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.551+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c10ee30 con 0x7f8f2c0ff350 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.553+0000 7f8f227fc700 1 -- 172.21.15.35:0/3508932437 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8f280105a0 con 0x7f8f2c0ff350 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.554+0000 7f8f227fc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8f1809f640 0x7f8f180a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.554+0000 7f8f30d57700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8f1809f640 0x7f8f180a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.554+0000 7f8f227fc700 1 -- 172.21.15.35:0/3508932437 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f8f28014070 con 0x7f8f2c0ff350 2023-03-17T08:58:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.554+0000 7f8f30d57700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8f1809f640 0x7f8f180a1af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c000c00 tx=0x7f8f1c00b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 Processor -- start 2023-03-17T08:58:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 -- start start 2023-03-17T08:58:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe1d040 0x561c9fe1d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe17830 0x561c9fe17ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fd1a010 con 0x561c9fe181e0 2023-03-17T08:58:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fd6c950 con 0x561c9fe17830 2023-03-17T08:58:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fd65de0 con 0x561c9fe1d040 2023-03-17T08:58:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42922/0 (socket says 172.21.15.35:42922) 2023-03-17T08:58:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 -- 172.21.15.35:0/2249243275 learned_addr learned my addr 172.21.15.35:0/2249243275 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe17830 0x561c9fe17ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31558700 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe1d040 0x561c9fe1d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 -- 172.21.15.35:0/2249243275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe1d040 msgr2=0x561c9fe1d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe1d040 0x561c9fe1d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 -- 172.21.15.35:0/2249243275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe17830 msgr2=0x561c9fe17ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe17830 0x561c9fe17ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.555+0000 7f8f31d59700 1 -- 172.21.15.35:0/2249243275 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c9fbe75d0 con 0x561c9fe181e0 2023-03-17T08:58:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.556+0000 7f8f31d59700 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23dd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8f24003f30 tx=0x7f8f24009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d700652359f1fbb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.556+0000 7f8f177fe700 1 -- 172.21.15.35:0/2249243275 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003a00 con 0x561c9fe181e0 2023-03-17T08:58:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.556+0000 7f8f177fe700 1 -- 172.21.15.35:0/2249243275 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f2400f040 con 0x561c9fe181e0 2023-03-17T08:58:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.556+0000 7f8f177fe700 1 -- 172.21.15.35:0/2249243275 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240156e0 con 0x561c9fe181e0 2023-03-17T08:58:45.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2249243275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 msgr2=0x561c9fe23dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23dd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8f24003f30 tx=0x7f8f24009c20 comp rx=0 tx=0).stop 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2249243275 shutdown_connections 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23dd0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe1d040 0x561c9fe1d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2249243275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe17830 0x561c9fe17ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2249243275 >> 172.21.15.35:0/2249243275 conn(0x561c9fc706b0 msgr2=0x561c9fe0da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2249243275 shutdown_connections 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2249243275 wait complete. 2023-03-17T08:58:45.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 -- start start 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.557+0000 7f8f3f949b80 1 Processor -- start 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe23d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe20fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe21590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fbe98c0 con 0x561c9fe181e0 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe21cd0 con 0x561c9fe1d040 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe2d4e0 con 0x561c9fe17830 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 10 client.0 _ll_register_callbacks cb 0x561c9fc0b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:58:45.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe20fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe20fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42926/0 (socket says 172.21.15.35:42926) 2023-03-17T08:58:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 -- 172.21.15.35:0/2030088249 learned_addr learned my addr 172.21.15.35:0/2030088249 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f31558700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe23d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 -- 172.21.15.35:0/2030088249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 msgr2=0x561c9fe23d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f31d59700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe21590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe23d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 -- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 msgr2=0x561c9fe21590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe21590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 -- 172.21.15.35:0/2030088249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f24003b60 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f30d57700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe20fa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0099c0 tx=0x7f8f1c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4cee74e244833 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f14ff9700 1 -- 172.21.15.35:0/2030088249 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c02b040 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f14ff9700 1 -- 172.21.15.35:0/2030088249 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f8f1c00f660 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.558+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c9fd28390 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f14ff9700 1 -- 172.21.15.35:0/2030088249 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f1c00f820 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 10 client.15654 fetch_fsmap learned FSMap version 29 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561c9fb93d80 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f14ff9700 1 -- 172.21.15.35:0/2030088249 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f1c03d020 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f14ff9700 1 -- 172.21.15.35:0/2030088249 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8f1c039740 con 0x561c9fe181e0 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:58:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 20 client.15654 populate_metadata read hostname 'smithi035' 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe31500 0x561c9fe33910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 4 client.15654 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c9fd34600 con 0x561c9fe31500 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.559+0000 7f8f31558700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe31500 0x561c9fe33910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.560+0000 7f8f31558700 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe31500 0x561c9fe33910 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eae2a5065ff9ca73 server_cookie=585cbd96ffd473e2 in_seq=0 out_seq=0 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.560+0000 7f8f14ff9700 10 client.15654 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.560+0000 7f8f14ff9700 1 -- 172.21.15.35:0/2030088249 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561c9fd34600 con 0x561c9fe31500 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.560+0000 7f8f14ff9700 10 client.15654 handle_command_reply: tid=0 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.560+0000 7f8f3f949b80 1 client.15654 shutdown 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 msgr2=0x561c9fe20fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe20fa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0099c0 tx=0x7f8f1c01f000 comp rx=0 tx=0).stop 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 shutdown_connections 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe31500 0x561c9fe33910 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe21590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f14ff9700 0 client.15654 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe23d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/2030088249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe20fa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 >> 172.21.15.35:0/2030088249 conn(0x561c9fc706b0 msgr2=0x561c9fe12410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 shutdown_connections 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 1 -- 172.21.15.35:0/2030088249 wait complete. 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.561+0000 7f8f3f949b80 20 client.15654 trim_cache size 0 max 16384 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 Processor -- start 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 -- start start 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe0dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe1c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe0e000 con 0x561c9fe181e0 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe1da60 con 0x561c9fe1d040 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe0e6b0 con 0x561c9fe17830 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42934/0 (socket says 172.21.15.35:42934) 2023-03-17T08:58:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 -- 172.21.15.35:0/563066555 learned_addr learned my addr 172.21.15.35:0/563066555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f31558700 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe0dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f31d59700 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe1c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 -- 172.21.15.35:0/563066555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 msgr2=0x561c9fe0dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe0dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 -- 172.21.15.35:0/563066555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 msgr2=0x561c9fe1c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe1c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f30d57700 1 -- 172.21.15.35:0/563066555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c9fd2c130 con 0x561c9fe181e0 2023-03-17T08:58:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.576+0000 7f8f31d59700 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe1c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:58:49.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f30d57700 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0098e0 tx=0x7f8f1c009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26973fe38d6a8d25 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f17fff700 1 -- 172.21.15.35:0/563066555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c02b070 con 0x561c9fe181e0 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f17fff700 1 -- 172.21.15.35:0/563066555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f1c03d040 con 0x561c9fe181e0 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f17fff700 1 -- 172.21.15.35:0/563066555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00f840 con 0x561c9fe181e0 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 -- 172.21.15.35:0/563066555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 msgr2=0x561c9fe23850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0098e0 tx=0x7f8f1c009290 comp rx=0 tx=0).stop 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 -- 172.21.15.35:0/563066555 shutdown_connections 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe1c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe0dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/563066555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe23850 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 -- 172.21.15.35:0/563066555 >> 172.21.15.35:0/563066555 conn(0x561c9fc706b0 msgr2=0x561c9fe1b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 -- 172.21.15.35:0/563066555 shutdown_connections 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.577+0000 7f8f3f949b80 1 -- 172.21.15.35:0/563066555 wait complete. 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.578+0000 7f8f3f949b80 1 -- start start 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.578+0000 7f8f3f949b80 1 Processor -- start 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.578+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe26410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:49.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.578+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe26950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f3f949b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe27260 con 0x561c9fe181e0 2023-03-17T08:58:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe848e0 con 0x561c9fe1d040 2023-03-17T08:58:49.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f3f949b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c9fe84a20 con 0x561c9fe17830 2023-03-17T08:58:49.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f3f949b80 10 client.0 _ll_register_callbacks cb 0x561c9fc0b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:58:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe26950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe26950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42940/0 (socket says 172.21.15.35:42940) 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 -- 172.21.15.35:0/1949001398 learned_addr learned my addr 172.21.15.35:0/1949001398 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f31558700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe26410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f31d59700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 -- 172.21.15.35:0/1949001398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 msgr2=0x561c9fe26410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe26410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 -- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 msgr2=0x561c9fe843a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe843a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 -- 172.21.15.35:0/1949001398 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c9fb93d80 con 0x561c9fe181e0 2023-03-17T08:58:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f31d59700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe843a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f30d57700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe26950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0099c0 tx=0x7f8f1c026040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe999bd4333d242 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f14ff9700 1 -- 172.21.15.35:0/1949001398 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c02b040 con 0x561c9fe181e0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f14ff9700 1 -- 172.21.15.35:0/1949001398 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f8f1c03e080 con 0x561c9fe181e0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c9fde31e0 con 0x561c9fe181e0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.579+0000 7f8f14ff9700 1 -- 172.21.15.35:0/1949001398 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f1c00f460 con 0x561c9fe181e0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 10 client.15660 fetch_fsmap learned FSMap version 29 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561c9fbba1f0 con 0x561c9fe181e0 2023-03-17T08:58:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f14ff9700 1 -- 172.21.15.35:0/1949001398 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f1c04f080 con 0x561c9fe181e0 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f14ff9700 1 -- 172.21.15.35:0/1949001398 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8f1c0425d0 con 0x561c9fe181e0 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 20 client.15660 populate_metadata read hostname 'smithi035' 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe85c40 0x561c9fe88050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 4 client.15660 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c9fbe9f00 con 0x561c9fe85c40 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f31558700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe85c40 0x561c9fe88050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.580+0000 7f8f31558700 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe85c40 0x561c9fe88050 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63535190d8d43365 server_cookie=2122dccceb111de6 in_seq=0 out_seq=0 2023-03-17T08:58:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.581+0000 7f8f14ff9700 10 client.15660 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f14ff9700 1 -- 172.21.15.35:0/1949001398 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c9fbe9f00 con 0x561c9fe85c40 2023-03-17T08:58:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f14ff9700 10 client.15660 handle_command_reply: tid=0 2023-03-17T08:58:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 client.15660 shutdown 2023-03-17T08:58:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 msgr2=0x561c9fe26950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe26950 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0099c0 tx=0x7f8f1c026040 comp rx=0 tx=0).stop 2023-03-17T08:58:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 shutdown_connections 2023-03-17T08:58:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c9fe85c40 0x561c9fe88050 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c9fe1d040 0x561c9fe843a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f14ff9700 0 client.15660 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:58:50.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c9fe17830 0x561c9fe26410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:50.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 --2- 172.21.15.35:0/1949001398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c9fe181e0 0x561c9fe26950 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.584+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 >> 172.21.15.35:0/1949001398 conn(0x561c9fc706b0 msgr2=0x561c9fe1c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 shutdown_connections 2023-03-17T08:58:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f3f949b80 1 -- 172.21.15.35:0/1949001398 wait complete. 2023-03-17T08:58:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f3f949b80 20 client.15660 trim_cache size 0 max 16384 2023-03-17T08:58:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:58:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:58:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:58:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:58:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8f1809f640 msgr2=0x7f8f180a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8f1809f640 0x7f8f180a1af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c000c00 tx=0x7f8f1c00b540 comp rx=0 tx=0).stop 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 msgr2=0x7f8f2c197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c197100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800e9a0 tx=0x7f8f2800ecb0 comp rx=0 tx=0).stop 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 shutdown_connections 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8f1809f640 0x7f8f180a1af0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c104390 0x7f8f2c1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8f2c0ff350 0x7f8f2c197100 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 --2- 172.21.15.35:0/3508932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f2c0ffcf0 0x7f8f2c197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 >> 172.21.15.35:0/3508932437 conn(0x7f8f2c076330 msgr2=0x7f8f2c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 shutdown_connections 2023-03-17T08:58:51.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:55:59.585+0000 7f8f337bc700 1 -- 172.21.15.35:0/3508932437 wait complete. 2023-03-17T08:58:51.015 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:36 smithi078 ceph-mon[94114]: pgmap v386: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:51.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:38 smithi078 ceph-mon[94114]: pgmap v387: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:51.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:58:51.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:58:52.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:58:52.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:40 smithi078 ceph-mon[94114]: pgmap v388: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:42 smithi078 ceph-mon[94114]: pgmap v389: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:44 smithi078 ceph-mon[94114]: pgmap v390: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:46 smithi078 ceph-mon[94114]: pgmap v391: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:48 smithi078 ceph-mon[94114]: pgmap v392: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:50 smithi078 ceph-mon[94114]: pgmap v393: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:36 smithi082 ceph-mon[94281]: pgmap v386: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:38 smithi082 ceph-mon[94281]: pgmap v387: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:58:52.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:40 smithi082 ceph-mon[94281]: pgmap v388: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:42 smithi082 ceph-mon[94281]: pgmap v389: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:44 smithi082 ceph-mon[94281]: pgmap v390: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:46 smithi082 ceph-mon[94281]: pgmap v391: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:48 smithi082 ceph-mon[94281]: pgmap v392: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:58:53.422 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:50 smithi082 ceph-mon[94281]: pgmap v393: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:00 smithi035 ceph-mon[92535]: pgmap v302: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:02 smithi035 ceph-mon[92535]: pgmap v303: 97 pgs: 97 active+clean; 1.3 MiB data, 88 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:04 smithi035 ceph-mon[92535]: pgmap v304: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:05 smithi035 ceph-mon[92535]: pgmap v305: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:08 smithi035 ceph-mon[92535]: pgmap v306: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:10 smithi035 ceph-mon[92535]: pgmap v307: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:10 smithi035 ceph-mon[92535]: osdmap e93: 12 total, 12 up, 12 in 2023-03-17T08:58:53.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:12 smithi035 ceph-mon[92535]: pgmap v309: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T08:58:53.425 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:52 smithi078 ceph-mon[94114]: pgmap v394: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:53.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:52 smithi082 ceph-mon[94281]: pgmap v394: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:58:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 -- 172.21.15.35:0/2795260218 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 msgr2=0x7f40e0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:55.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2795260218 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0104e10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f40d00099c0 tx=0x7f40d0009cd0 comp rx=0 tx=0).stop 2023-03-17T08:58:55.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 -- 172.21.15.35:0/2795260218 shutdown_connections 2023-03-17T08:58:55.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2795260218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40e01054f0 0x7f40e010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:55.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2795260218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40e0100be0 0x7f40e0100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:55.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2795260218 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0104e10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 -- 172.21.15.35:0/2795260218 >> 172.21.15.35:0/2795260218 conn(0x7f40e00774e0 msgr2=0x7f40e00778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 -- 172.21.15.35:0/2795260218 shutdown_connections 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.707+0000 7f40e48f3700 1 -- 172.21.15.35:0/2795260218 wait complete. 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.708+0000 7f40e48f3700 1 Processor -- start 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.708+0000 7f40e48f3700 1 -- start start 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40e48f3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40e0100be0 0x7f40e01962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40e48f3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40e48f3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40e01054f0 0x7f40e019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:55.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40e48f3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e019b2b0 con 0x7f40e0101580 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40e48f3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e019b420 con 0x7f40e0100be0 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40e48f3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e019b5e0 con 0x7f40e01054f0 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42954/0 (socket says 172.21.15.35:42954) 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 -- 172.21.15.35:0/2377730158 learned_addr learned my addr 172.21.15.35:0/2377730158 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40de59c700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40e0100be0 0x7f40e01962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ded9d700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40e01054f0 0x7f40e019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:55.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 -- 172.21.15.35:0/2377730158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40e01054f0 msgr2=0x7f40e019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:57.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40e01054f0 0x7f40e019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 -- 172.21.15.35:0/2377730158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40e0100be0 msgr2=0x7f40e01962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40e0100be0 0x7f40e01962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 -- 172.21.15.35:0/2377730158 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00095f0 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0196810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009990 tx=0x7f40d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.709+0000 7f40cf7fe700 1 -- 172.21.15.35:0/2377730158 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d001d070 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.710+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e01101b0 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.710+0000 7f40cf7fe700 1 -- 172.21.15.35:0/2377730158 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40d0003ec0 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.710+0000 7f40cf7fe700 1 -- 172.21.15.35:0/2377730158 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0022c60 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.710+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0110020 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.712+0000 7f40cf7fe700 1 -- 172.21.15.35:0/2377730158 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f40d0004030 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.712+0000 7f40cf7fe700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f40c809f640 0x7f40c80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.713+0000 7f40cf7fe700 1 -- 172.21.15.35:0/2377730158 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f40d00cba20 con 0x7f40e0101580 2023-03-17T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.713+0000 7f40de59c700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f40c809f640 0x7f40c80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.713+0000 7f40de59c700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f40c809f640 0x7f40c80a1af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40d4005950 tx=0x7f40d400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 Processor -- start 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 -- start start 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b93fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 0x55ebe7b8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7a95010 con 0x55ebe7b944f0 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7ae7950 con 0x55ebe7b8e960 2023-03-17T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7ae0de0 con 0x55ebe7b93be0 2023-03-17T08:59:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 0x55ebe7b8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 0x55ebe7b8e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42962/0 (socket says 172.21.15.35:42962) 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 -- 172.21.15.35:0/3477620845 learned_addr learned my addr 172.21.15.35:0/3477620845 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40de59c700 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b93fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ded9d700 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 -- 172.21.15.35:0/3477620845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 msgr2=0x55ebe7b93fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b93fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 -- 172.21.15.35:0/3477620845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 msgr2=0x55ebe7b8ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40ddd9b700 1 -- 172.21.15.35:0/3477620845 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebe79625d0 con 0x55ebe7b944f0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.714+0000 7f40de59c700 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.715+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 0x55ebe7b8e420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f40d0095fa0 tx=0x7f40d0098f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9ab891072ce110 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.715+0000 7f40ccff9700 1 -- 172.21.15.35:0/3477620845 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d009f0d0 con 0x55ebe7b944f0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.715+0000 7f40ccff9700 1 -- 172.21.15.35:0/3477620845 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40d0095040 con 0x55ebe7b944f0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.715+0000 7f40ccff9700 1 -- 172.21.15.35:0/3477620845 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0098a20 con 0x55ebe7b944f0 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.715+0000 7f40f0a80b80 1 -- 172.21.15.35:0/3477620845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 msgr2=0x55ebe7b8e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.715+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 0x55ebe7b8e420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f40d0095fa0 tx=0x7f40d0098f10 comp rx=0 tx=0).stop 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- 172.21.15.35:0/3477620845 shutdown_connections 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/3477620845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b944f0 0x55ebe7b8e420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- 172.21.15.35:0/3477620845 >> 172.21.15.35:0/3477620845 conn(0x55ebe79eb6b0 msgr2=0x55ebe7b88a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- 172.21.15.35:0/3477620845 shutdown_connections 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- 172.21.15.35:0/3477620845 wait complete. 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- start start 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 Processor -- start 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 0x55ebe7b97740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b97e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe79648c0 con 0x55ebe7b93be0 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7b985c0 con 0x55ebe7b8e960 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7ba3cf0 con 0x55ebe7b944f0 2023-03-17T08:59:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.716+0000 7f40f0a80b80 10 client.0 _ll_register_callbacks cb 0x55ebe7986230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 0x55ebe7b97740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 0x55ebe7b97740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42968/0 (socket says 172.21.15.35:42968) 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 -- 172.21.15.35:0/1126906591 learned_addr learned my addr 172.21.15.35:0/1126906591 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ded9d700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b97e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40de59c700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 -- 172.21.15.35:0/1126906591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 msgr2=0x55ebe7b97e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b97e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 -- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 msgr2=0x55ebe7b9a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 -- 172.21.15.35:0/1126906591 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e0110020 con 0x55ebe7b93be0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 0x55ebe7b97740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f40d0099470 tx=0x7f40d009f2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d2898b6141a007 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1126906591 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0097950 con 0x55ebe7b93be0 2023-03-17T08:59:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1126906591 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f40d0099790 con 0x55ebe7b93be0 2023-03-17T08:59:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebe7aa3390 con 0x55ebe7b93be0 2023-03-17T08:59:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1126906591 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d0099950 con 0x55ebe7b93be0 2023-03-17T08:59:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40f0a80b80 10 client.15672 fetch_fsmap learned FSMap version 29 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.717+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ebe790ed80 con 0x55ebe7b93be0 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1126906591 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40d00b5020 con 0x55ebe7b93be0 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1126906591 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f40d0098490 con 0x55ebe7b93be0 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40f0a80b80 10 client.15672 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40f0a80b80 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40f0a80b80 20 client.15672 populate_metadata read hostname 'smithi035' 2023-03-17T08:59:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7ba78b0 0x55ebe7ba9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:01.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40f0a80b80 4 client.15672 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:59:01.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebe7aaf600 con 0x55ebe7ba78b0 2023-03-17T08:59:01.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.718+0000 7f40de59c700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7ba78b0 0x55ebe7ba9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:01.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40c5ffb700 10 client.15672 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:01.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40de59c700 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7ba78b0 0x55ebe7ba9c90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b791ba3aa27a9b6 server_cookie=2d76e620fc252e5 in_seq=0 out_seq=0 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1126906591 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ebe7aaf600 con 0x55ebe7ba78b0 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40c5ffb700 10 client.15672 handle_command_reply: tid=0 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 client.15672 shutdown 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 msgr2=0x55ebe7b97740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 0x55ebe7b97740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f40d0099470 tx=0x7f40d009f2e0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 shutdown_connections 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7ba78b0 0x55ebe7ba9c90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:01.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b97e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40c5ffb700 0 client.15672 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1126906591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b93be0 0x55ebe7b97740 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.719+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 >> 172.21.15.35:0/1126906591 conn(0x55ebe79eb6b0 msgr2=0x55ebe7b8d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.720+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 shutdown_connections 2023-03-17T08:59:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.720+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1126906591 wait complete. 2023-03-17T08:59:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.720+0000 7f40f0a80b80 20 client.15672 trim_cache size 0 max 16384 2023-03-17T08:59:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 Processor -- start 2023-03-17T08:59:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 -- start start 2023-03-17T08:59:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b944f0 0x55ebe7b99ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7b89e40 con 0x55ebe7b8e960 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7b840f0 con 0x55ebe7b944f0 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7ba47c0 con 0x55ebe7b93be0 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42974/0 (socket says 172.21.15.35:42974) 2023-03-17T08:59:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 -- 172.21.15.35:0/2716676102 learned_addr learned my addr 172.21.15.35:0/2716676102 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 -- 172.21.15.35:0/2716676102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 msgr2=0x55ebe7b88ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40ded9d700 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b944f0 0x55ebe7b99ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 -- 172.21.15.35:0/2716676102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b944f0 msgr2=0x55ebe7b99ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b944f0 0x55ebe7b99ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 -- 172.21.15.35:0/2716676102 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebe7aa7130 con 0x55ebe7b8e960 2023-03-17T08:59:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40ded9d700 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b944f0 0x55ebe7b99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.735+0000 7f40de59c700 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8a770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f40d4005d90 tx=0x7f40d4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170bc847b0e5161b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40cd7fa700 1 -- 172.21.15.35:0/2716676102 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4024070 con 0x55ebe7b8e960 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40cd7fa700 1 -- 172.21.15.35:0/2716676102 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40d4015070 con 0x55ebe7b8e960 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40cd7fa700 1 -- 172.21.15.35:0/2716676102 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4005020 con 0x55ebe7b8e960 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 -- 172.21.15.35:0/2716676102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 msgr2=0x55ebe7b8a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8a770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f40d4005d90 tx=0x7f40d4013000 comp rx=0 tx=0).stop 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 -- 172.21.15.35:0/2716676102 shutdown_connections 2023-03-17T08:59:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b944f0 0x55ebe7b99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b8a770 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/2716676102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b93be0 0x55ebe7b88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 -- 172.21.15.35:0/2716676102 >> 172.21.15.35:0/2716676102 conn(0x55ebe79eb6b0 msgr2=0x55ebe7ba40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 -- 172.21.15.35:0/2716676102 shutdown_connections 2023-03-17T08:59:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.736+0000 7f40f0a80b80 1 -- 172.21.15.35:0/2716676102 wait complete. 2023-03-17T08:59:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 -- start start 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 Processor -- start 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b93be0 0x55ebe7b9cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b9d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7b9d7a0 con 0x55ebe7b8e960 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7b9d910 con 0x55ebe7b93be0 2023-03-17T08:59:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe7b9dad0 con 0x55ebe7b944f0 2023-03-17T08:59:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40f0a80b80 10 client.0 _ll_register_callbacks cb 0x55ebe7986230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:59:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42980/0 (socket says 172.21.15.35:42980) 2023-03-17T08:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 -- 172.21.15.35:0/1707687010 learned_addr learned my addr 172.21.15.35:0/1707687010 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b93be0 0x55ebe7b9cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 -- 172.21.15.35:0/1707687010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 msgr2=0x55ebe7b9d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40ded9d700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b9d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b9d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 -- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b93be0 msgr2=0x55ebe7b9cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:15.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b93be0 0x55ebe7b9cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40de59c700 1 -- 172.21.15.35:0/1707687010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d400bdf0 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.737+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b93be0 0x55ebe7b9cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40de59c700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9ea30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f40d4004800 tx=0x7f40d40048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e810563f70e6de8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1707687010 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4024030 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1707687010 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f40d4017070 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebe7b5e1e0 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1707687010 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d401e620 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 10 client.15678 fetch_fsmap learned FSMap version 29 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ebe79351f0 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1707687010 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ebe7b5e1e0 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1707687010 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f40d402f7c0 con 0x55ebe7b8e960 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 10 client.15678 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 10 client.15678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:59:15.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 20 client.15678 populate_metadata read hostname 'smithi035' 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7bfc890 0x55ebe7bfeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 4 client.15678 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.738+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ebe7964f00 con 0x55ebe7bfc890 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.739+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7bfc890 0x55ebe7bfeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.739+0000 7f40ddd9b700 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7bfc890 0x55ebe7bfeca0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1572a8abe0005d server_cookie=c155e618579621bd in_seq=0 out_seq=0 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.739+0000 7f40c5ffb700 10 client.15678 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.745+0000 7f40c5ffb700 1 -- 172.21.15.35:0/1707687010 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ebe7964f00 con 0x55ebe7bfc890 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.745+0000 7f40c5ffb700 10 client.15678 handle_command_reply: tid=0 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.745+0000 7f40f0a80b80 1 client.15678 shutdown 2023-03-17T08:59:15.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 msgr2=0x55ebe7b9ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9ea30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f40d4004800 tx=0x7f40d40048e0 comp rx=0 tx=0).stop 2023-03-17T08:59:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 shutdown_connections 2023-03-17T08:59:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ebe7bfc890 0x55ebe7bfeca0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ebe7b944f0 0x55ebe7b9d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40c5ffb700 0 client.15678 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ebe7b8e960 0x55ebe7b9ea30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 --2- 172.21.15.35:0/1707687010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebe7b93be0 0x55ebe7b9cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 >> 172.21.15.35:0/1707687010 conn(0x55ebe79eb6b0 msgr2=0x55ebe7b91650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 shutdown_connections 2023-03-17T08:59:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 1 -- 172.21.15.35:0/1707687010 wait complete. 2023-03-17T08:59:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40f0a80b80 20 client.15678 trim_cache size 0 max 16384 2023-03-17T08:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:59:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f40c809f640 msgr2=0x7f40c80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f40c809f640 0x7f40c80a1af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40d4005950 tx=0x7f40d400b410 comp rx=0 tx=0).stop 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 msgr2=0x7f40e0196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0196810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009990 tx=0x7f40d0004730 comp rx=0 tx=0).stop 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 shutdown_connections 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f40c809f640 0x7f40c80a1af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40e01054f0 0x7f40e019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40e0100be0 0x7f40e01962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 --2- 172.21.15.35:0/2377730158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f40e0101580 0x7f40e0196810 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.746+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 >> 172.21.15.35:0/2377730158 conn(0x7f40e00774e0 msgr2=0x7f40e00fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.747+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 shutdown_connections 2023-03-17T08:59:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:12.747+0000 7f40e48f3700 1 -- 172.21.15.35:0/2377730158 wait complete. 2023-03-17T08:59:21.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:14 smithi035 ceph-mon[92535]: pgmap v310: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T08:59:22.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:15 smithi035 ceph-mon[92535]: osdmap e94: 12 total, 12 up, 12 in 2023-03-17T08:59:22.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:15 smithi035 ceph-mon[92535]: pgmap v312: 97 pgs: 97 active+clean; 1.3 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T08:59:22.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:18 smithi035 ceph-mon[92535]: pgmap v313: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T08:59:22.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:20 smithi035 ceph-mon[92535]: pgmap v314: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 823 B/s wr, 11 op/s 2023-03-17T08:59:22.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:22 smithi035 ceph-mon[92535]: pgmap v315: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:59:22.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:24 smithi035 ceph-mon[92535]: pgmap v316: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T08:59:22.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:54 smithi082 ceph-mon[94281]: pgmap v395: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:56 smithi082 ceph-mon[94281]: pgmap v396: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:58:58 smithi082 ceph-mon[94281]: pgmap v397: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:00 smithi082 ceph-mon[94281]: pgmap v398: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:02 smithi082 ceph-mon[94281]: pgmap v399: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:04 smithi082 ceph-mon[94281]: pgmap v400: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:06 smithi082 ceph-mon[94281]: pgmap v401: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T08:59:24.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:08 smithi082 ceph-mon[94281]: pgmap v402: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T08:59:24.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:10 smithi082 ceph-mon[94281]: pgmap v403: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T08:59:24.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:10 smithi082 ceph-mon[94281]: osdmap e99: 12 total, 12 up, 12 in 2023-03-17T08:59:24.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:12 smithi082 ceph-mon[94281]: pgmap v405: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T08:59:24.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:14 smithi082 ceph-mon[94281]: pgmap v406: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:59:24.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:16 smithi082 ceph-mon[94281]: osdmap e100: 12 total, 12 up, 12 in 2023-03-17T08:59:24.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:16 smithi082 ceph-mon[94281]: pgmap v408: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T08:59:26.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:18 smithi082 ceph-mon[94281]: pgmap v409: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T08:59:26.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:20 smithi082 ceph-mon[94281]: pgmap v410: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:54 smithi078 ceph-mon[94114]: pgmap v395: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:56 smithi078 ceph-mon[94114]: pgmap v396: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:58:58 smithi078 ceph-mon[94114]: pgmap v397: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:00 smithi078 ceph-mon[94114]: pgmap v398: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:02 smithi078 ceph-mon[94114]: pgmap v399: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:04 smithi078 ceph-mon[94114]: pgmap v400: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T08:59:26.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:06 smithi078 ceph-mon[94114]: pgmap v401: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T08:59:26.187 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:08 smithi078 ceph-mon[94114]: pgmap v402: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:10 smithi078 ceph-mon[94114]: pgmap v403: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:10 smithi078 ceph-mon[94114]: osdmap e99: 12 total, 12 up, 12 in 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:12 smithi078 ceph-mon[94114]: pgmap v405: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:14 smithi078 ceph-mon[94114]: pgmap v406: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:16 smithi078 ceph-mon[94114]: osdmap e100: 12 total, 12 up, 12 in 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:16 smithi078 ceph-mon[94114]: pgmap v408: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:18 smithi078 ceph-mon[94114]: pgmap v409: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:20 smithi078 ceph-mon[94114]: pgmap v410: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:59:27.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:22 smithi078 ceph-mon[94114]: pgmap v411: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:59:27.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:24 smithi078 ceph-mon[94114]: pgmap v412: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T08:59:27.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:26 smithi078 ceph-mon[94114]: pgmap v413: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 510 B/s wr, 10 op/s 2023-03-17T08:59:27.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:22 smithi082 ceph-mon[94281]: pgmap v411: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T08:59:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:24 smithi082 ceph-mon[94281]: pgmap v412: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T08:59:29.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:26 smithi082 ceph-mon[94281]: pgmap v413: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 510 B/s wr, 10 op/s 2023-03-17T08:59:29.412 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:28 smithi082 ceph-mon[94281]: pgmap v414: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T08:59:30.672 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:28 smithi078 ceph-mon[94114]: pgmap v414: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T08:59:32.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:30 smithi082 ceph-mon[94281]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:59:33.087 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:30 smithi078 ceph-mon[94114]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:59:33.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:32 smithi082 ceph-mon[94281]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:59:34.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:32 smithi078 ceph-mon[94114]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T08:59:35.449 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:34 smithi082 ceph-mon[94281]: pgmap v417: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T08:59:35.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:34 smithi078 ceph-mon[94114]: pgmap v417: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T08:59:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.867+0000 7f672790b700 1 -- 172.21.15.35:0/4294602506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 msgr2=0x7f6720103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.867+0000 7f672790b700 1 --2- 172.21.15.35:0/4294602506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720103cb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f67140099c0 tx=0x7f6714009cd0 comp rx=0 tx=0).stop 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.867+0000 7f672790b700 1 -- 172.21.15.35:0/4294602506 shutdown_connections 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.867+0000 7f672790b700 1 --2- 172.21.15.35:0/4294602506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6720104390 0x7f672010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.867+0000 7f672790b700 1 --2- 172.21.15.35:0/4294602506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67200ff350 0x7f67200ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.867+0000 7f672790b700 1 --2- 172.21.15.35:0/4294602506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720103cb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 -- 172.21.15.35:0/4294602506 >> 172.21.15.35:0/4294602506 conn(0x7f6720076330 msgr2=0x7f6720076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 -- 172.21.15.35:0/4294602506 shutdown_connections 2023-03-17T08:59:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 -- 172.21.15.35:0/4294602506 wait complete. 2023-03-17T08:59:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 Processor -- start 2023-03-17T08:59:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 -- start start 2023-03-17T08:59:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67200ff350 0x7f6720196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.868+0000 7f672790b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6720104390 0x7f672019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:37.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f672790b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672019b2f0 con 0x7f67200ffcf0 2023-03-17T08:59:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f672790b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672019b460 con 0x7f6720104390 2023-03-17T08:59:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f672790b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672019b620 con 0x7f67200ff350 2023-03-17T08:59:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:42996/0 (socket says 172.21.15.35:42996) 2023-03-17T08:59:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 -- 172.21.15.35:0/2627029276 learned_addr learned my addr 172.21.15.35:0/2627029276 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f67256a7700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67200ff350 0x7f6720196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6725ea8700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6720104390 0x7f672019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 -- 172.21.15.35:0/2627029276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67200ff350 msgr2=0x7f6720196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67200ff350 0x7f6720196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 -- 172.21.15.35:0/2627029276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6720104390 msgr2=0x7f672019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6720104390 0x7f672019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 -- 172.21.15.35:0/2627029276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140095f0 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f6724ea6700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720196850 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6714009fd0 tx=0x7f671400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f67127fc700 1 -- 172.21.15.35:0/2627029276 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671401d070 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672010efc0 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f67127fc700 1 -- 172.21.15.35:0/2627029276 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67140059a0 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f67127fc700 1 -- 172.21.15.35:0/2627029276 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714022e90 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.869+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672010ee30 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.872+0000 7f67127fc700 1 -- 172.21.15.35:0/2627029276 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6714022470 con 0x7f67200ffcf0 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.872+0000 7f67127fc700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f670c09f640 0x7f670c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.873+0000 7f67256a7700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f670c09f640 0x7f670c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.873+0000 7f67127fc700 1 -- 172.21.15.35:0/2627029276 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f67140cb5d0 con 0x7f67200ffcf0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.873+0000 7f67256a7700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f670c09f640 0x7f670c0a1af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f671c009c60 tx=0x7f671c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 Processor -- start 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 -- start start 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 0x5638316f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f64f0 0x5638316f0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f0960 0x5638316f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638315f7010 con 0x5638316f5be0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563831649950 con 0x5638316f64f0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6733a98b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563831642de0 con 0x5638316f0960 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 0x5638316f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6724ea6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f64f0 0x5638316f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 0x5638316f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43002/0 (socket says 172.21.15.35:43002) 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f67256a7700 1 -- 172.21.15.35:0/647978760 learned_addr learned my addr 172.21.15.35:0/647978760 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.874+0000 7f6725ea8700 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f0960 0x5638316f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6724ea6700 1 -- 172.21.15.35:0/647978760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f0960 msgr2=0x5638316f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6724ea6700 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f0960 0x5638316f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6724ea6700 1 -- 172.21.15.35:0/647978760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 msgr2=0x5638316f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6724ea6700 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 0x5638316f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6724ea6700 1 -- 172.21.15.35:0/647978760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638314c45d0 con 0x5638316f64f0 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6725ea8700 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f0960 0x5638316f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T08:59:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f67256a7700 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 0x5638316f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T08:59:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f6724ea6700 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f64f0 0x5638316f0420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67140c8d60 tx=0x7f6714094db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd94a9a1dfcac52 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f670b7fe700 1 -- 172.21.15.35:0/647978760 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67140b0070 con 0x5638316f64f0 2023-03-17T08:59:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f670b7fe700 1 -- 172.21.15.35:0/647978760 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f671409e040 con 0x5638316f64f0 2023-03-17T08:59:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.875+0000 7f670b7fe700 1 -- 172.21.15.35:0/647978760 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67140b1270 con 0x5638316f64f0 2023-03-17T08:59:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 -- 172.21.15.35:0/647978760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f64f0 msgr2=0x5638316f0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f64f0 0x5638316f0420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67140c8d60 tx=0x7f6714094db0 comp rx=0 tx=0).stop 2023-03-17T08:59:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 -- 172.21.15.35:0/647978760 shutdown_connections 2023-03-17T08:59:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f0960 0x5638316f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f5be0 0x5638316f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 --2- 172.21.15.35:0/647978760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f64f0 0x5638316f0420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 -- 172.21.15.35:0/647978760 >> 172.21.15.35:0/647978760 conn(0x56383154d6b0 msgr2=0x5638316eaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 -- 172.21.15.35:0/647978760 shutdown_connections 2023-03-17T08:59:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 -- 172.21.15.35:0/647978760 wait complete. 2023-03-17T08:59:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 -- start start 2023-03-17T08:59:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.876+0000 7f6733a98b80 1 Processor -- start 2023-03-17T08:59:43.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638314c68c0 con 0x5638316f0960 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638316fa580 con 0x5638316f5be0 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563831705cf0 con 0x5638316f64f0 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6733a98b80 10 client.0 _ll_register_callbacks cb 0x5638314e8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6724ea6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6724ea6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316f9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:44806/0 (socket says 172.21.15.35:44806) 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6724ea6700 1 -- 172.21.15.35:0/840220762 learned_addr learned my addr 172.21.15.35:0/840220762 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316fc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43008/0 (socket says 172.21.15.35:43008) 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f6725ea8700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 -- 172.21.15.35:0/840220762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 msgr2=0x5638316f9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316f9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 -- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 msgr2=0x5638316f9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316f9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.877+0000 7f67256a7700 1 -- 172.21.15.35:0/840220762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672010ee30 con 0x5638316f0960 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f67256a7700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316fc4f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f671c003930 tx=0x7f671c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9515b17ab219a306 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6708ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6708ff9700 1 -- 172.21.15.35:0/840220762 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c022070 con 0x5638316f0960 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6708ff9700 1 -- 172.21.15.35:0/840220762 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f671c01d6e0 con 0x5638316f0960 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563831605390 con 0x5638316f0960 2023-03-17T08:59:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6708ff9700 1 -- 172.21.15.35:0/840220762 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f671c01d8a0 con 0x5638316f0960 2023-03-17T08:59:44.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 10 client.15690 fetch_fsmap learned FSMap version 29 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x563831470d80 con 0x5638316f0960 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6708ff9700 1 -- 172.21.15.35:0/840220762 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563831605390 con 0x5638316f0960 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6708ff9700 1 -- 172.21.15.35:0/840220762 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f671c027a30 con 0x5638316f0960 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 10 client.15690 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 20 client.15690 populate_metadata read hostname 'smithi035' 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831709e30 0x56383170c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 4 client.15690 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.878+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563831611600 con 0x563831709e30 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.879+0000 7f6724ea6700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831709e30 0x56383170c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.879+0000 7f6724ea6700 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831709e30 0x56383170c240 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f381046e68939f5a server_cookie=bbab5003e979fad9 in_seq=0 out_seq=0 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.879+0000 7f6708ff9700 10 client.15690 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6708ff9700 1 -- 172.21.15.35:0/840220762 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563831611600 con 0x563831709e30 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6708ff9700 10 client.15690 handle_command_reply: tid=0 2023-03-17T08:59:44.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 client.15690 shutdown 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 msgr2=0x5638316fc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316fc4f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f671c003930 tx=0x7f671c0047c0 comp rx=0 tx=0).stop 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 shutdown_connections 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831709e30 0x56383170c240 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316f9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316fc4f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 --2- 172.21.15.35:0/840220762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316f9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:44.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6708ff9700 0 client.15690 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 >> 172.21.15.35:0/840220762 conn(0x56383154d6b0 msgr2=0x5638316ef410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 shutdown_connections 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 1 -- 172.21.15.35:0/840220762 wait complete. 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.880+0000 7f6733a98b80 20 client.15690 trim_cache size 0 max 16384 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 Processor -- start 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 -- start start 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x563831700cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638316e6130 con 0x5638316f0960 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638316eb5d0 con 0x5638316f5be0 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6733a98b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638317074f0 con 0x5638316f64f0 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316eaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43016/0 (socket says 172.21.15.35:43016) 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 -- 172.21.15.35:0/3786222296 learned_addr learned my addr 172.21.15.35:0/3786222296 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6724ea6700 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x563831700cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f6725ea8700 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 -- 172.21.15.35:0/3786222296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 msgr2=0x5638316fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 -- 172.21.15.35:0/3786222296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 msgr2=0x563831700cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x563831700cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.895+0000 7f67256a7700 1 -- 172.21.15.35:0/3786222296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563831609130 con 0x5638316f0960 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6725ea8700 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f67256a7700 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316eaac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f671c000c00 tx=0x7f671c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b41e7b49ab5c9b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f670bfff700 1 -- 172.21.15.35:0/3786222296 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c022030 con 0x5638316f0960 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f670bfff700 1 -- 172.21.15.35:0/3786222296 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f671c011b30 con 0x5638316f0960 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f670bfff700 1 -- 172.21.15.35:0/3786222296 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c030440 con 0x5638316f0960 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 -- 172.21.15.35:0/3786222296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 msgr2=0x5638316eaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316eaac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f671c000c00 tx=0x7f671c009750 comp rx=0 tx=0).stop 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 -- 172.21.15.35:0/3786222296 shutdown_connections 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638316eaac0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3786222296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x563831700cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 -- 172.21.15.35:0/3786222296 >> 172.21.15.35:0/3786222296 conn(0x56383154d6b0 msgr2=0x5638316efa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.896+0000 7f6733a98b80 1 -- 172.21.15.35:0/3786222296 shutdown_connections 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.897+0000 7f6733a98b80 1 -- 172.21.15.35:0/3786222296 wait complete. 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.897+0000 7f6733a98b80 1 -- start start 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.897+0000 7f6733a98b80 1 Processor -- start 2023-03-17T08:59:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638317009d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316fece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316ff220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638317012a0 con 0x5638316f0960 2023-03-17T08:59:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638316ff760 con 0x5638316f5be0 2023-03-17T08:59:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638316ff920 con 0x5638316f64f0 2023-03-17T08:59:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 10 client.0 _ll_register_callbacks cb 0x5638314e8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T08:59:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638317009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638317009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43022/0 (socket says 172.21.15.35:43022) 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 -- 172.21.15.35:0/3300722388 learned_addr learned my addr 172.21.15.35:0/3300722388 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6725ea8700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6724ea6700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 -- 172.21.15.35:0/3300722388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 msgr2=0x5638316ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316ff220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 -- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 msgr2=0x5638316fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316fece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 -- 172.21.15.35:0/3300722388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563831470d80 con 0x5638316f0960 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6724ea6700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f67256a7700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638317009d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f671c016040 tx=0x7f671c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798377cbe64fc9db server_cookie=0 in_seq=0 out_seq=0 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6708ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6708ff9700 1 -- 172.21.15.35:0/3300722388 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c022040 con 0x5638316f0960 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6708ff9700 1 -- 172.21.15.35:0/3300722388 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f671c023070 con 0x5638316f0960 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638316c01e0 con 0x5638316f0960 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6708ff9700 1 -- 172.21.15.35:0/3300722388 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f671c0279f0 con 0x5638316f0960 2023-03-17T08:59:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 10 client.15696 fetch_fsmap learned FSMap version 29 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.898+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5638314971f0 con 0x5638316f0960 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6708ff9700 1 -- 172.21.15.35:0/3300722388 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638316c01e0 con 0x5638316f0960 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6708ff9700 1 -- 172.21.15.35:0/3300722388 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f671c03f020 con 0x5638316f0960 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6733a98b80 10 client.15696 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6733a98b80 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6733a98b80 20 client.15696 populate_metadata read hostname 'smithi035' 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831763100 0x563831765510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6733a98b80 4 client.15696 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5638314c6f00 con 0x563831763100 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6724ea6700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831763100 0x563831765510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6708ff9700 10 client.15696 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.899+0000 7f6724ea6700 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831763100 0x563831765510 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e44e4ef4112857f server_cookie=58b843346fa8ac47 in_seq=0 out_seq=0 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.903+0000 7f6708ff9700 1 -- 172.21.15.35:0/3300722388 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5638314c6f00 con 0x563831763100 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.903+0000 7f6708ff9700 10 client.15696 handle_command_reply: tid=0 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.903+0000 7f6733a98b80 1 client.15696 shutdown 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.903+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 msgr2=0x5638317009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638317009d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f671c016040 tx=0x7f671c005d50 comp rx=0 tx=0).stop 2023-03-17T08:59:47.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 shutdown_connections 2023-03-17T08:59:47.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563831763100 0x563831765510 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:47.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638316f64f0 0x5638316ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638316f0960 0x5638317009d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 --2- 172.21.15.35:0/3300722388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638316f5be0 0x5638316fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6708ff9700 0 client.15696 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T08:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 >> 172.21.15.35:0/3300722388 conn(0x56383154d6b0 msgr2=0x5638316f36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 shutdown_connections 2023-03-17T08:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 1 -- 172.21.15.35:0/3300722388 wait complete. 2023-03-17T08:59:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f6733a98b80 20 client.15696 trim_cache size 0 max 16384 2023-03-17T08:59:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T08:59:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T08:59:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T08:59:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T08:59:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f670c09f640 msgr2=0x7f670c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f670c09f640 0x7f670c0a1af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f671c009c60 tx=0x7f671c009260 comp rx=0 tx=0).stop 2023-03-17T08:59:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 msgr2=0x7f6720196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T08:59:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720196850 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6714009fd0 tx=0x7f671400f690 comp rx=0 tx=0).stop 2023-03-17T08:59:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 shutdown_connections 2023-03-17T08:59:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f670c09f640 0x7f670c0a1af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6720104390 0x7f672019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67200ff350 0x7f6720196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 --2- 172.21.15.35:0/2627029276 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f67200ffcf0 0x7f6720196850 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T08:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.904+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 >> 172.21.15.35:0/2627029276 conn(0x7f6720076330 msgr2=0x7f6720068160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T08:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.905+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 shutdown_connections 2023-03-17T08:59:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:25.905+0000 7f672790b700 1 -- 172.21.15.35:0/2627029276 wait complete. 2023-03-17T08:59:51.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:36 smithi082 ceph-mon[94281]: pgmap v418: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:38 smithi082 ceph-mon[94281]: pgmap v419: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:40 smithi082 ceph-mon[94281]: pgmap v420: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:42 smithi082 ceph-mon[94281]: pgmap v421: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:44 smithi082 ceph-mon[94281]: pgmap v422: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:53.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:46 smithi082 ceph-mon[94281]: pgmap v423: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:59:54.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:48 smithi082 ceph-mon[94281]: pgmap v424: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:54.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:50 smithi082 ceph-mon[94281]: pgmap v425: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:54.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:36 smithi078 ceph-mon[94114]: pgmap v418: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:54.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:38 smithi078 ceph-mon[94114]: pgmap v419: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:56.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:59:56.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:40 smithi078 ceph-mon[94114]: pgmap v420: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:56.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T08:59:56.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T08:59:56.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:59:56.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:42 smithi078 ceph-mon[94114]: pgmap v421: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:56.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:44 smithi078 ceph-mon[94114]: pgmap v422: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:56.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:46 smithi078 ceph-mon[94114]: pgmap v423: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T08:59:58.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:48 smithi078 ceph-mon[94114]: pgmap v424: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:58.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:50 smithi078 ceph-mon[94114]: pgmap v425: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:58.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:26 smithi035 ceph-mon[92535]: pgmap v317: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 714 B/s wr, 10 op/s 2023-03-17T08:59:58.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:28 smithi035 ceph-mon[92535]: pgmap v318: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T08:59:58.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:30 smithi035 ceph-mon[92535]: pgmap v319: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:58.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:32 smithi035 ceph-mon[92535]: pgmap v320: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T08:59:58.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T08:59:58.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:59:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T08:59:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:34 smithi035 ceph-mon[92535]: pgmap v321: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T08:59:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:00.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:00.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:01.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: pgmap v322: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:03.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:03.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:03.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:00:03.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:00:04.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:00:04.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:00:04.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:04.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:04.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:04.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:00:04.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:00:04.780 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:00:05.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:00:05.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:00:05.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:05.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:38 smithi035 ceph-mon[92535]: pgmap v323: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:05.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:52 smithi082 ceph-mon[94281]: pgmap v426: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:07.327 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:54 smithi082 ceph-mon[94281]: pgmap v427: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:07.327 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:56 smithi082 ceph-mon[94281]: pgmap v428: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:07.327 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 08:59:58 smithi082 ceph-mon[94281]: pgmap v429: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2023-03-17T09:00:09.235 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:00 smithi082 ceph-mon[94281]: pgmap v430: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2023-03-17T09:00:10.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T09:00:10.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:02 smithi082 ceph-mon[94281]: pgmap v431: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2023-03-17T09:00:10.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:04 smithi082 ceph-mon[94281]: pgmap v432: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 47 KiB/s wr, 29 op/s 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:52 smithi078 ceph-mon[94114]: pgmap v426: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:54 smithi078 ceph-mon[94114]: pgmap v427: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:56 smithi078 ceph-mon[94114]: pgmap v428: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 08:59:58 smithi078 ceph-mon[94114]: pgmap v429: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:00 smithi078 ceph-mon[94114]: pgmap v430: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T09:00:11.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:02 smithi078 ceph-mon[94114]: pgmap v431: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2023-03-17T09:00:11.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:04 smithi078 ceph-mon[94114]: pgmap v432: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 47 KiB/s wr, 29 op/s 2023-03-17T09:00:13.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:06 smithi082 ceph-mon[94281]: pgmap v433: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 25 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:08 smithi082 ceph-mon[94281]: pgmap v434: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 30 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:10 smithi082 ceph-mon[94281]: pgmap v435: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 46 KiB/s wr, 23 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:10 smithi082 ceph-mon[94281]: osdmap e101: 12 total, 12 up, 12 in 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:12 smithi082 ceph-mon[94281]: pgmap v437: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:06 smithi078 ceph-mon[94114]: pgmap v433: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 25 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:08 smithi078 ceph-mon[94114]: pgmap v434: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 30 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:10 smithi078 ceph-mon[94114]: pgmap v435: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 46 KiB/s wr, 23 op/s 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:10 smithi078 ceph-mon[94114]: osdmap e101: 12 total, 12 up, 12 in 2023-03-17T09:00:13.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:12 smithi078 ceph-mon[94114]: pgmap v437: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T09:00:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 -- 172.21.15.35:0/3854537531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ff350 msgr2=0x7f96900ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 --2- 172.21.15.35:0/3854537531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ff350 0x7f96900ff720 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f96800099c0 tx=0x7f9680009cd0 comp rx=0 tx=0).stop 2023-03-17T09:00:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 -- 172.21.15.35:0/3854537531 shutdown_connections 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 --2- 172.21.15.35:0/3854537531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9690104390 0x7f969010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 --2- 172.21.15.35:0/3854537531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ff350 0x7f96900ff720 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 --2- 172.21.15.35:0/3854537531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96900ffcf0 0x7f9690103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 -- 172.21.15.35:0/3854537531 >> 172.21.15.35:0/3854537531 conn(0x7f9690076330 msgr2=0x7f9690076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 -- 172.21.15.35:0/3854537531 shutdown_connections 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 -- 172.21.15.35:0/3854537531 wait complete. 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.027+0000 7f9696839700 1 Processor -- start 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 -- start start 2023-03-17T09:00:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96900ff350 0x7f9690197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 0x7f96901975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9690104390 0x7f96901a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96901a2630 con 0x7f96900ffcf0 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96901a2770 con 0x7f96900ff350 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9696839700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96901a28b0 con 0x7f9690104390 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 0x7f96901975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 0x7f96901975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43038/0 (socket says 172.21.15.35:43038) 2023-03-17T09:00:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 -- 172.21.15.35:0/1626261268 learned_addr learned my addr 172.21.15.35:0/1626261268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:00:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f9694dd6700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9690104390 0x7f96901a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968ffff700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96900ff350 0x7f9690197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 -- 172.21.15.35:0/1626261268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9690104390 msgr2=0x7f96901a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9690104390 0x7f96901a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 -- 172.21.15.35:0/1626261268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96900ff350 msgr2=0x7f9690197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96900ff350 0x7f9690197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.028+0000 7f968f7fe700 1 -- 172.21.15.35:0/1626261268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800095f0 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.029+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 0x7f96901975b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f968400d950 tx=0x7f968400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.029+0000 7f968d7fa700 1 -- 172.21.15.35:0/1626261268 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684004220 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.029+0000 7f968d7fa700 1 -- 172.21.15.35:0/1626261268 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9684004cc0 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.029+0000 7f968d7fa700 1 -- 172.21.15.35:0/1626261268 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684005600 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.029+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969010f000 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.029+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969010ee70 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.032+0000 7f968d7fa700 1 -- 172.21.15.35:0/1626261268 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9684004380 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.032+0000 7f968d7fa700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f967809f640 0x7f96780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.033+0000 7f968d7fa700 1 -- 172.21.15.35:0/1626261268 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f96840ca410 con 0x7f96900ffcf0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.033+0000 7f968ffff700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f967809f640 0x7f96780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.033+0000 7f968ffff700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f967809f640 0x7f96780a1af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f968000b580 tx=0x7f9680009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.033+0000 7f96a29c6b80 1 Processor -- start 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.033+0000 7f96a29c6b80 1 -- start start 2023-03-17T09:00:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e34f0 0x56009b7dd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7dd960 0x56009b7ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b6e4010 con 0x56009b7e2be0 2023-03-17T09:00:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b736950 con 0x56009b7dd960 2023-03-17T09:00:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b72fde0 con 0x56009b7e34f0 2023-03-17T09:00:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43044/0 (socket says 172.21.15.35:43044) 2023-03-17T09:00:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 -- 172.21.15.35:0/1052428052 learned_addr learned my addr 172.21.15.35:0/1052428052 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:00:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e34f0 0x56009b7dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 -- 172.21.15.35:0/1052428052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e34f0 msgr2=0x56009b7dd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e34f0 0x56009b7dd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f9694dd6700 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7dd960 0x56009b7ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 -- 172.21.15.35:0/1052428052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7dd960 msgr2=0x56009b7ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7dd960 0x56009b7ddd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 -- 172.21.15.35:0/1052428052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56009b5b15d0 con 0x56009b7e2be0 2023-03-17T09:00:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f968ffff700 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e2fb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9680015000 tx=0x7f9680020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc83f17582b6c19e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96767fc700 1 -- 172.21.15.35:0/1052428052 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000be20 con 0x56009b7e2be0 2023-03-17T09:00:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96767fc700 1 -- 172.21.15.35:0/1052428052 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968001e040 con 0x56009b7e2be0 2023-03-17T09:00:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.034+0000 7f96767fc700 1 -- 172.21.15.35:0/1052428052 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680003a80 con 0x56009b7e2be0 2023-03-17T09:00:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1052428052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 msgr2=0x56009b7e2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e2fb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9680015000 tx=0x7f9680020000 comp rx=0 tx=0).stop 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1052428052 shutdown_connections 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7dd960 0x56009b7ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e2fb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1052428052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e34f0 0x56009b7dd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1052428052 >> 172.21.15.35:0/1052428052 conn(0x56009b63a6b0 msgr2=0x56009b7d7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1052428052 shutdown_connections 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.035+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1052428052 wait complete. 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 -- start start 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 Processor -- start 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7e9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b5b38c0 con 0x56009b7e2be0 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b7e75f0 con 0x56009b7e34f0 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b7f2fd0 con 0x56009b7dd960 2023-03-17T09:00:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f96a29c6b80 10 client.0 _ll_register_callbacks cb 0x56009b5d5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43052/0 (socket says 172.21.15.35:43052) 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f968f7fe700 1 -- 172.21.15.35:0/1064468988 learned_addr learned my addr 172.21.15.35:0/1064468988 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.036+0000 7f968ffff700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f9694dd6700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f968f7fe700 1 -- 172.21.15.35:0/1064468988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 msgr2=0x56009b7e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7e9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f968f7fe700 1 -- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 msgr2=0x56009b7e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f968f7fe700 1 -- 172.21.15.35:0/1064468988 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969010c7a0 con 0x56009b7e2be0 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f9694dd6700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e6770 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9684094370 tx=0x7f9684097b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6efd8c93d46e1a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f966f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f966f7fe700 1 -- 172.21.15.35:0/1064468988 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840983f0 con 0x56009b7e2be0 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f966f7fe700 1 -- 172.21.15.35:0/1064468988 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f96840975b0 con 0x56009b7e2be0 2023-03-17T09:00:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56009b6f2390 con 0x56009b7e2be0 2023-03-17T09:00:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f966f7fe700 1 -- 172.21.15.35:0/1064468988 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f968409fc20 con 0x56009b7e2be0 2023-03-17T09:00:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f96a29c6b80 10 client.15708 fetch_fsmap learned FSMap version 29 2023-03-17T09:00:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56009b55dd80 con 0x56009b7e2be0 2023-03-17T09:00:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f966f7fe700 1 -- 172.21.15.35:0/1064468988 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96840b4030 con 0x56009b7e2be0 2023-03-17T09:00:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.037+0000 7f966f7fe700 1 -- 172.21.15.35:0/1064468988 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9684096e20 con 0x56009b7e2be0 2023-03-17T09:00:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f96a29c6b80 10 client.15708 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:00:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f96a29c6b80 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:00:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f96a29c6b80 20 client.15708 populate_metadata read hostname 'smithi035' 2023-03-17T09:00:28.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b7f7010 0x56009b7f9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f96a29c6b80 4 client.15708 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:00:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56009b6fe600 con 0x56009b7f7010 2023-03-17T09:00:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f968ffff700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b7f7010 0x56009b7f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f968ffff700 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b7f7010 0x56009b7f9420 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeda6908cee4b826 server_cookie=c05898d3efd3bd6c in_seq=0 out_seq=0 2023-03-17T09:00:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.038+0000 7f966f7fe700 10 client.15708 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:00:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f966f7fe700 1 -- 172.21.15.35:0/1064468988 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56009b6fe600 con 0x56009b7f7010 2023-03-17T09:00:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f966f7fe700 10 client.15708 handle_command_reply: tid=0 2023-03-17T09:00:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 client.15708 shutdown 2023-03-17T09:00:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 msgr2=0x56009b7e6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:30.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e6770 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9684094370 tx=0x7f9684097b00 comp rx=0 tx=0).stop 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 shutdown_connections 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b7f7010 0x56009b7f9420 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f966f7fe700 0 client.15708 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1064468988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7e6770 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 >> 172.21.15.35:0/1064468988 conn(0x56009b63a6b0 msgr2=0x56009b7dc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 shutdown_connections 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1064468988 wait complete. 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.039+0000 7f96a29c6b80 20 client.15708 trim_cache size 0 max 16384 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.054+0000 7f96a29c6b80 1 Processor -- start 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.054+0000 7f96a29c6b80 1 -- start start 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 0x56009b7d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e2be0 0x56009b7edf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b7d8000 con 0x56009b7dd960 2023-03-17T09:00:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b7d85d0 con 0x56009b7e34f0 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b7d4b60 con 0x56009b7e2be0 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 0x56009b7d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 0x56009b7d7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43058/0 (socket says 172.21.15.35:43058) 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 -- 172.21.15.35:0/1546220742 learned_addr learned my addr 172.21.15.35:0/1546220742 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e2be0 0x56009b7edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 -- 172.21.15.35:0/1546220742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e2be0 msgr2=0x56009b7edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e2be0 0x56009b7edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 -- 172.21.15.35:0/1546220742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 msgr2=0x56009b7e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 -- 172.21.15.35:0/1546220742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56009b6f6130 con 0x56009b7dd960 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968f7fe700 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e2be0 0x56009b7edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f968ffff700 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 0x56009b7d7ac0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f968000ba70 tx=0x7f9680023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ae483a21583a2e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f9676ffd700 1 -- 172.21.15.35:0/1546220742 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000bea0 con 0x56009b7dd960 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f9676ffd700 1 -- 172.21.15.35:0/1546220742 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968001e040 con 0x56009b7dd960 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.055+0000 7f9676ffd700 1 -- 172.21.15.35:0/1546220742 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680004760 con 0x56009b7dd960 2023-03-17T09:00:30.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1546220742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 msgr2=0x56009b7d7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 0x56009b7d7ac0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f968000ba70 tx=0x7f9680023000 comp rx=0 tx=0).stop 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1546220742 shutdown_connections 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b7e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7dd960 0x56009b7d7ac0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/1546220742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7e2be0 0x56009b7edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1546220742 >> 172.21.15.35:0/1546220742 conn(0x56009b63a6b0 msgr2=0x56009b7f3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1546220742 shutdown_connections 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 -- 172.21.15.35:0/1546220742 wait complete. 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.056+0000 7f96a29c6b80 1 -- start start 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 Processor -- start 2023-03-17T09:00:30.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b849eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b7ecdc0 con 0x56009b7e2be0 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b84a420 con 0x56009b7e34f0 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009b84a5e0 con 0x56009b7dd960 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f96a29c6b80 10 client.0 _ll_register_callbacks cb 0x56009b5d5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7ec630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43066/0 (socket says 172.21.15.35:43066) 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f968f7fe700 1 -- 172.21.15.35:0/2931484482 learned_addr learned my addr 172.21.15.35:0/2931484482 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f968ffff700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.057+0000 7f9694dd6700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b849eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968f7fe700 1 -- 172.21.15.35:0/2931484482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 msgr2=0x56009b7ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968f7fe700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968f7fe700 1 -- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 msgr2=0x56009b849eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968f7fe700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b849eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968f7fe700 1 -- 172.21.15.35:0/2931484482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56009b5b15d0 con 0x56009b7e2be0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968ffff700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f968f7fe700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7ec630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9684005d90 tx=0x7f9684094220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b263eb9db2767833 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f966f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f966f7fe700 1 -- 172.21.15.35:0/2931484482 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840983f0 con 0x56009b7e2be0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f966f7fe700 1 -- 172.21.15.35:0/2931484482 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f968409fe30 con 0x56009b7e2be0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.058+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56009b7ad1e0 con 0x56009b7e2be0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f966f7fe700 1 -- 172.21.15.35:0/2931484482 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96840971f0 con 0x56009b7e2be0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 10 client.15714 fetch_fsmap learned FSMap version 29 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56009b5841f0 con 0x56009b7e2be0 2023-03-17T09:00:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f966f7fe700 1 -- 172.21.15.35:0/2931484482 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56009b7ad1e0 con 0x56009b7e2be0 2023-03-17T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f966f7fe700 1 -- 172.21.15.35:0/2931484482 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9684004950 con 0x56009b7e2be0 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 20 client.15714 populate_metadata read hostname 'smithi035' 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b84b9a0 0x56009b84ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 4 client.15714 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56009b5b3f00 con 0x56009b84b9a0 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f968ffff700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b84b9a0 0x56009b84ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f966f7fe700 10 client.15714 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.059+0000 7f968ffff700 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b84b9a0 0x56009b84ddb0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d9601f21074851 server_cookie=15e4fa8f0067f272 in_seq=0 out_seq=0 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f966f7fe700 1 -- 172.21.15.35:0/2931484482 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56009b5b3f00 con 0x56009b84b9a0 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f966f7fe700 10 client.15714 handle_command_reply: tid=0 2023-03-17T09:00:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f96a29c6b80 1 client.15714 shutdown 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 msgr2=0x56009b7ec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7ec630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9684005d90 tx=0x7f9684094220 comp rx=0 tx=0).stop 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 shutdown_connections 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.063+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56009b84b9a0 0x56009b84ddb0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56009b7e34f0 0x56009b849eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f966f7fe700 0 client.15714 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56009b7dd960 0x56009b7ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 1 --2- 172.21.15.35:0/2931484482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56009b7e2be0 0x56009b7ec630 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 >> 172.21.15.35:0/2931484482 conn(0x56009b63a6b0 msgr2=0x56009b7e6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 shutdown_connections 2023-03-17T09:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 1 -- 172.21.15.35:0/2931484482 wait complete. 2023-03-17T09:00:35.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f96a29c6b80 20 client.15714 trim_cache size 0 max 16384 2023-03-17T09:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:00:35.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:00:35.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f967809f640 msgr2=0x7f96780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f967809f640 0x7f96780a1af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f968000b580 tx=0x7f9680009f10 comp rx=0 tx=0).stop 2023-03-17T09:00:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 msgr2=0x7f96901975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 0x7f96901975b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f968400d950 tx=0x7f968400dc60 comp rx=0 tx=0).stop 2023-03-17T09:00:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 shutdown_connections 2023-03-17T09:00:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f967809f640 0x7f96780a1af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9690104390 0x7f96901a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96900ff350 0x7f9690197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 --2- 172.21.15.35:0/1626261268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96900ffcf0 0x7f96901975b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:42.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 >> 172.21.15.35:0/1626261268 conn(0x7f9690076330 msgr2=0x7f96900fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 shutdown_connections 2023-03-17T09:00:42.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:39.064+0000 7f9696839700 1 -- 172.21.15.35:0/1626261268 wait complete. 2023-03-17T09:00:43.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:40 smithi035 ceph-mon[92535]: pgmap v324: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:00:43.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:42 smithi035 ceph-mon[92535]: pgmap v325: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:00:43.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:44 smithi035 ceph-mon[92535]: pgmap v326: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:43.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:46 smithi035 ceph-mon[92535]: pgmap v327: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:43.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:48 smithi035 ceph-mon[92535]: pgmap v328: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:44.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:50 smithi035 ceph-mon[92535]: pgmap v329: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:44.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:14 smithi082 ceph-mon[94281]: pgmap v438: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:16 smithi082 ceph-mon[94281]: osdmap e102: 12 total, 12 up, 12 in 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:16 smithi082 ceph-mon[94281]: pgmap v440: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:18 smithi082 ceph-mon[94281]: pgmap v441: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:20 smithi082 ceph-mon[94281]: pgmap v442: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:22 smithi082 ceph-mon[94281]: pgmap v443: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:24 smithi082 ceph-mon[94281]: pgmap v444: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:26 smithi082 ceph-mon[94281]: pgmap v445: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:28 smithi082 ceph-mon[94281]: pgmap v446: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:30 smithi082 ceph-mon[94281]: pgmap v447: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:47.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:32 smithi082 ceph-mon[94281]: pgmap v448: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:34 smithi082 ceph-mon[94281]: pgmap v449: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:36 smithi082 ceph-mon[94281]: pgmap v450: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:38 smithi082 ceph-mon[94281]: pgmap v451: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:40 smithi082 ceph-mon[94281]: pgmap v452: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:00:48.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:00:48.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:48.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:42 smithi082 ceph-mon[94281]: pgmap v453: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:49.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:14 smithi078 ceph-mon[94114]: pgmap v438: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-03-17T09:00:49.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:16 smithi078 ceph-mon[94114]: osdmap e102: 12 total, 12 up, 12 in 2023-03-17T09:00:49.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:16 smithi078 ceph-mon[94114]: pgmap v440: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2023-03-17T09:00:49.120 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:18 smithi078 ceph-mon[94114]: pgmap v441: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:20 smithi078 ceph-mon[94114]: pgmap v442: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:22 smithi078 ceph-mon[94114]: pgmap v443: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:24 smithi078 ceph-mon[94114]: pgmap v444: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:26 smithi078 ceph-mon[94114]: pgmap v445: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:28 smithi078 ceph-mon[94114]: pgmap v446: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:30 smithi078 ceph-mon[94114]: pgmap v447: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:50.147 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:32 smithi078 ceph-mon[94114]: pgmap v448: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:34 smithi078 ceph-mon[94114]: pgmap v449: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:36 smithi078 ceph-mon[94114]: pgmap v450: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:38 smithi078 ceph-mon[94114]: pgmap v451: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:40 smithi078 ceph-mon[94114]: pgmap v452: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:00:51.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:00:51.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:00:51.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:42 smithi078 ceph-mon[94114]: pgmap v453: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:51.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:44 smithi078 ceph-mon[94114]: pgmap v454: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:51.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:46 smithi078 ceph-mon[94114]: pgmap v455: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:51.766 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:48 smithi078 ceph-mon[94114]: pgmap v456: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:51.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:44 smithi082 ceph-mon[94281]: pgmap v454: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:53.192 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:46 smithi082 ceph-mon[94281]: pgmap v455: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:00:53.192 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:48 smithi082 ceph-mon[94281]: pgmap v456: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:00:53.192 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:50 smithi082 ceph-mon[94281]: pgmap v457: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:00:53.194 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:52 smithi082 ceph-mon[94281]: pgmap v458: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:00:53.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:50 smithi078 ceph-mon[94114]: pgmap v457: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:00:53.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:52 smithi078 ceph-mon[94114]: pgmap v458: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:00:53.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 -- 172.21.15.35:0/1641820816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c101ba0 msgr2=0x7f825c10a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 --2- 172.21.15.35:0/1641820816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c101ba0 0x7f825c10a270 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8258009990 tx=0x7f8258009ca0 comp rx=0 tx=0).stop 2023-03-17T09:00:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 -- 172.21.15.35:0/1641820816 shutdown_connections 2023-03-17T09:00:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 --2- 172.21.15.35:0/1641820816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c10a7b0 0x7f825c10cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 --2- 172.21.15.35:0/1641820816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c101290 0x7f825c101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 --2- 172.21.15.35:0/1641820816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c101ba0 0x7f825c10a270 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 -- 172.21.15.35:0/1641820816 >> 172.21.15.35:0/1641820816 conn(0x7f825c076330 msgr2=0x7f825c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:00:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 -- 172.21.15.35:0/1641820816 shutdown_connections 2023-03-17T09:00:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.188+0000 7f8263b35700 1 -- 172.21.15.35:0/1641820816 wait complete. 2023-03-17T09:00:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 Processor -- start 2023-03-17T09:00:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 -- start start 2023-03-17T09:00:55.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c101290 0x7f825c0ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:55.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c101ba0 0x7f825c0ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:55.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 0x7f825c1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0ffe30 con 0x7f825c10a7b0 2023-03-17T09:00:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1a4980 con 0x7f825c101ba0 2023-03-17T09:00:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f8263b35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c1a4ac0 con 0x7f825c101290 2023-03-17T09:00:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f82620d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 0x7f825c1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f82620d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 0x7f825c1a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43082/0 (socket says 172.21.15.35:43082) 2023-03-17T09:00:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f82610d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c101ba0 0x7f825c0ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.189+0000 7f82620d2700 1 -- 172.21.15.35:0/2322971415 learned_addr learned my addr 172.21.15.35:0/2322971415 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82618d1700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c101290 0x7f825c0ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82620d2700 1 -- 172.21.15.35:0/2322971415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c101290 msgr2=0x7f825c0ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82620d2700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c101290 0x7f825c0ff0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82620d2700 1 -- 172.21.15.35:0/2322971415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c101ba0 msgr2=0x7f825c0ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82620d2700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c101ba0 0x7f825c0ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82620d2700 1 -- 172.21.15.35:0/2322971415 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580095f0 con 0x7f825c10a7b0 2023-03-17T09:00:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82610d0700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c101ba0 0x7f825c0ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f82620d2700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 0x7f825c1a4440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f82540094f0 tx=0x7f825400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f8252ffd700 1 -- 172.21.15.35:0/2322971415 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254004db0 con 0x7f825c10a7b0 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f8252ffd700 1 -- 172.21.15.35:0/2322971415 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f825400f040 con 0x7f825c10a7b0 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c110140 con 0x7f825c10a7b0 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f8252ffd700 1 -- 172.21.15.35:0/2322971415 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540058b0 con 0x7f825c10a7b0 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.190+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c10ffb0 con 0x7f825c10a7b0 2023-03-17T09:00:57.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.192+0000 7f8252ffd700 1 -- 172.21.15.35:0/2322971415 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f825400db20 con 0x7f825c10a7b0 2023-03-17T09:00:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.193+0000 7f8252ffd700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f824809f640 0x7f82480a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.193+0000 7f82618d1700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f824809f640 0x7f82480a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:00:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.193+0000 7f8252ffd700 1 -- 172.21.15.35:0/2322971415 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f82540c9ef0 con 0x7f825c10a7b0 2023-03-17T09:00:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.193+0000 7f82618d1700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f824809f640 0x7f82480a1af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f824c005950 tx=0x7f824c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:00:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 Processor -- start 2023-03-17T09:00:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 -- start start 2023-03-17T09:00:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563393643be0 0x563393643fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339363e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:59.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339363ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:00:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563393545010 con 0x5633936444f0 2023-03-17T09:01:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563393597950 con 0x56339363e960 2023-03-17T09:01:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.194+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563393590de0 con 0x563393643be0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339363e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339363e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43088/0 (socket says 172.21.15.35:43088) 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 -- 172.21.15.35:0/2230781809 learned_addr learned my addr 172.21.15.35:0/2230781809 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82618d1700 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563393643be0 0x563393643fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82620d2700 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339363ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 -- 172.21.15.35:0/2230781809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563393643be0 msgr2=0x563393643fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563393643be0 0x563393643fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 -- 172.21.15.35:0/2230781809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 msgr2=0x56339363ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339363ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 -- 172.21.15.35:0/2230781809 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633934125d0 con 0x5633936444f0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82620d2700 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339363ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f82610d0700 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339363e420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8258009990 tx=0x7f8258005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21687aed9f1bb6b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f8247fff700 1 -- 172.21.15.35:0/2230781809 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825801d050 con 0x5633936444f0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f8247fff700 1 -- 172.21.15.35:0/2230781809 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f825801e040 con 0x5633936444f0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.195+0000 7f8247fff700 1 -- 172.21.15.35:0/2230781809 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580048c0 con 0x5633936444f0 2023-03-17T09:01:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 -- 172.21.15.35:0/2230781809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 msgr2=0x56339363e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339363e420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8258009990 tx=0x7f8258005bc0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 -- 172.21.15.35:0/2230781809 shutdown_connections 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339363ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563393643be0 0x563393643fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/2230781809 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339363e420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 -- 172.21.15.35:0/2230781809 >> 172.21.15.35:0/2230781809 conn(0x56339349b6b0 msgr2=0x563393638a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 -- 172.21.15.35:0/2230781809 shutdown_connections 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.196+0000 7f826fcc2b80 1 -- 172.21.15.35:0/2230781809 wait complete. 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 -- start start 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 Processor -- start 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339364a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 0x5633936476e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633936444f0 0x563393647cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633934148c0 con 0x563393643be0 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563393648480 con 0x56339363e960 2023-03-17T09:01:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563393654030 con 0x5633936444f0 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f826fcc2b80 10 client.0 _ll_register_callbacks cb 0x563393436230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.197+0000 7f82610d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 0x5633936476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 0x5633936476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43094/0 (socket says 172.21.15.35:43094) 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 -- 172.21.15.35:0/482336711 learned_addr learned my addr 172.21.15.35:0/482336711 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82620d2700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633936444f0 0x563393647cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82618d1700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339364a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 -- 172.21.15.35:0/482336711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633936444f0 msgr2=0x563393647cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633936444f0 0x563393647cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 -- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 msgr2=0x56339364a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339364a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 -- 172.21.15.35:0/482336711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c10d890 con 0x563393643be0 2023-03-17T09:01:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82618d1700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339364a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:01:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82610d0700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 0x5633936476e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8258006010 tx=0x7f8258003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9136c833824a99e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:01:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82457fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:01:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82457fa700 1 -- 172.21.15.35:0/482336711 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258004180 con 0x563393643be0 2023-03-17T09:01:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82457fa700 1 -- 172.21.15.35:0/482336711 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f825800f460 con 0x563393643be0 2023-03-17T09:01:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563393553390 con 0x563393643be0 2023-03-17T09:01:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f82457fa700 1 -- 172.21.15.35:0/482336711 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f825800f620 con 0x563393643be0 2023-03-17T09:01:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f826fcc2b80 10 client.15726 fetch_fsmap learned FSMap version 29 2023-03-17T09:01:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.198+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5633933bed80 con 0x563393643be0 2023-03-17T09:01:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f82457fa700 1 -- 172.21.15.35:0/482336711 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563393553390 con 0x563393643be0 2023-03-17T09:01:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f82457fa700 1 -- 172.21.15.35:0/482336711 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8258023460 con 0x563393643be0 2023-03-17T09:01:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f826fcc2b80 10 client.15726 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:01:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f826fcc2b80 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:01:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f826fcc2b80 20 client.15726 populate_metadata read hostname 'smithi035' 2023-03-17T09:01:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563393657c50 0x56339365a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:04.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f826fcc2b80 4 client.15726 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:01:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56339355f600 con 0x563393657c50 2023-03-17T09:01:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.199+0000 7f82618d1700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563393657c50 0x56339365a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f82457fa700 10 client.15726 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f82618d1700 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563393657c50 0x56339365a060 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6654421cb42b99 server_cookie=e4907476fd5e4bfc in_seq=0 out_seq=0 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f82457fa700 1 -- 172.21.15.35:0/482336711 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56339355f600 con 0x563393657c50 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f82457fa700 10 client.15726 handle_command_reply: tid=0 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f826fcc2b80 1 client.15726 shutdown 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 msgr2=0x5633936476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 0x5633936476e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8258006010 tx=0x7f8258003a50 comp rx=0 tx=0).stop 2023-03-17T09:01:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 shutdown_connections 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563393657c50 0x56339365a060 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.200+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633936444f0 0x563393647cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f82457fa700 0 client.15726 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56339363e960 0x56339364a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/482336711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563393643be0 0x5633936476e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 >> 172.21.15.35:0/482336711 conn(0x56339349b6b0 msgr2=0x56339363d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 shutdown_connections 2023-03-17T09:01:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f826fcc2b80 1 -- 172.21.15.35:0/482336711 wait complete. 2023-03-17T09:01:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.201+0000 7f826fcc2b80 20 client.15726 trim_cache size 0 max 16384 2023-03-17T09:01:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 Processor -- start 2023-03-17T09:01:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 -- start start 2023-03-17T09:01:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:06.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x563393649f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:07.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x563393641650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563393635b60 con 0x5633936444f0 2023-03-17T09:01:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633936340d0 con 0x563393643be0 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633936482c0 con 0x56339363e960 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x563393641650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x563393641650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43104/0 (socket says 172.21.15.35:43104) 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 -- 172.21.15.35:0/785108020 learned_addr learned my addr 172.21.15.35:0/785108020 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82610d0700 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x563393649f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82618d1700 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 -- 172.21.15.35:0/785108020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 msgr2=0x56339364ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 -- 172.21.15.35:0/785108020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 msgr2=0x563393649f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x563393649f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.216+0000 7f82620d2700 1 -- 172.21.15.35:0/785108020 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563393557130 con 0x5633936444f0 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f82620d2700 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x563393641650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8254097930 tx=0x7f8254009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2386a4c62d2140 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f8250dae700 1 -- 172.21.15.35:0/785108020 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540979a0 con 0x5633936444f0 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f8250dae700 1 -- 172.21.15.35:0/785108020 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f825409fb90 con 0x5633936444f0 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f8250dae700 1 -- 172.21.15.35:0/785108020 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254095e60 con 0x5633936444f0 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 -- 172.21.15.35:0/785108020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 msgr2=0x563393641650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x563393641650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8254097930 tx=0x7f8254009ea0 comp rx=0 tx=0).stop 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 -- 172.21.15.35:0/785108020 shutdown_connections 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x563393641650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/785108020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x563393649f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 -- 172.21.15.35:0/785108020 >> 172.21.15.35:0/785108020 conn(0x56339349b6b0 msgr2=0x56339363da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:01:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 -- 172.21.15.35:0/785108020 shutdown_connections 2023-03-17T09:01:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.217+0000 7f826fcc2b80 1 -- 172.21.15.35:0/785108020 wait complete. 2023-03-17T09:01:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 -- start start 2023-03-17T09:01:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 Processor -- start 2023-03-17T09:01:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x56339364d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339364dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56339364e3c0 con 0x5633936444f0 2023-03-17T09:01:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633936abac0 con 0x563393643be0 2023-03-17T09:01:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633936abc00 con 0x56339363e960 2023-03-17T09:01:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f826fcc2b80 10 client.0 _ll_register_callbacks cb 0x563393436230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:01:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f82620d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339364dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f82620d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339364dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43110/0 (socket says 172.21.15.35:43110) 2023-03-17T09:01:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f82620d2700 1 -- 172.21.15.35:0/1260863688 learned_addr learned my addr 172.21.15.35:0/1260863688 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:01:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.218+0000 7f82618d1700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82610d0700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x56339364d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82620d2700 1 -- 172.21.15.35:0/1260863688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 msgr2=0x56339364f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82620d2700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82620d2700 1 -- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 msgr2=0x56339364d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:01:18.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82620d2700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x56339364d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82620d2700 1 -- 172.21.15.35:0/1260863688 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c10ffb0 con 0x5633936444f0 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82610d0700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x56339364d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82618d1700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82620d2700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339364dce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f825409f660 tx=0x7f8254005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94f336db8394522 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82457fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82457fa700 1 -- 172.21.15.35:0/1260863688 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540979a0 con 0x5633936444f0 2023-03-17T09:01:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82457fa700 1 -- 172.21.15.35:0/1260863688 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f82540c71f0 con 0x5633936444f0 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56339360e1e0 con 0x5633936444f0 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f82457fa700 1 -- 172.21.15.35:0/1260863688 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82540c73b0 con 0x5633936444f0 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f826fcc2b80 10 client.15732 fetch_fsmap learned FSMap version 29 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.219+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5633933e51f0 con 0x5633936444f0 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f82457fa700 1 -- 172.21.15.35:0/1260863688 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56339360e1e0 con 0x5633936444f0 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f82457fa700 1 -- 172.21.15.35:0/1260863688 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8254097c00 con 0x5633936444f0 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f826fcc2b80 10 client.15732 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f826fcc2b80 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:01:18.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f826fcc2b80 20 client.15732 populate_metadata read hostname 'smithi035' 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633936acff0 0x5633936af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f826fcc2b80 4 client.15732 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563393414f00 con 0x5633936acff0 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.220+0000 7f82618d1700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633936acff0 0x5633936af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.221+0000 7f82457fa700 10 client.15732 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.221+0000 7f82618d1700 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633936acff0 0x5633936af400 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cc7b177c18a7655 server_cookie=ee6a360c445f8a28 in_seq=0 out_seq=0 2023-03-17T09:01:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.224+0000 7f82457fa700 1 -- 172.21.15.35:0/1260863688 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563393414f00 con 0x5633936acff0 2023-03-17T09:01:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.224+0000 7f82457fa700 10 client.15732 handle_command_reply: tid=0 2023-03-17T09:01:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.224+0000 7f826fcc2b80 1 client.15732 shutdown 2023-03-17T09:01:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 msgr2=0x56339364dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:20.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339364dce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f825409f660 tx=0x7f8254005320 comp rx=0 tx=0).stop 2023-03-17T09:01:20.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 shutdown_connections 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633936acff0 0x5633936af400 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633936444f0 0x56339364dce0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56339363e960 0x56339364f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 --2- 172.21.15.35:0/1260863688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563393643be0 0x56339364d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 >> 172.21.15.35:0/1260863688 conn(0x56339349b6b0 msgr2=0x563393641650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f82457fa700 0 client.15732 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 shutdown_connections 2023-03-17T09:01:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 1 -- 172.21.15.35:0/1260863688 wait complete. 2023-03-17T09:01:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f826fcc2b80 20 client.15732 trim_cache size 0 max 16384 2023-03-17T09:01:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:01:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:01:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:01:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:01:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f824809f640 msgr2=0x7f82480a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f824809f640 0x7f82480a1af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f824c005950 tx=0x7f824c00b410 comp rx=0 tx=0).stop 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 msgr2=0x7f825c1a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 0x7f825c1a4440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f82540094f0 tx=0x7f825400d3b0 comp rx=0 tx=0).stop 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 shutdown_connections 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f824809f640 0x7f82480a1af0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f825c10a7b0 0x7f825c1a4440 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f825c101290 0x7f825c0ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 --2- 172.21.15.35:0/2322971415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c101ba0 0x7f825c0ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.225+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 >> 172.21.15.35:0/2322971415 conn(0x7f825c076330 msgr2=0x7f825c1021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.226+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 shutdown_connections 2023-03-17T09:01:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:56:52.226+0000 7f8263b35700 1 -- 172.21.15.35:0/2322971415 wait complete. 2023-03-17T09:01:26.374 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:52 smithi035 ceph-mon[92535]: pgmap v330: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:27.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:54 smithi035 ceph-mon[92535]: pgmap v331: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:27.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:56 smithi035 ceph-mon[92535]: pgmap v332: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:01:27.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:56:58 smithi035 ceph-mon[92535]: pgmap v333: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:27.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:00 smithi035 ceph-mon[92535]: pgmap v334: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:27.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:02 smithi035 ceph-mon[92535]: pgmap v335: 97 pgs: 97 active+clean; 1.3 MiB data, 90 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:27.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:04 smithi035 ceph-mon[92535]: pgmap v336: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:01:27.916 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:54 smithi082 ceph-mon[94281]: pgmap v459: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:29.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:56 smithi082 ceph-mon[94281]: pgmap v460: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:30.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:00:58 smithi082 ceph-mon[94281]: pgmap v461: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:30.216 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:00 smithi082 ceph-mon[94281]: pgmap v462: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:30.217 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:02 smithi082 ceph-mon[94281]: pgmap v463: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:30.217 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:04 smithi082 ceph-mon[94281]: pgmap v464: 97 pgs: 97 active+clean; 1.3 MiB data, 107 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:01:30.217 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:05 smithi082 ceph-mon[94281]: osdmap e103: 12 total, 12 up, 12 in 2023-03-17T09:01:31.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:06 smithi082 ceph-mon[94281]: pgmap v466: 97 pgs: 97 active+clean; 1.3 MiB data, 107 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:01:31.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:08 smithi082 ceph-mon[94281]: pgmap v467: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:01:31.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:10 smithi082 ceph-mon[94281]: pgmap v468: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:01:31.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:10 smithi082 ceph-mon[94281]: osdmap e104: 12 total, 12 up, 12 in 2023-03-17T09:01:32.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:12 smithi082 ceph-mon[94281]: pgmap v470: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:01:32.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:14 smithi082 ceph-mon[94281]: pgmap v471: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T09:01:33.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:16 smithi082 ceph-mon[94281]: pgmap v472: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:01:33.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:18 smithi082 ceph-mon[94281]: pgmap v473: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:01:33.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:20 smithi082 ceph-mon[94281]: pgmap v474: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:01:33.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:22 smithi082 ceph-mon[94281]: pgmap v475: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 463 B/s wr, 9 op/s 2023-03-17T09:01:33.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:24 smithi082 ceph-mon[94281]: pgmap v476: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:26 smithi082 ceph-mon[94281]: pgmap v477: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:54 smithi078 ceph-mon[94114]: pgmap v459: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:56 smithi078 ceph-mon[94114]: pgmap v460: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:00:58 smithi078 ceph-mon[94114]: pgmap v461: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:00 smithi078 ceph-mon[94114]: pgmap v462: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:02 smithi078 ceph-mon[94114]: pgmap v463: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:04 smithi078 ceph-mon[94114]: pgmap v464: 97 pgs: 97 active+clean; 1.3 MiB data, 107 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:05 smithi078 ceph-mon[94114]: osdmap e103: 12 total, 12 up, 12 in 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:06 smithi078 ceph-mon[94114]: pgmap v466: 97 pgs: 97 active+clean; 1.3 MiB data, 107 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:08 smithi078 ceph-mon[94114]: pgmap v467: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:10 smithi078 ceph-mon[94114]: pgmap v468: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:10 smithi078 ceph-mon[94114]: osdmap e104: 12 total, 12 up, 12 in 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:12 smithi078 ceph-mon[94114]: pgmap v470: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:14 smithi078 ceph-mon[94114]: pgmap v471: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:16 smithi078 ceph-mon[94114]: pgmap v472: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:18 smithi078 ceph-mon[94114]: pgmap v473: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:01:33.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:20 smithi078 ceph-mon[94114]: pgmap v474: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:01:33.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:22 smithi078 ceph-mon[94114]: pgmap v475: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 463 B/s wr, 9 op/s 2023-03-17T09:01:33.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:24 smithi078 ceph-mon[94114]: pgmap v476: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:01:33.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:26 smithi078 ceph-mon[94114]: pgmap v477: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:01:33.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:28 smithi082 ceph-mon[94281]: pgmap v478: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:01:35.158 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:30 smithi082 ceph-mon[94281]: pgmap v479: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:01:35.158 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:32 smithi082 ceph-mon[94281]: pgmap v480: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:01:35.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:28 smithi078 ceph-mon[94114]: pgmap v478: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:01:35.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:30 smithi078 ceph-mon[94114]: pgmap v479: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:01:35.542 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:32 smithi078 ceph-mon[94114]: pgmap v480: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:01:35.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:34 smithi082 ceph-mon[94281]: pgmap v481: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:36.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:34 smithi078 ceph-mon[94114]: pgmap v481: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:36.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:36 smithi082 ceph-mon[94281]: pgmap v482: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:36.848 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:36 smithi078 ceph-mon[94114]: pgmap v482: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:01:38.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:38 smithi082 ceph-mon[94281]: pgmap v483: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:38.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:38 smithi078 ceph-mon[94114]: pgmap v483: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:01:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 -- 172.21.15.35:0/2940849646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93240ffcf0 msgr2=0x7f9324103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:40.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 --2- 172.21.15.35:0/2940849646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93240ffcf0 0x7f9324103cb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f93100099c0 tx=0x7f9310009cd0 comp rx=0 tx=0).stop 2023-03-17T09:01:40.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 -- 172.21.15.35:0/2940849646 shutdown_connections 2023-03-17T09:01:40.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 --2- 172.21.15.35:0/2940849646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9324104390 0x7f932410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 --2- 172.21.15.35:0/2940849646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93240ff350 0x7f93240ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 --2- 172.21.15.35:0/2940849646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93240ffcf0 0x7f9324103cb0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 -- 172.21.15.35:0/2940849646 >> 172.21.15.35:0/2940849646 conn(0x7f9324076330 msgr2=0x7f9324076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:01:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 -- 172.21.15.35:0/2940849646 shutdown_connections 2023-03-17T09:01:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.347+0000 7f932aaf9700 1 -- 172.21.15.35:0/2940849646 wait complete. 2023-03-17T09:01:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 Processor -- start 2023-03-17T09:01:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 -- start start 2023-03-17T09:01:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93240ff350 0x7f93241970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93240ffcf0 0x7f9324197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 0x7f93241a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9324197f60 con 0x7f9324104390 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93241a26a0 con 0x7f93240ff350 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.348+0000 7f932aaf9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93241a2860 con 0x7f93240ffcf0 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 0x7f93241a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 0x7f93241a2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43124/0 (socket says 172.21.15.35:43124) 2023-03-17T09:01:46.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 -- 172.21.15.35:0/3826319301 learned_addr learned my addr 172.21.15.35:0/3826319301 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:01:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9323fff700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93240ffcf0 0x7f9324197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9328895700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93240ff350 0x7f93241970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 -- 172.21.15.35:0/3826319301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93240ffcf0 msgr2=0x7f9324197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93240ffcf0 0x7f9324197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 -- 172.21.15.35:0/3826319301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93240ff350 msgr2=0x7f93241970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93240ff350 0x7f93241970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 -- 172.21.15.35:0/3826319301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100095f0 con 0x7f9324104390 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9329096700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 0x7f93241a2160 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f931c007ee0 tx=0x7f931c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9321ffb700 1 -- 172.21.15.35:0/3826319301 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00dd20 con 0x7f9324104390 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932410efc0 con 0x7f9324104390 2023-03-17T09:01:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9321ffb700 1 -- 172.21.15.35:0/3826319301 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f931c00f040 con 0x7f9324104390 2023-03-17T09:01:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.349+0000 7f9321ffb700 1 -- 172.21.15.35:0/3826319301 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c004750 con 0x7f9324104390 2023-03-17T09:01:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.350+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932410ee30 con 0x7f9324104390 2023-03-17T09:01:55.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.352+0000 7f9321ffb700 1 -- 172.21.15.35:0/3826319301 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f931c003a00 con 0x7f9324104390 2023-03-17T09:01:55.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.353+0000 7f9321ffb700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f931409f640 0x7f93140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.353+0000 7f9321ffb700 1 -- 172.21.15.35:0/3826319301 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f931c0c9ef0 con 0x7f9324104390 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.353+0000 7f9328895700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f931409f640 0x7f93140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9328895700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f931409f640 0x7f93140a1af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9318005950 tx=0x7f931800b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 Processor -- start 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 -- start start 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 0x556de0f9d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0f9d960 0x556de0f9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0ea4010 con 0x556de0fa34f0 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0ef6950 con 0x556de0f9d960 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9336c86b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0eefde0 con 0x556de0fa2be0 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 0x556de0f9d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 0x556de0f9d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43130/0 (socket says 172.21.15.35:43130) 2023-03-17T09:01:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 -- 172.21.15.35:0/4042504353 learned_addr learned my addr 172.21.15.35:0/4042504353 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:01:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9329096700 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0f9d960 0x556de0f9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9328895700 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:01:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 -- 172.21.15.35:0/4042504353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 msgr2=0x556de0fa2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 -- 172.21.15.35:0/4042504353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0f9d960 msgr2=0x556de0f9dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0f9d960 0x556de0f9dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.354+0000 7f9323fff700 1 -- 172.21.15.35:0/4042504353 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556de0d715d0 con 0x556de0fa34f0 2023-03-17T09:02:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.355+0000 7f9323fff700 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 0x556de0f9d420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f931000b580 tx=0x7f9310005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a652407e2e85d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.355+0000 7f930effd700 1 -- 172.21.15.35:0/4042504353 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931001d050 con 0x556de0fa34f0 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.355+0000 7f930effd700 1 -- 172.21.15.35:0/4042504353 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f931001e040 con 0x556de0fa34f0 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.355+0000 7f930effd700 1 -- 172.21.15.35:0/4042504353 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310003cf0 con 0x556de0fa34f0 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 -- 172.21.15.35:0/4042504353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 msgr2=0x556de0f9d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 0x556de0f9d420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f931000b580 tx=0x7f9310005990 comp rx=0 tx=0).stop 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 -- 172.21.15.35:0/4042504353 shutdown_connections 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0f9d960 0x556de0f9dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4042504353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0fa34f0 0x556de0f9d420 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 -- 172.21.15.35:0/4042504353 >> 172.21.15.35:0/4042504353 conn(0x556de0dfa6b0 msgr2=0x556de0f97a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 -- 172.21.15.35:0/4042504353 shutdown_connections 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 -- 172.21.15.35:0/4042504353 wait complete. 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 -- start start 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 Processor -- start 2023-03-17T09:02:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.356+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fa9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9336c86b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0d738c0 con 0x556de0f9d960 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9336c86b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0fa7330 con 0x556de0fa34f0 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9336c86b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0fa74f0 con 0x556de0fa2be0 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9336c86b80 10 client.0 _ll_register_callbacks cb 0x556de0d95230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9328895700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fa9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9328895700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fa9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43134/0 (socket says 172.21.15.35:43134) 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:34902/0 (socket says 172.21.15.35:34902) 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9328895700 1 -- 172.21.15.35:0/216827233 learned_addr learned my addr 172.21.15.35:0/216827233 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9329096700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:03.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 -- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 msgr2=0x556de0fa6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 -- 172.21.15.35:0/216827233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 msgr2=0x556de0fa9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fa9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 -- 172.21.15.35:0/216827233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932410c7a0 con 0x556de0fa2be0 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9328895700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fa9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9323fff700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa6660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9310000c00 tx=0x7f931000bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ec90fed095c365 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9303fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:02:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.357+0000 7f9303fff700 1 -- 172.21.15.35:0/216827233 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310004680 con 0x556de0fa2be0 2023-03-17T09:02:04.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556de0eb2390 con 0x556de0fa2be0 2023-03-17T09:02:04.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9303fff700 1 -- 172.21.15.35:0/216827233 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9310004830 con 0x556de0fa2be0 2023-03-17T09:02:04.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9303fff700 1 -- 172.21.15.35:0/216827233 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9310003a30 con 0x556de0fa2be0 2023-03-17T09:02:04.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 10 client.25477 fetch_fsmap learned FSMap version 29 2023-03-17T09:02:04.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556de0d1dd80 con 0x556de0fa2be0 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9303fff700 1 -- 172.21.15.35:0/216827233 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556de0eb2390 con 0x556de0fa2be0 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9303fff700 1 -- 172.21.15.35:0/216827233 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f931000f8b0 con 0x556de0fa2be0 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 10 client.25477 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 10 client.25477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 20 client.25477 populate_metadata read hostname 'smithi035' 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de0fb6c20 0x556de0fb9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 4 client.25477 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.358+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556de0ebe600 con 0x556de0fb6c20 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.359+0000 7f9328895700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de0fb6c20 0x556de0fb9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.359+0000 7f9328895700 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de0fb6c20 0x556de0fb9030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34d6e6713e0b6acf server_cookie=df03dd29714d9fbe in_seq=0 out_seq=0 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.359+0000 7f9303fff700 10 client.25477 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9303fff700 1 -- 172.21.15.35:0/216827233 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556de0ebe600 con 0x556de0fb6c20 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9303fff700 10 client.25477 handle_command_reply: tid=0 2023-03-17T09:02:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 client.25477 shutdown 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 msgr2=0x556de0fa6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa6660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9310000c00 tx=0x7f931000bfa0 comp rx=0 tx=0).stop 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 shutdown_connections 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de0fb6c20 0x556de0fb9030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9303fff700 0 client.25477 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fa9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 --2- 172.21.15.35:0/216827233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa6660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 >> 172.21.15.35:0/216827233 conn(0x556de0dfa6b0 msgr2=0x556de0f9c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 shutdown_connections 2023-03-17T09:02:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 1 -- 172.21.15.35:0/216827233 wait complete. 2023-03-17T09:02:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.360+0000 7f9336c86b80 20 client.25477 trim_cache size 0 max 16384 2023-03-17T09:02:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 Processor -- start 2023-03-17T09:02:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 -- start start 2023-03-17T09:02:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fadf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0fa7bd0 con 0x556de0f9d960 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0fa7590 con 0x556de0fa34f0 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9336c86b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de0f9d790 con 0x556de0fa2be0 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9328895700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fadf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9328895700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fadf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43142/0 (socket says 172.21.15.35:43142) 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.375+0000 7f9328895700 1 -- 172.21.15.35:0/4262339665 learned_addr learned my addr 172.21.15.35:0/4262339665 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9323fff700 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9328895700 1 -- 172.21.15.35:0/4262339665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 msgr2=0x556de0fa5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9328895700 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9328895700 1 -- 172.21.15.35:0/4262339665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 msgr2=0x556de0fa8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9328895700 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9328895700 1 -- 172.21.15.35:0/4262339665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556de0eb6130 con 0x556de0f9d960 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f9328895700 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fadf50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9318011010 tx=0x7f9318013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4062613e74341e8f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f930f7fe700 1 -- 172.21.15.35:0/4262339665 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318025070 con 0x556de0f9d960 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f930f7fe700 1 -- 172.21.15.35:0/4262339665 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9318015070 con 0x556de0f9d960 2023-03-17T09:02:06.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.376+0000 7f930f7fe700 1 -- 172.21.15.35:0/4262339665 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318011440 con 0x556de0f9d960 2023-03-17T09:02:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- 172.21.15.35:0/4262339665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 msgr2=0x556de0fadf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fadf50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9318011010 tx=0x7f9318013000 comp rx=0 tx=0).stop 2023-03-17T09:02:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- 172.21.15.35:0/4262339665 shutdown_connections 2023-03-17T09:02:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa34f0 0x556de0fa8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fadf50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- 172.21.15.35:0/4262339665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa2be0 0x556de0fa5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- 172.21.15.35:0/4262339665 >> 172.21.15.35:0/4262339665 conn(0x556de0dfa6b0 msgr2=0x556de0f9ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- 172.21.15.35:0/4262339665 shutdown_connections 2023-03-17T09:02:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- 172.21.15.35:0/4262339665 wait complete. 2023-03-17T09:02:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- start start 2023-03-17T09:02:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 Processor -- start 2023-03-17T09:02:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa2be0 0x556de0fac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa34f0 0x556de1007e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1008410 con 0x556de0f9d960 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1008580 con 0x556de0fa2be0 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de1008740 con 0x556de0fa34f0 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.377+0000 7f9336c86b80 10 client.0 _ll_register_callbacks cb 0x556de0d95230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43148/0 (socket says 172.21.15.35:43148) 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 -- 172.21.15.35:0/1835183064 learned_addr learned my addr 172.21.15.35:0/1835183064 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9329096700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa34f0 0x556de1007e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9323fff700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa2be0 0x556de0fac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 -- 172.21.15.35:0/1835183064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa34f0 msgr2=0x556de1007e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa34f0 0x556de1007e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 -- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa2be0 msgr2=0x556de0fac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa2be0 0x556de0fac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 -- 172.21.15.35:0/1835183064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93180204c0 con 0x556de0f9d960 2023-03-17T09:02:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9323fff700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa2be0 0x556de0fac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:02:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9328895700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fac120 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9318010ec0 tx=0x7f931800ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fd0bddc6390fc9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9303fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:02:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9303fff700 1 -- 172.21.15.35:0/1835183064 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318025040 con 0x556de0f9d960 2023-03-17T09:02:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9303fff700 1 -- 172.21.15.35:0/1835183064 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9318017070 con 0x556de0f9d960 2023-03-17T09:02:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556de0f6d1e0 con 0x556de0f9d960 2023-03-17T09:02:09.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9303fff700 1 -- 172.21.15.35:0/1835183064 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9318028e40 con 0x556de0f9d960 2023-03-17T09:02:09.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9336c86b80 10 client.15750 fetch_fsmap learned FSMap version 29 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.378+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556de0d441f0 con 0x556de0f9d960 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9303fff700 1 -- 172.21.15.35:0/1835183064 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556de0f6d1e0 con 0x556de0f9d960 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9303fff700 1 -- 172.21.15.35:0/1835183064 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9318004820 con 0x556de0f9d960 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9336c86b80 10 client.15750 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9336c86b80 10 client.15750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9336c86b80 20 client.15750 populate_metadata read hostname 'smithi035' 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9336c86b80 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de100fe00 0x556de1012210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9336c86b80 4 client.15750 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556de0d73f00 con 0x556de100fe00 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.379+0000 7f9323fff700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de100fe00 0x556de1012210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.380+0000 7f9303fff700 10 client.15750 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.380+0000 7f9323fff700 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de100fe00 0x556de1012210 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc14701e934bb833 server_cookie=69c9bbd04f6d6ee1 in_seq=0 out_seq=0 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9303fff700 1 -- 172.21.15.35:0/1835183064 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556de0d73f00 con 0x556de100fe00 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9303fff700 10 client.15750 handle_command_reply: tid=0 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 client.15750 shutdown 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 msgr2=0x556de0fac120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fac120 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9318010ec0 tx=0x7f931800ba30 comp rx=0 tx=0).stop 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 shutdown_connections 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556de100fe00 0x556de1012210 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556de0fa34f0 0x556de1007e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556de0f9d960 0x556de0fac120 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9303fff700 0 client.15750 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 --2- 172.21.15.35:0/1835183064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556de0fa2be0 0x556de0fac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 >> 172.21.15.35:0/1835183064 conn(0x556de0dfa6b0 msgr2=0x556de0fa06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 shutdown_connections 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.386+0000 7f9336c86b80 1 -- 172.21.15.35:0/1835183064 wait complete. 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f9336c86b80 20 client.15750 trim_cache size 0 max 16384 2023-03-17T09:02:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f931409f640 msgr2=0x7f93140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f931409f640 0x7f93140a1af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9318005950 tx=0x7f931800b410 comp rx=0 tx=0).stop 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 msgr2=0x7f93241a2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 0x7f93241a2160 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f931c007ee0 tx=0x7f931c00d3b0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 shutdown_connections 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f931409f640 0x7f93140a1af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9324104390 0x7f93241a2160 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93240ff350 0x7f93241970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 --2- 172.21.15.35:0/3826319301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93240ffcf0 0x7f9324197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 >> 172.21.15.35:0/3826319301 conn(0x7f9324076330 msgr2=0x7f93240fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 shutdown_connections 2023-03-17T09:02:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:05.387+0000 7f932aaf9700 1 -- 172.21.15.35:0/3826319301 wait complete. 2023-03-17T09:02:10.376 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:06 smithi035 ceph-mon[92535]: pgmap v337: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:08 smithi035 ceph-mon[92535]: pgmap v338: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:10 smithi035 ceph-mon[92535]: pgmap v339: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:10 smithi035 ceph-mon[92535]: osdmap e95: 12 total, 12 up, 12 in 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:12 smithi035 ceph-mon[92535]: pgmap v341: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:14 smithi035 ceph-mon[92535]: pgmap v342: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:16 smithi035 ceph-mon[92535]: osdmap e96: 12 total, 12 up, 12 in 2023-03-17T09:02:11.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:16 smithi035 ceph-mon[92535]: pgmap v344: 97 pgs: 97 active+clean; 1.3 MiB data, 91 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T09:02:12.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:18 smithi035 ceph-mon[92535]: pgmap v345: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T09:02:12.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:40 smithi082 ceph-mon[94281]: pgmap v484: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:42 smithi082 ceph-mon[94281]: pgmap v485: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:44 smithi082 ceph-mon[94281]: pgmap v486: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:46 smithi082 ceph-mon[94281]: pgmap v487: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:48 smithi082 ceph-mon[94281]: pgmap v488: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:50 smithi082 ceph-mon[94281]: pgmap v489: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:13.532 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:52 smithi082 ceph-mon[94281]: pgmap v490: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:54 smithi082 ceph-mon[94281]: pgmap v491: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:56 smithi082 ceph-mon[94281]: pgmap v492: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:01:58 smithi082 ceph-mon[94281]: pgmap v493: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:00 smithi082 ceph-mon[94281]: pgmap v494: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:02 smithi082 ceph-mon[94281]: pgmap v495: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:04 smithi082 ceph-mon[94281]: pgmap v496: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:06 smithi082 ceph-mon[94281]: pgmap v497: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:02:14.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:08 smithi082 ceph-mon[94281]: pgmap v498: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:02:14.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:10 smithi082 ceph-mon[94281]: pgmap v499: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:02:14.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:10 smithi082 ceph-mon[94281]: osdmap e105: 12 total, 12 up, 12 in 2023-03-17T09:02:14.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:40 smithi078 ceph-mon[94114]: pgmap v484: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:14.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:02:18.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:02:18.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:02:18.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:02:18.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:42 smithi078 ceph-mon[94114]: pgmap v485: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:18.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:44 smithi078 ceph-mon[94114]: pgmap v486: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:20.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:46 smithi078 ceph-mon[94114]: pgmap v487: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:02:20.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:48 smithi078 ceph-mon[94114]: pgmap v488: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:20.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:50 smithi078 ceph-mon[94114]: pgmap v489: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:20.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:52 smithi078 ceph-mon[94114]: pgmap v490: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:20.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:54 smithi078 ceph-mon[94114]: pgmap v491: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:56 smithi078 ceph-mon[94114]: pgmap v492: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:01:58 smithi078 ceph-mon[94114]: pgmap v493: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:00 smithi078 ceph-mon[94114]: pgmap v494: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:02 smithi078 ceph-mon[94114]: pgmap v495: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:04 smithi078 ceph-mon[94114]: pgmap v496: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:06 smithi078 ceph-mon[94114]: pgmap v497: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:08 smithi078 ceph-mon[94114]: pgmap v498: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:02:20.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:10 smithi078 ceph-mon[94114]: pgmap v499: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:02:20.026 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:10 smithi078 ceph-mon[94114]: osdmap e105: 12 total, 12 up, 12 in 2023-03-17T09:02:20.028 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:12 smithi078 ceph-mon[94114]: pgmap v501: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:02:22.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:14 smithi078 ceph-mon[94114]: pgmap v502: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:16 smithi078 ceph-mon[94114]: osdmap e106: 12 total, 12 up, 12 in 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:16 smithi078 ceph-mon[94114]: pgmap v504: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:18 smithi078 ceph-mon[94114]: pgmap v505: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:12 smithi082 ceph-mon[94281]: pgmap v501: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:14 smithi082 ceph-mon[94281]: pgmap v502: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:16 smithi082 ceph-mon[94281]: osdmap e106: 12 total, 12 up, 12 in 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:16 smithi082 ceph-mon[94281]: pgmap v504: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:02:22.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:18 smithi082 ceph-mon[94281]: pgmap v505: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T09:02:22.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:20 smithi078 ceph-mon[94114]: pgmap v506: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 926 B/s wr, 11 op/s 2023-03-17T09:02:22.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:22 smithi078 ceph-mon[94114]: pgmap v507: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:02:23.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:20 smithi082 ceph-mon[94281]: pgmap v506: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 926 B/s wr, 11 op/s 2023-03-17T09:02:23.859 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:22 smithi082 ceph-mon[94281]: pgmap v507: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:02:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 -- 172.21.15.35:0/4056009498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea64104390 msgr2=0x7fea6410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 --2- 172.21.15.35:0/4056009498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea64104390 0x7fea6410bf60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b0d0 tx=0x7fea5c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:02:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 -- 172.21.15.35:0/4056009498 shutdown_connections 2023-03-17T09:02:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 --2- 172.21.15.35:0/4056009498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea64104390 0x7fea6410bf60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 --2- 172.21.15.35:0/4056009498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea640ff350 0x7fea640ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 --2- 172.21.15.35:0/4056009498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea640ffcf0 0x7fea64103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.509+0000 7fea6b305700 1 -- 172.21.15.35:0/4056009498 >> 172.21.15.35:0/4056009498 conn(0x7fea64076330 msgr2=0x7fea64076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.510+0000 7fea6b305700 1 -- 172.21.15.35:0/4056009498 shutdown_connections 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.510+0000 7fea6b305700 1 -- 172.21.15.35:0/4056009498 wait complete. 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.510+0000 7fea6b305700 1 Processor -- start 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.510+0000 7fea6b305700 1 -- start start 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.510+0000 7fea6b305700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea640ff350 0x7fea641971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.510+0000 7fea6b305700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 0x7fea64197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea6b305700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea64104390 0x7fea641a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea6b305700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64198040 con 0x7fea640ffcf0 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea6b305700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea641a2780 con 0x7fea640ff350 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea6b305700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea641a2940 con 0x7fea64104390 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 0x7fea64197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 0x7fea64197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43164/0 (socket says 172.21.15.35:43164) 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 -- 172.21.15.35:0/2782256229 learned_addr learned my addr 172.21.15.35:0/2782256229 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea698a2700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea64104390 0x7fea641a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea690a1700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea640ff350 0x7fea641971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 -- 172.21.15.35:0/2782256229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea64104390 msgr2=0x7fea641a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea64104390 0x7fea641a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 -- 172.21.15.35:0/2782256229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea640ff350 msgr2=0x7fea641971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea640ff350 0x7fea641971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 -- 172.21.15.35:0/2782256229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c009d00 con 0x7fea640ffcf0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea698a2700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea64104390 0x7fea641a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea688a0700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 0x7fea64197700 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fea5400e940 tx=0x7fea5400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea5a7fc700 1 -- 172.21.15.35:0/2782256229 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54009730 con 0x7fea640ffcf0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea5a7fc700 1 -- 172.21.15.35:0/2782256229 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea5400cbd0 con 0x7fea640ffcf0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6410f010 con 0x7fea640ffcf0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea5a7fc700 1 -- 172.21.15.35:0/2782256229 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54018680 con 0x7fea640ffcf0 2023-03-17T09:02:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.511+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6410ee80 con 0x7fea640ffcf0 2023-03-17T09:02:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.514+0000 7fea5a7fc700 1 -- 172.21.15.35:0/2782256229 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fea5400cd40 con 0x7fea640ffcf0 2023-03-17T09:02:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.515+0000 7fea5a7fc700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea5009f6c0 0x7fea500a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.515+0000 7fea690a1700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea5009f6c0 0x7fea500a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.515+0000 7fea5a7fc700 1 -- 172.21.15.35:0/2782256229 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fea54014070 con 0x7fea640ffcf0 2023-03-17T09:02:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.515+0000 7fea690a1700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea5009f6c0 0x7fea500a1b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea60005950 tx=0x7fea600058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 Processor -- start 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 -- start start 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 0x55d0462a1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0461a8010 con 0x55d0462a74f0 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0461fa950 con 0x55d0462a1960 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea77492b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0461f3de0 con 0x55d0462a6be0 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 0x55d0462a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 0x55d0462a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43172/0 (socket says 172.21.15.35:43172) 2023-03-17T09:02:30.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea688a0700 1 -- 172.21.15.35:0/4070405224 learned_addr learned my addr 172.21.15.35:0/4070405224 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:30.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.516+0000 7fea698a2700 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:30.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea690a1700 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:30.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea688a0700 1 -- 172.21.15.35:0/4070405224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 msgr2=0x55d0462a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea688a0700 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea688a0700 1 -- 172.21.15.35:0/4070405224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 msgr2=0x55d0462a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea688a0700 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea688a0700 1 -- 172.21.15.35:0/4070405224 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0460755d0 con 0x55d0462a74f0 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea698a2700 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea688a0700 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 0x55d0462a1420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fea54009230 tx=0x7fea54097d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb848cc708660c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea4f7fe700 1 -- 172.21.15.35:0/4070405224 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54096750 con 0x55d0462a74f0 2023-03-17T09:02:30.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea4f7fe700 1 -- 172.21.15.35:0/4070405224 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea54098610 con 0x55d0462a74f0 2023-03-17T09:02:30.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.517+0000 7fea4f7fe700 1 -- 172.21.15.35:0/4070405224 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540a0310 con 0x55d0462a74f0 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 -- 172.21.15.35:0/4070405224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 msgr2=0x55d0462a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 0x55d0462a1420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fea54009230 tx=0x7fea54097d90 comp rx=0 tx=0).stop 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 -- 172.21.15.35:0/4070405224 shutdown_connections 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 --2- 172.21.15.35:0/4070405224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a74f0 0x55d0462a1420 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 -- 172.21.15.35:0/4070405224 >> 172.21.15.35:0/4070405224 conn(0x55d0460fe6b0 msgr2=0x55d04629ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:32.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 -- 172.21.15.35:0/4070405224 shutdown_connections 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 -- 172.21.15.35:0/4070405224 wait complete. 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 -- start start 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.518+0000 7fea77492b80 1 Processor -- start 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 0x55d0462ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d0462aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0460778c0 con 0x55d0462a1960 2023-03-17T09:02:32.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0462ab4a0 con 0x55d0462a74f0 2023-03-17T09:02:32.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0462b7030 con 0x55d0462a6be0 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea77492b80 10 client.0 _ll_register_callbacks cb 0x55d046099230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 0x55d0462ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 0x55d0462ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43176/0 (socket says 172.21.15.35:43176) 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 -- 172.21.15.35:0/3174089135 learned_addr learned my addr 172.21.15.35:0/3174089135 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea698a2700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d0462aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea688a0700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 -- 172.21.15.35:0/3174089135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 msgr2=0x55d0462aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 -- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 msgr2=0x55d0462aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d0462aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 -- 172.21.15.35:0/3174089135 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6410ee80 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea688a0700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea698a2700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d0462aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea690a1700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 0x55d0462ad450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fea6000fe10 tx=0x7fea60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725db94204e610a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.519+0000 7fea4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea4cff9700 1 -- 172.21.15.35:0/3174089135 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000b910 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea4cff9700 1 -- 172.21.15.35:0/3174089135 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fea6001e620 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0461b6390 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea4cff9700 1 -- 172.21.15.35:0/3174089135 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea60011e70 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 10 client.15762 fetch_fsmap learned FSMap version 29 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d046021d80 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea4cff9700 1 -- 172.21.15.35:0/3174089135 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d0461b6390 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea4cff9700 1 -- 172.21.15.35:0/3174089135 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fea60024020 con 0x55d0462a1960 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 10 client.15762 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:02:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 20 client.15762 populate_metadata read hostname 'smithi035' 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d0462bb1b0 0x55d0462bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 4 client.15762 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.520+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0461c2600 con 0x55d0462bb1b0 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.521+0000 7fea688a0700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d0462bb1b0 0x55d0462bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.521+0000 7fea688a0700 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d0462bb1b0 0x55d0462bd5c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c0f3b48e7bfe9b9 server_cookie=399a3d9094177ba7 in_seq=0 out_seq=0 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.521+0000 7fea4cff9700 10 client.15762 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea4cff9700 1 -- 172.21.15.35:0/3174089135 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d0461c2600 con 0x55d0462bb1b0 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea4cff9700 10 client.15762 handle_command_reply: tid=0 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 client.15762 shutdown 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 msgr2=0x55d0462ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 0x55d0462ad450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fea6000fe10 tx=0x7fea60004750 comp rx=0 tx=0).stop 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 shutdown_connections 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d0462bb1b0 0x55d0462bd5c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d0462aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a1960 0x55d0462ad450 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 --2- 172.21.15.35:0/3174089135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a6be0 0x55d0462aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea4cff9700 0 client.15762 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:33.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 >> 172.21.15.35:0/3174089135 conn(0x55d0460fe6b0 msgr2=0x55d0462a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 shutdown_connections 2023-03-17T09:02:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 1 -- 172.21.15.35:0/3174089135 wait complete. 2023-03-17T09:02:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.522+0000 7fea77492b80 20 client.15762 trim_cache size 0 max 16384 2023-03-17T09:02:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 Processor -- start 2023-03-17T09:02:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 -- start start 2023-03-17T09:02:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:35.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a74f0 0x55d0462a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0462985c0 con 0x55d0462a6be0 2023-03-17T09:02:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0462b8830 con 0x55d0462a1960 2023-03-17T09:02:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea77492b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0462a8c30 con 0x55d0462a74f0 2023-03-17T09:02:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43186/0 (socket says 172.21.15.35:43186) 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea688a0700 1 -- 172.21.15.35:0/1918759952 learned_addr learned my addr 172.21.15.35:0/1918759952 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.537+0000 7fea690a1700 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea688a0700 1 -- 172.21.15.35:0/1918759952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a74f0 msgr2=0x55d0462a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea688a0700 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a74f0 0x55d0462a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea688a0700 1 -- 172.21.15.35:0/1918759952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 msgr2=0x55d0462b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea688a0700 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea688a0700 1 -- 172.21.15.35:0/1918759952 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0461ba130 con 0x55d0462a6be0 2023-03-17T09:02:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea688a0700 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462acff0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fea540c8140 tx=0x7fea54094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885c292d13b8456c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea4ffff700 1 -- 172.21.15.35:0/1918759952 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54098610 con 0x55d0462a6be0 2023-03-17T09:02:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea4ffff700 1 -- 172.21.15.35:0/1918759952 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea54098770 con 0x55d0462a6be0 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea4ffff700 1 -- 172.21.15.35:0/1918759952 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540a0110 con 0x55d0462a6be0 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 -- 172.21.15.35:0/1918759952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 msgr2=0x55d0462acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462acff0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fea540c8140 tx=0x7fea54094040 comp rx=0 tx=0).stop 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 -- 172.21.15.35:0/1918759952 shutdown_connections 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a74f0 0x55d0462a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a1960 0x55d0462b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 --2- 172.21.15.35:0/1918759952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462acff0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.538+0000 7fea77492b80 1 -- 172.21.15.35:0/1918759952 >> 172.21.15.35:0/1918759952 conn(0x55d0460fe6b0 msgr2=0x55d0462a0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.539+0000 7fea77492b80 1 -- 172.21.15.35:0/1918759952 shutdown_connections 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.539+0000 7fea77492b80 1 -- 172.21.15.35:0/1918759952 wait complete. 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.539+0000 7fea77492b80 1 -- start start 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.539+0000 7fea77492b80 1 Processor -- start 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a1960 0x55d0462afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d046308050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d046308590 con 0x55d0462a6be0 2023-03-17T09:02:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d046308700 con 0x55d0462a74f0 2023-03-17T09:02:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0463088c0 con 0x55d0462a1960 2023-03-17T09:02:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 10 client.0 _ll_register_callbacks cb 0x55d046099230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:02:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43192/0 (socket says 172.21.15.35:43192) 2023-03-17T09:02:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 -- 172.21.15.35:0/3176279775 learned_addr learned my addr 172.21.15.35:0/3176279775 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:02:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea690a1700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a1960 0x55d0462afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea698a2700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d046308050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 -- 172.21.15.35:0/3176279775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a1960 msgr2=0x55d0462afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:40.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a1960 0x55d0462afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 -- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 msgr2=0x55d046308050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d046308050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 -- 172.21.15.35:0/3176279775 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0460755d0 con 0x55d0462a6be0 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea688a0700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462b03e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fea54009230 tx=0x7fea54010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e611f143afa90624 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea4cff9700 1 -- 172.21.15.35:0/3176279775 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540988e0 con 0x55d0462a6be0 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea4cff9700 1 -- 172.21.15.35:0/3176279775 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fea54097ab0 con 0x55d0462a6be0 2023-03-17T09:02:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0462711e0 con 0x55d0462a6be0 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea4cff9700 1 -- 172.21.15.35:0/3176279775 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea540b6200 con 0x55d0462a6be0 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.540+0000 7fea77492b80 10 client.15768 fetch_fsmap learned FSMap version 29 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d0460481f0 con 0x55d0462a6be0 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea4cff9700 1 -- 172.21.15.35:0/3176279775 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d0462711e0 con 0x55d0462a6be0 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea4cff9700 1 -- 172.21.15.35:0/3176279775 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fea540974a0 con 0x55d0462a6be0 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 10 client.15768 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:02:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 20 client.15768 populate_metadata read hostname 'smithi035' 2023-03-17T09:02:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d04630fb50 0x55d046311f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:02:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 4 client.15768 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d046077f00 con 0x55d04630fb50 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.541+0000 7fea690a1700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d04630fb50 0x55d046311f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.542+0000 7fea4cff9700 10 client.15768 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.542+0000 7fea690a1700 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d04630fb50 0x55d046311f30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f5d79c346559505 server_cookie=33a4c8ce40646f77 in_seq=0 out_seq=0 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea4cff9700 1 -- 172.21.15.35:0/3176279775 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d046077f00 con 0x55d04630fb50 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea4cff9700 10 client.15768 handle_command_reply: tid=0 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 client.15768 shutdown 2023-03-17T09:02:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 msgr2=0x55d0462b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462b03e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fea54009230 tx=0x7fea54010ae0 comp rx=0 tx=0).stop 2023-03-17T09:02:44.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 shutdown_connections 2023-03-17T09:02:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d04630fb50 0x55d046311f30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d0462a74f0 0x55d046308050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0462a1960 0x55d0462afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 --2- 172.21.15.35:0/3176279775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d0462a6be0 0x55d0462b03e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea4cff9700 0 client.15768 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:02:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.548+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 >> 172.21.15.35:0/3176279775 conn(0x55d0460fe6b0 msgr2=0x55d0462a46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 shutdown_connections 2023-03-17T09:02:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea77492b80 1 -- 172.21.15.35:0/3176279775 wait complete. 2023-03-17T09:02:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea77492b80 20 client.15768 trim_cache size 0 max 16384 2023-03-17T09:02:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:02:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:02:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:02:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:02:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea5009f6c0 msgr2=0x7fea500a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea5009f6c0 0x7fea500a1b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea60005950 tx=0x7fea600058e0 comp rx=0 tx=0).stop 2023-03-17T09:02:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 msgr2=0x7fea64197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:02:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 0x7fea64197700 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fea5400e940 tx=0x7fea5400ed00 comp rx=0 tx=0).stop 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 shutdown_connections 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea5009f6c0 0x7fea500a1b70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea64104390 0x7fea641a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea640ff350 0x7fea641971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 --2- 172.21.15.35:0/2782256229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea640ffcf0 0x7fea64197700 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 >> 172.21.15.35:0/2782256229 conn(0x7fea64076330 msgr2=0x7fea640fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 shutdown_connections 2023-03-17T09:02:47.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:18.549+0000 7fea6b305700 1 -- 172.21.15.35:0/2782256229 wait complete. 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:20 smithi035 ceph-mon[92535]: pgmap v346: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:22 smithi035 ceph-mon[92535]: pgmap v347: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:24 smithi035 ceph-mon[92535]: pgmap v348: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:26 smithi035 ceph-mon[92535]: pgmap v349: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 510 B/s wr, 10 op/s 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:28 smithi035 ceph-mon[92535]: pgmap v350: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:30 smithi035 ceph-mon[92535]: pgmap v351: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:47.566 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:24 smithi078 ceph-mon[94114]: pgmap v508: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:02:48.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:26 smithi078 ceph-mon[94114]: pgmap v509: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:02:48.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:28 smithi078 ceph-mon[94114]: pgmap v510: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:02:48.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:30 smithi078 ceph-mon[94114]: pgmap v511: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:50.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:32 smithi078 ceph-mon[94114]: pgmap v512: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:50.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:34 smithi078 ceph-mon[94114]: pgmap v513: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:02:50.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:36 smithi078 ceph-mon[94114]: pgmap v514: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:50.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:38 smithi078 ceph-mon[94114]: pgmap v515: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T09:02:50.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:40 smithi078 ceph-mon[94114]: pgmap v516: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:50.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:42 smithi078 ceph-mon[94114]: pgmap v517: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:44 smithi078 ceph-mon[94114]: pgmap v518: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:46 smithi078 ceph-mon[94114]: pgmap v519: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:24 smithi082 ceph-mon[94281]: pgmap v508: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:02:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:26 smithi082 ceph-mon[94281]: pgmap v509: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:28 smithi082 ceph-mon[94281]: pgmap v510: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:30 smithi082 ceph-mon[94281]: pgmap v511: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:32 smithi082 ceph-mon[94281]: pgmap v512: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:34 smithi082 ceph-mon[94281]: pgmap v513: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:36 smithi082 ceph-mon[94281]: pgmap v514: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:38 smithi082 ceph-mon[94281]: pgmap v515: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:40 smithi082 ceph-mon[94281]: pgmap v516: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:02:50.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:42 smithi082 ceph-mon[94281]: pgmap v517: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:50.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:02:50.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:02:50.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:02:50.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:44 smithi082 ceph-mon[94281]: pgmap v518: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:50.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:46 smithi082 ceph-mon[94281]: pgmap v519: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:50.012 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:48 smithi082 ceph-mon[94281]: pgmap v520: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:52.029 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:48 smithi078 ceph-mon[94114]: pgmap v520: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:52.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:50 smithi082 ceph-mon[94281]: pgmap v521: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:02:53.521 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:50 smithi078 ceph-mon[94114]: pgmap v521: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:02:53.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:52 smithi082 ceph-mon[94281]: pgmap v522: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:02:57.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:52 smithi078 ceph-mon[94114]: pgmap v522: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:02:57.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:54 smithi082 ceph-mon[94281]: pgmap v523: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:59.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:56 smithi082 ceph-mon[94281]: pgmap v524: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:59.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:54 smithi078 ceph-mon[94114]: pgmap v523: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:02:59.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:56 smithi078 ceph-mon[94114]: pgmap v524: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:02:59.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:02:58 smithi082 ceph-mon[94281]: pgmap v525: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:00.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:02:58 smithi078 ceph-mon[94114]: pgmap v525: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:00.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:00 smithi082 ceph-mon[94281]: pgmap v526: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:01.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:00 smithi078 ceph-mon[94114]: pgmap v526: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 -- 172.21.15.35:0/3994122920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc1054f0 msgr2=0x7fe1fc10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:04.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 --2- 172.21.15.35:0/3994122920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc1054f0 0x7fe1fc10d100 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400b0d0 tx=0x7fe1f400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:03:04.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 -- 172.21.15.35:0/3994122920 shutdown_connections 2023-03-17T09:03:04.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 --2- 172.21.15.35:0/3994122920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc1054f0 0x7fe1fc10d100 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 --2- 172.21.15.35:0/3994122920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1fc100be0 0x7fe1fc100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 --2- 172.21.15.35:0/3994122920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1fc101580 0x7fe1fc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 -- 172.21.15.35:0/3994122920 >> 172.21.15.35:0/3994122920 conn(0x7fe1fc0774e0 msgr2=0x7fe1fc0778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 -- 172.21.15.35:0/3994122920 shutdown_connections 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.662+0000 7fe202a90700 1 -- 172.21.15.35:0/3994122920 wait complete. 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.663+0000 7fe202a90700 1 Processor -- start 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.663+0000 7fe202a90700 1 -- start start 2023-03-17T09:03:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe202a90700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 0x7fe1fc196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe202a90700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1fc101580 0x7fe1fc1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe202a90700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1fc1054f0 0x7fe1fc19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe202a90700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc19b350 con 0x7fe1fc100be0 2023-03-17T09:03:05.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe202a90700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc19b4c0 con 0x7fe1fc1054f0 2023-03-17T09:03:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe202a90700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc19b680 con 0x7fe1fc101580 2023-03-17T09:03:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 0x7fe1fc196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 0x7fe1fc196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43218/0 (socket says 172.21.15.35:43218) 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 -- 172.21.15.35:0/3406662744 learned_addr learned my addr 172.21.15.35:0/3406662744 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1fc101580 0x7fe1fc1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20102d700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1fc1054f0 0x7fe1fc19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 -- 172.21.15.35:0/3406662744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1fc101580 msgr2=0x7fe1fc1968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1fc101580 0x7fe1fc1968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 -- 172.21.15.35:0/3406662744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1fc1054f0 msgr2=0x7fe1fc19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1fc1054f0 0x7fe1fc19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 -- 172.21.15.35:0/3406662744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4009d00 con 0x7fe1fc100be0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.664+0000 7fe20082c700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 0x7fe1fc196370 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c920 tx=0x7fe1f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.665+0000 7fe1f9ffb700 1 -- 172.21.15.35:0/3406662744 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0007b00 con 0x7fe1fc100be0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.665+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc1101c0 con 0x7fe1fc100be0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.665+0000 7fe1f9ffb700 1 -- 172.21.15.35:0/3406662744 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f000ce70 con 0x7fe1fc100be0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.665+0000 7fe1f9ffb700 1 -- 172.21.15.35:0/3406662744 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f00053e0 con 0x7fe1fc100be0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.665+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc110030 con 0x7fe1fc100be0 2023-03-17T09:03:06.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.668+0000 7fe1f9ffb700 1 -- 172.21.15.35:0/3406662744 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe1f0005580 con 0x7fe1fc100be0 2023-03-17T09:03:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.668+0000 7fe1f9ffb700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe1ec09f640 0x7fe1ec0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:06.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.668+0000 7fe20ec1db80 1 Processor -- start 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.668+0000 7fe1f9ffb700 1 -- 172.21.15.35:0/3406662744 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe1f00ca220 con 0x7fe1fc100be0 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.668+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe1ec09f640 0x7fe1ec0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.668+0000 7fe20ec1db80 1 -- start start 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a9d040 0x55d309a9d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309a97ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309aa3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d30999a010 con 0x55d309a981e0 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3099ec950 con 0x55d309a97830 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3099e5de0 con 0x55d309a9d040 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe1ec09f640 0x7fe1ec0a1af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc197980 tx=0x7fe1e80073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20082c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a9d040 0x55d309a9d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309aa3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309aa3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43230/0 (socket says 172.21.15.35:43230) 2023-03-17T09:03:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309a97ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20082c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a9d040 0x55d309a9d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:34992/0 (socket says 172.21.15.35:34992) 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 -- 172.21.15.35:0/1279865602 learned_addr learned my addr 172.21.15.35:0/1279865602 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 -- 172.21.15.35:0/1279865602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a9d040 msgr2=0x55d309a9d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a9d040 0x55d309a9d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 -- 172.21.15.35:0/1279865602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 msgr2=0x55d309a97ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309a97ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 -- 172.21.15.35:0/1279865602 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3098675d0 con 0x55d309a981e0 2023-03-17T09:03:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.669+0000 7fe20102d700 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309aa3dd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400cda0 tx=0x7fe1f400cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0265805ca5ee4e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe1e6ffd700 1 -- 172.21.15.35:0/1279865602 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400e050 con 0x55d309a981e0 2023-03-17T09:03:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe1e6ffd700 1 -- 172.21.15.35:0/1279865602 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f40092d0 con 0x55d309a981e0 2023-03-17T09:03:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe1e6ffd700 1 -- 172.21.15.35:0/1279865602 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4005280 con 0x55d309a981e0 2023-03-17T09:03:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1279865602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 msgr2=0x55d309aa3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309aa3dd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400cda0 tx=0x7fe1f400cdd0 comp rx=0 tx=0).stop 2023-03-17T09:03:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1279865602 shutdown_connections 2023-03-17T09:03:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309aa3dd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a9d040 0x55d309a9d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1279865602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309a97ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1279865602 >> 172.21.15.35:0/1279865602 conn(0x55d3098f06b0 msgr2=0x55d309a8da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.670+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1279865602 shutdown_connections 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1279865602 wait complete. 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 -- start start 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 Processor -- start 2023-03-17T09:03:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309aa1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3098698c0 con 0x55d309a9d040 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309aa1cb0 con 0x55d309a97830 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309aad480 con 0x55d309a981e0 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20ec1db80 10 client.0 _ll_register_callbacks cb 0x55d30988b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.671+0000 7fe20102d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309aa1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309aa1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43236/0 (socket says 172.21.15.35:43236) 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 -- 172.21.15.35:0/68543886 learned_addr learned my addr 172.21.15.35:0/68543886 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20082c700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 -- 172.21.15.35:0/68543886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 msgr2=0x55d309aa0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 -- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 msgr2=0x55d309aa3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 -- 172.21.15.35:0/68543886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc10d940 con 0x55d309a9d040 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20102d700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309aa1540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40060d0 tx=0x7fe1f4004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de9eb6739161de2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe1dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe1dbfff700 1 -- 172.21.15.35:0/68543886 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4026860 con 0x55d309a9d040 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3099a8390 con 0x55d309a9d040 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.672+0000 7fe1dbfff700 1 -- 172.21.15.35:0/68543886 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe1f40269c0 con 0x55d309a9d040 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe1dbfff700 1 -- 172.21.15.35:0/68543886 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1f400e020 con 0x55d309a9d040 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 10 client.15780 fetch_fsmap learned FSMap version 29 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d309813d80 con 0x55d309a9d040 2023-03-17T09:03:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe1dbfff700 1 -- 172.21.15.35:0/68543886 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d3099a8390 con 0x55d309a9d040 2023-03-17T09:03:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe1dbfff700 1 -- 172.21.15.35:0/68543886 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe1f400b100 con 0x55d309a9d040 2023-03-17T09:03:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 10 client.15780 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:03:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:03:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 20 client.15780 populate_metadata read hostname 'smithi035' 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309ab1060 0x55d309ab3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 4 client.15780 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3099b4600 con 0x55d309ab1060 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.673+0000 7fe20082c700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309ab1060 0x55d309ab3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe1dbfff700 10 client.15780 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20082c700 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309ab1060 0x55d309ab3440 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214e63643d858c5e server_cookie=40f3d3d10be076a3 in_seq=0 out_seq=0 2023-03-17T09:03:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe1dbfff700 1 -- 172.21.15.35:0/68543886 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d3099b4600 con 0x55d309ab1060 2023-03-17T09:03:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe1dbfff700 10 client.15780 handle_command_reply: tid=0 2023-03-17T09:03:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 client.15780 shutdown 2023-03-17T09:03:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 msgr2=0x55d309aa1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309aa1540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40060d0 tx=0x7fe1f4004d00 comp rx=0 tx=0).stop 2023-03-17T09:03:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 shutdown_connections 2023-03-17T09:03:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309ab1060 0x55d309ab3440 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309aa1540 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/68543886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 >> 172.21.15.35:0/68543886 conn(0x55d3098f06b0 msgr2=0x55d309a92410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.674+0000 7fe1dbfff700 0 client.15780 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:03:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.675+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 shutdown_connections 2023-03-17T09:03:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.675+0000 7fe20ec1db80 1 -- 172.21.15.35:0/68543886 wait complete. 2023-03-17T09:03:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.675+0000 7fe20ec1db80 20 client.15780 trim_cache size 0 max 16384 2023-03-17T09:03:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 Processor -- start 2023-03-17T09:03:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 -- start start 2023-03-17T09:03:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309a9c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309a890f0 con 0x55d309a9d040 2023-03-17T09:03:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309aa1ec0 con 0x55d309a97830 2023-03-17T09:03:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.705+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309a8edd0 con 0x55d309a981e0 2023-03-17T09:03:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309a9c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309a9c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43244/0 (socket says 172.21.15.35:43244) 2023-03-17T09:03:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 -- 172.21.15.35:0/1094092262 learned_addr learned my addr 172.21.15.35:0/1094092262 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20082c700 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 -- 172.21.15.35:0/1094092262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 msgr2=0x55d309aa3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:19.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 -- 172.21.15.35:0/1094092262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 msgr2=0x55d309aa83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:19.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 -- 172.21.15.35:0/1094092262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3099ac130 con 0x55d309a9d040 2023-03-17T09:03:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe20102d700 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309a9c210 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4026ce0 tx=0x7fe1f400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daca6133ce4125f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe1e77fe700 1 -- 172.21.15.35:0/1094092262 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400e040 con 0x55d309a9d040 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe1e77fe700 1 -- 172.21.15.35:0/1094092262 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f400b2c0 con 0x55d309a9d040 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.706+0000 7fe1e77fe700 1 -- 172.21.15.35:0/1094092262 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4026a40 con 0x55d309a9d040 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1094092262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 msgr2=0x55d309a9c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309a9c210 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4026ce0 tx=0x7fe1f400b950 comp rx=0 tx=0).stop 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1094092262 shutdown_connections 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a9d040 0x55d309a9c210 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a97830 0x55d309aa83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/1094092262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a981e0 0x55d309aa3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1094092262 >> 172.21.15.35:0/1094092262 conn(0x55d3098f06b0 msgr2=0x55d309aacb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1094092262 shutdown_connections 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 -- 172.21.15.35:0/1094092262 wait complete. 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 -- start start 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.707+0000 7fe20ec1db80 1 Processor -- start 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a97830 0x55d309afd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309afdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a9d040 0x55d309aa7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309aa7e30 con 0x55d309a981e0 2023-03-17T09:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309aa7fa0 con 0x55d309a9d040 2023-03-17T09:03:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d309aa8160 con 0x55d309a97830 2023-03-17T09:03:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20ec1db80 10 client.0 _ll_register_callbacks cb 0x55d30988b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:03:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309afdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309afdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43248/0 (socket says 172.21.15.35:43248) 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 -- 172.21.15.35:0/2827663705 learned_addr learned my addr 172.21.15.35:0/2827663705 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20082c700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a97830 0x55d309afd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20102d700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a9d040 0x55d309aa7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 -- 172.21.15.35:0/2827663705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a97830 msgr2=0x55d309afd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a97830 0x55d309afd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 -- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a9d040 msgr2=0x55d309aa7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a9d040 0x55d309aa7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe1fbfff700 1 -- 172.21.15.35:0/2827663705 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d309813d80 con 0x55d309a981e0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.708+0000 7fe20082c700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a97830 0x55d309afd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1fbfff700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309afdd50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55d309a8ff90 tx=0x7fe1e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964f23a572206410 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1dbfff700 1 -- 172.21.15.35:0/2827663705 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8025070 con 0x55d309a981e0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1dbfff700 1 -- 172.21.15.35:0/2827663705 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe1e8017070 con 0x55d309a981e0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d309a631e0 con 0x55d309a981e0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1dbfff700 1 -- 172.21.15.35:0/2827663705 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e80202e0 con 0x55d309a981e0 2023-03-17T09:03:24.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 10 client.15786 fetch_fsmap learned FSMap version 29 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d30983a1f0 con 0x55d309a981e0 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1dbfff700 1 -- 172.21.15.35:0/2827663705 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d309a631e0 con 0x55d309a981e0 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe1dbfff700 1 -- 172.21.15.35:0/2827663705 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe1e802a420 con 0x55d309a981e0 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 10 client.15786 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 20 client.15786 populate_metadata read hostname 'smithi035' 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309b05760 0x55d309b07b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 4 client.15786 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.709+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d309869f00 con 0x55d309b05760 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.710+0000 7fe20082c700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309b05760 0x55d309b07b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.710+0000 7fe1dbfff700 10 client.15786 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.710+0000 7fe20082c700 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309b05760 0x55d309b07b70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c339974d67157bff server_cookie=dde96501142a6b0d in_seq=0 out_seq=0 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe1dbfff700 1 -- 172.21.15.35:0/2827663705 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d309869f00 con 0x55d309b05760 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe1dbfff700 10 client.15786 handle_command_reply: tid=0 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 client.15786 shutdown 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 msgr2=0x55d309afdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:24.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309afdd50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55d309a8ff90 tx=0x7fe1e80047c0 comp rx=0 tx=0).stop 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 shutdown_connections 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d309b05760 0x55d309b07b70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d309a9d040 0x55d309aa7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d309a97830 0x55d309afd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe1dbfff700 0 client.15786 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 --2- 172.21.15.35:0/2827663705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d309a981e0 0x55d309afdd50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 >> 172.21.15.35:0/2827663705 conn(0x55d3098f06b0 msgr2=0x55d309a9b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 shutdown_connections 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 1 -- 172.21.15.35:0/2827663705 wait complete. 2023-03-17T09:03:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.714+0000 7fe20ec1db80 20 client.15786 trim_cache size 0 max 16384 2023-03-17T09:03:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:03:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:03:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:03:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:03:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe1ec09f640 msgr2=0x7fe1ec0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe1ec09f640 0x7fe1ec0a1af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc197980 tx=0x7fe1e80073d0 comp rx=0 tx=0).stop 2023-03-17T09:03:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 msgr2=0x7fe1fc196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 0x7fe1fc196370 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c920 tx=0x7fe1f000cc30 comp rx=0 tx=0).stop 2023-03-17T09:03:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 shutdown_connections 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe1ec09f640 0x7fe1ec0a1af0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1fc1054f0 0x7fe1fc19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe1fc100be0 0x7fe1fc196370 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 --2- 172.21.15.35:0/3406662744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1fc101580 0x7fe1fc1968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 >> 172.21.15.35:0/3406662744 conn(0x7fe1fc0774e0 msgr2=0x7fe1fc0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 shutdown_connections 2023-03-17T09:03:27.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:31.715+0000 7fe202a90700 1 -- 172.21.15.35:0/3406662744 wait complete. 2023-03-17T09:03:27.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:32 smithi035 ceph-mon[92535]: pgmap v352: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:34 smithi035 ceph-mon[92535]: pgmap v353: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:36 smithi035 ceph-mon[92535]: pgmap v354: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:38 smithi035 ceph-mon[92535]: pgmap v355: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:40 smithi035 ceph-mon[92535]: pgmap v356: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:42 smithi035 ceph-mon[92535]: pgmap v357: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:28.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:44 smithi035 ceph-mon[92535]: pgmap v358: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:30.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:02 smithi078 ceph-mon[94114]: pgmap v527: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:30.552 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:03:31.712 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: in thread 7f550c5a5700 thread_name:md_log_replay 2023-03-17T09:03:31.712 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:03:31.712 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f551d14fcf0] 2023-03-17T09:03:31.712 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5638c405d71f] 2023-03-17T09:03:31.712 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5638c405f953] 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 4: (MDLog::_replay_thread()+0x66d) [0x5638c40cb07d] 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5638c3d7ed91] 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f551d1451ca] 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 7: clone() 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:03.447+0000 7f550c5a5700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: in thread 7f550c5a5700 thread_name:md_log_replay 2023-03-17T09:03:31.713 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:33.350 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:03:33.350 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f551d14fcf0] 2023-03-17T09:03:33.350 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5638c405d71f] 2023-03-17T09:03:33.350 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5638c405f953] 2023-03-17T09:03:33.350 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 4: (MDLog::_replay_thread()+0x66d) [0x5638c40cb07d] 2023-03-17T09:03:33.350 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5638c3d7ed91] 2023-03-17T09:03:33.351 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f551d1451ca] 2023-03-17T09:03:36.227 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 7: clone() 2023-03-17T09:03:36.227 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 0> 2023-03-17T09:03:03.447+0000 7f550c5a5700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: in thread 7f550c5a5700 thread_name:md_log_replay 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f551d14fcf0] 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5638c405d71f] 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5638c405f953] 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 4: (MDLog::_replay_thread()+0x66d) [0x5638c40cb07d] 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5638c3d7ed91] 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f551d1451ca] 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 7: clone() 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:03:36.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:37.358 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 0> 2023-03-17T09:03:03.447+0000 7f550c5a5700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:03:37.358 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: in thread 7f550c5a5700 thread_name:md_log_replay 2023-03-17T09:03:37.358 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:37.358 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:03:37.358 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f551d14fcf0] 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5638c405d71f] 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5638c405f953] 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 4: (MDLog::_replay_thread()+0x66d) [0x5638c40cb07d] 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5638c3d7ed91] 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f551d1451ca] 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 7: clone() 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[119990]: 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:03:37.359 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:04 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:03:37.361 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:04 smithi078 ceph-mon[94114]: pgmap v528: 97 pgs: 97 active+clean; 1.4 MiB data, 119 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:05 smithi078 ceph-mon[94114]: osdmap e107: 12 total, 12 up, 12 in 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:06 smithi078 ceph-mon[94114]: pgmap v530: 97 pgs: 97 active+clean; 1.4 MiB data, 119 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:08 smithi078 ceph-mon[94114]: pgmap v531: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:10 smithi078 ceph-mon[94114]: pgmap v532: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:10 smithi078 ceph-mon[94114]: osdmap e108: 12 total, 12 up, 12 in 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:12 smithi078 ceph-mon[94114]: pgmap v534: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:03:40.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:14 smithi078 ceph-mon[94114]: pgmap v535: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 458 B/s wr, 10 op/s 2023-03-17T09:03:40.114 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:03:40.115 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Scheduled restart job, restart counter is at 1. 2023-03-17T09:03:40.115 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 systemd[1]: Stopped Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:03:40.115 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 systemd[1]: Starting Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T09:03:41.717 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 podman[133577]: 2023-03-17T09:03:41.717 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 bash[133577]: 426bde2f7f0bb5bedfe01bb4ce9cb90a1e7e0cdc024c0c8ea6e2f1040984f989 2023-03-17T09:03:41.717 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 ceph-mds[133617]: -- 172.21.15.78:0/2960267781 <== mon.2 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562f797aab60 con 0x562f79780c00 2023-03-17T09:03:41.717 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: starting mds.e at 2023-03-17T09:03:41.718 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:03:14 smithi078 systemd[1]: Started Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:03:41.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:02 smithi082 ceph-mon[94281]: pgmap v527: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:41.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:04 smithi082 ceph-mon[94281]: pgmap v528: 97 pgs: 97 active+clean; 1.4 MiB data, 119 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:05 smithi082 ceph-mon[94281]: osdmap e107: 12 total, 12 up, 12 in 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:06 smithi082 ceph-mon[94281]: pgmap v530: 97 pgs: 97 active+clean; 1.4 MiB data, 119 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:08 smithi082 ceph-mon[94281]: pgmap v531: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:10 smithi082 ceph-mon[94281]: pgmap v532: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:10 smithi082 ceph-mon[94281]: osdmap e108: 12 total, 12 up, 12 in 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:12 smithi082 ceph-mon[94281]: pgmap v534: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:14 smithi082 ceph-mon[94281]: pgmap v535: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 458 B/s wr, 10 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:15 smithi082 ceph-mon[94281]: daemon mds.e restarted 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:15 smithi082 ceph-mon[94281]: osdmap e109: 12 total, 12 up, 12 in 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6834/240520807,v1:172.21.15.78:6835/240520807] up:boot 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:16 smithi082 ceph-mon[94281]: pgmap v537: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:18 smithi082 ceph-mon[94281]: pgmap v538: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:20 smithi082 ceph-mon[94281]: pgmap v539: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 566 B/s wr, 10 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:22 smithi082 ceph-mon[94281]: pgmap v540: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:03:41.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:24 smithi082 ceph-mon[94281]: pgmap v541: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:26 smithi082 ceph-mon[94281]: pgmap v542: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 392 B/s wr, 10 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:28 smithi082 ceph-mon[94281]: pgmap v543: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:30 smithi082 ceph-mon[94281]: pgmap v544: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:32 smithi082 ceph-mon[94281]: pgmap v545: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:34 smithi082 ceph-mon[94281]: pgmap v546: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:36 smithi082 ceph-mon[94281]: pgmap v547: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:38 smithi082 ceph-mon[94281]: pgmap v548: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:41.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:40 smithi082 ceph-mon[94281]: pgmap v549: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:41.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:15 smithi078 ceph-mon[94114]: daemon mds.e restarted 2023-03-17T09:03:41.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:15 smithi078 ceph-mon[94114]: osdmap e109: 12 total, 12 up, 12 in 2023-03-17T09:03:41.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6834/240520807,v1:172.21.15.78:6835/240520807] up:boot 2023-03-17T09:03:41.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:16 smithi078 ceph-mon[94114]: pgmap v537: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:18 smithi078 ceph-mon[94114]: pgmap v538: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:20 smithi078 ceph-mon[94114]: pgmap v539: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 566 B/s wr, 10 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:22 smithi078 ceph-mon[94114]: pgmap v540: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:24 smithi078 ceph-mon[94114]: pgmap v541: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:26 smithi078 ceph-mon[94114]: pgmap v542: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 392 B/s wr, 10 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:28 smithi078 ceph-mon[94114]: pgmap v543: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:03:41.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:30 smithi078 ceph-mon[94114]: pgmap v544: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:03:41.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:32 smithi078 ceph-mon[94114]: pgmap v545: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:03:41.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:34 smithi078 ceph-mon[94114]: pgmap v546: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:41.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:36 smithi078 ceph-mon[94114]: pgmap v547: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:41.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:38 smithi078 ceph-mon[94114]: pgmap v548: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:43.152 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:40 smithi078 ceph-mon[94114]: pgmap v549: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:43.154 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:42 smithi078 ceph-mon[94114]: pgmap v550: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:44.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:03:44.402 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:42 smithi082 ceph-mon[94281]: pgmap v550: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:03:44.402 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:03:44.404 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:03:45.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:03:45.610 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:03:45.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:03:45.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:03:45.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:03:46.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:44 smithi078 ceph-mon[94114]: pgmap v551: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:46.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:44 smithi082 ceph-mon[94281]: pgmap v551: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:47.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:46 smithi078 ceph-mon[94114]: pgmap v552: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:03:49.318 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:46 smithi082 ceph-mon[94281]: pgmap v552: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:03:49.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:48 smithi078 ceph-mon[94114]: pgmap v553: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:51.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:48 smithi082 ceph-mon[94281]: pgmap v553: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:03:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 -- 172.21.15.35:0/3834661101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 msgr2=0x7fbba40fecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/3834661101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba40fecc0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009990 tx=0x7fbba0009ca0 comp rx=0 tx=0).stop 2023-03-17T09:03:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 -- 172.21.15.35:0/3834661101 shutdown_connections 2023-03-17T09:03:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/3834661101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba40ff200 0x7fbba410b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/3834661101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba4104860 0x7fbba4104c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/3834661101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba40fecc0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 -- 172.21.15.35:0/3834661101 >> 172.21.15.35:0/3834661101 conn(0x7fbba40757a0 msgr2=0x7fbba4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:03:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 -- 172.21.15.35:0/3834661101 shutdown_connections 2023-03-17T09:03:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.837+0000 7fbbab7a8700 1 -- 172.21.15.35:0/3834661101 wait complete. 2023-03-17T09:03:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 Processor -- start 2023-03-17T09:03:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 -- start start 2023-03-17T09:03:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba41961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba40ff200 0x7fbba4196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba4104860 0x7fbba419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:55.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba419b1c0 con 0x7fbba40fe850 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba419b330 con 0x7fbba4104860 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbbab7a8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba419b4f0 con 0x7fbba40ff200 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbba9544700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba41961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbba9544700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba41961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43260/0 (socket says 172.21.15.35:43260) 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbba9544700 1 -- 172.21.15.35:0/898093363 learned_addr learned my addr 172.21.15.35:0/898093363 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbba8d43700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba40ff200 0x7fbba4196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:55.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.838+0000 7fbba9d45700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba4104860 0x7fbba419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9544700 1 -- 172.21.15.35:0/898093363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba40ff200 msgr2=0x7fbba4196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9544700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba40ff200 0x7fbba4196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9544700 1 -- 172.21.15.35:0/898093363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba4104860 msgr2=0x7fbba419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:03:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9544700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba4104860 0x7fbba419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9544700 1 -- 172.21.15.35:0/898093363 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00095f0 con 0x7fbba40fe850 2023-03-17T09:03:55.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9d45700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba4104860 0x7fbba419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:03:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbba9544700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba41961e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800e970 tx=0x7fbb9800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbb967fc700 1 -- 172.21.15.35:0/898093363 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98009790 con 0x7fbba40fe850 2023-03-17T09:03:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbb967fc700 1 -- 172.21.15.35:0/898093363 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb9800eec0 con 0x7fbba40fe850 2023-03-17T09:03:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba410df10 con 0x7fbba40fe850 2023-03-17T09:03:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbb967fc700 1 -- 172.21.15.35:0/898093363 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98003c10 con 0x7fbba40fe850 2023-03-17T09:03:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.839+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba410dd80 con 0x7fbba40fe850 2023-03-17T09:03:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.841+0000 7fbb967fc700 1 -- 172.21.15.35:0/898093363 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbb98003db0 con 0x7fbba40fe850 2023-03-17T09:03:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.842+0000 7fbb967fc700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb9009f6c0 0x7fbb900a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.842+0000 7fbb967fc700 1 -- 172.21.15.35:0/898093363 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbb98014070 con 0x7fbba40fe850 2023-03-17T09:03:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.842+0000 7fbba8d43700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb9009f6c0 0x7fbb900a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbba8d43700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb9009f6c0 0x7fbb900a1b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbba00059d0 tx=0x7fbba0005960 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 Processor -- start 2023-03-17T09:03:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 -- start start 2023-03-17T09:03:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166859be0 0x562166859fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 0x562166854420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166854d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:03:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216675b010 con 0x56216685a4f0 2023-03-17T09:03:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621667ad950 con 0x562166859be0 2023-03-17T09:03:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.843+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621667a6de0 con 0x562166854960 2023-03-17T09:03:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 0x562166854420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:59.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 0x562166854420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43270/0 (socket says 172.21.15.35:43270) 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 -- 172.21.15.35:0/4264609259 learned_addr learned my addr 172.21.15.35:0/4264609259 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba9544700 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166859be0 0x562166859fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba9d45700 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166854d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 -- 172.21.15.35:0/4264609259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 msgr2=0x562166854d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166854d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 -- 172.21.15.35:0/4264609259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166859be0 msgr2=0x562166859fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166859be0 0x562166859fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 -- 172.21.15.35:0/4264609259 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621666285d0 con 0x56216685a4f0 2023-03-17T09:03:59.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba9544700 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166859be0 0x562166859fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:03:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbba8d43700 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 0x562166854420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbba00041d0 tx=0x7fbba0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b22a8dd346e966d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:03:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbb8f7fe700 1 -- 172.21.15.35:0/4264609259 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0003d10 con 0x56216685a4f0 2023-03-17T09:03:59.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbb8f7fe700 1 -- 172.21.15.35:0/4264609259 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbba001e040 con 0x56216685a4f0 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.844+0000 7fbb8f7fe700 1 -- 172.21.15.35:0/4264609259 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00049a0 con 0x56216685a4f0 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 -- 172.21.15.35:0/4264609259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 msgr2=0x562166854420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 0x562166854420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbba00041d0 tx=0x7fbba0020000 comp rx=0 tx=0).stop 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 -- 172.21.15.35:0/4264609259 shutdown_connections 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166854d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166859be0 0x562166859fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/4264609259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56216685a4f0 0x562166854420 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 -- 172.21.15.35:0/4264609259 >> 172.21.15.35:0/4264609259 conn(0x5621666b16b0 msgr2=0x56216684ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 -- 172.21.15.35:0/4264609259 shutdown_connections 2023-03-17T09:04:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 -- 172.21.15.35:0/4264609259 wait complete. 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.845+0000 7fbbb7935b80 1 -- start start 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 Processor -- start 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166860460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x56216685dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216662a8c0 con 0x562166859be0 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216685e3f0 con 0x562166854960 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216685e5b0 con 0x56216685a4f0 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbbb7935b80 10 client.0 _ll_register_callbacks cb 0x56216664c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43276/0 (socket says 172.21.15.35:43276) 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbba8d43700 1 -- 172.21.15.35:0/2395202425 learned_addr learned my addr 172.21.15.35:0/2395202425 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbba9544700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166860460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.846+0000 7fbba9d45700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x56216685dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbba8d43700 1 -- 172.21.15.35:0/2395202425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 msgr2=0x56216685dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbba8d43700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x56216685dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbba8d43700 1 -- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 msgr2=0x562166860460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbba8d43700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166860460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbba8d43700 1 -- 172.21.15.35:0/2395202425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba410bf90 con 0x562166859be0 2023-03-17T09:04:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbba8d43700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685d6e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbba0004540 tx=0x7fbba0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d86ddb74c72c68c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbb8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:04:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbb8cff9700 1 -- 172.21.15.35:0/2395202425 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba000b710 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbb8cff9700 1 -- 172.21.15.35:0/2395202425 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbba000b870 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562166769390 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbb8cff9700 1 -- 172.21.15.35:0/2395202425 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbba000ba30 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbbb7935b80 10 client.15798 fetch_fsmap learned FSMap version 29 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5621665d4d80 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.847+0000 7fbb8cff9700 1 -- 172.21.15.35:0/2395202425 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562166769390 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbb8cff9700 1 -- 172.21.15.35:0/2395202425 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbba0038ba0 con 0x562166859be0 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbbb7935b80 10 client.15798 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbbb7935b80 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbbb7935b80 20 client.15798 populate_metadata read hostname 'smithi035' 2023-03-17T09:04:05.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56216686db20 0x56216686ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbbb7935b80 4 client.15798 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562166775600 con 0x56216686db20 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbba9544700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56216686db20 0x56216686ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbb8cff9700 10 client.15798 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.848+0000 7fbba9544700 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56216686db20 0x56216686ff00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd50b9724864dbc server_cookie=3a09fb9f62a61970 in_seq=0 out_seq=0 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbb8cff9700 1 -- 172.21.15.35:0/2395202425 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562166775600 con 0x56216686db20 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbb8cff9700 10 client.15798 handle_command_reply: tid=0 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 client.15798 shutdown 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 msgr2=0x56216685d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685d6e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbba0004540 tx=0x7fbba0003d40 comp rx=0 tx=0).stop 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 shutdown_connections 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56216686db20 0x56216686ff00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x56216685dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166860460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/2395202425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685d6e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:05.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbb8cff9700 0 client.15798 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.849+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 >> 172.21.15.35:0/2395202425 conn(0x5621666b16b0 msgr2=0x562166853410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.850+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 shutdown_connections 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.850+0000 7fbbb7935b80 1 -- 172.21.15.35:0/2395202425 wait complete. 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.850+0000 7fbbb7935b80 20 client.15798 trim_cache size 0 max 16384 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 Processor -- start 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 -- start start 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166864f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56216685a4f0 0x56216685cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216684fe00 con 0x562166859be0 2023-03-17T09:04:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562166859800 con 0x56216685a4f0 2023-03-17T09:04:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56216685bc90 con 0x562166854960 2023-03-17T09:04:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43284/0 (socket says 172.21.15.35:43284) 2023-03-17T09:04:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 -- 172.21.15.35:0/3715941451 learned_addr learned my addr 172.21.15.35:0/3715941451 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba9544700 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166864f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba9d45700 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56216685a4f0 0x56216685cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 -- 172.21.15.35:0/3715941451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 msgr2=0x562166864f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166864f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 -- 172.21.15.35:0/3715941451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56216685a4f0 msgr2=0x56216685cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56216685a4f0 0x56216685cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 -- 172.21.15.35:0/3715941451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56216676d130 con 0x562166859be0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.865+0000 7fbba8d43700 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685ff90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbba0004570 tx=0x7fbba00092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1005d6b09e8cb29b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbb8ffff700 1 -- 172.21.15.35:0/3715941451 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0004a50 con 0x562166859be0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbb8ffff700 1 -- 172.21.15.35:0/3715941451 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbba001e040 con 0x562166859be0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbb8ffff700 1 -- 172.21.15.35:0/3715941451 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0038790 con 0x562166859be0 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3715941451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 msgr2=0x56216685ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685ff90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbba0004570 tx=0x7fbba00092f0 comp rx=0 tx=0).stop 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3715941451 shutdown_connections 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56216685a4f0 0x56216685cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562166854960 0x562166864f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3715941451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x56216685ff90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3715941451 >> 172.21.15.35:0/3715941451 conn(0x5621666b16b0 msgr2=0x562166853a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3715941451 shutdown_connections 2023-03-17T09:04:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.866+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3715941451 wait complete. 2023-03-17T09:04:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 -- start start 2023-03-17T09:04:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 Processor -- start 2023-03-17T09:04:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166862db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x5621668632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x5621668c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621668c0e60 con 0x562166859be0 2023-03-17T09:04:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621668c0fd0 con 0x562166854960 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621668c1190 con 0x56216685a4f0 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbbb7935b80 10 client.0 _ll_register_callbacks cb 0x56216664c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x5621668632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbba8d43700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x5621668632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43290/0 (socket says 172.21.15.35:43290) 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbba8d43700 1 -- 172.21.15.35:0/3832573380 learned_addr learned my addr 172.21.15.35:0/3832573380 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.867+0000 7fbba9544700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166862db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba9d45700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x5621668c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba8d43700 1 -- 172.21.15.35:0/3832573380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 msgr2=0x5621668c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba8d43700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x5621668c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba8d43700 1 -- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 msgr2=0x562166862db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba8d43700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166862db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba8d43700 1 -- 172.21.15.35:0/3832573380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621665d4d80 con 0x562166859be0 2023-03-17T09:04:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbba8d43700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x5621668632f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbba00054f0 tx=0x7fbba0004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78cd489ff7ac6f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbb8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:04:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbb8cff9700 1 -- 172.21.15.35:0/3832573380 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba000ba50 con 0x562166859be0 2023-03-17T09:04:09.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbb8cff9700 1 -- 172.21.15.35:0/3832573380 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbba000bbb0 con 0x562166859be0 2023-03-17T09:04:09.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621668241e0 con 0x562166859be0 2023-03-17T09:04:09.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbb8cff9700 1 -- 172.21.15.35:0/3832573380 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbba000bd70 con 0x562166859be0 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbbb7935b80 10 client.15804 fetch_fsmap learned FSMap version 29 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5621665fb1f0 con 0x562166859be0 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.868+0000 7fbb8cff9700 1 -- 172.21.15.35:0/3832573380 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5621668241e0 con 0x562166859be0 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbb8cff9700 1 -- 172.21.15.35:0/3832573380 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbba00245e0 con 0x562166859be0 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbbb7935b80 10 client.15804 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbbb7935b80 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbbb7935b80 20 client.15804 populate_metadata read hostname 'smithi035' 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5621668c2450 0x5621668c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbbb7935b80 4 client.15804 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56216662af00 con 0x5621668c2450 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbba9544700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5621668c2450 0x5621668c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbb8cff9700 10 client.15804 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:09.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.869+0000 7fbba9544700 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5621668c2450 0x5621668c4860 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c3c573b8a171580 server_cookie=631c6667ae9e3e53 in_seq=0 out_seq=0 2023-03-17T09:04:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbb8cff9700 1 -- 172.21.15.35:0/3832573380 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56216662af00 con 0x5621668c2450 2023-03-17T09:04:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbb8cff9700 10 client.15804 handle_command_reply: tid=0 2023-03-17T09:04:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 client.15804 shutdown 2023-03-17T09:04:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 msgr2=0x5621668632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x5621668632f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbba00054f0 tx=0x7fbba0004b00 comp rx=0 tx=0).stop 2023-03-17T09:04:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 shutdown_connections 2023-03-17T09:04:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5621668c2450 0x5621668c4860 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56216685a4f0 0x5621668c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562166854960 0x562166862db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 --2- 172.21.15.35:0/3832573380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562166859be0 0x5621668632f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 >> 172.21.15.35:0/3832573380 conn(0x5621666b16b0 msgr2=0x5621668576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.873+0000 7fbb8cff9700 0 client.15804 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 shutdown_connections 2023-03-17T09:04:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbb7935b80 1 -- 172.21.15.35:0/3832573380 wait complete. 2023-03-17T09:04:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbb7935b80 20 client.15804 trim_cache size 0 max 16384 2023-03-17T09:04:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:04:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:04:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:04:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:04:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb9009f6c0 msgr2=0x7fbb900a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb9009f6c0 0x7fbb900a1b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbba00059d0 tx=0x7fbba0005960 comp rx=0 tx=0).stop 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 msgr2=0x7fbba41961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba41961e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800e970 tx=0x7fbb9800ec80 comp rx=0 tx=0).stop 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 shutdown_connections 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb9009f6c0 0x7fbb900a1b70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba4104860 0x7fbba419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbba40fe850 0x7fbba41961e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 --2- 172.21.15.35:0/898093363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbba40ff200 0x7fbba4196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 >> 172.21.15.35:0/898093363 conn(0x7fbba40757a0 msgr2=0x7fbba40fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 shutdown_connections 2023-03-17T09:04:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:44.874+0000 7fbbab7a8700 1 -- 172.21.15.35:0/898093363 wait complete. 2023-03-17T09:04:14.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:46 smithi035 ceph-mon[92535]: pgmap v359: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:04:15.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:48 smithi035 ceph-mon[92535]: pgmap v360: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:15.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:50 smithi035 ceph-mon[92535]: pgmap v361: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:15.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:52 smithi035 ceph-mon[92535]: pgmap v362: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:15.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:54 smithi035 ceph-mon[92535]: pgmap v363: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:15.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:56 smithi035 ceph-mon[92535]: pgmap v364: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:15.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:50 smithi078 ceph-mon[94114]: pgmap v554: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:17.047 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:52 smithi078 ceph-mon[94114]: pgmap v555: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:17.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:54 smithi078 ceph-mon[94114]: pgmap v556: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:17.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:56 smithi078 ceph-mon[94114]: pgmap v557: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:17.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:03:58 smithi078 ceph-mon[94114]: pgmap v558: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:04:17.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:00 smithi078 ceph-mon[94114]: pgmap v559: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:17.048 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:02 smithi078 ceph-mon[94114]: pgmap v560: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:18.209 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:04 smithi078 ceph-mon[94114]: pgmap v561: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:04:18.209 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:06 smithi078 ceph-mon[94114]: pgmap v562: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:04:18.209 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:08 smithi078 ceph-mon[94114]: pgmap v563: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:04:19.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:09 smithi078 ceph-mon[94114]: osdmap e110: 12 total, 12 up, 12 in 2023-03-17T09:04:19.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:10 smithi078 ceph-mon[94114]: pgmap v565: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:04:19.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:12 smithi078 ceph-mon[94114]: pgmap v566: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:04:19.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:14 smithi078 ceph-mon[94114]: pgmap v567: 97 pgs: 97 active+clean; 1.4 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:04:19.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:50 smithi082 ceph-mon[94281]: pgmap v554: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:19.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:52 smithi082 ceph-mon[94281]: pgmap v555: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:54 smithi082 ceph-mon[94281]: pgmap v556: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:56 smithi082 ceph-mon[94281]: pgmap v557: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:03:58 smithi082 ceph-mon[94281]: pgmap v558: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:00 smithi082 ceph-mon[94281]: pgmap v559: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:02 smithi082 ceph-mon[94281]: pgmap v560: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:04 smithi082 ceph-mon[94281]: pgmap v561: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:04:20.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:06 smithi082 ceph-mon[94281]: pgmap v562: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:04:21.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:08 smithi082 ceph-mon[94281]: pgmap v563: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:04:21.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:09 smithi082 ceph-mon[94281]: osdmap e110: 12 total, 12 up, 12 in 2023-03-17T09:04:21.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:10 smithi082 ceph-mon[94281]: pgmap v565: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:04:21.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:12 smithi082 ceph-mon[94281]: pgmap v566: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:04:21.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:14 smithi082 ceph-mon[94281]: pgmap v567: 97 pgs: 97 active+clean; 1.4 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:04:21.671 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:16 smithi078 ceph-mon[94114]: osdmap e111: 12 total, 12 up, 12 in 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:16 smithi078 ceph-mon[94114]: pgmap v569: 97 pgs: 97 active+clean; 1.4 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:18 smithi078 ceph-mon[94114]: pgmap v570: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:20 smithi078 ceph-mon[94114]: pgmap v571: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:16 smithi082 ceph-mon[94281]: osdmap e111: 12 total, 12 up, 12 in 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:16 smithi082 ceph-mon[94281]: pgmap v569: 97 pgs: 97 active+clean; 1.4 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:18 smithi082 ceph-mon[94281]: pgmap v570: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T09:04:22.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:20 smithi082 ceph-mon[94281]: pgmap v571: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:04:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 -- 172.21.15.35:0/4266861827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc0ff350 msgr2=0x7f61cc0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 --2- 172.21.15.35:0/4266861827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc0ff350 0x7f61cc0ff720 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f61c00099c0 tx=0x7f61c0009cd0 comp rx=0 tx=0).stop 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 -- 172.21.15.35:0/4266861827 shutdown_connections 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 --2- 172.21.15.35:0/4266861827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc104390 0x7f61cc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 --2- 172.21.15.35:0/4266861827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc0ff350 0x7f61cc0ff720 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 --2- 172.21.15.35:0/4266861827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc0ffcf0 0x7f61cc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 -- 172.21.15.35:0/4266861827 >> 172.21.15.35:0/4266861827 conn(0x7f61cc076330 msgr2=0x7f61cc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 -- 172.21.15.35:0/4266861827 shutdown_connections 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.998+0000 7f61d1cba700 1 -- 172.21.15.35:0/4266861827 wait complete. 2023-03-17T09:04:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.999+0000 7f61d1cba700 1 Processor -- start 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:57.999+0000 7f61d1cba700 1 -- start start 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61d1cba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0ff350 0x7f61cc1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61d1cba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc0ffcf0 0x7f61cc197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61d1cba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 0x7f61cc1a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61d1cba700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc197f20 con 0x7f61cc104390 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61d1cba700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a2690 con 0x7f61cc0ffcf0 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61d1cba700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a2800 con 0x7f61cc0ff350 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 0x7f61cc1a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 0x7f61cc1a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43306/0 (socket says 172.21.15.35:43306) 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 -- 172.21.15.35:0/1137311295 learned_addr learned my addr 172.21.15.35:0/1137311295 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61caffd700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc0ffcf0 0x7f61cc197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0ff350 0x7f61cc1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 -- 172.21.15.35:0/1137311295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0ff350 msgr2=0x7f61cc1970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0ff350 0x7f61cc1970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 -- 172.21.15.35:0/1137311295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc0ffcf0 msgr2=0x7f61cc197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc0ffcf0 0x7f61cc197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 -- 172.21.15.35:0/1137311295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00095f0 con 0x7f61cc104390 2023-03-17T09:04:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61cbfff700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 0x7f61cc1a2150 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61c400ef30 tx=0x7f61c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.000+0000 7f61c8ff9700 1 -- 172.21.15.35:0/1137311295 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4018070 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.001+0000 7f61c8ff9700 1 -- 172.21.15.35:0/1137311295 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61c400f040 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.001+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc10f000 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.001+0000 7f61c8ff9700 1 -- 172.21.15.35:0/1137311295 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400cbc0 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.001+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc10ee70 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.003+0000 7f61c8ff9700 1 -- 172.21.15.35:0/1137311295 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f61c4007500 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.003+0000 7f61c8ff9700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f61b409f640 0x7f61b40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.004+0000 7f61c8ff9700 1 -- 172.21.15.35:0/1137311295 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f61c40ca090 con 0x7f61cc104390 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.004+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f61b409f640 0x7f61b40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.004+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f61b409f640 0x7f61b40a1af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b580 tx=0x7f61c0005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.004+0000 7f61dde47b80 1 Processor -- start 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.004+0000 7f61dde47b80 1 -- start start 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b470ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b470a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b470ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61dde47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4611010 con 0x5633b47104f0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61dde47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4663950 con 0x5633b470fbe0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61dde47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b465cde0 con 0x5633b470a960 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b470a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b470a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43312/0 (socket says 172.21.15.35:43312) 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 -- 172.21.15.35:0/126022908 learned_addr learned my addr 172.21.15.35:0/126022908 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b470ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 -- 172.21.15.35:0/126022908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 msgr2=0x5633b470ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b470ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 -- 172.21.15.35:0/126022908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 msgr2=0x5633b470ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b470ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 -- 172.21.15.35:0/126022908 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633b44de5d0 con 0x5633b47104f0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.005+0000 7f61caffd700 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b470a420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009cb0 tx=0x7f61bc011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e7b8aed67efdb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61b1ffb700 1 -- 172.21.15.35:0/126022908 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc011d80 con 0x5633b47104f0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61b1ffb700 1 -- 172.21.15.35:0/126022908 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61bc0044e0 con 0x5633b47104f0 2023-03-17T09:04:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61b1ffb700 1 -- 172.21.15.35:0/126022908 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc005280 con 0x5633b47104f0 2023-03-17T09:04:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 -- 172.21.15.35:0/126022908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 msgr2=0x5633b470a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b470a420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009cb0 tx=0x7f61bc011440 comp rx=0 tx=0).stop 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 -- 172.21.15.35:0/126022908 shutdown_connections 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b470ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b470ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 --2- 172.21.15.35:0/126022908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b470a420 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 -- 172.21.15.35:0/126022908 >> 172.21.15.35:0/126022908 conn(0x5633b45676b0 msgr2=0x5633b4704a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 -- 172.21.15.35:0/126022908 shutdown_connections 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.006+0000 7f61dde47b80 1 -- 172.21.15.35:0/126022908 wait complete. 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 -- start start 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 Processor -- start 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b47164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b4713740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b4713de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b44e08c0 con 0x5633b47104f0 2023-03-17T09:04:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4714550 con 0x5633b470fbe0 2023-03-17T09:04:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4720060 con 0x5633b470a960 2023-03-17T09:04:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61dde47b80 10 client.0 _ll_register_callbacks cb 0x5633b4502230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:04:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b4713de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.007+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b4713de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43320/0 (socket says 172.21.15.35:43320) 2023-03-17T09:04:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 -- 172.21.15.35:0/1612551543 learned_addr learned my addr 172.21.15.35:0/1612551543 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b47164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61caffd700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b4713740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 -- 172.21.15.35:0/1612551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 msgr2=0x5633b47164c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b47164c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:29.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 -- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 msgr2=0x5633b4713740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:29.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b4713740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 -- 172.21.15.35:0/1612551543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc0098e0 con 0x5633b47104f0 2023-03-17T09:04:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b47164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:04:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61caffd700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b4713740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:04:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61cbfff700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b4713de0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f61c40c7880 tx=0x7f61c40975e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2940625de0cea7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:04:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61aaffd700 1 -- 172.21.15.35:0/1612551543 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40970c0 con 0x5633b47104f0 2023-03-17T09:04:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61aaffd700 1 -- 172.21.15.35:0/1612551543 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f61c4097220 con 0x5633b47104f0 2023-03-17T09:04:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633b461f390 con 0x5633b47104f0 2023-03-17T09:04:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61aaffd700 1 -- 172.21.15.35:0/1612551543 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61c409f8a0 con 0x5633b47104f0 2023-03-17T09:04:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61dde47b80 10 client.15816 fetch_fsmap learned FSMap version 29 2023-03-17T09:04:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5633b448ad80 con 0x5633b47104f0 2023-03-17T09:04:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.008+0000 7f61aaffd700 1 -- 172.21.15.35:0/1612551543 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5633b461f390 con 0x5633b47104f0 2023-03-17T09:04:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61aaffd700 1 -- 172.21.15.35:0/1612551543 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f61c40c7280 con 0x5633b47104f0 2023-03-17T09:04:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61dde47b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:04:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61dde47b80 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:04:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61dde47b80 20 client.15816 populate_metadata read hostname 'smithi035' 2023-03-17T09:04:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61dde47b80 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4724230 0x5633b4726640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61dde47b80 4 client.15816 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:04:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633b462b600 con 0x5633b4724230 2023-03-17T09:04:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4724230 0x5633b4726640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61aaffd700 10 client.15816 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.009+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4724230 0x5633b4726640 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1593eb596e312c28 server_cookie=188b8d1a018b7258 in_seq=0 out_seq=0 2023-03-17T09:04:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61aaffd700 1 -- 172.21.15.35:0/1612551543 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5633b462b600 con 0x5633b4724230 2023-03-17T09:04:34.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61aaffd700 10 client.15816 handle_command_reply: tid=0 2023-03-17T09:04:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 client.15816 shutdown 2023-03-17T09:04:35.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 msgr2=0x5633b4713de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b4713de0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f61c40c7880 tx=0x7f61c40975e0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 shutdown_connections 2023-03-17T09:04:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4724230 0x5633b4726640 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b47104f0 0x5633b4713de0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b470a960 0x5633b47164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 --2- 172.21.15.35:0/1612551543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470fbe0 0x5633b4713740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61aaffd700 0 client.15816 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 >> 172.21.15.35:0/1612551543 conn(0x5633b45676b0 msgr2=0x5633b4709410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 shutdown_connections 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.010+0000 7f61dde47b80 1 -- 172.21.15.35:0/1612551543 wait complete. 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.011+0000 7f61dde47b80 20 client.15816 trim_cache size 0 max 16384 2023-03-17T09:04:35.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.025+0000 7f61dde47b80 1 Processor -- start 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.025+0000 7f61dde47b80 1 -- start start 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.025+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b4704ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.025+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b471afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b471f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61dde47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b47218f0 con 0x5633b470fbe0 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61dde47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4709ac0 con 0x5633b470a960 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61dde47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b470a7c0 con 0x5633b47104f0 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b471afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b471afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43326/0 (socket says 172.21.15.35:43326) 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 -- 172.21.15.35:0/3051935965 learned_addr learned my addr 172.21.15.35:0/3051935965 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b4704ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61cbfff700 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b471f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 -- 172.21.15.35:0/3051935965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 msgr2=0x5633b471f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b471f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 -- 172.21.15.35:0/3051935965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 msgr2=0x5633b4704ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b4704ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:35.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 -- 172.21.15.35:0/3051935965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633b4623130 con 0x5633b470fbe0 2023-03-17T09:04:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b4704ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:04:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61caffd700 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b471afb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x5633b47056a0 tx=0x7f61bc009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b576a6702c34e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61b27fc700 1 -- 172.21.15.35:0/3051935965 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc005050 con 0x5633b470fbe0 2023-03-17T09:04:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61b27fc700 1 -- 172.21.15.35:0/3051935965 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61bc005640 con 0x5633b470fbe0 2023-03-17T09:04:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.026+0000 7f61b27fc700 1 -- 172.21.15.35:0/3051935965 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc022400 con 0x5633b470fbe0 2023-03-17T09:04:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 -- 172.21.15.35:0/3051935965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 msgr2=0x5633b471afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b471afb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x5633b47056a0 tx=0x7f61bc009710 comp rx=0 tx=0).stop 2023-03-17T09:04:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 -- 172.21.15.35:0/3051935965 shutdown_connections 2023-03-17T09:04:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b471f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:38.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b4704ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:39.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 --2- 172.21.15.35:0/3051935965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b471afb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:39.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 -- 172.21.15.35:0/3051935965 >> 172.21.15.35:0/3051935965 conn(0x5633b45676b0 msgr2=0x5633b47160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:39.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 -- 172.21.15.35:0/3051935965 shutdown_connections 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 -- 172.21.15.35:0/3051935965 wait complete. 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.027+0000 7f61dde47b80 1 -- start start 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 Processor -- start 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b471ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b4719070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b47195b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4719af0 con 0x5633b470fbe0 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4719c60 con 0x5633b470a960 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b4719e20 con 0x5633b47104f0 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61dde47b80 10 client.0 _ll_register_callbacks cb 0x5633b4502230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b4719070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b4719070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43332/0 (socket says 172.21.15.35:43332) 2023-03-17T09:04:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 -- 172.21.15.35:0/2649116636 learned_addr learned my addr 172.21.15.35:0/2649116636 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:04:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61cb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b471ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61cbfff700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b47195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 -- 172.21.15.35:0/2649116636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 msgr2=0x5633b47195b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b47195b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 -- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 msgr2=0x5633b471ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:04:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b471ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.028+0000 7f61caffd700 1 -- 172.21.15.35:0/2649116636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc01d040 con 0x5633b470fbe0 2023-03-17T09:04:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61cbfff700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b47195b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61caffd700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b4719070 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61bc000c00 tx=0x7f61bc0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3966a3919d5fbc62 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61aaffd700 1 -- 172.21.15.35:0/2649116636 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc011020 con 0x5633b470fbe0 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61aaffd700 1 -- 172.21.15.35:0/2649116636 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f61bc011180 con 0x5633b470fbe0 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633b46da1e0 con 0x5633b470fbe0 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61aaffd700 1 -- 172.21.15.35:0/2649116636 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61bc003990 con 0x5633b470fbe0 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 10 client.15822 fetch_fsmap learned FSMap version 29 2023-03-17T09:04:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5633b44b11f0 con 0x5633b470fbe0 2023-03-17T09:04:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61aaffd700 1 -- 172.21.15.35:0/2649116636 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5633b46da1e0 con 0x5633b470fbe0 2023-03-17T09:04:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61aaffd700 1 -- 172.21.15.35:0/2649116636 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f61bc0114b0 con 0x5633b470fbe0 2023-03-17T09:04:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 10 client.15822 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:04:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:04:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 20 client.15822 populate_metadata read hostname 'smithi035' 2023-03-17T09:04:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4779170 0x5633b477b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:04:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 4 client.15822 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:04:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.029+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5633b44e0f00 con 0x5633b4779170 2023-03-17T09:04:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.030+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4779170 0x5633b477b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:04:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.030+0000 7f61cb7fe700 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4779170 0x5633b477b580 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=941373af41d4a2aa server_cookie=7195cbeffcaa8021 in_seq=0 out_seq=0 2023-03-17T09:04:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.030+0000 7f61aaffd700 10 client.15822 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61aaffd700 1 -- 172.21.15.35:0/2649116636 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5633b44e0f00 con 0x5633b4779170 2023-03-17T09:04:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61aaffd700 10 client.15822 handle_command_reply: tid=0 2023-03-17T09:04:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 client.15822 shutdown 2023-03-17T09:04:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 msgr2=0x5633b4719070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b4719070 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61bc000c00 tx=0x7f61bc0055d0 comp rx=0 tx=0).stop 2023-03-17T09:04:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 shutdown_connections 2023-03-17T09:04:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5633b4779170 0x5633b477b580 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633b47104f0 0x5633b47195b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5633b470a960 0x5633b471ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 --2- 172.21.15.35:0/2649116636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5633b470fbe0 0x5633b4719070 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 >> 172.21.15.35:0/2649116636 conn(0x5633b45676b0 msgr2=0x5633b470d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61aaffd700 0 client.15822 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 shutdown_connections 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.034+0000 7f61dde47b80 1 -- 172.21.15.35:0/2649116636 wait complete. 2023-03-17T09:04:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61dde47b80 20 client.15822 trim_cache size 0 max 16384 2023-03-17T09:04:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:04:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:04:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:04:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:04:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f61b409f640 msgr2=0x7f61b40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f61b409f640 0x7f61b40a1af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b580 tx=0x7f61c0005c00 comp rx=0 tx=0).stop 2023-03-17T09:04:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 msgr2=0x7f61cc1a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:04:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 0x7f61cc1a2150 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61c400ef30 tx=0x7f61c400c3a0 comp rx=0 tx=0).stop 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 shutdown_connections 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f61b409f640 0x7f61b40a1af0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f61cc104390 0x7f61cc1a2150 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61cc0ff350 0x7f61cc1970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 --2- 172.21.15.35:0/1137311295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc0ffcf0 0x7f61cc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 >> 172.21.15.35:0/1137311295 conn(0x7f61cc076330 msgr2=0x7f61cc0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 shutdown_connections 2023-03-17T09:04:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:57:58.035+0000 7f61d1cba700 1 -- 172.21.15.35:0/1137311295 wait complete. 2023-03-17T09:04:55.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:57:58 smithi035 ceph-mon[92535]: pgmap v365: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:55.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:00 smithi035 ceph-mon[92535]: pgmap v366: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:04:55.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:02 smithi035 ceph-mon[92535]: pgmap v367: 97 pgs: 97 active+clean; 1.3 MiB data, 92 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:04:55.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:04 smithi035 ceph-mon[92535]: pgmap v368: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:04:55.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:06 smithi035 ceph-mon[92535]: pgmap v369: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:04:55.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:08 smithi035 ceph-mon[92535]: pgmap v370: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:04:55.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:10 smithi035 ceph-mon[92535]: pgmap v371: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:04:55.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:10 smithi035 ceph-mon[92535]: osdmap e97: 12 total, 12 up, 12 in 2023-03-17T09:04:55.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:22 smithi078 ceph-mon[94114]: pgmap v572: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:04:58.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:24 smithi078 ceph-mon[94114]: pgmap v573: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:04:58.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:26 smithi078 ceph-mon[94114]: pgmap v574: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:04:58.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:28 smithi078 ceph-mon[94114]: pgmap v575: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:30 smithi078 ceph-mon[94114]: pgmap v576: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:32 smithi078 ceph-mon[94114]: pgmap v577: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:34 smithi078 ceph-mon[94114]: pgmap v578: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:36 smithi078 ceph-mon[94114]: pgmap v579: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:38 smithi078 ceph-mon[94114]: pgmap v580: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:40 smithi078 ceph-mon[94114]: pgmap v581: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:42 smithi078 ceph-mon[94114]: pgmap v582: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:58.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:04:58.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:44 smithi078 ceph-mon[94114]: pgmap v583: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:58.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:04:58.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:04:58.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:04:58.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:46 smithi078 ceph-mon[94114]: pgmap v584: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:58.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:48 smithi078 ceph-mon[94114]: pgmap v585: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:50 smithi078 ceph-mon[94114]: pgmap v586: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:52 smithi078 ceph-mon[94114]: pgmap v587: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:54 smithi078 ceph-mon[94114]: pgmap v588: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:22 smithi082 ceph-mon[94281]: pgmap v572: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:24 smithi082 ceph-mon[94281]: pgmap v573: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:26 smithi082 ceph-mon[94281]: pgmap v574: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:28 smithi082 ceph-mon[94281]: pgmap v575: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:30 smithi082 ceph-mon[94281]: pgmap v576: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:32 smithi082 ceph-mon[94281]: pgmap v577: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:34 smithi082 ceph-mon[94281]: pgmap v578: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:04:59.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:36 smithi082 ceph-mon[94281]: pgmap v579: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:59.515 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:38 smithi082 ceph-mon[94281]: pgmap v580: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:04:59.515 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:40 smithi082 ceph-mon[94281]: pgmap v581: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:59.515 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:42 smithi082 ceph-mon[94281]: pgmap v582: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:04:59.515 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:04:59.515 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:44 smithi082 ceph-mon[94281]: pgmap v583: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:05:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:05:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:00.045 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:46 smithi082 ceph-mon[94281]: pgmap v584: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:00.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:48 smithi082 ceph-mon[94281]: pgmap v585: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:01.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:50 smithi082 ceph-mon[94281]: pgmap v586: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:05:01.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:52 smithi082 ceph-mon[94281]: pgmap v587: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:05:01.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:54 smithi082 ceph-mon[94281]: pgmap v588: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:02.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:56 smithi082 ceph-mon[94281]: pgmap v589: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:03.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:04:58 smithi082 ceph-mon[94281]: pgmap v590: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:03.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:00 smithi082 ceph-mon[94281]: pgmap v591: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:03.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:56 smithi078 ceph-mon[94114]: pgmap v589: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:03.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:04:58 smithi078 ceph-mon[94114]: pgmap v590: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:03.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:00 smithi078 ceph-mon[94114]: pgmap v591: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:03.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:02 smithi082 ceph-mon[94281]: pgmap v592: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:05.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:02 smithi078 ceph-mon[94114]: pgmap v592: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:05.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:04 smithi082 ceph-mon[94281]: pgmap v593: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T09:05:05.758 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: in thread 7fa6ada76700 thread_name:md_log_replay 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa6be620cf0] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x562f771e0702] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562f771e2953] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 4: (MDLog::_replay_thread()+0x66d) [0x562f7724e07d] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562f76f01d91] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa6be6161ca] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 7: clone() 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:03.292+0000 7fa6ada76700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: in thread 7fa6ada76700 thread_name:md_log_replay 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa6be620cf0] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x562f771e0702] 2023-03-17T09:05:05.759 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562f771e2953] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 4: (MDLog::_replay_thread()+0x66d) [0x562f7724e07d] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562f76f01d91] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa6be6161ca] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 7: clone() 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 0> 2023-03-17T09:05:03.292+0000 7fa6ada76700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: in thread 7fa6ada76700 thread_name:md_log_replay 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa6be620cf0] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x562f771e0702] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562f771e2953] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 4: (MDLog::_replay_thread()+0x66d) [0x562f7724e07d] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562f76f01d91] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa6be6161ca] 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 7: clone() 2023-03-17T09:05:05.760 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 0> 2023-03-17T09:05:03.292+0000 7fa6ada76700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: in thread 7fa6ada76700 thread_name:md_log_replay 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa6be620cf0] 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x562f771e0702] 2023-03-17T09:05:05.761 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562f771e2953] 2023-03-17T09:05:06.251 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 4: (MDLog::_replay_thread()+0x66d) [0x562f7724e07d] 2023-03-17T09:05:06.251 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562f76f01d91] 2023-03-17T09:05:06.251 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa6be6161ca] 2023-03-17T09:05:06.251 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 7: clone() 2023-03-17T09:05:06.251 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:05:06.251 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[133593]: 2023-03-17T09:05:06.252 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:05:07.097 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:05:07.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:04 smithi078 ceph-mon[94114]: pgmap v593: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T09:05:07.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:06 smithi078 ceph-mon[94114]: pgmap v594: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T09:05:07.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:06 smithi082 ceph-mon[94281]: pgmap v594: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T09:05:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 -- 172.21.15.35:0/738190699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99800ffd70 msgr2=0x7f9980103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 --2- 172.21.15.35:0/738190699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99800ffd70 0x7f9980103d30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f99700099c0 tx=0x7f9970009cd0 comp rx=0 tx=0).stop 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 -- 172.21.15.35:0/738190699 shutdown_connections 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 --2- 172.21.15.35:0/738190699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9980104410 0x7f998010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 --2- 172.21.15.35:0/738190699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99800ff3d0 0x7f99800ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 --2- 172.21.15.35:0/738190699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99800ffd70 0x7f9980103d30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 -- 172.21.15.35:0/738190699 >> 172.21.15.35:0/738190699 conn(0x7f9980076f80 msgr2=0x7f9980077380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 -- 172.21.15.35:0/738190699 shutdown_connections 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.158+0000 7f998530a700 1 -- 172.21.15.35:0/738190699 wait complete. 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 Processor -- start 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 -- start start 2023-03-17T09:05:08.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99800ff3d0 0x7f9980196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99800ffd70 0x7f99801967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 0x7f998019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998019b270 con 0x7f9980104410 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998019b3e0 con 0x7f99800ffd70 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f998530a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998019b5a0 con 0x7f99800ff3d0 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f997f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 0x7f998019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f997f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 0x7f998019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43348/0 (socket says 172.21.15.35:43348) 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99800ffd70 0x7f99801967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f997f7fe700 1 -- 172.21.15.35:0/854869405 learned_addr learned my addr 172.21.15.35:0/854869405 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.159+0000 7f997effd700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99800ff3d0 0x7f9980196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997f7fe700 1 -- 172.21.15.35:0/854869405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99800ff3d0 msgr2=0x7f9980196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997f7fe700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99800ff3d0 0x7f9980196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997f7fe700 1 -- 172.21.15.35:0/854869405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99800ffd70 msgr2=0x7f99801967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997f7fe700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99800ffd70 0x7f99801967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997f7fe700 1 -- 172.21.15.35:0/854869405 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99700095f0 con 0x7f9980104410 2023-03-17T09:05:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997effd700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99800ff3d0 0x7f9980196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f997f7fe700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 0x7f998019ac30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f997800ef30 tx=0x7f997800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f9967fff700 1 -- 172.21.15.35:0/854869405 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978018070 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998010f090 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f9967fff700 1 -- 172.21.15.35:0/854869405 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f997800f040 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f9967fff700 1 -- 172.21.15.35:0/854869405 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800cbc0 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.160+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998010ef00 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.163+0000 7f9967fff700 1 -- 172.21.15.35:0/854869405 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9978007500 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.163+0000 7f9967fff700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f996809f640 0x7f99680a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.163+0000 7f9967fff700 1 -- 172.21.15.35:0/854869405 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f99780ca0c0 con 0x7f9980104410 2023-03-17T09:05:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.163+0000 7f997effd700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f996809f640 0x7f99680a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:09.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f997effd700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f996809f640 0x7f99680a1af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9974007fd0 tx=0x7f99740073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 Processor -- start 2023-03-17T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 -- start start 2023-03-17T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068aad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3067b1010 con 0x55b3068afbe0 2023-03-17T09:05:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b306803950 con 0x55b3068aa960 2023-03-17T09:05:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f9991497b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3067fcde0 con 0x55b3068b04f0 2023-03-17T09:05:12.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.164+0000 7f997effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43352/0 (socket says 172.21.15.35:43352) 2023-03-17T09:05:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 -- 172.21.15.35:0/213309319 learned_addr learned my addr 172.21.15.35:0/213309319 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:05:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997e7fc700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997f7fe700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 -- 172.21.15.35:0/213309319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 msgr2=0x55b3068aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:12.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 -- 172.21.15.35:0/213309319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 msgr2=0x55b3068aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 -- 172.21.15.35:0/213309319 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b30667e5d0 con 0x55b3068afbe0 2023-03-17T09:05:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997f7fe700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:05:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997e7fc700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:05:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f997effd700 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068affb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9974004350 tx=0x7f9974013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb00aca9e6a165f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:05:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f99657fa700 1 -- 172.21.15.35:0/213309319 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974003980 con 0x55b3068afbe0 2023-03-17T09:05:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f99657fa700 1 -- 172.21.15.35:0/213309319 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9974011440 con 0x55b3068afbe0 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.165+0000 7f99657fa700 1 -- 172.21.15.35:0/213309319 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997401f690 con 0x55b3068afbe0 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 -- 172.21.15.35:0/213309319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 msgr2=0x55b3068affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068affb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9974004350 tx=0x7f9974013000 comp rx=0 tx=0).stop 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 -- 172.21.15.35:0/213309319 shutdown_connections 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068affb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 --2- 172.21.15.35:0/213309319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 -- 172.21.15.35:0/213309319 >> 172.21.15.35:0/213309319 conn(0x55b3067076b0 msgr2=0x55b3068a4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 -- 172.21.15.35:0/213309319 shutdown_connections 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 -- 172.21.15.35:0/213309319 wait complete. 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.166+0000 7f9991497b80 1 -- start start 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 Processor -- start 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3066808c0 con 0x55b3068afbe0 2023-03-17T09:05:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068b4670 con 0x55b3068b04f0 2023-03-17T09:05:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068c0000 con 0x55b3068aa960 2023-03-17T09:05:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f9991497b80 10 client.0 _ll_register_callbacks cb 0x55b3066a2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:05:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43360/0 (socket says 172.21.15.35:43360) 2023-03-17T09:05:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 -- 172.21.15.35:0/1905524391 learned_addr learned my addr 172.21.15.35:0/1905524391 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:05:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997f7fe700 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 -- 172.21.15.35:0/1905524391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 msgr2=0x55b3068b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 -- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 msgr2=0x55b3068b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:15.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.167+0000 7f997e7fc700 1 -- 172.21.15.35:0/1905524391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974004030 con 0x55b3068afbe0 2023-03-17T09:05:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f997e7fc700 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b37c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f997000b580 tx=0x7f9970005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65daecc7787438e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:05:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9962ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:05:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9962ff5700 1 -- 172.21.15.35:0/1905524391 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970005600 con 0x55b3068afbe0 2023-03-17T09:05:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9962ff5700 1 -- 172.21.15.35:0/1905524391 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f9970003760 con 0x55b3068afbe0 2023-03-17T09:05:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3067bf390 con 0x55b3068afbe0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9962ff5700 1 -- 172.21.15.35:0/1905524391 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9970003920 con 0x55b3068afbe0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 10 client.15834 fetch_fsmap learned FSMap version 29 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b30662ad80 con 0x55b3068afbe0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9962ff5700 1 -- 172.21.15.35:0/1905524391 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9970030020 con 0x55b3068afbe0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9962ff5700 1 -- 172.21.15.35:0/1905524391 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f997000fa20 con 0x55b3068afbe0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 20 client.15834 populate_metadata read hostname 'smithi035' 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b3068c4020 0x55b3068c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 4 client.15834 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.168+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3067cb600 con 0x55b3068c4020 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.169+0000 7f997effd700 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b3068c4020 0x55b3068c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.169+0000 7f9962ff5700 10 client.15834 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.169+0000 7f997effd700 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b3068c4020 0x55b3068c6430 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af85b90e2a8156b server_cookie=7d2da50d0aa92567 in_seq=0 out_seq=0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9962ff5700 1 -- 172.21.15.35:0/1905524391 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b3067cb600 con 0x55b3068c4020 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9962ff5700 10 client.15834 handle_command_reply: tid=0 2023-03-17T09:05:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 client.15834 shutdown 2023-03-17T09:05:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 msgr2=0x55b3068b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b37c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f997000b580 tx=0x7f9970005c00 comp rx=0 tx=0).stop 2023-03-17T09:05:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 shutdown_connections 2023-03-17T09:05:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b3068c4020 0x55b3068c6430 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9962ff5700 0 client.15834 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:05:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 --2- 172.21.15.35:0/1905524391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b37c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 >> 172.21.15.35:0/1905524391 conn(0x55b3067076b0 msgr2=0x55b3068a9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:05:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 shutdown_connections 2023-03-17T09:05:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 1 -- 172.21.15.35:0/1905524391 wait complete. 2023-03-17T09:05:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.170+0000 7f9991497b80 20 client.15834 trim_cache size 0 max 16384 2023-03-17T09:05:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.185+0000 7f9991497b80 1 Processor -- start 2023-03-17T09:05:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.185+0000 7f9991497b80 1 -- start start 2023-03-17T09:05:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9991497b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068baf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9991497b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9991497b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9991497b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068a00f0 con 0x55b3068afbe0 2023-03-17T09:05:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9991497b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068a9b20 con 0x55b3068b04f0 2023-03-17T09:05:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9991497b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068a1b60 con 0x55b3068aa960 2023-03-17T09:05:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43368/0 (socket says 172.21.15.35:43368) 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 -- 172.21.15.35:0/2314922181 learned_addr learned my addr 172.21.15.35:0/2314922181 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997effd700 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997f7fe700 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 -- 172.21.15.35:0/2314922181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 msgr2=0x55b3068baf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068baf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 -- 172.21.15.35:0/2314922181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 msgr2=0x55b3068b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 -- 172.21.15.35:0/2314922181 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3067c3130 con 0x55b3068afbe0 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997f7fe700 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f997e7fc700 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068c0440 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f997000fe30 tx=0x7f9970009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb659ef92bfa3b5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9965ffb700 1 -- 172.21.15.35:0/2314922181 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000b630 con 0x55b3068afbe0 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9965ffb700 1 -- 172.21.15.35:0/2314922181 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9970030030 con 0x55b3068afbe0 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.186+0000 7f9965ffb700 1 -- 172.21.15.35:0/2314922181 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000f460 con 0x55b3068afbe0 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 -- 172.21.15.35:0/2314922181 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 msgr2=0x55b3068c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068c0440 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f997000fe30 tx=0x7f9970009cd0 comp rx=0 tx=0).stop 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 -- 172.21.15.35:0/2314922181 shutdown_connections 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068b04f0 0x55b3068b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068aa960 0x55b3068baf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 --2- 172.21.15.35:0/2314922181 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068c0440 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 -- 172.21.15.35:0/2314922181 >> 172.21.15.35:0/2314922181 conn(0x55b3067076b0 msgr2=0x55b3068a9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:05:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 -- 172.21.15.35:0/2314922181 shutdown_connections 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 -- 172.21.15.35:0/2314922181 wait complete. 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 -- start start 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.187+0000 7f9991497b80 1 Processor -- start 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068b99f0 con 0x55b3068afbe0 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068b9b60 con 0x55b3068aa960 2023-03-17T09:05:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3068b9d20 con 0x55b3068b04f0 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9991497b80 10 client.0 _ll_register_callbacks cb 0x55b3066a2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43374/0 (socket says 172.21.15.35:43374) 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 -- 172.21.15.35:0/4074425229 learned_addr learned my addr 172.21.15.35:0/4074425229 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997f7fe700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997effd700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 -- 172.21.15.35:0/4074425229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 msgr2=0x55b3068b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 -- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 msgr2=0x55b3068bacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068bacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 -- 172.21.15.35:0/4074425229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b30662ad80 con 0x55b3068afbe0 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f997e7fc700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b8f70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9970037040 tx=0x7f9970009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44934f6834387900 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.188+0000 7f9962ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9962ff5700 1 -- 172.21.15.35:0/4074425229 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970003960 con 0x55b3068afbe0 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9962ff5700 1 -- 172.21.15.35:0/4074425229 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f9970000e40 con 0x55b3068afbe0 2023-03-17T09:05:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b30687a1e0 con 0x55b3068afbe0 2023-03-17T09:05:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9962ff5700 1 -- 172.21.15.35:0/4074425229 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9970005710 con 0x55b3068afbe0 2023-03-17T09:05:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 10 client.15840 fetch_fsmap learned FSMap version 29 2023-03-17T09:05:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b3066511f0 con 0x55b3068afbe0 2023-03-17T09:05:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9962ff5700 1 -- 172.21.15.35:0/4074425229 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b30687a1e0 con 0x55b3068afbe0 2023-03-17T09:05:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9962ff5700 1 -- 172.21.15.35:0/4074425229 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f997000f9c0 con 0x55b3068afbe0 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 10 client.15840 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 10 client.15840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 20 client.15840 populate_metadata read hostname 'smithi035' 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b306918e20 0x55b30691b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 4 client.15840 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b306680f00 con 0x55b306918e20 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.189+0000 7f997effd700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b306918e20 0x55b30691b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.190+0000 7f9962ff5700 10 client.15840 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.190+0000 7f997effd700 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b306918e20 0x55b30691b200 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156da1914b5e8031 server_cookie=f341b033ee2b56b0 in_seq=0 out_seq=0 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.196+0000 7f9962ff5700 1 -- 172.21.15.35:0/4074425229 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b306680f00 con 0x55b306918e20 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.196+0000 7f9962ff5700 10 client.15840 handle_command_reply: tid=0 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.196+0000 7f9991497b80 1 client.15840 shutdown 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 msgr2=0x55b3068b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b8f70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9970037040 tx=0x7f9970009290 comp rx=0 tx=0).stop 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 shutdown_connections 2023-03-17T09:05:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b306918e20 0x55b30691b200 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3068b04f0 0x55b3068b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b3068aa960 0x55b3068bacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 --2- 172.21.15.35:0/4074425229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b3068afbe0 0x55b3068b8f70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9962ff5700 0 client.15840 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 >> 172.21.15.35:0/4074425229 conn(0x55b3067076b0 msgr2=0x55b3068ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 shutdown_connections 2023-03-17T09:05:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 1 -- 172.21.15.35:0/4074425229 wait complete. 2023-03-17T09:05:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f9991497b80 20 client.15840 trim_cache size 0 max 16384 2023-03-17T09:05:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:05:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:05:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:05:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:05:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f996809f640 msgr2=0x7f99680a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f996809f640 0x7f99680a1af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9974007fd0 tx=0x7f99740073d0 comp rx=0 tx=0).stop 2023-03-17T09:05:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 msgr2=0x7f998019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:05:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 0x7f998019ac30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f997800ef30 tx=0x7f997800c3a0 comp rx=0 tx=0).stop 2023-03-17T09:05:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 shutdown_connections 2023-03-17T09:05:34.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f996809f640 0x7f99680a1af0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9980104410 0x7f998019ac30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99800ff3d0 0x7f9980196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 --2- 172.21.15.35:0/854869405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99800ffd70 0x7f99801967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 >> 172.21.15.35:0/854869405 conn(0x7f9980076f80 msgr2=0x7f99800692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.197+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 shutdown_connections 2023-03-17T09:05:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:11.198+0000 7f998530a700 1 -- 172.21.15.35:0/854869405 wait complete. 2023-03-17T09:05:35.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:12 smithi035 ceph-mon[92535]: pgmap v373: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:05:38.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:14 smithi035 ceph-mon[92535]: pgmap v374: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:05:38.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:16 smithi035 ceph-mon[92535]: osdmap e98: 12 total, 12 up, 12 in 2023-03-17T09:05:38.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:16 smithi035 ceph-mon[92535]: pgmap v376: 97 pgs: 97 active+clean; 1.3 MiB data, 93 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:05:38.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:18 smithi035 ceph-mon[92535]: pgmap v377: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T09:05:38.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:20 smithi035 ceph-mon[92535]: pgmap v378: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 824 B/s wr, 11 op/s 2023-03-17T09:05:38.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:22 smithi035 ceph-mon[92535]: pgmap v379: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:05:38.071 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:08 smithi078 ceph-mon[94114]: pgmap v595: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T09:05:39.100 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:10 smithi078 ceph-mon[94114]: pgmap v596: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-03-17T09:05:40.937 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:12 smithi078 ceph-mon[94114]: pgmap v597: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-03-17T09:05:40.937 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:14 smithi078 ceph-mon[94114]: pgmap v598: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-03-17T09:05:40.938 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:05:40.938 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Scheduled restart job, restart counter is at 2. 2023-03-17T09:05:40.938 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 systemd[1]: Stopped Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:05:40.938 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 systemd[1]: Starting Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T09:05:40.938 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 podman[134040]: 2023-03-17T09:05:40.938 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 bash[134040]: a5a3ffb3d728ec952e0c3aa787fdbe8daa5678ffbec98751042f0e8864d09031 2023-03-17T09:05:40.939 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 ceph-mds[134080]: -- 172.21.15.78:0/3192070259 <== mon.2 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559caec6cb60 con 0x559caec43000 2023-03-17T09:05:40.939 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: starting mds.e at 2023-03-17T09:05:40.939 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:05:14 smithi078 systemd[1]: Started Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:05:40.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:08 smithi082 ceph-mon[94281]: pgmap v595: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T09:05:42.485 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:10 smithi082 ceph-mon[94281]: pgmap v596: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-03-17T09:05:42.485 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:12 smithi082 ceph-mon[94281]: pgmap v597: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:14 smithi082 ceph-mon[94281]: pgmap v598: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:15 smithi082 ceph-mon[94281]: daemon mds.e restarted 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:15 smithi082 ceph-mon[94281]: osdmap e112: 12 total, 12 up, 12 in 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6834/545594421,v1:172.21.15.78:6835/545594421] up:boot 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:16 smithi082 ceph-mon[94281]: pgmap v600: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 307 B/s wr, 8 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:18 smithi082 ceph-mon[94281]: pgmap v601: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:20 smithi082 ceph-mon[94281]: pgmap v602: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:22 smithi082 ceph-mon[94281]: pgmap v603: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:24 smithi082 ceph-mon[94281]: pgmap v604: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:05:42.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:26 smithi082 ceph-mon[94281]: pgmap v605: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 293 B/s wr, 10 op/s 2023-03-17T09:05:43.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:28 smithi082 ceph-mon[94281]: pgmap v606: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-17T09:05:43.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:30 smithi082 ceph-mon[94281]: pgmap v607: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:05:43.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:32 smithi082 ceph-mon[94281]: pgmap v608: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:05:43.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:34 smithi082 ceph-mon[94281]: pgmap v609: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:43.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:36 smithi082 ceph-mon[94281]: pgmap v610: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:43.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:38 smithi082 ceph-mon[94281]: pgmap v611: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:43.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:40 smithi082 ceph-mon[94281]: pgmap v612: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:43.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:15 smithi078 ceph-mon[94114]: daemon mds.e restarted 2023-03-17T09:05:44.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:15 smithi078 ceph-mon[94114]: osdmap e112: 12 total, 12 up, 12 in 2023-03-17T09:05:44.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6834/545594421,v1:172.21.15.78:6835/545594421] up:boot 2023-03-17T09:05:44.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:05:45.753 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:05:45.753 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:16 smithi078 ceph-mon[94114]: pgmap v600: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 307 B/s wr, 8 op/s 2023-03-17T09:05:45.753 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:18 smithi078 ceph-mon[94114]: pgmap v601: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:05:48.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:20 smithi078 ceph-mon[94114]: pgmap v602: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:22 smithi078 ceph-mon[94114]: pgmap v603: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:24 smithi078 ceph-mon[94114]: pgmap v604: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:26 smithi078 ceph-mon[94114]: pgmap v605: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 293 B/s wr, 10 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:28 smithi078 ceph-mon[94114]: pgmap v606: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:30 smithi078 ceph-mon[94114]: pgmap v607: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:32 smithi078 ceph-mon[94114]: pgmap v608: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:34 smithi078 ceph-mon[94114]: pgmap v609: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:36 smithi078 ceph-mon[94114]: pgmap v610: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:50.809 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:38 smithi078 ceph-mon[94114]: pgmap v611: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:50.809 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:40 smithi078 ceph-mon[94114]: pgmap v612: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:50.809 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:42 smithi078 ceph-mon[94114]: pgmap v613: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:50.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:44 smithi078 ceph-mon[94114]: pgmap v614: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:53.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:46 smithi078 ceph-mon[94114]: pgmap v615: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:48 smithi078 ceph-mon[94114]: pgmap v616: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:53.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:50 smithi078 ceph-mon[94114]: pgmap v617: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:42 smithi082 ceph-mon[94281]: pgmap v613: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:56.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:44 smithi082 ceph-mon[94281]: pgmap v614: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:56.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:05:56.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:56.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:56.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:05:56.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:05:56.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:05:57.154 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:46 smithi082 ceph-mon[94281]: pgmap v615: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-17T09:05:57.154 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:48 smithi082 ceph-mon[94281]: pgmap v616: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:57.154 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:50 smithi082 ceph-mon[94281]: pgmap v617: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:57.154 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:52 smithi082 ceph-mon[94281]: pgmap v618: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:57.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:54 smithi082 ceph-mon[94281]: pgmap v619: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:59.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:56 smithi082 ceph-mon[94281]: pgmap v620: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:59.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:52 smithi078 ceph-mon[94114]: pgmap v618: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:59.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:54 smithi078 ceph-mon[94114]: pgmap v619: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:05:59.229 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:56 smithi078 ceph-mon[94114]: pgmap v620: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:05:59.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:05:58 smithi078 ceph-mon[94114]: pgmap v621: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:06:01.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:05:58 smithi082 ceph-mon[94281]: pgmap v621: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:06:01.529 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:00 smithi078 ceph-mon[94114]: pgmap v622: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:03.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:00 smithi082 ceph-mon[94281]: pgmap v622: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:03.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:02 smithi078 ceph-mon[94114]: pgmap v623: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:03.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:02 smithi082 ceph-mon[94281]: pgmap v623: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:03.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 -- 172.21.15.35:0/3195252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47840ff350 msgr2=0x7f47840ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 --2- 172.21.15.35:0/3195252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47840ff350 0x7f47840ff720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f47740099c0 tx=0x7f4774009cd0 comp rx=0 tx=0).stop 2023-03-17T09:06:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 -- 172.21.15.35:0/3195252667 shutdown_connections 2023-03-17T09:06:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 --2- 172.21.15.35:0/3195252667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4784104390 0x7f478410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 --2- 172.21.15.35:0/3195252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47840ff350 0x7f47840ff720 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 --2- 172.21.15.35:0/3195252667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840ffcf0 0x7f4784103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 -- 172.21.15.35:0/3195252667 >> 172.21.15.35:0/3195252667 conn(0x7f4784076330 msgr2=0x7f4784076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 -- 172.21.15.35:0/3195252667 shutdown_connections 2023-03-17T09:06:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.320+0000 7f4788bc4700 1 -- 172.21.15.35:0/3195252667 wait complete. 2023-03-17T09:06:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 Processor -- start 2023-03-17T09:06:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 -- start start 2023-03-17T09:06:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 0x7f4784198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840ffcf0 0x7f4784198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4784104390 0x7f478419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478419d520 con 0x7f4784104390 2023-03-17T09:06:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478419d690 con 0x7f47840ffcf0 2023-03-17T09:06:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4788bc4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478419d850 con 0x7f47840ff350 2023-03-17T09:06:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f478259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 0x7f4784198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f4782d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4784104390 0x7f478419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.321+0000 7f478259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 0x7f4784198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:35152/0 (socket says 172.21.15.35:35152) 2023-03-17T09:06:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 -- 172.21.15.35:0/4076421407 learned_addr learned my addr 172.21.15.35:0/4076421407 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f4781d9b700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840ffcf0 0x7f4784198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 -- 172.21.15.35:0/4076421407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840ffcf0 msgr2=0x7f4784198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840ffcf0 0x7f4784198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 -- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4784104390 msgr2=0x7f478419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4784104390 0x7f478419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 -- 172.21.15.35:0/4076421407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740095f0 con 0x7f47840ff350 2023-03-17T09:06:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f478259c700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 0x7f4784198540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4774009fd0 tx=0x7f477400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f47737fe700 1 -- 172.21.15.35:0/4076421407 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477401d070 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478410f000 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f47737fe700 1 -- 172.21.15.35:0/4076421407 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47740054c0 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f47737fe700 1 -- 172.21.15.35:0/4076421407 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774004a90 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.322+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478410ee70 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.325+0000 7f47737fe700 1 -- 172.21.15.35:0/4076421407 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f477400fb80 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.325+0000 7f47737fe700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f476c09f640 0x7f476c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.325+0000 7f4781d9b700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f476c09f640 0x7f476c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.325+0000 7f47737fe700 1 -- 172.21.15.35:0/4076421407 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47740cb410 con 0x7f47840ff350 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 Processor -- start 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4781d9b700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f476c09f640 0x7f476c0a1af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4778005950 tx=0x7f47780058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 -- start start 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 0x555f395d8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395d8960 0x555f395d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f394df010 con 0x555f395de4f0 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f39531950 con 0x555f395ddbe0 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.326+0000 7f4794d51b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3952ade0 con 0x555f395d8960 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 0x555f395d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 0x555f395d8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43396/0 (socket says 172.21.15.35:43396) 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 -- 172.21.15.35:0/1903816884 learned_addr learned my addr 172.21.15.35:0/1903816884 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4782d9d700 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395d8960 0x555f395d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f478259c700 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 -- 172.21.15.35:0/1903816884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395d8960 msgr2=0x555f395d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395d8960 0x555f395d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 -- 172.21.15.35:0/1903816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 msgr2=0x555f395ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395ddfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 -- 172.21.15.35:0/1903816884 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f393ac5d0 con 0x555f395de4f0 2023-03-17T09:06:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4781d9b700 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 0x555f395d8420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f477800fce0 tx=0x7f4778012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f38d4827b667b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4770ff9700 1 -- 172.21.15.35:0/1903816884 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778011ad0 con 0x555f395de4f0 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4770ff9700 1 -- 172.21.15.35:0/1903816884 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4778011c30 con 0x555f395de4f0 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.327+0000 7f4770ff9700 1 -- 172.21.15.35:0/1903816884 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477801d5b0 con 0x555f395de4f0 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 -- 172.21.15.35:0/1903816884 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 msgr2=0x555f395d8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 0x555f395d8420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f477800fce0 tx=0x7f4778012000 comp rx=0 tx=0).stop 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 -- 172.21.15.35:0/1903816884 shutdown_connections 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395d8960 0x555f395d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 --2- 172.21.15.35:0/1903816884 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395de4f0 0x555f395d8420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 -- 172.21.15.35:0/1903816884 >> 172.21.15.35:0/1903816884 conn(0x555f394356b0 msgr2=0x555f395d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 -- 172.21.15.35:0/1903816884 shutdown_connections 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.328+0000 7f4794d51b80 1 -- 172.21.15.35:0/1903816884 wait complete. 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 -- start start 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 Processor -- start 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395e1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f393ae8c0 con 0x555f395d8960 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395e24d0 con 0x555f395ddbe0 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395ee030 con 0x555f395de4f0 2023-03-17T09:06:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4794d51b80 10 client.0 _ll_register_callbacks cb 0x555f393d0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:06:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f478259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f478259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43400/0 (socket says 172.21.15.35:43400) 2023-03-17T09:06:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f478259c700 1 -- 172.21.15.35:0/3128217292 learned_addr learned my addr 172.21.15.35:0/3128217292 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4782d9d700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.329+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:10.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f478259c700 1 -- 172.21.15.35:0/3128217292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 msgr2=0x555f395e1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f478259c700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395e1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f478259c700 1 -- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 msgr2=0x555f395e1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f478259c700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395e1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f478259c700 1 -- 172.21.15.35:0/3128217292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477800f990 con 0x555f395d8960 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4782d9d700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:06:10.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f478259c700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e4480 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4774095450 tx=0x7f4774005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f08f8292fcac15 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4769ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:06:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4769ffb700 1 -- 172.21.15.35:0/3128217292 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740b1210 con 0x555f395d8960 2023-03-17T09:06:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4769ffb700 1 -- 172.21.15.35:0/3128217292 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47740a10b0 con 0x555f395d8960 2023-03-17T09:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f394ed390 con 0x555f395d8960 2023-03-17T09:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4769ffb700 1 -- 172.21.15.35:0/3128217292 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47740a0c20 con 0x555f395d8960 2023-03-17T09:06:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 10 client.15852 fetch_fsmap learned FSMap version 29 2023-03-17T09:06:11.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555f39358d80 con 0x555f395d8960 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4769ffb700 1 -- 172.21.15.35:0/3128217292 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47740b5020 con 0x555f395d8960 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4769ffb700 1 -- 172.21.15.35:0/3128217292 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4774097eb0 con 0x555f395d8960 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 10 client.15852 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 20 client.15852 populate_metadata read hostname 'smithi035' 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f395f1dd0 0x555f395f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 4 client.15852 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.330+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f394f9600 con 0x555f395f1dd0 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.331+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f395f1dd0 0x555f395f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.331+0000 7f4769ffb700 10 client.15852 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.331+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f395f1dd0 0x555f395f41b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2cea52a0e7a76 server_cookie=d5fdd749c08e8562 in_seq=0 out_seq=0 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4769ffb700 1 -- 172.21.15.35:0/3128217292 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555f394f9600 con 0x555f395f1dd0 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4769ffb700 10 client.15852 handle_command_reply: tid=0 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 client.15852 shutdown 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 msgr2=0x555f395e4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e4480 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4774095450 tx=0x7f4774005760 comp rx=0 tx=0).stop 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 shutdown_connections 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f395f1dd0 0x555f395f41b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e4480 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4769ffb700 0 client.15852 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3128217292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395ddbe0 0x555f395e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 >> 172.21.15.35:0/3128217292 conn(0x555f394356b0 msgr2=0x555f395d7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 shutdown_connections 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 1 -- 172.21.15.35:0/3128217292 wait complete. 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.332+0000 7f4794d51b80 20 client.15852 trim_cache size 0 max 16384 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.347+0000 7f4794d51b80 1 Processor -- start 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 -- start start 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395d8960 0x555f395e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 0x555f395e4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395d87c0 con 0x555f395ddbe0 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395d36d0 con 0x555f395d8960 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4794d51b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395dd810 con 0x555f395de4f0 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 0x555f395e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 0x555f395e4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43410/0 (socket says 172.21.15.35:43410) 2023-03-17T09:06:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 -- 172.21.15.35:0/3807256078 learned_addr learned my addr 172.21.15.35:0/3807256078 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4782d9d700 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 -- 172.21.15.35:0/3807256078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 msgr2=0x555f395db6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395db6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f478259c700 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395d8960 0x555f395e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 -- 172.21.15.35:0/3807256078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395d8960 msgr2=0x555f395e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395d8960 0x555f395e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 -- 172.21.15.35:0/3807256078 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f394f1130 con 0x555f395ddbe0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4782d9d700 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 0x555f395e4020 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4778011720 tx=0x7f477800ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190eba264783ddfc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.348+0000 7f47717fa700 1 -- 172.21.15.35:0/3807256078 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477802e040 con 0x555f395ddbe0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f47717fa700 1 -- 172.21.15.35:0/3807256078 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47780333a0 con 0x555f395ddbe0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f47717fa700 1 -- 172.21.15.35:0/3807256078 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778005040 con 0x555f395ddbe0 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 -- 172.21.15.35:0/3807256078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 msgr2=0x555f395e4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 0x555f395e4020 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4778011720 tx=0x7f477800ba70 comp rx=0 tx=0).stop 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 -- 172.21.15.35:0/3807256078 shutdown_connections 2023-03-17T09:06:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395de4f0 0x555f395db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395d8960 0x555f395e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3807256078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395ddbe0 0x555f395e4020 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 -- 172.21.15.35:0/3807256078 >> 172.21.15.35:0/3807256078 conn(0x555f394356b0 msgr2=0x555f395ed710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 -- 172.21.15.35:0/3807256078 shutdown_connections 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 -- 172.21.15.35:0/3807256078 wait complete. 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.349+0000 7f4794d51b80 1 -- start start 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 Processor -- start 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395ddbe0 0x555f395e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395de4f0 0x555f395e7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395e7830 con 0x555f395d8960 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395e79a0 con 0x555f395de4f0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f395e7b60 con 0x555f395ddbe0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4794d51b80 10 client.0 _ll_register_callbacks cb 0x555f393d0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43414/0 (socket says 172.21.15.35:43414) 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 -- 172.21.15.35:0/3876727035 learned_addr learned my addr 172.21.15.35:0/3876727035 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395ddbe0 0x555f395e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4782d9d700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395de4f0 0x555f395e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 -- 172.21.15.35:0/3876727035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395ddbe0 msgr2=0x555f395e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395ddbe0 0x555f395e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 -- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395de4f0 msgr2=0x555f395e7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395de4f0 0x555f395e7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f478259c700 1 -- 172.21.15.35:0/3876727035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f393ac5d0 con 0x555f395d8960 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.350+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395ddbe0 0x555f395e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f478259c700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e8c70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f47740972a0 tx=0x7f4774098380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f822bf3201e5ab1d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4769ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4769ffb700 1 -- 172.21.15.35:0/3876727035 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740b1210 con 0x555f395d8960 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4769ffb700 1 -- 172.21.15.35:0/3876727035 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47740b6080 con 0x555f395d8960 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f395a81e0 con 0x555f395d8960 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4769ffb700 1 -- 172.21.15.35:0/3876727035 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47740a10b0 con 0x555f395d8960 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 10 client.15858 fetch_fsmap learned FSMap version 29 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555f3937f1f0 con 0x555f395d8960 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4769ffb700 1 -- 172.21.15.35:0/3876727035 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f395a81e0 con 0x555f395d8960 2023-03-17T09:06:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4769ffb700 1 -- 172.21.15.35:0/3876727035 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4774094eb0 con 0x555f395d8960 2023-03-17T09:06:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:06:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:06:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 20 client.15858 populate_metadata read hostname 'smithi035' 2023-03-17T09:06:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f39646990 0x555f39648d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 4 client.15858 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:06:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.351+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555f393aef00 con 0x555f39646990 2023-03-17T09:06:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.352+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f39646990 0x555f39648d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.352+0000 7f4781d9b700 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f39646990 0x555f39648d70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910dcd0d7ded8ebc server_cookie=3f1c7775cf5d318 in_seq=0 out_seq=0 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.352+0000 7f4769ffb700 10 client.15858 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4769ffb700 1 -- 172.21.15.35:0/3876727035 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555f393aef00 con 0x555f39646990 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4769ffb700 10 client.15858 handle_command_reply: tid=0 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 client.15858 shutdown 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 msgr2=0x555f395e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e8c70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f47740972a0 tx=0x7f4774098380 comp rx=0 tx=0).stop 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 shutdown_connections 2023-03-17T09:06:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f39646990 0x555f39648d70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f395de4f0 0x555f395e7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f395d8960 0x555f395e8c70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 --2- 172.21.15.35:0/3876727035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f395ddbe0 0x555f395e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 >> 172.21.15.35:0/3876727035 conn(0x555f394356b0 msgr2=0x555f395db6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4769ffb700 0 client.15858 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 shutdown_connections 2023-03-17T09:06:18.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 1 -- 172.21.15.35:0/3876727035 wait complete. 2023-03-17T09:06:18.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.356+0000 7f4794d51b80 20 client.15858 trim_cache size 0 max 16384 2023-03-17T09:06:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:06:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:06:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:06:18.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:06:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f476c09f640 msgr2=0x7f476c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:18.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f476c09f640 0x7f476c0a1af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4778005950 tx=0x7f47780058e0 comp rx=0 tx=0).stop 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 msgr2=0x7f4784198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 0x7f4784198540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4774009fd0 tx=0x7f477400f690 comp rx=0 tx=0).stop 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 shutdown_connections 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f476c09f640 0x7f476c0a1af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4784104390 0x7f478419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47840ff350 0x7f4784198540 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 --2- 172.21.15.35:0/4076421407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840ffcf0 0x7f4784198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 >> 172.21.15.35:0/4076421407 conn(0x7f4784076330 msgr2=0x7f47840fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 shutdown_connections 2023-03-17T09:06:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:24.357+0000 7f4788bc4700 1 -- 172.21.15.35:0/4076421407 wait complete. 2023-03-17T09:06:21.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:24 smithi035 ceph-mon[92535]: pgmap v380: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:06:22.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:26 smithi035 ceph-mon[92535]: pgmap v381: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:06:22.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:28 smithi035 ceph-mon[92535]: pgmap v382: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:22.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:30 smithi035 ceph-mon[92535]: pgmap v383: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:22.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:32 smithi035 ceph-mon[92535]: pgmap v384: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:24.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:34 smithi035 ceph-mon[92535]: pgmap v385: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:24.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:36 smithi035 ceph-mon[92535]: pgmap v386: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:24.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:04 smithi078 ceph-mon[94114]: pgmap v624: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:06:24.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:06 smithi078 ceph-mon[94114]: pgmap v625: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:08 smithi078 ceph-mon[94114]: pgmap v626: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:09 smithi078 ceph-mon[94114]: osdmap e113: 12 total, 12 up, 12 in 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:10 smithi078 ceph-mon[94114]: pgmap v628: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:12 smithi078 ceph-mon[94114]: pgmap v629: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:14 smithi078 ceph-mon[94114]: pgmap v630: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:16 smithi078 ceph-mon[94114]: osdmap e114: 12 total, 12 up, 12 in 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:16 smithi078 ceph-mon[94114]: pgmap v632: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:18 smithi078 ceph-mon[94114]: pgmap v633: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:06:24.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:20 smithi078 ceph-mon[94114]: pgmap v634: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:06:26.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:22 smithi078 ceph-mon[94114]: pgmap v635: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:06:26.434 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:04 smithi082 ceph-mon[94281]: pgmap v624: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:06:26.434 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:06 smithi082 ceph-mon[94281]: pgmap v625: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:06:26.434 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:08 smithi082 ceph-mon[94281]: pgmap v626: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:06:26.434 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:09 smithi082 ceph-mon[94281]: osdmap e113: 12 total, 12 up, 12 in 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:10 smithi082 ceph-mon[94281]: pgmap v628: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:12 smithi082 ceph-mon[94281]: pgmap v629: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:14 smithi082 ceph-mon[94281]: pgmap v630: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:16 smithi082 ceph-mon[94281]: osdmap e114: 12 total, 12 up, 12 in 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:16 smithi082 ceph-mon[94281]: pgmap v632: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:18 smithi082 ceph-mon[94281]: pgmap v633: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:20 smithi082 ceph-mon[94281]: pgmap v634: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:06:26.435 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:22 smithi082 ceph-mon[94281]: pgmap v635: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:06:26.437 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:24 smithi082 ceph-mon[94281]: pgmap v636: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:06:27.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:24 smithi078 ceph-mon[94114]: pgmap v636: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:06:27.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:26 smithi082 ceph-mon[94281]: pgmap v637: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:06:27.636 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:26 smithi078 ceph-mon[94114]: pgmap v637: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:06:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 -- 172.21.15.35:0/75947298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 msgr2=0x7f5500104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 --2- 172.21.15.35:0/75947298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500104e10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0099c0 tx=0x7f54ec009cd0 comp rx=0 tx=0).stop 2023-03-17T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 -- 172.21.15.35:0/75947298 shutdown_connections 2023-03-17T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 --2- 172.21.15.35:0/75947298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 0x7f550010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 --2- 172.21.15.35:0/75947298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 0x7f5500100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 --2- 172.21.15.35:0/75947298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500104e10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 -- 172.21.15.35:0/75947298 >> 172.21.15.35:0/75947298 conn(0x7f55000774b0 msgr2=0x7f55000778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 -- 172.21.15.35:0/75947298 shutdown_connections 2023-03-17T09:06:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.471+0000 7f550709f700 1 -- 172.21.15.35:0/75947298 wait complete. 2023-03-17T09:06:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 Processor -- start 2023-03-17T09:06:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 -- start start 2023-03-17T09:06:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 0x7f5500196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 0x7f550019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550019b230 con 0x7f5500101580 2023-03-17T09:06:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550019b3a0 con 0x7f5500100be0 2023-03-17T09:06:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.472+0000 7f550709f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550019b560 con 0x7f55001054f0 2023-03-17T09:06:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f5504e3b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 0x7f5500196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43430/0 (socket says 172.21.15.35:43430) 2023-03-17T09:06:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 -- 172.21.15.35:0/2035332054 learned_addr learned my addr 172.21.15.35:0/2035332054 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f550563c700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 0x7f550019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 -- 172.21.15.35:0/2035332054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 msgr2=0x7f550019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 0x7f550019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:32.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 -- 172.21.15.35:0/2035332054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 msgr2=0x7f5500196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:32.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 0x7f5500196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:32.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 -- 172.21.15.35:0/2035332054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0095f0 con 0x7f5500101580 2023-03-17T09:06:32.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f550563c700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 0x7f550019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:06:32.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 0x7f5500196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:06:32.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fffff700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500196790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009fd0 tx=0x7f54ec00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fdffb700 1 -- 172.21.15.35:0/2035332054 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec01d070 con 0x7f5500101580 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fdffb700 1 -- 172.21.15.35:0/2035332054 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54ec0059a0 con 0x7f5500101580 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500110140 con 0x7f5500101580 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f54fdffb700 1 -- 172.21.15.35:0/2035332054 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec022e90 con 0x7f5500101580 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.473+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550010ffb0 con 0x7f5500101580 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.476+0000 7f54fdffb700 1 -- 172.21.15.35:0/2035332054 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f54ec022470 con 0x7f5500101580 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.477+0000 7f54fdffb700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54f009f6c0 0x7f54f00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.477+0000 7f54fdffb700 1 -- 172.21.15.35:0/2035332054 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f54ec0cb5b0 con 0x7f5500101580 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.477+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54f009f6c0 0x7f54f00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.477+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54f009f6c0 0x7f54f00a1b70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54f4011490 tx=0x7f54f4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 Processor -- start 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 -- start start 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002890a20 0x55b002890df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002894c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002895170 0x55b0028955c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002793010 con 0x55b002891330 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0027e5950 con 0x55b002895170 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f551322cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0027dede0 con 0x55b002890a20 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002894c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f550563c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002895170 0x55b0028955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002894c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43438/0 (socket says 172.21.15.35:43438) 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 -- 172.21.15.35:0/1462434052 learned_addr learned my addr 172.21.15.35:0/1462434052 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f5504e3b700 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002890a20 0x55b002890df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 -- 172.21.15.35:0/1462434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002890a20 msgr2=0x55b002890df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002890a20 0x55b002890df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 -- 172.21.15.35:0/1462434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002895170 msgr2=0x55b0028955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002895170 0x55b0028955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f54fffff700 1 -- 172.21.15.35:0/1462434052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0026605d0 con 0x55b002891330 2023-03-17T09:06:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.478+0000 7f550563c700 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002895170 0x55b0028955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:06:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f54fffff700 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002894c30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f54ec095b00 tx=0x7f54ec094d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3d5c629006d005 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f54eaffd700 1 -- 172.21.15.35:0/1462434052 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0b0070 con 0x55b002891330 2023-03-17T09:06:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f54eaffd700 1 -- 172.21.15.35:0/1462434052 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54ec099090 con 0x55b002891330 2023-03-17T09:06:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f54eaffd700 1 -- 172.21.15.35:0/1462434052 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec022720 con 0x55b002891330 2023-03-17T09:06:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 -- 172.21.15.35:0/1462434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 msgr2=0x55b002894c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002894c30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f54ec095b00 tx=0x7f54ec094d30 comp rx=0 tx=0).stop 2023-03-17T09:06:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 -- 172.21.15.35:0/1462434052 shutdown_connections 2023-03-17T09:06:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002895170 0x55b0028955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002890a20 0x55b002890df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 --2- 172.21.15.35:0/1462434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002894c30 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.479+0000 7f551322cb80 1 -- 172.21.15.35:0/1462434052 >> 172.21.15.35:0/1462434052 conn(0x55b0026e96b0 msgr2=0x55b002886a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:37.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 -- 172.21.15.35:0/1462434052 shutdown_connections 2023-03-17T09:06:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 -- 172.21.15.35:0/1462434052 wait complete. 2023-03-17T09:06:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 -- start start 2023-03-17T09:06:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 Processor -- start 2023-03-17T09:06:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002899bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b00289a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0026628c0 con 0x55b002891330 2023-03-17T09:06:38.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b00289aa80 con 0x55b002890a20 2023-03-17T09:06:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0028a60d0 con 0x55b002895170 2023-03-17T09:06:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f551322cb80 10 client.0 _ll_register_callbacks cb 0x55b002684230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:06:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f54fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002899bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.480+0000 7f54fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002899bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43444/0 (socket says 172.21.15.35:43444) 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 -- 172.21.15.35:0/2400217663 learned_addr learned my addr 172.21.15.35:0/2400217663 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f550563c700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b00289a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 -- 172.21.15.35:0/2400217663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 msgr2=0x55b00289a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b00289a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 -- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 msgr2=0x55b00289c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 -- 172.21.15.35:0/2400217663 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550010ffb0 con 0x55b002891330 2023-03-17T09:06:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:06:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54fffff700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002899bd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f54ec099020 tx=0x7f54ec099680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baca83ada013d48 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54dffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:06:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54dffff700 1 -- 172.21.15.35:0/2400217663 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0b0070 con 0x55b002891330 2023-03-17T09:06:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54dffff700 1 -- 172.21.15.35:0/2400217663 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f54ec022720 con 0x55b002891330 2023-03-17T09:06:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0027a1390 con 0x55b002891330 2023-03-17T09:06:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54dffff700 1 -- 172.21.15.35:0/2400217663 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54ec0b1250 con 0x55b002891330 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f551322cb80 10 client.15870 fetch_fsmap learned FSMap version 29 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b00260cd80 con 0x55b002891330 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.481+0000 7f54dffff700 1 -- 172.21.15.35:0/2400217663 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b0027a1390 con 0x55b002891330 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f54dffff700 1 -- 172.21.15.35:0/2400217663 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f54ec0a0d60 con 0x55b002891330 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f551322cb80 10 client.15870 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f551322cb80 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f551322cb80 20 client.15870 populate_metadata read hostname 'smithi035' 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f551322cb80 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028a9d40 0x55b0028ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f551322cb80 4 client.15870 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0027ad600 con 0x55b0028a9d40 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028a9d40 0x55b0028ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028a9d40 0x55b0028ac120 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b87c91151242797f server_cookie=4457315a5f769eb6 in_seq=0 out_seq=0 2023-03-17T09:06:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.482+0000 7f54dffff700 10 client.15870 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f54dffff700 1 -- 172.21.15.35:0/2400217663 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b0027ad600 con 0x55b0028a9d40 2023-03-17T09:06:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f54dffff700 10 client.15870 handle_command_reply: tid=0 2023-03-17T09:06:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 client.15870 shutdown 2023-03-17T09:06:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 msgr2=0x55b002899bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002899bd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f54ec099020 tx=0x7f54ec099680 comp rx=0 tx=0).stop 2023-03-17T09:06:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 shutdown_connections 2023-03-17T09:06:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028a9d40 0x55b0028ac120 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b00289a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f54dffff700 0 client.15870 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 --2- 172.21.15.35:0/2400217663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002891330 0x55b002899bd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 >> 172.21.15.35:0/2400217663 conn(0x55b0026e96b0 msgr2=0x55b00288b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 shutdown_connections 2023-03-17T09:06:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 1 -- 172.21.15.35:0/2400217663 wait complete. 2023-03-17T09:06:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.483+0000 7f551322cb80 20 client.15870 trim_cache size 0 max 16384 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 Processor -- start 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 -- start start 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 0x55b002893b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002891330 0x55b002886ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b0028a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0027a1390 con 0x55b002890a20 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0028820f0 con 0x55b002891330 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f551322cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002887000 con 0x55b002895170 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f5504e3b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 0x55b002893b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f5504e3b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 0x55b002893b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43450/0 (socket says 172.21.15.35:43450) 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.498+0000 7f5504e3b700 1 -- 172.21.15.35:0/2695617799 learned_addr learned my addr 172.21.15.35:0/2695617799 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f54fffff700 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002891330 0x55b002886ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f550563c700 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b0028a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f5504e3b700 1 -- 172.21.15.35:0/2695617799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 msgr2=0x55b0028a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b0028a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f5504e3b700 1 -- 172.21.15.35:0/2695617799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002891330 msgr2=0x55b002886ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002891330 0x55b002886ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f5504e3b700 1 -- 172.21.15.35:0/2695617799 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0027a5130 con 0x55b002890a20 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f550563c700 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b0028a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 0x55b002893b30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f54f4004330 tx=0x7f54f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdbc66f6c132f88 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f54eb7fe700 1 -- 172.21.15.35:0/2695617799 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4024040 con 0x55b002890a20 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f54eb7fe700 1 -- 172.21.15.35:0/2695617799 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54f4003b10 con 0x55b002890a20 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.499+0000 7f54eb7fe700 1 -- 172.21.15.35:0/2695617799 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f401e8c0 con 0x55b002890a20 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- 172.21.15.35:0/2695617799 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 msgr2=0x55b002893b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 0x55b002893b30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f54f4004330 tx=0x7f54f4014000 comp rx=0 tx=0).stop 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- 172.21.15.35:0/2695617799 shutdown_connections 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002895170 0x55b0028a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002890a20 0x55b002893b30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- 172.21.15.35:0/2695617799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002891330 0x55b002886ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- 172.21.15.35:0/2695617799 >> 172.21.15.35:0/2695617799 conn(0x55b0026e96b0 msgr2=0x55b002895540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- 172.21.15.35:0/2695617799 shutdown_connections 2023-03-17T09:06:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- 172.21.15.35:0/2695617799 wait complete. 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- start start 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 Processor -- start 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002891330 0x55b00289f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002895170 0x55b0028f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0028f7100 con 0x55b002895170 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0028f7270 con 0x55b002890a20 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.500+0000 7f551322cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0028f7430 con 0x55b002891330 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f551322cb80 10 client.0 _ll_register_callbacks cb 0x55b002684230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f550563c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002895170 0x55b0028f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:45252/0 (socket says 172.21.15.35:45252) 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 -- 172.21.15.35:0/2215907728 learned_addr learned my addr 172.21.15.35:0/2215907728 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f54fffff700 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002891330 0x55b00289f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 -- 172.21.15.35:0/2215907728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002891330 msgr2=0x55b00289f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002891330 0x55b00289f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 -- 172.21.15.35:0/2215907728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002895170 msgr2=0x55b0028f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002895170 0x55b0028f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 -- 172.21.15.35:0/2215907728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f4017070 con 0x55b002890a20 2023-03-17T09:06:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f5504e3b700 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289f270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54f40046b0 tx=0x7f54f40057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d53bf6a358327 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:06:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f54dffff700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:06:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f54dffff700 1 -- 172.21.15.35:0/2215907728 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4024040 con 0x55b002890a20 2023-03-17T09:06:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b00285c1e0 con 0x55b002890a20 2023-03-17T09:06:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f54dffff700 1 -- 172.21.15.35:0/2215907728 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f54f4003880 con 0x55b002890a20 2023-03-17T09:06:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f54dffff700 1 -- 172.21.15.35:0/2215907728 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54f4003e90 con 0x55b002890a20 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f551322cb80 10 client.25526 fetch_fsmap learned FSMap version 29 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.501+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b0026331f0 con 0x55b002890a20 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f54dffff700 1 -- 172.21.15.35:0/2215907728 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b00285c1e0 con 0x55b002890a20 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f54dffff700 1 -- 172.21.15.35:0/2215907728 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f54f401e3f0 con 0x55b002890a20 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f551322cb80 10 client.25526 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f551322cb80 10 client.25526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f551322cb80 20 client.25526 populate_metadata read hostname 'smithi035' 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f551322cb80 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028feb90 0x55b002900fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:06:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f551322cb80 4 client.25526 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:06:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b002662f00 con 0x55b0028feb90 2023-03-17T09:06:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f54fffff700 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028feb90 0x55b002900fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:06:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f54dffff700 10 client.25526 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.502+0000 7f54fffff700 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028feb90 0x55b002900fa0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd26c622249c0ec0 server_cookie=bf7a1ced561cb6c0 in_seq=0 out_seq=0 2023-03-17T09:06:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f54dffff700 1 -- 172.21.15.35:0/2215907728 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b002662f00 con 0x55b0028feb90 2023-03-17T09:06:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f54dffff700 10 client.25526 handle_command_reply: tid=0 2023-03-17T09:06:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 client.25526 shutdown 2023-03-17T09:06:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 msgr2=0x55b00289f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289f270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54f40046b0 tx=0x7f54f40057b0 comp rx=0 tx=0).stop 2023-03-17T09:06:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 shutdown_connections 2023-03-17T09:06:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b0028feb90 0x55b002900fa0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b002895170 0x55b0028f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b002890a20 0x55b00289f270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f54dffff700 0 client.25526 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 --2- 172.21.15.35:0/2215907728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b002891330 0x55b00289f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.505+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 >> 172.21.15.35:0/2215907728 conn(0x55b0026e96b0 msgr2=0x55b002894420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 shutdown_connections 2023-03-17T09:06:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f551322cb80 1 -- 172.21.15.35:0/2215907728 wait complete. 2023-03-17T09:06:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f551322cb80 20 client.25526 trim_cache size 0 max 16384 2023-03-17T09:06:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:06:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:06:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:06:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:06:56.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54f009f6c0 msgr2=0x7f54f00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:56.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54f009f6c0 0x7f54f00a1b70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54f4011490 tx=0x7f54f4009260 comp rx=0 tx=0).stop 2023-03-17T09:06:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 msgr2=0x7f5500196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:06:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500196790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009fd0 tx=0x7f54ec00f690 comp rx=0 tx=0).stop 2023-03-17T09:06:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 shutdown_connections 2023-03-17T09:06:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54f009f6c0 0x7f54f00a1b70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55001054f0 0x7f550019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:56.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5500100be0 0x7f5500196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 --2- 172.21.15.35:0/2035332054 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5500101580 0x7f5500196790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:06:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 >> 172.21.15.35:0/2035332054 conn(0x7f55000774b0 msgr2=0x7f5500100260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:06:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 shutdown_connections 2023-03-17T09:06:57.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:37.506+0000 7f550709f700 1 -- 172.21.15.35:0/2035332054 wait complete. 2023-03-17T09:06:57.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:38 smithi035 ceph-mon[92535]: pgmap v387: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:57.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:06:57.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:40 smithi035 ceph-mon[92535]: pgmap v388: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:42 smithi035 ceph-mon[92535]: pgmap v389: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:44 smithi035 ceph-mon[92535]: pgmap v390: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:57.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:46 smithi035 ceph-mon[92535]: pgmap v391: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:58.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:48 smithi035 ceph-mon[92535]: pgmap v392: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:58.540 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:50 smithi035 ceph-mon[92535]: pgmap v393: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:58.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:28 smithi078 ceph-mon[94114]: pgmap v638: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:59.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:30 smithi078 ceph-mon[94114]: pgmap v639: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:59.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:32 smithi078 ceph-mon[94114]: pgmap v640: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:34 smithi078 ceph-mon[94114]: pgmap v641: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:36 smithi078 ceph-mon[94114]: pgmap v642: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:38 smithi078 ceph-mon[94114]: pgmap v643: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:40 smithi078 ceph-mon[94114]: pgmap v644: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:42 smithi078 ceph-mon[94114]: pgmap v645: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:44 smithi078 ceph-mon[94114]: pgmap v646: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:59.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:46 smithi078 ceph-mon[94114]: pgmap v647: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: pgmap v648: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:06:59.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:00.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:00.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.581 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.581 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:00.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:50 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:07:01.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:50 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:07:01.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:50 smithi078 ceph-mon[94114]: pgmap v649: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:01.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:52 smithi078 ceph-mon[94114]: pgmap v650: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:01.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:54 smithi078 ceph-mon[94114]: pgmap v651: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:01.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:56 smithi078 ceph-mon[94114]: pgmap v652: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:01.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:06:58 smithi078 ceph-mon[94114]: pgmap v653: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:01.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:28 smithi082 ceph-mon[94281]: pgmap v638: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:01.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:30 smithi082 ceph-mon[94281]: pgmap v639: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:01.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:32 smithi082 ceph-mon[94281]: pgmap v640: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:01.943 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:34 smithi082 ceph-mon[94281]: pgmap v641: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:01.943 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:36 smithi082 ceph-mon[94281]: pgmap v642: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:01.943 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:38 smithi082 ceph-mon[94281]: pgmap v643: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:07:01.943 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:40 smithi082 ceph-mon[94281]: pgmap v644: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:01.943 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:42 smithi082 ceph-mon[94281]: pgmap v645: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:02.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:44 smithi082 ceph-mon[94281]: pgmap v646: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:02.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:07:02.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:02.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:02.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:46 smithi082 ceph-mon[94281]: pgmap v647: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:02.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: pgmap v648: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:02.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:02.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:07:04.592 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:07:05.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:07:05.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:05.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:05.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:05.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:50 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:50 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:50 smithi082 ceph-mon[94281]: pgmap v649: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:52 smithi082 ceph-mon[94281]: pgmap v650: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:54 smithi082 ceph-mon[94281]: pgmap v651: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:56 smithi082 ceph-mon[94281]: pgmap v652: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:06.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:06:58 smithi082 ceph-mon[94281]: pgmap v653: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:06.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:00 smithi078 ceph-mon[94114]: pgmap v654: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:06.956 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:02 smithi078 ceph-mon[94114]: pgmap v655: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:08.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:00 smithi082 ceph-mon[94281]: pgmap v654: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:08.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:02 smithi082 ceph-mon[94281]: pgmap v655: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:04 smithi082 ceph-mon[94281]: pgmap v656: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:04 smithi082 ceph-mon[94281]: osdmap e115: 12 total, 12 up, 12 in 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:06 smithi082 ceph-mon[94281]: pgmap v658: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: in thread 7f81f08b3700 thread_name:md_log_replay 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:07:08.387 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f820145dcf0] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x559cacfdf702] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x559cacfe1953] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 4: (MDLog::_replay_thread()+0x66d) [0x559cad04d07d] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 5: (MDLog::ReplayThread::entry()+0x11) [0x559cacd00d91] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f82014531ca] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 7: clone() 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:03.330+0000 7f81f08b3700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: in thread 7f81f08b3700 thread_name:md_log_replay 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f820145dcf0] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x559cacfdf702] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x559cacfe1953] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 4: (MDLog::_replay_thread()+0x66d) [0x559cad04d07d] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 5: (MDLog::ReplayThread::entry()+0x11) [0x559cacd00d91] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f82014531ca] 2023-03-17T09:07:08.388 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 7: clone() 2023-03-17T09:07:08.389 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:07:08.389 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:08.389 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 0> 2023-03-17T09:07:03.330+0000 7f81f08b3700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:07:08.389 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: in thread 7f81f08b3700 thread_name:md_log_replay 2023-03-17T09:07:08.389 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:08.389 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:07:10.240 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f820145dcf0] 2023-03-17T09:07:10.240 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x559cacfdf702] 2023-03-17T09:07:10.240 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x559cacfe1953] 2023-03-17T09:07:10.240 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 4: (MDLog::_replay_thread()+0x66d) [0x559cad04d07d] 2023-03-17T09:07:10.240 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 5: (MDLog::ReplayThread::entry()+0x11) [0x559cacd00d91] 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f82014531ca] 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 7: clone() 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 0> 2023-03-17T09:07:03.330+0000 7f81f08b3700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: in thread 7f81f08b3700 thread_name:md_log_replay 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:11.228 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:07:11.229 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f820145dcf0] 2023-03-17T09:07:11.229 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x559cacfdf702] 2023-03-17T09:07:11.638 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x559cacfe1953] 2023-03-17T09:07:11.638 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 4: (MDLog::_replay_thread()+0x66d) [0x559cad04d07d] 2023-03-17T09:07:11.639 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 5: (MDLog::ReplayThread::entry()+0x11) [0x559cacd00d91] 2023-03-17T09:07:11.639 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f82014531ca] 2023-03-17T09:07:12.662 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 7: clone() 2023-03-17T09:07:12.662 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:07:12.662 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134056]: 2023-03-17T09:07:12.662 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:07:12.663 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:07:12.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:04 smithi078 ceph-mon[94114]: pgmap v656: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:07:12.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:04 smithi078 ceph-mon[94114]: osdmap e115: 12 total, 12 up, 12 in 2023-03-17T09:07:12.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:06 smithi078 ceph-mon[94114]: pgmap v658: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:07:12.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:08 smithi078 ceph-mon[94114]: pgmap v659: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:07:12.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:10 smithi078 ceph-mon[94114]: pgmap v660: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:07:12.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:10 smithi078 ceph-mon[94114]: osdmap e116: 12 total, 12 up, 12 in 2023-03-17T09:07:12.665 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:08 smithi082 ceph-mon[94281]: pgmap v659: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:07:12.665 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:10 smithi082 ceph-mon[94281]: pgmap v660: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:07:13.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:10 smithi082 ceph-mon[94281]: osdmap e116: 12 total, 12 up, 12 in 2023-03-17T09:07:13.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:12 smithi082 ceph-mon[94281]: pgmap v662: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:07:13.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:12 smithi078 ceph-mon[94114]: pgmap v662: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:07:15.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:14 smithi082 ceph-mon[94281]: pgmap v663: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 412 B/s wr, 9 op/s 2023-03-17T09:07:15.021 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:13 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:07:15.021 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:13 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Scheduled restart job, restart counter is at 3. 2023-03-17T09:07:15.021 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:13 smithi078 systemd[1]: Stopped Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:07:15.021 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:13 smithi078 systemd[1]: Starting Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T09:07:15.022 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:14 smithi078 ceph-mon[94114]: pgmap v663: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 412 B/s wr, 9 op/s 2023-03-17T09:07:15.022 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:14 smithi078 podman[134946]: 2023-03-17T09:07:16.165 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:14 smithi078 ceph-mds[134986]: -- 172.21.15.78:0/2530316343 <== mon.2 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56309caa6b60 con 0x56309ca7d000 2023-03-17T09:07:16.165 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:14 smithi078 bash[134946]: 3e0c6cec8941cac5f7f4b26a2f83e4b274c466b698870cfa5c4976c2d0910194 2023-03-17T09:07:16.166 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:14 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: starting mds.e at 2023-03-17T09:07:16.166 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:07:14 smithi078 systemd[1]: Started Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:07:16.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:15 smithi082 ceph-mon[94281]: daemon mds.e restarted 2023-03-17T09:07:16.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:15 smithi082 ceph-mon[94281]: osdmap e117: 12 total, 12 up, 12 in 2023-03-17T09:07:16.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6834/2101384039,v1:172.21.15.78:6835/2101384039] up:boot 2023-03-17T09:07:16.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:07:16.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:07:17.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:15 smithi078 ceph-mon[94114]: daemon mds.e restarted 2023-03-17T09:07:17.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:15 smithi078 ceph-mon[94114]: osdmap e117: 12 total, 12 up, 12 in 2023-03-17T09:07:17.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6834/2101384039,v1:172.21.15.78:6835/2101384039] up:boot 2023-03-17T09:07:18.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:07:18.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:07:18.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:16 smithi082 ceph-mon[94281]: pgmap v665: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:07:20.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:16 smithi078 ceph-mon[94114]: pgmap v665: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:07:20.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 -- 172.21.15.35:0/2440899771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ffd60 msgr2=0x7f269c103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:20.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 --2- 172.21.15.35:0/2440899771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ffd60 0x7f269c103d20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f26900099c0 tx=0x7f2690009cd0 comp rx=0 tx=0).stop 2023-03-17T09:07:20.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 -- 172.21.15.35:0/2440899771 shutdown_connections 2023-03-17T09:07:20.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 --2- 172.21.15.35:0/2440899771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f269c104400 0x7f269c10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:20.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 --2- 172.21.15.35:0/2440899771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c0ff3c0 0x7f269c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 --2- 172.21.15.35:0/2440899771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ffd60 0x7f269c103d20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 -- 172.21.15.35:0/2440899771 >> 172.21.15.35:0/2440899771 conn(0x7f269c076300 msgr2=0x7f269c076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 -- 172.21.15.35:0/2440899771 shutdown_connections 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.628+0000 7f26a29d0700 1 -- 172.21.15.35:0/2440899771 wait complete. 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 Processor -- start 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 -- start start 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 0x7f269c100dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f269c0ffd60 0x7f269c101300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c104400 0x7f269c1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c101b30 con 0x7f269c0ff3c0 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1a4970 con 0x7f269c104400 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.629+0000 7f26a29d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c1a4ab0 con 0x7f269c0ffd60 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 0x7f269c100dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 0x7f269c100dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43470/0 (socket says 172.21.15.35:43470) 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 -- 172.21.15.35:0/716751254 learned_addr learned my addr 172.21.15.35:0/716751254 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269b7fe700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f269c0ffd60 0x7f269c101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:20.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c104400 0x7f269c1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:20.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 -- 172.21.15.35:0/716751254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f269c0ffd60 msgr2=0x7f269c101300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:20.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f269c0ffd60 0x7f269c101300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:20.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 -- 172.21.15.35:0/716751254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c104400 msgr2=0x7f269c1a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c104400 0x7f269c1a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 -- 172.21.15.35:0/716751254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900095f0 con 0x7f269c0ff3c0 2023-03-17T09:07:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f269bfff700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 0x7f269c100dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f268c00d950 tx=0x7f268c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:07:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f26997fa700 1 -- 172.21.15.35:0/716751254 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c009940 con 0x7f269c0ff3c0 2023-03-17T09:07:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c10f030 con 0x7f269c0ff3c0 2023-03-17T09:07:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f26997fa700 1 -- 172.21.15.35:0/716751254 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f268c010460 con 0x7f269c0ff3c0 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f26997fa700 1 -- 172.21.15.35:0/716751254 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c00f620 con 0x7f269c0ff3c0 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.630+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c10eea0 con 0x7f269c0ff3c0 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.633+0000 7f26997fa700 1 -- 172.21.15.35:0/716751254 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f268c0105d0 con 0x7f269c0ff3c0 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.633+0000 7f26997fa700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f268409f640 0x7f26840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.634+0000 7f269b7fe700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f268409f640 0x7f26840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.634+0000 7f26997fa700 1 -- 172.21.15.35:0/716751254 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f268c0ca440 con 0x7f269c0ff3c0 2023-03-17T09:07:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.634+0000 7f269b7fe700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f268409f640 0x7f26840a1af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2690000c00 tx=0x7f269000b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:07:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.634+0000 7f26aeb5db80 1 Processor -- start 2023-03-17T09:07:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.634+0000 7f26aeb5db80 1 -- start start 2023-03-17T09:07:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d272fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d2734f0 0x555d3d26d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d26dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d174010 con 0x555d3d272be0 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d1c6950 con 0x555d3d2734f0 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d1bfde0 con 0x555d3d26d960 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d272fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d272fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43478/0 (socket says 172.21.15.35:43478) 2023-03-17T09:07:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 -- 172.21.15.35:0/1783430669 learned_addr learned my addr 172.21.15.35:0/1783430669 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d26dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269b7fe700 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d2734f0 0x555d3d26d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 -- 172.21.15.35:0/1783430669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 msgr2=0x555d3d26dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d26dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 -- 172.21.15.35:0/1783430669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d2734f0 msgr2=0x555d3d26d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d2734f0 0x555d3d26d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 -- 172.21.15.35:0/1783430669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d3d0415d0 con 0x555d3d272be0 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d26dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f269bfff700 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d272fb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f268c097e80 tx=0x7f268c0978d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a179648d4b8dea94 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26827fc700 1 -- 172.21.15.35:0/1783430669 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0a00e0 con 0x555d3d272be0 2023-03-17T09:07:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26827fc700 1 -- 172.21.15.35:0/1783430669 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f268c096290 con 0x555d3d272be0 2023-03-17T09:07:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.635+0000 7f26827fc700 1 -- 172.21.15.35:0/1783430669 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c09fc50 con 0x555d3d272be0 2023-03-17T09:07:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 -- 172.21.15.35:0/1783430669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 msgr2=0x555d3d272fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d272fb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f268c097e80 tx=0x7f268c0978d0 comp rx=0 tx=0).stop 2023-03-17T09:07:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 -- 172.21.15.35:0/1783430669 shutdown_connections 2023-03-17T09:07:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d26dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d272fb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/1783430669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d2734f0 0x555d3d26d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 -- 172.21.15.35:0/1783430669 >> 172.21.15.35:0/1783430669 conn(0x555d3d0ca6b0 msgr2=0x555d3d267a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:07:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 -- 172.21.15.35:0/1783430669 shutdown_connections 2023-03-17T09:07:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 -- 172.21.15.35:0/1783430669 wait complete. 2023-03-17T09:07:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.636+0000 7f26aeb5db80 1 -- start start 2023-03-17T09:07:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 Processor -- start 2023-03-17T09:07:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d26d960 0x555d3d2794c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d276740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d276e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d0438c0 con 0x555d3d272be0 2023-03-17T09:07:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d2775f0 con 0x555d3d26d960 2023-03-17T09:07:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d283030 con 0x555d3d2734f0 2023-03-17T09:07:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26aeb5db80 10 client.0 _ll_register_callbacks cb 0x555d3d065230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:07:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f269b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d276740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f269b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d276740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43486/0 (socket says 172.21.15.35:43486) 2023-03-17T09:07:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f269b7fe700 1 -- 172.21.15.35:0/2137675434 learned_addr learned my addr 172.21.15.35:0/2137675434 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:07:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f269bfff700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d26d960 0x555d3d2794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.637+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d276e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f269b7fe700 1 -- 172.21.15.35:0/2137675434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 msgr2=0x555d3d276e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:30.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f269b7fe700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d276e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f269b7fe700 1 -- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d26d960 msgr2=0x555d3d2794c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f269b7fe700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d26d960 0x555d3d2794c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f269b7fe700 1 -- 172.21.15.35:0/2137675434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c10eea0 con 0x555d3d272be0 2023-03-17T09:07:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d276e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:07:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f269b7fe700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d276740 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f269c100130 tx=0x7f2690009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7cf867f93f7326 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:07:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f267b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f267b7fe700 1 -- 172.21.15.35:0/2137675434 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269000f660 con 0x555d3d272be0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f267b7fe700 1 -- 172.21.15.35:0/2137675434 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f269000bdc0 con 0x555d3d272be0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d3d182390 con 0x555d3d272be0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f267b7fe700 1 -- 172.21.15.35:0/2137675434 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f269000f7c0 con 0x555d3d272be0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f26aeb5db80 10 client.15888 fetch_fsmap learned FSMap version 29 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.638+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555d3cfedd80 con 0x555d3d272be0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f267b7fe700 1 -- 172.21.15.35:0/2137675434 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f269003c020 con 0x555d3d272be0 2023-03-17T09:07:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f267b7fe700 1 -- 172.21.15.35:0/2137675434 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f26900388b0 con 0x555d3d272be0 2023-03-17T09:07:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f26aeb5db80 10 client.15888 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:07:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f26aeb5db80 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:07:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f26aeb5db80 20 client.15888 populate_metadata read hostname 'smithi035' 2023-03-17T09:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d287160 0x555d3d289570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f26aeb5db80 4 client.15888 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d3d18e600 con 0x555d3d287160 2023-03-17T09:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f269bfff700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d287160 0x555d3d289570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f269bfff700 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d287160 0x555d3d289570 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e7480da6bc6faa server_cookie=6b45a38ea4d4e8f8 in_seq=0 out_seq=0 2023-03-17T09:07:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.639+0000 7f267b7fe700 10 client.15888 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:07:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f267b7fe700 1 -- 172.21.15.35:0/2137675434 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555d3d18e600 con 0x555d3d287160 2023-03-17T09:07:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f267b7fe700 10 client.15888 handle_command_reply: tid=0 2023-03-17T09:07:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 client.15888 shutdown 2023-03-17T09:07:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 msgr2=0x555d3d276740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d276740 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f269c100130 tx=0x7f2690009310 comp rx=0 tx=0).stop 2023-03-17T09:07:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 shutdown_connections 2023-03-17T09:07:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d287160 0x555d3d289570 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d276e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d26d960 0x555d3d2794c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/2137675434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d272be0 0x555d3d276740 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f267b7fe700 0 client.15888 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:07:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 >> 172.21.15.35:0/2137675434 conn(0x555d3d0ca6b0 msgr2=0x555d3d26c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:07:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 shutdown_connections 2023-03-17T09:07:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.640+0000 7f26aeb5db80 1 -- 172.21.15.35:0/2137675434 wait complete. 2023-03-17T09:07:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.641+0000 7f26aeb5db80 20 client.15888 trim_cache size 0 max 16384 2023-03-17T09:07:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.655+0000 7f26aeb5db80 1 Processor -- start 2023-03-17T09:07:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.655+0000 7f26aeb5db80 1 -- start start 2023-03-17T09:07:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d267ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 0x555d3d26ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d2630f0 con 0x555d3d2734f0 2023-03-17T09:07:42.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d268380 con 0x555d3d272be0 2023-03-17T09:07:42.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d268000 con 0x555d3d26d960 2023-03-17T09:07:42.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 0x555d3d26ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 0x555d3d26ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43496/0 (socket says 172.21.15.35:43496) 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 -- 172.21.15.35:0/3221062837 learned_addr learned my addr 172.21.15.35:0/3221062837 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f269bfff700 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d267ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f269b7fe700 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 -- 172.21.15.35:0/3221062837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 msgr2=0x555d3d267ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d267ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 -- 172.21.15.35:0/3221062837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 msgr2=0x555d3d27df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 -- 172.21.15.35:0/3221062837 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d3d186130 con 0x555d3d2734f0 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f269b7fe700 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 0x555d3d26ca90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f26940094f0 tx=0x7f269400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a65e4ac2590436 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f2682ffd700 1 -- 172.21.15.35:0/3221062837 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400e070 con 0x555d3d2734f0 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f2682ffd700 1 -- 172.21.15.35:0/3221062837 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f269400f040 con 0x555d3d2734f0 2023-03-17T09:07:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.656+0000 7f2682ffd700 1 -- 172.21.15.35:0/3221062837 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940155f0 con 0x555d3d2734f0 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3221062837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 msgr2=0x555d3d26ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 0x555d3d26ca90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f26940094f0 tx=0x7f269400b040 comp rx=0 tx=0).stop 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3221062837 shutdown_connections 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d2734f0 0x555d3d26ca90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d26d960 0x555d3d267ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3221062837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3221062837 >> 172.21.15.35:0/3221062837 conn(0x555d3d0ca6b0 msgr2=0x555d3d283470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:07:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3221062837 shutdown_connections 2023-03-17T09:07:44.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3221062837 wait complete. 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.657+0000 7f26aeb5db80 1 -- start start 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 Processor -- start 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 0x555d3d27dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d27c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d27ca70 con 0x555d3d26d960 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d27cbe0 con 0x555d3d272be0 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d3d27cda0 con 0x555d3d2734f0 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26aeb5db80 10 client.0 _ll_register_callbacks cb 0x555d3d065230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 0x555d3d27dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 0x555d3d27dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43498/0 (socket says 172.21.15.35:43498) 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 -- 172.21.15.35:0/3162374846 learned_addr learned my addr 172.21.15.35:0/3162374846 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:07:44.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269b7fe700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f26a0f6d700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d27c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 -- 172.21.15.35:0/3162374846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 msgr2=0x555d3d27c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d27c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 -- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 msgr2=0x555d3d27bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.658+0000 7f269bfff700 1 -- 172.21.15.35:0/3162374846 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2694009170 con 0x555d3d26d960 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f269bfff700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 0x555d3d27dd30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f268c0943f0 tx=0x7f268c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe18282ecf8f815c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f267b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f267b7fe700 1 -- 172.21.15.35:0/3162374846 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0b02b0 con 0x555d3d26d960 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f267b7fe700 1 -- 172.21.15.35:0/3162374846 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f268c098150 con 0x555d3d26d960 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d3d23d1e0 con 0x555d3d26d960 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f267b7fe700 1 -- 172.21.15.35:0/3162374846 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f268c094230 con 0x555d3d26d960 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 10 client.15894 fetch_fsmap learned FSMap version 29 2023-03-17T09:07:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555d3d0141f0 con 0x555d3d26d960 2023-03-17T09:07:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f267b7fe700 1 -- 172.21.15.35:0/3162374846 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f268c064030 con 0x555d3d26d960 2023-03-17T09:07:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f267b7fe700 1 -- 172.21.15.35:0/3162374846 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f268c09fc50 con 0x555d3d26d960 2023-03-17T09:07:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 10 client.15894 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:07:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 10 client.15894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:07:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 20 client.15894 populate_metadata read hostname 'smithi035' 2023-03-17T09:07:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d2dbf80 0x555d3d2de360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:07:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 4 client.15894 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:07:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.659+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555d3d043f00 con 0x555d3d2dbf80 2023-03-17T09:07:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.660+0000 7f269b7fe700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d2dbf80 0x555d3d2de360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:07:46.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.660+0000 7f269b7fe700 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d2dbf80 0x555d3d2de360 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6cd86ece376be26 server_cookie=95a23afcc516e92a in_seq=0 out_seq=0 2023-03-17T09:07:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.660+0000 7f267b7fe700 10 client.15894 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:07:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f267b7fe700 1 -- 172.21.15.35:0/3162374846 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555d3d043f00 con 0x555d3d2dbf80 2023-03-17T09:07:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f267b7fe700 10 client.15894 handle_command_reply: tid=0 2023-03-17T09:07:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 client.15894 shutdown 2023-03-17T09:07:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 msgr2=0x555d3d27dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 0x555d3d27dd30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f268c0943f0 tx=0x7f268c00b5b0 comp rx=0 tx=0).stop 2023-03-17T09:07:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 shutdown_connections 2023-03-17T09:07:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d3d2dbf80 0x555d3d2de360 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d3d2734f0 0x555d3d27c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f267b7fe700 0 client.15894 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:07:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d3d26d960 0x555d3d27dd30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 --2- 172.21.15.35:0/3162374846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d3d272be0 0x555d3d27bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 >> 172.21.15.35:0/3162374846 conn(0x555d3d0ca6b0 msgr2=0x555d3d2706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:07:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 shutdown_connections 2023-03-17T09:07:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 1 -- 172.21.15.35:0/3162374846 wait complete. 2023-03-17T09:07:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.664+0000 7f26aeb5db80 20 client.15894 trim_cache size 0 max 16384 2023-03-17T09:07:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:07:50.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:07:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:07:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:07:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f268409f640 msgr2=0x7f26840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f268409f640 0x7f26840a1af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2690000c00 tx=0x7f269000b540 comp rx=0 tx=0).stop 2023-03-17T09:07:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 msgr2=0x7f269c100dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:07:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 0x7f269c100dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f268c00d950 tx=0x7f268c00dc60 comp rx=0 tx=0).stop 2023-03-17T09:07:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 shutdown_connections 2023-03-17T09:07:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f268409f640 0x7f26840a1af0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c104400 0x7f269c1a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f269c0ff3c0 0x7f269c100dc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 --2- 172.21.15.35:0/716751254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f269c0ffd60 0x7f269c101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:07:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 >> 172.21.15.35:0/716751254 conn(0x7f269c076300 msgr2=0x7f269c0692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:07:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 shutdown_connections 2023-03-17T09:07:53.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:58:50.665+0000 7f26a29d0700 1 -- 172.21.15.35:0/716751254 wait complete. 2023-03-17T09:07:53.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:52 smithi035 ceph-mon[92535]: pgmap v394: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:53.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:54 smithi035 ceph-mon[92535]: pgmap v395: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:07:53.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:56 smithi035 ceph-mon[92535]: pgmap v396: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:53.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:58:58 smithi035 ceph-mon[92535]: pgmap v397: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:53.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:00 smithi035 ceph-mon[92535]: pgmap v398: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:53.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:02 smithi035 ceph-mon[92535]: pgmap v399: 97 pgs: 97 active+clean; 1.3 MiB data, 94 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:54.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:18 smithi082 ceph-mon[94281]: pgmap v666: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:20 smithi082 ceph-mon[94281]: pgmap v667: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 565 B/s wr, 10 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:22 smithi082 ceph-mon[94281]: pgmap v668: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:24 smithi082 ceph-mon[94281]: pgmap v669: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:26 smithi082 ceph-mon[94281]: pgmap v670: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 380 B/s wr, 10 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:28 smithi082 ceph-mon[94281]: pgmap v671: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:30 smithi082 ceph-mon[94281]: pgmap v672: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:32 smithi082 ceph-mon[94281]: pgmap v673: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:34 smithi082 ceph-mon[94281]: pgmap v674: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:36 smithi082 ceph-mon[94281]: pgmap v675: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:54.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:38 smithi082 ceph-mon[94281]: pgmap v676: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:55.597 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:40 smithi082 ceph-mon[94281]: pgmap v677: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:55.597 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:42 smithi082 ceph-mon[94281]: pgmap v678: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:55.597 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:44 smithi082 ceph-mon[94281]: pgmap v679: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:55.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:46 smithi082 ceph-mon[94281]: pgmap v680: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:55.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:48 smithi082 ceph-mon[94281]: pgmap v681: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:55.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:07:55.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:50 smithi082 ceph-mon[94281]: pgmap v682: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:52 smithi082 ceph-mon[94281]: pgmap v683: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:18 smithi078 ceph-mon[94114]: pgmap v666: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:20 smithi078 ceph-mon[94114]: pgmap v667: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 565 B/s wr, 10 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:22 smithi078 ceph-mon[94114]: pgmap v668: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:24 smithi078 ceph-mon[94114]: pgmap v669: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:26 smithi078 ceph-mon[94114]: pgmap v670: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 380 B/s wr, 10 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:28 smithi078 ceph-mon[94114]: pgmap v671: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:30 smithi078 ceph-mon[94114]: pgmap v672: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:55.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:32 smithi078 ceph-mon[94114]: pgmap v673: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:57.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:34 smithi078 ceph-mon[94114]: pgmap v674: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:57.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:36 smithi078 ceph-mon[94114]: pgmap v675: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:57.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:38 smithi078 ceph-mon[94114]: pgmap v676: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:57.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:40 smithi078 ceph-mon[94114]: pgmap v677: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:57.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:42 smithi078 ceph-mon[94114]: pgmap v678: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:57.167 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:44 smithi078 ceph-mon[94114]: pgmap v679: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:57.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:46 smithi078 ceph-mon[94114]: pgmap v680: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:07:57.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:48 smithi078 ceph-mon[94114]: pgmap v681: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:57.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:07:57.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:50 smithi078 ceph-mon[94114]: pgmap v682: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:57.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:52 smithi078 ceph-mon[94114]: pgmap v683: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:57.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:57.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:57.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:07:57.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:07:57.708 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:07:57.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:54 smithi078 ceph-mon[94114]: pgmap v684: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:59.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:56 smithi078 ceph-mon[94114]: pgmap v685: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:59.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:54 smithi082 ceph-mon[94281]: pgmap v684: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:07:59.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:56 smithi082 ceph-mon[94281]: pgmap v685: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:07:59.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:07:58 smithi078 ceph-mon[94114]: pgmap v686: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:08:00.669 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:07:58 smithi082 ceph-mon[94281]: pgmap v686: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:08:00.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:00 smithi082 ceph-mon[94281]: pgmap v687: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:01.027 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:00 smithi078 ceph-mon[94114]: pgmap v687: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 -- 172.21.15.35:0/3088249951 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48105490 msgr2=0x7fcc4810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/3088249951 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48105490 0x7fcc4810d060 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000b0d0 tx=0x7fcc4000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 -- 172.21.15.35:0/3088249951 shutdown_connections 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/3088249951 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48105490 0x7fcc4810d060 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/3088249951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48100450 0x7fcc48100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/3088249951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48100df0 0x7fcc48104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 -- 172.21.15.35:0/3088249951 >> 172.21.15.35:0/3088249951 conn(0x7fcc480fbca0 msgr2=0x7fcc480fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 -- 172.21.15.35:0/3088249951 shutdown_connections 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.787+0000 7fcc4da4e700 1 -- 172.21.15.35:0/3088249951 wait complete. 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 Processor -- start 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 -- start start 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48100450 0x7fcc48072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 0x7fcc480732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48105490 0x7fcc481a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48073af0 con 0x7fcc48100df0 2023-03-17T09:08:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc481a4a50 con 0x7fcc48100450 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc4da4e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc481a4b90 con 0x7fcc48105490 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 0x7fcc480732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 0x7fcc480732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43514/0 (socket says 172.21.15.35:43514) 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc467fc700 1 -- 172.21.15.35:0/331711968 learned_addr learned my addr 172.21.15.35:0/331711968 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.788+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48100450 0x7fcc48072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc477fe700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48105490 0x7fcc481a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc467fc700 1 -- 172.21.15.35:0/331711968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48105490 msgr2=0x7fcc481a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc467fc700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48105490 0x7fcc481a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc467fc700 1 -- 172.21.15.35:0/331711968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48100450 msgr2=0x7fcc48072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc467fc700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48100450 0x7fcc48072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc467fc700 1 -- 172.21.15.35:0/331711968 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40009d00 con 0x7fcc48100df0 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc477fe700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48105490 0x7fcc481a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc467fc700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 0x7fcc480732c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800d950 tx=0x7fcc3800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc4ca4c700 1 -- 172.21.15.35:0/331711968 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38009930 con 0x7fcc48100df0 2023-03-17T09:08:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc4ca4c700 1 -- 172.21.15.35:0/331711968 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc38010460 con 0x7fcc48100df0 2023-03-17T09:08:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc481100c0 con 0x7fcc48100df0 2023-03-17T09:08:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc4ca4c700 1 -- 172.21.15.35:0/331711968 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800f620 con 0x7fcc48100df0 2023-03-17T09:08:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.789+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4810ff30 con 0x7fcc48100df0 2023-03-17T09:08:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.791+0000 7fcc4ca4c700 1 -- 172.21.15.35:0/331711968 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcc38009a90 con 0x7fcc48100df0 2023-03-17T09:08:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.792+0000 7fcc4ca4c700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc3009f640 0x7fcc300a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.792+0000 7fcc4ca4c700 1 -- 172.21.15.35:0/331711968 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcc380ca100 con 0x7fcc48100df0 2023-03-17T09:08:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.792+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc3009f640 0x7fcc300a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc3009f640 0x7fcc300a1af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009c60 tx=0x7fcc3c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 Processor -- start 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 -- start start 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4172fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be416d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be416dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be4074010 con 0x557be416d960 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be40c6950 con 0x557be41734f0 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.793+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be40bfde0 con 0x557be4172be0 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be416dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be416dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43524/0 (socket says 172.21.15.35:43524) 2023-03-17T09:08:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 -- 172.21.15.35:0/3035154116 learned_addr learned my addr 172.21.15.35:0/3035154116 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc467fc700 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be416d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4172fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 -- 172.21.15.35:0/3035154116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 msgr2=0x557be4172fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4172fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 -- 172.21.15.35:0/3035154116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 msgr2=0x557be416d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be416d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 -- 172.21.15.35:0/3035154116 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557be3f415d0 con 0x557be416d960 2023-03-17T09:08:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc467fc700 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be416d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:08:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc477fe700 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be416dd90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcc400092e0 tx=0x7fcc40009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b218a52a97a741a8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:05.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc2dffb700 1 -- 172.21.15.35:0/3035154116 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000e040 con 0x557be416d960 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc2dffb700 1 -- 172.21.15.35:0/3035154116 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc40007d90 con 0x557be416d960 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.794+0000 7fcc2dffb700 1 -- 172.21.15.35:0/3035154116 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40004cb0 con 0x557be416d960 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/3035154116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 msgr2=0x557be416dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be416dd90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcc400092e0 tx=0x7fcc40009310 comp rx=0 tx=0).stop 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/3035154116 shutdown_connections 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be416dd90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4172fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/3035154116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be416d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/3035154116 >> 172.21.15.35:0/3035154116 conn(0x557be3fca6b0 msgr2=0x557be4167a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/3035154116 shutdown_connections 2023-03-17T09:08:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/3035154116 wait complete. 2023-03-17T09:08:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.795+0000 7fcc59bdbb80 1 -- start start 2023-03-17T09:08:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 Processor -- start 2023-03-17T09:08:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be4179380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4176590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be4176ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be3f438c0 con 0x557be41734f0 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be41771c0 con 0x557be416d960 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be4177380 con 0x557be4172be0 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc59bdbb80 10 client.0 _ll_register_callbacks cb 0x557be3f65230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be4176ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc46ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be4179380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be4176ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43530/0 (socket says 172.21.15.35:43530) 2023-03-17T09:08:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc477fe700 1 -- 172.21.15.35:0/2476664429 learned_addr learned my addr 172.21.15.35:0/2476664429 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc46ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be4179380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:45322/0 (socket says 172.21.15.35:45322) 2023-03-17T09:08:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.796+0000 7fcc467fc700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4176590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc46ffd700 1 -- 172.21.15.35:0/2476664429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 msgr2=0x557be4176590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4176590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc46ffd700 1 -- 172.21.15.35:0/2476664429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 msgr2=0x557be4176ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be4176ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc46ffd700 1 -- 172.21.15.35:0/2476664429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4810d8a0 con 0x557be416d960 2023-03-17T09:08:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc467fc700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4176590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc477fe700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be4176ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be4179380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c011ab0 tx=0x7fcc3c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3806f81bc2fac8dd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc26ffd700 1 -- 172.21.15.35:0/2476664429 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c022070 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc26ffd700 1 -- 172.21.15.35:0/2476664429 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcc3c027420 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557be4082390 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc26ffd700 1 -- 172.21.15.35:0/2476664429 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc3c0275e0 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc59bdbb80 10 client.25553 fetch_fsmap learned FSMap version 29 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557be3eedd80 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.797+0000 7fcc26ffd700 1 -- 172.21.15.35:0/2476664429 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557be4082390 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc26ffd700 1 -- 172.21.15.35:0/2476664429 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcc3c01d850 con 0x557be416d960 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc59bdbb80 10 client.25553 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc59bdbb80 10 client.25553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc59bdbb80 20 client.25553 populate_metadata read hostname 'smithi035' 2023-03-17T09:08:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be4186f50 0x557be4189360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc59bdbb80 4 client.25553 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:08:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557be408e600 con 0x557be4186f50 2023-03-17T09:08:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc467fc700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be4186f50 0x557be4189360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc467fc700 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be4186f50 0x557be4189360 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee716c2ff7299c98 server_cookie=64943daa6e69c233 in_seq=0 out_seq=0 2023-03-17T09:08:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.798+0000 7fcc26ffd700 10 client.25553 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc26ffd700 1 -- 172.21.15.35:0/2476664429 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557be408e600 con 0x557be4186f50 2023-03-17T09:08:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc26ffd700 10 client.25553 handle_command_reply: tid=0 2023-03-17T09:08:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 client.25553 shutdown 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 msgr2=0x557be4179380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be4179380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c011ab0 tx=0x7fcc3c0047c0 comp rx=0 tx=0).stop 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 shutdown_connections 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be4186f50 0x557be4189360 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be4176ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc26ffd700 0 client.25553 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be4179380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/2476664429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4176590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 >> 172.21.15.35:0/2476664429 conn(0x557be3fca6b0 msgr2=0x557be4167a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.799+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 shutdown_connections 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.800+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/2476664429 wait complete. 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.800+0000 7fcc59bdbb80 20 client.25553 trim_cache size 0 max 16384 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 Processor -- start 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 -- start start 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be4167ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4173fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be4178eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be4184650 con 0x557be416d960 2023-03-17T09:08:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be4168000 con 0x557be41734f0 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be4164b60 con 0x557be4172be0 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be4167ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be4167ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43534/0 (socket says 172.21.15.35:43534) 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 -- 172.21.15.35:0/1190319562 learned_addr learned my addr 172.21.15.35:0/1190319562 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc477fe700 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be4178eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 -- 172.21.15.35:0/1190319562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 msgr2=0x557be4173fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4173fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 -- 172.21.15.35:0/1190319562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 msgr2=0x557be4178eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be4178eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 -- 172.21.15.35:0/1190319562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557be416e000 con 0x557be416d960 2023-03-17T09:08:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc477fe700 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be4178eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be4167ac0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009ed0 tx=0x7fcc3c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9d214a03784135 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.815+0000 7fcc2e7fc700 1 -- 172.21.15.35:0/1190319562 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c022040 con 0x557be416d960 2023-03-17T09:08:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc2e7fc700 1 -- 172.21.15.35:0/1190319562 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc3c01d8a0 con 0x557be416d960 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc2e7fc700 1 -- 172.21.15.35:0/1190319562 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c01cd90 con 0x557be416d960 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1190319562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 msgr2=0x557be4167ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be4167ac0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009ed0 tx=0x7fcc3c009370 comp rx=0 tx=0).stop 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1190319562 shutdown_connections 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be41734f0 0x557be4178eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be416d960 0x557be4167ac0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1190319562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be4173fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1190319562 >> 172.21.15.35:0/1190319562 conn(0x557be3fca6b0 msgr2=0x557be41738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1190319562 shutdown_connections 2023-03-17T09:08:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.816+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1190319562 wait complete. 2023-03-17T09:08:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 -- start start 2023-03-17T09:08:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 Processor -- start 2023-03-17T09:08:12.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be417c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:12.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be417c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be41d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be417cd60 con 0x557be41734f0 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be41da330 con 0x557be416d960 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557be41da470 con 0x557be4172be0 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc59bdbb80 10 client.0 _ll_register_callbacks cb 0x557be3f65230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be41d9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be41d9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43544/0 (socket says 172.21.15.35:43544) 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc477fe700 1 -- 172.21.15.35:0/1329010653 learned_addr learned my addr 172.21.15.35:0/1329010653 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be417c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.817+0000 7fcc467fc700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be417c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc477fe700 1 -- 172.21.15.35:0/1329010653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 msgr2=0x557be417c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc477fe700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be417c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc477fe700 1 -- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 msgr2=0x557be417c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc477fe700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be417c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc477fe700 1 -- 172.21.15.35:0/1329010653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557be3eedd80 con 0x557be41734f0 2023-03-17T09:08:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be417c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:08:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc477fe700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be41d9df0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000b420 tx=0x7fcc40004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e5302cfbea4f7d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:08:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc26ffd700 1 -- 172.21.15.35:0/1329010653 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4002a070 con 0x557be41734f0 2023-03-17T09:08:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc26ffd700 1 -- 172.21.15.35:0/1329010653 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcc400074a0 con 0x557be41734f0 2023-03-17T09:08:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557be413d1e0 con 0x557be41734f0 2023-03-17T09:08:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc26ffd700 1 -- 172.21.15.35:0/1329010653 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc40007ea0 con 0x557be41734f0 2023-03-17T09:08:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc59bdbb80 10 client.15912 fetch_fsmap learned FSMap version 29 2023-03-17T09:08:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557be3ed6c00 con 0x557be41734f0 2023-03-17T09:08:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.818+0000 7fcc26ffd700 1 -- 172.21.15.35:0/1329010653 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557be413d1e0 con 0x557be41734f0 2023-03-17T09:08:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc26ffd700 1 -- 172.21.15.35:0/1329010653 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcc40019030 con 0x557be41734f0 2023-03-17T09:08:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc59bdbb80 10 client.15912 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:08:17.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc59bdbb80 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:08:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc59bdbb80 20 client.15912 populate_metadata read hostname 'smithi035' 2023-03-17T09:08:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be41db740 0x557be41ddb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc59bdbb80 4 client.15912 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:08:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557be3f43f00 con 0x557be41db740 2023-03-17T09:08:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be41db740 0x557be41ddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc46ffd700 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be41db740 0x557be41ddb50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d238444b8f3fae6 server_cookie=ddc305a266453c6f in_seq=0 out_seq=0 2023-03-17T09:08:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.819+0000 7fcc26ffd700 10 client.15912 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:17.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc26ffd700 1 -- 172.21.15.35:0/1329010653 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557be3f43f00 con 0x557be41db740 2023-03-17T09:08:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc26ffd700 10 client.15912 handle_command_reply: tid=0 2023-03-17T09:08:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 client.15912 shutdown 2023-03-17T09:08:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 msgr2=0x557be41d9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be41d9df0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000b420 tx=0x7fcc40004c80 comp rx=0 tx=0).stop 2023-03-17T09:08:17.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 shutdown_connections 2023-03-17T09:08:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557be41db740 0x557be41ddb50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557be41734f0 0x557be41d9df0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc26ffd700 0 client.15912 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557be416d960 0x557be417c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 --2- 172.21.15.35:0/1329010653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557be4172be0 0x557be417c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 >> 172.21.15.35:0/1329010653 conn(0x557be3fca6b0 msgr2=0x557be4171690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 shutdown_connections 2023-03-17T09:08:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 1 -- 172.21.15.35:0/1329010653 wait complete. 2023-03-17T09:08:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.826+0000 7fcc59bdbb80 20 client.15912 trim_cache size 0 max 16384 2023-03-17T09:08:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:08:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:08:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:08:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:08:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc3009f640 msgr2=0x7fcc300a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc3009f640 0x7fcc300a1af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009c60 tx=0x7fcc3c009260 comp rx=0 tx=0).stop 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 msgr2=0x7fcc480732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 0x7fcc480732c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800d950 tx=0x7fcc3800dc60 comp rx=0 tx=0).stop 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 shutdown_connections 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc3009f640 0x7fcc300a1af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48105490 0x7fcc481a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc48100450 0x7fcc48072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 --2- 172.21.15.35:0/331711968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc48100df0 0x7fcc480732c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 >> 172.21.15.35:0/331711968 conn(0x7fcc480fbca0 msgr2=0x7fcc480fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 shutdown_connections 2023-03-17T09:08:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:03.827+0000 7fcc4da4e700 1 -- 172.21.15.35:0/331711968 wait complete. 2023-03-17T09:08:20.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:04 smithi035 ceph-mon[92535]: pgmap v400: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:08:20.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:06 smithi035 ceph-mon[92535]: pgmap v401: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:08:20.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:08 smithi035 ceph-mon[92535]: pgmap v402: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:08:20.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:10 smithi035 ceph-mon[92535]: pgmap v403: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T09:08:20.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:10 smithi035 ceph-mon[92535]: osdmap e99: 12 total, 12 up, 12 in 2023-03-17T09:08:20.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:12 smithi035 ceph-mon[92535]: pgmap v405: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:08:21.133 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:14 smithi035 ceph-mon[92535]: pgmap v406: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:08:21.133 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:16 smithi035 ceph-mon[92535]: osdmap e100: 12 total, 12 up, 12 in 2023-03-17T09:08:21.133 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:16 smithi035 ceph-mon[92535]: pgmap v408: 97 pgs: 97 active+clean; 1.3 MiB data, 99 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T09:08:21.136 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:02 smithi078 ceph-mon[94114]: pgmap v688: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:22.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:04 smithi078 ceph-mon[94114]: pgmap v689: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:08:22.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:06 smithi078 ceph-mon[94114]: pgmap v690: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:08:22.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:08 smithi078 ceph-mon[94114]: pgmap v691: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:08:22.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:09 smithi078 ceph-mon[94114]: osdmap e118: 12 total, 12 up, 12 in 2023-03-17T09:08:22.973 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:10 smithi078 ceph-mon[94114]: pgmap v693: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:12 smithi078 ceph-mon[94114]: pgmap v694: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:14 smithi078 ceph-mon[94114]: pgmap v695: 97 pgs: 97 active+clean; 1.4 MiB data, 145 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:16 smithi078 ceph-mon[94114]: osdmap e119: 12 total, 12 up, 12 in 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:16 smithi078 ceph-mon[94114]: pgmap v697: 97 pgs: 97 active+clean; 1.4 MiB data, 145 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:18 smithi078 ceph-mon[94114]: pgmap v698: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:20 smithi078 ceph-mon[94114]: pgmap v699: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:02 smithi082 ceph-mon[94281]: pgmap v688: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:04 smithi082 ceph-mon[94281]: pgmap v689: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:06 smithi082 ceph-mon[94281]: pgmap v690: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:08 smithi082 ceph-mon[94281]: pgmap v691: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:09 smithi082 ceph-mon[94281]: osdmap e118: 12 total, 12 up, 12 in 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:10 smithi082 ceph-mon[94281]: pgmap v693: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:12 smithi082 ceph-mon[94281]: pgmap v694: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:14 smithi082 ceph-mon[94281]: pgmap v695: 97 pgs: 97 active+clean; 1.4 MiB data, 145 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:08:22.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:16 smithi082 ceph-mon[94281]: osdmap e119: 12 total, 12 up, 12 in 2023-03-17T09:08:24.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:16 smithi082 ceph-mon[94281]: pgmap v697: 97 pgs: 97 active+clean; 1.4 MiB data, 145 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:08:24.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:18 smithi082 ceph-mon[94281]: pgmap v698: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:08:24.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:20 smithi082 ceph-mon[94281]: pgmap v699: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:08:24.215 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:22 smithi078 ceph-mon[94114]: pgmap v700: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:08:24.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:22 smithi082 ceph-mon[94281]: pgmap v700: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:08:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 -- 172.21.15.35:0/384461456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 msgr2=0x7f1b04103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/384461456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b04103cf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1af80099c0 tx=0x7f1af8009cd0 comp rx=0 tx=0).stop 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 -- 172.21.15.35:0/384461456 shutdown_connections 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/384461456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b041043d0 0x7f1b0410bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/384461456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b040ff390 0x7f1b040ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/384461456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b04103cf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.950+0000 7f1b0a23f700 1 -- 172.21.15.35:0/384461456 >> 172.21.15.35:0/384461456 conn(0x7f1b04075f30 msgr2=0x7f1b04076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.951+0000 7f1b0a23f700 1 -- 172.21.15.35:0/384461456 shutdown_connections 2023-03-17T09:08:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.951+0000 7f1b0a23f700 1 -- 172.21.15.35:0/384461456 wait complete. 2023-03-17T09:08:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.951+0000 7f1b0a23f700 1 Processor -- start 2023-03-17T09:08:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.951+0000 7f1b0a23f700 1 -- start start 2023-03-17T09:08:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b0a23f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b040ff390 0x7f1b0410e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b0a23f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b0410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b0a23f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b041043d0 0x7f1b041a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b0a23f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0410f570 con 0x7f1b040ffd30 2023-03-17T09:08:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b0a23f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b041a4990 con 0x7f1b041043d0 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b0a23f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b041a4ad0 con 0x7f1b040ff390 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b0410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b0410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43556/0 (socket says 172.21.15.35:43556) 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1238767930 learned_addr learned my addr 172.21.15.35:0/1238767930 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b037fe700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b040ff390 0x7f1b0410e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b03fff700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b041043d0 0x7f1b041a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1238767930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b040ff390 msgr2=0x7f1b0410e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b040ff390 0x7f1b0410e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1238767930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b041043d0 msgr2=0x7f1b041a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b041043d0 0x7f1b041a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1238767930 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80095f0 con 0x7f1b040ffd30 2023-03-17T09:08:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b0410ed40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009fd0 tx=0x7f1af8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.952+0000 7f1b00ff9700 1 -- 172.21.15.35:0/1238767930 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af801d070 con 0x7f1b040ffd30 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.953+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04069450 con 0x7f1b040ffd30 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.953+0000 7f1b00ff9700 1 -- 172.21.15.35:0/1238767930 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1af80059a0 con 0x7f1b040ffd30 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.953+0000 7f1b00ff9700 1 -- 172.21.15.35:0/1238767930 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8022d10 con 0x7f1b040ffd30 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.953+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b040692c0 con 0x7f1b040ffd30 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.955+0000 7f1b00ff9700 1 -- 172.21.15.35:0/1238767930 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1af8022470 con 0x7f1b040ffd30 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.956+0000 7f1b00ff9700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1aec09f640 0x7f1aec0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.956+0000 7f1b037fe700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1aec09f640 0x7f1aec0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:31.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.956+0000 7f1b00ff9700 1 -- 172.21.15.35:0/1238767930 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1af80cb6b0 con 0x7f1b040ffd30 2023-03-17T09:08:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b037fe700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1aec09f640 0x7f1aec0a1af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1af400f540 tx=0x7f1af400b040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 Processor -- start 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 -- start start 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f3360fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f335b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f335bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f3262010 con 0x5641f335b960 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f32b4950 con 0x5641f33614f0 2023-03-17T09:08:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f32adde0 con 0x5641f3360be0 2023-03-17T09:08:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b03fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f335bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b037fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f3360fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b03fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f335bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43566/0 (socket says 172.21.15.35:43566) 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b03fff700 1 -- 172.21.15.35:0/2348977405 learned_addr learned my addr 172.21.15.35:0/2348977405 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.957+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f335b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1b03fff700 1 -- 172.21.15.35:0/2348977405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 msgr2=0x5641f3360fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1b03fff700 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f3360fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1b03fff700 1 -- 172.21.15.35:0/2348977405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 msgr2=0x5641f335b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1b03fff700 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f335b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1b03fff700 1 -- 172.21.15.35:0/2348977405 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641f312f5d0 con 0x5641f335b960 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1b03fff700 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f335bd90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009c20 tx=0x7f1afc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76d675e4188aa48 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1ae9ffb700 1 -- 172.21.15.35:0/2348977405 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc011cb0 con 0x5641f335b960 2023-03-17T09:08:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1ae9ffb700 1 -- 172.21.15.35:0/2348977405 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1afc011e10 con 0x5641f335b960 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.958+0000 7f1ae9ffb700 1 -- 172.21.15.35:0/2348977405 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc005690 con 0x5641f335b960 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 -- 172.21.15.35:0/2348977405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 msgr2=0x5641f335bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f335bd90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009c20 tx=0x7f1afc009f30 comp rx=0 tx=0).stop 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 -- 172.21.15.35:0/2348977405 shutdown_connections 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f335bd90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f3360fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/2348977405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f335b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 -- 172.21.15.35:0/2348977405 >> 172.21.15.35:0/2348977405 conn(0x5641f31b86b0 msgr2=0x5641f3355a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 -- 172.21.15.35:0/2348977405 shutdown_connections 2023-03-17T09:08:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 -- 172.21.15.35:0/2348977405 wait complete. 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 -- start start 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.959+0000 7f1b163ccb80 1 Processor -- start 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f33673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f33645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f3364b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f31318c0 con 0x5641f335b960 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f3365250 con 0x5641f33614f0 2023-03-17T09:08:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f3365410 con 0x5641f3360be0 2023-03-17T09:08:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b163ccb80 10 client.0 _ll_register_callbacks cb 0x5641f3153230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:08:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f33673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f33673c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43568/0 (socket says 172.21.15.35:43568) 2023-03-17T09:08:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 -- 172.21.15.35:0/763223311 learned_addr learned my addr 172.21.15.35:0/763223311 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b03fff700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f3364b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f33645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 -- 172.21.15.35:0/763223311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 msgr2=0x5641f33645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f33645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 -- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 msgr2=0x5641f3364b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f3364b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 -- 172.21.15.35:0/763223311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc0098d0 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f33645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1b037fe700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f33673c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1af4004690 tx=0x7f1af4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed0b2f973ed4022 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.960+0000 7f1ae2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/763223311 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400e040 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/763223311 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1af4015cf0 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641f3270390 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/763223311 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af4009020 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 10 client.15924 fetch_fsmap learned FSMap version 29 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5641f30dbd80 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/763223311 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5641f3270390 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/763223311 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1af4008c60 con 0x5641f335b960 2023-03-17T09:08:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 10 client.15924 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 20 client.15924 populate_metadata read hostname 'smithi035' 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f3374fd0 0x5641f33773e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 4 client.15924 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641f327c600 con 0x5641f3374fd0 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.961+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f3374fd0 0x5641f33773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.962+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f3374fd0 0x5641f33773e0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e94b35eaee1271 server_cookie=46951822b275bc1 in_seq=0 out_seq=0 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.962+0000 7f1ae2ffd700 10 client.15924 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.962+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/763223311 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5641f327c600 con 0x5641f3374fd0 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.962+0000 7f1ae2ffd700 10 client.15924 handle_command_reply: tid=0 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.962+0000 7f1b163ccb80 1 client.15924 shutdown 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 msgr2=0x5641f33673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f33673c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1af4004690 tx=0x7f1af4004ad0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 shutdown_connections 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f3374fd0 0x5641f33773e0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f3364b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1ae2ffd700 0 client.15924 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f335b960 0x5641f33673c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/763223311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f3360be0 0x5641f33645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 >> 172.21.15.35:0/763223311 conn(0x5641f31b86b0 msgr2=0x5641f3355a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 shutdown_connections 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 1 -- 172.21.15.35:0/763223311 wait complete. 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.963+0000 7f1b163ccb80 20 client.15924 trim_cache size 0 max 16384 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 Processor -- start 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 -- start start 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f335b960 0x5641f335b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:37.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3355ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f33614f0 0x5641f33620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f33510f0 con 0x5641f3360be0 2023-03-17T09:08:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f33726e0 con 0x5641f335b960 2023-03-17T09:08:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f3356000 con 0x5641f33614f0 2023-03-17T09:08:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3355ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3355ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43578/0 (socket says 172.21.15.35:43578) 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b02ffd700 1 -- 172.21.15.35:0/507752200 learned_addr learned my addr 172.21.15.35:0/507752200 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b037fe700 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f335b960 0x5641f335b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.978+0000 7f1b03fff700 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f33614f0 0x5641f33620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b02ffd700 1 -- 172.21.15.35:0/507752200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f33614f0 msgr2=0x5641f33620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f33614f0 0x5641f33620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b02ffd700 1 -- 172.21.15.35:0/507752200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f335b960 msgr2=0x5641f335b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f335b960 0x5641f335b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b02ffd700 1 -- 172.21.15.35:0/507752200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641f335c000 con 0x5641f3360be0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b03fff700 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f33614f0 0x5641f33620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3355ac0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1af80956d0 tx=0x7f1af8094df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0647a1cc78b9a0b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1aea7fc700 1 -- 172.21.15.35:0/507752200 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8097570 con 0x5641f3360be0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1aea7fc700 1 -- 172.21.15.35:0/507752200 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1af80c8400 con 0x5641f3360be0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1aea7fc700 1 -- 172.21.15.35:0/507752200 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8099690 con 0x5641f3360be0 2023-03-17T09:08:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 -- 172.21.15.35:0/507752200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 msgr2=0x5641f3355ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3355ac0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1af80956d0 tx=0x7f1af8094df0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 -- 172.21.15.35:0/507752200 shutdown_connections 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f33614f0 0x5641f33620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f335b960 0x5641f335b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/507752200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3355ac0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 -- 172.21.15.35:0/507752200 >> 172.21.15.35:0/507752200 conn(0x5641f31b86b0 msgr2=0x5641f3361990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.979+0000 7f1b163ccb80 1 -- 172.21.15.35:0/507752200 shutdown_connections 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 -- 172.21.15.35:0/507752200 wait complete. 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 -- start start 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 Processor -- start 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f335b960 0x5641f3367f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3368460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f33c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f3368c40 con 0x5641f3360be0 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f3368db0 con 0x5641f33614f0 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641f33c83f0 con 0x5641f335b960 2023-03-17T09:08:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b163ccb80 10 client.0 _ll_register_callbacks cb 0x5641f3153230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3368460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b02ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3368460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43584/0 (socket says 172.21.15.35:43584) 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.980+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1551420312 learned_addr learned my addr 172.21.15.35:0/1551420312 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b037fe700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f335b960 0x5641f3367f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b03fff700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f33c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1551420312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f335b960 msgr2=0x5641f3367f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f335b960 0x5641f3367f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 msgr2=0x5641f33c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f33c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b02ffd700 1 -- 172.21.15.35:0/1551420312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b040692c0 con 0x5641f3360be0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b03fff700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f33c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b02ffd700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3368460 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1af8095c40 tx=0x7f1af80c8df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46e5d8201c3436f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1ae2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/1551420312 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80b7120 con 0x5641f3360be0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/1551420312 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1af8097570 con 0x5641f3360be0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641f332b1e0 con 0x5641f3360be0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/1551420312 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af80986c0 con 0x5641f3360be0 2023-03-17T09:08:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b163ccb80 10 client.15930 fetch_fsmap learned FSMap version 29 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5641f30c4c00 con 0x5641f3360be0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.981+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/1551420312 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5641f332b1e0 con 0x5641f3360be0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/1551420312 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1af8094fc0 con 0x5641f3360be0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b163ccb80 10 client.15930 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b163ccb80 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b163ccb80 20 client.15930 populate_metadata read hostname 'smithi035' 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f33c96d0 0x5641f33cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b163ccb80 4 client.15930 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5641f3131f00 con 0x5641f33c96d0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b037fe700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f33c96d0 0x5641f33cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1ae2ffd700 10 client.15930 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.982+0000 7f1b037fe700 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f33c96d0 0x5641f33cbae0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a1004711b0b902 server_cookie=77a897445c258a49 in_seq=0 out_seq=0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.989+0000 7f1ae2ffd700 1 -- 172.21.15.35:0/1551420312 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5641f3131f00 con 0x5641f33c96d0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.989+0000 7f1ae2ffd700 10 client.15930 handle_command_reply: tid=0 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.989+0000 7f1b163ccb80 1 client.15930 shutdown 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 msgr2=0x5641f3368460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3368460 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1af8095c40 tx=0x7f1af80c8df0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 shutdown_connections 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641f33c96d0 0x5641f33cbae0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641f33614f0 0x5641f33c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1ae2ffd700 0 client.15930 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641f335b960 0x5641f3367f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 --2- 172.21.15.35:0/1551420312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641f3360be0 0x5641f3368460 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 >> 172.21.15.35:0/1551420312 conn(0x5641f31b86b0 msgr2=0x5641f335f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 shutdown_connections 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 1 -- 172.21.15.35:0/1551420312 wait complete. 2023-03-17T09:08:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b163ccb80 20 client.15930 trim_cache size 0 max 16384 2023-03-17T09:08:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:08:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:08:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:08:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:08:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1aec09f640 msgr2=0x7f1aec0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1aec09f640 0x7f1aec0a1af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1af400f540 tx=0x7f1af400b040 comp rx=0 tx=0).stop 2023-03-17T09:08:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 msgr2=0x7f1b0410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:38.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b0410ed40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009fd0 tx=0x7f1af8009580 comp rx=0 tx=0).stop 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 shutdown_connections 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1aec09f640 0x7f1aec0a1af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b041043d0 0x7f1b041a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b040ff390 0x7f1b0410e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 --2- 172.21.15.35:0/1238767930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b040ffd30 0x7f1b0410ed40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.990+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 >> 172.21.15.35:0/1238767930 conn(0x7f1b04075f30 msgr2=0x7f1b040fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.991+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 shutdown_connections 2023-03-17T09:08:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:16.991+0000 7f1b0a23f700 1 -- 172.21.15.35:0/1238767930 wait complete. 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:24 smithi078 ceph-mon[94114]: pgmap v701: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:26 smithi078 ceph-mon[94114]: pgmap v702: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:28 smithi078 ceph-mon[94114]: pgmap v703: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:30 smithi078 ceph-mon[94114]: pgmap v704: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:32 smithi078 ceph-mon[94114]: pgmap v705: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:34 smithi078 ceph-mon[94114]: pgmap v706: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:36 smithi078 ceph-mon[94114]: pgmap v707: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:38 smithi078 ceph-mon[94114]: pgmap v708: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:24 smithi082 ceph-mon[94281]: pgmap v701: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:26 smithi082 ceph-mon[94281]: pgmap v702: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:28 smithi082 ceph-mon[94281]: pgmap v703: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:08:38.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:30 smithi082 ceph-mon[94281]: pgmap v704: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:40.357 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:32 smithi082 ceph-mon[94281]: pgmap v705: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:40.357 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:34 smithi082 ceph-mon[94281]: pgmap v706: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:08:40.357 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:36 smithi082 ceph-mon[94281]: pgmap v707: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:40.897 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:38 smithi082 ceph-mon[94281]: pgmap v708: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:08:40.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:18 smithi035 ceph-mon[92535]: pgmap v409: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T09:08:40.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:20 smithi035 ceph-mon[92535]: pgmap v410: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:08:40.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:22 smithi035 ceph-mon[92535]: pgmap v411: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:08:40.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:24 smithi035 ceph-mon[92535]: pgmap v412: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:08:40.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:26 smithi035 ceph-mon[92535]: pgmap v413: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 510 B/s wr, 10 op/s 2023-03-17T09:08:40.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:28 smithi035 ceph-mon[92535]: pgmap v414: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:08:40.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:40 smithi078 ceph-mon[94114]: pgmap v709: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:42.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:40 smithi082 ceph-mon[94281]: pgmap v709: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:08:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 -- 172.21.15.35:0/1645298215 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a40ffcf0 msgr2=0x7f31a4103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 --2- 172.21.15.35:0/1645298215 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a40ffcf0 0x7f31a4103cb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f31980099c0 tx=0x7f3198009cd0 comp rx=0 tx=0).stop 2023-03-17T09:08:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 -- 172.21.15.35:0/1645298215 shutdown_connections 2023-03-17T09:08:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 --2- 172.21.15.35:0/1645298215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a4104390 0x7f31a410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 --2- 172.21.15.35:0/1645298215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ff350 0x7f31a40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 --2- 172.21.15.35:0/1645298215 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a40ffcf0 0x7f31a4103cb0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 -- 172.21.15.35:0/1645298215 >> 172.21.15.35:0/1645298215 conn(0x7f31a4076330 msgr2=0x7f31a4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 -- 172.21.15.35:0/1645298215 shutdown_connections 2023-03-17T09:08:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.115+0000 7f31ac6de700 1 -- 172.21.15.35:0/1645298215 wait complete. 2023-03-17T09:08:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 Processor -- start 2023-03-17T09:08:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 -- start start 2023-03-17T09:08:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a40ff350 0x7f31a41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ffcf0 0x7f31a41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 0x7f31a419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a419d480 con 0x7f31a4104390 2023-03-17T09:08:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a419d5f0 con 0x7f31a40ffcf0 2023-03-17T09:08:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31ac6de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a419d7b0 con 0x7f31a40ff350 2023-03-17T09:08:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 0x7f31a419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 0x7f31a419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43600/0 (socket says 172.21.15.35:43600) 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 -- 172.21.15.35:0/158830996 learned_addr learned my addr 172.21.15.35:0/158830996 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aa47a700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a40ff350 0x7f31a41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31a9c79700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ffcf0 0x7f31a41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 -- 172.21.15.35:0/158830996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a40ff350 msgr2=0x7f31a41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a40ff350 0x7f31a41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 -- 172.21.15.35:0/158830996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ffcf0 msgr2=0x7f31a41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ffcf0 0x7f31a41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31aac7b700 1 -- 172.21.15.35:0/158830996 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980095f0 con 0x7f31a4104390 2023-03-17T09:08:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.116+0000 7f31a9c79700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ffcf0 0x7f31a41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.117+0000 7f31aac7b700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 0x7f31a419ce40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f319c00ef30 tx=0x7f319c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.117+0000 7f31977fe700 1 -- 172.21.15.35:0/158830996 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c018070 con 0x7f31a4104390 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.117+0000 7f31977fe700 1 -- 172.21.15.35:0/158830996 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f319c00f040 con 0x7f31a4104390 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.117+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a410df10 con 0x7f31a4104390 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.117+0000 7f31977fe700 1 -- 172.21.15.35:0/158830996 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00cc70 con 0x7f31a4104390 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.117+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a410dd80 con 0x7f31a4104390 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.119+0000 7f31977fe700 1 -- 172.21.15.35:0/158830996 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f319c007500 con 0x7f31a4104390 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.120+0000 7f31977fe700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f319009f630 0x7f31900a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.120+0000 7f31aa47a700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f319009f630 0x7f31900a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.120+0000 7f31977fe700 1 -- 172.21.15.35:0/158830996 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f319c0ca0d0 con 0x7f31a4104390 2023-03-17T09:08:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.121+0000 7f31aa47a700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f319009f630 0x7f31900a1ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009c60 tx=0x7f31a0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.121+0000 7f31b886bb80 1 Processor -- start 2023-03-17T09:08:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.121+0000 7f31b886bb80 1 -- start start 2023-03-17T09:08:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.121+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31b886bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff6ae010 con 0x55f1ff7acbe0 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31b886bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff700950 con 0x55f1ff7a7960 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31b886bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff6f9de0 con 0x55f1ff7ad4f0 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7acfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43604/0 (socket says 172.21.15.35:43604) 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 -- 172.21.15.35:0/1034563179 learned_addr learned my addr 172.21.15.35:0/1034563179 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aac7b700 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 -- 172.21.15.35:0/1034563179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 msgr2=0x55f1ff7a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 -- 172.21.15.35:0/1034563179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 msgr2=0x55f1ff7a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:47.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 -- 172.21.15.35:0/1034563179 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1ff57b5d0 con 0x55f1ff7acbe0 2023-03-17T09:08:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aac7b700 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7acfb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e4e0 tx=0x7f31a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4e151aed6157b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f3194ff9700 1 -- 172.21.15.35:0/1034563179 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000ee00 con 0x55f1ff7acbe0 2023-03-17T09:08:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f3194ff9700 1 -- 172.21.15.35:0/1034563179 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31a0021070 con 0x55f1ff7acbe0 2023-03-17T09:08:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.122+0000 7f3194ff9700 1 -- 172.21.15.35:0/1034563179 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a001d740 con 0x55f1ff7acbe0 2023-03-17T09:08:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 -- 172.21.15.35:0/1034563179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 msgr2=0x55f1ff7acfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:08:50.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7acfb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e4e0 tx=0x7f31a0014000 comp rx=0 tx=0).stop 2023-03-17T09:08:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 -- 172.21.15.35:0/1034563179 shutdown_connections 2023-03-17T09:08:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7acfb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1034563179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 -- 172.21.15.35:0/1034563179 >> 172.21.15.35:0/1034563179 conn(0x55f1ff6046b0 msgr2=0x55f1ff7a1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:08:50.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:30 smithi035 ceph-mon[92535]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:08:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:08:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:08:50.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:08:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:08:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 -- 172.21.15.35:0/1034563179 shutdown_connections 2023-03-17T09:08:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.123+0000 7f31b886bb80 1 -- 172.21.15.35:0/1034563179 wait complete. 2023-03-17T09:08:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 -- start start 2023-03-17T09:08:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 Processor -- start 2023-03-17T09:08:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff57d8c0 con 0x55f1ff7acbe0 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff7b12e0 con 0x55f1ff7a7960 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff7b14a0 con 0x55f1ff7ad4f0 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31b886bb80 10 client.0 _ll_register_callbacks cb 0x55f1ff59f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43612/0 (socket says 172.21.15.35:43612) 2023-03-17T09:08:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 -- 172.21.15.35:0/3529087894 learned_addr learned my addr 172.21.15.35:0/3529087894 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31aa47a700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31aac7b700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 -- 172.21.15.35:0/3529087894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 msgr2=0x55f1ff7b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 -- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 msgr2=0x55f1ff7b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31a9c79700 1 -- 172.21.15.35:0/3529087894 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a0017070 con 0x55f1ff7acbe0 2023-03-17T09:08:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.124+0000 7f31aa47a700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:08:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31a9c79700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b0620 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f31980099c0 tx=0x7f31980057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae0c4ab099d1a1f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:08:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f318dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:08:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f318dffb700 1 -- 172.21.15.35:0/3529087894 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319801d040 con 0x55f1ff7acbe0 2023-03-17T09:08:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f318dffb700 1 -- 172.21.15.35:0/3529087894 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f319800bd60 con 0x55f1ff7acbe0 2023-03-17T09:08:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1ff6bc390 con 0x55f1ff7acbe0 2023-03-17T09:08:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f318dffb700 1 -- 172.21.15.35:0/3529087894 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3198003760 con 0x55f1ff7acbe0 2023-03-17T09:08:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 10 client.15942 fetch_fsmap learned FSMap version 29 2023-03-17T09:08:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f1ff527d80 con 0x55f1ff7acbe0 2023-03-17T09:09:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f318dffb700 1 -- 172.21.15.35:0/3529087894 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f1ff6bc390 con 0x55f1ff7acbe0 2023-03-17T09:09:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f318dffb700 1 -- 172.21.15.35:0/3529087894 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3198023960 con 0x55f1ff7acbe0 2023-03-17T09:09:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 10 client.15942 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:09:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:09:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 20 client.15942 populate_metadata read hostname 'smithi035' 2023-03-17T09:09:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff7c10a0 0x55f1ff7c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 4 client.15942 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:09:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.125+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1ff6c8600 con 0x55f1ff7c10a0 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.126+0000 7f31aa47a700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff7c10a0 0x55f1ff7c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.126+0000 7f318dffb700 10 client.15942 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.126+0000 7f31aa47a700 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff7c10a0 0x55f1ff7c34b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0a2eb97addd0ee server_cookie=51b7153fcecd3eeb in_seq=0 out_seq=0 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f318dffb700 1 -- 172.21.15.35:0/3529087894 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f1ff6c8600 con 0x55f1ff7c10a0 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f318dffb700 10 client.15942 handle_command_reply: tid=0 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 client.15942 shutdown 2023-03-17T09:09:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 msgr2=0x55f1ff7b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b0620 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f31980099c0 tx=0x7f31980057e0 comp rx=0 tx=0).stop 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 shutdown_connections 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff7c10a0 0x55f1ff7c34b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f318dffb700 0 client.15942 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 --2- 172.21.15.35:0/3529087894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b0620 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 >> 172.21.15.35:0/3529087894 conn(0x55f1ff6046b0 msgr2=0x55f1ff7a6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 shutdown_connections 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 1 -- 172.21.15.35:0/3529087894 wait complete. 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.127+0000 7f31b886bb80 20 client.15942 trim_cache size 0 max 16384 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 Processor -- start 2023-03-17T09:09:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 -- start start 2023-03-17T09:09:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff79d0f0 con 0x55f1ff7acbe0 2023-03-17T09:09:04.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff7a2000 con 0x55f1ff7a7960 2023-03-17T09:09:04.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31b886bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff7ac830 con 0x55f1ff7ad4f0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31a9c79700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31a9c79700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7a6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43622/0 (socket says 172.21.15.35:43622) 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31a9c79700 1 -- 172.21.15.35:0/1480154455 learned_addr learned my addr 172.21.15.35:0/1480154455 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31aac7b700 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.144+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31a9c79700 1 -- 172.21.15.35:0/1480154455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 msgr2=0x55f1ff7b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31a9c79700 1 -- 172.21.15.35:0/1480154455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 msgr2=0x55f1ff7a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31a9c79700 1 -- 172.21.15.35:0/1480154455 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1ff7a8000 con 0x55f1ff7acbe0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7a6a90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3198009fd0 tx=0x7f3198023ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20007090f9bb1f64 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31957fa700 1 -- 172.21.15.35:0/1480154455 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319801d040 con 0x55f1ff7acbe0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31957fa700 1 -- 172.21.15.35:0/1480154455 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31980059c0 con 0x55f1ff7acbe0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.145+0000 7f31957fa700 1 -- 172.21.15.35:0/1480154455 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198003b60 con 0x55f1ff7acbe0 2023-03-17T09:09:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 -- 172.21.15.35:0/1480154455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 msgr2=0x55f1ff7a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7a6a90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3198009fd0 tx=0x7f3198023ec0 comp rx=0 tx=0).stop 2023-03-17T09:09:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 -- 172.21.15.35:0/1480154455 shutdown_connections 2023-03-17T09:09:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:04.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7a7960 0x55f1ff7a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1480154455 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7a6a90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 -- 172.21.15.35:0/1480154455 >> 172.21.15.35:0/1480154455 conn(0x55f1ff6046b0 msgr2=0x55f1ff7bc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:09:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 -- 172.21.15.35:0/1480154455 shutdown_connections 2023-03-17T09:09:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 -- 172.21.15.35:0/1480154455 wait complete. 2023-03-17T09:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 -- start start 2023-03-17T09:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 Processor -- start 2023-03-17T09:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.146+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff813f70 con 0x55f1ff7a7960 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff8140e0 con 0x55f1ff7acbe0 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ff8142a0 con 0x55f1ff7ad4f0 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 10 client.0 _ll_register_callbacks cb 0x55f1ff59f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43624/0 (socket says 172.21.15.35:43624) 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 -- 172.21.15.35:0/1301359142 learned_addr learned my addr 172.21.15.35:0/1301359142 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aac7b700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 -- 172.21.15.35:0/1301359142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 msgr2=0x55f1ff7b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 -- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7acbe0 msgr2=0x55f1ff7b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 -- 172.21.15.35:0/1301359142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a002a040 con 0x55f1ff7a7960 2023-03-17T09:09:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31aa47a700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b5710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e4b0 tx=0x7f31a00092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15b19c8e28a1237 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:09:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f318dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:09:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f318dffb700 1 -- 172.21.15.35:0/1301359142 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0030440 con 0x55f1ff7a7960 2023-03-17T09:09:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f318dffb700 1 -- 172.21.15.35:0/1301359142 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f31a00305a0 con 0x55f1ff7a7960 2023-03-17T09:09:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.147+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1ff7771e0 con 0x55f1ff7a7960 2023-03-17T09:09:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f318dffb700 1 -- 172.21.15.35:0/1301359142 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a00309e0 con 0x55f1ff7a7960 2023-03-17T09:09:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 10 client.15948 fetch_fsmap learned FSMap version 29 2023-03-17T09:09:09.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f1ff527d80 con 0x55f1ff7a7960 2023-03-17T09:09:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f318dffb700 1 -- 172.21.15.35:0/1301359142 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f1ff7771e0 con 0x55f1ff7a7960 2023-03-17T09:09:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f318dffb700 1 -- 172.21.15.35:0/1301359142 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f31a002d070 con 0x55f1ff7a7960 2023-03-17T09:09:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 10 client.15948 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:09:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:09:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 20 client.15948 populate_metadata read hostname 'smithi035' 2023-03-17T09:09:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff8159b0 0x55f1ff817dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 4 client.15948 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:09:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f1ff57df00 con 0x55f1ff8159b0 2023-03-17T09:09:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.148+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff8159b0 0x55f1ff817dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.149+0000 7f318dffb700 10 client.15948 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:09:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.149+0000 7f31a9c79700 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff8159b0 0x55f1ff817dc0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749ea80065d69183 server_cookie=7665eef962c28250 in_seq=0 out_seq=0 2023-03-17T09:09:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f318dffb700 1 -- 172.21.15.35:0/1301359142 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f1ff57df00 con 0x55f1ff8159b0 2023-03-17T09:09:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f318dffb700 10 client.15948 handle_command_reply: tid=0 2023-03-17T09:09:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 client.15948 shutdown 2023-03-17T09:09:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 msgr2=0x55f1ff7b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:12.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b5710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e4b0 tx=0x7f31a00092f0 comp rx=0 tx=0).stop 2023-03-17T09:09:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 shutdown_connections 2023-03-17T09:09:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1ff8159b0 0x55f1ff817dc0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1ff7ad4f0 0x55f1ff7b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f318dffb700 0 client.15948 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:09:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1ff7a7960 0x55f1ff7b5710 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 --2- 172.21.15.35:0/1301359142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1ff7acbe0 0x55f1ff7b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.152+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 >> 172.21.15.35:0/1301359142 conn(0x55f1ff6046b0 msgr2=0x55f1ff7a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:09:13.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 shutdown_connections 2023-03-17T09:09:15.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31b886bb80 1 -- 172.21.15.35:0/1301359142 wait complete. 2023-03-17T09:09:15.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31b886bb80 20 client.15948 trim_cache size 0 max 16384 2023-03-17T09:09:15.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f319009f630 msgr2=0x7f31900a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f319009f630 0x7f31900a1ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009c60 tx=0x7f31a0009260 comp rx=0 tx=0).stop 2023-03-17T09:09:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 msgr2=0x7f31a419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 0x7f31a419ce40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f319c00ef30 tx=0x7f319c00c3a0 comp rx=0 tx=0).stop 2023-03-17T09:09:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 shutdown_connections 2023-03-17T09:09:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f319009f630 0x7f31900a1ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f31a4104390 0x7f31a419ce40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31a40ff350 0x7f31a41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 --2- 172.21.15.35:0/158830996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31a40ffcf0 0x7f31a41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 >> 172.21.15.35:0/158830996 conn(0x7f31a4076330 msgr2=0x7f31a40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:09:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 shutdown_connections 2023-03-17T09:09:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:30.153+0000 7f31ac6de700 1 -- 172.21.15.35:0/158830996 wait complete. 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:32 smithi035 ceph-mon[92535]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:34 smithi035 ceph-mon[92535]: pgmap v417: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:36 smithi035 ceph-mon[92535]: pgmap v418: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:38 smithi035 ceph-mon[92535]: pgmap v419: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:40 smithi035 ceph-mon[92535]: pgmap v420: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:16.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:42 smithi035 ceph-mon[92535]: pgmap v421: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:16.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:42 smithi078 ceph-mon[94114]: pgmap v710: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:17.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:44 smithi078 ceph-mon[94114]: pgmap v711: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:17.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:46 smithi078 ceph-mon[94114]: pgmap v712: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:17.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:48 smithi078 ceph-mon[94114]: pgmap v713: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:17.758 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:50 smithi078 ceph-mon[94114]: pgmap v714: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:17.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:52 smithi078 ceph-mon[94114]: pgmap v715: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:17.759 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:09:18.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:18.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:18.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:53 smithi078 ceph-mon[94114]: pgmap v716: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:18.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:56 smithi078 ceph-mon[94114]: pgmap v717: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:08:58 smithi078 ceph-mon[94114]: pgmap v718: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:00 smithi078 ceph-mon[94114]: pgmap v719: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:18.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:02 smithi078 ceph-mon[94114]: pgmap v720: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:18.832 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:09:18.832 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: in thread 7eff2b68c700 thread_name:md_log_replay 2023-03-17T09:09:19.665 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:09:19.665 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7eff3c236cf0] 2023-03-17T09:09:19.665 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56309b45371f] 2023-03-17T09:09:19.665 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56309b455953] 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 4: (MDLog::_replay_thread()+0x66d) [0x56309b4c107d] 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56309b174d91] 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7eff3c22c1ca] 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 7: clone() 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:03.352+0000 7eff2b68c700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: in thread 7eff2b68c700 thread_name:md_log_replay 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:21.532 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7eff3c236cf0] 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56309b45371f] 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56309b455953] 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 4: (MDLog::_replay_thread()+0x66d) [0x56309b4c107d] 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56309b174d91] 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7eff3c22c1ca] 2023-03-17T09:09:21.533 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 7: clone() 2023-03-17T09:09:22.942 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:09:22.942 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:22.942 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 0> 2023-03-17T09:09:03.352+0000 7eff2b68c700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:09:22.942 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: in thread 7eff2b68c700 thread_name:md_log_replay 2023-03-17T09:09:25.141 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:25.141 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:09:25.141 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7eff3c236cf0] 2023-03-17T09:09:25.141 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56309b45371f] 2023-03-17T09:09:25.141 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56309b455953] 2023-03-17T09:09:25.991 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 4: (MDLog::_replay_thread()+0x66d) [0x56309b4c107d] 2023-03-17T09:09:25.991 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56309b174d91] 2023-03-17T09:09:25.991 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7eff3c22c1ca] 2023-03-17T09:09:25.991 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 7: clone() 2023-03-17T09:09:25.991 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:09:25.991 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 0> 2023-03-17T09:09:03.352+0000 7eff2b68c700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: in thread 7eff2b68c700 thread_name:md_log_replay 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7eff3c236cf0] 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56309b45371f] 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56309b455953] 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 4: (MDLog::_replay_thread()+0x66d) [0x56309b4c107d] 2023-03-17T09:09:25.992 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56309b174d91] 2023-03-17T09:09:27.675 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7eff3c22c1ca] 2023-03-17T09:09:27.675 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 7: clone() 2023-03-17T09:09:27.675 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:09:28.314 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[134962]: 2023-03-17T09:09:28.314 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:09:28.314 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:04 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:09:28.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:04 smithi078 ceph-mon[94114]: pgmap v721: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:09:28.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:04 smithi078 ceph-mon[94114]: osdmap e120: 12 total, 12 up, 12 in 2023-03-17T09:09:30.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:06 smithi078 ceph-mon[94114]: pgmap v723: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:09:30.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:08 smithi078 ceph-mon[94114]: pgmap v724: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:09:30.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:10 smithi078 ceph-mon[94114]: pgmap v725: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:09:30.280 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:10 smithi078 ceph-mon[94114]: osdmap e121: 12 total, 12 up, 12 in 2023-03-17T09:09:30.281 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:12 smithi078 ceph-mon[94114]: pgmap v727: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:09:30.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:14 smithi078 ceph-mon[94114]: pgmap v728: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 414 B/s wr, 9 op/s 2023-03-17T09:09:30.841 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:09:32.685 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Scheduled restart job, restart counter is at 4. 2023-03-17T09:09:33.715 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 systemd[1]: Stopped Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:09:33.715 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 systemd[1]: Starting Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T09:09:33.715 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 podman[136119]: 2023-03-17T09:09:33.715 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: starting mds.e at 2023-03-17T09:09:33.715 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 bash[136119]: 51784fe916809dbbfe6ce141405d4e81e496d36e8e26d9a22c3e109802d5b5cf 2023-03-17T09:09:33.715 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:09:14 smithi078 systemd[1]: Started Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:09:33.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:42 smithi082 ceph-mon[94281]: pgmap v710: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:33.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:44 smithi082 ceph-mon[94281]: pgmap v711: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:33.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:46 smithi082 ceph-mon[94281]: pgmap v712: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:33.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:48 smithi082 ceph-mon[94281]: pgmap v713: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:33.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:50 smithi082 ceph-mon[94281]: pgmap v714: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:34.412 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:52 smithi082 ceph-mon[94281]: pgmap v715: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:34.412 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:09:34.412 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:53 smithi082 ceph-mon[94281]: pgmap v716: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:56 smithi082 ceph-mon[94281]: pgmap v717: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:09:34.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:09:34.904 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:09:34.904 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:08:58 smithi082 ceph-mon[94281]: pgmap v718: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:34.904 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:00 smithi082 ceph-mon[94281]: pgmap v719: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:34.904 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:02 smithi082 ceph-mon[94281]: pgmap v720: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:34.904 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:04 smithi082 ceph-mon[94281]: pgmap v721: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:09:35.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:04 smithi082 ceph-mon[94281]: osdmap e120: 12 total, 12 up, 12 in 2023-03-17T09:09:35.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:06 smithi082 ceph-mon[94281]: pgmap v723: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:09:35.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:08 smithi082 ceph-mon[94281]: pgmap v724: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:09:35.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:10 smithi082 ceph-mon[94281]: pgmap v725: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:09:36.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:10 smithi082 ceph-mon[94281]: osdmap e121: 12 total, 12 up, 12 in 2023-03-17T09:09:36.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:12 smithi082 ceph-mon[94281]: pgmap v727: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:14 smithi082 ceph-mon[94281]: pgmap v728: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 414 B/s wr, 9 op/s 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:15 smithi082 ceph-mon[94281]: daemon mds.e restarted 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:15 smithi082 ceph-mon[94281]: osdmap e122: 12 total, 12 up, 12 in 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6834/792828454,v1:172.21.15.78:6835/792828454] up:boot 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:16 smithi082 ceph-mon[94281]: pgmap v730: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:18 smithi082 ceph-mon[94281]: pgmap v731: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:09:36.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:20 smithi082 ceph-mon[94281]: pgmap v732: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 565 B/s wr, 10 op/s 2023-03-17T09:09:36.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:22 smithi082 ceph-mon[94281]: pgmap v733: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:09:36.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:24 smithi082 ceph-mon[94281]: pgmap v734: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:09:36.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:26 smithi082 ceph-mon[94281]: pgmap v735: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 389 B/s wr, 10 op/s 2023-03-17T09:09:36.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:28 smithi082 ceph-mon[94281]: pgmap v736: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:09:36.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:30 smithi082 ceph-mon[94281]: pgmap v737: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:37.931 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:32 smithi082 ceph-mon[94281]: pgmap v738: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:39.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:15 smithi078 ceph-mon[94114]: daemon mds.e restarted 2023-03-17T09:09:39.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:15 smithi078 ceph-mon[94114]: osdmap e122: 12 total, 12 up, 12 in 2023-03-17T09:09:39.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6834/792828454,v1:172.21.15.78:6835/792828454] up:boot 2023-03-17T09:09:41.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:09:41.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:09:41.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:16 smithi078 ceph-mon[94114]: pgmap v730: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:09:41.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:18 smithi078 ceph-mon[94114]: pgmap v731: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:09:41.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:20 smithi078 ceph-mon[94114]: pgmap v732: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 565 B/s wr, 10 op/s 2023-03-17T09:09:42.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:22 smithi078 ceph-mon[94114]: pgmap v733: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:09:43.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:24 smithi078 ceph-mon[94114]: pgmap v734: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:09:43.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:26 smithi078 ceph-mon[94114]: pgmap v735: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 389 B/s wr, 10 op/s 2023-03-17T09:09:43.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:28 smithi078 ceph-mon[94114]: pgmap v736: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:09:43.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:30 smithi078 ceph-mon[94114]: pgmap v737: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:43.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:32 smithi078 ceph-mon[94114]: pgmap v738: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:09:43.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:34 smithi078 ceph-mon[94114]: pgmap v739: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:43.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:36 smithi078 ceph-mon[94114]: pgmap v740: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:44.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:38 smithi078 ceph-mon[94114]: pgmap v741: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:44.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:34 smithi082 ceph-mon[94281]: pgmap v739: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:44.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:36 smithi082 ceph-mon[94281]: pgmap v740: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:44.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:38 smithi082 ceph-mon[94281]: pgmap v741: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:44.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:40 smithi082 ceph-mon[94281]: pgmap v742: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:44.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:42 smithi082 ceph-mon[94281]: pgmap v743: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:44.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:40 smithi078 ceph-mon[94114]: pgmap v742: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:45.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:42 smithi078 ceph-mon[94114]: pgmap v743: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:09:45.278 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:44 smithi082 ceph-mon[94281]: pgmap v744: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:46.154 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:44 smithi078 ceph-mon[94114]: pgmap v744: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:09:46.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.276+0000 7f173efbe700 1 -- 172.21.15.35:0/514981901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17381043b0 msgr2=0x7f173810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.276+0000 7f173efbe700 1 --2- 172.21.15.35:0/514981901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17381043b0 0x7f173810bf80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f173000b0d0 tx=0x7f173000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:09:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 -- 172.21.15.35:0/514981901 shutdown_connections 2023-03-17T09:09:47.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 --2- 172.21.15.35:0/514981901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17381043b0 0x7f173810bf80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 --2- 172.21.15.35:0/514981901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17380ff370 0x7f17380ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:47.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 --2- 172.21.15.35:0/514981901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ffd10 0x7f1738103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 -- 172.21.15.35:0/514981901 >> 172.21.15.35:0/514981901 conn(0x7f1738076160 msgr2=0x7f1738076560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:09:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 -- 172.21.15.35:0/514981901 shutdown_connections 2023-03-17T09:09:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 -- 172.21.15.35:0/514981901 wait complete. 2023-03-17T09:09:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 Processor -- start 2023-03-17T09:09:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 -- start start 2023-03-17T09:09:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ff370 0x7f1738196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.277+0000 7f173efbe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 0x7f17381968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173efbe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17381043b0 0x7f173819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173efbe700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173819b350 con 0x7f17380ffd10 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173efbe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173819b4c0 con 0x7f17380ff370 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173efbe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173819b680 con 0x7f17381043b0 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 0x7f17381968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 0x7f17381968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43640/0 (socket says 172.21.15.35:43640) 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 -- 172.21.15.35:0/1398529823 learned_addr learned my addr 172.21.15.35:0/1398529823 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173d55b700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17381043b0 0x7f173819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ff370 0x7f1738196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 -- 172.21.15.35:0/1398529823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17381043b0 msgr2=0x7f173819ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17381043b0 0x7f173819ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 -- 172.21.15.35:0/1398529823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ff370 msgr2=0x7f1738196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ff370 0x7f1738196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 -- 172.21.15.35:0/1398529823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730009d00 con 0x7f17380ffd10 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ff370 0x7f1738196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1737fff700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 0x7f17381968b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f172400e940 tx=0x7f172400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1735ffb700 1 -- 172.21.15.35:0/1398529823 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724009730 con 0x7f17380ffd10 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f1735ffb700 1 -- 172.21.15.35:0/1398529823 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f172400ee90 con 0x7f17380ffd10 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.278+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173810efe0 con 0x7f17380ffd10 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.279+0000 7f1735ffb700 1 -- 172.21.15.35:0/1398529823 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724018420 con 0x7f17380ffd10 2023-03-17T09:09:52.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.279+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173810ee50 con 0x7f17380ffd10 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.281+0000 7f1735ffb700 1 -- 172.21.15.35:0/1398529823 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f172400cbd0 con 0x7f17380ffd10 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.282+0000 7f1735ffb700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f172809f640 0x7f17280a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.282+0000 7f1735ffb700 1 -- 172.21.15.35:0/1398529823 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1724014070 con 0x7f17380ffd10 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.282+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f172809f640 0x7f17280a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.282+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f172809f640 0x7f17280a1af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f172c009cb0 tx=0x7f172c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.282+0000 7f174b14bb80 1 Processor -- start 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.282+0000 7f174b14bb80 1 -- start start 2023-03-17T09:09:52.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16573fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1656e960 0x55ee1656ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f174b14bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee16475010 con 0x55ee165744f0 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f174b14bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee164c7950 con 0x55ee16573be0 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f174b14bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee164c0de0 con 0x55ee1656e960 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43648/0 (socket says 172.21.15.35:43648) 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 -- 172.21.15.35:0/872667428 learned_addr learned my addr 172.21.15.35:0/872667428 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f173d55b700 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1656e960 0x55ee1656ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f173cd5a700 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16573fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 -- 172.21.15.35:0/872667428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1656e960 msgr2=0x55ee1656ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1656e960 0x55ee1656ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 -- 172.21.15.35:0/872667428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 msgr2=0x55ee16573fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16573fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 -- 172.21.15.35:0/872667428 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee163425d0 con 0x55ee165744f0 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f173cd5a700 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16573fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:09:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1737fff700 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656e420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1724094850 tx=0x7f1724097d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3b639417218f21 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1722ffd700 1 -- 172.21.15.35:0/872667428 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172409c170 con 0x55ee165744f0 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1722ffd700 1 -- 172.21.15.35:0/872667428 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17240985b0 con 0x55ee165744f0 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.283+0000 7f1722ffd700 1 -- 172.21.15.35:0/872667428 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240a0310 con 0x55ee165744f0 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 -- 172.21.15.35:0/872667428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 msgr2=0x55ee1656e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656e420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1724094850 tx=0x7f1724097d30 comp rx=0 tx=0).stop 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 -- 172.21.15.35:0/872667428 shutdown_connections 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1656e960 0x55ee1656ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16573fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 --2- 172.21.15.35:0/872667428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656e420 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 -- 172.21.15.35:0/872667428 >> 172.21.15.35:0/872667428 conn(0x55ee163cb6b0 msgr2=0x55ee16568a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:09:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 -- 172.21.15.35:0/872667428 shutdown_connections 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.284+0000 7f174b14bb80 1 -- 172.21.15.35:0/872667428 wait complete. 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 -- start start 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 Processor -- start 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16577740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee165744f0 0x55ee16577e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee163448c0 con 0x55ee1656e960 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee165785f0 con 0x55ee16573be0 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee16584030 con 0x55ee165744f0 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f174b14bb80 10 client.0 _ll_register_callbacks cb 0x55ee16366230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f173cd5a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f173cd5a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43652/0 (socket says 172.21.15.35:43652) 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.285+0000 7f173cd5a700 1 -- 172.21.15.35:0/1699502274 learned_addr learned my addr 172.21.15.35:0/1699502274 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:09:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f1737fff700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16577740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173d55b700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee165744f0 0x55ee16577e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173cd5a700 1 -- 172.21.15.35:0/1699502274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee165744f0 msgr2=0x55ee16577e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee165744f0 0x55ee16577e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173cd5a700 1 -- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 msgr2=0x55ee16577740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16577740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173cd5a700 1 -- 172.21.15.35:0/1699502274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173810ee50 con 0x55ee1656e960 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173d55b700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee165744f0 0x55ee16577e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657a4c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f172c004510 tx=0x7f172c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc650f23abf89ad8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f1717fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f1717fff700 1 -- 172.21.15.35:0/1699502274 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c003ea0 con 0x55ee1656e960 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f1717fff700 1 -- 172.21.15.35:0/1699502274 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f172c018070 con 0x55ee1656e960 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee16483390 con 0x55ee1656e960 2023-03-17T09:09:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f1717fff700 1 -- 172.21.15.35:0/1699502274 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f172c004540 con 0x55ee1656e960 2023-03-17T09:09:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f174b14bb80 10 client.15960 fetch_fsmap learned FSMap version 29 2023-03-17T09:09:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.286+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ee162eed80 con 0x55ee1656e960 2023-03-17T09:09:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f1717fff700 1 -- 172.21.15.35:0/1699502274 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee16483390 con 0x55ee1656e960 2023-03-17T09:09:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f1717fff700 1 -- 172.21.15.35:0/1699502274 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f172c020890 con 0x55ee1656e960 2023-03-17T09:09:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f174b14bb80 10 client.15960 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:09:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f174b14bb80 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:09:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f174b14bb80 20 client.15960 populate_metadata read hostname 'smithi035' 2023-03-17T09:09:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee16588100 0x55ee1658a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f174b14bb80 4 client.15960 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee1648f600 con 0x55ee16588100 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f1737fff700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee16588100 0x55ee1658a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f1717fff700 10 client.15960 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.287+0000 7f1737fff700 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee16588100 0x55ee1658a510 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc841bbd1864cbd7 server_cookie=88933c72d280683b in_seq=0 out_seq=0 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f1717fff700 1 -- 172.21.15.35:0/1699502274 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ee1648f600 con 0x55ee16588100 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f1717fff700 10 client.15960 handle_command_reply: tid=0 2023-03-17T09:10:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 client.15960 shutdown 2023-03-17T09:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 msgr2=0x55ee1657a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657a4c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f172c004510 tx=0x7f172c0047c0 comp rx=0 tx=0).stop 2023-03-17T09:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 shutdown_connections 2023-03-17T09:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee16588100 0x55ee1658a510 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee165744f0 0x55ee16577e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657a4c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1699502274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee16573be0 0x55ee16577740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f1717fff700 0 client.15960 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 >> 172.21.15.35:0/1699502274 conn(0x55ee163cb6b0 msgr2=0x55ee1656d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.288+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 shutdown_connections 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.289+0000 7f174b14bb80 1 -- 172.21.15.35:0/1699502274 wait complete. 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.289+0000 7f174b14bb80 20 client.15960 trim_cache size 0 max 16384 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 Processor -- start 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 -- start start 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1656e960 0x55ee1657ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:02.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1656e7d0 con 0x55ee165744f0 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee16578d20 con 0x55ee1656e960 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f174b14bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee16584bb0 con 0x55ee16573be0 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43664/0 (socket says 172.21.15.35:43664) 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 -- 172.21.15.35:0/1205503529 learned_addr learned my addr 172.21.15.35:0/1205503529 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173cd5a700 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1656e960 0x55ee1657ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f1737fff700 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 -- 172.21.15.35:0/1205503529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 msgr2=0x55ee1657a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:02.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 -- 172.21.15.35:0/1205503529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1656e960 msgr2=0x55ee1657ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1656e960 0x55ee1657ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.304+0000 7f173d55b700 1 -- 172.21.15.35:0/1205503529 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1656f000 con 0x55ee165744f0 2023-03-17T09:10:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f173d55b700 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656da90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1730005b30 tx=0x7f1730005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac69009c11acbf22 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f17237fe700 1 -- 172.21.15.35:0/1205503529 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730021070 con 0x55ee165744f0 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f17237fe700 1 -- 172.21.15.35:0/1205503529 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17300094a0 con 0x55ee165744f0 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f17237fe700 1 -- 172.21.15.35:0/1205503529 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000e040 con 0x55ee165744f0 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 -- 172.21.15.35:0/1205503529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 msgr2=0x55ee1656da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656da90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1730005b30 tx=0x7f1730005b60 comp rx=0 tx=0).stop 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 -- 172.21.15.35:0/1205503529 shutdown_connections 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee165744f0 0x55ee1656da90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1656e960 0x55ee1657ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 --2- 172.21.15.35:0/1205503529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 -- 172.21.15.35:0/1205503529 >> 172.21.15.35:0/1205503529 conn(0x55ee163cb6b0 msgr2=0x55ee16584470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 -- 172.21.15.35:0/1205503529 shutdown_connections 2023-03-17T09:10:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.305+0000 7f174b14bb80 1 -- 172.21.15.35:0/1205503529 wait complete. 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.306+0000 7f174b14bb80 1 -- start start 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.306+0000 7f174b14bb80 1 Processor -- start 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.306+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.306+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.306+0000 7f174b14bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee165744f0 0x55ee165d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee165d54a0 con 0x55ee1656e960 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee165d5610 con 0x55ee165744f0 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee165d57d0 con 0x55ee16573be0 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 10 client.0 _ll_register_callbacks cb 0x55ee16366230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43666/0 (socket says 172.21.15.35:43666) 2023-03-17T09:10:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 -- 172.21.15.35:0/3991785712 learned_addr learned my addr 172.21.15.35:0/3991785712 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:10:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f1737fff700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 -- 172.21.15.35:0/3991785712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 msgr2=0x55ee1657d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173d55b700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee165744f0 0x55ee165d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 -- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee165744f0 msgr2=0x55ee165d4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee165744f0 0x55ee165d4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 -- 172.21.15.35:0/3991785712 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173810c7c0 con 0x55ee1656e960 2023-03-17T09:10:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f1737fff700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:10:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f173cd5a700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657d120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f172c0044e0 tx=0x7f172c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1069c726df7cd8c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f1717fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:10:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f1717fff700 1 -- 172.21.15.35:0/3991785712 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c003ea0 con 0x55ee1656e960 2023-03-17T09:10:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f1717fff700 1 -- 172.21.15.35:0/3991785712 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f172c018040 con 0x55ee1656e960 2023-03-17T09:10:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1653e1e0 con 0x55ee1656e960 2023-03-17T09:10:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f1717fff700 1 -- 172.21.15.35:0/3991785712 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f172c020810 con 0x55ee1656e960 2023-03-17T09:10:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 10 client.15966 fetch_fsmap learned FSMap version 29 2023-03-17T09:10:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.307+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ee162d7c00 con 0x55ee1656e960 2023-03-17T09:10:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f1717fff700 1 -- 172.21.15.35:0/3991785712 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee1653e1e0 con 0x55ee1656e960 2023-03-17T09:10:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f1717fff700 1 -- 172.21.15.35:0/3991785712 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f172c03d4d0 con 0x55ee1656e960 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f174b14bb80 10 client.15966 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f174b14bb80 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f174b14bb80 20 client.15966 populate_metadata read hostname 'smithi035' 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f174b14bb80 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee165dcfc0 0x55ee165df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f174b14bb80 4 client.15966 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee16344f00 con 0x55ee165dcfc0 2023-03-17T09:10:10.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.308+0000 7f1737fff700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee165dcfc0 0x55ee165df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.309+0000 7f1717fff700 10 client.15966 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.309+0000 7f1737fff700 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee165dcfc0 0x55ee165df3d0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465a14846e8bcf9 server_cookie=d0f9f0464e36eeba in_seq=0 out_seq=0 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.312+0000 7f1717fff700 1 -- 172.21.15.35:0/3991785712 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee16344f00 con 0x55ee165dcfc0 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.312+0000 7f1717fff700 10 client.15966 handle_command_reply: tid=0 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 client.15966 shutdown 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 msgr2=0x55ee1657d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657d120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f172c0044e0 tx=0x7f172c009f50 comp rx=0 tx=0).stop 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 shutdown_connections 2023-03-17T09:10:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee165dcfc0 0x55ee165df3d0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee165744f0 0x55ee165d4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f1717fff700 0 client.15966 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1656e960 0x55ee1657d120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 --2- 172.21.15.35:0/3991785712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee16573be0 0x55ee1657d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 >> 172.21.15.35:0/3991785712 conn(0x55ee163cb6b0 msgr2=0x55ee1656da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 shutdown_connections 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 1 -- 172.21.15.35:0/3991785712 wait complete. 2023-03-17T09:10:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f174b14bb80 20 client.15966 trim_cache size 0 max 16384 2023-03-17T09:10:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f172809f640 msgr2=0x7f17280a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f173efbe700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f172809f640 0x7f17280a1af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f172c009cb0 tx=0x7f172c009260 comp rx=0 tx=0).stop 2023-03-17T09:10:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 msgr2=0x7f17381968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.313+0000 7f173efbe700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 0x7f17381968b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f172400e940 tx=0x7f172400ec50 comp rx=0 tx=0).stop 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 shutdown_connections 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f172809f640 0x7f17280a1af0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17381043b0 0x7f173819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380ff370 0x7f1738196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 --2- 172.21.15.35:0/1398529823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17380ffd10 0x7f17381968b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 >> 172.21.15.35:0/1398529823 conn(0x7f1738076160 msgr2=0x7f1738102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 shutdown_connections 2023-03-17T09:10:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:43.314+0000 7f173efbe700 1 -- 172.21.15.35:0/1398529823 wait complete. 2023-03-17T09:10:14.939 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:44 smithi035 ceph-mon[92535]: pgmap v422: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:14.939 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:46 smithi035 ceph-mon[92535]: pgmap v423: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:14.939 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:48 smithi035 ceph-mon[92535]: pgmap v424: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:14.939 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:50 smithi035 ceph-mon[92535]: pgmap v425: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:14.942 DEBUG:teuthology.orchestra.run.smithi035:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4aa791bf129eece187e94ddbfa7c2b475588cf0c 2023-03-17T09:10:15.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:52 smithi035 ceph-mon[92535]: pgmap v426: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:16.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:54 smithi035 ceph-mon[92535]: pgmap v427: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:16.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:46 smithi078 ceph-mon[94114]: pgmap v745: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:16.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:48 smithi078 ceph-mon[94114]: pgmap v746: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:10:16.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:50 smithi078 ceph-mon[94114]: pgmap v747: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:16.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:52 smithi078 ceph-mon[94114]: pgmap v748: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:16.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:54 smithi078 ceph-mon[94114]: pgmap v749: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:10:17.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:56 smithi078 ceph-mon[94114]: pgmap v750: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:17.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:10:17.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:58 smithi078 ceph-mon[94114]: pgmap v751: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:10:17.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:17.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:17.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:09:59 smithi078 ceph-mon[94114]: pgmap v752: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:01 smithi078 ceph-mon[94114]: pgmap v753: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:04 smithi078 ceph-mon[94114]: pgmap v754: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:10:20.502 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:06 smithi078 ceph-mon[94114]: pgmap v755: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:10:21.329 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:08 smithi078 ceph-mon[94114]: pgmap v756: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:10:21.329 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:09 smithi078 ceph-mon[94114]: osdmap e123: 12 total, 12 up, 12 in 2023-03-17T09:10:21.329 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:10 smithi078 ceph-mon[94114]: pgmap v758: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:10:21.329 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:12 smithi078 ceph-mon[94114]: pgmap v759: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:10:21.329 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:14 smithi078 ceph-mon[94114]: pgmap v760: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:10:21.330 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:16 smithi078 ceph-mon[94114]: osdmap e124: 12 total, 12 up, 12 in 2023-03-17T09:10:21.330 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:16 smithi078 ceph-mon[94114]: pgmap v762: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:10:21.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:46 smithi082 ceph-mon[94281]: pgmap v745: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:48 smithi082 ceph-mon[94281]: pgmap v746: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:50 smithi082 ceph-mon[94281]: pgmap v747: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:52 smithi082 ceph-mon[94281]: pgmap v748: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:54 smithi082 ceph-mon[94281]: pgmap v749: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:56 smithi082 ceph-mon[94281]: pgmap v750: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:58 smithi082 ceph-mon[94281]: pgmap v751: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:10:21.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:10:21.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:21.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:09:59 smithi082 ceph-mon[94281]: pgmap v752: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:21.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T09:10:21.991 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:01 smithi082 ceph-mon[94281]: pgmap v753: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:22.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:04 smithi082 ceph-mon[94281]: pgmap v754: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:10:22.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:06 smithi082 ceph-mon[94281]: pgmap v755: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:08 smithi082 ceph-mon[94281]: pgmap v756: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:09 smithi082 ceph-mon[94281]: osdmap e123: 12 total, 12 up, 12 in 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:10 smithi082 ceph-mon[94281]: pgmap v758: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:12 smithi082 ceph-mon[94281]: pgmap v759: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:14 smithi082 ceph-mon[94281]: pgmap v760: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:16 smithi082 ceph-mon[94281]: osdmap e124: 12 total, 12 up, 12 in 2023-03-17T09:10:22.998 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:16 smithi082 ceph-mon[94281]: pgmap v762: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:10:23.000 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:18 smithi082 ceph-mon[94281]: pgmap v763: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:10:25.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:20 smithi082 ceph-mon[94281]: pgmap v764: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:10:25.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:22 smithi082 ceph-mon[94281]: pgmap v765: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:10:25.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:18 smithi078 ceph-mon[94114]: pgmap v763: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:10:25.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:20 smithi078 ceph-mon[94114]: pgmap v764: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:10:25.163 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:22 smithi078 ceph-mon[94114]: pgmap v765: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:10:26.222 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:24 smithi082 ceph-mon[94281]: pgmap v766: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:10:28.477 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:24 smithi078 ceph-mon[94114]: pgmap v766: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:10:29.095 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:26 smithi082 ceph-mon[94281]: pgmap v767: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 915 B/s wr, 11 op/s 2023-03-17T09:10:30.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:28 smithi082 ceph-mon[94281]: pgmap v768: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:10:30.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:26 smithi078 ceph-mon[94114]: pgmap v767: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 915 B/s wr, 11 op/s 2023-03-17T09:10:30.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:28 smithi078 ceph-mon[94114]: pgmap v768: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:10:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 -- 172.21.15.35:0/3238167518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8100970 msgr2=0x7f8da8100de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/3238167518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8100970 0x7f8da8100de0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8d980099c0 tx=0x7f8d98009cd0 comp rx=0 tx=0).stop 2023-03-17T09:10:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 -- 172.21.15.35:0/3238167518 shutdown_connections 2023-03-17T09:10:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/3238167518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8101320 0x7f8da810cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/3238167518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da8105140 0x7f8da8105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/3238167518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8100970 0x7f8da8100de0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 -- 172.21.15.35:0/3238167518 >> 172.21.15.35:0/3238167518 conn(0x7f8da80774c0 msgr2=0x7f8da80778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 -- 172.21.15.35:0/3238167518 shutdown_connections 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.436+0000 7f8dad7c4700 1 -- 172.21.15.35:0/3238167518 wait complete. 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 Processor -- start 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 -- start start 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8100970 0x7f8da8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 0x7f8da8196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da8105140 0x7f8da819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da819b230 con 0x7f8da8101320 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da819b3a0 con 0x7f8da8100970 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8dad7c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da819b560 con 0x7f8da8105140 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 0x7f8da8196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 0x7f8da8196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43680/0 (socket says 172.21.15.35:43680) 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da67fc700 1 -- 172.21.15.35:0/437716953 learned_addr learned my addr 172.21.15.35:0/437716953 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8100970 0x7f8da8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da77fe700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da8105140 0x7f8da819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da67fc700 1 -- 172.21.15.35:0/437716953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da8105140 msgr2=0x7f8da819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.437+0000 7f8da67fc700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da8105140 0x7f8da819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8da67fc700 1 -- 172.21.15.35:0/437716953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8100970 msgr2=0x7f8da8196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8da67fc700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8100970 0x7f8da8196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8da67fc700 1 -- 172.21.15.35:0/437716953 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980095f0 con 0x7f8da8101320 2023-03-17T09:10:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8100970 0x7f8da8196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8da67fc700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 0x7f8da8196790 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009f50 tx=0x7f8d980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8d8ffff700 1 -- 172.21.15.35:0/437716953 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9801d070 con 0x7f8da8101320 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8d8ffff700 1 -- 172.21.15.35:0/437716953 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d98004040 con 0x7f8da8101320 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da81101a0 con 0x7f8da8101320 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8d8ffff700 1 -- 172.21.15.35:0/437716953 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98022c80 con 0x7f8da8101320 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.438+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da8110010 con 0x7f8da8101320 2023-03-17T09:10:31.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.440+0000 7f8d8ffff700 1 -- 172.21.15.35:0/437716953 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8d98022470 con 0x7f8da8101320 2023-03-17T09:10:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.441+0000 7f8d8ffff700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8d9009f640 0x7f8d900a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.441+0000 7f8d8ffff700 1 -- 172.21.15.35:0/437716953 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8d980cbaf0 con 0x7f8da8101320 2023-03-17T09:10:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.441+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8d9009f640 0x7f8d900a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.441+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8d9009f640 0x7f8d900a1af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005950 tx=0x7f8d9c005f50 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 Processor -- start 2023-03-17T09:10:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 -- start start 2023-03-17T09:10:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 0x556373a73fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a6e960 0x556373a6ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373975010 con 0x556373a73be0 2023-03-17T09:10:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563739c7950 con 0x556373a744f0 2023-03-17T09:10:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8db9951b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563739c0de0 con 0x556373a6e960 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 0x556373a73fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 0x556373a73fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43686/0 (socket says 172.21.15.35:43686) 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8da6ffd700 1 -- 172.21.15.35:0/1606670143 learned_addr learned my addr 172.21.15.35:0/1606670143 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.442+0000 7f8da67fc700 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da77fe700 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a6e960 0x556373a6ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da6ffd700 1 -- 172.21.15.35:0/1606670143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a6e960 msgr2=0x556373a6ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a6e960 0x556373a6ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da6ffd700 1 -- 172.21.15.35:0/1606670143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 msgr2=0x556373a6e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da6ffd700 1 -- 172.21.15.35:0/1606670143 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563738425d0 con 0x556373a73be0 2023-03-17T09:10:34.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 0x556373a73fb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00ed30 tx=0x7f8d9c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32da954d0d9646b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:34.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8d8d7fa700 1 -- 172.21.15.35:0/1606670143 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c010cd0 con 0x556373a73be0 2023-03-17T09:10:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8d8d7fa700 1 -- 172.21.15.35:0/1606670143 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d9c010e30 con 0x556373a73be0 2023-03-17T09:10:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.443+0000 7f8d8d7fa700 1 -- 172.21.15.35:0/1606670143 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c01d450 con 0x556373a73be0 2023-03-17T09:10:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 -- 172.21.15.35:0/1606670143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 msgr2=0x556373a73fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 0x556373a73fb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00ed30 tx=0x7f8d9c011000 comp rx=0 tx=0).stop 2023-03-17T09:10:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 -- 172.21.15.35:0/1606670143 shutdown_connections 2023-03-17T09:10:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a6e960 0x556373a6ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a73be0 0x556373a73fb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1606670143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 -- 172.21.15.35:0/1606670143 >> 172.21.15.35:0/1606670143 conn(0x5563738cb6b0 msgr2=0x556373a68a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 -- 172.21.15.35:0/1606670143 shutdown_connections 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 -- 172.21.15.35:0/1606670143 wait complete. 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 -- start start 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 Processor -- start 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.444+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a6e960 0x556373a7a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a77660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 0x556373a77c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563738448c0 con 0x556373a744f0 2023-03-17T09:10:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373a78390 con 0x556373a6e960 2023-03-17T09:10:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373a84000 con 0x556373a73be0 2023-03-17T09:10:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 10 client.0 _ll_register_callbacks cb 0x556373866230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:10:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 0x556373a77c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a6e960 0x556373a7a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 0x556373a77c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43696/0 (socket says 172.21.15.35:43696) 2023-03-17T09:10:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 -- 172.21.15.35:0/1132188414 learned_addr learned my addr 172.21.15.35:0/1132188414 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:10:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da67fc700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a77660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 -- 172.21.15.35:0/1132188414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 msgr2=0x556373a77660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a77660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 -- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a6e960 msgr2=0x556373a7a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a6e960 0x556373a7a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 -- 172.21.15.35:0/1132188414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c00ea10 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a6e960 0x556373a7a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8da77fe700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 0x556373a77c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8da00078c0 tx=0x7f8da0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae97cc6a258f851 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8d8aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8d8aff5700 1 -- 172.21.15.35:0/1132188414 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0010670 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8d8aff5700 1 -- 172.21.15.35:0/1132188414 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8da00107d0 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.445+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556373983390 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8d8aff5700 1 -- 172.21.15.35:0/1132188414 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8da0010990 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 10 client.15978 fetch_fsmap learned FSMap version 29 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5563737eed80 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8d8aff5700 1 -- 172.21.15.35:0/1132188414 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556373983390 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8d8aff5700 1 -- 172.21.15.35:0/1132188414 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8da0016c10 con 0x556373a744f0 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 10 client.15978 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:10:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:10:39.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:56 smithi035 ceph-mon[92535]: pgmap v428: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:39.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 08:59:58 smithi035 ceph-mon[92535]: pgmap v429: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.2 KiB/s wr, 15 op/s 2023-03-17T09:10:39.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:00 smithi035 ceph-mon[92535]: pgmap v430: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2023-03-17T09:10:41.445 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T09:10:41.445 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:02 smithi035 ceph-mon[92535]: pgmap v431: 97 pgs: 97 active+clean; 1.3 MiB data, 100 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2023-03-17T09:10:41.445 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:04 smithi035 ceph-mon[92535]: pgmap v432: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 47 KiB/s wr, 29 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:06 smithi035 ceph-mon[92535]: pgmap v433: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 25 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:08 smithi035 ceph-mon[92535]: pgmap v434: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 30 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:10 smithi035 ceph-mon[92535]: pgmap v435: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 46 KiB/s wr, 23 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:10 smithi035 ceph-mon[92535]: osdmap e101: 12 total, 12 up, 12 in 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:12 smithi035 ceph-mon[92535]: pgmap v437: 97 pgs: 97 active+clean; 1.3 MiB data, 101 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:14 smithi035 ceph-mon[92535]: pgmap v438: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:16 smithi035 ceph-mon[92535]: osdmap e102: 12 total, 12 up, 12 in 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:16 smithi035 ceph-mon[92535]: pgmap v440: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:18 smithi035 ceph-mon[92535]: pgmap v441: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:20 smithi035 ceph-mon[92535]: pgmap v442: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-17T09:10:41.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:22 smithi035 ceph-mon[92535]: pgmap v443: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-03-17T09:10:41.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:24 smithi035 ceph-mon[92535]: pgmap v444: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:10:41.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:26 smithi035 ceph-mon[92535]: pgmap v445: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:10:42.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:28 smithi035 ceph-mon[92535]: pgmap v446: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:42.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:30 smithi035 ceph-mon[92535]: pgmap v447: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:42.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:32 smithi035 ceph-mon[92535]: pgmap v448: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:42.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:34 smithi035 ceph-mon[92535]: pgmap v449: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:42.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:36 smithi035 ceph-mon[92535]: pgmap v450: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:43.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:38 smithi035 ceph-mon[92535]: pgmap v451: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:40 smithi035 ceph-mon[92535]: pgmap v452: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:42 smithi035 ceph-mon[92535]: pgmap v453: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:44 smithi035 ceph-mon[92535]: pgmap v454: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:43.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:46 smithi035 ceph-mon[92535]: pgmap v455: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:43.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:48 smithi035 ceph-mon[92535]: pgmap v456: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:43.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:50 smithi035 ceph-mon[92535]: pgmap v457: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:43.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:52 smithi035 ceph-mon[92535]: pgmap v458: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:43.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:54 smithi035 ceph-mon[92535]: pgmap v459: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:43.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:56 smithi035 ceph-mon[92535]: pgmap v460: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:43.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:00:58 smithi035 ceph-mon[92535]: pgmap v461: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:10:45.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:00 smithi035 ceph-mon[92535]: pgmap v462: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:45.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:02 smithi035 ceph-mon[92535]: pgmap v463: 97 pgs: 97 active+clean; 1.3 MiB data, 102 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:10:46.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:04 smithi035 ceph-mon[92535]: pgmap v464: 97 pgs: 97 active+clean; 1.3 MiB data, 107 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:10:46.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:05 smithi035 ceph-mon[92535]: osdmap e103: 12 total, 12 up, 12 in 2023-03-17T09:10:47.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:06 smithi035 ceph-mon[92535]: pgmap v466: 97 pgs: 97 active+clean; 1.3 MiB data, 107 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:10:47.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:08 smithi035 ceph-mon[92535]: pgmap v467: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:10:47.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:10 smithi035 ceph-mon[92535]: pgmap v468: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:10:47.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:10 smithi035 ceph-mon[92535]: osdmap e104: 12 total, 12 up, 12 in 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:12 smithi035 ceph-mon[92535]: pgmap v470: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:14 smithi035 ceph-mon[92535]: pgmap v471: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:16 smithi035 ceph-mon[92535]: pgmap v472: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:18 smithi035 ceph-mon[92535]: pgmap v473: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:20 smithi035 ceph-mon[92535]: pgmap v474: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:22 smithi035 ceph-mon[92535]: pgmap v475: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 463 B/s wr, 9 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:24 smithi035 ceph-mon[92535]: pgmap v476: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:26 smithi035 ceph-mon[92535]: pgmap v477: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:28 smithi035 ceph-mon[92535]: pgmap v478: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:30 smithi035 ceph-mon[92535]: pgmap v479: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:48.037 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:32 smithi035 ceph-mon[92535]: pgmap v480: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:48.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:51.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:10:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:10:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:10:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:10:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 20 client.15978 populate_metadata read hostname 'smithi035' 2023-03-17T09:10:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373a880b0 0x556373a8a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 4 client.15978 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:10:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55637398f600 con 0x556373a880b0 2023-03-17T09:10:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.446+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373a880b0 0x556373a8a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.447+0000 7f8d8aff5700 10 client.15978 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.447+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373a880b0 0x556373a8a4c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c96bbcb55ab8cc10 server_cookie=452f3dbeac41a221 in_seq=0 out_seq=0 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.447+0000 7f8d8aff5700 1 -- 172.21.15.35:0/1132188414 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55637398f600 con 0x556373a880b0 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.447+0000 7f8d8aff5700 10 client.15978 handle_command_reply: tid=0 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.447+0000 7f8db9951b80 1 client.15978 shutdown 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 msgr2=0x556373a77c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 0x556373a77c20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8da00078c0 tx=0x7f8da0007bd0 comp rx=0 tx=0).stop 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 shutdown_connections 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373a880b0 0x556373a8a4c0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a744f0 0x556373a77c20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a6e960 0x556373a7a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8d8aff5700 0 client.15978 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 --2- 172.21.15.35:0/1132188414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a77660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 >> 172.21.15.35:0/1132188414 conn(0x5563738cb6b0 msgr2=0x556373a6d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 shutdown_connections 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 1 -- 172.21.15.35:0/1132188414 wait complete. 2023-03-17T09:10:57.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.448+0000 7f8db9951b80 20 client.15978 trim_cache size 0 max 16384 2023-03-17T09:10:57.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 Processor -- start 2023-03-17T09:10:57.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 -- start start 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373a7ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a79f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373a6a6a0 con 0x556373a6e960 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373a85760 con 0x556373a744f0 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8db9951b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373a78200 con 0x556373a73be0 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373a7ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373a7ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43700/0 (socket says 172.21.15.35:43700) 2023-03-17T09:10:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 -- 172.21.15.35:0/3318948370 learned_addr learned my addr 172.21.15.35:0/3318948370 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:10:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da77fe700 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 -- 172.21.15.35:0/3318948370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 msgr2=0x556373a79f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a79f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 -- 172.21.15.35:0/3318948370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 msgr2=0x556373a6d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.463+0000 7f8da6ffd700 1 -- 172.21.15.35:0/3318948370 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556373987130 con 0x556373a6e960 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373a7ef50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00a540 tx=0x7f8d9c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995b9d4b35fb832d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8d8dffb700 1 -- 172.21.15.35:0/3318948370 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c005550 con 0x556373a6e960 2023-03-17T09:10:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8d8dffb700 1 -- 172.21.15.35:0/3318948370 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d9c034a50 con 0x556373a6e960 2023-03-17T09:10:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8d8dffb700 1 -- 172.21.15.35:0/3318948370 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c034540 con 0x556373a6e960 2023-03-17T09:11:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 -- 172.21.15.35:0/3318948370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 msgr2=0x556373a7ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373a7ef50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00a540 tx=0x7f8d9c0054e0 comp rx=0 tx=0).stop 2023-03-17T09:11:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 -- 172.21.15.35:0/3318948370 shutdown_connections 2023-03-17T09:11:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a744f0 0x556373a6d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373a7ef50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 --2- 172.21.15.35:0/3318948370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a73be0 0x556373a79f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 -- 172.21.15.35:0/3318948370 >> 172.21.15.35:0/3318948370 conn(0x5563738cb6b0 msgr2=0x556373a716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 -- 172.21.15.35:0/3318948370 shutdown_connections 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.464+0000 7f8db9951b80 1 -- 172.21.15.35:0/3318948370 wait complete. 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 -- start start 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 Processor -- start 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373ad0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a73be0 0x556373ad05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a744f0 0x556373ad4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373ad54a0 con 0x556373a6e960 2023-03-17T09:11:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373ad5610 con 0x556373a73be0 2023-03-17T09:11:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556373ad57d0 con 0x556373a744f0 2023-03-17T09:11:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8db9951b80 10 client.0 _ll_register_callbacks cb 0x556373866230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:11:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373ad0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373ad0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43706/0 (socket says 172.21.15.35:43706) 2023-03-17T09:11:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 -- 172.21.15.35:0/2190597829 learned_addr learned my addr 172.21.15.35:0/2190597829 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da67fc700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a73be0 0x556373ad05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:01.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da77fe700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a744f0 0x556373ad4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 -- 172.21.15.35:0/2190597829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a744f0 msgr2=0x556373ad4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a744f0 0x556373ad4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 -- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a73be0 msgr2=0x556373ad05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a73be0 0x556373ad05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.465+0000 7f8da6ffd700 1 -- 172.21.15.35:0/2190597829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563738425d0 con 0x556373a6e960 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8da77fe700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a744f0 0x556373ad4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8da6ffd700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373ad0090 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c010710 tx=0x7f8d9c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f66c8c30c74f50 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8d8aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8d8aff5700 1 -- 172.21.15.35:0/2190597829 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c034e20 con 0x556373a6e960 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8d8aff5700 1 -- 172.21.15.35:0/2190597829 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8d9c034040 con 0x556373a6e960 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556373a3e1e0 con 0x556373a6e960 2023-03-17T09:11:01.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8d8aff5700 1 -- 172.21.15.35:0/2190597829 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d9c034240 con 0x556373a6e960 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 10 client.15984 fetch_fsmap learned FSMap version 29 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5563738151f0 con 0x556373a6e960 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8d8aff5700 1 -- 172.21.15.35:0/2190597829 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556373a3e1e0 con 0x556373a6e960 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8d8aff5700 1 -- 172.21.15.35:0/2190597829 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8d9c010430 con 0x556373a6e960 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 10 client.15984 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 20 client.15984 populate_metadata read hostname 'smithi035' 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373adcab0 0x556373adee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 4 client.15984 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.466+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556373844f00 con 0x556373adcab0 2023-03-17T09:11:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.467+0000 7f8da67fc700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373adcab0 0x556373adee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.467+0000 7f8d8aff5700 10 client.15984 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.467+0000 7f8da67fc700 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373adcab0 0x556373adee90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb421d13f600710d server_cookie=2b6ae3733f4a4813 in_seq=0 out_seq=0 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8d8aff5700 1 -- 172.21.15.35:0/2190597829 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556373844f00 con 0x556373adcab0 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8d8aff5700 10 client.15984 handle_command_reply: tid=0 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 client.15984 shutdown 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 msgr2=0x556373ad0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373ad0090 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c010710 tx=0x7f8d9c00a570 comp rx=0 tx=0).stop 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 shutdown_connections 2023-03-17T09:11:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556373adcab0 0x556373adee90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556373a744f0 0x556373ad4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556373a6e960 0x556373ad0090 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8d8aff5700 0 client.15984 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 --2- 172.21.15.35:0/2190597829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556373a73be0 0x556373ad05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:03.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.475+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 >> 172.21.15.35:0/2190597829 conn(0x5563738cb6b0 msgr2=0x556373a6d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 shutdown_connections 2023-03-17T09:11:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8db9951b80 1 -- 172.21.15.35:0/2190597829 wait complete. 2023-03-17T09:11:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8db9951b80 20 client.15984 trim_cache size 0 max 16384 2023-03-17T09:11:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8d9009f640 msgr2=0x7f8d900a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8d9009f640 0x7f8d900a1af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005950 tx=0x7f8d9c005f50 comp rx=0 tx=0).stop 2023-03-17T09:11:04.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 msgr2=0x7f8da8196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 0x7f8da8196790 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009f50 tx=0x7f8d980047c0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 shutdown_connections 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8d9009f640 0x7f8d900a1af0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8da8105140 0x7f8da819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da8100970 0x7f8da8196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 --2- 172.21.15.35:0/437716953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8da8101320 0x7f8da8196790 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 >> 172.21.15.35:0/437716953 conn(0x7f8da80774c0 msgr2=0x7f8da80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 shutdown_connections 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T08:59:56.476+0000 7f8dad7c4700 1 -- 172.21.15.35:0/437716953 wait complete. 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 -- 172.21.15.35:0/265872382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a6810cb60 msgr2=0x7f6a6810ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/265872382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a6810cb60 0x7f6a6810ef40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000b0a0 tx=0x7f6a6000b3b0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 -- 172.21.15.35:0/265872382 shutdown_connections 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/265872382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a6810cb60 0x7f6a6810ef40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/265872382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a680fefb0 0x7f6a680ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/265872382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a680ff8c0 0x7f6a6810c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 -- 172.21.15.35:0/265872382 >> 172.21.15.35:0/265872382 conn(0x7f6a68076330 msgr2=0x7f6a68076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 -- 172.21.15.35:0/265872382 shutdown_connections 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.598+0000 7f6a6c98d700 1 -- 172.21.15.35:0/265872382 wait complete. 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 Processor -- start 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 -- start start 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 0x7f6a68198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a680ff8c0 0x7f6a68198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a6810cb60 0x7f6a6819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6819d560 con 0x7f6a680fefb0 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6819d6d0 con 0x7f6a680ff8c0 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6c98d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6819d890 con 0x7f6a6810cb60 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 0x7f6a68198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 0x7f6a68198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43732/0 (socket says 172.21.15.35:43732) 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 -- 172.21.15.35:0/2155196609 learned_addr learned my addr 172.21.15.35:0/2155196609 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a6810cb60 0x7f6a6819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a680ff8c0 0x7f6a68198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 -- 172.21.15.35:0/2155196609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a6810cb60 msgr2=0x7f6a6819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a6810cb60 0x7f6a6819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 -- 172.21.15.35:0/2155196609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a680ff8c0 msgr2=0x7f6a68198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a680ff8c0 0x7f6a68198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 -- 172.21.15.35:0/2155196609 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60009d00 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.599+0000 7f6a6659c700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 0x7f6a68198580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800d980 tx=0x7f6a5800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.600+0000 7f6a577fe700 1 -- 172.21.15.35:0/2155196609 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58009b40 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.600+0000 7f6a577fe700 1 -- 172.21.15.35:0/2155196609 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a5800de60 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.600+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a68112290 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.600+0000 7f6a577fe700 1 -- 172.21.15.35:0/2155196609 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580054e0 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.600+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a68112100 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.603+0000 7f6a577fe700 1 -- 172.21.15.35:0/2155196609 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6a58004750 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.603+0000 7f6a577fe700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6a5009f6c0 0x7f6a500a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.603+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6a5009f6c0 0x7f6a500a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.603+0000 7f6a577fe700 1 -- 172.21.15.35:0/2155196609 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f6a580ca590 con 0x7f6a680fefb0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6a5009f6c0 0x7f6a500a1b70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a68199b90 tx=0x7f6a5c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 Processor -- start 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 -- start start 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285644fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x56128563f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128563fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285546010 con 0x56128563f960 2023-03-17T09:11:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285598950 con 0x561285644be0 2023-03-17T09:11:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285591de0 con 0x5612856454f0 2023-03-17T09:11:04.180 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:34 smithi035 ceph-mon[92535]: pgmap v481: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:11:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a66d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128563fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.604+0000 7f6a66d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128563fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43744/0 (socket says 172.21.15.35:43744) 2023-03-17T09:11:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 -- 172.21.15.35:0/3977233517 learned_addr learned my addr 172.21.15.35:0/3977233517 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285644fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x56128563f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 -- 172.21.15.35:0/3977233517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 msgr2=0x56128563f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x56128563f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 -- 172.21.15.35:0/3977233517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 msgr2=0x561285644fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285644fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 -- 172.21.15.35:0/3977233517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612854135d0 con 0x56128563f960 2023-03-17T09:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128563fd90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000b0a0 tx=0x7f6a60009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd701acba047282 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a54ff9700 1 -- 172.21.15.35:0/3977233517 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000e050 con 0x56128563f960 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a54ff9700 1 -- 172.21.15.35:0/3977233517 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a60009460 con 0x56128563f960 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.605+0000 7f6a54ff9700 1 -- 172.21.15.35:0/3977233517 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60004cb0 con 0x56128563f960 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3977233517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 msgr2=0x56128563fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128563fd90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000b0a0 tx=0x7f6a60009c40 comp rx=0 tx=0).stop 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3977233517 shutdown_connections 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128563fd90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285644fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:06.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3977233517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x56128563f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3977233517 >> 172.21.15.35:0/3977233517 conn(0x56128549c6b0 msgr2=0x561285639a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3977233517 shutdown_connections 2023-03-17T09:11:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3977233517 wait complete. 2023-03-17T09:11:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.606+0000 7f6a78b1ab80 1 -- start start 2023-03-17T09:11:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 Processor -- start 2023-03-17T09:11:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128564b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285648670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x561285648c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612854158c0 con 0x56128563f960 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285649410 con 0x561285644be0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285654fd0 con 0x5612856454f0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a78b1ab80 10 client.0 _ll_register_callbacks cb 0x561285437230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128564b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128564b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43746/0 (socket says 172.21.15.35:43746) 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 -- 172.21.15.35:0/3176548475 learned_addr learned my addr 172.21.15.35:0/3176548475 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285648670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x561285648c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 -- 172.21.15.35:0/3176548475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 msgr2=0x561285648c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x561285648c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 -- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 msgr2=0x561285648670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285648670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a6659c700 1 -- 172.21.15.35:0/3176548475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6810fac0 con 0x56128563f960 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.607+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285648670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128564b3f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6a58097d10 tx=0x7f6a580a0200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c104ee12d1439f53 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a4dffb700 1 -- 172.21.15.35:0/3176548475 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58098270 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a4dffb700 1 -- 172.21.15.35:0/3176548475 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f6a580c5020 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561285554390 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a4dffb700 1 -- 172.21.15.35:0/3176548475 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a580983d0 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 10 client.15996 fetch_fsmap learned FSMap version 29 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5612853bfd80 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a4dffb700 1 -- 172.21.15.35:0/3176548475 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561285554390 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a4dffb700 1 -- 172.21.15.35:0/3176548475 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a5809fe00 con 0x56128563f960 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 10 client.15996 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 20 client.15996 populate_metadata read hostname 'smithi035' 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561285658f40 0x56128565b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 4 client.15996 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:11:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.608+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561285560600 con 0x561285658f40 2023-03-17T09:11:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.609+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561285658f40 0x56128565b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.609+0000 7f6a4dffb700 10 client.15996 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.609+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561285658f40 0x56128565b320 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c367f954b32e25 server_cookie=653512e4ea04139b in_seq=0 out_seq=0 2023-03-17T09:11:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a4dffb700 1 -- 172.21.15.35:0/3176548475 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561285560600 con 0x561285658f40 2023-03-17T09:11:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a4dffb700 10 client.15996 handle_command_reply: tid=0 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 client.15996 shutdown 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 msgr2=0x56128564b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128564b3f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6a58097d10 tx=0x7f6a580a0200 comp rx=0 tx=0).stop 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 shutdown_connections 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561285658f40 0x56128565b320 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612856454f0 0x561285648c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x56128564b3f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3176548475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561285644be0 0x561285648670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a4dffb700 0 client.15996 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 >> 172.21.15.35:0/3176548475 conn(0x56128549c6b0 msgr2=0x561285639a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 shutdown_connections 2023-03-17T09:11:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3176548475 wait complete. 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.610+0000 7f6a78b1ab80 20 client.15996 trim_cache size 0 max 16384 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 Processor -- start 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 -- start start 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285639ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x56128564ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285649230 con 0x56128563f960 2023-03-17T09:11:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56128563a000 con 0x5612856454f0 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612856365c0 con 0x561285644be0 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285639ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285639ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43754/0 (socket says 172.21.15.35:43754) 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a6659c700 1 -- 172.21.15.35:0/3762288981 learned_addr learned my addr 172.21.15.35:0/3762288981 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.625+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x56128564ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a6659c700 1 -- 172.21.15.35:0/3762288981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 msgr2=0x56128564ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x56128564ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a6659c700 1 -- 172.21.15.35:0/3762288981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 msgr2=0x5612856460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a6659c700 1 -- 172.21.15.35:0/3762288981 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561285558130 con 0x56128563f960 2023-03-17T09:11:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a6659c700 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285639ac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ca870 tx=0x7f6a58005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a6f95ebde54d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a557fa700 1 -- 172.21.15.35:0/3762288981 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58093ed0 con 0x56128563f960 2023-03-17T09:11:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a557fa700 1 -- 172.21.15.35:0/3762288981 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a580b0260 con 0x56128563f960 2023-03-17T09:11:09.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a557fa700 1 -- 172.21.15.35:0/3762288981 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5809ff60 con 0x56128563f960 2023-03-17T09:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3762288981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 msgr2=0x561285639ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285639ac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ca870 tx=0x7f6a58005b60 comp rx=0 tx=0).stop 2023-03-17T09:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3762288981 shutdown_connections 2023-03-17T09:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.626+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285639ac0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:09.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/3762288981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x56128564ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3762288981 >> 172.21.15.35:0/3762288981 conn(0x56128549c6b0 msgr2=0x561285645990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3762288981 shutdown_connections 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/3762288981 wait complete. 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- start start 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 Processor -- start 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285641870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x561285641db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285640be0 con 0x56128563f960 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285640d50 con 0x5612856454f0 2023-03-17T09:11:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561285640f10 con 0x561285644be0 2023-03-17T09:11:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a78b1ab80 10 client.0 _ll_register_callbacks cb 0x561285437230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:11:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285641870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:11.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a6659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285641870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43760/0 (socket says 172.21.15.35:43760) 2023-03-17T09:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a6659c700 1 -- 172.21.15.35:0/2985197680 learned_addr learned my addr 172.21.15.35:0/2985197680 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x561285641db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.627+0000 7f6a66d9d700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a6659c700 1 -- 172.21.15.35:0/2985197680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 msgr2=0x561285641db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a6659c700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x561285641db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a6659c700 1 -- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 msgr2=0x5612856406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a6659c700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a6659c700 1 -- 172.21.15.35:0/2985197680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612853bfd80 con 0x56128563f960 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a6659c700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285641870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6a58094a80 tx=0x7f6a58094480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5147252ee69cbdb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a4dffb700 1 -- 172.21.15.35:0/2985197680 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580b03d0 con 0x56128563f960 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a4dffb700 1 -- 172.21.15.35:0/2985197680 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f6a580c5040 con 0x56128563f960 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56128560f1e0 con 0x56128563f960 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a4dffb700 1 -- 172.21.15.35:0/2985197680 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a58093ed0 con 0x56128563f960 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 10 client.16002 fetch_fsmap learned FSMap version 29 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5612853e61f0 con 0x56128563f960 2023-03-17T09:11:12.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a4dffb700 1 -- 172.21.15.35:0/2985197680 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56128560f1e0 con 0x56128563f960 2023-03-17T09:11:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a4dffb700 1 -- 172.21.15.35:0/2985197680 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a580a6020 con 0x56128563f960 2023-03-17T09:11:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 10 client.16002 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:11:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 10 client.16002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:11:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 20 client.16002 populate_metadata read hostname 'smithi035' 2023-03-17T09:11:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612856ad6d0 0x5612856afab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 4 client.16002 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:11:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.628+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561285415f00 con 0x5612856ad6d0 2023-03-17T09:11:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.629+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612856ad6d0 0x5612856afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.629+0000 7f6a65d9b700 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612856ad6d0 0x5612856afab0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c19adf62371792c server_cookie=624a4285e9833827 in_seq=0 out_seq=0 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.629+0000 7f6a4dffb700 10 client.16002 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.640+0000 7f6a4dffb700 1 -- 172.21.15.35:0/2985197680 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561285415f00 con 0x5612856ad6d0 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.640+0000 7f6a4dffb700 10 client.16002 handle_command_reply: tid=0 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 client.16002 shutdown 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 msgr2=0x561285641870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285641870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6a58094a80 tx=0x7f6a58094480 comp rx=0 tx=0).stop 2023-03-17T09:11:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 shutdown_connections 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612856ad6d0 0x5612856afab0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612856454f0 0x5612856406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a4dffb700 0 client.16002 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56128563f960 0x561285641870 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 --2- 172.21.15.35:0/2985197680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561285644be0 0x561285641db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 >> 172.21.15.35:0/2985197680 conn(0x56128549c6b0 msgr2=0x561285643790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 shutdown_connections 2023-03-17T09:11:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 1 -- 172.21.15.35:0/2985197680 wait complete. 2023-03-17T09:11:14.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a78b1ab80 20 client.16002 trim_cache size 0 max 16384 2023-03-17T09:11:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6a5009f6c0 msgr2=0x7f6a500a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6a5009f6c0 0x7f6a500a1b70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a68199b90 tx=0x7f6a5c009260 comp rx=0 tx=0).stop 2023-03-17T09:11:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 msgr2=0x7f6a68198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:15.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:36 smithi035 ceph-mon[92535]: pgmap v482: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:16.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 0x7f6a68198580 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800d980 tx=0x7f6a5800dd40 comp rx=0 tx=0).stop 2023-03-17T09:11:16.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 shutdown_connections 2023-03-17T09:11:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6a5009f6c0 0x7f6a500a1b70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a6810cb60 0x7f6a6819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6a680fefb0 0x7f6a68198580 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 --2- 172.21.15.35:0/2155196609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a680ff8c0 0x7f6a68198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.641+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 >> 172.21.15.35:0/2155196609 conn(0x7f6a68076330 msgr2=0x7f6a680fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.642+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 shutdown_connections 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:09.642+0000 7f6a6c98d700 1 -- 172.21.15.35:0/2155196609 wait complete. 2023-03-17T09:11:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2558845775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 msgr2=0x7ff9d410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2558845775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d410eee0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00b0a0 tx=0x7ff9cc00b3b0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2558845775 shutdown_connections 2023-03-17T09:11:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2558845775 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d410eee0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2558845775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40fef50 0x7ff9d40ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2558845775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d40ff860 0x7ff9d410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2558845775 >> 172.21.15.35:0/2558845775 conn(0x7ff9d4076330 msgr2=0x7ff9d4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2558845775 shutdown_connections 2023-03-17T09:11:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.765+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2558845775 wait complete. 2023-03-17T09:11:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 Processor -- start 2023-03-17T09:11:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 -- start start 2023-03-17T09:11:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d40fef50 0x7ff9d4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40ff860 0x7ff9d4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:20.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d419d570 con 0x7ff9d410cb00 2023-03-17T09:11:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d419d6e0 con 0x7ff9d40ff860 2023-03-17T09:11:20.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9db2e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d419d8a0 con 0x7ff9d40fef50 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43778/0 (socket says 172.21.15.35:43778) 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.766+0000 7ff9d9880700 1 -- 172.21.15.35:0/2001872808 learned_addr learned my addr 172.21.15.35:0/2001872808 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d887e700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40ff860 0x7ff9d4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d907f700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d40fef50 0x7ff9d4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d9880700 1 -- 172.21.15.35:0/2001872808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d40fef50 msgr2=0x7ff9d4198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:21.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d40fef50 0x7ff9d4198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d9880700 1 -- 172.21.15.35:0/2001872808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40ff860 msgr2=0x7ff9d4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40ff860 0x7ff9d4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d9880700 1 -- 172.21.15.35:0/2001872808 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009d00 con 0x7ff9d410cb00 2023-03-17T09:11:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d887e700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40ff860 0x7ff9d4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:11:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d419cf30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00b780 tx=0x7ff9cc00bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9ca7fc700 1 -- 172.21.15.35:0/2001872808 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00e040 con 0x7ff9d410cb00 2023-03-17T09:11:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9ca7fc700 1 -- 172.21.15.35:0/2001872808 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9cc009480 con 0x7ff9d410cb00 2023-03-17T09:11:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d41122d0 con 0x7ff9d410cb00 2023-03-17T09:11:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9ca7fc700 1 -- 172.21.15.35:0/2001872808 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0052a0 con 0x7ff9d410cb00 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.767+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d4112140 con 0x7ff9d410cb00 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.769+0000 7ff9ca7fc700 1 -- 172.21.15.35:0/2001872808 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff9cc01da10 con 0x7ff9d410cb00 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.770+0000 7ff9ca7fc700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9c009f6c0 0x7ff9c00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.770+0000 7ff9ca7fc700 1 -- 172.21.15.35:0/2001872808 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9cc0cb6e0 con 0x7ff9d410cb00 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.770+0000 7ff9d907f700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9c009f6c0 0x7ff9c00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.771+0000 7ff9d907f700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9c009f6c0 0x7ff9c00a1b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009bf0 tx=0x7ff9d0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.771+0000 7ff9e7470b80 1 Processor -- start 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.771+0000 7ff9e7470b80 1 -- start start 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.771+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.771+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca1234f0 0x5650ca11d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.771+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 0x5650ca11dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca024010 con 0x5650ca11d960 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca076950 con 0x5650ca122be0 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca06fde0 con 0x5650ca1234f0 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 0x5650ca11dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 0x5650ca11dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43786/0 (socket says 172.21.15.35:43786) 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 -- 172.21.15.35:0/2521907732 learned_addr learned my addr 172.21.15.35:0/2521907732 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d907f700 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d887e700 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca1234f0 0x5650ca11d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 -- 172.21.15.35:0/2521907732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca1234f0 msgr2=0x5650ca11d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca1234f0 0x5650ca11d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 -- 172.21.15.35:0/2521907732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 msgr2=0x5650ca122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 -- 172.21.15.35:0/2521907732 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650c9ef15d0 con 0x5650ca11d960 2023-03-17T09:11:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 0x5650ca11dd90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc095c90 tx=0x7ff9cc098d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6a0e4a7bf89fd5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9bf7fe700 1 -- 172.21.15.35:0/2521907732 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0a1380 con 0x5650ca11d960 2023-03-17T09:11:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9bf7fe700 1 -- 172.21.15.35:0/2521907732 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9cc003e10 con 0x5650ca11d960 2023-03-17T09:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.772+0000 7ff9bf7fe700 1 -- 172.21.15.35:0/2521907732 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc098710 con 0x5650ca11d960 2023-03-17T09:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2521907732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 msgr2=0x5650ca11dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 0x5650ca11dd90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc095c90 tx=0x7ff9cc098d60 comp rx=0 tx=0).stop 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2521907732 shutdown_connections 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca11d960 0x5650ca11dd90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2521907732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca1234f0 0x5650ca11d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2521907732 >> 172.21.15.35:0/2521907732 conn(0x5650c9f7a6b0 msgr2=0x5650ca117a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2521907732 shutdown_connections 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2521907732 wait complete. 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.773+0000 7ff9e7470b80 1 -- start start 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 Processor -- start 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca1294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca126700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca126df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c9ef38c0 con 0x5650ca1234f0 2023-03-17T09:11:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca127530 con 0x5650ca11d960 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca132dd0 con 0x5650ca122be0 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9e7470b80 10 client.0 _ll_register_callbacks cb 0x5650c9f15230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca126df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9d907f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca1294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca126df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43792/0 (socket says 172.21.15.35:43792) 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9d9880700 1 -- 172.21.15.35:0/1561009544 learned_addr learned my addr 172.21.15.35:0/1561009544 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9d887e700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca126700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.774+0000 7ff9d9880700 1 -- 172.21.15.35:0/1561009544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 msgr2=0x5650ca126700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9d9880700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca126700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9d9880700 1 -- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 msgr2=0x5650ca1294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9d9880700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca1294f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9d9880700 1 -- 172.21.15.35:0/1561009544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d4112140 con 0x5650ca1234f0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9d887e700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca126700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9d9880700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca126df0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc094fa0 tx=0x7ff9cc09d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1beaf6954fd440 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9bcff9700 1 -- 172.21.15.35:0/1561009544 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0a1380 con 0x5650ca1234f0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9bcff9700 1 -- 172.21.15.35:0/1561009544 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9cc099690 con 0x5650ca1234f0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650ca032390 con 0x5650ca1234f0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9bcff9700 1 -- 172.21.15.35:0/1561009544 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9cc0a0ef0 con 0x5650ca1234f0 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 10 client.16014 fetch_fsmap learned FSMap version 29 2023-03-17T09:11:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5650c9e9dd80 con 0x5650ca1234f0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9bcff9700 1 -- 172.21.15.35:0/1561009544 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5650ca032390 con 0x5650ca1234f0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9bcff9700 1 -- 172.21.15.35:0/1561009544 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff9cc098180 con 0x5650ca1234f0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 10 client.16014 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 20 client.16014 populate_metadata read hostname 'smithi035' 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca1369f0 0x5650ca138e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 4 client.16014 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.775+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650ca03e600 con 0x5650ca1369f0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.776+0000 7ff9d907f700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca1369f0 0x5650ca138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.776+0000 7ff9d907f700 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca1369f0 0x5650ca138e00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecbdb39001bc5c99 server_cookie=f2282138889e550 in_seq=0 out_seq=0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.776+0000 7ff9bcff9700 10 client.16014 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9bcff9700 1 -- 172.21.15.35:0/1561009544 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5650ca03e600 con 0x5650ca1369f0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9bcff9700 10 client.16014 handle_command_reply: tid=0 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 client.16014 shutdown 2023-03-17T09:11:25.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 msgr2=0x5650ca126df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca126df0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc094fa0 tx=0x7ff9cc09d170 comp rx=0 tx=0).stop 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 shutdown_connections 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca1369f0 0x5650ca138e00 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca126df0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca1294f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/1561009544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca126700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9bcff9700 0 client.16014 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 >> 172.21.15.35:0/1561009544 conn(0x5650c9f7a6b0 msgr2=0x5650ca11c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 shutdown_connections 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 1 -- 172.21.15.35:0/1561009544 wait complete. 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.777+0000 7ff9e7470b80 20 client.16014 trim_cache size 0 max 16384 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 Processor -- start 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 -- start start 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca117ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca12dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca129020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca1145c0 con 0x5650ca1234f0 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca11d7c0 con 0x5650ca11d960 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.792+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca1186d0 con 0x5650ca122be0 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca129020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca129020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43800/0 (socket says 172.21.15.35:43800) 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 -- 172.21.15.35:0/2430915754 learned_addr learned my addr 172.21.15.35:0/2430915754 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d907f700 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca117ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d887e700 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca12dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 -- 172.21.15.35:0/2430915754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 msgr2=0x5650ca12dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca12dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 -- 172.21.15.35:0/2430915754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 msgr2=0x5650ca117ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca117ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 -- 172.21.15.35:0/2430915754 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650ca036130 con 0x5650ca1234f0 2023-03-17T09:11:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9d9880700 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca129020 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c9470 tx=0x7ff9cc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447a41f1db16f125 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9bffff700 1 -- 172.21.15.35:0/2430915754 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0a1380 con 0x5650ca1234f0 2023-03-17T09:11:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9bffff700 1 -- 172.21.15.35:0/2430915754 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9cc099690 con 0x5650ca1234f0 2023-03-17T09:11:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.793+0000 7ff9bffff700 1 -- 172.21.15.35:0/2430915754 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0a1150 con 0x5650ca1234f0 2023-03-17T09:11:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2430915754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 msgr2=0x5650ca129020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca129020 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c9470 tx=0x7ff9cc009040 comp rx=0 tx=0).stop 2023-03-17T09:11:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2430915754 shutdown_connections 2023-03-17T09:11:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca129020 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:30.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:38 smithi035 ceph-mon[92535]: pgmap v483: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca11d960 0x5650ca117ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/2430915754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca122be0 0x5650ca12dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2430915754 >> 172.21.15.35:0/2430915754 conn(0x5650c9f7a6b0 msgr2=0x5650ca133160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2430915754 shutdown_connections 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 -- 172.21.15.35:0/2430915754 wait complete. 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 -- start start 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.794+0000 7ff9e7470b80 1 Processor -- start 2023-03-17T09:11:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca11d960 0x5650ca12d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca12dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca12bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca12c390 con 0x5650ca1234f0 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca12c500 con 0x5650ca122be0 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ca12c6c0 con 0x5650ca11d960 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9e7470b80 10 client.0 _ll_register_callbacks cb 0x5650c9f15230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:11:32.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca12bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d907f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca11d960 0x5650ca12d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca12bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43806/0 (socket says 172.21.15.35:43806) 2023-03-17T09:11:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 -- 172.21.15.35:0/421062062 learned_addr learned my addr 172.21.15.35:0/421062062 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d887e700 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca12dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 -- 172.21.15.35:0/421062062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca11d960 msgr2=0x5650ca12d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:32.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca11d960 0x5650ca12d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 -- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 msgr2=0x5650ca12dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca12dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 -- 172.21.15.35:0/421062062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650c9e9dd80 con 0x5650ca1234f0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9d9880700 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca12bd40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc094fa0 tx=0x7ff9cc00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98604a6ad1ecabc6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.795+0000 7ff9bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9bcff9700 1 -- 172.21.15.35:0/421062062 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0a1380 con 0x5650ca1234f0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9bcff9700 1 -- 172.21.15.35:0/421062062 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9cc0975c0 con 0x5650ca1234f0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650ca0ed1e0 con 0x5650ca1234f0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9bcff9700 1 -- 172.21.15.35:0/421062062 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9cc01d6e0 con 0x5650ca1234f0 2023-03-17T09:11:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 10 client.16020 fetch_fsmap learned FSMap version 29 2023-03-17T09:11:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5650c9ec41f0 con 0x5650ca1234f0 2023-03-17T09:11:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9bcff9700 1 -- 172.21.15.35:0/421062062 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5650ca0ed1e0 con 0x5650ca1234f0 2023-03-17T09:11:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9bcff9700 1 -- 172.21.15.35:0/421062062 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff9cc0b1340 con 0x5650ca1234f0 2023-03-17T09:11:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 10 client.16020 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:11:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:11:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 20 client.16020 populate_metadata read hostname 'smithi035' 2023-03-17T09:11:34.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca18b470 0x5650ca18d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 4 client.16020 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5650c9ef3f00 con 0x5650ca18b470 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.796+0000 7ff9d907f700 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca18b470 0x5650ca18d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.797+0000 7ff9bcff9700 10 client.16020 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.797+0000 7ff9d907f700 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca18b470 0x5650ca18d850 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a582ed3bd75688d server_cookie=4b614c46942973cc in_seq=0 out_seq=0 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9bcff9700 1 -- 172.21.15.35:0/421062062 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5650c9ef3f00 con 0x5650ca18b470 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9bcff9700 10 client.16020 handle_command_reply: tid=0 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 client.16020 shutdown 2023-03-17T09:11:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 msgr2=0x5650ca12bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca12bd40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc094fa0 tx=0x7ff9cc00b3b0 comp rx=0 tx=0).stop 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 shutdown_connections 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650ca18b470 0x5650ca18d850 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650ca1234f0 0x5650ca12bd40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9bcff9700 0 client.16020 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650ca11d960 0x5650ca12d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 --2- 172.21.15.35:0/421062062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650ca122be0 0x5650ca12dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 >> 172.21.15.35:0/421062062 conn(0x5650c9f7a6b0 msgr2=0x5650ca125f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:34.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 shutdown_connections 2023-03-17T09:11:35.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 1 -- 172.21.15.35:0/421062062 wait complete. 2023-03-17T09:11:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.801+0000 7ff9e7470b80 20 client.16020 trim_cache size 0 max 16384 2023-03-17T09:11:35.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9c009f6c0 msgr2=0x7ff9c00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9c009f6c0 0x7ff9c00a1b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009bf0 tx=0x7ff9d0009260 comp rx=0 tx=0).stop 2023-03-17T09:11:37.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 msgr2=0x7ff9d419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d419cf30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00b780 tx=0x7ff9cc00bd90 comp rx=0 tx=0).stop 2023-03-17T09:11:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 shutdown_connections 2023-03-17T09:11:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9c009f6c0 0x7ff9c00a1b70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d410cb00 0x7ff9d419cf30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d40fef50 0x7ff9d4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 --2- 172.21.15.35:0/2001872808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d40ff860 0x7ff9d4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 >> 172.21.15.35:0/2001872808 conn(0x7ff9d4076330 msgr2=0x7ff9d40fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 shutdown_connections 2023-03-17T09:11:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:22.802+0000 7ff9db2e3700 1 -- 172.21.15.35:0/2001872808 wait complete. 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 -- 172.21.15.35:0/3518963759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c104390 msgr2=0x7fe76c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 --2- 172.21.15.35:0/3518963759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c104390 0x7fe76c10bf60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe7640099c0 tx=0x7fe764009cd0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 -- 172.21.15.35:0/3518963759 shutdown_connections 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 --2- 172.21.15.35:0/3518963759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c104390 0x7fe76c10bf60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 --2- 172.21.15.35:0/3518963759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c0ff350 0x7fe76c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 --2- 172.21.15.35:0/3518963759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 -- 172.21.15.35:0/3518963759 >> 172.21.15.35:0/3518963759 conn(0x7fe76c076330 msgr2=0x7fe76c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 -- 172.21.15.35:0/3518963759 shutdown_connections 2023-03-17T09:11:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 -- 172.21.15.35:0/3518963759 wait complete. 2023-03-17T09:11:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.925+0000 7fe771c64700 1 Processor -- start 2023-03-17T09:11:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 -- start start 2023-03-17T09:11:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c0ff350 0x7fe76c100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c104390 0x7fe76c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c101ac0 con 0x7fe76c0ffcf0 2023-03-17T09:11:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1a4930 con 0x7fe76c104390 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe771c64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1a4a70 con 0x7fe76c0ff350 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43818/0 (socket says 172.21.15.35:43818) 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 -- 172.21.15.35:0/715897492 learned_addr learned my addr 172.21.15.35:0/715897492 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76bfff700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c104390 0x7fe76c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c0ff350 0x7fe76c100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 -- 172.21.15.35:0/715897492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c0ff350 msgr2=0x7fe76c100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c0ff350 0x7fe76c100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 -- 172.21.15.35:0/715897492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c104390 msgr2=0x7fe76c1a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c104390 0x7fe76c1a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76affd700 1 -- 172.21.15.35:0/715897492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640095f0 con 0x7fe76c0ffcf0 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.926+0000 7fe76bfff700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c104390 0x7fe76c1a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:11:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.927+0000 7fe76affd700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c101290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe76000d950 tx=0x7fe76000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.927+0000 7fe768ff9700 1 -- 172.21.15.35:0/715897492 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000bb60 con 0x7fe76c0ffcf0 2023-03-17T09:11:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.927+0000 7fe768ff9700 1 -- 172.21.15.35:0/715897492 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe76000de30 con 0x7fe76c0ffcf0 2023-03-17T09:11:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.927+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c10f010 con 0x7fe76c0ffcf0 2023-03-17T09:11:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.927+0000 7fe768ff9700 1 -- 172.21.15.35:0/715897492 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760005430 con 0x7fe76c0ffcf0 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.927+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c10ee80 con 0x7fe76c0ffcf0 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.929+0000 7fe768ff9700 1 -- 172.21.15.35:0/715897492 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe760005590 con 0x7fe76c0ffcf0 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.930+0000 7fe768ff9700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe75409f6c0 0x7fe7540a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.930+0000 7fe768ff9700 1 -- 172.21.15.35:0/715897492 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe7600c9ef0 con 0x7fe76c0ffcf0 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.930+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe75409f6c0 0x7fe7540a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.930+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe75409f6c0 0x7fe7540a1b70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009d10 tx=0x7fe75c009040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.931+0000 7fe77ddf1b80 1 Processor -- start 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.931+0000 7fe77ddf1b80 1 -- start start 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f29fdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f29f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f29f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f28ff010 con 0x5568f29fdbe0 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f2951950 con 0x5568f29f8960 2023-03-17T09:11:46.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f294ade0 con 0x5568f29fe4f0 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f29fdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f29fdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43824/0 (socket says 172.21.15.35:43824) 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 -- 172.21.15.35:0/2395925062 learned_addr learned my addr 172.21.15.35:0/2395925062 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76affd700 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f29f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76bfff700 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f29f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 -- 172.21.15.35:0/2395925062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 msgr2=0x5568f29f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f29f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 -- 172.21.15.35:0/2395925062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 msgr2=0x5568f29f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f29f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 -- 172.21.15.35:0/2395925062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568f27cc5d0 con 0x5568f29fdbe0 2023-03-17T09:11:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f29fdfb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0164a0 tx=0x7fe75c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabd75e62e1ec7e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:46.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe751ffb700 1 -- 172.21.15.35:0/2395925062 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c021600 con 0x5568f29fdbe0 2023-03-17T09:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe751ffb700 1 -- 172.21.15.35:0/2395925062 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe75c016e50 con 0x5568f29fdbe0 2023-03-17T09:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.932+0000 7fe751ffb700 1 -- 172.21.15.35:0/2395925062 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c014a30 con 0x5568f29fdbe0 2023-03-17T09:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/2395925062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 msgr2=0x5568f29fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f29fdfb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0164a0 tx=0x7fe75c012000 comp rx=0 tx=0).stop 2023-03-17T09:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/2395925062 shutdown_connections 2023-03-17T09:11:47.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f29f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f29fdfb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/2395925062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f29f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/2395925062 >> 172.21.15.35:0/2395925062 conn(0x5568f28556b0 msgr2=0x5568f29f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/2395925062 shutdown_connections 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.933+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/2395925062 wait complete. 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.934+0000 7fe77ddf1b80 1 -- start start 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.934+0000 7fe77ddf1b80 1 Processor -- start 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.934+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f2a04450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.934+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f2a01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f27ce8c0 con 0x5568f29fdbe0 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f2a02470 con 0x5568f29f8960 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f2a0e000 con 0x5568f29fe4f0 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe77ddf1b80 10 client.0 _ll_register_callbacks cb 0x5568f27f0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a016d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43832/0 (socket says 172.21.15.35:43832) 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 -- 172.21.15.35:0/4019255618 learned_addr learned my addr 172.21.15.35:0/4019255618 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:11:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76bfff700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f2a01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f2a04450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 -- 172.21.15.35:0/4019255618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 msgr2=0x5568f2a01d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f2a01d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 -- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 msgr2=0x5568f2a04450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f2a04450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 -- 172.21.15.35:0/4019255618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c007d80 con 0x5568f29fdbe0 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe76affd700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a016d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe7600058b0 tx=0x7fe760097560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb88dad5dd8e2520 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe74affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:11:47.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe74affd700 1 -- 172.21.15.35:0/4019255618 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600c5070 con 0x5568f29fdbe0 2023-03-17T09:11:47.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:40 smithi035 ceph-mon[92535]: pgmap v484: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:42 smithi035 ceph-mon[92535]: pgmap v485: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:44 smithi035 ceph-mon[92535]: pgmap v486: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:11:48.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:46 smithi035 ceph-mon[92535]: pgmap v487: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:11:48.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:48 smithi035 ceph-mon[92535]: pgmap v488: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:11:48.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:50 smithi035 ceph-mon[92535]: pgmap v489: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:48.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:52 smithi035 ceph-mon[92535]: pgmap v490: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:48.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:54 smithi035 ceph-mon[92535]: pgmap v491: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:11:48.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:56 smithi035 ceph-mon[92535]: pgmap v492: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:49.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:01:58 smithi035 ceph-mon[92535]: pgmap v493: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:11:49.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:00 smithi035 ceph-mon[92535]: pgmap v494: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:49.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:02 smithi035 ceph-mon[92535]: pgmap v495: 97 pgs: 97 active+clean; 1.3 MiB data, 108 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:11:49.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:04 smithi035 ceph-mon[92535]: pgmap v496: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:11:49.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:06 smithi035 ceph-mon[92535]: pgmap v497: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:11:49.567 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:08 smithi035 ceph-mon[92535]: pgmap v498: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:10 smithi035 ceph-mon[92535]: pgmap v499: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:10 smithi035 ceph-mon[92535]: osdmap e105: 12 total, 12 up, 12 in 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:12 smithi035 ceph-mon[92535]: pgmap v501: 97 pgs: 97 active+clean; 1.4 MiB data, 113 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:14 smithi035 ceph-mon[92535]: pgmap v502: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:16 smithi035 ceph-mon[92535]: osdmap e106: 12 total, 12 up, 12 in 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:16 smithi035 ceph-mon[92535]: pgmap v504: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:18 smithi035 ceph-mon[92535]: pgmap v505: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:20 smithi035 ceph-mon[92535]: pgmap v506: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 926 B/s wr, 11 op/s 2023-03-17T09:11:49.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:22 smithi035 ceph-mon[92535]: pgmap v507: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:11:49.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:11:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:11:50.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:11:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:11:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:11:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:11:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:11:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:11:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:11:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:11:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe74affd700 1 -- 172.21.15.35:0/4019255618 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe7600979a0 con 0x5568f29fdbe0 2023-03-17T09:11:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.935+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568f290d390 con 0x5568f29fdbe0 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe74affd700 1 -- 172.21.15.35:0/4019255618 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe76009fb90 con 0x5568f29fdbe0 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 10 client.16032 fetch_fsmap learned FSMap version 29 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5568f2778d80 con 0x5568f29fdbe0 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe74affd700 1 -- 172.21.15.35:0/4019255618 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568f290d390 con 0x5568f29fdbe0 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe74affd700 1 -- 172.21.15.35:0/4019255618 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe76009f700 con 0x5568f29fdbe0 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 10 client.16032 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:11:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:11:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 20 client.16032 populate_metadata read hostname 'smithi035' 2023-03-17T09:11:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a11f70 0x5568f2a14380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:11:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 4 client.16032 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:11:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568f2919600 con 0x5568f2a11f70 2023-03-17T09:11:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.936+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a11f70 0x5568f2a14380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:11:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.937+0000 7fe74affd700 10 client.16032 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:55.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.937+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a11f70 0x5568f2a14380 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a9ae33113086e2a server_cookie=7583038d82b2302f in_seq=0 out_seq=0 2023-03-17T09:11:55.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.937+0000 7fe74affd700 1 -- 172.21.15.35:0/4019255618 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5568f2919600 con 0x5568f2a11f70 2023-03-17T09:11:55.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.937+0000 7fe74affd700 10 client.16032 handle_command_reply: tid=0 2023-03-17T09:11:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.937+0000 7fe77ddf1b80 1 client.16032 shutdown 2023-03-17T09:11:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 msgr2=0x5568f2a016d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:11:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a016d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe7600058b0 tx=0x7fe760097560 comp rx=0 tx=0).stop 2023-03-17T09:11:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 shutdown_connections 2023-03-17T09:11:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a11f70 0x5568f2a14380 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29fe4f0 0x5568f2a01d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe74affd700 0 client.16032 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29f8960 0x5568f2a04450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4019255618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a016d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 >> 172.21.15.35:0/4019255618 conn(0x5568f28556b0 msgr2=0x5568f29f7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 shutdown_connections 2023-03-17T09:11:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4019255618 wait complete. 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.938+0000 7fe77ddf1b80 20 client.16032 trim_cache size 0 max 16384 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 Processor -- start 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 -- start start 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a08f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a03ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f29fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f290d390 con 0x5568f29fdbe0 2023-03-17T09:12:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f29f3710 con 0x5568f29fe4f0 2023-03-17T09:12:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f29f7a90 con 0x5568f29f8960 2023-03-17T09:12:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a03ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a03ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43840/0 (socket says 172.21.15.35:43840) 2023-03-17T09:12:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe76affd700 1 -- 172.21.15.35:0/4056612841 learned_addr learned my addr 172.21.15.35:0/4056612841 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe76bfff700 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f29fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.953+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a08f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76affd700 1 -- 172.21.15.35:0/4056612841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 msgr2=0x5568f2a08f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76affd700 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a08f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76affd700 1 -- 172.21.15.35:0/4056612841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 msgr2=0x5568f29fb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76affd700 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f29fb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76affd700 1 -- 172.21.15.35:0/4056612841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568f2911130 con 0x5568f29fdbe0 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a08f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe76affd700 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a03ff0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe760094410 tx=0x7fe760007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefc4f3ef17f8a04 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe7527fc700 1 -- 172.21.15.35:0/4056612841 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600c5070 con 0x5568f29fdbe0 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe7527fc700 1 -- 172.21.15.35:0/4056612841 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe760096cc0 con 0x5568f29fdbe0 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe7527fc700 1 -- 172.21.15.35:0/4056612841 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760096e90 con 0x5568f29fdbe0 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4056612841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 msgr2=0x5568f2a03ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a03ff0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe760094410 tx=0x7fe760007f70 comp rx=0 tx=0).stop 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4056612841 shutdown_connections 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f29fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a08f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/4056612841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a03ff0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.954+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4056612841 >> 172.21.15.35:0/4056612841 conn(0x5568f28556b0 msgr2=0x5568f29f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4056612841 shutdown_connections 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/4056612841 wait complete. 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 -- start start 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 Processor -- start 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a07120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a07660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f2a5ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f2a5f390 con 0x5568f29fdbe0 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f2a5f500 con 0x5568f29fe4f0 2023-03-17T09:12:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f2a5f6c0 con 0x5568f29f8960 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe77ddf1b80 10 client.0 _ll_register_callbacks cb 0x5568f27f0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.955+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a07660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a07660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43846/0 (socket says 172.21.15.35:43846) 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 -- 172.21.15.35:0/1025419430 learned_addr learned my addr 172.21.15.35:0/1025419430 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a07120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76bfff700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f2a5ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 -- 172.21.15.35:0/1025419430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 msgr2=0x5568f2a07120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a07120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 -- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 msgr2=0x5568f2a5ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f2a5ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 -- 172.21.15.35:0/1025419430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568f2778d80 con 0x5568f29fdbe0 2023-03-17T09:12:04.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76bfff700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f2a5ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe76affd700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a07660 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe760097930 tx=0x7fe76009fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89881c0f67b66399 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe74affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe74affd700 1 -- 172.21.15.35:0/1025419430 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7600c5070 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe74affd700 1 -- 172.21.15.35:0/1025419430 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe7600979a0 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568f29c81e0 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe74affd700 1 -- 172.21.15.35:0/1025419430 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe760097110 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe77ddf1b80 10 client.16038 fetch_fsmap learned FSMap version 29 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.956+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5568f279f1f0 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe74affd700 1 -- 172.21.15.35:0/1025419430 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568f29c81e0 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe74affd700 1 -- 172.21.15.35:0/1025419430 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe7600c1a20 con 0x5568f29fdbe0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe77ddf1b80 10 client.16038 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe77ddf1b80 10 client.16038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe77ddf1b80 20 client.16038 populate_metadata read hostname 'smithi035' 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a66970 0x5568f2a68d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe77ddf1b80 4 client.16038 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5568f27cef00 con 0x5568f2a66970 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a66970 0x5568f2a68d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:04.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe74affd700 10 client.16038 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.957+0000 7fe76b7fe700 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a66970 0x5568f2a68d50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edfdb51d1f07f7a3 server_cookie=472da7b870073471 in_seq=0 out_seq=0 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe74affd700 1 -- 172.21.15.35:0/1025419430 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5568f27cef00 con 0x5568f2a66970 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe74affd700 10 client.16038 handle_command_reply: tid=0 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 client.16038 shutdown 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 msgr2=0x5568f2a07660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a07660 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe760097930 tx=0x7fe76009fa80 comp rx=0 tx=0).stop 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 shutdown_connections 2023-03-17T09:12:04.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568f2a66970 0x5568f2a68d50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568f29fe4f0 0x5568f2a5ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe74affd700 0 client.16038 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568f29f8960 0x5568f2a07120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 --2- 172.21.15.35:0/1025419430 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568f29fdbe0 0x5568f2a07660 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 >> 172.21.15.35:0/1025419430 conn(0x5568f28556b0 msgr2=0x5568f29fb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 shutdown_connections 2023-03-17T09:12:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 1 -- 172.21.15.35:0/1025419430 wait complete. 2023-03-17T09:12:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.962+0000 7fe77ddf1b80 20 client.16038 trim_cache size 0 max 16384 2023-03-17T09:12:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe75409f6c0 msgr2=0x7fe7540a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe75409f6c0 0x7fe7540a1b70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009d10 tx=0x7fe75c009040 comp rx=0 tx=0).stop 2023-03-17T09:12:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 msgr2=0x7fe76c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c101290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe76000d950 tx=0x7fe76000dd10 comp rx=0 tx=0).stop 2023-03-17T09:12:08.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 shutdown_connections 2023-03-17T09:12:08.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe75409f6c0 0x7fe7540a1b70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe76c104390 0x7fe76c1a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe76c0ff350 0x7fe76c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 --2- 172.21.15.35:0/715897492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe76c0ffcf0 0x7fe76c101290 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 >> 172.21.15.35:0/715897492 conn(0x7fe76c076330 msgr2=0x7fe76c067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 shutdown_connections 2023-03-17T09:12:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:35.963+0000 7fe771c64700 1 -- 172.21.15.35:0/715897492 wait complete. 2023-03-17T09:12:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 -- 172.21.15.35:0/3728058060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac101410 msgr2=0x7ffaac1017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 --2- 172.21.15.35:0/3728058060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac101410 0x7ffaac1017e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009990 tx=0x7ffa94009ca0 comp rx=0 tx=0).stop 2023-03-17T09:12:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 -- 172.21.15.35:0/3728058060 shutdown_connections 2023-03-17T09:12:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 --2- 172.21.15.35:0/3728058060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaac10a750 0x7ffaac10cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 --2- 172.21.15.35:0/3728058060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac101410 0x7ffaac1017e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 --2- 172.21.15.35:0/3728058060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaac101d20 0x7ffaac10a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 -- 172.21.15.35:0/3728058060 >> 172.21.15.35:0/3728058060 conn(0x7ffaac076330 msgr2=0x7ffaac076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 -- 172.21.15.35:0/3728058060 shutdown_connections 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.085+0000 7ffab2166700 1 -- 172.21.15.35:0/3728058060 wait complete. 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 Processor -- start 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 -- start start 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaac101410 0x7ffaac196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaac101d20 0x7ffaac196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 0x7ffaac19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac19b180 con 0x7ffaac10a750 2023-03-17T09:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac19b2f0 con 0x7ffaac101d20 2023-03-17T09:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffab2166700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac19b4b0 con 0x7ffaac101410 2023-03-17T09:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffaabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 0x7ffaac19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffaabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 0x7ffaac19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43860/0 (socket says 172.21.15.35:43860) 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffaabfff700 1 -- 172.21.15.35:0/1214765413 learned_addr learned my addr 172.21.15.35:0/1214765413 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaac101410 0x7ffaac196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.086+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaac101d20 0x7ffaac196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaabfff700 1 -- 172.21.15.35:0/1214765413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaac101410 msgr2=0x7ffaac196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaabfff700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaac101410 0x7ffaac196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaabfff700 1 -- 172.21.15.35:0/1214765413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaac101d20 msgr2=0x7ffaac196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaabfff700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaac101d20 0x7ffaac196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaabfff700 1 -- 172.21.15.35:0/1214765413 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940095f0 con 0x7ffaac10a750 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaabfff700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 0x7ffaac19ab40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4007ee0 tx=0x7ffaa400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaa8ff9700 1 -- 172.21.15.35:0/1214765413 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4017070 con 0x7ffaac10a750 2023-03-17T09:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac1100b0 con 0x7ffaac10a750 2023-03-17T09:12:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaa8ff9700 1 -- 172.21.15.35:0/1214765413 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffaa400f040 con 0x7ffaac10a750 2023-03-17T09:12:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffaa8ff9700 1 -- 172.21.15.35:0/1214765413 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4005570 con 0x7ffaac10a750 2023-03-17T09:12:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.087+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac10ff20 con 0x7ffaac10a750 2023-03-17T09:12:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.089+0000 7ffaa8ff9700 1 -- 172.21.15.35:0/1214765413 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ffaa400db20 con 0x7ffaac10a750 2023-03-17T09:12:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.090+0000 7ffaa8ff9700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa9809f640 0x7ffa980a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.090+0000 7ffaa8ff9700 1 -- 172.21.15.35:0/1214765413 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ffaa40c9d30 con 0x7ffaac10a750 2023-03-17T09:12:11.573 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T09:12:11.573 INFO:teuthology.orchestra.run.smithi035.stdout: "status": "no active scrubs running", 2023-03-17T09:12:11.573 INFO:teuthology.orchestra.run.smithi035.stdout: "scrubs": {} 2023-03-17T09:12:12.912 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T09:12:12.912 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 -- 172.21.15.35:0/3088117831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c0ffd20 msgr2=0x7f944c103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:14.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 --2- 172.21.15.35:0/3088117831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c0ffd20 0x7f944c103ce0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f94400099c0 tx=0x7f9440009cd0 comp rx=0 tx=0).stop 2023-03-17T09:12:14.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 -- 172.21.15.35:0/3088117831 shutdown_connections 2023-03-17T09:12:14.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 --2- 172.21.15.35:0/3088117831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f944c1043c0 0x7f944c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:15.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 --2- 172.21.15.35:0/3088117831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c0ff380 0x7f944c0ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:15.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 --2- 172.21.15.35:0/3088117831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c0ffd20 0x7f944c103ce0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:15.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 -- 172.21.15.35:0/3088117831 >> 172.21.15.35:0/3088117831 conn(0x7f944c076300 msgr2=0x7f944c076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:15.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 -- 172.21.15.35:0/3088117831 shutdown_connections 2023-03-17T09:12:15.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.513+0000 7f94528c7700 1 -- 172.21.15.35:0/3088117831 wait complete. 2023-03-17T09:12:15.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.514+0000 7f94528c7700 1 Processor -- start 2023-03-17T09:12:15.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.514+0000 7f94528c7700 1 -- start start 2023-03-17T09:12:15.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94528c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c0ff380 0x7f944c195080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:16.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94528c7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f944c0ffd20 0x7f944c1955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94528c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 0x7f944c199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94528c7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c19a060 con 0x7f944c1043c0 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94528c7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c19a1d0 con 0x7f944c0ffd20 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94528c7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c19a390 con 0x7f944c0ff380 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 0x7f944c199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 0x7f944c199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44172/0 (socket says 172.21.15.35:44172) 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 -- 172.21.15.35:0/1340329579 learned_addr learned my addr 172.21.15.35:0/1340329579 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f944bfff700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c0ff380 0x7f944c195080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f944b7fe700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f944c0ffd20 0x7f944c1955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 -- 172.21.15.35:0/1340329579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c0ff380 msgr2=0x7f944c195080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c0ff380 0x7f944c195080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 -- 172.21.15.35:0/1340329579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f944c0ffd20 msgr2=0x7f944c1955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f944c0ffd20 0x7f944c1955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 -- 172.21.15.35:0/1340329579 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94400095f0 con 0x7f944c1043c0 2023-03-17T09:12:17.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f9450e64700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 0x7f944c199a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9444007ee0 tx=0x7f944400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:19.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94497fa700 1 -- 172.21.15.35:0/1340329579 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444017070 con 0x7f944c1043c0 2023-03-17T09:12:19.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.515+0000 7f94497fa700 1 -- 172.21.15.35:0/1340329579 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f944400f040 con 0x7f944c1043c0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.516+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c10eff0 con 0x7f944c1043c0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.516+0000 7f94497fa700 1 -- 172.21.15.35:0/1340329579 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444005570 con 0x7f944c1043c0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.516+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c10ee60 con 0x7f944c1043c0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.518+0000 7f94497fa700 1 -- 172.21.15.35:0/1340329579 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f944400db20 con 0x7f944c1043c0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.518+0000 7f94497fa700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f943409f6c0 0x7f94340a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f94497fa700 1 -- 172.21.15.35:0/1340329579 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f94440c9cf0 con 0x7f944c1043c0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f944bfff700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f943409f6c0 0x7f94340a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f944bfff700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f943409f6c0 0x7f94340a1b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ac50 tx=0x7f943c00a380 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 Processor -- start 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 -- start start 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42cff0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff14a0 0x55b42cff75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff7b10 0x55b42cff7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cef6070 con 0x55b42cff0b90 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cf489b0 con 0x55b42cff14a0 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f945ea54b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cf41e40 con 0x55b42cff7b10 2023-03-17T09:12:19.643 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f944bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42cff0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f944bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42cff0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44176/0 (socket says 172.21.15.35:44176) 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.519+0000 7f944bfff700 1 -- 172.21.15.35:0/1579042117 learned_addr learned my addr 172.21.15.35:0/1579042117 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944b7fe700 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff14a0 0x55b42cff75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944bfff700 1 -- 172.21.15.35:0/1579042117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff7b10 msgr2=0x55b42cff7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f9450e64700 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff7b10 0x55b42cff7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944bfff700 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff7b10 0x55b42cff7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944bfff700 1 -- 172.21.15.35:0/1579042117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff14a0 msgr2=0x55b42cff75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944bfff700 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff14a0 0x55b42cff75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944bfff700 1 -- 172.21.15.35:0/1579042117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b42cdc3630 con 0x55b42cff0b90 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944b7fe700 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff14a0 0x55b42cff75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f944bfff700 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42cff0f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ffc0 tx=0x7f943c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e56ec0d40083dd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f94327fc700 1 -- 172.21.15.35:0/1579042117 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c003b90 con 0x55b42cff0b90 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f94327fc700 1 -- 172.21.15.35:0/1579042117 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f943c003cf0 con 0x55b42cff0b90 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.520+0000 7f94327fc700 1 -- 172.21.15.35:0/1579042117 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c01d660 con 0x55b42cff0b90 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 -- 172.21.15.35:0/1579042117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 msgr2=0x55b42cff0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:19.644 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42cff0f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ffc0 tx=0x7f943c012000 comp rx=0 tx=0).stop 2023-03-17T09:12:20.464 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 -- 172.21.15.35:0/1579042117 shutdown_connections 2023-03-17T09:12:22.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff7b10 0x55b42cff7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:22.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42cff0f60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:22.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 --2- 172.21.15.35:0/1579042117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff14a0 0x55b42cff75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:22.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 -- 172.21.15.35:0/1579042117 >> 172.21.15.35:0/1579042117 conn(0x55b42cfeca90 msgr2=0x55b42cfece60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:22.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 -- 172.21.15.35:0/1579042117 shutdown_connections 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 -- 172.21.15.35:0/1579042117 wait complete. 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.521+0000 7f945ea54b80 1 -- start start 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 Processor -- start 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff0b90 0x55b42cffe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 0x55b42cffb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42cffb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cdc5920 con 0x55b42cff14a0 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cffbf30 con 0x55b42cff7b10 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cffc0f0 con 0x55b42cff0b90 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f945ea54b80 10 client.0 _ll_register_callbacks cb 0x55b42cde7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 0x55b42cffb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 0x55b42cffb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44184/0 (socket says 172.21.15.35:44184) 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 -- 172.21.15.35:0/4288176618 learned_addr learned my addr 172.21.15.35:0/4288176618 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f9450e64700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42cffb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:22.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944bfff700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff0b90 0x55b42cffe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:22.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 -- 172.21.15.35:0/4288176618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff0b90 msgr2=0x55b42cffe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff0b90 0x55b42cffe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 -- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 msgr2=0x55b42cffb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42cffb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 -- 172.21.15.35:0/4288176618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c00fc40 con 0x55b42cff14a0 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.522+0000 7f944b7fe700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 0x55b42cffb230 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f944000b580 tx=0x7f94400058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5e3518746897ef server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f942b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:12:25.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f942b7fe700 1 -- 172.21.15.35:0/4288176618 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000bba0 con 0x55b42cff14a0 2023-03-17T09:12:25.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f942b7fe700 1 -- 172.21.15.35:0/4288176618 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f944000bd00 con 0x55b42cff14a0 2023-03-17T09:12:25.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b42cf043f0 con 0x55b42cff14a0 2023-03-17T09:12:25.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f942b7fe700 1 -- 172.21.15.35:0/4288176618 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f944000bec0 con 0x55b42cff14a0 2023-03-17T09:12:25.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 10 client.16176 fetch_fsmap learned FSMap version 29 2023-03-17T09:12:25.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b42cd6fde0 con 0x55b42cff14a0 2023-03-17T09:12:25.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f942b7fe700 1 -- 172.21.15.35:0/4288176618 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b42cf043f0 con 0x55b42cff14a0 2023-03-17T09:12:25.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f942b7fe700 1 -- 172.21.15.35:0/4288176618 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9440003940 con 0x55b42cff14a0 2023-03-17T09:12:26.813 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 10 client.16176 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:12:26.813 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T09:12:26.813 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 20 client.16176 populate_metadata read hostname 'smithi035' 2023-03-17T09:12:26.813 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d00bba0 0x55b42d00dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:27.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 4 client.16176 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:12:27.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.523+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b42cf10660 con 0x55b42d00bba0 2023-03-17T09:12:29.122 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.524+0000 7f944bfff700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d00bba0 0x55b42d00dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.524+0000 7f944bfff700 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d00bba0 0x55b42d00dfb0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1bc393c11b4f26f server_cookie=37a5680eba107db7 in_seq=0 out_seq=0 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.524+0000 7f942b7fe700 10 client.16176 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f942b7fe700 1 -- 172.21.15.35:0/4288176618 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b42cf10660 con 0x55b42d00bba0 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f942b7fe700 10 client.16176 handle_command_reply: tid=0 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 client.16176 shutdown 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 msgr2=0x55b42cffb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 0x55b42cffb230 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f944000b580 tx=0x7f94400058e0 comp rx=0 tx=0).stop 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 shutdown_connections 2023-03-17T09:12:29.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d00bba0 0x55b42d00dfb0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42cffb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff0b90 0x55b42cffe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f942b7fe700 0 client.16176 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 --2- 172.21.15.35:0/4288176618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff14a0 0x55b42cffb230 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 >> 172.21.15.35:0/4288176618 conn(0x55b42cfeca90 msgr2=0x55b42cfece60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 shutdown_connections 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 1 -- 172.21.15.35:0/4288176618 wait complete. 2023-03-17T09:12:29.124 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.525+0000 7f945ea54b80 20 client.16176 trim_cache size 0 max 16384 2023-03-17T09:12:30.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 Processor -- start 2023-03-17T09:12:30.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 -- start start 2023-03-17T09:12:30.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff0b90 0x55b42d002a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:30.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d007de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:30.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 0x55b42cffdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:30.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cf043f0 con 0x55b42cff7b10 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cfed8d0 con 0x55b42cff0b90 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f945ea54b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42cff7f30 con 0x55b42cff14a0 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f9450e64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 0x55b42cffdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f9450e64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 0x55b42cffdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44194/0 (socket says 172.21.15.35:44194) 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f9450e64700 1 -- 172.21.15.35:0/2525977497 learned_addr learned my addr 172.21.15.35:0/2525977497 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.542+0000 7f944bfff700 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff0b90 0x55b42d002a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f944b7fe700 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9450e64700 1 -- 172.21.15.35:0/2525977497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 msgr2=0x55b42d007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9450e64700 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d007de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9450e64700 1 -- 172.21.15.35:0/2525977497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff0b90 msgr2=0x55b42d002a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9450e64700 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff0b90 0x55b42d002a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9450e64700 1 -- 172.21.15.35:0/2525977497 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b42cf08190 con 0x55b42cff7b10 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f944b7fe700 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d007de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9450e64700 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 0x55b42cffdb50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9444097470 tx=0x7f944400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08598f6e3e86540 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9432ffd700 1 -- 172.21.15.35:0/2525977497 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444004c40 con 0x55b42cff7b10 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9432ffd700 1 -- 172.21.15.35:0/2525977497 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f944400ddd0 con 0x55b42cff7b10 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f9432ffd700 1 -- 172.21.15.35:0/2525977497 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444097c30 con 0x55b42cff7b10 2023-03-17T09:12:30.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f945ea54b80 1 -- 172.21.15.35:0/2525977497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 msgr2=0x55b42cffdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.543+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 0x55b42cffdb50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9444097470 tx=0x7f944400b040 comp rx=0 tx=0).stop 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- 172.21.15.35:0/2525977497 shutdown_connections 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff7b10 0x55b42cffdb50 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff0b90 0x55b42d002a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2525977497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d007de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- 172.21.15.35:0/2525977497 >> 172.21.15.35:0/2525977497 conn(0x55b42cfeca90 msgr2=0x55b42cfece60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- 172.21.15.35:0/2525977497 shutdown_connections 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- 172.21.15.35:0/2525977497 wait complete. 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- start start 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 Processor -- start 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42d0012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d0017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42d001d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:30.299 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42d05fb90 con 0x55b42cff0b90 2023-03-17T09:12:30.300 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:24 smithi035 ceph-mon[92535]: pgmap v508: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:12:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.090+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa9809f640 0x7ffa980a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.090+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa9809f640 0x7ffa980a1af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400b5c0 tx=0x7ffa94005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 Processor -- start 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 -- start start 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c24f0 0x55d7782bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782bc960 0x55d7782bcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7781c3010 con 0x55d7782c1be0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d778215950 con 0x55d7782c24f0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77820ede0 con 0x55d7782bc960 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43864/0 (socket says 172.21.15.35:43864) 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.091+0000 7ffaab7fe700 1 -- 172.21.15.35:0/4017558668 learned_addr learned my addr 172.21.15.35:0/4017558668 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaabfff700 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782bc960 0x55d7782bcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c24f0 0x55d7782bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaab7fe700 1 -- 172.21.15.35:0/4017558668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782bc960 msgr2=0x55d7782bcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782bc960 0x55d7782bcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaab7fe700 1 -- 172.21.15.35:0/4017558668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c24f0 msgr2=0x55d7782bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c24f0 0x55d7782bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaab7fe700 1 -- 172.21.15.35:0/4017558668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7780905d0 con 0x55d7782c1be0 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782c1fb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ffa94015000 tx=0x7ffa94020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912c22ad0c82ed76 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaa1ffb700 1 -- 172.21.15.35:0/4017558668 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400be60 con 0x55d7782c1be0 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaa1ffb700 1 -- 172.21.15.35:0/4017558668 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa9401e040 con 0x55d7782c1be0 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.092+0000 7ffaa1ffb700 1 -- 172.21.15.35:0/4017558668 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94003a60 con 0x55d7782c1be0 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/4017558668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 msgr2=0x55d7782c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782c1fb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ffa94015000 tx=0x7ffa94020000 comp rx=0 tx=0).stop 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/4017558668 shutdown_connections 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782bc960 0x55d7782bcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782c1fb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/4017558668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c24f0 0x55d7782bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/4017558668 >> 172.21.15.35:0/4017558668 conn(0x55d7781196b0 msgr2=0x55d7782b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/4017558668 shutdown_connections 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/4017558668 wait complete. 2023-03-17T09:12:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.093+0000 7ffabe2f3b80 1 -- start start 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 Processor -- start 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 0x55d7782c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c1be0 0x55d7782c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7780928c0 con 0x55d7782bc960 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782c6580 con 0x55d7782c1be0 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782d63e0 con 0x55d7782c24f0 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffabe2f3b80 10 client.0 _ll_register_callbacks cb 0x55d7780b4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 0x55d7782c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 0x55d7782c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43870/0 (socket says 172.21.15.35:43870) 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 -- 172.21.15.35:0/939542779 learned_addr learned my addr 172.21.15.35:0/939542779 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaabfff700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c1be0 0x55d7782c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 -- 172.21.15.35:0/939542779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 msgr2=0x55d7782c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 -- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c1be0 msgr2=0x55d7782c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c1be0 0x55d7782c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaab7fe700 1 -- 172.21.15.35:0/939542779 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac10d880 con 0x55d7782bc960 2023-03-17T09:12:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaabfff700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:12:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.094+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c1be0 0x55d7782c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:12:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 0x55d7782c84f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000c00 tx=0x7ffa94004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df1d4aaa7bcc3dd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffa8affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:12:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffa8affd700 1 -- 172.21.15.35:0/939542779 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94003820 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffa8affd700 1 -- 172.21.15.35:0/939542779 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ffa94003980 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7781d1390 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffa8affd700 1 -- 172.21.15.35:0/939542779 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa94003b40 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 10 client.16050 fetch_fsmap learned FSMap version 29 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d77803cd80 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffa8affd700 1 -- 172.21.15.35:0/939542779 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d7781d1390 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffa8affd700 1 -- 172.21.15.35:0/939542779 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffa9402fa50 con 0x55d7782bc960 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 10 client.16050 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:12:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 20 client.16050 populate_metadata read hostname 'smithi035' 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7782da050 0x55d7782dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 4 client.16050 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.095+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7781dd600 con 0x55d7782da050 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.096+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7782da050 0x55d7782dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.096+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7782da050 0x55d7782dc460 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0c2e644b43269d server_cookie=e7e5c45d9becec1 in_seq=0 out_seq=0 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.096+0000 7ffa8affd700 10 client.16050 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffa8affd700 1 -- 172.21.15.35:0/939542779 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d7781dd600 con 0x55d7782da050 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffa8affd700 10 client.16050 handle_command_reply: tid=0 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 client.16050 shutdown 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 msgr2=0x55d7782c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 0x55d7782c84f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000c00 tx=0x7ffa94004500 comp rx=0 tx=0).stop 2023-03-17T09:12:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 shutdown_connections 2023-03-17T09:12:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7782da050 0x55d7782dc460 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782bc960 0x55d7782c84f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffa8affd700 0 client.16050 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/939542779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782c1be0 0x55d7782c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 >> 172.21.15.35:0/939542779 conn(0x55d7781196b0 msgr2=0x55d7782bb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 shutdown_connections 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.097+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/939542779 wait complete. 2023-03-17T09:12:35.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.098+0000 7ffabe2f3b80 20 client.16050 trim_cache size 0 max 16384 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 Processor -- start 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 -- start start 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782c6700 con 0x55d7782c1be0 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782c6470 con 0x55d7782bc960 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782b3b60 con 0x55d7782c24f0 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782d1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43880/0 (socket says 172.21.15.35:43880) 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffaaaffd700 1 -- 172.21.15.35:0/3621212936 learned_addr learned my addr 172.21.15.35:0/3621212936 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.113+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaaaffd700 1 -- 172.21.15.35:0/3621212936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 msgr2=0x55d7782c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaabfff700 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaaaffd700 1 -- 172.21.15.35:0/3621212936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 msgr2=0x55d7782b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:35.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaaaffd700 1 -- 172.21.15.35:0/3621212936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7781d5130 con 0x55d7782c1be0 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782d1330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55d7782b76a0 tx=0x7ffa9c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e77ab9f4b6c0493 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaa27fc700 1 -- 172.21.15.35:0/3621212936 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c01e070 con 0x55d7782c1be0 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaa27fc700 1 -- 172.21.15.35:0/3621212936 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa9c017040 con 0x55d7782c1be0 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.114+0000 7ffaa27fc700 1 -- 172.21.15.35:0/3621212936 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c005280 con 0x55d7782c1be0 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/3621212936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 msgr2=0x55d7782d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782d1330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55d7782b76a0 tx=0x7ffa9c00b410 comp rx=0 tx=0).stop 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/3621212936 shutdown_connections 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/3621212936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782d1330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/3621212936 >> 172.21.15.35:0/3621212936 conn(0x55d7781196b0 msgr2=0x55d7782bba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/3621212936 shutdown_connections 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/3621212936 wait complete. 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 -- start start 2023-03-17T09:12:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 Processor -- start 2023-03-17T09:12:36.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.115+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffabe2f3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782d03e0 con 0x55d7782c1be0 2023-03-17T09:12:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7782d0550 con 0x55d7782bc960 2023-03-17T09:12:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffabe2f3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77832dec0 con 0x55d7782c24f0 2023-03-17T09:12:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffabe2f3b80 10 client.0 _ll_register_callbacks cb 0x55d7780b4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:12:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43886/0 (socket says 172.21.15.35:43886) 2023-03-17T09:12:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 -- 172.21.15.35:0/1852980748 learned_addr learned my addr 172.21.15.35:0/1852980748 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaabfff700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:37.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 -- 172.21.15.35:0/1852980748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 msgr2=0x55d7782cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 -- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 msgr2=0x55d7782d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 -- 172.21.15.35:0/1852980748 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c01ea30 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaabfff700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffaaaffd700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782cf760 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00b7e0 tx=0x7ffa9c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf22fdda4807959f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffa8affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffa8affd700 1 -- 172.21.15.35:0/1852980748 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c004bd0 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffa8affd700 1 -- 172.21.15.35:0/1852980748 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ffa9c01e580 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.116+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d77828c1e0 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffa8affd700 1 -- 172.21.15.35:0/1852980748 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa9c004fb0 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 10 client.16056 fetch_fsmap learned FSMap version 29 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d7780631f0 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffa8affd700 1 -- 172.21.15.35:0/1852980748 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d77828c1e0 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffa8affd700 1 -- 172.21.15.35:0/1852980748 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffa9c003c20 con 0x55d7782c1be0 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 10 client.16056 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 10 client.16056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:12:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 20 client.16056 populate_metadata read hostname 'smithi035' 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d77832f390 0x55d7783317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 4 client.16056 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d778092f00 con 0x55d77832f390 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.117+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d77832f390 0x55d7783317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.118+0000 7ffaab7fe700 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d77832f390 0x55d7783317a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5ae8ba7b5edcc0e server_cookie=6074a72e9346ca20 in_seq=0 out_seq=0 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.118+0000 7ffa8affd700 10 client.16056 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffa8affd700 1 -- 172.21.15.35:0/1852980748 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d778092f00 con 0x55d77832f390 2023-03-17T09:12:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffa8affd700 10 client.16056 handle_command_reply: tid=0 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42d05fd00 con 0x55b42cff7b10 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42d05fec0 con 0x55b42cff14a0 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f945ea54b80 10 client.0 _ll_register_callbacks cb 0x55b42cde7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.544+0000 7f944bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42d0012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42d0012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44196/0 (socket says 172.21.15.35:44196) 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 -- 172.21.15.35:0/2028205212 learned_addr learned my addr 172.21.15.35:0/2028205212 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f9450e64700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42d001d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944b7fe700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d0017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 -- 172.21.15.35:0/2028205212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 msgr2=0x55b42d0017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:39.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d0017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 -- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 msgr2=0x55b42d001d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42d001d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 -- 172.21.15.35:0/2028205212 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c10ee60 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f944bfff700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42d0012b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f943c010c00 tx=0x7f943c00aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b346990ef2bdb06b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f942b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f942b7fe700 1 -- 172.21.15.35:0/2028205212 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c02b040 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f942b7fe700 1 -- 172.21.15.35:0/2028205212 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f943c003e40 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b42cfbf240 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f942b7fe700 1 -- 172.21.15.35:0/2028205212 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f943c033c30 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f945ea54b80 10 client.16182 fetch_fsmap learned FSMap version 29 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55b42cd96250 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.545+0000 7f942b7fe700 1 -- 172.21.15.35:0/2028205212 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b42cfbf240 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f942b7fe700 1 -- 172.21.15.35:0/2028205212 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f943c033210 con 0x55b42cff0b90 2023-03-17T09:12:41.433 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 10 client.16182 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:12:41.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 10 client.16182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T09:12:41.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 20 client.16182 populate_metadata read hostname 'smithi035' 2023-03-17T09:12:41.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d061490 0x55b42d0638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:12:41.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 4 client.16182 mds_command: new command op to 24452 tid=0[{"prefix": "scrub status"}] 2023-03-17T09:12:41.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b42cdc5f60 con 0x55b42d061490 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f944b7fe700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d061490 0x55b42d0638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f942b7fe700 10 client.16182 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f944b7fe700 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d061490 0x55b42d0638a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbec8e86ff87fa0 server_cookie=9a9bdd36f3438108 in_seq=0 out_seq=0 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f942b7fe700 1 -- 172.21.15.35:0/2028205212 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b42cdc5f60 con 0x55b42d061490 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f942b7fe700 10 client.16182 handle_command_reply: tid=0 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.546+0000 7f945ea54b80 1 client.16182 shutdown 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 msgr2=0x55b42d0012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42d0012b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f943c010c00 tx=0x7f943c00aa00 comp rx=0 tx=0).stop 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 shutdown_connections 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b42d061490 0x55b42d0638a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.001 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b42cff7b10 0x55b42d001d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f942b7fe700 0 client.16182 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b42cff0b90 0x55b42d0012b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 --2- 172.21.15.35:0/2028205212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b42cff14a0 0x55b42d0017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 >> 172.21.15.35:0/2028205212 conn(0x55b42cfeca90 msgr2=0x55b42d007de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 shutdown_connections 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 1 -- 172.21.15.35:0/2028205212 wait complete. 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f945ea54b80 20 client.16182 trim_cache size 0 max 16384 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f943409f6c0 msgr2=0x7f94340a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f943409f6c0 0x7f94340a1b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f943c00ac50 tx=0x7f943c00a380 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 msgr2=0x7f944c199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 0x7f944c199a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9444007ee0 tx=0x7f944400d3b0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 shutdown_connections 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f943409f6c0 0x7f94340a1b70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f944c1043c0 0x7f944c199a20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c0ff380 0x7f944c195080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 --2- 172.21.15.35:0/1340329579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f944c0ffd20 0x7f944c1955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:12:43.002 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 >> 172.21.15.35:0/1340329579 conn(0x7f944c076300 msgr2=0x7f944c0fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:12:43.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.547+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 shutdown_connections 2023-03-17T09:12:43.648 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:02:10.548+0000 7f94528c7700 1 -- 172.21.15.35:0/1340329579 wait complete. 2023-03-17T09:12:43.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:26 smithi035 ceph-mon[92535]: pgmap v509: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:12:43.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:28 smithi035 ceph-mon[92535]: pgmap v510: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:12:43.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:30 smithi035 ceph-mon[92535]: pgmap v511: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:12:43.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:32 smithi035 ceph-mon[92535]: pgmap v512: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:12:43.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:34 smithi035 ceph-mon[92535]: pgmap v513: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:12:43.649 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:36 smithi035 ceph-mon[92535]: pgmap v514: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:12:45.720 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:38 smithi035 ceph-mon[92535]: pgmap v515: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T09:12:45.720 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:40 smithi035 ceph-mon[92535]: pgmap v516: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:45.720 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:12:47.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:42 smithi035 ceph-mon[92535]: pgmap v517: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:47.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:12:47.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:12:47.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:44 smithi035 ceph-mon[92535]: pgmap v518: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:46 smithi035 ceph-mon[92535]: pgmap v519: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:48 smithi035 ceph-mon[92535]: pgmap v520: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:50 smithi035 ceph-mon[92535]: pgmap v521: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:52 smithi035 ceph-mon[92535]: pgmap v522: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:54 smithi035 ceph-mon[92535]: pgmap v523: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:56 smithi035 ceph-mon[92535]: pgmap v524: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:47.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:02:58 smithi035 ceph-mon[92535]: pgmap v525: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:48.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:00 smithi035 ceph-mon[92535]: pgmap v526: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:48.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:02 smithi035 ceph-mon[92535]: pgmap v527: 97 pgs: 97 active+clean; 1.4 MiB data, 114 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:48.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:04 smithi035 ceph-mon[92535]: pgmap v528: 97 pgs: 97 active+clean; 1.4 MiB data, 119 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:12:48.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:05 smithi035 ceph-mon[92535]: osdmap e107: 12 total, 12 up, 12 in 2023-03-17T09:12:48.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:06 smithi035 ceph-mon[92535]: pgmap v530: 97 pgs: 97 active+clean; 1.4 MiB data, 119 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:12:48.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:08 smithi035 ceph-mon[92535]: pgmap v531: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:12:48.665 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:10 smithi035 ceph-mon[92535]: pgmap v532: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:12:49.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:10 smithi035 ceph-mon[92535]: osdmap e108: 12 total, 12 up, 12 in 2023-03-17T09:12:49.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:12 smithi035 ceph-mon[92535]: pgmap v534: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:12:50.472 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:14 smithi035 ceph-mon[92535]: pgmap v535: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 458 B/s wr, 10 op/s 2023-03-17T09:12:50.978 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:15 smithi035 ceph-mon[92535]: daemon mds.e restarted 2023-03-17T09:12:50.978 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:15 smithi035 ceph-mon[92535]: osdmap e109: 12 total, 12 up, 12 in 2023-03-17T09:12:50.978 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6834/240520807,v1:172.21.15.78:6835/240520807] up:boot 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:16 smithi035 ceph-mon[92535]: pgmap v537: 97 pgs: 97 active+clean; 1.4 MiB data, 120 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:18 smithi035 ceph-mon[92535]: pgmap v538: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:20 smithi035 ceph-mon[92535]: pgmap v539: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 566 B/s wr, 10 op/s 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:22 smithi035 ceph-mon[92535]: pgmap v540: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:12:50.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:24 smithi035 ceph-mon[92535]: pgmap v541: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:12:51.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:26 smithi035 ceph-mon[92535]: pgmap v542: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 392 B/s wr, 10 op/s 2023-03-17T09:12:51.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:28 smithi035 ceph-mon[92535]: pgmap v543: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:12:51.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:30 smithi035 ceph-mon[92535]: pgmap v544: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:12:51.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:32 smithi035 ceph-mon[92535]: pgmap v545: 97 pgs: 97 active+clean; 1.4 MiB data, 121 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:12:51.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:34 smithi035 ceph-mon[92535]: pgmap v546: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:51.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:36 smithi035 ceph-mon[92535]: pgmap v547: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:38 smithi035 ceph-mon[92535]: pgmap v548: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:40 smithi035 ceph-mon[92535]: pgmap v549: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:42 smithi035 ceph-mon[92535]: pgmap v550: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:44 smithi035 ceph-mon[92535]: pgmap v551: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:46 smithi035 ceph-mon[92535]: pgmap v552: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:48 smithi035 ceph-mon[92535]: pgmap v553: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:50 smithi035 ceph-mon[92535]: pgmap v554: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:52 smithi035 ceph-mon[92535]: pgmap v555: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:54 smithi035 ceph-mon[92535]: pgmap v556: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:56 smithi035 ceph-mon[92535]: pgmap v557: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:03:58 smithi035 ceph-mon[92535]: pgmap v558: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:00 smithi035 ceph-mon[92535]: pgmap v559: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.399 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:02 smithi035 ceph-mon[92535]: pgmap v560: 97 pgs: 97 active+clean; 1.4 MiB data, 125 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:04 smithi035 ceph-mon[92535]: pgmap v561: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:06 smithi035 ceph-mon[92535]: pgmap v562: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:08 smithi035 ceph-mon[92535]: pgmap v563: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:09 smithi035 ceph-mon[92535]: osdmap e110: 12 total, 12 up, 12 in 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:10 smithi035 ceph-mon[92535]: pgmap v565: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:12 smithi035 ceph-mon[92535]: pgmap v566: 97 pgs: 97 active+clean; 1.4 MiB data, 126 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:14 smithi035 ceph-mon[92535]: pgmap v567: 97 pgs: 97 active+clean; 1.4 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:16 smithi035 ceph-mon[92535]: osdmap e111: 12 total, 12 up, 12 in 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:16 smithi035 ceph-mon[92535]: pgmap v569: 97 pgs: 97 active+clean; 1.4 MiB data, 130 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:18 smithi035 ceph-mon[92535]: pgmap v570: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T09:12:52.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:20 smithi035 ceph-mon[92535]: pgmap v571: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:12:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:54.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:12:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:12:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:12:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:12:58.242 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T09:12:58.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 client.16056 shutdown 2023-03-17T09:13:00.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 msgr2=0x55d7782cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:00.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782cf760 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00b7e0 tx=0x7ffa9c00bf00 comp rx=0 tx=0).stop 2023-03-17T09:13:00.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 shutdown_connections 2023-03-17T09:13:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d77832f390 0x55d7783317a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7782c24f0 0x55d7782cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7782bc960 0x55d7782d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 --2- 172.21.15.35:0/1852980748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7782c1be0 0x55d7782cf760 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 >> 172.21.15.35:0/1852980748 conn(0x55d7781196b0 msgr2=0x55d7782c4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffa8affd700 0 client.16056 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 shutdown_connections 2023-03-17T09:13:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 1 -- 172.21.15.35:0/1852980748 wait complete. 2023-03-17T09:13:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.122+0000 7ffabe2f3b80 20 client.16056 trim_cache size 0 max 16384 2023-03-17T09:13:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa9809f640 msgr2=0x7ffa980a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa9809f640 0x7ffa980a1af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400b5c0 tx=0x7ffa94005fb0 comp rx=0 tx=0).stop 2023-03-17T09:13:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 msgr2=0x7ffaac19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 0x7ffaac19ab40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4007ee0 tx=0x7ffaa400d3b0 comp rx=0 tx=0).stop 2023-03-17T09:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 shutdown_connections 2023-03-17T09:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa9809f640 0x7ffa980a1af0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffaac10a750 0x7ffaac19ab40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffaac101410 0x7ffaac196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 --2- 172.21.15.35:0/1214765413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaac101d20 0x7ffaac196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 >> 172.21.15.35:0/1214765413 conn(0x7ffaac076330 msgr2=0x7ffaac1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 shutdown_connections 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:00:49.123+0000 7ffab2166700 1 -- 172.21.15.35:0/1214765413 wait complete. 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 -- 172.21.15.35:0/1321413581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c0ff350 msgr2=0x7ff43c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 --2- 172.21.15.35:0/1321413581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c0ff350 0x7ff43c0ff720 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099c0 tx=0x7ff42c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 -- 172.21.15.35:0/1321413581 shutdown_connections 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 --2- 172.21.15.35:0/1321413581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff43c104390 0x7ff43c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 --2- 172.21.15.35:0/1321413581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c0ff350 0x7ff43c0ff720 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 --2- 172.21.15.35:0/1321413581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ffcf0 0x7ff43c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 -- 172.21.15.35:0/1321413581 >> 172.21.15.35:0/1321413581 conn(0x7ff43c076330 msgr2=0x7ff43c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 -- 172.21.15.35:0/1321413581 shutdown_connections 2023-03-17T09:13:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.248+0000 7ff441b33700 1 -- 172.21.15.35:0/1321413581 wait complete. 2023-03-17T09:13:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.249+0000 7ff441b33700 1 Processor -- start 2023-03-17T09:13:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.249+0000 7ff441b33700 1 -- start start 2023-03-17T09:13:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ff350 0x7ff43c196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff43c0ffcf0 0x7ff43c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 0x7ff43c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c19b230 con 0x7ff43c104390 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c19b3a0 con 0x7ff43c0ff350 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c19b560 con 0x7ff43c0ffcf0 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 0x7ff43c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 0x7ff43c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43920/0 (socket says 172.21.15.35:43920) 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ff350 0x7ff43c196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 -- 172.21.15.35:0/2246102824 learned_addr learned my addr 172.21.15.35:0/2246102824 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:03.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43affd700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff43c0ffcf0 0x7ff43c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:04.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 -- 172.21.15.35:0/2246102824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff43c0ffcf0 msgr2=0x7ff43c196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff43c0ffcf0 0x7ff43c196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 -- 172.21.15.35:0/2246102824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ff350 msgr2=0x7ff43c196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ff350 0x7ff43c196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 -- 172.21.15.35:0/2246102824 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0095f0 con 0x7ff43c104390 2023-03-17T09:13:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ff350 0x7ff43c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:13:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 0x7ff43c19abf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff43400ef30 tx=0x7ff43400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff438ff9700 1 -- 172.21.15.35:0/2246102824 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434018070 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff438ff9700 1 -- 172.21.15.35:0/2246102824 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff43400f040 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff438ff9700 1 -- 172.21.15.35:0/2246102824 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43400cbc0 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.250+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c10f000 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.251+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c10ee70 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.253+0000 7ff438ff9700 1 -- 172.21.15.35:0/2246102824 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff434007500 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.253+0000 7ff438ff9700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42409f6c0 0x7ff4240a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.254+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42409f6c0 0x7ff4240a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.254+0000 7ff438ff9700 1 -- 172.21.15.35:0/2246102824 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff4340ca070 con 0x7ff43c104390 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.254+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42409f6c0 0x7ff4240a1b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00b580 tx=0x7ff42c01a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.254+0000 7ff44dcc0b80 1 Processor -- start 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.254+0000 7ff44dcc0b80 1 -- start start 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e47fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e42420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e42960 0x5560e7e42d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7d49010 con 0x5560e7e47be0 2023-03-17T09:13:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7d9b950 con 0x5560e7e484f0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7d94de0 con 0x5560e7e42960 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e47fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e47fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43924/0 (socket says 172.21.15.35:43924) 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 -- 172.21.15.35:0/2245769640 learned_addr learned my addr 172.21.15.35:0/2245769640 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43affd700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e42420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e42960 0x5560e7e42d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 -- 172.21.15.35:0/2245769640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e42960 msgr2=0x5560e7e42d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e42960 0x5560e7e42d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 -- 172.21.15.35:0/2245769640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 msgr2=0x5560e7e42420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e42420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 -- 172.21.15.35:0/2245769640 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e7c165d0 con 0x5560e7e47be0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e42960 0x5560e7e42d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43affd700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e42420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e47fb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099c0 tx=0x7ff42c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a82d1eb3b3c9dd5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.255+0000 7ff421ffb700 1 -- 172.21.15.35:0/2245769640 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c003760 con 0x5560e7e47be0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff421ffb700 1 -- 172.21.15.35:0/2245769640 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff42c01e040 con 0x5560e7e47be0 2023-03-17T09:13:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff421ffb700 1 -- 172.21.15.35:0/2245769640 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00fa20 con 0x5560e7e47be0 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2245769640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 msgr2=0x5560e7e47fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e47fb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099c0 tx=0x7ff42c01f000 comp rx=0 tx=0).stop 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2245769640 shutdown_connections 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e42960 0x5560e7e42d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e47fb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2245769640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e42420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2245769640 >> 172.21.15.35:0/2245769640 conn(0x5560e7c9f6b0 msgr2=0x5560e7e3ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2245769640 shutdown_connections 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.256+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2245769640 wait complete. 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 -- start start 2023-03-17T09:13:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 Processor -- start 2023-03-17T09:13:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e4e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e4b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e484f0 0x5560e7e4bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7c188c0 con 0x5560e7e47be0 2023-03-17T09:13:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7e4c350 con 0x5560e7e42960 2023-03-17T09:13:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7e4c510 con 0x5560e7e484f0 2023-03-17T09:13:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff44dcc0b80 10 client.0 _ll_register_callbacks cb 0x5560e7c3a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:13:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e4e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff43affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e4b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff43affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e4b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43932/0 (socket says 172.21.15.35:43932) 2023-03-17T09:13:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff43affd700 1 -- 172.21.15.35:0/4025225851 learned_addr learned my addr 172.21.15.35:0/4025225851 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e4e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:45726/0 (socket says 172.21.15.35:45726) 2023-03-17T09:13:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.257+0000 7ff43bfff700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e484f0 0x5560e7e4bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43affd700 1 -- 172.21.15.35:0/4025225851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e484f0 msgr2=0x5560e7e4bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:07.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43affd700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e484f0 0x5560e7e4bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43affd700 1 -- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 msgr2=0x5560e7e4e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43affd700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e4e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43affd700 1 -- 172.21.15.35:0/4025225851 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c10c7a0 con 0x5560e7e47be0 2023-03-17T09:13:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43bfff700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e484f0 0x5560e7e4bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:13:07.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff43affd700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e4b650 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff4300126e0 tx=0x7ff4300129f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6d1e1c79f4ad17 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff41affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff41affd700 1 -- 172.21.15.35:0/4025225851 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430017070 con 0x5560e7e47be0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff41affd700 1 -- 172.21.15.35:0/4025225851 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff430004830 con 0x5560e7e47be0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560e7d57390 con 0x5560e7e47be0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff41affd700 1 -- 172.21.15.35:0/4025225851 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4300049f0 con 0x5560e7e47be0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff44dcc0b80 10 client.16068 fetch_fsmap learned FSMap version 29 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.258+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5560e7bc2d80 con 0x5560e7e47be0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff41affd700 1 -- 172.21.15.35:0/4025225851 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5560e7d57390 con 0x5560e7e47be0 2023-03-17T09:13:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff41affd700 1 -- 172.21.15.35:0/4025225851 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff43001c500 con 0x5560e7e47be0 2023-03-17T09:13:08.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff44dcc0b80 10 client.16068 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:13:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff44dcc0b80 10 client.16068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:13:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff44dcc0b80 20 client.16068 populate_metadata read hostname 'smithi035' 2023-03-17T09:13:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7e5bf90 0x5560e7e5e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff44dcc0b80 4 client.16068 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:13:11.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560e7d63600 con 0x5560e7e5bf90 2023-03-17T09:13:11.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7e5bf90 0x5560e7e5e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:11.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7e5bf90 0x5560e7e5e3a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61cddd139da48eb4 server_cookie=901f8af0cd39dc0b in_seq=0 out_seq=0 2023-03-17T09:13:11.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.259+0000 7ff41affd700 10 client.16068 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:11.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff41affd700 1 -- 172.21.15.35:0/4025225851 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5560e7d63600 con 0x5560e7e5bf90 2023-03-17T09:13:11.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff41affd700 10 client.16068 handle_command_reply: tid=0 2023-03-17T09:13:11.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 client.16068 shutdown 2023-03-17T09:13:11.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 msgr2=0x5560e7e4b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e4b650 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff4300126e0 tx=0x7ff4300129f0 comp rx=0 tx=0).stop 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 shutdown_connections 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7e5bf90 0x5560e7e5e3a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e484f0 0x5560e7e4bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e4e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff41affd700 0 client.16068 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/4025225851 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e47be0 0x5560e7e4b650 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 >> 172.21.15.35:0/4025225851 conn(0x5560e7c9f6b0 msgr2=0x5560e7e41410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 shutdown_connections 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.260+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/4025225851 wait complete. 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.261+0000 7ff44dcc0b80 20 client.16068 trim_cache size 0 max 16384 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 Processor -- start 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 -- start start 2023-03-17T09:13:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 0x5560e7e3cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e52ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e4df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7e3d000 con 0x5560e7e42960 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7e42760 con 0x5560e7e484f0 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7e49c30 con 0x5560e7e47be0 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 0x5560e7e3cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 0x5560e7e3cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43938/0 (socket says 172.21.15.35:43938) 2023-03-17T09:13:12.420 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-03-17T09:13:13.471 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T09:13:14.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:22 smithi035 ceph-mon[92535]: pgmap v572: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 -- 172.21.15.35:0/1582434052 learned_addr learned my addr 172.21.15.35:0/1582434052 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 -- 172.21.15.35:0/1582434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 msgr2=0x5560e7e52ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e52ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 -- 172.21.15.35:0/1582434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 msgr2=0x5560e7e4df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43bfff700 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e4df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e4df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 -- 172.21.15.35:0/1582434052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560e7d5b130 con 0x5560e7e42960 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43bfff700 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e4df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:13:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.276+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 0x5560e7e3cac0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff42c005d10 tx=0x7ff42c032040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721a744c052a3f41 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff4227fc700 1 -- 172.21.15.35:0/1582434052 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0393a0 con 0x5560e7e42960 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff4227fc700 1 -- 172.21.15.35:0/1582434052 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff42c01e070 con 0x5560e7e42960 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff4227fc700 1 -- 172.21.15.35:0/1582434052 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c003a50 con 0x5560e7e42960 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/1582434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 msgr2=0x5560e7e3cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 0x5560e7e3cac0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff42c005d10 tx=0x7ff42c032040 comp rx=0 tx=0).stop 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/1582434052 shutdown_connections 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e484f0 0x5560e7e4df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e42960 0x5560e7e3cac0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/1582434052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e52ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/1582434052 >> 172.21.15.35:0/1582434052 conn(0x5560e7c9f6b0 msgr2=0x5560e7e41a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/1582434052 shutdown_connections 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.277+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/1582434052 wait complete. 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 -- start start 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 Processor -- start 2023-03-17T09:13:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e50d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 0x5560e7eaee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7eaf370 con 0x5560e7e484f0 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7eaf4e0 con 0x5560e7e42960 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560e7eaf6a0 con 0x5560e7e47be0 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff44dcc0b80 10 client.0 _ll_register_callbacks cb 0x5560e7c3a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff43bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 0x5560e7eaee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff43bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 0x5560e7eaee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43948/0 (socket says 172.21.15.35:43948) 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff43bfff700 1 -- 172.21.15.35:0/2582652574 learned_addr learned my addr 172.21.15.35:0/2582652574 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e50d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.278+0000 7ff43affd700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff43bfff700 1 -- 172.21.15.35:0/2582652574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 msgr2=0x5560e7e512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff43bfff700 1 -- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 msgr2=0x5560e7e50d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e50d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff43bfff700 1 -- 172.21.15.35:0/2582652574 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560e7c165d0 con 0x5560e7e484f0 2023-03-17T09:13:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff43bfff700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 0x5560e7eaee30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff434097ae0 tx=0x7ff434098090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3db8e0e973e9de server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff41affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:13:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff41affd700 1 -- 172.21.15.35:0/2582652574 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43409f820 con 0x5560e7e484f0 2023-03-17T09:13:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff41affd700 1 -- 172.21.15.35:0/2582652574 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff43409f980 con 0x5560e7e484f0 2023-03-17T09:13:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560e7e121e0 con 0x5560e7e484f0 2023-03-17T09:13:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff41affd700 1 -- 172.21.15.35:0/2582652574 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff43409bb80 con 0x5560e7e484f0 2023-03-17T09:13:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff44dcc0b80 10 client.16074 fetch_fsmap learned FSMap version 29 2023-03-17T09:13:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5560e7be91f0 con 0x5560e7e484f0 2023-03-17T09:13:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.279+0000 7ff41affd700 1 -- 172.21.15.35:0/2582652574 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4340c7020 con 0x5560e7e484f0 2023-03-17T09:13:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff41affd700 1 -- 172.21.15.35:0/2582652574 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff434093b40 con 0x5560e7e484f0 2023-03-17T09:13:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff44dcc0b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff44dcc0b80 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff44dcc0b80 20 client.16074 populate_metadata read hostname 'smithi035' 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7eb0dd0 0x5560e7eb31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff44dcc0b80 4 client.16074 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5560e7c18f00 con 0x5560e7eb0dd0 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7eb0dd0 0x5560e7eb31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff43b7fe700 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7eb0dd0 0x5560e7eb31e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b049ac1aa87660a server_cookie=4dc7072d5435b208 in_seq=0 out_seq=0 2023-03-17T09:13:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:02.280+0000 7ff41affd700 10 client.16074 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff41affd700 1 -- 172.21.15.35:0/2582652574 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5560e7c18f00 con 0x5560e7eb0dd0 2023-03-17T09:13:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff41affd700 10 client.16074 handle_command_reply: tid=0 2023-03-17T09:13:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 client.16074 shutdown 2023-03-17T09:13:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 msgr2=0x5560e7eaee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 0x5560e7eaee30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff434097ae0 tx=0x7ff434098090 comp rx=0 tx=0).stop 2023-03-17T09:13:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 shutdown_connections 2023-03-17T09:13:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560e7eb0dd0 0x5560e7eb31e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560e7e484f0 0x5560e7eaee30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.221+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560e7e42960 0x5560e7e50d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff44dcc0b80 1 --2- 172.21.15.35:0/2582652574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560e7e47be0 0x5560e7e512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff41affd700 0 client.16074 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 >> 172.21.15.35:0/2582652574 conn(0x5560e7c9f6b0 msgr2=0x5560e7e456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 shutdown_connections 2023-03-17T09:13:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff44dcc0b80 1 -- 172.21.15.35:0/2582652574 wait complete. 2023-03-17T09:13:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff44dcc0b80 20 client.16074 trim_cache size 0 max 16384 2023-03-17T09:13:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42409f6c0 msgr2=0x7ff4240a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff441b33700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42409f6c0 0x7ff4240a1b70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00b580 tx=0x7ff42c01a040 comp rx=0 tx=0).stop 2023-03-17T09:13:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 msgr2=0x7ff43c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.222+0000 7ff441b33700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 0x7ff43c19abf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff43400ef30 tx=0x7ff43400c3a0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 shutdown_connections 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42409f6c0 0x7ff4240a1b70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff43c104390 0x7ff43c19abf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43c0ff350 0x7ff43c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 --2- 172.21.15.35:0/2246102824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff43c0ffcf0 0x7ff43c196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 >> 172.21.15.35:0/2246102824 conn(0x7ff43c076330 msgr2=0x7ff43c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 shutdown_connections 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:03.223+0000 7ff441b33700 1 -- 172.21.15.35:0/2246102824 wait complete. 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 -- 172.21.15.35:0/57228469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c104390 msgr2=0x7fb20c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 --2- 172.21.15.35:0/57228469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c104390 0x7fb20c10bf60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b0d0 tx=0x7fb20400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 -- 172.21.15.35:0/57228469 shutdown_connections 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 --2- 172.21.15.35:0/57228469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c104390 0x7fb20c10bf60 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 --2- 172.21.15.35:0/57228469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ff350 0x7fb20c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 --2- 172.21.15.35:0/57228469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20c0ffcf0 0x7fb20c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.347+0000 7fb21281c700 1 -- 172.21.15.35:0/57228469 >> 172.21.15.35:0/57228469 conn(0x7fb20c076330 msgr2=0x7fb20c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.348+0000 7fb21281c700 1 -- 172.21.15.35:0/57228469 shutdown_connections 2023-03-17T09:13:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.348+0000 7fb21281c700 1 -- 172.21.15.35:0/57228469 wait complete. 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.348+0000 7fb21281c700 1 Processor -- start 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.348+0000 7fb21281c700 1 -- start start 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb21281c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 0x7fb20c195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb21281c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ffcf0 0x7fb20c1957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb21281c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20c104390 0x7fb20c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb21281c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c19a250 con 0x7fb20c0ff350 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb21281c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c19a3c0 con 0x7fb20c0ffcf0 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb21281c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c19a580 con 0x7fb20c104390 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 0x7fb20c195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 0x7fb20c195270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43958/0 (socket says 172.21.15.35:43958) 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 -- 172.21.15.35:0/2531881003 learned_addr learned my addr 172.21.15.35:0/2531881003 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ffcf0 0x7fb20c1957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb210db9700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20c104390 0x7fb20c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 -- 172.21.15.35:0/2531881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20c104390 msgr2=0x7fb20c199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20c104390 0x7fb20c199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 -- 172.21.15.35:0/2531881003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ffcf0 msgr2=0x7fb20c1957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ffcf0 0x7fb20c1957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 -- 172.21.15.35:0/2531881003 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204009d00 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ffcf0 0x7fb20c1957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 0x7fb20c195270 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00d950 tx=0x7fb1fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.349+0000 7fb2097fa700 1 -- 172.21.15.35:0/2531881003 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc009b40 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.350+0000 7fb2097fa700 1 -- 172.21.15.35:0/2531881003 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1fc009ca0 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.350+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c10f010 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.350+0000 7fb2097fa700 1 -- 172.21.15.35:0/2531881003 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00f620 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.350+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c10ee80 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.352+0000 7fb2097fa700 1 -- 172.21.15.35:0/2531881003 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb1fc010460 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.353+0000 7fb2097fa700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb1f409f640 0x7fb1f40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.353+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb1f409f640 0x7fb1f40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.353+0000 7fb2097fa700 1 -- 172.21.15.35:0/2531881003 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb1fc0ca9a0 con 0x7fb20c0ff350 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.353+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb1f409f640 0x7fb1f40a1af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb20c196880 tx=0x7fb200005d80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 Processor -- start 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 -- start start 2023-03-17T09:13:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a43630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a43fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483948010 con 0x565483a48d90 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548399a950 con 0x565483a496a0 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483993de0 con 0x565483a43b70 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a49160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43966/0 (socket says 172.21.15.35:43966) 2023-03-17T09:13:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb20bfff700 1 -- 172.21.15.35:0/343234818 learned_addr learned my addr 172.21.15.35:0/343234818 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.354+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a43630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb210db9700 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a43fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb20bfff700 1 -- 172.21.15.35:0/343234818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 msgr2=0x565483a43fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb20bfff700 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a43fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb20bfff700 1 -- 172.21.15.35:0/343234818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 msgr2=0x565483a43630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb20bfff700 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a43630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb20bfff700 1 -- 172.21.15.35:0/343234818 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654838155d0 con 0x565483a48d90 2023-03-17T09:13:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb210db9700 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a43fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:13:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb20bfff700 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a49160 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc094ec0 tx=0x7fb1fc0982a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7c69d1c41f7bd7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb1f27fc700 1 -- 172.21.15.35:0/343234818 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc098450 con 0x565483a48d90 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb1f27fc700 1 -- 172.21.15.35:0/343234818 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1fc0a0640 con 0x565483a48d90 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.355+0000 7fb1f27fc700 1 -- 172.21.15.35:0/343234818 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0986b0 con 0x565483a48d90 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/343234818 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 msgr2=0x565483a49160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a49160 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc094ec0 tx=0x7fb1fc0982a0 comp rx=0 tx=0).stop 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/343234818 shutdown_connections 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a43fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a49160 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/343234818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a43630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/343234818 >> 172.21.15.35:0/343234818 conn(0x56548389e6b0 msgr2=0x565483a3ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/343234818 shutdown_connections 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/343234818 wait complete. 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 -- start start 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.356+0000 7fb21e9a9b80 1 Processor -- start 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a4f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a4c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:23.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:24 smithi035 ceph-mon[92535]: pgmap v573: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 0x565483a4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654838178c0 con 0x565483a496a0 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a4d770 con 0x565483a48d90 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a590b0 con 0x565483a43b70 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb21e9a9b80 10 client.0 _ll_register_callbacks cb 0x565483839230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 0x565483a4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 0x565483a4d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43976/0 (socket says 172.21.15.35:43976) 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 -- 172.21.15.35:0/1524308932 learned_addr learned my addr 172.21.15.35:0/1524308932 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a4c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb20bfff700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a4f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 -- 172.21.15.35:0/1524308932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 msgr2=0x565483a4f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a4f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 -- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 msgr2=0x565483a4c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a4c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 -- 172.21.15.35:0/1524308932 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c10ee80 con 0x565483a496a0 2023-03-17T09:13:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb210db9700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 0x565483a4d030 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb204004ce0 tx=0x7fb204004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9617f23ca3e3607d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.357+0000 7fb1eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:13:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/1524308932 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400e040 con 0x565483a496a0 2023-03-17T09:13:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565483956390 con 0x565483a496a0 2023-03-17T09:13:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/1524308932 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb2040076f0 con 0x565483a496a0 2023-03-17T09:13:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/1524308932 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb204009b80 con 0x565483a496a0 2023-03-17T09:13:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 10 client.16086 fetch_fsmap learned FSMap version 29 2023-03-17T09:13:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5654837c1d80 con 0x565483a496a0 2023-03-17T09:13:26.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/1524308932 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565483956390 con 0x565483a496a0 2023-03-17T09:13:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/1524308932 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb204019070 con 0x565483a496a0 2023-03-17T09:13:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 10 client.16086 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:13:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 10 client.16086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:13:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 20 client.16086 populate_metadata read hostname 'smithi035' 2023-03-17T09:13:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483a5d210 0x565483a5f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 4 client.16086 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:13:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565483962600 con 0x565483a5d210 2023-03-17T09:13:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.358+0000 7fb20bfff700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483a5d210 0x565483a5f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:29.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.359+0000 7fb1eb7fe700 10 client.16086 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.359+0000 7fb20bfff700 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483a5d210 0x565483a5f620 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d59faf0276c0b31 server_cookie=544262385374aadc in_seq=0 out_seq=0 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.359+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/1524308932 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x565483962600 con 0x565483a5d210 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.359+0000 7fb1eb7fe700 10 client.16086 handle_command_reply: tid=0 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.359+0000 7fb21e9a9b80 1 client.16086 shutdown 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 msgr2=0x565483a4d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 0x565483a4d030 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb204004ce0 tx=0x7fb204004d10 comp rx=0 tx=0).stop 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 shutdown_connections 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483a5d210 0x565483a5f620 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:29.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a496a0 0x565483a4d030 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb1eb7fe700 0 client.16086 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a4f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/1524308932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a4c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:33.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 >> 172.21.15.35:0/1524308932 conn(0x56548389e6b0 msgr2=0x565483a40410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:33.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 shutdown_connections 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/1524308932 wait complete. 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.360+0000 7fb21e9a9b80 20 client.16086 trim_cache size 0 max 16384 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 Processor -- start 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 -- start start 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a40b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a3bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a53ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:35.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483956390 con 0x565483a48d90 2023-03-17T09:13:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a3d620 con 0x565483a496a0 2023-03-17T09:13:35.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a3c000 con 0x565483a43b70 2023-03-17T09:13:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a3bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a3bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43982/0 (socket says 172.21.15.35:43982) 2023-03-17T09:13:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 -- 172.21.15.35:0/2480333017 learned_addr learned my addr 172.21.15.35:0/2480333017 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb210db9700 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a53ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a40b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 -- 172.21.15.35:0/2480333017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 msgr2=0x565483a40b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a40b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 -- 172.21.15.35:0/2480333017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 msgr2=0x565483a53ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a53ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.375+0000 7fb20b7fe700 1 -- 172.21.15.35:0/2480333017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56548395a130 con 0x565483a48d90 2023-03-17T09:13:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a3bac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb20000fde0 tx=0x7fb200012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c2d50b9b583bf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb1f2ffd700 1 -- 172.21.15.35:0/2480333017 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200024070 con 0x565483a48d90 2023-03-17T09:13:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb1f2ffd700 1 -- 172.21.15.35:0/2480333017 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb20000fe10 con 0x565483a48d90 2023-03-17T09:13:37.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb1f2ffd700 1 -- 172.21.15.35:0/2480333017 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200003aa0 con 0x565483a48d90 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2480333017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 msgr2=0x565483a3bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a3bac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb20000fde0 tx=0x7fb200012000 comp rx=0 tx=0).stop 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2480333017 shutdown_connections 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a496a0 0x565483a53ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a43b70 0x565483a40b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2480333017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a48d90 0x565483a3bac0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2480333017 >> 172.21.15.35:0/2480333017 conn(0x56548389e6b0 msgr2=0x565483a40410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2480333017 shutdown_connections 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.376+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2480333017 wait complete. 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 -- start start 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 Processor -- start 2023-03-17T09:13:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 0x565483a53d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a50030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a496a0 0x565483a50570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a54630 con 0x565483a43b70 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a50ab0 con 0x565483a48d90 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565483a50c70 con 0x565483a496a0 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb21e9a9b80 10 client.0 _ll_register_callbacks cb 0x565483839230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 0x565483a53d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 0x565483a53d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:43986/0 (socket says 172.21.15.35:43986) 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.377+0000 7fb20bfff700 1 -- 172.21.15.35:0/2468758548 learned_addr learned my addr 172.21.15.35:0/2468758548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a50030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb210db9700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a496a0 0x565483a50570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20bfff700 1 -- 172.21.15.35:0/2468758548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a496a0 msgr2=0x565483a50570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a496a0 0x565483a50570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20bfff700 1 -- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 msgr2=0x565483a50030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a50030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20bfff700 1 -- 172.21.15.35:0/2468758548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20000fac0 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb210db9700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a496a0 0x565483a50570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb20bfff700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 0x565483a53d20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0983e0 tx=0x7fb1fc0a0740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc402913bfd0b0c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb1eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/2468758548 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc098450 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/2468758548 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb1fc010710 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565483a111e0 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/2468758548 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1fc094b60 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb21e9a9b80 10 client.16092 fetch_fsmap learned FSMap version 29 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5654837e81f0 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.378+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/2468758548 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1fc062080 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/2468758548 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1fc0986b0 con 0x565483a43b70 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb21e9a9b80 10 client.16092 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:13:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb21e9a9b80 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:13:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb21e9a9b80 20 client.16092 populate_metadata read hostname 'smithi035' 2023-03-17T09:13:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483ab43f0 0x565483ab67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb21e9a9b80 4 client.16092 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:13:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565483817f00 con 0x565483ab43f0 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483ab43f0 0x565483ab67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb20b7fe700 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483ab43f0 0x565483ab67d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62697512e965fc09 server_cookie=edc0c3ebddfe2c3b in_seq=0 out_seq=0 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.379+0000 7fb1eb7fe700 10 client.16092 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb1eb7fe700 1 -- 172.21.15.35:0/2468758548 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565483817f00 con 0x565483ab43f0 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb1eb7fe700 10 client.16092 handle_command_reply: tid=0 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 client.16092 shutdown 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 msgr2=0x565483a53d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 0x565483a53d20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0983e0 tx=0x7fb1fc0a0740 comp rx=0 tx=0).stop 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 shutdown_connections 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565483ab43f0 0x565483ab67d0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565483a496a0 0x565483a50570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb1eb7fe700 0 client.16092 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:13:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565483a43b70 0x565483a53d20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 --2- 172.21.15.35:0/2468758548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565483a48d90 0x565483a50030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 >> 172.21.15.35:0/2468758548 conn(0x56548389e6b0 msgr2=0x565483a46860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 shutdown_connections 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 1 -- 172.21.15.35:0/2468758548 wait complete. 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.386+0000 7fb21e9a9b80 20 client.16092 trim_cache size 0 max 16384 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb1f409f640 msgr2=0x7fb1f40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb1f409f640 0x7fb1f40a1af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb20c196880 tx=0x7fb200005d80 comp rx=0 tx=0).stop 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 msgr2=0x7fb20c195270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 0x7fb20c195270 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00d950 tx=0x7fb1fc00dd10 comp rx=0 tx=0).stop 2023-03-17T09:13:46.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 shutdown_connections 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb1f409f640 0x7fb1f40a1af0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb20c104390 0x7fb20c199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb20c0ff350 0x7fb20c195270 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 --2- 172.21.15.35:0/2531881003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20c0ffcf0 0x7fb20c1957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 >> 172.21.15.35:0/2531881003 conn(0x7fb20c076330 msgr2=0x7fb20c102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 shutdown_connections 2023-03-17T09:13:46.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:16.387+0000 7fb21281c700 1 -- 172.21.15.35:0/2531881003 wait complete. 2023-03-17T09:13:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 -- 172.21.15.35:0/3132319528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd400ffd30 msgr2=0x7fcd40103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3132319528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd400ffd30 0x7fcd40103cf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0099c0 tx=0x7fcd3c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:13:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 -- 172.21.15.35:0/3132319528 shutdown_connections 2023-03-17T09:13:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3132319528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd401043d0 0x7fcd4010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3132319528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd400ff390 0x7fcd400ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3132319528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd400ffd30 0x7fcd40103cf0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 -- 172.21.15.35:0/3132319528 >> 172.21.15.35:0/3132319528 conn(0x7fcd40075f30 msgr2=0x7fcd40076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 -- 172.21.15.35:0/3132319528 shutdown_connections 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.508+0000 7fcd485ee700 1 -- 172.21.15.35:0/3132319528 wait complete. 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 Processor -- start 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 -- start start 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd400ff390 0x7fcd40100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd400ffd30 0x7fcd401012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 0x7fcd401a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40101b00 con 0x7fcd401043d0 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401a4a40 con 0x7fcd400ffd30 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd485ee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401a4b80 con 0x7fcd400ff390 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd46b8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 0x7fcd401a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd46b8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 0x7fcd401a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44004/0 (socket says 172.21.15.35:44004) 2023-03-17T09:13:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.509+0000 7fcd46b8b700 1 -- 172.21.15.35:0/3422573308 learned_addr learned my addr 172.21.15.35:0/3422573308 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:48.192 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:26 smithi035 ceph-mon[92535]: pgmap v574: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:13:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd45b89700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd400ffd30 0x7fcd401012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd4638a700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd400ff390 0x7fcd40100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd46b8b700 1 -- 172.21.15.35:0/3422573308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd400ff390 msgr2=0x7fcd40100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd400ff390 0x7fcd40100d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd46b8b700 1 -- 172.21.15.35:0/3422573308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd400ffd30 msgr2=0x7fcd401012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:13:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd400ffd30 0x7fcd401012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd46b8b700 1 -- 172.21.15.35:0/3422573308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0095f0 con 0x7fcd401043d0 2023-03-17T09:13:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd4638a700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd400ff390 0x7fcd40100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:13:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 0x7fcd401a4500 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcd38007ee0 tx=0x7fcd3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:50.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd337fe700 1 -- 172.21.15.35:0/3422573308 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800ddd0 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4010f000 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd337fe700 1 -- 172.21.15.35:0/3422573308 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd3800f040 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd337fe700 1 -- 172.21.15.35:0/3422573308 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380047d0 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.510+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4010ee70 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.513+0000 7fcd337fe700 1 -- 172.21.15.35:0/3422573308 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcd38003a00 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.513+0000 7fcd337fe700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd2c09f640 0x7fcd2c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.514+0000 7fcd4638a700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd2c09f640 0x7fcd2c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.514+0000 7fcd337fe700 1 -- 172.21.15.35:0/3422573308 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd380c9ee0 con 0x7fcd401043d0 2023-03-17T09:13:50.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.514+0000 7fcd4638a700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd2c09f640 0x7fcd2c0a1af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd34005950 tx=0x7fcd340058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.514+0000 7fcd5477bb80 1 Processor -- start 2023-03-17T09:13:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 -- start start 2023-03-17T09:13:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d3bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d36420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d36d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:13:50.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1c3d010 con 0x556da1d36960 2023-03-17T09:13:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1c8f950 con 0x556da1d3c4f0 2023-03-17T09:13:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1c88de0 con 0x556da1d3bbe0 2023-03-17T09:13:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d36d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d36d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44012/0 (socket says 172.21.15.35:44012) 2023-03-17T09:13:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd45b89700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d36420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 -- 172.21.15.35:0/4028936074 learned_addr learned my addr 172.21.15.35:0/4028936074 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:13:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd4638a700 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d3bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:13:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 -- 172.21.15.35:0/4028936074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 msgr2=0x556da1d3bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d3bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 -- 172.21.15.35:0/4028936074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 msgr2=0x556da1d36420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:13:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d36420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:13:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.515+0000 7fcd46b8b700 1 -- 172.21.15.35:0/4028936074 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556da1b0a5d0 con 0x556da1d36960 2023-03-17T09:13:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.516+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d36d90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd38093e90 tx=0x7fcd38093da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d10a7f1cccaec6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:13:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.516+0000 7fcd30ff9700 1 -- 172.21.15.35:0/4028936074 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38004000 con 0x556da1d36960 2023-03-17T09:13:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.516+0000 7fcd30ff9700 1 -- 172.21.15.35:0/4028936074 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd38097990 con 0x556da1d36960 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.516+0000 7fcd30ff9700 1 -- 172.21.15.35:0/4028936074 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38095dc0 con 0x556da1d36960 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.516+0000 7fcd5477bb80 1 -- 172.21.15.35:0/4028936074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 msgr2=0x556da1d36d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.516+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d36d90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd38093e90 tx=0x7fcd38093da0 comp rx=0 tx=0).stop 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- 172.21.15.35:0/4028936074 shutdown_connections 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d36d90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d3bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/4028936074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d36420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- 172.21.15.35:0/4028936074 >> 172.21.15.35:0/4028936074 conn(0x556da1b936b0 msgr2=0x556da1d30a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- 172.21.15.35:0/4028936074 shutdown_connections 2023-03-17T09:14:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- 172.21.15.35:0/4028936074 wait complete. 2023-03-17T09:14:00.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- start start 2023-03-17T09:14:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 Processor -- start 2023-03-17T09:14:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d36960 0x556da1d42470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 0x556da1d3f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d3fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1b0c8c0 con 0x556da1d3bbe0 2023-03-17T09:14:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d404b0 con 0x556da1d3c4f0 2023-03-17T09:14:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d4c000 con 0x556da1d36960 2023-03-17T09:14:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd5477bb80 10 client.0 _ll_register_callbacks cb 0x556da1b2e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:14:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd45b89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 0x556da1d3f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.517+0000 7fcd45b89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 0x556da1d3f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44016/0 (socket says 172.21.15.35:44016) 2023-03-17T09:14:04.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 -- 172.21.15.35:0/356160193 learned_addr learned my addr 172.21.15.35:0/356160193 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d3fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd4638a700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d36960 0x556da1d42470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 -- 172.21.15.35:0/356160193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d36960 msgr2=0x556da1d42470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d36960 0x556da1d42470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 -- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 msgr2=0x556da1d3fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d3fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 -- 172.21.15.35:0/356160193 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4010ee70 con 0x556da1d3bbe0 2023-03-17T09:14:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd45b89700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 0x556da1d3f6f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcd40100100 tx=0x7fcd3c005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea4d39653ece6be server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:14:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd29ffb700 1 -- 172.21.15.35:0/356160193 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c01d030 con 0x556da1d3bbe0 2023-03-17T09:14:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd29ffb700 1 -- 172.21.15.35:0/356160193 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd3c00bca0 con 0x556da1d3bbe0 2023-03-17T09:14:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da1c4b390 con 0x556da1d3bbe0 2023-03-17T09:14:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd29ffb700 1 -- 172.21.15.35:0/356160193 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd3c00be60 con 0x556da1d3bbe0 2023-03-17T09:14:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd5477bb80 10 client.16104 fetch_fsmap learned FSMap version 29 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.518+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556da1ab6d80 con 0x556da1d3bbe0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd29ffb700 1 -- 172.21.15.35:0/356160193 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556da1c4b390 con 0x556da1d3bbe0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd29ffb700 1 -- 172.21.15.35:0/356160193 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcd3c003820 con 0x556da1d3bbe0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd5477bb80 10 client.16104 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd5477bb80 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd5477bb80 20 client.16104 populate_metadata read hostname 'smithi035' 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1d500f0 0x556da1d52500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd5477bb80 4 client.16104 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556da1c57600 con 0x556da1d500f0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.519+0000 7fcd4638a700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1d500f0 0x556da1d52500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd29ffb700 10 client.16104 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd4638a700 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1d500f0 0x556da1d52500 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7d6c77c8c2e2fd8 server_cookie=215497516be2d5e6 in_seq=0 out_seq=0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd29ffb700 1 -- 172.21.15.35:0/356160193 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556da1c57600 con 0x556da1d500f0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd29ffb700 10 client.16104 handle_command_reply: tid=0 2023-03-17T09:14:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 client.16104 shutdown 2023-03-17T09:14:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 msgr2=0x556da1d3f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 0x556da1d3f6f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcd40100100 tx=0x7fcd3c005ec0 comp rx=0 tx=0).stop 2023-03-17T09:14:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 shutdown_connections 2023-03-17T09:14:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1d500f0 0x556da1d52500 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3c4f0 0x556da1d3fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d36960 0x556da1d42470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/356160193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3bbe0 0x556da1d3f6f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd29ffb700 0 client.16104 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 >> 172.21.15.35:0/356160193 conn(0x556da1b936b0 msgr2=0x556da1d35410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 shutdown_connections 2023-03-17T09:14:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.520+0000 7fcd5477bb80 1 -- 172.21.15.35:0/356160193 wait complete. 2023-03-17T09:14:08.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.521+0000 7fcd5477bb80 20 client.16104 trim_cache size 0 max 16384 2023-03-17T09:14:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.535+0000 7fcd5477bb80 1 Processor -- start 2023-03-17T09:14:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.535+0000 7fcd5477bb80 1 -- start start 2023-03-17T09:14:08.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d36960 0x556da1d46f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d42010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 0x556da1d396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d2c0f0 con 0x556da1d3c4f0 2023-03-17T09:14:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d367c0 con 0x556da1d36960 2023-03-17T09:14:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d42c30 con 0x556da1d3bbe0 2023-03-17T09:14:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 0x556da1d396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 0x556da1d396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44026/0 (socket says 172.21.15.35:44026) 2023-03-17T09:14:10.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 -- 172.21.15.35:0/1779742109 learned_addr learned my addr 172.21.15.35:0/1779742109 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd45b89700 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d42010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd4638a700 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d36960 0x556da1d46f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 -- 172.21.15.35:0/1779742109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 msgr2=0x556da1d42010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d42010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 -- 172.21.15.35:0/1779742109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d36960 msgr2=0x556da1d46f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d36960 0x556da1d46f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 -- 172.21.15.35:0/1779742109 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556da1c4f130 con 0x556da1d3c4f0 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd4638a700 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d36960 0x556da1d46f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 0x556da1d396b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcd38097920 tx=0x7fcd38007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84269fe4f6feba4b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd317fa700 1 -- 172.21.15.35:0/1779742109 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38004000 con 0x556da1d3c4f0 2023-03-17T09:14:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd317fa700 1 -- 172.21.15.35:0/1779742109 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd3809fb80 con 0x556da1d3c4f0 2023-03-17T09:14:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.536+0000 7fcd317fa700 1 -- 172.21.15.35:0/1779742109 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38003d90 con 0x556da1d3c4f0 2023-03-17T09:14:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1779742109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 msgr2=0x556da1d396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 0x556da1d396b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcd38097920 tx=0x7fcd38007e60 comp rx=0 tx=0).stop 2023-03-17T09:14:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1779742109 shutdown_connections 2023-03-17T09:14:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d3c4f0 0x556da1d396b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d36960 0x556da1d46f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1779742109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3bbe0 0x556da1d42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1779742109 >> 172.21.15.35:0/1779742109 conn(0x556da1b936b0 msgr2=0x556da1d35a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1779742109 shutdown_connections 2023-03-17T09:14:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1779742109 wait complete. 2023-03-17T09:14:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 -- start start 2023-03-17T09:14:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.537+0000 7fcd5477bb80 1 Processor -- start 2023-03-17T09:14:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d46c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3bbe0 0x556da1d47160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3c4f0 0x556da1d45110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d457e0 con 0x556da1d36960 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d45950 con 0x556da1d3bbe0 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556da1d45b10 con 0x556da1d3c4f0 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd5477bb80 10 client.0 _ll_register_callbacks cb 0x556da1b2e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d46c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d46c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44028/0 (socket says 172.21.15.35:44028) 2023-03-17T09:14:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 -- 172.21.15.35:0/1872914469 learned_addr learned my addr 172.21.15.35:0/1872914469 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd45b89700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3bbe0 0x556da1d47160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd46b8b700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3c4f0 0x556da1d45110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 -- 172.21.15.35:0/1872914469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3c4f0 msgr2=0x556da1d45110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3c4f0 0x556da1d45110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 -- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3bbe0 msgr2=0x556da1d47160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3bbe0 0x556da1d47160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 -- 172.21.15.35:0/1872914469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556da1b0a5d0 con 0x556da1d36960 2023-03-17T09:14:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd45b89700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3bbe0 0x556da1d47160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:14:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd4638a700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d46c20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b5d0 tx=0x7fcd340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a100d2de76274082 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.538+0000 7fcd29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:14:15.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:28 smithi035 ceph-mon[92535]: pgmap v575: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:16.459 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:30 smithi035 ceph-mon[92535]: pgmap v576: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:32 smithi035 ceph-mon[92535]: pgmap v577: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:34 smithi035 ceph-mon[92535]: pgmap v578: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:36 smithi035 ceph-mon[92535]: pgmap v579: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:38 smithi035 ceph-mon[92535]: pgmap v580: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:40 smithi035 ceph-mon[92535]: pgmap v581: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:42 smithi035 ceph-mon[92535]: pgmap v582: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:44 smithi035 ceph-mon[92535]: pgmap v583: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:46 smithi035 ceph-mon[92535]: pgmap v584: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:48 smithi035 ceph-mon[92535]: pgmap v585: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:50 smithi035 ceph-mon[92535]: pgmap v586: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:52 smithi035 ceph-mon[92535]: pgmap v587: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:54 smithi035 ceph-mon[92535]: pgmap v588: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:16.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:56 smithi035 ceph-mon[92535]: pgmap v589: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:04:58 smithi035 ceph-mon[92535]: pgmap v590: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:16.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:00 smithi035 ceph-mon[92535]: pgmap v591: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:02 smithi035 ceph-mon[92535]: pgmap v592: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:16.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:04 smithi035 ceph-mon[92535]: pgmap v593: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T09:14:17.261 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:06 smithi035 ceph-mon[92535]: pgmap v594: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T09:14:17.261 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:08 smithi035 ceph-mon[92535]: pgmap v595: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T09:14:17.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:10 smithi035 ceph-mon[92535]: pgmap v596: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-03-17T09:14:17.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:12 smithi035 ceph-mon[92535]: pgmap v597: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2023-03-17T09:14:17.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:14 smithi035 ceph-mon[92535]: pgmap v598: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-03-17T09:14:17.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:15 smithi035 ceph-mon[92535]: daemon mds.e restarted 2023-03-17T09:14:17.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:15 smithi035 ceph-mon[92535]: osdmap e112: 12 total, 12 up, 12 in 2023-03-17T09:14:18.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6834/545594421,v1:172.21.15.78:6835/545594421] up:boot 2023-03-17T09:14:18.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:16 smithi035 ceph-mon[92535]: pgmap v600: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 307 B/s wr, 8 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:18 smithi035 ceph-mon[92535]: pgmap v601: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:20 smithi035 ceph-mon[92535]: pgmap v602: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:22 smithi035 ceph-mon[92535]: pgmap v603: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 9 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:24 smithi035 ceph-mon[92535]: pgmap v604: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:26 smithi035 ceph-mon[92535]: pgmap v605: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 293 B/s wr, 10 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:28 smithi035 ceph-mon[92535]: pgmap v606: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:30 smithi035 ceph-mon[92535]: pgmap v607: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:14:18.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:32 smithi035 ceph-mon[92535]: pgmap v608: 97 pgs: 97 active+clean; 1.4 MiB data, 135 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:34 smithi035 ceph-mon[92535]: pgmap v609: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:36 smithi035 ceph-mon[92535]: pgmap v610: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:38 smithi035 ceph-mon[92535]: pgmap v611: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:40 smithi035 ceph-mon[92535]: pgmap v612: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:42 smithi035 ceph-mon[92535]: pgmap v613: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:44 smithi035 ceph-mon[92535]: pgmap v614: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:14:22.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:14:22.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:46 smithi035 ceph-mon[92535]: pgmap v615: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:48 smithi035 ceph-mon[92535]: pgmap v616: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:50 smithi035 ceph-mon[92535]: pgmap v617: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:52 smithi035 ceph-mon[92535]: pgmap v618: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:54 smithi035 ceph-mon[92535]: pgmap v619: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:56 smithi035 ceph-mon[92535]: pgmap v620: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:05:58 smithi035 ceph-mon[92535]: pgmap v621: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:14:24.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:00 smithi035 ceph-mon[92535]: pgmap v622: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:02 smithi035 ceph-mon[92535]: pgmap v623: 97 pgs: 97 active+clean; 1.4 MiB data, 136 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:04 smithi035 ceph-mon[92535]: pgmap v624: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:06 smithi035 ceph-mon[92535]: pgmap v625: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:08 smithi035 ceph-mon[92535]: pgmap v626: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:09 smithi035 ceph-mon[92535]: osdmap e113: 12 total, 12 up, 12 in 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:10 smithi035 ceph-mon[92535]: pgmap v628: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:12 smithi035 ceph-mon[92535]: pgmap v629: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:14:24.953 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:14 smithi035 ceph-mon[92535]: pgmap v630: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:14:25.939 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:16 smithi035 ceph-mon[92535]: osdmap e114: 12 total, 12 up, 12 in 2023-03-17T09:14:25.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:16 smithi035 ceph-mon[92535]: pgmap v632: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:14:25.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:18 smithi035 ceph-mon[92535]: pgmap v633: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:14:25.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:20 smithi035 ceph-mon[92535]: pgmap v634: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:14:25.940 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:22 smithi035 ceph-mon[92535]: pgmap v635: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:14:29.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:24 smithi035 ceph-mon[92535]: pgmap v636: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:14:29.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:26 smithi035 ceph-mon[92535]: pgmap v637: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:14:31.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:14:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd29ffb700 1 -- 172.21.15.35:0/1872914469 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34017040 con 0x556da1d36960 2023-03-17T09:14:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd29ffb700 1 -- 172.21.15.35:0/1872914469 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd34004230 con 0x556da1d36960 2023-03-17T09:14:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556da1d061e0 con 0x556da1d36960 2023-03-17T09:14:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd29ffb700 1 -- 172.21.15.35:0/1872914469 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd340043f0 con 0x556da1d36960 2023-03-17T09:14:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 10 client.16110 fetch_fsmap learned FSMap version 29 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556da1add1f0 con 0x556da1d36960 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd29ffb700 1 -- 172.21.15.35:0/1872914469 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556da1d061e0 con 0x556da1d36960 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd29ffb700 1 -- 172.21.15.35:0/1872914469 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcd34003820 con 0x556da1d36960 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 10 client.16110 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 20 client.16110 populate_metadata read hostname 'smithi035' 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1da5240 0x556da1da7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 4 client.16110 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:14:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.539+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556da1b0cf00 con 0x556da1da5240 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.540+0000 7fcd45b89700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1da5240 0x556da1da7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.540+0000 7fcd29ffb700 10 client.16110 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.540+0000 7fcd45b89700 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1da5240 0x556da1da7650 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3606bfa51206961 server_cookie=db2ca1eb31c5c1e2 in_seq=0 out_seq=0 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd29ffb700 1 -- 172.21.15.35:0/1872914469 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556da1b0cf00 con 0x556da1da5240 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd29ffb700 10 client.16110 handle_command_reply: tid=0 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 client.16110 shutdown 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 msgr2=0x556da1d46c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d46c20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b5d0 tx=0x7fcd340047c0 comp rx=0 tx=0).stop 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 shutdown_connections 2023-03-17T09:14:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556da1da5240 0x556da1da7650 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556da1d3c4f0 0x556da1d45110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556da1d36960 0x556da1d46c20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:35.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd29ffb700 0 client.16110 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 --2- 172.21.15.35:0/1872914469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556da1d3bbe0 0x556da1d47160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 >> 172.21.15.35:0/1872914469 conn(0x556da1b936b0 msgr2=0x556da1d396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 shutdown_connections 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.544+0000 7fcd5477bb80 1 -- 172.21.15.35:0/1872914469 wait complete. 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd5477bb80 20 client.16110 trim_cache size 0 max 16384 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd2c09f640 msgr2=0x7fcd2c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd2c09f640 0x7fcd2c0a1af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd34005950 tx=0x7fcd340058e0 comp rx=0 tx=0).stop 2023-03-17T09:14:35.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 msgr2=0x7fcd401a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 0x7fcd401a4500 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcd38007ee0 tx=0x7fcd3800d3b0 comp rx=0 tx=0).stop 2023-03-17T09:14:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 shutdown_connections 2023-03-17T09:14:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd2c09f640 0x7fcd2c0a1af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd401043d0 0x7fcd401a4500 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd400ff390 0x7fcd40100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 --2- 172.21.15.35:0/3422573308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd400ffd30 0x7fcd401012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 >> 172.21.15.35:0/3422573308 conn(0x7fcd40075f30 msgr2=0x7fcd40068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 shutdown_connections 2023-03-17T09:14:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:29.545+0000 7fcd485ee700 1 -- 172.21.15.35:0/3422573308 wait complete. 2023-03-17T09:14:37.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 -- 172.21.15.35:0/3894630411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf40ff350 msgr2=0x7fdbf40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/3894630411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf40ff350 0x7fdbf40ff720 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40099c0 tx=0x7fdbe4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 -- 172.21.15.35:0/3894630411 shutdown_connections 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/3894630411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbf4104390 0x7fdbf410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/3894630411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf40ff350 0x7fdbf40ff720 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/3894630411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 0x7fdbf4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 -- 172.21.15.35:0/3894630411 >> 172.21.15.35:0/3894630411 conn(0x7fdbf4076330 msgr2=0x7fdbf4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 -- 172.21.15.35:0/3894630411 shutdown_connections 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 -- 172.21.15.35:0/3894630411 wait complete. 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 Processor -- start 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.668+0000 7fdbfa55f700 1 -- start start 2023-03-17T09:14:37.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbfa55f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbf40ff350 0x7fdbf4197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbfa55f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 0x7fdbf41975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbfa55f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 0x7fdbf41a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbfa55f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41a2630 con 0x7fdbf4104390 2023-03-17T09:14:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbfa55f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41a2770 con 0x7fdbf40ffcf0 2023-03-17T09:14:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbfa55f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41a28b0 con 0x7fdbf40ff350 2023-03-17T09:14:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 0x7fdbf41a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 0x7fdbf41a20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44046/0 (socket says 172.21.15.35:44046) 2023-03-17T09:14:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 -- 172.21.15.35:0/1099100159 learned_addr learned my addr 172.21.15.35:0/1099100159 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 0x7fdbf41975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbf40ff350 0x7fdbf4197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 -- 172.21.15.35:0/1099100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbf40ff350 msgr2=0x7fdbf4197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbf40ff350 0x7fdbf4197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 -- 172.21.15.35:0/1099100159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 msgr2=0x7fdbf41975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 0x7fdbf41975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf8afc700 1 -- 172.21.15.35:0/1099100159 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40095f0 con 0x7fdbf4104390 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.669+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 0x7fdbf41975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.670+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 0x7fdbf41a20f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00ef30 tx=0x7fdbec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.670+0000 7fdbf17fa700 1 -- 172.21.15.35:0/1099100159 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec018070 con 0x7fdbf4104390 2023-03-17T09:14:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.670+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf410f000 con 0x7fdbf4104390 2023-03-17T09:14:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.670+0000 7fdbf17fa700 1 -- 172.21.15.35:0/1099100159 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbec00f040 con 0x7fdbf4104390 2023-03-17T09:14:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.670+0000 7fdbf17fa700 1 -- 172.21.15.35:0/1099100159 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00cc70 con 0x7fdbf4104390 2023-03-17T09:14:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.670+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf410ee70 con 0x7fdbf4104390 2023-03-17T09:14:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.673+0000 7fdbf17fa700 1 -- 172.21.15.35:0/1099100159 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdbec007500 con 0x7fdbf4104390 2023-03-17T09:14:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.673+0000 7fdbf17fa700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdbdc09f640 0x7fdbdc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.673+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdbdc09f640 0x7fdbdc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.673+0000 7fdbf17fa700 1 -- 172.21.15.35:0/1099100159 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdbec0ca0c0 con 0x7fdbf4104390 2023-03-17T09:14:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 Processor -- start 2023-03-17T09:14:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 -- start start 2023-03-17T09:14:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdbdc09f640 0x7fdbdc0a1af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400b580 tx=0x7fdbe401a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff368410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff362830 0x5653ff362ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff265010 con 0x5653ff368040 2023-03-17T09:14:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff2b7950 con 0x5653ff362830 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff2b0de0 con 0x5653ff3631e0 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff368410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff368410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44050/0 (socket says 172.21.15.35:44050) 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 -- 172.21.15.35:0/3333494829 learned_addr learned my addr 172.21.15.35:0/3333494829 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff362830 0x5653ff362ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 -- 172.21.15.35:0/3333494829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 msgr2=0x5653ff36edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 -- 172.21.15.35:0/3333494829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff362830 msgr2=0x5653ff362ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff362830 0x5653ff362ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.674+0000 7fdbf3fff700 1 -- 172.21.15.35:0/3333494829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653ff1325d0 con 0x5653ff368040 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.675+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff368410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400ba10 tx=0x7fdbe401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1622b049a63cea1a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.675+0000 7fdbda7fc700 1 -- 172.21.15.35:0/3333494829 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe401d040 con 0x5653ff368040 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.675+0000 7fdbda7fc700 1 -- 172.21.15.35:0/3333494829 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbe4029040 con 0x5653ff368040 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.675+0000 7fdbda7fc700 1 -- 172.21.15.35:0/3333494829 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4023bc0 con 0x5653ff368040 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3333494829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 msgr2=0x5653ff368410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff368410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400ba10 tx=0x7fdbe401e000 comp rx=0 tx=0).stop 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3333494829 shutdown_connections 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff368410 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3333494829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff362830 0x5653ff362ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3333494829 >> 172.21.15.35:0/3333494829 conn(0x5653ff1bb6b0 msgr2=0x5653ff358a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3333494829 shutdown_connections 2023-03-17T09:14:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3333494829 wait complete. 2023-03-17T09:14:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 -- start start 2023-03-17T09:14:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.676+0000 7fdc066ecb80 1 Processor -- start 2023-03-17T09:14:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 0x5653ff36ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff1348c0 con 0x5653ff362830 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff36cc60 con 0x5653ff368040 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff378480 con 0x5653ff3631e0 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdc066ecb80 10 client.0 _ll_register_callbacks cb 0x5653ff156230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 0x5653ff36ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 0x5653ff36ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44056/0 (socket says 172.21.15.35:44056) 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 -- 172.21.15.35:0/27455456 learned_addr learned my addr 172.21.15.35:0/27455456 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 -- 172.21.15.35:0/27455456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 msgr2=0x5653ff36bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 -- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 msgr2=0x5653ff36c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.677+0000 7fdbf3fff700 1 -- 172.21.15.35:0/27455456 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf410c7a0 con 0x5653ff362830 2023-03-17T09:14:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 0x5653ff36ec80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400fb50 tx=0x7fdbe400fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd48cb5037186a3e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:14:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbd37fe700 1 -- 172.21.15.35:0/27455456 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4038870 con 0x5653ff362830 2023-03-17T09:14:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbd37fe700 1 -- 172.21.15.35:0/27455456 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdbe4023410 con 0x5653ff362830 2023-03-17T09:14:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653ff273390 con 0x5653ff362830 2023-03-17T09:14:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbd37fe700 1 -- 172.21.15.35:0/27455456 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbe4005980 con 0x5653ff362830 2023-03-17T09:14:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 10 client.16122 fetch_fsmap learned FSMap version 29 2023-03-17T09:14:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5653ff0ded80 con 0x5653ff362830 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbd37fe700 1 -- 172.21.15.35:0/27455456 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbe4046020 con 0x5653ff362830 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdbd37fe700 1 -- 172.21.15.35:0/27455456 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdbe402c070 con 0x5653ff362830 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 10 client.16122 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 20 client.16122 populate_metadata read hostname 'smithi035' 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff37c110 0x5653ff37e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 4 client.16122 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.678+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653ff27f600 con 0x5653ff37c110 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.679+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff37c110 0x5653ff37e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.679+0000 7fdbd37fe700 10 client.16122 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.679+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff37c110 0x5653ff37e520 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=707981b2307f4f11 server_cookie=ca3a7ef163e1a63c in_seq=0 out_seq=0 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdbd37fe700 1 -- 172.21.15.35:0/27455456 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5653ff27f600 con 0x5653ff37c110 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdbd37fe700 10 client.16122 handle_command_reply: tid=0 2023-03-17T09:14:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 client.16122 shutdown 2023-03-17T09:14:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 msgr2=0x5653ff36ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 0x5653ff36ec80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400fb50 tx=0x7fdbe400fb80 comp rx=0 tx=0).stop 2023-03-17T09:14:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 shutdown_connections 2023-03-17T09:14:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff37c110 0x5653ff37e520 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:50.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdbd37fe700 0 client.16122 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff362830 0x5653ff36ec80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/27455456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff3631e0 0x5653ff36bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:52.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:28 smithi035 ceph-mon[92535]: pgmap v638: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:14:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 >> 172.21.15.35:0/27455456 conn(0x5653ff1bb6b0 msgr2=0x5653ff35d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 shutdown_connections 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 1 -- 172.21.15.35:0/27455456 wait complete. 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.680+0000 7fdc066ecb80 20 client.16122 trim_cache size 0 max 16384 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.695+0000 7fdc066ecb80 1 Processor -- start 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.695+0000 7fdc066ecb80 1 -- start start 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.695+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff367710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.695+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 0x5653ff3733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.695+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.695+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff3596e0 con 0x5653ff3631e0 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff367cc0 con 0x5653ff368040 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff3540d0 con 0x5653ff362830 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 0x5653ff3733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 0x5653ff3733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44066/0 (socket says 172.21.15.35:44066) 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 -- 172.21.15.35:0/1833999080 learned_addr learned my addr 172.21.15.35:0/1833999080 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff367710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 -- 172.21.15.35:0/1833999080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 msgr2=0x5653ff367710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff367710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 -- 172.21.15.35:0/1833999080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 msgr2=0x5653ff36e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 -- 172.21.15.35:0/1833999080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653ff277130 con 0x5653ff3631e0 2023-03-17T09:14:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 0x5653ff3733d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x5653ff35af90 tx=0x7fdbe8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ef6ee3c8f6169a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbdaffd700 1 -- 172.21.15.35:0/1833999080 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8017030 con 0x5653ff3631e0 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbdaffd700 1 -- 172.21.15.35:0/1833999080 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbe8018040 con 0x5653ff3631e0 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.696+0000 7fdbdaffd700 1 -- 172.21.15.35:0/1833999080 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8004050 con 0x5653ff3631e0 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 -- 172.21.15.35:0/1833999080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 msgr2=0x5653ff3733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 0x5653ff3733d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x5653ff35af90 tx=0x7fdbe8009260 comp rx=0 tx=0).stop 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 -- 172.21.15.35:0/1833999080 shutdown_connections 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff368040 0x5653ff36e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff367710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/1833999080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff3631e0 0x5653ff3733d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 -- 172.21.15.35:0/1833999080 >> 172.21.15.35:0/1833999080 conn(0x5653ff1bb6b0 msgr2=0x5653ff367000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 -- 172.21.15.35:0/1833999080 shutdown_connections 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 -- 172.21.15.35:0/1833999080 wait complete. 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.697+0000 7fdc066ecb80 1 -- start start 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 Processor -- start 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff3c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff3631e0 0x5653ff3c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff3cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff3cf4c0 con 0x5653ff368040 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff3cf600 con 0x5653ff3631e0 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ff3cf7c0 con 0x5653ff362830 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdc066ecb80 10 client.0 _ll_register_callbacks cb 0x5653ff156230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff3cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff3cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44074/0 (socket says 172.21.15.35:44074) 2023-03-17T09:14:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 -- 172.21.15.35:0/3134375367 learned_addr learned my addr 172.21.15.35:0/3134375367 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff3c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf37fe700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff3631e0 0x5653ff3c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 -- 172.21.15.35:0/3134375367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 msgr2=0x5653ff3c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff3c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 -- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff3631e0 msgr2=0x5653ff3c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:14:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff3631e0 0x5653ff3c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.698+0000 7fdbf8afc700 1 -- 172.21.15.35:0/3134375367 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe8012170 con 0x5653ff368040 2023-03-17T09:14:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbf8afc700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff3cef80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00ef00 tx=0x7fdbec097860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82959e3a4f71620 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:14:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbd37fe700 1 -- 172.21.15.35:0/3134375367 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec097390 con 0x5653ff368040 2023-03-17T09:14:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbd37fe700 1 -- 172.21.15.35:0/3134375367 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdbec09fe00 con 0x5653ff368040 2023-03-17T09:14:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653ff32e1e0 con 0x5653ff368040 2023-03-17T09:14:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbd37fe700 1 -- 172.21.15.35:0/3134375367 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbec09f970 con 0x5653ff368040 2023-03-17T09:14:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 10 client.16128 fetch_fsmap learned FSMap version 29 2023-03-17T09:14:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5653ff1051f0 con 0x5653ff368040 2023-03-17T09:14:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbd37fe700 1 -- 172.21.15.35:0/3134375367 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653ff32e1e0 con 0x5653ff368040 2023-03-17T09:14:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdbd37fe700 1 -- 172.21.15.35:0/3134375367 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdbec093a90 con 0x5653ff368040 2023-03-17T09:14:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 10 client.16128 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 20 client.16128 populate_metadata read hostname 'smithi035' 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff3d0dd0 0x5653ff3d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 4 client.16128 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.699+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653ff134f00 con 0x5653ff3d0dd0 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.700+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff3d0dd0 0x5653ff3d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.700+0000 7fdbf3fff700 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff3d0dd0 0x5653ff3d31e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f0be5190faca75f server_cookie=3e6cce33b8fa845 in_seq=0 out_seq=0 2023-03-17T09:14:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.700+0000 7fdbd37fe700 10 client.16128 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdbd37fe700 1 -- 172.21.15.35:0/3134375367 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653ff134f00 con 0x5653ff3d0dd0 2023-03-17T09:14:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdbd37fe700 10 client.16128 handle_command_reply: tid=0 2023-03-17T09:14:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 client.16128 shutdown 2023-03-17T09:14:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 msgr2=0x5653ff3cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff3cef80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00ef00 tx=0x7fdbec097860 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 shutdown_connections 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653ff3d0dd0 0x5653ff3d31e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653ff368040 0x5653ff3cef80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653ff362830 0x5653ff3c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdbd37fe700 0 client.16128 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 --2- 172.21.15.35:0/3134375367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653ff3631e0 0x5653ff3c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 >> 172.21.15.35:0/3134375367 conn(0x5653ff1bb6b0 msgr2=0x5653ff35d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 shutdown_connections 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 1 -- 172.21.15.35:0/3134375367 wait complete. 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdc066ecb80 20 client.16128 trim_cache size 0 max 16384 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdbdc09f640 msgr2=0x7fdbdc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.704+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdbdc09f640 0x7fdbdc0a1af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400b580 tx=0x7fdbe401a040 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 msgr2=0x7fdbf41a20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 0x7fdbf41a20f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00ef30 tx=0x7fdbec00c3a0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 shutdown_connections 2023-03-17T09:14:58.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdbdc09f640 0x7fdbdc0a1af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbf4104390 0x7fdbf41a20f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbf40ff350 0x7fdbf4197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 --2- 172.21.15.35:0/1099100159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbf40ffcf0 0x7fdbf41975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 >> 172.21.15.35:0/1099100159 conn(0x7fdbf4076330 msgr2=0x7fdbf40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 shutdown_connections 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:42.705+0000 7fdbfa55f700 1 -- 172.21.15.35:0/1099100159 wait complete. 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 -- 172.21.15.35:0/1659295516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe9280ff350 msgr2=0x7fe9280ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 --2- 172.21.15.35:0/1659295516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe9280ff350 0x7fe9280ff720 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe9100099c0 tx=0x7fe910009cd0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 -- 172.21.15.35:0/1659295516 shutdown_connections 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 --2- 172.21.15.35:0/1659295516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe928104390 0x7fe92810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 --2- 172.21.15.35:0/1659295516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe9280ff350 0x7fe9280ff720 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 --2- 172.21.15.35:0/1659295516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9280ffcf0 0x7fe928103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 -- 172.21.15.35:0/1659295516 >> 172.21.15.35:0/1659295516 conn(0x7fe928076330 msgr2=0x7fe928076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 -- 172.21.15.35:0/1659295516 shutdown_connections 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.827+0000 7fe92cb96700 1 -- 172.21.15.35:0/1659295516 wait complete. 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.828+0000 7fe92cb96700 1 Processor -- start 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 -- start start 2023-03-17T09:14:58.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9280ff350 0x7fe9281950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9280ffcf0 0x7fe9281955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 0x7fe928199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92819a080 con 0x7fe928104390 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92819a1f0 con 0x7fe9280ffcf0 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92cb96700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92819a3b0 con 0x7fe9280ff350 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 0x7fe928199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 0x7fe928199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44088/0 (socket says 172.21.15.35:44088) 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 -- 172.21.15.35:0/3591226966 learned_addr learned my addr 172.21.15.35:0/3591226966 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe925d9b700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9280ffcf0 0x7fe9281955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe92659c700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9280ff350 0x7fe9281950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 -- 172.21.15.35:0/3591226966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9280ff350 msgr2=0x7fe9281950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9280ff350 0x7fe9281950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 -- 172.21.15.35:0/3591226966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9280ffcf0 msgr2=0x7fe9281955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9280ffcf0 0x7fe9281955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.829+0000 7fe926d9d700 1 -- 172.21.15.35:0/3591226966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9100095f0 con 0x7fe928104390 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.830+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 0x7fe928199a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe920007ee0 tx=0x7fe92000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.830+0000 7fe91f7fe700 1 -- 172.21.15.35:0/3591226966 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920017070 con 0x7fe928104390 2023-03-17T09:14:58.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.830+0000 7fe91f7fe700 1 -- 172.21.15.35:0/3591226966 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe92000f040 con 0x7fe928104390 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.830+0000 7fe91f7fe700 1 -- 172.21.15.35:0/3591226966 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920005710 con 0x7fe928104390 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.830+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92810f000 con 0x7fe928104390 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.830+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92810ee70 con 0x7fe928104390 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.832+0000 7fe91f7fe700 1 -- 172.21.15.35:0/3591226966 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe920005870 con 0x7fe928104390 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.833+0000 7fe91f7fe700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe91409f640 0x7fe9140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.833+0000 7fe91f7fe700 1 -- 172.21.15.35:0/3591226966 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe9200c9e00 con 0x7fe928104390 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.833+0000 7fe92659c700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe91409f640 0x7fe9140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:14:58.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.833+0000 7fe92659c700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe91409f640 0x7fe9140a1af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe910009fd0 tx=0x7fe910005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 Processor -- start 2023-03-17T09:15:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 -- start start 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020ec160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c01feb010 con 0x557c020e6b70 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c0203d950 con 0x557c020ec6a0 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe938d23b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c02036de0 con 0x557c020ebd90 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.834+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44096/0 (socket says 172.21.15.35:44096) 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 -- 172.21.15.35:0/3303109546 learned_addr learned my addr 172.21.15.35:0/3303109546 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe92659c700 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020ec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe925d9b700 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 -- 172.21.15.35:0/3303109546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 msgr2=0x557c020ec160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020ec160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 -- 172.21.15.35:0/3303109546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 msgr2=0x557c020e6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 -- 172.21.15.35:0/3303109546 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c01eb85d0 con 0x557c020e6b70 2023-03-17T09:15:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe925d9b700 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:15:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e6fc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe920097840 tx=0x7fe920097470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274469985bcff983 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe91cff9700 1 -- 172.21.15.35:0/3303109546 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200978b0 con 0x557c020e6b70 2023-03-17T09:15:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe91cff9700 1 -- 172.21.15.35:0/3303109546 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe92009faa0 con 0x557c020e6b70 2023-03-17T09:15:02.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.835+0000 7fe91cff9700 1 -- 172.21.15.35:0/3303109546 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920097d10 con 0x557c020e6b70 2023-03-17T09:15:02.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:30 smithi035 ceph-mon[92535]: pgmap v639: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 -- 172.21.15.35:0/3303109546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 msgr2=0x557c020e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e6fc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe920097840 tx=0x7fe920097470 comp rx=0 tx=0).stop 2023-03-17T09:15:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 -- 172.21.15.35:0/3303109546 shutdown_connections 2023-03-17T09:15:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e6fc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020ec160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3303109546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 -- 172.21.15.35:0/3303109546 >> 172.21.15.35:0/3303109546 conn(0x557c01f416b0 msgr2=0x557c020dea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 -- 172.21.15.35:0/3303109546 shutdown_connections 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 -- 172.21.15.35:0/3303109546 wait complete. 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.836+0000 7fe938d23b80 1 -- start start 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 Processor -- start 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020f2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 0x557c020ef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020effb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c01eba8c0 con 0x557c020ebd90 2023-03-17T09:15:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020f0720 con 0x557c020ec6a0 2023-03-17T09:15:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020fc1a0 con 0x557c020e6b70 2023-03-17T09:15:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe938d23b80 10 client.0 _ll_register_callbacks cb 0x557c01edc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:15:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 0x557c020ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 0x557c020ef930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44100/0 (socket says 172.21.15.35:44100) 2023-03-17T09:15:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 -- 172.21.15.35:0/3090575544 learned_addr learned my addr 172.21.15.35:0/3090575544 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:15:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe92659c700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe926d9d700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 -- 172.21.15.35:0/3090575544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 msgr2=0x557c020f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 -- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 msgr2=0x557c020effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.837+0000 7fe925d9b700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe925d9b700 1 -- 172.21.15.35:0/3090575544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92810ee70 con 0x557c020ebd90 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe925d9b700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 0x557c020ef930 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe9180117a0 tx=0x7fe918011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca8df3a933070d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe90dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe90dffb700 1 -- 172.21.15.35:0/3090575544 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918004220 con 0x557c020ebd90 2023-03-17T09:15:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe90dffb700 1 -- 172.21.15.35:0/3090575544 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe918004380 con 0x557c020ebd90 2023-03-17T09:15:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c01ff9390 con 0x557c020ebd90 2023-03-17T09:15:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe90dffb700 1 -- 172.21.15.35:0/3090575544 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe918004540 con 0x557c020ebd90 2023-03-17T09:15:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe938d23b80 10 client.16140 fetch_fsmap learned FSMap version 29 2023-03-17T09:15:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557c01e64d80 con 0x557c020ebd90 2023-03-17T09:15:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe90dffb700 1 -- 172.21.15.35:0/3090575544 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c01ff9390 con 0x557c020ebd90 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe90dffb700 1 -- 172.21.15.35:0/3090575544 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe918003ad0 con 0x557c020ebd90 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.838+0000 7fe938d23b80 10 client.16140 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe938d23b80 10 client.16140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe938d23b80 20 client.16140 populate_metadata read hostname 'smithi035' 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c021003b0 0x557c021027c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe938d23b80 4 client.16140 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:15:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c02005600 con 0x557c021003b0 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe92659c700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c021003b0 0x557c021027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe92659c700 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c021003b0 0x557c021027c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff5973c0965339e server_cookie=9f4a4ccd10c9cad7 in_seq=0 out_seq=0 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.839+0000 7fe90dffb700 10 client.16140 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe90dffb700 1 -- 172.21.15.35:0/3090575544 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557c02005600 con 0x557c021003b0 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe90dffb700 10 client.16140 handle_command_reply: tid=0 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 client.16140 shutdown 2023-03-17T09:15:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 msgr2=0x557c020ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 0x557c020ef930 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe9180117a0 tx=0x7fe918011ab0 comp rx=0 tx=0).stop 2023-03-17T09:15:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 shutdown_connections 2023-03-17T09:15:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c021003b0 0x557c021027c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe90dffb700 0 client.16140 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:15:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 --2- 172.21.15.35:0/3090575544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ebd90 0x557c020ef930 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 >> 172.21.15.35:0/3090575544 conn(0x557c01f416b0 msgr2=0x557c020dea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:14.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 shutdown_connections 2023-03-17T09:15:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.840+0000 7fe938d23b80 1 -- 172.21.15.35:0/3090575544 wait complete. 2023-03-17T09:15:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.841+0000 7fe938d23b80 20 client.16140 trim_cache size 0 max 16384 2023-03-17T09:15:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 Processor -- start 2023-03-17T09:15:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 -- start start 2023-03-17T09:15:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020deac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ebd90 0x557c020f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 0x557c020ef270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020df000 con 0x557c020ec6a0 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020da0d0 con 0x557c020ebd90 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe938d23b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020dbb60 con 0x557c020e6b70 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 0x557c020ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe926d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 0x557c020ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44110/0 (socket says 172.21.15.35:44110) 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.856+0000 7fe926d9d700 1 -- 172.21.15.35:0/2439878307 learned_addr learned my addr 172.21.15.35:0/2439878307 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:15:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe925d9b700 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ebd90 0x557c020f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe92659c700 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe926d9d700 1 -- 172.21.15.35:0/2439878307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 msgr2=0x557c020deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe926d9d700 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe926d9d700 1 -- 172.21.15.35:0/2439878307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ebd90 msgr2=0x557c020f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe926d9d700 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ebd90 0x557c020f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe926d9d700 1 -- 172.21.15.35:0/2439878307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c01ffd130 con 0x557c020ec6a0 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe925d9b700 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ebd90 0x557c020f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe926d9d700 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 0x557c020ef270 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe920009510 tx=0x7fe920004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8ddaf3420c5544 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe91d7fa700 1 -- 172.21.15.35:0/2439878307 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92009faa0 con 0x557c020ec6a0 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe91d7fa700 1 -- 172.21.15.35:0/2439878307 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9200978b0 con 0x557c020ec6a0 2023-03-17T09:15:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.857+0000 7fe91d7fa700 1 -- 172.21.15.35:0/2439878307 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920096da0 con 0x557c020ec6a0 2023-03-17T09:15:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 -- 172.21.15.35:0/2439878307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 msgr2=0x557c020ef270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 0x557c020ef270 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe920009510 tx=0x7fe920004ad0 comp rx=0 tx=0).stop 2023-03-17T09:15:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 -- 172.21.15.35:0/2439878307 shutdown_connections 2023-03-17T09:15:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020ec6a0 0x557c020ef270 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020e6b70 0x557c020deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2439878307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ebd90 0x557c020f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 -- 172.21.15.35:0/2439878307 >> 172.21.15.35:0/2439878307 conn(0x557c01f416b0 msgr2=0x557c020e9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 -- 172.21.15.35:0/2439878307 shutdown_connections 2023-03-17T09:15:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 -- 172.21.15.35:0/2439878307 wait complete. 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 -- start start 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.858+0000 7fe938d23b80 1 Processor -- start 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020e7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020e9530 con 0x557c020e6b70 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020e96a0 con 0x557c020ec6a0 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c020e82d0 con 0x557c020ebd90 2023-03-17T09:15:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe938d23b80 10 client.0 _ll_register_callbacks cb 0x557c01edc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:15:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44112/0 (socket says 172.21.15.35:44112) 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 -- 172.21.15.35:0/2598763017 learned_addr learned my addr 172.21.15.35:0/2598763017 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe926d9d700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe925d9b700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 -- 172.21.15.35:0/2598763017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 msgr2=0x557c020e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020e7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 -- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 msgr2=0x557c020e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 -- 172.21.15.35:0/2598763017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c01eb85d0 con 0x557c020e6b70 2023-03-17T09:15:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe925d9b700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:15:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe92659c700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e8df0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098e0 tx=0x7fe910009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf84eae060b1ce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:25.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.859+0000 7fe90dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:15:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe90dffb700 1 -- 172.21.15.35:0/2598763017 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000bee0 con 0x557c020e6b70 2023-03-17T09:15:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe90dffb700 1 -- 172.21.15.35:0/2598763017 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe910034a40 con 0x557c020e6b70 2023-03-17T09:15:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c020b41e0 con 0x557c020e6b70 2023-03-17T09:15:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe90dffb700 1 -- 172.21.15.35:0/2598763017 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe910034c00 con 0x557c020e6b70 2023-03-17T09:15:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 10 client.16146 fetch_fsmap learned FSMap version 29 2023-03-17T09:15:25.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557c01e8b1f0 con 0x557c020e6b70 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe90dffb700 1 -- 172.21.15.35:0/2598763017 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c020b41e0 con 0x557c020e6b70 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe90dffb700 1 -- 172.21.15.35:0/2598763017 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe910004770 con 0x557c020e6b70 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 10 client.16146 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 10 client.16146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 20 client.16146 populate_metadata read hostname 'smithi035' 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c02155300 0x557c02157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 4 client.16146 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:15:25.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.860+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557c01ebaf00 con 0x557c02155300 2023-03-17T09:15:25.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.861+0000 7fe925d9b700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c02155300 0x557c02157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.861+0000 7fe90dffb700 10 client.16146 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:15:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.861+0000 7fe925d9b700 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c02155300 0x557c02157710 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c312b755f73d5972 server_cookie=b35ad614d3d1663c in_seq=0 out_seq=0 2023-03-17T09:15:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe90dffb700 1 -- 172.21.15.35:0/2598763017 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557c01ebaf00 con 0x557c02155300 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe90dffb700 10 client.16146 handle_command_reply: tid=0 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 client.16146 shutdown 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 msgr2=0x557c020e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e8df0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe9100098e0 tx=0x7fe910009cd0 comp rx=0 tx=0).stop 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 shutdown_connections 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c02155300 0x557c02157710 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c020ec6a0 0x557c020e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c020e6b70 0x557c020e8df0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:26.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 --2- 172.21.15.35:0/2598763017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c020ebd90 0x557c020e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 >> 172.21.15.35:0/2598763017 conn(0x557c01f416b0 msgr2=0x557c020e3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe90dffb700 0 client.16146 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:15:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 shutdown_connections 2023-03-17T09:15:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 1 -- 172.21.15.35:0/2598763017 wait complete. 2023-03-17T09:15:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.865+0000 7fe938d23b80 20 client.16146 trim_cache size 0 max 16384 2023-03-17T09:15:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe91409f640 msgr2=0x7fe9140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe91409f640 0x7fe9140a1af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe910009fd0 tx=0x7fe910005fb0 comp rx=0 tx=0).stop 2023-03-17T09:15:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 msgr2=0x7fe928199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 0x7fe928199a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe920007ee0 tx=0x7fe92000d3b0 comp rx=0 tx=0).stop 2023-03-17T09:15:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 shutdown_connections 2023-03-17T09:15:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe91409f640 0x7fe9140a1af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe928104390 0x7fe928199a40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9280ff350 0x7fe9281950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 --2- 172.21.15.35:0/3591226966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9280ffcf0 0x7fe9281955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 >> 172.21.15.35:0/3591226966 conn(0x7fe928076330 msgr2=0x7fe928102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 shutdown_connections 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:01:55.866+0000 7fe92cb96700 1 -- 172.21.15.35:0/3591226966 wait complete. 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 -- 172.21.15.35:0/1973979065 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ffcf0 msgr2=0x7f26b0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/1973979065 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ffcf0 0x7f26b0103cb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f26a00099c0 tx=0x7f26a0009cd0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 -- 172.21.15.35:0/1973979065 shutdown_connections 2023-03-17T09:15:30.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/1973979065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b0104390 0x7f26b010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/1973979065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26b00ff350 0x7f26b00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/1973979065 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ffcf0 0x7f26b0103cb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:30.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:32 smithi035 ceph-mon[92535]: pgmap v640: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:31.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:34 smithi035 ceph-mon[92535]: pgmap v641: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:31.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:36 smithi035 ceph-mon[92535]: pgmap v642: 97 pgs: 97 active+clean; 1.4 MiB data, 137 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:31.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:38 smithi035 ceph-mon[92535]: pgmap v643: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:15:32.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:40 smithi035 ceph-mon[92535]: pgmap v644: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:32.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:42 smithi035 ceph-mon[92535]: pgmap v645: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:32.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:44 smithi035 ceph-mon[92535]: pgmap v646: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:32.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:15:32.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:32.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:33.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:46 smithi035 ceph-mon[92535]: pgmap v647: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:33.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: pgmap v648: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:34.612 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:34.612 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:34.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:35.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:35.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:35.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:35.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:35.654 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:15:37.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:37.096 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:50 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:50 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:50 smithi035 ceph-mon[92535]: pgmap v649: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:52 smithi035 ceph-mon[92535]: pgmap v650: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:54 smithi035 ceph-mon[92535]: pgmap v651: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:56 smithi035 ceph-mon[92535]: pgmap v652: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:06:58 smithi035 ceph-mon[92535]: pgmap v653: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:40.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:00 smithi035 ceph-mon[92535]: pgmap v654: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:42.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:02 smithi035 ceph-mon[92535]: pgmap v655: 97 pgs: 97 active+clean; 1.4 MiB data, 138 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:42.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:04 smithi035 ceph-mon[92535]: pgmap v656: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:04 smithi035 ceph-mon[92535]: osdmap e115: 12 total, 12 up, 12 in 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:06 smithi035 ceph-mon[92535]: pgmap v658: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:08 smithi035 ceph-mon[92535]: pgmap v659: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:10 smithi035 ceph-mon[92535]: pgmap v660: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:10 smithi035 ceph-mon[92535]: osdmap e116: 12 total, 12 up, 12 in 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:12 smithi035 ceph-mon[92535]: pgmap v662: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:14 smithi035 ceph-mon[92535]: pgmap v663: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 412 B/s wr, 9 op/s 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:15 smithi035 ceph-mon[92535]: daemon mds.e restarted 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:15 smithi035 ceph-mon[92535]: osdmap e117: 12 total, 12 up, 12 in 2023-03-17T09:15:42.182 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6834/2101384039,v1:172.21.15.78:6835/2101384039] up:boot 2023-03-17T09:15:42.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:15:42.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:15:42.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:16 smithi035 ceph-mon[92535]: pgmap v665: 97 pgs: 97 active+clean; 1.4 MiB data, 139 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:15:42.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:18 smithi035 ceph-mon[92535]: pgmap v666: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:15:42.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:20 smithi035 ceph-mon[92535]: pgmap v667: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 565 B/s wr, 10 op/s 2023-03-17T09:15:42.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:22 smithi035 ceph-mon[92535]: pgmap v668: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:15:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:24 smithi035 ceph-mon[92535]: pgmap v669: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:15:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:26 smithi035 ceph-mon[92535]: pgmap v670: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 380 B/s wr, 10 op/s 2023-03-17T09:15:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:28 smithi035 ceph-mon[92535]: pgmap v671: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:15:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:30 smithi035 ceph-mon[92535]: pgmap v672: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:15:44.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:32 smithi035 ceph-mon[92535]: pgmap v673: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:15:44.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:34 smithi035 ceph-mon[92535]: pgmap v674: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:36 smithi035 ceph-mon[92535]: pgmap v675: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:38 smithi035 ceph-mon[92535]: pgmap v676: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:40 smithi035 ceph-mon[92535]: pgmap v677: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:42 smithi035 ceph-mon[92535]: pgmap v678: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:44 smithi035 ceph-mon[92535]: pgmap v679: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:46 smithi035 ceph-mon[92535]: pgmap v680: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:15:44.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:48 smithi035 ceph-mon[92535]: pgmap v681: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:45.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:15:45.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:50 smithi035 ceph-mon[92535]: pgmap v682: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:45.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:52 smithi035 ceph-mon[92535]: pgmap v683: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:45.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:45.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:45.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:15:45.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:15:45.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:15:45.837 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:54 smithi035 ceph-mon[92535]: pgmap v684: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:15:46.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:56 smithi035 ceph-mon[92535]: pgmap v685: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:46.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:47.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:15:47.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:15:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:15:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:15:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 -- 172.21.15.35:0/1973979065 >> 172.21.15.35:0/1973979065 conn(0x7f26b0076330 msgr2=0x7f26b0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:50.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 -- 172.21.15.35:0/1973979065 shutdown_connections 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.988+0000 7f26b7e7b700 1 -- 172.21.15.35:0/1973979065 wait complete. 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 Processor -- start 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 -- start start 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 0x7f26b0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26b00ffcf0 0x7f26b01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b0104390 0x7f26b019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b019d450 con 0x7f26b00ff350 2023-03-17T09:15:50.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b019d5c0 con 0x7f26b00ffcf0 2023-03-17T09:15:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b7e7b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b019d780 con 0x7f26b0104390 2023-03-17T09:15:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b5c17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 0x7f26b0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b5c17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 0x7f26b0198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44126/0 (socket says 172.21.15.35:44126) 2023-03-17T09:15:50.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b5c17700 1 -- 172.21.15.35:0/271309194 learned_addr learned my addr 172.21.15.35:0/271309194 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b6418700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b0104390 0x7f26b019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.989+0000 7f26b5416700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26b00ffcf0 0x7f26b01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b5c17700 1 -- 172.21.15.35:0/271309194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b0104390 msgr2=0x7f26b019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b5c17700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b0104390 0x7f26b019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b5c17700 1 -- 172.21.15.35:0/271309194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26b00ffcf0 msgr2=0x7f26b01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b5c17700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26b00ffcf0 0x7f26b01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b5c17700 1 -- 172.21.15.35:0/271309194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00095f0 con 0x7f26b00ff350 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b5c17700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 0x7f26b0198470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00d980 tx=0x7f26ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26a6ffd700 1 -- 172.21.15.35:0/271309194 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac004220 con 0x7f26b00ff350 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26a6ffd700 1 -- 172.21.15.35:0/271309194 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26ac007640 con 0x7f26b00ff350 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b010efc0 con 0x7f26b00ff350 2023-03-17T09:15:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26a6ffd700 1 -- 172.21.15.35:0/271309194 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac005660 con 0x7f26b00ff350 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.990+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b010ee30 con 0x7f26b00ff350 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.993+0000 7f26a6ffd700 1 -- 172.21.15.35:0/271309194 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f26ac004750 con 0x7f26b00ff350 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.994+0000 7f26a6ffd700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f269c09f640 0x7f269c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.994+0000 7f26a6ffd700 1 -- 172.21.15.35:0/271309194 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f26ac0ca3f0 con 0x7f26b00ff350 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.994+0000 7f26b5416700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f269c09f640 0x7f269c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.994+0000 7f26c4008b80 1 Processor -- start 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 -- start start 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5416700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f269c09f640 0x7f269c0a1af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f26a00036c0 tx=0x7f26a0009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb24f0 0x555a2edac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edac960 0x555a2edacd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2ecb3010 con 0x555a2edb1be0 2023-03-17T09:15:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2ed05950 con 0x555a2edac960 2023-03-17T09:15:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26c4008b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2ecfede0 con 0x555a2edb24f0 2023-03-17T09:15:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44134/0 (socket says 172.21.15.35:44134) 2023-03-17T09:15:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 -- 172.21.15.35:0/2616880813 learned_addr learned my addr 172.21.15.35:0/2616880813 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:15:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b6418700 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edac960 0x555a2edacd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5416700 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb24f0 0x555a2edac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:15:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 -- 172.21.15.35:0/2616880813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb24f0 msgr2=0x555a2edac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb24f0 0x555a2edac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 -- 172.21.15.35:0/2616880813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edac960 msgr2=0x555a2edacd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edac960 0x555a2edacd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b5c17700 1 -- 172.21.15.35:0/2616880813 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a2eb805d0 con 0x555a2edb1be0 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.995+0000 7f26b6418700 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edac960 0x555a2edacd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.996+0000 7f26b5c17700 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb1fb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0948b0 tx=0x7f26ac097820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53f2cf7b848aecb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.996+0000 7f269bfff700 1 -- 172.21.15.35:0/2616880813 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0af070 con 0x555a2edb1be0 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.996+0000 7f269bfff700 1 -- 172.21.15.35:0/2616880813 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26ac097e40 con 0x555a2edb1be0 2023-03-17T09:15:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.996+0000 7f269bfff700 1 -- 172.21.15.35:0/2616880813 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac097330 con 0x555a2edb1be0 2023-03-17T09:15:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.996+0000 7f26c4008b80 1 -- 172.21.15.35:0/2616880813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 msgr2=0x555a2edb1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:15:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.996+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb1fb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0948b0 tx=0x7f26ac097820 comp rx=0 tx=0).stop 2023-03-17T09:15:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 -- 172.21.15.35:0/2616880813 shutdown_connections 2023-03-17T09:15:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edac960 0x555a2edacd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb1fb0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2616880813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb24f0 0x555a2edac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:15:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 -- 172.21.15.35:0/2616880813 >> 172.21.15.35:0/2616880813 conn(0x555a2ec096b0 msgr2=0x555a2eda6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:15:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 -- 172.21.15.35:0/2616880813 shutdown_connections 2023-03-17T09:15:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 -- 172.21.15.35:0/2616880813 wait complete. 2023-03-17T09:15:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 -- start start 2023-03-17T09:15:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.997+0000 7f26c4008b80 1 Processor -- start 2023-03-17T09:15:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edb84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2edb5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:15:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2eb828c0 con 0x555a2edb1be0 2023-03-17T09:15:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2edb65c0 con 0x555a2edb24f0 2023-03-17T09:15:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2edc1fd0 con 0x555a2edac960 2023-03-17T09:15:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26c4008b80 10 client.0 _ll_register_callbacks cb 0x555a2eba4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:01.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44140/0 (socket says 172.21.15.35:44140) 2023-03-17T09:16:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 -- 172.21.15.35:0/1258531791 learned_addr learned my addr 172.21.15.35:0/1258531791 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5c17700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edb84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b6418700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2edb5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 -- 172.21.15.35:0/1258531791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 msgr2=0x555a2edb84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edb84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 -- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 msgr2=0x555a2edb5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2edb5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 -- 172.21.15.35:0/1258531791 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b010ee30 con 0x555a2edb1be0 2023-03-17T09:16:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26b5416700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb5760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f26b01000c0 tx=0x7f26a001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b69dfa97a134e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.998+0000 7f26997fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:16:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26997fa700 1 -- 172.21.15.35:0/1258531791 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000be70 con 0x555a2edb1be0 2023-03-17T09:16:04.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26997fa700 1 -- 172.21.15.35:0/1258531791 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f26a0004b70 con 0x555a2edb1be0 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a2ecc1390 con 0x555a2edb1be0 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26997fa700 1 -- 172.21.15.35:0/1258531791 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26a0004d30 con 0x555a2edb1be0 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 10 client.16158 fetch_fsmap learned FSMap version 29 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555a2eb2cd80 con 0x555a2edb1be0 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26997fa700 1 -- 172.21.15.35:0/1258531791 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26a003e020 con 0x555a2edb1be0 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26997fa700 1 -- 172.21.15.35:0/1258531791 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f26a003a470 con 0x555a2edb1be0 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 10 client.16158 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:16:04.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 10 client.16158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 20 client.16158 populate_metadata read hostname 'smithi035' 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2edc6080 0x555a2edc8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 4 client.16158 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:08.999+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a2eccd600 con 0x555a2edc6080 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.000+0000 7f26b5c17700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2edc6080 0x555a2edc8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.000+0000 7f26b5c17700 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2edc6080 0x555a2edc8490 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab414372e6641519 server_cookie=433cc5d288cd31ea in_seq=0 out_seq=0 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.000+0000 7f26997fa700 10 client.16158 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.000+0000 7f26997fa700 1 -- 172.21.15.35:0/1258531791 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555a2eccd600 con 0x555a2edc6080 2023-03-17T09:16:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.000+0000 7f26997fa700 10 client.16158 handle_command_reply: tid=0 2023-03-17T09:16:04.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.000+0000 7f26c4008b80 1 client.16158 shutdown 2023-03-17T09:16:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 msgr2=0x555a2edb5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb5760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f26b01000c0 tx=0x7f26a001a050 comp rx=0 tx=0).stop 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 shutdown_connections 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2edc6080 0x555a2edc8490 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2edb5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26997fa700 0 client.16158 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edb84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 --2- 172.21.15.35:0/1258531791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb1be0 0x555a2edb5760 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 >> 172.21.15.35:0/1258531791 conn(0x555a2ec096b0 msgr2=0x555a2edab410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 shutdown_connections 2023-03-17T09:16:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 1 -- 172.21.15.35:0/1258531791 wait complete. 2023-03-17T09:16:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.001+0000 7f26c4008b80 20 client.16158 trim_cache size 0 max 16384 2023-03-17T09:16:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 Processor -- start 2023-03-17T09:16:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 -- start start 2023-03-17T09:16:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edbcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb1be0 0x555a2edb8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 0x555a2edaba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2edb6d40 con 0x555a2edb24f0 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2edb8b70 con 0x555a2edb1be0 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26c4008b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2eda8620 con 0x555a2edac960 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26b6418700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 0x555a2edaba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.016+0000 7f26b6418700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 0x555a2edaba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44152/0 (socket says 172.21.15.35:44152) 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b6418700 1 -- 172.21.15.35:0/2488476480 learned_addr learned my addr 172.21.15.35:0/2488476480 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb1be0 0x555a2edb8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5c17700 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edbcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 -- 172.21.15.35:0/2488476480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 msgr2=0x555a2edbcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edbcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 -- 172.21.15.35:0/2488476480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 msgr2=0x555a2edaba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 0x555a2edaba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 -- 172.21.15.35:0/2488476480 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a2ecc5130 con 0x555a2edb1be0 2023-03-17T09:16:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b6418700 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 0x555a2edaba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26b5416700 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb1be0 0x555a2edb8080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26a003a880 tx=0x7f26a003aa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7e6f7043949204 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26a4ff9700 1 -- 172.21.15.35:0/2488476480 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000be70 con 0x555a2edb1be0 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26a4ff9700 1 -- 172.21.15.35:0/2488476480 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26a003e030 con 0x555a2edb1be0 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.017+0000 7f26a4ff9700 1 -- 172.21.15.35:0/2488476480 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0003820 con 0x555a2edb1be0 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 -- 172.21.15.35:0/2488476480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb1be0 msgr2=0x555a2edb8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb1be0 0x555a2edb8080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f26a003a880 tx=0x7f26a003aa20 comp rx=0 tx=0).stop 2023-03-17T09:16:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 -- 172.21.15.35:0/2488476480 shutdown_connections 2023-03-17T09:16:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edb24f0 0x555a2edaba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edac960 0x555a2edbcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 --2- 172.21.15.35:0/2488476480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb1be0 0x555a2edb8080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 -- 172.21.15.35:0/2488476480 >> 172.21.15.35:0/2488476480 conn(0x555a2ec096b0 msgr2=0x555a2edc2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 -- 172.21.15.35:0/2488476480 shutdown_connections 2023-03-17T09:16:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 -- 172.21.15.35:0/2488476480 wait complete. 2023-03-17T09:16:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 -- start start 2023-03-17T09:16:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.018+0000 7f26c4008b80 1 Processor -- start 2023-03-17T09:16:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 0x555a2edbb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb1be0 0x555a2edbb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2ee18f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2ee19480 con 0x555a2edac960 2023-03-17T09:16:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2ee195c0 con 0x555a2edb24f0 2023-03-17T09:16:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a2ee19700 con 0x555a2edb1be0 2023-03-17T09:16:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26c4008b80 10 client.0 _ll_register_callbacks cb 0x555a2eba4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:16:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 0x555a2edbb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 0x555a2edbb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44154/0 (socket says 172.21.15.35:44154) 2023-03-17T09:16:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 -- 172.21.15.35:0/35342129 learned_addr learned my addr 172.21.15.35:0/35342129 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:13.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:07:58 smithi035 ceph-mon[92535]: pgmap v686: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:16:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b6418700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2ee18f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5416700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb1be0 0x555a2edbb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 -- 172.21.15.35:0/35342129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb1be0 msgr2=0x555a2edbb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb1be0 0x555a2edbb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 -- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 msgr2=0x555a2ee18f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2ee18f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.019+0000 7f26b5c17700 1 -- 172.21.15.35:0/35342129 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a8003cf0 con 0x555a2edac960 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26b5c17700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 0x555a2edbb0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26ac097dd0 tx=0x7f26ac0c80a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd56884142dcd1f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26997fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26997fa700 1 -- 172.21.15.35:0/35342129 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0af040 con 0x555a2edac960 2023-03-17T09:16:17.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26997fa700 1 -- 172.21.15.35:0/35342129 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f26ac0a0030 con 0x555a2edac960 2023-03-17T09:16:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a2ed7c1e0 con 0x555a2edac960 2023-03-17T09:16:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26997fa700 1 -- 172.21.15.35:0/35342129 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26ac097e40 con 0x555a2edac960 2023-03-17T09:16:17.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 10 client.16164 fetch_fsmap learned FSMap version 29 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555a2eb2cd80 con 0x555a2edac960 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26997fa700 1 -- 172.21.15.35:0/35342129 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555a2ed7c1e0 con 0x555a2edac960 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26997fa700 1 -- 172.21.15.35:0/35342129 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f26ac0b5b60 con 0x555a2edac960 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 10 client.16164 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 10 client.16164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 20 client.16164 populate_metadata read hostname 'smithi035' 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2ee1aa20 0x555a2ee1ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 4 client.16164 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:16:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.020+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555a2eb82f00 con 0x555a2ee1aa20 2023-03-17T09:16:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.021+0000 7f26b5416700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2ee1aa20 0x555a2ee1ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.021+0000 7f26997fa700 10 client.16164 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.021+0000 7f26b5416700 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2ee1aa20 0x555a2ee1ce00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a136e5adb16c34b server_cookie=2124072d841700f2 in_seq=0 out_seq=0 2023-03-17T09:16:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26997fa700 1 -- 172.21.15.35:0/35342129 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555a2eb82f00 con 0x555a2ee1aa20 2023-03-17T09:16:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26997fa700 10 client.16164 handle_command_reply: tid=0 2023-03-17T09:16:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 client.16164 shutdown 2023-03-17T09:16:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 msgr2=0x555a2edbb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 0x555a2edbb0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26ac097dd0 tx=0x7f26ac0c80a0 comp rx=0 tx=0).stop 2023-03-17T09:16:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 shutdown_connections 2023-03-17T09:16:21.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555a2ee1aa20 0x555a2ee1ce00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a2edb24f0 0x555a2ee18f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555a2edac960 0x555a2edbb0c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 --2- 172.21.15.35:0/35342129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a2edb1be0 0x555a2edbb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26997fa700 0 client.16164 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 >> 172.21.15.35:0/35342129 conn(0x555a2ec096b0 msgr2=0x555a2edaf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 shutdown_connections 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 1 -- 172.21.15.35:0/35342129 wait complete. 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.028+0000 7f26c4008b80 20 client.16164 trim_cache size 0 max 16384 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f269c09f640 msgr2=0x7f269c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f269c09f640 0x7f269c0a1af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f26a00036c0 tx=0x7f26a0009f10 comp rx=0 tx=0).stop 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 msgr2=0x7f26b0198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 0x7f26b0198470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00d980 tx=0x7f26ac00dc90 comp rx=0 tx=0).stop 2023-03-17T09:16:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 shutdown_connections 2023-03-17T09:16:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f269c09f640 0x7f269c0a1af0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26b0104390 0x7f26b019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f26b00ff350 0x7f26b0198470 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 --2- 172.21.15.35:0/271309194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26b00ffcf0 0x7f26b01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 >> 172.21.15.35:0/271309194 conn(0x7f26b0076330 msgr2=0x7f26b0068920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 shutdown_connections 2023-03-17T09:16:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:09.029+0000 7f26b7e7b700 1 -- 172.21.15.35:0/271309194 wait complete. 2023-03-17T09:16:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 -- 172.21.15.35:0/2102315615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 msgr2=0x7fbec80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 --2- 172.21.15.35:0/2102315615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec80ff720 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbec40099c0 tx=0x7fbec4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 -- 172.21.15.35:0/2102315615 shutdown_connections 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 --2- 172.21.15.35:0/2102315615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec8104390 0x7fbec810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 --2- 172.21.15.35:0/2102315615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec80ff720 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 --2- 172.21.15.35:0/2102315615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec80ffcf0 0x7fbec8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 -- 172.21.15.35:0/2102315615 >> 172.21.15.35:0/2102315615 conn(0x7fbec8076330 msgr2=0x7fbec8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 -- 172.21.15.35:0/2102315615 shutdown_connections 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.151+0000 7fbed059f700 1 -- 172.21.15.35:0/2102315615 wait complete. 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 Processor -- start 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 -- start start 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80ffcf0 0x7fbec8196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec8104390 0x7fbec819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819b2c0 con 0x7fbec80ff350 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819b430 con 0x7fbec8104390 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbed059f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819b5f0 con 0x7fbec80ffcf0 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbece33b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbece33b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec81962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44210/0 (socket says 172.21.15.35:44210) 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbece33b700 1 -- 172.21.15.35:0/678746324 learned_addr learned my addr 172.21.15.35:0/678746324 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80ffcf0 0x7fbec8196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.152+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec8104390 0x7fbec819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbece33b700 1 -- 172.21.15.35:0/678746324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80ffcf0 msgr2=0x7fbec8196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbece33b700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80ffcf0 0x7fbec8196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbece33b700 1 -- 172.21.15.35:0/678746324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec8104390 msgr2=0x7fbec819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbece33b700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec8104390 0x7fbec819ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbece33b700 1 -- 172.21.15.35:0/678746324 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40095f0 con 0x7fbec80ff350 2023-03-17T09:16:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbece33b700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec81962e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbec4000c00 tx=0x7fbec4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbebb7fe700 1 -- 172.21.15.35:0/678746324 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec401d070 con 0x7fbec80ff350 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbebb7fe700 1 -- 172.21.15.35:0/678746324 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbec400fe70 con 0x7fbec80ff350 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbebb7fe700 1 -- 172.21.15.35:0/678746324 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40173f0 con 0x7fbec80ff350 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec810f050 con 0x7fbec80ff350 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.153+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec810eec0 con 0x7fbec80ff350 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.155+0000 7fbebb7fe700 1 -- 172.21.15.35:0/678746324 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbec400f9e0 con 0x7fbec80ff350 2023-03-17T09:16:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.156+0000 7fbebb7fe700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbeb409f790 0x7fbeb40a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.156+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbeb409f790 0x7fbeb40a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.156+0000 7fbebb7fe700 1 -- 172.21.15.35:0/678746324 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbec40cb6f0 con 0x7fbec80ff350 2023-03-17T09:16:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.157+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbeb409f790 0x7fbeb40a1c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbec81978f0 tx=0x7fbebc00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.157+0000 7fbedc72cb80 1 Processor -- start 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.157+0000 7fbedc72cb80 1 -- start start 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.157+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa79fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.157+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefa74420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa74d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceef97b010 con 0x55ceefa7a4f0 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceef9cd950 con 0x55ceefa74960 2023-03-17T09:16:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceef9c6de0 con 0x55ceefa79be0 2023-03-17T09:16:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefa74420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:29.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefa74420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44220/0 (socket says 172.21.15.35:44220) 2023-03-17T09:16:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 -- 172.21.15.35:0/448019428 learned_addr learned my addr 172.21.15.35:0/448019428 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbece33b700 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa79fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 -- 172.21.15.35:0/448019428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 msgr2=0x55ceefa79fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa79fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 -- 172.21.15.35:0/448019428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 msgr2=0x55ceefa74d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa74d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 -- 172.21.15.35:0/448019428 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceef8485d0 con 0x55ceefa7a4f0 2023-03-17T09:16:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa74d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:16:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefa74420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbebc005d90 tx=0x7fbebc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864e74b278676868 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbeb8ff9700 1 -- 172.21.15.35:0/448019428 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc011bb0 con 0x55ceefa7a4f0 2023-03-17T09:16:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.158+0000 7fbeb8ff9700 1 -- 172.21.15.35:0/448019428 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbebc015070 con 0x55ceefa7a4f0 2023-03-17T09:16:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbeb8ff9700 1 -- 172.21.15.35:0/448019428 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0054c0 con 0x55ceefa7a4f0 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 -- 172.21.15.35:0/448019428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 msgr2=0x55ceefa74420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefa74420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbebc005d90 tx=0x7fbebc013000 comp rx=0 tx=0).stop 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 -- 172.21.15.35:0/448019428 shutdown_connections 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa74d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa79fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/448019428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefa74420 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 -- 172.21.15.35:0/448019428 >> 172.21.15.35:0/448019428 conn(0x55ceef8d16b0 msgr2=0x55ceefa6ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 -- 172.21.15.35:0/448019428 shutdown_connections 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.159+0000 7fbedc72cb80 1 -- 172.21.15.35:0/448019428 wait complete. 2023-03-17T09:16:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 -- start start 2023-03-17T09:16:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 Processor -- start 2023-03-17T09:16:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa80430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 0x55ceefa7d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa7a4f0 0x55ceefa7dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceef84a8c0 con 0x55ceefa79be0 2023-03-17T09:16:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefa7e4d0 con 0x55ceefa74960 2023-03-17T09:16:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefa8a030 con 0x55ceefa7a4f0 2023-03-17T09:16:35.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbedc72cb80 10 client.0 _ll_register_callbacks cb 0x55ceef86c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.160+0000 7fbecdb3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 0x55ceefa7d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 0x55ceefa7d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44226/0 (socket says 172.21.15.35:44226) 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 -- 172.21.15.35:0/3195389460 learned_addr learned my addr 172.21.15.35:0/3195389460 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa7a4f0 0x55ceefa7dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbece33b700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa80430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 -- 172.21.15.35:0/3195389460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa7a4f0 msgr2=0x55ceefa7dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa7a4f0 0x55ceefa7dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:36.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 -- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 msgr2=0x55ceefa80430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa80430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 -- 172.21.15.35:0/3195389460 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc010c20 con 0x55ceefa79be0 2023-03-17T09:16:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa7a4f0 0x55ceefa7dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:16:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 0x55ceefa7d720 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0059d0 tx=0x7fbebc012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55237e5fc61a1aa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbeb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3195389460 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc02b070 con 0x55ceefa79be0 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceef989390 con 0x55ceefa79be0 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3195389460 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbebc017070 con 0x55ceefa79be0 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3195389460 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbebc004920 con 0x55ceefa79be0 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbedc72cb80 10 client.16194 fetch_fsmap learned FSMap version 29 2023-03-17T09:16:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.161+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ceef7f4d80 con 0x55ceefa79be0 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3195389460 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbebc03d020 con 0x55ceefa79be0 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3195389460 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbebc024070 con 0x55ceefa79be0 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbedc72cb80 10 client.16194 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbedc72cb80 10 client.16194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbedc72cb80 20 client.16194 populate_metadata read hostname 'smithi035' 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefa8e040 0x55ceefa90450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbedc72cb80 4 client.16194 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:16:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ceef995600 con 0x55ceefa8e040 2023-03-17T09:16:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.162+0000 7fbece33b700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefa8e040 0x55ceefa90450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbeb1ffb700 10 client.16194 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:39.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:00 smithi035 ceph-mon[92535]: pgmap v687: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:16:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbece33b700 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefa8e040 0x55ceefa90450 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb56ee1b42fc05de server_cookie=106616207ad5595e in_seq=0 out_seq=0 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3195389460 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ceef995600 con 0x55ceefa8e040 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbeb1ffb700 10 client.16194 handle_command_reply: tid=0 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 client.16194 shutdown 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 msgr2=0x55ceefa7d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 0x55ceefa7d720 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0059d0 tx=0x7fbebc012ea0 comp rx=0 tx=0).stop 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 shutdown_connections 2023-03-17T09:16:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefa8e040 0x55ceefa90450 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa7a4f0 0x55ceefa7dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbeb1ffb700 0 client.16194 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa74960 0x55ceefa80430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:45.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3195389460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa79be0 0x55ceefa7d720 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:45.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.163+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 >> 172.21.15.35:0/3195389460 conn(0x55ceef8d16b0 msgr2=0x55ceefa73410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:45.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.164+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 shutdown_connections 2023-03-17T09:16:45.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.164+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3195389460 wait complete. 2023-03-17T09:16:45.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.164+0000 7fbedc72cb80 20 client.16194 trim_cache size 0 max 16384 2023-03-17T09:16:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 Processor -- start 2023-03-17T09:16:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 -- start start 2023-03-17T09:16:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 0x55ceefa84f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa7ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa7a4f0 0x55ceefa77650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefa8ab00 con 0x55ceefa74960 2023-03-17T09:16:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefa6bb60 con 0x55ceefa7a4f0 2023-03-17T09:16:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefa73a90 con 0x55ceefa79be0 2023-03-17T09:16:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbece33b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 0x55ceefa84f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbece33b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 0x55ceefa84f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44232/0 (socket says 172.21.15.35:44232) 2023-03-17T09:16:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbece33b700 1 -- 172.21.15.35:0/2566451859 learned_addr learned my addr 172.21.15.35:0/2566451859 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa7ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.179+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa7a4f0 0x55ceefa77650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbece33b700 1 -- 172.21.15.35:0/2566451859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 msgr2=0x55ceefa7ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbece33b700 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa7ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbece33b700 1 -- 172.21.15.35:0/2566451859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa7a4f0 msgr2=0x55ceefa77650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbece33b700 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa7a4f0 0x55ceefa77650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbece33b700 1 -- 172.21.15.35:0/2566451859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ceef98d130 con 0x55ceefa74960 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa7a4f0 0x55ceefa77650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:16:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbece33b700 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 0x55ceefa84f80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbec40c9480 tx=0x7fbec4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f730b163626222 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbeb97fa700 1 -- 172.21.15.35:0/2566451859 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400fc90 con 0x55ceefa74960 2023-03-17T09:16:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbeb97fa700 1 -- 172.21.15.35:0/2566451859 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbec4099230 con 0x55ceefa74960 2023-03-17T09:16:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.180+0000 7fbeb97fa700 1 -- 172.21.15.35:0/2566451859 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4099490 con 0x55ceefa74960 2023-03-17T09:16:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 -- 172.21.15.35:0/2566451859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 msgr2=0x55ceefa84f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:50.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 0x55ceefa84f80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbec40c9480 tx=0x7fbec4009310 comp rx=0 tx=0).stop 2023-03-17T09:16:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 -- 172.21.15.35:0/2566451859 shutdown_connections 2023-03-17T09:16:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa7a4f0 0x55ceefa77650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa74960 0x55ceefa84f80 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/2566451859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa79be0 0x55ceefa7ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 -- 172.21.15.35:0/2566451859 >> 172.21.15.35:0/2566451859 conn(0x55ceef8d16b0 msgr2=0x55ceefa8a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:50.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 -- 172.21.15.35:0/2566451859 shutdown_connections 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 -- 172.21.15.35:0/2566451859 wait complete. 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 -- start start 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 Processor -- start 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.181+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 0x55ceefada430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa79be0 0x55ceefada970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefae52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefadb100 con 0x55ceefa7a4f0 2023-03-17T09:16:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefae5830 con 0x55ceefa79be0 2023-03-17T09:16:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ceefae59f0 con 0x55ceefa74960 2023-03-17T09:16:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 10 client.0 _ll_register_callbacks cb 0x55ceef86c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:16:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefae52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbece33b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 0x55ceefada430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbece33b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 0x55ceefada430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36004/0 (socket says 172.21.15.35:36004) 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbece33b700 1 -- 172.21.15.35:0/3234278829 learned_addr learned my addr 172.21.15.35:0/3234278829 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefae52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44242/0 (socket says 172.21.15.35:44242) 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa79be0 0x55ceefada970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 -- 172.21.15.35:0/3234278829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 msgr2=0x55ceefada430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 0x55ceefada430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 -- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa79be0 msgr2=0x55ceefada970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa79be0 0x55ceefada970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 -- 172.21.15.35:0/3234278829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec810eec0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbecdb3a700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa79be0 0x55ceefada970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbece33b700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 0x55ceefada430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeceb3c700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefae52c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55ceefa7a960 tx=0x7fbec0007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7839968738ae9d3c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3234278829 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000e040 con 0x55ceefa7a4f0 2023-03-17T09:16:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ceefa441e0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.182+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3234278829 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbec0004db0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3234278829 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec00176e0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 10 client.16200 fetch_fsmap learned FSMap version 29 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ceef81b1f0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3234278829 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ceefa441e0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3234278829 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbec001f9c0 con 0x55ceefa7a4f0 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 10 client.16200 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:16:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 20 client.16200 populate_metadata read hostname 'smithi035' 2023-03-17T09:16:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefae71e0 0x55ceefae95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 4 client.16200 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ceef84af00 con 0x55ceefae71e0 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.183+0000 7fbece33b700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefae71e0 0x55ceefae95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.184+0000 7fbeb1ffb700 10 client.16200 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.184+0000 7fbece33b700 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefae71e0 0x55ceefae95f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9a6c8874309c58 server_cookie=bb6206a4d3bf2818 in_seq=0 out_seq=0 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbeb1ffb700 1 -- 172.21.15.35:0/3234278829 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ceef84af00 con 0x55ceefae71e0 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbeb1ffb700 10 client.16200 handle_command_reply: tid=0 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 client.16200 shutdown 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 msgr2=0x55ceefae52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefae52c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55ceefa7a960 tx=0x7fbec0007ac0 comp rx=0 tx=0).stop 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 shutdown_connections 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ceefae71e0 0x55ceefae95f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ceefa7a4f0 0x55ceefae52c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ceefa74960 0x55ceefada430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbeb1ffb700 0 client.16200 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:16:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 --2- 172.21.15.35:0/3234278829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ceefa79be0 0x55ceefada970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 >> 172.21.15.35:0/3234278829 conn(0x55ceef8d16b0 msgr2=0x55ceefa77650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.191+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 shutdown_connections 2023-03-17T09:16:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbedc72cb80 1 -- 172.21.15.35:0/3234278829 wait complete. 2023-03-17T09:16:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbedc72cb80 20 client.16200 trim_cache size 0 max 16384 2023-03-17T09:16:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbeb409f790 msgr2=0x7fbeb40a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbeb409f790 0x7fbeb40a1c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbec81978f0 tx=0x7fbebc00b410 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 msgr2=0x7fbec81962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec81962e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbec4000c00 tx=0x7fbec4005f10 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 shutdown_connections 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbeb409f790 0x7fbeb40a1c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbec8104390 0x7fbec819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbec80ff350 0x7fbec81962e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 --2- 172.21.15.35:0/678746324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbec80ffcf0 0x7fbec8196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 >> 172.21.15.35:0/678746324 conn(0x7fbec8076330 msgr2=0x7fbec80680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 shutdown_connections 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:22.192+0000 7fbed059f700 1 -- 172.21.15.35:0/678746324 wait complete. 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 -- 172.21.15.35:0/1613939682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c810a7d0 msgr2=0x7fd0c810cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 --2- 172.21.15.35:0/1613939682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c810a7d0 0x7fd0c810cc30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000b0a0 tx=0x7fd0c000b3b0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 -- 172.21.15.35:0/1613939682 shutdown_connections 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 --2- 172.21.15.35:0/1613939682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c810a7d0 0x7fd0c810cc30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 --2- 172.21.15.35:0/1613939682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 0x7fd0c8101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 --2- 172.21.15.35:0/1613939682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0c8101da0 0x7fd0c810a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:16:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 -- 172.21.15.35:0/1613939682 >> 172.21.15.35:0/1613939682 conn(0x7fd0c8075f60 msgr2=0x7fd0c8076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:16:57.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 -- 172.21.15.35:0/1613939682 shutdown_connections 2023-03-17T09:16:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.316+0000 7fd0cd719700 1 -- 172.21.15.35:0/1613939682 wait complete. 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.317+0000 7fd0cd719700 1 Processor -- start 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.317+0000 7fd0cd719700 1 -- start start 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.317+0000 7fd0cd719700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 0x7fd0c8196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.317+0000 7fd0cd719700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 0x7fd0c8196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.317+0000 7fd0cd719700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0c810a7d0 0x7fd0c819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.317+0000 7fd0cd719700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c819b2f0 con 0x7fd0c8101da0 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0cd719700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c819b460 con 0x7fd0c8101490 2023-03-17T09:17:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0cd719700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c819b620 con 0x7fd0c810a7d0 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 0x7fd0c8196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 0x7fd0c8196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44254/0 (socket says 172.21.15.35:44254) 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 -- 172.21.15.35:0/282871308 learned_addr learned my addr 172.21.15.35:0/282871308 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0c810a7d0 0x7fd0c819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 0x7fd0c8196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 -- 172.21.15.35:0/282871308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0c810a7d0 msgr2=0x7fd0c819acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0c810a7d0 0x7fd0c819acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 -- 172.21.15.35:0/282871308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 msgr2=0x7fd0c8196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 0x7fd0c8196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 -- 172.21.15.35:0/282871308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0009d00 con 0x7fd0c8101da0 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 0x7fd0c8196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 0x7fd0c8196850 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00d950 tx=0x7fd0bc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0affff700 1 -- 172.21.15.35:0/282871308 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc009b40 con 0x7fd0c8101da0 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c81100c0 con 0x7fd0c8101da0 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0affff700 1 -- 172.21.15.35:0/282871308 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0bc009ca0 con 0x7fd0c8101da0 2023-03-17T09:17:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0affff700 1 -- 172.21.15.35:0/282871308 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00f620 con 0x7fd0c8101da0 2023-03-17T09:17:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.318+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c810ff30 con 0x7fd0c8101da0 2023-03-17T09:17:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.321+0000 7fd0affff700 1 -- 172.21.15.35:0/282871308 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd0bc010460 con 0x7fd0c8101da0 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.321+0000 7fd0affff700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd0b009f640 0x7fd0b00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.321+0000 7fd0affff700 1 -- 172.21.15.35:0/282871308 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd0bc0ca960 con 0x7fd0c8101da0 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.321+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd0b009f640 0x7fd0b00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.322+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd0b009f640 0x7fd0b00a1af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009cb0 tx=0x7fd0b8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.322+0000 7fd0d98a6b80 1 Processor -- start 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.322+0000 7fd0d98a6b80 1 -- start start 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482858fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634828594f0 0x563482853420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482853960 0x563482853d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348275a010 con 0x563482858be0 2023-03-17T09:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634827ac950 con 0x5634828594f0 2023-03-17T09:17:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634827a5de0 con 0x563482853960 2023-03-17T09:17:07.882 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:02 smithi035 ceph-mon[92535]: pgmap v688: 97 pgs: 97 active+clean; 1.4 MiB data, 140 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482858fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:09.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482858fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44260/0 (socket says 172.21.15.35:44260) 2023-03-17T09:17:09.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 -- 172.21.15.35:0/677417023 learned_addr learned my addr 172.21.15.35:0/677417023 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:09.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482853960 0x563482853d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634828594f0 0x563482853420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 -- 172.21.15.35:0/677417023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482853960 msgr2=0x563482853d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482853960 0x563482853d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 -- 172.21.15.35:0/677417023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634828594f0 msgr2=0x563482853420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634828594f0 0x563482853420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 -- 172.21.15.35:0/677417023 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634826275d0 con 0x563482858be0 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634828594f0 0x563482853420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482858fb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8011fb0 tx=0x7fd0b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d9c2c24d9f3a71 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.323+0000 7fd0ad7fa700 1 -- 172.21.15.35:0/677417023 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8003680 con 0x563482858be0 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0ad7fa700 1 -- 172.21.15.35:0/677417023 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b8003c70 con 0x563482858be0 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0ad7fa700 1 -- 172.21.15.35:0/677417023 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8012c70 con 0x563482858be0 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/677417023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 msgr2=0x563482858fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482858fb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8011fb0 tx=0x7fd0b8014000 comp rx=0 tx=0).stop 2023-03-17T09:17:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/677417023 shutdown_connections 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482853960 0x563482853d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482858fb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/677417023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634828594f0 0x563482853420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/677417023 >> 172.21.15.35:0/677417023 conn(0x5634826b06b0 msgr2=0x56348284da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/677417023 shutdown_connections 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.324+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/677417023 wait complete. 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 -- start start 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 Processor -- start 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348285f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x56348285c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x56348285cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634826298c0 con 0x563482858be0 2023-03-17T09:17:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348285d4b0 con 0x563482853960 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563482869000 con 0x5634828594f0 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0d98a6b80 10 client.0 _ll_register_callbacks cb 0x56348264b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0c67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x56348285c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.325+0000 7fd0c67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x56348285c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44268/0 (socket says 172.21.15.35:44268) 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 -- 172.21.15.35:0/790836654 learned_addr learned my addr 172.21.15.35:0/790836654 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x56348285cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348285f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 -- 172.21.15.35:0/790836654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 msgr2=0x56348285cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x56348285cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 -- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 msgr2=0x56348285f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348285f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 -- 172.21.15.35:0/790836654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b8011c60 con 0x563482858be0 2023-03-17T09:17:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x56348285cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:17:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x56348285c740 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009520 tx=0x7fd0bc098080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7022e9a847d5112 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0aaff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:17:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0aaff5700 1 -- 172.21.15.35:0/790836654 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0a0600 con 0x563482858be0 2023-03-17T09:17:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563482768390 con 0x563482858be0 2023-03-17T09:17:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0aaff5700 1 -- 172.21.15.35:0/790836654 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd0bc094b20 con 0x563482858be0 2023-03-17T09:17:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0aaff5700 1 -- 172.21.15.35:0/790836654 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0bc094ce0 con 0x563482858be0 2023-03-17T09:17:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0d98a6b80 10 client.16212 fetch_fsmap learned FSMap version 29 2023-03-17T09:17:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.326+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5634825d3d80 con 0x563482858be0 2023-03-17T09:17:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0aaff5700 1 -- 172.21.15.35:0/790836654 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563482768390 con 0x563482858be0 2023-03-17T09:17:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0aaff5700 1 -- 172.21.15.35:0/790836654 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0bc097970 con 0x563482858be0 2023-03-17T09:17:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0d98a6b80 10 client.16212 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0d98a6b80 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0d98a6b80 20 client.16212 populate_metadata read hostname 'smithi035' 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348286d0f0 0x56348286f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0d98a6b80 4 client.16212 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563482774600 con 0x56348286d0f0 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.327+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348286d0f0 0x56348286f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0aaff5700 10 client.16212 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348286d0f0 0x56348286f500 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41dfa88afde72359 server_cookie=62f6996ccbcc8c9e in_seq=0 out_seq=0 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0aaff5700 1 -- 172.21.15.35:0/790836654 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563482774600 con 0x56348286d0f0 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0aaff5700 10 client.16212 handle_command_reply: tid=0 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 client.16212 shutdown 2023-03-17T09:17:15.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 msgr2=0x56348285c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x56348285c740 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009520 tx=0x7fd0bc098080 comp rx=0 tx=0).stop 2023-03-17T09:17:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 shutdown_connections 2023-03-17T09:17:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348286d0f0 0x56348286f500 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x56348285cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348285f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0aaff5700 0 client.16212 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/790836654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x56348285c740 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 >> 172.21.15.35:0/790836654 conn(0x5634826b06b0 msgr2=0x563482852410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 shutdown_connections 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.328+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/790836654 wait complete. 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.329+0000 7fd0d98a6b80 20 client.16212 trim_cache size 0 max 16384 2023-03-17T09:17:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 Processor -- start 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 -- start start 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348284dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482858be0 0x563482863f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 0x56348285eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348284fc50 con 0x5634828594f0 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563482774600 con 0x563482853960 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563482768390 con 0x563482858be0 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 0x56348285eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 0x56348285eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44278/0 (socket says 172.21.15.35:44278) 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c6ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348284dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c77fe700 1 -- 172.21.15.35:0/4233303171 learned_addr learned my addr 172.21.15.35:0/4233303171 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482858be0 0x563482863f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:16.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c77fe700 1 -- 172.21.15.35:0/4233303171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482858be0 msgr2=0x563482863f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:16.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.344+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482858be0 0x563482863f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0c77fe700 1 -- 172.21.15.35:0/4233303171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 msgr2=0x56348284dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348284dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0c77fe700 1 -- 172.21.15.35:0/4233303171 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563482854000 con 0x5634828594f0 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348284dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 0x56348285eff0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000b0a0 tx=0x7fd0c00093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f4f80993bee432 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0adffb700 1 -- 172.21.15.35:0/4233303171 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000e040 con 0x5634828594f0 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0adffb700 1 -- 172.21.15.35:0/4233303171 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0c0020070 con 0x5634828594f0 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.345+0000 7fd0adffb700 1 -- 172.21.15.35:0/4233303171 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0004da0 con 0x5634828594f0 2023-03-17T09:17:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/4233303171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 msgr2=0x56348285eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 0x56348285eff0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000b0a0 tx=0x7fd0c00093f0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/4233303171 shutdown_connections 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634828594f0 0x56348285eff0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x56348284dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/4233303171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563482858be0 0x563482863f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/4233303171 >> 172.21.15.35:0/4233303171 conn(0x5634826b06b0 msgr2=0x563482852a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/4233303171 shutdown_connections 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/4233303171 wait complete. 2023-03-17T09:17:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 -- start start 2023-03-17T09:17:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 Processor -- start 2023-03-17T09:17:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x563482862120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.346+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482862660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0d98a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x5634828b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634828ba4e0 con 0x563482858be0 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634828ba650 con 0x563482853960 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0d98a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634828ba810 con 0x5634828594f0 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0d98a6b80 10 client.0 _ll_register_callbacks cb 0x56348264b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482862660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482862660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44282/0 (socket says 172.21.15.35:44282) 2023-03-17T09:17:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 -- 172.21.15.35:0/2541490183 learned_addr learned my addr 172.21.15.35:0/2541490183 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c77fe700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x5634828b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x563482862120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 -- 172.21.15.35:0/2541490183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 msgr2=0x5634828b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x5634828b9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 -- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 msgr2=0x563482862120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x563482862120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 -- 172.21.15.35:0/2541490183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634826275d0 con 0x563482858be0 2023-03-17T09:17:21.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0c67fc700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482862660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc000c00 tx=0x7fd0bc0ca8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e5f603755e37dc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0aaff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:17:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0aaff5700 1 -- 172.21.15.35:0/2541490183 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc009e10 con 0x563482858be0 2023-03-17T09:17:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634828231e0 con 0x563482858be0 2023-03-17T09:17:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.347+0000 7fd0aaff5700 1 -- 172.21.15.35:0/2541490183 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd0bc0a0600 con 0x563482858be0 2023-03-17T09:17:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0aaff5700 1 -- 172.21.15.35:0/2541490183 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0bc0a0380 con 0x563482858be0 2023-03-17T09:17:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 10 client.16218 fetch_fsmap learned FSMap version 29 2023-03-17T09:17:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fd0c810d8f0 con 0x563482858be0 2023-03-17T09:17:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0aaff5700 1 -- 172.21.15.35:0/2541490183 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634828231e0 con 0x563482858be0 2023-03-17T09:17:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0aaff5700 1 -- 172.21.15.35:0/2541490183 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0bc098670 con 0x563482858be0 2023-03-17T09:17:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 10 client.16218 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:17:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 10 client.16218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:17:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 20 client.16218 populate_metadata read hostname 'smithi035' 2023-03-17T09:17:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634828c1c20 0x5634828c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 4 client.16218 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:17:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563482629f00 con 0x5634828c1c20 2023-03-17T09:17:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.348+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634828c1c20 0x5634828c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.349+0000 7fd0c6ffd700 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634828c1c20 0x5634828c4030 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16116c11cb56cb7e server_cookie=2b3e985c080fce40 in_seq=0 out_seq=0 2023-03-17T09:17:24.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.349+0000 7fd0aaff5700 10 client.16218 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0aaff5700 1 -- 172.21.15.35:0/2541490183 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563482629f00 con 0x5634828c1c20 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0aaff5700 10 client.16218 handle_command_reply: tid=0 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 client.16218 shutdown 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 msgr2=0x563482862660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482862660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc000c00 tx=0x7fd0bc0ca8d0 comp rx=0 tx=0).stop 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 shutdown_connections 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634828c1c20 0x5634828c4030 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634828594f0 0x5634828b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563482853960 0x563482862120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0aaff5700 0 client.16218 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 --2- 172.21.15.35:0/2541490183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563482858be0 0x563482862660 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 >> 172.21.15.35:0/2541490183 conn(0x5634826b06b0 msgr2=0x56348285bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 shutdown_connections 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 1 -- 172.21.15.35:0/2541490183 wait complete. 2023-03-17T09:17:28.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.353+0000 7fd0d98a6b80 20 client.16218 trim_cache size 0 max 16384 2023-03-17T09:17:28.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:04 smithi035 ceph-mon[92535]: pgmap v689: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:17:28.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:06 smithi035 ceph-mon[92535]: pgmap v690: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:17:28.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:08 smithi035 ceph-mon[92535]: pgmap v691: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:09 smithi035 ceph-mon[92535]: osdmap e118: 12 total, 12 up, 12 in 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:10 smithi035 ceph-mon[92535]: pgmap v693: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:12 smithi035 ceph-mon[92535]: pgmap v694: 97 pgs: 97 active+clean; 1.4 MiB data, 141 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:14 smithi035 ceph-mon[92535]: pgmap v695: 97 pgs: 97 active+clean; 1.4 MiB data, 145 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:16 smithi035 ceph-mon[92535]: osdmap e119: 12 total, 12 up, 12 in 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:16 smithi035 ceph-mon[92535]: pgmap v697: 97 pgs: 97 active+clean; 1.4 MiB data, 145 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:18 smithi035 ceph-mon[92535]: pgmap v698: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:17:28.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:20 smithi035 ceph-mon[92535]: pgmap v699: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:17:28.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:22 smithi035 ceph-mon[92535]: pgmap v700: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:17:28.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:24 smithi035 ceph-mon[92535]: pgmap v701: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:17:28.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:26 smithi035 ceph-mon[92535]: pgmap v702: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:17:28.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:28 smithi035 ceph-mon[92535]: pgmap v703: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:17:28.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:30 smithi035 ceph-mon[92535]: pgmap v704: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:32 smithi035 ceph-mon[92535]: pgmap v705: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:34 smithi035 ceph-mon[92535]: pgmap v706: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:36 smithi035 ceph-mon[92535]: pgmap v707: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:38 smithi035 ceph-mon[92535]: pgmap v708: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:40 smithi035 ceph-mon[92535]: pgmap v709: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:42 smithi035 ceph-mon[92535]: pgmap v710: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:44 smithi035 ceph-mon[92535]: pgmap v711: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:17:30.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:46 smithi035 ceph-mon[92535]: pgmap v712: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:48 smithi035 ceph-mon[92535]: pgmap v713: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:17:30.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:50 smithi035 ceph-mon[92535]: pgmap v714: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:17:30.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:52 smithi035 ceph-mon[92535]: pgmap v715: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:17:30.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:17:30.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:53 smithi035 ceph-mon[92535]: pgmap v716: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:56 smithi035 ceph-mon[92535]: pgmap v717: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:17:30.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:08:58 smithi035 ceph-mon[92535]: pgmap v718: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:00 smithi035 ceph-mon[92535]: pgmap v719: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:02 smithi035 ceph-mon[92535]: pgmap v720: 97 pgs: 97 active+clean; 1.4 MiB data, 146 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:04 smithi035 ceph-mon[92535]: pgmap v721: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:04 smithi035 ceph-mon[92535]: osdmap e120: 12 total, 12 up, 12 in 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:06 smithi035 ceph-mon[92535]: pgmap v723: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:17:30.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:08 smithi035 ceph-mon[92535]: pgmap v724: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:17:32.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:10 smithi035 ceph-mon[92535]: pgmap v725: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:17:33.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:10 smithi035 ceph-mon[92535]: osdmap e121: 12 total, 12 up, 12 in 2023-03-17T09:17:33.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:12 smithi035 ceph-mon[92535]: pgmap v727: 97 pgs: 97 active+clean; 1.4 MiB data, 147 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:17:33.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:14 smithi035 ceph-mon[92535]: pgmap v728: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 414 B/s wr, 9 op/s 2023-03-17T09:17:33.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:15 smithi035 ceph-mon[92535]: daemon mds.e restarted 2023-03-17T09:17:33.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:15 smithi035 ceph-mon[92535]: osdmap e122: 12 total, 12 up, 12 in 2023-03-17T09:17:33.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6834/792828454,v1:172.21.15.78:6835/792828454] up:boot 2023-03-17T09:17:33.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:17:35.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:17:35.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:16 smithi035 ceph-mon[92535]: pgmap v730: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:17:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:17:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:17:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:17:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:17:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:17:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:17:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:17:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:17:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:17:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:17:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd0b009f640 msgr2=0x7fd0b00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd0b009f640 0x7fd0b00a1af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009cb0 tx=0x7fd0b8009260 comp rx=0 tx=0).stop 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 msgr2=0x7fd0c8196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 0x7fd0c8196850 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00d950 tx=0x7fd0bc00dd10 comp rx=0 tx=0).stop 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 shutdown_connections 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd0b009f640 0x7fd0b00a1af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0c810a7d0 0x7fd0c819acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0c8101490 0x7fd0c8196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 --2- 172.21.15.35:0/282871308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd0c8101da0 0x7fd0c8196850 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 >> 172.21.15.35:0/282871308 conn(0x7fd0c8075f60 msgr2=0x7fd0c810b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 shutdown_connections 2023-03-17T09:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:35.354+0000 7fd0cd719700 1 -- 172.21.15.35:0/282871308 wait complete. 2023-03-17T09:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 -- 172.21.15.35:0/2422010155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ff350 msgr2=0x7fedc80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/2422010155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ff350 0x7fedc80ff720 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fedc40099c0 tx=0x7fedc4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:17:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 -- 172.21.15.35:0/2422010155 shutdown_connections 2023-03-17T09:17:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/2422010155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedc8104390 0x7fedc810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/2422010155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ff350 0x7fedc80ff720 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/2422010155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ffcf0 0x7fedc8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 -- 172.21.15.35:0/2422010155 >> 172.21.15.35:0/2422010155 conn(0x7fedc8076330 msgr2=0x7fedc8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 -- 172.21.15.35:0/2422010155 shutdown_connections 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.477+0000 7fedcfdd6700 1 -- 172.21.15.35:0/2422010155 wait complete. 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.478+0000 7fedcfdd6700 1 Processor -- start 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.478+0000 7fedcfdd6700 1 -- start start 2023-03-17T09:17:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.478+0000 7fedcfdd6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ff350 0x7fedc8195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcfdd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 0x7fedc81956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcfdd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedc8104390 0x7fedc8199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcfdd6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc819a160 con 0x7fedc80ffcf0 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcfdd6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc819a2d0 con 0x7fedc80ff350 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcfdd6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc819a490 con 0x7fedc8104390 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 0x7fedc81956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 0x7fedc81956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44296/0 (socket says 172.21.15.35:44296) 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcdb72700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ff350 0x7fedc8195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 -- 172.21.15.35:0/4235619751 learned_addr learned my addr 172.21.15.35:0/4235619751 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedce373700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedc8104390 0x7fedc8199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 -- 172.21.15.35:0/4235619751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedc8104390 msgr2=0x7fedc8199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedc8104390 0x7fedc8199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 -- 172.21.15.35:0/4235619751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ff350 msgr2=0x7fedc8195180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ff350 0x7fedc8195180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 -- 172.21.15.35:0/4235619751 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40095f0 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcdb72700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ff350 0x7fedc8195180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedcd371700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 0x7fedc81956c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fedb800d950 tx=0x7fedb800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.479+0000 7fedbeffd700 1 -- 172.21.15.35:0/4235619751 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800f890 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.480+0000 7fedbeffd700 1 -- 172.21.15.35:0/4235619751 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb800fe80 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.480+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc810f000 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.480+0000 7fedbeffd700 1 -- 172.21.15.35:0/4235619751 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800e3b0 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.480+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc810ee70 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.482+0000 7fedbeffd700 1 -- 172.21.15.35:0/4235619751 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fedb800f9f0 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.482+0000 7fedbeffd700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fedb409f640 0x7fedb40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.483+0000 7fedcdb72700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fedb409f640 0x7fedb40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.483+0000 7fedbeffd700 1 -- 172.21.15.35:0/4235619751 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fedb80ca100 con 0x7fedc80ffcf0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.483+0000 7fedcdb72700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fedb409f640 0x7fedb40a1af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b580 tx=0x7fedc4009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:40.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.483+0000 7feddbf63b80 1 Processor -- start 2023-03-17T09:17:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 -- start start 2023-03-17T09:17:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x562693736fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693735890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x562693745ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269363c010 con 0x562693735dd0 2023-03-17T09:17:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269368e950 con 0x562693736c10 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7feddbf63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562693687de0 con 0x562693735420 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x562693745ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x562693745ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44306/0 (socket says 172.21.15.35:44306) 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 -- 172.21.15.35:0/3747235652 learned_addr learned my addr 172.21.15.35:0/3747235652 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedcdb72700 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x562693736fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedcd371700 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693735890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 -- 172.21.15.35:0/3747235652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 msgr2=0x562693735890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693735890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 -- 172.21.15.35:0/3747235652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 msgr2=0x562693736fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x562693736fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 -- 172.21.15.35:0/3747235652 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626935095d0 con 0x562693735dd0 2023-03-17T09:17:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.484+0000 7fedce373700 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x562693745ab0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fedc000a730 tx=0x7fedc00078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eafd1ef97424992 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.485+0000 7fedb3fff700 1 -- 172.21.15.35:0/3747235652 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0018070 con 0x562693735dd0 2023-03-17T09:17:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.485+0000 7fedb3fff700 1 -- 172.21.15.35:0/3747235652 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc0010040 con 0x562693735dd0 2023-03-17T09:17:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.485+0000 7fedb3fff700 1 -- 172.21.15.35:0/3747235652 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000f050 con 0x562693735dd0 2023-03-17T09:17:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 -- 172.21.15.35:0/3747235652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 msgr2=0x562693745ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x562693745ab0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fedc000a730 tx=0x7fedc00078d0 comp rx=0 tx=0).stop 2023-03-17T09:17:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 -- 172.21.15.35:0/3747235652 shutdown_connections 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x562693745ab0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x562693736fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 --2- 172.21.15.35:0/3747235652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693735890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 -- 172.21.15.35:0/3747235652 >> 172.21.15.35:0/3747235652 conn(0x5626935926b0 msgr2=0x56269372fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 -- 172.21.15.35:0/3747235652 shutdown_connections 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 -- 172.21.15.35:0/3747235652 wait complete. 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 -- start start 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.486+0000 7feddbf63b80 1 Processor -- start 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 0x5626937459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735dd0 0x562693742c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x5626937432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269350b8c0 con 0x562693735420 2023-03-17T09:17:46.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562693743a00 con 0x562693736c10 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56269374f3f0 con 0x562693735dd0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7feddbf63b80 10 client.0 _ll_register_callbacks cb 0x56269352d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 0x5626937459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 0x5626937459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44308/0 (socket says 172.21.15.35:44308) 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 -- 172.21.15.35:0/2320335148 learned_addr learned my addr 172.21.15.35:0/2320335148 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcd371700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735dd0 0x562693742c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedce373700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x5626937432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 -- 172.21.15.35:0/2320335148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735dd0 msgr2=0x562693742c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735dd0 0x562693742c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 -- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 msgr2=0x5626937432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x5626937432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedcdb72700 1 -- 172.21.15.35:0/2320335148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc000a410 con 0x562693735420 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.487+0000 7fedce373700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x5626937432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedcdb72700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 0x5626937459c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fedc4015000 tx=0x7fedc401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3961327153239db server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:17:46.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedb17fa700 1 -- 172.21.15.35:0/2320335148 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc402b070 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedb17fa700 1 -- 172.21.15.35:0/2320335148 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fedc400fc80 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56269364a390 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedb17fa700 1 -- 172.21.15.35:0/2320335148 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedc400fe40 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7feddbf63b80 10 client.16230 fetch_fsmap learned FSMap version 29 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5626934b5d80 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedb17fa700 1 -- 172.21.15.35:0/2320335148 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc403f020 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.488+0000 7fedb17fa700 1 -- 172.21.15.35:0/2320335148 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fedc4005280 con 0x562693735420 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7feddbf63b80 10 client.16230 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7feddbf63b80 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7feddbf63b80 20 client.16230 populate_metadata read hostname 'smithi035' 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562693753460 0x562693755870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7feddbf63b80 4 client.16230 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:17:46.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562693656600 con 0x562693753460 2023-03-17T09:17:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7fedcd371700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562693753460 0x562693755870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7fedcd371700 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562693753460 0x562693755870 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=141b6584d4debdb9 server_cookie=6195a2fb47a939e5 in_seq=0 out_seq=0 2023-03-17T09:17:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.489+0000 7fedb17fa700 10 client.16230 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:17:47.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7fedb17fa700 1 -- 172.21.15.35:0/2320335148 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562693656600 con 0x562693753460 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7fedb17fa700 10 client.16230 handle_command_reply: tid=0 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 client.16230 shutdown 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 msgr2=0x5626937459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 0x5626937459c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fedc4015000 tx=0x7fedc401a050 comp rx=0 tx=0).stop 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 shutdown_connections 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562693753460 0x562693755870 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693736c10 0x5626937432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735420 0x5626937459c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2320335148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735dd0 0x562693742c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7fedb17fa700 0 client.16230 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 >> 172.21.15.35:0/2320335148 conn(0x5626935926b0 msgr2=0x562693734410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 shutdown_connections 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 1 -- 172.21.15.35:0/2320335148 wait complete. 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.490+0000 7feddbf63b80 20 client.16230 trim_cache size 0 max 16384 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.505+0000 7feddbf63b80 1 Processor -- start 2023-03-17T09:17:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.505+0000 7feddbf63b80 1 -- start start 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693745560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735dd0 0x562693742420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 0x562693742960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7feddbf63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562693744220 con 0x562693736c10 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7feddbf63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626937306c0 con 0x562693735dd0 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7feddbf63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562693730cc0 con 0x562693735420 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 0x562693742960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 0x562693742960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44320/0 (socket says 172.21.15.35:44320) 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 -- 172.21.15.35:0/1799986740 learned_addr learned my addr 172.21.15.35:0/1799986740 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedcdb72700 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693745560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedcd371700 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735dd0 0x562693742420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 -- 172.21.15.35:0/1799986740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 msgr2=0x562693745560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693745560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 -- 172.21.15.35:0/1799986740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735dd0 msgr2=0x562693742420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735dd0 0x562693742420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 -- 172.21.15.35:0/1799986740 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56269364e130 con 0x562693736c10 2023-03-17T09:17:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedce373700 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 0x562693742960 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fedc000a700 tx=0x7fedc0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf90c522f4bcb6ce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.506+0000 7fedbcff9700 1 -- 172.21.15.35:0/1799986740 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0018040 con 0x562693736c10 2023-03-17T09:17:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7fedbcff9700 1 -- 172.21.15.35:0/1799986740 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc0003e90 con 0x562693736c10 2023-03-17T09:17:52.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7fedbcff9700 1 -- 172.21.15.35:0/1799986740 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc00045b0 con 0x562693736c10 2023-03-17T09:17:52.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 -- 172.21.15.35:0/1799986740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 msgr2=0x562693742960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:17:52.671 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:18 smithi035 ceph-mon[92535]: pgmap v731: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:17:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 0x562693742960 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fedc000a700 tx=0x7fedc0007700 comp rx=0 tx=0).stop 2023-03-17T09:17:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 -- 172.21.15.35:0/1799986740 shutdown_connections 2023-03-17T09:17:55.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693736c10 0x562693742960 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:56.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693735420 0x562693745560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 --2- 172.21.15.35:0/1799986740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735dd0 0x562693742420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 -- 172.21.15.35:0/1799986740 >> 172.21.15.35:0/1799986740 conn(0x5626935926b0 msgr2=0x56269373dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 -- 172.21.15.35:0/1799986740 shutdown_connections 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 -- 172.21.15.35:0/1799986740 wait complete. 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.507+0000 7feddbf63b80 1 -- start start 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 Processor -- start 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735420 0x562693749d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x56269374a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693736c10 0x5626937482a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626937489b0 con 0x562693735dd0 2023-03-17T09:17:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562693748b20 con 0x562693735420 2023-03-17T09:17:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562693748ce0 con 0x562693736c10 2023-03-17T09:17:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7feddbf63b80 10 client.0 _ll_register_callbacks cb 0x56269352d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:17:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7fedcd371700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x56269374a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:56.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7fedcd371700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x56269374a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44324/0 (socket says 172.21.15.35:44324) 2023-03-17T09:17:56.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.508+0000 7fedcd371700 1 -- 172.21.15.35:0/2915577429 learned_addr learned my addr 172.21.15.35:0/2915577429 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:17:56.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedce373700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693736c10 0x5626937482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:56.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcdb72700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735420 0x562693749d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcd371700 1 -- 172.21.15.35:0/2915577429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693736c10 msgr2=0x5626937482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcd371700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693736c10 0x5626937482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcd371700 1 -- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735420 msgr2=0x562693749d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcd371700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735420 0x562693749d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcd371700 1 -- 172.21.15.35:0/2915577429 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626935095d0 con 0x562693735dd0 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedce373700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693736c10 0x5626937482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedcd371700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x56269374a2d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fedb80978b0 tx=0x7fedb800d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d24ebf1b17252d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:17:56.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedb17fa700 1 -- 172.21.15.35:0/2915577429 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80b1070 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedb17fa700 1 -- 172.21.15.35:0/2915577429 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fedb8095f50 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626937051e0 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedb17fa700 1 -- 172.21.15.35:0/2915577429 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb80106d0 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7feddbf63b80 10 client.16236 fetch_fsmap learned FSMap version 29 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5626934dc1f0 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.509+0000 7fedb17fa700 1 -- 172.21.15.35:0/2915577429 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626937051e0 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7fedb17fa700 1 -- 172.21.15.35:0/2915577429 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fedb80b4030 con 0x562693735dd0 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7feddbf63b80 10 client.16236 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7feddbf63b80 10 client.16236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:17:56.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7feddbf63b80 20 client.16236 populate_metadata read hostname 'smithi035' 2023-03-17T09:17:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626937a8410 0x5626937aa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:17:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7feddbf63b80 4 client.16236 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:18:04.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56269350bf00 con 0x5626937a8410 2023-03-17T09:18:04.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7fedcdb72700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626937a8410 0x5626937aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:04.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7fedb17fa700 10 client.16236 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:04.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.510+0000 7fedcdb72700 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626937a8410 0x5626937aa820 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea2e7f837cb9869 server_cookie=de4c3ccec52af559 in_seq=0 out_seq=0 2023-03-17T09:18:04.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.514+0000 7fedb17fa700 1 -- 172.21.15.35:0/2915577429 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56269350bf00 con 0x5626937a8410 2023-03-17T09:18:04.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.514+0000 7fedb17fa700 10 client.16236 handle_command_reply: tid=0 2023-03-17T09:18:04.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.514+0000 7feddbf63b80 1 client.16236 shutdown 2023-03-17T09:18:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.514+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 msgr2=0x56269374a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.514+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x56269374a2d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fedb80978b0 tx=0x7fedb800d8d0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.514+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 shutdown_connections 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626937a8410 0x5626937aa820 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562693736c10 0x5626937482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562693735420 0x562693749d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedb17fa700 0 client.16236 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 --2- 172.21.15.35:0/2915577429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562693735dd0 0x56269374a2d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 >> 172.21.15.35:0/2915577429 conn(0x5626935926b0 msgr2=0x562693734410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 shutdown_connections 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 1 -- 172.21.15.35:0/2915577429 wait complete. 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7feddbf63b80 20 client.16236 trim_cache size 0 max 16384 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fedb409f640 msgr2=0x7fedb40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fedb409f640 0x7fedb40a1af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fedc400b580 tx=0x7fedc4009f10 comp rx=0 tx=0).stop 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 msgr2=0x7fedc81956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 0x7fedc81956c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fedb800d950 tx=0x7fedb800dc60 comp rx=0 tx=0).stop 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 shutdown_connections 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fedb409f640 0x7fedb40a1af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedc8104390 0x7fedc8199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc80ff350 0x7fedc8195180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 --2- 172.21.15.35:0/4235619751 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fedc80ffcf0 0x7fedc81956c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 >> 172.21.15.35:0/4235619751 conn(0x7fedc8076330 msgr2=0x7fedc80fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 shutdown_connections 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:02:48.515+0000 7fedcfdd6700 1 -- 172.21.15.35:0/4235619751 wait complete. 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 -- 172.21.15.35:0/2219895092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19380ff360 msgr2=0x7f19380ff730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 --2- 172.21.15.35:0/2219895092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19380ff360 0x7f19380ff730 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f192c0099c0 tx=0x7f192c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:18:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 -- 172.21.15.35:0/2219895092 shutdown_connections 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 --2- 172.21.15.35:0/2219895092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19381043a0 0x7f193810bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 --2- 172.21.15.35:0/2219895092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19380ff360 0x7f19380ff730 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 --2- 172.21.15.35:0/2219895092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ffd00 0x7f1938103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 -- 172.21.15.35:0/2219895092 >> 172.21.15.35:0/2219895092 conn(0x7f19380761c0 msgr2=0x7f19380765c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 -- 172.21.15.35:0/2219895092 shutdown_connections 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.637+0000 7f193d692700 1 -- 172.21.15.35:0/2219895092 wait complete. 2023-03-17T09:18:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 Processor -- start 2023-03-17T09:18:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 -- start start 2023-03-17T09:18:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ff360 0x7f1938100d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19380ffd00 0x7f19381012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 0x7f19381a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1938101ad0 con 0x7f19381043a0 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19381a4990 con 0x7f19380ffd00 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f193d692700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19381a4ad0 con 0x7f19380ff360 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 0x7f19381a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 0x7f19381a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44340/0 (socket says 172.21.15.35:44340) 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f19377fe700 1 -- 172.21.15.35:0/1446930907 learned_addr learned my addr 172.21.15.35:0/1446930907 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.638+0000 7f19367fc700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19380ffd00 0x7f19381012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f1936ffd700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ff360 0x7f1938100d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f19377fe700 1 -- 172.21.15.35:0/1446930907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ff360 msgr2=0x7f1938100d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f19377fe700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ff360 0x7f1938100d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f19377fe700 1 -- 172.21.15.35:0/1446930907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19380ffd00 msgr2=0x7f19381012a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f19377fe700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19380ffd00 0x7f19381012a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f19377fe700 1 -- 172.21.15.35:0/1446930907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0095f0 con 0x7f19381043a0 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f1936ffd700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ff360 0x7f1938100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f19377fe700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 0x7f19381a4450 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f193000ada0 tx=0x7f193000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f191ffff700 1 -- 172.21.15.35:0/1446930907 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193000f070 con 0x7f19381043a0 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f191ffff700 1 -- 172.21.15.35:0/1446930907 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1930007b30 con 0x7f19381043a0 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f191ffff700 1 -- 172.21.15.35:0/1446930907 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930005280 con 0x7f19381043a0 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193810f010 con 0x7f19381043a0 2023-03-17T09:18:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.639+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193810ee80 con 0x7f19381043a0 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.641+0000 7f191ffff700 1 -- 172.21.15.35:0/1446930907 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f193000c980 con 0x7f19381043a0 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.642+0000 7f191ffff700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f192009f640 0x7f19200a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.642+0000 7f191ffff700 1 -- 172.21.15.35:0/1446930907 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f19300c9cc0 con 0x7f19381043a0 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.642+0000 7f1936ffd700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f192009f640 0x7f19200a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f1936ffd700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f192009f640 0x7f19200a1af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f192c000c00 tx=0x7f192c005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 Processor -- start 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 -- start start 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:13.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430d7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d642fde010 con 0x55d6430d7960 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d643030950 con 0x55d6430dd4f0 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.643+0000 7f194981fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d643029de0 con 0x55d6430dcbe0 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44348/0 (socket says 172.21.15.35:44348) 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 -- 172.21.15.35:0/1921213582 learned_addr learned my addr 172.21.15.35:0/1921213582 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f1936ffd700 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19367fc700 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 -- 172.21.15.35:0/1921213582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 msgr2=0x55d6430dcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430dcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 -- 172.21.15.35:0/1921213582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 msgr2=0x55d6430d7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430d7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 -- 172.21.15.35:0/1921213582 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d642eab5d0 con 0x55d6430d7960 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19367fc700 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430d7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:18:13.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f19377fe700 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d7d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1930097500 tx=0x7f1930097340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271b581ecbffbfba server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f191d7fa700 1 -- 172.21.15.35:0/1921213582 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300192b0 con 0x55d6430d7960 2023-03-17T09:18:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f191d7fa700 1 -- 172.21.15.35:0/1921213582 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1930097800 con 0x55d6430d7960 2023-03-17T09:18:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.644+0000 7f191d7fa700 1 -- 172.21.15.35:0/1921213582 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300940f0 con 0x55d6430d7960 2023-03-17T09:18:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 -- 172.21.15.35:0/1921213582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 msgr2=0x55d6430d7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d7d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1930097500 tx=0x7f1930097340 comp rx=0 tx=0).stop 2023-03-17T09:18:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 -- 172.21.15.35:0/1921213582 shutdown_connections 2023-03-17T09:18:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d7d90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430dcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 --2- 172.21.15.35:0/1921213582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430d7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 -- 172.21.15.35:0/1921213582 >> 172.21.15.35:0/1921213582 conn(0x55d642f346b0 msgr2=0x55d6430d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 -- 172.21.15.35:0/1921213582 shutdown_connections 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 -- 172.21.15.35:0/1921213582 wait complete. 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 -- start start 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.645+0000 7f194981fb80 1 Processor -- start 2023-03-17T09:18:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430d7960 0x55d6430e3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d6430e0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d642ead8c0 con 0x55d6430dd4f0 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6430e14e0 con 0x55d6430d7960 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6430ed030 con 0x55d6430dcbe0 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f194981fb80 10 client.0 _ll_register_callbacks cb 0x55d642ecf230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d6430e0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d6430e0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44354/0 (socket says 172.21.15.35:44354) 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 -- 172.21.15.35:0/737331288 learned_addr learned my addr 172.21.15.35:0/737331288 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f1936ffd700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430d7960 0x55d6430e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19367fc700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 -- 172.21.15.35:0/737331288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 msgr2=0x55d6430e06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:19.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:19.802 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:20 smithi035 ceph-mon[92535]: pgmap v732: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 565 B/s wr, 10 op/s 2023-03-17T09:18:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 -- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430d7960 msgr2=0x55d6430e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430d7960 0x55d6430e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 -- 172.21.15.35:0/737331288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193810ee80 con 0x55d6430dd4f0 2023-03-17T09:18:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19367fc700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:18:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f19377fe700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d6430e0d70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f19300c7a50 tx=0x7f1930097030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f463eb11c878e7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.646+0000 7f191aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:18:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f191aff5700 1 -- 172.21.15.35:0/737331288 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300192b0 con 0x55d6430dd4f0 2023-03-17T09:18:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d642fec390 con 0x55d6430dd4f0 2023-03-17T09:18:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f191aff5700 1 -- 172.21.15.35:0/737331288 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f193009f960 con 0x55d6430dd4f0 2023-03-17T09:18:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f191aff5700 1 -- 172.21.15.35:0/737331288 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1930097800 con 0x55d6430dd4f0 2023-03-17T09:18:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 10 client.16248 fetch_fsmap learned FSMap version 29 2023-03-17T09:18:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d642e57d80 con 0x55d6430dd4f0 2023-03-17T09:18:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f191aff5700 1 -- 172.21.15.35:0/737331288 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d642fec390 con 0x55d6430dd4f0 2023-03-17T09:18:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f191aff5700 1 -- 172.21.15.35:0/737331288 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f19300c7c30 con 0x55d6430dd4f0 2023-03-17T09:18:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 10 client.16248 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:18:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:18:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 20 client.16248 populate_metadata read hostname 'smithi035' 2023-03-17T09:18:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6430f0c40 0x55d6430f3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 4 client.16248 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:18:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.647+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d642ff8600 con 0x55d6430f0c40 2023-03-17T09:18:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.648+0000 7f1936ffd700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6430f0c40 0x55d6430f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.648+0000 7f191aff5700 10 client.16248 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.648+0000 7f1936ffd700 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6430f0c40 0x55d6430f3050 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb40b708be6e64f server_cookie=b022a824a611c85 in_seq=0 out_seq=0 2023-03-17T09:18:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f191aff5700 1 -- 172.21.15.35:0/737331288 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d642ff8600 con 0x55d6430f0c40 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f191aff5700 10 client.16248 handle_command_reply: tid=0 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 client.16248 shutdown 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 msgr2=0x55d6430e0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d6430e0d70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f19300c7a50 tx=0x7f1930097030 comp rx=0 tx=0).stop 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 shutdown_connections 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6430f0c40 0x55d6430f3050 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d6430e0d70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f191aff5700 0 client.16248 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430d7960 0x55d6430e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 --2- 172.21.15.35:0/737331288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 >> 172.21.15.35:0/737331288 conn(0x55d642f346b0 msgr2=0x55d6430d6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 shutdown_connections 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 1 -- 172.21.15.35:0/737331288 wait complete. 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.649+0000 7f194981fb80 20 client.16248 trim_cache size 0 max 16384 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 Processor -- start 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 -- start start 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430ec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6430e1170 con 0x55d6430d7960 2023-03-17T09:18:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6430cd330 con 0x55d6430dd4f0 2023-03-17T09:18:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f194981fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d642ff8600 con 0x55d6430dcbe0 2023-03-17T09:18:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44358/0 (socket says 172.21.15.35:44358) 2023-03-17T09:18:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 -- 172.21.15.35:0/2457755494 learned_addr learned my addr 172.21.15.35:0/2457755494 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f19367fc700 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f19377fe700 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 -- 172.21.15.35:0/2457755494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 msgr2=0x55d6430e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:30.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 -- 172.21.15.35:0/2457755494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 msgr2=0x55d6430ec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.665+0000 7f1936ffd700 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430ec710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.666+0000 7f1936ffd700 1 -- 172.21.15.35:0/2457755494 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6430d8000 con 0x55d6430d7960 2023-03-17T09:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.666+0000 7f1936ffd700 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d1ac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f192c0098e0 tx=0x7f192c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4351e0a85c902e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.666+0000 7f191dffb700 1 -- 172.21.15.35:0/2457755494 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c034d00 con 0x55d6430d7960 2023-03-17T09:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.666+0000 7f191dffb700 1 -- 172.21.15.35:0/2457755494 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f192c02c040 con 0x55d6430d7960 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.666+0000 7f191dffb700 1 -- 172.21.15.35:0/2457755494 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00bda0 con 0x55d6430d7960 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 -- 172.21.15.35:0/2457755494 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 msgr2=0x55d6430d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d1ac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f192c0098e0 tx=0x7f192c022000 comp rx=0 tx=0).stop 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 -- 172.21.15.35:0/2457755494 shutdown_connections 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dd4f0 0x55d6430ec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430d7960 0x55d6430d1ac0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 --2- 172.21.15.35:0/2457755494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430dcbe0 0x55d6430e7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 -- 172.21.15.35:0/2457755494 >> 172.21.15.35:0/2457755494 conn(0x55d642f346b0 msgr2=0x55d6430d6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 -- 172.21.15.35:0/2457755494 shutdown_connections 2023-03-17T09:18:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 -- 172.21.15.35:0/2457755494 wait complete. 2023-03-17T09:18:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 -- start start 2023-03-17T09:18:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.667+0000 7f194981fb80 1 Processor -- start 2023-03-17T09:18:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430d7960 0x55d643138c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dcbe0 0x55d643139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d643143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6431398d0 con 0x55d6430dd4f0 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d643143ff0 con 0x55d6430dcbe0 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6431441b0 con 0x55d6430d7960 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f194981fb80 10 client.0 _ll_register_callbacks cb 0x55d642ecf230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d643143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f1936ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430d7960 0x55d643138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d643143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44368/0 (socket says 172.21.15.35:44368) 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 -- 172.21.15.35:0/2881941406 learned_addr learned my addr 172.21.15.35:0/2881941406 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19367fc700 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dcbe0 0x55d643139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f1936ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430d7960 0x55d643138c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36130/0 (socket says 172.21.15.35:36130) 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 -- 172.21.15.35:0/2881941406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430d7960 msgr2=0x55d643138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:38.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430d7960 0x55d643138c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 -- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dcbe0 msgr2=0x55d643139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dcbe0 0x55d643139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 -- 172.21.15.35:0/2881941406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193810c7b0 con 0x55d6430dd4f0 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f19377fe700 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d643143ab0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f193000ad70 tx=0x7f1930004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97feb4db462f84c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f191aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.668+0000 7f191aff5700 1 -- 172.21.15.35:0/2881941406 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930097800 con 0x55d6430dd4f0 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f191aff5700 1 -- 172.21.15.35:0/2881941406 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f19300192b0 con 0x55d6430dd4f0 2023-03-17T09:18:38.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6430a71e0 con 0x55d6430dd4f0 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f191aff5700 1 -- 172.21.15.35:0/2881941406 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1930097160 con 0x55d6430dd4f0 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 10 client.16254 fetch_fsmap learned FSMap version 29 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d642e40c00 con 0x55d6430dd4f0 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f191aff5700 1 -- 172.21.15.35:0/2881941406 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6430a71e0 con 0x55d6430dd4f0 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f191aff5700 1 -- 172.21.15.35:0/2881941406 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 29) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1930078d90 con 0x55d6430dd4f0 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 10 client.16254 fetch_fsmap finished waiting for FSMap version 29 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 10 client.16254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 20 client.16254 populate_metadata read hostname 'smithi035' 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d643145410 0x55d6431477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 4 client.16254 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d642eadf00 con 0x55d643145410 2023-03-17T09:18:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.669+0000 7f1936ffd700 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d643145410 0x55d6431477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.670+0000 7f191aff5700 10 client.16254 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:01.670+0000 7f1936ffd700 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d643145410 0x55d6431477f0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61086e54dce6cdb3 server_cookie=6500a2738551bfbc in_seq=0 out_seq=0 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f191aff5700 1 -- 172.21.15.35:0/2881941406 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d642eadf00 con 0x55d643145410 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f191aff5700 10 client.16254 handle_command_reply: tid=0 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 client.16254 shutdown 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 msgr2=0x55d643143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d643143ab0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f193000ad70 tx=0x7f1930004c50 comp rx=0 tx=0).stop 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 shutdown_connections 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d643145410 0x55d6431477f0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6430dd4f0 0x55d643143ab0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6430d7960 0x55d643138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 --2- 172.21.15.35:0/2881941406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6430dcbe0 0x55d643139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 >> 172.21.15.35:0/2881941406 conn(0x55d642f346b0 msgr2=0x55d6430ed420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f191aff5700 0 client.16254 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 shutdown_connections 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.223+0000 7f194981fb80 1 -- 172.21.15.35:0/2881941406 wait complete. 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f194981fb80 20 client.16254 trim_cache size 0 max 16384 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f192009f640 msgr2=0x7f19200a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f192009f640 0x7f19200a1af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f192c000c00 tx=0x7f192c005fb0 comp rx=0 tx=0).stop 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 msgr2=0x7f19381a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:41.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 0x7f19381a4450 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f193000ada0 tx=0x7f193000c330 comp rx=0 tx=0).stop 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 shutdown_connections 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f192009f640 0x7f19200a1af0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f19381043a0 0x7f19381a4450 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19380ff360 0x7f1938100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 --2- 172.21.15.35:0/1446930907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19380ffd00 0x7f19381012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.224+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 >> 172.21.15.35:0/1446930907 conn(0x7f19380761c0 msgr2=0x7f1938068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.225+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 shutdown_connections 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:03.225+0000 7f193d692700 1 -- 172.21.15.35:0/1446930907 wait complete. 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.349+0000 7f958f90a700 1 -- 172.21.15.35:0/3090317146 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9588104390 msgr2=0x7f958810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.349+0000 7f958f90a700 1 --2- 172.21.15.35:0/3090317146 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9588104390 0x7f958810bf60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f958000b0d0 tx=0x7f958000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:18:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 -- 172.21.15.35:0/3090317146 shutdown_connections 2023-03-17T09:18:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 --2- 172.21.15.35:0/3090317146 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9588104390 0x7f958810bf60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 --2- 172.21.15.35:0/3090317146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95880ff350 0x7f95880ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 --2- 172.21.15.35:0/3090317146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95880ffcf0 0x7f9588103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 -- 172.21.15.35:0/3090317146 >> 172.21.15.35:0/3090317146 conn(0x7f9588076330 msgr2=0x7f9588076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 -- 172.21.15.35:0/3090317146 shutdown_connections 2023-03-17T09:18:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 -- 172.21.15.35:0/3090317146 wait complete. 2023-03-17T09:18:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 Processor -- start 2023-03-17T09:18:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.350+0000 7f958f90a700 1 -- start start 2023-03-17T09:18:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958f90a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95880ff350 0x7f95881971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958f90a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 0x7f9588197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958f90a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9588104390 0x7f95881a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958f90a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9588198010 con 0x7f95880ffcf0 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958f90a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95881a2780 con 0x7f95880ff350 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958f90a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95881a28f0 con 0x7f9588104390 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 0x7f9588197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 0x7f9588197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44380/0 (socket says 172.21.15.35:44380) 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 -- 172.21.15.35:0/2645941064 learned_addr learned my addr 172.21.15.35:0/2645941064 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958dea7700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9588104390 0x7f95881a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958d6a6700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95880ff350 0x7f95881971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 -- 172.21.15.35:0/2645941064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9588104390 msgr2=0x7f95881a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9588104390 0x7f95881a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 -- 172.21.15.35:0/2645941064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95880ff350 msgr2=0x7f95881971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95880ff350 0x7f95881971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 -- 172.21.15.35:0/2645941064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580009d00 con 0x7f95880ffcf0 2023-03-17T09:18:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.351+0000 7f958cea5700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 0x7f9588197700 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f957800d950 tx=0x7f957800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.352+0000 7f957e7fc700 1 -- 172.21.15.35:0/2645941064 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578009930 con 0x7f95880ffcf0 2023-03-17T09:18:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.352+0000 7f957e7fc700 1 -- 172.21.15.35:0/2645941064 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9578010460 con 0x7f95880ffcf0 2023-03-17T09:18:45.532 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:22 smithi035 ceph-mon[92535]: pgmap v733: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:18:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.352+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958810f010 con 0x7f95880ffcf0 2023-03-17T09:18:46.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.352+0000 7f957e7fc700 1 -- 172.21.15.35:0/2645941064 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800f620 con 0x7f95880ffcf0 2023-03-17T09:18:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.352+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958810ee80 con 0x7f95880ffcf0 2023-03-17T09:18:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.354+0000 7f957e7fc700 1 -- 172.21.15.35:0/2645941064 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9578009a90 con 0x7f95880ffcf0 2023-03-17T09:18:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.355+0000 7f957e7fc700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f957409f640 0x7f95740a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.355+0000 7f957e7fc700 1 -- 172.21.15.35:0/2645941064 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f95780ca0d0 con 0x7f95880ffcf0 2023-03-17T09:18:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.355+0000 7f958d6a6700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f957409f640 0x7f95740a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f958d6a6700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f957409f640 0x7f95740a1af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9584005fd0 tx=0x7f958400a560 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 Processor -- start 2023-03-17T09:18:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 -- start start 2023-03-17T09:18:47.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d1edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d22c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1c21010 con 0x5641c1d1f330 2023-03-17T09:18:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1c73950 con 0x5641c1d1ea20 2023-03-17T09:18:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f959ba97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1c6cde0 con 0x5641c1d23170 2023-03-17T09:18:48.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f958cea5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d22c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f958cea5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d22c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44388/0 (socket says 172.21.15.35:44388) 2023-03-17T09:18:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f958cea5700 1 -- 172.21.15.35:0/2446392668 learned_addr learned my addr 172.21.15.35:0/2446392668 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.356+0000 7f958d6a6700 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d1edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958dea7700 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958cea5700 1 -- 172.21.15.35:0/2446392668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 msgr2=0x5641c1d235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958cea5700 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d235c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:50.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958cea5700 1 -- 172.21.15.35:0/2446392668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 msgr2=0x5641c1d1edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:50.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958cea5700 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d1edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958cea5700 1 -- 172.21.15.35:0/2446392668 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641c1aee5d0 con 0x5641c1d1f330 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958d6a6700 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d1edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f958cea5700 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d22c30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9578094620 tx=0x7f95780977c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbcfa2762a5e86b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f95737fe700 1 -- 172.21.15.35:0/2446392668 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578097bb0 con 0x5641c1d1f330 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f95737fe700 1 -- 172.21.15.35:0/2446392668 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f957809fda0 con 0x5641c1d1f330 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.357+0000 7f95737fe700 1 -- 172.21.15.35:0/2446392668 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578098010 con 0x5641c1d1f330 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 -- 172.21.15.35:0/2446392668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 msgr2=0x5641c1d22c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d22c30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9578094620 tx=0x7f95780977c0 comp rx=0 tx=0).stop 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 -- 172.21.15.35:0/2446392668 shutdown_connections 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d1edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 --2- 172.21.15.35:0/2446392668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d22c30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 -- 172.21.15.35:0/2446392668 >> 172.21.15.35:0/2446392668 conn(0x5641c1b776b0 msgr2=0x5641c1d14a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 -- 172.21.15.35:0/2446392668 shutdown_connections 2023-03-17T09:18:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 -- 172.21.15.35:0/2446392668 wait complete. 2023-03-17T09:18:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 -- start start 2023-03-17T09:18:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.358+0000 7f959ba97b80 1 Processor -- start 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 0x5641c1d27b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1f330 0x5641c1d280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d28610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1af08c0 con 0x5641c1d1ea20 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d2ad30 con 0x5641c1d1f330 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d343b0 con 0x5641c1d23170 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f959ba97b80 10 client.0 _ll_register_callbacks cb 0x5641c1b12230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 0x5641c1d27b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 0x5641c1d27b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44392/0 (socket says 172.21.15.35:44392) 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 -- 172.21.15.35:0/4066743637 learned_addr learned my addr 172.21.15.35:0/4066743637 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958dea7700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d28610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958cea5700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1f330 0x5641c1d280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 -- 172.21.15.35:0/4066743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 msgr2=0x5641c1d28610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d28610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 -- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1f330 msgr2=0x5641c1d280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1f330 0x5641c1d280d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958d6a6700 1 -- 172.21.15.35:0/4066743637 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958810ee80 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.359+0000 7f958cea5700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1f330 0x5641c1d280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f958d6a6700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 0x5641c1d27b90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9584010760 tx=0x7f9584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c2b306ade4ba55 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f9570ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f9570ff9700 1 -- 172.21.15.35:0/4066743637 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584004a30 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f9570ff9700 1 -- 172.21.15.35:0/4066743637 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f9584004b90 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641c1c2f390 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f9570ff9700 1 -- 172.21.15.35:0/4066743637 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9584004d90 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 10 client.16269 fetch_fsmap learned FSMap version 30 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5641c1a9ad80 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f9570ff9700 1 -- 172.21.15.35:0/4066743637 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5641c1c2f390 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f9570ff9700 1 -- 172.21.15.35:0/4066743637 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9584024030 con 0x5641c1d1ea20 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 10 client.16269 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:18:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:18:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 20 client.16269 populate_metadata read hostname 'smithi035' 2023-03-17T09:18:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d385b0 0x5641c1d3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 4 client.16269 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:18:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.360+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641c1c3b600 con 0x5641c1d385b0 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.361+0000 7f958cea5700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d385b0 0x5641c1d3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.361+0000 7f9570ff9700 10 client.16269 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.361+0000 7f958cea5700 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d385b0 0x5641c1d3a9c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c8fbfe7b0dc2b1 server_cookie=a4da6b41ec083bb8 in_seq=0 out_seq=0 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f9570ff9700 1 -- 172.21.15.35:0/4066743637 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5641c1c3b600 con 0x5641c1d385b0 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f9570ff9700 10 client.16269 handle_command_reply: tid=0 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 client.16269 shutdown 2023-03-17T09:18:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 msgr2=0x5641c1d27b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:18:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 0x5641c1d27b90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9584010760 tx=0x7f9584004750 comp rx=0 tx=0).stop 2023-03-17T09:18:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 shutdown_connections 2023-03-17T09:18:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d385b0 0x5641c1d3a9c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d23170 0x5641c1d28610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:54.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f9570ff9700 0 client.16269 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:18:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1ea20 0x5641c1d27b90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 --2- 172.21.15.35:0/4066743637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1f330 0x5641c1d280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:18:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 >> 172.21.15.35:0/4066743637 conn(0x5641c1b776b0 msgr2=0x5641c1d19410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:18:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 shutdown_connections 2023-03-17T09:18:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 1 -- 172.21.15.35:0/4066743637 wait complete. 2023-03-17T09:18:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.362+0000 7f959ba97b80 20 client.16269 trim_cache size 0 max 16384 2023-03-17T09:18:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 Processor -- start 2023-03-17T09:18:57.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 -- start start 2023-03-17T09:18:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d14ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1f330 0x5641c1d28460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 0x5641c1d21290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:18:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1c2f390 con 0x5641c1d23170 2023-03-17T09:18:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d100f0 con 0x5641c1d1ea20 2023-03-17T09:19:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.377+0000 7f959ba97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d35c30 con 0x5641c1d1f330 2023-03-17T09:19:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 0x5641c1d21290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 0x5641c1d21290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44404/0 (socket says 172.21.15.35:44404) 2023-03-17T09:19:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 -- 172.21.15.35:0/321490792 learned_addr learned my addr 172.21.15.35:0/321490792 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958d6a6700 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d14ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958cea5700 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1f330 0x5641c1d28460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 -- 172.21.15.35:0/321490792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1f330 msgr2=0x5641c1d28460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1f330 0x5641c1d28460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 -- 172.21.15.35:0/321490792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 msgr2=0x5641c1d14ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d14ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 -- 172.21.15.35:0/321490792 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641c1c33130 con 0x5641c1d23170 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958d6a6700 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d14ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f958dea7700 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 0x5641c1d21290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9580009440 tx=0x7f958000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b981d7fd9111f340 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f9573fff700 1 -- 172.21.15.35:0/321490792 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000e030 con 0x5641c1d23170 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f9573fff700 1 -- 172.21.15.35:0/321490792 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9580003e90 con 0x5641c1d23170 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.378+0000 7f9573fff700 1 -- 172.21.15.35:0/321490792 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580005800 con 0x5641c1d23170 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 -- 172.21.15.35:0/321490792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 msgr2=0x5641c1d21290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 0x5641c1d21290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9580009440 tx=0x7f958000b040 comp rx=0 tx=0).stop 2023-03-17T09:19:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 -- 172.21.15.35:0/321490792 shutdown_connections 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d23170 0x5641c1d21290 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d1ea20 0x5641c1d14ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 --2- 172.21.15.35:0/321490792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1f330 0x5641c1d28460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 -- 172.21.15.35:0/321490792 >> 172.21.15.35:0/321490792 conn(0x5641c1b776b0 msgr2=0x5641c1d33a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 -- 172.21.15.35:0/321490792 shutdown_connections 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 -- 172.21.15.35:0/321490792 wait complete. 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 -- start start 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.379+0000 7f959ba97b80 1 Processor -- start 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1ea20 0x5641c1d2ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d2f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d23170 0x5641c1d2d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d2d870 con 0x5641c1d1f330 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d2d9e0 con 0x5641c1d23170 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641c1d2dba0 con 0x5641c1d1ea20 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f959ba97b80 10 client.0 _ll_register_callbacks cb 0x5641c1b12230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f958cea5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d2f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f958cea5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d2f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44408/0 (socket says 172.21.15.35:44408) 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f958cea5700 1 -- 172.21.15.35:0/3589408350 learned_addr learned my addr 172.21.15.35:0/3589408350 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f958d6a6700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1ea20 0x5641c1d2ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.380+0000 7f958dea7700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d23170 0x5641c1d2d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958d6a6700 1 -- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d23170 msgr2=0x5641c1d2d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958d6a6700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d23170 0x5641c1d2d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958d6a6700 1 -- 172.21.15.35:0/3589408350 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 msgr2=0x5641c1d2f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958d6a6700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d2f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:00.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958d6a6700 1 -- 172.21.15.35:0/3589408350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958810c7a0 con 0x5641c1d1ea20 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958dea7700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d23170 0x5641c1d2d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958cea5700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d2f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f958d6a6700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1ea20 0x5641c1d2ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9584005bf0 tx=0x7f958401e930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17c7684469ff8b58 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f9570ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f9570ff9700 1 -- 172.21.15.35:0/3589408350 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584034070 con 0x5641c1d1ea20 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f9570ff9700 1 -- 172.21.15.35:0/3589408350 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f9584010e00 con 0x5641c1d1ea20 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641c1cea1e0 con 0x5641c1d1ea20 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f9570ff9700 1 -- 172.21.15.35:0/3589408350 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f958402f620 con 0x5641c1d1ea20 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f959ba97b80 10 client.25936 fetch_fsmap learned FSMap version 30 2023-03-17T09:19:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5641c1ac11f0 con 0x5641c1d1ea20 2023-03-17T09:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.381+0000 7f9570ff9700 1 -- 172.21.15.35:0/3589408350 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9584046020 con 0x5641c1d1ea20 2023-03-17T09:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f9570ff9700 1 -- 172.21.15.35:0/3589408350 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9584010790 con 0x5641c1d1ea20 2023-03-17T09:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f959ba97b80 10 client.25936 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f959ba97b80 10 client.25936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f959ba97b80 20 client.25936 populate_metadata read hostname 'smithi035' 2023-03-17T09:19:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f959ba97b80 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d8d520 0x5641c1d8f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:02.586 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:24 smithi035 ceph-mon[92535]: pgmap v734: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:19:02.586 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:26 smithi035 ceph-mon[92535]: pgmap v735: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 389 B/s wr, 10 op/s 2023-03-17T09:19:02.586 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:28 smithi035 ceph-mon[92535]: pgmap v736: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:30 smithi035 ceph-mon[92535]: pgmap v737: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:32 smithi035 ceph-mon[92535]: pgmap v738: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:34 smithi035 ceph-mon[92535]: pgmap v739: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:36 smithi035 ceph-mon[92535]: pgmap v740: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:38 smithi035 ceph-mon[92535]: pgmap v741: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:40 smithi035 ceph-mon[92535]: pgmap v742: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:42 smithi035 ceph-mon[92535]: pgmap v743: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:44 smithi035 ceph-mon[92535]: pgmap v744: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:46 smithi035 ceph-mon[92535]: pgmap v745: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:48 smithi035 ceph-mon[92535]: pgmap v746: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:50 smithi035 ceph-mon[92535]: pgmap v747: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:52 smithi035 ceph-mon[92535]: pgmap v748: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:54 smithi035 ceph-mon[92535]: pgmap v749: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:56 smithi035 ceph-mon[92535]: pgmap v750: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:58 smithi035 ceph-mon[92535]: pgmap v751: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:19:02.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:09:59 smithi035 ceph-mon[92535]: pgmap v752: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:01 smithi035 ceph-mon[92535]: pgmap v753: 97 pgs: 97 active+clean; 1.4 MiB data, 148 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:04 smithi035 ceph-mon[92535]: pgmap v754: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:06 smithi035 ceph-mon[92535]: pgmap v755: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:08 smithi035 ceph-mon[92535]: pgmap v756: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:19:02.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:09 smithi035 ceph-mon[92535]: osdmap e123: 12 total, 12 up, 12 in 2023-03-17T09:19:03.570 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:10 smithi035 ceph-mon[92535]: pgmap v758: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:12 smithi035 ceph-mon[92535]: pgmap v759: 97 pgs: 97 active+clean; 1.4 MiB data, 149 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:14 smithi035 ceph-mon[92535]: pgmap v760: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:16 smithi035 ceph-mon[92535]: osdmap e124: 12 total, 12 up, 12 in 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:16 smithi035 ceph-mon[92535]: pgmap v762: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:18 smithi035 ceph-mon[92535]: pgmap v763: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:20 smithi035 ceph-mon[92535]: pgmap v764: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:22 smithi035 ceph-mon[92535]: pgmap v765: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:19:03.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:24 smithi035 ceph-mon[92535]: pgmap v766: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:19:04.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:26 smithi035 ceph-mon[92535]: pgmap v767: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 915 B/s wr, 11 op/s 2023-03-17T09:19:04.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:28 smithi035 ceph-mon[92535]: pgmap v768: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:19:04.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:30 smithi035 ceph-mon[92535]: pgmap v769: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:32 smithi035 ceph-mon[92535]: pgmap v770: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:34 smithi035 ceph-mon[92535]: pgmap v771: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:36 smithi035 ceph-mon[92535]: pgmap v772: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:38 smithi035 ceph-mon[92535]: pgmap v773: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:40 smithi035 ceph-mon[92535]: pgmap v774: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:42 smithi035 ceph-mon[92535]: pgmap v775: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:44 smithi035 ceph-mon[92535]: pgmap v776: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:46 smithi035 ceph-mon[92535]: pgmap v777: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:48 smithi035 ceph-mon[92535]: pgmap v778: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:50 smithi035 ceph-mon[92535]: pgmap v779: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:52 smithi035 ceph-mon[92535]: pgmap v780: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:54 smithi035 ceph-mon[92535]: pgmap v781: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:56 smithi035 ceph-mon[92535]: pgmap v782: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:58 smithi035 ceph-mon[92535]: pgmap v783: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:10:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:00 smithi035 ceph-mon[92535]: pgmap v784: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:04.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:19:04.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:19:04.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:19:04.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:02 smithi035 ceph-mon[92535]: pgmap v785: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:19:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:19:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:19:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:19:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:19:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:19:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:19:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:19:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:19:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:19:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:19:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:19:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:19:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:19:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f959ba97b80 4 client.25936 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:19:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5641c1af0f00 con 0x5641c1d8d520 2023-03-17T09:19:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f958cea5700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d8d520 0x5641c1d8f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f9570ff9700 10 client.25936 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.382+0000 7f958cea5700 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d8d520 0x5641c1d8f930 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7db51794816b979d server_cookie=38767f3f755f0412 in_seq=0 out_seq=0 2023-03-17T09:19:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f9570ff9700 1 -- 172.21.15.35:0/3589408350 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5641c1af0f00 con 0x5641c1d8d520 2023-03-17T09:19:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f9570ff9700 10 client.25936 handle_command_reply: tid=0 2023-03-17T09:19:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f959ba97b80 1 client.25936 shutdown 2023-03-17T09:19:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1ea20 msgr2=0x5641c1d2ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f959ba97b80 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1ea20 0x5641c1d2ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9584005bf0 tx=0x7f958401e930 comp rx=0 tx=0).stop 2023-03-17T09:19:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 shutdown_connections 2023-03-17T09:19:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.389+0000 7f959ba97b80 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5641c1d8d520 0x5641c1d8f930 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5641c1d23170 0x5641c1d2d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f9570ff9700 0 client.25936 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5641c1d1ea20 0x5641c1d2ec40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 1 --2- 172.21.15.35:0/3589408350 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5641c1d1f330 0x5641c1d2f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 >> 172.21.15.35:0/3589408350 conn(0x5641c1b776b0 msgr2=0x5641c1d19410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 shutdown_connections 2023-03-17T09:19:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 1 -- 172.21.15.35:0/3589408350 wait complete. 2023-03-17T09:19:11.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f959ba97b80 20 client.25936 trim_cache size 0 max 16384 2023-03-17T09:19:11.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f957409f640 msgr2=0x7f95740a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f957409f640 0x7f95740a1af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9584005fd0 tx=0x7f958400a560 comp rx=0 tx=0).stop 2023-03-17T09:19:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 msgr2=0x7f9588197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 0x7f9588197700 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f957800d950 tx=0x7f957800dc60 comp rx=0 tx=0).stop 2023-03-17T09:19:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 shutdown_connections 2023-03-17T09:19:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f957409f640 0x7f95740a1af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9588104390 0x7f95881a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95880ff350 0x7f95881971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 --2- 172.21.15.35:0/2645941064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95880ffcf0 0x7f9588197700 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:16.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.390+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 >> 172.21.15.35:0/2645941064 conn(0x7f9588076330 msgr2=0x7f95880fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:18.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.391+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 shutdown_connections 2023-03-17T09:19:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:16.391+0000 7f958f90a700 1 -- 172.21.15.35:0/2645941064 wait complete. 2023-03-17T09:19:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 -- 172.21.15.35:0/4009935111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c0ff3c0 msgr2=0x7fc28c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 --2- 172.21.15.35:0/4009935111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c0ff3c0 0x7fc28c0ff790 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc2880099c0 tx=0x7fc288009cd0 comp rx=0 tx=0).stop 2023-03-17T09:19:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 -- 172.21.15.35:0/4009935111 shutdown_connections 2023-03-17T09:19:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 --2- 172.21.15.35:0/4009935111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c104400 0x7fc28c10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 --2- 172.21.15.35:0/4009935111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c0ff3c0 0x7fc28c0ff790 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 --2- 172.21.15.35:0/4009935111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc28c0ffd60 0x7fc28c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 -- 172.21.15.35:0/4009935111 >> 172.21.15.35:0/4009935111 conn(0x7fc28c076300 msgr2=0x7fc28c076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.512+0000 7fc2946c0700 1 -- 172.21.15.35:0/4009935111 shutdown_connections 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.513+0000 7fc2946c0700 1 -- 172.21.15.35:0/4009935111 wait complete. 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.513+0000 7fc2946c0700 1 Processor -- start 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.513+0000 7fc2946c0700 1 -- start start 2023-03-17T09:19:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc2946c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ff3c0 0x7fc28c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc2946c0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc28c0ffd60 0x7fc28c197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc2946c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 0x7fc28c1a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc2946c0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c197f40 con 0x7fc28c104400 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc2946c0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1a26b0 con 0x7fc28c0ffd60 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc2946c0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1a2820 con 0x7fc28c0ff3c0 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 0x7fc28c1a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 0x7fc28c1a2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44424/0 (socket says 172.21.15.35:44424) 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 -- 172.21.15.35:0/3233917188 learned_addr learned my addr 172.21.15.35:0/3233917188 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc29245c700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ff3c0 0x7fc28c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc291c5b700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc28c0ffd60 0x7fc28c197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 -- 172.21.15.35:0/3233917188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ff3c0 msgr2=0x7fc28c1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ff3c0 0x7fc28c1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 -- 172.21.15.35:0/3233917188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc28c0ffd60 msgr2=0x7fc28c197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc28c0ffd60 0x7fc28c197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.514+0000 7fc292c5d700 1 -- 172.21.15.35:0/3233917188 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880095f0 con 0x7fc28c104400 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.515+0000 7fc292c5d700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 0x7fc28c1a2170 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc284007ee0 tx=0x7fc28400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.515+0000 7fc2837fe700 1 -- 172.21.15.35:0/3233917188 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284017070 con 0x7fc28c104400 2023-03-17T09:19:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.515+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c10f070 con 0x7fc28c104400 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.515+0000 7fc2837fe700 1 -- 172.21.15.35:0/3233917188 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc28400f040 con 0x7fc28c104400 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.515+0000 7fc2837fe700 1 -- 172.21.15.35:0/3233917188 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284005570 con 0x7fc28c104400 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.515+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c10eee0 con 0x7fc28c104400 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.517+0000 7fc2837fe700 1 -- 172.21.15.35:0/3233917188 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc28400db20 con 0x7fc28c104400 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.518+0000 7fc2837fe700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc27809f640 0x7fc2780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.518+0000 7fc2837fe700 1 -- 172.21.15.35:0/3233917188 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc2840c9cf0 con 0x7fc28c104400 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.518+0000 7fc29245c700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc27809f640 0x7fc2780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc29245c700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc27809f640 0x7fc2780a1af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc28800b580 tx=0x7fc288009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 Processor -- start 2023-03-17T09:19:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 -- start start 2023-03-17T09:19:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 0x55d5ab176410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab17cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab073010 con 0x55d5ab176040 2023-03-17T09:19:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab0c5950 con 0x55d5ab1711e0 2023-03-17T09:19:20.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.519+0000 7fc2a084db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab0bede0 con 0x55d5ab170830 2023-03-17T09:19:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 0x55d5ab176410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 0x55d5ab176410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44428/0 (socket says 172.21.15.35:44428) 2023-03-17T09:19:20.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 -- 172.21.15.35:0/1454863531 learned_addr learned my addr 172.21.15.35:0/1454863531 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc291c5b700 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab17cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 -- 172.21.15.35:0/1454863531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 msgr2=0x55d5ab170ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 -- 172.21.15.35:0/1454863531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 msgr2=0x55d5ab17cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab17cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:21.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 -- 172.21.15.35:0/1454863531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5aaf405d0 con 0x55d5ab176040 2023-03-17T09:19:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab17cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:19:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc29245c700 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 0x55d5ab176410 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc288015000 tx=0x7fc288020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b54c290c6363f5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc280ff9700 1 -- 172.21.15.35:0/1454863531 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28800be20 con 0x55d5ab176040 2023-03-17T09:19:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc280ff9700 1 -- 172.21.15.35:0/1454863531 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc28801e040 con 0x55d5ab176040 2023-03-17T09:19:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.520+0000 7fc280ff9700 1 -- 172.21.15.35:0/1454863531 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288003a60 con 0x55d5ab176040 2023-03-17T09:19:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 -- 172.21.15.35:0/1454863531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 msgr2=0x55d5ab176410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 0x55d5ab176410 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc288015000 tx=0x7fc288020000 comp rx=0 tx=0).stop 2023-03-17T09:19:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 -- 172.21.15.35:0/1454863531 shutdown_connections 2023-03-17T09:19:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab17cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab176040 0x55d5ab176410 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1454863531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 -- 172.21.15.35:0/1454863531 >> 172.21.15.35:0/1454863531 conn(0x55d5aafc96b0 msgr2=0x55d5ab166a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 -- 172.21.15.35:0/1454863531 shutdown_connections 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.521+0000 7fc2a084db80 1 -- 172.21.15.35:0/1454863531 wait complete. 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 -- start start 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 Processor -- start 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab179f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab176040 0x55d5ab17a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5aaf428c0 con 0x55d5ab170830 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab17ac30 con 0x55d5ab1711e0 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab17adf0 con 0x55d5ab176040 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc2a084db80 10 client.0 _ll_register_callbacks cb 0x55d5aaf64230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc29245c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:22.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc29245c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44434/0 (socket says 172.21.15.35:44434) 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc29245c700 1 -- 172.21.15.35:0/3296399198 learned_addr learned my addr 172.21.15.35:0/3296399198 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc291c5b700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab179f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.522+0000 7fc292c5d700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab176040 0x55d5ab17a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc29245c700 1 -- 172.21.15.35:0/3296399198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab176040 msgr2=0x55d5ab17a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc29245c700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab176040 0x55d5ab17a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc29245c700 1 -- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 msgr2=0x55d5ab179f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc29245c700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab179f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc29245c700 1 -- 172.21.15.35:0/3296399198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c10c810 con 0x55d5ab170830 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc292c5d700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab176040 0x55d5ab17a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc291c5b700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab179f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc29245c700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17ccb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc288005a60 tx=0x7fc2880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605414cd5ef4954f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc275ffb700 1 -- 172.21.15.35:0/3296399198 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288003f20 con 0x55d5ab170830 2023-03-17T09:19:22.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc275ffb700 1 -- 172.21.15.35:0/3296399198 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc288003ab0 con 0x55d5ab170830 2023-03-17T09:19:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5ab081390 con 0x55d5ab170830 2023-03-17T09:19:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc275ffb700 1 -- 172.21.15.35:0/3296399198 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc288004080 con 0x55d5ab170830 2023-03-17T09:19:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc2a084db80 10 client.16287 fetch_fsmap learned FSMap version 30 2023-03-17T09:19:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d5aaeecd80 con 0x55d5ab170830 2023-03-17T09:19:22.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.523+0000 7fc275ffb700 1 -- 172.21.15.35:0/3296399198 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc288045080 con 0x55d5ab170830 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc275ffb700 1 -- 172.21.15.35:0/3296399198 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc28802f810 con 0x55d5ab170830 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc2a084db80 10 client.16287 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc2a084db80 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc2a084db80 20 client.16287 populate_metadata read hostname 'smithi035' 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc2a084db80 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab18a150 0x55d5ab18c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc2a084db80 4 client.16287 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5ab08d600 con 0x55d5ab18a150 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc291c5b700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab18a150 0x55d5ab18c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc291c5b700 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab18a150 0x55d5ab18c560 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d083a857a6b637 server_cookie=cbb698bf52f5874e in_seq=0 out_seq=0 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.524+0000 7fc275ffb700 10 client.16287 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc275ffb700 1 -- 172.21.15.35:0/3296399198 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d5ab08d600 con 0x55d5ab18a150 2023-03-17T09:19:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc275ffb700 10 client.16287 handle_command_reply: tid=0 2023-03-17T09:19:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 client.16287 shutdown 2023-03-17T09:19:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 msgr2=0x55d5ab17ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:25.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17ccb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc288005a60 tx=0x7fc2880057f0 comp rx=0 tx=0).stop 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 shutdown_connections 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab18a150 0x55d5ab18c560 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab176040 0x55d5ab17a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17ccb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 --2- 172.21.15.35:0/3296399198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab1711e0 0x55d5ab179f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc275ffb700 0 client.16287 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 >> 172.21.15.35:0/3296399198 conn(0x55d5aafc96b0 msgr2=0x55d5ab16b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 shutdown_connections 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 1 -- 172.21.15.35:0/3296399198 wait complete. 2023-03-17T09:19:25.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.525+0000 7fc2a084db80 20 client.16287 trim_cache size 0 max 16384 2023-03-17T09:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.540+0000 7fc2a084db80 1 Processor -- start 2023-03-17T09:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 -- start start 2023-03-17T09:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 0x55d5ab166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1813d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab1687d0 con 0x55d5ab1711e0 2023-03-17T09:19:27.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:04 smithi035 ceph-mon[92535]: pgmap v786: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:19:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab167000 con 0x55d5ab176040 2023-03-17T09:19:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc2a084db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab168c00 con 0x55d5ab170830 2023-03-17T09:19:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 0x55d5ab166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 0x55d5ab166ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44444/0 (socket says 172.21.15.35:44444) 2023-03-17T09:19:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 -- 172.21.15.35:0/1667694115 learned_addr learned my addr 172.21.15.35:0/1667694115 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc29245c700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 -- 172.21.15.35:0/1667694115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 msgr2=0x55d5ab170c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 -- 172.21.15.35:0/1667694115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 msgr2=0x55d5ab1813d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1813d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 -- 172.21.15.35:0/1667694115 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5ab085130 con 0x55d5ab1711e0 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc29245c700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:19:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.541+0000 7fc291c5b700 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 0x55d5ab166ac0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc28c068fc0 tx=0x7fc27c00b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e789f0928414d29 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2817fa700 1 -- 172.21.15.35:0/1667694115 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c017040 con 0x55d5ab1711e0 2023-03-17T09:19:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2817fa700 1 -- 172.21.15.35:0/1667694115 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc27c020070 con 0x55d5ab1711e0 2023-03-17T09:19:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2817fa700 1 -- 172.21.15.35:0/1667694115 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c005280 con 0x55d5ab1711e0 2023-03-17T09:19:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 -- 172.21.15.35:0/1667694115 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 msgr2=0x55d5ab166ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 0x55d5ab166ac0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc28c068fc0 tx=0x7fc27c00b7a0 comp rx=0 tx=0).stop 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 -- 172.21.15.35:0/1667694115 shutdown_connections 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab170830 0x55d5ab170c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1667694115 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab1711e0 0x55d5ab166ac0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 -- 172.21.15.35:0/1667694115 >> 172.21.15.35:0/1667694115 conn(0x55d5aafc96b0 msgr2=0x55d5ab1742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 -- 172.21.15.35:0/1667694115 shutdown_connections 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.542+0000 7fc2a084db80 1 -- 172.21.15.35:0/1667694115 wait complete. 2023-03-17T09:19:30.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 -- start start 2023-03-17T09:19:31.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 Processor -- start 2023-03-17T09:19:31.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab1711e0 0x55d5ab17fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1d7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab1d75a0 con 0x55d5ab170830 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab1d7710 con 0x55d5ab176040 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ab1d78d0 con 0x55d5ab1711e0 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc2a084db80 10 client.0 _ll_register_callbacks cb 0x55d5aaf64230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc29245c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:31.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc29245c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44448/0 (socket says 172.21.15.35:44448) 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc29245c700 1 -- 172.21.15.35:0/1713903565 learned_addr learned my addr 172.21.15.35:0/1713903565 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc291c5b700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab1711e0 0x55d5ab17fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc292c5d700 1 -- 172.21.15.35:0/1713903565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab1711e0 msgr2=0x55d5ab17fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.543+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab1711e0 0x55d5ab17fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc292c5d700 1 -- 172.21.15.35:0/1713903565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 msgr2=0x55d5ab17f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:31.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:31.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc292c5d700 1 -- 172.21.15.35:0/1713903565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c004450 con 0x55d5ab176040 2023-03-17T09:19:31.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc29245c700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:19:31.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc292c5d700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1d7060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2840c74b0 tx=0x7fc284007e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d0c1a1a36de1b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:31.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc275ffb700 1 -- 172.21.15.35:0/1713903565 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2840c5070 con 0x55d5ab176040 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5ab13c1e0 con 0x55d5ab176040 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc275ffb700 1 -- 172.21.15.35:0/1713903565 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fc284004c40 con 0x55d5ab176040 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc275ffb700 1 -- 172.21.15.35:0/1713903565 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc28400ddd0 con 0x55d5ab176040 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc2a084db80 10 client.25898 fetch_fsmap learned FSMap version 30 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d5aaf131f0 con 0x55d5ab176040 2023-03-17T09:19:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.544+0000 7fc275ffb700 1 -- 172.21.15.35:0/1713903565 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d5ab13c1e0 con 0x55d5ab176040 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc275ffb700 1 -- 172.21.15.35:0/1713903565 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc2840056d0 con 0x55d5ab176040 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc2a084db80 10 client.25898 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc2a084db80 10 client.25898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc2a084db80 20 client.25898 populate_metadata read hostname 'smithi035' 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab1def10 0x55d5ab1e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc2a084db80 4 client.25898 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d5aaf42f00 con 0x55d5ab1def10 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc29245c700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab1def10 0x55d5ab1e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc29245c700 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab1def10 0x55d5ab1e12f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5d823d6aae86b2 server_cookie=9612ac61ef9e5fcf in_seq=0 out_seq=0 2023-03-17T09:19:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.545+0000 7fc275ffb700 10 client.25898 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc275ffb700 1 -- 172.21.15.35:0/1713903565 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d5aaf42f00 con 0x55d5ab1def10 2023-03-17T09:19:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc275ffb700 10 client.25898 handle_command_reply: tid=0 2023-03-17T09:19:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 client.25898 shutdown 2023-03-17T09:19:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 msgr2=0x55d5ab1d7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1d7060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2840c74b0 tx=0x7fc284007e60 comp rx=0 tx=0).stop 2023-03-17T09:19:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 shutdown_connections 2023-03-17T09:19:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d5ab1def10 0x55d5ab1e12f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d5ab176040 0x55d5ab1d7060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc275ffb700 0 client.25898 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d5ab170830 0x55d5ab17f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 --2- 172.21.15.35:0/1713903565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5ab1711e0 0x55d5ab17fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 >> 172.21.15.35:0/1713903565 conn(0x55d5aafc96b0 msgr2=0x55d5ab175250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 shutdown_connections 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.549+0000 7fc2a084db80 1 -- 172.21.15.35:0/1713903565 wait complete. 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2a084db80 20 client.25898 trim_cache size 0 max 16384 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc27809f640 msgr2=0x7fc2780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc27809f640 0x7fc2780a1af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc28800b580 tx=0x7fc288009f10 comp rx=0 tx=0).stop 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 msgr2=0x7fc28c1a2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 0x7fc28c1a2170 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc284007ee0 tx=0x7fc28400d3b0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 shutdown_connections 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc27809f640 0x7fc2780a1af0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc28c104400 0x7fc28c1a2170 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c0ff3c0 0x7fc28c1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 --2- 172.21.15.35:0/3233917188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc28c0ffd60 0x7fc28c197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 >> 172.21.15.35:0/3233917188 conn(0x7fc28c076300 msgr2=0x7fc28c0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 shutdown_connections 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:29.550+0000 7fc2946c0700 1 -- 172.21.15.35:0/3233917188 wait complete. 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 -- 172.21.15.35:0/2798926121 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b01054f0 msgr2=0x7fd1b010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/2798926121 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b01054f0 0x7fd1b010d100 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800b0d0 tx=0x7fd1a800b3e0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 -- 172.21.15.35:0/2798926121 shutdown_connections 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/2798926121 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b01054f0 0x7fd1b010d100 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/2798926121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b0100be0 0x7fd1b0100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/2798926121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b0101580 0x7fd1b0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 -- 172.21.15.35:0/2798926121 >> 172.21.15.35:0/2798926121 conn(0x7fd1b00774e0 msgr2=0x7fd1b00778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 -- 172.21.15.35:0/2798926121 shutdown_connections 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.660+0000 7fd1b80c8700 1 -- 172.21.15.35:0/2798926121 wait complete. 2023-03-17T09:19:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 Processor -- start 2023-03-17T09:19:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 -- start start 2023-03-17T09:19:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b0100be0 0x7fd1b0196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 0x7fd1b0196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b01054f0 0x7fd1b019ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b019b320 con 0x7fd1b0101580 2023-03-17T09:19:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b019b490 con 0x7fd1b01054f0 2023-03-17T09:19:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b80c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b019b650 con 0x7fd1b0100be0 2023-03-17T09:19:41.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 0x7fd1b0196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 0x7fd1b0196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44464/0 (socket says 172.21.15.35:44464) 2023-03-17T09:19:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 -- 172.21.15.35:0/411207878 learned_addr learned my addr 172.21.15.35:0/411207878 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:42.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b6665700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b01054f0 0x7fd1b019ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b0100be0 0x7fd1b0196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 -- 172.21.15.35:0/411207878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b0100be0 msgr2=0x7fd1b0196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b0100be0 0x7fd1b0196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 -- 172.21.15.35:0/411207878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b01054f0 msgr2=0x7fd1b019ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b01054f0 0x7fd1b019ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 -- 172.21.15.35:0/411207878 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8009d00 con 0x7fd1b0101580 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b6665700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b01054f0 0x7fd1b019ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.661+0000 7fd1b5663700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 0x7fd1b0196880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00d950 tx=0x7fd1ac00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.662+0000 7fd1a6ffd700 1 -- 172.21.15.35:0/411207878 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00bb60 con 0x7fd1b0101580 2023-03-17T09:19:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.662+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b0110170 con 0x7fd1b0101580 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.662+0000 7fd1a6ffd700 1 -- 172.21.15.35:0/411207878 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1ac00de30 con 0x7fd1b0101580 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.662+0000 7fd1a6ffd700 1 -- 172.21.15.35:0/411207878 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac005460 con 0x7fd1b0101580 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.662+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b010ffe0 con 0x7fd1b0101580 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.665+0000 7fd1c4255b80 1 Processor -- start 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.665+0000 7fd1c4255b80 1 -- start start 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef882410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 0x55f8ef87cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef77f010 con 0x55f8ef87d1e0 2023-03-17T09:19:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef7d1950 con 0x55f8ef882040 2023-03-17T09:19:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef7cade0 con 0x55f8ef87c830 2023-03-17T09:19:43.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 0x55f8ef87cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 0x55f8ef87cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36236/0 (socket says 172.21.15.35:36236) 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 -- 172.21.15.35:0/3571215371 learned_addr learned my addr 172.21.15.35:0/3571215371 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b6665700 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef882410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 -- 172.21.15.35:0/3571215371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 msgr2=0x55f8ef882410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef882410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 -- 172.21.15.35:0/3571215371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 msgr2=0x55f8ef888dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 -- 172.21.15.35:0/3571215371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ef64c5d0 con 0x55f8ef87c830 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.666+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 0x55f8ef87cca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009d10 tx=0x7fd1a00116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbba58055eebb3f7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd19bfff700 1 -- 172.21.15.35:0/3571215371 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0011e20 con 0x55f8ef87c830 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd19bfff700 1 -- 172.21.15.35:0/3571215371 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1a0009e60 con 0x55f8ef87c830 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd19bfff700 1 -- 172.21.15.35:0/3571215371 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000f6a0 con 0x55f8ef87c830 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1a6ffd700 1 -- 172.21.15.35:0/411207878 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd1ac0055c0 con 0x7fd1b0101580 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1a6ffd700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd19c09f640 0x7fd19c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1c4255b80 1 -- 172.21.15.35:0/3571215371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 msgr2=0x55f8ef87cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 0x55f8ef87cca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009d10 tx=0x7fd1a00116c0 comp rx=0 tx=0).stop 2023-03-17T09:19:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1a6ffd700 1 -- 172.21.15.35:0/411207878 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd1ac0c9ee0 con 0x7fd1b0101580 2023-03-17T09:19:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1b6665700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd19c09f640 0x7fd19c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1c4255b80 1 -- 172.21.15.35:0/3571215371 shutdown_connections 2023-03-17T09:19:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef882410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.667+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/3571215371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87c830 0x55f8ef87cca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:44.235 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:06 smithi035 ceph-mon[92535]: pgmap v787: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:19:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.668+0000 7fd1c4255b80 1 -- 172.21.15.35:0/3571215371 >> 172.21.15.35:0/3571215371 conn(0x55f8ef6d56b0 msgr2=0x55f8ef872a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.668+0000 7fd1c4255b80 1 -- 172.21.15.35:0/3571215371 shutdown_connections 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.668+0000 7fd1c4255b80 1 -- 172.21.15.35:0/3571215371 wait complete. 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.668+0000 7fd1b6665700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd19c09f640 0x7fd19c0a1af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009fd0 tx=0x7fd1a800b040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.668+0000 7fd1c4255b80 1 -- start start 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.668+0000 7fd1c4255b80 1 Processor -- start 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 0x55f8ef888c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87d1e0 0x55f8ef885ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef8864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef64e8c0 con 0x55f8ef87c830 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef886c80 con 0x55f8ef882040 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef8924b0 con 0x55f8ef87d1e0 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1c4255b80 10 client.0 _ll_register_callbacks cb 0x55f8ef670230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:19:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 0x55f8ef888c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 0x55f8ef888c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44474/0 (socket says 172.21.15.35:44474) 2023-03-17T09:19:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2168719762 learned_addr learned my addr 172.21.15.35:0/2168719762 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5663700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87d1e0 0x55f8ef885ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b6665700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef8864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2168719762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87d1e0 msgr2=0x55f8ef885ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87d1e0 0x55f8ef885ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 msgr2=0x55f8ef8864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef8864c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.669+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2168719762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a0009940 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 0x55f8ef888c60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009620 tx=0x7fd1a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee940bd8b90c1f1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1997fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1997fa700 1 -- 172.21.15.35:0/2168719762 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0012450 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1997fa700 1 -- 172.21.15.35:0/2168719762 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd1a00125b0 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8ef78d390 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1997fa700 1 -- 172.21.15.35:0/2168719762 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1a0012770 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 10 client.16302 fetch_fsmap learned FSMap version 30 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f8ef5f8d80 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1997fa700 1 -- 172.21.15.35:0/2168719762 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f8ef78d390 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1997fa700 1 -- 172.21.15.35:0/2168719762 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd1a0022070 con 0x55f8ef87c830 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 10 client.16302 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 20 client.16302 populate_metadata read hostname 'smithi035' 2023-03-17T09:19:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef896420 0x55f8ef898830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.670+0000 7fd1c4255b80 4 client.16302 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.671+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8ef799600 con 0x55f8ef896420 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.671+0000 7fd1b5663700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef896420 0x55f8ef898830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.671+0000 7fd1b5663700 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef896420 0x55f8ef898830 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cd19d3a180f93d server_cookie=3f9c2eaecf09d022 in_seq=0 out_seq=0 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.671+0000 7fd1997fa700 10 client.16302 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1997fa700 1 -- 172.21.15.35:0/2168719762 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f8ef799600 con 0x55f8ef896420 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1997fa700 10 client.16302 handle_command_reply: tid=0 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 client.16302 shutdown 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 msgr2=0x55f8ef888c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 0x55f8ef888c60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009620 tx=0x7fd1a00042f0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 shutdown_connections 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef896420 0x55f8ef898830 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef882040 0x55f8ef8864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87c830 0x55f8ef888c60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2168719762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef87d1e0 0x55f8ef885ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1997fa700 0 client.16302 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 >> 172.21.15.35:0/2168719762 conn(0x55f8ef6d56b0 msgr2=0x55f8ef877410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 shutdown_connections 2023-03-17T09:19:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2168719762 wait complete. 2023-03-17T09:19:46.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.672+0000 7fd1c4255b80 20 client.16302 trim_cache size 0 max 16384 2023-03-17T09:19:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 Processor -- start 2023-03-17T09:19:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 -- start start 2023-03-17T09:19:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef8811b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef8736f0 con 0x55f8ef87d1e0 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef86e0f0 con 0x55f8ef87c830 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef880da0 con 0x55f8ef882040 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44484/0 (socket says 172.21.15.35:44484) 2023-03-17T09:19:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 -- 172.21.15.35:0/4210555217 learned_addr learned my addr 172.21.15.35:0/4210555217 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b6665700 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef8811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 -- 172.21.15.35:0/4210555217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 msgr2=0x55f8ef8811b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef8811b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 -- 172.21.15.35:0/4210555217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 msgr2=0x55f8ef88d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.687+0000 7fd1b5663700 1 -- 172.21.15.35:0/4210555217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ef791130 con 0x55f8ef87d1e0 2023-03-17T09:19:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1b5663700 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00b540 tx=0x7fd1ac0c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c77e2ca53b6f5f4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1a4ff9700 1 -- 172.21.15.35:0/4210555217 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac095d60 con 0x55f8ef87d1e0 2023-03-17T09:19:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1a4ff9700 1 -- 172.21.15.35:0/4210555217 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1ac0940d0 con 0x55f8ef87d1e0 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1a4ff9700 1 -- 172.21.15.35:0/4210555217 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac097e80 con 0x55f8ef87d1e0 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 -- 172.21.15.35:0/4210555217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 msgr2=0x55f8ef888800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00b540 tx=0x7fd1ac0c9040 comp rx=0 tx=0).stop 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 -- 172.21.15.35:0/4210555217 shutdown_connections 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef8811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/4210555217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef888800 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 -- 172.21.15.35:0/4210555217 >> 172.21.15.35:0/4210555217 conn(0x55f8ef6d56b0 msgr2=0x55f8ef877410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 -- 172.21.15.35:0/4210555217 shutdown_connections 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.688+0000 7fd1c4255b80 1 -- 172.21.15.35:0/4210555217 wait complete. 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 -- start start 2023-03-17T09:19:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 Processor -- start 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef88bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef88c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef8ea2d0 con 0x55f8ef87d1e0 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef8ea410 con 0x55f8ef87c830 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ef8ea550 con 0x55f8ef882040 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1c4255b80 10 client.0 _ll_register_callbacks cb 0x55f8ef670230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1b5663700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef88bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1b5e64700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1b5e64700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:46284/0 (socket says 172.21.15.35:46284) 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1b5663700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef88bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44490/0 (socket says 172.21.15.35:44490) 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.689+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2730692734 learned_addr learned my addr 172.21.15.35:0/2730692734 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b6665700 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef88c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2730692734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 msgr2=0x55f8ef88c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef88c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2730692734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 msgr2=0x55f8ef88bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:19:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef88bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b5e64700 1 -- 172.21.15.35:0/2730692734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b010ffe0 con 0x55f8ef87c830 2023-03-17T09:19:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1b5e64700 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88ba70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0003f30 tx=0x7fd1a002d650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d4a1a2d4308ceb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1997fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:19:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1997fa700 1 -- 172.21.15.35:0/2730692734 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a002de00 con 0x55f8ef87c830 2023-03-17T09:19:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1997fa700 1 -- 172.21.15.35:0/2730692734 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd1a0009350 con 0x55f8ef87c830 2023-03-17T09:19:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8ef8481e0 con 0x55f8ef87c830 2023-03-17T09:19:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1997fa700 1 -- 172.21.15.35:0/2730692734 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1a0004360 con 0x55f8ef87c830 2023-03-17T09:19:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1c4255b80 10 client.25916 fetch_fsmap learned FSMap version 30 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f8ef61f1f0 con 0x55f8ef87c830 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.690+0000 7fd1997fa700 1 -- 172.21.15.35:0/2730692734 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1a0047080 con 0x55f8ef87c830 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1997fa700 1 -- 172.21.15.35:0/2730692734 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd1a0011730 con 0x55f8ef87c830 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1c4255b80 10 client.25916 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1c4255b80 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1c4255b80 20 client.25916 populate_metadata read hostname 'smithi035' 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef8eb8c0 0x55f8ef8edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1c4255b80 4 client.25916 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:19:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f8ef64ef00 con 0x55f8ef8eb8c0 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1b5663700 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef8eb8c0 0x55f8ef8edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1997fa700 10 client.25916 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.691+0000 7fd1b5663700 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef8eb8c0 0x55f8ef8edcd0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdaa620da3799d9 server_cookie=6aa23d615850584f in_seq=0 out_seq=0 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.694+0000 7fd1997fa700 1 -- 172.21.15.35:0/2730692734 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f8ef64ef00 con 0x55f8ef8eb8c0 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.694+0000 7fd1997fa700 10 client.25916 handle_command_reply: tid=0 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.694+0000 7fd1c4255b80 1 client.25916 shutdown 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.694+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 msgr2=0x55f8ef88ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.694+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88ba70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0003f30 tx=0x7fd1a002d650 comp rx=0 tx=0).stop 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 shutdown_connections 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f8ef8eb8c0 0x55f8ef8edcd0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f8ef882040 0x55f8ef88c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1997fa700 0 client.25916 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f8ef87c830 0x55f8ef88ba70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 --2- 172.21.15.35:0/2730692734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f8ef87d1e0 0x55f8ef88bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 >> 172.21.15.35:0/2730692734 conn(0x55f8ef6d56b0 msgr2=0x55f8ef880230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 shutdown_connections 2023-03-17T09:19:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 1 -- 172.21.15.35:0/2730692734 wait complete. 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1c4255b80 20 client.25916 trim_cache size 0 max 16384 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd19c09f640 msgr2=0x7fd19c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd19c09f640 0x7fd19c0a1af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009fd0 tx=0x7fd1a800b040 comp rx=0 tx=0).stop 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 msgr2=0x7fd1b0196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.695+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 0x7fd1b0196880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00d950 tx=0x7fd1ac00dd10 comp rx=0 tx=0).stop 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 shutdown_connections 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd19c09f640 0x7fd19c0a1af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1b01054f0 0x7fd1b019ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b0100be0 0x7fd1b0196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 --2- 172.21.15.35:0/411207878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1b0101580 0x7fd1b0196880 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 >> 172.21.15.35:0/411207878 conn(0x7fd1b00774e0 msgr2=0x7fd1b00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 shutdown_connections 2023-03-17T09:19:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:42.696+0000 7fd1b80c8700 1 -- 172.21.15.35:0/411207878 wait complete. 2023-03-17T09:19:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 -- 172.21.15.35:0/508570505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 msgr2=0x7f10d8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 --2- 172.21.15.35:0/508570505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d8104e10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0099c0 tx=0x7f10cc009cd0 comp rx=0 tx=0).stop 2023-03-17T09:19:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 -- 172.21.15.35:0/508570505 shutdown_connections 2023-03-17T09:19:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 --2- 172.21.15.35:0/508570505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d81054f0 0x7f10d810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 --2- 172.21.15.35:0/508570505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 0x7f10d8100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 --2- 172.21.15.35:0/508570505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d8104e10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.817+0000 7f10de70d700 1 -- 172.21.15.35:0/508570505 >> 172.21.15.35:0/508570505 conn(0x7f10d80774e0 msgr2=0x7f10d80778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.818+0000 7f10de70d700 1 -- 172.21.15.35:0/508570505 shutdown_connections 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.818+0000 7f10de70d700 1 -- 172.21.15.35:0/508570505 wait complete. 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.818+0000 7f10de70d700 1 Processor -- start 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.818+0000 7f10de70d700 1 -- start start 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10de70d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 0x7f10d81962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10de70d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d81967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10de70d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d81054f0 0x7f10d819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:52.851 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:08 smithi035 ceph-mon[92535]: pgmap v788: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:19:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10de70d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819b280 con 0x7f10d8101580 2023-03-17T09:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10de70d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819b3f0 con 0x7f10d8100be0 2023-03-17T09:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10de70d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d819b5b0 con 0x7f10d81054f0 2023-03-17T09:19:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 0x7f10d81962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d81967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 0x7f10d81962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:46298/0 (socket says 172.21.15.35:46298) 2023-03-17T09:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d81967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44504/0 (socket says 172.21.15.35:44504) 2023-03-17T09:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10d7fff700 1 -- 172.21.15.35:0/4247201287 learned_addr learned my addr 172.21.15.35:0/4247201287 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:19:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.819+0000 7f10dccaa700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d81054f0 0x7f10d819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d77fe700 1 -- 172.21.15.35:0/4247201287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d81054f0 msgr2=0x7f10d819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d77fe700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d81054f0 0x7f10d819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d77fe700 1 -- 172.21.15.35:0/4247201287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 msgr2=0x7f10d81962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:19:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d77fe700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 0x7f10d81962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:19:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d77fe700 1 -- 172.21.15.35:0/4247201287 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0095f0 con 0x7f10d8101580 2023-03-17T09:19:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d77fe700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d81967e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009fd0 tx=0x7f10cc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d57fa700 1 -- 172.21.15.35:0/4247201287 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc01d070 con 0x7f10d8101580 2023-03-17T09:19:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d57fa700 1 -- 172.21.15.35:0/4247201287 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10cc005020 con 0x7f10d8101580 2023-03-17T09:19:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d81101b0 con 0x7f10d8101580 2023-03-17T09:19:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10d57fa700 1 -- 172.21.15.35:0/4247201287 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc004970 con 0x7f10d8101580 2023-03-17T09:19:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.820+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d8110020 con 0x7f10d8101580 2023-03-17T09:19:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.822+0000 7f10d57fa700 1 -- 172.21.15.35:0/4247201287 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f10cc005420 con 0x7f10d8101580 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.823+0000 7f10d57fa700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f10c009f6c0 0x7f10c00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.823+0000 7f10d7fff700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f10c009f6c0 0x7f10c00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.823+0000 7f10d57fa700 1 -- 172.21.15.35:0/4247201287 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f10cc0caf50 con 0x7f10d8101580 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.824+0000 7f10d7fff700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f10c009f6c0 0x7f10c00a1b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009d20 tx=0x7f10c8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.824+0000 7f10ea89ab80 1 Processor -- start 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.824+0000 7f10ea89ab80 1 -- start start 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.824+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec45195360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.824+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec451958a0 0x55ec4518f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 0x55ec451901c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec45092010 con 0x55ec4518fd70 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec450e4950 con 0x55ec45194f90 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec450ddde0 con 0x55ec451958a0 2023-03-17T09:19:58.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 0x55ec451901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 0x55ec451901c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44514/0 (socket says 172.21.15.35:44514) 2023-03-17T09:20:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 -- 172.21.15.35:0/3021747726 learned_addr learned my addr 172.21.15.35:0/3021747726 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10d77fe700 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec451958a0 0x55ec4518f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10d7fff700 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec45195360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 -- 172.21.15.35:0/3021747726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec451958a0 msgr2=0x55ec4518f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec451958a0 0x55ec4518f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 -- 172.21.15.35:0/3021747726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 msgr2=0x55ec45195360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec45195360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 -- 172.21.15.35:0/3021747726 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec44f5f5d0 con 0x55ec4518fd70 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10dccaa700 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 0x55ec451901c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f10d0003fa0 tx=0x7f10d0009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be32975dde17ab75 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10be7fc700 1 -- 172.21.15.35:0/3021747726 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0019070 con 0x55ec4518fd70 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10be7fc700 1 -- 172.21.15.35:0/3021747726 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10d000f040 con 0x55ec4518fd70 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.825+0000 7f10be7fc700 1 -- 172.21.15.35:0/3021747726 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0007920 con 0x55ec4518fd70 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3021747726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 msgr2=0x55ec451901c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 0x55ec451901c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f10d0003fa0 tx=0x7f10d0009ba0 comp rx=0 tx=0).stop 2023-03-17T09:20:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3021747726 shutdown_connections 2023-03-17T09:20:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec4518fd70 0x55ec451901c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec45195360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3021747726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec451958a0 0x55ec4518f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3021747726 >> 172.21.15.35:0/3021747726 conn(0x55ec44fe86b0 msgr2=0x55ec45185a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3021747726 shutdown_connections 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.826+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3021747726 wait complete. 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 -- start start 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 Processor -- start 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec4519b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 0x55ec45198b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec451958a0 0x55ec451991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec44f618c0 con 0x55ec45194f90 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec45199960 con 0x55ec451958a0 2023-03-17T09:20:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec451a5400 con 0x55ec4518fd70 2023-03-17T09:20:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10ea89ab80 10 client.0 _ll_register_callbacks cb 0x55ec44f83230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:20:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 0x55ec45198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 0x55ec45198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44518/0 (socket says 172.21.15.35:44518) 2023-03-17T09:20:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10d77fe700 1 -- 172.21.15.35:0/3832572069 learned_addr learned my addr 172.21.15.35:0/3832572069 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.827+0000 7f10dccaa700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec451958a0 0x55ec451991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d7fff700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec4519b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:05.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d77fe700 1 -- 172.21.15.35:0/3832572069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 msgr2=0x55ec4519b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d77fe700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec4519b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d77fe700 1 -- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec451958a0 msgr2=0x55ec451991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d77fe700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec451958a0 0x55ec451991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d77fe700 1 -- 172.21.15.35:0/3832572069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d0003bd0 con 0x55ec45194f90 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10d77fe700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 0x55ec45198b50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f10cc098760 tx=0x7f10cc009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1c1248897910f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10b77fe700 1 -- 172.21.15.35:0/3832572069 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc020370 con 0x55ec45194f90 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10b77fe700 1 -- 172.21.15.35:0/3832572069 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f10cc098a60 con 0x55ec45194f90 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec450a0390 con 0x55ec45194f90 2023-03-17T09:20:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10b77fe700 1 -- 172.21.15.35:0/3832572069 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10cc0a0bc0 con 0x55ec45194f90 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10ea89ab80 10 client.16320 fetch_fsmap learned FSMap version 30 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.828+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ec44f0bd80 con 0x55ec45194f90 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10b77fe700 1 -- 172.21.15.35:0/3832572069 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec450a0390 con 0x55ec45194f90 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10b77fe700 1 -- 172.21.15.35:0/3832572069 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f10cc094850 con 0x55ec45194f90 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10ea89ab80 10 client.16320 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10ea89ab80 10 client.16320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10ea89ab80 20 client.16320 populate_metadata read hostname 'smithi035' 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451a91d0 0x55ec451ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10ea89ab80 4 client.16320 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec450ac600 con 0x55ec451a91d0 2023-03-17T09:20:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.829+0000 7f10d7fff700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451a91d0 0x55ec451ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.830+0000 7f10b77fe700 10 client.16320 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.830+0000 7f10d7fff700 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451a91d0 0x55ec451ab5e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beae12c831f0d83d server_cookie=17d3ebc154e68487 in_seq=0 out_seq=0 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.830+0000 7f10b77fe700 1 -- 172.21.15.35:0/3832572069 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ec450ac600 con 0x55ec451a91d0 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.830+0000 7f10b77fe700 10 client.16320 handle_command_reply: tid=0 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.830+0000 7f10ea89ab80 1 client.16320 shutdown 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 msgr2=0x55ec45198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 0x55ec45198b50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f10cc098760 tx=0x7f10cc009380 comp rx=0 tx=0).stop 2023-03-17T09:20:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 shutdown_connections 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451a91d0 0x55ec451ab5e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec451958a0 0x55ec451991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10b77fe700 0 client.16320 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec4519b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/3832572069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec45194f90 0x55ec45198b50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 >> 172.21.15.35:0/3832572069 conn(0x55ec44fe86b0 msgr2=0x55ec45185a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 shutdown_connections 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 1 -- 172.21.15.35:0/3832572069 wait complete. 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.831+0000 7f10ea89ab80 20 client.16320 trim_cache size 0 max 16384 2023-03-17T09:20:08.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.846+0000 7f10ea89ab80 1 Processor -- start 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.846+0000 7f10ea89ab80 1 -- start start 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec45185ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec451a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45198380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec450a03c0 con 0x55ec451958a0 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec45199af0 con 0x55ec45194f90 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec451810d0 con 0x55ec4518fd70 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec45185ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec451a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec451a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:46322/0 (socket says 172.21.15.35:46322) 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec45185ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36290/0 (socket says 172.21.15.35:36290) 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 -- 172.21.15.35:0/2128080598 learned_addr learned my addr 172.21.15.35:0/2128080598 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10dccaa700 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 -- 172.21.15.35:0/2128080598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 msgr2=0x55ec45185ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:08.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec45185ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 -- 172.21.15.35:0/2128080598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 msgr2=0x55ec45198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 -- 172.21.15.35:0/2128080598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec45190410 con 0x55ec45194f90 2023-03-17T09:20:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10dccaa700 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:20:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.847+0000 7f10d77fe700 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec451a0340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10cc094f60 tx=0x7f10cc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7245b426b49918 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10beffd700 1 -- 172.21.15.35:0/2128080598 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0a09b0 con 0x55ec45194f90 2023-03-17T09:20:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10beffd700 1 -- 172.21.15.35:0/2128080598 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10cc020370 con 0x55ec45194f90 2023-03-17T09:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10beffd700 1 -- 172.21.15.35:0/2128080598 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0a0730 con 0x55ec45194f90 2023-03-17T09:20:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 -- 172.21.15.35:0/2128080598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 msgr2=0x55ec451a0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec451a0340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10cc094f60 tx=0x7f10cc000bc0 comp rx=0 tx=0).stop 2023-03-17T09:20:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 -- 172.21.15.35:0/2128080598 shutdown_connections 2023-03-17T09:20:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:13.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec4518fd70 0x55ec45185ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:13.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/2128080598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec45194f90 0x55ec451a0340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:13.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 -- 172.21.15.35:0/2128080598 >> 172.21.15.35:0/2128080598 conn(0x55ec44fe86b0 msgr2=0x55ec45192d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 -- 172.21.15.35:0/2128080598 shutdown_connections 2023-03-17T09:20:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.848+0000 7f10ea89ab80 1 -- 172.21.15.35:0/2128080598 wait complete. 2023-03-17T09:20:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 -- start start 2023-03-17T09:20:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 Processor -- start 2023-03-17T09:20:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec4518fd70 0x55ec451a0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:15.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec45194f90 0x55ec45190bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45191130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:15.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec45191670 con 0x55ec451958a0 2023-03-17T09:20:15.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec451917e0 con 0x55ec4518fd70 2023-03-17T09:20:15.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec451919a0 con 0x55ec45194f90 2023-03-17T09:20:17.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10ea89ab80 10 client.0 _ll_register_callbacks cb 0x55ec44f83230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:20:17.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10dccaa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45191130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.849+0000 7f10dccaa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45191130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44534/0 (socket says 172.21.15.35:44534) 2023-03-17T09:20:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 -- 172.21.15.35:0/1150960980 learned_addr learned my addr 172.21.15.35:0/1150960980 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10d7fff700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec4518fd70 0x55ec451a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10d77fe700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec45194f90 0x55ec45190bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 -- 172.21.15.35:0/1150960980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec45194f90 msgr2=0x55ec45190bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:09 smithi035 ceph-mon[92535]: osdmap e125: 12 total, 12 up, 12 in 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:10 smithi035 ceph-mon[92535]: pgmap v790: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:12 smithi035 ceph-mon[92535]: pgmap v791: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:14 smithi035 ceph-mon[92535]: pgmap v792: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:16 smithi035 ceph-mon[92535]: osdmap e126: 12 total, 12 up, 12 in 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:16 smithi035 ceph-mon[92535]: pgmap v794: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:18 smithi035 ceph-mon[92535]: pgmap v795: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T09:20:19.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:20 smithi035 ceph-mon[92535]: pgmap v796: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:22 smithi035 ceph-mon[92535]: pgmap v797: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:24 smithi035 ceph-mon[92535]: pgmap v798: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:26 smithi035 ceph-mon[92535]: pgmap v799: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:28 smithi035 ceph-mon[92535]: pgmap v800: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:30 smithi035 ceph-mon[92535]: pgmap v801: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:32 smithi035 ceph-mon[92535]: pgmap v802: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:19.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:34 smithi035 ceph-mon[92535]: pgmap v803: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:20:20.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:36 smithi035 ceph-mon[92535]: pgmap v804: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:20.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:38 smithi035 ceph-mon[92535]: pgmap v805: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:20:20.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:40 smithi035 ceph-mon[92535]: pgmap v806: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:21.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:42 smithi035 ceph-mon[92535]: pgmap v807: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:21.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:44 smithi035 ceph-mon[92535]: pgmap v808: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:20:21.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:46 smithi035 ceph-mon[92535]: pgmap v809: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:21.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:48 smithi035 ceph-mon[92535]: pgmap v810: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:20:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:20:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:20:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:20:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:20:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec45194f90 0x55ec45190bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 -- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec4518fd70 msgr2=0x55ec451a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec4518fd70 0x55ec451a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 -- 172.21.15.35:0/1150960980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec44f0bd80 con 0x55ec451958a0 2023-03-17T09:20:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10dccaa700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45191130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f10d0003fa0 tx=0x7f10d0004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7041f49f333fce5a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10b77fe700 1 -- 172.21.15.35:0/1150960980 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0019040 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec4515b1e0 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10b77fe700 1 -- 172.21.15.35:0/1150960980 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f10d00089a0 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10b77fe700 1 -- 172.21.15.35:0/1150960980 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d0008b60 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10ea89ab80 10 client.16326 fetch_fsmap learned FSMap version 30 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.850+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ec44ef4c00 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10b77fe700 1 -- 172.21.15.35:0/1150960980 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec4515b1e0 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10b77fe700 1 -- 172.21.15.35:0/1150960980 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f10d0020430 con 0x55ec451958a0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10ea89ab80 10 client.16326 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10ea89ab80 10 client.16326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10ea89ab80 20 client.16326 populate_metadata read hostname 'smithi035' 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451fe480 0x55ec45200890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10ea89ab80 4 client.16326 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ec44f61f00 con 0x55ec451fe480 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10d7fff700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451fe480 0x55ec45200890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10b77fe700 10 client.16326 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.851+0000 7f10d7fff700 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451fe480 0x55ec45200890 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a73084182946c6 server_cookie=eeb8516452f1bb8e in_seq=0 out_seq=0 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10b77fe700 1 -- 172.21.15.35:0/1150960980 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ec44f61f00 con 0x55ec451fe480 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10b77fe700 10 client.16326 handle_command_reply: tid=0 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 client.16326 shutdown 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 msgr2=0x55ec45191130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45191130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f10d0003fa0 tx=0x7f10d0004870 comp rx=0 tx=0).stop 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 shutdown_connections 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec451fe480 0x55ec45200890 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec451958a0 0x55ec45191130 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10b77fe700 0 client.16326 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec4518fd70 0x55ec451a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 --2- 172.21.15.35:0/1150960980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec45194f90 0x55ec45190bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 >> 172.21.15.35:0/1150960980 conn(0x55ec44fe86b0 msgr2=0x55ec45193cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 shutdown_connections 2023-03-17T09:20:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 1 -- 172.21.15.35:0/1150960980 wait complete. 2023-03-17T09:20:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.856+0000 7f10ea89ab80 20 client.16326 trim_cache size 0 max 16384 2023-03-17T09:20:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f10c009f6c0 msgr2=0x7f10c00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f10c009f6c0 0x7f10c00a1b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009d20 tx=0x7f10c8009260 comp rx=0 tx=0).stop 2023-03-17T09:20:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 msgr2=0x7f10d81967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d81967e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009fd0 tx=0x7f10cc00f690 comp rx=0 tx=0).stop 2023-03-17T09:20:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 shutdown_connections 2023-03-17T09:20:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f10c009f6c0 0x7f10c00a1b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d81054f0 0x7f10d819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10d8100be0 0x7f10d81962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 --2- 172.21.15.35:0/4247201287 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f10d8101580 0x7f10d81967e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 >> 172.21.15.35:0/4247201287 conn(0x7f10d80774e0 msgr2=0x7f10d80fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 shutdown_connections 2023-03-17T09:20:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:03:55.857+0000 7f10de70d700 1 -- 172.21.15.35:0/4247201287 wait complete. 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/1690772560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 msgr2=0x7fb4a810a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/1690772560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a810a210 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb498009990 tx=0x7fb498009ca0 comp rx=0 tx=0).stop 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/1690772560 shutdown_connections 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/1690772560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a810a750 0x7fb4a810cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/1690772560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a8101410 0x7fb4a81017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/1690772560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a810a210 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/1690772560 >> 172.21.15.35:0/1690772560 conn(0x7fb4a8076330 msgr2=0x7fb4a8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/1690772560 shutdown_connections 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.979+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/1690772560 wait complete. 2023-03-17T09:20:24.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.980+0000 7fb4ae6d2700 1 Processor -- start 2023-03-17T09:20:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.980+0000 7fb4ae6d2700 1 -- start start 2023-03-17T09:20:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4ae6d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a8101410 0x7fb4a8196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4ae6d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a8196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4ae6d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a810a750 0x7fb4a819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4ae6d2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a819b1f0 con 0x7fb4a8101d20 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4ae6d2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a819b360 con 0x7fb4a8101410 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4ae6d2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a819b520 con 0x7fb4a810a750 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a8196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a8196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44546/0 (socket says 172.21.15.35:44546) 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 -- 172.21.15.35:0/288733392 learned_addr learned my addr 172.21.15.35:0/288733392 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a8101410 0x7fb4a8196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a810a750 0x7fb4a819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 -- 172.21.15.35:0/288733392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a810a750 msgr2=0x7fb4a819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a810a750 0x7fb4a819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 -- 172.21.15.35:0/288733392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a8101410 msgr2=0x7fb4a8196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a8101410 0x7fb4a8196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 -- 172.21.15.35:0/288733392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980095f0 con 0x7fb4a8101d20 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a8196750 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb4980036c0 tx=0x7fb498005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.981+0000 7fb4a57fa700 1 -- 172.21.15.35:0/288733392 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49801d070 con 0x7fb4a8101d20 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.982+0000 7fb4a57fa700 1 -- 172.21.15.35:0/288733392 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb498003ec0 con 0x7fb4a8101d20 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.982+0000 7fb4a57fa700 1 -- 172.21.15.35:0/288733392 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498022b90 con 0x7fb4a8101d20 2023-03-17T09:20:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.982+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a8110100 con 0x7fb4a8101d20 2023-03-17T09:20:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.982+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a810ff70 con 0x7fb4a8101d20 2023-03-17T09:20:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.984+0000 7fb4a57fa700 1 -- 172.21.15.35:0/288733392 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb498004030 con 0x7fb4a8101d20 2023-03-17T09:20:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.984+0000 7fb4a57fa700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb49409f6c0 0x7fb4940a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4a57fa700 1 -- 172.21.15.35:0/288733392 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fb4980cbb70 con 0x7fb4a8101d20 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb49409f6c0 0x7fb4940a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb49409f6c0 0x7fb4940a1b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb490005950 tx=0x7fb49000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4ba85fb80 1 Processor -- start 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4ba85fb80 1 -- start start 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 0x564a6446dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64468420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.985+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a64468d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6436f010 con 0x564a6446dbe0 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a643c1950 con 0x564a64468960 2023-03-17T09:20:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a643bade0 con 0x564a6446e4f0 2023-03-17T09:20:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 0x564a6446dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 0x564a6446dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44552/0 (socket says 172.21.15.35:44552) 2023-03-17T09:20:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 -- 172.21.15.35:0/751535741 learned_addr learned my addr 172.21.15.35:0/751535741 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64468420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a64468d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 -- 172.21.15.35:0/751535741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 msgr2=0x564a64468420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64468420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 -- 172.21.15.35:0/751535741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 msgr2=0x564a64468d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a64468d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 -- 172.21.15.35:0/751535741 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a6423c5d0 con 0x564a6446dbe0 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a64468d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:20:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 0x564a6446dfb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb490010fa0 tx=0x7fb490013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71da99bac5dcde16 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb49e7fc700 1 -- 172.21.15.35:0/751535741 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49001e620 con 0x564a6446dbe0 2023-03-17T09:20:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb49e7fc700 1 -- 172.21.15.35:0/751535741 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb490015070 con 0x564a6446dbe0 2023-03-17T09:20:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.986+0000 7fb49e7fc700 1 -- 172.21.15.35:0/751535741 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49001c8c0 con 0x564a6446dbe0 2023-03-17T09:20:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/751535741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 msgr2=0x564a6446dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 0x564a6446dfb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb490010fa0 tx=0x7fb490013000 comp rx=0 tx=0).stop 2023-03-17T09:20:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/751535741 shutdown_connections 2023-03-17T09:20:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a64468d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446dbe0 0x564a6446dfb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/751535741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64468420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/751535741 >> 172.21.15.35:0/751535741 conn(0x564a642c56b0 msgr2=0x564a64462a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/751535741 shutdown_connections 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.987+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/751535741 wait complete. 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 -- start start 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 Processor -- start 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 0x564a64474350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64471b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6423e8c0 con 0x564a64468960 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a64472280 con 0x564a6446dbe0 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a64472440 con 0x564a6446e4f0 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4ba85fb80 10 client.0 _ll_register_callbacks cb 0x564a64260230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 0x564a64474350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 0x564a64474350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44558/0 (socket says 172.21.15.35:44558) 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4a7fff700 1 -- 172.21.15.35:0/302609508 learned_addr learned my addr 172.21.15.35:0/302609508 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64471b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.988+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4a7fff700 1 -- 172.21.15.35:0/302609508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 msgr2=0x564a64471b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64471b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4a7fff700 1 -- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 msgr2=0x564a644715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4a7fff700 1 -- 172.21.15.35:0/302609508 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb490010c50 con 0x564a64468960 2023-03-17T09:20:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 0x564a64474350 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb490010a40 tx=0x7fb490005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471265847545754d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4877fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4877fe700 1 -- 172.21.15.35:0/302609508 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49002c070 con 0x564a64468960 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4877fe700 1 -- 172.21.15.35:0/302609508 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fb490017070 con 0x564a64468960 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a6437d390 con 0x564a64468960 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4877fe700 1 -- 172.21.15.35:0/302609508 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb490005670 con 0x564a64468960 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4ba85fb80 10 client.16338 fetch_fsmap learned FSMap version 30 2023-03-17T09:20:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.989+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564a641e8d80 con 0x564a64468960 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4877fe700 1 -- 172.21.15.35:0/302609508 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb49003d020 con 0x564a64468960 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4877fe700 1 -- 172.21.15.35:0/302609508 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb49001e7c0 con 0x564a64468960 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4ba85fb80 10 client.16338 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4ba85fb80 10 client.16338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4ba85fb80 20 client.16338 populate_metadata read hostname 'smithi035' 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a64481e50 0x564a64484260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4ba85fb80 4 client.16338 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a64389600 con 0x564a64481e50 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.990+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a64481e50 0x564a64484260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.991+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a64481e50 0x564a64484260 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae69842169201647 server_cookie=181705cabe9ee80b in_seq=0 out_seq=0 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.991+0000 7fb4877fe700 10 client.16338 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.991+0000 7fb4877fe700 1 -- 172.21.15.35:0/302609508 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564a64389600 con 0x564a64481e50 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.991+0000 7fb4877fe700 10 client.16338 handle_command_reply: tid=0 2023-03-17T09:20:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.991+0000 7fb4ba85fb80 1 client.16338 shutdown 2023-03-17T09:20:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 msgr2=0x564a64474350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:34.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:50 smithi035 ceph-mon[92535]: pgmap v811: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 0x564a64474350 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb490010a40 tx=0x7fb490005270 comp rx=0 tx=0).stop 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 shutdown_connections 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a64481e50 0x564a64484260 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446e4f0 0x564a64471b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a64468960 0x564a64474350 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4877fe700 0 client.16338 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/302609508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 >> 172.21.15.35:0/302609508 conn(0x564a642c56b0 msgr2=0x564a64467410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 shutdown_connections 2023-03-17T09:20:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/302609508 wait complete. 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:08.992+0000 7fb4ba85fb80 20 client.16338 trim_cache size 0 max 16384 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 Processor -- start 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 -- start start 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a6446f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446dbe0 0x564a64478f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a64473ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a64389630 con 0x564a6446e4f0 2023-03-17T09:20:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6445e120 con 0x564a64468960 2023-03-17T09:20:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6446f5e0 con 0x564a6446dbe0 2023-03-17T09:20:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a64473ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a64473ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44570/0 (socket says 172.21.15.35:44570) 2023-03-17T09:20:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 -- 172.21.15.35:0/3860730493 learned_addr learned my addr 172.21.15.35:0/3860730493 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446dbe0 0x564a64478f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a6446f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 -- 172.21.15.35:0/3860730493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446dbe0 msgr2=0x564a64478f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446dbe0 0x564a64478f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 -- 172.21.15.35:0/3860730493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 msgr2=0x564a6446f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a6446f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:36.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4acc6f700 1 -- 172.21.15.35:0/3860730493 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a64381130 con 0x564a6446e4f0 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.007+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a6446f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a64473ef0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009e80 tx=0x7fb4a00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e732abe3c5717f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb49effd700 1 -- 172.21.15.35:0/3860730493 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0017440 con 0x564a6446e4f0 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb49effd700 1 -- 172.21.15.35:0/3860730493 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4a000f070 con 0x564a6446e4f0 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb49effd700 1 -- 172.21.15.35:0/3860730493 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00167d0 con 0x564a6446e4f0 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/3860730493 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 msgr2=0x564a64473ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a64473ef0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009e80 tx=0x7fb4a00077e0 comp rx=0 tx=0).stop 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/3860730493 shutdown_connections 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a64473ef0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a64468960 0x564a6446f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/3860730493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a6446dbe0 0x564a64478f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.008+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/3860730493 >> 172.21.15.35:0/3860730493 conn(0x564a642c56b0 msgr2=0x564a6446e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/3860730493 shutdown_connections 2023-03-17T09:20:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/3860730493 wait complete. 2023-03-17T09:20:38.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 -- start start 2023-03-17T09:20:38.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 Processor -- start 2023-03-17T09:20:38.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a64468960 0x564a644cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:38.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a644c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a644ca290 con 0x564a6446e4f0 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a644ca400 con 0x564a6446dbe0 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a644ca5c0 con 0x564a64468960 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.009+0000 7fb4ba85fb80 10 client.0 _ll_register_callbacks cb 0x564a64260230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a644c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a644c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44576/0 (socket says 172.21.15.35:44576) 2023-03-17T09:20:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 -- 172.21.15.35:0/1631649335 learned_addr learned my addr 172.21.15.35:0/1631649335 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a64468960 0x564a644cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 -- 172.21.15.35:0/1631649335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a64468960 msgr2=0x564a644cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a64468960 0x564a644cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 -- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 msgr2=0x564a644cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 -- 172.21.15.35:0/1631649335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a0009b30 con 0x564a6446e4f0 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4a77fe700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:20:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4acc6f700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a644c9c80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009ad0 tx=0x7fb4a0017670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f194e7e507dca65 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4877fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4877fe700 1 -- 172.21.15.35:0/1631649335 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0017ca0 con 0x564a6446e4f0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4877fe700 1 -- 172.21.15.35:0/1631649335 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fb4a0017e00 con 0x564a6446e4f0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.010+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a644381e0 con 0x564a6446e4f0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4877fe700 1 -- 172.21.15.35:0/1631649335 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4a0020450 con 0x564a6446e4f0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 10 client.16344 fetch_fsmap learned FSMap version 30 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564a6420f1f0 con 0x564a6446e4f0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4877fe700 1 -- 172.21.15.35:0/1631649335 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4a0035020 con 0x564a6446e4f0 2023-03-17T09:20:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4877fe700 1 -- 172.21.15.35:0/1631649335 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb4a0014050 con 0x564a6446e4f0 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 10 client.16344 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 10 client.16344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 20 client.16344 populate_metadata read hostname 'smithi035' 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a644d7220 0x564a644d9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 4 client.16344 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a6423ef00 con 0x564a644d7220 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.011+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a644d7220 0x564a644d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.012+0000 7fb4877fe700 10 client.16344 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.012+0000 7fb4a7fff700 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a644d7220 0x564a644d9630 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=178aae9fc572b40d server_cookie=279e80438f7449f3 in_seq=0 out_seq=0 2023-03-17T09:20:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4877fe700 1 -- 172.21.15.35:0/1631649335 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a6423ef00 con 0x564a644d7220 2023-03-17T09:20:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4877fe700 10 client.16344 handle_command_reply: tid=0 2023-03-17T09:20:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 client.16344 shutdown 2023-03-17T09:20:40.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 msgr2=0x564a644c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a644c9c80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009ad0 tx=0x7fb4a0017670 comp rx=0 tx=0).stop 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 shutdown_connections 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a644d7220 0x564a644d9630 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a6446e4f0 0x564a644c9c80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a64468960 0x564a644cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4877fe700 0 client.16344 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 --2- 172.21.15.35:0/1631649335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a6446dbe0 0x564a644cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 >> 172.21.15.35:0/1631649335 conn(0x564a642c56b0 msgr2=0x564a64467410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 shutdown_connections 2023-03-17T09:20:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 1 -- 172.21.15.35:0/1631649335 wait complete. 2023-03-17T09:20:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.019+0000 7fb4ba85fb80 20 client.16344 trim_cache size 0 max 16384 2023-03-17T09:20:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb49409f6c0 msgr2=0x7fb4940a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:42.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb49409f6c0 0x7fb4940a1b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb490005950 tx=0x7fb49000b410 comp rx=0 tx=0).stop 2023-03-17T09:20:42.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 msgr2=0x7fb4a8196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:42.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a8196750 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb4980036c0 tx=0x7fb498005740 comp rx=0 tx=0).stop 2023-03-17T09:20:42.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 shutdown_connections 2023-03-17T09:20:42.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb49409f6c0 0x7fb4940a1b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4a810a750 0x7fb4a819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4a8101410 0x7fb4a8196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 --2- 172.21.15.35:0/288733392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4a8101d20 0x7fb4a8196750 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 >> 172.21.15.35:0/288733392 conn(0x7fb4a8076330 msgr2=0x7fb4a81021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 shutdown_connections 2023-03-17T09:20:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:09.020+0000 7fb4ae6d2700 1 -- 172.21.15.35:0/288733392 wait complete. 2023-03-17T09:20:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 -- 172.21.15.35:0/794721642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 msgr2=0x7fcfa8103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 --2- 172.21.15.35:0/794721642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa8103cb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcf980099c0 tx=0x7fcf98009cd0 comp rx=0 tx=0).stop 2023-03-17T09:20:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 -- 172.21.15.35:0/794721642 shutdown_connections 2023-03-17T09:20:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 --2- 172.21.15.35:0/794721642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa8104390 0x7fcfa810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 --2- 172.21.15.35:0/794721642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa80ff350 0x7fcfa80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 --2- 172.21.15.35:0/794721642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa8103cb0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 -- 172.21.15.35:0/794721642 >> 172.21.15.35:0/794721642 conn(0x7fcfa8076330 msgr2=0x7fcfa8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 -- 172.21.15.35:0/794721642 shutdown_connections 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.143+0000 7fcfb0203700 1 -- 172.21.15.35:0/794721642 wait complete. 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 Processor -- start 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 -- start start 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa80ff350 0x7fcfa81971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa81976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa8104390 0x7fcfa81a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8198030 con 0x7fcfa80ffcf0 2023-03-17T09:20:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81a2770 con 0x7fcfa8104390 2023-03-17T09:20:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfb0203700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa81a2930 con 0x7fcfa80ff350 2023-03-17T09:20:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa81976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa81976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44588/0 (socket says 172.21.15.35:44588) 2023-03-17T09:20:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 -- 172.21.15.35:0/3823168017 learned_addr learned my addr 172.21.15.35:0/3823168017 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa80ff350 0x7fcfa81971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa8104390 0x7fcfa81a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 -- 172.21.15.35:0/3823168017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa80ff350 msgr2=0x7fcfa81971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa80ff350 0x7fcfa81971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:48.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 -- 172.21.15.35:0/3823168017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa8104390 msgr2=0x7fcfa81a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa8104390 0x7fcfa81a2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfad79e700 1 -- 172.21.15.35:0/3823168017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf980095f0 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.144+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa8104390 0x7fcfa81a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.145+0000 7fcfad79e700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa81976f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009fd0 tx=0x7fcf9800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.145+0000 7fcf9effd700 1 -- 172.21.15.35:0/3823168017 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9801d070 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.145+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa810efc0 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.145+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa810ee30 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.145+0000 7fcf9effd700 1 -- 172.21.15.35:0/3823168017 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf980059a0 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.145+0000 7fcf9effd700 1 -- 172.21.15.35:0/3823168017 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98022e70 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.147+0000 7fcf9effd700 1 -- 172.21.15.35:0/3823168017 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcf9800fb80 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.148+0000 7fcf9effd700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9409f640 0x7fcf940a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.148+0000 7fcf9effd700 1 -- 172.21.15.35:0/3823168017 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcf980cb5b0 con 0x7fcfa80ffcf0 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.148+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9409f640 0x7fcf940a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9409f640 0x7fcf940a1af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4007be0 tx=0x7fcfa40073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 Processor -- start 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 -- start start 2023-03-17T09:20:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46240fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b4623b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4623bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46142010 con 0x558b4623b960 2023-03-17T09:20:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46194950 con 0x558b462414f0 2023-03-17T09:20:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4618dde0 con 0x558b46240be0 2023-03-17T09:20:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfae7a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4623bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfae7a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4623bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44598/0 (socket says 172.21.15.35:44598) 2023-03-17T09:20:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.149+0000 7fcfae7a0700 1 -- 172.21.15.35:0/1163011219 learned_addr learned my addr 172.21.15.35:0/1163011219 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46240fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfad79e700 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b4623b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:50.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfae7a0700 1 -- 172.21.15.35:0/1163011219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 msgr2=0x558b46240fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:50.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:52 smithi035 ceph-mon[92535]: pgmap v812: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:20:50.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46240fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfae7a0700 1 -- 172.21.15.35:0/1163011219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 msgr2=0x558b4623b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b4623b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfae7a0700 1 -- 172.21.15.35:0/1163011219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b4600f5d0 con 0x558b4623b960 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46240fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4623bd90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009440 tx=0x7fcfa0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ce16ef45503935 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcf93fff700 1 -- 172.21.15.35:0/1163011219 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000e070 con 0x558b4623b960 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcf93fff700 1 -- 172.21.15.35:0/1163011219 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa000f040 con 0x558b4623b960 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.150+0000 7fcf93fff700 1 -- 172.21.15.35:0/1163011219 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0015ac0 con 0x558b4623b960 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 -- 172.21.15.35:0/1163011219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 msgr2=0x558b4623bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4623bd90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009440 tx=0x7fcfa0009920 comp rx=0 tx=0).stop 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 -- 172.21.15.35:0/1163011219 shutdown_connections 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4623bd90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46240fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/1163011219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b4623b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 -- 172.21.15.35:0/1163011219 >> 172.21.15.35:0/1163011219 conn(0x558b460986b0 msgr2=0x558b46235a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 -- 172.21.15.35:0/1163011219 shutdown_connections 2023-03-17T09:20:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 -- 172.21.15.35:0/1163011219 wait complete. 2023-03-17T09:20:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.151+0000 7fcfbc390b80 1 -- start start 2023-03-17T09:20:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 Processor -- start 2023-03-17T09:20:53.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b462473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46244640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b46244be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:20:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b460118c0 con 0x558b4623b960 2023-03-17T09:20:56.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46245350 con 0x558b462414f0 2023-03-17T09:20:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46245510 con 0x558b46240be0 2023-03-17T09:20:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfbc390b80 10 client.0 _ll_register_callbacks cb 0x558b46033230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:20:58.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfadf9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b462473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfadf9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b462473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44600/0 (socket says 172.21.15.35:44600) 2023-03-17T09:20:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfadf9f700 1 -- 172.21.15.35:0/628955285 learned_addr learned my addr 172.21.15.35:0/628955285 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:20:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfad79e700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46244640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:20:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.152+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b46244be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfadf9f700 1 -- 172.21.15.35:0/628955285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 msgr2=0x558b46244640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46244640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfadf9f700 1 -- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 msgr2=0x558b46244be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b46244be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfadf9f700 1 -- 172.21.15.35:0/628955285 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00090f0 con 0x558b4623b960 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b462473c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4004360 tx=0x7fcfa40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ed8a85628d085f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcf917fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcf917fa700 1 -- 172.21.15.35:0/628955285 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4010b00 con 0x558b4623b960 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcf917fa700 1 -- 172.21.15.35:0/628955285 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcfa4017070 con 0x558b4623b960 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b46150390 con 0x558b4623b960 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcf917fa700 1 -- 172.21.15.35:0/628955285 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa4003a90 con 0x558b4623b960 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfbc390b80 10 client.16356 fetch_fsmap learned FSMap version 30 2023-03-17T09:21:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558b45fbbd80 con 0x558b4623b960 2023-03-17T09:21:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.153+0000 7fcf917fa700 1 -- 172.21.15.35:0/628955285 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558b46150390 con 0x558b4623b960 2023-03-17T09:21:01.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcf917fa700 1 -- 172.21.15.35:0/628955285 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcfa4020410 con 0x558b4623b960 2023-03-17T09:21:01.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfbc390b80 10 client.16356 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:21:01.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfbc390b80 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:21:01.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfbc390b80 20 client.16356 populate_metadata read hostname 'smithi035' 2023-03-17T09:21:01.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b46255090 0x558b462574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:01.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfbc390b80 4 client.16356 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b4615c600 con 0x558b46255090 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfad79e700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b46255090 0x558b462574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcf917fa700 10 client.16356 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.154+0000 7fcfad79e700 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b46255090 0x558b462574a0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c927e43d928c32 server_cookie=53d9803d097fa53d in_seq=0 out_seq=0 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcf917fa700 1 -- 172.21.15.35:0/628955285 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558b4615c600 con 0x558b46255090 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcf917fa700 10 client.16356 handle_command_reply: tid=0 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 client.16356 shutdown 2023-03-17T09:21:01.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 msgr2=0x558b462473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:01.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b462473c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4004360 tx=0x7fcfa40047c0 comp rx=0 tx=0).stop 2023-03-17T09:21:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 shutdown_connections 2023-03-17T09:21:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b46255090 0x558b462574a0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b462414f0 0x558b46244be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b462473c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/628955285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b46244640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcf917fa700 0 client.16356 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 >> 172.21.15.35:0/628955285 conn(0x558b460986b0 msgr2=0x558b46235a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 shutdown_connections 2023-03-17T09:21:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 1 -- 172.21.15.35:0/628955285 wait complete. 2023-03-17T09:21:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.155+0000 7fcfbc390b80 20 client.16356 trim_cache size 0 max 16384 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.170+0000 7fcfbc390b80 1 Processor -- start 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.170+0000 7fcfbc390b80 1 -- start start 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b4623b960 0x558b46235ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b462420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 0x558b4624bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46252770 con 0x558b462414f0 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b462366f0 con 0x558b4623b960 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b46245780 con 0x558b46240be0 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 0x558b4624bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 0x558b4624bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44612/0 (socket says 172.21.15.35:44612) 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 -- 172.21.15.35:0/2175591273 learned_addr learned my addr 172.21.15.35:0/2175591273 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfad79e700 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b462420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b4623b960 0x558b46235ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 -- 172.21.15.35:0/2175591273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 msgr2=0x558b462420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b462420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 -- 172.21.15.35:0/2175591273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b4623b960 msgr2=0x558b46235ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b4623b960 0x558b46235ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 -- 172.21.15.35:0/2175591273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b46154130 con 0x558b462414f0 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 0x558b4624bf70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0018000 tx=0x7fcfa00095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4aa35f9f312ead server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.171+0000 7fcf9cff9700 1 -- 172.21.15.35:0/2175591273 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000e040 con 0x558b462414f0 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcf9cff9700 1 -- 172.21.15.35:0/2175591273 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa0003e90 con 0x558b462414f0 2023-03-17T09:21:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcf9cff9700 1 -- 172.21.15.35:0/2175591273 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0004770 con 0x558b462414f0 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 -- 172.21.15.35:0/2175591273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 msgr2=0x558b4624bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 0x558b4624bf70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0018000 tx=0x7fcfa00095e0 comp rx=0 tx=0).stop 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 -- 172.21.15.35:0/2175591273 shutdown_connections 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b462414f0 0x558b4624bf70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b4623b960 0x558b46235ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/2175591273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b46240be0 0x558b462420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 -- 172.21.15.35:0/2175591273 >> 172.21.15.35:0/2175591273 conn(0x558b460986b0 msgr2=0x558b46241990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 -- 172.21.15.35:0/2175591273 shutdown_connections 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.172+0000 7fcfbc390b80 1 -- 172.21.15.35:0/2175591273 wait complete. 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 -- start start 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 Processor -- start 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4624bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b46240be0 0x558b4623c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b462414f0 0x558b4623cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4623d360 con 0x558b4623b960 2023-03-17T09:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4623d4d0 con 0x558b46240be0 2023-03-17T09:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b462ad300 con 0x558b462414f0 2023-03-17T09:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfbc390b80 10 client.0 _ll_register_callbacks cb 0x558b46033230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:21:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfadf9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4624bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfadf9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4624bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44614/0 (socket says 172.21.15.35:44614) 2023-03-17T09:21:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfadf9f700 1 -- 172.21.15.35:0/475437823 learned_addr learned my addr 172.21.15.35:0/475437823 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.173+0000 7fcfad79e700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b46240be0 0x558b4623c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfae7a0700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b462414f0 0x558b4623cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfadf9f700 1 -- 172.21.15.35:0/475437823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b462414f0 msgr2=0x558b4623cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b462414f0 0x558b4623cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfadf9f700 1 -- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b46240be0 msgr2=0x558b4623c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b46240be0 0x558b4623c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfadf9f700 1 -- 172.21.15.35:0/475437823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b4600f5d0 con 0x558b4623b960 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfad79e700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b46240be0 0x558b4623c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfadf9f700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4624bf80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4004360 tx=0x7fcfa4004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa7e970d302260a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcf917fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcf917fa700 1 -- 172.21.15.35:0/475437823 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4003ca0 con 0x558b4623b960 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcf917fa700 1 -- 172.21.15.35:0/475437823 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcfa4017070 con 0x558b4623b960 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b4620b1e0 con 0x558b4623b960 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcf917fa700 1 -- 172.21.15.35:0/475437823 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa4007930 con 0x558b4623b960 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfbc390b80 10 client.16362 fetch_fsmap learned FSMap version 30 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558b45fe21f0 con 0x558b4623b960 2023-03-17T09:21:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.174+0000 7fcf917fa700 1 -- 172.21.15.35:0/475437823 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558b4620b1e0 con 0x558b4623b960 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcf917fa700 1 -- 172.21.15.35:0/475437823 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcfa40299f0 con 0x558b4623b960 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfbc390b80 10 client.16362 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfbc390b80 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfbc390b80 20 client.16362 populate_metadata read hostname 'smithi035' 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b462ae910 0x558b462b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfbc390b80 4 client.16362 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558b46011f00 con 0x558b462ae910 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfad79e700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b462ae910 0x558b462b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcf917fa700 10 client.16362 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.175+0000 7fcfad79e700 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b462ae910 0x558b462b0d20 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=517540750be1daf9 server_cookie=c1ec7bc011b25ce8 in_seq=0 out_seq=0 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcf917fa700 1 -- 172.21.15.35:0/475437823 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558b46011f00 con 0x558b462ae910 2023-03-17T09:21:09.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcf917fa700 10 client.16362 handle_command_reply: tid=0 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 client.16362 shutdown 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 msgr2=0x558b4624bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4624bf80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4004360 tx=0x7fcfa4004670 comp rx=0 tx=0).stop 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 shutdown_connections 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558b462ae910 0x558b462b0d20 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558b462414f0 0x558b4623cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558b4623b960 0x558b4624bf80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 --2- 172.21.15.35:0/475437823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558b46240be0 0x558b4623c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcf917fa700 0 client.16362 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 >> 172.21.15.35:0/475437823 conn(0x558b460986b0 msgr2=0x558b46242150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 shutdown_connections 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 1 -- 172.21.15.35:0/475437823 wait complete. 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.180+0000 7fcfbc390b80 20 client.16362 trim_cache size 0 max 16384 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9409f640 msgr2=0x7fcf940a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9409f640 0x7fcf940a1af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4007be0 tx=0x7fcfa40073d0 comp rx=0 tx=0).stop 2023-03-17T09:21:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 msgr2=0x7fcfa81976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa81976f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009fd0 tx=0x7fcf9800f690 comp rx=0 tx=0).stop 2023-03-17T09:21:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 shutdown_connections 2023-03-17T09:21:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9409f640 0x7fcf940a1af0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfa8104390 0x7fcfa81a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa80ff350 0x7fcfa81971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:10.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:54 smithi035 ceph-mon[92535]: pgmap v813: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:21:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 --2- 172.21.15.35:0/3823168017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfa80ffcf0 0x7fcfa81976f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 >> 172.21.15.35:0/3823168017 conn(0x7fcfa8076330 msgr2=0x7fcfa80fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 shutdown_connections 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:22.181+0000 7fcfb0203700 1 -- 172.21.15.35:0/3823168017 wait complete. 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 -- 172.21.15.35:0/3479189701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101410 msgr2=0x7efca01017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 --2- 172.21.15.35:0/3479189701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101410 0x7efca01017e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efc94009990 tx=0x7efc94009ca0 comp rx=0 tx=0).stop 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 -- 172.21.15.35:0/3479189701 shutdown_connections 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 --2- 172.21.15.35:0/3479189701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca010a750 0x7efca010cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 --2- 172.21.15.35:0/3479189701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101410 0x7efca01017e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 --2- 172.21.15.35:0/3479189701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca0101d20 0x7efca010a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 -- 172.21.15.35:0/3479189701 >> 172.21.15.35:0/3479189701 conn(0x7efca0076330 msgr2=0x7efca0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 -- 172.21.15.35:0/3479189701 shutdown_connections 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.303+0000 7efca701d700 1 -- 172.21.15.35:0/3479189701 wait complete. 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 Processor -- start 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 -- start start 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca0101410 0x7efca00ff060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 0x7efca00ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca010a750 0x7efca01a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca00ffdd0 con 0x7efca0101d20 2023-03-17T09:21:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca01a4920 con 0x7efca010a750 2023-03-17T09:21:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efca701d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca01a4a60 con 0x7efca0101410 2023-03-17T09:21:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efc9ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 0x7efca00ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efc9ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 0x7efca00ff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44630/0 (socket says 172.21.15.35:44630) 2023-03-17T09:21:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.304+0000 7efc9ffff700 1 -- 172.21.15.35:0/1813723476 learned_addr learned my addr 172.21.15.35:0/1813723476 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efca55ba700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca010a750 0x7efca01a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efca4db9700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca0101410 0x7efca00ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9ffff700 1 -- 172.21.15.35:0/1813723476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca0101410 msgr2=0x7efca00ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9ffff700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca0101410 0x7efca00ff060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:14.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9ffff700 1 -- 172.21.15.35:0/1813723476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca010a750 msgr2=0x7efca01a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9ffff700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca010a750 0x7efca01a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9ffff700 1 -- 172.21.15.35:0/1813723476 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940095f0 con 0x7efca0101d20 2023-03-17T09:21:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9ffff700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 0x7efca00ff5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00d950 tx=0x7efc8c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9dffb700 1 -- 172.21.15.35:0/1813723476 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c009940 con 0x7efca0101d20 2023-03-17T09:21:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9dffb700 1 -- 172.21.15.35:0/1813723476 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc8c010460 con 0x7efca0101d20 2023-03-17T09:21:15.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca01100b0 con 0x7efca0101d20 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efc9dffb700 1 -- 172.21.15.35:0/1813723476 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00f620 con 0x7efca0101d20 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.305+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca010ff20 con 0x7efca0101d20 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.308+0000 7efc9dffb700 1 -- 172.21.15.35:0/1813723476 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7efc8c0105d0 con 0x7efca0101d20 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.308+0000 7efc9dffb700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efc9009f6c0 0x7efc900a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.308+0000 7efca4db9700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efc9009f6c0 0x7efc900a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.308+0000 7efc9dffb700 1 -- 172.21.15.35:0/1813723476 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efc8c0ca3b0 con 0x7efca0101d20 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.309+0000 7efca4db9700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efc9009f6c0 0x7efc900a1b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efc94006010 tx=0x7efc9400b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.309+0000 7efcb31aab80 1 Processor -- start 2023-03-17T09:21:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.309+0000 7efcb31aab80 1 -- start start 2023-03-17T09:21:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.309+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459b3ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b3a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b3ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efcb31aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459a41010 con 0x55f459b3fbe0 2023-03-17T09:21:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efcb31aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459a93950 con 0x55f459b404f0 2023-03-17T09:21:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efcb31aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459a8cde0 con 0x55f459b3a960 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459b3ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459b3ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44636/0 (socket says 172.21.15.35:44636) 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 -- 172.21.15.35:0/2944858863 learned_addr learned my addr 172.21.15.35:0/2944858863 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efc9ffff700 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b3a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca55ba700 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b3ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 -- 172.21.15.35:0/2944858863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 msgr2=0x55f459b3ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b3ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 -- 172.21.15.35:0/2944858863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 msgr2=0x55f459b3a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b3a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 -- 172.21.15.35:0/2944858863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f45990e5d0 con 0x55f459b3fbe0 2023-03-17T09:21:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efc9ffff700 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b3a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:21:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efca4db9700 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459b3ffb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efc940059d0 tx=0x7efc9401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37179975805a3846 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efc8affd700 1 -- 172.21.15.35:0/2944858863 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9402b070 con 0x55f459b3fbe0 2023-03-17T09:21:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efc8affd700 1 -- 172.21.15.35:0/2944858863 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc9401e040 con 0x55f459b3fbe0 2023-03-17T09:21:20.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.310+0000 7efc8affd700 1 -- 172.21.15.35:0/2944858863 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94004db0 con 0x55f459b3fbe0 2023-03-17T09:21:20.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 -- 172.21.15.35:0/2944858863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 msgr2=0x55f459b3ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:20.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459b3ffb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efc940059d0 tx=0x7efc9401f000 comp rx=0 tx=0).stop 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 -- 172.21.15.35:0/2944858863 shutdown_connections 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b3ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459b3ffb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2944858863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b3a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 -- 172.21.15.35:0/2944858863 >> 172.21.15.35:0/2944858863 conn(0x55f4599976b0 msgr2=0x55f459b34a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 -- 172.21.15.35:0/2944858863 shutdown_connections 2023-03-17T09:21:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.311+0000 7efcb31aab80 1 -- 172.21.15.35:0/2944858863 wait complete. 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 -- start start 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 Processor -- start 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b46380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3fbe0 0x55f459b43600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b43b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4599108c0 con 0x55f459b404f0 2023-03-17T09:21:21.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b442d0 con 0x55f459b3fbe0 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b44490 con 0x55f459b3a960 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efcb31aab80 10 client.0 _ll_register_callbacks cb 0x55f459932230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efca55ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b43b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efca55ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b43b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44646/0 (socket says 172.21.15.35:44646) 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efca55ba700 1 -- 172.21.15.35:0/3665275618 learned_addr learned my addr 172.21.15.35:0/3665275618 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.312+0000 7efc9ffff700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3fbe0 0x55f459b43600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca4db9700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b46380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:22.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca55ba700 1 -- 172.21.15.35:0/3665275618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 msgr2=0x55f459b46380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:22.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca55ba700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b46380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca55ba700 1 -- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3fbe0 msgr2=0x55f459b43600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca55ba700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3fbe0 0x55f459b43600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca55ba700 1 -- 172.21.15.35:0/3665275618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca010d880 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efca55ba700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b43b60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efc98011e10 tx=0x7efc98014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bee87bfc27f2e8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efc7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efc7ffff700 1 -- 172.21.15.35:0/3665275618 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800e040 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efc7ffff700 1 -- 172.21.15.35:0/3665275618 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efc98003a00 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f459a4f390 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efc7ffff700 1 -- 172.21.15.35:0/3665275618 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc98003bc0 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efcb31aab80 10 client.16374 fetch_fsmap learned FSMap version 30 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.313+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f4598bad80 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efc7ffff700 1 -- 172.21.15.35:0/3665275618 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f459a4f390 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efc7ffff700 1 -- 172.21.15.35:0/3665275618 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efc9801c070 con 0x55f459b404f0 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efcb31aab80 10 client.16374 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:21:24.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efcb31aab80 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:21:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efcb31aab80 20 client.16374 populate_metadata read hostname 'smithi035' 2023-03-17T09:21:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efcb31aab80 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459b54010 0x55f459b56420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efcb31aab80 4 client.16374 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:21:24.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f459a5b600 con 0x55f459b54010 2023-03-17T09:21:24.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efca4db9700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459b54010 0x55f459b56420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:24.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efc7ffff700 10 client.16374 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:24.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.314+0000 7efca4db9700 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459b54010 0x55f459b56420 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db72f4a7426fe082 server_cookie=30f7e8c803c85757 in_seq=0 out_seq=0 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efc7ffff700 1 -- 172.21.15.35:0/3665275618 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f459a5b600 con 0x55f459b54010 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efc7ffff700 10 client.16374 handle_command_reply: tid=0 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 client.16374 shutdown 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 msgr2=0x55f459b43b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b43b60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efc98011e10 tx=0x7efc98014600 comp rx=0 tx=0).stop 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 shutdown_connections 2023-03-17T09:21:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459b54010 0x55f459b56420 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b43b60 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459b46380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 --2- 172.21.15.35:0/3665275618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3fbe0 0x55f459b43600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efc7ffff700 0 client.16374 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 >> 172.21.15.35:0/3665275618 conn(0x55f4599976b0 msgr2=0x55f459b39410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.315+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 shutdown_connections 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.316+0000 7efcb31aab80 1 -- 172.21.15.35:0/3665275618 wait complete. 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.316+0000 7efcb31aab80 20 client.16374 trim_cache size 0 max 16384 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.330+0000 7efcb31aab80 1 Processor -- start 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 -- start start 2023-03-17T09:21:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3a960 0x55f459b3dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:28.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3fbe0 0x55f459b34ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:28.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b4aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:28.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b35000 con 0x55f459b404f0 2023-03-17T09:21:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b46980 con 0x55f459b3a960 2023-03-17T09:21:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efcb31aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b315c0 con 0x55f459b3fbe0 2023-03-17T09:21:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b4aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b4aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44654/0 (socket says 172.21.15.35:44654) 2023-03-17T09:21:29.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 -- 172.21.15.35:0/2063368829 learned_addr learned my addr 172.21.15.35:0/2063368829 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efc9ffff700 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3fbe0 0x55f459b34ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca4db9700 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3a960 0x55f459b3dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 -- 172.21.15.35:0/2063368829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3fbe0 msgr2=0x55f459b34ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3fbe0 0x55f459b34ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 -- 172.21.15.35:0/2063368829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3a960 msgr2=0x55f459b3dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3a960 0x55f459b3dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 -- 172.21.15.35:0/2063368829 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f459a53130 con 0x55f459b404f0 2023-03-17T09:21:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca4db9700 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3a960 0x55f459b3dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:21:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.331+0000 7efca55ba700 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b4aec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efc98009510 tx=0x7efc98006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e393f216fda97b39 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efc8b7fe700 1 -- 172.21.15.35:0/2063368829 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800e070 con 0x55f459b404f0 2023-03-17T09:21:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efc8b7fe700 1 -- 172.21.15.35:0/2063368829 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc9800f040 con 0x55f459b404f0 2023-03-17T09:21:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efc8b7fe700 1 -- 172.21.15.35:0/2063368829 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98027440 con 0x55f459b404f0 2023-03-17T09:21:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 -- 172.21.15.35:0/2063368829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 msgr2=0x55f459b4aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b4aec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efc98009510 tx=0x7efc98006000 comp rx=0 tx=0).stop 2023-03-17T09:21:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 -- 172.21.15.35:0/2063368829 shutdown_connections 2023-03-17T09:21:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b404f0 0x55f459b4aec0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b3a960 0x55f459b3dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 --2- 172.21.15.35:0/2063368829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3fbe0 0x55f459b34ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 -- 172.21.15.35:0/2063368829 >> 172.21.15.35:0/2063368829 conn(0x55f4599976b0 msgr2=0x55f459b3d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 -- 172.21.15.35:0/2063368829 shutdown_connections 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.332+0000 7efcb31aab80 1 -- 172.21.15.35:0/2063368829 wait complete. 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 -- start start 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 Processor -- start 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459ba1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459ba1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:56 smithi035 ceph-mon[92535]: pgmap v814: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:11:58 smithi035 ceph-mon[92535]: pgmap v815: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:00 smithi035 ceph-mon[92535]: pgmap v816: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:02 smithi035 ceph-mon[92535]: pgmap v817: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:04 smithi035 ceph-mon[92535]: pgmap v818: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:06 smithi035 ceph-mon[92535]: pgmap v819: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:21:33.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:08 smithi035 ceph-mon[92535]: pgmap v820: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:21:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:09 smithi035 ceph-mon[92535]: osdmap e127: 12 total, 12 up, 12 in 2023-03-17T09:21:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:10 smithi035 ceph-mon[92535]: pgmap v822: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:21:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:12 smithi035 ceph-mon[92535]: pgmap v823: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:21:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:14 smithi035 ceph-mon[92535]: pgmap v824: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:21:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:16 smithi035 ceph-mon[92535]: osdmap e128: 12 total, 12 up, 12 in 2023-03-17T09:21:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:16 smithi035 ceph-mon[92535]: pgmap v826: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:21:35.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:18 smithi035 ceph-mon[92535]: pgmap v827: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:21:35.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:20 smithi035 ceph-mon[92535]: pgmap v828: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:21:35.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:22 smithi035 ceph-mon[92535]: pgmap v829: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:21:35.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:24 smithi035 ceph-mon[92535]: pgmap v830: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:21:35.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:26 smithi035 ceph-mon[92535]: pgmap v831: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:21:35.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:28 smithi035 ceph-mon[92535]: pgmap v832: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:21:35.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:30 smithi035 ceph-mon[92535]: pgmap v833: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:35.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:32 smithi035 ceph-mon[92535]: pgmap v834: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:36.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:34 smithi035 ceph-mon[92535]: pgmap v835: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:21:36.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:36 smithi035 ceph-mon[92535]: pgmap v836: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:36.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:38 smithi035 ceph-mon[92535]: pgmap v837: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:40 smithi035 ceph-mon[92535]: pgmap v838: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:42 smithi035 ceph-mon[92535]: pgmap v839: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:44 smithi035 ceph-mon[92535]: pgmap v840: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:46 smithi035 ceph-mon[92535]: pgmap v841: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:48 smithi035 ceph-mon[92535]: pgmap v842: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:50 smithi035 ceph-mon[92535]: pgmap v843: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:52 smithi035 ceph-mon[92535]: pgmap v844: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:54 smithi035 ceph-mon[92535]: pgmap v845: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:56 smithi035 ceph-mon[92535]: pgmap v846: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:12:58 smithi035 ceph-mon[92535]: pgmap v847: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:00 smithi035 ceph-mon[92535]: pgmap v848: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:02 smithi035 ceph-mon[92535]: pgmap v849: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:21:37.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:21:37.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:21:37.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:21:38.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:04 smithi035 ceph-mon[92535]: pgmap v850: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T09:21:38.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:06 smithi035 ceph-mon[92535]: pgmap v851: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:21:38.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:08 smithi035 ceph-mon[92535]: pgmap v852: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:21:38.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:09 smithi035 ceph-mon[92535]: osdmap e129: 12 total, 12 up, 12 in 2023-03-17T09:21:38.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:10 smithi035 ceph-mon[92535]: pgmap v854: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:21:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:21:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:21:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:21:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:21:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:21:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:21:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:21:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b9be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b9c410 con 0x55f459b3fbe0 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b9c580 con 0x55f459b404f0 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f459b9c740 con 0x55f459b3a960 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efcb31aab80 10 client.0 _ll_register_callbacks cb 0x55f459932230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efc9ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459ba1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efc9ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459ba1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44658/0 (socket says 172.21.15.35:44658) 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efc9ffff700 1 -- 172.21.15.35:0/1238920803 learned_addr learned my addr 172.21.15.35:0/1238920803 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efca4db9700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459ba1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.333+0000 7efca55ba700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b9be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc9ffff700 1 -- 172.21.15.35:0/1238920803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 msgr2=0x55f459ba1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc9ffff700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459ba1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc9ffff700 1 -- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 msgr2=0x55f459b9be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc9ffff700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b9be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc9ffff700 1 -- 172.21.15.35:0/1238920803 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4598bad80 con 0x55f459b3fbe0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc9ffff700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459ba1b60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0c7ba0 tx=0x7efc8c097d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc7c2b1a860222d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc7ffff700 1 -- 172.21.15.35:0/1238920803 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c097350 con 0x55f459b3fbe0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc7ffff700 1 -- 172.21.15.35:0/1238920803 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efc8c0af070 con 0x55f459b3fbe0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f459b0a1e0 con 0x55f459b3fbe0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc7ffff700 1 -- 172.21.15.35:0/1238920803 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc8c0974b0 con 0x55f459b3fbe0 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efcb31aab80 10 client.16380 fetch_fsmap learned FSMap version 30 2023-03-17T09:21:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f4598e11f0 con 0x55f459b3fbe0 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.334+0000 7efc7ffff700 1 -- 172.21.15.35:0/1238920803 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f459b0a1e0 con 0x55f459b3fbe0 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efc7ffff700 1 -- 172.21.15.35:0/1238920803 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efc8c096ec0 con 0x55f459b3fbe0 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efcb31aab80 10 client.16380 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efcb31aab80 10 client.16380 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efcb31aab80 20 client.16380 populate_metadata read hostname 'smithi035' 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efcb31aab80 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459ba9470 0x55f459bab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efcb31aab80 4 client.16380 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:21:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f459910f00 con 0x55f459ba9470 2023-03-17T09:21:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efca4db9700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459ba9470 0x55f459bab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efc7ffff700 10 client.16380 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.335+0000 7efca4db9700 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459ba9470 0x55f459bab880 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cf13cd5efddc942 server_cookie=ff3a917f3f66254b in_seq=0 out_seq=0 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.339+0000 7efc7ffff700 1 -- 172.21.15.35:0/1238920803 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f459910f00 con 0x55f459ba9470 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.339+0000 7efc7ffff700 10 client.16380 handle_command_reply: tid=0 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.339+0000 7efcb31aab80 1 client.16380 shutdown 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.339+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 msgr2=0x55f459ba1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.339+0000 7efcb31aab80 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459ba1b60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0c7ba0 tx=0x7efc8c097d60 comp rx=0 tx=0).stop 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 shutdown_connections 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f459ba9470 0x55f459bab880 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f459b404f0 0x55f459b9be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efc7ffff700 0 client.16380 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f459b3a960 0x55f459ba1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 --2- 172.21.15.35:0/1238920803 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f459b3fbe0 0x55f459ba1b60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 >> 172.21.15.35:0/1238920803 conn(0x55f4599976b0 msgr2=0x55f459b39410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 shutdown_connections 2023-03-17T09:21:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 1 -- 172.21.15.35:0/1238920803 wait complete. 2023-03-17T09:21:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efcb31aab80 20 client.16380 trim_cache size 0 max 16384 2023-03-17T09:21:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efc9009f6c0 msgr2=0x7efc900a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:44.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efca701d700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efc9009f6c0 0x7efc900a1b70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efc94006010 tx=0x7efc9400b260 comp rx=0 tx=0).stop 2023-03-17T09:21:44.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 msgr2=0x7efca00ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.340+0000 7efca701d700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 0x7efca00ff5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00d950 tx=0x7efc8c00dc60 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 shutdown_connections 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efc9009f6c0 0x7efc900a1b70 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efc94006010 tx=0x7efc9400b260 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efca010a750 0x7efca01a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efca0101410 0x7efca00ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 --2- 172.21.15.35:0/1813723476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efca0101d20 0x7efca00ff5a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 >> 172.21.15.35:0/1813723476 conn(0x7efca0076330 msgr2=0x7efca01021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 shutdown_connections 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:35.341+0000 7efca701d700 1 -- 172.21.15.35:0/1813723476 wait complete. 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 -- 172.21.15.35:0/1782741498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 msgr2=0x7f799c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 --2- 172.21.15.35:0/1782741498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c10bf60 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f799400b0d0 tx=0x7f799400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 -- 172.21.15.35:0/1782741498 shutdown_connections 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 --2- 172.21.15.35:0/1782741498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c10bf60 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:45.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 --2- 172.21.15.35:0/1782741498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f799c0ff350 0x7f799c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:45.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 --2- 172.21.15.35:0/1782741498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c0ffcf0 0x7f799c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 -- 172.21.15.35:0/1782741498 >> 172.21.15.35:0/1782741498 conn(0x7f799c076330 msgr2=0x7f799c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 -- 172.21.15.35:0/1782741498 shutdown_connections 2023-03-17T09:21:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 -- 172.21.15.35:0/1782741498 wait complete. 2023-03-17T09:21:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.465+0000 7f79a2562700 1 Processor -- start 2023-03-17T09:21:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 -- start start 2023-03-17T09:21:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c0ff350 0x7f799c100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f799c0ffcf0 0x7f799c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c1a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c101ac0 con 0x7f799c104390 2023-03-17T09:21:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1a4ac0 con 0x7f799c0ff350 2023-03-17T09:21:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a2562700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1a4c00 con 0x7f799c0ffcf0 2023-03-17T09:21:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c1a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c1a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44674/0 (socket says 172.21.15.35:44674) 2023-03-17T09:21:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 -- 172.21.15.35:0/3645372676 learned_addr learned my addr 172.21.15.35:0/3645372676 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f799bfff700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c0ff350 0x7f799c100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:47.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f799b7fe700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f799c0ffcf0 0x7f799c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 -- 172.21.15.35:0/3645372676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f799c0ffcf0 msgr2=0x7f799c101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f799c0ffcf0 0x7f799c101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 -- 172.21.15.35:0/3645372676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c0ff350 msgr2=0x7f799c100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c0ff350 0x7f799c100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.466+0000 7f79a0aff700 1 -- 172.21.15.35:0/3645372676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994009d00 con 0x7f799c104390 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.467+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c1a4580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7994009fd0 tx=0x7f799400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.467+0000 7f79997fa700 1 -- 172.21.15.35:0/3645372676 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799400e040 con 0x7f799c104390 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.467+0000 7f79997fa700 1 -- 172.21.15.35:0/3645372676 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7994003e10 con 0x7f799c104390 2023-03-17T09:21:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.467+0000 7f79997fa700 1 -- 172.21.15.35:0/3645372676 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940052a0 con 0x7f799c104390 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.467+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c10f010 con 0x7f799c104390 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.467+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c10ee80 con 0x7f799c104390 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.470+0000 7f79997fa700 1 -- 172.21.15.35:0/3645372676 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7994005400 con 0x7f799c104390 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.470+0000 7f79997fa700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f798409f640 0x7f79840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.470+0000 7f79997fa700 1 -- 172.21.15.35:0/3645372676 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f79940cb810 con 0x7f799c104390 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.470+0000 7f799bfff700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f798409f640 0x7f79840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.471+0000 7f799bfff700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f798409f640 0x7f79840a1af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f798c009c60 tx=0x7f798c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.471+0000 7f79ae6efb80 1 Processor -- start 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.471+0000 7f79ae6efb80 1 -- start start 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091963fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x56109195e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109195ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561091865010 con 0x5610919644f0 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610918b7950 con 0x561091963be0 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610918b0de0 con 0x56109195e960 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x56109195e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x56109195e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44680/0 (socket says 172.21.15.35:44680) 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091963fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 -- 172.21.15.35:0/3516050666 learned_addr learned my addr 172.21.15.35:0/3516050666 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109195ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 -- 172.21.15.35:0/3516050666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 msgr2=0x56109195ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109195ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 -- 172.21.15.35:0/3516050666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 msgr2=0x561091963fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091963fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 -- 172.21.15.35:0/3516050666 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610917325d0 con 0x5610919644f0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f799b7fe700 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x56109195e420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f79900046c0 tx=0x7f799000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70671dc3423882b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79827fc700 1 -- 172.21.15.35:0/3516050666 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990004a30 con 0x5610919644f0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79827fc700 1 -- 172.21.15.35:0/3516050666 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f799000fce0 con 0x5610919644f0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.472+0000 7f79827fc700 1 -- 172.21.15.35:0/3516050666 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900054a0 con 0x5610919644f0 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3516050666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 msgr2=0x56109195e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x56109195e420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f79900046c0 tx=0x7f799000de50 comp rx=0 tx=0).stop 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3516050666 shutdown_connections 2023-03-17T09:21:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109195ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091963fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3516050666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x56109195e420 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3516050666 >> 172.21.15.35:0/3516050666 conn(0x5610917bb6b0 msgr2=0x561091958a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3516050666 shutdown_connections 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.473+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3516050666 wait complete. 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 -- start start 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 Processor -- start 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56109195e960 0x56109196a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561091963be0 0x561091967650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x561091967c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610917348c0 con 0x5610919644f0 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561091968380 con 0x56109195e960 2023-03-17T09:21:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561091974000 con 0x561091963be0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79ae6efb80 10 client.0 _ll_register_callbacks cb 0x561091756230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79a0aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x561091967c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79a0aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x561091967c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44688/0 (socket says 172.21.15.35:44688) 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f79a0aff700 1 -- 172.21.15.35:0/3824535107 learned_addr learned my addr 172.21.15.35:0/3824535107 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f799bfff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56109195e960 0x56109196a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.474+0000 7f799b7fe700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561091963be0 0x561091967650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79a0aff700 1 -- 172.21.15.35:0/3824535107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561091963be0 msgr2=0x561091967650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561091963be0 0x561091967650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79a0aff700 1 -- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56109195e960 msgr2=0x56109196a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56109195e960 0x56109196a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79a0aff700 1 -- 172.21.15.35:0/3824535107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799000d7d0 con 0x5610919644f0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f799bfff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56109195e960 0x56109196a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79a0aff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x561091967c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f79940992e0 tx=0x7f7994098f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9138729bdef34a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f797b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:21:50.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f797b7fe700 1 -- 172.21.15.35:0/3824535107 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799409d150 con 0x5610919644f0 2023-03-17T09:21:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f797b7fe700 1 -- 172.21.15.35:0/3824535107 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7994099350 con 0x5610919644f0 2023-03-17T09:21:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561091873390 con 0x5610919644f0 2023-03-17T09:21:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f797b7fe700 1 -- 172.21.15.35:0/3824535107 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79940a14b0 con 0x5610919644f0 2023-03-17T09:21:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79ae6efb80 10 client.16392 fetch_fsmap learned FSMap version 30 2023-03-17T09:21:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5610916ded80 con 0x5610919644f0 2023-03-17T09:21:50.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.475+0000 7f797b7fe700 1 -- 172.21.15.35:0/3824535107 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561091873390 con 0x5610919644f0 2023-03-17T09:21:50.031 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:12 smithi035 ceph-mon[92535]: pgmap v855: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:21:50.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f797b7fe700 1 -- 172.21.15.35:0/3824535107 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f79940a1020 con 0x5610919644f0 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f79ae6efb80 10 client.16392 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f79ae6efb80 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f79ae6efb80 20 client.16392 populate_metadata read hostname 'smithi035' 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561091977e20 0x56109197a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f79ae6efb80 4 client.16392 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56109187f600 con 0x561091977e20 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f799bfff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561091977e20 0x56109197a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f797b7fe700 10 client.16392 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.476+0000 7f799bfff700 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561091977e20 0x56109197a200 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6e1f0ff7ba53123 server_cookie=9957e140cbadc8a0 in_seq=0 out_seq=0 2023-03-17T09:21:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f797b7fe700 1 -- 172.21.15.35:0/3824535107 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56109187f600 con 0x561091977e20 2023-03-17T09:21:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f797b7fe700 10 client.16392 handle_command_reply: tid=0 2023-03-17T09:21:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 client.16392 shutdown 2023-03-17T09:21:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 msgr2=0x561091967c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x561091967c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f79940992e0 tx=0x7f7994098f80 comp rx=0 tx=0).stop 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 shutdown_connections 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561091977e20 0x56109197a200 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x561091967c10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56109195e960 0x56109196a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/3824535107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561091963be0 0x561091967650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f797b7fe700 0 client.16392 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 >> 172.21.15.35:0/3824535107 conn(0x5610917bb6b0 msgr2=0x56109195d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 shutdown_connections 2023-03-17T09:21:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 1 -- 172.21.15.35:0/3824535107 wait complete. 2023-03-17T09:21:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.477+0000 7f79ae6efb80 20 client.16392 trim_cache size 0 max 16384 2023-03-17T09:21:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 Processor -- start 2023-03-17T09:21:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 -- start start 2023-03-17T09:21:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109196ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091969f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x5610919616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561091959b70 con 0x5610919644f0 2023-03-17T09:21:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610919540d0 con 0x561091963be0 2023-03-17T09:21:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.492+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610919621b0 con 0x56109195e960 2023-03-17T09:21:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x5610919616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x5610919616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44696/0 (socket says 172.21.15.35:44696) 2023-03-17T09:21:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 -- 172.21.15.35:0/1559305717 learned_addr learned my addr 172.21.15.35:0/1559305717 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f799b7fe700 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091969f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f799bfff700 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109196ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 -- 172.21.15.35:0/1559305717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 msgr2=0x56109196ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109196ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 -- 172.21.15.35:0/1559305717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 msgr2=0x561091969f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091969f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 -- 172.21.15.35:0/1559305717 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561091877130 con 0x5610919644f0 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f79a0aff700 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x5610919616b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7994095dc0 tx=0x7f799400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806be79cd6b85802 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f7982ffd700 1 -- 172.21.15.35:0/1559305717 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994098a50 con 0x5610919644f0 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f7982ffd700 1 -- 172.21.15.35:0/1559305717 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f799409d150 con 0x5610919644f0 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.493+0000 7f7982ffd700 1 -- 172.21.15.35:0/1559305717 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940b71a0 con 0x5610919644f0 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 -- 172.21.15.35:0/1559305717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 msgr2=0x5610919616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:21:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x5610919616b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7994095dc0 tx=0x7f799400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 -- 172.21.15.35:0/1559305717 shutdown_connections 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5610919644f0 0x5610919616b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x56109196ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/1559305717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561091963be0 0x561091969f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 -- 172.21.15.35:0/1559305717 >> 172.21.15.35:0/1559305717 conn(0x5610917bb6b0 msgr2=0x56109195dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 -- 172.21.15.35:0/1559305717 shutdown_connections 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 -- 172.21.15.35:0/1559305717 wait complete. 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.494+0000 7f79ae6efb80 1 -- start start 2023-03-17T09:21:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 Processor -- start 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x5610919bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 0x5610919c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5610919644f0 0x5610919c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610919cadf0 con 0x561091963be0 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610919caf60 con 0x5610919644f0 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610919cb120 con 0x56109195e960 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79ae6efb80 10 client.0 _ll_register_callbacks cb 0x561091756230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 0x5610919c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 0x5610919c0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44700/0 (socket says 172.21.15.35:44700) 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799b7fe700 1 -- 172.21.15.35:0/2438646342 learned_addr learned my addr 172.21.15.35:0/2438646342 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799bfff700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x5610919bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f79a0aff700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5610919644f0 0x5610919c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:21:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799bfff700 1 -- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5610919644f0 msgr2=0x5610919c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799bfff700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5610919644f0 0x5610919c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799bfff700 1 -- 172.21.15.35:0/2438646342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 msgr2=0x5610919c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:21:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.495+0000 7f799bfff700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 0x5610919c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:21:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f799bfff700 1 -- 172.21.15.35:0/2438646342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610916ded80 con 0x56109195e960 2023-03-17T09:21:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f799b7fe700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 0x5610919c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:21:59.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f799bfff700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x5610919bfbf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561091968590 tx=0x7f798c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e17d9f8a78b1d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f797b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f797b7fe700 1 -- 172.21.15.35:0/2438646342 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c022050 con 0x56109195e960 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f797b7fe700 1 -- 172.21.15.35:0/2438646342 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f798c02b0b0 con 0x56109195e960 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56109192e1e0 con 0x56109195e960 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f797b7fe700 1 -- 172.21.15.35:0/2438646342 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f798c02b270 con 0x56109195e960 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f79ae6efb80 10 client.26059 fetch_fsmap learned FSMap version 30 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5610917051f0 con 0x56109195e960 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.496+0000 7f797b7fe700 1 -- 172.21.15.35:0/2438646342 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56109192e1e0 con 0x56109195e960 2023-03-17T09:22:01.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f797b7fe700 1 -- 172.21.15.35:0/2438646342 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f798c029af0 con 0x56109195e960 2023-03-17T09:22:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f79ae6efb80 10 client.26059 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:22:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f79ae6efb80 10 client.26059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:22:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f79ae6efb80 20 client.26059 populate_metadata read hostname 'smithi035' 2023-03-17T09:22:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5610919cc820 0x5610919cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:01.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f79ae6efb80 4 client.26059 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:22:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561091734f00 con 0x5610919cc820 2023-03-17T09:22:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f799b7fe700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5610919cc820 0x5610919cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f797b7fe700 10 client.26059 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.497+0000 7f799b7fe700 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5610919cc820 0x5610919cec30 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55059392ee223f4d server_cookie=f2ad6cb364c51173 in_seq=0 out_seq=0 2023-03-17T09:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.501+0000 7f797b7fe700 1 -- 172.21.15.35:0/2438646342 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561091734f00 con 0x5610919cc820 2023-03-17T09:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.501+0000 7f797b7fe700 10 client.26059 handle_command_reply: tid=0 2023-03-17T09:22:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.501+0000 7f79ae6efb80 1 client.26059 shutdown 2023-03-17T09:22:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 msgr2=0x5610919bfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x5610919bfbf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561091968590 tx=0x7f798c0047c0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 shutdown_connections 2023-03-17T09:22:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5610919cc820 0x5610919cec30 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5610919644f0 0x5610919c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f797b7fe700 0 client.26059 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56109195e960 0x5610919bfbf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 --2- 172.21.15.35:0/2438646342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561091963be0 0x5610919c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 >> 172.21.15.35:0/2438646342 conn(0x5610917bb6b0 msgr2=0x5610919616b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 shutdown_connections 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 1 -- 172.21.15.35:0/2438646342 wait complete. 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79ae6efb80 20 client.26059 trim_cache size 0 max 16384 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f798409f640 msgr2=0x7f79840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79a2562700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f798409f640 0x7f79840a1af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f798c009c60 tx=0x7f798c009260 comp rx=0 tx=0).stop 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 msgr2=0x7f799c1a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.502+0000 7f79a2562700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c1a4580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7994009fd0 tx=0x7f799400cce0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 shutdown_connections 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f798409f640 0x7f79840a1af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f799c104390 0x7f799c1a4580 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f799c0ff350 0x7f799c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 --2- 172.21.15.35:0/3645372676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f799c0ffcf0 0x7f799c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 >> 172.21.15.35:0/3645372676 conn(0x7f799c076330 msgr2=0x7f799c067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 shutdown_connections 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:04:48.503+0000 7f79a2562700 1 -- 172.21.15.35:0/3645372676 wait complete. 2023-03-17T09:22:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 -- 172.21.15.35:0/1466311448 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c0ffb40 msgr2=0x7fa32c0fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 --2- 172.21.15.35:0/1466311448 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c0ffb40 0x7fa32c0fff10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0099c0 tx=0x7fa31c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 -- 172.21.15.35:0/1466311448 shutdown_connections 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 --2- 172.21.15.35:0/1466311448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa32c104440 0x7fa32c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 --2- 172.21.15.35:0/1466311448 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c0ffb40 0x7fa32c0fff10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 --2- 172.21.15.35:0/1466311448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32c1004e0 0x7fa32c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 -- 172.21.15.35:0/1466311448 >> 172.21.15.35:0/1466311448 conn(0x7fa32c074590 msgr2=0x7fa32c074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 -- 172.21.15.35:0/1466311448 shutdown_connections 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.624+0000 7fa3312a0700 1 -- 172.21.15.35:0/1466311448 wait complete. 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 Processor -- start 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 -- start start 2023-03-17T09:22:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32c0ffb40 0x7fa32c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 0x7fa32c197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa32c104440 0x7fa32c1a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1a26b0 con 0x7fa32c1004e0 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1a27f0 con 0x7fa32c104440 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.625+0000 7fa3312a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1a2930 con 0x7fa32c0ffb40 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 0x7fa32c197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 0x7fa32c197630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44714/0 (socket says 172.21.15.35:44714) 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 -- 172.21.15.35:0/3945979178 learned_addr learned my addr 172.21.15.35:0/3945979178 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32affd700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32c0ffb40 0x7fa32c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa32c104440 0x7fa32c1a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 -- 172.21.15.35:0/3945979178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32c0ffb40 msgr2=0x7fa32c1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32c0ffb40 0x7fa32c1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 -- 172.21.15.35:0/3945979178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa32c104440 msgr2=0x7fa32c1a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa32c104440 0x7fa32c1a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 -- 172.21.15.35:0/3945979178 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0095f0 con 0x7fa32c1004e0 2023-03-17T09:22:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 0x7fa32c197630 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa31400d980 tx=0x7fa31400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa323fff700 1 -- 172.21.15.35:0/3945979178 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314009930 con 0x7fa32c1004e0 2023-03-17T09:22:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c10f060 con 0x7fa32c1004e0 2023-03-17T09:22:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa323fff700 1 -- 172.21.15.35:0/3945979178 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa31400b5e0 con 0x7fa32c1004e0 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa323fff700 1 -- 172.21.15.35:0/3945979178 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400f3c0 con 0x7fa32c1004e0 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.626+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c10eed0 con 0x7fa32c1004e0 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.629+0000 7fa323fff700 1 -- 172.21.15.35:0/3945979178 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa314009a90 con 0x7fa32c1004e0 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.629+0000 7fa323fff700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa31809f640 0x7fa3180a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.629+0000 7fa323fff700 1 -- 172.21.15.35:0/3945979178 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa3140ca0d0 con 0x7fa32c1004e0 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.629+0000 7fa32affd700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa31809f640 0x7fa3180a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.630+0000 7fa32affd700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa31809f640 0x7fa3180a1af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b580 tx=0x7fa31c005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.631+0000 7fa33d42db80 1 Processor -- start 2023-03-17T09:22:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.631+0000 7fa33d42db80 1 -- start start 2023-03-17T09:22:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8d8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa33d42db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b7df010 con 0x55c57b8de4f0 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa33d42db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b831950 con 0x55c57b8d8960 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa33d42db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b82ade0 con 0x55c57b8ddbe0 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8d8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44722/0 (socket says 172.21.15.35:44722) 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 -- 172.21.15.35:0/549808506 learned_addr learned my addr 172.21.15.35:0/549808506 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 -- 172.21.15.35:0/549808506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 msgr2=0x55c57b8ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 -- 172.21.15.35:0/549808506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 msgr2=0x55c57b8d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 -- 172.21.15.35:0/549808506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57b6ac5d0 con 0x55c57b8de4f0 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.632+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8d8420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa314094690 tx=0x7fa3140977e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82be0a988a5d6b3c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.633+0000 7fa3217fa700 1 -- 172.21.15.35:0/549808506 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314014020 con 0x55c57b8de4f0 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.633+0000 7fa3217fa700 1 -- 172.21.15.35:0/549808506 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa314097c20 con 0x55c57b8de4f0 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.633+0000 7fa3217fa700 1 -- 172.21.15.35:0/549808506 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314097110 con 0x55c57b8de4f0 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.633+0000 7fa33d42db80 1 -- 172.21.15.35:0/549808506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 msgr2=0x55c57b8d8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.633+0000 7fa33d42db80 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8d8420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa314094690 tx=0x7fa3140977e0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.633+0000 7fa33d42db80 1 -- 172.21.15.35:0/549808506 shutdown_connections 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 --2- 172.21.15.35:0/549808506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8d8420 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- 172.21.15.35:0/549808506 >> 172.21.15.35:0/549808506 conn(0x55c57b7356b0 msgr2=0x55c57b8d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- 172.21.15.35:0/549808506 shutdown_connections 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- 172.21.15.35:0/549808506 wait complete. 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- start start 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 Processor -- start 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8de4f0 0x55c57b8e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b6ae8c0 con 0x55c57b8ddbe0 2023-03-17T09:22:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8e2650 con 0x55c57b8d8960 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8ee020 con 0x55c57b8de4f0 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa33d42db80 10 client.0 _ll_register_callbacks cb 0x55c57b6d0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.634+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44728/0 (socket says 172.21.15.35:44728) 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 -- 172.21.15.35:0/1167529424 learned_addr learned my addr 172.21.15.35:0/1167529424 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32affd700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8de4f0 0x55c57b8e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 -- 172.21.15.35:0/1167529424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8de4f0 msgr2=0x55c57b8e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8de4f0 0x55c57b8e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 -- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 msgr2=0x55c57b8e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 -- 172.21.15.35:0/1167529424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c10eed0 con 0x55c57b8ddbe0 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8de4f0 0x55c57b8e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e17a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa314097920 tx=0x7fa314009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53ba41848386d9d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa3127fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:22:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa3127fc700 1 -- 172.21.15.35:0/1167529424 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314014070 con 0x55c57b8ddbe0 2023-03-17T09:22:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa3127fc700 1 -- 172.21.15.35:0/1167529424 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa314097320 con 0x55c57b8ddbe0 2023-03-17T09:22:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c57b7ed390 con 0x55c57b8ddbe0 2023-03-17T09:22:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa3127fc700 1 -- 172.21.15.35:0/1167529424 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3140641a0 con 0x55c57b8ddbe0 2023-03-17T09:22:08.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.635+0000 7fa33d42db80 10 client.16410 fetch_fsmap learned FSMap version 30 2023-03-17T09:22:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c57b658d80 con 0x55c57b8ddbe0 2023-03-17T09:22:10.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa3127fc700 1 -- 172.21.15.35:0/1167529424 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c57b7ed390 con 0x55c57b8ddbe0 2023-03-17T09:22:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa3127fc700 1 -- 172.21.15.35:0/1167529424 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa31409faa0 con 0x55c57b8ddbe0 2023-03-17T09:22:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 10 client.16410 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:22:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:22:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 20 client.16410 populate_metadata read hostname 'smithi035' 2023-03-17T09:22:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b8f1c40 0x55c57b8f4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 4 client.16410 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:22:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c57b7f9600 con 0x55c57b8f1c40 2023-03-17T09:22:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.636+0000 7fa32affd700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b8f1c40 0x55c57b8f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa3127fc700 10 client.16410 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa32affd700 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b8f1c40 0x55c57b8f4020 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8656ec64d01a17e4 server_cookie=49aac200aca3a7ce in_seq=0 out_seq=0 2023-03-17T09:22:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa3127fc700 1 -- 172.21.15.35:0/1167529424 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c57b7f9600 con 0x55c57b8f1c40 2023-03-17T09:22:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa3127fc700 10 client.16410 handle_command_reply: tid=0 2023-03-17T09:22:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa33d42db80 1 client.16410 shutdown 2023-03-17T09:22:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 msgr2=0x55c57b8e17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.637+0000 7fa33d42db80 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e17a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa314097920 tx=0x7fa314009f70 comp rx=0 tx=0).stop 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 shutdown_connections 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b8f1c40 0x55c57b8f4020 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8de4f0 0x55c57b8e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa3127fc700 0 client.16410 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 --2- 172.21.15.35:0/1167529424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e17a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 >> 172.21.15.35:0/1167529424 conn(0x55c57b7356b0 msgr2=0x55c57b8d7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:13.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 shutdown_connections 2023-03-17T09:22:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 1 -- 172.21.15.35:0/1167529424 wait complete. 2023-03-17T09:22:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.638+0000 7fa33d42db80 20 client.16410 trim_cache size 0 max 16384 2023-03-17T09:22:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 Processor -- start 2023-03-17T09:22:14.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 -- start start 2023-03-17T09:22:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 0x55c57b8d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8de4f0 0x55c57b8e4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8d33b0 con 0x55c57b8d8960 2023-03-17T09:22:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8d3030 con 0x55c57b8de4f0 2023-03-17T09:22:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa33d42db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8d8380 con 0x55c57b8ddbe0 2023-03-17T09:22:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa32affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 0x55c57b8d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa32affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 0x55c57b8d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44734/0 (socket says 172.21.15.35:44734) 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.653+0000 7fa32affd700 1 -- 172.21.15.35:0/2927363516 learned_addr learned my addr 172.21.15.35:0/2927363516 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8de4f0 0x55c57b8e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32affd700 1 -- 172.21.15.35:0/2927363516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 msgr2=0x55c57b8e8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32affd700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32affd700 1 -- 172.21.15.35:0/2927363516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8de4f0 msgr2=0x55c57b8e4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:15.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32affd700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8de4f0 0x55c57b8e4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32affd700 1 -- 172.21.15.35:0/2927363516 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c57b7f1130 con 0x55c57b8d8960 2023-03-17T09:22:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8de4f0 0x55c57b8e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:22:18.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa32affd700 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 0x55c57b8d2ac0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0098e0 tx=0x7fa31c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11376a7c55845ac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:18.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa321ffb700 1 -- 172.21.15.35:0/2927363516 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c02e5b0 con 0x55c57b8d8960 2023-03-17T09:22:18.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa321ffb700 1 -- 172.21.15.35:0/2927363516 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa31c029040 con 0x55c57b8d8960 2023-03-17T09:22:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.654+0000 7fa321ffb700 1 -- 172.21.15.35:0/2927363516 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c003e10 con 0x55c57b8d8960 2023-03-17T09:22:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 -- 172.21.15.35:0/2927363516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 msgr2=0x55c57b8d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 0x55c57b8d2ac0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0098e0 tx=0x7fa31c01f000 comp rx=0 tx=0).stop 2023-03-17T09:22:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 -- 172.21.15.35:0/2927363516 shutdown_connections 2023-03-17T09:22:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8de4f0 0x55c57b8e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8d8960 0x55c57b8d2ac0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2927363516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 -- 172.21.15.35:0/2927363516 >> 172.21.15.35:0/2927363516 conn(0x55c57b7356b0 msgr2=0x55c57b8ee3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 -- 172.21.15.35:0/2927363516 shutdown_connections 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 -- 172.21.15.35:0/2927363516 wait complete. 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 -- start start 2023-03-17T09:22:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.655+0000 7fa33d42db80 1 Processor -- start 2023-03-17T09:22:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8e74a0 con 0x55c57b8de4f0 2023-03-17T09:22:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8e7610 con 0x55c57b8d8960 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c57b8e77d0 con 0x55c57b8ddbe0 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa33d42db80 10 client.0 _ll_register_callbacks cb 0x55c57b6d0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44744/0 (socket says 172.21.15.35:44744) 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 -- 172.21.15.35:0/2910023900 learned_addr learned my addr 172.21.15.35:0/2910023900 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32a7fc700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32affd700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 -- 172.21.15.35:0/2910023900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 msgr2=0x55c57b8e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 -- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 msgr2=0x55c57b8e88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32b7fe700 1 -- 172.21.15.35:0/2910023900 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c10c800 con 0x55c57b8de4f0 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.656+0000 7fa32affd700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:20.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa32b7fe700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8e6ed0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa324007ab0 tx=0x7fa324007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f11fe303048ba3b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa3127fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:22:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa3127fc700 1 -- 172.21.15.35:0/2910023900 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32400e070 con 0x55c57b8de4f0 2023-03-17T09:22:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c57b8a81e0 con 0x55c57b8de4f0 2023-03-17T09:22:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa3127fc700 1 -- 172.21.15.35:0/2910023900 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa324004bb0 con 0x55c57b8de4f0 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa3127fc700 1 -- 172.21.15.35:0/2910023900 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa324004db0 con 0x55c57b8de4f0 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 10 client.16416 fetch_fsmap learned FSMap version 30 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c57b67f1f0 con 0x55c57b8de4f0 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa3127fc700 1 -- 172.21.15.35:0/2910023900 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c57b8a81e0 con 0x55c57b8de4f0 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa3127fc700 1 -- 172.21.15.35:0/2910023900 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 30) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa324017ad0 con 0x55c57b8de4f0 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 10 client.16416 fetch_fsmap finished waiting for FSMap version 30 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 20 client.16416 populate_metadata read hostname 'smithi035' 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b946c00 0x55c57b949010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 4 client.16416 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.657+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c57b6aef00 con 0x55c57b946c00 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.658+0000 7fa32affd700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b946c00 0x55c57b949010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.658+0000 7fa3127fc700 10 client.16416 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:01.658+0000 7fa32affd700 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b946c00 0x55c57b949010 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902098a8d78cfb3c server_cookie=c38b69365d2664ad in_seq=0 out_seq=0 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa3127fc700 1 -- 172.21.15.35:0/2910023900 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c57b6aef00 con 0x55c57b946c00 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa3127fc700 10 client.16416 handle_command_reply: tid=0 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 client.16416 shutdown 2023-03-17T09:22:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 msgr2=0x55c57b8e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8e6ed0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa324007ab0 tx=0x7fa324007dc0 comp rx=0 tx=0).stop 2023-03-17T09:22:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 shutdown_connections 2023-03-17T09:22:23.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c57b946c00 0x55c57b949010 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c57b8de4f0 0x55c57b8e6ed0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c57b8d8960 0x55c57b8e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa3127fc700 0 client.16416 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 --2- 172.21.15.35:0/2910023900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c57b8ddbe0 0x55c57b8e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 >> 172.21.15.35:0/2910023900 conn(0x55c57b7356b0 msgr2=0x55c57b8e4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 shutdown_connections 2023-03-17T09:22:24.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 1 -- 172.21.15.35:0/2910023900 wait complete. 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.226+0000 7fa33d42db80 20 client.16416 trim_cache size 0 max 16384 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa31809f640 msgr2=0x7fa3180a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa31809f640 0x7fa3180a1af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b580 tx=0x7fa31c005c00 comp rx=0 tx=0).stop 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 msgr2=0x7fa32c197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 0x7fa32c197630 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa31400d980 tx=0x7fa31400dc90 comp rx=0 tx=0).stop 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 shutdown_connections 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa31809f640 0x7fa3180a1af0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:24.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa32c104440 0x7fa32c1a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:24.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32c0ffb40 0x7fa32c1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:24.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 --2- 172.21.15.35:0/3945979178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa32c1004e0 0x7fa32c197630 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:24.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 >> 172.21.15.35:0/3945979178 conn(0x7fa32c074590 msgr2=0x7fa32c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 shutdown_connections 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:03.227+0000 7fa3312a0700 1 -- 172.21.15.35:0/3945979178 wait complete. 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 -- 172.21.15.35:0/2211074853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 msgr2=0x7fb05010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 --2- 172.21.15.35:0/2211074853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb05010bf60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb04800b0d0 tx=0x7fb04800b3e0 comp rx=0 tx=0).stop 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 -- 172.21.15.35:0/2211074853 shutdown_connections 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 --2- 172.21.15.35:0/2211074853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb05010bf60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 --2- 172.21.15.35:0/2211074853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0500ff350 0x7fb0500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 --2- 172.21.15.35:0/2211074853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 0x7fb050103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 -- 172.21.15.35:0/2211074853 >> 172.21.15.35:0/2211074853 conn(0x7fb050076330 msgr2=0x7fb050076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 -- 172.21.15.35:0/2211074853 shutdown_connections 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.352+0000 7fb056008700 1 -- 172.21.15.35:0/2211074853 wait complete. 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.353+0000 7fb056008700 1 Processor -- start 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.353+0000 7fb056008700 1 -- start start 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.353+0000 7fb056008700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0500ff350 0x7fb050195260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb056008700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 0x7fb0501957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb056008700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb050199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb056008700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05019a240 con 0x7fb050104390 2023-03-17T09:22:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb056008700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05019a3b0 con 0x7fb0500ffcf0 2023-03-17T09:22:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb056008700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05019a570 con 0x7fb0500ff350 2023-03-17T09:22:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb050199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb050199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44756/0 (socket says 172.21.15.35:44756) 2023-03-17T09:22:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 0x7fb0501957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 -- 172.21.15.35:0/401987650 learned_addr learned my addr 172.21.15.35:0/401987650 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0500ff350 0x7fb050195260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 -- 172.21.15.35:0/401987650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0500ff350 msgr2=0x7fb050195260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0500ff350 0x7fb050195260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 -- 172.21.15.35:0/401987650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 msgr2=0x7fb0501957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 0x7fb0501957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 -- 172.21.15.35:0/401987650 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048009d00 con 0x7fb050104390 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04effd700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 0x7fb0501957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04ffff700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb050199c00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb048008e50 tx=0x7fb048008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04cff9700 1 -- 172.21.15.35:0/401987650 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800e040 con 0x7fb050104390 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04cff9700 1 -- 172.21.15.35:0/401987650 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb048003e90 con 0x7fb050104390 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05010efc0 con 0x7fb050104390 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.354+0000 7fb04cff9700 1 -- 172.21.15.35:0/401987650 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04801b460 con 0x7fb050104390 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.355+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05010ee30 con 0x7fb050104390 2023-03-17T09:22:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.357+0000 7fb04cff9700 1 -- 172.21.15.35:0/401987650 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb048003a00 con 0x7fb050104390 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.358+0000 7fb04cff9700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb03809f640 0x7fb0380a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.358+0000 7fb04cff9700 1 -- 172.21.15.35:0/401987650 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fb0480cb680 con 0x7fb050104390 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.358+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb03809f640 0x7fb0380a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb03809f640 0x7fb0380a1af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb044009c60 tx=0x7fb044009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 Processor -- start 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 -- start start 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 0x55f7fa388fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa383420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa383d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa28a010 con 0x55f7fa388be0 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa2dc950 con 0x55f7fa383960 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.359+0000 7fb062195b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa2d5de0 con 0x55f7fa3894f0 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 0x55f7fa388fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 0x55f7fa388fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44760/0 (socket says 172.21.15.35:44760) 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3315440145 learned_addr learned my addr 172.21.15.35:0/3315440145 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04effd700 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa383420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04ffff700 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa383d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3315440145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 msgr2=0x55f7fa383420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa383420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3315440145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 msgr2=0x55f7fa383d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa383d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3315440145 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7fa1575d0 con 0x55f7fa388be0 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 0x55f7fa388fb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb04400e4e0 tx=0x7fb044014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaaf6bf4fb32831 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb035ffb700 1 -- 172.21.15.35:0/3315440145 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044026430 con 0x55f7fa388be0 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb035ffb700 1 -- 172.21.15.35:0/3315440145 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb044021070 con 0x55f7fa388be0 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.360+0000 7fb035ffb700 1 -- 172.21.15.35:0/3315440145 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04401d670 con 0x55f7fa388be0 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 -- 172.21.15.35:0/3315440145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 msgr2=0x55f7fa388fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 0x55f7fa388fb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb04400e4e0 tx=0x7fb044014000 comp rx=0 tx=0).stop 2023-03-17T09:22:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 -- 172.21.15.35:0/3315440145 shutdown_connections 2023-03-17T09:22:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa383d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa388be0 0x55f7fa388fb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 --2- 172.21.15.35:0/3315440145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa383420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 -- 172.21.15.35:0/3315440145 >> 172.21.15.35:0/3315440145 conn(0x55f7fa1e06b0 msgr2=0x55f7fa37da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 -- 172.21.15.35:0/3315440145 shutdown_connections 2023-03-17T09:22:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.361+0000 7fb062195b80 1 -- 172.21.15.35:0/3315440145 wait complete. 2023-03-17T09:22:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 -- start start 2023-03-17T09:22:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 Processor -- start 2023-03-17T09:22:30.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa38f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa38c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa3894f0 0x55f7fa38cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa1598c0 con 0x55f7fa383960 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa38d320 con 0x55f7fa3894f0 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa38d4e0 con 0x55f7fa388be0 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb062195b80 10 client.0 _ll_register_callbacks cb 0x55f7fa17b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa38f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa38f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44766/0 (socket says 172.21.15.35:44766) 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3633188921 learned_addr learned my addr 172.21.15.35:0/3633188921 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.362+0000 7fb04effd700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa38c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04ffff700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa3894f0 0x55f7fa38cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3633188921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 msgr2=0x55f7fa38c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa38c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa3894f0 msgr2=0x55f7fa38cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa3894f0 0x55f7fa38cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04f7fe700 1 -- 172.21.15.35:0/3633188921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb044017070 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04ffff700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa3894f0 0x55f7fa38cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa38f430 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb044005950 tx=0x7fb04401cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdd8775f25ce939 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb02effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb02effd700 1 -- 172.21.15.35:0/3633188921 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04401c820 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb02effd700 1 -- 172.21.15.35:0/3633188921 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fb04401c980 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7fa298390 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb02effd700 1 -- 172.21.15.35:0/3633188921 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb04400ee90 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb062195b80 10 client.16431 fetch_fsmap learned FSMap version 31 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f7fa103d80 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.363+0000 7fb02effd700 1 -- 172.21.15.35:0/3633188921 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f7fa298390 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb02effd700 1 -- 172.21.15.35:0/3633188921 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb044003ae0 con 0x55f7fa383960 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb062195b80 10 client.16431 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb062195b80 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb062195b80 20 client.16431 populate_metadata read hostname 'smithi035' 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb062195b80 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa39d010 0x55f7fa39f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb062195b80 4 client.16431 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:22:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7fa2a4600 con 0x55f7fa39d010 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb04effd700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa39d010 0x55f7fa39f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb02effd700 10 client.16431 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.364+0000 7fb04effd700 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa39d010 0x55f7fa39f420 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbae8e6ad3595dc2 server_cookie=d8cdff49153194fa in_seq=0 out_seq=0 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb02effd700 1 -- 172.21.15.35:0/3633188921 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f7fa2a4600 con 0x55f7fa39d010 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb02effd700 10 client.16431 handle_command_reply: tid=0 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 client.16431 shutdown 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 msgr2=0x55f7fa38f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa38f430 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb044005950 tx=0x7fb04401cf50 comp rx=0 tx=0).stop 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 shutdown_connections 2023-03-17T09:22:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa39d010 0x55f7fa39f420 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa3894f0 0x55f7fa38cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa38f430 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb02effd700 0 client.16431 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 --2- 172.21.15.35:0/3633188921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa38c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 >> 172.21.15.35:0/3633188921 conn(0x55f7fa1e06b0 msgr2=0x55f7fa382410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 shutdown_connections 2023-03-17T09:22:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.365+0000 7fb062195b80 1 -- 172.21.15.35:0/3633188921 wait complete. 2023-03-17T09:22:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.366+0000 7fb062195b80 20 client.16431 trim_cache size 0 max 16384 2023-03-17T09:22:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.380+0000 7fb062195b80 1 Processor -- start 2023-03-17T09:22:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.380+0000 7fb062195b80 1 -- start start 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb062195b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa37dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb062195b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa388be0 0x55f7fa393f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb062195b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa3986e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb062195b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa3790f0 con 0x55f7fa383960 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb062195b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa37e000 con 0x55f7fa388be0 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb062195b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa37e700 con 0x55f7fa3894f0 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa37dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa37dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44774/0 (socket says 172.21.15.35:44774) 2023-03-17T09:22:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 -- 172.21.15.35:0/2009983672 learned_addr learned my addr 172.21.15.35:0/2009983672 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04ffff700 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa3986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04effd700 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa388be0 0x55f7fa393f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 -- 172.21.15.35:0/2009983672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 msgr2=0x55f7fa3986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:37.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa3986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 -- 172.21.15.35:0/2009983672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa388be0 msgr2=0x55f7fa393f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa388be0 0x55f7fa393f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 -- 172.21.15.35:0/2009983672 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7fa384000 con 0x55f7fa383960 2023-03-17T09:22:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa37dac0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb044016040 tx=0x7fb044009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c877d00f45cad5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:37.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:14 smithi035 ceph-mon[92535]: pgmap v856: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:22:37.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:16 smithi035 ceph-mon[92535]: osdmap e130: 12 total, 12 up, 12 in 2023-03-17T09:22:37.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:16 smithi035 ceph-mon[92535]: pgmap v858: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:22:37.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:18 smithi035 ceph-mon[92535]: pgmap v859: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T09:22:37.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:20 smithi035 ceph-mon[92535]: pgmap v860: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:22:37.919 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:22 smithi035 ceph-mon[92535]: pgmap v861: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:22:38.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:24 smithi035 ceph-mon[92535]: pgmap v862: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:22:38.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:26 smithi035 ceph-mon[92535]: pgmap v863: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 813 B/s wr, 10 op/s 2023-03-17T09:22:38.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:28 smithi035 ceph-mon[92535]: pgmap v864: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:30 smithi035 ceph-mon[92535]: pgmap v865: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:32 smithi035 ceph-mon[92535]: pgmap v866: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:34 smithi035 ceph-mon[92535]: pgmap v867: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:36 smithi035 ceph-mon[92535]: pgmap v868: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:38 smithi035 ceph-mon[92535]: pgmap v869: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:40 smithi035 ceph-mon[92535]: pgmap v870: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:42 smithi035 ceph-mon[92535]: pgmap v871: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:44 smithi035 ceph-mon[92535]: pgmap v872: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:46 smithi035 ceph-mon[92535]: pgmap v873: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:48 smithi035 ceph-mon[92535]: pgmap v874: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:50 smithi035 ceph-mon[92535]: pgmap v875: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:52 smithi035 ceph-mon[92535]: pgmap v876: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:54 smithi035 ceph-mon[92535]: pgmap v877: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:56 smithi035 ceph-mon[92535]: pgmap v878: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:13:58 smithi035 ceph-mon[92535]: pgmap v879: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:00 smithi035 ceph-mon[92535]: pgmap v880: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:02 smithi035 ceph-mon[92535]: pgmap v881: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:38.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:04 smithi035 ceph-mon[92535]: pgmap v882: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:06 smithi035 ceph-mon[92535]: pgmap v883: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:08 smithi035 ceph-mon[92535]: pgmap v884: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:09 smithi035 ceph-mon[92535]: osdmap e131: 12 total, 12 up, 12 in 2023-03-17T09:22:38.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:10 smithi035 ceph-mon[92535]: pgmap v886: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:12 smithi035 ceph-mon[92535]: pgmap v887: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:14 smithi035 ceph-mon[92535]: pgmap v888: 97 pgs: 97 active+clean; 1.4 MiB data, 165 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:16 smithi035 ceph-mon[92535]: osdmap e132: 12 total, 12 up, 12 in 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:16 smithi035 ceph-mon[92535]: pgmap v890: 97 pgs: 97 active+clean; 1.4 MiB data, 165 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:18 smithi035 ceph-mon[92535]: pgmap v891: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:20 smithi035 ceph-mon[92535]: pgmap v892: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:22 smithi035 ceph-mon[92535]: pgmap v893: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:24 smithi035 ceph-mon[92535]: pgmap v894: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:22:40.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:26 smithi035 ceph-mon[92535]: pgmap v895: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:22:40.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:28 smithi035 ceph-mon[92535]: pgmap v896: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:22:40.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:30 smithi035 ceph-mon[92535]: pgmap v897: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:40.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:32 smithi035 ceph-mon[92535]: pgmap v898: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:40.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:34 smithi035 ceph-mon[92535]: pgmap v899: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:41.863 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:36 smithi035 ceph-mon[92535]: pgmap v900: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:45.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:38 smithi035 ceph-mon[92535]: pgmap v901: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:45.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:40 smithi035 ceph-mon[92535]: pgmap v902: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:45.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:42 smithi035 ceph-mon[92535]: pgmap v903: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:45.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:44 smithi035 ceph-mon[92535]: pgmap v904: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:45.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:46 smithi035 ceph-mon[92535]: pgmap v905: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:45.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:48 smithi035 ceph-mon[92535]: pgmap v906: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:22:45.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:50 smithi035 ceph-mon[92535]: pgmap v907: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:45.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:52 smithi035 ceph-mon[92535]: pgmap v908: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:22:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:22:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:22:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:22:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:22:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:22:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:22:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:22:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:22:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb0367fc700 1 -- 172.21.15.35:0/2009983672 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04402e5d0 con 0x55f7fa383960 2023-03-17T09:22:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.381+0000 7fb0367fc700 1 -- 172.21.15.35:0/2009983672 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb044021070 con 0x55f7fa383960 2023-03-17T09:22:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb0367fc700 1 -- 172.21.15.35:0/2009983672 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04402e810 con 0x55f7fa383960 2023-03-17T09:22:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 -- 172.21.15.35:0/2009983672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 msgr2=0x55f7fa37dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa37dac0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb044016040 tx=0x7fb044009e50 comp rx=0 tx=0).stop 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 -- 172.21.15.35:0/2009983672 shutdown_connections 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa3894f0 0x55f7fa3986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa383960 0x55f7fa37dac0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 --2- 172.21.15.35:0/2009983672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa388be0 0x55f7fa393f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 -- 172.21.15.35:0/2009983672 >> 172.21.15.35:0/2009983672 conn(0x55f7fa1e06b0 msgr2=0x55f7fa382b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 -- 172.21.15.35:0/2009983672 shutdown_connections 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 -- 172.21.15.35:0/2009983672 wait complete. 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.382+0000 7fb062195b80 1 -- start start 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 Processor -- start 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa392120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa392660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 0x55f7fa3efe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa392e00 con 0x55f7fa3894f0 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa3f03e0 con 0x55f7fa383960 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7fa3f05a0 con 0x55f7fa388be0 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb062195b80 10 client.0 _ll_register_callbacks cb 0x55f7fa17b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 0x55f7fa3efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 0x55f7fa3efe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44784/0 (socket says 172.21.15.35:44784) 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb04ffff700 1 -- 172.21.15.35:0/1094876233 learned_addr learned my addr 172.21.15.35:0/1094876233 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa392120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.383+0000 7fb04effd700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa392660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04ffff700 1 -- 172.21.15.35:0/1094876233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 msgr2=0x55f7fa392660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04ffff700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa392660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04ffff700 1 -- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 msgr2=0x55f7fa392120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:22:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04ffff700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa392120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04ffff700 1 -- 172.21.15.35:0/1094876233 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7fa103d80 con 0x55f7fa3894f0 2023-03-17T09:22:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04effd700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa392660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa392120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb04ffff700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 0x55f7fa3efe70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb048007590 tx=0x7fb048099070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ad02527a3553b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb02effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:22:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb02effd700 1 -- 172.21.15.35:0/1094876233 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480991f0 con 0x55f7fa3894f0 2023-03-17T09:22:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb02effd700 1 -- 172.21.15.35:0/1094876233 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fb0480a1350 con 0x55f7fa3894f0 2023-03-17T09:22:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7fa3531e0 con 0x55f7fa3894f0 2023-03-17T09:22:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb02effd700 1 -- 172.21.15.35:0/1094876233 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0480b1280 con 0x55f7fa3894f0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb062195b80 10 client.16437 fetch_fsmap learned FSMap version 31 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f7fa0ecc00 con 0x55f7fa3894f0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb02effd700 1 -- 172.21.15.35:0/1094876233 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb048063080 con 0x55f7fa3894f0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.384+0000 7fb02effd700 1 -- 172.21.15.35:0/1094876233 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb0480986e0 con 0x55f7fa3894f0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb062195b80 10 client.16437 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb062195b80 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb062195b80 20 client.16437 populate_metadata read hostname 'smithi035' 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb062195b80 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa3f1ab0 0x55f7fa3f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb062195b80 4 client.16437 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f7fa159f00 con 0x55f7fa3f1ab0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa3f1ab0 0x55f7fa3f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb02effd700 10 client.16437 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.385+0000 7fb04f7fe700 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa3f1ab0 0x55f7fa3f3e90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dde86df9957a2c61 server_cookie=d2b96bda4bcd654d in_seq=0 out_seq=0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.389+0000 7fb02effd700 1 -- 172.21.15.35:0/1094876233 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f7fa159f00 con 0x55f7fa3f1ab0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.389+0000 7fb02effd700 10 client.16437 handle_command_reply: tid=0 2023-03-17T09:22:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.389+0000 7fb062195b80 1 client.16437 shutdown 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 msgr2=0x55f7fa3efe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 0x55f7fa3efe70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb048007590 tx=0x7fb048099070 comp rx=0 tx=0).stop 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 shutdown_connections 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f7fa3f1ab0 0x55f7fa3f3e90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f7fa3894f0 0x55f7fa3efe70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb02effd700 0 client.16437 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7fa383960 0x55f7fa392120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 --2- 172.21.15.35:0/1094876233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7fa388be0 0x55f7fa392660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 >> 172.21.15.35:0/1094876233 conn(0x55f7fa1e06b0 msgr2=0x55f7fa399270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 shutdown_connections 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 1 -- 172.21.15.35:0/1094876233 wait complete. 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb062195b80 20 client.16437 trim_cache size 0 max 16384 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb03809f640 msgr2=0x7fb0380a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb03809f640 0x7fb0380a1af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb044009c60 tx=0x7fb044009260 comp rx=0 tx=0).stop 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 msgr2=0x7fb050199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb050199c00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb048008e50 tx=0x7fb048008e80 comp rx=0 tx=0).stop 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 shutdown_connections 2023-03-17T09:22:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb03809f640 0x7fb0380a1af0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb050104390 0x7fb050199c00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0500ff350 0x7fb050195260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 --2- 172.21.15.35:0/401987650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0500ffcf0 0x7fb0501957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.390+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 >> 172.21.15.35:0/401987650 conn(0x7fb050076330 msgr2=0x7fb0500fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.391+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 shutdown_connections 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:16.391+0000 7fb056008700 1 -- 172.21.15.35:0/401987650 wait complete. 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 -- 172.21.15.35:0/1407901020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda50104390 msgr2=0x7fda5010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 --2- 172.21.15.35:0/1407901020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda50104390 0x7fda5010bf60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fda4800b0d0 tx=0x7fda4800b3e0 comp rx=0 tx=0).stop 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 -- 172.21.15.35:0/1407901020 shutdown_connections 2023-03-17T09:22:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 --2- 172.21.15.35:0/1407901020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda50104390 0x7fda5010bf60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 --2- 172.21.15.35:0/1407901020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda500ff350 0x7fda500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 --2- 172.21.15.35:0/1407901020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda500ffcf0 0x7fda50103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 -- 172.21.15.35:0/1407901020 >> 172.21.15.35:0/1407901020 conn(0x7fda50076330 msgr2=0x7fda50076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:22:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 -- 172.21.15.35:0/1407901020 shutdown_connections 2023-03-17T09:22:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.512+0000 7fda55e24700 1 -- 172.21.15.35:0/1407901020 wait complete. 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 Processor -- start 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 -- start start 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 0x7fda50196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda500ffcf0 0x7fda501968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda50104390 0x7fda5019ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5019b340 con 0x7fda500ff350 2023-03-17T09:22:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5019b4b0 con 0x7fda50104390 2023-03-17T09:22:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.513+0000 7fda55e24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5019b670 con 0x7fda500ffcf0 2023-03-17T09:22:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 0x7fda50196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 0x7fda50196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44794/0 (socket says 172.21.15.35:44794) 2023-03-17T09:22:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 -- 172.21.15.35:0/2393876463 learned_addr learned my addr 172.21.15.35:0/2393876463 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:22:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4effd700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda500ffcf0 0x7fda501968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4ffff700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda50104390 0x7fda5019ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 -- 172.21.15.35:0/2393876463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda500ffcf0 msgr2=0x7fda501968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda500ffcf0 0x7fda501968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 -- 172.21.15.35:0/2393876463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda50104390 msgr2=0x7fda5019ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda50104390 0x7fda5019ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 -- 172.21.15.35:0/2393876463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009d00 con 0x7fda500ff350 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4ffff700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda50104390 0x7fda5019ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 0x7fda50196360 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d950 tx=0x7fda4000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4cff9700 1 -- 172.21.15.35:0/2393876463 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40009940 con 0x7fda500ff350 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4cff9700 1 -- 172.21.15.35:0/2393876463 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda40010460 con 0x7fda500ff350 2023-03-17T09:22:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5010f010 con 0x7fda500ff350 2023-03-17T09:22:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda4cff9700 1 -- 172.21.15.35:0/2393876463 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000f620 con 0x7fda500ff350 2023-03-17T09:22:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.514+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5010ee80 con 0x7fda500ff350 2023-03-17T09:22:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.517+0000 7fda4cff9700 1 -- 172.21.15.35:0/2393876463 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fda400105d0 con 0x7fda500ff350 2023-03-17T09:22:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.517+0000 7fda4cff9700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda3809f640 0x7fda380a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.517+0000 7fda4cff9700 1 -- 172.21.15.35:0/2393876463 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fda400ca440 con 0x7fda500ff350 2023-03-17T09:22:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.517+0000 7fda4effd700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda3809f640 0x7fda380a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda4effd700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda3809f640 0x7fda380a1af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda50197970 tx=0x7fda44009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 Processor -- start 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 -- start start 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01db9cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01db97420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01db97d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01da9e010 con 0x55d01db9d4f0 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01daf0950 con 0x55d01db9cbe0 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dae9de0 con 0x55d01db97960 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01db97420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01db97420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44804/0 (socket says 172.21.15.35:44804) 2023-03-17T09:22:58.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.518+0000 7fda4effd700 1 -- 172.21.15.35:0/357462544 learned_addr learned my addr 172.21.15.35:0/357462544 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01db9cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4ffff700 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01db97d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4effd700 1 -- 172.21.15.35:0/357462544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 msgr2=0x55d01db97d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4effd700 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01db97d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4effd700 1 -- 172.21.15.35:0/357462544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 msgr2=0x55d01db9cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4effd700 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01db9cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4effd700 1 -- 172.21.15.35:0/357462544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d01d96b5d0 con 0x55d01db9d4f0 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01db9cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda4effd700 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01db97420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda44011cd0 tx=0x7fda44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec0bf4c259ef701 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda35ffb700 1 -- 172.21.15.35:0/357462544 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44004030 con 0x55d01db9d4f0 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda35ffb700 1 -- 172.21.15.35:0/357462544 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda4400e840 con 0x55d01db9d4f0 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.519+0000 7fda35ffb700 1 -- 172.21.15.35:0/357462544 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda440039b0 con 0x55d01db9d4f0 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 -- 172.21.15.35:0/357462544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 msgr2=0x55d01db97420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01db97420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda44011cd0 tx=0x7fda44014000 comp rx=0 tx=0).stop 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 -- 172.21.15.35:0/357462544 shutdown_connections 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01db97d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01db9cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/357462544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01db97420 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 -- 172.21.15.35:0/357462544 >> 172.21.15.35:0/357462544 conn(0x55d01d9f46b0 msgr2=0x55d01db91a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 -- 172.21.15.35:0/357462544 shutdown_connections 2023-03-17T09:23:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.520+0000 7fda61fb1b80 1 -- 172.21.15.35:0/357462544 wait complete. 2023-03-17T09:23:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 -- start start 2023-03-17T09:23:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 Processor -- start 2023-03-17T09:23:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01dba0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01dba0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01d96d8c0 con 0x55d01db9cbe0 2023-03-17T09:23:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dba14d0 con 0x55d01db9d4f0 2023-03-17T09:23:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dbad030 con 0x55d01db97960 2023-03-17T09:23:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda61fb1b80 10 client.0 _ll_register_callbacks cb 0x55d01d98f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:23:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01dba0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.521+0000 7fda4f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01dba0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44810/0 (socket says 172.21.15.35:44810) 2023-03-17T09:23:03.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:54 smithi035 ceph-mon[92535]: pgmap v909: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:03.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4effd700 1 -- 172.21.15.35:0/1822360126 learned_addr learned my addr 172.21.15.35:0/1822360126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4ffff700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01dba0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4f7fe700 1 -- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 msgr2=0x55d01dba0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01dba0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4f7fe700 1 -- 172.21.15.35:0/1822360126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 msgr2=0x55d01dba0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01dba0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4f7fe700 1 -- 172.21.15.35:0/1822360126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44017070 con 0x55d01db97960 2023-03-17T09:23:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4ffff700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01dba0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba3480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda400c7c00 tx=0x7fda40097b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce1efd0d70767252 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda2effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda2effd700 1 -- 172.21.15.35:0/1822360126 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400b0260 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda2effd700 1 -- 172.21.15.35:0/1822360126 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fda400a0110 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d01daac390 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda2effd700 1 -- 172.21.15.35:0/1822360126 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda40097410 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda61fb1b80 10 client.26107 fetch_fsmap learned FSMap version 31 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.522+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d01d917d80 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda2effd700 1 -- 172.21.15.35:0/1822360126 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda400b4080 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda2effd700 1 -- 172.21.15.35:0/1822360126 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fda40093d10 con 0x55d01db97960 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda61fb1b80 10 client.26107 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda61fb1b80 10 client.26107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:23:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda61fb1b80 20 client.26107 populate_metadata read hostname 'smithi035' 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dbb0fc0 0x55d01dbb33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda61fb1b80 4 client.26107 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d01dab8600 con 0x55d01dbb0fc0 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.523+0000 7fda4effd700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dbb0fc0 0x55d01dbb33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda2effd700 10 client.26107 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda4effd700 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dbb0fc0 0x55d01dbb33d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b0d1a40c63cad8 server_cookie=bfa48cfd19b94b8c in_seq=0 out_seq=0 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda2effd700 1 -- 172.21.15.35:0/1822360126 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d01dab8600 con 0x55d01dbb0fc0 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda2effd700 10 client.26107 handle_command_reply: tid=0 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda61fb1b80 1 client.26107 shutdown 2023-03-17T09:23:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 msgr2=0x55d01dba3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.524+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba3480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda400c7c00 tx=0x7fda40097b70 comp rx=0 tx=0).stop 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 shutdown_connections 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dbb0fc0 0x55d01dbb33d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01dba0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba3480 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1822360126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01dba0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda2effd700 0 client.26107 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 >> 172.21.15.35:0/1822360126 conn(0x55d01d9f46b0 msgr2=0x55d01db96410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 shutdown_connections 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1822360126 wait complete. 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.525+0000 7fda61fb1b80 20 client.26107 trim_cache size 0 max 16384 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.539+0000 7fda61fb1b80 1 Processor -- start 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 -- start start 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01db9ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01db96410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dba1ce0 con 0x55d01db9cbe0 2023-03-17T09:23:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01db9c810 con 0x55d01db9d4f0 2023-03-17T09:23:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01db9b450 con 0x55d01db97960 2023-03-17T09:23:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01db9ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01db9ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44818/0 (socket says 172.21.15.35:44818) 2023-03-17T09:23:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 -- 172.21.15.35:0/3937579074 learned_addr learned my addr 172.21.15.35:0/3937579074 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4ffff700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01db96410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 -- 172.21.15.35:0/3937579074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 msgr2=0x55d01dba7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 -- 172.21.15.35:0/3937579074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 msgr2=0x55d01db96410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01db96410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 -- 172.21.15.35:0/3937579074 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d01dab0130 con 0x55d01db9cbe0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4ffff700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01db96410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.540+0000 7fda4effd700 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01db9ff20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55d01dba1cb0 tx=0x7fda4400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d53bdf3d46b3174 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda367fc700 1 -- 172.21.15.35:0/3937579074 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4402b040 con 0x55d01db9cbe0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda367fc700 1 -- 172.21.15.35:0/3937579074 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda44009950 con 0x55d01db9cbe0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda367fc700 1 -- 172.21.15.35:0/3937579074 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44032610 con 0x55d01db9cbe0 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 -- 172.21.15.35:0/3937579074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 msgr2=0x55d01db9ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01db9ff20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55d01dba1cb0 tx=0x7fda4400ef70 comp rx=0 tx=0).stop 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 -- 172.21.15.35:0/3937579074 shutdown_connections 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9d4f0 0x55d01db96410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/3937579074 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9cbe0 0x55d01db9ff20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 -- 172.21.15.35:0/3937579074 >> 172.21.15.35:0/3937579074 conn(0x55d01d9f46b0 msgr2=0x55d01dbb7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.541+0000 7fda61fb1b80 1 -- 172.21.15.35:0/3937579074 shutdown_connections 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 -- 172.21.15.35:0/3937579074 wait complete. 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 -- start start 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 Processor -- start 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01dba7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01dba5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dba65f0 con 0x55d01db9d4f0 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dba6760 con 0x55d01db9cbe0 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d01dba6920 con 0x55d01db97960 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda61fb1b80 10 client.0 _ll_register_callbacks cb 0x55d01d98f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:23:09.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.542+0000 7fda4ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01dba5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01dba5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44826/0 (socket says 172.21.15.35:44826) 2023-03-17T09:23:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 -- 172.21.15.35:0/1607704451 learned_addr learned my addr 172.21.15.35:0/1607704451 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4effd700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01dba7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 -- 172.21.15.35:0/1607704451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 msgr2=0x55d01dba7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 -- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 msgr2=0x55d01dba7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01dba7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 -- 172.21.15.35:0/1607704451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d01d96b5d0 con 0x55d01db9d4f0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4effd700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01dba7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda4ffff700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01dba5f60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fda48015000 tx=0x7fda480095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9073d177081c39 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda2effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda2effd700 1 -- 172.21.15.35:0/1607704451 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48021040 con 0x55d01db9d4f0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda2effd700 1 -- 172.21.15.35:0/1607704451 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fda48004c50 con 0x55d01db9d4f0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d01d96df00 con 0x55d01db9d4f0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda2effd700 1 -- 172.21.15.35:0/1607704451 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda4800e040 con 0x55d01db9d4f0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda61fb1b80 10 client.16455 fetch_fsmap learned FSMap version 31 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.543+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d01d93e1f0 con 0x55d01db9d4f0 2023-03-17T09:23:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda2effd700 1 -- 172.21.15.35:0/1607704451 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d01d96df00 con 0x55d01db9d4f0 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda2effd700 1 -- 172.21.15.35:0/1607704451 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fda4800b100 con 0x55d01db9d4f0 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda61fb1b80 10 client.16455 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda61fb1b80 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda61fb1b80 20 client.16455 populate_metadata read hostname 'smithi035' 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dc06030 0x55d01dc08440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda61fb1b80 4 client.16455 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d01daa6360 con 0x55d01dc06030 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dc06030 0x55d01dc08440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda4f7fe700 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dc06030 0x55d01dc08440 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d48488e54084128 server_cookie=2e197211d8bae1ca in_seq=0 out_seq=0 2023-03-17T09:23:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.544+0000 7fda2effd700 10 client.16455 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.548+0000 7fda2effd700 1 -- 172.21.15.35:0/1607704451 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d01daa6360 con 0x55d01dc06030 2023-03-17T09:23:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.548+0000 7fda2effd700 10 client.16455 handle_command_reply: tid=0 2023-03-17T09:23:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.548+0000 7fda61fb1b80 1 client.16455 shutdown 2023-03-17T09:23:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 msgr2=0x55d01dba5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01dba5f60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fda48015000 tx=0x7fda480095d0 comp rx=0 tx=0).stop 2023-03-17T09:23:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 shutdown_connections 2023-03-17T09:23:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d01dc06030 0x55d01dc08440 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d01db9d4f0 0x55d01dba5f60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d01db97960 0x55d01dba7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda2effd700 0 client.16455 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:13.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 --2- 172.21.15.35:0/1607704451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d01db9cbe0 0x55d01dba7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 >> 172.21.15.35:0/1607704451 conn(0x55d01d9f46b0 msgr2=0x55d01db9a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 shutdown_connections 2023-03-17T09:23:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 1 -- 172.21.15.35:0/1607704451 wait complete. 2023-03-17T09:23:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda61fb1b80 20 client.16455 trim_cache size 0 max 16384 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda3809f640 msgr2=0x7fda380a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda3809f640 0x7fda380a1af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda50197970 tx=0x7fda44009260 comp rx=0 tx=0).stop 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 msgr2=0x7fda50196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 0x7fda50196360 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fda4000d950 tx=0x7fda4000dc60 comp rx=0 tx=0).stop 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 shutdown_connections 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda3809f640 0x7fda380a1af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda50104390 0x7fda5019ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda500ff350 0x7fda50196360 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 --2- 172.21.15.35:0/2393876463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda500ffcf0 0x7fda501968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.549+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 >> 172.21.15.35:0/2393876463 conn(0x7fda50076330 msgr2=0x7fda50068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.550+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 shutdown_connections 2023-03-17T09:23:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:29.550+0000 7fda55e24700 1 -- 172.21.15.35:0/2393876463 wait complete. 2023-03-17T09:23:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 -- 172.21.15.35:0/13558945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ffd50 msgr2=0x7fd3f4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/13558945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ffd50 0x7fd3f4103d10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80099c0 tx=0x7fd3e8009cd0 comp rx=0 tx=0).stop 2023-03-17T09:23:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 -- 172.21.15.35:0/13558945 shutdown_connections 2023-03-17T09:23:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/13558945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f41043f0 0x7fd3f410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/13558945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f40ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/13558945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ffd50 0x7fd3f4103d10 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 -- 172.21.15.35:0/13558945 >> 172.21.15.35:0/13558945 conn(0x7fd3f4075f60 msgr2=0x7fd3f4076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 -- 172.21.15.35:0/13558945 shutdown_connections 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.672+0000 7fd3fa6da700 1 -- 172.21.15.35:0/13558945 wait complete. 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 Processor -- start 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 -- start start 2023-03-17T09:23:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f4196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f40ffd50 0x7fd3f41967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41043f0 0x7fd3f419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419b240 con 0x7fd3f40ff3b0 2023-03-17T09:23:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419b3b0 con 0x7fd3f41043f0 2023-03-17T09:23:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3fa6da700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f419b570 con 0x7fd3f40ffd50 2023-03-17T09:23:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f4196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f4196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44836/0 (socket says 172.21.15.35:44836) 2023-03-17T09:23:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3f3fff700 1 -- 172.21.15.35:0/680223425 learned_addr learned my addr 172.21.15.35:0/680223425 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41043f0 0x7fd3f419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.673+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f40ffd50 0x7fd3f41967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f3fff700 1 -- 172.21.15.35:0/680223425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f40ffd50 msgr2=0x7fd3f41967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:19.850 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:56 smithi035 ceph-mon[92535]: pgmap v910: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f40ffd50 0x7fd3f41967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f3fff700 1 -- 172.21.15.35:0/680223425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41043f0 msgr2=0x7fd3f419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41043f0 0x7fd3f419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f3fff700 1 -- 172.21.15.35:0/680223425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e80095f0 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41043f0 0x7fd3f419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f4196260 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400e9a0 tx=0x7fd3e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f17fa700 1 -- 172.21.15.35:0/680223425 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4009790 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f17fa700 1 -- 172.21.15.35:0/680223425 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3e4010430 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3f17fa700 1 -- 172.21.15.35:0/680223425 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400cea0 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f410f020 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.674+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f410ee90 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.677+0000 7fd3f17fa700 1 -- 172.21.15.35:0/680223425 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd3e40105a0 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.677+0000 7fd3f17fa700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd3dc09f640 0x7fd3dc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.677+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd3dc09f640 0x7fd3dc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.677+0000 7fd3f17fa700 1 -- 172.21.15.35:0/680223425 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd3e4014070 con 0x7fd3f40ff3b0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd3dc09f640 0x7fd3dc0a1af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e800b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 Processor -- start 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 -- start start 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c6a7010 con 0x55866c7a0960 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c6f9950 con 0x55866c7a64f0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.678+0000 7fd406867b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c6f2de0 con 0x55866c7a5be0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44848/0 (socket says 172.21.15.35:44848) 2023-03-17T09:23:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 -- 172.21.15.35:0/2563166425 learned_addr learned my addr 172.21.15.35:0/2563166425 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 -- 172.21.15.35:0/2563166425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 msgr2=0x55866c7a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 -- 172.21.15.35:0/2563166425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 msgr2=0x55866c7a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 -- 172.21.15.35:0/2563166425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866c5745d0 con 0x55866c7a0960 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7a0d90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec003eb0 tx=0x7fd3ec009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a43d7480f020eb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3da7fc700 1 -- 172.21.15.35:0/2563166425 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0092d0 con 0x55866c7a0960 2023-03-17T09:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3da7fc700 1 -- 172.21.15.35:0/2563166425 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3ec00f040 con 0x55866c7a0960 2023-03-17T09:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.679+0000 7fd3da7fc700 1 -- 172.21.15.35:0/2563166425 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00e750 con 0x55866c7a0960 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 -- 172.21.15.35:0/2563166425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 msgr2=0x55866c7a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7a0d90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec003eb0 tx=0x7fd3ec009920 comp rx=0 tx=0).stop 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 -- 172.21.15.35:0/2563166425 shutdown_connections 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7a0d90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 --2- 172.21.15.35:0/2563166425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 -- 172.21.15.35:0/2563166425 >> 172.21.15.35:0/2563166425 conn(0x55866c5fd6b0 msgr2=0x55866c79aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 -- 172.21.15.35:0/2563166425 shutdown_connections 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.680+0000 7fd406867b80 1 -- 172.21.15.35:0/2563166425 wait complete. 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 -- start start 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 Processor -- start 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c5768c0 con 0x55866c7a0960 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7aa430 con 0x55866c7a64f0 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7b6000 con 0x55866c7a5be0 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd406867b80 10 client.0 _ll_register_callbacks cb 0x55866c598230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44850/0 (socket says 172.21.15.35:44850) 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd3f3fff700 1 -- 172.21.15.35:0/1912131963 learned_addr learned my addr 172.21.15.35:0/1912131963 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.681+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:24.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f3fff700 1 -- 172.21.15.35:0/1912131963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 msgr2=0x55866c7a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f3fff700 1 -- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 msgr2=0x55866c7a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f3fff700 1 -- 172.21.15.35:0/1912131963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec003b90 con 0x55866c7a0960 2023-03-17T09:23:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:23:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7ac430 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40c86e0 tx=0x7fd3e4097d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb73949cb478ce63 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:23:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3d37fe700 1 -- 172.21.15.35:0/1912131963 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4097af0 con 0x55866c7a0960 2023-03-17T09:23:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3d37fe700 1 -- 172.21.15.35:0/1912131963 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd3e40a05f0 con 0x55866c7a0960 2023-03-17T09:23:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55866c6b5390 con 0x55866c7a0960 2023-03-17T09:23:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3d37fe700 1 -- 172.21.15.35:0/1912131963 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3e40a0160 con 0x55866c7a0960 2023-03-17T09:23:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd406867b80 10 client.16467 fetch_fsmap learned FSMap version 31 2023-03-17T09:23:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55866c520d80 con 0x55866c7a0960 2023-03-17T09:23:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.682+0000 7fd3d37fe700 1 -- 172.21.15.35:0/1912131963 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3e40b4020 con 0x55866c7a0960 2023-03-17T09:23:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd3d37fe700 1 -- 172.21.15.35:0/1912131963 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd3e4097360 con 0x55866c7a0960 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd406867b80 10 client.16467 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd406867b80 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd406867b80 20 client.16467 populate_metadata read hostname 'smithi035' 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd406867b80 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c7ba0c0 0x55866c7bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd406867b80 4 client.16467 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55866c6c1600 con 0x55866c7ba0c0 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c7ba0c0 0x55866c7bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c7ba0c0 0x55866c7bc4a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89de82cab76ee92 server_cookie=13a9ef14a476ef3f in_seq=0 out_seq=0 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.683+0000 7fd3d37fe700 10 client.16467 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd3d37fe700 1 -- 172.21.15.35:0/1912131963 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55866c6c1600 con 0x55866c7ba0c0 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd3d37fe700 10 client.16467 handle_command_reply: tid=0 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 client.16467 shutdown 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 msgr2=0x55866c7ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7ac430 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40c86e0 tx=0x7fd3e4097d60 comp rx=0 tx=0).stop 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 shutdown_connections 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c7ba0c0 0x55866c7bc4a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a64f0 0x55866c7a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd3d37fe700 0 client.16467 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c7ac430 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 --2- 172.21.15.35:0/1912131963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a5be0 0x55866c7a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.684+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 >> 172.21.15.35:0/1912131963 conn(0x55866c5fd6b0 msgr2=0x55866c79aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.685+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 shutdown_connections 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.685+0000 7fd406867b80 1 -- 172.21.15.35:0/1912131963 wait complete. 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.685+0000 7fd406867b80 20 client.16467 trim_cache size 0 max 16384 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 Processor -- start 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 -- start start 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c79aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a5be0 0x55866c7b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7b77b0 con 0x55866c7a0960 2023-03-17T09:23:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c79b000 con 0x55866c7a5be0 2023-03-17T09:23:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd406867b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7975c0 con 0x55866c7a64f0 2023-03-17T09:23:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c79aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c79aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44856/0 (socket says 172.21.15.35:44856) 2023-03-17T09:23:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 -- 172.21.15.35:0/866642464 learned_addr learned my addr 172.21.15.35:0/866642464 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a5be0 0x55866c7b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f8c77700 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 -- 172.21.15.35:0/866642464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 msgr2=0x55866c7a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 -- 172.21.15.35:0/866642464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a5be0 msgr2=0x55866c7b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a5be0 0x55866c7b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.700+0000 7fd3f3fff700 1 -- 172.21.15.35:0/866642464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866c6b9130 con 0x55866c7a0960 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.701+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c79aac0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4096750 tx=0x7fd3e4010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c637f6e8ef89f62a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.701+0000 7fd3daffd700 1 -- 172.21.15.35:0/866642464 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40a05f0 con 0x55866c7a0960 2023-03-17T09:23:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.701+0000 7fd3daffd700 1 -- 172.21.15.35:0/866642464 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3e40b4030 con 0x55866c7a0960 2023-03-17T09:23:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.701+0000 7fd3daffd700 1 -- 172.21.15.35:0/866642464 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40a03c0 con 0x55866c7a0960 2023-03-17T09:23:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.701+0000 7fd406867b80 1 -- 172.21.15.35:0/866642464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 msgr2=0x55866c79aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.701+0000 7fd406867b80 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c79aac0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4096750 tx=0x7fd3e4010a70 comp rx=0 tx=0).stop 2023-03-17T09:23:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- 172.21.15.35:0/866642464 shutdown_connections 2023-03-17T09:23:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a0960 0x55866c79aac0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 --2- 172.21.15.35:0/866642464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a5be0 0x55866c7b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- 172.21.15.35:0/866642464 >> 172.21.15.35:0/866642464 conn(0x55866c5fd6b0 msgr2=0x55866c7a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- 172.21.15.35:0/866642464 shutdown_connections 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- 172.21.15.35:0/866642464 wait complete. 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- start start 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 Processor -- start 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a0960 0x55866c7a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a5be0 0x55866c7a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7b14f0 con 0x55866c7a5be0 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7a2120 con 0x55866c7a0960 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c7a22e0 con 0x55866c7a64f0 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.702+0000 7fd406867b80 10 client.0 _ll_register_callbacks cb 0x55866c598230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a5be0 0x55866c7a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f8c77700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a5be0 0x55866c7a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44864/0 (socket says 172.21.15.35:44864) 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a0960 0x55866c7a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f37fe700 1 -- 172.21.15.35:0/3661428601 learned_addr learned my addr 172.21.15.35:0/3661428601 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 -- 172.21.15.35:0/3661428601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 msgr2=0x55866c7a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 -- 172.21.15.35:0/3661428601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a5be0 msgr2=0x55866c7a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a5be0 0x55866c7a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 -- 172.21.15.35:0/3661428601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55866c520d80 con 0x55866c7a0960 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3f3fff700 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a0960 0x55866c7a2d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40a00c0 tx=0x7fd3e4097800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40fa715ef0696a10 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:23:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3d37fe700 1 -- 172.21.15.35:0/3661428601 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4097af0 con 0x55866c7a0960 2023-03-17T09:23:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd3d37fe700 1 -- 172.21.15.35:0/3661428601 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fd3e40b5080 con 0x55866c7a0960 2023-03-17T09:23:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.703+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55866c7701e0 con 0x55866c7a0960 2023-03-17T09:23:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd3d37fe700 1 -- 172.21.15.35:0/3661428601 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3e40a05f0 con 0x55866c7a0960 2023-03-17T09:23:29.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:14:58 smithi035 ceph-mon[92535]: pgmap v911: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 10 client.26078 fetch_fsmap learned FSMap version 31 2023-03-17T09:23:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55866c5471f0 con 0x55866c7a0960 2023-03-17T09:23:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd3d37fe700 1 -- 172.21.15.35:0/3661428601 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55866c7701e0 con 0x55866c7a0960 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd3d37fe700 1 -- 172.21.15.35:0/3661428601 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd3e40991e0 con 0x55866c7a0960 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 10 client.26078 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 10 client.26078 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 20 client.26078 populate_metadata read hostname 'smithi035' 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c813170 0x55866c815550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 4 client.26078 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55866c576f00 con 0x55866c813170 2023-03-17T09:23:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.704+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c813170 0x55866c815550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.705+0000 7fd3d37fe700 10 client.26078 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.705+0000 7fd3f37fe700 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c813170 0x55866c815550 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fba1ff2e226c6331 server_cookie=ee8c6f96d1b64d7a in_seq=0 out_seq=0 2023-03-17T09:23:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.708+0000 7fd3d37fe700 1 -- 172.21.15.35:0/3661428601 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55866c576f00 con 0x55866c813170 2023-03-17T09:23:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.708+0000 7fd3d37fe700 10 client.26078 handle_command_reply: tid=0 2023-03-17T09:23:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.708+0000 7fd406867b80 1 client.26078 shutdown 2023-03-17T09:23:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a0960 msgr2=0x55866c7a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:34.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a0960 0x55866c7a2d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40a00c0 tx=0x7fd3e4097800 comp rx=0 tx=0).stop 2023-03-17T09:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 shutdown_connections 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55866c813170 0x55866c815550 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55866c7a64f0 0x55866c7a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3d37fe700 0 client.26078 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55866c7a0960 0x55866c7a2d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 --2- 172.21.15.35:0/3661428601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55866c7a5be0 0x55866c7a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 >> 172.21.15.35:0/3661428601 conn(0x55866c5fd6b0 msgr2=0x55866c7a7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 shutdown_connections 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 1 -- 172.21.15.35:0/3661428601 wait complete. 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd406867b80 20 client.26078 trim_cache size 0 max 16384 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd3dc09f640 msgr2=0x7fd3dc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd3dc09f640 0x7fd3dc0a1af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e800b540 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 msgr2=0x7fd3f4196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f4196260 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400e9a0 tx=0x7fd3e400ecb0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 shutdown_connections 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd3dc09f640 0x7fd3dc0a1af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3f41043f0 0x7fd3f419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.709+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3f40ff3b0 0x7fd3f4196260 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.710+0000 7fd3fa6da700 1 --2- 172.21.15.35:0/680223425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3f40ffd50 0x7fd3f41967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.710+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 >> 172.21.15.35:0/680223425 conn(0x7fd3f4075f60 msgr2=0x7fd3f4068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.710+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 shutdown_connections 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:42.710+0000 7fd3fa6da700 1 -- 172.21.15.35:0/680223425 wait complete. 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/514338066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 msgr2=0x7f4d040ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/514338066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d040ff720 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4d000099c0 tx=0x7f4d00009cd0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/514338066 shutdown_connections 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/514338066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d04104390 0x7f4d0410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/514338066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d040ff720 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/514338066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d040ffcf0 0x7f4d04103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/514338066 >> 172.21.15.35:0/514338066 conn(0x7f4d04076330 msgr2=0x7f4d04076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/514338066 shutdown_connections 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.832+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/514338066 wait complete. 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 Processor -- start 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 -- start start 2023-03-17T09:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d04194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d040ffcf0 0x7f4d041953b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d04104390 0x7f4d041958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041a4700 con 0x7f4d040ff350 2023-03-17T09:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041a4870 con 0x7f4d04104390 2023-03-17T09:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d0b2b6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041a4a30 con 0x7f4d040ffcf0 2023-03-17T09:23:37.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d04194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:37.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d04194e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44878/0 (socket says 172.21.15.35:44878) 2023-03-17T09:23:37.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d09052700 1 -- 172.21.15.35:0/594106444 learned_addr learned my addr 172.21.15.35:0/594106444 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:37.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d09853700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d04104390 0x7f4d041958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.833+0000 7f4d08851700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d040ffcf0 0x7f4d041953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09052700 1 -- 172.21.15.35:0/594106444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d040ffcf0 msgr2=0x7f4d041953b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09052700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d040ffcf0 0x7f4d041953b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09052700 1 -- 172.21.15.35:0/594106444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d04104390 msgr2=0x7f4d041958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09052700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d04104390 0x7f4d041958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09052700 1 -- 172.21.15.35:0/594106444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000095f0 con 0x7f4d040ff350 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09853700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d04104390 0x7f4d041958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d09052700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d04194e70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4d00005910 tx=0x7f4d0000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4cfa7fc700 1 -- 172.21.15.35:0/594106444 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0001d070 con 0x7f4d040ff350 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0410f000 con 0x7f4d040ff350 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4cfa7fc700 1 -- 172.21.15.35:0/594106444 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d000054e0 con 0x7f4d040ff350 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4cfa7fc700 1 -- 172.21.15.35:0/594106444 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00004ab0 con 0x7f4d040ff350 2023-03-17T09:23:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.834+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0410ee70 con 0x7f4d040ff350 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.836+0000 7f4cfa7fc700 1 -- 172.21.15.35:0/594106444 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4d0000fb80 con 0x7f4d040ff350 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.837+0000 7f4cfa7fc700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4cf009f640 0x7f4cf00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.837+0000 7f4d08851700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4cf009f640 0x7f4cf00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.837+0000 7f4cfa7fc700 1 -- 172.21.15.35:0/594106444 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4d000cb470 con 0x7f4d040ff350 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.838+0000 7f4d08851700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4cf009f640 0x7f4cf00a1af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d040689a0 tx=0x7f4cf4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.838+0000 7f4d17443b80 1 Processor -- start 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 -- start start 2023-03-17T09:23:43.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 0x564a8dc49fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc44420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc44960 0x564a8dc44d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8db4b010 con 0x564a8dc49be0 2023-03-17T09:23:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8db9d950 con 0x564a8dc4a4f0 2023-03-17T09:23:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d17443b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8db96de0 con 0x564a8dc44960 2023-03-17T09:23:43.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 0x564a8dc49fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 0x564a8dc49fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44886/0 (socket says 172.21.15.35:44886) 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d09052700 1 -- 172.21.15.35:0/1654547157 learned_addr learned my addr 172.21.15.35:0/1654547157 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d08851700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc44420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d09853700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc44960 0x564a8dc44d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.839+0000 7f4d09052700 1 -- 172.21.15.35:0/1654547157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc44960 msgr2=0x564a8dc44d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d09052700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc44960 0x564a8dc44d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d09052700 1 -- 172.21.15.35:0/1654547157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 msgr2=0x564a8dc44420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d09052700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc44420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d09052700 1 -- 172.21.15.35:0/1654547157 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8da185d0 con 0x564a8dc49be0 2023-03-17T09:23:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d09853700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc44960 0x564a8dc44d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:23:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d08851700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc44420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:23:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4d09052700 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 0x564a8dc49fb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4d000954e0 tx=0x7f4d00098c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154e46083676ef77 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4cef7fe700 1 -- 172.21.15.35:0/1654547157 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000b1210 con 0x564a8dc49be0 2023-03-17T09:23:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4cef7fe700 1 -- 172.21.15.35:0/1654547157 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d00097380 con 0x564a8dc49be0 2023-03-17T09:23:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.840+0000 7f4cef7fe700 1 -- 172.21.15.35:0/1654547157 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000cb040 con 0x564a8dc49be0 2023-03-17T09:23:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 -- 172.21.15.35:0/1654547157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 msgr2=0x564a8dc49fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 0x564a8dc49fb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4d000954e0 tx=0x7f4d00098c30 comp rx=0 tx=0).stop 2023-03-17T09:23:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 -- 172.21.15.35:0/1654547157 shutdown_connections 2023-03-17T09:23:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc44960 0x564a8dc44d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc49be0 0x564a8dc49fb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1654547157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc44420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 -- 172.21.15.35:0/1654547157 >> 172.21.15.35:0/1654547157 conn(0x564a8daa16b0 msgr2=0x564a8dc3ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 -- 172.21.15.35:0/1654547157 shutdown_connections 2023-03-17T09:23:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 -- 172.21.15.35:0/1654547157 wait complete. 2023-03-17T09:23:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 -- start start 2023-03-17T09:23:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.841+0000 7f4d17443b80 1 Processor -- start 2023-03-17T09:23:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc50470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:44.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc4d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc4dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8da1a8c0 con 0x564a8dc44960 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dc4e550 con 0x564a8dc4a4f0 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dc59cf0 con 0x564a8dc49be0 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d17443b80 10 client.0 _ll_register_callbacks cb 0x564a8da3c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc50470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc50470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44890/0 (socket says 172.21.15.35:44890) 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 -- 172.21.15.35:0/2449528485 learned_addr learned my addr 172.21.15.35:0/2449528485 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d08851700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc4d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09853700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc4dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 -- 172.21.15.35:0/2449528485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 msgr2=0x564a8dc4d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:44.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc4d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 -- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 msgr2=0x564a8dc4dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc4dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.842+0000 7f4d09052700 1 -- 172.21.15.35:0/2449528485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0410ee70 con 0x564a8dc44960 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d09052700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc50470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009fd0 tx=0x7f4d0000fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aaa46aad78c9b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4cecff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4cecff9700 1 -- 172.21.15.35:0/2449528485 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00099440 con 0x564a8dc44960 2023-03-17T09:23:44.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4cecff9700 1 -- 172.21.15.35:0/2449528485 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4d000984d0 con 0x564a8dc44960 2023-03-17T09:23:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a8db59390 con 0x564a8dc44960 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4cecff9700 1 -- 172.21.15.35:0/2449528485 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d000056d0 con 0x564a8dc44960 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 10 client.16485 fetch_fsmap learned FSMap version 31 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564a8d9c4d80 con 0x564a8dc44960 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4cecff9700 1 -- 172.21.15.35:0/2449528485 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d00063080 con 0x564a8dc44960 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4cecff9700 1 -- 172.21.15.35:0/2449528485 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d00097fd0 con 0x564a8dc44960 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 20 client.16485 populate_metadata read hostname 'smithi035' 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.843+0000 7f4d17443b80 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dc5d930 0x564a8dc5fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.844+0000 7f4d17443b80 4 client.16485 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.844+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a8db65600 con 0x564a8dc5d930 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.844+0000 7f4d08851700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dc5d930 0x564a8dc5fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:23:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.844+0000 7f4cecff9700 10 client.16485 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:44.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.844+0000 7f4d08851700 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dc5d930 0x564a8dc5fd10 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f6a500edbb908c server_cookie=7d26e444140ed1ec in_seq=0 out_seq=0 2023-03-17T09:23:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4cecff9700 1 -- 172.21.15.35:0/2449528485 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564a8db65600 con 0x564a8dc5d930 2023-03-17T09:23:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4cecff9700 10 client.16485 handle_command_reply: tid=0 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 client.16485 shutdown 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 msgr2=0x564a8dc50470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc50470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009fd0 tx=0x7f4d0000fe30 comp rx=0 tx=0).stop 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 shutdown_connections 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dc5d930 0x564a8dc5fd10 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc4a4f0 0x564a8dc4dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc50470 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4cecff9700 0 client.16485 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 --2- 172.21.15.35:0/2449528485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc4d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 >> 172.21.15.35:0/2449528485 conn(0x564a8daa16b0 msgr2=0x564a8dc43410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:23:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 shutdown_connections 2023-03-17T09:23:45.336 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:00 smithi035 ceph-mon[92535]: pgmap v912: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:45.336 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:02 smithi035 ceph-mon[92535]: pgmap v913: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:45.667 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:23:45.667 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:23:45.667 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:23:46.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:46.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:04 smithi035 ceph-mon[92535]: pgmap v914: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:23:46.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:06 smithi035 ceph-mon[92535]: pgmap v915: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:23:46.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:08 smithi035 ceph-mon[92535]: pgmap v916: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:23:47.293 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:09 smithi035 ceph-mon[92535]: osdmap e133: 12 total, 12 up, 12 in 2023-03-17T09:23:47.293 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:10 smithi035 ceph-mon[92535]: pgmap v918: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:23:47.293 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:12 smithi035 ceph-mon[92535]: pgmap v919: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:23:47.293 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:14 smithi035 ceph-mon[92535]: pgmap v920: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:23:47.293 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:16 smithi035 ceph-mon[92535]: osdmap e134: 12 total, 12 up, 12 in 2023-03-17T09:23:47.293 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:16 smithi035 ceph-mon[92535]: pgmap v922: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:18 smithi035 ceph-mon[92535]: pgmap v923: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:20 smithi035 ceph-mon[92535]: pgmap v924: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:22 smithi035 ceph-mon[92535]: pgmap v925: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:24 smithi035 ceph-mon[92535]: pgmap v926: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:26 smithi035 ceph-mon[92535]: pgmap v927: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 915 B/s wr, 10 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:28 smithi035 ceph-mon[92535]: pgmap v928: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:30 smithi035 ceph-mon[92535]: pgmap v929: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:32 smithi035 ceph-mon[92535]: pgmap v930: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:34 smithi035 ceph-mon[92535]: pgmap v931: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:36 smithi035 ceph-mon[92535]: pgmap v932: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:38 smithi035 ceph-mon[92535]: pgmap v933: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:23:47.294 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:40 smithi035 ceph-mon[92535]: pgmap v934: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:23:47.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:42 smithi035 ceph-mon[92535]: pgmap v935: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:23:47.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:44 smithi035 ceph-mon[92535]: pgmap v936: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:23:47.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:46 smithi035 ceph-mon[92535]: pgmap v937: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:47.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:48 smithi035 ceph-mon[92535]: pgmap v938: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:23:47.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:50 smithi035 ceph-mon[92535]: pgmap v939: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:23:48.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:52 smithi035 ceph-mon[92535]: pgmap v940: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:23:48.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:54 smithi035 ceph-mon[92535]: pgmap v941: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:23:48.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:56 smithi035 ceph-mon[92535]: pgmap v942: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:15:58 smithi035 ceph-mon[92535]: pgmap v943: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:00 smithi035 ceph-mon[92535]: pgmap v944: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:02 smithi035 ceph-mon[92535]: pgmap v945: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:04 smithi035 ceph-mon[92535]: pgmap v946: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:23:48.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:23:48.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:48.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:06 smithi035 ceph-mon[92535]: pgmap v947: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:23:48.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:08 smithi035 ceph-mon[92535]: pgmap v948: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:23:49.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:09 smithi035 ceph-mon[92535]: osdmap e135: 12 total, 12 up, 12 in 2023-03-17T09:23:49.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:10 smithi035 ceph-mon[92535]: pgmap v950: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:23:49.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:12 smithi035 ceph-mon[92535]: pgmap v951: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:23:49.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:14 smithi035 ceph-mon[92535]: pgmap v952: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:23:51.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:16 smithi035 ceph-mon[92535]: osdmap e136: 12 total, 12 up, 12 in 2023-03-17T09:23:51.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:16 smithi035 ceph-mon[92535]: pgmap v954: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:23:51.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:18 smithi035 ceph-mon[92535]: pgmap v955: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 915 B/s wr, 11 op/s 2023-03-17T09:23:51.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:20 smithi035 ceph-mon[92535]: pgmap v956: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:23:53.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:22 smithi035 ceph-mon[92535]: pgmap v957: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:23:53.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:24 smithi035 ceph-mon[92535]: pgmap v958: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T09:23:53.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:26 smithi035 ceph-mon[92535]: pgmap v959: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T09:23:53.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:28 smithi035 ceph-mon[92535]: pgmap v960: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T09:23:53.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:30 smithi035 ceph-mon[92535]: pgmap v961: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:32 smithi035 ceph-mon[92535]: pgmap v962: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:34 smithi035 ceph-mon[92535]: pgmap v963: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:36 smithi035 ceph-mon[92535]: pgmap v964: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:38 smithi035 ceph-mon[92535]: pgmap v965: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:40 smithi035 ceph-mon[92535]: pgmap v966: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:42 smithi035 ceph-mon[92535]: pgmap v967: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:44 smithi035 ceph-mon[92535]: pgmap v968: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:46 smithi035 ceph-mon[92535]: pgmap v969: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:48 smithi035 ceph-mon[92535]: pgmap v970: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:53.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:50 smithi035 ceph-mon[92535]: pgmap v971: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:52 smithi035 ceph-mon[92535]: pgmap v972: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:53.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:54 smithi035 ceph-mon[92535]: pgmap v973: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:53.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:56 smithi035 ceph-mon[92535]: pgmap v974: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:56.617 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:16:58 smithi035 ceph-mon[92535]: pgmap v975: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:23:56.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:00 smithi035 ceph-mon[92535]: pgmap v976: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:56.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:02 smithi035 ceph-mon[92535]: pgmap v977: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:23:56.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:04 smithi035 ceph-mon[92535]: pgmap v978: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:23:56.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:23:56.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:06 smithi035 ceph-mon[92535]: pgmap v979: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: pgmap v980: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.927 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:23:57.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:23:58.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:58.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:23:58.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:58.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:58.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:23:58.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:24:00.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:24:00.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:24:00.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:24:00.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:24:00.101 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:24:00.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:10 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:24:01.462 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:10 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:24:02.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:10 smithi035 ceph-mon[92535]: osdmap e137: 12 total, 12 up, 12 in 2023-03-17T09:24:02.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:10 smithi035 ceph-mon[92535]: pgmap v982: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:24:02.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:12 smithi035 ceph-mon[92535]: pgmap v983: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:24:02.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:14 smithi035 ceph-mon[92535]: pgmap v984: 97 pgs: 97 active+clean; 1.5 MiB data, 179 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:24:02.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:16 smithi035 ceph-mon[92535]: osdmap e138: 12 total, 12 up, 12 in 2023-03-17T09:24:02.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:16 smithi035 ceph-mon[92535]: pgmap v986: 97 pgs: 97 active+clean; 1.5 MiB data, 179 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:24:02.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:18 smithi035 ceph-mon[92535]: pgmap v987: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 12 op/s 2023-03-17T09:24:02.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:20 smithi035 ceph-mon[92535]: pgmap v988: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:24:03.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:22 smithi035 ceph-mon[92535]: pgmap v989: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:24:03.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:24 smithi035 ceph-mon[92535]: pgmap v990: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:24:03.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:26 smithi035 ceph-mon[92535]: pgmap v991: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:24:04.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:28 smithi035 ceph-mon[92535]: pgmap v992: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:24:04.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:30 smithi035 ceph-mon[92535]: pgmap v993: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:24:05.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:32 smithi035 ceph-mon[92535]: pgmap v994: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:24:05.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:34 smithi035 ceph-mon[92535]: pgmap v995: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:24:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:24:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:24:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:24:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:24:05.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:24:05.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:24:05.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.845+0000 7f4d17443b80 1 -- 172.21.15.35:0/2449528485 wait complete. 2023-03-17T09:24:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.846+0000 7f4d17443b80 20 client.16485 trim_cache size 0 max 16384 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.861+0000 7f4d17443b80 1 Processor -- start 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 -- start start 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc44960 0x564a8dc54cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc50010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 0x564a8dc47650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dc3bb90 con 0x564a8dc4a4f0 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dc4ecd0 con 0x564a8dc44960 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d17443b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dc447d0 con 0x564a8dc49be0 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 0x564a8dc47650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 0x564a8dc47650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44902/0 (socket says 172.21.15.35:44902) 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 -- 172.21.15.35:0/3866022004 learned_addr learned my addr 172.21.15.35:0/3866022004 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d08851700 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc50010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09052700 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc44960 0x564a8dc54cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 -- 172.21.15.35:0/3866022004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 msgr2=0x564a8dc50010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc50010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 -- 172.21.15.35:0/3866022004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc44960 msgr2=0x564a8dc54cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc44960 0x564a8dc54cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 -- 172.21.15.35:0/3866022004 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8db5d130 con 0x564a8dc4a4f0 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.862+0000 7f4d09853700 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 0x564a8dc47650 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc008740 tx=0x7f4cfc0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05505951a7231d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.863+0000 7f4ceffff700 1 -- 172.21.15.35:0/3866022004 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00f070 con 0x564a8dc4a4f0 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.863+0000 7f4ceffff700 1 -- 172.21.15.35:0/3866022004 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4cfc010040 con 0x564a8dc4a4f0 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.863+0000 7f4ceffff700 1 -- 172.21.15.35:0/3866022004 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc016920 con 0x564a8dc4a4f0 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 -- 172.21.15.35:0/3866022004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 msgr2=0x564a8dc47650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 0x564a8dc47650 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc008740 tx=0x7f4cfc0078d0 comp rx=0 tx=0).stop 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 -- 172.21.15.35:0/3866022004 shutdown_connections 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc4a4f0 0x564a8dc47650 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc44960 0x564a8dc54cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 --2- 172.21.15.35:0/3866022004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc49be0 0x564a8dc50010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 -- 172.21.15.35:0/3866022004 >> 172.21.15.35:0/3866022004 conn(0x564a8daa16b0 msgr2=0x564a8dc43a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 -- 172.21.15.35:0/3866022004 shutdown_connections 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 -- 172.21.15.35:0/3866022004 wait complete. 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 -- start start 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.864+0000 7f4d17443b80 1 Processor -- start 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc49be0 0x564a8dc53820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc4a4f0 0x564a8dc53d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dc55260 con 0x564a8dc44960 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dcb1780 con 0x564a8dc49be0 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8dcb18c0 con 0x564a8dc4a4f0 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d17443b80 10 client.0 _ll_register_callbacks cb 0x564a8da3c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44904/0 (socket says 172.21.15.35:44904) 2023-03-17T09:24:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 -- 172.21.15.35:0/1457480122 learned_addr learned my addr 172.21.15.35:0/1457480122 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d08851700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc49be0 0x564a8dc53820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09853700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc4a4f0 0x564a8dc53d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 -- 172.21.15.35:0/1457480122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc4a4f0 msgr2=0x564a8dc53d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc4a4f0 0x564a8dc53d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 -- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc49be0 msgr2=0x564a8dc53820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc49be0 0x564a8dc53820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.865+0000 7f4d09052700 1 -- 172.21.15.35:0/1457480122 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0083f0 con 0x564a8dc44960 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d09052700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc532e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4d00098330 tx=0x7f4d00098170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d466f2f616e1eb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4cecff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4cecff9700 1 -- 172.21.15.35:0/1457480122 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00096f70 con 0x564a8dc44960 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4cecff9700 1 -- 172.21.15.35:0/1457480122 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4d000a0ec0 con 0x564a8dc44960 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a8dc141e0 con 0x564a8dc44960 2023-03-17T09:24:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4cecff9700 1 -- 172.21.15.35:0/1457480122 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d00099eb0 con 0x564a8dc44960 2023-03-17T09:24:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 10 client.16491 fetch_fsmap learned FSMap version 31 2023-03-17T09:24:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564a8d9eb1f0 con 0x564a8dc44960 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4cecff9700 1 -- 172.21.15.35:0/1457480122 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d00063070 con 0x564a8dc44960 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4cecff9700 1 -- 172.21.15.35:0/1457480122 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d000996e0 con 0x564a8dc44960 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 20 client.16491 populate_metadata read hostname 'smithi035' 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dcb2a80 0x564a8dcb4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 4 client.16491 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.866+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a8da1af00 con 0x564a8dcb2a80 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.867+0000 7f4d08851700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dcb2a80 0x564a8dcb4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.867+0000 7f4d08851700 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dcb2a80 0x564a8dcb4e60 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=833a1a322a357a9a server_cookie=6b32f2a10ee43bbe in_seq=0 out_seq=0 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.867+0000 7f4cecff9700 10 client.16491 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4cecff9700 1 -- 172.21.15.35:0/1457480122 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a8da1af00 con 0x564a8dcb2a80 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4cecff9700 10 client.16491 handle_command_reply: tid=0 2023-03-17T09:24:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 client.16491 shutdown 2023-03-17T09:24:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 msgr2=0x564a8dc532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc532e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4d00098330 tx=0x7f4d00098170 comp rx=0 tx=0).stop 2023-03-17T09:24:11.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 shutdown_connections 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a8dcb2a80 0x564a8dcb4e60 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a8dc4a4f0 0x564a8dc53d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4cecff9700 0 client.16491 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a8dc44960 0x564a8dc532e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 --2- 172.21.15.35:0/1457480122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a8dc49be0 0x564a8dc53820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 >> 172.21.15.35:0/1457480122 conn(0x564a8daa16b0 msgr2=0x564a8dc47650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:11.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 shutdown_connections 2023-03-17T09:24:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.871+0000 7f4d17443b80 1 -- 172.21.15.35:0/1457480122 wait complete. 2023-03-17T09:24:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d17443b80 20 client.16491 trim_cache size 0 max 16384 2023-03-17T09:24:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4cf009f640 msgr2=0x7f4cf00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4cf009f640 0x7f4cf00a1af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d040689a0 tx=0x7f4cf4009260 comp rx=0 tx=0).stop 2023-03-17T09:24:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 msgr2=0x7f4d04194e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d04194e70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4d00005910 tx=0x7f4d0000f690 comp rx=0 tx=0).stop 2023-03-17T09:24:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 shutdown_connections 2023-03-17T09:24:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4cf009f640 0x7f4cf00a1af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d04104390 0x7f4d041958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d040ff350 0x7f4d04194e70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 --2- 172.21.15.35:0/594106444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d040ffcf0 0x7f4d041953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 >> 172.21.15.35:0/594106444 conn(0x7f4d04076330 msgr2=0x7f4d040fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 shutdown_connections 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:05:55.872+0000 7f4d0b2b6700 1 -- 172.21.15.35:0/594106444 wait complete. 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 -- 172.21.15.35:0/2533300708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 msgr2=0x7f5d940ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 --2- 172.21.15.35:0/2533300708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d940ff720 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5d840099c0 tx=0x7f5d84009cd0 comp rx=0 tx=0).stop 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 -- 172.21.15.35:0/2533300708 shutdown_connections 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 --2- 172.21.15.35:0/2533300708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 0x7f5d9410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 --2- 172.21.15.35:0/2533300708 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d940ff720 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 --2- 172.21.15.35:0/2533300708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d940ffcf0 0x7f5d94103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.997+0000 7f5d9b868700 1 -- 172.21.15.35:0/2533300708 >> 172.21.15.35:0/2533300708 conn(0x7f5d94076330 msgr2=0x7f5d94076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.998+0000 7f5d9b868700 1 -- 172.21.15.35:0/2533300708 shutdown_connections 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.998+0000 7f5d9b868700 1 -- 172.21.15.35:0/2533300708 wait complete. 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.998+0000 7f5d9b868700 1 Processor -- start 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 -- start start 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d94196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d940ffcf0 0x7f5d941967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 0x7f5d9419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9419b1d0 con 0x7f5d940ff350 2023-03-17T09:24:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9419b340 con 0x7f5d940ffcf0 2023-03-17T09:24:22.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d9b868700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9419b500 con 0x7f5d94104390 2023-03-17T09:24:22.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d94196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:22.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d94196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44916/0 (socket says 172.21.15.35:44916) 2023-03-17T09:24:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 -- 172.21.15.35:0/3046054858 learned_addr learned my addr 172.21.15.35:0/3046054858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d98e03700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d940ffcf0 0x7f5d941967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99e05700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 0x7f5d9419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 -- 172.21.15.35:0/3046054858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 msgr2=0x7f5d9419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 0x7f5d9419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 -- 172.21.15.35:0/3046054858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d940ffcf0 msgr2=0x7f5d941967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d940ffcf0 0x7f5d941967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 -- 172.21.15.35:0/3046054858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840095f0 con 0x7f5d940ff350 2023-03-17T09:24:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99e05700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 0x7f5d9419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:08.999+0000 7f5d99604700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d94196260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009fd0 tx=0x7f5d8400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.000+0000 7f5d8a7fc700 1 -- 172.21.15.35:0/3046054858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8401d070 con 0x7f5d940ff350 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.000+0000 7f5d8a7fc700 1 -- 172.21.15.35:0/3046054858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d840054c0 con 0x7f5d940ff350 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.000+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9410f000 con 0x7f5d940ff350 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.000+0000 7f5d8a7fc700 1 -- 172.21.15.35:0/3046054858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84004a90 con 0x7f5d940ff350 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.000+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9410ee70 con 0x7f5d940ff350 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.002+0000 7f5d8a7fc700 1 -- 172.21.15.35:0/3046054858 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5d8400fb80 con 0x7f5d940ff350 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.002+0000 7f5d8a7fc700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5d8009f640 0x7f5d800a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.003+0000 7f5d98e03700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5d8009f640 0x7f5d800a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:23.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.003+0000 7f5d8a7fc700 1 -- 172.21.15.35:0/3046054858 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f5d840cb460 con 0x7f5d940ff350 2023-03-17T09:24:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.003+0000 7f5d98e03700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5d8009f640 0x7f5d800a1af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d94197800 tx=0x7f5d9000f7a0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 Processor -- start 2023-03-17T09:24:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 -- start start 2023-03-17T09:24:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5930fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c592b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c592bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5832010 con 0x55f4c5930be0 2023-03-17T09:24:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5884950 con 0x55f4c592b960 2023-03-17T09:24:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.005+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c587dde0 con 0x55f4c59314f0 2023-03-17T09:24:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d99604700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5930fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d99604700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5930fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44924/0 (socket says 172.21.15.35:44924) 2023-03-17T09:24:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d99604700 1 -- 172.21.15.35:0/198658328 learned_addr learned my addr 172.21.15.35:0/198658328 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c592b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d99e05700 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c592bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 -- 172.21.15.35:0/198658328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 msgr2=0x55f4c592bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c592bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 -- 172.21.15.35:0/198658328 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 msgr2=0x55f4c5930fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5930fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 -- 172.21.15.35:0/198658328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4c56ff5d0 con 0x55f4c59314f0 2023-03-17T09:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d99604700 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5930fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.006+0000 7f5d98e03700 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c592b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d941000c0 tx=0x7f5d90017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=964db950b84e6a22 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.007+0000 7f5d7f7fe700 1 -- 172.21.15.35:0/198658328 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9001baa0 con 0x55f4c59314f0 2023-03-17T09:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.007+0000 7f5d7f7fe700 1 -- 172.21.15.35:0/198658328 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d90015040 con 0x55f4c59314f0 2023-03-17T09:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.007+0000 7f5d7f7fe700 1 -- 172.21.15.35:0/198658328 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90026df0 con 0x55f4c59314f0 2023-03-17T09:24:25.907 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:36 smithi035 ceph-mon[92535]: pgmap v996: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:24:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 -- 172.21.15.35:0/198658328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 msgr2=0x55f4c592b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c592b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d941000c0 tx=0x7f5d90017000 comp rx=0 tx=0).stop 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 -- 172.21.15.35:0/198658328 shutdown_connections 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c592bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5930fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/198658328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c592b420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 -- 172.21.15.35:0/198658328 >> 172.21.15.35:0/198658328 conn(0x55f4c57886b0 msgr2=0x55f4c5925a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 -- 172.21.15.35:0/198658328 shutdown_connections 2023-03-17T09:24:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 -- 172.21.15.35:0/198658328 wait complete. 2023-03-17T09:24:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 -- start start 2023-03-17T09:24:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.008+0000 7f5da79f5b80 1 Processor -- start 2023-03-17T09:24:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c59374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5934720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5934da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c57018c0 con 0x55f4c5930be0 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5935510 con 0x55f4c592b960 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5949810 con 0x55f4c59314f0 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5da79f5b80 10 client.0 _ll_register_callbacks cb 0x55f4c5723230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5d98e03700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5934720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5d98e03700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5934720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44932/0 (socket says 172.21.15.35:44932) 2023-03-17T09:24:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5d98e03700 1 -- 172.21.15.35:0/2484939187 learned_addr learned my addr 172.21.15.35:0/2484939187 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5d99604700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c59374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.009+0000 7f5d99e05700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5934da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d98e03700 1 -- 172.21.15.35:0/2484939187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 msgr2=0x55f4c5934da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d98e03700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5934da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d98e03700 1 -- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 msgr2=0x55f4c59374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d98e03700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c59374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d98e03700 1 -- 172.21.15.35:0/2484939187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d90003ac0 con 0x55f4c5930be0 2023-03-17T09:24:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d98e03700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5934720 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5d90005fa0 tx=0x7f5d90026cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936ecc15d078a322 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:24:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d7cff9700 1 -- 172.21.15.35:0/2484939187 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f030 con 0x55f4c5930be0 2023-03-17T09:24:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d7cff9700 1 -- 172.21.15.35:0/2484939187 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f5d9000f190 con 0x55f4c5930be0 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4c5840390 con 0x55f4c5930be0 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d7cff9700 1 -- 172.21.15.35:0/2484939187 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d9000f350 con 0x55f4c5930be0 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5da79f5b80 10 client.16503 fetch_fsmap learned FSMap version 31 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f4c56abd80 con 0x55f4c5930be0 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d7cff9700 1 -- 172.21.15.35:0/2484939187 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4c5840390 con 0x55f4c5930be0 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.010+0000 7f5d7cff9700 1 -- 172.21.15.35:0/2484939187 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5d9002d020 con 0x55f4c5930be0 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5da79f5b80 10 client.16503 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:24:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5da79f5b80 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:24:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5da79f5b80 20 client.16503 populate_metadata read hostname 'smithi035' 2023-03-17T09:24:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c594d830 0x55f4c594fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5da79f5b80 4 client.16503 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:24:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4c584c600 con 0x55f4c594d830 2023-03-17T09:24:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5d99604700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c594d830 0x55f4c594fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5d99604700 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c594d830 0x55f4c594fc40 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63500462a79a481 server_cookie=6d16102852a71d59 in_seq=0 out_seq=0 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.011+0000 7f5d7cff9700 10 client.16503 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5d7cff9700 1 -- 172.21.15.35:0/2484939187 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f4c584c600 con 0x55f4c594d830 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5d7cff9700 10 client.16503 handle_command_reply: tid=0 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 client.16503 shutdown 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 msgr2=0x55f4c5934720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5934720 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5d90005fa0 tx=0x7f5d90026cc0 comp rx=0 tx=0).stop 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 shutdown_connections 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c594d830 0x55f4c594fc40 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5934da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:32.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5d7cff9700 0 client.16503 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:24:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c592b960 0x55f4c59374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:34.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/2484939187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5934720 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:34.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 >> 172.21.15.35:0/2484939187 conn(0x55f4c57886b0 msgr2=0x55f4c592a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:34.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 shutdown_connections 2023-03-17T09:24:34.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.012+0000 7f5da79f5b80 1 -- 172.21.15.35:0/2484939187 wait complete. 2023-03-17T09:24:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.013+0000 7f5da79f5b80 20 client.16503 trim_cache size 0 max 16384 2023-03-17T09:24:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 Processor -- start 2023-03-17T09:24:35.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 -- start start 2023-03-17T09:24:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 0x55f4c5925ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c5930be0 0x55f4c59447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:35.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5949c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5926e40 con 0x55f4c592b960 2023-03-17T09:24:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5927c30 con 0x55f4c5930be0 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c592aa90 con 0x55f4c59314f0 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5d99604700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 0x55f4c5925ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5d99604700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 0x55f4c5925ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44938/0 (socket says 172.21.15.35:44938) 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.028+0000 7f5d99604700 1 -- 172.21.15.35:0/1635057450 learned_addr learned my addr 172.21.15.35:0/1635057450 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d98e03700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c5930be0 0x55f4c59447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99e05700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5949c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99604700 1 -- 172.21.15.35:0/1635057450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 msgr2=0x55f4c5949c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99604700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5949c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:38.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99604700 1 -- 172.21.15.35:0/1635057450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c5930be0 msgr2=0x55f4c59447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:38.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99604700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c5930be0 0x55f4c59447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99604700 1 -- 172.21.15.35:0/1635057450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4c5844130 con 0x55f4c592b960 2023-03-17T09:24:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d98e03700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c5930be0 0x55f4c59447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:24:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99e05700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5949c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:24:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d99604700 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 0x55f4c5925ac0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5d84000c00 tx=0x7f5d8401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d571fda10a6f61 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d7ffff700 1 -- 172.21.15.35:0/1635057450 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840b1250 con 0x55f4c592b960 2023-03-17T09:24:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d7ffff700 1 -- 172.21.15.35:0/1635057450 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d84097310 con 0x55f4c592b960 2023-03-17T09:24:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.029+0000 7f5d7ffff700 1 -- 172.21.15.35:0/1635057450 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840986c0 con 0x55f4c592b960 2023-03-17T09:24:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 -- 172.21.15.35:0/1635057450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 msgr2=0x55f4c5925ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 0x55f4c5925ac0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5d84000c00 tx=0x7f5d8401a040 comp rx=0 tx=0).stop 2023-03-17T09:24:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 -- 172.21.15.35:0/1635057450 shutdown_connections 2023-03-17T09:24:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c59314f0 0x55f4c5949c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c592b960 0x55f4c5925ac0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/1635057450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c5930be0 0x55f4c59447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 -- 172.21.15.35:0/1635057450 >> 172.21.15.35:0/1635057450 conn(0x55f4c57886b0 msgr2=0x55f4c592ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 -- 172.21.15.35:0/1635057450 shutdown_connections 2023-03-17T09:24:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 -- 172.21.15.35:0/1635057450 wait complete. 2023-03-17T09:24:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 -- start start 2023-03-17T09:24:40.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.030+0000 7f5da79f5b80 1 Processor -- start 2023-03-17T09:24:40.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c592b960 0x55f4c5944750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:40.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5942a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:40.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c59314f0 0x55f4c5942fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:40.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5943590 con 0x55f4c5930be0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c5943700 con 0x55f4c59314f0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4c59438c0 con 0x55f4c592b960 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5da79f5b80 10 client.0 _ll_register_callbacks cb 0x55f4c5723230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5942a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5942a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44946/0 (socket says 172.21.15.35:44946) 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 -- 172.21.15.35:0/3872833836 learned_addr learned my addr 172.21.15.35:0/3872833836 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d99604700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c592b960 0x55f4c5944750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d99e05700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c59314f0 0x55f4c5942fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 -- 172.21.15.35:0/3872833836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c592b960 msgr2=0x55f4c5944750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c592b960 0x55f4c5944750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 -- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c59314f0 msgr2=0x55f4c5942fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c59314f0 0x55f4c5942fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 -- 172.21.15.35:0/3872833836 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9410f000 con 0x55f4c5930be0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d98e03700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5942a80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55f4c5922ca0 tx=0x7f5d90004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b827b6508dc8aedb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.031+0000 7f5d7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:24:40.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5d7cff9700 1 -- 172.21.15.35:0/3872833836 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f440 con 0x55f4c5930be0 2023-03-17T09:24:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4c58fb1e0 con 0x55f4c5930be0 2023-03-17T09:24:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5d7cff9700 1 -- 172.21.15.35:0/3872833836 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f5d90004ac0 con 0x55f4c5930be0 2023-03-17T09:24:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5d7cff9700 1 -- 172.21.15.35:0/3872833836 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d90025ec0 con 0x55f4c5930be0 2023-03-17T09:24:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 10 client.16509 fetch_fsmap learned FSMap version 31 2023-03-17T09:24:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f4c56d21f0 con 0x55f4c5930be0 2023-03-17T09:24:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5d7cff9700 1 -- 172.21.15.35:0/3872833836 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4c58fb1e0 con 0x55f4c5930be0 2023-03-17T09:24:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5d7cff9700 1 -- 172.21.15.35:0/3872833836 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5d9002d070 con 0x55f4c5930be0 2023-03-17T09:24:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 10 client.16509 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 20 client.16509 populate_metadata read hostname 'smithi035' 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c59a28d0 0x55f4c59a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 4 client.16509 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f4c5701f00 con 0x55f4c59a28d0 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.032+0000 7f5d99604700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c59a28d0 0x55f4c59a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.033+0000 7f5d7cff9700 10 client.16509 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.033+0000 7f5d99604700 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c59a28d0 0x55f4c59a4ce0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4a99fde85dadeea server_cookie=691c0a40bb5bac34 in_seq=0 out_seq=0 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5d7cff9700 1 -- 172.21.15.35:0/3872833836 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f4c5701f00 con 0x55f4c59a28d0 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5d7cff9700 10 client.16509 handle_command_reply: tid=0 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 client.16509 shutdown 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 msgr2=0x55f4c5942a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5942a80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x55f4c5922ca0 tx=0x7f5d90004970 comp rx=0 tx=0).stop 2023-03-17T09:24:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 shutdown_connections 2023-03-17T09:24:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4c59a28d0 0x55f4c59a4ce0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4c59314f0 0x55f4c5942fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5d7cff9700 0 client.16509 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:24:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4c592b960 0x55f4c5944750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.040+0000 7f5da79f5b80 1 --2- 172.21.15.35:0/3872833836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f4c5930be0 0x55f4c5942a80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 >> 172.21.15.35:0/3872833836 conn(0x55f4c57886b0 msgr2=0x55f4c5931990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 shutdown_connections 2023-03-17T09:24:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5da79f5b80 1 -- 172.21.15.35:0/3872833836 wait complete. 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5da79f5b80 20 client.16509 trim_cache size 0 max 16384 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5d8009f640 msgr2=0x7f5d800a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5d8009f640 0x7f5d800a1af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d94197800 tx=0x7f5d9000f7a0 comp rx=0 tx=0).stop 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 msgr2=0x7f5d94196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d94196260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009fd0 tx=0x7f5d8400f690 comp rx=0 tx=0).stop 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 shutdown_connections 2023-03-17T09:24:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5d8009f640 0x7f5d800a1af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d94104390 0x7f5d9419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5d940ff350 0x7f5d94196260 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 --2- 172.21.15.35:0/3046054858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d940ffcf0 0x7f5d941967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 >> 172.21.15.35:0/3046054858 conn(0x7f5d94076330 msgr2=0x7f5d94102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 shutdown_connections 2023-03-17T09:24:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:09.041+0000 7f5d9b868700 1 -- 172.21.15.35:0/3046054858 wait complete. 2023-03-17T09:24:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.163+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1054685187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100450 msgr2=0x7fb818100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.163+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1054685187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100450 0x7fb818100820 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb8080099c0 tx=0x7fb808009cd0 comp rx=0 tx=0).stop 2023-03-17T09:24:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.163+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1054685187 shutdown_connections 2023-03-17T09:24:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.163+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1054685187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818105490 0x7fb81810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.164+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1054685187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100450 0x7fb818100820 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.164+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1054685187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb818100df0 0x7fb818104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:53.493 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:38 smithi035 ceph-mon[92535]: pgmap v997: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:24:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.164+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1054685187 >> 172.21.15.35:0/1054685187 conn(0x7fb8180fbca0 msgr2=0x7fb8180fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:24:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.164+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1054685187 shutdown_connections 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.164+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1054685187 wait complete. 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.164+0000 7fb81dbd6700 1 Processor -- start 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 -- start start 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818100450 0x7fb818196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 0x7fb8181967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb818105490 0x7fb81819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81819b270 con 0x7fb818100df0 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81819b3e0 con 0x7fb818100450 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb81dbd6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81819b5a0 con 0x7fb818105490 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb816ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 0x7fb8181967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb816ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 0x7fb8181967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44960/0 (socket says 172.21.15.35:44960) 2023-03-17T09:24:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb816ffd700 1 -- 172.21.15.35:0/1630879096 learned_addr learned my addr 172.21.15.35:0/1630879096 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:24:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb8177fe700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818100450 0x7fb818196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.165+0000 7fb817fff700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb818105490 0x7fb81819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:24:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb816ffd700 1 -- 172.21.15.35:0/1630879096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb818105490 msgr2=0x7fb81819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb816ffd700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb818105490 0x7fb81819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb816ffd700 1 -- 172.21.15.35:0/1630879096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818100450 msgr2=0x7fb818196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:24:56.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb816ffd700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818100450 0x7fb818196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:24:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb816ffd700 1 -- 172.21.15.35:0/1630879096 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080095f0 con 0x7fb818100df0 2023-03-17T09:24:56.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb816ffd700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 0x7fb8181967d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00d950 tx=0x7fb80c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:24:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb814ff9700 1 -- 172.21.15.35:0/1630879096 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004220 con 0x7fb818100df0 2023-03-17T09:24:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb814ff9700 1 -- 172.21.15.35:0/1630879096 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb80c004cc0 con 0x7fb818100df0 2023-03-17T09:25:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818110150 con 0x7fb818100df0 2023-03-17T09:25:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb814ff9700 1 -- 172.21.15.35:0/1630879096 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c005600 con 0x7fb818100df0 2023-03-17T09:25:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.166+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81810ffc0 con 0x7fb818100df0 2023-03-17T09:25:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.168+0000 7fb814ff9700 1 -- 172.21.15.35:0/1630879096 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb80c004380 con 0x7fb818100df0 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.169+0000 7fb814ff9700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb80009f640 0x7fb8000a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.169+0000 7fb814ff9700 1 -- 172.21.15.35:0/1630879096 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb80c0ca410 con 0x7fb818100df0 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.169+0000 7fb8177fe700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb80009f640 0x7fb8000a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb8177fe700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb80009f640 0x7fb8000a1af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb808009990 tx=0x7fb808005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 Processor -- start 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 -- start start 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3114fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c31154f0 0x55d6c310f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 0x55d6c310fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c3016010 con 0x55d6c310f960 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c3068950 con 0x55d6c31154f0 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb829d63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c3061de0 con 0x55d6c3114be0 2023-03-17T09:25:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 0x55d6c310fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 0x55d6c310fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44970/0 (socket says 172.21.15.35:44970) 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb817fff700 1 -- 172.21.15.35:0/2390632134 learned_addr learned my addr 172.21.15.35:0/2390632134 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb8177fe700 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3114fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.170+0000 7fb816ffd700 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c31154f0 0x55d6c310f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb817fff700 1 -- 172.21.15.35:0/2390632134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 msgr2=0x55d6c3114fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb817fff700 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3114fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb817fff700 1 -- 172.21.15.35:0/2390632134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c31154f0 msgr2=0x55d6c310f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb817fff700 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c31154f0 0x55d6c310f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb817fff700 1 -- 172.21.15.35:0/2390632134 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6c2ee35d0 con 0x55d6c310f960 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb816ffd700 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c31154f0 0x55d6c310f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb817fff700 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 0x55d6c310fd90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb810011680 tx=0x7fb810009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786b5dfec0246c7a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb7fdffb700 1 -- 172.21.15.35:0/2390632134 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000e040 con 0x55d6c310f960 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb7fdffb700 1 -- 172.21.15.35:0/2390632134 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb81000f040 con 0x55d6c310f960 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.171+0000 7fb7fdffb700 1 -- 172.21.15.35:0/2390632134 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810004730 con 0x55d6c310f960 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 -- 172.21.15.35:0/2390632134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 msgr2=0x55d6c310fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 0x55d6c310fd90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb810011680 tx=0x7fb810009920 comp rx=0 tx=0).stop 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 -- 172.21.15.35:0/2390632134 shutdown_connections 2023-03-17T09:25:01.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c310f960 0x55d6c310fd90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3114fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 --2- 172.21.15.35:0/2390632134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c31154f0 0x55d6c310f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 -- 172.21.15.35:0/2390632134 >> 172.21.15.35:0/2390632134 conn(0x55d6c2f6c6b0 msgr2=0x55d6c3109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 -- 172.21.15.35:0/2390632134 shutdown_connections 2023-03-17T09:25:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 -- 172.21.15.35:0/2390632134 wait complete. 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.172+0000 7fb829d63b80 1 -- start start 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 Processor -- start 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c310f960 0x55d6c311b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c3114be0 0x55d6c31185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c3118b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c2ee58c0 con 0x55d6c31154f0 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c3119250 con 0x55d6c3114be0 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c3119410 con 0x55d6c310f960 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb829d63b80 10 client.0 _ll_register_callbacks cb 0x55d6c2f07230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c3118b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c3118b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44976/0 (socket says 172.21.15.35:44976) 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 -- 172.21.15.35:0/702738073 learned_addr learned my addr 172.21.15.35:0/702738073 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb816ffd700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c3114be0 0x55d6c31185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb8177fe700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c310f960 0x55d6c311b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 -- 172.21.15.35:0/702738073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c310f960 msgr2=0x55d6c311b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c310f960 0x55d6c311b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 -- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c3114be0 msgr2=0x55d6c31185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c3114be0 0x55d6c31185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 -- 172.21.15.35:0/702738073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb810011330 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.173+0000 7fb817fff700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c3118b10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb810009690 tx=0x7fb810005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a55a79631853424 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb7f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/702738073 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000e070 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/702738073 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb810004500 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6c3024390 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/702738073 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb810004700 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 10 client.16521 fetch_fsmap learned FSMap version 31 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d6c2e8fd80 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/702738073 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6c3024390 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/702738073 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb810024020 con 0x55d6c31154f0 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 10 client.16521 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 20 client.16521 populate_metadata read hostname 'smithi035' 2023-03-17T09:25:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c3128f10 0x55d6c312b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 4 client.16521 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.174+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6c3030600 con 0x55d6c3128f10 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.175+0000 7fb8177fe700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c3128f10 0x55d6c312b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.175+0000 7fb7f6ffd700 10 client.16521 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.175+0000 7fb8177fe700 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c3128f10 0x55d6c312b2f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91ac323d397ddc0 server_cookie=b4fa927f09681c8a in_seq=0 out_seq=0 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/702738073 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d6c3030600 con 0x55d6c3128f10 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb7f6ffd700 10 client.16521 handle_command_reply: tid=0 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 client.16521 shutdown 2023-03-17T09:25:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 msgr2=0x55d6c3118b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c3118b10 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb810009690 tx=0x7fb810005b90 comp rx=0 tx=0).stop 2023-03-17T09:25:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 shutdown_connections 2023-03-17T09:25:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c3128f10 0x55d6c312b2f0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c3118b10 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb7f6ffd700 0 client.16521 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c310f960 0x55d6c311b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 --2- 172.21.15.35:0/702738073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c3114be0 0x55d6c31185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 >> 172.21.15.35:0/702738073 conn(0x55d6c2f6c6b0 msgr2=0x55d6c3109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 shutdown_connections 2023-03-17T09:25:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 1 -- 172.21.15.35:0/702738073 wait complete. 2023-03-17T09:25:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.176+0000 7fb829d63b80 20 client.16521 trim_cache size 0 max 16384 2023-03-17T09:25:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 Processor -- start 2023-03-17T09:25:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 -- start start 2023-03-17T09:25:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c3109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3115fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c311aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c31050d0 con 0x55d6c31154f0 2023-03-17T09:25:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c31065c0 con 0x55d6c310f960 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb829d63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c3106b60 con 0x55d6c3114be0 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c311aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c311aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44984/0 (socket says 172.21.15.35:44984) 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.191+0000 7fb817fff700 1 -- 172.21.15.35:0/3342925816 learned_addr learned my addr 172.21.15.35:0/3342925816 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb8177fe700 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c3109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb816ffd700 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3115fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb817fff700 1 -- 172.21.15.35:0/3342925816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 msgr2=0x55d6c3115fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb817fff700 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3115fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb817fff700 1 -- 172.21.15.35:0/3342925816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 msgr2=0x55d6c3109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb817fff700 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c3109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb817fff700 1 -- 172.21.15.35:0/3342925816 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6c3110000 con 0x55d6c31154f0 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb8177fe700 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c3109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb817fff700 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c311aef0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb810011680 tx=0x7fb8100155f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4cdbd620bc34c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb7fe7fc700 1 -- 172.21.15.35:0/3342925816 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000e030 con 0x55d6c31154f0 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb7fe7fc700 1 -- 172.21.15.35:0/3342925816 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8100092e0 con 0x55d6c31154f0 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.192+0000 7fb7fe7fc700 1 -- 172.21.15.35:0/3342925816 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810014880 con 0x55d6c31154f0 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 -- 172.21.15.35:0/3342925816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 msgr2=0x55d6c311aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c311aef0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb810011680 tx=0x7fb8100155f0 comp rx=0 tx=0).stop 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 -- 172.21.15.35:0/3342925816 shutdown_connections 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c311aef0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c3109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 --2- 172.21.15.35:0/3342925816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c3115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 -- 172.21.15.35:0/3342925816 >> 172.21.15.35:0/3342925816 conn(0x55d6c2f6c6b0 msgr2=0x55d6c31158c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 -- 172.21.15.35:0/3342925816 shutdown_connections 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 -- 172.21.15.35:0/3342925816 wait complete. 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 -- start start 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.193+0000 7fb829d63b80 1 Processor -- start 2023-03-17T09:25:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c311bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c311c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c317bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c311cd50 con 0x55d6c31154f0 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c317c2b0 con 0x55d6c310f960 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6c317c3f0 con 0x55d6c3114be0 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb829d63b80 10 client.0 _ll_register_callbacks cb 0x55d6c2f07230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c317bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c317bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:44990/0 (socket says 172.21.15.35:44990) 2023-03-17T09:25:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 -- 172.21.15.35:0/489479782 learned_addr learned my addr 172.21.15.35:0/489479782 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:06.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:40 smithi035 ceph-mon[92535]: pgmap v998: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:06.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:42 smithi035 ceph-mon[92535]: pgmap v999: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:06.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:44 smithi035 ceph-mon[92535]: pgmap v1000: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:46 smithi035 ceph-mon[92535]: pgmap v1001: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:48 smithi035 ceph-mon[92535]: pgmap v1002: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:50 smithi035 ceph-mon[92535]: pgmap v1003: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:52 smithi035 ceph-mon[92535]: pgmap v1004: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:54 smithi035 ceph-mon[92535]: pgmap v1005: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:56 smithi035 ceph-mon[92535]: pgmap v1006: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:17:58 smithi035 ceph-mon[92535]: pgmap v1007: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:25:06.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:00 smithi035 ceph-mon[92535]: pgmap v1008: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:02 smithi035 ceph-mon[92535]: pgmap v1009: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:04 smithi035 ceph-mon[92535]: pgmap v1010: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:06 smithi035 ceph-mon[92535]: pgmap v1011: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:08 smithi035 ceph-mon[92535]: pgmap v1012: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:09 smithi035 ceph-mon[92535]: osdmap e139: 12 total, 12 up, 12 in 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:10 smithi035 ceph-mon[92535]: pgmap v1014: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:25:07.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:25:07.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:25:07.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:25:08.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:12 smithi035 ceph-mon[92535]: pgmap v1015: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:25:09.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:14 smithi035 ceph-mon[92535]: pgmap v1016: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:25:09.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:16 smithi035 ceph-mon[92535]: osdmap e140: 12 total, 12 up, 12 in 2023-03-17T09:25:09.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:16 smithi035 ceph-mon[92535]: pgmap v1018: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:25:11.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:18 smithi035 ceph-mon[92535]: pgmap v1019: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:25:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb8177fe700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c311bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:15.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb816ffd700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c311c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 -- 172.21.15.35:0/489479782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 msgr2=0x55d6c311c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c311c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 -- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 msgr2=0x55d6c311bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c311bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 -- 172.21.15.35:0/489479782 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6c2e8fd80 con 0x55d6c31154f0 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb817fff700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c317bd70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb8100042c0 tx=0x7fb810015b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ae39d11ff72e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb7f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:25:15.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.194+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/489479782 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000e040 con 0x55d6c31154f0 2023-03-17T09:25:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/489479782 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb81000f070 con 0x55d6c31154f0 2023-03-17T09:25:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6c2ee5f00 con 0x55d6c31154f0 2023-03-17T09:25:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/489479782 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8100060b0 con 0x55d6c31154f0 2023-03-17T09:25:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 10 client.16527 fetch_fsmap learned FSMap version 31 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d6c2e78c00 con 0x55d6c31154f0 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/489479782 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6c2ee5f00 con 0x55d6c31154f0 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/489479782 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb810011990 con 0x55d6c31154f0 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 10 client.16527 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 10 client.16527 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 20 client.16527 populate_metadata read hostname 'smithi035' 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c317d590 0x55d6c317f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 4 client.16527 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:25:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d6c301e360 con 0x55d6c317d590 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.195+0000 7fb8177fe700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c317d590 0x55d6c317f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.196+0000 7fb8177fe700 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c317d590 0x55d6c317f970 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebeb7399ae3abb00 server_cookie=a73ad589f24a109e in_seq=0 out_seq=0 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.196+0000 7fb7f6ffd700 10 client.16527 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb7f6ffd700 1 -- 172.21.15.35:0/489479782 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d6c301e360 con 0x55d6c317d590 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb7f6ffd700 10 client.16527 handle_command_reply: tid=0 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 client.16527 shutdown 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 msgr2=0x55d6c317bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c317bd70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb8100042c0 tx=0x7fb810015b30 comp rx=0 tx=0).stop 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 shutdown_connections 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d6c317d590 0x55d6c317f970 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d6c31154f0 0x55d6c317bd70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6c310f960 0x55d6c311bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 --2- 172.21.15.35:0/489479782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6c3114be0 0x55d6c311c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 >> 172.21.15.35:0/489479782 conn(0x55d6c2f6c6b0 msgr2=0x55d6c31136c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb7f6ffd700 0 client.16527 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 shutdown_connections 2023-03-17T09:25:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 1 -- 172.21.15.35:0/489479782 wait complete. 2023-03-17T09:25:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.200+0000 7fb829d63b80 20 client.16527 trim_cache size 0 max 16384 2023-03-17T09:25:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb80009f640 msgr2=0x7fb8000a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb80009f640 0x7fb8000a1af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb808009990 tx=0x7fb808005c00 comp rx=0 tx=0).stop 2023-03-17T09:25:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 msgr2=0x7fb8181967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 0x7fb8181967d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00d950 tx=0x7fb80c00dc60 comp rx=0 tx=0).stop 2023-03-17T09:25:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 shutdown_connections 2023-03-17T09:25:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb80009f640 0x7fb8000a1af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb818105490 0x7fb81819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb818100450 0x7fb818196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 --2- 172.21.15.35:0/1630879096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb818100df0 0x7fb8181967d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 >> 172.21.15.35:0/1630879096 conn(0x7fb8180fbca0 msgr2=0x7fb8180fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 shutdown_connections 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:22.201+0000 7fb81dbd6700 1 -- 172.21.15.35:0/1630879096 wait complete. 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2700407200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d340ff350 msgr2=0x7f9d340ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2700407200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d340ff350 0x7f9d340ff720 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9d240099c0 tx=0x7f9d24009cd0 comp rx=0 tx=0).stop 2023-03-17T09:25:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2700407200 shutdown_connections 2023-03-17T09:25:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2700407200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d34104390 0x7f9d3410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2700407200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d340ff350 0x7f9d340ff720 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2700407200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 0x7f9d34103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2700407200 >> 172.21.15.35:0/2700407200 conn(0x7f9d34076330 msgr2=0x7f9d34076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2700407200 shutdown_connections 2023-03-17T09:25:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2700407200 wait complete. 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.324+0000 7f9d3a15b700 1 Processor -- start 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 -- start start 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 0x7f9d34197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 0x7f9d34197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 0x7f9d341a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d341a2710 con 0x7f9d34104390 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d341a2850 con 0x7f9d340ff350 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d3a15b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d341a2990 con 0x7f9d340ffcf0 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d33fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 0x7f9d341a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 0x7f9d34197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 0x7f9d34197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d33fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 0x7f9d341a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45004/0 (socket says 172.21.15.35:45004) 2023-03-17T09:25:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 0x7f9d34197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:46796/0 (socket says 172.21.15.35:46796) 2023-03-17T09:25:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 0x7f9d34197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36768/0 (socket says 172.21.15.35:36768) 2023-03-17T09:25:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.325+0000 7f9d33fff700 1 -- 172.21.15.35:0/2463102689 learned_addr learned my addr 172.21.15.35:0/2463102689 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d33fff700 1 -- 172.21.15.35:0/2463102689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 msgr2=0x7f9d34197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d33fff700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 0x7f9d34197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d33fff700 1 -- 172.21.15.35:0/2463102689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 msgr2=0x7f9d34197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d33fff700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 0x7f9d34197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d33fff700 1 -- 172.21.15.35:0/2463102689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240095f0 con 0x7f9d34104390 2023-03-17T09:25:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d337fe700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 0x7f9d34197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:25:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d33fff700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 0x7f9d341a21d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c007ee0 tx=0x7f9d2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d30ff9700 1 -- 172.21.15.35:0/2463102689 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c017070 con 0x7f9d34104390 2023-03-17T09:25:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d30ff9700 1 -- 172.21.15.35:0/2463102689 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d2c00f040 con 0x7f9d34104390 2023-03-17T09:25:25.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d30ff9700 1 -- 172.21.15.35:0/2463102689 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c005570 con 0x7f9d34104390 2023-03-17T09:25:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3410f000 con 0x7f9d34104390 2023-03-17T09:25:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.326+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3410ee70 con 0x7f9d34104390 2023-03-17T09:25:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.329+0000 7f9d30ff9700 1 -- 172.21.15.35:0/2463102689 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9d2c00db20 con 0x7f9d34104390 2023-03-17T09:25:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.329+0000 7f9d30ff9700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d1c09f640 0x7f9d1c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.329+0000 7f9d30ff9700 1 -- 172.21.15.35:0/2463102689 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d2c0c9cf0 con 0x7f9d34104390 2023-03-17T09:25:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d337fe700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d1c09f640 0x7f9d1c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 Processor -- start 2023-03-17T09:25:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d337fe700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d1c09f640 0x7f9d1c0a1af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400b580 tx=0x7f9d24009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 -- start start 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fcbe0 0x5594875fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 0x5594875f7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594874fe010 con 0x5594875fd4f0 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487550950 con 0x5594875f7960 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487549de0 con 0x5594875fcbe0 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 0x5594875f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.330+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 0x5594875f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45010/0 (socket says 172.21.15.35:45010) 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 -- 172.21.15.35:0/1389785936 learned_addr learned my addr 172.21.15.35:0/1389785936 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d337fe700 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fcbe0 0x5594875fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d33fff700 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 -- 172.21.15.35:0/1389785936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fcbe0 msgr2=0x5594875fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fcbe0 0x5594875fcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 -- 172.21.15.35:0/1389785936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 msgr2=0x5594875f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 -- 172.21.15.35:0/1389785936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594873cb5d0 con 0x5594875fd4f0 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 0x5594875f7420 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800bcf0 tx=0x7f9d280103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877cd4238aa5d348 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d19ffb700 1 -- 172.21.15.35:0/1389785936 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28010d10 con 0x5594875fd4f0 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d19ffb700 1 -- 172.21.15.35:0/1389785936 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d28015070 con 0x5594875fd4f0 2023-03-17T09:25:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.331+0000 7f9d19ffb700 1 -- 172.21.15.35:0/1389785936 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28005020 con 0x5594875fd4f0 2023-03-17T09:25:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 -- 172.21.15.35:0/1389785936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 msgr2=0x5594875f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 0x5594875f7420 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800bcf0 tx=0x7f9d280103d0 comp rx=0 tx=0).stop 2023-03-17T09:25:28.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 -- 172.21.15.35:0/1389785936 shutdown_connections 2023-03-17T09:25:28.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:28.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fcbe0 0x5594875fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:28.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/1389785936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fd4f0 0x5594875f7420 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 -- 172.21.15.35:0/1389785936 >> 172.21.15.35:0/1389785936 conn(0x5594874546b0 msgr2=0x5594875f1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 -- 172.21.15.35:0/1389785936 shutdown_connections 2023-03-17T09:25:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 -- 172.21.15.35:0/1389785936 wait complete. 2023-03-17T09:25:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.332+0000 7f9d462e8b80 1 -- start start 2023-03-17T09:25:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 Processor -- start 2023-03-17T09:25:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x5594876033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x559487600640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487600be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594873cd8c0 con 0x5594875fcbe0 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487601350 con 0x5594875fd4f0 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487601510 con 0x5594875f7960 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d462e8b80 10 client.0 _ll_register_callbacks cb 0x5594873ef230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x559487600640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x559487600640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45016/0 (socket says 172.21.15.35:45016) 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x5594876033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d32ffd700 1 -- 172.21.15.35:0/3477476101 learned_addr learned my addr 172.21.15.35:0/3477476101 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.333+0000 7f9d33fff700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487600be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d32ffd700 1 -- 172.21.15.35:0/3477476101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 msgr2=0x5594876033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x5594876033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d32ffd700 1 -- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 msgr2=0x559487600be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487600be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d32ffd700 1 -- 172.21.15.35:0/3477476101 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2800b920 con 0x5594875fcbe0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d337fe700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x5594876033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d33fff700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487600be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x559487600640 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000c00 tx=0x7f9d28010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3844ec538aca0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d12ffd700 1 -- 172.21.15.35:0/3477476101 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28004450 con 0x5594875fcbe0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d12ffd700 1 -- 172.21.15.35:0/3477476101 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d28017070 con 0x5594875fcbe0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55948750c390 con 0x5594875fcbe0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d12ffd700 1 -- 172.21.15.35:0/3477476101 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d280045b0 con 0x5594875fcbe0 2023-03-17T09:25:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d462e8b80 10 client.16539 fetch_fsmap learned FSMap version 31 2023-03-17T09:25:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.334+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x559487377d80 con 0x5594875fcbe0 2023-03-17T09:25:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d12ffd700 1 -- 172.21.15.35:0/3477476101 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55948750c390 con 0x5594875fcbe0 2023-03-17T09:25:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d12ffd700 1 -- 172.21.15.35:0/3477476101 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9d28025710 con 0x5594875fcbe0 2023-03-17T09:25:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d462e8b80 10 client.16539 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:25:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d462e8b80 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:25:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d462e8b80 20 client.16539 populate_metadata read hostname 'smithi035' 2023-03-17T09:25:31.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:20 smithi035 ceph-mon[92535]: pgmap v1020: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:25:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487611020 0x559487613430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d462e8b80 4 client.16539 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:25:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559487518600 con 0x559487611020 2023-03-17T09:25:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.335+0000 7f9d337fe700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487611020 0x559487613430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d12ffd700 10 client.16539 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d337fe700 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487611020 0x559487613430 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6aff8437b071ab server_cookie=ebcf29ceac4a8535 in_seq=0 out_seq=0 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d12ffd700 1 -- 172.21.15.35:0/3477476101 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559487518600 con 0x559487611020 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d12ffd700 10 client.16539 handle_command_reply: tid=0 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 client.16539 shutdown 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 msgr2=0x559487600640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x559487600640 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000c00 tx=0x7f9d28010e70 comp rx=0 tx=0).stop 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 shutdown_connections 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487611020 0x559487613430 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487600be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d12ffd700 0 client.16539 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x5594876033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/3477476101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x559487600640 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.336+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 >> 172.21.15.35:0/3477476101 conn(0x5594874546b0 msgr2=0x5594875f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.337+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 shutdown_connections 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.337+0000 7f9d462e8b80 1 -- 172.21.15.35:0/3477476101 wait complete. 2023-03-17T09:25:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.337+0000 7f9d462e8b80 20 client.16539 trim_cache size 0 max 16384 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 Processor -- start 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 -- start start 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594875f6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fd4f0 0x559487607f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594875ed0f0 con 0x5594875fcbe0 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594875f2000 con 0x5594875f7960 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594875f34a0 con 0x5594875fd4f0 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594875f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594875f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45022/0 (socket says 172.21.15.35:45022) 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 -- 172.21.15.35:0/928562597 learned_addr learned my addr 172.21.15.35:0/928562597 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d337fe700 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d33fff700 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fd4f0 0x559487607f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 -- 172.21.15.35:0/928562597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fd4f0 msgr2=0x559487607f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fd4f0 0x559487607f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 -- 172.21.15.35:0/928562597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 msgr2=0x5594875f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 -- 172.21.15.35:0/928562597 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559487510130 con 0x5594875fcbe0 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d337fe700 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.352+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594875f6410 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800b7e0 tx=0x7f9d280103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3c820d8a0c38c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d1a7fc700 1 -- 172.21.15.35:0/928562597 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28025640 con 0x5594875fcbe0 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d1a7fc700 1 -- 172.21.15.35:0/928562597 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d28015030 con 0x5594875fcbe0 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d1a7fc700 1 -- 172.21.15.35:0/928562597 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003b80 con 0x5594875fcbe0 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 -- 172.21.15.35:0/928562597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 msgr2=0x5594875f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594875f6410 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800b7e0 tx=0x7f9d280103d0 comp rx=0 tx=0).stop 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 -- 172.21.15.35:0/928562597 shutdown_connections 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875fd4f0 0x559487607f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875f7960 0x5594875f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/928562597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594875f6410 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 -- 172.21.15.35:0/928562597 >> 172.21.15.35:0/928562597 conn(0x5594874546b0 msgr2=0x559487617d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 -- 172.21.15.35:0/928562597 shutdown_connections 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.353+0000 7f9d462e8b80 1 -- 172.21.15.35:0/928562597 wait complete. 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 -- start start 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 Processor -- start 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x559487605470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594876059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487605ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487608540 con 0x5594875fcbe0 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487663e80 con 0x5594875fd4f0 2023-03-17T09:25:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559487663ff0 con 0x5594875f7960 2023-03-17T09:25:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d462e8b80 10 client.0 _ll_register_callbacks cb 0x5594873ef230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:25:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594876059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d32ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594876059b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45030/0 (socket says 172.21.15.35:45030) 2023-03-17T09:25:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.354+0000 7f9d32ffd700 1 -- 172.21.15.35:0/37851189 learned_addr learned my addr 172.21.15.35:0/37851189 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d337fe700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x559487605470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d33fff700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487605ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d32ffd700 1 -- 172.21.15.35:0/37851189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 msgr2=0x559487605470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x559487605470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d32ffd700 1 -- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 msgr2=0x559487605ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487605ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d32ffd700 1 -- 172.21.15.35:0/37851189 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559487377d80 con 0x5594875fcbe0 2023-03-17T09:25:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d32ffd700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594876059b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9d28025ac0 tx=0x7f9d28005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc25252064c031ab server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:25:34.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d12ffd700 1 -- 172.21.15.35:0/37851189 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003b30 con 0x5594875fcbe0 2023-03-17T09:25:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d12ffd700 1 -- 172.21.15.35:0/37851189 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d28000e40 con 0x5594875fcbe0 2023-03-17T09:25:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.355+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594875c71e0 con 0x5594875fcbe0 2023-03-17T09:25:37.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d12ffd700 1 -- 172.21.15.35:0/37851189 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d28025860 con 0x5594875fcbe0 2023-03-17T09:25:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 10 client.16545 fetch_fsmap learned FSMap version 31 2023-03-17T09:25:37.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55948739e1f0 con 0x5594875fcbe0 2023-03-17T09:25:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d12ffd700 1 -- 172.21.15.35:0/37851189 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594875c71e0 con 0x5594875fcbe0 2023-03-17T09:25:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d12ffd700 1 -- 172.21.15.35:0/37851189 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9d2802e9f0 con 0x5594875fcbe0 2023-03-17T09:25:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 10 client.16545 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:25:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:25:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 20 client.16545 populate_metadata read hostname 'smithi035' 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487665300 0x559487667710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 4 client.16545 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5594873cdf00 con 0x559487665300 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.356+0000 7f9d337fe700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487665300 0x559487667710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.357+0000 7f9d12ffd700 10 client.16545 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.357+0000 7f9d337fe700 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487665300 0x559487667710 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375ecbc383acad1b server_cookie=2b6ea4af2c41d76f in_seq=0 out_seq=0 2023-03-17T09:25:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d12ffd700 1 -- 172.21.15.35:0/37851189 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5594873cdf00 con 0x559487665300 2023-03-17T09:25:42.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d12ffd700 10 client.16545 handle_command_reply: tid=0 2023-03-17T09:25:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 client.16545 shutdown 2023-03-17T09:25:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 msgr2=0x5594876059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594876059b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9d28025ac0 tx=0x7f9d28005950 comp rx=0 tx=0).stop 2023-03-17T09:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 shutdown_connections 2023-03-17T09:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559487665300 0x559487667710 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594875fd4f0 0x559487605ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d12ffd700 0 client.16545 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594875f7960 0x559487605470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 --2- 172.21.15.35:0/37851189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5594875fcbe0 0x5594876059b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 >> 172.21.15.35:0/37851189 conn(0x5594874546b0 msgr2=0x5594875f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 shutdown_connections 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 1 -- 172.21.15.35:0/37851189 wait complete. 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d462e8b80 20 client.16545 trim_cache size 0 max 16384 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.361+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d1c09f640 msgr2=0x7f9d1c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d1c09f640 0x7f9d1c0a1af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400b580 tx=0x7f9d24009f10 comp rx=0 tx=0).stop 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 msgr2=0x7f9d341a21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 0x7f9d341a21d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c007ee0 tx=0x7f9d2c00d3b0 comp rx=0 tx=0).stop 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 shutdown_connections 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d1c09f640 0x7f9d1c0a1af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d34104390 0x7f9d341a21d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d340ff350 0x7f9d34197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 --2- 172.21.15.35:0/2463102689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d340ffcf0 0x7f9d34197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 >> 172.21.15.35:0/2463102689 conn(0x7f9d34076330 msgr2=0x7f9d340fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 shutdown_connections 2023-03-17T09:25:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:35.362+0000 7f9d3a15b700 1 -- 172.21.15.35:0/2463102689 wait complete. 2023-03-17T09:25:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 -- 172.21.15.35:0/4144602431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ff350 msgr2=0x7f64900ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 --2- 172.21.15.35:0/4144602431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ff350 0x7f64900ff720 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f64840099c0 tx=0x7f6484009cd0 comp rx=0 tx=0).stop 2023-03-17T09:25:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 -- 172.21.15.35:0/4144602431 shutdown_connections 2023-03-17T09:25:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 --2- 172.21.15.35:0/4144602431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490104390 0x7f649010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 --2- 172.21.15.35:0/4144602431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ff350 0x7f64900ff720 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 --2- 172.21.15.35:0/4144602431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64900ffcf0 0x7f6490103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 -- 172.21.15.35:0/4144602431 >> 172.21.15.35:0/4144602431 conn(0x7f6490076330 msgr2=0x7f6490076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:47.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 -- 172.21.15.35:0/4144602431 shutdown_connections 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.477+0000 7f6496e87700 1 -- 172.21.15.35:0/4144602431 wait complete. 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 Processor -- start 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 -- start start 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ff350 0x7f6490195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ffcf0 0x7f64901956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6490104390 0x7f6490199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019a150 con 0x7f64900ffcf0 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019a2c0 con 0x7f6490104390 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.478+0000 7f6496e87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019a480 con 0x7f64900ff350 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f648ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ffcf0 0x7f64901956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ff350 0x7f6490195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f648ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ffcf0 0x7f64901956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45044/0 (socket says 172.21.15.35:45044) 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f648ffff700 1 -- 172.21.15.35:0/480288341 learned_addr learned my addr 172.21.15.35:0/480288341 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6495424700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6490104390 0x7f6490199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 -- 172.21.15.35:0/480288341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6490104390 msgr2=0x7f6490199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6490104390 0x7f6490199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 -- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ffcf0 msgr2=0x7f64901956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ffcf0 0x7f64901956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 -- 172.21.15.35:0/480288341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840095f0 con 0x7f64900ff350 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6494c23700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ff350 0x7f6490195170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6484000c00 tx=0x7f648401a840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f648dffb700 1 -- 172.21.15.35:0/480288341 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648401f070 con 0x7f64900ff350 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649010f000 con 0x7f64900ff350 2023-03-17T09:25:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f648dffb700 1 -- 172.21.15.35:0/480288341 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f648401ac80 con 0x7f64900ff350 2023-03-17T09:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.479+0000 7f648dffb700 1 -- 172.21.15.35:0/480288341 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484004a70 con 0x7f64900ff350 2023-03-17T09:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.480+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649010ee70 con 0x7f64900ff350 2023-03-17T09:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.482+0000 7f648dffb700 1 -- 172.21.15.35:0/480288341 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6484004c10 con 0x7f64900ff350 2023-03-17T09:25:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.483+0000 7f648dffb700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f648009f640 0x7f64800a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.483+0000 7f648ffff700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f648009f640 0x7f64800a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.483+0000 7f648dffb700 1 -- 172.21.15.35:0/480288341 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f64840cd7d0 con 0x7f64900ff350 2023-03-17T09:25:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.483+0000 7f648ffff700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f648009f640 0x7f64800a1af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6490196780 tx=0x7f647c00b460 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 Processor -- start 2023-03-17T09:25:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 -- start start 2023-03-17T09:25:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c0960 0x556ee05c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee04c7010 con 0x556ee05c0960 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee0519950 con 0x556ee05c64f0 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f64a3014b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee0512de0 con 0x556ee05c5be0 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6495424700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c0960 0x556ee05c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6494c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f648ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6495424700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c0960 0x556ee05c0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45054/0 (socket says 172.21.15.35:45054) 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6495424700 1 -- 172.21.15.35:0/2712294438 learned_addr learned my addr 172.21.15.35:0/2712294438 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6494c23700 1 -- 172.21.15.35:0/2712294438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 msgr2=0x556ee05c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6494c23700 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6494c23700 1 -- 172.21.15.35:0/2712294438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c0960 msgr2=0x556ee05c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6494c23700 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c0960 0x556ee05c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f6494c23700 1 -- 172.21.15.35:0/2712294438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ee03945d0 con 0x556ee05c5be0 2023-03-17T09:25:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.484+0000 7f648ffff700 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:25:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f6494c23700 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05c5fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64840caf00 tx=0x7f6484005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e9da350043d2c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f647affd700 1 -- 172.21.15.35:0/2712294438 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648401adf0 con 0x556ee05c5be0 2023-03-17T09:25:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f647affd700 1 -- 172.21.15.35:0/2712294438 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f648409b2b0 con 0x556ee05c5be0 2023-03-17T09:25:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f647affd700 1 -- 172.21.15.35:0/2712294438 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648409aa00 con 0x556ee05c5be0 2023-03-17T09:25:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 -- 172.21.15.35:0/2712294438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 msgr2=0x556ee05c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05c5fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64840caf00 tx=0x7f6484005fb0 comp rx=0 tx=0).stop 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 -- 172.21.15.35:0/2712294438 shutdown_connections 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c0960 0x556ee05c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05c5fb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 --2- 172.21.15.35:0/2712294438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.485+0000 7f64a3014b80 1 -- 172.21.15.35:0/2712294438 >> 172.21.15.35:0/2712294438 conn(0x556ee041d6b0 msgr2=0x556ee05baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 -- 172.21.15.35:0/2712294438 shutdown_connections 2023-03-17T09:25:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 -- 172.21.15.35:0/2712294438 wait complete. 2023-03-17T09:25:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 -- start start 2023-03-17T09:25:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 Processor -- start 2023-03-17T09:25:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c5be0 0x556ee05c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee03968c0 con 0x556ee05c64f0 2023-03-17T09:25:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee05ca3f0 con 0x556ee05c5be0 2023-03-17T09:25:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee05d5cf0 con 0x556ee05c0960 2023-03-17T09:25:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.486+0000 7f64a3014b80 10 client.0 _ll_register_callbacks cb 0x556ee03b8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:25:57.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36822/0 (socket says 172.21.15.35:36822) 2023-03-17T09:25:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 -- 172.21.15.35:0/3844303958 learned_addr learned my addr 172.21.15.35:0/3844303958 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6495424700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f648ffff700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c5be0 0x556ee05c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 -- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c5be0 msgr2=0x556ee05c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c5be0 0x556ee05c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 -- 172.21.15.35:0/3844303958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 msgr2=0x556ee05c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 -- 172.21.15.35:0/3844303958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649010ee70 con 0x556ee05c0960 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f6494c23700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cc490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6484009fd0 tx=0x7f648409aa50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209aad03133f309c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f646ffff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f646ffff700 1 -- 172.21.15.35:0/3844303958 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648401adf0 con 0x556ee05c0960 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ee04d5390 con 0x556ee05c0960 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f646ffff700 1 -- 172.21.15.35:0/3844303958 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f64840a3410 con 0x556ee05c0960 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f646ffff700 1 -- 172.21.15.35:0/3844303958 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f648409b2b0 con 0x556ee05c0960 2023-03-17T09:25:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f64a3014b80 10 client.26209 fetch_fsmap learned FSMap version 31 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556ee0340d80 con 0x556ee05c0960 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.487+0000 7f646ffff700 1 -- 172.21.15.35:0/3844303958 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6484065080 con 0x556ee05c0960 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f646ffff700 1 -- 172.21.15.35:0/3844303958 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64840970a0 con 0x556ee05c0960 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f64a3014b80 10 client.26209 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f64a3014b80 10 client.26209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f64a3014b80 20 client.26209 populate_metadata read hostname 'smithi035' 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f64a3014b80 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee05d9990 0x556ee05dbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f64a3014b80 4 client.26209 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ee04e1600 con 0x556ee05d9990 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f648ffff700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee05d9990 0x556ee05dbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f646ffff700 10 client.26209 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.488+0000 7f648ffff700 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee05d9990 0x556ee05dbda0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb7e24223f18c0a server_cookie=82112785e0310e0c in_seq=0 out_seq=0 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f646ffff700 1 -- 172.21.15.35:0/3844303958 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556ee04e1600 con 0x556ee05d9990 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f646ffff700 10 client.26209 handle_command_reply: tid=0 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 client.26209 shutdown 2023-03-17T09:25:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 msgr2=0x556ee05cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cc490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6484009fd0 tx=0x7f648409aa50 comp rx=0 tx=0).stop 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 shutdown_connections 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee05d9990 0x556ee05dbda0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f646ffff700 0 client.26209 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cc490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 --2- 172.21.15.35:0/3844303958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c5be0 0x556ee05c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 >> 172.21.15.35:0/3844303958 conn(0x556ee041d6b0 msgr2=0x556ee05bf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 shutdown_connections 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 1 -- 172.21.15.35:0/3844303958 wait complete. 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.489+0000 7f64a3014b80 20 client.26209 trim_cache size 0 max 16384 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.504+0000 7f64a3014b80 1 Processor -- start 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.504+0000 7f64a3014b80 1 -- start start 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c0960 0x556ee05baac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:25:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f64a3014b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee05b75c0 con 0x556ee05c64f0 2023-03-17T09:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f64a3014b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee05bb6d0 con 0x556ee05c0960 2023-03-17T09:26:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f64a3014b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee05ca290 con 0x556ee05c5be0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05bfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45068/0 (socket says 172.21.15.35:45068) 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 -- 172.21.15.35:0/1145501108 learned_addr learned my addr 172.21.15.35:0/1145501108 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f648ffff700 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6494c23700 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c0960 0x556ee05baac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 -- 172.21.15.35:0/1145501108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 msgr2=0x556ee05d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 -- 172.21.15.35:0/1145501108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c0960 msgr2=0x556ee05baac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c0960 0x556ee05baac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 -- 172.21.15.35:0/1145501108 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ee04d9130 con 0x556ee05c64f0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f6495424700 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05bfa90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f64880040c0 tx=0x7f6488009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e72a75378c5801d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f647b7fe700 1 -- 172.21.15.35:0/1145501108 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800e040 con 0x556ee05c64f0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f647b7fe700 1 -- 172.21.15.35:0/1145501108 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f648800f040 con 0x556ee05c64f0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.505+0000 7f647b7fe700 1 -- 172.21.15.35:0/1145501108 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488016660 con 0x556ee05c64f0 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 -- 172.21.15.35:0/1145501108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 msgr2=0x556ee05bfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05bfa90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f64880040c0 tx=0x7f6488009920 comp rx=0 tx=0).stop 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 -- 172.21.15.35:0/1145501108 shutdown_connections 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c64f0 0x556ee05bfa90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c0960 0x556ee05baac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 --2- 172.21.15.35:0/1145501108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c5be0 0x556ee05d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 -- 172.21.15.35:0/1145501108 >> 172.21.15.35:0/1145501108 conn(0x556ee041d6b0 msgr2=0x556ee05d5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 -- 172.21.15.35:0/1145501108 shutdown_connections 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 -- 172.21.15.35:0/1145501108 wait complete. 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.506+0000 7f64a3014b80 1 -- start start 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 Processor -- start 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c5be0 0x556ee05cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee0631c10 con 0x556ee05c5be0 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee0631d50 con 0x556ee05c64f0 2023-03-17T09:26:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee0631ec0 con 0x556ee05c0960 2023-03-17T09:26:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f64a3014b80 10 client.0 _ll_register_callbacks cb 0x556ee03b8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:26:04.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f648ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c5be0 0x556ee05cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6494c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f648ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c5be0 0x556ee05cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45072/0 (socket says 172.21.15.35:45072) 2023-03-17T09:26:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:46870/0 (socket says 172.21.15.35:46870) 2023-03-17T09:26:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6494c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36836/0 (socket says 172.21.15.35:36836) 2023-03-17T09:26:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f648ffff700 1 -- 172.21.15.35:0/4262024167 learned_addr learned my addr 172.21.15.35:0/4262024167 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 -- 172.21.15.35:0/4262024167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 msgr2=0x556ee05cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 -- 172.21.15.35:0/4262024167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c5be0 msgr2=0x556ee05cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:08.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c5be0 0x556ee05cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.507+0000 7f6495424700 1 -- 172.21.15.35:0/4262024167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488003d20 con 0x556ee05c64f0 2023-03-17T09:26:08.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f6495424700 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05cfe50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6488003cc0 tx=0x7f6488007c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c0ad310c5478ee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f646ffff700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f646ffff700 1 -- 172.21.15.35:0/4262024167 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648800e040 con 0x556ee05c64f0 2023-03-17T09:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f646ffff700 1 -- 172.21.15.35:0/4262024167 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6488004cd0 con 0x556ee05c64f0 2023-03-17T09:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ee05901e0 con 0x556ee05c64f0 2023-03-17T09:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f646ffff700 1 -- 172.21.15.35:0/4262024167 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6488005050 con 0x556ee05c64f0 2023-03-17T09:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 10 client.26168 fetch_fsmap learned FSMap version 31 2023-03-17T09:26:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556ee03671f0 con 0x556ee05c64f0 2023-03-17T09:26:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f646ffff700 1 -- 172.21.15.35:0/4262024167 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556ee05901e0 con 0x556ee05c64f0 2023-03-17T09:26:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f646ffff700 1 -- 172.21.15.35:0/4262024167 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64880325f0 con 0x556ee05c64f0 2023-03-17T09:26:13.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 10 client.26168 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:26:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 10 client.26168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:26:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 20 client.26168 populate_metadata read hostname 'smithi035' 2023-03-17T09:26:15.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee0633590 0x556ee06359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 4 client.26168 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.508+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556ee0396f00 con 0x556ee0633590 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.509+0000 7f6494c23700 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee0633590 0x556ee06359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.509+0000 7f646ffff700 10 client.26168 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.509+0000 7f6494c23700 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee0633590 0x556ee06359a0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216a120eefe74943 server_cookie=c5110f20b1b0a3d in_seq=0 out_seq=0 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f646ffff700 1 -- 172.21.15.35:0/4262024167 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556ee0396f00 con 0x556ee0633590 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f646ffff700 10 client.26168 handle_command_reply: tid=0 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 client.26168 shutdown 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 msgr2=0x556ee05cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05cfe50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6488003cc0 tx=0x7f6488007c90 comp rx=0 tx=0).stop 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 shutdown_connections 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556ee0633590 0x556ee06359a0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ee05c64f0 0x556ee05cfe50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f646ffff700 0 client.26168 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ee05c0960 0x556ee05cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 --2- 172.21.15.35:0/4262024167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556ee05c5be0 0x556ee05cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 >> 172.21.15.35:0/4262024167 conn(0x556ee041d6b0 msgr2=0x556ee05d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 shutdown_connections 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 1 -- 172.21.15.35:0/4262024167 wait complete. 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.513+0000 7f64a3014b80 20 client.26168 trim_cache size 0 max 16384 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f648009f640 msgr2=0x7f64800a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f648009f640 0x7f64800a1af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6490196780 tx=0x7f647c00b460 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ff350 msgr2=0x7f6490195170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ff350 0x7f6490195170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6484000c00 tx=0x7f648401a840 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 shutdown_connections 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f648009f640 0x7f64800a1af0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6490104390 0x7f6490199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ff350 0x7f6490195170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 --2- 172.21.15.35:0/480288341 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64900ffcf0 0x7f64901956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 >> 172.21.15.35:0/480288341 conn(0x7f6490076330 msgr2=0x7f64900fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 shutdown_connections 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:06:48.514+0000 7f6496e87700 1 -- 172.21.15.35:0/480288341 wait complete. 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 -- 172.21.15.35:0/3828086298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 msgr2=0x7f14840ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3828086298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14840ff720 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1474009920 tx=0x7f1474009c30 comp rx=0 tx=0).stop 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 -- 172.21.15.35:0/3828086298 shutdown_connections 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3828086298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1484104390 0x7f148410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3828086298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14840ff720 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:15.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3828086298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14840ffcf0 0x7f1484103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 -- 172.21.15.35:0/3828086298 >> 172.21.15.35:0/3828086298 conn(0x7f1484076330 msgr2=0x7f1484076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 -- 172.21.15.35:0/3828086298 shutdown_connections 2023-03-17T09:26:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.638+0000 7f1488ab1700 1 -- 172.21.15.35:0/3828086298 wait complete. 2023-03-17T09:26:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 Processor -- start 2023-03-17T09:26:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 -- start start 2023-03-17T09:26:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14841970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14840ffcf0 0x7f1484197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1484104390 0x7f14841a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14841a26a0 con 0x7f14840ff350 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14841a27e0 con 0x7f14840ffcf0 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.639+0000 7f1488ab1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14841a2920 con 0x7f1484104390 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14841970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14841970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45084/0 (socket says 172.21.15.35:45084) 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 -- 172.21.15.35:0/3651577676 learned_addr learned my addr 172.21.15.35:0/3651577676 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f1481d9b700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14840ffcf0 0x7f1484197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f1482d9d700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1484104390 0x7f14841a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 -- 172.21.15.35:0/3651577676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1484104390 msgr2=0x7f14841a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1484104390 0x7f14841a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 -- 172.21.15.35:0/3651577676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14840ffcf0 msgr2=0x7f1484197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14840ffcf0 0x7f1484197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 -- 172.21.15.35:0/3651577676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780095f0 con 0x7f14840ff350 2023-03-17T09:26:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f1482d9d700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1484104390 0x7f14841a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:26:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f148259c700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14841970e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1474009230 tx=0x7f147400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f14737fe700 1 -- 172.21.15.35:0/3651577676 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147401c070 con 0x7f14840ff350 2023-03-17T09:26:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1474009520 con 0x7f14840ff350 2023-03-17T09:26:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148410f000 con 0x7f14840ff350 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f14737fe700 1 -- 172.21.15.35:0/3651577676 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f147400bb70 con 0x7f14840ff350 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.640+0000 7f14737fe700 1 -- 172.21.15.35:0/3651577676 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474004910 con 0x7f14840ff350 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.643+0000 7f14737fe700 1 -- 172.21.15.35:0/3651577676 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1474020070 con 0x7f14840ff350 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.643+0000 7f14737fe700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f146c09f640 0x7f146c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.644+0000 7f14737fe700 1 -- 172.21.15.35:0/3651577676 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f14740cb0b0 con 0x7f14840ff350 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.644+0000 7f1481d9b700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f146c09f640 0x7f146c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.644+0000 7f1494c3eb80 1 Processor -- start 2023-03-17T09:26:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.644+0000 7f1481d9b700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f146c09f640 0x7f146c0a1af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f148406a350 tx=0x7f1478009310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.644+0000 7f1494c3eb80 1 -- start start 2023-03-17T09:26:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 0x5636f2864fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:30.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f285f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f285f960 0x5636f285fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f2766010 con 0x5636f2864be0 2023-03-17T09:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f27b8950 con 0x5636f285f960 2023-03-17T09:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f27b1de0 con 0x5636f28654f0 2023-03-17T09:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 0x5636f2864fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 0x5636f2864fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45092/0 (socket says 172.21.15.35:45092) 2023-03-17T09:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 -- 172.21.15.35:0/173682266 learned_addr learned my addr 172.21.15.35:0/173682266 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1481d9b700 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f285f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f1482d9d700 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f285f960 0x5636f285fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 -- 172.21.15.35:0/173682266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 msgr2=0x5636f285f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f285f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 -- 172.21.15.35:0/173682266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f285f960 msgr2=0x5636f285fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f285f960 0x5636f285fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 -- 172.21.15.35:0/173682266 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636f26335d0 con 0x5636f2864be0 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.645+0000 7f148259c700 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 0x5636f2864fb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f14740950f0 tx=0x7f1474009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3c327bc33f2a21 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.646+0000 7f1470ff9700 1 -- 172.21.15.35:0/173682266 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474095300 con 0x5636f2864be0 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.646+0000 7f1470ff9700 1 -- 172.21.15.35:0/173682266 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1474095460 con 0x5636f2864be0 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.646+0000 7f1470ff9700 1 -- 172.21.15.35:0/173682266 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a0b20 con 0x5636f2864be0 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 -- 172.21.15.35:0/173682266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 msgr2=0x5636f2864fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 0x5636f2864fb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f14740950f0 tx=0x7f1474009c30 comp rx=0 tx=0).stop 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 -- 172.21.15.35:0/173682266 shutdown_connections 2023-03-17T09:26:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f285f960 0x5636f285fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f2864be0 0x5636f2864fb0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/173682266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f285f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 -- 172.21.15.35:0/173682266 >> 172.21.15.35:0/173682266 conn(0x5636f26bc6b0 msgr2=0x5636f2859a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 -- 172.21.15.35:0/173682266 shutdown_connections 2023-03-17T09:26:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.647+0000 7f1494c3eb80 1 -- 172.21.15.35:0/173682266 wait complete. 2023-03-17T09:26:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 -- start start 2023-03-17T09:26:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 Processor -- start 2023-03-17T09:26:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f28686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f2868d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f26358c0 con 0x5636f285f960 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f2869480 con 0x5636f28654f0 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f2874c60 con 0x5636f2864be0 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f1494c3eb80 10 client.0 _ll_register_callbacks cb 0x5636f2657230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45098/0 (socket says 172.21.15.35:45098) 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.648+0000 7f148259c700 1 -- 172.21.15.35:0/3779669072 learned_addr learned my addr 172.21.15.35:0/3779669072 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1481d9b700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f28686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1482d9d700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f2868d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f148259c700 1 -- 172.21.15.35:0/3779669072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 msgr2=0x5636f28686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f148259c700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f28686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f148259c700 1 -- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 msgr2=0x5636f2868d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f148259c700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f2868d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f148259c700 1 -- 172.21.15.35:0/3779669072 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148410f000 con 0x5636f285f960 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1482d9d700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f2868d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f148259c700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286b440 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f147409e010 tx=0x7f1474099130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb53e0e5f2587802 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1469ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1469ffb700 1 -- 172.21.15.35:0/3779669072 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740c2be0 con 0x5636f285f960 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1469ffb700 1 -- 172.21.15.35:0/3779669072 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f14740c2d40 con 0x5636f285f960 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636f2774390 con 0x5636f285f960 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1469ffb700 1 -- 172.21.15.35:0/3779669072 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14740a08c0 con 0x5636f285f960 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1494c3eb80 10 client.16575 fetch_fsmap learned FSMap version 31 2023-03-17T09:26:34.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5636f25dfd80 con 0x5636f285f960 2023-03-17T09:26:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.649+0000 7f1469ffb700 1 -- 172.21.15.35:0/3779669072 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5636f2774390 con 0x5636f285f960 2023-03-17T09:26:34.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1469ffb700 1 -- 172.21.15.35:0/3779669072 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14740949e0 con 0x5636f285f960 2023-03-17T09:26:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1494c3eb80 10 client.16575 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:26:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1494c3eb80 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:26:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1494c3eb80 20 client.16575 populate_metadata read hostname 'smithi035' 2023-03-17T09:26:37.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f2878950 0x5636f287ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1494c3eb80 4 client.16575 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636f2780600 con 0x5636f2878950 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.650+0000 7f1481d9b700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f2878950 0x5636f287ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1481d9b700 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f2878950 0x5636f287ad60 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b18997943a5991ba server_cookie=3ec244ca8d5c875b in_seq=0 out_seq=0 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1469ffb700 10 client.16575 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1469ffb700 1 -- 172.21.15.35:0/3779669072 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5636f2780600 con 0x5636f2878950 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1469ffb700 10 client.16575 handle_command_reply: tid=0 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 client.16575 shutdown 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 msgr2=0x5636f286b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286b440 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f147409e010 tx=0x7f1474099130 comp rx=0 tx=0).stop 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 shutdown_connections 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f2878950 0x5636f287ad60 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f2868d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286b440 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1469ffb700 0 client.16575 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/3779669072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f28686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.651+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 >> 172.21.15.35:0/3779669072 conn(0x5636f26bc6b0 msgr2=0x5636f285e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.652+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 shutdown_connections 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.652+0000 7f1494c3eb80 1 -- 172.21.15.35:0/3779669072 wait complete. 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.652+0000 7f1494c3eb80 20 client.16575 trim_cache size 0 max 16384 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 Processor -- start 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 -- start start 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f2859ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f286fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f285ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f285a6d0 con 0x5636f285f960 2023-03-17T09:26:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f2869ca0 con 0x5636f28654f0 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f28633c0 con 0x5636f2864be0 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f2859ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f2859ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45106/0 (socket says 172.21.15.35:45106) 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 -- 172.21.15.35:0/1443852631 learned_addr learned my addr 172.21.15.35:0/1443852631 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1481d9b700 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f286fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1482d9d700 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f285ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 -- 172.21.15.35:0/1443852631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 msgr2=0x5636f286fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f286fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 -- 172.21.15.35:0/1443852631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 msgr2=0x5636f285ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f285ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f148259c700 1 -- 172.21.15.35:0/1443852631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636f2778130 con 0x5636f285f960 2023-03-17T09:26:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.667+0000 7f1482d9d700 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f285ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:26:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f148259c700 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f2859ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1474005e90 tx=0x7f1474009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421c36568bf742ea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f14717fa700 1 -- 172.21.15.35:0/1443852631 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474094720 con 0x5636f285f960 2023-03-17T09:26:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f14717fa700 1 -- 172.21.15.35:0/1443852631 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14740949e0 con 0x5636f285f960 2023-03-17T09:26:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f14717fa700 1 -- 172.21.15.35:0/1443852631 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a0b20 con 0x5636f285f960 2023-03-17T09:26:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 -- 172.21.15.35:0/1443852631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 msgr2=0x5636f2859ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:40.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:22 smithi035 ceph-mon[92535]: pgmap v1021: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:26:40.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:24 smithi035 ceph-mon[92535]: pgmap v1022: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T09:26:40.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:26 smithi035 ceph-mon[92535]: pgmap v1023: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 914 B/s wr, 10 op/s 2023-03-17T09:26:40.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:28 smithi035 ceph-mon[92535]: pgmap v1024: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:26:40.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:30 smithi035 ceph-mon[92535]: pgmap v1025: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:32 smithi035 ceph-mon[92535]: pgmap v1026: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:34 smithi035 ceph-mon[92535]: pgmap v1027: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:36 smithi035 ceph-mon[92535]: pgmap v1028: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:38 smithi035 ceph-mon[92535]: pgmap v1029: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:40 smithi035 ceph-mon[92535]: pgmap v1030: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:42 smithi035 ceph-mon[92535]: pgmap v1031: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:44 smithi035 ceph-mon[92535]: pgmap v1032: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:26:40.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:46 smithi035 ceph-mon[92535]: pgmap v1033: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:26:40.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:48 smithi035 ceph-mon[92535]: pgmap v1034: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:26:40.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:50 smithi035 ceph-mon[92535]: pgmap v1035: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:26:41.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:52 smithi035 ceph-mon[92535]: pgmap v1036: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:26:41.112 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:54 smithi035 ceph-mon[92535]: pgmap v1037: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:26:42.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:56 smithi035 ceph-mon[92535]: pgmap v1038: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:26:42.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:18:58 smithi035 ceph-mon[92535]: pgmap v1039: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:26:42.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:00 smithi035 ceph-mon[92535]: pgmap v1040: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:26:42.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:02 smithi035 ceph-mon[92535]: pgmap v1041: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:26:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:26:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:26:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:26:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:26:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:26:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:26:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:26:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:26:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f2859ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1474005e90 tx=0x7f1474009260 comp rx=0 tx=0).stop 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 -- 172.21.15.35:0/1443852631 shutdown_connections 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f28654f0 0x5636f285ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f2859ac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/1443852631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f2864be0 0x5636f286fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.668+0000 7f1494c3eb80 1 -- 172.21.15.35:0/1443852631 >> 172.21.15.35:0/1443852631 conn(0x5636f26bc6b0 msgr2=0x5636f28637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 -- 172.21.15.35:0/1443852631 shutdown_connections 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 -- 172.21.15.35:0/1443852631 wait complete. 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 -- start start 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 Processor -- start 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f2864be0 0x5636f286f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f28cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f28d0100 con 0x5636f285f960 2023-03-17T09:26:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f28d0240 con 0x5636f2864be0 2023-03-17T09:26:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f28d0380 con 0x5636f28654f0 2023-03-17T09:26:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1494c3eb80 10 client.0 _ll_register_callbacks cb 0x5636f2657230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:26:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f148259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45112/0 (socket says 172.21.15.35:45112) 2023-03-17T09:26:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f148259c700 1 -- 172.21.15.35:0/4161159262 learned_addr learned my addr 172.21.15.35:0/4161159262 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.669+0000 7f1481d9b700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f2864be0 0x5636f286f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1482d9d700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f28cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f148259c700 1 -- 172.21.15.35:0/4161159262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 msgr2=0x5636f28cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f148259c700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f28cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f148259c700 1 -- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f2864be0 msgr2=0x5636f286f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f148259c700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f2864be0 0x5636f286f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f148259c700 1 -- 172.21.15.35:0/4161159262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636f25dfd80 con 0x5636f285f960 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f148259c700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286eff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1474094d40 tx=0x7f1474099130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ede8857ec1924d0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1469ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1469ffb700 1 -- 172.21.15.35:0/4161159262 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740a0ac0 con 0x5636f285f960 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1469ffb700 1 -- 172.21.15.35:0/4161159262 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f14740b3040 con 0x5636f285f960 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636f282f1e0 con 0x5636f285f960 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1469ffb700 1 -- 172.21.15.35:0/4161159262 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14740c82a0 con 0x5636f285f960 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1494c3eb80 10 client.16581 fetch_fsmap learned FSMap version 31 2023-03-17T09:26:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5636f26061f0 con 0x5636f285f960 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.670+0000 7f1469ffb700 1 -- 172.21.15.35:0/4161159262 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5636f282f1e0 con 0x5636f285f960 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1469ffb700 1 -- 172.21.15.35:0/4161159262 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 31) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1474082510 con 0x5636f285f960 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1494c3eb80 10 client.16581 fetch_fsmap finished waiting for FSMap version 31 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1494c3eb80 10 client.16581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1494c3eb80 20 client.16581 populate_metadata read hostname 'smithi035' 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f28d1570 0x5636f28d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1494c3eb80 4 client.16581 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5636f2635f00 con 0x5636f28d1570 2023-03-17T09:26:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.671+0000 7f1481d9b700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f28d1570 0x5636f28d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:26:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.672+0000 7f1469ffb700 10 client.16581 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:26:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:01.672+0000 7f1481d9b700 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f28d1570 0x5636f28d3950 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1332eb079afd1c03 server_cookie=962522fe67a6be9f in_seq=0 out_seq=0 2023-03-17T09:26:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.228+0000 7f1469ffb700 1 -- 172.21.15.35:0/4161159262 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5636f2635f00 con 0x5636f28d1570 2023-03-17T09:26:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.228+0000 7f1469ffb700 10 client.16581 handle_command_reply: tid=0 2023-03-17T09:26:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.228+0000 7f1494c3eb80 1 client.16581 shutdown 2023-03-17T09:26:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 msgr2=0x5636f286eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:52.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286eff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1474094d40 tx=0x7f1474099130 comp rx=0 tx=0).stop 2023-03-17T09:26:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 shutdown_connections 2023-03-17T09:26:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5636f28d1570 0x5636f28d3950 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636f28654f0 0x5636f28cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1469ffb700 0 client.16581 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:26:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5636f285f960 0x5636f286eff0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 --2- 172.21.15.35:0/4161159262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636f2864be0 0x5636f286f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 >> 172.21.15.35:0/4161159262 conn(0x5636f26bc6b0 msgr2=0x5636f285ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 shutdown_connections 2023-03-17T09:26:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 1 -- 172.21.15.35:0/4161159262 wait complete. 2023-03-17T09:26:56.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.229+0000 7f1494c3eb80 20 client.16581 trim_cache size 0 max 16384 2023-03-17T09:26:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f146c09f640 msgr2=0x7f146c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f146c09f640 0x7f146c0a1af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f148406a350 tx=0x7f1478009310 comp rx=0 tx=0).stop 2023-03-17T09:26:56.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 msgr2=0x7f14841970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14841970e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1474009230 tx=0x7f147400fa00 comp rx=0 tx=0).stop 2023-03-17T09:26:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 shutdown_connections 2023-03-17T09:26:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f146c09f640 0x7f146c0a1af0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1484104390 0x7f14841a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14840ff350 0x7f14841970e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 --2- 172.21.15.35:0/3651577676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14840ffcf0 0x7f1484197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 >> 172.21.15.35:0/3651577676 conn(0x7f1484076330 msgr2=0x7f14840fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 shutdown_connections 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:03.230+0000 7f1488ab1700 1 -- 172.21.15.35:0/3651577676 wait complete. 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 -- 172.21.15.35:0/2434796131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 msgr2=0x7f93a80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2434796131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a80ff720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f93a40099c0 tx=0x7f93a4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 -- 172.21.15.35:0/2434796131 shutdown_connections 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2434796131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a8104390 0x7f93a810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2434796131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a80ff720 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2434796131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a80ffcf0 0x7f93a8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 -- 172.21.15.35:0/2434796131 >> 172.21.15.35:0/2434796131 conn(0x7f93a8076330 msgr2=0x7f93a8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:26:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 -- 172.21.15.35:0/2434796131 shutdown_connections 2023-03-17T09:26:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.356+0000 7f93af6b8700 1 -- 172.21.15.35:0/2434796131 wait complete. 2023-03-17T09:26:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 Processor -- start 2023-03-17T09:26:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 -- start start 2023-03-17T09:26:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a81952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a80ffcf0 0x7f93a81957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:26:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a8104390 0x7f93a8199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a819a280 con 0x7f93a80ff350 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a819a3f0 con 0x7f93a80ffcf0 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93af6b8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a819a5b0 con 0x7f93a8104390 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93ad454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a81952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93ad454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a81952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45126/0 (socket says 172.21.15.35:45126) 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93ad454700 1 -- 172.21.15.35:0/2203146231 learned_addr learned my addr 172.21.15.35:0/2203146231 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93adc55700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a8104390 0x7f93a8199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.357+0000 7f93acc53700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a80ffcf0 0x7f93a81957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93ad454700 1 -- 172.21.15.35:0/2203146231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a8104390 msgr2=0x7f93a8199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93ad454700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a8104390 0x7f93a8199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93ad454700 1 -- 172.21.15.35:0/2203146231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a80ffcf0 msgr2=0x7f93a81957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93ad454700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a80ffcf0 0x7f93a81957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93ad454700 1 -- 172.21.15.35:0/2203146231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40095f0 con 0x7f93a80ff350 2023-03-17T09:27:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93acc53700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a80ffcf0 0x7f93a81957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:27:02.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93ad454700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a81952a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f93a400c010 tx=0x7f93a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f939e7fc700 1 -- 172.21.15.35:0/2203146231 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a401d070 con 0x7f93a80ff350 2023-03-17T09:27:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f939e7fc700 1 -- 172.21.15.35:0/2203146231 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f93a4004000 con 0x7f93a80ff350 2023-03-17T09:27:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a810f050 con 0x7f93a80ff350 2023-03-17T09:27:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f939e7fc700 1 -- 172.21.15.35:0/2203146231 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4022da0 con 0x7f93a80ff350 2023-03-17T09:27:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.358+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a810eec0 con 0x7f93a80ff350 2023-03-17T09:27:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.360+0000 7f939e7fc700 1 -- 172.21.15.35:0/2203146231 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f93a4022570 con 0x7f93a80ff350 2023-03-17T09:27:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f939e7fc700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f939409f6c0 0x7f93940a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 Processor -- start 2023-03-17T09:27:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93acc53700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f939409f6c0 0x7f93940a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:04.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 -- start start 2023-03-17T09:27:04.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f939e7fc700 1 -- 172.21.15.35:0/2203146231 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f93a40cb8f0 con 0x7f93a80ff350 2023-03-17T09:27:04.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:04.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 0x557dfe986420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:04.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe986d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe88d010 con 0x557dfe98c4f0 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe8df950 con 0x557dfe986960 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93bb845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe8d8de0 con 0x557dfe98bbe0 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93acc53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 0x557dfe986420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93acc53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 0x557dfe986420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45138/0 (socket says 172.21.15.35:45138) 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93adc55700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe986d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93acc53700 1 -- 172.21.15.35:0/3761534291 learned_addr learned my addr 172.21.15.35:0/3761534291 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.362+0000 7f93ad454700 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f939409f6c0 0x7f93940a1b70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f93a81968b0 tx=0x7f939800e630 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 -- 172.21.15.35:0/3761534291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 msgr2=0x557dfe98bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 -- 172.21.15.35:0/3761534291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 msgr2=0x557dfe986d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe986d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 -- 172.21.15.35:0/3761534291 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dfe75a5d0 con 0x557dfe98c4f0 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93ad454700 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93acc53700 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 0x557dfe986420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f939800ef00 tx=0x7f9398019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2be39fda2e810d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93937fe700 1 -- 172.21.15.35:0/3761534291 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398018030 con 0x557dfe98c4f0 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93937fe700 1 -- 172.21.15.35:0/3761534291 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9398004cc0 con 0x557dfe98c4f0 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.363+0000 7f93937fe700 1 -- 172.21.15.35:0/3761534291 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398005620 con 0x557dfe98c4f0 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 -- 172.21.15.35:0/3761534291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 msgr2=0x557dfe986420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 0x557dfe986420 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f939800ef00 tx=0x7f9398019000 comp rx=0 tx=0).stop 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 -- 172.21.15.35:0/3761534291 shutdown_connections 2023-03-17T09:27:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe986d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 --2- 172.21.15.35:0/3761534291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98c4f0 0x557dfe986420 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 -- 172.21.15.35:0/3761534291 >> 172.21.15.35:0/3761534291 conn(0x557dfe7e36b0 msgr2=0x557dfe980a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 -- 172.21.15.35:0/3761534291 shutdown_connections 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.364+0000 7f93bb845b80 1 -- 172.21.15.35:0/3761534291 wait complete. 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.365+0000 7f93bb845b80 1 -- start start 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.365+0000 7f93bb845b80 1 Processor -- start 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 0x557dfe9924b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe98fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe75c8c0 con 0x557dfe986960 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe9905b0 con 0x557dfe98c4f0 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe99bfc0 con 0x557dfe98bbe0 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93bb845b80 10 client.0 _ll_register_callbacks cb 0x557dfe77e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 0x557dfe9924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 0x557dfe9924b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45140/0 (socket says 172.21.15.35:45140) 2023-03-17T09:27:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 -- 172.21.15.35:0/1308856107 learned_addr learned my addr 172.21.15.35:0/1308856107 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93adc55700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe98fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93acc53700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 -- 172.21.15.35:0/1308856107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 msgr2=0x557dfe98f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 -- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 msgr2=0x557dfe98fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:07.043 INFO:tasks.workunit.client.0.smithi035.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-03-17T09:27:07.044 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:04 smithi035 ceph-mon[92535]: pgmap v1042: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:27:07.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:04 smithi035 ceph-mon[92535]: osdmap e141: 12 total, 12 up, 12 in 2023-03-17T09:27:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe98fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:07.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 -- 172.21.15.35:0/1308856107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939800ebb0 con 0x557dfe986960 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93acc53700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f93ad454700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 0x557dfe9924b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f93a40036c0 tx=0x7f93a4098f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17a3c7eda4d3cf3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.366+0000 7f9390ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f9390ff9700 1 -- 172.21.15.35:0/1308856107 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4004170 con 0x557dfe986960 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f9390ff9700 1 -- 172.21.15.35:0/1308856107 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f93a4099400 con 0x557dfe986960 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dfe89b390 con 0x557dfe986960 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f9390ff9700 1 -- 172.21.15.35:0/1308856107 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93a40a1560 con 0x557dfe986960 2023-03-17T09:27:07.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 10 client.16599 fetch_fsmap learned FSMap version 32 2023-03-17T09:27:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557dfe706d80 con 0x557dfe986960 2023-03-17T09:27:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f9390ff9700 1 -- 172.21.15.35:0/1308856107 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557dfe89b390 con 0x557dfe986960 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f9390ff9700 1 -- 172.21.15.35:0/1308856107 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f93a40951f0 con 0x557dfe986960 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 10 client.16599 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 20 client.16599 populate_metadata read hostname 'smithi035' 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9a2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 4 client.16599 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.367+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dfe8a7600 con 0x557dfe99fd10 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.368+0000 7f93acc53700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.368+0000 7f93acc53700 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9a2120 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88006f4889149b81 server_cookie=56424113d6756adc in_seq=0 out_seq=0 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.368+0000 7f9390ff9700 10 client.16599 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f9390ff9700 1 -- 172.21.15.35:0/1308856107 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557dfe8a7600 con 0x557dfe99fd10 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f9390ff9700 10 client.16599 handle_command_reply: tid=0 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 client.16599 shutdown 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 msgr2=0x557dfe9924b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 0x557dfe9924b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f93a40036c0 tx=0x7f93a4098f40 comp rx=0 tx=0).stop 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 shutdown_connections 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9a2120 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe98fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f9390ff9700 0 client.16599 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe986960 0x557dfe9924b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1308856107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98bbe0 0x557dfe98f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 >> 172.21.15.35:0/1308856107 conn(0x557dfe7e36b0 msgr2=0x557dfe985410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 shutdown_connections 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 1 -- 172.21.15.35:0/1308856107 wait complete. 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.369+0000 7f93bb845b80 20 client.16599 trim_cache size 0 max 16384 2023-03-17T09:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 Processor -- start 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 -- start start 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe997140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe992050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98c4f0 0x557dfe9896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe89b390 con 0x557dfe98bbe0 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe89c050 con 0x557dfe986960 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93bb845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe990740 con 0x557dfe98c4f0 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe992050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe992050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45150/0 (socket says 172.21.15.35:45150) 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 -- 172.21.15.35:0/2512246467 learned_addr learned my addr 172.21.15.35:0/2512246467 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93ad454700 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe997140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93adc55700 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98c4f0 0x557dfe9896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 -- 172.21.15.35:0/2512246467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98c4f0 msgr2=0x557dfe9896b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98c4f0 0x557dfe9896b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 -- 172.21.15.35:0/2512246467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 msgr2=0x557dfe997140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe997140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93acc53700 1 -- 172.21.15.35:0/2512246467 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dfe89f130 con 0x557dfe98bbe0 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.385+0000 7f93adc55700 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98c4f0 0x557dfe9896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93acc53700 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe992050 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f939800a500 tx=0x7f9398012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aefe23d8a2f2f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f9393fff700 1 -- 172.21.15.35:0/2512246467 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939802e5a0 con 0x557dfe98bbe0 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f9393fff700 1 -- 172.21.15.35:0/2512246467 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f939802ece0 con 0x557dfe98bbe0 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f9393fff700 1 -- 172.21.15.35:0/2512246467 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980046f0 con 0x557dfe98bbe0 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 -- 172.21.15.35:0/2512246467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 msgr2=0x557dfe992050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe992050 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f939800a500 tx=0x7f9398012f90 comp rx=0 tx=0).stop 2023-03-17T09:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 -- 172.21.15.35:0/2512246467 shutdown_connections 2023-03-17T09:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe98c4f0 0x557dfe9896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe986960 0x557dfe997140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 --2- 172.21.15.35:0/2512246467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe992050 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.386+0000 7f93bb845b80 1 -- 172.21.15.35:0/2512246467 >> 172.21.15.35:0/2512246467 conn(0x557dfe7e36b0 msgr2=0x557dfe985410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 -- 172.21.15.35:0/2512246467 shutdown_connections 2023-03-17T09:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 -- 172.21.15.35:0/2512246467 wait complete. 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 -- start start 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 Processor -- start 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe986960 0x557dfe9ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe9ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe9e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe9ea0e0 con 0x557dfe98bbe0 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe9ea250 con 0x557dfe98c4f0 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dfe9ea410 con 0x557dfe986960 2023-03-17T09:27:11.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.387+0000 7f93bb845b80 10 client.0 _ll_register_callbacks cb 0x557dfe77e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe9ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93ad454700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe986960 0x557dfe9ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe9ef5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45156/0 (socket says 172.21.15.35:45156) 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 -- 172.21.15.35:0/1186257940 learned_addr learned my addr 172.21.15.35:0/1186257940 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93adc55700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe9e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 -- 172.21.15.35:0/1186257940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe986960 msgr2=0x557dfe9ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe986960 0x557dfe9ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 -- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 msgr2=0x557dfe9e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe9e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 -- 172.21.15.35:0/1186257940 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dfe75a5d0 con 0x557dfe98bbe0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93ad454700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe986960 0x557dfe9ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93adc55700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe9e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93acc53700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe9ef5e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f939800efe0 tx=0x7f939800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3425b607df0d6f1a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f9390ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:27:11.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f9390ff9700 1 -- 172.21.15.35:0/1186257940 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398005510 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f9390ff9700 1 -- 172.21.15.35:0/1186257940 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f9398019070 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dfe9561e0 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f9390ff9700 1 -- 172.21.15.35:0/1186257940 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9398005670 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93bb845b80 10 client.16605 fetch_fsmap learned FSMap version 32 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.388+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557dfe72d1f0 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f9390ff9700 1 -- 172.21.15.35:0/1186257940 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557dfe9561e0 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f9390ff9700 1 -- 172.21.15.35:0/1186257940 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9398023020 con 0x557dfe98bbe0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93bb845b80 10 client.16605 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93bb845b80 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93bb845b80 20 client.16605 populate_metadata read hostname 'smithi035' 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93bb845b80 4 client.16605 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557dfe75cf00 con 0x557dfe99fd10 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93ad454700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f9390ff9700 10 client.16605 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:13.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.389+0000 7f93ad454700 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9f8a90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed3d5850f80d36e server_cookie=29cb6baa2ce5cb4f in_seq=0 out_seq=0 2023-03-17T09:27:14.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f9390ff9700 1 -- 172.21.15.35:0/1186257940 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557dfe75cf00 con 0x557dfe99fd10 2023-03-17T09:27:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f9390ff9700 10 client.16605 handle_command_reply: tid=0 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 client.16605 shutdown 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 msgr2=0x557dfe9ef5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe9ef5e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f939800efe0 tx=0x7f939800eb40 comp rx=0 tx=0).stop 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 shutdown_connections 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557dfe99fd10 0x557dfe9f8a90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557dfe98c4f0 0x557dfe9e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557dfe986960 0x557dfe9ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 --2- 172.21.15.35:0/1186257940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557dfe98bbe0 0x557dfe9ef5e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f9390ff9700 0 client.16605 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 >> 172.21.15.35:0/1186257940 conn(0x557dfe7e36b0 msgr2=0x557dfe9896b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 shutdown_connections 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 1 -- 172.21.15.35:0/1186257940 wait complete. 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.397+0000 7f93bb845b80 20 client.16605 trim_cache size 0 max 16384 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f939409f6c0 msgr2=0x7f93940a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f939409f6c0 0x7f93940a1b70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f93a81968b0 tx=0x7f939800e630 comp rx=0 tx=0).stop 2023-03-17T09:27:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 msgr2=0x7f93a81952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a81952a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f93a400c010 tx=0x7f93a4004730 comp rx=0 tx=0).stop 2023-03-17T09:27:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 shutdown_connections 2023-03-17T09:27:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f939409f6c0 0x7f93940a1b70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:17.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a8104390 0x7f93a8199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f93a80ff350 0x7f93a81952a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 --2- 172.21.15.35:0/2203146231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a80ffcf0 0x7f93a81957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 >> 172.21.15.35:0/2203146231 conn(0x7f93a8076330 msgr2=0x7f93a80fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 shutdown_connections 2023-03-17T09:27:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:16.398+0000 7f93af6b8700 1 -- 172.21.15.35:0/2203146231 wait complete. 2023-03-17T09:27:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 -- 172.21.15.35:0/2414108988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d41043f0 msgr2=0x7f14d410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 --2- 172.21.15.35:0/2414108988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d41043f0 0x7f14d410bfc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b0d0 tx=0x7f14cc00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:27:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 -- 172.21.15.35:0/2414108988 shutdown_connections 2023-03-17T09:27:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 --2- 172.21.15.35:0/2414108988 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d41043f0 0x7f14d410bfc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:19.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 --2- 172.21.15.35:0/2414108988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14d40ff3b0 0x7f14d40ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 --2- 172.21.15.35:0/2414108988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ffd50 0x7f14d4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 -- 172.21.15.35:0/2414108988 >> 172.21.15.35:0/2414108988 conn(0x7f14d4075f60 msgr2=0x7f14d4076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 -- 172.21.15.35:0/2414108988 shutdown_connections 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 -- 172.21.15.35:0/2414108988 wait complete. 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.520+0000 7f14db830700 1 Processor -- start 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 -- start start 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ff3b0 0x7f14d4197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 0x7f14d41976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14d41043f0 0x7f14d41a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41a2730 con 0x7f14d40ffd50 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41a2870 con 0x7f14d41043f0 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14db830700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d41a29b0 con 0x7f14d40ff3b0 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 0x7f14d41976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 0x7f14d41976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45170/0 (socket says 172.21.15.35:45170) 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 -- 172.21.15.35:0/3011691946 learned_addr learned my addr 172.21.15.35:0/3011691946 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d95cc700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ff3b0 0x7f14d4197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14d41043f0 0x7f14d41a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 -- 172.21.15.35:0/3011691946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ff3b0 msgr2=0x7f14d4197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ff3b0 0x7f14d4197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 -- 172.21.15.35:0/3011691946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14d41043f0 msgr2=0x7f14d41a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14d41043f0 0x7f14d41a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 -- 172.21.15.35:0/3011691946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009d00 con 0x7f14d40ffd50 2023-03-17T09:27:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d95cc700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ff3b0 0x7f14d4197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:27:20.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:06 smithi035 ceph-mon[92535]: pgmap v1044: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:27:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.521+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 0x7f14d41976b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d950 tx=0x7f14c400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.522+0000 7f14ca7fc700 1 -- 172.21.15.35:0/3011691946 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4009b40 con 0x7f14d40ffd50 2023-03-17T09:27:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.522+0000 7f14ca7fc700 1 -- 172.21.15.35:0/3011691946 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14c400de30 con 0x7f14d40ffd50 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.522+0000 7f14ca7fc700 1 -- 172.21.15.35:0/3011691946 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400f620 con 0x7f14d40ffd50 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.522+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d410f070 con 0x7f14d40ffd50 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.522+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d410eee0 con 0x7f14d40ffd50 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.524+0000 7f14ca7fc700 1 -- 172.21.15.35:0/3011691946 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f14c4010460 con 0x7f14d40ffd50 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.524+0000 7f14ca7fc700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f14c009f640 0x7f14c00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.525+0000 7f14d95cc700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f14c009f640 0x7f14c00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.525+0000 7f14ca7fc700 1 -- 172.21.15.35:0/3011691946 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f14c40ca1c0 con 0x7f14d40ffd50 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.525+0000 7f14d95cc700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f14c009f640 0x7f14c00a1af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f14d000bc10 tx=0x7f14d000b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 Processor -- start 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 -- start start 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9f1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd8f8010 con 0x5613dd9f1960 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd94a950 con 0x5613dd9f74f0 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd943de0 con 0x5613dd9f6be0 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45180/0 (socket says 172.21.15.35:45180) 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 -- 172.21.15.35:0/1196884547 learned_addr learned my addr 172.21.15.35:0/1196884547 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d95cc700 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 -- 172.21.15.35:0/1196884547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 msgr2=0x5613dd9f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 -- 172.21.15.35:0/1196884547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 msgr2=0x5613dd9f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.526+0000 7f14d9dcd700 1 -- 172.21.15.35:0/1196884547 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613dd7c55d0 con 0x5613dd9f1960 2023-03-17T09:27:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.527+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1d90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009c30 tx=0x7f14cc009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8490a7d857f012e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.527+0000 7f14bf7fe700 1 -- 172.21.15.35:0/1196884547 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00e050 con 0x5613dd9f1960 2023-03-17T09:27:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.527+0000 7f14bf7fe700 1 -- 172.21.15.35:0/1196884547 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14cc0092d0 con 0x5613dd9f1960 2023-03-17T09:27:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.527+0000 7f14bf7fe700 1 -- 172.21.15.35:0/1196884547 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0052a0 con 0x5613dd9f1960 2023-03-17T09:27:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1196884547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 msgr2=0x5613dd9f1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:26.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1d90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009c30 tx=0x7f14cc009c60 comp rx=0 tx=0).stop 2023-03-17T09:27:26.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1196884547 shutdown_connections 2023-03-17T09:27:26.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1d90 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:26.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:26.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1196884547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:26.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1196884547 >> 172.21.15.35:0/1196884547 conn(0x5613dd84e6b0 msgr2=0x5613dd9eba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:26.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1196884547 shutdown_connections 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1196884547 wait complete. 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 -- start start 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.528+0000 7f14e79bdb80 1 Processor -- start 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 0x5613dd9fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9fab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd7c78c0 con 0x5613dd9f6be0 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd9fb250 con 0x5613dd9f74f0 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd9fb410 con 0x5613dd9f1960 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14e79bdb80 10 client.0 _ll_register_callbacks cb 0x5613dd7e9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d8dcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 0x5613dd9fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d8dcb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 0x5613dd9fa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45184/0 (socket says 172.21.15.35:45184) 2023-03-17T09:27:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d8dcb700 1 -- 172.21.15.35:0/499417636 learned_addr learned my addr 172.21.15.35:0/499417636 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d95cc700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 -- 172.21.15.35:0/499417636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 msgr2=0x5613dd9fd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 -- 172.21.15.35:0/499417636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 msgr2=0x5613dd9fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 0x5613dd9fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 -- 172.21.15.35:0/499417636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d410c800 con 0x5613dd9f74f0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d95cc700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 0x5613dd9fa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9fab10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009c00 tx=0x7f14cc009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b6c0d759835e2f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.529+0000 7f14bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14bcff9700 1 -- 172.21.15.35:0/499417636 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc004e60 con 0x5613dd9f74f0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14bcff9700 1 -- 172.21.15.35:0/499417636 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f14cc026450 con 0x5613dd9f74f0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613dd906390 con 0x5613dd9f74f0 2023-03-17T09:27:28.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14bcff9700 1 -- 172.21.15.35:0/499417636 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14cc007580 con 0x5613dd9f74f0 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 10 client.26219 fetch_fsmap learned FSMap version 32 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5613dd771d80 con 0x5613dd9f74f0 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14bcff9700 1 -- 172.21.15.35:0/499417636 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5613dd906390 con 0x5613dd9f74f0 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14bcff9700 1 -- 172.21.15.35:0/499417636 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14cc00b100 con 0x5613dd9f74f0 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 10 client.26219 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 10 client.26219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 20 client.26219 populate_metadata read hostname 'smithi035' 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda0aae0 0x5613dda0cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 4 client.26219 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:27:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.530+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613dd912600 con 0x5613dda0aae0 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.531+0000 7f14d95cc700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda0aae0 0x5613dda0cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.531+0000 7f14d95cc700 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda0aae0 0x5613dda0cec0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4360007f9a02af10 server_cookie=9096b1f2e8a12919 in_seq=0 out_seq=0 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.531+0000 7f14bcff9700 10 client.26219 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14bcff9700 1 -- 172.21.15.35:0/499417636 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5613dd912600 con 0x5613dda0aae0 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14bcff9700 10 client.26219 handle_command_reply: tid=0 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 client.26219 shutdown 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 msgr2=0x5613dd9fab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9fab10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009c00 tx=0x7f14cc009360 comp rx=0 tx=0).stop 2023-03-17T09:27:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 shutdown_connections 2023-03-17T09:27:31.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda0aae0 0x5613dda0cec0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:31.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dd9fab10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:31.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14bcff9700 0 client.26219 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:31.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/499417636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f6be0 0x5613dd9fa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 >> 172.21.15.35:0/499417636 conn(0x5613dd84e6b0 msgr2=0x5613dd9eba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 shutdown_connections 2023-03-17T09:27:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 1 -- 172.21.15.35:0/499417636 wait complete. 2023-03-17T09:27:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.532+0000 7f14e79bdb80 20 client.26219 trim_cache size 0 max 16384 2023-03-17T09:27:33.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 Processor -- start 2023-03-17T09:27:33.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 -- start start 2023-03-17T09:27:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9ebac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dda01ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd9ec000 con 0x5613dd9f1960 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd9e70d0 con 0x5613dd9f74f0 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dd9e8b60 con 0x5613dd9f6be0 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14d95cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14d95cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45190/0 (socket says 172.21.15.35:45190) 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.547+0000 7f14d95cc700 1 -- 172.21.15.35:0/485395502 learned_addr learned my addr 172.21.15.35:0/485395502 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9ebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dda01ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d95cc700 1 -- 172.21.15.35:0/485395502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 msgr2=0x5613dd9ebac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d95cc700 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9ebac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d95cc700 1 -- 172.21.15.35:0/485395502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 msgr2=0x5613dda01ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d95cc700 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dda01ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d95cc700 1 -- 172.21.15.35:0/485395502 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613dd90a130 con 0x5613dd9f1960 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14d95cc700 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1420 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5613dda0d770 tx=0x7f14d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd99d50e86b5e6a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14bffff700 1 -- 172.21.15.35:0/485395502 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0024040 con 0x5613dd9f1960 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14bffff700 1 -- 172.21.15.35:0/485395502 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14d0011cb0 con 0x5613dd9f1960 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.548+0000 7f14bffff700 1 -- 172.21.15.35:0/485395502 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d001f8f0 con 0x5613dd9f1960 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 -- 172.21.15.35:0/485395502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 msgr2=0x5613dd9f1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1420 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5613dda0d770 tx=0x7f14d0012000 comp rx=0 tx=0).stop 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 -- 172.21.15.35:0/485395502 shutdown_connections 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f74f0 0x5613dda01ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f1960 0x5613dd9f1420 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/485395502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f6be0 0x5613dd9ebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 -- 172.21.15.35:0/485395502 >> 172.21.15.35:0/485395502 conn(0x5613dd84e6b0 msgr2=0x5613dd9f78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 -- 172.21.15.35:0/485395502 shutdown_connections 2023-03-17T09:27:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 -- 172.21.15.35:0/485395502 wait complete. 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 -- start start 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.549+0000 7f14e79bdb80 1 Processor -- start 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f6be0 0x5613dd9fe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 0x5613dda61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dda62260 con 0x5613dd9f74f0 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dda623a0 con 0x5613dd9f6be0 2023-03-17T09:27:36.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613dda62530 con 0x5613dd9f1960 2023-03-17T09:27:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14e79bdb80 10 client.0 _ll_register_callbacks cb 0x5613dd7e9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:27:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d9dcd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 0x5613dda61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d9dcd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 0x5613dda61d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45198/0 (socket says 172.21.15.35:45198) 2023-03-17T09:27:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d9dcd700 1 -- 172.21.15.35:0/1938540548 learned_addr learned my addr 172.21.15.35:0/1938540548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d95cc700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f6be0 0x5613dd9fe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d95cc700 1 -- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f6be0 msgr2=0x5613dd9fe5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d95cc700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f6be0 0x5613dd9fe5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d95cc700 1 -- 172.21.15.35:0/1938540548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 msgr2=0x5613dda61d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d95cc700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 0x5613dda61d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d95cc700 1 -- 172.21.15.35:0/1938540548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d000f9e0 con 0x5613dd9f1960 2023-03-17T09:27:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.550+0000 7f14d9dcd700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 0x5613dda61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:27:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14d95cc700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fe0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14d0014040 tx=0x7f14d0011f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a25878fc33a4949 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:27:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14bcff9700 1 -- 172.21.15.35:0/1938540548 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0024070 con 0x5613dd9f1960 2023-03-17T09:27:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14bcff9700 1 -- 172.21.15.35:0/1938540548 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f14d0011a20 con 0x5613dd9f1960 2023-03-17T09:27:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613dd9c11e0 con 0x5613dd9f1960 2023-03-17T09:27:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14bcff9700 1 -- 172.21.15.35:0/1938540548 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14d002a4d0 con 0x5613dd9f1960 2023-03-17T09:27:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 10 client.26266 fetch_fsmap learned FSMap version 32 2023-03-17T09:27:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5613dd7981f0 con 0x5613dd9f1960 2023-03-17T09:27:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14bcff9700 1 -- 172.21.15.35:0/1938540548 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5613dd9c11e0 con 0x5613dd9f1960 2023-03-17T09:27:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14bcff9700 1 -- 172.21.15.35:0/1938540548 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14d0004be0 con 0x5613dd9f1960 2023-03-17T09:27:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 10 client.26266 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:27:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 10 client.26266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:27:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 20 client.26266 populate_metadata read hostname 'smithi035' 2023-03-17T09:27:39.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:08 smithi035 ceph-mon[92535]: pgmap v1045: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:27:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda63b60 0x5613dda65f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 4 client.26266 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:27:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.551+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5613dd7c7f00 con 0x5613dda63b60 2023-03-17T09:27:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.552+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda63b60 0x5613dda65f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.552+0000 7f14bcff9700 10 client.26266 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.552+0000 7f14d8dcb700 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda63b60 0x5613dda65f70 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330d5271130a5f54 server_cookie=23c4781d6042375e in_seq=0 out_seq=0 2023-03-17T09:27:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14bcff9700 1 -- 172.21.15.35:0/1938540548 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5613dd7c7f00 con 0x5613dda63b60 2023-03-17T09:27:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14bcff9700 10 client.26266 handle_command_reply: tid=0 2023-03-17T09:27:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 client.26266 shutdown 2023-03-17T09:27:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 msgr2=0x5613dd9fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fe0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14d0014040 tx=0x7f14d0011f80 comp rx=0 tx=0).stop 2023-03-17T09:27:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 shutdown_connections 2023-03-17T09:27:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5613dda63b60 0x5613dda65f70 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613dd9f74f0 0x5613dda61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613dd9f1960 0x5613dd9fe0b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 --2- 172.21.15.35:0/1938540548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613dd9f6be0 0x5613dd9fe5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14bcff9700 0 client.26266 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.556+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 >> 172.21.15.35:0/1938540548 conn(0x5613dd84e6b0 msgr2=0x5613dd9f56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 shutdown_connections 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14e79bdb80 1 -- 172.21.15.35:0/1938540548 wait complete. 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14e79bdb80 20 client.26266 trim_cache size 0 max 16384 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f14c009f640 msgr2=0x7f14c00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f14c009f640 0x7f14c00a1af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f14d000bc10 tx=0x7f14d000b5f0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 msgr2=0x7f14d41976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 0x7f14d41976b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d950 tx=0x7f14c400dd10 comp rx=0 tx=0).stop 2023-03-17T09:27:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 shutdown_connections 2023-03-17T09:27:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f14c009f640 0x7f14c00a1af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14d41043f0 0x7f14d41a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d40ff3b0 0x7f14d4197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 --2- 172.21.15.35:0/3011691946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14d40ffd50 0x7f14d41976b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 >> 172.21.15.35:0/3011691946 conn(0x7f14d4075f60 msgr2=0x7f14d40fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 shutdown_connections 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:29.557+0000 7f14db830700 1 -- 172.21.15.35:0/3011691946 wait complete. 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 -- 172.21.15.35:0/656594335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f410a750 msgr2=0x7f43f410cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 --2- 172.21.15.35:0/656594335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f410a750 0x7f43f410cbc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00b0a0 tx=0x7f43ec00b3b0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 -- 172.21.15.35:0/656594335 shutdown_connections 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 --2- 172.21.15.35:0/656594335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f410a750 0x7f43f410cbc0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 --2- 172.21.15.35:0/656594335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f4101410 0x7f43f41017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 --2- 172.21.15.35:0/656594335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f4101d20 0x7f43f410a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 -- 172.21.15.35:0/656594335 >> 172.21.15.35:0/656594335 conn(0x7f43f4076330 msgr2=0x7f43f4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:27:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 -- 172.21.15.35:0/656594335 shutdown_connections 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.679+0000 7f43f9b73700 1 -- 172.21.15.35:0/656594335 wait complete. 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 Processor -- start 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 -- start start 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f4101410 0x7f43f4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 0x7f43f4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f410a750 0x7f43f419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f419d560 con 0x7f43f4101d20 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f419d6d0 con 0x7f43f410a750 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f9b73700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f419d890 con 0x7f43f4101410 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 0x7f43f4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 0x7f43f4198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45212/0 (socket says 172.21.15.35:45212) 2023-03-17T09:27:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.680+0000 7f43f2ffd700 1 -- 172.21.15.35:0/4064962997 learned_addr learned my addr 172.21.15.35:0/4064962997 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f37fe700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f4101410 0x7f43f4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f3fff700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f410a750 0x7f43f419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f2ffd700 1 -- 172.21.15.35:0/4064962997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f4101410 msgr2=0x7f43f4198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f4101410 0x7f43f4198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f2ffd700 1 -- 172.21.15.35:0/4064962997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f410a750 msgr2=0x7f43f419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f410a750 0x7f43f419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f2ffd700 1 -- 172.21.15.35:0/4064962997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec009d00 con 0x7f43f4101d20 2023-03-17T09:27:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f3fff700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f410a750 0x7f43f419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:27:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 0x7f43f4198ac0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00e9a0 tx=0x7f43dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f0ff9700 1 -- 172.21.15.35:0/4064962997 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc009790 con 0x7f43f4101d20 2023-03-17T09:27:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f4110050 con 0x7f43f4101d20 2023-03-17T09:27:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f0ff9700 1 -- 172.21.15.35:0/4064962997 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43dc00cbd0 con 0x7f43f4101d20 2023-03-17T09:27:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f0ff9700 1 -- 172.21.15.35:0/4064962997 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc018680 con 0x7f43f4101d20 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.681+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f410fec0 con 0x7f43f4101d20 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.684+0000 7f43f0ff9700 1 -- 172.21.15.35:0/4064962997 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f43dc00cd40 con 0x7f43f4101d20 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.684+0000 7f43f0ff9700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f43e009f640 0x7f43e00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.684+0000 7f43f0ff9700 1 -- 172.21.15.35:0/4064962997 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f43dc014070 con 0x7f43f4101d20 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.684+0000 7f43f37fe700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f43e009f640 0x7f43e00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f43f37fe700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f43e009f640 0x7f43e00a1af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009c60 tx=0x7f43e4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 Processor -- start 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 -- start start 2023-03-17T09:27:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea83524be0 0x55ea83524fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8351f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8351fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:27:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83426010 con 0x55ea8351f960 2023-03-17T09:27:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83478950 con 0x55ea83524be0 2023-03-17T09:27:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f4405d00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83471de0 con 0x55ea835254f0 2023-03-17T09:27:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.685+0000 7f43f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8351fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8351fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45220/0 (socket says 172.21.15.35:45220) 2023-03-17T09:27:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 -- 172.21.15.35:0/3420009686 learned_addr learned my addr 172.21.15.35:0/3420009686 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:27:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f37fe700 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea83524be0 0x55ea83524fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8351f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:27:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 -- 172.21.15.35:0/3420009686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 msgr2=0x55ea8351f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8351f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 -- 172.21.15.35:0/3420009686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea83524be0 msgr2=0x55ea83524fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:27:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea83524be0 0x55ea83524fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:27:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 -- 172.21.15.35:0/3420009686 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea832f35d0 con 0x55ea8351f960 2023-03-17T09:27:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43f3fff700 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8351fd90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009cd0 tx=0x7f43ec0092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390f89bcf1fa4576 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:27:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43e9ffb700 1 -- 172.21.15.35:0/3420009686 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00e050 con 0x55ea8351f960 2023-03-17T09:27:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43e9ffb700 1 -- 172.21.15.35:0/3420009686 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43ec007d90 con 0x55ea8351f960 2023-03-17T09:27:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.686+0000 7f43e9ffb700 1 -- 172.21.15.35:0/3420009686 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec004dd0 con 0x55ea8351f960 2023-03-17T09:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 -- 172.21.15.35:0/3420009686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 msgr2=0x55ea8351fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8351fd90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009cd0 tx=0x7f43ec0092e0 comp rx=0 tx=0).stop 2023-03-17T09:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 -- 172.21.15.35:0/3420009686 shutdown_connections 2023-03-17T09:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8351fd90 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea83524be0 0x55ea83524fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3420009686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8351f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 -- 172.21.15.35:0/3420009686 >> 172.21.15.35:0/3420009686 conn(0x55ea8337c6b0 msgr2=0x55ea83519a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 -- 172.21.15.35:0/3420009686 shutdown_connections 2023-03-17T09:28:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 -- 172.21.15.35:0/3420009686 wait complete. 2023-03-17T09:28:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.687+0000 7f4405d00b80 1 -- start start 2023-03-17T09:28:02.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 Processor -- start 2023-03-17T09:28:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8352b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:04.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 0x55ea83528660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea835254f0 0x55ea83528c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea832f58c0 con 0x55ea8351f960 2023-03-17T09:28:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83529390 con 0x55ea835254f0 2023-03-17T09:28:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83534fa0 con 0x55ea83524be0 2023-03-17T09:28:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f4405d00b80 10 client.0 _ll_register_callbacks cb 0x55ea83317230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:28:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 0x55ea83528660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f43f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8352b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 0x55ea83528660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:36988/0 (socket says 172.21.15.35:36988) 2023-03-17T09:28:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f43f2ffd700 1 -- 172.21.15.35:0/2505109449 learned_addr learned my addr 172.21.15.35:0/2505109449 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.688+0000 7f43f3fff700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea835254f0 0x55ea83528c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f37fe700 1 -- 172.21.15.35:0/2505109449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 msgr2=0x55ea83528660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f37fe700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 0x55ea83528660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f37fe700 1 -- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea835254f0 msgr2=0x55ea83528c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f37fe700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea835254f0 0x55ea83528c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f37fe700 1 -- 172.21.15.35:0/2505109449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f410d880 con 0x55ea8351f960 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 0x55ea83528660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f3fff700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea835254f0 0x55ea83528c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43f37fe700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8352b3e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f43e4011ab0 tx=0x7f43e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4839a151de36a6bd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43d2ffd700 1 -- 172.21.15.35:0/2505109449 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4022070 con 0x55ea8351f960 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43d2ffd700 1 -- 172.21.15.35:0/2505109449 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f43e401d410 con 0x55ea8351f960 2023-03-17T09:28:09.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea83434390 con 0x55ea8351f960 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43d2ffd700 1 -- 172.21.15.35:0/2505109449 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43e4004580 con 0x55ea8351f960 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f4405d00b80 10 client.16635 fetch_fsmap learned FSMap version 32 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ea8329fd80 con 0x55ea8351f960 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.689+0000 7f43d2ffd700 1 -- 172.21.15.35:0/2505109449 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea83434390 con 0x55ea8351f960 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f43d2ffd700 1 -- 172.21.15.35:0/2505109449 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f43e4027650 con 0x55ea8351f960 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f4405d00b80 10 client.16635 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:28:09.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f4405d00b80 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:28:12.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f4405d00b80 20 client.16635 populate_metadata read hostname 'smithi035' 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f4405d00b80 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea83538fb0 0x55ea8353b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f4405d00b80 4 client.16635 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea83440600 con 0x55ea83538fb0 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea83538fb0 0x55ea8353b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f43d2ffd700 10 client.16635 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.690+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea83538fb0 0x55ea8353b3c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a41deae0bfe275a server_cookie=a46eb5842ee5ba03 in_seq=0 out_seq=0 2023-03-17T09:28:12.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f43d2ffd700 1 -- 172.21.15.35:0/2505109449 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ea83440600 con 0x55ea83538fb0 2023-03-17T09:28:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f43d2ffd700 10 client.16635 handle_command_reply: tid=0 2023-03-17T09:28:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 client.16635 shutdown 2023-03-17T09:28:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 msgr2=0x55ea8352b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8352b3e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f43e4011ab0 tx=0x7f43e40047c0 comp rx=0 tx=0).stop 2023-03-17T09:28:12.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 shutdown_connections 2023-03-17T09:28:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea83538fb0 0x55ea8353b3c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea835254f0 0x55ea83528c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea8351f960 0x55ea8352b3e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 --2- 172.21.15.35:0/2505109449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea83524be0 0x55ea83528660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f43d2ffd700 0 client.16635 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 >> 172.21.15.35:0/2505109449 conn(0x55ea8337c6b0 msgr2=0x55ea83519a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 shutdown_connections 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.691+0000 7f4405d00b80 1 -- 172.21.15.35:0/2505109449 wait complete. 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.692+0000 7f4405d00b80 20 client.16635 trim_cache size 0 max 16384 2023-03-17T09:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.706+0000 7f4405d00b80 1 Processor -- start 2023-03-17T09:28:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.706+0000 7f4405d00b80 1 -- start start 2023-03-17T09:28:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83519ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835260a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8352fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f4405d00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea8351a000 con 0x55ea83524be0 2023-03-17T09:28:14.375 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:10 smithi035 ceph-mon[92535]: pgmap v1046: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:28:15.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:28:15.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:10 smithi035 ceph-mon[92535]: osdmap e142: 12 total, 12 up, 12 in 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:12 smithi035 ceph-mon[92535]: pgmap v1048: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-03-17T09:28:16.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:14 smithi035 ceph-mon[92535]: pgmap v1049: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 514 B/s wr, 9 op/s 2023-03-17T09:28:16.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:16 smithi035 ceph-mon[92535]: pgmap v1050: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:28:16.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:16 smithi035 ceph-mon[92535]: daemon mds.e restarted 2023-03-17T09:28:16.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:16 smithi035 ceph-mon[92535]: osdmap e143: 12 total, 12 up, 12 in 2023-03-17T09:28:16.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:17 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.78:6834/649712286,v1:172.21.15.78:6835/649712286] up:boot 2023-03-17T09:28:17.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:17 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-03-17T09:28:17.721 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:28:17.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:17 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:28:17.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:18 smithi035 ceph-mon[92535]: pgmap v1052: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T09:28:17.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:20 smithi035 ceph-mon[92535]: pgmap v1053: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 563 B/s wr, 10 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:22 smithi035 ceph-mon[92535]: pgmap v1054: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:24 smithi035 ceph-mon[92535]: pgmap v1055: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:26 smithi035 ceph-mon[92535]: pgmap v1056: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:28 smithi035 ceph-mon[92535]: pgmap v1057: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:30 smithi035 ceph-mon[92535]: pgmap v1058: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:32 smithi035 ceph-mon[92535]: pgmap v1059: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:34 smithi035 ceph-mon[92535]: pgmap v1060: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T09:28:18.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:36 smithi035 ceph-mon[92535]: pgmap v1061: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:38 smithi035 ceph-mon[92535]: pgmap v1062: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:40 smithi035 ceph-mon[92535]: pgmap v1063: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:42 smithi035 ceph-mon[92535]: pgmap v1064: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:44 smithi035 ceph-mon[92535]: pgmap v1065: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:46 smithi035 ceph-mon[92535]: pgmap v1066: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:48 smithi035 ceph-mon[92535]: pgmap v1067: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:50 smithi035 ceph-mon[92535]: pgmap v1068: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:52 smithi035 ceph-mon[92535]: pgmap v1069: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:54 smithi035 ceph-mon[92535]: pgmap v1070: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:56 smithi035 ceph-mon[92535]: pgmap v1071: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:19:58 smithi035 ceph-mon[92535]: pgmap v1072: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:00 smithi035 ceph-mon[92535]: pgmap v1073: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:00 smithi035 ceph-mon[92535]: overall HEALTH_OK 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:02 smithi035 ceph-mon[92535]: pgmap v1074: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:04 smithi035 ceph-mon[92535]: pgmap v1075: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:06 smithi035 ceph-mon[92535]: pgmap v1076: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:28:18.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:08 smithi035 ceph-mon[92535]: pgmap v1077: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:28:18.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:09 smithi035 ceph-mon[92535]: osdmap e144: 12 total, 12 up, 12 in 2023-03-17T09:28:20.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:10 smithi035 ceph-mon[92535]: pgmap v1079: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:28:22.129 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:28:22.129 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:12 smithi035 ceph-mon[92535]: pgmap v1080: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:28:22.129 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:28:22.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:28:22.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:14 smithi035 ceph-mon[92535]: pgmap v1081: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:16 smithi035 ceph-mon[92535]: osdmap e145: 12 total, 12 up, 12 in 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:16 smithi035 ceph-mon[92535]: pgmap v1083: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:18 smithi035 ceph-mon[92535]: pgmap v1084: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:20 smithi035 ceph-mon[92535]: pgmap v1085: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:22 smithi035 ceph-mon[92535]: pgmap v1086: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:24 smithi035 ceph-mon[92535]: pgmap v1087: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:28:24.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:26 smithi035 ceph-mon[92535]: pgmap v1088: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:28:24.364 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:28 smithi035 ceph-mon[92535]: pgmap v1089: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:28:24.364 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:30 smithi035 ceph-mon[92535]: pgmap v1090: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:24.364 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:32 smithi035 ceph-mon[92535]: pgmap v1091: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:28:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:28:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:28:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:28:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f4405d00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea835165c0 con 0x55ea8351f960 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f4405d00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea8351ae10 con 0x55ea835254f0 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45230/0 (socket says 172.21.15.35:45230) 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 -- 172.21.15.35:0/1647104182 learned_addr learned my addr 172.21.15.35:0/1647104182 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f3fff700 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8352fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:26.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f37fe700 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83519ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 -- 172.21.15.35:0/1647104182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 msgr2=0x55ea8352fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8352fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 -- 172.21.15.35:0/1647104182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 msgr2=0x55ea83519ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83519ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 -- 172.21.15.35:0/1647104182 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea83438130 con 0x55ea83524be0 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f37fe700 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83519ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835260a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f43dc098120 tx=0x7f43dc012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f28613beb90f06 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43ea7fc700 1 -- 172.21.15.35:0/1647104182 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc098420 con 0x55ea83524be0 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43ea7fc700 1 -- 172.21.15.35:0/1647104182 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43dc0a0610 con 0x55ea83524be0 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.707+0000 7f43ea7fc700 1 -- 172.21.15.35:0/1647104182 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0a0180 con 0x55ea83524be0 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 -- 172.21.15.35:0/1647104182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 msgr2=0x55ea835260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835260a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f43dc098120 tx=0x7f43dc012040 comp rx=0 tx=0).stop 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 -- 172.21.15.35:0/1647104182 shutdown_connections 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea8352fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83519ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 --2- 172.21.15.35:0/1647104182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835260a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 -- 172.21.15.35:0/1647104182 >> 172.21.15.35:0/1647104182 conn(0x55ea8337c6b0 msgr2=0x55ea83525990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:26.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 -- 172.21.15.35:0/1647104182 shutdown_connections 2023-03-17T09:28:26.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.708+0000 7f4405d00b80 1 -- 172.21.15.35:0/1647104182 wait complete. 2023-03-17T09:28:26.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 -- start start 2023-03-17T09:28:26.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 Processor -- start 2023-03-17T09:28:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83521d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea83520be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83521120 con 0x55ea83524be0 2023-03-17T09:28:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83521290 con 0x55ea8351f960 2023-03-17T09:28:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea83521450 con 0x55ea835254f0 2023-03-17T09:28:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f4405d00b80 10 client.0 _ll_register_callbacks cb 0x55ea83317230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45236/0 (socket says 172.21.15.35:45236) 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f43f2ffd700 1 -- 172.21.15.35:0/3329506196 learned_addr learned my addr 172.21.15.35:0/3329506196 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f43f3fff700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea83520be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.709+0000 7f43f37fe700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83521d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43f2ffd700 1 -- 172.21.15.35:0/3329506196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 msgr2=0x55ea83520be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea83520be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43f2ffd700 1 -- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 msgr2=0x55ea83521d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:30.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83521d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43f2ffd700 1 -- 172.21.15.35:0/3329506196 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f410fec0 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43f2ffd700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835206a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f43dc094920 tx=0x7f43dc010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e116762b8efa2418 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43d2ffd700 1 -- 172.21.15.35:0/3329506196 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc097b10 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43d2ffd700 1 -- 172.21.15.35:0/3329506196 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f43dc0a0180 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea834ef1e0 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43d2ffd700 1 -- 172.21.15.35:0/3329506196 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43dc096620 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f4405d00b80 10 client.16641 fetch_fsmap learned FSMap version 32 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ea832c61f0 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.710+0000 7f43d2ffd700 1 -- 172.21.15.35:0/3329506196 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea834ef1e0 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f43d2ffd700 1 -- 172.21.15.35:0/3329506196 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f43dc097380 con 0x55ea83524be0 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f4405d00b80 10 client.16641 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f4405d00b80 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f4405d00b80 20 client.16641 populate_metadata read hostname 'smithi035' 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea8358de70 0x55ea83590280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:30.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f4405d00b80 4 client.16641 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea832f5f00 con 0x55ea8358de70 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f43f37fe700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea8358de70 0x55ea83590280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f43d2ffd700 10 client.16641 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.711+0000 7f43f37fe700 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea8358de70 0x55ea83590280 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a2c9da925951510 server_cookie=9a9f159a9a0cf9f4 in_seq=0 out_seq=0 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f43d2ffd700 1 -- 172.21.15.35:0/3329506196 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea832f5f00 con 0x55ea8358de70 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f43d2ffd700 10 client.16641 handle_command_reply: tid=0 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 client.16641 shutdown 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 msgr2=0x55ea835206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835206a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f43dc094920 tx=0x7f43dc010a70 comp rx=0 tx=0).stop 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 shutdown_connections 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ea8358de70 0x55ea83590280 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ea835254f0 0x55ea83520be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea8351f960 0x55ea83521d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 --2- 172.21.15.35:0/3329506196 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ea83524be0 0x55ea835206a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 >> 172.21.15.35:0/3329506196 conn(0x55ea8337c6b0 msgr2=0x55ea83523760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f43d2ffd700 0 client.16641 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 shutdown_connections 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 1 -- 172.21.15.35:0/3329506196 wait complete. 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.716+0000 7f4405d00b80 20 client.16641 trim_cache size 0 max 16384 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f43e009f640 msgr2=0x7f43e00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f43e009f640 0x7f43e00a1af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009c60 tx=0x7f43e4009260 comp rx=0 tx=0).stop 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 msgr2=0x7f43f4198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 0x7f43f4198ac0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00e9a0 tx=0x7f43dc00ecb0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 shutdown_connections 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f43e009f640 0x7f43e00a1af0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43f410a750 0x7f43f419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f4101410 0x7f43f4198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 --2- 172.21.15.35:0/4064962997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f43f4101d20 0x7f43f4198ac0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 >> 172.21.15.35:0/4064962997 conn(0x7f43f4076330 msgr2=0x7f43f40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 shutdown_connections 2023-03-17T09:28:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:42.717+0000 7f43f9b73700 1 -- 172.21.15.35:0/4064962997 wait complete. 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.841+0000 7f3704eeb700 1 -- 172.21.15.35:0/1744663261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3700100420 msgr2=0x7f3700103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.841+0000 7f3704eeb700 1 --2- 172.21.15.35:0/1744663261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3700100420 0x7f3700103ec0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f36f40099c0 tx=0x7f36f4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 -- 172.21.15.35:0/1744663261 shutdown_connections 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 --2- 172.21.15.35:0/1744663261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37001045a0 0x7f370010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 --2- 172.21.15.35:0/1744663261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37000ffa80 0x7f37000ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 --2- 172.21.15.35:0/1744663261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3700100420 0x7f3700103ec0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 -- 172.21.15.35:0/1744663261 >> 172.21.15.35:0/1744663261 conn(0x7f37000757a0 msgr2=0x7f3700075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 -- 172.21.15.35:0/1744663261 shutdown_connections 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.842+0000 7f3704eeb700 1 -- 172.21.15.35:0/1744663261 wait complete. 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 Processor -- start 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 -- start start 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37000ffa80 0x7f3700196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3700100420 0x7f3700196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 0x7f370019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370019b420 con 0x7f37001045a0 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370019b590 con 0x7f37000ffa80 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.843+0000 7f3704eeb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370019b750 con 0x7f3700100420 2023-03-17T09:28:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 0x7f370019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37000ffa80 0x7f3700196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 0x7f370019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45248/0 (socket says 172.21.15.35:45248) 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 -- 172.21.15.35:0/2540315062 learned_addr learned my addr 172.21.15.35:0/2540315062 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3700100420 0x7f3700196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 -- 172.21.15.35:0/2540315062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3700100420 msgr2=0x7f3700196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3700100420 0x7f3700196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 -- 172.21.15.35:0/2540315062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37000ffa80 msgr2=0x7f3700196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37000ffa80 0x7f3700196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 -- 172.21.15.35:0/2540315062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40095f0 con 0x7f37001045a0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fe59c700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37000ffa80 0x7f3700196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36fed9d700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 0x7f370019ade0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f36f8007ee0 tx=0x7f36f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36ef7fe700 1 -- 172.21.15.35:0/2540315062 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8017070 con 0x7f37001045a0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36ef7fe700 1 -- 172.21.15.35:0/2540315062 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36f800f040 con 0x7f37001045a0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370010f1d0 con 0x7f37001045a0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.844+0000 7f36ef7fe700 1 -- 172.21.15.35:0/2540315062 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8005570 con 0x7f37001045a0 2023-03-17T09:28:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.845+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370010f040 con 0x7f37001045a0 2023-03-17T09:28:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.847+0000 7f36ef7fe700 1 -- 172.21.15.35:0/2540315062 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f36f800db20 con 0x7f37001045a0 2023-03-17T09:28:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.848+0000 7f36ef7fe700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f36e809f640 0x7f36e80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.848+0000 7f36ef7fe700 1 -- 172.21.15.35:0/2540315062 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f36f80c9d50 con 0x7f37001045a0 2023-03-17T09:28:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.848+0000 7f36fe59c700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f36e809f640 0x7f36e80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 Processor -- start 2023-03-17T09:28:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f36fe59c700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f36e809f640 0x7f36e80a1af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009730 tx=0x7f36f0012040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 -- start start 2023-03-17T09:28:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2d9afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d95420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2d95d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2c9c010 con 0x55edd2d9b4f0 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2cee950 con 0x55edd2d95960 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f3711078b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2ce7de0 con 0x55edd2d9abe0 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f36fdd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d95420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f36fdd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d95420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45254/0 (socket says 172.21.15.35:45254) 2023-03-17T09:28:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.849+0000 7f36fdd9b700 1 -- 172.21.15.35:0/1080015058 learned_addr learned my addr 172.21.15.35:0/1080015058 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fed9d700 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2d95d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fe59c700 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2d9afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fdd9b700 1 -- 172.21.15.35:0/1080015058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 msgr2=0x55edd2d9afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2d9afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fdd9b700 1 -- 172.21.15.35:0/1080015058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 msgr2=0x55edd2d95d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2d95d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fdd9b700 1 -- 172.21.15.35:0/1080015058 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edd2b695d0 con 0x55edd2d9b4f0 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fed9d700 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2d95d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:28:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d95420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f37001007f0 tx=0x7f36f400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d04c1c77289cba5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36ecff9700 1 -- 172.21.15.35:0/1080015058 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400bbb0 con 0x55edd2d9b4f0 2023-03-17T09:28:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36ecff9700 1 -- 172.21.15.35:0/1080015058 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36f401e040 con 0x55edd2d9b4f0 2023-03-17T09:28:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.850+0000 7f36ecff9700 1 -- 172.21.15.35:0/1080015058 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f40039c0 con 0x55edd2d9b4f0 2023-03-17T09:28:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 -- 172.21.15.35:0/1080015058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 msgr2=0x55edd2d95420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d95420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f37001007f0 tx=0x7f36f400b790 comp rx=0 tx=0).stop 2023-03-17T09:28:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 -- 172.21.15.35:0/1080015058 shutdown_connections 2023-03-17T09:28:37.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2d95d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:37.462 INFO:tasks.workunit.client.0.smithi035.stderr:Note: switching to '4aa791bf129eece187e94ddbfa7c2b475588cf0c'. 2023-03-17T09:28:39.015 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.015 INFO:tasks.workunit.client.0.smithi035.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-03-17T09:28:39.015 INFO:tasks.workunit.client.0.smithi035.stderr:changes and commit them, and you can discard any commits you make in this 2023-03-17T09:28:39.015 INFO:tasks.workunit.client.0.smithi035.stderr:state without impacting any branches by switching back to a branch. 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr:If you want to create a new branch to retain commits you create, you may 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr:do so (now or later) by using -c with the switch command. Example: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: git switch -c 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr:Or undo this operation with: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: git switch - 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr: 2023-03-17T09:28:39.016 INFO:tasks.workunit.client.0.smithi035.stderr:HEAD is now at 4aa791bf129 Merge PR #49773 into wip-pdonnell-testing-20230316.214637 2023-03-17T09:28:39.017 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:34 smithi035 ceph-mon[92535]: pgmap v1092: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2d9afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 --2- 172.21.15.35:0/1080015058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d95420 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 -- 172.21.15.35:0/1080015058 >> 172.21.15.35:0/1080015058 conn(0x55edd2bf26b0 msgr2=0x55edd2d8fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 -- 172.21.15.35:0/1080015058 shutdown_connections 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 -- 172.21.15.35:0/1080015058 wait complete. 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.851+0000 7f3711078b80 1 -- start start 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 Processor -- start 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2d9e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2b6b8c0 con 0x55edd2d95960 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2d9f4a0 con 0x55edd2d9abe0 2023-03-17T09:28:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2daafa0 con 0x55edd2d9b4f0 2023-03-17T09:28:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f3711078b80 10 client.0 _ll_register_callbacks cb 0x55edd2b8d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:28:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45258/0 (socket says 172.21.15.35:45258) 2023-03-17T09:28:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 -- 172.21.15.35:0/257638291 learned_addr learned my addr 172.21.15.35:0/257638291 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fed9d700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2d9e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 -- 172.21.15.35:0/257638291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 msgr2=0x55edd2d9ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 -- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 msgr2=0x55edd2d9e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2d9e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 -- 172.21.15.35:0/257638291 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370010c9b0 con 0x55edd2d95960 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fed9d700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36fe59c700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da1430 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f36f0003a50 tx=0x7f36f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bff1961c1bbf1b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.852+0000 7f36e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f36e5ffb700 1 -- 172.21.15.35:0/257638291 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0004180 con 0x55edd2d95960 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edd2caa390 con 0x55edd2d95960 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f36e5ffb700 1 -- 172.21.15.35:0/257638291 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f36f001ac20 con 0x55edd2d95960 2023-03-17T09:28:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f36e5ffb700 1 -- 172.21.15.35:0/257638291 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f001ade0 con 0x55edd2d95960 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 10 client.16653 fetch_fsmap learned FSMap version 32 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55edd2b15d80 con 0x55edd2d95960 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f36e5ffb700 1 -- 172.21.15.35:0/257638291 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55edd2caa390 con 0x55edd2d95960 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f36e5ffb700 1 -- 172.21.15.35:0/257638291 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f36f001c3f0 con 0x55edd2d95960 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 10 client.16653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 20 client.16653 populate_metadata read hostname 'smithi035' 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2daf0a0 0x55edd2db14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 4 client.16653 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edd2cb6600 con 0x55edd2daf0a0 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.853+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2daf0a0 0x55edd2db14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.854+0000 7f36e5ffb700 10 client.16653 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.854+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2daf0a0 0x55edd2db14b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3392a3e172407be2 server_cookie=cc8281c866267fb9 in_seq=0 out_seq=0 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.854+0000 7f36e5ffb700 1 -- 172.21.15.35:0/257638291 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55edd2cb6600 con 0x55edd2daf0a0 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.854+0000 7f36e5ffb700 10 client.16653 handle_command_reply: tid=0 2023-03-17T09:28:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 client.16653 shutdown 2023-03-17T09:28:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 msgr2=0x55edd2da1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da1430 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f36f0003a50 tx=0x7f36f0004750 comp rx=0 tx=0).stop 2023-03-17T09:28:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 shutdown_connections 2023-03-17T09:28:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2daf0a0 0x55edd2db14b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f36e5ffb700 0 client.16653 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da1430 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 --2- 172.21.15.35:0/257638291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2d9e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 >> 172.21.15.35:0/257638291 conn(0x55edd2bf26b0 msgr2=0x55edd2d94410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 shutdown_connections 2023-03-17T09:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 1 -- 172.21.15.35:0/257638291 wait complete. 2023-03-17T09:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.855+0000 7f3711078b80 20 client.16653 trim_cache size 0 max 16384 2023-03-17T09:28:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 Processor -- start 2023-03-17T09:28:43.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 -- start start 2023-03-17T09:28:43.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2da5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:43.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2da0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2d8b0f0 con 0x55edd2d9b4f0 2023-03-17T09:28:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2d957d0 con 0x55edd2d95960 2023-03-17T09:28:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f3711078b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2d8cb60 con 0x55edd2d9abe0 2023-03-17T09:28:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f36fed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:45.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f36fed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45270/0 (socket says 172.21.15.35:45270) 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.871+0000 7f36fed9d700 1 -- 172.21.15.35:0/220774464 learned_addr learned my addr 172.21.15.35:0/220774464 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fe59c700 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2da5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2da0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fed9d700 1 -- 172.21.15.35:0/220774464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 msgr2=0x55edd2da0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fed9d700 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2da0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fed9d700 1 -- 172.21.15.35:0/220774464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 msgr2=0x55edd2da5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fed9d700 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2da5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:45.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fed9d700 1 -- 172.21.15.35:0/220774464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edd2cae130 con 0x55edd2d9b4f0 2023-03-17T09:28:45.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36fed9d700 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9df20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f36f80974d0 tx=0x7f36f80c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1224ff9a2da7d18 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36ed7fa700 1 -- 172.21.15.35:0/220774464 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8004c40 con 0x55edd2d9b4f0 2023-03-17T09:28:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36ed7fa700 1 -- 172.21.15.35:0/220774464 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36f800ddd0 con 0x55edd2d9b4f0 2023-03-17T09:28:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.872+0000 7f36ed7fa700 1 -- 172.21.15.35:0/220774464 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8097a30 con 0x55edd2d9b4f0 2023-03-17T09:28:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 -- 172.21.15.35:0/220774464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 msgr2=0x55edd2d9df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9df20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f36f80974d0 tx=0x7f36f80c9040 comp rx=0 tx=0).stop 2023-03-17T09:28:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 -- 172.21.15.35:0/220774464 shutdown_connections 2023-03-17T09:28:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d9b4f0 0x55edd2d9df20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d95960 0x55edd2da5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 --2- 172.21.15.35:0/220774464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9abe0 0x55edd2da0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 -- 172.21.15.35:0/220774464 >> 172.21.15.35:0/220774464 conn(0x55edd2bf26b0 msgr2=0x55edd2d94a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 -- 172.21.15.35:0/220774464 shutdown_connections 2023-03-17T09:28:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 -- 172.21.15.35:0/220774464 wait complete. 2023-03-17T09:28:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 -- start start 2023-03-17T09:28:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.873+0000 7f3711078b80 1 Processor -- start 2023-03-17T09:28:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2da3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:47.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2da4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:47.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2da4a50 con 0x55edd2d95960 2023-03-17T09:28:47.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2da4bc0 con 0x55edd2d9abe0 2023-03-17T09:28:47.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd2da4d80 con 0x55edd2d9b4f0 2023-03-17T09:28:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f3711078b80 10 client.0 _ll_register_callbacks cb 0x55edd2b8d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:28:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:49.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45272/0 (socket says 172.21.15.35:45272) 2023-03-17T09:28:49.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 -- 172.21.15.35:0/1008294755 learned_addr learned my addr 172.21.15.35:0/1008294755 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2da3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fed9d700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2da4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 -- 172.21.15.35:0/1008294755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 msgr2=0x55edd2da4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2da4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 -- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 msgr2=0x55edd2da3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2da3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.874+0000 7f36fe59c700 1 -- 172.21.15.35:0/1008294755 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370010f040 con 0x55edd2d95960 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36fe59c700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da5ce0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f36f0003a50 tx=0x7f36f001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ff8d74f9431d87 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36e5ffb700 1 -- 172.21.15.35:0/1008294755 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f001aef0 con 0x55edd2d95960 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36e5ffb700 1 -- 172.21.15.35:0/1008294755 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f36f00058e0 con 0x55edd2d95960 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edd2d651e0 con 0x55edd2d95960 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36e5ffb700 1 -- 172.21.15.35:0/1008294755 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f0004160 con 0x55edd2d95960 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 10 client.16659 fetch_fsmap learned FSMap version 32 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55edd2b3c1f0 con 0x55edd2d95960 2023-03-17T09:28:49.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36e5ffb700 1 -- 172.21.15.35:0/1008294755 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55edd2d651e0 con 0x55edd2d95960 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f36e5ffb700 1 -- 172.21.15.35:0/1008294755 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f36f0032440 con 0x55edd2d95960 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 10 client.16659 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 10 client.16659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 20 client.16659 populate_metadata read hostname 'smithi035' 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2e04390 0x55edd2e067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 4 client.16659 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.875+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55edd2b6bf00 con 0x55edd2e04390 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.876+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2e04390 0x55edd2e067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.876+0000 7f36e5ffb700 10 client.16659 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.876+0000 7f36fdd9b700 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2e04390 0x55edd2e067a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=341e07e6eeba3688 server_cookie=7e43f148c41de3dd in_seq=0 out_seq=0 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f36e5ffb700 1 -- 172.21.15.35:0/1008294755 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55edd2b6bf00 con 0x55edd2e04390 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f36e5ffb700 10 client.16659 handle_command_reply: tid=0 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 client.16659 shutdown 2023-03-17T09:28:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 msgr2=0x55edd2da5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da5ce0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f36f0003a50 tx=0x7f36f001acd0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 shutdown_connections 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55edd2e04390 0x55edd2e067a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edd2d9b4f0 0x55edd2da4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f36e5ffb700 0 client.16659 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55edd2d95960 0x55edd2da5ce0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.880+0000 7f3711078b80 1 --2- 172.21.15.35:0/1008294755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55edd2d9abe0 0x55edd2da3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 >> 172.21.15.35:0/1008294755 conn(0x55edd2bf26b0 msgr2=0x55edd2d986b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 shutdown_connections 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3711078b80 1 -- 172.21.15.35:0/1008294755 wait complete. 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3711078b80 20 client.16659 trim_cache size 0 max 16384 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f36e809f640 msgr2=0x7f36e80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3704eeb700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f36e809f640 0x7f36e80a1af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009730 tx=0x7f36f0012040 comp rx=0 tx=0).stop 2023-03-17T09:28:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 msgr2=0x7f370019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.881+0000 7f3704eeb700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 0x7f370019ade0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f36f8007ee0 tx=0x7f36f800d3b0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 shutdown_connections 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f36e809f640 0x7f36e80a1af0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37001045a0 0x7f370019ade0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37000ffa80 0x7f3700196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 --2- 172.21.15.35:0/2540315062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3700100420 0x7f3700196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 >> 172.21.15.35:0/2540315062 conn(0x7f37000757a0 msgr2=0x7f37000fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 shutdown_connections 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:07:55.882+0000 7f3704eeb700 1 -- 172.21.15.35:0/2540315062 wait complete. 2023-03-17T09:28:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 -- 172.21.15.35:0/2061027050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 msgr2=0x7f577c10a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 --2- 172.21.15.35:0/2061027050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c10a770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f57700099c0 tx=0x7f5770009cd0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 -- 172.21.15.35:0/2061027050 shutdown_connections 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 --2- 172.21.15.35:0/2061027050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 0x7f577c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 --2- 172.21.15.35:0/2061027050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 0x7f577c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 --2- 172.21.15.35:0/2061027050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c10a770 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 -- 172.21.15.35:0/2061027050 >> 172.21.15.35:0/2061027050 conn(0x7f577c0749e0 msgr2=0x7f577c074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 -- 172.21.15.35:0/2061027050 shutdown_connections 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 -- 172.21.15.35:0/2061027050 wait complete. 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.004+0000 7f57818f4700 1 Processor -- start 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 -- start start 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 0x7f577c196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 0x7f577c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:51.346 DEBUG:teuthology.orchestra.run.smithi035:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-03-17T09:28:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c19b230 con 0x7f577c0ffd00 2023-03-17T09:28:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c19b3a0 con 0x7f577c10acb0 2023-03-17T09:28:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f57818f4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c19b560 con 0x7f577c0ff3f0 2023-03-17T09:28:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45288/0 (socket says 172.21.15.35:45288) 2023-03-17T09:28:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 -- 172.21.15.35:0/1935125198 learned_addr learned my addr 172.21.15.35:0/1935125198 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577b7fe700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 0x7f577c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577affd700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 0x7f577c196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 -- 172.21.15.35:0/1935125198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 msgr2=0x7f577c196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 0x7f577c196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:54.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 -- 172.21.15.35:0/1935125198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 msgr2=0x7f577c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:54.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 0x7f577c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:54.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577a7fc700 1 -- 172.21.15.35:0/1935125198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700095f0 con 0x7f577c0ffd00 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577affd700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 0x7f577c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.005+0000 7f577b7fe700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 0x7f577c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.006+0000 7f577a7fc700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c196790 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5770009fd0 tx=0x7f577000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.006+0000 7f57808f2700 1 -- 172.21.15.35:0/1935125198 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577001d070 con 0x7f577c0ffd00 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.006+0000 7f57808f2700 1 -- 172.21.15.35:0/1935125198 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57700054c0 con 0x7f577c0ffd00 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.006+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c110150 con 0x7f577c0ffd00 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.006+0000 7f57808f2700 1 -- 172.21.15.35:0/1935125198 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770004b30 con 0x7f577c0ffd00 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.006+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c10ffc0 con 0x7f577c0ffd00 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 Processor -- start 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 -- start start 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22236fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de22231420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22231d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22138010 con 0x55de22236be0 2023-03-17T09:28:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de2218a950 con 0x55de222374f0 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f578da81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22183de0 con 0x55de22231960 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22236fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22236fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45292/0 (socket says 172.21.15.35:45292) 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 -- 172.21.15.35:0/460502183 learned_addr learned my addr 172.21.15.35:0/460502183 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577affd700 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de22231420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f57808f2700 1 -- 172.21.15.35:0/1935125198 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f577000fc30 con 0x7f577c0ffd00 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 -- 172.21.15.35:0/460502183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 msgr2=0x55de22231d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22231d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:54.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 -- 172.21.15.35:0/460502183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 msgr2=0x55de22231420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de22231420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.010+0000 7f577b7fe700 1 -- 172.21.15.35:0/460502183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de220055d0 con 0x55de22236be0 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.011+0000 7f577b7fe700 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22236fb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5774009440 tx=0x7f5774009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09f0c21d1325eb9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.011+0000 7f5761ffb700 1 -- 172.21.15.35:0/460502183 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400e070 con 0x55de22236be0 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.011+0000 7f5761ffb700 1 -- 172.21.15.35:0/460502183 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f577400f040 con 0x55de22236be0 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.011+0000 7f5761ffb700 1 -- 172.21.15.35:0/460502183 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774015b30 con 0x55de22236be0 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.011+0000 7f57808f2700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f576409f640 0x7f57640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.011+0000 7f577affd700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f576409f640 0x7f57640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 -- 172.21.15.35:0/460502183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 msgr2=0x55de22236fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:28:54.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22236fb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5774009440 tx=0x7f5774009920 comp rx=0 tx=0).stop 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 -- 172.21.15.35:0/460502183 shutdown_connections 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22231d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f57808f2700 1 -- 172.21.15.35:0/1935125198 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f57700cb4c0 con 0x7f577c0ffd00 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22236fb0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 --2- 172.21.15.35:0/460502183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de22231420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 -- 172.21.15.35:0/460502183 >> 172.21.15.35:0/460502183 conn(0x55de2208e6b0 msgr2=0x55de2222ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 -- 172.21.15.35:0/460502183 shutdown_connections 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 -- 172.21.15.35:0/460502183 wait complete. 2023-03-17T09:28:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f577affd700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f576409f640 0x7f57640a1af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55de2222c6a0 tx=0x7f576c009520 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 -- start start 2023-03-17T09:28:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.012+0000 7f578da81b80 1 Processor -- start 2023-03-17T09:28:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de2223d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de2223a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de2223ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de220078c0 con 0x55de22236be0 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de2223b480 con 0x55de222374f0 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22247030 con 0x55de22231960 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f578da81b80 10 client.0 _ll_register_callbacks cb 0x55de22029230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de2223a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de2223a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45302/0 (socket says 172.21.15.35:45302) 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 -- 172.21.15.35:0/3916149506 learned_addr learned my addr 172.21.15.35:0/3916149506 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577b7fe700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de2223ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577affd700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de2223d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 -- 172.21.15.35:0/3916149506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 msgr2=0x55de2223d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de2223d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 -- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 msgr2=0x55de2223ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de2223ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 -- 172.21.15.35:0/3916149506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57740090f0 con 0x55de22236be0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f577a7fc700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de2223a710 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f57700c8c80 tx=0x7f5770098a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37547a2038ee007 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.013+0000 7f575affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f575affd700 1 -- 172.21.15.35:0/3916149506 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770099430 con 0x55de22236be0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f575affd700 1 -- 172.21.15.35:0/3916149506 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f57700984c0 con 0x55de22236be0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de22146390 con 0x55de22236be0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f575affd700 1 -- 172.21.15.35:0/3916149506 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57700986a0 con 0x55de22236be0 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 10 client.16671 fetch_fsmap learned FSMap version 32 2023-03-17T09:28:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55de21fb1d80 con 0x55de22236be0 2023-03-17T09:28:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f575affd700 1 -- 172.21.15.35:0/3916149506 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de22146390 con 0x55de22236be0 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f575affd700 1 -- 172.21.15.35:0/3916149506 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f57700a0da0 con 0x55de22236be0 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 10 client.16671 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 10 client.16671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 20 client.16671 populate_metadata read hostname 'smithi035' 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de2224cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 4 client.16671 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.014+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de22152600 con 0x55de2224ac00 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.015+0000 7f577affd700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de2224cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:28:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.015+0000 7f575affd700 10 client.16671 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.015+0000 7f577affd700 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de2224cfe0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec1fe30412666f7f server_cookie=1a16e79c43246527 in_seq=0 out_seq=0 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f575affd700 1 -- 172.21.15.35:0/3916149506 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55de22152600 con 0x55de2224ac00 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f575affd700 10 client.16671 handle_command_reply: tid=0 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 client.16671 shutdown 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 msgr2=0x55de2223a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de2223a710 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f57700c8c80 tx=0x7f5770098a20 comp rx=0 tx=0).stop 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 shutdown_connections 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de2224cfe0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de2223ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:00.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f575affd700 0 client.16671 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de2223d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 --2- 172.21.15.35:0/3916149506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de2223a710 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 >> 172.21.15.35:0/3916149506 conn(0x55de2208e6b0 msgr2=0x55de22230410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 shutdown_connections 2023-03-17T09:29:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 1 -- 172.21.15.35:0/3916149506 wait complete. 2023-03-17T09:29:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.016+0000 7f578da81b80 20 client.16671 trim_cache size 0 max 16384 2023-03-17T09:29:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.031+0000 7f578da81b80 1 Processor -- start 2023-03-17T09:29:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 -- start start 2023-03-17T09:29:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de22231960 0x55de2222bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22236be0 0x55de22241f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 0x55de2223cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22147050 con 0x55de222374f0 2023-03-17T09:29:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de2223b690 con 0x55de22231960 2023-03-17T09:29:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f578da81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de2222c000 con 0x55de22236be0 2023-03-17T09:29:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 0x55de2223cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 0x55de2223cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45312/0 (socket says 172.21.15.35:45312) 2023-03-17T09:29:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 -- 172.21.15.35:0/2100742048 learned_addr learned my addr 172.21.15.35:0/2100742048 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577a7fc700 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22236be0 0x55de22241f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577affd700 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de22231960 0x55de2222bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 -- 172.21.15.35:0/2100742048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22236be0 msgr2=0x55de22241f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22236be0 0x55de22241f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 -- 172.21.15.35:0/2100742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de22231960 msgr2=0x55de2222bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de22231960 0x55de2222bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.032+0000 7f577b7fe700 1 -- 172.21.15.35:0/2100742048 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de2214a130 con 0x55de222374f0 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f577b7fe700 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 0x55de2223cfc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f57740093e0 tx=0x7f5774009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2624e8ebe9dcc2a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f57627fc700 1 -- 172.21.15.35:0/2100742048 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400e040 con 0x55de222374f0 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f57627fc700 1 -- 172.21.15.35:0/2100742048 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5774003e90 con 0x55de222374f0 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f57627fc700 1 -- 172.21.15.35:0/2100742048 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740047a0 con 0x55de222374f0 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 -- 172.21.15.35:0/2100742048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 msgr2=0x55de2223cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 0x55de2223cfc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f57740093e0 tx=0x7f5774009690 comp rx=0 tx=0).stop 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 -- 172.21.15.35:0/2100742048 shutdown_connections 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de222374f0 0x55de2223cfc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de22231960 0x55de2222bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 --2- 172.21.15.35:0/2100742048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22236be0 0x55de22241f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.033+0000 7f578da81b80 1 -- 172.21.15.35:0/2100742048 >> 172.21.15.35:0/2100742048 conn(0x55de2208e6b0 msgr2=0x55de22230410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 -- 172.21.15.35:0/2100742048 shutdown_connections 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 -- 172.21.15.35:0/2100742048 wait complete. 2023-03-17T09:29:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 -- start start 2023-03-17T09:29:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 Processor -- start 2023-03-17T09:29:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22241e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22240160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de222406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22240be0 con 0x55de22236be0 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22240d20 con 0x55de222374f0 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de22240ee0 con 0x55de22231960 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.034+0000 7f578da81b80 10 client.0 _ll_register_callbacks cb 0x55de22029230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22240160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22240160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45318/0 (socket says 172.21.15.35:45318) 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22241e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 -- 172.21.15.35:0/1537674346 learned_addr learned my addr 172.21.15.35:0/1537674346 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577b7fe700 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de222406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 -- 172.21.15.35:0/1537674346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 msgr2=0x55de22241e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22241e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 -- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 msgr2=0x55de222406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de222406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 -- 172.21.15.35:0/1537674346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de220055d0 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f577a7fc700 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22240160 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f57700095c0 tx=0x7f577009a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f5862ca8a34d8d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f575affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f575affd700 1 -- 172.21.15.35:0/1537674346 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770095310 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f575affd700 1 -- 172.21.15.35:0/1537674346 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f57700a0eb0 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de222011e0 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f575affd700 1 -- 172.21.15.35:0/1537674346 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5770098140 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f578da81b80 10 client.16677 fetch_fsmap learned FSMap version 32 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.035+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55de21fd81f0 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f575affd700 1 -- 172.21.15.35:0/1537674346 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de222011e0 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f575affd700 1 -- 172.21.15.35:0/1537674346 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5770098550 con 0x55de22236be0 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f578da81b80 10 client.16677 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:29:03.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f578da81b80 10 client.16677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:29:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f578da81b80 20 client.16677 populate_metadata read hostname 'smithi035' 2023-03-17T09:29:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f578da81b80 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de222a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f578da81b80 4 client.16677 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:29:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55de22007f00 con 0x55de2224ac00 2023-03-17T09:29:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.036+0000 7f577affd700 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de222a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.037+0000 7f575affd700 10 client.16677 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.037+0000 7f577affd700 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de222a1a60 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f02c1524fb93d430 server_cookie=c5f96dbedd459020 in_seq=0 out_seq=0 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f575affd700 1 -- 172.21.15.35:0/1537674346 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55de22007f00 con 0x55de2224ac00 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f575affd700 10 client.16677 handle_command_reply: tid=0 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 client.16677 shutdown 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 msgr2=0x55de22240160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22240160 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f57700095c0 tx=0x7f577009a350 comp rx=0 tx=0).stop 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 shutdown_connections 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de2224ac00 0x55de222a1a60 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de222374f0 0x55de222406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f575affd700 0 client.16677 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de22231960 0x55de22241e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 --2- 172.21.15.35:0/1537674346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de22236be0 0x55de22240160 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 >> 172.21.15.35:0/1537674346 conn(0x55de2208e6b0 msgr2=0x55de222346b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 shutdown_connections 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 1 -- 172.21.15.35:0/1537674346 wait complete. 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.044+0000 7f578da81b80 20 client.16677 trim_cache size 0 max 16384 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f576409f640 msgr2=0x7f57640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f576409f640 0x7f57640a1af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55de2222c6a0 tx=0x7f576c009520 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 msgr2=0x7f577c196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c196790 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5770009fd0 tx=0x7f577000f740 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 shutdown_connections 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f576409f640 0x7f57640a1af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f577c10acb0 0x7f577c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577c0ff3f0 0x7f577c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 --2- 172.21.15.35:0/1935125198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f577c0ffd00 0x7f577c196790 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 >> 172.21.15.35:0/1935125198 conn(0x7f577c0749e0 msgr2=0x7f577c0fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 shutdown_connections 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:09.045+0000 7f57818f4700 1 -- 172.21.15.35:0/1935125198 wait complete. 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 -- 172.21.15.35:0/227886792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34140ffd50 msgr2=0x7f3414103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 --2- 172.21.15.35:0/227886792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34140ffd50 0x7f3414103d10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0099c0 tx=0x7f33fc009cd0 comp rx=0 tx=0).stop 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 -- 172.21.15.35:0/227886792 shutdown_connections 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 --2- 172.21.15.35:0/227886792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34141043f0 0x7f341410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 --2- 172.21.15.35:0/227886792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34140ff3b0 0x7f34140ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 --2- 172.21.15.35:0/227886792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34140ffd50 0x7f3414103d10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 -- 172.21.15.35:0/227886792 >> 172.21.15.35:0/227886792 conn(0x7f3414075f60 msgr2=0x7f3414076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 -- 172.21.15.35:0/227886792 shutdown_connections 2023-03-17T09:29:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.167+0000 7f3418b7d700 1 -- 172.21.15.35:0/227886792 wait complete. 2023-03-17T09:29:04.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.168+0000 7f3418b7d700 1 Processor -- start 2023-03-17T09:29:04.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.168+0000 7f3418b7d700 1 -- start start 2023-03-17T09:29:04.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3418b7d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34140ff3b0 0x7f3414197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:04.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3418b7d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34140ffd50 0x7f3414197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:04.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3418b7d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 0x7f34141a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3418b7d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414197fa0 con 0x7f34141043f0 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3418b7d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34141a2710 con 0x7f34140ffd50 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3418b7d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34141a2880 con 0x7f34140ff3b0 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 0x7f34141a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 0x7f34141a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45332/0 (socket says 172.21.15.35:45332) 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 -- 172.21.15.35:0/723915245 learned_addr learned my addr 172.21.15.35:0/723915245 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f340bfff700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34140ffd50 0x7f3414197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f341259c700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34140ff3b0 0x7f3414197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 -- 172.21.15.35:0/723915245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34140ff3b0 msgr2=0x7f3414197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34140ff3b0 0x7f3414197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 -- 172.21.15.35:0/723915245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34140ffd50 msgr2=0x7f3414197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34140ffd50 0x7f3414197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f3412d9d700 1 -- 172.21.15.35:0/723915245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc0095f0 con 0x7f34141043f0 2023-03-17T09:29:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.169+0000 7f340bfff700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34140ffd50 0x7f3414197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.170+0000 7f3412d9d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 0x7f34141a21d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f340c007ee0 tx=0x7f340c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.170+0000 7f340b7fe700 1 -- 172.21.15.35:0/723915245 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00dd20 con 0x7f34141043f0 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.170+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341410f020 con 0x7f34141043f0 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.170+0000 7f340b7fe700 1 -- 172.21.15.35:0/723915245 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f340c00f040 con 0x7f34141043f0 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.170+0000 7f340b7fe700 1 -- 172.21.15.35:0/723915245 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c004750 con 0x7f34141043f0 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.170+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341410ee90 con 0x7f34141043f0 2023-03-17T09:29:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.172+0000 7f340b7fe700 1 -- 172.21.15.35:0/723915245 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f340c003a00 con 0x7f34141043f0 2023-03-17T09:29:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.173+0000 7f340b7fe700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f340009f640 0x7f34000a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.173+0000 7f340b7fe700 1 -- 172.21.15.35:0/723915245 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f340c0c9e90 con 0x7f34141043f0 2023-03-17T09:29:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.173+0000 7f341259c700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f340009f640 0x7f34000a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.174+0000 7f341259c700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f340009f640 0x7f34000a1af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3404005950 tx=0x7f340400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.174+0000 7f3424d0ab80 1 Processor -- start 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.174+0000 7f3424d0ab80 1 -- start start 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.174+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245ceefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.174+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245ce9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.174+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245ce9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245bf0010 con 0x559245cef4f0 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245c42950 con 0x559245ce9960 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245c3bde0 con 0x559245ceebe0 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245ce9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245ce9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45338/0 (socket says 172.21.15.35:45338) 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 -- 172.21.15.35:0/694609099 learned_addr learned my addr 172.21.15.35:0/694609099 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f341259c700 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245ceefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3412d9d700 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245ce9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 -- 172.21.15.35:0/694609099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 msgr2=0x559245ceefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245ceefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 -- 172.21.15.35:0/694609099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 msgr2=0x559245ce9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245ce9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 -- 172.21.15.35:0/694609099 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559245abd5d0 con 0x559245cef4f0 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f340bfff700 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245ce9420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b580 tx=0x7f33fc005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68635e9e0625e6fe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3408ff9700 1 -- 172.21.15.35:0/694609099 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc01d050 con 0x559245cef4f0 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3408ff9700 1 -- 172.21.15.35:0/694609099 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33fc01e040 con 0x559245cef4f0 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.175+0000 7f3408ff9700 1 -- 172.21.15.35:0/694609099 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004910 con 0x559245cef4f0 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 -- 172.21.15.35:0/694609099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 msgr2=0x559245ce9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245ce9420 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b580 tx=0x7f33fc005c90 comp rx=0 tx=0).stop 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 -- 172.21.15.35:0/694609099 shutdown_connections 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245ce9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245ceefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/694609099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245ce9420 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 -- 172.21.15.35:0/694609099 >> 172.21.15.35:0/694609099 conn(0x559245b466b0 msgr2=0x559245ce3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 -- 172.21.15.35:0/694609099 shutdown_connections 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.176+0000 7f3424d0ab80 1 -- 172.21.15.35:0/694609099 wait complete. 2023-03-17T09:29:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 -- start start 2023-03-17T09:29:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 Processor -- start 2023-03-17T09:29:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245cf5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245cf2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245cf2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245abf8c0 con 0x559245cef4f0 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245cf34a0 con 0x559245ce9960 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245cfefa0 con 0x559245ceebe0 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3424d0ab80 10 client.0 _ll_register_callbacks cb 0x559245ae1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245cf2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245cf2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45346/0 (socket says 172.21.15.35:45346) 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f3412d9d700 1 -- 172.21.15.35:0/1107811231 learned_addr learned my addr 172.21.15.35:0/1107811231 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f341259c700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245cf5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.177+0000 7f340bfff700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245cf2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3412d9d700 1 -- 172.21.15.35:0/1107811231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 msgr2=0x559245cf2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3412d9d700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245cf2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3412d9d700 1 -- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 msgr2=0x559245cf5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3412d9d700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245cf5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3412d9d700 1 -- 172.21.15.35:0/1107811231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341410c800 con 0x559245cef4f0 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f341259c700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245cf5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3412d9d700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245cf2d30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c7c20 tx=0x7f340c003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c67466d0ee4c2f1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f33f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:29:08.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f33f9ffb700 1 -- 172.21.15.35:0/1107811231 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c009410 con 0x559245cef4f0 2023-03-17T09:29:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f33f9ffb700 1 -- 172.21.15.35:0/1107811231 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f340c097940 con 0x559245cef4f0 2023-03-17T09:29:08.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559245bfe390 con 0x559245cef4f0 2023-03-17T09:29:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f33f9ffb700 1 -- 172.21.15.35:0/1107811231 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f340c09fb30 con 0x559245cef4f0 2023-03-17T09:29:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3424d0ab80 10 client.16689 fetch_fsmap learned FSMap version 32 2023-03-17T09:29:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x559245a69d80 con 0x559245cef4f0 2023-03-17T09:29:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f33f9ffb700 1 -- 172.21.15.35:0/1107811231 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559245bfe390 con 0x559245cef4f0 2023-03-17T09:29:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.178+0000 7f33f9ffb700 1 -- 172.21.15.35:0/1107811231 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f340c096f30 con 0x559245cef4f0 2023-03-17T09:29:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f3424d0ab80 10 client.16689 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:29:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f3424d0ab80 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:29:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f3424d0ab80 20 client.16689 populate_metadata read hostname 'smithi035' 2023-03-17T09:29:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d030e0 0x559245d054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f3424d0ab80 4 client.16689 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:29:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559245c0a600 con 0x559245d030e0 2023-03-17T09:29:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f341259c700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d030e0 0x559245d054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f33f9ffb700 10 client.16689 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.179+0000 7f341259c700 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d030e0 0x559245d054c0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4871c73f2c6605 server_cookie=f005656024733616 in_seq=0 out_seq=0 2023-03-17T09:29:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f33f9ffb700 1 -- 172.21.15.35:0/1107811231 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559245c0a600 con 0x559245d030e0 2023-03-17T09:29:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f33f9ffb700 10 client.16689 handle_command_reply: tid=0 2023-03-17T09:29:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 client.16689 shutdown 2023-03-17T09:29:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 msgr2=0x559245cf2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245cf2d30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c7c20 tx=0x7f340c003da0 comp rx=0 tx=0).stop 2023-03-17T09:29:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 shutdown_connections 2023-03-17T09:29:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d030e0 0x559245d054c0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:11.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:36 smithi035 ceph-mon[92535]: pgmap v1093: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:38 smithi035 ceph-mon[92535]: pgmap v1094: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:40 smithi035 ceph-mon[92535]: pgmap v1095: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:42 smithi035 ceph-mon[92535]: pgmap v1096: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:44 smithi035 ceph-mon[92535]: pgmap v1097: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:46 smithi035 ceph-mon[92535]: pgmap v1098: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:48 smithi035 ceph-mon[92535]: pgmap v1099: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:50 smithi035 ceph-mon[92535]: pgmap v1100: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:52 smithi035 ceph-mon[92535]: pgmap v1101: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:54 smithi035 ceph-mon[92535]: pgmap v1102: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:56 smithi035 ceph-mon[92535]: pgmap v1103: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:20:58 smithi035 ceph-mon[92535]: pgmap v1104: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:00 smithi035 ceph-mon[92535]: pgmap v1105: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:02 smithi035 ceph-mon[92535]: pgmap v1106: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:29:12.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:04 smithi035 ceph-mon[92535]: pgmap v1107: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:04 smithi035 ceph-mon[92535]: osdmap e146: 12 total, 12 up, 12 in 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:06 smithi035 ceph-mon[92535]: pgmap v1109: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:08 smithi035 ceph-mon[92535]: pgmap v1110: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:10 smithi035 ceph-mon[92535]: pgmap v1111: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:10 smithi035 ceph-mon[92535]: osdmap e147: 12 total, 12 up, 12 in 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:12 smithi035 ceph-mon[92535]: pgmap v1113: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:14 smithi035 ceph-mon[92535]: pgmap v1114: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 412 B/s wr, 9 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:16 smithi035 ceph-mon[92535]: pgmap v1115: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 409 B/s wr, 8 op/s 2023-03-17T09:29:12.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:18 smithi035 ceph-mon[92535]: pgmap v1116: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-03-17T09:29:13.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:20 smithi035 ceph-mon[92535]: pgmap v1117: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-03-17T09:29:13.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:20 smithi035 ceph-mon[92535]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2023-03-17T09:29:13.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:20 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T09:29:13.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:22 smithi035 ceph-mon[92535]: pgmap v1118: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 462 B/s wr, 7 op/s 2023-03-17T09:29:13.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:24 smithi035 ceph-mon[92535]: pgmap v1119: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2023-03-17T09:29:13.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:26 smithi035 ceph-mon[92535]: pgmap v1120: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:29:13.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:28 smithi035 ceph-mon[92535]: pgmap v1121: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:29:13.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:30 smithi035 ceph-mon[92535]: pgmap v1122: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-03-17T09:29:13.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:32 smithi035 ceph-mon[92535]: pgmap v1123: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-03-17T09:29:13.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:34 smithi035 ceph-mon[92535]: pgmap v1124: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-17T09:29:13.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:36 smithi035 ceph-mon[92535]: pgmap v1125: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:29:13.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:29:13.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:29:13.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:29:13.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:29:13.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:29:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:29:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:29:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:29:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:29:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:29:14.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:29:14.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:29:14.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:29:14.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:29:14.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:29:14.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:29:14.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:29:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:29:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:29:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:29:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245cef4f0 0x559245cf2d30 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245ce9960 0x559245cf5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f33f9ffb700 0 client.16689 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1107811231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245cf2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 >> 172.21.15.35:0/1107811231 conn(0x559245b466b0 msgr2=0x559245ce8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 shutdown_connections 2023-03-17T09:29:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1107811231 wait complete. 2023-03-17T09:29:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.180+0000 7f3424d0ab80 20 client.16689 trim_cache size 0 max 16384 2023-03-17T09:29:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 Processor -- start 2023-03-17T09:29:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 -- start start 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ce9960 0x559245cf9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 0x559245cf4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245cec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245cdf0f0 con 0x559245ceebe0 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245cf36e0 con 0x559245cef4f0 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245ce0b60 con 0x559245ce9960 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f340bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 0x559245cf4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f340bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 0x559245cf4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45352/0 (socket says 172.21.15.35:45352) 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.195+0000 7f340bfff700 1 -- 172.21.15.35:0/1759589782 learned_addr learned my addr 172.21.15.35:0/1759589782 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f341259c700 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ce9960 0x559245cf9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f3412d9d700 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245cec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f340bfff700 1 -- 172.21.15.35:0/1759589782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ce9960 msgr2=0x559245cf9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f340bfff700 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ce9960 0x559245cf9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f340bfff700 1 -- 172.21.15.35:0/1759589782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 msgr2=0x559245cec6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f340bfff700 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245cec6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f340bfff700 1 -- 172.21.15.35:0/1759589782 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559245c02130 con 0x559245ceebe0 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f3412d9d700 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245cec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f340bfff700 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 0x559245cf4fd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b580 tx=0x7f33fc00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f421d113dfd71cf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f34097fa700 1 -- 172.21.15.35:0/1759589782 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00bd40 con 0x559245ceebe0 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f34097fa700 1 -- 172.21.15.35:0/1759589782 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33fc00bea0 con 0x559245ceebe0 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.196+0000 7f34097fa700 1 -- 172.21.15.35:0/1759589782 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004bc0 con 0x559245ceebe0 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1759589782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 msgr2=0x559245cf4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 0x559245cf4fd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b580 tx=0x7f33fc00b6b0 comp rx=0 tx=0).stop 2023-03-17T09:29:18.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1759589782 shutdown_connections 2023-03-17T09:29:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245cec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:21.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ce9960 0x559245cf9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/1759589782 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ceebe0 0x559245cf4fd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1759589782 >> 172.21.15.35:0/1759589782 conn(0x559245b466b0 msgr2=0x559245cff330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1759589782 shutdown_connections 2023-03-17T09:29:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 -- 172.21.15.35:0/1759589782 wait complete. 2023-03-17T09:29:22.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 -- start start 2023-03-17T09:29:22.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.197+0000 7f3424d0ab80 1 Processor -- start 2023-03-17T09:29:22.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 0x559245d4f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:22.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245d4fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:22.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245d543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245d548f0 con 0x559245ce9960 2023-03-17T09:29:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245d54a60 con 0x559245cef4f0 2023-03-17T09:29:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559245d54c20 con 0x559245ceebe0 2023-03-17T09:29:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3424d0ab80 10 client.0 _ll_register_callbacks cb 0x559245ae1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:29:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 0x559245d4f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 0x559245d4f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45356/0 (socket says 172.21.15.35:45356) 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 -- 172.21.15.35:0/2869744869 learned_addr learned my addr 172.21.15.35:0/2869744869 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f340bfff700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245d4fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3412d9d700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245d543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 -- 172.21.15.35:0/2869744869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 msgr2=0x559245d4fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245d4fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 -- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 msgr2=0x559245d543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245d543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 -- 172.21.15.35:0/2869744869 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559245abd5d0 con 0x559245ce9960 2023-03-17T09:29:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f3412d9d700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245d543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:29:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f341259c700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 0x559245d4f4e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x559245d05dd0 tx=0x7f34040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca79fbfaf337a7bc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.198+0000 7f33f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:29:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f33f9ffb700 1 -- 172.21.15.35:0/2869744869 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404027250 con 0x559245ce9960 2023-03-17T09:29:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f33f9ffb700 1 -- 172.21.15.35:0/2869744869 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3404017070 con 0x559245ce9960 2023-03-17T09:29:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559245cb91e0 con 0x559245ce9960 2023-03-17T09:29:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f33f9ffb700 1 -- 172.21.15.35:0/2869744869 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34040273b0 con 0x559245ce9960 2023-03-17T09:29:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 10 client.16695 fetch_fsmap learned FSMap version 32 2023-03-17T09:29:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x559245a901f0 con 0x559245ce9960 2023-03-17T09:29:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f33f9ffb700 1 -- 172.21.15.35:0/2869744869 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559245cb91e0 con 0x559245ce9960 2023-03-17T09:29:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f33f9ffb700 1 -- 172.21.15.35:0/2869744869 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f340401f530 con 0x559245ce9960 2023-03-17T09:29:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 10 client.16695 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:29:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:29:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 20 client.16695 populate_metadata read hostname 'smithi035' 2023-03-17T09:29:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d5c3b0 0x559245d5e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 4 client.16695 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:29:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559245abff00 con 0x559245d5c3b0 2023-03-17T09:29:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.199+0000 7f340bfff700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d5c3b0 0x559245d5e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.200+0000 7f340bfff700 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d5c3b0 0x559245d5e7c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3599c5752ed1c4 server_cookie=d59e1ce5a8813672 in_seq=0 out_seq=0 2023-03-17T09:29:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.200+0000 7f33f9ffb700 10 client.16695 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f33f9ffb700 1 -- 172.21.15.35:0/2869744869 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559245abff00 con 0x559245d5c3b0 2023-03-17T09:29:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f33f9ffb700 10 client.16695 handle_command_reply: tid=0 2023-03-17T09:29:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 client.16695 shutdown 2023-03-17T09:29:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 msgr2=0x559245d4f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 0x559245d4f4e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x559245d05dd0 tx=0x7f34040047c0 comp rx=0 tx=0).stop 2023-03-17T09:29:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 shutdown_connections 2023-03-17T09:29:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559245d5c3b0 0x559245d5e7c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559245cef4f0 0x559245d543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f33f9ffb700 0 client.16695 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559245ce9960 0x559245d4f4e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 --2- 172.21.15.35:0/2869744869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559245ceebe0 0x559245d4fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 >> 172.21.15.35:0/2869744869 conn(0x559245b466b0 msgr2=0x559245cec6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 shutdown_connections 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 1 -- 172.21.15.35:0/2869744869 wait complete. 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.204+0000 7f3424d0ab80 20 client.16695 trim_cache size 0 max 16384 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f340009f640 msgr2=0x7f34000a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f340009f640 0x7f34000a1af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3404005950 tx=0x7f340400b410 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 msgr2=0x7f34141a21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 0x7f34141a21d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f340c007ee0 tx=0x7f340c00d3b0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 shutdown_connections 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f340009f640 0x7f34000a1af0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f34141043f0 0x7f34141a21d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34140ff3b0 0x7f3414197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 --2- 172.21.15.35:0/723915245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34140ffd50 0x7f3414197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 >> 172.21.15.35:0/723915245 conn(0x7f3414075f60 msgr2=0x7f34140fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 shutdown_connections 2023-03-17T09:29:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:22.205+0000 7f3418b7d700 1 -- 172.21.15.35:0/723915245 wait complete. 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4183614122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ffd30 msgr2=0x7f8c98103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4183614122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ffd30 0x7f8c98103cf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0099c0 tx=0x7f8c8c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4183614122 shutdown_connections 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4183614122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c981043d0 0x7f8c9810bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4183614122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ff390 0x7f8c980ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4183614122 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ffd30 0x7f8c98103cf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4183614122 >> 172.21.15.35:0/4183614122 conn(0x7f8c98075f30 msgr2=0x7f8c98076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4183614122 shutdown_connections 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.328+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4183614122 wait complete. 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 Processor -- start 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 -- start start 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 0x7f8c98196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ffd30 0x7f8c981967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c981043d0 0x7f8c9819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9819b250 con 0x7f8c980ff390 2023-03-17T09:29:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9819b3c0 con 0x7f8c981043d0 2023-03-17T09:29:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c9e69a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9819b580 con 0x7f8c980ffd30 2023-03-17T09:29:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.329+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 0x7f8c98196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 0x7f8c98196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45370/0 (socket says 172.21.15.35:45370) 2023-03-17T09:29:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 -- 172.21.15.35:0/4111013819 learned_addr learned my addr 172.21.15.35:0/4111013819 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c977fe700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ffd30 0x7f8c981967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c981043d0 0x7f8c9819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:29.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 -- 172.21.15.35:0/4111013819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ffd30 msgr2=0x7f8c981967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:29.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ffd30 0x7f8c981967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:29.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 -- 172.21.15.35:0/4111013819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c981043d0 msgr2=0x7f8c9819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:29.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c981043d0 0x7f8c9819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 -- 172.21.15.35:0/4111013819 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0095f0 con 0x7f8c980ff390 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c977fe700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ffd30 0x7f8c981967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.330+0000 7f8c97fff700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 0x7f8c98196270 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800e9a0 tx=0x7f8c8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.331+0000 7f8c957fa700 1 -- 172.21.15.35:0/4111013819 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88009790 con 0x7f8c980ff390 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.331+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9810f000 con 0x7f8c980ff390 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.331+0000 7f8c957fa700 1 -- 172.21.15.35:0/4111013819 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c88010430 con 0x7f8c980ff390 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.331+0000 7f8c957fa700 1 -- 172.21.15.35:0/4111013819 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800cea0 con 0x7f8c980ff390 2023-03-17T09:29:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.331+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9810ee70 con 0x7f8c980ff390 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.333+0000 7f8c957fa700 1 -- 172.21.15.35:0/4111013819 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8c880105a0 con 0x7f8c980ff390 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.334+0000 7f8c957fa700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c8009f640 0x7f8c800a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.334+0000 7f8c957fa700 1 -- 172.21.15.35:0/4111013819 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c88014070 con 0x7f8c980ff390 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.334+0000 7f8c977fe700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c8009f640 0x7f8c800a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.334+0000 7f8c977fe700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c8009f640 0x7f8c800a1af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c000c00 tx=0x7f8c8c01a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 Processor -- start 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 -- start start 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53b4f0 0x55be8c535420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c535d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c43c010 con 0x55be8c535960 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c48e950 con 0x55be8c53b4f0 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8caa827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c487de0 con 0x55be8c53abe0 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8c9cc37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c535d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8c9cc37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c535d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45382/0 (socket says 172.21.15.35:45382) 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3107341354 learned_addr learned my addr 172.21.15.35:0/3107341354 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8c977fe700 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53b4f0 0x55be8c535420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.335+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3107341354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 msgr2=0x55be8c53afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3107341354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53b4f0 msgr2=0x55be8c535420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:33.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:38 smithi035 ceph-mon[92535]: pgmap v1126: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:29:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53b4f0 0x55be8c535420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3107341354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be8c3095d0 con 0x55be8c535960 2023-03-17T09:29:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:29:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c535d90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8c90003fa0 tx=0x7f8c90009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7783529ebf3f01cc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c7e7fc700 1 -- 172.21.15.35:0/3107341354 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90019070 con 0x55be8c535960 2023-03-17T09:29:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c7e7fc700 1 -- 172.21.15.35:0/3107341354 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c9000f040 con 0x55be8c535960 2023-03-17T09:29:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.336+0000 7f8c7e7fc700 1 -- 172.21.15.35:0/3107341354 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c900079f0 con 0x55be8c535960 2023-03-17T09:29:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 -- 172.21.15.35:0/3107341354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 msgr2=0x55be8c535d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c535d90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8c90003fa0 tx=0x7f8c90009ba0 comp rx=0 tx=0).stop 2023-03-17T09:29:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 -- 172.21.15.35:0/3107341354 shutdown_connections 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c535d90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3107341354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53b4f0 0x55be8c535420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 -- 172.21.15.35:0/3107341354 >> 172.21.15.35:0/3107341354 conn(0x55be8c3926b0 msgr2=0x55be8c52fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 -- 172.21.15.35:0/3107341354 shutdown_connections 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 -- 172.21.15.35:0/3107341354 wait complete. 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.337+0000 7f8caa827b80 1 -- start start 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 Processor -- start 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c53ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c30b8c0 con 0x55be8c53b4f0 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c53f390 con 0x55be8c535960 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c54b000 con 0x55be8c53abe0 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8caa827b80 10 client.0 _ll_register_callbacks cb 0x55be8c32d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c53ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c53ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45386/0 (socket says 172.21.15.35:45386) 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3061214033 learned_addr learned my addr 172.21.15.35:0/3061214033 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c977fe700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3061214033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 msgr2=0x55be8c53e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 msgr2=0x55be8c5413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3061214033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c90003bd0 con 0x55be8c53b4f0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.338+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c53ec20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8c90004680 tx=0x7f8c900095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1759ba6faa8367e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c777fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c777fe700 1 -- 172.21.15.35:0/3061214033 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90019030 con 0x55be8c53b4f0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c777fe700 1 -- 172.21.15.35:0/3061214033 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c9001a070 con 0x55be8c53b4f0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be8c44a390 con 0x55be8c53b4f0 2023-03-17T09:29:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c777fe700 1 -- 172.21.15.35:0/3061214033 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c90007a40 con 0x55be8c53b4f0 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 10 client.16707 fetch_fsmap learned FSMap version 32 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55be8c2b5d80 con 0x55be8c53b4f0 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c777fe700 1 -- 172.21.15.35:0/3061214033 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55be8c44a390 con 0x55be8c53b4f0 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8c777fe700 1 -- 172.21.15.35:0/3061214033 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8c90015b40 con 0x55be8c53b4f0 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 10 client.16707 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 20 client.16707 populate_metadata read hostname 'smithi035' 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c54efc0 0x55be8c5513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 4 client.16707 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.339+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be8c456600 con 0x55be8c54efc0 2023-03-17T09:29:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.340+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c54efc0 0x55be8c5513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.340+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c54efc0 0x55be8c5513d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7335318a85bbeff4 server_cookie=8b7eaef726295307 in_seq=0 out_seq=0 2023-03-17T09:29:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.340+0000 7f8c777fe700 10 client.16707 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8c777fe700 1 -- 172.21.15.35:0/3061214033 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55be8c456600 con 0x55be8c54efc0 2023-03-17T09:29:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8c777fe700 10 client.16707 handle_command_reply: tid=0 2023-03-17T09:29:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 client.16707 shutdown 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 msgr2=0x55be8c53ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c53ec20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8c90004680 tx=0x7f8c900095b0 comp rx=0 tx=0).stop 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 shutdown_connections 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c54efc0 0x55be8c5513d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c53ec20 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8c777fe700 0 client.16707 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3061214033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c53e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 >> 172.21.15.35:0/3061214033 conn(0x55be8c3926b0 msgr2=0x55be8c52fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 shutdown_connections 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 1 -- 172.21.15.35:0/3061214033 wait complete. 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.341+0000 7f8caa827b80 20 client.16707 trim_cache size 0 max 16384 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.356+0000 7f8caa827b80 1 Processor -- start 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.356+0000 7f8caa827b80 1 -- start start 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c52fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53abe0 0x55be8c53bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53b4f0 0x55be8c540f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8caa827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c52b0f0 con 0x55be8c535960 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8caa827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c53afb0 con 0x55be8c53abe0 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8caa827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c530000 con 0x55be8c53b4f0 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c52fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c52fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45392/0 (socket says 172.21.15.35:45392) 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 -- 172.21.15.35:0/2580655658 learned_addr learned my addr 172.21.15.35:0/2580655658 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:39.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c977fe700 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53abe0 0x55be8c53bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53b4f0 0x55be8c540f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 -- 172.21.15.35:0/2580655658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53b4f0 msgr2=0x55be8c540f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53b4f0 0x55be8c540f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 -- 172.21.15.35:0/2580655658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53abe0 msgr2=0x55be8c53bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53abe0 0x55be8c53bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 -- 172.21.15.35:0/2580655658 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be8c44e130 con 0x55be8c535960 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c97fff700 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c52fac0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8c88098100 tx=0x7f8c8809b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdc02590cccea0a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.357+0000 7f8c7effd700 1 -- 172.21.15.35:0/2580655658 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88098400 con 0x55be8c535960 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8c7effd700 1 -- 172.21.15.35:0/2580655658 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c880a05f0 con 0x55be8c535960 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8c7effd700 1 -- 172.21.15.35:0/2580655658 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c880978f0 con 0x55be8c535960 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 -- 172.21.15.35:0/2580655658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 msgr2=0x55be8c52fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c52fac0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8c88098100 tx=0x7f8c8809b040 comp rx=0 tx=0).stop 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 -- 172.21.15.35:0/2580655658 shutdown_connections 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53b4f0 0x55be8c540f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:39.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c535960 0x55be8c52fac0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 --2- 172.21.15.35:0/2580655658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c53abe0 0x55be8c53bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:41.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 -- 172.21.15.35:0/2580655658 >> 172.21.15.35:0/2580655658 conn(0x55be8c3926b0 msgr2=0x55be8c53b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 -- 172.21.15.35:0/2580655658 shutdown_connections 2023-03-17T09:29:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.358+0000 7f8caa827b80 1 -- 172.21.15.35:0/2580655658 wait complete. 2023-03-17T09:29:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 -- start start 2023-03-17T09:29:41.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 Processor -- start 2023-03-17T09:29:43.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c545f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c543f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c544640 con 0x55be8c53b4f0 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c5447b0 con 0x55be8c535960 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8c544970 con 0x55be8c53abe0 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8caa827b80 10 client.0 _ll_register_callbacks cb 0x55be8c32d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8c9cc37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c543f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8c9cc37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c543f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45400/0 (socket says 172.21.15.35:45400) 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3066908056 learned_addr learned my addr 172.21.15.35:0/3066908056 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.359+0000 7f8c977fe700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c545f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3066908056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 msgr2=0x55be8c545f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c545f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 msgr2=0x55be8c5459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:43.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c9cc37700 1 -- 172.21.15.35:0/3066908056 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9810f000 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c9cc37700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c543f30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8c900093f0 tx=0x7f8c90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e7679eb4efa84 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c777fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c777fe700 1 -- 172.21.15.35:0/3066908056 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90019070 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c777fe700 1 -- 172.21.15.35:0/3066908056 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c9001e5e0 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be8c5051e0 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c777fe700 1 -- 172.21.15.35:0/3066908056 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c9001ea30 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8caa827b80 10 client.16713 fetch_fsmap learned FSMap version 32 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55be8c2dc1f0 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c777fe700 1 -- 172.21.15.35:0/3066908056 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c9003d020 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.360+0000 7f8c777fe700 1 -- 172.21.15.35:0/3066908056 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8c90015480 con 0x55be8c53b4f0 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8caa827b80 10 client.16713 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8caa827b80 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8caa827b80 20 client.16713 populate_metadata read hostname 'smithi035' 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c5a3d70 0x55be8c5a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8caa827b80 4 client.16713 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55be8c30bf00 con 0x55be8c5a3d70 2023-03-17T09:29:43.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c5a3d70 0x55be8c5a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8c777fe700 10 client.16713 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.361+0000 7f8c97fff700 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c5a3d70 0x55be8c5a6180 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15d101cfc2584e28 server_cookie=a6b4f0f6c7a1552 in_seq=0 out_seq=0 2023-03-17T09:29:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.365+0000 7f8c777fe700 1 -- 172.21.15.35:0/3066908056 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55be8c30bf00 con 0x55be8c5a3d70 2023-03-17T09:29:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.365+0000 7f8c777fe700 10 client.16713 handle_command_reply: tid=0 2023-03-17T09:29:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.365+0000 7f8caa827b80 1 client.16713 shutdown 2023-03-17T09:29:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.365+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 msgr2=0x55be8c543f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.365+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c543f30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f8c900093f0 tx=0x7f8c90004a40 comp rx=0 tx=0).stop 2023-03-17T09:29:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 shutdown_connections 2023-03-17T09:29:44.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55be8c5a3d70 0x55be8c5a6180 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:45.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55be8c53b4f0 0x55be8c543f30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:45.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55be8c535960 0x55be8c5459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:45.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c777fe700 0 client.16713 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:29:45.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 --2- 172.21.15.35:0/3066908056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be8c53abe0 0x55be8c545f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:45.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 >> 172.21.15.35:0/3066908056 conn(0x55be8c3926b0 msgr2=0x55be8c53c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 shutdown_connections 2023-03-17T09:29:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 1 -- 172.21.15.35:0/3066908056 wait complete. 2023-03-17T09:29:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8caa827b80 20 client.16713 trim_cache size 0 max 16384 2023-03-17T09:29:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c8009f640 msgr2=0x7f8c800a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c8009f640 0x7f8c800a1af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c000c00 tx=0x7f8c8c01a040 comp rx=0 tx=0).stop 2023-03-17T09:29:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 msgr2=0x7f8c98196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 0x7f8c98196270 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800e9a0 tx=0x7f8c8800ecb0 comp rx=0 tx=0).stop 2023-03-17T09:29:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 shutdown_connections 2023-03-17T09:29:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c8009f640 0x7f8c800a1af0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c981043d0 0x7f8c9819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c980ff390 0x7f8c98196270 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 --2- 172.21.15.35:0/4111013819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c980ffd30 0x7f8c981967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 >> 172.21.15.35:0/4111013819 conn(0x7f8c98075f30 msgr2=0x7f8c98068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 shutdown_connections 2023-03-17T09:29:49.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:40 smithi035 ceph-mon[92535]: pgmap v1127: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:29:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:35.366+0000 7f8c9e69a700 1 -- 172.21.15.35:0/4111013819 wait complete. 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 -- 172.21.15.35:0/2466119571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c10a770 msgr2=0x7f2f7c10cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 --2- 172.21.15.35:0/2466119571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c10a770 0x7f2f7c10cbd0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400b0a0 tx=0x7f2f7400b3b0 comp rx=0 tx=0).stop 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 -- 172.21.15.35:0/2466119571 shutdown_connections 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 --2- 172.21.15.35:0/2466119571 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c10a770 0x7f2f7c10cbd0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 --2- 172.21.15.35:0/2466119571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f7c101430 0x7f2f7c101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 --2- 172.21.15.35:0/2466119571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101d40 0x7f2f7c10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 -- 172.21.15.35:0/2466119571 >> 172.21.15.35:0/2466119571 conn(0x7f2f7c076330 msgr2=0x7f2f7c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 -- 172.21.15.35:0/2466119571 shutdown_connections 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.490+0000 7f2f830cd700 1 -- 172.21.15.35:0/2466119571 wait complete. 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.491+0000 7f2f830cd700 1 Processor -- start 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.491+0000 7f2f830cd700 1 -- start start 2023-03-17T09:29:51.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f830cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101430 0x7f2f7c196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f830cd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 0x7f2f7c196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:51.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f830cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f7c10a770 0x7f2f7c19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f830cd700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c19b320 con 0x7f2f7c101d40 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f830cd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c19b490 con 0x7f2f7c101430 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f830cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c19b650 con 0x7f2f7c10a770 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 0x7f2f7c196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 0x7f2f7c196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45410/0 (socket says 172.21.15.35:45410) 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3613897783 learned_addr learned my addr 172.21.15.35:0/3613897783 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101430 0x7f2f7c196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f8166a700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f7c10a770 0x7f2f7c19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3613897783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f7c10a770 msgr2=0x7f2f7c19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f7c10a770 0x7f2f7c19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3613897783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101430 msgr2=0x7f2f7c196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101430 0x7f2f7c196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3613897783 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009d00 con 0x7f2f7c101d40 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.492+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101430 0x7f2f7c196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:29:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.493+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 0x7f2f7c196880 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800e9a0 tx=0x7f2f6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.493+0000 7f2f79ffb700 1 -- 172.21.15.35:0/3613897783 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68009790 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.493+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c1100b0 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.493+0000 7f2f79ffb700 1 -- 172.21.15.35:0/3613897783 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f68010430 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.493+0000 7f2f79ffb700 1 -- 172.21.15.35:0/3613897783 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800cea0 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.493+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c10ff20 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.495+0000 7f2f79ffb700 1 -- 172.21.15.35:0/3613897783 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2f680105a0 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.496+0000 7f2f79ffb700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f6c09f640 0x7f2f6c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.496+0000 7f2f79ffb700 1 -- 172.21.15.35:0/3613897783 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f68014070 con 0x7f2f7c101d40 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.496+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f6c09f640 0x7f2f6c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.496+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f6c09f640 0x7f2f6c0a1af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f70011490 tx=0x7f2f70009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 Processor -- start 2023-03-17T09:29:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 -- start start 2023-03-17T09:29:55.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1debbdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debb8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1debb8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1deabf010 con 0x55f1debb8960 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1deb11950 con 0x55f1debbe4f0 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.498+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1deb0ade0 con 0x55f1debbdbe0 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1debb8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1debb8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45420/0 (socket says 172.21.15.35:45420) 2023-03-17T09:29:56.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 -- 172.21.15.35:0/1676416019 learned_addr learned my addr 172.21.15.35:0/1676416019 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:29:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f80e69700 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1debbdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debb8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:29:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 -- 172.21.15.35:0/1676416019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 msgr2=0x55f1debbdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1debbdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 -- 172.21.15.35:0/1676416019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 msgr2=0x55f1debb8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debb8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 -- 172.21.15.35:0/1676416019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1de98c5d0 con 0x55f1debb8960 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f80e69700 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1debbdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f8166a700 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1debb8d90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400b0a0 tx=0x7f2f74009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daa3a816f26f714 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f66ffd700 1 -- 172.21.15.35:0/1676416019 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400e040 con 0x55f1debb8960 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f66ffd700 1 -- 172.21.15.35:0/1676416019 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f74007d90 con 0x55f1debb8960 2023-03-17T09:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.499+0000 7f2f66ffd700 1 -- 172.21.15.35:0/1676416019 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74003e00 con 0x55f1debb8960 2023-03-17T09:30:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/1676416019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 msgr2=0x55f1debb8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1debb8d90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400b0a0 tx=0x7f2f74009c40 comp rx=0 tx=0).stop 2023-03-17T09:30:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/1676416019 shutdown_connections 2023-03-17T09:30:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1debb8d90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1debbdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/1676416019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debb8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/1676416019 >> 172.21.15.35:0/1676416019 conn(0x55f1dea156b0 msgr2=0x55f1debb2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/1676416019 shutdown_connections 2023-03-17T09:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/1676416019 wait complete. 2023-03-17T09:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.500+0000 7f2f8f25ab80 1 -- start start 2023-03-17T09:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 Processor -- start 2023-03-17T09:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debb8960 0x55f1debc4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debc1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1de98e8c0 con 0x55f1debbdbe0 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debc23f0 con 0x55f1debbe4f0 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debcdfd0 con 0x55f1debb8960 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8f25ab80 10 client.0 _ll_register_callbacks cb 0x55f1de9b0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debc1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debc1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45422/0 (socket says 172.21.15.35:45422) 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3512806532 learned_addr learned my addr 172.21.15.35:0/3512806532 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f8166a700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.501+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debb8960 0x55f1debc4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3512806532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debb8960 msgr2=0x55f1debc4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debb8960 0x55f1debc4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 msgr2=0x55f1debc1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:01.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f7bfff700 1 -- 172.21.15.35:0/3512806532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c10d890 con 0x55f1debbdbe0 2023-03-17T09:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f8166a700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debc1690 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800c2d0 tx=0x7f2f68010970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d409a7bd3ba3df44 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f5bfff700 1 -- 172.21.15.35:0/3512806532 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6809c190 con 0x55f1debbdbe0 2023-03-17T09:30:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f5bfff700 1 -- 172.21.15.35:0/3512806532 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f680a0520 con 0x55f1debbdbe0 2023-03-17T09:30:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1deacd390 con 0x55f1debbdbe0 2023-03-17T09:30:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f5bfff700 1 -- 172.21.15.35:0/3512806532 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f680abbd0 con 0x55f1debbdbe0 2023-03-17T09:30:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f8f25ab80 10 client.16725 fetch_fsmap learned FSMap version 32 2023-03-17T09:30:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f1de938d80 con 0x55f1debbdbe0 2023-03-17T09:30:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f5bfff700 1 -- 172.21.15.35:0/3512806532 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f1deacd390 con 0x55f1debbdbe0 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.502+0000 7f2f5bfff700 1 -- 172.21.15.35:0/3512806532 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2f68094240 con 0x55f1debbdbe0 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f8f25ab80 10 client.16725 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f8f25ab80 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f8f25ab80 20 client.16725 populate_metadata read hostname 'smithi035' 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1debd20d0 0x55f1debd44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f8f25ab80 4 client.16725 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1dead9600 con 0x55f1debd20d0 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1debd20d0 0x55f1debd44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f5bfff700 10 client.16725 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:30:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.503+0000 7f2f80e69700 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1debd20d0 0x55f1debd44e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1468d08d0904c658 server_cookie=279fa423a52448b4 in_seq=0 out_seq=0 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f5bfff700 1 -- 172.21.15.35:0/3512806532 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f1dead9600 con 0x55f1debd20d0 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f5bfff700 10 client.16725 handle_command_reply: tid=0 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 client.16725 shutdown 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 msgr2=0x55f1debc1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debc1690 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800c2d0 tx=0x7f2f68010970 comp rx=0 tx=0).stop 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 shutdown_connections 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1debd20d0 0x55f1debd44e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debb8960 0x55f1debc4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:03.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f5bfff700 0 client.16725 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/3512806532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debc1690 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 >> 172.21.15.35:0/3512806532 conn(0x55f1dea156b0 msgr2=0x55f1debb2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 shutdown_connections 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.504+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/3512806532 wait complete. 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.505+0000 7f2f8f25ab80 20 client.16725 trim_cache size 0 max 16384 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.520+0000 7f2f8f25ab80 1 Processor -- start 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 -- start start 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debb8960 0x55f1debb8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debb2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbe4f0 0x55f1debba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:03.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1deacd390 con 0x55f1debbdbe0 2023-03-17T09:30:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debb3000 con 0x55f1debb8960 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debae0d0 con 0x55f1debbe4f0 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debb2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debb2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45432/0 (socket says 172.21.15.35:45432) 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 -- 172.21.15.35:0/2477898343 learned_addr learned my addr 172.21.15.35:0/2477898343 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f8166a700 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbe4f0 0x55f1debba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f80e69700 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debb8960 0x55f1debb8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 -- 172.21.15.35:0/2477898343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbe4f0 msgr2=0x55f1debba6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbe4f0 0x55f1debba6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 -- 172.21.15.35:0/2477898343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debb8960 msgr2=0x55f1debb8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debb8960 0x55f1debb8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.521+0000 7f2f7bfff700 1 -- 172.21.15.35:0/2477898343 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1dead1130 con 0x55f1debbdbe0 2023-03-17T09:30:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debb2ac0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2f680940b0 tx=0x7f2f68010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363288638668ddc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f677fe700 1 -- 172.21.15.35:0/2477898343 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6809c190 con 0x55f1debbdbe0 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f677fe700 1 -- 172.21.15.35:0/2477898343 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f68097330 con 0x55f1debbdbe0 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f677fe700 1 -- 172.21.15.35:0/2477898343 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680abbd0 con 0x55f1debbdbe0 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/2477898343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 msgr2=0x55f1debb2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debb2ac0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2f680940b0 tx=0x7f2f68010a70 comp rx=0 tx=0).stop 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/2477898343 shutdown_connections 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbe4f0 0x55f1debba6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debb8960 0x55f1debb8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/2477898343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debbdbe0 0x55f1debb2ac0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.522+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/2477898343 >> 172.21.15.35:0/2477898343 conn(0x55f1dea156b0 msgr2=0x55f1debbb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/2477898343 shutdown_connections 2023-03-17T09:30:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/2477898343 wait complete. 2023-03-17T09:30:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 -- start start 2023-03-17T09:30:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 Processor -- start 2023-03-17T09:30:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1dec1f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1dec1f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:05.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:42 smithi035 ceph-mon[92535]: pgmap v1128: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:30:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debc7440 con 0x55f1debb8960 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debc75b0 con 0x55f1debbe4f0 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1debc7770 con 0x55f1debbdbe0 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.523+0000 7f2f8f25ab80 10 client.0 _ll_register_callbacks cb 0x55f1de9b0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1dec1f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1dec1f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45436/0 (socket says 172.21.15.35:45436) 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 -- 172.21.15.35:0/682563321 learned_addr learned my addr 172.21.15.35:0/682563321 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1dec1f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f8166a700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 -- 172.21.15.35:0/682563321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 msgr2=0x55f1dec1f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1dec1f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 -- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 msgr2=0x55f1debc6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 -- 172.21.15.35:0/682563321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1de938d80 con 0x55f1debb8960 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f8166a700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f80e69700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1dec1f1a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2f70013010 tx=0x7f2f70013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e64229ea6c0a2f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f5bfff700 1 -- 172.21.15.35:0/682563321 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7002c040 con 0x55f1debb8960 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f5bfff700 1 -- 172.21.15.35:0/682563321 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f70023ce0 con 0x55f1debb8960 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.524+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1deb881e0 con 0x55f1debb8960 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f5bfff700 1 -- 172.21.15.35:0/682563321 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f70023ea0 con 0x55f1debb8960 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 10 client.16731 fetch_fsmap learned FSMap version 32 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f1de95f1f0 con 0x55f1debb8960 2023-03-17T09:30:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f5bfff700 1 -- 172.21.15.35:0/682563321 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f1deb881e0 con 0x55f1debb8960 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f5bfff700 1 -- 172.21.15.35:0/682563321 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2f70003b00 con 0x55f1debb8960 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 10 client.16731 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 10 client.16731 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 20 client.16731 populate_metadata read hostname 'smithi035' 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1dec26f40 0x55f1dec29350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 4 client.16731 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f1de98ef00 con 0x55f1dec26f40 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.525+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1dec26f40 0x55f1dec29350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.526+0000 7f2f5bfff700 10 client.16731 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.526+0000 7f2f7bfff700 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1dec26f40 0x55f1dec29350 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fdf115d9c5fea95 server_cookie=af8025224e0e24af in_seq=0 out_seq=0 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f5bfff700 1 -- 172.21.15.35:0/682563321 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f1de98ef00 con 0x55f1dec26f40 2023-03-17T09:30:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f5bfff700 10 client.16731 handle_command_reply: tid=0 2023-03-17T09:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 client.16731 shutdown 2023-03-17T09:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 msgr2=0x55f1dec1f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1dec1f1a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2f70013010 tx=0x7f2f70013040 comp rx=0 tx=0).stop 2023-03-17T09:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 shutdown_connections 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f1dec26f40 0x55f1dec29350 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1debbe4f0 0x55f1debc6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f1debb8960 0x55f1dec1f1a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 --2- 172.21.15.35:0/682563321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f1debbdbe0 0x55f1dec1f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 >> 172.21.15.35:0/682563321 conn(0x55f1dea156b0 msgr2=0x55f1debbe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f5bfff700 0 client.16731 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 shutdown_connections 2023-03-17T09:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 1 -- 172.21.15.35:0/682563321 wait complete. 2023-03-17T09:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.530+0000 7f2f8f25ab80 20 client.16731 trim_cache size 0 max 16384 2023-03-17T09:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f6c09f640 msgr2=0x7f2f6c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f6c09f640 0x7f2f6c0a1af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2f70011490 tx=0x7f2f70009260 comp rx=0 tx=0).stop 2023-03-17T09:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 msgr2=0x7f2f7c196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 0x7f2f7c196880 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800e9a0 tx=0x7f2f6800ecb0 comp rx=0 tx=0).stop 2023-03-17T09:30:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 shutdown_connections 2023-03-17T09:30:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f6c09f640 0x7f2f6c0a1af0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f7c10a770 0x7f2f7c19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f7c101430 0x7f2f7c196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 --2- 172.21.15.35:0/3613897783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f7c101d40 0x7f2f7c196880 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 >> 172.21.15.35:0/3613897783 conn(0x7f2f7c076330 msgr2=0x7f2f7c1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 shutdown_connections 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:08:48.531+0000 7f2f830cd700 1 -- 172.21.15.35:0/3613897783 wait complete. 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 -- 172.21.15.35:0/2397464508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c104390 msgr2=0x7fd64c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 --2- 172.21.15.35:0/2397464508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c104390 0x7fd64c10bf60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b0d0 tx=0x7fd64400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 -- 172.21.15.35:0/2397464508 shutdown_connections 2023-03-17T09:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 --2- 172.21.15.35:0/2397464508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c104390 0x7fd64c10bf60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 --2- 172.21.15.35:0/2397464508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0ff350 0x7fd64c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 --2- 172.21.15.35:0/2397464508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 -- 172.21.15.35:0/2397464508 >> 172.21.15.35:0/2397464508 conn(0x7fd64c076330 msgr2=0x7fd64c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 -- 172.21.15.35:0/2397464508 shutdown_connections 2023-03-17T09:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.654+0000 7fd652503700 1 -- 172.21.15.35:0/2397464508 wait complete. 2023-03-17T09:30:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 Processor -- start 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 -- start start 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0ff350 0x7fd64c100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c104390 0x7fd64c1a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c101ac0 con 0x7fd64c0ffcf0 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c1a4a70 con 0x7fd64c0ff350 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd652503700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c1a4bb0 con 0x7fd64c104390 2023-03-17T09:30:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45450/0 (socket says 172.21.15.35:45450) 2023-03-17T09:30:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3273370786 learned_addr learned my addr 172.21.15.35:0/3273370786 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd650aa0700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c104390 0x7fd64c1a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.655+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0ff350 0x7fd64c100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3273370786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c104390 msgr2=0x7fd64c1a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c104390 0x7fd64c1a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3273370786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0ff350 msgr2=0x7fd64c100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0ff350 0x7fd64c100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3273370786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644009d00 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c101290 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00d950 tx=0x7fd63c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd6497fa700 1 -- 172.21.15.35:0/3273370786 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00f890 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c10f010 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd6497fa700 1 -- 172.21.15.35:0/3273370786 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd63c00fe80 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd6497fa700 1 -- 172.21.15.35:0/3273370786 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c00e3b0 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.656+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c10ee80 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.659+0000 7fd6497fa700 1 -- 172.21.15.35:0/3273370786 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd63c00f9f0 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.659+0000 7fd6497fa700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd63409f640 0x7fd6340a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.660+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd63409f640 0x7fd6340a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.660+0000 7fd6497fa700 1 -- 172.21.15.35:0/3273370786 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd63c0ca0a0 con 0x7fd64c0ffcf0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.660+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd63409f640 0x7fd6340a1af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd640007be0 tx=0x7fd6400073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.660+0000 7fd65e690b80 1 Processor -- start 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 -- start start 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d16fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d11420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d11960 0x555825d11d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825c18010 con 0x555825d174f0 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825c6a950 con 0x555825d11960 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd65e690b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825c63de0 con 0x555825d16be0 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d11420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d11420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45458/0 (socket says 172.21.15.35:45458) 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3360648965 learned_addr learned my addr 172.21.15.35:0/3360648965 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d16fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd650aa0700 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d11960 0x555825d11d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3360648965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 msgr2=0x555825d16fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d16fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3360648965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d11960 msgr2=0x555825d11d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d11960 0x555825d11d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 -- 172.21.15.35:0/3360648965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555825ae55d0 con 0x555825d174f0 2023-03-17T09:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.661+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d11420 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0945c0 tx=0x7fd63c0974b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1eed73a075cbb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.662+0000 7fd6327fc700 1 -- 172.21.15.35:0/3360648965 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c09fd40 con 0x555825d174f0 2023-03-17T09:30:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.662+0000 7fd6327fc700 1 -- 172.21.15.35:0/3360648965 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd63c095ef0 con 0x555825d174f0 2023-03-17T09:30:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.662+0000 7fd6327fc700 1 -- 172.21.15.35:0/3360648965 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c097260 con 0x555825d174f0 2023-03-17T09:30:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.662+0000 7fd65e690b80 1 -- 172.21.15.35:0/3360648965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 msgr2=0x555825d11420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.662+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d11420 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0945c0 tx=0x7fd63c0974b0 comp rx=0 tx=0).stop 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.662+0000 7fd65e690b80 1 -- 172.21.15.35:0/3360648965 shutdown_connections 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d11960 0x555825d11d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d16fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3360648965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d11420 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 -- 172.21.15.35:0/3360648965 >> 172.21.15.35:0/3360648965 conn(0x555825b6e6b0 msgr2=0x555825d0ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 -- 172.21.15.35:0/3360648965 shutdown_connections 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 -- 172.21.15.35:0/3360648965 wait complete. 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 -- start start 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 Processor -- start 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.663+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d11960 0x555825d1d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d16be0 0x555825d1a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d1adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd65e690b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825ae78c0 con 0x555825d174f0 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd65e690b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d1b4f0 con 0x555825d16be0 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd65e690b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d26fa0 con 0x555825d11960 2023-03-17T09:30:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd65e690b80 10 client.0 _ll_register_callbacks cb 0x555825b09230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d1adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d1adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45464/0 (socket says 172.21.15.35:45464) 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 -- 172.21.15.35:0/1394039249 learned_addr learned my addr 172.21.15.35:0/1394039249 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d16be0 0x555825d1a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd64bfff700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d11960 0x555825d1d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 -- 172.21.15.35:0/1394039249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d11960 msgr2=0x555825d1d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d11960 0x555825d1d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 -- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d16be0 msgr2=0x555825d1a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d16be0 0x555825d1a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 -- 172.21.15.35:0/1394039249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c10ee80 con 0x555825d174f0 2023-03-17T09:30:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d16be0 0x555825d1a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:30:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd650aa0700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d1adb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd644009cd0 tx=0x7fd644007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171df543032cd6a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd62b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:30:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.664+0000 7fd62b7fe700 1 -- 172.21.15.35:0/1394039249 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64400e070 con 0x555825d174f0 2023-03-17T09:30:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd62b7fe700 1 -- 172.21.15.35:0/1394039249 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd644003e10 con 0x555825d174f0 2023-03-17T09:30:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555825c26390 con 0x555825d174f0 2023-03-17T09:30:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd62b7fe700 1 -- 172.21.15.35:0/1394039249 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd644007930 con 0x555825d174f0 2023-03-17T09:30:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 10 client.16743 fetch_fsmap learned FSMap version 32 2023-03-17T09:30:31.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x555825a91d80 con 0x555825d174f0 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:44 smithi035 ceph-mon[92535]: pgmap v1129: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:46 smithi035 ceph-mon[92535]: pgmap v1130: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:48 smithi035 ceph-mon[92535]: pgmap v1131: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:50 smithi035 ceph-mon[92535]: pgmap v1132: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:52 smithi035 ceph-mon[92535]: pgmap v1133: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:54 smithi035 ceph-mon[92535]: pgmap v1134: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:56 smithi035 ceph-mon[92535]: pgmap v1135: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:31.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:21:58 smithi035 ceph-mon[92535]: pgmap v1136: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:30:32.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:00 smithi035 ceph-mon[92535]: pgmap v1137: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:32.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:02 smithi035 ceph-mon[92535]: pgmap v1138: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:32.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:04 smithi035 ceph-mon[92535]: pgmap v1139: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:30:32.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:06 smithi035 ceph-mon[92535]: pgmap v1140: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:30:32.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:08 smithi035 ceph-mon[92535]: pgmap v1141: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:30:32.552 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:09 smithi035 ceph-mon[92535]: osdmap e148: 12 total, 12 up, 12 in 2023-03-17T09:30:33.692 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:10 smithi035 ceph-mon[92535]: pgmap v1143: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:30:33.692 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:12 smithi035 ceph-mon[92535]: pgmap v1144: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:30:34.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:30:35.747 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:14 smithi035 ceph-mon[92535]: pgmap v1145: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:16 smithi035 ceph-mon[92535]: osdmap e149: 12 total, 12 up, 12 in 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:16 smithi035 ceph-mon[92535]: pgmap v1147: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:18 smithi035 ceph-mon[92535]: pgmap v1148: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:20 smithi035 ceph-mon[92535]: pgmap v1149: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:22 smithi035 ceph-mon[92535]: pgmap v1150: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:30:35.748 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:24 smithi035 ceph-mon[92535]: pgmap v1151: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:26 smithi035 ceph-mon[92535]: pgmap v1152: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:28 smithi035 ceph-mon[92535]: pgmap v1153: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:30 smithi035 ceph-mon[92535]: pgmap v1154: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:32 smithi035 ceph-mon[92535]: pgmap v1155: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:34 smithi035 ceph-mon[92535]: pgmap v1156: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:36 smithi035 ceph-mon[92535]: pgmap v1157: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:30:37.666 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:38 smithi035 ceph-mon[92535]: pgmap v1158: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:30:38.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:38 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1078072470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T09:30:38.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:40 smithi035 ceph-mon[92535]: pgmap v1159: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:30:38.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:42 smithi035 ceph-mon[92535]: pgmap v1160: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:30:38.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:44 smithi035 ceph-mon[92535]: pgmap v1161: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:30:38.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:46 smithi035 ceph-mon[92535]: pgmap v1162: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:48 smithi035 ceph-mon[92535]: pgmap v1163: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:50 smithi035 ceph-mon[92535]: pgmap v1164: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:52 smithi035 ceph-mon[92535]: pgmap v1165: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:54 smithi035 ceph-mon[92535]: pgmap v1166: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:56 smithi035 ceph-mon[92535]: pgmap v1167: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:22:58 smithi035 ceph-mon[92535]: pgmap v1168: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:00 smithi035 ceph-mon[92535]: pgmap v1169: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:30:38.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:02 smithi035 ceph-mon[92535]: pgmap v1170: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:30:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:30:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:30:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:30:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:30:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:30:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:30:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd62b7fe700 1 -- 172.21.15.35:0/1394039249 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555825c26390 con 0x555825d174f0 2023-03-17T09:30:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd62b7fe700 1 -- 172.21.15.35:0/1394039249 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd644019030 con 0x555825d174f0 2023-03-17T09:30:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 10 client.16743 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:30:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 10 client.16743 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:30:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 20 client.16743 populate_metadata read hostname 'smithi035' 2023-03-17T09:30:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d2b060 0x555825d2d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 4 client.16743 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.665+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555825c32600 con 0x555825d2b060 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.666+0000 7fd64bfff700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d2b060 0x555825d2d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.666+0000 7fd62b7fe700 10 client.16743 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.666+0000 7fd64bfff700 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d2b060 0x555825d2d470 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69b936bcd68dfcad server_cookie=5fb6cdb0361a2f4c in_seq=0 out_seq=0 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd62b7fe700 1 -- 172.21.15.35:0/1394039249 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555825c32600 con 0x555825d2b060 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd62b7fe700 10 client.16743 handle_command_reply: tid=0 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 client.16743 shutdown 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 msgr2=0x555825d1adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d1adb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd644009cd0 tx=0x7fd644007710 comp rx=0 tx=0).stop 2023-03-17T09:30:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 shutdown_connections 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d2b060 0x555825d2d470 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d174f0 0x555825d1adb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd62b7fe700 0 client.16743 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d11960 0x555825d1d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 --2- 172.21.15.35:0/1394039249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d16be0 0x555825d1a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 >> 172.21.15.35:0/1394039249 conn(0x555825b6e6b0 msgr2=0x555825d10410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 shutdown_connections 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 1 -- 172.21.15.35:0/1394039249 wait complete. 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.667+0000 7fd65e690b80 20 client.16743 trim_cache size 0 max 16384 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.682+0000 7fd65e690b80 1 Processor -- start 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.682+0000 7fd65e690b80 1 -- start start 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d0bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d10a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd65e690b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d1b680 con 0x555825d11960 2023-03-17T09:30:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd65e690b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d085c0 con 0x555825d174f0 2023-03-17T09:30:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd65e690b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d0c380 con 0x555825d16be0 2023-03-17T09:30:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d0bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d0bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45468/0 (socket says 172.21.15.35:45468) 2023-03-17T09:30:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 -- 172.21.15.35:0/3492562581 learned_addr learned my addr 172.21.15.35:0/3492562581 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd650aa0700 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d10a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 -- 172.21.15.35:0/3492562581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 msgr2=0x555825d21ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d21ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 -- 172.21.15.35:0/3492562581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 msgr2=0x555825d10a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d10a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 -- 172.21.15.35:0/3492562581 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555825d12000 con 0x555825d11960 2023-03-17T09:30:47.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.683+0000 7fd64bfff700 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d0bac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x555825d2dd80 tx=0x7fd640013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1351a6e6de02c93e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:47.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd632ffd700 1 -- 172.21.15.35:0/3492562581 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640004590 con 0x555825d11960 2023-03-17T09:30:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd632ffd700 1 -- 172.21.15.35:0/3492562581 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd6400275c0 con 0x555825d11960 2023-03-17T09:30:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd632ffd700 1 -- 172.21.15.35:0/3492562581 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400038e0 con 0x555825d11960 2023-03-17T09:30:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 -- 172.21.15.35:0/3492562581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 msgr2=0x555825d0bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:30:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d0bac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x555825d2dd80 tx=0x7fd640013000 comp rx=0 tx=0).stop 2023-03-17T09:30:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 -- 172.21.15.35:0/3492562581 shutdown_connections 2023-03-17T09:30:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d10a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d0bac0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 --2- 172.21.15.35:0/3492562581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d21ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:50.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 -- 172.21.15.35:0/3492562581 >> 172.21.15.35:0/3492562581 conn(0x555825b6e6b0 msgr2=0x555825d26680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 -- 172.21.15.35:0/3492562581 shutdown_connections 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.684+0000 7fd65e690b80 1 -- 172.21.15.35:0/3492562581 wait complete. 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 -- start start 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 Processor -- start 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d72e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d735a0 con 0x555825d11960 2023-03-17T09:30:50.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d73710 con 0x555825d174f0 2023-03-17T09:30:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555825d738d0 con 0x555825d16be0 2023-03-17T09:30:50.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.685+0000 7fd65e690b80 10 client.0 _ll_register_callbacks cb 0x555825b09230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:30:52.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:52.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45474/0 (socket says 172.21.15.35:45474) 2023-03-17T09:30:52.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 -- 172.21.15.35:0/29172672 learned_addr learned my addr 172.21.15.35:0/29172672 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:30:52.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:52.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd650aa0700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d72e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:30:52.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 -- 172.21.15.35:0/29172672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 msgr2=0x555825d777e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d777e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 -- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 msgr2=0x555825d72e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:30:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d72e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:30:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 -- 172.21.15.35:0/29172672 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd640010ac0 con 0x555825d11960 2023-03-17T09:30:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd64bfff700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d772a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd640005cb0 tx=0x7fd640028e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df936d30918118fd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:30:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.686+0000 7fd62b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:30:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd62b7fe700 1 -- 172.21.15.35:0/29172672 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640027970 con 0x555825d11960 2023-03-17T09:30:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd62b7fe700 1 -- 172.21.15.35:0/29172672 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd640017040 con 0x555825d11960 2023-03-17T09:30:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555825ce11e0 con 0x555825d11960 2023-03-17T09:30:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd62b7fe700 1 -- 172.21.15.35:0/29172672 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd640027130 con 0x555825d11960 2023-03-17T09:30:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 10 client.16749 fetch_fsmap learned FSMap version 32 2023-03-17T09:30:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x555825a7ac00 con 0x555825d11960 2023-03-17T09:30:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd62b7fe700 1 -- 172.21.15.35:0/29172672 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555825ce11e0 con 0x555825d11960 2023-03-17T09:30:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd62b7fe700 1 -- 172.21.15.35:0/29172672 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 32) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd6400048e0 con 0x555825d11960 2023-03-17T09:30:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 10 client.16749 fetch_fsmap finished waiting for FSMap version 32 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 10 client.16749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 20 client.16749 populate_metadata read hostname 'smithi035' 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d80010 0x555825d823f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 4 client.16749 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555825ae7f00 con 0x555825d80010 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.687+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d80010 0x555825d823f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:01.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.688+0000 7fd62b7fe700 10 client.16749 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:01.688+0000 7fd64b7fe700 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d80010 0x555825d823f0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=562b990cb7ed43bf server_cookie=f7143d274728b37f in_seq=0 out_seq=0 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.231+0000 7fd62b7fe700 1 -- 172.21.15.35:0/29172672 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555825ae7f00 con 0x555825d80010 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.231+0000 7fd62b7fe700 10 client.16749 handle_command_reply: tid=0 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.231+0000 7fd65e690b80 1 client.16749 shutdown 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 msgr2=0x555825d772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d772a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd640005cb0 tx=0x7fd640028e80 comp rx=0 tx=0).stop 2023-03-17T09:31:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 shutdown_connections 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555825d80010 0x555825d823f0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555825d174f0 0x555825d72e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555825d11960 0x555825d772a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd62b7fe700 0 client.16749 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 --2- 172.21.15.35:0/29172672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555825d16be0 0x555825d777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 >> 172.21.15.35:0/29172672 conn(0x555825b6e6b0 msgr2=0x555825d10a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 shutdown_connections 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 1 -- 172.21.15.35:0/29172672 wait complete. 2023-03-17T09:31:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.232+0000 7fd65e690b80 20 client.16749 trim_cache size 0 max 16384 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd63409f640 msgr2=0x7fd6340a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd63409f640 0x7fd6340a1af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd640007be0 tx=0x7fd6400073d0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 msgr2=0x7fd64c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c101290 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00d950 tx=0x7fd63c00dc60 comp rx=0 tx=0).stop 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 shutdown_connections 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd63409f640 0x7fd6340a1af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd64c104390 0x7fd64c1a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd64c0ff350 0x7fd64c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 --2- 172.21.15.35:0/3273370786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd64c0ffcf0 0x7fd64c101290 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 >> 172.21.15.35:0/3273370786 conn(0x7fd64c076330 msgr2=0x7fd64c102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 shutdown_connections 2023-03-17T09:31:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:03.233+0000 7fd652503700 1 -- 172.21.15.35:0/3273370786 wait complete. 2023-03-17T09:31:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.359+0000 7f0b318ae700 1 -- 172.21.15.35:0/2513072284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ffd70 msgr2=0x7f0b2c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.359+0000 7f0b318ae700 1 --2- 172.21.15.35:0/2513072284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c103d30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0099c0 tx=0x7f0b1c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:31:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.359+0000 7f0b318ae700 1 -- 172.21.15.35:0/2513072284 shutdown_connections 2023-03-17T09:31:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.359+0000 7f0b318ae700 1 --2- 172.21.15.35:0/2513072284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c104410 0x7f0b2c10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 --2- 172.21.15.35:0/2513072284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:04.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 --2- 172.21.15.35:0/2513072284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c103d30 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 -- 172.21.15.35:0/2513072284 >> 172.21.15.35:0/2513072284 conn(0x7f0b2c076f80 msgr2=0x7f0b2c077380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 -- 172.21.15.35:0/2513072284 shutdown_connections 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 -- 172.21.15.35:0/2513072284 wait complete. 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 Processor -- start 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.360+0000 7f0b318ae700 1 -- start start 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:04.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c104410 0x7f0b2c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c19b2a0 con 0x7f0b2c0ff3d0 2023-03-17T09:31:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c19b410 con 0x7f0b2c0ffd70 2023-03-17T09:31:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c19b5d0 con 0x7f0b2c104410 2023-03-17T09:31:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c1962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45488/0 (socket says 172.21.15.35:45488) 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 -- 172.21.15.35:0/3831033913 learned_addr learned my addr 172.21.15.35:0/3831033913 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2b7fe700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c104410 0x7f0b2c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 -- 172.21.15.35:0/3831033913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c104410 msgr2=0x7f0b2c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c104410 0x7f0b2c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 -- 172.21.15.35:0/3831033913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c0ffd70 msgr2=0x7f0b2c196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 -- 172.21.15.35:0/3831033913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0095f0 con 0x7f0b2c0ff3d0 2023-03-17T09:31:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:31:05.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b2affd700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c1962c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000e9a0 tx=0x7f0b2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b308ac700 1 -- 172.21.15.35:0/3831033913 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20009790 con 0x7f0b2c0ff3d0 2023-03-17T09:31:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b308ac700 1 -- 172.21.15.35:0/3831033913 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b2000cbd0 con 0x7f0b2c0ff3d0 2023-03-17T09:31:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c10f090 con 0x7f0b2c0ff3d0 2023-03-17T09:31:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b308ac700 1 -- 172.21.15.35:0/3831033913 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20018680 con 0x7f0b2c0ff3d0 2023-03-17T09:31:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.361+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c10ef00 con 0x7f0b2c0ff3d0 2023-03-17T09:31:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.364+0000 7f0b308ac700 1 -- 172.21.15.35:0/3831033913 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f0b2000cd40 con 0x7f0b2c0ff3d0 2023-03-17T09:31:08.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.364+0000 7f0b308ac700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0b1409f6c0 0x7f0b140a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.365+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0b1409f6c0 0x7f0b140a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.365+0000 7f0b308ac700 1 -- 172.21.15.35:0/3831033913 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f0b20014070 con 0x7f0b2c0ff3d0 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.365+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0b1409f6c0 0x7f0b140a1b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009990 tx=0x7f0b1c01a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.365+0000 7f0b3da3bb80 1 Processor -- start 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.365+0000 7f0b3da3bb80 1 -- start start 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d36ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d36a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:08.895 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T09:31:12.064 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T09:21:20.417538+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14487":{"gid":14487,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6837/623104731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":623104731},{"type":"v1","addr":"172.21.15.35:6837","nonce":623104731}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T09:31:12.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 -- 172.21.15.35:0/2941107031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf5410a810 msgr2=0x7fcf5410cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:13.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 --2- 172.21.15.35:0/2941107031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf5410a810 0x7fcf5410cc30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00b0a0 tx=0x7fcf4c00b3b0 comp rx=0 tx=0).stop 2023-03-17T09:31:13.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 -- 172.21.15.35:0/2941107031 shutdown_connections 2023-03-17T09:31:13.405 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 --2- 172.21.15.35:0/2941107031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf5410a810 0x7fcf5410cc30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:14.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 --2- 172.21.15.35:0/2941107031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf541012f0 0x7fcf541016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:14.776 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 --2- 172.21.15.35:0/2941107031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf54101c00 0x7fcf5410a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:14.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 -- 172.21.15.35:0/2941107031 >> 172.21.15.35:0/2941107031 conn(0x7fcf54075f50 msgr2=0x7fcf54076350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:15.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 -- 172.21.15.35:0/2941107031 shutdown_connections 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 -- 172.21.15.35:0/2941107031 wait complete. 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.071+0000 7fcf5986c700 1 Processor -- start 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 -- start start 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf541012f0 0x7fcf54196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 0x7fcf541968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf5410a810 0x7fcf5419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5419b340 con 0x7fcf54101c00 2023-03-17T09:31:15.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5419b4b0 con 0x7fcf541012f0 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf5986c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5419b670 con 0x7fcf5410a810 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 0x7fcf541968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 0x7fcf541968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46672/0 (socket says 172.21.15.35:46672) 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 -- 172.21.15.35:0/1078072470 learned_addr learned my addr 172.21.15.35:0/1078072470 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf52ffd700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf541012f0 0x7fcf54196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf537fe700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf5410a810 0x7fcf5419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:16.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 -- 172.21.15.35:0/1078072470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf5410a810 msgr2=0x7fcf5419ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf5410a810 0x7fcf5419ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 -- 172.21.15.35:0/1078072470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf541012f0 msgr2=0x7fcf54196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf541012f0 0x7fcf54196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 -- 172.21.15.35:0/1078072470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c009d00 con 0x7fcf54101c00 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.072+0000 7fcf527fc700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 0x7fcf541968a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800d950 tx=0x7fcf4800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.073+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48009940 con 0x7fcf54101c00 2023-03-17T09:31:16.816 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.073+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf48010460 con 0x7fcf54101c00 2023-03-17T09:31:17.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.073+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf54110150 con 0x7fcf54101c00 2023-03-17T09:31:17.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.073+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800f620 con 0x7fcf54101c00 2023-03-17T09:31:18.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.073+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5410ffc0 con 0x7fcf54101c00 2023-03-17T09:31:18.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.074+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf54067dc0 con 0x7fcf54101c00 2023-03-17T09:31:18.557 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.075+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcf480105d0 con 0x7fcf54101c00 2023-03-17T09:31:18.557 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.075+0000 7fcf5886a700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf3c09f640 0x7fcf3c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:18.557 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.076+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcf480ca430 con 0x7fcf54101c00 2023-03-17T09:31:19.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.076+0000 7fcf52ffd700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf3c09f640 0x7fcf3c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:19.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.076+0000 7fcf52ffd700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf3c09f640 0x7fcf3c0a1af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf44007be0 tx=0x7fcf440073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.080+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fcf480941c0 con 0x7fcf54101c00 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.326+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf54068740 con 0x7fcf54101c00 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.327+0000 7fcf5886a700 1 -- 172.21.15.35:0/1078072470 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+10085 (secure 0 0 0) 0x7fcf48020090 con 0x7fcf54101c00 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.328+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf3c09f640 msgr2=0x7fcf3c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf3c09f640 0x7fcf3c0a1af0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf44007be0 tx=0x7fcf440073d0 comp rx=0 tx=0).stop 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 msgr2=0x7fcf541968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 0x7fcf541968a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800d950 tx=0x7fcf4800dc60 comp rx=0 tx=0).stop 2023-03-17T09:31:19.116 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 shutdown_connections 2023-03-17T09:31:19.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf3c09f640 0x7fcf3c0a1af0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:19.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf5410a810 0x7fcf5419ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:20.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf541012f0 0x7fcf54196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:20.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 --2- 172.21.15.35:0/1078072470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf54101c00 0x7fcf541968a0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:21.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 >> 172.21.15.35:0/1078072470 conn(0x7fcf54075f50 msgr2=0x7fcf5410b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:21.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 shutdown_connections 2023-03-17T09:31:21.148 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:22:38.329+0000 7fcf5986c700 1 -- 172.21.15.35:0/1078072470 wait complete. 2023-03-17T09:31:21.148 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 36 2023-03-17T09:31:21.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:04 smithi035 ceph-mon[92535]: pgmap v1171: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:31:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36a960 0x55d78d36ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d271010 con 0x55d78d36fbe0 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d2c3950 con 0x55d78d3704f0 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d2bcde0 con 0x55d78d36a960 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d36ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d36ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45496/0 (socket says 172.21.15.35:45496) 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 -- 172.21.15.35:0/2042836400 learned_addr learned my addr 172.21.15.35:0/2042836400 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2b7fe700 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36a960 0x55d78d36ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:22.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d36a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:22.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 -- 172.21.15.35:0/2042836400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36a960 msgr2=0x55d78d36ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36a960 0x55d78d36ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 -- 172.21.15.35:0/2042836400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 msgr2=0x55d78d36a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d36a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 -- 172.21.15.35:0/2042836400 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d78d13e5d0 con 0x55d78d36fbe0 2023-03-17T09:31:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b2affd700 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d36ffb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0b20094930 tx=0x7f0b20097f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04991a4daceeed6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b11ffb700 1 -- 172.21.15.35:0/2042836400 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200a0620 con 0x55d78d36fbe0 2023-03-17T09:31:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b11ffb700 1 -- 172.21.15.35:0/2042836400 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b200967d0 con 0x55d78d36fbe0 2023-03-17T09:31:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.366+0000 7f0b11ffb700 1 -- 172.21.15.35:0/2042836400 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200a0190 con 0x55d78d36fbe0 2023-03-17T09:31:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/2042836400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 msgr2=0x55d78d36ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d36ffb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0b20094930 tx=0x7f0b20097f70 comp rx=0 tx=0).stop 2023-03-17T09:31:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/2042836400 shutdown_connections 2023-03-17T09:31:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36a960 0x55d78d36ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d36ffb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/2042836400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d36a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/2042836400 >> 172.21.15.35:0/2042836400 conn(0x55d78d1c76b0 msgr2=0x55d78d364a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/2042836400 shutdown_connections 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/2042836400 wait complete. 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.367+0000 7f0b3da3bb80 1 -- start start 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 Processor -- start 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d376520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36fbe0 0x55d78d373730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d373e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d1408c0 con 0x55d78d36a960 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d3745b0 con 0x55d78d36fbe0 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d37ffa0 con 0x55d78d3704f0 2023-03-17T09:31:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b3da3bb80 10 client.0 _ll_register_callbacks cb 0x55d78d162230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d376520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d376520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45502/0 (socket says 172.21.15.35:45502) 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b2affd700 1 -- 172.21.15.35:0/4263503909 learned_addr learned my addr 172.21.15.35:0/4263503909 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36fbe0 0x55d78d373730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.368+0000 7f0b2b7fe700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d373e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/4263503909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 msgr2=0x55d78d373e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d373e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/4263503909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 msgr2=0x55d78d376520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d376520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/4263503909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c10ef00 con 0x55d78d36fbe0 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36fbe0 0x55d78d373730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009fd0 tx=0x7f0b1c009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db81df78e8e8f5a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b0affd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b0affd700 1 -- 172.21.15.35:0/4263503909 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c02a050 con 0x55d78d36fbe0 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d78d27f390 con 0x55d78d36fbe0 2023-03-17T09:31:25.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b0affd700 1 -- 172.21.15.35:0/4263503909 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f0b1c00f460 con 0x55d78d36fbe0 2023-03-17T09:31:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b0affd700 1 -- 172.21.15.35:0/4263503909 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b1c01d040 con 0x55d78d36fbe0 2023-03-17T09:31:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b3da3bb80 10 client.26363 fetch_fsmap learned FSMap version 33 2023-03-17T09:31:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.369+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d78d0ead80 con 0x55d78d36fbe0 2023-03-17T09:31:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b0affd700 1 -- 172.21.15.35:0/4263503909 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d78d27f390 con 0x55d78d36fbe0 2023-03-17T09:31:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b0affd700 1 -- 172.21.15.35:0/4263503909 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0b1c02f490 con 0x55d78d36fbe0 2023-03-17T09:31:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b3da3bb80 10 client.26363 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:31:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b3da3bb80 10 client.26363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:31:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b3da3bb80 20 client.26363 populate_metadata read hostname 'smithi035' 2023-03-17T09:31:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3840b0 0x55d78d3864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b3da3bb80 4 client.26363 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:31:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d78d28b600 con 0x55d78d3840b0 2023-03-17T09:31:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b2affd700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3840b0 0x55d78d3864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b0affd700 10 client.26363 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.370+0000 7f0b2affd700 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3840b0 0x55d78d3864c0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5fec2cad955ac16 server_cookie=1f1ed19cc42c4ff5 in_seq=0 out_seq=0 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b0affd700 1 -- 172.21.15.35:0/4263503909 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d78d28b600 con 0x55d78d3840b0 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b0affd700 10 client.26363 handle_command_reply: tid=0 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 client.26363 shutdown 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36fbe0 msgr2=0x55d78d373730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36fbe0 0x55d78d373730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009fd0 tx=0x7f0b1c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 shutdown_connections 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3840b0 0x55d78d3864c0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d373e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d376520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b0affd700 0 client.26363 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/4263503909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36fbe0 0x55d78d373730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 >> 172.21.15.35:0/4263503909 conn(0x55d78d1c76b0 msgr2=0x55d78d369410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 shutdown_connections 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.371+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/4263503909 wait complete. 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.372+0000 7f0b3da3bb80 20 client.26363 trim_cache size 0 max 16384 2023-03-17T09:31:27.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.386+0000 7f0b3da3bb80 1 Processor -- start 2023-03-17T09:31:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.386+0000 7f0b3da3bb80 1 -- start start 2023-03-17T09:31:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36a960 0x55d78d364ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d37aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d376050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d381810 con 0x55d78d36fbe0 2023-03-17T09:31:28.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d3600f0 con 0x55d78d36a960 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d365000 con 0x55d78d3704f0 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d37aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d37aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45512/0 (socket says 172.21.15.35:45512) 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/1085872514 learned_addr learned my addr 172.21.15.35:0/1085872514 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2b7fe700 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d376050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2affd700 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36a960 0x55d78d364ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/1085872514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 msgr2=0x55d78d376050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d376050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/1085872514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36a960 msgr2=0x55d78d364ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36a960 0x55d78d364ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 -- 172.21.15.35:0/1085872514 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d78d283130 con 0x55d78d36fbe0 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2affd700 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36a960 0x55d78d364ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d37aef0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0098e0 tx=0x7f0b1c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc109a0b7be73e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b127fc700 1 -- 172.21.15.35:0/1085872514 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c01d050 con 0x55d78d36fbe0 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b127fc700 1 -- 172.21.15.35:0/1085872514 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b1c02b040 con 0x55d78d36fbe0 2023-03-17T09:31:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.387+0000 7f0b127fc700 1 -- 172.21.15.35:0/1085872514 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c02a040 con 0x55d78d36fbe0 2023-03-17T09:31:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1085872514 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 msgr2=0x55d78d37aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d37aef0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0098e0 tx=0x7f0b1c00bf20 comp rx=0 tx=0).stop 2023-03-17T09:31:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1085872514 shutdown_connections 2023-03-17T09:31:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d3704f0 0x55d78d376050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d36a960 0x55d78d364ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1085872514 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36fbe0 0x55d78d37aef0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1085872514 >> 172.21.15.35:0/1085872514 conn(0x55d78d1c76b0 msgr2=0x55d78d369a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1085872514 shutdown_connections 2023-03-17T09:31:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1085872514 wait complete. 2023-03-17T09:31:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.388+0000 7f0b3da3bb80 1 -- start start 2023-03-17T09:31:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 Processor -- start 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d3d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36fbe0 0x55d78d3d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d378ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d3794a0 con 0x55d78d36a960 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d379610 con 0x55d78d3704f0 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78d3797d0 con 0x55d78d36fbe0 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b3da3bb80 10 client.0 _ll_register_callbacks cb 0x55d78d162230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d3d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d3d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45516/0 (socket says 172.21.15.35:45516) 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 -- 172.21.15.35:0/1152951254 learned_addr learned my addr 172.21.15.35:0/1152951254 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2b7fe700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d378ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36fbe0 0x55d78d3d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 -- 172.21.15.35:0/1152951254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36fbe0 msgr2=0x55d78d3d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36fbe0 0x55d78d3d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 -- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 msgr2=0x55d78d378ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d378ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 -- 172.21.15.35:0/1152951254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d78d0ead80 con 0x55d78d36a960 2023-03-17T09:31:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2b7fe700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d378ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:31:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b2affd700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d3d1250 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0b200c8690 tx=0x7f0b20010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce567cd7e70f8da server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.389+0000 7f0b0affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:31:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b0affd700 1 -- 172.21.15.35:0/1152951254 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200a06a0 con 0x55d78d36a960 2023-03-17T09:31:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b0affd700 1 -- 172.21.15.35:0/1152951254 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f0b20098690 con 0x55d78d36a960 2023-03-17T09:31:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d78d33a1e0 con 0x55d78d36a960 2023-03-17T09:31:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b0affd700 1 -- 172.21.15.35:0/1152951254 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b20098850 con 0x55d78d36a960 2023-03-17T09:31:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 10 client.16767 fetch_fsmap learned FSMap version 33 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d78d1111f0 con 0x55d78d36a960 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b0affd700 1 -- 172.21.15.35:0/1152951254 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d78d33a1e0 con 0x55d78d36a960 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b0affd700 1 -- 172.21.15.35:0/1152951254 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0b200a0190 con 0x55d78d36a960 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 10 client.16767 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 20 client.16767 populate_metadata read hostname 'smithi035' 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3d8db0 0x55d78d3db1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 4 client.16767 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d78d140f00 con 0x55d78d3d8db0 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.390+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3d8db0 0x55d78d3db1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.391+0000 7f0b0affd700 10 client.16767 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.391+0000 7f0b2a7fc700 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3d8db0 0x55d78d3db1c0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8bbebb7cff4b9fe server_cookie=950fc5c928c76b8b in_seq=0 out_seq=0 2023-03-17T09:31:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b0affd700 1 -- 172.21.15.35:0/1152951254 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d78d140f00 con 0x55d78d3d8db0 2023-03-17T09:31:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b0affd700 10 client.16767 handle_command_reply: tid=0 2023-03-17T09:31:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 client.16767 shutdown 2023-03-17T09:31:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 msgr2=0x55d78d3d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d3d1250 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0b200c8690 tx=0x7f0b20010960 comp rx=0 tx=0).stop 2023-03-17T09:31:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 shutdown_connections 2023-03-17T09:31:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d78d3d8db0 0x55d78d3db1c0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d78d3704f0 0x55d78d378ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b0affd700 0 client.16767 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d78d36a960 0x55d78d3d1250 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 --2- 172.21.15.35:0/1152951254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d78d36fbe0 0x55d78d3d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 >> 172.21.15.35:0/1152951254 conn(0x55d78d1c76b0 msgr2=0x55d78d36d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:34.362 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-03-17T09:31:35.531 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:06 smithi035 ceph-mon[92535]: pgmap v1172: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:31:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 shutdown_connections 2023-03-17T09:31:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 1 -- 172.21.15.35:0/1152951254 wait complete. 2023-03-17T09:31:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.398+0000 7f0b3da3bb80 20 client.16767 trim_cache size 0 max 16384 2023-03-17T09:31:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0b1409f6c0 msgr2=0x7f0b140a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0b1409f6c0 0x7f0b140a1b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009990 tx=0x7f0b1c01a040 comp rx=0 tx=0).stop 2023-03-17T09:31:37.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 msgr2=0x7f0b2c1962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c1962c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000e9a0 tx=0x7f0b2000ecb0 comp rx=0 tx=0).stop 2023-03-17T09:31:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 shutdown_connections 2023-03-17T09:31:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0b1409f6c0 0x7f0b140a1b70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b2c104410 0x7f0b2c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0b2c0ff3d0 0x7f0b2c1962c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 --2- 172.21.15.35:0/3831033913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b2c0ffd70 0x7f0b2c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 >> 172.21.15.35:0/3831033913 conn(0x7f0b2c076f80 msgr2=0x7f0b2c069340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 shutdown_connections 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:16.399+0000 7f0b318ae700 1 -- 172.21.15.35:0/3831033913 wait complete. 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.519+0000 7fe43520c700 1 -- 172.21.15.35:0/470747029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4300ff350 msgr2=0x7fe4300ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.519+0000 7fe43520c700 1 --2- 172.21.15.35:0/470747029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4300ff350 0x7fe4300ff720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe4200099c0 tx=0x7fe420009cd0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 -- 172.21.15.35:0/470747029 shutdown_connections 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 --2- 172.21.15.35:0/470747029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe430104390 0x7fe43010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 --2- 172.21.15.35:0/470747029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4300ff350 0x7fe4300ff720 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 --2- 172.21.15.35:0/470747029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4300ffcf0 0x7fe430103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 -- 172.21.15.35:0/470747029 >> 172.21.15.35:0/470747029 conn(0x7fe430076330 msgr2=0x7fe430076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 -- 172.21.15.35:0/470747029 shutdown_connections 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 -- 172.21.15.35:0/470747029 wait complete. 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.520+0000 7fe43520c700 1 Processor -- start 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 -- start start 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4300ff350 0x7fe430196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4300ffcf0 0x7fe430196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 0x7fe43019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43019b310 con 0x7fe430104390 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43019b480 con 0x7fe4300ff350 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe43520c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43019b640 con 0x7fe4300ffcf0 2023-03-17T09:31:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 0x7fe43019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:40.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 0x7fe43019acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45532/0 (socket says 172.21.15.35:45532) 2023-03-17T09:31:40.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 -- 172.21.15.35:0/2117993804 learned_addr learned my addr 172.21.15.35:0/2117993804 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:40.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4300ff350 0x7fe430196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:40.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42e59c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4300ffcf0 0x7fe430196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 -- 172.21.15.35:0/2117993804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4300ffcf0 msgr2=0x7fe430196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4300ffcf0 0x7fe430196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 -- 172.21.15.35:0/2117993804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4300ff350 msgr2=0x7fe430196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4300ff350 0x7fe430196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42f59e700 1 -- 172.21.15.35:0/2117993804 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200095f0 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.521+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4300ff350 0x7fe430196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.522+0000 7fe42f59e700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 0x7fe43019acd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe428007ee0 tx=0x7fe42800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.522+0000 7fe417fff700 1 -- 172.21.15.35:0/2117993804 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428017070 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.522+0000 7fe417fff700 1 -- 172.21.15.35:0/2117993804 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe42800f040 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.522+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43010f050 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.522+0000 7fe417fff700 1 -- 172.21.15.35:0/2117993804 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428005710 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.522+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43010eec0 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.524+0000 7fe417fff700 1 -- 172.21.15.35:0/2117993804 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe428005870 con 0x7fe430104390 2023-03-17T09:31:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.525+0000 7fe417fff700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe41809f6c0 0x7fe4180a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.525+0000 7fe417fff700 1 -- 172.21.15.35:0/2117993804 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fe4280c9d60 con 0x7fe430104390 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.525+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe41809f6c0 0x7fe4180a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.525+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe41809f6c0 0x7fe4180a1b70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe4200036c0 tx=0x7fe420005e80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 Processor -- start 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 -- start start 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb66d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbda6d010 con 0x55fcbdb6bbe0 2023-03-17T09:31:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdabf950 con 0x55fcbdb66960 2023-03-17T09:31:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe441399b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdab8de0 con 0x55fcbdb6c4f0 2023-03-17T09:31:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45538/0 (socket says 172.21.15.35:45538) 2023-03-17T09:31:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 -- 172.21.15.35:0/2550371436 learned_addr learned my addr 172.21.15.35:0/2550371436 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42e59c700 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42f59e700 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb66d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:42.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 -- 172.21.15.35:0/2550371436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 msgr2=0x55fcbdb66420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb66420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 -- 172.21.15.35:0/2550371436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 msgr2=0x55fcbdb66d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb66d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42ed9d700 1 -- 172.21.15.35:0/2550371436 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcbd93a5d0 con 0x55fcbdb6bbe0 2023-03-17T09:31:42.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.526+0000 7fe42e59c700 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb66420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:31:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6bfb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe4200099c0 tx=0x7fe42001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f3abeec76c0fde server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe4157fa700 1 -- 172.21.15.35:0/2550371436 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42002b070 con 0x55fcbdb6bbe0 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe4157fa700 1 -- 172.21.15.35:0/2550371436 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe42001e040 con 0x55fcbdb6bbe0 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe4157fa700 1 -- 172.21.15.35:0/2550371436 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420004c10 con 0x55fcbdb6bbe0 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe441399b80 1 -- 172.21.15.35:0/2550371436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 msgr2=0x55fcbdb6bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe441399b80 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6bfb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe4200099c0 tx=0x7fe42001f000 comp rx=0 tx=0).stop 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.527+0000 7fe441399b80 1 -- 172.21.15.35:0/2550371436 shutdown_connections 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb66d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6bfb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 --2- 172.21.15.35:0/2550371436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb66420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- 172.21.15.35:0/2550371436 >> 172.21.15.35:0/2550371436 conn(0x55fcbd9c36b0 msgr2=0x55fcbdb60a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- 172.21.15.35:0/2550371436 shutdown_connections 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- 172.21.15.35:0/2550371436 wait complete. 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- start start 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 Processor -- start 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb6fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbd93c8c0 con 0x55fcbdb6c4f0 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdb70350 con 0x55fcbdb66960 2023-03-17T09:31:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdb70510 con 0x55fcbdb6bbe0 2023-03-17T09:31:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe441399b80 10 client.0 _ll_register_callbacks cb 0x55fcbd95e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:31:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb6fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb6fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45548/0 (socket says 172.21.15.35:45548) 2023-03-17T09:31:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.528+0000 7fe42f59e700 1 -- 172.21.15.35:0/1274248674 learned_addr learned my addr 172.21.15.35:0/1274248674 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42e59c700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42f59e700 1 -- 172.21.15.35:0/1274248674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6bbe0 msgr2=0x55fcbdb6f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42f59e700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42f59e700 1 -- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 msgr2=0x55fcbdb723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42f59e700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42f59e700 1 -- 172.21.15.35:0/1274248674 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43010c7a0 con 0x55fcbdb6c4f0 2023-03-17T09:31:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42e59c700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:31:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe42f59e700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb6fbe0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe428093ce0 tx=0x7fe428097410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153cfb675846f9db server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe412ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:31:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe412ff5700 1 -- 172.21.15.35:0/1274248674 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428097c40 con 0x55fcbdb6c4f0 2023-03-17T09:31:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe412ff5700 1 -- 172.21.15.35:0/1274248674 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fe4280977e0 con 0x55fcbdb6c4f0 2023-03-17T09:31:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcbda7b390 con 0x55fcbdb6c4f0 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe412ff5700 1 -- 172.21.15.35:0/1274248674 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe42809f9d0 con 0x55fcbdb6c4f0 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe441399b80 10 client.16779 fetch_fsmap learned FSMap version 33 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fcbd8e6d80 con 0x55fcbdb6c4f0 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.529+0000 7fe412ff5700 1 -- 172.21.15.35:0/1274248674 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fcbda7b390 con 0x55fcbdb6c4f0 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe412ff5700 1 -- 172.21.15.35:0/1274248674 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe42809f540 con 0x55fcbdb6c4f0 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe441399b80 10 client.16779 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:31:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe441399b80 10 client.16779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:31:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe441399b80 20 client.16779 populate_metadata read hostname 'smithi035' 2023-03-17T09:31:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe441399b80 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb887d0 0x55fcbdb8abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe441399b80 4 client.16779 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:31:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcbda87600 con 0x55fcbdb887d0 2023-03-17T09:31:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb887d0 0x55fcbdb8abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe412ff5700 10 client.16779 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.530+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb887d0 0x55fcbdb8abe0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4655696e09dc76a server_cookie=b9154a83e54be132 in_seq=0 out_seq=0 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe412ff5700 1 -- 172.21.15.35:0/1274248674 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55fcbda87600 con 0x55fcbdb887d0 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe412ff5700 10 client.16779 handle_command_reply: tid=0 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 client.16779 shutdown 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 msgr2=0x55fcbdb6fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb6fbe0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe428093ce0 tx=0x7fe428097410 comp rx=0 tx=0).stop 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 shutdown_connections 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb887d0 0x55fcbdb8abe0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb6fbe0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe412ff5700 0 client.16779 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:31:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 --2- 172.21.15.35:0/1274248674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb6f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 >> 172.21.15.35:0/1274248674 conn(0x55fcbd9c36b0 msgr2=0x55fcbdb65410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:51.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 shutdown_connections 2023-03-17T09:31:51.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 1 -- 172.21.15.35:0/1274248674 wait complete. 2023-03-17T09:31:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.531+0000 7fe441399b80 20 client.16779 trim_cache size 0 max 16384 2023-03-17T09:31:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 Processor -- start 2023-03-17T09:31:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 -- start start 2023-03-17T09:31:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb6d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb60ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb81800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbda87600 con 0x55fcbdb6bbe0 2023-03-17T09:31:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbda7b390 con 0x55fcbdb66960 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe441399b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdb5c0f0 con 0x55fcbdb6c4f0 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb60ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb60ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45554/0 (socket says 172.21.15.35:45554) 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 -- 172.21.15.35:0/2348765486 learned_addr learned my addr 172.21.15.35:0/2348765486 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb6d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42f59e700 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb81800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 -- 172.21.15.35:0/2348765486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 msgr2=0x55fcbdb81800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb81800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 -- 172.21.15.35:0/2348765486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 msgr2=0x55fcbdb6d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb6d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 -- 172.21.15.35:0/2348765486 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcbda7f130 con 0x55fcbdb6bbe0 2023-03-17T09:31:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42f59e700 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb81800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:31:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:31:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:31:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:31:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:31:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.547+0000 7fe42e59c700 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb60ac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe43006a350 tx=0x7fe42400baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ad94b0ad449990 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe415ffb700 1 -- 172.21.15.35:0/2348765486 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424017070 con 0x55fcbdb6bbe0 2023-03-17T09:31:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe415ffb700 1 -- 172.21.15.35:0/2348765486 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe424004cc0 con 0x55fcbdb6bbe0 2023-03-17T09:31:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe415ffb700 1 -- 172.21.15.35:0/2348765486 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240039a0 con 0x55fcbdb6bbe0 2023-03-17T09:31:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 -- 172.21.15.35:0/2348765486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 msgr2=0x55fcbdb60ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:31:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb60ac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe43006a350 tx=0x7fe42400baf0 comp rx=0 tx=0).stop 2023-03-17T09:31:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 -- 172.21.15.35:0/2348765486 shutdown_connections 2023-03-17T09:31:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb81800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb66960 0x55fcbdb6d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 --2- 172.21.15.35:0/2348765486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb60ac0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 -- 172.21.15.35:0/2348765486 >> 172.21.15.35:0/2348765486 conn(0x55fcbd9c36b0 msgr2=0x55fcbdb65410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 -- 172.21.15.35:0/2348765486 shutdown_connections 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.548+0000 7fe441399b80 1 -- 172.21.15.35:0/2348765486 wait complete. 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 -- start start 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 Processor -- start 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb66960 0x55fcbdb90e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb8b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdb8bb70 con 0x55fcbdb6c4f0 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdb8bce0 con 0x55fcbdb6bbe0 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcbdb8bea0 con 0x55fcbdb66960 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe441399b80 10 client.0 _ll_register_callbacks cb 0x55fcbd95e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:31:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb8b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe42f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb8b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45562/0 (socket says 172.21.15.35:45562) 2023-03-17T09:31:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe42f59e700 1 -- 172.21.15.35:0/3665688685 learned_addr learned my addr 172.21.15.35:0/3665688685 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:31:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb66960 0x55fcbdb90e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.549+0000 7fe42e59c700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:31:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe42f59e700 1 -- 172.21.15.35:0/3665688685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb66960 msgr2=0x55fcbdb90e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe42f59e700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb66960 0x55fcbdb90e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe42f59e700 1 -- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb6bbe0 msgr2=0x55fcbdb913c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:31:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe42f59e700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb913c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:31:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe42f59e700 1 -- 172.21.15.35:0/3665688685 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe424004210 con 0x55fcbdb6c4f0 2023-03-17T09:31:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe42f59e700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb8b490 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe4280974e0 tx=0x7fe428093500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cb12d95f5a2213 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:31:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe412ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:31:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe412ff5700 1 -- 172.21.15.35:0/3665688685 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428097c40 con 0x55fcbdb6c4f0 2023-03-17T09:31:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe412ff5700 1 -- 172.21.15.35:0/3665688685 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fe4280977e0 con 0x55fcbdb6c4f0 2023-03-17T09:31:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcbdb361e0 con 0x55fcbdb6c4f0 2023-03-17T09:32:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe412ff5700 1 -- 172.21.15.35:0/3665688685 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe428081340 con 0x55fcbdb6c4f0 2023-03-17T09:32:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 10 client.16785 fetch_fsmap learned FSMap version 33 2023-03-17T09:32:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fcbd90d1f0 con 0x55fcbdb6c4f0 2023-03-17T09:32:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe412ff5700 1 -- 172.21.15.35:0/3665688685 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4280a3070 con 0x55fcbdb6c4f0 2023-03-17T09:32:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe412ff5700 1 -- 172.21.15.35:0/3665688685 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe428096740 con 0x55fcbdb6c4f0 2023-03-17T09:32:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:32:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:32:01.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 20 client.16785 populate_metadata read hostname 'smithi035' 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb98780 0x55fcbdb9ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.550+0000 7fe441399b80 4 client.16785 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.551+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fcbd93cf00 con 0x55fcbdb98780 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.551+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb98780 0x55fcbdb9ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.551+0000 7fe412ff5700 10 client.16785 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.551+0000 7fe42ed9d700 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb98780 0x55fcbdb9ab90 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d405cf1642cdf27 server_cookie=26ab5b9e5d6b00a2 in_seq=0 out_seq=0 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe412ff5700 1 -- 172.21.15.35:0/3665688685 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fcbd93cf00 con 0x55fcbdb98780 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe412ff5700 10 client.16785 handle_command_reply: tid=0 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 client.16785 shutdown 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 msgr2=0x55fcbdb8b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb8b490 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe4280974e0 tx=0x7fe428093500 comp rx=0 tx=0).stop 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 shutdown_connections 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fcbdb98780 0x55fcbdb9ab90 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fcbdb6c4f0 0x55fcbdb8b490 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe412ff5700 0 client.16785 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcbdb66960 0x55fcbdb90e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 --2- 172.21.15.35:0/3665688685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcbdb6bbe0 0x55fcbdb913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 >> 172.21.15.35:0/3665688685 conn(0x55fcbd9c36b0 msgr2=0x55fcbdb7aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.555+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 shutdown_connections 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe441399b80 1 -- 172.21.15.35:0/3665688685 wait complete. 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe441399b80 20 client.16785 trim_cache size 0 max 16384 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe41809f6c0 msgr2=0x7fe4180a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:01.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe41809f6c0 0x7fe4180a1b70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe4200036c0 tx=0x7fe420005e80 comp rx=0 tx=0).stop 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 msgr2=0x7fe43019acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 0x7fe43019acd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe428007ee0 tx=0x7fe42800d3b0 comp rx=0 tx=0).stop 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 shutdown_connections 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe41809f6c0 0x7fe4180a1b70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe430104390 0x7fe43019acd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4300ff350 0x7fe430196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 --2- 172.21.15.35:0/2117993804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4300ffcf0 0x7fe430196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 >> 172.21.15.35:0/2117993804 conn(0x7fe430076330 msgr2=0x7fe430068120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 shutdown_connections 2023-03-17T09:32:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:09:29.556+0000 7fe43520c700 1 -- 172.21.15.35:0/2117993804 wait complete. 2023-03-17T09:32:03.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/3282441757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e5810a7a0 msgr2=0x7f5e5810cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/3282441757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e5810a7a0 0x7f5e5810cbc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000b0a0 tx=0x7f5e5000b3b0 comp rx=0 tx=0).stop 2023-03-17T09:32:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/3282441757 shutdown_connections 2023-03-17T09:32:04.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/3282441757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e5810a7a0 0x7f5e5810cbc0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/3282441757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e581013d0 0x7f5e581017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/3282441757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e58101ce0 0x7f5e5810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/3282441757 >> 172.21.15.35:0/3282441757 conn(0x7f5e58076330 msgr2=0x7f5e58076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/3282441757 shutdown_connections 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.419+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/3282441757 wait complete. 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.420+0000 7f5e5dfc2700 1 Processor -- start 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.420+0000 7f5e5dfc2700 1 -- start start 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e5dfc2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e581013d0 0x7f5e58198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e5dfc2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e58101ce0 0x7f5e58198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:04.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e5dfc2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5810a7a0 0x7f5e5819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e5dfc2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5819d500 con 0x7f5e58101ce0 2023-03-17T09:32:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e5dfc2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5819d670 con 0x7f5e5810a7a0 2023-03-17T09:32:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e5dfc2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5819d830 con 0x7f5e581013d0 2023-03-17T09:32:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e58101ce0 0x7f5e58198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e581013d0 0x7f5e58198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e58101ce0 0x7f5e58198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45574/0 (socket says 172.21.15.35:45574) 2023-03-17T09:32:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e56ffd700 1 -- 172.21.15.35:0/108096025 learned_addr learned my addr 172.21.15.35:0/108096025 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e57fff700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5810a7a0 0x7f5e5819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 -- 172.21.15.35:0/108096025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5810a7a0 msgr2=0x7f5e5819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5810a7a0 0x7f5e5819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:08.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 -- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e58101ce0 msgr2=0x7f5e58198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e58101ce0 0x7f5e58198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 -- 172.21.15.35:0/108096025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50009d00 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e57fff700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5810a7a0 0x7f5e5819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e577fe700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e581013d0 0x7f5e58198520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e9f0 tx=0x7f5e4800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.421+0000 7f5e54ff9700 1 -- 172.21.15.35:0/108096025 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800eee0 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.422+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e581100a0 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.422+0000 7f5e54ff9700 1 -- 172.21.15.35:0/108096025 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e4800cbd0 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.422+0000 7f5e54ff9700 1 -- 172.21.15.35:0/108096025 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48018680 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.422+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5810ff10 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.424+0000 7f5e54ff9700 1 -- 172.21.15.35:0/108096025 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5e48010430 con 0x7f5e581013d0 2023-03-17T09:32:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.424+0000 7f5e54ff9700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e4009f640 0x7f5e400a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e54ff9700 1 -- 172.21.15.35:0/108096025 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5e48014070 con 0x7f5e581013d0 2023-03-17T09:32:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e4009f640 0x7f5e400a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 Processor -- start 2023-03-17T09:32:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e4009f640 0x7f5e400a1af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e58199b30 tx=0x7f5e4c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 -- start start 2023-03-17T09:32:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa95fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa90420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa90960 0x55d00aa90d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00a997010 con 0x55d00aa964f0 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00a9e9950 con 0x55d00aa90960 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.425+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00a9e2de0 con 0x55d00aa95be0 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa90420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa90420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45582/0 (socket says 172.21.15.35:45582) 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1451812120 learned_addr learned my addr 172.21.15.35:0/1451812120 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e577fe700 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa95fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa90960 0x55d00aa90d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1451812120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 msgr2=0x55d00aa95fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa95fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1451812120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa90960 msgr2=0x55d00aa90d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa90960 0x55d00aa90d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1451812120 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00a8645d0 con 0x55d00aa964f0 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa90420 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009fd0 tx=0x7f5e4c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c29cd758860e43 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e3dffb700 1 -- 172.21.15.35:0/1451812120 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c00ec20 con 0x55d00aa964f0 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e3dffb700 1 -- 172.21.15.35:0/1451812120 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e4c021070 con 0x55d00aa964f0 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.426+0000 7f5e3dffb700 1 -- 172.21.15.35:0/1451812120 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c01c670 con 0x55d00aa964f0 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1451812120 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 msgr2=0x55d00aa90420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa90420 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009fd0 tx=0x7f5e4c014000 comp rx=0 tx=0).stop 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1451812120 shutdown_connections 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa90960 0x55d00aa90d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa95fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1451812120 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa90420 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1451812120 >> 172.21.15.35:0/1451812120 conn(0x55d00a8ed6b0 msgr2=0x55d00aa8aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1451812120 shutdown_connections 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.427+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1451812120 wait complete. 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 -- start start 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 Processor -- start 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 0x55d00aa9c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa99780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa99ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00a8668c0 con 0x55d00aa90960 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa9a630 con 0x55d00aa964f0 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aaa5fe0 con 0x55d00aa95be0 2023-03-17T09:32:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e6a14fb80 10 client.0 _ll_register_callbacks cb 0x55d00a888230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:32:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 0x55d00aa9c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e577fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 0x55d00aa9c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45586/0 (socket says 172.21.15.35:45586) 2023-03-17T09:32:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e577fe700 1 -- 172.21.15.35:0/1882022575 learned_addr learned my addr 172.21.15.35:0/1882022575 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.428+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa99ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa99780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:16.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:08 smithi035 ceph-mon[92535]: pgmap v1173: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:09 smithi035 ceph-mon[92535]: osdmap e150: 12 total, 12 up, 12 in 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:10 smithi035 ceph-mon[92535]: pgmap v1175: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:12 smithi035 ceph-mon[92535]: pgmap v1176: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:14 smithi035 ceph-mon[92535]: pgmap v1177: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:32:19.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:16 smithi035 ceph-mon[92535]: osdmap e151: 12 total, 12 up, 12 in 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:16 smithi035 ceph-mon[92535]: pgmap v1179: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:18 smithi035 ceph-mon[92535]: pgmap v1180: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:20 smithi035 ceph-mon[92535]: pgmap v1181: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:22 smithi035 ceph-mon[92535]: pgmap v1182: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:24 smithi035 ceph-mon[92535]: pgmap v1183: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:26 smithi035 ceph-mon[92535]: pgmap v1184: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 304 B/s wr, 10 op/s 2023-03-17T09:32:19.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:28 smithi035 ceph-mon[92535]: pgmap v1185: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:32:22.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:30 smithi035 ceph-mon[92535]: pgmap v1186: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:32:22.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:32 smithi035 ceph-mon[92535]: pgmap v1187: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:32:22.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:34 smithi035 ceph-mon[92535]: pgmap v1188: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:36 smithi035 ceph-mon[92535]: pgmap v1189: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:38 smithi035 ceph-mon[92535]: pgmap v1190: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:40 smithi035 ceph-mon[92535]: pgmap v1191: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:42 smithi035 ceph-mon[92535]: pgmap v1192: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:44 smithi035 ceph-mon[92535]: pgmap v1193: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:46 smithi035 ceph-mon[92535]: pgmap v1194: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:48 smithi035 ceph-mon[92535]: pgmap v1195: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:32:22.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:50 smithi035 ceph-mon[92535]: pgmap v1196: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:52 smithi035 ceph-mon[92535]: pgmap v1197: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:54 smithi035 ceph-mon[92535]: pgmap v1198: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:56 smithi035 ceph-mon[92535]: pgmap v1199: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:23:58 smithi035 ceph-mon[92535]: pgmap v1200: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:00 smithi035 ceph-mon[92535]: pgmap v1201: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:02 smithi035 ceph-mon[92535]: pgmap v1202: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:32:22.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:04 smithi035 ceph-mon[92535]: pgmap v1203: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T09:32:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:32:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:32:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:32:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:32:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e57fff700 1 -- 172.21.15.35:0/1882022575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 msgr2=0x55d00aa99780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa99780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e57fff700 1 -- 172.21.15.35:0/1882022575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 msgr2=0x55d00aa9c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 0x55d00aa9c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e57fff700 1 -- 172.21.15.35:0/1882022575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c017070 con 0x55d00aa964f0 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e577fe700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 0x55d00aa9c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa99ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009fd0 tx=0x7f5e50007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8465606829752a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e36ffd700 1 -- 172.21.15.35:0/1882022575 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000e040 con 0x55d00aa964f0 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e36ffd700 1 -- 172.21.15.35:0/1882022575 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5e50022070 con 0x55d00aa964f0 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d00a9a5390 con 0x55d00aa964f0 2023-03-17T09:32:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e36ffd700 1 -- 172.21.15.35:0/1882022575 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5000be40 con 0x55d00aa964f0 2023-03-17T09:32:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e6a14fb80 10 client.26396 fetch_fsmap learned FSMap version 33 2023-03-17T09:32:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.429+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d00a810d80 con 0x55d00aa964f0 2023-03-17T09:32:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e36ffd700 1 -- 172.21.15.35:0/1882022575 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d00a9a5390 con 0x55d00aa964f0 2023-03-17T09:32:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e36ffd700 1 -- 172.21.15.35:0/1882022575 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5e5000b0d0 con 0x55d00aa964f0 2023-03-17T09:32:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e6a14fb80 10 client.26396 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:32:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e6a14fb80 10 client.26396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e6a14fb80 20 client.26396 populate_metadata read hostname 'smithi035' 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aaaa0b0 0x55d00aaac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e6a14fb80 4 client.26396 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d00a9b1600 con 0x55d00aaaa0b0 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.430+0000 7f5e577fe700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aaaa0b0 0x55d00aaac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.431+0000 7f5e36ffd700 10 client.26396 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.431+0000 7f5e577fe700 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aaaa0b0 0x55d00aaac4c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e121b101d154a7ff server_cookie=24b07fb26c5da862 in_seq=0 out_seq=0 2023-03-17T09:32:26.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e36ffd700 1 -- 172.21.15.35:0/1882022575 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d00a9b1600 con 0x55d00aaaa0b0 2023-03-17T09:32:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e36ffd700 10 client.26396 handle_command_reply: tid=0 2023-03-17T09:32:26.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 client.26396 shutdown 2023-03-17T09:32:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 msgr2=0x55d00aa99ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa99ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009fd0 tx=0x7f5e50007f90 comp rx=0 tx=0).stop 2023-03-17T09:32:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 shutdown_connections 2023-03-17T09:32:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aaaa0b0 0x55d00aaac4c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa99ec0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa90960 0x55d00aa9c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1882022575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa95be0 0x55d00aa99780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e36ffd700 0 client.26396 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 >> 172.21.15.35:0/1882022575 conn(0x55d00a8ed6b0 msgr2=0x55d00aa8f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 shutdown_connections 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1882022575 wait complete. 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.432+0000 7f5e6a14fb80 20 client.26396 trim_cache size 0 max 16384 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 Processor -- start 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 -- start start 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 0x55d00aa9c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa8fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa907f0 con 0x55d00aa95be0 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa860f0 con 0x55d00aa964f0 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa8cc10 con 0x55d00aa90960 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 0x55d00aa9c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 0x55d00aa9c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45596/0 (socket says 172.21.15.35:45596) 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1395843858 learned_addr learned my addr 172.21.15.35:0/1395843858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa8fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e577fe700 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1395843858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 msgr2=0x55d00aaa0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1395843858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 msgr2=0x55d00aa8fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa8fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e56ffd700 1 -- 172.21.15.35:0/1395843858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00aa91000 con 0x55d00aa95be0 2023-03-17T09:32:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.448+0000 7f5e57fff700 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa8fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:32:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.449+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 0x55d00aa9c0a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c025000 tx=0x7f5e4c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47e56df52fc4170 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.449+0000 7f5e3e7fc700 1 -- 172.21.15.35:0/1395843858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c02b040 con 0x55d00aa95be0 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.449+0000 7f5e3e7fc700 1 -- 172.21.15.35:0/1395843858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e4c021040 con 0x55d00aa95be0 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.449+0000 7f5e3e7fc700 1 -- 172.21.15.35:0/1395843858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0049b0 con 0x55d00aa95be0 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1395843858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 msgr2=0x55d00aa9c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 0x55d00aa9c0a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c025000 tx=0x7f5e4c009820 comp rx=0 tx=0).stop 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1395843858 shutdown_connections 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa964f0 0x55d00aa8fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/1395843858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa95be0 0x55d00aa9c0a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1395843858 >> 172.21.15.35:0/1395843858 conn(0x55d00a8ed6b0 msgr2=0x55d00aaa6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1395843858 shutdown_connections 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/1395843858 wait complete. 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 -- start start 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.450+0000 7f5e6a14fb80 1 Processor -- start 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa95be0 0x55d00aaa1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa9f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa9f830 con 0x55d00aa964f0 2023-03-17T09:32:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa9f9a0 con 0x55d00aa95be0 2023-03-17T09:32:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00aa9fb60 con 0x55d00aa90960 2023-03-17T09:32:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e6a14fb80 10 client.0 _ll_register_callbacks cb 0x55d00a888230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:32:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa9f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa9f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45604/0 (socket says 172.21.15.35:45604) 2023-03-17T09:32:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 -- 172.21.15.35:0/505043113 learned_addr learned my addr 172.21.15.35:0/505043113 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e577fe700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e56ffd700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa95be0 0x55d00aaa1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 -- 172.21.15.35:0/505043113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 msgr2=0x55d00aaa0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 -- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa95be0 msgr2=0x55d00aaa1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa95be0 0x55d00aaa1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.451+0000 7f5e57fff700 1 -- 172.21.15.35:0/505043113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d00a810d80 con 0x55d00aa964f0 2023-03-17T09:32:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e57fff700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa9f160 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009cd0 tx=0x7f5e500276b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6e78d889c92bb4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e36ffd700 1 -- 172.21.15.35:0/505043113 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000e070 con 0x55d00aa964f0 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d00aa601e0 con 0x55d00aa964f0 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e36ffd700 1 -- 172.21.15.35:0/505043113 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5e50022070 con 0x55d00aa964f0 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e36ffd700 1 -- 172.21.15.35:0/505043113 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5000b700 con 0x55d00aa964f0 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 10 client.16803 fetch_fsmap learned FSMap version 33 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d00a8645d0 con 0x55d00aa964f0 2023-03-17T09:32:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e36ffd700 1 -- 172.21.15.35:0/505043113 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d00aa601e0 con 0x55d00aa964f0 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e36ffd700 1 -- 172.21.15.35:0/505043113 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5e50005110 con 0x55d00aa964f0 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 10 client.16803 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 20 client.16803 populate_metadata read hostname 'smithi035' 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aafeee0 0x55d00ab012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 4 client.16803 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:32:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.452+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d00a866f00 con 0x55d00aafeee0 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.453+0000 7f5e577fe700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aafeee0 0x55d00ab012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.453+0000 7f5e577fe700 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aafeee0 0x55d00ab012f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e4f9d8940c696e server_cookie=4df9e6d86b5edaaa in_seq=0 out_seq=0 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.453+0000 7f5e36ffd700 10 client.16803 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e36ffd700 1 -- 172.21.15.35:0/505043113 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d00a866f00 con 0x55d00aafeee0 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e36ffd700 10 client.16803 handle_command_reply: tid=0 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 client.16803 shutdown 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 msgr2=0x55d00aa9f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa9f160 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009cd0 tx=0x7f5e500276b0 comp rx=0 tx=0).stop 2023-03-17T09:32:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 shutdown_connections 2023-03-17T09:32:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d00aafeee0 0x55d00ab012f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d00aa964f0 0x55d00aa9f160 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d00aa90960 0x55d00aaa0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e36ffd700 0 client.16803 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 --2- 172.21.15.35:0/505043113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d00aa95be0 0x55d00aaa1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 >> 172.21.15.35:0/505043113 conn(0x55d00a8ed6b0 msgr2=0x55d00aa936b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 shutdown_connections 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 1 -- 172.21.15.35:0/505043113 wait complete. 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.461+0000 7f5e6a14fb80 20 client.16803 trim_cache size 0 max 16384 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e4009f640 msgr2=0x7f5e400a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e4009f640 0x7f5e400a1af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e58199b30 tx=0x7f5e4c009260 comp rx=0 tx=0).stop 2023-03-17T09:32:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e581013d0 msgr2=0x7f5e58198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e581013d0 0x7f5e58198520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e9f0 tx=0x7f5e4800ed00 comp rx=0 tx=0).stop 2023-03-17T09:32:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 shutdown_connections 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e4009f640 0x7f5e400a1af0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e5810a7a0 0x7f5e5819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e581013d0 0x7f5e58198520 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 --2- 172.21.15.35:0/108096025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e58101ce0 0x7f5e58198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 >> 172.21.15.35:0/108096025 conn(0x7f5e58076330 msgr2=0x7f5e580ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 shutdown_connections 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:18.462+0000 7f5e5dfc2700 1 -- 172.21.15.35:0/108096025 wait complete. 2023-03-17T09:32:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 -- 172.21.15.35:0/521732445 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e04104390 msgr2=0x7f5e0410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/521732445 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e04104390 0x7f5e0410bf60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00b0d0 tx=0x7f5dfc00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 -- 172.21.15.35:0/521732445 shutdown_connections 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/521732445 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e04104390 0x7f5e0410bf60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/521732445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 0x7f5e040ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/521732445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e040ffcf0 0x7f5e04103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 -- 172.21.15.35:0/521732445 >> 172.21.15.35:0/521732445 conn(0x7f5e04076330 msgr2=0x7f5e04076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 -- 172.21.15.35:0/521732445 shutdown_connections 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.585+0000 7f5e08e1d700 1 -- 172.21.15.35:0/521732445 wait complete. 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 Processor -- start 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 -- start start 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 0x7f5e04195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 0x7f5e041957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04104390 0x7f5e04199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0419a270 con 0x7f5e040ffcf0 2023-03-17T09:32:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0419a3e0 con 0x7f5e040ff350 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e08e1d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0419a5a0 con 0x7f5e04104390 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.586+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 0x7f5e041957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 0x7f5e041957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45616/0 (socket says 172.21.15.35:45616) 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e01d9b700 1 -- 172.21.15.35:0/4149379073 learned_addr learned my addr 172.21.15.35:0/4149379073 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 0x7f5e04195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e02d9d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04104390 0x7f5e04199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 -- 172.21.15.35:0/4149379073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04104390 msgr2=0x7f5e04199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04104390 0x7f5e04199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 -- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 msgr2=0x7f5e041957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 0x7f5e041957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 -- 172.21.15.35:0/4149379073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc009d00 con 0x7f5e040ff350 2023-03-17T09:32:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 0x7f5e041957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:32:34.046 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:06 smithi035 ceph-mon[92535]: pgmap v1204: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 0x7f5e04195290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9f0 tx=0x7f5dec00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5dfb7fe700 1 -- 172.21.15.35:0/4149379073 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00c9c0 con 0x7f5e040ff350 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5dfb7fe700 1 -- 172.21.15.35:0/4149379073 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dec010430 con 0x7f5e040ff350 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0410f010 con 0x7f5e040ff350 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.587+0000 7f5dfb7fe700 1 -- 172.21.15.35:0/4149379073 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec018680 con 0x7f5e040ff350 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.588+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0410ee80 con 0x7f5e040ff350 2023-03-17T09:32:36.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.590+0000 7f5dfb7fe700 1 -- 172.21.15.35:0/4149379073 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5dec0105a0 con 0x7f5e040ff350 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.591+0000 7f5dfb7fe700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5df009f640 0x7f5df00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.591+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5df009f640 0x7f5df00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.591+0000 7f5dfb7fe700 1 -- 172.21.15.35:0/4149379073 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5dec014070 con 0x7f5e040ff350 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.591+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5df009f640 0x7f5df00a1af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e041968a0 tx=0x7f5df400b460 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 Processor -- start 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 -- start start 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df8e9010 con 0x55f3df9f09d0 2023-03-17T09:32:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df93b950 con 0x55f3df9e36f0 2023-03-17T09:32:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e14faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df934de0 con 0x55f3df9e2de0 2023-03-17T09:32:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9f2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45626/0 (socket says 172.21.15.35:45626) 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e02d9d700 1 -- 172.21.15.35:0/4089489051 learned_addr learned my addr 172.21.15.35:0/4089489051 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.592+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e02d9d700 1 -- 172.21.15.35:0/4089489051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 msgr2=0x55f3df9e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e02d9d700 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9e31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e02d9d700 1 -- 172.21.15.35:0/4089489051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 msgr2=0x55f3df9f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e02d9d700 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e02d9d700 1 -- 172.21.15.35:0/4089489051 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3df7b65d0 con 0x55f3df9f09d0 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:32:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5e02d9d700 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9f2db0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0093f0 tx=0x7f5dfc006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919061b375bd793e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5df8ff9700 1 -- 172.21.15.35:0/4089489051 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00e040 con 0x55f3df9f09d0 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5df8ff9700 1 -- 172.21.15.35:0/4089489051 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dfc007d90 con 0x55f3df9f09d0 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.593+0000 7f5df8ff9700 1 -- 172.21.15.35:0/4089489051 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc003c60 con 0x55f3df9f09d0 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 -- 172.21.15.35:0/4089489051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 msgr2=0x55f3df9f2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9f2db0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0093f0 tx=0x7f5dfc006210 comp rx=0 tx=0).stop 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 -- 172.21.15.35:0/4089489051 shutdown_connections 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9f2db0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4089489051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 -- 172.21.15.35:0/4089489051 >> 172.21.15.35:0/4089489051 conn(0x55f3df83f6b0 msgr2=0x55f3df9df8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 -- 172.21.15.35:0/4089489051 shutdown_connections 2023-03-17T09:32:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 -- 172.21.15.35:0/4089489051 wait complete. 2023-03-17T09:32:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.594+0000 7f5e14faab80 1 -- start start 2023-03-17T09:32:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 Processor -- start 2023-03-17T09:32:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9edc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df7b88c0 con 0x55f3df9f09d0 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df9ee390 con 0x55f3df9e36f0 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df9fc420 con 0x55f3df9e2de0 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e14faab80 10 client.0 _ll_register_callbacks cb 0x55f3df7da230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45632/0 (socket says 172.21.15.35:45632) 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e02d9d700 1 -- 172.21.15.35:0/4185602599 learned_addr learned my addr 172.21.15.35:0/4185602599 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e0259c700 1 -- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 msgr2=0x55f3df9ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e0259c700 1 -- 172.21.15.35:0/4185602599 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 msgr2=0x55f3df9edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9edc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.595+0000 7f5e0259c700 1 -- 172.21.15.35:0/4185602599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0410c7a0 con 0x55f3df9e2de0 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:32:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5e02d9d700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5e0259c700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f0370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0c8020 tx=0x7f5dec097d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4902ec539a0001e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5de9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5de9ffb700 1 -- 172.21.15.35:0/4185602599 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec09c170 con 0x55f3df9e2de0 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5de9ffb700 1 -- 172.21.15.35:0/4185602599 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5dec098340 con 0x55f3df9e2de0 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3df8f7390 con 0x55f3df9e2de0 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5de9ffb700 1 -- 172.21.15.35:0/4185602599 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dec0a0530 con 0x55f3df9e2de0 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5e14faab80 10 client.26446 fetch_fsmap learned FSMap version 33 2023-03-17T09:32:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f3df762d80 con 0x55f3df9e2de0 2023-03-17T09:32:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.596+0000 7f5de9ffb700 1 -- 172.21.15.35:0/4185602599 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3df8f7390 con 0x55f3df9e2de0 2023-03-17T09:32:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5de9ffb700 1 -- 172.21.15.35:0/4185602599 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5dec0972a0 con 0x55f3df9e2de0 2023-03-17T09:32:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e14faab80 10 client.26446 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:32:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e14faab80 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:32:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e14faab80 20 client.26446 populate_metadata read hostname 'smithi035' 2023-03-17T09:32:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa00470 0x55f3dfa02880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e14faab80 4 client.26446 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:32:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3df903600 con 0x55f3dfa00470 2023-03-17T09:32:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa00470 0x55f3dfa02880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa00470 0x55f3dfa02880 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bc4312bebe2260a server_cookie=a04af88932dca436 in_seq=0 out_seq=0 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.597+0000 7f5de9ffb700 10 client.26446 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5de9ffb700 1 -- 172.21.15.35:0/4185602599 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f3df903600 con 0x55f3dfa00470 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5de9ffb700 10 client.26446 handle_command_reply: tid=0 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 client.26446 shutdown 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 msgr2=0x55f3df9f0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f0370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0c8020 tx=0x7f5dec097d20 comp rx=0 tx=0).stop 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 shutdown_connections 2023-03-17T09:32:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa00470 0x55f3dfa02880 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3df9edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5de9ffb700 0 client.26446 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f0370 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 --2- 172.21.15.35:0/4185602599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 >> 172.21.15.35:0/4185602599 conn(0x55f3df83f6b0 msgr2=0x55f3df9e5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 shutdown_connections 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 1 -- 172.21.15.35:0/4185602599 wait complete. 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.598+0000 7f5e14faab80 20 client.26446 trim_cache size 0 max 16384 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.613+0000 7f5e14faab80 1 Processor -- start 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 -- start start 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 0x55f3df9eff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e36f0 0x55f3df9dce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9f09d0 0x55f3df9dd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df9debe0 con 0x55f3df9e2de0 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df9d9b90 con 0x55f3df9f09d0 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e14faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df9e4000 con 0x55f3df9e36f0 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 0x55f3df9eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 0x55f3df9eff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45636/0 (socket says 172.21.15.35:45636) 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 -- 172.21.15.35:0/757891835 learned_addr learned my addr 172.21.15.35:0/757891835 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e36f0 0x55f3df9dce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e02d9d700 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9f09d0 0x55f3df9dd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 -- 172.21.15.35:0/757891835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e36f0 msgr2=0x55f3df9dce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e36f0 0x55f3df9dce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 -- 172.21.15.35:0/757891835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9f09d0 msgr2=0x55f3df9dd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9f09d0 0x55f3df9dd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 -- 172.21.15.35:0/757891835 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3df8fb130 con 0x55f3df9e2de0 2023-03-17T09:32:49.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.614+0000 7f5e0259c700 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 0x55f3df9eff10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9c0 tx=0x7f5dec01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c6eb7df604e7c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5df97fa700 1 -- 172.21.15.35:0/757891835 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec09c170 con 0x55f3df9e2de0 2023-03-17T09:32:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5df97fa700 1 -- 172.21.15.35:0/757891835 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dec0944c0 con 0x55f3df9e2de0 2023-03-17T09:32:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5df97fa700 1 -- 172.21.15.35:0/757891835 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec0abbe0 con 0x55f3df9e2de0 2023-03-17T09:32:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 -- 172.21.15.35:0/757891835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 msgr2=0x55f3df9eff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 0x55f3df9eff10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9c0 tx=0x7f5dec01f000 comp rx=0 tx=0).stop 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 -- 172.21.15.35:0/757891835 shutdown_connections 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9f09d0 0x55f3df9dd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9e2de0 0x55f3df9eff10 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 --2- 172.21.15.35:0/757891835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e36f0 0x55f3df9dce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 -- 172.21.15.35:0/757891835 >> 172.21.15.35:0/757891835 conn(0x55f3df83f6b0 msgr2=0x55f3df9fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.615+0000 7f5e14faab80 1 -- 172.21.15.35:0/757891835 shutdown_connections 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 -- 172.21.15.35:0/757891835 wait complete. 2023-03-17T09:32:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 -- start start 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 Processor -- start 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3dfa53310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df9f61f0 con 0x55f3df9f09d0 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3dfa53850 con 0x55f3df9e36f0 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3dfa53990 con 0x55f3df9e2de0 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e14faab80 10 client.0 _ll_register_callbacks cb 0x55f3df7da230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3dfa53310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3dfa53310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45646/0 (socket says 172.21.15.35:45646) 2023-03-17T09:32:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.616+0000 7f5e02d9d700 1 -- 172.21.15.35:0/1327374123 learned_addr learned my addr 172.21.15.35:0/1327374123 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e0259c700 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e01d9b700 1 -- 172.21.15.35:0/1327374123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 msgr2=0x55f3df9f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e01d9b700 1 -- 172.21.15.35:0/1327374123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 msgr2=0x55f3dfa53310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3dfa53310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e01d9b700 1 -- 172.21.15.35:0/1327374123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3df762d80 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e01d9b700 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f5ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55f3df9e3e80 tx=0x7f5df40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=909f82d1ee0fa698 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5de9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5de9ffb700 1 -- 172.21.15.35:0/1327374123 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4024040 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3df9b21e0 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5de9ffb700 1 -- 172.21.15.35:0/1327374123 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5df4017070 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5de9ffb700 1 -- 172.21.15.35:0/1327374123 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5df4011820 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e14faab80 10 client.26420 fetch_fsmap learned FSMap version 33 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.617+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f3df7891f0 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5de9ffb700 1 -- 172.21.15.35:0/1327374123 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3df9b21e0 con 0x55f3df9e36f0 2023-03-17T09:32:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5de9ffb700 1 -- 172.21.15.35:0/1327374123 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5df401f8c0 con 0x55f3df9e36f0 2023-03-17T09:32:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e14faab80 10 client.26420 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:32:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e14faab80 10 client.26420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:32:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e14faab80 20 client.26420 populate_metadata read hostname 'smithi035' 2023-03-17T09:32:56.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:08 smithi035 ceph-mon[92535]: pgmap v1205: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:32:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e14faab80 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa550a0 0x55f3dfa574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:32:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e14faab80 4 client.26420 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:32:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f3df7b8f00 con 0x55f3dfa550a0 2023-03-17T09:32:59.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e0259c700 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa550a0 0x55f3dfa574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5de9ffb700 10 client.26420 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.618+0000 7f5e0259c700 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa550a0 0x55f3dfa574b0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec55a734a555f73b server_cookie=4474a990fc7f83bb in_seq=0 out_seq=0 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.622+0000 7f5de9ffb700 1 -- 172.21.15.35:0/1327374123 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f3df7b8f00 con 0x55f3dfa550a0 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.622+0000 7f5de9ffb700 10 client.26420 handle_command_reply: tid=0 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 client.26420 shutdown 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 msgr2=0x55f3df9f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f5ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55f3df9e3e80 tx=0x7f5df40047c0 comp rx=0 tx=0).stop 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 shutdown_connections 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f3dfa550a0 0x55f3dfa574b0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f3df9f09d0 0x55f3dfa53310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f3df9e2de0 0x55f3df9f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 --2- 172.21.15.35:0/1327374123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3df9e36f0 0x55f3df9f5ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5de9ffb700 0 client.26420 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 >> 172.21.15.35:0/1327374123 conn(0x55f3df83f6b0 msgr2=0x55f3df9dce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 shutdown_connections 2023-03-17T09:32:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 1 -- 172.21.15.35:0/1327374123 wait complete. 2023-03-17T09:32:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e14faab80 20 client.26420 trim_cache size 0 max 16384 2023-03-17T09:32:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5df009f640 msgr2=0x7f5df00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:32:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5df009f640 0x7f5df00a1af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e041968a0 tx=0x7f5df400b460 comp rx=0 tx=0).stop 2023-03-17T09:33:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 msgr2=0x7f5e04195290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 0x7f5e04195290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9f0 tx=0x7f5dec00ed00 comp rx=0 tx=0).stop 2023-03-17T09:33:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 shutdown_connections 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5df009f640 0x7f5df00a1af0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04104390 0x7f5e04199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e040ff350 0x7f5e04195290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 --2- 172.21.15.35:0/4149379073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5e040ffcf0 0x7f5e041957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.623+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 >> 172.21.15.35:0/4149379073 conn(0x7f5e04076330 msgr2=0x7f5e040fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.624+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 shutdown_connections 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:31.624+0000 7f5e08e1d700 1 -- 172.21.15.35:0/4149379073 wait complete. 2023-03-17T09:33:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 -- 172.21.15.35:0/3552251095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 msgr2=0x7f29900ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 --2- 172.21.15.35:0/3552251095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29900ff720 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f29800099c0 tx=0x7f2980009cd0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 -- 172.21.15.35:0/3552251095 shutdown_connections 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 --2- 172.21.15.35:0/3552251095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2990104390 0x7f299010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 --2- 172.21.15.35:0/3552251095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29900ff720 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 --2- 172.21.15.35:0/3552251095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29900ffcf0 0x7f2990103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 -- 172.21.15.35:0/3552251095 >> 172.21.15.35:0/3552251095 conn(0x7f2990076330 msgr2=0x7f2990076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 -- 172.21.15.35:0/3552251095 shutdown_connections 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 -- 172.21.15.35:0/3552251095 wait complete. 2023-03-17T09:33:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.746+0000 7f2995eef700 1 Processor -- start 2023-03-17T09:33:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 -- start start 2023-03-17T09:33:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29901970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29900ffcf0 0x7f2990197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2990104390 0x7f29901a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990197f50 con 0x7f29900ff350 2023-03-17T09:33:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29901a2690 con 0x7f2990104390 2023-03-17T09:33:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f2995eef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29901a2850 con 0x7f29900ffcf0 2023-03-17T09:33:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29901970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29901970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45654/0 (socket says 172.21.15.35:45654) 2023-03-17T09:33:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 -- 172.21.15.35:0/2432483295 learned_addr learned my addr 172.21.15.35:0/2432483295 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298ffff700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2990104390 0x7f29901a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298effd700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29900ffcf0 0x7f2990197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 -- 172.21.15.35:0/2432483295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29900ffcf0 msgr2=0x7f2990197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29900ffcf0 0x7f2990197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 -- 172.21.15.35:0/2432483295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2990104390 msgr2=0x7f29901a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2990104390 0x7f29901a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.747+0000 7f298f7fe700 1 -- 172.21.15.35:0/2432483295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800095f0 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.748+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29901970d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2980009fd0 tx=0x7f298000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.748+0000 7f298cff9700 1 -- 172.21.15.35:0/2432483295 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298001d070 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.748+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299010f000 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.748+0000 7f298cff9700 1 -- 172.21.15.35:0/2432483295 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2980005030 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.748+0000 7f298cff9700 1 -- 172.21.15.35:0/2432483295 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980004990 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.748+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299010ee70 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.750+0000 7f298cff9700 1 -- 172.21.15.35:0/2432483295 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f29800051a0 con 0x7f29900ff350 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.751+0000 7f298cff9700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f297809f640 0x7f29780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.751+0000 7f298effd700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f297809f640 0x7f29780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:04.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.751+0000 7f298cff9700 1 -- 172.21.15.35:0/2432483295 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f29800cb3a0 con 0x7f29900ff350 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.751+0000 7f298effd700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f297809f640 0x7f29780a1af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f29900688b0 tx=0x7f2984009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 Processor -- start 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 -- start start 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e417be0 0x55762e417fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e4184f0 0x55762e412420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e412d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e319010 con 0x55762e412960 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e36b950 con 0x55762e4184f0 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f29a207cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e364de0 con 0x55762e417be0 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f298ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e412d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f298ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e412d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45666/0 (socket says 172.21.15.35:45666) 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f298ffff700 1 -- 172.21.15.35:0/2789402259 learned_addr learned my addr 172.21.15.35:0/2789402259 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e417be0 0x55762e417fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:04.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f298effd700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e4184f0 0x55762e412420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.753+0000 7f298ffff700 1 -- 172.21.15.35:0/2789402259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e417be0 msgr2=0x55762e417fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298ffff700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e417be0 0x55762e417fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298ffff700 1 -- 172.21.15.35:0/2789402259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e4184f0 msgr2=0x55762e412420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298ffff700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e4184f0 0x55762e412420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298ffff700 1 -- 172.21.15.35:0/2789402259 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762e1e65d0 con 0x55762e412960 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e417be0 0x55762e417fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298effd700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e4184f0 0x55762e412420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f298ffff700 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e412d90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2988003f30 tx=0x7f2988009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19efcfdb36ea3c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f2975ffb700 1 -- 172.21.15.35:0/2789402259 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988003a00 con 0x55762e412960 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f2975ffb700 1 -- 172.21.15.35:0/2789402259 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f298800f040 con 0x55762e412960 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.754+0000 7f2975ffb700 1 -- 172.21.15.35:0/2789402259 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880156e0 con 0x55762e412960 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 -- 172.21.15.35:0/2789402259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 msgr2=0x55762e412d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e412d90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2988003f30 tx=0x7f2988009c20 comp rx=0 tx=0).stop 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 -- 172.21.15.35:0/2789402259 shutdown_connections 2023-03-17T09:33:04.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e412d90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e417be0 0x55762e417fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2789402259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e4184f0 0x55762e412420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 -- 172.21.15.35:0/2789402259 >> 172.21.15.35:0/2789402259 conn(0x55762e26f6b0 msgr2=0x55762e40ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 -- 172.21.15.35:0/2789402259 shutdown_connections 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 -- 172.21.15.35:0/2789402259 wait complete. 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.755+0000 7f29a207cb80 1 -- start start 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 Processor -- start 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e41e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e41b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e41bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e1e88c0 con 0x55762e412960 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e41c410 con 0x55762e417be0 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e428060 con 0x55762e4184f0 2023-03-17T09:33:04.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f29a207cb80 10 client.0 _ll_register_callbacks cb 0x55762e20a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:33:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e41e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e41e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45670/0 (socket says 172.21.15.35:45670) 2023-03-17T09:33:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 -- 172.21.15.35:0/2907717068 learned_addr learned my addr 172.21.15.35:0/2907717068 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298ffff700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e41bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298effd700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e41b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 -- 172.21.15.35:0/2907717068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 msgr2=0x55762e41bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e41bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 -- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 msgr2=0x55762e41b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e41b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298f7fe700 1 -- 172.21.15.35:0/2907717068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988003b60 con 0x55762e412960 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.756+0000 7f298ffff700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e41bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f298f7fe700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e41e3d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f29800c9130 tx=0x7f2980099020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13988d1eba4ffdb7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f296effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f296effd700 1 -- 172.21.15.35:0/2907717068 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29800985d0 con 0x55762e412960 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55762e327390 con 0x55762e412960 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f296effd700 1 -- 172.21.15.35:0/2907717068 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f29800a0bb0 con 0x55762e412960 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f296effd700 1 -- 172.21.15.35:0/2907717068 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29800a0d70 con 0x55762e412960 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f29a207cb80 10 client.16833 fetch_fsmap learned FSMap version 33 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55762e192d80 con 0x55762e412960 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.757+0000 7f296effd700 1 -- 172.21.15.35:0/2907717068 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29800b6030 con 0x55762e412960 2023-03-17T09:33:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f296effd700 1 -- 172.21.15.35:0/2907717068 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2980093af0 con 0x55762e412960 2023-03-17T09:33:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f29a207cb80 10 client.16833 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:33:08.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f29a207cb80 10 client.16833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:33:08.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f29a207cb80 20 client.16833 populate_metadata read hostname 'smithi035' 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e42bde0 0x55762e42e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f29a207cb80 4 client.16833 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55762e333600 con 0x55762e42bde0 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f298effd700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e42bde0 0x55762e42e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f296effd700 10 client.16833 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.758+0000 7f298effd700 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e42bde0 0x55762e42e1f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a9e3771e850f00 server_cookie=b4a13bff3851dcd4 in_seq=0 out_seq=0 2023-03-17T09:33:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f296effd700 1 -- 172.21.15.35:0/2907717068 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55762e333600 con 0x55762e42bde0 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f296effd700 10 client.16833 handle_command_reply: tid=0 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 client.16833 shutdown 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 msgr2=0x55762e41e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e41e3d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f29800c9130 tx=0x7f2980099020 comp rx=0 tx=0).stop 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 shutdown_connections 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e42bde0 0x55762e42e1f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e41bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f296effd700 0 client.16833 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e41e3d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 --2- 172.21.15.35:0/2907717068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e41b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 >> 172.21.15.35:0/2907717068 conn(0x55762e26f6b0 msgr2=0x55762e40ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 shutdown_connections 2023-03-17T09:33:08.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.759+0000 7f29a207cb80 1 -- 172.21.15.35:0/2907717068 wait complete. 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.760+0000 7f29a207cb80 20 client.16833 trim_cache size 0 max 16384 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 Processor -- start 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 -- start start 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e40cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e422fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:08.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e40d720 con 0x55762e412960 2023-03-17T09:33:08.071 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:09 smithi035 ceph-mon[92535]: osdmap e152: 12 total, 12 up, 12 in 2023-03-17T09:33:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e40e400 con 0x55762e417be0 2023-03-17T09:33:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f29a207cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e409b60 con 0x55762e4184f0 2023-03-17T09:33:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e40cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e40cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45676/0 (socket says 172.21.15.35:45676) 2023-03-17T09:33:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 -- 172.21.15.35:0/944168748 learned_addr learned my addr 172.21.15.35:0/944168748 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298effd700 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e422fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298ffff700 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 -- 172.21.15.35:0/944168748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 msgr2=0x55762e4190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 -- 172.21.15.35:0/944168748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 msgr2=0x55762e422fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e422fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.776+0000 7f298f7fe700 1 -- 172.21.15.35:0/944168748 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762e32b130 con 0x55762e412960 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.777+0000 7f298f7fe700 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e40cac0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f29800095c0 tx=0x7f2980098b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcd2fff3ce322c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.777+0000 7f29767fc700 1 -- 172.21.15.35:0/944168748 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980063070 con 0x55762e412960 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.777+0000 7f29767fc700 1 -- 172.21.15.35:0/944168748 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29800b6070 con 0x55762e412960 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.777+0000 7f29767fc700 1 -- 172.21.15.35:0/944168748 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29800983d0 con 0x55762e412960 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.777+0000 7f29a207cb80 1 -- 172.21.15.35:0/944168748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 msgr2=0x55762e40cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.777+0000 7f29a207cb80 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e40cac0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f29800095c0 tx=0x7f2980098b50 comp rx=0 tx=0).stop 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- 172.21.15.35:0/944168748 shutdown_connections 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e412960 0x55762e40cac0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 --2- 172.21.15.35:0/944168748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e417be0 0x55762e422fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- 172.21.15.35:0/944168748 >> 172.21.15.35:0/944168748 conn(0x55762e26f6b0 msgr2=0x55762e418990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- 172.21.15.35:0/944168748 shutdown_connections 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- 172.21.15.35:0/944168748 wait complete. 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- start start 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 Processor -- start 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e412960 0x55762e414a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 0x55762e414f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e413c10 con 0x55762e417be0 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e413d80 con 0x55762e412960 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.778+0000 7f29a207cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e413f40 con 0x55762e4184f0 2023-03-17T09:33:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f29a207cb80 10 client.0 _ll_register_callbacks cb 0x55762e20a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 0x55762e414f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 0x55762e414f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45684/0 (socket says 172.21.15.35:45684) 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 -- 172.21.15.35:0/3429300515 learned_addr learned my addr 172.21.15.35:0/3429300515 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298ffff700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298f7fe700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e412960 0x55762e414a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 -- 172.21.15.35:0/3429300515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 msgr2=0x55762e4136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 -- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e412960 msgr2=0x55762e414a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e412960 0x55762e414a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 -- 172.21.15.35:0/3429300515 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55762e192d80 con 0x55762e417be0 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f298effd700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 0x55762e414f80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f29900fd800 tx=0x7f29840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb694f1fb02b94f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f296effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f296effd700 1 -- 172.21.15.35:0/3429300515 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984023040 con 0x55762e417be0 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f296effd700 1 -- 172.21.15.35:0/3429300515 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2984027ae0 con 0x55762e417be0 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.779+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55762e3e21e0 con 0x55762e417be0 2023-03-17T09:33:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f296effd700 1 -- 172.21.15.35:0/3429300515 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2984027770 con 0x55762e417be0 2023-03-17T09:33:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 10 client.16839 fetch_fsmap learned FSMap version 33 2023-03-17T09:33:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55762e1b91f0 con 0x55762e417be0 2023-03-17T09:33:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f296effd700 1 -- 172.21.15.35:0/3429300515 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55762e3e21e0 con 0x55762e417be0 2023-03-17T09:33:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f296effd700 1 -- 172.21.15.35:0/3429300515 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f298401d410 con 0x55762e417be0 2023-03-17T09:33:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 10 client.16839 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:33:18.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 10 client.16839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:33:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 20 client.16839 populate_metadata read hostname 'smithi035' 2023-03-17T09:33:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e485040 0x55762e487450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 4 client.16839 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:33:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55762e1e8f00 con 0x55762e485040 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.780+0000 7f298f7fe700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e485040 0x55762e487450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.781+0000 7f296effd700 10 client.16839 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.781+0000 7f298f7fe700 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e485040 0x55762e487450 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6175a4975f66d4e server_cookie=6ffad866bb40bc3c in_seq=0 out_seq=0 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.784+0000 7f296effd700 1 -- 172.21.15.35:0/3429300515 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55762e1e8f00 con 0x55762e485040 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.784+0000 7f296effd700 10 client.16839 handle_command_reply: tid=0 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.784+0000 7f29a207cb80 1 client.16839 shutdown 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 msgr2=0x55762e414f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 0x55762e414f80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f29900fd800 tx=0x7f29840047c0 comp rx=0 tx=0).stop 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 shutdown_connections 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55762e485040 0x55762e487450 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55762e4184f0 0x55762e4136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55762e412960 0x55762e414a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f296effd700 0 client.16839 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 --2- 172.21.15.35:0/3429300515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55762e417be0 0x55762e414f80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 >> 172.21.15.35:0/3429300515 conn(0x55762e26f6b0 msgr2=0x55762e419220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 shutdown_connections 2023-03-17T09:33:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 1 -- 172.21.15.35:0/3429300515 wait complete. 2023-03-17T09:33:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f29a207cb80 20 client.16839 trim_cache size 0 max 16384 2023-03-17T09:33:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f297809f640 msgr2=0x7f29780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f297809f640 0x7f29780a1af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f29900688b0 tx=0x7f2984009260 comp rx=0 tx=0).stop 2023-03-17T09:33:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 msgr2=0x7f29901970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29901970d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2980009fd0 tx=0x7f298000f690 comp rx=0 tx=0).stop 2023-03-17T09:33:22.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 shutdown_connections 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f297809f640 0x7f29780a1af0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2990104390 0x7f29901a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29900ff350 0x7f29901970d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 --2- 172.21.15.35:0/2432483295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29900ffcf0 0x7f2990197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.785+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 >> 172.21.15.35:0/2432483295 conn(0x7f2990076330 msgr2=0x7f2990102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.786+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 shutdown_connections 2023-03-17T09:33:22.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:44.786+0000 7f2995eef700 1 -- 172.21.15.35:0/2432483295 wait complete. 2023-03-17T09:33:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 -- 172.21.15.35:0/2514226461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f87941013d0 msgr2=0x7f87941017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 --2- 172.21.15.35:0/2514226461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f87941013d0 0x7f87941017a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8790009990 tx=0x7f8790009ca0 comp rx=0 tx=0).stop 2023-03-17T09:33:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 -- 172.21.15.35:0/2514226461 shutdown_connections 2023-03-17T09:33:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 --2- 172.21.15.35:0/2514226461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879410a7a0 0x7f879410cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 --2- 172.21.15.35:0/2514226461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f87941013d0 0x7f87941017a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 --2- 172.21.15.35:0/2514226461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8794101ce0 0x7f879410a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.907+0000 7f879ad12700 1 -- 172.21.15.35:0/2514226461 >> 172.21.15.35:0/2514226461 conn(0x7f8794076330 msgr2=0x7f8794076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 -- 172.21.15.35:0/2514226461 shutdown_connections 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 -- 172.21.15.35:0/2514226461 wait complete. 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 Processor -- start 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 -- start start 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87941013d0 0x7f8794198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 0x7f8794198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879410a7a0 0x7f879419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879419d570 con 0x7f8794101ce0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879419d6e0 con 0x7f879410a7a0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f879ad12700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879419d8a0 con 0x7f87941013d0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.908+0000 7f878bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 0x7f8794198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 0x7f8794198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45698/0 (socket says 172.21.15.35:45698) 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 -- 172.21.15.35:0/4012287973 learned_addr learned my addr 172.21.15.35:0/4012287973 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f8798aae700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87941013d0 0x7f8794198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f87992af700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879410a7a0 0x7f879419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 -- 172.21.15.35:0/4012287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87941013d0 msgr2=0x7f8794198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87941013d0 0x7f8794198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 -- 172.21.15.35:0/4012287973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879410a7a0 msgr2=0x7f879419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879410a7a0 0x7f879419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 -- 172.21.15.35:0/4012287973 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900095f0 con 0x7f8794101ce0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f878bfff700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 0x7f8794198ad0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f878400e9a0 tx=0x7f878400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f8789ffb700 1 -- 172.21.15.35:0/4012287973 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784009790 con 0x7f8794101ce0 2023-03-17T09:33:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f8789ffb700 1 -- 172.21.15.35:0/4012287973 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f878400cbd0 con 0x7f8794101ce0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f8789ffb700 1 -- 172.21.15.35:0/4012287973 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784018680 con 0x7f8794101ce0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8794110100 con 0x7f8794101ce0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.909+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879410ff70 con 0x7f8794101ce0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.912+0000 7f8789ffb700 1 -- 172.21.15.35:0/4012287973 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f878400cd40 con 0x7f8794101ce0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.912+0000 7f8789ffb700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f877c09f6c0 0x7f877c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.912+0000 7f8789ffb700 1 -- 172.21.15.35:0/4012287973 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8784014070 con 0x7f8794101ce0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.912+0000 7f8798aae700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f877c09f6c0 0x7f877c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f8798aae700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f877c09f6c0 0x7f877c0a1b70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8790006010 tx=0x7f879000b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 Processor -- start 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 -- start start 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c12be0 0x562326c12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c134f0 0x562326c0d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326b14010 con 0x562326c0d960 2023-03-17T09:33:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326b66950 con 0x562326c12be0 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.913+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326b5fde0 con 0x562326c134f0 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45706/0 (socket says 172.21.15.35:45706) 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 -- 172.21.15.35:0/598294128 learned_addr learned my addr 172.21.15.35:0/598294128 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f8798aae700 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c12be0 0x562326c12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f878bfff700 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c134f0 0x562326c0d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 -- 172.21.15.35:0/598294128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c134f0 msgr2=0x562326c0d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c134f0 0x562326c0d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 -- 172.21.15.35:0/598294128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c12be0 msgr2=0x562326c12fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c12be0 0x562326c12fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 -- 172.21.15.35:0/598294128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623269e15d0 con 0x562326c0d960 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f87992af700 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0dd90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f878c009440 tx=0x7f878c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd05d5cf204556a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f877affd700 1 -- 172.21.15.35:0/598294128 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c00e070 con 0x562326c0d960 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f877affd700 1 -- 172.21.15.35:0/598294128 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f878c00f040 con 0x562326c0d960 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.914+0000 7f877affd700 1 -- 172.21.15.35:0/598294128 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c015a40 con 0x562326c0d960 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/598294128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 msgr2=0x562326c0dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0dd90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f878c009440 tx=0x7f878c009920 comp rx=0 tx=0).stop 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/598294128 shutdown_connections 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0dd90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c12be0 0x562326c12fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/598294128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c134f0 0x562326c0d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/598294128 >> 172.21.15.35:0/598294128 conn(0x562326a6a6b0 msgr2=0x562326c07a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/598294128 shutdown_connections 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/598294128 wait complete. 2023-03-17T09:33:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.915+0000 7f87a6e9fb80 1 -- start start 2023-03-17T09:33:25.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:10 smithi035 ceph-mon[92535]: pgmap v1207: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:33:27.221 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:12 smithi035 ceph-mon[92535]: pgmap v1208: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:14 smithi035 ceph-mon[92535]: pgmap v1209: 97 pgs: 97 active+clean; 1.5 MiB data, 209 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:15 smithi035 ceph-mon[92535]: osdmap e153: 12 total, 12 up, 12 in 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:16 smithi035 ceph-mon[92535]: pgmap v1211: 97 pgs: 97 active+clean; 1.5 MiB data, 209 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:18 smithi035 ceph-mon[92535]: pgmap v1212: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:20 smithi035 ceph-mon[92535]: pgmap v1213: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:22 smithi035 ceph-mon[92535]: pgmap v1214: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:24 smithi035 ceph-mon[92535]: pgmap v1215: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:26 smithi035 ceph-mon[92535]: pgmap v1216: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:28 smithi035 ceph-mon[92535]: pgmap v1217: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:30 smithi035 ceph-mon[92535]: pgmap v1218: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:33:27.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:32 smithi035 ceph-mon[92535]: pgmap v1219: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:34 smithi035 ceph-mon[92535]: pgmap v1220: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:36 smithi035 ceph-mon[92535]: pgmap v1221: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:38 smithi035 ceph-mon[92535]: pgmap v1222: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:40 smithi035 ceph-mon[92535]: pgmap v1223: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:42 smithi035 ceph-mon[92535]: pgmap v1224: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:44 smithi035 ceph-mon[92535]: pgmap v1225: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:46 smithi035 ceph-mon[92535]: pgmap v1226: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:48 smithi035 ceph-mon[92535]: pgmap v1227: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:50 smithi035 ceph-mon[92535]: pgmap v1228: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:52 smithi035 ceph-mon[92535]: pgmap v1229: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:54 smithi035 ceph-mon[92535]: pgmap v1230: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:56 smithi035 ceph-mon[92535]: pgmap v1231: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:24:58 smithi035 ceph-mon[92535]: pgmap v1232: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:00 smithi035 ceph-mon[92535]: pgmap v1233: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:33:27.223 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:02 smithi035 ceph-mon[92535]: pgmap v1234: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:33:27.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:04 smithi035 ceph-mon[92535]: pgmap v1235: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:33:28.048 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:06 smithi035 ceph-mon[92535]: pgmap v1236: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:33:28.048 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:08 smithi035 ceph-mon[92535]: pgmap v1237: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T09:33:28.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:09 smithi035 ceph-mon[92535]: osdmap e154: 12 total, 12 up, 12 in 2023-03-17T09:33:28.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:10 smithi035 ceph-mon[92535]: pgmap v1239: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:33:28.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:12 smithi035 ceph-mon[92535]: pgmap v1240: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:33:28.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:14 smithi035 ceph-mon[92535]: pgmap v1241: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:33:28.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:16 smithi035 ceph-mon[92535]: osdmap e155: 12 total, 12 up, 12 in 2023-03-17T09:33:28.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:33:28.588 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:16 smithi035 ceph-mon[92535]: pgmap v1243: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T09:33:28.589 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:33:28.863 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:33:28.863 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:33:28.863 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:18 smithi035 ceph-mon[92535]: pgmap v1244: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 114 B/s wr, 11 op/s 2023-03-17T09:33:29.470 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:20 smithi035 ceph-mon[92535]: pgmap v1245: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:33:29.470 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:22 smithi035 ceph-mon[92535]: pgmap v1246: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:33:29.470 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:24 smithi035 ceph-mon[92535]: pgmap v1247: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:33:29.749 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:26 smithi035 ceph-mon[92535]: pgmap v1248: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 507 B/s wr, 10 op/s 2023-03-17T09:33:29.749 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:28 smithi035 ceph-mon[92535]: pgmap v1249: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T09:33:29.749 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:30 smithi035 ceph-mon[92535]: pgmap v1250: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:33:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:33:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:33:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:33:31.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:33:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:33:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:33:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:33:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:33:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:33:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 Processor -- start 2023-03-17T09:33:34.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c193f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:34.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c16670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c16c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623269e38c0 con 0x562326c12be0 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c17410 con 0x562326c134f0 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c23000 con 0x562326c0d960 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87a6e9fb80 10 client.0 _ll_register_callbacks cb 0x562326a05230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c16670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c16670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45710/0 (socket says 172.21.15.35:45710) 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 -- 172.21.15.35:0/1667224585 learned_addr learned my addr 172.21.15.35:0/1667224585 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f8798aae700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c193f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87992af700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c16c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 -- 172.21.15.35:0/1667224585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 msgr2=0x562326c193f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c193f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 -- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 msgr2=0x562326c16c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c16c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f878bfff700 1 -- 172.21.15.35:0/1667224585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0090f0 con 0x562326c12be0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.916+0000 7f87992af700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c16c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f878bfff700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c16670 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f878400c5b0 tx=0x7f8784098420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e89a3546265d87 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f8773fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f8773fff700 1 -- 172.21.15.35:0/1667224585 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784097b10 con 0x562326c12be0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f8773fff700 1 -- 172.21.15.35:0/1667224585 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f87840a0180 con 0x562326c12be0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562326b22390 con 0x562326c12be0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f8773fff700 1 -- 172.21.15.35:0/1667224585 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87840a0340 con 0x562326c12be0 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 10 client.16851 fetch_fsmap learned FSMap version 33 2023-03-17T09:33:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56232698dd80 con 0x562326c12be0 2023-03-17T09:33:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f8773fff700 1 -- 172.21.15.35:0/1667224585 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562326b22390 con 0x562326c12be0 2023-03-17T09:33:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f8773fff700 1 -- 172.21.15.35:0/1667224585 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8784097380 con 0x562326c12be0 2023-03-17T09:33:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 10 client.16851 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:33:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 10 client.16851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:33:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 20 client.16851 populate_metadata read hostname 'smithi035' 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c27000 0x562326c29410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 4 client.16851 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.917+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562326b2e600 con 0x562326c27000 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.918+0000 7f8798aae700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c27000 0x562326c29410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.918+0000 7f8773fff700 10 client.16851 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.918+0000 7f8798aae700 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c27000 0x562326c29410 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0fa49e93c2e9cb9 server_cookie=1cb3cf27cefbb8a8 in_seq=0 out_seq=0 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f8773fff700 1 -- 172.21.15.35:0/1667224585 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562326b2e600 con 0x562326c27000 2023-03-17T09:33:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f8773fff700 10 client.16851 handle_command_reply: tid=0 2023-03-17T09:33:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 client.16851 shutdown 2023-03-17T09:33:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 msgr2=0x562326c16670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c16670 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f878400c5b0 tx=0x7f8784098420 comp rx=0 tx=0).stop 2023-03-17T09:33:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 shutdown_connections 2023-03-17T09:33:36.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c27000 0x562326c29410 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c16c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f8773fff700 0 client.16851 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c193f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/1667224585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c16670 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 >> 172.21.15.35:0/1667224585 conn(0x562326a6a6b0 msgr2=0x562326c07a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.919+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 shutdown_connections 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.920+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/1667224585 wait complete. 2023-03-17T09:33:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.920+0000 7f87a6e9fb80 20 client.16851 trim_cache size 0 max 16384 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 Processor -- start 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 -- start start 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c0d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c1df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c24770 con 0x562326c12be0 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c086f0 con 0x562326c134f0 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c08000 con 0x562326c0d960 2023-03-17T09:33:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c07ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45718/0 (socket says 172.21.15.35:45718) 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 -- 172.21.15.35:0/2977111846 learned_addr learned my addr 172.21.15.35:0/2977111846 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f8798aae700 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c0d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87992af700 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c1df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 -- 172.21.15.35:0/2977111846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 msgr2=0x562326c0d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c0d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 -- 172.21.15.35:0/2977111846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 msgr2=0x562326c1df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c1df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:39.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 -- 172.21.15.35:0/2977111846 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562326b26130 con 0x562326c12be0 2023-03-17T09:33:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f87992af700 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c1df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:33:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.935+0000 7f878bfff700 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c07ac0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8784098120 tx=0x7f87840a0790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ecce58220db9f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f877b7fe700 1 -- 172.21.15.35:0/2977111846 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840c6070 con 0x562326c12be0 2023-03-17T09:33:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f877b7fe700 1 -- 172.21.15.35:0/2977111846 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87840b62f0 con 0x562326c12be0 2023-03-17T09:33:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f877b7fe700 1 -- 172.21.15.35:0/2977111846 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840a0180 con 0x562326c12be0 2023-03-17T09:33:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/2977111846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 msgr2=0x562326c07ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c07ac0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8784098120 tx=0x7f87840a0790 comp rx=0 tx=0).stop 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/2977111846 shutdown_connections 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c1df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c0d960 0x562326c0d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/2977111846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c12be0 0x562326c07ac0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/2977111846 >> 172.21.15.35:0/2977111846 conn(0x562326a6a6b0 msgr2=0x562326c10840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/2977111846 shutdown_connections 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.936+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/2977111846 wait complete. 2023-03-17T09:33:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 -- start start 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 Processor -- start 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c12be0 0x562326c0e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c0f120 con 0x562326c0d960 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c0f290 con 0x562326c134f0 2023-03-17T09:33:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562326c0f450 con 0x562326c12be0 2023-03-17T09:33:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87a6e9fb80 10 client.0 _ll_register_callbacks cb 0x562326a05230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:33:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45722/0 (socket says 172.21.15.35:45722) 2023-03-17T09:33:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 -- 172.21.15.35:0/587122701 learned_addr learned my addr 172.21.15.35:0/587122701 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f878bfff700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c12be0 0x562326c0e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f87992af700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 -- 172.21.15.35:0/587122701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c12be0 msgr2=0x562326c0e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c12be0 0x562326c0e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 -- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 msgr2=0x562326c0ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c0ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f8798aae700 1 -- 172.21.15.35:0/587122701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56232698dd80 con 0x562326c0d960 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.937+0000 7f878bfff700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c12be0 0x562326c0e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8798aae700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0fdc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8790005910 tx=0x7f8790009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bcd9d44e0f6c45 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8773fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8773fff700 1 -- 172.21.15.35:0/587122701 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000be60 con 0x562326c0d960 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8773fff700 1 -- 172.21.15.35:0/587122701 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f879000fde0 con 0x562326c0d960 2023-03-17T09:33:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562326bdd1e0 con 0x562326c0d960 2023-03-17T09:33:45.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8773fff700 1 -- 172.21.15.35:0/587122701 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8790035ad0 con 0x562326c0d960 2023-03-17T09:33:45.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 10 client.16857 fetch_fsmap learned FSMap version 33 2023-03-17T09:33:45.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5623269b41f0 con 0x562326c0d960 2023-03-17T09:33:45.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8773fff700 1 -- 172.21.15.35:0/587122701 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562326bdd1e0 con 0x562326c0d960 2023-03-17T09:33:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f8773fff700 1 -- 172.21.15.35:0/587122701 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f879003b020 con 0x562326c0d960 2023-03-17T09:33:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 10 client.16857 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:33:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:33:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 20 client.16857 populate_metadata read hostname 'smithi035' 2023-03-17T09:33:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c7c040 0x562326c7e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 4 client.16857 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.938+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623269e3f00 con 0x562326c7c040 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.939+0000 7f878bfff700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c7c040 0x562326c7e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.939+0000 7f8773fff700 10 client.16857 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.939+0000 7f878bfff700 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c7c040 0x562326c7e450 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3b8970d68cf870 server_cookie=54705217627b1e81 in_seq=0 out_seq=0 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f8773fff700 1 -- 172.21.15.35:0/587122701 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623269e3f00 con 0x562326c7c040 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f8773fff700 10 client.16857 handle_command_reply: tid=0 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 client.16857 shutdown 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 msgr2=0x562326c0fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0fdc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8790005910 tx=0x7f8790009ca0 comp rx=0 tx=0).stop 2023-03-17T09:33:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 shutdown_connections 2023-03-17T09:33:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562326c7c040 0x562326c7e450 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562326c134f0 0x562326c0ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562326c0d960 0x562326c0fdc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 --2- 172.21.15.35:0/587122701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562326c12be0 0x562326c0e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f8773fff700 0 client.16857 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.943+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 >> 172.21.15.35:0/587122701 conn(0x562326a6a6b0 msgr2=0x562326c13990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 shutdown_connections 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f87a6e9fb80 1 -- 172.21.15.35:0/587122701 wait complete. 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f87a6e9fb80 20 client.16857 trim_cache size 0 max 16384 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f877c09f6c0 msgr2=0x7f877c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f877c09f6c0 0x7f877c0a1b70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8790006010 tx=0x7f879000b260 comp rx=0 tx=0).stop 2023-03-17T09:33:48.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 msgr2=0x7f8794198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 0x7f8794198ad0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f878400e9a0 tx=0x7f878400ecb0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 shutdown_connections 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f877c09f6c0 0x7f877c0a1b70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f879410a7a0 0x7f879419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87941013d0 0x7f8794198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 --2- 172.21.15.35:0/4012287973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8794101ce0 0x7f8794198ad0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 >> 172.21.15.35:0/4012287973 conn(0x7f8794076330 msgr2=0x7f87940ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 shutdown_connections 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:10:57.944+0000 7f879ad12700 1 -- 172.21.15.35:0/4012287973 wait complete. 2023-03-17T09:33:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 -- 172.21.15.35:0/2045677370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ffd70 msgr2=0x7f8200103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 --2- 172.21.15.35:0/2045677370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ffd70 0x7f8200103d30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f81f40099c0 tx=0x7f81f4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 -- 172.21.15.35:0/2045677370 shutdown_connections 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 --2- 172.21.15.35:0/2045677370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8200104410 0x7f820010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 --2- 172.21.15.35:0/2045677370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82000ff3d0 0x7f82000ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 --2- 172.21.15.35:0/2045677370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ffd70 0x7f8200103d30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 -- 172.21.15.35:0/2045677370 >> 172.21.15.35:0/2045677370 conn(0x7f8200076f80 msgr2=0x7f8200077380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 -- 172.21.15.35:0/2045677370 shutdown_connections 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.067+0000 7f8206662700 1 -- 172.21.15.35:0/2045677370 wait complete. 2023-03-17T09:33:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.068+0000 7f8206662700 1 Processor -- start 2023-03-17T09:33:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.068+0000 7f8206662700 1 -- start start 2023-03-17T09:33:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.068+0000 7f8206662700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 0x7f8200198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.068+0000 7f8206662700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82000ffd70 0x7f82001989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.068+0000 7f8206662700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8200104410 0x7f820019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f8206662700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820019d460 con 0x7f82000ff3d0 2023-03-17T09:33:50.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:32 smithi035 ceph-mon[92535]: pgmap v1251: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:33:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f8206662700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820019d5d0 con 0x7f82000ffd70 2023-03-17T09:33:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f8206662700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820019d790 con 0x7f8200104410 2023-03-17T09:33:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 0x7f8200198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 0x7f8200198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45734/0 (socket says 172.21.15.35:45734) 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 -- 172.21.15.35:0/1524466394 learned_addr learned my addr 172.21.15.35:0/1524466394 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f8204bff700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8200104410 0x7f820019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82000ffd70 0x7f82001989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 -- 172.21.15.35:0/1524466394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8200104410 msgr2=0x7f820019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8200104410 0x7f820019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 -- 172.21.15.35:0/1524466394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82000ffd70 msgr2=0x7f82001989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82000ffd70 0x7f82001989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 -- 172.21.15.35:0/1524466394 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40095f0 con 0x7f82000ff3d0 2023-03-17T09:33:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fffff700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 0x7f8200198480 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f81f000e9a0 tx=0x7f81f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fd7fa700 1 -- 172.21.15.35:0/1524466394 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0009790 con 0x7f82000ff3d0 2023-03-17T09:33:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fd7fa700 1 -- 172.21.15.35:0/1524466394 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81f000cbd0 con 0x7f82000ff3d0 2023-03-17T09:33:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f81fd7fa700 1 -- 172.21.15.35:0/1524466394 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0018680 con 0x7f82000ff3d0 2023-03-17T09:33:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820010f040 con 0x7f82000ff3d0 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.069+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820010eeb0 con 0x7f82000ff3d0 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.072+0000 7f81fd7fa700 1 -- 172.21.15.35:0/1524466394 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f81f000cd40 con 0x7f82000ff3d0 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.072+0000 7f81fd7fa700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f81e809f6c0 0x7f81e80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.072+0000 7f81fd7fa700 1 -- 172.21.15.35:0/1524466394 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f81f0014070 con 0x7f82000ff3d0 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.072+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f81e809f6c0 0x7f81e80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f81e809f6c0 0x7f81e80a1b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009990 tx=0x7f81f401a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 Processor -- start 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 -- start start 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700138be0 0x564700138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647001394f0 0x564700133420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 0x564700133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470003a010 con 0x564700133960 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470008c950 con 0x564700138be0 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.073+0000 7f82127efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564700085de0 con 0x5647001394f0 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 0x564700133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 0x564700133d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45746/0 (socket says 172.21.15.35:45746) 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 -- 172.21.15.35:0/2876608579 learned_addr learned my addr 172.21.15.35:0/2876608579 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647001394f0 0x564700133420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f81fffff700 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700138be0 0x564700138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 -- 172.21.15.35:0/2876608579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647001394f0 msgr2=0x564700133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647001394f0 0x564700133420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 -- 172.21.15.35:0/2876608579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700138be0 msgr2=0x564700138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700138be0 0x564700138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 -- 172.21.15.35:0/2876608579 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646fff075d0 con 0x564700133960 2023-03-17T09:33:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f8204bff700 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 0x564700133d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f81f8011680 tx=0x7f81f8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1939933fc133c15 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f81e67fc700 1 -- 172.21.15.35:0/2876608579 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800e040 con 0x564700133960 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f81e67fc700 1 -- 172.21.15.35:0/2876608579 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81f800f040 con 0x564700133960 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.074+0000 7f81e67fc700 1 -- 172.21.15.35:0/2876608579 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8004790 con 0x564700133960 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 -- 172.21.15.35:0/2876608579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 msgr2=0x564700133d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 0x564700133d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f81f8011680 tx=0x7f81f8009920 comp rx=0 tx=0).stop 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 -- 172.21.15.35:0/2876608579 shutdown_connections 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700133960 0x564700133d90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700138be0 0x564700138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 --2- 172.21.15.35:0/2876608579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647001394f0 0x564700133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:33:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 -- 172.21.15.35:0/2876608579 >> 172.21.15.35:0/2876608579 conn(0x5646fff906b0 msgr2=0x56470012da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 -- 172.21.15.35:0/2876608579 shutdown_connections 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 -- 172.21.15.35:0/2876608579 wait complete. 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.075+0000 7f82127efb80 1 -- start start 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 Processor -- start 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x56470013f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x56470013c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x56470013cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646fff098c0 con 0x5647001394f0 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470013d490 con 0x564700133960 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470016b010 con 0x564700138be0 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f82127efb80 10 client.0 _ll_register_callbacks cb 0x5646fff2b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x56470013cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x56470013cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45752/0 (socket says 172.21.15.35:45752) 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 -- 172.21.15.35:0/2403998671 learned_addr learned my addr 172.21.15.35:0/2403998671 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x56470013c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:33:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f81fffff700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x56470013f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:00.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 -- 172.21.15.35:0/2403998671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 msgr2=0x56470013c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x56470013c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 -- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 msgr2=0x56470013f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x56470013f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.076+0000 7f8204bff700 1 -- 172.21.15.35:0/2403998671 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8011330 con 0x5647001394f0 2023-03-17T09:34:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f8204bff700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x56470013cd60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f81f8004040 tx=0x7f81f80095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e982e5ce7b72dada server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f81df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:34:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f81df7fe700 1 -- 172.21.15.35:0/2403998671 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800e070 con 0x5647001394f0 2023-03-17T09:34:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f81df7fe700 1 -- 172.21.15.35:0/2403998671 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f81f80093a0 con 0x5647001394f0 2023-03-17T09:34:03.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564700048390 con 0x5647001394f0 2023-03-17T09:34:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f81df7fe700 1 -- 172.21.15.35:0/2403998671 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81f8004500 con 0x5647001394f0 2023-03-17T09:34:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 10 client.16869 fetch_fsmap learned FSMap version 33 2023-03-17T09:34:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5646ffeb3d80 con 0x5647001394f0 2023-03-17T09:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f81df7fe700 1 -- 172.21.15.35:0/2403998671 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564700048390 con 0x5647001394f0 2023-03-17T09:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f81df7fe700 1 -- 172.21.15.35:0/2403998671 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f81f8071070 con 0x5647001394f0 2023-03-17T09:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 10 client.16869 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 20 client.16869 populate_metadata read hostname 'smithi035' 2023-03-17T09:34:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x564700144a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 4 client.16869 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:34:04.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.077+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564700054600 con 0x564700142670 2023-03-17T09:34:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.078+0000 7f81fffff700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x564700144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.078+0000 7f81df7fe700 10 client.16869 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.078+0000 7f81fffff700 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x564700144a80 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=124ee8562bb37f4a server_cookie=5597e31bf720587d in_seq=0 out_seq=0 2023-03-17T09:34:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f81df7fe700 1 -- 172.21.15.35:0/2403998671 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564700054600 con 0x564700142670 2023-03-17T09:34:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f81df7fe700 10 client.16869 handle_command_reply: tid=0 2023-03-17T09:34:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 client.16869 shutdown 2023-03-17T09:34:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 msgr2=0x56470013cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x56470013cd60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f81f8004040 tx=0x7f81f80095e0 comp rx=0 tx=0).stop 2023-03-17T09:34:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 shutdown_connections 2023-03-17T09:34:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x564700144a80 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x56470013cd60 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x56470013f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f81df7fe700 0 client.16869 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 --2- 172.21.15.35:0/2403998671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x56470013c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 >> 172.21.15.35:0/2403998671 conn(0x5646fff906b0 msgr2=0x56470012da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 shutdown_connections 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 1 -- 172.21.15.35:0/2403998671 wait complete. 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.079+0000 7f82127efb80 20 client.16869 trim_cache size 0 max 16384 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.094+0000 7f82127efb80 1 Processor -- start 2023-03-17T09:34:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.094+0000 7f82127efb80 1 -- start start 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.094+0000 7f82127efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700133960 0x564700133420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.094+0000 7f82127efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 0x56470012dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f82127efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5647001394f0 0x564700137f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 0x56470012dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f82127efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470013d110 con 0x564700138be0 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f82127efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470012e000 con 0x5647001394f0 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f82127efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470012a5c0 con 0x564700133960 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 0x56470012dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45758/0 (socket says 172.21.15.35:45758) 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 -- 172.21.15.35:0/194499138 learned_addr learned my addr 172.21.15.35:0/194499138 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81fffff700 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700133960 0x564700133420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 -- 172.21.15.35:0/194499138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700133960 msgr2=0x564700133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700133960 0x564700133420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 -- 172.21.15.35:0/194499138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5647001394f0 msgr2=0x564700137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5647001394f0 0x564700137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 -- 172.21.15.35:0/194499138 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56470004c130 con 0x564700138be0 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81fffff700 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700133960 0x564700133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 0x56470012dac0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000c00 tx=0x7f81f4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ea68b11d569969 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81e6ffd700 1 -- 172.21.15.35:0/194499138 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f401d040 con 0x564700138be0 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81e6ffd700 1 -- 172.21.15.35:0/194499138 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81f4029070 con 0x564700138be0 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.095+0000 7f81e6ffd700 1 -- 172.21.15.35:0/194499138 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4030b40 con 0x564700138be0 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 -- 172.21.15.35:0/194499138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 msgr2=0x56470012dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 0x56470012dac0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000c00 tx=0x7f81f4022000 comp rx=0 tx=0).stop 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 -- 172.21.15.35:0/194499138 shutdown_connections 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5647001394f0 0x564700137f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700133960 0x564700133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 --2- 172.21.15.35:0/194499138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564700138be0 0x56470012dac0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 -- 172.21.15.35:0/194499138 >> 172.21.15.35:0/194499138 conn(0x5646fff906b0 msgr2=0x564700137800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 -- 172.21.15.35:0/194499138 shutdown_connections 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 -- 172.21.15.35:0/194499138 wait complete. 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 -- start start 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.096+0000 7f82127efb80 1 Processor -- start 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x564700198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x564700199530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x564700199a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564700228970 con 0x5647001394f0 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564700228ab0 con 0x564700133960 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564700228bf0 con 0x564700138be0 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f82127efb80 10 client.0 _ll_register_callbacks cb 0x5646fff2b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x564700199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x564700199a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45766/0 (socket says 172.21.15.35:45766) 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 -- 172.21.15.35:0/1784155654 learned_addr learned my addr 172.21.15.35:0/1784155654 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f81fffff700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x564700198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f81ff7fe700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x564700199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 -- 172.21.15.35:0/1784155654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 msgr2=0x564700199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x564700199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 -- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 msgr2=0x564700198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x564700198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 -- 172.21.15.35:0/1784155654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820010c820 con 0x5647001394f0 2023-03-17T09:34:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f8204bff700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x564700199a70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f81f8007e60 tx=0x7f81f8004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71e4527ec263e96 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:14.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:34 smithi035 ceph-mon[92535]: pgmap v1252: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:34:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f81df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.097+0000 7f81df7fe700 1 -- 172.21.15.35:0/1784155654 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800e020 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f81df7fe700 1 -- 172.21.15.35:0/1784155654 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f81f8009920 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647001031e0 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f81df7fe700 1 -- 172.21.15.35:0/1784155654 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81f8015ce0 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 10 client.16875 fetch_fsmap learned FSMap version 33 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5646ffeda1f0 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f81df7fe700 1 -- 172.21.15.35:0/1784155654 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5647001031e0 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f81df7fe700 1 -- 172.21.15.35:0/1784155654 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f81f8024070 con 0x5647001394f0 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 10 client.16875 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:34:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:34:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 20 client.16875 populate_metadata read hostname 'smithi035' 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x56470022c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 4 client.16875 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646fff09f00 con 0x564700142670 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.098+0000 7f81fffff700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x56470022c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.099+0000 7f81df7fe700 10 client.16875 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.099+0000 7f81fffff700 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x56470022c080 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2143d705d4a49d82 server_cookie=3576697f8c37777e in_seq=0 out_seq=0 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f81df7fe700 1 -- 172.21.15.35:0/1784155654 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646fff09f00 con 0x564700142670 2023-03-17T09:34:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f81df7fe700 10 client.16875 handle_command_reply: tid=0 2023-03-17T09:34:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 client.16875 shutdown 2023-03-17T09:34:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 msgr2=0x564700199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x564700199a70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f81f8007e60 tx=0x7f81f8004160 comp rx=0 tx=0).stop 2023-03-17T09:34:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 shutdown_connections 2023-03-17T09:34:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564700142670 0x56470022c080 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5647001394f0 0x564700199a70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564700133960 0x564700198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 --2- 172.21.15.35:0/1784155654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564700138be0 0x564700199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f81df7fe700 0 client.16875 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 >> 172.21.15.35:0/1784155654 conn(0x5646fff906b0 msgr2=0x56470013e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 shutdown_connections 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 1 -- 172.21.15.35:0/1784155654 wait complete. 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.106+0000 7f82127efb80 20 client.16875 trim_cache size 0 max 16384 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f81e809f6c0 msgr2=0x7f81e80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f81e809f6c0 0x7f81e80a1b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009990 tx=0x7f81f401a040 comp rx=0 tx=0).stop 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 msgr2=0x7f8200198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 0x7f8200198480 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f81f000e9a0 tx=0x7f81f000ecb0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 shutdown_connections 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f81e809f6c0 0x7f81e80a1b70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8200104410 0x7f820019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82000ff3d0 0x7f8200198480 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 --2- 172.21.15.35:0/1524466394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82000ffd70 0x7f82001989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 >> 172.21.15.35:0/1524466394 conn(0x7f8200076f80 msgr2=0x7f82000fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 shutdown_connections 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:11:11.107+0000 7f8206662700 1 -- 172.21.15.35:0/1524466394 wait complete. 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/4063282970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b4104390 msgr2=0x7ff8b410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/4063282970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b4104390 0x7ff8b410bf60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00b0d0 tx=0x7ff8ac00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/4063282970 shutdown_connections 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/4063282970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b4104390 0x7ff8b410bf60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/4063282970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff350 0x7ff8b40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/4063282970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/4063282970 >> 172.21.15.35:0/4063282970 conn(0x7ff8b4076330 msgr2=0x7ff8b4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/4063282970 shutdown_connections 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.553+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/4063282970 wait complete. 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 Processor -- start 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 -- start start 2023-03-17T09:34:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff350 0x7ff8b4197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4104390 0x7ff8b41a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4198070 con 0x7ff8b40ffcf0 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b41a27e0 con 0x7ff8b4104390 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8bbfe7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b41a2950 con 0x7ff8b40ff350 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8b9582700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8b9582700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45778/0 (socket says 172.21.15.35:45778) 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8b9582700 1 -- 172.21.15.35:0/965563553 learned_addr learned my addr 172.21.15.35:0/965563553 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8ba584700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4104390 0x7ff8b41a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff350 0x7ff8b4197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8b9582700 1 -- 172.21.15.35:0/965563553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff350 msgr2=0x7ff8b4197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.554+0000 7ff8b9582700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff350 0x7ff8b4197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8b9582700 1 -- 172.21.15.35:0/965563553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4104390 msgr2=0x7ff8b41a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8b9582700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4104390 0x7ff8b41a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8b9582700 1 -- 172.21.15.35:0/965563553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009d00 con 0x7ff8b40ffcf0 2023-03-17T09:34:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8ba584700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4104390 0x7ff8b41a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:34:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8b9582700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4197760 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400d950 tx=0x7ff8a400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8aaffd700 1 -- 172.21.15.35:0/965563553 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4004220 con 0x7ff8b40ffcf0 2023-03-17T09:34:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8aaffd700 1 -- 172.21.15.35:0/965563553 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8a4004cc0 con 0x7ff8b40ffcf0 2023-03-17T09:34:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b410f010 con 0x7ff8b40ffcf0 2023-03-17T09:34:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8aaffd700 1 -- 172.21.15.35:0/965563553 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4005600 con 0x7ff8b40ffcf0 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.555+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b410ee80 con 0x7ff8b40ffcf0 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.557+0000 7ff8aaffd700 1 -- 172.21.15.35:0/965563553 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff8a4004380 con 0x7ff8b40ffcf0 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.558+0000 7ff8aaffd700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff8a009f640 0x7ff8a00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.558+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff8a009f640 0x7ff8a00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.558+0000 7ff8aaffd700 1 -- 172.21.15.35:0/965563553 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff8a40ca3e0 con 0x7ff8b40ffcf0 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.559+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff8a009f640 0x7ff8a00a1af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009c60 tx=0x7ff8b0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.559+0000 7ff8c8174b80 1 Processor -- start 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.559+0000 7ff8c8174b80 1 -- start start 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e030f90 0x557b4e031360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e0318a0 0x557b4e02b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e02c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:21.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4df2e010 con 0x557b4e02bd70 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4df80950 con 0x557b4e030f90 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4df79de0 con 0x557b4e0318a0 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e02c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e02c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45786/0 (socket says 172.21.15.35:45786) 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 -- 172.21.15.35:0/3178531177 learned_addr learned my addr 172.21.15.35:0/3178531177 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8b9582700 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e0318a0 0x557b4e02b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e030f90 0x557b4e031360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:21.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 -- 172.21.15.35:0/3178531177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e0318a0 msgr2=0x557b4e02b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:21.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e0318a0 0x557b4e02b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:21.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 -- 172.21.15.35:0/3178531177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e030f90 msgr2=0x557b4e031360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:21.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e030f90 0x557b4e031360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:21.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 -- 172.21.15.35:0/3178531177 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b4ddfb5d0 con 0x557b4e02bd70 2023-03-17T09:34:21.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.560+0000 7ff8ba584700 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e02c1c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac015000 tx=0x7ff8ac006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95da46a383407b04 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff89ffff700 1 -- 172.21.15.35:0/3178531177 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00e040 con 0x557b4e02bd70 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff89ffff700 1 -- 172.21.15.35:0/3178531177 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8ac009b80 con 0x557b4e02bd70 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff89ffff700 1 -- 172.21.15.35:0/3178531177 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac01c6a0 con 0x557b4e02bd70 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 -- 172.21.15.35:0/3178531177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 msgr2=0x557b4e02c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e02c1c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac015000 tx=0x7ff8ac006210 comp rx=0 tx=0).stop 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 -- 172.21.15.35:0/3178531177 shutdown_connections 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e02c1c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e030f90 0x557b4e031360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/3178531177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e0318a0 0x557b4e02b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.561+0000 7ff8c8174b80 1 -- 172.21.15.35:0/3178531177 >> 172.21.15.35:0/3178531177 conn(0x557b4de846b0 msgr2=0x557b4e021a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.562+0000 7ff8c8174b80 1 -- 172.21.15.35:0/3178531177 shutdown_connections 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.562+0000 7ff8c8174b80 1 -- 172.21.15.35:0/3178531177 wait complete. 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.562+0000 7ff8c8174b80 1 -- start start 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.562+0000 7ff8c8174b80 1 Processor -- start 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.562+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e0377e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e0349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e034fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4ddfd8c0 con 0x557b4e02bd70 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4e0356f0 con 0x557b4e0318a0 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4e0358b0 con 0x557b4e030f90 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 10 client.0 _ll_register_callbacks cb 0x557b4de1f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e0377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e0377e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45790/0 (socket says 172.21.15.35:45790) 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 -- 172.21.15.35:0/4233521225 learned_addr learned my addr 172.21.15.35:0/4233521225 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e0349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8ba584700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e034fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 -- 172.21.15.35:0/4233521225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 msgr2=0x557b4e0349f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e0349f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 -- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 msgr2=0x557b4e034fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e034fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 -- 172.21.15.35:0/4233521225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b410c7a0 con 0x557b4e02bd70 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e0349f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e0377e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff8b001ebe0 tx=0x7ff8b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca39fbd620d87ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff89d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4233521225 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000ea50 con 0x557b4e02bd70 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4233521225 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff8b000ebb0 con 0x557b4e02bd70 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.563+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b4df3c390 con 0x557b4e02bd70 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4233521225 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8b000ed70 con 0x557b4e02bd70 2023-03-17T09:34:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 10 client.16887 fetch_fsmap learned FSMap version 33 2023-03-17T09:34:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x557b4dda7d80 con 0x557b4e02bd70 2023-03-17T09:34:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4233521225 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557b4df3c390 con 0x557b4e02bd70 2023-03-17T09:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4233521225 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff8b00263e0 con 0x557b4e02bd70 2023-03-17T09:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 10 client.16887 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:34:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 20 client.16887 populate_metadata read hostname 'smithi035' 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e045550 0x557b4e047960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 4 client.16887 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b4df48600 con 0x557b4e045550 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.564+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e045550 0x557b4e047960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.565+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e045550 0x557b4e047960 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb4e209fff4b11c0 server_cookie=e382ca82b1730cba in_seq=0 out_seq=0 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.565+0000 7ff89d7fa700 10 client.16887 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4233521225 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557b4df48600 con 0x557b4e045550 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff89d7fa700 10 client.16887 handle_command_reply: tid=0 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 client.16887 shutdown 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 msgr2=0x557b4e0377e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e0377e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff8b001ebe0 tx=0x7ff8b00047c0 comp rx=0 tx=0).stop 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 shutdown_connections 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e045550 0x557b4e047960 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e034fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff89d7fa700 0 client.16887 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:23.139 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:36 smithi035 ceph-mon[92535]: pgmap v1253: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:34:23.139 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:38 smithi035 ceph-mon[92535]: pgmap v1254: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:23.139 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:40 smithi035 ceph-mon[92535]: pgmap v1255: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:34:23.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:42 smithi035 ceph-mon[92535]: pgmap v1256: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:34:23.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:44 smithi035 ceph-mon[92535]: pgmap v1257: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:46 smithi035 ceph-mon[92535]: pgmap v1258: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:48 smithi035 ceph-mon[92535]: pgmap v1259: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:50 smithi035 ceph-mon[92535]: pgmap v1260: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:52 smithi035 ceph-mon[92535]: pgmap v1261: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:54 smithi035 ceph-mon[92535]: pgmap v1262: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:56 smithi035 ceph-mon[92535]: pgmap v1263: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:23.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:25:58 smithi035 ceph-mon[92535]: pgmap v1264: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:23.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:00 smithi035 ceph-mon[92535]: pgmap v1265: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:23.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:02 smithi035 ceph-mon[92535]: pgmap v1266: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:23.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:04 smithi035 ceph-mon[92535]: pgmap v1267: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:34:23.995 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:06 smithi035 ceph-mon[92535]: pgmap v1268: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:34:24.161 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:08 smithi035 ceph-mon[92535]: pgmap v1269: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:34:24.161 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:09 smithi035 ceph-mon[92535]: osdmap e156: 12 total, 12 up, 12 in 2023-03-17T09:34:24.161 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:10 smithi035 ceph-mon[92535]: pgmap v1271: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:34:24.161 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:12 smithi035 ceph-mon[92535]: pgmap v1272: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:34:24.162 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:14 smithi035 ceph-mon[92535]: pgmap v1273: 97 pgs: 97 active+clean; 1.5 MiB data, 217 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:34:24.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:16 smithi035 ceph-mon[92535]: osdmap e157: 12 total, 12 up, 12 in 2023-03-17T09:34:24.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:16 smithi035 ceph-mon[92535]: pgmap v1275: 97 pgs: 97 active+clean; 1.5 MiB data, 217 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:34:24.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:34:24.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:34:24.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:34:24.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:34:24.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:34:24.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:34:24.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:17 smithi035 ceph-mon[92535]: pgmap v1276: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:34:25.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:20 smithi035 ceph-mon[92535]: pgmap v1277: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:34:25.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:22 smithi035 ceph-mon[92535]: pgmap v1278: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:34:25.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:24 smithi035 ceph-mon[92535]: pgmap v1279: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:34:25.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:26 smithi035 ceph-mon[92535]: pgmap v1280: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:28 smithi035 ceph-mon[92535]: pgmap v1281: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:30 smithi035 ceph-mon[92535]: pgmap v1282: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:32 smithi035 ceph-mon[92535]: pgmap v1283: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:34 smithi035 ceph-mon[92535]: pgmap v1284: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:36 smithi035 ceph-mon[92535]: pgmap v1285: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:38 smithi035 ceph-mon[92535]: pgmap v1286: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:34:25.194 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:40 smithi035 ceph-mon[92535]: pgmap v1287: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e02bd70 0x557b4e0377e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4233521225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e0349f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 >> 172.21.15.35:0/4233521225 conn(0x557b4de846b0 msgr2=0x557b4e021a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 shutdown_connections 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4233521225 wait complete. 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.566+0000 7ff8c8174b80 20 client.16887 trim_cache size 0 max 16384 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 Processor -- start 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 -- start start 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e02bd70 0x557b4e0349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e021ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 0x557b4e03c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4df48600 con 0x557b4e0318a0 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4df3c390 con 0x557b4e02bd70 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4e02b830 con 0x557b4e030f90 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8ba584700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 0x557b4e03c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8ba584700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 0x557b4e03c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45802/0 (socket says 172.21.15.35:45802) 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.581+0000 7ff8ba584700 1 -- 172.21.15.35:0/2557211042 learned_addr learned my addr 172.21.15.35:0/2557211042 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8b9582700 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e021ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e02bd70 0x557b4e0349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8ba584700 1 -- 172.21.15.35:0/2557211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 msgr2=0x557b4e021ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8ba584700 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e021ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8ba584700 1 -- 172.21.15.35:0/2557211042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e02bd70 msgr2=0x557b4e0349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8ba584700 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e02bd70 0x557b4e0349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8ba584700 1 -- 172.21.15.35:0/2557211042 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b4df40130 con 0x557b4e0318a0 2023-03-17T09:34:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8ba584700 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 0x557b4e03c340 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac015000 tx=0x7ff8ac009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6b2e462dab3ed3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8a8ff9700 1 -- 172.21.15.35:0/2557211042 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00e040 con 0x557b4e0318a0 2023-03-17T09:34:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8a8ff9700 1 -- 172.21.15.35:0/2557211042 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8ac00bca0 con 0x557b4e0318a0 2023-03-17T09:34:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.582+0000 7ff8a8ff9700 1 -- 172.21.15.35:0/2557211042 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0256b0 con 0x557b4e0318a0 2023-03-17T09:34:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 -- 172.21.15.35:0/2557211042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 msgr2=0x557b4e03c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 0x557b4e03c340 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac015000 tx=0x7ff8ac009b80 comp rx=0 tx=0).stop 2023-03-17T09:34:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 -- 172.21.15.35:0/2557211042 shutdown_connections 2023-03-17T09:34:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e0318a0 0x557b4e03c340 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e02bd70 0x557b4e0349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/2557211042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e030f90 0x557b4e021ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 -- 172.21.15.35:0/2557211042 >> 172.21.15.35:0/2557211042 conn(0x557b4de846b0 msgr2=0x557b4e034290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 -- 172.21.15.35:0/2557211042 shutdown_connections 2023-03-17T09:34:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 -- 172.21.15.35:0/2557211042 wait complete. 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 -- start start 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.583+0000 7ff8c8174b80 1 Processor -- start 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e02bd70 0x557b4e02de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 0x557b4e02e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e02ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4e02d060 con 0x557b4e030f90 2023-03-17T09:34:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4e02d1d0 con 0x557b4e0318a0 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b4e02d390 con 0x557b4e02bd70 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8c8174b80 10 client.0 _ll_register_callbacks cb 0x557b4de1f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 0x557b4e02e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9d83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e02bd70 0x557b4e02de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 0x557b4e02e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45808/0 (socket says 172.21.15.35:45808) 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 -- 172.21.15.35:0/4245632754 learned_addr learned my addr 172.21.15.35:0/4245632754 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8ba584700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e02ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:28.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 -- 172.21.15.35:0/4245632754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e02bd70 msgr2=0x557b4e02de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e02bd70 0x557b4e02de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 -- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 msgr2=0x557b4e02ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e02ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 -- 172.21.15.35:0/4245632754 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b4ddfb5d0 con 0x557b4e030f90 2023-03-17T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e02bd70 0x557b4e02de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:34:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8ba584700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e02ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:34:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff8b9582700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 0x557b4e02e3b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400d920 tx=0x7ff8a4004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3733fc338f4f2cf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.584+0000 7ff89d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:34:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4245632754 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a40b0070 con 0x557b4e030f90 2023-03-17T09:34:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4245632754 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff8a40b01d0 con 0x557b4e030f90 2023-03-17T09:34:30.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b4dff71e0 con 0x557b4e030f90 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4245632754 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a40982f0 con 0x557b4e030f90 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 10 client.16893 fetch_fsmap learned FSMap version 33 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x557b4ddce1f0 con 0x557b4e030f90 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4245632754 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8a4062080 con 0x557b4e030f90 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4245632754 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff8a4022be0 con 0x557b4e030f90 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 10 client.16893 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 10 client.16893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 20 client.16893 populate_metadata read hostname 'smithi035' 2023-03-17T09:34:30.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e09a430 0x557b4e09c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 4 client.16893 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.585+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557b4ddfdf00 con 0x557b4e09a430 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.586+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e09a430 0x557b4e09c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.586+0000 7ff89d7fa700 10 client.16893 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.586+0000 7ff8b9d83700 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e09a430 0x557b4e09c840 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673e3155ab3ab55c server_cookie=a46feae1cd8dff8b in_seq=0 out_seq=0 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.594+0000 7ff89d7fa700 1 -- 172.21.15.35:0/4245632754 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557b4ddfdf00 con 0x557b4e09a430 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.594+0000 7ff89d7fa700 10 client.16893 handle_command_reply: tid=0 2023-03-17T09:34:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.594+0000 7ff8c8174b80 1 client.16893 shutdown 2023-03-17T09:34:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 msgr2=0x557b4e02e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 0x557b4e02e3b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400d920 tx=0x7ff8a4004e30 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 shutdown_connections 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b4e09a430 0x557b4e09c840 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b4e0318a0 0x557b4e02ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff89d7fa700 0 client.16893 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b4e02bd70 0x557b4e02de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 --2- 172.21.15.35:0/4245632754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b4e030f90 0x557b4e02e3b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 >> 172.21.15.35:0/4245632754 conn(0x557b4de846b0 msgr2=0x557b4e026410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 shutdown_connections 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 1 -- 172.21.15.35:0/4245632754 wait complete. 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.595+0000 7ff8c8174b80 20 client.16893 trim_cache size 0 max 16384 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff8a009f640 msgr2=0x7ff8a00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff8a009f640 0x7ff8a00a1af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009c60 tx=0x7ff8b0009260 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 msgr2=0x7ff8b4197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4197760 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400d950 tx=0x7ff8a400dc60 comp rx=0 tx=0).stop 2023-03-17T09:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 shutdown_connections 2023-03-17T09:34:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff8a009f640 0x7ff8a00a1af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8b4104390 0x7ff8b41a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff350 0x7ff8b4197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 --2- 172.21.15.35:0/965563553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8b40ffcf0 0x7ff8b4197760 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 >> 172.21.15.35:0/965563553 conn(0x7ff8b4076330 msgr2=0x7ff8b40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 shutdown_connections 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:12:47.596+0000 7ff8bbfe7700 1 -- 172.21.15.35:0/965563553 wait complete. 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 -- 172.21.15.35:0/1295553061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac100420 msgr2=0x7fc3ac103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 --2- 172.21.15.35:0/1295553061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac100420 0x7fc3ac103ec0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0099c0 tx=0x7fc39c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 -- 172.21.15.35:0/1295553061 shutdown_connections 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 --2- 172.21.15.35:0/1295553061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 --2- 172.21.15.35:0/1295553061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ac0ffa80 0x7fc3ac0ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 --2- 172.21.15.35:0/1295553061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac100420 0x7fc3ac103ec0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 -- 172.21.15.35:0/1295553061 >> 172.21.15.35:0/1295553061 conn(0x7fc3ac0757a0 msgr2=0x7fc3ac075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 -- 172.21.15.35:0/1295553061 shutdown_connections 2023-03-17T09:34:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.718+0000 7fc3b342f700 1 -- 172.21.15.35:0/1295553061 wait complete. 2023-03-17T09:34:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 Processor -- start 2023-03-17T09:34:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 -- start start 2023-03-17T09:34:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3ac0ffa80 0x7fc3ac100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ac100420 0x7fc3ac1014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac101cd0 con 0x7fc3ac1045a0 2023-03-17T09:34:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1a4c10 con 0x7fc3ac100420 2023-03-17T09:34:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b342f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1a4d50 con 0x7fc3ac0ffa80 2023-03-17T09:34:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac1a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45822/0 (socket says 172.21.15.35:45822) 2023-03-17T09:34:39.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 -- 172.21.15.35:0/3840622638 learned_addr learned my addr 172.21.15.35:0/3840622638 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:39.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ac100420 0x7fc3ac1014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:39.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3ac0ffa80 0x7fc3ac100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:39.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 -- 172.21.15.35:0/3840622638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3ac0ffa80 msgr2=0x7fc3ac100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:39.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3ac0ffa80 0x7fc3ac100f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 -- 172.21.15.35:0/3840622638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ac100420 msgr2=0x7fc3ac1014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ac100420 0x7fc3ac1014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.719+0000 7fc3b19cc700 1 -- 172.21.15.35:0/3840622638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0095f0 con 0x7fc3ac1045a0 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.720+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac1a46d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400ef30 tx=0x7fc3a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.720+0000 7fc3a27fc700 1 -- 172.21.15.35:0/3840622638 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4018070 con 0x7fc3ac1045a0 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.720+0000 7fc3a27fc700 1 -- 172.21.15.35:0/3840622638 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc3a400f040 con 0x7fc3ac1045a0 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.720+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac10f1d0 con 0x7fc3ac1045a0 2023-03-17T09:34:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.720+0000 7fc3a27fc700 1 -- 172.21.15.35:0/3840622638 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400cc70 con 0x7fc3ac1045a0 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.720+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac10f040 con 0x7fc3ac1045a0 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.723+0000 7fc3a27fc700 1 -- 172.21.15.35:0/3840622638 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc3a4007500 con 0x7fc3ac1045a0 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.723+0000 7fc3a27fc700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc39809f640 0x7fc3980a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.724+0000 7fc3a27fc700 1 -- 172.21.15.35:0/3840622638 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc3a40ca100 con 0x7fc3ac1045a0 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.724+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc39809f640 0x7fc3980a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.724+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc39809f640 0x7fc3980a1af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009bf0 tx=0x7fc3a8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.724+0000 7fc3bf5bcb80 1 Processor -- start 2023-03-17T09:34:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 -- start start 2023-03-17T09:34:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcd9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcd4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bcd4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:44.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bbdb010 con 0x56394bcda4f0 2023-03-17T09:34:44.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bc2d950 con 0x56394bcd4960 2023-03-17T09:34:44.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bc26de0 con 0x56394bcd9be0 2023-03-17T09:34:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcd4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcd4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45828/0 (socket says 172.21.15.35:45828) 2023-03-17T09:34:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3881458490 learned_addr learned my addr 172.21.15.35:0/3881458490 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcd9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bcd4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:45.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3881458490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 msgr2=0x56394bcd9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcd9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3881458490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 msgr2=0x56394bcd4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bcd4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3881458490 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394baa85d0 con 0x56394bcda4f0 2023-03-17T09:34:45.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.725+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcd4420 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac1007f0 tx=0x7fc39c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d551a2626fbb2c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:46.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:42 smithi035 ceph-mon[92535]: pgmap v1288: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:34:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.726+0000 7fc3977fe700 1 -- 172.21.15.35:0/3881458490 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00ba90 con 0x56394bcda4f0 2023-03-17T09:34:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.726+0000 7fc3977fe700 1 -- 172.21.15.35:0/3881458490 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc39c01e040 con 0x56394bcda4f0 2023-03-17T09:34:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.726+0000 7fc3977fe700 1 -- 172.21.15.35:0/3881458490 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00be50 con 0x56394bcda4f0 2023-03-17T09:34:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3881458490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 msgr2=0x56394bcd4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcd4420 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac1007f0 tx=0x7fc39c005c30 comp rx=0 tx=0).stop 2023-03-17T09:34:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3881458490 shutdown_connections 2023-03-17T09:34:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bcd4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcd9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:47.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3881458490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcd4420 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:48.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3881458490 >> 172.21.15.35:0/3881458490 conn(0x56394bb316b0 msgr2=0x56394bccea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3881458490 shutdown_connections 2023-03-17T09:34:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3881458490 wait complete. 2023-03-17T09:34:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.727+0000 7fc3bf5bcb80 1 -- start start 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 Processor -- start 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bcdd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcda4f0 0x56394bcddc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394baaa8c0 con 0x56394bcd9be0 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bcde400 con 0x56394bcd4960 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bcea000 con 0x56394bcda4f0 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.728+0000 7fc3bf5bcb80 10 client.0 _ll_register_callbacks cb 0x56394bacc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bcdd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bcdd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45834/0 (socket says 172.21.15.35:45834) 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3937222300 learned_addr learned my addr 172.21.15.35:0/3937222300 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcda4f0 0x56394bcddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3937222300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcda4f0 msgr2=0x56394bcddc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcda4f0 0x56394bcddc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 msgr2=0x56394bce03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3937222300 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac10c9b0 con 0x56394bcd9be0 2023-03-17T09:34:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bcdd6d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc39c006010 tx=0x7fc39c00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d98afa710069177 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:34:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc394ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:34:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc394ff9700 1 -- 172.21.15.35:0/3937222300 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0054c0 con 0x56394bcd9be0 2023-03-17T09:34:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc394ff9700 1 -- 172.21.15.35:0/3937222300 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc39c005620 con 0x56394bcd9be0 2023-03-17T09:34:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56394bbe9390 con 0x56394bcd9be0 2023-03-17T09:34:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.729+0000 7fc394ff9700 1 -- 172.21.15.35:0/3937222300 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc39c0037e0 con 0x56394bcd9be0 2023-03-17T09:34:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 10 client.16905 fetch_fsmap learned FSMap version 33 2023-03-17T09:34:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56394ba54d80 con 0x56394bcd9be0 2023-03-17T09:34:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc394ff9700 1 -- 172.21.15.35:0/3937222300 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc39c039020 con 0x56394bcd9be0 2023-03-17T09:34:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc394ff9700 1 -- 172.21.15.35:0/3937222300 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc39c029030 con 0x56394bcd9be0 2023-03-17T09:34:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 10 client.16905 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 10 client.16905 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 20 client.16905 populate_metadata read hostname 'smithi035' 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bcedb70 0x56394bceff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 4 client.16905 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56394bbf5600 con 0x56394bcedb70 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.730+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bcedb70 0x56394bceff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.731+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bcedb70 0x56394bceff80 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba04e32645abfad server_cookie=cafeb4bf04215cec in_seq=0 out_seq=0 2023-03-17T09:34:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.731+0000 7fc394ff9700 10 client.16905 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.731+0000 7fc394ff9700 1 -- 172.21.15.35:0/3937222300 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56394bbf5600 con 0x56394bcedb70 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.731+0000 7fc394ff9700 10 client.16905 handle_command_reply: tid=0 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.731+0000 7fc3bf5bcb80 1 client.16905 shutdown 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 msgr2=0x56394bcdd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bcdd6d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc39c006010 tx=0x7fc39c00bac0 comp rx=0 tx=0).stop 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 shutdown_connections 2023-03-17T09:34:55.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bcedb70 0x56394bceff80 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcda4f0 0x56394bcddc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc394ff9700 0 client.16905 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:34:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3937222300 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bcdd6d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 >> 172.21.15.35:0/3937222300 conn(0x56394bb316b0 msgr2=0x56394bcd3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:34:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 shutdown_connections 2023-03-17T09:34:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3937222300 wait complete. 2023-03-17T09:34:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.732+0000 7fc3bf5bcb80 20 client.16905 trim_cache size 0 max 16384 2023-03-17T09:34:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.747+0000 7fc3bf5bcb80 1 Processor -- start 2023-03-17T09:34:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.747+0000 7fc3bf5bcb80 1 -- start start 2023-03-17T09:34:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcdff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:57.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcdceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bceaa30 con 0x56394bcda4f0 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bcca0d0 con 0x56394bcd4960 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bccbb60 con 0x56394bcd9be0 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b19cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcdceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b19cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcdceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45842/0 (socket says 172.21.15.35:45842) 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcdff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b19cc700 1 -- 172.21.15.35:0/2648515703 learned_addr learned my addr 172.21.15.35:0/2648515703 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 -- 172.21.15.35:0/2648515703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 msgr2=0x56394bce4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:34:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:34:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 -- 172.21.15.35:0/2648515703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 msgr2=0x56394bcdceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcdceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 -- 172.21.15.35:0/2648515703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394bbed130 con 0x56394bcd9be0 2023-03-17T09:35:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcdceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:35:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcdff80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc39c035af0 tx=0x7fc39c00b5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7885a9e93c975dde server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.748+0000 7fc397fff700 1 -- 172.21.15.35:0/2648515703 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c035d60 con 0x56394bcd9be0 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc397fff700 1 -- 172.21.15.35:0/2648515703 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc39c039070 con 0x56394bcd9be0 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc397fff700 1 -- 172.21.15.35:0/2648515703 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c003760 con 0x56394bcd9be0 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/2648515703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 msgr2=0x56394bcdff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcdff80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc39c035af0 tx=0x7fc39c00b5c0 comp rx=0 tx=0).stop 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/2648515703 shutdown_connections 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcda4f0 0x56394bcdceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcd4960 0x56394bce4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/2648515703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd9be0 0x56394bcdff80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/2648515703 >> 172.21.15.35:0/2648515703 conn(0x56394bb316b0 msgr2=0x56394bcea320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/2648515703 shutdown_connections 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.749+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/2648515703 wait complete. 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 -- start start 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 Processor -- start 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd4960 0x56394bce4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bce4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcda4f0 0x56394bce2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bce3370 con 0x56394bcd9be0 2023-03-17T09:35:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bce34e0 con 0x56394bcda4f0 2023-03-17T09:35:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394bce36a0 con 0x56394bcd4960 2023-03-17T09:35:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3bf5bcb80 10 client.0 _ll_register_callbacks cb 0x56394bacc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:35:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3b09ca700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bce4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3b11cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd4960 0x56394bce4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:01.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3b09ca700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bce4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45846/0 (socket says 172.21.15.35:45846) 2023-03-17T09:35:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3b09ca700 1 -- 172.21.15.35:0/3848852034 learned_addr learned my addr 172.21.15.35:0/3848852034 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.750+0000 7fc3b19cc700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcda4f0 0x56394bce2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b11cb700 1 -- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcda4f0 msgr2=0x56394bce2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcda4f0 0x56394bce2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b11cb700 1 -- 172.21.15.35:0/3848852034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 msgr2=0x56394bce4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bce4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b11cb700 1 -- 172.21.15.35:0/3848852034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac10f040 con 0x56394bcd4960 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bce4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3b11cb700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd4960 0x56394bce4970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x56394bcf0830 tx=0x7fc3a80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d9e9f81bb7a019d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc394ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc394ff9700 1 -- 172.21.15.35:0/3848852034 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8026040 con 0x56394bcd4960 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56394bca41e0 con 0x56394bcd4960 2023-03-17T09:35:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc394ff9700 1 -- 172.21.15.35:0/3848852034 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc3a8018070 con 0x56394bcd4960 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc394ff9700 1 -- 172.21.15.35:0/3848852034 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3a8012c40 con 0x56394bcd4960 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.751+0000 7fc3bf5bcb80 10 client.26542 fetch_fsmap learned FSMap version 33 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56394ba54d80 con 0x56394bcd4960 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc394ff9700 1 -- 172.21.15.35:0/3848852034 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56394bca41e0 con 0x56394bcd4960 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc394ff9700 1 -- 172.21.15.35:0/3848852034 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc3a8028ac0 con 0x56394bcd4960 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 10 client.26542 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 10 client.26542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:35:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 20 client.26542 populate_metadata read hostname 'smithi035' 2023-03-17T09:35:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bd42b20 0x56394bd44f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 4 client.26542 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:35:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56394baaaf00 con 0x56394bd42b20 2023-03-17T09:35:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.752+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bd42b20 0x56394bd44f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.753+0000 7fc394ff9700 10 client.26542 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:35:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.753+0000 7fc3b09ca700 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bd42b20 0x56394bd44f00 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1ea13fd7612bae server_cookie=4d93bfc907dd31d in_seq=0 out_seq=0 2023-03-17T09:35:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc394ff9700 1 -- 172.21.15.35:0/3848852034 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56394baaaf00 con 0x56394bd42b20 2023-03-17T09:35:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc394ff9700 10 client.26542 handle_command_reply: tid=0 2023-03-17T09:35:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 client.26542 shutdown 2023-03-17T09:35:06.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd4960 msgr2=0x56394bce4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd4960 0x56394bce4970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x56394bcf0830 tx=0x7fc3a80047c0 comp rx=0 tx=0).stop 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 shutdown_connections 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56394bd42b20 0x56394bd44f00 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56394bcda4f0 0x56394bce2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56394bcd4960 0x56394bce4970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 --2- 172.21.15.35:0/3848852034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56394bcd9be0 0x56394bce4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc394ff9700 0 client.26542 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 >> 172.21.15.35:0/3848852034 conn(0x56394bb316b0 msgr2=0x56394bcd76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 shutdown_connections 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 1 -- 172.21.15.35:0/3848852034 wait complete. 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.757+0000 7fc3bf5bcb80 20 client.26542 trim_cache size 0 max 16384 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc39809f640 msgr2=0x7fc3980a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc39809f640 0x7fc3980a1af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009bf0 tx=0x7fc3a8009260 comp rx=0 tx=0).stop 2023-03-17T09:35:06.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 msgr2=0x7fc3ac1a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac1a46d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400ef30 tx=0x7fc3a400c3a0 comp rx=0 tx=0).stop 2023-03-17T09:35:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 shutdown_connections 2023-03-17T09:35:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc39809f640 0x7fc3980a1af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc3ac1045a0 0x7fc3ac1a46d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3ac0ffa80 0x7fc3ac100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 --2- 172.21.15.35:0/3840622638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3ac100420 0x7fc3ac1014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 >> 172.21.15.35:0/3840622638 conn(0x7fc3ac0757a0 msgr2=0x7fc3ac0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 shutdown_connections 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:00.758+0000 7fc3b342f700 1 -- 172.21.15.35:0/3840622638 wait complete. 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 -- 172.21.15.35:0/3401497343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ffcf0 msgr2=0x7fb600103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 --2- 172.21.15.35:0/3401497343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ffcf0 0x7fb600103cb0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0099c0 tx=0x7fb5ec009cd0 comp rx=0 tx=0).stop 2023-03-17T09:35:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 -- 172.21.15.35:0/3401497343 shutdown_connections 2023-03-17T09:35:08.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:44 smithi035 ceph-mon[92535]: pgmap v1289: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:35:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 --2- 172.21.15.35:0/3401497343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104390 0x7fb60010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 --2- 172.21.15.35:0/3401497343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6000ff350 0x7fb6000ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 --2- 172.21.15.35:0/3401497343 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ffcf0 0x7fb600103cb0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 -- 172.21.15.35:0/3401497343 >> 172.21.15.35:0/3401497343 conn(0x7fb600076330 msgr2=0x7fb600076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 -- 172.21.15.35:0/3401497343 shutdown_connections 2023-03-17T09:35:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.882+0000 7fb606aed700 1 -- 172.21.15.35:0/3401497343 wait complete. 2023-03-17T09:35:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 Processor -- start 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 -- start start 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 0x7fb6001951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6000ffcf0 0x7fb6001956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104390 0x7fb600199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60019a180 con 0x7fb6000ff350 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60019a2f0 con 0x7fb6000ffcf0 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb606aed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60019a4b0 con 0x7fb600104390 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 0x7fb6001951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 0x7fb6001951a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45858/0 (socket says 172.21.15.35:45858) 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 -- 172.21.15.35:0/1628269083 learned_addr learned my addr 172.21.15.35:0/1628269083 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6000ffcf0 0x7fb6001956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb60508a700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104390 0x7fb600199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 -- 172.21.15.35:0/1628269083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104390 msgr2=0x7fb600199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104390 0x7fb600199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 -- 172.21.15.35:0/1628269083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6000ffcf0 msgr2=0x7fb6001956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.883+0000 7fb604889700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6000ffcf0 0x7fb6001956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:10.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb604889700 1 -- 172.21.15.35:0/1628269083 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009520 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb604889700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 0x7fb6001951a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400ec40 tx=0x7fb5f400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb5fdffb700 1 -- 172.21.15.35:0/1628269083 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4013070 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb5fdffb700 1 -- 172.21.15.35:0/1628269083 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5f4004020 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec0095f0 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb5fdffb700 1 -- 172.21.15.35:0/1628269083 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4003b40 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.884+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60010efc0 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.886+0000 7fb5fdffb700 1 -- 172.21.15.35:0/1628269083 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb5f4003ca0 con 0x7fb6000ff350 2023-03-17T09:35:10.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.887+0000 7fb5fdffb700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5f009f640 0x7fb5f00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.887+0000 7fb5fdffb700 1 -- 172.21.15.35:0/1628269083 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fb5f40cbcf0 con 0x7fb6000ff350 2023-03-17T09:35:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.887+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5f009f640 0x7fb5f00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5f009f640 0x7fb5f00a1af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000c00 tx=0x7fb5ec00b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 Processor -- start 2023-03-17T09:35:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 -- start start 2023-03-17T09:35:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 0x5623685dd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685d7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623684da010 con 0x5623685dd040 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236852c950 con 0x5623685d7830 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562368525de0 con 0x5623685d81e0 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb604889700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 0x5623685dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.888+0000 7fb604889700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 0x5623685dd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45866/0 (socket says 172.21.15.35:45866) 2023-03-17T09:35:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 -- 172.21.15.35:0/2400601194 learned_addr learned my addr 172.21.15.35:0/2400601194 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb5fffff700 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685d7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb60508a700 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 -- 172.21.15.35:0/2400601194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 msgr2=0x5623685e3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 -- 172.21.15.35:0/2400601194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 msgr2=0x5623685d7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685d7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 -- 172.21.15.35:0/2400601194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623683a75d0 con 0x5623685dd040 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb5fffff700 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685d7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb604889700 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 0x5623685dd410 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4095c70 tx=0x7fb5f400e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231b4ee89f467004 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb5eaffd700 1 -- 172.21.15.35:0/2400601194 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4099770 con 0x5623685dd040 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb5eaffd700 1 -- 172.21.15.35:0/2400601194 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5f40a1960 con 0x5623685dd040 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.889+0000 7fb5eaffd700 1 -- 172.21.15.35:0/2400601194 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4098ea0 con 0x5623685dd040 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 -- 172.21.15.35:0/2400601194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 msgr2=0x5623685dd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 0x5623685dd410 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4095c70 tx=0x7fb5f400e470 comp rx=0 tx=0).stop 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 -- 172.21.15.35:0/2400601194 shutdown_connections 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685dd040 0x5623685dd410 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:14.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/2400601194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685d7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 -- 172.21.15.35:0/2400601194 >> 172.21.15.35:0/2400601194 conn(0x5623684306b0 msgr2=0x5623685cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 -- 172.21.15.35:0/2400601194 shutdown_connections 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 -- 172.21.15.35:0/2400601194 wait complete. 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 -- start start 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.890+0000 7fb612c7ab80 1 Processor -- start 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:14.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x5623685e1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623683a98c0 con 0x5623685d81e0 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623685e1ee0 con 0x5623685d7830 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623685ed4b0 con 0x5623685dd040 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb612c7ab80 10 client.0 _ll_register_callbacks cb 0x5623683cb230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45874/0 (socket says 172.21.15.35:45874) 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 -- 172.21.15.35:0/306963078 learned_addr learned my addr 172.21.15.35:0/306963078 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb60508a700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x5623685e1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb604889700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 -- 172.21.15.35:0/306963078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 msgr2=0x5623685e1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x5623685e1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 -- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 msgr2=0x5623685e3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.891+0000 7fb5fffff700 1 -- 172.21.15.35:0/306963078 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60010efc0 con 0x5623685d81e0 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5fffff700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e1080 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb6001000c0 tx=0x7fb5ec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74935d991b80190c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5dffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5dffff700 1 -- 172.21.15.35:0/306963078 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0056a0 con 0x5623685d81e0 2023-03-17T09:35:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5dffff700 1 -- 172.21.15.35:0/306963078 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fb5ec00f460 con 0x5623685d81e0 2023-03-17T09:35:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623684e8390 con 0x5623685d81e0 2023-03-17T09:35:17.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5dffff700 1 -- 172.21.15.35:0/306963078 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5ec00f620 con 0x5623685d81e0 2023-03-17T09:35:17.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 10 client.16923 fetch_fsmap learned FSMap version 33 2023-03-17T09:35:17.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562368353d80 con 0x5623685d81e0 2023-03-17T09:35:17.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5dffff700 1 -- 172.21.15.35:0/306963078 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ec03b020 con 0x5623685d81e0 2023-03-17T09:35:17.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb5dffff700 1 -- 172.21.15.35:0/306963078 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb5ec02e760 con 0x5623685d81e0 2023-03-17T09:35:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 10 client.16923 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:35:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:35:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 20 client.16923 populate_metadata read hostname 'smithi035' 2023-03-17T09:35:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623685f1560 0x5623685f3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.892+0000 7fb612c7ab80 4 client.16923 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:35:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.893+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623684f4600 con 0x5623685f1560 2023-03-17T09:35:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.893+0000 7fb604889700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623685f1560 0x5623685f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.893+0000 7fb5dffff700 10 client.16923 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:35:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.893+0000 7fb604889700 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623685f1560 0x5623685f3970 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b157f72d47700d server_cookie=b0bc5827f790b60a in_seq=0 out_seq=0 2023-03-17T09:35:23.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb5dffff700 1 -- 172.21.15.35:0/306963078 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5623684f4600 con 0x5623685f1560 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb5dffff700 10 client.16923 handle_command_reply: tid=0 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 client.16923 shutdown 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 msgr2=0x5623685e1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e1080 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb6001000c0 tx=0x7fb5ec009310 comp rx=0 tx=0).stop 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 shutdown_connections 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623685f1560 0x5623685f3970 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x5623685e1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb5dffff700 0 client.16923 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/306963078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e1080 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 >> 172.21.15.35:0/306963078 conn(0x5623684306b0 msgr2=0x5623685d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 shutdown_connections 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 1 -- 172.21.15.35:0/306963078 wait complete. 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.894+0000 7fb612c7ab80 20 client.16923 trim_cache size 0 max 16384 2023-03-17T09:35:23.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 Processor -- start 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 -- start start 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 0x5623685cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685dd040 0x5623685db190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623685ce000 con 0x5623685d7830 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623685ca5c0 con 0x5623685dd040 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623685d85b0 con 0x5623685d81e0 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb604889700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 0x5623685cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb604889700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 0x5623685cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45880/0 (socket says 172.21.15.35:45880) 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb604889700 1 -- 172.21.15.35:0/1500154330 learned_addr learned my addr 172.21.15.35:0/1500154330 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:23.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb60508a700 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685dd040 0x5623685db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.909+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb604889700 1 -- 172.21.15.35:0/1500154330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 msgr2=0x5623685e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb604889700 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb604889700 1 -- 172.21.15.35:0/1500154330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685dd040 msgr2=0x5623685db190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb604889700 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685dd040 0x5623685db190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb604889700 1 -- 172.21.15.35:0/1500154330 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623684ec130 con 0x5623685d7830 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb60508a700 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685dd040 0x5623685db190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb604889700 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 0x5623685cdac0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40c9500 tx=0x7fb5f409c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce61535f75e1916 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb5eb7fe700 1 -- 172.21.15.35:0/1500154330 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40997f0 con 0x5623685d7830 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb5eb7fe700 1 -- 172.21.15.35:0/1500154330 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5f4097b10 con 0x5623685d7830 2023-03-17T09:35:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.910+0000 7fb5eb7fe700 1 -- 172.21.15.35:0/1500154330 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4099c30 con 0x5623685d7830 2023-03-17T09:35:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1500154330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 msgr2=0x5623685cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 0x5623685cdac0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40c9500 tx=0x7fb5f409c040 comp rx=0 tx=0).stop 2023-03-17T09:35:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1500154330 shutdown_connections 2023-03-17T09:35:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685dd040 0x5623685db190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d7830 0x5623685cdac0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1500154330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685d81e0 0x5623685e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1500154330 >> 172.21.15.35:0/1500154330 conn(0x5623684306b0 msgr2=0x5623685dc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1500154330 shutdown_connections 2023-03-17T09:35:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1500154330 wait complete. 2023-03-17T09:35:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- start start 2023-03-17T09:35:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 Processor -- start 2023-03-17T09:35:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x562368644420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623685e71c0 con 0x5623685d81e0 2023-03-17T09:35:31.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562368644960 con 0x5623685d7830 2023-03-17T09:35:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562368644aa0 con 0x5623685dd040 2023-03-17T09:35:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.911+0000 7fb612c7ab80 10 client.0 _ll_register_callbacks cb 0x5623683cb230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:35:32.716 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:46 smithi035 ceph-mon[92535]: pgmap v1290: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:35:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45888/0 (socket says 172.21.15.35:45888) 2023-03-17T09:35:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 -- 172.21.15.35:0/1229835864 learned_addr learned my addr 172.21.15.35:0/1229835864 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb60508a700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x562368644420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb604889700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 -- 172.21.15.35:0/1229835864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 msgr2=0x562368644420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x562368644420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 -- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 msgr2=0x5623685e65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 -- 172.21.15.35:0/1229835864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623683a75d0 con 0x5623685d81e0 2023-03-17T09:35:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5fffff700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e6ae0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x5623685e25c0 tx=0x7fb5ec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e03071eb9854c66 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5dffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:35:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5dffff700 1 -- 172.21.15.35:0/1229835864 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0058e0 con 0x5623685d81e0 2023-03-17T09:35:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5dffff700 1 -- 172.21.15.35:0/1229835864 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fb5ec03c080 con 0x5623685d81e0 2023-03-17T09:35:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623685a31e0 con 0x5623685d81e0 2023-03-17T09:35:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb5dffff700 1 -- 172.21.15.35:0/1229835864 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5ec00f460 con 0x5623685d81e0 2023-03-17T09:35:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.912+0000 7fb612c7ab80 10 client.16929 fetch_fsmap learned FSMap version 33 2023-03-17T09:35:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56236837a1f0 con 0x5623685d81e0 2023-03-17T09:35:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb5dffff700 1 -- 172.21.15.35:0/1229835864 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ec04c080 con 0x5623685d81e0 2023-03-17T09:35:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb5dffff700 1 -- 172.21.15.35:0/1229835864 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb5ec040430 con 0x5623685d81e0 2023-03-17T09:35:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 10 client.16929 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:35:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 10 client.16929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:35:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 20 client.16929 populate_metadata read hostname 'smithi035' 2023-03-17T09:35:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562368645e20 0x562368648230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 4 client.16929 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:35:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623683a9f00 con 0x562368645e20 2023-03-17T09:35:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.913+0000 7fb604889700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562368645e20 0x562368648230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.914+0000 7fb5dffff700 10 client.16929 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:35:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.914+0000 7fb604889700 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562368645e20 0x562368648230 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f8b698375753ae server_cookie=67e32b59c6db072d in_seq=0 out_seq=0 2023-03-17T09:35:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.920+0000 7fb5dffff700 1 -- 172.21.15.35:0/1229835864 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623683a9f00 con 0x562368645e20 2023-03-17T09:35:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.920+0000 7fb5dffff700 10 client.16929 handle_command_reply: tid=0 2023-03-17T09:35:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.920+0000 7fb612c7ab80 1 client.16929 shutdown 2023-03-17T09:35:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 msgr2=0x5623685e6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e6ae0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x5623685e25c0 tx=0x7fb5ec00b890 comp rx=0 tx=0).stop 2023-03-17T09:35:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 shutdown_connections 2023-03-17T09:35:42.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562368645e20 0x562368648230 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:42.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623685dd040 0x562368644420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:42.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb5dffff700 0 client.16929 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:35:42.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623685d7830 0x5623685e65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 --2- 172.21.15.35:0/1229835864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623685d81e0 0x5623685e6ae0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 >> 172.21.15.35:0/1229835864 conn(0x5623684306b0 msgr2=0x5623685db190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 shutdown_connections 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 1 -- 172.21.15.35:0/1229835864 wait complete. 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb612c7ab80 20 client.16929 trim_cache size 0 max 16384 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5f009f640 msgr2=0x7fb5f00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5f009f640 0x7fb5f00a1af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000c00 tx=0x7fb5ec00b540 comp rx=0 tx=0).stop 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 msgr2=0x7fb6001951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 0x7fb6001951a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400ec40 tx=0x7fb5f400ef50 comp rx=0 tx=0).stop 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 shutdown_connections 2023-03-17T09:35:44.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5f009f640 0x7fb5f00a1af0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600104390 0x7fb600199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6000ff350 0x7fb6001951a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 --2- 172.21.15.35:0/1628269083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6000ffcf0 0x7fb6001956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.921+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 >> 172.21.15.35:0/1628269083 conn(0x7fb600076330 msgr2=0x7fb6000fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.922+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 shutdown_connections 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:13.922+0000 7fb606aed700 1 -- 172.21.15.35:0/1628269083 wait complete. 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 -- 172.21.15.35:0/4220001391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ffcf0 msgr2=0x7fa520103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 --2- 172.21.15.35:0/4220001391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ffcf0 0x7fa520103cb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa5140099c0 tx=0x7fa514009cd0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 -- 172.21.15.35:0/4220001391 shutdown_connections 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 --2- 172.21.15.35:0/4220001391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 0x7fa52010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 --2- 172.21.15.35:0/4220001391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ff350 0x7fa5200ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 --2- 172.21.15.35:0/4220001391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ffcf0 0x7fa520103cb0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 -- 172.21.15.35:0/4220001391 >> 172.21.15.35:0/4220001391 conn(0x7fa520076330 msgr2=0x7fa520076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 -- 172.21.15.35:0/4220001391 shutdown_connections 2023-03-17T09:35:44.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 -- 172.21.15.35:0/4220001391 wait complete. 2023-03-17T09:35:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.046+0000 7fa525b54700 1 Processor -- start 2023-03-17T09:35:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 -- start start 2023-03-17T09:35:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 0x7fa5201962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ffcf0 0x7fa5201967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 0x7fa52019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52019b280 con 0x7fa5200ff350 2023-03-17T09:35:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52019b3f0 con 0x7fa5200ffcf0 2023-03-17T09:35:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa525b54700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52019b5b0 con 0x7fa520104390 2023-03-17T09:35:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 0x7fa5201962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 0x7fa5201962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45900/0 (socket says 172.21.15.35:45900) 2023-03-17T09:35:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 -- 172.21.15.35:0/855524960 learned_addr learned my addr 172.21.15.35:0/855524960 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51ffff700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 0x7fa52019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51effd700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ffcf0 0x7fa5201967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 -- 172.21.15.35:0/855524960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 msgr2=0x7fa52019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 0x7fa52019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 -- 172.21.15.35:0/855524960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ffcf0 msgr2=0x7fa5201967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ffcf0 0x7fa5201967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 -- 172.21.15.35:0/855524960 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5140095f0 con 0x7fa5200ff350 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51ffff700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 0x7fa52019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51effd700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ffcf0 0x7fa5201967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:35:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.047+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 0x7fa5201962a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e9a0 tx=0x7fa51000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.048+0000 7fa51cff9700 1 -- 172.21.15.35:0/855524960 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510009790 con 0x7fa5200ff350 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.048+0000 7fa51cff9700 1 -- 172.21.15.35:0/855524960 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa51000cbd0 con 0x7fa5200ff350 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.048+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52010efc0 con 0x7fa5200ff350 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.048+0000 7fa51cff9700 1 -- 172.21.15.35:0/855524960 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510018680 con 0x7fa5200ff350 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.048+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52010ee30 con 0x7fa5200ff350 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.050+0000 7fa51cff9700 1 -- 172.21.15.35:0/855524960 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa51000cd40 con 0x7fa5200ff350 2023-03-17T09:35:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.050+0000 7fa51cff9700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa50809f640 0x7fa5080a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa51effd700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa50809f640 0x7fa5080a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa51cff9700 1 -- 172.21.15.35:0/855524960 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa510014070 con 0x7fa5200ff350 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa51effd700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa50809f640 0x7fa5080a1af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa514009990 tx=0x7fa51401a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa531ce1b80 1 Processor -- start 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa531ce1b80 1 -- start start 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 0x56022a6c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c0960 0x56022a6c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.051+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a5c7010 con 0x56022a6c64f0 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a619950 con 0x56022a6c5be0 2023-03-17T09:35:50.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a612de0 con 0x56022a6c0960 2023-03-17T09:35:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 0x56022a6c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 0x56022a6c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45910/0 (socket says 172.21.15.35:45910) 2023-03-17T09:35:50.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 -- 172.21.15.35:0/2167587040 learned_addr learned my addr 172.21.15.35:0/2167587040 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51ffff700 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c0960 0x56022a6c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 -- 172.21.15.35:0/2167587040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c0960 msgr2=0x56022a6c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c0960 0x56022a6c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 -- 172.21.15.35:0/2167587040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 msgr2=0x56022a6c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 -- 172.21.15.35:0/2167587040 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56022a4945d0 con 0x56022a6c64f0 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa51effd700 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 0x56022a6c0420 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa5140099c0 tx=0x7fa51401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16803ab81f1d79eb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa505ffb700 1 -- 172.21.15.35:0/2167587040 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51402a070 con 0x56022a6c64f0 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa505ffb700 1 -- 172.21.15.35:0/2167587040 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa514003bf0 con 0x56022a6c64f0 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.052+0000 7fa505ffb700 1 -- 172.21.15.35:0/2167587040 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51401d040 con 0x56022a6c64f0 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2167587040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 msgr2=0x56022a6c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:35:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 0x56022a6c0420 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa5140099c0 tx=0x7fa51401e000 comp rx=0 tx=0).stop 2023-03-17T09:35:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2167587040 shutdown_connections 2023-03-17T09:35:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c0960 0x56022a6c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2167587040 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c64f0 0x56022a6c0420 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2167587040 >> 172.21.15.35:0/2167587040 conn(0x56022a51d6b0 msgr2=0x56022a6baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2167587040 shutdown_connections 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2167587040 wait complete. 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.053+0000 7fa531ce1b80 1 -- start start 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 Processor -- start 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a4968c0 con 0x56022a6c0960 2023-03-17T09:35:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6ca4a0 con 0x56022a6c5be0 2023-03-17T09:35:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6d5fa0 con 0x56022a6c64f0 2023-03-17T09:35:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa531ce1b80 10 client.0 _ll_register_callbacks cb 0x56022a4b8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:35:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45914/0 (socket says 172.21.15.35:45914) 2023-03-17T09:35:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 -- 172.21.15.35:0/1768557519 learned_addr learned my addr 172.21.15.35:0/1768557519 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51ffff700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51effd700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 -- 172.21.15.35:0/1768557519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 msgr2=0x56022a6c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 -- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 msgr2=0x56022a6c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:35:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.054+0000 7fa51f7fe700 1 -- 172.21.15.35:0/1768557519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52010c7a0 con 0x56022a6c0960 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6cc4b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa5100c82b0 tx=0x7fa510098610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76e7047096392de server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa4feffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa4feffd700 1 -- 172.21.15.35:0/1768557519 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510094040 con 0x56022a6c0960 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa4feffd700 1 -- 172.21.15.35:0/1768557519 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa510097c10 con 0x56022a6c0960 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56022a5d5390 con 0x56022a6c0960 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa4feffd700 1 -- 172.21.15.35:0/1768557519 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5100a0280 con 0x56022a6c0960 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 10 client.16941 fetch_fsmap learned FSMap version 33 2023-03-17T09:35:55.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56022a440d80 con 0x56022a6c0960 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa4feffd700 1 -- 172.21.15.35:0/1768557519 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5100b4020 con 0x56022a6c0960 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa4feffd700 1 -- 172.21.15.35:0/1768557519 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa510099300 con 0x56022a6c0960 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 10 client.16941 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 20 client.16941 populate_metadata read hostname 'smithi035' 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a6da0a0 0x56022a6dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:35:55.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 4 client.16941 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:35:55.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:48 smithi035 ceph-mon[92535]: pgmap v1291: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:35:57.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:50 smithi035 ceph-mon[92535]: pgmap v1292: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:52 smithi035 ceph-mon[92535]: pgmap v1293: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:54 smithi035 ceph-mon[92535]: pgmap v1294: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:56 smithi035 ceph-mon[92535]: pgmap v1295: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:26:58 smithi035 ceph-mon[92535]: pgmap v1296: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:00 smithi035 ceph-mon[92535]: pgmap v1297: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:02 smithi035 ceph-mon[92535]: pgmap v1298: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:04 smithi035 ceph-mon[92535]: pgmap v1299: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:35:58.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:06 smithi035 ceph-mon[92535]: pgmap v1300: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:35:59.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:08 smithi035 ceph-mon[92535]: pgmap v1301: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:35:59.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:09 smithi035 ceph-mon[92535]: osdmap e158: 12 total, 12 up, 12 in 2023-03-17T09:35:59.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:10 smithi035 ceph-mon[92535]: pgmap v1303: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:35:59.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:12 smithi035 ceph-mon[92535]: pgmap v1304: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:35:59.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:14 smithi035 ceph-mon[92535]: pgmap v1305: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:16 smithi035 ceph-mon[92535]: osdmap e159: 12 total, 12 up, 12 in 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:16 smithi035 ceph-mon[92535]: pgmap v1307: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:18 smithi035 ceph-mon[92535]: pgmap v1308: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:20 smithi035 ceph-mon[92535]: pgmap v1309: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:00.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:01.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:36:01.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:36:02.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:02.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:02.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: pgmap v1310: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 839 B/s wr, 11 op/s 2023-03-17T09:36:02.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:02.646 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:22 smithi035 ceph-mon[92535]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:23 smithi035 ceph-mon[92535]: pgmap v1311: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 734 B/s wr, 11 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:26 smithi035 ceph-mon[92535]: pgmap v1312: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 727 B/s wr, 10 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:28 smithi035 ceph-mon[92535]: pgmap v1313: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 870 B/s wr, 13 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:30 smithi035 ceph-mon[92535]: pgmap v1314: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 261 B/s wr, 8 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:32 smithi035 ceph-mon[92535]: pgmap v1315: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 261 B/s wr, 8 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:34 smithi035 ceph-mon[92535]: pgmap v1316: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:36 smithi035 ceph-mon[92535]: pgmap v1317: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:38 smithi035 ceph-mon[92535]: pgmap v1318: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:40 smithi035 ceph-mon[92535]: pgmap v1319: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:42 smithi035 ceph-mon[92535]: pgmap v1320: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:44 smithi035 ceph-mon[92535]: pgmap v1321: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:03.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:46 smithi035 ceph-mon[92535]: pgmap v1322: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:03.504 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:48 smithi035 ceph-mon[92535]: pgmap v1323: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:03.504 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:50 smithi035 ceph-mon[92535]: pgmap v1324: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:03.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:52 smithi035 ceph-mon[92535]: pgmap v1325: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:03.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:54 smithi035 ceph-mon[92535]: pgmap v1326: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:36:03.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:56 smithi035 ceph-mon[92535]: pgmap v1327: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:04.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:27:58 smithi035 ceph-mon[92535]: pgmap v1328: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:04.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:00 smithi035 ceph-mon[92535]: pgmap v1329: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:04.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:02 smithi035 ceph-mon[92535]: pgmap v1330: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:04.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:04 smithi035 ceph-mon[92535]: pgmap v1331: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:06 smithi035 ceph-mon[92535]: pgmap v1332: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:08 smithi035 ceph-mon[92535]: pgmap v1333: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:09 smithi035 ceph-mon[92535]: osdmap e160: 12 total, 12 up, 12 in 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:10 smithi035 ceph-mon[92535]: pgmap v1335: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:12 smithi035 ceph-mon[92535]: pgmap v1336: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:14 smithi035 ceph-mon[92535]: pgmap v1337: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:16 smithi035 ceph-mon[92535]: pgmap v1338: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:16 smithi035 ceph-mon[92535]: osdmap e161: 12 total, 12 up, 12 in 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:18 smithi035 ceph-mon[92535]: pgmap v1340: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:20 smithi035 ceph-mon[92535]: pgmap v1341: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:04.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:22 smithi035 ceph-mon[92535]: pgmap v1342: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:36:04.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:04.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:04.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:05.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:23 smithi035 ceph-mon[92535]: pgmap v1343: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T09:36:05.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:23 smithi035 ceph-mon[92535]: pgmap v1344: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 149 B/s wr, 14 op/s 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:36:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:36:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.055+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56022a5e1600 con 0x56022a6da0a0 2023-03-17T09:36:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.056+0000 7fa51effd700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a6da0a0 0x56022a6dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.056+0000 7fa4feffd700 10 client.16941 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.056+0000 7fa51effd700 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a6da0a0 0x56022a6dc480 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b509b21fcaf6a424 server_cookie=7df5048f4a2a896d in_seq=0 out_seq=0 2023-03-17T09:36:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa4feffd700 1 -- 172.21.15.35:0/1768557519 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56022a5e1600 con 0x56022a6da0a0 2023-03-17T09:36:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa4feffd700 10 client.16941 handle_command_reply: tid=0 2023-03-17T09:36:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 client.16941 shutdown 2023-03-17T09:36:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 msgr2=0x56022a6cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:08.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6cc4b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa5100c82b0 tx=0x7fa510098610 comp rx=0 tx=0).stop 2023-03-17T09:36:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 shutdown_connections 2023-03-17T09:36:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a6da0a0 0x56022a6dc480 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6cc4b0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa4feffd700 0 client.16941 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/1768557519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 >> 172.21.15.35:0/1768557519 conn(0x56022a51d6b0 msgr2=0x56022a6bf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 shutdown_connections 2023-03-17T09:36:09.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 1 -- 172.21.15.35:0/1768557519 wait complete. 2023-03-17T09:36:10.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.057+0000 7fa531ce1b80 20 client.16941 trim_cache size 0 max 16384 2023-03-17T09:36:10.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.072+0000 7fa531ce1b80 1 Processor -- start 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.072+0000 7fa531ce1b80 1 -- start start 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.072+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6baac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6bb000 con 0x56022a6c0960 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6b75c0 con 0x56022a6c5be0 2023-03-17T09:36:10.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6c0780 con 0x56022a6c64f0 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6baac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6baac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45922/0 (socket says 172.21.15.35:45922) 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 -- 172.21.15.35:0/3024495314 learned_addr learned my addr 172.21.15.35:0/3024495314 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51ffff700 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51effd700 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 -- 172.21.15.35:0/3024495314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 msgr2=0x56022a6cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 -- 172.21.15.35:0/3024495314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 msgr2=0x56022a6d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:10.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:10.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 -- 172.21.15.35:0/3024495314 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56022a5d9130 con 0x56022a6c0960 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51effd700 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6baac0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa510094f90 tx=0x7fa51009c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d393d7a7d2abb8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa5067fc700 1 -- 172.21.15.35:0/3024495314 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510094040 con 0x56022a6c0960 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa5067fc700 1 -- 172.21.15.35:0/3024495314 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5100b4070 con 0x56022a6c0960 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.073+0000 7fa5067fc700 1 -- 172.21.15.35:0/3024495314 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100a0280 con 0x56022a6c0960 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 -- 172.21.15.35:0/3024495314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 msgr2=0x56022a6baac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6baac0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa510094f90 tx=0x7fa51009c420 comp rx=0 tx=0).stop 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 -- 172.21.15.35:0/3024495314 shutdown_connections 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c0960 0x56022a6baac0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/3024495314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c5be0 0x56022a6d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 -- 172.21.15.35:0/3024495314 >> 172.21.15.35:0/3024495314 conn(0x56022a51d6b0 msgr2=0x56022a6d5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 -- 172.21.15.35:0/3024495314 shutdown_connections 2023-03-17T09:36:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 -- 172.21.15.35:0/3024495314 wait complete. 2023-03-17T09:36:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 -- start start 2023-03-17T09:36:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.074+0000 7fa531ce1b80 1 Processor -- start 2023-03-17T09:36:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c0960 0x56022a6d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 0x56022a6cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6cff50 con 0x56022a6c5be0 2023-03-17T09:36:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a6d00c0 con 0x56022a6c0960 2023-03-17T09:36:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022a72def0 con 0x56022a6c64f0 2023-03-17T09:36:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa531ce1b80 10 client.0 _ll_register_callbacks cb 0x56022a4b8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:36:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 0x56022a6cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 0x56022a6cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45930/0 (socket says 172.21.15.35:45930) 2023-03-17T09:36:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 -- 172.21.15.35:0/2459028399 learned_addr learned my addr 172.21.15.35:0/2459028399 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51ffff700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c0960 0x56022a6d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 -- 172.21.15.35:0/2459028399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 msgr2=0x56022a6cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 -- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c0960 msgr2=0x56022a6d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c0960 0x56022a6d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 -- 172.21.15.35:0/2459028399 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56022a440d80 con 0x56022a6c5be0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c0960 0x56022a6d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa51effd700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 0x56022a6cf320 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa514006010 tx=0x7fa514005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c1a4f4a1669a65 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa4feffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.075+0000 7fa4feffd700 1 -- 172.21.15.35:0/2459028399 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51402a030 con 0x56022a6c5be0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa4feffd700 1 -- 172.21.15.35:0/2459028399 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa514039050 con 0x56022a6c5be0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56022a6901e0 con 0x56022a6c5be0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa4feffd700 1 -- 172.21.15.35:0/2459028399 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa51401d040 con 0x56022a6c5be0 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 10 client.16947 fetch_fsmap learned FSMap version 33 2023-03-17T09:36:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56022a4671f0 con 0x56022a6c5be0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa4feffd700 1 -- 172.21.15.35:0/2459028399 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56022a6901e0 con 0x56022a6c5be0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa4feffd700 1 -- 172.21.15.35:0/2459028399 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa514005450 con 0x56022a6c5be0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 10 client.16947 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 10 client.16947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 20 client.16947 populate_metadata read hostname 'smithi035' 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a72f0f0 0x56022a731500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 4 client.16947 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56022a496f00 con 0x56022a72f0f0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.076+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a72f0f0 0x56022a731500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.077+0000 7fa4feffd700 10 client.16947 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.077+0000 7fa51f7fe700 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a72f0f0 0x56022a731500 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e50db7783ade761 server_cookie=474d7991419ba6a6 in_seq=0 out_seq=0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa4feffd700 1 -- 172.21.15.35:0/2459028399 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56022a496f00 con 0x56022a72f0f0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa4feffd700 10 client.16947 handle_command_reply: tid=0 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 client.16947 shutdown 2023-03-17T09:36:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 msgr2=0x56022a6cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:14.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 0x56022a6cf320 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa514006010 tx=0x7fa514005990 comp rx=0 tx=0).stop 2023-03-17T09:36:14.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 shutdown_connections 2023-03-17T09:36:14.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56022a72f0f0 0x56022a731500 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56022a6c64f0 0x56022a6cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa4feffd700 0 client.16947 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56022a6c0960 0x56022a6d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 --2- 172.21.15.35:0/2459028399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56022a6c5be0 0x56022a6cf320 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 >> 172.21.15.35:0/2459028399 conn(0x56022a51d6b0 msgr2=0x56022a6c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 shutdown_connections 2023-03-17T09:36:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 1 -- 172.21.15.35:0/2459028399 wait complete. 2023-03-17T09:36:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.081+0000 7fa531ce1b80 20 client.16947 trim_cache size 0 max 16384 2023-03-17T09:36:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa50809f640 msgr2=0x7fa5080a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa50809f640 0x7fa5080a1af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa514009990 tx=0x7fa51401a040 comp rx=0 tx=0).stop 2023-03-17T09:36:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 msgr2=0x7fa5201962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 0x7fa5201962a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e9a0 tx=0x7fa51000ed60 comp rx=0 tx=0).stop 2023-03-17T09:36:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 shutdown_connections 2023-03-17T09:36:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa50809f640 0x7fa5080a1af0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520104390 0x7fa52019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5200ff350 0x7fa5201962a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 --2- 172.21.15.35:0/855524960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5200ffcf0 0x7fa5201967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 >> 172.21.15.35:0/855524960 conn(0x7fa520076330 msgr2=0x7fa5200680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 shutdown_connections 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:13:27.082+0000 7fa525b54700 1 -- 172.21.15.35:0/855524960 wait complete. 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 -- 172.21.15.35:0/3112240678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 msgr2=0x7f42b410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3112240678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b410bf60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00b0d0 tx=0x7f42ac00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 -- 172.21.15.35:0/3112240678 shutdown_connections 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3112240678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b410bf60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3112240678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42b40ff350 0x7f42b40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3112240678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b40ffcf0 0x7f42b4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 -- 172.21.15.35:0/3112240678 >> 172.21.15.35:0/3112240678 conn(0x7f42b4076330 msgr2=0x7f42b4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 -- 172.21.15.35:0/3112240678 shutdown_connections 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 -- 172.21.15.35:0/3112240678 wait complete. 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.950+0000 7f42b9e27700 1 Processor -- start 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 -- start start 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b40ff350 0x7f42b41971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42b40ffcf0 0x7f42b4197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b41a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4198010 con 0x7f42b4104390 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b41a2780 con 0x7f42b40ff350 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b9e27700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b41a28f0 con 0x7f42b40ffcf0 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b41a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b41a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45958/0 (socket says 172.21.15.35:45958) 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 -- 172.21.15.35:0/3446705820 learned_addr learned my addr 172.21.15.35:0/3446705820 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42b40ffcf0 0x7f42b4197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b37fe700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b40ff350 0x7f42b41971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 -- 172.21.15.35:0/3446705820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42b40ffcf0 msgr2=0x7f42b4197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42b40ffcf0 0x7f42b4197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 -- 172.21.15.35:0/3446705820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b40ff350 msgr2=0x7f42b41971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b40ff350 0x7f42b41971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.951+0000 7f42b3fff700 1 -- 172.21.15.35:0/3446705820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009d00 con 0x7f42b4104390 2023-03-17T09:36:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.952+0000 7f42b3fff700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b41a2240 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f42ac008ec0 tx=0x7f42ac008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.952+0000 7f42b0ff9700 1 -- 172.21.15.35:0/3446705820 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00e040 con 0x7f42b4104390 2023-03-17T09:36:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.952+0000 7f42b0ff9700 1 -- 172.21.15.35:0/3446705820 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42ac00be30 con 0x7f42b4104390 2023-03-17T09:36:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.952+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b410efc0 con 0x7f42b4104390 2023-03-17T09:36:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.952+0000 7f42b0ff9700 1 -- 172.21.15.35:0/3446705820 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac01b6c0 con 0x7f42b4104390 2023-03-17T09:36:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.952+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b410ee30 con 0x7f42b4104390 2023-03-17T09:36:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.954+0000 7f42b0ff9700 1 -- 172.21.15.35:0/3446705820 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f42ac024410 con 0x7f42b4104390 2023-03-17T09:36:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.955+0000 7f42b0ff9700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f429c09f640 0x7f429c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.955+0000 7f42b37fe700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f429c09f640 0x7f429c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.955+0000 7f42b0ff9700 1 -- 172.21.15.35:0/3446705820 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f42ac0cb7f0 con 0x7f42b4104390 2023-03-17T09:36:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.955+0000 7f42b37fe700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f429c09f640 0x7f429c0a1af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005950 tx=0x7f42a40058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.955+0000 7f42c5fb4b80 1 Processor -- start 2023-03-17T09:36:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 -- start start 2023-03-17T09:36:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 0x5635e2340410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233a830 0x5635e233aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e223d010 con 0x5635e2340040 2023-03-17T09:36:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e228f950 con 0x5635e233b1e0 2023-03-17T09:36:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e2288de0 con 0x5635e233a830 2023-03-17T09:36:19.855 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:25 smithi035 ceph-mon[92535]: pgmap v1345: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 118 B/s wr, 11 op/s 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 0x5635e2340410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 0x5635e2340410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45962/0 (socket says 172.21.15.35:45962) 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 -- 172.21.15.35:0/347819853 learned_addr learned my addr 172.21.15.35:0/347819853 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233a830 0x5635e233aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b3fff700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 -- 172.21.15.35:0/347819853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233a830 msgr2=0x5635e233aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233a830 0x5635e233aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 -- 172.21.15.35:0/347819853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 msgr2=0x5635e2346dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 -- 172.21.15.35:0/347819853 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e210a5d0 con 0x5635e2340040 2023-03-17T09:36:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233a830 0x5635e233aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:36:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b3fff700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:36:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.956+0000 7f42b37fe700 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 0x5635e2340410 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f42a400fd70 tx=0x7f42a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8156e77c5b95ae0e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f4299ffb700 1 -- 172.21.15.35:0/347819853 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4011c60 con 0x5635e2340040 2023-03-17T09:36:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f4299ffb700 1 -- 172.21.15.35:0/347819853 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42a4011dc0 con 0x5635e2340040 2023-03-17T09:36:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f4299ffb700 1 -- 172.21.15.35:0/347819853 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a401d770 con 0x5635e2340040 2023-03-17T09:36:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/347819853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 msgr2=0x5635e2340410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 0x5635e2340410 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f42a400fd70 tx=0x7f42a4012000 comp rx=0 tx=0).stop 2023-03-17T09:36:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/347819853 shutdown_connections 2023-03-17T09:36:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e2340040 0x5635e2340410 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:20.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/347819853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233a830 0x5635e233aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:20.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/347819853 >> 172.21.15.35:0/347819853 conn(0x5635e21936b0 msgr2=0x5635e2330a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:20.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/347819853 shutdown_connections 2023-03-17T09:36:20.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.957+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/347819853 wait complete. 2023-03-17T09:36:20.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 -- start start 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 Processor -- start 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233a830 0x5635e2346c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 0x5635e2343f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e2344530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e210c8c0 con 0x5635e233b1e0 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e2344ca0 con 0x5635e233a830 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e23504e0 con 0x5635e2340040 2023-03-17T09:36:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42c5fb4b80 10 client.0 _ll_register_callbacks cb 0x5635e212e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:36:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42b2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 0x5635e2343f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42b2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 0x5635e2343f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45970/0 (socket says 172.21.15.35:45970) 2023-03-17T09:36:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42b2ffd700 1 -- 172.21.15.35:0/2869658301 learned_addr learned my addr 172.21.15.35:0/2869658301 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.958+0000 7f42b37fe700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233a830 0x5635e2346c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b3fff700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e2344530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b2ffd700 1 -- 172.21.15.35:0/2869658301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 msgr2=0x5635e2344530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e2344530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b2ffd700 1 -- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233a830 msgr2=0x5635e2346c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233a830 0x5635e2346c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b2ffd700 1 -- 172.21.15.35:0/2869658301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a400fa20 con 0x5635e233b1e0 2023-03-17T09:36:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 0x5635e2343f70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f42a80116f0 tx=0x7f42a8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db46805a7612db12 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f4292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:36:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f4292ffd700 1 -- 172.21.15.35:0/2869658301 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8016070 con 0x5635e233b1e0 2023-03-17T09:36:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f4292ffd700 1 -- 172.21.15.35:0/2869658301 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f42a8004320 con 0x5635e233b1e0 2023-03-17T09:36:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635e224b390 con 0x5635e233b1e0 2023-03-17T09:36:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f4292ffd700 1 -- 172.21.15.35:0/2869658301 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42a80044e0 con 0x5635e233b1e0 2023-03-17T09:36:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42c5fb4b80 10 client.16959 fetch_fsmap learned FSMap version 33 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5635e20b6d80 con 0x5635e233b1e0 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.959+0000 7f4292ffd700 1 -- 172.21.15.35:0/2869658301 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42a8027020 con 0x5635e233b1e0 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f4292ffd700 1 -- 172.21.15.35:0/2869658301 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f42a8005520 con 0x5635e233b1e0 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42c5fb4b80 10 client.16959 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42c5fb4b80 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42c5fb4b80 20 client.16959 populate_metadata read hostname 'smithi035' 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e2354450 0x5635e2356860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42c5fb4b80 4 client.16959 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635e2257600 con 0x5635e2354450 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.960+0000 7f42b37fe700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e2354450 0x5635e2356860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42b37fe700 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e2354450 0x5635e2356860 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4387f1961613ddd server_cookie=3c503dd4fed69fbc in_seq=0 out_seq=0 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f4292ffd700 10 client.16959 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f4292ffd700 1 -- 172.21.15.35:0/2869658301 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5635e2257600 con 0x5635e2354450 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f4292ffd700 10 client.16959 handle_command_reply: tid=0 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 client.16959 shutdown 2023-03-17T09:36:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 msgr2=0x5635e2343f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 0x5635e2343f70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f42a80116f0 tx=0x7f42a8011a00 comp rx=0 tx=0).stop 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 shutdown_connections 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e2354450 0x5635e2356860 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e2344530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f4292ffd700 0 client.16959 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233a830 0x5635e2346c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2869658301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233b1e0 0x5635e2343f70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.961+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 >> 172.21.15.35:0/2869658301 conn(0x5635e21936b0 msgr2=0x5635e2335410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.962+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 shutdown_connections 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.962+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2869658301 wait complete. 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.962+0000 7f42c5fb4b80 20 client.16959 trim_cache size 0 max 16384 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 Processor -- start 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 -- start start 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e233f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:26.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e2257600 con 0x5635e233a830 2023-03-17T09:36:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e224c050 con 0x5635e233b1e0 2023-03-17T09:36:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e232d5c0 con 0x5635e2340040 2023-03-17T09:36:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45976/0 (socket says 172.21.15.35:45976) 2023-03-17T09:36:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42b37fe700 1 -- 172.21.15.35:0/1680785650 learned_addr learned my addr 172.21.15.35:0/1680785650 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.977+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b3fff700 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e233f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b37fe700 1 -- 172.21.15.35:0/1680785650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 msgr2=0x5635e233f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b37fe700 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e233f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b37fe700 1 -- 172.21.15.35:0/1680785650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 msgr2=0x5635e2346820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b37fe700 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b37fe700 1 -- 172.21.15.35:0/1680785650 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e224f130 con 0x5635e233a830 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b3fff700 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e233f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f42b37fe700 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234b430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f42a4011ab0 tx=0x7f42a400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30527c5e2db9ca6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f429a7fc700 1 -- 172.21.15.35:0/1680785650 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a402d040 con 0x5635e233a830 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f429a7fc700 1 -- 172.21.15.35:0/1680785650 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42a402e040 con 0x5635e233a830 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.978+0000 7f429a7fc700 1 -- 172.21.15.35:0/1680785650 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4005330 con 0x5635e233a830 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/1680785650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 msgr2=0x5635e234b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234b430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f42a4011ab0 tx=0x7f42a400ba70 comp rx=0 tx=0).stop 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/1680785650 shutdown_connections 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e2340040 0x5635e233f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234b430 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/1680785650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e233b1e0 0x5635e2346820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/1680785650 >> 172.21.15.35:0/1680785650 conn(0x5635e21936b0 msgr2=0x5635e233e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/1680785650 shutdown_connections 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/1680785650 wait complete. 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 -- start start 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 Processor -- start 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.979+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233b1e0 0x5635e234b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e2340040 0x5635e2349410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e23499e0 con 0x5635e233a830 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e2349b50 con 0x5635e2340040 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e2349d10 con 0x5635e233b1e0 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 10 client.0 _ll_register_callbacks cb 0x5635e212e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:36:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45982/0 (socket says 172.21.15.35:45982) 2023-03-17T09:36:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 -- 172.21.15.35:0/2882400634 learned_addr learned my addr 172.21.15.35:0/2882400634 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:36:28.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233b1e0 0x5635e234b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b3fff700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e2340040 0x5635e2349410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 -- 172.21.15.35:0/2882400634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233b1e0 msgr2=0x5635e234b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233b1e0 0x5635e234b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 -- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e2340040 msgr2=0x5635e2349410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:36:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e2340040 0x5635e2349410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 -- 172.21.15.35:0/2882400634 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635e210a5d0 con 0x5635e233a830 2023-03-17T09:36:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b3fff700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e2340040 0x5635e2349410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:36:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42b37fe700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234ae30 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f42a4012fd0 tx=0x7f42a400fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e5864e681366b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:36:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f4292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f4292ffd700 1 -- 172.21.15.35:0/2882400634 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4034dd0 con 0x5635e233a830 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f4292ffd700 1 -- 172.21.15.35:0/2882400634 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f42a40345a0 con 0x5635e233a830 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635e23061e0 con 0x5635e233a830 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.980+0000 7f4292ffd700 1 -- 172.21.15.35:0/2882400634 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42a4005040 con 0x5635e233a830 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 10 client.16965 fetch_fsmap learned FSMap version 33 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5635e20dd1f0 con 0x5635e233a830 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f4292ffd700 1 -- 172.21.15.35:0/2882400634 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635e23061e0 con 0x5635e233a830 2023-03-17T09:36:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f4292ffd700 1 -- 172.21.15.35:0/2882400634 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f42a4004ce0 con 0x5635e233a830 2023-03-17T09:36:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 10 client.16965 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:36:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 10 client.16965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:36:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 20 client.16965 populate_metadata read hostname 'smithi035' 2023-03-17T09:36:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e23a8f80 0x5635e23ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:36:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 4 client.16965 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:36:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5635e210cf00 con 0x5635e23a8f80 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.981+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e23a8f80 0x5635e23ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.982+0000 7f4292ffd700 10 client.16965 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.982+0000 7f42b2ffd700 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e23a8f80 0x5635e23ab360 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca5c7c45d281aff server_cookie=6b1cecee439bfce9 in_seq=0 out_seq=0 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f4292ffd700 1 -- 172.21.15.35:0/2882400634 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5635e210cf00 con 0x5635e23a8f80 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f4292ffd700 10 client.16965 handle_command_reply: tid=0 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 client.16965 shutdown 2023-03-17T09:36:30.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 msgr2=0x5635e234ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:36:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234ae30 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f42a4012fd0 tx=0x7f42a400fe30 comp rx=0 tx=0).stop 2023-03-17T09:36:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 shutdown_connections 2023-03-17T09:36:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5635e23a8f80 0x5635e23ab360 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635e2340040 0x5635e2349410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5635e233a830 0x5635e234ae30 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 --2- 172.21.15.35:0/2882400634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5635e233b1e0 0x5635e234b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:36:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f4292ffd700 0 client.16965 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:36:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 >> 172.21.15.35:0/2882400634 conn(0x5635e21936b0 msgr2=0x5635e233f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:36:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 shutdown_connections 2023-03-17T09:36:33.105 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:27 smithi035 ceph-mon[92535]: pgmap v1346: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:30 smithi078 ceph-mon[94114]: pgmap v769: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:32 smithi078 ceph-mon[94114]: pgmap v770: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:34 smithi078 ceph-mon[94114]: pgmap v771: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:36 smithi078 ceph-mon[94114]: pgmap v772: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:38 smithi078 ceph-mon[94114]: pgmap v773: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:40 smithi078 ceph-mon[94114]: pgmap v774: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:42 smithi078 ceph-mon[94114]: pgmap v775: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:44 smithi078 ceph-mon[94114]: pgmap v776: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:33.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:46 smithi078 ceph-mon[94114]: pgmap v777: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:33.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:48 smithi078 ceph-mon[94114]: pgmap v778: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:33.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:50 smithi078 ceph-mon[94114]: pgmap v779: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:33.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:52 smithi078 ceph-mon[94114]: pgmap v780: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:33.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:54 smithi078 ceph-mon[94114]: pgmap v781: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:56 smithi078 ceph-mon[94114]: pgmap v782: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:58 smithi078 ceph-mon[94114]: pgmap v783: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:10:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:00 smithi078 ceph-mon[94114]: pgmap v784: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:02 smithi078 ceph-mon[94114]: pgmap v785: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:04 smithi078 ceph-mon[94114]: pgmap v786: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:06 smithi078 ceph-mon[94114]: pgmap v787: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:08 smithi078 ceph-mon[94114]: pgmap v788: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:34.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:09 smithi078 ceph-mon[94114]: osdmap e125: 12 total, 12 up, 12 in 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:10 smithi078 ceph-mon[94114]: pgmap v790: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:12 smithi078 ceph-mon[94114]: pgmap v791: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:14 smithi078 ceph-mon[94114]: pgmap v792: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:16 smithi078 ceph-mon[94114]: osdmap e126: 12 total, 12 up, 12 in 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:16 smithi078 ceph-mon[94114]: pgmap v794: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:18 smithi078 ceph-mon[94114]: pgmap v795: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T09:36:34.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:20 smithi078 ceph-mon[94114]: pgmap v796: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:35.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:22 smithi078 ceph-mon[94114]: pgmap v797: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:35.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:24 smithi078 ceph-mon[94114]: pgmap v798: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:36:35.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:26 smithi078 ceph-mon[94114]: pgmap v799: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:36:35.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:28 smithi078 ceph-mon[94114]: pgmap v800: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:35.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:30 smithi078 ceph-mon[94114]: pgmap v801: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:35.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:32 smithi078 ceph-mon[94114]: pgmap v802: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:35.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:34 smithi078 ceph-mon[94114]: pgmap v803: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:35.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:36 smithi078 ceph-mon[94114]: pgmap v804: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:35.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:38 smithi078 ceph-mon[94114]: pgmap v805: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:35.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:40 smithi078 ceph-mon[94114]: pgmap v806: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:36.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:42 smithi078 ceph-mon[94114]: pgmap v807: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:36.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:44 smithi078 ceph-mon[94114]: pgmap v808: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:36.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:46 smithi078 ceph-mon[94114]: pgmap v809: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:37.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:48 smithi078 ceph-mon[94114]: pgmap v810: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:37.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:50 smithi078 ceph-mon[94114]: pgmap v811: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:37.599 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:52 smithi078 ceph-mon[94114]: pgmap v812: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:37.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:54 smithi078 ceph-mon[94114]: pgmap v813: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:37.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:56 smithi078 ceph-mon[94114]: pgmap v814: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:38.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:11:58 smithi078 ceph-mon[94114]: pgmap v815: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:38.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:00 smithi078 ceph-mon[94114]: pgmap v816: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:38.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:38.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:38.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:38.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:38.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:02 smithi078 ceph-mon[94114]: pgmap v817: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:38.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:04 smithi078 ceph-mon[94114]: pgmap v818: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:39.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:06 smithi078 ceph-mon[94114]: pgmap v819: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:36:39.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:08 smithi078 ceph-mon[94114]: pgmap v820: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:39.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:09 smithi078 ceph-mon[94114]: osdmap e127: 12 total, 12 up, 12 in 2023-03-17T09:36:39.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:10 smithi078 ceph-mon[94114]: pgmap v822: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:39.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:12 smithi078 ceph-mon[94114]: pgmap v823: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:39.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:14 smithi078 ceph-mon[94114]: pgmap v824: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:16 smithi078 ceph-mon[94114]: osdmap e128: 12 total, 12 up, 12 in 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:16 smithi078 ceph-mon[94114]: pgmap v826: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:18 smithi078 ceph-mon[94114]: pgmap v827: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:20 smithi078 ceph-mon[94114]: pgmap v828: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:22 smithi078 ceph-mon[94114]: pgmap v829: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:24 smithi078 ceph-mon[94114]: pgmap v830: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:26 smithi078 ceph-mon[94114]: pgmap v831: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:28 smithi078 ceph-mon[94114]: pgmap v832: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:30 smithi078 ceph-mon[94114]: pgmap v833: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:32 smithi078 ceph-mon[94114]: pgmap v834: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:34 smithi078 ceph-mon[94114]: pgmap v835: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:36 smithi078 ceph-mon[94114]: pgmap v836: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:38 smithi078 ceph-mon[94114]: pgmap v837: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:39.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:40 smithi078 ceph-mon[94114]: pgmap v838: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:39.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:42 smithi078 ceph-mon[94114]: pgmap v839: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:39.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:44 smithi078 ceph-mon[94114]: pgmap v840: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:39.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:46 smithi078 ceph-mon[94114]: pgmap v841: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:39.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:48 smithi078 ceph-mon[94114]: pgmap v842: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:40.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:50 smithi078 ceph-mon[94114]: pgmap v843: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:52 smithi078 ceph-mon[94114]: pgmap v844: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:54 smithi078 ceph-mon[94114]: pgmap v845: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:56 smithi078 ceph-mon[94114]: pgmap v846: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:12:58 smithi078 ceph-mon[94114]: pgmap v847: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:00 smithi078 ceph-mon[94114]: pgmap v848: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:02 smithi078 ceph-mon[94114]: pgmap v849: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:36:40.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:04 smithi078 ceph-mon[94114]: pgmap v850: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:06 smithi078 ceph-mon[94114]: pgmap v851: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:08 smithi078 ceph-mon[94114]: pgmap v852: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:09 smithi078 ceph-mon[94114]: osdmap e129: 12 total, 12 up, 12 in 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:10 smithi078 ceph-mon[94114]: pgmap v854: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:12 smithi078 ceph-mon[94114]: pgmap v855: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:14 smithi078 ceph-mon[94114]: pgmap v856: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:16 smithi078 ceph-mon[94114]: osdmap e130: 12 total, 12 up, 12 in 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:16 smithi078 ceph-mon[94114]: pgmap v858: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:18 smithi078 ceph-mon[94114]: pgmap v859: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:20 smithi078 ceph-mon[94114]: pgmap v860: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:36:41.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:22 smithi078 ceph-mon[94114]: pgmap v861: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:24 smithi078 ceph-mon[94114]: pgmap v862: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:26 smithi078 ceph-mon[94114]: pgmap v863: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 813 B/s wr, 10 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:28 smithi078 ceph-mon[94114]: pgmap v864: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:30 smithi078 ceph-mon[94114]: pgmap v865: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:32 smithi078 ceph-mon[94114]: pgmap v866: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:34 smithi078 ceph-mon[94114]: pgmap v867: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:36 smithi078 ceph-mon[94114]: pgmap v868: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:38 smithi078 ceph-mon[94114]: pgmap v869: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:40 smithi078 ceph-mon[94114]: pgmap v870: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:42 smithi078 ceph-mon[94114]: pgmap v871: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:44 smithi078 ceph-mon[94114]: pgmap v872: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:46 smithi078 ceph-mon[94114]: pgmap v873: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:48 smithi078 ceph-mon[94114]: pgmap v874: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:50 smithi078 ceph-mon[94114]: pgmap v875: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:52 smithi078 ceph-mon[94114]: pgmap v876: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:54 smithi078 ceph-mon[94114]: pgmap v877: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:56 smithi078 ceph-mon[94114]: pgmap v878: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:41.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:13:58 smithi078 ceph-mon[94114]: pgmap v879: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:42.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:00 smithi078 ceph-mon[94114]: pgmap v880: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:42.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:02 smithi078 ceph-mon[94114]: pgmap v881: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:04 smithi078 ceph-mon[94114]: pgmap v882: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:06 smithi078 ceph-mon[94114]: pgmap v883: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:08 smithi078 ceph-mon[94114]: pgmap v884: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:09 smithi078 ceph-mon[94114]: osdmap e131: 12 total, 12 up, 12 in 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:10 smithi078 ceph-mon[94114]: pgmap v886: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:12 smithi078 ceph-mon[94114]: pgmap v887: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:43.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:14 smithi078 ceph-mon[94114]: pgmap v888: 97 pgs: 97 active+clean; 1.4 MiB data, 165 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:43.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:16 smithi078 ceph-mon[94114]: osdmap e132: 12 total, 12 up, 12 in 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:16 smithi078 ceph-mon[94114]: pgmap v890: 97 pgs: 97 active+clean; 1.4 MiB data, 165 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:18 smithi078 ceph-mon[94114]: pgmap v891: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:20 smithi078 ceph-mon[94114]: pgmap v892: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:22 smithi078 ceph-mon[94114]: pgmap v893: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:24 smithi078 ceph-mon[94114]: pgmap v894: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:26 smithi078 ceph-mon[94114]: pgmap v895: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:36:43.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:28 smithi078 ceph-mon[94114]: pgmap v896: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:30 smithi078 ceph-mon[94114]: pgmap v897: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:32 smithi078 ceph-mon[94114]: pgmap v898: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:34 smithi078 ceph-mon[94114]: pgmap v899: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:36 smithi078 ceph-mon[94114]: pgmap v900: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:38 smithi078 ceph-mon[94114]: pgmap v901: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:40 smithi078 ceph-mon[94114]: pgmap v902: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:42 smithi078 ceph-mon[94114]: pgmap v903: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:44 smithi078 ceph-mon[94114]: pgmap v904: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:46 smithi078 ceph-mon[94114]: pgmap v905: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:48 smithi078 ceph-mon[94114]: pgmap v906: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:50 smithi078 ceph-mon[94114]: pgmap v907: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:52 smithi078 ceph-mon[94114]: pgmap v908: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:54 smithi078 ceph-mon[94114]: pgmap v909: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:44.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:56 smithi078 ceph-mon[94114]: pgmap v910: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:14:58 smithi078 ceph-mon[94114]: pgmap v911: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:44.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:00 smithi078 ceph-mon[94114]: pgmap v912: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:02 smithi078 ceph-mon[94114]: pgmap v913: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:44.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:44.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:45.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:46.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:46.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:04 smithi078 ceph-mon[94114]: pgmap v914: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:46.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:06 smithi078 ceph-mon[94114]: pgmap v915: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:36:47.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:08 smithi078 ceph-mon[94114]: pgmap v916: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:47.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:09 smithi078 ceph-mon[94114]: osdmap e133: 12 total, 12 up, 12 in 2023-03-17T09:36:47.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:10 smithi078 ceph-mon[94114]: pgmap v918: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:47.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:12 smithi078 ceph-mon[94114]: pgmap v919: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:47.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:14 smithi078 ceph-mon[94114]: pgmap v920: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:47.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:16 smithi078 ceph-mon[94114]: osdmap e134: 12 total, 12 up, 12 in 2023-03-17T09:36:47.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:16 smithi078 ceph-mon[94114]: pgmap v922: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:36:47.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:18 smithi078 ceph-mon[94114]: pgmap v923: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:36:47.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:20 smithi078 ceph-mon[94114]: pgmap v924: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:47.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:22 smithi078 ceph-mon[94114]: pgmap v925: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:47.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:24 smithi078 ceph-mon[94114]: pgmap v926: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T09:36:47.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:26 smithi078 ceph-mon[94114]: pgmap v927: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 915 B/s wr, 10 op/s 2023-03-17T09:36:48.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:28 smithi078 ceph-mon[94114]: pgmap v928: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:36:48.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:30 smithi078 ceph-mon[94114]: pgmap v929: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:36:48.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:32 smithi078 ceph-mon[94114]: pgmap v930: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:36:48.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:34 smithi078 ceph-mon[94114]: pgmap v931: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2023-03-17T09:36:48.491 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:36 smithi078 ceph-mon[94114]: pgmap v932: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:38 smithi078 ceph-mon[94114]: pgmap v933: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:40 smithi078 ceph-mon[94114]: pgmap v934: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:42 smithi078 ceph-mon[94114]: pgmap v935: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:44 smithi078 ceph-mon[94114]: pgmap v936: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:46 smithi078 ceph-mon[94114]: pgmap v937: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:48 smithi078 ceph-mon[94114]: pgmap v938: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:48.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:50 smithi078 ceph-mon[94114]: pgmap v939: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:49.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:52 smithi078 ceph-mon[94114]: pgmap v940: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:49.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:54 smithi078 ceph-mon[94114]: pgmap v941: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:49.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:56 smithi078 ceph-mon[94114]: pgmap v942: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:36:49.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:15:58 smithi078 ceph-mon[94114]: pgmap v943: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:36:49.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:00 smithi078 ceph-mon[94114]: pgmap v944: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:49.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:02 smithi078 ceph-mon[94114]: pgmap v945: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:49.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:49.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:04 smithi078 ceph-mon[94114]: pgmap v946: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:49.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:49.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:50.802 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:50.802 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:06 smithi078 ceph-mon[94114]: pgmap v947: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:08 smithi078 ceph-mon[94114]: pgmap v948: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:09 smithi078 ceph-mon[94114]: osdmap e135: 12 total, 12 up, 12 in 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:10 smithi078 ceph-mon[94114]: pgmap v950: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:12 smithi078 ceph-mon[94114]: pgmap v951: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:50.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:14 smithi078 ceph-mon[94114]: pgmap v952: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:36:51.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:16 smithi078 ceph-mon[94114]: osdmap e136: 12 total, 12 up, 12 in 2023-03-17T09:36:51.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:16 smithi078 ceph-mon[94114]: pgmap v954: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:36:51.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:18 smithi078 ceph-mon[94114]: pgmap v955: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 915 B/s wr, 11 op/s 2023-03-17T09:36:51.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:20 smithi078 ceph-mon[94114]: pgmap v956: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:51.933 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:22 smithi078 ceph-mon[94114]: pgmap v957: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:36:51.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:24 smithi078 ceph-mon[94114]: pgmap v958: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T09:36:51.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:26 smithi078 ceph-mon[94114]: pgmap v959: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T09:36:52.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:28 smithi078 ceph-mon[94114]: pgmap v960: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T09:36:52.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:30 smithi078 ceph-mon[94114]: pgmap v961: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:52.503 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:32 smithi078 ceph-mon[94114]: pgmap v962: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:53.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:34 smithi078 ceph-mon[94114]: pgmap v963: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:53.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:36 smithi078 ceph-mon[94114]: pgmap v964: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:53.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:38 smithi078 ceph-mon[94114]: pgmap v965: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:53.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:40 smithi078 ceph-mon[94114]: pgmap v966: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:53.055 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:42 smithi078 ceph-mon[94114]: pgmap v967: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:53.055 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:44 smithi078 ceph-mon[94114]: pgmap v968: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:54.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:46 smithi078 ceph-mon[94114]: pgmap v969: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:54.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:48 smithi078 ceph-mon[94114]: pgmap v970: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:54.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:50 smithi078 ceph-mon[94114]: pgmap v971: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:54.148 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:52 smithi078 ceph-mon[94114]: pgmap v972: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:54.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:54 smithi078 ceph-mon[94114]: pgmap v973: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:54.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:56 smithi078 ceph-mon[94114]: pgmap v974: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:54.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:16:58 smithi078 ceph-mon[94114]: pgmap v975: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:54.554 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:00 smithi078 ceph-mon[94114]: pgmap v976: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:54.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:02 smithi078 ceph-mon[94114]: pgmap v977: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:54.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:04 smithi078 ceph-mon[94114]: pgmap v978: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:54.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:36:54.555 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:06 smithi078 ceph-mon[94114]: pgmap v979: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: pgmap v980: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:36:55.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:55.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:56.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:56.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:56.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:36:56.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:36:56.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:36:56.155 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:36:56.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:10 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:36:56.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:10 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:36:56.156 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:10 smithi078 ceph-mon[94114]: osdmap e137: 12 total, 12 up, 12 in 2023-03-17T09:36:56.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:10 smithi078 ceph-mon[94114]: pgmap v982: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:56.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:12 smithi078 ceph-mon[94114]: pgmap v983: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:36:56.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:14 smithi078 ceph-mon[94114]: pgmap v984: 97 pgs: 97 active+clean; 1.5 MiB data, 179 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:56.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:16 smithi078 ceph-mon[94114]: osdmap e138: 12 total, 12 up, 12 in 2023-03-17T09:36:56.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:16 smithi078 ceph-mon[94114]: pgmap v986: 97 pgs: 97 active+clean; 1.5 MiB data, 179 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:36:56.782 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:18 smithi078 ceph-mon[94114]: pgmap v987: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 12 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:20 smithi078 ceph-mon[94114]: pgmap v988: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:22 smithi078 ceph-mon[94114]: pgmap v989: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:24 smithi078 ceph-mon[94114]: pgmap v990: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:26 smithi078 ceph-mon[94114]: pgmap v991: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:28 smithi078 ceph-mon[94114]: pgmap v992: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:30 smithi078 ceph-mon[94114]: pgmap v993: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:32 smithi078 ceph-mon[94114]: pgmap v994: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:34 smithi078 ceph-mon[94114]: pgmap v995: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:36 smithi078 ceph-mon[94114]: pgmap v996: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:38 smithi078 ceph-mon[94114]: pgmap v997: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:40 smithi078 ceph-mon[94114]: pgmap v998: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:42 smithi078 ceph-mon[94114]: pgmap v999: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:44 smithi078 ceph-mon[94114]: pgmap v1000: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:46 smithi078 ceph-mon[94114]: pgmap v1001: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:48 smithi078 ceph-mon[94114]: pgmap v1002: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:56.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:50 smithi078 ceph-mon[94114]: pgmap v1003: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:56.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:52 smithi078 ceph-mon[94114]: pgmap v1004: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:58.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:54 smithi078 ceph-mon[94114]: pgmap v1005: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:56 smithi078 ceph-mon[94114]: pgmap v1006: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:17:58 smithi078 ceph-mon[94114]: pgmap v1007: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:00 smithi078 ceph-mon[94114]: pgmap v1008: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:02 smithi078 ceph-mon[94114]: pgmap v1009: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:04 smithi078 ceph-mon[94114]: pgmap v1010: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:06 smithi078 ceph-mon[94114]: pgmap v1011: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:08 smithi078 ceph-mon[94114]: pgmap v1012: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:36:58.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:09 smithi078 ceph-mon[94114]: osdmap e139: 12 total, 12 up, 12 in 2023-03-17T09:37:00.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:37:00.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:10 smithi078 ceph-mon[94114]: pgmap v1014: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:37:00.595 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:12 smithi078 ceph-mon[94114]: pgmap v1015: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:14 smithi078 ceph-mon[94114]: pgmap v1016: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:16 smithi078 ceph-mon[94114]: osdmap e140: 12 total, 12 up, 12 in 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:16 smithi078 ceph-mon[94114]: pgmap v1018: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:18 smithi078 ceph-mon[94114]: pgmap v1019: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:20 smithi078 ceph-mon[94114]: pgmap v1020: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:22 smithi078 ceph-mon[94114]: pgmap v1021: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:24 smithi078 ceph-mon[94114]: pgmap v1022: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:26 smithi078 ceph-mon[94114]: pgmap v1023: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 914 B/s wr, 10 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:28 smithi078 ceph-mon[94114]: pgmap v1024: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:30 smithi078 ceph-mon[94114]: pgmap v1025: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:32 smithi078 ceph-mon[94114]: pgmap v1026: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:34 smithi078 ceph-mon[94114]: pgmap v1027: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:37:00.596 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:36 smithi078 ceph-mon[94114]: pgmap v1028: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:37:00.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:38 smithi078 ceph-mon[94114]: pgmap v1029: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:37:00.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:40 smithi078 ceph-mon[94114]: pgmap v1030: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:37:00.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:42 smithi078 ceph-mon[94114]: pgmap v1031: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:37:00.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:44 smithi078 ceph-mon[94114]: pgmap v1032: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:37:00.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:46 smithi078 ceph-mon[94114]: pgmap v1033: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:37:00.597 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:48 smithi078 ceph-mon[94114]: pgmap v1034: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:37:01.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:50 smithi078 ceph-mon[94114]: pgmap v1035: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:37:02.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:52 smithi078 ceph-mon[94114]: pgmap v1036: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:37:02.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:54 smithi078 ceph-mon[94114]: pgmap v1037: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:37:02.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:56 smithi078 ceph-mon[94114]: pgmap v1038: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:37:02.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:18:58 smithi078 ceph-mon[94114]: pgmap v1039: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:37:02.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:00 smithi078 ceph-mon[94114]: pgmap v1040: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:37:02.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:02 smithi078 ceph-mon[94114]: pgmap v1041: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: in thread 7fa318b61700 thread_name:md_log_replay 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa32970bcf0] 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x55f46c89d702] 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55f46c89f953] 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 4: (MDLog::_replay_thread()+0x66d) [0x55f46c90b07d] 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55f46c5bed91] 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa3297011ca] 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 7: clone() 2023-03-17T09:37:02.237 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:19:04.106+0000 7fa318b61700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:37:02.238 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: in thread 7fa318b61700 thread_name:md_log_replay 2023-03-17T09:37:02.238 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:37:02.238 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:37:05.925 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa32970bcf0] 2023-03-17T09:37:05.925 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x55f46c89d702] 2023-03-17T09:37:05.925 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55f46c89f953] 2023-03-17T09:37:05.925 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 4: (MDLog::_replay_thread()+0x66d) [0x55f46c90b07d] 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55f46c5bed91] 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa3297011ca] 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 7: clone() 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 0> 2023-03-17T09:19:04.106+0000 7fa318b61700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: in thread 7fa318b61700 thread_name:md_log_replay 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:37:05.926 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa32970bcf0] 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x55f46c89d702] 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55f46c89f953] 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 4: (MDLog::_replay_thread()+0x66d) [0x55f46c90b07d] 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55f46c5bed91] 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa3297011ca] 2023-03-17T09:37:07.056 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 7: clone() 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 0> 2023-03-17T09:19:04.106+0000 7fa318b61700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: in thread 7fa318b61700 thread_name:md_log_replay 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa32970bcf0] 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2: /usr/bin/ceph-mds(+0x4bd702) [0x55f46c89d702] 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55f46c89f953] 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 4: (MDLog::_replay_thread()+0x66d) [0x55f46c90b07d] 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55f46c5bed91] 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fa3297011ca] 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 7: clone() 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:37:07.057 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[136135]: 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 1 -- 172.21.15.35:0/2882400634 wait complete. 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.990+0000 7f42c5fb4b80 20 client.16965 trim_cache size 0 max 16384 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f429c09f640 msgr2=0x7f429c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f429c09f640 0x7f429c0a1af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005950 tx=0x7f42a40058e0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 msgr2=0x7f42b41a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b41a2240 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f42ac008ec0 tx=0x7f42ac008ef0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 shutdown_connections 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f429c09f640 0x7f429c0a1af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42b4104390 0x7f42b41a2240 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42b40ff350 0x7f42b41971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 --2- 172.21.15.35:0/3446705820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42b40ffcf0 0x7f42b4197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 >> 172.21.15.35:0/3446705820 conn(0x7f42b4076330 msgr2=0x7f42b40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 shutdown_connections 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:17.991+0000 7f42b9e27700 1 -- 172.21.15.35:0/3446705820 wait complete. 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 -- 172.21.15.35:0/760700396 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 msgr2=0x7fb7f8103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/760700396 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f8103cb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0099c0 tx=0x7fb7ec009cd0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 -- 172.21.15.35:0/760700396 shutdown_connections 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/760700396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7f8104390 0x7fb7f810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/760700396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f80ff350 0x7fb7f80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/760700396 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f8103cb0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.112+0000 7fb7fe33c700 1 -- 172.21.15.35:0/760700396 >> 172.21.15.35:0/760700396 conn(0x7fb7f8076330 msgr2=0x7fb7f8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.113+0000 7fb7fe33c700 1 -- 172.21.15.35:0/760700396 shutdown_connections 2023-03-17T09:37:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.113+0000 7fb7fe33c700 1 -- 172.21.15.35:0/760700396 wait complete. 2023-03-17T09:37:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.113+0000 7fb7fe33c700 1 Processor -- start 2023-03-17T09:37:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.113+0000 7fb7fe33c700 1 -- start start 2023-03-17T09:37:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7f80ff350 0x7fb7f8196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f8104390 0x7fb7f819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f819b240 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f819b3b0 con 0x7fb7f80ff350 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f819b570 con 0x7fb7f8104390 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f81967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:45998/0 (socket says 172.21.15.35:45998) 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 -- 172.21.15.35:0/2223596384 learned_addr learned my addr 172.21.15.35:0/2223596384 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f8104390 0x7fb7f819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7f80ff350 0x7fb7f8196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 -- 172.21.15.35:0/2223596384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f8104390 msgr2=0x7fb7f819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f8104390 0x7fb7f819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 -- 172.21.15.35:0/2223596384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7f80ff350 msgr2=0x7fb7f8196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7f80ff350 0x7fb7f8196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 -- 172.21.15.35:0/2223596384 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0095f0 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f81967a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009fd0 tx=0x7fb7ec00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f57fa700 1 -- 172.21.15.35:0/2223596384 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec01d070 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f57fa700 1 -- 172.21.15.35:0/2223596384 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7ec0059a0 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f810efc0 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7f57fa700 1 -- 172.21.15.35:0/2223596384 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec022e90 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.114+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f810ee30 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.117+0000 7fb7f57fa700 1 -- 172.21.15.35:0/2223596384 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb7ec022470 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.117+0000 7fb7f57fa700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb7e009f6c0 0x7fb7e00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.118+0000 7fb7f57fa700 1 -- 172.21.15.35:0/2223596384 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb7ec0cb550 con 0x7fb7f80ffcf0 2023-03-17T09:37:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.118+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb7e009f6c0 0x7fb7e00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.118+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb7e009f6c0 0x7fb7e00a1b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8005fd0 tx=0x7fb7e8005f60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 Processor -- start 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 -- start start 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b5965253c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59651f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b59651fdc0 0x55b596520230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b596422010 con 0x55b596525900 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b596474950 con 0x55b596524ff0 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59646dde0 con 0x55b59651fdc0 2023-03-17T09:37:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59651f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59651f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46006/0 (socket says 172.21.15.35:46006) 2023-03-17T09:37:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 -- 172.21.15.35:0/78746319 learned_addr learned my addr 172.21.15.35:0/78746319 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b5965253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b59651fdc0 0x55b596520230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 -- 172.21.15.35:0/78746319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b59651fdc0 msgr2=0x55b596520230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b59651fdc0 0x55b596520230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 -- 172.21.15.35:0/78746319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 msgr2=0x55b5965253c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b5965253c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f77fe700 1 -- 172.21.15.35:0/78746319 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5962ef5d0 con 0x55b596525900 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b59651fdc0 0x55b596520230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.119+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b5965253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.120+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59651f830 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0a0cc0 tx=0x7fb7ec094d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc77c5d644e7fd6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.120+0000 7fb7de7fc700 1 -- 172.21.15.35:0/78746319 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0b0070 con 0x55b596525900 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.120+0000 7fb7de7fc700 1 -- 172.21.15.35:0/78746319 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7ec0a11f0 con 0x55b596525900 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.120+0000 7fb7de7fc700 1 -- 172.21.15.35:0/78746319 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec022720 con 0x55b596525900 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.120+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/78746319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 msgr2=0x55b59651f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:12.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.120+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59651f830 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0a0cc0 tx=0x7fb7ec094d30 comp rx=0 tx=0).stop 2023-03-17T09:37:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/78746319 shutdown_connections 2023-03-17T09:37:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b59651fdc0 0x55b596520230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b5965253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/78746319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59651f830 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/78746319 >> 172.21.15.35:0/78746319 conn(0x55b5963786b0 msgr2=0x55b596515a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/78746319 shutdown_connections 2023-03-17T09:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/78746319 wait complete. 2023-03-17T09:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 -- start start 2023-03-17T09:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 Processor -- start 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.121+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 0x55b596528ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b596529200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5962f18c0 con 0x55b596524ff0 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b596529970 con 0x55b59651fdc0 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5965350f0 con 0x55b596525900 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 10 client.0 _ll_register_callbacks cb 0x55b596313230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 0x55b596528ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 0x55b596528ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46012/0 (socket says 172.21.15.35:46012) 2023-03-17T09:37:19.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 -- 172.21.15.35:0/1360224716 learned_addr learned my addr 172.21.15.35:0/1360224716 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b596529200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 -- 172.21.15.35:0/1360224716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 msgr2=0x55b596529200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b596529200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 -- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 msgr2=0x55b59652b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 -- 172.21.15.35:0/1360224716 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f810ee30 con 0x55b596524ff0 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 0x55b596528ac0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0c8d90 tx=0x7fb7ec005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6ed507430f3b32 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7d77fe700 1 -- 172.21.15.35:0/1360224716 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0b0070 con 0x55b596524ff0 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7d77fe700 1 -- 172.21.15.35:0/1360224716 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb7ec022720 con 0x55b596524ff0 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b596430390 con 0x55b596524ff0 2023-03-17T09:37:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb7d77fe700 1 -- 172.21.15.35:0/1360224716 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7ec0a11f0 con 0x55b596524ff0 2023-03-17T09:37:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.122+0000 7fb80a4c9b80 10 client.16977 fetch_fsmap learned FSMap version 33 2023-03-17T09:37:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b59629bd80 con 0x55b596524ff0 2023-03-17T09:37:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb7d77fe700 1 -- 172.21.15.35:0/1360224716 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b596430390 con 0x55b596524ff0 2023-03-17T09:37:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb7d77fe700 1 -- 172.21.15.35:0/1360224716 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb7ec0a0d60 con 0x55b596524ff0 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 10 client.16977 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 10 client.16977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 20 client.16977 populate_metadata read hostname 'smithi035' 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b596538cd0 0x55b59653b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 4 client.16977 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b59643c600 con 0x55b596538cd0 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.123+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b596538cd0 0x55b59653b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b596538cd0 0x55b59653b0b0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256a59a7bc9f4a98 server_cookie=1b91538fd5c5358e in_seq=0 out_seq=0 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb7d77fe700 10 client.16977 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb7d77fe700 1 -- 172.21.15.35:0/1360224716 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b59643c600 con 0x55b596538cd0 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb7d77fe700 10 client.16977 handle_command_reply: tid=0 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb80a4c9b80 1 client.16977 shutdown 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 msgr2=0x55b596528ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.124+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 0x55b596528ac0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0c8d90 tx=0x7fb7ec005f10 comp rx=0 tx=0).stop 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 shutdown_connections 2023-03-17T09:37:23.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b596538cd0 0x55b59653b0b0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b596529200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/1360224716 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596524ff0 0x55b596528ac0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb7d77fe700 0 client.16977 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 >> 172.21.15.35:0/1360224716 conn(0x55b5963786b0 msgr2=0x55b59651a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 shutdown_connections 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/1360224716 wait complete. 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.125+0000 7fb80a4c9b80 20 client.16977 trim_cache size 0 max 16384 2023-03-17T09:37:24.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.139+0000 7fb80a4c9b80 1 Processor -- start 2023-03-17T09:37:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.139+0000 7fb80a4c9b80 1 -- start start 2023-03-17T09:37:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 0x55b5965300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:24.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b59652b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b59652b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5965110f0 con 0x55b59651fdc0 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5965173d0 con 0x55b596524ff0 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b596517c10 con 0x55b596525900 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 0x55b5965300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 0x55b5965300c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46018/0 (socket says 172.21.15.35:46018) 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 -- 172.21.15.35:0/3176491292 learned_addr learned my addr 172.21.15.35:0/3176491292 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 -- 172.21.15.35:0/3176491292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 msgr2=0x55b59652b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b59652b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b59652b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 -- 172.21.15.35:0/3176491292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 msgr2=0x55b59652b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b59652b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 -- 172.21.15.35:0/3176491292 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b596520460 con 0x55b59651fdc0 2023-03-17T09:37:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 0x55b5965300c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800b490 tx=0x7fb7e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b93cd2f9ab93dd1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7deffd700 1 -- 172.21.15.35:0/3176491292 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8025040 con 0x55b59651fdc0 2023-03-17T09:37:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7deffd700 1 -- 172.21.15.35:0/3176491292 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7e8011db0 con 0x55b59651fdc0 2023-03-17T09:37:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.140+0000 7fb7deffd700 1 -- 172.21.15.35:0/3176491292 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e801f690 con 0x55b59651fdc0 2023-03-17T09:37:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3176491292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 msgr2=0x55b5965300c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:25.413 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-mon[94114]: pgmap v1042: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:37:25.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:04 smithi078 ceph-mon[94114]: osdmap e141: 12 total, 12 up, 12 in 2023-03-17T09:37:25.414 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:29 smithi035 ceph-mon[92535]: pgmap v1347: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:37:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 0x55b5965300c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800b490 tx=0x7fb7e8015000 comp rx=0 tx=0).stop 2023-03-17T09:37:26.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3176491292 shutdown_connections 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596525900 0x55b59652b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b59651fdc0 0x55b5965300c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3176491292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b596524ff0 0x55b59652b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3176491292 >> 172.21.15.35:0/3176491292 conn(0x55b5963786b0 msgr2=0x55b59651a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3176491292 shutdown_connections 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3176491292 wait complete. 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.141+0000 7fb80a4c9b80 1 -- start start 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 Processor -- start 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596524ff0 0x55b5965300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59652e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59652e7b0 con 0x55b596525900 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59652e920 con 0x55b59651fdc0 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b59652eae0 con 0x55b596524ff0 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb80a4c9b80 10 client.0 _ll_register_callbacks cb 0x55b596313230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59652e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59652e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46028/0 (socket says 172.21.15.35:46028) 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 -- 172.21.15.35:0/3500756397 learned_addr learned my addr 172.21.15.35:0/3500756397 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7f77fe700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596524ff0 0x55b5965300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 -- 172.21.15.35:0/3500756397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596524ff0 msgr2=0x55b5965300e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596524ff0 0x55b5965300e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 -- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 msgr2=0x55b59652fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.142+0000 7fb7fc8d9700 1 -- 172.21.15.35:0/3500756397 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e800f8f0 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7fc8d9700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59652e0a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0004660 tx=0x7fb7f0004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bce17daffd62d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7d77fe700 1 -- 172.21.15.35:0/3500756397 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000e040 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7d77fe700 1 -- 172.21.15.35:0/3500756397 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb7f0003e50 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5964eb1e0 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7d77fe700 1 -- 172.21.15.35:0/3500756397 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7f0008d90 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 10 client.16983 fetch_fsmap learned FSMap version 33 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b596284c00 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7d77fe700 1 -- 172.21.15.35:0/3500756397 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b5964eb1e0 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb7d77fe700 1 -- 172.21.15.35:0/3500756397 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb7f001e020 con 0x55b596525900 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 10 client.16983 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 10 client.16983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 20 client.16983 populate_metadata read hostname 'smithi035' 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b59658dd30 0x55b596590140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 4 client.16983 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:37:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.143+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b5962f1f00 con 0x55b59658dd30 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.144+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b59658dd30 0x55b596590140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.144+0000 7fb7f7fff700 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b59658dd30 0x55b596590140 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b6069d2a007a8db server_cookie=374f9285b4fc2c2 in_seq=0 out_seq=0 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.144+0000 7fb7d77fe700 10 client.16983 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.148+0000 7fb7d77fe700 1 -- 172.21.15.35:0/3500756397 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b5962f1f00 con 0x55b59658dd30 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.148+0000 7fb7d77fe700 10 client.16983 handle_command_reply: tid=0 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.148+0000 7fb80a4c9b80 1 client.16983 shutdown 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.148+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 msgr2=0x55b59652e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.148+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59652e0a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0004660 tx=0x7fb7f0004970 comp rx=0 tx=0).stop 2023-03-17T09:37:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 shutdown_connections 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b59658dd30 0x55b596590140 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b596525900 0x55b59652e0a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b59651fdc0 0x55b59652fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7d77fe700 0 client.16983 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 --2- 172.21.15.35:0/3500756397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b596524ff0 0x55b5965300e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 >> 172.21.15.35:0/3500756397 conn(0x55b5963786b0 msgr2=0x55b596522a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 shutdown_connections 2023-03-17T09:37:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 1 -- 172.21.15.35:0/3500756397 wait complete. 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb80a4c9b80 20 client.16983 trim_cache size 0 max 16384 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb7e009f6c0 msgr2=0x7fb7e00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb7e009f6c0 0x7fb7e00a1b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8005fd0 tx=0x7fb7e8005f60 comp rx=0 tx=0).stop 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 msgr2=0x7fb7f81967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f81967a0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009fd0 tx=0x7fb7ec00f690 comp rx=0 tx=0).stop 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 shutdown_connections 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb7e009f6c0 0x7fb7e00a1b70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f8104390 0x7fb7f819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7f80ff350 0x7fb7f8196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 --2- 172.21.15.35:0/2223596384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb7f80ffcf0 0x7fb7f81967a0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 >> 172.21.15.35:0/2223596384 conn(0x7fb7f8076330 msgr2=0x7fb7f80680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 shutdown_connections 2023-03-17T09:37:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:31.149+0000 7fb7fe33c700 1 -- 172.21.15.35:0/2223596384 wait complete. 2023-03-17T09:37:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 -- 172.21.15.35:0/3861359288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1640ffcf0 msgr2=0x7fd164103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 --2- 172.21.15.35:0/3861359288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1640ffcf0 0x7fd164103cb0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fd1540099c0 tx=0x7fd154009cd0 comp rx=0 tx=0).stop 2023-03-17T09:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 -- 172.21.15.35:0/3861359288 shutdown_connections 2023-03-17T09:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 --2- 172.21.15.35:0/3861359288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd164104390 0x7fd16410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:35.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 --2- 172.21.15.35:0/3861359288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640ff350 0x7fd1640ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 --2- 172.21.15.35:0/3861359288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd1640ffcf0 0x7fd164103cb0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.271+0000 7fd16b296700 1 -- 172.21.15.35:0/3861359288 >> 172.21.15.35:0/3861359288 conn(0x7fd164076330 msgr2=0x7fd164076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 -- 172.21.15.35:0/3861359288 shutdown_connections 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 -- 172.21.15.35:0/3861359288 wait complete. 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 Processor -- start 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 -- start start 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1640ff350 0x7fd164100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:35.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640ffcf0 0x7fd164101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 0x7fd1641a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd164101ac0 con 0x7fd164104390 2023-03-17T09:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1641a4960 con 0x7fd1640ffcf0 2023-03-17T09:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.272+0000 7fd16b296700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1641a4aa0 con 0x7fd1640ff350 2023-03-17T09:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 0x7fd1641a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 0x7fd1641a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46042/0 (socket says 172.21.15.35:46042) 2023-03-17T09:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 -- 172.21.15.35:0/1927587360 learned_addr learned my addr 172.21.15.35:0/1927587360 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd168831700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640ffcf0 0x7fd164101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169032700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1640ff350 0x7fd164100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 -- 172.21.15.35:0/1927587360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1640ff350 msgr2=0x7fd164100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1640ff350 0x7fd164100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 -- 172.21.15.35:0/1927587360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640ffcf0 msgr2=0x7fd164101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640ffcf0 0x7fd164101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:44.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 -- 172.21.15.35:0/1927587360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540095f0 con 0x7fd164104390 2023-03-17T09:37:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169032700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1640ff350 0x7fd164100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:37:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd169833700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 0x7fd1641a4420 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd15c007d70 tx=0x7fd15c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd15a7fc700 1 -- 172.21.15.35:0/1927587360 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c00ad40 con 0x7fd164104390 2023-03-17T09:37:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16410f010 con 0x7fd164104390 2023-03-17T09:37:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd15a7fc700 1 -- 172.21.15.35:0/1927587360 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd15c0128b0 con 0x7fd164104390 2023-03-17T09:37:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd15a7fc700 1 -- 172.21.15.35:0/1927587360 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0115a0 con 0x7fd164104390 2023-03-17T09:37:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.273+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16410ee80 con 0x7fd164104390 2023-03-17T09:37:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.276+0000 7fd15a7fc700 1 -- 172.21.15.35:0/1927587360 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd15c012a20 con 0x7fd164104390 2023-03-17T09:37:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.277+0000 7fd15a7fc700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd15009f640 0x7fd1500a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.277+0000 7fd169032700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd15009f640 0x7fd1500a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.277+0000 7fd15a7fc700 1 -- 172.21.15.35:0/1927587360 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd15c0ca760 con 0x7fd164104390 2023-03-17T09:37:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd169032700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd15009f640 0x7fd1500a1af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd160009cb0 tx=0x7fd160009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 Processor -- start 2023-03-17T09:37:48.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 -- start start 2023-03-17T09:37:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3ebe0 0x562f08e3efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e39420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e39d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:50.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08d40010 con 0x562f08e3f4f0 2023-03-17T09:37:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08d92950 con 0x562f08e3ebe0 2023-03-17T09:37:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd177423b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08d8bde0 con 0x562f08e39960 2023-03-17T09:37:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd168831700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e39420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd168831700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e39420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46048/0 (socket says 172.21.15.35:46048) 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd168831700 1 -- 172.21.15.35:0/497007356 learned_addr learned my addr 172.21.15.35:0/497007356 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd169032700 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3ebe0 0x562f08e3efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.278+0000 7fd169833700 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e39d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd168831700 1 -- 172.21.15.35:0/497007356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 msgr2=0x562f08e39d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd168831700 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e39d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd168831700 1 -- 172.21.15.35:0/497007356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3ebe0 msgr2=0x562f08e3efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd168831700 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3ebe0 0x562f08e3efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd168831700 1 -- 172.21.15.35:0/497007356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f08c0d5d0 con 0x562f08e3f4f0 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd169032700 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3ebe0 0x562f08e3efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:37:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd168831700 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e39420 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd154006010 tx=0x7fd15400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca3190abcf84a65 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:37:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd14f7fe700 1 -- 172.21.15.35:0/497007356 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400bb30 con 0x562f08e3f4f0 2023-03-17T09:37:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd14f7fe700 1 -- 172.21.15.35:0/497007356 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd15401e040 con 0x562f08e3f4f0 2023-03-17T09:37:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.279+0000 7fd14f7fe700 1 -- 172.21.15.35:0/497007356 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154003b30 con 0x562f08e3f4f0 2023-03-17T09:37:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 -- 172.21.15.35:0/497007356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 msgr2=0x562f08e39420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:37:53.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e39420 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fd154006010 tx=0x7fd15400b840 comp rx=0 tx=0).stop 2023-03-17T09:37:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 -- 172.21.15.35:0/497007356 shutdown_connections 2023-03-17T09:37:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e39d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3ebe0 0x562f08e3efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 --2- 172.21.15.35:0/497007356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e39420 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 -- 172.21.15.35:0/497007356 >> 172.21.15.35:0/497007356 conn(0x562f08c966b0 msgr2=0x562f08e33a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:37:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 -- 172.21.15.35:0/497007356 shutdown_connections 2023-03-17T09:37:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 -- 172.21.15.35:0/497007356 wait complete. 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 -- start start 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.280+0000 7fd177423b80 1 Processor -- start 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e39960 0x562f08e45480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e42700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e42d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08c0f8c0 con 0x562f08e3f4f0 2023-03-17T09:37:58.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08e434d0 con 0x562f08e39960 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08e4efa0 con 0x562f08e3ebe0 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd177423b80 10 client.0 _ll_register_callbacks cb 0x562f08c31230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e42d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e42d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46056/0 (socket says 172.21.15.35:46056) 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 -- 172.21.15.35:0/3453317478 learned_addr learned my addr 172.21.15.35:0/3453317478 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169032700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e39960 0x562f08e45480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd168831700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e42700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 -- 172.21.15.35:0/3453317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 msgr2=0x562f08e42700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e42700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:37:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 -- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e39960 msgr2=0x562f08e45480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:37:58.553 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:37:58.553 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:04 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:37:58.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:31 smithi035 ceph-mon[92535]: pgmap v1348: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:37:58.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:33 smithi035 ceph-mon[92535]: pgmap v1349: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:37:58.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:35 smithi035 ceph-mon[92535]: pgmap v1350: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:37:58.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:37 smithi035 ceph-mon[92535]: pgmap v1351: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:37:58.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:39 smithi035 ceph-mon[92535]: pgmap v1352: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:37:58.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:41 smithi035 ceph-mon[92535]: pgmap v1353: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:00.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:43 smithi035 ceph-mon[92535]: pgmap v1354: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:38:00.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:45 smithi035 ceph-mon[92535]: pgmap v1355: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:00.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:47 smithi035 ceph-mon[92535]: pgmap v1356: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:01.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:49 smithi035 ceph-mon[92535]: pgmap v1357: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:38:01.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:51 smithi035 ceph-mon[92535]: pgmap v1358: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:01.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:53 smithi035 ceph-mon[92535]: pgmap v1359: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:38:01.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:55 smithi035 ceph-mon[92535]: pgmap v1360: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:01.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:57 smithi035 ceph-mon[92535]: pgmap v1361: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:01.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:28:59 smithi035 ceph-mon[92535]: pgmap v1362: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:38:01.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:01 smithi035 ceph-mon[92535]: pgmap v1363: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:38:01.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:03 smithi035 ceph-mon[92535]: pgmap v1364: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:38:01.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:05 smithi035 ceph-mon[92535]: pgmap v1365: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:38:01.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:07 smithi035 ceph-mon[92535]: pgmap v1366: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:38:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:09 smithi035 ceph-mon[92535]: pgmap v1367: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:09 smithi035 ceph-mon[92535]: osdmap e162: 12 total, 12 up, 12 in 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:11 smithi035 ceph-mon[92535]: pgmap v1369: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:13 smithi035 ceph-mon[92535]: pgmap v1370: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:15 smithi035 ceph-mon[92535]: pgmap v1371: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:15 smithi035 ceph-mon[92535]: osdmap e163: 12 total, 12 up, 12 in 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:17 smithi035 ceph-mon[92535]: pgmap v1373: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:19 smithi035 ceph-mon[92535]: pgmap v1374: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T09:38:05.006 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:21 smithi035 ceph-mon[92535]: pgmap v1375: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:23 smithi035 ceph-mon[92535]: pgmap v1376: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:24 smithi035 ceph-mon[92535]: pgmap v1377: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 991 B/s wr, 11 op/s 2023-03-17T09:38:05.007 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:24 smithi035 ceph-mon[92535]: pgmap v1378: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T09:38:05.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:26 smithi035 ceph-mon[92535]: pgmap v1379: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 991 B/s wr, 11 op/s 2023-03-17T09:38:05.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:28 smithi035 ceph-mon[92535]: pgmap v1380: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T09:38:05.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:30 smithi035 ceph-mon[92535]: pgmap v1381: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T09:38:05.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:32 smithi035 ceph-mon[92535]: pgmap v1382: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:38:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e39960 0x562f08e45480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 -- 172.21.15.35:0/3453317478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16410c7a0 con 0x562f08e3f4f0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd169833700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e42d60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd15c094820 tx=0x7fd15c098320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2a350091549ef3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.281+0000 7fd14cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd14cff9700 1 -- 172.21.15.35:0/3453317478 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c098780 con 0x562f08e3f4f0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd14cff9700 1 -- 172.21.15.35:0/3453317478 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd15c097810 con 0x562f08e3f4f0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f08d4e390 con 0x562f08e3f4f0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd14cff9700 1 -- 172.21.15.35:0/3453317478 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd15c09c170 con 0x562f08e3f4f0 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 10 client.16995 fetch_fsmap learned FSMap version 33 2023-03-17T09:38:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562f08bb9d80 con 0x562f08e3f4f0 2023-03-17T09:38:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd14cff9700 1 -- 172.21.15.35:0/3453317478 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f08d4e390 con 0x562f08e3f4f0 2023-03-17T09:38:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd14cff9700 1 -- 172.21.15.35:0/3453317478 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd15c0a01c0 con 0x562f08e3f4f0 2023-03-17T09:38:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 10 client.16995 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:38:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 10 client.16995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:38:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 20 client.16995 populate_metadata read hostname 'smithi035' 2023-03-17T09:38:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08e53040 0x562f08e55450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 4 client.16995 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:38:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f08d5a600 con 0x562f08e53040 2023-03-17T09:38:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.282+0000 7fd169032700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08e53040 0x562f08e55450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:06.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.283+0000 7fd14cff9700 10 client.16995 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.283+0000 7fd169032700 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08e53040 0x562f08e55450 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd51ac8f84ec1f5d server_cookie=541e9a1779b3ee2d in_seq=0 out_seq=0 2023-03-17T09:38:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd14cff9700 1 -- 172.21.15.35:0/3453317478 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562f08d5a600 con 0x562f08e53040 2023-03-17T09:38:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd14cff9700 10 client.16995 handle_command_reply: tid=0 2023-03-17T09:38:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 client.16995 shutdown 2023-03-17T09:38:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 msgr2=0x562f08e42d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e42d60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd15c094820 tx=0x7fd15c098320 comp rx=0 tx=0).stop 2023-03-17T09:38:08.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 shutdown_connections 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08e53040 0x562f08e55450 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3f4f0 0x562f08e42d60 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd14cff9700 0 client.16995 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e39960 0x562f08e45480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 --2- 172.21.15.35:0/3453317478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e42700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 >> 172.21.15.35:0/3453317478 conn(0x562f08c966b0 msgr2=0x562f08e38410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 shutdown_connections 2023-03-17T09:38:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 1 -- 172.21.15.35:0/3453317478 wait complete. 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.284+0000 7fd177423b80 20 client.16995 trim_cache size 0 max 16384 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 Processor -- start 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 -- start start 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e49ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 0x562f08e45020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08e2f130 con 0x562f08e3ebe0 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08e507d0 con 0x562f08e3f4f0 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd177423b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08e43110 con 0x562f08e39960 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd168831700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 0x562f08e45020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd168831700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 0x562f08e45020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46062/0 (socket says 172.21.15.35:46062) 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd168831700 1 -- 172.21.15.35:0/2254592288 learned_addr learned my addr 172.21.15.35:0/2254592288 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:08.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd169833700 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.299+0000 7fd169032700 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e49ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd168831700 1 -- 172.21.15.35:0/2254592288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 msgr2=0x562f08e49ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd168831700 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e49ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd168831700 1 -- 172.21.15.35:0/2254592288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 msgr2=0x562f08e3c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd168831700 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e3c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd168831700 1 -- 172.21.15.35:0/2254592288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f08d52130 con 0x562f08e3ebe0 2023-03-17T09:38:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd169833700 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e3c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:38:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd168831700 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 0x562f08e45020 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd1540099c0 tx=0x7fd1540058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4273e497037aa369 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd14ffff700 1 -- 172.21.15.35:0/2254592288 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400bb30 con 0x562f08e3ebe0 2023-03-17T09:38:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd14ffff700 1 -- 172.21.15.35:0/2254592288 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd15401e070 con 0x562f08e3ebe0 2023-03-17T09:38:09.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.300+0000 7fd14ffff700 1 -- 172.21.15.35:0/2254592288 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd154003a50 con 0x562f08e3ebe0 2023-03-17T09:38:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 -- 172.21.15.35:0/2254592288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 msgr2=0x562f08e45020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 0x562f08e45020 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd1540099c0 tx=0x7fd1540058e0 comp rx=0 tx=0).stop 2023-03-17T09:38:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 -- 172.21.15.35:0/2254592288 shutdown_connections 2023-03-17T09:38:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e3c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e39960 0x562f08e49ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 --2- 172.21.15.35:0/2254592288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e3ebe0 0x562f08e45020 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 -- 172.21.15.35:0/2254592288 >> 172.21.15.35:0/2254592288 conn(0x562f08c966b0 msgr2=0x562f08e38a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 -- 172.21.15.35:0/2254592288 shutdown_connections 2023-03-17T09:38:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 -- 172.21.15.35:0/2254592288 wait complete. 2023-03-17T09:38:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 -- start start 2023-03-17T09:38:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.301+0000 7fd177423b80 1 Processor -- start 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 0x562f08e9b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e9b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e9fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08ea0400 con 0x562f08e39960 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08ea0570 con 0x562f08e3f4f0 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f08ea0730 con 0x562f08e3ebe0 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd177423b80 10 client.0 _ll_register_callbacks cb 0x562f08c31230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 0x562f08e9b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 0x562f08e9b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46066/0 (socket says 172.21.15.35:46066) 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 -- 172.21.15.35:0/365587810 learned_addr learned my addr 172.21.15.35:0/365587810 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd168831700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e9b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:14.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169833700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e9fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:14.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 -- 172.21.15.35:0/365587810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 msgr2=0x562f08e9b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:14.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e9b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 -- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 msgr2=0x562f08e9fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e9fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.302+0000 7fd169032700 1 -- 172.21.15.35:0/365587810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f08bb9d80 con 0x562f08e39960 2023-03-17T09:38:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd169032700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 0x562f08e9b060 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd160009fd0 tx=0x7fd1600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ac4dfdedba3fa1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd14cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:38:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd14cff9700 1 -- 172.21.15.35:0/365587810 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160027040 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd14cff9700 1 -- 172.21.15.35:0/365587810 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd160018030 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f08e091e0 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd14cff9700 1 -- 172.21.15.35:0/365587810 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd160003680 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 10 client.17001 fetch_fsmap learned FSMap version 33 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562f08c0d5d0 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd14cff9700 1 -- 172.21.15.35:0/365587810 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f08e091e0 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd14cff9700 1 -- 172.21.15.35:0/365587810 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd160012800 con 0x562f08e39960 2023-03-17T09:38:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 10 client.17001 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:38:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 20 client.17001 populate_metadata read hostname 'smithi035' 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08ea7e90 0x562f08eaa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 4 client.17001 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.303+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562f08c0ff00 con 0x562f08ea7e90 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.304+0000 7fd168831700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08ea7e90 0x562f08eaa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.304+0000 7fd14cff9700 10 client.17001 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.304+0000 7fd168831700 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08ea7e90 0x562f08eaa2a0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8157ca895006f6d1 server_cookie=5543ea8666a5fc70 in_seq=0 out_seq=0 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd14cff9700 1 -- 172.21.15.35:0/365587810 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562f08c0ff00 con 0x562f08ea7e90 2023-03-17T09:38:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd14cff9700 10 client.17001 handle_command_reply: tid=0 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 client.17001 shutdown 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 msgr2=0x562f08e9b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 0x562f08e9b060 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd160009fd0 tx=0x7fd1600047c0 comp rx=0 tx=0).stop 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 shutdown_connections 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f08ea7e90 0x562f08eaa2a0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f08e3f4f0 0x562f08e9fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f08e39960 0x562f08e9b060 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:19.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 --2- 172.21.15.35:0/365587810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f08e3ebe0 0x562f08e9b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd14cff9700 0 client.17001 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 >> 172.21.15.35:0/365587810 conn(0x562f08c966b0 msgr2=0x562f08e3c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 shutdown_connections 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 1 -- 172.21.15.35:0/365587810 wait complete. 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.308+0000 7fd177423b80 20 client.17001 trim_cache size 0 max 16384 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd15009f640 msgr2=0x7fd1500a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd15009f640 0x7fd1500a1af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd160009cb0 tx=0x7fd160009260 comp rx=0 tx=0).stop 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 msgr2=0x7fd1641a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 0x7fd1641a4420 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd15c007d70 tx=0x7fd15c00a340 comp rx=0 tx=0).stop 2023-03-17T09:38:21.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 shutdown_connections 2023-03-17T09:38:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd15009f640 0x7fd1500a1af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd164104390 0x7fd1641a4420 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1640ff350 0x7fd164100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 --2- 172.21.15.35:0/1927587360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1640ffcf0 0x7fd164101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 >> 172.21.15.35:0/1927587360 conn(0x7fd164076330 msgr2=0x7fd164067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 shutdown_connections 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:44.309+0000 7fd16b296700 1 -- 172.21.15.35:0/1927587360 wait complete. 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 -- 172.21.15.35:0/3075443304 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa084104390 msgr2=0x7fa08410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 --2- 172.21.15.35:0/3075443304 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa084104390 0x7fa08410bf60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00b0d0 tx=0x7fa07c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 -- 172.21.15.35:0/3075443304 shutdown_connections 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 --2- 172.21.15.35:0/3075443304 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa084104390 0x7fa08410bf60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 --2- 172.21.15.35:0/3075443304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840ff350 0x7fa0840ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 --2- 172.21.15.35:0/3075443304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0840ffcf0 0x7fa084103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.430+0000 7fa089053700 1 -- 172.21.15.35:0/3075443304 >> 172.21.15.35:0/3075443304 conn(0x7fa084076330 msgr2=0x7fa084076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.431+0000 7fa089053700 1 -- 172.21.15.35:0/3075443304 shutdown_connections 2023-03-17T09:38:22.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.431+0000 7fa089053700 1 -- 172.21.15.35:0/3075443304 wait complete. 2023-03-17T09:38:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.431+0000 7fa089053700 1 Processor -- start 2023-03-17T09:38:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.431+0000 7fa089053700 1 -- start start 2023-03-17T09:38:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 0x7fa084196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840ffcf0 0x7fa0841968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa084104390 0x7fa08419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08419b350 con 0x7fa0840ff350 2023-03-17T09:38:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08419b4c0 con 0x7fa0840ffcf0 2023-03-17T09:38:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08419b680 con 0x7fa084104390 2023-03-17T09:38:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 0x7fa084196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 0x7fa084196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46080/0 (socket says 172.21.15.35:46080) 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 -- 172.21.15.35:0/2791340006 learned_addr learned my addr 172.21.15.35:0/2791340006 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa08359e700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa084104390 0x7fa08419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa07bfff700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840ffcf0 0x7fa0841968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 -- 172.21.15.35:0/2791340006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa084104390 msgr2=0x7fa08419ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa084104390 0x7fa08419ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 -- 172.21.15.35:0/2791340006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840ffcf0 msgr2=0x7fa0841968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840ffcf0 0x7fa0841968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 -- 172.21.15.35:0/2791340006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c009d00 con 0x7fa0840ff350 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa082d9d700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 0x7fa084196370 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa07400d950 tx=0x7fa07400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa080d99700 1 -- 172.21.15.35:0/2791340006 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074009b40 con 0x7fa0840ff350 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa080d99700 1 -- 172.21.15.35:0/2791340006 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa074009ca0 con 0x7fa0840ff350 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.432+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08410f010 con 0x7fa0840ff350 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.433+0000 7fa080d99700 1 -- 172.21.15.35:0/2791340006 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400f620 con 0x7fa0840ff350 2023-03-17T09:38:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.433+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08410ee80 con 0x7fa0840ff350 2023-03-17T09:38:27.105 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:34 smithi035 ceph-mon[92535]: pgmap v1383: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:38:27.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:06 smithi078 ceph-mon[94114]: pgmap v1044: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:38:27.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:08 smithi078 ceph-mon[94114]: pgmap v1045: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:38:27.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:10 smithi078 ceph-mon[94114]: pgmap v1046: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:38:29.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:38:29.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:10 smithi078 ceph-mon[94114]: osdmap e142: 12 total, 12 up, 12 in 2023-03-17T09:38:29.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:38:29.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:38:29.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:38:29.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:38:29.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:38:29.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:12 smithi078 ceph-mon[94114]: pgmap v1048: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-03-17T09:38:29.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:14 smithi078 ceph-mon[94114]: pgmap v1049: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 514 B/s wr, 9 op/s 2023-03-17T09:38:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.435+0000 7fa080d99700 1 -- 172.21.15.35:0/2791340006 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa074010460 con 0x7fa0840ff350 2023-03-17T09:38:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.435+0000 7fa080d99700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa07009f640 0x7fa0700a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.436+0000 7fa07bfff700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa07009f640 0x7fa0700a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.436+0000 7fa080d99700 1 -- 172.21.15.35:0/2791340006 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa0740caa00 con 0x7fa0840ff350 2023-03-17T09:38:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.436+0000 7fa07bfff700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa07009f640 0x7fa0700a1af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa06c005fd0 tx=0x7fa06c00af20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:29.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.436+0000 7fa0951e0b80 1 Processor -- start 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.436+0000 7fa0951e0b80 1 -- start start 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf58df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 0x5576adf5cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf5d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576ade5b010 con 0x5576adf59330 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adead950 con 0x5576adf58a20 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adea6de0 con 0x5576adf5d170 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 0x5576adf5cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 0x5576adf5cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46090/0 (socket says 172.21.15.35:46090) 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 -- 172.21.15.35:0/2954992982 learned_addr learned my addr 172.21.15.35:0/2954992982 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa082d9d700 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf58df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa08359e700 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf5d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 -- 172.21.15.35:0/2954992982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 msgr2=0x5576adf5d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf5d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 -- 172.21.15.35:0/2954992982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 msgr2=0x5576adf58df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf58df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.437+0000 7fa07bfff700 1 -- 172.21.15.35:0/2954992982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576add285d0 con 0x5576adf59330 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.438+0000 7fa07bfff700 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 0x5576adf5cc30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00ebf0 tx=0x7fa06c00af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf5ab7135c12044 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.438+0000 7fa0797fa700 1 -- 172.21.15.35:0/2954992982 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c010cd0 con 0x5576adf59330 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.438+0000 7fa0797fa700 1 -- 172.21.15.35:0/2954992982 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa06c010e30 con 0x5576adf59330 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.438+0000 7fa0797fa700 1 -- 172.21.15.35:0/2954992982 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00f6e0 con 0x5576adf59330 2023-03-17T09:38:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.438+0000 7fa0951e0b80 1 -- 172.21.15.35:0/2954992982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 msgr2=0x5576adf5cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.438+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 0x5576adf5cc30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00ebf0 tx=0x7fa06c00af90 comp rx=0 tx=0).stop 2023-03-17T09:38:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- 172.21.15.35:0/2954992982 shutdown_connections 2023-03-17T09:38:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf5d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf58df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/2954992982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf59330 0x5576adf5cc30 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- 172.21.15.35:0/2954992982 >> 172.21.15.35:0/2954992982 conn(0x5576addb16b0 msgr2=0x5576adf4ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- 172.21.15.35:0/2954992982 shutdown_connections 2023-03-17T09:38:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- 172.21.15.35:0/2954992982 wait complete. 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- start start 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 Processor -- start 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf64890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf61b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf62120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576add2a8c0 con 0x5576adf5d170 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf62860 con 0x5576adf58a20 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf6e3e0 con 0x5576adf59330 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.439+0000 7fa0951e0b80 10 client.0 _ll_register_callbacks cb 0x5576add4c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa08359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf62120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf64890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf64890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:47890/0 (socket says 172.21.15.35:47890) 2023-03-17T09:38:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 -- 172.21.15.35:0/4158631036 learned_addr learned my addr 172.21.15.35:0/4158631036 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa08359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf62120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46098/0 (socket says 172.21.15.35:46098) 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa07bfff700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf61b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 -- 172.21.15.35:0/4158631036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 msgr2=0x5576adf61b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf61b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 -- 172.21.15.35:0/4158631036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 msgr2=0x5576adf62120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf62120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:31.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 -- 172.21.15.35:0/4158631036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c00e8a0 con 0x5576adf58a20 2023-03-17T09:38:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa07bfff700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf61b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:38:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa08359e700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:38:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa082d9d700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf64890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa074000c00 tx=0x7fa074098010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b860e920e49ce0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa06a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:38:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa06a7fc700 1 -- 172.21.15.35:0/4158631036 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740af070 con 0x5576adf58a20 2023-03-17T09:38:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576ade69390 con 0x5576adf58a20 2023-03-17T09:38:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa06a7fc700 1 -- 172.21.15.35:0/4158631036 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa0740a0640 con 0x5576adf58a20 2023-03-17T09:38:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa06a7fc700 1 -- 172.21.15.35:0/4158631036 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa074094b60 con 0x5576adf58a20 2023-03-17T09:38:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa0951e0b80 10 client.26591 fetch_fsmap learned FSMap version 33 2023-03-17T09:38:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.440+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5576adcd4d80 con 0x5576adf58a20 2023-03-17T09:38:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa06a7fc700 1 -- 172.21.15.35:0/4158631036 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0740b4020 con 0x5576adf58a20 2023-03-17T09:38:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa06a7fc700 1 -- 172.21.15.35:0/4158631036 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa074098740 con 0x5576adf58a20 2023-03-17T09:38:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa0951e0b80 10 client.26591 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:38:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa0951e0b80 10 client.26591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:38:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa0951e0b80 20 client.26591 populate_metadata read hostname 'smithi035' 2023-03-17T09:38:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adf72420 0x5576adf74830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa0951e0b80 4 client.26591 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576ade75600 con 0x5576adf72420 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.441+0000 7fa07bfff700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adf72420 0x5576adf74830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.442+0000 7fa06a7fc700 10 client.26591 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.442+0000 7fa07bfff700 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adf72420 0x5576adf74830 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3dc657bc5a7961f server_cookie=264dd824e84a3e in_seq=0 out_seq=0 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.442+0000 7fa06a7fc700 1 -- 172.21.15.35:0/4158631036 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5576ade75600 con 0x5576adf72420 2023-03-17T09:38:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.442+0000 7fa06a7fc700 10 client.26591 handle_command_reply: tid=0 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.442+0000 7fa0951e0b80 1 client.26591 shutdown 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 msgr2=0x5576adf64890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf64890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa074000c00 tx=0x7fa074098010 comp rx=0 tx=0).stop 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 shutdown_connections 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adf72420 0x5576adf74830 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf64890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa06a7fc700 0 client.26591 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/4158631036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf61b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 >> 172.21.15.35:0/4158631036 conn(0x5576addb16b0 msgr2=0x5576adf53410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 shutdown_connections 2023-03-17T09:38:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 1 -- 172.21.15.35:0/4158631036 wait complete. 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.443+0000 7fa0951e0b80 20 client.26591 trim_cache size 0 max 16384 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 Processor -- start 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 -- start start 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf4eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf69320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf5e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf4b5c0 con 0x5576adf5d170 2023-03-17T09:38:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf62aa0 con 0x5576adf58a20 2023-03-17T09:38:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf4f6d0 con 0x5576adf59330 2023-03-17T09:38:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf5e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:44.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf5e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46106/0 (socket says 172.21.15.35:46106) 2023-03-17T09:38:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 -- 172.21.15.35:0/1149733286 learned_addr learned my addr 172.21.15.35:0/1149733286 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa082d9d700 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf4eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:47.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa07bfff700 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf69320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 -- 172.21.15.35:0/1149733286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 msgr2=0x5576adf69320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf69320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 -- 172.21.15.35:0/1149733286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 msgr2=0x5576adf4eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf4eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.459+0000 7fa08359e700 1 -- 172.21.15.35:0/1149733286 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576adf61680 con 0x5576adf5d170 2023-03-17T09:38:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.460+0000 7fa08359e700 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf5e550 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004ab0 tx=0x7fa07c004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35edfec46063994 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.460+0000 7fa079ffb700 1 -- 172.21.15.35:0/1149733286 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00e040 con 0x5576adf5d170 2023-03-17T09:38:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.460+0000 7fa079ffb700 1 -- 172.21.15.35:0/1149733286 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa07c004e80 con 0x5576adf5d170 2023-03-17T09:38:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.460+0000 7fa079ffb700 1 -- 172.21.15.35:0/1149733286 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c026df0 con 0x5576adf5d170 2023-03-17T09:38:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 -- 172.21.15.35:0/1149733286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 msgr2=0x5576adf5e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf5e550 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004ab0 tx=0x7fa07c004ae0 comp rx=0 tx=0).stop 2023-03-17T09:38:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 -- 172.21.15.35:0/1149733286 shutdown_connections 2023-03-17T09:38:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf5d170 0x5576adf5e550 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf58a20 0x5576adf4eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/1149733286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf59330 0x5576adf69320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 -- 172.21.15.35:0/1149733286 >> 172.21.15.35:0/1149733286 conn(0x5576addb16b0 msgr2=0x5576adf5b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 -- 172.21.15.35:0/1149733286 shutdown_connections 2023-03-17T09:38:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 -- 172.21.15.35:0/1149733286 wait complete. 2023-03-17T09:38:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 -- start start 2023-03-17T09:38:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.461+0000 7fa0951e0b80 1 Processor -- start 2023-03-17T09:38:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 0x5576adf68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf59330 0x5576adf69470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf65b00 con 0x5576adf58a20 2023-03-17T09:38:51.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf65c70 con 0x5576adf59330 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576adf65e30 con 0x5576adf5d170 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 10 client.0 _ll_register_callbacks cb 0x5576add4c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 0x5576adf68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 0x5576adf68f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46108/0 (socket says 172.21.15.35:46108) 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 -- 172.21.15.35:0/3162711603 learned_addr learned my addr 172.21.15.35:0/3162711603 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa07bfff700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf59330 0x5576adf69470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa08359e700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:51.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 -- 172.21.15.35:0/3162711603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 msgr2=0x5576adf653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf653f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 -- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf59330 msgr2=0x5576adf69470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf59330 0x5576adf69470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 -- 172.21.15.35:0/3162711603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08410c7a0 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa08359e700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa082d9d700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 0x5576adf68f30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa074010bc0 tx=0x7fa074010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f16ca810637e403 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa06a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa06a7fc700 1 -- 172.21.15.35:0/3162711603 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740af030 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa06a7fc700 1 -- 172.21.15.35:0/3162711603 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa0740b0070 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.462+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576add2af00 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa06a7fc700 1 -- 172.21.15.35:0/3162711603 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa074014070 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 10 client.17019 fetch_fsmap learned FSMap version 33 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5576adcbdc00 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa06a7fc700 1 -- 172.21.15.35:0/3162711603 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa074064020 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa06a7fc700 1 -- 172.21.15.35:0/3162711603 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa0740979e0 con 0x5576adf58a20 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 10 client.17019 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:38:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 10 client.17019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:38:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 20 client.17019 populate_metadata read hostname 'smithi035' 2023-03-17T09:38:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adfc7030 0x5576adfc9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 4 client.17019 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:38:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5576ade63360 con 0x5576adfc7030 2023-03-17T09:38:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.463+0000 7fa07bfff700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adfc7030 0x5576adfc9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.464+0000 7fa06a7fc700 10 client.17019 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:51.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:36 smithi035 ceph-mon[92535]: pgmap v1384: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Scheduled restart job, restart counter is at 5. 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:14 smithi078 systemd[1]: Stopped Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:14 smithi078 systemd[1]: Starting Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:15 smithi078 podman[138222]: 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:15 smithi078 ceph-mds[138262]: -- 172.21.15.78:0/3453869730 <== mon.2 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b632952b60 con 0x55b632928800 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:15 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: starting mds.e at 2023-03-17T09:38:52.969 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:15 smithi078 bash[138222]: b6166b33f75e71bea5bb0929f0129375dddd0cdb67c8845c5181acfac6952259 2023-03-17T09:38:52.970 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:19:15 smithi078 systemd[1]: Started Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:38:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.464+0000 7fa07bfff700 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adfc7030 0x5576adfc9440 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a23384f541a5fe server_cookie=f2a5e3d6878e6a89 in_seq=0 out_seq=0 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa06a7fc700 1 -- 172.21.15.35:0/3162711603 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5576ade63360 con 0x5576adfc7030 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa06a7fc700 10 client.17019 handle_command_reply: tid=0 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 client.17019 shutdown 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 msgr2=0x5576adf68f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 0x5576adf68f30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa074010bc0 tx=0x7fa074010a00 comp rx=0 tx=0).stop 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 shutdown_connections 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5576adfc7030 0x5576adfc9440 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5576adf5d170 0x5576adf653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5576adf58a20 0x5576adf68f30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa06a7fc700 0 client.17019 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:38:54.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 --2- 172.21.15.35:0/3162711603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5576adf59330 0x5576adf69470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 >> 172.21.15.35:0/3162711603 conn(0x5576addb16b0 msgr2=0x5576adf61a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 shutdown_connections 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 1 -- 172.21.15.35:0/3162711603 wait complete. 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.468+0000 7fa0951e0b80 20 client.17019 trim_cache size 0 max 16384 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa07009f640 msgr2=0x7fa0700a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa07009f640 0x7fa0700a1af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa06c005fd0 tx=0x7fa06c00af20 comp rx=0 tx=0).stop 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 msgr2=0x7fa084196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 0x7fa084196370 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa07400d950 tx=0x7fa07400dd10 comp rx=0 tx=0).stop 2023-03-17T09:38:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 shutdown_connections 2023-03-17T09:38:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa07009f640 0x7fa0700a1af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa084104390 0x7fa08419ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa0840ff350 0x7fa084196370 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 --2- 172.21.15.35:0/2791340006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840ffcf0 0x7fa0841968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 >> 172.21.15.35:0/2791340006 conn(0x7fa084076330 msgr2=0x7fa084067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 shutdown_connections 2023-03-17T09:38:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:15:57.469+0000 7fa089053700 1 -- 172.21.15.35:0/2791340006 wait complete. 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 -- 172.21.15.35:0/812457340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 msgr2=0x7f3a4410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 --2- 172.21.15.35:0/812457340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4410bfc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00b0d0 tx=0x7f3a3c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 -- 172.21.15.35:0/812457340 shutdown_connections 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 --2- 172.21.15.35:0/812457340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4410bfc0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 --2- 172.21.15.35:0/812457340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 0x7f3a440ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 --2- 172.21.15.35:0/812457340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 -- 172.21.15.35:0/812457340 >> 172.21.15.35:0/812457340 conn(0x7f3a44075f60 msgr2=0x7f3a44076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 -- 172.21.15.35:0/812457340 shutdown_connections 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.591+0000 7f3a4addb700 1 -- 172.21.15.35:0/812457340 wait complete. 2023-03-17T09:38:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 Processor -- start 2023-03-17T09:38:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 -- start start 2023-03-17T09:38:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 0x7f3a441963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4419ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4419b3c0 con 0x7f3a441043f0 2023-03-17T09:38:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4419b530 con 0x7f3a440ffd50 2023-03-17T09:38:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a4addb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4419b6f0 con 0x7f3a440ff3b0 2023-03-17T09:38:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4419ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4419ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46162/0 (socket says 172.21.15.35:46162) 2023-03-17T09:38:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:47956/0 (socket says 172.21.15.35:47956) 2023-03-17T09:38:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 -- 172.21.15.35:0/2872367769 learned_addr learned my addr 172.21.15.35:0/2872367769 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:38:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a48b77700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 0x7f3a441963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 -- 172.21.15.35:0/2872367769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 msgr2=0x7f3a441963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 0x7f3a441963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 -- 172.21.15.35:0/2872367769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 msgr2=0x7f3a44196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a49378700 1 -- 172.21.15.35:0/2872367769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009d00 con 0x7f3a441043f0 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.592+0000 7f3a48b77700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 0x7f3a441963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a43fff700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a49378700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4419ad80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c008e50 tx=0x7f3a3c008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:38:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a41ffb700 1 -- 172.21.15.35:0/2872367769 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00e040 con 0x7f3a441043f0 2023-03-17T09:38:57.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a41ffb700 1 -- 172.21.15.35:0/2872367769 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a3c003e90 con 0x7f3a441043f0 2023-03-17T09:38:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4410f020 con 0x7f3a441043f0 2023-03-17T09:38:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a41ffb700 1 -- 172.21.15.35:0/2872367769 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c01b6c0 con 0x7f3a441043f0 2023-03-17T09:38:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.593+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4410ee90 con 0x7f3a441043f0 2023-03-17T09:38:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.595+0000 7f3a41ffb700 1 -- 172.21.15.35:0/2872367769 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3a3c003a00 con 0x7f3a441043f0 2023-03-17T09:38:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.596+0000 7f3a41ffb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a3409f6c0 0x7f3a340a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:38:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.596+0000 7f3a48b77700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a3409f6c0 0x7f3a340a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:38:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.596+0000 7f3a41ffb700 1 -- 172.21.15.35:0/2872367769 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f3a3c0cb730 con 0x7f3a441043f0 2023-03-17T09:38:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.596+0000 7f3a48b77700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a3409f6c0 0x7f3a340a1b70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009cb0 tx=0x7f3a38009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 Processor -- start 2023-03-17T09:39:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 -- start start 2023-03-17T09:39:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 0x55d931b39df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b3dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b3e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931a3c010 con 0x55d931b39a20 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931a8e950 con 0x55d931b3e170 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931a87de0 con 0x55d931b3a330 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a48b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 0x55d931b39df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a48b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 0x55d931b39df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46166/0 (socket says 172.21.15.35:46166) 2023-03-17T09:39:01.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a48b77700 1 -- 172.21.15.35:0/3044901654 learned_addr learned my addr 172.21.15.35:0/3044901654 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a43fff700 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b3dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.597+0000 7f3a49378700 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b3e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a48b77700 1 -- 172.21.15.35:0/3044901654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 msgr2=0x55d931b3dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a48b77700 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b3dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:01.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a48b77700 1 -- 172.21.15.35:0/3044901654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 msgr2=0x55d931b3e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a48b77700 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b3e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a48b77700 1 -- 172.21.15.35:0/3044901654 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9319095d0 con 0x55d931b39a20 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a49378700 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b3e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a48b77700 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 0x55d931b39df0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3a38011fb0 tx=0x7f3a38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26defb6c571d9c63 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a2effd700 1 -- 172.21.15.35:0/3044901654 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38003680 con 0x55d931b39a20 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a2effd700 1 -- 172.21.15.35:0/3044901654 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a38003c70 con 0x55d931b39a20 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.598+0000 7f3a2effd700 1 -- 172.21.15.35:0/3044901654 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38012c70 con 0x55d931b39a20 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 -- 172.21.15.35:0/3044901654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 msgr2=0x55d931b39df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 0x55d931b39df0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3a38011fb0 tx=0x7f3a38014000 comp rx=0 tx=0).stop 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 -- 172.21.15.35:0/3044901654 shutdown_connections 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b3e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b39a20 0x55d931b39df0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/3044901654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b3dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 -- 172.21.15.35:0/3044901654 >> 172.21.15.35:0/3044901654 conn(0x55d9319926b0 msgr2=0x55d931b2fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 -- 172.21.15.35:0/3044901654 shutdown_connections 2023-03-17T09:39:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 -- 172.21.15.35:0/3044901654 wait complete. 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 -- start start 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.599+0000 7f3a56f68b80 1 Processor -- start 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b39a20 0x55d931b45950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b42bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b43310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93190b8c0 con 0x55d931b3a330 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b43a80 con 0x55d931b3e170 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b4f460 con 0x55d931b39a20 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a56f68b80 10 client.0 _ll_register_callbacks cb 0x55d93192d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b42bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b42bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46174/0 (socket says 172.21.15.35:46174) 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a48b77700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b39a20 0x55d931b45950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 -- 172.21.15.35:0/1646704126 learned_addr learned my addr 172.21.15.35:0/1646704126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:02.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a49378700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b43310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 -- 172.21.15.35:0/1646704126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b39a20 msgr2=0x55d931b45950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:06.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b39a20 0x55d931b45950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 -- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 msgr2=0x55d931b43310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b43310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 -- 172.21.15.35:0/1646704126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a38011c60 con 0x55d931b3a330 2023-03-17T09:39:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a49378700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b43310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:39:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a43fff700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b42bd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3a30012d20 tx=0x7f3a3000f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e78ab472ead7e8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.600+0000 7f3a23fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a23fff700 1 -- 172.21.15.35:0/1646704126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30017070 con 0x55d931b3a330 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a23fff700 1 -- 172.21.15.35:0/1646704126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f3a3000fbd0 con 0x55d931b3a330 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d931a4a390 con 0x55d931b3a330 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a23fff700 1 -- 172.21.15.35:0/1646704126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a3000fd90 con 0x55d931b3a330 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 10 client.17031 fetch_fsmap learned FSMap version 33 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d9318b5d80 con 0x55d931b3a330 2023-03-17T09:39:08.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a23fff700 1 -- 172.21.15.35:0/1646704126 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d931a4a390 con 0x55d931b3a330 2023-03-17T09:39:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a23fff700 1 -- 172.21.15.35:0/1646704126 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3a30003b40 con 0x55d931b3a330 2023-03-17T09:39:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 10 client.17031 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:39:10.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 10 client.17031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:39:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 20 client.17031 populate_metadata read hostname 'smithi035' 2023-03-17T09:39:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b535b0 0x55d931b559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 4 client.17031 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:39:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d931a56600 con 0x55d931b535b0 2023-03-17T09:39:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.601+0000 7f3a48b77700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b535b0 0x55d931b559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.602+0000 7f3a23fff700 10 client.17031 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:39:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.602+0000 7f3a48b77700 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b535b0 0x55d931b559c0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19601b0b839f0f81 server_cookie=bd529132fa2de121 in_seq=0 out_seq=0 2023-03-17T09:39:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.602+0000 7f3a23fff700 1 -- 172.21.15.35:0/1646704126 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d931a56600 con 0x55d931b535b0 2023-03-17T09:39:14.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.602+0000 7f3a23fff700 10 client.17031 handle_command_reply: tid=0 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.602+0000 7f3a56f68b80 1 client.17031 shutdown 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 msgr2=0x55d931b42bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b42bd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3a30012d20 tx=0x7f3a3000f6a0 comp rx=0 tx=0).stop 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 shutdown_connections 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b535b0 0x55d931b559c0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b3e170 0x55d931b43310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:14.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b39a20 0x55d931b45950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1646704126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b42bd0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a23fff700 0 client.17031 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:39:16.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 >> 172.21.15.35:0/1646704126 conn(0x55d9319926b0 msgr2=0x55d931b34410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 shutdown_connections 2023-03-17T09:39:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1646704126 wait complete. 2023-03-17T09:39:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.603+0000 7f3a56f68b80 20 client.17031 trim_cache size 0 max 16384 2023-03-17T09:39:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 Processor -- start 2023-03-17T09:39:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 -- start start 2023-03-17T09:39:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b3ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b2fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3e170 0x55d931b4a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b50c30 con 0x55d931b3a330 2023-03-17T09:39:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b30000 con 0x55d931b39a20 2023-03-17T09:39:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b2b0d0 con 0x55d931b3e170 2023-03-17T09:39:20.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:38 smithi035 ceph-mon[92535]: pgmap v1385: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:39:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b2fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b2fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46182/0 (socket says 172.21.15.35:46182) 2023-03-17T09:39:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 -- 172.21.15.35:0/900449827 learned_addr learned my addr 172.21.15.35:0/900449827 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:21.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a48b77700 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b3ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 -- 172.21.15.35:0/900449827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3e170 msgr2=0x55d931b4a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3e170 0x55d931b4a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 -- 172.21.15.35:0/900449827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 msgr2=0x55d931b3ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b3ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.618+0000 7f3a43fff700 1 -- 172.21.15.35:0/900449827 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d931a4e130 con 0x55d931b3a330 2023-03-17T09:39:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a43fff700 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b2fac0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3a30003ec0 tx=0x7f3a300123a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717f940797a25d55 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a2f7fe700 1 -- 172.21.15.35:0/900449827 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30017040 con 0x55d931b3a330 2023-03-17T09:39:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a2f7fe700 1 -- 172.21.15.35:0/900449827 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a30025d60 con 0x55d931b3a330 2023-03-17T09:39:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a2f7fe700 1 -- 172.21.15.35:0/900449827 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30003bb0 con 0x55d931b3a330 2023-03-17T09:39:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 -- 172.21.15.35:0/900449827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 msgr2=0x55d931b2fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b2fac0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3a30003ec0 tx=0x7f3a300123a0 comp rx=0 tx=0).stop 2023-03-17T09:39:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 -- 172.21.15.35:0/900449827 shutdown_connections 2023-03-17T09:39:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3e170 0x55d931b4a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b3ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/900449827 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3a330 0x55d931b2fac0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 -- 172.21.15.35:0/900449827 >> 172.21.15.35:0/900449827 conn(0x55d9319926b0 msgr2=0x55d931b34410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 -- 172.21.15.35:0/900449827 shutdown_connections 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.619+0000 7f3a56f68b80 1 -- 172.21.15.35:0/900449827 wait complete. 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 -- start start 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 Processor -- start 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b4a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b41420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 0x55d931b41960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b42040 con 0x55d931b3e170 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931b421b0 con 0x55d931b39a20 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d931ba7410 con 0x55d931b3a330 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a56f68b80 10 client.0 _ll_register_callbacks cb 0x55d93192d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a49378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 0x55d931b41960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a49378700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 0x55d931b41960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46190/0 (socket says 172.21.15.35:46190) 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a48b77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b4a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.620+0000 7f3a49378700 1 -- 172.21.15.35:0/1922409349 learned_addr learned my addr 172.21.15.35:0/1922409349 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a43fff700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b41420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a49378700 1 -- 172.21.15.35:0/1922409349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 msgr2=0x55d931b41420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a49378700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b41420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a49378700 1 -- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 msgr2=0x55d931b4a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a49378700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b4a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a49378700 1 -- 172.21.15.35:0/1922409349 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9318b5d80 con 0x55d931b3e170 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a48b77700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a49378700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 0x55d931b41960 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0956e0 tx=0x7f3a3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa388ff6a6077c8c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a23fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a23fff700 1 -- 172.21.15.35:0/1922409349 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c098fb0 con 0x55d931b3e170 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a23fff700 1 -- 172.21.15.35:0/1922409349 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f3a3c005290 con 0x55d931b3e170 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d931b051e0 con 0x55d931b3e170 2023-03-17T09:39:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a23fff700 1 -- 172.21.15.35:0/1922409349 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a3c098d20 con 0x55d931b3e170 2023-03-17T09:39:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a56f68b80 10 client.17037 fetch_fsmap learned FSMap version 33 2023-03-17T09:39:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d9318dc1f0 con 0x55d931b3e170 2023-03-17T09:39:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a23fff700 1 -- 172.21.15.35:0/1922409349 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d931b051e0 con 0x55d931b3e170 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.621+0000 7f3a23fff700 1 -- 172.21.15.35:0/1922409349 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3a3c0986d0 con 0x55d931b3e170 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a56f68b80 10 client.17037 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a56f68b80 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a56f68b80 20 client.17037 populate_metadata read hostname 'smithi035' 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b357d0 0x55d931b37bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a56f68b80 4 client.17037 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:39:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d93190bf00 con 0x55d931b357d0 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a48b77700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b357d0 0x55d931b37bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a48b77700 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b357d0 0x55d931b37bb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f3bb2a093b3e44 server_cookie=b1eca4378672a23d in_seq=0 out_seq=0 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.622+0000 7f3a23fff700 10 client.17037 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.629+0000 7f3a23fff700 1 -- 172.21.15.35:0/1922409349 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d93190bf00 con 0x55d931b357d0 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a23fff700 10 client.17037 handle_command_reply: tid=0 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 client.17037 shutdown 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 msgr2=0x55d931b41960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:27.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 0x55d931b41960 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0956e0 tx=0x7f3a3c009bf0 comp rx=0 tx=0).stop 2023-03-17T09:39:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 shutdown_connections 2023-03-17T09:39:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d931b357d0 0x55d931b37bb0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d931b3e170 0x55d931b41960 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d931b39a20 0x55d931b4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a23fff700 0 client.17037 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:39:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 --2- 172.21.15.35:0/1922409349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d931b3a330 0x55d931b41420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:28.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 >> 172.21.15.35:0/1922409349 conn(0x55d9319926b0 msgr2=0x55d931b3c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:28.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 shutdown_connections 2023-03-17T09:39:30.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 1 -- 172.21.15.35:0/1922409349 wait complete. 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a56f68b80 20 client.17037 trim_cache size 0 max 16384 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a3409f6c0 msgr2=0x7f3a340a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a4addb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a3409f6c0 0x7f3a340a1b70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009cb0 tx=0x7f3a38009260 comp rx=0 tx=0).stop 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 msgr2=0x7f3a4419ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.630+0000 7f3a4addb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4419ad80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c008e50 tx=0x7f3a3c008e80 comp rx=0 tx=0).stop 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 shutdown_connections 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a3409f6c0 0x7f3a340a1b70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a441043f0 0x7f3a4419ad80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a440ff3b0 0x7f3a441963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 --2- 172.21.15.35:0/2872367769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a440ffd50 0x7f3a44196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 >> 172.21.15.35:0/2872367769 conn(0x7f3a44075f60 msgr2=0x7f3a44102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 shutdown_connections 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:16:10.631+0000 7f3a4addb700 1 -- 172.21.15.35:0/2872367769 wait complete. 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 -- 172.21.15.35:0/3033377559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 msgr2=0x7f2ca410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/3033377559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca410bf60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00b0d0 tx=0x7f2c9c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 -- 172.21.15.35:0/3033377559 shutdown_connections 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/3033377559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca410bf60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/3033377559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40ff350 0x7f2ca40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/3033377559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca40ffcf0 0x7f2ca4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 -- 172.21.15.35:0/3033377559 >> 172.21.15.35:0/3033377559 conn(0x7f2ca4076330 msgr2=0x7f2ca4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 -- 172.21.15.35:0/3033377559 shutdown_connections 2023-03-17T09:39:30.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.685+0000 7f2caa5ac700 1 -- 172.21.15.35:0/3033377559 wait complete. 2023-03-17T09:39:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.686+0000 7f2caa5ac700 1 Processor -- start 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.686+0000 7f2caa5ac700 1 -- start start 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40ff350 0x7f2ca4194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca40ffcf0 0x7f2ca41954d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca4195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41a47d0 con 0x7f2ca4104390 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41a4940 con 0x7f2ca40ff350 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca41a4b00 con 0x7f2ca40ffcf0 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca4195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca4195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46202/0 (socket says 172.21.15.35:46202) 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 -- 172.21.15.35:0/2735349742 learned_addr learned my addr 172.21.15.35:0/2735349742 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca40ffcf0 0x7f2ca41954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40ff350 0x7f2ca4194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 -- 172.21.15.35:0/2735349742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca40ffcf0 msgr2=0x7f2ca41954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca40ffcf0 0x7f2ca41954d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 -- 172.21.15.35:0/2735349742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40ff350 msgr2=0x7f2ca4194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:33.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40ff350 0x7f2ca4194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:33.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 -- 172.21.15.35:0/2735349742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c009d00 con 0x7f2ca4104390 2023-03-17T09:39:33.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca4195a10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c008ec0 tx=0x7f2c9c008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:33.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca17fa700 1 -- 172.21.15.35:0/2735349742 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00e040 con 0x7f2ca4104390 2023-03-17T09:39:33.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2ca17fa700 1 -- 172.21.15.35:0/2735349742 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c9c003e90 con 0x7f2ca4104390 2023-03-17T09:39:33.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.687+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca410efc0 con 0x7f2ca4104390 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.688+0000 7f2ca17fa700 1 -- 172.21.15.35:0/2735349742 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c01b6c0 con 0x7f2ca4104390 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.688+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca410ee30 con 0x7f2ca4104390 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.690+0000 7f2ca17fa700 1 -- 172.21.15.35:0/2735349742 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2c9c003a00 con 0x7f2ca4104390 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.690+0000 7f2ca17fa700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c9009f640 0x7f2c900a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.690+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c9009f640 0x7f2c900a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.690+0000 7f2ca17fa700 1 -- 172.21.15.35:0/2735349742 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2c9c0cb6e0 con 0x7f2ca4104390 2023-03-17T09:39:34.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.691+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c9009f640 0x7f2c900a1af0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009c60 tx=0x7f2c94009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.691+0000 7f2cb6739b80 1 Processor -- start 2023-03-17T09:39:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.691+0000 7f2cb6739b80 1 -- start start 2023-03-17T09:39:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667db94fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:34.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667db8f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667db8fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667da96010 con 0x55667db94be0 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667dae8950 con 0x55667db954f0 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667dae1de0 con 0x55667db8f960 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667db94fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667db94fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46206/0 (socket says 172.21.15.35:46206) 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 -- 172.21.15.35:0/176606043 learned_addr learned my addr 172.21.15.35:0/176606043 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667db8fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667db8f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 -- 172.21.15.35:0/176606043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 msgr2=0x55667db8fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667db8fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 -- 172.21.15.35:0/176606043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 msgr2=0x55667db8f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667db8f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 -- 172.21.15.35:0/176606043 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55667d9635d0 con 0x55667db94be0 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667db94fb0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e4e0 tx=0x7f2c94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef12ccf9ba93bc5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2c9a7fc700 1 -- 172.21.15.35:0/176606043 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94026430 con 0x55667db94be0 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.692+0000 7f2c9a7fc700 1 -- 172.21.15.35:0/176606043 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c94021070 con 0x55667db94be0 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2c9a7fc700 1 -- 172.21.15.35:0/176606043 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9401d670 con 0x55667db94be0 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 -- 172.21.15.35:0/176606043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 msgr2=0x55667db94fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667db94fb0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e4e0 tx=0x7f2c94014000 comp rx=0 tx=0).stop 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 -- 172.21.15.35:0/176606043 shutdown_connections 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667db8fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667db94fb0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/176606043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667db8f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 -- 172.21.15.35:0/176606043 >> 172.21.15.35:0/176606043 conn(0x55667d9ec6b0 msgr2=0x55667db89a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 -- 172.21.15.35:0/176606043 shutdown_connections 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.693+0000 7f2cb6739b80 1 -- 172.21.15.35:0/176606043 wait complete. 2023-03-17T09:39:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 -- start start 2023-03-17T09:39:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 Processor -- start 2023-03-17T09:39:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db8f960 0x55667db9b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:35.520 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:40 smithi035 ceph-mon[92535]: pgmap v1386: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:42 smithi035 ceph-mon[92535]: pgmap v1387: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:44 smithi035 ceph-mon[92535]: pgmap v1388: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:46 smithi035 ceph-mon[92535]: pgmap v1389: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:48 smithi035 ceph-mon[92535]: pgmap v1390: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:50 smithi035 ceph-mon[92535]: pgmap v1391: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:52 smithi035 ceph-mon[92535]: pgmap v1392: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:54 smithi035 ceph-mon[92535]: pgmap v1393: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:39:37.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:56 smithi035 ceph-mon[92535]: pgmap v1394: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:38.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:29:58 smithi035 ceph-mon[92535]: pgmap v1395: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:39:38.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:00 smithi035 ceph-mon[92535]: pgmap v1396: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:38.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:00 smithi035 ceph-mon[92535]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T09:39:38.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:00 smithi035 ceph-mon[92535]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2023-03-17T09:39:38.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:00 smithi035 ceph-mon[92535]: daemon mds.e on smithi078 is in error state 2023-03-17T09:39:38.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:02 smithi035 ceph-mon[92535]: pgmap v1397: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:39:40.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:04 smithi035 ceph-mon[92535]: pgmap v1398: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:39:40.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:06 smithi035 ceph-mon[92535]: pgmap v1399: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:39:40.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:08 smithi035 ceph-mon[92535]: pgmap v1400: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:39:40.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:09 smithi035 ceph-mon[92535]: osdmap e164: 12 total, 12 up, 12 in 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:10 smithi035 ceph-mon[92535]: pgmap v1402: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:12 smithi035 ceph-mon[92535]: pgmap v1403: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:14 smithi035 ceph-mon[92535]: pgmap v1404: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:16 smithi035 ceph-mon[92535]: pgmap v1405: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:16 smithi035 ceph-mon[92535]: osdmap e165: 12 total, 12 up, 12 in 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:18 smithi035 ceph-mon[92535]: pgmap v1407: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 931 B/s wr, 12 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:20 smithi035 ceph-mon[92535]: pgmap v1408: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:22 smithi035 ceph-mon[92535]: pgmap v1409: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:24 smithi035 ceph-mon[92535]: pgmap v1410: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:39:41.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:25 smithi035 ceph-mon[92535]: pgmap v1411: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:25 smithi035 ceph-mon[92535]: pgmap v1412: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:27 smithi035 ceph-mon[92535]: pgmap v1413: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:29 smithi035 ceph-mon[92535]: pgmap v1414: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:31 smithi035 ceph-mon[92535]: pgmap v1415: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:33 smithi035 ceph-mon[92535]: pgmap v1416: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:35 smithi035 ceph-mon[92535]: pgmap v1417: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:39:41.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:37 smithi035 ceph-mon[92535]: pgmap v1418: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:39:41.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:39:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:39:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:39:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:39:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db94be0 0x55667db98660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 0x55667db98c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667d9658c0 con 0x55667db954f0 2023-03-17T09:39:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667db99390 con 0x55667db8f960 2023-03-17T09:39:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667dba5000 con 0x55667db94be0 2023-03-17T09:39:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2cb6739b80 10 client.0 _ll_register_callbacks cb 0x55667d987230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:39:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2ca8b49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 0x55667db98c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2ca8b49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 0x55667db98c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46216/0 (socket says 172.21.15.35:46216) 2023-03-17T09:39:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2ca8b49700 1 -- 172.21.15.35:0/525227870 learned_addr learned my addr 172.21.15.35:0/525227870 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db94be0 0x55667db98660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.694+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db8f960 0x55667db9b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2ca8b49700 1 -- 172.21.15.35:0/525227870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db94be0 msgr2=0x55667db98660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db94be0 0x55667db98660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2ca8b49700 1 -- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db8f960 msgr2=0x55667db9b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db8f960 0x55667db9b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2ca8b49700 1 -- 172.21.15.35:0/525227870 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c94017070 con 0x55667db954f0 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 0x55667db98c20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009fd0 tx=0x7f2c9c0990e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9eae78452729d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2c837fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:39:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2c837fe700 1 -- 172.21.15.35:0/525227870 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c099680 con 0x55667db954f0 2023-03-17T09:39:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2c837fe700 1 -- 172.21.15.35:0/525227870 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2c9c005300 con 0x55667db954f0 2023-03-17T09:39:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55667daa4390 con 0x55667db954f0 2023-03-17T09:39:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2c837fe700 1 -- 172.21.15.35:0/525227870 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c9c003cb0 con 0x55667db954f0 2023-03-17T09:39:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2cb6739b80 10 client.17049 fetch_fsmap learned FSMap version 33 2023-03-17T09:39:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55667d90fd80 con 0x55667db954f0 2023-03-17T09:39:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.695+0000 7f2c837fe700 1 -- 172.21.15.35:0/525227870 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55667daa4390 con 0x55667db954f0 2023-03-17T09:39:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2c837fe700 1 -- 172.21.15.35:0/525227870 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c9c0c5020 con 0x55667db954f0 2023-03-17T09:39:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2cb6739b80 10 client.17049 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:39:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2cb6739b80 10 client.17049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:39:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2cb6739b80 20 client.17049 populate_metadata read hostname 'smithi035' 2023-03-17T09:39:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dba8df0 0x55667dbab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2cb6739b80 4 client.17049 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55667dab0600 con 0x55667dba8df0 2023-03-17T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dba8df0 0x55667dbab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2c837fe700 10 client.17049 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.696+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dba8df0 0x55667dbab200 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb6c3ea2f15b47bd server_cookie=dfc0419c0f2982be in_seq=0 out_seq=0 2023-03-17T09:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2c837fe700 1 -- 172.21.15.35:0/525227870 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55667dab0600 con 0x55667dba8df0 2023-03-17T09:39:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2c837fe700 10 client.17049 handle_command_reply: tid=0 2023-03-17T09:39:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 client.17049 shutdown 2023-03-17T09:39:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 msgr2=0x55667db98c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 0x55667db98c20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009fd0 tx=0x7f2c9c0990e0 comp rx=0 tx=0).stop 2023-03-17T09:39:48.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 shutdown_connections 2023-03-17T09:39:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dba8df0 0x55667dbab200 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db954f0 0x55667db98c20 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db8f960 0x55667db9b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/525227870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db94be0 0x55667db98660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2c837fe700 0 client.17049 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 >> 172.21.15.35:0/525227870 conn(0x55667d9ec6b0 msgr2=0x55667db8e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 shutdown_connections 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.697+0000 7f2cb6739b80 1 -- 172.21.15.35:0/525227870 wait complete. 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.698+0000 7f2cb6739b80 20 client.17049 trim_cache size 0 max 16384 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 Processor -- start 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 -- start start 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 0x55667db9ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db94be0 0x55667db9af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db954f0 0x55667db8e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667daa4390 con 0x55667db8f960 2023-03-17T09:39:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667daa5050 con 0x55667db94be0 2023-03-17T09:39:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667db931b0 con 0x55667db954f0 2023-03-17T09:39:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 0x55667db9ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 0x55667db9ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46220/0 (socket says 172.21.15.35:46220) 2023-03-17T09:39:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 -- 172.21.15.35:0/2965906439 learned_addr learned my addr 172.21.15.35:0/2965906439 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:39:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db94be0 0x55667db9af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db954f0 0x55667db8e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:39:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 -- 172.21.15.35:0/2965906439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db954f0 msgr2=0x55667db8e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db954f0 0x55667db8e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 -- 172.21.15.35:0/2965906439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db94be0 msgr2=0x55667db9af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db94be0 0x55667db9af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca3fff700 1 -- 172.21.15.35:0/2965906439 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55667daa8130 con 0x55667db8f960 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.713+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db94be0 0x55667db9af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 0x55667db9ff50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c94026000 tx=0x7f2c94005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36bb9c8fd395aed server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2c9affd700 1 -- 172.21.15.35:0/2965906439 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94031bf0 con 0x55667db8f960 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2c9affd700 1 -- 172.21.15.35:0/2965906439 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c94021070 con 0x55667db8f960 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2c9affd700 1 -- 172.21.15.35:0/2965906439 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94003680 con 0x55667db8f960 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 -- 172.21.15.35:0/2965906439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 msgr2=0x55667db9ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:39:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 0x55667db9ff50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c94026000 tx=0x7f2c94005ce0 comp rx=0 tx=0).stop 2023-03-17T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 -- 172.21.15.35:0/2965906439 shutdown_connections 2023-03-17T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db954f0 0x55667db8e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db8f960 0x55667db9ff50 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/2965906439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db94be0 0x55667db9af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:39:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 -- 172.21.15.35:0/2965906439 >> 172.21.15.35:0/2965906439 conn(0x55667d9ec6b0 msgr2=0x55667db926b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:39:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 -- 172.21.15.35:0/2965906439 shutdown_connections 2023-03-17T09:39:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.714+0000 7f2cb6739b80 1 -- 172.21.15.35:0/2965906439 wait complete. 2023-03-17T09:39:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 -- start start 2023-03-17T09:39:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 Processor -- start 2023-03-17T09:39:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667dbf0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667dbf1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667dbf5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:39:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667dbf6220 con 0x55667db94be0 2023-03-17T09:40:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667dbf6390 con 0x55667db954f0 2023-03-17T09:40:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667dbf6550 con 0x55667db8f960 2023-03-17T09:40:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2cb6739b80 10 client.0 _ll_register_callbacks cb 0x55667d987230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:40:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2ca37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667dbf1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:00.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2ca37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667dbf1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46228/0 (socket says 172.21.15.35:46228) 2023-03-17T09:40:00.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.715+0000 7f2ca37fe700 1 -- 172.21.15.35:0/1852084714 learned_addr learned my addr 172.21.15.35:0/1852084714 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:00.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667dbf5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667dbf0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca37fe700 1 -- 172.21.15.35:0/1852084714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 msgr2=0x55667dbf0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667dbf0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca37fe700 1 -- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 msgr2=0x55667dbf5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667dbf5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca37fe700 1 -- 172.21.15.35:0/1852084714 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9402a040 con 0x55667db94be0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667dbf0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca8b49700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667dbf5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2ca37fe700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667dbf1350 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2ca406a350 tx=0x7f2c8c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98ec4e8b20bf879 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2c837fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2c837fe700 1 -- 172.21.15.35:0/1852084714 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c003e50 con 0x55667db94be0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55667db5f1e0 con 0x55667db94be0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2c837fe700 1 -- 172.21.15.35:0/1852084714 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2c8c004830 con 0x55667db94be0 2023-03-17T09:40:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2c837fe700 1 -- 172.21.15.35:0/1852084714 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c8c0049f0 con 0x55667db94be0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2cb6739b80 10 client.17055 fetch_fsmap learned FSMap version 33 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55667d9361f0 con 0x55667db94be0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.716+0000 7f2c837fe700 1 -- 172.21.15.35:0/1852084714 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55667db5f1e0 con 0x55667db94be0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2c837fe700 1 -- 172.21.15.35:0/1852084714 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c8c01c510 con 0x55667db94be0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2cb6739b80 10 client.17055 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2cb6739b80 10 client.17055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2cb6739b80 20 client.17055 populate_metadata read hostname 'smithi035' 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dbfdec0 0x55667dc002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2cb6739b80 4 client.17055 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55667d965f00 con 0x55667dbfdec0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dbfdec0 0x55667dc002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2ca3fff700 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dbfdec0 0x55667dc002d0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b2d618614436a4 server_cookie=3993e821d48b3e30 in_seq=0 out_seq=0 2023-03-17T09:40:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.717+0000 7f2c837fe700 10 client.17055 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.725+0000 7f2c837fe700 1 -- 172.21.15.35:0/1852084714 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55667d965f00 con 0x55667dbfdec0 2023-03-17T09:40:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2c837fe700 10 client.17055 handle_command_reply: tid=0 2023-03-17T09:40:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 client.17055 shutdown 2023-03-17T09:40:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 msgr2=0x55667dbf1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667dbf1350 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2ca406a350 tx=0x7f2c8c00bd40 comp rx=0 tx=0).stop 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 shutdown_connections 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55667dbfdec0 0x55667dc002d0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667db954f0 0x55667dbf5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2c837fe700 0 client.17055 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55667db8f960 0x55667dbf0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 --2- 172.21.15.35:0/1852084714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55667db94be0 0x55667dbf1350 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 >> 172.21.15.35:0/1852084714 conn(0x55667d9ec6b0 msgr2=0x55667db8e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 shutdown_connections 2023-03-17T09:40:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 1 -- 172.21.15.35:0/1852084714 wait complete. 2023-03-17T09:40:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2cb6739b80 20 client.17055 trim_cache size 0 max 16384 2023-03-17T09:40:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c9009f640 msgr2=0x7f2c900a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c9009f640 0x7f2c900a1af0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009c60 tx=0x7f2c94009260 comp rx=0 tx=0).stop 2023-03-17T09:40:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 msgr2=0x7f2ca4195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.726+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca4195a10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c008ec0 tx=0x7f2c9c008ef0 comp rx=0 tx=0).stop 2023-03-17T09:40:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 shutdown_connections 2023-03-17T09:40:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c9009f640 0x7f2c900a1af0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2ca4104390 0x7f2ca4195a10 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ca40ff350 0x7f2ca4194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 --2- 172.21.15.35:0/2735349742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca40ffcf0 0x7f2ca41954d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 >> 172.21.15.35:0/2735349742 conn(0x7f2ca4076330 msgr2=0x7f2ca40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 shutdown_connections 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:21.727+0000 7f2caa5ac700 1 -- 172.21.15.35:0/2735349742 wait complete. 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 -- 172.21.15.35:0/4123545757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9480fefb0 msgr2=0x7ff9480ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 --2- 172.21.15.35:0/4123545757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9480fefb0 0x7ff9480ff380 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff938009990 tx=0x7ff938009ca0 comp rx=0 tx=0).stop 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 -- 172.21.15.35:0/4123545757 shutdown_connections 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 --2- 172.21.15.35:0/4123545757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff94810cb60 0x7ff94810ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 --2- 172.21.15.35:0/4123545757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9480fefb0 0x7ff9480ff380 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 --2- 172.21.15.35:0/4123545757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9480ff8c0 0x7ff94810c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 -- 172.21.15.35:0/4123545757 >> 172.21.15.35:0/4123545757 conn(0x7ff948076330 msgr2=0x7ff948076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 -- 172.21.15.35:0/4123545757 shutdown_connections 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 -- 172.21.15.35:0/4123545757 wait complete. 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.849+0000 7ff94d88e700 1 Processor -- start 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 -- start start 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9480fefb0 0x7ff948198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9480ff8c0 0x7ff9481989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 0x7ff94819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819d440 con 0x7ff94810cb60 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819d5b0 con 0x7ff9480fefb0 2023-03-17T09:40:07.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff94d88e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819d770 con 0x7ff9480ff8c0 2023-03-17T09:40:07.750 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:39 smithi035 ceph-mon[92535]: pgmap v1419: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 0x7ff94819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 0x7ff94819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46244/0 (socket says 172.21.15.35:46244) 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff946ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9480fefb0 0x7ff948198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 -- 172.21.15.35:0/2752055931 learned_addr learned my addr 172.21.15.35:0/2752055931 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9467fc700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9480ff8c0 0x7ff9481989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 -- 172.21.15.35:0/2752055931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9480ff8c0 msgr2=0x7ff9481989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9480ff8c0 0x7ff9481989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 -- 172.21.15.35:0/2752055931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9480fefb0 msgr2=0x7ff948198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9480fefb0 0x7ff948198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 -- 172.21.15.35:0/2752055931 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380095f0 con 0x7ff94810cb60 2023-03-17T09:40:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.850+0000 7ff9477fe700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 0x7ff94819ce00 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff940007ce0 tx=0x7ff94000d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.851+0000 7ff94c88c700 1 -- 172.21.15.35:0/2752055931 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940004db0 con 0x7ff94810cb60 2023-03-17T09:40:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.851+0000 7ff94c88c700 1 -- 172.21.15.35:0/2752055931 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff94000f040 con 0x7ff94810cb60 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.851+0000 7ff94c88c700 1 -- 172.21.15.35:0/2752055931 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940005980 con 0x7ff94810cb60 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.851+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948112300 con 0x7ff94810cb60 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.851+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff948112170 con 0x7ff94810cb60 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.853+0000 7ff94c88c700 1 -- 172.21.15.35:0/2752055931 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff94000da10 con 0x7ff94810cb60 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.854+0000 7ff94c88c700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff93009f6c0 0x7ff9300a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.854+0000 7ff946ffd700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff93009f6c0 0x7ff9300a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.854+0000 7ff94c88c700 1 -- 172.21.15.35:0/2752055931 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9400c9de0 con 0x7ff94810cb60 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff946ffd700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff93009f6c0 0x7ff9300a1b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff93800b5c0 tx=0x7ff938005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 Processor -- start 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 -- start start 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07abe0 0x55b20a07afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a075420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a075d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b209f7c010 con 0x55b20a07b4f0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b209fce950 con 0x55b20a075960 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b209fc7de0 con 0x55b20a07abe0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff9467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff9467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a075420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46250/0 (socket says 172.21.15.35:46250) 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff9467fc700 1 -- 172.21.15.35:0/695386090 learned_addr learned my addr 172.21.15.35:0/695386090 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.855+0000 7ff9477fe700 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a075d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff946ffd700 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07abe0 0x55b20a07afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9467fc700 1 -- 172.21.15.35:0/695386090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07abe0 msgr2=0x55b20a07afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9467fc700 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07abe0 0x55b20a07afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9467fc700 1 -- 172.21.15.35:0/695386090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 msgr2=0x55b20a075d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9467fc700 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a075d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9467fc700 1 -- 172.21.15.35:0/695386090 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b209e495d0 con 0x55b20a07b4f0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9477fe700 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff9467fc700 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a075420 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00bd10 tx=0x7ff93c00f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188ff194c23b6eeb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff92dffb700 1 -- 172.21.15.35:0/695386090 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00fe50 con 0x55b20a07b4f0 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff92dffb700 1 -- 172.21.15.35:0/695386090 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff93c00be60 con 0x55b20a07b4f0 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.856+0000 7ff92dffb700 1 -- 172.21.15.35:0/695386090 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c010750 con 0x55b20a07b4f0 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 -- 172.21.15.35:0/695386090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 msgr2=0x55b20a075420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a075420 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00bd10 tx=0x7ff93c00f640 comp rx=0 tx=0).stop 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 -- 172.21.15.35:0/695386090 shutdown_connections 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07abe0 0x55b20a07afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/695386090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a075420 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 -- 172.21.15.35:0/695386090 >> 172.21.15.35:0/695386090 conn(0x55b209ed26b0 msgr2=0x55b20a06fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 -- 172.21.15.35:0/695386090 shutdown_connections 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 -- 172.21.15.35:0/695386090 wait complete. 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 -- start start 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.857+0000 7ff959a1bb80 1 Processor -- start 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a0814b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a07e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07b4f0 0x55b20a07ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b209e4b8c0 con 0x55b20a07abe0 2023-03-17T09:40:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a07f5b0 con 0x55b20a075960 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a08b060 con 0x55b20a07b4f0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 10 client.0 _ll_register_callbacks cb 0x55b209e6d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a07e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a07e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46256/0 (socket says 172.21.15.35:46256) 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 -- 172.21.15.35:0/157160870 learned_addr learned my addr 172.21.15.35:0/157160870 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff946ffd700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a0814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9477fe700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07b4f0 0x55b20a07ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 -- 172.21.15.35:0/157160870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07b4f0 msgr2=0x55b20a07ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07b4f0 0x55b20a07ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 -- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 msgr2=0x55b20a0814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a0814b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 -- 172.21.15.35:0/157160870 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c00b940 con 0x55b20a07abe0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff946ffd700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a0814b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff9467fc700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a07e7a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff93c011ec0 tx=0x7ff93c00ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0fd95ae2d0c18b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff926ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff926ffd700 1 -- 172.21.15.35:0/157160870 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c020070 con 0x55b20a07abe0 2023-03-17T09:40:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff926ffd700 1 -- 172.21.15.35:0/157160870 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff93c0054f0 con 0x55b20a07abe0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.858+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b209f8a390 con 0x55b20a07abe0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff926ffd700 1 -- 172.21.15.35:0/157160870 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff93c0056b0 con 0x55b20a07abe0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 10 client.17067 fetch_fsmap learned FSMap version 33 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b209df5d80 con 0x55b20a07abe0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff926ffd700 1 -- 172.21.15.35:0/157160870 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b209f8a390 con 0x55b20a07abe0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff926ffd700 1 -- 172.21.15.35:0/157160870 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff93c011820 con 0x55b20a07abe0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 10 client.17067 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 20 client.17067 populate_metadata read hostname 'smithi035' 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a08f040 0x55b20a091450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 4 client.17067 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b209f96600 con 0x55b20a08f040 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.859+0000 7ff946ffd700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a08f040 0x55b20a091450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff926ffd700 10 client.17067 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff946ffd700 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a08f040 0x55b20a091450 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75372ce91e29a9c server_cookie=116cd742bb9dd5e5 in_seq=0 out_seq=0 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff926ffd700 1 -- 172.21.15.35:0/157160870 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b209f96600 con 0x55b20a08f040 2023-03-17T09:40:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff926ffd700 10 client.17067 handle_command_reply: tid=0 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff959a1bb80 1 client.17067 shutdown 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 msgr2=0x55b20a07e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.860+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a07e7a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff93c011ec0 tx=0x7ff93c00ff30 comp rx=0 tx=0).stop 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 shutdown_connections 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a08f040 0x55b20a091450 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a07b4f0 0x55b20a07ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a075960 0x55b20a0814b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff926ffd700 0 client.17067 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/157160870 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a07e7a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 >> 172.21.15.35:0/157160870 conn(0x55b209ed26b0 msgr2=0x55b20a074410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 shutdown_connections 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 1 -- 172.21.15.35:0/157160870 wait complete. 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.861+0000 7ff959a1bb80 20 client.17067 trim_cache size 0 max 16384 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 Processor -- start 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 -- start start 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07abe0 0x55b20a081050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a0786b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a070000 con 0x55b20a07b4f0 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a07f6f0 con 0x55b20a07abe0 2023-03-17T09:40:11.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a07a830 con 0x55b20a075960 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a0786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a0786b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46266/0 (socket says 172.21.15.35:46266) 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 -- 172.21.15.35:0/2174013306 learned_addr learned my addr 172.21.15.35:0/2174013306 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff946ffd700 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9467fc700 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07abe0 0x55b20a081050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 -- 172.21.15.35:0/2174013306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 msgr2=0x55b20a06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a06fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 -- 172.21.15.35:0/2174013306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07abe0 msgr2=0x55b20a081050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07abe0 0x55b20a081050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 -- 172.21.15.35:0/2174013306 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b209f8e130 con 0x55b20a07b4f0 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff946ffd700 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.876+0000 7ff9477fe700 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a0786b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff94000d4d0 tx=0x7ff9400c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd605877ab2a0f5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff92e7fc700 1 -- 172.21.15.35:0/2174013306 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400ac070 con 0x55b20a07b4f0 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff92e7fc700 1 -- 172.21.15.35:0/2174013306 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff940095c30 con 0x55b20a07b4f0 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff92e7fc700 1 -- 172.21.15.35:0/2174013306 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940097af0 con 0x55b20a07b4f0 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 -- 172.21.15.35:0/2174013306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 msgr2=0x55b20a0786b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a0786b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff94000d4d0 tx=0x7ff9400c9040 comp rx=0 tx=0).stop 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 -- 172.21.15.35:0/2174013306 shutdown_connections 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07b4f0 0x55b20a0786b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/2174013306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07abe0 0x55b20a081050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 -- 172.21.15.35:0/2174013306 >> 172.21.15.35:0/2174013306 conn(0x55b209ed26b0 msgr2=0x55b20a095d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 -- 172.21.15.35:0/2174013306 shutdown_connections 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 -- 172.21.15.35:0/2174013306 wait complete. 2023-03-17T09:40:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.877+0000 7ff959a1bb80 1 -- start start 2023-03-17T09:40:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 Processor -- start 2023-03-17T09:40:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a084180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a0846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07b4f0 0x55b20a0dbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a0dc4b0 con 0x55b20a07abe0 2023-03-17T09:40:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a0dc620 con 0x55b20a07b4f0 2023-03-17T09:40:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20a0dc7e0 con 0x55b20a075960 2023-03-17T09:40:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff959a1bb80 10 client.0 _ll_register_callbacks cb 0x55b209e6d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:40:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a0846c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a0846c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46270/0 (socket says 172.21.15.35:46270) 2023-03-17T09:40:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 -- 172.21.15.35:0/530819540 learned_addr learned my addr 172.21.15.35:0/530819540 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9477fe700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07b4f0 0x55b20a0dbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff946ffd700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a084180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 -- 172.21.15.35:0/530819540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 msgr2=0x55b20a084180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a084180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 -- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07b4f0 msgr2=0x55b20a0dbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.878+0000 7ff9467fc700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07b4f0 0x55b20a0dbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff9467fc700 1 -- 172.21.15.35:0/530819540 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff948112170 con 0x55b20a07abe0 2023-03-17T09:40:16.697 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:41 smithi035 ceph-mon[92535]: pgmap v1420: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:40:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff9467fc700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a0846c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff93c014040 tx=0x7ff93c011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a98dac3c829036 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff926ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff926ffd700 1 -- 172.21.15.35:0/530819540 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c020040 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff926ffd700 1 -- 172.21.15.35:0/530819540 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff93c000e40 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b20a0451e0 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff926ffd700 1 -- 172.21.15.35:0/530819540 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff93c005ee0 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 10 client.17073 fetch_fsmap learned FSMap version 33 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b209e1c1f0 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff926ffd700 1 -- 172.21.15.35:0/530819540 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b20a0451e0 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff926ffd700 1 -- 172.21.15.35:0/530819540 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff93c01acd0 con 0x55b20a07abe0 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 10 client.17073 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 10 client.17073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 20 client.17073 populate_metadata read hostname 'smithi035' 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a0e3c10 0x55b20a0e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 4 client.17073 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:40:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.879+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b209e4bf00 con 0x55b20a0e3c10 2023-03-17T09:40:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.880+0000 7ff946ffd700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a0e3c10 0x55b20a0e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.880+0000 7ff926ffd700 10 client.17073 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.880+0000 7ff946ffd700 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a0e3c10 0x55b20a0e6020 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c98e206ffdd5732 server_cookie=98ea76d6ae98c78c in_seq=0 out_seq=0 2023-03-17T09:40:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff926ffd700 1 -- 172.21.15.35:0/530819540 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b209e4bf00 con 0x55b20a0e3c10 2023-03-17T09:40:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff926ffd700 10 client.17073 handle_command_reply: tid=0 2023-03-17T09:40:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 client.17073 shutdown 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 msgr2=0x55b20a0846c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a0846c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff93c014040 tx=0x7ff93c011770 comp rx=0 tx=0).stop 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 shutdown_connections 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b20a0e3c10 0x55b20a0e6020 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b20a07b4f0 0x55b20a0dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b20a075960 0x55b20a084180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 --2- 172.21.15.35:0/530819540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b20a07abe0 0x55b20a0846c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 >> 172.21.15.35:0/530819540 conn(0x55b209ed26b0 msgr2=0x55b20a0786b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff926ffd700 0 client.17073 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.884+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 shutdown_connections 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff959a1bb80 1 -- 172.21.15.35:0/530819540 wait complete. 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff959a1bb80 20 client.17073 trim_cache size 0 max 16384 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff93009f6c0 msgr2=0x7ff9300a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff93009f6c0 0x7ff9300a1b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff93800b5c0 tx=0x7ff938005fb0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 msgr2=0x7ff94819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 0x7ff94819ce00 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff940007ce0 tx=0x7ff94000d0d0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 shutdown_connections 2023-03-17T09:40:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff93009f6c0 0x7ff9300a1b70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff94810cb60 0x7ff94819ce00 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9480fefb0 0x7ff948198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 --2- 172.21.15.35:0/2752055931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9480ff8c0 0x7ff9481989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 >> 172.21.15.35:0/2752055931 conn(0x7ff948076330 msgr2=0x7ff9480fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 shutdown_connections 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:34.885+0000 7ff94d88e700 1 -- 172.21.15.35:0/2752055931 wait complete. 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 -- 172.21.15.35:0/802169399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 msgr2=0x7eff140fecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/802169399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff140fecc0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7eff04009990 tx=0x7eff04009ca0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 -- 172.21.15.35:0/802169399 shutdown_connections 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/802169399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff140ff200 0x7eff1410b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/802169399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff14104860 0x7eff14104c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/802169399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff140fecc0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 -- 172.21.15.35:0/802169399 >> 172.21.15.35:0/802169399 conn(0x7eff140757a0 msgr2=0x7eff14075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 -- 172.21.15.35:0/802169399 shutdown_connections 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.007+0000 7eff1a7a3700 1 -- 172.21.15.35:0/802169399 wait complete. 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.008+0000 7eff1a7a3700 1 Processor -- start 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.008+0000 7eff1a7a3700 1 -- start start 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff1a7a3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff14196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff1a7a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff140ff200 0x7eff14197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff1a7a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff14104860 0x7eff141a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff1a7a3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141a25a0 con 0x7eff140fe850 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff1a7a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141a26e0 con 0x7eff14104860 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff1a7a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff141a2820 con 0x7eff140ff200 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff14196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff14196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46284/0 (socket says 172.21.15.35:46284) 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 -- 172.21.15.35:0/1401789786 learned_addr learned my addr 172.21.15.35:0/1401789786 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff18d40700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff14104860 0x7eff141a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff137fe700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff140ff200 0x7eff14197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 -- 172.21.15.35:0/1401789786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff140ff200 msgr2=0x7eff14197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff140ff200 0x7eff14197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 -- 172.21.15.35:0/1401789786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff14104860 msgr2=0x7eff141a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff14104860 0x7eff141a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff13fff700 1 -- 172.21.15.35:0/1401789786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040095f0 con 0x7eff140fe850 2023-03-17T09:40:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.009+0000 7eff137fe700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff140ff200 0x7eff14197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:40:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.010+0000 7eff13fff700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff14196fe0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7eff0800d980 tx=0x7eff0800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.010+0000 7eff117fa700 1 -- 172.21.15.35:0/1401789786 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800bb60 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.010+0000 7eff117fa700 1 -- 172.21.15.35:0/1401789786 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff08007620 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.010+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1410efd0 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.010+0000 7eff117fa700 1 -- 172.21.15.35:0/1401789786 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800f3c0 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.010+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1410ee40 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.012+0000 7eff117fa700 1 -- 172.21.15.35:0/1401789786 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7eff08010460 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.012+0000 7eff117fa700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efefc09f640 0x7efefc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.013+0000 7eff137fe700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efefc09f640 0x7efefc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.013+0000 7eff117fa700 1 -- 172.21.15.35:0/1401789786 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7eff080ca870 con 0x7eff140fe850 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.013+0000 7eff137fe700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efefc09f640 0x7efefc0a1af0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b2e0 tx=0x7eff04005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.013+0000 7eff26930b80 1 Processor -- start 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 -- start start 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 0x55fe04e2dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e28d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04d2f010 con 0x55fe04e2dbe0 2023-03-17T09:40:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04d81950 con 0x55fe04e2e4f0 2023-03-17T09:40:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff26930b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04d7ade0 con 0x55fe04e28960 2023-03-17T09:40:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 0x55fe04e2dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 0x55fe04e2dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46292/0 (socket says 172.21.15.35:46292) 2023-03-17T09:40:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 -- 172.21.15.35:0/469094379 learned_addr learned my addr 172.21.15.35:0/469094379 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff137fe700 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff18d40700 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 -- 172.21.15.35:0/469094379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 msgr2=0x55fe04e28d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e28d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 -- 172.21.15.35:0/469094379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 msgr2=0x55fe04e28420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e28420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 -- 172.21.15.35:0/469094379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe04bfc5d0 con 0x55fe04e2dbe0 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.014+0000 7eff13fff700 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 0x55fe04e2dfb0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7eff080947c0 tx=0x7eff08097ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931602f747e3e476 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7efefa7fc700 1 -- 172.21.15.35:0/469094379 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080982c0 con 0x55fe04e2dbe0 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7efefa7fc700 1 -- 172.21.15.35:0/469094379 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff080a04b0 con 0x55fe04e2dbe0 2023-03-17T09:40:28.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7efefa7fc700 1 -- 172.21.15.35:0/469094379 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080a0020 con 0x55fe04e2dbe0 2023-03-17T09:40:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 -- 172.21.15.35:0/469094379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 msgr2=0x55fe04e2dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 0x55fe04e2dfb0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7eff080947c0 tx=0x7eff08097ca0 comp rx=0 tx=0).stop 2023-03-17T09:40:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 -- 172.21.15.35:0/469094379 shutdown_connections 2023-03-17T09:40:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e28d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2dbe0 0x55fe04e2dfb0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 --2- 172.21.15.35:0/469094379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e28420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 -- 172.21.15.35:0/469094379 >> 172.21.15.35:0/469094379 conn(0x55fe04c856b0 msgr2=0x55fe04e22a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 -- 172.21.15.35:0/469094379 shutdown_connections 2023-03-17T09:40:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.015+0000 7eff26930b80 1 -- 172.21.15.35:0/469094379 wait complete. 2023-03-17T09:40:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 -- start start 2023-03-17T09:40:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 Processor -- start 2023-03-17T09:40:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 0x55fe04e34450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e2dbe0 0x55fe04e316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e31d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04bfe8c0 con 0x55fe04e28960 2023-03-17T09:40:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e324a0 con 0x55fe04e2e4f0 2023-03-17T09:40:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e3e030 con 0x55fe04e2dbe0 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff26930b80 10 client.0 _ll_register_callbacks cb 0x55fe04c20230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 0x55fe04e34450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff13fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 0x55fe04e34450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46298/0 (socket says 172.21.15.35:46298) 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff13fff700 1 -- 172.21.15.35:0/4137483225 learned_addr learned my addr 172.21.15.35:0/4137483225 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.016+0000 7eff18d40700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e31d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff137fe700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e2dbe0 0x55fe04e316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff13fff700 1 -- 172.21.15.35:0/4137483225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e2dbe0 msgr2=0x55fe04e316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:34.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff13fff700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e2dbe0 0x55fe04e316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff13fff700 1 -- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 msgr2=0x55fe04e31d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff13fff700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e31d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff13fff700 1 -- 172.21.15.35:0/4137483225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1410ee40 con 0x55fe04e28960 2023-03-17T09:40:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff137fe700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e2dbe0 0x55fe04e316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:40:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff13fff700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 0x55fe04e34450 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7eff08010fd0 tx=0x7eff08098750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1652c2e74da925f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7efef37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:40:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7efef37fe700 1 -- 172.21.15.35:0/4137483225 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080982c0 con 0x55fe04e28960 2023-03-17T09:40:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7efef37fe700 1 -- 172.21.15.35:0/4137483225 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7eff080979c0 con 0x55fe04e28960 2023-03-17T09:40:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe04d3d390 con 0x55fe04e28960 2023-03-17T09:40:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7efef37fe700 1 -- 172.21.15.35:0/4137483225 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff080a0020 con 0x55fe04e28960 2023-03-17T09:40:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff26930b80 10 client.17085 fetch_fsmap learned FSMap version 33 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fe04ba8d80 con 0x55fe04e28960 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.017+0000 7efef37fe700 1 -- 172.21.15.35:0/4137483225 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe04d3d390 con 0x55fe04e28960 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7efef37fe700 1 -- 172.21.15.35:0/4137483225 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7eff080942e0 con 0x55fe04e28960 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff26930b80 10 client.17085 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff26930b80 10 client.17085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff26930b80 20 client.17085 populate_metadata read hostname 'smithi035' 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff26930b80 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e41d40 0x55fe04e44150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff26930b80 4 client.17085 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe04d49600 con 0x55fe04e41d40 2023-03-17T09:40:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff137fe700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e41d40 0x55fe04e44150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7efef37fe700 10 client.17085 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.018+0000 7eff137fe700 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e41d40 0x55fe04e44150 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=915ca844eee65398 server_cookie=c056540945f83b61 in_seq=0 out_seq=0 2023-03-17T09:40:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7efef37fe700 1 -- 172.21.15.35:0/4137483225 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55fe04d49600 con 0x55fe04e41d40 2023-03-17T09:40:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7efef37fe700 10 client.17085 handle_command_reply: tid=0 2023-03-17T09:40:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 client.17085 shutdown 2023-03-17T09:40:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 msgr2=0x55fe04e34450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 0x55fe04e34450 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7eff08010fd0 tx=0x7eff08098750 comp rx=0 tx=0).stop 2023-03-17T09:40:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 shutdown_connections 2023-03-17T09:40:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e41d40 0x55fe04e44150 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:38.523 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:43 smithi035 ceph-mon[92535]: pgmap v1421: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:40:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2e4f0 0x55fe04e31d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7efef37fe700 0 client.17085 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e28960 0x55fe04e34450 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 --2- 172.21.15.35:0/4137483225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e2dbe0 0x55fe04e316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 >> 172.21.15.35:0/4137483225 conn(0x55fe04c856b0 msgr2=0x55fe04e27410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 shutdown_connections 2023-03-17T09:40:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 1 -- 172.21.15.35:0/4137483225 wait complete. 2023-03-17T09:40:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.019+0000 7eff26930b80 20 client.17085 trim_cache size 0 max 16384 2023-03-17T09:40:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.034+0000 7eff26930b80 1 Processor -- start 2023-03-17T09:40:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.034+0000 7eff26930b80 1 -- start start 2023-03-17T09:40:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.034+0000 7eff26930b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.034+0000 7eff26930b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e3d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.034+0000 7eff26930b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e33ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff26930b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e32cb0 con 0x55fe04e2e4f0 2023-03-17T09:40:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff26930b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e28760 con 0x55fe04e2dbe0 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff26930b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e2fc30 con 0x55fe04e28960 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e33ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e33ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46310/0 (socket says 172.21.15.35:46310) 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 -- 172.21.15.35:0/2632430307 learned_addr learned my addr 172.21.15.35:0/2632430307 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff13fff700 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff137fe700 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e3d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 -- 172.21.15.35:0/2632430307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 msgr2=0x55fe04e38f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 -- 172.21.15.35:0/2632430307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 msgr2=0x55fe04e3d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e3d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 -- 172.21.15.35:0/2632430307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe04d41130 con 0x55fe04e2e4f0 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff137fe700 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e3d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7eff18d40700 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e33ff0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7eff0c008550 tx=0x7eff0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8fcb57349eefd2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7efefaffd700 1 -- 172.21.15.35:0/2632430307 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00e040 con 0x55fe04e2e4f0 2023-03-17T09:40:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7efefaffd700 1 -- 172.21.15.35:0/2632430307 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff0c00f040 con 0x55fe04e2e4f0 2023-03-17T09:40:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.035+0000 7efefaffd700 1 -- 172.21.15.35:0/2632430307 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0079a0 con 0x55fe04e2e4f0 2023-03-17T09:40:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 -- 172.21.15.35:0/2632430307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 msgr2=0x55fe04e33ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e33ff0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7eff0c008550 tx=0x7eff0c00b040 comp rx=0 tx=0).stop 2023-03-17T09:40:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 -- 172.21.15.35:0/2632430307 shutdown_connections 2023-03-17T09:40:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e33ff0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 --2- 172.21.15.35:0/2632430307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e3d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 -- 172.21.15.35:0/2632430307 >> 172.21.15.35:0/2632430307 conn(0x55fe04c856b0 msgr2=0x55fe04e3e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 -- 172.21.15.35:0/2632430307 shutdown_connections 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 -- 172.21.15.35:0/2632430307 wait complete. 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.036+0000 7eff26930b80 1 -- start start 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 Processor -- start 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e37140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e37680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e37bc0 con 0x55fe04e2e4f0 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e37d30 con 0x55fe04e2dbe0 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe04e37ef0 con 0x55fe04e28960 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff26930b80 10 client.0 _ll_register_callbacks cb 0x55fe04c20230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:40:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e37680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e37680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46316/0 (socket says 172.21.15.35:46316) 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 -- 172.21.15.35:0/1595737773 learned_addr learned my addr 172.21.15.35:0/1595737773 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff137fe700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e37140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff13fff700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 -- 172.21.15.35:0/1595737773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 msgr2=0x55fe04e38de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 -- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 msgr2=0x55fe04e37140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e37140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 -- 172.21.15.35:0/1595737773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c0092c0 con 0x55fe04e2e4f0 2023-03-17T09:40:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7eff18d40700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e37680 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7eff0c007d00 tx=0x7eff0c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c678f1e4c2c1359f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.037+0000 7efef37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:40:50.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7efef37fe700 1 -- 172.21.15.35:0/1595737773 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00e040 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7efef37fe700 1 -- 172.21.15.35:0/1595737773 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7eff0c017440 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe04df81e0 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7efef37fe700 1 -- 172.21.15.35:0/1595737773 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff0c0073e0 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 10 client.17091 fetch_fsmap learned FSMap version 33 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fe04bcf1f0 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7efef37fe700 1 -- 172.21.15.35:0/1595737773 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe04df81e0 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7efef37fe700 1 -- 172.21.15.35:0/1595737773 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7eff0c014050 con 0x55fe04e2e4f0 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 10 client.17091 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:40:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:40:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 20 client.17091 populate_metadata read hostname 'smithi035' 2023-03-17T09:40:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e9b350 0x55fe04e9d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 4 client.17091 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:40:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fe04bfef00 con 0x55fe04e9b350 2023-03-17T09:40:52.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.038+0000 7eff13fff700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e9b350 0x55fe04e9d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.039+0000 7efef37fe700 10 client.17091 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.039+0000 7eff13fff700 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e9b350 0x55fe04e9d760 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6dcbc4fd030352 server_cookie=b0fd660a5479a146 in_seq=0 out_seq=0 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7efef37fe700 1 -- 172.21.15.35:0/1595737773 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fe04bfef00 con 0x55fe04e9b350 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7efef37fe700 10 client.17091 handle_command_reply: tid=0 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 client.17091 shutdown 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 msgr2=0x55fe04e37680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e37680 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7eff0c007d00 tx=0x7eff0c007de0 comp rx=0 tx=0).stop 2023-03-17T09:40:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 shutdown_connections 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fe04e9b350 0x55fe04e9d760 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fe04e2e4f0 0x55fe04e37680 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7efef37fe700 0 client.17091 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe04e28960 0x55fe04e38de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 --2- 172.21.15.35:0/1595737773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fe04e2dbe0 0x55fe04e37140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 >> 172.21.15.35:0/1595737773 conn(0x55fe04c856b0 msgr2=0x55fe04e3d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 shutdown_connections 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 1 -- 172.21.15.35:0/1595737773 wait complete. 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.043+0000 7eff26930b80 20 client.17091 trim_cache size 0 max 16384 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efefc09f640 msgr2=0x7efefc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efefc09f640 0x7efefc0a1af0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b2e0 tx=0x7eff04005fb0 comp rx=0 tx=0).stop 2023-03-17T09:40:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 msgr2=0x7eff14196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff14196fe0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7eff0800d980 tx=0x7eff0800dd40 comp rx=0 tx=0).stop 2023-03-17T09:40:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 shutdown_connections 2023-03-17T09:40:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efefc09f640 0x7efefc0a1af0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff14104860 0x7eff141a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff140fe850 0x7eff14196fe0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 --2- 172.21.15.35:0/1401789786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff140ff200 0x7eff14197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 >> 172.21.15.35:0/1401789786 conn(0x7eff140757a0 msgr2=0x7eff140fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 shutdown_connections 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:18:48.044+0000 7eff1a7a3700 1 -- 172.21.15.35:0/1401789786 wait complete. 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 -- 172.21.15.35:0/3748071073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f4101ce0 msgr2=0x7f52f410a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3748071073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f4101ce0 0x7f52f410a1d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009990 tx=0x7f52e4009ca0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 -- 172.21.15.35:0/3748071073 shutdown_connections 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3748071073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f410a7a0 0x7f52f410cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3748071073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f41013d0 0x7f52f41017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3748071073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f4101ce0 0x7f52f410a1d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 -- 172.21.15.35:0/3748071073 >> 172.21.15.35:0/3748071073 conn(0x7f52f4076330 msgr2=0x7f52f4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:40:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 -- 172.21.15.35:0/3748071073 shutdown_connections 2023-03-17T09:40:55.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.157+0000 7f52fc56d700 1 -- 172.21.15.35:0/3748071073 wait complete. 2023-03-17T09:40:55.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 Processor -- start 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 -- start start 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f41013d0 0x7f52f41961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4101ce0 0x7f52f4196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 0x7f52f419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f419b1b0 con 0x7f52f410a7a0 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f419b320 con 0x7f52f41013d0 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fc56d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f419b4e0 con 0x7f52f4101ce0 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 0x7f52f419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 0x7f52f419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46330/0 (socket says 172.21.15.35:46330) 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 -- 172.21.15.35:0/3654217478 learned_addr learned my addr 172.21.15.35:0/3654217478 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fa309700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f41013d0 0x7f52f41961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52f9b08700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4101ce0 0x7f52f4196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 -- 172.21.15.35:0/3654217478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4101ce0 msgr2=0x7f52f4196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4101ce0 0x7f52f4196710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 -- 172.21.15.35:0/3654217478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f41013d0 msgr2=0x7f52f41961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f41013d0 0x7f52f41961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.158+0000 7f52fab0a700 1 -- 172.21.15.35:0/3654217478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40095f0 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.159+0000 7f52fab0a700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 0x7f52f419ab70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f52ec007ee0 tx=0x7f52ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.159+0000 7f52eb7fe700 1 -- 172.21.15.35:0/3654217478 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00ddd0 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.159+0000 7f52eb7fe700 1 -- 172.21.15.35:0/3654217478 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52ec00f040 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.159+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f41100c0 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.159+0000 7f52eb7fe700 1 -- 172.21.15.35:0/3654217478 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0047d0 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.159+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f410ff30 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.162+0000 7f52eb7fe700 1 -- 172.21.15.35:0/3654217478 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f52ec003a00 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.162+0000 7f52eb7fe700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f52e009f640 0x7f52e00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.163+0000 7f52fa309700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f52e009f640 0x7f52e00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.163+0000 7f52eb7fe700 1 -- 172.21.15.35:0/3654217478 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f52ec0c9e40 con 0x7f52f410a7a0 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.163+0000 7f53086fab80 1 Processor -- start 2023-03-17T09:40:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.163+0000 7f52fa309700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f52e009f640 0x7f52e00a1af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009c60 tx=0x7f52f0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:40:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.163+0000 7f53086fab80 1 -- start start 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f53086fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b09fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f53086fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b0a4f0 0x560a75b04420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f53086fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 0x560a75b04d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f53086fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75a0b010 con 0x560a75b04960 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f53086fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75a5d950 con 0x560a75b0a4f0 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f53086fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75a56de0 con 0x560a75b09be0 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 0x560a75b04d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 0x560a75b04d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46338/0 (socket says 172.21.15.35:46338) 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 -- 172.21.15.35:0/2683107335 learned_addr learned my addr 172.21.15.35:0/2683107335 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:40:58.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fa309700 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b09fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52f9b08700 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b0a4f0 0x560a75b04420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:40:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 -- 172.21.15.35:0/2683107335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 msgr2=0x560a75b09fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b09fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:40:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 -- 172.21.15.35:0/2683107335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b0a4f0 msgr2=0x560a75b04420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:40:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b0a4f0 0x560a75b04420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:00.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.164+0000 7f52fab0a700 1 -- 172.21.15.35:0/2683107335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a758d85d0 con 0x560a75b04960 2023-03-17T09:41:00.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:45 smithi035 ceph-mon[92535]: pgmap v1422: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:00.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:47 smithi035 ceph-mon[92535]: pgmap v1423: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:00.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:49 smithi035 ceph-mon[92535]: pgmap v1424: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:51 smithi035 ceph-mon[92535]: pgmap v1425: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:53 smithi035 ceph-mon[92535]: pgmap v1426: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:55 smithi035 ceph-mon[92535]: pgmap v1427: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:57 smithi035 ceph-mon[92535]: pgmap v1428: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:30:59 smithi035 ceph-mon[92535]: pgmap v1429: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:01 smithi035 ceph-mon[92535]: pgmap v1430: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:00.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:03 smithi035 ceph-mon[92535]: pgmap v1431: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:41:03.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:05 smithi035 ceph-mon[92535]: pgmap v1432: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:41:03.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:07 smithi035 ceph-mon[92535]: pgmap v1433: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:41:03.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:09 smithi035 ceph-mon[92535]: pgmap v1434: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:41:03.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:09 smithi035 ceph-mon[92535]: osdmap e166: 12 total, 12 up, 12 in 2023-03-17T09:41:03.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:11 smithi035 ceph-mon[92535]: pgmap v1436: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:41:03.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:13 smithi035 ceph-mon[92535]: pgmap v1437: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:41:03.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:15 smithi035 ceph-mon[92535]: pgmap v1438: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:41:03.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:15 smithi035 ceph-mon[92535]: osdmap e167: 12 total, 12 up, 12 in 2023-03-17T09:41:03.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:17 smithi035 ceph-mon[92535]: pgmap v1440: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:41:06.377 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:19 smithi035 ceph-mon[92535]: pgmap v1441: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:21 smithi035 ceph-mon[92535]: pgmap v1442: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:23 smithi035 ceph-mon[92535]: pgmap v1443: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:25 smithi035 ceph-mon[92535]: pgmap v1444: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:41:06.378 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:26 smithi035 ceph-mon[92535]: pgmap v1445: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 106 B/s wr, 10 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:26 smithi035 ceph-mon[92535]: pgmap v1446: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:28 smithi035 ceph-mon[92535]: pgmap v1447: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:30 smithi035 ceph-mon[92535]: pgmap v1448: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:32 smithi035 ceph-mon[92535]: pgmap v1449: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:34 smithi035 ceph-mon[92535]: pgmap v1450: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:36 smithi035 ceph-mon[92535]: pgmap v1451: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:41:06.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:38 smithi035 ceph-mon[92535]: pgmap v1452: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:41:08.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:40 smithi035 ceph-mon[92535]: pgmap v1453: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:09.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:42 smithi035 ceph-mon[92535]: pgmap v1454: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:44 smithi035 ceph-mon[92535]: pgmap v1455: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:46 smithi035 ceph-mon[92535]: pgmap v1456: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:48 smithi035 ceph-mon[92535]: pgmap v1457: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:50 smithi035 ceph-mon[92535]: pgmap v1458: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:52 smithi035 ceph-mon[92535]: pgmap v1459: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:54 smithi035 ceph-mon[92535]: pgmap v1460: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:56 smithi035 ceph-mon[92535]: pgmap v1461: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:41:09.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:31:58 smithi035 ceph-mon[92535]: pgmap v1462: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:00 smithi035 ceph-mon[92535]: pgmap v1463: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:02 smithi035 ceph-mon[92535]: pgmap v1464: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:04 smithi035 ceph-mon[92535]: pgmap v1465: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:06 smithi035 ceph-mon[92535]: pgmap v1466: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:08 smithi035 ceph-mon[92535]: pgmap v1467: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:09 smithi035 ceph-mon[92535]: osdmap e168: 12 total, 12 up, 12 in 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:10 smithi035 ceph-mon[92535]: pgmap v1469: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:41:09.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:11 smithi035 ceph-mon[92535]: pgmap v1470: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:41:09.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:14 smithi035 ceph-mon[92535]: pgmap v1471: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:41:09.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:16 smithi035 ceph-mon[92535]: pgmap v1472: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:41:09.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:16 smithi035 ceph-mon[92535]: osdmap e169: 12 total, 12 up, 12 in 2023-03-17T09:41:09.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:18 smithi035 ceph-mon[92535]: pgmap v1474: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 970 B/s wr, 13 op/s 2023-03-17T09:41:09.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:20 smithi035 ceph-mon[92535]: pgmap v1475: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:41:09.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:22 smithi035 ceph-mon[92535]: pgmap v1476: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:41:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:41:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:41:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:41:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:41:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:41:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:41:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:41:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:41:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.165+0000 7f52fab0a700 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 0x560a75b04d90 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f52ec09f5b0 tx=0x7f52ec093d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf7fcab25fded2a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.165+0000 7f52e8ff9700 1 -- 172.21.15.35:0/2683107335 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec004000 con 0x560a75b04960 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.165+0000 7f52e8ff9700 1 -- 172.21.15.35:0/2683107335 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52ec0978f0 con 0x560a75b04960 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.165+0000 7f52e8ff9700 1 -- 172.21.15.35:0/2683107335 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec094000 con 0x560a75b04960 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 -- 172.21.15.35:0/2683107335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 msgr2=0x560a75b04d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 0x560a75b04d90 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f52ec09f5b0 tx=0x7f52ec093d50 comp rx=0 tx=0).stop 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 -- 172.21.15.35:0/2683107335 shutdown_connections 2023-03-17T09:41:13.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b04960 0x560a75b04d90 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b09fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 --2- 172.21.15.35:0/2683107335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b0a4f0 0x560a75b04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 -- 172.21.15.35:0/2683107335 >> 172.21.15.35:0/2683107335 conn(0x560a759616b0 msgr2=0x560a75afea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 -- 172.21.15.35:0/2683107335 shutdown_connections 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 -- 172.21.15.35:0/2683107335 wait complete. 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 -- start start 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.166+0000 7f53086fab80 1 Processor -- start 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b10480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b0d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b0ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a758da8c0 con 0x560a75b0a4f0 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b0e540 con 0x560a75b04960 2023-03-17T09:41:13.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b1a000 con 0x560a75b09be0 2023-03-17T09:41:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f53086fab80 10 client.0 _ll_register_callbacks cb 0x560a758fc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:41:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b0ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b10480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b0ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46344/0 (socket says 172.21.15.35:46344) 2023-03-17T09:41:13.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b10480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:48136/0 (socket says 172.21.15.35:48136) 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52f9b08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b0d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fab0a700 1 -- 172.21.15.35:0/551574298 learned_addr learned my addr 172.21.15.35:0/551574298 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 -- 172.21.15.35:0/551574298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 msgr2=0x560a75b0d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b0d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 -- 172.21.15.35:0/551574298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 msgr2=0x560a75b0ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b0ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 -- 172.21.15.35:0/551574298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f410ff30 con 0x560a75b04960 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fab0a700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b0ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52f9b08700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b0d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:41:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52fa309700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b10480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52f00097c0 tx=0x7f52f00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f8604a2b158e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.167+0000 7f52ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:41:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f52ddffb700 1 -- 172.21.15.35:0/551574298 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0022070 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a75a19390 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f52ddffb700 1 -- 172.21.15.35:0/551574298 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f52f001d620 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f52ddffb700 1 -- 172.21.15.35:0/551574298 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52f0004580 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f53086fab80 10 client.26672 fetch_fsmap learned FSMap version 33 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x560a75884d80 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f52ddffb700 1 -- 172.21.15.35:0/551574298 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a75a19390 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f52ddffb700 1 -- 172.21.15.35:0/551574298 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f52f0027850 con 0x560a75b04960 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f53086fab80 10 client.26672 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.168+0000 7f53086fab80 10 client.26672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f53086fab80 20 client.26672 populate_metadata read hostname 'smithi035' 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f53086fab80 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b1e1f0 0x560a75b20600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f53086fab80 4 client.26672 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:41:21.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a75a25600 con 0x560a75b1e1f0 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f52f9b08700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b1e1f0 0x560a75b20600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f52ddffb700 10 client.26672 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.169+0000 7f52f9b08700 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b1e1f0 0x560a75b20600 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c64306f99c0c628 server_cookie=7176c61b93b71314 in_seq=0 out_seq=0 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f52ddffb700 1 -- 172.21.15.35:0/551574298 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560a75a25600 con 0x560a75b1e1f0 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f52ddffb700 10 client.26672 handle_command_reply: tid=0 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 client.26672 shutdown 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 msgr2=0x560a75b10480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:21.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b10480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f52f00097c0 tx=0x7f52f00047c0 comp rx=0 tx=0).stop 2023-03-17T09:41:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 shutdown_connections 2023-03-17T09:41:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b1e1f0 0x560a75b20600 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b0ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f52ddffb700 0 client.26672 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b10480 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 --2- 172.21.15.35:0/551574298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b0d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 >> 172.21.15.35:0/551574298 conn(0x560a759616b0 msgr2=0x560a75b03410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 shutdown_connections 2023-03-17T09:41:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 1 -- 172.21.15.35:0/551574298 wait complete. 2023-03-17T09:41:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.170+0000 7f53086fab80 20 client.26672 trim_cache size 0 max 16384 2023-03-17T09:41:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.185+0000 7f53086fab80 1 Processor -- start 2023-03-17T09:41:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.185+0000 7f53086fab80 1 -- start start 2023-03-17T09:41:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.185+0000 7f53086fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b14f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.185+0000 7f53086fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b10020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.185+0000 7f53086fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f53086fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b003d0 con 0x560a75b0a4f0 2023-03-17T09:41:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f53086fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75afbb60 con 0x560a75b04960 2023-03-17T09:41:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f53086fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b00590 con 0x560a75b09be0 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b076b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46352/0 (socket says 172.21.15.35:46352) 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 -- 172.21.15.35:0/3004724662 learned_addr learned my addr 172.21.15.35:0/3004724662 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fa309700 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b14f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52f9b08700 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b10020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 -- 172.21.15.35:0/3004724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 msgr2=0x560a75b10020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b10020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 -- 172.21.15.35:0/3004724662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 msgr2=0x560a75b14f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b14f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 -- 172.21.15.35:0/3004724662 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a75a1d130 con 0x560a75b0a4f0 2023-03-17T09:41:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fa309700 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b14f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:41:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52fab0a700 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b076b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f52ec097880 tx=0x7f52ec007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da4f75efc478bb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52e97fa700 1 -- 172.21.15.35:0/3004724662 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0978f0 con 0x560a75b0a4f0 2023-03-17T09:41:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52e97fa700 1 -- 172.21.15.35:0/3004724662 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52ec0c7320 con 0x560a75b0a4f0 2023-03-17T09:41:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.186+0000 7f52e97fa700 1 -- 172.21.15.35:0/3004724662 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0c7850 con 0x560a75b0a4f0 2023-03-17T09:41:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 -- 172.21.15.35:0/3004724662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 msgr2=0x560a75b076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b076b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f52ec097880 tx=0x7f52ec007e60 comp rx=0 tx=0).stop 2023-03-17T09:41:30.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 -- 172.21.15.35:0/3004724662 shutdown_connections 2023-03-17T09:41:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b0a4f0 0x560a75b076b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b14f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 --2- 172.21.15.35:0/3004724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b09be0 0x560a75b10020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 -- 172.21.15.35:0/3004724662 >> 172.21.15.35:0/3004724662 conn(0x560a759616b0 msgr2=0x560a75b03410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 -- 172.21.15.35:0/3004724662 shutdown_connections 2023-03-17T09:41:30.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 -- 172.21.15.35:0/3004724662 wait complete. 2023-03-17T09:41:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.187+0000 7f53086fab80 1 -- start start 2023-03-17T09:41:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 Processor -- start 2023-03-17T09:41:30.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b13120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 0x560a75b13660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b0a4f0 0x560a75b71050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b13df0 con 0x560a75b09be0 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b715c0 con 0x560a75b04960 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a75b71780 con 0x560a75b0a4f0 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f53086fab80 10 client.0 _ll_register_callbacks cb 0x560a758fc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 0x560a75b13660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 0x560a75b13660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46356/0 (socket says 172.21.15.35:46356) 2023-03-17T09:41:30.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 -- 172.21.15.35:0/2071778560 learned_addr learned my addr 172.21.15.35:0/2071778560 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52fa309700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b13120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52fab0a700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b0a4f0 0x560a75b71050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 -- 172.21.15.35:0/2071778560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b0a4f0 msgr2=0x560a75b71050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b0a4f0 0x560a75b71050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 -- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 msgr2=0x560a75b13120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b13120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.188+0000 7f52f9b08700 1 -- 172.21.15.35:0/2071778560 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a75884d80 con 0x560a75b09be0 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52f9b08700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 0x560a75b13660 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009350 tx=0x7f52e40284f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9df0a821cf934e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:30.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:41:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52ddffb700 1 -- 172.21.15.35:0/2071778560 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4020040 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52ddffb700 1 -- 172.21.15.35:0/2071778560 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f52e4028c30 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a75ad41e0 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52ddffb700 1 -- 172.21.15.35:0/2071778560 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52e4028df0 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 10 client.17109 fetch_fsmap learned FSMap version 33 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x560a758d85d0 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52ddffb700 1 -- 172.21.15.35:0/2071778560 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a75ad41e0 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f52ddffb700 1 -- 172.21.15.35:0/2071778560 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 33) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f52e4039440 con 0x560a75b09be0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 10 client.17109 fetch_fsmap finished waiting for FSMap version 33 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 20 client.17109 populate_metadata read hostname 'smithi035' 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b72ed0 0x560a75b752e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 4 client.17109 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.189+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a758daf00 con 0x560a75b72ed0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.190+0000 7f52fa309700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b72ed0 0x560a75b752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.190+0000 7f52ddffb700 10 client.17109 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:01.190+0000 7f52fa309700 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b72ed0 0x560a75b752e0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85ec01fa7b66180 server_cookie=2ff7fd0ac42c7aaf in_seq=0 out_seq=0 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.245+0000 7f52ddffb700 1 -- 172.21.15.35:0/2071778560 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a758daf00 con 0x560a75b72ed0 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.245+0000 7f52ddffb700 10 client.17109 handle_command_reply: tid=0 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.245+0000 7f53086fab80 1 client.17109 shutdown 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 msgr2=0x560a75b13660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 0x560a75b13660 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009350 tx=0x7f52e40284f0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 shutdown_connections 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a75b72ed0 0x560a75b752e0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a75b0a4f0 0x560a75b71050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52ddffb700 0 client.17109 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a75b04960 0x560a75b13120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 --2- 172.21.15.35:0/2071778560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a75b09be0 0x560a75b13660 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 >> 172.21.15.35:0/2071778560 conn(0x560a759616b0 msgr2=0x560a75b076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 shutdown_connections 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 1 -- 172.21.15.35:0/2071778560 wait complete. 2023-03-17T09:41:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f53086fab80 20 client.17109 trim_cache size 0 max 16384 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f52e009f640 msgr2=0x7f52e00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f52e009f640 0x7f52e00a1af0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009c60 tx=0x7f52f0009260 comp rx=0 tx=0).stop 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 msgr2=0x7f52f419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 0x7f52f419ab70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f52ec007ee0 tx=0x7f52ec00d3b0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 shutdown_connections 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f52e009f640 0x7f52e00a1af0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f52f410a7a0 0x7f52f419ab70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.246+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f41013d0 0x7f52f41961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.247+0000 7f52fc56d700 1 --2- 172.21.15.35:0/3654217478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4101ce0 0x7f52f4196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.247+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 >> 172.21.15.35:0/3654217478 conn(0x7f52f4076330 msgr2=0x7f52f40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.247+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 shutdown_connections 2023-03-17T09:41:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:03.247+0000 7f52fc56d700 1 -- 172.21.15.35:0/3654217478 wait complete. 2023-03-17T09:41:31.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:24 smithi035 ceph-mon[92535]: pgmap v1477: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:41:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 -- 172.21.15.35:0/1064363401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe53006aad0 msgr2=0x7fe53006af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 --2- 172.21.15.35:0/1064363401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe53006aad0 0x7fe53006af40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe52400aaa0 tx=0x7fe52400adb0 comp rx=0 tx=0).stop 2023-03-17T09:41:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 -- 172.21.15.35:0/1064363401 shutdown_connections 2023-03-17T09:41:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 --2- 172.21.15.35:0/1064363401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530111780 0x7fe530113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 --2- 172.21.15.35:0/1064363401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe530072720 0x7fe53006a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 --2- 172.21.15.35:0/1064363401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe53006aad0 0x7fe53006af40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 -- 172.21.15.35:0/1064363401 >> 172.21.15.35:0/1064363401 conn(0x7fe5300757a0 msgr2=0x7fe530075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:34.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 -- 172.21.15.35:0/1064363401 shutdown_connections 2023-03-17T09:41:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 -- 172.21.15.35:0/1064363401 wait complete. 2023-03-17T09:41:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.414+0000 7fe535e9a700 1 Processor -- start 2023-03-17T09:41:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 -- start start 2023-03-17T09:41:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 0x7fe5301a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530072720 0x7fe5301a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe530111780 0x7fe53019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53019f0b0 con 0x7fe530111780 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53019f220 con 0x7fe530072720 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe535e9a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53019f3e0 con 0x7fe53006aad0 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 0x7fe5301a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe52ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe530111780 0x7fe53019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 0x7fe5301a49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:38134/0 (socket says 172.21.15.35:38134) 2023-03-17T09:41:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe52f7fe700 1 -- 172.21.15.35:0/2220488873 learned_addr learned my addr 172.21.15.35:0/2220488873 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.415+0000 7fe52effd700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530072720 0x7fe5301a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52ffff700 1 -- 172.21.15.35:0/2220488873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 msgr2=0x7fe5301a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52ffff700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 0x7fe5301a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52ffff700 1 -- 172.21.15.35:0/2220488873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530072720 msgr2=0x7fe5301a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52ffff700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530072720 0x7fe5301a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52ffff700 1 -- 172.21.15.35:0/2220488873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52400a700 con 0x7fe530111780 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 0x7fe5301a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52effd700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530072720 0x7fe5301a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52ffff700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe530111780 0x7fe53019ea40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe530073010 tx=0x7fe528009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52cff9700 1 -- 172.21.15.35:0/2220488873 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800cb30 con 0x7fe530111780 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe530116760 con 0x7fe530111780 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe52cff9700 1 -- 172.21.15.35:0/2220488873 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe52800cc90 con 0x7fe530111780 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.416+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5301165d0 con 0x7fe530111780 2023-03-17T09:41:37.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.418+0000 7fe52cff9700 1 -- 172.21.15.35:0/2220488873 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280125a0 con 0x7fe530111780 2023-03-17T09:41:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.420+0000 7fe52cff9700 1 -- 172.21.15.35:0/2220488873 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe5280127c0 con 0x7fe530111780 2023-03-17T09:41:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.420+0000 7fe52cff9700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe51809f6c0 0x7fe5180a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.421+0000 7fe52cff9700 1 -- 172.21.15.35:0/2220488873 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fe528006e40 con 0x7fe530111780 2023-03-17T09:41:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.421+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe51809f6c0 0x7fe5180a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.421+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe51809f6c0 0x7fe5180a1b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe520011550 tx=0x7fe520009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.421+0000 7fe542027b80 1 Processor -- start 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.421+0000 7fe542027b80 1 -- start start 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe542027b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952ced690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe542027b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe542027b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe542027b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952be6010 con 0x559952cec590 2023-03-17T09:41:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe542027b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952c38950 con 0x559952cedbd0 2023-03-17T09:41:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe542027b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952c31de0 con 0x559952ced2c0 2023-03-17T09:41:38.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:38.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cec9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46378/0 (socket says 172.21.15.35:46378) 2023-03-17T09:41:38.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52ffff700 1 -- 172.21.15.35:0/3810928134 learned_addr learned my addr 172.21.15.35:0/3810928134 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:38.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952ced690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52effd700 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3810928134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 msgr2=0x559952cec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cec050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:38.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3810928134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 msgr2=0x559952cec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3810928134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559952ab35d0 con 0x559952ced2c0 2023-03-17T09:41:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.422+0000 7fe52ffff700 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:41:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.423+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952ced690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe520011ca0 tx=0x7fe520014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b010b1296f9b2e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.423+0000 7fe515ffb700 1 -- 172.21.15.35:0/3810928134 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520004830 con 0x559952ced2c0 2023-03-17T09:41:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.423+0000 7fe515ffb700 1 -- 172.21.15.35:0/3810928134 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe520021070 con 0x559952ced2c0 2023-03-17T09:41:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.423+0000 7fe515ffb700 1 -- 172.21.15.35:0/3810928134 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52001c670 con 0x559952ced2c0 2023-03-17T09:41:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 -- 172.21.15.35:0/3810928134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 msgr2=0x559952ced690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952ced690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe520011ca0 tx=0x7fe520014000 comp rx=0 tx=0).stop 2023-03-17T09:41:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 -- 172.21.15.35:0/3810928134 shutdown_connections 2023-03-17T09:41:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952ced690 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 --2- 172.21.15.35:0/3810928134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 -- 172.21.15.35:0/3810928134 >> 172.21.15.35:0/3810928134 conn(0x559952b3c6b0 msgr2=0x559952cd9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 -- 172.21.15.35:0/3810928134 shutdown_connections 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 -- 172.21.15.35:0/3810928134 wait complete. 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.424+0000 7fe542027b80 1 -- start start 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 Processor -- start 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952ced2c0 0x559952cf0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:45.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cedbd0 0x559952cf1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952ab58c0 con 0x559952cec590 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cf1e60 con 0x559952ced2c0 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cfd870 con 0x559952cedbd0 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe542027b80 10 client.0 _ll_register_callbacks cb 0x559952ad7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46382/0 (socket says 172.21.15.35:46382) 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.425+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3239144475 learned_addr learned my addr 172.21.15.35:0/3239144475 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:45.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52effd700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952ced2c0 0x559952cf0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3239144475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cedbd0 msgr2=0x559952cf1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52ffff700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cedbd0 0x559952cf1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cedbd0 0x559952cf1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952ced2c0 msgr2=0x559952cf0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952ced2c0 0x559952cf0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52f7fe700 1 -- 172.21.15.35:0/3239144475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe520017070 con 0x559952cec590 2023-03-17T09:41:45.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52effd700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952ced2c0 0x559952cf0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:41:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52ffff700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cedbd0 0x559952cf1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:41:45.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf3d60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe520005570 tx=0x7fe520005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b290dbbbbe744fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe50effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:41:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe50effd700 1 -- 172.21.15.35:0/3239144475 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520026890 con 0x559952cec590 2023-03-17T09:41:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe50effd700 1 -- 172.21.15.35:0/3239144475 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fe5200269f0 con 0x559952cec590 2023-03-17T09:41:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559952bf4390 con 0x559952cec590 2023-03-17T09:41:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe50effd700 1 -- 172.21.15.35:0/3239144475 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe520026bb0 con 0x559952cec590 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe542027b80 10 client.17127 fetch_fsmap learned FSMap version 35 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.426+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559952a5fd80 con 0x559952cec590 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe50effd700 1 -- 172.21.15.35:0/3239144475 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559952bf4390 con 0x559952cec590 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe50effd700 1 -- 172.21.15.35:0/3239144475 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe52002d030 con 0x559952cec590 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe542027b80 10 client.17127 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe542027b80 10 client.17127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe542027b80 20 client.17127 populate_metadata read hostname 'smithi035' 2023-03-17T09:41:48.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe542027b80 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d018f0 0x559952d03d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe542027b80 4 client.17127 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559952c00600 con 0x559952d018f0 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.427+0000 7fe52effd700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d018f0 0x559952d03d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.428+0000 7fe50effd700 10 client.17127 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.428+0000 7fe52effd700 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d018f0 0x559952d03d00 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5216a50ed103be23 server_cookie=8f0c62432fdf0ea4 in_seq=0 out_seq=0 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.428+0000 7fe50effd700 1 -- 172.21.15.35:0/3239144475 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559952c00600 con 0x559952d018f0 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.428+0000 7fe50effd700 10 client.17127 handle_command_reply: tid=0 2023-03-17T09:41:48.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.428+0000 7fe542027b80 1 client.17127 shutdown 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 msgr2=0x559952cf3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf3d60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe520005570 tx=0x7fe520005650 comp rx=0 tx=0).stop 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 shutdown_connections 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d018f0 0x559952d03d00 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cedbd0 0x559952cf1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf3d60 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 --2- 172.21.15.35:0/3239144475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952ced2c0 0x559952cf0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 >> 172.21.15.35:0/3239144475 conn(0x559952b3c6b0 msgr2=0x559952cde410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe50effd700 0 client.17127 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 shutdown_connections 2023-03-17T09:41:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 1 -- 172.21.15.35:0/3239144475 wait complete. 2023-03-17T09:41:48.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.429+0000 7fe542027b80 20 client.17127 trim_cache size 0 max 16384 2023-03-17T09:41:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 Processor -- start 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 -- start start 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cec590 0x559952cf87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 0x559952cd9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cdfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cda320 con 0x559952ced2c0 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cece00 con 0x559952cedbd0 2023-03-17T09:41:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe542027b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cef590 con 0x559952cec590 2023-03-17T09:41:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe52effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 0x559952cd9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe52effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 0x559952cd9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46390/0 (socket says 172.21.15.35:46390) 2023-03-17T09:41:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe52effd700 1 -- 172.21.15.35:0/1339587795 learned_addr learned my addr 172.21.15.35:0/1339587795 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe52ffff700 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cdfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.458+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cec590 0x559952cf87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52effd700 1 -- 172.21.15.35:0/1339587795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cec590 msgr2=0x559952cf87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52effd700 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cec590 0x559952cf87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52effd700 1 -- 172.21.15.35:0/1339587795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 msgr2=0x559952cdfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52effd700 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cdfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52effd700 1 -- 172.21.15.35:0/1339587795 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559952bf8130 con 0x559952ced2c0 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cec590 0x559952cf87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe52effd700 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 0x559952cd9ac0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe524016000 tx=0x7fe524005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135c9495f8cccfe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe5167fc700 1 -- 172.21.15.35:0/1339587795 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524028300 con 0x559952ced2c0 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe5167fc700 1 -- 172.21.15.35:0/1339587795 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe524028460 con 0x559952ced2c0 2023-03-17T09:41:50.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.459+0000 7fe5167fc700 1 -- 172.21.15.35:0/1339587795 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524028ca0 con 0x559952ced2c0 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 -- 172.21.15.35:0/1339587795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 msgr2=0x559952cd9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 0x559952cd9ac0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe524016000 tx=0x7fe524005fb0 comp rx=0 tx=0).stop 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 -- 172.21.15.35:0/1339587795 shutdown_connections 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cdfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952cec590 0x559952cf87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 --2- 172.21.15.35:0/1339587795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952ced2c0 0x559952cd9ac0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 -- 172.21.15.35:0/1339587795 >> 172.21.15.35:0/1339587795 conn(0x559952b3c6b0 msgr2=0x559952d03900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:41:50.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 -- 172.21.15.35:0/1339587795 shutdown_connections 2023-03-17T09:41:50.444 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:41:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.460+0000 7fe542027b80 1 -- 172.21.15.35:0/1339587795 wait complete. 2023-03-17T09:41:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 -- start start 2023-03-17T09:41:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 Processor -- start 2023-03-17T09:41:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952cf0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cefd20 con 0x559952cec590 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cefe90 con 0x559952cedbd0 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559952cf0050 con 0x559952ced2c0 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.461+0000 7fe542027b80 10 client.0 _ll_register_callbacks cb 0x559952ad7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952cf0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952cf0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:38162/0 (socket says 172.21.15.35:38162) 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 -- 172.21.15.35:0/3550066164 learned_addr learned my addr 172.21.15.35:0/3550066164 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52ffff700 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:53.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 -- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 msgr2=0x559952cef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cef7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 -- 172.21.15.35:0/3550066164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 msgr2=0x559952cf0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:41:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:41:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 -- 172.21.15.35:0/3550066164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52401a040 con 0x559952ced2c0 2023-03-17T09:41:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe52effd700 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952cf0da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe52400adf0 tx=0x7fe524028300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816aad067f62a7ac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:41:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe50effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T09:41:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe50effd700 1 -- 172.21.15.35:0/3550066164 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240285d0 con 0x559952ced2c0 2023-03-17T09:41:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe50effd700 1 -- 172.21.15.35:0/3550066164 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fe524012070 con 0x559952ced2c0 2023-03-17T09:41:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.462+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559952caf1e0 con 0x559952ced2c0 2023-03-17T09:41:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe50effd700 1 -- 172.21.15.35:0/3550066164 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5240050c0 con 0x559952ced2c0 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 10 client.26722 fetch_fsmap learned FSMap version 35 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x559952a861f0 con 0x559952ced2c0 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe50effd700 1 -- 172.21.15.35:0/3550066164 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559952caf1e0 con 0x559952ced2c0 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe50effd700 1 -- 172.21.15.35:0/3550066164 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe52400ec90 con 0x559952ced2c0 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 10 client.26722 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 10 client.26722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 20 client.26722 populate_metadata read hostname 'smithi035' 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d56180 0x559952d58590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:41:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 4 client.26722 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:41:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559952ab5f00 con 0x559952d56180 2023-03-17T09:41:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.463+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d56180 0x559952d58590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:41:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.464+0000 7fe50effd700 10 client.26722 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:41:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.464+0000 7fe52f7fe700 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d56180 0x559952d58590 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b875d0df9d7267 server_cookie=b002ba524624d515 in_seq=0 out_seq=0 2023-03-17T09:41:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.471+0000 7fe50effd700 1 -- 172.21.15.35:0/3550066164 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559952ab5f00 con 0x559952d56180 2023-03-17T09:41:58.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.471+0000 7fe50effd700 10 client.26722 handle_command_reply: tid=0 2023-03-17T09:41:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.471+0000 7fe542027b80 1 client.26722 shutdown 2023-03-17T09:42:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 msgr2=0x559952cf0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952cf0da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe52400adf0 tx=0x7fe524028300 comp rx=0 tx=0).stop 2023-03-17T09:42:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 shutdown_connections 2023-03-17T09:42:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559952d56180 0x559952d58590 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559952cedbd0 0x559952cef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559952cec590 0x559952cf0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe50effd700 0 client.26722 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 --2- 172.21.15.35:0/3550066164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559952ced2c0 0x559952cf0da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 >> 172.21.15.35:0/3550066164 conn(0x559952b3c6b0 msgr2=0x559952cea670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 shutdown_connections 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 1 -- 172.21.15.35:0/3550066164 wait complete. 2023-03-17T09:42:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe542027b80 20 client.26722 trim_cache size 0 max 16384 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe51809f6c0 msgr2=0x7fe5180a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe535e9a700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe51809f6c0 0x7fe5180a1b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe520011550 tx=0x7fe520009260 comp rx=0 tx=0).stop 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe530111780 msgr2=0x7fe53019ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.472+0000 7fe535e9a700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe530111780 0x7fe53019ea40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe530073010 tx=0x7fe528009ed0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 shutdown_connections 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe51809f6c0 0x7fe5180a1b70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe530111780 0x7fe53019ea40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe53006aad0 0x7fe5301a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 --2- 172.21.15.35:0/2220488873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530072720 0x7fe5301a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 >> 172.21.15.35:0/2220488873 conn(0x7fe5300757a0 msgr2=0x7fe5300fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 shutdown_connections 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:19:16.473+0000 7fe535e9a700 1 -- 172.21.15.35:0/2220488873 wait complete. 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 -- 172.21.15.35:0/2487670148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 msgr2=0x7f64e4105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 --2- 172.21.15.35:0/2487670148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e4105510 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f64d40099c0 tx=0x7f64d4009cd0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 -- 172.21.15.35:0/2487670148 shutdown_connections 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 --2- 172.21.15.35:0/2487670148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64e4101320 0x7f64e410cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 --2- 172.21.15.35:0/2487670148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e4105510 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 --2- 172.21.15.35:0/2487670148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64e4100970 0x7f64e4100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.291+0000 7f64e9572700 1 -- 172.21.15.35:0/2487670148 >> 172.21.15.35:0/2487670148 conn(0x7f64e40774c0 msgr2=0x7f64e40778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.292+0000 7f64e9572700 1 -- 172.21.15.35:0/2487670148 shutdown_connections 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.292+0000 7f64e9572700 1 -- 172.21.15.35:0/2487670148 wait complete. 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.292+0000 7f64e9572700 1 Processor -- start 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.292+0000 7f64e9572700 1 -- start start 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e9572700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64e4100970 0x7f64e4196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e9572700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64e4101320 0x7f64e4196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e9572700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e9572700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e419b220 con 0x7f64e4105140 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e9572700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e419b390 con 0x7f64e4101320 2023-03-17T09:42:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e9572700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e419b550 con 0x7f64e4100970 2023-03-17T09:42:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46412/0 (socket says 172.21.15.35:46412) 2023-03-17T09:42:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 -- 172.21.15.35:0/3446326520 learned_addr learned my addr 172.21.15.35:0/3446326520 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64e4100970 0x7f64e4196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e27fc700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64e4101320 0x7f64e4196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 -- 172.21.15.35:0/3446326520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64e4100970 msgr2=0x7f64e4196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64e4100970 0x7f64e4196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 -- 172.21.15.35:0/3446326520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64e4101320 msgr2=0x7f64e4196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64e4101320 0x7f64e4196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 -- 172.21.15.35:0/3446326520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40095f0 con 0x7f64e4105140 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64e37fe700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e419abe0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f64dc007ee0 tx=0x7f64dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64cbfff700 1 -- 172.21.15.35:0/3446326520 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc017070 con 0x7f64e4105140 2023-03-17T09:42:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64cbfff700 1 -- 172.21.15.35:0/3446326520 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64dc00f040 con 0x7f64e4105140 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.293+0000 7f64cbfff700 1 -- 172.21.15.35:0/3446326520 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc005710 con 0x7f64e4105140 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.294+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e4110180 con 0x7f64e4105140 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.294+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e410fff0 con 0x7f64e4105140 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.296+0000 7f64cbfff700 1 -- 172.21.15.35:0/3446326520 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f64dc005870 con 0x7f64e4105140 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.296+0000 7f64cbfff700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f64cc09f640 0x7f64cc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.296+0000 7f64cbfff700 1 -- 172.21.15.35:0/3446326520 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f64dc0c9e00 con 0x7f64e4105140 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.296+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f64cc09f640 0x7f64cc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.297+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f64cc09f640 0x7f64cc0a1af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b580 tx=0x7f64d4009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.297+0000 7f64f56ffb80 1 Processor -- start 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.297+0000 7f64f56ffb80 1 -- start start 2023-03-17T09:42:13.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:13.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:13.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 0x55ee1e0c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:14.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1dfc8010 con 0x55ee1e0c1960 2023-03-17T09:42:14.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e01a950 con 0x55ee1e0c74f0 2023-03-17T09:42:14.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e013de0 con 0x55ee1e0c6be0 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 0x55ee1e0c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 0x55ee1e0c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46420/0 (socket says 172.21.15.35:46420) 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 -- 172.21.15.35:0/1123478843 learned_addr learned my addr 172.21.15.35:0/1123478843 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e27fc700 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 -- 172.21.15.35:0/1123478843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 msgr2=0x55ee1e0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 -- 172.21.15.35:0/1123478843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c74f0 msgr2=0x55ee1e0c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 -- 172.21.15.35:0/1123478843 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1de955d0 con 0x55ee1e0c1960 2023-03-17T09:42:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e27fc700 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:42:17.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64e37fe700 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 0x55ee1e0c1d90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f64dc097840 tx=0x7f64dc097470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cbef37265dfea3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64c97fa700 1 -- 172.21.15.35:0/1123478843 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0978b0 con 0x55ee1e0c1960 2023-03-17T09:42:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64c97fa700 1 -- 172.21.15.35:0/1123478843 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64dc09faa0 con 0x55ee1e0c1960 2023-03-17T09:42:17.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.298+0000 7f64c97fa700 1 -- 172.21.15.35:0/1123478843 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc097d50 con 0x55ee1e0c1960 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 -- 172.21.15.35:0/1123478843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 msgr2=0x55ee1e0c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 0x55ee1e0c1d90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f64dc097840 tx=0x7f64dc097470 comp rx=0 tx=0).stop 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 -- 172.21.15.35:0/1123478843 shutdown_connections 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c1960 0x55ee1e0c1d90 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/1123478843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 -- 172.21.15.35:0/1123478843 >> 172.21.15.35:0/1123478843 conn(0x55ee1df1e6b0 msgr2=0x55ee1e0bba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 -- 172.21.15.35:0/1123478843 shutdown_connections 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 -- 172.21.15.35:0/1123478843 wait complete. 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.299+0000 7f64f56ffb80 1 -- start start 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 Processor -- start 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c1960 0x55ee1e0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1de978c0 con 0x55ee1e0c74f0 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e0cb4d0 con 0x55ee1e0c1960 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e0d6fa0 con 0x55ee1e0c6be0 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64f56ffb80 10 client.0 _ll_register_callbacks cb 0x55ee1deb9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46426/0 (socket says 172.21.15.35:46426) 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64e37fe700 1 -- 172.21.15.35:0/3410772976 learned_addr learned my addr 172.21.15.35:0/3410772976 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c1960 0x55ee1e0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.300+0000 7f64e27fc700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64e37fe700 1 -- 172.21.15.35:0/3410772976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 msgr2=0x55ee1e0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64e37fe700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64e37fe700 1 -- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c1960 msgr2=0x55ee1e0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64e37fe700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c1960 0x55ee1e0cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64e37fe700 1 -- 172.21.15.35:0/3410772976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e410fff0 con 0x55ee1e0c74f0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64e37fe700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0cad60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f64dc094320 tx=0x7f64dc0941d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c546a4ca2cde909 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64c6ff5700 1 -- 172.21.15.35:0/3410772976 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0978b0 con 0x55ee1e0c74f0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64c6ff5700 1 -- 172.21.15.35:0/3410772976 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f64dc096fb0 con 0x55ee1e0c74f0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1dfd6390 con 0x55ee1e0c74f0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64c6ff5700 1 -- 172.21.15.35:0/3410772976 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64dc0c70d0 con 0x55ee1e0c74f0 2023-03-17T09:42:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64f56ffb80 10 client.17142 fetch_fsmap learned FSMap version 35 2023-03-17T09:42:22.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:26 smithi035 ceph-mon[92535]: pgmap v1478: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:42:24.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:42:24.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:42:24.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:42:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ee1de41d80 con 0x55ee1e0c74f0 2023-03-17T09:42:24.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64c6ff5700 1 -- 172.21.15.35:0/3410772976 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee1dfd6390 con 0x55ee1e0c74f0 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64c6ff5700 1 -- 172.21.15.35:0/3410772976 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64dc09f610 con 0x55ee1e0c74f0 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64f56ffb80 10 client.17142 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.301+0000 7f64f56ffb80 10 client.17142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64f56ffb80 20 client.17142 populate_metadata read hostname 'smithi035' 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e0dad20 0x55ee1e0dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64f56ffb80 4 client.17142 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:42:25.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee1dfe2600 con 0x55ee1e0dad20 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e0dad20 0x55ee1e0dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e0dad20 0x55ee1e0dd130 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ab5efd0924fc34a server_cookie=70562ea592c9e7d0 in_seq=0 out_seq=0 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.302+0000 7f64c6ff5700 10 client.17142 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64c6ff5700 1 -- 172.21.15.35:0/3410772976 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ee1dfe2600 con 0x55ee1e0dad20 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64c6ff5700 10 client.17142 handle_command_reply: tid=0 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 client.17142 shutdown 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 msgr2=0x55ee1e0cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:25.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0cad60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f64dc094320 tx=0x7f64dc0941d0 comp rx=0 tx=0).stop 2023-03-17T09:42:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 shutdown_connections 2023-03-17T09:42:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e0dad20 0x55ee1e0dd130 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:25.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0cad60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c1960 0x55ee1e0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64c6ff5700 0 client.17142 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/3410772976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 >> 172.21.15.35:0/3410772976 conn(0x55ee1df1e6b0 msgr2=0x55ee1e0c0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 shutdown_connections 2023-03-17T09:42:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 1 -- 172.21.15.35:0/3410772976 wait complete. 2023-03-17T09:42:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.303+0000 7f64f56ffb80 20 client.17142 trim_cache size 0 max 16384 2023-03-17T09:42:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.318+0000 7f64f56ffb80 1 Processor -- start 2023-03-17T09:42:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.318+0000 7f64f56ffb80 1 -- start start 2023-03-17T09:42:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e0bc530 con 0x55ee1e0c74f0 2023-03-17T09:42:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e0bc380 con 0x55ee1e0c6be0 2023-03-17T09:42:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e0b7100 con 0x55ee1e0c1960 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46434/0 (socket says 172.21.15.35:46434) 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 -- 172.21.15.35:0/2427757108 learned_addr learned my addr 172.21.15.35:0/2427757108 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e27fc700 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 -- 172.21.15.35:0/2427757108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 msgr2=0x55ee1e0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 -- 172.21.15.35:0/2427757108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 msgr2=0x55ee1e0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 -- 172.21.15.35:0/2427757108 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1e0c2020 con 0x55ee1e0c74f0 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64e37fe700 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c5830 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f64dc095c00 tx=0x7f64dc097730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602f682a103d7b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.319+0000 7f64c9ffb700 1 -- 172.21.15.35:0/2427757108 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc093bf0 con 0x55ee1e0c74f0 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64c9ffb700 1 -- 172.21.15.35:0/2427757108 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64dc096fb0 con 0x55ee1e0c74f0 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64c9ffb700 1 -- 172.21.15.35:0/2427757108 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc097b10 con 0x55ee1e0c74f0 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2427757108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 msgr2=0x55ee1e0c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c5830 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f64dc095c00 tx=0x7f64dc097730 comp rx=0 tx=0).stop 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2427757108 shutdown_connections 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e0c5830 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2427757108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2427757108 >> 172.21.15.35:0/2427757108 conn(0x55ee1df1e6b0 msgr2=0x55ee1e0d72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2427757108 shutdown_connections 2023-03-17T09:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2427757108 wait complete. 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.320+0000 7f64f56ffb80 1 -- start start 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 Processor -- start 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e127040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e127580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e122b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e123210 con 0x55ee1e0c74f0 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e123380 con 0x55ee1e0c6be0 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1e123540 con 0x55ee1e0c1960 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64f56ffb80 10 client.0 _ll_register_callbacks cb 0x55ee1deb9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e122b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46440/0 (socket says 172.21.15.35:46440) 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 -- 172.21.15.35:0/2771137457 learned_addr learned my addr 172.21.15.35:0/2771137457 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e27fc700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e127580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 -- 172.21.15.35:0/2771137457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 msgr2=0x55ee1e127040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e127040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 -- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 msgr2=0x55ee1e127580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e127580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 -- 172.21.15.35:0/2771137457 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee1de41d80 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64e37fe700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e122b10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00ddf0 tx=0x7f64dc097520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104595154f676b0f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.321+0000 7f64c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64c6ff5700 1 -- 172.21.15.35:0/2771137457 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0c70d0 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64c6ff5700 1 -- 172.21.15.35:0/2771137457 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f64dc0c7230 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1e0911e0 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64c6ff5700 1 -- 172.21.15.35:0/2771137457 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64dc097b10 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 10 client.17148 fetch_fsmap learned FSMap version 35 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ee1de2ac00 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64c6ff5700 1 -- 172.21.15.35:0/2771137457 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee1e0911e0 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64c6ff5700 1 -- 172.21.15.35:0/2771137457 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64dc098690 con 0x55ee1e0c74f0 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 10 client.17148 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 10 client.17148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 20 client.17148 populate_metadata read hostname 'smithi035' 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e12fa80 0x55ee1e131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 4 client.17148 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:42:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee1de97f00 con 0x55ee1e12fa80 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.322+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e12fa80 0x55ee1e131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.323+0000 7f64e2ffd700 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e12fa80 0x55ee1e131e60 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221fb4019647733c server_cookie=4f60424d33c1e946 in_seq=0 out_seq=0 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.323+0000 7f64c6ff5700 10 client.17148 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.331+0000 7f64c6ff5700 1 -- 172.21.15.35:0/2771137457 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee1de97f00 con 0x55ee1e12fa80 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.331+0000 7f64c6ff5700 10 client.17148 handle_command_reply: tid=0 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.331+0000 7f64f56ffb80 1 client.17148 shutdown 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 msgr2=0x55ee1e122b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e122b10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00ddf0 tx=0x7f64dc097520 comp rx=0 tx=0).stop 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 shutdown_connections 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee1e12fa80 0x55ee1e131e60 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee1e0c74f0 0x55ee1e122b10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64c6ff5700 0 client.17148 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee1e0c1960 0x55ee1e127040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 --2- 172.21.15.35:0/2771137457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee1e0c6be0 0x55ee1e127580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 >> 172.21.15.35:0/2771137457 conn(0x55ee1df1e6b0 msgr2=0x55ee1e0c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 shutdown_connections 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 1 -- 172.21.15.35:0/2771137457 wait complete. 2023-03-17T09:42:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64f56ffb80 20 client.17148 trim_cache size 0 max 16384 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f64cc09f640 msgr2=0x7f64cc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f64cc09f640 0x7f64cc0a1af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b580 tx=0x7f64d4009f10 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 msgr2=0x7f64e419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e419abe0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f64dc007ee0 tx=0x7f64dc00d3b0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 shutdown_connections 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f64cc09f640 0x7f64cc0a1af0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64e4105140 0x7f64e419abe0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64e4100970 0x7f64e4196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 --2- 172.21.15.35:0/3446326520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64e4101320 0x7f64e4196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.332+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 >> 172.21.15.35:0/3446326520 conn(0x7f64e40774c0 msgr2=0x7f64e40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.333+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 shutdown_connections 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:35.333+0000 7f64e9572700 1 -- 172.21.15.35:0/3446326520 wait complete. 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 -- 172.21.15.35:0/3516807538 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd64104390 msgr2=0x7fbd6410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/3516807538 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd64104390 0x7fbd6410bf60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b0d0 tx=0x7fbd5c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 -- 172.21.15.35:0/3516807538 shutdown_connections 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/3516807538 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd64104390 0x7fbd6410bf60 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/3516807538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd640ff350 0x7fbd640ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/3516807538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd640ffcf0 0x7fbd64103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.454+0000 7fbd6b62a700 1 -- 172.21.15.35:0/3516807538 >> 172.21.15.35:0/3516807538 conn(0x7fbd64076330 msgr2=0x7fbd64076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 -- 172.21.15.35:0/3516807538 shutdown_connections 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 -- 172.21.15.35:0/3516807538 wait complete. 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 Processor -- start 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 -- start start 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd640ff350 0x7fbd64195240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 0x7fbd64195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd64104390 0x7fbd64199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6419a220 con 0x7fbd640ffcf0 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6419a390 con 0x7fbd640ff350 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.455+0000 7fbd6b62a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6419a550 con 0x7fbd64104390 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 0x7fbd64195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 0x7fbd64195780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46452/0 (socket says 172.21.15.35:46452) 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 -- 172.21.15.35:0/1200817688 learned_addr learned my addr 172.21.15.35:0/1200817688 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd693c6700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd640ff350 0x7fbd64195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd64104390 0x7fbd64199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 -- 172.21.15.35:0/1200817688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd64104390 msgr2=0x7fbd64199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd64104390 0x7fbd64199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 -- 172.21.15.35:0/1200817688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd640ff350 msgr2=0x7fbd64195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd640ff350 0x7fbd64195240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 -- 172.21.15.35:0/1200817688 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c009d00 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 0x7fbd64195780 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000ea50 tx=0x7fbd6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd5a7fc700 1 -- 172.21.15.35:0/1200817688 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60013070 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6410efc0 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd5a7fc700 1 -- 172.21.15.35:0/1200817688 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd6000be50 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd5a7fc700 1 -- 172.21.15.35:0/1200817688 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017da0 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.456+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6410ee30 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.459+0000 7fbd5a7fc700 1 -- 172.21.15.35:0/1200817688 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbd6000b9c0 con 0x7fbd640ffcf0 2023-03-17T09:42:28.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.459+0000 7fbd5a7fc700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbd5009f640 0x7fbd500a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:28.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.459+0000 7fbd5a7fc700 1 -- 172.21.15.35:0/1200817688 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbd600cba90 con 0x7fbd640ffcf0 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.459+0000 7fbd693c6700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbd5009f640 0x7fbd500a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.460+0000 7fbd693c6700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbd5009f640 0x7fbd500a1af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005950 tx=0x7fbd5400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.460+0000 7fbd777b7b80 1 Processor -- start 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.460+0000 7fbd777b7b80 1 -- start start 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:30.502 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:27 smithi035 ceph-mon[92535]: pgmap v1479: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 490 B/s wr, 10 op/s 2023-03-17T09:42:32.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:27 smithi035 ceph-mon[92535]: pgmap v1480: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 464 B/s wr, 6 op/s 2023-03-17T09:42:32.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:29 smithi035 ceph-mon[92535]: pgmap v1481: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 464 B/s wr, 11 op/s 2023-03-17T09:42:32.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:31 smithi035 ceph-mon[92535]: pgmap v1482: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 464 B/s wr, 11 op/s 2023-03-17T09:42:32.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:33 smithi035 ceph-mon[92535]: pgmap v1483: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T09:42:32.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:35 smithi035 ceph-mon[92535]: pgmap v1484: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T09:42:33.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:37 smithi035 ceph-mon[92535]: pgmap v1485: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T09:42:33.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:39 smithi035 ceph-mon[92535]: pgmap v1486: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:42:33.687 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:41 smithi035 ceph-mon[92535]: pgmap v1487: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:43 smithi035 ceph-mon[92535]: pgmap v1488: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:45 smithi035 ceph-mon[92535]: pgmap v1489: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:47 smithi035 ceph-mon[92535]: pgmap v1490: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:49 smithi035 ceph-mon[92535]: pgmap v1491: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:51 smithi035 ceph-mon[92535]: pgmap v1492: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:53 smithi035 ceph-mon[92535]: pgmap v1493: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:55 smithi035 ceph-mon[92535]: pgmap v1494: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:57 smithi035 ceph-mon[92535]: pgmap v1495: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:34.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:32:59 smithi035 ceph-mon[92535]: pgmap v1496: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:01 smithi035 ceph-mon[92535]: pgmap v1497: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:03 smithi035 ceph-mon[92535]: pgmap v1498: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:05 smithi035 ceph-mon[92535]: pgmap v1499: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:07 smithi035 ceph-mon[92535]: pgmap v1500: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:09 smithi035 ceph-mon[92535]: pgmap v1501: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:09 smithi035 ceph-mon[92535]: osdmap e170: 12 total, 12 up, 12 in 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:11 smithi035 ceph-mon[92535]: pgmap v1503: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:13 smithi035 ceph-mon[92535]: pgmap v1504: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:42:35.461 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:15 smithi035 ceph-mon[92535]: pgmap v1505: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:42:37.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:15 smithi035 ceph-mon[92535]: osdmap e171: 12 total, 12 up, 12 in 2023-03-17T09:42:40.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:17 smithi035 ceph-mon[92535]: pgmap v1507: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:19 smithi035 ceph-mon[92535]: pgmap v1508: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:21 smithi035 ceph-mon[92535]: pgmap v1509: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:23 smithi035 ceph-mon[92535]: pgmap v1510: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:25 smithi035 ceph-mon[92535]: pgmap v1511: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:27 smithi035 ceph-mon[92535]: pgmap v1512: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:28 smithi035 ceph-mon[92535]: pgmap v1513: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-17T09:42:40.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:28 smithi035 ceph-mon[92535]: pgmap v1514: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T09:42:41.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:30 smithi035 ceph-mon[92535]: pgmap v1515: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:42:41.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:32 smithi035 ceph-mon[92535]: pgmap v1516: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:42:41.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:34 smithi035 ceph-mon[92535]: pgmap v1517: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:42:41.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:36 smithi035 ceph-mon[92535]: pgmap v1518: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:42:41.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:38 smithi035 ceph-mon[92535]: pgmap v1519: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:42:41.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:40 smithi035 ceph-mon[92535]: pgmap v1520: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:42:41.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:42 smithi035 ceph-mon[92535]: pgmap v1521: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:42.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:44 smithi035 ceph-mon[92535]: pgmap v1522: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:42:42.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:46 smithi035 ceph-mon[92535]: pgmap v1523: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:42.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:48 smithi035 ceph-mon[92535]: pgmap v1524: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:42:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:42:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:42:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:42:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:42:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:42:42.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:42:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:42:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f904c4010 con 0x564f905bd960 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f90516950 con 0x564f905c2be0 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9050fde0 con 0x564f905c34f0 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46462/0 (socket says 172.21.15.35:46462) 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2355358080 learned_addr learned my addr 172.21.15.35:0/2355358080 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd693c6700 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2355358080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 msgr2=0x564f905bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2355358080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 msgr2=0x564f905c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2355358080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f903915d0 con 0x564f905bd960 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.461+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905bdd90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005ad0 tx=0x7fbd5c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e124f8b9fffaccd8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd4f7fe700 1 -- 172.21.15.35:0/2355358080 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00e040 con 0x564f905bd960 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd4f7fe700 1 -- 172.21.15.35:0/2355358080 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd5c007b90 con 0x564f905bd960 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd4f7fe700 1 -- 172.21.15.35:0/2355358080 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c003c60 con 0x564f905bd960 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2355358080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 msgr2=0x564f905bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905bdd90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005ad0 tx=0x7fbd5c009c90 comp rx=0 tx=0).stop 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2355358080 shutdown_connections 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905bdd90 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2355358080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2355358080 >> 172.21.15.35:0/2355358080 conn(0x564f9041a6b0 msgr2=0x564f905b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2355358080 shutdown_connections 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.462+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2355358080 wait complete. 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 -- start start 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 Processor -- start 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f903938c0 con 0x564f905bd960 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905c7410 con 0x564f905c2be0 2023-03-17T09:42:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905d2fa0 con 0x564f905c34f0 2023-03-17T09:42:44.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd777b7b80 10 client.0 _ll_register_callbacks cb 0x564f903b5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.463+0000 7fbd693c6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46464/0 (socket says 172.21.15.35:46464) 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 -- 172.21.15.35:0/884471647 learned_addr learned my addr 172.21.15.35:0/884471647 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 -- 172.21.15.35:0/884471647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 msgr2=0x564f905c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 -- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 msgr2=0x564f905c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 -- 172.21.15.35:0/884471647 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6410c7a0 con 0x564f905bd960 2023-03-17T09:42:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd693c6700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905c93f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbd540116f0 tx=0x7fbd540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c327952faacbc6e6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:42:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd4cff9700 1 -- 172.21.15.35:0/884471647 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54028670 con 0x564f905bd960 2023-03-17T09:42:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd4cff9700 1 -- 172.21.15.35:0/884471647 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbd54017070 con 0x564f905bd960 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f904d2390 con 0x564f905bd960 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd4cff9700 1 -- 172.21.15.35:0/884471647 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd540287d0 con 0x564f905bd960 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd777b7b80 10 client.17160 fetch_fsmap learned FSMap version 35 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.464+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564f9033dd80 con 0x564f905bd960 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd4cff9700 1 -- 172.21.15.35:0/884471647 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f904d2390 con 0x564f905bd960 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd4cff9700 1 -- 172.21.15.35:0/884471647 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd540317e0 con 0x564f905bd960 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd777b7b80 10 client.17160 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd777b7b80 10 client.17160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd777b7b80 20 client.17160 populate_metadata read hostname 'smithi035' 2023-03-17T09:42:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f905d6fe0 0x564f905d93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd777b7b80 4 client.17160 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f904de600 con 0x564f905d6fe0 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f905d6fe0 0x564f905d93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd4cff9700 10 client.17160 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.465+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f905d6fe0 0x564f905d93f0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead071090a1c0a99 server_cookie=f798617a0bf16b5f in_seq=0 out_seq=0 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd4cff9700 1 -- 172.21.15.35:0/884471647 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564f904de600 con 0x564f905d6fe0 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd4cff9700 10 client.17160 handle_command_reply: tid=0 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 client.17160 shutdown 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 msgr2=0x564f905c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905c93f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbd540116f0 tx=0x7fbd540047c0 comp rx=0 tx=0).stop 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 shutdown_connections 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f905d6fe0 0x564f905d93f0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c34f0 0x564f905c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905bd960 0x564f905c93f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/884471647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905c2be0 0x564f905c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd4cff9700 0 client.17160 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 >> 172.21.15.35:0/884471647 conn(0x564f9041a6b0 msgr2=0x564f905b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 shutdown_connections 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.466+0000 7fbd777b7b80 1 -- 172.21.15.35:0/884471647 wait complete. 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.467+0000 7fbd777b7b80 20 client.17160 trim_cache size 0 max 16384 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 Processor -- start 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 -- start start 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905c2ff0 con 0x564f905c34f0 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905d4740 con 0x564f905bd960 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.484+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905b86f0 con 0x564f905c2be0 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46476/0 (socket says 172.21.15.35:46476) 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2727679535 learned_addr learned my addr 172.21.15.35:0/2727679535 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd693c6700 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2727679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 msgr2=0x564f905cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2727679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 msgr2=0x564f905b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:48.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 -- 172.21.15.35:0/2727679535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f904d6130 con 0x564f905c34f0 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905c40a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b420 tx=0x7fbd5c006130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a092be5601d3b8c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd4ffff700 1 -- 172.21.15.35:0/2727679535 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00e040 con 0x564f905c34f0 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd4ffff700 1 -- 172.21.15.35:0/2727679535 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd5c009460 con 0x564f905c34f0 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.485+0000 7fbd4ffff700 1 -- 172.21.15.35:0/2727679535 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c003c60 con 0x564f905c34f0 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2727679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 msgr2=0x564f905c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905c40a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00b420 tx=0x7fbd5c006130 comp rx=0 tx=0).stop 2023-03-17T09:42:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2727679535 shutdown_connections 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905c40a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/2727679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2727679535 >> 172.21.15.35:0/2727679535 conn(0x564f9041a6b0 msgr2=0x564f905c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2727679535 shutdown_connections 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 -- 172.21.15.35:0/2727679535 wait complete. 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.486+0000 7fbd777b7b80 1 -- start start 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 Processor -- start 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905bf120 con 0x564f905c34f0 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905bf290 con 0x564f905bd960 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f905bf450 con 0x564f905c2be0 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd777b7b80 10 client.0 _ll_register_callbacks cb 0x564f903b5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd69bc7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd69bc7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905bebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46482/0 (socket says 172.21.15.35:46482) 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd69bc7700 1 -- 172.21.15.35:0/3959167073 learned_addr learned my addr 172.21.15.35:0/3959167073 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.487+0000 7fbd693c6700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd68bc5700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd69bc7700 1 -- 172.21.15.35:0/3959167073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 msgr2=0x564f905be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905be6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd69bc7700 1 -- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 msgr2=0x564f905cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:42:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd69bc7700 1 -- 172.21.15.35:0/3959167073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f903915d0 con 0x564f905c34f0 2023-03-17T09:42:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd69bc7700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905bebe0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005b00 tx=0x7fbd5c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dad77043829821 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:42:50.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd4cff9700 1 -- 172.21.15.35:0/3959167073 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00e040 con 0x564f905c34f0 2023-03-17T09:42:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd4cff9700 1 -- 172.21.15.35:0/3959167073 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbd5c007b90 con 0x564f905c34f0 2023-03-17T09:42:50.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f9058d1e0 con 0x564f905c34f0 2023-03-17T09:42:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd4cff9700 1 -- 172.21.15.35:0/3959167073 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd5c007d50 con 0x564f905c34f0 2023-03-17T09:42:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd777b7b80 10 client.17166 fetch_fsmap learned FSMap version 35 2023-03-17T09:42:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x564f903641f0 con 0x564f905c34f0 2023-03-17T09:42:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd4cff9700 1 -- 172.21.15.35:0/3959167073 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f9058d1e0 con 0x564f905c34f0 2023-03-17T09:42:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd4cff9700 1 -- 172.21.15.35:0/3959167073 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd5c00b100 con 0x564f905c34f0 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd777b7b80 10 client.17166 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.488+0000 7fbd777b7b80 10 client.17166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd777b7b80 20 client.17166 populate_metadata read hostname 'smithi035' 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f9062bdd0 0x564f9062e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd777b7b80 4 client.17166 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564f90393f00 con 0x564f9062bdd0 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd693c6700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f9062bdd0 0x564f9062e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd4cff9700 10 client.17166 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.489+0000 7fbd693c6700 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f9062bdd0 0x564f9062e1b0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f1621048f626f9 server_cookie=34644656f4fb9330 in_seq=0 out_seq=0 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd4cff9700 1 -- 172.21.15.35:0/3959167073 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564f90393f00 con 0x564f9062bdd0 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd4cff9700 10 client.17166 handle_command_reply: tid=0 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 client.17166 shutdown 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 msgr2=0x564f905bebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905bebe0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005b00 tx=0x7fbd5c00be10 comp rx=0 tx=0).stop 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 shutdown_connections 2023-03-17T09:42:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f9062bdd0 0x564f9062e1b0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f905c34f0 0x564f905bebe0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f905bd960 0x564f905cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd4cff9700 0 client.17166 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 --2- 172.21.15.35:0/3959167073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f905c2be0 0x564f905be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 >> 172.21.15.35:0/3959167073 conn(0x564f9041a6b0 msgr2=0x564f905c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 shutdown_connections 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.493+0000 7fbd777b7b80 1 -- 172.21.15.35:0/3959167073 wait complete. 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd777b7b80 20 client.17166 trim_cache size 0 max 16384 2023-03-17T09:42:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbd5009f640 msgr2=0x7fbd500a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:52.994 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:50 smithi035 ceph-mon[92535]: pgmap v1525: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T09:42:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbd5009f640 0x7fbd500a1af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005950 tx=0x7fbd5400b410 comp rx=0 tx=0).stop 2023-03-17T09:42:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 msgr2=0x7fbd64195780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 0x7fbd64195780 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000ea50 tx=0x7fbd6000ed60 comp rx=0 tx=0).stop 2023-03-17T09:42:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 shutdown_connections 2023-03-17T09:42:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbd5009f640 0x7fbd500a1af0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd64104390 0x7fbd64199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd640ff350 0x7fbd64195240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 --2- 172.21.15.35:0/1200817688 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbd640ffcf0 0x7fbd64195780 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 >> 172.21.15.35:0/1200817688 conn(0x7fbd64076330 msgr2=0x7fbd640fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 shutdown_connections 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:20:48.494+0000 7fbd6b62a700 1 -- 172.21.15.35:0/1200817688 wait complete. 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 -- 172.21.15.35:0/2006869389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 msgr2=0x7f4eec10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 --2- 172.21.15.35:0/2006869389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec10bfc0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400b0d0 tx=0x7f4ee400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 -- 172.21.15.35:0/2006869389 shutdown_connections 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 --2- 172.21.15.35:0/2006869389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec10bfc0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 --2- 172.21.15.35:0/2006869389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eec0ff3b0 0x7f4eec0ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 --2- 172.21.15.35:0/2006869389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec0ffd50 0x7f4eec103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 -- 172.21.15.35:0/2006869389 >> 172.21.15.35:0/2006869389 conn(0x7f4eec075f60 msgr2=0x7f4eec076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:42:55.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 -- 172.21.15.35:0/2006869389 shutdown_connections 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.617+0000 7f4ef2353700 1 -- 172.21.15.35:0/2006869389 wait complete. 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 Processor -- start 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 -- start start 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec0ff3b0 0x7f4eec196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eec0ffd50 0x7f4eec196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec19b320 con 0x7f4eec1043f0 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec19b490 con 0x7f4eec0ff3b0 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.618+0000 7f4ef2353700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec19b650 con 0x7f4eec0ffd50 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec19ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46496/0 (socket says 172.21.15.35:46496) 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3747493268 learned_addr learned my addr 172.21.15.35:0/3747493268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4eebfff700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec0ff3b0 0x7f4eec196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eec0ffd50 0x7f4eec196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3747493268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eec0ffd50 msgr2=0x7f4eec196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eec0ffd50 0x7f4eec196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3747493268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec0ff3b0 msgr2=0x7f4eec196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:42:55.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec0ff3b0 0x7f4eec196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:42:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3747493268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009d00 con 0x7f4eec1043f0 2023-03-17T09:42:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec19ace0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009fd0 tx=0x7f4ee400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ee97fa700 1 -- 172.21.15.35:0/3747493268 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400e040 con 0x7f4eec1043f0 2023-03-17T09:42:55.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ee97fa700 1 -- 172.21.15.35:0/3747493268 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ee40094a0 con 0x7f4eec1043f0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec10f070 con 0x7f4eec1043f0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ee97fa700 1 -- 172.21.15.35:0/3747493268 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4005040 con 0x7f4eec1043f0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.619+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec10eee0 con 0x7f4eec1043f0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.621+0000 7f4ee97fa700 1 -- 172.21.15.35:0/3747493268 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4ee401b450 con 0x7f4eec1043f0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.622+0000 7f4ee97fa700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ed409f640 0x7f4ed40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.622+0000 7f4ee97fa700 1 -- 172.21.15.35:0/3747493268 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4ee40cb670 con 0x7f4eec1043f0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.622+0000 7f4eebfff700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ed409f640 0x7f4ed40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4eebfff700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ed409f640 0x7f4ed40a1af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009c60 tx=0x7f4edc009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:42:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 Processor -- start 2023-03-17T09:42:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 -- start start 2023-03-17T09:42:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec0382ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0382a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec0382ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:42:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec03731010 con 0x55ec0382a960 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec03783950 con 0x55ec038304f0 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0377cde0 con 0x55ec0382fbe0 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4ef08f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec0382ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4ef08f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec0382ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46504/0 (socket says 172.21.15.35:46504) 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.623+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3400429185 learned_addr learned my addr 172.21.15.35:0/3400429185 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0382a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4eebfff700 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec0382ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:42:59.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3400429185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 msgr2=0x55ec0382ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec0382ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3400429185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 msgr2=0x55ec0382a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0382a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3400429185 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec035fe5d0 con 0x55ec0382a960 2023-03-17T09:43:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4eebfff700 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec0382ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:43:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec0382ad90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40c9400 tx=0x7f4ee4099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ebc18f4434c855 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ed27fc700 1 -- 172.21.15.35:0/3400429185 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4003e10 con 0x55ec0382a960 2023-03-17T09:43:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ed27fc700 1 -- 172.21.15.35:0/3400429185 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ee401a3b0 con 0x55ec0382a960 2023-03-17T09:43:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.624+0000 7f4ed27fc700 1 -- 172.21.15.35:0/3400429185 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401b700 con 0x55ec0382a960 2023-03-17T09:43:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3400429185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 msgr2=0x55ec0382ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec0382ad90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40c9400 tx=0x7f4ee4099000 comp rx=0 tx=0).stop 2023-03-17T09:43:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3400429185 shutdown_connections 2023-03-17T09:43:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec0382ad90 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec0382ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3400429185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0382a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3400429185 >> 172.21.15.35:0/3400429185 conn(0x55ec036876b0 msgr2=0x55ec03824a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3400429185 shutdown_connections 2023-03-17T09:43:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3400429185 wait complete. 2023-03-17T09:43:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 -- start start 2023-03-17T09:43:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.625+0000 7f4efe4e0b80 1 Processor -- start 2023-03-17T09:43:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec03836460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382fbe0 0x55ec038336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec038304f0 0x55ec03833d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:09.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec036008c0 con 0x55ec0382a960 2023-03-17T09:43:09.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec038344d0 con 0x55ec0382fbe0 2023-03-17T09:43:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0383fd30 con 0x55ec038304f0 2023-03-17T09:43:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4efe4e0b80 10 client.0 _ll_register_callbacks cb 0x55ec03622230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec03836460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec03836460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46506/0 (socket says 172.21.15.35:46506) 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 -- 172.21.15.35:0/1907989126 learned_addr learned my addr 172.21.15.35:0/1907989126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec038304f0 0x55ec03833d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382fbe0 0x55ec038336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 -- 172.21.15.35:0/1907989126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec038304f0 msgr2=0x55ec03833d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec038304f0 0x55ec03833d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 -- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382fbe0 msgr2=0x55ec038336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382fbe0 0x55ec038336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 -- 172.21.15.35:0/1907989126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec10eee0 con 0x55ec0382a960 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4eebfff700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec03836460 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0039b0 tx=0x7f4edc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a37246aeb9b666 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.626+0000 7f4ecb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/1907989126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc01eab0 con 0x55ec0382a960 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/1907989126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4edc009e50 con 0x55ec0382a960 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec0373f390 con 0x55ec0382a960 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/1907989126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4edc004580 con 0x55ec0382a960 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 10 client.17178 fetch_fsmap learned FSMap version 35 2023-03-17T09:43:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ec035aad80 con 0x55ec0382a960 2023-03-17T09:43:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/1907989126 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec0373f390 con 0x55ec0382a960 2023-03-17T09:43:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/1907989126 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4edc01c430 con 0x55ec0382a960 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 10 client.17178 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 10 client.17178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 20 client.17178 populate_metadata read hostname 'smithi035' 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec03843f80 0x55ec03846390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 4 client.17178 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.627+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec0374b600 con 0x55ec03843f80 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.628+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec03843f80 0x55ec03846390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.628+0000 7f4ecb7fe700 10 client.17178 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.628+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec03843f80 0x55ec03846390 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7434d0c69e47449 server_cookie=b8c12370bcf9dc5e in_seq=0 out_seq=0 2023-03-17T09:43:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/1907989126 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ec0374b600 con 0x55ec03843f80 2023-03-17T09:43:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4ecb7fe700 10 client.17178 handle_command_reply: tid=0 2023-03-17T09:43:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 client.17178 shutdown 2023-03-17T09:43:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 msgr2=0x55ec03836460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:14.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec03836460 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0039b0 tx=0x7f4edc0047c0 comp rx=0 tx=0).stop 2023-03-17T09:43:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 shutdown_connections 2023-03-17T09:43:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec03843f80 0x55ec03846390 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec038304f0 0x55ec03833d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4ecb7fe700 0 client.17178 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382a960 0x55ec03836460 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/1907989126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382fbe0 0x55ec038336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 >> 172.21.15.35:0/1907989126 conn(0x55ec036876b0 msgr2=0x55ec03829410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 shutdown_connections 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/1907989126 wait complete. 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.629+0000 7f4efe4e0b80 20 client.17178 trim_cache size 0 max 16384 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 Processor -- start 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 -- start start 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382a960 0x55ec0383acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec03836000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 0x55ec0382d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec03825e10 con 0x55ec038304f0 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec03834cc0 con 0x55ec0382a960 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec03826620 con 0x55ec0382fbe0 2023-03-17T09:43:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4ef08f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 0x55ec0382d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4eebfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382a960 0x55ec0383acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4ef08f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 0x55ec0382d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46518/0 (socket says 172.21.15.35:46518) 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3784334160 learned_addr learned my addr 172.21.15.35:0/3784334160 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3784334160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 msgr2=0x55ec03836000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec03836000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.644+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec03836000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3784334160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382a960 msgr2=0x55ec0383acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382a960 0x55ec0383acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ef08f0700 1 -- 172.21.15.35:0/3784334160 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec03743130 con 0x55ec038304f0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4eebfff700 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382a960 0x55ec0383acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 0x55ec0382d6b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40990f0 tx=0x7f4ee4009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5a2bd922820a97 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ed2ffd700 1 -- 172.21.15.35:0/3784334160 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4003e10 con 0x55ec038304f0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ed2ffd700 1 -- 172.21.15.35:0/3784334160 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ee401a3b0 con 0x55ec038304f0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4ed2ffd700 1 -- 172.21.15.35:0/3784334160 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401b700 con 0x55ec038304f0 2023-03-17T09:43:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3784334160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 msgr2=0x55ec0382d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:19.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 0x55ec0382d6b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40990f0 tx=0x7f4ee4009640 comp rx=0 tx=0).stop 2023-03-17T09:43:19.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3784334160 shutdown_connections 2023-03-17T09:43:19.729 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:52 smithi035 ceph-mon[92535]: pgmap v1526: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:43:19.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec038304f0 0x55ec0382d6b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec0382a960 0x55ec0383acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.645+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/3784334160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382fbe0 0x55ec03836000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3784334160 >> 172.21.15.35:0/3784334160 conn(0x55ec036876b0 msgr2=0x55ec03829b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3784334160 shutdown_connections 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/3784334160 wait complete. 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- start start 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 Processor -- start 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382a960 0x55ec03838e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 0x55ec038393d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0389b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0389b770 con 0x55ec0382fbe0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0389b8b0 con 0x55ec038304f0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec0389ba40 con 0x55ec0382a960 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.646+0000 7f4efe4e0b80 10 client.0 _ll_register_callbacks cb 0x55ec03622230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 0x55ec038393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 0x55ec038393d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46522/0 (socket says 172.21.15.35:46522) 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 -- 172.21.15.35:0/511206627 learned_addr learned my addr 172.21.15.35:0/511206627 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eebfff700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382a960 0x55ec03838e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4ef08f0700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0389b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 -- 172.21.15.35:0/511206627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382a960 msgr2=0x55ec03838e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382a960 0x55ec03838e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 -- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 msgr2=0x55ec0389b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0389b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 -- 172.21.15.35:0/511206627 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec035aad80 con 0x55ec0382fbe0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4eeb7fe700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 0x55ec038393d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4eec100120 tx=0x7f4ee001ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b7cb1e421466d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4ecb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:43:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/511206627 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0017040 con 0x55ec0382fbe0 2023-03-17T09:43:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/511206627 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4ee0003680 con 0x55ec0382fbe0 2023-03-17T09:43:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec037fa1e0 con 0x55ec0382fbe0 2023-03-17T09:43:22.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/511206627 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ee001ee90 con 0x55ec0382fbe0 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4efe4e0b80 10 client.17184 fetch_fsmap learned FSMap version 35 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.647+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ec035fe5d0 con 0x55ec0382fbe0 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/511206627 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ec037fa1e0 con 0x55ec0382fbe0 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/511206627 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4ee00308f0 con 0x55ec0382fbe0 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4efe4e0b80 10 client.17184 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4efe4e0b80 10 client.17184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4efe4e0b80 20 client.17184 populate_metadata read hostname 'smithi035' 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec0389d240 0x55ec0389f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4efe4e0b80 4 client.17184 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ec03600f00 con 0x55ec0389d240 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4eebfff700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec0389d240 0x55ec0389f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4ecb7fe700 10 client.17184 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:01.648+0000 7f4eebfff700 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec0389d240 0x55ec0389f650 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8739df43b3fc6a43 server_cookie=2240020f278eebc4 in_seq=0 out_seq=0 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.248+0000 7f4ecb7fe700 1 -- 172.21.15.35:0/511206627 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ec03600f00 con 0x55ec0389d240 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.248+0000 7f4ecb7fe700 10 client.17184 handle_command_reply: tid=0 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.248+0000 7f4efe4e0b80 1 client.17184 shutdown 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 msgr2=0x55ec038393d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 0x55ec038393d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4eec100120 tx=0x7f4ee001ed00 comp rx=0 tx=0).stop 2023-03-17T09:43:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 shutdown_connections 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ec0389d240 0x55ec0389f650 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ec038304f0 0x55ec0389b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec0382a960 0x55ec03838e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 --2- 172.21.15.35:0/511206627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ec0382fbe0 0x55ec038393d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4ecb7fe700 0 client.17184 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 >> 172.21.15.35:0/511206627 conn(0x55ec036876b0 msgr2=0x55ec0382d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 shutdown_connections 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 1 -- 172.21.15.35:0/511206627 wait complete. 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.249+0000 7f4efe4e0b80 20 client.17184 trim_cache size 0 max 16384 2023-03-17T09:43:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ed409f640 msgr2=0x7f4ed40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ed409f640 0x7f4ed40a1af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009c60 tx=0x7f4edc009260 comp rx=0 tx=0).stop 2023-03-17T09:43:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 msgr2=0x7f4eec19ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec19ace0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009fd0 tx=0x7f4ee400cce0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 shutdown_connections 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ed409f640 0x7f4ed40a1af0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4eec1043f0 0x7f4eec19ace0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4eec0ff3b0 0x7f4eec196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 --2- 172.21.15.35:0/3747493268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4eec0ffd50 0x7f4eec196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 >> 172.21.15.35:0/3747493268 conn(0x7f4eec075f60 msgr2=0x7f4eec102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 shutdown_connections 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:03.250+0000 7f4ef2353700 1 -- 172.21.15.35:0/3747493268 wait complete. 2023-03-17T09:43:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 -- 172.21.15.35:0/1628907141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 msgr2=0x7f69780ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 --2- 172.21.15.35:0/1628907141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f69780ff780 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f69680099c0 tx=0x7f6968009cd0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 -- 172.21.15.35:0/1628907141 shutdown_connections 2023-03-17T09:43:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 --2- 172.21.15.35:0/1628907141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69781043f0 0x7f697810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 --2- 172.21.15.35:0/1628907141 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f69780ff780 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 --2- 172.21.15.35:0/1628907141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69780ffd50 0x7f6978103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:28.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 -- 172.21.15.35:0/1628907141 >> 172.21.15.35:0/1628907141 conn(0x7f6978075f60 msgr2=0x7f6978076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 -- 172.21.15.35:0/1628907141 shutdown_connections 2023-03-17T09:43:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.376+0000 7f697e5d2700 1 -- 172.21.15.35:0/1628907141 wait complete. 2023-03-17T09:43:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 Processor -- start 2023-03-17T09:43:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 -- start start 2023-03-17T09:43:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f6978195260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ffd50 0x7f69781957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69781043f0 0x7f6978199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697819a240 con 0x7f69780ff3b0 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697819a3b0 con 0x7f69780ffd50 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.377+0000 7f697e5d2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697819a570 con 0x7f69781043f0 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f6978195260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f6978195260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46534/0 (socket says 172.21.15.35:46534) 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 -- 172.21.15.35:0/3366102213 learned_addr learned my addr 172.21.15.35:0/3366102213 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f69777fe700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ffd50 0x7f69781957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f697cb6f700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69781043f0 0x7f6978199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 -- 172.21.15.35:0/3366102213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69781043f0 msgr2=0x7f6978199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69781043f0 0x7f6978199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 -- 172.21.15.35:0/3366102213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ffd50 msgr2=0x7f69781957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ffd50 0x7f69781957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 -- 172.21.15.35:0/3366102213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680095f0 con 0x7f69780ff3b0 2023-03-17T09:43:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f69777fe700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ffd50 0x7f69781957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f6977fff700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f6978195260 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6968009f50 tx=0x7f69680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f69757fa700 1 -- 172.21.15.35:0/3366102213 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696801f070 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f69757fa700 1 -- 172.21.15.35:0/3366102213 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f696801ac20 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697810f060 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f69757fa700 1 -- 172.21.15.35:0/3366102213 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968003fe0 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.378+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697810eed0 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.381+0000 7f69757fa700 1 -- 172.21.15.35:0/3366102213 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6968023070 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.381+0000 7f69757fa700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f696009f640 0x7f69600a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.381+0000 7f69777fe700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f696009f640 0x7f69600a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.381+0000 7f69757fa700 1 -- 172.21.15.35:0/3366102213 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f69680cd780 con 0x7f69780ff3b0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f69777fe700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f696009f640 0x7f69600a1af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f696c005950 tx=0x7f696c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 Processor -- start 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 -- start start 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99bea5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99bea0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99bea0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99bda7010 con 0x55d99bea5be0 2023-03-17T09:43:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99bdf9950 con 0x55d99bea64f0 2023-03-17T09:43:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f698a75fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99bdf2de0 con 0x55d99bea0960 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99bea5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99bea5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46542/0 (socket says 172.21.15.35:46542) 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f6977fff700 1 -- 172.21.15.35:0/1159421569 learned_addr learned my addr 172.21.15.35:0/1159421569 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f69777fe700 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99bea0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.382+0000 7f697cb6f700 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99bea0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f6977fff700 1 -- 172.21.15.35:0/1159421569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 msgr2=0x55d99bea0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f6977fff700 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99bea0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f6977fff700 1 -- 172.21.15.35:0/1159421569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 msgr2=0x55d99bea0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f6977fff700 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99bea0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f6977fff700 1 -- 172.21.15.35:0/1159421569 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d99bc745d0 con 0x55d99bea5be0 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f6977fff700 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99bea5fb0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f69680977c0 tx=0x7f6968009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade41802fc3b396d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f695e7fc700 1 -- 172.21.15.35:0/1159421569 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696809f020 con 0x55d99bea5be0 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f695e7fc700 1 -- 172.21.15.35:0/1159421569 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f696801ad90 con 0x55d99bea5be0 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.383+0000 7f695e7fc700 1 -- 172.21.15.35:0/1159421569 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696809b720 con 0x55d99bea5be0 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 -- 172.21.15.35:0/1159421569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 msgr2=0x55d99bea5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99bea5fb0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f69680977c0 tx=0x7f6968009310 comp rx=0 tx=0).stop 2023-03-17T09:43:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 -- 172.21.15.35:0/1159421569 shutdown_connections 2023-03-17T09:43:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99bea0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99bea5fb0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1159421569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99bea0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 -- 172.21.15.35:0/1159421569 >> 172.21.15.35:0/1159421569 conn(0x55d99bcfd6b0 msgr2=0x55d99be9aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 -- 172.21.15.35:0/1159421569 shutdown_connections 2023-03-17T09:43:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 -- 172.21.15.35:0/1159421569 wait complete. 2023-03-17T09:43:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 -- start start 2023-03-17T09:43:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.384+0000 7f698a75fb80 1 Processor -- start 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99bea9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99bea9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99bc768c0 con 0x55d99bea0960 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99beaa4a0 con 0x55d99bea5be0 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99beb5cf0 con 0x55d99bea64f0 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 10 client.0 _ll_register_callbacks cb 0x55d99bc98230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46548/0 (socket says 172.21.15.35:46548) 2023-03-17T09:43:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 -- 172.21.15.35:0/3587337112 learned_addr learned my addr 172.21.15.35:0/3587337112 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f697cb6f700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99bea9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f69777fe700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99bea9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 -- 172.21.15.35:0/3587337112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 msgr2=0x55d99bea9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99bea9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:35.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 -- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 msgr2=0x55d99bea9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99bea9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 -- 172.21.15.35:0/3587337112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697810eed0 con 0x55d99bea0960 2023-03-17T09:43:36.550 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:54 smithi035 ceph-mon[92535]: pgmap v1527: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:43:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f69777fe700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99bea9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:43:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f6977fff700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beac410 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f69680cb490 tx=0x7f6968005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db777db695e26d82 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f69577fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:43:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f69577fe700 1 -- 172.21.15.35:0/3587337112 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696809a7b0 con 0x55d99bea0960 2023-03-17T09:43:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f69577fe700 1 -- 172.21.15.35:0/3587337112 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f696809a910 con 0x55d99bea0960 2023-03-17T09:43:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.385+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d99bdb5390 con 0x55d99bea0960 2023-03-17T09:43:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f69577fe700 1 -- 172.21.15.35:0/3587337112 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f696809b520 con 0x55d99bea0960 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 10 client.17196 fetch_fsmap learned FSMap version 35 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d99bc20d80 con 0x55d99bea0960 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f69577fe700 1 -- 172.21.15.35:0/3587337112 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d99bdb5390 con 0x55d99bea0960 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f69577fe700 1 -- 172.21.15.35:0/3587337112 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f69680c6070 con 0x55d99bea0960 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 10 client.17196 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 10 client.17196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 20 client.17196 populate_metadata read hostname 'smithi035' 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99beb98d0 0x55d99bebbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 4 client.17196 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:43:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d99bdc1600 con 0x55d99beb98d0 2023-03-17T09:43:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.386+0000 7f69777fe700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99beb98d0 0x55d99bebbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.387+0000 7f69577fe700 10 client.17196 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.387+0000 7f69777fe700 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99beb98d0 0x55d99bebbcb0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88df9d367e18ad32 server_cookie=1d49cad2ba1ef9b0 in_seq=0 out_seq=0 2023-03-17T09:43:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.387+0000 7f69577fe700 1 -- 172.21.15.35:0/3587337112 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d99bdc1600 con 0x55d99beb98d0 2023-03-17T09:43:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.387+0000 7f69577fe700 10 client.17196 handle_command_reply: tid=0 2023-03-17T09:43:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.387+0000 7f698a75fb80 1 client.17196 shutdown 2023-03-17T09:43:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 msgr2=0x55d99beac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beac410 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f69680cb490 tx=0x7f6968005c00 comp rx=0 tx=0).stop 2023-03-17T09:43:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 shutdown_connections 2023-03-17T09:43:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99beb98d0 0x55d99bebbcb0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99bea9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beac410 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f69577fe700 0 client.17196 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 --2- 172.21.15.35:0/3587337112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99bea9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 >> 172.21.15.35:0/3587337112 conn(0x55d99bcfd6b0 msgr2=0x55d99be9f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 shutdown_connections 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 1 -- 172.21.15.35:0/3587337112 wait complete. 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.388+0000 7f698a75fb80 20 client.17196 trim_cache size 0 max 16384 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 Processor -- start 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 -- start start 2023-03-17T09:43:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99be9aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99beb0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99be9f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99bdb5390 con 0x55d99bea5be0 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99be960f0 con 0x55d99bea64f0 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f698a75fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99be9b3d0 con 0x55d99bea0960 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99beb0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99beb0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46558/0 (socket says 172.21.15.35:46558) 2023-03-17T09:43:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 -- 172.21.15.35:0/98188843 learned_addr learned my addr 172.21.15.35:0/98188843 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f697cb6f700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99be9f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 -- 172.21.15.35:0/98188843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 msgr2=0x55d99be9aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f6977fff700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99be9aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99be9aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 -- 172.21.15.35:0/98188843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 msgr2=0x55d99be9f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99be9f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f69777fe700 1 -- 172.21.15.35:0/98188843 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d99bdb9130 con 0x55d99bea5be0 2023-03-17T09:43:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f6977fff700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99be9aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:43:47.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.403+0000 7f697cb6f700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99be9f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:43:47.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f69777fe700 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99beb0cc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6978196870 tx=0x7f696c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfea781d7540a313 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:47.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f695effd700 1 -- 172.21.15.35:0/98188843 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c017040 con 0x55d99bea5be0 2023-03-17T09:43:47.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f695effd700 1 -- 172.21.15.35:0/98188843 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f696c004530 con 0x55d99bea5be0 2023-03-17T09:43:47.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f695effd700 1 -- 172.21.15.35:0/98188843 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0038e0 con 0x55d99bea5be0 2023-03-17T09:43:47.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 -- 172.21.15.35:0/98188843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 msgr2=0x55d99beb0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:47.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99beb0cc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6978196870 tx=0x7f696c015000 comp rx=0 tx=0).stop 2023-03-17T09:43:47.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 -- 172.21.15.35:0/98188843 shutdown_connections 2023-03-17T09:43:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea64f0 0x55d99be9f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea0960 0x55d99be9aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:48.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 --2- 172.21.15.35:0/98188843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea5be0 0x55d99beb0cc0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 -- 172.21.15.35:0/98188843 >> 172.21.15.35:0/98188843 conn(0x55d99bcfd6b0 msgr2=0x55d99beb6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.404+0000 7f698a75fb80 1 -- 172.21.15.35:0/98188843 shutdown_connections 2023-03-17T09:43:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.405+0000 7f698a75fb80 1 -- 172.21.15.35:0/98188843 wait complete. 2023-03-17T09:43:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.405+0000 7f698a75fb80 1 -- start start 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.405+0000 7f698a75fb80 1 Processor -- start 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.405+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beb0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99beaeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99beaf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99beaf960 con 0x55d99bea0960 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99beafad0 con 0x55d99bea5be0 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99beafc90 con 0x55d99bea64f0 2023-03-17T09:43:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 10 client.0 _ll_register_callbacks cb 0x55d99bc98230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:43:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beb0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beb0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46562/0 (socket says 172.21.15.35:46562) 2023-03-17T09:43:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 -- 172.21.15.35:0/1278541356 learned_addr learned my addr 172.21.15.35:0/1278541356 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:43:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f697cb6f700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99beaf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f69777fe700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99beaeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 -- 172.21.15.35:0/1278541356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 msgr2=0x55d99beaf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99beaf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 -- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 msgr2=0x55d99beaeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99beaeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 -- 172.21.15.35:0/1278541356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c00fe30 con 0x55d99bea0960 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f6977fff700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beb0ae0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6968097d30 tx=0x7f6968005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e23716939623d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f69577fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f69577fe700 1 -- 172.21.15.35:0/1278541356 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696801aac0 con 0x55d99bea0960 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f69577fe700 1 -- 172.21.15.35:0/1278541356 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f696801a880 con 0x55d99bea0960 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d99be701e0 con 0x55d99bea0960 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f69577fe700 1 -- 172.21.15.35:0/1278541356 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69680a31a0 con 0x55d99bea0960 2023-03-17T09:43:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 10 client.17202 fetch_fsmap learned FSMap version 35 2023-03-17T09:43:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.406+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d99bc471f0 con 0x55d99bea0960 2023-03-17T09:43:54.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f69577fe700 1 -- 172.21.15.35:0/1278541356 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d99be701e0 con 0x55d99bea0960 2023-03-17T09:43:54.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f69577fe700 1 -- 172.21.15.35:0/1278541356 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 35) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f69680c6070 con 0x55d99bea0960 2023-03-17T09:43:54.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f698a75fb80 10 client.17202 fetch_fsmap finished waiting for FSMap version 35 2023-03-17T09:43:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f698a75fb80 10 client.17202 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f698a75fb80 20 client.17202 populate_metadata read hostname 'smithi035' 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99bf12a20 0x55d99bf14e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f698a75fb80 4 client.17202 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d99bc76f00 con 0x55d99bf12a20 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.407+0000 7f69777fe700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99bf12a20 0x55d99bf14e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.408+0000 7f69577fe700 10 client.17202 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.408+0000 7f69777fe700 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99bf12a20 0x55d99bf14e00 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f76c14d853eca003 server_cookie=4b24e6709a9781b2 in_seq=0 out_seq=0 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.415+0000 7f69577fe700 1 -- 172.21.15.35:0/1278541356 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d99bc76f00 con 0x55d99bf12a20 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.415+0000 7f69577fe700 10 client.17202 handle_command_reply: tid=0 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.415+0000 7f698a75fb80 1 client.17202 shutdown 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 msgr2=0x55d99beb0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beb0ae0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f6968097d30 tx=0x7f6968005c70 comp rx=0 tx=0).stop 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 shutdown_connections 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d99bf12a20 0x55d99bf14e00 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d99bea64f0 0x55d99beaf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d99bea0960 0x55d99beb0ae0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 --2- 172.21.15.35:0/1278541356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d99bea5be0 0x55d99beaeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 >> 172.21.15.35:0/1278541356 conn(0x55d99bcfd6b0 msgr2=0x55d99be9f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f69577fe700 0 client.17202 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 shutdown_connections 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 1 -- 172.21.15.35:0/1278541356 wait complete. 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f698a75fb80 20 client.17202 trim_cache size 0 max 16384 2023-03-17T09:43:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f696009f640 msgr2=0x7f69600a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:43:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f697e5d2700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f696009f640 0x7f69600a1af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f696c005950 tx=0x7f696c0058e0 comp rx=0 tx=0).stop 2023-03-17T09:44:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 msgr2=0x7f6978195260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.416+0000 7f697e5d2700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f6978195260 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6968009f50 tx=0x7f69680047c0 comp rx=0 tx=0).stop 2023-03-17T09:44:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 shutdown_connections 2023-03-17T09:44:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f696009f640 0x7f69600a1af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69781043f0 0x7f6978199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f69780ff3b0 0x7f6978195260 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 --2- 172.21.15.35:0/3366102213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69780ffd50 0x7f69781957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 >> 172.21.15.35:0/3366102213 conn(0x7f6978075f60 msgr2=0x7f69780fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 shutdown_connections 2023-03-17T09:44:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:16.417+0000 7f697e5d2700 1 -- 172.21.15.35:0/3366102213 wait complete. 2023-03-17T09:44:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 -- 172.21.15.35:0/486242285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c0fe970 msgr2=0x7f842c0fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 --2- 172.21.15.35:0/486242285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c0fe970 0x7f842c0fed40 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f841c0099c0 tx=0x7f841c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:44:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 -- 172.21.15.35:0/486242285 shutdown_connections 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 --2- 172.21.15.35:0/486242285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f842c105510 0x7f842c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 --2- 172.21.15.35:0/486242285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c0fe970 0x7f842c0fed40 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 --2- 172.21.15.35:0/486242285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f842c0ff310 0x7f842c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 -- 172.21.15.35:0/486242285 >> 172.21.15.35:0/486242285 conn(0x7f842c0757a0 msgr2=0x7f842c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 -- 172.21.15.35:0/486242285 shutdown_connections 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.540+0000 7f84321c9700 1 -- 172.21.15.35:0/486242285 wait complete. 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.541+0000 7f84321c9700 1 Processor -- start 2023-03-17T09:44:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.541+0000 7f84321c9700 1 -- start start 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.541+0000 7f84321c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f842c0fe970 0x7f842c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.541+0000 7f84321c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f842c0ff310 0x7f842c1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f84321c9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 0x7f842c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f84321c9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19b280 con 0x7f842c105510 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f84321c9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19b3f0 con 0x7f842c0ff310 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f84321c9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19b5b0 con 0x7f842c0fe970 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 0x7f842c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 0x7f842c19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46590/0 (socket says 172.21.15.35:46590) 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 -- 172.21.15.35:0/3434696050 learned_addr learned my addr 172.21.15.35:0/3434696050 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842b7fe700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f842c0fe970 0x7f842c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 -- 172.21.15.35:0/3434696050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f842c0fe970 msgr2=0x7f842c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:04.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f842c0fe970 0x7f842c1962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 -- 172.21.15.35:0/3434696050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f842c0ff310 msgr2=0x7f842c1967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842affd700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f842c0ff310 0x7f842c1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f842c0ff310 0x7f842c1967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 -- 172.21.15.35:0/3434696050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0095f0 con 0x7f842c105510 2023-03-17T09:44:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f842bfff700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 0x7f842c19ac40 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8424007ee0 tx=0x7f842400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f8428ff9700 1 -- 172.21.15.35:0/3434696050 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424017070 con 0x7f842c105510 2023-03-17T09:44:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f8428ff9700 1 -- 172.21.15.35:0/3434696050 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f842400f040 con 0x7f842c105510 2023-03-17T09:44:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c110180 con 0x7f842c105510 2023-03-17T09:44:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f8428ff9700 1 -- 172.21.15.35:0/3434696050 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424005710 con 0x7f842c105510 2023-03-17T09:44:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.542+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c10fff0 con 0x7f842c105510 2023-03-17T09:44:07.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:56 smithi035 ceph-mon[92535]: pgmap v1528: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:44:07.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:33:58 smithi035 ceph-mon[92535]: pgmap v1529: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:00 smithi035 ceph-mon[92535]: pgmap v1530: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:02 smithi035 ceph-mon[92535]: pgmap v1531: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:04 smithi035 ceph-mon[92535]: pgmap v1532: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:06 smithi035 ceph-mon[92535]: pgmap v1533: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:08 smithi035 ceph-mon[92535]: pgmap v1534: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:09 smithi035 ceph-mon[92535]: osdmap e172: 12 total, 12 up, 12 in 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:09 smithi035 ceph-mon[92535]: pgmap v1536: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:12 smithi035 ceph-mon[92535]: pgmap v1537: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:14 smithi035 ceph-mon[92535]: pgmap v1538: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:16 smithi035 ceph-mon[92535]: pgmap v1539: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:44:08.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:16 smithi035 ceph-mon[92535]: osdmap e173: 12 total, 12 up, 12 in 2023-03-17T09:44:08.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:18 smithi035 ceph-mon[92535]: pgmap v1541: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 126 B/s wr, 6 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:20 smithi035 ceph-mon[92535]: pgmap v1542: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:22 smithi035 ceph-mon[92535]: pgmap v1543: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:24 smithi035 ceph-mon[92535]: pgmap v1544: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:26 smithi035 ceph-mon[92535]: pgmap v1545: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:28 smithi035 ceph-mon[92535]: pgmap v1546: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 637 B/s wr, 10 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:28 smithi035 ceph-mon[92535]: pgmap v1547: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 947 B/s wr, 14 op/s 2023-03-17T09:44:09.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:28 smithi035 ceph-mon[92535]: pgmap v1548: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:30 smithi035 ceph-mon[92535]: pgmap v1549: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:32 smithi035 ceph-mon[92535]: pgmap v1550: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:34 smithi035 ceph-mon[92535]: pgmap v1551: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:36 smithi035 ceph-mon[92535]: pgmap v1552: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:38 smithi035 ceph-mon[92535]: pgmap v1553: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:40 smithi035 ceph-mon[92535]: pgmap v1554: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:42 smithi035 ceph-mon[92535]: pgmap v1555: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:44 smithi035 ceph-mon[92535]: pgmap v1556: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:46 smithi035 ceph-mon[92535]: pgmap v1557: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:48 smithi035 ceph-mon[92535]: pgmap v1558: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:50 smithi035 ceph-mon[92535]: pgmap v1559: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:52 smithi035 ceph-mon[92535]: pgmap v1560: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:54 smithi035 ceph-mon[92535]: pgmap v1561: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:56 smithi035 ceph-mon[92535]: pgmap v1562: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:09.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:34:58 smithi035 ceph-mon[92535]: pgmap v1563: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:10.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:00 smithi035 ceph-mon[92535]: pgmap v1564: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:10.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:02 smithi035 ceph-mon[92535]: pgmap v1565: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:10.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:04 smithi035 ceph-mon[92535]: pgmap v1566: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:44:10.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:06 smithi035 ceph-mon[92535]: pgmap v1567: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:44:10.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:44:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:44:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:44:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:44:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:44:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:44:12.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:44:13.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.545+0000 7f8428ff9700 1 -- 172.21.15.35:0/3434696050 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8424005870 con 0x7f842c105510 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.545+0000 7f8428ff9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f841409f6c0 0x7f84140a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.545+0000 7f8428ff9700 1 -- 172.21.15.35:0/3434696050 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f84240c9d30 con 0x7f842c105510 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.545+0000 7f842b7fe700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f841409f6c0 0x7f84140a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f842b7fe700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f841409f6c0 0x7f84140a1b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f841c006010 tx=0x7f841c003680 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 Processor -- start 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 -- start start 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5887be0 0x55e4a5887fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a5882420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a5882d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a5789010 con 0x55e4a58884f0 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a57db950 con 0x55e4a5887be0 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f843e356b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a57d4de0 con 0x55e4a5882960 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f842affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a5882420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f842affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a5882420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46596/0 (socket says 172.21.15.35:46596) 2023-03-17T09:44:13.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f842affd700 1 -- 172.21.15.35:0/2738447628 learned_addr learned my addr 172.21.15.35:0/2738447628 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.546+0000 7f842b7fe700 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5887be0 0x55e4a5887fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842bfff700 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a5882d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842affd700 1 -- 172.21.15.35:0/2738447628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 msgr2=0x55e4a5882d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:13.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842affd700 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a5882d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842affd700 1 -- 172.21.15.35:0/2738447628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5887be0 msgr2=0x55e4a5887fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842affd700 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5887be0 0x55e4a5887fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842affd700 1 -- 172.21.15.35:0/2738447628 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4a56565d0 con 0x55e4a58884f0 2023-03-17T09:44:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842bfff700 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a5882d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:44:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f842affd700 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a5882420 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8420009b60 tx=0x7f8420009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670773fb9882eb20 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f8411ffb700 1 -- 172.21.15.35:0/2738447628 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420004a30 con 0x55e4a58884f0 2023-03-17T09:44:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f8411ffb700 1 -- 172.21.15.35:0/2738447628 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84200054b0 con 0x55e4a58884f0 2023-03-17T09:44:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.547+0000 7f8411ffb700 1 -- 172.21.15.35:0/2738447628 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842000ec40 con 0x55e4a58884f0 2023-03-17T09:44:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 -- 172.21.15.35:0/2738447628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 msgr2=0x55e4a5882420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a5882420 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8420009b60 tx=0x7f8420009e70 comp rx=0 tx=0).stop 2023-03-17T09:44:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 -- 172.21.15.35:0/2738447628 shutdown_connections 2023-03-17T09:44:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a5882d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5887be0 0x55e4a5887fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 --2- 172.21.15.35:0/2738447628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a5882420 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 -- 172.21.15.35:0/2738447628 >> 172.21.15.35:0/2738447628 conn(0x55e4a56df6b0 msgr2=0x55e4a587ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 -- 172.21.15.35:0/2738447628 shutdown_connections 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 -- 172.21.15.35:0/2738447628 wait complete. 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.548+0000 7f843e356b80 1 -- start start 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 Processor -- start 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5882960 0x55e4a588e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a588b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:18.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a588bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:18.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a56588c0 con 0x55e4a58884f0 2023-03-17T09:44:18.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a588c330 con 0x55e4a5882960 2023-03-17T09:44:18.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a588c4f0 con 0x55e4a5887be0 2023-03-17T09:44:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f843e356b80 10 client.0 _ll_register_callbacks cb 0x55e4a567a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a588bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a588bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46604/0 (socket says 172.21.15.35:46604) 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 -- 172.21.15.35:0/4203712033 learned_addr learned my addr 172.21.15.35:0/4203712033 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842b7fe700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5882960 0x55e4a588e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842affd700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a588b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 -- 172.21.15.35:0/4203712033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 msgr2=0x55e4a588b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a588b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 -- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5882960 msgr2=0x55e4a588e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5882960 0x55e4a588e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 -- 172.21.15.35:0/4203712033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8420009790 con 0x55e4a58884f0 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842affd700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a588b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842b7fe700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5882960 0x55e4a588e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:44:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f842bfff700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a588bbc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f842400d7b0 tx=0x7f8424097140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c1edf8aed79e3d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.549+0000 7f840affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f840affd700 1 -- 172.21.15.35:0/4203712033 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424097c40 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f840affd700 1 -- 172.21.15.35:0/4203712033 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f842409f9d0 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4a5797390 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f840affd700 1 -- 172.21.15.35:0/4203712033 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8424022460 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 10 client.17214 fetch_fsmap learned FSMap version 36 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e4a5602d80 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f840affd700 1 -- 172.21.15.35:0/4203712033 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e4a5797390 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f840affd700 1 -- 172.21.15.35:0/4203712033 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f842409f540 con 0x55e4a58884f0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 10 client.17214 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 10 client.17214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 20 client.17214 populate_metadata read hostname 'smithi035' 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a589c040 0x55e4a589e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 4 client.17214 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4a57a3600 con 0x55e4a589c040 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.550+0000 7f842b7fe700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a589c040 0x55e4a589e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.551+0000 7f842b7fe700 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a589c040 0x55e4a589e470 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b7d612d7b10c81 server_cookie=e1bd46181b9844a0 in_seq=0 out_seq=0 2023-03-17T09:44:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.551+0000 7f840affd700 10 client.17214 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f840affd700 1 -- 172.21.15.35:0/4203712033 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e4a57a3600 con 0x55e4a589c040 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f840affd700 10 client.17214 handle_command_reply: tid=0 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 client.17214 shutdown 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 msgr2=0x55e4a588bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a588bbc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f842400d7b0 tx=0x7f8424097140 comp rx=0 tx=0).stop 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 shutdown_connections 2023-03-17T09:44:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a589c040 0x55e4a589e470 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a58884f0 0x55e4a588bbc0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f840affd700 0 client.17214 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:44:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a5882960 0x55e4a588e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 --2- 172.21.15.35:0/4203712033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a588b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 >> 172.21.15.35:0/4203712033 conn(0x55e4a56df6b0 msgr2=0x55e4a5881410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 shutdown_connections 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 1 -- 172.21.15.35:0/4203712033 wait complete. 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.552+0000 7f843e356b80 20 client.17214 trim_cache size 0 max 16384 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 Processor -- start 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 -- start start 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a587cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 0x55e4a588ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a588df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a5797390 con 0x55e4a5887be0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a58780f0 con 0x55e4a58884f0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f843e356b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a5879b60 con 0x55e4a5882960 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f842affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 0x55e4a588ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f842affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 0x55e4a588ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46610/0 (socket says 172.21.15.35:46610) 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f842affd700 1 -- 172.21.15.35:0/2191330963 learned_addr learned my addr 172.21.15.35:0/2191330963 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f842b7fe700 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a587cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.567+0000 7f842bfff700 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a588df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842affd700 1 -- 172.21.15.35:0/2191330963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 msgr2=0x55e4a587cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842affd700 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a587cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842affd700 1 -- 172.21.15.35:0/2191330963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 msgr2=0x55e4a588df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842affd700 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a588df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842affd700 1 -- 172.21.15.35:0/2191330963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4a5883000 con 0x55e4a5887be0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842bfff700 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a588df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f842affd700 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 0x55e4a588ae70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x55e4a587d6a0 tx=0x7f8420005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1c1041666ee901 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f84127fc700 1 -- 172.21.15.35:0/2191330963 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420005250 con 0x55e4a5887be0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f84127fc700 1 -- 172.21.15.35:0/2191330963 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84200a8070 con 0x55e4a5887be0 2023-03-17T09:44:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.568+0000 7f84127fc700 1 -- 172.21.15.35:0/2191330963 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200046f0 con 0x55e4a5887be0 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 -- 172.21.15.35:0/2191330963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 msgr2=0x55e4a588ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 0x55e4a588ae70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x55e4a587d6a0 tx=0x7f8420005b40 comp rx=0 tx=0).stop 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 -- 172.21.15.35:0/2191330963 shutdown_connections 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a588df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5882960 0x55e4a587cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 --2- 172.21.15.35:0/2191330963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5887be0 0x55e4a588ae70 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 -- 172.21.15.35:0/2191330963 >> 172.21.15.35:0/2191330963 conn(0x55e4a56df6b0 msgr2=0x55e4a5881a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 -- 172.21.15.35:0/2191330963 shutdown_connections 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 -- 172.21.15.35:0/2191330963 wait complete. 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 -- start start 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.569+0000 7f843e356b80 1 Processor -- start 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 0x55e4a58c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a58c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a5890cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a58912b0 con 0x55e4a5882960 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a5891420 con 0x55e4a58884f0 2023-03-17T09:44:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4a58915e0 con 0x55e4a5887be0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 10 client.0 _ll_register_callbacks cb 0x55e4a567a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 0x55e4a58c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 0x55e4a58c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46614/0 (socket says 172.21.15.35:46614) 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 -- 172.21.15.35:0/3865332072 learned_addr learned my addr 172.21.15.35:0/3865332072 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842affd700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a58c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842bfff700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a5890cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 -- 172.21.15.35:0/3865332072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 msgr2=0x55e4a58c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a58c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 -- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 msgr2=0x55e4a5890cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a5890cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 -- 172.21.15.35:0/3865332072 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4a56565d0 con 0x55e4a5882960 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842bfff700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a5890cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f842b7fe700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 0x55e4a58c7140 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f841c005850 tx=0x7f841c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37c59f9040038de server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f840affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f840affd700 1 -- 172.21.15.35:0/3865332072 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c035ce0 con 0x55e4a5882960 2023-03-17T09:44:26.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f840affd700 1 -- 172.21.15.35:0/3865332072 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f841c035e40 con 0x55e4a5882960 2023-03-17T09:44:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4a58521e0 con 0x55e4a5882960 2023-03-17T09:44:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f840affd700 1 -- 172.21.15.35:0/3865332072 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f841c035040 con 0x55e4a5882960 2023-03-17T09:44:26.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 10 client.17220 fetch_fsmap learned FSMap version 36 2023-03-17T09:44:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.570+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e4a55ebc00 con 0x55e4a5882960 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f840affd700 1 -- 172.21.15.35:0/3865332072 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e4a58521e0 con 0x55e4a5882960 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f840affd700 1 -- 172.21.15.35:0/3865332072 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f841c03b020 con 0x55e4a5882960 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f843e356b80 10 client.17220 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f843e356b80 10 client.17220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f843e356b80 20 client.17220 populate_metadata read hostname 'smithi035' 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f843e356b80 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a58ceca0 0x55e4a58d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f843e356b80 4 client.17220 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:44:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e4a5658f00 con 0x55e4a58ceca0 2023-03-17T09:44:26.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:08 smithi035 ceph-mon[92535]: pgmap v1568: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:44:27.803 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:16 smithi078 ceph-mon[94114]: pgmap v1050: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:44:27.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:16 smithi078 ceph-mon[94114]: daemon mds.e restarted 2023-03-17T09:44:27.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:16 smithi078 ceph-mon[94114]: osdmap e143: 12 total, 12 up, 12 in 2023-03-17T09:44:27.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:17 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.78:6834/649712286,v1:172.21.15.78:6835/649712286] up:boot 2023-03-17T09:44:27.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:17 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-03-17T09:44:27.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T09:44:27.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:17 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:18 smithi078 ceph-mon[94114]: pgmap v1052: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:20 smithi078 ceph-mon[94114]: pgmap v1053: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 563 B/s wr, 10 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:22 smithi078 ceph-mon[94114]: pgmap v1054: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:24 smithi078 ceph-mon[94114]: pgmap v1055: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:26 smithi078 ceph-mon[94114]: pgmap v1056: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:28 smithi078 ceph-mon[94114]: pgmap v1057: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:30 smithi078 ceph-mon[94114]: pgmap v1058: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:32 smithi078 ceph-mon[94114]: pgmap v1059: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:34 smithi078 ceph-mon[94114]: pgmap v1060: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:36 smithi078 ceph-mon[94114]: pgmap v1061: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:38 smithi078 ceph-mon[94114]: pgmap v1062: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:29.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:40 smithi078 ceph-mon[94114]: pgmap v1063: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:42 smithi078 ceph-mon[94114]: pgmap v1064: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:44 smithi078 ceph-mon[94114]: pgmap v1065: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:29.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:46 smithi078 ceph-mon[94114]: pgmap v1066: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:48 smithi078 ceph-mon[94114]: pgmap v1067: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:29.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:50 smithi078 ceph-mon[94114]: pgmap v1068: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:52 smithi078 ceph-mon[94114]: pgmap v1069: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:54 smithi078 ceph-mon[94114]: pgmap v1070: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:29.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:56 smithi078 ceph-mon[94114]: pgmap v1071: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:29.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:19:58 smithi078 ceph-mon[94114]: pgmap v1072: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:29.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:00 smithi078 ceph-mon[94114]: pgmap v1073: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:30.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:00 smithi078 ceph-mon[94114]: overall HEALTH_OK 2023-03-17T09:44:30.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:02 smithi078 ceph-mon[94114]: pgmap v1074: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:30.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:04 smithi078 ceph-mon[94114]: pgmap v1075: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:44:30.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:06 smithi078 ceph-mon[94114]: pgmap v1076: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:44:30.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:08 smithi078 ceph-mon[94114]: pgmap v1077: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:09 smithi078 ceph-mon[94114]: osdmap e144: 12 total, 12 up, 12 in 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:10 smithi078 ceph-mon[94114]: pgmap v1079: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:12 smithi078 ceph-mon[94114]: pgmap v1080: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:14 smithi078 ceph-mon[94114]: pgmap v1081: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:16 smithi078 ceph-mon[94114]: osdmap e145: 12 total, 12 up, 12 in 2023-03-17T09:44:31.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:16 smithi078 ceph-mon[94114]: pgmap v1083: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:18 smithi078 ceph-mon[94114]: pgmap v1084: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:20 smithi078 ceph-mon[94114]: pgmap v1085: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:22 smithi078 ceph-mon[94114]: pgmap v1086: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:24 smithi078 ceph-mon[94114]: pgmap v1087: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:26 smithi078 ceph-mon[94114]: pgmap v1088: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:28 smithi078 ceph-mon[94114]: pgmap v1089: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:30 smithi078 ceph-mon[94114]: pgmap v1090: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:32 smithi078 ceph-mon[94114]: pgmap v1091: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:34 smithi078 ceph-mon[94114]: pgmap v1092: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:36 smithi078 ceph-mon[94114]: pgmap v1093: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:38 smithi078 ceph-mon[94114]: pgmap v1094: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:44:31.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:40 smithi078 ceph-mon[94114]: pgmap v1095: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:44:32.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:42 smithi078 ceph-mon[94114]: pgmap v1096: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:44:32.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:44 smithi078 ceph-mon[94114]: pgmap v1097: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:44:32.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:46 smithi078 ceph-mon[94114]: pgmap v1098: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:44:32.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:48 smithi078 ceph-mon[94114]: pgmap v1099: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:44:33.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:50 smithi078 ceph-mon[94114]: pgmap v1100: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:33.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:52 smithi078 ceph-mon[94114]: pgmap v1101: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:44:33.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:54 smithi078 ceph-mon[94114]: pgmap v1102: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:44:33.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:56 smithi078 ceph-mon[94114]: pgmap v1103: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:44:33.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:20:58 smithi078 ceph-mon[94114]: pgmap v1104: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:44:33.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:00 smithi078 ceph-mon[94114]: pgmap v1105: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:44:33.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:02 smithi078 ceph-mon[94114]: pgmap v1106: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:44:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f842affd700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a58ceca0 0x55e4a58d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f840affd700 10 client.17220 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:44:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.571+0000 7f842affd700 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a58ceca0 0x55e4a58d10b0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4955bd9792cea61d server_cookie=69266ccf0ecb14f0 in_seq=0 out_seq=0 2023-03-17T09:44:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.575+0000 7f840affd700 1 -- 172.21.15.35:0/3865332072 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e4a5658f00 con 0x55e4a58ceca0 2023-03-17T09:44:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.575+0000 7f840affd700 10 client.17220 handle_command_reply: tid=0 2023-03-17T09:44:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.575+0000 7f843e356b80 1 client.17220 shutdown 2023-03-17T09:44:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 msgr2=0x55e4a58c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:34.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 0x55e4a58c7140 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f841c005850 tx=0x7f841c009310 comp rx=0 tx=0).stop 2023-03-17T09:44:34.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 shutdown_connections 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4a58ceca0 0x55e4a58d10b0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4a58884f0 0x55e4a5890cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4a5882960 0x55e4a58c7140 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 --2- 172.21.15.35:0/3865332072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4a5887be0 0x55e4a58c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f840affd700 0 client.17220 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 >> 172.21.15.35:0/3865332072 conn(0x55e4a56df6b0 msgr2=0x55e4a58856b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 shutdown_connections 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 1 -- 172.21.15.35:0/3865332072 wait complete. 2023-03-17T09:44:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f843e356b80 20 client.17220 trim_cache size 0 max 16384 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f841409f6c0 msgr2=0x7f84140a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f841409f6c0 0x7f84140a1b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f841c006010 tx=0x7f841c003680 comp rx=0 tx=0).stop 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 msgr2=0x7f842c19ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 0x7f842c19ac40 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8424007ee0 tx=0x7f842400d3b0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 shutdown_connections 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f841409f6c0 0x7f84140a1b70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f842c105510 0x7f842c19ac40 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.576+0000 7f84321c9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f842c0fe970 0x7f842c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.577+0000 7f84321c9700 1 --2- 172.21.15.35:0/3434696050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f842c0ff310 0x7f842c1967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.577+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 >> 172.21.15.35:0/3434696050 conn(0x7f842c0757a0 msgr2=0x7f842c0fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.577+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 shutdown_connections 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:21:29.577+0000 7f84321c9700 1 -- 172.21.15.35:0/3434696050 wait complete. 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.077+0000 7fdd41c85700 1 -- 172.21.15.35:0/3158195180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c104390 msgr2=0x7fdd3c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.077+0000 7fdd41c85700 1 --2- 172.21.15.35:0/3158195180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c104390 0x7fdd3c10bf60 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b0d0 tx=0x7fdd3400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 -- 172.21.15.35:0/3158195180 shutdown_connections 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 --2- 172.21.15.35:0/3158195180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c104390 0x7fdd3c10bf60 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 --2- 172.21.15.35:0/3158195180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 --2- 172.21.15.35:0/3158195180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c0ffcf0 0x7fdd3c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 -- 172.21.15.35:0/3158195180 >> 172.21.15.35:0/3158195180 conn(0x7fdd3c076330 msgr2=0x7fdd3c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 -- 172.21.15.35:0/3158195180 shutdown_connections 2023-03-17T09:44:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 -- 172.21.15.35:0/3158195180 wait complete. 2023-03-17T09:44:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.078+0000 7fdd41c85700 1 Processor -- start 2023-03-17T09:44:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 -- start start 2023-03-17T09:44:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c0ffcf0 0x7fdd3c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:42.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c104390 0x7fdd3c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c19b390 con 0x7fdd3c0ff350 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c19b500 con 0x7fdd3c104390 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd41c85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c19b6c0 con 0x7fdd3c0ffcf0 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46628/0 (socket says 172.21.15.35:46628) 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/270496093 learned_addr learned my addr 172.21.15.35:0/270496093 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3affd700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c0ffcf0 0x7fdd3c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c104390 0x7fdd3c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/270496093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c0ffcf0 msgr2=0x7fdd3c1968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c0ffcf0 0x7fdd3c1968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/270496093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c104390 msgr2=0x7fdd3c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c104390 0x7fdd3c19ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/270496093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009d00 con 0x7fdd3c0ff350 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.079+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c1963b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00d950 tx=0x7fdd2c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.080+0000 7fdd38ff9700 1 -- 172.21.15.35:0/270496093 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c009940 con 0x7fdd3c0ff350 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.080+0000 7fdd38ff9700 1 -- 172.21.15.35:0/270496093 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd2c010460 con 0x7fdd3c0ff350 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.080+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c10f010 con 0x7fdd3c0ff350 2023-03-17T09:44:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.080+0000 7fdd38ff9700 1 -- 172.21.15.35:0/270496093 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00f620 con 0x7fdd3c0ff350 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.080+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c10ee80 con 0x7fdd3c0ff350 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.083+0000 7fdd38ff9700 1 -- 172.21.15.35:0/270496093 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdd2c0105d0 con 0x7fdd3c0ff350 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.083+0000 7fdd38ff9700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdd2409f6c0 0x7fdd240a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.083+0000 7fdd38ff9700 1 -- 172.21.15.35:0/270496093 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdd2c0ca3c0 con 0x7fdd3c0ff350 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.083+0000 7fdd3affd700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdd2409f6c0 0x7fdd240a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 Processor -- start 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd3affd700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdd2409f6c0 0x7fdd240a1b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c1979c0 tx=0x7fdd300073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 -- start start 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45123ff0 0x55de451243c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4511e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de4511edc0 0x55de4511f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de45021010 con 0x55de45124900 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de45073950 con 0x55de4511edc0 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4506cde0 con 0x55de45123ff0 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd3affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4511e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd3affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4511e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46638/0 (socket says 172.21.15.35:46638) 2023-03-17T09:44:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd3affd700 1 -- 172.21.15.35:0/2297712734 learned_addr learned my addr 172.21.15.35:0/2297712734 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45123ff0 0x55de451243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.084+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de4511edc0 0x55de4511f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3affd700 1 -- 172.21.15.35:0/2297712734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45123ff0 msgr2=0x55de451243c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3affd700 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45123ff0 0x55de451243c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3affd700 1 -- 172.21.15.35:0/2297712734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de4511edc0 msgr2=0x55de4511f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3affd700 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de4511edc0 0x55de4511f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3affd700 1 -- 172.21.15.35:0/2297712734 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de44eee5d0 con 0x55de45124900 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45123ff0 0x55de451243c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd3affd700 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4511e830 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdd30010d10 tx=0x7fdd30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20a78b9d2d1de2d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd21ffb700 1 -- 172.21.15.35:0/2297712734 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30011b80 con 0x55de45124900 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd21ffb700 1 -- 172.21.15.35:0/2297712734 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd30015070 con 0x55de45124900 2023-03-17T09:44:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.085+0000 7fdd21ffb700 1 -- 172.21.15.35:0/2297712734 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3001c3b0 con 0x55de45124900 2023-03-17T09:44:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 -- 172.21.15.35:0/2297712734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 msgr2=0x55de4511e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4511e830 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdd30010d10 tx=0x7fdd30013000 comp rx=0 tx=0).stop 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 -- 172.21.15.35:0/2297712734 shutdown_connections 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de4511edc0 0x55de4511f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45123ff0 0x55de451243c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/2297712734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4511e830 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 -- 172.21.15.35:0/2297712734 >> 172.21.15.35:0/2297712734 conn(0x55de44f776b0 msgr2=0x55de45114a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 -- 172.21.15.35:0/2297712734 shutdown_connections 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 -- 172.21.15.35:0/2297712734 wait complete. 2023-03-17T09:44:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 -- start start 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.086+0000 7fdd4de12b80 1 Processor -- start 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de45127ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de451281c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de44ef08c0 con 0x55de45124900 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de45128900 con 0x55de45123ff0 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de45134430 con 0x55de4511edc0 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd4de12b80 10 client.0 _ll_register_callbacks cb 0x55de44f12230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:44:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de451281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de451281c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46646/0 (socket says 172.21.15.35:46646) 2023-03-17T09:44:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 -- 172.21.15.35:0/995012929 learned_addr learned my addr 172.21.15.35:0/995012929 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3affd700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de45127ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 -- 172.21.15.35:0/995012929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 msgr2=0x55de4512a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 -- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 msgr2=0x55de45127ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:44:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de45127ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 -- 172.21.15.35:0/995012929 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd300109f0 con 0x55de45124900 2023-03-17T09:44:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de451281c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009300 tx=0x7fdd340093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdc3b53e80791cd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:44:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.087+0000 7fdd1affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:44:49.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd1affd700 1 -- 172.21.15.35:0/995012929 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400e070 con 0x55de45124900 2023-03-17T09:44:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de4502f390 con 0x55de45124900 2023-03-17T09:44:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd1affd700 1 -- 172.21.15.35:0/995012929 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdd34004a50 con 0x55de45124900 2023-03-17T09:44:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd1affd700 1 -- 172.21.15.35:0/995012929 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd340078f0 con 0x55de45124900 2023-03-17T09:44:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 10 client.17232 fetch_fsmap learned FSMap version 36 2023-03-17T09:44:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55de44e9ad80 con 0x55de45124900 2023-03-17T09:44:50.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd1affd700 1 -- 172.21.15.35:0/995012929 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de4502f390 con 0x55de45124900 2023-03-17T09:44:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd1affd700 1 -- 172.21.15.35:0/995012929 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdd3400b100 con 0x55de45124900 2023-03-17T09:44:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 10 client.17232 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:44:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 10 client.17232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:44:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 20 client.17232 populate_metadata read hostname 'smithi035' 2023-03-17T09:44:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de45138560 0x55de4513a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:51.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 4 client.17232 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:44:51.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de4503b600 con 0x55de45138560 2023-03-17T09:44:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.088+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de45138560 0x55de4513a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.089+0000 7fdd1affd700 10 client.17232 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:44:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.089+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de45138560 0x55de4513a970 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6340d32b5ccdb97b server_cookie=5be5341dd9edcf88 in_seq=0 out_seq=0 2023-03-17T09:44:52.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd1affd700 1 -- 172.21.15.35:0/995012929 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55de4503b600 con 0x55de45138560 2023-03-17T09:44:52.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd1affd700 10 client.17232 handle_command_reply: tid=0 2023-03-17T09:44:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 client.17232 shutdown 2023-03-17T09:44:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 msgr2=0x55de451281c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:44:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de451281c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009300 tx=0x7fdd340093e0 comp rx=0 tx=0).stop 2023-03-17T09:44:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 shutdown_connections 2023-03-17T09:44:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de45138560 0x55de4513a970 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de451281c0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd1affd700 0 client.17232 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:44:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/995012929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de45127ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:44:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 >> 172.21.15.35:0/995012929 conn(0x55de44f776b0 msgr2=0x55de45119410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:44:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 shutdown_connections 2023-03-17T09:44:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 1 -- 172.21.15.35:0/995012929 wait complete. 2023-03-17T09:44:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.090+0000 7fdd4de12b80 20 client.17232 trim_cache size 0 max 16384 2023-03-17T09:44:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 Processor -- start 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 -- start start 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 0x55de451280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45124900 0x55de4512a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de45123c60 con 0x55de4511edc0 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de451156b0 con 0x55de45123ff0 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de45111b60 con 0x55de45124900 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 0x55de451280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:44:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 0x55de451280d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46650/0 (socket says 172.21.15.35:46650) 2023-03-17T09:44:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/1156318498 learned_addr learned my addr 172.21.15.35:0/1156318498 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:44:55.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:09 smithi035 ceph-mon[92535]: osdmap e174: 12 total, 12 up, 12 in 2023-03-17T09:44:57.043 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: in thread 7f944dc17700 thread_name:md_log_replay 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f945e7c1cf0] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55b63067371f] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b630675953] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 4: (MDLog::_replay_thread()+0x66d) [0x55b6306e107d] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b630394d91] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f945e7b71ca] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 7: clone() 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:21:03.578+0000 7f944dc17700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: in thread 7f944dc17700 thread_name:md_log_replay 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f945e7c1cf0] 2023-03-17T09:44:57.044 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55b63067371f] 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b630675953] 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 4: (MDLog::_replay_thread()+0x66d) [0x55b6306e107d] 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b630394d91] 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f945e7b71ca] 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 7: clone() 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 0> 2023-03-17T09:21:03.578+0000 7f944dc17700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: in thread 7f944dc17700 thread_name:md_log_replay 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f945e7c1cf0] 2023-03-17T09:44:57.045 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55b63067371f] 2023-03-17T09:44:57.821 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b630675953] 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 4: (MDLog::_replay_thread()+0x66d) [0x55b6306e107d] 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b630394d91] 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f945e7b71ca] 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 7: clone() 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 0> 2023-03-17T09:21:03.578+0000 7f944dc17700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:44:57.822 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: in thread 7f944dc17700 thread_name:md_log_replay 2023-03-17T09:44:57.823 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:44:57.823 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:44:57.823 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f945e7c1cf0] 2023-03-17T09:44:57.823 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55b63067371f] 2023-03-17T09:44:57.823 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55b630675953] 2023-03-17T09:44:59.460 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 4: (MDLog::_replay_thread()+0x66d) [0x55b6306e107d] 2023-03-17T09:44:59.461 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55b630394d91] 2023-03-17T09:44:59.461 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f945e7b71ca] 2023-03-17T09:44:59.461 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 7: clone() 2023-03-17T09:44:59.461 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:45:00.247 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-e[138238]: 2023-03-17T09:45:00.247 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:03 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:45:00.247 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:04 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.105+0000 7fdd3affd700 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45124900 0x55de4512a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/1156318498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45124900 msgr2=0x55de4512a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45124900 0x55de4512a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/1156318498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 msgr2=0x55de4512f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3b7fe700 1 -- 172.21.15.35:0/1156318498 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de45033130 con 0x55de4511edc0 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45124900 0x55de4512a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 0x55de451280d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0c7bb0 tx=0x7fdd2c010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d2c839eb675d0e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd227fc700 1 -- 172.21.15.35:0/1156318498 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0c5070 con 0x55de4511edc0 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd227fc700 1 -- 172.21.15.35:0/1156318498 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd2c0b0180 con 0x55de4511edc0 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.106+0000 7fdd227fc700 1 -- 172.21.15.35:0/1156318498 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c097360 con 0x55de4511edc0 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- 172.21.15.35:0/1156318498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 msgr2=0x55de451280d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 0x55de451280d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0c7bb0 tx=0x7fdd2c010f50 comp rx=0 tx=0).stop 2023-03-17T09:45:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- 172.21.15.35:0/1156318498 shutdown_connections 2023-03-17T09:45:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de45124900 0x55de4512a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de4511edc0 0x55de451280d0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/1156318498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- 172.21.15.35:0/1156318498 >> 172.21.15.35:0/1156318498 conn(0x55de44f776b0 msgr2=0x55de45121a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- 172.21.15.35:0/1156318498 shutdown_connections 2023-03-17T09:45:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- 172.21.15.35:0/1156318498 wait complete. 2023-03-17T09:45:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- start start 2023-03-17T09:45:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 Processor -- start 2023-03-17T09:45:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4512dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4512e3c0 con 0x55de45124900 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4512e530 con 0x55de45123ff0 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.107+0000 7fdd4de12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4518c3d0 con 0x55de4511edc0 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd4de12b80 10 client.0 _ll_register_callbacks cb 0x55de44f12230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4512dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4512dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46660/0 (socket says 172.21.15.35:46660) 2023-03-17T09:45:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 -- 172.21.15.35:0/3571034191 learned_addr learned my addr 172.21.15.35:0/3571034191 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3affd700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 -- 172.21.15.35:0/3571034191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 msgr2=0x55de4512f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 -- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 msgr2=0x55de4512d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 -- 172.21.15.35:0/3571034191 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c10ee80 con 0x55de45124900 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd3bfff700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4512dcf0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b820 tx=0x7fdd34006230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a49be6715c4d9f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd1affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd1affd700 1 -- 172.21.15.35:0/3571034191 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400e040 con 0x55de45124900 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de450ea1e0 con 0x55de45124900 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd1affd700 1 -- 172.21.15.35:0/3571034191 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdd3401c5d0 con 0x55de45124900 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd1affd700 1 -- 172.21.15.35:0/3571034191 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd3401c790 con 0x55de45124900 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd4de12b80 10 client.17238 fetch_fsmap learned FSMap version 36 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.108+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55de44ec11f0 con 0x55de45124900 2023-03-17T09:45:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd1affd700 1 -- 172.21.15.35:0/3571034191 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55de450ea1e0 con 0x55de45124900 2023-03-17T09:45:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd1affd700 1 -- 172.21.15.35:0/3571034191 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdd34034030 con 0x55de45124900 2023-03-17T09:45:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd4de12b80 10 client.17238 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:45:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd4de12b80 10 client.17238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd4de12b80 20 client.17238 populate_metadata read hostname 'smithi035' 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de4518d700 0x55de4518fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd4de12b80 4 client.17238 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55de44ef0f00 con 0x55de4518d700 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.109+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de4518d700 0x55de4518fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.110+0000 7fdd3b7fe700 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de4518d700 0x55de4518fb10 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdbe7567ef2d3d1 server_cookie=6c9e73fd7b29f770 in_seq=0 out_seq=0 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.110+0000 7fdd1affd700 10 client.17238 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:06.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd1affd700 1 -- 172.21.15.35:0/3571034191 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55de44ef0f00 con 0x55de4518d700 2023-03-17T09:45:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd1affd700 10 client.17238 handle_command_reply: tid=0 2023-03-17T09:45:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 client.17238 shutdown 2023-03-17T09:45:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 msgr2=0x55de4512dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4512dcf0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b820 tx=0x7fdd34006230 comp rx=0 tx=0).stop 2023-03-17T09:45:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 shutdown_connections 2023-03-17T09:45:08.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55de4518d700 0x55de4518fb10 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:08.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55de45124900 0x55de4512dcf0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd1affd700 0 client.17238 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de4511edc0 0x55de4512f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 --2- 172.21.15.35:0/3571034191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de45123ff0 0x55de4512d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:08.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 >> 172.21.15.35:0/3571034191 conn(0x55de44f776b0 msgr2=0x55de45122a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 shutdown_connections 2023-03-17T09:45:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 1 -- 172.21.15.35:0/3571034191 wait complete. 2023-03-17T09:45:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd4de12b80 20 client.17238 trim_cache size 0 max 16384 2023-03-17T09:45:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdd2409f6c0 msgr2=0x7fdd240a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd41c85700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdd2409f6c0 0x7fdd240a1b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c1979c0 tx=0x7fdd300073d0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 msgr2=0x7fdd3c1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.118+0000 7fdd41c85700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c1963b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00d950 tx=0x7fdd2c00dc60 comp rx=0 tx=0).stop 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 shutdown_connections 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdd2409f6c0 0x7fdd240a1b70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c104390 0x7fdd3c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdd3c0ff350 0x7fdd3c1963b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 --2- 172.21.15.35:0/270496093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd3c0ffcf0 0x7fdd3c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 >> 172.21.15.35:0/270496093 conn(0x7fdd3c076330 msgr2=0x7fdd3c068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 shutdown_connections 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:29.119+0000 7fdd41c85700 1 -- 172.21.15.35:0/270496093 wait complete. 2023-03-17T09:45:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 -- 172.21.15.35:0/587670022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e01054f0 msgr2=0x7ff0e010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 --2- 172.21.15.35:0/587670022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e01054f0 0x7ff0e010d100 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800b0d0 tx=0x7ff0d800b3e0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 -- 172.21.15.35:0/587670022 shutdown_connections 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 --2- 172.21.15.35:0/587670022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e01054f0 0x7ff0e010d100 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 --2- 172.21.15.35:0/587670022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0100be0 0x7ff0e0100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 --2- 172.21.15.35:0/587670022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e0101580 0x7ff0e0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 -- 172.21.15.35:0/587670022 >> 172.21.15.35:0/587670022 conn(0x7ff0e00774e0 msgr2=0x7ff0e00778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 -- 172.21.15.35:0/587670022 shutdown_connections 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.240+0000 7ff0e792f700 1 -- 172.21.15.35:0/587670022 wait complete. 2023-03-17T09:45:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 Processor -- start 2023-03-17T09:45:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 -- start start 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 0x7ff0e0196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0101580 0x7ff0e0196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e01054f0 0x7ff0e019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e019b330 con 0x7ff0e0100be0 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e019b4a0 con 0x7ff0e0101580 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e792f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e019b660 con 0x7ff0e01054f0 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e56cb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 0x7ff0e0196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e56cb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 0x7ff0e0196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46684/0 (socket says 172.21.15.35:46684) 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e56cb700 1 -- 172.21.15.35:0/3879346800 learned_addr learned my addr 172.21.15.35:0/3879346800 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e01054f0 0x7ff0e019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.241+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0101580 0x7ff0e0196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e56cb700 1 -- 172.21.15.35:0/3879346800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e01054f0 msgr2=0x7ff0e019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e01054f0 0x7ff0e019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e56cb700 1 -- 172.21.15.35:0/3879346800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0101580 msgr2=0x7ff0e0196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0101580 0x7ff0e0196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e56cb700 1 -- 172.21.15.35:0/3879346800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009d00 con 0x7ff0e0100be0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0101580 0x7ff0e0196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 0x7ff0e0196350 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c920 tx=0x7ff0d000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0d67fc700 1 -- 172.21.15.35:0/3879346800 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0007b00 con 0x7ff0e0100be0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e01101c0 con 0x7ff0e0100be0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0d67fc700 1 -- 172.21.15.35:0/3879346800 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d000ce70 con 0x7ff0e0100be0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0d67fc700 1 -- 172.21.15.35:0/3879346800 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00053e0 con 0x7ff0e0100be0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.242+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0110030 con 0x7ff0e0100be0 2023-03-17T09:45:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.244+0000 7ff0d67fc700 1 -- 172.21.15.35:0/3879346800 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff0d0005580 con 0x7ff0e0100be0 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.245+0000 7ff0d67fc700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff0cc09f640 0x7ff0cc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.245+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff0cc09f640 0x7ff0cc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.245+0000 7ff0d67fc700 1 -- 172.21.15.35:0/3879346800 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff0d00ca220 con 0x7ff0e0100be0 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff0cc09f640 0x7ff0cc0a1af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc005e10 tx=0x7ff0dc005d60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 Processor -- start 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 -- start start 2023-03-17T09:45:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858683fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x56485867e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485867ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564858585010 con 0x56485867e960 2023-03-17T09:45:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648585d7950 con 0x564858683be0 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648585d0de0 con 0x5648586844f0 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0e5ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485867ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0e5ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485867ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46696/0 (socket says 172.21.15.35:46696) 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/2296613142 learned_addr learned my addr 172.21.15.35:0/2296613142 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.246+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x56485867e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858683fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/2296613142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 msgr2=0x56485867e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x56485867e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/2296613142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 msgr2=0x564858683fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858683fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/2296613142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648584525d0 con 0x56485867e960 2023-03-17T09:45:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485867ed90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009230 tx=0x7ff0d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375073e2a88f64a8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0cb7fe700 1 -- 172.21.15.35:0/2296613142 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800e070 con 0x56485867e960 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0cb7fe700 1 -- 172.21.15.35:0/2296613142 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d8003e90 con 0x56485867e960 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.247+0000 7ff0cb7fe700 1 -- 172.21.15.35:0/2296613142 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8005570 con 0x56485867e960 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2296613142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 msgr2=0x56485867ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485867ed90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009230 tx=0x7ff0d8009260 comp rx=0 tx=0).stop 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2296613142 shutdown_connections 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485867ed90 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858683fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2296613142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x56485867e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2296613142 >> 172.21.15.35:0/2296613142 conn(0x5648584db6b0 msgr2=0x564858678a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2296613142 shutdown_connections 2023-03-17T09:45:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2296613142 wait complete. 2023-03-17T09:45:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 -- start start 2023-03-17T09:45:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.248+0000 7ff0f3abcb80 1 Processor -- start 2023-03-17T09:45:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485868a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564858683be0 0x5648586876e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:12.072 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:10 smithi035 ceph-mon[92535]: pgmap v1570: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:45:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648586844f0 0x564858687d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648584548c0 con 0x56485867e960 2023-03-17T09:45:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564858688490 con 0x5648586844f0 2023-03-17T09:45:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564858693fd0 con 0x564858683be0 2023-03-17T09:45:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0f3abcb80 10 client.0 _ll_register_callbacks cb 0x564858476230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:45:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485868a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485868a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46698/0 (socket says 172.21.15.35:46698) 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 -- 172.21.15.35:0/1136497346 learned_addr learned my addr 172.21.15.35:0/1136497346 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564858683be0 0x5648586876e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648586844f0 0x564858687d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 -- 172.21.15.35:0/1136497346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564858683be0 msgr2=0x5648586876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564858683be0 0x5648586876e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 -- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648586844f0 msgr2=0x564858687d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648586844f0 0x564858687d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 -- 172.21.15.35:0/1136497346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e010d940 con 0x56485867e960 2023-03-17T09:45:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648586844f0 0x564858687d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:45:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485868a460 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00c7a60 tx=0x7ff0d00976e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13be71d2a94bf440 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.249+0000 7ff0c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:45:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1136497346 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d009a050 con 0x56485867e960 2023-03-17T09:45:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1136497346 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff0d009fec0 con 0x56485867e960 2023-03-17T09:45:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564858593390 con 0x56485867e960 2023-03-17T09:45:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1136497346 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d00971c0 con 0x56485867e960 2023-03-17T09:45:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 10 client.17256 fetch_fsmap learned FSMap version 36 2023-03-17T09:45:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5648583fed80 con 0x56485867e960 2023-03-17T09:45:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1136497346 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d0062080 con 0x56485867e960 2023-03-17T09:45:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1136497346 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff0d0096c30 con 0x56485867e960 2023-03-17T09:45:18.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 10 client.17256 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:45:18.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 10 client.17256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:45:18.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 20 client.17256 populate_metadata read hostname 'smithi035' 2023-03-17T09:45:18.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564858697f50 0x56485869a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 4 client.17256 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:45:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56485859f600 con 0x564858697f50 2023-03-17T09:45:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.250+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564858697f50 0x56485869a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:19.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.251+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564858697f50 0x56485869a330 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6846786634236ba server_cookie=c65308315134cd15 in_seq=0 out_seq=0 2023-03-17T09:45:19.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.251+0000 7ff0c8ff9700 10 client.17256 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:19.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1136497346 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56485859f600 con 0x564858697f50 2023-03-17T09:45:19.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0c8ff9700 10 client.17256 handle_command_reply: tid=0 2023-03-17T09:45:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 client.17256 shutdown 2023-03-17T09:45:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 msgr2=0x56485868a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485868a460 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00c7a60 tx=0x7ff0d00976e0 comp rx=0 tx=0).stop 2023-03-17T09:45:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 shutdown_connections 2023-03-17T09:45:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564858697f50 0x56485869a330 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648586844f0 0x564858687d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x56485868a460 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0c8ff9700 0 client.17256 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1136497346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564858683be0 0x5648586876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 >> 172.21.15.35:0/1136497346 conn(0x5648584db6b0 msgr2=0x564858678a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 shutdown_connections 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1136497346 wait complete. 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.252+0000 7ff0f3abcb80 20 client.17256 trim_cache size 0 max 16384 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 Processor -- start 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 -- start start 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x564858678ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x56485868ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x564858682f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564858679000 con 0x56485867e960 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648586755c0 con 0x564858683be0 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564858679e10 con 0x5648586844f0 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0e56cb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x564858678ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0e56cb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x564858678ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46706/0 (socket says 172.21.15.35:46706) 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.267+0000 7ff0e56cb700 1 -- 172.21.15.35:0/2166581015 learned_addr learned my addr 172.21.15.35:0/2166581015 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x56485868ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e56cb700 1 -- 172.21.15.35:0/2166581015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 msgr2=0x564858682f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x564858682f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e56cb700 1 -- 172.21.15.35:0/2166581015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 msgr2=0x56485868ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x56485868ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e56cb700 1 -- 172.21.15.35:0/2166581015 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56485867f000 con 0x56485867e960 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x564858678ac0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0096020 tx=0x7ff0d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfb5269fbd27005 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0cbfff700 1 -- 172.21.15.35:0/2166581015 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0079070 con 0x56485867e960 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0cbfff700 1 -- 172.21.15.35:0/2166581015 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564858593390 con 0x56485867e960 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0cbfff700 1 -- 172.21.15.35:0/2166581015 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d009a040 con 0x56485867e960 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2166581015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 msgr2=0x564858678ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x564858678ac0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0096020 tx=0x7ff0d0000bc0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2166581015 shutdown_connections 2023-03-17T09:45:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648586844f0 0x564858682f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56485867e960 0x564858678ac0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/2166581015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x56485868ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.268+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2166581015 >> 172.21.15.35:0/2166581015 conn(0x5648584db6b0 msgr2=0x564858682800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2166581015 shutdown_connections 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/2166581015 wait complete. 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 -- start start 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 Processor -- start 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56485867e960 0x5648586809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858680ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 0x56485867f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485867fbe0 con 0x5648586844f0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485867fd50 con 0x564858683be0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485867ff10 con 0x56485867e960 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0f3abcb80 10 client.0 _ll_register_callbacks cb 0x564858476230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0e5ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 0x56485867f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.269+0000 7ff0e5ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 0x56485867f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46716/0 (socket says 172.21.15.35:46716) 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/1313143014 learned_addr learned my addr 172.21.15.35:0/1313143014 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e4eca700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858680ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56485867e960 0x5648586809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/1313143014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56485867e960 msgr2=0x5648586809b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56485867e960 0x5648586809b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 msgr2=0x564858680ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858680ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 -- 172.21.15.35:0/1313143014 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648583fed80 con 0x5648586844f0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0e5ecc700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 0x56485867f6a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009230 tx=0x7ff0d8009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de67084f830c8a19 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:45:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1313143014 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800e040 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1313143014 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff0d80078b0 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56485864e1e0 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1313143014 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d8003ea0 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0f3abcb80 10 client.17262 fetch_fsmap learned FSMap version 36 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.270+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5648583e7c00 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1313143014 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56485864e1e0 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1313143014 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff0d8019050 con 0x5648586844f0 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0f3abcb80 10 client.17262 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0f3abcb80 10 client.17262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0f3abcb80 20 client.17262 populate_metadata read hostname 'smithi035' 2023-03-17T09:45:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5648586ec950 0x5648586eed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0f3abcb80 4 client.17262 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:45:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564858454f00 con 0x5648586ec950 2023-03-17T09:45:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5648586ec950 0x5648586eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0c8ff9700 10 client.17262 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.271+0000 7ff0e56cb700 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5648586ec950 0x5648586eed30 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db23da02b10068b server_cookie=9a5b1a703cdf9fe5 in_seq=0 out_seq=0 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.275+0000 7ff0c8ff9700 1 -- 172.21.15.35:0/1313143014 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564858454f00 con 0x5648586ec950 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0c8ff9700 10 client.17262 handle_command_reply: tid=0 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 client.17262 shutdown 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 msgr2=0x56485867f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 0x56485867f6a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009230 tx=0x7ff0d8009480 comp rx=0 tx=0).stop 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 shutdown_connections 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5648586ec950 0x5648586eed30 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5648586844f0 0x56485867f6a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56485867e960 0x5648586809b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 --2- 172.21.15.35:0/1313143014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564858683be0 0x564858680ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0c8ff9700 0 client.17262 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 >> 172.21.15.35:0/1313143014 conn(0x5648584db6b0 msgr2=0x564858683090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 shutdown_connections 2023-03-17T09:45:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 1 -- 172.21.15.35:0/1313143014 wait complete. 2023-03-17T09:45:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0f3abcb80 20 client.17262 trim_cache size 0 max 16384 2023-03-17T09:45:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff0cc09f640 msgr2=0x7ff0cc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0e792f700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff0cc09f640 0x7ff0cc0a1af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc005e10 tx=0x7ff0dc005d60 comp rx=0 tx=0).stop 2023-03-17T09:45:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 msgr2=0x7ff0e0196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.276+0000 7ff0e792f700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 0x7ff0e0196350 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c920 tx=0x7ff0d000cc30 comp rx=0 tx=0).stop 2023-03-17T09:45:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 shutdown_connections 2023-03-17T09:45:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff0cc09f640 0x7ff0cc0a1af0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0e01054f0 0x7ff0e019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0e0100be0 0x7ff0e0196350 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 --2- 172.21.15.35:0/3879346800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e0101580 0x7ff0e0196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 >> 172.21.15.35:0/3879346800 conn(0x7ff0e00774e0 msgr2=0x7ff0e00fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 shutdown_connections 2023-03-17T09:45:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:42.277+0000 7ff0e792f700 1 -- 172.21.15.35:0/3879346800 wait complete. 2023-03-17T09:45:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.398+0000 7fc8c56d1700 1 -- 172.21.15.35:0/803577465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c01044d0 msgr2=0x7fc8c010c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.398+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/803577465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c01044d0 0x7fc8c010c0a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b0d0 tx=0x7fc8b800b3e0 comp rx=0 tx=0).stop 2023-03-17T09:45:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 -- 172.21.15.35:0/803577465 shutdown_connections 2023-03-17T09:45:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/803577465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c01044d0 0x7fc8c010c0a0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/803577465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c00ff4b0 0x7fc8c00ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/803577465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c00ffe50 0x7fc8c0103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 -- 172.21.15.35:0/803577465 >> 172.21.15.35:0/803577465 conn(0x7fc8c0077220 msgr2=0x7fc8c0077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 -- 172.21.15.35:0/803577465 shutdown_connections 2023-03-17T09:45:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 -- 172.21.15.35:0/803577465 wait complete. 2023-03-17T09:45:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 Processor -- start 2023-03-17T09:45:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.399+0000 7fc8c56d1700 1 -- start start 2023-03-17T09:45:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8c56d1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c00ff4b0 0x7fc8c0100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8c56d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 0x7fc8c01013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8c56d1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c01044d0 0x7fc8c01a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:31.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8c56d1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0101c00 con 0x7fc8c00ffe50 2023-03-17T09:45:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8c56d1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c01a4b10 con 0x7fc8c00ff4b0 2023-03-17T09:45:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8c56d1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c01a4c50 con 0x7fc8c01044d0 2023-03-17T09:45:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 0x7fc8c01013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 0x7fc8c01013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46728/0 (socket says 172.21.15.35:46728) 2023-03-17T09:45:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 -- 172.21.15.35:0/2229806356 learned_addr learned my addr 172.21.15.35:0/2229806356 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:31.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c01044d0 0x7fc8c01a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:04 smithi078 ceph-mon[94114]: pgmap v1107: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:04 smithi078 ceph-mon[94114]: osdmap e146: 12 total, 12 up, 12 in 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:06 smithi078 ceph-mon[94114]: pgmap v1109: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:08 smithi078 ceph-mon[94114]: pgmap v1110: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:10 smithi078 ceph-mon[94114]: pgmap v1111: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:10 smithi078 ceph-mon[94114]: osdmap e147: 12 total, 12 up, 12 in 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:12 smithi078 ceph-mon[94114]: pgmap v1113: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:45:31.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:45:32.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:12 smithi035 ceph-mon[92535]: pgmap v1571: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:45:32.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:14 smithi035 ceph-mon[92535]: pgmap v1572: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:45:32.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:16 smithi035 ceph-mon[92535]: osdmap e175: 12 total, 12 up, 12 in 2023-03-17T09:45:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:16 smithi035 ceph-mon[92535]: pgmap v1574: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:45:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:18 smithi035 ceph-mon[92535]: pgmap v1575: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:45:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:20 smithi035 ceph-mon[92535]: pgmap v1576: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:45:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:22 smithi035 ceph-mon[92535]: pgmap v1577: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:45:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:24 smithi035 ceph-mon[92535]: pgmap v1578: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:26 smithi035 ceph-mon[92535]: pgmap v1579: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:28 smithi035 ceph-mon[92535]: pgmap v1580: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:29 smithi035 ceph-mon[92535]: pgmap v1581: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:29 smithi035 ceph-mon[92535]: pgmap v1582: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:45:33.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:31 smithi035 ceph-mon[92535]: pgmap v1583: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:45:33.919 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:45:33.919 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Scheduled restart job, restart counter is at 6. 2023-03-17T09:45:33.919 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:14 smithi078 systemd[1]: Stopped Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:45:33.919 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Start request repeated too quickly. 2023-03-17T09:45:33.919 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:14 smithi078 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.e.service: Failed with result 'exit-code'. 2023-03-17T09:45:33.919 INFO:journalctl@ceph.mds.e.smithi078.stdout:Mar 17 09:21:14 smithi078 systemd[1]: Failed to start Ceph mds.e for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:45:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c00ff4b0 0x7fc8c0100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 -- 172.21.15.35:0/2229806356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c01044d0 msgr2=0x7fc8c01a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c01044d0 0x7fc8c01a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 -- 172.21.15.35:0/2229806356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c00ff4b0 msgr2=0x7fc8c0100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c00ff4b0 0x7fc8c0100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 -- 172.21.15.35:0/2229806356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8009d00 con 0x7fc8c00ffe50 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.400+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 0x7fc8c01013d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800d980 tx=0x7fc8a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.401+0000 7fc8b7fff700 1 -- 172.21.15.35:0/2229806356 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004a30 con 0x7fc8c00ffe50 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.401+0000 7fc8b7fff700 1 -- 172.21.15.35:0/2229806356 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8a80054b0 con 0x7fc8c00ffe50 2023-03-17T09:45:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.401+0000 7fc8b7fff700 1 -- 172.21.15.35:0/2229806356 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800fb50 con 0x7fc8c00ffe50 2023-03-17T09:45:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.401+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c010f170 con 0x7fc8c00ffe50 2023-03-17T09:45:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.401+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c010efe0 con 0x7fc8c00ffe50 2023-03-17T09:45:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.403+0000 7fc8b7fff700 1 -- 172.21.15.35:0/2229806356 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc8a8004c20 con 0x7fc8c00ffe50 2023-03-17T09:45:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.403+0000 7fc8b7fff700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8ac09f640 0x7fc8ac0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.403+0000 7fc8b7fff700 1 -- 172.21.15.35:0/2229806356 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc8a80c9d40 con 0x7fc8c00ffe50 2023-03-17T09:45:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.404+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8ac09f640 0x7fc8ac0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.404+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8ac09f640 0x7fc8ac0a1af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0005950 tx=0x7fc8b000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.404+0000 7fc8d185eb80 1 Processor -- start 2023-03-17T09:45:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.404+0000 7fc8d185eb80 1 -- start start 2023-03-17T09:45:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca25a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca25ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca161010 con 0x55e6ca25a960 2023-03-17T09:45:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca1b3950 con 0x55e6ca25fbe0 2023-03-17T09:45:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca1acde0 con 0x55e6ca2604f0 2023-03-17T09:45:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca25ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca25ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46738/0 (socket says 172.21.15.35:46738) 2023-03-17T09:45:40.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/2120079663 learned_addr learned my addr 172.21.15.35:0/2120079663 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca25a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/2120079663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 msgr2=0x55e6ca25a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca25a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/2120079663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 msgr2=0x55e6ca25ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/2120079663 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6ca02e5d0 con 0x55e6ca25a960 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.405+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.406+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca25ad90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80090d0 tx=0x7fc8b8009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755ea6115c58b632 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.406+0000 7fc8b57fa700 1 -- 172.21.15.35:0/2120079663 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800e070 con 0x55e6ca25a960 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.406+0000 7fc8b57fa700 1 -- 172.21.15.35:0/2120079663 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8b8003a00 con 0x55e6ca25a960 2023-03-17T09:45:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.406+0000 7fc8b57fa700 1 -- 172.21.15.35:0/2120079663 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8005530 con 0x55e6ca25a960 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.406+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2120079663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 msgr2=0x55e6ca25ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.406+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca25ad90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80090d0 tx=0x7fc8b8009100 comp rx=0 tx=0).stop 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2120079663 shutdown_connections 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca25ad90 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2120079663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca25a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2120079663 >> 172.21.15.35:0/2120079663 conn(0x55e6ca0b76b0 msgr2=0x55e6ca254a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2120079663 shutdown_connections 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2120079663 wait complete. 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- start start 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 Processor -- start 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca266460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:42.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 0x55e6ca263d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca0308c0 con 0x55e6ca2604f0 2023-03-17T09:45:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca264490 con 0x55e6ca25a960 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca26ffa0 con 0x55e6ca25fbe0 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8d185eb80 10 client.0 _ll_register_callbacks cb 0x55e6ca052230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.407+0000 7fc8bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 0x55e6ca263d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 0x55e6ca263d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46744/0 (socket says 172.21.15.35:46744) 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/706611934 learned_addr learned my addr 172.21.15.35:0/706611934 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8beffd700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca266460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:43.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/706611934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca25fbe0 msgr2=0x55e6ca2636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 msgr2=0x55e6ca266460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca266460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 -- 172.21.15.35:0/706611934 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c010c8b0 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8beffd700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca266460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 0x55e6ca263d60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b820 tx=0x7fc8b8006180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b989c4fb21a26eb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8a67fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8a67fc700 1 -- 172.21.15.35:0/706611934 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800e070 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8a67fc700 1 -- 172.21.15.35:0/706611934 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc8b8005110 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6ca16f390 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8a67fc700 1 -- 172.21.15.35:0/706611934 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b80052d0 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8d185eb80 10 client.17274 fetch_fsmap learned FSMap version 36 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.408+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e6c9fdad80 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8a67fc700 1 -- 172.21.15.35:0/706611934 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e6ca16f390 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8a67fc700 1 -- 172.21.15.35:0/706611934 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc8b8019050 con 0x55e6ca2604f0 2023-03-17T09:45:43.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8d185eb80 10 client.17274 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:45:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8d185eb80 10 client.17274 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:45:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8d185eb80 20 client.17274 populate_metadata read hostname 'smithi035' 2023-03-17T09:45:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca273c30 0x55e6ca276010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8d185eb80 4 client.17274 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:45:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6ca17b600 con 0x55e6ca273c30 2023-03-17T09:45:43.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8beffd700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca273c30 0x55e6ca276010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8a67fc700 10 client.17274 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.409+0000 7fc8beffd700 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca273c30 0x55e6ca276010 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cce4424607ebf40 server_cookie=aa8d2ed68bca09a3 in_seq=0 out_seq=0 2023-03-17T09:45:44.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8a67fc700 1 -- 172.21.15.35:0/706611934 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e6ca17b600 con 0x55e6ca273c30 2023-03-17T09:45:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8a67fc700 10 client.17274 handle_command_reply: tid=0 2023-03-17T09:45:44.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 client.17274 shutdown 2023-03-17T09:45:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 msgr2=0x55e6ca263d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 0x55e6ca263d60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b820 tx=0x7fc8b8006180 comp rx=0 tx=0).stop 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 shutdown_connections 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca273c30 0x55e6ca276010 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca2604f0 0x55e6ca263d60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca266460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8a67fc700 0 client.17274 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/706611934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 >> 172.21.15.35:0/706611934 conn(0x55e6ca0b76b0 msgr2=0x55e6ca254a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 shutdown_connections 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 1 -- 172.21.15.35:0/706611934 wait complete. 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.410+0000 7fc8d185eb80 20 client.17274 trim_cache size 0 max 16384 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.425+0000 7fc8d185eb80 1 Processor -- start 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.425+0000 7fc8d185eb80 1 -- start start 2023-03-17T09:45:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca254ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca266000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca255000 con 0x55e6ca25fbe0 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca2515c0 con 0x55e6ca25a960 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca255e40 con 0x55e6ca2604f0 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46750/0 (socket says 172.21.15.35:46750) 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 -- 172.21.15.35:0/4220531447 learned_addr learned my addr 172.21.15.35:0/4220531447 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca266000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8beffd700 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca254ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 -- 172.21.15.35:0/4220531447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 msgr2=0x55e6ca266000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca266000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 -- 172.21.15.35:0/4220531447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 msgr2=0x55e6ca254ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca254ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 -- 172.21.15.35:0/4220531447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6ca25b000 con 0x55e6ca25fbe0 2023-03-17T09:45:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ef10 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8097780 tx=0x7fc8a8097150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916e5725807fc20f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.426+0000 7fc8b5ffb700 1 -- 172.21.15.35:0/4220531447 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80ad030 con 0x55e6ca25fbe0 2023-03-17T09:45:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8b5ffb700 1 -- 172.21.15.35:0/4220531447 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8a809f9e0 con 0x55e6ca25fbe0 2023-03-17T09:45:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8b5ffb700 1 -- 172.21.15.35:0/4220531447 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8097c90 con 0x55e6ca25fbe0 2023-03-17T09:45:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 -- 172.21.15.35:0/4220531447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 msgr2=0x55e6ca25ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ef10 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8097780 tx=0x7fc8a8097150 comp rx=0 tx=0).stop 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 -- 172.21.15.35:0/4220531447 shutdown_connections 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca266000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25a960 0x55e6ca254ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/4220531447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25fbe0 0x55e6ca25ef10 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 -- 172.21.15.35:0/4220531447 >> 172.21.15.35:0/4220531447 conn(0x55e6ca0b76b0 msgr2=0x55e6ca25e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 -- 172.21.15.35:0/4220531447 shutdown_connections 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.427+0000 7fc8d185eb80 1 -- 172.21.15.35:0/4220531447 wait complete. 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 -- start start 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 Processor -- start 2023-03-17T09:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca2c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca268ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca2694a0 con 0x55e6ca25a960 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca269610 con 0x55e6ca25fbe0 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6ca2697d0 con 0x55e6ca2604f0 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8d185eb80 10 client.0 _ll_register_callbacks cb 0x55e6ca052230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca2c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca2c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46754/0 (socket says 172.21.15.35:46754) 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 -- 172.21.15.35:0/2767358203 learned_addr learned my addr 172.21.15.35:0/2767358203 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca268ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 -- 172.21.15.35:0/2767358203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 msgr2=0x55e6ca268ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca268ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 -- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 msgr2=0x55e6ca2c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8beffd700 1 -- 172.21.15.35:0/2767358203 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c010efe0 con 0x55e6ca25a960 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.428+0000 7fc8bf7fe700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca268ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8beffd700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca2c0d70 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0005d90 tx=0x7fc8b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125968b70e6e3e5f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8a67fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:45:48.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8a67fc700 1 -- 172.21.15.35:0/2767358203 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0026450 con 0x55e6ca25a960 2023-03-17T09:45:49.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8a67fc700 1 -- 172.21.15.35:0/2767358203 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc8b0017070 con 0x55e6ca25a960 2023-03-17T09:45:49.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:33 smithi035 ceph-mon[92535]: pgmap v1584: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:45:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6ca22a1e0 con 0x55e6ca25a960 2023-03-17T09:45:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8a67fc700 1 -- 172.21.15.35:0/2767358203 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b0011e40 con 0x55e6ca25a960 2023-03-17T09:45:49.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 10 client.17280 fetch_fsmap learned FSMap version 36 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55e6c9fc3c00 con 0x55e6ca25a960 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8a67fc700 1 -- 172.21.15.35:0/2767358203 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e6ca22a1e0 con 0x55e6ca25a960 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8a67fc700 1 -- 172.21.15.35:0/2767358203 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc8b0026a50 con 0x55e6ca25a960 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 10 client.17280 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 10 client.17280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 20 client.17280 populate_metadata read hostname 'smithi035' 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca2c8cc0 0x55e6ca2cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 4 client.17280 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.429+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e6ca030f00 con 0x55e6ca2c8cc0 2023-03-17T09:45:49.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.430+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca2c8cc0 0x55e6ca2cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.430+0000 7fc8a67fc700 10 client.17280 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.430+0000 7fc8be7fc700 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca2c8cc0 0x55e6ca2cb0d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3aeed2c741cf3c server_cookie=24dfbbe7a5d4708a in_seq=0 out_seq=0 2023-03-17T09:45:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8a67fc700 1 -- 172.21.15.35:0/2767358203 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e6ca030f00 con 0x55e6ca2c8cc0 2023-03-17T09:45:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8a67fc700 10 client.17280 handle_command_reply: tid=0 2023-03-17T09:45:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 client.17280 shutdown 2023-03-17T09:45:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 msgr2=0x55e6ca2c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca2c0d70 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0005d90 tx=0x7fc8b00047c0 comp rx=0 tx=0).stop 2023-03-17T09:45:53.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 shutdown_connections 2023-03-17T09:45:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6ca2c8cc0 0x55e6ca2cb0d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6ca2604f0 0x55e6ca268ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8a67fc700 0 client.17280 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:45:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6ca25a960 0x55e6ca2c0d70 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 --2- 172.21.15.35:0/2767358203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6ca25fbe0 0x55e6ca2c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.434+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 >> 172.21.15.35:0/2767358203 conn(0x55e6ca0b76b0 msgr2=0x55e6ca25f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 shutdown_connections 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8d185eb80 1 -- 172.21.15.35:0/2767358203 wait complete. 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8d185eb80 20 client.17280 trim_cache size 0 max 16384 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8ac09f640 msgr2=0x7fc8ac0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8ac09f640 0x7fc8ac0a1af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0005950 tx=0x7fc8b000b410 comp rx=0 tx=0).stop 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 msgr2=0x7fc8c01013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 0x7fc8c01013d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800d980 tx=0x7fc8a800dc90 comp rx=0 tx=0).stop 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 shutdown_connections 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8ac09f640 0x7fc8ac0a1af0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c01044d0 0x7fc8c01a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c00ff4b0 0x7fc8c0100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 --2- 172.21.15.35:0/2229806356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8c00ffe50 0x7fc8c01013d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 >> 172.21.15.35:0/2229806356 conn(0x7fc8c0077220 msgr2=0x7fc8c0069240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 shutdown_connections 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:22:55.435+0000 7fc8c56d1700 1 -- 172.21.15.35:0/2229806356 wait complete. 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 -- 172.21.15.35:0/3659400438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 msgr2=0x7f313810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 --2- 172.21.15.35:0/3659400438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f313810bf60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f313000b0d0 tx=0x7f313000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 -- 172.21.15.35:0/3659400438 shutdown_connections 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 --2- 172.21.15.35:0/3659400438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f313810bf60 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 --2- 172.21.15.35:0/3659400438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31380ff350 0x7f31380ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 --2- 172.21.15.35:0/3659400438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31380ffcf0 0x7f3138103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:55.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 -- 172.21.15.35:0/3659400438 >> 172.21.15.35:0/3659400438 conn(0x7f3138076330 msgr2=0x7f3138076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 -- 172.21.15.35:0/3659400438 shutdown_connections 2023-03-17T09:45:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.560+0000 7f313ea82700 1 -- 172.21.15.35:0/3659400438 wait complete. 2023-03-17T09:45:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.561+0000 7f313ea82700 1 Processor -- start 2023-03-17T09:45:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.561+0000 7f313ea82700 1 -- start start 2023-03-17T09:45:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313ea82700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31380ff350 0x7f3138197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313ea82700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31380ffcf0 0x7f3138197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313ea82700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f31381a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313ea82700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381a2700 con 0x7f3138104390 2023-03-17T09:45:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313ea82700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381a2840 con 0x7f31380ff350 2023-03-17T09:45:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313ea82700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381a2980 con 0x7f31380ffcf0 2023-03-17T09:45:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f31381a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f31381a21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46772/0 (socket says 172.21.15.35:46772) 2023-03-17T09:45:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 -- 172.21.15.35:0/3712612142 learned_addr learned my addr 172.21.15.35:0/3712612142 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313c81e700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31380ff350 0x7f3138197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f3137fff700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31380ffcf0 0x7f3138197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 -- 172.21.15.35:0/3712612142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31380ffcf0 msgr2=0x7f3138197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31380ffcf0 0x7f3138197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 -- 172.21.15.35:0/3712612142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31380ff350 msgr2=0x7f3138197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31380ff350 0x7f3138197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 -- 172.21.15.35:0/3712612142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130009d00 con 0x7f3138104390 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.562+0000 7f313d01f700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f31381a21c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3130009fd0 tx=0x7f313000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.563+0000 7f3135ffb700 1 -- 172.21.15.35:0/3712612142 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000e040 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.563+0000 7f3135ffb700 1 -- 172.21.15.35:0/3712612142 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31300094a0 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.563+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313810f010 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.563+0000 7f3135ffb700 1 -- 172.21.15.35:0/3712612142 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300052a0 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.563+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313810ee80 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.565+0000 7f3135ffb700 1 -- 172.21.15.35:0/3712612142 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f313001b450 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.566+0000 7f3135ffb700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f312809f6c0 0x7f31280a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.566+0000 7f313c81e700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f312809f6c0 0x7f31280a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.566+0000 7f3135ffb700 1 -- 172.21.15.35:0/3712612142 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f31300cb810 con 0x7f3138104390 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f313c81e700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f312809f6c0 0x7f31280a1b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f312c009c60 tx=0x7f312c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 Processor -- start 2023-03-17T09:45:59.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 -- start start 2023-03-17T09:45:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 0x564a0cfcafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcb4f0 0x564a0cfc5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfc5960 0x564a0cfc5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cecc010 con 0x564a0cfcabe0 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cf1e950 con 0x564a0cfc5960 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cf17de0 con 0x564a0cfcb4f0 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 0x564a0cfcafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 0x564a0cfcafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46776/0 (socket says 172.21.15.35:46776) 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f313c81e700 1 -- 172.21.15.35:0/2947103835 learned_addr learned my addr 172.21.15.35:0/2947103835 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:45:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f313d01f700 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfc5960 0x564a0cfc5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.567+0000 7f3137fff700 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcb4f0 0x564a0cfc5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:45:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f313c81e700 1 -- 172.21.15.35:0/2947103835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcb4f0 msgr2=0x564a0cfc5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f313c81e700 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcb4f0 0x564a0cfc5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f313c81e700 1 -- 172.21.15.35:0/2947103835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfc5960 msgr2=0x564a0cfc5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:45:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f313c81e700 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfc5960 0x564a0cfc5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f313c81e700 1 -- 172.21.15.35:0/2947103835 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0cd995d0 con 0x564a0cfcabe0 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f313c81e700 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 0x564a0cfcafb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e4e0 tx=0x7f312c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4051cbedf300c3b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f3122ffd700 1 -- 172.21.15.35:0/2947103835 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00ee00 con 0x564a0cfcabe0 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f3122ffd700 1 -- 172.21.15.35:0/2947103835 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f312c021070 con 0x564a0cfcabe0 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.568+0000 7f3122ffd700 1 -- 172.21.15.35:0/2947103835 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c01d780 con 0x564a0cfcabe0 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2947103835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 msgr2=0x564a0cfcafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 0x564a0cfcafb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e4e0 tx=0x7f312c014000 comp rx=0 tx=0).stop 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2947103835 shutdown_connections 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfc5960 0x564a0cfc5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfcabe0 0x564a0cfcafb0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2947103835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcb4f0 0x564a0cfc5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2947103835 >> 172.21.15.35:0/2947103835 conn(0x564a0ce226b0 msgr2=0x564a0cfbfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2947103835 shutdown_connections 2023-03-17T09:45:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2947103835 wait complete. 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 -- start start 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.569+0000 7f314ac0fb80 1 Processor -- start 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfcef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cd9b8c0 con 0x564a0cfc5960 2023-03-17T09:46:00.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfcf640 con 0x564a0cfcb4f0 2023-03-17T09:46:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfdb000 con 0x564a0cfcabe0 2023-03-17T09:46:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f314ac0fb80 10 client.0 _ll_register_callbacks cb 0x564a0cdbd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:46:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46782/0 (socket says 172.21.15.35:46782) 2023-03-17T09:46:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 -- 172.21.15.35:0/3324843329 learned_addr learned my addr 172.21.15.35:0/3324843329 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f3137fff700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313d01f700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfcef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 -- 172.21.15.35:0/3324843329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 msgr2=0x564a0cfce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 -- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 msgr2=0x564a0cfcef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfcef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 -- 172.21.15.35:0/3324843329 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c017070 con 0x564a0cfc5960 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f313c81e700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd1540 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f312c00ed90 tx=0x7f312c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef439c76c29fa550 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.570+0000 7f3117fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f3117fff700 1 -- 172.21.15.35:0/3324843329 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c005550 con 0x564a0cfc5960 2023-03-17T09:46:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f3117fff700 1 -- 172.21.15.35:0/3324843329 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f312c003680 con 0x564a0cfc5960 2023-03-17T09:46:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a0ceda390 con 0x564a0cfc5960 2023-03-17T09:46:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f3117fff700 1 -- 172.21.15.35:0/3324843329 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f312c0056b0 con 0x564a0cfc5960 2023-03-17T09:46:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 10 client.17292 fetch_fsmap learned FSMap version 36 2023-03-17T09:46:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564a0cd45d80 con 0x564a0cfc5960 2023-03-17T09:46:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f3117fff700 1 -- 172.21.15.35:0/3324843329 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a0ceda390 con 0x564a0cfc5960 2023-03-17T09:46:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f3117fff700 1 -- 172.21.15.35:0/3324843329 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f312c01c890 con 0x564a0cfc5960 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 10 client.17292 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 10 client.17292 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 20 client.17292 populate_metadata read hostname 'smithi035' 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0cfdf040 0x564a0cfe1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 4 client.17292 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.571+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a0cee6600 con 0x564a0cfdf040 2023-03-17T09:46:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.572+0000 7f3137fff700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0cfdf040 0x564a0cfe1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.572+0000 7f3137fff700 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0cfdf040 0x564a0cfe1450 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb5540eaa6e086d0 server_cookie=32f6b4ab79c4b3a6 in_seq=0 out_seq=0 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.572+0000 7f3117fff700 10 client.17292 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f3117fff700 1 -- 172.21.15.35:0/3324843329 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564a0cee6600 con 0x564a0cfdf040 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f3117fff700 10 client.17292 handle_command_reply: tid=0 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 client.17292 shutdown 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 msgr2=0x564a0cfd1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd1540 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f312c00ed90 tx=0x7f312c00edc0 comp rx=0 tx=0).stop 2023-03-17T09:46:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 shutdown_connections 2023-03-17T09:46:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0cfdf040 0x564a0cfe1450 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfcef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f3117fff700 0 client.17292 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd1540 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/3324843329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 >> 172.21.15.35:0/3324843329 conn(0x564a0ce226b0 msgr2=0x564a0cfc4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 shutdown_connections 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 1 -- 172.21.15.35:0/3324843329 wait complete. 2023-03-17T09:46:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.573+0000 7f314ac0fb80 20 client.17292 trim_cache size 0 max 16384 2023-03-17T09:46:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 Processor -- start 2023-03-17T09:46:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 -- start start 2023-03-17T09:46:10.126 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:35 smithi035 ceph-mon[92535]: pgmap v1585: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:46:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfbfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfbb0f0 con 0x564a0cfc5960 2023-03-17T09:46:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfcf780 con 0x564a0cfcb4f0 2023-03-17T09:46:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfc0000 con 0x564a0cfcabe0 2023-03-17T09:46:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46790/0 (socket says 172.21.15.35:46790) 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 -- 172.21.15.35:0/2890172009 learned_addr learned my addr 172.21.15.35:0/2890172009 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f3137fff700 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfbfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313d01f700 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 -- 172.21.15.35:0/2890172009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 msgr2=0x564a0cfbfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfbfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 -- 172.21.15.35:0/2890172009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 msgr2=0x564a0cfd5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.590+0000 7f313c81e700 1 -- 172.21.15.35:0/2890172009 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a0cfc6000 con 0x564a0cfc5960 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.591+0000 7f313c81e700 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfce770 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f312c009d70 tx=0x7f312c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aef2dcb8d94b961 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.591+0000 7f31237fe700 1 -- 172.21.15.35:0/2890172009 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c0092d0 con 0x564a0cfc5960 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.591+0000 7f31237fe700 1 -- 172.21.15.35:0/2890172009 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f312c021070 con 0x564a0cfc5960 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.591+0000 7f31237fe700 1 -- 172.21.15.35:0/2890172009 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c003680 con 0x564a0cfc5960 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2890172009 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 msgr2=0x564a0cfce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfce770 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f312c009d70 tx=0x7f312c00eee0 comp rx=0 tx=0).stop 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2890172009 shutdown_connections 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfce770 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/2890172009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfbfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2890172009 >> 172.21.15.35:0/2890172009 conn(0x564a0ce226b0 msgr2=0x564a0cfce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2890172009 shutdown_connections 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 -- 172.21.15.35:0/2890172009 wait complete. 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 -- start start 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.592+0000 7f314ac0fb80 1 Processor -- start 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfd4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfd4af0 con 0x564a0cfc5960 2023-03-17T09:46:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfd4c60 con 0x564a0cfcb4f0 2023-03-17T09:46:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a0cfd4e20 con 0x564a0cfcabe0 2023-03-17T09:46:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f314ac0fb80 10 client.0 _ll_register_callbacks cb 0x564a0cdbd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:46:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:48592/0 (socket says 172.21.15.35:48592) 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313c81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46796/0 (socket says 172.21.15.35:46796) 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 -- 172.21.15.35:0/1177467070 learned_addr learned my addr 172.21.15.35:0/1177467070 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f3137fff700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfd4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 -- 172.21.15.35:0/1177467070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 msgr2=0x564a0cfd4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfd4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 -- 172.21.15.35:0/1177467070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 msgr2=0x564a0cfd5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313d01f700 1 -- 172.21.15.35:0/1177467070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a0cd45d80 con 0x564a0cfcb4f0 2023-03-17T09:46:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.593+0000 7f313c81e700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:46:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.594+0000 7f313d01f700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd45b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3130095dc0 tx=0x7f31300099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6cacbad1cf5998 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.594+0000 7f3117fff700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:46:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.595+0000 7f3117fff700 1 -- 172.21.15.35:0/1177467070 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300997b0 con 0x564a0cfcb4f0 2023-03-17T09:46:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.595+0000 7f3117fff700 1 -- 172.21.15.35:0/1177467070 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f3130099350 con 0x564a0cfcb4f0 2023-03-17T09:46:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.596+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a0cf951e0 con 0x564a0cfcb4f0 2023-03-17T09:46:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.597+0000 7f3117fff700 1 -- 172.21.15.35:0/1177467070 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31300a14b0 con 0x564a0cfcb4f0 2023-03-17T09:46:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.597+0000 7f314ac0fb80 10 client.26843 fetch_fsmap learned FSMap version 36 2023-03-17T09:46:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.597+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564a0cd2ec00 con 0x564a0cfcb4f0 2023-03-17T09:46:19.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f3117fff700 1 -- 172.21.15.35:0/1177467070 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a0cf951e0 con 0x564a0cfcb4f0 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f3117fff700 1 -- 172.21.15.35:0/1177467070 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f313001b700 con 0x564a0cfcb4f0 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f314ac0fb80 10 client.26843 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f314ac0fb80 10 client.26843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f314ac0fb80 20 client.26843 populate_metadata read hostname 'smithi035' 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0d032090 0x564a0d034470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f314ac0fb80 4 client.26843 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a0cd9bf00 con 0x564a0d032090 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.598+0000 7f313c81e700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0d032090 0x564a0d034470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.599+0000 7f3117fff700 10 client.26843 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.599+0000 7f313c81e700 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0d032090 0x564a0d034470 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d23d269a10824b8 server_cookie=7e9a6a929d2dd19a in_seq=0 out_seq=0 2023-03-17T09:46:19.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f3117fff700 1 -- 172.21.15.35:0/1177467070 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a0cd9bf00 con 0x564a0d032090 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f3117fff700 10 client.26843 handle_command_reply: tid=0 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 client.26843 shutdown 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 msgr2=0x564a0cfd45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd45b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3130095dc0 tx=0x7f31300099e0 comp rx=0 tx=0).stop 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 shutdown_connections 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a0d032090 0x564a0d034470 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a0cfcb4f0 0x564a0cfd45b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a0cfc5960 0x564a0cfd5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f3117fff700 0 client.26843 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 --2- 172.21.15.35:0/1177467070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a0cfcabe0 0x564a0cfd4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 >> 172.21.15.35:0/1177467070 conn(0x564a0ce226b0 msgr2=0x564a0cfc8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 shutdown_connections 2023-03-17T09:46:19.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 1 -- 172.21.15.35:0/1177467070 wait complete. 2023-03-17T09:46:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.614+0000 7f314ac0fb80 20 client.26843 trim_cache size 0 max 16384 2023-03-17T09:46:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f312809f6c0 msgr2=0x7f31280a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f312809f6c0 0x7f31280a1b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f312c009c60 tx=0x7f312c009260 comp rx=0 tx=0).stop 2023-03-17T09:46:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 msgr2=0x7f31381a21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f31381a21c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3130009fd0 tx=0x7f313000cce0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 shutdown_connections 2023-03-17T09:46:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f312809f6c0 0x7f31280a1b70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3138104390 0x7f31381a21c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31380ff350 0x7f3138197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 --2- 172.21.15.35:0/3712612142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31380ffcf0 0x7f3138197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 >> 172.21.15.35:0/3712612142 conn(0x7f3138076330 msgr2=0x7f3138102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 shutdown_connections 2023-03-17T09:46:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:08.615+0000 7f313ea82700 1 -- 172.21.15.35:0/3712612142 wait complete. 2023-03-17T09:46:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 -- 172.21.15.35:0/3701232178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 msgr2=0x7fafa410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/3701232178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa410bf60 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00b0d0 tx=0x7faf9c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 -- 172.21.15.35:0/3701232178 shutdown_connections 2023-03-17T09:46:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/3701232178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa410bf60 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/3701232178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa40ff350 0x7fafa40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:22.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/3701232178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 0x7fafa4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 -- 172.21.15.35:0/3701232178 >> 172.21.15.35:0/3701232178 conn(0x7fafa4076330 msgr2=0x7fafa4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 -- 172.21.15.35:0/3701232178 shutdown_connections 2023-03-17T09:46:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.736+0000 7fafaaf9d700 1 -- 172.21.15.35:0/3701232178 wait complete. 2023-03-17T09:46:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 Processor -- start 2023-03-17T09:46:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 -- start start 2023-03-17T09:46:24.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa40ff350 0x7fafa41962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 0x7fafa4196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:24.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa419b2d0 con 0x7fafa4104390 2023-03-17T09:46:24.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa419b440 con 0x7fafa40ffcf0 2023-03-17T09:46:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafaaf9d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa419b600 con 0x7fafa40ff350 2023-03-17T09:46:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa419ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46814/0 (socket says 172.21.15.35:46814) 2023-03-17T09:46:24.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 -- 172.21.15.35:0/2907463689 learned_addr learned my addr 172.21.15.35:0/2907463689 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa3fff700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 0x7fafa4196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 -- 172.21.15.35:0/2907463689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa40ff350 msgr2=0x7fafa41962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa8d39700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa40ff350 0x7fafa41962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa40ff350 0x7fafa41962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 -- 172.21.15.35:0/2907463689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 msgr2=0x7fafa4196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 0x7fafa4196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa953a700 1 -- 172.21.15.35:0/2907463689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009d00 con 0x7fafa4104390 2023-03-17T09:46:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.737+0000 7fafa3fff700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 0x7fafa4196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:46:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.738+0000 7fafa953a700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa419ac90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7faf9c008ec0 tx=0x7faf9c008fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.738+0000 7fafa1ffb700 1 -- 172.21.15.35:0/2907463689 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00e040 con 0x7fafa4104390 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.738+0000 7fafa1ffb700 1 -- 172.21.15.35:0/2907463689 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf9c003c00 con 0x7fafa4104390 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.738+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa410efc0 con 0x7fafa4104390 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.738+0000 7fafa1ffb700 1 -- 172.21.15.35:0/2907463689 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c01b6d0 con 0x7fafa4104390 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.738+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa410ee30 con 0x7fafa4104390 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.740+0000 7fafa1ffb700 1 -- 172.21.15.35:0/2907463689 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7faf9c01b830 con 0x7fafa4104390 2023-03-17T09:46:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.741+0000 7fafa1ffb700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf9409f640 0x7faf940a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:26.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.741+0000 7fafa8d39700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf9409f640 0x7faf940a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:26.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.741+0000 7fafa1ffb700 1 -- 172.21.15.35:0/2907463689 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faf9c0dbd60 con 0x7fafa4104390 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.742+0000 7fafa8d39700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf9409f640 0x7faf940a1af0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf9800ba60 tx=0x7faf98005d50 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.742+0000 7fafb712ab80 1 Processor -- start 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.742+0000 7fafb712ab80 1 -- start start 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.742+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6209140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6209680 0x55abf6204430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6204970 0x55abf6204da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafb712ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf60e9010 con 0x55abf6208d70 2023-03-17T09:46:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafb712ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf613b950 con 0x55abf6209680 2023-03-17T09:46:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafb712ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf6134de0 con 0x55abf6204970 2023-03-17T09:46:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6209140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6209140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46818/0 (socket says 172.21.15.35:46818) 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 -- 172.21.15.35:0/299788722 learned_addr learned my addr 172.21.15.35:0/299788722 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa953a700 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6204970 0x55abf6204da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa3fff700 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6209680 0x55abf6204430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 -- 172.21.15.35:0/299788722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6204970 msgr2=0x55abf6204da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6204970 0x55abf6204da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 -- 172.21.15.35:0/299788722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6209680 msgr2=0x55abf6204430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6209680 0x55abf6204430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 -- 172.21.15.35:0/299788722 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abf5fb65d0 con 0x55abf6208d70 2023-03-17T09:46:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa3fff700 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6209680 0x55abf6204430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:46:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7fafa8d39700 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6209140 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7faf9800dc20 tx=0x7faf98010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477dc1118427137d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7faf8effd700 1 -- 172.21.15.35:0/299788722 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800fa70 con 0x55abf6208d70 2023-03-17T09:46:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7faf8effd700 1 -- 172.21.15.35:0/299788722 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf9800fbd0 con 0x55abf6208d70 2023-03-17T09:46:30.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:37 smithi035 ceph-mon[92535]: pgmap v1586: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:46:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.743+0000 7faf8effd700 1 -- 172.21.15.35:0/299788722 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9805f420 con 0x55abf6208d70 2023-03-17T09:46:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 -- 172.21.15.35:0/299788722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 msgr2=0x55abf6209140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6209140 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7faf9800dc20 tx=0x7faf98010000 comp rx=0 tx=0).stop 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 -- 172.21.15.35:0/299788722 shutdown_connections 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6204970 0x55abf6204da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6209140 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 --2- 172.21.15.35:0/299788722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6209680 0x55abf6204430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 -- 172.21.15.35:0/299788722 >> 172.21.15.35:0/299788722 conn(0x55abf603f6b0 msgr2=0x55abf61dca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 -- 172.21.15.35:0/299788722 shutdown_connections 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 -- 172.21.15.35:0/299788722 wait complete. 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.744+0000 7fafb712ab80 1 -- start start 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 Processor -- start 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf61e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf5fb88c0 con 0x55abf6208d70 2023-03-17T09:46:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf61e0360 con 0x55abf6204970 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf61e0520 con 0x55abf6209680 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafb712ab80 10 client.0 _ll_register_callbacks cb 0x55abf5fda230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf61e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf61e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46824/0 (socket says 172.21.15.35:46824) 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 -- 172.21.15.35:0/689758920 learned_addr learned my addr 172.21.15.35:0/689758920 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa8d39700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa953a700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 -- 172.21.15.35:0/689758920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 msgr2=0x55abf61dfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61dfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 -- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 msgr2=0x55abf61e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.745+0000 7fafa3fff700 1 -- 172.21.15.35:0/689758920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9800d8d0 con 0x55abf6208d70 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafa3fff700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf61e4d30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fafa41000c0 tx=0x7faf900116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd22883857b31907 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7faf83fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7faf83fff700 1 -- 172.21.15.35:0/689758920 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90004230 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7faf83fff700 1 -- 172.21.15.35:0/689758920 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faf90018070 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abf60f7390 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7faf83fff700 1 -- 172.21.15.35:0/689758920 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf90004390 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 10 client.17310 fetch_fsmap learned FSMap version 36 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55abf5f62d80 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7faf83fff700 1 -- 172.21.15.35:0/689758920 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55abf60f7390 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7faf83fff700 1 -- 172.21.15.35:0/689758920 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7faf90012500 con 0x55abf6208d70 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 10 client.17310 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:46:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 10 client.17310 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:46:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 20 client.17310 populate_metadata read hostname 'smithi035' 2023-03-17T09:46:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf61effa0 0x55abf61f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 4 client.17310 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:46:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.746+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abf6103600 con 0x55abf61effa0 2023-03-17T09:46:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.747+0000 7fafa8d39700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf61effa0 0x55abf61f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.747+0000 7fafa8d39700 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf61effa0 0x55abf61f23b0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2472aa3d367b800 server_cookie=f108c65daa0ef8e7 in_seq=0 out_seq=0 2023-03-17T09:46:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.747+0000 7faf83fff700 10 client.17310 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7faf83fff700 1 -- 172.21.15.35:0/689758920 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55abf6103600 con 0x55abf61effa0 2023-03-17T09:46:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7faf83fff700 10 client.17310 handle_command_reply: tid=0 2023-03-17T09:46:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 client.17310 shutdown 2023-03-17T09:46:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 msgr2=0x55abf61e4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf61e4d30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fafa41000c0 tx=0x7faf900116c0 comp rx=0 tx=0).stop 2023-03-17T09:46:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 shutdown_connections 2023-03-17T09:46:34.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf61effa0 0x55abf61f23b0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61dfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7faf83fff700 0 client.17310 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 --2- 172.21.15.35:0/689758920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf61e4d30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 >> 172.21.15.35:0/689758920 conn(0x55abf603f6b0 msgr2=0x55abf6207a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 shutdown_connections 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 1 -- 172.21.15.35:0/689758920 wait complete. 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.748+0000 7fafb712ab80 20 client.17310 trim_cache size 0 max 16384 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 Processor -- start 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 -- start start 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6204d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61de970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf61d9b60 con 0x55abf6208d70 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf6205280 con 0x55abf6204970 2023-03-17T09:46:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafb712ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf620f550 con 0x55abf6209680 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6204d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6204d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46832/0 (socket says 172.21.15.35:46832) 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafa3fff700 1 -- 172.21.15.35:0/966080346 learned_addr learned my addr 172.21.15.35:0/966080346 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.763+0000 7fafa8d39700 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafa3fff700 1 -- 172.21.15.35:0/966080346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 msgr2=0x55abf61de970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafa3fff700 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafa3fff700 1 -- 172.21.15.35:0/966080346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 msgr2=0x55abf61dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafa3fff700 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafa3fff700 1 -- 172.21.15.35:0/966080346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abf60fb130 con 0x55abf6208d70 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafa3fff700 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6204d40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7faf90012960 tx=0x7faf90005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d2a2f5244721dd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7faf8f7fe700 1 -- 172.21.15.35:0/966080346 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90012a80 con 0x55abf6208d70 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7faf8f7fe700 1 -- 172.21.15.35:0/966080346 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf90016070 con 0x55abf6208d70 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7faf8f7fe700 1 -- 172.21.15.35:0/966080346 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90003680 con 0x55abf6208d70 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafb712ab80 1 -- 172.21.15.35:0/966080346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 msgr2=0x55abf6204d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.764+0000 7fafb712ab80 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6204d40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7faf90012960 tx=0x7faf90005d60 comp rx=0 tx=0).stop 2023-03-17T09:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- 172.21.15.35:0/966080346 shutdown_connections 2023-03-17T09:46:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61de970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf61dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 --2- 172.21.15.35:0/966080346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6204d40 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- 172.21.15.35:0/966080346 >> 172.21.15.35:0/966080346 conn(0x55abf603f6b0 msgr2=0x55abf61f6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- 172.21.15.35:0/966080346 shutdown_connections 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- 172.21.15.35:0/966080346 wait complete. 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- start start 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 Processor -- start 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf6248320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6248860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf61e6950 con 0x55abf6208d70 2023-03-17T09:46:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf61e6ac0 con 0x55abf6204970 2023-03-17T09:46:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf61e6c80 con 0x55abf6209680 2023-03-17T09:46:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafb712ab80 10 client.0 _ll_register_callbacks cb 0x55abf5fda230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:46:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6248860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6248860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46838/0 (socket says 172.21.15.35:46838) 2023-03-17T09:46:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.765+0000 7fafa3fff700 1 -- 172.21.15.35:0/1228333268 learned_addr learned my addr 172.21.15.35:0/1228333268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa8d39700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf6248320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa953a700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa3fff700 1 -- 172.21.15.35:0/1228333268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 msgr2=0x55abf61e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa3fff700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa3fff700 1 -- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 msgr2=0x55abf6248320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa3fff700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf6248320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa3fff700 1 -- 172.21.15.35:0/1228333268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abf5f62d80 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa953a700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafa3fff700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6248860 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7faf90009b20 tx=0x7faf900051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf0caeb1573971a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7faf83fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7faf83fff700 1 -- 172.21.15.35:0/1228333268 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90034070 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abf61b21e0 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7faf83fff700 1 -- 172.21.15.35:0/1228333268 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faf90018040 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7faf83fff700 1 -- 172.21.15.35:0/1228333268 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf90005630 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafb712ab80 10 client.17316 fetch_fsmap learned FSMap version 36 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.766+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55abf5f891f0 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7faf83fff700 1 -- 172.21.15.35:0/1228333268 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf9003d020 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7faf83fff700 1 -- 172.21.15.35:0/1228333268 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7faf90039780 con 0x55abf6208d70 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafb712ab80 10 client.17316 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:46:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafb712ab80 10 client.17316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:46:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafb712ab80 20 client.17316 populate_metadata read hostname 'smithi035' 2023-03-17T09:46:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafb712ab80 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf6250d30 0x55abf6253140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafb712ab80 4 client.17316 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:46:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55abf5fb8f00 con 0x55abf6250d30 2023-03-17T09:46:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafa8d39700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf6250d30 0x55abf6253140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7fafa8d39700 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf6250d30 0x55abf6253140 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e892b1fe4b92e68 server_cookie=1ca022bdb811a3f0 in_seq=0 out_seq=0 2023-03-17T09:46:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.767+0000 7faf83fff700 10 client.17316 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7faf83fff700 1 -- 172.21.15.35:0/1228333268 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55abf5fb8f00 con 0x55abf6250d30 2023-03-17T09:46:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7faf83fff700 10 client.17316 handle_command_reply: tid=0 2023-03-17T09:46:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 client.17316 shutdown 2023-03-17T09:46:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 msgr2=0x55abf6248860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6248860 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7faf90009b20 tx=0x7faf900051c0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 shutdown_connections 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55abf6250d30 0x55abf6253140 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55abf6209680 0x55abf61e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55abf6204970 0x55abf6248320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 --2- 172.21.15.35:0/1228333268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55abf6208d70 0x55abf6248860 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7faf83fff700 0 client.17316 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 >> 172.21.15.35:0/1228333268 conn(0x55abf603f6b0 msgr2=0x55abf61df9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 shutdown_connections 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.772+0000 7fafb712ab80 1 -- 172.21.15.35:0/1228333268 wait complete. 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafb712ab80 20 client.17316 trim_cache size 0 max 16384 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf9409f640 msgr2=0x7faf940a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf9409f640 0x7faf940a1af0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf9800ba60 tx=0x7faf98005d50 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 msgr2=0x7fafa419ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa419ac90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7faf9c008ec0 tx=0x7faf9c008fa0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 shutdown_connections 2023-03-17T09:46:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf9409f640 0x7faf940a1af0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fafa4104390 0x7fafa419ac90 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa40ff350 0x7fafa41962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 --2- 172.21.15.35:0/2907463689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40ffcf0 0x7fafa4196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 >> 172.21.15.35:0/2907463689 conn(0x7fafa4076330 msgr2=0x7fafa4102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 shutdown_connections 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:23:21.773+0000 7fafaaf9d700 1 -- 172.21.15.35:0/2907463689 wait complete. 2023-03-17T09:46:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 -- 172.21.15.35:0/3013486172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1718105530 msgr2=0x7f171810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 --2- 172.21.15.35:0/3013486172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1718105530 0x7f171810d100 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f171000b0d0 tx=0x7f171000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 -- 172.21.15.35:0/3013486172 shutdown_connections 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 --2- 172.21.15.35:0/3013486172 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1718105530 0x7f171810d100 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 --2- 172.21.15.35:0/3013486172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17181004f0 0x7f17181008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 --2- 172.21.15.35:0/3013486172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1718100e90 0x7f1718104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.032+0000 7f171f885700 1 -- 172.21.15.35:0/3013486172 >> 172.21.15.35:0/3013486172 conn(0x7f1718078170 msgr2=0x7f1718078570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:46:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 -- 172.21.15.35:0/3013486172 shutdown_connections 2023-03-17T09:46:44.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:39 smithi035 ceph-mon[92535]: pgmap v1587: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:46:46.123 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:41 smithi035 ceph-mon[92535]: pgmap v1588: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.123 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:43 smithi035 ceph-mon[92535]: pgmap v1589: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:46.123 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:45 smithi035 ceph-mon[92535]: pgmap v1590: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.123 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:47 smithi035 ceph-mon[92535]: pgmap v1591: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.123 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:49 smithi035 ceph-mon[92535]: pgmap v1592: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:51 smithi035 ceph-mon[92535]: pgmap v1593: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:53 smithi035 ceph-mon[92535]: pgmap v1594: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:55 smithi035 ceph-mon[92535]: pgmap v1595: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:57 smithi035 ceph-mon[92535]: pgmap v1596: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:35:59 smithi035 ceph-mon[92535]: pgmap v1597: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:01 smithi035 ceph-mon[92535]: pgmap v1598: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-mon[92535]: pgmap v1599: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:04 smithi035 ceph-mon[92535]: osdmap e176: 12 total, 12 up, 12 in 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:04 smithi035 ceph-mon[92535]: pgmap v1601: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:07 smithi035 ceph-mon[92535]: pgmap v1602: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:09 smithi035 ceph-mon[92535]: pgmap v1603: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:11 smithi035 ceph-mon[92535]: pgmap v1604: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:11 smithi035 ceph-mon[92535]: osdmap e177: 12 total, 12 up, 12 in 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:13 smithi035 ceph-mon[92535]: pgmap v1606: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.0 KiB/s wr, 10 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mon[92535]: pgmap v1607: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 921 B/s wr, 9 op/s 2023-03-17T09:46:46.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mon[92535]: osdmap e178: 12 total, 12 up, 12 in 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/1872850599,v1:172.21.15.35:6837/1872850599] up:boot 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:17 smithi035 ceph-mon[92535]: pgmap v1609: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:19 smithi035 ceph-mon[92535]: pgmap v1610: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T09:46:46.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:21 smithi035 ceph-mon[92535]: pgmap v1611: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 517 B/s wr, 10 op/s 2023-03-17T09:46:47.027 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:23 smithi035 ceph-mon[92535]: pgmap v1612: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:46:47.027 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:25 smithi035 ceph-mon[92535]: pgmap v1613: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T09:46:47.027 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:27 smithi035 ceph-mon[92535]: pgmap v1614: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 361 B/s wr, 9 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:29 smithi035 ceph-mon[92535]: pgmap v1615: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:30 smithi035 ceph-mon[92535]: pgmap v1616: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:30 smithi035 ceph-mon[92535]: pgmap v1617: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:31 smithi035 ceph-mon[92535]: pgmap v1618: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:33 smithi035 ceph-mon[92535]: pgmap v1619: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:36 smithi035 ceph-mon[92535]: pgmap v1620: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:37 smithi035 ceph-mon[92535]: pgmap v1621: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:39 smithi035 ceph-mon[92535]: pgmap v1622: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:41 smithi035 ceph-mon[92535]: pgmap v1623: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:43 smithi035 ceph-mon[92535]: pgmap v1624: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:46:47.028 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:46 smithi035 ceph-mon[92535]: pgmap v1625: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:47 smithi035 ceph-mon[92535]: pgmap v1626: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:49 smithi035 ceph-mon[92535]: pgmap v1627: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:51 smithi035 ceph-mon[92535]: pgmap v1628: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:53 smithi035 ceph-mon[92535]: pgmap v1629: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:56 smithi035 ceph-mon[92535]: pgmap v1630: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:57 smithi035 ceph-mon[92535]: pgmap v1631: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:36:59 smithi035 ceph-mon[92535]: pgmap v1632: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:01 smithi035 ceph-mon[92535]: pgmap v1633: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:03 smithi035 ceph-mon[92535]: pgmap v1634: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:06 smithi035 ceph-mon[92535]: pgmap v1635: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:07 smithi035 ceph-mon[92535]: pgmap v1636: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:09 smithi035 ceph-mon[92535]: osdmap e179: 12 total, 12 up, 12 in 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:09 smithi035 ceph-mon[92535]: pgmap v1638: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:11 smithi035 ceph-mon[92535]: pgmap v1639: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:46:47.029 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:13 smithi035 ceph-mon[92535]: pgmap v1640: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:16 smithi035 ceph-mon[92535]: osdmap e180: 12 total, 12 up, 12 in 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:16 smithi035 ceph-mon[92535]: pgmap v1642: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:18 smithi035 ceph-mon[92535]: pgmap v1643: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 343 B/s wr, 11 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:21 smithi035 ceph-mon[92535]: pgmap v1644: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:23 smithi035 ceph-mon[92535]: pgmap v1645: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:25 smithi035 ceph-mon[92535]: pgmap v1646: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:27 smithi035 ceph-mon[92535]: pgmap v1647: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 201 B/s wr, 10 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:29 smithi035 ceph-mon[92535]: pgmap v1648: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:31 smithi035 ceph-mon[92535]: pgmap v1649: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: pgmap v1650: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:47.030 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:48.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:48.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:48.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:48.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:48.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:46:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: pgmap v1651: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: pgmap v1652: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:36 smithi035 ceph-mon[92535]: pgmap v1653: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:38 smithi035 ceph-mon[92535]: pgmap v1654: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:40 smithi035 ceph-mon[92535]: pgmap v1655: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:42 smithi035 ceph-mon[92535]: pgmap v1656: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:44 smithi035 ceph-mon[92535]: pgmap v1657: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:46:49.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:46 smithi035 ceph-mon[92535]: pgmap v1658: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:48 smithi035 ceph-mon[92535]: pgmap v1659: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:50 smithi035 ceph-mon[92535]: pgmap v1660: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:52 smithi035 ceph-mon[92535]: pgmap v1661: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:54 smithi035 ceph-mon[92535]: pgmap v1662: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:56 smithi035 ceph-mon[92535]: pgmap v1663: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:37:58 smithi035 ceph-mon[92535]: pgmap v1664: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:00 smithi035 ceph-mon[92535]: pgmap v1665: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:49.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:02 smithi035 ceph-mon[92535]: pgmap v1666: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:46:49.747 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:04 smithi035 ceph-mon[92535]: pgmap v1667: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:46:49.747 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: *** Caught signal (Segmentation fault) ** 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: in thread 7f33e53e5700 thread_name:md_log_replay 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f33f5f8fcf0] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5626e9ac771f] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5626e9ac9953] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 4: (MDLog::_replay_thread()+0x66d) [0x5626e9b3507d] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5626e97e8d91] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f33f5f851ca] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 7: clone() 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:36:03.920+0000 7f33e53e5700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: in thread 7f33e53e5700 thread_name:md_log_replay 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f33f5f8fcf0] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5626e9ac771f] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5626e9ac9953] 2023-03-17T09:46:49.748 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 4: (MDLog::_replay_thread()+0x66d) [0x5626e9b3507d] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5626e97e8d91] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f33f5f851ca] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 7: clone() 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 0> 2023-03-17T09:36:03.920+0000 7f33e53e5700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: in thread 7f33e53e5700 thread_name:md_log_replay 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f33f5f8fcf0] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5626e9ac771f] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5626e9ac9953] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 4: (MDLog::_replay_thread()+0x66d) [0x5626e9b3507d] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5626e97e8d91] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f33f5f851ca] 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 7: clone() 2023-03-17T09:46:49.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:46:49.750 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:46:49.750 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 0> 2023-03-17T09:36:03.920+0000 7f33e53e5700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: in thread 7f33e53e5700 thread_name:md_log_replay 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f33f5f8fcf0] 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x5626e9ac771f] 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5626e9ac9953] 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 4: (MDLog::_replay_thread()+0x66d) [0x5626e9b3507d] 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5626e97e8d91] 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f33f5f851ca] 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 7: clone() 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T09:46:50.897 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[127901]: 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 1. 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:14 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:14 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:14 smithi035 podman[168035]: 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:15 smithi035 bash[168035]: 299c361600bdf18577bdb2e05ef34220520bcb0e4427bb99a9ff07fde93269f2 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-mds[168076]: -- 172.21.15.35:0/545455657 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b4e5e4b60 con 0x564b4e5ba800 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: starting mds.d at 2023-03-17T09:46:50.898 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:36:15 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T09:46:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:46:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:46:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:46:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:46:52.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:46:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:46:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 -- 172.21.15.35:0/3013486172 wait complete. 2023-03-17T09:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 Processor -- start 2023-03-17T09:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 -- start start 2023-03-17T09:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 0x7f1718196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1718100e90 0x7f1718196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1718105530 0x7f171819ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171819b320 con 0x7f17181004f0 2023-03-17T09:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171819b490 con 0x7f1718100e90 2023-03-17T09:46:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.033+0000 7f171f885700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171819b650 con 0x7f1718105530 2023-03-17T09:46:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 0x7f1718196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 0x7f1718196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46850/0 (socket says 172.21.15.35:46850) 2023-03-17T09:46:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 -- 172.21.15.35:0/4036184222 learned_addr learned my addr 172.21.15.35:0/4036184222 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:46:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171ce20700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1718100e90 0x7f1718196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171de22700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1718105530 0x7f171819ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 -- 172.21.15.35:0/4036184222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1718105530 msgr2=0x7f171819ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1718105530 0x7f171819ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 -- 172.21.15.35:0/4036184222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1718100e90 msgr2=0x7f1718196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1718100e90 0x7f1718196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 -- 172.21.15.35:0/4036184222 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710009d00 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171d621700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 0x7f1718196340 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f171400d950 tx=0x7f171400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f170a7fc700 1 -- 172.21.15.35:0/4036184222 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400f890 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f170a7fc700 1 -- 172.21.15.35:0/4036184222 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f171400fe80 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17181101b0 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f170a7fc700 1 -- 172.21.15.35:0/4036184222 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400e3b0 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.034+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1718110020 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.037+0000 7f170a7fc700 1 -- 172.21.15.35:0/4036184222 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1714010460 con 0x7f17181004f0 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.037+0000 7f170a7fc700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f6c0 0x7f17040a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.037+0000 7f170a7fc700 1 -- 172.21.15.35:0/4036184222 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f17140ca390 con 0x7f17181004f0 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.037+0000 7f171ce20700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f6c0 0x7f17040a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.038+0000 7f171ce20700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f6c0 0x7f17040a1b70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1718197950 tx=0x7f170c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.038+0000 7f172ba12b80 1 Processor -- start 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.038+0000 7f172ba12b80 1 -- start start 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:46:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f172ba12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557059fdd010 con 0x55705a0dbbe0 2023-03-17T09:47:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f172ba12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a02f950 con 0x55705a0dc4f0 2023-03-17T09:47:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f172ba12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a028de0 con 0x55705a0d6960 2023-03-17T09:47:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0dbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46858/0 (socket says 172.21.15.35:46858) 2023-03-17T09:47:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 -- 172.21.15.35:0/3897365414 learned_addr learned my addr 172.21.15.35:0/3897365414 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171de22700 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171ce20700 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 -- 172.21.15.35:0/3897365414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 msgr2=0x55705a0d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 -- 172.21.15.35:0/3897365414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 msgr2=0x55705a0d6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 -- 172.21.15.35:0/3897365414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557059eaa5d0 con 0x55705a0dbbe0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171ce20700 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f171d621700 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0dbfb0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f1714097dd0 tx=0x7f1714010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39fa8ef3f9c7b3c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f17037fe700 1 -- 172.21.15.35:0/3897365414 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140a0030 con 0x55705a0dbbe0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.039+0000 7f17037fe700 1 -- 172.21.15.35:0/3897365414 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17140980a0 con 0x55705a0dbbe0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f17037fe700 1 -- 172.21.15.35:0/3897365414 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171409fe00 con 0x55705a0dbbe0 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 -- 172.21.15.35:0/3897365414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 msgr2=0x55705a0dbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0dbfb0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f1714097dd0 tx=0x7f1714010760 comp rx=0 tx=0).stop 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 -- 172.21.15.35:0/3897365414 shutdown_connections 2023-03-17T09:47:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0dbfb0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3897365414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 -- 172.21.15.35:0/3897365414 >> 172.21.15.35:0/3897365414 conn(0x557059f336b0 msgr2=0x55705a0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 -- 172.21.15.35:0/3897365414 shutdown_connections 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.040+0000 7f172ba12b80 1 -- 172.21.15.35:0/3897365414 wait complete. 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 -- start start 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 Processor -- start 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dbbe0 0x55705a0df720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 0x55705a0dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557059eac8c0 con 0x55705a0dc4f0 2023-03-17T09:47:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0e05d0 con 0x55705a0dbbe0 2023-03-17T09:47:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0ec000 con 0x55705a0d6960 2023-03-17T09:47:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f172ba12b80 10 client.0 _ll_register_callbacks cb 0x557059ece230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:47:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f171de22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 0x55705a0dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f171de22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 0x55705a0dfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46868/0 (socket says 172.21.15.35:46868) 2023-03-17T09:47:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f171de22700 1 -- 172.21.15.35:0/2245388542 learned_addr learned my addr 172.21.15.35:0/2245388542 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.041+0000 7f171d621700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171ce20700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dbbe0 0x55705a0df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171de22700 1 -- 172.21.15.35:0/2245388542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 msgr2=0x55705a0e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171de22700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171de22700 1 -- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dbbe0 msgr2=0x55705a0df720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171de22700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dbbe0 0x55705a0df720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171de22700 1 -- 172.21.15.35:0/2245388542 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1718110020 con 0x55705a0dc4f0 2023-03-17T09:47:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171ce20700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dbbe0 0x55705a0df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f171de22700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 0x55705a0dfe60 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1710007710 tx=0x7f1710007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aec6bf3439632c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f1700ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f1700ff9700 1 -- 172.21.15.35:0/2245388542 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171000e070 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f1700ff9700 1 -- 172.21.15.35:0/2245388542 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1710003e10 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557059feb390 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f1700ff9700 1 -- 172.21.15.35:0/2245388542 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1710005040 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f172ba12b80 10 client.17328 fetch_fsmap learned FSMap version 36 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557059e56d80 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.042+0000 7f1700ff9700 1 -- 172.21.15.35:0/2245388542 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557059feb390 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f1700ff9700 1 -- 172.21.15.35:0/2245388542 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1710019030 con 0x55705a0dc4f0 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f172ba12b80 10 client.17328 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f172ba12b80 10 client.17328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f172ba12b80 20 client.17328 populate_metadata read hostname 'smithi035' 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f172ba12b80 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a0f0140 0x55705a0f2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f172ba12b80 4 client.17328 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557059ff7600 con 0x55705a0f0140 2023-03-17T09:47:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f171d621700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a0f0140 0x55705a0f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f1700ff9700 10 client.17328 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.043+0000 7f171d621700 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a0f0140 0x55705a0f2550 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b292d6e6c270af4 server_cookie=f6e41f1b99dfdfd5 in_seq=0 out_seq=0 2023-03-17T09:47:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f1700ff9700 1 -- 172.21.15.35:0/2245388542 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557059ff7600 con 0x55705a0f0140 2023-03-17T09:47:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f1700ff9700 10 client.17328 handle_command_reply: tid=0 2023-03-17T09:47:14.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 client.17328 shutdown 2023-03-17T09:47:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 msgr2=0x55705a0dfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 0x55705a0dfe60 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1710007710 tx=0x7f1710007740 comp rx=0 tx=0).stop 2023-03-17T09:47:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 shutdown_connections 2023-03-17T09:47:14.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a0f0140 0x55705a0f2550 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:15.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dc4f0 0x55705a0dfe60 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f1700ff9700 0 client.17328 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 --2- 172.21.15.35:0/2245388542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dbbe0 0x55705a0df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 >> 172.21.15.35:0/2245388542 conn(0x557059f336b0 msgr2=0x55705a0d5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 shutdown_connections 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.044+0000 7f172ba12b80 1 -- 172.21.15.35:0/2245388542 wait complete. 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.045+0000 7f172ba12b80 20 client.17328 trim_cache size 0 max 16384 2023-03-17T09:47:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.059+0000 7f172ba12b80 1 Processor -- start 2023-03-17T09:47:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 -- start start 2023-03-17T09:47:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0e6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0cc0f0 con 0x55705a0dbbe0 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0e0440 con 0x55705a0dc4f0 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f172ba12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0d67d0 con 0x55705a0d6960 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0e6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0e6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46874/0 (socket says 172.21.15.35:46874) 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 -- 172.21.15.35:0/3144195091 learned_addr learned my addr 172.21.15.35:0/3144195091 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171d621700 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171de22700 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 -- 172.21.15.35:0/3144195091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 msgr2=0x55705a0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 -- 172.21.15.35:0/3144195091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 msgr2=0x55705a0d5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 -- 172.21.15.35:0/3144195091 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557059fef130 con 0x55705a0dbbe0 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f171ce20700 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0e6f50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f170c010ef0 tx=0x7f170c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fe2ce902768a50 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.060+0000 7f1703fff700 1 -- 172.21.15.35:0/3144195091 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c011db0 con 0x55705a0dbbe0 2023-03-17T09:47:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f1703fff700 1 -- 172.21.15.35:0/3144195091 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f170c015070 con 0x55705a0dbbe0 2023-03-17T09:47:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f1703fff700 1 -- 172.21.15.35:0/3144195091 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c005680 con 0x55705a0dbbe0 2023-03-17T09:47:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 -- 172.21.15.35:0/3144195091 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 msgr2=0x55705a0e6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0e6f50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f170c010ef0 tx=0x7f170c013000 comp rx=0 tx=0).stop 2023-03-17T09:47:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 -- 172.21.15.35:0/3144195091 shutdown_connections 2023-03-17T09:47:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0d5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:21.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0d6960 0x55705a0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 --2- 172.21.15.35:0/3144195091 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0dbbe0 0x55705a0e6f50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 -- 172.21.15.35:0/3144195091 >> 172.21.15.35:0/3144195091 conn(0x557059f336b0 msgr2=0x55705a0ec440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 -- 172.21.15.35:0/3144195091 shutdown_connections 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.061+0000 7f172ba12b80 1 -- 172.21.15.35:0/3144195091 wait complete. 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 -- start start 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 Processor -- start 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 0x55705a0e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0dbbe0 0x55705a0e5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0e5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0e5c10 con 0x55705a0d6960 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0e5d50 con 0x55705a0dc4f0 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55705a0e5f10 con 0x55705a0dbbe0 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f172ba12b80 10 client.0 _ll_register_callbacks cb 0x557059ece230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f171d621700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 0x55705a0e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f171d621700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 0x55705a0e6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46878/0 (socket says 172.21.15.35:46878) 2023-03-17T09:47:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f171d621700 1 -- 172.21.15.35:0/1691365306 learned_addr learned my addr 172.21.15.35:0/1691365306 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.062+0000 7f171de22700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:23.774 INFO:tasks.workunit.client.0.smithi035.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-03-17T09:47:23.774 INFO:tasks.workunit.client.0.smithi035.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-17T09:47:23.774 INFO:tasks.workunit.client.0.smithi035.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-03-17T09:47:23.774 INFO:tasks.workunit.client.0.smithi035.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-03-17T09:47:23.775 INFO:tasks.workunit.client.0.smithi035.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-03-17T09:47:23.775 INFO:tasks.workunit.client.0.smithi035.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-03-17T09:47:23.775 INFO:tasks.workunit.client.0.smithi035.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-17T09:47:23.775 INFO:tasks.workunit.client.0.smithi035.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-03-17T09:47:23.775 INFO:tasks.workunit.client.0.smithi035.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-03-17T09:47:23.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:06 smithi035 ceph-mon[92535]: pgmap v1668: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:47:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171ce20700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0dbbe0 0x55705a0e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171d621700 1 -- 172.21.15.35:0/1691365306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0dbbe0 msgr2=0x55705a0e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171d621700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0dbbe0 0x55705a0e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171d621700 1 -- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 msgr2=0x55705a0e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171d621700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171d621700 1 -- 172.21.15.35:0/1691365306 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c010b50 con 0x55705a0d6960 2023-03-17T09:47:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f171d621700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 0x55705a0e6e20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f17140b0330 tx=0x7f171400dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262f3f71b72015c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f1700ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:47:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f1700ff9700 1 -- 172.21.15.35:0/1691365306 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140c7040 con 0x55705a0d6960 2023-03-17T09:47:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f1700ff9700 1 -- 172.21.15.35:0/1691365306 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f17140982a0 con 0x55705a0d6960 2023-03-17T09:47:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55705a0a61e0 con 0x55705a0d6960 2023-03-17T09:47:28.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f1700ff9700 1 -- 172.21.15.35:0/1691365306 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17140a00b0 con 0x55705a0d6960 2023-03-17T09:47:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f172ba12b80 10 client.17334 fetch_fsmap learned FSMap version 36 2023-03-17T09:47:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557059e7d1f0 con 0x55705a0d6960 2023-03-17T09:47:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.063+0000 7f1700ff9700 1 -- 172.21.15.35:0/1691365306 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55705a0a61e0 con 0x55705a0d6960 2023-03-17T09:47:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f1700ff9700 1 -- 172.21.15.35:0/1691365306 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f171409fba0 con 0x55705a0d6960 2023-03-17T09:47:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f172ba12b80 10 client.17334 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:47:28.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f172ba12b80 10 client.17334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:47:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f172ba12b80 20 client.17334 populate_metadata read hostname 'smithi035' 2023-03-17T09:47:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f172ba12b80 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a14d7f0 0x55705a14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f172ba12b80 4 client.17334 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:47:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557059eacf00 con 0x55705a14d7f0 2023-03-17T09:47:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f171ce20700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a14d7f0 0x55705a14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f171ce20700 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a14d7f0 0x55705a14fbd0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f32ff31e5548ade7 server_cookie=676cedd9a334bfb4 in_seq=0 out_seq=0 2023-03-17T09:47:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.064+0000 7f1700ff9700 10 client.17334 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f1700ff9700 1 -- 172.21.15.35:0/1691365306 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557059eacf00 con 0x55705a14d7f0 2023-03-17T09:47:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f1700ff9700 10 client.17334 handle_command_reply: tid=0 2023-03-17T09:47:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 client.17334 shutdown 2023-03-17T09:47:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 msgr2=0x55705a0e6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 0x55705a0e6e20 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f17140b0330 tx=0x7f171400dfd0 comp rx=0 tx=0).stop 2023-03-17T09:47:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 shutdown_connections 2023-03-17T09:47:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55705a14d7f0 0x55705a14fbd0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55705a0dc4f0 0x55705a0e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f1700ff9700 0 client.17334 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55705a0d6960 0x55705a0e6e20 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 --2- 172.21.15.35:0/1691365306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55705a0dbbe0 0x55705a0e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.072+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 >> 172.21.15.35:0/1691365306 conn(0x557059f336b0 msgr2=0x55705a0d96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 shutdown_connections 2023-03-17T09:47:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f172ba12b80 1 -- 172.21.15.35:0/1691365306 wait complete. 2023-03-17T09:47:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f172ba12b80 20 client.17334 trim_cache size 0 max 16384 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f6c0 msgr2=0x7f17040a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f6c0 0x7f17040a1b70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1718197950 tx=0x7f170c00b410 comp rx=0 tx=0).stop 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 msgr2=0x7f1718196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 0x7f1718196340 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f171400d950 tx=0x7f171400dc60 comp rx=0 tx=0).stop 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 shutdown_connections 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f6c0 0x7f17040a1b70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1718105530 0x7f171819ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17181004f0 0x7f1718196340 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 --2- 172.21.15.35:0/4036184222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1718100e90 0x7f1718196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 >> 172.21.15.35:0/4036184222 conn(0x7f1718078170 msgr2=0x7f17180fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 shutdown_connections 2023-03-17T09:47:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:39.073+0000 7f171f885700 1 -- 172.21.15.35:0/4036184222 wait complete. 2023-03-17T09:47:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 -- 172.21.15.35:0/2344610358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ff350 msgr2=0x7f50100ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 --2- 172.21.15.35:0/2344610358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ff350 0x7f50100ff720 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f500c0099c0 tx=0x7f500c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:47:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 -- 172.21.15.35:0/2344610358 shutdown_connections 2023-03-17T09:47:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 --2- 172.21.15.35:0/2344610358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5010104390 0x7f501010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 --2- 172.21.15.35:0/2344610358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ff350 0x7f50100ff720 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 --2- 172.21.15.35:0/2344610358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50100ffcf0 0x7f5010103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 -- 172.21.15.35:0/2344610358 >> 172.21.15.35:0/2344610358 conn(0x7f5010076330 msgr2=0x7f5010076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 -- 172.21.15.35:0/2344610358 shutdown_connections 2023-03-17T09:47:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.195+0000 7f5017855700 1 -- 172.21.15.35:0/2344610358 wait complete. 2023-03-17T09:47:37.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 Processor -- start 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 -- start start 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50100ff350 0x7f5010197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 0x7f5010197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5010104390 0x7f50101a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010197ea0 con 0x7f50100ffcf0 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010194e40 con 0x7f50100ff350 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5017855700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010194fb0 con 0x7f5010104390 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5014df0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 0x7f5010197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5014df0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 0x7f5010197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46892/0 (socket says 172.21.15.35:46892) 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5014df0700 1 -- 172.21.15.35:0/3824401548 learned_addr learned my addr 172.21.15.35:0/3824401548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f50155f1700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50100ff350 0x7f5010197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.196+0000 7f5015df2700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5010104390 0x7f50101a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5014df0700 1 -- 172.21.15.35:0/3824401548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5010104390 msgr2=0x7f50101a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5014df0700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5010104390 0x7f50101a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5014df0700 1 -- 172.21.15.35:0/3824401548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50100ff350 msgr2=0x7f5010197050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5014df0700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50100ff350 0x7f5010197050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5014df0700 1 -- 172.21.15.35:0/3824401548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0095f0 con 0x7f50100ffcf0 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5014df0700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 0x7f5010197590 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f500000c9b0 tx=0x7f500000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f50067fc700 1 -- 172.21.15.35:0/3824401548 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000007aa0 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f50067fc700 1 -- 172.21.15.35:0/3824401548 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500000ce50 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501010f000 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f50067fc700 1 -- 172.21.15.35:0/3824401548 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000e3b0 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.197+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501010ee70 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.200+0000 7f50067fc700 1 -- 172.21.15.35:0/3824401548 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f500000f450 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.200+0000 7f50067fc700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ffc09f6c0 0x7f4ffc0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.200+0000 7f50067fc700 1 -- 172.21.15.35:0/3824401548 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50000ca0d0 con 0x7f50100ffcf0 2023-03-17T09:47:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.200+0000 7f50155f1700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ffc09f6c0 0x7f4ffc0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50155f1700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ffc09f6c0 0x7f4ffc0a1b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f500c000c00 tx=0x7f500c009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:39.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50239e2b80 1 Processor -- start 2023-03-17T09:47:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50239e2b80 1 -- start start 2023-03-17T09:47:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f13b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.201+0000 7f50239e2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f042010 con 0x55960f140be0 2023-03-17T09:47:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50239e2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f094950 con 0x55960f1414f0 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50239e2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f08dde0 con 0x55960f13b960 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f140fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46898/0 (socket says 172.21.15.35:46898) 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 -- 172.21.15.35:0/2625569268 learned_addr learned my addr 172.21.15.35:0/2625569268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f5015df2700 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f5014df0700 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f13b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 -- 172.21.15.35:0/2625569268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 msgr2=0x55960f13bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 -- 172.21.15.35:0/2625569268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 msgr2=0x55960f13b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f13b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 -- 172.21.15.35:0/2625569268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55960ef0f5d0 con 0x55960f140be0 2023-03-17T09:47:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f50155f1700 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f140fb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f500c005150 tx=0x7f500c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45414bddeeb3d5cf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f4ffb7fe700 1 -- 172.21.15.35:0/2625569268 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00bed0 con 0x55960f140be0 2023-03-17T09:47:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f4ffb7fe700 1 -- 172.21.15.35:0/2625569268 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f500c01e040 con 0x55960f140be0 2023-03-17T09:47:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.202+0000 7f4ffb7fe700 1 -- 172.21.15.35:0/2625569268 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c003b30 con 0x55960f140be0 2023-03-17T09:47:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 -- 172.21.15.35:0/2625569268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 msgr2=0x55960f140fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f140fb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f500c005150 tx=0x7f500c020000 comp rx=0 tx=0).stop 2023-03-17T09:47:43.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 -- 172.21.15.35:0/2625569268 shutdown_connections 2023-03-17T09:47:43.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:43.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f140fb0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:43.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2625569268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f13b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:43.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 -- 172.21.15.35:0/2625569268 >> 172.21.15.35:0/2625569268 conn(0x55960ef986b0 msgr2=0x55960f135a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:43.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 -- 172.21.15.35:0/2625569268 shutdown_connections 2023-03-17T09:47:43.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.203+0000 7f50239e2b80 1 -- 172.21.15.35:0/2625569268 wait complete. 2023-03-17T09:47:43.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 -- start start 2023-03-17T09:47:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 Processor -- start 2023-03-17T09:47:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f1474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f140be0 0x55960f144740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 0x55960f144d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960ef118c0 con 0x55960f1414f0 2023-03-17T09:47:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f1454b0 con 0x55960f140be0 2023-03-17T09:47:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f150f10 con 0x55960f13b960 2023-03-17T09:47:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50239e2b80 10 client.0 _ll_register_callbacks cb 0x55960ef33230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:47:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f5015df2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 0x55960f144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f5015df2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 0x55960f144d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46908/0 (socket says 172.21.15.35:46908) 2023-03-17T09:47:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f5015df2700 1 -- 172.21.15.35:0/3013521479 learned_addr learned my addr 172.21.15.35:0/3013521479 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:48.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f50155f1700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f1474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.204+0000 7f5014df0700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f140be0 0x55960f144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f5015df2700 1 -- 172.21.15.35:0/3013521479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 msgr2=0x55960f1474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f5015df2700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f1474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f5015df2700 1 -- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f140be0 msgr2=0x55960f144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f5015df2700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f140be0 0x55960f144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f5015df2700 1 -- 172.21.15.35:0/3013521479 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501010c7a0 con 0x55960f1414f0 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f50155f1700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f5015df2700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 0x55960f144d70 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f500800ae80 tx=0x7f5008012510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc40ab51025ec6b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:48.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f4ff8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/3013521479 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500800f040 con 0x55960f1414f0 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/3013521479 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5008012bf0 con 0x55960f1414f0 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55960f050390 con 0x55960f1414f0 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/3013521479 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5008012db0 con 0x55960f1414f0 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f50239e2b80 10 client.17346 fetch_fsmap learned FSMap version 36 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55960eebbd80 con 0x55960f1414f0 2023-03-17T09:47:48.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.205+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/3013521479 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55960f050390 con 0x55960f1414f0 2023-03-17T09:47:48.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/3013521479 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f50080083f0 con 0x55960f1414f0 2023-03-17T09:47:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50239e2b80 10 client.17346 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:47:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50239e2b80 10 client.17346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:47:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50239e2b80 20 client.17346 populate_metadata read hostname 'smithi035' 2023-03-17T09:47:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50239e2b80 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f154fd0 0x55960f1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50239e2b80 4 client.17346 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:47:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55960f05c600 con 0x55960f154fd0 2023-03-17T09:47:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50155f1700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f154fd0 0x55960f1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f4ff8ff9700 10 client.17346 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:50.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.206+0000 7f50155f1700 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f154fd0 0x55960f1573e0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90d7f36fe0010e7e server_cookie=f18f8b3fc7c3ca6b in_seq=0 out_seq=0 2023-03-17T09:47:50.024 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T09:47:50.746 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-03-17T09:47:50.746 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-03-17T09:47:50.747 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:08 smithi035 ceph-mon[92535]: pgmap v1669: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:47:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/3013521479 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55960f05c600 con 0x55960f154fd0 2023-03-17T09:47:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f4ff8ff9700 10 client.17346 handle_command_reply: tid=0 2023-03-17T09:47:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 client.17346 shutdown 2023-03-17T09:47:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 msgr2=0x55960f144d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 0x55960f144d70 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f500800ae80 tx=0x7f5008012510 comp rx=0 tx=0).stop 2023-03-17T09:47:50.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 shutdown_connections 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f154fd0 0x55960f1573e0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f1414f0 0x55960f144d70 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 --2- 172.21.15.35:0/3013521479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f140be0 0x55960f144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f4ff8ff9700 0 client.17346 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 >> 172.21.15.35:0/3013521479 conn(0x55960ef986b0 msgr2=0x55960f13a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 shutdown_connections 2023-03-17T09:47:50.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.207+0000 7f50239e2b80 1 -- 172.21.15.35:0/3013521479 wait complete. 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.208+0000 7f50239e2b80 20 client.17346 trim_cache size 0 max 16384 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 Processor -- start 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 -- start start 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f14be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f1310f0 con 0x55960f140be0 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f1526d0 con 0x55960f1414f0 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.222+0000 7f50239e2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f13b7d0 con 0x55960f13b960 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f14be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f14be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46914/0 (socket says 172.21.15.35:46914) 2023-03-17T09:47:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 -- 172.21.15.35:0/2226093322 learned_addr learned my addr 172.21.15.35:0/2226093322 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5015df2700 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f50155f1700 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 -- 172.21.15.35:0/2226093322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 msgr2=0x55960f13edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 -- 172.21.15.35:0/2226093322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 msgr2=0x55960f146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 -- 172.21.15.35:0/2226093322 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55960f054130 con 0x55960f140be0 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5015df2700 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f5014df0700 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f14be60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f50000074a0 tx=0x7f5000097810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e537f707e5acf5f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f4ffbfff700 1 -- 172.21.15.35:0/2226093322 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000097c20 con 0x55960f140be0 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f4ffbfff700 1 -- 172.21.15.35:0/2226093322 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50000af070 con 0x55960f140be0 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.223+0000 7f4ffbfff700 1 -- 172.21.15.35:0/2226093322 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000097e80 con 0x55960f140be0 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 -- 172.21.15.35:0/2226093322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 msgr2=0x55960f14be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f14be60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f50000074a0 tx=0x7f5000097810 comp rx=0 tx=0).stop 2023-03-17T09:47:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 -- 172.21.15.35:0/2226093322 shutdown_connections 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f1414f0 0x55960f146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f13b960 0x55960f13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2226093322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f14be60 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 -- 172.21.15.35:0/2226093322 >> 172.21.15.35:0/2226093322 conn(0x55960ef986b0 msgr2=0x55960f13e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 -- 172.21.15.35:0/2226093322 shutdown_connections 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 -- 172.21.15.35:0/2226093322 wait complete. 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 -- start start 2023-03-17T09:47:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.224+0000 7f50239e2b80 1 Processor -- start 2023-03-17T09:47:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f13b960 0x55960f19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f19d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f1414f0 0x55960f1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f1a2350 con 0x55960f140be0 2023-03-17T09:47:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f1a24c0 con 0x55960f13b960 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55960f1a2680 con 0x55960f1414f0 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 10 client.0 _ll_register_callbacks cb 0x55960ef33230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f19d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f19d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46920/0 (socket says 172.21.15.35:46920) 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 -- 172.21.15.35:0/2732436543 learned_addr learned my addr 172.21.15.35:0/2732436543 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5015df2700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f1414f0 0x55960f1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 -- 172.21.15.35:0/2732436543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f1414f0 msgr2=0x55960f1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f1414f0 0x55960f1a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 -- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f13b960 msgr2=0x55960f19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50155f1700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f13b960 0x55960f19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f13b960 0x55960f19cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 -- 172.21.15.35:0/2732436543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501010ee70 con 0x55960f140be0 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f5014df0700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f19d4f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5000097bb0 tx=0x7f500009ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec8dc77eee2ecfb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f4ff8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/2732436543 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500007a020 con 0x55960f140be0 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/2732436543 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5000096080 con 0x55960f140be0 2023-03-17T09:47:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.225+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55960f10b1e0 con 0x55960f140be0 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/2732436543 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5000097e80 con 0x55960f140be0 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 10 client.17352 fetch_fsmap learned FSMap version 36 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55960eee21f0 con 0x55960f140be0 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/2732436543 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50000a4020 con 0x55960f140be0 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/2732436543 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5000093a10 con 0x55960f140be0 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 10 client.17352 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 10 client.17352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 20 client.17352 populate_metadata read hostname 'smithi035' 2023-03-17T09:47:51.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f1a99f0 0x55960f1abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 4 client.17352 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55960ef11f00 con 0x55960f1a99f0 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.226+0000 7f50155f1700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f1a99f0 0x55960f1abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.227+0000 7f4ff8ff9700 10 client.17352 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.227+0000 7f50155f1700 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f1a99f0 0x55960f1abe00 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a145d1d35a117f server_cookie=497489c7de327dc2 in_seq=0 out_seq=0 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f4ff8ff9700 1 -- 172.21.15.35:0/2732436543 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55960ef11f00 con 0x55960f1a99f0 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f4ff8ff9700 10 client.17352 handle_command_reply: tid=0 2023-03-17T09:47:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 client.17352 shutdown 2023-03-17T09:47:51.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 msgr2=0x55960f19d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f19d4f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5000097bb0 tx=0x7f500009ff40 comp rx=0 tx=0).stop 2023-03-17T09:47:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 shutdown_connections 2023-03-17T09:47:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55960f1a99f0 0x55960f1abe00 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55960f1414f0 0x55960f1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f4ff8ff9700 0 client.17352 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:47:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55960f13b960 0x55960f19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 --2- 172.21.15.35:0/2732436543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55960f140be0 0x55960f19d4f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 >> 172.21.15.35:0/2732436543 conn(0x55960ef986b0 msgr2=0x55960f13f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 shutdown_connections 2023-03-17T09:47:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 1 -- 172.21.15.35:0/2732436543 wait complete. 2023-03-17T09:47:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.231+0000 7f50239e2b80 20 client.17352 trim_cache size 0 max 16384 2023-03-17T09:47:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ffc09f6c0 msgr2=0x7f4ffc0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ffc09f6c0 0x7f4ffc0a1b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f500c000c00 tx=0x7f500c009f10 comp rx=0 tx=0).stop 2023-03-17T09:47:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 msgr2=0x7f5010197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 0x7f5010197590 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f500000c9b0 tx=0x7f500000ccc0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 shutdown_connections 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ffc09f6c0 0x7f4ffc0a1b70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5010104390 0x7f50101a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50100ff350 0x7f5010197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 --2- 172.21.15.35:0/3824401548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50100ffcf0 0x7f5010197590 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 >> 172.21.15.35:0/3824401548 conn(0x7f5010076330 msgr2=0x7f50100fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 shutdown_connections 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:24:52.232+0000 7f5017855700 1 -- 172.21.15.35:0/3824401548 wait complete. 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.354+0000 7f8603567700 1 -- 172.21.15.35:0/1696797866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc101b80 msgr2=0x7f85fc10a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.354+0000 7f8603567700 1 --2- 172.21.15.35:0/1696797866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc101b80 0x7f85fc10a250 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009990 tx=0x7f85f8009ca0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 -- 172.21.15.35:0/1696797866 shutdown_connections 2023-03-17T09:47:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 --2- 172.21.15.35:0/1696797866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc10a790 0x7f85fc10cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 --2- 172.21.15.35:0/1696797866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc101270 0x7f85fc101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 --2- 172.21.15.35:0/1696797866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc101b80 0x7f85fc10a250 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 -- 172.21.15.35:0/1696797866 >> 172.21.15.35:0/1696797866 conn(0x7f85fc076330 msgr2=0x7f85fc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:53.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 -- 172.21.15.35:0/1696797866 shutdown_connections 2023-03-17T09:47:53.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 -- 172.21.15.35:0/1696797866 wait complete. 2023-03-17T09:47:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 Processor -- start 2023-03-17T09:47:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 -- start start 2023-03-17T09:47:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.355+0000 7f8603567700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc101270 0x7f85fc1961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc101b80 0x7f85fc196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 0x7f85fc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc19b1c0 con 0x7f85fc10a790 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc19b330 con 0x7f85fc101b80 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc19b4f0 con 0x7f85fc101270 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 0x7f85fc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 0x7f85fc19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46936/0 (socket says 172.21.15.35:46936) 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 -- 172.21.15.35:0/3565467762 learned_addr learned my addr 172.21.15.35:0/3565467762 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8600b02700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc101b80 0x7f85fc196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601303700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc101270 0x7f85fc1961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 -- 172.21.15.35:0/3565467762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc101270 msgr2=0x7f85fc1961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc101270 0x7f85fc1961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 -- 172.21.15.35:0/3565467762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc101b80 msgr2=0x7f85fc196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc101b80 0x7f85fc196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 -- 172.21.15.35:0/3565467762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80095f0 con 0x7f85fc10a790 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8600b02700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc101b80 0x7f85fc196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:47:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8601b04700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 0x7f85fc19ab80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f85f4007d70 tx=0x7f85f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f85ee7fc700 1 -- 172.21.15.35:0/3565467762 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400ad40 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f85ee7fc700 1 -- 172.21.15.35:0/3565467762 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85f40128b0 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc110110 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f85ee7fc700 1 -- 172.21.15.35:0/3565467762 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40116b0 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.356+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc10ff80 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.359+0000 7f85ee7fc700 1 -- 172.21.15.35:0/3565467762 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f85f4012a20 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.359+0000 7f85ee7fc700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f85e809f640 0x7f85e80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.359+0000 7f8601303700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f85e809f640 0x7f85e80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.359+0000 7f85ee7fc700 1 -- 172.21.15.35:0/3565467762 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f85f40ca800 con 0x7f85fc10a790 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.360+0000 7f8601303700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f85e809f640 0x7f85e80a1af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85f0005950 tx=0x7f85f00058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.360+0000 7f860f6f4b80 1 Processor -- start 2023-03-17T09:47:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.360+0000 7f860f6f4b80 1 -- start start 2023-03-17T09:47:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f644013fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 0x55f64400e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f64400e960 0x55f64400ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:47:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f643f15010 con 0x55f6440144f0 2023-03-17T09:47:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f643f67950 con 0x55f64400e960 2023-03-17T09:47:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f643f60de0 con 0x55f644013be0 2023-03-17T09:47:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 0x55f64400e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 0x55f64400e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46942/0 (socket says 172.21.15.35:46942) 2023-03-17T09:47:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 -- 172.21.15.35:0/2923195505 learned_addr learned my addr 172.21.15.35:0/2923195505 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:47:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8601b04700 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f64400e960 0x55f64400ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:58.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:09 smithi035 ceph-mon[92535]: osdmap e181: 12 total, 12 up, 12 in 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8601303700 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f644013fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 -- 172.21.15.35:0/2923195505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 msgr2=0x55f644013fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f644013fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 -- 172.21.15.35:0/2923195505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f64400e960 msgr2=0x55f64400ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f64400e960 0x55f64400ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 -- 172.21.15.35:0/2923195505 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f643de25d0 con 0x55f6440144f0 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8601b04700 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f64400e960 0x55f64400ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.361+0000 7f8600b02700 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 0x55f64400e420 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f85f8015000 tx=0x7f85f8009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e609ca29816cc0f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f85e77fe700 1 -- 172.21.15.35:0/2923195505 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8005230 con 0x55f6440144f0 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f85e77fe700 1 -- 172.21.15.35:0/2923195505 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85f801e040 con 0x55f6440144f0 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f85e77fe700 1 -- 172.21.15.35:0/2923195505 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80048d0 con 0x55f6440144f0 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2923195505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 msgr2=0x55f64400e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 0x55f64400e420 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f85f8015000 tx=0x7f85f8009ee0 comp rx=0 tx=0).stop 2023-03-17T09:47:59.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2923195505 shutdown_connections 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f64400e960 0x55f64400ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f644013fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2923195505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f6440144f0 0x55f64400e420 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2923195505 >> 172.21.15.35:0/2923195505 conn(0x55f643e6b6b0 msgr2=0x55f644008a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.362+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2923195505 shutdown_connections 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.363+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2923195505 wait complete. 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.363+0000 7f860f6f4b80 1 -- start start 2023-03-17T09:47:59.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.363+0000 7f860f6f4b80 1 Processor -- start 2023-03-17T09:48:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f64400e960 0x55f64401a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 0x55f644017720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f644017d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f643de48c0 con 0x55f644013be0 2023-03-17T09:48:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6440184a0 con 0x55f6440144f0 2023-03-17T09:48:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f644023fa0 con 0x55f64400e960 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f860f6f4b80 10 client.0 _ll_register_callbacks cb 0x55f643e06230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 0x55f644017720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 0x55f644017720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46948/0 (socket says 172.21.15.35:46948) 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 -- 172.21.15.35:0/1800760915 learned_addr learned my addr 172.21.15.35:0/1800760915 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8601303700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f64400e960 0x55f64401a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8601b04700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f644017d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 -- 172.21.15.35:0/1800760915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f64400e960 msgr2=0x55f64401a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f64400e960 0x55f64401a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 -- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 msgr2=0x55f644017d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f644017d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 -- 172.21.15.35:0/1800760915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc10d8e0 con 0x55f644013be0 2023-03-17T09:48:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8601b04700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f644017d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:48:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f8600b02700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 0x55f644017720 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f85f800bed0 tx=0x7f85f8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee82efe2729e05c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f85e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:48:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.364+0000 7f85e4ff9700 1 -- 172.21.15.35:0/1800760915 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80048b0 con 0x55f644013be0 2023-03-17T09:48:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f643f23390 con 0x55f644013be0 2023-03-17T09:48:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f85e4ff9700 1 -- 172.21.15.35:0/1800760915 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f85f80056a0 con 0x55f644013be0 2023-03-17T09:48:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f85e4ff9700 1 -- 172.21.15.35:0/1800760915 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f800bcf0 con 0x55f644013be0 2023-03-17T09:48:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 10 client.17364 fetch_fsmap learned FSMap version 36 2023-03-17T09:48:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f643d8ed80 con 0x55f644013be0 2023-03-17T09:48:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f85e4ff9700 1 -- 172.21.15.35:0/1800760915 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f643f23390 con 0x55f644013be0 2023-03-17T09:48:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f85e4ff9700 1 -- 172.21.15.35:0/1800760915 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f85f8029030 con 0x55f644013be0 2023-03-17T09:48:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 10 client.17364 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:48:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 10 client.17364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:48:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 20 client.17364 populate_metadata read hostname 'smithi035' 2023-03-17T09:48:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f644027b20 0x55f644029f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 4 client.17364 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:48:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f643f2f600 con 0x55f644027b20 2023-03-17T09:48:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.365+0000 7f8601303700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f644027b20 0x55f644029f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.366+0000 7f8601303700 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f644027b20 0x55f644029f30 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8a4aadd630c2b3d server_cookie=c74353598d204141 in_seq=0 out_seq=0 2023-03-17T09:48:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.366+0000 7f85e4ff9700 10 client.17364 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f85e4ff9700 1 -- 172.21.15.35:0/1800760915 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f643f2f600 con 0x55f644027b20 2023-03-17T09:48:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f85e4ff9700 10 client.17364 handle_command_reply: tid=0 2023-03-17T09:48:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 client.17364 shutdown 2023-03-17T09:48:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 msgr2=0x55f644017720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 0x55f644017720 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f85f800bed0 tx=0x7f85f8005270 comp rx=0 tx=0).stop 2023-03-17T09:48:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 shutdown_connections 2023-03-17T09:48:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f644027b20 0x55f644029f30 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f644017d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f64400e960 0x55f64401a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f85e4ff9700 0 client.17364 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/1800760915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f644013be0 0x55f644017720 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:06.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 >> 172.21.15.35:0/1800760915 conn(0x55f643e6b6b0 msgr2=0x55f64400d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 shutdown_connections 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 1 -- 172.21.15.35:0/1800760915 wait complete. 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.367+0000 7f860f6f4b80 20 client.17364 trim_cache size 0 max 16384 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 Processor -- start 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 -- start start 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f644008ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:06.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64400d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f644005b60 con 0x55f64400e960 2023-03-17T09:48:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f644009000 con 0x55f6440144f0 2023-03-17T09:48:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6440040d0 con 0x55f644013be0 2023-03-17T09:48:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.382+0000 7f8601303700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f644008ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f644008ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46954/0 (socket says 172.21.15.35:46954) 2023-03-17T09:48:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 -- 172.21.15.35:0/135590620 learned_addr learned my addr 172.21.15.35:0/135590620 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8600b02700 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 -- 172.21.15.35:0/135590620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 msgr2=0x55f64401eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 -- 172.21.15.35:0/135590620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 msgr2=0x55f64400d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64400d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 -- 172.21.15.35:0/135590620 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f643f27130 con 0x55f64400e960 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8600b02700 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f8601303700 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f644008ac0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f85f0014040 tx=0x7f85f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e901575f0adf43 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f85e7fff700 1 -- 172.21.15.35:0/135590620 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0025040 con 0x55f64400e960 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f85e7fff700 1 -- 172.21.15.35:0/135590620 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85f0027370 con 0x55f64400e960 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.383+0000 7f85e7fff700 1 -- 172.21.15.35:0/135590620 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0027e80 con 0x55f64400e960 2023-03-17T09:48:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 -- 172.21.15.35:0/135590620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 msgr2=0x55f644008ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f644008ac0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f85f0014040 tx=0x7f85f0015000 comp rx=0 tx=0).stop 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 -- 172.21.15.35:0/135590620 shutdown_connections 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64400d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f644008ac0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/135590620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 -- 172.21.15.35:0/135590620 >> 172.21.15.35:0/135590620 conn(0x55f643e6b6b0 msgr2=0x55f64402e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:07.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 -- 172.21.15.35:0/135590620 shutdown_connections 2023-03-17T09:48:07.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 -- 172.21.15.35:0/135590620 wait complete. 2023-03-17T09:48:07.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 -- start start 2023-03-17T09:48:07.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.384+0000 7f860f6f4b80 1 Processor -- start 2023-03-17T09:48:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f64401e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:08.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64401ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64401d4b0 con 0x55f64400e960 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64401d620 con 0x55f6440144f0 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64401d7e0 con 0x55f644013be0 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f860f6f4b80 10 client.0 _ll_register_callbacks cb 0x55f643e06230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f64401e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f64401e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46960/0 (socket says 172.21.15.35:46960) 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 -- 172.21.15.35:0/2815944676 learned_addr learned my addr 172.21.15.35:0/2815944676 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601b04700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64401ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 -- 172.21.15.35:0/2815944676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 msgr2=0x55f64401ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 -- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 msgr2=0x55f64401ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:08.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64401ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601303700 1 -- 172.21.15.35:0/2815944676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f000f9e0 con 0x55f64400e960 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.385+0000 7f8601b04700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64401ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f8601303700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f64401e8e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b8c0 tx=0x7f85f0012ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f700f3b6e38706 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f85e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f85e4ff9700 1 -- 172.21.15.35:0/2815944676 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0011b30 con 0x55f64400e960 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f643fde1e0 con 0x55f64400e960 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f85e4ff9700 1 -- 172.21.15.35:0/2815944676 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f85f0011c90 con 0x55f64400e960 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f85e4ff9700 1 -- 172.21.15.35:0/2815944676 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f0011e50 con 0x55f64400e960 2023-03-17T09:48:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 10 client.17370 fetch_fsmap learned FSMap version 36 2023-03-17T09:48:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f643db51f0 con 0x55f64400e960 2023-03-17T09:48:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f85e4ff9700 1 -- 172.21.15.35:0/2815944676 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f643fde1e0 con 0x55f64400e960 2023-03-17T09:48:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f85e4ff9700 1 -- 172.21.15.35:0/2815944676 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f85f0036020 con 0x55f64400e960 2023-03-17T09:48:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 10 client.17370 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:48:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 10 client.17370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:48:08.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 20 client.17370 populate_metadata read hostname 'smithi035' 2023-03-17T09:48:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f64407ca80 0x55f64407ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 4 client.17370 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:48:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.386+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f643de4f00 con 0x55f64407ca80 2023-03-17T09:48:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.387+0000 7f8600b02700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f64407ca80 0x55f64407ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.387+0000 7f85e4ff9700 10 client.17370 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.387+0000 7f8600b02700 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f64407ca80 0x55f64407ee90 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993db0d9dd5715bf server_cookie=33316f791858efa in_seq=0 out_seq=0 2023-03-17T09:48:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.394+0000 7f85e4ff9700 1 -- 172.21.15.35:0/2815944676 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f643de4f00 con 0x55f64407ca80 2023-03-17T09:48:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.394+0000 7f85e4ff9700 10 client.17370 handle_command_reply: tid=0 2023-03-17T09:48:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.394+0000 7f860f6f4b80 1 client.17370 shutdown 2023-03-17T09:48:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 msgr2=0x55f64401e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f64401e8e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b8c0 tx=0x7f85f0012ec0 comp rx=0 tx=0).stop 2023-03-17T09:48:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 shutdown_connections 2023-03-17T09:48:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f64407ca80 0x55f64407ee90 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f6440144f0 0x55f64401ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f64400e960 0x55f64401e8e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:10.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f85e4ff9700 0 client.17370 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 --2- 172.21.15.35:0/2815944676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f644013be0 0x55f64401ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 >> 172.21.15.35:0/2815944676 conn(0x55f643e6b6b0 msgr2=0x55f64400d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 shutdown_connections 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 1 -- 172.21.15.35:0/2815944676 wait complete. 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f860f6f4b80 20 client.17370 trim_cache size 0 max 16384 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f85e809f640 msgr2=0x7f85e80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f85e809f640 0x7f85e80a1af0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85f0005950 tx=0x7f85f00058e0 comp rx=0 tx=0).stop 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 msgr2=0x7f85fc19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 0x7f85fc19ab80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f85f4007d70 tx=0x7f85f400a340 comp rx=0 tx=0).stop 2023-03-17T09:48:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 shutdown_connections 2023-03-17T09:48:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f85e809f640 0x7f85e80a1af0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85fc10a790 0x7f85fc19ab80 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:15.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:10 smithi035 ceph-mon[92535]: pgmap v1671: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:48:17.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:12 smithi035 ceph-mon[92535]: pgmap v1672: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:48:17.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:14 smithi035 ceph-mon[92535]: pgmap v1673: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:48:17.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:16 smithi035 ceph-mon[92535]: osdmap e182: 12 total, 12 up, 12 in 2023-03-17T09:48:17.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:16 smithi035 ceph-mon[92535]: pgmap v1675: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:48:17.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:18 smithi035 ceph-mon[92535]: pgmap v1676: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:20 smithi035 ceph-mon[92535]: pgmap v1677: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:22 smithi035 ceph-mon[92535]: pgmap v1678: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:24 smithi035 ceph-mon[92535]: pgmap v1679: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:26 smithi035 ceph-mon[92535]: pgmap v1680: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:28 smithi035 ceph-mon[92535]: pgmap v1681: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:30 smithi035 ceph-mon[92535]: pgmap v1682: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:48:17.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:32 smithi035 ceph-mon[92535]: pgmap v1683: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:48:18.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:34 smithi035 ceph-mon[92535]: pgmap v1684: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:48:19.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:48:19.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:36 smithi035 ceph-mon[92535]: pgmap v1685: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:48:19.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:19.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:19.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:48:19.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:48:21.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: pgmap v1686: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-17T09:48:21.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: pgmap v1687: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:48:22.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:22.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:40 smithi035 ceph-mon[92535]: pgmap v1688: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:48:22.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:42 smithi035 ceph-mon[92535]: pgmap v1689: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:48:22.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:44 smithi035 ceph-mon[92535]: pgmap v1690: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:48:22.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:46 smithi035 ceph-mon[92535]: pgmap v1691: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:48:22.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:48 smithi035 ceph-mon[92535]: pgmap v1692: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:48:24.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:50 smithi035 ceph-mon[92535]: pgmap v1693: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:48:24.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:52 smithi035 ceph-mon[92535]: pgmap v1694: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:48:24.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:54 smithi035 ceph-mon[92535]: pgmap v1695: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:56 smithi035 ceph-mon[92535]: pgmap v1696: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:38:58 smithi035 ceph-mon[92535]: pgmap v1697: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:00 smithi035 ceph-mon[92535]: pgmap v1698: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:02 smithi035 ceph-mon[92535]: pgmap v1699: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:04 smithi035 ceph-mon[92535]: pgmap v1700: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:06 smithi035 ceph-mon[92535]: pgmap v1701: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:48:25.368 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:08 smithi035 ceph-mon[92535]: pgmap v1702: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:09 smithi035 ceph-mon[92535]: osdmap e183: 12 total, 12 up, 12 in 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:10 smithi035 ceph-mon[92535]: pgmap v1704: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:12 smithi035 ceph-mon[92535]: pgmap v1705: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:14 smithi035 ceph-mon[92535]: pgmap v1706: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:16 smithi035 ceph-mon[92535]: pgmap v1707: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:16 smithi035 ceph-mon[92535]: osdmap e184: 12 total, 12 up, 12 in 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:18 smithi035 ceph-mon[92535]: pgmap v1709: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 119 B/s wr, 12 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:20 smithi035 ceph-mon[92535]: pgmap v1710: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:48:25.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:22 smithi035 ceph-mon[92535]: pgmap v1711: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:48:25.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:24 smithi035 ceph-mon[92535]: pgmap v1712: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:48:25.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:26 smithi035 ceph-mon[92535]: pgmap v1713: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:48:25.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:28 smithi035 ceph-mon[92535]: pgmap v1714: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 440 B/s wr, 13 op/s 2023-03-17T09:48:25.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:30 smithi035 ceph-mon[92535]: pgmap v1715: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:48:25.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:32 smithi035 ceph-mon[92535]: pgmap v1716: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:48:27.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:34 smithi035 ceph-mon[92535]: pgmap v1717: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:36 smithi035 ceph-mon[92535]: pgmap v1718: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:38 smithi035 ceph-mon[92535]: pgmap v1719: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:40 smithi035 ceph-mon[92535]: pgmap v1720: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:27.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:27.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:48:27.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:48:27.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:48:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:48:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:48:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:48:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:48:28.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:48:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:48:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:48:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:48:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:48:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:48:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:48:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:48:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85fc101270 0x7f85fc1961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.395+0000 7f8603567700 1 --2- 172.21.15.35:0/3565467762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85fc101b80 0x7f85fc196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.396+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 >> 172.21.15.35:0/3565467762 conn(0x7f85fc076330 msgr2=0x7f85fc0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.396+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 shutdown_connections 2023-03-17T09:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:05.396+0000 7f8603567700 1 -- 172.21.15.35:0/3565467762 wait complete. 2023-03-17T09:48:30.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 -- 172.21.15.35:0/324574825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ffcf0 msgr2=0x7f3a90103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/324574825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ffcf0 0x7f3a90103cb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3a800099c0 tx=0x7f3a80009cd0 comp rx=0 tx=0).stop 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 -- 172.21.15.35:0/324574825 shutdown_connections 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/324574825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a90104390 0x7f3a9010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/324574825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ff350 0x7f3a900ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/324574825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ffcf0 0x7f3a90103cb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 -- 172.21.15.35:0/324574825 >> 172.21.15.35:0/324574825 conn(0x7f3a90076330 msgr2=0x7f3a90076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:30.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 -- 172.21.15.35:0/324574825 shutdown_connections 2023-03-17T09:48:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 -- 172.21.15.35:0/324574825 wait complete. 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 Processor -- start 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.518+0000 7f3a97a1f700 1 -- start start 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a97a1f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 0x7f3a90194070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a97a1f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ffcf0 0x7f3a901945b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a97a1f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a90104390 0x7f3a90198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a97a1f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90199050 con 0x7f3a900ff350 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a97a1f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901991c0 con 0x7f3a900ffcf0 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a97a1f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90199380 con 0x7f3a90104390 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 0x7f3a90194070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 0x7f3a90194070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46974/0 (socket says 172.21.15.35:46974) 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 -- 172.21.15.35:0/3670717168 learned_addr learned my addr 172.21.15.35:0/3670717168 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a95fbc700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a90104390 0x7f3a90198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a94fba700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ffcf0 0x7f3a901945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 -- 172.21.15.35:0/3670717168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a90104390 msgr2=0x7f3a90198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:34.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a90104390 0x7f3a90198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:34.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 -- 172.21.15.35:0/3670717168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ffcf0 msgr2=0x7f3a901945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:34.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ffcf0 0x7f3a901945b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:34.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 -- 172.21.15.35:0/3670717168 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800095f0 con 0x7f3a900ff350 2023-03-17T09:48:34.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a94fba700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ffcf0 0x7f3a901945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.519+0000 7f3a957bb700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 0x7f3a90194070 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c9b0 tx=0x7f3a8c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.520+0000 7f3a867fc700 1 -- 172.21.15.35:0/3670717168 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c007b00 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.520+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9010df10 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.520+0000 7f3a867fc700 1 -- 172.21.15.35:0/3670717168 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a8c007c60 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.520+0000 7f3a867fc700 1 -- 172.21.15.35:0/3670717168 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c018660 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.520+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9010dd80 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.522+0000 7f3a867fc700 1 -- 172.21.15.35:0/3670717168 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3a8c00f450 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.522+0000 7f3a867fc700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a7c09f640 0x7f3a7c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.522+0000 7f3a867fc700 1 -- 172.21.15.35:0/3670717168 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3a8c0ca620 con 0x7f3a900ff350 2023-03-17T09:48:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.522+0000 7f3a94fba700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a7c09f640 0x7f3a7c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.523+0000 7f3a94fba700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a7c09f640 0x7f3a7c0a1af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000b580 tx=0x7f3a80010040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 Processor -- start 2023-03-17T09:48:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 -- start start 2023-03-17T09:48:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad0297410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 0x561ad0291ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad02921e0 0x561ad029ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad0194010 con 0x561ad0291830 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad01e6950 con 0x561ad02921e0 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad01dfde0 con 0x561ad0297040 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 0x561ad0291ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 0x561ad0291ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46984/0 (socket says 172.21.15.35:46984) 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 -- 172.21.15.35:0/715434686 learned_addr learned my addr 172.21.15.35:0/715434686 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a957bb700 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad0297410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a95fbc700 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad02921e0 0x561ad029ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 -- 172.21.15.35:0/715434686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 msgr2=0x561ad0297410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad0297410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 -- 172.21.15.35:0/715434686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad02921e0 msgr2=0x561ad029ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad02921e0 0x561ad029ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 -- 172.21.15.35:0/715434686 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ad00615d0 con 0x561ad0291830 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.524+0000 7f3a94fba700 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 0x561ad0291ca0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3a80017000 tx=0x7f3a80020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28ee6809d4723d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3a7b7fe700 1 -- 172.21.15.35:0/715434686 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80003a20 con 0x561ad0291830 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3a7b7fe700 1 -- 172.21.15.35:0/715434686 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a80005500 con 0x561ad0291830 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3a7b7fe700 1 -- 172.21.15.35:0/715434686 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80023ca0 con 0x561ad0291830 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/715434686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 msgr2=0x561ad0291ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 0x561ad0291ca0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3a80017000 tx=0x7f3a80020000 comp rx=0 tx=0).stop 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/715434686 shutdown_connections 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad02921e0 0x561ad029ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad0297410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/715434686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad0291830 0x561ad0291ca0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/715434686 >> 172.21.15.35:0/715434686 conn(0x561ad00ea6b0 msgr2=0x561ad0287a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.525+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/715434686 shutdown_connections 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/715434686 wait complete. 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 -- start start 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 Processor -- start 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad029dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad029aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad029b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad00638c0 con 0x561ad02921e0 2023-03-17T09:48:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad029bb90 con 0x561ad0297040 2023-03-17T09:48:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad029bd50 con 0x561ad0291830 2023-03-17T09:48:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.526+0000 7f3aa3bacb80 10 client.0 _ll_register_callbacks cb 0x561ad0085230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:48:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad029aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad029aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46990/0 (socket says 172.21.15.35:46990) 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 -- 172.21.15.35:0/194245482 learned_addr learned my addr 172.21.15.35:0/194245482 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a957bb700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad029dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a95fbc700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad029b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 -- 172.21.15.35:0/194245482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 msgr2=0x561ad029dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad029dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 -- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 msgr2=0x561ad029b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad029b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 -- 172.21.15.35:0/194245482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9010c7a0 con 0x561ad02921e0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a95fbc700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad029b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a94fba700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad029aeb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009d10 tx=0x7f3a80003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28bf4e43ac87be3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a78ff9700 1 -- 172.21.15.35:0/194245482 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800238a0 con 0x561ad02921e0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a78ff9700 1 -- 172.21.15.35:0/194245482 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3a80023a00 con 0x561ad02921e0 2023-03-17T09:48:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ad01a2390 con 0x561ad02921e0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3a78ff9700 1 -- 172.21.15.35:0/194245482 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a80023bc0 con 0x561ad02921e0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3aa3bacb80 10 client.17382 fetch_fsmap learned FSMap version 36 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.527+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561ad000dd80 con 0x561ad02921e0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3a78ff9700 1 -- 172.21.15.35:0/194245482 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ad01a2390 con 0x561ad02921e0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3a78ff9700 1 -- 172.21.15.35:0/194245482 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3a80021550 con 0x561ad02921e0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3aa3bacb80 10 client.17382 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3aa3bacb80 10 client.17382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3aa3bacb80 20 client.17382 populate_metadata read hostname 'smithi035' 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ab230 0x561ad02ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3aa3bacb80 4 client.17382 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ad01ae600 con 0x561ad02ab230 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.528+0000 7f3a957bb700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ab230 0x561ad02ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3a78ff9700 10 client.17382 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3a957bb700 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ab230 0x561ad02ad640 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26316bd854795ee9 server_cookie=377000cd56ca2011 in_seq=0 out_seq=0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3a78ff9700 1 -- 172.21.15.35:0/194245482 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561ad01ae600 con 0x561ad02ab230 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3a78ff9700 10 client.17382 handle_command_reply: tid=0 2023-03-17T09:48:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 client.17382 shutdown 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 msgr2=0x561ad029aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad029aeb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009d10 tx=0x7f3a80003b20 comp rx=0 tx=0).stop 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 shutdown_connections 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ab230 0x561ad02ad640 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad029b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3a78ff9700 0 client.17382 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad029dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/194245482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad029aeb0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 >> 172.21.15.35:0/194245482 conn(0x561ad00ea6b0 msgr2=0x561ad028c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.529+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 shutdown_connections 2023-03-17T09:48:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.530+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/194245482 wait complete. 2023-03-17T09:48:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.530+0000 7f3aa3bacb80 20 client.17382 trim_cache size 0 max 16384 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 Processor -- start 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 -- start start 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0291830 0x561ad02897b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad0287ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad02a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad01a2390 con 0x561ad02921e0 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad01a3050 con 0x561ad0291830 2023-03-17T09:48:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad0284b60 con 0x561ad0297040 2023-03-17T09:48:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad0287ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad0287ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:46998/0 (socket says 172.21.15.35:46998) 2023-03-17T09:48:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 -- 172.21.15.35:0/930000048 learned_addr learned my addr 172.21.15.35:0/930000048 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a957bb700 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0291830 0x561ad02897b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 -- 172.21.15.35:0/930000048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 msgr2=0x561ad02a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad02a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 -- 172.21.15.35:0/930000048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0291830 msgr2=0x561ad02897b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0291830 0x561ad02897b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.545+0000 7f3a94fba700 1 -- 172.21.15.35:0/930000048 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ad01a6130 con 0x561ad02921e0 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3a94fba700 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad0287ac0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3a80021980 tx=0x7f3a80021470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa9300f088050ce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3a7bfff700 1 -- 172.21.15.35:0/930000048 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80021b20 con 0x561ad02921e0 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3a7bfff700 1 -- 172.21.15.35:0/930000048 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a80021c80 con 0x561ad02921e0 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3a7bfff700 1 -- 172.21.15.35:0/930000048 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800237c0 con 0x561ad02921e0 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/930000048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 msgr2=0x561ad0287ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad0287ac0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3a80021980 tx=0x7f3a80021470 comp rx=0 tx=0).stop 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/930000048 shutdown_connections 2023-03-17T09:48:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0297040 0x561ad02a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0291830 0x561ad02897b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/930000048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad0287ac0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/930000048 >> 172.21.15.35:0/930000048 conn(0x561ad00ea6b0 msgr2=0x561ad02951d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/930000048 shutdown_connections 2023-03-17T09:48:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.546+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/930000048 wait complete. 2023-03-17T09:48:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 -- start start 2023-03-17T09:48:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 Processor -- start 2023-03-17T09:48:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad02a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:46.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:41 smithi035 ceph-mon[92535]: pgmap v1721: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 269 B/s wr, 9 op/s 2023-03-17T09:48:48.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:41 smithi035 ceph-mon[92535]: pgmap v1722: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T09:48:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad02a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad02a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad02fe0d0 con 0x561ad02921e0 2023-03-17T09:48:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad02fe240 con 0x561ad0297040 2023-03-17T09:48:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ad02fe400 con 0x561ad0291830 2023-03-17T09:48:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3aa3bacb80 10 client.0 _ll_register_callbacks cb 0x561ad0085230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad02a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3a94fba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad02a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47004/0 (socket says 172.21.15.35:47004) 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.547+0000 7f3a94fba700 1 -- 172.21.15.35:0/1367461989 learned_addr learned my addr 172.21.15.35:0/1367461989 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a95fbc700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad02a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a957bb700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad02a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a94fba700 1 -- 172.21.15.35:0/1367461989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 msgr2=0x561ad02a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a94fba700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad02a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a94fba700 1 -- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 msgr2=0x561ad02a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a94fba700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad02a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a94fba700 1 -- 172.21.15.35:0/1367461989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ad000dd80 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a95fbc700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad02a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a94fba700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad02a08f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3a80003b60 tx=0x7f3a80021c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5453533303aa82d6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a78ff9700 1 -- 172.21.15.35:0/1367461989 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80023480 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a78ff9700 1 -- 172.21.15.35:0/1367461989 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3a800235e0 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ad025d1e0 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a78ff9700 1 -- 172.21.15.35:0/1367461989 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a800237a0 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3aa3bacb80 10 client.17388 fetch_fsmap learned FSMap version 36 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561ad00341f0 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.548+0000 7f3a78ff9700 1 -- 172.21.15.35:0/1367461989 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ad025d1e0 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3a78ff9700 1 -- 172.21.15.35:0/1367461989 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3a80050070 con 0x561ad02921e0 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3aa3bacb80 10 client.17388 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:48:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3aa3bacb80 10 client.17388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3aa3bacb80 20 client.17388 populate_metadata read hostname 'smithi035' 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ff6c0 0x561ad0301ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3aa3bacb80 4 client.17388 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561ad0063f00 con 0x561ad02ff6c0 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3a957bb700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ff6c0 0x561ad0301ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3a78ff9700 10 client.17388 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.549+0000 7f3a957bb700 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ff6c0 0x561ad0301ad0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77e5e6b4cd85128d server_cookie=ebfc7a9be9bd094b in_seq=0 out_seq=0 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3a78ff9700 1 -- 172.21.15.35:0/1367461989 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561ad0063f00 con 0x561ad02ff6c0 2023-03-17T09:48:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3a78ff9700 10 client.17388 handle_command_reply: tid=0 2023-03-17T09:48:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 client.17388 shutdown 2023-03-17T09:48:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 msgr2=0x561ad02a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:51.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad02a08f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3a80003b60 tx=0x7f3a80021c10 comp rx=0 tx=0).stop 2023-03-17T09:48:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 shutdown_connections 2023-03-17T09:48:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ad02ff6c0 0x561ad0301ad0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ad0297040 0x561ad02a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad0291830 0x561ad02a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3a78ff9700 0 client.17388 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:48:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 --2- 172.21.15.35:0/1367461989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ad02921e0 0x561ad02a08f0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 >> 172.21.15.35:0/1367461989 conn(0x561ad00ea6b0 msgr2=0x561ad029a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 shutdown_connections 2023-03-17T09:48:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 1 -- 172.21.15.35:0/1367461989 wait complete. 2023-03-17T09:48:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.557+0000 7f3aa3bacb80 20 client.17388 trim_cache size 0 max 16384 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a7c09f640 msgr2=0x7f3a7c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a7c09f640 0x7f3a7c0a1af0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000b580 tx=0x7f3a80010040 comp rx=0 tx=0).stop 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 msgr2=0x7f3a90194070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 0x7f3a90194070 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c9b0 tx=0x7f3a8c00ccc0 comp rx=0 tx=0).stop 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 shutdown_connections 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3a7c09f640 0x7f3a7c0a1af0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a90104390 0x7f3a90198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3a900ff350 0x7f3a90194070 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 --2- 172.21.15.35:0/3670717168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a900ffcf0 0x7f3a901945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 >> 172.21.15.35:0/3670717168 conn(0x7f3a90076330 msgr2=0x7f3a900fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 shutdown_connections 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:25:18.558+0000 7f3a97a1f700 1 -- 172.21.15.35:0/3670717168 wait complete. 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 -- 172.21.15.35:0/3138318536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00fea30 msgr2=0x7fc4a00fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:48:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 --2- 172.21.15.35:0/3138318536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00fea30 0x7fc4a00fee00 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fc4900099c0 tx=0x7fc490009cd0 comp rx=0 tx=0).stop 2023-03-17T09:49:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 -- 172.21.15.35:0/3138318536 shutdown_connections 2023-03-17T09:49:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 --2- 172.21.15.35:0/3138318536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a0105510 0x7fc4a010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 --2- 172.21.15.35:0/3138318536 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00fea30 0x7fc4a00fee00 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 --2- 172.21.15.35:0/3138318536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a0104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.896+0000 7fc4a5588700 1 -- 172.21.15.35:0/3138318536 >> 172.21.15.35:0/3138318536 conn(0x7fc4a0074590 msgr2=0x7fc4a0074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.897+0000 7fc4a5588700 1 -- 172.21.15.35:0/3138318536 shutdown_connections 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.897+0000 7fc4a5588700 1 -- 172.21.15.35:0/3138318536 wait complete. 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.897+0000 7fc4a5588700 1 Processor -- start 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.897+0000 7fc4a5588700 1 -- start start 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc4a5588700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a00fea30 0x7fc4a00ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc4a5588700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a00ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc4a5588700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0105510 0x7fc4a01a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc4a5588700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0100710 con 0x7fc4a00ff3d0 2023-03-17T09:49:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc4a5588700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01a4970 con 0x7fc4a0105510 2023-03-17T09:49:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc4a5588700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01a4ab0 con 0x7fc4a00fea30 2023-03-17T09:49:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a00ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a00ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47018/0 (socket says 172.21.15.35:47018) 2023-03-17T09:49:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1468199623 learned_addr learned my addr 172.21.15.35:0/1468199623 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0105510 0x7fc4a01a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49effd700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a00fea30 0x7fc4a00ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1468199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a00fea30 msgr2=0x7fc4a00ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a00fea30 0x7fc4a00ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1468199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0105510 msgr2=0x7fc4a01a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0105510 0x7fc4a01a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1468199623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4900095f0 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49effd700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a00fea30 0x7fc4a00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:49:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a00ffee0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc49400e940 tx=0x7fc49400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.898+0000 7fc487fff700 1 -- 172.21.15.35:0/1468199623 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494009730 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.899+0000 7fc487fff700 1 -- 172.21.15.35:0/1468199623 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc49400ee90 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.899+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a01101a0 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.899+0000 7fc487fff700 1 -- 172.21.15.35:0/1468199623 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494018420 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.899+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a0110010 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.901+0000 7fc487fff700 1 -- 172.21.15.35:0/1468199623 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc49400cbd0 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.901+0000 7fc487fff700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc48809f640 0x7fc4880a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.901+0000 7fc487fff700 1 -- 172.21.15.35:0/1468199623 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fc494014070 con 0x7fc4a00ff3d0 2023-03-17T09:49:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.901+0000 7fc49effd700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc48809f640 0x7fc4880a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.902+0000 7fc49effd700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc48809f640 0x7fc4880a1af0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b580 tx=0x7fc49001a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.902+0000 7fc4b1715b80 1 Processor -- start 2023-03-17T09:49:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.902+0000 7fc4b1715b80 1 -- start start 2023-03-17T09:49:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.902+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef995420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef995d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef89c010 con 0x55efef99abe0 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef8ee950 con 0x55efef99b4f0 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef8e7de0 con 0x55efef995960 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47024/0 (socket says 172.21.15.35:47024) 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 -- 172.21.15.35:0/778566073 learned_addr learned my addr 172.21.15.35:0/778566073 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef995d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef995420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 -- 172.21.15.35:0/778566073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 msgr2=0x55efef995d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef995d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 -- 172.21.15.35:0/778566073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 msgr2=0x55efef995420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef995420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 -- 172.21.15.35:0/778566073 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efef7695d0 con 0x55efef99abe0 2023-03-17T09:49:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef995420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc49effd700 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99afb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc4900099c0 tx=0x7fc49001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b8f5b71b3450c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4857fa700 1 -- 172.21.15.35:0/778566073 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49002a070 con 0x55efef99abe0 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4857fa700 1 -- 172.21.15.35:0/778566073 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc490003bf0 con 0x55efef99abe0 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.903+0000 7fc4857fa700 1 -- 172.21.15.35:0/778566073 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49001d040 con 0x55efef99abe0 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 -- 172.21.15.35:0/778566073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 msgr2=0x55efef99afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99afb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc4900099c0 tx=0x7fc49001e000 comp rx=0 tx=0).stop 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 -- 172.21.15.35:0/778566073 shutdown_connections 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef995d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99afb0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/778566073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef995420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 -- 172.21.15.35:0/778566073 >> 172.21.15.35:0/778566073 conn(0x55efef7f26b0 msgr2=0x55efef98fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 -- 172.21.15.35:0/778566073 shutdown_connections 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.904+0000 7fc4b1715b80 1 -- 172.21.15.35:0/778566073 wait complete. 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 -- start start 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 Processor -- start 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef99ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef76b8c0 con 0x55efef99abe0 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef99f560 con 0x55efef99b4f0 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef9aafd0 con 0x55efef995960 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc4b1715b80 10 client.0 _ll_register_callbacks cb 0x55efef78d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47032/0 (socket says 172.21.15.35:47032) 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1993028283 learned_addr learned my addr 172.21.15.35:0/1993028283 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef99ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49effd700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1993028283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 msgr2=0x55efef9a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 msgr2=0x55efef99ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef99ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49e7fc700 1 -- 172.21.15.35:0/1993028283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a010d940 con 0x55efef99abe0 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.905+0000 7fc49effd700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99e730 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc494094e70 tx=0x7fc4940984f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109791f05b7e93b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc482ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc482ff5700 1 -- 172.21.15.35:0/1993028283 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940af070 con 0x55efef99abe0 2023-03-17T09:49:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc482ff5700 1 -- 172.21.15.35:0/1993028283 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fc494097b00 con 0x55efef99abe0 2023-03-17T09:49:10.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:43 smithi035 ceph-mon[92535]: pgmap v1723: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T09:49:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efef8aa390 con 0x55efef99abe0 2023-03-17T09:49:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc482ff5700 1 -- 172.21.15.35:0/1993028283 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4940a0160 con 0x55efef99abe0 2023-03-17T09:49:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 10 client.17400 fetch_fsmap learned FSMap version 36 2023-03-17T09:49:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55efef715d80 con 0x55efef99abe0 2023-03-17T09:49:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc482ff5700 1 -- 172.21.15.35:0/1993028283 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4940b4020 con 0x55efef99abe0 2023-03-17T09:49:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc482ff5700 1 -- 172.21.15.35:0/1993028283 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc494097360 con 0x55efef99abe0 2023-03-17T09:49:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 10 client.17400 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:49:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 10 client.17400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:49:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 20 client.17400 populate_metadata read hostname 'smithi035' 2023-03-17T09:49:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efef9aeef0 0x55efef9b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 4 client.17400 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:49:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.906+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efef8b6600 con 0x55efef9aeef0 2023-03-17T09:49:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.907+0000 7fc49effd700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efef9aeef0 0x55efef9b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.907+0000 7fc482ff5700 10 client.17400 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.907+0000 7fc49effd700 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efef9aeef0 0x55efef9b1300 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=812195dd0367b8e2 server_cookie=572af27fac82f903 in_seq=0 out_seq=0 2023-03-17T09:49:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc482ff5700 1 -- 172.21.15.35:0/1993028283 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55efef8b6600 con 0x55efef9aeef0 2023-03-17T09:49:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc482ff5700 10 client.17400 handle_command_reply: tid=0 2023-03-17T09:49:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 client.17400 shutdown 2023-03-17T09:49:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 msgr2=0x55efef99e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99e730 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc494094e70 tx=0x7fc4940984f0 comp rx=0 tx=0).stop 2023-03-17T09:49:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 shutdown_connections 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efef9aeef0 0x55efef9b1300 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef99ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc482ff5700 0 client.17400 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1993028283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99abe0 0x55efef99e730 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 >> 172.21.15.35:0/1993028283 conn(0x55efef7f26b0 msgr2=0x55efef994410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 shutdown_connections 2023-03-17T09:49:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1993028283 wait complete. 2023-03-17T09:49:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.908+0000 7fc4b1715b80 20 client.17400 trim_cache size 0 max 16384 2023-03-17T09:49:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 Processor -- start 2023-03-17T09:49:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 -- start start 2023-03-17T09:49:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 0x55efef98fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef99abe0 0x55efef9a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef9a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef8b6600 con 0x55efef995960 2023-03-17T09:49:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef9abad0 con 0x55efef99b4f0 2023-03-17T09:49:18.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef99f6a0 con 0x55efef99abe0 2023-03-17T09:49:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc49effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 0x55efef98fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.924+0000 7fc49effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 0x55efef98fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47038/0 (socket says 172.21.15.35:47038) 2023-03-17T09:49:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 -- 172.21.15.35:0/3025414092 learned_addr learned my addr 172.21.15.35:0/3025414092 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef9a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef99abe0 0x55efef9a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 -- 172.21.15.35:0/3025414092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef99abe0 msgr2=0x55efef9a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef99abe0 0x55efef9a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 -- 172.21.15.35:0/3025414092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 msgr2=0x55efef9a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef9a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 -- 172.21.15.35:0/3025414092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efef996000 con 0x55efef995960 2023-03-17T09:49:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc49effd700 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 0x55efef98fac0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc4900054c0 tx=0x7fc490027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e967876ff23f37ed server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc485ffb700 1 -- 172.21.15.35:0/3025414092 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49001d040 con 0x55efef995960 2023-03-17T09:49:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc485ffb700 1 -- 172.21.15.35:0/3025414092 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc49000baf0 con 0x55efef995960 2023-03-17T09:49:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.925+0000 7fc485ffb700 1 -- 172.21.15.35:0/3025414092 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49002a040 con 0x55efef995960 2023-03-17T09:49:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 -- 172.21.15.35:0/3025414092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 msgr2=0x55efef98fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 0x55efef98fac0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc4900054c0 tx=0x7fc490027040 comp rx=0 tx=0).stop 2023-03-17T09:49:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 -- 172.21.15.35:0/3025414092 shutdown_connections 2023-03-17T09:49:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99b4f0 0x55efef9a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef995960 0x55efef98fac0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/3025414092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef99abe0 0x55efef9a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 -- 172.21.15.35:0/3025414092 >> 172.21.15.35:0/3025414092 conn(0x55efef7f26b0 msgr2=0x55efef9ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 -- 172.21.15.35:0/3025414092 shutdown_connections 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 -- 172.21.15.35:0/3025414092 wait complete. 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 -- start start 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.926+0000 7fc4b1715b80 1 Processor -- start 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99abe0 0x55efef9a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 0x55efef9a4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef9a4a40 con 0x55efef99b4f0 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef9a4bb0 con 0x55efef99abe0 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efef9a4d70 con 0x55efef995960 2023-03-17T09:49:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc4b1715b80 10 client.0 _ll_register_callbacks cb 0x55efef78d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:49:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 0x55efef9a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 0x55efef9a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47048/0 (socket says 172.21.15.35:47048) 2023-03-17T09:49:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 -- 172.21.15.35:0/1581906489 learned_addr learned my addr 172.21.15.35:0/1581906489 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49effd700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49e7fc700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99abe0 0x55efef9a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 -- 172.21.15.35:0/1581906489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 msgr2=0x55efef9a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 -- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99abe0 msgr2=0x55efef9a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99abe0 0x55efef9a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:26.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 -- 172.21.15.35:0/1581906489 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efef7695d0 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc49f7fe700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 0x55efef9a4500 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc4980047a0 tx=0x7fc4980047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f61c9777c62dc1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.927+0000 7fc482ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc482ff5700 1 -- 172.21.15.35:0/1581906489 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49801c070 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc482ff5700 1 -- 172.21.15.35:0/1581906489 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fc4980179b0 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efef9651e0 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc482ff5700 1 -- 172.21.15.35:0/1581906489 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc49800e040 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 10 client.17406 fetch_fsmap learned FSMap version 36 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55efef6fec00 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc482ff5700 1 -- 172.21.15.35:0/1581906489 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc49802d080 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc482ff5700 1 -- 172.21.15.35:0/1581906489 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc498021be0 con 0x55efef99b4f0 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 10 client.17406 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:49:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 10 client.17406 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 20 client.17406 populate_metadata read hostname 'smithi035' 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efefa04290 0x55efefa066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 4 client.17406 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55efef76bf00 con 0x55efefa04290 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.928+0000 7fc49effd700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efefa04290 0x55efefa066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.929+0000 7fc482ff5700 10 client.17406 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.929+0000 7fc49effd700 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efefa04290 0x55efefa066a0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc180831ab27c92d server_cookie=db223329581477c3 in_seq=0 out_seq=0 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc482ff5700 1 -- 172.21.15.35:0/1581906489 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55efef76bf00 con 0x55efefa04290 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc482ff5700 10 client.17406 handle_command_reply: tid=0 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 client.17406 shutdown 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 msgr2=0x55efef9a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 0x55efef9a4500 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc4980047a0 tx=0x7fc4980047d0 comp rx=0 tx=0).stop 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 shutdown_connections 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55efefa04290 0x55efefa066a0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55efef99b4f0 0x55efef9a4500 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc482ff5700 0 client.17406 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55efef995960 0x55efef9a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:27.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 --2- 172.21.15.35:0/1581906489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55efef99abe0 0x55efef9a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:27.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 >> 172.21.15.35:0/1581906489 conn(0x55efef7f26b0 msgr2=0x55efef9986b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:27.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 shutdown_connections 2023-03-17T09:49:27.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 1 -- 172.21.15.35:0/1581906489 wait complete. 2023-03-17T09:49:27.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4b1715b80 20 client.17406 trim_cache size 0 max 16384 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc48809f640 msgr2=0x7fc4880a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc48809f640 0x7fc4880a1af0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc49000b580 tx=0x7fc49001a040 comp rx=0 tx=0).stop 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 msgr2=0x7fc4a00ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a00ffee0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc49400e940 tx=0x7fc49400ec50 comp rx=0 tx=0).stop 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 shutdown_connections 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc48809f640 0x7fc4880a1af0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4a0105510 0x7fc4a01a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a00fea30 0x7fc4a00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 --2- 172.21.15.35:0/1468199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4a00ff3d0 0x7fc4a00ffee0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.937+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 >> 172.21.15.35:0/1468199623 conn(0x7fc4a0074590 msgr2=0x7fc4a00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.938+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 shutdown_connections 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:11.938+0000 7fc4a5588700 1 -- 172.21.15.35:0/1468199623 wait complete. 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 -- 172.21.15.35:0/1595846959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ff390 msgr2=0x7face40ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 --2- 172.21.15.35:0/1595846959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ff390 0x7face40ff760 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7facd80099c0 tx=0x7facd8009cd0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 -- 172.21.15.35:0/1595846959 shutdown_connections 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 --2- 172.21.15.35:0/1595846959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face41043d0 0x7face410bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 --2- 172.21.15.35:0/1595846959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ff390 0x7face40ff760 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 --2- 172.21.15.35:0/1595846959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face40ffd30 0x7face4103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 -- 172.21.15.35:0/1595846959 >> 172.21.15.35:0/1595846959 conn(0x7face4075f30 msgr2=0x7face4076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 -- 172.21.15.35:0/1595846959 shutdown_connections 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.060+0000 7faceafc3700 1 -- 172.21.15.35:0/1595846959 wait complete. 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 Processor -- start 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 -- start start 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40ff390 0x7face41962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 0x7face4196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face41043d0 0x7face419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face419b2c0 con 0x7face40ffd30 2023-03-17T09:49:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face419b430 con 0x7face40ff390 2023-03-17T09:49:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7faceafc3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face419b5f0 con 0x7face41043d0 2023-03-17T09:49:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 0x7face4196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 0x7face4196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47058/0 (socket says 172.21.15.35:47058) 2023-03-17T09:49:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 -- 172.21.15.35:0/2352626422 learned_addr learned my addr 172.21.15.35:0/2352626422 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face9560700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face41043d0 0x7face419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face8d5f700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40ff390 0x7face41962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 -- 172.21.15.35:0/2352626422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face41043d0 msgr2=0x7face419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:30.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face41043d0 0x7face419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 -- 172.21.15.35:0/2352626422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40ff390 msgr2=0x7face41962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40ff390 0x7face41962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face3fff700 1 -- 172.21.15.35:0/2352626422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80095f0 con 0x7face40ffd30 2023-03-17T09:49:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.061+0000 7face8d5f700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40ff390 0x7face41962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:49:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.062+0000 7face3fff700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 0x7face4196820 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7facd000d950 tx=0x7facd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.062+0000 7face1ffb700 1 -- 172.21.15.35:0/2352626422 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0004220 con 0x7face40ffd30 2023-03-17T09:49:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.062+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face410f040 con 0x7face40ffd30 2023-03-17T09:49:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.062+0000 7face1ffb700 1 -- 172.21.15.35:0/2352626422 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facd0004cc0 con 0x7face40ffd30 2023-03-17T09:49:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.062+0000 7face1ffb700 1 -- 172.21.15.35:0/2352626422 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd00055b0 con 0x7face40ffd30 2023-03-17T09:49:30.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.062+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face410eeb0 con 0x7face40ffd30 2023-03-17T09:49:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.064+0000 7face1ffb700 1 -- 172.21.15.35:0/2352626422 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7facd0004750 con 0x7face40ffd30 2023-03-17T09:49:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.065+0000 7face1ffb700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7facd409f640 0x7facd40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:31.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.065+0000 7face1ffb700 1 -- 172.21.15.35:0/2352626422 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7facd00ca440 con 0x7face40ffd30 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.065+0000 7face8d5f700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7facd409f640 0x7facd40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.065+0000 7face8d5f700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7facd409f640 0x7facd40a1af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7facd8000c00 tx=0x7facd8005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 Processor -- start 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 -- start start 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c98693be0 0x564c98693fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 0x564c9868ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c98595010 con 0x564c9868e960 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c985e7950 con 0x564c986944f0 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7facf7150b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c985e0de0 con 0x564c98693be0 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7face9560700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 0x564c9868ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7face9560700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 0x564c9868ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47068/0 (socket says 172.21.15.35:47068) 2023-03-17T09:49:31.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7face9560700 1 -- 172.21.15.35:0/3294618342 learned_addr learned my addr 172.21.15.35:0/3294618342 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7face3fff700 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.066+0000 7face8d5f700 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c98693be0 0x564c98693fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face9560700 1 -- 172.21.15.35:0/3294618342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c98693be0 msgr2=0x564c98693fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face9560700 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c98693be0 0x564c98693fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face9560700 1 -- 172.21.15.35:0/3294618342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 msgr2=0x564c9868e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face9560700 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face9560700 1 -- 172.21.15.35:0/3294618342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c984625d0 con 0x564c9868e960 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face3fff700 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7face9560700 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 0x564c9868ed90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7facdc003f30 tx=0x7facdc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdd193619d2ff40 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7facceffd700 1 -- 172.21.15.35:0/3294618342 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc003a00 con 0x564c9868e960 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7facceffd700 1 -- 172.21.15.35:0/3294618342 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facdc00f040 con 0x564c9868e960 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.067+0000 7facceffd700 1 -- 172.21.15.35:0/3294618342 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc015680 con 0x564c9868e960 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 -- 172.21.15.35:0/3294618342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 msgr2=0x564c9868ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 0x564c9868ed90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7facdc003f30 tx=0x7facdc009c20 comp rx=0 tx=0).stop 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 -- 172.21.15.35:0/3294618342 shutdown_connections 2023-03-17T09:49:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c9868e960 0x564c9868ed90 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c98693be0 0x564c98693fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 --2- 172.21.15.35:0/3294618342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 -- 172.21.15.35:0/3294618342 >> 172.21.15.35:0/3294618342 conn(0x564c984eb6b0 msgr2=0x564c98688a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 -- 172.21.15.35:0/3294618342 shutdown_connections 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 -- 172.21.15.35:0/3294618342 wait complete. 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 -- start start 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.068+0000 7facf7150b80 1 Processor -- start 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c98693be0 0x564c98697600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 0x564c98697b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c984648c0 con 0x564c986944f0 2023-03-17T09:49:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c98698310 con 0x564c98693be0 2023-03-17T09:49:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c986984d0 con 0x564c9868e960 2023-03-17T09:49:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facf7150b80 10 client.0 _ll_register_callbacks cb 0x564c98486230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:49:34.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 0x564c98697b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 0x564c98697b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47074/0 (socket says 172.21.15.35:47074) 2023-03-17T09:49:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 -- 172.21.15.35:0/559468780 learned_addr learned my addr 172.21.15.35:0/559468780 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face8d5f700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face3fff700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c98693be0 0x564c98697600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 -- 172.21.15.35:0/559468780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 msgr2=0x564c9869a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 -- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c98693be0 msgr2=0x564c98697600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c98693be0 0x564c98697600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 -- 172.21.15.35:0/559468780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc003b60 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face3fff700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c98693be0 0x564c98697600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7face9560700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 0x564c98697b80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7facdc000f80 tx=0x7facdc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd67401dd5e029e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facc3fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.069+0000 7facc3fff700 1 -- 172.21.15.35:0/559468780 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc004680 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c985a3390 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facc3fff700 1 -- 172.21.15.35:0/559468780 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7facdc0047e0 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facc3fff700 1 -- 172.21.15.35:0/559468780 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7facdc015480 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 10 client.17418 fetch_fsmap learned FSMap version 36 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564c9840ed80 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facc3fff700 1 -- 172.21.15.35:0/559468780 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c985a3390 con 0x564c986944f0 2023-03-17T09:49:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facc3fff700 1 -- 172.21.15.35:0/559468780 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7facdc030670 con 0x564c986944f0 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 10 client.17418 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 10 client.17418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 20 client.17418 populate_metadata read hostname 'smithi035' 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986a7eb0 0x564c986aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 4 client.17418 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c985af600 con 0x564c986a7eb0 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.070+0000 7face8d5f700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986a7eb0 0x564c986aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.071+0000 7facc3fff700 10 client.17418 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.071+0000 7face8d5f700 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986a7eb0 0x564c986aa2c0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bbf4b9688fb93c5 server_cookie=6632399a3e002596 in_seq=0 out_seq=0 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.071+0000 7facc3fff700 1 -- 172.21.15.35:0/559468780 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564c985af600 con 0x564c986a7eb0 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.071+0000 7facc3fff700 10 client.17418 handle_command_reply: tid=0 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.071+0000 7facf7150b80 1 client.17418 shutdown 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 msgr2=0x564c98697b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 0x564c98697b80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7facdc000f80 tx=0x7facdc007f90 comp rx=0 tx=0).stop 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 shutdown_connections 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986a7eb0 0x564c986aa2c0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c986944f0 0x564c98697b80 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 --2- 172.21.15.35:0/559468780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c98693be0 0x564c98697600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facc3fff700 0 client.17418 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 >> 172.21.15.35:0/559468780 conn(0x564c984eb6b0 msgr2=0x564c98688a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 shutdown_connections 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 1 -- 172.21.15.35:0/559468780 wait complete. 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.072+0000 7facf7150b80 20 client.17418 trim_cache size 0 max 16384 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 Processor -- start 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 -- start start 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9868e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c98688ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9869ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c98698160 con 0x564c98693be0 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c9869a9f0 con 0x564c986944f0 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7facf7150b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c98694340 con 0x564c9868e960 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c98688ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c98688ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47080/0 (socket says 172.21.15.35:47080) 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face3fff700 1 -- 172.21.15.35:0/2453184930 learned_addr learned my addr 172.21.15.35:0/2453184930 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face8d5f700 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9868e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face9560700 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9869ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face3fff700 1 -- 172.21.15.35:0/2453184930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 msgr2=0x564c9868e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face3fff700 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9868e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.087+0000 7face3fff700 1 -- 172.21.15.35:0/2453184930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 msgr2=0x564c9869ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7face3fff700 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9869ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7face3fff700 1 -- 172.21.15.35:0/2453184930 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c985a7130 con 0x564c98693be0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7face8d5f700 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9868e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7face3fff700 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c98688ac0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7facd0094960 tx=0x7facd001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4eb9a577c2bf9f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7faccf7fe700 1 -- 172.21.15.35:0/2453184930 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0097ef0 con 0x564c98693be0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7faccf7fe700 1 -- 172.21.15.35:0/2453184930 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facd00a00e0 con 0x564c98693be0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7faccf7fe700 1 -- 172.21.15.35:0/2453184930 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd00983b0 con 0x564c98693be0 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 -- 172.21.15.35:0/2453184930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 msgr2=0x564c98688ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c98688ac0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7facd0094960 tx=0x7facd001c040 comp rx=0 tx=0).stop 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 -- 172.21.15.35:0/2453184930 shutdown_connections 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9869ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9868e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 --2- 172.21.15.35:0/2453184930 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c98688ac0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 -- 172.21.15.35:0/2453184930 >> 172.21.15.35:0/2453184930 conn(0x564c984eb6b0 msgr2=0x564c986948c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.088+0000 7facf7150b80 1 -- 172.21.15.35:0/2453184930 shutdown_connections 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 -- 172.21.15.35:0/2453184930 wait complete. 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 -- start start 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 Processor -- start 2023-03-17T09:49:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c9868f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c986900c0 con 0x564c98693be0 2023-03-17T09:49:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c98690230 con 0x564c986944f0 2023-03-17T09:49:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c986903f0 con 0x564c9868e960 2023-03-17T09:49:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7facf7150b80 10 client.0 _ll_register_callbacks cb 0x564c98486230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:49:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.089+0000 7face3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c9868f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c9868f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47086/0 (socket says 172.21.15.35:47086) 2023-03-17T09:49:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 -- 172.21.15.35:0/1842917905 learned_addr learned my addr 172.21.15.35:0/1842917905 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face8d5f700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face9560700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 -- 172.21.15.35:0/1842917905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 msgr2=0x564c9869ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 -- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 msgr2=0x564c9868fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 -- 172.21.15.35:0/1842917905 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face410f040 con 0x564c98693be0 2023-03-17T09:49:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face8d5f700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:49:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7face3fff700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c9868f640 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7facd0096240 tx=0x7facd0004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bcd7ea9f162288 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facc3fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:49:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facc3fff700 1 -- 172.21.15.35:0/1842917905 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0062070 con 0x564c98693be0 2023-03-17T09:49:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facc3fff700 1 -- 172.21.15.35:0/1842917905 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7facd0004a00 con 0x564c98693be0 2023-03-17T09:49:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c9865e1e0 con 0x564c98693be0 2023-03-17T09:49:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facc3fff700 1 -- 172.21.15.35:0/1842917905 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7facd00973e0 con 0x564c98693be0 2023-03-17T09:49:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facf7150b80 10 client.17424 fetch_fsmap learned FSMap version 36 2023-03-17T09:49:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.090+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564c984351f0 con 0x564c98693be0 2023-03-17T09:49:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facc3fff700 1 -- 172.21.15.35:0/1842917905 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facd007d080 con 0x564c98693be0 2023-03-17T09:49:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facc3fff700 1 -- 172.21.15.35:0/1842917905 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7facd009fc50 con 0x564c98693be0 2023-03-17T09:49:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facf7150b80 10 client.17424 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:49:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facf7150b80 10 client.17424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:49:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facf7150b80 20 client.17424 populate_metadata read hostname 'smithi035' 2023-03-17T09:49:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facf7150b80 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986fcca0 0x564c986ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facf7150b80 4 client.17424 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:49:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564c98464f00 con 0x564c986fcca0 2023-03-17T09:49:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7face8d5f700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986fcca0 0x564c986ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7facc3fff700 10 client.17424 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.091+0000 7face8d5f700 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986fcca0 0x564c986ff0b0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d00f73200c6bbea server_cookie=4b5fccab4f6dfe57 in_seq=0 out_seq=0 2023-03-17T09:49:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facc3fff700 1 -- 172.21.15.35:0/1842917905 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564c98464f00 con 0x564c986fcca0 2023-03-17T09:49:43.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facc3fff700 10 client.17424 handle_command_reply: tid=0 2023-03-17T09:49:43.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 client.17424 shutdown 2023-03-17T09:49:43.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 msgr2=0x564c9868f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:43.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c9868f640 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7facd0096240 tx=0x7facd0004680 comp rx=0 tx=0).stop 2023-03-17T09:49:44.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:45 smithi035 ceph-mon[92535]: pgmap v1724: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T09:49:45.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:47 smithi035 ceph-mon[92535]: pgmap v1725: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T09:49:45.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:49 smithi035 ceph-mon[92535]: pgmap v1726: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T09:49:45.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:51 smithi035 ceph-mon[92535]: pgmap v1727: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:49:45.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:53 smithi035 ceph-mon[92535]: pgmap v1728: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:49:45.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:55 smithi035 ceph-mon[92535]: pgmap v1729: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:49:46.315 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:57 smithi035 ceph-mon[92535]: pgmap v1730: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:49:46.315 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:39:59 smithi035 ceph-mon[92535]: pgmap v1731: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:01 smithi035 ceph-mon[92535]: pgmap v1732: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:03 smithi035 ceph-mon[92535]: pgmap v1733: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:05 smithi035 ceph-mon[92535]: pgmap v1734: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:07 smithi035 ceph-mon[92535]: pgmap v1735: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:09 smithi035 ceph-mon[92535]: pgmap v1736: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:09 smithi035 ceph-mon[92535]: osdmap e185: 12 total, 12 up, 12 in 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:11 smithi035 ceph-mon[92535]: pgmap v1738: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:13 smithi035 ceph-mon[92535]: pgmap v1739: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:15 smithi035 ceph-mon[92535]: pgmap v1740: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:15 smithi035 ceph-mon[92535]: osdmap e186: 12 total, 12 up, 12 in 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:17 smithi035 ceph-mon[92535]: pgmap v1742: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:19 smithi035 ceph-mon[92535]: pgmap v1743: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:21 smithi035 ceph-mon[92535]: pgmap v1744: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:23 smithi035 ceph-mon[92535]: pgmap v1745: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:25 smithi035 ceph-mon[92535]: pgmap v1746: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:49:46.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:27 smithi035 ceph-mon[92535]: pgmap v1747: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-03-17T09:49:46.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:29 smithi035 ceph-mon[92535]: pgmap v1748: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:49:46.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:31 smithi035 ceph-mon[92535]: pgmap v1749: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:49:46.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:33 smithi035 ceph-mon[92535]: pgmap v1750: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:49:46.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:35 smithi035 ceph-mon[92535]: pgmap v1751: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:49:46.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:37 smithi035 ceph-mon[92535]: pgmap v1752: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:49:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:49:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:49:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:49:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:49:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:49:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:49:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:49:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:49:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 shutdown_connections 2023-03-17T09:49:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564c986fcca0 0x564c986ff0b0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564c986944f0 0x564c9868fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564c9868e960 0x564c9869ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 --2- 172.21.15.35:0/1842917905 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564c98693be0 0x564c9868f640 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facc3fff700 0 client.17424 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 >> 172.21.15.35:0/1842917905 conn(0x564c984eb6b0 msgr2=0x564c98695150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 shutdown_connections 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 1 -- 172.21.15.35:0/1842917905 wait complete. 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.096+0000 7facf7150b80 20 client.17424 trim_cache size 0 max 16384 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7facd409f640 msgr2=0x7facd40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7facd409f640 0x7facd40a1af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7facd8000c00 tx=0x7facd8005fb0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 msgr2=0x7face4196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 0x7face4196820 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7facd000d950 tx=0x7facd000dc60 comp rx=0 tx=0).stop 2023-03-17T09:49:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 shutdown_connections 2023-03-17T09:49:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7facd409f640 0x7facd40a1af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7face41043d0 0x7face419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face40ff390 0x7face41962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 --2- 172.21.15.35:0/2352626422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7face40ffd30 0x7face4196820 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 >> 172.21.15.35:0/2352626422 conn(0x7face4075f30 msgr2=0x7face4102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 shutdown_connections 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:25.097+0000 7faceafc3700 1 -- 172.21.15.35:0/2352626422 wait complete. 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 -- 172.21.15.35:0/450374157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 msgr2=0x7f14380ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 --2- 172.21.15.35:0/450374157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f14380ff720 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f14280099c0 tx=0x7f1428009cd0 comp rx=0 tx=0).stop 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 -- 172.21.15.35:0/450374157 shutdown_connections 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 --2- 172.21.15.35:0/450374157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1438104390 0x7f143810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 --2- 172.21.15.35:0/450374157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f14380ff720 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 --2- 172.21.15.35:0/450374157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14380ffcf0 0x7f1438103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 -- 172.21.15.35:0/450374157 >> 172.21.15.35:0/450374157 conn(0x7f1438076330 msgr2=0x7f1438076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 -- 172.21.15.35:0/450374157 shutdown_connections 2023-03-17T09:49:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.219+0000 7f143e21c700 1 -- 172.21.15.35:0/450374157 wait complete. 2023-03-17T09:49:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.220+0000 7f143e21c700 1 Processor -- start 2023-03-17T09:49:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.220+0000 7f143e21c700 1 -- start start 2023-03-17T09:49:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f1438195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14380ffcf0 0x7f1438195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1438104390 0x7f1438199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819a120 con 0x7f14380ff350 2023-03-17T09:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819a290 con 0x7f14380ffcf0 2023-03-17T09:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143819a450 con 0x7f1438104390 2023-03-17T09:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f1438195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f1438195140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47098/0 (socket says 172.21.15.35:47098) 2023-03-17T09:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 -- 172.21.15.35:0/3118679386 learned_addr learned my addr 172.21.15.35:0/3118679386 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f1437fff700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1438104390 0x7f1438199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 -- 172.21.15.35:0/3118679386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1438104390 msgr2=0x7f1438199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14380ffcf0 0x7f1438195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1438104390 0x7f1438199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 -- 172.21.15.35:0/3118679386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14380ffcf0 msgr2=0x7f1438195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14380ffcf0 0x7f1438195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 -- 172.21.15.35:0/3118679386 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280095f0 con 0x7f14380ff350 2023-03-17T09:49:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14380ffcf0 0x7f1438195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:49:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f14377fe700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f1438195140 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1428009fd0 tx=0x7f142800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f1434ff9700 1 -- 172.21.15.35:0/3118679386 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142801d070 con 0x7f14380ff350 2023-03-17T09:49:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143810f000 con 0x7f14380ff350 2023-03-17T09:49:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f1434ff9700 1 -- 172.21.15.35:0/3118679386 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14280054c0 con 0x7f14380ff350 2023-03-17T09:49:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f1434ff9700 1 -- 172.21.15.35:0/3118679386 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428004b30 con 0x7f14380ff350 2023-03-17T09:49:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.221+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143810ee70 con 0x7f14380ff350 2023-03-17T09:49:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.224+0000 7f1434ff9700 1 -- 172.21.15.35:0/3118679386 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f142800fc30 con 0x7f14380ff350 2023-03-17T09:49:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.224+0000 7f1434ff9700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f142409f640 0x7f14240a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f1434ff9700 1 -- 172.21.15.35:0/3118679386 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f14280cb4c0 con 0x7f14380ff350 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f142409f640 0x7f14240a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f142409f640 0x7f14240a1af0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1420005fd0 tx=0x7f1420005ee0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f144a3a9b80 1 Processor -- start 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f144a3a9b80 1 -- start start 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bd5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.225+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd56a0 0x55f629bcf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bcffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629ad4010 con 0x55f629bd4d90 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629b26950 con 0x55f629bd56a0 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629b1fde0 con 0x55f629bcfb70 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bd5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bd5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47106/0 (socket says 172.21.15.35:47106) 2023-03-17T09:49:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 -- 172.21.15.35:0/2304842772 learned_addr learned my addr 172.21.15.35:0/2304842772 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f1437fff700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bcffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f1436ffd700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd56a0 0x55f629bcf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 -- 172.21.15.35:0/2304842772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 msgr2=0x55f629bcffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bcffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 -- 172.21.15.35:0/2304842772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd56a0 msgr2=0x55f629bcf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd56a0 0x55f629bcf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 -- 172.21.15.35:0/2304842772 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6299a15d0 con 0x55f629bd4d90 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f1437fff700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bcffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f1436ffd700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd56a0 0x55f629bcf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f14377fe700 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bd5160 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1428095a70 tx=0x7f1428099080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0ba75ba8038686 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f142dffb700 1 -- 172.21.15.35:0/2304842772 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428099260 con 0x55f629bd4d90 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f142dffb700 1 -- 172.21.15.35:0/2304842772 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14280993c0 con 0x55f629bd4d90 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.226+0000 7f142dffb700 1 -- 172.21.15.35:0/2304842772 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280a0ed0 con 0x55f629bd4d90 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 -- 172.21.15.35:0/2304842772 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 msgr2=0x55f629bd5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bd5160 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1428095a70 tx=0x7f1428099080 comp rx=0 tx=0).stop 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 -- 172.21.15.35:0/2304842772 shutdown_connections 2023-03-17T09:49:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bcffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bd5160 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/2304842772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd56a0 0x55f629bcf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 -- 172.21.15.35:0/2304842772 >> 172.21.15.35:0/2304842772 conn(0x55f629a2a6b0 msgr2=0x55f629bc7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 -- 172.21.15.35:0/2304842772 shutdown_connections 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 -- 172.21.15.35:0/2304842772 wait complete. 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.227+0000 7f144a3a9b80 1 -- start start 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 Processor -- start 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bdb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bd8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6299a38c0 con 0x55f629bd56a0 2023-03-17T09:49:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629bd9650 con 0x55f629bd4d90 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629be4ef0 con 0x55f629bcfb70 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f144a3a9b80 10 client.0 _ll_register_callbacks cb 0x55f6299c5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47116/0 (socket says 172.21.15.35:47116) 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 -- 172.21.15.35:0/3843781601 learned_addr learned my addr 172.21.15.35:0/3843781601 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bd8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f14377fe700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bdb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 -- 172.21.15.35:0/3843781601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 msgr2=0x55f629bdb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bdb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 -- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 msgr2=0x55f629bd8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bd8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.228+0000 7f1437fff700 1 -- 172.21.15.35:0/3843781601 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143810ee70 con 0x55f629bd56a0 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f14377fe700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bdb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1437fff700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd8f10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1430007ae0 tx=0x7f1430007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a447fe10562120 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1416ffd700 1 -- 172.21.15.35:0/3843781601 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000e030 con 0x55f629bd56a0 2023-03-17T09:49:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1416ffd700 1 -- 172.21.15.35:0/3843781601 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f143000f070 con 0x55f629bd56a0 2023-03-17T09:49:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f629ae2390 con 0x55f629bd56a0 2023-03-17T09:49:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1416ffd700 1 -- 172.21.15.35:0/3843781601 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14300118b0 con 0x55f629bd56a0 2023-03-17T09:49:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 10 client.17436 fetch_fsmap learned FSMap version 36 2023-03-17T09:49:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f62994dd80 con 0x55f629bd56a0 2023-03-17T09:49:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1416ffd700 1 -- 172.21.15.35:0/3843781601 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f629ae2390 con 0x55f629bd56a0 2023-03-17T09:49:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f1416ffd700 1 -- 172.21.15.35:0/3843781601 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f143001d060 con 0x55f629bd56a0 2023-03-17T09:49:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 10 client.17436 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:49:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 10 client.17436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:49:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 20 client.17436 populate_metadata read hostname 'smithi035' 2023-03-17T09:49:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.229+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629be9030 0x55f629beb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:58.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.230+0000 7f144a3a9b80 4 client.17436 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:49:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.230+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f629aee600 con 0x55f629be9030 2023-03-17T09:49:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.230+0000 7f14377fe700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629be9030 0x55f629beb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.230+0000 7f1416ffd700 10 client.17436 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.230+0000 7f14377fe700 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629be9030 0x55f629beb440 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dde9dc50d17127a server_cookie=aa57bce1230677f5 in_seq=0 out_seq=0 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f1416ffd700 1 -- 172.21.15.35:0/3843781601 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f629aee600 con 0x55f629be9030 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f1416ffd700 10 client.17436 handle_command_reply: tid=0 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 client.17436 shutdown 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 msgr2=0x55f629bd8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd8f10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1430007ae0 tx=0x7f1430007df0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 shutdown_connections 2023-03-17T09:49:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629be9030 0x55f629beb440 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd8f10 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629bdb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f1416ffd700 0 client.17436 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3843781601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bd8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 >> 172.21.15.35:0/3843781601 conn(0x55f629a2a6b0 msgr2=0x55f629bcc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 shutdown_connections 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3843781601 wait complete. 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.231+0000 7f144a3a9b80 20 client.17436 trim_cache size 0 max 16384 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 Processor -- start 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 -- start start 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629beb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bc7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629bc30f0 con 0x55f629bd56a0 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629be6660 con 0x55f629bd4d90 2023-03-17T09:49:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629bc8000 con 0x55f629bcfb70 2023-03-17T09:49:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f1437fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f1437fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47124/0 (socket says 172.21.15.35:47124) 2023-03-17T09:49:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.246+0000 7f1437fff700 1 -- 172.21.15.35:0/3826189656 learned_addr learned my addr 172.21.15.35:0/3826189656 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:49:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bc7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:49:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1437fff700 1 -- 172.21.15.35:0/3826189656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 msgr2=0x55f629beb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:59.894 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:39 smithi035 ceph-mon[92535]: pgmap v1753: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:49:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1437fff700 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629beb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1437fff700 1 -- 172.21.15.35:0/3826189656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 msgr2=0x55f629bc7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:49:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1437fff700 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bc7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1437fff700 1 -- 172.21.15.35:0/3826189656 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f629ae6130 con 0x55f629bd56a0 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bc7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f1437fff700 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd2860 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1430002230 tx=0x7f1430011530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a1dfed4463b377 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f142e7fc700 1 -- 172.21.15.35:0/3826189656 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000e070 con 0x55f629bd56a0 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f142e7fc700 1 -- 172.21.15.35:0/3826189656 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1430016470 con 0x55f629bd56a0 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f142e7fc700 1 -- 172.21.15.35:0/3826189656 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300118d0 con 0x55f629bd56a0 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3826189656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 msgr2=0x55f629bd2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.247+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd2860 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1430002230 tx=0x7f1430011530 comp rx=0 tx=0).stop 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3826189656 shutdown_connections 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd56a0 0x55f629bd2860 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bcfb70 0x55f629beb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3826189656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bd4d90 0x55f629bc7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3826189656 >> 172.21.15.35:0/3826189656 conn(0x55f629a2a6b0 msgr2=0x55f629bcc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3826189656 shutdown_connections 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3826189656 wait complete. 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- start start 2023-03-17T09:49:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 Processor -- start 2023-03-17T09:49:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bcfb70 0x55f629bddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bde2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:49:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bd56a0 0x55f629c3e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629c3e840 con 0x55f629bd4d90 2023-03-17T09:50:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629c3e9b0 con 0x55f629bcfb70 2023-03-17T09:50:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629c3eb70 con 0x55f629bd56a0 2023-03-17T09:50:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.248+0000 7f144a3a9b80 10 client.0 _ll_register_callbacks cb 0x55f6299c5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:50:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bde2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bde2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47128/0 (socket says 172.21.15.35:47128) 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 -- 172.21.15.35:0/3252290353 learned_addr learned my addr 172.21.15.35:0/3252290353 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f14377fe700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bcfb70 0x55f629bddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1437fff700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bd56a0 0x55f629c3e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 -- 172.21.15.35:0/3252290353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bd56a0 msgr2=0x55f629c3e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bd56a0 0x55f629c3e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 -- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bcfb70 msgr2=0x55f629bddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bcfb70 0x55f629bddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 -- 172.21.15.35:0/3252290353 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f62994dd80 con 0x55f629bd4d90 2023-03-17T09:50:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1436ffd700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bde2e0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f143806a350 tx=0x7f14200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e30cf10b413fbb9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1416ffd700 1 -- 172.21.15.35:0/3252290353 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420004220 con 0x55f629bd4d90 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1416ffd700 1 -- 172.21.15.35:0/3252290353 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1420004380 con 0x55f629bd4d90 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f629b9d1e0 con 0x55f629bd4d90 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f1416ffd700 1 -- 172.21.15.35:0/3252290353 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1420004540 con 0x55f629bd4d90 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f144a3a9b80 10 client.17442 fetch_fsmap learned FSMap version 36 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.249+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55f6299741f0 con 0x55f629bd4d90 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f1416ffd700 1 -- 172.21.15.35:0/3252290353 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f629b9d1e0 con 0x55f629bd4d90 2023-03-17T09:50:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f1416ffd700 1 -- 172.21.15.35:0/3252290353 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1420020870 con 0x55f629bd4d90 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f144a3a9b80 10 client.17442 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f144a3a9b80 10 client.17442 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f144a3a9b80 20 client.17442 populate_metadata read hostname 'smithi035' 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629c402c0 0x55f629c426d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f144a3a9b80 4 client.17442 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f6299a3f00 con 0x55f629c402c0 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f14377fe700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629c402c0 0x55f629c426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f1416ffd700 10 client.17442 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.250+0000 7f14377fe700 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629c402c0 0x55f629c426d0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24490a7f5d7cae3a server_cookie=3fb2373e9bc9f9d9 in_seq=0 out_seq=0 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f1416ffd700 1 -- 172.21.15.35:0/3252290353 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f6299a3f00 con 0x55f629c402c0 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f1416ffd700 10 client.17442 handle_command_reply: tid=0 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 client.17442 shutdown 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 msgr2=0x55f629bde2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bde2e0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f143806a350 tx=0x7f14200047c0 comp rx=0 tx=0).stop 2023-03-17T09:50:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 shutdown_connections 2023-03-17T09:50:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f629c402c0 0x55f629c426d0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f629bd56a0 0x55f629c3e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f1416ffd700 0 client.17442 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f629bcfb70 0x55f629bddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 --2- 172.21.15.35:0/3252290353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f629bd4d90 0x55f629bde2e0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 >> 172.21.15.35:0/3252290353 conn(0x55f629a2a6b0 msgr2=0x55f629bd39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 shutdown_connections 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 1 -- 172.21.15.35:0/3252290353 wait complete. 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.255+0000 7f144a3a9b80 20 client.17442 trim_cache size 0 max 16384 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f142409f640 msgr2=0x7f14240a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f142409f640 0x7f14240a1af0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1420005fd0 tx=0x7f1420005ee0 comp rx=0 tx=0).stop 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 msgr2=0x7f1438195140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f1438195140 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1428009fd0 tx=0x7f142800f740 comp rx=0 tx=0).stop 2023-03-17T09:50:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 shutdown_connections 2023-03-17T09:50:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f142409f640 0x7f14240a1af0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1438104390 0x7f1438199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14380ff350 0x7f1438195140 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 --2- 172.21.15.35:0/3118679386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14380ffcf0 0x7f1438195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 >> 172.21.15.35:0/3118679386 conn(0x7f1438076330 msgr2=0x7f1438102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 shutdown_connections 2023-03-17T09:50:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:38.256+0000 7f143e21c700 1 -- 172.21.15.35:0/3118679386 wait complete. 2023-03-17T09:50:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 -- 172.21.15.35:0/3645503294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc81044d0 msgr2=0x7fbfc810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3645503294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc81044d0 0x7fbfc810c0a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000b0d0 tx=0x7fbfc000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:50:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 -- 172.21.15.35:0/3645503294 shutdown_connections 2023-03-17T09:50:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3645503294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc81044d0 0x7fbfc810c0a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3645503294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc80ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3645503294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc80ffe50 0x7fbfc8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 -- 172.21.15.35:0/3645503294 >> 172.21.15.35:0/3645503294 conn(0x7fbfc8077220 msgr2=0x7fbfc8077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 -- 172.21.15.35:0/3645503294 shutdown_connections 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 -- 172.21.15.35:0/3645503294 wait complete. 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.379+0000 7fbfcd794700 1 Processor -- start 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 -- start start 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc8100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ffe50 0x7fbfc81013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc81044d0 0x7fbfc81a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8101c00 con 0x7fbfc80ff4b0 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81a4af0 con 0x7fbfc81044d0 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfcd794700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81a4c30 con 0x7fbfc80ffe50 2023-03-17T09:50:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc8100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc8100e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47140/0 (socket says 172.21.15.35:47140) 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/3729508418 learned_addr learned my addr 172.21.15.35:0/3729508418 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc81044d0 0x7fbfc81a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ffe50 0x7fbfc81013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/3729508418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ffe50 msgr2=0x7fbfc81013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ffe50 0x7fbfc81013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/3729508418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc81044d0 msgr2=0x7fbfc81a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc81044d0 0x7fbfc81a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/3729508418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0009d00 con 0x7fbfc80ff4b0 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ffe50 0x7fbfc81013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.380+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc81044d0 0x7fbfc81a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.381+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc8100e90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000e9a0 tx=0x7fbfb000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.381+0000 7fbfbffff700 1 -- 172.21.15.35:0/3729508418 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0009790 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.381+0000 7fbfbffff700 1 -- 172.21.15.35:0/3729508418 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfb000cbd0 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.381+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc810f0e0 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.381+0000 7fbfbffff700 1 -- 172.21.15.35:0/3729508418 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0018680 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.381+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc810ef50 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.383+0000 7fbfbffff700 1 -- 172.21.15.35:0/3729508418 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbfb000cd40 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.384+0000 7fbfbffff700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb409f6c0 0x7fbfb40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.384+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb409f6c0 0x7fbfb40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.384+0000 7fbfbffff700 1 -- 172.21.15.35:0/3729508418 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbfb0014070 con 0x7fbfc80ff4b0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb409f6c0 0x7fbfb40a1b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8102680 tx=0x7fbfb8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:11.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 Processor -- start 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 -- start start 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b9be0 0x55780c6b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c5bb010 con 0x55780c6b4960 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c60d950 con 0x55780c6b9be0 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.385+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c606de0 con 0x55780c6ba4f0 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47152/0 (socket says 172.21.15.35:47152) 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 -- 172.21.15.35:0/1230772580 learned_addr learned my addr 172.21.15.35:0/1230772580 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b9be0 0x55780c6b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:11.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 -- 172.21.15.35:0/1230772580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 msgr2=0x55780c6b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 -- 172.21.15.35:0/1230772580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b9be0 msgr2=0x55780c6b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b9be0 0x55780c6b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 -- 172.21.15.35:0/1230772580 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55780c4885d0 con 0x55780c6b4960 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b9be0 0x55780c6b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6b4d90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00092e0 tx=0x7fbfc0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60bdd1af19626da server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfbd7fa700 1 -- 172.21.15.35:0/1230772580 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000e040 con 0x55780c6b4960 2023-03-17T09:50:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfbd7fa700 1 -- 172.21.15.35:0/1230772580 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfc0007d90 con 0x55780c6b4960 2023-03-17T09:50:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.386+0000 7fbfbd7fa700 1 -- 172.21.15.35:0/1230772580 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0004cb0 con 0x55780c6b4960 2023-03-17T09:50:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1230772580 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 msgr2=0x55780c6b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6b4d90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00092e0 tx=0x7fbfc0009310 comp rx=0 tx=0).stop 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1230772580 shutdown_connections 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6b4d90 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b9be0 0x55780c6b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1230772580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1230772580 >> 172.21.15.35:0/1230772580 conn(0x55780c5116b0 msgr2=0x55780c6aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1230772580 shutdown_connections 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1230772580 wait complete. 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.387+0000 7fbfd9921b80 1 -- start start 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 Processor -- start 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6ba4f0 0x55780c6bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c48a8c0 con 0x55780c6b4960 2023-03-17T09:50:15.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:41 smithi035 ceph-mon[92535]: pgmap v1754: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:15.434 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:50:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6be410 con 0x55780c6ba4f0 2023-03-17T09:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6c9fd0 con 0x55780c6b9be0 2023-03-17T09:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfd9921b80 10 client.0 _ll_register_callbacks cb 0x55780c4ac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:50:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6c03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47154/0 (socket says 172.21.15.35:47154) 2023-03-17T09:50:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/1176936501 learned_addr learned my addr 172.21.15.35:0/1176936501 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6ba4f0 0x55780c6bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:17.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/1176936501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 msgr2=0x55780c6bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6ba4f0 msgr2=0x55780c6bdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6ba4f0 0x55780c6bdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.388+0000 7fbfc6ffd700 1 -- 172.21.15.35:0/1176936501 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc810c8b0 con 0x55780c6b4960 2023-03-17T09:50:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6c03f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00c81f0 tx=0x7fbfb00985b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f261e8f7aa87c8cd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:50:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfae7fc700 1 -- 172.21.15.35:0/1176936501 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0097ba0 con 0x55780c6b4960 2023-03-17T09:50:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfae7fc700 1 -- 172.21.15.35:0/1176936501 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbfb00a0210 con 0x55780c6b4960 2023-03-17T09:50:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55780c5c9390 con 0x55780c6b4960 2023-03-17T09:50:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfae7fc700 1 -- 172.21.15.35:0/1176936501 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfb00a03d0 con 0x55780c6b4960 2023-03-17T09:50:21.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 10 client.17454 fetch_fsmap learned FSMap version 36 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55780c434d80 con 0x55780c6b4960 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfae7fc700 1 -- 172.21.15.35:0/1176936501 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55780c5c9390 con 0x55780c6b4960 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfae7fc700 1 -- 172.21.15.35:0/1176936501 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbfb00c7d70 con 0x55780c6b4960 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 10 client.17454 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 10 client.17454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 20 client.17454 populate_metadata read hostname 'smithi035' 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c6ce050 0x55780c6d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 4 client.17454 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.389+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55780c5d5600 con 0x55780c6ce050 2023-03-17T09:50:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.390+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c6ce050 0x55780c6d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.390+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c6ce050 0x55780c6d0460 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb401055c91809b server_cookie=6a10e57bce523d3d in_seq=0 out_seq=0 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.390+0000 7fbfae7fc700 10 client.17454 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfae7fc700 1 -- 172.21.15.35:0/1176936501 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55780c5d5600 con 0x55780c6ce050 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfae7fc700 10 client.17454 handle_command_reply: tid=0 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 client.17454 shutdown 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 msgr2=0x55780c6c03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6c03f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00c81f0 tx=0x7fbfb00985b0 comp rx=0 tx=0).stop 2023-03-17T09:50:23.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 shutdown_connections 2023-03-17T09:50:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c6ce050 0x55780c6d0460 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6ba4f0 0x55780c6bdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfae7fc700 0 client.17454 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:50:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b4960 0x55780c6c03f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1176936501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 >> 172.21.15.35:0/1176936501 conn(0x55780c5116b0 msgr2=0x55780c6aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 shutdown_connections 2023-03-17T09:50:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1176936501 wait complete. 2023-03-17T09:50:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.391+0000 7fbfd9921b80 20 client.17454 trim_cache size 0 max 16384 2023-03-17T09:50:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.406+0000 7fbfd9921b80 1 Processor -- start 2023-03-17T09:50:26.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.406+0000 7fbfd9921b80 1 -- start start 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.406+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 0x55780c6c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6be230 con 0x55780c6b9be0 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6af000 con 0x55780c6b4960 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6ab5c0 con 0x55780c6ba4f0 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 0x55780c6c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 0x55780c6c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47164/0 (socket says 172.21.15.35:47164) 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 -- 172.21.15.35:0/1253010656 learned_addr learned my addr 172.21.15.35:0/1253010656 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 -- 172.21.15.35:0/1253010656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 msgr2=0x55780c6bb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6bb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 -- 172.21.15.35:0/1253010656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 msgr2=0x55780c6aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:28.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 -- 172.21.15.35:0/1253010656 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55780c5cd130 con 0x55780c6b9be0 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 0x55780c6c4f10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8069080 tx=0x7fbfb8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f05332920b06e90 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfbdffb700 1 -- 172.21.15.35:0/1253010656 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8025040 con 0x55780c6b9be0 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfbdffb700 1 -- 172.21.15.35:0/1253010656 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfb800f9e0 con 0x55780c6b9be0 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.407+0000 7fbfbdffb700 1 -- 172.21.15.35:0/1253010656 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8003d10 con 0x55780c6b9be0 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1253010656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 msgr2=0x55780c6c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 0x55780c6c4f10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8069080 tx=0x7fbfb8015000 comp rx=0 tx=0).stop 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1253010656 shutdown_connections 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6ba4f0 0x55780c6bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/1253010656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6b9be0 0x55780c6c4f10 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1253010656 >> 172.21.15.35:0/1253010656 conn(0x55780c5116b0 msgr2=0x55780c6ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1253010656 shutdown_connections 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.408+0000 7fbfd9921b80 1 -- 172.21.15.35:0/1253010656 wait complete. 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 -- start start 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 Processor -- start 2023-03-17T09:50:28.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 0x55780c6b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6b61c0 con 0x55780c6ba4f0 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6b6330 con 0x55780c6b4960 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780c6b64f0 con 0x55780c6b9be0 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfd9921b80 10 client.0 _ll_register_callbacks cb 0x55780c4ac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 0x55780c6b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 0x55780c6b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47172/0 (socket says 172.21.15.35:47172) 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc77fe700 1 -- 172.21.15.35:0/277092831 learned_addr learned my addr 172.21.15.35:0/277092831 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc77fe700 1 -- 172.21.15.35:0/277092831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 msgr2=0x55780c6b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.409+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfc77fe700 1 -- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 msgr2=0x55780c6c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfc77fe700 1 -- 172.21.15.35:0/277092831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb800feb0 con 0x55780c6ba4f0 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfc67fc700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfc77fe700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 0x55780c6b5c80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009380 tx=0x7fbfc000bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6471ca044346206e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfae7fc700 1 -- 172.21.15.35:0/277092831 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc002b070 con 0x55780c6ba4f0 2023-03-17T09:50:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfae7fc700 1 -- 172.21.15.35:0/277092831 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbfc0004c60 con 0x55780c6ba4f0 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55780c6841e0 con 0x55780c6ba4f0 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfae7fc700 1 -- 172.21.15.35:0/277092831 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc000e040 con 0x55780c6ba4f0 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 10 client.17460 fetch_fsmap learned FSMap version 36 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55780c45b1f0 con 0x55780c6ba4f0 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfae7fc700 1 -- 172.21.15.35:0/277092831 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55780c6841e0 con 0x55780c6ba4f0 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfae7fc700 1 -- 172.21.15.35:0/277092831 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbfc0019030 con 0x55780c6ba4f0 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 10 client.17460 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 10 client.17460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 20 client.17460 populate_metadata read hostname 'smithi035' 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c722f60 0x55780c725370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 4 client.17460 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.410+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55780c48af00 con 0x55780c722f60 2023-03-17T09:50:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.411+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c722f60 0x55780c725370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.411+0000 7fbfc6ffd700 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c722f60 0x55780c725370 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6188b87aa7edaf33 server_cookie=dfba0f48e19e3c14 in_seq=0 out_seq=0 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.411+0000 7fbfae7fc700 10 client.17460 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfae7fc700 1 -- 172.21.15.35:0/277092831 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55780c48af00 con 0x55780c722f60 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfae7fc700 10 client.17460 handle_command_reply: tid=0 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 client.17460 shutdown 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 msgr2=0x55780c6b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 0x55780c6b5c80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009380 tx=0x7fbfc000bd80 comp rx=0 tx=0).stop 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 shutdown_connections 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55780c722f60 0x55780c725370 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55780c6ba4f0 0x55780c6b5c80 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfae7fc700 0 client.17460 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55780c6b4960 0x55780c6c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 --2- 172.21.15.35:0/277092831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55780c6b9be0 0x55780c6b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 >> 172.21.15.35:0/277092831 conn(0x55780c5116b0 msgr2=0x55780c6b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.415+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 shutdown_connections 2023-03-17T09:50:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfd9921b80 1 -- 172.21.15.35:0/277092831 wait complete. 2023-03-17T09:50:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfd9921b80 20 client.17460 trim_cache size 0 max 16384 2023-03-17T09:50:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb409f6c0 msgr2=0x7fbfb40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb409f6c0 0x7fbfb40a1b70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8102680 tx=0x7fbfb8009260 comp rx=0 tx=0).stop 2023-03-17T09:50:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 msgr2=0x7fbfc8100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc8100e90 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000e9a0 tx=0x7fbfb000ed60 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 shutdown_connections 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb409f6c0 0x7fbfb40a1b70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfc81044d0 0x7fbfc81a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfc80ff4b0 0x7fbfc8100e90 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 --2- 172.21.15.35:0/3729508418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80ffe50 0x7fbfc81013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 >> 172.21.15.35:0/3729508418 conn(0x7fbfc8077220 msgr2=0x7fbfc80692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 shutdown_connections 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:27:51.416+0000 7fbfcd794700 1 -- 172.21.15.35:0/3729508418 wait complete. 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/3652772006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 msgr2=0x7ff2f4101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/3652772006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4101660 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009990 tx=0x7ff2e4009ca0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/3652772006 shutdown_connections 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/3652772006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f410a7b0 0x7ff2f410cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/3652772006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4101660 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/3652772006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 0x7ff2f410a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/3652772006 >> 172.21.15.35:0/3652772006 conn(0x7ff2f4076330 msgr2=0x7ff2f4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/3652772006 shutdown_connections 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.537+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/3652772006 wait complete. 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.538+0000 7ff2fa7d4700 1 Processor -- start 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.538+0000 7ff2fa7d4700 1 -- start start 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 0x7ff2f4196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f410a7b0 0x7ff2f419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419b220 con 0x7ff2f4101290 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419b390 con 0x7ff2f410a7b0 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f419b550 con 0x7ff2f4101ba0 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47182/0 (socket says 172.21.15.35:47182) 2023-03-17T09:50:33.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:43 smithi035 ceph-mon[92535]: pgmap v1755: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:50:35.096 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:50:35.096 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:50:35.096 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:50:35.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: pgmap v1756: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: pgmap v1757: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:47 smithi035 ceph-mon[92535]: pgmap v1758: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:49 smithi035 ceph-mon[92535]: pgmap v1759: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:51 smithi035 ceph-mon[92535]: pgmap v1760: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:53 smithi035 ceph-mon[92535]: pgmap v1761: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:55 smithi035 ceph-mon[92535]: pgmap v1762: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:57 smithi035 ceph-mon[92535]: pgmap v1763: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:40:59 smithi035 ceph-mon[92535]: pgmap v1764: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:01 smithi035 ceph-mon[92535]: pgmap v1765: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:03 smithi035 ceph-mon[92535]: pgmap v1766: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:05 smithi035 ceph-mon[92535]: pgmap v1767: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:07 smithi035 ceph-mon[92535]: pgmap v1768: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:50:37.875 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:09 smithi035 ceph-mon[92535]: pgmap v1769: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:09 smithi035 ceph-mon[92535]: osdmap e187: 12 total, 12 up, 12 in 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:11 smithi035 ceph-mon[92535]: pgmap v1771: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:13 smithi035 ceph-mon[92535]: pgmap v1772: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:15 smithi035 ceph-mon[92535]: pgmap v1773: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:15 smithi035 ceph-mon[92535]: osdmap e188: 12 total, 12 up, 12 in 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:17 smithi035 ceph-mon[92535]: pgmap v1775: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:19 smithi035 ceph-mon[92535]: pgmap v1776: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:21 smithi035 ceph-mon[92535]: pgmap v1777: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:23 smithi035 ceph-mon[92535]: pgmap v1778: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:25 smithi035 ceph-mon[92535]: pgmap v1779: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:27 smithi035 ceph-mon[92535]: pgmap v1780: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:29 smithi035 ceph-mon[92535]: pgmap v1781: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:31 smithi035 ceph-mon[92535]: pgmap v1782: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:33 smithi035 ceph-mon[92535]: pgmap v1783: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:35 smithi035 ceph-mon[92535]: pgmap v1784: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:37 smithi035 ceph-mon[92535]: pgmap v1785: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:39 smithi035 ceph-mon[92535]: pgmap v1786: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:50:37.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:41 smithi035 ceph-mon[92535]: pgmap v1787: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:43 smithi035 ceph-mon[92535]: pgmap v1788: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:45 smithi035 ceph-mon[92535]: pgmap v1789: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:46 smithi035 ceph-mon[92535]: pgmap v1790: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 754 B/s wr, 9 op/s 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:46 smithi035 ceph-mon[92535]: pgmap v1791: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T09:50:37.877 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:48 smithi035 ceph-mon[92535]: pgmap v1792: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:50 smithi035 ceph-mon[92535]: pgmap v1793: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:52 smithi035 ceph-mon[92535]: pgmap v1794: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:54 smithi035 ceph-mon[92535]: pgmap v1795: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:56 smithi035 ceph-mon[92535]: pgmap v1796: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:41:58 smithi035 ceph-mon[92535]: pgmap v1797: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:00 smithi035 ceph-mon[92535]: pgmap v1798: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:02 smithi035 ceph-mon[92535]: pgmap v1799: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:04 smithi035 ceph-mon[92535]: pgmap v1800: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:06 smithi035 ceph-mon[92535]: pgmap v1801: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:50:38.534 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:08 smithi035 ceph-mon[92535]: pgmap v1802: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:50:39.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:09 smithi035 ceph-mon[92535]: osdmap e189: 12 total, 12 up, 12 in 2023-03-17T09:50:40.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:10 smithi035 ceph-mon[92535]: pgmap v1804: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:50:40.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:11 smithi035 ceph-mon[92535]: pgmap v1805: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:50:40.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:14 smithi035 ceph-mon[92535]: pgmap v1806: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:50:40.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:16 smithi035 ceph-mon[92535]: pgmap v1807: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:50:40.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:16 smithi035 ceph-mon[92535]: osdmap e190: 12 total, 12 up, 12 in 2023-03-17T09:50:40.720 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:18 smithi035 ceph-mon[92535]: pgmap v1809: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 972 B/s wr, 13 op/s 2023-03-17T09:50:40.720 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:20 smithi035 ceph-mon[92535]: pgmap v1810: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:50:40.720 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:22 smithi035 ceph-mon[92535]: pgmap v1811: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:50:41.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:24 smithi035 ceph-mon[92535]: pgmap v1812: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:26 smithi035 ceph-mon[92535]: pgmap v1813: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:28 smithi035 ceph-mon[92535]: pgmap v1814: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 443 B/s wr, 13 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:30 smithi035 ceph-mon[92535]: pgmap v1815: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:32 smithi035 ceph-mon[92535]: pgmap v1816: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:34 smithi035 ceph-mon[92535]: pgmap v1817: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:36 smithi035 ceph-mon[92535]: pgmap v1818: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:38 smithi035 ceph-mon[92535]: pgmap v1819: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:50:41.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:40 smithi035 ceph-mon[92535]: pgmap v1820: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:42 smithi035 ceph-mon[92535]: pgmap v1821: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:44 smithi035 ceph-mon[92535]: pgmap v1822: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:46 smithi035 ceph-mon[92535]: pgmap v1823: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:47 smithi035 ceph-mon[92535]: pgmap v1824: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T09:50:41.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:47 smithi035 ceph-mon[92535]: pgmap v1825: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:50:41.595 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:49 smithi035 ceph-mon[92535]: pgmap v1826: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:50:41.595 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:51 smithi035 ceph-mon[92535]: pgmap v1827: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:50:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:50:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:50:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:50:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:50:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:50:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:50:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:50:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:50:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:50:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:50:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:50:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:50:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:50:47.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:50:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:50:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:50:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:50:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:50:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:50:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:50:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 -- 172.21.15.35:0/2120462305 learned_addr learned my addr 172.21.15.35:0/2120462305 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 0x7ff2f4196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f410a7b0 0x7ff2f419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 -- 172.21.15.35:0/2120462305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 msgr2=0x7ff2f4196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 0x7ff2f4196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 -- 172.21.15.35:0/2120462305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f410a7b0 msgr2=0x7ff2f419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f410a7b0 0x7ff2f419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 -- 172.21.15.35:0/2120462305 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40095f0 con 0x7ff2f4101290 2023-03-17T09:50:51.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 0x7ff2f4196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4196240 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005f50 tx=0x7ff2e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f17fa700 1 -- 172.21.15.35:0/2120462305 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e401d070 con 0x7ff2f4101290 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f41100e0 con 0x7ff2f4101290 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f17fa700 1 -- 172.21.15.35:0/2120462305 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2e4004cc0 con 0x7ff2f4101290 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.539+0000 7ff2f17fa700 1 -- 172.21.15.35:0/2120462305 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4005280 con 0x7ff2f4101290 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.540+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f410ff50 con 0x7ff2f4101290 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.542+0000 7ff2f17fa700 1 -- 172.21.15.35:0/2120462305 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff2e4003b60 con 0x7ff2f4101290 2023-03-17T09:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.542+0000 7ff2f17fa700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff2dc09f640 0x7ff2dc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.542+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff2dc09f640 0x7ff2dc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.542+0000 7ff2f17fa700 1 -- 172.21.15.35:0/2120462305 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff2e40cb830 con 0x7ff2f4101290 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.543+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff2dc09f640 0x7ff2dc0a1af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4197850 tx=0x7ff2e8005f50 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.543+0000 7ff306961b80 1 Processor -- start 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.543+0000 7ff306961b80 1 -- start start 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff306961b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc48f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff306961b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc489830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff306961b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc489dc0 0x5564dc48a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff306961b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc38c010 con 0x5564dc48f900 2023-03-17T09:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff306961b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc3de950 con 0x5564dc48eff0 2023-03-17T09:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff306961b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc3d7de0 con 0x5564dc489dc0 2023-03-17T09:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc489830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc489830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47192/0 (socket says 172.21.15.35:47192) 2023-03-17T09:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 -- 172.21.15.35:0/1020256418 learned_addr learned my addr 172.21.15.35:0/1020256418 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc489dc0 0x5564dc48a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc48f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 -- 172.21.15.35:0/1020256418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc489dc0 msgr2=0x5564dc48a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc489dc0 0x5564dc48a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 -- 172.21.15.35:0/1020256418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 msgr2=0x5564dc48f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc48f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 -- 172.21.15.35:0/1020256418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564dc2595d0 con 0x5564dc48f900 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc489dc0 0x5564dc48a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc48f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:50:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc489830 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800ed00 tx=0x7ff2e8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addd4e71011f3f32 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.544+0000 7ff2da7fc700 1 -- 172.21.15.35:0/1020256418 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8010d50 con 0x5564dc48f900 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff2da7fc700 1 -- 172.21.15.35:0/1020256418 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2e8004cc0 con 0x5564dc48f900 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff2da7fc700 1 -- 172.21.15.35:0/1020256418 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e801d450 con 0x5564dc48f900 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 -- 172.21.15.35:0/1020256418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 msgr2=0x5564dc489830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc489830 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800ed00 tx=0x7ff2e8011000 comp rx=0 tx=0).stop 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 -- 172.21.15.35:0/1020256418 shutdown_connections 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc489dc0 0x5564dc48a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc48f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 --2- 172.21.15.35:0/1020256418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc489830 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 -- 172.21.15.35:0/1020256418 >> 172.21.15.35:0/1020256418 conn(0x5564dc2e26b0 msgr2=0x5564dc47fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:50:57.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 -- 172.21.15.35:0/1020256418 shutdown_connections 2023-03-17T09:50:57.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.545+0000 7ff306961b80 1 -- 172.21.15.35:0/1020256418 wait complete. 2023-03-17T09:50:57.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.546+0000 7ff306961b80 1 -- start start 2023-03-17T09:50:57.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.546+0000 7ff306961b80 1 Processor -- start 2023-03-17T09:50:57.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.546+0000 7ff306961b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc495850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:57.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.546+0000 7ff306961b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc492a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.546+0000 7ff306961b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48f900 0x5564dc493090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc25b8c0 con 0x5564dc489dc0 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc4937d0 con 0x5564dc48eff0 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc49f460 con 0x5564dc48f900 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 10 client.0 _ll_register_callbacks cb 0x5564dc27d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc495850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc495850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47196/0 (socket says 172.21.15.35:47196) 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 -- 172.21.15.35:0/285147080 learned_addr learned my addr 172.21.15.35:0/285147080 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:50:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48f900 0x5564dc493090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 -- 172.21.15.35:0/285147080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48f900 msgr2=0x5564dc493090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48f900 0x5564dc493090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc492a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 -- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 msgr2=0x5564dc492a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc492a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 -- 172.21.15.35:0/285147080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e800e9e0 con 0x5564dc489dc0 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc492a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:50:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc495850 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40c9020 tx=0x7ff2e4097920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9061912fa9bb9a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:50:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:50:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2d37fe700 1 -- 172.21.15.35:0/285147080 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e409d160 con 0x5564dc489dc0 2023-03-17T09:50:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2d37fe700 1 -- 172.21.15.35:0/285147080 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff2e4099370 con 0x5564dc489dc0 2023-03-17T09:50:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564dc39a390 con 0x5564dc489dc0 2023-03-17T09:51:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff2d37fe700 1 -- 172.21.15.35:0/285147080 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e40a14d0 con 0x5564dc489dc0 2023-03-17T09:51:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 10 client.17472 fetch_fsmap learned FSMap version 36 2023-03-17T09:51:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.547+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5564dc205d80 con 0x5564dc489dc0 2023-03-17T09:51:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff2d37fe700 1 -- 172.21.15.35:0/285147080 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564dc39a390 con 0x5564dc489dc0 2023-03-17T09:51:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff2d37fe700 1 -- 172.21.15.35:0/285147080 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff2e40055a0 con 0x5564dc489dc0 2023-03-17T09:51:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff306961b80 10 client.17472 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:51:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff306961b80 10 client.17472 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:51:01.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff306961b80 20 client.17472 populate_metadata read hostname 'smithi035' 2023-03-17T09:51:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff306961b80 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4a3100 0x5564dc4a5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff306961b80 4 client.17472 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:51:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564dc3a6600 con 0x5564dc4a3100 2023-03-17T09:51:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.548+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4a3100 0x5564dc4a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff2d37fe700 10 client.17472 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4a3100 0x5564dc4a5510 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a509531b7a4c7a2 server_cookie=40cdf6b6a0c9fd53 in_seq=0 out_seq=0 2023-03-17T09:51:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff2d37fe700 1 -- 172.21.15.35:0/285147080 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5564dc3a6600 con 0x5564dc4a3100 2023-03-17T09:51:04.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff2d37fe700 10 client.17472 handle_command_reply: tid=0 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff306961b80 1 client.17472 shutdown 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 msgr2=0x5564dc495850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff306961b80 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc495850 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40c9020 tx=0x7ff2e4097920 comp rx=0 tx=0).stop 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 shutdown_connections 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.549+0000 7ff306961b80 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4a3100 0x5564dc4a5510 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48f900 0x5564dc493090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc495850 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff2d37fe700 0 client.17472 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 1 --2- 172.21.15.35:0/285147080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48eff0 0x5564dc492a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 >> 172.21.15.35:0/285147080 conn(0x5564dc2e26b0 msgr2=0x5564dc484410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 shutdown_connections 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 1 -- 172.21.15.35:0/285147080 wait complete. 2023-03-17T09:51:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.550+0000 7ff306961b80 20 client.17472 trim_cache size 0 max 16384 2023-03-17T09:51:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 Processor -- start 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 -- start start 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc47fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc49a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48f900 0x5564dc495380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc493a10 con 0x5564dc489dc0 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc48ea90 con 0x5564dc48f900 2023-03-17T09:51:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff306961b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc480000 con 0x5564dc48eff0 2023-03-17T09:51:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc47fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc47fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47204/0 (socket says 172.21.15.35:47204) 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 -- 172.21.15.35:0/1552074450 learned_addr learned my addr 172.21.15.35:0/1552074450 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc49a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 -- 172.21.15.35:0/1552074450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 msgr2=0x5564dc49a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc49a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 -- 172.21.15.35:0/1552074450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48f900 msgr2=0x5564dc495380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48f900 0x5564dc495380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:08.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48f900 0x5564dc495380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f3fff700 1 -- 172.21.15.35:0/1552074450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564dc39e130 con 0x5564dc489dc0 2023-03-17T09:51:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.565+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48f900 0x5564dc495380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:51:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc47fac0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4099070 tx=0x7ff2e40950b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70a52c0b15777bc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff2daffd700 1 -- 172.21.15.35:0/1552074450 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4095510 con 0x5564dc489dc0 2023-03-17T09:51:08.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff2daffd700 1 -- 172.21.15.35:0/1552074450 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2e409d160 con 0x5564dc489dc0 2023-03-17T09:51:09.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff2daffd700 1 -- 172.21.15.35:0/1552074450 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40a1040 con 0x5564dc489dc0 2023-03-17T09:51:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 -- 172.21.15.35:0/1552074450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 msgr2=0x5564dc47fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc47fac0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4099070 tx=0x7ff2e40950b0 comp rx=0 tx=0).stop 2023-03-17T09:51:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 -- 172.21.15.35:0/1552074450 shutdown_connections 2023-03-17T09:51:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc48f900 0x5564dc495380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc489dc0 0x5564dc47fac0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 --2- 172.21.15.35:0/1552074450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc49a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 -- 172.21.15.35:0/1552074450 >> 172.21.15.35:0/1552074450 conn(0x5564dc2e26b0 msgr2=0x5564dc48ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 -- 172.21.15.35:0/1552074450 shutdown_connections 2023-03-17T09:51:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.566+0000 7ff306961b80 1 -- 172.21.15.35:0/1552074450 wait complete. 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 -- start start 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 Processor -- start 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc489dc0 0x5564dc487430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc487970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc487eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc498410 con 0x5564dc48f900 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc498580 con 0x5564dc489dc0 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dc498740 con 0x5564dc48eff0 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff2f8d71700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc487eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff306961b80 10 client.0 _ll_register_callbacks cb 0x5564dc27d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff2f8d71700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc487eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47214/0 (socket says 172.21.15.35:47214) 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff2f8d71700 1 -- 172.21.15.35:0/3558035937 learned_addr learned my addr 172.21.15.35:0/3558035937 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff2f37fe700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc487970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.567+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc489dc0 0x5564dc487430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2f8d71700 1 -- 172.21.15.35:0/3558035937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 msgr2=0x5564dc487970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc487970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2f8d71700 1 -- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc489dc0 msgr2=0x5564dc487430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc489dc0 0x5564dc487430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:10.356 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T09:51:11.048 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 -- 172.21.15.35:0/3501176485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17141043c0 msgr2=0x7f171410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 --2- 172.21.15.35:0/3501176485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17141043c0 0x7f171410bf90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f170c00b0d0 tx=0x7f170c00b3e0 comp rx=0 tx=0).stop 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 -- 172.21.15.35:0/3501176485 shutdown_connections 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 --2- 172.21.15.35:0/3501176485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17141043c0 0x7f171410bf90 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 --2- 172.21.15.35:0/3501176485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17140ff380 0x7f17140ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 --2- 172.21.15.35:0/3501176485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17140ffd20 0x7f1714103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 -- 172.21.15.35:0/3501176485 >> 172.21.15.35:0/3501176485 conn(0x7f1714076300 msgr2=0x7f1714076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 -- 172.21.15.35:0/3501176485 shutdown_connections 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 -- 172.21.15.35:0/3501176485 wait complete. 2023-03-17T09:51:12.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 Processor -- start 2023-03-17T09:51:14.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 -- start start 2023-03-17T09:51:14.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.475+0000 7f171aca6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17140ff380 0x7f17141970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:14.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f171aca6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 0x7f17141975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:14.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f171aca6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17141043c0 0x7f17141a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:14.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f171aca6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714197eb0 con 0x7f17140ffd20 2023-03-17T09:51:14.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f171aca6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17141a2670 con 0x7f17141043c0 2023-03-17T09:51:15.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f171aca6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17141a27b0 con 0x7f17140ff380 2023-03-17T09:51:15.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 0x7f17141975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:15.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 0x7f17141975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48284/0 (socket says 172.21.15.35:48284) 2023-03-17T09:51:15.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1718a42700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17140ff380 0x7f17141970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:15.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 -- 172.21.15.35:0/2024722859 learned_addr learned my addr 172.21.15.35:0/2024722859 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:15.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1719243700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17141043c0 0x7f17141a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:15.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 -- 172.21.15.35:0/2024722859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17140ff380 msgr2=0x7f17141970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:15.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17140ff380 0x7f17141970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:15.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 -- 172.21.15.35:0/2024722859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17141043c0 msgr2=0x7f17141a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:15.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17141043c0 0x7f17141a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:15.847 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 -- 172.21.15.35:0/2024722859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c009d00 con 0x7f17140ffd20 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1719243700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17141043c0 0x7f17141a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1713fff700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 0x7f17141975f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f170000c9b0 tx=0x7f170000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1711ffb700 1 -- 172.21.15.35:0/2024722859 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700007aa0 con 0x7f17140ffd20 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171410f040 con 0x7f17140ffd20 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1711ffb700 1 -- 172.21.15.35:0/2024722859 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1700007c00 con 0x7f17140ffd20 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.476+0000 7f1711ffb700 1 -- 172.21.15.35:0/2024722859 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700018660 con 0x7f17140ffd20 2023-03-17T09:51:16.257 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.477+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171410eeb0 con 0x7f17140ffd20 2023-03-17T09:51:17.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.479+0000 7f1711ffb700 1 -- 172.21.15.35:0/2024722859 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f170000f450 con 0x7f17140ffd20 2023-03-17T09:51:17.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.479+0000 7f1711ffb700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f640 0x7f17040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.479+0000 7f1711ffb700 1 -- 172.21.15.35:0/2024722859 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f17000ca510 con 0x7f17140ffd20 2023-03-17T09:51:17.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.479+0000 7f1718a42700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f640 0x7f17040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1718a42700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f640 0x7f17040a1af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1708005950 tx=0x7f170800b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 Processor -- start 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 -- start start 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266742be0 0x561266742fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x561266747500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x561266747e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561266645070 con 0x561266747a40 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612666979b0 con 0x5612667434f0 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1726e33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561266690e40 con 0x561266742be0 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.480+0000 7f1719243700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x561266747e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x561266747e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48294/0 (socket says 172.21.15.35:48294) 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 -- 172.21.15.35:0/2172945509 learned_addr learned my addr 172.21.15.35:0/2172945509 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:17.079 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1713fff700 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x561266747500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1718a42700 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266742be0 0x561266742fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 -- 172.21.15.35:0/2172945509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266742be0 msgr2=0x561266742fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266742be0 0x561266742fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 -- 172.21.15.35:0/2172945509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 msgr2=0x561266747500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x561266747500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 -- 172.21.15.35:0/2172945509 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561266512630 con 0x561266747a40 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f1719243700 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x561266747e90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f170c00ce40 tx=0x7f170c00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962b370005a54b94 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f16feffd700 1 -- 172.21.15.35:0/2172945509 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00e050 con 0x561266747a40 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f16feffd700 1 -- 172.21.15.35:0/2172945509 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f170c0093d0 con 0x561266747a40 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.481+0000 7f16feffd700 1 -- 172.21.15.35:0/2172945509 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c005310 con 0x561266747a40 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 -- 172.21.15.35:0/2172945509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 msgr2=0x561266747e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x561266747e90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f170c00ce40 tx=0x7f170c00ce70 comp rx=0 tx=0).stop 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 -- 172.21.15.35:0/2172945509 shutdown_connections 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x561266747e90 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266742be0 0x561266742fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.239 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2172945509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x561266747500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.239 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 -- 172.21.15.35:0/2172945509 >> 172.21.15.35:0/2172945509 conn(0x561266739030 msgr2=0x561266739400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:17.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 -- 172.21.15.35:0/2172945509 shutdown_connections 2023-03-17T09:51:17.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 -- 172.21.15.35:0/2172945509 wait complete. 2023-03-17T09:51:17.240 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 -- start start 2023-03-17T09:51:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.482+0000 7f1726e33b80 1 Processor -- start 2023-03-17T09:51:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 0x56126674f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x56126674c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561266514920 con 0x561266742be0 2023-03-17T09:51:17.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126674d1e0 con 0x5612667434f0 2023-03-17T09:51:17.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561266758c90 con 0x561266747a40 2023-03-17T09:51:17.955 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1726e33b80 10 client.0 _ll_register_callbacks cb 0x561266536290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 0x56126674f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 0x56126674f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48296/0 (socket says 172.21.15.35:48296) 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 -- 172.21.15.35:0/1850531685 learned_addr learned my addr 172.21.15.35:0/1850531685 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1719243700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1713fff700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x56126674c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 -- 172.21.15.35:0/1850531685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 msgr2=0x56126674ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 -- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 msgr2=0x56126674c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x56126674c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 -- 172.21.15.35:0/1850531685 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171410c7d0 con 0x561266742be0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f1718a42700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 0x56126674f190 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f17080116c0 tx=0x7f17080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3325dd092c7a37 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.483+0000 7f16f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f16f3fff700 1 -- 172.21.15.35:0/1850531685 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708004a30 con 0x561266742be0 2023-03-17T09:51:17.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f16f3fff700 1 -- 172.21.15.35:0/1850531685 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1708017070 con 0x561266742be0 2023-03-17T09:51:17.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612666533f0 con 0x561266742be0 2023-03-17T09:51:17.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f16f3fff700 1 -- 172.21.15.35:0/1850531685 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1708010ec0 con 0x561266742be0 2023-03-17T09:51:17.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 10 client.17928 fetch_fsmap learned FSMap version 37 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5612664bede0 con 0x561266742be0 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f16f3fff700 1 -- 172.21.15.35:0/1850531685 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5612666533f0 con 0x561266742be0 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f16f3fff700 1 -- 172.21.15.35:0/1850531685 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f170801f640 con 0x561266742be0 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 10 client.17928 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 10 client.17928 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 20 client.17928 populate_metadata read hostname 'smithi035' 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x56126675cce0 0x56126675f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 4 client.17928 mds_command: new command op to 24431 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.484+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56126665f660 con 0x56126675cce0 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.485+0000 7f1713fff700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x56126675cce0 0x56126675f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.485+0000 7f16f3fff700 10 client.17928 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T09:51:18.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.485+0000 7f1713fff700 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x56126675cce0 0x56126675f0f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f58e103e2d647b95 server_cookie=3b653ee7fa75a749 in_seq=0 out_seq=0 2023-03-17T09:51:18.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f16f3fff700 1 -- 172.21.15.35:0/1850531685 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56126665f660 con 0x56126675cce0 2023-03-17T09:51:18.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f16f3fff700 10 client.17928 handle_command_reply: tid=0 2023-03-17T09:51:18.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 client.17928 shutdown 2023-03-17T09:51:18.339 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 msgr2=0x56126674f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:19.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 0x56126674f190 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f17080116c0 tx=0x7f17080047c0 comp rx=0 tx=0).stop 2023-03-17T09:51:19.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 shutdown_connections 2023-03-17T09:51:19.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:19.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266742be0 0x56126674f190 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:19.323 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x56126675cce0 0x56126675f0f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 --2- 172.21.15.35:0/1850531685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612667434f0 0x56126674c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f16f3fff700 0 client.17928 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 >> 172.21.15.35:0/1850531685 conn(0x561266739030 msgr2=0x561266738710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 shutdown_connections 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 1 -- 172.21.15.35:0/1850531685 wait complete. 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.486+0000 7f1726e33b80 20 client.17928 trim_cache size 0 max 16384 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 Processor -- start 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 -- start start 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x561266753bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:20.423 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612667434f0 0x561266738710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x56126674ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126675a490 con 0x561266747a40 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126674da10 con 0x561266742be0 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1726e33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561266743d50 con 0x5612667434f0 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1719243700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x56126674ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1719243700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x56126674ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48308/0 (socket says 172.21.15.35:48308) 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1719243700 1 -- 172.21.15.35:0/2648844148 learned_addr learned my addr 172.21.15.35:0/2648844148 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.499+0000 7f1718a42700 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x561266753bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1713fff700 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612667434f0 0x561266738710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1719243700 1 -- 172.21.15.35:0/2648844148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612667434f0 msgr2=0x561266738710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1719243700 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612667434f0 0x561266738710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1719243700 1 -- 172.21.15.35:0/2648844148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 msgr2=0x561266753bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1719243700 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x561266753bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1719243700 1 -- 172.21.15.35:0/2648844148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612667396d0 con 0x561266747a40 2023-03-17T09:51:20.424 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f1719243700 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x56126674ed30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f170c00cf90 tx=0x7f170c0060f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bde0dbe6f4e3c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f16ff7fe700 1 -- 172.21.15.35:0/2648844148 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c0077b0 con 0x561266747a40 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f16ff7fe700 1 -- 172.21.15.35:0/2648844148 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f170c02a070 con 0x561266747a40 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.500+0000 7f16ff7fe700 1 -- 172.21.15.35:0/2648844148 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c0267d0 con 0x561266747a40 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- 172.21.15.35:0/2648844148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 msgr2=0x56126674ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x56126674ed30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f170c00cf90 tx=0x7f170c0060f0 comp rx=0 tx=0).stop 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- 172.21.15.35:0/2648844148 shutdown_connections 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561266747a40 0x56126674ed30 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:20.425 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x561266753bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:21.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- 172.21.15.35:0/2648844148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612667434f0 0x561266738710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:21.264 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- 172.21.15.35:0/2648844148 >> 172.21.15.35:0/2648844148 conn(0x561266739030 msgr2=0x5612667590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:21.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- 172.21.15.35:0/2648844148 shutdown_connections 2023-03-17T09:51:21.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- 172.21.15.35:0/2648844148 wait complete. 2023-03-17T09:51:21.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- start start 2023-03-17T09:51:21.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 Processor -- start 2023-03-17T09:51:21.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x56126674bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:21.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 0x56126674c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:21.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:21.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126674b230 con 0x5612667434f0 2023-03-17T09:51:21.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126674b3a0 con 0x561266742be0 2023-03-17T09:51:21.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126674b560 con 0x561266747a40 2023-03-17T09:51:21.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:53 smithi035 ceph-mon[92535]: pgmap v1828: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2f8d71700 1 -- 172.21.15.35:0/3558035937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564dc205d80 con 0x5564dc48f900 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2f8d71700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc487eb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0077b0 tx=0x7ff2ec007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269d13320a3acd5c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2d37fe700 1 -- 172.21.15.35:0/3558035937 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec018890 con 0x5564dc48f900 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2d37fe700 1 -- 172.21.15.35:0/3558035937 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff2ec0189f0 con 0x5564dc48f900 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564dc4551e0 con 0x5564dc48f900 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2d37fe700 1 -- 172.21.15.35:0/3558035937 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2ec018bd0 con 0x5564dc48f900 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 10 client.17478 fetch_fsmap learned FSMap version 36 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5564dc22c1f0 con 0x5564dc48f900 2023-03-17T09:51:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2d37fe700 1 -- 172.21.15.35:0/3558035937 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564dc4551e0 con 0x5564dc48f900 2023-03-17T09:51:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff2d37fe700 1 -- 172.21.15.35:0/3558035937 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff2ec0173e0 con 0x5564dc48f900 2023-03-17T09:51:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 10 client.17478 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:51:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 10 client.17478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:51:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 20 client.17478 populate_metadata read hostname 'smithi035' 2023-03-17T09:51:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4ed720 0x5564dc4efb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:24.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 4 client.17478 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:51:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.568+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5564dc25bf00 con 0x5564dc4ed720 2023-03-17T09:51:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.569+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4ed720 0x5564dc4efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.569+0000 7ff2f3fff700 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4ed720 0x5564dc4efb30 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7deaff4ba71ba5 server_cookie=81cc43ff8bd9b70a in_seq=0 out_seq=0 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.569+0000 7ff2d37fe700 10 client.17478 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff2d37fe700 1 -- 172.21.15.35:0/3558035937 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5564dc25bf00 con 0x5564dc4ed720 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff2d37fe700 10 client.17478 handle_command_reply: tid=0 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 client.17478 shutdown 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 msgr2=0x5564dc487eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc487eb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0077b0 tx=0x7ff2ec007ac0 comp rx=0 tx=0).stop 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 shutdown_connections 2023-03-17T09:51:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dc4ed720 0x5564dc4efb30 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dc48f900 0x5564dc487eb0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dc489dc0 0x5564dc487430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 --2- 172.21.15.35:0/3558035937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dc48eff0 0x5564dc487970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff2d37fe700 0 client.17478 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 >> 172.21.15.35:0/3558035937 conn(0x5564dc2e26b0 msgr2=0x5564dc492300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 shutdown_connections 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 1 -- 172.21.15.35:0/3558035937 wait complete. 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.577+0000 7ff306961b80 20 client.17478 trim_cache size 0 max 16384 2023-03-17T09:51:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff2dc09f640 msgr2=0x7ff2dc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff2dc09f640 0x7ff2dc0a1af0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4197850 tx=0x7ff2e8005f50 comp rx=0 tx=0).stop 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 msgr2=0x7ff2f4196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4196240 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005f50 tx=0x7ff2e4004730 comp rx=0 tx=0).stop 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 shutdown_connections 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff2dc09f640 0x7ff2dc0a1af0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f410a7b0 0x7ff2f419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff2f4101290 0x7ff2f4196240 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 --2- 172.21.15.35:0/2120462305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f4101ba0 0x7ff2f4196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 >> 172.21.15.35:0/2120462305 conn(0x7ff2f4076330 msgr2=0x7ff2f41021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 shutdown_connections 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:28:04.578+0000 7ff2fa7d4700 1 -- 172.21.15.35:0/2120462305 wait complete. 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 -- 172.21.15.35:0/766898199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ff350 msgr2=0x7f7d040ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 --2- 172.21.15.35:0/766898199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ff350 0x7f7d040ff720 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0099c0 tx=0x7f7cec009cd0 comp rx=0 tx=0).stop 2023-03-17T09:51:27.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 -- 172.21.15.35:0/766898199 shutdown_connections 2023-03-17T09:51:27.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 --2- 172.21.15.35:0/766898199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d04104390 0x7f7d0410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 --2- 172.21.15.35:0/766898199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ff350 0x7f7d040ff720 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 --2- 172.21.15.35:0/766898199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d040ffcf0 0x7f7d04103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 -- 172.21.15.35:0/766898199 >> 172.21.15.35:0/766898199 conn(0x7f7d04076330 msgr2=0x7f7d04076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:28.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 -- 172.21.15.35:0/766898199 shutdown_connections 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.539+0000 7f7d089a2700 1 -- 172.21.15.35:0/766898199 wait complete. 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 Processor -- start 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 -- start start 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d040ff350 0x7f7d04100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 0x7f7d04101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d04104390 0x7f7d041a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04101ac0 con 0x7f7d040ffcf0 2023-03-17T09:51:28.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041a49f0 con 0x7f7d04104390 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d089a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041a4b30 con 0x7f7d040ff350 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 0x7f7d04101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 0x7f7d04101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47226/0 (socket says 172.21.15.35:47226) 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d01d9b700 1 -- 172.21.15.35:0/856538194 learned_addr learned my addr 172.21.15.35:0/856538194 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d04104390 0x7f7d041a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.540+0000 7f7d0259c700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d040ff350 0x7f7d04100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d01d9b700 1 -- 172.21.15.35:0/856538194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d040ff350 msgr2=0x7f7d04100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d040ff350 0x7f7d04100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d01d9b700 1 -- 172.21.15.35:0/856538194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d04104390 msgr2=0x7f7d041a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d04104390 0x7f7d041a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d01d9b700 1 -- 172.21.15.35:0/856538194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0095f0 con 0x7f7d040ffcf0 2023-03-17T09:51:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 0x7f7d04101290 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400d950 tx=0x7f7cf400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7cfb7fe700 1 -- 172.21.15.35:0/856538194 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400f890 con 0x7f7d040ffcf0 2023-03-17T09:51:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7cfb7fe700 1 -- 172.21.15.35:0/856538194 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cf400fe80 con 0x7f7d040ffcf0 2023-03-17T09:51:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0410f050 con 0x7f7d040ffcf0 2023-03-17T09:51:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7cfb7fe700 1 -- 172.21.15.35:0/856538194 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400e3b0 con 0x7f7d040ffcf0 2023-03-17T09:51:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.541+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0410eec0 con 0x7f7d040ffcf0 2023-03-17T09:51:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.544+0000 7f7cfb7fe700 1 -- 172.21.15.35:0/856538194 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7cf400f9f0 con 0x7f7d040ffcf0 2023-03-17T09:51:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.544+0000 7f7cfb7fe700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cf009f6c0 0x7f7cf00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.545+0000 7f7cfb7fe700 1 -- 172.21.15.35:0/856538194 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cf40ca0d0 con 0x7f7d040ffcf0 2023-03-17T09:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.545+0000 7f7d0259c700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cf009f6c0 0x7f7cf00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.545+0000 7f7d0259c700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cf009f6c0 0x7f7cf00a1b70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000c00 tx=0x7f7cec009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.545+0000 7f7d14b2fb80 1 Processor -- start 2023-03-17T09:51:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.545+0000 7f7d14b2fb80 1 -- start start 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4da0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4ca7010 con 0x5611f4da0960 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4cf9950 con 0x5611f4da5be0 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4cf2de0 con 0x5611f4da64f0 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4da0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:33.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4da0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47236/0 (socket says 172.21.15.35:47236) 2023-03-17T09:51:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 -- 172.21.15.35:0/1762197153 learned_addr learned my addr 172.21.15.35:0/1762197153 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d0259c700 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 -- 172.21.15.35:0/1762197153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 msgr2=0x5611f4da0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 -- 172.21.15.35:0/1762197153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 msgr2=0x5611f4da5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 -- 172.21.15.35:0/1762197153 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f4b745d0 con 0x5611f4da0960 2023-03-17T09:51:35.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4da0d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc003f40 tx=0x7f7cfc009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4a912f8bd9a3e0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.546+0000 7f7cf8ff9700 1 -- 172.21.15.35:0/1762197153 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc019070 con 0x5611f4da0960 2023-03-17T09:51:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7cf8ff9700 1 -- 172.21.15.35:0/1762197153 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cfc00f040 con 0x5611f4da0960 2023-03-17T09:51:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7cf8ff9700 1 -- 172.21.15.35:0/1762197153 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0079f0 con 0x5611f4da0960 2023-03-17T09:51:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1762197153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 msgr2=0x5611f4da0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4da0d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc003f40 tx=0x7f7cfc009ba0 comp rx=0 tx=0).stop 2023-03-17T09:51:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1762197153 shutdown_connections 2023-03-17T09:51:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4da0d90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1762197153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1762197153 >> 172.21.15.35:0/1762197153 conn(0x5611f4bfd6b0 msgr2=0x5611f4d9aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1762197153 shutdown_connections 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.547+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1762197153 wait complete. 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 -- start start 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 Processor -- start 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4dac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4b768c0 con 0x5611f4da0960 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4daa320 con 0x5611f4da5be0 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4daa4e0 con 0x5611f4da64f0 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d14b2fb80 10 client.0 _ll_register_callbacks cb 0x5611f4b98230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4dac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4dac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47238/0 (socket says 172.21.15.35:47238) 2023-03-17T09:51:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 -- 172.21.15.35:0/589479985 learned_addr learned my addr 172.21.15.35:0/589479985 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 -- 172.21.15.35:0/589479985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 msgr2=0x5611f4da9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 -- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 msgr2=0x5611f4da9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.548+0000 7f7d0259c700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7d0259c700 1 -- 172.21.15.35:0/589479985 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc003b70 con 0x5611f4da0960 2023-03-17T09:51:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7d0259c700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4dac390 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0099c0 tx=0x7f7cec01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e90435aa84550d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7ce9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:51:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/589479985 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec003c80 con 0x5611f4da0960 2023-03-17T09:51:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/589479985 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cec003de0 con 0x5611f4da0960 2023-03-17T09:51:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611f4cb5390 con 0x5611f4da0960 2023-03-17T09:51:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/589479985 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cec003fa0 con 0x5611f4da0960 2023-03-17T09:51:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7d14b2fb80 10 client.17490 fetch_fsmap learned FSMap version 36 2023-03-17T09:51:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5611f4b20d80 con 0x5611f4da0960 2023-03-17T09:51:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/589479985 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cec03e020 con 0x5611f4da0960 2023-03-17T09:51:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.549+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/589479985 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7cec00f460 con 0x5611f4da0960 2023-03-17T09:51:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d14b2fb80 10 client.17490 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:51:41.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d14b2fb80 10 client.17490 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:51:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d14b2fb80 20 client.17490 populate_metadata read hostname 'smithi035' 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4dba030 0x5611f4dbc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d14b2fb80 4 client.17490 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611f4cc1600 con 0x5611f4dba030 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4dba030 0x5611f4dbc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7ce9ffb700 10 client.17490 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.550+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4dba030 0x5611f4dbc440 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5262c6a25ecf71 server_cookie=64101edaac74698b in_seq=0 out_seq=0 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/589479985 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5611f4cc1600 con 0x5611f4dba030 2023-03-17T09:51:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7ce9ffb700 10 client.17490 handle_command_reply: tid=0 2023-03-17T09:51:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 client.17490 shutdown 2023-03-17T09:51:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 msgr2=0x5611f4dac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4dac390 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0099c0 tx=0x7f7cec01a050 comp rx=0 tx=0).stop 2023-03-17T09:51:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 shutdown_connections 2023-03-17T09:51:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4dba030 0x5611f4dbc440 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da64f0 0x5611f4da9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da0960 0x5611f4dac390 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:43.782 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.501+0000 7f1726e33b80 10 client.0 _ll_register_callbacks cb 0x561266743c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 0x56126674c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1718a42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x56126674bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 0x56126674c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48312/0 (socket says 172.21.15.35:48312) 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 -- 172.21.15.35:0/3446133641 learned_addr learned my addr 172.21.15.35:0/3446133641 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1719243700 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 -- 172.21.15.35:0/3446133641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 msgr2=0x56126674acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 -- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 msgr2=0x56126674bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:44.315 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x56126674bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 -- 172.21.15.35:0/3446133641 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561266512630 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1713fff700 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 0x56126674c320 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f17000944c0 tx=0x7f170009b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d832d70702be2b47 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f16f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f16f3fff700 1 -- 172.21.15.35:0/3446133641 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000a01b0 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f16f3fff700 1 -- 172.21.15.35:0/3446133641 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f170000f700 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56126670e240 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f16f3fff700 1 -- 172.21.15.35:0/3446133641 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17000946d0 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1726e33b80 10 client.17934 fetch_fsmap learned FSMap version 37 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5612664a7c60 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.502+0000 7f16f3fff700 1 -- 172.21.15.35:0/3446133641 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56126670e240 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f16f3fff700 1 -- 172.21.15.35:0/3446133641 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f17000c77e0 con 0x5612667434f0 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 10 client.17934 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 10 client.17934 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 20 client.17934 populate_metadata read hostname 'smithi035' 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5612667b19f0 0x5612667b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:44.316 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 4 client.17934 mds_command: new command op to 24431 tid=0[{"prefix": "damage ls"}] 2023-03-17T09:51:44.317 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561266514f60 con 0x5612667b19f0 2023-03-17T09:51:45.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1718a42700 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5612667b19f0 0x5612667b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:45.443 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f16f3fff700 10 client.17934 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T09:51:45.444 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1718a42700 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5612667b19f0 0x5612667b3e00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f8c4399cd237cfb1 server_cookie=248709a3a8f81c87 in_seq=0 out_seq=0 2023-03-17T09:51:45.444 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f16f3fff700 1 -- 172.21.15.35:0/3446133641 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561266514f60 con 0x5612667b19f0 2023-03-17T09:51:46.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f16f3fff700 10 client.17934 handle_command_reply: tid=0 2023-03-17T09:51:46.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.503+0000 7f1726e33b80 1 client.17934 shutdown 2023-03-17T09:51:46.548 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 msgr2=0x56126674c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:47.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 0x56126674c320 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f17000944c0 tx=0x7f170009b040 comp rx=0 tx=0).stop 2023-03-17T09:51:47.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 shutdown_connections 2023-03-17T09:51:47.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561266747a40 0x56126674acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:47.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x5612667b19f0 0x5612667b3e00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:47.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561266742be0 0x56126674bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:47.065 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 --2- 172.21.15.35:0/3446133641 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612667434f0 0x56126674c320 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:48.246 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f16f3fff700 0 client.17934 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T09:51:48.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 >> 172.21.15.35:0/3446133641 conn(0x561266739030 msgr2=0x561266738710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:48.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 shutdown_connections 2023-03-17T09:51:48.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 1 -- 172.21.15.35:0/3446133641 wait complete. 2023-03-17T09:51:48.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f1726e33b80 20 client.17934 trim_cache size 0 max 16384 2023-03-17T09:51:48.247 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f640 msgr2=0x7f17040a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:49.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f640 0x7f17040a1af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1708005950 tx=0x7f170800b410 comp rx=0 tx=0).stop 2023-03-17T09:51:49.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 msgr2=0x7f17141975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 0x7f17141975f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f170000c9b0 tx=0x7f170000ccc0 comp rx=0 tx=0).stop 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 shutdown_connections 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f170409f640 0x7f17040a1af0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17141043c0 0x7f17141a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17140ff380 0x7f17141970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 --2- 172.21.15.35:0/2024722859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f17140ffd20 0x7f17141975f0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.504+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 >> 172.21.15.35:0/2024722859 conn(0x7f1714076300 msgr2=0x7f17140fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:49.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.505+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 shutdown_connections 2023-03-17T09:51:50.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:41:00.505+0000 7f171aca6700 1 -- 172.21.15.35:0/2024722859 wait complete. 2023-03-17T09:51:50.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:55 smithi035 ceph-mon[92535]: pgmap v1829: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:51:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7ce9ffb700 0 client.17490 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/589479985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da5be0 0x5611f4da9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:50.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 >> 172.21.15.35:0/589479985 conn(0x5611f4bfd6b0 msgr2=0x5611f4d9aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 shutdown_connections 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/589479985 wait complete. 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.551+0000 7f7d14b2fb80 20 client.17490 trim_cache size 0 max 16384 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.566+0000 7f7d14b2fb80 1 Processor -- start 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.566+0000 7f7d14b2fb80 1 -- start start 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4d9aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4db0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4dabf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:50.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4d960f0 con 0x5611f4da5be0 2023-03-17T09:51:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4d9b6f0 con 0x5611f4da64f0 2023-03-17T09:51:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4d9b000 con 0x5611f4da0960 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4db0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4db0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47248/0 (socket says 172.21.15.35:47248) 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 -- 172.21.15.35:0/2658247675 learned_addr learned my addr 172.21.15.35:0/2658247675 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d0259c700 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4d9aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4dabf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 -- 172.21.15.35:0/2658247675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 msgr2=0x5611f4d9aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4d9aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 -- 172.21.15.35:0/2658247675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 msgr2=0x5611f4dabf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4dabf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 -- 172.21.15.35:0/2658247675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f4da1000 con 0x5611f4da5be0 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4dabf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4db0f70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4097820 tx=0x7f7cf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69af119022997846 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7cf97fa700 1 -- 172.21.15.35:0/2658247675 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4095d20 con 0x5611f4da5be0 2023-03-17T09:51:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7cf97fa700 1 -- 172.21.15.35:0/2658247675 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cf4095ec0 con 0x5611f4da5be0 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.567+0000 7f7cf97fa700 1 -- 172.21.15.35:0/2658247675 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4097010 con 0x5611f4da5be0 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/2658247675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 msgr2=0x5611f4db0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4db0f70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4097820 tx=0x7f7cf4000bc0 comp rx=0 tx=0).stop 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/2658247675 shutdown_connections 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4dabf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4d9aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/2658247675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4db0f70 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/2658247675 >> 172.21.15.35:0/2658247675 conn(0x5611f4bfd6b0 msgr2=0x5611f4da37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/2658247675 shutdown_connections 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/2658247675 wait complete. 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 -- start start 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.568+0000 7f7d14b2fb80 1 Processor -- start 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4da2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4da16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4da1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4da2120 con 0x5611f4da5be0 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4da2290 con 0x5611f4da64f0 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4da2450 con 0x5611f4da0960 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 10 client.0 _ll_register_callbacks cb 0x5611f4b98230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4da16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4da16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47254/0 (socket says 172.21.15.35:47254) 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 -- 172.21.15.35:0/1403027780 learned_addr learned my addr 172.21.15.35:0/1403027780 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d0259c700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4da2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d02d9d700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4da1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 -- 172.21.15.35:0/1403027780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 msgr2=0x5611f4da2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4da2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 -- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 msgr2=0x5611f4da1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4da1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 -- 172.21.15.35:0/1403027780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0410eec0 con 0x5611f4da5be0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d01d9b700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4da16a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40975f0 tx=0x7f7cf4093f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4f7020f55903e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7ce9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/1403027780 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4097210 con 0x5611f4da5be0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/1403027780 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cf4097d80 con 0x5611f4da5be0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.569+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611f4d701e0 con 0x5611f4da5be0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/1403027780 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cf4097f40 con 0x5611f4da5be0 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 10 client.17496 fetch_fsmap learned FSMap version 36 2023-03-17T09:51:53.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5611f4b09c00 con 0x5611f4da5be0 2023-03-17T09:51:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/1403027780 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5611f4d701e0 con 0x5611f4da5be0 2023-03-17T09:51:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/1403027780 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7cf40c1ba0 con 0x5611f4da5be0 2023-03-17T09:51:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 10 client.17496 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:51:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 10 client.17496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:51:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 20 client.17496 populate_metadata read hostname 'smithi035' 2023-03-17T09:51:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4e0edf0 0x5611f4e11200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 4 client.17496 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:51:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5611f4b76f00 con 0x5611f4e0edf0 2023-03-17T09:51:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.570+0000 7f7d0259c700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4e0edf0 0x5611f4e11200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.571+0000 7f7d0259c700 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4e0edf0 0x5611f4e11200 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7746b939ab65c81 server_cookie=21fd52a5f4853a80 in_seq=0 out_seq=0 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.571+0000 7f7ce9ffb700 10 client.17496 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7ce9ffb700 1 -- 172.21.15.35:0/1403027780 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5611f4b76f00 con 0x5611f4e0edf0 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7ce9ffb700 10 client.17496 handle_command_reply: tid=0 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 client.17496 shutdown 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 msgr2=0x5611f4da16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4da16a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40975f0 tx=0x7f7cf4093f10 comp rx=0 tx=0).stop 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 shutdown_connections 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5611f4e0edf0 0x5611f4e11200 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5611f4da64f0 0x5611f4da1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7ce9ffb700 0 client.17496 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:51:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611f4da0960 0x5611f4da2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 --2- 172.21.15.35:0/1403027780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5611f4da5be0 0x5611f4da16a0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 >> 172.21.15.35:0/1403027780 conn(0x5611f4bfd6b0 msgr2=0x5611f4da6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 shutdown_connections 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 1 -- 172.21.15.35:0/1403027780 wait complete. 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d14b2fb80 20 client.17496 trim_cache size 0 max 16384 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cf009f6c0 msgr2=0x7f7cf00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d089a2700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cf009f6c0 0x7f7cf00a1b70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000c00 tx=0x7f7cec009f10 comp rx=0 tx=0).stop 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 msgr2=0x7f7d04101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.579+0000 7f7d089a2700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 0x7f7d04101290 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400d950 tx=0x7f7cf400dc60 comp rx=0 tx=0).stop 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 shutdown_connections 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cf009f6c0 0x7f7cf00a1b70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d04104390 0x7f7d041a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d040ff350 0x7f7d04100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 --2- 172.21.15.35:0/856538194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d040ffcf0 0x7f7d04101290 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 >> 172.21.15.35:0/856538194 conn(0x7f7d04076330 msgr2=0x7f7d040680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 shutdown_connections 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:16.580+0000 7f7d089a2700 1 -- 172.21.15.35:0/856538194 wait complete. 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 -- 172.21.15.35:0/803585037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae600ffcf0 msgr2=0x7fae60103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 --2- 172.21.15.35:0/803585037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae600ffcf0 0x7fae60103cb0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fae480099c0 tx=0x7fae48009cd0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 -- 172.21.15.35:0/803585037 shutdown_connections 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 --2- 172.21.15.35:0/803585037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae60104390 0x7fae6010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 --2- 172.21.15.35:0/803585037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600ff350 0x7fae600ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 --2- 172.21.15.35:0/803585037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae600ffcf0 0x7fae60103cb0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 -- 172.21.15.35:0/803585037 >> 172.21.15.35:0/803585037 conn(0x7fae60076330 msgr2=0x7fae60076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 -- 172.21.15.35:0/803585037 shutdown_connections 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.702+0000 7fae662bb700 1 -- 172.21.15.35:0/803585037 wait complete. 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.703+0000 7fae662bb700 1 Processor -- start 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.703+0000 7fae662bb700 1 -- start start 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae662bb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae600ff350 0x7fae601970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae662bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600ffcf0 0x7fae601975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae662bb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 0x7fae601a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae662bb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601a2660 con 0x7fae60104390 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae662bb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601a27a0 con 0x7fae600ff350 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae662bb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601a28e0 con 0x7fae600ffcf0 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 0x7fae601a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 0x7fae601a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47270/0 (socket says 172.21.15.35:47270) 2023-03-17T09:51:56.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 -- 172.21.15.35:0/81362531 learned_addr learned my addr 172.21.15.35:0/81362531 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae5ffff700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae600ff350 0x7fae601970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600ffcf0 0x7fae601975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 -- 172.21.15.35:0/81362531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600ffcf0 msgr2=0x7fae601975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600ffcf0 0x7fae601975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 -- 172.21.15.35:0/81362531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae600ff350 msgr2=0x7fae601970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae600ff350 0x7fae601970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 -- 172.21.15.35:0/81362531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae480095f0 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae64858700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 0x7fae601a2120 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fae5800ef30 tx=0x7fae5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.704+0000 7fae5d7fa700 1 -- 172.21.15.35:0/81362531 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58018070 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.705+0000 7fae5d7fa700 1 -- 172.21.15.35:0/81362531 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae5800f040 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.705+0000 7fae5d7fa700 1 -- 172.21.15.35:0/81362531 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800cbc0 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.705+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6010efc0 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.705+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6010ee30 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.707+0000 7fae5d7fa700 1 -- 172.21.15.35:0/81362531 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fae58007500 con 0x7fae60104390 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.707+0000 7fae5d7fa700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae4c09f640 0x7fae4c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:56.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.707+0000 7fae5d7fa700 1 -- 172.21.15.35:0/81362531 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fae580ca0b0 con 0x7fae60104390 2023-03-17T09:51:56.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.707+0000 7fae5ffff700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae4c09f640 0x7fae4c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:56.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae5ffff700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae4c09f640 0x7fae4c0a1af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae50009c60 tx=0x7fae50009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae72448b80 1 Processor -- start 2023-03-17T09:51:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae72448b80 1 -- start start 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae72448b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 0x561859cfc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae72448b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cf6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae72448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf71e0 0x561859d02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.708+0000 7fae72448b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859bf9010 con 0x561859cfc040 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae72448b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859c4b950 con 0x561859cf6830 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae72448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859c44de0 con 0x561859cf71e0 2023-03-17T09:51:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 0x561859cfc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 0x561859cfc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47274/0 (socket says 172.21.15.35:47274) 2023-03-17T09:51:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 -- 172.21.15.35:0/2333157833 learned_addr learned my addr 172.21.15.35:0/2333157833 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:51:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae64858700 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf71e0 0x561859d02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cf6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 -- 172.21.15.35:0/2333157833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf71e0 msgr2=0x561859d02dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf71e0 0x561859d02dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 -- 172.21.15.35:0/2333157833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 msgr2=0x561859cf6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cf6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 -- 172.21.15.35:0/2333157833 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561859ac65d0 con 0x561859cfc040 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae5ffff700 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 0x561859cfc410 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e4e0 tx=0x7fae50014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc3baf4d941c5c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae567fc700 1 -- 172.21.15.35:0/2333157833 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000ee00 con 0x561859cfc040 2023-03-17T09:51:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae567fc700 1 -- 172.21.15.35:0/2333157833 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae50021070 con 0x561859cfc040 2023-03-17T09:51:59.886 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-03-17T09:52:00.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:57 smithi035 ceph-mon[92535]: pgmap v1830: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:52:00.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:42:59 smithi035 ceph-mon[92535]: pgmap v1831: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:52:00.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:01 smithi035 ceph-mon[92535]: pgmap v1832: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:00.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:03 smithi035 ceph-mon[92535]: pgmap v1833: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:52:00.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:05 smithi035 ceph-mon[92535]: pgmap v1834: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:52:00.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:07 smithi035 ceph-mon[92535]: pgmap v1835: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:52:00.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:09 smithi035 ceph-mon[92535]: pgmap v1836: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:52:00.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:09 smithi035 ceph-mon[92535]: osdmap e191: 12 total, 12 up, 12 in 2023-03-17T09:52:00.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:11 smithi035 ceph-mon[92535]: pgmap v1838: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:52:00.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:13 smithi035 ceph-mon[92535]: pgmap v1839: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:52:00.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:15 smithi035 ceph-mon[92535]: pgmap v1840: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:52:00.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:15 smithi035 ceph-mon[92535]: osdmap e192: 12 total, 12 up, 12 in 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:17 smithi035 ceph-mon[92535]: pgmap v1842: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:19 smithi035 ceph-mon[92535]: pgmap v1843: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:21 smithi035 ceph-mon[92535]: pgmap v1844: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:23 smithi035 ceph-mon[92535]: pgmap v1845: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:25 smithi035 ceph-mon[92535]: pgmap v1846: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:27 smithi035 ceph-mon[92535]: pgmap v1847: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:29 smithi035 ceph-mon[92535]: pgmap v1848: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:31 smithi035 ceph-mon[92535]: pgmap v1849: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:32 smithi035 ceph-mon[92535]: pgmap v1850: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:35 smithi035 ceph-mon[92535]: pgmap v1851: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:02.751 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:37 smithi035 ceph-mon[92535]: pgmap v1852: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:39 smithi035 ceph-mon[92535]: pgmap v1853: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:41 smithi035 ceph-mon[92535]: pgmap v1854: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:43 smithi035 ceph-mon[92535]: pgmap v1855: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:45 smithi035 ceph-mon[92535]: pgmap v1856: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:47 smithi035 ceph-mon[92535]: pgmap v1857: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:48 smithi035 ceph-mon[92535]: pgmap v1858: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:48 smithi035 ceph-mon[92535]: pgmap v1859: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:50 smithi035 ceph-mon[92535]: pgmap v1860: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:52 smithi035 ceph-mon[92535]: pgmap v1861: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:54 smithi035 ceph-mon[92535]: pgmap v1862: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:56 smithi035 ceph-mon[92535]: pgmap v1863: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:43:58 smithi035 ceph-mon[92535]: pgmap v1864: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:00 smithi035 ceph-mon[92535]: pgmap v1865: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T09:52:02.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:02 smithi035 ceph-mon[92535]: pgmap v1866: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:04 smithi035 ceph-mon[92535]: pgmap v1867: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:04 smithi035 ceph-mon[92535]: osdmap e193: 12 total, 12 up, 12 in 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:06 smithi035 ceph-mon[92535]: pgmap v1869: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:08 smithi035 ceph-mon[92535]: pgmap v1870: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:10 smithi035 ceph-mon[92535]: pgmap v1871: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:10 smithi035 ceph-mon[92535]: osdmap e194: 12 total, 12 up, 12 in 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:12 smithi035 ceph-mon[92535]: pgmap v1873: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:14 smithi035 ceph-mon[92535]: pgmap v1874: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1010 B/s wr, 12 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:16 smithi035 ceph-mon[92535]: pgmap v1875: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:18 smithi035 ceph-mon[92535]: pgmap v1876: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:20 smithi035 ceph-mon[92535]: pgmap v1877: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:22 smithi035 ceph-mon[92535]: pgmap v1878: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 503 B/s wr, 10 op/s 2023-03-17T09:52:02.753 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:24 smithi035 ceph-mon[92535]: pgmap v1879: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T09:52:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:52:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:52:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:52:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:52:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:52:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:52:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:52:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:52:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:52:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.709+0000 7fae567fc700 1 -- 172.21.15.35:0/2333157833 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5001d740 con 0x561859cfc040 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 -- 172.21.15.35:0/2333157833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 msgr2=0x561859cfc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 0x561859cfc410 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e4e0 tx=0x7fae50014000 comp rx=0 tx=0).stop 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 -- 172.21.15.35:0/2333157833 shutdown_connections 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf71e0 0x561859d02dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cfc040 0x561859cfc410 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 --2- 172.21.15.35:0/2333157833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cf6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 -- 172.21.15.35:0/2333157833 >> 172.21.15.35:0/2333157833 conn(0x561859b4f6b0 msgr2=0x561859ceca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 -- 172.21.15.35:0/2333157833 shutdown_connections 2023-03-17T09:52:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 -- 172.21.15.35:0/2333157833 wait complete. 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.710+0000 7fae72448b80 1 -- start start 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 Processor -- start 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 0x561859d02bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf71e0 0x561859cffe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d00390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859ac88c0 con 0x561859cf6830 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859d00b00 con 0x561859cf71e0 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859d00cc0 con 0x561859cfc040 2023-03-17T09:52:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae72448b80 10 client.0 _ll_register_callbacks cb 0x561859aea230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 0x561859d02bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 0x561859d02bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47280/0 (socket says 172.21.15.35:47280) 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae5ffff700 1 -- 172.21.15.35:0/3917379507 learned_addr learned my addr 172.21.15.35:0/3917379507 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf71e0 0x561859cffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.711+0000 7fae64858700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d00390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae5ffff700 1 -- 172.21.15.35:0/3917379507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 msgr2=0x561859d00390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d00390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae5ffff700 1 -- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf71e0 msgr2=0x561859cffe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf71e0 0x561859cffe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae5ffff700 1 -- 172.21.15.35:0/3917379507 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae50017070 con 0x561859cf6830 2023-03-17T09:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 0x561859d02bd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fae50005950 tx=0x7fae5000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a021d51b9b7815 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae3f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:52:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3917379507 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50005450 con 0x561859cf6830 2023-03-17T09:52:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3917379507 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fae500055b0 con 0x561859cf6830 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561859c07390 con 0x561859cf6830 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3917379507 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae50003680 con 0x561859cf6830 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae72448b80 10 client.17508 fetch_fsmap learned FSMap version 36 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561859a72d80 con 0x561859cf6830 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.712+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3917379507 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae5003b020 con 0x561859cf6830 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3917379507 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fae5001c890 con 0x561859cf6830 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae72448b80 10 client.17508 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:52:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae72448b80 10 client.17508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:52:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae72448b80 20 client.17508 populate_metadata read hostname 'smithi035' 2023-03-17T09:52:08.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae72448b80 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d10330 0x561859d12740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae72448b80 4 client.17508 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:52:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561859c13600 con 0x561859d10330 2023-03-17T09:52:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d10330 0x561859d12740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d10330 0x561859d12740 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c46f69c04b552b7b server_cookie=e1f7312acfa0afb4 in_seq=0 out_seq=0 2023-03-17T09:52:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.713+0000 7fae3f7fe700 10 client.17508 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3917379507 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561859c13600 con 0x561859d10330 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae3f7fe700 10 client.17508 handle_command_reply: tid=0 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 client.17508 shutdown 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 msgr2=0x561859d02bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 0x561859d02bd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fae50005950 tx=0x7fae5000ed80 comp rx=0 tx=0).stop 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 shutdown_connections 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d10330 0x561859d12740 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d00390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf6830 0x561859d02bd0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae3f7fe700 0 client.17508 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 --2- 172.21.15.35:0/3917379507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf71e0 0x561859cffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 >> 172.21.15.35:0/3917379507 conn(0x561859b4f6b0 msgr2=0x561859cf1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 shutdown_connections 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.714+0000 7fae72448b80 1 -- 172.21.15.35:0/3917379507 wait complete. 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.715+0000 7fae72448b80 20 client.17508 trim_cache size 0 max 16384 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 Processor -- start 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 -- start start 2023-03-17T09:52:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cecac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d07400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d02770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859ced050 con 0x561859cf71e0 2023-03-17T09:52:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859cf76d0 con 0x561859cf6830 2023-03-17T09:52:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae72448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859ce9610 con 0x561859cfc040 2023-03-17T09:52:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d07400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d07400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47290/0 (socket says 172.21.15.35:47290) 2023-03-17T09:52:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 -- 172.21.15.35:0/2749078548 learned_addr learned my addr 172.21.15.35:0/2749078548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae64858700 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d02770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5ffff700 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 -- 172.21.15.35:0/2749078548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 msgr2=0x561859d02770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d02770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 -- 172.21.15.35:0/2749078548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 msgr2=0x561859cecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5f7fe700 1 -- 172.21.15.35:0/2749078548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561859c0b130 con 0x561859cf71e0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.730+0000 7fae5ffff700 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d07400 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fae48009990 tx=0x7fae48005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813c65744361ffa3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae56ffd700 1 -- 172.21.15.35:0/2749078548 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48005630 con 0x561859cf71e0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae56ffd700 1 -- 172.21.15.35:0/2749078548 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae4802b070 con 0x561859cf71e0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae56ffd700 1 -- 172.21.15.35:0/2749078548 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480039c0 con 0x561859cf71e0 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 -- 172.21.15.35:0/2749078548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 msgr2=0x561859d07400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d07400 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fae48009990 tx=0x7fae48005040 comp rx=0 tx=0).stop 2023-03-17T09:52:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 -- 172.21.15.35:0/2749078548 shutdown_connections 2023-03-17T09:52:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cfc040 0x561859d02770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cf6830 0x561859cecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 --2- 172.21.15.35:0/2749078548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d07400 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 -- 172.21.15.35:0/2749078548 >> 172.21.15.35:0/2749078548 conn(0x561859b4f6b0 msgr2=0x561859cfaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 -- 172.21.15.35:0/2749078548 shutdown_connections 2023-03-17T09:52:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.731+0000 7fae72448b80 1 -- 172.21.15.35:0/2749078548 wait complete. 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 -- start start 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 Processor -- start 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf6830 0x561859d5dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d5e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cfc040 0x561859d58160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859d58740 con 0x561859cf71e0 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859d588b0 con 0x561859cfc040 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561859d58a70 con 0x561859cf6830 2023-03-17T09:52:17.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae72448b80 10 client.0 _ll_register_callbacks cb 0x561859aea230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:52:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae5f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d5e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae5f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d5e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47296/0 (socket says 172.21.15.35:47296) 2023-03-17T09:52:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae5f7fe700 1 -- 172.21.15.35:0/3724119230 learned_addr learned my addr 172.21.15.35:0/3724119230 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.732+0000 7fae64858700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cfc040 0x561859d58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf6830 0x561859d5dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5f7fe700 1 -- 172.21.15.35:0/3724119230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf6830 msgr2=0x561859d5dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf6830 0x561859d5dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5f7fe700 1 -- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cfc040 msgr2=0x561859d58160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cfc040 0x561859d58160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5f7fe700 1 -- 172.21.15.35:0/3724119230 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6010c7a0 con 0x561859cf71e0 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf6830 0x561859d5dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae5f7fe700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d5e1e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fae48009350 tx=0x7fae48005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1f345d84d36529 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae3f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:52:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3724119230 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480272f0 con 0x561859cf71e0 2023-03-17T09:52:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3724119230 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fae48027ab0 con 0x561859cf71e0 2023-03-17T09:52:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561859cc21e0 con 0x561859cf71e0 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3724119230 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae480056d0 con 0x561859cf71e0 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae72448b80 10 client.17514 fetch_fsmap learned FSMap version 36 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.733+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x561859a991f0 con 0x561859cf71e0 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3724119230 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561859cc21e0 con 0x561859cf71e0 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3724119230 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fae4800b6a0 con 0x561859cf71e0 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae72448b80 10 client.17514 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:52:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae72448b80 10 client.17514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:52:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae72448b80 20 client.17514 populate_metadata read hostname 'smithi035' 2023-03-17T09:52:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae72448b80 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d65710 0x561859d67b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae72448b80 4 client.17514 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:52:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561859ac8f00 con 0x561859d65710 2023-03-17T09:52:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.734+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d65710 0x561859d67b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.735+0000 7fae3f7fe700 10 client.17514 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.735+0000 7fae5ffff700 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d65710 0x561859d67b20 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46eaa57e92849fd server_cookie=a66b869ca0f9b6a2 in_seq=0 out_seq=0 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae3f7fe700 1 -- 172.21.15.35:0/3724119230 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561859ac8f00 con 0x561859d65710 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae3f7fe700 10 client.17514 handle_command_reply: tid=0 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 client.17514 shutdown 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 msgr2=0x561859d5e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d5e1e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fae48009350 tx=0x7fae48005430 comp rx=0 tx=0).stop 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 shutdown_connections 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561859d65710 0x561859d67b20 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561859cfc040 0x561859d58160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561859cf6830 0x561859d5dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 --2- 172.21.15.35:0/3724119230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561859cf71e0 0x561859d5e1e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae3f7fe700 0 client.17514 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 >> 172.21.15.35:0/3724119230 conn(0x561859b4f6b0 msgr2=0x561859cf1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 shutdown_connections 2023-03-17T09:52:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 1 -- 172.21.15.35:0/3724119230 wait complete. 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.739+0000 7fae72448b80 20 client.17514 trim_cache size 0 max 16384 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae4c09f640 msgr2=0x7fae4c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae4c09f640 0x7fae4c0a1af0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae50009c60 tx=0x7fae50009260 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 msgr2=0x7fae601a2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 0x7fae601a2120 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fae5800ef30 tx=0x7fae5800c3a0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 shutdown_connections 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae4c09f640 0x7fae4c0a1af0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae60104390 0x7fae601a2120 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae600ff350 0x7fae601970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 --2- 172.21.15.35:0/81362531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600ffcf0 0x7fae601975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 >> 172.21.15.35:0/81362531 conn(0x7fae60076330 msgr2=0x7fae600fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 shutdown_connections 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:29.740+0000 7fae662bb700 1 -- 172.21.15.35:0/81362531 wait complete. 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 -- 172.21.15.35:0/28314470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a600ff350 msgr2=0x7f2a600ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 --2- 172.21.15.35:0/28314470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a600ff350 0x7f2a600ff720 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0099c0 tx=0x7f2a5c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 -- 172.21.15.35:0/28314470 shutdown_connections 2023-03-17T09:52:24.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 --2- 172.21.15.35:0/28314470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a60104390 0x7f2a6010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:24.806 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:26 smithi035 ceph-mon[92535]: pgmap v1880: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:52:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 --2- 172.21.15.35:0/28314470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a600ff350 0x7f2a600ff720 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 --2- 172.21.15.35:0/28314470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a600ffcf0 0x7f2a60103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 -- 172.21.15.35:0/28314470 >> 172.21.15.35:0/28314470 conn(0x7f2a60076330 msgr2=0x7f2a60076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 -- 172.21.15.35:0/28314470 shutdown_connections 2023-03-17T09:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 -- 172.21.15.35:0/28314470 wait complete. 2023-03-17T09:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 Processor -- start 2023-03-17T09:52:25.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.862+0000 7f2a67956700 1 -- start start 2023-03-17T09:52:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a67956700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a600ff350 0x7f2a60100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a67956700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a600ffcf0 0x7f2a60101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a67956700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 0x7f2a601a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a67956700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60101b30 con 0x7f2a60104390 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a67956700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601a49b0 con 0x7f2a600ff350 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a67956700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601a4af0 con 0x7f2a600ffcf0 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 0x7f2a601a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 0x7f2a601a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47312/0 (socket says 172.21.15.35:47312) 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 -- 172.21.15.35:0/1441129858 learned_addr learned my addr 172.21.15.35:0/1441129858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a600ffcf0 0x7f2a60101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a656f2700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a600ff350 0x7f2a60100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 -- 172.21.15.35:0/1441129858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a600ffcf0 msgr2=0x7f2a60101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a600ffcf0 0x7f2a60101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 -- 172.21.15.35:0/1441129858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a600ff350 msgr2=0x7f2a60100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a600ff350 0x7f2a60100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 -- 172.21.15.35:0/1441129858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0095f0 con 0x7f2a60104390 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 0x7f2a601a4470 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2a58007f10 tx=0x7f2a5800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a567fc700 1 -- 172.21.15.35:0/1441129858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58017070 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.863+0000 7f2a567fc700 1 -- 172.21.15.35:0/1441129858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a5800f040 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.864+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6010f000 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.864+0000 7f2a567fc700 1 -- 172.21.15.35:0/1441129858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58005710 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.864+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6010ee70 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.866+0000 7f2a567fc700 1 -- 172.21.15.35:0/1441129858 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2a58004ad0 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.866+0000 7f2a567fc700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a4c09f6c0 0x7f2a4c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.866+0000 7f2a656f2700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a4c09f6c0 0x7f2a4c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.866+0000 7f2a567fc700 1 -- 172.21.15.35:0/1441129858 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2a580c9e20 con 0x7f2a60104390 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.867+0000 7f2a656f2700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a4c09f6c0 0x7f2a4c0a1b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009fd0 tx=0x7f2a5c005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.867+0000 7f2a73ae3b80 1 Processor -- start 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.867+0000 7f2a73ae3b80 1 -- start start 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef4abe0 0x55aecef4afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4b4f0 0x55aecef45420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecef45d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecee4c010 con 0x55aecef45960 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecee9e950 con 0x55aecef4b4f0 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecee97de0 con 0x55aecef4abe0 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecef45d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecef45d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47320/0 (socket says 172.21.15.35:47320) 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3180658226 learned_addr learned my addr 172.21.15.35:0/3180658226 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a656f2700 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef4abe0 0x55aecef4afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4b4f0 0x55aecef45420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3180658226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef4abe0 msgr2=0x55aecef4afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef4abe0 0x55aecef4afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3180658226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4b4f0 msgr2=0x55aecef45420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4b4f0 0x55aecef45420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3180658226 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aeced195d0 con 0x55aecef45960 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecef45d90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2a58094340 tx=0x7f2a58097280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d424d8afad8bdb53 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a4b7fe700 1 -- 172.21.15.35:0/3180658226 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58093fe0 con 0x55aecef45960 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a4b7fe700 1 -- 172.21.15.35:0/3180658226 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a58094140 con 0x55aecef45960 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.868+0000 7f2a4b7fe700 1 -- 172.21.15.35:0/3180658226 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58097d90 con 0x55aecef45960 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3180658226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 msgr2=0x55aecef45d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecef45d90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2a58094340 tx=0x7f2a58097280 comp rx=0 tx=0).stop 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3180658226 shutdown_connections 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecef45d90 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef4abe0 0x55aecef4afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3180658226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4b4f0 0x55aecef45420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3180658226 >> 172.21.15.35:0/3180658226 conn(0x55aeceda26b0 msgr2=0x55aecef3fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3180658226 shutdown_connections 2023-03-17T09:52:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.869+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3180658226 wait complete. 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 -- start start 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 Processor -- start 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 0x55aecef4eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aeced1b8c0 con 0x55aecef4b4f0 2023-03-17T09:52:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef4f610 con 0x55aecef4abe0 2023-03-17T09:52:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef5afc0 con 0x55aecef45960 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a73ae3b80 10 client.0 _ll_register_callbacks cb 0x55aeced3d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 0x55aecef4eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 0x55aecef4eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47326/0 (socket says 172.21.15.35:47326) 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a65ef3700 1 -- 172.21.15.35:0/2920095780 learned_addr learned my addr 172.21.15.35:0/2920095780 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.870+0000 7f2a656f2700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a65ef3700 1 -- 172.21.15.35:0/2920095780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 msgr2=0x55aecef514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a65ef3700 1 -- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 msgr2=0x55aecef4e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef4e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a65ef3700 1 -- 172.21.15.35:0/2920095780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6010ee70 con 0x55aecef4b4f0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 0x55aecef4eea0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2a58095c20 tx=0x7f2a58022f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de016db967931855 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:52:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2920095780 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580c7070 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2920095780 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2a58005a80 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aecee5a390 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2920095780 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a58096dc0 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a73ae3b80 10 client.17526 fetch_fsmap learned FSMap version 36 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55aececc5d80 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2920095780 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aecee5a390 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2920095780 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2a5809f750 con 0x55aecef4b4f0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.871+0000 7f2a73ae3b80 10 client.17526 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a73ae3b80 10 client.17526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a73ae3b80 20 client.17526 populate_metadata read hostname 'smithi035' 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef5ed50 0x55aecef61160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a73ae3b80 4 client.17526 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aecee66600 con 0x55aecef5ed50 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a656f2700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef5ed50 0x55aecef61160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a48ff9700 10 client.17526 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.872+0000 7f2a656f2700 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef5ed50 0x55aecef61160 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fac26f8ffb4ec2fa server_cookie=fa13e7737934d48a in_seq=0 out_seq=0 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2920095780 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55aecee66600 con 0x55aecef5ed50 2023-03-17T09:52:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a48ff9700 10 client.17526 handle_command_reply: tid=0 2023-03-17T09:52:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 client.17526 shutdown 2023-03-17T09:52:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 msgr2=0x55aecef4eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 0x55aecef4eea0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2a58095c20 tx=0x7f2a58022f50 comp rx=0 tx=0).stop 2023-03-17T09:52:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 shutdown_connections 2023-03-17T09:52:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef5ed50 0x55aecef61160 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4b4f0 0x55aecef4eea0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a48ff9700 0 client.17526 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2920095780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:33.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.873+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 >> 172.21.15.35:0/2920095780 conn(0x55aeceda26b0 msgr2=0x55aecef44410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.874+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 shutdown_connections 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.874+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2920095780 wait complete. 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.874+0000 7f2a73ae3b80 20 client.17526 trim_cache size 0 max 16384 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 Processor -- start 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 -- start start 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aeceda26b0 0x55aecef3fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef55f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 0x55aecef51110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef40000 con 0x55aecef4abe0 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef3b0d0 con 0x55aeceda26b0 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef406d0 con 0x55aecef45960 2023-03-17T09:52:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 0x55aecef51110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 0x55aecef51110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47334/0 (socket says 172.21.15.35:47334) 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3478908474 learned_addr learned my addr 172.21.15.35:0/3478908474 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef55f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a656f2700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aeceda26b0 0x55aecef3fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3478908474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 msgr2=0x55aecef55f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef55f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3478908474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aeceda26b0 msgr2=0x55aecef3fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aeceda26b0 0x55aecef3fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a65ef3700 1 -- 172.21.15.35:0/3478908474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aecee5e130 con 0x55aecef4abe0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a656f2700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aeceda26b0 0x55aecef3fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.889+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef55f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 0x55aecef51110 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800d7b0 tx=0x7f2a58097410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a52959fde84bf3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a4bfff700 1 -- 172.21.15.35:0/3478908474 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580c7040 con 0x55aecef4abe0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a4bfff700 1 -- 172.21.15.35:0/3478908474 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a58005a80 con 0x55aecef4abe0 2023-03-17T09:52:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a4bfff700 1 -- 172.21.15.35:0/3478908474 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58097d90 con 0x55aecef4abe0 2023-03-17T09:52:34.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3478908474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 msgr2=0x55aecef51110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 0x55aecef51110 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800d7b0 tx=0x7f2a58097410 comp rx=0 tx=0).stop 2023-03-17T09:52:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3478908474 shutdown_connections 2023-03-17T09:52:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef4abe0 0x55aecef51110 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aeceda26b0 0x55aecef3fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/3478908474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aecef45960 0x55aecef55f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3478908474 >> 172.21.15.35:0/3478908474 conn(0x55aecef4f010 msgr2=0x55aecef44a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3478908474 shutdown_connections 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.890+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/3478908474 wait complete. 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 -- start start 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 Processor -- start 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeceda26b0 0x55aecefabef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecefac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef53f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef54500 con 0x55aecef45960 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef54670 con 0x55aecef4abe0 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aecef54830 con 0x55aeceda26b0 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a73ae3b80 10 client.0 _ll_register_callbacks cb 0x55aeced3d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a64ef1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecefac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a64ef1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecefac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47338/0 (socket says 172.21.15.35:47338) 2023-03-17T09:52:35.616 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:28 smithi035 ceph-mon[92535]: pgmap v1881: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a64ef1700 1 -- 172.21.15.35:0/2923541488 learned_addr learned my addr 172.21.15.35:0/2923541488 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef53f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.891+0000 7f2a656f2700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeceda26b0 0x55aecefabef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a64ef1700 1 -- 172.21.15.35:0/2923541488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeceda26b0 msgr2=0x55aecefabef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeceda26b0 0x55aecefabef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a64ef1700 1 -- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 msgr2=0x55aecef53f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef53f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a64ef1700 1 -- 172.21.15.35:0/2923541488 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aececc5d80 con 0x55aecef45960 2023-03-17T09:52:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a65ef3700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef53f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a64ef1700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecefac430 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2a6006a350 tx=0x7f2a50012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312a6859e9a8edbf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2923541488 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50004230 con 0x55aecef45960 2023-03-17T09:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2923541488 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2a50004390 con 0x55aecef45960 2023-03-17T09:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aecef151e0 con 0x55aecef45960 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2923541488 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a50012e90 con 0x55aecef45960 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a73ae3b80 10 client.17532 fetch_fsmap learned FSMap version 36 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55aececec1f0 con 0x55aecef45960 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.892+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2923541488 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aecef151e0 con 0x55aecef45960 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2923541488 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2a500116d0 con 0x55aecef45960 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a73ae3b80 10 client.17532 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a73ae3b80 10 client.17532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a73ae3b80 20 client.17532 populate_metadata read hostname 'smithi035' 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef4b4f0 0x55aecefb5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:38.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a73ae3b80 4 client.17532 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aeced1bf00 con 0x55aecef4b4f0 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a656f2700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef4b4f0 0x55aecefb5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a48ff9700 10 client.17532 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.893+0000 7f2a656f2700 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef4b4f0 0x55aecefb5d50 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95571e62bff5ff6 server_cookie=aed9494fbb55a005 in_seq=0 out_seq=0 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a48ff9700 1 -- 172.21.15.35:0/2923541488 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aeced1bf00 con 0x55aecef4b4f0 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a48ff9700 10 client.17532 handle_command_reply: tid=0 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 client.17532 shutdown 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 msgr2=0x55aecefac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecefac430 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2a6006a350 tx=0x7f2a50012730 comp rx=0 tx=0).stop 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 shutdown_connections 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aecef4b4f0 0x55aecefb5d50 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aecef4abe0 0x55aecef53f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a48ff9700 0 client.17532 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aeceda26b0 0x55aecefabef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 --2- 172.21.15.35:0/2923541488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aecef45960 0x55aecefac430 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 >> 172.21.15.35:0/2923541488 conn(0x55aecef4f010 msgr2=0x55aecef510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 shutdown_connections 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 1 -- 172.21.15.35:0/2923541488 wait complete. 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.898+0000 7f2a73ae3b80 20 client.17532 trim_cache size 0 max 16384 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a4c09f6c0 msgr2=0x7f2a4c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a4c09f6c0 0x7f2a4c0a1b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009fd0 tx=0x7f2a5c005fb0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 msgr2=0x7f2a601a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 0x7f2a601a4470 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2a58007f10 tx=0x7f2a5800d3b0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 shutdown_connections 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a4c09f6c0 0x7f2a4c0a1b70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a60104390 0x7f2a601a4470 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a600ff350 0x7f2a60100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 --2- 172.21.15.35:0/1441129858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a600ffcf0 0x7f2a60101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 >> 172.21.15.35:0/1441129858 conn(0x7f2a60076330 msgr2=0x7f2a60103030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 shutdown_connections 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:42.899+0000 7f2a67956700 1 -- 172.21.15.35:0/1441129858 wait complete. 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 -- 172.21.15.35:0/2491751864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 msgr2=0x7f3278104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 --2- 172.21.15.35:0/2491751864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f3278104de0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f32740099c0 tx=0x7f3274009cd0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 -- 172.21.15.35:0/2491751864 shutdown_connections 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 --2- 172.21.15.35:0/2491751864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3278105510 0x7f327810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 --2- 172.21.15.35:0/2491751864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780fe970 0x7f32780fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 --2- 172.21.15.35:0/2491751864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f3278104de0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 -- 172.21.15.35:0/2491751864 >> 172.21.15.35:0/2491751864 conn(0x7f32780757a0 msgr2=0x7f3278075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 -- 172.21.15.35:0/2491751864 shutdown_connections 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.021+0000 7f327f6ba700 1 -- 172.21.15.35:0/2491751864 wait complete. 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 Processor -- start 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 -- start start 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780fe970 0x7f3278196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f32781967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3278105510 0x7f327819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327819b240 con 0x7f32780ff310 2023-03-17T09:52:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327819b3b0 con 0x7f3278105510 2023-03-17T09:52:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327f6ba700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327819b570 con 0x7f32780fe970 2023-03-17T09:52:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327cc55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f32781967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327cc55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f32781967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47352/0 (socket says 172.21.15.35:47352) 2023-03-17T09:52:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327cc55700 1 -- 172.21.15.35:0/1586039867 learned_addr learned my addr 172.21.15.35:0/1586039867 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327dc57700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3278105510 0x7f327819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.022+0000 7f327d456700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780fe970 0x7f3278196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327cc55700 1 -- 172.21.15.35:0/1586039867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780fe970 msgr2=0x7f3278196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327cc55700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780fe970 0x7f3278196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327cc55700 1 -- 172.21.15.35:0/1586039867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3278105510 msgr2=0x7f327819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327cc55700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3278105510 0x7f327819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327cc55700 1 -- 172.21.15.35:0/1586039867 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32740095f0 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327cc55700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f32781967a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f3274009fd0 tx=0x7f327400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f326a7fc700 1 -- 172.21.15.35:0/1586039867 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327401d070 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f326a7fc700 1 -- 172.21.15.35:0/1586039867 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32740059a0 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32781100f0 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f326a7fc700 1 -- 172.21.15.35:0/1586039867 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274022e90 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.023+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327810ff60 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.025+0000 7f326a7fc700 1 -- 172.21.15.35:0/1586039867 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3274022470 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.026+0000 7f326a7fc700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f326409f640 0x7f32640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.026+0000 7f326a7fc700 1 -- 172.21.15.35:0/1586039867 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f32740cb570 con 0x7f32780ff310 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.026+0000 7f327d456700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f326409f640 0x7f32640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.026+0000 7f327d456700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f326409f640 0x7f32640a1af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f326c005950 tx=0x7f326c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 Processor -- start 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 -- start start 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d907fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d902420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d809010 con 0x55572d902960 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d85b950 con 0x55572d9084f0 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f328b847b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d854de0 con 0x55572d907be0 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f327dc57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f327d456700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d907fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f327dc57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47362/0 (socket says 172.21.15.35:47362) 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f327dc57700 1 -- 172.21.15.35:0/3466987771 learned_addr learned my addr 172.21.15.35:0/3466987771 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.027+0000 7f327cc55700 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d902420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f327dc57700 1 -- 172.21.15.35:0/3466987771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 msgr2=0x55572d907fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f327dc57700 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d907fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f327dc57700 1 -- 172.21.15.35:0/3466987771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 msgr2=0x55572d902420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f327dc57700 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d902420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f327dc57700 1 -- 172.21.15.35:0/3466987771 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572d6d65d0 con 0x55572d902960 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f327dc57700 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902d90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3270011680 tx=0x7f3270009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f5361dfb935af3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f32637fe700 1 -- 172.21.15.35:0/3466987771 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000e040 con 0x55572d902960 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f32637fe700 1 -- 172.21.15.35:0/3466987771 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f327000f040 con 0x55572d902960 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.028+0000 7f32637fe700 1 -- 172.21.15.35:0/3466987771 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004790 con 0x55572d902960 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 -- 172.21.15.35:0/3466987771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 msgr2=0x55572d902d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902d90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f3270011680 tx=0x7f3270009920 comp rx=0 tx=0).stop 2023-03-17T09:52:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 -- 172.21.15.35:0/3466987771 shutdown_connections 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902d90 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d907fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 --2- 172.21.15.35:0/3466987771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d902420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 -- 172.21.15.35:0/3466987771 >> 172.21.15.35:0/3466987771 conn(0x55572d75f6b0 msgr2=0x55572d8fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 -- 172.21.15.35:0/3466987771 shutdown_connections 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 -- 172.21.15.35:0/3466987771 wait complete. 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 -- start start 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.029+0000 7f328b847b80 1 Processor -- start 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d90e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d90b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d90bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d6d88c0 con 0x55572d902960 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d90c1c0 con 0x55572d9084f0 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d90c380 con 0x55572d907be0 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f328b847b80 10 client.0 _ll_register_callbacks cb 0x55572d6fa230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d90e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d90e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47364/0 (socket says 172.21.15.35:47364) 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 -- 172.21.15.35:0/1423802975 learned_addr learned my addr 172.21.15.35:0/1423802975 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327cc55700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d90b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327dc57700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d90bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 -- 172.21.15.35:0/1423802975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 msgr2=0x55572d90b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d90b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 -- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 msgr2=0x55572d90bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d90bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 -- 172.21.15.35:0/1423802975 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3270011330 con 0x55572d902960 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f327d456700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d90e380 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f326c010000 tx=0x7f326c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb50b746732adb8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f3260ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f3260ff9700 1 -- 172.21.15.35:0/1423802975 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c028670 con 0x55572d902960 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.030+0000 7f3260ff9700 1 -- 172.21.15.35:0/1423802975 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f326c01f430 con 0x55572d902960 2023-03-17T09:52:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55572d817390 con 0x55572d902960 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f3260ff9700 1 -- 172.21.15.35:0/1423802975 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f326c011e70 con 0x55572d902960 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 10 client.17544 fetch_fsmap learned FSMap version 36 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55572d682d80 con 0x55572d902960 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f3260ff9700 1 -- 172.21.15.35:0/1423802975 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55572d817390 con 0x55572d902960 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f3260ff9700 1 -- 172.21.15.35:0/1423802975 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f326c01fa30 con 0x55572d902960 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 10 client.17544 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 10 client.17544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 20 client.17544 populate_metadata read hostname 'smithi035' 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d91bf90 0x55572d91e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 4 client.17544 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55572d823600 con 0x55572d91bf90 2023-03-17T09:52:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.031+0000 7f327cc55700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d91bf90 0x55572d91e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:52:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:52:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:52:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:52:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.032+0000 7f327cc55700 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d91bf90 0x55572d91e3a0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368e2da6867620e3 server_cookie=f2419f831b9bef7f in_seq=0 out_seq=0 2023-03-17T09:52:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.032+0000 7f3260ff9700 10 client.17544 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.032+0000 7f3260ff9700 1 -- 172.21.15.35:0/1423802975 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55572d823600 con 0x55572d91bf90 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.032+0000 7f3260ff9700 10 client.17544 handle_command_reply: tid=0 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 client.17544 shutdown 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 msgr2=0x55572d90e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d90e380 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f326c010000 tx=0x7f326c004750 comp rx=0 tx=0).stop 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 shutdown_connections 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d91bf90 0x55572d91e3a0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d9084f0 0x55572d90bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d90e380 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:47.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f3260ff9700 0 client.17544 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 --2- 172.21.15.35:0/1423802975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d907be0 0x55572d90b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 >> 172.21.15.35:0/1423802975 conn(0x55572d75f6b0 msgr2=0x55572d8fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 shutdown_connections 2023-03-17T09:52:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 1 -- 172.21.15.35:0/1423802975 wait complete. 2023-03-17T09:52:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.033+0000 7f328b847b80 20 client.17544 trim_cache size 0 max 16384 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 Processor -- start 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 -- start start 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d8fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d9090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d8fd710 con 0x55572d902960 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d8f80f0 con 0x55572d907be0 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f328b847b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d9196b0 con 0x55572d9084f0 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f327d456700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f327d456700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47372/0 (socket says 172.21.15.35:47372) 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f327d456700 1 -- 172.21.15.35:0/1468886872 learned_addr learned my addr 172.21.15.35:0/1468886872 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f327cc55700 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d8fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.048+0000 7f327dc57700 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d9090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f327d456700 1 -- 172.21.15.35:0/1468886872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 msgr2=0x55572d9090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f327d456700 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d9090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f327d456700 1 -- 172.21.15.35:0/1468886872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 msgr2=0x55572d8fcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f327d456700 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d8fcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f327d456700 1 -- 172.21.15.35:0/1468886872 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55572d903000 con 0x55572d902960 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f327d456700 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902420 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f326c014040 tx=0x7f326c00f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d06cfd620539967 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f3263fff700 1 -- 172.21.15.35:0/1468886872 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c011ab0 con 0x55572d902960 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f3263fff700 1 -- 172.21.15.35:0/1468886872 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f326c031510 con 0x55572d902960 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f3263fff700 1 -- 172.21.15.35:0/1468886872 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c01f980 con 0x55572d902960 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 -- 172.21.15.35:0/1468886872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 msgr2=0x55572d902420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902420 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f326c014040 tx=0x7f326c00f960 comp rx=0 tx=0).stop 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 -- 172.21.15.35:0/1468886872 shutdown_connections 2023-03-17T09:52:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d9090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d902420 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 --2- 172.21.15.35:0/1468886872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d8fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.049+0000 7f328b847b80 1 -- 172.21.15.35:0/1468886872 >> 172.21.15.35:0/1468886872 conn(0x55572d75f6b0 msgr2=0x55572d908990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 -- 172.21.15.35:0/1468886872 shutdown_connections 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 -- 172.21.15.35:0/1468886872 wait complete. 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 -- start start 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 Processor -- start 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d904ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d9036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d903be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d9050d0 con 0x55572d902960 2023-03-17T09:52:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d905240 con 0x55572d907be0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572d904120 con 0x55572d9084f0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f328b847b80 10 client.0 _ll_register_callbacks cb 0x55572d6fa230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.050+0000 7f327d456700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d904ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d904ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47378/0 (socket says 172.21.15.35:47378) 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 -- 172.21.15.35:0/1719937158 learned_addr learned my addr 172.21.15.35:0/1719937158 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327dc57700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d903be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327cc55700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d9036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 -- 172.21.15.35:0/1719937158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 msgr2=0x55572d903be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d903be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 -- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 msgr2=0x55572d9036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d9036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 -- 172.21.15.35:0/1719937158 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55572d682d80 con 0x55572d902960 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f327d456700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d904ac0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f326c03c040 tx=0x7f326c031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6f3d250e73544 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f3260ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f3260ff9700 1 -- 172.21.15.35:0/1719937158 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c005450 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f3260ff9700 1 -- 172.21.15.35:0/1719937158 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f326c0055b0 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55572d8d21e0 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f3260ff9700 1 -- 172.21.15.35:0/1719937158 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f326c011ab0 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f328b847b80 10 client.17550 fetch_fsmap learned FSMap version 36 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.051+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55572d66bc00 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f3260ff9700 1 -- 172.21.15.35:0/1719937158 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f326c050020 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f3260ff9700 1 -- 172.21.15.35:0/1719937158 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f326c004a10 con 0x55572d902960 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f328b847b80 10 client.17550 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f328b847b80 10 client.17550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f328b847b80 20 client.17550 populate_metadata read hostname 'smithi035' 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f328b847b80 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d970be0 0x55572d972ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f328b847b80 4 client.17550 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:52:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55572d6d8f00 con 0x55572d970be0 2023-03-17T09:52:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f327cc55700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d970be0 0x55572d972ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f3260ff9700 10 client.17550 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.052+0000 7f327cc55700 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d970be0 0x55572d972ff0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0466fcdff957d8d server_cookie=e270494a69f9c7cb in_seq=0 out_seq=0 2023-03-17T09:52:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f3260ff9700 1 -- 172.21.15.35:0/1719937158 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55572d6d8f00 con 0x55572d970be0 2023-03-17T09:52:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f3260ff9700 10 client.17550 handle_command_reply: tid=0 2023-03-17T09:52:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 client.17550 shutdown 2023-03-17T09:52:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 msgr2=0x55572d904ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d904ac0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f326c03c040 tx=0x7f326c031e20 comp rx=0 tx=0).stop 2023-03-17T09:52:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 shutdown_connections 2023-03-17T09:52:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55572d970be0 0x55572d972ff0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55572d9084f0 0x55572d903be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55572d902960 0x55572d904ac0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 --2- 172.21.15.35:0/1719937158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55572d907be0 0x55572d9036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f3260ff9700 0 client.17550 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 >> 172.21.15.35:0/1719937158 conn(0x55572d75f6b0 msgr2=0x55572d906690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 shutdown_connections 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 1 -- 172.21.15.35:0/1719937158 wait complete. 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f328b847b80 20 client.17550 trim_cache size 0 max 16384 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f326409f640 msgr2=0x7f32640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f327f6ba700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f326409f640 0x7f32640a1af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f326c005950 tx=0x7f326c0058e0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 msgr2=0x7f32781967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.057+0000 7f327f6ba700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f32781967a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f3274009fd0 tx=0x7f327400f690 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 shutdown_connections 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f326409f640 0x7f32640a1af0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3278105510 0x7f327819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32780fe970 0x7f3278196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 --2- 172.21.15.35:0/1586039867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32780ff310 0x7f32781967a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 >> 172.21.15.35:0/1586039867 conn(0x7f32780757a0 msgr2=0x7f32780fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 shutdown_connections 2023-03-17T09:52:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:29:56.058+0000 7f327f6ba700 1 -- 172.21.15.35:0/1586039867 wait complete. 2023-03-17T09:52:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 -- 172.21.15.35:0/3872031796 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf800ffcf0 msgr2=0x7fcf80103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3872031796 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf800ffcf0 0x7fcf80103cb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fcf700099c0 tx=0x7fcf70009cd0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 -- 172.21.15.35:0/3872031796 shutdown_connections 2023-03-17T09:52:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3872031796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf80104390 0x7fcf8010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3872031796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf800ff350 0x7fcf800ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3872031796 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf800ffcf0 0x7fcf80103cb0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 -- 172.21.15.35:0/3872031796 >> 172.21.15.35:0/3872031796 conn(0x7fcf80076330 msgr2=0x7fcf80076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:52:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 -- 172.21.15.35:0/3872031796 shutdown_connections 2023-03-17T09:52:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.180+0000 7fcf84c57700 1 -- 172.21.15.35:0/3872031796 wait complete. 2023-03-17T09:52:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 Processor -- start 2023-03-17T09:52:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 -- start start 2023-03-17T09:52:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf800ff350 0x7fcf80196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf800ffcf0 0x7fcf801967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 0x7fcf8019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019b270 con 0x7fcf80104390 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019b3e0 con 0x7fcf800ff350 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf84c57700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019b5a0 con 0x7fcf800ffcf0 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 0x7fcf8019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 0x7fcf8019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47406/0 (socket says 172.21.15.35:47406) 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 -- 172.21.15.35:0/3075010476 learned_addr learned my addr 172.21.15.35:0/3075010476 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf800ffcf0 0x7fcf801967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf800ff350 0x7fcf80196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 -- 172.21.15.35:0/3075010476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf800ffcf0 msgr2=0x7fcf801967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf800ffcf0 0x7fcf801967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 -- 172.21.15.35:0/3075010476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf800ff350 msgr2=0x7fcf80196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.181+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf800ff350 0x7fcf80196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf7ed9d700 1 -- 172.21.15.35:0/3075010476 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700095f0 con 0x7fcf80104390 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 0x7fcf8019ac30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800ada0 tx=0x7fcf7800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf777fe700 1 -- 172.21.15.35:0/3075010476 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800f070 con 0x7fcf80104390 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf777fe700 1 -- 172.21.15.35:0/3075010476 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf78007b30 con 0x7fcf80104390 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf777fe700 1 -- 172.21.15.35:0/3075010476 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78005280 con 0x7fcf80104390 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8010efc0 con 0x7fcf80104390 2023-03-17T09:52:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.182+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8010ee30 con 0x7fcf80104390 2023-03-17T09:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.184+0000 7fcf777fe700 1 -- 172.21.15.35:0/3075010476 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcf7800c8d0 con 0x7fcf80104390 2023-03-17T09:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.185+0000 7fcf777fe700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf6c09f640 0x7fcf6c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.185+0000 7fcf777fe700 1 -- 172.21.15.35:0/3075010476 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fcf780c9b70 con 0x7fcf80104390 2023-03-17T09:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.185+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf6c09f640 0x7fcf6c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.185+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf6c09f640 0x7fcf6c0a1af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf68007be0 tx=0x7fcf680073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:52:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 Processor -- start 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 -- start start 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184edd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184de4010 con 0x558184ee2be0 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184e36950 con 0x558184ee34f0 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184e2fde0 con 0x558184edd960 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf7e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:52:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf7e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47410/0 (socket says 172.21.15.35:47410) 2023-03-17T09:53:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf7e59c700 1 -- 172.21.15.35:0/1380053864 learned_addr learned my addr 172.21.15.35:0/1380053864 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184edd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:00.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:30 smithi035 ceph-mon[92535]: pgmap v1882: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:53:00.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:32 smithi035 ceph-mon[92535]: pgmap v1883: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:00.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:34 smithi035 ceph-mon[92535]: pgmap v1884: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:36 smithi035 ceph-mon[92535]: pgmap v1885: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:38 smithi035 ceph-mon[92535]: pgmap v1886: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:40 smithi035 ceph-mon[92535]: pgmap v1887: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:42 smithi035 ceph-mon[92535]: pgmap v1888: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:44 smithi035 ceph-mon[92535]: pgmap v1889: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:46 smithi035 ceph-mon[92535]: pgmap v1890: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:48 smithi035 ceph-mon[92535]: pgmap v1891: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:48 smithi035 ceph-mon[92535]: pgmap v1892: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:48 smithi035 ceph-mon[92535]: pgmap v1893: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:49 smithi035 ceph-mon[92535]: pgmap v1894: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:52 smithi035 ceph-mon[92535]: pgmap v1895: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:53:00.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:54 smithi035 ceph-mon[92535]: pgmap v1896: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:53:00.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:56 smithi035 ceph-mon[92535]: pgmap v1897: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-17T09:53:01.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:44:58 smithi035 ceph-mon[92535]: pgmap v1898: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:53:01.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:00 smithi035 ceph-mon[92535]: pgmap v1899: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:01.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:02 smithi035 ceph-mon[92535]: pgmap v1900: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:01.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:04 smithi035 ceph-mon[92535]: pgmap v1901: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:53:01.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:06 smithi035 ceph-mon[92535]: pgmap v1902: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:53:01.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:08 smithi035 ceph-mon[92535]: pgmap v1903: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:53:01.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:09 smithi035 ceph-mon[92535]: osdmap e195: 12 total, 12 up, 12 in 2023-03-17T09:53:01.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:10 smithi035 ceph-mon[92535]: pgmap v1905: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:53:01.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:12 smithi035 ceph-mon[92535]: pgmap v1906: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:53:01.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:14 smithi035 ceph-mon[92535]: pgmap v1907: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:53:02.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:16 smithi035 ceph-mon[92535]: pgmap v1908: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:53:02.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:16 smithi035 ceph-mon[92535]: osdmap e196: 12 total, 12 up, 12 in 2023-03-17T09:53:02.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:18 smithi035 ceph-mon[92535]: pgmap v1910: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T09:53:02.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:20 smithi035 ceph-mon[92535]: pgmap v1911: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:22 smithi035 ceph-mon[92535]: pgmap v1912: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:24 smithi035 ceph-mon[92535]: pgmap v1913: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:26 smithi035 ceph-mon[92535]: pgmap v1914: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:28 smithi035 ceph-mon[92535]: pgmap v1915: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:30 smithi035 ceph-mon[92535]: pgmap v1916: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:32 smithi035 ceph-mon[92535]: pgmap v1917: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:34 smithi035 ceph-mon[92535]: pgmap v1918: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:36 smithi035 ceph-mon[92535]: pgmap v1919: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:38 smithi035 ceph-mon[92535]: pgmap v1920: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:40 smithi035 ceph-mon[92535]: pgmap v1921: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:42 smithi035 ceph-mon[92535]: pgmap v1922: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:03.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:44 smithi035 ceph-mon[92535]: pgmap v1923: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:53:06.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:46 smithi035 ceph-mon[92535]: pgmap v1924: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:53:06.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:48 smithi035 ceph-mon[92535]: pgmap v1925: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:53:06.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:53:06.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:53:06.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:53:06.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:53:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.186+0000 7fcf7e59c700 1 -- 172.21.15.35:0/1380053864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 msgr2=0x558184eddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eddd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf7e59c700 1 -- 172.21.15.35:0/1380053864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 msgr2=0x558184edd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184edd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf7e59c700 1 -- 172.21.15.35:0/1380053864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558184cb15d0 con 0x558184ee2be0 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee2fb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcf68010e80 tx=0x7fcf68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a49af41edfd2459 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf74ff9700 1 -- 172.21.15.35:0/1380053864 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68010eb0 con 0x558184ee2be0 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf74ff9700 1 -- 172.21.15.35:0/1380053864 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf68003b10 con 0x558184ee2be0 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.187+0000 7fcf74ff9700 1 -- 172.21.15.35:0/1380053864 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68011af0 con 0x558184ee2be0 2023-03-17T09:53:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- 172.21.15.35:0/1380053864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 msgr2=0x558184ee2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee2fb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcf68010e80 tx=0x7fcf68013000 comp rx=0 tx=0).stop 2023-03-17T09:53:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- 172.21.15.35:0/1380053864 shutdown_connections 2023-03-17T09:53:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee2fb0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/1380053864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184edd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- 172.21.15.35:0/1380053864 >> 172.21.15.35:0/1380053864 conn(0x558184d3a6b0 msgr2=0x558184ed7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- 172.21.15.35:0/1380053864 shutdown_connections 2023-03-17T09:53:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- 172.21.15.35:0/1380053864 wait complete. 2023-03-17T09:53:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- start start 2023-03-17T09:53:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 Processor -- start 2023-03-17T09:53:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ee9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184cb38c0 con 0x558184ee2be0 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184ee7560 con 0x558184edd960 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184ef3000 con 0x558184ee34f0 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.188+0000 7fcf90de4b80 10 client.0 _ll_register_callbacks cb 0x558184cd5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47418/0 (socket says 172.21.15.35:47418) 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2143548053 learned_addr learned my addr 172.21.15.35:0/2143548053 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ee9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2143548053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 msgr2=0x558184ee6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 msgr2=0x558184ee9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ee9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2143548053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf68010b60 con 0x558184ee2be0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee6730 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fcf801000c0 tx=0x7fcf70005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e3b0855727bc62 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf65ffb700 1 -- 172.21.15.35:0/2143548053 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7001d070 con 0x558184ee2be0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf65ffb700 1 -- 172.21.15.35:0/2143548053 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fcf7000bd60 con 0x558184ee2be0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558184df2390 con 0x558184ee2be0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf65ffb700 1 -- 172.21.15.35:0/2143548053 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf70004500 con 0x558184ee2be0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf90de4b80 10 client.17562 fetch_fsmap learned FSMap version 36 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.189+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x558184c5dd80 con 0x558184ee2be0 2023-03-17T09:53:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf65ffb700 1 -- 172.21.15.35:0/2143548053 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558184df2390 con 0x558184ee2be0 2023-03-17T09:53:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf65ffb700 1 -- 172.21.15.35:0/2143548053 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcf70033040 con 0x558184ee2be0 2023-03-17T09:53:14.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf90de4b80 10 client.17562 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:53:14.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf90de4b80 10 client.17562 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:53:14.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf90de4b80 20 client.17562 populate_metadata read hostname 'smithi035' 2023-03-17T09:53:14.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184ef9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:14.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf90de4b80 4 client.17562 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:53:14.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558184dfe600 con 0x558184ef7150 2023-03-17T09:53:14.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.190+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184ef9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:14.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf65ffb700 10 client.17562 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:14.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184ef9560 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b211f54cac9d22 server_cookie=e0482969c210ad30 in_seq=0 out_seq=0 2023-03-17T09:53:14.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf65ffb700 1 -- 172.21.15.35:0/2143548053 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558184dfe600 con 0x558184ef7150 2023-03-17T09:53:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf65ffb700 10 client.17562 handle_command_reply: tid=0 2023-03-17T09:53:15.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 client.17562 shutdown 2023-03-17T09:53:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 msgr2=0x558184ee6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee6730 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fcf801000c0 tx=0x7fcf70005bc0 comp rx=0 tx=0).stop 2023-03-17T09:53:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 shutdown_connections 2023-03-17T09:53:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184ef9560 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:15.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf65ffb700 0 client.17562 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ee9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2143548053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184ee6730 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 >> 172.21.15.35:0/2143548053 conn(0x558184d3a6b0 msgr2=0x558184edc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 shutdown_connections 2023-03-17T09:53:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.191+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2143548053 wait complete. 2023-03-17T09:53:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.192+0000 7fcf90de4b80 20 client.17562 trim_cache size 0 max 16384 2023-03-17T09:53:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 Processor -- start 2023-03-17T09:53:17.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 -- start start 2023-03-17T09:53:17.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ed7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:17.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eedf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:17.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:17.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184ed30f0 con 0x558184ee2be0 2023-03-17T09:53:17.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184ed8000 con 0x558184edd960 2023-03-17T09:53:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184edd7a0 con 0x558184ee34f0 2023-03-17T09:53:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eedf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eedf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47424/0 (socket says 172.21.15.35:47424) 2023-03-17T09:53:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2063270499 learned_addr learned my addr 172.21.15.35:0/2063270499 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ed7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.209+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2063270499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 msgr2=0x558184ee9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2063270499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 msgr2=0x558184ed7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ed7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/2063270499 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558184df6130 con 0x558184ee2be0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eedf50 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d10 tx=0x7fcf700059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3e6a7eee8c960b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf757fa700 1 -- 172.21.15.35:0/2063270499 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7001d040 con 0x558184ee2be0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf757fa700 1 -- 172.21.15.35:0/2063270499 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf7001e040 con 0x558184ee2be0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.210+0000 7fcf757fa700 1 -- 172.21.15.35:0/2063270499 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70003820 con 0x558184ee2be0 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2063270499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 msgr2=0x558184eedf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eedf50 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d10 tx=0x7fcf700059b0 comp rx=0 tx=0).stop 2023-03-17T09:53:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2063270499 shutdown_connections 2023-03-17T09:53:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184ee34f0 0x558184ee9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184edd960 0x558184ed7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/2063270499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eedf50 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2063270499 >> 172.21.15.35:0/2063270499 conn(0x558184d3a6b0 msgr2=0x558184edca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2063270499 shutdown_connections 2023-03-17T09:53:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- 172.21.15.35:0/2063270499 wait complete. 2023-03-17T09:53:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- start start 2023-03-17T09:53:20.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 Processor -- start 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eeded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184eebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184eec640 con 0x558184ee2be0 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eeded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184eec7b0 con 0x558184ee34f0 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558184eec970 con 0x558184edd960 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eeded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47430/0 (socket says 172.21.15.35:47430) 2023-03-17T09:53:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/4044065458 learned_addr learned my addr 172.21.15.35:0/4044065458 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf90de4b80 10 client.0 _ll_register_callbacks cb 0x558184cd5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf7ed9d700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184eebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.211+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/4044065458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 msgr2=0x558184eed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 msgr2=0x558184eebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184eebf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf7dd9b700 1 -- 172.21.15.35:0/4044065458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558184c5dd80 con 0x558184ee2be0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf7dd9b700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eeded0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcf700036c0 tx=0x7fcf70009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44309bbb15bf0199 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf65ffb700 1 -- 172.21.15.35:0/4044065458 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7001d070 con 0x558184ee2be0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558184ead1e0 con 0x558184ee2be0 2023-03-17T09:53:21.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf65ffb700 1 -- 172.21.15.35:0/4044065458 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fcf70004500 con 0x558184ee2be0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf65ffb700 1 -- 172.21.15.35:0/4044065458 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf700046c0 con 0x558184ee2be0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf90de4b80 10 client.17568 fetch_fsmap learned FSMap version 36 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x558184c841f0 con 0x558184ee2be0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.212+0000 7fcf65ffb700 1 -- 172.21.15.35:0/4044065458 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558184ead1e0 con 0x558184ee2be0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf65ffb700 1 -- 172.21.15.35:0/4044065458 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcf70003f70 con 0x558184ee2be0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf90de4b80 10 client.17568 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf90de4b80 10 client.17568 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf90de4b80 20 client.17568 populate_metadata read hostname 'smithi035' 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184f06970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf90de4b80 4 client.17568 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558184cb3f00 con 0x558184ef7150 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184f06970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf7e59c700 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184f06970 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e0737a75fbcc5a server_cookie=c0d2a82d88f73bee in_seq=0 out_seq=0 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.213+0000 7fcf65ffb700 10 client.17568 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf65ffb700 1 -- 172.21.15.35:0/4044065458 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558184cb3f00 con 0x558184ef7150 2023-03-17T09:53:21.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf65ffb700 10 client.17568 handle_command_reply: tid=0 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 client.17568 shutdown 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 msgr2=0x558184eeded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eeded0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcf700036c0 tx=0x7fcf70009580 comp rx=0 tx=0).stop 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 shutdown_connections 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558184ef7150 0x558184f06970 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558184ee34f0 0x558184eebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558184edd960 0x558184eed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 --2- 172.21.15.35:0/4044065458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558184ee2be0 0x558184eeded0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf65ffb700 0 client.17568 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 >> 172.21.15.35:0/4044065458 conn(0x558184d3a6b0 msgr2=0x558184ee06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 shutdown_connections 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 1 -- 172.21.15.35:0/4044065458 wait complete. 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.229+0000 7fcf90de4b80 20 client.17568 trim_cache size 0 max 16384 2023-03-17T09:53:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf6c09f640 msgr2=0x7fcf6c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf6c09f640 0x7fcf6c0a1af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf68007be0 tx=0x7fcf680073d0 comp rx=0 tx=0).stop 2023-03-17T09:53:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 msgr2=0x7fcf8019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 0x7fcf8019ac30 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800ada0 tx=0x7fcf7800c330 comp rx=0 tx=0).stop 2023-03-17T09:53:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 shutdown_connections 2023-03-17T09:53:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf6c09f640 0x7fcf6c0a1af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcf80104390 0x7fcf8019ac30 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf800ff350 0x7fcf80196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:24.291 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:49 smithi035 ceph-mon[92535]: pgmap v1926: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T09:53:26.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:49 smithi035 ceph-mon[92535]: pgmap v1927: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:53:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 --2- 172.21.15.35:0/3075010476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf800ffcf0 0x7fcf801967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 >> 172.21.15.35:0/3075010476 conn(0x7fcf80076330 msgr2=0x7fcf80068120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 shutdown_connections 2023-03-17T09:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:30:09.230+0000 7fcf84c57700 1 -- 172.21.15.35:0/3075010476 wait complete. 2023-03-17T09:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 -- 172.21.15.35:0/122442012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac104390 msgr2=0x7f5fac10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/122442012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac104390 0x7f5fac10bf60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b0d0 tx=0x7f5fa400b3e0 comp rx=0 tx=0).stop 2023-03-17T09:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 -- 172.21.15.35:0/122442012 shutdown_connections 2023-03-17T09:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/122442012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac104390 0x7f5fac10bf60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/122442012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ff350 0x7f5fac0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/122442012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fac0ffcf0 0x7f5fac103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 -- 172.21.15.35:0/122442012 >> 172.21.15.35:0/122442012 conn(0x7f5fac076330 msgr2=0x7f5fac076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 -- 172.21.15.35:0/122442012 shutdown_connections 2023-03-17T09:53:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 -- 172.21.15.35:0/122442012 wait complete. 2023-03-17T09:53:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 Processor -- start 2023-03-17T09:53:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.119+0000 7f5fb30e9700 1 -- start start 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 0x7f5fac100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ffcf0 0x7f5fac101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fac104390 0x7f5fac1a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac101ac0 con 0x7f5fac0ff350 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1a4b30 con 0x7f5fac0ffcf0 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1a4c70 con 0x7f5fac104390 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 0x7f5fac100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 0x7f5fac100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47468/0 (socket says 172.21.15.35:47468) 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 -- 172.21.15.35:0/2896941742 learned_addr learned my addr 172.21.15.35:0/2896941742 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb1686700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fac104390 0x7f5fac1a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fabfff700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ffcf0 0x7f5fac101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 -- 172.21.15.35:0/2896941742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fac104390 msgr2=0x7f5fac1a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fac104390 0x7f5fac1a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 -- 172.21.15.35:0/2896941742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ffcf0 msgr2=0x7f5fac101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ffcf0 0x7f5fac101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 -- 172.21.15.35:0/2896941742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009d00 con 0x7f5fac0ff350 2023-03-17T09:53:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 0x7f5fac100d50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000e9a0 tx=0x7f5fa000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fa9ffb700 1 -- 172.21.15.35:0/2896941742 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0009790 con 0x7f5fac0ff350 2023-03-17T09:53:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fa9ffb700 1 -- 172.21.15.35:0/2896941742 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa000cbd0 con 0x7f5fac0ff350 2023-03-17T09:53:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fa9ffb700 1 -- 172.21.15.35:0/2896941742 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0018680 con 0x7f5fac0ff350 2023-03-17T09:53:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.120+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac10efc0 con 0x7f5fac0ff350 2023-03-17T09:53:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.121+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac10ee30 con 0x7f5fac0ff350 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.123+0000 7f5fa9ffb700 1 -- 172.21.15.35:0/2896941742 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5fa000cd40 con 0x7f5fac0ff350 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.124+0000 7f5fa9ffb700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f9c09f640 0x7f5f9c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.124+0000 7f5fa9ffb700 1 -- 172.21.15.35:0/2896941742 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5fa0014070 con 0x7f5fac0ff350 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.124+0000 7f5fabfff700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f9c09f640 0x7f5f9c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 Processor -- start 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fabfff700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f9c09f640 0x7f5f9c0a1af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5fac102540 tx=0x7f5f98009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 -- start start 2023-03-17T09:53:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebe9dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebe98420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe98960 0x55a5ebe98d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebd9f010 con 0x55a5ebe9dbe0 2023-03-17T09:53:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebdf1950 con 0x55a5ebe9e4f0 2023-03-17T09:53:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebdeade0 con 0x55a5ebe98960 2023-03-17T09:53:33.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebe9dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:33.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebe9dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47476/0 (socket says 172.21.15.35:47476) 2023-03-17T09:53:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 -- 172.21.15.35:0/3347032411 learned_addr learned my addr 172.21.15.35:0/3347032411 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fabfff700 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebe98420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb1686700 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe98960 0x55a5ebe98d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 -- 172.21.15.35:0/3347032411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe98960 msgr2=0x55a5ebe98d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe98960 0x55a5ebe98d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 -- 172.21.15.35:0/3347032411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 msgr2=0x55a5ebe98420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebe98420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fb0e85700 1 -- 172.21.15.35:0/3347032411 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5ebc6c5d0 con 0x55a5ebe9dbe0 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.125+0000 7f5fabfff700 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebe98420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.126+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebe9dfb0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00a0130 tx=0x7f5fa00980d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2464abef8915ea5c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.126+0000 7f5f96ffd700 1 -- 172.21.15.35:0/3347032411 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00af070 con 0x55a5ebe9dbe0 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.126+0000 7f5f96ffd700 1 -- 172.21.15.35:0/3347032411 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa00a0660 con 0x55a5ebe9dbe0 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.126+0000 7f5f96ffd700 1 -- 172.21.15.35:0/3347032411 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00989a0 con 0x55a5ebe9dbe0 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.126+0000 7f5fbf276b80 1 -- 172.21.15.35:0/3347032411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 msgr2=0x55a5ebe9dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.126+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebe9dfb0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00a0130 tx=0x7f5fa00980d0 comp rx=0 tx=0).stop 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 -- 172.21.15.35:0/3347032411 shutdown_connections 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe98960 0x55a5ebe98d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebe9dfb0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/3347032411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebe98420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 -- 172.21.15.35:0/3347032411 >> 172.21.15.35:0/3347032411 conn(0x55a5ebcf56b0 msgr2=0x55a5ebe92a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 -- 172.21.15.35:0/3347032411 shutdown_connections 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 -- 172.21.15.35:0/3347032411 wait complete. 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 -- start start 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.127+0000 7f5fbf276b80 1 Processor -- start 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebc6e8c0 con 0x55a5ebe9dbe0 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebea2590 con 0x55a5ebe98960 2023-03-17T09:53:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebeae000 con 0x55a5ebe9e4f0 2023-03-17T09:53:37.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fbf276b80 10 client.0 _ll_register_callbacks cb 0x55a5ebc90230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:53:37.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47484/0 (socket says 172.21.15.35:47484) 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 -- 172.21.15.35:0/1879744515 learned_addr learned my addr 172.21.15.35:0/1879744515 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fb1686700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 -- 172.21.15.35:0/1879744515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 msgr2=0x55a5ebea1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 -- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 msgr2=0x55a5ebea4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 -- 172.21.15.35:0/1879744515 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac10ee30 con 0x55a5ebe9dbe0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5fabfff700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea1780 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5f98011790 tx=0x7f5f980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2c1972b5c592cb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.128+0000 7f5f8bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5f8bfff700 1 -- 172.21.15.35:0/1879744515 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9801f840 con 0x55a5ebe9dbe0 2023-03-17T09:53:37.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5ebdad390 con 0x55a5ebe9dbe0 2023-03-17T09:53:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5f8bfff700 1 -- 172.21.15.35:0/1879744515 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f98017070 con 0x55a5ebe9dbe0 2023-03-17T09:53:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5f8bfff700 1 -- 172.21.15.35:0/1879744515 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f9801f9a0 con 0x55a5ebe9dbe0 2023-03-17T09:53:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 10 client.17580 fetch_fsmap learned FSMap version 36 2023-03-17T09:53:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a5ebc18d80 con 0x55a5ebe9dbe0 2023-03-17T09:53:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5f8bfff700 1 -- 172.21.15.35:0/1879744515 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a5ebdad390 con 0x55a5ebe9dbe0 2023-03-17T09:53:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5f8bfff700 1 -- 172.21.15.35:0/1879744515 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f98028b20 con 0x55a5ebe9dbe0 2023-03-17T09:53:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 10 client.17580 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:53:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 10 client.17580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:53:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 20 client.17580 populate_metadata read hostname 'smithi035' 2023-03-17T09:53:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebeb2150 0x55a5ebeb4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 4 client.17580 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:53:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5ebdb9600 con 0x55a5ebeb2150 2023-03-17T09:53:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.129+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebeb2150 0x55a5ebeb4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.130+0000 7f5f8bfff700 10 client.17580 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.130+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebeb2150 0x55a5ebeb4560 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ac196a7ec22760 server_cookie=b95eb07e89b28b66 in_seq=0 out_seq=0 2023-03-17T09:53:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.130+0000 7f5f8bfff700 1 -- 172.21.15.35:0/1879744515 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a5ebdb9600 con 0x55a5ebeb2150 2023-03-17T09:53:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5f8bfff700 10 client.17580 handle_command_reply: tid=0 2023-03-17T09:53:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 client.17580 shutdown 2023-03-17T09:53:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 msgr2=0x55a5ebea1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea1780 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f5f98011790 tx=0x7f5f980047c0 comp rx=0 tx=0).stop 2023-03-17T09:53:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 shutdown_connections 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebeb2150 0x55a5ebeb4560 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5f8bfff700 0 client.17580 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1879744515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea1780 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 >> 172.21.15.35:0/1879744515 conn(0x55a5ebcf56b0 msgr2=0x55a5ebe97410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 shutdown_connections 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1879744515 wait complete. 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.131+0000 7f5fbf276b80 20 client.17580 trim_cache size 0 max 16384 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 Processor -- start 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 -- start start 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebe8e0f0 con 0x55a5ebe9dbe0 2023-03-17T09:53:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebeaf850 con 0x55a5ebe98960 2023-03-17T09:53:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebeaeb20 con 0x55a5ebe9e4f0 2023-03-17T09:53:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fabfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47492/0 (socket says 172.21.15.35:47492) 2023-03-17T09:53:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fabfff700 1 -- 172.21.15.35:0/1313581847 learned_addr learned my addr 172.21.15.35:0/1313581847 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.146+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fb1686700 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fabfff700 1 -- 172.21.15.35:0/1313581847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 msgr2=0x55a5ebea0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fabfff700 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fabfff700 1 -- 172.21.15.35:0/1313581847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 msgr2=0x55a5ebea8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fabfff700 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fabfff700 1 -- 172.21.15.35:0/1313581847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5ebdb1130 con 0x55a5ebe9dbe0 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fb1686700 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5fabfff700 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea4030 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f5f98000c00 tx=0x7f5f98009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10064ff1dcf1595 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5f977fe700 1 -- 172.21.15.35:0/1313581847 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9801e500 con 0x55a5ebe9dbe0 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5f977fe700 1 -- 172.21.15.35:0/1313581847 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f98015070 con 0x55a5ebe9dbe0 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.147+0000 7f5f977fe700 1 -- 172.21.15.35:0/1313581847 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9801f950 con 0x55a5ebe9dbe0 2023-03-17T09:53:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1313581847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 msgr2=0x55a5ebea4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea4030 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f5f98000c00 tx=0x7f5f98009370 comp rx=0 tx=0).stop 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1313581847 shutdown_connections 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe98960 0x55a5ebea8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/1313581847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea4030 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1313581847 >> 172.21.15.35:0/1313581847 conn(0x55a5ebcf56b0 msgr2=0x55a5ebeae410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1313581847 shutdown_connections 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 -- 172.21.15.35:0/1313581847 wait complete. 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 -- start start 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.148+0000 7f5fbf276b80 1 Processor -- start 2023-03-17T09:53:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 0x55a5ebea8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:46.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:51 smithi035 ceph-mon[92535]: pgmap v1928: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:53:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebea7f90 con 0x55a5ebe98960 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebea8100 con 0x55a5ebe9e4f0 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ebf06000 con 0x55a5ebe9dbe0 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 10 client.0 _ll_register_callbacks cb 0x55a5ebc90230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 0x55a5ebea8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 0x55a5ebea8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47496/0 (socket says 172.21.15.35:47496) 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 -- 172.21.15.35:0/4244236258 learned_addr learned my addr 172.21.15.35:0/4244236258 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fabfff700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb1686700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 -- 172.21.15.35:0/4244236258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9dbe0 msgr2=0x55a5ebea7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 -- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 msgr2=0x55a5ebea78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:53:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 -- 172.21.15.35:0/4244236258 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5ebc18d80 con 0x55a5ebe98960 2023-03-17T09:53:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fabfff700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fb0e85700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 0x55a5ebea8fa0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c5b0 tx=0x7f5fa000efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f434dff525e6e873 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5f8bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5f8bfff700 1 -- 172.21.15.35:0/4244236258 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00af040 con 0x55a5ebe98960 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5f8bfff700 1 -- 172.21.15.35:0/4244236258 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5fa009c270 con 0x55a5ebe98960 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5ebe681e0 con 0x55a5ebe98960 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5f8bfff700 1 -- 172.21.15.35:0/4244236258 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa0097b60 con 0x55a5ebe98960 2023-03-17T09:53:48.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 10 client.17586 fetch_fsmap learned FSMap version 36 2023-03-17T09:53:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.149+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55a5ebc3f1f0 con 0x55a5ebe98960 2023-03-17T09:53:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5f8bfff700 1 -- 172.21.15.35:0/4244236258 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a5ebe681e0 con 0x55a5ebe98960 2023-03-17T09:53:49.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5f8bfff700 1 -- 172.21.15.35:0/4244236258 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5fa00a01d0 con 0x55a5ebe98960 2023-03-17T09:53:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fbf276b80 10 client.17586 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:53:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fbf276b80 10 client.17586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fbf276b80 20 client.17586 populate_metadata read hostname 'smithi035' 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebf07070 0x55a5ebf09450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fbf276b80 4 client.17586 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a5ebc6ef00 con 0x55a5ebf07070 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fabfff700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebf07070 0x55a5ebf09450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5f8bfff700 10 client.17586 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.150+0000 7f5fabfff700 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebf07070 0x55a5ebf09450 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80fc84ef010709f0 server_cookie=2935d0b1f35a1706 in_seq=0 out_seq=0 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5f8bfff700 1 -- 172.21.15.35:0/4244236258 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a5ebc6ef00 con 0x55a5ebf07070 2023-03-17T09:53:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5f8bfff700 10 client.17586 handle_command_reply: tid=0 2023-03-17T09:53:52.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 client.17586 shutdown 2023-03-17T09:53:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 msgr2=0x55a5ebea8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 0x55a5ebea8fa0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c5b0 tx=0x7f5fa000efa0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 shutdown_connections 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a5ebf07070 0x55a5ebf09450 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5ebe9e4f0 0x55a5ebea78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5f8bfff700 0 client.17586 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a5ebe98960 0x55a5ebea8fa0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 --2- 172.21.15.35:0/4244236258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ebe9dbe0 0x55a5ebea7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.159+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 >> 172.21.15.35:0/4244236258 conn(0x55a5ebcf56b0 msgr2=0x55a5ebe9b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 shutdown_connections 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fbf276b80 1 -- 172.21.15.35:0/4244236258 wait complete. 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fbf276b80 20 client.17586 trim_cache size 0 max 16384 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f9c09f640 msgr2=0x7f5f9c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f9c09f640 0x7f5f9c0a1af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5fac102540 tx=0x7f5f98009260 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 msgr2=0x7f5fac100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 0x7f5fac100d50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000e9a0 tx=0x7f5fa000ecb0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 shutdown_connections 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f9c09f640 0x7f5f9c0a1af0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fac104390 0x7f5fac1a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fac0ff350 0x7f5fac100d50 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 --2- 172.21.15.35:0/2896941742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fac0ffcf0 0x7f5fac101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 >> 172.21.15.35:0/2896941742 conn(0x7f5fac076330 msgr2=0x7f5fac068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 shutdown_connections 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:41.160+0000 7f5fb30e9700 1 -- 172.21.15.35:0/2896941742 wait complete. 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.282+0000 7f78dec3e700 1 -- 172.21.15.35:0/1409650479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d8104390 msgr2=0x7f78d810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.282+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1409650479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d8104390 0x7f78d810bf60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f78d000b0d0 tx=0x7f78d000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 -- 172.21.15.35:0/1409650479 shutdown_connections 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1409650479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d8104390 0x7f78d810bf60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1409650479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d80ff350 0x7f78d80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1409650479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d80ffcf0 0x7f78d8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 -- 172.21.15.35:0/1409650479 >> 172.21.15.35:0/1409650479 conn(0x7f78d8076330 msgr2=0x7f78d8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 -- 172.21.15.35:0/1409650479 shutdown_connections 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 -- 172.21.15.35:0/1409650479 wait complete. 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 Processor -- start 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.283+0000 7f78dec3e700 1 -- start start 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 0x7f78d8100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d80ffcf0 0x7f78d8101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d8104390 0x7f78d81a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:53:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8101ac0 con 0x7f78d80ff350 2023-03-17T09:53:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81a4a00 con 0x7f78d8104390 2023-03-17T09:53:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81a4b40 con 0x7f78d80ffcf0 2023-03-17T09:53:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 0x7f78d8100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:53:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 0x7f78d8100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47510/0 (socket says 172.21.15.35:47510) 2023-03-17T09:53:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 -- 172.21.15.35:0/1313342156 learned_addr learned my addr 172.21.15.35:0/1313342156 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d80ffcf0 0x7f78d8101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dd1db700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d8104390 0x7f78d81a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 -- 172.21.15.35:0/1313342156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d80ffcf0 msgr2=0x7f78d8101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d80ffcf0 0x7f78d8101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 -- 172.21.15.35:0/1313342156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d8104390 msgr2=0x7f78d81a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d8104390 0x7f78d81a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 -- 172.21.15.35:0/1313342156 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0009d00 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 0x7f78d8100d50 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d950 tx=0x7f78cc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78d5ffb700 1 -- 172.21.15.35:0/1313342156 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00f890 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.284+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d810f060 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.285+0000 7f78d5ffb700 1 -- 172.21.15.35:0/1313342156 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78cc00fe80 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.285+0000 7f78d5ffb700 1 -- 172.21.15.35:0/1313342156 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00e3b0 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.285+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d810eed0 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.287+0000 7f78d5ffb700 1 -- 172.21.15.35:0/1313342156 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f78cc010460 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.288+0000 7f78d5ffb700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f78c809f640 0x7f78c80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.288+0000 7f78d5ffb700 1 -- 172.21.15.35:0/1313342156 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f78cc0ca400 con 0x7f78d80ff350 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.288+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f78c809f640 0x7f78c80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.288+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f78c809f640 0x7f78c80a1af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f78d8102540 tx=0x7f78c400a380 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 Processor -- start 2023-03-17T09:54:04.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 -- start start 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a0d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a0dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132914010 con 0x565132a12be0 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132966950 con 0x565132a0d960 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56513295fde0 con 0x565132a134f0 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a12fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47518/0 (socket says 172.21.15.35:47518) 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 -- 172.21.15.35:0/3207105061 learned_addr learned my addr 172.21.15.35:0/3207105061 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78d7fff700 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a0d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dd1db700 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a0dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 -- 172.21.15.35:0/3207105061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 msgr2=0x565132a0d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a0d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 -- 172.21.15.35:0/3207105061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 msgr2=0x565132a0dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:04.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a0dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 -- 172.21.15.35:0/3207105061 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651327e15d0 con 0x565132a12be0 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dd1db700 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a0dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.289+0000 7f78dc9da700 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a12fb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f78cc097e40 tx=0x7f78cc010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b70b1151932951c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.290+0000 7f78c2ffd700 1 -- 172.21.15.35:0/3207105061 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0b0210 con 0x565132a12be0 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.290+0000 7f78c2ffd700 1 -- 172.21.15.35:0/3207105061 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78cc0a00a0 con 0x565132a12be0 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.290+0000 7f78c2ffd700 1 -- 172.21.15.35:0/3207105061 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc09fe70 con 0x565132a12be0 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.290+0000 7f78eadcbb80 1 -- 172.21.15.35:0/3207105061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 msgr2=0x565132a12fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.290+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a12fb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f78cc097e40 tx=0x7f78cc010760 comp rx=0 tx=0).stop 2023-03-17T09:54:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- 172.21.15.35:0/3207105061 shutdown_connections 2023-03-17T09:54:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a0dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a12fb0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/3207105061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a0d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- 172.21.15.35:0/3207105061 >> 172.21.15.35:0/3207105061 conn(0x56513286a6b0 msgr2=0x565132a07a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- 172.21.15.35:0/3207105061 shutdown_connections 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- 172.21.15.35:0/3207105061 wait complete. 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- start start 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 Processor -- start 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a19520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a16ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651327e38c0 con 0x565132a12be0 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a17650 con 0x565132a0d960 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.291+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a23080 con 0x565132a134f0 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78eadcbb80 10 client.0 _ll_register_callbacks cb 0x565132805230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a167a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47526/0 (socket says 172.21.15.35:47526) 2023-03-17T09:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 -- 172.21.15.35:0/1853198566 learned_addr learned my addr 172.21.15.35:0/1853198566 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78dd1db700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a16ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a19520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 -- 172.21.15.35:0/1853198566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 msgr2=0x565132a16ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a16ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 -- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 msgr2=0x565132a19520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a19520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 -- 172.21.15.35:0/1853198566 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d810eed0 con 0x565132a12be0 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78dd1db700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a16ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:54:06.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a167a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f78c4003680 tx=0x7f78c40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571c34d41d31213b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:54:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78b7fff700 1 -- 172.21.15.35:0/1853198566 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4010840 con 0x565132a12be0 2023-03-17T09:54:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78b7fff700 1 -- 172.21.15.35:0/1853198566 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f78c40109a0 con 0x565132a12be0 2023-03-17T09:54:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.292+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565132922390 con 0x565132a12be0 2023-03-17T09:54:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78b7fff700 1 -- 172.21.15.35:0/1853198566 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c4010b60 con 0x565132a12be0 2023-03-17T09:54:06.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:53 smithi035 ceph-mon[92535]: pgmap v1929: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:54:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 10 client.17598 fetch_fsmap learned FSMap version 36 2023-03-17T09:54:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x56513278dd80 con 0x565132a12be0 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78b7fff700 1 -- 172.21.15.35:0/1853198566 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565132922390 con 0x565132a12be0 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78b7fff700 1 -- 172.21.15.35:0/1853198566 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f78c4030c40 con 0x565132a12be0 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 10 client.17598 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 10 client.17598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 20 client.17598 populate_metadata read hostname 'smithi035' 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a271d0 0x565132a295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 4 client.17598 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:54:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56513292e600 con 0x565132a271d0 2023-03-17T09:54:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.293+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a271d0 0x565132a295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78b7fff700 10 client.17598 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a271d0 0x565132a295e0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736ae9a9127ac47c server_cookie=c5eeaad1d869f093 in_seq=0 out_seq=0 2023-03-17T09:54:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78b7fff700 1 -- 172.21.15.35:0/1853198566 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56513292e600 con 0x565132a271d0 2023-03-17T09:54:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78b7fff700 10 client.17598 handle_command_reply: tid=0 2023-03-17T09:54:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 client.17598 shutdown 2023-03-17T09:54:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 msgr2=0x565132a167a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a167a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f78c4003680 tx=0x7f78c40047c0 comp rx=0 tx=0).stop 2023-03-17T09:54:09.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 shutdown_connections 2023-03-17T09:54:09.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a271d0 0x565132a295e0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:09.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a134f0 0x565132a16ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:09.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a0d960 0x565132a19520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:09.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1853198566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a12be0 0x565132a167a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:09.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78b7fff700 0 client.17598 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:09.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.294+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 >> 172.21.15.35:0/1853198566 conn(0x56513286a6b0 msgr2=0x565132a0c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:09.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.295+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 shutdown_connections 2023-03-17T09:54:09.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.295+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1853198566 wait complete. 2023-03-17T09:54:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.295+0000 7f78eadcbb80 20 client.17598 trim_cache size 0 max 16384 2023-03-17T09:54:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 Processor -- start 2023-03-17T09:54:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 -- start start 2023-03-17T09:54:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a19150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a030f0 con 0x565132a134f0 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a24850 con 0x565132a12be0 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a0ca90 con 0x565132a0d960 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a19150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a19150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47536/0 (socket says 172.21.15.35:47536) 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 -- 172.21.15.35:0/4290136174 learned_addr learned my addr 172.21.15.35:0/4290136174 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dc9da700 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78d7fff700 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 -- 172.21.15.35:0/4290136174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 msgr2=0x565132a07ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a07ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 -- 172.21.15.35:0/4290136174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 msgr2=0x565132a1df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 -- 172.21.15.35:0/4290136174 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565132926130 con 0x565132a134f0 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78d7fff700 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.310+0000 7f78dd1db700 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a19150 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f78d0015000 tx=0x7f78d0005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b7526b4a2d4d27 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78c37fe700 1 -- 172.21.15.35:0/4290136174 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d000e040 con 0x565132a134f0 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78c37fe700 1 -- 172.21.15.35:0/4290136174 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78d00094b0 con 0x565132a134f0 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78c37fe700 1 -- 172.21.15.35:0/4290136174 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0005530 con 0x565132a134f0 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 -- 172.21.15.35:0/4290136174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 msgr2=0x565132a19150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a19150 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f78d0015000 tx=0x7f78d0005b90 comp rx=0 tx=0).stop 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 -- 172.21.15.35:0/4290136174 shutdown_connections 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a19150 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a07ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/4290136174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 -- 172.21.15.35:0/4290136174 >> 172.21.15.35:0/4290136174 conn(0x56513286a6b0 msgr2=0x565132a234c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 -- 172.21.15.35:0/4290136174 shutdown_connections 2023-03-17T09:54:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.311+0000 7f78eadcbb80 1 -- 172.21.15.35:0/4290136174 wait complete. 2023-03-17T09:54:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 -- start start 2023-03-17T09:54:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 Processor -- start 2023-03-17T09:54:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a1e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a1ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a1d380 con 0x565132a134f0 2023-03-17T09:54:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a7b040 con 0x565132a12be0 2023-03-17T09:54:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565132a7b180 con 0x565132a0d960 2023-03-17T09:54:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78eadcbb80 10 client.0 _ll_register_callbacks cb 0x565132805230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:54:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a1ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:19.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a1ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47542/0 (socket says 172.21.15.35:47542) 2023-03-17T09:54:19.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 -- 172.21.15.35:0/1988896237 learned_addr learned my addr 172.21.15.35:0/1988896237 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:19.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78d7fff700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:19.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 -- 172.21.15.35:0/1988896237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 msgr2=0x565132a1e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:19.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a1e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a1e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 -- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 msgr2=0x565132a1c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:19.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.312+0000 7f78dd1db700 1 -- 172.21.15.35:0/1988896237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d810c7a0 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78dd1db700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a1ccb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f78d000b0d0 tx=0x7f78d00078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abe01fff5f3f7ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78b7fff700 1 -- 172.21.15.35:0/1988896237 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d000e040 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78b7fff700 1 -- 172.21.15.35:0/1988896237 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f78d0005310 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651329dd1e0 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78b7fff700 1 -- 172.21.15.35:0/1988896237 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78d00054d0 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 10 client.17604 fetch_fsmap learned FSMap version 36 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5651327b41f0 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78b7fff700 1 -- 172.21.15.35:0/1988896237 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5651329dd1e0 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78b7fff700 1 -- 172.21.15.35:0/1988896237 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f78d000b100 con 0x565132a134f0 2023-03-17T09:54:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 10 client.17604 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 10 client.17604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 20 client.17604 populate_metadata read hostname 'smithi035' 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a7c4a0 0x565132a7e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 4 client.17604 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.313+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5651327e3f00 con 0x565132a7c4a0 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.314+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a7c4a0 0x565132a7e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.314+0000 7f78b7fff700 10 client.17604 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.314+0000 7f78dc9da700 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a7c4a0 0x565132a7e8b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99cfa245b6375a server_cookie=f5d44249ad4ad5b0 in_seq=0 out_seq=0 2023-03-17T09:54:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78b7fff700 1 -- 172.21.15.35:0/1988896237 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5651327e3f00 con 0x565132a7c4a0 2023-03-17T09:54:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78b7fff700 10 client.17604 handle_command_reply: tid=0 2023-03-17T09:54:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 client.17604 shutdown 2023-03-17T09:54:20.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 msgr2=0x565132a1ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a1ccb0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f78d000b0d0 tx=0x7f78d00078e0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 shutdown_connections 2023-03-17T09:54:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565132a7c4a0 0x565132a7e8b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565132a134f0 0x565132a1ccb0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565132a0d960 0x565132a1e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78b7fff700 0 client.17604 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 --2- 172.21.15.35:0/1988896237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565132a12be0 0x565132a1c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.318+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 >> 172.21.15.35:0/1988896237 conn(0x56513286a6b0 msgr2=0x565132a19130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 shutdown_connections 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78eadcbb80 1 -- 172.21.15.35:0/1988896237 wait complete. 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78eadcbb80 20 client.17604 trim_cache size 0 max 16384 2023-03-17T09:54:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f78c809f640 msgr2=0x7f78c80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f78c809f640 0x7f78c80a1af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f78d8102540 tx=0x7f78c400a380 comp rx=0 tx=0).stop 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 msgr2=0x7f78d8100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 0x7f78d8100d50 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d950 tx=0x7f78cc00dc60 comp rx=0 tx=0).stop 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 shutdown_connections 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f78c809f640 0x7f78c80a1af0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78d8104390 0x7f78d81a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f78d80ff350 0x7f78d8100d50 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 --2- 172.21.15.35:0/1313342156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d80ffcf0 0x7f78d8101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 >> 172.21.15.35:0/1313342156 conn(0x7f78d8076330 msgr2=0x7f78d8067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 shutdown_connections 2023-03-17T09:54:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:31:54.319+0000 7f78dec3e700 1 -- 172.21.15.35:0/1313342156 wait complete. 2023-03-17T09:54:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 -- 172.21.15.35:0/1168562845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a81045a0 msgr2=0x7f51a810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 --2- 172.21.15.35:0/1168562845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a81045a0 0x7f51a810c170 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b0d0 tx=0x7f51a000b3e0 comp rx=0 tx=0).stop 2023-03-17T09:54:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 -- 172.21.15.35:0/1168562845 shutdown_connections 2023-03-17T09:54:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 --2- 172.21.15.35:0/1168562845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a81045a0 0x7f51a810c170 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 --2- 172.21.15.35:0/1168562845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a80ffa80 0x7f51a80ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 --2- 172.21.15.35:0/1168562845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a8100420 0x7f51a8103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 -- 172.21.15.35:0/1168562845 >> 172.21.15.35:0/1168562845 conn(0x7f51a80757a0 msgr2=0x7f51a8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 -- 172.21.15.35:0/1168562845 shutdown_connections 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.442+0000 7f51accd4700 1 -- 172.21.15.35:0/1168562845 wait complete. 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.443+0000 7f51accd4700 1 Processor -- start 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.443+0000 7f51accd4700 1 -- start start 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51accd4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a80ffa80 0x7f51a81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51accd4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 0x7f51a8197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51accd4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a81045a0 0x7f51a81a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51accd4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8198230 con 0x7f51a8100420 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51accd4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a81a29a0 con 0x7f51a80ffa80 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51accd4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a81a2b10 con 0x7f51a81045a0 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 0x7f51a8197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 0x7f51a8197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47554/0 (socket says 172.21.15.35:47554) 2023-03-17T09:54:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 -- 172.21.15.35:0/3580477681 learned_addr learned my addr 172.21.15.35:0/3580477681 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a659c700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a80ffa80 0x7f51a81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a81045a0 0x7f51a81a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 -- 172.21.15.35:0/3580477681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a81045a0 msgr2=0x7f51a81a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a81045a0 0x7f51a81a2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 -- 172.21.15.35:0/3580477681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a80ffa80 msgr2=0x7f51a81973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a80ffa80 0x7f51a81973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 -- 172.21.15.35:0/3580477681 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0009d00 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a81045a0 0x7f51a81a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 0x7f51a8197920 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f519000d950 tx=0x7f519000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.444+0000 7f519f7fe700 1 -- 172.21.15.35:0/3580477681 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190009930 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.445+0000 7f519f7fe700 1 -- 172.21.15.35:0/3580477681 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5190010460 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.445+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a810f270 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.445+0000 7f519f7fe700 1 -- 172.21.15.35:0/3580477681 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000f620 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.445+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a810f0e0 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.447+0000 7f519f7fe700 1 -- 172.21.15.35:0/3580477681 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5190009a90 con 0x7f51a8100420 2023-03-17T09:54:23.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.447+0000 7f519f7fe700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f519409f640 0x7f51940a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.448+0000 7f519f7fe700 1 -- 172.21.15.35:0/3580477681 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f51900ca160 con 0x7f51a8100420 2023-03-17T09:54:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.448+0000 7f51a659c700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f519409f640 0x7f51940a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:23.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.448+0000 7f51a659c700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f519409f640 0x7f51940a1af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5198007be0 tx=0x7f51980073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:23.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:55 smithi035 ceph-mon[92535]: pgmap v1930: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T09:54:25.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:57 smithi035 ceph-mon[92535]: pgmap v1931: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T09:54:25.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:45:59 smithi035 ceph-mon[92535]: pgmap v1932: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T09:54:25.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:01 smithi035 ceph-mon[92535]: pgmap v1933: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:25.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:03 smithi035 ceph-mon[92535]: pgmap v1934: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:54:25.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:05 smithi035 ceph-mon[92535]: pgmap v1935: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:07 smithi035 ceph-mon[92535]: pgmap v1936: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:09 smithi035 ceph-mon[92535]: pgmap v1937: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:09 smithi035 ceph-mon[92535]: osdmap e197: 12 total, 12 up, 12 in 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:11 smithi035 ceph-mon[92535]: pgmap v1939: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:13 smithi035 ceph-mon[92535]: pgmap v1940: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:15 smithi035 ceph-mon[92535]: pgmap v1941: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:15 smithi035 ceph-mon[92535]: osdmap e198: 12 total, 12 up, 12 in 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:17 smithi035 ceph-mon[92535]: pgmap v1943: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:19 smithi035 ceph-mon[92535]: pgmap v1944: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 843 B/s wr, 11 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:21 smithi035 ceph-mon[92535]: pgmap v1945: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:23 smithi035 ceph-mon[92535]: pgmap v1946: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:25 smithi035 ceph-mon[92535]: pgmap v1947: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:26 smithi035 ceph-mon[92535]: pgmap v1948: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 664 B/s wr, 10 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:29 smithi035 ceph-mon[92535]: pgmap v1949: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:31 smithi035 ceph-mon[92535]: pgmap v1950: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:33 smithi035 ceph-mon[92535]: pgmap v1951: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:54:25.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:35 smithi035 ceph-mon[92535]: pgmap v1952: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:37 smithi035 ceph-mon[92535]: pgmap v1953: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:39 smithi035 ceph-mon[92535]: pgmap v1954: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:41 smithi035 ceph-mon[92535]: pgmap v1955: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:43 smithi035 ceph-mon[92535]: pgmap v1956: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:45 smithi035 ceph-mon[92535]: pgmap v1957: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:47 smithi035 ceph-mon[92535]: pgmap v1958: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:49 smithi035 ceph-mon[92535]: pgmap v1959: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:54:25.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:54:28.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:50 smithi035 ceph-mon[92535]: pgmap v1960: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 272 B/s wr, 9 op/s 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:50 smithi035 ceph-mon[92535]: pgmap v1961: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:51 smithi035 ceph-mon[92535]: pgmap v1962: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:53 smithi035 ceph-mon[92535]: pgmap v1963: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:56 smithi035 ceph-mon[92535]: pgmap v1964: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:46:58 smithi035 ceph-mon[92535]: pgmap v1965: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T09:54:30.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:00 smithi035 ceph-mon[92535]: pgmap v1966: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:54:30.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:02 smithi035 ceph-mon[92535]: pgmap v1967: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:54:30.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:04 smithi035 ceph-mon[92535]: pgmap v1968: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:54:30.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:06 smithi035 ceph-mon[92535]: pgmap v1969: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T09:54:30.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:08 smithi035 ceph-mon[92535]: pgmap v1970: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:54:30.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:10 smithi035 ceph-mon[92535]: osdmap e199: 12 total, 12 up, 12 in 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:10 smithi035 ceph-mon[92535]: pgmap v1972: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:12 smithi035 ceph-mon[92535]: pgmap v1973: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:14 smithi035 ceph-mon[92535]: pgmap v1974: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:16 smithi035 ceph-mon[92535]: osdmap e200: 12 total, 12 up, 12 in 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:16 smithi035 ceph-mon[92535]: pgmap v1976: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:18 smithi035 ceph-mon[92535]: pgmap v1977: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 344 B/s wr, 11 op/s 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:20 smithi035 ceph-mon[92535]: pgmap v1978: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T09:54:35.224 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:22 smithi035 ceph-mon[92535]: pgmap v1979: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:24 smithi035 ceph-mon[92535]: pgmap v1980: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:26 smithi035 ceph-mon[92535]: pgmap v1981: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:28 smithi035 ceph-mon[92535]: pgmap v1982: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:30 smithi035 ceph-mon[92535]: pgmap v1983: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:32 smithi035 ceph-mon[92535]: pgmap v1984: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:34 smithi035 ceph-mon[92535]: pgmap v1985: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:36.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:36 smithi035 ceph-mon[92535]: pgmap v1986: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:36.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:38 smithi035 ceph-mon[92535]: pgmap v1987: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:54:36.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:40 smithi035 ceph-mon[92535]: pgmap v1988: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:36.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:42 smithi035 ceph-mon[92535]: pgmap v1989: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:54:36.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:44 smithi035 ceph-mon[92535]: pgmap v1990: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:36.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:46 smithi035 ceph-mon[92535]: pgmap v1991: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:36.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:48 smithi035 ceph-mon[92535]: pgmap v1992: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:54:36.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:54:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:54:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:54:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:54:38.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:54:38.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:54:39.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:54:39.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:54:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:54:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:54:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:54:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.448+0000 7f51b8e61b80 1 Processor -- start 2023-03-17T09:54:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 -- start start 2023-03-17T09:54:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830f040 0x55c5f830f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f8309830 0x55c5f8309ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8315dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f820c010 con 0x55c5f830a1e0 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f825e950 con 0x55c5f8309830 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f8257de0 con 0x55c5f830f040 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8315dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8315dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47564/0 (socket says 172.21.15.35:47564) 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 -- 172.21.15.35:0/1343865816 learned_addr learned my addr 172.21.15.35:0/1343865816 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a659c700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830f040 0x55c5f830f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f8309830 0x55c5f8309ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 -- 172.21.15.35:0/1343865816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830f040 msgr2=0x55c5f830f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830f040 0x55c5f830f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 -- 172.21.15.35:0/1343865816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f8309830 msgr2=0x55c5f8309ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f8309830 0x55c5f8309ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a6d9d700 1 -- 172.21.15.35:0/1343865816 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f80d95d0 con 0x55c5f830a1e0 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a659c700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830f040 0x55c5f830f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.449+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f8309830 0x55c5f8309ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.450+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8315dd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f51a000cda0 tx=0x7f51a000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68bed4ddee44afc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.450+0000 7f519cff9700 1 -- 172.21.15.35:0/1343865816 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000e070 con 0x55c5f830a1e0 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.450+0000 7f519cff9700 1 -- 172.21.15.35:0/1343865816 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51a0004a50 con 0x55c5f830a1e0 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.450+0000 7f519cff9700 1 -- 172.21.15.35:0/1343865816 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a00052a0 con 0x55c5f830a1e0 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.450+0000 7f51b8e61b80 1 -- 172.21.15.35:0/1343865816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 msgr2=0x55c5f8315dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.450+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8315dd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f51a000cda0 tx=0x7f51a000cdd0 comp rx=0 tx=0).stop 2023-03-17T09:54:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- 172.21.15.35:0/1343865816 shutdown_connections 2023-03-17T09:54:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8315dd0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830f040 0x55c5f830f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/1343865816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f8309830 0x55c5f8309ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- 172.21.15.35:0/1343865816 >> 172.21.15.35:0/1343865816 conn(0x55c5f81626b0 msgr2=0x55c5f82ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- 172.21.15.35:0/1343865816 shutdown_connections 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- 172.21.15.35:0/1343865816 wait complete. 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- start start 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 Processor -- start 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8315bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830a1e0 0x55c5f8312e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 0x55c5f83133b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f80db8c0 con 0x55c5f830f040 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f8313aa0 con 0x55c5f830a1e0 2023-03-17T09:54:45.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f8313c60 con 0x55c5f8309830 2023-03-17T09:54:45.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51b8e61b80 10 client.0 _ll_register_callbacks cb 0x55c5f80fd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:54:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.451+0000 7f51a6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 0x55c5f83133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 0x55c5f83133b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47570/0 (socket says 172.21.15.35:47570) 2023-03-17T09:54:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 -- 172.21.15.35:0/707634563 learned_addr learned my addr 172.21.15.35:0/707634563 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830a1e0 0x55c5f8312e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a659c700 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8315bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 -- 172.21.15.35:0/707634563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 msgr2=0x55c5f8315bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8315bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 -- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830a1e0 msgr2=0x55c5f8312e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830a1e0 0x55c5f8312e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 -- 172.21.15.35:0/707634563 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a810c9b0 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 0x55c5f83133b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f51a000cd70 tx=0x7f51a0007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754d9e89a091f0d0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f518dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f518dffb700 1 -- 172.21.15.35:0/707634563 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000e040 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f518dffb700 1 -- 172.21.15.35:0/707634563 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f51a0004da0 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5f821a390 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f518dffb700 1 -- 172.21.15.35:0/707634563 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51a0005040 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51b8e61b80 10 client.17616 fetch_fsmap learned FSMap version 36 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.452+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c5f8085d80 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f518dffb700 1 -- 172.21.15.35:0/707634563 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c5f821a390 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f518dffb700 1 -- 172.21.15.35:0/707634563 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f51a000b100 con 0x55c5f830f040 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51b8e61b80 10 client.17616 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51b8e61b80 10 client.17616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51b8e61b80 20 client.17616 populate_metadata read hostname 'smithi035' 2023-03-17T09:54:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8323140 0x55c5f8325550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51b8e61b80 4 client.17616 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:54:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5f8226600 con 0x55c5f8323140 2023-03-17T09:54:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51a659c700 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8323140 0x55c5f8325550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f51a659c700 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8323140 0x55c5f8325550 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80bb60709885c19c server_cookie=2e0e128c038fb302 in_seq=0 out_seq=0 2023-03-17T09:54:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.453+0000 7f518dffb700 10 client.17616 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f518dffb700 1 -- 172.21.15.35:0/707634563 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c5f8226600 con 0x55c5f8323140 2023-03-17T09:54:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f518dffb700 10 client.17616 handle_command_reply: tid=0 2023-03-17T09:54:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 client.17616 shutdown 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 msgr2=0x55c5f83133b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 0x55c5f83133b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f51a000cd70 tx=0x7f51a0007a60 comp rx=0 tx=0).stop 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 shutdown_connections 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8323140 0x55c5f8325550 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830f040 0x55c5f83133b0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f518dffb700 0 client.17616 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8315bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/707634563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830a1e0 0x55c5f8312e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 >> 172.21.15.35:0/707634563 conn(0x55c5f81626b0 msgr2=0x55c5f8304410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 shutdown_connections 2023-03-17T09:54:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 1 -- 172.21.15.35:0/707634563 wait complete. 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.454+0000 7f51b8e61b80 20 client.17616 trim_cache size 0 max 16384 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.469+0000 7f51b8e61b80 1 Processor -- start 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.469+0000 7f51b8e61b80 1 -- start start 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 0x55c5f82ffac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830a1e0 0x55c5f831a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f8315720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f82fb110 con 0x55c5f8309830 2023-03-17T09:54:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f82fc5f0 con 0x55c5f830f040 2023-03-17T09:54:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f830cd00 con 0x55c5f830a1e0 2023-03-17T09:54:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 0x55c5f82ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 0x55c5f82ffac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47574/0 (socket says 172.21.15.35:47574) 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 -- 172.21.15.35:0/893145572 learned_addr learned my addr 172.21.15.35:0/893145572 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f8315720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830a1e0 0x55c5f831a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 -- 172.21.15.35:0/893145572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830a1e0 msgr2=0x55c5f831a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830a1e0 0x55c5f831a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 -- 172.21.15.35:0/893145572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 msgr2=0x55c5f8315720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f8315720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 -- 172.21.15.35:0/893145572 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f821e130 con 0x55c5f8309830 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f51a659c700 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 0x55c5f82ffac0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x55c5f8325e20 tx=0x7f5198013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16e0485162020a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f519d7fa700 1 -- 172.21.15.35:0/893145572 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198026130 con 0x55c5f8309830 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f519d7fa700 1 -- 172.21.15.35:0/893145572 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51980267e0 con 0x55c5f8309830 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.470+0000 7f519d7fa700 1 -- 172.21.15.35:0/893145572 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198003a70 con 0x55c5f8309830 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 -- 172.21.15.35:0/893145572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 msgr2=0x55c5f82ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 0x55c5f82ffac0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x55c5f8325e20 tx=0x7f5198013000 comp rx=0 tx=0).stop 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 -- 172.21.15.35:0/893145572 shutdown_connections 2023-03-17T09:54:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f8315720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f8309830 0x55c5f82ffac0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/893145572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f830a1e0 0x55c5f831a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 -- 172.21.15.35:0/893145572 >> 172.21.15.35:0/893145572 conn(0x55c5f81626b0 msgr2=0x55c5f830d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 -- 172.21.15.35:0/893145572 shutdown_connections 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 -- 172.21.15.35:0/893145572 wait complete. 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 -- start start 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.471+0000 7f51b8e61b80 1 Processor -- start 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8370240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8370780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:54.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f83183b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:54.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f83188f0 con 0x55c5f830a1e0 2023-03-17T09:54:54.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f8318a30 con 0x55c5f830f040 2023-03-17T09:54:54.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f8318bf0 con 0x55c5f8309830 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51b8e61b80 10 client.0 _ll_register_callbacks cb 0x55c5f80fd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8370780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8370780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47582/0 (socket says 172.21.15.35:47582) 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 -- 172.21.15.35:0/2024050424 learned_addr learned my addr 172.21.15.35:0/2024050424 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a659c700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8370240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a6d9d700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f83183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 -- 172.21.15.35:0/2024050424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 msgr2=0x55c5f8370240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8370240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 -- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 msgr2=0x55c5f83183b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f83183b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 -- 172.21.15.35:0/2024050424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980078b0 con 0x55c5f830a1e0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f51a5d9b700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8370780 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5190005bf0 tx=0x7f5190097580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6614c25821b0233 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f518dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.472+0000 7f518dffb700 1 -- 172.21.15.35:0/2024050424 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190097bb0 con 0x55c5f830a1e0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f518dffb700 1 -- 172.21.15.35:0/2024050424 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f519009fda0 con 0x55c5f830a1e0 2023-03-17T09:54:54.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5f82d51e0 con 0x55c5f830a1e0 2023-03-17T09:54:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f518dffb700 1 -- 172.21.15.35:0/2024050424 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51900b1030 con 0x55c5f830a1e0 2023-03-17T09:54:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 10 client.17622 fetch_fsmap learned FSMap version 36 2023-03-17T09:54:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55c5f80ac1f0 con 0x55c5f830a1e0 2023-03-17T09:54:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f518dffb700 1 -- 172.21.15.35:0/2024050424 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c5f82d51e0 con 0x55c5f830a1e0 2023-03-17T09:54:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f518dffb700 1 -- 172.21.15.35:0/2024050424 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f519009f910 con 0x55c5f830a1e0 2023-03-17T09:54:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 10 client.17622 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:54:56.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 10 client.17622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 20 client.17622 populate_metadata read hostname 'smithi035' 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8378040 0x55c5f837a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 4 client.17622 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c5f80dbf00 con 0x55c5f8378040 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.473+0000 7f51a659c700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8378040 0x55c5f837a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.474+0000 7f518dffb700 10 client.17622 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.474+0000 7f51a659c700 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8378040 0x55c5f837a450 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bdfc66e713c4276 server_cookie=83fc19ba280bf0b1 in_seq=0 out_seq=0 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f518dffb700 1 -- 172.21.15.35:0/2024050424 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c5f80dbf00 con 0x55c5f8378040 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f518dffb700 10 client.17622 handle_command_reply: tid=0 2023-03-17T09:54:57.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f51b8e61b80 1 client.17622 shutdown 2023-03-17T09:54:57.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 msgr2=0x55c5f8370780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:54:57.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8370780 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5190005bf0 tx=0x7f5190097580 comp rx=0 tx=0).stop 2023-03-17T09:54:57.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 shutdown_connections 2023-03-17T09:54:57.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.481+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f8378040 0x55c5f837a450 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:57.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f830f040 0x55c5f83183b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:54:57.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:50 smithi035 ceph-mon[92535]: pgmap v1993: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:54:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f8309830 0x55c5f8370240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f518dffb700 0 client.17622 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 1 --2- 172.21.15.35:0/2024050424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f830a1e0 0x55c5f8370780 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 >> 172.21.15.35:0/2024050424 conn(0x55c5f81626b0 msgr2=0x55c5f830e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 shutdown_connections 2023-03-17T09:55:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 1 -- 172.21.15.35:0/2024050424 wait complete. 2023-03-17T09:55:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51b8e61b80 20 client.17622 trim_cache size 0 max 16384 2023-03-17T09:55:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f519409f640 msgr2=0x7f51940a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f519409f640 0x7f51940a1af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5198007be0 tx=0x7f51980073d0 comp rx=0 tx=0).stop 2023-03-17T09:55:02.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 msgr2=0x7f51a8197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 0x7f51a8197920 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f519000d950 tx=0x7f519000dc60 comp rx=0 tx=0).stop 2023-03-17T09:55:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 shutdown_connections 2023-03-17T09:55:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f519409f640 0x7f51940a1af0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a81045a0 0x7f51a81a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51a80ffa80 0x7f51a81973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 --2- 172.21.15.35:0/3580477681 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f51a8100420 0x7f51a8197920 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 >> 172.21.15.35:0/3580477681 conn(0x7f51a80757a0 msgr2=0x7f51a80fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 shutdown_connections 2023-03-17T09:55:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:07.482+0000 7f51accd4700 1 -- 172.21.15.35:0/3580477681 wait complete. 2023-03-17T09:55:05.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 -- 172.21.15.35:0/1767886228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 msgr2=0x7fe2a0101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1767886228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0101640 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe290009990 tx=0x7fe290009ca0 comp rx=0 tx=0).stop 2023-03-17T09:55:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 -- 172.21.15.35:0/1767886228 shutdown_connections 2023-03-17T09:55:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1767886228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2a010a790 0x7fe2a010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1767886228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0101640 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1767886228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a0101b80 0x7fe2a010a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 -- 172.21.15.35:0/1767886228 >> 172.21.15.35:0/1767886228 conn(0x7fe2a0076330 msgr2=0x7fe2a0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 -- 172.21.15.35:0/1767886228 shutdown_connections 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.607+0000 7fe2a6042700 1 -- 172.21.15.35:0/1767886228 wait complete. 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 Processor -- start 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 -- start start 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a0101b80 0x7fe2a01967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2a010a790 0x7fe2a019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a019b240 con 0x7fe2a0101270 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a019b3b0 con 0x7fe2a0101b80 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe2a6042700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a019b570 con 0x7fe2a010a790 2023-03-17T09:55:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:06.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47594/0 (socket says 172.21.15.35:47594) 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.608+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1289442456 learned_addr learned my addr 172.21.15.35:0/1289442456 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29ffff700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2a010a790 0x7fe2a019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29effd700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a0101b80 0x7fe2a01967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1289442456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2a010a790 msgr2=0x7fe2a019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2a010a790 0x7fe2a019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1289442456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a0101b80 msgr2=0x7fe2a01967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a0101b80 0x7fe2a01967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1289442456 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900095f0 con 0x7fe2a0101270 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0196260 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe290005910 tx=0x7fe290009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29cff9700 1 -- 172.21.15.35:0/1289442456 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29001d070 con 0x7fe2a0101270 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a0110100 con 0x7fe2a0101270 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29cff9700 1 -- 172.21.15.35:0/1289442456 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe290004c80 con 0x7fe2a0101270 2023-03-17T09:55:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe29cff9700 1 -- 172.21.15.35:0/1289442456 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290003a30 con 0x7fe2a0101270 2023-03-17T09:55:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.609+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a010ff70 con 0x7fe2a0101270 2023-03-17T09:55:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.611+0000 7fe29cff9700 1 -- 172.21.15.35:0/1289442456 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe290004fd0 con 0x7fe2a0101270 2023-03-17T09:55:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.612+0000 7fe29cff9700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe28809f640 0x7fe2880a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.612+0000 7fe29cff9700 1 -- 172.21.15.35:0/1289442456 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe2900cb4d0 con 0x7fe2a0101270 2023-03-17T09:55:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.612+0000 7fe29effd700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe28809f640 0x7fe2880a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.613+0000 7fe29effd700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe28809f640 0x7fe2880a1af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0197870 tx=0x7fe2940073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 Processor -- start 2023-03-17T09:55:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 -- start start 2023-03-17T09:55:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee558410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee552ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee55edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee455010 con 0x55dfee558040 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee4a7950 con 0x55dfee552830 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee4a0de0 con 0x55dfee5531e0 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee558410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee558410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47602/0 (socket says 172.21.15.35:47602) 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1127388099 learned_addr learned my addr 172.21.15.35:0/1127388099 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe29effd700 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee552ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.614+0000 7fe29ffff700 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee55edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1127388099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 msgr2=0x55dfee55edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee55edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:08.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1127388099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 msgr2=0x55dfee552ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee552ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe29f7fe700 1 -- 172.21.15.35:0/1127388099 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfee3225d0 con 0x55dfee558040 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee558410 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe290095510 tx=0x7fe290098c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35a6011b74c126e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe285ffb700 1 -- 172.21.15.35:0/1127388099 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a1170 con 0x55dfee558040 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe285ffb700 1 -- 172.21.15.35:0/1127388099 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe290099270 con 0x55dfee558040 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.615+0000 7fe285ffb700 1 -- 172.21.15.35:0/1127388099 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a0f40 con 0x55dfee558040 2023-03-17T09:55:08.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/1127388099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 msgr2=0x55dfee558410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee558410 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe290095510 tx=0x7fe290098c80 comp rx=0 tx=0).stop 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/1127388099 shutdown_connections 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee55edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee558410 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/1127388099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee552ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/1127388099 >> 172.21.15.35:0/1127388099 conn(0x55dfee3ab6b0 msgr2=0x55dfee548a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/1127388099 shutdown_connections 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/1127388099 wait complete. 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 -- start start 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.616+0000 7fe2b21cfb80 1 Processor -- start 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee561af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee562030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee55bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee3248c0 con 0x55dfee552830 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee55c350 con 0x55dfee5531e0 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee55c510 con 0x55dfee558040 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 10 client.0 _ll_register_callbacks cb 0x55dfee346230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee561af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee561af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47608/0 (socket says 172.21.15.35:47608) 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 -- 172.21.15.35:0/3113123701 learned_addr learned my addr 172.21.15.35:0/3113123701 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29ffff700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee55bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29effd700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee562030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 -- 172.21.15.35:0/3113123701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 msgr2=0x55dfee55bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee55bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 -- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 msgr2=0x55dfee562030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee562030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 -- 172.21.15.35:0/3113123701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a010ff70 con 0x55dfee552830 2023-03-17T09:55:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee561af0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe2900a0c40 tx=0x7fe2900987b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cae84e5f89aa0d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe27effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:55:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe27effd700 1 -- 172.21.15.35:0/3113123701 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900a1170 con 0x55dfee552830 2023-03-17T09:55:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe27effd700 1 -- 172.21.15.35:0/3113123701 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe2900b12b0 con 0x55dfee552830 2023-03-17T09:55:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.617+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfee463390 con 0x55dfee552830 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe27effd700 1 -- 172.21.15.35:0/3113123701 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2900a0ef0 con 0x55dfee552830 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 10 client.17634 fetch_fsmap learned FSMap version 36 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55dfee2ced80 con 0x55dfee552830 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe27effd700 1 -- 172.21.15.35:0/3113123701 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dfee463390 con 0x55dfee552830 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe27effd700 1 -- 172.21.15.35:0/3113123701 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe2900b5cd0 con 0x55dfee552830 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 10 client.17634 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 10 client.17634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 20 client.17634 populate_metadata read hostname 'smithi035' 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee56bcf0 0x55dfee56e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 4 client.17634 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfee46f600 con 0x55dfee56bcf0 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.618+0000 7fe29effd700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee56bcf0 0x55dfee56e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe29effd700 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee56bcf0 0x55dfee56e0d0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed717a29b4545230 server_cookie=1c2e1b96bd729d35 in_seq=0 out_seq=0 2023-03-17T09:55:11.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe27effd700 10 client.17634 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe27effd700 1 -- 172.21.15.35:0/3113123701 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55dfee46f600 con 0x55dfee56bcf0 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe27effd700 10 client.17634 handle_command_reply: tid=0 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe2b21cfb80 1 client.17634 shutdown 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 msgr2=0x55dfee561af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.619+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee561af0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe2900a0c40 tx=0x7fe2900987b0 comp rx=0 tx=0).stop 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 shutdown_connections 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee56bcf0 0x55dfee56e0d0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee55bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:11.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe27effd700 0 client.17634 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee561af0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3113123701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee562030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 >> 172.21.15.35:0/3113123701 conn(0x55dfee3ab6b0 msgr2=0x55dfee54d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 shutdown_connections 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3113123701 wait complete. 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.620+0000 7fe2b21cfb80 20 client.17634 trim_cache size 0 max 16384 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.634+0000 7fe2b21cfb80 1 Processor -- start 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 -- start start 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee548ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee54d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee54d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee544120 con 0x55dfee558040 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee549c10 con 0x55dfee552830 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee5455c0 con 0x55dfee5531e0 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee54d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee54d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47620/0 (socket says 172.21.15.35:47620) 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 -- 172.21.15.35:0/3325646383 learned_addr learned my addr 172.21.15.35:0/3325646383 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29effd700 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee54d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee548ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 -- 172.21.15.35:0/3325646383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 msgr2=0x55dfee54d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee54d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 -- 172.21.15.35:0/3325646383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 msgr2=0x55dfee548ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee548ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 -- 172.21.15.35:0/3325646383 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfee467130 con 0x55dfee558040 2023-03-17T09:55:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.635+0000 7fe29ffff700 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee54d950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe298009ee0 tx=0x7fe298009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838b889ced3fe536 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2867fc700 1 -- 172.21.15.35:0/3325646383 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298007dc0 con 0x55dfee558040 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2867fc700 1 -- 172.21.15.35:0/3325646383 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe29800f040 con 0x55dfee558040 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2867fc700 1 -- 172.21.15.35:0/3325646383 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298005020 con 0x55dfee558040 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3325646383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 msgr2=0x55dfee54d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee54d950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe298009ee0 tx=0x7fe298009f10 comp rx=0 tx=0).stop 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3325646383 shutdown_connections 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee558040 0x55dfee54d950 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee552830 0x55dfee548ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/3325646383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee5531e0 0x55dfee54d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3325646383 >> 172.21.15.35:0/3325646383 conn(0x55dfee3ab6b0 msgr2=0x55dfee572a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3325646383 shutdown_connections 2023-03-17T09:55:16.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.636+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/3325646383 wait complete. 2023-03-17T09:55:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 -- start start 2023-03-17T09:55:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 Processor -- start 2023-03-17T09:55:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee5b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee5b8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee5b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee5b41d0 con 0x55dfee552830 2023-03-17T09:55:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee5b4340 con 0x55dfee5531e0 2023-03-17T09:55:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfee5b4500 con 0x55dfee558040 2023-03-17T09:55:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe2b21cfb80 10 client.0 _ll_register_callbacks cb 0x55dfee346230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:55:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee5b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe29f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee5b7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47622/0 (socket says 172.21.15.35:47622) 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe29effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee5b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe29f7fe700 1 -- 172.21.15.35:0/953965116 learned_addr learned my addr 172.21.15.35:0/953965116 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.637+0000 7fe29ffff700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee5b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29effd700 1 -- 172.21.15.35:0/953965116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 msgr2=0x55dfee5b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29effd700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee5b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29effd700 1 -- 172.21.15.35:0/953965116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 msgr2=0x55dfee5b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29effd700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee5b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29effd700 1 -- 172.21.15.35:0/953965116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298009b90 con 0x55dfee5531e0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29ffff700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee5b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe29effd700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee5b8530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55dfee54a910 tx=0x7fe294013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2009f67edc04a03a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe27effd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe27effd700 1 -- 172.21.15.35:0/953965116 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294028600 con 0x55dfee5531e0 2023-03-17T09:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe27effd700 1 -- 172.21.15.35:0/953965116 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe294017040 con 0x55dfee5531e0 2023-03-17T09:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfee51e1e0 con 0x55dfee5531e0 2023-03-17T09:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe27effd700 1 -- 172.21.15.35:0/953965116 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2940287e0 con 0x55dfee5531e0 2023-03-17T09:55:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe2b21cfb80 10 client.27116 fetch_fsmap learned FSMap version 36 2023-03-17T09:55:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55dfee2f51f0 con 0x55dfee5531e0 2023-03-17T09:55:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.638+0000 7fe27effd700 1 -- 172.21.15.35:0/953965116 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dfee51e1e0 con 0x55dfee5531e0 2023-03-17T09:55:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe27effd700 1 -- 172.21.15.35:0/953965116 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe294003a20 con 0x55dfee5531e0 2023-03-17T09:55:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe2b21cfb80 10 client.27116 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe2b21cfb80 10 client.27116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe2b21cfb80 20 client.27116 populate_metadata read hostname 'smithi035' 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee5c0f30 0x55dfee5c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe2b21cfb80 4 client.27116 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dfee324f00 con 0x55dfee5c0f30 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee5c0f30 0x55dfee5c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe27effd700 10 client.27116 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.639+0000 7fe29f7fe700 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee5c0f30 0x55dfee5c3340 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8413411409dd67 server_cookie=3c36b214e4f0fa22 in_seq=0 out_seq=0 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.647+0000 7fe27effd700 1 -- 172.21.15.35:0/953965116 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dfee324f00 con 0x55dfee5c0f30 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.647+0000 7fe27effd700 10 client.27116 handle_command_reply: tid=0 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.647+0000 7fe2b21cfb80 1 client.27116 shutdown 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.647+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 msgr2=0x55dfee5b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.647+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee5b8530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55dfee54a910 tx=0x7fe294013000 comp rx=0 tx=0).stop 2023-03-17T09:55:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 shutdown_connections 2023-03-17T09:55:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfee5c0f30 0x55dfee5c3340 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfee558040 0x55dfee5b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfee552830 0x55dfee5b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe27effd700 0 client.27116 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 --2- 172.21.15.35:0/953965116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfee5531e0 0x55dfee5b8530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 >> 172.21.15.35:0/953965116 conn(0x55dfee3ab6b0 msgr2=0x55dfee54d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 shutdown_connections 2023-03-17T09:55:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 1 -- 172.21.15.35:0/953965116 wait complete. 2023-03-17T09:55:22.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2b21cfb80 20 client.27116 trim_cache size 0 max 16384 2023-03-17T09:55:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe28809f640 msgr2=0x7fe2880a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe28809f640 0x7fe2880a1af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0197870 tx=0x7fe2940073d0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 msgr2=0x7fe2a0196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0196260 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe290005910 tx=0x7fe290009580 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 shutdown_connections 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe28809f640 0x7fe2880a1af0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2a010a790 0x7fe2a019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe2a0101270 0x7fe2a0196260 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 --2- 172.21.15.35:0/1289442456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a0101b80 0x7fe2a01967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 >> 172.21.15.35:0/1289442456 conn(0x7fe2a0076330 msgr2=0x7fe2a01021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 shutdown_connections 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:20.648+0000 7fe2a6042700 1 -- 172.21.15.35:0/1289442456 wait complete. 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.769+0000 7fa155dcc700 1 -- 172.21.15.35:0/3421482637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ff350 msgr2=0x7fa1500ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.769+0000 7fa155dcc700 1 --2- 172.21.15.35:0/3421482637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ff350 0x7fa1500ff720 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fa1400099c0 tx=0x7fa140009cd0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 -- 172.21.15.35:0/3421482637 shutdown_connections 2023-03-17T09:55:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 --2- 172.21.15.35:0/3421482637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 0x7fa15010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 --2- 172.21.15.35:0/3421482637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ff350 0x7fa1500ff720 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 --2- 172.21.15.35:0/3421482637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1500ffcf0 0x7fa150103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 -- 172.21.15.35:0/3421482637 >> 172.21.15.35:0/3421482637 conn(0x7fa150076330 msgr2=0x7fa150076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 -- 172.21.15.35:0/3421482637 shutdown_connections 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 -- 172.21.15.35:0/3421482637 wait complete. 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.770+0000 7fa155dcc700 1 Processor -- start 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 -- start start 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1500ff350 0x7fa150195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 0x7fa1501956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 0x7fa150199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15019a160 con 0x7fa1500ffcf0 2023-03-17T09:55:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15019a2d0 con 0x7fa1500ff350 2023-03-17T09:55:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa155dcc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15019a490 con 0x7fa150104390 2023-03-17T09:55:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa14effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 0x7fa1501956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:24.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa14effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 0x7fa1501956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47638/0 (socket says 172.21.15.35:47638) 2023-03-17T09:55:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa14effd700 1 -- 172.21.15.35:0/1581884569 learned_addr learned my addr 172.21.15.35:0/1581884569 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1500ff350 0x7fa150195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.771+0000 7fa14ffff700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 0x7fa150199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:24.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14effd700 1 -- 172.21.15.35:0/1581884569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 msgr2=0x7fa150199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14effd700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 0x7fa150199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14effd700 1 -- 172.21.15.35:0/1581884569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1500ff350 msgr2=0x7fa150195180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14effd700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1500ff350 0x7fa150195180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14effd700 1 -- 172.21.15.35:0/1581884569 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400095f0 con 0x7fa1500ffcf0 2023-03-17T09:55:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14ffff700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 0x7fa150199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:55:25.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14effd700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 0x7fa1501956c0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa14400d950 tx=0x7fa14400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14cff9700 1 -- 172.21.15.35:0/1581884569 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144009b40 con 0x7fa1500ffcf0 2023-03-17T09:55:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14cff9700 1 -- 172.21.15.35:0/1581884569 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa14400de30 con 0x7fa1500ffcf0 2023-03-17T09:55:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15010f000 con 0x7fa1500ffcf0 2023-03-17T09:55:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa14cff9700 1 -- 172.21.15.35:0/1581884569 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400f620 con 0x7fa1500ffcf0 2023-03-17T09:55:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.772+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010ee70 con 0x7fa1500ffcf0 2023-03-17T09:55:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.774+0000 7fa14cff9700 1 -- 172.21.15.35:0/1581884569 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa144010460 con 0x7fa1500ffcf0 2023-03-17T09:55:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.775+0000 7fa14cff9700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa13809f640 0x7fa1380a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.775+0000 7fa14cff9700 1 -- 172.21.15.35:0/1581884569 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa1440ca2e0 con 0x7fa1500ffcf0 2023-03-17T09:55:27.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.775+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa13809f640 0x7fa1380a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.775+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa13809f640 0x7fa1380a1af0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa140009fd0 tx=0x7fa140005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 Processor -- start 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 -- start start 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cadff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 0x558c6cada430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cada970 0x558c6cadadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6c9d0010 con 0x558c6cae04a0 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6ca22950 con 0x558c6cadfb90 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa161f59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6ca1bde0 con 0x558c6cada970 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 0x558c6cada430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 0x558c6cada430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47646/0 (socket says 172.21.15.35:47646) 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 -- 172.21.15.35:0/2957268372 learned_addr learned my addr 172.21.15.35:0/2957268372 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14ffff700 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cada970 0x558c6cadadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cadff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 -- 172.21.15.35:0/2957268372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cada970 msgr2=0x558c6cadadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cada970 0x558c6cadadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 -- 172.21.15.35:0/2957268372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 msgr2=0x558c6cadff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cadff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.776+0000 7fa14effd700 1 -- 172.21.15.35:0/2957268372 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c6c89d5d0 con 0x558c6cae04a0 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.777+0000 7fa14effd700 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 0x558c6cada430 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa144094230 tx=0x7fa144097760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a67259f8a3e48f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.777+0000 7fa135ffb700 1 -- 172.21.15.35:0/2957268372 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144009ca0 con 0x558c6cae04a0 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.777+0000 7fa135ffb700 1 -- 172.21.15.35:0/2957268372 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1440960d0 con 0x558c6cae04a0 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.777+0000 7fa135ffb700 1 -- 172.21.15.35:0/2957268372 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440981f0 con 0x558c6cae04a0 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.777+0000 7fa161f59b80 1 -- 172.21.15.35:0/2957268372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 msgr2=0x558c6cada430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.777+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 0x558c6cada430 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa144094230 tx=0x7fa144097760 comp rx=0 tx=0).stop 2023-03-17T09:55:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 -- 172.21.15.35:0/2957268372 shutdown_connections 2023-03-17T09:55:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cada970 0x558c6cadadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:28.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cadff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:28.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2957268372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cae04a0 0x558c6cada430 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 -- 172.21.15.35:0/2957268372 >> 172.21.15.35:0/2957268372 conn(0x558c6c9266b0 msgr2=0x558c6cac3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 -- 172.21.15.35:0/2957268372 shutdown_connections 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 -- 172.21.15.35:0/2957268372 wait complete. 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 -- start start 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.778+0000 7fa161f59b80 1 Processor -- start 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cae3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cae41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6c89f8c0 con 0x558c6cada970 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cae4ae0 con 0x558c6cadfb90 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cad2ca0 con 0x558c6cae04a0 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 10 client.0 _ll_register_callbacks cb 0x558c6c8c1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cae3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cae3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47650/0 (socket says 172.21.15.35:47650) 2023-03-17T09:55:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 -- 172.21.15.35:0/1092230469 learned_addr learned my addr 172.21.15.35:0/1092230469 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14ffff700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14effd700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cae41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 -- 172.21.15.35:0/1092230469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 msgr2=0x558c6cad2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:29.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:55:30.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:30.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 -- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 msgr2=0x558c6cae41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cae41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 -- 172.21.15.35:0/1092230469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010ee70 con 0x558c6cada970 2023-03-17T09:55:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14effd700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cae41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:55:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cae3c90 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098e0 tx=0x7fa140009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3c261b5ce686cb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa12effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:55:31.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa12effd700 1 -- 172.21.15.35:0/1092230469 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400052b0 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa12effd700 1 -- 172.21.15.35:0/1092230469 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa140004910 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.779+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c6c9de390 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa12effd700 1 -- 172.21.15.35:0/1092230469 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa140004ad0 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 10 client.17652 fetch_fsmap learned FSMap version 36 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x558c6c849d80 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa12effd700 1 -- 172.21.15.35:0/1092230469 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c6c9de390 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa12effd700 1 -- 172.21.15.35:0/1092230469 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa1400040b0 con 0x558c6cada970 2023-03-17T09:55:31.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 10 client.17652 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:55:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 10 client.17652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:55:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 20 client.17652 populate_metadata read hostname 'smithi035' 2023-03-17T09:55:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cad6d80 0x558c6cad9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 4 client.17652 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:55:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c6c9ea600 con 0x558c6cad6d80 2023-03-17T09:55:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.780+0000 7fa14effd700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cad6d80 0x558c6cad9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.781+0000 7fa12effd700 10 client.17652 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.781+0000 7fa14effd700 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cad6d80 0x558c6cad9190 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3994a41034ec9ca2 server_cookie=853d29b4d007bfe3 in_seq=0 out_seq=0 2023-03-17T09:55:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.781+0000 7fa12effd700 1 -- 172.21.15.35:0/1092230469 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558c6c9ea600 con 0x558c6cad6d80 2023-03-17T09:55:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.781+0000 7fa12effd700 10 client.17652 handle_command_reply: tid=0 2023-03-17T09:55:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 client.17652 shutdown 2023-03-17T09:55:35.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 msgr2=0x558c6cae3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cae3c90 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098e0 tx=0x7fa140009cd0 comp rx=0 tx=0).stop 2023-03-17T09:55:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 shutdown_connections 2023-03-17T09:55:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cad6d80 0x558c6cad9190 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa12effd700 0 client.17652 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cae3c90 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 --2- 172.21.15.35:0/1092230469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cae41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 >> 172.21.15.35:0/1092230469 conn(0x558c6c9266b0 msgr2=0x558c6cac8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 shutdown_connections 2023-03-17T09:55:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 1 -- 172.21.15.35:0/1092230469 wait complete. 2023-03-17T09:55:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.782+0000 7fa161f59b80 20 client.17652 trim_cache size 0 max 16384 2023-03-17T09:55:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 Processor -- start 2023-03-17T09:55:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 -- start start 2023-03-17T09:55:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cac3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cacd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cac0b60 con 0x558c6cada970 2023-03-17T09:55:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cac4000 con 0x558c6cadfb90 2023-03-17T09:55:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa161f59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cae4c20 con 0x558c6cae04a0 2023-03-17T09:55:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cac3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cac3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47658/0 (socket says 172.21.15.35:47658) 2023-03-17T09:55:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 -- 172.21.15.35:0/371861037 learned_addr learned my addr 172.21.15.35:0/371861037 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14ffff700 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14effd700 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cacd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 -- 172.21.15.35:0/371861037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 msgr2=0x558c6cad1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 -- 172.21.15.35:0/371861037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 msgr2=0x558c6cacd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cacd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14f7fe700 1 -- 172.21.15.35:0/371861037 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c6c9e2130 con 0x558c6cada970 2023-03-17T09:55:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.797+0000 7fa14effd700 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cacd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:55:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cac3ac0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa140005940 tx=0x7fa14000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3e6301b4b368c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:40.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa1367fc700 1 -- 172.21.15.35:0/371861037 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000f7a0 con 0x558c6cada970 2023-03-17T09:55:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa1367fc700 1 -- 172.21.15.35:0/371861037 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa14002c040 con 0x558c6cada970 2023-03-17T09:55:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa1367fc700 1 -- 172.21.15.35:0/371861037 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140004ea0 con 0x558c6cada970 2023-03-17T09:55:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 -- 172.21.15.35:0/371861037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 msgr2=0x558c6cac3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:40.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cac3ac0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa140005940 tx=0x7fa14000bef0 comp rx=0 tx=0).stop 2023-03-17T09:55:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 -- 172.21.15.35:0/371861037 shutdown_connections 2023-03-17T09:55:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cae04a0 0x558c6cad1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:40.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cac3ac0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 --2- 172.21.15.35:0/371861037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cadfb90 0x558c6cacd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 -- 172.21.15.35:0/371861037 >> 172.21.15.35:0/371861037 conn(0x558c6c9266b0 msgr2=0x558c6cadee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 -- 172.21.15.35:0/371861037 shutdown_connections 2023-03-17T09:55:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.798+0000 7fa161f59b80 1 -- 172.21.15.35:0/371861037 wait complete. 2023-03-17T09:55:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.799+0000 7fa161f59b80 1 -- start start 2023-03-17T09:55:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.799+0000 7fa161f59b80 1 Processor -- start 2023-03-17T09:55:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.799+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cb26c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.799+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cadfb90 0x558c6cb27180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cae04a0 0x558c6cb276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cb2ddf0 con 0x558c6cada970 2023-03-17T09:55:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cb2df60 con 0x558c6cae04a0 2023-03-17T09:55:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6cb2e120 con 0x558c6cadfb90 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 10 client.0 _ll_register_callbacks cb 0x558c6c8c1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cb26c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cb26c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47664/0 (socket says 172.21.15.35:47664) 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 -- 172.21.15.35:0/2401124993 learned_addr learned my addr 172.21.15.35:0/2401124993 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14effd700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cadfb90 0x558c6cb27180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 -- 172.21.15.35:0/2401124993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cadfb90 msgr2=0x558c6cb27180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14ffff700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cae04a0 0x558c6cb276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cadfb90 0x558c6cb27180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 -- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cae04a0 msgr2=0x558c6cb276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cae04a0 0x558c6cb276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 -- 172.21.15.35:0/2401124993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c6c849d80 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa14f7fe700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cb26c40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098e0 tx=0x7fa140005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf8f103034bfc4d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa12effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa12effd700 1 -- 172.21.15.35:0/2401124993 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000fbf0 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa12effd700 1 -- 172.21.15.35:0/2401124993 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa14000fd50 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c6ca991e0 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa12effd700 1 -- 172.21.15.35:0/2401124993 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa140003820 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 10 client.17658 fetch_fsmap learned FSMap version 36 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.800+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x558c6c8701f0 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa12effd700 1 -- 172.21.15.35:0/2401124993 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c6ca991e0 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa12effd700 1 -- 172.21.15.35:0/2401124993 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa14003a6d0 con 0x558c6cada970 2023-03-17T09:55:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa161f59b80 10 client.17658 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa161f59b80 10 client.17658 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa161f59b80 20 client.17658 populate_metadata read hostname 'smithi035' 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cbbfb40 0x558c6cbc1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa161f59b80 4 client.17658 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558c6c89ff00 con 0x558c6cbbfb40 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa14effd700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cbbfb40 0x558c6cbc1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa14effd700 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cbbfb40 0x558c6cbc1f20 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f13f701fb2ba5133 server_cookie=8515f604b53fbedb in_seq=0 out_seq=0 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.801+0000 7fa12effd700 10 client.17658 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa12effd700 1 -- 172.21.15.35:0/2401124993 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558c6c89ff00 con 0x558c6cbbfb40 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa12effd700 10 client.17658 handle_command_reply: tid=0 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 client.17658 shutdown 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 msgr2=0x558c6cb26c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cb26c40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098e0 tx=0x7fa140005d20 comp rx=0 tx=0).stop 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 shutdown_connections 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558c6cbbfb40 0x558c6cbc1f20 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558c6cae04a0 0x558c6cb276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa12effd700 0 client.17658 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558c6cada970 0x558c6cb26c40 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 --2- 172.21.15.35:0/2401124993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558c6cadfb90 0x558c6cb27180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 >> 172.21.15.35:0/2401124993 conn(0x558c6c9266b0 msgr2=0x558c6cad1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 shutdown_connections 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 1 -- 172.21.15.35:0/2401124993 wait complete. 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.806+0000 7fa161f59b80 20 client.17658 trim_cache size 0 max 16384 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa13809f640 msgr2=0x7fa1380a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa13809f640 0x7fa1380a1af0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa140009fd0 tx=0x7fa140005fb0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 msgr2=0x7fa1501956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 0x7fa1501956c0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa14400d950 tx=0x7fa14400dd10 comp rx=0 tx=0).stop 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 shutdown_connections 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa13809f640 0x7fa1380a1af0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa150104390 0x7fa150199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1500ff350 0x7fa150195180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 --2- 172.21.15.35:0/1581884569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1500ffcf0 0x7fa1501956c0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 >> 172.21.15.35:0/1581884569 conn(0x7fa150076330 msgr2=0x7fa1500fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 shutdown_connections 2023-03-17T09:55:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:32:33.807+0000 7fa155dcc700 1 -- 172.21.15.35:0/1581884569 wait complete. 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 -- 172.21.15.35:0/2314781242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8810104390 msgr2=0x7f881010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 --2- 172.21.15.35:0/2314781242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8810104390 0x7f881010bf60 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f880800b0d0 tx=0x7f880800b3e0 comp rx=0 tx=0).stop 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 -- 172.21.15.35:0/2314781242 shutdown_connections 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 --2- 172.21.15.35:0/2314781242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8810104390 0x7f881010bf60 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 --2- 172.21.15.35:0/2314781242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88100ff350 0x7f88100ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 --2- 172.21.15.35:0/2314781242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88100ffcf0 0x7f8810103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 -- 172.21.15.35:0/2314781242 >> 172.21.15.35:0/2314781242 conn(0x7f8810076330 msgr2=0x7f8810076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:55:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 -- 172.21.15.35:0/2314781242 shutdown_connections 2023-03-17T09:55:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 -- 172.21.15.35:0/2314781242 wait complete. 2023-03-17T09:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.458+0000 7f8816264700 1 Processor -- start 2023-03-17T09:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 -- start start 2023-03-17T09:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88100ff350 0x7f8810100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:49.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 0x7f8810101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8810104390 0x7f88101a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810101ac0 con 0x7f88100ffcf0 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88101a4a60 con 0x7f88100ff350 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8816264700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88101a4ba0 con 0x7f8810104390 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 0x7f8810101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 0x7f8810101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47678/0 (socket says 172.21.15.35:47678) 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 -- 172.21.15.35:0/1800341519 learned_addr learned my addr 172.21.15.35:0/1800341519 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880ffff700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88100ff350 0x7f8810100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f8814801700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8810104390 0x7f88101a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 -- 172.21.15.35:0/1800341519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8810104390 msgr2=0x7f88101a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8810104390 0x7f88101a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 -- 172.21.15.35:0/1800341519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88100ff350 msgr2=0x7f8810100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88100ff350 0x7f8810100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.459+0000 7f880f7fe700 1 -- 172.21.15.35:0/1800341519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808009d00 con 0x7f88100ffcf0 2023-03-17T09:55:49.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.460+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 0x7f8810101290 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f880400e940 tx=0x7f880400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:49.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.460+0000 7f880d7fa700 1 -- 172.21.15.35:0/1800341519 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804009730 con 0x7f88100ffcf0 2023-03-17T09:55:49.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:52 smithi035 ceph-mon[92535]: pgmap v1994: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:55:51.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.923 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: pgmap v1995: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:51.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:54.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:55 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:55 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:55 smithi035 ceph-mon[92535]: pgmap v1996: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:55 smithi035 ceph-mon[92535]: pgmap v1997: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T09:55:54.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:57 smithi035 ceph-mon[92535]: pgmap v1998: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T09:55:54.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:47:59 smithi035 ceph-mon[92535]: pgmap v1999: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T09:55:54.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:01 smithi035 ceph-mon[92535]: pgmap v2000: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T09:55:54.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:03 smithi035 ceph-mon[92535]: pgmap v2001: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 33 op/s 2023-03-17T09:55:54.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:05 smithi035 ceph-mon[92535]: pgmap v2002: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:07 smithi035 ceph-mon[92535]: pgmap v2003: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:09 smithi035 ceph-mon[92535]: pgmap v2004: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:09 smithi035 ceph-mon[92535]: osdmap e201: 12 total, 12 up, 12 in 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:11 smithi035 ceph-mon[92535]: pgmap v2006: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:13 smithi035 ceph-mon[92535]: pgmap v2007: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:15 smithi035 ceph-mon[92535]: pgmap v2008: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:55:55.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:15 smithi035 ceph-mon[92535]: osdmap e202: 12 total, 12 up, 12 in 2023-03-17T09:55:57.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:17 smithi035 ceph-mon[92535]: pgmap v2010: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:55:57.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:19 smithi035 ceph-mon[92535]: pgmap v2011: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T09:55:57.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:21 smithi035 ceph-mon[92535]: pgmap v2012: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:55:57.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:23 smithi035 ceph-mon[92535]: pgmap v2013: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T09:55:57.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:25 smithi035 ceph-mon[92535]: pgmap v2014: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T09:55:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.460+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881010efc0 con 0x7f88100ffcf0 2023-03-17T09:55:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.460+0000 7f880d7fa700 1 -- 172.21.15.35:0/1800341519 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f880400ee90 con 0x7f88100ffcf0 2023-03-17T09:55:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.460+0000 7f880d7fa700 1 -- 172.21.15.35:0/1800341519 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804018420 con 0x7f88100ffcf0 2023-03-17T09:55:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.460+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881010ee30 con 0x7f88100ffcf0 2023-03-17T09:55:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.463+0000 7f880d7fa700 1 -- 172.21.15.35:0/1800341519 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f880400cbd0 con 0x7f88100ffcf0 2023-03-17T09:55:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.463+0000 7f880d7fa700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f87f809f640 0x7f87f80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.463+0000 7f880d7fa700 1 -- 172.21.15.35:0/1800341519 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8804014070 con 0x7f88100ffcf0 2023-03-17T09:55:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.463+0000 7f880ffff700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f87f809f640 0x7f87f80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f880ffff700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f87f809f640 0x7f87f80a1af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8800009c60 tx=0x7f8800009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 Processor -- start 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 -- start start 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e7efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62e79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62d80010 con 0x55fb62e7ebe0 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62dd2950 con 0x55fb62e79960 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f88223f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62dcbde0 con 0x55fb62e7f4f0 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.464+0000 7f880ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e7efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e7efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47684/0 (socket says 172.21.15.35:47684) 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 -- 172.21.15.35:0/1741514282 learned_addr learned my addr 172.21.15.35:0/1741514282 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f8814801700 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:57.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62e79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 -- 172.21.15.35:0/1741514282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 msgr2=0x55fb62e79420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62e79420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 -- 172.21.15.35:0/1741514282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 msgr2=0x55fb62e79d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e79d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 -- 172.21.15.35:0/1741514282 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb62c4d5d0 con 0x55fb62e7ebe0 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f8814801700 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e79d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f880ffff700 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e7efb0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f880000e4e0 tx=0x7f8800014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaa2964905f17b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f87f67fc700 1 -- 172.21.15.35:0/1741514282 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000ee00 con 0x55fb62e7ebe0 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f87f67fc700 1 -- 172.21.15.35:0/1741514282 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8800021070 con 0x55fb62e7ebe0 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.465+0000 7f87f67fc700 1 -- 172.21.15.35:0/1741514282 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880001d720 con 0x55fb62e7ebe0 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 -- 172.21.15.35:0/1741514282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 msgr2=0x55fb62e7efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e7efb0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f880000e4e0 tx=0x7f8800014000 comp rx=0 tx=0).stop 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 -- 172.21.15.35:0/1741514282 shutdown_connections 2023-03-17T09:55:57.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e79d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:58.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e7efb0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:55:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1741514282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62e79420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 -- 172.21.15.35:0/1741514282 >> 172.21.15.35:0/1741514282 conn(0x55fb62cd66b0 msgr2=0x55fb62e73a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 -- 172.21.15.35:0/1741514282 shutdown_connections 2023-03-17T09:56:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 -- 172.21.15.35:0/1741514282 wait complete. 2023-03-17T09:56:01.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.466+0000 7f88223f1b80 1 -- start start 2023-03-17T09:56:01.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 Processor -- start 2023-03-17T09:56:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 0x55fb62e854d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7ebe0 0x55fb62e826e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e82e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62c4f8c0 con 0x55fb62e79960 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62e83560 con 0x55fb62e7f4f0 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62e8f000 con 0x55fb62e7ebe0 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f88223f1b80 10 client.0 _ll_register_callbacks cb 0x55fb62c71230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 0x55fb62e854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 0x55fb62e854d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47690/0 (socket says 172.21.15.35:47690) 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 -- 172.21.15.35:0/1340523769 learned_addr learned my addr 172.21.15.35:0/1340523769 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7ebe0 0x55fb62e826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f8814801700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e82e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 -- 172.21.15.35:0/1340523769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7ebe0 msgr2=0x55fb62e826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7ebe0 0x55fb62e826e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 -- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 msgr2=0x55fb62e82e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e82e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f880ffff700 1 -- 172.21.15.35:0/1340523769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8800017070 con 0x55fb62e79960 2023-03-17T09:56:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.467+0000 7f8814801700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e82e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f880ffff700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 0x55fb62e854d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f880000ed10 tx=0x7f880000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309a90e1a4d1fad6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f87ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f87ef7fe700 1 -- 172.21.15.35:0/1340523769 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800005590 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f87ef7fe700 1 -- 172.21.15.35:0/1340523769 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8800003680 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb62d8e390 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f87ef7fe700 1 -- 172.21.15.35:0/1340523769 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88000056f0 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 10 client.17670 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fb62bf9d80 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f87ef7fe700 1 -- 172.21.15.35:0/1340523769 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fb62d8e390 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f87ef7fe700 1 -- 172.21.15.35:0/1340523769 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f880001c8d0 con 0x55fb62e79960 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 10 client.17670 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 10 client.17670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 20 client.17670 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62e92ef0 0x55fb62e95300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 4 client.17670 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:56:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.468+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb62d9a600 con 0x55fb62e92ef0 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.469+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62e92ef0 0x55fb62e95300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.469+0000 7f87ef7fe700 10 client.17670 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.469+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62e92ef0 0x55fb62e95300 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c167af01f6b06ac server_cookie=867603f54225d949 in_seq=0 out_seq=0 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f87ef7fe700 1 -- 172.21.15.35:0/1340523769 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55fb62d9a600 con 0x55fb62e92ef0 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f87ef7fe700 10 client.17670 handle_command_reply: tid=0 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 client.17670 shutdown 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 msgr2=0x55fb62e854d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 0x55fb62e854d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f880000ed10 tx=0x7f880000ed40 comp rx=0 tx=0).stop 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 shutdown_connections 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62e92ef0 0x55fb62e95300 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e82e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e79960 0x55fb62e854d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1340523769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7ebe0 0x55fb62e826e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 >> 172.21.15.35:0/1340523769 conn(0x55fb62cd66b0 msgr2=0x55fb62e78410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f87ef7fe700 0 client.17670 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 shutdown_connections 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 1 -- 172.21.15.35:0/1340523769 wait complete. 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.470+0000 7f88223f1b80 20 client.17670 trim_cache size 0 max 16384 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.485+0000 7f88223f1b80 1 Processor -- start 2023-03-17T09:56:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.485+0000 7f88223f1b80 1 -- start start 2023-03-17T09:56:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e79960 0x55fb62e73ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e85000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f88223f1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62e836a0 con 0x55fb62e7ebe0 2023-03-17T09:56:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f88223f1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62e74000 con 0x55fb62e7f4f0 2023-03-17T09:56:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f88223f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62e74580 con 0x55fb62e79960 2023-03-17T09:56:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e89f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47700/0 (socket says 172.21.15.35:47700) 2023-03-17T09:56:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 -- 172.21.15.35:0/1829040519 learned_addr learned my addr 172.21.15.35:0/1829040519 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880ffff700 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e79960 0x55fb62e73ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f8814801700 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e85000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 -- 172.21.15.35:0/1829040519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e79960 msgr2=0x55fb62e73ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e79960 0x55fb62e73ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 -- 172.21.15.35:0/1829040519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 msgr2=0x55fb62e85000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e85000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 -- 172.21.15.35:0/1829040519 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb62e7a000 con 0x55fb62e7ebe0 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f880f7fe700 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e89f50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8804094df0 tx=0x7f880409b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a291d5cf9e95ff5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f87f6ffd700 1 -- 172.21.15.35:0/1829040519 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88040c6070 con 0x55fb62e7ebe0 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f87f6ffd700 1 -- 172.21.15.35:0/1829040519 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88040af070 con 0x55fb62e7ebe0 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.486+0000 7f87f6ffd700 1 -- 172.21.15.35:0/1829040519 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804098840 con 0x55fb62e7ebe0 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 -- 172.21.15.35:0/1829040519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 msgr2=0x55fb62e89f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e89f50 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8804094df0 tx=0x7f880409b040 comp rx=0 tx=0).stop 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 -- 172.21.15.35:0/1829040519 shutdown_connections 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e7f4f0 0x55fb62e85000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e79960 0x55fb62e73ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 --2- 172.21.15.35:0/1829040519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e89f50 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 -- 172.21.15.35:0/1829040519 >> 172.21.15.35:0/1829040519 conn(0x55fb62cd66b0 msgr2=0x55fb62e94f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 -- 172.21.15.35:0/1829040519 shutdown_connections 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 -- 172.21.15.35:0/1829040519 wait complete. 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.487+0000 7f88223f1b80 1 -- start start 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 Processor -- start 2023-03-17T09:56:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e87f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e88470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62ee5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62e88db0 con 0x55fb62e7ebe0 2023-03-17T09:56:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62ee62d0 con 0x55fb62e79960 2023-03-17T09:56:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb62ee6490 con 0x55fb62e7f4f0 2023-03-17T09:56:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f88223f1b80 10 client.0 _ll_register_callbacks cb 0x55fb62c71230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e88470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e88470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47706/0 (socket says 172.21.15.35:47706) 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 -- 172.21.15.35:0/3917543825 learned_addr learned my addr 172.21.15.35:0/3917543825 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880ffff700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e87f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f8814801700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62ee5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 -- 172.21.15.35:0/3917543825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 msgr2=0x55fb62ee5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62ee5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 -- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 msgr2=0x55fb62e87f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e87f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880f7fe700 1 -- 172.21.15.35:0/3917543825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881010ee30 con 0x55fb62e7ebe0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.488+0000 7f880ffff700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e87f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f880f7fe700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e88470 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8804098310 tx=0x7f8804010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8b19c2cc649d60 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f87ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f87ef7fe700 1 -- 172.21.15.35:0/3917543825 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88040c6070 con 0x55fb62e7ebe0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f87ef7fe700 1 -- 172.21.15.35:0/3917543825 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8804097a80 con 0x55fb62e7ebe0 2023-03-17T09:56:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb62e491e0 con 0x55fb62e7ebe0 2023-03-17T09:56:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f87ef7fe700 1 -- 172.21.15.35:0/3917543825 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880409c1e0 con 0x55fb62e7ebe0 2023-03-17T09:56:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 10 client.17676 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55fb62be2c00 con 0x55fb62e7ebe0 2023-03-17T09:56:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f87ef7fe700 1 -- 172.21.15.35:0/3917543825 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fb62e491e0 con 0x55fb62e7ebe0 2023-03-17T09:56:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f87ef7fe700 1 -- 172.21.15.35:0/3917543825 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f88040a00e0 con 0x55fb62e7ebe0 2023-03-17T09:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 10 client.17676 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 10 client.17676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 20 client.17676 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62ee7990 0x55fb62ee9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 4 client.17676 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:56:12.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:27 smithi035 ceph-mon[92535]: pgmap v2015: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.489+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fb62c4ff00 con 0x55fb62ee7990 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.490+0000 7f880ffff700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62ee7990 0x55fb62ee9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.490+0000 7f87ef7fe700 10 client.17676 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.490+0000 7f880ffff700 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62ee7990 0x55fb62ee9da0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce157bf110a58a8b server_cookie=f0f813b919d127c9 in_seq=0 out_seq=0 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.498+0000 7f87ef7fe700 1 -- 172.21.15.35:0/3917543825 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fb62c4ff00 con 0x55fb62ee7990 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f87ef7fe700 10 client.17676 handle_command_reply: tid=0 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 client.17676 shutdown 2023-03-17T09:56:13.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 msgr2=0x55fb62e88470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e88470 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8804098310 tx=0x7f8804010a70 comp rx=0 tx=0).stop 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 shutdown_connections 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fb62ee7990 0x55fb62ee9da0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb62e7f4f0 0x55fb62ee5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fb62e79960 0x55fb62e87f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f87ef7fe700 0 client.17676 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 --2- 172.21.15.35:0/3917543825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fb62e7ebe0 0x55fb62e88470 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 >> 172.21.15.35:0/3917543825 conn(0x55fb62cd66b0 msgr2=0x55fb62e7c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 shutdown_connections 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 1 -- 172.21.15.35:0/3917543825 wait complete. 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f88223f1b80 20 client.17676 trim_cache size 0 max 16384 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f87f809f640 msgr2=0x7f87f80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f8816264700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f87f809f640 0x7f87f80a1af0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8800009c60 tx=0x7f8800009260 comp rx=0 tx=0).stop 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 msgr2=0x7f8810101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.499+0000 7f8816264700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 0x7f8810101290 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f880400e940 tx=0x7f880400ec50 comp rx=0 tx=0).stop 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 shutdown_connections 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f87f809f640 0x7f87f80a1af0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8810104390 0x7f88101a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88100ff350 0x7f8810100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 --2- 172.21.15.35:0/1800341519 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88100ffcf0 0x7f8810101290 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 >> 172.21.15.35:0/1800341519 conn(0x7f8810076330 msgr2=0x7f8810068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 shutdown_connections 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:46.500+0000 7f8816264700 1 -- 172.21.15.35:0/1800341519 wait complete. 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 -- 172.21.15.35:0/2454912897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ff350 msgr2=0x7efcdc0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 --2- 172.21.15.35:0/2454912897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ff350 0x7efcdc0ff720 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7efcd80099c0 tx=0x7efcd8009cd0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 -- 172.21.15.35:0/2454912897 shutdown_connections 2023-03-17T09:56:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 --2- 172.21.15.35:0/2454912897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc104390 0x7efcdc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 --2- 172.21.15.35:0/2454912897 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ff350 0x7efcdc0ff720 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 --2- 172.21.15.35:0/2454912897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.622+0000 7efce380e700 1 -- 172.21.15.35:0/2454912897 >> 172.21.15.35:0/2454912897 conn(0x7efcdc076330 msgr2=0x7efcdc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.623+0000 7efce380e700 1 -- 172.21.15.35:0/2454912897 shutdown_connections 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.623+0000 7efce380e700 1 -- 172.21.15.35:0/2454912897 wait complete. 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.623+0000 7efce380e700 1 Processor -- start 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 -- start start 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc0ff350 0x7efcdc195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc1956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcdc104390 0x7efcdc199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc19a150 con 0x7efcdc0ffcf0 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc19a2c0 con 0x7efcdc104390 2023-03-17T09:56:15.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce380e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc19a480 con 0x7efcdc0ff350 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc1956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc1956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47720/0 (socket says 172.21.15.35:47720) 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 -- 172.21.15.35:0/974066031 learned_addr learned my addr 172.21.15.35:0/974066031 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce15aa700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc0ff350 0x7efcdc195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce1dab700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcdc104390 0x7efcdc199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 -- 172.21.15.35:0/974066031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc0ff350 msgr2=0x7efcdc195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc0ff350 0x7efcdc195170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 -- 172.21.15.35:0/974066031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcdc104390 msgr2=0x7efcdc199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcdc104390 0x7efcdc199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 -- 172.21.15.35:0/974066031 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80095f0 con 0x7efcdc0ffcf0 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce15aa700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc0ff350 0x7efcdc195170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.624+0000 7efce0da9700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc1956b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7efccc00e940 tx=0x7efccc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.625+0000 7efcd27fc700 1 -- 172.21.15.35:0/974066031 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc009730 con 0x7efcdc0ffcf0 2023-03-17T09:56:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.625+0000 7efcd27fc700 1 -- 172.21.15.35:0/974066031 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efccc00cbd0 con 0x7efcdc0ffcf0 2023-03-17T09:56:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.625+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc10f000 con 0x7efcdc0ffcf0 2023-03-17T09:56:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.625+0000 7efcd27fc700 1 -- 172.21.15.35:0/974066031 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc018680 con 0x7efcdc0ffcf0 2023-03-17T09:56:16.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.625+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc10ee70 con 0x7efcdc0ffcf0 2023-03-17T09:56:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.627+0000 7efcd27fc700 1 -- 172.21.15.35:0/974066031 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7efccc00cd40 con 0x7efcdc0ffcf0 2023-03-17T09:56:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.627+0000 7efcd27fc700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efcc809f6c0 0x7efcc80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.628+0000 7efce15aa700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efcc809f6c0 0x7efcc80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.628+0000 7efcd27fc700 1 -- 172.21.15.35:0/974066031 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efccc014070 con 0x7efcdc0ffcf0 2023-03-17T09:56:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.628+0000 7efce15aa700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efcc809f6c0 0x7efcc80a1b70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b580 tx=0x7efcd801a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.628+0000 7efcef99bb80 1 Processor -- start 2023-03-17T09:56:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.628+0000 7efcef99bb80 1 -- start start 2023-03-17T09:56:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e78b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e789890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e799ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efcef99bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e690010 con 0x55bc4e789dd0 2023-03-17T09:56:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efcef99bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e6e2950 con 0x55bc4e789420 2023-03-17T09:56:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efcef99bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e6dbde0 con 0x55bc4e78ac50 2023-03-17T09:56:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e799ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e799ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47730/0 (socket says 172.21.15.35:47730) 2023-03-17T09:56:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce15aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e78b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 -- 172.21.15.35:0/228320570 learned_addr learned my addr 172.21.15.35:0/228320570 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce0da9700 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e789890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 -- 172.21.15.35:0/228320570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 msgr2=0x55bc4e78b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e78b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 -- 172.21.15.35:0/228320570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 msgr2=0x55bc4e789890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e789890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 -- 172.21.15.35:0/228320570 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc4e55d5d0 con 0x55bc4e789dd0 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce15aa700 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e78b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.629+0000 7efce1dab700 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e799ab0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009440 tx=0x7efcd4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3a5325cd6b9943 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcc77fe700 1 -- 172.21.15.35:0/228320570 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400e070 con 0x55bc4e789dd0 2023-03-17T09:56:21.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcc77fe700 1 -- 172.21.15.35:0/228320570 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcd400f040 con 0x55bc4e789dd0 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcc77fe700 1 -- 172.21.15.35:0/228320570 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4015a40 con 0x55bc4e789dd0 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 -- 172.21.15.35:0/228320570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 msgr2=0x55bc4e799ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e799ab0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009440 tx=0x7efcd4009920 comp rx=0 tx=0).stop 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 -- 172.21.15.35:0/228320570 shutdown_connections 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e799ab0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e78b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 --2- 172.21.15.35:0/228320570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e789890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 -- 172.21.15.35:0/228320570 >> 172.21.15.35:0/228320570 conn(0x55bc4e5e66b0 msgr2=0x55bc4e783a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 -- 172.21.15.35:0/228320570 shutdown_connections 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.630+0000 7efcef99bb80 1 -- 172.21.15.35:0/228320570 wait complete. 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 -- start start 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 Processor -- start 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e799960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789dd0 0x55bc4e796c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 0x55bc4e797280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e55f8c0 con 0x55bc4e78ac50 2023-03-17T09:56:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e7979b0 con 0x55bc4e789dd0 2023-03-17T09:56:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e7a3410 con 0x55bc4e789420 2023-03-17T09:56:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efcef99bb80 10 client.0 _ll_register_callbacks cb 0x55bc4e581230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efce1dab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 0x55bc4e797280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efce1dab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 0x55bc4e797280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47736/0 (socket says 172.21.15.35:47736) 2023-03-17T09:56:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.631+0000 7efce1dab700 1 -- 172.21.15.35:0/173037861 learned_addr learned my addr 172.21.15.35:0/173037861 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce0da9700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789dd0 0x55bc4e796c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce15aa700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e799960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce1dab700 1 -- 172.21.15.35:0/173037861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 msgr2=0x55bc4e799960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce1dab700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e799960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce1dab700 1 -- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789dd0 msgr2=0x55bc4e796c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce1dab700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789dd0 0x55bc4e796c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce1dab700 1 -- 172.21.15.35:0/173037861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd40090f0 con 0x55bc4e78ac50 2023-03-17T09:56:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce15aa700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e799960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:56:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efce1dab700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 0x55bc4e797280 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7efcd40168a0 tx=0x7efcd40168d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da9c0c790b8824e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcc4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:24.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcc4ff9700 1 -- 172.21.15.35:0/173037861 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd400e040 con 0x55bc4e78ac50 2023-03-17T09:56:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcc4ff9700 1 -- 172.21.15.35:0/173037861 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efcd40095e0 con 0x55bc4e78ac50 2023-03-17T09:56:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc4e69e390 con 0x55bc4e78ac50 2023-03-17T09:56:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcc4ff9700 1 -- 172.21.15.35:0/173037861 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcd4003a00 con 0x55bc4e78ac50 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcef99bb80 10 client.17688 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.632+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bc4e509d80 con 0x55bc4e78ac50 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcc4ff9700 1 -- 172.21.15.35:0/173037861 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc4e69e390 con 0x55bc4e78ac50 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcc4ff9700 1 -- 172.21.15.35:0/173037861 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7efcd4007500 con 0x55bc4e78ac50 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcef99bb80 10 client.17688 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcef99bb80 10 client.17688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcef99bb80 20 client.17688 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcef99bb80 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7a7390 0x55bc4e7a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcef99bb80 4 client.17688 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc4e6aa600 con 0x55bc4e7a7390 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efce15aa700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7a7390 0x55bc4e7a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efcc4ff9700 10 client.17688 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.633+0000 7efce15aa700 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7a7390 0x55bc4e7a97a0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819d1de25db799d2 server_cookie=72ce1159a2738e60 in_seq=0 out_seq=0 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcc4ff9700 1 -- 172.21.15.35:0/173037861 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55bc4e6aa600 con 0x55bc4e7a7390 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcc4ff9700 10 client.17688 handle_command_reply: tid=0 2023-03-17T09:56:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 client.17688 shutdown 2023-03-17T09:56:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 msgr2=0x55bc4e797280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 0x55bc4e797280 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7efcd40168a0 tx=0x7efcd40168d0 comp rx=0 tx=0).stop 2023-03-17T09:56:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 shutdown_connections 2023-03-17T09:56:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7a7390 0x55bc4e7a97a0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e78ac50 0x55bc4e797280 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e799960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcc4ff9700 0 client.17688 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 --2- 172.21.15.35:0/173037861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789dd0 0x55bc4e796c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 >> 172.21.15.35:0/173037861 conn(0x55bc4e5e66b0 msgr2=0x55bc4e788410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 shutdown_connections 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.634+0000 7efcef99bb80 1 -- 172.21.15.35:0/173037861 wait complete. 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.635+0000 7efcef99bb80 20 client.17688 trim_cache size 0 max 16384 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 Processor -- start 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 -- start start 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e7853d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e783ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e78ac50 0x55bc4e79e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e69e390 con 0x55bc4e789dd0 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e69f050 con 0x55bc4e78ac50 2023-03-17T09:56:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efcef99bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e77f0f0 con 0x55bc4e789420 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e783ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e783ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47742/0 (socket says 172.21.15.35:47742) 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 -- 172.21.15.35:0/3680657308 learned_addr learned my addr 172.21.15.35:0/3680657308 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce15aa700 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e7853d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce1dab700 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e78ac50 0x55bc4e79e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 -- 172.21.15.35:0/3680657308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 msgr2=0x55bc4e7853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e7853d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 -- 172.21.15.35:0/3680657308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e78ac50 msgr2=0x55bc4e79e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e78ac50 0x55bc4e79e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.650+0000 7efce0da9700 1 -- 172.21.15.35:0/3680657308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc4e6a2130 con 0x55bc4e789dd0 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efce0da9700 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e783ac0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7efccc098170 tx=0x7efccc0ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec73d2bd9e7a121 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcc7fff700 1 -- 172.21.15.35:0/3680657308 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc098470 con 0x55bc4e789dd0 2023-03-17T09:56:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcc7fff700 1 -- 172.21.15.35:0/3680657308 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efccc0a0660 con 0x55bc4e789dd0 2023-03-17T09:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcc7fff700 1 -- 172.21.15.35:0/3680657308 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc097bc0 con 0x55bc4e789dd0 2023-03-17T09:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 -- 172.21.15.35:0/3680657308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 msgr2=0x55bc4e783ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e783ac0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7efccc098170 tx=0x7efccc0ca040 comp rx=0 tx=0).stop 2023-03-17T09:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 -- 172.21.15.35:0/3680657308 shutdown_connections 2023-03-17T09:56:28.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e78ac50 0x55bc4e79e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e789420 0x55bc4e7853d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 --2- 172.21.15.35:0/3680657308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e783ac0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 -- 172.21.15.35:0/3680657308 >> 172.21.15.35:0/3680657308 conn(0x55bc4e5e66b0 msgr2=0x55bc4e788410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 -- 172.21.15.35:0/3680657308 shutdown_connections 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.651+0000 7efcef99bb80 1 -- 172.21.15.35:0/3680657308 wait complete. 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 -- start start 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 Processor -- start 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e7f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e7f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e7ef180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:28.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e7ef890 con 0x55bc4e789dd0 2023-03-17T09:56:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e7efa00 con 0x55bc4e789420 2023-03-17T09:56:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc4e7efbc0 con 0x55bc4e78ac50 2023-03-17T09:56:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efcef99bb80 10 client.0 _ll_register_callbacks cb 0x55bc4e581230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.652+0000 7efce0da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e7f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e7f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47748/0 (socket says 172.21.15.35:47748) 2023-03-17T09:56:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 -- 172.21.15.35:0/2171446344 learned_addr learned my addr 172.21.15.35:0/2171446344 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:31.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce15aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e7f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce1dab700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e7ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 -- 172.21.15.35:0/2171446344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 msgr2=0x55bc4e7ef180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:31.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e7ef180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 -- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 msgr2=0x55bc4e7f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e7f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 -- 172.21.15.35:0/2171446344 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc10ee70 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce15aa700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e7f49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efce0da9700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e7f4f00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7efccc0a0130 tx=0x7efccc096a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671cda9312321981 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcc4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcc4ff9700 1 -- 172.21.15.35:0/2171446344 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0b6070 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcc4ff9700 1 -- 172.21.15.35:0/2171446344 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efccc0b61d0 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc4e7591e0 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcc4ff9700 1 -- 172.21.15.35:0/2171446344 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7efccc0b63d0 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcef99bb80 10 client.17694 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.653+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55bc4e5301f0 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcc4ff9700 1 -- 172.21.15.35:0/2171446344 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc4e7591e0 con 0x55bc4e789dd0 2023-03-17T09:56:31.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcc4ff9700 1 -- 172.21.15.35:0/2171446344 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7efccc0973d0 con 0x55bc4e789dd0 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcef99bb80 10 client.17694 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcef99bb80 10 client.17694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcef99bb80 20 client.17694 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcef99bb80 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7fc3e0 0x55bc4e7fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcef99bb80 4 client.17694 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bc4e55ff00 con 0x55bc4e7fc3e0 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efce15aa700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7fc3e0 0x55bc4e7fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efce15aa700 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7fc3e0 0x55bc4e7fe7f0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=568045c724ca5fd9 server_cookie=43d9d1a3933e8ff5 in_seq=0 out_seq=0 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.654+0000 7efcc4ff9700 10 client.17694 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcc4ff9700 1 -- 172.21.15.35:0/2171446344 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bc4e55ff00 con 0x55bc4e7fc3e0 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcc4ff9700 10 client.17694 handle_command_reply: tid=0 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 client.17694 shutdown 2023-03-17T09:56:31.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 msgr2=0x55bc4e7f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e7f4f00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7efccc0a0130 tx=0x7efccc096a20 comp rx=0 tx=0).stop 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 shutdown_connections 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bc4e7fc3e0 0x55bc4e7fe7f0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bc4e78ac50 0x55bc4e7ef180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bc4e789420 0x55bc4e7f49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcc4ff9700 0 client.17694 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 --2- 172.21.15.35:0/2171446344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bc4e789dd0 0x55bc4e7f4f00 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 >> 172.21.15.35:0/2171446344 conn(0x55bc4e5e66b0 msgr2=0x55bc4e788c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 shutdown_connections 2023-03-17T09:56:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 1 -- 172.21.15.35:0/2171446344 wait complete. 2023-03-17T09:56:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.659+0000 7efcef99bb80 20 client.17694 trim_cache size 0 max 16384 2023-03-17T09:56:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efcc809f6c0 msgr2=0x7efcc80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efcc809f6c0 0x7efcc80a1b70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b580 tx=0x7efcd801a040 comp rx=0 tx=0).stop 2023-03-17T09:56:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 msgr2=0x7efcdc1956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc1956b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7efccc00e940 tx=0x7efccc00ed00 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 shutdown_connections 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efcc809f6c0 0x7efcc80a1b70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcdc104390 0x7efcdc199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc0ff350 0x7efcdc195170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 --2- 172.21.15.35:0/974066031 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efcdc0ffcf0 0x7efcdc1956b0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 >> 172.21.15.35:0/974066031 conn(0x7efcdc076330 msgr2=0x7efcdc0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 shutdown_connections 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:33:59.660+0000 7efce380e700 1 -- 172.21.15.35:0/974066031 wait complete. 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 -- 172.21.15.35:0/4152793684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed040ff4b0 msgr2=0x7fed040ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 --2- 172.21.15.35:0/4152793684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed040ff4b0 0x7fed040ff880 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fecf80099c0 tx=0x7fecf8009cd0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 -- 172.21.15.35:0/4152793684 shutdown_connections 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 --2- 172.21.15.35:0/4152793684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed041044d0 0x7fed0410c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 --2- 172.21.15.35:0/4152793684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed040ff4b0 0x7fed040ff880 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 --2- 172.21.15.35:0/4152793684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed040ffe50 0x7fed04103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 -- 172.21.15.35:0/4152793684 >> 172.21.15.35:0/4152793684 conn(0x7fed04077220 msgr2=0x7fed04077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 -- 172.21.15.35:0/4152793684 shutdown_connections 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.782+0000 7fed088b6700 1 -- 172.21.15.35:0/4152793684 wait complete. 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 Processor -- start 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 -- start start 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed040ff4b0 0x7fed041951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed040ffe50 0x7fed04195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 0x7fed04199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0419a1b0 con 0x7fed041044d0 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0419a320 con 0x7fed040ffe50 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed088b6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0419a4e0 con 0x7fed040ff4b0 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.783+0000 7fed02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 0x7fed04199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 0x7fed04199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47762/0 (socket says 172.21.15.35:47762) 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 -- 172.21.15.35:0/685222839 learned_addr learned my addr 172.21.15.35:0/685222839 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed01d9b700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed040ffe50 0x7fed04195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed0259c700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed040ff4b0 0x7fed041951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 -- 172.21.15.35:0/685222839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed040ff4b0 msgr2=0x7fed041951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed040ff4b0 0x7fed041951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 -- 172.21.15.35:0/685222839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed040ffe50 msgr2=0x7fed04195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed040ffe50 0x7fed04195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 -- 172.21.15.35:0/685222839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80095f0 con 0x7fed041044d0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed02d9d700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 0x7fed04199b70 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007f10 tx=0x7fecfc00f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fecf37fe700 1 -- 172.21.15.35:0/685222839 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc00fde0 con 0x7fed041044d0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fecf37fe700 1 -- 172.21.15.35:0/685222839 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc004bb0 con 0x7fed041044d0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0410f130 con 0x7fed041044d0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fecf37fe700 1 -- 172.21.15.35:0/685222839 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc005020 con 0x7fed041044d0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.784+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0410efa0 con 0x7fed041044d0 2023-03-17T09:56:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.787+0000 7fecf37fe700 1 -- 172.21.15.35:0/685222839 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fecfc004d20 con 0x7fed041044d0 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.787+0000 7fecf37fe700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecec09f6c0 0x7fecec0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.787+0000 7fecf37fe700 1 -- 172.21.15.35:0/685222839 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fecfc0cc810 con 0x7fed041044d0 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.787+0000 7fed0259c700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecec09f6c0 0x7fecec0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.788+0000 7fed0259c700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecec09f6c0 0x7fecec0a1b70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fecf8000c00 tx=0x7fecf8005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.788+0000 7fed14a43b80 1 Processor -- start 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.788+0000 7fed14a43b80 1 -- start start 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.788+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed14a43b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e681b5010 con 0x560e682b8040 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed14a43b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e68207950 con 0x560e682b31e0 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed14a43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e68200de0 con 0x560e682b2830 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47766/0 (socket says 172.21.15.35:47766) 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 -- 172.21.15.35:0/2496513 learned_addr learned my addr 172.21.15.35:0/2496513 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed01d9b700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed02d9d700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 -- 172.21.15.35:0/2496513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 msgr2=0x560e682b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 -- 172.21.15.35:0/2496513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 msgr2=0x560e682bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 -- 172.21.15.35:0/2496513 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e680825d0 con 0x560e682b8040 2023-03-17T09:56:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed01d9b700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:56:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed02d9d700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fed0259c700 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682b8410 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fecf80099c0 tx=0x7fecf801a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94927f87e9e8fd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:32.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fecf0ff9700 1 -- 172.21.15.35:0/2496513 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80053c0 con 0x560e682b8040 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fecf0ff9700 1 -- 172.21.15.35:0/2496513 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecf801e040 con 0x560e682b8040 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.789+0000 7fecf0ff9700 1 -- 172.21.15.35:0/2496513 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8010770 con 0x560e682b8040 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 -- 172.21.15.35:0/2496513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 msgr2=0x560e682b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682b8410 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fecf80099c0 tx=0x7fecf801a070 comp rx=0 tx=0).stop 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 -- 172.21.15.35:0/2496513 shutdown_connections 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682b8410 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2496513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:32.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 -- 172.21.15.35:0/2496513 >> 172.21.15.35:0/2496513 conn(0x560e6810b6b0 msgr2=0x560e682a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 -- 172.21.15.35:0/2496513 shutdown_connections 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.790+0000 7fed14a43b80 1 -- 172.21.15.35:0/2496513 wait complete. 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 -- start start 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 Processor -- start 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:34.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e680848c0 con 0x560e682b8040 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682bcb90 con 0x560e682b31e0 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682bcd50 con 0x560e682b2830 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed14a43b80 10 client.0 _ll_register_callbacks cb 0x560e680a6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed02d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682bc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47776/0 (socket says 172.21.15.35:47776) 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.791+0000 7fed02d9d700 1 -- 172.21.15.35:0/4243636342 learned_addr learned my addr 172.21.15.35:0/4243636342 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed01d9b700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed0259c700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed02d9d700 1 -- 172.21.15.35:0/4243636342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 msgr2=0x560e682beca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed02d9d700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682beca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed02d9d700 1 -- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 msgr2=0x560e682bbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed02d9d700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed02d9d700 1 -- 172.21.15.35:0/4243636342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0410c8b0 con 0x560e682b8040 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed0259c700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed02d9d700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682bc450 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0ca570 tx=0x7fecfc09a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7db29ed0bd1d369 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:34.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fece9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fece9ffb700 1 -- 172.21.15.35:0/4243636342 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc094ea0 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fece9ffb700 1 -- 172.21.15.35:0/4243636342 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fecfc099780 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e681c3390 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fece9ffb700 1 -- 172.21.15.35:0/4243636342 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecfc099940 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed14a43b80 10 client.17706 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560e6802ed80 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.792+0000 7fece9ffb700 1 -- 172.21.15.35:0/4243636342 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e681c3390 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fece9ffb700 1 -- 172.21.15.35:0/4243636342 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fecfc0991f0 con 0x560e682b8040 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed14a43b80 10 client.17706 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed14a43b80 10 client.17706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed14a43b80 20 client.17706 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed14a43b80 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e682cc3a0 0x560e682ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed14a43b80 4 client.17706 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e681cf600 con 0x560e682cc3a0 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed0259c700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e682cc3a0 0x560e682ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:34.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fece9ffb700 10 client.17706 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.793+0000 7fed0259c700 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e682cc3a0 0x560e682ce7b0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca3f7d10f36eaa0 server_cookie=bd112189eb201f04 in_seq=0 out_seq=0 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fece9ffb700 1 -- 172.21.15.35:0/4243636342 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560e681cf600 con 0x560e682cc3a0 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fece9ffb700 10 client.17706 handle_command_reply: tid=0 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 client.17706 shutdown 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 msgr2=0x560e682bc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682bc450 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0ca570 tx=0x7fecfc09a290 comp rx=0 tx=0).stop 2023-03-17T09:56:34.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 shutdown_connections 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e682cc3a0 0x560e682ce7b0 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b8040 0x560e682bc450 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b2830 0x560e682beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 --2- 172.21.15.35:0/4243636342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682bbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fece9ffb700 0 client.17706 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 >> 172.21.15.35:0/4243636342 conn(0x560e6810b6b0 msgr2=0x560e682ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 shutdown_connections 2023-03-17T09:56:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 1 -- 172.21.15.35:0/4243636342 wait complete. 2023-03-17T09:56:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.794+0000 7fed14a43b80 20 client.17706 trim_cache size 0 max 16384 2023-03-17T09:56:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.809+0000 7fed14a43b80 1 Processor -- start 2023-03-17T09:56:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.809+0000 7fed14a43b80 1 -- start start 2023-03-17T09:56:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682b7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b8040 0x560e682be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed14a43b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682aac20 con 0x560e682b2830 2023-03-17T09:56:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed14a43b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682a9000 con 0x560e682b31e0 2023-03-17T09:56:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed14a43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682a96b0 con 0x560e682b8040 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47780/0 (socket says 172.21.15.35:47780) 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 -- 172.21.15.35:0/2451100003 learned_addr learned my addr 172.21.15.35:0/2451100003 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed02d9d700 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b8040 0x560e682be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed01d9b700 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 -- 172.21.15.35:0/2451100003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b8040 msgr2=0x560e682be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b8040 0x560e682be7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 -- 172.21.15.35:0/2451100003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 msgr2=0x560e682a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 -- 172.21.15.35:0/2451100003 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e681c7130 con 0x560e682b2830 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed01d9b700 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fed0259c700 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682b7850 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fecf800b600 tx=0x7fecf8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dd43bb819f4039 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fecf17fa700 1 -- 172.21.15.35:0/2451100003 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8026040 con 0x560e682b2830 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fecf17fa700 1 -- 172.21.15.35:0/2451100003 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecf801e040 con 0x560e682b2830 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.810+0000 7fecf17fa700 1 -- 172.21.15.35:0/2451100003 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf803a030 con 0x560e682b2830 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 -- 172.21.15.35:0/2451100003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 msgr2=0x560e682b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682b7850 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fecf800b600 tx=0x7fecf8009cd0 comp rx=0 tx=0).stop 2023-03-17T09:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 -- 172.21.15.35:0/2451100003 shutdown_connections 2023-03-17T09:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b8040 0x560e682be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682b7850 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 --2- 172.21.15.35:0/2451100003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b31e0 0x560e682a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 -- 172.21.15.35:0/2451100003 >> 172.21.15.35:0/2451100003 conn(0x560e6810b6b0 msgr2=0x560e682b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 -- 172.21.15.35:0/2451100003 shutdown_connections 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 -- 172.21.15.35:0/2451100003 wait complete. 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.811+0000 7fed14a43b80 1 -- start start 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 Processor -- start 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b31e0 0x560e682c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b8040 0x560e6831f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682c31f0 con 0x560e682b2830 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e682c3360 con 0x560e682b8040 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6831f7d0 con 0x560e682b31e0 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed14a43b80 10 client.0 _ll_register_callbacks cb 0x560e680a6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47786/0 (socket says 172.21.15.35:47786) 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 -- 172.21.15.35:0/498744374 learned_addr learned my addr 172.21.15.35:0/498744374 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:41.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed01d9b700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b31e0 0x560e682c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed02d9d700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b8040 0x560e6831f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 -- 172.21.15.35:0/498744374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b31e0 msgr2=0x560e682c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b31e0 0x560e682c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 -- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b8040 msgr2=0x560e6831f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b8040 0x560e6831f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 -- 172.21.15.35:0/498744374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e680825d0 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed02d9d700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b8040 0x560e6831f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fed0259c700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682c24d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fecf80098e0 tx=0x7fecf8005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f889abc84ab71288 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.812+0000 7fece9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fece9ffb700 1 -- 172.21.15.35:0/498744374 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8026070 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fece9ffb700 1 -- 172.21.15.35:0/498744374 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fecf803adf0 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e6827e1e0 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fece9ffb700 1 -- 172.21.15.35:0/498744374 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf80056f0 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 10 client.17712 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x560e680551f0 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fece9ffb700 1 -- 172.21.15.35:0/498744374 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e6827e1e0 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fece9ffb700 1 -- 172.21.15.35:0/498744374 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fecf8037040 con 0x560e682b2830 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 10 client.17712 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 10 client.17712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 20 client.17712 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e683209d0 0x560e68322db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 4 client.17712 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e68084f00 con 0x560e683209d0 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.813+0000 7fed01d9b700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e683209d0 0x560e68322db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.814+0000 7fed01d9b700 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e683209d0 0x560e68322db0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a5b4414d238c9c2 server_cookie=916f00525742b012 in_seq=0 out_seq=0 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.814+0000 7fece9ffb700 10 client.17712 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fece9ffb700 1 -- 172.21.15.35:0/498744374 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e68084f00 con 0x560e683209d0 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fece9ffb700 10 client.17712 handle_command_reply: tid=0 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 client.17712 shutdown 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 msgr2=0x560e682c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682c24d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fecf80098e0 tx=0x7fecf8005450 comp rx=0 tx=0).stop 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 shutdown_connections 2023-03-17T09:56:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e683209d0 0x560e68322db0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e682b8040 0x560e6831f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fece9ffb700 0 client.17712 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e682b2830 0x560e682c24d0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 --2- 172.21.15.35:0/498744374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e682b31e0 0x560e682c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 >> 172.21.15.35:0/498744374 conn(0x560e6810b6b0 msgr2=0x560e682ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 shutdown_connections 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 1 -- 172.21.15.35:0/498744374 wait complete. 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed14a43b80 20 client.17712 trim_cache size 0 max 16384 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecec09f6c0 msgr2=0x7fecec0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed088b6700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecec09f6c0 0x7fecec0a1b70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fecf8000c00 tx=0x7fecf8005fb0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 msgr2=0x7fed04199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.822+0000 7fed088b6700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 0x7fed04199b70 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007f10 tx=0x7fecfc00f5c0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 shutdown_connections 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecec09f6c0 0x7fecec0a1b70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed041044d0 0x7fed04199b70 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed040ff4b0 0x7fed041951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 --2- 172.21.15.35:0/685222839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed040ffe50 0x7fed04195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 >> 172.21.15.35:0/685222839 conn(0x7fed04077220 msgr2=0x7fed040fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 shutdown_connections 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:12.823+0000 7fed088b6700 1 -- 172.21.15.35:0/685222839 wait complete. 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 -- 172.21.15.35:0/2192018398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 msgr2=0x7ff3600ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 --2- 172.21.15.35:0/2192018398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff3600ff720 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ff3500099c0 tx=0x7ff350009cd0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 -- 172.21.15.35:0/2192018398 shutdown_connections 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 --2- 172.21.15.35:0/2192018398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff360104390 0x7ff36010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 --2- 172.21.15.35:0/2192018398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff3600ff720 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 --2- 172.21.15.35:0/2192018398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3600ffcf0 0x7ff360103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 -- 172.21.15.35:0/2192018398 >> 172.21.15.35:0/2192018398 conn(0x7ff360076330 msgr2=0x7ff360076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 -- 172.21.15.35:0/2192018398 shutdown_connections 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.944+0000 7ff367a14700 1 -- 172.21.15.35:0/2192018398 wait complete. 2023-03-17T09:56:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 Processor -- start 2023-03-17T09:56:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 -- start start 2023-03-17T09:56:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff360197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3600ffcf0 0x7ff3601975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:43.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:29 smithi035 ceph-mon[92535]: pgmap v2016: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:56:44.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:31 smithi035 ceph-mon[92535]: pgmap v2017: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T09:56:44.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:33 smithi035 ceph-mon[92535]: pgmap v2018: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:56:44.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:35 smithi035 ceph-mon[92535]: pgmap v2019: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:56:44.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:37 smithi035 ceph-mon[92535]: pgmap v2020: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:56:44.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:39 smithi035 ceph-mon[92535]: pgmap v2021: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:56:44.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:41 smithi035 ceph-mon[92535]: pgmap v2022: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:56:44.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:43 smithi035 ceph-mon[92535]: pgmap v2023: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:56:44.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:45 smithi035 ceph-mon[92535]: pgmap v2024: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:56:44.716 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:47 smithi035 ceph-mon[92535]: pgmap v2025: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:56:44.716 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:49 smithi035 ceph-mon[92535]: pgmap v2026: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:56:44.716 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:51 smithi035 ceph-mon[92535]: pgmap v2027: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:56:44.716 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:53 smithi035 ceph-mon[92535]: pgmap v2028: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:56:44.717 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:56:44.717 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:55 smithi035 ceph-mon[92535]: pgmap v2029: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:56:45.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:56:46.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:56:46.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:56:46.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:56 smithi035 ceph-mon[92535]: pgmap v2030: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 757 B/s wr, 10 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:56 smithi035 ceph-mon[92535]: pgmap v2031: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:48:58 smithi035 ceph-mon[92535]: pgmap v2032: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:00 smithi035 ceph-mon[92535]: pgmap v2033: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:02 smithi035 ceph-mon[92535]: pgmap v2034: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:04 smithi035 ceph-mon[92535]: pgmap v2035: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:06 smithi035 ceph-mon[92535]: pgmap v2036: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:56:47.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:08 smithi035 ceph-mon[92535]: pgmap v2037: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:56:48.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:09 smithi035 ceph-mon[92535]: osdmap e203: 12 total, 12 up, 12 in 2023-03-17T09:56:48.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:09 smithi035 ceph-mon[92535]: pgmap v2039: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:56:48.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:12 smithi035 ceph-mon[92535]: pgmap v2040: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:56:48.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:14 smithi035 ceph-mon[92535]: pgmap v2041: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:56:48.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:16 smithi035 ceph-mon[92535]: pgmap v2042: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:56:48.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:16 smithi035 ceph-mon[92535]: osdmap e204: 12 total, 12 up, 12 in 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:18 smithi035 ceph-mon[92535]: pgmap v2044: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:20 smithi035 ceph-mon[92535]: pgmap v2045: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:22 smithi035 ceph-mon[92535]: pgmap v2046: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:24 smithi035 ceph-mon[92535]: pgmap v2047: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:26 smithi035 ceph-mon[92535]: pgmap v2048: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:28 smithi035 ceph-mon[92535]: pgmap v2049: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 456 B/s wr, 14 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:30 smithi035 ceph-mon[92535]: pgmap v2050: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:32 smithi035 ceph-mon[92535]: pgmap v2051: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:34 smithi035 ceph-mon[92535]: pgmap v2052: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:36 smithi035 ceph-mon[92535]: pgmap v2053: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:38 smithi035 ceph-mon[92535]: pgmap v2054: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:40 smithi035 ceph-mon[92535]: pgmap v2055: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:42 smithi035 ceph-mon[92535]: pgmap v2056: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:56:48.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:44 smithi035 ceph-mon[92535]: pgmap v2057: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:56:48.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:56:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:56:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:56:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:56:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:56:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:56:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:56:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff360104390 0x7ff3601a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360197f00 con 0x7ff3600ff350 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601a2640 con 0x7ff3600ffcf0 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff367a14700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601a2800 con 0x7ff360104390 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff3657b0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff360197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff3657b0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff360197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47800/0 (socket says 172.21.15.35:47800) 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff3657b0700 1 -- 172.21.15.35:0/691870606 learned_addr learned my addr 172.21.15.35:0/691870606 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.945+0000 7ff364faf700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3600ffcf0 0x7ff3601975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff365fb1700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff360104390 0x7ff3601a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3657b0700 1 -- 172.21.15.35:0/691870606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff360104390 msgr2=0x7ff3601a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3657b0700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff360104390 0x7ff3601a2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3657b0700 1 -- 172.21.15.35:0/691870606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3600ffcf0 msgr2=0x7ff3601975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3657b0700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3600ffcf0 0x7ff3601975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3657b0700 1 -- 172.21.15.35:0/691870606 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500095f0 con 0x7ff3600ff350 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3657b0700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff360197080 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff350005910 tx=0x7ff35000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3567fc700 1 -- 172.21.15.35:0/691870606 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35001d070 con 0x7ff3600ff350 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3567fc700 1 -- 172.21.15.35:0/691870606 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3500054e0 con 0x7ff3600ff350 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36010f000 con 0x7ff3600ff350 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff3567fc700 1 -- 172.21.15.35:0/691870606 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350004ab0 con 0x7ff3600ff350 2023-03-17T09:56:51.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.946+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36010ee70 con 0x7ff3600ff350 2023-03-17T09:56:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.948+0000 7ff3567fc700 1 -- 172.21.15.35:0/691870606 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff35000fb80 con 0x7ff3600ff350 2023-03-17T09:56:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.949+0000 7ff3567fc700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff34c09f640 0x7ff34c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.949+0000 7ff3567fc700 1 -- 172.21.15.35:0/691870606 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff3500cb4a0 con 0x7ff3600ff350 2023-03-17T09:56:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.949+0000 7ff364faf700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff34c09f640 0x7ff34c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.949+0000 7ff364faf700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff34c09f640 0x7ff34c0a1af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3600688b0 tx=0x7ff35c0073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 Processor -- start 2023-03-17T09:56:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 -- start start 2023-03-17T09:56:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7c3be0 0x55b74b7c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7be420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 0x55b74b7bed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b6c5010 con 0x55b74b7be960 2023-03-17T09:56:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b717950 con 0x55b74b7c3be0 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b710de0 con 0x55b74b7c44f0 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff365fb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 0x55b74b7bed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff365fb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 0x55b74b7bed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47812/0 (socket says 172.21.15.35:47812) 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff365fb1700 1 -- 172.21.15.35:0/2710472353 learned_addr learned my addr 172.21.15.35:0/2710472353 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.950+0000 7ff3657b0700 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7c3be0 0x55b74b7c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff364faf700 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff365fb1700 1 -- 172.21.15.35:0/2710472353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 msgr2=0x55b74b7be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff365fb1700 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7be420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff365fb1700 1 -- 172.21.15.35:0/2710472353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7c3be0 msgr2=0x55b74b7c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff365fb1700 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7c3be0 0x55b74b7c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff365fb1700 1 -- 172.21.15.35:0/2710472353 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b74b5925d0 con 0x55b74b7be960 2023-03-17T09:56:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff364faf700 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff365fb1700 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 0x55b74b7bed90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff358009fd0 tx=0x7ff358009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660c2eadbb69f792 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff34b7fe700 1 -- 172.21.15.35:0/2710472353 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358009e70 con 0x55b74b7be960 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff34b7fe700 1 -- 172.21.15.35:0/2710472353 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff358011040 con 0x55b74b7be960 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.951+0000 7ff34b7fe700 1 -- 172.21.15.35:0/2710472353 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580153f0 con 0x55b74b7be960 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 -- 172.21.15.35:0/2710472353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 msgr2=0x55b74b7bed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 0x55b74b7bed90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff358009fd0 tx=0x7ff358009920 comp rx=0 tx=0).stop 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 -- 172.21.15.35:0/2710472353 shutdown_connections 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7be960 0x55b74b7bed90 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7c3be0 0x55b74b7c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/2710472353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 -- 172.21.15.35:0/2710472353 >> 172.21.15.35:0/2710472353 conn(0x55b74b61b6b0 msgr2=0x55b74b7b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 -- 172.21.15.35:0/2710472353 shutdown_connections 2023-03-17T09:56:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 -- 172.21.15.35:0/2710472353 wait complete. 2023-03-17T09:56:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 -- start start 2023-03-17T09:56:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.952+0000 7ff373ba1b80 1 Processor -- start 2023-03-17T09:56:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b7c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b5948c0 con 0x55b74b7c44f0 2023-03-17T09:56:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7c8460 con 0x55b74b7be960 2023-03-17T09:56:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7d4030 con 0x55b74b7c3be0 2023-03-17T09:56:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff373ba1b80 10 client.0 _ll_register_callbacks cb 0x55b74b5b6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47818/0 (socket says 172.21.15.35:47818) 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 -- 172.21.15.35:0/596219402 learned_addr learned my addr 172.21.15.35:0/596219402 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff3657b0700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff364faf700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b7c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 -- 172.21.15.35:0/596219402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 msgr2=0x55b74b7c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b7c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 -- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 msgr2=0x55b74b7ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 -- 172.21.15.35:0/596219402 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff358009050 con 0x55b74b7c44f0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff365fb1700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7c7cf0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff358000f80 tx=0x7ff358004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7be7aaeb5da1f51 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.953+0000 7ff348ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:56:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff348ff9700 1 -- 172.21.15.35:0/596219402 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358004930 con 0x55b74b7c44f0 2023-03-17T09:56:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff348ff9700 1 -- 172.21.15.35:0/596219402 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff358003a00 con 0x55b74b7c44f0 2023-03-17T09:56:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b74b6d3390 con 0x55b74b7c44f0 2023-03-17T09:56:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff348ff9700 1 -- 172.21.15.35:0/596219402 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff358003be0 con 0x55b74b7c44f0 2023-03-17T09:56:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 10 client.17724 fetch_fsmap learned FSMap version 36 2023-03-17T09:56:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b74b53ed80 con 0x55b74b7c44f0 2023-03-17T09:56:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff348ff9700 1 -- 172.21.15.35:0/596219402 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b74b6d3390 con 0x55b74b7c44f0 2023-03-17T09:56:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff348ff9700 1 -- 172.21.15.35:0/596219402 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff358005840 con 0x55b74b7c44f0 2023-03-17T09:56:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 10 client.17724 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:56:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 10 client.17724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:56:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 20 client.17724 populate_metadata read hostname 'smithi035' 2023-03-17T09:56:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b7d8000 0x55b74b7da410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 4 client.17724 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:56:56.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.954+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b74b6df600 con 0x55b74b7d8000 2023-03-17T09:56:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.955+0000 7ff3657b0700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b7d8000 0x55b74b7da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.955+0000 7ff348ff9700 10 client.17724 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.955+0000 7ff3657b0700 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b7d8000 0x55b74b7da410 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d822031be1754c9 server_cookie=6af023cfcbc2524 in_seq=0 out_seq=0 2023-03-17T09:56:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff348ff9700 1 -- 172.21.15.35:0/596219402 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b74b6df600 con 0x55b74b7d8000 2023-03-17T09:56:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff348ff9700 10 client.17724 handle_command_reply: tid=0 2023-03-17T09:56:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 client.17724 shutdown 2023-03-17T09:56:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 msgr2=0x55b74b7c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:56:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7c7cf0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff358000f80 tx=0x7ff358004f90 comp rx=0 tx=0).stop 2023-03-17T09:56:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 shutdown_connections 2023-03-17T09:56:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b7d8000 0x55b74b7da410 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7c7cf0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff348ff9700 0 client.17724 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:56:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/596219402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b7c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 >> 172.21.15.35:0/596219402 conn(0x55b74b61b6b0 msgr2=0x55b74b7b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 shutdown_connections 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 1 -- 172.21.15.35:0/596219402 wait complete. 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.956+0000 7ff373ba1b80 20 client.17724 trim_cache size 0 max 16384 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 Processor -- start 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 -- start start 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 0x55b74b7c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7b55c0 con 0x55b74b7c3be0 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7b9e10 con 0x55b74b7be960 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7b96d0 con 0x55b74b7c44f0 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff364faf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 0x55b74b7c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff364faf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 0x55b74b7c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47824/0 (socket says 172.21.15.35:47824) 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.971+0000 7ff364faf700 1 -- 172.21.15.35:0/3369645431 learned_addr learned my addr 172.21.15.35:0/3369645431 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff3657b0700 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff364faf700 1 -- 172.21.15.35:0/3369645431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 msgr2=0x55b74b7c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff364faf700 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:58.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff364faf700 1 -- 172.21.15.35:0/3369645431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 msgr2=0x55b74b7b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:56:58.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff364faf700 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7b8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:56:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff364faf700 1 -- 172.21.15.35:0/3369645431 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b74b7bf000 con 0x55b74b7c3be0 2023-03-17T09:56:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff3657b0700 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:56:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff364faf700 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 0x55b74b7c2f10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff36006a350 tx=0x7ff35c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95682f9980af80b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff34bfff700 1 -- 172.21.15.35:0/3369645431 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c011e30 con 0x55b74b7c3be0 2023-03-17T09:57:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff34bfff700 1 -- 172.21.15.35:0/3369645431 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff35c015070 con 0x55b74b7c3be0 2023-03-17T09:57:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.972+0000 7ff34bfff700 1 -- 172.21.15.35:0/3369645431 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c01e680 con 0x55b74b7c3be0 2023-03-17T09:57:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3369645431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 msgr2=0x55b74b7c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 0x55b74b7c2f10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff36006a350 tx=0x7ff35c013000 comp rx=0 tx=0).stop 2023-03-17T09:57:01.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3369645431 shutdown_connections 2023-03-17T09:57:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c44f0 0x55b74b7c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b7b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3369645431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c3be0 0x55b74b7c2f10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3369645431 >> 172.21.15.35:0/3369645431 conn(0x55b74b61b6b0 msgr2=0x55b74b7c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3369645431 shutdown_connections 2023-03-17T09:57:01.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3369645431 wait complete. 2023-03-17T09:57:01.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- start start 2023-03-17T09:57:01.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 Processor -- start 2023-03-17T09:57:01.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b825160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b8256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:03.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7cd630 con 0x55b74b7c44f0 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7cd7a0 con 0x55b74b7be960 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.973+0000 7ff373ba1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b74b7cd960 con 0x55b74b7c3be0 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff373ba1b80 10 client.0 _ll_register_callbacks cb 0x55b74b5b6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff3657b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b825160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47832/0 (socket says 172.21.15.35:47832) 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 -- 172.21.15.35:0/3861227126 learned_addr learned my addr 172.21.15.35:0/3861227126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff364faf700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b8256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:03.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 -- 172.21.15.35:0/3861227126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 msgr2=0x55b74b8256a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:03.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b8256a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:03.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 -- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 msgr2=0x55b74b825160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:03.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:46 smithi035 ceph-mon[92535]: pgmap v2058: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:57:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b825160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 -- 172.21.15.35:0/3861227126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c010b60 con 0x55b74b7c44f0 2023-03-17T09:57:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff3657b0700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b825160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:57:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff365fb1700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7ccf60 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff358005bd0 tx=0x7ff3580049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3e14626c641383 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff348ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:57:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff348ff9700 1 -- 172.21.15.35:0/3861227126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35801eb90 con 0x55b74b7c44f0 2023-03-17T09:57:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff348ff9700 1 -- 172.21.15.35:0/3861227126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff358009580 con 0x55b74b7c44f0 2023-03-17T09:57:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b74b78e1e0 con 0x55b74b7c44f0 2023-03-17T09:57:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff348ff9700 1 -- 172.21.15.35:0/3861227126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff35801ecf0 con 0x55b74b7c44f0 2023-03-17T09:57:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff373ba1b80 10 client.17730 fetch_fsmap learned FSMap version 36 2023-03-17T09:57:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.974+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55b74b527c00 con 0x55b74b7c44f0 2023-03-17T09:57:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff348ff9700 1 -- 172.21.15.35:0/3861227126 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff35803f020 con 0x55b74b7c44f0 2023-03-17T09:57:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff348ff9700 1 -- 172.21.15.35:0/3861227126 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff35803b470 con 0x55b74b7c44f0 2023-03-17T09:57:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff373ba1b80 10 client.17730 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:57:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff373ba1b80 10 client.17730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:57:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff373ba1b80 20 client.17730 populate_metadata read hostname 'smithi035' 2023-03-17T09:57:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b82cbd0 0x55b74b82efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff373ba1b80 4 client.17730 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b74b594f00 con 0x55b74b82cbd0 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.975+0000 7ff3657b0700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b82cbd0 0x55b74b82efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.976+0000 7ff348ff9700 10 client.17730 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.976+0000 7ff3657b0700 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b82cbd0 0x55b74b82efe0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3a0f5e12a7447b server_cookie=eedd9103ed44be4f in_seq=0 out_seq=0 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff348ff9700 1 -- 172.21.15.35:0/3861227126 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b74b594f00 con 0x55b74b82cbd0 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff348ff9700 10 client.17730 handle_command_reply: tid=0 2023-03-17T09:57:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 client.17730 shutdown 2023-03-17T09:57:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 msgr2=0x55b74b7ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7ccf60 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff358005bd0 tx=0x7ff3580049e0 comp rx=0 tx=0).stop 2023-03-17T09:57:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 shutdown_connections 2023-03-17T09:57:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b74b82cbd0 0x55b74b82efe0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b74b7c44f0 0x55b74b7ccf60 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff348ff9700 0 client.17730 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:57:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b74b7be960 0x55b74b825160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 --2- 172.21.15.35:0/3861227126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b74b7c3be0 0x55b74b8256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 >> 172.21.15.35:0/3861227126 conn(0x55b74b61b6b0 msgr2=0x55b74b7c3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 shutdown_connections 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.980+0000 7ff373ba1b80 1 -- 172.21.15.35:0/3861227126 wait complete. 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff373ba1b80 20 client.17730 trim_cache size 0 max 16384 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff34c09f640 msgr2=0x7ff34c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff34c09f640 0x7ff34c0a1af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3600688b0 tx=0x7ff35c0073d0 comp rx=0 tx=0).stop 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 msgr2=0x7ff360197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff360197080 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff350005910 tx=0x7ff35000f690 comp rx=0 tx=0).stop 2023-03-17T09:57:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 shutdown_connections 2023-03-17T09:57:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff34c09f640 0x7ff34c0a1af0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff360104390 0x7ff3601a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff3600ff350 0x7ff360197080 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 --2- 172.21.15.35:0/691870606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3600ffcf0 0x7ff3601975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 >> 172.21.15.35:0/691870606 conn(0x7ff360076330 msgr2=0x7ff360102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 shutdown_connections 2023-03-17T09:57:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:34:25.981+0000 7ff367a14700 1 -- 172.21.15.35:0/691870606 wait complete. 2023-03-17T09:57:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 -- 172.21.15.35:0/2042452482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74780ff350 msgr2=0x7f74780ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 --2- 172.21.15.35:0/2042452482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74780ff350 0x7f74780ff720 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f74680099c0 tx=0x7f7468009cd0 comp rx=0 tx=0).stop 2023-03-17T09:57:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 -- 172.21.15.35:0/2042452482 shutdown_connections 2023-03-17T09:57:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 --2- 172.21.15.35:0/2042452482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7478104390 0x7f747810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 --2- 172.21.15.35:0/2042452482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74780ff350 0x7f74780ff720 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 --2- 172.21.15.35:0/2042452482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74780ffcf0 0x7f7478103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 -- 172.21.15.35:0/2042452482 >> 172.21.15.35:0/2042452482 conn(0x7f7478076330 msgr2=0x7f7478076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 -- 172.21.15.35:0/2042452482 shutdown_connections 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.117+0000 7f747cf8f700 1 -- 172.21.15.35:0/2042452482 wait complete. 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.118+0000 7f747cf8f700 1 Processor -- start 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.118+0000 7f747cf8f700 1 -- start start 2023-03-17T09:57:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747cf8f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780ff350 0x7f7478197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747cf8f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74780ffcf0 0x7f74781975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747cf8f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 0x7f74781a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747cf8f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478197f00 con 0x7f7478104390 2023-03-17T09:57:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747cf8f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74781a2640 con 0x7f74780ffcf0 2023-03-17T09:57:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747cf8f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74781a2800 con 0x7f74780ff350 2023-03-17T09:57:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 0x7f74781a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 0x7f74781a2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47846/0 (socket says 172.21.15.35:47846) 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 -- 172.21.15.35:0/420956982 learned_addr learned my addr 172.21.15.35:0/420956982 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f747659c700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780ff350 0x7f7478197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7475d9b700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74780ffcf0 0x7f74781975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 -- 172.21.15.35:0/420956982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780ff350 msgr2=0x7f7478197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780ff350 0x7f7478197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 -- 172.21.15.35:0/420956982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74780ffcf0 msgr2=0x7f74781975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74780ffcf0 0x7f74781975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 -- 172.21.15.35:0/420956982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680095f0 con 0x7f7478104390 2023-03-17T09:57:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.119+0000 7f7476d9d700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 0x7f74781a2100 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7470007ee0 tx=0x7f747000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.120+0000 7f74677fe700 1 -- 172.21.15.35:0/420956982 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470017070 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.120+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747810f030 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.120+0000 7f74677fe700 1 -- 172.21.15.35:0/420956982 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f747000f040 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.120+0000 7f74677fe700 1 -- 172.21.15.35:0/420956982 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470005570 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.120+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747810eea0 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.122+0000 7f74677fe700 1 -- 172.21.15.35:0/420956982 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f747000db20 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.122+0000 7f74677fe700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746009f640 0x7f74600a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.122+0000 7f74677fe700 1 -- 172.21.15.35:0/420956982 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74700c9700 con 0x7f7478104390 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.122+0000 7f747659c700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746009f640 0x7f74600a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.123+0000 7f747659c700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746009f640 0x7f74600a1af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f746800b580 tx=0x7f7468009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.123+0000 7f748911cb80 1 Processor -- start 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.123+0000 7f748911cb80 1 -- start start 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f748911cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f748911cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29f9d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f748911cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29f9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f748911cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29ea4010 con 0x55ad29fa34f0 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f748911cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29ef6950 con 0x55ad29f9d960 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f748911cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29eefde0 con 0x55ad29fa2be0 2023-03-17T09:57:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29f9d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29f9d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47852/0 (socket says 172.21.15.35:47852) 2023-03-17T09:57:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 -- 172.21.15.35:0/2532883217 learned_addr learned my addr 172.21.15.35:0/2532883217 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f747659c700 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7476d9d700 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29f9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 -- 172.21.15.35:0/2532883217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 msgr2=0x55ad29fa2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 -- 172.21.15.35:0/2532883217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 msgr2=0x55ad29f9dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29f9dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 -- 172.21.15.35:0/2532883217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad29d715d0 con 0x55ad29fa34f0 2023-03-17T09:57:17.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.124+0000 7f7475d9b700 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29f9d420 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f746c007bf0 tx=0x7f746c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de35827b9d5bcf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f7464ff9700 1 -- 172.21.15.35:0/2532883217 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c010cf0 con 0x55ad29fa34f0 2023-03-17T09:57:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f7464ff9700 1 -- 172.21.15.35:0/2532883217 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f746c010e50 con 0x55ad29fa34f0 2023-03-17T09:57:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f7464ff9700 1 -- 172.21.15.35:0/2532883217 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c003e40 con 0x55ad29fa34f0 2023-03-17T09:57:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 -- 172.21.15.35:0/2532883217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 msgr2=0x55ad29f9d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29f9d420 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f746c007bf0 tx=0x7f746c007f00 comp rx=0 tx=0).stop 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 -- 172.21.15.35:0/2532883217 shutdown_connections 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29f9dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 --2- 172.21.15.35:0/2532883217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29f9d420 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 -- 172.21.15.35:0/2532883217 >> 172.21.15.35:0/2532883217 conn(0x55ad29dfa6b0 msgr2=0x55ad29f97a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 -- 172.21.15.35:0/2532883217 shutdown_connections 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.125+0000 7f748911cb80 1 -- 172.21.15.35:0/2532883217 wait complete. 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 -- start start 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 Processor -- start 2023-03-17T09:57:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fa93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fa66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa34f0 0x55ad29fa6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29d738c0 con 0x55ad29fa2be0 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29fa7400 con 0x55ad29f9d960 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29fb3060 con 0x55ad29fa34f0 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f748911cb80 10 client.0 _ll_register_callbacks cb 0x55ad29d95230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fa66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fa66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47858/0 (socket says 172.21.15.35:47858) 2023-03-17T09:57:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f7475d9b700 1 -- 172.21.15.35:0/1892073888 learned_addr learned my addr 172.21.15.35:0/1892073888 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.126+0000 7f747659c700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fa93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7476d9d700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa34f0 0x55ad29fa6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7475d9b700 1 -- 172.21.15.35:0/1892073888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa34f0 msgr2=0x55ad29fa6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7475d9b700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa34f0 0x55ad29fa6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7475d9b700 1 -- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 msgr2=0x55ad29fa93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7475d9b700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fa93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7475d9b700 1 -- 172.21.15.35:0/1892073888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c0078a0 con 0x55ad29fa2be0 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f747659c700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fa93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f7475d9b700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fa66d0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f746c007bc0 tx=0x7f746c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85408b4d0bf2ff7c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f745dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f745dffb700 1 -- 172.21.15.35:0/1892073888 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c01f070 con 0x55ad29fa2be0 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad29eb2390 con 0x55ad29fa2be0 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f745dffb700 1 -- 172.21.15.35:0/1892073888 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f746c003bf0 con 0x55ad29fa2be0 2023-03-17T09:57:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f745dffb700 1 -- 172.21.15.35:0/1892073888 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f746c003db0 con 0x55ad29fa2be0 2023-03-17T09:57:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f748911cb80 10 client.17742 fetch_fsmap learned FSMap version 36 2023-03-17T09:57:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.127+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ad29d1dd80 con 0x55ad29fa2be0 2023-03-17T09:57:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f745dffb700 1 -- 172.21.15.35:0/1892073888 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ad29eb2390 con 0x55ad29fa2be0 2023-03-17T09:57:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f745dffb700 1 -- 172.21.15.35:0/1892073888 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f746c005500 con 0x55ad29fa2be0 2023-03-17T09:57:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f748911cb80 10 client.17742 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:57:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f748911cb80 10 client.17742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f748911cb80 20 client.17742 populate_metadata read hostname 'smithi035' 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f748911cb80 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad29fb6fb0 0x55ad29fb93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f748911cb80 4 client.17742 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad29ebe600 con 0x55ad29fb6fb0 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.128+0000 7f747659c700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad29fb6fb0 0x55ad29fb93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.129+0000 7f745dffb700 10 client.17742 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.129+0000 7f747659c700 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad29fb6fb0 0x55ad29fb93c0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc5659bd20e4b7a8 server_cookie=989c329c0b0f1ee in_seq=0 out_seq=0 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.129+0000 7f745dffb700 1 -- 172.21.15.35:0/1892073888 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ad29ebe600 con 0x55ad29fb6fb0 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.129+0000 7f745dffb700 10 client.17742 handle_command_reply: tid=0 2023-03-17T09:57:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.129+0000 7f748911cb80 1 client.17742 shutdown 2023-03-17T09:57:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 msgr2=0x55ad29fa66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fa66d0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f746c007bc0 tx=0x7f746c010d20 comp rx=0 tx=0).stop 2023-03-17T09:57:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 shutdown_connections 2023-03-17T09:57:25.724 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:48 smithi035 ceph-mon[92535]: pgmap v2059: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad29fb6fb0 0x55ad29fb93c0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa34f0 0x55ad29fa6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fa93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f745dffb700 0 client.17742 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 --2- 172.21.15.35:0/1892073888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fa66d0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 >> 172.21.15.35:0/1892073888 conn(0x55ad29dfa6b0 msgr2=0x55ad29f9c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 shutdown_connections 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 1 -- 172.21.15.35:0/1892073888 wait complete. 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.130+0000 7f748911cb80 20 client.17742 trim_cache size 0 max 16384 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 Processor -- start 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 -- start start 2023-03-17T09:57:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fadfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29fa5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29eb2390 con 0x55ad29fa34f0 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29f930f0 con 0x55ad29f9d960 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f748911cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29fb3ae0 con 0x55ad29fa2be0 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f7476d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29fa5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f7476d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29fa5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47868/0 (socket says 172.21.15.35:47868) 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f7476d9d700 1 -- 172.21.15.35:0/387781228 learned_addr learned my addr 172.21.15.35:0/387781228 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f747659c700 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fadfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.145+0000 7f7475d9b700 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f7476d9d700 1 -- 172.21.15.35:0/387781228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 msgr2=0x55ad29fa8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f7476d9d700 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f7476d9d700 1 -- 172.21.15.35:0/387781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 msgr2=0x55ad29fadfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:28.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f7476d9d700 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fadfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f7476d9d700 1 -- 172.21.15.35:0/387781228 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad29eb6130 con 0x55ad29fa34f0 2023-03-17T09:57:28.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f7476d9d700 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29fa5eb0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7470096eb0 tx=0x7f7470096f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57b448989b6f397 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f74657fa700 1 -- 172.21.15.35:0/387781228 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470004c40 con 0x55ad29fa34f0 2023-03-17T09:57:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f74657fa700 1 -- 172.21.15.35:0/387781228 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74700971b0 con 0x55ad29fa34f0 2023-03-17T09:57:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f74657fa700 1 -- 172.21.15.35:0/387781228 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470093aa0 con 0x55ad29fa34f0 2023-03-17T09:57:30.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f748911cb80 1 -- 172.21.15.35:0/387781228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 msgr2=0x55ad29fa5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.146+0000 7f748911cb80 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29fa5eb0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7470096eb0 tx=0x7f7470096f80 comp rx=0 tx=0).stop 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- 172.21.15.35:0/387781228 shutdown_connections 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa34f0 0x55ad29fa5eb0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29f9d960 0x55ad29fadfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 --2- 172.21.15.35:0/387781228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29fa2be0 0x55ad29fa8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- 172.21.15.35:0/387781228 >> 172.21.15.35:0/387781228 conn(0x55ad29dfa6b0 msgr2=0x55ad29fb3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- 172.21.15.35:0/387781228 shutdown_connections 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- 172.21.15.35:0/387781228 wait complete. 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- start start 2023-03-17T09:57:31.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 Processor -- start 2023-03-17T09:57:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29f9d960 0x55ad29fadcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fabfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29fa34f0 0x55ad29fac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29fae580 con 0x55ad29fa2be0 2023-03-17T09:57:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29faca50 con 0x55ad29fa34f0 2023-03-17T09:57:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad29facbe0 con 0x55ad29f9d960 2023-03-17T09:57:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f748911cb80 10 client.0 _ll_register_callbacks cb 0x55ad29d95230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:57:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fabfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fabfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47872/0 (socket says 172.21.15.35:47872) 2023-03-17T09:57:36.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.147+0000 7f7475d9b700 1 -- 172.21.15.35:0/1983582850 learned_addr learned my addr 172.21.15.35:0/1983582850 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:36.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7476d9d700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29fa34f0 0x55ad29fac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:36.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f747659c700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29f9d960 0x55ad29fadcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:36.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7475d9b700 1 -- 172.21.15.35:0/1983582850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29f9d960 msgr2=0x55ad29fadcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:36.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7475d9b700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29f9d960 0x55ad29fadcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:36.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7475d9b700 1 -- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29fa34f0 msgr2=0x55ad29fac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7475d9b700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29fa34f0 0x55ad29fac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:36.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7475d9b700 1 -- 172.21.15.35:0/1983582850 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747810eea0 con 0x55ad29fa2be0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f7475d9b700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fabfd0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f746c02ca80 tx=0x7f746c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801fa5223aa870cb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f745dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f745dffb700 1 -- 172.21.15.35:0/1983582850 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c01f040 con 0x55ad29fa2be0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f745dffb700 1 -- 172.21.15.35:0/1983582850 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f746c000e40 con 0x55ad29fa2be0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad29f6d1e0 con 0x55ad29fa2be0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f745dffb700 1 -- 172.21.15.35:0/1983582850 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f746c02cee0 con 0x55ad29fa2be0 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f748911cb80 10 client.17748 fetch_fsmap learned FSMap version 36 2023-03-17T09:57:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55ad29d441f0 con 0x55ad29fa2be0 2023-03-17T09:57:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f745dffb700 1 -- 172.21.15.35:0/1983582850 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ad29f6d1e0 con 0x55ad29fa2be0 2023-03-17T09:57:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.148+0000 7f745dffb700 1 -- 172.21.15.35:0/1983582850 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 36) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f746c039bf0 con 0x55ad29fa2be0 2023-03-17T09:57:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f748911cb80 10 client.17748 fetch_fsmap finished waiting for FSMap version 36 2023-03-17T09:57:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f748911cb80 10 client.17748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:57:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f748911cb80 20 client.17748 populate_metadata read hostname 'smithi035' 2023-03-17T09:57:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f748911cb80 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad2a00be10 0x55ad2a00e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f748911cb80 4 client.17748 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ad29d73f00 con 0x55ad2a00be10 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f747659c700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad2a00be10 0x55ad2a00e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f745dffb700 10 client.17748 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:02.149+0000 7f747659c700 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad2a00be10 0x55ad2a00e220 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59aadfc15be61502 server_cookie=1a97056af76daedb in_seq=0 out_seq=0 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f745dffb700 1 -- 172.21.15.35:0/1983582850 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ad29d73f00 con 0x55ad2a00be10 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f745dffb700 10 client.17748 handle_command_reply: tid=0 2023-03-17T09:57:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 client.17748 shutdown 2023-03-17T09:57:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 msgr2=0x55ad29fabfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fabfd0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f746c02ca80 tx=0x7f746c0075f0 comp rx=0 tx=0).stop 2023-03-17T09:57:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 shutdown_connections 2023-03-17T09:57:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ad2a00be10 0x55ad2a00e220 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ad29fa34f0 0x55ad29fac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad29f9d960 0x55ad29fadcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f745dffb700 0 client.17748 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:57:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 --2- 172.21.15.35:0/1983582850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ad29fa2be0 0x55ad29fabfd0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 >> 172.21.15.35:0/1983582850 conn(0x55ad29dfa6b0 msgr2=0x55ad29fa0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 shutdown_connections 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 1 -- 172.21.15.35:0/1983582850 wait complete. 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.271+0000 7f748911cb80 20 client.17748 trim_cache size 0 max 16384 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746009f640 msgr2=0x7f74600a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746009f640 0x7f74600a1af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f746800b580 tx=0x7f7468009f10 comp rx=0 tx=0).stop 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 msgr2=0x7f74781a2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 0x7f74781a2100 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7470007ee0 tx=0x7f747000d3b0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 shutdown_connections 2023-03-17T09:57:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746009f640 0x7f74600a1af0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7478104390 0x7f74781a2100 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780ff350 0x7f7478197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 --2- 172.21.15.35:0/420956982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74780ffcf0 0x7f74781975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 >> 172.21.15.35:0/420956982 conn(0x7f7478076330 msgr2=0x7f74780fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:43.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 shutdown_connections 2023-03-17T09:57:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:03.272+0000 7f747cf8f700 1 -- 172.21.15.35:0/420956982 wait complete. 2023-03-17T09:57:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 -- 172.21.15.35:0/3127932829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ff350 msgr2=0x7f73a40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3127932829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ff350 0x7f73a40ff720 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f738c0099c0 tx=0x7f738c009cd0 comp rx=0 tx=0).stop 2023-03-17T09:57:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 -- 172.21.15.35:0/3127932829 shutdown_connections 2023-03-17T09:57:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3127932829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73a4104390 0x7f73a410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3127932829 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ff350 0x7f73a40ff720 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3127932829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a40ffcf0 0x7f73a4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 -- 172.21.15.35:0/3127932829 >> 172.21.15.35:0/3127932829 conn(0x7f73a4076330 msgr2=0x7f73a4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 -- 172.21.15.35:0/3127932829 shutdown_connections 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 -- 172.21.15.35:0/3127932829 wait complete. 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.399+0000 7f73a9f02700 1 Processor -- start 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 -- start start 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73a40ff350 0x7f73a41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 0x7f73a41975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a4104390 0x7f73a41a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4197f00 con 0x7f73a40ffcf0 2023-03-17T09:57:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a41a2670 con 0x7f73a40ff350 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a9f02700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a41a27e0 con 0x7f73a4104390 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 0x7f73a41975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 0x7f73a41975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47908/0 (socket says 172.21.15.35:47908) 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 -- 172.21.15.35:0/3708461477 learned_addr learned my addr 172.21.15.35:0/3708461477 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a37fe700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73a40ff350 0x7f73a41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a3fff700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a4104390 0x7f73a41a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 -- 172.21.15.35:0/3708461477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a4104390 msgr2=0x7f73a41a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a4104390 0x7f73a41a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 -- 172.21.15.35:0/3708461477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73a40ff350 msgr2=0x7f73a41970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.400+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73a40ff350 0x7f73a41970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a2ffd700 1 -- 172.21.15.35:0/3708461477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0095f0 con 0x7f73a40ffcf0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 0x7f73a41975f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f739400c9b0 tx=0x7f739400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a0ff9700 1 -- 172.21.15.35:0/3708461477 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394007aa0 con 0x7f73a40ffcf0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a410f050 con 0x7f73a40ffcf0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a0ff9700 1 -- 172.21.15.35:0/3708461477 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f739400ce50 con 0x7f73a40ffcf0 2023-03-17T09:57:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a0ff9700 1 -- 172.21.15.35:0/3708461477 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394018400 con 0x7f73a40ffcf0 2023-03-17T09:57:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.401+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a410eec0 con 0x7f73a40ffcf0 2023-03-17T09:57:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.403+0000 7f73a0ff9700 1 -- 172.21.15.35:0/3708461477 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f739400f450 con 0x7f73a40ffcf0 2023-03-17T09:57:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.404+0000 7f73a0ff9700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f739009f640 0x7f73900a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.404+0000 7f73a0ff9700 1 -- 172.21.15.35:0/3708461477 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f73940ca4a0 con 0x7f73a40ffcf0 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.404+0000 7f73a37fe700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f739009f640 0x7f73900a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.404+0000 7f73a37fe700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f739009f640 0x7f73900a1af0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f738c000c00 tx=0x7f738c009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 Processor -- start 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 -- start start 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c40ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c411c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c4125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c310010 con 0x55e84c40da20 2023-03-17T09:57:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c362950 con 0x55e84c40e330 2023-03-17T09:57:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73b608fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c35bde0 con 0x55e84c412170 2023-03-17T09:57:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c40ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c40ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47914/0 (socket says 172.21.15.35:47914) 2023-03-17T09:57:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 -- 172.21.15.35:0/987829831 learned_addr learned my addr 172.21.15.35:0/987829831 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a3fff700 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c4125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c411c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 -- 172.21.15.35:0/987829831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 msgr2=0x55e84c4125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c4125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 -- 172.21.15.35:0/987829831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 msgr2=0x55e84c411c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c411c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a37fe700 1 -- 172.21.15.35:0/987829831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e84c1dd5d0 con 0x55e84c40da20 2023-03-17T09:57:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.405+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c411c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:57:53.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:50 smithi035 ceph-mon[92535]: pgmap v2060: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:57:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73a37fe700 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c40ddf0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f738c015000 tx=0x7f738c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e05eaf8d54762 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f7399ffb700 1 -- 172.21.15.35:0/987829831 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c003820 con 0x55e84c40da20 2023-03-17T09:57:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f7399ffb700 1 -- 172.21.15.35:0/987829831 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f738c01e040 con 0x55e84c40da20 2023-03-17T09:57:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f7399ffb700 1 -- 172.21.15.35:0/987829831 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c00f980 con 0x55e84c40da20 2023-03-17T09:57:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 -- 172.21.15.35:0/987829831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 msgr2=0x55e84c40ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:57:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c40ddf0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f738c015000 tx=0x7f738c020000 comp rx=0 tx=0).stop 2023-03-17T09:57:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 -- 172.21.15.35:0/987829831 shutdown_connections 2023-03-17T09:57:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c4125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c40ddf0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 --2- 172.21.15.35:0/987829831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c411c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.406+0000 7f73b608fb80 1 -- 172.21.15.35:0/987829831 >> 172.21.15.35:0/987829831 conn(0x55e84c2666b0 msgr2=0x55e84c403a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:57:58.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 -- 172.21.15.35:0/987829831 shutdown_connections 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 -- 172.21.15.35:0/987829831 wait complete. 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 -- start start 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 Processor -- start 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c419870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c416af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c417170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c1df8c0 con 0x55e84c40da20 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c4178b0 con 0x55e84c40e330 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c4233e0 con 0x55e84c412170 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.407+0000 7f73b608fb80 10 client.0 _ll_register_callbacks cb 0x55e84c201230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c419870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c419870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47920/0 (socket says 172.21.15.35:47920) 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 -- 172.21.15.35:0/4136423575 learned_addr learned my addr 172.21.15.35:0/4136423575 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a3fff700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c417170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c416af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:57:59.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 -- 172.21.15.35:0/4136423575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 msgr2=0x55e84c417170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c417170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 -- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 msgr2=0x55e84c416af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:57:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c416af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:57:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 -- 172.21.15.35:0/4136423575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a410c7a0 con 0x55e84c40da20 2023-03-17T09:57:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73a37fe700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c419870 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f738c0098e0 tx=0x7f738c0042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfad0212b015c86b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:57:59.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f7382ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:58:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f7382ffd700 1 -- 172.21.15.35:0/4136423575 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c003a30 con 0x55e84c40da20 2023-03-17T09:58:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f7382ffd700 1 -- 172.21.15.35:0/4136423575 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f738c003b90 con 0x55e84c40da20 2023-03-17T09:58:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e84c31e390 con 0x55e84c40da20 2023-03-17T09:58:04.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f7382ffd700 1 -- 172.21.15.35:0/4136423575 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f738c003d90 con 0x55e84c40da20 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73b608fb80 10 client.17766 fetch_fsmap learned FSMap version 37 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.408+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e84c189d80 con 0x55e84c40da20 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f7382ffd700 1 -- 172.21.15.35:0/4136423575 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e84c31e390 con 0x55e84c40da20 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f7382ffd700 1 -- 172.21.15.35:0/4136423575 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f738c024be0 con 0x55e84c40da20 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73b608fb80 10 client.17766 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73b608fb80 10 client.17766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:58:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73b608fb80 20 client.17766 populate_metadata read hostname 'smithi035' 2023-03-17T09:58:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c426f10 0x55e84c4292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73b608fb80 4 client.17766 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e84c32a600 con 0x55e84c426f10 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.409+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c426f10 0x55e84c4292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f7382ffd700 10 client.17766 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c426f10 0x55e84c4292f0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e1f38204ebf8d81 server_cookie=597be01c417f852 in_seq=0 out_seq=0 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f7382ffd700 1 -- 172.21.15.35:0/4136423575 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e84c32a600 con 0x55e84c426f10 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f7382ffd700 10 client.17766 handle_command_reply: tid=0 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 client.17766 shutdown 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 msgr2=0x55e84c419870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c419870 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f738c0098e0 tx=0x7f738c0042a0 comp rx=0 tx=0).stop 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 shutdown_connections 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c426f10 0x55e84c4292f0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c417170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40da20 0x55e84c419870 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f7382ffd700 0 client.17766 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4136423575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c416af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.410+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 >> 172.21.15.35:0/4136423575 conn(0x55e84c2666b0 msgr2=0x55e84c408410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.411+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 shutdown_connections 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.411+0000 7f73b608fb80 1 -- 172.21.15.35:0/4136423575 wait complete. 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.411+0000 7f73b608fb80 20 client.17766 trim_cache size 0 max 16384 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 Processor -- start 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 -- start start 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40da20 0x55e84c41e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 0x55e84c419410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c414550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c3ff0f0 con 0x55e84c40e330 2023-03-17T09:58:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c4046d0 con 0x55e84c40da20 2023-03-17T09:58:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73b608fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c4180a0 con 0x55e84c412170 2023-03-17T09:58:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 0x55e84c419410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 0x55e84c419410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47930/0 (socket says 172.21.15.35:47930) 2023-03-17T09:58:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 -- 172.21.15.35:0/119705740 learned_addr learned my addr 172.21.15.35:0/119705740 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a3fff700 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c414550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 -- 172.21.15.35:0/119705740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 msgr2=0x55e84c414550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c414550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 -- 172.21.15.35:0/119705740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40da20 msgr2=0x55e84c41e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a37fe700 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40da20 0x55e84c41e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40da20 0x55e84c41e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 -- 172.21.15.35:0/119705740 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e84c322130 con 0x55e84c40e330 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.426+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 0x55e84c419410 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f73940074a0 tx=0x7f7394094350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b239dfe2a24e62fa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f739a7fc700 1 -- 172.21.15.35:0/119705740 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940962c0 con 0x55e84c40e330 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f739a7fc700 1 -- 172.21.15.35:0/119705740 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73940c7e80 con 0x55e84c40e330 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f739a7fc700 1 -- 172.21.15.35:0/119705740 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400f940 con 0x55e84c40e330 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 -- 172.21.15.35:0/119705740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 msgr2=0x55e84c419410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 0x55e84c419410 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f73940074a0 tx=0x7f7394094350 comp rx=0 tx=0).stop 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 -- 172.21.15.35:0/119705740 shutdown_connections 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c412170 0x55e84c414550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40da20 0x55e84c41e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 --2- 172.21.15.35:0/119705740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c40e330 0x55e84c419410 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 -- 172.21.15.35:0/119705740 >> 172.21.15.35:0/119705740 conn(0x55e84c2666b0 msgr2=0x55e84c410290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 -- 172.21.15.35:0/119705740 shutdown_connections 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 -- 172.21.15.35:0/119705740 wait complete. 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.427+0000 7f73b608fb80 1 -- start start 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 Processor -- start 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c40da20 0x55e84c41dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c41e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 0x55e84c41c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c41c920 con 0x55e84c412170 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c41ca90 con 0x55e84c40e330 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84c41cc50 con 0x55e84c40da20 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73b608fb80 10 client.0 _ll_register_callbacks cb 0x55e84c201230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 0x55e84c41c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 0x55e84c41c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47938/0 (socket says 172.21.15.35:47938) 2023-03-17T09:58:15.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 -- 172.21.15.35:0/4173501498 learned_addr learned my addr 172.21.15.35:0/4173501498 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a37fe700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c40da20 0x55e84c41dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c41e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 -- 172.21.15.35:0/4173501498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c40da20 msgr2=0x55e84c41dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c40da20 0x55e84c41dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 -- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 msgr2=0x55e84c41e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c41e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a3fff700 1 -- 172.21.15.35:0/4173501498 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a410eec0 con 0x55e84c412170 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.428+0000 7f73a2ffd700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c41e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73a3fff700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 0x55e84c41c310 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f739c00ae50 tx=0x7f739c015600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae7633eeeaeba1e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f7382ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f7382ffd700 1 -- 172.21.15.35:0/4173501498 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c00f040 con 0x55e84c412170 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f7382ffd700 1 -- 172.21.15.35:0/4173501498 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f739c01b070 con 0x55e84c412170 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e84c3d91e0 con 0x55e84c412170 2023-03-17T09:58:15.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f7382ffd700 1 -- 172.21.15.35:0/4173501498 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f739c00ae80 con 0x55e84c412170 2023-03-17T09:58:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 10 client.17772 fetch_fsmap learned FSMap version 37 2023-03-17T09:58:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e84c1b01f0 con 0x55e84c412170 2023-03-17T09:58:18.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f7382ffd700 1 -- 172.21.15.35:0/4173501498 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e84c3d91e0 con 0x55e84c412170 2023-03-17T09:58:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f7382ffd700 1 -- 172.21.15.35:0/4173501498 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f739c02a460 con 0x55e84c412170 2023-03-17T09:58:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 10 client.17772 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:58:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 10 client.17772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:58:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 20 client.17772 populate_metadata read hostname 'smithi035' 2023-03-17T09:58:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c47c090 0x55e84c47e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:19.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 4 client.17772 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:58:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.429+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e84c1dff00 con 0x55e84c47c090 2023-03-17T09:58:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.430+0000 7f73a37fe700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c47c090 0x55e84c47e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.430+0000 7f7382ffd700 10 client.17772 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.430+0000 7f73a37fe700 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c47c090 0x55e84c47e4a0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307be5a06a5236ed server_cookie=88f13cae07caec4f in_seq=0 out_seq=0 2023-03-17T09:58:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f7382ffd700 1 -- 172.21.15.35:0/4173501498 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e84c1dff00 con 0x55e84c47c090 2023-03-17T09:58:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f7382ffd700 10 client.17772 handle_command_reply: tid=0 2023-03-17T09:58:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 client.17772 shutdown 2023-03-17T09:58:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 msgr2=0x55e84c41c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 0x55e84c41c310 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f739c00ae50 tx=0x7f739c015600 comp rx=0 tx=0).stop 2023-03-17T09:58:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 shutdown_connections 2023-03-17T09:58:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e84c47c090 0x55e84c47e4a0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e84c412170 0x55e84c41c310 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e84c40da20 0x55e84c41dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 --2- 172.21.15.35:0/4173501498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e84c40e330 0x55e84c41e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 >> 172.21.15.35:0/4173501498 conn(0x55e84c2666b0 msgr2=0x55e84c414550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f7382ffd700 0 client.17772 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 shutdown_connections 2023-03-17T09:58:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 1 -- 172.21.15.35:0/4173501498 wait complete. 2023-03-17T09:58:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.437+0000 7f73b608fb80 20 client.17772 trim_cache size 0 max 16384 2023-03-17T09:58:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f739009f640 msgr2=0x7f73900a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f739009f640 0x7f73900a1af0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f738c000c00 tx=0x7f738c009f10 comp rx=0 tx=0).stop 2023-03-17T09:58:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 msgr2=0x7f73a41975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 0x7f73a41975f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f739400c9b0 tx=0x7f739400ccc0 comp rx=0 tx=0).stop 2023-03-17T09:58:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 shutdown_connections 2023-03-17T09:58:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f739009f640 0x7f73900a1af0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a4104390 0x7f73a41a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73a40ff350 0x7f73a41970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 --2- 172.21.15.35:0/3708461477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f73a40ffcf0 0x7f73a41975f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 >> 172.21.15.35:0/3708461477 conn(0x7f73a4076330 msgr2=0x7f73a40fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 shutdown_connections 2023-03-17T09:58:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:16.438+0000 7f73a9f02700 1 -- 172.21.15.35:0/3708461477 wait complete. 2023-03-17T09:58:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 -- 172.21.15.35:0/2833201679 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 msgr2=0x7f9888103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 --2- 172.21.15.35:0/2833201679 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888103cb0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f98780099c0 tx=0x7f9878009cd0 comp rx=0 tx=0).stop 2023-03-17T09:58:29.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 -- 172.21.15.35:0/2833201679 shutdown_connections 2023-03-17T09:58:29.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:52 smithi035 ceph-mon[92535]: pgmap v2061: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:58:30.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:54 smithi035 ceph-mon[92535]: pgmap v2062: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:56 smithi035 ceph-mon[92535]: pgmap v2063: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:57 smithi035 ceph-mon[92535]: pgmap v2064: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:57 smithi035 ceph-mon[92535]: pgmap v2065: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:49:59 smithi035 ceph-mon[92535]: pgmap v2066: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:01 smithi035 ceph-mon[92535]: pgmap v2067: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:03 smithi035 ceph-mon[92535]: pgmap v2068: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:05 smithi035 ceph-mon[92535]: pgmap v2069: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:07 smithi035 ceph-mon[92535]: pgmap v2070: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:09 smithi035 ceph-mon[92535]: pgmap v2071: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T09:58:30.232 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:09 smithi035 ceph-mon[92535]: osdmap e205: 12 total, 12 up, 12 in 2023-03-17T09:58:30.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:11 smithi035 ceph-mon[92535]: pgmap v2073: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:58:30.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:13 smithi035 ceph-mon[92535]: pgmap v2074: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:58:30.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:15 smithi035 ceph-mon[92535]: pgmap v2075: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:58:30.233 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:15 smithi035 ceph-mon[92535]: osdmap e206: 12 total, 12 up, 12 in 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:17 smithi035 ceph-mon[92535]: pgmap v2077: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:19 smithi035 ceph-mon[92535]: pgmap v2078: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:21 smithi035 ceph-mon[92535]: pgmap v2079: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:23 smithi035 ceph-mon[92535]: pgmap v2080: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:25 smithi035 ceph-mon[92535]: pgmap v2081: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:27 smithi035 ceph-mon[92535]: pgmap v2082: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:29 smithi035 ceph-mon[92535]: pgmap v2083: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:31 smithi035 ceph-mon[92535]: pgmap v2084: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:33 smithi035 ceph-mon[92535]: pgmap v2085: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:35 smithi035 ceph-mon[92535]: pgmap v2086: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:37 smithi035 ceph-mon[92535]: pgmap v2087: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:58:32.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:39 smithi035 ceph-mon[92535]: pgmap v2088: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:58:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 --2- 172.21.15.35:0/2833201679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 0x7f988810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 --2- 172.21.15.35:0/2833201679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 0x7f98880ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 --2- 172.21.15.35:0/2833201679 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888103cb0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 -- 172.21.15.35:0/2833201679 >> 172.21.15.35:0/2833201679 conn(0x7f9888076330 msgr2=0x7f9888076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 -- 172.21.15.35:0/2833201679 shutdown_connections 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.549+0000 7f988d426700 1 -- 172.21.15.35:0/2833201679 wait complete. 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 Processor -- start 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 -- start start 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 0x7f9888100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 0x7f98881a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9888101ac0 con 0x7f98880ffcf0 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98881a4980 con 0x7f9888104390 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f988d426700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98881a4ac0 con 0x7f98880ff350 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47950/0 (socket says 172.21.15.35:47950) 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 -- 172.21.15.35:0/1186921706 learned_addr learned my addr 172.21.15.35:0/1186921706 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98877fe700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 0x7f98881a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 0x7f9888100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 -- 172.21.15.35:0/1186921706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 msgr2=0x7f9888100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 0x7f9888100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 -- 172.21.15.35:0/1186921706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 msgr2=0x7f98881a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 0x7f98881a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f98867fc700 1 -- 172.21.15.35:0/1186921706 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780095f0 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.550+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 0x7f9888100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f98877fe700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 0x7f98881a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f98867fc700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888101290 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9878000c00 tx=0x7f987800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f986ffff700 1 -- 172.21.15.35:0/1186921706 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987801d070 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988810efc0 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f986ffff700 1 -- 172.21.15.35:0/1186921706 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98780054e0 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f986ffff700 1 -- 172.21.15.35:0/1186921706 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878004a90 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.551+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988810ee30 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.553+0000 7f986ffff700 1 -- 172.21.15.35:0/1186921706 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9878004c10 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.554+0000 7f986ffff700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f987009f640 0x7f98700a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.554+0000 7f986ffff700 1 -- 172.21.15.35:0/1186921706 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f98780cb390 con 0x7f98880ffcf0 2023-03-17T09:58:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.554+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f987009f640 0x7f98700a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.554+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f987009f640 0x7f98700a1af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f987c005d90 tx=0x7f987c005d00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 Processor -- start 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 -- start start 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc0be0 0x55a231fc0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fbb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a231fbbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231ec2010 con 0x55a231fc14f0 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231f14950 con 0x55a231fbb960 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98995b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231f0dde0 con 0x55a231fc0be0 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fbb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fbb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47958/0 (socket says 172.21.15.35:47958) 2023-03-17T09:58:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 -- 172.21.15.35:0/1843272852 learned_addr learned my addr 172.21.15.35:0/1843272852 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc0be0 0x55a231fc0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98877fe700 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a231fbbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 -- 172.21.15.35:0/1843272852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc0be0 msgr2=0x55a231fc0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc0be0 0x55a231fc0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 -- 172.21.15.35:0/1843272852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 msgr2=0x55a231fbbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a231fbbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 -- 172.21.15.35:0/1843272852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a231d8f5d0 con 0x55a231fc14f0 2023-03-17T09:58:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98877fe700 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a231fbbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:58:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.555+0000 7f98867fc700 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fbb420 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f9878095970 tx=0x7f9878098b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3364ba3168aa32 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f986d7fa700 1 -- 172.21.15.35:0/1843272852 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780a1060 con 0x55a231fc14f0 2023-03-17T09:58:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f986d7fa700 1 -- 172.21.15.35:0/1843272852 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98780972a0 con 0x55a231fc14f0 2023-03-17T09:58:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f986d7fa700 1 -- 172.21.15.35:0/1843272852 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878098650 con 0x55a231fc14f0 2023-03-17T09:58:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 -- 172.21.15.35:0/1843272852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 msgr2=0x55a231fbb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fbb420 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f9878095970 tx=0x7f9878098b40 comp rx=0 tx=0).stop 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 -- 172.21.15.35:0/1843272852 shutdown_connections 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a231fbbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc0be0 0x55a231fc0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1843272852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fbb420 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 -- 172.21.15.35:0/1843272852 >> 172.21.15.35:0/1843272852 conn(0x55a231e186b0 msgr2=0x55a231fb5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 -- 172.21.15.35:0/1843272852 shutdown_connections 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.556+0000 7f98995b3b80 1 -- 172.21.15.35:0/1843272852 wait complete. 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 -- start start 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 Processor -- start 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fc73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc0be0 0x55a231fc4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fc4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231d918c0 con 0x55a231fc14f0 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231fc53a0 con 0x55a231fc0be0 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231fd0cf0 con 0x55a231fbb960 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98995b3b80 10 client.0 _ll_register_callbacks cb 0x55a231db3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98877fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fc4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f9886ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fc73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98877fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fc4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47966/0 (socket says 172.21.15.35:47966) 2023-03-17T09:58:38.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f9886ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fc73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:39728/0 (socket says 172.21.15.35:39728) 2023-03-17T09:58:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98877fe700 1 -- 172.21.15.35:0/1396601578 learned_addr learned my addr 172.21.15.35:0/1396601578 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98867fc700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc0be0 0x55a231fc4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98877fe700 1 -- 172.21.15.35:0/1396601578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 msgr2=0x55a231fc73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.557+0000 7f98877fe700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fc73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98877fe700 1 -- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc0be0 msgr2=0x55a231fc4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98877fe700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc0be0 0x55a231fc4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98877fe700 1 -- 172.21.15.35:0/1396601578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988810ee30 con 0x55a231fc14f0 2023-03-17T09:58:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fc73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:58:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98877fe700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fc4c30 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f9880007a40 tx=0x7f9880007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d093b273e244c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f986aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:58:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f986aff5700 1 -- 172.21.15.35:0/1396601578 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988000e070 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f986aff5700 1 -- 172.21.15.35:0/1396601578 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f9880003c00 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a231ed0390 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f986aff5700 1 -- 172.21.15.35:0/1396601578 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9880009e50 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 10 client.17784 fetch_fsmap learned FSMap version 37 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a231d3bd80 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f986aff5700 1 -- 172.21.15.35:0/1396601578 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a231ed0390 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f986aff5700 1 -- 172.21.15.35:0/1396601578 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f988001c020 con 0x55a231fc14f0 2023-03-17T09:58:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 10 client.17784 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:58:41.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 10 client.17784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:58:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 20 client.17784 populate_metadata read hostname 'smithi035' 2023-03-17T09:58:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a231fd4dc0 0x55a231fd71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 4 client.17784 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.558+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a231edc600 con 0x55a231fd4dc0 2023-03-17T09:58:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.559+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a231fd4dc0 0x55a231fd71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.559+0000 7f9886ffd700 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a231fd4dc0 0x55a231fd71d0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7abde9ea299a636f server_cookie=89d28d8a954d2273 in_seq=0 out_seq=0 2023-03-17T09:58:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.559+0000 7f986aff5700 10 client.17784 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f986aff5700 1 -- 172.21.15.35:0/1396601578 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a231edc600 con 0x55a231fd4dc0 2023-03-17T09:58:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f986aff5700 10 client.17784 handle_command_reply: tid=0 2023-03-17T09:58:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 client.17784 shutdown 2023-03-17T09:58:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 msgr2=0x55a231fc4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fc4c30 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f9880007a40 tx=0x7f9880007d50 comp rx=0 tx=0).stop 2023-03-17T09:58:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 shutdown_connections 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a231fd4dc0 0x55a231fd71d0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc14f0 0x55a231fc4c30 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f986aff5700 0 client.17784 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fc73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 --2- 172.21.15.35:0/1396601578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc0be0 0x55a231fc4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 >> 172.21.15.35:0/1396601578 conn(0x55a231e186b0 msgr2=0x55a231fba410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 shutdown_connections 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 1 -- 172.21.15.35:0/1396601578 wait complete. 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.560+0000 7f98995b3b80 20 client.17784 trim_cache size 0 max 16384 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 Processor -- start 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 -- start start 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fcbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a231fc2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc14f0 0x55a231fc6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231edc630 con 0x55a231fc0be0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231fb1120 con 0x55a231fc14f0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98995b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a231fc5210 con 0x55a231fbb960 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a231fc2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a231fc2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47972/0 (socket says 172.21.15.35:47972) 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 -- 172.21.15.35:0/2060055322 learned_addr learned my addr 172.21.15.35:0/2060055322 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 -- 172.21.15.35:0/2060055322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 msgr2=0x55a231fcbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fcbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 -- 172.21.15.35:0/2060055322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc14f0 msgr2=0x55a231fc6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc14f0 0x55a231fc6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.575+0000 7f98867fc700 1 -- 172.21.15.35:0/2060055322 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a231ed4130 con 0x55a231fc0be0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98867fc700 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a231fc2030 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f987800ffd0 tx=0x7f987800b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14194038bb2a11bf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f986dffb700 1 -- 172.21.15.35:0/2060055322 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780c8070 con 0x55a231fc0be0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f986dffb700 1 -- 172.21.15.35:0/2060055322 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9878005650 con 0x55a231fc0be0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f986dffb700 1 -- 172.21.15.35:0/2060055322 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878099160 con 0x55a231fc0be0 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 -- 172.21.15.35:0/2060055322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 msgr2=0x55a231fc2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a231fc2030 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f987800ffd0 tx=0x7f987800b540 comp rx=0 tx=0).stop 2023-03-17T09:58:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 -- 172.21.15.35:0/2060055322 shutdown_connections 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fc14f0 0x55a231fc6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fbb960 0x55a231fcbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 --2- 172.21.15.35:0/2060055322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a231fc2030 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 -- 172.21.15.35:0/2060055322 >> 172.21.15.35:0/2060055322 conn(0x55a231e186b0 msgr2=0x55a231fc1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 -- 172.21.15.35:0/2060055322 shutdown_connections 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.576+0000 7f98995b3b80 1 -- 172.21.15.35:0/2060055322 wait complete. 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 -- start start 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 Processor -- start 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a23201cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a23201d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc14f0 0x55a232021c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2320221b0 con 0x55a231fc0be0 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a232022320 con 0x55a231fbb960 2023-03-17T09:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2320224e0 con 0x55a231fc14f0 2023-03-17T09:58:48.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:41 smithi035 ceph-mon[92535]: pgmap v2089: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98995b3b80 10 client.0 _ll_register_callbacks cb 0x55a231db3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a23201d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a23201d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47978/0 (socket says 172.21.15.35:47978) 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 -- 172.21.15.35:0/3763770548 learned_addr learned my addr 172.21.15.35:0/3763770548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f9886ffd700 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a23201cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 -- 172.21.15.35:0/3763770548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc14f0 msgr2=0x55a232021c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc14f0 0x55a232021c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 -- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 msgr2=0x55a23201cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a23201cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.577+0000 7f98867fc700 1 -- 172.21.15.35:0/3763770548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98780b0040 con 0x55a231fc0be0 2023-03-17T09:58:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98867fc700 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a23201d2e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f98780cb670 tx=0x7f9878099080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842abd7d935451e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f986aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f986aff5700 1 -- 172.21.15.35:0/3763770548 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780c8040 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f986aff5700 1 -- 172.21.15.35:0/3763770548 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f98780983f0 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a231f8b1e0 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f986aff5700 1 -- 172.21.15.35:0/3763770548 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98780985b0 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 10 client.17790 fetch_fsmap learned FSMap version 37 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a231d621f0 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f986aff5700 1 -- 172.21.15.35:0/3763770548 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a231f8b1e0 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f986aff5700 1 -- 172.21.15.35:0/3763770548 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9878094cf0 con 0x55a231fc0be0 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 10 client.17790 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 10 client.17790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 20 client.17790 populate_metadata read hostname 'smithi035' 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2320297f0 0x55a23202bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 4 client.17790 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:58:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a231d91f00 con 0x55a2320297f0 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.578+0000 7f9886ffd700 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2320297f0 0x55a23202bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.579+0000 7f986aff5700 10 client.17790 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.579+0000 7f9886ffd700 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2320297f0 0x55a23202bbd0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6000b1031ac95e96 server_cookie=f26e0e72e538d10d in_seq=0 out_seq=0 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f986aff5700 1 -- 172.21.15.35:0/3763770548 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a231d91f00 con 0x55a2320297f0 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f986aff5700 10 client.17790 handle_command_reply: tid=0 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 client.17790 shutdown 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 msgr2=0x55a23201d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a23201d2e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f98780cb670 tx=0x7f9878099080 comp rx=0 tx=0).stop 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 shutdown_connections 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2320297f0 0x55a23202bbd0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a231fc14f0 0x55a232021c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a231fbb960 0x55a23201cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f986aff5700 0 client.17790 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 --2- 172.21.15.35:0/3763770548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a231fc0be0 0x55a23201d2e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 >> 172.21.15.35:0/3763770548 conn(0x55a231e186b0 msgr2=0x55a231fbaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 shutdown_connections 2023-03-17T09:58:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.582+0000 7f98995b3b80 1 -- 172.21.15.35:0/3763770548 wait complete. 2023-03-17T09:58:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f98995b3b80 20 client.17790 trim_cache size 0 max 16384 2023-03-17T09:58:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f987009f640 msgr2=0x7f98700a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f987009f640 0x7f98700a1af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f987c005d90 tx=0x7f987c005d00 comp rx=0 tx=0).stop 2023-03-17T09:58:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 msgr2=0x7f9888101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888101290 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f9878000c00 tx=0x7f987800f740 comp rx=0 tx=0).stop 2023-03-17T09:58:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 shutdown_connections 2023-03-17T09:58:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f987009f640 0x7f98700a1af0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9888104390 0x7f98881a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98880ff350 0x7f9888100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 --2- 172.21.15.35:0/1186921706 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98880ffcf0 0x7f9888101290 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 >> 172.21.15.35:0/1186921706 conn(0x7f9888076330 msgr2=0x7f9888102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 shutdown_connections 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:29.583+0000 7f988d426700 1 -- 172.21.15.35:0/1186921706 wait complete. 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 -- 172.21.15.35:0/1495614420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 msgr2=0x7f6818103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 --2- 172.21.15.35:0/1495614420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818103cb0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f68000099c0 tx=0x7f6800009cd0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 -- 172.21.15.35:0/1495614420 shutdown_connections 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 --2- 172.21.15.35:0/1495614420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6818104390 0x7f681810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 --2- 172.21.15.35:0/1495614420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68180ff350 0x7f68180ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 --2- 172.21.15.35:0/1495614420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818103cb0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 -- 172.21.15.35:0/1495614420 >> 172.21.15.35:0/1495614420 conn(0x7f6818076330 msgr2=0x7f6818076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 -- 172.21.15.35:0/1495614420 shutdown_connections 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 -- 172.21.15.35:0/1495614420 wait complete. 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 Processor -- start 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.705+0000 7f681e809700 1 -- start start 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68180ff350 0x7f6818100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6818104390 0x7f68181a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6818101ac0 con 0x7f68180ffcf0 2023-03-17T09:58:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68181a4980 con 0x7f68180ff350 2023-03-17T09:58:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68181a4ac0 con 0x7f6818104390 2023-03-17T09:58:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47992/0 (socket says 172.21.15.35:47992) 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 -- 172.21.15.35:0/2250204470 learned_addr learned my addr 172.21.15.35:0/2250204470 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681cda6700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6818104390 0x7f68181a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f6817fff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68180ff350 0x7f6818100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 -- 172.21.15.35:0/2250204470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6818104390 msgr2=0x7f68181a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6818104390 0x7f68181a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 -- 172.21.15.35:0/2250204470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68180ff350 msgr2=0x7f6818100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68180ff350 0x7f6818100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 -- 172.21.15.35:0/2250204470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000095f0 con 0x7f68180ffcf0 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f6817fff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68180ff350 0x7f6818100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f680ffff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818101290 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6800000c00 tx=0x7f680000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:53.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f6815ffb700 1 -- 172.21.15.35:0/2250204470 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680001d070 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f6815ffb700 1 -- 172.21.15.35:0/2250204470 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68000054e0 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681810efc0 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f6815ffb700 1 -- 172.21.15.35:0/2250204470 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800004990 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.706+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681810ee30 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.709+0000 7f6815ffb700 1 -- 172.21.15.35:0/2250204470 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6800005050 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.709+0000 7f6815ffb700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f680409f6c0 0x7f68040a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.709+0000 7f6815ffb700 1 -- 172.21.15.35:0/2250204470 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f68000cb250 con 0x7f68180ffcf0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.709+0000 7f6817fff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f680409f6c0 0x7f68040a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.710+0000 7f6817fff700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f680409f6c0 0x7f68040a1b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f680800bc10 tx=0x7f680800b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.710+0000 7f682a996b80 1 Processor -- start 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.710+0000 7f682a996b80 1 -- start start 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f682a996b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb14fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f682a996b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb0f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f682a996b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb0fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f682a996b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6ea16010 con 0x55df6eb14be0 2023-03-17T09:58:53.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f682a996b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6ea68950 con 0x55df6eb0f960 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f682a996b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6ea61de0 con 0x55df6eb154f0 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb14fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb14fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:47998/0 (socket says 172.21.15.35:47998) 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 -- 172.21.15.35:0/662400715 learned_addr learned my addr 172.21.15.35:0/662400715 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f680ffff700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb0f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f681cda6700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb0fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 -- 172.21.15.35:0/662400715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 msgr2=0x55df6eb0f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb0f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 -- 172.21.15.35:0/662400715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 msgr2=0x55df6eb0fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb0fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 -- 172.21.15.35:0/662400715 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df6e8e35d0 con 0x55df6eb14be0 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f680ffff700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb0f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f681cda6700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb0fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.711+0000 7f6817fff700 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb14fb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f680800fd10 tx=0x7f6808012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235ddceac12e82dc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f680e7fc700 1 -- 172.21.15.35:0/662400715 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011ad0 con 0x55df6eb14be0 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f680e7fc700 1 -- 172.21.15.35:0/662400715 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6808011c30 con 0x55df6eb14be0 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f680e7fc700 1 -- 172.21.15.35:0/662400715 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680801d5b0 con 0x55df6eb14be0 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 -- 172.21.15.35:0/662400715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 msgr2=0x55df6eb14fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb14fb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f680800fd10 tx=0x7f6808012000 comp rx=0 tx=0).stop 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 -- 172.21.15.35:0/662400715 shutdown_connections 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb0fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb14fb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:54.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 --2- 172.21.15.35:0/662400715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb0f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 -- 172.21.15.35:0/662400715 >> 172.21.15.35:0/662400715 conn(0x55df6e96c6b0 msgr2=0x55df6eb09a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 -- 172.21.15.35:0/662400715 shutdown_connections 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.712+0000 7f682a996b80 1 -- 172.21.15.35:0/662400715 wait complete. 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 -- start start 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 Processor -- start 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb18640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb18be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:58:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6e8e58c0 con 0x55df6eb14be0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb19350 con 0x55df6eb0f960 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb19510 con 0x55df6eb154f0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f682a996b80 10 client.0 _ll_register_callbacks cb 0x55df6e907230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb18640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb18640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48006/0 (socket says 172.21.15.35:48006) 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f680ffff700 1 -- 172.21.15.35:0/4132166684 learned_addr learned my addr 172.21.15.35:0/4132166684 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.713+0000 7f681cda6700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb18be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f6817fff700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f680ffff700 1 -- 172.21.15.35:0/4132166684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 msgr2=0x55df6eb18be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f680ffff700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb18be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f680ffff700 1 -- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 msgr2=0x55df6eb1b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f680ffff700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f680ffff700 1 -- 172.21.15.35:0/4132166684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680800f9f0 con 0x55df6eb14be0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f680ffff700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb18640 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6800095270 tx=0x7f6800005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346b6a699e817810 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f67f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:58:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f67f77fe700 1 -- 172.21.15.35:0/4132166684 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000a0f20 con 0x55df6eb14be0 2023-03-17T09:58:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f67f77fe700 1 -- 172.21.15.35:0/4132166684 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f6800005650 con 0x55df6eb14be0 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df6ea24390 con 0x55df6eb14be0 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f67f77fe700 1 -- 172.21.15.35:0/4132166684 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f680000fb80 con 0x55df6eb14be0 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f682a996b80 10 client.17802 fetch_fsmap learned FSMap version 37 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55df6e88fd80 con 0x55df6eb14be0 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.714+0000 7f67f77fe700 1 -- 172.21.15.35:0/4132166684 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55df6ea24390 con 0x55df6eb14be0 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f67f77fe700 1 -- 172.21.15.35:0/4132166684 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f68000b2070 con 0x55df6eb14be0 2023-03-17T09:58:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f682a996b80 10 client.17802 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:58:57.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f682a996b80 10 client.17802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:58:57.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f682a996b80 20 client.17802 populate_metadata read hostname 'smithi035' 2023-03-17T09:58:57.637 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:43 smithi035 ceph-mon[92535]: pgmap v2090: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:58:57.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f682a996b80 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb28ce0 0x55df6eb2b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f682a996b80 4 client.17802 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:59:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df6ea30600 con 0x55df6eb28ce0 2023-03-17T09:59:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f6817fff700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb28ce0 0x55df6eb2b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f67f77fe700 10 client.17802 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.715+0000 7f6817fff700 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb28ce0 0x55df6eb2b0c0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1bb5a643f982bf server_cookie=f05525b08ae9ff2d in_seq=0 out_seq=0 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f67f77fe700 1 -- 172.21.15.35:0/4132166684 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55df6ea30600 con 0x55df6eb28ce0 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f67f77fe700 10 client.17802 handle_command_reply: tid=0 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 client.17802 shutdown 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 msgr2=0x55df6eb18640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb18640 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6800095270 tx=0x7f6800005380 comp rx=0 tx=0).stop 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 shutdown_connections 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb28ce0 0x55df6eb2b0c0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb18be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 --2- 172.21.15.35:0/4132166684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb18640 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f67f77fe700 0 client.17802 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 >> 172.21.15.35:0/4132166684 conn(0x55df6e96c6b0 msgr2=0x55df6eb0e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 shutdown_connections 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.716+0000 7f682a996b80 1 -- 172.21.15.35:0/4132166684 wait complete. 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.717+0000 7f682a996b80 20 client.17802 trim_cache size 0 max 16384 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 Processor -- start 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 -- start start 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb17e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6ea24390 con 0x55df6eb14be0 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb050f0 con 0x55df6eb0f960 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f682a996b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb19c70 con 0x55df6eb154f0 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb17e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb17e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48014/0 (socket says 172.21.15.35:48014) 2023-03-17T09:59:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 -- 172.21.15.35:0/2921836376 learned_addr learned my addr 172.21.15.35:0/2921836376 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f6817fff700 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f681cda6700 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 -- 172.21.15.35:0/2921836376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 msgr2=0x55df6eb1af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 -- 172.21.15.35:0/2921836376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 msgr2=0x55df6eb1ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.732+0000 7f680ffff700 1 -- 172.21.15.35:0/2921836376 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df6ea28130 con 0x55df6eb14be0 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f680ffff700 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb17e20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6800098ac0 tx=0x7f680000b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc832216585cd0af server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f680effd700 1 -- 172.21.15.35:0/2921836376 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800094f20 con 0x55df6eb14be0 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f680effd700 1 -- 172.21.15.35:0/2921836376 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68000a0f20 con 0x55df6eb14be0 2023-03-17T09:59:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f680effd700 1 -- 172.21.15.35:0/2921836376 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000982b0 con 0x55df6eb14be0 2023-03-17T09:59:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 -- 172.21.15.35:0/2921836376 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 msgr2=0x55df6eb17e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb17e20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6800098ac0 tx=0x7f680000b540 comp rx=0 tx=0).stop 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 -- 172.21.15.35:0/2921836376 shutdown_connections 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb1ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 --2- 172.21.15.35:0/2921836376 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb17e20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 -- 172.21.15.35:0/2921836376 >> 172.21.15.35:0/2921836376 conn(0x55df6e96c6b0 msgr2=0x55df6eb2fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 -- 172.21.15.35:0/2921836376 shutdown_connections 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.733+0000 7f682a996b80 1 -- 172.21.15.35:0/2921836376 wait complete. 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 -- start start 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 Processor -- start 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb75d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb1e470 con 0x55df6eb14be0 2023-03-17T09:59:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb1e5b0 con 0x55df6eb0f960 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df6eb1e770 con 0x55df6eb154f0 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f682a996b80 10 client.0 _ll_register_callbacks cb 0x55df6e907230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f680ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb762c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48020/0 (socket says 172.21.15.35:48020) 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f680ffff700 1 -- 172.21.15.35:0/2671052351 learned_addr learned my addr 172.21.15.35:0/2671052351 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f681cda6700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.734+0000 7f6817fff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb75d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f680ffff700 1 -- 172.21.15.35:0/2671052351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 msgr2=0x55df6eb1df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f680ffff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f680ffff700 1 -- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 msgr2=0x55df6eb75d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f680ffff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb75d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f680ffff700 1 -- 172.21.15.35:0/2671052351 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df6e88fd80 con 0x55df6eb14be0 2023-03-17T09:59:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f6817fff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb75d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:59:06.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f680ffff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb762c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6800098d50 tx=0x7f6800097370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306b8efe89444608 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f67f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:59:06.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f67f77fe700 1 -- 172.21.15.35:0/2671052351 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000a0c80 con 0x55df6eb14be0 2023-03-17T09:59:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f67f77fe700 1 -- 172.21.15.35:0/2671052351 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f6800005650 con 0x55df6eb14be0 2023-03-17T09:59:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df6eadf1e0 con 0x55df6eb14be0 2023-03-17T09:59:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f67f77fe700 1 -- 172.21.15.35:0/2671052351 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6800094bb0 con 0x55df6eb14be0 2023-03-17T09:59:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 10 client.17808 fetch_fsmap learned FSMap version 37 2023-03-17T09:59:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55df6e8b61f0 con 0x55df6eb14be0 2023-03-17T09:59:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f67f77fe700 1 -- 172.21.15.35:0/2671052351 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6800081080 con 0x55df6eb14be0 2023-03-17T09:59:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f67f77fe700 1 -- 172.21.15.35:0/2671052351 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f680007b030 con 0x55df6eb14be0 2023-03-17T09:59:13.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 10 client.17808 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:59:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 10 client.17808 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:59:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 20 client.17808 populate_metadata read hostname 'smithi035' 2023-03-17T09:59:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb7d620 0x55df6eb7fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.735+0000 7f682a996b80 4 client.17808 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:59:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.736+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55df6e8e5f00 con 0x55df6eb7d620 2023-03-17T09:59:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.736+0000 7f6817fff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb7d620 0x55df6eb7fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:20.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.736+0000 7f6817fff700 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb7d620 0x55df6eb7fa00 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ce520f03a1ba47 server_cookie=5835f9d31e729112 in_seq=0 out_seq=0 2023-03-17T09:59:20.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.736+0000 7f67f77fe700 10 client.17808 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:20.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.740+0000 7f67f77fe700 1 -- 172.21.15.35:0/2671052351 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55df6e8e5f00 con 0x55df6eb7d620 2023-03-17T09:59:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.740+0000 7f67f77fe700 10 client.17808 handle_command_reply: tid=0 2023-03-17T09:59:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.740+0000 7f682a996b80 1 client.17808 shutdown 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 msgr2=0x55df6eb762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb762c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6800098d50 tx=0x7f6800097370 comp rx=0 tx=0).stop 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 shutdown_connections 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55df6eb7d620 0x55df6eb7fa00 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55df6eb154f0 0x55df6eb1df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55df6eb0f960 0x55df6eb75d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 --2- 172.21.15.35:0/2671052351 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55df6eb14be0 0x55df6eb762c0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f67f77fe700 0 client.17808 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 >> 172.21.15.35:0/2671052351 conn(0x55df6e96c6b0 msgr2=0x55df6eb126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 shutdown_connections 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 1 -- 172.21.15.35:0/2671052351 wait complete. 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f682a996b80 20 client.17808 trim_cache size 0 max 16384 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f680409f6c0 msgr2=0x7f68040a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f680409f6c0 0x7f68040a1b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f680800bc10 tx=0x7f680800b5f0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 msgr2=0x7f6818101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818101290 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6800000c00 tx=0x7f680000f690 comp rx=0 tx=0).stop 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 shutdown_connections 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f680409f6c0 0x7f68040a1b70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6818104390 0x7f68181a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68180ff350 0x7f6818100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 --2- 172.21.15.35:0/2250204470 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f68180ffcf0 0x7f6818101290 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.741+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 >> 172.21.15.35:0/2250204470 conn(0x7f6818076330 msgr2=0x7f6818102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.742+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 shutdown_connections 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:42.742+0000 7f681e809700 1 -- 172.21.15.35:0/2250204470 wait complete. 2023-03-17T09:59:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 -- 172.21.15.35:0/2380172471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280fef50 msgr2=0x7fdb280ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/2380172471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280fef50 0x7fdb280ff320 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009990 tx=0x7fdb24009ca0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 -- 172.21.15.35:0/2380172471 shutdown_connections 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/2380172471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2810cb00 0x7fdb2810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/2380172471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280fef50 0x7fdb280ff320 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/2380172471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb280ff860 0x7fdb2810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 -- 172.21.15.35:0/2380172471 >> 172.21.15.35:0/2380172471 conn(0x7fdb28076330 msgr2=0x7fdb28076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 -- 172.21.15.35:0/2380172471 shutdown_connections 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.865+0000 7fdb2fa29700 1 -- 172.21.15.35:0/2380172471 wait complete. 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 Processor -- start 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 -- start start 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb280fef50 0x7fdb28101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 0x7fdb28101770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2810cb00 0x7fdb28101cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281a8a10 con 0x7fdb280ff860 2023-03-17T09:59:25.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281a8b80 con 0x7fdb280fef50 2023-03-17T09:59:25.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2fa29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281a8d40 con 0x7fdb2810cb00 2023-03-17T09:59:25.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 0x7fdb28101770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:25.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 0x7fdb28101770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48034/0 (socket says 172.21.15.35:48034) 2023-03-17T09:59:25.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/1208791522 learned_addr learned my addr 172.21.15.35:0/1208791522 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:25.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb280fef50 0x7fdb28101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2810cb00 0x7fdb28101cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/1208791522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2810cb00 msgr2=0x7fdb28101cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2810cb00 0x7fdb28101cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.866+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/1208791522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb280fef50 msgr2=0x7fdb28101230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb280fef50 0x7fdb28101230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/1208791522 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240095f0 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 0x7fdb28101770 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800c9b0 tx=0x7fdb1800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb1e7fc700 1 -- 172.21.15.35:0/1208791522 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18007b00 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28112310 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb1e7fc700 1 -- 172.21.15.35:0/1208791522 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb18007c60 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb1e7fc700 1 -- 172.21.15.35:0/1208791522 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18018660 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.867+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb28112180 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.869+0000 7fdb1e7fc700 1 -- 172.21.15.35:0/1208791522 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdb1800f450 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.870+0000 7fdb1e7fc700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb1409f640 0x7fdb140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.870+0000 7fdb1e7fc700 1 -- 172.21.15.35:0/1208791522 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fdb180ca5e0 con 0x7fdb280ff860 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.870+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb1409f640 0x7fdb140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.870+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb1409f640 0x7fdb140a1af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400b5c0 tx=0x7fdb24005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 Processor -- start 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 -- start start 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba68420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 0x557c3ba68d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3b96f010 con 0x557c3ba68960 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3b9c1950 con 0x557c3ba6e4f0 2023-03-17T09:59:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3b9bade0 con 0x557c3ba6dbe0 2023-03-17T09:59:27.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:45 smithi035 ceph-mon[92535]: pgmap v2091: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:59:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb2dfc6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 0x557c3ba68d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb2dfc6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 0x557c3ba68d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48044/0 (socket says 172.21.15.35:48044) 2023-03-17T09:59:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.871+0000 7fdb2dfc6700 1 -- 172.21.15.35:0/1665628906 learned_addr learned my addr 172.21.15.35:0/1665628906 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba68420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2dfc6700 1 -- 172.21.15.35:0/1665628906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba6dbe0 msgr2=0x557c3ba6dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2dfc6700 1 -- 172.21.15.35:0/1665628906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 msgr2=0x557c3ba68420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba68420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2dfc6700 1 -- 172.21.15.35:0/1665628906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3b83c5d0 con 0x557c3ba68960 2023-03-17T09:59:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba68420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T09:59:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 0x557c3ba68d90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fdb20007f10 tx=0x7fdb2000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6385a09da5d2b45b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb137fe700 1 -- 172.21.15.35:0/1665628906 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20018070 con 0x557c3ba68960 2023-03-17T09:59:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb137fe700 1 -- 172.21.15.35:0/1665628906 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb20007b50 con 0x557c3ba68960 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.872+0000 7fdb137fe700 1 -- 172.21.15.35:0/1665628906 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20014a90 con 0x557c3ba68960 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/1665628906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 msgr2=0x557c3ba68d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 0x557c3ba68d90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fdb20007f10 tx=0x7fdb2000e440 comp rx=0 tx=0).stop 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/1665628906 shutdown_connections 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba68960 0x557c3ba68d90 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/1665628906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba68420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:35.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/1665628906 >> 172.21.15.35:0/1665628906 conn(0x557c3b8c56b0 msgr2=0x557c3ba62a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/1665628906 shutdown_connections 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/1665628906 wait complete. 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.873+0000 7fdb3bbb6b80 1 -- start start 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 Processor -- start 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba743c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba71b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3b83e8c0 con 0x557c3ba6dbe0 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba72250 con 0x557c3ba6e4f0 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba72410 con 0x557c3ba68960 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb3bbb6b80 10 client.0 _ll_register_callbacks cb 0x557c3b860230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48048/0 (socket says 172.21.15.35:48048) 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3574014243 learned_addr learned my addr 172.21.15.35:0/3574014243 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.874+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba71b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:35.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3574014243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 msgr2=0x557c3ba743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 msgr2=0x557c3ba71b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba71b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3574014243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2000f040 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba715d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fdb18097dc0 tx=0x7fdb1800fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c096fd0b6f251c37 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb10ff9700 1 -- 172.21.15.35:0/3574014243 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb180b0460 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb10ff9700 1 -- 172.21.15.35:0/3574014243 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fdb180980c0 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c3b97d390 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb10ff9700 1 -- 172.21.15.35:0/3574014243 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb180a02b0 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb3bbb6b80 10 client.17820 fetch_fsmap learned FSMap version 37 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x557c3b7e8d80 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb10ff9700 1 -- 172.21.15.35:0/3574014243 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb18062020 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.875+0000 7fdb10ff9700 1 -- 172.21.15.35:0/3574014243 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdb1809fe20 con 0x557c3ba6dbe0 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb3bbb6b80 10 client.17820 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb3bbb6b80 10 client.17820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:59:35.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb3bbb6b80 20 client.17820 populate_metadata read hostname 'smithi035' 2023-03-17T09:59:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3ba81fa0 0x557c3ba843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb3bbb6b80 4 client.17820 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T09:59:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c3b989600 con 0x557c3ba81fa0 2023-03-17T09:59:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3ba81fa0 0x557c3ba843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb10ff9700 10 client.17820 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:35.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.876+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3ba81fa0 0x557c3ba843b0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c4d0322b701a3c server_cookie=75c411005f61ecb0 in_seq=0 out_seq=0 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb10ff9700 1 -- 172.21.15.35:0/3574014243 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557c3b989600 con 0x557c3ba81fa0 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb10ff9700 10 client.17820 handle_command_reply: tid=0 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 client.17820 shutdown 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 msgr2=0x557c3ba715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba715d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fdb18097dc0 tx=0x7fdb1800fee0 comp rx=0 tx=0).stop 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 shutdown_connections 2023-03-17T09:59:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3ba81fa0 0x557c3ba843b0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba71b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb10ff9700 0 client.17820 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3574014243 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba715d0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 >> 172.21.15.35:0/3574014243 conn(0x557c3b8c56b0 msgr2=0x557c3ba62a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 shutdown_connections 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3574014243 wait complete. 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.877+0000 7fdb3bbb6b80 20 client.17820 trim_cache size 0 max 16384 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.892+0000 7fdb3bbb6b80 1 Processor -- start 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 -- start start 2023-03-17T09:59:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba68420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba62ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba6f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba63000 con 0x557c3ba6dbe0 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba6f5e0 con 0x557c3ba6e4f0 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba5e0d0 con 0x557c3ba68960 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba62ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba62ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48056/0 (socket says 172.21.15.35:48056) 2023-03-17T09:59:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3316549934 learned_addr learned my addr 172.21.15.35:0/3316549934 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba68420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba6f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3316549934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 msgr2=0x557c3ba68420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba68420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3316549934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 msgr2=0x557c3ba6f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba6f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/3316549934 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3ba69000 con 0x557c3ba6dbe0 2023-03-17T09:59:43.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba6f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.893+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba62ac0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fdb18094b30 tx=0x7fdb18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6200ac1aac44fbee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb13fff700 1 -- 172.21.15.35:0/3316549934 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18097850 con 0x557c3ba6dbe0 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb13fff700 1 -- 172.21.15.35:0/3316549934 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb18062070 con 0x557c3ba6dbe0 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb13fff700 1 -- 172.21.15.35:0/3316549934 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1809ff40 con 0x557c3ba6dbe0 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3316549934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 msgr2=0x557c3ba62ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba62ac0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fdb18094b30 tx=0x7fdb18000bc0 comp rx=0 tx=0).stop 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3316549934 shutdown_connections 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba6f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba68420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/3316549934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba62ac0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3316549934 >> 172.21.15.35:0/3316549934 conn(0x557c3b8c56b0 msgr2=0x557c3ba6e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3316549934 shutdown_connections 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.894+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/3316549934 wait complete. 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 -- start start 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 Processor -- start 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba6a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba69cc0 con 0x557c3ba6dbe0 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba69e30 con 0x557c3ba6e4f0 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3ba69ff0 con 0x557c3ba68960 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb3bbb6b80 10 client.0 _ll_register_callbacks cb 0x557c3b860230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2cfc4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48062/0 (socket says 172.21.15.35:48062) 2023-03-17T09:59:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/2028890025 learned_addr learned my addr 172.21.15.35:0/2028890025 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T09:59:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba6a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/2028890025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 msgr2=0x557c3ba6a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba6a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.895+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 msgr2=0x557c3ba696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T09:59:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb2cfc4700 1 -- 172.21.15.35:0/2028890025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c3b7e8d80 con 0x557c3ba6dbe0 2023-03-17T09:59:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb2dfc6700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T09:59:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb2cfc4700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6ae90 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdb180074a0 tx=0x7fdb18094400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3a8dd58982f880 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T09:59:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T09:59:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb10ff9700 1 -- 172.21.15.35:0/2028890025 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18097850 con 0x557c3ba6dbe0 2023-03-17T09:59:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c3ba381e0 con 0x557c3ba6dbe0 2023-03-17T09:59:48.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb10ff9700 1 -- 172.21.15.35:0/2028890025 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 8411+0+0 (secure 0 0 0) 0x7fdb18063080 con 0x557c3ba6dbe0 2023-03-17T09:59:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb10ff9700 1 -- 172.21.15.35:0/2028890025 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb180980c0 con 0x557c3ba6dbe0 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 10 client.17826 fetch_fsmap learned FSMap version 37 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x557c3b7d1c00 con 0x557c3ba6dbe0 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb10ff9700 1 -- 172.21.15.35:0/2028890025 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c3ba381e0 con 0x557c3ba6dbe0 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb10ff9700 1 -- 172.21.15.35:0/2028890025 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdb18097020 con 0x557c3ba6dbe0 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 10 client.17826 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 10 client.17826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 20 client.17826 populate_metadata read hostname 'smithi035' 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3bace050 0x557c3bad0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T09:59:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 4 client.17826 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T09:59:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.896+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557c3b83ef00 con 0x557c3bace050 2023-03-17T09:59:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.897+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3bace050 0x557c3bad0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T09:59:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.897+0000 7fdb2d7c5700 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3bace050 0x557c3bad0460 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3120577fc28a86 server_cookie=30c179a4192ccab7 in_seq=0 out_seq=0 2023-03-17T09:59:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.897+0000 7fdb10ff9700 10 client.17826 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:49.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb10ff9700 1 -- 172.21.15.35:0/2028890025 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557c3b83ef00 con 0x557c3bace050 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb10ff9700 10 client.17826 handle_command_reply: tid=0 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 client.17826 shutdown 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 msgr2=0x557c3ba6ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6ae90 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdb180074a0 tx=0x7fdb18094400 comp rx=0 tx=0).stop 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 shutdown_connections 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557c3bace050 0x557c3bad0460 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:50.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c3ba6e4f0 0x557c3ba696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c3ba68960 0x557c3ba6a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb10ff9700 0 client.17826 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T09:59:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 --2- 172.21.15.35:0/2028890025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557c3ba6dbe0 0x557c3ba6ae90 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T09:59:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 >> 172.21.15.35:0/2028890025 conn(0x557c3b8c56b0 msgr2=0x557c3ba6c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T09:59:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 shutdown_connections 2023-03-17T09:59:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 1 -- 172.21.15.35:0/2028890025 wait complete. 2023-03-17T09:59:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb3bbb6b80 20 client.17826 trim_cache size 0 max 16384 2023-03-17T09:59:55.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:47 smithi035 ceph-mon[92535]: pgmap v2092: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T09:59:57.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:49 smithi035 ceph-mon[92535]: pgmap v2093: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:59:57.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:51 smithi035 ceph-mon[92535]: pgmap v2094: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T09:59:57.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:53 smithi035 ceph-mon[92535]: pgmap v2095: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:55 smithi035 ceph-mon[92535]: pgmap v2096: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:57 smithi035 ceph-mon[92535]: pgmap v2097: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:58 smithi035 ceph-mon[92535]: pgmap v2098: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 283 B/s wr, 14 op/s 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:50:58 smithi035 ceph-mon[92535]: pgmap v2099: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T09:59:57.634 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:00 smithi035 ceph-mon[92535]: pgmap v2100: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:02 smithi035 ceph-mon[92535]: pgmap v2101: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 347 B/s wr, 6 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:04 smithi035 ceph-mon[92535]: pgmap v2102: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:06 smithi035 ceph-mon[92535]: pgmap v2103: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:08 smithi035 ceph-mon[92535]: pgmap v2104: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:09 smithi035 ceph-mon[92535]: osdmap e207: 12 total, 12 up, 12 in 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:10 smithi035 ceph-mon[92535]: pgmap v2106: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:12 smithi035 ceph-mon[92535]: pgmap v2107: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T09:59:57.635 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:14 smithi035 ceph-mon[92535]: pgmap v2108: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:59:57.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:16 smithi035 ceph-mon[92535]: pgmap v2109: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:59:57.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:16 smithi035 ceph-mon[92535]: osdmap e208: 12 total, 12 up, 12 in 2023-03-17T09:59:57.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:18 smithi035 ceph-mon[92535]: pgmap v2111: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 998 B/s wr, 13 op/s 2023-03-17T09:59:57.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:20 smithi035 ceph-mon[92535]: pgmap v2112: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:59:57.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:22 smithi035 ceph-mon[92535]: pgmap v2113: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T09:59:57.636 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:24 smithi035 ceph-mon[92535]: pgmap v2114: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:59:58.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:26 smithi035 ceph-mon[92535]: pgmap v2115: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:28 smithi035 ceph-mon[92535]: pgmap v2116: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 456 B/s wr, 14 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:30 smithi035 ceph-mon[92535]: pgmap v2117: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:32 smithi035 ceph-mon[92535]: pgmap v2118: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:34 smithi035 ceph-mon[92535]: pgmap v2119: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:36 smithi035 ceph-mon[92535]: pgmap v2120: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:38 smithi035 ceph-mon[92535]: pgmap v2121: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:40 smithi035 ceph-mon[92535]: pgmap v2122: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:42 smithi035 ceph-mon[92535]: pgmap v2123: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:44 smithi035 ceph-mon[92535]: pgmap v2124: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:59:58.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:46 smithi035 ceph-mon[92535]: pgmap v2125: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T09:59:58.895 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:48 smithi035 ceph-mon[92535]: pgmap v2126: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T09:59:58.895 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:50 smithi035 ceph-mon[92535]: pgmap v2127: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:59:58.895 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:52 smithi035 ceph-mon[92535]: pgmap v2128: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:59:58.895 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:54 smithi035 ceph-mon[92535]: pgmap v2129: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T09:59:58.896 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:56 smithi035 ceph-mon[92535]: pgmap v2130: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T09:59:58.896 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T09:59:58.896 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T09:59:58.896 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:00:00.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:58 smithi035 ceph-mon[92535]: pgmap v2131: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:58 smithi035 ceph-mon[92535]: pgmap v2132: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:51:58 smithi035 ceph-mon[92535]: pgmap v2133: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:00 smithi035 ceph-mon[92535]: pgmap v2134: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:03 smithi035 ceph-mon[92535]: pgmap v2135: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:04 smithi035 ceph-mon[92535]: pgmap v2136: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:06 smithi035 ceph-mon[92535]: pgmap v2137: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:08 smithi035 ceph-mon[92535]: pgmap v2138: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:00:00.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:10 smithi035 ceph-mon[92535]: osdmap e209: 12 total, 12 up, 12 in 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:10 smithi035 ceph-mon[92535]: pgmap v2140: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:12 smithi035 ceph-mon[92535]: pgmap v2141: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:14 smithi035 ceph-mon[92535]: pgmap v2142: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:16 smithi035 ceph-mon[92535]: osdmap e210: 12 total, 12 up, 12 in 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:16 smithi035 ceph-mon[92535]: pgmap v2144: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:18 smithi035 ceph-mon[92535]: pgmap v2145: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:20 smithi035 ceph-mon[92535]: pgmap v2146: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:22 smithi035 ceph-mon[92535]: pgmap v2147: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:00:00.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:24 smithi035 ceph-mon[92535]: pgmap v2148: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:00:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:00:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:00:00.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:00:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:00:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:00:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb1409f640 msgr2=0x7fdb140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb1409f640 0x7fdb140a1af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400b5c0 tx=0x7fdb24005fb0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 msgr2=0x7fdb28101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.902+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 0x7fdb28101770 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800c9b0 tx=0x7fdb1800ccc0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 shutdown_connections 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb1409f640 0x7fdb140a1af0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb2810cb00 0x7fdb28101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb280fef50 0x7fdb28101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 --2- 172.21.15.35:0/1208791522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb280ff860 0x7fdb28101770 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 >> 172.21.15.35:0/1208791522 conn(0x7fdb28076330 msgr2=0x7fdb280fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 shutdown_connections 2023-03-17T10:00:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:36:55.903+0000 7fdb2fa29700 1 -- 172.21.15.35:0/1208791522 wait complete. 2023-03-17T10:00:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.097+0000 7f47b42a6700 1 -- 172.21.15.35:0/411235129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac104390 msgr2=0x7f47ac10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.097+0000 7f47b42a6700 1 --2- 172.21.15.35:0/411235129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac104390 0x7f47ac10bf60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f47a400b0d0 tx=0x7f47a400b3e0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 -- 172.21.15.35:0/411235129 shutdown_connections 2023-03-17T10:00:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 --2- 172.21.15.35:0/411235129 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac104390 0x7f47ac10bf60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 --2- 172.21.15.35:0/411235129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ff350 0x7f47ac0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 --2- 172.21.15.35:0/411235129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47ac0ffcf0 0x7f47ac103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:01.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 -- 172.21.15.35:0/411235129 >> 172.21.15.35:0/411235129 conn(0x7f47ac076330 msgr2=0x7f47ac076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 -- 172.21.15.35:0/411235129 shutdown_connections 2023-03-17T10:00:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 -- 172.21.15.35:0/411235129 wait complete. 2023-03-17T10:00:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 Processor -- start 2023-03-17T10:00:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.098+0000 7f47b42a6700 1 -- start start 2023-03-17T10:00:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 0x7f47ac1952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ffcf0 0x7f47ac195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47ac104390 0x7f47ac199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19a2b0 con 0x7f47ac0ff350 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19a420 con 0x7f47ac0ffcf0 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19a5e0 con 0x7f47ac104390 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 0x7f47ac1952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 0x7f47ac1952d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48072/0 (socket says 172.21.15.35:48072) 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 -- 172.21.15.35:0/1266817420 learned_addr learned my addr 172.21.15.35:0/1266817420 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2843700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47ac104390 0x7f47ac199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 -- 172.21.15.35:0/1266817420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47ac104390 msgr2=0x7f47ac199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47ac104390 0x7f47ac199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 -- 172.21.15.35:0/1266817420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ffcf0 msgr2=0x7f47ac195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b1841700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ffcf0 0x7f47ac195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ffcf0 0x7f47ac195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 -- 172.21.15.35:0/1266817420 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4009d00 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b1841700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ffcf0 0x7f47ac195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b2042700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 0x7f47ac1952d0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f47a800d950 tx=0x7f47a800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f479f7fe700 1 -- 172.21.15.35:0/1266817420 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8009b40 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f479f7fe700 1 -- 172.21.15.35:0/1266817420 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47a8009ca0 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac10f060 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f479f7fe700 1 -- 172.21.15.35:0/1266817420 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800f620 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.099+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac10eed0 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.102+0000 7f479f7fe700 1 -- 172.21.15.35:0/1266817420 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f47a8010460 con 0x7f47ac0ff350 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.102+0000 7f479f7fe700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f479809f6c0 0x7f47980a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.103+0000 7f47b1841700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f479809f6c0 0x7f47980a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.103+0000 7f479f7fe700 1 -- 172.21.15.35:0/1266817420 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47a80ca920 con 0x7f47ac0ff350 2023-03-17T10:00:03.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.103+0000 7f47b1841700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f479809f6c0 0x7f47980a1b70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47ac1968e0 tx=0x7f47a0009550 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:03.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 Processor -- start 2023-03-17T10:00:03.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 -- start start 2023-03-17T10:00:03.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce70bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcd69010 con 0x5625dce69e40 2023-03-17T10:00:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcdbb950 con 0x5625dce64fe0 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47c0433b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcdb4de0 con 0x5625dce64630 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47b2042700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47b2042700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48080/0 (socket says 172.21.15.35:48080) 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.104+0000 7f47b2042700 1 -- 172.21.15.35:0/587506042 learned_addr learned my addr 172.21.15.35:0/587506042 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b1841700 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2843700 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce70bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2042700 1 -- 172.21.15.35:0/587506042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 msgr2=0x5625dce64aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2042700 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce64aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2042700 1 -- 172.21.15.35:0/587506042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 msgr2=0x5625dce70bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2042700 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce70bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2042700 1 -- 172.21.15.35:0/587506042 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dcc365d0 con 0x5625dce69e40 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f47b2042700 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6a210 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f47a8094e40 tx=0x7f47a8098270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5279943c8e012a2f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f479cdae700 1 -- 172.21.15.35:0/587506042 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a809c1b0 con 0x5625dce69e40 2023-03-17T10:00:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f479cdae700 1 -- 172.21.15.35:0/587506042 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47a80a05c0 con 0x5625dce69e40 2023-03-17T10:00:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.105+0000 7f479cdae700 1 -- 172.21.15.35:0/587506042 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8098870 con 0x5625dce69e40 2023-03-17T10:00:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 -- 172.21.15.35:0/587506042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 msgr2=0x5625dce6a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6a210 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f47a8094e40 tx=0x7f47a8098270 comp rx=0 tx=0).stop 2023-03-17T10:00:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 -- 172.21.15.35:0/587506042 shutdown_connections 2023-03-17T10:00:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce70bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6a210 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 --2- 172.21.15.35:0/587506042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce64aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 -- 172.21.15.35:0/587506042 >> 172.21.15.35:0/587506042 conn(0x5625dccbf6b0 msgr2=0x5625dce5ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 -- 172.21.15.35:0/587506042 shutdown_connections 2023-03-17T10:00:07.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 -- 172.21.15.35:0/587506042 wait complete. 2023-03-17T10:00:07.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 -- start start 2023-03-17T10:00:07.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.106+0000 7f47c0433b80 1 Processor -- start 2023-03-17T10:00:07.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce73f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:07.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcc388c0 con 0x5625dce69e40 2023-03-17T10:00:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dce6e270 con 0x5625dce64fe0 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dce6e430 con 0x5625dce64630 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47c0433b80 10 client.0 _ll_register_callbacks cb 0x5625dcc5a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2042700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48090/0 (socket says 172.21.15.35:48090) 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 -- 172.21.15.35:0/3389726100 learned_addr learned my addr 172.21.15.35:0/3389726100 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b1841700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce73f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 -- 172.21.15.35:0/3389726100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 msgr2=0x5625dce739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 -- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 msgr2=0x5625dce73f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce73f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 -- 172.21.15.35:0/3389726100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac10eed0 con 0x5625dce69e40 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b1841700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce73f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:00:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2042700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:00:10.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f47b2843700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6dc60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009330 tx=0x7f47a4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3822fabba06b6b3a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.107+0000 7f4795ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f4795ffb700 1 -- 172.21.15.35:0/3389726100 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400e070 con 0x5625dce69e40 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f4795ffb700 1 -- 172.21.15.35:0/3389726100 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(182..182 src has 1..182) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47a40074e0 con 0x5625dce69e40 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625dcd77390 con 0x5625dce69e40 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f4795ffb700 1 -- 172.21.15.35:0/3389726100 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a4004e60 con 0x5625dce69e40 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 10 client.17838 fetch_fsmap learned FSMap version 37 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5625dcbe2d80 con 0x5625dce69e40 2023-03-17T10:00:10.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f4795ffb700 1 -- 172.21.15.35:0/3389726100 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5625dcd77390 con 0x5625dce69e40 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f4795ffb700 1 -- 172.21.15.35:0/3389726100 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f47a400b100 con 0x5625dce69e40 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 10 client.17838 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 10 client.17838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 20 client.17838 populate_metadata read hostname 'smithi035' 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dce7e1c0 0x5625dce805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 4 client.17838 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:00:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625dcd83600 con 0x5625dce7e1c0 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.108+0000 7f47b2042700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dce7e1c0 0x5625dce805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.109+0000 7f47b2042700 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dce7e1c0 0x5625dce805d0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8bf0ce5ead6db4d server_cookie=b850a8ae8da7aa6 in_seq=0 out_seq=0 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.109+0000 7f4795ffb700 10 client.17838 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.109+0000 7f4795ffb700 1 -- 172.21.15.35:0/3389726100 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5625dcd83600 con 0x5625dce7e1c0 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.109+0000 7f4795ffb700 10 client.17838 handle_command_reply: tid=0 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 client.17838 shutdown 2023-03-17T10:00:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 msgr2=0x5625dce6dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6dc60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009330 tx=0x7f47a4009360 comp rx=0 tx=0).stop 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 shutdown_connections 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dce7e1c0 0x5625dce805d0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce6dc60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f4795ffb700 0 client.17838 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64630 0x5625dce739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 --2- 172.21.15.35:0/3389726100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64fe0 0x5625dce73f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 >> 172.21.15.35:0/3389726100 conn(0x5625dccbf6b0 msgr2=0x5625dce61410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 shutdown_connections 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 1 -- 172.21.15.35:0/3389726100 wait complete. 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.110+0000 7f47c0433b80 20 client.17838 trim_cache size 0 max 16384 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 Processor -- start 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 -- start start 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dce64a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dce61b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dce5d6b0 con 0x5625dce69e40 2023-03-17T10:00:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dce69aa0 con 0x5625dce64630 2023-03-17T10:00:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47c0433b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dce68b40 con 0x5625dce64fe0 2023-03-17T10:00:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48098/0 (socket says 172.21.15.35:48098) 2023-03-17T10:00:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 -- 172.21.15.35:0/1833367496 learned_addr learned my addr 172.21.15.35:0/1833367496 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b1841700 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dce61b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 -- 172.21.15.35:0/1833367496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 msgr2=0x5625dce61b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dce61b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2042700 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dce64a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 -- 172.21.15.35:0/1833367496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 msgr2=0x5625dce64a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dce64a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2843700 1 -- 172.21.15.35:0/1833367496 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625dcd7b130 con 0x5625dce69e40 2023-03-17T10:00:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.125+0000 7f47b2042700 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dce64a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:00:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47b2843700 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce735a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009cd0 tx=0x7f47a4006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb25fee92a9745d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f479d5af700 1 -- 172.21.15.35:0/1833367496 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400e070 con 0x5625dce69e40 2023-03-17T10:00:14.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:26 smithi035 ceph-mon[92535]: pgmap v2149: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f479d5af700 1 -- 172.21.15.35:0/1833367496 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47a4007930 con 0x5625dce69e40 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f479d5af700 1 -- 172.21.15.35:0/1833367496 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4025550 con 0x5625dce69e40 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 -- 172.21.15.35:0/1833367496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 msgr2=0x5625dce735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce735a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009cd0 tx=0x7f47a4006000 comp rx=0 tx=0).stop 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 -- 172.21.15.35:0/1833367496 shutdown_connections 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dce735a0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dce64a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1833367496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dce61b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 -- 172.21.15.35:0/1833367496 >> 172.21.15.35:0/1833367496 conn(0x5625dccbf6b0 msgr2=0x5625dce61410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.126+0000 7f47c0433b80 1 -- 172.21.15.35:0/1833367496 shutdown_connections 2023-03-17T10:00:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 -- 172.21.15.35:0/1833367496 wait complete. 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 -- start start 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 Processor -- start 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dcecb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dcecb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dcec5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcec5b40 con 0x5625dce69e40 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcec5cb0 con 0x5625dce64630 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625dcec5e70 con 0x5625dce64fe0 2023-03-17T10:00:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47c0433b80 10 client.0 _ll_register_callbacks cb 0x5625dcc5a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47b2843700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dcec5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47b2843700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dcec5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48104/0 (socket says 172.21.15.35:48104) 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47b2843700 1 -- 172.21.15.35:0/1932995379 learned_addr learned my addr 172.21.15.35:0/1932995379 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47b2042700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dcecb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47b1841700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dcecb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.127+0000 7f47b2843700 1 -- 172.21.15.35:0/1932995379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 msgr2=0x5625dcecb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47b2843700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dcecb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47b2843700 1 -- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 msgr2=0x5625dcecb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47b2843700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dcecb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47b2843700 1 -- 172.21.15.35:0/1932995379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625dcbe2d80 con 0x5625dce69e40 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47b2042700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dcecb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47b2843700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dcec5560 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f47a4025ea0 tx=0x7f47a400b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90ddf9b1772c568 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f4795ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f4795ffb700 1 -- 172.21.15.35:0/1932995379 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400e040 con 0x5625dce69e40 2023-03-17T10:00:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f4795ffb700 1 -- 172.21.15.35:0/1932995379 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(182..182 src has 1..182) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47a4025460 con 0x5625dce69e40 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625dce321e0 con 0x5625dce69e40 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f4795ffb700 1 -- 172.21.15.35:0/1932995379 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a4025620 con 0x5625dce69e40 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 10 client.17844 fetch_fsmap learned FSMap version 37 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5625dcc091f0 con 0x5625dce69e40 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f4795ffb700 1 -- 172.21.15.35:0/1932995379 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5625dce321e0 con 0x5625dce69e40 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f4795ffb700 1 -- 172.21.15.35:0/1932995379 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f47a4037410 con 0x5625dce69e40 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 10 client.17844 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 10 client.17844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 20 client.17844 populate_metadata read hostname 'smithi035' 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dced2ac0 0x5625dced4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 4 client.17844 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.128+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5625dcc38f00 con 0x5625dced2ac0 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.129+0000 7f47b2042700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dced2ac0 0x5625dced4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.129+0000 7f4795ffb700 10 client.17844 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.129+0000 7f47b2042700 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dced2ac0 0x5625dced4ea0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66326b23579f37f server_cookie=94879eb4556ca1a in_seq=0 out_seq=0 2023-03-17T10:00:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f4795ffb700 1 -- 172.21.15.35:0/1932995379 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5625dcc38f00 con 0x5625dced2ac0 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f4795ffb700 10 client.17844 handle_command_reply: tid=0 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 client.17844 shutdown 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 msgr2=0x5625dcec5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dcec5560 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f47a4025ea0 tx=0x7f47a400b380 comp rx=0 tx=0).stop 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 shutdown_connections 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625dced2ac0 0x5625dced4ea0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625dce69e40 0x5625dcec5560 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625dce64630 0x5625dcecb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 --2- 172.21.15.35:0/1932995379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625dce64fe0 0x5625dcecb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f4795ffb700 0 client.17844 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 >> 172.21.15.35:0/1932995379 conn(0x5625dccbf6b0 msgr2=0x5625dce61ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 shutdown_connections 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 1 -- 172.21.15.35:0/1932995379 wait complete. 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.136+0000 7f47c0433b80 20 client.17844 trim_cache size 0 max 16384 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f479809f6c0 msgr2=0x7f47980a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f479809f6c0 0x7f47980a1b70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47ac1968e0 tx=0x7f47a0009550 comp rx=0 tx=0).stop 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 msgr2=0x7f47ac1952d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 0x7f47ac1952d0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f47a800d950 tx=0x7f47a800dd10 comp rx=0 tx=0).stop 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 shutdown_connections 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f479809f6c0 0x7f47980a1b70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47ac104390 0x7f47ac199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47ac0ff350 0x7f47ac1952d0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 --2- 172.21.15.35:0/1266817420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ac0ffcf0 0x7f47ac195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 >> 172.21.15.35:0/1266817420 conn(0x7f47ac076330 msgr2=0x7f47ac0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 shutdown_connections 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:06.137+0000 7f47b42a6700 1 -- 172.21.15.35:0/1266817420 wait complete. 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 -- 172.21.15.35:0/757394611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe0100470 msgr2=0x7fabe0100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/757394611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe0100470 0x7fabe0100840 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fabd00099c0 tx=0x7fabd0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 -- 172.21.15.35:0/757394611 shutdown_connections 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/757394611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe01054b0 0x7fabe010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/757394611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe0100470 0x7fabe0100840 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/757394611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100e10 0x7fabe0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 -- 172.21.15.35:0/757394611 >> 172.21.15.35:0/757394611 conn(0x7fabe00fbce0 msgr2=0x7fabe00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 -- 172.21.15.35:0/757394611 shutdown_connections 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.259+0000 7fabe5c5d700 1 -- 172.21.15.35:0/757394611 wait complete. 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 Processor -- start 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 -- start start 2023-03-17T10:00:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100470 0x7fabe0196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe0100e10 0x7fabe0196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 0x7fabe019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:21.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe019b200 con 0x7fabe01054b0 2023-03-17T10:00:21.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe019b370 con 0x7fabe0100e10 2023-03-17T10:00:21.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabe5c5d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe019b530 con 0x7fabe0100470 2023-03-17T10:00:21.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabdffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 0x7fabe019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:21.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabdffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 0x7fabe019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48118/0 (socket says 172.21.15.35:48118) 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabdffff700 1 -- 172.21.15.35:0/3879688825 learned_addr learned my addr 172.21.15.35:0/3879688825 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabdeffd700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe0100e10 0x7fabe0196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.260+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100470 0x7fabe0196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdffff700 1 -- 172.21.15.35:0/3879688825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100470 msgr2=0x7fabe0196220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdffff700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100470 0x7fabe0196220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdffff700 1 -- 172.21.15.35:0/3879688825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe0100e10 msgr2=0x7fabe0196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdffff700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe0100e10 0x7fabe0196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdffff700 1 -- 172.21.15.35:0/3879688825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00095f0 con 0x7fabe01054b0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100470 0x7fabe0196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdffff700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 0x7fabe019abc0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007d70 tx=0x7fabd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdcff9700 1 -- 172.21.15.35:0/3879688825 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800ad40 con 0x7fabe01054b0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe0110180 con 0x7fabe01054b0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdcff9700 1 -- 172.21.15.35:0/3879688825 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabd80128b0 con 0x7fabe01054b0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabdcff9700 1 -- 172.21.15.35:0/3879688825 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80115c0 con 0x7fabe01054b0 2023-03-17T10:00:21.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.261+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe010fff0 con 0x7fabe01054b0 2023-03-17T10:00:21.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.263+0000 7fabdcff9700 1 -- 172.21.15.35:0/3879688825 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fabd8012a20 con 0x7fabe01054b0 2023-03-17T10:00:22.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.264+0000 7fabdcff9700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fabcc09f640 0x7fabcc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.264+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fabcc09f640 0x7fabcc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.264+0000 7fabdcff9700 1 -- 172.21.15.35:0/3879688825 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fabd80ca780 con 0x7fabe01054b0 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fabcc09f640 0x7fabcc0a1af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fabd0005cd0 tx=0x7fabd0005c40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 Processor -- start 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 -- start start 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede7be0 0x5596fede7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fede2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596fede2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fece9010 con 0x5596fede2960 2023-03-17T10:00:28.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fed3b950 con 0x5596fede7be0 2023-03-17T10:00:28.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabf1deab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fed34de0 con 0x5596fede84f0 2023-03-17T10:00:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabdffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596fede2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabdffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596fede2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48126/0 (socket says 172.21.15.35:48126) 2023-03-17T10:00:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabdffff700 1 -- 172.21.15.35:0/1333313724 learned_addr learned my addr 172.21.15.35:0/1333313724 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede7be0 0x5596fede7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.265+0000 7fabdeffd700 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fede2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdffff700 1 -- 172.21.15.35:0/1333313724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 msgr2=0x5596fede2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdffff700 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fede2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdffff700 1 -- 172.21.15.35:0/1333313724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede7be0 msgr2=0x5596fede7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdffff700 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede7be0 0x5596fede7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdffff700 1 -- 172.21.15.35:0/1333313724 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596febb65d0 con 0x5596fede2960 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdeffd700 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fede2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabdffff700 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596fede2d90 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fabd8094d50 tx=0x7fabd8012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307217d8e32fa4b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabd5ffb700 1 -- 172.21.15.35:0/1333313724 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8096680 con 0x5596fede2960 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabd5ffb700 1 -- 172.21.15.35:0/1333313724 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabd8098540 con 0x5596fede2960 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.266+0000 7fabd5ffb700 1 -- 172.21.15.35:0/1333313724 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80a0040 con 0x5596fede2960 2023-03-17T10:00:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 -- 172.21.15.35:0/1333313724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 msgr2=0x5596fede2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596fede2d90 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fabd8094d50 tx=0x7fabd8012d00 comp rx=0 tx=0).stop 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 -- 172.21.15.35:0/1333313724 shutdown_connections 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596fede2d90 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede7be0 0x5596fede7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1333313724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fede2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 -- 172.21.15.35:0/1333313724 >> 172.21.15.35:0/1333313724 conn(0x5596fec3f6b0 msgr2=0x5596feddca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 -- 172.21.15.35:0/1333313724 shutdown_connections 2023-03-17T10:00:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 -- 172.21.15.35:0/1333313724 wait complete. 2023-03-17T10:00:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 -- start start 2023-03-17T10:00:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.267+0000 7fabf1deab80 1 Processor -- start 2023-03-17T10:00:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede2960 0x5596fedee520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedeb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fedebe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596febb88c0 con 0x5596fede7be0 2023-03-17T10:00:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedec5b0 con 0x5596fede2960 2023-03-17T10:00:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedf8030 con 0x5596fede84f0 2023-03-17T10:00:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 10 client.0 _ll_register_callbacks cb 0x5596febda230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:00:34.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedeb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:34.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedeb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48130/0 (socket says 172.21.15.35:48130) 2023-03-17T10:00:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 -- 172.21.15.35:0/1451698473 learned_addr learned my addr 172.21.15.35:0/1451698473 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede2960 0x5596fedee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:35.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:28 smithi035 ceph-mon[92535]: pgmap v2150: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdffff700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fedebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 -- 172.21.15.35:0/1451698473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 msgr2=0x5596fedebe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fedebe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 -- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede2960 msgr2=0x5596fedee520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede2960 0x5596fedee520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 -- 172.21.15.35:0/1451698473 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe010fff0 con 0x5596fede7be0 2023-03-17T10:00:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabdeffd700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedeb730 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fabc80102a0 tx=0x7fabc8010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20a0815b90cae3d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabbeffd700 1 -- 172.21.15.35:0/1451698473 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80145f0 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabbeffd700 1 -- 172.21.15.35:0/1451698473 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fabc8014750 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.268+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596fecf7390 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabbeffd700 1 -- 172.21.15.35:0/1451698473 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc8014910 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 10 client.17856 fetch_fsmap learned FSMap version 37 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5596feb62d80 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabbeffd700 1 -- 172.21.15.35:0/1451698473 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5596fecf7390 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabbeffd700 1 -- 172.21.15.35:0/1451698473 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fabc801cab0 con 0x5596fede7be0 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 10 client.17856 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 10 client.17856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 20 client.17856 populate_metadata read hostname 'smithi035' 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fedfc110 0x5596fedfe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 4 client.17856 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596fed03600 con 0x5596fedfc110 2023-03-17T10:00:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.269+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fedfc110 0x5596fedfe520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.270+0000 7fabbeffd700 10 client.17856 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.270+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fedfc110 0x5596fedfe520 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a79b3688e005a1 server_cookie=4eb5c03541e605a7 in_seq=0 out_seq=0 2023-03-17T10:00:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabbeffd700 1 -- 172.21.15.35:0/1451698473 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5596fed03600 con 0x5596fedfc110 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabbeffd700 10 client.17856 handle_command_reply: tid=0 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 client.17856 shutdown 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 msgr2=0x5596fedeb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedeb730 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fabc80102a0 tx=0x7fabc8010660 comp rx=0 tx=0).stop 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 shutdown_connections 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fedfc110 0x5596fedfe520 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede84f0 0x5596fedebe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede2960 0x5596fedee520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabbeffd700 0 client.17856 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1451698473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedeb730 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 >> 172.21.15.35:0/1451698473 conn(0x5596fec3f6b0 msgr2=0x5596fede1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 shutdown_connections 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 1 -- 172.21.15.35:0/1451698473 wait complete. 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.271+0000 7fabf1deab80 20 client.17856 trim_cache size 0 max 16384 2023-03-17T10:00:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 Processor -- start 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 -- start start 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596feddcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede7be0 0x5596fedf2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedee050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedd80f0 con 0x5596fede2960 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedf9810 con 0x5596fede84f0 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabf1deab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596feddd000 con 0x5596fede7be0 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabdf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596feddcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabdf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596feddcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48136/0 (socket says 172.21.15.35:48136) 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.286+0000 7fabdf7fe700 1 -- 172.21.15.35:0/1809745106 learned_addr learned my addr 172.21.15.35:0/1809745106 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdffff700 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdeffd700 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede7be0 0x5596fedf2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdf7fe700 1 -- 172.21.15.35:0/1809745106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede7be0 msgr2=0x5596fedf2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede7be0 0x5596fedf2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdf7fe700 1 -- 172.21.15.35:0/1809745106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 msgr2=0x5596fedee050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedee050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdf7fe700 1 -- 172.21.15.35:0/1809745106 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596fecfb130 con 0x5596fede2960 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdffff700 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596feddcac0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fabd00099c0 tx=0x7fabd0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac14beaa5b99007 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabd67fc700 1 -- 172.21.15.35:0/1809745106 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd001e070 con 0x5596fede2960 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabd67fc700 1 -- 172.21.15.35:0/1809745106 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabd002d040 con 0x5596fede2960 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabd67fc700 1 -- 172.21.15.35:0/1809745106 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0004880 con 0x5596fede2960 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabf1deab80 1 -- 172.21.15.35:0/1809745106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 msgr2=0x5596feddcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.287+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596feddcac0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fabd00099c0 tx=0x7fabd0021000 comp rx=0 tx=0).stop 2023-03-17T10:00:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- 172.21.15.35:0/1809745106 shutdown_connections 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede2960 0x5596feddcac0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 --2- 172.21.15.35:0/1809745106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede7be0 0x5596fedf2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- 172.21.15.35:0/1809745106 >> 172.21.15.35:0/1809745106 conn(0x5596fec3f6b0 msgr2=0x5596fede1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- 172.21.15.35:0/1809745106 shutdown_connections 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- 172.21.15.35:0/1809745106 wait complete. 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- start start 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 Processor -- start 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede2960 0x5596fedf2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedf10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedf15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedf1b20 con 0x5596fede7be0 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedf1c90 con 0x5596fede84f0 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fedf1e50 con 0x5596fede2960 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.288+0000 7fabf1deab80 10 client.0 _ll_register_callbacks cb 0x5596febda230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedf10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedf10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48144/0 (socket says 172.21.15.35:48144) 2023-03-17T10:00:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 -- 172.21.15.35:0/745627642 learned_addr learned my addr 172.21.15.35:0/745627642 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdffff700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedf15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede2960 0x5596fedf2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 -- 172.21.15.35:0/745627642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede2960 msgr2=0x5596fedf2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede2960 0x5596fedf2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 -- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 msgr2=0x5596fedf15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedf15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 -- 172.21.15.35:0/745627642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe010d8c0 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabdeffd700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedf10a0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009da0 tx=0x7fabc8009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aab6b51cd7a13d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabbeffd700 1 -- 172.21.15.35:0/745627642 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8005e60 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabbeffd700 1 -- 172.21.15.35:0/745627642 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fabc80133c0 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596fedb21e0 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabbeffd700 1 -- 172.21.15.35:0/745627642 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc8010a60 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabf1deab80 10 client.17862 fetch_fsmap learned FSMap version 37 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.289+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5596feb891f0 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabbeffd700 1 -- 172.21.15.35:0/745627642 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5596fedb21e0 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabbeffd700 1 -- 172.21.15.35:0/745627642 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fabc801c8a0 con 0x5596fede7be0 2023-03-17T10:00:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabf1deab80 10 client.17862 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabf1deab80 10 client.17862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabf1deab80 20 client.17862 populate_metadata read hostname 'smithi035' 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabf1deab80 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fee51380 0x5596fee53790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabf1deab80 4 client.17862 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5596febb8f00 con 0x5596fee51380 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fee51380 0x5596fee53790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabdf7fe700 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fee51380 0x5596fee53790 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d10a925b55f687dd server_cookie=d7ff24e47fa50599 in_seq=0 out_seq=0 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.290+0000 7fabbeffd700 10 client.17862 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.297+0000 7fabbeffd700 1 -- 172.21.15.35:0/745627642 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5596febb8f00 con 0x5596fee51380 2023-03-17T10:00:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabbeffd700 10 client.17862 handle_command_reply: tid=0 2023-03-17T10:00:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 client.17862 shutdown 2023-03-17T10:00:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 msgr2=0x5596fedf10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedf10a0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009da0 tx=0x7fabc8009370 comp rx=0 tx=0).stop 2023-03-17T10:00:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 shutdown_connections 2023-03-17T10:00:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5596fee51380 0x5596fee53790 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596fede84f0 0x5596fedf15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabbeffd700 0 client.17862 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5596fede2960 0x5596fedf2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 --2- 172.21.15.35:0/745627642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5596fede7be0 0x5596fedf10a0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 >> 172.21.15.35:0/745627642 conn(0x5596fec3f6b0 msgr2=0x5596fede56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 shutdown_connections 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 1 -- 172.21.15.35:0/745627642 wait complete. 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabf1deab80 20 client.17862 trim_cache size 0 max 16384 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fabcc09f640 msgr2=0x7fabcc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fabcc09f640 0x7fabcc0a1af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fabd0005cd0 tx=0x7fabd0005c40 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 msgr2=0x7fabe019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 0x7fabe019abc0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007d70 tx=0x7fabd800a340 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.298+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 shutdown_connections 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fabcc09f640 0x7fabcc0a1af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabe01054b0 0x7fabe019abc0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe0100470 0x7fabe0196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 --2- 172.21.15.35:0/3879688825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabe0100e10 0x7fabe0196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 >> 172.21.15.35:0/3879688825 conn(0x7fabe00fbce0 msgr2=0x7fabe0103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 shutdown_connections 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:19.299+0000 7fabe5c5d700 1 -- 172.21.15.35:0/3879688825 wait complete. 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/1844532980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e80ffcf0 msgr2=0x7fa5e8103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/1844532980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e80ffcf0 0x7fa5e8103cb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80099c0 tx=0x7fa5d8009cd0 comp rx=0 tx=0).stop 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/1844532980 shutdown_connections 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/1844532980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5e8104390 0x7fa5e810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/1844532980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e80ff350 0x7fa5e80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/1844532980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e80ffcf0 0x7fa5e8103cb0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/1844532980 >> 172.21.15.35:0/1844532980 conn(0x7fa5e8076330 msgr2=0x7fa5e8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/1844532980 shutdown_connections 2023-03-17T10:00:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.420+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/1844532980 wait complete. 2023-03-17T10:00:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 Processor -- start 2023-03-17T10:00:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 -- start start 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5e80ff350 0x7fa5e81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e80ffcf0 0x7fa5e81975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 0x7fa5e81a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e81a2660 con 0x7fa5e8104390 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e81a27a0 con 0x7fa5e80ff350 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5ef4d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e81a28e0 con 0x7fa5e80ffcf0 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5eda74700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 0x7fa5e81a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5eda74700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 0x7fa5e81a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48160/0 (socket says 172.21.15.35:48160) 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.421+0000 7fa5eda74700 1 -- 172.21.15.35:0/3460658438 learned_addr learned my addr 172.21.15.35:0/3460658438 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eca72700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e80ffcf0 0x7fa5e81975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5ed273700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5e80ff350 0x7fa5e81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eda74700 1 -- 172.21.15.35:0/3460658438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e80ffcf0 msgr2=0x7fa5e81975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eda74700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e80ffcf0 0x7fa5e81975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eda74700 1 -- 172.21.15.35:0/3460658438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5e80ff350 msgr2=0x7fa5e81970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eda74700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5e80ff350 0x7fa5e81970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eda74700 1 -- 172.21.15.35:0/3460658438 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80095f0 con 0x7fa5e8104390 2023-03-17T10:00:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5eda74700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 0x7fa5e81a2120 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0007ee0 tx=0x7fa5e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:42.335 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:30 smithi035 ceph-mon[92535]: pgmap v2151: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5de7fc700 1 -- 172.21.15.35:0/3460658438 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0017070 con 0x7fa5e8104390 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5de7fc700 1 -- 172.21.15.35:0/3460658438 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5e000f040 con 0x7fa5e8104390 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e810efc0 con 0x7fa5e8104390 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5de7fc700 1 -- 172.21.15.35:0/3460658438 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0005570 con 0x7fa5e8104390 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.422+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e810ee30 con 0x7fa5e8104390 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.425+0000 7fa5de7fc700 1 -- 172.21.15.35:0/3460658438 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa5e000db20 con 0x7fa5e8104390 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.425+0000 7fa5de7fc700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5d409f640 0x7fa5d40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.425+0000 7fa5de7fc700 1 -- 172.21.15.35:0/3460658438 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa5e00c9d20 con 0x7fa5e8104390 2023-03-17T10:00:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.425+0000 7fa5ed273700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5d409f640 0x7fa5d40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.426+0000 7fa5ed273700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5d409f640 0x7fa5d40a1af0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009c60 tx=0x7fa5e4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.426+0000 7fa5fb664b80 1 Processor -- start 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.426+0000 7fa5fb664b80 1 -- start start 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.426+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a088be0 0x56543a088fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.426+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a083420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.426+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 0x56543a083d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565439f8a010 con 0x56543a083960 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565439fdc950 con 0x56543a0894f0 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565439fd5de0 con 0x56543a088be0 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 0x56543a083d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 0x56543a083d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48168/0 (socket says 172.21.15.35:48168) 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 -- 172.21.15.35:0/641187974 learned_addr learned my addr 172.21.15.35:0/641187974 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eca72700 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a083420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5ed273700 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a088be0 0x56543a088fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 -- 172.21.15.35:0/641187974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a088be0 msgr2=0x56543a088fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a088be0 0x56543a088fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 -- 172.21.15.35:0/641187974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 msgr2=0x56543a083420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a083420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 -- 172.21.15.35:0/641187974 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565439e575d0 con 0x56543a083960 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5eda74700 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 0x56543a083d90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0094240 tx=0x7fa5e0097690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f31d77965c5ad6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5d37fe700 1 -- 172.21.15.35:0/641187974 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0004c40 con 0x56543a083960 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5d37fe700 1 -- 172.21.15.35:0/641187974 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5e00977d0 con 0x56543a083960 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.427+0000 7fa5d37fe700 1 -- 172.21.15.35:0/641187974 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0097c30 con 0x56543a083960 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 -- 172.21.15.35:0/641187974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 msgr2=0x56543a083d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 0x56543a083d90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0094240 tx=0x7fa5e0097690 comp rx=0 tx=0).stop 2023-03-17T10:00:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 -- 172.21.15.35:0/641187974 shutdown_connections 2023-03-17T10:00:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a083960 0x56543a083d90 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a088be0 0x56543a088fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/641187974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a083420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:46.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 -- 172.21.15.35:0/641187974 >> 172.21.15.35:0/641187974 conn(0x565439ee06b0 msgr2=0x56543a07da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:46.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 -- 172.21.15.35:0/641187974 shutdown_connections 2023-03-17T10:00:46.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 -- 172.21.15.35:0/641187974 wait complete. 2023-03-17T10:00:46.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.428+0000 7fa5fb664b80 1 -- start start 2023-03-17T10:00:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 Processor -- start 2023-03-17T10:00:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a08c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a08cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565439e598c0 con 0x56543a088be0 2023-03-17T10:00:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a098fa0 con 0x56543a0894f0 2023-03-17T10:00:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a0990e0 con 0x56543a083960 2023-03-17T10:00:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5fb664b80 10 client.0 _ll_register_callbacks cb 0x565439e7b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:00:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5eca72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a08cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5eca72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a08cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48172/0 (socket says 172.21.15.35:48172) 2023-03-17T10:00:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5eca72700 1 -- 172.21.15.35:0/1940947212 learned_addr learned my addr 172.21.15.35:0/1940947212 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5ed273700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a08c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.429+0000 7fa5eda74700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5eca72700 1 -- 172.21.15.35:0/1940947212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 msgr2=0x56543a08c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5eca72700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a08c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5eca72700 1 -- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 msgr2=0x56543a08d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5eca72700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5eca72700 1 -- 172.21.15.35:0/1940947212 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e810ee30 con 0x56543a088be0 2023-03-17T10:00:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5ed273700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a08c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:00:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5eca72700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a08cd00 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80099c0 tx=0x7fa5d8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d7746ea8def70d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:00:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/1940947212 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80055f0 con 0x56543a088be0 2023-03-17T10:00:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/1940947212 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa5d8003760 con 0x56543a088be0 2023-03-17T10:00:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565439f98390 con 0x56543a088be0 2023-03-17T10:00:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/1940947212 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5d8005960 con 0x56543a088be0 2023-03-17T10:00:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5fb664b80 10 client.17874 fetch_fsmap learned FSMap version 37 2023-03-17T10:00:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x565439e03d80 con 0x56543a088be0 2023-03-17T10:00:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.430+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/1940947212 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565439f98390 con 0x56543a088be0 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/1940947212 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa5d800f990 con 0x56543a088be0 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5fb664b80 10 client.17874 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5fb664b80 10 client.17874 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5fb664b80 20 client.17874 populate_metadata read hostname 'smithi035' 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a09d170 0x56543a09f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5fb664b80 4 client.17874 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565439fa4600 con 0x56543a09d170 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5ed273700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a09d170 0x56543a09f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5d0ff9700 10 client.17874 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:59.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.431+0000 7fa5ed273700 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a09d170 0x56543a09f580 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=999d8dd707226e43 server_cookie=1cb89a05442db534 in_seq=0 out_seq=0 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/1940947212 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x565439fa4600 con 0x56543a09d170 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5d0ff9700 10 client.17874 handle_command_reply: tid=0 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 client.17874 shutdown 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 msgr2=0x56543a08cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a08cd00 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80099c0 tx=0x7fa5d8005040 comp rx=0 tx=0).stop 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 shutdown_connections 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a09d170 0x56543a09f580 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a08c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5d0ff9700 0 client.17874 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/1940947212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a08cd00 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 >> 172.21.15.35:0/1940947212 conn(0x565439ee06b0 msgr2=0x56543a082410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 shutdown_connections 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 1 -- 172.21.15.35:0/1940947212 wait complete. 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.432+0000 7fa5fb664b80 20 client.17874 trim_cache size 0 max 16384 2023-03-17T10:00:59.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 Processor -- start 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 -- start start 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a086dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a07dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565439f98390 con 0x56543a088be0 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a09a880 con 0x56543a0894f0 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a087300 con 0x56543a083960 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.447+0000 7fa5eca72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a07dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a07dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48180/0 (socket says 172.21.15.35:48180) 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 -- 172.21.15.35:0/74211612 learned_addr learned my addr 172.21.15.35:0/74211612 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5ed273700 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a086dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eda74700 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 -- 172.21.15.35:0/74211612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 msgr2=0x56543a086dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a086dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 -- 172.21.15.35:0/74211612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 msgr2=0x56543a08d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 -- 172.21.15.35:0/74211612 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565439f9c130 con 0x56543a088be0 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eda74700 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5eca72700 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a07dac0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80098e0 tx=0x7fa5d8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911c21fad787a3f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5d3fff700 1 -- 172.21.15.35:0/74211612 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8017440 con 0x56543a088be0 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5d3fff700 1 -- 172.21.15.35:0/74211612 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5d801e040 con 0x56543a088be0 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.448+0000 7fa5d3fff700 1 -- 172.21.15.35:0/74211612 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80039c0 con 0x56543a088be0 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 -- 172.21.15.35:0/74211612 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 msgr2=0x56543a07dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a07dac0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80098e0 tx=0x7fa5d8009290 comp rx=0 tx=0).stop 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 -- 172.21.15.35:0/74211612 shutdown_connections 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a0894f0 0x56543a08d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a083960 0x56543a086dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:00:59.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/74211612 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a07dac0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 -- 172.21.15.35:0/74211612 >> 172.21.15.35:0/74211612 conn(0x565439ee06b0 msgr2=0x56543a0866b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 -- 172.21.15.35:0/74211612 shutdown_connections 2023-03-17T10:01:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 -- 172.21.15.35:0/74211612 wait complete. 2023-03-17T10:01:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 -- start start 2023-03-17T10:01:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.449+0000 7fa5fb664b80 1 Processor -- start 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a083960 0x56543a091ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a092410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a0894f0 0x56543a092970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a0f01c0 con 0x56543a088be0 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a0f0330 con 0x56543a083960 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56543a0f04f0 con 0x56543a0894f0 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5fb664b80 10 client.0 _ll_register_callbacks cb 0x565439e7b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a092410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a092410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48186/0 (socket says 172.21.15.35:48186) 2023-03-17T10:01:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 -- 172.21.15.35:0/371522419 learned_addr learned my addr 172.21.15.35:0/371522419 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eda74700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a0894f0 0x56543a092970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5ed273700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a083960 0x56543a091ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 -- 172.21.15.35:0/371522419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a0894f0 msgr2=0x56543a092970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a0894f0 0x56543a092970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 -- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a083960 msgr2=0x56543a091ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a083960 0x56543a091ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 -- 172.21.15.35:0/371522419 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565439e03d80 con 0x56543a088be0 2023-03-17T10:01:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5eca72700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a092410 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80098e0 tx=0x7fa5d800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c146bb7d10667fe0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:01:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.450+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/371522419 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8017440 con 0x56543a088be0 2023-03-17T10:01:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56543a0531e0 con 0x56543a088be0 2023-03-17T10:01:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/371522419 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa5d8000e40 con 0x56543a088be0 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/371522419 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5d80058e0 con 0x56543a088be0 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 10 client.17880 fetch_fsmap learned FSMap version 37 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x565439e2a1f0 con 0x56543a088be0 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/371522419 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56543a0531e0 con 0x56543a088be0 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/371522419 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa5d8017630 con 0x56543a088be0 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 10 client.17880 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:01:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 10 client.17880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:01:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 20 client.17880 populate_metadata read hostname 'smithi035' 2023-03-17T10:01:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a0f17f0 0x56543a0f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 4 client.17880 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:01:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565439e59f00 con 0x56543a0f17f0 2023-03-17T10:01:05.053 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:32 smithi035 ceph-mon[92535]: pgmap v2152: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:01:05.053 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:34 smithi035 ceph-mon[92535]: pgmap v2153: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:36 smithi035 ceph-mon[92535]: pgmap v2154: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:38 smithi035 ceph-mon[92535]: pgmap v2155: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:40 smithi035 ceph-mon[92535]: pgmap v2156: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:42 smithi035 ceph-mon[92535]: pgmap v2157: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:44 smithi035 ceph-mon[92535]: pgmap v2158: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:46 smithi035 ceph-mon[92535]: pgmap v2159: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:48 smithi035 ceph-mon[92535]: pgmap v2160: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:01:05.054 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:50 smithi035 ceph-mon[92535]: pgmap v2161: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:01:05.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:52 smithi035 ceph-mon[92535]: pgmap v2162: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:01:05.879 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:54 smithi035 ceph-mon[92535]: pgmap v2163: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:01:05.879 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:56 smithi035 ceph-mon[92535]: pgmap v2164: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:01:06.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:58 smithi035 ceph-mon[92535]: pgmap v2165: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:01:06.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:01:06.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:01:06.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:01:06.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:59 smithi035 ceph-mon[92535]: pgmap v2166: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T10:01:06.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:59 smithi035 ceph-mon[92535]: pgmap v2167: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:01:06.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:52:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:01:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.451+0000 7fa5ed273700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a0f17f0 0x56543a0f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.452+0000 7fa5d0ff9700 10 client.17880 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.452+0000 7fa5ed273700 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a0f17f0 0x56543a0f3c00 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70872cbfb330007 server_cookie=ff4414f1a069fda in_seq=0 out_seq=0 2023-03-17T10:01:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5d0ff9700 1 -- 172.21.15.35:0/371522419 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565439e59f00 con 0x56543a0f17f0 2023-03-17T10:01:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5d0ff9700 10 client.17880 handle_command_reply: tid=0 2023-03-17T10:01:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 client.17880 shutdown 2023-03-17T10:01:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 msgr2=0x56543a092410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a092410 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80098e0 tx=0x7fa5d800f690 comp rx=0 tx=0).stop 2023-03-17T10:01:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 shutdown_connections 2023-03-17T10:01:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56543a0f17f0 0x56543a0f3c00 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56543a0894f0 0x56543a092970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5d0ff9700 0 client.17880 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56543a083960 0x56543a091ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 --2- 172.21.15.35:0/371522419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56543a088be0 0x56543a092410 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 >> 172.21.15.35:0/371522419 conn(0x565439ee06b0 msgr2=0x56543a0878c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.456+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 shutdown_connections 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5fb664b80 1 -- 172.21.15.35:0/371522419 wait complete. 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5fb664b80 20 client.17880 trim_cache size 0 max 16384 2023-03-17T10:01:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5d409f640 msgr2=0x7fa5d40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5d409f640 0x7fa5d40a1af0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009c60 tx=0x7fa5e4009260 comp rx=0 tx=0).stop 2023-03-17T10:01:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 msgr2=0x7fa5e81a2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:10.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 0x7fa5e81a2120 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0007ee0 tx=0x7fa5e000d3b0 comp rx=0 tx=0).stop 2023-03-17T10:01:10.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 shutdown_connections 2023-03-17T10:01:10.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5d409f640 0x7fa5d40a1af0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5e8104390 0x7fa5e81a2120 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5e80ff350 0x7fa5e81970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 --2- 172.21.15.35:0/3460658438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5e80ffcf0 0x7fa5e81975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 >> 172.21.15.35:0/3460658438 conn(0x7fa5e8076330 msgr2=0x7fa5e80fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 shutdown_connections 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:32.457+0000 7fa5ef4d7700 1 -- 172.21.15.35:0/3460658438 wait complete. 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 -- 172.21.15.35:0/1438258886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 msgr2=0x7f42d80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/1438258886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d80ff720 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0099c0 tx=0x7f42cc009cd0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 -- 172.21.15.35:0/1438258886 shutdown_connections 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/1438258886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d8104390 0x7f42d810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/1438258886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d80ff720 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/1438258886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d80ffcf0 0x7f42d8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 -- 172.21.15.35:0/1438258886 >> 172.21.15.35:0/1438258886 conn(0x7f42d8076330 msgr2=0x7f42d8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 -- 172.21.15.35:0/1438258886 shutdown_connections 2023-03-17T10:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.579+0000 7f42dc9e8700 1 -- 172.21.15.35:0/1438258886 wait complete. 2023-03-17T10:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 Processor -- start 2023-03-17T10:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 -- start start 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d810c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d80ffcf0 0x7f42d810cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d8104390 0x7f42d81a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d810d5e0 con 0x7f42d80ff350 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81a48f0 con 0x7f42d80ffcf0 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.580+0000 7f42dc9e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81a4a30 con 0x7f42d8104390 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d810c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d810c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48198/0 (socket says 172.21.15.35:48198) 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d80ffcf0 0x7f42d810cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 -- 172.21.15.35:0/906812838 learned_addr learned my addr 172.21.15.35:0/906812838 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d8104390 0x7f42d81a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 -- 172.21.15.35:0/906812838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d8104390 msgr2=0x7f42d81a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d8104390 0x7f42d81a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 -- 172.21.15.35:0/906812838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d80ffcf0 msgr2=0x7f42d810cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d80ffcf0 0x7f42d810cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 -- 172.21.15.35:0/906812838 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0095f0 con 0x7f42d80ff350 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42d659c700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d810c870 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009f50 tx=0x7f42cc0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42c77fe700 1 -- 172.21.15.35:0/906812838 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc01d070 con 0x7f42d80ff350 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42c77fe700 1 -- 172.21.15.35:0/906812838 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42cc0040b0 con 0x7f42d80ff350 2023-03-17T10:01:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d8110170 con 0x7f42d80ff350 2023-03-17T10:01:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42c77fe700 1 -- 172.21.15.35:0/906812838 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc022db0 con 0x7f42d80ff350 2023-03-17T10:01:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.581+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d810ffe0 con 0x7f42d80ff350 2023-03-17T10:01:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.583+0000 7f42c77fe700 1 -- 172.21.15.35:0/906812838 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f42cc022470 con 0x7f42d80ff350 2023-03-17T10:01:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.584+0000 7f42c77fe700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f42c009f6c0 0x7f42c00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.584+0000 7f42c77fe700 1 -- 172.21.15.35:0/906812838 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f42cc0cb9b0 con 0x7f42d80ff350 2023-03-17T10:01:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.584+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f42c009f6c0 0x7f42c00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.585+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f42c009f6c0 0x7f42c00a1b70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42d810e060 tx=0x7f42c800a380 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.585+0000 7f42e8b75b80 1 Processor -- start 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.585+0000 7f42e8b75b80 1 -- start start 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.585+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda610fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda60b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda60bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda512010 con 0x55ddda610be0 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda564950 con 0x55ddda60b960 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda55dde0 con 0x55ddda6114f0 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda610fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda610fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48206/0 (socket says 172.21.15.35:48206) 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 -- 172.21.15.35:0/4286245390 learned_addr learned my addr 172.21.15.35:0/4286245390 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda60bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda60b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 -- 172.21.15.35:0/4286245390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 msgr2=0x55ddda60b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda60b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 -- 172.21.15.35:0/4286245390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 msgr2=0x55ddda60bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda60bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 -- 172.21.15.35:0/4286245390 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddda3df5d0 con 0x55ddda610be0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda60bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42d659c700 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda610fb0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0959f0 tx=0x7f42cc099030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c30d6228754bc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42c4ff9700 1 -- 172.21.15.35:0/4286245390 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a1650 con 0x55ddda610be0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42c4ff9700 1 -- 172.21.15.35:0/4286245390 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42cc097890 con 0x55ddda610be0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.586+0000 7f42c4ff9700 1 -- 172.21.15.35:0/4286245390 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc098c40 con 0x55ddda610be0 2023-03-17T10:01:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4286245390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 msgr2=0x55ddda610fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:13.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda610fb0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0959f0 tx=0x7f42cc099030 comp rx=0 tx=0).stop 2023-03-17T10:01:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4286245390 shutdown_connections 2023-03-17T10:01:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda60bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda610fb0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4286245390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda60b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4286245390 >> 172.21.15.35:0/4286245390 conn(0x55ddda4686b0 msgr2=0x55ddda605a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4286245390 shutdown_connections 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.587+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4286245390 wait complete. 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 -- start start 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 Processor -- start 2023-03-17T10:01:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda6174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda614750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda614e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda3e18c0 con 0x55ddda610be0 2023-03-17T10:01:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda6155d0 con 0x55ddda60b960 2023-03-17T10:01:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda620c60 con 0x55ddda6114f0 2023-03-17T10:01:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42e8b75b80 10 client.0 _ll_register_callbacks cb 0x55ddda403230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:01:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda614750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda614750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48214/0 (socket says 172.21.15.35:48214) 2023-03-17T10:01:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 -- 172.21.15.35:0/2876449864 learned_addr learned my addr 172.21.15.35:0/2876449864 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda614e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d659c700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda6174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 -- 172.21.15.35:0/2876449864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 msgr2=0x55ddda614e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda614e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 -- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 msgr2=0x55ddda6174d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda6174d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 -- 172.21.15.35:0/2876449864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d810ffe0 con 0x55ddda610be0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda614750 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f42c80045e0 tx=0x7f42c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ea5185e5a01dd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.588+0000 7f42bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42bdffb700 1 -- 172.21.15.35:0/2876449864 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8003ea0 con 0x55ddda610be0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddda520390 con 0x55ddda610be0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42bdffb700 1 -- 172.21.15.35:0/2876449864 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f42c8010840 con 0x55ddda610be0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42bdffb700 1 -- 172.21.15.35:0/2876449864 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42c8010a00 con 0x55ddda610be0 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 10 client.17892 fetch_fsmap learned FSMap version 37 2023-03-17T10:01:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ddda38bd80 con 0x55ddda610be0 2023-03-17T10:01:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42bdffb700 1 -- 172.21.15.35:0/2876449864 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ddda520390 con 0x55ddda610be0 2023-03-17T10:01:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42bdffb700 1 -- 172.21.15.35:0/2876449864 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f42c8027c60 con 0x55ddda610be0 2023-03-17T10:01:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 10 client.17892 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:01:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 10 client.17892 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:01:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 20 client.17892 populate_metadata read hostname 'smithi035' 2023-03-17T10:01:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda624d20 0x55ddda627130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 4 client.17892 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.589+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddda52c600 con 0x55ddda624d20 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.590+0000 7f42d659c700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda624d20 0x55ddda627130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.590+0000 7f42bdffb700 10 client.17892 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.590+0000 7f42d659c700 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda624d20 0x55ddda627130 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3417baa0b35d0e46 server_cookie=edcf5c185a14eea7 in_seq=0 out_seq=0 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42bdffb700 1 -- 172.21.15.35:0/2876449864 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ddda52c600 con 0x55ddda624d20 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42bdffb700 10 client.17892 handle_command_reply: tid=0 2023-03-17T10:01:18.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 client.17892 shutdown 2023-03-17T10:01:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 msgr2=0x55ddda614750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda614750 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f42c80045e0 tx=0x7f42c80047c0 comp rx=0 tx=0).stop 2023-03-17T10:01:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 shutdown_connections 2023-03-17T10:01:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda624d20 0x55ddda627130 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda6114f0 0x55ddda614e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda60b960 0x55ddda6174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/2876449864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda610be0 0x55ddda614750 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42bdffb700 0 client.17892 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 >> 172.21.15.35:0/2876449864 conn(0x55ddda4686b0 msgr2=0x55ddda60a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 shutdown_connections 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 1 -- 172.21.15.35:0/2876449864 wait complete. 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.591+0000 7f42e8b75b80 20 client.17892 trim_cache size 0 max 16384 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 Processor -- start 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 -- start start 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda60b960 0x55ddda605ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda610be0 0x55ddda61bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 0x55ddda617000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda602600 con 0x55ddda6114f0 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda602b90 con 0x55ddda610be0 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda60b400 con 0x55ddda60b960 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42d6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 0x55ddda617000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42d6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 0x55ddda617000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48224/0 (socket says 172.21.15.35:48224) 2023-03-17T10:01:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42d6d9d700 1 -- 172.21.15.35:0/4147863978 learned_addr learned my addr 172.21.15.35:0/4147863978 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:21.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:01 smithi035 ceph-mon[92535]: pgmap v2168: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T10:01:22.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d6d9d700 1 -- 172.21.15.35:0/4147863978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda60b960 msgr2=0x55ddda605ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:22.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda610be0 0x55ddda61bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:22.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.606+0000 7f42d659c700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda60b960 0x55ddda605ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda60b960 0x55ddda605ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d6d9d700 1 -- 172.21.15.35:0/4147863978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda610be0 msgr2=0x55ddda61bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda610be0 0x55ddda61bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d6d9d700 1 -- 172.21.15.35:0/4147863978 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddda524130 con 0x55ddda6114f0 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda610be0 0x55ddda61bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d659c700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda60b960 0x55ddda605ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 0x55ddda617000 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f42d00084c0 tx=0x7f42d00087d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef799b6873d3072 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42c57fa700 1 -- 172.21.15.35:0/4147863978 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0016600 con 0x55ddda6114f0 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42c57fa700 1 -- 172.21.15.35:0/4147863978 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42d0010070 con 0x55ddda6114f0 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42c57fa700 1 -- 172.21.15.35:0/4147863978 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0015950 con 0x55ddda6114f0 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4147863978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 msgr2=0x55ddda617000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 0x55ddda617000 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f42d00084c0 tx=0x7f42d00087d0 comp rx=0 tx=0).stop 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4147863978 shutdown_connections 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda6114f0 0x55ddda617000 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda60b960 0x55ddda605ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/4147863978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda610be0 0x55ddda61bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.607+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4147863978 >> 172.21.15.35:0/4147863978 conn(0x55ddda4686b0 msgr2=0x55ddda6202b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4147863978 shutdown_connections 2023-03-17T10:01:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 -- 172.21.15.35:0/4147863978 wait complete. 2023-03-17T10:01:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 -- start start 2023-03-17T10:01:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 Processor -- start 2023-03-17T10:01:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 0x55ddda61bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda610be0 0x55ddda619f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda6114f0 0x55ddda61a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda61ab40 con 0x55ddda60b960 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda61acb0 con 0x55ddda6114f0 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddda678bd0 con 0x55ddda610be0 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42e8b75b80 10 client.0 _ll_register_callbacks cb 0x55ddda403230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42d659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 0x55ddda61bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42d659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 0x55ddda61bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48226/0 (socket says 172.21.15.35:48226) 2023-03-17T10:01:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42d659c700 1 -- 172.21.15.35:0/967652585 learned_addr learned my addr 172.21.15.35:0/967652585 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.608+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda6114f0 0x55ddda61a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d659c700 1 -- 172.21.15.35:0/967652585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda610be0 msgr2=0x55ddda619f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d659c700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda610be0 0x55ddda619f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d659c700 1 -- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda6114f0 msgr2=0x55ddda61a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d659c700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda6114f0 0x55ddda61a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d659c700 1 -- 172.21.15.35:0/967652585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d0007d00 con 0x55ddda60b960 2023-03-17T10:01:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d6d9d700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda6114f0 0x55ddda61a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:01:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42d659c700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 0x55ddda61bb30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0959f0 tx=0x7f42cc003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabbd8977a272d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42bdffb700 1 -- 172.21.15.35:0/967652585 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0c7070 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42bdffb700 1 -- 172.21.15.35:0/967652585 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f42cc09d170 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddda5db1e0 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42bdffb700 1 -- 172.21.15.35:0/967652585 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42cc0989e0 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 10 client.17898 fetch_fsmap learned FSMap version 37 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ddda3b21f0 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42bdffb700 1 -- 172.21.15.35:0/967652585 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42cc07c080 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42bdffb700 1 -- 172.21.15.35:0/967652585 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f42cc0a11c0 con 0x55ddda60b960 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 10 client.17898 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 10 client.17898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 20 client.17898 populate_metadata read hostname 'smithi035' 2023-03-17T10:01:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda679c80 0x55ddda67c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 4 client.17898 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:01:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.609+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ddda3e1f00 con 0x55ddda679c80 2023-03-17T10:01:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.610+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda679c80 0x55ddda67c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.610+0000 7f42d5d9b700 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda679c80 0x55ddda67c090 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf8ba40e735dba1 server_cookie=b3cc0217de0da88e in_seq=0 out_seq=0 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.610+0000 7f42bdffb700 10 client.17898 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.614+0000 7f42bdffb700 1 -- 172.21.15.35:0/967652585 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ddda3e1f00 con 0x55ddda679c80 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.614+0000 7f42bdffb700 10 client.17898 handle_command_reply: tid=0 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 client.17898 shutdown 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 msgr2=0x55ddda61bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 0x55ddda61bb30 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0959f0 tx=0x7f42cc003680 comp rx=0 tx=0).stop 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 shutdown_connections 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ddda679c80 0x55ddda67c090 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ddda6114f0 0x55ddda61a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42bdffb700 0 client.17898 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ddda60b960 0x55ddda61bb30 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 --2- 172.21.15.35:0/967652585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ddda610be0 0x55ddda619f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 >> 172.21.15.35:0/967652585 conn(0x55ddda4686b0 msgr2=0x55ddda60e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 shutdown_connections 2023-03-17T10:01:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 1 -- 172.21.15.35:0/967652585 wait complete. 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42e8b75b80 20 client.17898 trim_cache size 0 max 16384 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f42c009f6c0 msgr2=0x7f42c00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f42c009f6c0 0x7f42c00a1b70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42d810e060 tx=0x7f42c800a380 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 msgr2=0x7f42d810c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.615+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d810c870 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009f50 tx=0x7f42cc0057b0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 shutdown_connections 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f42c009f6c0 0x7f42c00a1b70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42d8104390 0x7f42d81a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f42d80ff350 0x7f42d810c870 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 --2- 172.21.15.35:0/906812838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d80ffcf0 0x7f42d810cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 >> 172.21.15.35:0/906812838 conn(0x7f42d8076330 msgr2=0x7f42d8102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 shutdown_connections 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:45.616+0000 7f42dc9e8700 1 -- 172.21.15.35:0/906812838 wait complete. 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 -- 172.21.15.35:0/1742992694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f00ffcf0 msgr2=0x7f90f0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/1742992694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f00ffcf0 0x7f90f0103cb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0099c0 tx=0x7f90dc009cd0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 -- 172.21.15.35:0/1742992694 shutdown_connections 2023-03-17T10:01:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/1742992694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f0104390 0x7f90f010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/1742992694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90f00ff350 0x7f90f00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/1742992694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f00ffcf0 0x7f90f0103cb0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 -- 172.21.15.35:0/1742992694 >> 172.21.15.35:0/1742992694 conn(0x7f90f0076330 msgr2=0x7f90f0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 -- 172.21.15.35:0/1742992694 shutdown_connections 2023-03-17T10:01:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.737+0000 7f90f6ff4700 1 -- 172.21.15.35:0/1742992694 wait complete. 2023-03-17T10:01:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 Processor -- start 2023-03-17T10:01:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 -- start start 2023-03-17T10:01:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90f00ff350 0x7f90f0196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00ffcf0 0x7f90f01967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 0x7f90f019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f019b240 con 0x7f90f0104390 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f019b3b0 con 0x7f90f00ffcf0 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f6ff4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f019b570 con 0x7f90f00ff350 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f5591700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 0x7f90f019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f5591700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 0x7f90f019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48244/0 (socket says 172.21.15.35:48244) 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f5591700 1 -- 172.21.15.35:0/4008585307 learned_addr learned my addr 172.21.15.35:0/4008585307 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90effff700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00ffcf0 0x7f90f01967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.738+0000 7f90f4d90700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90f00ff350 0x7f90f0196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f5591700 1 -- 172.21.15.35:0/4008585307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90f00ff350 msgr2=0x7f90f0196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f5591700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90f00ff350 0x7f90f0196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f5591700 1 -- 172.21.15.35:0/4008585307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00ffcf0 msgr2=0x7f90f01967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f5591700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00ffcf0 0x7f90f01967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f5591700 1 -- 172.21.15.35:0/4008585307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc0095f0 con 0x7f90f0104390 2023-03-17T10:01:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f5591700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 0x7f90f019ac00 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f90e8007ee0 tx=0x7f90e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:30.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90edffb700 1 -- 172.21.15.35:0/4008585307 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8017070 con 0x7f90f0104390 2023-03-17T10:01:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90edffb700 1 -- 172.21.15.35:0/4008585307 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90e800f040 con 0x7f90f0104390 2023-03-17T10:01:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f010efc0 con 0x7f90f0104390 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90edffb700 1 -- 172.21.15.35:0/4008585307 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8005570 con 0x7f90f0104390 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.739+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f010ee30 con 0x7f90f0104390 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.742+0000 7f90edffb700 1 -- 172.21.15.35:0/4008585307 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f90e800db20 con 0x7f90f0104390 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.742+0000 7f90edffb700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f90e009f640 0x7f90e00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.742+0000 7f90edffb700 1 -- 172.21.15.35:0/4008585307 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f90e80c9d20 con 0x7f90f0104390 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.742+0000 7f90f4d90700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f90e009f640 0x7f90e00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.743+0000 7f90f4d90700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f90e009f640 0x7f90e00a1af0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90e4005950 tx=0x7f90e400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.743+0000 7f9103181b80 1 Processor -- start 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.743+0000 7f9103181b80 1 -- start start 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f9103181b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e544df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f9103181b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e545330 0x55c85e548c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f9103181b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 0x55c85e5495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f9103181b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e447010 con 0x55c85e549170 2023-03-17T10:01:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f9103181b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e499950 con 0x55c85e545330 2023-03-17T10:01:34.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f9103181b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e492de0 con 0x55c85e544a20 2023-03-17T10:01:34.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 0x55c85e5495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 0x55c85e5495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48252/0 (socket says 172.21.15.35:48252) 2023-03-17T10:01:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 -- 172.21.15.35:0/3384157953 learned_addr learned my addr 172.21.15.35:0/3384157953 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e544df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90effff700 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e545330 0x55c85e548c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 -- 172.21.15.35:0/3384157953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 msgr2=0x55c85e544df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e544df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 -- 172.21.15.35:0/3384157953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e545330 msgr2=0x55c85e548c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e545330 0x55c85e548c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 -- 172.21.15.35:0/3384157953 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85e3145d0 con 0x55c85e549170 2023-03-17T10:01:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90f5591700 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 0x55c85e5495c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f90e809f490 tx=0x7f90e8097670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47725df52d24d7b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90daffd700 1 -- 172.21.15.35:0/3384157953 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800ddd0 con 0x55c85e549170 2023-03-17T10:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90daffd700 1 -- 172.21.15.35:0/3384157953 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90e80977d0 con 0x55c85e549170 2023-03-17T10:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.744+0000 7f90daffd700 1 -- 172.21.15.35:0/3384157953 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8097c70 con 0x55c85e549170 2023-03-17T10:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 -- 172.21.15.35:0/3384157953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 msgr2=0x55c85e5495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 0x55c85e5495c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f90e809f490 tx=0x7f90e8097670 comp rx=0 tx=0).stop 2023-03-17T10:01:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 -- 172.21.15.35:0/3384157953 shutdown_connections 2023-03-17T10:01:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e549170 0x55c85e5495c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e544df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 --2- 172.21.15.35:0/3384157953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e545330 0x55c85e548c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 -- 172.21.15.35:0/3384157953 >> 172.21.15.35:0/3384157953 conn(0x55c85e39d6b0 msgr2=0x55c85e53aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 -- 172.21.15.35:0/3384157953 shutdown_connections 2023-03-17T10:01:40.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.745+0000 7f9103181b80 1 -- 172.21.15.35:0/3384157953 wait complete. 2023-03-17T10:01:40.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 -- start start 2023-03-17T10:01:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 Processor -- start 2023-03-17T10:01:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e54dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e54e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e54e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e3168c0 con 0x55c85e545330 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e55a380 con 0x55c85e549170 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e55a4c0 con 0x55c85e544a20 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f9103181b80 10 client.0 _ll_register_callbacks cb 0x55c85e338230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f90effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e54e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f90effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e54e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48256/0 (socket says 172.21.15.35:48256) 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f90effff700 1 -- 172.21.15.35:0/3424641669 learned_addr learned my addr 172.21.15.35:0/3424641669 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e54dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.746+0000 7f90f5591700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e54e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90effff700 1 -- 172.21.15.35:0/3424641669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 msgr2=0x55c85e54dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90effff700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e54dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90effff700 1 -- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 msgr2=0x55c85e54e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90effff700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e54e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90effff700 1 -- 172.21.15.35:0/3424641669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f010ee30 con 0x55c85e545330 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90effff700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e54e1b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f90dc000c00 tx=0x7f90dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f2f092dd5634b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90cffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:01:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90cffff700 1 -- 172.21.15.35:0/3424641669 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00bba0 con 0x55c85e545330 2023-03-17T10:01:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90cffff700 1 -- 172.21.15.35:0/3424641669 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f90dc00bd00 con 0x55c85e545330 2023-03-17T10:01:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c85e455390 con 0x55c85e545330 2023-03-17T10:01:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90cffff700 1 -- 172.21.15.35:0/3424641669 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90dc0058e0 con 0x55c85e545330 2023-03-17T10:01:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f9103181b80 10 client.17910 fetch_fsmap learned FSMap version 37 2023-03-17T10:01:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55c85e2c0d80 con 0x55c85e545330 2023-03-17T10:01:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.747+0000 7f90cffff700 1 -- 172.21.15.35:0/3424641669 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c85e455390 con 0x55c85e545330 2023-03-17T10:01:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f90cffff700 1 -- 172.21.15.35:0/3424641669 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f90dc003820 con 0x55c85e545330 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f9103181b80 10 client.17910 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f9103181b80 10 client.17910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f9103181b80 20 client.17910 populate_metadata read hostname 'smithi035' 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f9103181b80 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e55e600 0x55c85e560a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f9103181b80 4 client.17910 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c85e461600 con 0x55c85e55e600 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e55e600 0x55c85e560a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e55e600 0x55c85e560a10 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cb8ecce6ea48b7e server_cookie=43379bc5e2ca6322 in_seq=0 out_seq=0 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.748+0000 7f90cffff700 10 client.17910 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f90cffff700 1 -- 172.21.15.35:0/3424641669 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c85e461600 con 0x55c85e55e600 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f90cffff700 10 client.17910 handle_command_reply: tid=0 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 client.17910 shutdown 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 msgr2=0x55c85e54e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e54e1b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f90dc000c00 tx=0x7f90dc005800 comp rx=0 tx=0).stop 2023-03-17T10:01:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 shutdown_connections 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e55e600 0x55c85e560a10 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e54e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e544a20 0x55c85e54dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 --2- 172.21.15.35:0/3424641669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e54e1b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f90cffff700 0 client.17910 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 >> 172.21.15.35:0/3424641669 conn(0x55c85e39d6b0 msgr2=0x55c85e53f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 shutdown_connections 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 1 -- 172.21.15.35:0/3424641669 wait complete. 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.749+0000 7f9103181b80 20 client.17910 trim_cache size 0 max 16384 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.764+0000 7f9103181b80 1 Processor -- start 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.764+0000 7f9103181b80 1 -- start start 2023-03-17T10:01:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f9103181b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e544a20 0x55c85e546a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f9103181b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e53aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f9103181b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e549170 0x55c85e54e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f9103181b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e55bc70 con 0x55c85e545330 2023-03-17T10:01:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f9103181b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e5402a0 con 0x55c85e544a20 2023-03-17T10:01:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f9103181b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e53b000 con 0x55c85e549170 2023-03-17T10:01:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e53aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e53aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48264/0 (socket says 172.21.15.35:48264) 2023-03-17T10:01:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 -- 172.21.15.35:0/897742834 learned_addr learned my addr 172.21.15.35:0/897742834 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90f4d90700 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e544a20 0x55c85e546a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90f5591700 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e549170 0x55c85e54e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 -- 172.21.15.35:0/897742834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e549170 msgr2=0x55c85e54e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e549170 0x55c85e54e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:47.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 -- 172.21.15.35:0/897742834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e544a20 msgr2=0x55c85e546a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:47.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e544a20 0x55c85e546a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 -- 172.21.15.35:0/897742834 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85e459130 con 0x55c85e545330 2023-03-17T10:01:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90effff700 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e53aac0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f90dc003c80 tx=0x7f90dc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceb8c1764c6e49c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:48.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90db7fe700 1 -- 172.21.15.35:0/897742834 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00b630 con 0x55c85e545330 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90db7fe700 1 -- 172.21.15.35:0/897742834 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90dc01e050 con 0x55c85e545330 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.765+0000 7f90db7fe700 1 -- 172.21.15.35:0/897742834 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004500 con 0x55c85e545330 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 -- 172.21.15.35:0/897742834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 msgr2=0x55c85e53aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e53aac0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f90dc003c80 tx=0x7f90dc009cd0 comp rx=0 tx=0).stop 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 -- 172.21.15.35:0/897742834 shutdown_connections 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e549170 0x55c85e54e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e544a20 0x55c85e546a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 --2- 172.21.15.35:0/897742834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e545330 0x55c85e53aac0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 -- 172.21.15.35:0/897742834 >> 172.21.15.35:0/897742834 conn(0x55c85e39d6b0 msgr2=0x55c85e547390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 -- 172.21.15.35:0/897742834 shutdown_connections 2023-03-17T10:01:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 -- 172.21.15.35:0/897742834 wait complete. 2023-03-17T10:01:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.766+0000 7f9103181b80 1 -- start start 2023-03-17T10:01:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 Processor -- start 2023-03-17T10:01:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 0x55c85e5534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e545330 0x55c85e5539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e5ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e5aba20 con 0x55c85e544a20 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e5abb90 con 0x55c85e549170 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85e5abd50 con 0x55c85e545330 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f9103181b80 10 client.0 _ll_register_callbacks cb 0x55c85e338230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 0x55c85e5534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 0x55c85e5534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48268/0 (socket says 172.21.15.35:48268) 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 -- 172.21.15.35:0/3815646830 learned_addr learned my addr 172.21.15.35:0/3815646830 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90effff700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e545330 0x55c85e5539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f5591700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e5ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 -- 172.21.15.35:0/3815646830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e545330 msgr2=0x55c85e5539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e545330 0x55c85e5539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 -- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 msgr2=0x55c85e5ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e5ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f4d90700 1 -- 172.21.15.35:0/3815646830 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c85e2c0d80 con 0x55c85e544a20 2023-03-17T10:01:50.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.767+0000 7f90f5591700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e5ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90f4d90700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 0x55c85e5534a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f90e4005d90 tx=0x7f90e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0d08893b24efda server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90cffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90cffff700 1 -- 172.21.15.35:0/3815646830 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4024040 con 0x55c85e544a20 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90cffff700 1 -- 172.21.15.35:0/3815646830 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(184..184 src has 1..184) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f90e4017070 con 0x55c85e544a20 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c85e5101e0 con 0x55c85e544a20 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90cffff700 1 -- 172.21.15.35:0/3815646830 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90e4029e90 con 0x55c85e544a20 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 10 client.17916 fetch_fsmap learned FSMap version 37 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55c85e2e71f0 con 0x55c85e544a20 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90cffff700 1 -- 172.21.15.35:0/3815646830 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c85e5101e0 con 0x55c85e544a20 2023-03-17T10:01:54.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f90cffff700 1 -- 172.21.15.35:0/3815646830 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f90e4005540 con 0x55c85e544a20 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 10 client.17916 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 10 client.17916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 20 client.17916 populate_metadata read hostname 'smithi035' 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e63b470 0x55c85e63d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 4 client.17916 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.768+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c85e316f00 con 0x55c85e63b470 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.769+0000 7f90effff700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e63b470 0x55c85e63d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.769+0000 7f90cffff700 10 client.17916 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.769+0000 7f90effff700 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e63b470 0x55c85e63d8c0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aebbd995a2a72623 server_cookie=b533bf315bce5fde in_seq=0 out_seq=0 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.773+0000 7f90cffff700 1 -- 172.21.15.35:0/3815646830 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c85e316f00 con 0x55c85e63b470 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.773+0000 7f90cffff700 10 client.17916 handle_command_reply: tid=0 2023-03-17T10:01:54.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.773+0000 7f9103181b80 1 client.17916 shutdown 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.773+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 msgr2=0x55c85e5534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.773+0000 7f9103181b80 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 0x55c85e5534a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f90e4005d90 tx=0x7f90e40047c0 comp rx=0 tx=0).stop 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 shutdown_connections 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c85e63b470 0x55c85e63d8c0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c85e549170 0x55c85e5ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c85e544a20 0x55c85e5534a0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90cffff700 0 client.17916 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:01:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 --2- 172.21.15.35:0/3815646830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c85e545330 0x55c85e5539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 >> 172.21.15.35:0/3815646830 conn(0x55c85e39d6b0 msgr2=0x55c85e548280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 shutdown_connections 2023-03-17T10:01:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 1 -- 172.21.15.35:0/3815646830 wait complete. 2023-03-17T10:01:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f9103181b80 20 client.17916 trim_cache size 0 max 16384 2023-03-17T10:01:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f90e009f640 msgr2=0x7f90e00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f90e009f640 0x7f90e00a1af0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90e4005950 tx=0x7f90e400b410 comp rx=0 tx=0).stop 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 msgr2=0x7f90f019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 0x7f90f019ac00 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f90e8007ee0 tx=0x7f90e800d3b0 comp rx=0 tx=0).stop 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 shutdown_connections 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f90e009f640 0x7f90e00a1af0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f90f0104390 0x7f90f019ac00 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90f00ff350 0x7f90f0196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 --2- 172.21.15.35:0/4008585307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00ffcf0 0x7f90f01967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 >> 172.21.15.35:0/4008585307 conn(0x7f90f0076330 msgr2=0x7f90f00680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.774+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 shutdown_connections 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:39:58.775+0000 7f90f6ff4700 1 -- 172.21.15.35:0/4008585307 wait complete. 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 -- 172.21.15.35:0/3517652270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ff3b0 msgr2=0x7fd3600ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 --2- 172.21.15.35:0/3517652270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ff3b0 0x7fd3600ff780 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fd3480099c0 tx=0x7fd348009cd0 comp rx=0 tx=0).stop 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 -- 172.21.15.35:0/3517652270 shutdown_connections 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 --2- 172.21.15.35:0/3517652270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 0x7fd36010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 --2- 172.21.15.35:0/3517652270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ff3b0 0x7fd3600ff780 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 --2- 172.21.15.35:0/3517652270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3600ffd50 0x7fd360103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 -- 172.21.15.35:0/3517652270 >> 172.21.15.35:0/3517652270 conn(0x7fd360075f60 msgr2=0x7fd360076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 -- 172.21.15.35:0/3517652270 shutdown_connections 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.311+0000 7fd3662ac700 1 -- 172.21.15.35:0/3517652270 wait complete. 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 Processor -- start 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 -- start start 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3600ff3b0 0x7fd360196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 0x7fd3601967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 0x7fd36019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36019b260 con 0x7fd3600ffd50 2023-03-17T10:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36019b3d0 con 0x7fd3600ff3b0 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd3662ac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36019b590 con 0x7fd3601043f0 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd35f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 0x7fd3601967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd35f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 0x7fd3601967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48326/0 (socket says 172.21.15.35:48326) 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd35f7fe700 1 -- 172.21.15.35:0/1618676235 learned_addr learned my addr 172.21.15.35:0/1618676235 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.312+0000 7fd35ffff700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3600ff3b0 0x7fd360196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd364849700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 0x7fd36019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35f7fe700 1 -- 172.21.15.35:0/1618676235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 msgr2=0x7fd36019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 0x7fd36019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35f7fe700 1 -- 172.21.15.35:0/1618676235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3600ff3b0 msgr2=0x7fd360196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3600ff3b0 0x7fd360196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35f7fe700 1 -- 172.21.15.35:0/1618676235 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480095f0 con 0x7fd3600ffd50 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd364849700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 0x7fd36019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:01:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 0x7fd3601967c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd35000e940 tx=0x7fd35000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:01:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35d7fa700 1 -- 172.21.15.35:0/1618676235 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350009730 con 0x7fd3600ffd50 2023-03-17T10:01:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36010f060 con 0x7fd3600ffd50 2023-03-17T10:02:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd35d7fa700 1 -- 172.21.15.35:0/1618676235 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd35000ee90 con 0x7fd3600ffd50 2023-03-17T10:02:01.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.313+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36010eed0 con 0x7fd3600ffd50 2023-03-17T10:02:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.314+0000 7fd35d7fa700 1 -- 172.21.15.35:0/1618676235 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350018420 con 0x7fd3600ffd50 2023-03-17T10:02:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.315+0000 7fd35d7fa700 1 -- 172.21.15.35:0/1618676235 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd35000cbd0 con 0x7fd3600ffd50 2023-03-17T10:02:01.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.316+0000 7fd35d7fa700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd34c09f640 0x7fd34c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.316+0000 7fd35d7fa700 1 -- 172.21.15.35:0/1618676235 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd350014070 con 0x7fd3600ffd50 2023-03-17T10:02:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.316+0000 7fd35ffff700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd34c09f640 0x7fd34c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd35ffff700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd34c09f640 0x7fd34c0a1af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd34800b580 tx=0x7fd348005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 Processor -- start 2023-03-17T10:02:04.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 -- start start 2023-03-17T10:02:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc65c040 0x5582fc65c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc656830 0x5582fc656ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc662dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc559010 con 0x5582fc6571e0 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc5ab950 con 0x5582fc65c040 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd372439b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc5a4de0 con 0x5582fc656830 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.317+0000 7fd364849700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc662dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc662dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48336/0 (socket says 172.21.15.35:48336) 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 -- 172.21.15.35:0/2742315522 learned_addr learned my addr 172.21.15.35:0/2742315522 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd35ffff700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc65c040 0x5582fc65c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc656830 0x5582fc656ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 -- 172.21.15.35:0/2742315522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc656830 msgr2=0x5582fc656ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc656830 0x5582fc656ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 -- 172.21.15.35:0/2742315522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc65c040 msgr2=0x5582fc65c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc65c040 0x5582fc65c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 -- 172.21.15.35:0/2742315522 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582fc4265d0 con 0x5582fc6571e0 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc656830 0x5582fc656ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd35ffff700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc65c040 0x5582fc65c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd364849700 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc662dd0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd358009400 tx=0x7fd358009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc659de27544af7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd3567fc700 1 -- 172.21.15.35:0/2742315522 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580155f0 con 0x5582fc6571e0 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd3567fc700 1 -- 172.21.15.35:0/2742315522 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd358011040 con 0x5582fc6571e0 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.318+0000 7fd3567fc700 1 -- 172.21.15.35:0/2742315522 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358014880 con 0x5582fc6571e0 2023-03-17T10:02:13.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 -- 172.21.15.35:0/2742315522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 msgr2=0x5582fc662dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:13.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc662dd0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd358009400 tx=0x7fd358009920 comp rx=0 tx=0).stop 2023-03-17T10:02:13.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 -- 172.21.15.35:0/2742315522 shutdown_connections 2023-03-17T10:02:13.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc662dd0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc65c040 0x5582fc65c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 --2- 172.21.15.35:0/2742315522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc656830 0x5582fc656ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 -- 172.21.15.35:0/2742315522 >> 172.21.15.35:0/2742315522 conn(0x5582fc4af6b0 msgr2=0x5582fc64ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 -- 172.21.15.35:0/2742315522 shutdown_connections 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 -- 172.21.15.35:0/2742315522 wait complete. 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.319+0000 7fd372439b80 1 -- start start 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 Processor -- start 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 0x5582fc662c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc6571e0 0x5582fc65fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:14.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc4288c0 con 0x5582fc656830 2023-03-17T10:02:14.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc660c80 con 0x5582fc6571e0 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc66c480 con 0x5582fc65c040 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd372439b80 10 client.0 _ll_register_callbacks cb 0x5582fc44a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 0x5582fc662c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 0x5582fc662c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48338/0 (socket says 172.21.15.35:48338) 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 -- 172.21.15.35:0/107460272 learned_addr learned my addr 172.21.15.35:0/107460272 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd364849700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc6571e0 0x5582fc65fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 -- 172.21.15.35:0/107460272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 msgr2=0x5582fc6604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 -- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc6571e0 msgr2=0x5582fc65fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc6571e0 0x5582fc65fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.320+0000 7fd35ffff700 1 -- 172.21.15.35:0/107460272 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580090b0 con 0x5582fc656830 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd35ffff700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 0x5582fc662c60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd3480099c0 tx=0x7fd348009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c934ce7caef0c45d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd33f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd33f7fe700 1 -- 172.21.15.35:0/107460272 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800f660 con 0x5582fc656830 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd33f7fe700 1 -- 172.21.15.35:0/107460272 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd34800bdd0 con 0x5582fc656830 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582fc567390 con 0x5582fc656830 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd33f7fe700 1 -- 172.21.15.35:0/107460272 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34800f7c0 con 0x5582fc656830 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 10 client.17946 fetch_fsmap learned FSMap version 37 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5582fc3d2d80 con 0x5582fc656830 2023-03-17T10:02:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd33f7fe700 1 -- 172.21.15.35:0/107460272 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5582fc567390 con 0x5582fc656830 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd33f7fe700 1 -- 172.21.15.35:0/107460272 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fd34802d920 con 0x5582fc656830 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 10 client.17946 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 10 client.17946 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 20 client.17946 populate_metadata read hostname 'smithi035' 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc670420 0x5582fc672830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 4 client.17946 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.321+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582fc573600 con 0x5582fc670420 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.322+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc670420 0x5582fc672830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.322+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc670420 0x5582fc672830 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a8fb7ce589f19e server_cookie=657e5a6b7eccd5ed in_seq=0 out_seq=0 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.322+0000 7fd33f7fe700 10 client.17946 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd33f7fe700 1 -- 172.21.15.35:0/107460272 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5582fc573600 con 0x5582fc670420 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd33f7fe700 10 client.17946 handle_command_reply: tid=0 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 client.17946 shutdown 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 msgr2=0x5582fc662c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 0x5582fc662c60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd3480099c0 tx=0x7fd348009310 comp rx=0 tx=0).stop 2023-03-17T10:02:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 shutdown_connections 2023-03-17T10:02:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc670420 0x5582fc672830 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd33f7fe700 0 client.17946 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:02:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc656830 0x5582fc662c60 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 --2- 172.21.15.35:0/107460272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc6571e0 0x5582fc65fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 >> 172.21.15.35:0/107460272 conn(0x5582fc4af6b0 msgr2=0x5582fc651410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 shutdown_connections 2023-03-17T10:02:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 1 -- 172.21.15.35:0/107460272 wait complete. 2023-03-17T10:02:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.323+0000 7fd372439b80 20 client.17946 trim_cache size 0 max 16384 2023-03-17T10:02:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 Processor -- start 2023-03-17T10:02:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 -- start start 2023-03-17T10:02:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc6673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc6571e0 0x5582fc662800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 0x5582fc65a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc65e4f0 con 0x5582fc65c040 2023-03-17T10:02:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc65ad40 con 0x5582fc656830 2023-03-17T10:02:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd372439b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc659cb0 con 0x5582fc6571e0 2023-03-17T10:02:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd364849700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 0x5582fc65a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd364849700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 0x5582fc65a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48350/0 (socket says 172.21.15.35:48350) 2023-03-17T10:02:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd364849700 1 -- 172.21.15.35:0/1963001868 learned_addr learned my addr 172.21.15.35:0/1963001868 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc6571e0 0x5582fc662800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.339+0000 7fd35ffff700 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc6673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd364849700 1 -- 172.21.15.35:0/1963001868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc6571e0 msgr2=0x5582fc662800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd364849700 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc6571e0 0x5582fc662800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd364849700 1 -- 172.21.15.35:0/1963001868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 msgr2=0x5582fc6673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd364849700 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc6673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd364849700 1 -- 172.21.15.35:0/1963001868 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582fc56b130 con 0x5582fc65c040 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd364849700 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 0x5582fc65a1d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd358017000 tx=0x7fd358015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b943fda15907b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd356ffd700 1 -- 172.21.15.35:0/1963001868 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358004d70 con 0x5582fc65c040 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd356ffd700 1 -- 172.21.15.35:0/1963001868 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd358011070 con 0x5582fc65c040 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.340+0000 7fd356ffd700 1 -- 172.21.15.35:0/1963001868 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35801f660 con 0x5582fc65c040 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 -- 172.21.15.35:0/1963001868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 msgr2=0x5582fc65a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 0x5582fc65a1d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd358017000 tx=0x7fd358015f90 comp rx=0 tx=0).stop 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 -- 172.21.15.35:0/1963001868 shutdown_connections 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc65c040 0x5582fc65a1d0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc6673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- 172.21.15.35:0/1963001868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc6571e0 0x5582fc662800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 -- 172.21.15.35:0/1963001868 >> 172.21.15.35:0/1963001868 conn(0x5582fc4af6b0 msgr2=0x5582fc64e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 -- 172.21.15.35:0/1963001868 shutdown_connections 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 -- 172.21.15.35:0/1963001868 wait complete. 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 -- start start 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 Processor -- start 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc666b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc667060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.341+0000 7fd372439b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc665a80 con 0x5582fc6571e0 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc665bf0 con 0x5582fc656830 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fc665db0 con 0x5582fc65c040 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 10 client.0 _ll_register_callbacks cb 0x5582fc44a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc667060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc667060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48354/0 (socket says 172.21.15.35:48354) 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 -- 172.21.15.35:0/871792802 learned_addr learned my addr 172.21.15.35:0/871792802 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd364849700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35ffff700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc666b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 -- 172.21.15.35:0/871792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 msgr2=0x5582fc6653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 -- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 msgr2=0x5582fc666b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc666b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 -- 172.21.15.35:0/871792802 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582fc4265d0 con 0x5582fc6571e0 2023-03-17T10:02:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35ffff700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc666b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:02:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd35f7fe700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc667060 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fd350010fd0 tx=0x7fd3500ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0c8c8c93904853 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-mon[92535]: pgmap v2169: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:04 smithi035 ceph-mon[92535]: osdmap e211: 12 total, 12 up, 12 in 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:05 smithi035 ceph-mon[92535]: pgmap v2171: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:07 smithi035 ceph-mon[92535]: pgmap v2172: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 67 KiB/s wr, 28 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:09 smithi035 ceph-mon[92535]: pgmap v2173: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:11 smithi035 ceph-mon[92535]: pgmap v2174: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:11 smithi035 ceph-mon[92535]: osdmap e212: 12 total, 12 up, 12 in 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:13 smithi035 ceph-mon[92535]: pgmap v2176: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 463 B/s wr, 10 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:14 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:14 smithi035 ceph-mon[92535]: osdmap e213: 12 total, 12 up, 12 in 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:15 smithi035 ceph-mon[92535]: pgmap v2178: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 11 op/s 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/2800644014,v1:172.21.15.35:6837/2800644014] up:boot 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T10:02:20.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:17 smithi035 ceph-mon[92535]: pgmap v2179: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:19 smithi035 ceph-mon[92535]: pgmap v2180: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:21 smithi035 ceph-mon[92535]: pgmap v2181: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 519 B/s wr, 9 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:23 smithi035 ceph-mon[92535]: pgmap v2182: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:25 smithi035 ceph-mon[92535]: pgmap v2183: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 408 B/s wr, 10 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:27 smithi035 ceph-mon[92535]: pgmap v2184: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:29 smithi035 ceph-mon[92535]: pgmap v2185: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:31 smithi035 ceph-mon[92535]: pgmap v2186: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:34 smithi035 ceph-mon[92535]: pgmap v2187: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:02:20.231 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:36 smithi035 ceph-mon[92535]: pgmap v2188: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:02:22.685 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:38 smithi035 ceph-mon[92535]: pgmap v2189: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:02:22.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:40 smithi035 ceph-mon[92535]: pgmap v2190: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:02:22.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:42 smithi035 ceph-mon[92535]: pgmap v2191: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:02:22.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:44 smithi035 ceph-mon[92535]: pgmap v2192: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:02:22.686 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:46 smithi035 ceph-mon[92535]: pgmap v2193: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:02:25.227 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:47 smithi035 ceph-mon[92535]: pgmap v2194: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:02:25.227 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:49 smithi035 ceph-mon[92535]: pgmap v2195: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:02:25.227 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:51 smithi035 ceph-mon[92535]: pgmap v2196: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:02:25.227 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:53 smithi035 ceph-mon[92535]: pgmap v2197: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:02:25.227 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:55 smithi035 ceph-mon[92535]: pgmap v2198: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:02:27.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:57 smithi035 ceph-mon[92535]: pgmap v2199: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:02:27.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:02:27.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:59 smithi035 ceph-mon[92535]: pgmap v2200: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T10:02:27.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:02:27.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:02:27.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:53:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:02:27.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:00 smithi035 ceph-mon[92535]: pgmap v2201: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T10:02:29.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:00 smithi035 ceph-mon[92535]: pgmap v2202: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T10:02:30.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:02 smithi035 ceph-mon[92535]: pgmap v2203: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T10:02:30.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:04 smithi035 ceph-mon[92535]: pgmap v2204: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: *** Caught signal (Segmentation fault) ** 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: in thread 7efcfa08c700 thread_name:md_log_replay 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7efd0ac36cf0] 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x564b4d9c571f] 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x564b4d9c7953] 2023-03-17T10:02:30.615 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 4: (MDLog::_replay_thread()+0x66d) [0x564b4da3307d] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 5: (MDLog::ReplayThread::entry()+0x11) [0x564b4d6e6d91] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7efd0ac2c1ca] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 7: clone() 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T09:53:03.503+0000 7efcfa08c700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: in thread 7efcfa08c700 thread_name:md_log_replay 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7efd0ac36cf0] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x564b4d9c571f] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x564b4d9c7953] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 4: (MDLog::_replay_thread()+0x66d) [0x564b4da3307d] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 5: (MDLog::ReplayThread::entry()+0x11) [0x564b4d6e6d91] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7efd0ac2c1ca] 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 7: clone() 2023-03-17T10:02:30.616 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:02:30.617 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T10:02:30.617 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 0> 2023-03-17T09:53:03.503+0000 7efcfa08c700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:02:30.617 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: in thread 7efcfa08c700 thread_name:md_log_replay 2023-03-17T10:02:31.930 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T10:02:31.930 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:02:31.930 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7efd0ac36cf0] 2023-03-17T10:02:31.930 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x564b4d9c571f] 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x564b4d9c7953] 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 4: (MDLog::_replay_thread()+0x66d) [0x564b4da3307d] 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 5: (MDLog::ReplayThread::entry()+0x11) [0x564b4d6e6d91] 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7efd0ac2c1ca] 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 7: clone() 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 0> 2023-03-17T09:53:03.503+0000 7efcfa08c700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:02:33.817 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: in thread 7efcfa08c700 thread_name:md_log_replay 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7efd0ac36cf0] 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x564b4d9c571f] 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x564b4d9c7953] 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 4: (MDLog::_replay_thread()+0x66d) [0x564b4da3307d] 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 5: (MDLog::ReplayThread::entry()+0x11) [0x564b4d6e6d91] 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7efd0ac2c1ca] 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 7: clone() 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[168051]: 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:03 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 2. 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:02:33.818 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T10:02:33.819 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 podman[174166]: 2023-03-17T10:02:33.819 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 bash[174166]: 3b918811ec8c40bf056d6e1614f82503ab0ae0bffcd2edf00142195c689aa2eb 2023-03-17T10:02:33.819 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 ceph-mds[174206]: -- 172.21.15.35:0/3596452386 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c5b1eb8b60 con 0x55c5b1e8e800 2023-03-17T10:02:33.819 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: starting mds.d at 2023-03-17T10:02:33.819 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:53:14 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:02:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:02:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:02:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:02:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:02:35.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd33f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd33f7fe700 1 -- 172.21.15.35:0/871792802 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500c6070 con 0x5582fc6571e0 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd33f7fe700 1 -- 172.21.15.35:0/871792802 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd350094af0 con 0x5582fc6571e0 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582fc6221e0 con 0x5582fc6571e0 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd33f7fe700 1 -- 172.21.15.35:0/871792802 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd350094cb0 con 0x5582fc6571e0 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 10 client.17952 fetch_fsmap learned FSMap version 37 2023-03-17T10:02:35.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.342+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5582fc3f91f0 con 0x5582fc6571e0 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd33f7fe700 1 -- 172.21.15.35:0/871792802 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5582fc6221e0 con 0x5582fc6571e0 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd33f7fe700 1 -- 172.21.15.35:0/871792802 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fd3500978d0 con 0x5582fc6571e0 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd372439b80 10 client.17952 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd372439b80 10 client.17952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd372439b80 20 client.17952 populate_metadata read hostname 'smithi035' 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd372439b80 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc6c5330 0x5582fc6c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd372439b80 4 client.17952 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:02:35.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5582fc428f00 con 0x5582fc6c5330 2023-03-17T10:02:35.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.343+0000 7fd35ffff700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc6c5330 0x5582fc6c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.344+0000 7fd35ffff700 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc6c5330 0x5582fc6c7740 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c46b249f1ab94ced server_cookie=de2ef6bd41d9bfac in_seq=0 out_seq=0 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.344+0000 7fd33f7fe700 10 client.17952 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd33f7fe700 1 -- 172.21.15.35:0/871792802 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5582fc428f00 con 0x5582fc6c5330 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd33f7fe700 10 client.17952 handle_command_reply: tid=0 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 client.17952 shutdown 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 msgr2=0x5582fc667060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc667060 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fd350010fd0 tx=0x7fd3500ca040 comp rx=0 tx=0).stop 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 shutdown_connections 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5582fc6c5330 0x5582fc6c7740 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582fc65c040 0x5582fc6653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582fc656830 0x5582fc666b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 --2- 172.21.15.35:0/871792802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5582fc6571e0 0x5582fc667060 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 >> 172.21.15.35:0/871792802 conn(0x5582fc4af6b0 msgr2=0x5582fc65a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd33f7fe700 0 client.17952 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 shutdown_connections 2023-03-17T10:02:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 1 -- 172.21.15.35:0/871792802 wait complete. 2023-03-17T10:02:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.352+0000 7fd372439b80 20 client.17952 trim_cache size 0 max 16384 2023-03-17T10:02:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd34c09f640 msgr2=0x7fd34c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd34c09f640 0x7fd34c0a1af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd34800b580 tx=0x7fd348005c00 comp rx=0 tx=0).stop 2023-03-17T10:02:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 msgr2=0x7fd3601967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 0x7fd3601967c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd35000e940 tx=0x7fd35000ec50 comp rx=0 tx=0).stop 2023-03-17T10:02:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 shutdown_connections 2023-03-17T10:02:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd34c09f640 0x7fd34c0a1af0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601043f0 0x7fd36019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3600ff3b0 0x7fd360196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 --2- 172.21.15.35:0/1618676235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3600ffd50 0x7fd3601967c0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 >> 172.21.15.35:0/1618676235 conn(0x7fd360075f60 msgr2=0x7fd360102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 shutdown_connections 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:41.353+0000 7fd3662ac700 1 -- 172.21.15.35:0/1618676235 wait complete. 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 -- 172.21.15.35:0/822620758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 msgr2=0x7fbb90101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 --2- 172.21.15.35:0/822620758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90101640 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009990 tx=0x7fbb8c009ca0 comp rx=0 tx=0).stop 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 -- 172.21.15.35:0/822620758 shutdown_connections 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 --2- 172.21.15.35:0/822620758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9010a790 0x7fbb9010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 --2- 172.21.15.35:0/822620758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90101640 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 --2- 172.21.15.35:0/822620758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb90101b80 0x7fbb9010a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 -- 172.21.15.35:0/822620758 >> 172.21.15.35:0/822620758 conn(0x7fbb90076330 msgr2=0x7fbb90076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 -- 172.21.15.35:0/822620758 shutdown_connections 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.474+0000 7fbb981aa700 1 -- 172.21.15.35:0/822620758 wait complete. 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 Processor -- start 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 -- start start 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb90101b80 0x7fbb90196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb9010a790 0x7fbb9019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9019b220 con 0x7fbb90101270 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9019b390 con 0x7fbb9010a790 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb981aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9019b550 con 0x7fbb90101b80 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48366/0 (socket says 172.21.15.35:48366) 2023-03-17T10:02:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 -- 172.21.15.35:0/2967182052 learned_addr learned my addr 172.21.15.35:0/2967182052 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb96747700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb9010a790 0x7fbb9019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95745700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb90101b80 0x7fbb90196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 -- 172.21.15.35:0/2967182052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb90101b80 msgr2=0x7fbb90196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb90101b80 0x7fbb90196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 -- 172.21.15.35:0/2967182052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb9010a790 msgr2=0x7fbb9019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb9010a790 0x7fbb9019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 -- 172.21.15.35:0/2967182052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0095f0 con 0x7fbb90101270 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95745700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb90101b80 0x7fbb90196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb96747700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb9010a790 0x7fbb9019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.475+0000 7fbb95f46700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90196240 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c000c00 tx=0x7fbb8c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.476+0000 7fbb86ffd700 1 -- 172.21.15.35:0/2967182052 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c01d070 con 0x7fbb90101270 2023-03-17T10:02:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.476+0000 7fbb86ffd700 1 -- 172.21.15.35:0/2967182052 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb8c0040b0 con 0x7fbb90101270 2023-03-17T10:02:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.476+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb90110170 con 0x7fbb90101270 2023-03-17T10:02:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.476+0000 7fbb86ffd700 1 -- 172.21.15.35:0/2967182052 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c022da0 con 0x7fbb90101270 2023-03-17T10:02:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.476+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9010ffe0 con 0x7fbb90101270 2023-03-17T10:02:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.478+0000 7fbb86ffd700 1 -- 172.21.15.35:0/2967182052 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbb8c022470 con 0x7fbb90101270 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.479+0000 7fbb86ffd700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb7c09f6c0 0x7fbb7c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.479+0000 7fbb95745700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb7c09f6c0 0x7fbb7c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.479+0000 7fbb86ffd700 1 -- 172.21.15.35:0/2967182052 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbb8c0cbb00 con 0x7fbb90101270 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbb95745700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb7c09f6c0 0x7fbb7c0a1b70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005fd0 tx=0x7fbb80005e20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 Processor -- start 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 -- start start 2023-03-17T10:02:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7abc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7abcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f79c3010 con 0x55e6f7abc960 2023-03-17T10:02:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7a15950 con 0x55e6f7ac1be0 2023-03-17T10:02:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.480+0000 7fbba4337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7a0ede0 con 0x55e6f7ac24f0 2023-03-17T10:02:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7abcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7abcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48378/0 (socket says 172.21.15.35:48378) 2023-03-17T10:02:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 -- 172.21.15.35:0/2607196931 learned_addr learned my addr 172.21.15.35:0/2607196931 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb95f46700 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb95745700 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7abc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 -- 172.21.15.35:0/2607196931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 msgr2=0x55e6f7abc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7abc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:50.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 -- 172.21.15.35:0/2607196931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 msgr2=0x55e6f7ac1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 -- 172.21.15.35:0/2607196931 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6f78905d0 con 0x55e6f7abc960 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb96747700 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7abcd90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c450 tx=0x7fbb8800c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe94357b6e4f8d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb7bfff700 1 -- 172.21.15.35:0/2607196931 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88011070 con 0x55e6f7abc960 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb7bfff700 1 -- 172.21.15.35:0/2607196931 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb88009b20 con 0x55e6f7abc960 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.481+0000 7fbb7bfff700 1 -- 172.21.15.35:0/2607196931 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880153c0 con 0x55e6f7abc960 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 -- 172.21.15.35:0/2607196931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 msgr2=0x55e6f7abcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7abcd90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c450 tx=0x7fbb8800c480 comp rx=0 tx=0).stop 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 -- 172.21.15.35:0/2607196931 shutdown_connections 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7abcd90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 --2- 172.21.15.35:0/2607196931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7abc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 -- 172.21.15.35:0/2607196931 >> 172.21.15.35:0/2607196931 conn(0x55e6f79196b0 msgr2=0x55e6f7ab6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 -- 172.21.15.35:0/2607196931 shutdown_connections 2023-03-17T10:02:50.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 -- 172.21.15.35:0/2607196931 wait complete. 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.482+0000 7fbba4337b80 1 -- start start 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 Processor -- start 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ac8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f78928c0 con 0x55e6f7ac24f0 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7ac63f0 con 0x55e6f7abc960 2023-03-17T10:02:50.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7ad2000 con 0x55e6f7ac1be0 2023-03-17T10:02:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbba4337b80 10 client.0 _ll_register_callbacks cb 0x55e6f78b4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:02:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbb96747700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbb96747700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48384/0 (socket says 172.21.15.35:48384) 2023-03-17T10:02:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbb96747700 1 -- 172.21.15.35:0/3211953293 learned_addr learned my addr 172.21.15.35:0/3211953293 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.483+0000 7fbb95f46700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ac8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb95745700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb96747700 1 -- 172.21.15.35:0/3211953293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac1be0 msgr2=0x55e6f7ac5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb96747700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb96747700 1 -- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 msgr2=0x55e6f7ac8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb96747700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ac8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb96747700 1 -- 172.21.15.35:0/3211953293 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb88009ca0 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb96747700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac5cc0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fbb88000f80 tx=0x7fbb8800a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9634473e2b93f92f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb797fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb797fa700 1 -- 172.21.15.35:0/3211953293 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88011040 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb797fa700 1 -- 172.21.15.35:0/3211953293 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbb88006e40 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6f79d1390 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbb797fa700 1 -- 172.21.15.35:0/3211953293 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb88009b20 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbba4337b80 10 client.17964 fetch_fsmap learned FSMap version 37 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.484+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e6f783cd80 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbb797fa700 1 -- 172.21.15.35:0/3211953293 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e6f79d1390 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbb797fa700 1 -- 172.21.15.35:0/3211953293 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbb8801e400 con 0x55e6f7ac24f0 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbba4337b80 10 client.17964 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:02:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbba4337b80 10 client.17964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbba4337b80 20 client.17964 populate_metadata read hostname 'smithi035' 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbba4337b80 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7ad6090 0x55e6f7ad84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbba4337b80 4 client.17964 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6f79dd600 con 0x55e6f7ad6090 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbb95f46700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7ad6090 0x55e6f7ad84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbb95f46700 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7ad6090 0x55e6f7ad84a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ddeb48ef8c7bb67 server_cookie=a0856519294db612 in_seq=0 out_seq=0 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.485+0000 7fbb797fa700 10 client.17964 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:02:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbb797fa700 1 -- 172.21.15.35:0/3211953293 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e6f79dd600 con 0x55e6f7ad6090 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbb797fa700 10 client.17964 handle_command_reply: tid=0 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 client.17964 shutdown 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 msgr2=0x55e6f7ac5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac5cc0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fbb88000f80 tx=0x7fbb8800a630 comp rx=0 tx=0).stop 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 shutdown_connections 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7ad6090 0x55e6f7ad84a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac5cc0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:55.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:07 smithi035 ceph-mon[92535]: pgmap v2205: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:02:55.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ac8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 --2- 172.21.15.35:0/3211953293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbb797fa700 0 client.17964 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:02:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 >> 172.21.15.35:0/3211953293 conn(0x55e6f79196b0 msgr2=0x55e6f7ab6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:02:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 shutdown_connections 2023-03-17T10:02:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 1 -- 172.21.15.35:0/3211953293 wait complete. 2023-03-17T10:02:58.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.486+0000 7fbba4337b80 20 client.17964 trim_cache size 0 max 16384 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.501+0000 7fbba4337b80 1 Processor -- start 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 -- start start 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ab6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7ab7e10 con 0x55e6f7ac1be0 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7ab76d0 con 0x55e6f7abc960 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbba4337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7ab3b60 con 0x55e6f7ac24f0 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48390/0 (socket says 172.21.15.35:48390) 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 -- 172.21.15.35:0/1166997820 learned_addr learned my addr 172.21.15.35:0/1166997820 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95f46700 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ab6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:58.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb96747700 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 -- 172.21.15.35:0/1166997820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 msgr2=0x55e6f7ac7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 -- 172.21.15.35:0/1166997820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 msgr2=0x55e6f7ab6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ab6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 -- 172.21.15.35:0/1166997820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6f79d5130 con 0x55e6f7ac1be0 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.502+0000 7fbb95745700 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac2fd0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000db20 tx=0x7fbb80010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2587ae084747101b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbb84ff9700 1 -- 172.21.15.35:0/1166997820 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8001c830 con 0x55e6f7ac1be0 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbb84ff9700 1 -- 172.21.15.35:0/1166997820 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb8001ce20 con 0x55e6f7ac1be0 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbb84ff9700 1 -- 172.21.15.35:0/1166997820 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80025e90 con 0x55e6f7ac1be0 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 -- 172.21.15.35:0/1166997820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 msgr2=0x55e6f7ac2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac2fd0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000db20 tx=0x7fbb80010000 comp rx=0 tx=0).stop 2023-03-17T10:02:59.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 -- 172.21.15.35:0/1166997820 shutdown_connections 2023-03-17T10:02:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7ac7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:02:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7abc960 0x55e6f7ab6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 --2- 172.21.15.35:0/1166997820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7ac1be0 0x55e6f7ac2fd0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 -- 172.21.15.35:0/1166997820 >> 172.21.15.35:0/1166997820 conn(0x55e6f79196b0 msgr2=0x55e6f7ac28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 -- 172.21.15.35:0/1166997820 shutdown_connections 2023-03-17T10:03:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.503+0000 7fbba4337b80 1 -- 172.21.15.35:0/1166997820 wait complete. 2023-03-17T10:03:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 -- start start 2023-03-17T10:03:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 Processor -- start 2023-03-17T10:03:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7acc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7acceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7acaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7acb500 con 0x55e6f7abc960 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7acb670 con 0x55e6f7ac1be0 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f7acb830 con 0x55e6f7ac24f0 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbba4337b80 10 client.0 _ll_register_callbacks cb 0x55e6f78b4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbb95f46700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7acc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbb95f46700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7acc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48392/0 (socket says 172.21.15.35:48392) 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbb95f46700 1 -- 172.21.15.35:0/56685128 learned_addr learned my addr 172.21.15.35:0/56685128 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbb95745700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7acceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.504+0000 7fbb96747700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7acaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95f46700 1 -- 172.21.15.35:0/56685128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 msgr2=0x55e6f7acaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:06.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95f46700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7acaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95f46700 1 -- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 msgr2=0x55e6f7acceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95f46700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7acceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95f46700 1 -- 172.21.15.35:0/56685128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8000d800 con 0x55e6f7abc960 2023-03-17T10:03:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95745700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7acceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:03:06.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb95f46700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7acc970 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0960b0 tx=0x7fbb8c09f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf17f7cb20fa6ba server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb797fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:03:07.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb797fa700 1 -- 172.21.15.35:0/56685128 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c099aa0 con 0x55e6f7abc960 2023-03-17T10:03:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb797fa700 1 -- 172.21.15.35:0/56685128 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbb8c097aa0 con 0x55e6f7abc960 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6f7a8c1e0 con 0x55e6f7abc960 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb797fa700 1 -- 172.21.15.35:0/56685128 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb8c09f2c0 con 0x55e6f7abc960 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 10 client.17970 fetch_fsmap learned FSMap version 37 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e6f78631f0 con 0x55e6f7abc960 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb797fa700 1 -- 172.21.15.35:0/56685128 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e6f7a8c1e0 con 0x55e6f7abc960 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbb797fa700 1 -- 172.21.15.35:0/56685128 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbb8c0a1310 con 0x55e6f7abc960 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 10 client.17970 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:03:08.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 10 client.17970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 20 client.17970 populate_metadata read hostname 'smithi035' 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7b2ac40 0x55e6f7b2d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 4 client.17970 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.505+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e6f7892f00 con 0x55e6f7b2ac40 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.506+0000 7fbb95745700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7b2ac40 0x55e6f7b2d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.506+0000 7fbb797fa700 10 client.17970 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.506+0000 7fbb95745700 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7b2ac40 0x55e6f7b2d020 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74a1519843645f76 server_cookie=120794e517628d57 in_seq=0 out_seq=0 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbb797fa700 1 -- 172.21.15.35:0/56685128 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e6f7892f00 con 0x55e6f7b2ac40 2023-03-17T10:03:08.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbb797fa700 10 client.17970 handle_command_reply: tid=0 2023-03-17T10:03:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 client.17970 shutdown 2023-03-17T10:03:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 msgr2=0x55e6f7acc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7acc970 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0960b0 tx=0x7fbb8c09f040 comp rx=0 tx=0).stop 2023-03-17T10:03:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 shutdown_connections 2023-03-17T10:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e6f7b2ac40 0x55e6f7b2d020 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6f7ac24f0 0x55e6f7acaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbb797fa700 0 client.17970 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e6f7abc960 0x55e6f7acc970 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 --2- 172.21.15.35:0/56685128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e6f7ac1be0 0x55e6f7acceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 >> 172.21.15.35:0/56685128 conn(0x55e6f79196b0 msgr2=0x55e6f7ac3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 shutdown_connections 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 1 -- 172.21.15.35:0/56685128 wait complete. 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.511+0000 7fbba4337b80 20 client.17970 trim_cache size 0 max 16384 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb7c09f6c0 msgr2=0x7fbb7c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb7c09f6c0 0x7fbb7c0a1b70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005fd0 tx=0x7fbb80005e20 comp rx=0 tx=0).stop 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 msgr2=0x7fbb90196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90196240 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c000c00 tx=0x7fbb8c004710 comp rx=0 tx=0).stop 2023-03-17T10:03:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 shutdown_connections 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbb7c09f6c0 0x7fbb7c0a1b70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb9010a790 0x7fbb9019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbb90101270 0x7fbb90196240 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 --2- 172.21.15.35:0/2967182052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb90101b80 0x7fbb90196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 >> 172.21.15.35:0/2967182052 conn(0x7fbb90076330 msgr2=0x7fbb900fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 shutdown_connections 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:41:54.512+0000 7fbb981aa700 1 -- 172.21.15.35:0/2967182052 wait complete. 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.635+0000 7f8186b34700 1 -- 172.21.15.35:0/3566835546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 msgr2=0x7f818010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.635+0000 7f8186b34700 1 --2- 172.21.15.35:0/3566835546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f818010bf60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f817800b0d0 tx=0x7f817800b3e0 comp rx=0 tx=0).stop 2023-03-17T10:03:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 -- 172.21.15.35:0/3566835546 shutdown_connections 2023-03-17T10:03:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 --2- 172.21.15.35:0/3566835546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f818010bf60 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 --2- 172.21.15.35:0/3566835546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81800ff350 0x7f81800ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 --2- 172.21.15.35:0/3566835546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffcf0 0x7f8180103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 -- 172.21.15.35:0/3566835546 >> 172.21.15.35:0/3566835546 conn(0x7f8180076330 msgr2=0x7f8180076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 -- 172.21.15.35:0/3566835546 shutdown_connections 2023-03-17T10:03:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 -- 172.21.15.35:0/3566835546 wait complete. 2023-03-17T10:03:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.636+0000 7f8186b34700 1 Processor -- start 2023-03-17T10:03:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 -- start start 2023-03-17T10:03:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81800ff350 0x7f81801971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:14.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffcf0 0x7f81801976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f81801a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180198030 con 0x7f8180104390 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81801a2770 con 0x7f81800ff350 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f8186b34700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81801a2930 con 0x7f81800ffcf0 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f81801a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f81801a2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48410/0 (socket says 172.21.15.35:48410) 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 -- 172.21.15.35:0/4143797282 learned_addr learned my addr 172.21.15.35:0/4143797282 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:14.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f817ffff700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffcf0 0x7f81801976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81848d0700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81800ff350 0x7f81801971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:14.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 -- 172.21.15.35:0/4143797282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffcf0 msgr2=0x7f81801976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffcf0 0x7f81801976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 -- 172.21.15.35:0/4143797282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81800ff350 msgr2=0x7f81801971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81800ff350 0x7f81801971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.637+0000 7f81850d1700 1 -- 172.21.15.35:0/4143797282 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178009d00 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.638+0000 7f81850d1700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f81801a2230 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8178009380 tx=0x7f81780093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.638+0000 7f817dffb700 1 -- 172.21.15.35:0/4143797282 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800e040 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.638+0000 7f817dffb700 1 -- 172.21.15.35:0/4143797282 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8178003e10 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.638+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818010f010 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.638+0000 7f817dffb700 1 -- 172.21.15.35:0/4143797282 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817801ba00 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.638+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818010ee80 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.640+0000 7f817dffb700 1 -- 172.21.15.35:0/4143797282 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8178024410 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.641+0000 7f817dffb700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f817009f640 0x7f81700a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.641+0000 7f817dffb700 1 -- 172.21.15.35:0/4143797282 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f81780cbdb0 con 0x7f8180104390 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.641+0000 7f81848d0700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f817009f640 0x7f81700a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.641+0000 7f81848d0700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f817009f640 0x7f81700a1af0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8174005950 tx=0x7f81740058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 Processor -- start 2023-03-17T10:03:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 -- start start 2023-03-17T10:03:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4330fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d43314f0 0x5560d432b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:16.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d432b960 0x5560d432bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d4232010 con 0x5560d4330be0 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d4284950 con 0x5560d432b960 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d427dde0 con 0x5560d43314f0 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4330fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4330fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48414/0 (socket says 172.21.15.35:48414) 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 -- 172.21.15.35:0/1355358817 learned_addr learned my addr 172.21.15.35:0/1355358817 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81850d1700 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d432b960 0x5560d432bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f817ffff700 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d43314f0 0x5560d432b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 -- 172.21.15.35:0/1355358817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d43314f0 msgr2=0x5560d432b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d43314f0 0x5560d432b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 -- 172.21.15.35:0/1355358817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d432b960 msgr2=0x5560d432bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d432b960 0x5560d432bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.642+0000 7f81848d0700 1 -- 172.21.15.35:0/1355358817 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d40ff5d0 con 0x5560d4330be0 2023-03-17T10:03:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.643+0000 7f81848d0700 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4330fb0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f817400fd70 tx=0x7f8174012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ac76b14497de2a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.643+0000 7f816affd700 1 -- 172.21.15.35:0/1355358817 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174011c60 con 0x5560d4330be0 2023-03-17T10:03:17.140 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:09 smithi035 ceph-mon[92535]: pgmap v2206: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.643+0000 7f816affd700 1 -- 172.21.15.35:0/1355358817 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8174011dc0 con 0x5560d4330be0 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.643+0000 7f816affd700 1 -- 172.21.15.35:0/1355358817 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817401d710 con 0x5560d4330be0 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1355358817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 msgr2=0x5560d4330fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4330fb0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f817400fd70 tx=0x7f8174012000 comp rx=0 tx=0).stop 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1355358817 shutdown_connections 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d432b960 0x5560d432bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4330fb0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1355358817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d43314f0 0x5560d432b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1355358817 >> 172.21.15.35:0/1355358817 conn(0x5560d41886b0 msgr2=0x5560d4325a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1355358817 shutdown_connections 2023-03-17T10:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1355358817 wait complete. 2023-03-17T10:03:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 -- start start 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.644+0000 7f8192cc1b80 1 Processor -- start 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4337400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4334610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d43314f0 0x5560d4334b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d41018c0 con 0x5560d4330be0 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d43352d0 con 0x5560d43314f0 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d4335490 con 0x5560d432b960 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 10 client.0 _ll_register_callbacks cb 0x5560d4123230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4334610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4334610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48422/0 (socket says 172.21.15.35:48422) 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f81848d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4337400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 -- 172.21.15.35:0/2309687703 learned_addr learned my addr 172.21.15.35:0/2309687703 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f81850d1700 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d43314f0 0x5560d4334b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 -- 172.21.15.35:0/2309687703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 msgr2=0x5560d4337400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4337400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 -- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d43314f0 msgr2=0x5560d4334b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d43314f0 0x5560d4334b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 -- 172.21.15.35:0/2309687703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817400fa20 con 0x5560d4330be0 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f817ffff700 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4334610 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f816c007d50 tx=0x7f816c0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5375eb437b0e24 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f815ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f815ffff700 1 -- 172.21.15.35:0/2309687703 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c004050 con 0x5560d4330be0 2023-03-17T10:03:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f815ffff700 1 -- 172.21.15.35:0/2309687703 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f816c0041b0 con 0x5560d4330be0 2023-03-17T10:03:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.645+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560d4240390 con 0x5560d4330be0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f815ffff700 1 -- 172.21.15.35:0/2309687703 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f816c004370 con 0x5560d4330be0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 10 client.17982 fetch_fsmap learned FSMap version 37 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5560d40abd80 con 0x5560d4330be0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f815ffff700 1 -- 172.21.15.35:0/2309687703 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5560d4240390 con 0x5560d4330be0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f815ffff700 1 -- 172.21.15.35:0/2309687703 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f816c0124e0 con 0x5560d4330be0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 10 client.17982 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 10 client.17982 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 20 client.17982 populate_metadata read hostname 'smithi035' 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d43450c0 0x5560d43474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 4 client.17982 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560d424c600 con 0x5560d43450c0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.646+0000 7f81848d0700 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d43450c0 0x5560d43474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.647+0000 7f815ffff700 10 client.17982 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.647+0000 7f81848d0700 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d43450c0 0x5560d43474d0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c0563d55bacea7 server_cookie=2e25776402ed618a in_seq=0 out_seq=0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.647+0000 7f815ffff700 1 -- 172.21.15.35:0/2309687703 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5560d424c600 con 0x5560d43450c0 2023-03-17T10:03:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.647+0000 7f815ffff700 10 client.17982 handle_command_reply: tid=0 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.647+0000 7f8192cc1b80 1 client.17982 shutdown 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 msgr2=0x5560d4334610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4334610 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f816c007d50 tx=0x7f816c0116c0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 shutdown_connections 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d43450c0 0x5560d43474d0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d43314f0 0x5560d4334b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f815ffff700 0 client.17982 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4337400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/2309687703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d4330be0 0x5560d4334610 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 >> 172.21.15.35:0/2309687703 conn(0x5560d41886b0 msgr2=0x5560d432a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 shutdown_connections 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 1 -- 172.21.15.35:0/2309687703 wait complete. 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.648+0000 7f8192cc1b80 20 client.17982 trim_cache size 0 max 16384 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 Processor -- start 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 -- start start 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4325ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d4336f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d432a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d4326000 con 0x5560d43314f0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d432f1b0 con 0x5560d4330be0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d4342740 con 0x5560d432b960 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d432a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d432a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48432/0 (socket says 172.21.15.35:48432) 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 -- 172.21.15.35:0/3090589741 learned_addr learned my addr 172.21.15.35:0/3090589741 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81848d0700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4325ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 -- 172.21.15.35:0/3090589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 msgr2=0x5560d4325ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f817ffff700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d4336f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4325ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 -- 172.21.15.35:0/3090589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 msgr2=0x5560d4336f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d4336f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81850d1700 1 -- 172.21.15.35:0/3090589741 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560d4244130 con 0x5560d43314f0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f81848d0700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4325ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.663+0000 7f817ffff700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d4336f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f81850d1700 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d432a7d0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f8178009830 tx=0x7f81780099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be769a1e3f28f8e0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:20.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f816b7fe700 1 -- 172.21.15.35:0/3090589741 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178099890 con 0x5560d43314f0 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f816b7fe700 1 -- 172.21.15.35:0/3090589741 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81780af070 con 0x5560d43314f0 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f816b7fe700 1 -- 172.21.15.35:0/3090589741 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178098d80 con 0x5560d43314f0 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 -- 172.21.15.35:0/3090589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 msgr2=0x5560d432a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d432a7d0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f8178009830 tx=0x7f81780099e0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 -- 172.21.15.35:0/3090589741 shutdown_connections 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d432a7d0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d4325ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/3090589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d4336f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 -- 172.21.15.35:0/3090589741 >> 172.21.15.35:0/3090589741 conn(0x5560d41886b0 msgr2=0x5560d432e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 -- 172.21.15.35:0/3090589741 shutdown_connections 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.664+0000 7f8192cc1b80 1 -- 172.21.15.35:0/3090589741 wait complete. 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.665+0000 7f8192cc1b80 1 -- start start 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.665+0000 7f8192cc1b80 1 Processor -- start 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.665+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d433a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d433a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d4391f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:20.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d43924c0 con 0x5560d43314f0 2023-03-17T10:03:20.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d4392630 con 0x5560d4330be0 2023-03-17T10:03:20.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560d43927f0 con 0x5560d432b960 2023-03-17T10:03:20.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 10 client.0 _ll_register_callbacks cb 0x5560d4123230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:03:20.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d4391f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d4391f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48438/0 (socket says 172.21.15.35:48438) 2023-03-17T10:03:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 -- 172.21.15.35:0/1999917464 learned_addr learned my addr 172.21.15.35:0/1999917464 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:20.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f817ffff700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d433a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81848d0700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d433a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 -- 172.21.15.35:0/1999917464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 msgr2=0x5560d433a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d433a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 -- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 msgr2=0x5560d433a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d433a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 -- 172.21.15.35:0/1999917464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818010ee80 con 0x5560d43314f0 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f817ffff700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d433a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81848d0700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d433a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f81850d1700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d4391f80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f8178009fd0 tx=0x7f8178097c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586cf0c3ceb345f5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f815ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f815ffff700 1 -- 172.21.15.35:0/1999917464 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178098f80 con 0x5560d43314f0 2023-03-17T10:03:20.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f815ffff700 1 -- 172.21.15.35:0/1999917464 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8178099af0 con 0x5560d43314f0 2023-03-17T10:03:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560d42fb1e0 con 0x5560d43314f0 2023-03-17T10:03:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f815ffff700 1 -- 172.21.15.35:0/1999917464 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8178099cb0 con 0x5560d43314f0 2023-03-17T10:03:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 10 client.17988 fetch_fsmap learned FSMap version 37 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.666+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5560d40d21f0 con 0x5560d43314f0 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f815ffff700 1 -- 172.21.15.35:0/1999917464 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5560d42fb1e0 con 0x5560d43314f0 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f815ffff700 1 -- 172.21.15.35:0/1999917464 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f81780830d0 con 0x5560d43314f0 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f8192cc1b80 10 client.17988 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f8192cc1b80 10 client.17988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f8192cc1b80 20 client.17988 populate_metadata read hostname 'smithi035' 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d4399ba0 0x5560d439bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f8192cc1b80 4 client.17988 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:03:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5560d4101f00 con 0x5560d4399ba0 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.667+0000 7f81848d0700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d4399ba0 0x5560d439bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.668+0000 7f815ffff700 10 client.17988 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.668+0000 7f81848d0700 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d4399ba0 0x5560d439bf80 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcd32f2ca63278e3 server_cookie=660b620752759bf0 in_seq=0 out_seq=0 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.675+0000 7f815ffff700 1 -- 172.21.15.35:0/1999917464 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5560d4101f00 con 0x5560d4399ba0 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.675+0000 7f815ffff700 10 client.17988 handle_command_reply: tid=0 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.675+0000 7f8192cc1b80 1 client.17988 shutdown 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.675+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 msgr2=0x5560d4391f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.675+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d4391f80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f8178009fd0 tx=0x7f8178097c30 comp rx=0 tx=0).stop 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 shutdown_connections 2023-03-17T10:03:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560d4399ba0 0x5560d439bf80 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560d43314f0 0x5560d4391f80 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560d432b960 0x5560d433a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f815ffff700 0 client.17988 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 --2- 172.21.15.35:0/1999917464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560d4330be0 0x5560d433a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 >> 172.21.15.35:0/1999917464 conn(0x5560d41886b0 msgr2=0x5560d432a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 shutdown_connections 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 1 -- 172.21.15.35:0/1999917464 wait complete. 2023-03-17T10:03:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8192cc1b80 20 client.17988 trim_cache size 0 max 16384 2023-03-17T10:03:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f817009f640 msgr2=0x7f81700a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f817009f640 0x7f81700a1af0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8174005950 tx=0x7f81740058e0 comp rx=0 tx=0).stop 2023-03-17T10:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 msgr2=0x7f81801a2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f81801a2230 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8178009380 tx=0x7f81780093b0 comp rx=0 tx=0).stop 2023-03-17T10:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 shutdown_connections 2023-03-17T10:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f817009f640 0x7f81700a1af0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8180104390 0x7f81801a2230 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81800ff350 0x7f81801971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 --2- 172.21.15.35:0/4143797282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffcf0 0x7f81801976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 >> 172.21.15.35:0/4143797282 conn(0x7f8180076330 msgr2=0x7f8180102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.676+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 shutdown_connections 2023-03-17T10:03:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:07.677+0000 7f8186b34700 1 -- 172.21.15.35:0/4143797282 wait complete. 2023-03-17T10:03:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 -- 172.21.15.35:0/1699449853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda800ff350 msgr2=0x7fda800ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:26.274 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:10 smithi035 ceph-mon[92535]: osdmap e214: 12 total, 12 up, 12 in 2023-03-17T10:03:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 --2- 172.21.15.35:0/1699449853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda800ff350 0x7fda800ff720 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fda740099c0 tx=0x7fda74009cd0 comp rx=0 tx=0).stop 2023-03-17T10:03:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 -- 172.21.15.35:0/1699449853 shutdown_connections 2023-03-17T10:03:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 --2- 172.21.15.35:0/1699449853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda80104390 0x7fda8010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 --2- 172.21.15.35:0/1699449853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda800ff350 0x7fda800ff720 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 --2- 172.21.15.35:0/1699449853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda800ffcf0 0x7fda80103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:28.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 -- 172.21.15.35:0/1699449853 >> 172.21.15.35:0/1699449853 conn(0x7fda80076330 msgr2=0x7fda80076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 -- 172.21.15.35:0/1699449853 shutdown_connections 2023-03-17T10:03:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.798+0000 7fda86c21700 1 -- 172.21.15.35:0/1699449853 wait complete. 2023-03-17T10:03:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 Processor -- start 2023-03-17T10:03:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 -- start start 2023-03-17T10:03:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda800ff350 0x7fda80196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda800ffcf0 0x7fda80196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 0x7fda8019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8019b220 con 0x7fda80104390 2023-03-17T10:03:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8019b390 con 0x7fda800ff350 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda86c21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8019b550 con 0x7fda800ffcf0 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 0x7fda8019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 0x7fda8019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48452/0 (socket says 172.21.15.35:48452) 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda800ffcf0 0x7fda80196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 -- 172.21.15.35:0/3142951615 learned_addr learned my addr 172.21.15.35:0/3142951615 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda849bd700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda800ff350 0x7fda80196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 -- 172.21.15.35:0/3142951615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda800ffcf0 msgr2=0x7fda80196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda800ffcf0 0x7fda80196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 -- 172.21.15.35:0/3142951615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda800ff350 msgr2=0x7fda80196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.799+0000 7fda851be700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda800ff350 0x7fda80196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda851be700 1 -- 172.21.15.35:0/3142951615 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740095f0 con 0x7fda80104390 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda851be700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 0x7fda8019abe0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fda7800ef30 tx=0x7fda7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda7dffb700 1 -- 172.21.15.35:0/3142951615 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78018070 con 0x7fda80104390 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda7dffb700 1 -- 172.21.15.35:0/3142951615 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda7800f040 con 0x7fda80104390 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8010f000 con 0x7fda80104390 2023-03-17T10:03:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda7dffb700 1 -- 172.21.15.35:0/3142951615 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7800cbc0 con 0x7fda80104390 2023-03-17T10:03:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.800+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8010ee70 con 0x7fda80104390 2023-03-17T10:03:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.803+0000 7fda7dffb700 1 -- 172.21.15.35:0/3142951615 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fda7800cd60 con 0x7fda80104390 2023-03-17T10:03:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.803+0000 7fda7dffb700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda7009f640 0x7fda700a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.803+0000 7fda7dffb700 1 -- 172.21.15.35:0/3142951615 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fda780ca070 con 0x7fda80104390 2023-03-17T10:03:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.804+0000 7fda849bd700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda7009f640 0x7fda700a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.804+0000 7fda849bd700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda7009f640 0x7fda700a1af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda7400b580 tx=0x7fda74005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.804+0000 7fda92daeb80 1 Processor -- start 2023-03-17T10:03:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 -- start start 2023-03-17T10:03:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d83fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d7e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81c85010 con 0x55ff81d83be0 2023-03-17T10:03:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81cd7950 con 0x55ff81d7e960 2023-03-17T10:03:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda92daeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81cd0de0 con 0x55ff81d844f0 2023-03-17T10:03:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d83fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:34.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d83fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48456/0 (socket says 172.21.15.35:48456) 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 -- 172.21.15.35:0/1395221308 learned_addr learned my addr 172.21.15.35:0/1395221308 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda851be700 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda7ffff700 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d7e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 -- 172.21.15.35:0/1395221308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 msgr2=0x55ff81d7e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d7e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 -- 172.21.15.35:0/1395221308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 msgr2=0x55ff81d7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 -- 172.21.15.35:0/1395221308 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff81b525d0 con 0x55ff81d83be0 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.805+0000 7fda849bd700 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d83fb0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fda74015000 tx=0x7fda7401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ec90999a63c3c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda6affd700 1 -- 172.21.15.35:0/1395221308 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74028070 con 0x55ff81d83be0 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda6affd700 1 -- 172.21.15.35:0/1395221308 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda7401e040 con 0x55ff81d83be0 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda6affd700 1 -- 172.21.15.35:0/1395221308 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400f6c0 con 0x55ff81d83be0 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 -- 172.21.15.35:0/1395221308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 msgr2=0x55ff81d83fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d83fb0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fda74015000 tx=0x7fda7401f000 comp rx=0 tx=0).stop 2023-03-17T10:03:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 -- 172.21.15.35:0/1395221308 shutdown_connections 2023-03-17T10:03:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d83fb0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:37.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1395221308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d7e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 -- 172.21.15.35:0/1395221308 >> 172.21.15.35:0/1395221308 conn(0x55ff81bdb6b0 msgr2=0x55ff81d78a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 -- 172.21.15.35:0/1395221308 shutdown_connections 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.806+0000 7fda92daeb80 1 -- 172.21.15.35:0/1395221308 wait complete. 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 -- start start 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 Processor -- start 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d87ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d88220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81b548c0 con 0x55ff81d83be0 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81d8a940 con 0x55ff81d7e960 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81d93fd0 con 0x55ff81d844f0 2023-03-17T10:03:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda92daeb80 10 client.0 _ll_register_callbacks cb 0x55ff81b76230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:03:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d87ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.807+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d87ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48462/0 (socket says 172.21.15.35:48462) 2023-03-17T10:03:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 -- 172.21.15.35:0/352762399 learned_addr learned my addr 172.21.15.35:0/352762399 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda849bd700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda851be700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d88220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 -- 172.21.15.35:0/352762399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 msgr2=0x55ff81d88220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d88220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 -- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 msgr2=0x55ff81d877a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d877a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 -- 172.21.15.35:0/352762399 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8010c7a0 con 0x55ff81d83be0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda7ffff700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d87ce0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fda6c013710 tx=0x7fda6c013a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee5f234d96bf353 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda5ffff700 1 -- 172.21.15.35:0/352762399 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c004520 con 0x55ff81d83be0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda5ffff700 1 -- 172.21.15.35:0/352762399 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fda6c003680 con 0x55ff81d83be0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff81c93390 con 0x55ff81d83be0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda5ffff700 1 -- 172.21.15.35:0/352762399 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda6c003840 con 0x55ff81d83be0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda92daeb80 10 client.18000 fetch_fsmap learned FSMap version 37 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ff81afed80 con 0x55ff81d83be0 2023-03-17T10:03:39.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.808+0000 7fda5ffff700 1 -- 172.21.15.35:0/352762399 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ff81c93390 con 0x55ff81d83be0 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda5ffff700 1 -- 172.21.15.35:0/352762399 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fda6c011a80 con 0x55ff81d83be0 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda92daeb80 10 client.18000 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda92daeb80 10 client.18000 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda92daeb80 20 client.18000 populate_metadata read hostname 'smithi035' 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda92daeb80 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81d98130 0x55ff81d9a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda92daeb80 4 client.18000 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:03:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff81c9f600 con 0x55ff81d98130 2023-03-17T10:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda849bd700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81d98130 0x55ff81d9a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda5ffff700 10 client.18000 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.809+0000 7fda849bd700 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81d98130 0x55ff81d9a540 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc9bd498e31085b server_cookie=f50bc20859b43d73 in_seq=0 out_seq=0 2023-03-17T10:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda5ffff700 1 -- 172.21.15.35:0/352762399 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ff81c9f600 con 0x55ff81d98130 2023-03-17T10:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda5ffff700 10 client.18000 handle_command_reply: tid=0 2023-03-17T10:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 client.18000 shutdown 2023-03-17T10:03:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 msgr2=0x55ff81d87ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d87ce0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fda6c013710 tx=0x7fda6c013a20 comp rx=0 tx=0).stop 2023-03-17T10:03:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 shutdown_connections 2023-03-17T10:03:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81d98130 0x55ff81d9a540 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d88220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda5ffff700 0 client.18000 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:03:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d877a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 --2- 172.21.15.35:0/352762399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d87ce0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 >> 172.21.15.35:0/352762399 conn(0x55ff81bdb6b0 msgr2=0x55ff81d7d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 shutdown_connections 2023-03-17T10:03:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 1 -- 172.21.15.35:0/352762399 wait complete. 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.810+0000 7fda92daeb80 20 client.18000 trim_cache size 0 max 16384 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.825+0000 7fda92daeb80 1 Processor -- start 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.825+0000 7fda92daeb80 1 -- start start 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 0x55ff81d78ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d83be0 0x55ff81d88020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda92daeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81d740f0 con 0x55ff81d7e960 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda92daeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81d95830 con 0x55ff81d83be0 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda92daeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81d79000 con 0x55ff81d844f0 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 0x55ff81d78ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 0x55ff81d78ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48470/0 (socket says 172.21.15.35:48470) 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 -- 172.21.15.35:0/3093736560 learned_addr learned my addr 172.21.15.35:0/3093736560 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda851be700 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 -- 172.21.15.35:0/3093736560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 msgr2=0x55ff81d816b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d816b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda7ffff700 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d83be0 0x55ff81d88020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 -- 172.21.15.35:0/3093736560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d83be0 msgr2=0x55ff81d88020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d83be0 0x55ff81d88020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 -- 172.21.15.35:0/3093736560 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff81d7f000 con 0x55ff81d7e960 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda849bd700 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 0x55ff81d78ac0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fda74000c00 tx=0x7fda7400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d031ff65c42afc1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda6b7fe700 1 -- 172.21.15.35:0/3093736560 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74028040 con 0x55ff81d7e960 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda6b7fe700 1 -- 172.21.15.35:0/3093736560 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda7401e040 con 0x55ff81d7e960 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.826+0000 7fda6b7fe700 1 -- 172.21.15.35:0/3093736560 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400f6c0 con 0x55ff81d7e960 2023-03-17T10:03:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 -- 172.21.15.35:0/3093736560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 msgr2=0x55ff81d78ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 0x55ff81d78ac0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fda74000c00 tx=0x7fda7400bf10 comp rx=0 tx=0).stop 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 -- 172.21.15.35:0/3093736560 shutdown_connections 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d7e960 0x55ff81d78ac0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 --2- 172.21.15.35:0/3093736560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d83be0 0x55ff81d88020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 -- 172.21.15.35:0/3093736560 >> 172.21.15.35:0/3093736560 conn(0x55ff81bdb6b0 msgr2=0x55ff81d93680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 -- 172.21.15.35:0/3093736560 shutdown_connections 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 -- 172.21.15.35:0/3093736560 wait complete. 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 -- start start 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.827+0000 7fda92daeb80 1 Processor -- start 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d8ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d8d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d8d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81deb180 con 0x55ff81d83be0 2023-03-17T10:03:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81deb2f0 con 0x55ff81d7e960 2023-03-17T10:03:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff81deb4b0 con 0x55ff81d844f0 2023-03-17T10:03:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda92daeb80 10 client.0 _ll_register_callbacks cb 0x55ff81b76230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:03:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d8d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:03:49.861 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:11 smithi035 ceph-mon[92535]: pgmap v2208: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:03:50.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:13 smithi035 ceph-mon[92535]: pgmap v2209: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:03:50.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:15 smithi035 ceph-mon[92535]: pgmap v2210: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:03:50.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:16 smithi035 ceph-mon[92535]: pgmap v2211: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:03:51.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:16 smithi035 ceph-mon[92535]: osdmap e215: 12 total, 12 up, 12 in 2023-03-17T10:03:51.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:18 smithi035 ceph-mon[92535]: pgmap v2213: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 355 B/s wr, 12 op/s 2023-03-17T10:03:51.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:20 smithi035 ceph-mon[92535]: pgmap v2214: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T10:03:51.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:22 smithi035 ceph-mon[92535]: pgmap v2215: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T10:03:52.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:24 smithi035 ceph-mon[92535]: pgmap v2216: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:26 smithi035 ceph-mon[92535]: pgmap v2217: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:28 smithi035 ceph-mon[92535]: pgmap v2218: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 175 B/s wr, 13 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:31 smithi035 ceph-mon[92535]: pgmap v2219: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:33 smithi035 ceph-mon[92535]: pgmap v2220: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:35 smithi035 ceph-mon[92535]: pgmap v2221: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:37 smithi035 ceph-mon[92535]: pgmap v2222: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:39 smithi035 ceph-mon[92535]: pgmap v2223: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:41 smithi035 ceph-mon[92535]: pgmap v2224: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:52.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:43 smithi035 ceph-mon[92535]: pgmap v2225: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:53.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:45 smithi035 ceph-mon[92535]: pgmap v2226: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:03:53.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:47 smithi035 ceph-mon[92535]: pgmap v2227: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:53.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:49 smithi035 ceph-mon[92535]: pgmap v2228: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:03:54.455 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:51 smithi035 ceph-mon[92535]: pgmap v2229: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:54.455 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:52 smithi035 ceph-mon[92535]: pgmap v2230: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:54.455 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:54 smithi035 ceph-mon[92535]: pgmap v2231: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:03:56.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:56 smithi035 ceph-mon[92535]: pgmap v2232: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:56.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:58 smithi035 ceph-mon[92535]: pgmap v2233: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:03:58.280 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:54:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:01 smithi035 ceph-mon[92535]: pgmap v2234: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:02 smithi035 ceph-mon[92535]: pgmap v2235: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:02 smithi035 ceph-mon[92535]: pgmap v2236: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:03:58.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:04 smithi035 ceph-mon[92535]: pgmap v2237: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:06 smithi035 ceph-mon[92535]: pgmap v2238: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:08 smithi035 ceph-mon[92535]: pgmap v2239: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:10 smithi035 ceph-mon[92535]: pgmap v2240: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:10 smithi035 ceph-mon[92535]: osdmap e216: 12 total, 12 up, 12 in 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:12 smithi035 ceph-mon[92535]: pgmap v2242: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:14 smithi035 ceph-mon[92535]: pgmap v2243: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:16 smithi035 ceph-mon[92535]: pgmap v2244: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:16 smithi035 ceph-mon[92535]: osdmap e217: 12 total, 12 up, 12 in 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:17 smithi035 ceph-mon[92535]: pgmap v2246: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T10:03:58.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:19 smithi035 ceph-mon[92535]: pgmap v2247: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-17T10:04:00.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:21 smithi035 ceph-mon[92535]: pgmap v2248: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:04:00.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:24 smithi035 ceph-mon[92535]: pgmap v2249: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T10:04:00.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:26 smithi035 ceph-mon[92535]: pgmap v2250: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T10:04:00.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:28 smithi035 ceph-mon[92535]: pgmap v2251: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 877 B/s wr, 10 op/s 2023-03-17T10:04:00.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:30 smithi035 ceph-mon[92535]: pgmap v2252: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T10:04:00.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:32 smithi035 ceph-mon[92535]: pgmap v2253: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:04:00.308 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:34 smithi035 ceph-mon[92535]: pgmap v2254: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:36 smithi035 ceph-mon[92535]: pgmap v2255: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:38 smithi035 ceph-mon[92535]: pgmap v2256: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:40 smithi035 ceph-mon[92535]: pgmap v2257: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:42 smithi035 ceph-mon[92535]: pgmap v2258: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:44 smithi035 ceph-mon[92535]: pgmap v2259: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:46 smithi035 ceph-mon[92535]: pgmap v2260: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:04:01.170 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:48 smithi035 ceph-mon[92535]: pgmap v2261: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:04:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:04:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:04:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:04:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:04:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:04:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:04:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:04:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:04:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:04:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:04:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:04:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:04:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d8d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48478/0 (socket says 172.21.15.35:48478) 2023-03-17T10:04:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 -- 172.21.15.35:0/1346212907 learned_addr learned my addr 172.21.15.35:0/1346212907 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda851be700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d8d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda849bd700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d8ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 -- 172.21.15.35:0/1346212907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 msgr2=0x55ff81d8d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d8d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 -- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 msgr2=0x55ff81d8ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d8ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 -- 172.21.15.35:0/1346212907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff81b525d0 con 0x55ff81d83be0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda7ffff700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d8d410 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00f3e0 tx=0x7fda6c0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e5235ec35639db server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.828+0000 7fda5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda5ffff700 1 -- 172.21.15.35:0/1346212907 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0118b0 con 0x55ff81d83be0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda5ffff700 1 -- 172.21.15.35:0/1346212907 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fda6c011a10 con 0x55ff81d83be0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff81d4e1e0 con 0x55ff81d83be0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda5ffff700 1 -- 172.21.15.35:0/1346212907 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda6c00f410 con 0x55ff81d83be0 2023-03-17T10:04:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 10 client.18006 fetch_fsmap learned FSMap version 37 2023-03-17T10:04:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ff81ae7c00 con 0x55ff81d83be0 2023-03-17T10:04:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda5ffff700 1 -- 172.21.15.35:0/1346212907 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ff81d4e1e0 con 0x55ff81d83be0 2023-03-17T10:04:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda5ffff700 1 -- 172.21.15.35:0/1346212907 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fda6c00f690 con 0x55ff81d83be0 2023-03-17T10:04:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 10 client.18006 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:04:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 10 client.18006 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:04:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 20 client.18006 populate_metadata read hostname 'smithi035' 2023-03-17T10:04:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81decbb0 0x55ff81deefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 4 client.18006 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff81b54f00 con 0x55ff81decbb0 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.829+0000 7fda849bd700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81decbb0 0x55ff81deefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.830+0000 7fda5ffff700 10 client.18006 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.830+0000 7fda849bd700 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81decbb0 0x55ff81deefc0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a486105d292307d5 server_cookie=4e83591de89373ce in_seq=0 out_seq=0 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.837+0000 7fda5ffff700 1 -- 172.21.15.35:0/1346212907 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff81b54f00 con 0x55ff81decbb0 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda5ffff700 10 client.18006 handle_command_reply: tid=0 2023-03-17T10:04:06.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 client.18006 shutdown 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 msgr2=0x55ff81d8d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d8d410 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00f3e0 tx=0x7fda6c0096d0 comp rx=0 tx=0).stop 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 shutdown_connections 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ff81decbb0 0x55ff81deefc0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ff81d844f0 0x55ff81d8d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff81d7e960 0x55ff81d8ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda5ffff700 0 client.18006 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 --2- 172.21.15.35:0/1346212907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ff81d83be0 0x55ff81d8d410 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 >> 172.21.15.35:0/1346212907 conn(0x55ff81bdb6b0 msgr2=0x55ff81d816b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 shutdown_connections 2023-03-17T10:04:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 1 -- 172.21.15.35:0/1346212907 wait complete. 2023-03-17T10:04:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda92daeb80 20 client.18006 trim_cache size 0 max 16384 2023-03-17T10:04:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda7009f640 msgr2=0x7fda700a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.838+0000 7fda86c21700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda7009f640 0x7fda700a1af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda7400b580 tx=0x7fda74005c00 comp rx=0 tx=0).stop 2023-03-17T10:04:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 msgr2=0x7fda8019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 0x7fda8019abe0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fda7800ef30 tx=0x7fda7800c3a0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 shutdown_connections 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fda7009f640 0x7fda700a1af0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fda80104390 0x7fda8019abe0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda800ff350 0x7fda80196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 --2- 172.21.15.35:0/3142951615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda800ffcf0 0x7fda80196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 >> 172.21.15.35:0/3142951615 conn(0x7fda80076330 msgr2=0x7fda80102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 shutdown_connections 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:20.839+0000 7fda86c21700 1 -- 172.21.15.35:0/3142951615 wait complete. 2023-03-17T10:04:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 -- 172.21.15.35:0/1476961027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f377410a7a0 msgr2=0x7f377410cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 --2- 172.21.15.35:0/1476961027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f377410a7a0 0x7f377410cbc0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f376c00b0a0 tx=0x7f376c00b3b0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 -- 172.21.15.35:0/1476961027 shutdown_connections 2023-03-17T10:04:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 --2- 172.21.15.35:0/1476961027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f377410a7a0 0x7f377410cbc0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 --2- 172.21.15.35:0/1476961027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37741013d0 0x7f37741017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 --2- 172.21.15.35:0/1476961027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3774101ce0 0x7f377410a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:09.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 -- 172.21.15.35:0/1476961027 >> 172.21.15.35:0/1476961027 conn(0x7f3774076330 msgr2=0x7f3774076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:09.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 -- 172.21.15.35:0/1476961027 shutdown_connections 2023-03-17T10:04:09.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.961+0000 7f377c5b4700 1 -- 172.21.15.35:0/1476961027 wait complete. 2023-03-17T10:04:09.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 Processor -- start 2023-03-17T10:04:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 -- start start 2023-03-17T10:04:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 0x7f3774196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3774101ce0 0x7f37741968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f377410a7a0 0x7f377419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:09.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377419b360 con 0x7f37741013d0 2023-03-17T10:04:10.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377419b4d0 con 0x7f3774101ce0 2023-03-17T10:04:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377c5b4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377419b690 con 0x7f377410a7a0 2023-03-17T10:04:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377a350700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 0x7f3774196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377a350700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 0x7f3774196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48490/0 (socket says 172.21.15.35:48490) 2023-03-17T10:04:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377a350700 1 -- 172.21.15.35:0/2452877811 learned_addr learned my addr 172.21.15.35:0/2452877811 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f377ab51700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f377410a7a0 0x7f377419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.962+0000 7f3779b4f700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3774101ce0 0x7f37741968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377a350700 1 -- 172.21.15.35:0/2452877811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f377410a7a0 msgr2=0x7f377419ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377a350700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f377410a7a0 0x7f377419ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377a350700 1 -- 172.21.15.35:0/2452877811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3774101ce0 msgr2=0x7f37741968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377a350700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3774101ce0 0x7f37741968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377a350700 1 -- 172.21.15.35:0/2452877811 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009d00 con 0x7f37741013d0 2023-03-17T10:04:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377ab51700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f377410a7a0 0x7f377419ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:04:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377a350700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 0x7f3774196380 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f377000d950 tx=0x7f377000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f376b7fe700 1 -- 172.21.15.35:0/2452877811 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770009b40 con 0x7f37741013d0 2023-03-17T10:04:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f376b7fe700 1 -- 172.21.15.35:0/2452877811 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3770009ca0 con 0x7f37741013d0 2023-03-17T10:04:12.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37741100f0 con 0x7f37741013d0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f376b7fe700 1 -- 172.21.15.35:0/2452877811 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000f620 con 0x7f37741013d0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.963+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377410ff60 con 0x7f37741013d0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.965+0000 7f376b7fe700 1 -- 172.21.15.35:0/2452877811 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3770010460 con 0x7f37741013d0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.966+0000 7f376b7fe700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f376009f640 0x7f37600a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.966+0000 7f3779b4f700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f376009f640 0x7f37600a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.966+0000 7f376b7fe700 1 -- 172.21.15.35:0/2452877811 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37700ca9a0 con 0x7f37741013d0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.966+0000 7f3779b4f700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f376009f640 0x7f37600a1af0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3764005950 tx=0x7f37640058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 Processor -- start 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 -- start start 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25a9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea24b0010 con 0x560ea25a9960 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea2502950 con 0x560ea25aebe0 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f3788741b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea24fbde0 con 0x560ea25af4f0 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f377ab51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f377ab51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48502/0 (socket says 172.21.15.35:48502) 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.967+0000 7f377ab51700 1 -- 172.21.15.35:0/1708979360 learned_addr learned my addr 172.21.15.35:0/1708979360 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377a350700 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f3779b4f700 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377ab51700 1 -- 172.21.15.35:0/1708979360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 msgr2=0x560ea25a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377ab51700 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25a9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377ab51700 1 -- 172.21.15.35:0/1708979360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 msgr2=0x560ea25aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377ab51700 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377ab51700 1 -- 172.21.15.35:0/1708979360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea237d5d0 con 0x560ea25a9960 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f377ab51700 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a9d90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f376c015000 tx=0x7f376c0090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4523c13d48396026 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f3768ff9700 1 -- 172.21.15.35:0/1708979360 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c00e050 con 0x560ea25a9960 2023-03-17T10:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f3768ff9700 1 -- 172.21.15.35:0/1708979360 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f376c0074e0 con 0x560ea25a9960 2023-03-17T10:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.968+0000 7f3768ff9700 1 -- 172.21.15.35:0/1708979360 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c005460 con 0x560ea25a9960 2023-03-17T10:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 -- 172.21.15.35:0/1708979360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 msgr2=0x560ea25a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a9d90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f376c015000 tx=0x7f376c0090d0 comp rx=0 tx=0).stop 2023-03-17T10:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 -- 172.21.15.35:0/1708979360 shutdown_connections 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a9d90 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 --2- 172.21.15.35:0/1708979360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 -- 172.21.15.35:0/1708979360 >> 172.21.15.35:0/1708979360 conn(0x560ea24066b0 msgr2=0x560ea25a3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 -- 172.21.15.35:0/1708979360 shutdown_connections 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 -- 172.21.15.35:0/1708979360 wait complete. 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 -- start start 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.969+0000 7f3788741b80 1 Processor -- start 2023-03-17T10:04:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25a9960 0x560ea25b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 0x560ea25b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea237f8c0 con 0x560ea25af4f0 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25b33e0 con 0x560ea25a9960 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25bf000 con 0x560ea25aebe0 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3788741b80 10 client.0 _ll_register_callbacks cb 0x560ea23a1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 0x560ea25b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 0x560ea25b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48508/0 (socket says 172.21.15.35:48508) 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 -- 172.21.15.35:0/2912165082 learned_addr learned my addr 172.21.15.35:0/2912165082 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f3779b4f700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377a350700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25a9960 0x560ea25b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 -- 172.21.15.35:0/2912165082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 msgr2=0x560ea25b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 -- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25a9960 msgr2=0x560ea25b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25a9960 0x560ea25b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 -- 172.21.15.35:0/2912165082 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377410d880 con 0x560ea25af4f0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377a350700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25a9960 0x560ea25b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f377ab51700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 0x560ea25b2c20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f376c009850 tx=0x7f376c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18fb0af9af648ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f375dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.970+0000 7f375dffb700 1 -- 172.21.15.35:0/2912165082 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c005240 con 0x560ea25af4f0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f375dffb700 1 -- 172.21.15.35:0/2912165082 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f376c007910 con 0x560ea25af4f0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ea24be390 con 0x560ea25af4f0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f375dffb700 1 -- 172.21.15.35:0/2912165082 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f376c0053a0 con 0x560ea25af4f0 2023-03-17T10:04:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 10 client.18018 fetch_fsmap learned FSMap version 37 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560ea2329d80 con 0x560ea25af4f0 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f375dffb700 1 -- 172.21.15.35:0/2912165082 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ea24be390 con 0x560ea25af4f0 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f375dffb700 1 -- 172.21.15.35:0/2912165082 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f376c00b0d0 con 0x560ea25af4f0 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 10 client.18018 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 10 client.18018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 20 client.18018 populate_metadata read hostname 'smithi035' 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea25c2d50 0x560ea25c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 4 client.18018 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:04:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ea24ca600 con 0x560ea25c2d50 2023-03-17T10:04:21.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:50 smithi035 ceph-mon[92535]: pgmap v2262: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:04:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.971+0000 7f377a350700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea25c2d50 0x560ea25c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f375dffb700 10 client.18018 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f377a350700 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea25c2d50 0x560ea25c5160 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c0dcd86ec5fd78 server_cookie=fc5d68693f71ffff in_seq=0 out_seq=0 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f375dffb700 1 -- 172.21.15.35:0/2912165082 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560ea24ca600 con 0x560ea25c2d50 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f375dffb700 10 client.18018 handle_command_reply: tid=0 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f3788741b80 1 client.18018 shutdown 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 msgr2=0x560ea25b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.972+0000 7f3788741b80 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 0x560ea25b2c20 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f376c009850 tx=0x7f376c009520 comp rx=0 tx=0).stop 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 shutdown_connections 2023-03-17T10:04:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea25c2d50 0x560ea25c5160 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25af4f0 0x560ea25b2c20 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25a9960 0x560ea25b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f375dffb700 0 client.18018 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 --2- 172.21.15.35:0/2912165082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 >> 172.21.15.35:0/2912165082 conn(0x560ea24066b0 msgr2=0x560ea25a3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 shutdown_connections 2023-03-17T10:04:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 1 -- 172.21.15.35:0/2912165082 wait complete. 2023-03-17T10:04:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.973+0000 7f3788741b80 20 client.18018 trim_cache size 0 max 16384 2023-03-17T10:04:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 Processor -- start 2023-03-17T10:04:24.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 -- start start 2023-03-17T10:04:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:24.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25af4f0 0x560ea25b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea259f0f0 con 0x560ea25a9960 2023-03-17T10:04:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25b3200 con 0x560ea25af4f0 2023-03-17T10:04:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3788741b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25a4000 con 0x560ea25aebe0 2023-03-17T10:04:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48512/0 (socket says 172.21.15.35:48512) 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 -- 172.21.15.35:0/2645949820 learned_addr learned my addr 172.21.15.35:0/2645949820 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f3779b4f700 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377ab51700 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25af4f0 0x560ea25b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 -- 172.21.15.35:0/2645949820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 msgr2=0x560ea25affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 -- 172.21.15.35:0/2645949820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25af4f0 msgr2=0x560ea25b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25af4f0 0x560ea25b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377a350700 1 -- 172.21.15.35:0/2645949820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea25aa000 con 0x560ea25a9960 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.988+0000 7f377ab51700 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25af4f0 0x560ea25b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:04:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f377a350700 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a3ac0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3770000c00 tx=0x7f3770010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daf0ed0a930a21c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f37697fa700 1 -- 172.21.15.35:0/2645949820 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700a0640 con 0x560ea25a9960 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f37697fa700 1 -- 172.21.15.35:0/2645949820 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37700967f0 con 0x560ea25a9960 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f37697fa700 1 -- 172.21.15.35:0/2645949820 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770094b60 con 0x560ea25a9960 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 -- 172.21.15.35:0/2645949820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 msgr2=0x560ea25a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a3ac0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3770000c00 tx=0x7f3770010a00 comp rx=0 tx=0).stop 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 -- 172.21.15.35:0/2645949820 shutdown_connections 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25af4f0 0x560ea25b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25a3ac0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 --2- 172.21.15.35:0/2645949820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25aebe0 0x560ea25affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 -- 172.21.15.35:0/2645949820 >> 172.21.15.35:0/2645949820 conn(0x560ea24066b0 msgr2=0x560ea25af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 -- 172.21.15.35:0/2645949820 shutdown_connections 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.989+0000 7f3788741b80 1 -- 172.21.15.35:0/2645949820 wait complete. 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 -- start start 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 Processor -- start 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25b8640 con 0x560ea25a9960 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25b87b0 con 0x560ea25aebe0 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea25b8970 con 0x560ea25af4f0 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f3788741b80 10 client.0 _ll_register_callbacks cb 0x560ea23a1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f377a350700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f377a350700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48518/0 (socket says 172.21.15.35:48518) 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.990+0000 7f377a350700 1 -- 172.21.15.35:0/3728080993 learned_addr learned my addr 172.21.15.35:0/3728080993 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377a350700 1 -- 172.21.15.35:0/3728080993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 msgr2=0x560ea25b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377ab51700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3779b4f700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377a350700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377a350700 1 -- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 msgr2=0x560ea25b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377a350700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377a350700 1 -- 172.21.15.35:0/3728080993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377410ff60 con 0x560ea25a9960 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377ab51700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:04:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3779b4f700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f377a350700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25b99c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f37700a0110 tx=0x7f3770010b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8e60c93ab2ef05 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f375dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f375dffb700 1 -- 172.21.15.35:0/3728080993 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700986b0 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f375dffb700 1 -- 172.21.15.35:0/3728080993 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3770098810 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ea25791e0 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f375dffb700 1 -- 172.21.15.35:0/3728080993 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3770097940 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 10 client.18024 fetch_fsmap learned FSMap version 37 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560ea2312c00 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f375dffb700 1 -- 172.21.15.35:0/3728080993 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ea25791e0 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f375dffb700 1 -- 172.21.15.35:0/3728080993 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f37700a02b0 con 0x560ea25a9960 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 10 client.18024 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 10 client.18024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 20 client.18024 populate_metadata read hostname 'smithi035' 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea2617890 0x560ea2619ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 4 client.18024 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.991+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ea237ff00 con 0x560ea2617890 2023-03-17T10:04:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.992+0000 7f3779b4f700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea2617890 0x560ea2619ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.992+0000 7f3779b4f700 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea2617890 0x560ea2619ca0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2d2a4bc7b32d89b server_cookie=b3614abb2360103e in_seq=0 out_seq=0 2023-03-17T10:04:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.992+0000 7f375dffb700 10 client.18024 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:26.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.996+0000 7f375dffb700 1 -- 172.21.15.35:0/3728080993 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ea237ff00 con 0x560ea2617890 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.996+0000 7f375dffb700 10 client.18024 handle_command_reply: tid=0 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.996+0000 7f3788741b80 1 client.18024 shutdown 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 msgr2=0x560ea25b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25b99c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f37700a0110 tx=0x7f3770010b10 comp rx=0 tx=0).stop 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 shutdown_connections 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ea2617890 0x560ea2619ca0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ea25af4f0 0x560ea25b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ea25a9960 0x560ea25b99c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f375dffb700 0 client.18024 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 --2- 172.21.15.35:0/3728080993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ea25aebe0 0x560ea25b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 >> 172.21.15.35:0/3728080993 conn(0x560ea24066b0 msgr2=0x560ea25b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 shutdown_connections 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 1 -- 172.21.15.35:0/3728080993 wait complete. 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f3788741b80 20 client.18024 trim_cache size 0 max 16384 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f376009f640 msgr2=0x7f37600a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f376009f640 0x7f37600a1af0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3764005950 tx=0x7f37640058e0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 msgr2=0x7f3774196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 0x7f3774196380 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f377000d950 tx=0x7f377000dd10 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 shutdown_connections 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f376009f640 0x7f37600a1af0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f377410a7a0 0x7f377419ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37741013d0 0x7f3774196380 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 --2- 172.21.15.35:0/2452877811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3774101ce0 0x7f37741968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.997+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 >> 172.21.15.35:0/2452877811 conn(0x7f3774076330 msgr2=0x7f3774102170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.998+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 shutdown_connections 2023-03-17T10:04:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:42:33.998+0000 7f377c5b4700 1 -- 172.21.15.35:0/2452877811 wait complete. 2023-03-17T10:04:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2285714368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f28104390 msgr2=0x7f2f2810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2285714368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f28104390 0x7f2f2810bf60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000b0d0 tx=0x7f2f2000b3e0 comp rx=0 tx=0).stop 2023-03-17T10:04:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2285714368 shutdown_connections 2023-03-17T10:04:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2285714368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f28104390 0x7f2f2810bf60 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2285714368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f280ff350 0x7f2f280ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2285714368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f280ffcf0 0x7f2f28103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2285714368 >> 172.21.15.35:0/2285714368 conn(0x7f2f28076330 msgr2=0x7f2f28076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2285714368 shutdown_connections 2023-03-17T10:04:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.678+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2285714368 wait complete. 2023-03-17T10:04:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 Processor -- start 2023-03-17T10:04:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 -- start start 2023-03-17T10:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f280ff350 0x7f2f28100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 0x7f2f28101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f28104390 0x7f2f281a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28101ac0 con 0x7f2f280ffcf0 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281a4ac0 con 0x7f2f28104390 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f2d6f6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281a4c00 con 0x7f2f280ff350 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 0x7f2f28101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 0x7f2f28101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48534/0 (socket says 172.21.15.35:48534) 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f267fc700 1 -- 172.21.15.35:0/2457530712 learned_addr learned my addr 172.21.15.35:0/2457530712 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f280ff350 0x7f2f28100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.679+0000 7f2f277fe700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f28104390 0x7f2f281a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f267fc700 1 -- 172.21.15.35:0/2457530712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f280ff350 msgr2=0x7f2f28100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f267fc700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f280ff350 0x7f2f28100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f267fc700 1 -- 172.21.15.35:0/2457530712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f28104390 msgr2=0x7f2f281a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f267fc700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f28104390 0x7f2f281a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f267fc700 1 -- 172.21.15.35:0/2457530712 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009d00 con 0x7f2f280ffcf0 2023-03-17T10:04:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f267fc700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 0x7f2f28101290 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00d950 tx=0x7f2f1c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f0ffff700 1 -- 172.21.15.35:0/2457530712 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00f890 con 0x7f2f280ffcf0 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2810f010 con 0x7f2f280ffcf0 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f0ffff700 1 -- 172.21.15.35:0/2457530712 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f1c00fe80 con 0x7f2f280ffcf0 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f0ffff700 1 -- 172.21.15.35:0/2457530712 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00e3b0 con 0x7f2f280ffcf0 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.680+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2810ee80 con 0x7f2f280ffcf0 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.682+0000 7f2f0ffff700 1 -- 172.21.15.35:0/2457530712 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2f1c00f9f0 con 0x7f2f280ffcf0 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.683+0000 7f2f0ffff700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f1009f640 0x7f2f100a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.683+0000 7f2f0ffff700 1 -- 172.21.15.35:0/2457530712 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f1c0ca0a0 con 0x7f2f280ffcf0 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.683+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f1009f640 0x7f2f100a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.683+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f1009f640 0x7f2f100a1af0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f18007be0 tx=0x7f2f180073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 Processor -- start 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 -- start start 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc4646fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 0x55bbc4641420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4641d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc4548010 con 0x55bbc46474f0 2023-03-17T10:04:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc459a950 con 0x55bbc4641960 2023-03-17T10:04:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f39883b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc4593de0 con 0x55bbc4646be0 2023-03-17T10:04:34.718 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-03-17T10:04:34.720 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-03-17T10:04:35.311 DEBUG:teuthology.orchestra.run.smithi035:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4aa791bf129eece187e94ddbfa7c2b475588cf0c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-03-17T10:04:36.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:52 smithi035 ceph-mon[92535]: pgmap v2263: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:04:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 0x55bbc4641420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 0x55bbc4641420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48542/0 (socket says 172.21.15.35:48542) 2023-03-17T10:04:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f267fc700 1 -- 172.21.15.35:0/1376812094 learned_addr learned my addr 172.21.15.35:0/1376812094 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f277fe700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4641d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.684+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc4646fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:36.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f267fc700 1 -- 172.21.15.35:0/1376812094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 msgr2=0x55bbc4646fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f267fc700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc4646fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:36.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f267fc700 1 -- 172.21.15.35:0/1376812094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 msgr2=0x55bbc4641d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f267fc700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4641d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f267fc700 1 -- 172.21.15.35:0/1376812094 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc44155d0 con 0x55bbc46474f0 2023-03-17T10:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc4646fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f277fe700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4641d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f267fc700 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 0x55bbc4641420 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0945c0 tx=0x7f2f1c0974b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a81ad21051e4bb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f0d7fa700 1 -- 172.21.15.35:0/1376812094 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c09fd40 con 0x55bbc46474f0 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f0d7fa700 1 -- 172.21.15.35:0/1376812094 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f1c095ef0 con 0x55bbc46474f0 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.685+0000 7f2f0d7fa700 1 -- 172.21.15.35:0/1376812094 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c097240 con 0x55bbc46474f0 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 -- 172.21.15.35:0/1376812094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 msgr2=0x55bbc4641420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 0x55bbc4641420 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0945c0 tx=0x7f2f1c0974b0 comp rx=0 tx=0).stop 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 -- 172.21.15.35:0/1376812094 shutdown_connections 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4641d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc4646fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1376812094 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc46474f0 0x55bbc4641420 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 -- 172.21.15.35:0/1376812094 >> 172.21.15.35:0/1376812094 conn(0x55bbc449e6b0 msgr2=0x55bbc463ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 -- 172.21.15.35:0/1376812094 shutdown_connections 2023-03-17T10:04:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 -- 172.21.15.35:0/1376812094 wait complete. 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 -- start start 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.686+0000 7f2f39883b80 1 Processor -- start 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc464d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4646be0 0x55bbc464a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc464ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc44178c0 con 0x55bbc4641960 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc464b550 con 0x55bbc4646be0 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc4656fa0 con 0x55bbc46474f0 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc464d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f39883b80 10 client.0 _ll_register_callbacks cb 0x55bbc4439230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc464d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48546/0 (socket says 172.21.15.35:48546) 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 -- 172.21.15.35:0/2910391058 learned_addr learned my addr 172.21.15.35:0/2910391058 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f267fc700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4646be0 0x55bbc464a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f277fe700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc464ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 -- 172.21.15.35:0/2910391058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 msgr2=0x55bbc464ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc464ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 -- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4646be0 msgr2=0x55bbc464a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4646be0 0x55bbc464a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 -- 172.21.15.35:0/2910391058 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2810ee80 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc464d470 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2f18004030 tx=0x7f2f180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdccfd48c303c58 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.687+0000 7f2f0aff5700 1 -- 172.21.15.35:0/2910391058 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18003c40 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f0aff5700 1 -- 172.21.15.35:0/2910391058 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f18017070 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbc4556390 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f0aff5700 1 -- 172.21.15.35:0/2910391058 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f18003da0 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 10 client.18036 fetch_fsmap learned FSMap version 37 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bbc43c1d80 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f0aff5700 1 -- 172.21.15.35:0/2910391058 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bbc4556390 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f0aff5700 1 -- 172.21.15.35:0/2910391058 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2f1801f400 con 0x55bbc4641960 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 10 client.18036 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:04:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 10 client.18036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 20 client.18036 populate_metadata read hostname 'smithi035' 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc465b030 0x55bbc465d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 4 client.18036 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbc4562600 con 0x55bbc465b030 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.688+0000 7f2f267fc700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc465b030 0x55bbc465d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.689+0000 7f2f0aff5700 10 client.18036 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.689+0000 7f2f267fc700 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc465b030 0x55bbc465d440 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703da3c77ca2298b server_cookie=c1c40f44d67fce8b in_seq=0 out_seq=0 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.689+0000 7f2f0aff5700 1 -- 172.21.15.35:0/2910391058 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55bbc4562600 con 0x55bbc465b030 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.689+0000 7f2f0aff5700 10 client.18036 handle_command_reply: tid=0 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 client.18036 shutdown 2023-03-17T10:04:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 msgr2=0x55bbc464d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc464d470 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2f18004030 tx=0x7f2f180047c0 comp rx=0 tx=0).stop 2023-03-17T10:04:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 shutdown_connections 2023-03-17T10:04:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc465b030 0x55bbc465d440 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc464ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f0aff5700 0 client.18036 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc464d470 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 --2- 172.21.15.35:0/2910391058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4646be0 0x55bbc464a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 >> 172.21.15.35:0/2910391058 conn(0x55bbc449e6b0 msgr2=0x55bbc4640410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 shutdown_connections 2023-03-17T10:04:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 1 -- 172.21.15.35:0/2910391058 wait complete. 2023-03-17T10:04:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.690+0000 7f2f39883b80 20 client.18036 trim_cache size 0 max 16384 2023-03-17T10:04:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 Processor -- start 2023-03-17T10:04:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 -- start start 2023-03-17T10:04:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc4651ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:47.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc464d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc46474f0 0x55bbc46446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc46370f0 con 0x55bbc4641960 2023-03-17T10:04:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc4658740 con 0x55bbc46474f0 2023-03-17T10:04:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f39883b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc463c380 con 0x55bbc4646be0 2023-03-17T10:04:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc4651ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc4651ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48554/0 (socket says 172.21.15.35:48554) 2023-03-17T10:04:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f26ffd700 1 -- 172.21.15.35:0/1106295800 learned_addr learned my addr 172.21.15.35:0/1106295800 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f277fe700 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc46474f0 0x55bbc46446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f26ffd700 1 -- 172.21.15.35:0/1106295800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 msgr2=0x55bbc464d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.705+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc464d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f26ffd700 1 -- 172.21.15.35:0/1106295800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc46474f0 msgr2=0x55bbc46446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:51.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc46474f0 0x55bbc46446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:51.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f26ffd700 1 -- 172.21.15.35:0/1106295800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc455a130 con 0x55bbc4641960 2023-03-17T10:04:51.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f277fe700 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc46474f0 0x55bbc46446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:04:51.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc4651ef0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2f1802d040 tx=0x7f2f18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6c1127f806cb32 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:51.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f0dffb700 1 -- 172.21.15.35:0/1106295800 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1801f980 con 0x55bbc4641960 2023-03-17T10:04:51.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f0dffb700 1 -- 172.21.15.35:0/1106295800 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f1801fae0 con 0x55bbc4641960 2023-03-17T10:04:51.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f0dffb700 1 -- 172.21.15.35:0/1106295800 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18011b10 con 0x55bbc4641960 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 -- 172.21.15.35:0/1106295800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 msgr2=0x55bbc4651ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc4651ef0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2f1802d040 tx=0x7f2f18005880 comp rx=0 tx=0).stop 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 -- 172.21.15.35:0/1106295800 shutdown_connections 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc46474f0 0x55bbc46446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4641960 0x55bbc4651ef0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 --2- 172.21.15.35:0/1106295800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc4646be0 0x55bbc464d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 -- 172.21.15.35:0/1106295800 >> 172.21.15.35:0/1106295800 conn(0x55bbc449e6b0 msgr2=0x55bbc4640410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.706+0000 7f2f39883b80 1 -- 172.21.15.35:0/1106295800 shutdown_connections 2023-03-17T10:04:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 -- 172.21.15.35:0/1106295800 wait complete. 2023-03-17T10:04:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 -- start start 2023-03-17T10:04:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 Processor -- start 2023-03-17T10:04:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4651f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 0x55bbc4650320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc4650860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc4650fa0 con 0x55bbc4646be0 2023-03-17T10:04:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc4651110 con 0x55bbc4641960 2023-03-17T10:04:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc46aeee0 con 0x55bbc46474f0 2023-03-17T10:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f39883b80 10 client.0 _ll_register_callbacks cb 0x55bbc4439230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 0x55bbc4650320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 0x55bbc4650320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48562/0 (socket says 172.21.15.35:48562) 2023-03-17T10:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 -- 172.21.15.35:0/4060465081 learned_addr learned my addr 172.21.15.35:0/4060465081 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:04:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4651f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 -- 172.21.15.35:0/4060465081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 msgr2=0x55bbc4650860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc4650860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 -- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 msgr2=0x55bbc4651f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.707+0000 7f2f267fc700 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4651f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f267fc700 1 -- 172.21.15.35:0/4060465081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbc43c1d80 con 0x55bbc4646be0 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f267fc700 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 0x55bbc4650320 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0945c0 tx=0x7f2f1c097cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cedd7ed525c2bf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f0aff5700 1 -- 172.21.15.35:0/4060465081 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c09fd40 con 0x55bbc4646be0 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f0aff5700 1 -- 172.21.15.35:0/4060465081 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f1c097040 con 0x55bbc4646be0 2023-03-17T10:04:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbc46111e0 con 0x55bbc4646be0 2023-03-17T10:04:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f0aff5700 1 -- 172.21.15.35:0/4060465081 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f1c097200 con 0x55bbc4646be0 2023-03-17T10:04:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 10 client.18042 fetch_fsmap learned FSMap version 37 2023-03-17T10:04:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bbc43e81f0 con 0x55bbc4646be0 2023-03-17T10:04:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f0aff5700 1 -- 172.21.15.35:0/4060465081 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bbc46111e0 con 0x55bbc4646be0 2023-03-17T10:04:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f0aff5700 1 -- 172.21.15.35:0/4060465081 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2f1c0c1cd0 con 0x55bbc4646be0 2023-03-17T10:04:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 10 client.18042 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:04:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 10 client.18042 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:04:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 20 client.18042 populate_metadata read hostname 'smithi035' 2023-03-17T10:04:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc46b0190 0x55bbc46b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 4 client.18042 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.708+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bbc4417f00 con 0x55bbc46b0190 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.709+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc46b0190 0x55bbc46b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.709+0000 7f2f0aff5700 10 client.18042 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.709+0000 7f2f26ffd700 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc46b0190 0x55bbc46b25a0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f65b0b3ccd154578 server_cookie=4969eeb8edc8fe61 in_seq=0 out_seq=0 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f0aff5700 1 -- 172.21.15.35:0/4060465081 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bbc4417f00 con 0x55bbc46b0190 2023-03-17T10:04:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f0aff5700 10 client.18042 handle_command_reply: tid=0 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f39883b80 1 client.18042 shutdown 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 msgr2=0x55bbc4650320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f39883b80 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 0x55bbc4650320 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0945c0 tx=0x7f2f1c097cd0 comp rx=0 tx=0).stop 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 shutdown_connections 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.717+0000 7f2f39883b80 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbc46b0190 0x55bbc46b25a0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbc46474f0 0x55bbc4650860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbc4641960 0x55bbc4651f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f0aff5700 0 client.18042 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:04:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 1 --2- 172.21.15.35:0/4060465081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbc4646be0 0x55bbc4650320 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 >> 172.21.15.35:0/4060465081 conn(0x55bbc449e6b0 msgr2=0x55bbc46446b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:04:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 shutdown_connections 2023-03-17T10:04:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 1 -- 172.21.15.35:0/4060465081 wait complete. 2023-03-17T10:04:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f39883b80 20 client.18042 trim_cache size 0 max 16384 2023-03-17T10:04:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f1009f640 msgr2=0x7f2f100a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f1009f640 0x7f2f100a1af0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f18007be0 tx=0x7f2f180073d0 comp rx=0 tx=0).stop 2023-03-17T10:04:58.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:54 smithi035 ceph-mon[92535]: pgmap v2264: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:04:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 msgr2=0x7f2f28101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:04:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 0x7f2f28101290 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00d950 tx=0x7f2f1c00dc60 comp rx=0 tx=0).stop 2023-03-17T10:04:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 shutdown_connections 2023-03-17T10:04:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f1009f640 0x7f2f100a1af0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f28104390 0x7f2f281a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:04:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f280ff350 0x7f2f28100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 --2- 172.21.15.35:0/2457530712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f280ffcf0 0x7f2f28101290 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 >> 172.21.15.35:0/2457530712 conn(0x7f2f28076330 msgr2=0x7f2f28067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 shutdown_connections 2023-03-17T10:05:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:43:49.718+0000 7f2f2d6f6700 1 -- 172.21.15.35:0/2457530712 wait complete. 2023-03-17T10:05:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 -- 172.21.15.35:0/3248822070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 msgr2=0x7f75780ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 --2- 172.21.15.35:0/3248822070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f75780ff720 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f756c0099c0 tx=0x7f756c009cd0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 -- 172.21.15.35:0/3248822070 shutdown_connections 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 --2- 172.21.15.35:0/3248822070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7578104390 0x7f757810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 --2- 172.21.15.35:0/3248822070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f75780ff720 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 --2- 172.21.15.35:0/3248822070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75780ffcf0 0x7f7578103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 -- 172.21.15.35:0/3248822070 >> 172.21.15.35:0/3248822070 conn(0x7f7578076330 msgr2=0x7f7578076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 -- 172.21.15.35:0/3248822070 shutdown_connections 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.839+0000 7f757cbe0700 1 -- 172.21.15.35:0/3248822070 wait complete. 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.840+0000 7f757cbe0700 1 Processor -- start 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.840+0000 7f757cbe0700 1 -- start start 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f7578196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75780ffcf0 0x7f7578196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7578104390 0x7f757819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757819b230 con 0x7f75780ff350 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757819b3a0 con 0x7f7578104390 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757819b560 con 0x7f75780ffcf0 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f7578196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f7578196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48574/0 (socket says 172.21.15.35:48574) 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 -- 172.21.15.35:0/860349753 learned_addr learned my addr 172.21.15.35:0/860349753 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f7576d9d700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7578104390 0x7f757819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f7575d9b700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75780ffcf0 0x7f7578196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 -- 172.21.15.35:0/860349753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75780ffcf0 msgr2=0x7f7578196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75780ffcf0 0x7f7578196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 -- 172.21.15.35:0/860349753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7578104390 msgr2=0x7f757819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7578104390 0x7f757819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 -- 172.21.15.35:0/860349753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0095f0 con 0x7f75780ff350 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757659c700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f7578196250 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f756c005910 tx=0x7f756c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f75677fe700 1 -- 172.21.15.35:0/860349753 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c01d070 con 0x7f75780ff350 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757810f050 con 0x7f75780ff350 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f75677fe700 1 -- 172.21.15.35:0/860349753 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f756c005050 con 0x7f75780ff350 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.841+0000 7f75677fe700 1 -- 172.21.15.35:0/860349753 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c004a00 con 0x7f75780ff350 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.842+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757810eec0 con 0x7f75780ff350 2023-03-17T10:05:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.844+0000 7f75677fe700 1 -- 172.21.15.35:0/860349753 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f756c0051c0 con 0x7f75780ff350 2023-03-17T10:05:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.844+0000 7f75677fe700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f756009f6c0 0x7f75600a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.845+0000 7f7575d9b700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f756009f6c0 0x7f75600a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.845+0000 7f75677fe700 1 -- 172.21.15.35:0/860349753 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f756c0cb430 con 0x7f75780ff350 2023-03-17T10:05:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.845+0000 7f7575d9b700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f756009f6c0 0x7f75600a1b70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7578197860 tx=0x7f7568009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.845+0000 7f7588d6db80 1 Processor -- start 2023-03-17T10:05:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 -- start start 2023-03-17T10:05:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8667be0 0x55f0b8667fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b8662420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b8569010 con 0x55f0b8662960 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b85bb950 con 0x55f0b86684f0 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7588d6db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b85b4de0 con 0x55f0b8667be0 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48586/0 (socket says 172.21.15.35:48586) 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 -- 172.21.15.35:0/4149346047 learned_addr learned my addr 172.21.15.35:0/4149346047 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f757659c700 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8667be0 0x55f0b8667fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7575d9b700 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b8662420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 -- 172.21.15.35:0/4149346047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8667be0 msgr2=0x55f0b8667fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8667be0 0x55f0b8667fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 -- 172.21.15.35:0/4149346047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 msgr2=0x55f0b8662420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b8662420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.846+0000 7f7576d9d700 1 -- 172.21.15.35:0/4149346047 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0b84365d0 con 0x55f0b8662960 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.847+0000 7f7576d9d700 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662d90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f757000f410 tx=0x7f757000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01abd9916c2db0e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.847+0000 7f7564ff9700 1 -- 172.21.15.35:0/4149346047 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570004bb0 con 0x55f0b8662960 2023-03-17T10:05:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.847+0000 7f7564ff9700 1 -- 172.21.15.35:0/4149346047 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7570004d10 con 0x55f0b8662960 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.847+0000 7f7564ff9700 1 -- 172.21.15.35:0/4149346047 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570005020 con 0x55f0b8662960 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.847+0000 7f7588d6db80 1 -- 172.21.15.35:0/4149346047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 msgr2=0x55f0b8662d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.847+0000 7f7588d6db80 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662d90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f757000f410 tx=0x7f757000f720 comp rx=0 tx=0).stop 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- 172.21.15.35:0/4149346047 shutdown_connections 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662d90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8667be0 0x55f0b8667fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 --2- 172.21.15.35:0/4149346047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b8662420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- 172.21.15.35:0/4149346047 >> 172.21.15.35:0/4149346047 conn(0x55f0b84bf6b0 msgr2=0x55f0b865ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- 172.21.15.35:0/4149346047 shutdown_connections 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- 172.21.15.35:0/4149346047 wait complete. 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- start start 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 Processor -- start 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8662960 0x55f0b866e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b866bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:04.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b84388c0 con 0x55f0b8667be0 2023-03-17T10:05:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b866c320 con 0x55f0b8662960 2023-03-17T10:05:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.848+0000 7f7588d6db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b866c4e0 con 0x55f0b86684f0 2023-03-17T10:05:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7588d6db80 10 client.0 _ll_register_callbacks cb 0x55f0b845a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:05:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7575d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7575d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48590/0 (socket says 172.21.15.35:48590) 2023-03-17T10:05:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7575d9b700 1 -- 172.21.15.35:0/972563628 learned_addr learned my addr 172.21.15.35:0/972563628 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b866bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f757659c700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8662960 0x55f0b866e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 -- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8662960 msgr2=0x55f0b866e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8662960 0x55f0b866e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 -- 172.21.15.35:0/972563628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 msgr2=0x55f0b866b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 -- 172.21.15.35:0/972563628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7570007e50 con 0x55f0b86684f0 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7575d9b700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f757659c700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8662960 0x55f0b866e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f7576d9d700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b866bbe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7570007df0 tx=0x7f7570003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de991c5d31c98059 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.849+0000 7f755dffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.851+0000 7f755dffb700 1 -- 172.21.15.35:0/972563628 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570003e80 con 0x55f0b86684f0 2023-03-17T10:05:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.851+0000 7f755dffb700 1 -- 172.21.15.35:0/972563628 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7570014470 con 0x55f0b86684f0 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.851+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0b8577390 con 0x55f0b86684f0 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.851+0000 7f755dffb700 1 -- 172.21.15.35:0/972563628 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7570014650 con 0x55f0b86684f0 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.851+0000 7f7588d6db80 10 client.27445 fetch_fsmap learned FSMap version 37 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.851+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55f0b83e2d80 con 0x55f0b86684f0 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f755dffb700 1 -- 172.21.15.35:0/972563628 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0b8577390 con 0x55f0b86684f0 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f755dffb700 1 -- 172.21.15.35:0/972563628 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7570023070 con 0x55f0b86684f0 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f7588d6db80 10 client.27445 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f7588d6db80 10 client.27445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f7588d6db80 20 client.27445 populate_metadata read hostname 'smithi035' 2023-03-17T10:05:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f7588d6db80 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b867bf80 0x55f0b867e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f7588d6db80 4 client.27445 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0b8583600 con 0x55f0b867bf80 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f757659c700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b867bf80 0x55f0b867e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f757659c700 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b867bf80 0x55f0b867e390 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d661df3f0d8b319a server_cookie=e656cc1e7f8e5ab9 in_seq=0 out_seq=0 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.852+0000 7f755dffb700 10 client.27445 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f755dffb700 1 -- 172.21.15.35:0/972563628 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f0b8583600 con 0x55f0b867bf80 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f755dffb700 10 client.27445 handle_command_reply: tid=0 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 client.27445 shutdown 2023-03-17T10:05:11.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 msgr2=0x55f0b866bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b866bbe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7570007df0 tx=0x7f7570003a00 comp rx=0 tx=0).stop 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 shutdown_connections 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b867bf80 0x55f0b867e390 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b866bbe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8662960 0x55f0b866e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 --2- 172.21.15.35:0/972563628 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f755dffb700 0 client.27445 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 >> 172.21.15.35:0/972563628 conn(0x55f0b84bf6b0 msgr2=0x55f0b865ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.853+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 shutdown_connections 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.854+0000 7f7588d6db80 1 -- 172.21.15.35:0/972563628 wait complete. 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.854+0000 7f7588d6db80 20 client.27445 trim_cache size 0 max 16384 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 Processor -- start 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 -- start start 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8667be0 0x55f0b865cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b8672f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b8577390 con 0x55f0b8662960 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b86580f0 con 0x55f0b8667be0 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7588d6db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b865d000 con 0x55f0b86684f0 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48596/0 (socket says 172.21.15.35:48596) 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 -- 172.21.15.35:0/1529188390 learned_addr learned my addr 172.21.15.35:0/1529188390 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 -- 172.21.15.35:0/1529188390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 msgr2=0x55f0b8672f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b8672f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 -- 172.21.15.35:0/1529188390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8667be0 msgr2=0x55f0b865cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f7575d9b700 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8667be0 0x55f0b865cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8667be0 0x55f0b865cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 -- 172.21.15.35:0/1529188390 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0b857b130 con 0x55f0b8662960 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.869+0000 7f757659c700 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662420 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f756c098ea0 tx=0x7f756c098d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c752474a3846d655 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f75657fa700 1 -- 172.21.15.35:0/1529188390 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c0c8de0 con 0x55f0b8662960 2023-03-17T10:05:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f75657fa700 1 -- 172.21.15.35:0/1529188390 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f756c0c8f40 con 0x55f0b8662960 2023-03-17T10:05:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f75657fa700 1 -- 172.21.15.35:0/1529188390 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c098620 con 0x55f0b8662960 2023-03-17T10:05:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 -- 172.21.15.35:0/1529188390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 msgr2=0x55f0b8662420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662420 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f756c098ea0 tx=0x7f756c098d90 comp rx=0 tx=0).stop 2023-03-17T10:05:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 -- 172.21.15.35:0/1529188390 shutdown_connections 2023-03-17T10:05:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b86684f0 0x55f0b8672f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8662960 0x55f0b8662420 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:56 smithi035 ceph-mon[92535]: pgmap v2265: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:55:58 smithi035 ceph-mon[92535]: pgmap v2266: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:00 smithi035 ceph-mon[92535]: pgmap v2267: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:02 smithi035 ceph-mon[92535]: pgmap v2268: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-mon[92535]: pgmap v2269: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-mon[92535]: pgmap v2270: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:05 smithi035 ceph-mon[92535]: pgmap v2271: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:05 smithi035 ceph-mon[92535]: osdmap e218: 12 total, 12 up, 12 in 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:07 smithi035 ceph-mon[92535]: pgmap v2273: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:09 smithi035 ceph-mon[92535]: pgmap v2274: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 79 KiB/s wr, 40 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:10 smithi035 ceph-mon[92535]: pgmap v2275: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-17T10:05:16.127 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:12 smithi035 ceph-mon[92535]: osdmap e219: 12 total, 12 up, 12 in 2023-03-17T10:05:16.128 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:13 smithi035 ceph-mon[92535]: pgmap v2277: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2023-03-17T10:05:16.128 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: *** Caught signal (Segmentation fault) ** 2023-03-17T10:05:20.031 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: in thread 7f30be9fd700 thread_name:md_log_replay 2023-03-17T10:05:20.031 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:05:20.031 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f30cf5a7cf0] 2023-03-17T10:05:20.031 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55c5b01ed71f] 2023-03-17T10:05:20.031 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c5b01ef953] 2023-03-17T10:05:20.031 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 4: (MDLog::_replay_thread()+0x66d) [0x55c5b025b07d] 2023-03-17T10:05:21.943 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c5aff0ed91] 2023-03-17T10:05:21.943 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f30cf59d1ca] 2023-03-17T10:05:21.943 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 7: clone() 2023-03-17T10:05:23.518 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T09:56:03.330+0000 7f30be9fd700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:05:23.518 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: in thread 7f30be9fd700 thread_name:md_log_replay 2023-03-17T10:05:23.518 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T10:05:23.518 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:05:23.518 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f30cf5a7cf0] 2023-03-17T10:05:23.519 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55c5b01ed71f] 2023-03-17T10:05:24.873 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c5b01ef953] 2023-03-17T10:05:24.873 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 4: (MDLog::_replay_thread()+0x66d) [0x55c5b025b07d] 2023-03-17T10:05:24.873 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c5aff0ed91] 2023-03-17T10:05:24.873 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f30cf59d1ca] 2023-03-17T10:05:24.873 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 7: clone() 2023-03-17T10:05:24.873 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:05:26.459 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T10:05:26.459 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 0> 2023-03-17T09:56:03.330+0000 7f30be9fd700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:05:26.459 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: in thread 7f30be9fd700 thread_name:md_log_replay 2023-03-17T10:05:26.459 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T10:05:27.414 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:05:27.414 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f30cf5a7cf0] 2023-03-17T10:05:27.414 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55c5b01ed71f] 2023-03-17T10:05:29.322 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c5b01ef953] 2023-03-17T10:05:29.322 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 4: (MDLog::_replay_thread()+0x66d) [0x55c5b025b07d] 2023-03-17T10:05:29.322 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c5aff0ed91] 2023-03-17T10:05:29.322 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f30cf59d1ca] 2023-03-17T10:05:29.322 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 7: clone() 2023-03-17T10:05:30.176 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:05:30.176 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T10:05:32.158 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 0> 2023-03-17T09:56:03.330+0000 7f30be9fd700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:05:32.158 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: in thread 7f30be9fd700 thread_name:md_log_replay 2023-03-17T10:05:32.158 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f30cf5a7cf0] 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55c5b01ed71f] 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c5b01ef953] 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 4: (MDLog::_replay_thread()+0x66d) [0x55c5b025b07d] 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c5aff0ed91] 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f30cf59d1ca] 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 7: clone() 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[174182]: 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T10:05:32.159 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:03 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T10:05:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:05:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:05:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:05:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:05:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 --2- 172.21.15.35:0/1529188390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b8667be0 0x55f0b865cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 -- 172.21.15.35:0/1529188390 >> 172.21.15.35:0/1529188390 conn(0x55f0b84bf6b0 msgr2=0x55f0b86688c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 -- 172.21.15.35:0/1529188390 shutdown_connections 2023-03-17T10:05:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.870+0000 7f7588d6db80 1 -- 172.21.15.35:0/1529188390 wait complete. 2023-03-17T10:05:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 -- start start 2023-03-17T10:05:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 Processor -- start 2023-03-17T10:05:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8662960 0x55f0b866ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b86cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b866fda0 con 0x55f0b8667be0 2023-03-17T10:05:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b86cf310 con 0x55f0b86684f0 2023-03-17T10:05:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0b86cf450 con 0x55f0b8662960 2023-03-17T10:05:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7588d6db80 10 client.0 _ll_register_callbacks cb 0x55f0b845a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:05:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48604/0 (socket says 172.21.15.35:48604) 2023-03-17T10:05:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 -- 172.21.15.35:0/3316529984 learned_addr learned my addr 172.21.15.35:0/3316529984 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:36.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f757659c700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8662960 0x55f0b866ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:36.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7576d9d700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b86cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:36.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 -- 172.21.15.35:0/3316529984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8662960 msgr2=0x55f0b866ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:36.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8662960 0x55f0b866ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:36.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 -- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 msgr2=0x55f0b86cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b86cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.871+0000 7f7575d9b700 1 -- 172.21.15.35:0/3316529984 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757810eec0 con 0x55f0b8667be0 2023-03-17T10:05:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7575d9b700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866f460 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f756801fc20 tx=0x7f75680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9455c76ec6160d0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f755dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:05:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f755dffb700 1 -- 172.21.15.35:0/3316529984 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568024070 con 0x55f0b8667be0 2023-03-17T10:05:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0b86321e0 con 0x55f0b8667be0 2023-03-17T10:05:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f755dffb700 1 -- 172.21.15.35:0/3316529984 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7568004050 con 0x55f0b8667be0 2023-03-17T10:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f755dffb700 1 -- 172.21.15.35:0/3316529984 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7568004210 con 0x55f0b8667be0 2023-03-17T10:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 10 client.18060 fetch_fsmap learned FSMap version 37 2023-03-17T10:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55f0b84091f0 con 0x55f0b8667be0 2023-03-17T10:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f755dffb700 1 -- 172.21.15.35:0/3316529984 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0b86321e0 con 0x55f0b8667be0 2023-03-17T10:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f755dffb700 1 -- 172.21.15.35:0/3316529984 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f75680036a0 con 0x55f0b8667be0 2023-03-17T10:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 10 client.18060 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 10 client.18060 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 20 client.18060 populate_metadata read hostname 'smithi035' 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b86d0bc0 0x55f0b86d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 4 client.18060 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.872+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f0b8438f00 con 0x55f0b86d0bc0 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.873+0000 7f757659c700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b86d0bc0 0x55f0b86d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.873+0000 7f755dffb700 10 client.18060 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:02.873+0000 7f757659c700 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b86d0bc0 0x55f0b86d2fd0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=447fa7da1fcc5fe0 server_cookie=2c82dac1d3c53309 in_seq=0 out_seq=0 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f755dffb700 1 -- 172.21.15.35:0/3316529984 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f0b8438f00 con 0x55f0b86d0bc0 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f755dffb700 10 client.18060 handle_command_reply: tid=0 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 client.18060 shutdown 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 msgr2=0x55f0b866f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866f460 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f756801fc20 tx=0x7f75680047c0 comp rx=0 tx=0).stop 2023-03-17T10:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 shutdown_connections 2023-03-17T10:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0b86d0bc0 0x55f0b86d2fd0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0b86684f0 0x55f0b86cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f755dffb700 0 client.18060 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0b8662960 0x55f0b866ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 --2- 172.21.15.35:0/3316529984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0b8667be0 0x55f0b866f460 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 >> 172.21.15.35:0/3316529984 conn(0x55f0b84bf6b0 msgr2=0x55f0b8669150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 shutdown_connections 2023-03-17T10:05:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.281+0000 7f7588d6db80 1 -- 172.21.15.35:0/3316529984 wait complete. 2023-03-17T10:05:39.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f7588d6db80 20 client.18060 trim_cache size 0 max 16384 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f756009f6c0 msgr2=0x7f75600a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f756009f6c0 0x7f75600a1b70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7578197860 tx=0x7f7568009260 comp rx=0 tx=0).stop 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 msgr2=0x7f7578196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f7578196250 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f756c005910 tx=0x7f756c00f690 comp rx=0 tx=0).stop 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 shutdown_connections 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f756009f6c0 0x7f75600a1b70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7578104390 0x7f757819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f75780ff350 0x7f7578196250 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 --2- 172.21.15.35:0/860349753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75780ffcf0 0x7f7578196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 >> 172.21.15.35:0/860349753 conn(0x7f7578076330 msgr2=0x7f7578068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 shutdown_connections 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:03.282+0000 7f757cbe0700 1 -- 172.21.15.35:0/860349753 wait complete. 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 -- 172.21.15.35:0/2620024777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe8101270 msgr2=0x7f5fe8101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/2620024777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe8101270 0x7f5fe8101640 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009990 tx=0x7f5fd8009ca0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 -- 172.21.15.35:0/2620024777 shutdown_connections 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/2620024777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fe810a790 0x7f5fe810cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/2620024777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe8101270 0x7f5fe8101640 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/2620024777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101b80 0x7f5fe810a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:40.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 -- 172.21.15.35:0/2620024777 >> 172.21.15.35:0/2620024777 conn(0x7f5fe8076330 msgr2=0x7f5fe8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 -- 172.21.15.35:0/2620024777 shutdown_connections 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 -- 172.21.15.35:0/2620024777 wait complete. 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.406+0000 7f5fee4aa700 1 Processor -- start 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 -- start start 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101270 0x7f5fe80ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fe8101b80 0x7f5fe80ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 0x7f5fe81a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80ffe10 con 0x7f5fe810a790 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81a4950 con 0x7f5fe8101270 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fee4aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81a4a90 con 0x7f5fe8101b80 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 0x7f5fe81a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 0x7f5fe81a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48620/0 (socket says 172.21.15.35:48620) 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 -- 172.21.15.35:0/1491148069 learned_addr learned my addr 172.21.15.35:0/1491148069 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fe8101b80 0x7f5fe80ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101270 0x7f5fe80ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 -- 172.21.15.35:0/1491148069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fe8101b80 msgr2=0x7f5fe80ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fe8101b80 0x7f5fe80ff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 -- 172.21.15.35:0/1491148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101270 msgr2=0x7f5fe80ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101270 0x7f5fe80ff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5feca47700 1 -- 172.21.15.35:0/1491148069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80095f0 con 0x7f5fe810a790 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.407+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101270 0x7f5fe80ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.408+0000 7f5feca47700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 0x7f5fe81a4410 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0007ee0 tx=0x7f5fe000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.408+0000 7f5fe57fa700 1 -- 172.21.15.35:0/1491148069 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0017070 con 0x7f5fe810a790 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.408+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe81100b0 con 0x7f5fe810a790 2023-03-17T10:05:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.408+0000 7f5fe57fa700 1 -- 172.21.15.35:0/1491148069 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fe000f040 con 0x7f5fe810a790 2023-03-17T10:05:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.408+0000 7f5fe57fa700 1 -- 172.21.15.35:0/1491148069 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0005710 con 0x7f5fe810a790 2023-03-17T10:05:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.408+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe810ff20 con 0x7f5fe810a790 2023-03-17T10:05:42.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.410+0000 7f5fe57fa700 1 -- 172.21.15.35:0/1491148069 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5fe0005870 con 0x7f5fe810a790 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.411+0000 7f5fe57fa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5fd009f640 0x7f5fd00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.411+0000 7f5fe57fa700 1 -- 172.21.15.35:0/1491148069 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5fe00c9e60 con 0x7f5fe810a790 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.411+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5fd009f640 0x7f5fd00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.411+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5fd009f640 0x7f5fd00a1af0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8006010 tx=0x7f5fd8005940 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.411+0000 7f5ffa637b80 1 Processor -- start 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 -- start start 2023-03-17T10:05:42.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a213dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 0x5644a2138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a2138960 0x5644a2138d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a203f010 con 0x5644a213e4f0 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a2091950 con 0x5644a2138960 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a208ade0 con 0x5644a213dbe0 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 0x5644a2138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 0x5644a2138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48626/0 (socket says 172.21.15.35:48626) 2023-03-17T10:05:42.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 -- 172.21.15.35:0/733770001 learned_addr learned my addr 172.21.15.35:0/733770001 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:42.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a213dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 -- 172.21.15.35:0/733770001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 msgr2=0x5644a213dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a213dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5feca47700 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a2138960 0x5644a2138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 -- 172.21.15.35:0/733770001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a2138960 msgr2=0x5644a2138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a2138960 0x5644a2138d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 -- 172.21.15.35:0/733770001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a1f0c5d0 con 0x5644a213e4f0 2023-03-17T10:05:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5feca47700 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a2138960 0x5644a2138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.412+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 0x5644a2138420 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009d20 tx=0x7f5fdc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd69fb649c4fde6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5fce7fc700 1 -- 172.21.15.35:0/733770001 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc019630 con 0x5644a213e4f0 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5fce7fc700 1 -- 172.21.15.35:0/733770001 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fdc019c20 con 0x5644a213e4f0 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5fce7fc700 1 -- 172.21.15.35:0/733770001 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc00eab0 con 0x5644a213e4f0 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 -- 172.21.15.35:0/733770001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 msgr2=0x5644a2138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 0x5644a2138420 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009d20 tx=0x7f5fdc011720 comp rx=0 tx=0).stop 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 -- 172.21.15.35:0/733770001 shutdown_connections 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a2138960 0x5644a2138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a213dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/733770001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a213e4f0 0x5644a2138420 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 -- 172.21.15.35:0/733770001 >> 172.21.15.35:0/733770001 conn(0x5644a1f956b0 msgr2=0x5644a2132a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 -- 172.21.15.35:0/733770001 shutdown_connections 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.413+0000 7f5ffa637b80 1 -- 172.21.15.35:0/733770001 wait complete. 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 -- start start 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 Processor -- start 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2141720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a2141d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a1f0e8c0 con 0x5644a2138960 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a21424a0 con 0x5644a213e4f0 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a214e030 con 0x5644a213dbe0 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5ffa637b80 10 client.0 _ll_register_callbacks cb 0x5644a1f30230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.414+0000 7f5fe7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48630/0 (socket says 172.21.15.35:48630) 2023-03-17T10:05:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 -- 172.21.15.35:0/525335152 learned_addr learned my addr 172.21.15.35:0/525335152 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5feca47700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a2141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 -- 172.21.15.35:0/525335152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 msgr2=0x5644a2141720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2141720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 -- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 msgr2=0x5644a2141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a2141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 -- 172.21.15.35:0/525335152 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc009980 con 0x5644a2138960 2023-03-17T10:05:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5feca47700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a2141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:05:43.206 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:13 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T10:05:44.413 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:13 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 3. 2023-03-17T10:05:44.413 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:13 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:05:44.413 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:13 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T10:05:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2144430 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000c00 tx=0x7f5fd801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fe2f6601bb3fbf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fc77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:05:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fc77fe700 1 -- 172.21.15.35:0/525335152 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8034070 con 0x5644a2138960 2023-03-17T10:05:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fc77fe700 1 -- 172.21.15.35:0/525335152 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(194..194 src has 1..194) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5fd8005020 con 0x5644a2138960 2023-03-17T10:05:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644a204d390 con 0x5644a2138960 2023-03-17T10:05:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5fc77fe700 1 -- 172.21.15.35:0/525335152 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fd802b050 con 0x5644a2138960 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5ffa637b80 10 client.18072 fetch_fsmap learned FSMap version 37 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.415+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5644a1eb8d80 con 0x5644a2138960 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5fc77fe700 1 -- 172.21.15.35:0/525335152 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5644a204d390 con 0x5644a2138960 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5fc77fe700 1 -- 172.21.15.35:0/525335152 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5fd8037030 con 0x5644a2138960 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5ffa637b80 10 client.18072 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5ffa637b80 10 client.18072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5ffa637b80 20 client.18072 populate_metadata read hostname 'smithi035' 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a2152040 0x5644a2154450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5ffa637b80 4 client.18072 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644a2059600 con 0x5644a2152040 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.416+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a2152040 0x5644a2154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5fc77fe700 10 client.18072 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a2152040 0x5644a2154450 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62eea54a3792531d server_cookie=88ed7689184eb699 in_seq=0 out_seq=0 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5fc77fe700 1 -- 172.21.15.35:0/525335152 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5644a2059600 con 0x5644a2152040 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5fc77fe700 10 client.18072 handle_command_reply: tid=0 2023-03-17T10:05:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 client.18072 shutdown 2023-03-17T10:05:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 msgr2=0x5644a2144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:46.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2144430 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000c00 tx=0x7f5fd801a050 comp rx=0 tx=0).stop 2023-03-17T10:05:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 shutdown_connections 2023-03-17T10:05:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a2152040 0x5644a2154450 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a2141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2144430 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/525335152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2141720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5fc77fe700 0 client.18072 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 >> 172.21.15.35:0/525335152 conn(0x5644a1f956b0 msgr2=0x5644a2137410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 shutdown_connections 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.417+0000 7f5ffa637b80 1 -- 172.21.15.35:0/525335152 wait complete. 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.418+0000 7f5ffa637b80 20 client.18072 trim_cache size 0 max 16384 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 Processor -- start 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 -- start start 2023-03-17T10:05:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2148f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:50.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:50.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a213b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:50.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a212e0f0 con 0x5644a2138960 2023-03-17T10:05:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a21387d0 con 0x5644a213e4f0 2023-03-17T10:05:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a212fb60 con 0x5644a213dbe0 2023-03-17T10:05:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48638/0 (socket says 172.21.15.35:48638) 2023-03-17T10:05:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 -- 172.21.15.35:0/592976318 learned_addr learned my addr 172.21.15.35:0/592976318 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 -- 172.21.15.35:0/592976318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 msgr2=0x5644a2143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 -- 172.21.15.35:0/592976318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 msgr2=0x5644a213b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a213b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 -- 172.21.15.35:0/592976318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a2051130 con 0x5644a2138960 2023-03-17T10:05:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2148f80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80095c0 tx=0x7f5fd800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d7d8a95044ca82 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.433+0000 7f5fceffd700 1 -- 172.21.15.35:0/592976318 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd802b070 con 0x5644a2138960 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5fceffd700 1 -- 172.21.15.35:0/592976318 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fd802c040 con 0x5644a2138960 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5fceffd700 1 -- 172.21.15.35:0/592976318 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8034040 con 0x5644a2138960 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 -- 172.21.15.35:0/592976318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 msgr2=0x5644a2148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2148f80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80095c0 tx=0x7f5fd800ff00 comp rx=0 tx=0).stop 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 -- 172.21.15.35:0/592976318 shutdown_connections 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a213b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a2148f80 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/592976318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a2143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 -- 172.21.15.35:0/592976318 >> 172.21.15.35:0/592976318 conn(0x5644a1f956b0 msgr2=0x5644a2137c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 -- 172.21.15.35:0/592976318 shutdown_connections 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 -- 172.21.15.35:0/592976318 wait complete. 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.434+0000 7f5ffa637b80 1 -- start start 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 Processor -- start 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a219a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a219a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a219f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a219f550 con 0x5644a2138960 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a219f6c0 con 0x5644a213e4f0 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a219f880 con 0x5644a213dbe0 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5ffa637b80 10 client.0 _ll_register_callbacks cb 0x5644a1f30230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a219a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a219a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48644/0 (socket says 172.21.15.35:48644) 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 -- 172.21.15.35:0/4281105926 learned_addr learned my addr 172.21.15.35:0/4281105926 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a219a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5feca47700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a219f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 -- 172.21.15.35:0/4281105926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 msgr2=0x5644a219a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a219a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 -- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 msgr2=0x5644a219f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a219f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.435+0000 7f5fe7fff700 1 -- 172.21.15.35:0/4281105926 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644a1eb8d80 con 0x5644a2138960 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5feca47700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a219f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fe7fff700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a219a060 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000c00 tx=0x7f5fd8004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aff74eb66ada21a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fc77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fc77fe700 1 -- 172.21.15.35:0/4281105926 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8046070 con 0x5644a2138960 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fc77fe700 1 -- 172.21.15.35:0/4281105926 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(194..194 src has 1..194) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5fd80051b0 con 0x5644a2138960 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644a21081e0 con 0x5644a2138960 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fc77fe700 1 -- 172.21.15.35:0/4281105926 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fd802b030 con 0x5644a2138960 2023-03-17T10:05:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 10 client.18078 fetch_fsmap learned FSMap version 37 2023-03-17T10:05:54.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5644a1edf1f0 con 0x5644a2138960 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fc77fe700 1 -- 172.21.15.35:0/4281105926 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fd804f020 con 0x5644a2138960 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5fc77fe700 1 -- 172.21.15.35:0/4281105926 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5fd8049030 con 0x5644a2138960 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 10 client.18078 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 10 client.18078 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 20 client.18078 populate_metadata read hostname 'smithi035' 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a21a6b10 0x5644a21a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 4 client.18078 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.436+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5644a1f0ef00 con 0x5644a21a6b10 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.437+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a21a6b10 0x5644a21a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.437+0000 7f5fc77fe700 10 client.18078 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.437+0000 7f5fe77fe700 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a21a6b10 0x5644a21a8ef0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a02f901ea481f5d1 server_cookie=f2d5f8622ff7bd8d in_seq=0 out_seq=0 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5fc77fe700 1 -- 172.21.15.35:0/4281105926 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5644a1f0ef00 con 0x5644a21a6b10 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5fc77fe700 10 client.18078 handle_command_reply: tid=0 2023-03-17T10:05:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 client.18078 shutdown 2023-03-17T10:05:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 msgr2=0x5644a219a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a219a060 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8000c00 tx=0x7f5fd8004950 comp rx=0 tx=0).stop 2023-03-17T10:05:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 shutdown_connections 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5644a21a6b10 0x5644a21a8ef0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5644a213e4f0 0x5644a219f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5fc77fe700 0 client.18078 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5644a2138960 0x5644a219a060 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 --2- 172.21.15.35:0/4281105926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644a213dbe0 0x5644a219a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.445+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 >> 172.21.15.35:0/4281105926 conn(0x5644a1f956b0 msgr2=0x5644a213b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 shutdown_connections 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5ffa637b80 1 -- 172.21.15.35:0/4281105926 wait complete. 2023-03-17T10:05:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5ffa637b80 20 client.18078 trim_cache size 0 max 16384 2023-03-17T10:05:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5fd009f640 msgr2=0x7f5fd00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5fd009f640 0x7f5fd00a1af0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8006010 tx=0x7f5fd8005940 comp rx=0 tx=0).stop 2023-03-17T10:05:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 msgr2=0x7f5fe81a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 0x7f5fe81a4410 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0007ee0 tx=0x7f5fe000d3b0 comp rx=0 tx=0).stop 2023-03-17T10:05:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 shutdown_connections 2023-03-17T10:05:57.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5fd009f640 0x7f5fd00a1af0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5fe810a790 0x7f5fe81a4410 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fe8101270 0x7f5fe80ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 --2- 172.21.15.35:0/1491148069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fe8101b80 0x7f5fe80ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 >> 172.21.15.35:0/1491148069 conn(0x7f5fe8076330 msgr2=0x7f5fe81021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 shutdown_connections 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:16.446+0000 7f5fee4aa700 1 -- 172.21.15.35:0/1491148069 wait complete. 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 -- 172.21.15.35:0/1558784967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ff350 msgr2=0x7f35d80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1558784967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ff350 0x7f35d80ff720 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0099c0 tx=0x7f35cc009cd0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 -- 172.21.15.35:0/1558784967 shutdown_connections 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1558784967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d8104390 0x7f35d810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1558784967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ff350 0x7f35d80ff720 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1558784967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d80ffcf0 0x7f35d8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 -- 172.21.15.35:0/1558784967 >> 172.21.15.35:0/1558784967 conn(0x7f35d8076330 msgr2=0x7f35d8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 -- 172.21.15.35:0/1558784967 shutdown_connections 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.567+0000 7f35dee3d700 1 -- 172.21.15.35:0/1558784967 wait complete. 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 Processor -- start 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 -- start start 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d80ff350 0x7f35d81971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 0x7f35d81976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d8104390 0x7f35d81a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8198000 con 0x7f35d80ffcf0 2023-03-17T10:05:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81a2770 con 0x7f35d8104390 2023-03-17T10:05:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35dee3d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81a28e0 con 0x7f35d80ff350 2023-03-17T10:05:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 0x7f35d81976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.568+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 0x7f35d81976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48660/0 (socket says 172.21.15.35:48660) 2023-03-17T10:05:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 -- 172.21.15.35:0/1383698289 learned_addr learned my addr 172.21.15.35:0/1383698289 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d80ff350 0x7f35d81971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35dd3da700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d8104390 0x7f35d81a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 -- 172.21.15.35:0/1383698289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d80ff350 msgr2=0x7f35d81971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d80ff350 0x7f35d81971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 -- 172.21.15.35:0/1383698289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d8104390 msgr2=0x7f35d81a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d8104390 0x7f35d81a2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 -- 172.21.15.35:0/1383698289 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0095f0 con 0x7f35d80ffcf0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 0x7f35d81976f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f35c400d950 tx=0x7f35c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d5ffb700 1 -- 172.21.15.35:0/1383698289 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4009930 con 0x7f35d80ffcf0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d5ffb700 1 -- 172.21.15.35:0/1383698289 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35c4010460 con 0x7f35d80ffcf0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d810f000 con 0x7f35d80ffcf0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35d5ffb700 1 -- 172.21.15.35:0/1383698289 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400f620 con 0x7f35d80ffcf0 2023-03-17T10:05:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.569+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d810ee70 con 0x7f35d80ffcf0 2023-03-17T10:05:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.572+0000 7f35d5ffb700 1 -- 172.21.15.35:0/1383698289 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f35c4009a90 con 0x7f35d80ffcf0 2023-03-17T10:05:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.572+0000 7f35d5ffb700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f35c809f640 0x7f35c80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:05:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.572+0000 7f35d5ffb700 1 -- 172.21.15.35:0/1383698289 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f35c40ca1e0 con 0x7f35d80ffcf0 2023-03-17T10:05:59.852 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:14 smithi035 podman[175170]: 2023-03-17T10:06:01.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.572+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f35c809f640 0x7f35c80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f35c809f640 0x7f35c80a1af0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b580 tx=0x7f35cc009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 Processor -- start 2023-03-17T10:06:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 -- start start 2023-03-17T10:06:04.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:04.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae57420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:04.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ad5e010 con 0x558f1ae57960 2023-03-17T10:06:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1adb0950 con 0x558f1ae5d4f0 2023-03-17T10:06:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.573+0000 7f35eafcab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ada9de0 con 0x558f1ae5cbe0 2023-03-17T10:06:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48670/0 (socket says 172.21.15.35:48670) 2023-03-17T10:06:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 -- 172.21.15.35:0/1166071237 learned_addr learned my addr 172.21.15.35:0/1166071237 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae57420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 -- 172.21.15.35:0/1166071237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 msgr2=0x558f1ae5cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae5cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 -- 172.21.15.35:0/1166071237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 msgr2=0x558f1ae57420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae57420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 -- 172.21.15.35:0/1166071237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f1ac2b5d0 con 0x558f1ae57960 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35dd3da700 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57d90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009d20 tx=0x7f35d00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d67f836b448e3e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35c2ffd700 1 -- 172.21.15.35:0/1166071237 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0018070 con 0x558f1ae57960 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35c2ffd700 1 -- 172.21.15.35:0/1166071237 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35d000f050 con 0x558f1ae57960 2023-03-17T10:06:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.574+0000 7f35c2ffd700 1 -- 172.21.15.35:0/1166071237 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00059a0 con 0x558f1ae57960 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 -- 172.21.15.35:0/1166071237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 msgr2=0x558f1ae57d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57d90 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009d20 tx=0x7f35d00077e0 comp rx=0 tx=0).stop 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 -- 172.21.15.35:0/1166071237 shutdown_connections 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57d90 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1166071237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae57420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 -- 172.21.15.35:0/1166071237 >> 172.21.15.35:0/1166071237 conn(0x558f1acb46b0 msgr2=0x558f1ae51a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:07.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 -- 172.21.15.35:0/1166071237 shutdown_connections 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 -- 172.21.15.35:0/1166071237 wait complete. 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.575+0000 7f35eafcab80 1 -- start start 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 Processor -- start 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae57960 0x558f1ae633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae60b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ac2d8c0 con 0x558f1ae5cbe0 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae61250 con 0x558f1ae5d4f0 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae61410 con 0x558f1ae57960 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35eafcab80 10 client.0 _ll_register_callbacks cb 0x558f1ac4f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48674/0 (socket says 172.21.15.35:48674) 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 -- 172.21.15.35:0/4076878859 learned_addr learned my addr 172.21.15.35:0/4076878859 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae57960 0x558f1ae633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35dd3da700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae60b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 -- 172.21.15.35:0/4076878859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae57960 msgr2=0x558f1ae633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae57960 0x558f1ae633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 -- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 msgr2=0x558f1ae60b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae60b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.576+0000 7f35d7fff700 1 -- 172.21.15.35:0/4076878859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d0009980 con 0x558f1ae5cbe0 2023-03-17T10:06:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35d7fff700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae605d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f35c40c7f70 tx=0x7f35c4010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cbd4f3e8e833aa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:06:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35b7fff700 1 -- 172.21.15.35:0/4076878859 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40af070 con 0x558f1ae5cbe0 2023-03-17T10:06:08.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35b7fff700 1 -- 172.21.15.35:0/4076878859 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(194..194 src has 1..194) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f35c409b070 con 0x558f1ae5cbe0 2023-03-17T10:06:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f1ad6c390 con 0x558f1ae5cbe0 2023-03-17T10:06:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35b7fff700 1 -- 172.21.15.35:0/4076878859 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c4097ef0 con 0x558f1ae5cbe0 2023-03-17T10:06:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 10 client.18090 fetch_fsmap learned FSMap version 37 2023-03-17T10:06:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558f1abd7d80 con 0x558f1ae5cbe0 2023-03-17T10:06:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35b7fff700 1 -- 172.21.15.35:0/4076878859 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558f1ad6c390 con 0x558f1ae5cbe0 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35b7fff700 1 -- 172.21.15.35:0/4076878859 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f35c40b2020 con 0x558f1ae5cbe0 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 10 client.18090 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 10 client.18090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 20 client.18090 populate_metadata read hostname 'smithi035' 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1ae70fa0 0x558f1ae733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 4 client.18090 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.577+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f1ad78600 con 0x558f1ae70fa0 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.578+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1ae70fa0 0x558f1ae733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.578+0000 7f35b7fff700 10 client.18090 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:06:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.578+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1ae70fa0 0x558f1ae733b0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b3af6d4eb5bac56 server_cookie=73be89db75a0eaeb in_seq=0 out_seq=0 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35b7fff700 1 -- 172.21.15.35:0/4076878859 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558f1ad78600 con 0x558f1ae70fa0 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35b7fff700 10 client.18090 handle_command_reply: tid=0 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 client.18090 shutdown 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 msgr2=0x558f1ae605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae605d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f35c40c7f70 tx=0x7f35c4010860 comp rx=0 tx=0).stop 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 shutdown_connections 2023-03-17T10:06:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1ae70fa0 0x558f1ae733b0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae60b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae57960 0x558f1ae633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 --2- 172.21.15.35:0/4076878859 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae605d0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35b7fff700 0 client.18090 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:06:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 >> 172.21.15.35:0/4076878859 conn(0x558f1acb46b0 msgr2=0x558f1ae51a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 shutdown_connections 2023-03-17T10:06:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 1 -- 172.21.15.35:0/4076878859 wait complete. 2023-03-17T10:06:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.579+0000 7f35eafcab80 20 client.18090 trim_cache size 0 max 16384 2023-03-17T10:06:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 Processor -- start 2023-03-17T10:06:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 -- start start 2023-03-17T10:06:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae5e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae61550 con 0x558f1ae57960 2023-03-17T10:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae52000 con 0x558f1ae5d4f0 2023-03-17T10:06:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35eafcab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae5e5e0 con 0x558f1ae5cbe0 2023-03-17T10:06:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48680/0 (socket says 172.21.15.35:48680) 2023-03-17T10:06:18.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 -- 172.21.15.35:0/3779510807 learned_addr learned my addr 172.21.15.35:0/3779510807 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dd3da700 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae5e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35d7fff700 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 -- 172.21.15.35:0/3779510807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 msgr2=0x558f1ae51ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae51ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 -- 172.21.15.35:0/3779510807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 msgr2=0x558f1ae5e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae5e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 -- 172.21.15.35:0/3779510807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f1ae58000 con 0x558f1ae57960 2023-03-17T10:06:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35d7fff700 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:06:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57420 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0098e0 tx=0x7f35cc023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c6db4bb5b5b140 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35c37fe700 1 -- 172.21.15.35:0/3779510807 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc005200 con 0x558f1ae57960 2023-03-17T10:06:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35c37fe700 1 -- 172.21.15.35:0/3779510807 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35cc01e040 con 0x558f1ae57960 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.595+0000 7f35c37fe700 1 -- 172.21.15.35:0/3779510807 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc004880 con 0x558f1ae57960 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 -- 172.21.15.35:0/3779510807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 msgr2=0x558f1ae57420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57420 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0098e0 tx=0x7f35cc023000 comp rx=0 tx=0).stop 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 -- 172.21.15.35:0/3779510807 shutdown_connections 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae5d4f0 0x558f1ae5e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae57960 0x558f1ae57420 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- 172.21.15.35:0/3779510807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5cbe0 0x558f1ae51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 -- 172.21.15.35:0/3779510807 >> 172.21.15.35:0/3779510807 conn(0x558f1acb46b0 msgr2=0x558f1ae5d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 -- 172.21.15.35:0/3779510807 shutdown_connections 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 -- 172.21.15.35:0/3779510807 wait complete. 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 -- start start 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 Processor -- start 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae57960 0x558f1ae59a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae586a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.596+0000 7f35eafcab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5d4f0 0x558f1ae58be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae5a0e0 con 0x558f1ae5cbe0 2023-03-17T10:06:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae5a250 con 0x558f1ae57960 2023-03-17T10:06:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ae59120 con 0x558f1ae5d4f0 2023-03-17T10:06:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 10 client.0 _ll_register_callbacks cb 0x558f1ac4f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:06:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48688/0 (socket says 172.21.15.35:48688) 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 -- 172.21.15.35:0/1912446910 learned_addr learned my addr 172.21.15.35:0/1912446910 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35dd3da700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5d4f0 0x558f1ae58be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 -- 172.21.15.35:0/1912446910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5d4f0 msgr2=0x558f1ae58be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5d4f0 0x558f1ae58be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 -- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae57960 msgr2=0x558f1ae59a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae57960 0x558f1ae59a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 -- 172.21.15.35:0/1912446910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d810c7a0 con 0x558f1ae5cbe0 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35dd3da700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5d4f0 0x558f1ae58be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35d7fff700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae586a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f35c4097c20 tx=0x7f35c40978a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2d55a2d5edddcf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:06:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35b7fff700 1 -- 172.21.15.35:0/1912446910 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40af030 con 0x558f1ae5cbe0 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35b7fff700 1 -- 172.21.15.35:0/1912446910 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(194..194 src has 1..194) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f35c409b040 con 0x558f1ae5cbe0 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f1ae271e0 con 0x558f1ae5cbe0 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35b7fff700 1 -- 172.21.15.35:0/1912446910 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c4097300 con 0x558f1ae5cbe0 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 10 client.18096 fetch_fsmap learned FSMap version 37 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.597+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558f1abc0c00 con 0x558f1ae5cbe0 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35b7fff700 1 -- 172.21.15.35:0/1912446910 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558f1ae271e0 con 0x558f1ae5cbe0 2023-03-17T10:06:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35b7fff700 1 -- 172.21.15.35:0/1912446910 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f35c40b2070 con 0x558f1ae5cbe0 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35eafcab80 10 client.18096 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35eafcab80 10 client.18096 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35eafcab80 20 client.18096 populate_metadata read hostname 'smithi035' 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1aec5a80 0x558f1aec7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35eafcab80 4 client.18096 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f1ac2df00 con 0x558f1aec5a80 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1aec5a80 0x558f1aec7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35b7fff700 10 client.18096 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:06:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.598+0000 7f35dcbd9700 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1aec5a80 0x558f1aec7e60 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feef9ecdcf8b292f server_cookie=464b0348345e1983 in_seq=0 out_seq=0 2023-03-17T10:06:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35b7fff700 1 -- 172.21.15.35:0/1912446910 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f1ac2df00 con 0x558f1aec5a80 2023-03-17T10:06:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35b7fff700 10 client.18096 handle_command_reply: tid=0 2023-03-17T10:06:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 client.18096 shutdown 2023-03-17T10:06:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 msgr2=0x558f1ae586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae586a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f35c4097c20 tx=0x7f35c40978a0 comp rx=0 tx=0).stop 2023-03-17T10:06:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 shutdown_connections 2023-03-17T10:06:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f1aec5a80 0x558f1aec7e60 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:30.267 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:14 smithi035 ceph-mds[175211]: -- 172.21.15.35:0/1631596045 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a745054b60 con 0x55a74502a800 2023-03-17T10:06:30.267 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:14 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: starting mds.d at 2023-03-17T10:06:30.267 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:14 smithi035 bash[175170]: 6ea41ca404d288afff0af56e176945c28dc71ae1c0fb9c844aa2bcda5feda00b 2023-03-17T10:06:30.268 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 09:56:14 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:06:31.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f1ae5d4f0 0x558f1ae58be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f1ae57960 0x558f1ae59a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35b7fff700 0 client.18096 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:06:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 --2- 172.21.15.35:0/1912446910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f1ae5cbe0 0x558f1ae586a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 >> 172.21.15.35:0/1912446910 conn(0x558f1acb46b0 msgr2=0x558f1ae5b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 shutdown_connections 2023-03-17T10:06:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 1 -- 172.21.15.35:0/1912446910 wait complete. 2023-03-17T10:06:33.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.603+0000 7f35eafcab80 20 client.18096 trim_cache size 0 max 16384 2023-03-17T10:06:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f35c809f640 msgr2=0x7f35c80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f35c809f640 0x7f35c80a1af0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b580 tx=0x7f35cc009f10 comp rx=0 tx=0).stop 2023-03-17T10:06:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 msgr2=0x7f35d81976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 0x7f35d81976f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f35c400d950 tx=0x7f35c400dc60 comp rx=0 tx=0).stop 2023-03-17T10:06:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 shutdown_connections 2023-03-17T10:06:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f35c809f640 0x7f35c80a1af0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35d8104390 0x7f35d81a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35d80ff350 0x7f35d81971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 --2- 172.21.15.35:0/1383698289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35d80ffcf0 0x7f35d81976f0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 >> 172.21.15.35:0/1383698289 conn(0x7f35d8076330 msgr2=0x7f35d80fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 shutdown_connections 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:29.604+0000 7f35dee3d700 1 -- 172.21.15.35:0/1383698289 wait complete. 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.725+0000 7feed6d32700 1 -- 172.21.15.35:0/3737946876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed00ffcf0 msgr2=0x7feed0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.725+0000 7feed6d32700 1 --2- 172.21.15.35:0/3737946876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed00ffcf0 0x7feed0103cb0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7feebc0099c0 tx=0x7feebc009cd0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 -- 172.21.15.35:0/3737946876 shutdown_connections 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 --2- 172.21.15.35:0/3737946876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed0104390 0x7feed010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 --2- 172.21.15.35:0/3737946876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed00ff350 0x7feed00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 --2- 172.21.15.35:0/3737946876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed00ffcf0 0x7feed0103cb0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 -- 172.21.15.35:0/3737946876 >> 172.21.15.35:0/3737946876 conn(0x7feed0076330 msgr2=0x7feed0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 -- 172.21.15.35:0/3737946876 shutdown_connections 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:44:42.726+0000 7feed6d32700 1 -- 172.21.15.35:0/3737946876 wait complete. 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 Processor -- start 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 -- start start 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed00ff350 0x7feed0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed00ffcf0 0x7feed01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:35.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 0x7feed019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019d450 con 0x7feed0104390 2023-03-17T10:06:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019d5c0 con 0x7feed00ffcf0 2023-03-17T10:06:35.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed6d32700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019d780 con 0x7feed00ff350 2023-03-17T10:06:36.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed52cf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 0x7feed019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:36.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.275+0000 7feed52cf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 0x7feed019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48716/0 (socket says 172.21.15.35:48716) 2023-03-17T10:06:36.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 -- 172.21.15.35:0/2408760589 learned_addr learned my addr 172.21.15.35:0/2408760589 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed4ace700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed00ff350 0x7feed0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:37.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feecffff700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed00ffcf0 0x7feed01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:37.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 -- 172.21.15.35:0/2408760589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed00ff350 msgr2=0x7feed0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed00ff350 0x7feed0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 -- 172.21.15.35:0/2408760589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed00ffcf0 msgr2=0x7feed01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed00ffcf0 0x7feed01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 -- 172.21.15.35:0/2408760589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0095f0 con 0x7feed0104390 2023-03-17T10:06:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed52cf700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 0x7feed019ce10 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7feec8007ee0 tx=0x7feec800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feecdffb700 1 -- 172.21.15.35:0/2408760589 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feed0104390 2023-03-17T10:06:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feecdffb700 1 -- 172.21.15.35:0/2408760589 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec800f040 con 0x7feed0104390 2023-03-17T10:06:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed010efc0 con 0x7feed0104390 2023-03-17T10:06:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.276+0000 7feecdffb700 1 -- 172.21.15.35:0/2408760589 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8005570 con 0x7feed0104390 2023-03-17T10:06:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.277+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed010ee30 con 0x7feed0104390 2023-03-17T10:06:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.279+0000 7feecdffb700 1 -- 172.21.15.35:0/2408760589 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7feec800db20 con 0x7feed0104390 2023-03-17T10:06:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.280+0000 7feecdffb700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7feec009f640 0x7feec00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.280+0000 7feecdffb700 1 -- 172.21.15.35:0/2408760589 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 8455+0+0 (secure 0 0 0) 0x7feec80c9d80 con 0x7feed0104390 2023-03-17T10:06:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.280+0000 7feed4ace700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7feec009f640 0x7feec00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.281+0000 7feed4ace700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7feec009f640 0x7feec00a1af0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feec4005950 tx=0x7feec400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 Processor -- start 2023-03-17T10:06:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 -- start start 2023-03-17T10:06:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b64fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b5f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b5f960 0x563c82b5fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82a66010 con 0x563c82b64be0 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82ab8950 con 0x563c82b5f960 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82ab1de0 con 0x563c82b654f0 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feed4ace700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b64fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feed4ace700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b64fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48720/0 (socket says 172.21.15.35:48720) 2023-03-17T10:06:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feed4ace700 1 -- 172.21.15.35:0/3620441298 learned_addr learned my addr 172.21.15.35:0/3620441298 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feed52cf700 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b5f960 0x563c82b5fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.282+0000 7feecffff700 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b5f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed4ace700 1 -- 172.21.15.35:0/3620441298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 msgr2=0x563c82b5f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed4ace700 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b5f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed4ace700 1 -- 172.21.15.35:0/3620441298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b5f960 msgr2=0x563c82b5fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed4ace700 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b5f960 0x563c82b5fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed4ace700 1 -- 172.21.15.35:0/3620441298 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c829335d0 con 0x563c82b64be0 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed52cf700 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b5f960 0x563c82b5fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feed4ace700 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b64fb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7feec4010fa0 tx=0x7feec4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7da4caa7a5f2f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feebaffd700 1 -- 172.21.15.35:0/3620441298 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4011db0 con 0x563c82b64be0 2023-03-17T10:06:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feebaffd700 1 -- 172.21.15.35:0/3620441298 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec4015070 con 0x563c82b64be0 2023-03-17T10:06:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.283+0000 7feebaffd700 1 -- 172.21.15.35:0/3620441298 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec401c610 con 0x563c82b64be0 2023-03-17T10:06:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3620441298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 msgr2=0x563c82b64fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b64fb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7feec4010fa0 tx=0x7feec4013000 comp rx=0 tx=0).stop 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3620441298 shutdown_connections 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b5f960 0x563c82b5fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b64fb0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3620441298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b5f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3620441298 >> 172.21.15.35:0/3620441298 conn(0x563c829bc6b0 msgr2=0x563c82b59a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3620441298 shutdown_connections 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.284+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3620441298 wait complete. 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 -- start start 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 Processor -- start 2023-03-17T10:06:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b64be0 0x563c82b686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b68e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c829358c0 con 0x563c82b5f960 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82b69560 con 0x563c82b64be0 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82b75000 con 0x563c82b654f0 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.285+0000 7feee2ebfb80 10 client.0 _ll_register_callbacks cb 0x563c82957230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48726/0 (socket says 172.21.15.35:48726) 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 -- 172.21.15.35:0/1900565552 learned_addr learned my addr 172.21.15.35:0/1900565552 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feecffff700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b64be0 0x563c82b686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed52cf700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b68e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 -- 172.21.15.35:0/1900565552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 msgr2=0x563c82b68e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b68e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 -- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b64be0 msgr2=0x563c82b686e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b64be0 0x563c82b686e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 -- 172.21.15.35:0/1900565552 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec4010c50 con 0x563c82b5f960 2023-03-17T10:06:47.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feecffff700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b64be0 0x563c82b686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feed4ace700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6b4d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7feec4011de0 tx=0x7feec4011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6900e7f4d0f6de20 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feeaffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.286+0000 7feeaffff700 1 -- 172.21.15.35:0/1900565552 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec402b070 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feeaffff700 1 -- 172.21.15.35:0/1900565552 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 8455+0+0 (secure 0 0 0) 0x7feec4017070 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c82a74390 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feeaffff700 1 -- 172.21.15.35:0/1900565552 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec400be60 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 10 client.18108 fetch_fsmap learned FSMap version 37 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563c828dfd80 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feeaffff700 1 -- 172.21.15.35:0/1900565552 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563c82a74390 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feeaffff700 1 -- 172.21.15.35:0/1900565552 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7feec4026c50 con 0x563c82b5f960 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 10 client.18108 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 10 client.18108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 20 client.18108 populate_metadata read hostname 'smithi035' 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82b78fa0 0x563c82b7b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:47.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 4 client.18108 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:06:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.287+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c82a80600 con 0x563c82b78fa0 2023-03-17T10:06:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.288+0000 7feecffff700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82b78fa0 0x563c82b7b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.288+0000 7feecffff700 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82b78fa0 0x563c82b7b380 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a0c21b0fcd9b3e server_cookie=4acea259dcd04f59 in_seq=0 out_seq=0 2023-03-17T10:06:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.288+0000 7feeaffff700 10 client.18108 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:06:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feeaffff700 1 -- 172.21.15.35:0/1900565552 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563c82a80600 con 0x563c82b78fa0 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feeaffff700 10 client.18108 handle_command_reply: tid=0 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 client.18108 shutdown 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 msgr2=0x563c82b6b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6b4d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7feec4011de0 tx=0x7feec4011e10 comp rx=0 tx=0).stop 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 shutdown_connections 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82b78fa0 0x563c82b7b380 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b654f0 0x563c82b68e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6b4d0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/1900565552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b64be0 0x563c82b686e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feeaffff700 0 client.18108 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:06:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 >> 172.21.15.35:0/1900565552 conn(0x563c829bc6b0 msgr2=0x563c82b5e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:06:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 shutdown_connections 2023-03-17T10:06:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.289+0000 7feee2ebfb80 1 -- 172.21.15.35:0/1900565552 wait complete. 2023-03-17T10:06:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.290+0000 7feee2ebfb80 20 client.18108 trim_cache size 0 max 16384 2023-03-17T10:06:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.305+0000 7feee2ebfb80 1 Processor -- start 2023-03-17T10:06:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 -- start start 2023-03-17T10:06:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b5f960 0x563c82b59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b6ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:06:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82b696e0 con 0x563c82b64be0 2023-03-17T10:06:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82b5a030 con 0x563c82b654f0 2023-03-17T10:06:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82b56b60 con 0x563c82b5f960 2023-03-17T10:06:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feecffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b6ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feecffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b6ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48736/0 (socket says 172.21.15.35:48736) 2023-03-17T10:06:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed4ace700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b5f960 0x563c82b59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feecffff700 1 -- 172.21.15.35:0/3636262479 learned_addr learned my addr 172.21.15.35:0/3636262479 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:06:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed52cf700 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:06:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed4ace700 1 -- 172.21.15.35:0/3636262479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 msgr2=0x563c82b6b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed4ace700 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed4ace700 1 -- 172.21.15.35:0/3636262479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 msgr2=0x563c82b6ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:06:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed4ace700 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b6ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:06:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.306+0000 7feed4ace700 1 -- 172.21.15.35:0/3636262479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c82a78130 con 0x563c82b5f960 2023-03-17T10:06:53.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:15 smithi035 ceph-mon[92535]: pgmap v2278: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 551 B/s wr, 9 op/s 2023-03-17T10:06:53.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:15 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T10:06:53.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:15 smithi035 ceph-mon[92535]: osdmap e220: 12 total, 12 up, 12 in 2023-03-17T10:06:53.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:16 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/4214884183,v1:172.21.15.35:6837/4214884183] up:boot 2023-03-17T10:06:54.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:16 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T10:06:54.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T10:06:54.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:16 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:06:54.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:17 smithi035 ceph-mon[92535]: pgmap v2280: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T10:06:54.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:19 smithi035 ceph-mon[92535]: pgmap v2281: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 127 B/s wr, 11 op/s 2023-03-17T10:06:54.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:21 smithi035 ceph-mon[92535]: pgmap v2282: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 123 B/s wr, 11 op/s 2023-03-17T10:06:54.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:23 smithi035 ceph-mon[92535]: pgmap v2283: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T10:06:54.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:25 smithi035 ceph-mon[92535]: pgmap v2284: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-17T10:06:54.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:27 smithi035 ceph-mon[92535]: pgmap v2285: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-17T10:06:54.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:29 smithi035 ceph-mon[92535]: pgmap v2286: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s 2023-03-17T10:06:55.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:31 smithi035 ceph-mon[92535]: pgmap v2287: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:55.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:33 smithi035 ceph-mon[92535]: pgmap v2288: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:55.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:35 smithi035 ceph-mon[92535]: pgmap v2289: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:06:55.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:37 smithi035 ceph-mon[92535]: pgmap v2290: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:55.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:39 smithi035 ceph-mon[92535]: pgmap v2291: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:06:55.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:41 smithi035 ceph-mon[92535]: pgmap v2292: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:56.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:43 smithi035 ceph-mon[92535]: pgmap v2293: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:56.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:45 smithi035 ceph-mon[92535]: pgmap v2294: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:06:56.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:47 smithi035 ceph-mon[92535]: pgmap v2295: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:56.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:49 smithi035 ceph-mon[92535]: pgmap v2296: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:06:56.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:51 smithi035 ceph-mon[92535]: pgmap v2297: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:56.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:52 smithi035 ceph-mon[92535]: pgmap v2298: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:56.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:54 smithi035 ceph-mon[92535]: pgmap v2299: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:06:56.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:57 smithi035 ceph-mon[92535]: pgmap v2300: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:56.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:56:59 smithi035 ceph-mon[92535]: pgmap v2301: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:06:57.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:01 smithi035 ceph-mon[92535]: pgmap v2302: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:57.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:06:57.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:06:57.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:06:57.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:03 smithi035 ceph-mon[92535]: pgmap v2303: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:57.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:04 smithi035 ceph-mon[92535]: pgmap v2304: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 28 op/s 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:04 smithi035 ceph-mon[92535]: pgmap v2305: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:06 smithi035 ceph-mon[92535]: pgmap v2306: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:08 smithi035 ceph-mon[92535]: pgmap v2307: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 57 KiB/s wr, 24 op/s 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:10 smithi035 ceph-mon[92535]: pgmap v2308: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T10:06:58.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:10 smithi035 ceph-mon[92535]: osdmap e221: 12 total, 12 up, 12 in 2023-03-17T10:06:58.850 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:12 smithi035 ceph-mon[92535]: pgmap v2310: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T10:06:59.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:14 smithi035 ceph-mon[92535]: pgmap v2311: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:06:59.446 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:16 smithi035 ceph-mon[92535]: pgmap v2312: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:06:59.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:17 smithi035 ceph-mon[92535]: osdmap e222: 12 total, 12 up, 12 in 2023-03-17T10:06:59.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:18 smithi035 ceph-mon[92535]: pgmap v2314: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:20 smithi035 ceph-mon[92535]: pgmap v2315: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 535 B/s wr, 11 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:22 smithi035 ceph-mon[92535]: pgmap v2316: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:24 smithi035 ceph-mon[92535]: pgmap v2317: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:26 smithi035 ceph-mon[92535]: pgmap v2318: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:27 smithi035 ceph-mon[92535]: pgmap v2319: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 483 B/s wr, 10 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:29 smithi035 ceph-mon[92535]: pgmap v2320: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:32 smithi035 ceph-mon[92535]: pgmap v2321: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:34 smithi035 ceph-mon[92535]: pgmap v2322: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:36 smithi035 ceph-mon[92535]: pgmap v2323: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:38 smithi035 ceph-mon[92535]: pgmap v2324: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:40 smithi035 ceph-mon[92535]: pgmap v2325: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:06:59.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:42 smithi035 ceph-mon[92535]: pgmap v2326: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:44 smithi035 ceph-mon[92535]: pgmap v2327: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:46 smithi035 ceph-mon[92535]: pgmap v2328: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:48 smithi035 ceph-mon[92535]: pgmap v2329: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:50 smithi035 ceph-mon[92535]: pgmap v2330: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:52 smithi035 ceph-mon[92535]: pgmap v2331: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:54 smithi035 ceph-mon[92535]: pgmap v2332: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:07:00.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:56 smithi035 ceph-mon[92535]: pgmap v2333: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:07:00.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:57:58 smithi035 ceph-mon[92535]: pgmap v2334: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:07:00.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:00 smithi035 ceph-mon[92535]: pgmap v2335: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T10:07:00.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:02 smithi035 ceph-mon[92535]: pgmap v2336: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:07:00.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:07:00.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:04 smithi035 ceph-mon[92535]: pgmap v2337: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:07:02.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:02.415 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:03.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: pgmap v2338: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:07:03.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:03.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:03.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:03.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:03.543 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:04.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:04.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:04.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:04.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:06.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:06.125 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:07:08.404 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: pgmap v2339: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T10:07:08.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:07:09.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: pgmap v2340: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:07:09.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:08 smithi035 ceph-mon[92535]: pgmap v2341: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 66 KiB/s wr, 28 op/s 2023-03-17T10:07:11.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:09 smithi035 ceph-mon[92535]: pgmap v2342: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 34 op/s 2023-03-17T10:07:11.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:10 smithi035 ceph-mon[92535]: osdmap e223: 12 total, 12 up, 12 in 2023-03-17T10:07:11.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:12 smithi035 ceph-mon[92535]: pgmap v2344: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T10:07:11.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:14 smithi035 ceph-mon[92535]: pgmap v2345: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 340 B/s wr, 17 op/s 2023-03-17T10:07:11.082 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:16 smithi035 ceph-mon[92535]: pgmap v2346: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:16 smithi035 ceph-mon[92535]: osdmap e224: 12 total, 12 up, 12 in 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:18 smithi035 ceph-mon[92535]: pgmap v2348: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:20 smithi035 ceph-mon[92535]: pgmap v2349: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 321 B/s wr, 10 op/s 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:22 smithi035 ceph-mon[92535]: pgmap v2350: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:24 smithi035 ceph-mon[92535]: pgmap v2351: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:26 smithi035 ceph-mon[92535]: pgmap v2352: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:07:11.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:28 smithi035 ceph-mon[92535]: pgmap v2353: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 193 B/s wr, 9 op/s 2023-03-17T10:07:12.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:30 smithi035 ceph-mon[92535]: pgmap v2354: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T10:07:12.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:32 smithi035 ceph-mon[92535]: pgmap v2355: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:07:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:07:14.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:07:14.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:07:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:07:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:07:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:07:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.307+0000 7feed4ace700 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b5f960 0x563c82b59ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feec4011a00 tx=0x7feec4010f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f84955b64c12fb12 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.307+0000 7feebb7fe700 1 -- 172.21.15.35:0/3636262479 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec402b030 con 0x563c82b5f960 2023-03-17T10:07:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.307+0000 7feebb7fe700 1 -- 172.21.15.35:0/3636262479 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec4015050 con 0x563c82b5f960 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.307+0000 7feebb7fe700 1 -- 172.21.15.35:0/3636262479 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4030470 con 0x563c82b5f960 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.307+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3636262479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b5f960 msgr2=0x563c82b59ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.307+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b5f960 0x563c82b59ac0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feec4011a00 tx=0x7feec4010f20 comp rx=0 tx=0).stop 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3636262479 shutdown_connections 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b5f960 0x563c82b59ac0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3636262479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b64be0 0x563c82b6ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3636262479 >> 172.21.15.35:0/3636262479 conn(0x563c829bc6b0 msgr2=0x563c82b746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3636262479 shutdown_connections 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3636262479 wait complete. 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 -- start start 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.308+0000 7feee2ebfb80 1 Processor -- start 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b64be0 0x563c82b6e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:19.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82bcbf20 con 0x563c82b5f960 2023-03-17T10:07:19.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82bcc090 con 0x563c82b654f0 2023-03-17T10:07:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c82bcc250 con 0x563c82b64be0 2023-03-17T10:07:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feee2ebfb80 10 client.0 _ll_register_callbacks cb 0x563c82957230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:07:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48740/0 (socket says 172.21.15.35:48740) 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 -- 172.21.15.35:0/3787493885 learned_addr learned my addr 172.21.15.35:0/3787493885 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feecffff700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b64be0 0x563c82b6e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed52cf700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 -- 172.21.15.35:0/3787493885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b64be0 msgr2=0x563c82b6e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b64be0 0x563c82b6e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 -- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 msgr2=0x563c82b6e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 -- 172.21.15.35:0/3787493885 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c828dfd80 con 0x563c82b5f960 2023-03-17T10:07:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feecffff700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b64be0 0x563c82b6e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feed4ace700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6df30 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7feec4005d90 tx=0x7feec401e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b512696cc348076f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.309+0000 7feeaffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feeaffff700 1 -- 172.21.15.35:0/3787493885 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec402b070 con 0x563c82b5f960 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feeaffff700 1 -- 172.21.15.35:0/3787493885 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 8455+0+0 (secure 0 0 0) 0x7feec402c070 con 0x563c82b5f960 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c82b2f1e0 con 0x563c82b5f960 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feeaffff700 1 -- 172.21.15.35:0/3787493885 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec401eb80 con 0x563c82b5f960 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 10 client.18114 fetch_fsmap learned FSMap version 37 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x563c829061f0 con 0x563c82b5f960 2023-03-17T10:07:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feeaffff700 1 -- 172.21.15.35:0/3787493885 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec4050020 con 0x563c82b5f960 2023-03-17T10:07:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feeaffff700 1 -- 172.21.15.35:0/3787493885 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7feec4028ba0 con 0x563c82b5f960 2023-03-17T10:07:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 10 client.18114 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 10 client.18114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 20 client.18114 populate_metadata read hostname 'smithi035' 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82bcd4c0 0x563c82bcf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 4 client.18114 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.310+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563c82935f00 con 0x563c82bcd4c0 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.311+0000 7feecffff700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82bcd4c0 0x563c82bcf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.311+0000 7feecffff700 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82bcd4c0 0x563c82bcf8a0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58114d1ccf778251 server_cookie=687c231db9dbf28 in_seq=0 out_seq=0 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.311+0000 7feeaffff700 10 client.18114 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.320+0000 7feeaffff700 1 -- 172.21.15.35:0/3787493885 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563c82935f00 con 0x563c82bcd4c0 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.320+0000 7feeaffff700 10 client.18114 handle_command_reply: tid=0 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 client.18114 shutdown 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 msgr2=0x563c82b6df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6df30 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7feec4005d90 tx=0x7feec401e860 comp rx=0 tx=0).stop 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 shutdown_connections 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563c82bcd4c0 0x563c82bcf8a0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c82b654f0 0x563c82b6e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563c82b5f960 0x563c82b6df30 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 --2- 172.21.15.35:0/3787493885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c82b64be0 0x563c82b6e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feeaffff700 0 client.18114 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 >> 172.21.15.35:0/3787493885 conn(0x563c829bc6b0 msgr2=0x563c82b62650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 shutdown_connections 2023-03-17T10:07:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 1 -- 172.21.15.35:0/3787493885 wait complete. 2023-03-17T10:07:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.321+0000 7feee2ebfb80 20 client.18114 trim_cache size 0 max 16384 2023-03-17T10:07:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7feec009f640 msgr2=0x7feec00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7feec009f640 0x7feec00a1af0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feec4005950 tx=0x7feec400b410 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 msgr2=0x7feed019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 0x7feed019ce10 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7feec8007ee0 tx=0x7feec800d3b0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 shutdown_connections 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7feec009f640 0x7feec00a1af0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feed0104390 0x7feed019ce10 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feed00ff350 0x7feed0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 --2- 172.21.15.35:0/2408760589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed00ffcf0 0x7feed01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 >> 172.21.15.35:0/2408760589 conn(0x7feed0076330 msgr2=0x7feed0068920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 shutdown_connections 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:45:59.322+0000 7feed6d32700 1 -- 172.21.15.35:0/2408760589 wait complete. 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 -- 172.21.15.35:0/4212901291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 msgr2=0x7ff9200ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 --2- 172.21.15.35:0/4212901291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff9200ff7c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ff9100099c0 tx=0x7ff910009cd0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 -- 172.21.15.35:0/4212901291 shutdown_connections 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 --2- 172.21.15.35:0/4212901291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92010acb0 0x7ff92010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 --2- 172.21.15.35:0/4212901291 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff9200ff7c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 --2- 172.21.15.35:0/4212901291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9200ffd00 0x7ff92010a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 -- 172.21.15.35:0/4212901291 >> 172.21.15.35:0/4212901291 conn(0x7ff9200749e0 msgr2=0x7ff920074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 -- 172.21.15.35:0/4212901291 shutdown_connections 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 -- 172.21.15.35:0/4212901291 wait complete. 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.446+0000 7ff9257f7700 1 Processor -- start 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 -- start start 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff920196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9200ffd00 0x7ff920196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92010acb0 0x7ff92019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92019b210 con 0x7ff9200ff3f0 2023-03-17T10:07:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92019b380 con 0x7ff9200ffd00 2023-03-17T10:07:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff9257f7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92019b540 con 0x7ff92010acb0 2023-03-17T10:07:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff920196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff920196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48786/0 (socket says 172.21.15.35:48786) 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 -- 172.21.15.35:0/2502166907 learned_addr learned my addr 172.21.15.35:0/2502166907 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92010acb0 0x7ff92019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9200ffd00 0x7ff920196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 -- 172.21.15.35:0/2502166907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92010acb0 msgr2=0x7ff92019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92010acb0 0x7ff92019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 -- 172.21.15.35:0/2502166907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9200ffd00 msgr2=0x7ff920196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9200ffd00 0x7ff920196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.447+0000 7ff91effd700 1 -- 172.21.15.35:0/2502166907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9100095f0 con 0x7ff9200ff3f0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.448+0000 7ff91effd700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff920196230 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff910000c00 tx=0x7ff910005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.448+0000 7ff907fff700 1 -- 172.21.15.35:0/2502166907 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91001d070 con 0x7ff9200ff3f0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.448+0000 7ff907fff700 1 -- 172.21.15.35:0/2502166907 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff910022470 con 0x7ff9200ff3f0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.448+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff920110190 con 0x7ff9200ff3f0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.448+0000 7ff907fff700 1 -- 172.21.15.35:0/2502166907 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910017650 con 0x7ff9200ff3f0 2023-03-17T10:07:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.448+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920110000 con 0x7ff9200ff3f0 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.450+0000 7ff907fff700 1 -- 172.21.15.35:0/2502166907 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff9100225e0 con 0x7ff9200ff3f0 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.451+0000 7ff907fff700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff90809f640 0x7ff9080a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.451+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff90809f640 0x7ff9080a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.451+0000 7ff907fff700 1 -- 172.21.15.35:0/2502166907 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff9100cb800 con 0x7ff9200ff3f0 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff90809f640 0x7ff9080a1af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff920197840 tx=0x7ff914009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 Processor -- start 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 -- start start 2023-03-17T10:07:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b83410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7d830 0x559527b7dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b89dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527a80010 con 0x559527b83040 2023-03-17T10:07:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527ad2950 con 0x559527b7d830 2023-03-17T10:07:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff931984b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527acbde0 con 0x559527b7e1e0 2023-03-17T10:07:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff91effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b83410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff91effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b83410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48794/0 (socket says 172.21.15.35:48794) 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.452+0000 7ff91effd700 1 -- 172.21.15.35:0/3874473242 learned_addr learned my addr 172.21.15.35:0/3874473242 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7d830 0x559527b7dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b89dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91effd700 1 -- 172.21.15.35:0/3874473242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 msgr2=0x559527b89dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91effd700 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b89dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91effd700 1 -- 172.21.15.35:0/3874473242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7d830 msgr2=0x559527b7dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91effd700 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7d830 0x559527b7dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91effd700 1 -- 172.21.15.35:0/3874473242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952794d5d0 con 0x559527b83040 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff91effd700 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b83410 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff9100a1050 tx=0x7ff910099050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83af5380c86b3743 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff9057fa700 1 -- 172.21.15.35:0/3874473242 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91009f0d0 con 0x559527b83040 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff9057fa700 1 -- 172.21.15.35:0/3874473242 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9100a1580 con 0x559527b83040 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.453+0000 7ff9057fa700 1 -- 172.21.15.35:0/3874473242 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910099680 con 0x559527b83040 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 -- 172.21.15.35:0/3874473242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 msgr2=0x559527b83410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b83410 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff9100a1050 tx=0x7ff910099050 comp rx=0 tx=0).stop 2023-03-17T10:07:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 -- 172.21.15.35:0/3874473242 shutdown_connections 2023-03-17T10:07:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b89dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b83410 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 --2- 172.21.15.35:0/3874473242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7d830 0x559527b7dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 -- 172.21.15.35:0/3874473242 >> 172.21.15.35:0/3874473242 conn(0x5595279d66b0 msgr2=0x559527b73a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 -- 172.21.15.35:0/3874473242 shutdown_connections 2023-03-17T10:07:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 -- 172.21.15.35:0/3874473242 wait complete. 2023-03-17T10:07:28.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 -- start start 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.454+0000 7ff931984b80 1 Processor -- start 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b8cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b8d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b86d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952794f8c0 con 0x559527b83040 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b87370 con 0x559527b7e1e0 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b87530 con 0x559527b7d830 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 10 client.0 _ll_register_callbacks cb 0x559527971230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:07:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b86d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:30.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b86d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48804/0 (socket says 172.21.15.35:48804) 2023-03-17T10:07:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 -- 172.21.15.35:0/2342107901 learned_addr learned my addr 172.21.15.35:0/2342107901 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:07:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91effd700 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b8cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:34.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:34 smithi035 ceph-mon[92535]: pgmap v2356: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 -- 172.21.15.35:0/2342107901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 msgr2=0x559527b8cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b8cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 -- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 msgr2=0x559527b8d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b8d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 -- 172.21.15.35:0/2342107901 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920110000 con 0x559527b83040 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b86d90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff9180040e0 tx=0x7ff9180044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52903021a6506978 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff902ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff902ff5700 1 -- 172.21.15.35:0/2342107901 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918003b90 con 0x559527b83040 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559527a8e390 con 0x559527b83040 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.455+0000 7ff902ff5700 1 -- 172.21.15.35:0/2342107901 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(197..197 src has 1..197) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff918007a90 con 0x559527b83040 2023-03-17T10:07:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff902ff5700 1 -- 172.21.15.35:0/2342107901 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff918007c50 con 0x559527b83040 2023-03-17T10:07:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 10 client.18126 fetch_fsmap learned FSMap version 37 2023-03-17T10:07:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5595278f9d80 con 0x559527b83040 2023-03-17T10:07:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff902ff5700 1 -- 172.21.15.35:0/2342107901 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559527a8e390 con 0x559527b83040 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff902ff5700 1 -- 172.21.15.35:0/2342107901 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff918014040 con 0x559527b83040 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 10 client.18126 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 10 client.18126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 20 client.18126 populate_metadata read hostname 'smithi035' 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527b97340 0x559527b99750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 4 client.18126 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559527a9a600 con 0x559527b97340 2023-03-17T10:07:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.456+0000 7ff91effd700 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527b97340 0x559527b99750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:36.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.457+0000 7ff902ff5700 10 client.18126 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:07:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.457+0000 7ff91effd700 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527b97340 0x559527b99750 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4296f0017c736fd6 server_cookie=963a64ebce8855dc in_seq=0 out_seq=0 2023-03-17T10:07:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.457+0000 7ff902ff5700 1 -- 172.21.15.35:0/2342107901 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559527a9a600 con 0x559527b97340 2023-03-17T10:07:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.457+0000 7ff902ff5700 10 client.18126 handle_command_reply: tid=0 2023-03-17T10:07:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.457+0000 7ff931984b80 1 client.18126 shutdown 2023-03-17T10:07:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 msgr2=0x559527b86d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b86d90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff9180040e0 tx=0x7ff9180044a0 comp rx=0 tx=0).stop 2023-03-17T10:07:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 shutdown_connections 2023-03-17T10:07:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527b97340 0x559527b99750 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b86d90 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff902ff5700 0 client.18126 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:07:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b8cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 --2- 172.21.15.35:0/2342107901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b8d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 >> 172.21.15.35:0/2342107901 conn(0x5595279d66b0 msgr2=0x559527b78410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 shutdown_connections 2023-03-17T10:07:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 1 -- 172.21.15.35:0/2342107901 wait complete. 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.458+0000 7ff931984b80 20 client.18126 trim_cache size 0 max 16384 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 Processor -- start 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 -- start start 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b7dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b86570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b6f0f0 con 0x559527b83040 2023-03-17T10:07:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b705c0 con 0x559527b7e1e0 2023-03-17T10:07:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff931984b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b70b60 con 0x559527b7d830 2023-03-17T10:07:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff91f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff91f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b8c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48810/0 (socket says 172.21.15.35:48810) 2023-03-17T10:07:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff91f7fe700 1 -- 172.21.15.35:0/3022827327 learned_addr learned my addr 172.21.15.35:0/3022827327 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:07:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b86570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.473+0000 7ff91effd700 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b7dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91f7fe700 1 -- 172.21.15.35:0/3022827327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 msgr2=0x559527b7dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b7dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:47.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91f7fe700 1 -- 172.21.15.35:0/3022827327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 msgr2=0x559527b86570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b86570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91f7fe700 1 -- 172.21.15.35:0/3022827327 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559527a92130 con 0x559527b83040 2023-03-17T10:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b86570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b8c930 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff918000f80 tx=0x7ff918009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ccd21e1ad1969 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff905ffb700 1 -- 172.21.15.35:0/3022827327 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9180156b0 con 0x559527b83040 2023-03-17T10:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff905ffb700 1 -- 172.21.15.35:0/3022827327 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff91800f040 con 0x559527b83040 2023-03-17T10:07:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff905ffb700 1 -- 172.21.15.35:0/3022827327 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918007af0 con 0x559527b83040 2023-03-17T10:07:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff931984b80 1 -- 172.21.15.35:0/3022827327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 msgr2=0x559527b8c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff931984b80 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b8c930 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff918000f80 tx=0x7ff918009540 comp rx=0 tx=0).stop 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff931984b80 1 -- 172.21.15.35:0/3022827327 shutdown_connections 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff931984b80 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b83040 0x559527b8c930 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.474+0000 7ff931984b80 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7d830 0x559527b7dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 --2- 172.21.15.35:0/3022827327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b7e1e0 0x559527b86570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- 172.21.15.35:0/3022827327 >> 172.21.15.35:0/3022827327 conn(0x5595279d66b0 msgr2=0x559527b9e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- 172.21.15.35:0/3022827327 shutdown_connections 2023-03-17T10:07:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- 172.21.15.35:0/3022827327 wait complete. 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- start start 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 Processor -- start 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 0x559527b93630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b91920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b83040 0x559527b91e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b923a0 con 0x559527b7d830 2023-03-17T10:07:50.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b92510 con 0x559527b83040 2023-03-17T10:07:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.475+0000 7ff931984b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559527b926d0 con 0x559527b7e1e0 2023-03-17T10:07:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff931984b80 10 client.0 _ll_register_callbacks cb 0x559527971230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:07:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 0x559527b93630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 0x559527b93630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48814/0 (socket says 172.21.15.35:48814) 2023-03-17T10:07:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 -- 172.21.15.35:0/2777120469 learned_addr learned my addr 172.21.15.35:0/2777120469 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b91920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b83040 0x559527b91e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 -- 172.21.15.35:0/2777120469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 msgr2=0x559527b91920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b91920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 -- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b83040 msgr2=0x559527b91e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b83040 0x559527b91e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 -- 172.21.15.35:0/2777120469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff914011b30 con 0x559527b7d830 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b91920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91f7fe700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b83040 0x559527b91e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff91effd700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 0x559527b93630 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff910095920 tx=0x7ff9100cb9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d771f48597173ec server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff902ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:07:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff902ff5700 1 -- 172.21.15.35:0/2777120469 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100228c0 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff902ff5700 1 -- 172.21.15.35:0/2777120469 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(197..197 src has 1..197) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff91000fa90 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559527b491e0 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff902ff5700 1 -- 172.21.15.35:0/2777120469 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff91000fc50 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff931984b80 10 client.18132 fetch_fsmap learned FSMap version 37 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.476+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5595278f9d80 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff902ff5700 1 -- 172.21.15.35:0/2777120469 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff910065020 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff902ff5700 1 -- 172.21.15.35:0/2777120469 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff9100989a0 con 0x559527b7d830 2023-03-17T10:07:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff931984b80 10 client.18132 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:07:56.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff931984b80 10 client.18132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:07:56.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff931984b80 20 client.18132 populate_metadata read hostname 'smithi035' 2023-03-17T10:07:56.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff931984b80 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527bec210 0x559527bee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:07:56.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff931984b80 4 client.18132 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:07:56.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55952794ff00 con 0x559527bec210 2023-03-17T10:07:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527bec210 0x559527bee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:07:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff91e7fc700 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527bec210 0x559527bee5f0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6dd32856cceaa09 server_cookie=7c08570d9ef71b85 in_seq=0 out_seq=0 2023-03-17T10:07:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.477+0000 7ff902ff5700 10 client.18132 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:07:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff902ff5700 1 -- 172.21.15.35:0/2777120469 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55952794ff00 con 0x559527bec210 2023-03-17T10:07:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff902ff5700 10 client.18132 handle_command_reply: tid=0 2023-03-17T10:08:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 client.18132 shutdown 2023-03-17T10:08:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 msgr2=0x559527b93630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 0x559527b93630 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff910095920 tx=0x7ff9100cb9c0 comp rx=0 tx=0).stop 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 shutdown_connections 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559527bec210 0x559527bee5f0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559527b83040 0x559527b91e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff902ff5700 0 client.18132 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559527b7d830 0x559527b93630 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 --2- 172.21.15.35:0/2777120469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559527b7e1e0 0x559527b91920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 >> 172.21.15.35:0/2777120469 conn(0x5595279d66b0 msgr2=0x559527b8c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 shutdown_connections 2023-03-17T10:08:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 1 -- 172.21.15.35:0/2777120469 wait complete. 2023-03-17T10:08:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff931984b80 20 client.18132 trim_cache size 0 max 16384 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff90809f640 msgr2=0x7ff9080a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff9257f7700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff90809f640 0x7ff9080a1af0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff920197840 tx=0x7ff914009260 comp rx=0 tx=0).stop 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 msgr2=0x7ff920196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.485+0000 7ff9257f7700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff920196230 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ff910000c00 tx=0x7ff910005f10 comp rx=0 tx=0).stop 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 shutdown_connections 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff90809f640 0x7ff9080a1af0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92010acb0 0x7ff92019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9200ff3f0 0x7ff920196230 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 --2- 172.21.15.35:0/2502166907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9200ffd00 0x7ff920196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 >> 172.21.15.35:0/2502166907 conn(0x7ff9200749e0 msgr2=0x7ff9200fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 shutdown_connections 2023-03-17T10:08:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:12.486+0000 7ff9257f7700 1 -- 172.21.15.35:0/2502166907 wait complete. 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 -- 172.21.15.35:0/4136541899 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101b80 msgr2=0x7fcbf810a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/4136541899 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101b80 0x7fcbf810a250 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009990 tx=0x7fcbe0009ca0 comp rx=0 tx=0).stop 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 -- 172.21.15.35:0/4136541899 shutdown_connections 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/4136541899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf810a790 0x7fcbf810cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/4136541899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf8101270 0x7fcbf8101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/4136541899 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101b80 0x7fcbf810a250 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 -- 172.21.15.35:0/4136541899 >> 172.21.15.35:0/4136541899 conn(0x7fcbf8076330 msgr2=0x7fcbf8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 -- 172.21.15.35:0/4136541899 shutdown_connections 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.607+0000 7fcbfda8d700 1 -- 172.21.15.35:0/4136541899 wait complete. 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 Processor -- start 2023-03-17T10:08:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 -- start start 2023-03-17T10:08:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 0x7fcbf81961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf8101b80 0x7fcbf8196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf810a790 0x7fcbf819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf819b1d0 con 0x7fcbf8101270 2023-03-17T10:08:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf819b340 con 0x7fcbf810a790 2023-03-17T10:08:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.608+0000 7fcbfda8d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf819b500 con 0x7fcbf8101b80 2023-03-17T10:08:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 0x7fcbf81961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 0x7fcbf81961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48828/0 (socket says 172.21.15.35:48828) 2023-03-17T10:08:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2887782060 learned_addr learned my addr 172.21.15.35:0/2887782060 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf8101b80 0x7fcbf8196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf810a790 0x7fcbf819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2887782060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf8101b80 msgr2=0x7fcbf8196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf8101b80 0x7fcbf8196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2887782060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf810a790 msgr2=0x7fcbf819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf810a790 0x7fcbf819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2887782060 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00095f0 con 0x7fcbf8101270 2023-03-17T10:08:10.806 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:36 smithi035 ceph-mon[92535]: pgmap v2357: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf810a790 0x7fcbf819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:08:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 0x7fcbf81961f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d950 tx=0x7fcbe800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf4ff9700 1 -- 172.21.15.35:0/2887782060 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8009940 con 0x7fcbf8101270 2023-03-17T10:08:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf81100c0 con 0x7fcbf8101270 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf4ff9700 1 -- 172.21.15.35:0/2887782060 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbe8010460 con 0x7fcbf8101270 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbf4ff9700 1 -- 172.21.15.35:0/2887782060 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800f620 con 0x7fcbf8101270 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.609+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf810ff30 con 0x7fcbf8101270 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.612+0000 7fcbf4ff9700 1 -- 172.21.15.35:0/2887782060 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcbe80105d0 con 0x7fcbf8101270 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.612+0000 7fcbf4ff9700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcbe409f640 0x7fcbe40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.612+0000 7fcbf4ff9700 1 -- 172.21.15.35:0/2887782060 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcbe80ca470 con 0x7fcbf8101270 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.612+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcbe409f640 0x7fcbe40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 Processor -- start 2023-03-17T10:08:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcbe409f640 0x7fcbe40a1af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8197800 tx=0x7fcbe0005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 -- start start 2023-03-17T10:08:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bf6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bf1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282af8010 con 0x55b282bf1960 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282b4a950 con 0x55b282bf74f0 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282b43de0 con 0x55b282bf6be0 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcbf7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.613+0000 7fcbf7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48840/0 (socket says 172.21.15.35:48840) 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 -- 172.21.15.35:0/3027535234 learned_addr learned my addr 172.21.15.35:0/3027535234 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bf6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:13.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bf1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 -- 172.21.15.35:0/3027535234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 msgr2=0x55b282bf6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bf6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 -- 172.21.15.35:0/3027535234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 msgr2=0x55b282bf1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bf1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 -- 172.21.15.35:0/3027535234 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2829c55d0 con 0x55b282bf1960 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bf1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1d90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009ca0 tx=0x7fcbf0007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf133f0614f701c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbedffb700 1 -- 172.21.15.35:0/3027535234 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0004bb0 con 0x55b282bf1960 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbedffb700 1 -- 172.21.15.35:0/3027535234 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbf0004d10 con 0x55b282bf1960 2023-03-17T10:08:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.614+0000 7fcbedffb700 1 -- 172.21.15.35:0/3027535234 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0014660 con 0x55b282bf1960 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/3027535234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 msgr2=0x55b282bf1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1d90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009ca0 tx=0x7fcbf0007500 comp rx=0 tx=0).stop 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/3027535234 shutdown_connections 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1d90 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bf6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/3027535234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bf1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/3027535234 >> 172.21.15.35:0/3027535234 conn(0x55b282a4e6b0 msgr2=0x55b282beba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/3027535234 shutdown_connections 2023-03-17T10:08:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/3027535234 wait complete. 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.615+0000 7fcc09c1ab80 1 -- start start 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 Processor -- start 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf1960 0x55b282bfd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 0x55b282bfa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2829c78c0 con 0x55b282bf6be0 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282bfb250 con 0x55b282bf74f0 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282bfb410 con 0x55b282bf1960 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcc09c1ab80 10 client.0 _ll_register_callbacks cb 0x55b2829e9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:08:13.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 0x55b282bfa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 0x55b282bfa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48844/0 (socket says 172.21.15.35:48844) 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 -- 172.21.15.35:0/4077089485 learned_addr learned my addr 172.21.15.35:0/4077089485 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf1960 0x55b282bfd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 -- 172.21.15.35:0/4077089485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf1960 msgr2=0x55b282bfd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf1960 0x55b282bfd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 -- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 msgr2=0x55b282bfab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.616+0000 7fcbf6ffd700 1 -- 172.21.15.35:0/4077089485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf0009900 con 0x55b282bf6be0 2023-03-17T10:08:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 0x55b282bfa5d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0015000 tx=0x7fcbe001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3959bb8e7eeae0d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:08:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4077089485 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000be60 con 0x55b282bf6be0 2023-03-17T10:08:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4077089485 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcbe0004ba0 con 0x55b282bf6be0 2023-03-17T10:08:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b282b06390 con 0x55b282bf6be0 2023-03-17T10:08:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4077089485 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbe0004d60 con 0x55b282bf6be0 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 10 client.18144 fetch_fsmap learned FSMap version 37 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55b282971d80 con 0x55b282bf6be0 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4077089485 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b282b06390 con 0x55b282bf6be0 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4077089485 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcbe000f460 con 0x55b282bf6be0 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 10 client.18144 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 10 client.18144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 20 client.18144 populate_metadata read hostname 'smithi035' 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c0b000 0x55b282c0d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 4 client.18144 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.617+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b282b12600 con 0x55b282c0b000 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.618+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c0b000 0x55b282c0d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.618+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c0b000 0x55b282c0d410 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca00d0f4cf2ce3de server_cookie=8149fb2e3af0caf in_seq=0 out_seq=0 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.618+0000 7fcbd6ffd700 10 client.18144 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4077089485 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b282b12600 con 0x55b282c0b000 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcbd6ffd700 10 client.18144 handle_command_reply: tid=0 2023-03-17T10:08:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 client.18144 shutdown 2023-03-17T10:08:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 msgr2=0x55b282bfa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 0x55b282bfa5d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0015000 tx=0x7fcbe001a050 comp rx=0 tx=0).stop 2023-03-17T10:08:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 shutdown_connections 2023-03-17T10:08:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c0b000 0x55b282c0d410 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcbd6ffd700 0 client.18144 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf1960 0x55b282bfd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4077089485 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf6be0 0x55b282bfa5d0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 >> 172.21.15.35:0/4077089485 conn(0x55b282a4e6b0 msgr2=0x55b282beba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 shutdown_connections 2023-03-17T10:08:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4077089485 wait complete. 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.619+0000 7fcc09c1ab80 20 client.18144 trim_cache size 0 max 16384 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 Processor -- start 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 -- start start 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf6be0 0x55b282bebac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf74f0 0x55b282bf80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282bfb0f0 con 0x55b282bf1960 2023-03-17T10:08:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282b12600 con 0x55b282bf6be0 2023-03-17T10:08:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282b06390 con 0x55b282bf74f0 2023-03-17T10:08:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48850/0 (socket says 172.21.15.35:48850) 2023-03-17T10:08:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.634+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2163272014 learned_addr learned my addr 172.21.15.35:0/2163272014 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf6be0 0x55b282bebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf74f0 0x55b282bf80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2163272014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf74f0 msgr2=0x55b282bf80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf74f0 0x55b282bf80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2163272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf6be0 msgr2=0x55b282bebac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf6be0 0x55b282bebac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf77fe700 1 -- 172.21.15.35:0/2163272014 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b282b0a130 con 0x55b282bf1960 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf6be0 0x55b282bebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1420 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8010880 tx=0x7fcbe800d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd799eab015c2df9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbee7fc700 1 -- 172.21.15.35:0/2163272014 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8096120 con 0x55b282bf1960 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbee7fc700 1 -- 172.21.15.35:0/2163272014 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbe8014070 con 0x55b282bf1960 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.635+0000 7fcbee7fc700 1 -- 172.21.15.35:0/2163272014 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe809fc80 con 0x55b282bf1960 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/2163272014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 msgr2=0x55b282bf1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1420 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8010880 tx=0x7fcbe800d8d0 comp rx=0 tx=0).stop 2023-03-17T10:08:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/2163272014 shutdown_connections 2023-03-17T10:08:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf74f0 0x55b282bf80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282bf1420 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/2163272014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf6be0 0x55b282bebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/2163272014 >> 172.21.15.35:0/2163272014 conn(0x55b282a4e6b0 msgr2=0x55b282bf7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/2163272014 shutdown_connections 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/2163272014 wait complete. 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- start start 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 Processor -- start 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282c01db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bfe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282bfeb70 con 0x55b282bf1960 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282bfecb0 con 0x55b282bf74f0 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b282bfee70 con 0x55b282bf6be0 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.636+0000 7fcc09c1ab80 10 client.0 _ll_register_callbacks cb 0x55b2829e9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282c01db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282c01db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48856/0 (socket says 172.21.15.35:48856) 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 -- 172.21.15.35:0/4167125010 learned_addr learned my addr 172.21.15.35:0/4167125010 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf7fff700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bfe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 -- 172.21.15.35:0/4167125010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 msgr2=0x55b282bfe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bfe0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 -- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 msgr2=0x55b282bfe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 -- 172.21.15.35:0/4167125010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf810ff30 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbf77fe700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282c01db0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80c7cb0 tx=0x7fcbe80984e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbbbef62b00cab0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4167125010 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe809fc80 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4167125010 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcbe809fde0 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b282bc11e0 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4167125010 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbe8092b30 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcc09c1ab80 10 client.18150 fetch_fsmap learned FSMap version 37 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.637+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55b2829981f0 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4167125010 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b282bc11e0 con 0x55b282bf1960 2023-03-17T10:08:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4167125010 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcbe8096ff0 con 0x55b282bf1960 2023-03-17T10:08:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcc09c1ab80 10 client.18150 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:08:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcc09c1ab80 10 client.18150 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:08:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcc09c1ab80 20 client.18150 populate_metadata read hostname 'smithi035' 2023-03-17T10:08:33.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:37 smithi035 ceph-mon[92535]: pgmap v2358: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c64220 0x55b282c66600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcc09c1ab80 4 client.18150 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:08:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2829c7f00 con 0x55b282c64220 2023-03-17T10:08:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c64220 0x55b282c66600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcbd6ffd700 10 client.18150 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:33.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.638+0000 7fcbf6ffd700 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c64220 0x55b282c66600 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5fe7f05d693919b server_cookie=34338952762ba231 in_seq=0 out_seq=0 2023-03-17T10:08:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.643+0000 7fcbd6ffd700 1 -- 172.21.15.35:0/4167125010 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2829c7f00 con 0x55b282c64220 2023-03-17T10:08:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.643+0000 7fcbd6ffd700 10 client.18150 handle_command_reply: tid=0 2023-03-17T10:08:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.643+0000 7fcc09c1ab80 1 client.18150 shutdown 2023-03-17T10:08:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 msgr2=0x55b282c01db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282c01db0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80c7cb0 tx=0x7fcbe80984e0 comp rx=0 tx=0).stop 2023-03-17T10:08:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 shutdown_connections 2023-03-17T10:08:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b282c64220 0x55b282c66600 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b282bf74f0 0x55b282bfe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b282bf1960 0x55b282c01db0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:37.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 --2- 172.21.15.35:0/4167125010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b282bf6be0 0x55b282bfe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 >> 172.21.15.35:0/4167125010 conn(0x55b282a4e6b0 msgr2=0x55b282bf56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbd6ffd700 0 client.18150 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 shutdown_connections 2023-03-17T10:08:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 1 -- 172.21.15.35:0/4167125010 wait complete. 2023-03-17T10:08:37.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcc09c1ab80 20 client.18150 trim_cache size 0 max 16384 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcbe409f640 msgr2=0x7fcbe40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcbe409f640 0x7fcbe40a1af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8197800 tx=0x7fcbe0005fb0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 msgr2=0x7fcbf81961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 0x7fcbf81961f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d950 tx=0x7fcbe800dc60 comp rx=0 tx=0).stop 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 shutdown_connections 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcbe409f640 0x7fcbe40a1af0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbf810a790 0x7fcbf819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcbf8101270 0x7fcbf81961f0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 --2- 172.21.15.35:0/2887782060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbf8101b80 0x7fcbf8196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.644+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 >> 172.21.15.35:0/2887782060 conn(0x7fcbf8076330 msgr2=0x7fcbf80fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.645+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 shutdown_connections 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:25.645+0000 7fcbfda8d700 1 -- 172.21.15.35:0/2887782060 wait complete. 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 -- 172.21.15.35:0/482416214 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 msgr2=0x7f7294103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 --2- 172.21.15.35:0/482416214 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f7294103cb0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f72840099c0 tx=0x7f7284009cd0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 -- 172.21.15.35:0/482416214 shutdown_connections 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 --2- 172.21.15.35:0/482416214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7294104390 0x7f729410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 --2- 172.21.15.35:0/482416214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72940ff350 0x7f72940ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 --2- 172.21.15.35:0/482416214 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f7294103cb0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 -- 172.21.15.35:0/482416214 >> 172.21.15.35:0/482416214 conn(0x7f7294076330 msgr2=0x7f7294076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 -- 172.21.15.35:0/482416214 shutdown_connections 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.766+0000 7f729c575700 1 -- 172.21.15.35:0/482416214 wait complete. 2023-03-17T10:08:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 Processor -- start 2023-03-17T10:08:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 -- start start 2023-03-17T10:08:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72940ff350 0x7f72941962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f72941967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7294104390 0x7f729419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729419b290 con 0x7f72940ffcf0 2023-03-17T10:08:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729419b400 con 0x7f7294104390 2023-03-17T10:08:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729c575700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729419b5c0 con 0x7f72940ff350 2023-03-17T10:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f7299b10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f72941967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f7299b10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f72941967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48872/0 (socket says 172.21.15.35:48872) 2023-03-17T10:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f7299b10700 1 -- 172.21.15.35:0/500586153 learned_addr learned my addr 172.21.15.35:0/500586153 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729a311700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72940ff350 0x7f72941962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.767+0000 7f729ab12700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7294104390 0x7f729419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f7299b10700 1 -- 172.21.15.35:0/500586153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72940ff350 msgr2=0x7f72941962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f7299b10700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72940ff350 0x7f72941962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f7299b10700 1 -- 172.21.15.35:0/500586153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7294104390 msgr2=0x7f729419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f7299b10700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7294104390 0x7f729419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f7299b10700 1 -- 172.21.15.35:0/500586153 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72840095f0 con 0x7f72940ffcf0 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f729ab12700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7294104390 0x7f729419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f7299b10700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f72941967f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7284009990 tx=0x7f7284004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f728b7fe700 1 -- 172.21.15.35:0/500586153 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728401d070 con 0x7f72940ffcf0 2023-03-17T10:08:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f728b7fe700 1 -- 172.21.15.35:0/500586153 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7284004cc0 con 0x7f72940ffcf0 2023-03-17T10:08:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729410f010 con 0x7f72940ffcf0 2023-03-17T10:08:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f728b7fe700 1 -- 172.21.15.35:0/500586153 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284005720 con 0x7f72940ffcf0 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.768+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729410ee80 con 0x7f72940ffcf0 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.770+0000 7f728b7fe700 1 -- 172.21.15.35:0/500586153 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7284005120 con 0x7f72940ffcf0 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.771+0000 7f728b7fe700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f728009f6c0 0x7f72800a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.771+0000 7f729a311700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f728009f6c0 0x7f72800a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.771+0000 7f728b7fe700 1 -- 172.21.15.35:0/500586153 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f72840cb570 con 0x7f72940ffcf0 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f729a311700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f728009f6c0 0x7f72800a1b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7290005950 tx=0x7f729000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 Processor -- start 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 -- start start 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfaffe010 con 0x55bbfb0f7960 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb050950 con 0x55bbfb0fcbe0 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.772+0000 7f72a8702b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb049de0 con 0x55bbfb0fd4f0 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48882/0 (socket says 172.21.15.35:48882) 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 -- 172.21.15.35:0/2876129269 learned_addr learned my addr 172.21.15.35:0/2876129269 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729a311700 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f7299b10700 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 -- 172.21.15.35:0/2876129269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 msgr2=0x55bbfb0f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 -- 172.21.15.35:0/2876129269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 msgr2=0x55bbfb0fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 -- 172.21.15.35:0/2876129269 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbfaecb5d0 con 0x55bbfb0f7960 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f729ab12700 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f7d90 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f728c009dd0 tx=0x7f728c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f96c8474a13e3d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f7288ff9700 1 -- 172.21.15.35:0/2876129269 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c018070 con 0x55bbfb0f7960 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f7288ff9700 1 -- 172.21.15.35:0/2876129269 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f728c00f050 con 0x55bbfb0f7960 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.773+0000 7f7288ff9700 1 -- 172.21.15.35:0/2876129269 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c0059a0 con 0x55bbfb0f7960 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 -- 172.21.15.35:0/2876129269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 msgr2=0x55bbfb0f7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f7d90 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f728c009dd0 tx=0x7f728c0077e0 comp rx=0 tx=0).stop 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 -- 172.21.15.35:0/2876129269 shutdown_connections 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f7d90 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2876129269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 -- 172.21.15.35:0/2876129269 >> 172.21.15.35:0/2876129269 conn(0x55bbfaf546b0 msgr2=0x55bbfb0f1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 -- 172.21.15.35:0/2876129269 shutdown_connections 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 -- 172.21.15.35:0/2876129269 wait complete. 2023-03-17T10:08:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.774+0000 7f72a8702b80 1 -- start start 2023-03-17T10:08:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 Processor -- start 2023-03-17T10:08:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb1033e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb100660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb100c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfaecd8c0 con 0x55bbfb0f7960 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb101390 con 0x55bbfb0fcbe0 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb10d000 con 0x55bbfb0fd4f0 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f72a8702b80 10 client.0 _ll_register_callbacks cb 0x55bbfaeef230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb1033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb1033e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48884/0 (socket says 172.21.15.35:48884) 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 -- 172.21.15.35:0/904642888 learned_addr learned my addr 172.21.15.35:0/904642888 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f7299b10700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729ab12700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb100c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 -- 172.21.15.35:0/904642888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 msgr2=0x55bbfb100c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb100c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 -- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 msgr2=0x55bbfb100660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb100660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 -- 172.21.15.35:0/904642888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c009a00 con 0x55bbfb0f7960 2023-03-17T10:08:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f729a311700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb1033e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f72900116f0 tx=0x7f72900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6b8925d24477d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:08:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.775+0000 7f727dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:08:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f727dffb700 1 -- 172.21.15.35:0/904642888 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7290028470 con 0x55bbfb0f7960 2023-03-17T10:08:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f727dffb700 1 -- 172.21.15.35:0/904642888 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7290017070 con 0x55bbfb0f7960 2023-03-17T10:08:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbfb00c390 con 0x55bbfb0f7960 2023-03-17T10:08:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f727dffb700 1 -- 172.21.15.35:0/904642888 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72900285d0 con 0x55bbfb0f7960 2023-03-17T10:08:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 10 client.18162 fetch_fsmap learned FSMap version 37 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bbfae77d80 con 0x55bbfb0f7960 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f727dffb700 1 -- 172.21.15.35:0/904642888 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bbfb00c390 con 0x55bbfb0f7960 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f727dffb700 1 -- 172.21.15.35:0/904642888 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7290031770 con 0x55bbfb0f7960 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 10 client.18162 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 10 client.18162 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 20 client.18162 populate_metadata read hostname 'smithi035' 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb111030 0x55bbfb113440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 4 client.18162 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:08:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.776+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbfb018600 con 0x55bbfb111030 2023-03-17T10:08:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.777+0000 7f7299b10700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb111030 0x55bbfb113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:08:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.777+0000 7f7299b10700 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb111030 0x55bbfb113440 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0f63383c3b65ed server_cookie=821590ee2367ffc6 in_seq=0 out_seq=0 2023-03-17T10:08:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.777+0000 7f727dffb700 10 client.18162 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f727dffb700 1 -- 172.21.15.35:0/904642888 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55bbfb018600 con 0x55bbfb111030 2023-03-17T10:08:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f727dffb700 10 client.18162 handle_command_reply: tid=0 2023-03-17T10:08:54.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 client.18162 shutdown 2023-03-17T10:08:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 msgr2=0x55bbfb1033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:08:54.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb1033e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f72900116f0 tx=0x7f72900047c0 comp rx=0 tx=0).stop 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 shutdown_connections 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb111030 0x55bbfb113440 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb1033e0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f727dffb700 0 client.18162 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 --2- 172.21.15.35:0/904642888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 >> 172.21.15.35:0/904642888 conn(0x55bbfaf546b0 msgr2=0x55bbfb0f1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:08:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 shutdown_connections 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 1 -- 172.21.15.35:0/904642888 wait complete. 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.778+0000 7f72a8702b80 20 client.18162 trim_cache size 0 max 16384 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 Processor -- start 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 -- start start 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb107f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb0f2710 con 0x55bbfb0f7960 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb0ed0f0 con 0x55bbfb0fd4f0 2023-03-17T10:08:54.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f72a8702b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb0f2000 con 0x55bbfb0fcbe0 2023-03-17T10:08:54.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:39 smithi035 ceph-mon[92535]: pgmap v2359: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:42 smithi035 ceph-mon[92535]: pgmap v2360: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:44 smithi035 ceph-mon[92535]: pgmap v2361: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:46 smithi035 ceph-mon[92535]: pgmap v2362: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:48 smithi035 ceph-mon[92535]: pgmap v2363: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:50 smithi035 ceph-mon[92535]: pgmap v2364: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:52 smithi035 ceph-mon[92535]: pgmap v2365: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:54 smithi035 ceph-mon[92535]: pgmap v2366: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:55 smithi035 ceph-mon[92535]: pgmap v2367: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:58:58 smithi035 ceph-mon[92535]: pgmap v2368: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:57.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:00 smithi035 ceph-mon[92535]: pgmap v2369: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:08:58.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:02 smithi035 ceph-mon[92535]: pgmap v2370: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:08:58.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:04 smithi035 ceph-mon[92535]: pgmap v2371: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:08:58.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:06 smithi035 ceph-mon[92535]: pgmap v2372: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:08:58.797 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:08 smithi035 ceph-mon[92535]: pgmap v2373: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:08 smithi035 ceph-mon[92535]: pgmap v2374: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:08 smithi035 ceph-mon[92535]: pgmap v2375: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:10 smithi035 ceph-mon[92535]: osdmap e225: 12 total, 12 up, 12 in 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:10 smithi035 ceph-mon[92535]: pgmap v2377: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:13 smithi035 ceph-mon[92535]: pgmap v2378: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:15 smithi035 ceph-mon[92535]: pgmap v2379: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:17 smithi035 ceph-mon[92535]: pgmap v2380: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:17 smithi035 ceph-mon[92535]: osdmap e226: 12 total, 12 up, 12 in 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:19 smithi035 ceph-mon[92535]: pgmap v2382: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:21 smithi035 ceph-mon[92535]: pgmap v2383: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:23 smithi035 ceph-mon[92535]: pgmap v2384: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:08:58.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:25 smithi035 ceph-mon[92535]: pgmap v2385: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T10:08:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:09:01.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:09:01.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:09:01.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48892/0 (socket says 172.21.15.35:48892) 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 -- 172.21.15.35:0/2845530567 learned_addr learned my addr 172.21.15.35:0/2845530567 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f7299b10700 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729ab12700 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 -- 172.21.15.35:0/2845530567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fcbe0 msgr2=0x55bbfb0fe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:01.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 -- 172.21.15.35:0/2845530567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 msgr2=0x55bbfb107f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb107f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729a311700 1 -- 172.21.15.35:0/2845530567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbfb010130 con 0x55bbfb0f7960 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.793+0000 7f729ab12700 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f729a311700 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f1ac0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7290010c50 tx=0x7f7290010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5e1619248387b3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72897fa700 1 -- 172.21.15.35:0/2845530567 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7290011a00 con 0x55bbfb0f7960 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72897fa700 1 -- 172.21.15.35:0/2845530567 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7290015070 con 0x55bbfb0f7960 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72897fa700 1 -- 172.21.15.35:0/2845530567 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72900289f0 con 0x55bbfb0f7960 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 -- 172.21.15.35:0/2845530567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 msgr2=0x55bbfb0f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f1ac0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7290010c50 tx=0x7f7290010c80 comp rx=0 tx=0).stop 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 -- 172.21.15.35:0/2845530567 shutdown_connections 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0f7960 0x55bbfb0f1ac0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 --2- 172.21.15.35:0/2845530567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0fe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 -- 172.21.15.35:0/2845530567 >> 172.21.15.35:0/2845530567 conn(0x55bbfaf546b0 msgr2=0x55bbfb0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:01.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 -- 172.21.15.35:0/2845530567 shutdown_connections 2023-03-17T10:09:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.794+0000 7f72a8702b80 1 -- 172.21.15.35:0/2845530567 wait complete. 2023-03-17T10:09:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 -- start start 2023-03-17T10:09:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 Processor -- start 2023-03-17T10:09:01.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0f7960 0x55bbfb108140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0f8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb0f94b0 con 0x55bbfb0fcbe0 2023-03-17T10:09:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb0f9620 con 0x55bbfb0fd4f0 2023-03-17T10:09:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbfb1692e0 con 0x55bbfb0f7960 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f72a8702b80 10 client.0 _ll_register_callbacks cb 0x55bbfaeef230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48900/0 (socket says 172.21.15.35:48900) 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 -- 172.21.15.35:0/773563675 learned_addr learned my addr 172.21.15.35:0/773563675 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f729a311700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0f7960 0x55bbfb108140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f729ab12700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 -- 172.21.15.35:0/773563675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0f7960 msgr2=0x55bbfb108140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0f7960 0x55bbfb108140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 -- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 msgr2=0x55bbfb0f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.795+0000 7f7299b10700 1 -- 172.21.15.35:0/773563675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbfae77d80 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f7299b10700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0f8880 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f72840095c0 tx=0x7f728409c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98aef64baacadb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f727dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f727dffb700 1 -- 172.21.15.35:0/773563675 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840c8a40 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f727dffb700 1 -- 172.21.15.35:0/773563675 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f72840c7070 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbfb0c71e0 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f727dffb700 1 -- 172.21.15.35:0/773563675 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72840a1210 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 10 client.18168 fetch_fsmap learned FSMap version 37 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55bbfae9e1f0 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f727dffb700 1 -- 172.21.15.35:0/773563675 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bbfb0c71e0 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f727dffb700 1 -- 172.21.15.35:0/773563675 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7284099310 con 0x55bbfb0fcbe0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 10 client.18168 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 10 client.18168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 20 client.18168 populate_metadata read hostname 'smithi035' 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb16a570 0x55bbfb16c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 4 client.18168 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.796+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bbfaecdf00 con 0x55bbfb16a570 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.797+0000 7f729a311700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb16a570 0x55bbfb16c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.797+0000 7f729a311700 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb16a570 0x55bbfb16c980 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b94c88fe3a3ca054 server_cookie=d09775e34d1ee4b7 in_seq=0 out_seq=0 2023-03-17T10:09:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.797+0000 7f727dffb700 10 client.18168 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f727dffb700 1 -- 172.21.15.35:0/773563675 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bbfaecdf00 con 0x55bbfb16a570 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f727dffb700 10 client.18168 handle_command_reply: tid=0 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 client.18168 shutdown 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 msgr2=0x55bbfb0f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0f8880 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f72840095c0 tx=0x7f728409c040 comp rx=0 tx=0).stop 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 shutdown_connections 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bbfb16a570 0x55bbfb16c980 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bbfb0fd4f0 0x55bbfb0f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbfb0f7960 0x55bbfb108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 --2- 172.21.15.35:0/773563675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bbfb0fcbe0 0x55bbfb0f8880 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f727dffb700 0 client.18168 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.801+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 >> 172.21.15.35:0/773563675 conn(0x55bbfaf546b0 msgr2=0x55bbfb0fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 shutdown_connections 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f72a8702b80 1 -- 172.21.15.35:0/773563675 wait complete. 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f72a8702b80 20 client.18168 trim_cache size 0 max 16384 2023-03-17T10:09:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f728009f6c0 msgr2=0x7f72800a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f728009f6c0 0x7f72800a1b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7290005950 tx=0x7f729000b410 comp rx=0 tx=0).stop 2023-03-17T10:09:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 msgr2=0x7f72941967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f72941967f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7284009990 tx=0x7f7284004730 comp rx=0 tx=0).stop 2023-03-17T10:09:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 shutdown_connections 2023-03-17T10:09:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f728009f6c0 0x7f72800a1b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7294104390 0x7f729419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72940ff350 0x7f72941962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 --2- 172.21.15.35:0/500586153 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72940ffcf0 0x7f72941967f0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 >> 172.21.15.35:0/500586153 conn(0x7f7294076330 msgr2=0x7f72940680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 shutdown_connections 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:38.802+0000 7f729c575700 1 -- 172.21.15.35:0/500586153 wait complete. 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 -- 172.21.15.35:0/4220596378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 msgr2=0x7f6aec10cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4220596378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec10cc30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400b0a0 tx=0x7f6ae400b3b0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 -- 172.21.15.35:0/4220596378 shutdown_connections 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4220596378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec10cc30 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4220596378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aec101490 0x7f6aec101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4220596378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aec101da0 0x7f6aec10a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 -- 172.21.15.35:0/4220596378 >> 172.21.15.35:0/4220596378 conn(0x7f6aec075f60 msgr2=0x7f6aec076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 -- 172.21.15.35:0/4220596378 shutdown_connections 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.925+0000 7f6af0f81700 1 -- 172.21.15.35:0/4220596378 wait complete. 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 Processor -- start 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 -- start start 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aec101490 0x7f6aec196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aec101da0 0x7f6aec1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec19b340 con 0x7f6aec10a7d0 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec19b4b0 con 0x7f6aec101da0 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.926+0000 7f6af0f81700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec19b670 con 0x7f6aec101490 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec19ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48916/0 (socket says 172.21.15.35:48916) 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 -- 172.21.15.35:0/4266226200 learned_addr learned my addr 172.21.15.35:0/4266226200 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aec101da0 0x7f6aec1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aea59c700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aec101490 0x7f6aec196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 -- 172.21.15.35:0/4266226200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aec101490 msgr2=0x7f6aec196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aec101490 0x7f6aec196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 -- 172.21.15.35:0/4266226200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aec101da0 msgr2=0x7f6aec1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aec101da0 0x7f6aec1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 -- 172.21.15.35:0/4266226200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009d00 con 0x7f6aec10a7d0 2023-03-17T10:09:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6aead9d700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec19ad00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400b780 tx=0x7f6ae400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6ae37fe700 1 -- 172.21.15.35:0/4266226200 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400e040 con 0x7f6aec10a7d0 2023-03-17T10:09:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6ae37fe700 1 -- 172.21.15.35:0/4266226200 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ae4004e60 con 0x7f6aec10a7d0 2023-03-17T10:09:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec1100f0 con 0x7f6aec10a7d0 2023-03-17T10:09:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6ae37fe700 1 -- 172.21.15.35:0/4266226200 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40052a0 con 0x7f6aec10a7d0 2023-03-17T10:09:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.927+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec10ff60 con 0x7f6aec10a7d0 2023-03-17T10:09:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.930+0000 7f6ae37fe700 1 -- 172.21.15.35:0/4266226200 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6ae4005400 con 0x7f6aec10a7d0 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.930+0000 7f6ae37fe700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6ad809f640 0x7f6ad80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.930+0000 7f6ae37fe700 1 -- 172.21.15.35:0/4266226200 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6ae40cbcd0 con 0x7f6aec10a7d0 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.930+0000 7f6aea59c700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6ad809f640 0x7f6ad80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.931+0000 7f6aea59c700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6ad809f640 0x7f6ad80a1af0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4005950 tx=0x7f6ad40058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.931+0000 7f6afd10eb80 1 Processor -- start 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.931+0000 7f6afd10eb80 1 -- start start 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a09410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f41a0fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41906010 con 0x564f41a03830 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41958950 con 0x564f41a041e0 2023-03-17T10:09:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41951de0 con 0x564f41a09040 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a09410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48922/0 (socket says 172.21.15.35:48922) 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 -- 172.21.15.35:0/618643033 learned_addr learned my addr 172.21.15.35:0/618643033 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6aead9d700 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f41a0fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 -- 172.21.15.35:0/618643033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 msgr2=0x564f41a09410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a09410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 -- 172.21.15.35:0/618643033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 msgr2=0x564f41a0fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f41a0fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 -- 172.21.15.35:0/618643033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f417d35d0 con 0x564f41a03830 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6aea59c700 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a09410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.932+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03ca0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009cb0 tx=0x7f6adc011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202ef0fad2e27c38 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6ae0ff9700 1 -- 172.21.15.35:0/618643033 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc011d80 con 0x564f41a03830 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6ae0ff9700 1 -- 172.21.15.35:0/618643033 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6adc004cc0 con 0x564f41a03830 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6ae0ff9700 1 -- 172.21.15.35:0/618643033 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc019430 con 0x564f41a03830 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 -- 172.21.15.35:0/618643033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 msgr2=0x564f41a03ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03ca0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009cb0 tx=0x7f6adc011440 comp rx=0 tx=0).stop 2023-03-17T10:09:11.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 -- 172.21.15.35:0/618643033 shutdown_connections 2023-03-17T10:09:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f41a0fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a09410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/618643033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03ca0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.933+0000 7f6afd10eb80 1 -- 172.21.15.35:0/618643033 >> 172.21.15.35:0/618643033 conn(0x564f4185c6b0 msgr2=0x564f419f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:15.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 -- 172.21.15.35:0/618643033 shutdown_connections 2023-03-17T10:09:15.332 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:27 smithi035 ceph-mon[92535]: pgmap v2386: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 -- 172.21.15.35:0/618643033 wait complete. 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 -- start start 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 Processor -- start 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a0fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a0cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a0d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f417d58c0 con 0x564f41a03830 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41a0dcd0 con 0x564f41a09040 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41a194e0 con 0x564f41a041e0 2023-03-17T10:09:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6afd10eb80 10 client.0 _ll_register_callbacks cb 0x564f417f7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a0fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a0fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48926/0 (socket says 172.21.15.35:48926) 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.934+0000 7f6aea59c700 1 -- 172.21.15.35:0/1112551696 learned_addr learned my addr 172.21.15.35:0/1112551696 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aead9d700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a0d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a0cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aea59c700 1 -- 172.21.15.35:0/1112551696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 msgr2=0x564f41a0cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aea59c700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a0cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aea59c700 1 -- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 msgr2=0x564f41a0d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aea59c700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a0d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aea59c700 1 -- 172.21.15.35:0/1112551696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0098e0 con 0x564f41a03830 2023-03-17T10:09:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a0cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:09:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aead9d700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a0d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:09:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6aea59c700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a0fd20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40114c0 tx=0x7f6ad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a73455f020f40d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ad1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/1112551696 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400fa40 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/1112551696 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6ad401f430 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f41914390 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/1112551696 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad4028670 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6afd10eb80 10 client.18180 fetch_fsmap learned FSMap version 37 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564f4177fd80 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.935+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/1112551696 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f41914390 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/1112551696 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6ad401fb40 con 0x564f41a03830 2023-03-17T10:09:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6afd10eb80 10 client.18180 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6afd10eb80 10 client.18180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6afd10eb80 20 client.18180 populate_metadata read hostname 'smithi035' 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a1d610 0x564f41a1fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6afd10eb80 4 client.18180 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f41920600 con 0x564f41a1d610 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a1d610 0x564f41a1fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6ad1ffb700 10 client.18180 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.936+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a1d610 0x564f41a1fa20 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdcd2278d5f2b1db server_cookie=aa6b92b6cf2e8840 in_seq=0 out_seq=0 2023-03-17T10:09:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/1112551696 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564f41920600 con 0x564f41a1d610 2023-03-17T10:09:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6ad1ffb700 10 client.18180 handle_command_reply: tid=0 2023-03-17T10:09:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 client.18180 shutdown 2023-03-17T10:09:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 msgr2=0x564f41a0fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a0fd20 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40114c0 tx=0x7f6ad4004750 comp rx=0 tx=0).stop 2023-03-17T10:09:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 shutdown_connections 2023-03-17T10:09:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a1d610 0x564f41a1fa20 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:21.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a0d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a0fd20 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:21.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6ad1ffb700 0 client.18180 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/1112551696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a0cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 >> 172.21.15.35:0/1112551696 conn(0x564f4185c6b0 msgr2=0x564f419fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 shutdown_connections 2023-03-17T10:09:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 1 -- 172.21.15.35:0/1112551696 wait complete. 2023-03-17T10:09:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.937+0000 7f6afd10eb80 20 client.18180 trim_cache size 0 max 16384 2023-03-17T10:09:21.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.952+0000 7f6afd10eb80 1 Processor -- start 2023-03-17T10:09:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 -- start start 2023-03-17T10:09:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f419f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a0f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41920600 con 0x564f41a03830 2023-03-17T10:09:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41914390 con 0x564f41a041e0 2023-03-17T10:09:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f419f50f0 con 0x564f41a09040 2023-03-17T10:09:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48934/0 (socket says 172.21.15.35:48934) 2023-03-17T10:09:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 -- 172.21.15.35:0/4110847976 learned_addr learned my addr 172.21.15.35:0/4110847976 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aead9d700 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a0f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 -- 172.21.15.35:0/4110847976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 msgr2=0x564f41a0f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a0f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 -- 172.21.15.35:0/4110847976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 msgr2=0x564f419f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f419f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 -- 172.21.15.35:0/4110847976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f41918130 con 0x564f41a03830 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6aea59c700 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03c00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6ad401ffd0 tx=0x7f6ad400f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cdb6c325ff4645 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6ae17fa700 1 -- 172.21.15.35:0/4110847976 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400f960 con 0x564f41a03830 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.953+0000 7f6ae17fa700 1 -- 172.21.15.35:0/4110847976 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ad4031cd0 con 0x564f41a03830 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6ae17fa700 1 -- 172.21.15.35:0/4110847976 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad401fa40 con 0x564f41a03830 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 -- 172.21.15.35:0/4110847976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 msgr2=0x564f41a03c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03c00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6ad401ffd0 tx=0x7f6ad400f820 comp rx=0 tx=0).stop 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 -- 172.21.15.35:0/4110847976 shutdown_connections 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a09040 0x564f41a0f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a03c00 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/4110847976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a041e0 0x564f419f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 -- 172.21.15.35:0/4110847976 >> 172.21.15.35:0/4110847976 conn(0x564f4185c6b0 msgr2=0x564f41a07310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 -- 172.21.15.35:0/4110847976 shutdown_connections 2023-03-17T10:09:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 -- 172.21.15.35:0/4110847976 wait complete. 2023-03-17T10:09:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 -- start start 2023-03-17T10:09:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.954+0000 7f6afd10eb80 1 Processor -- start 2023-03-17T10:09:25.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a14630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a12610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41a12cb0 con 0x564f41a03830 2023-03-17T10:09:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41a12e20 con 0x564f41a09040 2023-03-17T10:09:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f41a12fe0 con 0x564f41a041e0 2023-03-17T10:09:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6afd10eb80 10 client.0 _ll_register_callbacks cb 0x564f417f7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:09:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48940/0 (socket says 172.21.15.35:48940) 2023-03-17T10:09:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 -- 172.21.15.35:0/2434095958 learned_addr learned my addr 172.21.15.35:0/2434095958 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a14630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 -- 172.21.15.35:0/2434095958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 msgr2=0x564f41a14630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aead9d700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a12610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a14630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 -- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 msgr2=0x564f41a12610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a12610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 -- 172.21.15.35:0/2434095958 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f4177fd80 con 0x564f41a03830 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aead9d700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a12610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6aea59c700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a140f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4014040 tx=0x7f6ad4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7443628c96ea219d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6ad1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.955+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/2434095958 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4005450 con 0x564f41a03830 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/2434095958 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6ad401f430 con 0x564f41a03830 2023-03-17T10:09:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f419cf1e0 con 0x564f41a03830 2023-03-17T10:09:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/2434095958 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad40055b0 con 0x564f41a03830 2023-03-17T10:09:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 10 client.18186 fetch_fsmap learned FSMap version 37 2023-03-17T10:09:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564f417a61f0 con 0x564f41a03830 2023-03-17T10:09:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/2434095958 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f419cf1e0 con 0x564f41a03830 2023-03-17T10:09:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/2434095958 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6ad4004a70 con 0x564f41a03830 2023-03-17T10:09:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 10 client.18186 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:09:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 10 client.18186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:09:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 20 client.18186 populate_metadata read hostname 'smithi035' 2023-03-17T10:09:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a72350 0x564f41a74730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 4 client.18186 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:09:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564f417d5f00 con 0x564f41a72350 2023-03-17T10:09:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.956+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a72350 0x564f41a74730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.957+0000 7f6ad1ffb700 10 client.18186 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.957+0000 7f6ae9d9b700 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a72350 0x564f41a74730 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60691000a1908cc8 server_cookie=6b01aba6c95387a2 in_seq=0 out_seq=0 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6ad1ffb700 1 -- 172.21.15.35:0/2434095958 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564f417d5f00 con 0x564f41a72350 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6ad1ffb700 10 client.18186 handle_command_reply: tid=0 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 client.18186 shutdown 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 msgr2=0x564f41a140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a140f0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4014040 tx=0x7f6ad4005a00 comp rx=0 tx=0).stop 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 shutdown_connections 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564f41a72350 0x564f41a74730 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f41a09040 0x564f41a12610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564f41a03830 0x564f41a140f0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6ad1ffb700 0 client.18186 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 --2- 172.21.15.35:0/2434095958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f41a041e0 0x564f41a14630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 >> 172.21.15.35:0/2434095958 conn(0x564f4185c6b0 msgr2=0x564f419fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.961+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 shutdown_connections 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.962+0000 7f6afd10eb80 1 -- 172.21.15.35:0/2434095958 wait complete. 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.962+0000 7f6afd10eb80 20 client.18186 trim_cache size 0 max 16384 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.962+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6ad809f640 msgr2=0x7f6ad80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.962+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6ad809f640 0x7f6ad80a1af0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4005950 tx=0x7f6ad40058e0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.962+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 msgr2=0x7f6aec19ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.962+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec19ad00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400b780 tx=0x7f6ae400bd60 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 shutdown_connections 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6ad809f640 0x7f6ad80a1af0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6aec10a7d0 0x7f6aec19ad00 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aec101490 0x7f6aec196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 --2- 172.21.15.35:0/4266226200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aec101da0 0x7f6aec1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 >> 172.21.15.35:0/4266226200 conn(0x7f6aec075f60 msgr2=0x7f6aec10b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 shutdown_connections 2023-03-17T10:09:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:46:51.963+0000 7f6af0f81700 1 -- 172.21.15.35:0/4266226200 wait complete. 2023-03-17T10:09:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.343+0000 7f9445c10700 1 -- 172.21.15.35:0/1554801834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94401043f0 msgr2=0x7f944010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.343+0000 7f9445c10700 1 --2- 172.21.15.35:0/1554801834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94401043f0 0x7f944010bfc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f943800b0d0 tx=0x7f943800b3e0 comp rx=0 tx=0).stop 2023-03-17T10:09:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 -- 172.21.15.35:0/1554801834 shutdown_connections 2023-03-17T10:09:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 --2- 172.21.15.35:0/1554801834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94401043f0 0x7f944010bfc0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 --2- 172.21.15.35:0/1554801834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94400ff3b0 0x7f94400ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 --2- 172.21.15.35:0/1554801834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400ffd50 0x7f9440103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 -- 172.21.15.35:0/1554801834 >> 172.21.15.35:0/1554801834 conn(0x7f9440075f60 msgr2=0x7f9440076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 -- 172.21.15.35:0/1554801834 shutdown_connections 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 -- 172.21.15.35:0/1554801834 wait complete. 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 Processor -- start 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.344+0000 7f9445c10700 1 -- start start 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f9445c10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400ff3b0 0x7f9440196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f9445c10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 0x7f9440196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f9445c10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94401043f0 0x7f944019ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f9445c10700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944019b320 con 0x7f94400ffd50 2023-03-17T10:09:33.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f9445c10700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944019b490 con 0x7f94401043f0 2023-03-17T10:09:33.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:28 smithi035 ceph-mon[92535]: pgmap v2387: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 807 B/s wr, 14 op/s 2023-03-17T10:09:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f9445c10700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944019b650 con 0x7f94400ff3b0 2023-03-17T10:09:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 0x7f9440196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 0x7f9440196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48956/0 (socket says 172.21.15.35:48956) 2023-03-17T10:09:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 -- 172.21.15.35:0/323247952 learned_addr learned my addr 172.21.15.35:0/323247952 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943f7fe700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400ff3b0 0x7f9440196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943ffff700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94401043f0 0x7f944019ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 -- 172.21.15.35:0/323247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400ff3b0 msgr2=0x7f9440196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400ff3b0 0x7f9440196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 -- 172.21.15.35:0/323247952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94401043f0 msgr2=0x7f944019ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94401043f0 0x7f944019ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 -- 172.21.15.35:0/323247952 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009d00 con 0x7f94400ffd50 2023-03-17T10:09:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943ffff700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94401043f0 0x7f944019ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:09:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943effd700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 0x7f9440196880 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f943400c8c0 tx=0x7f943400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.345+0000 7f943cff9700 1 -- 172.21.15.35:0/323247952 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434004220 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.346+0000 7f943cff9700 1 -- 172.21.15.35:0/323247952 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9434007d90 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.346+0000 7f943cff9700 1 -- 172.21.15.35:0/323247952 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434004d80 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.346+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944010f0c0 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.346+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944010ef30 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.348+0000 7f943cff9700 1 -- 172.21.15.35:0/323247952 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9434007900 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.348+0000 7f943cff9700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f942809f640 0x7f94280a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.349+0000 7f943cff9700 1 -- 172.21.15.35:0/323247952 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f94340ca230 con 0x7f94400ffd50 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.349+0000 7f943f7fe700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f942809f640 0x7f94280a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.349+0000 7f943f7fe700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f942809f640 0x7f94280a1af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9430005ea0 tx=0x7f9430005e30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.349+0000 7f9451d9db80 1 Processor -- start 2023-03-17T10:09:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.349+0000 7f9451d9db80 1 -- start start 2023-03-17T10:09:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e3be0 0x5632b04e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 0x5632b04de420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04de960 0x5632b04ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:41.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9451d9db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b03e5010 con 0x5632b04e44f0 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9451d9db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b0437950 con 0x5632b04de960 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9451d9db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b0430de0 con 0x5632b04e3be0 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 0x5632b04de420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 0x5632b04de420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48964/0 (socket says 172.21.15.35:48964) 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 -- 172.21.15.35:0/3392180092 learned_addr learned my addr 172.21.15.35:0/3392180092 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943f7fe700 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e3be0 0x5632b04e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:42.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943ffff700 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04de960 0x5632b04ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 -- 172.21.15.35:0/3392180092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e3be0 msgr2=0x5632b04e3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e3be0 0x5632b04e3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 -- 172.21.15.35:0/3392180092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04de960 msgr2=0x5632b04ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04de960 0x5632b04ded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 -- 172.21.15.35:0/3392180092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632b02b25d0 con 0x5632b04e44f0 2023-03-17T10:09:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f943effd700 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 0x5632b04de420 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f94340c7fc0 tx=0x7f94340978a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cde49c5d8260d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9425ffb700 1 -- 172.21.15.35:0/3392180092 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434097ce0 con 0x5632b04e44f0 2023-03-17T10:09:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9425ffb700 1 -- 172.21.15.35:0/3392180092 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f943409a040 con 0x5632b04e44f0 2023-03-17T10:09:46.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.350+0000 7f9425ffb700 1 -- 172.21.15.35:0/3392180092 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434097f40 con 0x5632b04e44f0 2023-03-17T10:09:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 -- 172.21.15.35:0/3392180092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 msgr2=0x5632b04de420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 0x5632b04de420 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f94340c7fc0 tx=0x7f94340978a0 comp rx=0 tx=0).stop 2023-03-17T10:09:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 -- 172.21.15.35:0/3392180092 shutdown_connections 2023-03-17T10:09:46.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04de960 0x5632b04ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e3be0 0x5632b04e3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 --2- 172.21.15.35:0/3392180092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e44f0 0x5632b04de420 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 -- 172.21.15.35:0/3392180092 >> 172.21.15.35:0/3392180092 conn(0x5632b033b6b0 msgr2=0x5632b04d8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:47.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 -- 172.21.15.35:0/3392180092 shutdown_connections 2023-03-17T10:09:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.351+0000 7f9451d9db80 1 -- 172.21.15.35:0/3392180092 wait complete. 2023-03-17T10:09:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 -- start start 2023-03-17T10:09:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 Processor -- start 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04ea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b02b48c0 con 0x5632b04de960 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b04e84d0 con 0x5632b04e3be0 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b04f3f10 con 0x5632b04e44f0 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f9451d9db80 10 client.0 _ll_register_callbacks cb 0x5632b02d6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:09:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f943f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f943f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04ea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48968/0 (socket says 172.21.15.35:48968) 2023-03-17T10:09:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f943f7fe700 1 -- 172.21.15.35:0/198473639 learned_addr learned my addr 172.21.15.35:0/198473639 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f943effd700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.352+0000 7f943ffff700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943f7fe700 1 -- 172.21.15.35:0/198473639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 msgr2=0x5632b04e7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943f7fe700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943f7fe700 1 -- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 msgr2=0x5632b04e76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943f7fe700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04e76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943f7fe700 1 -- 172.21.15.35:0/198473639 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944010ef30 con 0x5632b04de960 2023-03-17T10:09:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943ffff700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:09:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f943f7fe700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04ea460 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f94300109b0 tx=0x7f94300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4a2187e899a94d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f941effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:09:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f941effd700 1 -- 172.21.15.35:0/198473639 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943001da50 con 0x5632b04de960 2023-03-17T10:09:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f941effd700 1 -- 172.21.15.35:0/198473639 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f943001dbb0 con 0x5632b04de960 2023-03-17T10:09:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632b03f3390 con 0x5632b04de960 2023-03-17T10:09:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f941effd700 1 -- 172.21.15.35:0/198473639 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f943000eed0 con 0x5632b04de960 2023-03-17T10:09:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f9451d9db80 10 client.18198 fetch_fsmap learned FSMap version 37 2023-03-17T10:09:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5632b025ed80 con 0x5632b04de960 2023-03-17T10:09:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.353+0000 7f941effd700 1 -- 172.21.15.35:0/198473639 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5632b03f3390 con 0x5632b04de960 2023-03-17T10:09:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f941effd700 1 -- 172.21.15.35:0/198473639 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f94300263f0 con 0x5632b04de960 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f9451d9db80 10 client.18198 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f9451d9db80 10 client.18198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f9451d9db80 20 client.18198 populate_metadata read hostname 'smithi035' 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f9451d9db80 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b04f8040 0x5632b04fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f9451d9db80 4 client.18198 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632b03ff600 con 0x5632b04f8040 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f943effd700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b04f8040 0x5632b04fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f941effd700 10 client.18198 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.354+0000 7f943effd700 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b04f8040 0x5632b04fa450 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3600575fc8d01c71 server_cookie=8bf64e1a7f2c7e45 in_seq=0 out_seq=0 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f941effd700 1 -- 172.21.15.35:0/198473639 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5632b03ff600 con 0x5632b04f8040 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f941effd700 10 client.18198 handle_command_reply: tid=0 2023-03-17T10:09:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 client.18198 shutdown 2023-03-17T10:09:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 msgr2=0x5632b04ea460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:09:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04ea460 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f94300109b0 tx=0x7f94300047c0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 shutdown_connections 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b04f8040 0x5632b04fa450 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04ea460 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 --2- 172.21.15.35:0/198473639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04e76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f941effd700 0 client.18198 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 >> 172.21.15.35:0/198473639 conn(0x5632b033b6b0 msgr2=0x5632b04dd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 shutdown_connections 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 1 -- 172.21.15.35:0/198473639 wait complete. 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.355+0000 7f9451d9db80 20 client.18198 trim_cache size 0 max 16384 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.370+0000 7f9451d9db80 1 Processor -- start 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.370+0000 7f9451d9db80 1 -- start start 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.370+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04eee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f9451d9db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b03f3390 con 0x5632b04de960 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f9451d9db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b03f4050 con 0x5632b04e3be0 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f9451d9db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b04e8cc0 con 0x5632b04e44f0 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04eee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48976/0 (socket says 172.21.15.35:48976) 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 -- 172.21.15.35:0/2503513035 learned_addr learned my addr 172.21.15.35:0/2503513035 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:09:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943effd700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 -- 172.21.15.35:0/2503513035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 msgr2=0x5632b04e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943ffff700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:09:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 -- 172.21.15.35:0/2503513035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 msgr2=0x5632b04ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:09:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:09:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 -- 172.21.15.35:0/2503513035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632b03f7130 con 0x5632b04de960 2023-03-17T10:09:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943effd700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:09:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943ffff700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:09:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f943f7fe700 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04eee20 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f9430004790 tx=0x7f943000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1554ba68863b75 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:09:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f94267fc700 1 -- 172.21.15.35:0/2503513035 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430026970 con 0x5632b04de960 2023-03-17T10:09:59.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f94267fc700 1 -- 172.21.15.35:0/2503513035 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9430026ad0 con 0x5632b04de960 2023-03-17T10:10:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.371+0000 7f94267fc700 1 -- 172.21.15.35:0/2503513035 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943003a6b0 con 0x5632b04de960 2023-03-17T10:10:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 -- 172.21.15.35:0/2503513035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 msgr2=0x5632b04eee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04eee20 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f9430004790 tx=0x7f943000eed0 comp rx=0 tx=0).stop 2023-03-17T10:10:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 -- 172.21.15.35:0/2503513035 shutdown_connections 2023-03-17T10:10:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04e44f0 0x5632b04e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04de960 0x5632b04eee20 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 --2- 172.21.15.35:0/2503513035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e3be0 0x5632b04ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 -- 172.21.15.35:0/2503513035 >> 172.21.15.35:0/2503513035 conn(0x5632b033b6b0 msgr2=0x5632b04dda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 -- 172.21.15.35:0/2503513035 shutdown_connections 2023-03-17T10:10:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 -- 172.21.15.35:0/2503513035 wait complete. 2023-03-17T10:10:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.372+0000 7f9451d9db80 1 -- start start 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 Processor -- start 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04de960 0x5632b04eee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 0x5632b04ed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e44f0 0x5632b04ed790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b04ede60 con 0x5632b04e3be0 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b04edfd0 con 0x5632b04e44f0 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632b0550300 con 0x5632b04de960 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f9451d9db80 10 client.0 _ll_register_callbacks cb 0x5632b02d6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 0x5632b04ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 0x5632b04ed250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48984/0 (socket says 172.21.15.35:48984) 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 -- 172.21.15.35:0/876644083 learned_addr learned my addr 172.21.15.35:0/876644083 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943f7fe700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04de960 0x5632b04eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943ffff700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e44f0 0x5632b04ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 -- 172.21.15.35:0/876644083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04de960 msgr2=0x5632b04eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:03.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04de960 0x5632b04eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:03.364 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:30 smithi035 ceph-mon[92535]: pgmap v2388: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 -- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e44f0 msgr2=0x5632b04ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e44f0 0x5632b04ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 -- 172.21.15.35:0/876644083 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632b025ed80 con 0x5632b04e3be0 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f943effd700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 0x5632b04ed250 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f94340941e0 tx=0x7f943400a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec5d535414a7398 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.373+0000 7f941effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f941effd700 1 -- 172.21.15.35:0/876644083 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434004380 con 0x5632b04e3be0 2023-03-17T10:10:04.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f941effd700 1 -- 172.21.15.35:0/876644083 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f94340943f0 con 0x5632b04e3be0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632b04ae1e0 con 0x5632b04e3be0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f941effd700 1 -- 172.21.15.35:0/876644083 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94340945b0 con 0x5632b04e3be0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 10 client.18204 fetch_fsmap learned FSMap version 37 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5632b02851f0 con 0x5632b04e3be0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f941effd700 1 -- 172.21.15.35:0/876644083 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9434079030 con 0x5632b04e3be0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f941effd700 1 -- 172.21.15.35:0/876644083 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9434097fd0 con 0x5632b04e3be0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 10 client.18204 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 10 client.18204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 20 client.18204 populate_metadata read hostname 'smithi035' 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b0551380 0x5632b0553790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 4 client.18204 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5632b02b4f00 con 0x5632b0551380 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.374+0000 7f943f7fe700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b0551380 0x5632b0553790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.375+0000 7f941effd700 10 client.18204 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:10:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.375+0000 7f943f7fe700 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b0551380 0x5632b0553790 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629f988fad353563 server_cookie=6177f1260d13d335 in_seq=0 out_seq=0 2023-03-17T10:10:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.383+0000 7f941effd700 1 -- 172.21.15.35:0/876644083 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5632b02b4f00 con 0x5632b0551380 2023-03-17T10:10:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.383+0000 7f941effd700 10 client.18204 handle_command_reply: tid=0 2023-03-17T10:10:07.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.383+0000 7f9451d9db80 1 client.18204 shutdown 2023-03-17T10:10:07.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.383+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 msgr2=0x5632b04ed250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.383+0000 7f9451d9db80 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 0x5632b04ed250 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f94340941e0 tx=0x7f943400a500 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 shutdown_connections 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632b0551380 0x5632b0553790 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5632b04e44f0 0x5632b04ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f941effd700 0 client.18204 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5632b04de960 0x5632b04eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 --2- 172.21.15.35:0/876644083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5632b04e3be0 0x5632b04ed250 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 >> 172.21.15.35:0/876644083 conn(0x5632b033b6b0 msgr2=0x5632b04e16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 shutdown_connections 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 1 -- 172.21.15.35:0/876644083 wait complete. 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9451d9db80 20 client.18204 trim_cache size 0 max 16384 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f942809f640 msgr2=0x7f94280a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f942809f640 0x7f94280a1af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9430005ea0 tx=0x7f9430005e30 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 msgr2=0x7f9440196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 0x7f9440196880 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f943400c8c0 tx=0x7f943400cc80 comp rx=0 tx=0).stop 2023-03-17T10:10:07.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 shutdown_connections 2023-03-17T10:10:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f942809f640 0x7f94280a1af0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94401043f0 0x7f944019ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400ff3b0 0x7f9440196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 --2- 172.21.15.35:0/323247952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94400ffd50 0x7f9440196880 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 >> 172.21.15.35:0/323247952 conn(0x7f9440075f60 msgr2=0x7f9440068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 shutdown_connections 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:42.384+0000 7f9445c10700 1 -- 172.21.15.35:0/323247952 wait complete. 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 -- 172.21.15.35:0/905475811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc84104390 msgr2=0x7fbc8410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/905475811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc84104390 0x7fbc8410bf60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00b0d0 tx=0x7fbc7c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 -- 172.21.15.35:0/905475811 shutdown_connections 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/905475811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc84104390 0x7fbc8410bf60 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/905475811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc840ff350 0x7fbc840ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/905475811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 0x7fbc84103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 -- 172.21.15.35:0/905475811 >> 172.21.15.35:0/905475811 conn(0x7fbc84076330 msgr2=0x7fbc84076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 -- 172.21.15.35:0/905475811 shutdown_connections 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.496+0000 7fbc8a03e700 1 -- 172.21.15.35:0/905475811 wait complete. 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 Processor -- start 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 -- start start 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 0x7fbc841971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 0x7fbc84197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc84104390 0x7fbc841a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84198040 con 0x7fbc840ff350 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc841a27b0 con 0x7fbc840ffcf0 2023-03-17T10:10:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.497+0000 7fbc8a03e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc841a2920 con 0x7fbc84104390 2023-03-17T10:10:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 0x7fbc841971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 0x7fbc841971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:48996/0 (socket says 172.21.15.35:48996) 2023-03-17T10:10:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 -- 172.21.15.35:0/2480040157 learned_addr learned my addr 172.21.15.35:0/2480040157 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 0x7fbc84197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 -- 172.21.15.35:0/2480040157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc84104390 msgr2=0x7fbc841a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc84104390 0x7fbc841a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 -- 172.21.15.35:0/2480040157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 msgr2=0x7fbc84197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 0x7fbc84197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 -- 172.21.15.35:0/2480040157 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c009d00 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 0x7fbc84197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc837fe700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 0x7fbc841971f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400d950 tx=0x7fbc7400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc80ff9700 1 -- 172.21.15.35:0/2480040157 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74009b40 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc80ff9700 1 -- 172.21.15.35:0/2480040157 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc74009ca0 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8410f010 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc80ff9700 1 -- 172.21.15.35:0/2480040157 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400f620 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.498+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8410ee80 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.500+0000 7fbc80ff9700 1 -- 172.21.15.35:0/2480040157 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbc74010460 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.501+0000 7fbc80ff9700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbc7009f6c0 0x7fbc700a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.501+0000 7fbc80ff9700 1 -- 172.21.15.35:0/2480040157 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbc740ca980 con 0x7fbc840ff350 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.501+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbc7009f6c0 0x7fbc700a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbc7009f6c0 0x7fbc700a1b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc84068890 tx=0x7fbc6c009550 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 Processor -- start 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 -- start start 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d009be0 0x55a41d009fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d00a4f0 0x55a41d004420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cf0b010 con 0x55a41d004960 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cf5d950 con 0x55a41d009be0 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cf56de0 con 0x55a41d00a4f0 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d004d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49008/0 (socket says 172.21.15.35:49008) 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc83fff700 1 -- 172.21.15.35:0/461104528 learned_addr learned my addr 172.21.15.35:0/461104528 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc837fe700 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d009be0 0x55a41d009fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.502+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d00a4f0 0x55a41d004420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc83fff700 1 -- 172.21.15.35:0/461104528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d00a4f0 msgr2=0x55a41d004420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc83fff700 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d00a4f0 0x55a41d004420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc83fff700 1 -- 172.21.15.35:0/461104528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d009be0 msgr2=0x55a41d009fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc83fff700 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d009be0 0x55a41d009fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc83fff700 1 -- 172.21.15.35:0/461104528 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a41cdd85d0 con 0x55a41d004960 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc83fff700 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d004d90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009bc0 tx=0x7fbc7c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab169e68079ed29 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc79ffb700 1 -- 172.21.15.35:0/461104528 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00e040 con 0x55a41d004960 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc79ffb700 1 -- 172.21.15.35:0/461104528 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc7c0092d0 con 0x55a41d004960 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.503+0000 7fbc79ffb700 1 -- 172.21.15.35:0/461104528 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0052d0 con 0x55a41d004960 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 -- 172.21.15.35:0/461104528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 msgr2=0x55a41d004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d004d90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009bc0 tx=0x7fbc7c009bf0 comp rx=0 tx=0).stop 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 -- 172.21.15.35:0/461104528 shutdown_connections 2023-03-17T10:10:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d004d90 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d009be0 0x55a41d009fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/461104528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d00a4f0 0x55a41d004420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 -- 172.21.15.35:0/461104528 >> 172.21.15.35:0/461104528 conn(0x55a41ce616b0 msgr2=0x55a41cffea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 -- 172.21.15.35:0/461104528 shutdown_connections 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 -- 172.21.15.35:0/461104528 wait complete. 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 -- start start 2023-03-17T10:10:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.504+0000 7fbc961cbb80 1 Processor -- start 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d0103c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d00d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cdda8c0 con 0x55a41d004960 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41d00e350 con 0x55a41d00a4f0 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41d00e510 con 0x55a41d009be0 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 10 client.0 _ll_register_callbacks cb 0x55a41cdfc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d0103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d0103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49010/0 (socket says 172.21.15.35:49010) 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 -- 172.21.15.35:0/1480525484 learned_addr learned my addr 172.21.15.35:0/1480525484 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d00d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc83fff700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 -- 172.21.15.35:0/1480525484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 msgr2=0x55a41d00d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d00d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 -- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 msgr2=0x55a41d00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 -- 172.21.15.35:0/1480525484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8410c7a0 con 0x55a41d004960 2023-03-17T10:10:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc837fe700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d0103c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc74097db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac28f5c2b99d148 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:10:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc62ffd700 1 -- 172.21.15.35:0/1480525484 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74094ae0 con 0x55a41d004960 2023-03-17T10:10:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc62ffd700 1 -- 172.21.15.35:0/1480525484 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbc74094c40 con 0x55a41d004960 2023-03-17T10:10:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a41cf19390 con 0x55a41d004960 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc62ffd700 1 -- 172.21.15.35:0/1480525484 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc74098630 con 0x55a41d004960 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 10 client.18216 fetch_fsmap learned FSMap version 37 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.505+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a41cd84d80 con 0x55a41d004960 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc62ffd700 1 -- 172.21.15.35:0/1480525484 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc740b4020 con 0x55a41d004960 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc62ffd700 1 -- 172.21.15.35:0/1480525484 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbc74097950 con 0x55a41d004960 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc961cbb80 10 client.18216 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc961cbb80 10 client.18216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc961cbb80 20 client.18216 populate_metadata read hostname 'smithi035' 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d01e000 0x55a41d020410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc961cbb80 4 client.18216 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:10:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a41cf25600 con 0x55a41d01e000 2023-03-17T10:10:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d01e000 0x55a41d020410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc62ffd700 10 client.18216 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:10:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.506+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d01e000 0x55a41d020410 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=575e3a5af91acf85 server_cookie=924bf34827748c6b in_seq=0 out_seq=0 2023-03-17T10:10:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc62ffd700 1 -- 172.21.15.35:0/1480525484 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a41cf25600 con 0x55a41d01e000 2023-03-17T10:10:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc62ffd700 10 client.18216 handle_command_reply: tid=0 2023-03-17T10:10:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 client.18216 shutdown 2023-03-17T10:10:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 msgr2=0x55a41d0103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d0103c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc74097db0 comp rx=0 tx=0).stop 2023-03-17T10:10:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 shutdown_connections 2023-03-17T10:10:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d01e000 0x55a41d020410 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:17.422 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:33 smithi035 ceph-mon[92535]: pgmap v2389: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:10:23.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:35 smithi035 ceph-mon[92535]: pgmap v2390: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:10:23.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:37 smithi035 ceph-mon[92535]: pgmap v2391: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:23.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:39 smithi035 ceph-mon[92535]: pgmap v2392: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:10:23.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:41 smithi035 ceph-mon[92535]: pgmap v2393: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:10:23.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:42 smithi035 ceph-mon[92535]: pgmap v2394: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:10:23.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:44 smithi035 ceph-mon[92535]: pgmap v2395: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:10:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:47 smithi035 ceph-mon[92535]: pgmap v2396: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:10:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:49 smithi035 ceph-mon[92535]: pgmap v2397: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:10:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:51 smithi035 ceph-mon[92535]: pgmap v2398: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:53 smithi035 ceph-mon[92535]: pgmap v2399: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:54 smithi035 ceph-mon[92535]: pgmap v2400: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:10:23.413 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:57 smithi035 ceph-mon[92535]: pgmap v2401: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 09:59:59 smithi035 ceph-mon[92535]: pgmap v2402: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:01 smithi035 ceph-mon[92535]: pgmap v2403: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:02 smithi035 ceph-mon[92535]: pgmap v2404: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:04 smithi035 ceph-mon[92535]: osdmap e227: 12 total, 12 up, 12 in 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:04 smithi035 ceph-mon[92535]: pgmap v2406: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:07 smithi035 ceph-mon[92535]: pgmap v2407: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:09 smithi035 ceph-mon[92535]: pgmap v2408: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:10:28.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:10 smithi035 ceph-mon[92535]: pgmap v2409: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:10 smithi035 ceph-mon[92535]: pgmap v2410: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 74 KiB/s wr, 38 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:12 smithi035 ceph-mon[92535]: pgmap v2411: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 550 B/s wr, 6 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:12 smithi035 ceph-mon[92535]: osdmap e228: 12 total, 12 up, 12 in 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:14 smithi035 ceph-mon[92535]: pgmap v2413: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 700 B/s wr, 12 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:15 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:15 smithi035 ceph-mon[92535]: osdmap e229: 12 total, 12 up, 12 in 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:16 smithi035 ceph-mon[92535]: pgmap v2415: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:16 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/1983264099,v1:172.21.15.35:6837/1983264099] up:boot 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:16 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:16 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:18 smithi035 ceph-mon[92535]: pgmap v2416: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:19 smithi035 ceph-mon[92535]: pgmap v2417: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T10:10:28.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:22 smithi035 ceph-mon[92535]: pgmap v2418: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 526 B/s wr, 10 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:24 smithi035 ceph-mon[92535]: pgmap v2419: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:26 smithi035 ceph-mon[92535]: pgmap v2420: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 407 B/s wr, 10 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:27 smithi035 ceph-mon[92535]: pgmap v2421: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:29 smithi035 ceph-mon[92535]: pgmap v2422: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:32 smithi035 ceph-mon[92535]: pgmap v2423: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:34 smithi035 ceph-mon[92535]: pgmap v2424: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:35 smithi035 ceph-mon[92535]: pgmap v2425: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:37 smithi035 ceph-mon[92535]: pgmap v2426: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:39 smithi035 ceph-mon[92535]: pgmap v2427: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:42 smithi035 ceph-mon[92535]: pgmap v2428: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:43 smithi035 ceph-mon[92535]: pgmap v2429: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:45 smithi035 ceph-mon[92535]: pgmap v2430: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:48 smithi035 ceph-mon[92535]: pgmap v2431: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:49 smithi035 ceph-mon[92535]: pgmap v2432: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:10:28.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:52 smithi035 ceph-mon[92535]: pgmap v2433: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:29.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:53 smithi035 ceph-mon[92535]: pgmap v2434: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:55 smithi035 ceph-mon[92535]: pgmap v2435: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:57 smithi035 ceph-mon[92535]: pgmap v2436: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:00:59 smithi035 ceph-mon[92535]: pgmap v2437: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:02 smithi035 ceph-mon[92535]: pgmap v2438: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:03 smithi035 ceph-mon[92535]: pgmap v2439: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:05 smithi035 ceph-mon[92535]: pgmap v2440: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:07 smithi035 ceph-mon[92535]: pgmap v2441: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:09 smithi035 ceph-mon[92535]: osdmap e230: 12 total, 12 up, 12 in 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:09 smithi035 ceph-mon[92535]: pgmap v2443: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:10 smithi035 ceph-mon[92535]: pgmap v2444: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:10 smithi035 ceph-mon[92535]: pgmap v2445: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:10:29.956 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:12 smithi035 ceph-mon[92535]: pgmap v2446: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T10:10:29.957 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:14 smithi035 ceph-mon[92535]: pgmap v2447: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T10:10:29.957 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:16 smithi035 ceph-mon[92535]: pgmap v2448: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T10:10:29.957 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:16 smithi035 ceph-mon[92535]: osdmap e231: 12 total, 12 up, 12 in 2023-03-17T10:10:29.957 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:18 smithi035 ceph-mon[92535]: pgmap v2450: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:10:29.958 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: *** Caught signal (Segmentation fault) ** 2023-03-17T10:10:30.966 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: in thread 7f51c6b28700 thread_name:md_log_replay 2023-03-17T10:10:30.966 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:10:33.683 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f51d76d2cf0] 2023-03-17T10:10:33.683 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55a743ebb71f] 2023-03-17T10:10:33.683 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55a743ebd953] 2023-03-17T10:10:33.683 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 4: (MDLog::_replay_thread()+0x66d) [0x55a743f2907d] 2023-03-17T10:10:33.683 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55a743bdcd91] 2023-03-17T10:10:33.684 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f51d76c81ca] 2023-03-17T10:10:33.684 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 7: clone() 2023-03-17T10:10:34.902 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:00:03.502+0000 7f51c6b28700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:10:34.902 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: in thread 7f51c6b28700 thread_name:md_log_replay 2023-03-17T10:10:34.902 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:10:36.840 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:10:36.840 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f51d76d2cf0] 2023-03-17T10:10:39.166 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55a743ebb71f] 2023-03-17T10:10:39.166 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55a743ebd953] 2023-03-17T10:10:39.166 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 4: (MDLog::_replay_thread()+0x66d) [0x55a743f2907d] 2023-03-17T10:10:39.166 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55a743bdcd91] 2023-03-17T10:10:39.166 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f51d76c81ca] 2023-03-17T10:10:39.166 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 7: clone() 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 0> 2023-03-17T10:00:03.502+0000 7f51c6b28700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: in thread 7f51c6b28700 thread_name:md_log_replay 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f51d76d2cf0] 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55a743ebb71f] 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55a743ebd953] 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 4: (MDLog::_replay_thread()+0x66d) [0x55a743f2907d] 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55a743bdcd91] 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f51d76c81ca] 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 7: clone() 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:10:39.167 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 0> 2023-03-17T10:00:03.502+0000 7f51c6b28700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: in thread 7f51c6b28700 thread_name:md_log_replay 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f51d76d2cf0] 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55a743ebb71f] 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55a743ebd953] 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 4: (MDLog::_replay_thread()+0x66d) [0x55a743f2907d] 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55a743bdcd91] 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f51d76c81ca] 2023-03-17T10:10:39.168 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 7: clone() 2023-03-17T10:10:40.850 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[175186]: 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:03 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 4. 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 podman[176866]: 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 bash[176866]: cfdc44a92fedfceadd1de068941b5f307c19dd8f9b73ad2a4f99017fd48bd7d1 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 ceph-mds[176906]: -- 172.21.15.35:0/1034300171 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56549e614b60 con 0x56549e5eac00 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: starting mds.d at 2023-03-17T10:10:42.614 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:00:14 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:10:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:10:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:10:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:10:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:10:43.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:10:43.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:10:43.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d0103c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc62ffd700 0 client.18216 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:10:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/1480525484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d00d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 >> 172.21.15.35:0/1480525484 conn(0x55a41ce616b0 msgr2=0x55a41cffea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 shutdown_connections 2023-03-17T10:10:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 1 -- 172.21.15.35:0/1480525484 wait complete. 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.507+0000 7fbc961cbb80 20 client.18216 trim_cache size 0 max 16384 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 Processor -- start 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 -- start start 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d004960 0x55a41cffeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 0x55a41d00b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cffb5c0 con 0x55a41d009be0 2023-03-17T10:10:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cfffe10 con 0x55a41d00a4f0 2023-03-17T10:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41cfff6d0 con 0x55a41d004960 2023-03-17T10:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 0x55a41d00b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 0x55a41d00b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49020/0 (socket says 172.21.15.35:49020) 2023-03-17T10:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.522+0000 7fbc82ffd700 1 -- 172.21.15.35:0/94744765 learned_addr learned my addr 172.21.15.35:0/94744765 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc83fff700 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:46.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc837fe700 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d004960 0x55a41cffeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc82ffd700 1 -- 172.21.15.35:0/94744765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d004960 msgr2=0x55a41cffeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d004960 0x55a41cffeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc82ffd700 1 -- 172.21.15.35:0/94744765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 msgr2=0x55a41d00ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc82ffd700 1 -- 172.21.15.35:0/94744765 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a41d005000 con 0x55a41d009be0 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc837fe700 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d004960 0x55a41cffeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 0x55a41d00b0a0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x55a41cfff6a0 tx=0x7fbc6c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307e8fe4c8387c3d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc7a7fc700 1 -- 172.21.15.35:0/94744765 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c02b070 con 0x55a41d009be0 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc7a7fc700 1 -- 172.21.15.35:0/94744765 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc6c027380 con 0x55a41d009be0 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.523+0000 7fbc7a7fc700 1 -- 172.21.15.35:0/94744765 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c025040 con 0x55a41d009be0 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- 172.21.15.35:0/94744765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 msgr2=0x55a41d00b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 0x55a41d00b0a0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x55a41cfff6a0 tx=0x7fbc6c014000 comp rx=0 tx=0).stop 2023-03-17T10:10:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- 172.21.15.35:0/94744765 shutdown_connections 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d00ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d004960 0x55a41cffeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/94744765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d009be0 0x55a41d00b0a0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- 172.21.15.35:0/94744765 >> 172.21.15.35:0/94744765 conn(0x55a41ce616b0 msgr2=0x55a41d00a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- 172.21.15.35:0/94744765 shutdown_connections 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- 172.21.15.35:0/94744765 wait complete. 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- start start 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 Processor -- start 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d014950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d014e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d012f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41d013550 con 0x55a41d004960 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41d0136c0 con 0x55a41d00a4f0 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.524+0000 7fbc961cbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41d013880 con 0x55a41d009be0 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc961cbb80 10 client.0 _ll_register_callbacks cb 0x55a41cdfc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:10:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d014950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d014950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49024/0 (socket says 172.21.15.35:49024) 2023-03-17T10:10:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 -- 172.21.15.35:0/4093299467 learned_addr learned my addr 172.21.15.35:0/4093299467 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc83fff700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d012f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d014e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 -- 172.21.15.35:0/4093299467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 msgr2=0x55a41d014e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d014e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 -- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 msgr2=0x55a41d012f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:10:50.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d012f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:50.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 -- 172.21.15.35:0/4093299467 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c00ed80 con 0x55a41d004960 2023-03-17T10:10:50.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc837fe700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d014950 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbc74005950 tx=0x7fbc74010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529ae820a5911639 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:10:50.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc62ffd700 1 -- 172.21.15.35:0/4093299467 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74014070 con 0x55a41d004960 2023-03-17T10:10:51.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc62ffd700 1 -- 172.21.15.35:0/4093299467 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbc740b5080 con 0x55a41d004960 2023-03-17T10:10:51.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a41cfd41e0 con 0x55a41d004960 2023-03-17T10:10:51.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc62ffd700 1 -- 172.21.15.35:0/4093299467 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc740a0280 con 0x55a41d004960 2023-03-17T10:10:51.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc961cbb80 10 client.18222 fetch_fsmap learned FSMap version 37 2023-03-17T10:10:51.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.525+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a41cd6dc00 con 0x55a41d004960 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc62ffd700 1 -- 172.21.15.35:0/4093299467 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a41cfd41e0 con 0x55a41d004960 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc62ffd700 1 -- 172.21.15.35:0/4093299467 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbc74098630 con 0x55a41d004960 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc961cbb80 10 client.18222 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc961cbb80 10 client.18222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc961cbb80 20 client.18222 populate_metadata read hostname 'smithi035' 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d072de0 0x55a41d0751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc961cbb80 4 client.18222 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:10:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a41cddaf00 con 0x55a41d072de0 2023-03-17T10:10:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d072de0 0x55a41d0751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc62ffd700 10 client.18222 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:10:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.526+0000 7fbc82ffd700 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d072de0 0x55a41d0751f0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2605044f8ea897c7 server_cookie=b35b599797433175 in_seq=0 out_seq=0 2023-03-17T10:10:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc62ffd700 1 -- 172.21.15.35:0/4093299467 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a41cddaf00 con 0x55a41d072de0 2023-03-17T10:10:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc62ffd700 10 client.18222 handle_command_reply: tid=0 2023-03-17T10:10:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 client.18222 shutdown 2023-03-17T10:10:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 msgr2=0x55a41d014950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d014950 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbc74005950 tx=0x7fbc74010a70 comp rx=0 tx=0).stop 2023-03-17T10:10:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 shutdown_connections 2023-03-17T10:10:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a41d072de0 0x55a41d0751f0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a41d00a4f0 0x55a41d012f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc62ffd700 0 client.18222 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:10:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a41d004960 0x55a41d014950 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 --2- 172.21.15.35:0/4093299467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a41d009be0 0x55a41d014e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 >> 172.21.15.35:0/4093299467 conn(0x55a41ce616b0 msgr2=0x55a41d008760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 shutdown_connections 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 1 -- 172.21.15.35:0/4093299467 wait complete. 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.530+0000 7fbc961cbb80 20 client.18222 trim_cache size 0 max 16384 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbc7009f6c0 msgr2=0x7fbc700a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbc7009f6c0 0x7fbc700a1b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc84068890 tx=0x7fbc6c009550 comp rx=0 tx=0).stop 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 msgr2=0x7fbc841971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 0x7fbc841971f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400d950 tx=0x7fbc7400dd10 comp rx=0 tx=0).stop 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 shutdown_connections 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbc7009f6c0 0x7fbc700a1b70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc84104390 0x7fbc841a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc840ff350 0x7fbc841971f0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 --2- 172.21.15.35:0/2480040157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc840ffcf0 0x7fbc84197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 >> 172.21.15.35:0/2480040157 conn(0x7fbc84076330 msgr2=0x7fbc840fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 shutdown_connections 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:48:55.531+0000 7fbc8a03e700 1 -- 172.21.15.35:0/2480040157 wait complete. 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.652+0000 7fd6a93c6700 1 -- 172.21.15.35:0/2318119756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a40ffac0 msgr2=0x7fd6a40fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.652+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/2318119756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a40ffac0 0x7fd6a40fff30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fd698009990 tx=0x7fd698009ca0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 -- 172.21.15.35:0/2318119756 shutdown_connections 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/2318119756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6a4100470 0x7fd6a410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/2318119756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 0x7fd6a4105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/2318119756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a40ffac0 0x7fd6a40fff30 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 -- 172.21.15.35:0/2318119756 >> 172.21.15.35:0/2318119756 conn(0x7fd6a40747d0 msgr2=0x7fd6a4074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 -- 172.21.15.35:0/2318119756 shutdown_connections 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 -- 172.21.15.35:0/2318119756 wait complete. 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.653+0000 7fd6a93c6700 1 Processor -- start 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 -- start start 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6a40ffac0 0x7fd6a4196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 0x7fd6a4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:58.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 0x7fd6a41a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4197dd0 con 0x7fd6a4100470 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a41a2510 con 0x7fd6a4105270 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a93c6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a41a26d0 con 0x7fd6a40ffac0 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 0x7fd6a4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 0x7fd6a4197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49040/0 (socket says 172.21.15.35:49040) 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 -- 172.21.15.35:0/3881347483 learned_addr learned my addr 172.21.15.35:0/3881347483 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6a40ffac0 0x7fd6a4196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 0x7fd6a41a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 -- 172.21.15.35:0/3881347483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6a40ffac0 msgr2=0x7fd6a4196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6a40ffac0 0x7fd6a4196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 -- 172.21.15.35:0/3881347483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 msgr2=0x7fd6a41a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:10:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 0x7fd6a41a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:10:59.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 -- 172.21.15.35:0/3881347483 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6980095f0 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 0x7fd6a41a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.654+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 0x7fd6a4197490 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fd698005740 tx=0x7fd698005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.655+0000 7fd68bfff700 1 -- 172.21.15.35:0/3881347483 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69801d070 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.655+0000 7fd68bfff700 1 -- 172.21.15.35:0/3881347483 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd698022470 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.655+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a410f000 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.655+0000 7fd68bfff700 1 -- 172.21.15.35:0/3881347483 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698017650 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.655+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a410ee70 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.657+0000 7fd68bfff700 1 -- 172.21.15.35:0/3881347483 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd69800fb00 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.658+0000 7fd68bfff700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd68c09f640 0x7fd68c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.658+0000 7fd68bfff700 1 -- 172.21.15.35:0/3881347483 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd6980cbb40 con 0x7fd6a4100470 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.658+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd68c09f640 0x7fd68c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd68c09f640 0x7fd68c0a1af0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd694009c60 tx=0x7fd694009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 Processor -- start 2023-03-17T10:10:59.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 -- start start 2023-03-17T10:10:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321716fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613217174f0 0x561321711420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:10:59.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x561321711d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:03.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561321618010 con 0x561321716be0 2023-03-17T10:11:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56132166a950 con 0x5613217174f0 2023-03-17T10:11:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561321663de0 con 0x561321711960 2023-03-17T10:11:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6a2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321716fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6a2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321716fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49046/0 (socket says 172.21.15.35:49046) 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6a2ffd700 1 -- 172.21.15.35:0/380866687 learned_addr learned my addr 172.21.15.35:0/380866687 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x561321711d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.659+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613217174f0 0x561321711420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a2ffd700 1 -- 172.21.15.35:0/380866687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 msgr2=0x561321711d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x561321711d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a2ffd700 1 -- 172.21.15.35:0/380866687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613217174f0 msgr2=0x561321711420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613217174f0 0x561321711420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a2ffd700 1 -- 172.21.15.35:0/380866687 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613214e55d0 con 0x561321716be0 2023-03-17T10:11:04.037 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T10:11:04.038 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 -- 172.21.15.35:0/2384346573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101420 msgr2=0x7f68901017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:05.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 --2- 172.21.15.35:0/2384346573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101420 0x7f68901017f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f6878009990 tx=0x7f6878009ca0 comp rx=0 tx=0).stop 2023-03-17T10:11:05.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 -- 172.21.15.35:0/2384346573 shutdown_connections 2023-03-17T10:11:05.973 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 --2- 172.21.15.35:0/2384346573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689010a760 0x7f689010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 --2- 172.21.15.35:0/2384346573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101420 0x7f68901017f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 --2- 172.21.15.35:0/2384346573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6890101d30 0x7f689010a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 -- 172.21.15.35:0/2384346573 >> 172.21.15.35:0/2384346573 conn(0x7f6890076300 msgr2=0x7f6890076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 -- 172.21.15.35:0/2384346573 shutdown_connections 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.030+0000 7f6895df6700 1 -- 172.21.15.35:0/2384346573 wait complete. 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 Processor -- start 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 -- start start 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6890101420 0x7f6890196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 0x7f6890196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:06.599 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f689010a760 0x7f689019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:06.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019b230 con 0x7f6890101d30 2023-03-17T10:11:06.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019b3a0 con 0x7f689010a760 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f6895df6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019b560 con 0x7f6890101420 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.031+0000 7f688effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 0x7f6890196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 0x7f6890196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50126/0 (socket says 172.21.15.35:50126) 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 -- 172.21.15.35:0/2013939807 learned_addr learned my addr 172.21.15.35:0/2013939807 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688f7fe700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6890101420 0x7f6890196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688ffff700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f689010a760 0x7f689019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:08.637 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 -- 172.21.15.35:0/2013939807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6890101420 msgr2=0x7f6890196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:09.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6890101420 0x7f6890196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:09.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 -- 172.21.15.35:0/2013939807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f689010a760 msgr2=0x7f689019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:09.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f689010a760 0x7f689019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:09.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 -- 172.21.15.35:0/2013939807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780095f0 con 0x7f6890101d30 2023-03-17T10:11:09.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688effd700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 0x7f6890196790 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f688000d950 tx=0x7f688000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688cff9700 1 -- 172.21.15.35:0/2013939807 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880009940 con 0x7f6890101d30 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68901100d0 con 0x7f6890101d30 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688cff9700 1 -- 172.21.15.35:0/2013939807 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6880010460 con 0x7f6890101d30 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f688cff9700 1 -- 172.21.15.35:0/2013939807 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000f620 con 0x7f6890101d30 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.032+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689010ff40 con 0x7f6890101d30 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.034+0000 7f688cff9700 1 -- 172.21.15.35:0/2013939807 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f68800105d0 con 0x7f6890101d30 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.035+0000 7f688cff9700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f687c09f640 0x7f687c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:09.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.035+0000 7f688cff9700 1 -- 172.21.15.35:0/2013939807 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f68800ca4d0 con 0x7f6890101d30 2023-03-17T10:11:11.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.035+0000 7f688f7fe700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f687c09f640 0x7f687c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:11.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f688f7fe700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f687c09f640 0x7f687c0a1af0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f687800b5c0 tx=0x7f6878005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:11.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 Processor -- start 2023-03-17T10:11:12.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 -- start start 2023-03-17T10:11:12.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06a7d0 0x56518e06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:12.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 0x56518e06f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:12.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06f630 0x56518e06fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:12.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518df71070 con 0x56518e06b0e0 2023-03-17T10:11:14.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518dfc39b0 con 0x56518e06f630 2023-03-17T10:11:14.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518dfbce40 con 0x56518e06a7d0 2023-03-17T10:11:14.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f688effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 0x56518e06f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:14.043 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f688effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 0x56518e06f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50134/0 (socket says 172.21.15.35:50134) 2023-03-17T10:11:14.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f688effd700 1 -- 172.21.15.35:0/964131326 learned_addr learned my addr 172.21.15.35:0/964131326 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.036+0000 7f688ffff700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06f630 0x56518e06fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688f7fe700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06a7d0 0x56518e06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688effd700 1 -- 172.21.15.35:0/964131326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06a7d0 msgr2=0x56518e06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688effd700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06a7d0 0x56518e06aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688effd700 1 -- 172.21.15.35:0/964131326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06f630 msgr2=0x56518e06fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688effd700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06f630 0x56518e06fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688effd700 1 -- 172.21.15.35:0/964131326 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56518de3e630 con 0x56518e06b0e0 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688ffff700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06f630 0x56518e06fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688f7fe700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06a7d0 0x56518e06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f688effd700 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 0x56518e06f0f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f6880094990 tx=0x7f6880097b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5cba09dc034fcc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:15.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f6885ffb700 1 -- 172.21.15.35:0/964131326 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800a0110 con 0x56518e06b0e0 2023-03-17T10:11:16.502 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f6885ffb700 1 -- 172.21.15.35:0/964131326 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68800962c0 con 0x56518e06b0e0 2023-03-17T10:11:16.502 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.037+0000 7f6885ffb700 1 -- 172.21.15.35:0/964131326 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688009fc80 con 0x56518e06b0e0 2023-03-17T10:11:18.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 -- 172.21.15.35:0/964131326 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 msgr2=0x56518e06f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:18.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 0x56518e06f0f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f6880094990 tx=0x7f6880097b90 comp rx=0 tx=0).stop 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 -- 172.21.15.35:0/964131326 shutdown_connections 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06f630 0x56518e06fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06a7d0 0x56518e06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/964131326 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06b0e0 0x56518e06f0f0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 -- 172.21.15.35:0/964131326 >> 172.21.15.35:0/964131326 conn(0x56518e065030 msgr2=0x56518e065400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 -- 172.21.15.35:0/964131326 shutdown_connections 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 -- 172.21.15.35:0/964131326 wait complete. 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 -- start start 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.038+0000 7f68a1f83b80 1 Processor -- start 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e074630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e074b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518de40920 con 0x56518e06a7d0 2023-03-17T10:11:19.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e077250 con 0x56518e06b0e0 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e080960 con 0x56518e06f630 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f68a1f83b80 10 client.0 _ll_register_callbacks cb 0x56518de62290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e0740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50138/0 (socket says 172.21.15.35:50138) 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 -- 172.21.15.35:0/1427005878 learned_addr learned my addr 172.21.15.35:0/1427005878 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688effd700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e074630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688ffff700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 -- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 msgr2=0x56518e074b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e074b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 -- 172.21.15.35:0/1427005878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 msgr2=0x56518e074630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e074630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:19.968 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 -- 172.21.15.35:0/1427005878 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689010ff40 con 0x56518e06a7d0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688ffff700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e074b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f688f7fe700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e0740f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f6878015000 tx=0x7f687801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a813625c8107c6b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.039+0000 7f686effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f686effd700 1 -- 172.21.15.35:0/1427005878 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878004da0 con 0x56518e06a7d0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f686effd700 1 -- 172.21.15.35:0/1427005878 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6878003820 con 0x56518e06a7d0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56518df7f3f0 con 0x56518e06a7d0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f686effd700 1 -- 172.21.15.35:0/1427005878 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f687800be90 con 0x56518e06a7d0 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 10 client.18696 fetch_fsmap learned FSMap version 41 2023-03-17T10:11:21.085 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56518ddeade0 con 0x56518e06a7d0 2023-03-17T10:11:23.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f686effd700 1 -- 172.21.15.35:0/1427005878 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56518df7f3f0 con 0x56518e06a7d0 2023-03-17T10:11:25.473 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f686effd700 1 -- 172.21.15.35:0/1427005878 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f687800f650 con 0x56518e06a7d0 2023-03-17T10:11:25.474 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 10 client.18696 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:11:26.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 10 client.18696 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-17T10:11:26.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 20 client.18696 populate_metadata read hostname 'smithi035' 2023-03-17T10:11:26.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0849e0 0x56518e086df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:26.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 4 client.18696 mds_command: new command op to 24439 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:11:26.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56518df8b660 con 0x56518e0849e0 2023-03-17T10:11:27.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.040+0000 7f688effd700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0849e0 0x56518e086df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:27.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.041+0000 7f686effd700 10 client.18696 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T10:11:27.711 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.041+0000 7f688effd700 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0849e0 0x56518e086df0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4003101a92217f6b server_cookie=fb1c44050cfe0c28 in_seq=0 out_seq=0 2023-03-17T10:11:28.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.041+0000 7f686effd700 1 -- 172.21.15.35:0/1427005878 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56518df8b660 con 0x56518e0849e0 2023-03-17T10:11:28.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.041+0000 7f686effd700 10 client.18696 handle_command_reply: tid=0 2023-03-17T10:11:28.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 client.18696 shutdown 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 msgr2=0x56518e0740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e0740f0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f6878015000 tx=0x7f687801a050 comp rx=0 tx=0).stop 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 shutdown_connections 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0849e0 0x56518e086df0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e074b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f686effd700 0 client.18696 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e0740f0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1427005878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e074630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 >> 172.21.15.35:0/1427005878 conn(0x56518e065030 msgr2=0x56518e064710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 shutdown_connections 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1427005878 wait complete. 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.042+0000 7f68a1f83b80 20 client.18696 trim_cache size 0 max 16384 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 Processor -- start 2023-03-17T10:11:28.673 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 -- start start 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e07b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e065ef0 con 0x56518e06a7d0 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e06b940 con 0x56518e06b0e0 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e0756d0 con 0x56518e06f630 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e06cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50146/0 (socket says 172.21.15.35:50146) 2023-03-17T10:11:28.854 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.055+0000 7f688f7fe700 1 -- 172.21.15.35:0/3994791506 learned_addr learned my addr 172.21.15.35:0/3994791506 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688effd700 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e07b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688ffff700 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688f7fe700 1 -- 172.21.15.35:0/3994791506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 msgr2=0x56518e071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688f7fe700 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688f7fe700 1 -- 172.21.15.35:0/3994791506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 msgr2=0x56518e07b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688f7fe700 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e07b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688f7fe700 1 -- 172.21.15.35:0/3994791506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56518e0656d0 con 0x56518e06a7d0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688ffff700 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f688f7fe700 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e06cf90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f6878000c00 tx=0x7f6878005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d17bd740edcd4c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f68867fc700 1 -- 172.21.15.35:0/3994791506 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878004da0 con 0x56518e06a7d0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f68867fc700 1 -- 172.21.15.35:0/3994791506 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f687802a050 con 0x56518e06a7d0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f68867fc700 1 -- 172.21.15.35:0/3994791506 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878003c10 con 0x56518e06a7d0 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f68a1f83b80 1 -- 172.21.15.35:0/3994791506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 msgr2=0x56518e06cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.056+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e06cf90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f6878000c00 tx=0x7f6878005f00 comp rx=0 tx=0).stop 2023-03-17T10:11:29.864 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- 172.21.15.35:0/3994791506 shutdown_connections 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e06cf90 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/3994791506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e07b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- 172.21.15.35:0/3994791506 >> 172.21.15.35:0/3994791506 conn(0x56518e065030 msgr2=0x56518e080da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- 172.21.15.35:0/3994791506 shutdown_connections 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- 172.21.15.35:0/3994791506 wait complete. 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- start start 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 Processor -- start 2023-03-17T10:11:29.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e079810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:29.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:20 smithi035 ceph-mon[92535]: pgmap v2451: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:11:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x561321711d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:11:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321716fb0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fd69400e4e0 tx=0x7fd694014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb884ae433e75bd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6897fa700 1 -- 172.21.15.35:0/380866687 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694026430 con 0x561321716be0 2023-03-17T10:11:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6897fa700 1 -- 172.21.15.35:0/380866687 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd694021070 con 0x561321716be0 2023-03-17T10:11:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.660+0000 7fd6897fa700 1 -- 172.21.15.35:0/380866687 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69401d630 con 0x561321716be0 2023-03-17T10:11:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 -- 172.21.15.35:0/380866687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 msgr2=0x561321716fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321716fb0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fd69400e4e0 tx=0x7fd694014000 comp rx=0 tx=0).stop 2023-03-17T10:11:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 -- 172.21.15.35:0/380866687 shutdown_connections 2023-03-17T10:11:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x561321711d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321716fb0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/380866687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5613217174f0 0x561321711420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 -- 172.21.15.35:0/380866687 >> 172.21.15.35:0/380866687 conn(0x56132156e6b0 msgr2=0x56132170ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 -- 172.21.15.35:0/380866687 shutdown_connections 2023-03-17T10:11:32.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 -- 172.21.15.35:0/380866687 wait complete. 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 -- start start 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 Processor -- start 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.661+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x56132171d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321716be0 0x56132171a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x56132171ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613214e78c0 con 0x5613217174f0 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56132171b3d0 con 0x561321716be0 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561321727000 con 0x561321711960 2023-03-17T10:11:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 10 client.0 _ll_register_callbacks cb 0x561321509230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x56132171ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x56132171ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49056/0 (socket says 172.21.15.35:49056) 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 -- 172.21.15.35:0/2647373249 learned_addr learned my addr 172.21.15.35:0/2647373249 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321716be0 0x56132171a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x56132171d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 -- 172.21.15.35:0/2647373249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 msgr2=0x56132171d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x56132171d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 -- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321716be0 msgr2=0x56132171a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321716be0 0x56132171a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 -- 172.21.15.35:0/2647373249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd694017070 con 0x5613217174f0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x56132171ac60 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00fd30 tx=0x7fd69c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e8f0711661b3d9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd686ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd686ff5700 1 -- 172.21.15.35:0/2647373249 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c007ea0 con 0x5613217174f0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd686ff5700 1 -- 172.21.15.35:0/2647373249 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd69c00da40 con 0x5613217174f0 2023-03-17T10:11:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.662+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561321626390 con 0x5613217174f0 2023-03-17T10:11:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd686ff5700 1 -- 172.21.15.35:0/2647373249 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd69c00dc00 con 0x5613217174f0 2023-03-17T10:11:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 10 client.18234 fetch_fsmap learned FSMap version 37 2023-03-17T10:11:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x561321491d80 con 0x5613217174f0 2023-03-17T10:11:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd686ff5700 1 -- 172.21.15.35:0/2647373249 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561321626390 con 0x5613217174f0 2023-03-17T10:11:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd686ff5700 1 -- 172.21.15.35:0/2647373249 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fd69c012070 con 0x5613217174f0 2023-03-17T10:11:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 10 client.18234 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:11:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 10 client.18234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:11:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 20 client.18234 populate_metadata read hostname 'smithi035' 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56132172b140 0x56132172d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 4 client.18234 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561321632600 con 0x56132172b140 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.663+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56132172b140 0x56132172d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd686ff5700 10 client.18234 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56132172b140 0x56132172d550 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65848ad1ab5b056f server_cookie=e51d0d18181e166 in_seq=0 out_seq=0 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd686ff5700 1 -- 172.21.15.35:0/2647373249 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561321632600 con 0x56132172b140 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd686ff5700 10 client.18234 handle_command_reply: tid=0 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 client.18234 shutdown 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 msgr2=0x56132171ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x56132171ac60 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00fd30 tx=0x7fd69c00d430 comp rx=0 tx=0).stop 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 shutdown_connections 2023-03-17T10:11:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56132172b140 0x56132172d550 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:35.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x56132171ac60 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:35.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd686ff5700 0 client.18234 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:11:35.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321711960 0x56132171d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:35.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/2647373249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321716be0 0x56132171a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.664+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 >> 172.21.15.35:0/2647373249 conn(0x56132156e6b0 msgr2=0x561321710410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.665+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 shutdown_connections 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.665+0000 7fd6b5553b80 1 -- 172.21.15.35:0/2647373249 wait complete. 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.665+0000 7fd6b5553b80 20 client.18234 trim_cache size 0 max 16384 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 Processor -- start 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 -- start start 2023-03-17T10:11:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x56132170bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321721f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613217174f0 0x5613217266e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561321627050 con 0x561321716be0 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56132170d620 con 0x561321711960 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56132171b290 con 0x5613217174f0 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321721f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321721f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49062/0 (socket says 172.21.15.35:49062) 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 -- 172.21.15.35:0/960090757 learned_addr learned my addr 172.21.15.35:0/960090757 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613217174f0 0x5613217266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x56132170bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 -- 172.21.15.35:0/960090757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613217174f0 msgr2=0x5613217266e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613217174f0 0x5613217266e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 -- 172.21.15.35:0/960090757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 msgr2=0x56132170bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x56132170bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 -- 172.21.15.35:0/960090757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56132162a130 con 0x561321716be0 2023-03-17T10:11:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.680+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321721f50 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd698022fd0 tx=0x7fd69809f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b388d4266a1fcbfa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd689ffb700 1 -- 172.21.15.35:0/960090757 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6980a1780 con 0x561321716be0 2023-03-17T10:11:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd689ffb700 1 -- 172.21.15.35:0/960090757 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd69800fdb0 con 0x561321716be0 2023-03-17T10:11:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd689ffb700 1 -- 172.21.15.35:0/960090757 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698099880 con 0x561321716be0 2023-03-17T10:11:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 -- 172.21.15.35:0/960090757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 msgr2=0x561321721f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321721f50 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd698022fd0 tx=0x7fd69809f040 comp rx=0 tx=0).stop 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 -- 172.21.15.35:0/960090757 shutdown_connections 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613217174f0 0x5613217266e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x56132170bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/960090757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561321716be0 0x561321721f50 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 -- 172.21.15.35:0/960090757 >> 172.21.15.35:0/960090757 conn(0x56132156e6b0 msgr2=0x561321710bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 -- 172.21.15.35:0/960090757 shutdown_connections 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.681+0000 7fd6b5553b80 1 -- 172.21.15.35:0/960090757 wait complete. 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 -- start start 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 Processor -- start 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x5613217772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321716be0 0x561321777800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x561321778030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561321778730 con 0x5613217174f0 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613217788a0 con 0x561321711960 2023-03-17T10:11:41.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561321778a60 con 0x561321716be0 2023-03-17T10:11:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6b5553b80 10 client.0 _ll_register_callbacks cb 0x561321509230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:11:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x561321778030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x561321778030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49070/0 (socket says 172.21.15.35:49070) 2023-03-17T10:11:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 -- 172.21.15.35:0/479758874 learned_addr learned my addr 172.21.15.35:0/479758874 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x5613217772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a27fc700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321716be0 0x561321777800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:42.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 -- 172.21.15.35:0/479758874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321716be0 msgr2=0x561321777800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:42.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321716be0 0x561321777800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 -- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 msgr2=0x5613217772c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x5613217772c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.682+0000 7fd6a37fe700 1 -- 172.21.15.35:0/479758874 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a410ee70 con 0x5613217174f0 2023-03-17T10:11:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6a37fe700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x561321778030 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00fd30 tx=0x7fd69c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9334c7338f3351ed server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd686ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:11:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd686ff5700 1 -- 172.21.15.35:0/479758874 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c007ea0 con 0x5613217174f0 2023-03-17T10:11:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd686ff5700 1 -- 172.21.15.35:0/479758874 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd69c007840 con 0x5613217174f0 2023-03-17T10:11:44.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613216e11e0 con 0x5613217174f0 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd686ff5700 1 -- 172.21.15.35:0/479758874 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd69c004ea0 con 0x5613217174f0 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 10 client.18240 fetch_fsmap learned FSMap version 37 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5613214b81f0 con 0x5613217174f0 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd686ff5700 1 -- 172.21.15.35:0/479758874 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5613216e11e0 con 0x5613217174f0 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd686ff5700 1 -- 172.21.15.35:0/479758874 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fd69c00d150 con 0x5613217174f0 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 10 client.18240 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:11:46.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 10 client.18240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 20 client.18240 populate_metadata read hostname 'smithi035' 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561321780180 0x561321782590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 4 client.18240 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.683+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5613214e7f00 con 0x561321780180 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.684+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561321780180 0x561321782590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.684+0000 7fd686ff5700 10 client.18240 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.684+0000 7fd6a2ffd700 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561321780180 0x561321782590 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f6a834bf622ef9 server_cookie=c9a52f66d1048674 in_seq=0 out_seq=0 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd686ff5700 1 -- 172.21.15.35:0/479758874 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5613214e7f00 con 0x561321780180 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd686ff5700 10 client.18240 handle_command_reply: tid=0 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 client.18240 shutdown 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 msgr2=0x561321778030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x561321778030 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00fd30 tx=0x7fd69c00dcf0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 shutdown_connections 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561321780180 0x561321782590 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5613217174f0 0x561321778030 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd686ff5700 0 client.18240 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:11:46.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561321711960 0x5613217772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 --2- 172.21.15.35:0/479758874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561321716be0 0x561321777800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 >> 172.21.15.35:0/479758874 conn(0x56132156e6b0 msgr2=0x5613217146b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 shutdown_connections 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 1 -- 172.21.15.35:0/479758874 wait complete. 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.692+0000 7fd6b5553b80 20 client.18240 trim_cache size 0 max 16384 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd68c09f640 msgr2=0x7fd68c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd68c09f640 0x7fd68c0a1af0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd694009c60 tx=0x7fd694009260 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 msgr2=0x7fd6a4197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 0x7fd6a4197490 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fd698005740 tx=0x7fd698005770 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 shutdown_connections 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd68c09f640 0x7fd68c0a1af0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6a4105270 0x7fd6a41a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6a40ffac0 0x7fd6a4196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 --2- 172.21.15.35:0/3881347483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd6a4100470 0x7fd6a4197490 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 >> 172.21.15.35:0/3881347483 conn(0x7fd6a40747d0 msgr2=0x7fd6a40fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 shutdown_connections 2023-03-17T10:11:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:08.693+0000 7fd6a93c6700 1 -- 172.21.15.35:0/3881347483 wait complete. 2023-03-17T10:11:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 -- 172.21.15.35:0/3126979676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a541045a0 msgr2=0x7f4a5410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 --2- 172.21.15.35:0/3126979676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a541045a0 0x7f4a5410c170 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00b0d0 tx=0x7f4a4c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:11:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 -- 172.21.15.35:0/3126979676 shutdown_connections 2023-03-17T10:11:46.521 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e079d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:47.441 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e07a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:47.441 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e0d7a70 con 0x56518e06a7d0 2023-03-17T10:11:47.441 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e0d7be0 con 0x56518e06b0e0 2023-03-17T10:11:47.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518e0d7da0 con 0x56518e06f630 2023-03-17T10:11:47.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f68a1f83b80 10 client.0 _ll_register_callbacks cb 0x56518de62290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:11:47.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.057+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e079810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:47.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e079810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50152/0 (socket says 172.21.15.35:50152) 2023-03-17T10:11:48.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 -- 172.21.15.35:0/1415260832 learned_addr learned my addr 172.21.15.35:0/1415260832 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:11:48.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688ffff700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e07a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:48.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688effd700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e079d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:48.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 -- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 msgr2=0x56518e07a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:48.417 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e07a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 -- 172.21.15.35:0/1415260832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 msgr2=0x56518e079d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e079d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 -- 172.21.15.35:0/1415260832 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56518ddeade0 con 0x56518e06a7d0 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688effd700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f688f7fe700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e079810 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f68780098e0 tx=0x7f6878004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab67097ac5a529ea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f686effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f686effd700 1 -- 172.21.15.35:0/1415260832 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878003820 con 0x56518e06a7d0 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f686effd700 1 -- 172.21.15.35:0/1415260832 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6878003980 con 0x56518e06a7d0 2023-03-17T10:11:48.418 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56518e03a240 con 0x56518e06a7d0 2023-03-17T10:11:49.568 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f686effd700 1 -- 172.21.15.35:0/1415260832 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6878003b40 con 0x56518e06a7d0 2023-03-17T10:11:49.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f68a1f83b80 10 client.18702 fetch_fsmap learned FSMap version 41 2023-03-17T10:11:49.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56518ddd3c60 con 0x56518e06a7d0 2023-03-17T10:11:49.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.058+0000 7f686effd700 1 -- 172.21.15.35:0/1415260832 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56518e03a240 con 0x56518e06a7d0 2023-03-17T10:11:49.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f686effd700 1 -- 172.21.15.35:0/1415260832 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6878039760 con 0x56518e06a7d0 2023-03-17T10:11:49.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 10 client.18702 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:11:49.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 10 client.18702 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 20 client.18702 populate_metadata read hostname 'smithi035' 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0d8ec0 0x56518e0db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 4 client.18702 mds_command: new command op to 24439 tid=0[{"prefix": "damage ls"}] 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56518de40f60 con 0x56518e0d8ec0 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f688effd700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0d8ec0 0x56518e0db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f686effd700 10 client.18702 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f688effd700 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0d8ec0 0x56518e0db2a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bba18b746711bad4 server_cookie=9ce2c87b662792ab in_seq=0 out_seq=0 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f686effd700 1 -- 172.21.15.35:0/1415260832 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56518de40f60 con 0x56518e0d8ec0 2023-03-17T10:11:50.185 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f686effd700 10 client.18702 handle_command_reply: tid=0 2023-03-17T10:11:52.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.059+0000 7f68a1f83b80 1 client.18702 shutdown 2023-03-17T10:11:52.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 msgr2=0x56518e079810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:52.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e079810 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f68780098e0 tx=0x7f6878004e50 comp rx=0 tx=0).stop 2023-03-17T10:11:52.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 shutdown_connections 2023-03-17T10:11:52.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x56518e0d8ec0 0x56518e0db2a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:52.235 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56518e06f630 0x56518e07a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:53.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f686effd700 0 client.18702 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T10:11:53.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56518e06a7d0 0x56518e079810 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:53.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 --2- 172.21.15.35:0/1415260832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56518e06b0e0 0x56518e079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:53.465 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 >> 172.21.15.35:0/1415260832 conn(0x56518e065030 msgr2=0x56518e070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:55.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 shutdown_connections 2023-03-17T10:11:55.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 1 -- 172.21.15.35:0/1415260832 wait complete. 2023-03-17T10:11:55.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f68a1f83b80 20 client.18702 trim_cache size 0 max 16384 2023-03-17T10:11:55.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f687c09f640 msgr2=0x7f687c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:55.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f687c09f640 0x7f687c0a1af0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f687800b5c0 tx=0x7f6878005fb0 comp rx=0 tx=0).stop 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 msgr2=0x7f6890196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 0x7f6890196790 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f688000d950 tx=0x7f688000dc60 comp rx=0 tx=0).stop 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 shutdown_connections 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f687c09f640 0x7f687c0a1af0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f689010a760 0x7f689019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6890101420 0x7f6890196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 --2- 172.21.15.35:0/2013939807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6890101d30 0x7f6890196790 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 >> 172.21.15.35:0/2013939807 conn(0x7f6890076300 msgr2=0x7f68900fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 shutdown_connections 2023-03-17T10:11:55.095 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T09:59:56.060+0000 7f6895df6700 1 -- 172.21.15.35:0/2013939807 wait complete. 2023-03-17T10:11:55.096 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:22 smithi035 ceph-mon[92535]: pgmap v2452: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:11:57.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:24 smithi035 ceph-mon[92535]: pgmap v2453: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:11:57.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:26 smithi035 ceph-mon[92535]: pgmap v2454: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:11:57.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:28 smithi035 ceph-mon[92535]: pgmap v2455: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-17T10:11:59.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:30 smithi035 ceph-mon[92535]: pgmap v2456: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:32 smithi035 ceph-mon[92535]: pgmap v2457: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:34 smithi035 ceph-mon[92535]: pgmap v2458: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:36 smithi035 ceph-mon[92535]: pgmap v2459: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:38 smithi035 ceph-mon[92535]: pgmap v2460: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:40 smithi035 ceph-mon[92535]: pgmap v2461: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:42 smithi035 ceph-mon[92535]: pgmap v2462: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:44 smithi035 ceph-mon[92535]: pgmap v2463: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:11:59.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:46 smithi035 ceph-mon[92535]: pgmap v2464: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:48 smithi035 ceph-mon[92535]: pgmap v2465: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:50 smithi035 ceph-mon[92535]: pgmap v2466: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:52 smithi035 ceph-mon[92535]: pgmap v2467: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:54 smithi035 ceph-mon[92535]: pgmap v2468: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:56 smithi035 ceph-mon[92535]: pgmap v2469: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:01:58 smithi035 ceph-mon[92535]: pgmap v2470: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:00 smithi035 ceph-mon[92535]: pgmap v2471: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:11:59.042 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:02 smithi035 ceph-mon[92535]: pgmap v2472: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:04 smithi035 ceph-mon[92535]: osdmap e232: 12 total, 12 up, 12 in 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:04 smithi035 ceph-mon[92535]: pgmap v2474: 97 pgs: 97 active+clean; 1.7 MiB data, 312 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:06 smithi035 ceph-mon[92535]: pgmap v2475: 97 pgs: 97 active+clean; 1.7 MiB data, 312 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:08 smithi035 ceph-mon[92535]: pgmap v2476: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:10 smithi035 ceph-mon[92535]: pgmap v2477: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:11:59.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:11:59.044 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:12:00.950 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:11 smithi035 ceph-mon[92535]: pgmap v2478: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T10:12:00.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:11 smithi035 ceph-mon[92535]: pgmap v2479: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 431 B/s wr, 6 op/s 2023-03-17T10:12:00.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:11 smithi035 ceph-mon[92535]: osdmap e233: 12 total, 12 up, 12 in 2023-03-17T10:12:00.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:13 smithi035 ceph-mon[92535]: pgmap v2481: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 601 B/s wr, 13 op/s 2023-03-17T10:12:00.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:14 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T10:12:00.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:14 smithi035 ceph-mon[92535]: osdmap e234: 12 total, 12 up, 12 in 2023-03-17T10:12:00.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:15 smithi035 ceph-mon[92535]: pgmap v2482: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 150 B/s wr, 6 op/s 2023-03-17T10:12:02.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:15 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/257124184,v1:172.21.15.35:6837/257124184] up:boot 2023-03-17T10:12:02.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T10:12:02.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T10:12:03.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:12:03.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:17 smithi035 ceph-mon[92535]: pgmap v2484: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-03-17T10:12:03.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:19 smithi035 ceph-mon[92535]: pgmap v2485: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T10:12:03.638 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: *** Caught signal (Segmentation fault) ** 2023-03-17T10:12:04.496 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: in thread 7f66031a0700 thread_name:md_log_replay 2023-03-17T10:12:04.496 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:12:04.496 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6613d4acf0] 2023-03-17T10:12:04.496 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56549c14071f] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56549c142953] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 4: (MDLog::_replay_thread()+0x66d) [0x56549c1ae07d] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56549be61d91] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6613d401ca] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 7: clone() 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:02:03.330+0000 7f66031a0700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: in thread 7f66031a0700 thread_name:md_log_replay 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6613d4acf0] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56549c14071f] 2023-03-17T10:12:04.945 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56549c142953] 2023-03-17T10:12:08.398 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 4: (MDLog::_replay_thread()+0x66d) [0x56549c1ae07d] 2023-03-17T10:12:08.398 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56549be61d91] 2023-03-17T10:12:08.398 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6613d401ca] 2023-03-17T10:12:08.398 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 7: clone() 2023-03-17T10:12:08.398 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:12:08.838 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:12:08.839 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 0> 2023-03-17T10:02:03.330+0000 7f66031a0700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:12:08.839 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: in thread 7f66031a0700 thread_name:md_log_replay 2023-03-17T10:12:08.839 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:12:08.839 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:12:08.839 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6613d4acf0] 2023-03-17T10:12:10.053 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56549c14071f] 2023-03-17T10:12:10.053 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56549c142953] 2023-03-17T10:12:10.053 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 4: (MDLog::_replay_thread()+0x66d) [0x56549c1ae07d] 2023-03-17T10:12:10.053 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56549be61d91] 2023-03-17T10:12:10.054 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6613d401ca] 2023-03-17T10:12:10.054 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 7: clone() 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 0> 2023-03-17T10:02:03.330+0000 7f66031a0700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: in thread 7f66031a0700 thread_name:md_log_replay 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6613d4acf0] 2023-03-17T10:12:10.749 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56549c14071f] 2023-03-17T10:12:11.160 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56549c142953] 2023-03-17T10:12:11.160 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 4: (MDLog::_replay_thread()+0x66d) [0x56549c1ae07d] 2023-03-17T10:12:11.160 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56549be61d91] 2023-03-17T10:12:11.160 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6613d401ca] 2023-03-17T10:12:11.161 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 7: clone() 2023-03-17T10:12:12.082 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T10:12:12.082 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[176882]: 2023-03-17T10:12:12.082 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T10:12:12.785 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:03 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T10:12:12.785 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:13 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:13 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 5. 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:13 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:13 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:14 smithi035 podman[177533]: 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:14 smithi035 bash[177533]: 159dbf459ed325fa44c5ee18b12eef8b8381f34a7fab185e073b220649e38a47 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:14 smithi035 ceph-mds[177573]: -- 172.21.15.35:0/3386380669 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aaa0216b60 con 0x55aaa01ec800 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:14 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: starting mds.d at 2023-03-17T10:12:12.786 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:02:14 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T10:12:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:12:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:12:15.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:12:15.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 --2- 172.21.15.35:0/3126979676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a541045a0 0x7f4a5410c170 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 --2- 172.21.15.35:0/3126979676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a540ffa80 0x7f4a540ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 --2- 172.21.15.35:0/3126979676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a54100420 0x7f4a54103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 -- 172.21.15.35:0/3126979676 >> 172.21.15.35:0/3126979676 conn(0x7f4a540757a0 msgr2=0x7f4a54075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 -- 172.21.15.35:0/3126979676 shutdown_connections 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.815+0000 7f4a5b272700 1 -- 172.21.15.35:0/3126979676 wait complete. 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 Processor -- start 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 -- start start 2023-03-17T10:12:15.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 0x7f4a5419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a54100420 0x7f4a5419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a541045a0 0x7f4a541985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54198c60 con 0x7f4a540ffa80 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54198dd0 con 0x7f4a541045a0 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5b272700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54198f90 con 0x7f4a54100420 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 0x7f4a5419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 0x7f4a5419e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49080/0 (socket says 172.21.15.35:49080) 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 -- 172.21.15.35:0/2822834279 learned_addr learned my addr 172.21.15.35:0/2822834279 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5880d700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a54100420 0x7f4a5419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a541045a0 0x7f4a541985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 -- 172.21.15.35:0/2822834279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a54100420 msgr2=0x7f4a5419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a54100420 0x7f4a5419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 -- 172.21.15.35:0/2822834279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a541045a0 msgr2=0x7f4a541985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a541045a0 0x7f4a541985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5900e700 1 -- 172.21.15.35:0/2822834279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c009d00 con 0x7f4a540ffa80 2023-03-17T10:12:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.816+0000 7f4a5880d700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a54100420 0x7f4a5419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.817+0000 7f4a5900e700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 0x7f4a5419e580 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400c920 tx=0x7f4a4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.817+0000 7f4a4a7fc700 1 -- 172.21.15.35:0/2822834279 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44007b00 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.817+0000 7f4a4a7fc700 1 -- 172.21.15.35:0/2822834279 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a44004cc0 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.817+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5410f270 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.817+0000 7f4a4a7fc700 1 -- 172.21.15.35:0/2822834279 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44005590 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.817+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5410f0e0 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.819+0000 7f4a4a7fc700 1 -- 172.21.15.35:0/2822834279 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4a44004750 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.820+0000 7f4a4a7fc700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a4009f6c0 0x7f4a400a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.820+0000 7f4a4a7fc700 1 -- 172.21.15.35:0/2822834279 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4a440ca590 con 0x7f4a540ffa80 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.820+0000 7f4a5880d700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a4009f6c0 0x7f4a400a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.820+0000 7f4a5880d700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a4009f6c0 0x7f4a400a1b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005e10 tx=0x7f4a50005d60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 Processor -- start 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 -- start start 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f0be0 0x555d557f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f14f0 0x555d557eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 0x555d557ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d556f2010 con 0x555d557eb960 2023-03-17T10:12:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d55744950 con 0x555d557f0be0 2023-03-17T10:12:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5573dde0 con 0x555d557f14f0 2023-03-17T10:12:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a5980f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 0x555d557ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a5900e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f0be0 0x555d557f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a5980f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 0x555d557ebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49092/0 (socket says 172.21.15.35:49092) 2023-03-17T10:12:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a5980f700 1 -- 172.21.15.35:0/2956970078 learned_addr learned my addr 172.21.15.35:0/2956970078 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.821+0000 7f4a5880d700 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f14f0 0x555d557eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5980f700 1 -- 172.21.15.35:0/2956970078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f14f0 msgr2=0x555d557eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f14f0 0x555d557eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5980f700 1 -- 172.21.15.35:0/2956970078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f0be0 msgr2=0x555d557f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f0be0 0x555d557f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5980f700 1 -- 172.21.15.35:0/2956970078 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d555bf5d0 con 0x555d557eb960 2023-03-17T10:12:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5900e700 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f0be0 0x555d557f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:12:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 0x555d557ebd90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00cd70 tx=0x7f4a4c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9140d436a9579bca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a3f7fe700 1 -- 172.21.15.35:0/2956970078 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00e050 con 0x555d557eb960 2023-03-17T10:12:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a3f7fe700 1 -- 172.21.15.35:0/2956970078 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a4c0092d0 con 0x555d557eb960 2023-03-17T10:12:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.822+0000 7f4a3f7fe700 1 -- 172.21.15.35:0/2956970078 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0052a0 con 0x555d557eb960 2023-03-17T10:12:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2956970078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 msgr2=0x555d557ebd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 0x555d557ebd90 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00cd70 tx=0x7f4a4c00cda0 comp rx=0 tx=0).stop 2023-03-17T10:12:18.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2956970078 shutdown_connections 2023-03-17T10:12:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557eb960 0x555d557ebd90 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f0be0 0x555d557f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2956970078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f14f0 0x555d557eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2956970078 >> 172.21.15.35:0/2956970078 conn(0x555d556486b0 msgr2=0x555d557e5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2956970078 shutdown_connections 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2956970078 wait complete. 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 -- start start 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.823+0000 7f4a673ffb80 1 Processor -- start 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557f4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d555c18c0 con 0x555d557f14f0 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d557f53f0 con 0x555d557eb960 2023-03-17T10:12:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d55801000 con 0x555d557f0be0 2023-03-17T10:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a673ffb80 10 client.0 _ll_register_callbacks cb 0x555d555e3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49098/0 (socket says 172.21.15.35:49098) 2023-03-17T10:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 -- 172.21.15.35:0/3223312967 learned_addr learned my addr 172.21.15.35:0/3223312967 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5880d700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5900e700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 -- 172.21.15.35:0/3223312967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 msgr2=0x555d557f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 -- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 msgr2=0x555d557f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 -- 172.21.15.35:0/3223312967 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5410c9b0 con 0x555d557f14f0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a5980f700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f4cc0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00b420 tx=0x7f4a4c007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e089270516a08ee6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.824+0000 7f4a3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a3cff9700 1 -- 172.21.15.35:0/3223312967 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c02d070 con 0x555d557f14f0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a3cff9700 1 -- 172.21.15.35:0/3223312967 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(204..204 src has 1..204) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4a4c0092e0 con 0x555d557f14f0 2023-03-17T10:12:22.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d55700390 con 0x555d557f14f0 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a3cff9700 1 -- 172.21.15.35:0/3223312967 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a4c0074a0 con 0x555d557f14f0 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 10 client.18252 fetch_fsmap learned FSMap version 37 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555d5556bd80 con 0x555d557f14f0 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a3cff9700 1 -- 172.21.15.35:0/3223312967 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d55700390 con 0x555d557f14f0 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a3cff9700 1 -- 172.21.15.35:0/3223312967 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4a4c030030 con 0x555d557f14f0 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 10 client.18252 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 10 client.18252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 20 client.18252 populate_metadata read hostname 'smithi035' 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d55804b60 0x555d55806f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 4 client.18252 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:12:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d5570c600 con 0x555d55804b60 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.825+0000 7f4a5900e700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d55804b60 0x555d55806f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.826+0000 7f4a3cff9700 10 client.18252 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.826+0000 7f4a5900e700 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d55804b60 0x555d55806f40 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc3bd96189e337 server_cookie=47c98099dd0f091a in_seq=0 out_seq=0 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.826+0000 7f4a3cff9700 1 -- 172.21.15.35:0/3223312967 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555d5570c600 con 0x555d55804b60 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.826+0000 7f4a3cff9700 10 client.18252 handle_command_reply: tid=0 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.826+0000 7f4a673ffb80 1 client.18252 shutdown 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 msgr2=0x555d557f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f4cc0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00b420 tx=0x7f4a4c007a30 comp rx=0 tx=0).stop 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 shutdown_connections 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d55804b60 0x555d55806f40 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f4cc0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a3cff9700 0 client.18252 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/3223312967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 >> 172.21.15.35:0/3223312967 conn(0x555d556486b0 msgr2=0x555d557e5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 shutdown_connections 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 1 -- 172.21.15.35:0/3223312967 wait complete. 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.827+0000 7f4a673ffb80 20 client.18252 trim_cache size 0 max 16384 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 Processor -- start 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 -- start start 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d557e2600 con 0x555d557f14f0 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d557e6e40 con 0x555d557eb960 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d557e6720 con 0x555d557f0be0 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49106/0 (socket says 172.21.15.35:49106) 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 -- 172.21.15.35:0/2554268354 learned_addr learned my addr 172.21.15.35:0/2554268354 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5900e700 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5880d700 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 -- 172.21.15.35:0/2554268354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 msgr2=0x555d557fbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557fbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 -- 172.21.15.35:0/2554268354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 msgr2=0x555d557e5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557e5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5980f700 1 -- 172.21.15.35:0/2554268354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d55704130 con 0x555d557f14f0 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.842+0000 7f4a5900e700 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557e5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a5980f700 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f1fd0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c006130 tx=0x7f4a4c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ce77f34911036e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a3ffff700 1 -- 172.21.15.35:0/2554268354 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00e070 con 0x555d557f14f0 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a3ffff700 1 -- 172.21.15.35:0/2554268354 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a4c004e80 con 0x555d557f14f0 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a3ffff700 1 -- 172.21.15.35:0/2554268354 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c02d070 con 0x555d557f14f0 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2554268354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 msgr2=0x555d557f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f1fd0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c006130 tx=0x7f4a4c000f40 comp rx=0 tx=0).stop 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2554268354 shutdown_connections 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f14f0 0x555d557f1fd0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557eb960 0x555d557e5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/2554268354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557f0be0 0x555d557fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2554268354 >> 172.21.15.35:0/2554268354 conn(0x555d556486b0 msgr2=0x555d557f18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2554268354 shutdown_connections 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.843+0000 7f4a673ffb80 1 -- 172.21.15.35:0/2554268354 wait complete. 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 -- start start 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 Processor -- start 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557eb960 0x555d557f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 0x555d557f8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f14f0 0x555d55857950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d557f8d70 con 0x555d557f0be0 2023-03-17T10:12:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d55857e90 con 0x555d557f14f0 2023-03-17T10:12:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d55857fd0 con 0x555d557eb960 2023-03-17T10:12:25.414 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T10:12:28.279 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-03-17T10:12:28.279 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:21 smithi035 ceph-mon[92535]: pgmap v2486: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 546 B/s wr, 10 op/s 2023-03-17T10:12:28.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a673ffb80 10 client.0 _ll_register_callbacks cb 0x555d555e3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:12:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a5880d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 0x555d557f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a5880d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 0x555d557f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49110/0 (socket says 172.21.15.35:49110) 2023-03-17T10:12:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a5880d700 1 -- 172.21.15.35:0/87389629 learned_addr learned my addr 172.21.15.35:0/87389629 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a5980f700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f14f0 0x555d55857950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.844+0000 7f4a5900e700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557eb960 0x555d557f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a5880d700 1 -- 172.21.15.35:0/87389629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557eb960 msgr2=0x555d557f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a5880d700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557eb960 0x555d557f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a5880d700 1 -- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f14f0 msgr2=0x555d55857950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a5880d700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f14f0 0x555d55857950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a5880d700 1 -- 172.21.15.35:0/87389629 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d5556bd80 con 0x555d557f0be0 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a5880d700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 0x555d557f8460 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4a541007f0 tx=0x7f4a50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928af86e794ebd4d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a3cff9700 1 -- 172.21.15.35:0/87389629 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50026070 con 0x555d557f0be0 2023-03-17T10:12:31.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a3cff9700 1 -- 172.21.15.35:0/87389629 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(204..204 src has 1..204) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4a50003890 con 0x555d557f0be0 2023-03-17T10:12:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d557bb1e0 con 0x555d557f0be0 2023-03-17T10:12:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a3cff9700 1 -- 172.21.15.35:0/87389629 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a50017040 con 0x555d557f0be0 2023-03-17T10:12:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a673ffb80 10 client.18258 fetch_fsmap learned FSMap version 37 2023-03-17T10:12:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x555d555921f0 con 0x555d557f0be0 2023-03-17T10:12:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a3cff9700 1 -- 172.21.15.35:0/87389629 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d557bb1e0 con 0x555d557f0be0 2023-03-17T10:12:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.845+0000 7f4a3cff9700 1 -- 172.21.15.35:0/87389629 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4a50011ad0 con 0x555d557f0be0 2023-03-17T10:12:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a673ffb80 10 client.18258 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:12:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a673ffb80 10 client.18258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:12:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a673ffb80 20 client.18258 populate_metadata read hostname 'smithi035' 2023-03-17T10:12:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d558597a0 0x555d5585bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a673ffb80 4 client.18258 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555d555c1f00 con 0x555d558597a0 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a5900e700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d558597a0 0x555d5585bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a3cff9700 10 client.18258 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.846+0000 7f4a5900e700 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d558597a0 0x555d5585bbb0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5cbce5e97876e9b server_cookie=1144e5d73f880a29 in_seq=0 out_seq=0 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.853+0000 7f4a3cff9700 1 -- 172.21.15.35:0/87389629 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555d555c1f00 con 0x555d558597a0 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.853+0000 7f4a3cff9700 10 client.18258 handle_command_reply: tid=0 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 client.18258 shutdown 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 msgr2=0x555d557f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 0x555d557f8460 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4a541007f0 tx=0x7f4a50004750 comp rx=0 tx=0).stop 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 shutdown_connections 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555d558597a0 0x555d5585bbb0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d557f14f0 0x555d55857950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d557eb960 0x555d557f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a3cff9700 0 client.18258 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 --2- 172.21.15.35:0/87389629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555d557f0be0 0x555d557f8460 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 >> 172.21.15.35:0/87389629 conn(0x555d556486b0 msgr2=0x555d557f2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 shutdown_connections 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 1 -- 172.21.15.35:0/87389629 wait complete. 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a673ffb80 20 client.18258 trim_cache size 0 max 16384 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a4009f6c0 msgr2=0x7f4a400a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a5b272700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a4009f6c0 0x7f4a400a1b70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a50005e10 tx=0x7f4a50005d60 comp rx=0 tx=0).stop 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 msgr2=0x7f4a5419e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.854+0000 7f4a5b272700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 0x7f4a5419e580 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400c920 tx=0x7f4a4400cce0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 shutdown_connections 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4a4009f6c0 0x7f4a400a1b70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a541045a0 0x7f4a541985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4a540ffa80 0x7f4a5419e580 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 --2- 172.21.15.35:0/2822834279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a54100420 0x7f4a5419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 >> 172.21.15.35:0/2822834279 conn(0x7f4a540757a0 msgr2=0x7f4a540ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 shutdown_connections 2023-03-17T10:12:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:21.855+0000 7f4a5b272700 1 -- 172.21.15.35:0/2822834279 wait complete. 2023-03-17T10:12:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 -- 172.21.15.35:0/1640452607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c0ff350 msgr2=0x7f389c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/1640452607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c0ff350 0x7f389c0ff720 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f38900099c0 tx=0x7f3890009cd0 comp rx=0 tx=0).stop 2023-03-17T10:12:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 -- 172.21.15.35:0/1640452607 shutdown_connections 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/1640452607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f389c104390 0x7f389c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/1640452607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c0ff350 0x7f389c0ff720 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/1640452607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 0x7f389c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 -- 172.21.15.35:0/1640452607 >> 172.21.15.35:0/1640452607 conn(0x7f389c076330 msgr2=0x7f389c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 -- 172.21.15.35:0/1640452607 shutdown_connections 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 -- 172.21.15.35:0/1640452607 wait complete. 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 Processor -- start 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.976+0000 7f38a2c0a700 1 -- start start 2023-03-17T10:12:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a2c0a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f389c0ff350 0x7f389c196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a2c0a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 0x7f389c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a2c0a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 0x7f389c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a2c0a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c19b230 con 0x7f389c104390 2023-03-17T10:12:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a2c0a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c19b3a0 con 0x7f389c0ffcf0 2023-03-17T10:12:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a2c0a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c19b560 con 0x7f389c0ff350 2023-03-17T10:12:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 0x7f389c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 0x7f389c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49124/0 (socket says 172.21.15.35:49124) 2023-03-17T10:12:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f389c0ff350 0x7f389c196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 -- 172.21.15.35:0/170601921 learned_addr learned my addr 172.21.15.35:0/170601921 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f389bfff700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 0x7f389c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 -- 172.21.15.35:0/170601921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f389c0ff350 msgr2=0x7f389c196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f389c0ff350 0x7f389c196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 -- 172.21.15.35:0/170601921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 msgr2=0x7f389c196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 0x7f389c196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 -- 172.21.15.35:0/170601921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900095f0 con 0x7f389c104390 2023-03-17T10:12:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f389bfff700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 0x7f389c196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:12:42.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f38a11a7700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 0x7f389c19abf0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f389400ef30 tx=0x7f389400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:42.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f3899ffb700 1 -- 172.21.15.35:0/170601921 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894018070 con 0x7f389c104390 2023-03-17T10:12:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.977+0000 7f3899ffb700 1 -- 172.21.15.35:0/170601921 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f389400f040 con 0x7f389c104390 2023-03-17T10:12:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.978+0000 7f3899ffb700 1 -- 172.21.15.35:0/170601921 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389400cc70 con 0x7f389c104390 2023-03-17T10:12:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.978+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c10f000 con 0x7f389c104390 2023-03-17T10:12:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.978+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c10ee70 con 0x7f389c104390 2023-03-17T10:12:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.980+0000 7f3899ffb700 1 -- 172.21.15.35:0/170601921 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3894007500 con 0x7f389c104390 2023-03-17T10:12:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.980+0000 7f3899ffb700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f388c09f6c0 0x7f388c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.981+0000 7f3899ffb700 1 -- 172.21.15.35:0/170601921 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f38940ca0f0 con 0x7f389c104390 2023-03-17T10:12:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.981+0000 7f38a09a6700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f388c09f6c0 0x7f388c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.981+0000 7f38a09a6700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f388c09f6c0 0x7f388c0a1b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f389000b580 tx=0x7f3890005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 Processor -- start 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 -- start start 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef29fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef24420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ee2b010 con 0x55c66ef29be0 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ee7d950 con 0x55c66ef2a4f0 2023-03-17T10:12:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38aed97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ee76de0 con 0x55c66ef24960 2023-03-17T10:12:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef29fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef29fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49128/0 (socket says 172.21.15.35:49128) 2023-03-17T10:12:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 -- 172.21.15.35:0/3954774555 learned_addr learned my addr 172.21.15.35:0/3954774555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a11a7700 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f389bfff700 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef24420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 -- 172.21.15.35:0/3954774555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 msgr2=0x55c66ef24d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef24d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:48.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 -- 172.21.15.35:0/3954774555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 msgr2=0x55c66ef24420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef24420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.982+0000 7f38a09a6700 1 -- 172.21.15.35:0/3954774555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c66ecf85d0 con 0x55c66ef29be0 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.983+0000 7f38a09a6700 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef29fb0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f3890015000 tx=0x7f389001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e5020c5247a5b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.983+0000 7f3886ffd700 1 -- 172.21.15.35:0/3954774555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890028070 con 0x55c66ef29be0 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.983+0000 7f3886ffd700 1 -- 172.21.15.35:0/3954774555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f389001e040 con 0x55c66ef29be0 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.983+0000 7f3886ffd700 1 -- 172.21.15.35:0/3954774555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000f660 con 0x55c66ef29be0 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.983+0000 7f38aed97b80 1 -- 172.21.15.35:0/3954774555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 msgr2=0x55c66ef29fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.983+0000 7f38aed97b80 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef29fb0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f3890015000 tx=0x7f389001f000 comp rx=0 tx=0).stop 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- 172.21.15.35:0/3954774555 shutdown_connections 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef24d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef29fb0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 --2- 172.21.15.35:0/3954774555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef24420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- 172.21.15.35:0/3954774555 >> 172.21.15.35:0/3954774555 conn(0x55c66ed816b0 msgr2=0x55c66ef1ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- 172.21.15.35:0/3954774555 shutdown_connections 2023-03-17T10:12:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- 172.21.15.35:0/3954774555 wait complete. 2023-03-17T10:12:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- start start 2023-03-17T10:12:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 Processor -- start 2023-03-17T10:12:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef303f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef2d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef2dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ecfa8c0 con 0x55c66ef24960 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef2e410 con 0x55c66ef2a4f0 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.984+0000 7f38aed97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef39fa0 con 0x55c66ef29be0 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38aed97b80 10 client.0 _ll_register_callbacks cb 0x55c66ed1c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef303f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49134/0 (socket says 172.21.15.35:49134) 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 -- 172.21.15.35:0/1229817053 learned_addr learned my addr 172.21.15.35:0/1229817053 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f389bfff700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef2d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a11a7700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef2dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 -- 172.21.15.35:0/1229817053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 msgr2=0x55c66ef2d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef2d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 -- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 msgr2=0x55c66ef2dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef2dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 -- 172.21.15.35:0/1229817053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c10c7a0 con 0x55c66ef24960 2023-03-17T10:12:49.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a11a7700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef2dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:12:49.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38a09a6700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef303f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f389002f040 tx=0x7f389000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a190efa1e23376 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:49.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f387bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f387bfff700 1 -- 172.21.15.35:0/1229817053 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890028040 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f387bfff700 1 -- 172.21.15.35:0/1229817053 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(204..204 src has 1..204) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f389000f920 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.985+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c66ee39390 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f387bfff700 1 -- 172.21.15.35:0/1229817053 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f389000fae0 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 10 client.18270 fetch_fsmap learned FSMap version 37 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55c66eca4d80 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f387bfff700 1 -- 172.21.15.35:0/1229817053 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c66ee39390 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f387bfff700 1 -- 172.21.15.35:0/1229817053 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3890035b00 con 0x55c66ef24960 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 10 client.18270 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 10 client.18270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:12:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 20 client.18270 populate_metadata read hostname 'smithi035' 2023-03-17T10:12:50.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:23 smithi035 ceph-mon[92535]: pgmap v2487: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T10:12:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef3dc20 0x55c66ef40030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 4 client.18270 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:12:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c66ee45600 con 0x55c66ef3dc20 2023-03-17T10:12:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.986+0000 7f389bfff700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef3dc20 0x55c66ef40030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.987+0000 7f389bfff700 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef3dc20 0x55c66ef40030 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ff5b9da5b23e147 server_cookie=848684bf24d541e in_seq=0 out_seq=0 2023-03-17T10:12:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.987+0000 7f387bfff700 10 client.18270 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.987+0000 7f387bfff700 1 -- 172.21.15.35:0/1229817053 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c66ee45600 con 0x55c66ef3dc20 2023-03-17T10:12:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.987+0000 7f387bfff700 10 client.18270 handle_command_reply: tid=0 2023-03-17T10:12:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.987+0000 7f38aed97b80 1 client.18270 shutdown 2023-03-17T10:12:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 msgr2=0x55c66ef303f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef303f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f389002f040 tx=0x7f389000bf10 comp rx=0 tx=0).stop 2023-03-17T10:12:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 shutdown_connections 2023-03-17T10:12:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef3dc20 0x55c66ef40030 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef2dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f387bfff700 0 client.18270 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef303f0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 --2- 172.21.15.35:0/1229817053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef2d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 >> 172.21.15.35:0/1229817053 conn(0x55c66ed816b0 msgr2=0x55c66ef23410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 shutdown_connections 2023-03-17T10:12:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 1 -- 172.21.15.35:0/1229817053 wait complete. 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:34.988+0000 7f38aed97b80 20 client.18270 trim_cache size 0 max 16384 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 Processor -- start 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 -- start start 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef34ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef2ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef2e660 con 0x55c66ef29be0 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef1a100 con 0x55c66ef2a4f0 2023-03-17T10:12:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38aed97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef28200 con 0x55c66ef24960 2023-03-17T10:12:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f389bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef2ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f389bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef2ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49144/0 (socket says 172.21.15.35:49144) 2023-03-17T10:12:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f389bfff700 1 -- 172.21.15.35:0/36417100 learned_addr learned my addr 172.21.15.35:0/36417100 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38a11a7700 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f38a09a6700 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef34ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f389bfff700 1 -- 172.21.15.35:0/36417100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 msgr2=0x55c66ef34ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.003+0000 7f389bfff700 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef34ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f389bfff700 1 -- 172.21.15.35:0/36417100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 msgr2=0x55c66ef276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f389bfff700 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef276b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f389bfff700 1 -- 172.21.15.35:0/36417100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c66ee3d130 con 0x55c66ef29be0 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f38a09a6700 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef34ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f389bfff700 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef2ff90 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f388800b370 tx=0x7f3888004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ec021a1d4d34c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f38877fe700 1 -- 172.21.15.35:0/36417100 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888017040 con 0x55c66ef29be0 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f38877fe700 1 -- 172.21.15.35:0/36417100 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f388801de40 con 0x55c66ef29be0 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f38877fe700 1 -- 172.21.15.35:0/36417100 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880126b0 con 0x55c66ef29be0 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f38aed97b80 1 -- 172.21.15.35:0/36417100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 msgr2=0x55c66ef2ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.004+0000 7f38aed97b80 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef2ff90 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f388800b370 tx=0x7f3888004320 comp rx=0 tx=0).stop 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- 172.21.15.35:0/36417100 shutdown_connections 2023-03-17T10:12:54.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef24960 0x55c66ef34ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 --2- 172.21.15.35:0/36417100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef29be0 0x55c66ef2ff90 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- 172.21.15.35:0/36417100 >> 172.21.15.35:0/36417100 conn(0x55c66ed816b0 msgr2=0x55c66ef23b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- 172.21.15.35:0/36417100 shutdown_connections 2023-03-17T10:12:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- 172.21.15.35:0/36417100 wait complete. 2023-03-17T10:12:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- start start 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 Processor -- start 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef34a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef34f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef32ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef33590 con 0x55c66ef24960 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef33700 con 0x55c66ef2a4f0 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c66ef338c0 con 0x55c66ef29be0 2023-03-17T10:12:54.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.005+0000 7f38aed97b80 10 client.0 _ll_register_callbacks cb 0x55c66ed1c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:12:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef34a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef34a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49148/0 (socket says 172.21.15.35:49148) 2023-03-17T10:12:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 -- 172.21.15.35:0/145380578 learned_addr learned my addr 172.21.15.35:0/145380578 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f389bfff700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef34f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a11a7700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef32ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 -- 172.21.15.35:0/145380578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 msgr2=0x55c66ef34f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef34f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 -- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 msgr2=0x55c66ef32ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef32ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 -- 172.21.15.35:0/145380578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c66eccb1f0 con 0x55c66ef24960 2023-03-17T10:12:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a11a7700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef32ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:12:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38a09a6700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef34a00 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f3890035ee0 tx=0x7f3890022a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01fa09298532a4a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:12:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f387bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:12:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f387bfff700 1 -- 172.21.15.35:0/145380578 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890028040 con 0x55c66ef24960 2023-03-17T10:12:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c66eef41e0 con 0x55c66ef24960 2023-03-17T10:12:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f387bfff700 1 -- 172.21.15.35:0/145380578 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(204..204 src has 1..204) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f38900225b0 con 0x55c66ef24960 2023-03-17T10:12:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f387bfff700 1 -- 172.21.15.35:0/145380578 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3890005920 con 0x55c66ef24960 2023-03-17T10:12:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38aed97b80 10 client.18276 fetch_fsmap learned FSMap version 37 2023-03-17T10:12:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55c66ec8dc00 con 0x55c66ef24960 2023-03-17T10:12:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.006+0000 7f387bfff700 1 -- 172.21.15.35:0/145380578 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f389004a020 con 0x55c66ef24960 2023-03-17T10:12:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f387bfff700 1 -- 172.21.15.35:0/145380578 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f38900357f0 con 0x55c66ef24960 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f38aed97b80 10 client.18276 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f38aed97b80 10 client.18276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f38aed97b80 20 client.18276 populate_metadata read hostname 'smithi035' 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f38aed97b80 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef928a0 0x55c66ef94c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f38aed97b80 4 client.18276 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c66ecfaf00 con 0x55c66ef928a0 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f389bfff700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef928a0 0x55c66ef94c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f387bfff700 10 client.18276 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.007+0000 7f389bfff700 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef928a0 0x55c66ef94c80 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed7cb3c1760bc02c server_cookie=f0657fbeedb972ef in_seq=0 out_seq=0 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f387bfff700 1 -- 172.21.15.35:0/145380578 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c66ecfaf00 con 0x55c66ef928a0 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f387bfff700 10 client.18276 handle_command_reply: tid=0 2023-03-17T10:12:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 client.18276 shutdown 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 msgr2=0x55c66ef34a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef34a00 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f3890035ee0 tx=0x7f3890022a20 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 shutdown_connections 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c66ef928a0 0x55c66ef94c80 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c66ef2a4f0 0x55c66ef32ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c66ef24960 0x55c66ef34a00 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f387bfff700 0 client.18276 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 --2- 172.21.15.35:0/145380578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c66ef29be0 0x55c66ef34f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 >> 172.21.15.35:0/145380578 conn(0x55c66ed816b0 msgr2=0x55c66ef276b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 shutdown_connections 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 1 -- 172.21.15.35:0/145380578 wait complete. 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.012+0000 7f38aed97b80 20 client.18276 trim_cache size 0 max 16384 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f388c09f6c0 msgr2=0x7f388c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f388c09f6c0 0x7f388c0a1b70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f389000b580 tx=0x7f3890005c00 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 msgr2=0x7f389c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 0x7f389c19abf0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f389400ef30 tx=0x7f389400c3a0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 shutdown_connections 2023-03-17T10:12:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f388c09f6c0 0x7f388c0a1b70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f389c104390 0x7f389c19abf0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f389c0ff350 0x7f389c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 --2- 172.21.15.35:0/170601921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f389c0ffcf0 0x7f389c196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 >> 172.21.15.35:0/170601921 conn(0x7f389c076330 msgr2=0x7f389c102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 shutdown_connections 2023-03-17T10:12:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:49:35.013+0000 7f38a2c0a700 1 -- 172.21.15.35:0/170601921 wait complete. 2023-03-17T10:12:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2582992528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a40ffa80 msgr2=0x7ff1a40ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2582992528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a40ffa80 0x7ff1a40ffe50 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff1980099c0 tx=0x7ff198009cd0 comp rx=0 tx=0).stop 2023-03-17T10:12:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2582992528 shutdown_connections 2023-03-17T10:12:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2582992528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a41045a0 0x7ff1a410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2582992528 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a40ffa80 0x7ff1a40ffe50 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2582992528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a4100420 0x7ff1a4103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2582992528 >> 172.21.15.35:0/2582992528 conn(0x7ff1a40757a0 msgr2=0x7ff1a4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2582992528 shutdown_connections 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.306+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2582992528 wait complete. 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 Processor -- start 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 -- start start 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a40ffa80 0x7ff1a41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a4100420 0x7ff1a4197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 0x7ff1a41a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:12:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4198060 con 0x7ff1a41045a0 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a41a27a0 con 0x7ff1a4100420 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1aacf3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a41a2960 con 0x7ff1a40ffa80 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 0x7ff1a41a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 0x7ff1a41a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49164/0 (socket says 172.21.15.35:49164) 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 -- 172.21.15.35:0/2863241407 learned_addr learned my addr 172.21.15.35:0/2863241407 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a40ffa80 0x7ff1a41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a4100420 0x7ff1a4197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:12:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 -- 172.21.15.35:0/2863241407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a40ffa80 msgr2=0x7ff1a41971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a40ffa80 0x7ff1a41971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:12:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 -- 172.21.15.35:0/2863241407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a4100420 msgr2=0x7ff1a4197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:12:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a4100420 0x7ff1a4197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 -- 172.21.15.35:0/2863241407 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980095f0 con 0x7ff1a41045a0 2023-03-17T10:13:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a4100420 0x7ff1a4197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:13:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.307+0000 7ff1a9290700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 0x7ff1a41a2260 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007d70 tx=0x7ff19c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.308+0000 7ff1a1ffb700 1 -- 172.21.15.35:0/2863241407 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00ad40 con 0x7ff1a41045a0 2023-03-17T10:13:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.308+0000 7ff1a1ffb700 1 -- 172.21.15.35:0/2863241407 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff19c0128b0 con 0x7ff1a41045a0 2023-03-17T10:13:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.308+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a410f210 con 0x7ff1a41045a0 2023-03-17T10:13:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.308+0000 7ff1a1ffb700 1 -- 172.21.15.35:0/2863241407 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0115a0 con 0x7ff1a41045a0 2023-03-17T10:13:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.308+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a410f080 con 0x7ff1a41045a0 2023-03-17T10:13:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.310+0000 7ff1a1ffb700 1 -- 172.21.15.35:0/2863241407 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff19c012a20 con 0x7ff1a41045a0 2023-03-17T10:13:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.310+0000 7ff1a1ffb700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff19409f6c0 0x7ff1940a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.311+0000 7ff1a1ffb700 1 -- 172.21.15.35:0/2863241407 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff19c0ca6d0 con 0x7ff1a41045a0 2023-03-17T10:13:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.311+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff19409f6c0 0x7ff1940a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.311+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff19409f6c0 0x7ff1940a1b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff19800b580 tx=0x7ff198009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.311+0000 7ff1b6e80b80 1 Processor -- start 2023-03-17T10:13:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 -- start start 2023-03-17T10:13:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d1496a1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1495a8010 con 0x55d1496a1960 2023-03-17T10:13:04.162 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:25 smithi035 ceph-mon[92535]: pgmap v2488: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1495fa950 con 0x55d1496a74f0 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1495f3de0 con 0x55d1496a6be0 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49172/0 (socket says 172.21.15.35:49172) 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 -- 172.21.15.35:0/3692429140 learned_addr learned my addr 172.21.15.35:0/3692429140 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d1496a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 -- 172.21.15.35:0/3692429140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 msgr2=0x55d1496a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 -- 172.21.15.35:0/3692429140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 msgr2=0x55d1496a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d1496a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 -- 172.21.15.35:0/3692429140 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1494755d0 con 0x55d1496a1960 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.312+0000 7ff1a9290700 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496a1d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff19c094d00 tx=0x7ff19c012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8936b2f2a79c949 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff18effd700 1 -- 172.21.15.35:0/3692429140 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c092ea0 con 0x55d1496a1960 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff18effd700 1 -- 172.21.15.35:0/3692429140 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff19c096630 con 0x55d1496a1960 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff18effd700 1 -- 172.21.15.35:0/3692429140 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0979e0 con 0x55d1496a1960 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3692429140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 msgr2=0x55d1496a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496a1d90 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff19c094d00 tx=0x7ff19c012dd0 comp rx=0 tx=0).stop 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3692429140 shutdown_connections 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496a1d90 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3692429140 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d1496a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3692429140 >> 172.21.15.35:0/3692429140 conn(0x55d1494fe6b0 msgr2=0x55d14969ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3692429140 shutdown_connections 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.313+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3692429140 wait complete. 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 -- start start 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 Processor -- start 2023-03-17T10:13:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a6be0 0x55d1496aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a74f0 0x55d1496aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1494778c0 con 0x55d1496a1960 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1496ab650 con 0x55d1496a6be0 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1496b7000 con 0x55d1496a74f0 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1b6e80b80 10 client.0 _ll_register_callbacks cb 0x55d149499230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1a8a8f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1a8a8f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49174/0 (socket says 172.21.15.35:49174) 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.314+0000 7ff1a8a8f700 1 -- 172.21.15.35:0/2719752092 learned_addr learned my addr 172.21.15.35:0/2719752092 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a9290700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a74f0 0x55d1496aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a6be0 0x55d1496aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a8a8f700 1 -- 172.21.15.35:0/2719752092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a74f0 msgr2=0x55d1496aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a74f0 0x55d1496aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a8a8f700 1 -- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a6be0 msgr2=0x55d1496aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a6be0 0x55d1496aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a8a8f700 1 -- 172.21.15.35:0/2719752092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a410f080 con 0x55d1496a1960 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496ad4b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff1980099c0 tx=0x7ff198009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf61e87aec46f60e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff183fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:13:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff183fff700 1 -- 172.21.15.35:0/2719752092 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198004cf0 con 0x55d1496a1960 2023-03-17T10:13:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff183fff700 1 -- 172.21.15.35:0/2719752092 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff198004e50 con 0x55d1496a1960 2023-03-17T10:13:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1495b6390 con 0x55d1496a1960 2023-03-17T10:13:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff183fff700 1 -- 172.21.15.35:0/2719752092 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff198003820 con 0x55d1496a1960 2023-03-17T10:13:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1b6e80b80 10 client.18288 fetch_fsmap learned FSMap version 37 2023-03-17T10:13:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d149421d80 con 0x55d1496a1960 2023-03-17T10:13:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.315+0000 7ff183fff700 1 -- 172.21.15.35:0/2719752092 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d1495b6390 con 0x55d1496a1960 2023-03-17T10:13:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff183fff700 1 -- 172.21.15.35:0/2719752092 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff19802f070 con 0x55d1496a1960 2023-03-17T10:13:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1b6e80b80 10 client.18288 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:13:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1b6e80b80 10 client.18288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:13:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1b6e80b80 20 client.18288 populate_metadata read hostname 'smithi035' 2023-03-17T10:13:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1496bb2a0 0x55d1496bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1b6e80b80 4 client.18288 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1495c2600 con 0x55d1496bb2a0 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1496bb2a0 0x55d1496bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff183fff700 10 client.18288 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.316+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1496bb2a0 0x55d1496bd6b0 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252e75ad85a67617 server_cookie=32fde920abb1bc7f in_seq=0 out_seq=0 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff183fff700 1 -- 172.21.15.35:0/2719752092 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d1495c2600 con 0x55d1496bb2a0 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff183fff700 10 client.18288 handle_command_reply: tid=0 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 client.18288 shutdown 2023-03-17T10:13:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 msgr2=0x55d1496ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496ad4b0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff1980099c0 tx=0x7ff198009cd0 comp rx=0 tx=0).stop 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 shutdown_connections 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1496bb2a0 0x55d1496bd6b0 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a74f0 0x55d1496aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a1960 0x55d1496ad4b0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff183fff700 0 client.18288 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/2719752092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a6be0 0x55d1496aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 >> 172.21.15.35:0/2719752092 conn(0x55d1494fe6b0 msgr2=0x55d1496a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.317+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 shutdown_connections 2023-03-17T10:13:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.318+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/2719752092 wait complete. 2023-03-17T10:13:10.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.318+0000 7ff1b6e80b80 20 client.18288 trim_cache size 0 max 16384 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 Processor -- start 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 -- start start 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a1960 0x55d1496b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 0x55d1496a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1496985f0 con 0x55d1496a74f0 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1496a0b20 con 0x55d1496a1960 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d149698b90 con 0x55d1496a6be0 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 0x55d1496a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 0x55d1496a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49186/0 (socket says 172.21.15.35:49186) 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 -- 172.21.15.35:0/1072581520 learned_addr learned my addr 172.21.15.35:0/1072581520 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:10.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a1960 0x55d1496b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 -- 172.21.15.35:0/1072581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 msgr2=0x55d1496ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 -- 172.21.15.35:0/1072581520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a1960 msgr2=0x55d1496b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a1960 0x55d1496b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a9290700 1 -- 172.21.15.35:0/1072581520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1495ba130 con 0x55d1496a74f0 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a1960 0x55d1496b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:13:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.333+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1a9290700 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 0x55d1496a9f60 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0c8020 tx=0x7ff19c0a0540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09e29dffd2983b3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff18f7fe700 1 -- 172.21.15.35:0/1072581520 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c092ea0 con 0x55d1496a74f0 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff18f7fe700 1 -- 172.21.15.35:0/1072581520 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff19c097dd0 con 0x55d1496a74f0 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff18f7fe700 1 -- 172.21.15.35:0/1072581520 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c098750 con 0x55d1496a74f0 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/1072581520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 msgr2=0x55d1496a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 0x55d1496a9f60 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0c8020 tx=0x7ff19c0a0540 comp rx=0 tx=0).stop 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/1072581520 shutdown_connections 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a74f0 0x55d1496a9f60 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:13.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a1960 0x55d1496b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/1072581520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a6be0 0x55d1496ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/1072581520 >> 172.21.15.35:0/1072581520 conn(0x55d1494fe6b0 msgr2=0x55d1496a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/1072581520 shutdown_connections 2023-03-17T10:13:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.334+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/1072581520 wait complete. 2023-03-17T10:13:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 -- start start 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 Processor -- start 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a1960 0x55d1496b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 0x55d1496b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d14970e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14970e680 con 0x55d1496a6be0 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14970e7c0 con 0x55d1496a74f0 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14970e930 con 0x55d1496a1960 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1b6e80b80 10 client.0 _ll_register_callbacks cb 0x55d149499230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1a3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 0x55d1496b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1a3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 0x55d1496b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49190/0 (socket says 172.21.15.35:49190) 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.335+0000 7ff1a3fff700 1 -- 172.21.15.35:0/3052785371 learned_addr learned my addr 172.21.15.35:0/3052785371 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a1960 0x55d1496b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a9290700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d14970e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a3fff700 1 -- 172.21.15.35:0/3052785371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a1960 msgr2=0x55d1496b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a1960 0x55d1496b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a3fff700 1 -- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 msgr2=0x55d14970e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d14970e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a3fff700 1 -- 172.21.15.35:0/3052785371 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1494755d0 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1a3fff700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 0x55d1496b0660 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40732a0 tx=0x7ff19001ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbdb0cb204dfeee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff183fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff183fff700 1 -- 172.21.15.35:0/3052785371 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190017040 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff183fff700 1 -- 172.21.15.35:0/3052785371 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff19001c5b0 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1496711e0 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff183fff700 1 -- 172.21.15.35:0/3052785371 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff190003680 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1b6e80b80 10 client.18294 fetch_fsmap learned FSMap version 37 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d1494481f0 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.336+0000 7ff183fff700 1 -- 172.21.15.35:0/3052785371 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d1496711e0 con 0x55d1496a6be0 2023-03-17T10:13:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff183fff700 1 -- 172.21.15.35:0/3052785371 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff190011810 con 0x55d1496a6be0 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1b6e80b80 10 client.18294 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1b6e80b80 10 client.18294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1b6e80b80 20 client.18294 populate_metadata read hostname 'smithi035' 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1497100a0 0x55d1497124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1b6e80b80 4 client.18294 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d149477f00 con 0x55d1497100a0 2023-03-17T10:13:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1497100a0 0x55d1497124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:18.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff183fff700 10 client.18294 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.337+0000 7ff1a8a8f700 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1497100a0 0x55d1497124b0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=970e83701776b4dd server_cookie=2f573a1c51f41599 in_seq=0 out_seq=0 2023-03-17T10:13:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff183fff700 1 -- 172.21.15.35:0/3052785371 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d149477f00 con 0x55d1497100a0 2023-03-17T10:13:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff183fff700 10 client.18294 handle_command_reply: tid=0 2023-03-17T10:13:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 client.18294 shutdown 2023-03-17T10:13:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 msgr2=0x55d1496b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 0x55d1496b0660 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40732a0 tx=0x7ff19001ce30 comp rx=0 tx=0).stop 2023-03-17T10:13:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 shutdown_connections 2023-03-17T10:13:18.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d1497100a0 0x55d1497124b0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1496a74f0 0x55d14970e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff183fff700 0 client.18294 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d1496a1960 0x55d1496b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 --2- 172.21.15.35:0/3052785371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d1496a6be0 0x55d1496b0660 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.345+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 >> 172.21.15.35:0/3052785371 conn(0x55d1494fe6b0 msgr2=0x55d1496a46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 shutdown_connections 2023-03-17T10:13:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1b6e80b80 1 -- 172.21.15.35:0/3052785371 wait complete. 2023-03-17T10:13:20.628 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:27 smithi035 ceph-mon[92535]: pgmap v2489: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 342 B/s wr, 9 op/s 2023-03-17T10:13:22.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:29 smithi035 ceph-mon[92535]: pgmap v2490: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T10:13:22.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:31 smithi035 ceph-mon[92535]: pgmap v2491: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:23.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:33 smithi035 ceph-mon[92535]: pgmap v2492: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:13:23.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:35 smithi035 ceph-mon[92535]: pgmap v2493: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:13:23.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:37 smithi035 ceph-mon[92535]: pgmap v2494: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:13:23.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:39 smithi035 ceph-mon[92535]: pgmap v2495: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:13:23.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:41 smithi035 ceph-mon[92535]: pgmap v2496: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:13:23.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:43 smithi035 ceph-mon[92535]: pgmap v2497: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:45 smithi035 ceph-mon[92535]: pgmap v2498: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:47 smithi035 ceph-mon[92535]: pgmap v2499: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:49 smithi035 ceph-mon[92535]: pgmap v2500: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:51 smithi035 ceph-mon[92535]: pgmap v2501: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:53 smithi035 ceph-mon[92535]: pgmap v2502: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:55 smithi035 ceph-mon[92535]: pgmap v2503: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:23.219 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:57 smithi035 ceph-mon[92535]: pgmap v2504: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:25.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:02:59 smithi035 ceph-mon[92535]: pgmap v2505: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:13:25.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:01 smithi035 ceph-mon[92535]: pgmap v2506: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:13:25.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:03 smithi035 ceph-mon[92535]: pgmap v2507: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:13:25.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:05 smithi035 ceph-mon[92535]: pgmap v2508: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:13:27.261 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:07 smithi035 ceph-mon[92535]: pgmap v2509: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:13:27.261 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:09 smithi035 ceph-mon[92535]: osdmap e235: 12 total, 12 up, 12 in 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:09 smithi035 ceph-mon[92535]: pgmap v2511: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:11 smithi035 ceph-mon[92535]: pgmap v2512: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:12 smithi035 ceph-mon[92535]: pgmap v2513: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:12 smithi035 ceph-mon[92535]: pgmap v2514: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T10:13:27.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:14 smithi035 ceph-mon[92535]: pgmap v2515: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T10:13:29.114 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:16 smithi035 ceph-mon[92535]: pgmap v2516: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 147 B/s wr, 7 op/s 2023-03-17T10:13:29.114 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:16 smithi035 ceph-mon[92535]: osdmap e236: 12 total, 12 up, 12 in 2023-03-17T10:13:29.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:18 smithi035 ceph-mon[92535]: pgmap v2518: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T10:13:29.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:20 smithi035 ceph-mon[92535]: pgmap v2519: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:13:29.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:22 smithi035 ceph-mon[92535]: pgmap v2520: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:13:29.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:24 smithi035 ceph-mon[92535]: pgmap v2521: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:13:30.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:13:30.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:13:30.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:13:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:13:31.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1b6e80b80 20 client.18294 trim_cache size 0 max 16384 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff19409f6c0 msgr2=0x7ff1940a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff19409f6c0 0x7ff1940a1b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff19800b580 tx=0x7ff198009f10 comp rx=0 tx=0).stop 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 msgr2=0x7ff1a41a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 0x7ff1a41a2260 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007d70 tx=0x7ff19c00a340 comp rx=0 tx=0).stop 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 shutdown_connections 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff19409f6c0 0x7ff1940a1b70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1a41045a0 0x7ff1a41a2260 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1a40ffa80 0x7ff1a41971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 --2- 172.21.15.35:0/2863241407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1a4100420 0x7ff1a4197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 >> 172.21.15.35:0/2863241407 conn(0x7ff1a40757a0 msgr2=0x7ff1a4102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 shutdown_connections 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:41.346+0000 7ff1aacf3700 1 -- 172.21.15.35:0/2863241407 wait complete. 2023-03-17T10:13:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 -- 172.21.15.35:0/1742495615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 msgr2=0x7f085010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 --2- 172.21.15.35:0/1742495615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085010d080 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f084800b0d0 tx=0x7f084800b3e0 comp rx=0 tx=0).stop 2023-03-17T10:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 -- 172.21.15.35:0/1742495615 shutdown_connections 2023-03-17T10:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 --2- 172.21.15.35:0/1742495615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085010d080 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 --2- 172.21.15.35:0/1742495615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0850100470 0x7f0850100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 --2- 172.21.15.35:0/1742495615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100e10 0x7f0850104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 -- 172.21.15.35:0/1742495615 >> 172.21.15.35:0/1742495615 conn(0x7f08500fbce0 msgr2=0x7f08500fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 -- 172.21.15.35:0/1742495615 shutdown_connections 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 -- 172.21.15.35:0/1742495615 wait complete. 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 Processor -- start 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.470+0000 7f085705b700 1 -- start start 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f085705b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100470 0x7f08501963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f085705b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0850100e10 0x7f08501968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f085705b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f085705b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085019b380 con 0x7f08501054b0 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f085705b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085019b4f0 con 0x7f0850100470 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f085705b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085019b6b0 con 0x7f0850100e10 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085019ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49206/0 (socket says 172.21.15.35:49206) 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 -- 172.21.15.35:0/1707377653 learned_addr learned my addr 172.21.15.35:0/1707377653 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f084ffff700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0850100e10 0x7f08501968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f0854df7700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100470 0x7f08501963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 -- 172.21.15.35:0/1707377653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0850100e10 msgr2=0x7f08501968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0850100e10 0x7f08501968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 -- 172.21.15.35:0/1707377653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100470 msgr2=0x7f08501963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100470 0x7f08501963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 -- 172.21.15.35:0/1707377653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009d00 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f0854df7700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100470 0x7f08501963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.471+0000 7f08555f8700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085019ad40 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0848009fd0 tx=0x7f084800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.472+0000 7f084dffb700 1 -- 172.21.15.35:0/1707377653 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800e040 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.472+0000 7f084dffb700 1 -- 172.21.15.35:0/1707377653 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08480094a0 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.472+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0850110130 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.472+0000 7f084dffb700 1 -- 172.21.15.35:0/1707377653 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480052a0 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.472+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085010ffa0 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.474+0000 7f084dffb700 1 -- 172.21.15.35:0/1707377653 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f084801b450 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.475+0000 7f084dffb700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f084009f640 0x7f08400a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.475+0000 7f0854df7700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f084009f640 0x7f08400a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.475+0000 7f084dffb700 1 -- 172.21.15.35:0/1707377653 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f08480cb7a0 con 0x7f08501054b0 2023-03-17T10:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f0854df7700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f084009f640 0x7f08400a1af0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0844009cb0 tx=0x7f0844009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 Processor -- start 2023-03-17T10:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 -- start start 2023-03-17T10:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26726be0 0x562a26726fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26721420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a26721d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a26628010 con 0x562a26721960 2023-03-17T10:13:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2667a950 con 0x562a267274f0 2023-03-17T10:13:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08631e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a26673de0 con 0x562a26726be0 2023-03-17T10:13:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08555f8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a26721d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08555f8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a26721d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49214/0 (socket says 172.21.15.35:49214) 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.476+0000 7f08555f8700 1 -- 172.21.15.35:0/1084404614 learned_addr learned my addr 172.21.15.35:0/1084404614 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f084ffff700 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26721420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f0854df7700 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26726be0 0x562a26726fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f08555f8700 1 -- 172.21.15.35:0/1084404614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26726be0 msgr2=0x562a26726fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f08555f8700 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26726be0 0x562a26726fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f08555f8700 1 -- 172.21.15.35:0/1084404614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 msgr2=0x562a26721420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f08555f8700 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26721420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f08555f8700 1 -- 172.21.15.35:0/1084404614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a264f55d0 con 0x562a26721960 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f084ffff700 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26721420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f08555f8700 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a26721d90 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0848095d50 tx=0x7f0848003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14928a7cef3a55e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f083affd700 1 -- 172.21.15.35:0/1084404614 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480992e0 con 0x562a26721960 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f083affd700 1 -- 172.21.15.35:0/1084404614 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08480a1440 con 0x562a26721960 2023-03-17T10:13:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.477+0000 7f083affd700 1 -- 172.21.15.35:0/1084404614 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480987d0 con 0x562a26721960 2023-03-17T10:13:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 -- 172.21.15.35:0/1084404614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 msgr2=0x562a26721d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a26721d90 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0848095d50 tx=0x7f0848003f10 comp rx=0 tx=0).stop 2023-03-17T10:13:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 -- 172.21.15.35:0/1084404614 shutdown_connections 2023-03-17T10:13:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a26721d90 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26726be0 0x562a26726fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 --2- 172.21.15.35:0/1084404614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26721420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 -- 172.21.15.35:0/1084404614 >> 172.21.15.35:0/1084404614 conn(0x562a2657e6b0 msgr2=0x562a2671ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 -- 172.21.15.35:0/1084404614 shutdown_connections 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 -- 172.21.15.35:0/1084404614 wait complete. 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 -- start start 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.478+0000 7f08631e8b80 1 Processor -- start 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a2672d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a2672a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a2672ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a264f78c0 con 0x562a26726be0 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2672b5e0 con 0x562a267274f0 2023-03-17T10:13:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2673b1e0 con 0x562a26721960 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08631e8b80 10 client.0 _ll_register_callbacks cb 0x562a26519230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a2672a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a2672a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49218/0 (socket says 172.21.15.35:49218) 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 -- 172.21.15.35:0/2637589555 learned_addr learned my addr 172.21.15.35:0/2637589555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f08555f8700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a2672ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f0854df7700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a2672d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 -- 172.21.15.35:0/2637589555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 msgr2=0x562a2672d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a2672d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 -- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 msgr2=0x562a2672ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a2672ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 -- 172.21.15.35:0/2637589555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085010ffa0 con 0x562a26726be0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f084ffff700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a2672a730 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f083c0116f0 tx=0x7f083c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3232c51afd8a8198 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.479+0000 7f082ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f082ffff700 1 -- 172.21.15.35:0/2637589555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c016070 con 0x562a26726be0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f082ffff700 1 -- 172.21.15.35:0/2637589555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f083c004320 con 0x562a26726be0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a26636390 con 0x562a26726be0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f082ffff700 1 -- 172.21.15.35:0/2637589555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083c0044e0 con 0x562a26726be0 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 10 client.18306 fetch_fsmap learned FSMap version 37 2023-03-17T10:13:37.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562a264a1d80 con 0x562a26726be0 2023-03-17T10:13:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f082ffff700 1 -- 172.21.15.35:0/2637589555 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a26636390 con 0x562a26726be0 2023-03-17T10:13:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f082ffff700 1 -- 172.21.15.35:0/2637589555 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f083c00f710 con 0x562a26726be0 2023-03-17T10:13:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 10 client.18306 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:13:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 10 client.18306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:13:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 20 client.18306 populate_metadata read hostname 'smithi035' 2023-03-17T10:13:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a2673f360 0x562a26741770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:38.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 4 client.18306 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:13:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.480+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a26642600 con 0x562a2673f360 2023-03-17T10:13:38.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.481+0000 7f0854df7700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a2673f360 0x562a26741770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.481+0000 7f0854df7700 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a2673f360 0x562a26741770 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ec758a78802e99 server_cookie=3ad7ef3901d61122 in_seq=0 out_seq=0 2023-03-17T10:13:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.481+0000 7f082ffff700 10 client.18306 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f082ffff700 1 -- 172.21.15.35:0/2637589555 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562a26642600 con 0x562a2673f360 2023-03-17T10:13:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f082ffff700 10 client.18306 handle_command_reply: tid=0 2023-03-17T10:13:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 client.18306 shutdown 2023-03-17T10:13:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 msgr2=0x562a2672a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a2672a730 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f083c0116f0 tx=0x7f083c011a00 comp rx=0 tx=0).stop 2023-03-17T10:13:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 shutdown_connections 2023-03-17T10:13:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a2673f360 0x562a26741770 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a2672ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f082ffff700 0 client.18306 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a2672d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2637589555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a2672a730 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 >> 172.21.15.35:0/2637589555 conn(0x562a2657e6b0 msgr2=0x562a26720410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 shutdown_connections 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 1 -- 172.21.15.35:0/2637589555 wait complete. 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.482+0000 7f08631e8b80 20 client.18306 trim_cache size 0 max 16384 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 Processor -- start 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 -- start start 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a2671bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a26726be0 0x562a267361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a267274f0 0x562a26720a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a26642630 con 0x562a26721960 2023-03-17T10:13:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a266363c0 con 0x562a26726be0 2023-03-17T10:13:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f08631e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a2671c000 con 0x562a267274f0 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f0854df7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a2671bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f0854df7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a2671bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49224/0 (socket says 172.21.15.35:49224) 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f0854df7700 1 -- 172.21.15.35:0/4178047138 learned_addr learned my addr 172.21.15.35:0/4178047138 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.497+0000 7f084ffff700 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a26726be0 0x562a267361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08555f8700 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a267274f0 0x562a26720a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f0854df7700 1 -- 172.21.15.35:0/4178047138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a267274f0 msgr2=0x562a26720a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f0854df7700 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a267274f0 0x562a26720a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f0854df7700 1 -- 172.21.15.35:0/4178047138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a26726be0 msgr2=0x562a267361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f0854df7700 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a26726be0 0x562a267361b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:42.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f0854df7700 1 -- 172.21.15.35:0/4178047138 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a2663a130 con 0x562a26721960 2023-03-17T10:13:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f0854df7700 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a2671bac0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0844009810 tx=0x7f0844014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3aefb765b69f64 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f083b7fe700 1 -- 172.21.15.35:0/4178047138 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844027330 con 0x562a26721960 2023-03-17T10:13:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f083b7fe700 1 -- 172.21.15.35:0/4178047138 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0844027490 con 0x562a26721960 2023-03-17T10:13:42.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f083b7fe700 1 -- 172.21.15.35:0/4178047138 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844003a20 con 0x562a26721960 2023-03-17T10:13:42.089 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:26 smithi035 ceph-mon[92535]: pgmap v2522: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08631e8b80 1 -- 172.21.15.35:0/4178047138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 msgr2=0x562a2671bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08631e8b80 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a2671bac0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0844009810 tx=0x7f0844014000 comp rx=0 tx=0).stop 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08631e8b80 1 -- 172.21.15.35:0/4178047138 shutdown_connections 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08631e8b80 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a267274f0 0x562a26720a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08631e8b80 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26721960 0x562a2671bac0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.498+0000 7f08631e8b80 1 --2- 172.21.15.35:0/4178047138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a26726be0 0x562a267361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- 172.21.15.35:0/4178047138 >> 172.21.15.35:0/4178047138 conn(0x562a2657e6b0 msgr2=0x562a2673b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:42.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- 172.21.15.35:0/4178047138 shutdown_connections 2023-03-17T10:13:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- 172.21.15.35:0/4178047138 wait complete. 2023-03-17T10:13:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- start start 2023-03-17T10:13:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 Processor -- start 2023-03-17T10:13:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a26735fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a26734310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:43.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26734850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a26734d90 con 0x562a26726be0 2023-03-17T10:13:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a26734ed0 con 0x562a267274f0 2023-03-17T10:13:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a26735090 con 0x562a26721960 2023-03-17T10:13:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.499+0000 7f08631e8b80 10 client.0 _ll_register_callbacks cb 0x562a26519230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:13:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a26734310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:44.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a26734310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49232/0 (socket says 172.21.15.35:49232) 2023-03-17T10:13:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 -- 172.21.15.35:0/2964661949 learned_addr learned my addr 172.21.15.35:0/2964661949 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:45.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f08555f8700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26734850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f0854df7700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a26735fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 -- 172.21.15.35:0/2964661949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 msgr2=0x562a26735fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a26735fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 -- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 msgr2=0x562a26734850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26734850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 -- 172.21.15.35:0/2964661949 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a264c81f0 con 0x562a26726be0 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f0854df7700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a26735fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:13:45.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f084ffff700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a26734310 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x562a2672bce0 tx=0x7f083c00f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d29a128db824912 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f082ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f082ffff700 1 -- 172.21.15.35:0/2964661949 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c016070 con 0x562a26726be0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f082ffff700 1 -- 172.21.15.35:0/2964661949 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f083c000e40 con 0x562a26726be0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a266f11e0 con 0x562a26726be0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f082ffff700 1 -- 172.21.15.35:0/2964661949 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083c0092d0 con 0x562a26726be0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f08631e8b80 10 client.18312 fetch_fsmap learned FSMap version 37 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.500+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562a2648ac00 con 0x562a26726be0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f082ffff700 1 -- 172.21.15.35:0/2964661949 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a266f11e0 con 0x562a26726be0 2023-03-17T10:13:45.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f082ffff700 1 -- 172.21.15.35:0/2964661949 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f083c035430 con 0x562a26726be0 2023-03-17T10:13:45.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f08631e8b80 10 client.18312 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:13:45.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f08631e8b80 10 client.18312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f08631e8b80 20 client.18312 populate_metadata read hostname 'smithi035' 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a267946d0 0x562a26796ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f08631e8b80 4 client.18312 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a264f7f00 con 0x562a267946d0 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f0854df7700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a267946d0 0x562a26796ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f0854df7700 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a267946d0 0x562a26796ae0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e642eb58cdf10a0 server_cookie=cf1d838a78db4a79 in_seq=0 out_seq=0 2023-03-17T10:13:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.501+0000 7f082ffff700 10 client.18312 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f082ffff700 1 -- 172.21.15.35:0/2964661949 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a264f7f00 con 0x562a267946d0 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f082ffff700 10 client.18312 handle_command_reply: tid=0 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 client.18312 shutdown 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 msgr2=0x562a26734310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a26734310 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x562a2672bce0 tx=0x7f083c00f7b0 comp rx=0 tx=0).stop 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 shutdown_connections 2023-03-17T10:13:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a267946d0 0x562a26796ae0 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a267274f0 0x562a26734850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a26721960 0x562a26735fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 --2- 172.21.15.35:0/2964661949 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a26726be0 0x562a26734310 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 >> 172.21.15.35:0/2964661949 conn(0x562a2657e6b0 msgr2=0x562a26720a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f082ffff700 0 client.18312 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 shutdown_connections 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.506+0000 7f08631e8b80 1 -- 172.21.15.35:0/2964661949 wait complete. 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f08631e8b80 20 client.18312 trim_cache size 0 max 16384 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f084009f640 msgr2=0x7f08400a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f084009f640 0x7f08400a1af0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0844009cb0 tx=0x7f0844009260 comp rx=0 tx=0).stop 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 msgr2=0x7f085019ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085019ad40 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0848009fd0 tx=0x7f084800cce0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 shutdown_connections 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f084009f640 0x7f08400a1af0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f08501054b0 0x7f085019ad40 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0850100470 0x7f08501963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 --2- 172.21.15.35:0/1707377653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0850100e10 0x7f08501968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 >> 172.21.15.35:0/1707377653 conn(0x7f08500fbce0 msgr2=0x7f08500fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 shutdown_connections 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:50:54.507+0000 7f085705b700 1 -- 172.21.15.35:0/1707377653 wait complete. 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 -- 172.21.15.35:0/3433243765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 msgr2=0x7f279410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 --2- 172.21.15.35:0/3433243765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f279410d090 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f278c00b0d0 tx=0x7f278c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 -- 172.21.15.35:0/3433243765 shutdown_connections 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 --2- 172.21.15.35:0/3433243765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f279410d090 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 --2- 172.21.15.35:0/3433243765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27940fe970 0x7f27940fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 --2- 172.21.15.35:0/3433243765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940ff310 0x7f2794104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.628+0000 7f279946b700 1 -- 172.21.15.35:0/3433243765 >> 172.21.15.35:0/3433243765 conn(0x7f27940757a0 msgr2=0x7f2794075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 -- 172.21.15.35:0/3433243765 shutdown_connections 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 -- 172.21.15.35:0/3433243765 wait complete. 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 Processor -- start 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 -- start start 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940fe970 0x7f27940ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27940ff310 0x7f27940ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f27941a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2794100650 con 0x7f2794105510 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27941a49d0 con 0x7f27940fe970 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.629+0000 7f279946b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27941a4b10 con 0x7f27940ff310 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f27941a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f27941a4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49246/0 (socket says 172.21.15.35:49246) 2023-03-17T10:13:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 -- 172.21.15.35:0/3684444788 learned_addr learned my addr 172.21.15.35:0/3684444788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940fe970 0x7f27940ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f278bfff700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27940ff310 0x7f27940ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 -- 172.21.15.35:0/3684444788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27940ff310 msgr2=0x7f27940ffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27940ff310 0x7f27940ffe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 -- 172.21.15.35:0/3684444788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940fe970 msgr2=0x7f27940ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940fe970 0x7f27940ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 -- 172.21.15.35:0/3684444788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009d00 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940fe970 0x7f27940ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f27937fe700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f27941a4490 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f278c009fd0 tx=0x7f278c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f2790ff9700 1 -- 172.21.15.35:0/3684444788 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00e040 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f2790ff9700 1 -- 172.21.15.35:0/3684444788 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f278c003e10 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2794110140 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f2790ff9700 1 -- 172.21.15.35:0/3684444788 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0052a0 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.630+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279410ffb0 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.632+0000 7f2790ff9700 1 -- 172.21.15.35:0/3684444788 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f278c01b450 con 0x7f2794105510 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.633+0000 7f2790ff9700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f278009f6c0 0x7f27800a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.633+0000 7f2790ff9700 1 -- 172.21.15.35:0/3684444788 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f278c0cb8e0 con 0x7f2794105510 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.633+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f278009f6c0 0x7f27800a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f278009f6c0 0x7f27800a1b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2784009be0 tx=0x7f2784009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 Processor -- start 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 -- start start 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 0x55e0d380dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3808420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d3808d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d370f010 con 0x55e0d380dbe0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d3761950 con 0x55e0d380e4f0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d375ade0 con 0x55e0d3808960 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 0x55e0d380dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 0x55e0d380dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49250/0 (socket says 172.21.15.35:49250) 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f2792ffd700 1 -- 172.21.15.35:0/4114517263 learned_addr learned my addr 172.21.15.35:0/4114517263 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.634+0000 7f278bfff700 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3808420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f27937fe700 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d3808d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f2792ffd700 1 -- 172.21.15.35:0/4114517263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 msgr2=0x55e0d3808d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f2792ffd700 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d3808d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f2792ffd700 1 -- 172.21.15.35:0/4114517263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 msgr2=0x55e0d3808420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f2792ffd700 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3808420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f2792ffd700 1 -- 172.21.15.35:0/4114517263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d35dc5d0 con 0x55e0d380dbe0 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f278bfff700 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3808420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f2792ffd700 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 0x55e0d380dfb0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2784010d00 tx=0x7f2784013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40e1a72039f64f5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f27897fa700 1 -- 172.21.15.35:0/4114517263 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784012ab0 con 0x55e0d380dbe0 2023-03-17T10:13:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f27897fa700 1 -- 172.21.15.35:0/4114517263 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2784012c10 con 0x55e0d380dbe0 2023-03-17T10:13:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.635+0000 7f27897fa700 1 -- 172.21.15.35:0/4114517263 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278401e5b0 con 0x55e0d380dbe0 2023-03-17T10:13:48.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 -- 172.21.15.35:0/4114517263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 msgr2=0x55e0d380dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 0x55e0d380dfb0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2784010d00 tx=0x7f2784013000 comp rx=0 tx=0).stop 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 -- 172.21.15.35:0/4114517263 shutdown_connections 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d3808d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380dbe0 0x55e0d380dfb0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/4114517263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3808420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 -- 172.21.15.35:0/4114517263 >> 172.21.15.35:0/4114517263 conn(0x55e0d36656b0 msgr2=0x55e0d3802a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 -- 172.21.15.35:0/4114517263 shutdown_connections 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.636+0000 7f27a55f8b80 1 -- 172.21.15.35:0/4114517263 wait complete. 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 -- start start 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 Processor -- start 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d38144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380dbe0 0x55e0d38116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 0x55e0d3811e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d35de8c0 con 0x55e0d380e4f0 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d3812560 con 0x55e0d380dbe0 2023-03-17T10:13:48.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d381e030 con 0x55e0d3808960 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27a55f8b80 10 client.0 _ll_register_callbacks cb 0x55e0d3600230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27937fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 0x55e0d3811e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f278bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380dbe0 0x55e0d38116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27937fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 0x55e0d3811e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49260/0 (socket says 172.21.15.35:49260) 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f27937fe700 1 -- 172.21.15.35:0/2314738758 learned_addr learned my addr 172.21.15.35:0/2314738758 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.637+0000 7f2792ffd700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d38144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27937fe700 1 -- 172.21.15.35:0/2314738758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 msgr2=0x55e0d38144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:49.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:28 smithi035 ceph-mon[92535]: pgmap v2523: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 91 B/s wr, 13 op/s 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27937fe700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d38144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27937fe700 1 -- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380dbe0 msgr2=0x55e0d38116e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27937fe700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380dbe0 0x55e0d38116e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27937fe700 1 -- 172.21.15.35:0/2314738758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27840109b0 con 0x55e0d380e4f0 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f278bfff700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380dbe0 0x55e0d38116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f2792ffd700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d38144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27937fe700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 0x55e0d3811e20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f278c099350 tx=0x7f278c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb41b865425f11b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f277a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:13:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f277a7fc700 1 -- 172.21.15.35:0/2314738758 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c01b900 con 0x55e0d380e4f0 2023-03-17T10:13:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f277a7fc700 1 -- 172.21.15.35:0/2314738758 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f278c01a3b0 con 0x55e0d380e4f0 2023-03-17T10:13:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d371d390 con 0x55e0d380e4f0 2023-03-17T10:13:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f277a7fc700 1 -- 172.21.15.35:0/2314738758 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f278c0993c0 con 0x55e0d380e4f0 2023-03-17T10:13:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27a55f8b80 10 client.18324 fetch_fsmap learned FSMap version 37 2023-03-17T10:13:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.638+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e0d3588d80 con 0x55e0d380e4f0 2023-03-17T10:13:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f277a7fc700 1 -- 172.21.15.35:0/2314738758 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f278c0b5080 con 0x55e0d380e4f0 2023-03-17T10:13:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f277a7fc700 1 -- 172.21.15.35:0/2314738758 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f278c0acbd0 con 0x55e0d380e4f0 2023-03-17T10:13:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f27a55f8b80 10 client.18324 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:13:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f27a55f8b80 10 client.18324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:13:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f27a55f8b80 20 client.18324 populate_metadata read hostname 'smithi035' 2023-03-17T10:13:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3821ee0 0x55e0d38242f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f27a55f8b80 4 client.18324 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:13:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0d3729600 con 0x55e0d3821ee0 2023-03-17T10:13:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.639+0000 7f2792ffd700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3821ee0 0x55e0d38242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f277a7fc700 10 client.18324 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f2792ffd700 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3821ee0 0x55e0d38242f0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21d55ce6f6377421 server_cookie=d8037ec83b0095 in_seq=0 out_seq=0 2023-03-17T10:13:51.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f277a7fc700 1 -- 172.21.15.35:0/2314738758 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e0d3729600 con 0x55e0d3821ee0 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f277a7fc700 10 client.18324 handle_command_reply: tid=0 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f27a55f8b80 1 client.18324 shutdown 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 msgr2=0x55e0d3811e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 0x55e0d3811e20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f278c099350 tx=0x7f278c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 shutdown_connections 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.640+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3821ee0 0x55e0d38242f0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d380e4f0 0x55e0d3811e20 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f277a7fc700 0 client.18324 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d3808960 0x55e0d38144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/2314738758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380dbe0 0x55e0d38116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 >> 172.21.15.35:0/2314738758 conn(0x55e0d36656b0 msgr2=0x55e0d3807410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 shutdown_connections 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 1 -- 172.21.15.35:0/2314738758 wait complete. 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.641+0000 7f27a55f8b80 20 client.18324 trim_cache size 0 max 16384 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.656+0000 7f27a55f8b80 1 Processor -- start 2023-03-17T10:13:51.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.656+0000 7f27a55f8b80 1 -- start start 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3802ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3818f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3814000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d37ffba0 con 0x55e0d3808960 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d3804620 con 0x55e0d380e4f0 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d3824950 con 0x55e0d380dbe0 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3802ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3802ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49264/0 (socket says 172.21.15.35:49264) 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 -- 172.21.15.35:0/3177991959 learned_addr learned my addr 172.21.15.35:0/3177991959 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27937fe700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3814000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f278bfff700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3818f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 -- 172.21.15.35:0/3177991959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 msgr2=0x55e0d3818f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3818f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 -- 172.21.15.35:0/3177991959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 msgr2=0x55e0d3814000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3814000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f2792ffd700 1 -- 172.21.15.35:0/3177991959 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d3721130 con 0x55e0d3808960 2023-03-17T10:13:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f278bfff700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3818f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:13:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.657+0000 7f27937fe700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3814000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:13:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.658+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3802ac0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2784010d00 tx=0x7f278401fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a334022ecab982 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.658+0000 7f2789ffb700 1 -- 172.21.15.35:0/3177991959 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278403a030 con 0x55e0d3808960 2023-03-17T10:13:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.658+0000 7f2789ffb700 1 -- 172.21.15.35:0/3177991959 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2784030040 con 0x55e0d3808960 2023-03-17T10:13:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.658+0000 7f2789ffb700 1 -- 172.21.15.35:0/3177991959 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278401f760 con 0x55e0d3808960 2023-03-17T10:13:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3177991959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 msgr2=0x55e0d3802ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:13:53.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3802ac0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2784010d00 tx=0x7f278401fb80 comp rx=0 tx=0).stop 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3177991959 shutdown_connections 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d3814000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3802ac0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3177991959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3818f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3177991959 >> 172.21.15.35:0/3177991959 conn(0x55e0d36656b0 msgr2=0x55e0d3807a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3177991959 shutdown_connections 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3177991959 wait complete. 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 -- start start 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.659+0000 7f27a55f8b80 1 Processor -- start 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3817150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3817690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:53.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d386ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:13:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d386f2c0 con 0x55e0d3808960 2023-03-17T10:13:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d386f430 con 0x55e0d380e4f0 2023-03-17T10:13:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d386f5f0 con 0x55e0d380dbe0 2023-03-17T10:13:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27a55f8b80 10 client.0 _ll_register_callbacks cb 0x55e0d3600230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:13:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3817150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3817150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49270/0 (socket says 172.21.15.35:49270) 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 -- 172.21.15.35:0/3917402251 learned_addr learned my addr 172.21.15.35:0/3917402251 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f278bfff700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3817690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f27937fe700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d386ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 -- 172.21.15.35:0/3917402251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 msgr2=0x55e0d3817690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3817690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 -- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 msgr2=0x55e0d386ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:13:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d386ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:13:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 -- 172.21.15.35:0/3917402251 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0d35dc5d0 con 0x55e0d3808960 2023-03-17T10:13:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f2792ffd700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3817150 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2784035510 tx=0x7f2784035540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be52f563f78feb52 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:13:59.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.660+0000 7f277a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:14:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f277a7fc700 1 -- 172.21.15.35:0/3917402251 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278403a040 con 0x55e0d3808960 2023-03-17T10:14:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f277a7fc700 1 -- 172.21.15.35:0/3917402251 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(206..206 src has 1..206) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f278403b070 con 0x55e0d3808960 2023-03-17T10:14:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d37d81e0 con 0x55e0d3808960 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f277a7fc700 1 -- 172.21.15.35:0/3917402251 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2784035de0 con 0x55e0d3808960 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 10 client.18330 fetch_fsmap learned FSMap version 37 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55e0d35af1f0 con 0x55e0d3808960 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f277a7fc700 1 -- 172.21.15.35:0/3917402251 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e0d37d81e0 con 0x55e0d3808960 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f277a7fc700 1 -- 172.21.15.35:0/3917402251 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2784012830 con 0x55e0d3808960 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 10 client.18330 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 10 client.18330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 20 client.18330 populate_metadata read hostname 'smithi035' 2023-03-17T10:14:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3876840 0x55e0d3878c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 4 client.18330 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0d35def00 con 0x55e0d3876840 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.661+0000 7f278bfff700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3876840 0x55e0d3878c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.662+0000 7f277a7fc700 10 client.18330 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.662+0000 7f278bfff700 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3876840 0x55e0d3878c20 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32395407da931921 server_cookie=79e0833b1e0f26f6 in_seq=0 out_seq=0 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f277a7fc700 1 -- 172.21.15.35:0/3917402251 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0d35def00 con 0x55e0d3876840 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f277a7fc700 10 client.18330 handle_command_reply: tid=0 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 client.18330 shutdown 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 msgr2=0x55e0d3817150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3817150 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2784035510 tx=0x7f2784035540 comp rx=0 tx=0).stop 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 shutdown_connections 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e0d3876840 0x55e0d3878c20 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e0d380e4f0 0x55e0d386ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e0d3808960 0x55e0d3817150 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f277a7fc700 0 client.18330 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 --2- 172.21.15.35:0/3917402251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e0d380dbe0 0x55e0d3817690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 >> 172.21.15.35:0/3917402251 conn(0x55e0d36656b0 msgr2=0x55e0d380b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 shutdown_connections 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 1 -- 172.21.15.35:0/3917402251 wait complete. 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.670+0000 7f27a55f8b80 20 client.18330 trim_cache size 0 max 16384 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f278009f6c0 msgr2=0x7f27800a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f278009f6c0 0x7f27800a1b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2784009be0 tx=0x7f2784009260 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 msgr2=0x7f27941a4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f27941a4490 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f278c009fd0 tx=0x7f278c00cd90 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 shutdown_connections 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f278009f6c0 0x7f27800a1b70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2794105510 0x7f27941a4490 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27940fe970 0x7f27940ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 --2- 172.21.15.35:0/3684444788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27940ff310 0x7f27940ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 >> 172.21.15.35:0/3684444788 conn(0x7f27940757a0 msgr2=0x7f27940fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 shutdown_connections 2023-03-17T10:14:04.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:07.671+0000 7f279946b700 1 -- 172.21.15.35:0/3684444788 wait complete. 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 -- 172.21.15.35:0/2083527142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 msgr2=0x7f1f5410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 --2- 172.21.15.35:0/2083527142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5410bf60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00b0d0 tx=0x7f1f4c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 -- 172.21.15.35:0/2083527142 shutdown_connections 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 --2- 172.21.15.35:0/2083527142 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5410bf60 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 --2- 172.21.15.35:0/2083527142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 0x7f1f540ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 --2- 172.21.15.35:0/2083527142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f540ffcf0 0x7f1f54103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.792+0000 7f1f5a126700 1 -- 172.21.15.35:0/2083527142 >> 172.21.15.35:0/2083527142 conn(0x7f1f54076330 msgr2=0x7f1f54076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.793+0000 7f1f5a126700 1 -- 172.21.15.35:0/2083527142 shutdown_connections 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.793+0000 7f1f5a126700 1 -- 172.21.15.35:0/2083527142 wait complete. 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.793+0000 7f1f5a126700 1 Processor -- start 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.793+0000 7f1f5a126700 1 -- start start 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 0x7f1f54196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f540ffcf0 0x7f1f541968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5419b340 con 0x7f1f54104390 2023-03-17T10:14:04.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5419b4b0 con 0x7f1f540ffcf0 2023-03-17T10:14:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5419b670 con 0x7f1f540ff350 2023-03-17T10:14:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5419ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49294/0 (socket says 172.21.15.35:49294) 2023-03-17T10:14:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 -- 172.21.15.35:0/4127025718 learned_addr learned my addr 172.21.15.35:0/4127025718 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:04.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f537fe700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 0x7f1f54196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f540ffcf0 0x7f1f541968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 -- 172.21.15.35:0/4127025718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 msgr2=0x7f1f54196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 0x7f1f54196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 -- 172.21.15.35:0/4127025718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f540ffcf0 msgr2=0x7f1f541968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f540ffcf0 0x7f1f541968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 -- 172.21.15.35:0/4127025718 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009d00 con 0x7f1f54104390 2023-03-17T10:14:06.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:30 smithi035 ceph-mon[92535]: pgmap v2524: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:06.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f537fe700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 0x7f1f54196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:14:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f53fff700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5419ad00 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c008ec0 tx=0x7f1f4c008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f50ff9700 1 -- 172.21.15.35:0/4127025718 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00e040 con 0x7f1f54104390 2023-03-17T10:14:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f50ff9700 1 -- 172.21.15.35:0/4127025718 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f4c00be30 con 0x7f1f54104390 2023-03-17T10:14:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5410efe0 con 0x7f1f54104390 2023-03-17T10:14:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f50ff9700 1 -- 172.21.15.35:0/4127025718 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c01b6c0 con 0x7f1f54104390 2023-03-17T10:14:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.794+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5410ee50 con 0x7f1f54104390 2023-03-17T10:14:09.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.797+0000 7f1f50ff9700 1 -- 172.21.15.35:0/4127025718 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1f4c024410 con 0x7f1f54104390 2023-03-17T10:14:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.797+0000 7f1f50ff9700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1f4009f6c0 0x7f1f400a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.797+0000 7f1f50ff9700 1 -- 172.21.15.35:0/4127025718 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1f4c0cb7f0 con 0x7f1f54104390 2023-03-17T10:14:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.797+0000 7f1f537fe700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1f4009f6c0 0x7f1f400a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f537fe700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1f4009f6c0 0x7f1f400a1b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400bcf0 tx=0x7f1f4400b2c0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 Processor -- start 2023-03-17T10:14:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 -- start start 2023-03-17T10:14:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce7e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce71420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce71e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cd78010 con 0x55ba0ce7ebf0 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cdca950 con 0x55ba0ce7e2e0 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cdc3de0 con 0x55ba0ce719b0 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.798+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce71420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce71420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49300/0 (socket says 172.21.15.35:49300) 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2852284369 learned_addr learned my addr 172.21.15.35:0/2852284369 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f537fe700 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce7e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f53fff700 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce71e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2852284369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 msgr2=0x55ba0ce71e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce71e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2852284369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7e2e0 msgr2=0x55ba0ce7e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce7e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2852284369 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba0cc455d0 con 0x55ba0ce7ebf0 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce71420 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009c30 tx=0x7f1f3c009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4880d366616be019 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f49ffb700 1 -- 172.21.15.35:0/2852284369 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c011d10 con 0x55ba0ce7ebf0 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f49ffb700 1 -- 172.21.15.35:0/2852284369 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f3c011e70 con 0x55ba0ce7ebf0 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.799+0000 7f1f49ffb700 1 -- 172.21.15.35:0/2852284369 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c005280 con 0x55ba0ce7ebf0 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2852284369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 msgr2=0x55ba0ce71420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce71420 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009c30 tx=0x7f1f3c009f40 comp rx=0 tx=0).stop 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2852284369 shutdown_connections 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce71e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce7e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2852284369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce71420 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2852284369 >> 172.21.15.35:0/2852284369 conn(0x55ba0ccce6b0 msgr2=0x55ba0ce6ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2852284369 shutdown_connections 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2852284369 wait complete. 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.800+0000 7f1f662b3b80 1 -- start start 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 Processor -- start 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce82f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce83680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cc478c0 con 0x55ba0ce7e2e0 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0ce83df0 con 0x55ba0ce719b0 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0ce8f8a0 con 0x55ba0ce7ebf0 2023-03-17T10:14:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f662b3b80 10 client.0 _ll_register_callbacks cb 0x55ba0cc69230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:14:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce82f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce82f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49306/0 (socket says 172.21.15.35:49306) 2023-03-17T10:14:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 -- 172.21.15.35:0/207167998 learned_addr learned my addr 172.21.15.35:0/207167998 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f537fe700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f53fff700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce83680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 -- 172.21.15.35:0/207167998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7ebf0 msgr2=0x55ba0ce83680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce83680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 -- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 msgr2=0x55ba0ce85cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce85cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f52ffd700 1 -- 172.21.15.35:0/207167998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c0098e0 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.801+0000 7f1f537fe700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce82f40 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c014030 tx=0x7f1f3c005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5843e475c189cd3f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:14:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f32ffd700 1 -- 172.21.15.35:0/207167998 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c004850 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f32ffd700 1 -- 172.21.15.35:0/207167998 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(208..208 src has 1..208) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1f3c011d20 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba0cd86390 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f32ffd700 1 -- 172.21.15.35:0/207167998 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f3c004050 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 10 client.18342 fetch_fsmap learned FSMap version 37 2023-03-17T10:14:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ba0cbf1d80 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f32ffd700 1 -- 172.21.15.35:0/207167998 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba0cd86390 con 0x55ba0ce7e2e0 2023-03-17T10:14:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f32ffd700 1 -- 172.21.15.35:0/207167998 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1f3c003cc0 con 0x55ba0ce7e2e0 2023-03-17T10:14:21.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 10 client.18342 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:14:21.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 10 client.18342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:14:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 20 client.18342 populate_metadata read hostname 'smithi035' 2023-03-17T10:14:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0ce93810 0x55ba0ce95c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 4 client.18342 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:14:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.802+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba0cd92600 con 0x55ba0ce93810 2023-03-17T10:14:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.803+0000 7f1f537fe700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0ce93810 0x55ba0ce95c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.803+0000 7f1f32ffd700 10 client.18342 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.803+0000 7f1f537fe700 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0ce93810 0x55ba0ce95c20 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbe5d90d0e85c665 server_cookie=79a093ded417a077 in_seq=0 out_seq=0 2023-03-17T10:14:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f32ffd700 1 -- 172.21.15.35:0/207167998 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ba0cd92600 con 0x55ba0ce93810 2023-03-17T10:14:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f32ffd700 10 client.18342 handle_command_reply: tid=0 2023-03-17T10:14:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 client.18342 shutdown 2023-03-17T10:14:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 msgr2=0x55ba0ce82f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce82f40 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c014030 tx=0x7f1f3c005ce0 comp rx=0 tx=0).stop 2023-03-17T10:14:24.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 shutdown_connections 2023-03-17T10:14:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0ce93810 0x55ba0ce95c20 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce83680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f32ffd700 0 client.18342 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/207167998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce82f40 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 >> 172.21.15.35:0/207167998 conn(0x55ba0ccce6b0 msgr2=0x55ba0ce74790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 shutdown_connections 2023-03-17T10:14:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 1 -- 172.21.15.35:0/207167998 wait complete. 2023-03-17T10:14:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.804+0000 7f1f662b3b80 20 client.18342 trim_cache size 0 max 16384 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 Processor -- start 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 -- start start 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce6bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce85860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce6f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0ce86250 con 0x55ba0ce7e2e0 2023-03-17T10:14:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0ce6c000 con 0x55ba0ce7ebf0 2023-03-17T10:14:27.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.819+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0ce6c6b0 con 0x55ba0ce719b0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce85860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce85860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49314/0 (socket says 172.21.15.35:49314) 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2789185033 learned_addr learned my addr 172.21.15.35:0/2789185033 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f537fe700 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce6bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f53fff700 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce6f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2789185033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 msgr2=0x55ba0ce6bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce6bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2789185033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7ebf0 msgr2=0x55ba0ce6f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce6f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 -- 172.21.15.35:0/2789185033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba0cd8a130 con 0x55ba0ce7e2e0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f537fe700 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce6bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce85860 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009c30 tx=0x7f1f3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bc41c20a13ab29 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f4a7fc700 1 -- 172.21.15.35:0/2789185033 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c039070 con 0x55ba0ce7e2e0 2023-03-17T10:14:27.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f4a7fc700 1 -- 172.21.15.35:0/2789185033 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f3c013260 con 0x55ba0ce7e2e0 2023-03-17T10:14:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.820+0000 7f1f4a7fc700 1 -- 172.21.15.35:0/2789185033 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0134c0 con 0x55ba0ce7e2e0 2023-03-17T10:14:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2789185033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 msgr2=0x55ba0ce85860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce85860 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009c30 tx=0x7f1f3c009780 comp rx=0 tx=0).stop 2023-03-17T10:14:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2789185033 shutdown_connections 2023-03-17T10:14:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce6f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce719b0 0x55ba0ce6bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:28.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2789185033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce85860 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2789185033 >> 172.21.15.35:0/2789185033 conn(0x55ba0ccce6b0 msgr2=0x55ba0ce8ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2789185033 shutdown_connections 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2789185033 wait complete. 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- start start 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 Processor -- start 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce887d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce88d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce89250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:28.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cee67c0 con 0x55ba0ce7ebf0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cee6930 con 0x55ba0ce719b0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.821+0000 7f1f662b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba0cee6af0 con 0x55ba0ce7e2e0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f662b3b80 10 client.0 _ll_register_callbacks cb 0x55ba0cc69230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce89250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce89250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49322/0 (socket says 172.21.15.35:49322) 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 -- 172.21.15.35:0/2598177852 learned_addr learned my addr 172.21.15.35:0/2598177852 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f537fe700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce887d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce88d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:28.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 -- 172.21.15.35:0/2598177852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7e2e0 msgr2=0x55ba0ce88d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce88d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 -- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 msgr2=0x55ba0ce887d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce887d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 -- 172.21.15.35:0/2598177852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba0cbf1d80 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f52ffd700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce88d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:14:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f53fff700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce89250 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c099030 tx=0x7f1f4c099100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1247ce6a0797525 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f32ffd700 1 -- 172.21.15.35:0/2598177852 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0b0070 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f32ffd700 1 -- 172.21.15.35:0/2598177852 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(208..208 src has 1..208) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1f4c099330 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba0ce411e0 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f32ffd700 1 -- 172.21.15.35:0/2598177852 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f4c09d160 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f662b3b80 10 client.18348 fetch_fsmap learned FSMap version 37 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.822+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55ba0cc181f0 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f32ffd700 1 -- 172.21.15.35:0/2598177852 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba0ce411e0 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f32ffd700 1 -- 172.21.15.35:0/2598177852 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1f4c098820 con 0x55ba0ce7ebf0 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:32 smithi035 ceph-mon[92535]: pgmap v2525: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:34 smithi035 ceph-mon[92535]: pgmap v2526: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:36 smithi035 ceph-mon[92535]: pgmap v2527: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:38 smithi035 ceph-mon[92535]: pgmap v2528: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:40 smithi035 ceph-mon[92535]: pgmap v2529: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:42 smithi035 ceph-mon[92535]: pgmap v2530: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:44 smithi035 ceph-mon[92535]: pgmap v2531: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:46 smithi035 ceph-mon[92535]: pgmap v2532: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:48 smithi035 ceph-mon[92535]: pgmap v2533: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:29.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:50 smithi035 ceph-mon[92535]: pgmap v2534: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:52 smithi035 ceph-mon[92535]: pgmap v2535: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:29.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:54 smithi035 ceph-mon[92535]: pgmap v2536: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:29.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:56 smithi035 ceph-mon[92535]: pgmap v2537: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:30.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:03:58 smithi035 ceph-mon[92535]: pgmap v2538: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:14:30.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:00 smithi035 ceph-mon[92535]: pgmap v2539: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:14:30.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:02 smithi035 ceph-mon[92535]: pgmap v2540: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:14:30.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:04 smithi035 ceph-mon[92535]: pgmap v2541: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T10:14:30.754 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:06 smithi035 ceph-mon[92535]: pgmap v2542: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T10:14:31.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:08 smithi035 ceph-mon[92535]: pgmap v2543: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T10:14:31.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:09 smithi035 ceph-mon[92535]: osdmap e237: 12 total, 12 up, 12 in 2023-03-17T10:14:31.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:10 smithi035 ceph-mon[92535]: pgmap v2545: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T10:14:31.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:12 smithi035 ceph-mon[92535]: pgmap v2546: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T10:14:31.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:14:31.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:14:31.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:14:31.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:14:31.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:13 smithi035 ceph-mon[92535]: pgmap v2547: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T10:14:31.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:13 smithi035 ceph-mon[92535]: pgmap v2548: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.2 KiB/s wr, 15 op/s 2023-03-17T10:14:31.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:15 smithi035 ceph-mon[92535]: pgmap v2549: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-03-17T10:14:31.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:17 smithi035 ceph-mon[92535]: pgmap v2550: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T10:14:31.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:17 smithi035 ceph-mon[92535]: osdmap e238: 12 total, 12 up, 12 in 2023-03-17T10:14:31.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:19 smithi035 ceph-mon[92535]: pgmap v2552: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 150 B/s wr, 15 op/s 2023-03-17T10:14:32.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:21 smithi035 ceph-mon[92535]: pgmap v2553: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T10:14:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:23 smithi035 ceph-mon[92535]: pgmap v2554: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:14:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:25 smithi035 ceph-mon[92535]: pgmap v2555: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:14:35.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:27 smithi035 ceph-mon[92535]: pgmap v2556: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:14:35.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:29 smithi035 ceph-mon[92535]: pgmap v2557: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T10:14:35.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:31 smithi035 ceph-mon[92535]: pgmap v2558: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T10:14:35.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:33 smithi035 ceph-mon[92535]: pgmap v2559: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T10:14:35.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:35 smithi035 ceph-mon[92535]: pgmap v2560: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:35.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:37 smithi035 ceph-mon[92535]: pgmap v2561: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:39 smithi035 ceph-mon[92535]: pgmap v2562: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:14:37.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:41 smithi035 ceph-mon[92535]: pgmap v2563: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:14:37.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:43 smithi035 ceph-mon[92535]: pgmap v2564: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:14:37.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:45 smithi035 ceph-mon[92535]: pgmap v2565: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:14:37.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:47 smithi035 ceph-mon[92535]: pgmap v2566: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:49 smithi035 ceph-mon[92535]: pgmap v2567: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:51 smithi035 ceph-mon[92535]: pgmap v2568: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:53 smithi035 ceph-mon[92535]: pgmap v2569: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:55 smithi035 ceph-mon[92535]: pgmap v2570: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:57 smithi035 ceph-mon[92535]: pgmap v2571: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:04:59 smithi035 ceph-mon[92535]: pgmap v2572: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:01 smithi035 ceph-mon[92535]: pgmap v2573: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:03 smithi035 ceph-mon[92535]: pgmap v2574: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:05 smithi035 ceph-mon[92535]: pgmap v2575: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:07 smithi035 ceph-mon[92535]: pgmap v2576: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:09 smithi035 ceph-mon[92535]: pgmap v2577: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:11 smithi035 ceph-mon[92535]: pgmap v2578: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: pgmap v2579: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:14:37.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: pgmap v2580: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 189 B/s wr, 9 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: pgmap v2581: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:16 smithi035 ceph-mon[92535]: pgmap v2582: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:17 smithi035 ceph-mon[92535]: pgmap v2583: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 10 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:20 smithi035 ceph-mon[92535]: pgmap v2584: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:22 smithi035 ceph-mon[92535]: pgmap v2585: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:24 smithi035 ceph-mon[92535]: pgmap v2586: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:26 smithi035 ceph-mon[92535]: pgmap v2587: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:27 smithi035 ceph-mon[92535]: pgmap v2588: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:14:37.167 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:30 smithi035 ceph-mon[92535]: pgmap v2589: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:14:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:14:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:14:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:14:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:14:37.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f662b3b80 10 client.18348 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:14:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f662b3b80 10 client.18348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:14:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f662b3b80 20 client.18348 populate_metadata read hostname 'smithi035' 2023-03-17T10:14:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0cee7fe0 0x55ba0ceea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f662b3b80 4 client.18348 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:14:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ba0cc47f00 con 0x55ba0cee7fe0 2023-03-17T10:14:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f537fe700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0cee7fe0 0x55ba0ceea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f32ffd700 10 client.18348 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.823+0000 7f1f537fe700 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0cee7fe0 0x55ba0ceea3c0 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7a3878b83a4fe81 server_cookie=de9252d9b6b4f5cf in_seq=0 out_seq=0 2023-03-17T10:14:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f32ffd700 1 -- 172.21.15.35:0/2598177852 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ba0cc47f00 con 0x55ba0cee7fe0 2023-03-17T10:14:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f32ffd700 10 client.18348 handle_command_reply: tid=0 2023-03-17T10:14:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 client.18348 shutdown 2023-03-17T10:14:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 msgr2=0x55ba0ce89250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce89250 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c099030 tx=0x7f1f4c099100 comp rx=0 tx=0).stop 2023-03-17T10:14:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 shutdown_connections 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba0cee7fe0 0x55ba0ceea3c0 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba0ce7ebf0 0x55ba0ce89250 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0ce719b0 0x55ba0ce887d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f32ffd700 0 client.18348 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 --2- 172.21.15.35:0/2598177852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba0ce7e2e0 0x55ba0ce88d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.831+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 >> 172.21.15.35:0/2598177852 conn(0x55ba0ccce6b0 msgr2=0x55ba0ce6f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 shutdown_connections 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f662b3b80 1 -- 172.21.15.35:0/2598177852 wait complete. 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f662b3b80 20 client.18348 trim_cache size 0 max 16384 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1f4009f6c0 msgr2=0x7f1f400a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1f4009f6c0 0x7f1f400a1b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400bcf0 tx=0x7f1f4400b2c0 comp rx=0 tx=0).stop 2023-03-17T10:14:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 msgr2=0x7f1f5419ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5419ad00 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c008ec0 tx=0x7f1f4c008ef0 comp rx=0 tx=0).stop 2023-03-17T10:14:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 shutdown_connections 2023-03-17T10:14:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1f4009f6c0 0x7f1f400a1b70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1f54104390 0x7f1f5419ad00 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f540ff350 0x7f1f54196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 --2- 172.21.15.35:0/4127025718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f540ffcf0 0x7f1f541968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 >> 172.21.15.35:0/4127025718 conn(0x7f1f54076330 msgr2=0x7f1f54068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 shutdown_connections 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:20.832+0000 7f1f5a126700 1 -- 172.21.15.35:0/4127025718 wait complete. 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.955+0000 7fb9e4562700 1 -- 172.21.15.35:0/758613627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc104390 msgr2=0x7fb9dc10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.955+0000 7fb9e4562700 1 --2- 172.21.15.35:0/758613627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc104390 0x7fb9dc10bf60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b0d0 tx=0x7fb9d400b3e0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 -- 172.21.15.35:0/758613627 shutdown_connections 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 --2- 172.21.15.35:0/758613627 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc104390 0x7fb9dc10bf60 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 --2- 172.21.15.35:0/758613627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 --2- 172.21.15.35:0/758613627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc0ffcf0 0x7fb9dc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 -- 172.21.15.35:0/758613627 >> 172.21.15.35:0/758613627 conn(0x7fb9dc076330 msgr2=0x7fb9dc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 -- 172.21.15.35:0/758613627 shutdown_connections 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 -- 172.21.15.35:0/758613627 wait complete. 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 Processor -- start 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 -- start start 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.956+0000 7fb9e4562700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc0ffcf0 0x7fb9dc101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc104390 0x7fb9dc1a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc101ac0 con 0x7fb9dc0ff350 2023-03-17T10:14:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1a4a60 con 0x7fb9dc0ffcf0 2023-03-17T10:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1a4ba0 con 0x7fb9dc104390 2023-03-17T10:14:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49332/0 (socket says 172.21.15.35:49332) 2023-03-17T10:14:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2781576389 learned_addr learned my addr 172.21.15.35:0/2781576389 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc104390 0x7fb9dc1a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc0ffcf0 0x7fb9dc101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2781576389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc104390 msgr2=0x7fb9dc1a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc104390 0x7fb9dc1a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2781576389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc0ffcf0 msgr2=0x7fb9dc101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc0ffcf0 0x7fb9dc101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2781576389 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4009d00 con 0x7fb9dc0ff350 2023-03-17T10:14:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc100d50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9a0 tx=0x7fb9d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9d37fe700 1 -- 172.21.15.35:0/2781576389 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8009790 con 0x7fb9dc0ff350 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9d37fe700 1 -- 172.21.15.35:0/2781576389 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9d8010430 con 0x7fb9dc0ff350 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc10efc0 con 0x7fb9dc0ff350 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9d37fe700 1 -- 172.21.15.35:0/2781576389 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cea0 con 0x7fb9dc0ff350 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.957+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc10ee30 con 0x7fb9dc0ff350 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.960+0000 7fb9d37fe700 1 -- 172.21.15.35:0/2781576389 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb9d80105a0 con 0x7fb9dc0ff350 2023-03-17T10:14:48.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.961+0000 7fb9d37fe700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb9c809f6c0 0x7fb9c80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.961+0000 7fb9d37fe700 1 -- 172.21.15.35:0/2781576389 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb9d8014070 con 0x7fb9dc0ff350 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.961+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb9c809f6c0 0x7fb9c80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb9c809f6c0 0x7fb9c80a1b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc102540 tx=0x7fb9cc009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 Processor -- start 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 -- start start 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68044fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b6803f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b6803fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:48.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b67f46010 con 0x557b680454f0 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b67f98950 con 0x557b68044be0 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b67f91de0 con 0x557b6803f960 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9e1afd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b6803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9e1afd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b6803f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49342/0 (socket says 172.21.15.35:49342) 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9e1afd700 1 -- 172.21.15.35:0/2472699704 learned_addr learned my addr 172.21.15.35:0/2472699704 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68044fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.962+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b6803fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9e1afd700 1 -- 172.21.15.35:0/2472699704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 msgr2=0x557b6803fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b6803fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9e1afd700 1 -- 172.21.15.35:0/2472699704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 msgr2=0x557b68044fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68044fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9e1afd700 1 -- 172.21.15.35:0/2472699704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b67e135d0 con 0x557b680454f0 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b6803f420 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc011cd0 tx=0x7fb9cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e4986156110e9e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9d0ff9700 1 -- 172.21.15.35:0/2472699704 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc004030 con 0x557b680454f0 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9d0ff9700 1 -- 172.21.15.35:0/2472699704 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9cc00e840 con 0x557b680454f0 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.963+0000 7fb9d0ff9700 1 -- 172.21.15.35:0/2472699704 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0039d0 con 0x557b680454f0 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2472699704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 msgr2=0x557b6803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b6803f420 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc011cd0 tx=0x7fb9cc014000 comp rx=0 tx=0).stop 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2472699704 shutdown_connections 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b6803fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68044fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2472699704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b6803f420 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2472699704 >> 172.21.15.35:0/2472699704 conn(0x557b67e9c6b0 msgr2=0x557b68039a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2472699704 shutdown_connections 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2472699704 wait complete. 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 -- start start 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.964+0000 7fb9f06efb80 1 Processor -- start 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 0x557b6804b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68048700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b680454f0 0x557b68048d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b67e158c0 con 0x557b6803f960 2023-03-17T10:14:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b680494d0 con 0x557b680454f0 2023-03-17T10:14:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68055030 con 0x557b68044be0 2023-03-17T10:14:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 10 client.0 _ll_register_callbacks cb 0x557b67e37230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:14:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 0x557b6804b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 0x557b6804b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49346/0 (socket says 172.21.15.35:49346) 2023-03-17T10:14:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2621701183 learned_addr learned my addr 172.21.15.35:0/2621701183 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68048700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b680454f0 0x557b68048d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2621701183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 msgr2=0x557b68048700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68048700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b680454f0 msgr2=0x557b68048d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b680454f0 0x557b68048d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 -- 172.21.15.35:0/2621701183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc017070 con 0x557b6803f960 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b680454f0 0x557b68048d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 0x557b6804b480 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80c80c0 tx=0x7fb9d8097e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1355256b28c2e769 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/2621701183 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d809c160 con 0x557b6803f960 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/2621701183 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(208..208 src has 1..208) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb9d80a0570 con 0x557b6803f960 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b67f54390 con 0x557b6803f960 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/2621701183 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d80a00e0 con 0x557b6803f960 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 10 client.18360 fetch_fsmap learned FSMap version 37 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.965+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x557b67dbfd80 con 0x557b6803f960 2023-03-17T10:14:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/2621701183 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9d80b6030 con 0x557b6803f960 2023-03-17T10:14:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/2621701183 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb9d8094290 con 0x557b6803f960 2023-03-17T10:14:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9f06efb80 10 client.18360 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:14:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9f06efb80 10 client.18360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:14:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9f06efb80 20 client.18360 populate_metadata read hostname 'smithi035' 2023-03-17T10:14:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680618d0 0x557b68063cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9f06efb80 4 client.18360 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b67f60600 con 0x557b680618d0 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.966+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680618d0 0x557b68063cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680618d0 0x557b68063cf0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1c29b41d7cd2cf server_cookie=3f4c32ee4a1788ab in_seq=0 out_seq=0 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9c5ffb700 10 client.18360 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/2621701183 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557b67f60600 con 0x557b680618d0 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9c5ffb700 10 client.18360 handle_command_reply: tid=0 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9f06efb80 1 client.18360 shutdown 2023-03-17T10:14:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 msgr2=0x557b6804b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 0x557b6804b480 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80c80c0 tx=0x7fb9d8097e10 comp rx=0 tx=0).stop 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.967+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 shutdown_connections 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680618d0 0x557b68063cf0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b680454f0 0x557b68048d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9c5ffb700 0 client.18360 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b6803f960 0x557b6804b480 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/2621701183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68048700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 >> 172.21.15.35:0/2621701183 conn(0x557b67e9c6b0 msgr2=0x557b6803e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 shutdown_connections 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 1 -- 172.21.15.35:0/2621701183 wait complete. 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.968+0000 7fb9f06efb80 20 client.18360 trim_cache size 0 max 16384 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.982+0000 7fb9f06efb80 1 Processor -- start 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 -- start start 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b68042dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68039ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b68047f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b6803a040 con 0x557b680454f0 2023-03-17T10:14:52.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:32 smithi035 ceph-mon[92535]: pgmap v2590: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:14:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b6803f7f0 con 0x557b68044be0 2023-03-17T10:14:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b6803a720 con 0x557b6803f960 2023-03-17T10:14:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b68047f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b68047f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49358/0 (socket says 172.21.15.35:49358) 2023-03-17T10:14:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 -- 172.21.15.35:0/1745901637 learned_addr learned my addr 172.21.15.35:0/1745901637 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:14:55.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b68042dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68039ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 -- 172.21.15.35:0/1745901637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 msgr2=0x557b68042dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b68042dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 -- 172.21.15.35:0/1745901637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 msgr2=0x557b68039ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:14:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68039ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 -- 172.21.15.35:0/1745901637 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b67f58130 con 0x557b680454f0 2023-03-17T10:14:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b68047f20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4015000 tx=0x7fb9d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1690fff6b91d60f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.983+0000 7fb9d17fa700 1 -- 172.21.15.35:0/1745901637 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400e040 con 0x557b680454f0 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9d17fa700 1 -- 172.21.15.35:0/1745901637 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9d4007b90 con 0x557b680454f0 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9d17fa700 1 -- 172.21.15.35:0/1745901637 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4003c60 con 0x557b680454f0 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 -- 172.21.15.35:0/1745901637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 msgr2=0x557b68047f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b68047f20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4015000 tx=0x7fb9d400b040 comp rx=0 tx=0).stop 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 -- 172.21.15.35:0/1745901637 shutdown_connections 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b68047f20 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b6803f960 0x557b68042dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/1745901637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b68044be0 0x557b68039ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:14:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 -- 172.21.15.35:0/1745901637 >> 172.21.15.35:0/1745901637 conn(0x557b67e9c6b0 msgr2=0x557b680426b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 -- 172.21.15.35:0/1745901637 shutdown_connections 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 -- 172.21.15.35:0/1745901637 wait complete. 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 -- start start 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.984+0000 7fb9f06efb80 1 Processor -- start 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b6803f960 0x557b6805aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68058e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b680593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68059a80 con 0x557b680454f0 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b68059bf0 con 0x557b6803f960 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b680ad000 con 0x557b68044be0 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 10 client.0 _ll_register_callbacks cb 0x557b67e37230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b680593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b680593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49364/0 (socket says 172.21.15.35:49364) 2023-03-17T10:14:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 -- 172.21.15.35:0/361194595 learned_addr learned my addr 172.21.15.35:0/361194595 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b6803f960 0x557b6805aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68058e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 -- 172.21.15.35:0/361194595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 msgr2=0x557b68058e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68058e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 -- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b6803f960 msgr2=0x557b6805aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b6803f960 0x557b6805aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 -- 172.21.15.35:0/361194595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc10c7a0 con 0x557b680454f0 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e1afd700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68058e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:15:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b6803f960 0x557b6805aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:15:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9e2aff700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b680593b0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b770 tx=0x7fb9d4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212e663855b8d985 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:15:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/361194595 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400e040 con 0x557b680454f0 2023-03-17T10:15:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/361194595 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(208..208 src has 1..208) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb9d4003a00 con 0x557b680454f0 2023-03-17T10:15:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.985+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b6800f1e0 con 0x557b680454f0 2023-03-17T10:15:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/361194595 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d4003bc0 con 0x557b680454f0 2023-03-17T10:15:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 10 client.18366 fetch_fsmap learned FSMap version 37 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x557b67de61f0 con 0x557b680454f0 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/361194595 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557b6800f1e0 con 0x557b680454f0 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/361194595 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb9d400b100 con 0x557b680454f0 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 10 client.18366 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 10 client.18366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 20 client.18366 populate_metadata read hostname 'smithi035' 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680ae490 0x557b680b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 4 client.18366 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557b67e15f00 con 0x557b680ae490 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.986+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680ae490 0x557b680b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.987+0000 7fb9c5ffb700 10 client.18366 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.987+0000 7fb9e22fe700 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680ae490 0x557b680b08a0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c50c052a1d0592 server_cookie=c2d8919ba52001cd in_seq=0 out_seq=0 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9c5ffb700 1 -- 172.21.15.35:0/361194595 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557b67e15f00 con 0x557b680ae490 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9c5ffb700 10 client.18366 handle_command_reply: tid=0 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 client.18366 shutdown 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 msgr2=0x557b680593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b680593b0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b770 tx=0x7fb9d4007db0 comp rx=0 tx=0).stop 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 shutdown_connections 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557b680ae490 0x557b680b08a0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557b680454f0 0x557b680593b0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9c5ffb700 0 client.18366 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b6803f960 0x557b6805aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 --2- 172.21.15.35:0/361194595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557b68044be0 0x557b68058e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 >> 172.21.15.35:0/361194595 conn(0x557b67e9c6b0 msgr2=0x557b68043860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 shutdown_connections 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 1 -- 172.21.15.35:0/361194595 wait complete. 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.991+0000 7fb9f06efb80 20 client.18366 trim_cache size 0 max 16384 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb9c809f6c0 msgr2=0x7fb9c80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb9c809f6c0 0x7fb9c80a1b70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc102540 tx=0x7fb9cc009260 comp rx=0 tx=0).stop 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 msgr2=0x7fb9dc100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc100d50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9a0 tx=0x7fb9d800ecb0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 shutdown_connections 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb9c809f6c0 0x7fb9c80a1b70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9dc104390 0x7fb9dc1a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb9dc0ff350 0x7fb9dc100d50 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 --2- 172.21.15.35:0/2781576389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9dc0ffcf0 0x7fb9dc101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 >> 172.21.15.35:0/2781576389 conn(0x7fb9dc076330 msgr2=0x7fb9dc068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 shutdown_connections 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:51:33.992+0000 7fb9e4562700 1 -- 172.21.15.35:0/2781576389 wait complete. 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 -- 172.21.15.35:0/2388742369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a0104390 msgr2=0x7f81a010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 --2- 172.21.15.35:0/2388742369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a0104390 0x7f81a010bf60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f819800b0d0 tx=0x7f819800b3e0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 -- 172.21.15.35:0/2388742369 shutdown_connections 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 --2- 172.21.15.35:0/2388742369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a0104390 0x7f81a010bf60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 --2- 172.21.15.35:0/2388742369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a00ff350 0x7f81a00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 --2- 172.21.15.35:0/2388742369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ffcf0 0x7f81a0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 -- 172.21.15.35:0/2388742369 >> 172.21.15.35:0/2388742369 conn(0x7f81a0076330 msgr2=0x7f81a0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.193+0000 7f81a8739700 1 -- 172.21.15.35:0/2388742369 shutdown_connections 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.194+0000 7f81a8739700 1 -- 172.21.15.35:0/2388742369 wait complete. 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.194+0000 7f81a8739700 1 Processor -- start 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.194+0000 7f81a8739700 1 -- start start 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a8739700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 0x7f81a0100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a8739700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a00ffcf0 0x7f81a0101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a8739700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a0104390 0x7f81a01a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a8739700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a0101ac0 con 0x7f81a00ffcf0 2023-03-17T10:15:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a8739700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01a4b00 con 0x7f81a0104390 2023-03-17T10:15:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a8739700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01a4c40 con 0x7f81a00ff350 2023-03-17T10:15:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 0x7f81a0100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a5cd4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a00ffcf0 0x7f81a0101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 0x7f81a0100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:41140/0 (socket says 172.21.15.35:41140) 2023-03-17T10:15:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 -- 172.21.15.35:0/1842457891 learned_addr learned my addr 172.21.15.35:0/1842457891 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:10.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a00ffcf0 0x7f81a0101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49378/0 (socket says 172.21.15.35:49378) 2023-03-17T10:15:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a0104390 0x7f81a01a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 -- 172.21.15.35:0/1842457891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a0104390 msgr2=0x7f81a01a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a0104390 0x7f81a01a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 -- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a00ffcf0 msgr2=0x7f81a0101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a00ffcf0 0x7f81a0101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:12.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 -- 172.21.15.35:0/1842457891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198009d00 con 0x7f81a00ff350 2023-03-17T10:15:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.195+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 0x7f81a0100d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f819c00d980 tx=0x7f819c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.196+0000 7f81977fe700 1 -- 172.21.15.35:0/1842457891 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c004220 con 0x7f81a00ff350 2023-03-17T10:15:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.196+0000 7f81977fe700 1 -- 172.21.15.35:0/1842457891 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f819c004cc0 con 0x7f81a00ff350 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.196+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a010f010 con 0x7f81a00ff350 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.196+0000 7f81977fe700 1 -- 172.21.15.35:0/1842457891 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c00f690 con 0x7f81a00ff350 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.196+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a010ee80 con 0x7f81a00ff350 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.198+0000 7f81977fe700 1 -- 172.21.15.35:0/1842457891 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f819c004e30 con 0x7f81a00ff350 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.199+0000 7f81977fe700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f818c09f6c0 0x7f818c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.199+0000 7f81977fe700 1 -- 172.21.15.35:0/1842457891 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f819c0ca2c0 con 0x7f81a00ff350 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.199+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f818c09f6c0 0x7f818c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.199+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f818c09f6c0 0x7f818c0a1b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81a0102540 tx=0x7f8190009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 Processor -- start 2023-03-17T10:15:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 -- start start 2023-03-17T10:15:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x564200797fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642007984f0 0x564200792420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x564200792d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564200699010 con 0x564200792960 2023-03-17T10:15:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642006eb950 con 0x5642007984f0 2023-03-17T10:15:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642006e4de0 con 0x564200797be0 2023-03-17T10:15:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81a6cd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x564200792d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81a64d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x564200797fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81a6cd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x564200792d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49386/0 (socket says 172.21.15.35:49386) 2023-03-17T10:15:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81a6cd6700 1 -- 172.21.15.35:0/844775374 learned_addr learned my addr 172.21.15.35:0/844775374 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.200+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642007984f0 0x564200792420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f81a64d5700 1 -- 172.21.15.35:0/844775374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642007984f0 msgr2=0x564200792420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f81a64d5700 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642007984f0 0x564200792420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:17.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f81a64d5700 1 -- 172.21.15.35:0/844775374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 msgr2=0x564200792d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f81a64d5700 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x564200792d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f81a64d5700 1 -- 172.21.15.35:0/844775374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642005665d0 con 0x564200797be0 2023-03-17T10:15:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f81a64d5700 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x564200797fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f819c0c7a50 tx=0x7f819c0978b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e6e93374157cf3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f8194ff9700 1 -- 172.21.15.35:0/844775374 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0044e0 con 0x564200797be0 2023-03-17T10:15:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f8194ff9700 1 -- 172.21.15.35:0/844775374 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f819c097d70 con 0x564200797be0 2023-03-17T10:15:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.201+0000 7f8194ff9700 1 -- 172.21.15.35:0/844775374 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c098210 con 0x564200797be0 2023-03-17T10:15:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 -- 172.21.15.35:0/844775374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 msgr2=0x564200797fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x564200797fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f819c0c7a50 tx=0x7f819c0978b0 comp rx=0 tx=0).stop 2023-03-17T10:15:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 -- 172.21.15.35:0/844775374 shutdown_connections 2023-03-17T10:15:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x564200792d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:21.079 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:34 smithi035 ceph-mon[92535]: pgmap v2591: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:15:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x564200797fb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/844775374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642007984f0 0x564200792420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 -- 172.21.15.35:0/844775374 >> 172.21.15.35:0/844775374 conn(0x5642005ef6b0 msgr2=0x56420078ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 -- 172.21.15.35:0/844775374 shutdown_connections 2023-03-17T10:15:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.202+0000 7f81b48c6b80 1 -- 172.21.15.35:0/844775374 wait complete. 2023-03-17T10:15:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 -- start start 2023-03-17T10:15:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 Processor -- start 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420079e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642005688c0 con 0x5642007984f0 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420079c670 con 0x564200792960 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642007a8000 con 0x564200797be0 2023-03-17T10:15:26.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81b48c6b80 10 client.0 _ll_register_callbacks cb 0x56420058a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:15:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81a6cd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81a6cd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49392/0 (socket says 172.21.15.35:49392) 2023-03-17T10:15:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81a6cd6700 1 -- 172.21.15.35:0/1880493644 learned_addr learned my addr 172.21.15.35:0/1880493644 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.203+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420079e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a6cd6700 1 -- 172.21.15.35:0/1880493644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 msgr2=0x56420079b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a6cd6700 1 -- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 msgr2=0x56420079e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420079e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a6cd6700 1 -- 172.21.15.35:0/1880493644 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a010ee80 con 0x5642007984f0 2023-03-17T10:15:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:15:28.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079bf00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f819800bcd0 tx=0x7f819800bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caedb8124dec4f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f8189ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:15:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f8189ffb700 1 -- 172.21.15.35:0/1880493644 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800bea0 con 0x5642007984f0 2023-03-17T10:15:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f8189ffb700 1 -- 172.21.15.35:0/1880493644 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(210..210 src has 1..210) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8198003a00 con 0x5642007984f0 2023-03-17T10:15:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.204+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642006a7390 con 0x5642007984f0 2023-03-17T10:15:28.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f8189ffb700 1 -- 172.21.15.35:0/1880493644 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f819800e040 con 0x5642007984f0 2023-03-17T10:15:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 10 client.18378 fetch_fsmap learned FSMap version 37 2023-03-17T10:15:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564200512d80 con 0x5642007984f0 2023-03-17T10:15:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f8189ffb700 1 -- 172.21.15.35:0/1880493644 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5642006a7390 con 0x5642007984f0 2023-03-17T10:15:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f8189ffb700 1 -- 172.21.15.35:0/1880493644 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f819800b100 con 0x5642007984f0 2023-03-17T10:15:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 10 client.18378 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:15:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 10 client.18378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:15:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 20 client.18378 populate_metadata read hostname 'smithi035' 2023-03-17T10:15:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642007ac060 0x5642007ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 4 client.18378 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:15:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.205+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642006b3600 con 0x5642007ac060 2023-03-17T10:15:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.206+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642007ac060 0x5642007ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.206+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642007ac060 0x5642007ae470 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7cd3e40a8320b84 server_cookie=8860ccfef4e41625 in_seq=0 out_seq=0 2023-03-17T10:15:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.206+0000 7f8189ffb700 10 client.18378 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f8189ffb700 1 -- 172.21.15.35:0/1880493644 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5642006b3600 con 0x5642007ac060 2023-03-17T10:15:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f8189ffb700 10 client.18378 handle_command_reply: tid=0 2023-03-17T10:15:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 client.18378 shutdown 2023-03-17T10:15:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 msgr2=0x56420079bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079bf00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f819800bcd0 tx=0x7f819800bd00 comp rx=0 tx=0).stop 2023-03-17T10:15:33.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 shutdown_connections 2023-03-17T10:15:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642007ac060 0x5642007ae470 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079bf00 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420079e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f8189ffb700 0 client.18378 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1880493644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 >> 172.21.15.35:0/1880493644 conn(0x5642005ef6b0 msgr2=0x564200791410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 shutdown_connections 2023-03-17T10:15:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1880493644 wait complete. 2023-03-17T10:15:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.207+0000 7f81b48c6b80 20 client.18378 trim_cache size 0 max 16384 2023-03-17T10:15:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.224+0000 7f81b48c6b80 1 Processor -- start 2023-03-17T10:15:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 -- start start 2023-03-17T10:15:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420078cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642006a7390 con 0x5642007984f0 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642007a8b50 con 0x564200792960 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642007880f0 con 0x564200797be0 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49400/0 (socket says 172.21.15.35:49400) 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 -- 172.21.15.35:0/3062853462 learned_addr learned my addr 172.21.15.35:0/3062853462 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a5cd4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a64d5700 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420078cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 -- 172.21.15.35:0/3062853462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 msgr2=0x56420079e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 -- 172.21.15.35:0/3062853462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 msgr2=0x56420078cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420078cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a6cd6700 1 -- 172.21.15.35:0/3062853462 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642006ab130 con 0x5642007984f0 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.225+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079afd0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f81980061e0 tx=0x7f8198009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a157b20b0377cade server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81957fa700 1 -- 172.21.15.35:0/3062853462 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800e020 con 0x5642007984f0 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81957fa700 1 -- 172.21.15.35:0/3062853462 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8198003e90 con 0x5642007984f0 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81957fa700 1 -- 172.21.15.35:0/3062853462 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800b2d0 con 0x5642007984f0 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81b48c6b80 1 -- 172.21.15.35:0/3062853462 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 msgr2=0x56420079afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079afd0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f81980061e0 tx=0x7f8198009780 comp rx=0 tx=0).stop 2023-03-17T10:15:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81b48c6b80 1 -- 172.21.15.35:0/3062853462 shutdown_connections 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642007984f0 0x56420079afd0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.226+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200792960 0x56420078cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/3062853462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564200797be0 0x56420079e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- 172.21.15.35:0/3062853462 >> 172.21.15.35:0/3062853462 conn(0x5642005ef6b0 msgr2=0x5642007a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- 172.21.15.35:0/3062853462 shutdown_connections 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- 172.21.15.35:0/3062853462 wait complete. 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- start start 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 Processor -- start 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x5642007f9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200797be0 0x5642007f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642007984f0 0x5642007a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642007a1470 con 0x564200792960 2023-03-17T10:15:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642007a15e0 con 0x564200797be0 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642007a17a0 con 0x5642007984f0 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81b48c6b80 10 client.0 _ll_register_callbacks cb 0x56420058a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81a64d5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x5642007f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81a64d5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x5642007f9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49402/0 (socket says 172.21.15.35:49402) 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81a64d5700 1 -- 172.21.15.35:0/1934878056 learned_addr learned my addr 172.21.15.35:0/1934878056 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200797be0 0x5642007f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.227+0000 7f81a6cd6700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642007984f0 0x5642007a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81a64d5700 1 -- 172.21.15.35:0/1934878056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642007984f0 msgr2=0x5642007a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642007984f0 0x5642007a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81a64d5700 1 -- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200797be0 msgr2=0x5642007f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200797be0 0x5642007f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81a64d5700 1 -- 172.21.15.35:0/1934878056 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8190017070 con 0x564200792960 2023-03-17T10:15:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81a64d5700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x5642007f9130 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f819c00d950 tx=0x7f819c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9440f52f18405033 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f8189ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f8189ffb700 1 -- 172.21.15.35:0/1934878056 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c005770 con 0x564200792960 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f8189ffb700 1 -- 172.21.15.35:0/1934878056 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(210..210 src has 1..210) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f819c09ff60 con 0x564200792960 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642007621e0 con 0x564200792960 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f8189ffb700 1 -- 172.21.15.35:0/1934878056 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f819c096110 con 0x564200792960 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 10 client.18384 fetch_fsmap learned FSMap version 37 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564200512d80 con 0x564200792960 2023-03-17T10:15:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f8189ffb700 1 -- 172.21.15.35:0/1934878056 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5642007621e0 con 0x564200792960 2023-03-17T10:15:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f8189ffb700 1 -- 172.21.15.35:0/1934878056 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 37) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f819c080be0 con 0x564200792960 2023-03-17T10:15:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 10 client.18384 fetch_fsmap finished waiting for FSMap version 37 2023-03-17T10:15:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 10 client.18384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:15:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 20 client.18384 populate_metadata read hostname 'smithi035' 2023-03-17T10:15:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.228+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564200800a50 0x564200802e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.229+0000 7f81b48c6b80 4 client.18384 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:15:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.229+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564200568f00 con 0x564200800a50 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.229+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564200800a50 0x564200802e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.229+0000 7f8189ffb700 10 client.18384 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:00.229+0000 7f81a5cd4700 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564200800a50 0x564200802e30 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1eb91ce59d0e7b server_cookie=c7a141693919009c in_seq=0 out_seq=0 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f8189ffb700 1 -- 172.21.15.35:0/1934878056 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564200568f00 con 0x564200800a50 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f8189ffb700 10 client.18384 handle_command_reply: tid=0 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 client.18384 shutdown 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 msgr2=0x5642007f9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x5642007f9130 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f819c00d950 tx=0x7f819c005dc0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 shutdown_connections 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564200800a50 0x564200802e30 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642007984f0 0x5642007a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564200792960 0x5642007f9130 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f8189ffb700 0 client.18384 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 --2- 172.21.15.35:0/1934878056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564200797be0 0x5642007f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 >> 172.21.15.35:0/1934878056 conn(0x5642005ef6b0 msgr2=0x5642007956b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 shutdown_connections 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 1 -- 172.21.15.35:0/1934878056 wait complete. 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.295+0000 7f81b48c6b80 20 client.18384 trim_cache size 0 max 16384 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f818c09f6c0 msgr2=0x7f818c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f818c09f6c0 0x7f818c0a1b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81a0102540 tx=0x7f8190009260 comp rx=0 tx=0).stop 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 msgr2=0x7f81a0100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 0x7f81a0100d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f819c00d980 tx=0x7f819c00dc90 comp rx=0 tx=0).stop 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 shutdown_connections 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f818c09f6c0 0x7f818c0a1b70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a0104390 0x7f81a01a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00ff350 0x7f81a0100d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 --2- 172.21.15.35:0/1842457891 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f81a00ffcf0 0x7f81a0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 >> 172.21.15.35:0/1842457891 conn(0x7f81a0076330 msgr2=0x7f81a0068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 shutdown_connections 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:03.296+0000 7f81a8739700 1 -- 172.21.15.35:0/1842457891 wait complete. 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 -- 172.21.15.35:0/2946264073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c00ffcf0 msgr2=0x7f92c0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/2946264073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c00ffcf0 0x7f92c0103cb0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f92b00099c0 tx=0x7f92b0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 -- 172.21.15.35:0/2946264073 shutdown_connections 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/2946264073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92c0104390 0x7f92c010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/2946264073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ff350 0x7f92c00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/2946264073 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c00ffcf0 0x7f92c0103cb0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 -- 172.21.15.35:0/2946264073 >> 172.21.15.35:0/2946264073 conn(0x7f92c0076330 msgr2=0x7f92c0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 -- 172.21.15.35:0/2946264073 shutdown_connections 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.423+0000 7f92c7d4a700 1 -- 172.21.15.35:0/2946264073 wait complete. 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 Processor -- start 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 -- start start 2023-03-17T10:15:43.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ff350 0x7f92c0196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:43.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:36 smithi035 ceph-mon[92535]: pgmap v2592: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:15:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92c00ffcf0 0x7f92c01967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 0x7f92c019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c019b240 con 0x7f92c0104390 2023-03-17T10:15:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c019b3b0 con 0x7f92c00ffcf0 2023-03-17T10:15:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c7d4a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c019b570 con 0x7f92c00ff350 2023-03-17T10:15:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 0x7f92c019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 0x7f92c019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49444/0 (socket says 172.21.15.35:49444) 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 -- 172.21.15.35:0/3949560346 learned_addr learned my addr 172.21.15.35:0/3949560346 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92c00ffcf0 0x7f92c01967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ff350 0x7f92c0196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 -- 172.21.15.35:0/3949560346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ff350 msgr2=0x7f92c0196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ff350 0x7f92c0196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 -- 172.21.15.35:0/3949560346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92c00ffcf0 msgr2=0x7f92c01967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92c00ffcf0 0x7f92c01967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.424+0000 7f92c62e7700 1 -- 172.21.15.35:0/3949560346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00095f0 con 0x7f92c0104390 2023-03-17T10:15:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.425+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 0x7f92c019ac00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007ee0 tx=0x7f92b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.425+0000 7f92b6ffd700 1 -- 172.21.15.35:0/3949560346 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8017070 con 0x7f92c0104390 2023-03-17T10:15:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.425+0000 7f92b6ffd700 1 -- 172.21.15.35:0/3949560346 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b800f040 con 0x7f92c0104390 2023-03-17T10:15:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.425+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c010efc0 con 0x7f92c0104390 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.425+0000 7f92b6ffd700 1 -- 172.21.15.35:0/3949560346 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8005570 con 0x7f92c0104390 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.425+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c010ee30 con 0x7f92c0104390 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.427+0000 7f92b6ffd700 1 -- 172.21.15.35:0/3949560346 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f92b800db20 con 0x7f92c0104390 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.428+0000 7f92b6ffd700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f92ac09f640 0x7f92ac0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.428+0000 7f92b6ffd700 1 -- 172.21.15.35:0/3949560346 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f92b80c9cf0 con 0x7f92c0104390 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.428+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f92ac09f640 0x7f92ac0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.428+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f92ac09f640 0x7f92ac0a1af0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009c60 tx=0x7f92bc009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.428+0000 7f92d3ed7b80 1 Processor -- start 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 -- start start 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba769a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba7699c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba7699cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba768a3010 con 0x55ba769a1be0 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba768f5950 con 0x55ba769a24f0 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba768eede0 con 0x55ba7699c960 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba769a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba769a1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49448/0 (socket says 172.21.15.35:49448) 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 -- 172.21.15.35:0/2555364588 learned_addr learned my addr 172.21.15.35:0/2555364588 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c62e7700 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba7699cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c52e5700 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba7699c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 -- 172.21.15.35:0/2555364588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 msgr2=0x55ba7699cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba7699cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 -- 172.21.15.35:0/2555364588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 msgr2=0x55ba7699c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba7699c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.429+0000 7f92c5ae6700 1 -- 172.21.15.35:0/2555364588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba767705d0 con 0x55ba769a1be0 2023-03-17T10:15:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.430+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba769a1fb0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00e4e0 tx=0x7f92bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422a4292c0498050 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.430+0000 7f92abfff700 1 -- 172.21.15.35:0/2555364588 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00ee00 con 0x55ba769a1be0 2023-03-17T10:15:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.430+0000 7f92abfff700 1 -- 172.21.15.35:0/2555364588 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92bc021070 con 0x55ba769a1be0 2023-03-17T10:15:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.430+0000 7f92abfff700 1 -- 172.21.15.35:0/2555364588 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc01d740 con 0x55ba769a1be0 2023-03-17T10:15:50.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/2555364588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 msgr2=0x55ba769a1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba769a1fb0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00e4e0 tx=0x7f92bc014000 comp rx=0 tx=0).stop 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/2555364588 shutdown_connections 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba7699cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba769a1fb0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/2555364588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba7699c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/2555364588 >> 172.21.15.35:0/2555364588 conn(0x55ba767f96b0 msgr2=0x55ba76996a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/2555364588 shutdown_connections 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/2555364588 wait complete. 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 -- start start 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.431+0000 7f92d3ed7b80 1 Processor -- start 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 0x55ba769a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a1be0 0x55ba769a5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba769a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:50.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba767728c0 con 0x55ba7699c960 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba769a6580 con 0x55ba769a24f0 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba769b2000 con 0x55ba769a1be0 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92d3ed7b80 10 client.0 _ll_register_callbacks cb 0x55ba76794230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 0x55ba769a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 0x55ba769a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49454/0 (socket says 172.21.15.35:49454) 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 -- 172.21.15.35:0/3285348906 learned_addr learned my addr 172.21.15.35:0/3285348906 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a1be0 0x55ba769a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba769a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 -- 172.21.15.35:0/3285348906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a1be0 msgr2=0x55ba769a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a1be0 0x55ba769a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 -- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 msgr2=0x55ba769a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba769a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:50.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 -- 172.21.15.35:0/3285348906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc017070 con 0x55ba7699c960 2023-03-17T10:15:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba769a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:15:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 0x55ba769a84f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00ecf0 tx=0x7f92bc00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ae42a2787ac33e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.432+0000 7f92a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:15:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92a97fa700 1 -- 172.21.15.35:0/3285348906 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc005590 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92a97fa700 1 -- 172.21.15.35:0/3285348906 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f92bc003680 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba768b1390 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92a97fa700 1 -- 172.21.15.35:0/3285348906 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92bc0056f0 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 10 client.18402 fetch_fsmap learned FSMap version 39 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55ba7671cd80 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92a97fa700 1 -- 172.21.15.35:0/3285348906 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba768b1390 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92a97fa700 1 -- 172.21.15.35:0/3285348906 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f92bc01c940 con 0x55ba7699c960 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 10 client.18402 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 10 client.18402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:15:53.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 20 client.18402 populate_metadata read hostname 'smithi035' 2023-03-17T10:15:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba769b6030 0x55ba769b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 4 client.18402 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:15:54.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.433+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba768bd600 con 0x55ba769b6030 2023-03-17T10:15:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.434+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba769b6030 0x55ba769b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.434+0000 7f92a97fa700 10 client.18402 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.434+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba769b6030 0x55ba769b8440 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84d8089072d6bf14 server_cookie=ac1fc56b03378fad in_seq=0 out_seq=0 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92a97fa700 1 -- 172.21.15.35:0/3285348906 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ba768bd600 con 0x55ba769b6030 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92a97fa700 10 client.18402 handle_command_reply: tid=0 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 client.18402 shutdown 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 msgr2=0x55ba769a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 0x55ba769a84f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00ecf0 tx=0x7f92bc00ed20 comp rx=0 tx=0).stop 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 shutdown_connections 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba769b6030 0x55ba769b8440 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a24f0 0x55ba769a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92a97fa700 0 client.18402 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba7699c960 0x55ba769a84f0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3285348906 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a1be0 0x55ba769a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 >> 172.21.15.35:0/3285348906 conn(0x55ba767f96b0 msgr2=0x55ba7699b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 shutdown_connections 2023-03-17T10:15:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3285348906 wait complete. 2023-03-17T10:15:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.435+0000 7f92d3ed7b80 20 client.18402 trim_cache size 0 max 16384 2023-03-17T10:15:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 Processor -- start 2023-03-17T10:15:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 -- start start 2023-03-17T10:15:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba76996ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a1be0 0x55ba7699ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 0x55ba769a8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba76993b60 con 0x55ba769a24f0 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba7699c7a0 con 0x55ba769a1be0 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.450+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba769a1830 con 0x55ba7699c960 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 0x55ba769a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 0x55ba769a8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49466/0 (socket says 172.21.15.35:49466) 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 -- 172.21.15.35:0/3331917050 learned_addr learned my addr 172.21.15.35:0/3331917050 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba76996ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a1be0 0x55ba7699ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:15:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 -- 172.21.15.35:0/3331917050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 msgr2=0x55ba76996ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba76996ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 -- 172.21.15.35:0/3331917050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a1be0 msgr2=0x55ba7699ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a1be0 0x55ba7699ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 -- 172.21.15.35:0/3331917050 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba7699d000 con 0x55ba769a24f0 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba76996ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a1be0 0x55ba7699ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:15:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 0x55ba769a8020 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009510 tx=0x7f92b80c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b910882cf47ed35 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:15:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92b4ff9700 1 -- 172.21.15.35:0/3331917050 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800ddd0 con 0x55ba769a24f0 2023-03-17T10:15:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92b4ff9700 1 -- 172.21.15.35:0/3331917050 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b80977d0 con 0x55ba769a24f0 2023-03-17T10:15:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.451+0000 7f92b4ff9700 1 -- 172.21.15.35:0/3331917050 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8097c70 con 0x55ba769a24f0 2023-03-17T10:15:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3331917050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 msgr2=0x55ba769a8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:15:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 0x55ba769a8020 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009510 tx=0x7f92b80c9040 comp rx=0 tx=0).stop 2023-03-17T10:15:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3331917050 shutdown_connections 2023-03-17T10:15:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a24f0 0x55ba769a8020 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7699c960 0x55ba76996ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3331917050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba769a1be0 0x55ba7699ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:15:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3331917050 >> 172.21.15.35:0/3331917050 conn(0x55ba767f96b0 msgr2=0x55ba769983d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:15:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3331917050 shutdown_connections 2023-03-17T10:15:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3331917050 wait complete. 2023-03-17T10:15:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 -- start start 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.452+0000 7f92d3ed7b80 1 Processor -- start 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba7699c960 0x55ba76a06350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba76a06890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a24f0 0x55ba76a01e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba76a02520 con 0x55ba769a1be0 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba76a02690 con 0x55ba7699c960 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba76a02850 con 0x55ba769a24f0 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92d3ed7b80 10 client.0 _ll_register_callbacks cb 0x55ba76794230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba76a06890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba76a06890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49470/0 (socket says 172.21.15.35:49470) 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 -- 172.21.15.35:0/3775909345 learned_addr learned my addr 172.21.15.35:0/3775909345 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a24f0 0x55ba76a01e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 -- 172.21.15.35:0/3775909345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a24f0 msgr2=0x55ba76a01e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:03.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:37 smithi035 ceph-mon[92535]: pgmap v2593: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:16:03.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:40 smithi035 ceph-mon[92535]: pgmap v2594: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:03.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:42 smithi035 ceph-mon[92535]: pgmap v2595: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:03.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:44 smithi035 ceph-mon[92535]: pgmap v2596: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:16:03.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:46 smithi035 ceph-mon[92535]: pgmap v2597: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:06.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:47 smithi035 ceph-mon[92535]: pgmap v2598: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:16:06.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:50 smithi035 ceph-mon[92535]: pgmap v2599: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:52 smithi035 ceph-mon[92535]: pgmap v2600: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:54 smithi035 ceph-mon[92535]: pgmap v2601: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:56 smithi035 ceph-mon[92535]: pgmap v2602: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:05:57 smithi035 ceph-mon[92535]: pgmap v2603: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:00 smithi035 ceph-mon[92535]: pgmap v2604: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:02 smithi035 ceph-mon[92535]: pgmap v2605: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:04 smithi035 ceph-mon[92535]: pgmap v2606: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:06 smithi035 ceph-mon[92535]: pgmap v2607: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:07 smithi035 ceph-mon[92535]: pgmap v2608: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:09 smithi035 ceph-mon[92535]: osdmap e239: 12 total, 12 up, 12 in 2023-03-17T10:16:06.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:09 smithi035 ceph-mon[92535]: pgmap v2610: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:16:06.104 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:12 smithi035 ceph-mon[92535]: pgmap v2611: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:16:06.104 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:14 smithi035 ceph-mon[92535]: pgmap v2612: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:16:06.104 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:15 smithi035 ceph-mon[92535]: pgmap v2613: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:15 smithi035 ceph-mon[92535]: pgmap v2614: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:17 smithi035 ceph-mon[92535]: pgmap v2615: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 137 B/s wr, 6 op/s 2023-03-17T10:16:07.699 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:17 smithi035 ceph-mon[92535]: osdmap e240: 12 total, 12 up, 12 in 2023-03-17T10:16:07.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:19 smithi035 ceph-mon[92535]: pgmap v2617: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T10:16:07.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:21 smithi035 ceph-mon[92535]: pgmap v2618: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T10:16:07.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:22 smithi035 ceph-mon[92535]: pgmap v2619: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T10:16:07.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:24 smithi035 ceph-mon[92535]: pgmap v2620: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:16:07.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:26 smithi035 ceph-mon[92535]: pgmap v2621: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:16:07.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:28 smithi035 ceph-mon[92535]: pgmap v2622: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 705 B/s wr, 13 op/s 2023-03-17T10:16:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:16:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:16:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba7699c960 0x55ba76a06350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a24f0 0x55ba76a01e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 -- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba7699c960 msgr2=0x55ba76a06350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba7699c960 0x55ba76a06350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 -- 172.21.15.35:0/3775909345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c010ee30 con 0x55ba769a1be0 2023-03-17T10:16:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c62e7700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a24f0 0x55ba76a01e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:16:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92c52e5700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba76a06890 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f92b000b580 tx=0x7f92b0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6538917734cba178 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:10.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.453+0000 7f92a97fa700 1 -- 172.21.15.35:0/3775909345 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00270e0 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba7696c1e0 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92a97fa700 1 -- 172.21.15.35:0/3775909345 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f92b0027240 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92a97fa700 1 -- 172.21.15.35:0/3775909345 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b0027400 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 10 client.18408 fetch_fsmap learned FSMap version 39 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55ba76705c00 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92a97fa700 1 -- 172.21.15.35:0/3775909345 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba7696c1e0 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92a97fa700 1 -- 172.21.15.35:0/3775909345 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f92b0003880 con 0x55ba769a1be0 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 10 client.18408 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 10 client.18408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 20 client.18408 populate_metadata read hostname 'smithi035' 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba76a0f230 0x55ba76a11640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 4 client.18408 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:16:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ba76772f00 con 0x55ba76a0f230 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.454+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba76a0f230 0x55ba76a11640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.455+0000 7f92a97fa700 10 client.18408 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.455+0000 7f92c5ae6700 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba76a0f230 0x55ba76a11640 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=163049c19fb3aed8 server_cookie=43fcc1037dd5e1d9 in_seq=0 out_seq=0 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.462+0000 7f92a97fa700 1 -- 172.21.15.35:0/3775909345 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ba76772f00 con 0x55ba76a0f230 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.462+0000 7f92a97fa700 10 client.18408 handle_command_reply: tid=0 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.462+0000 7f92d3ed7b80 1 client.18408 shutdown 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 msgr2=0x55ba76a06890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:10.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba76a06890 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f92b000b580 tx=0x7f92b0005640 comp rx=0 tx=0).stop 2023-03-17T10:16:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 shutdown_connections 2023-03-17T10:16:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba76a0f230 0x55ba76a11640 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba769a24f0 0x55ba76a01e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92a97fa700 0 client.18408 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba7699c960 0x55ba76a06350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 --2- 172.21.15.35:0/3775909345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba769a1be0 0x55ba76a06890 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 >> 172.21.15.35:0/3775909345 conn(0x55ba767f96b0 msgr2=0x55ba7699ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 shutdown_connections 2023-03-17T10:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 1 -- 172.21.15.35:0/3775909345 wait complete. 2023-03-17T10:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92d3ed7b80 20 client.18408 trim_cache size 0 max 16384 2023-03-17T10:16:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f92ac09f640 msgr2=0x7f92ac0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f92ac09f640 0x7f92ac0a1af0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009c60 tx=0x7f92bc009260 comp rx=0 tx=0).stop 2023-03-17T10:16:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 msgr2=0x7f92c019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 0x7f92c019ac00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007ee0 tx=0x7f92b800d3b0 comp rx=0 tx=0).stop 2023-03-17T10:16:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 shutdown_connections 2023-03-17T10:16:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f92ac09f640 0x7f92ac0a1af0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92c0104390 0x7f92c019ac00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ff350 0x7f92c0196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 --2- 172.21.15.35:0/3949560346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92c00ffcf0 0x7f92c01967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.463+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 >> 172.21.15.35:0/3949560346 conn(0x7f92c0076330 msgr2=0x7f92c00680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.464+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 shutdown_connections 2023-03-17T10:16:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:16.464+0000 7f92c7d4a700 1 -- 172.21.15.35:0/3949560346 wait complete. 2023-03-17T10:16:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.585+0000 7f42450e4700 1 -- 172.21.15.35:0/2105860801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 msgr2=0x7f424010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.585+0000 7f42450e4700 1 --2- 172.21.15.35:0/2105860801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f424010bf60 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f423800b0d0 tx=0x7f423800b3e0 comp rx=0 tx=0).stop 2023-03-17T10:16:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.585+0000 7f42450e4700 1 -- 172.21.15.35:0/2105860801 shutdown_connections 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.585+0000 7f42450e4700 1 --2- 172.21.15.35:0/2105860801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f424010bf60 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.586+0000 7f42450e4700 1 --2- 172.21.15.35:0/2105860801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 0x7f42400ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.586+0000 7f42450e4700 1 --2- 172.21.15.35:0/2105860801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42400ffcf0 0x7f4240103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.586+0000 7f42450e4700 1 -- 172.21.15.35:0/2105860801 >> 172.21.15.35:0/2105860801 conn(0x7f4240076330 msgr2=0x7f4240076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.586+0000 7f42450e4700 1 -- 172.21.15.35:0/2105860801 shutdown_connections 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.586+0000 7f42450e4700 1 -- 172.21.15.35:0/2105860801 wait complete. 2023-03-17T10:16:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.586+0000 7f42450e4700 1 Processor -- start 2023-03-17T10:16:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 -- start start 2023-03-17T10:16:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 0x7f42401952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42400ffcf0 0x7f42401957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f4240199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019a280 con 0x7f4240104390 2023-03-17T10:16:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019a3f0 con 0x7f42400ff350 2023-03-17T10:16:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f42450e4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019a5b0 con 0x7f42400ffcf0 2023-03-17T10:16:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f4240199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f4240199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49486/0 (socket says 172.21.15.35:49486) 2023-03-17T10:16:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 -- 172.21.15.35:0/3133224259 learned_addr learned my addr 172.21.15.35:0/3133224259 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423e59c700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42400ffcf0 0x7f42401957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423ed9d700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 0x7f42401952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 -- 172.21.15.35:0/3133224259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42400ffcf0 msgr2=0x7f42401957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42400ffcf0 0x7f42401957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 -- 172.21.15.35:0/3133224259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 msgr2=0x7f42401952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 0x7f42401952a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423f59e700 1 -- 172.21.15.35:0/3133224259 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4238009d00 con 0x7f4240104390 2023-03-17T10:16:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.587+0000 7f423ed9d700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 0x7f42401952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.588+0000 7f423f59e700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f4240199c40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4238008ec0 tx=0x7f4238008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.588+0000 7f4227fff700 1 -- 172.21.15.35:0/3133224259 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800e040 con 0x7f4240104390 2023-03-17T10:16:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.588+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424010efc0 con 0x7f4240104390 2023-03-17T10:16:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.588+0000 7f4227fff700 1 -- 172.21.15.35:0/3133224259 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f423800be30 con 0x7f4240104390 2023-03-17T10:16:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.588+0000 7f4227fff700 1 -- 172.21.15.35:0/3133224259 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423801b6c0 con 0x7f4240104390 2023-03-17T10:16:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.588+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424010ee30 con 0x7f4240104390 2023-03-17T10:16:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.590+0000 7f4227fff700 1 -- 172.21.15.35:0/3133224259 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4238024410 con 0x7f4240104390 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.591+0000 7f4227fff700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f422809f640 0x7f42280a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.591+0000 7f4227fff700 1 -- 172.21.15.35:0/3133224259 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f42380cb7c0 con 0x7f4240104390 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.591+0000 7f423ed9d700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f422809f640 0x7f42280a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.591+0000 7f423ed9d700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f422809f640 0x7f42280a1af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4230009cb0 tx=0x7f4230009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 Processor -- start 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 -- start start 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc575ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc575a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc575ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5661010 con 0x559fc57604f0 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc56b3950 con 0x559fc575fbe0 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f4251271b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc56acde0 con 0x559fc575a960 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f423e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc575a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f423e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc575a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49492/0 (socket says 172.21.15.35:49492) 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f423e59c700 1 -- 172.21.15.35:0/3350444904 learned_addr learned my addr 172.21.15.35:0/3350444904 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.592+0000 7f423ed9d700 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc575ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423f59e700 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc575ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423e59c700 1 -- 172.21.15.35:0/3350444904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 msgr2=0x559fc575ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423e59c700 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc575ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423e59c700 1 -- 172.21.15.35:0/3350444904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 msgr2=0x559fc575ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423e59c700 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc575ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423e59c700 1 -- 172.21.15.35:0/3350444904 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fc552e5d0 con 0x559fc57604f0 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f423e59c700 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc575a420 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f423400bc30 tx=0x7f423400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b51d3af84fabf60 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f42257fa700 1 -- 172.21.15.35:0/3350444904 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234010ca0 con 0x559fc57604f0 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f42257fa700 1 -- 172.21.15.35:0/3350444904 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4234015070 con 0x559fc57604f0 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.593+0000 7f42257fa700 1 -- 172.21.15.35:0/3350444904 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234004e90 con 0x559fc57604f0 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 -- 172.21.15.35:0/3350444904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 msgr2=0x559fc575a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc575a420 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f423400bc30 tx=0x7f423400bf40 comp rx=0 tx=0).stop 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 -- 172.21.15.35:0/3350444904 shutdown_connections 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc575ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc575ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 --2- 172.21.15.35:0/3350444904 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc575a420 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 -- 172.21.15.35:0/3350444904 >> 172.21.15.35:0/3350444904 conn(0x559fc55b76b0 msgr2=0x559fc5754a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 -- 172.21.15.35:0/3350444904 shutdown_connections 2023-03-17T10:16:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 -- 172.21.15.35:0/3350444904 wait complete. 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 -- start start 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.594+0000 7f4251271b80 1 Processor -- start 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc5766440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc57636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc5763cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc55308c0 con 0x559fc575a960 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5764460 con 0x559fc575fbe0 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5770030 con 0x559fc57604f0 2023-03-17T10:16:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4251271b80 10 client.0 _ll_register_callbacks cb 0x559fc5552230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:16:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc5766440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc5766440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49496/0 (socket says 172.21.15.35:49496) 2023-03-17T10:16:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 -- 172.21.15.35:0/1968837081 learned_addr learned my addr 172.21.15.35:0/1968837081 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423e59c700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc57636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423f59e700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc5763cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 -- 172.21.15.35:0/1968837081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 msgr2=0x559fc5763cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc5763cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 -- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 msgr2=0x559fc57636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc57636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 -- 172.21.15.35:0/1968837081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423400b860 con 0x559fc575a960 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423e59c700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc57636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f423ed9d700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc5766440 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4230003930 tx=0x7f42300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4f4932f762ac98 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4222ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:16:24.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4222ff5700 1 -- 172.21.15.35:0/1968837081 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230012650 con 0x559fc575a960 2023-03-17T10:16:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.595+0000 7f4222ff5700 1 -- 172.21.15.35:0/1968837081 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4230018070 con 0x559fc575a960 2023-03-17T10:16:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559fc566f390 con 0x559fc575a960 2023-03-17T10:16:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4222ff5700 1 -- 172.21.15.35:0/1968837081 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42300127b0 con 0x559fc575a960 2023-03-17T10:16:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 10 client.18420 fetch_fsmap learned FSMap version 39 2023-03-17T10:16:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x559fc54dad80 con 0x559fc575a960 2023-03-17T10:16:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4222ff5700 1 -- 172.21.15.35:0/1968837081 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559fc566f390 con 0x559fc575a960 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4222ff5700 1 -- 172.21.15.35:0/1968837081 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4230021900 con 0x559fc575a960 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 10 client.18420 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 10 client.18420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 20 client.18420 populate_metadata read hostname 'smithi035' 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc5774120 0x559fc5776530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 4 client.18420 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:16:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559fc567b600 con 0x559fc5774120 2023-03-17T10:16:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.596+0000 7f423e59c700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc5774120 0x559fc5776530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.597+0000 7f4222ff5700 10 client.18420 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:28.102 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:30 smithi035 ceph-mon[92535]: pgmap v2623: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.597+0000 7f423e59c700 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc5774120 0x559fc5776530 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2950470e05ce6a1 server_cookie=313cef976a387e19 in_seq=0 out_seq=0 2023-03-17T10:16:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.597+0000 7f4222ff5700 1 -- 172.21.15.35:0/1968837081 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559fc567b600 con 0x559fc5774120 2023-03-17T10:16:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.597+0000 7f4222ff5700 10 client.18420 handle_command_reply: tid=0 2023-03-17T10:16:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.597+0000 7f4251271b80 1 client.18420 shutdown 2023-03-17T10:16:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 msgr2=0x559fc5766440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc5766440 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4230003930 tx=0x7f42300047c0 comp rx=0 tx=0).stop 2023-03-17T10:16:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 shutdown_connections 2023-03-17T10:16:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc5774120 0x559fc5776530 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc5763cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc5766440 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4222ff5700 0 client.18420 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 --2- 172.21.15.35:0/1968837081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc57636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 >> 172.21.15.35:0/1968837081 conn(0x559fc55b76b0 msgr2=0x559fc5759410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 shutdown_connections 2023-03-17T10:16:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 1 -- 172.21.15.35:0/1968837081 wait complete. 2023-03-17T10:16:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.598+0000 7f4251271b80 20 client.18420 trim_cache size 0 max 16384 2023-03-17T10:16:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 Processor -- start 2023-03-17T10:16:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 -- start start 2023-03-17T10:16:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc576af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5765fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc575d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:34.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc57515c0 con 0x559fc575a960 2023-03-17T10:16:34.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc57556d0 con 0x559fc575fbe0 2023-03-17T10:16:34.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f4251271b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc57564f0 con 0x559fc57604f0 2023-03-17T10:16:34.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc576af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc576af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49504/0 (socket says 172.21.15.35:49504) 2023-03-17T10:16:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 -- 172.21.15.35:0/2920704938 learned_addr learned my addr 172.21.15.35:0/2920704938 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423e59c700 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5765fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423f59e700 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc575d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 -- 172.21.15.35:0/2920704938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 msgr2=0x559fc575d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc575d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 -- 172.21.15.35:0/2920704938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 msgr2=0x559fc5765fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5765fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 -- 172.21.15.35:0/2920704938 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fc5673130 con 0x559fc575a960 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423e59c700 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5765fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.613+0000 7f423ed9d700 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc576af80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f4230009680 tx=0x7f4230009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99244bfdd78daa1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4225ffb700 1 -- 172.21.15.35:0/2920704938 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230003da0 con 0x559fc575a960 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4225ffb700 1 -- 172.21.15.35:0/2920704938 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42300218a0 con 0x559fc575a960 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4225ffb700 1 -- 172.21.15.35:0/2920704938 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300128c0 con 0x559fc575a960 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 -- 172.21.15.35:0/2920704938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 msgr2=0x559fc576af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc576af80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f4230009680 tx=0x7f4230009f20 comp rx=0 tx=0).stop 2023-03-17T10:16:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 -- 172.21.15.35:0/2920704938 shutdown_connections 2023-03-17T10:16:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc57604f0 0x559fc575d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc575a960 0x559fc576af80 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 --2- 172.21.15.35:0/2920704938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5765fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:37.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 -- 172.21.15.35:0/2920704938 >> 172.21.15.35:0/2920704938 conn(0x559fc55b76b0 msgr2=0x559fc5759bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 -- 172.21.15.35:0/2920704938 shutdown_connections 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 -- 172.21.15.35:0/2920704938 wait complete. 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.614+0000 7f4251271b80 1 -- start start 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 Processor -- start 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc576ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5769140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc5769680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5769c00 con 0x559fc57604f0 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5769d70 con 0x559fc575fbe0 2023-03-17T10:16:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fc5769f30 con 0x559fc575a960 2023-03-17T10:16:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4251271b80 10 client.0 _ll_register_callbacks cb 0x559fc5552230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:16:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc5769680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc576ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc5769680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49514/0 (socket says 172.21.15.35:49514) 2023-03-17T10:16:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 -- 172.21.15.35:0/2583216464 learned_addr learned my addr 172.21.15.35:0/2583216464 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423e59c700 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5769140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 -- 172.21.15.35:0/2583216464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 msgr2=0x559fc576ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc576ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 -- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 msgr2=0x559fc5769140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5769140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 -- 172.21.15.35:0/2583216464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fc54dad80 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f423f59e700 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc5769680 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f4238099030 tx=0x7f4238095760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dd91b5e79ceccd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.615+0000 7f4222ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4222ff5700 1 -- 172.21.15.35:0/2583216464 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380b0070 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4222ff5700 1 -- 172.21.15.35:0/2583216464 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4238099330 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559fc572a1e0 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4222ff5700 1 -- 172.21.15.35:0/2583216464 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4238098e70 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 10 client.18426 fetch_fsmap learned FSMap version 39 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x559fc55011f0 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4222ff5700 1 -- 172.21.15.35:0/2583216464 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42380b5020 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4222ff5700 1 -- 172.21.15.35:0/2583216464 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4238098820 con 0x559fc57604f0 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 10 client.18426 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:16:41.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 10 client.18426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:16:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 20 client.18426 populate_metadata read hostname 'smithi035' 2023-03-17T10:16:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc57c92c0 0x559fc57cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 4 client.18426 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559fc5530f00 con 0x559fc57c92c0 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.616+0000 7f423ed9d700 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc57c92c0 0x559fc57cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.617+0000 7f423ed9d700 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc57c92c0 0x559fc57cb6a0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1fcd190d2559145 server_cookie=8d96992cfdec693 in_seq=0 out_seq=0 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.617+0000 7f4222ff5700 10 client.18426 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.621+0000 7f4222ff5700 1 -- 172.21.15.35:0/2583216464 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559fc5530f00 con 0x559fc57c92c0 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.621+0000 7f4222ff5700 10 client.18426 handle_command_reply: tid=0 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 client.18426 shutdown 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 msgr2=0x559fc5769680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc5769680 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f4238099030 tx=0x7f4238095760 comp rx=0 tx=0).stop 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 shutdown_connections 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559fc57c92c0 0x559fc57cb6a0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559fc57604f0 0x559fc5769680 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559fc575a960 0x559fc576ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4222ff5700 0 client.18426 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 --2- 172.21.15.35:0/2583216464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559fc575fbe0 0x559fc5769140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 >> 172.21.15.35:0/2583216464 conn(0x559fc55b76b0 msgr2=0x559fc575d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 shutdown_connections 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 1 -- 172.21.15.35:0/2583216464 wait complete. 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f4251271b80 20 client.18426 trim_cache size 0 max 16384 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f422809f640 msgr2=0x7f42280a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f422809f640 0x7f42280a1af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4230009cb0 tx=0x7f4230009260 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 msgr2=0x7f4240199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f4240199c40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4238008ec0 tx=0x7f4238008ef0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 shutdown_connections 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f422809f640 0x7f42280a1af0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4240104390 0x7f4240199c40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42400ff350 0x7f42401952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 --2- 172.21.15.35:0/3133224259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42400ffcf0 0x7f42401957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.622+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 >> 172.21.15.35:0/3133224259 conn(0x7f4240076330 msgr2=0x7f42400fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.623+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 shutdown_connections 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:29.623+0000 7f42450e4700 1 -- 172.21.15.35:0/3133224259 wait complete. 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 -- 172.21.15.35:0/3247916201 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c741043f0 msgr2=0x7f2c7410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/3247916201 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c741043f0 0x7f2c7410bfc0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00b0d0 tx=0x7f2c6c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 -- 172.21.15.35:0/3247916201 shutdown_connections 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/3247916201 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c741043f0 0x7f2c7410bfc0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/3247916201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c740ff3b0 0x7f2c740ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/3247916201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ffd50 0x7f2c74103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 -- 172.21.15.35:0/3247916201 >> 172.21.15.35:0/3247916201 conn(0x7f2c74075f60 msgr2=0x7f2c74076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 -- 172.21.15.35:0/3247916201 shutdown_connections 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.744+0000 7f2c7b08a700 1 -- 172.21.15.35:0/3247916201 wait complete. 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 Processor -- start 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 -- start start 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ff3b0 0x7f2c741962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 0x7f2c74196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c741043f0 0x7f2c7419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7419b2b0 con 0x7f2c740ffd50 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7419b420 con 0x7f2c741043f0 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c7b08a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7419b5e0 con 0x7f2c740ff3b0 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 0x7f2c74196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 0x7f2c74196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49524/0 (socket says 172.21.15.35:49524) 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 -- 172.21.15.35:0/397270457 learned_addr learned my addr 172.21.15.35:0/397270457 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c78e26700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ff3b0 0x7f2c741962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c79627700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c741043f0 0x7f2c7419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 -- 172.21.15.35:0/397270457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ff3b0 msgr2=0x7f2c741962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ff3b0 0x7f2c741962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 -- 172.21.15.35:0/397270457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c741043f0 msgr2=0x7f2c7419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c741043f0 0x7f2c7419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 -- 172.21.15.35:0/397270457 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c009d00 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c78e26700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ff3b0 0x7f2c741962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c79627700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c741043f0 0x7f2c7419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.745+0000 7f2c73fff700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 0x7f2c74196810 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c9b0 tx=0x7f2c6000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.746+0000 7f2c71ffb700 1 -- 172.21.15.35:0/397270457 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60007aa0 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.746+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7410f070 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.746+0000 7f2c71ffb700 1 -- 172.21.15.35:0/397270457 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c60007c00 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.746+0000 7f2c71ffb700 1 -- 172.21.15.35:0/397270457 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60018600 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.746+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7410eee0 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.748+0000 7f2c71ffb700 1 -- 172.21.15.35:0/397270457 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2c6000f450 con 0x7f2c740ffd50 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.749+0000 7f2c71ffb700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c6409f640 0x7f2c640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.749+0000 7f2c71ffb700 1 -- 172.21.15.35:0/397270457 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f2c600ca580 con 0x7f2c740ffd50 2023-03-17T10:16:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.749+0000 7f2c78e26700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c6409f640 0x7f2c640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.749+0000 7f2c78e26700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c6409f640 0x7f2c640a1af0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c68005950 tx=0x7f2c680058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 Processor -- start 2023-03-17T10:16:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 -- start start 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93fbe0 0x56346f93ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 0x56346f93ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f841010 con 0x56346f93a960 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f893950 con 0x56346f93fbe0 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.750+0000 7f2c87217b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f88cde0 con 0x56346f9404f0 2023-03-17T10:16:43.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 0x56346f93ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 0x56346f93ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49532/0 (socket says 172.21.15.35:49532) 2023-03-17T10:16:43.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 -- 172.21.15.35:0/3531210244 learned_addr learned my addr 172.21.15.35:0/3531210244 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:43.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:32 smithi035 ceph-mon[92535]: pgmap v2624: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:16:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c78e26700 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93fbe0 0x56346f93ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c73fff700 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 -- 172.21.15.35:0/3531210244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 msgr2=0x56346f93a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 -- 172.21.15.35:0/3531210244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93fbe0 msgr2=0x56346f93ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93fbe0 0x56346f93ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 -- 172.21.15.35:0/3531210244 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346f70e5d0 con 0x56346f93a960 2023-03-17T10:16:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c78e26700 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93fbe0 0x56346f93ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c79627700 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 0x56346f93ad90 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009c90 tx=0x7f2c6c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9abae5c65f410 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c5effd700 1 -- 172.21.15.35:0/3531210244 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00e070 con 0x56346f93a960 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c5effd700 1 -- 172.21.15.35:0/3531210244 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c6c004a50 con 0x56346f93a960 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.751+0000 7f2c5effd700 1 -- 172.21.15.35:0/3531210244 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c005040 con 0x56346f93a960 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 -- 172.21.15.35:0/3531210244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 msgr2=0x56346f93ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 0x56346f93ad90 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009c90 tx=0x7f2c6c00cd70 comp rx=0 tx=0).stop 2023-03-17T10:16:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 -- 172.21.15.35:0/3531210244 shutdown_connections 2023-03-17T10:16:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93a960 0x56346f93ad90 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93fbe0 0x56346f93ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 --2- 172.21.15.35:0/3531210244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 -- 172.21.15.35:0/3531210244 >> 172.21.15.35:0/3531210244 conn(0x56346f7976b0 msgr2=0x56346f934a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 -- 172.21.15.35:0/3531210244 shutdown_connections 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 -- 172.21.15.35:0/3531210244 wait complete. 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.752+0000 7f2c87217b80 1 -- start start 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 Processor -- start 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f93a960 0x56346f9463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f943670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f9404f0 0x56346f943c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f7108c0 con 0x56346f93fbe0 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f944410 con 0x56346f9404f0 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f94ffa0 con 0x56346f93a960 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c87217b80 10 client.0 _ll_register_callbacks cb 0x56346f732230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f943670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f943670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49536/0 (socket says 172.21.15.35:49536) 2023-03-17T10:16:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 -- 172.21.15.35:0/4057038855 learned_addr learned my addr 172.21.15.35:0/4057038855 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:47.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c79627700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f9404f0 0x56346f943c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c78e26700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f93a960 0x56346f9463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 -- 172.21.15.35:0/4057038855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f93a960 msgr2=0x56346f9463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f93a960 0x56346f9463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 -- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f9404f0 msgr2=0x56346f943c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f9404f0 0x56346f943c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c73fff700 1 -- 172.21.15.35:0/4057038855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7410c800 con 0x56346f93fbe0 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.753+0000 7f2c78e26700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f93a960 0x56346f9463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c73fff700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f943670 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2c60097d60 tx=0x7f2c60098060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7d2d317451c17c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c53fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c53fff700 1 -- 172.21.15.35:0/4057038855 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000f900 con 0x56346f93fbe0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c53fff700 1 -- 172.21.15.35:0/4057038855 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f2c60007e30 con 0x56346f93fbe0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56346f84f390 con 0x56346f93fbe0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c53fff700 1 -- 172.21.15.35:0/4057038855 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c600982c0 con 0x56346f93fbe0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 10 client.18438 fetch_fsmap learned FSMap version 39 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56346f6bad80 con 0x56346f93fbe0 2023-03-17T10:16:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c53fff700 1 -- 172.21.15.35:0/4057038855 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56346f84f390 con 0x56346f93fbe0 2023-03-17T10:16:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c53fff700 1 -- 172.21.15.35:0/4057038855 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2c600b4cd0 con 0x56346f93fbe0 2023-03-17T10:16:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 10 client.18438 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:16:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 10 client.18438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:16:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 20 client.18438 populate_metadata read hostname 'smithi035' 2023-03-17T10:16:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f953f60 0x56346f956340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 4 client.18438 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:16:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.754+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56346f85b600 con 0x56346f953f60 2023-03-17T10:16:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.755+0000 7f2c78e26700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f953f60 0x56346f956340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.755+0000 7f2c53fff700 10 client.18438 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.755+0000 7f2c78e26700 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f953f60 0x56346f956340 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e81a26267921b63 server_cookie=31fe038fef406e34 in_seq=0 out_seq=0 2023-03-17T10:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c53fff700 1 -- 172.21.15.35:0/4057038855 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56346f85b600 con 0x56346f953f60 2023-03-17T10:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c53fff700 10 client.18438 handle_command_reply: tid=0 2023-03-17T10:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 client.18438 shutdown 2023-03-17T10:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 msgr2=0x56346f943670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f943670 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2c60097d60 tx=0x7f2c60098060 comp rx=0 tx=0).stop 2023-03-17T10:16:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 shutdown_connections 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f953f60 0x56346f956340 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f9404f0 0x56346f943c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f93a960 0x56346f9463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 --2- 172.21.15.35:0/4057038855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f943670 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c53fff700 0 client.18438 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 >> 172.21.15.35:0/4057038855 conn(0x56346f7976b0 msgr2=0x56346f934a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 shutdown_connections 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 1 -- 172.21.15.35:0/4057038855 wait complete. 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.756+0000 7f2c87217b80 20 client.18438 trim_cache size 0 max 16384 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 Processor -- start 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 -- start start 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f934ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f94aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f9410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f951750 con 0x56346f93fbe0 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f935720 con 0x56346f93a960 2023-03-17T10:16:55.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c87217b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f9315c0 con 0x56346f9404f0 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f94aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f94aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49544/0 (socket says 172.21.15.35:49544) 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c73fff700 1 -- 172.21.15.35:0/2411151323 learned_addr learned my addr 172.21.15.35:0/2411151323 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c78e26700 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f934ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.771+0000 7f2c79627700 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f9410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c73fff700 1 -- 172.21.15.35:0/2411151323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 msgr2=0x56346f9410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c73fff700 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f9410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:55.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c73fff700 1 -- 172.21.15.35:0/2411151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 msgr2=0x56346f934ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c73fff700 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f934ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c73fff700 1 -- 172.21.15.35:0/2411151323 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346f853130 con 0x56346f93fbe0 2023-03-17T10:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c73fff700 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f94aee0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2c60094560 tx=0x7f2c6000a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08f1a1723ba0188 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c5f7fe700 1 -- 172.21.15.35:0/2411151323 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000f900 con 0x56346f93fbe0 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c5f7fe700 1 -- 172.21.15.35:0/2411151323 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c600c4070 con 0x56346f93fbe0 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c5f7fe700 1 -- 172.21.15.35:0/2411151323 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60097770 con 0x56346f93fbe0 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 -- 172.21.15.35:0/2411151323 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 msgr2=0x56346f94aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f94aee0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2c60094560 tx=0x7f2c6000a5e0 comp rx=0 tx=0).stop 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 -- 172.21.15.35:0/2411151323 shutdown_connections 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f9410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f934ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2411151323 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f94aee0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.772+0000 7f2c87217b80 1 -- 172.21.15.35:0/2411151323 >> 172.21.15.35:0/2411151323 conn(0x56346f7976b0 msgr2=0x56346f940990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 -- 172.21.15.35:0/2411151323 shutdown_connections 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 -- 172.21.15.35:0/2411151323 wait complete. 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 -- start start 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 Processor -- start 2023-03-17T10:16:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f93cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f93b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:16:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f93d190 con 0x56346f93fbe0 2023-03-17T10:16:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f93d300 con 0x56346f93a960 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346f93c120 con 0x56346f9404f0 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c87217b80 10 client.0 _ll_register_callbacks cb 0x56346f732230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.773+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f93b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f93b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49550/0 (socket says 172.21.15.35:49550) 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 -- 172.21.15.35:0/2071757130 learned_addr learned my addr 172.21.15.35:0/2071757130 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c79627700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c78e26700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f93cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 -- 172.21.15.35:0/2071757130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 msgr2=0x56346f93bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 -- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 msgr2=0x56346f93cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f93cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 -- 172.21.15.35:0/2071757130 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56346f6bad80 con 0x56346f93fbe0 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c79627700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c73fff700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f93b6a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2c60097d60 tx=0x7f2c600a00e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd149ee0b5635cc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c53fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:16:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c53fff700 1 -- 172.21.15.35:0/2071757130 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6009fef0 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c53fff700 1 -- 172.21.15.35:0/2071757130 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f2c60007e30 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56346f90a1e0 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c53fff700 1 -- 172.21.15.35:0/2071757130 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c600982c0 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c87217b80 10 client.18444 fetch_fsmap learned FSMap version 39 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56346f6e11f0 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.774+0000 7f2c53fff700 1 -- 172.21.15.35:0/2071757130 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c600bf020 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c53fff700 1 -- 172.21.15.35:0/2071757130 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2c60096fc0 con 0x56346f93fbe0 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c87217b80 10 client.18444 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c87217b80 10 client.18444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c87217b80 20 client.18444 populate_metadata read hostname 'smithi035' 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f9a8a00 0x56346f9aade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c87217b80 4 client.18444 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:17:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56346f710f00 con 0x56346f9a8a00 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c78e26700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f9a8a00 0x56346f9aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c53fff700 10 client.18444 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.775+0000 7f2c78e26700 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f9a8a00 0x56346f9aade0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edc5101a9237fd30 server_cookie=dd23b13a30059dbc in_seq=0 out_seq=0 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c53fff700 1 -- 172.21.15.35:0/2071757130 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56346f710f00 con 0x56346f9a8a00 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c53fff700 10 client.18444 handle_command_reply: tid=0 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 client.18444 shutdown 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 msgr2=0x56346f93b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f93b6a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2c60097d60 tx=0x7f2c600a00e0 comp rx=0 tx=0).stop 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 shutdown_connections 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56346f9a8a00 0x56346f9aade0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56346f9404f0 0x56346f93bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c53fff700 0 client.18444 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56346f93a960 0x56346f93cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 --2- 172.21.15.35:0/2071757130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56346f93fbe0 0x56346f93b6a0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 >> 172.21.15.35:0/2071757130 conn(0x56346f7976b0 msgr2=0x56346f93e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 shutdown_connections 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 1 -- 172.21.15.35:0/2071757130 wait complete. 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.780+0000 7f2c87217b80 20 client.18444 trim_cache size 0 max 16384 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c6409f640 msgr2=0x7f2c640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c6409f640 0x7f2c640a1af0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c68005950 tx=0x7f2c680058e0 comp rx=0 tx=0).stop 2023-03-17T10:17:00.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 msgr2=0x7f2c74196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:00.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:34 smithi035 ceph-mon[92535]: pgmap v2625: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:17:00.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 0x7f2c74196810 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c9b0 tx=0x7f2c6000cd70 comp rx=0 tx=0).stop 2023-03-17T10:17:01.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 shutdown_connections 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2c6409f640 0x7f2c640a1af0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c741043f0 0x7f2c7419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c740ff3b0 0x7f2c741962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 --2- 172.21.15.35:0/397270457 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2c740ffd50 0x7f2c74196810 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 >> 172.21.15.35:0/397270457 conn(0x7f2c74075f60 msgr2=0x7f2c74068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 shutdown_connections 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:42.781+0000 7f2c7b08a700 1 -- 172.21.15.35:0/397270457 wait complete. 2023-03-17T10:17:01.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 -- 172.21.15.35:0/2018522961 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 msgr2=0x7eff50103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2018522961 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff50103cb0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7eff400099c0 tx=0x7eff40009cd0 comp rx=0 tx=0).stop 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 -- 172.21.15.35:0/2018522961 shutdown_connections 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2018522961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50104390 0x7eff5010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2018522961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff500ff350 0x7eff500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2018522961 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff50103cb0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 -- 172.21.15.35:0/2018522961 >> 172.21.15.35:0/2018522961 conn(0x7eff50076330 msgr2=0x7eff50076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 -- 172.21.15.35:0/2018522961 shutdown_connections 2023-03-17T10:17:02.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.903+0000 7eff57ad6700 1 -- 172.21.15.35:0/2018522961 wait complete. 2023-03-17T10:17:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 Processor -- start 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 -- start start 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff500ff350 0x7eff50196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff501967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff50104390 0x7eff5019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5019b240 con 0x7eff500ffcf0 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5019b3b0 con 0x7eff50104390 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff57ad6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5019b570 con 0x7eff500ff350 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff501967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff501967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49562/0 (socket says 172.21.15.35:49562) 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 -- 172.21.15.35:0/2180211811 learned_addr learned my addr 172.21.15.35:0/2180211811 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55872700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff500ff350 0x7eff50196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff56073700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff50104390 0x7eff5019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 -- 172.21.15.35:0/2180211811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff500ff350 msgr2=0x7eff50196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff500ff350 0x7eff50196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 -- 172.21.15.35:0/2180211811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff50104390 msgr2=0x7eff5019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff50104390 0x7eff5019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 -- 172.21.15.35:0/2180211811 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff400095f0 con 0x7eff500ffcf0 2023-03-17T10:17:06.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.904+0000 7eff55071700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff501967a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7eff40000c00 tx=0x7eff40005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:07.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.905+0000 7eff46ffd700 1 -- 172.21.15.35:0/2180211811 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000f990 con 0x7eff500ffcf0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.905+0000 7eff46ffd700 1 -- 172.21.15.35:0/2180211811 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff40023070 con 0x7eff500ffcf0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.905+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50110180 con 0x7eff500ffcf0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.905+0000 7eff46ffd700 1 -- 172.21.15.35:0/2180211811 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400173f0 con 0x7eff500ffcf0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.905+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5010fff0 con 0x7eff500ffcf0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.907+0000 7eff46ffd700 1 -- 172.21.15.35:0/2180211811 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7eff40025030 con 0x7eff500ffcf0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.908+0000 7eff46ffd700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7eff3c003940 0x7eff3c005df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.908+0000 7eff55872700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7eff3c003940 0x7eff3c005df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:07.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.908+0000 7eff46ffd700 1 -- 172.21.15.35:0/2180211811 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7eff400caf20 con 0x7eff500ffcf0 2023-03-17T10:17:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.908+0000 7eff55872700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7eff3c003940 0x7eff3c005df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff4c005950 tx=0x7eff4c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 Processor -- start 2023-03-17T10:17:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 -- start start 2023-03-17T10:17:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563493aa010 con 0x5563494cabf0 2023-03-17T10:17:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563493fc950 con 0x5563494c59c0 2023-03-17T10:17:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff63c63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563493f5de0 con 0x5563494cb500 2023-03-17T10:17:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff55872700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff55872700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49568/0 (socket says 172.21.15.35:49568) 2023-03-17T10:17:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.909+0000 7eff55872700 1 -- 172.21.15.35:0/2313508636 learned_addr learned my addr 172.21.15.35:0/2313508636 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55071700 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff56073700 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55872700 1 -- 172.21.15.35:0/2313508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 msgr2=0x5563494c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55872700 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55872700 1 -- 172.21.15.35:0/2313508636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 msgr2=0x5563494c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55872700 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55872700 1 -- 172.21.15.35:0/2313508636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563492775d0 con 0x5563494cabf0 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff55872700 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cafc0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7eff4c010fa0 tx=0x7eff4c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548e4e3543299b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:16.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff3bfff700 1 -- 172.21.15.35:0/2313508636 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c01e620 con 0x5563494cabf0 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff3bfff700 1 -- 172.21.15.35:0/2313508636 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff4c015070 con 0x5563494cabf0 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.910+0000 7eff3bfff700 1 -- 172.21.15.35:0/2313508636 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c01c910 con 0x5563494cabf0 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 -- 172.21.15.35:0/2313508636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 msgr2=0x5563494cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cafc0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7eff4c010fa0 tx=0x7eff4c013000 comp rx=0 tx=0).stop 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 -- 172.21.15.35:0/2313508636 shutdown_connections 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cafc0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2313508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 -- 172.21.15.35:0/2313508636 >> 172.21.15.35:0/2313508636 conn(0x5563493006b0 msgr2=0x55634949da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 -- 172.21.15.35:0/2313508636 shutdown_connections 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 -- 172.21.15.35:0/2313508636 wait complete. 2023-03-17T10:17:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 -- start start 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.911+0000 7eff63c63b80 1 Processor -- start 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563492798c0 con 0x5563494cabf0 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563494cfc00 con 0x5563494c59c0 2023-03-17T10:17:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563494acd20 con 0x5563494cb500 2023-03-17T10:17:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff63c63b80 10 client.0 _ll_register_callbacks cb 0x55634929b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:17:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49576/0 (socket says 172.21.15.35:49576) 2023-03-17T10:17:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 -- 172.21.15.35:0/1304062855 learned_addr learned my addr 172.21.15.35:0/1304062855 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff56073700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55872700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 -- 172.21.15.35:0/1304062855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 msgr2=0x5563494ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 -- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 msgr2=0x5563494cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 -- 172.21.15.35:0/1304062855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c010c50 con 0x5563494cabf0 2023-03-17T10:17:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55872700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:17:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff55071700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cf470 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7eff400c8850 tx=0x7eff4000d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f2025797283287 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.912+0000 7eff397fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:17:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff397fa700 1 -- 172.21.15.35:0/1304062855 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40099000 con 0x5563494cabf0 2023-03-17T10:17:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff397fa700 1 -- 172.21.15.35:0/1304062855 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7eff40098090 con 0x5563494cabf0 2023-03-17T10:17:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563493b8390 con 0x5563494cabf0 2023-03-17T10:17:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff397fa700 1 -- 172.21.15.35:0/1304062855 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff4001f950 con 0x5563494cabf0 2023-03-17T10:17:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 10 client.18456 fetch_fsmap learned FSMap version 39 2023-03-17T10:17:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x556349223d80 con 0x5563494cabf0 2023-03-17T10:17:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff397fa700 1 -- 172.21.15.35:0/1304062855 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563493b8390 con 0x5563494cabf0 2023-03-17T10:17:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff397fa700 1 -- 172.21.15.35:0/1304062855 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7eff4009cbd0 con 0x5563494cabf0 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 10 client.18456 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 10 client.18456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 20 client.18456 populate_metadata read hostname 'smithi035' 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563494b0b80 0x5563494b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 4 client.18456 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563493c4600 con 0x5563494b0b80 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.913+0000 7eff55872700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563494b0b80 0x5563494b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.914+0000 7eff55872700 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563494b0b80 0x5563494b2f60 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27319fdb3925f1ce server_cookie=19d48169b5a702ca in_seq=0 out_seq=0 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.914+0000 7eff397fa700 10 client.18456 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff397fa700 1 -- 172.21.15.35:0/1304062855 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5563493c4600 con 0x5563494b0b80 2023-03-17T10:17:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff397fa700 10 client.18456 handle_command_reply: tid=0 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 client.18456 shutdown 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 msgr2=0x5563494cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cf470 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7eff400c8850 tx=0x7eff4000d3c0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 shutdown_connections 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563494b0b80 0x5563494b2f60 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x5563494ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 --2- 172.21.15.35:0/1304062855 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cabf0 0x5563494cf470 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff397fa700 0 client.18456 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 >> 172.21.15.35:0/1304062855 conn(0x5563493006b0 msgr2=0x5563494a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 shutdown_connections 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 1 -- 172.21.15.35:0/1304062855 wait complete. 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.915+0000 7eff63c63b80 20 client.18456 trim_cache size 0 max 16384 2023-03-17T10:17:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 Processor -- start 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 -- start start 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cabf0 0x5563494c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 0x55634949dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563493b8390 con 0x5563494cb500 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563494990f0 con 0x5563494c59c0 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff63c63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634949e000 con 0x5563494cabf0 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff56073700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 0x55634949dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff56073700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 0x55634949dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49586/0 (socket says 172.21.15.35:49586) 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff56073700 1 -- 172.21.15.35:0/2488496917 learned_addr learned my addr 172.21.15.35:0/2488496917 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff55872700 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.930+0000 7eff55071700 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cabf0 0x5563494c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff56073700 1 -- 172.21.15.35:0/2488496917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cabf0 msgr2=0x5563494c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:24.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff56073700 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cabf0 0x5563494c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff56073700 1 -- 172.21.15.35:0/2488496917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 msgr2=0x5563494ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff56073700 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff56073700 1 -- 172.21.15.35:0/2488496917 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563493bc130 con 0x5563494cb500 2023-03-17T10:17:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff56073700 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 0x55634949dac0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7eff480092f0 tx=0x7eff4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df0d89486745171 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff44dae700 1 -- 172.21.15.35:0/2488496917 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48007ce0 con 0x5563494cb500 2023-03-17T10:17:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff44dae700 1 -- 172.21.15.35:0/2488496917 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff48003e90 con 0x5563494cb500 2023-03-17T10:17:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff44dae700 1 -- 172.21.15.35:0/2488496917 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff480047e0 con 0x5563494cb500 2023-03-17T10:17:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff63c63b80 1 -- 172.21.15.35:0/2488496917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 msgr2=0x55634949dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 0x55634949dac0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7eff480092f0 tx=0x7eff4800b040 comp rx=0 tx=0).stop 2023-03-17T10:17:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff63c63b80 1 -- 172.21.15.35:0/2488496917 shutdown_connections 2023-03-17T10:17:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494cb500 0x55634949dac0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.931+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494c59c0 0x5563494ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:36 smithi035 ceph-mon[92535]: pgmap v2626: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:38 smithi035 ceph-mon[92535]: pgmap v2627: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:40 smithi035 ceph-mon[92535]: pgmap v2628: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:42 smithi035 ceph-mon[92535]: pgmap v2629: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:44 smithi035 ceph-mon[92535]: pgmap v2630: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:46 smithi035 ceph-mon[92535]: pgmap v2631: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:48 smithi035 ceph-mon[92535]: pgmap v2632: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:50 smithi035 ceph-mon[92535]: pgmap v2633: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:52 smithi035 ceph-mon[92535]: pgmap v2634: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:54 smithi035 ceph-mon[92535]: pgmap v2635: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:56 smithi035 ceph-mon[92535]: pgmap v2636: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:06:58 smithi035 ceph-mon[92535]: pgmap v2637: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:00 smithi035 ceph-mon[92535]: pgmap v2638: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:02 smithi035 ceph-mon[92535]: pgmap v2639: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:04 smithi035 ceph-mon[92535]: pgmap v2640: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:17:24.968 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:06 smithi035 ceph-mon[92535]: pgmap v2641: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:08 smithi035 ceph-mon[92535]: pgmap v2642: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:09 smithi035 ceph-mon[92535]: osdmap e241: 12 total, 12 up, 12 in 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:10 smithi035 ceph-mon[92535]: pgmap v2644: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:12 smithi035 ceph-mon[92535]: pgmap v2645: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:14 smithi035 ceph-mon[92535]: pgmap v2646: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:15 smithi035 ceph-mon[92535]: pgmap v2647: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 883 B/s wr, 11 op/s 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:15 smithi035 ceph-mon[92535]: pgmap v2648: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 986 B/s wr, 7 op/s 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:17 smithi035 ceph-mon[92535]: osdmap e242: 12 total, 12 up, 12 in 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:17 smithi035 ceph-mon[92535]: pgmap v2650: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 15 op/s 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:20 smithi035 ceph-mon[92535]: pgmap v2651: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 15 op/s 2023-03-17T10:17:24.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:22 smithi035 ceph-mon[92535]: pgmap v2652: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:24 smithi035 ceph-mon[92535]: pgmap v2653: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:26 smithi035 ceph-mon[92535]: pgmap v2654: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:27 smithi035 ceph-mon[92535]: pgmap v2655: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:30 smithi035 ceph-mon[92535]: pgmap v2656: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:32 smithi035 ceph-mon[92535]: pgmap v2657: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:34 smithi035 ceph-mon[92535]: pgmap v2658: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:36 smithi035 ceph-mon[92535]: pgmap v2659: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:37 smithi035 ceph-mon[92535]: pgmap v2660: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:24.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:40 smithi035 ceph-mon[92535]: pgmap v2661: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:42 smithi035 ceph-mon[92535]: pgmap v2662: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:44 smithi035 ceph-mon[92535]: pgmap v2663: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:46 smithi035 ceph-mon[92535]: pgmap v2664: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:47 smithi035 ceph-mon[92535]: pgmap v2665: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:50 smithi035 ceph-mon[92535]: pgmap v2666: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:52 smithi035 ceph-mon[92535]: pgmap v2667: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:54 smithi035 ceph-mon[92535]: pgmap v2668: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:56 smithi035 ceph-mon[92535]: pgmap v2669: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:07:57 smithi035 ceph-mon[92535]: pgmap v2670: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:00 smithi035 ceph-mon[92535]: pgmap v2671: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:02 smithi035 ceph-mon[92535]: pgmap v2672: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:04 smithi035 ceph-mon[92535]: pgmap v2673: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:06 smithi035 ceph-mon[92535]: pgmap v2674: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:07 smithi035 ceph-mon[92535]: pgmap v2675: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:09 smithi035 ceph-mon[92535]: osdmap e243: 12 total, 12 up, 12 in 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:09 smithi035 ceph-mon[92535]: pgmap v2677: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:17:24.973 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:12 smithi035 ceph-mon[92535]: pgmap v2678: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:14 smithi035 ceph-mon[92535]: pgmap v2679: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:16 smithi035 ceph-mon[92535]: pgmap v2680: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:17 smithi035 ceph-mon[92535]: osdmap e244: 12 total, 12 up, 12 in 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:17 smithi035 ceph-mon[92535]: pgmap v2682: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:17:24.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T10:17:27.822 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:17:27.822 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: pgmap v2683: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: pgmap v2684: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:22 smithi035 ceph-mon[92535]: pgmap v2685: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:24 smithi035 ceph-mon[92535]: pgmap v2686: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:26 smithi035 ceph-mon[92535]: pgmap v2687: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 115 B/s wr, 11 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:27 smithi035 ceph-mon[92535]: pgmap v2688: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:30 smithi035 ceph-mon[92535]: pgmap v2689: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:17:27.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:32 smithi035 ceph-mon[92535]: pgmap v2690: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:17:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:17:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:17:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:17:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:17:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:17:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 --2- 172.21.15.35:0/2488496917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cabf0 0x5563494c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- 172.21.15.35:0/2488496917 >> 172.21.15.35:0/2488496917 conn(0x5563493006b0 msgr2=0x5563494a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- 172.21.15.35:0/2488496917 shutdown_connections 2023-03-17T10:17:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- 172.21.15.35:0/2488496917 wait complete. 2023-03-17T10:17:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- start start 2023-03-17T10:17:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 Processor -- start 2023-03-17T10:17:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 0x5563494bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494cabf0 0x5563494bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x55634950fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556349510350 con 0x5563494c59c0 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556349510490 con 0x5563494cabf0 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556349510650 con 0x5563494cb500 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff63c63b80 10 client.0 _ll_register_callbacks cb 0x55634929b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff55872700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 0x5563494bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff55872700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 0x5563494bf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49588/0 (socket says 172.21.15.35:49588) 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff55872700 1 -- 172.21.15.35:0/106127581 learned_addr learned my addr 172.21.15.35:0/106127581 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.932+0000 7eff56073700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x55634950fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55071700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494cabf0 0x5563494bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55872700 1 -- 172.21.15.35:0/106127581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 msgr2=0x55634950fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55872700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x55634950fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55872700 1 -- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494cabf0 msgr2=0x5563494bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:31.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55872700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494cabf0 0x5563494bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55872700 1 -- 172.21.15.35:0/106127581 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff48013040 con 0x5563494c59c0 2023-03-17T10:17:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff56073700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x55634950fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:17:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff55872700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 0x5563494bf640 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7eff4c011ab0 tx=0x7eff4c005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a451750e2e74b5c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff397fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:17:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff397fa700 1 -- 172.21.15.35:0/106127581 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c005670 con 0x5563494c59c0 2023-03-17T10:17:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563494731e0 con 0x5563494c59c0 2023-03-17T10:17:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff397fa700 1 -- 172.21.15.35:0/106127581 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 8411+0+0 (secure 0 0 0) 0x7eff4c017070 con 0x5563494c59c0 2023-03-17T10:17:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.933+0000 7eff397fa700 1 -- 172.21.15.35:0/106127581 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff4c032950 con 0x5563494c59c0 2023-03-17T10:17:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 10 client.18462 fetch_fsmap learned FSMap version 39 2023-03-17T10:17:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55634924a1f0 con 0x5563494c59c0 2023-03-17T10:17:36.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff397fa700 1 -- 172.21.15.35:0/106127581 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563494731e0 con 0x5563494c59c0 2023-03-17T10:17:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff397fa700 1 -- 172.21.15.35:0/106127581 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7eff4c004cd0 con 0x5563494c59c0 2023-03-17T10:17:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 10 client.18462 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:17:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 10 client.18462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:17:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 20 client.18462 populate_metadata read hostname 'smithi035' 2023-03-17T10:17:36.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556349511c10 0x556349514020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 4 client.18462 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:17:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556349279f00 con 0x556349511c10 2023-03-17T10:17:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.934+0000 7eff55071700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556349511c10 0x556349514020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.935+0000 7eff397fa700 10 client.18462 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.935+0000 7eff55071700 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556349511c10 0x556349514020 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5369d01bc215d841 server_cookie=72bb3305753a4e05 in_seq=0 out_seq=0 2023-03-17T10:17:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff397fa700 1 -- 172.21.15.35:0/106127581 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556349279f00 con 0x556349511c10 2023-03-17T10:17:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff397fa700 10 client.18462 handle_command_reply: tid=0 2023-03-17T10:17:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 client.18462 shutdown 2023-03-17T10:17:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 msgr2=0x5563494bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 0x5563494bf640 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7eff4c011ab0 tx=0x7eff4c005300 comp rx=0 tx=0).stop 2023-03-17T10:17:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 shutdown_connections 2023-03-17T10:17:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556349511c10 0x556349514020 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563494cb500 0x55634950fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563494c59c0 0x5563494bf640 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff397fa700 0 client.18462 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 --2- 172.21.15.35:0/106127581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563494cabf0 0x5563494bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 >> 172.21.15.35:0/106127581 conn(0x5563493006b0 msgr2=0x5563494ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:40.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 shutdown_connections 2023-03-17T10:17:40.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 1 -- 172.21.15.35:0/106127581 wait complete. 2023-03-17T10:17:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff63c63b80 20 client.18462 trim_cache size 0 max 16384 2023-03-17T10:17:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.940+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7eff3c003940 msgr2=0x7eff3c005df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7eff3c003940 0x7eff3c005df0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff4c005950 tx=0x7eff4c00b410 comp rx=0 tx=0).stop 2023-03-17T10:17:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 msgr2=0x7eff501967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff501967a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7eff40000c00 tx=0x7eff40005f10 comp rx=0 tx=0).stop 2023-03-17T10:17:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 shutdown_connections 2023-03-17T10:17:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7eff3c003940 0x7eff3c005df0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff50104390 0x7eff5019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff500ff350 0x7eff50196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 --2- 172.21.15.35:0/2180211811 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7eff500ffcf0 0x7eff501967a0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 >> 172.21.15.35:0/2180211811 conn(0x7eff50076330 msgr2=0x7eff500fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:41.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 shutdown_connections 2023-03-17T10:17:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:53:55.941+0000 7eff57ad6700 1 -- 172.21.15.35:0/2180211811 wait complete. 2023-03-17T10:17:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 -- 172.21.15.35:0/279067199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 msgr2=0x7f85a410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 --2- 172.21.15.35:0/279067199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a410bf60 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f859c00b0d0 tx=0x7f859c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:17:43.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 -- 172.21.15.35:0/279067199 shutdown_connections 2023-03-17T10:17:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 --2- 172.21.15.35:0/279067199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a410bf60 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 --2- 172.21.15.35:0/279067199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a40ff350 0x7f85a40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 --2- 172.21.15.35:0/279067199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ffcf0 0x7f85a4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 -- 172.21.15.35:0/279067199 >> 172.21.15.35:0/279067199 conn(0x7f85a4076330 msgr2=0x7f85a4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 -- 172.21.15.35:0/279067199 shutdown_connections 2023-03-17T10:17:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.634+0000 7f85aad82700 1 -- 172.21.15.35:0/279067199 wait complete. 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 Processor -- start 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 -- start start 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ff350 0x7f85a41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a40ffcf0 0x7f85a4197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a41a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4198040 con 0x7f85a4104390 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a41a27b0 con 0x7f85a40ff350 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85aad82700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a41a2920 con 0x7f85a40ffcf0 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a41a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a41a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49606/0 (socket says 172.21.15.35:49606) 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 -- 172.21.15.35:0/603074666 learned_addr learned my addr 172.21.15.35:0/603074666 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:43.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a3fff700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a40ffcf0 0x7f85a4197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ff350 0x7f85a41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 -- 172.21.15.35:0/603074666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a40ffcf0 msgr2=0x7f85a4197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a40ffcf0 0x7f85a4197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 -- 172.21.15.35:0/603074666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ff350 msgr2=0x7f85a41971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ff350 0x7f85a41971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a931f700 1 -- 172.21.15.35:0/603074666 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c009d00 con 0x7f85a4104390 2023-03-17T10:17:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.635+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ff350 0x7f85a41971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:17:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.636+0000 7f85a931f700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a41a2270 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f859c009380 tx=0x7f859c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.636+0000 7f85a1ffb700 1 -- 172.21.15.35:0/603074666 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c00e040 con 0x7f85a4104390 2023-03-17T10:17:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.636+0000 7f85a1ffb700 1 -- 172.21.15.35:0/603074666 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f859c003e10 con 0x7f85a4104390 2023-03-17T10:17:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.636+0000 7f85a1ffb700 1 -- 172.21.15.35:0/603074666 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c01ba00 con 0x7f85a4104390 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.636+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a410f010 con 0x7f85a4104390 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.636+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a410ee80 con 0x7f85a4104390 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.638+0000 7f85a1ffb700 1 -- 172.21.15.35:0/603074666 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f859c024410 con 0x7f85a4104390 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.639+0000 7f85a1ffb700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f859409f640 0x7f85940a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.639+0000 7f85a1ffb700 1 -- 172.21.15.35:0/603074666 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f859c0cbdb0 con 0x7f85a4104390 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.639+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f859409f640 0x7f85940a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.639+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f859409f640 0x7f85940a1af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8598005950 tx=0x7f85980058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 Processor -- start 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 -- start start 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0d8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a309fdf010 con 0x55a30a0d8960 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a031950 con 0x55a30a0ddbe0 2023-03-17T10:17:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a02ade0 con 0x55a30a0de4f0 2023-03-17T10:17:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85a931f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85a931f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49614/0 (socket says 172.21.15.35:49614) 2023-03-17T10:17:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85a931f700 1 -- 172.21.15.35:0/1696855281 learned_addr learned my addr 172.21.15.35:0/1696855281 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.640+0000 7f85a3fff700 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f85a931f700 1 -- 172.21.15.35:0/1696855281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 msgr2=0x55a30a0d8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:47.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f85a931f700 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0d8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f85a931f700 1 -- 172.21.15.35:0/1696855281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 msgr2=0x55a30a0ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f85a931f700 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0ddfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f85a931f700 1 -- 172.21.15.35:0/1696855281 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a309eac5d0 con 0x55a30a0d8960 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f85a931f700 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0d8d90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f859c0a14c0 tx=0x7f859c005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a8298fb9e430b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f858effd700 1 -- 172.21.15.35:0/1696855281 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0a19f0 con 0x55a30a0d8960 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f858effd700 1 -- 172.21.15.35:0/1696855281 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f859c0af070 con 0x55a30a0d8960 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.641+0000 7f858effd700 1 -- 172.21.15.35:0/1696855281 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c099dc0 con 0x55a30a0d8960 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1696855281 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 msgr2=0x55a30a0d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:47.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0d8d90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f859c0a14c0 tx=0x7f859c005990 comp rx=0 tx=0).stop 2023-03-17T10:17:48.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1696855281 shutdown_connections 2023-03-17T10:17:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0d8d90 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1696855281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0d8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1696855281 >> 172.21.15.35:0/1696855281 conn(0x55a309f356b0 msgr2=0x55a30a0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1696855281 shutdown_connections 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1696855281 wait complete. 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 -- start start 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.642+0000 7f85b6f0fb80 1 Processor -- start 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0d8960 0x55a30a0e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0de4f0 0x55a30a0e1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a309eae8c0 con 0x55a30a0ddbe0 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0e25c0 con 0x55a30a0de4f0 2023-03-17T10:17:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0ede00 con 0x55a30a0d8960 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85b6f0fb80 10 client.0 _ll_register_callbacks cb 0x55a309ed0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49618/0 (socket says 172.21.15.35:49618) 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 -- 172.21.15.35:0/1685166318 learned_addr learned my addr 172.21.15.35:0/1685166318 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a931f700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0de4f0 0x55a30a0e1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0d8960 0x55a30a0e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 -- 172.21.15.35:0/1685166318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0d8960 msgr2=0x55a30a0e44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0d8960 0x55a30a0e44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 -- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0de4f0 msgr2=0x55a30a0e1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0de4f0 0x55a30a0e1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 -- 172.21.15.35:0/1685166318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a410ee80 con 0x55a30a0ddbe0 2023-03-17T10:17:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.643+0000 7f85a3fff700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e1760 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f8590007de0 tx=0x7f8590012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6311738211289771 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f8583fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:17:51.621 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:34 smithi035 ceph-mon[92535]: pgmap v2691: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:17:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f8583fff700 1 -- 172.21.15.35:0/1685166318 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590004520 con 0x55a30a0ddbe0 2023-03-17T10:17:51.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f8583fff700 1 -- 172.21.15.35:0/1685166318 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8590003680 con 0x55a30a0ddbe0 2023-03-17T10:17:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a309fed390 con 0x55a30a0ddbe0 2023-03-17T10:17:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f8583fff700 1 -- 172.21.15.35:0/1685166318 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8590003880 con 0x55a30a0ddbe0 2023-03-17T10:17:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 10 client.18474 fetch_fsmap learned FSMap version 39 2023-03-17T10:17:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a309e58d80 con 0x55a30a0ddbe0 2023-03-17T10:17:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f8583fff700 1 -- 172.21.15.35:0/1685166318 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a309fed390 con 0x55a30a0ddbe0 2023-03-17T10:17:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f8583fff700 1 -- 172.21.15.35:0/1685166318 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f859001b9f0 con 0x55a30a0ddbe0 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 10 client.18474 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 10 client.18474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 20 client.18474 populate_metadata read hostname 'smithi035' 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a0f1fe0 0x55a30a0f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 4 client.18474 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.644+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a309ff9600 con 0x55a30a0f1fe0 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.645+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a0f1fe0 0x55a30a0f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.645+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a0f1fe0 0x55a30a0f43f0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21fe8c7395745a0e server_cookie=9860aa9b034109a6 in_seq=0 out_seq=0 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.645+0000 7f8583fff700 10 client.18474 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f8583fff700 1 -- 172.21.15.35:0/1685166318 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a309ff9600 con 0x55a30a0f1fe0 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f8583fff700 10 client.18474 handle_command_reply: tid=0 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 client.18474 shutdown 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 msgr2=0x55a30a0e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e1760 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f8590007de0 tx=0x7f8590012730 comp rx=0 tx=0).stop 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 shutdown_connections 2023-03-17T10:17:52.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a0f1fe0 0x55a30a0f43f0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0de4f0 0x55a30a0e1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f8583fff700 0 client.18474 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0d8960 0x55a30a0e44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/1685166318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e1760 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 >> 172.21.15.35:0/1685166318 conn(0x55a309f356b0 msgr2=0x55a30a0d7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 shutdown_connections 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/1685166318 wait complete. 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.646+0000 7f85b6f0fb80 20 client.18474 trim_cache size 0 max 16384 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.661+0000 7f85b6f0fb80 1 Processor -- start 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.661+0000 7f85b6f0fb80 1 -- start start 2023-03-17T10:17:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0d8960 0x55a30a0d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 0x55a30a0e4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0d3e70 con 0x55a30a0de4f0 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0ef690 con 0x55a30a0d8960 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0ce0d0 con 0x55a30a0ddbe0 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 0x55a30a0e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 0x55a30a0e4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49628/0 (socket says 172.21.15.35:49628) 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 -- 172.21.15.35:0/2857287104 learned_addr learned my addr 172.21.15.35:0/2857287104 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0d8960 0x55a30a0d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a3fff700 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 -- 172.21.15.35:0/2857287104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0ddbe0 msgr2=0x55a30a0e8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 -- 172.21.15.35:0/2857287104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0d8960 msgr2=0x55a30a0d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0d8960 0x55a30a0d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 -- 172.21.15.35:0/2857287104 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a309ff1130 con 0x55a30a0de4f0 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a3fff700 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f85a931f700 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 0x55a30a0e4110 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f859c099590 tx=0x7f859c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec8819d004b3ccc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f858f7fe700 1 -- 172.21.15.35:0/2857287104 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c0993d0 con 0x55a30a0de4f0 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f858f7fe700 1 -- 172.21.15.35:0/2857287104 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f859c0af070 con 0x55a30a0de4f0 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.662+0000 7f858f7fe700 1 -- 172.21.15.35:0/2857287104 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c099af0 con 0x55a30a0de4f0 2023-03-17T10:17:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/2857287104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 msgr2=0x55a30a0e4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 0x55a30a0e4110 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f859c099590 tx=0x7f859c0057b0 comp rx=0 tx=0).stop 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/2857287104 shutdown_connections 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0de4f0 0x55a30a0e4110 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0d8960 0x55a30a0d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/2857287104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/2857287104 >> 172.21.15.35:0/2857287104 conn(0x55a309f356b0 msgr2=0x55a30a0d7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/2857287104 shutdown_connections 2023-03-17T10:17:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/2857287104 wait complete. 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 -- start start 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.663+0000 7f85b6f0fb80 1 Processor -- start 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0e7dd0 con 0x55a30a0d8960 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a0e7f40 con 0x55a30a0ddbe0 2023-03-17T10:17:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a30a145e50 con 0x55a30a0de4f0 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85b6f0fb80 10 client.0 _ll_register_callbacks cb 0x55a309ed0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0e8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49630/0 (socket says 172.21.15.35:49630) 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 -- 172.21.15.35:0/3290795701 learned_addr learned my addr 172.21.15.35:0/3290795701 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a931f700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a3fff700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 -- 172.21.15.35:0/3290795701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 msgr2=0x55a30a0e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0e76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 -- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 msgr2=0x55a30a0e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 -- 172.21.15.35:0/3290795701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a309eac5d0 con 0x55a30a0d8960 2023-03-17T10:17:55.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f85a8b1e700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0e8d00 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f859800b5d0 tx=0x7f8598012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a570c1ac885075 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:17:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.664+0000 7f8583fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:17:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f8583fff700 1 -- 172.21.15.35:0/3290795701 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598017040 con 0x55a30a0d8960 2023-03-17T10:17:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f8583fff700 1 -- 172.21.15.35:0/3290795701 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8598004440 con 0x55a30a0d8960 2023-03-17T10:17:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a30a0a81e0 con 0x55a30a0d8960 2023-03-17T10:17:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f8583fff700 1 -- 172.21.15.35:0/3290795701 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8598028850 con 0x55a30a0d8960 2023-03-17T10:17:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 10 client.18480 fetch_fsmap learned FSMap version 39 2023-03-17T10:17:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a309e7f1f0 con 0x55a30a0d8960 2023-03-17T10:17:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f8583fff700 1 -- 172.21.15.35:0/3290795701 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a30a0a81e0 con 0x55a30a0d8960 2023-03-17T10:17:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f8583fff700 1 -- 172.21.15.35:0/3290795701 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8598003ad0 con 0x55a30a0d8960 2023-03-17T10:17:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 10 client.18480 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:17:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 10 client.18480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:17:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 20 client.18480 populate_metadata read hostname 'smithi035' 2023-03-17T10:17:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a1473b0 0x55a30a1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:17:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 4 client.18480 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:17:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a309eaef00 con 0x55a30a1473b0 2023-03-17T10:17:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.665+0000 7f85a3fff700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a1473b0 0x55a30a1497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.666+0000 7f85a3fff700 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a1473b0 0x55a30a1497c0 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81fab0aadae0a1a7 server_cookie=4e92fc156d7d35e9 in_seq=0 out_seq=0 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.666+0000 7f8583fff700 10 client.18480 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f8583fff700 1 -- 172.21.15.35:0/3290795701 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a309eaef00 con 0x55a30a1473b0 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f8583fff700 10 client.18480 handle_command_reply: tid=0 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 client.18480 shutdown 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 msgr2=0x55a30a0e8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0e8d00 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f859800b5d0 tx=0x7f8598012000 comp rx=0 tx=0).stop 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 shutdown_connections 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a30a1473b0 0x55a30a1497c0 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a30a0de4f0 0x55a30a0e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f8583fff700 0 client.18480 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a30a0d8960 0x55a30a0e8d00 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 --2- 172.21.15.35:0/3290795701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a30a0ddbe0 0x55a30a0e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 >> 172.21.15.35:0/3290795701 conn(0x55a309f356b0 msgr2=0x55a30a0db6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 shutdown_connections 2023-03-17T10:17:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 1 -- 172.21.15.35:0/3290795701 wait complete. 2023-03-17T10:17:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.675+0000 7f85b6f0fb80 20 client.18480 trim_cache size 0 max 16384 2023-03-17T10:17:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f859409f640 msgr2=0x7f85940a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f859409f640 0x7f85940a1af0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8598005950 tx=0x7f85980058e0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 msgr2=0x7f85a41a2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a41a2270 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f859c009380 tx=0x7f859c0093b0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 shutdown_connections 2023-03-17T10:17:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f859409f640 0x7f85940a1af0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f85a4104390 0x7f85a41a2270 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85a40ff350 0x7f85a41971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 --2- 172.21.15.35:0/603074666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a40ffcf0 0x7f85a4197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:17:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 >> 172.21.15.35:0/603074666 conn(0x7f85a4076330 msgr2=0x7f85a40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:17:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 shutdown_connections 2023-03-17T10:17:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:21.676+0000 7f85aad82700 1 -- 172.21.15.35:0/603074666 wait complete. 2023-03-17T10:17:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 -- 172.21.15.35:0/3486740777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 msgr2=0x7f35300ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:17:59.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 --2- 172.21.15.35:0/3486740777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f35300ff720 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f35240099c0 tx=0x7f3524009cd0 comp rx=0 tx=0).stop 2023-03-17T10:17:59.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 -- 172.21.15.35:0/3486740777 shutdown_connections 2023-03-17T10:17:59.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 --2- 172.21.15.35:0/3486740777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3530104390 0x7f353010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 --2- 172.21.15.35:0/3486740777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f35300ff720 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 --2- 172.21.15.35:0/3486740777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35300ffcf0 0x7f3530103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 -- 172.21.15.35:0/3486740777 >> 172.21.15.35:0/3486740777 conn(0x7f3530076330 msgr2=0x7f3530076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 -- 172.21.15.35:0/3486740777 shutdown_connections 2023-03-17T10:18:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.798+0000 7f3536035700 1 -- 172.21.15.35:0/3486740777 wait complete. 2023-03-17T10:18:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.799+0000 7f3536035700 1 Processor -- start 2023-03-17T10:18:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 -- start start 2023-03-17T10:18:00.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f3530195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35300ffcf0 0x7f3530195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3530104390 0x7f3530199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353019a120 con 0x7f35300ff350 2023-03-17T10:18:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353019a290 con 0x7f35300ffcf0 2023-03-17T10:18:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f3536035700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353019a450 con 0x7f3530104390 2023-03-17T10:18:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f3530195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f3530195140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49644/0 (socket says 172.21.15.35:49644) 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 -- 172.21.15.35:0/2037595914 learned_addr learned my addr 172.21.15.35:0/2037595914 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352ffff700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3530104390 0x7f3530199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352effd700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35300ffcf0 0x7f3530195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 -- 172.21.15.35:0/2037595914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3530104390 msgr2=0x7f3530199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3530104390 0x7f3530199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 -- 172.21.15.35:0/2037595914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35300ffcf0 msgr2=0x7f3530195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35300ffcf0 0x7f3530195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352f7fe700 1 -- 172.21.15.35:0/2037595914 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240095f0 con 0x7f35300ff350 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.800+0000 7f352effd700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35300ffcf0 0x7f3530195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.801+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f3530195140 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3524009fd0 tx=0x7f352401a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.801+0000 7f352cff9700 1 -- 172.21.15.35:0/2037595914 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352401f070 con 0x7f35300ff350 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.801+0000 7f352cff9700 1 -- 172.21.15.35:0/2037595914 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3524005030 con 0x7f35300ff350 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.801+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353010f000 con 0x7f35300ff350 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.801+0000 7f352cff9700 1 -- 172.21.15.35:0/2037595914 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524004a90 con 0x7f35300ff350 2023-03-17T10:18:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.801+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353010ee70 con 0x7f35300ff350 2023-03-17T10:18:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.803+0000 7f352cff9700 1 -- 172.21.15.35:0/2037595914 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3524023070 con 0x7f35300ff350 2023-03-17T10:18:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.804+0000 7f352cff9700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f351809f640 0x7f35180a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:02.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:36 smithi035 ceph-mon[92535]: pgmap v2692: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.804+0000 7f352effd700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f351809f640 0x7f35180a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.804+0000 7f352cff9700 1 -- 172.21.15.35:0/2037595914 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f35240cd510 con 0x7f35300ff350 2023-03-17T10:18:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.804+0000 7f352effd700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f351809f640 0x7f35180a1af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3520005fd0 tx=0x7f3520005ee0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 Processor -- start 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 -- start start 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab91fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab8c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab8cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578daa93010 con 0x5578dab924f0 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578daae5950 con 0x5578dab91be0 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f35421c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578daadede0 con 0x5578dab8c960 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f352effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab8c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f352effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab8c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49654/0 (socket says 172.21.15.35:49654) 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f352effd700 1 -- 172.21.15.35:0/361459617 learned_addr learned my addr 172.21.15.35:0/361459617 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f352f7fe700 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab91fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.805+0000 7f352ffff700 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab8cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352effd700 1 -- 172.21.15.35:0/361459617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 msgr2=0x5578dab8cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352effd700 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab8cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352effd700 1 -- 172.21.15.35:0/361459617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 msgr2=0x5578dab91fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352effd700 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab91fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352effd700 1 -- 172.21.15.35:0/361459617 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578da9605d0 con 0x5578dab924f0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352ffff700 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab8cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f352effd700 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab8c420 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f3520009410 tx=0x7f3520009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d400cf12b235fe72 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f3515ffb700 1 -- 172.21.15.35:0/361459617 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520022070 con 0x5578dab924f0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f3515ffb700 1 -- 172.21.15.35:0/361459617 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f352000ed70 con 0x5578dab924f0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.806+0000 7f3515ffb700 1 -- 172.21.15.35:0/361459617 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520005220 con 0x5578dab924f0 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 -- 172.21.15.35:0/361459617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 msgr2=0x5578dab8c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab8c420 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f3520009410 tx=0x7f3520009f90 comp rx=0 tx=0).stop 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 -- 172.21.15.35:0/361459617 shutdown_connections 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab8cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab91fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 --2- 172.21.15.35:0/361459617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab8c420 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 -- 172.21.15.35:0/361459617 >> 172.21.15.35:0/361459617 conn(0x5578da9e96b0 msgr2=0x5578dab86a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 -- 172.21.15.35:0/361459617 shutdown_connections 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 -- 172.21.15.35:0/361459617 wait complete. 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 -- start start 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.807+0000 7f35421c2b80 1 Processor -- start 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab98430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab95720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab95d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578da9628c0 con 0x5578dab924f0 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dab964a0 con 0x5578dab91be0 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578daba2000 con 0x5578dab8c960 2023-03-17T10:18:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f35421c2b80 10 client.0 _ll_register_callbacks cb 0x5578da984230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab95d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab95d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49662/0 (socket says 172.21.15.35:49662) 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 -- 172.21.15.35:0/2259409998 learned_addr learned my addr 172.21.15.35:0/2259409998 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab98430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352effd700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab95720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 -- 172.21.15.35:0/2259409998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 msgr2=0x5578dab98430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab98430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 -- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 msgr2=0x5578dab95720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab95720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 -- 172.21.15.35:0/2259409998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352000ea50 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f352ffff700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab95d30 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f3528007be0 tx=0x7f3528007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a66793f71e134b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f350effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.808+0000 7f350effd700 1 -- 172.21.15.35:0/2259409998 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800e040 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f350effd700 1 -- 172.21.15.35:0/2259409998 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3528004bb0 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578daaa1390 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f350effd700 1 -- 172.21.15.35:0/2259409998 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3528004d70 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 10 client.18492 fetch_fsmap learned FSMap version 39 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5578da90cd80 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f350effd700 1 -- 172.21.15.35:0/2259409998 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5578daaa1390 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f350effd700 1 -- 172.21.15.35:0/2259409998 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3528016850 con 0x5578dab924f0 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 10 client.18492 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 10 client.18492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 20 client.18492 populate_metadata read hostname 'smithi035' 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578daba6130 0x5578daba8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 4 client.18492 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578daaad600 con 0x5578daba6130 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.809+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578daba6130 0x5578daba8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.810+0000 7f350effd700 10 client.18492 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.810+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578daba6130 0x5578daba8540 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc61be39f89c7fc8 server_cookie=1c22f73c069f89db in_seq=0 out_seq=0 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.810+0000 7f350effd700 1 -- 172.21.15.35:0/2259409998 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5578daaad600 con 0x5578daba6130 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.810+0000 7f350effd700 10 client.18492 handle_command_reply: tid=0 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 client.18492 shutdown 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 msgr2=0x5578dab95d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab95d30 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f3528007be0 tx=0x7f3528007c10 comp rx=0 tx=0).stop 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 shutdown_connections 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578daba6130 0x5578daba8540 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab924f0 0x5578dab95d30 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f350effd700 0 client.18492 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab8c960 0x5578dab98430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2259409998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab91be0 0x5578dab95720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 >> 172.21.15.35:0/2259409998 conn(0x5578da9e96b0 msgr2=0x5578dab8b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 shutdown_connections 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 1 -- 172.21.15.35:0/2259409998 wait complete. 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.811+0000 7f35421c2b80 20 client.18492 trim_cache size 0 max 16384 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 Processor -- start 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 -- start start 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dab9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578daba2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dab97fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dab96310 con 0x5578dab8c960 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dab8c7d0 con 0x5578dab924f0 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f35421c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dab83b60 con 0x5578dab91be0 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dab9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dab9cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49666/0 (socket says 172.21.15.35:49666) 2023-03-17T10:18:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 -- 172.21.15.35:0/472944888 learned_addr learned my addr 172.21.15.35:0/472944888 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352ffff700 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dab97fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 -- 172.21.15.35:0/472944888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 msgr2=0x5578daba2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578daba2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 -- 172.21.15.35:0/472944888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 msgr2=0x5578dab97fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dab97fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352f7fe700 1 -- 172.21.15.35:0/472944888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578daaa5130 con 0x5578dab8c960 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.826+0000 7f352ffff700 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dab97fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f352f7fe700 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dab9cf50 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f3524097550 tx=0x7f3524009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471e9a2db7bf2933 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35167fc700 1 -- 172.21.15.35:0/472944888 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240c9070 con 0x5578dab8c960 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35167fc700 1 -- 172.21.15.35:0/472944888 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35240994b0 con 0x5578dab8c960 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35167fc700 1 -- 172.21.15.35:0/472944888 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240b3040 con 0x5578dab8c960 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 -- 172.21.15.35:0/472944888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 msgr2=0x5578dab9cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dab9cf50 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f3524097550 tx=0x7f3524009310 comp rx=0 tx=0).stop 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 -- 172.21.15.35:0/472944888 shutdown_connections 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dab97fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dab9cf50 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 --2- 172.21.15.35:0/472944888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578daba2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 -- 172.21.15.35:0/472944888 >> 172.21.15.35:0/472944888 conn(0x5578da9e96b0 msgr2=0x5578dab8bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 -- 172.21.15.35:0/472944888 shutdown_connections 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.827+0000 7f35421c2b80 1 -- 172.21.15.35:0/472944888 wait complete. 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 -- start start 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 Processor -- start 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dabf2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578dabf2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dabf63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:10.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dabf6950 con 0x5578dab8c960 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dabf6ac0 con 0x5578dab924f0 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578dabf6c80 con 0x5578dab91be0 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f35421c2b80 10 client.0 _ll_register_callbacks cb 0x5578da984230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dabf2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f352f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dabf2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49672/0 (socket says 172.21.15.35:49672) 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f352f7fe700 1 -- 172.21.15.35:0/2600426478 learned_addr learned my addr 172.21.15.35:0/2600426478 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.828+0000 7f352ffff700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dabf63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352effd700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578dabf2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352f7fe700 1 -- 172.21.15.35:0/2600426478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 msgr2=0x5578dabf2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578dabf2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352f7fe700 1 -- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 msgr2=0x5578dabf63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dabf63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352f7fe700 1 -- 172.21.15.35:0/2600426478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353010ee70 con 0x5578dab8c960 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352ffff700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dabf63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:18:10.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f352f7fe700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dabf2520 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f3524005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de468d345ab4a6c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f350effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f350effd700 1 -- 172.21.15.35:0/2600426478 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240c9040 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f350effd700 1 -- 172.21.15.35:0/2600426478 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f35240b3320 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578dab5c1e0 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f350effd700 1 -- 172.21.15.35:0/2600426478 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35240b3040 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 10 client.18498 fetch_fsmap learned FSMap version 39 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5578da9331f0 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f350effd700 1 -- 172.21.15.35:0/2600426478 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5578dab5c1e0 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f350effd700 1 -- 172.21.15.35:0/2600426478 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f35240a2d20 con 0x5578dab8c960 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 10 client.18498 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 10 client.18498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 20 client.18498 populate_metadata read hostname 'smithi035' 2023-03-17T10:18:10.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578dabff1a0 0x5578dac015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 4 client.18498 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:18:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.829+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5578da962f00 con 0x5578dabff1a0 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.830+0000 7f352effd700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578dabff1a0 0x5578dac015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.830+0000 7f352effd700 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578dabff1a0 0x5578dac015b0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70fe18722ff72319 server_cookie=994251ad3cf9cd67 in_seq=0 out_seq=0 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.830+0000 7f350effd700 10 client.18498 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f350effd700 1 -- 172.21.15.35:0/2600426478 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5578da962f00 con 0x5578dabff1a0 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f350effd700 10 client.18498 handle_command_reply: tid=0 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 client.18498 shutdown 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 msgr2=0x5578dabf2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:12.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dabf2520 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f3524005320 comp rx=0 tx=0).stop 2023-03-17T10:18:12.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:37 smithi035 ceph-mon[92535]: pgmap v2693: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:18:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 shutdown_connections 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578dabff1a0 0x5578dac015b0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578dab924f0 0x5578dabf63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f350effd700 0 client.18498 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578dab8c960 0x5578dabf2520 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 --2- 172.21.15.35:0/2600426478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578dab91be0 0x5578dabf2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 >> 172.21.15.35:0/2600426478 conn(0x5578da9e96b0 msgr2=0x5578dab8f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 shutdown_connections 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 1 -- 172.21.15.35:0/2600426478 wait complete. 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f35421c2b80 20 client.18498 trim_cache size 0 max 16384 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f351809f640 msgr2=0x7f35180a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.835+0000 7f3536035700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f351809f640 0x7f35180a1af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3520005fd0 tx=0x7f3520005ee0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 msgr2=0x7f3530195140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f3530195140 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3524009fd0 tx=0x7f352401a840 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 shutdown_connections 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f351809f640 0x7f35180a1af0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3530104390 0x7f3530199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f35300ff350 0x7f3530195140 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 --2- 172.21.15.35:0/2037595914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35300ffcf0 0x7f3530195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 >> 172.21.15.35:0/2037595914 conn(0x7f3530076330 msgr2=0x7f3530102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 shutdown_connections 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:34.836+0000 7f3536035700 1 -- 172.21.15.35:0/2037595914 wait complete. 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 -- 172.21.15.35:0/1233893674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 msgr2=0x7fcfb410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 --2- 172.21.15.35:0/1233893674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb410bf60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00b0d0 tx=0x7fcfac00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 -- 172.21.15.35:0/1233893674 shutdown_connections 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 --2- 172.21.15.35:0/1233893674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb410bf60 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 --2- 172.21.15.35:0/1233893674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb40ff350 0x7fcfb40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 --2- 172.21.15.35:0/1233893674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40ffcf0 0x7fcfb4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 -- 172.21.15.35:0/1233893674 >> 172.21.15.35:0/1233893674 conn(0x7fcfb4076330 msgr2=0x7fcfb4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 -- 172.21.15.35:0/1233893674 shutdown_connections 2023-03-17T10:18:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.958+0000 7fcfba902700 1 -- 172.21.15.35:0/1233893674 wait complete. 2023-03-17T10:18:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 Processor -- start 2023-03-17T10:18:15.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 -- start start 2023-03-17T10:18:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40ff350 0x7fcfb41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb40ffcf0 0x7fcfb4197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb41a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4198040 con 0x7fcfb4104390 2023-03-17T10:18:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41a27b0 con 0x7fcfb40ff350 2023-03-17T10:18:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.959+0000 7fcfba902700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41a2920 con 0x7fcfb40ffcf0 2023-03-17T10:18:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb41a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb41a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49690/0 (socket says 172.21.15.35:49690) 2023-03-17T10:18:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 -- 172.21.15.35:0/1783200262 learned_addr learned my addr 172.21.15.35:0/1783200262 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb40ffcf0 0x7fcfb4197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40ff350 0x7fcfb41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 -- 172.21.15.35:0/1783200262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb40ffcf0 msgr2=0x7fcfb4197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:20.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb40ffcf0 0x7fcfb4197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 -- 172.21.15.35:0/1783200262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40ff350 msgr2=0x7fcfb41971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40ff350 0x7fcfb41971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 -- 172.21.15.35:0/1783200262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009d00 con 0x7fcfb4104390 2023-03-17T10:18:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb41a2270 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009380 tx=0x7fcfac0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb17fa700 1 -- 172.21.15.35:0/1783200262 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00e040 con 0x7fcfb4104390 2023-03-17T10:18:20.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb410f010 con 0x7fcfb4104390 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb17fa700 1 -- 172.21.15.35:0/1783200262 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfac003e10 con 0x7fcfb4104390 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfb17fa700 1 -- 172.21.15.35:0/1783200262 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac01ba00 con 0x7fcfb4104390 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.960+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb410ee80 con 0x7fcfb4104390 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.963+0000 7fcfb17fa700 1 -- 172.21.15.35:0/1783200262 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcfac024400 con 0x7fcfb4104390 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.963+0000 7fcfb17fa700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9c09f640 0x7fcf9c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.963+0000 7fcfb17fa700 1 -- 172.21.15.35:0/1783200262 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcfac0cbe20 con 0x7fcfb4104390 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.963+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9c09f640 0x7fcf9c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9c09f640 0x7fcf9c0a1af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4005950 tx=0x7fcfa40058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 Processor -- start 2023-03-17T10:18:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 -- start start 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e5a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e4ae010 con 0x55742e5ad4f0 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e500950 con 0x55742e5a7960 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.964+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e4f9de0 con 0x55742e5acbe0 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e5a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e5a7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49696/0 (socket says 172.21.15.35:49696) 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 -- 172.21.15.35:0/3150758510 learned_addr learned my addr 172.21.15.35:0/3150758510 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 -- 172.21.15.35:0/3150758510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 msgr2=0x55742e5acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 -- 172.21.15.35:0/3150758510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 msgr2=0x55742e5a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5a7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 -- 172.21.15.35:0/3150758510 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742e37b5d0 con 0x55742e5ad4f0 2023-03-17T10:18:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:18:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e5a7420 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800bc30 tx=0x7fcfa800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bcb29afff39cc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcf9a7fc700 1 -- 172.21.15.35:0/3150758510 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8010d50 con 0x55742e5ad4f0 2023-03-17T10:18:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcf9a7fc700 1 -- 172.21.15.35:0/3150758510 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa8015070 con 0x55742e5ad4f0 2023-03-17T10:18:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.965+0000 7fcf9a7fc700 1 -- 172.21.15.35:0/3150758510 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8005020 con 0x55742e5ad4f0 2023-03-17T10:18:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/3150758510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 msgr2=0x55742e5a7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e5a7420 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800bc30 tx=0x7fcfa800bf40 comp rx=0 tx=0).stop 2023-03-17T10:18:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/3150758510 shutdown_connections 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/3150758510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e5a7420 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/3150758510 >> 172.21.15.35:0/3150758510 conn(0x55742e4046b0 msgr2=0x55742e5a1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/3150758510 shutdown_connections 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/3150758510 wait complete. 2023-03-17T10:18:24.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.966+0000 7fcfc6a8fb80 1 -- start start 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 Processor -- start 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 0x55742e5b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5ad4f0 0x55742e5b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e37d8c0 con 0x55742e5a7960 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5b1400 con 0x55742e5ad4f0 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5bd030 con 0x55742e5acbe0 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfc6a8fb80 10 client.0 _ll_register_callbacks cb 0x55742e39f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:18:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 0x55742e5b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 0x55742e5b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49700/0 (socket says 172.21.15.35:49700) 2023-03-17T10:18:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.967+0000 7fcfb3fff700 1 -- 172.21.15.35:0/182260227 learned_addr learned my addr 172.21.15.35:0/182260227 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5ad4f0 0x55742e5b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb3fff700 1 -- 172.21.15.35:0/182260227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 msgr2=0x55742e5b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb3fff700 1 -- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5ad4f0 msgr2=0x55742e5b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5ad4f0 0x55742e5b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb3fff700 1 -- 172.21.15.35:0/182260227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa800b860 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 0x55742e5b33e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4011470 tx=0x7fcfa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8348b27026553695 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcf937fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcf937fe700 1 -- 172.21.15.35:0/182260227 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa401f630 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcf937fe700 1 -- 172.21.15.35:0/182260227 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcfa401f790 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55742e4bc390 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcf937fe700 1 -- 172.21.15.35:0/182260227 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa401f950 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfc6a8fb80 10 client.18510 fetch_fsmap learned FSMap version 39 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.968+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55742e327d80 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcf937fe700 1 -- 172.21.15.35:0/182260227 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55742e4bc390 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcf937fe700 1 -- 172.21.15.35:0/182260227 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcfa4025020 con 0x55742e5a7960 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfc6a8fb80 10 client.18510 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfc6a8fb80 10 client.18510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfc6a8fb80 20 client.18510 populate_metadata read hostname 'smithi035' 2023-03-17T10:18:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e5c10c0 0x55742e5c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfc6a8fb80 4 client.18510 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55742e4c8600 con 0x55742e5c10c0 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e5c10c0 0x55742e5c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcf937fe700 10 client.18510 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.969+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e5c10c0 0x55742e5c34d0 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc95e1ddd5ff48 server_cookie=b49ac55ee7bf70e8 in_seq=0 out_seq=0 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcf937fe700 1 -- 172.21.15.35:0/182260227 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55742e4c8600 con 0x55742e5c10c0 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcf937fe700 10 client.18510 handle_command_reply: tid=0 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 client.18510 shutdown 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 msgr2=0x55742e5b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 0x55742e5b33e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4011470 tx=0x7fcfa4004750 comp rx=0 tx=0).stop 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 shutdown_connections 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e5c10c0 0x55742e5c34d0 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5ad4f0 0x55742e5b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5a7960 0x55742e5b33e0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/182260227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5acbe0 0x55742e5b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcf937fe700 0 client.18510 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 >> 172.21.15.35:0/182260227 conn(0x55742e4046b0 msgr2=0x55742e5a6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 shutdown_connections 2023-03-17T10:18:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.970+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/182260227 wait complete. 2023-03-17T10:18:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.971+0000 7fcfc6a8fb80 20 client.18510 trim_cache size 0 max 16384 2023-03-17T10:18:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.985+0000 7fcfc6a8fb80 1 Processor -- start 2023-03-17T10:18:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 -- start start 2023-03-17T10:18:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 0x55742e5b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5ad4f0 0x55742e5aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5be790 con 0x55742e5acbe0 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5a26d0 con 0x55742e5a7960 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5a7790 con 0x55742e5ad4f0 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 0x55742e5b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 0x55742e5b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49710/0 (socket says 172.21.15.35:49710) 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 -- 172.21.15.35:0/1696661497 learned_addr learned my addr 172.21.15.35:0/1696661497 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5ad4f0 0x55742e5aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 -- 172.21.15.35:0/1696661497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5ad4f0 msgr2=0x55742e5aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5ad4f0 0x55742e5aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 -- 172.21.15.35:0/1696661497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 msgr2=0x55742e5b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:32.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:40 smithi035 ceph-mon[92535]: pgmap v2694: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:42 smithi035 ceph-mon[92535]: pgmap v2695: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:44 smithi035 ceph-mon[92535]: pgmap v2696: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:18:33.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:46 smithi035 ceph-mon[92535]: pgmap v2697: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:47 smithi035 ceph-mon[92535]: pgmap v2698: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:18:33.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:50 smithi035 ceph-mon[92535]: pgmap v2699: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:52 smithi035 ceph-mon[92535]: pgmap v2700: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:54 smithi035 ceph-mon[92535]: pgmap v2701: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:18:33.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:56 smithi035 ceph-mon[92535]: pgmap v2702: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:08:57 smithi035 ceph-mon[92535]: pgmap v2703: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:18:33.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:00 smithi035 ceph-mon[92535]: pgmap v2704: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:02 smithi035 ceph-mon[92535]: pgmap v2705: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:18:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:04 smithi035 ceph-mon[92535]: pgmap v2706: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:18:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:06 smithi035 ceph-mon[92535]: pgmap v2707: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:18:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:07 smithi035 ceph-mon[92535]: pgmap v2708: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:18:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:09 smithi035 ceph-mon[92535]: osdmap e245: 12 total, 12 up, 12 in 2023-03-17T10:18:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:09 smithi035 ceph-mon[92535]: pgmap v2710: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:18:33.917 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:12 smithi035 ceph-mon[92535]: pgmap v2711: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:14 smithi035 ceph-mon[92535]: pgmap v2712: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:16 smithi035 ceph-mon[92535]: pgmap v2713: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:17 smithi035 ceph-mon[92535]: osdmap e246: 12 total, 12 up, 12 in 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:17 smithi035 ceph-mon[92535]: pgmap v2715: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:20 smithi035 ceph-mon[92535]: pgmap v2716: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:22 smithi035 ceph-mon[92535]: pgmap v2717: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: pgmap v2718: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 952 B/s wr, 11 op/s 2023-03-17T10:18:34.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: pgmap v2719: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T10:18:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:18:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:25 smithi035 ceph-mon[92535]: pgmap v2720: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-03-17T10:18:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:27 smithi035 ceph-mon[92535]: pgmap v2721: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 847 B/s wr, 6 op/s 2023-03-17T10:18:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:29 smithi035 ceph-mon[92535]: pgmap v2722: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 847 B/s wr, 11 op/s 2023-03-17T10:18:34.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:31 smithi035 ceph-mon[92535]: pgmap v2723: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 847 B/s wr, 11 op/s 2023-03-17T10:18:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:18:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:18:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:18:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:18:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:18:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:18:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:18:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:18:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 -- 172.21.15.35:0/1696661497 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742e5a39a0 con 0x55742e5acbe0 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb8e9f700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5ad4f0 0x55742e5aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 0x55742e5b2f80 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8019000 tx=0x7fcfa800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65ffac2b512bb92 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.986+0000 7fcf9affd700 1 -- 172.21.15.35:0/1696661497 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8020040 con 0x55742e5acbe0 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcf9affd700 1 -- 172.21.15.35:0/1696661497 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa8015040 con 0x55742e5acbe0 2023-03-17T10:18:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcf9affd700 1 -- 172.21.15.35:0/1696661497 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80038c0 con 0x55742e5acbe0 2023-03-17T10:18:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1696661497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 msgr2=0x55742e5b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 0x55742e5b2f80 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8019000 tx=0x7fcfa800b410 comp rx=0 tx=0).stop 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1696661497 shutdown_connections 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5ad4f0 0x55742e5aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5a7960 0x55742e5b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1696661497 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5acbe0 0x55742e5b2f80 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1696661497 >> 172.21.15.35:0/1696661497 conn(0x55742e4046b0 msgr2=0x55742e5a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1696661497 shutdown_connections 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.987+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1696661497 wait complete. 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.988+0000 7fcfc6a8fb80 1 -- start start 2023-03-17T10:18:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.988+0000 7fcfc6a8fb80 1 Processor -- start 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 0x55742e5b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5acbe0 0x55742e5b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e60def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5b6c80 con 0x55742e5ad4f0 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e5b6df0 con 0x55742e5acbe0 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742e60e4b0 con 0x55742e5a7960 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfc6a8fb80 10 client.0 _ll_register_callbacks cb 0x55742e39f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb8e9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e60def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 0x55742e5b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 0x55742e5b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:41480/0 (socket says 172.21.15.35:41480) 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb8e9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e60def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49718/0 (socket says 172.21.15.35:49718) 2023-03-17T10:18:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 -- 172.21.15.35:0/1685632632 learned_addr learned my addr 172.21.15.35:0/1685632632 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5acbe0 0x55742e5b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 -- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5acbe0 msgr2=0x55742e5b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5acbe0 0x55742e5b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 -- 172.21.15.35:0/1685632632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 msgr2=0x55742e60def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e60def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 -- 172.21.15.35:0/1685632632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55742e37b5d0 con 0x55742e5a7960 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcfb3fff700 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 0x55742e5b5f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4012f60 tx=0x7fcfa4012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d8604b9dd3d907 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.989+0000 7fcf937fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcf937fe700 1 -- 172.21.15.35:0/1685632632 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400f6f0 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcf937fe700 1 -- 172.21.15.35:0/1685632632 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcfa4005030 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55742e5771e0 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcf937fe700 1 -- 172.21.15.35:0/1685632632 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa40051f0 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 10 client.27823 fetch_fsmap learned FSMap version 39 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55742e310c00 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcf937fe700 1 -- 172.21.15.35:0/1685632632 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55742e5771e0 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcf937fe700 1 -- 172.21.15.35:0/1685632632 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcfa4025070 con 0x55742e5a7960 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 10 client.27823 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 10 client.27823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 20 client.27823 populate_metadata read hostname 'smithi035' 2023-03-17T10:18:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e61e680 0x55742e620a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 4 client.27823 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55742e37df00 con 0x55742e61e680 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.990+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e61e680 0x55742e620a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.991+0000 7fcfb37fe700 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e61e680 0x55742e620a90 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e68e7c9d8ef85ca8 server_cookie=960c121a0cc2eef8 in_seq=0 out_seq=0 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.991+0000 7fcf937fe700 10 client.27823 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcf937fe700 1 -- 172.21.15.35:0/1685632632 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55742e37df00 con 0x55742e61e680 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcf937fe700 10 client.27823 handle_command_reply: tid=0 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 client.27823 shutdown 2023-03-17T10:18:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 msgr2=0x55742e5b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 0x55742e5b5f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4012f60 tx=0x7fcfa4012f90 comp rx=0 tx=0).stop 2023-03-17T10:18:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 shutdown_connections 2023-03-17T10:18:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55742e61e680 0x55742e620a90 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:35.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55742e5ad4f0 0x55742e60def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55742e5a7960 0x55742e5b5f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcf937fe700 0 client.27823 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 --2- 172.21.15.35:0/1685632632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55742e5acbe0 0x55742e5b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 >> 172.21.15.35:0/1685632632 conn(0x55742e4046b0 msgr2=0x55742e5aa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 shutdown_connections 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 1 -- 172.21.15.35:0/1685632632 wait complete. 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfc6a8fb80 20 client.27823 trim_cache size 0 max 16384 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9c09f640 msgr2=0x7fcf9c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfba902700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9c09f640 0x7fcf9c0a1af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4005950 tx=0x7fcfa40058e0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 msgr2=0x7fcfb41a2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.996+0000 7fcfba902700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb41a2270 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009380 tx=0x7fcfac0093b0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 shutdown_connections 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcf9c09f640 0x7fcf9c0a1af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcfb4104390 0x7fcfb41a2270 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40ff350 0x7fcfb41971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 --2- 172.21.15.35:0/1783200262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb40ffcf0 0x7fcfb4197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 >> 172.21.15.35:0/1783200262 conn(0x7fcfb4076330 msgr2=0x7fcfb40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 shutdown_connections 2023-03-17T10:18:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:55:47.997+0000 7fcfba902700 1 -- 172.21.15.35:0/1783200262 wait complete. 2023-03-17T10:18:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 -- 172.21.15.35:0/790525515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 msgr2=0x7f16e40ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 --2- 172.21.15.35:0/790525515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e40ff780 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f16e00099c0 tx=0x7f16e0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 -- 172.21.15.35:0/790525515 shutdown_connections 2023-03-17T10:18:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 --2- 172.21.15.35:0/790525515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e41043f0 0x7f16e410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 --2- 172.21.15.35:0/790525515 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e40ff780 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 --2- 172.21.15.35:0/790525515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16e40ffd50 0x7f16e4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:37.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 -- 172.21.15.35:0/790525515 >> 172.21.15.35:0/790525515 conn(0x7f16e4075f60 msgr2=0x7f16e4076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:37.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 -- 172.21.15.35:0/790525515 shutdown_connections 2023-03-17T10:18:37.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.111+0000 7f16ec423700 1 -- 172.21.15.35:0/790525515 wait complete. 2023-03-17T10:18:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 Processor -- start 2023-03-17T10:18:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 -- start start 2023-03-17T10:18:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e4197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e40ffd50 0x7f16e4197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16e41043f0 0x7f16e41a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4197f90 con 0x7f16e40ff3b0 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e41a26d0 con 0x7f16e40ffd50 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ec423700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e41a2890 con 0x7f16e41043f0 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e4197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e4197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49726/0 (socket says 172.21.15.35:49726) 2023-03-17T10:18:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 -- 172.21.15.35:0/1475198790 learned_addr learned my addr 172.21.15.35:0/1475198790 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16e41043f0 0x7f16e41a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16e99be700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e40ffd50 0x7f16e4197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 -- 172.21.15.35:0/1475198790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16e41043f0 msgr2=0x7f16e41a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16e41043f0 0x7f16e41a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 -- 172.21.15.35:0/1475198790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e40ffd50 msgr2=0x7f16e4197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e40ffd50 0x7f16e4197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.112+0000 7f16ea1bf700 1 -- 172.21.15.35:0/1475198790 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4009520 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.113+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e4197110 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f16e0005910 tx=0x7f16e0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.113+0000 7f16db7fe700 1 -- 172.21.15.35:0/1475198790 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e001d070 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.113+0000 7f16db7fe700 1 -- 172.21.15.35:0/1475198790 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16e0022470 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.113+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00095f0 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.113+0000 7f16db7fe700 1 -- 172.21.15.35:0/1475198790 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0017650 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.113+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e410f060 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.115+0000 7f16db7fe700 1 -- 172.21.15.35:0/1475198790 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f16e00225e0 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.116+0000 7f16db7fe700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f16d009f640 0x7f16d00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.116+0000 7f16db7fe700 1 -- 172.21.15.35:0/1475198790 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f16e00cb520 con 0x7f16e40ff3b0 2023-03-17T10:18:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.116+0000 7f16e99be700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f16d009f640 0x7f16d00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.116+0000 7f16f85b0b80 1 Processor -- start 2023-03-17T10:18:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.116+0000 7f16e99be700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f16d009f640 0x7f16d00a1af0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f16e4069490 tx=0x7f16d4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.116+0000 7f16f85b0b80 1 -- start start 2023-03-17T10:18:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d84fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 0x5560c0d7f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d7f960 0x5560c0d7fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0c86010 con 0x5560c0d7f960 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0cd8950 con 0x5560c0d84be0 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0cd1de0 con 0x5560c0d854f0 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16ea9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d7f960 0x5560c0d7fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 0x5560c0d7f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 0x5560c0d7f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:41502/0 (socket says 172.21.15.35:41502) 2023-03-17T10:18:41.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 -- 172.21.15.35:0/48037817 learned_addr learned my addr 172.21.15.35:0/48037817 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16ea1bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d84fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 -- 172.21.15.35:0/48037817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 msgr2=0x5560c0d84fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d84fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 -- 172.21.15.35:0/48037817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d7f960 msgr2=0x5560c0d7fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d7f960 0x5560c0d7fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:42.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 -- 172.21.15.35:0/48037817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560c0b535d0 con 0x5560c0d854f0 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d7f960 0x5560c0d7fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.117+0000 7f16e99be700 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 0x5560c0d7f420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16d400e560 tx=0x7f16d4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7f737e68f16e97 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16d8dae700 1 -- 172.21.15.35:0/48037817 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4026430 con 0x5560c0d854f0 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16d8dae700 1 -- 172.21.15.35:0/48037817 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16d4021070 con 0x5560c0d854f0 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16d8dae700 1 -- 172.21.15.35:0/48037817 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d401d650 con 0x5560c0d854f0 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 -- 172.21.15.35:0/48037817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 msgr2=0x5560c0d7f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 0x5560c0d7f420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16d400e560 tx=0x7f16d4014000 comp rx=0 tx=0).stop 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 -- 172.21.15.35:0/48037817 shutdown_connections 2023-03-17T10:18:42.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d7f960 0x5560c0d7fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d84fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/48037817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d854f0 0x5560c0d7f420 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.118+0000 7f16f85b0b80 1 -- 172.21.15.35:0/48037817 >> 172.21.15.35:0/48037817 conn(0x5560c0bdc6b0 msgr2=0x5560c0d79a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 -- 172.21.15.35:0/48037817 shutdown_connections 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 -- 172.21.15.35:0/48037817 wait complete. 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 -- start start 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 Processor -- start 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0d887c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d88d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:44.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d89240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:44.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0b558c0 con 0x5560c0d854f0 2023-03-17T10:18:44.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0d8b960 con 0x5560c0d84be0 2023-03-17T10:18:44.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0d95060 con 0x5560c0d7f960 2023-03-17T10:18:44.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16f85b0b80 10 client.0 _ll_register_callbacks cb 0x5560c0b77230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:18:44.414 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:33 smithi035 ceph-mon[92535]: pgmap v2724: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:18:44.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16ea9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d89240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16e99be700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d88d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16ea1bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0d887c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16ea9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d89240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49744/0 (socket says 172.21.15.35:49744) 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.119+0000 7f16ea9c0700 1 -- 172.21.15.35:0/888638264 learned_addr learned my addr 172.21.15.35:0/888638264 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea9c0700 1 -- 172.21.15.35:0/888638264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 msgr2=0x5560c0d887c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0d887c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea9c0700 1 -- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 msgr2=0x5560c0d88d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d88d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea9c0700 1 -- 172.21.15.35:0/888638264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d4017070 con 0x5560c0d854f0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0d887c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d89240 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f16dc011ef0 tx=0x7f16dc011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecdf8e78dec8291 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16cdffb700 1 -- 172.21.15.35:0/888638264 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00e040 con 0x5560c0d854f0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560c0c94390 con 0x5560c0d854f0 2023-03-17T10:18:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16cdffb700 1 -- 172.21.15.35:0/888638264 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f16dc003c00 con 0x5560c0d854f0 2023-03-17T10:18:45.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16cdffb700 1 -- 172.21.15.35:0/888638264 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16dc0093a0 con 0x5560c0d854f0 2023-03-17T10:18:46.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16f85b0b80 10 client.18528 fetch_fsmap learned FSMap version 39 2023-03-17T10:18:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5560c0affd80 con 0x5560c0d854f0 2023-03-17T10:18:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16cdffb700 1 -- 172.21.15.35:0/888638264 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5560c0c94390 con 0x5560c0d854f0 2023-03-17T10:18:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16cdffb700 1 -- 172.21.15.35:0/888638264 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f16dc004030 con 0x5560c0d854f0 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16f85b0b80 10 client.18528 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.120+0000 7f16f85b0b80 10 client.18528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16f85b0b80 20 client.18528 populate_metadata read hostname 'smithi035' 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0d992b0 0x5560c0d9b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16f85b0b80 4 client.18528 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560c0ca0600 con 0x5560c0d992b0 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0d992b0 0x5560c0d9b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16cdffb700 10 client.18528 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.121+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0d992b0 0x5560c0d9b6c0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e48c947c02533d server_cookie=40de0a76df8af2e3 in_seq=0 out_seq=0 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16cdffb700 1 -- 172.21.15.35:0/888638264 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5560c0ca0600 con 0x5560c0d992b0 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16cdffb700 10 client.18528 handle_command_reply: tid=0 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 client.18528 shutdown 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 msgr2=0x5560c0d89240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d89240 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f16dc011ef0 tx=0x7f16dc011f20 comp rx=0 tx=0).stop 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 shutdown_connections 2023-03-17T10:18:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0d992b0 0x5560c0d9b6c0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d89240 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0d887c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/888638264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d84be0 0x5560c0d88d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 >> 172.21.15.35:0/888638264 conn(0x5560c0bdc6b0 msgr2=0x5560c0d7e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16cdffb700 0 client.18528 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 shutdown_connections 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 1 -- 172.21.15.35:0/888638264 wait complete. 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.122+0000 7f16f85b0b80 20 client.18528 trim_cache size 0 max 16384 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.137+0000 7f16f85b0b80 1 Processor -- start 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.137+0000 7f16f85b0b80 1 -- start start 2023-03-17T10:18:48.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d7f960 0x5560c0d79ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d84be0 0x5560c0d8ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0d7bc30 con 0x5560c0d854f0 2023-03-17T10:18:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0d750f0 con 0x5560c0d7f960 2023-03-17T10:18:50.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0d7a000 con 0x5560c0d84be0 2023-03-17T10:18:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d826b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49752/0 (socket says 172.21.15.35:49752) 2023-03-17T10:18:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 -- 172.21.15.35:0/490703833 learned_addr learned my addr 172.21.15.35:0/490703833 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:18:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d7f960 0x5560c0d79ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16e99be700 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d84be0 0x5560c0d8ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:18:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 -- 172.21.15.35:0/490703833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d84be0 msgr2=0x5560c0d8ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d84be0 0x5560c0d8ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 -- 172.21.15.35:0/490703833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d7f960 msgr2=0x5560c0d79ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:18:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d7f960 0x5560c0d79ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 -- 172.21.15.35:0/490703833 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560c0c98130 con 0x5560c0d854f0 2023-03-17T10:18:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d826b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f16dc011450 tx=0x7f16dc004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be406c2775fa4a42 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:18:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16d95af700 1 -- 172.21.15.35:0/490703833 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00e030 con 0x5560c0d854f0 2023-03-17T10:18:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16d95af700 1 -- 172.21.15.35:0/490703833 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16dc00f040 con 0x5560c0d854f0 2023-03-17T10:18:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.138+0000 7f16d95af700 1 -- 172.21.15.35:0/490703833 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc013ca0 con 0x5560c0d854f0 2023-03-17T10:18:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 -- 172.21.15.35:0/490703833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 msgr2=0x5560c0d826b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:18:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d826b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f16dc011450 tx=0x7f16dc004a00 comp rx=0 tx=0).stop 2023-03-17T10:18:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 -- 172.21.15.35:0/490703833 shutdown_connections 2023-03-17T10:18:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d854f0 0x5560c0d826b0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d7f960 0x5560c0d79ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/490703833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d84be0 0x5560c0d8ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:18:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 -- 172.21.15.35:0/490703833 >> 172.21.15.35:0/490703833 conn(0x5560c0bdc6b0 msgr2=0x5560c0d953e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 -- 172.21.15.35:0/490703833 shutdown_connections 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.139+0000 7f16f85b0b80 1 -- 172.21.15.35:0/490703833 wait complete. 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 -- start start 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 Processor -- start 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0de10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 0x5560c0de1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d854f0 0x5560c0de1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0dec250 con 0x5560c0d84be0 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0dec390 con 0x5560c0d854f0 2023-03-17T10:18:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560c0dec550 con 0x5560c0d7f960 2023-03-17T10:18:58.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16f85b0b80 10 client.0 _ll_register_callbacks cb 0x5560c0b77230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:19:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 0x5560c0de1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 0x5560c0de1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49756/0 (socket says 172.21.15.35:49756) 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 -- 172.21.15.35:0/2224481418 learned_addr learned my addr 172.21.15.35:0/2224481418 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d854f0 0x5560c0de1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0de10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 -- 172.21.15.35:0/2224481418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 msgr2=0x5560c0de10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0de10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 -- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d854f0 msgr2=0x5560c0de1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d854f0 0x5560c0de1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16e99be700 1 -- 172.21.15.35:0/2224481418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560c0affd80 con 0x5560c0d84be0 2023-03-17T10:19:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.140+0000 7f16ea9c0700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d854f0 0x5560c0de1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16e99be700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 0x5560c0de1620 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f16d400eb50 tx=0x7f16d4009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266ee704dc46bf85 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16cdffb700 1 -- 172.21.15.35:0/2224481418 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4031db0 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16cdffb700 1 -- 172.21.15.35:0/2224481418 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(217..217 src has 1..217) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f16d4005040 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560c0d4f1e0 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16cdffb700 1 -- 172.21.15.35:0/2224481418 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d4005200 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 10 client.18534 fetch_fsmap learned FSMap version 39 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5560c0b261f0 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16cdffb700 1 -- 172.21.15.35:0/2224481418 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5560c0d4f1e0 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16cdffb700 1 -- 172.21.15.35:0/2224481418 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 39) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f16d4026430 con 0x5560c0d84be0 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 10 client.18534 fetch_fsmap finished waiting for FSMap version 39 2023-03-17T10:19:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 10 client.18534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:19:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 20 client.18534 populate_metadata read hostname 'smithi035' 2023-03-17T10:19:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0dedc30 0x5560c0df0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 4 client.18534 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:19:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.141+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5560c0b55f00 con 0x5560c0dedc30 2023-03-17T10:19:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.142+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0dedc30 0x5560c0df0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.142+0000 7f16cdffb700 10 client.18534 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:01.142+0000 7f16ea1bf700 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0dedc30 0x5560c0df0040 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8875357f6eac05 server_cookie=c866f3041c20a935 in_seq=0 out_seq=0 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.299+0000 7f16cdffb700 1 -- 172.21.15.35:0/2224481418 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5560c0b55f00 con 0x5560c0dedc30 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.299+0000 7f16cdffb700 10 client.18534 handle_command_reply: tid=0 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 client.18534 shutdown 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 msgr2=0x5560c0de1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 0x5560c0de1620 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f16d400eb50 tx=0x7f16d4009c10 comp rx=0 tx=0).stop 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 shutdown_connections 2023-03-17T10:19:07.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5560c0dedc30 0x5560c0df0040 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5560c0d854f0 0x5560c0de1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560c0d7f960 0x5560c0de10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16cdffb700 0 client.18534 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 --2- 172.21.15.35:0/2224481418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5560c0d84be0 0x5560c0de1620 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 >> 172.21.15.35:0/2224481418 conn(0x5560c0bdc6b0 msgr2=0x5560c0d826b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:08.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 shutdown_connections 2023-03-17T10:19:08.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 1 -- 172.21.15.35:0/2224481418 wait complete. 2023-03-17T10:19:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.300+0000 7f16f85b0b80 20 client.18534 trim_cache size 0 max 16384 2023-03-17T10:19:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f16d009f640 msgr2=0x7f16d00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f16d009f640 0x7f16d00a1af0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f16e4069490 tx=0x7f16d4009260 comp rx=0 tx=0).stop 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 msgr2=0x7f16e4197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e4197110 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f16e0005910 tx=0x7f16e0009580 comp rx=0 tx=0).stop 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 shutdown_connections 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f16d009f640 0x7f16d00a1af0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16e41043f0 0x7f16e41a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16e40ff3b0 0x7f16e4197110 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 --2- 172.21.15.35:0/1475198790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e40ffd50 0x7f16e4197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 >> 172.21.15.35:0/1475198790 conn(0x7f16e4075f60 msgr2=0x7f16e4102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 shutdown_connections 2023-03-17T10:19:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:56:03.301+0000 7f16ec423700 1 -- 172.21.15.35:0/1475198790 wait complete. 2023-03-17T10:19:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 -- 172.21.15.35:0/666949427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b00ff350 msgr2=0x7f83b00ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 --2- 172.21.15.35:0/666949427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b00ff350 0x7f83b00ff720 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f83a00099c0 tx=0x7f83a0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:19:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 -- 172.21.15.35:0/666949427 shutdown_connections 2023-03-17T10:19:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 --2- 172.21.15.35:0/666949427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b0104390 0x7f83b010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 --2- 172.21.15.35:0/666949427 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b00ff350 0x7f83b00ff720 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 --2- 172.21.15.35:0/666949427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b00ffcf0 0x7f83b0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 -- 172.21.15.35:0/666949427 >> 172.21.15.35:0/666949427 conn(0x7f83b0076330 msgr2=0x7f83b0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 -- 172.21.15.35:0/666949427 shutdown_connections 2023-03-17T10:19:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.424+0000 7f83b4b23700 1 -- 172.21.15.35:0/666949427 wait complete. 2023-03-17T10:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 Processor -- start 2023-03-17T10:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 -- start start 2023-03-17T10:19:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b00ff350 0x7f83b0100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00ffcf0 0x7f83b0101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 0x7f83b01a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0101b30 con 0x7f83b0104390 2023-03-17T10:19:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01a49b0 con 0x7f83b00ffcf0 2023-03-17T10:19:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83b4b23700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01a4af0 con 0x7f83b00ff350 2023-03-17T10:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83aed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 0x7f83b01a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:13.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83aed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 0x7f83b01a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49792/0 (socket says 172.21.15.35:49792) 2023-03-17T10:19:14.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83aed9d700 1 -- 172.21.15.35:0/2501640534 learned_addr learned my addr 172.21.15.35:0/2501640534 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:14.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.425+0000 7f83ae59c700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b00ff350 0x7f83b0100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:14.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83add9b700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00ffcf0 0x7f83b0101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:14.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83aed9d700 1 -- 172.21.15.35:0/2501640534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b00ff350 msgr2=0x7f83b0100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:14.103 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:35 smithi035 ceph-mon[92535]: pgmap v2725: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83aed9d700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b00ff350 0x7f83b0100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83aed9d700 1 -- 172.21.15.35:0/2501640534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00ffcf0 msgr2=0x7f83b0101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83aed9d700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00ffcf0 0x7f83b0101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83aed9d700 1 -- 172.21.15.35:0/2501640534 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00095f0 con 0x7f83b0104390 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83add9b700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00ffcf0 0x7f83b0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83aed9d700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 0x7f83b01a4470 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f83a800ef60 tx=0x7f83a800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f839f7fe700 1 -- 172.21.15.35:0/2501640534 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8018070 con 0x7f83b0104390 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f839f7fe700 1 -- 172.21.15.35:0/2501640534 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a800f040 con 0x7f83b0104390 2023-03-17T10:19:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b010f000 con 0x7f83b0104390 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f839f7fe700 1 -- 172.21.15.35:0/2501640534 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800cd10 con 0x7f83b0104390 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.426+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b010ee70 con 0x7f83b0104390 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.428+0000 7f839f7fe700 1 -- 172.21.15.35:0/2501640534 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f83a8004ad0 con 0x7f83b0104390 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.429+0000 7f839f7fe700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f839809f6c0 0x7f83980a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.429+0000 7f83ae59c700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f839809f6c0 0x7f83980a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.429+0000 7f839f7fe700 1 -- 172.21.15.35:0/2501640534 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(220..220 src has 1..220) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f83a80ca0f0 con 0x7f83b0104390 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.430+0000 7f83ae59c700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f839809f6c0 0x7f83980a1b70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f83a000b580 tx=0x7f83a0005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.430+0000 7f83c0cb0b80 1 Processor -- start 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.430+0000 7f83c0cb0b80 1 -- start start 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 0x555705b17420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b17960 0x555705b17d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705a1e010 con 0x555705b1d4f0 2023-03-17T10:19:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705a70950 con 0x555705b1cbe0 2023-03-17T10:19:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705a69de0 con 0x555705b17960 2023-03-17T10:19:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 0x555705b17420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:18.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 0x555705b17420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49798/0 (socket says 172.21.15.35:49798) 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 -- 172.21.15.35:0/2940902812 learned_addr learned my addr 172.21.15.35:0/2940902812 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83aed9d700 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b17960 0x555705b17d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83ae59c700 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b1cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 -- 172.21.15.35:0/2940902812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b17960 msgr2=0x555705b17d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b17960 0x555705b17d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 -- 172.21.15.35:0/2940902812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 msgr2=0x555705b1cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b1cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 -- 172.21.15.35:0/2940902812 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557058eb5d0 con 0x555705b1d4f0 2023-03-17T10:19:20.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f83add9b700 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 0x555705b17420 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009cd0 tx=0x7f83a4010370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94d5795a430e538 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f839cff9700 1 -- 172.21.15.35:0/2940902812 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4010bf0 con 0x555705b1d4f0 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.431+0000 7f839cff9700 1 -- 172.21.15.35:0/2940902812 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a40044c0 con 0x555705b1d4f0 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f839cff9700 1 -- 172.21.15.35:0/2940902812 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4003e00 con 0x555705b1d4f0 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/2940902812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 msgr2=0x555705b17420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 0x555705b17420 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009cd0 tx=0x7f83a4010370 comp rx=0 tx=0).stop 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/2940902812 shutdown_connections 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b17960 0x555705b17d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/2940902812 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1d4f0 0x555705b17420 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:20.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/2940902812 >> 172.21.15.35:0/2940902812 conn(0x5557059746b0 msgr2=0x555705b11a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/2940902812 shutdown_connections 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.432+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/2940902812 wait complete. 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 -- start start 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 Processor -- start 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b17960 0x555705b23480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 0x555705b20700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b20d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557058ed8c0 con 0x555705b1cbe0 2023-03-17T10:19:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b214d0 con 0x555705b17960 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b2d030 con 0x555705b1d4f0 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83c0cb0b80 10 client.0 _ll_register_callbacks cb 0x55570590f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83add9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 0x555705b20700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83add9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 0x555705b20700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49804/0 (socket says 172.21.15.35:49804) 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83ae59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b17960 0x555705b23480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83add9b700 1 -- 172.21.15.35:0/3208084358 learned_addr learned my addr 172.21.15.35:0/3208084358 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.433+0000 7f83aed9d700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b20d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83ae59c700 1 -- 172.21.15.35:0/3208084358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 msgr2=0x555705b20d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83ae59c700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b20d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83ae59c700 1 -- 172.21.15.35:0/3208084358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 msgr2=0x555705b20700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83ae59c700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 0x555705b20700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83ae59c700 1 -- 172.21.15.35:0/3208084358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4009900 con 0x555705b17960 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83add9b700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 0x555705b20700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:19:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83ae59c700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b17960 0x555705b23480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f83a0000c00 tx=0x7f83a0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ab7e2d3b241882 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f8395ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:19:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f8395ffb700 1 -- 172.21.15.35:0/3208084358 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0028070 con 0x555705b17960 2023-03-17T10:19:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555705a2c390 con 0x555705b17960 2023-03-17T10:19:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f8395ffb700 1 -- 172.21.15.35:0/3208084358 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(220..220 src has 1..220) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f83a000f660 con 0x555705b17960 2023-03-17T10:19:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f8395ffb700 1 -- 172.21.15.35:0/3208084358 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83a000f860 con 0x555705b17960 2023-03-17T10:19:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83c0cb0b80 10 client.27839 fetch_fsmap learned FSMap version 41 2023-03-17T10:19:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.434+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x555705897d80 con 0x555705b17960 2023-03-17T10:19:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f8395ffb700 1 -- 172.21.15.35:0/3208084358 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555705a2c390 con 0x555705b17960 2023-03-17T10:19:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f8395ffb700 1 -- 172.21.15.35:0/3208084358 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f83a0022790 con 0x555705b17960 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83c0cb0b80 10 client.27839 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83c0cb0b80 10 client.27839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83c0cb0b80 20 client.27839 populate_metadata read hostname 'smithi035' 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b310f0 0x555705b33500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83c0cb0b80 4 client.27839 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555705a38600 con 0x555705b310f0 2023-03-17T10:19:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83add9b700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b310f0 0x555705b33500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f8395ffb700 10 client.27839 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.435+0000 7f83add9b700 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b310f0 0x555705b33500 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d728f274a5eb6203 server_cookie=7d69d6b2e97771a1 in_seq=0 out_seq=0 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f8395ffb700 1 -- 172.21.15.35:0/3208084358 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555705a38600 con 0x555705b310f0 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f8395ffb700 10 client.27839 handle_command_reply: tid=0 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 client.27839 shutdown 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b17960 msgr2=0x555705b23480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b17960 0x555705b23480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f83a0000c00 tx=0x7f83a0009310 comp rx=0 tx=0).stop 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 shutdown_connections 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b310f0 0x555705b33500 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b20d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b17960 0x555705b23480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f8395ffb700 0 client.27839 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3208084358 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b1cbe0 0x555705b20700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 >> 172.21.15.35:0/3208084358 conn(0x5557059746b0 msgr2=0x555705b16410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 shutdown_connections 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3208084358 wait complete. 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.436+0000 7f83c0cb0b80 20 client.27839 trim_cache size 0 max 16384 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 Processor -- start 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 -- start start 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b27f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:28.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b23020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b1a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b23c30 con 0x555705b17960 2023-03-17T10:19:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b21ce0 con 0x555705b1cbe0 2023-03-17T10:19:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.451+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b1c840 con 0x555705b1d4f0 2023-03-17T10:19:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b27f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b27f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49810/0 (socket says 172.21.15.35:49810) 2023-03-17T10:19:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 -- 172.21.15.35:0/809519325 learned_addr learned my addr 172.21.15.35:0/809519325 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83add9b700 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b23020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83aed9d700 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b1a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 -- 172.21.15.35:0/809519325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 msgr2=0x555705b1a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b1a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 -- 172.21.15.35:0/809519325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 msgr2=0x555705b23020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b23020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 -- 172.21.15.35:0/809519325 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555705a30130 con 0x555705b17960 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83aed9d700 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b1a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f83ae59c700 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b27f80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f83a0022cc0 tx=0x7f83a00094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31085ee6f4fc595e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:31.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f839d7fa700 1 -- 172.21.15.35:0/809519325 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0028050 con 0x555705b17960 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f839d7fa700 1 -- 172.21.15.35:0/809519325 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a0029040 con 0x555705b17960 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.452+0000 7f839d7fa700 1 -- 172.21.15.35:0/809519325 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000f7e0 con 0x555705b17960 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/809519325 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 msgr2=0x555705b27f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b27f80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f83a0022cc0 tx=0x7f83a00094b0 comp rx=0 tx=0).stop 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/809519325 shutdown_connections 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b1a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b27f80 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/809519325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b23020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/809519325 >> 172.21.15.35:0/809519325 conn(0x5557059746b0 msgr2=0x555705b16a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/809519325 shutdown_connections 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/809519325 wait complete. 2023-03-17T10:19:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 -- start start 2023-03-17T10:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.453+0000 7f83c0cb0b80 1 Processor -- start 2023-03-17T10:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b26150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b26690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b7dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b7e510 con 0x555705b17960 2023-03-17T10:19:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b7e680 con 0x555705b1cbe0 2023-03-17T10:19:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555705b7e840 con 0x555705b1d4f0 2023-03-17T10:19:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 10 client.0 _ll_register_callbacks cb 0x55570590f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:19:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b26150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b26150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49816/0 (socket says 172.21.15.35:49816) 2023-03-17T10:19:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 -- 172.21.15.35:0/3509257792 learned_addr learned my addr 172.21.15.35:0/3509257792 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83add9b700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b26690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83aed9d700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b7dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 -- 172.21.15.35:0/3509257792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 msgr2=0x555705b7dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b7dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 -- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 msgr2=0x555705b26690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b26690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 -- 172.21.15.35:0/3509257792 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555705897d80 con 0x555705b17960 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83aed9d700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b7dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83ae59c700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b26150 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f83a00098e0 tx=0x7f83a0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13882a3552f5e9a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f8395ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:19:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f8395ffb700 1 -- 172.21.15.35:0/3509257792 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0028040 con 0x555705b17960 2023-03-17T10:19:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f8395ffb700 1 -- 172.21.15.35:0/3509257792 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(220..220 src has 1..220) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f83a000f460 con 0x555705b17960 2023-03-17T10:19:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.454+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555705ae71e0 con 0x555705b17960 2023-03-17T10:19:33.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:37 smithi035 ceph-mon[92535]: pgmap v2726: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f8395ffb700 1 -- 172.21.15.35:0/3509257792 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83a00228e0 con 0x555705b17960 2023-03-17T10:19:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 10 client.18558 fetch_fsmap learned FSMap version 41 2023-03-17T10:19:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5557058be1f0 con 0x555705b17960 2023-03-17T10:19:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f8395ffb700 1 -- 172.21.15.35:0/3509257792 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555705ae71e0 con 0x555705b17960 2023-03-17T10:19:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f8395ffb700 1 -- 172.21.15.35:0/3509257792 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f83a0037590 con 0x555705b17960 2023-03-17T10:19:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 10 client.18558 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:19:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 10 client.18558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:19:34.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 20 client.18558 populate_metadata read hostname 'smithi035' 2023-03-17T10:19:34.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b85b10 0x555705b87ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:34.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 4 client.18558 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:19:34.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5557058edf00 con 0x555705b85b10 2023-03-17T10:19:34.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.455+0000 7f83add9b700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b85b10 0x555705b87ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:34.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.456+0000 7f8395ffb700 10 client.18558 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.456+0000 7f83add9b700 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b85b10 0x555705b87ef0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c322602aff49f92 server_cookie=d57ac9878aa20322 in_seq=0 out_seq=0 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f8395ffb700 1 -- 172.21.15.35:0/3509257792 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5557058edf00 con 0x555705b85b10 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f8395ffb700 10 client.18558 handle_command_reply: tid=0 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 client.18558 shutdown 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 msgr2=0x555705b26150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b26150 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f83a00098e0 tx=0x7f83a0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 shutdown_connections 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555705b85b10 0x555705b87ef0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555705b1d4f0 0x555705b7dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f8395ffb700 0 client.18558 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555705b17960 0x555705b26150 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 --2- 172.21.15.35:0/3509257792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555705b1cbe0 0x555705b26690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 >> 172.21.15.35:0/3509257792 conn(0x5557059746b0 msgr2=0x555705b1a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 shutdown_connections 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 1 -- 172.21.15.35:0/3509257792 wait complete. 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.463+0000 7f83c0cb0b80 20 client.18558 trim_cache size 0 max 16384 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f839809f6c0 msgr2=0x7f83980a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f839809f6c0 0x7f83980a1b70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f83a000b580 tx=0x7f83a0005c00 comp rx=0 tx=0).stop 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 msgr2=0x7f83b01a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 0x7f83b01a4470 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f83a800ef60 tx=0x7f83a800ef90 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 shutdown_connections 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f839809f6c0 0x7f83980a1b70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83b0104390 0x7f83b01a4470 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b00ff350 0x7f83b0100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 --2- 172.21.15.35:0/2501640534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00ffcf0 0x7f83b0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 >> 172.21.15.35:0/2501640534 conn(0x7f83b0076330 msgr2=0x7f83b0103030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 shutdown_connections 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:03.464+0000 7f83b4b23700 1 -- 172.21.15.35:0/2501640534 wait complete. 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 -- 172.21.15.35:0/3630254166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 msgr2=0x7fc7980ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3630254166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc7980ff720 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fc7880099c0 tx=0x7fc788009cd0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 -- 172.21.15.35:0/3630254166 shutdown_connections 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3630254166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 0x7fc79810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3630254166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc7980ff720 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3630254166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7980ffcf0 0x7fc798103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 -- 172.21.15.35:0/3630254166 >> 172.21.15.35:0/3630254166 conn(0x7fc798076330 msgr2=0x7fc798076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 -- 172.21.15.35:0/3630254166 shutdown_connections 2023-03-17T10:19:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.582+0000 7fc7a00da700 1 -- 172.21.15.35:0/3630254166 wait complete. 2023-03-17T10:19:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 Processor -- start 2023-03-17T10:19:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 -- start start 2023-03-17T10:19:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc798197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7980ffcf0 0x7fc798197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 0x7fc7981a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798197ed0 con 0x7fc7980ff350 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7981a2610 con 0x7fc7980ffcf0 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc7a00da700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7981a27d0 con 0x7fc798104390 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc79de76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc798197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc79de76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc798197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49830/0 (socket says 172.21.15.35:49830) 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc79de76700 1 -- 172.21.15.35:0/3614274631 learned_addr learned my addr 172.21.15.35:0/3614274631 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc79d675700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7980ffcf0 0x7fc798197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc79e677700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 0x7fc7981a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.583+0000 7fc79de76700 1 -- 172.21.15.35:0/3614274631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 msgr2=0x7fc7981a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc79de76700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 0x7fc7981a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc79de76700 1 -- 172.21.15.35:0/3614274631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7980ffcf0 msgr2=0x7fc798197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc79de76700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7980ffcf0 0x7fc798197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc79de76700 1 -- 172.21.15.35:0/3614274631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880095f0 con 0x7fc7980ff350 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc79e677700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 0x7fc7981a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc79de76700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc798197050 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc788009f50 tx=0x7fc788005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc78effd700 1 -- 172.21.15.35:0/3614274631 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78801d070 con 0x7fc7980ff350 2023-03-17T10:19:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc78effd700 1 -- 172.21.15.35:0/3614274631 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc788003fc0 con 0x7fc7980ff350 2023-03-17T10:19:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79810f000 con 0x7fc7980ff350 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc78effd700 1 -- 172.21.15.35:0/3614274631 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788022d10 con 0x7fc7980ff350 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.584+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79810ee70 con 0x7fc7980ff350 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.586+0000 7fc78effd700 1 -- 172.21.15.35:0/3614274631 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc788022470 con 0x7fc7980ff350 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.587+0000 7fc78effd700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc78409f640 0x7fc7840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.587+0000 7fc79d675700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc78409f640 0x7fc7840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.587+0000 7fc78effd700 1 -- 172.21.15.35:0/3614274631 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc7880cb9b0 con 0x7fc7980ff350 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.588+0000 7fc79d675700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc78409f640 0x7fc7840a1af0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7980688b0 tx=0x7fc79400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.588+0000 7fc7ac267b80 1 Processor -- start 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.588+0000 7fc7ac267b80 1 -- start start 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba4158be0 0x55dba4158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 0x55dba4153420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba405a010 con 0x55dba41594f0 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba40ac950 con 0x55dba4153960 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba40a5de0 con 0x55dba4158be0 2023-03-17T10:19:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 0x55dba4153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 0x55dba4153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49840/0 (socket says 172.21.15.35:49840) 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 -- 172.21.15.35:0/3854614286 learned_addr learned my addr 172.21.15.35:0/3854614286 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79de76700 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba4158be0 0x55dba4158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79e677700 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 -- 172.21.15.35:0/3854614286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba4158be0 msgr2=0x55dba4158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba4158be0 0x55dba4158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 -- 172.21.15.35:0/3854614286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 msgr2=0x55dba4153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 -- 172.21.15.35:0/3854614286 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dba3f275d0 con 0x55dba41594f0 2023-03-17T10:19:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc79d675700 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 0x55dba4153420 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc794010f40 tx=0x7fc794013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6b5f96d4f5ac77 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc783fff700 1 -- 172.21.15.35:0/3854614286 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794011bb0 con 0x55dba41594f0 2023-03-17T10:19:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc783fff700 1 -- 172.21.15.35:0/3854614286 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc794015070 con 0x55dba41594f0 2023-03-17T10:19:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.589+0000 7fc783fff700 1 -- 172.21.15.35:0/3854614286 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79401c610 con 0x55dba41594f0 2023-03-17T10:19:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 -- 172.21.15.35:0/3854614286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 msgr2=0x55dba4153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 0x55dba4153420 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc794010f40 tx=0x7fc794013000 comp rx=0 tx=0).stop 2023-03-17T10:19:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 -- 172.21.15.35:0/3854614286 shutdown_connections 2023-03-17T10:19:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba4158be0 0x55dba4158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/3854614286 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba41594f0 0x55dba4153420 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 -- 172.21.15.35:0/3854614286 >> 172.21.15.35:0/3854614286 conn(0x55dba3fb06b0 msgr2=0x55dba414da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 -- 172.21.15.35:0/3854614286 shutdown_connections 2023-03-17T10:19:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.590+0000 7fc7ac267b80 1 -- 172.21.15.35:0/3854614286 wait complete. 2023-03-17T10:19:45.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 -- start start 2023-03-17T10:19:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 Processor -- start 2023-03-17T10:19:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba415f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:45.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba415c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba3f298c0 con 0x55dba4153960 2023-03-17T10:19:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba415d4a0 con 0x55dba4158be0 2023-03-17T10:19:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba4169030 con 0x55dba41594f0 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc7ac267b80 10 client.0 _ll_register_callbacks cb 0x55dba3f4b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc79de76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba415f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc79de76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba415f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49844/0 (socket says 172.21.15.35:49844) 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc79de76700 1 -- 172.21.15.35:0/2526574915 learned_addr learned my addr 172.21.15.35:0/2526574915 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc79e677700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.591+0000 7fc79d675700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc79de76700 1 -- 172.21.15.35:0/2526574915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 msgr2=0x55dba415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc79de76700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc79de76700 1 -- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 msgr2=0x55dba415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc79de76700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc79de76700 1 -- 172.21.15.35:0/2526574915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc794010c20 con 0x55dba4153960 2023-03-17T10:19:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc79de76700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba415f430 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc788000c00 tx=0x7fc788098f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91d1a59a6e91b36 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7817fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:19:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7817fa700 1 -- 172.21.15.35:0/2526574915 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880b0070 con 0x55dba4153960 2023-03-17T10:19:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7817fa700 1 -- 172.21.15.35:0/2526574915 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc788097870 con 0x55dba4153960 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dba4068390 con 0x55dba4153960 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7817fa700 1 -- 172.21.15.35:0/2526574915 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc78809d070 con 0x55dba4153960 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7ac267b80 10 client.18570 fetch_fsmap learned FSMap version 41 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55dba3ed3d80 con 0x55dba4153960 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7817fa700 1 -- 172.21.15.35:0/2526574915 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dba4068390 con 0x55dba4153960 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7817fa700 1 -- 172.21.15.35:0/2526574915 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc7880a11a0 con 0x55dba4153960 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7ac267b80 10 client.18570 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:19:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.592+0000 7fc7ac267b80 10 client.18570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc7ac267b80 20 client.18570 populate_metadata read hostname 'smithi035' 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba416cd80 0x55dba416f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc7ac267b80 4 client.18570 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dba4074600 con 0x55dba416cd80 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc79d675700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba416cd80 0x55dba416f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc7817fa700 10 client.18570 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.593+0000 7fc79d675700 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba416cd80 0x55dba416f160 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654ff1ad31c9132c server_cookie=d93d2b0f98bad04d in_seq=0 out_seq=0 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7817fa700 1 -- 172.21.15.35:0/2526574915 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55dba4074600 con 0x55dba416cd80 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7817fa700 10 client.18570 handle_command_reply: tid=0 2023-03-17T10:19:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 client.18570 shutdown 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 msgr2=0x55dba415f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba415f430 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc788000c00 tx=0x7fc788098f00 comp rx=0 tx=0).stop 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 shutdown_connections 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba416cd80 0x55dba416f160 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba415f430 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7817fa700 0 client.18570 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/2526574915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 >> 172.21.15.35:0/2526574915 conn(0x55dba3fb06b0 msgr2=0x55dba4152410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 shutdown_connections 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 1 -- 172.21.15.35:0/2526574915 wait complete. 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.594+0000 7fc7ac267b80 20 client.18570 trim_cache size 0 max 16384 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 Processor -- start 2023-03-17T10:19:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 -- start start 2023-03-17T10:19:49.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:39 smithi035 ceph-mon[92535]: pgmap v2727: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:19:49.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:41 smithi035 ceph-mon[92535]: pgmap v2728: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:19:49.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:43 smithi035 ceph-mon[92535]: pgmap v2729: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:19:49.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:45 smithi035 ceph-mon[92535]: pgmap v2730: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:19:51.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:47 smithi035 ceph-mon[92535]: pgmap v2731: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:19:51.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:49 smithi035 ceph-mon[92535]: pgmap v2732: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T10:19:51.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:51 smithi035 ceph-mon[92535]: pgmap v2733: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:53 smithi035 ceph-mon[92535]: pgmap v2734: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:55 smithi035 ceph-mon[92535]: pgmap v2735: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:57 smithi035 ceph-mon[92535]: pgmap v2736: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:09:59 smithi035 ceph-mon[92535]: pgmap v2737: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:01 smithi035 ceph-mon[92535]: pgmap v2738: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:51.299 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:03 smithi035 ceph-mon[92535]: pgmap v2739: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:05 smithi035 ceph-mon[92535]: pgmap v2740: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:07 smithi035 ceph-mon[92535]: pgmap v2741: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:09 smithi035 ceph-mon[92535]: osdmap e247: 12 total, 12 up, 12 in 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:09 smithi035 ceph-mon[92535]: pgmap v2743: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:11 smithi035 ceph-mon[92535]: pgmap v2744: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:13 smithi035 ceph-mon[92535]: pgmap v2745: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:15 smithi035 ceph-mon[92535]: pgmap v2746: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:17 smithi035 ceph-mon[92535]: osdmap e248: 12 total, 12 up, 12 in 2023-03-17T10:19:52.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:17 smithi035 ceph-mon[92535]: pgmap v2748: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 970 B/s wr, 7 op/s 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:19 smithi035 ceph-mon[92535]: pgmap v2749: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:21 smithi035 ceph-mon[92535]: pgmap v2750: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:23 smithi035 ceph-mon[92535]: pgmap v2751: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:25 smithi035 ceph-mon[92535]: pgmap v2752: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:19:52.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: pgmap v2753: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T10:19:54.174 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: pgmap v2754: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T10:19:54.174 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:19:54.174 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:29 smithi035 ceph-mon[92535]: pgmap v2755: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T10:19:54.174 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:31 smithi035 ceph-mon[92535]: pgmap v2756: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T10:19:54.174 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:32 smithi035 ceph-mon[92535]: pgmap v2757: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:35 smithi035 ceph-mon[92535]: pgmap v2758: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:37 smithi035 ceph-mon[92535]: pgmap v2759: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:39 smithi035 ceph-mon[92535]: pgmap v2760: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:41 smithi035 ceph-mon[92535]: pgmap v2761: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:42 smithi035 ceph-mon[92535]: pgmap v2762: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:45 smithi035 ceph-mon[92535]: pgmap v2763: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:47 smithi035 ceph-mon[92535]: pgmap v2764: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:49 smithi035 ceph-mon[92535]: pgmap v2765: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:51 smithi035 ceph-mon[92535]: pgmap v2766: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:52 smithi035 ceph-mon[92535]: pgmap v2767: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:55 smithi035 ceph-mon[92535]: pgmap v2768: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:57 smithi035 ceph-mon[92535]: pgmap v2769: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:10:59 smithi035 ceph-mon[92535]: pgmap v2770: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:01 smithi035 ceph-mon[92535]: pgmap v2771: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:19:54.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:02 smithi035 ceph-mon[92535]: pgmap v2772: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:19:54.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:05 smithi035 ceph-mon[92535]: pgmap v2773: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:19:54.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:07 smithi035 ceph-mon[92535]: pgmap v2774: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:19:54.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:09 smithi035 ceph-mon[92535]: pgmap v2775: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:19:54.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:10 smithi035 ceph-mon[92535]: osdmap e249: 12 total, 12 up, 12 in 2023-03-17T10:19:54.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:11 smithi035 ceph-mon[92535]: pgmap v2777: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:19:54.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:12 smithi035 ceph-mon[92535]: pgmap v2778: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:19:55.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:15 smithi035 ceph-mon[92535]: pgmap v2779: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:19:55.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:17 smithi035 ceph-mon[92535]: pgmap v2780: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:19:55.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:17 smithi035 ceph-mon[92535]: osdmap e250: 12 total, 12 up, 12 in 2023-03-17T10:19:55.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:19 smithi035 ceph-mon[92535]: pgmap v2782: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T10:19:55.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:21 smithi035 ceph-mon[92535]: pgmap v2783: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:19:55.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:22 smithi035 ceph-mon[92535]: pgmap v2784: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:19:55.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:25 smithi035 ceph-mon[92535]: pgmap v2785: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:19:55.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:27 smithi035 ceph-mon[92535]: pgmap v2786: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:19:55.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:19:55.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:29 smithi035 ceph-mon[92535]: pgmap v2787: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-17T10:19:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:19:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:19:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:19:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:19:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:19:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4163f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 0x55dba415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:19:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba415d6e0 con 0x55dba4158be0 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba414ab60 con 0x55dba4153960 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba41490d0 con 0x55dba41594f0 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc79d675700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 0x55dba415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc79d675700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 0x55dba415bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49854/0 (socket says 172.21.15.35:49854) 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.609+0000 7fc79d675700 1 -- 172.21.15.35:0/830657726 learned_addr learned my addr 172.21.15.35:0/830657726 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79de76700 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4163f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79d675700 1 -- 172.21.15.35:0/830657726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 msgr2=0x55dba415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79d675700 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79d675700 1 -- 172.21.15.35:0/830657726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 msgr2=0x55dba4163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79d675700 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4163f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79d675700 1 -- 172.21.15.35:0/830657726 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dba406c130 con 0x55dba4158be0 2023-03-17T10:19:59.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79de76700 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4163f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc79d675700 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 0x55dba415bf20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc794005d90 tx=0x7fc79400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec902ddd29291dac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc78cff9700 1 -- 172.21.15.35:0/830657726 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79402c040 con 0x55dba4158be0 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc78cff9700 1 -- 172.21.15.35:0/830657726 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc794015040 con 0x55dba4158be0 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc78cff9700 1 -- 172.21.15.35:0/830657726 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79401e680 con 0x55dba4158be0 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc7ac267b80 1 -- 172.21.15.35:0/830657726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 msgr2=0x55dba415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 0x55dba415bf20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fc794005d90 tx=0x7fc79400b480 comp rx=0 tx=0).stop 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc7ac267b80 1 -- 172.21.15.35:0/830657726 shutdown_connections 2023-03-17T10:19:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.610+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4153960 0x55dba4163f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/830657726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4158be0 0x55dba415bf20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- 172.21.15.35:0/830657726 >> 172.21.15.35:0/830657726 conn(0x55dba3fb06b0 msgr2=0x55dba4168710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- 172.21.15.35:0/830657726 shutdown_connections 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- 172.21.15.35:0/830657726 wait complete. 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- start start 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 Processor -- start 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba41639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba4163f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba4161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba4162670 con 0x55dba4153960 2023-03-17T10:20:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba41627e0 con 0x55dba4158be0 2023-03-17T10:20:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dba41629a0 con 0x55dba41594f0 2023-03-17T10:20:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc7ac267b80 10 client.0 _ll_register_callbacks cb 0x55dba3f4b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:20:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc79de76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba41639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.611+0000 7fc79de76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba41639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49858/0 (socket says 172.21.15.35:49858) 2023-03-17T10:20:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 -- 172.21.15.35:0/379703006 learned_addr learned my addr 172.21.15.35:0/379703006 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:20:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79d675700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba4163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79e677700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba4161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 -- 172.21.15.35:0/379703006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 msgr2=0x55dba4161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba4161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 -- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 msgr2=0x55dba4163f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba4163f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 -- 172.21.15.35:0/379703006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dba3f275d0 con 0x55dba4153960 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79e677700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba4161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc79de76700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba41639e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fc7880cbc10 tx=0x7fc788005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f57e7256ab7fda server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7817fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:20:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7817fa700 1 -- 172.21.15.35:0/379703006 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7880b0030 con 0x55dba4153960 2023-03-17T10:20:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7817fa700 1 -- 172.21.15.35:0/379703006 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc7880b7290 con 0x55dba4153960 2023-03-17T10:20:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dba41231e0 con 0x55dba4153960 2023-03-17T10:20:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7817fa700 1 -- 172.21.15.35:0/379703006 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc78809d040 con 0x55dba4153960 2023-03-17T10:20:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7ac267b80 10 client.18576 fetch_fsmap learned FSMap version 41 2023-03-17T10:20:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55dba3efa1f0 con 0x55dba4153960 2023-03-17T10:20:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.612+0000 7fc7817fa700 1 -- 172.21.15.35:0/379703006 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc78807c020 con 0x55dba4153960 2023-03-17T10:20:06.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7817fa700 1 -- 172.21.15.35:0/379703006 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc7880953a0 con 0x55dba4153960 2023-03-17T10:20:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7ac267b80 10 client.18576 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:20:08.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7ac267b80 10 client.18576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7ac267b80 20 client.18576 populate_metadata read hostname 'smithi035' 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba41c1880 0x55dba41c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7ac267b80 4 client.18576 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dba3f29f00 con 0x55dba41c1880 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc79d675700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba41c1880 0x55dba41c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc7817fa700 10 client.18576 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.613+0000 7fc79d675700 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba41c1880 0x55dba41c3c60 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b42afd2e147cab server_cookie=1d98657e09fd7214 in_seq=0 out_seq=0 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7817fa700 1 -- 172.21.15.35:0/379703006 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dba3f29f00 con 0x55dba41c1880 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7817fa700 10 client.18576 handle_command_reply: tid=0 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 client.18576 shutdown 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 msgr2=0x55dba41639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba41639e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fc7880cbc10 tx=0x7fc788005fb0 comp rx=0 tx=0).stop 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 shutdown_connections 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dba41c1880 0x55dba41c3c60 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:08.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dba41594f0 0x55dba4161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dba4153960 0x55dba41639e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 --2- 172.21.15.35:0/379703006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dba4158be0 0x55dba4163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7817fa700 0 client.18576 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:20:08.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 >> 172.21.15.35:0/379703006 conn(0x55dba3fb06b0 msgr2=0x55dba41566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 shutdown_connections 2023-03-17T10:20:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.621+0000 7fc7ac267b80 1 -- 172.21.15.35:0/379703006 wait complete. 2023-03-17T10:20:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7ac267b80 20 client.18576 trim_cache size 0 max 16384 2023-03-17T10:20:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc78409f640 msgr2=0x7fc7840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc78409f640 0x7fc7840a1af0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7980688b0 tx=0x7fc79400b410 comp rx=0 tx=0).stop 2023-03-17T10:20:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 msgr2=0x7fc798197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc798197050 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc788009f50 tx=0x7fc788005740 comp rx=0 tx=0).stop 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 shutdown_connections 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc78409f640 0x7fc7840a1af0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc798104390 0x7fc7981a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc7980ff350 0x7fc798197050 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 --2- 172.21.15.35:0/3614274631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7980ffcf0 0x7fc798197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 >> 172.21.15.35:0/3614274631 conn(0x7fc798076330 msgr2=0x7fc7980fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 shutdown_connections 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:16.622+0000 7fc7a00da700 1 -- 172.21.15.35:0/3614274631 wait complete. 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3764432512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf780fef50 msgr2=0x7fbf780ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3764432512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf780fef50 0x7fbf780ff320 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009990 tx=0x7fbf74009ca0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3764432512 shutdown_connections 2023-03-17T10:20:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3764432512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf7810cb00 0x7fbf7810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3764432512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf780fef50 0x7fbf780ff320 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3764432512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780ff860 0x7fbf7810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3764432512 >> 172.21.15.35:0/3764432512 conn(0x7fbf78076330 msgr2=0x7fbf78076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3764432512 shutdown_connections 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3764432512 wait complete. 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.746+0000 7fbf7fb50700 1 Processor -- start 2023-03-17T10:20:13.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 -- start start 2023-03-17T10:20:14.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780fef50 0x7fbf78198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf780ff860 0x7fbf781989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 0x7fbf7819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7819d440 con 0x7fbf7810cb00 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7819d5b0 con 0x7fbf780ff860 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7fb50700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7819d770 con 0x7fbf780fef50 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 0x7fbf7819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 0x7fbf7819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49876/0 (socket says 172.21.15.35:49876) 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3960823825 learned_addr learned my addr 172.21.15.35:0/3960823825 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:20:14.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf780ff860 0x7fbf781989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780fef50 0x7fbf78198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3960823825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780fef50 msgr2=0x7fbf78198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780fef50 0x7fbf78198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3960823825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf780ff860 msgr2=0x7fbf781989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf780ff860 0x7fbf781989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3960823825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf740095f0 con 0x7fbf7810cb00 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780fef50 0x7fbf78198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.747+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 0x7fbf7819ce00 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fbf70007ce0 tx=0x7fbf7000d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.748+0000 7fbf6effd700 1 -- 172.21.15.35:0/3960823825 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70004db0 con 0x7fbf7810cb00 2023-03-17T10:20:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.748+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf78112320 con 0x7fbf7810cb00 2023-03-17T10:20:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.748+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf78112190 con 0x7fbf7810cb00 2023-03-17T10:20:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.748+0000 7fbf6effd700 1 -- 172.21.15.35:0/3960823825 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf7000f040 con 0x7fbf7810cb00 2023-03-17T10:20:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.748+0000 7fbf6effd700 1 -- 172.21.15.35:0/3960823825 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf700058c0 con 0x7fbf7810cb00 2023-03-17T10:20:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.750+0000 7fbf6effd700 1 -- 172.21.15.35:0/3960823825 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbf70005000 con 0x7fbf7810cb00 2023-03-17T10:20:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.750+0000 7fbf6effd700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbf6409f640 0x7fbf640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.750+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbf6409f640 0x7fbf640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.750+0000 7fbf6effd700 1 -- 172.21.15.35:0/3960823825 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbf700c9ec0 con 0x7fbf7810cb00 2023-03-17T10:20:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.751+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbf6409f640 0x7fbf640a1af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400b2e0 tx=0x7fbf74005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.751+0000 7fbf8bcddb80 1 Processor -- start 2023-03-17T10:20:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 -- start start 2023-03-17T10:20:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 0x559733631fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x55973362c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973362cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733533010 con 0x559733631be0 2023-03-17T10:20:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733585950 con 0x55973362c960 2023-03-17T10:20:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55973357ede0 con 0x5597336324f0 2023-03-17T10:20:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 0x559733631fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 0x559733631fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49880/0 (socket says 172.21.15.35:49880) 2023-03-17T10:20:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/2702247123 learned_addr learned my addr 172.21.15.35:0/2702247123 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:20:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x55973362c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973362cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/2702247123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 msgr2=0x55973362c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x55973362c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/2702247123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 msgr2=0x55973362cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973362cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/2702247123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597334005d0 con 0x559733631be0 2023-03-17T10:20:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973362cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:20:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.752+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 0x559733631fb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400bbf0 tx=0x7fbf7401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb3da542ab8d598 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf63fff700 1 -- 172.21.15.35:0/2702247123 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7401e070 con 0x559733631be0 2023-03-17T10:20:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf63fff700 1 -- 172.21.15.35:0/2702247123 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf740056e0 con 0x559733631be0 2023-03-17T10:20:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf63fff700 1 -- 172.21.15.35:0/2702247123 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74030cb0 con 0x559733631be0 2023-03-17T10:20:26.308 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:20:27.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:20:27.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:20:27.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:20:27.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: pgmap v2788: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T10:20:27.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: pgmap v2789: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T10:20:27.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:20:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/2702247123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 msgr2=0x559733631fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 0x559733631fb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400bbf0 tx=0x7fbf7401e000 comp rx=0 tx=0).stop 2023-03-17T10:20:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/2702247123 shutdown_connections 2023-03-17T10:20:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973362cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559733631be0 0x559733631fb0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/2702247123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x55973362c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:29.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/2702247123 >> 172.21.15.35:0/2702247123 conn(0x5597334896b0 msgr2=0x559733626a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.753+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/2702247123 shutdown_connections 2023-03-17T10:20:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/2702247123 wait complete. 2023-03-17T10:20:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 -- start start 2023-03-17T10:20:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 Processor -- start 2023-03-17T10:20:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x559733638470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733635760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x559733635de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597334028c0 con 0x5597336324f0 2023-03-17T10:20:31.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733636520 con 0x55973362c960 2023-03-17T10:20:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.754+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733642030 con 0x559733631be0 2023-03-17T10:20:31.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf8bcddb80 10 client.0 _ll_register_callbacks cb 0x559733424230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:20:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x559733635de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x559733635de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49890/0 (socket says 172.21.15.35:49890) 2023-03-17T10:20:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3631259025 learned_addr learned my addr 172.21.15.35:0/3631259025 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:20:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x559733638470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733635760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3631259025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 msgr2=0x559733635760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733635760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 msgr2=0x559733638470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x559733638470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/3631259025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7810fab0 con 0x5597336324f0 2023-03-17T10:20:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733635760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:20:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x559733635de0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fbf70093e70 tx=0x7fbf700979f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa3feefbeddf55c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf617fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:20:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf617fa700 1 -- 172.21.15.35:0/3631259025 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70096e60 con 0x5597336324f0 2023-03-17T10:20:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf617fa700 1 -- 172.21.15.35:0/3631259025 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbf70096fc0 con 0x5597336324f0 2023-03-17T10:20:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559733541390 con 0x5597336324f0 2023-03-17T10:20:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf617fa700 1 -- 172.21.15.35:0/3631259025 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf700c72c0 con 0x5597336324f0 2023-03-17T10:20:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf8bcddb80 10 client.18588 fetch_fsmap learned FSMap version 41 2023-03-17T10:20:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.755+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5597333acd80 con 0x5597336324f0 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf617fa700 1 -- 172.21.15.35:0/3631259025 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559733541390 con 0x5597336324f0 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf617fa700 1 -- 172.21.15.35:0/3631259025 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbf700ad070 con 0x5597336324f0 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf8bcddb80 10 client.18588 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf8bcddb80 10 client.18588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf8bcddb80 20 client.18588 populate_metadata read hostname 'smithi035' 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5597336461a0 0x5597336485b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf8bcddb80 4 client.18588 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55973354d600 con 0x5597336461a0 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5597336461a0 0x5597336485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf617fa700 10 client.18588 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.756+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5597336461a0 0x5597336485b0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b382f261e8b92b server_cookie=fe852096b22c87dc in_seq=0 out_seq=0 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf617fa700 1 -- 172.21.15.35:0/3631259025 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55973354d600 con 0x5597336461a0 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf617fa700 10 client.18588 handle_command_reply: tid=0 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 client.18588 shutdown 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 msgr2=0x559733635de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x559733635de0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fbf70093e70 tx=0x7fbf700979f0 comp rx=0 tx=0).stop 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 shutdown_connections 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5597336461a0 0x5597336485b0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x559733635de0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf617fa700 0 client.18588 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:20:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x559733638470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/3631259025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733635760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 >> 172.21.15.35:0/3631259025 conn(0x5597334896b0 msgr2=0x55973362b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.757+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 shutdown_connections 2023-03-17T10:20:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.758+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/3631259025 wait complete. 2023-03-17T10:20:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.758+0000 7fbf8bcddb80 20 client.18588 trim_cache size 0 max 16384 2023-03-17T10:20:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.772+0000 7fbf8bcddb80 1 Processor -- start 2023-03-17T10:20:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 -- start start 2023-03-17T10:20:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973363cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733638010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x55973362f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733623bd0 con 0x5597336324f0 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733636d00 con 0x55973362c960 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55973362c7a0 con 0x559733631be0 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x55973362f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x55973362f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49898/0 (socket says 172.21.15.35:49898) 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/53934662 learned_addr learned my addr 172.21.15.35:0/53934662 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:20:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973363cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/53934662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 msgr2=0x559733638010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733638010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/53934662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 msgr2=0x55973363cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973363cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 -- 172.21.15.35:0/53934662 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55973362d000 con 0x5597336324f0 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973363cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.773+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x55973362f6b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fbf700074d0 tx=0x7fbf70092580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03ed6c4ba13f7fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf6cdae700 1 -- 172.21.15.35:0/53934662 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70096ca0 con 0x5597336324f0 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf6cdae700 1 -- 172.21.15.35:0/53934662 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf70096a60 con 0x5597336324f0 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf6cdae700 1 -- 172.21.15.35:0/53934662 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7009f910 con 0x5597336324f0 2023-03-17T10:20:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/53934662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 msgr2=0x55973362f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x55973362f6b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fbf700074d0 tx=0x7fbf70092580 comp rx=0 tx=0).stop 2023-03-17T10:20:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/53934662 shutdown_connections 2023-03-17T10:20:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5597336324f0 0x55973362f6b0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55973362c960 0x55973363cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/53934662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559733631be0 0x559733638010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/53934662 >> 172.21.15.35:0/53934662 conn(0x5597334896b0 msgr2=0x55973362ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/53934662 shutdown_connections 2023-03-17T10:20:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/53934662 wait complete. 2023-03-17T10:20:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.774+0000 7fbf8bcddb80 1 -- start start 2023-03-17T10:20:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 Processor -- start 2023-03-17T10:20:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 0x55973368e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559733631be0 0x55973368e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x559733692fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733693520 con 0x55973362c960 2023-03-17T10:20:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733693660 con 0x559733631be0 2023-03-17T10:20:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559733693820 con 0x5597336324f0 2023-03-17T10:20:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf8bcddb80 10 client.0 _ll_register_callbacks cb 0x559733424230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:20:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf7d8ec700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 0x55973368e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf7d8ec700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 0x55973368e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49900/0 (socket says 172.21.15.35:49900) 2023-03-17T10:20:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/315206734 learned_addr learned my addr 172.21.15.35:0/315206734 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:20:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.775+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559733631be0 0x55973368e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x559733692fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/315206734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 msgr2=0x559733692fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:47.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x559733692fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559733631be0 msgr2=0x55973368e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:20:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559733631be0 0x55973368e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d8ec700 1 -- 172.21.15.35:0/315206734 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597333acd80 con 0x55973362c960 2023-03-17T10:20:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559733631be0 0x55973368e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:20:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7e0ed700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x559733692fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:20:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf7d8ec700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 0x55973368e180 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fbf740098e0 tx=0x7fbf74030530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a49f5fcf243fbf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:20:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf617fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:20:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf617fa700 1 -- 172.21.15.35:0/315206734 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74036040 con 0x55973362c960 2023-03-17T10:20:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf617fa700 1 -- 172.21.15.35:0/315206734 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbf74038580 con 0x55973362c960 2023-03-17T10:20:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597335fc1e0 con 0x55973362c960 2023-03-17T10:20:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf617fa700 1 -- 172.21.15.35:0/315206734 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf7401e040 con 0x55973362c960 2023-03-17T10:20:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf8bcddb80 10 client.18594 fetch_fsmap learned FSMap version 41 2023-03-17T10:20:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x559733395c00 con 0x55973362c960 2023-03-17T10:20:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.776+0000 7fbf617fa700 1 -- 172.21.15.35:0/315206734 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5597335fc1e0 con 0x55973362c960 2023-03-17T10:20:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf617fa700 1 -- 172.21.15.35:0/315206734 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbf74030820 con 0x55973362c960 2023-03-17T10:20:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf8bcddb80 10 client.18594 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:20:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf8bcddb80 10 client.18594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf8bcddb80 20 client.18594 populate_metadata read hostname 'smithi035' 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55973369abb0 0x55973369cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf8bcddb80 4 client.18594 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559733402f00 con 0x55973369abb0 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55973369abb0 0x55973369cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf617fa700 10 client.18594 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.777+0000 7fbf7d0eb700 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55973369abb0 0x55973369cfc0 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c377eb26de02059e server_cookie=f0f25d1f2bb9913f in_seq=0 out_seq=0 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf617fa700 1 -- 172.21.15.35:0/315206734 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559733402f00 con 0x55973369abb0 2023-03-17T10:20:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf617fa700 10 client.18594 handle_command_reply: tid=0 2023-03-17T10:20:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 client.18594 shutdown 2023-03-17T10:20:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 msgr2=0x55973368e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 0x55973368e180 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fbf740098e0 tx=0x7fbf74030530 comp rx=0 tx=0).stop 2023-03-17T10:20:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 shutdown_connections 2023-03-17T10:20:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55973369abb0 0x55973369cfc0 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5597336324f0 0x559733692fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55973362c960 0x55973368e180 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf617fa700 0 client.18594 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 --2- 172.21.15.35:0/315206734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559733631be0 0x55973368e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 >> 172.21.15.35:0/315206734 conn(0x5597334896b0 msgr2=0x55973362f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 shutdown_connections 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 1 -- 172.21.15.35:0/315206734 wait complete. 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.782+0000 7fbf8bcddb80 20 client.18594 trim_cache size 0 max 16384 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbf6409f640 msgr2=0x7fbf640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbf6409f640 0x7fbf640a1af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400b2e0 tx=0x7fbf74005fb0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 msgr2=0x7fbf7819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 0x7fbf7819ce00 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fbf70007ce0 tx=0x7fbf7000d0d0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 shutdown_connections 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbf6409f640 0x7fbf640a1af0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbf7810cb00 0x7fbf7819ce00 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf780fef50 0x7fbf78198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 --2- 172.21.15.35:0/3960823825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf780ff860 0x7fbf781989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 >> 172.21.15.35:0/3960823825 conn(0x7fbf78076330 msgr2=0x7fbf780fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 shutdown_connections 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:29.783+0000 7fbf7fb50700 1 -- 172.21.15.35:0/3960823825 wait complete. 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 -- 172.21.15.35:0/11862081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f795410a790 msgr2=0x7f795410cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 --2- 172.21.15.35:0/11862081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f795410a790 0x7f795410cbd0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f794c00b0a0 tx=0x7f794c00b3b0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 -- 172.21.15.35:0/11862081 shutdown_connections 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 --2- 172.21.15.35:0/11862081 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f795410a790 0x7f795410cbd0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 --2- 172.21.15.35:0/11862081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7954101270 0x7f7954101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:56.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:32 smithi035 ceph-mon[92535]: pgmap v2790: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-03-17T10:20:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 --2- 172.21.15.35:0/11862081 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101b80 0x7f795410a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:20:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 -- 172.21.15.35:0/11862081 >> 172.21.15.35:0/11862081 conn(0x7f7954076330 msgr2=0x7f7954076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:20:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 -- 172.21.15.35:0/11862081 shutdown_connections 2023-03-17T10:20:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 -- 172.21.15.35:0/11862081 wait complete. 2023-03-17T10:21:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 Processor -- start 2023-03-17T10:21:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.905+0000 7f795c685700 1 -- start start 2023-03-17T10:21:00.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795c685700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101270 0x7f7954198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795c685700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 0x7f79541989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:01.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795c685700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795410a790 0x7f795419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:03.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795c685700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419d470 con 0x7f7954101b80 2023-03-17T10:21:03.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795c685700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419d5e0 con 0x7f7954101270 2023-03-17T10:21:03.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795c685700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419d7a0 con 0x7f795410a790 2023-03-17T10:21:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 0x7f79541989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 0x7f79541989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49916/0 (socket says 172.21.15.35:49916) 2023-03-17T10:21:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 -- 172.21.15.35:0/3678724092 learned_addr learned my addr 172.21.15.35:0/3678724092 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795ac22700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795410a790 0x7f795419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795a421700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101270 0x7f7954198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 -- 172.21.15.35:0/3678724092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795410a790 msgr2=0x7f795419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795410a790 0x7f795419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 -- 172.21.15.35:0/3678724092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101270 msgr2=0x7f7954198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101270 0x7f7954198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 -- 172.21.15.35:0/3678724092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009d00 con 0x7f7954101b80 2023-03-17T10:21:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f795a421700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101270 0x7f7954198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:21:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.906+0000 7f7959c20700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 0x7f79541989d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f795000c9b0 tx=0x7f795000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.907+0000 7f794b7fe700 1 -- 172.21.15.35:0/3678724092 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950007b00 con 0x7f7954101b80 2023-03-17T10:21:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.907+0000 7f794b7fe700 1 -- 172.21.15.35:0/3678724092 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7950007c60 con 0x7f7954101b80 2023-03-17T10:21:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.907+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79541100a0 con 0x7f7954101b80 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.907+0000 7f794b7fe700 1 -- 172.21.15.35:0/3678724092 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950018660 con 0x7f7954101b80 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.907+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795410ff10 con 0x7f7954101b80 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.909+0000 7f794b7fe700 1 -- 172.21.15.35:0/3678724092 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f795000f450 con 0x7f7954101b80 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.910+0000 7f794b7fe700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f794009f640 0x7f79400a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.910+0000 7f795a421700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f794009f640 0x7f79400a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.910+0000 7f794b7fe700 1 -- 172.21.15.35:0/3678724092 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f79500ca590 con 0x7f7954101b80 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f795a421700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f794009f640 0x7f79400a1af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f794400bc10 tx=0x7f794400b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 Processor -- start 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 -- start start 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d118be0 0x562e4d118fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 0x562e4d113420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:08.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d113d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d01a010 con 0x562e4d1194f0 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d06c950 con 0x562e4d118be0 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.911+0000 7f7968812b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d065de0 con 0x562e4d113960 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 0x562e4d113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 0x562e4d113420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49924/0 (socket says 172.21.15.35:49924) 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 -- 172.21.15.35:0/286267173 learned_addr learned my addr 172.21.15.35:0/286267173 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f795ac22700 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d113d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f795a421700 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d118be0 0x562e4d118fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 -- 172.21.15.35:0/286267173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 msgr2=0x562e4d113d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d113d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 -- 172.21.15.35:0/286267173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d118be0 msgr2=0x562e4d118fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d118be0 0x562e4d118fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 -- 172.21.15.35:0/286267173 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e4cee75d0 con 0x562e4d1194f0 2023-03-17T10:21:08.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f795ac22700 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:21:08.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7959c20700 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 0x562e4d113420 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7950097fd0 tx=0x7f7950097a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baeae72c3c55f6b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7948ff9700 1 -- 172.21.15.35:0/286267173 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500a0230 con 0x562e4d1194f0 2023-03-17T10:21:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7948ff9700 1 -- 172.21.15.35:0/286267173 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79500963e0 con 0x562e4d1194f0 2023-03-17T10:21:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.912+0000 7f7948ff9700 1 -- 172.21.15.35:0/286267173 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500982a0 con 0x562e4d1194f0 2023-03-17T10:21:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 -- 172.21.15.35:0/286267173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 msgr2=0x562e4d113420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 0x562e4d113420 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7950097fd0 tx=0x7f7950097a90 comp rx=0 tx=0).stop 2023-03-17T10:21:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 -- 172.21.15.35:0/286267173 shutdown_connections 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d118be0 0x562e4d118fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 --2- 172.21.15.35:0/286267173 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d1194f0 0x562e4d113420 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 -- 172.21.15.35:0/286267173 >> 172.21.15.35:0/286267173 conn(0x562e4cf706b0 msgr2=0x562e4d10da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 -- 172.21.15.35:0/286267173 shutdown_connections 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 -- 172.21.15.35:0/286267173 wait complete. 2023-03-17T10:21:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.913+0000 7f7968812b80 1 -- start start 2023-03-17T10:21:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 Processor -- start 2023-03-17T10:21:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d11f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d11cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4cee98c0 con 0x562e4d113960 2023-03-17T10:21:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d11d4b0 con 0x562e4d1194f0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d128f10 con 0x562e4d118be0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7968812b80 10 client.0 _ll_register_callbacks cb 0x562e4cf0b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d11f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d11f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49928/0 (socket says 172.21.15.35:49928) 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 -- 172.21.15.35:0/552258349 learned_addr learned my addr 172.21.15.35:0/552258349 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795ac22700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d11cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f7959c20700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 -- 172.21.15.35:0/552258349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 msgr2=0x562e4d11c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 -- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 msgr2=0x562e4d11cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d11cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 -- 172.21.15.35:0/552258349 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795410ff10 con 0x562e4d113960 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f795a421700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d11f420 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f794400ffa0 tx=0x7f7944004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140fbd31da5d9caf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.914+0000 7f793dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:21:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f793dffb700 1 -- 172.21.15.35:0/552258349 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794401f630 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f793dffb700 1 -- 172.21.15.35:0/552258349 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f794401f790 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e4d028390 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f793dffb700 1 -- 172.21.15.35:0/552258349 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f794401f990 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 10 client.18606 fetch_fsmap learned FSMap version 41 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562e4ce93d80 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f793dffb700 1 -- 172.21.15.35:0/552258349 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e4d028390 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f793dffb700 1 -- 172.21.15.35:0/552258349 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7944025020 con 0x562e4d113960 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 10 client.18606 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:21:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 10 client.18606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:21:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 20 client.18606 populate_metadata read hostname 'smithi035' 2023-03-17T10:21:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d12cfb0 0x562e4d12f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 4 client.18606 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:21:13.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e4d034600 con 0x562e4d12cfb0 2023-03-17T10:21:13.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.915+0000 7f7959c20700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d12cfb0 0x562e4d12f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:13.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.916+0000 7f793dffb700 10 client.18606 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.916+0000 7f7959c20700 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d12cfb0 0x562e4d12f3c0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42e9d374fef4c7f server_cookie=f2c7fac28323cef in_seq=0 out_seq=0 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f793dffb700 1 -- 172.21.15.35:0/552258349 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562e4d034600 con 0x562e4d12cfb0 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f793dffb700 10 client.18606 handle_command_reply: tid=0 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 client.18606 shutdown 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 msgr2=0x562e4d11f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d11f420 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f794400ffa0 tx=0x7f7944004750 comp rx=0 tx=0).stop 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 shutdown_connections 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d12cfb0 0x562e4d12f3c0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d11cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:15.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f793dffb700 0 client.18606 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:21:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d11f420 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 --2- 172.21.15.35:0/552258349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 >> 172.21.15.35:0/552258349 conn(0x562e4cf706b0 msgr2=0x562e4d112410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 shutdown_connections 2023-03-17T10:21:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 1 -- 172.21.15.35:0/552258349 wait complete. 2023-03-17T10:21:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.917+0000 7f7968812b80 20 client.18606 trim_cache size 0 max 16384 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.932+0000 7f7968812b80 1 Processor -- start 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.932+0000 7f7968812b80 1 -- start start 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7968812b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d123e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7968812b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7968812b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d1166b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7968812b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d1090f0 con 0x562e4d113960 2023-03-17T10:21:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7968812b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d12a6e0 con 0x562e4d1194f0 2023-03-17T10:21:19.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7968812b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d10ab60 con 0x562e4d118be0 2023-03-17T10:21:19.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:19.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d123e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49936/0 (socket says 172.21.15.35:49936) 2023-03-17T10:21:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 -- 172.21.15.35:0/4194068854 learned_addr learned my addr 172.21.15.35:0/4194068854 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f7959c20700 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 -- 172.21.15.35:0/4194068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 msgr2=0x562e4d11efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:22.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 -- 172.21.15.35:0/4194068854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 msgr2=0x562e4d1166b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795ac22700 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d1166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d1166b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 -- 172.21.15.35:0/4194068854 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e4d02c130 con 0x562e4d113960 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795ac22700 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d1166b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f795a421700 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d123e20 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7944010010 tx=0x7f7944011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfc54d9605e2f88 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f79497fa700 1 -- 172.21.15.35:0/4194068854 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944003900 con 0x562e4d113960 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f79497fa700 1 -- 172.21.15.35:0/4194068854 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7944003a60 con 0x562e4d113960 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.933+0000 7f79497fa700 1 -- 172.21.15.35:0/4194068854 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794403a6c0 con 0x562e4d113960 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 -- 172.21.15.35:0/4194068854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 msgr2=0x562e4d123e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d123e20 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7944010010 tx=0x7f7944011b60 comp rx=0 tx=0).stop 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 -- 172.21.15.35:0/4194068854 shutdown_connections 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d1166b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d113960 0x562e4d123e20 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 --2- 172.21.15.35:0/4194068854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d118be0 0x562e4d11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 -- 172.21.15.35:0/4194068854 >> 172.21.15.35:0/4194068854 conn(0x562e4cf706b0 msgr2=0x562e4d112a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 -- 172.21.15.35:0/4194068854 shutdown_connections 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 -- 172.21.15.35:0/4194068854 wait complete. 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 -- start start 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.934+0000 7f7968812b80 1 Processor -- start 2023-03-17T10:21:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d123a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 0x562e4d123fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d122600 con 0x562e4d118be0 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d122770 con 0x562e4d1194f0 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4d122930 con 0x562e4d113960 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 10 client.0 _ll_register_callbacks cb 0x562e4cf0b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:21:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 0x562e4d123fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:26.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:34 smithi035 ceph-mon[92535]: pgmap v2791: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T10:21:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 0x562e4d123fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49944/0 (socket says 172.21.15.35:49944) 2023-03-17T10:21:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 -- 172.21.15.35:0/2872746203 learned_addr learned my addr 172.21.15.35:0/2872746203 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f795a421700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d123a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f795ac22700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 -- 172.21.15.35:0/2872746203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 msgr2=0x562e4d123a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d123a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 -- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 msgr2=0x562e4d121ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d121ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 -- 172.21.15.35:0/2872746203 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e4ce93d80 con 0x562e4d118be0 2023-03-17T10:21:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f795ac22700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d121ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:21:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7959c20700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 0x562e4d123fa0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f7950097f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da41148c6472339 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f793dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:21:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f793dffb700 1 -- 172.21.15.35:0/2872746203 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950094380 con 0x562e4d118be0 2023-03-17T10:21:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f793dffb700 1 -- 172.21.15.35:0/2872746203 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f795000f700 con 0x562e4d118be0 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.935+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e4d0e31e0 con 0x562e4d118be0 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f793dffb700 1 -- 172.21.15.35:0/2872746203 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79500b02a0 con 0x562e4d118be0 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 10 client.18612 fetch_fsmap learned FSMap version 41 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562e4ceba1f0 con 0x562e4d118be0 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f793dffb700 1 -- 172.21.15.35:0/2872746203 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e4d0e31e0 con 0x562e4d118be0 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f793dffb700 1 -- 172.21.15.35:0/2872746203 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7950016020 con 0x562e4d118be0 2023-03-17T10:21:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 10 client.18612 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:21:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 10 client.18612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:21:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 20 client.18612 populate_metadata read hostname 'smithi035' 2023-03-17T10:21:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d181c80 0x562e4d184090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 4 client.18612 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:21:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e4cee9f00 con 0x562e4d181c80 2023-03-17T10:21:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.936+0000 7f795a421700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d181c80 0x562e4d184090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.937+0000 7f795a421700 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d181c80 0x562e4d184090 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bec7bc275b3af7 server_cookie=8246c511df4f3cbb in_seq=0 out_seq=0 2023-03-17T10:21:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.937+0000 7f793dffb700 10 client.18612 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:21:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.941+0000 7f793dffb700 1 -- 172.21.15.35:0/2872746203 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e4cee9f00 con 0x562e4d181c80 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.941+0000 7f793dffb700 10 client.18612 handle_command_reply: tid=0 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.941+0000 7f7968812b80 1 client.18612 shutdown 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.941+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 msgr2=0x562e4d123fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.941+0000 7f7968812b80 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 0x562e4d123fa0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f7950097f40 comp rx=0 tx=0).stop 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 shutdown_connections 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e4d181c80 0x562e4d184090 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e4d1194f0 0x562e4d121ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f793dffb700 0 client.18612 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:21:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e4d113960 0x562e4d123a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 --2- 172.21.15.35:0/2872746203 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e4d118be0 0x562e4d123fa0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 >> 172.21.15.35:0/2872746203 conn(0x562e4cf706b0 msgr2=0x562e4d1166b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 shutdown_connections 2023-03-17T10:21:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 1 -- 172.21.15.35:0/2872746203 wait complete. 2023-03-17T10:21:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f7968812b80 20 client.18612 trim_cache size 0 max 16384 2023-03-17T10:21:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f794009f640 msgr2=0x7f79400a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f794009f640 0x7f79400a1af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f794400bc10 tx=0x7f794400b5f0 comp rx=0 tx=0).stop 2023-03-17T10:21:34.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 msgr2=0x7f79541989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 0x7f79541989d0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f795000c9b0 tx=0x7f795000ccc0 comp rx=0 tx=0).stop 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 shutdown_connections 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f794009f640 0x7f79400a1af0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f795410a790 0x7f795419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7954101270 0x7f7954198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 --2- 172.21.15.35:0/3678724092 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7954101b80 0x7f79541989d0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:35.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 >> 172.21.15.35:0/3678724092 conn(0x7f7954076330 msgr2=0x7f79540fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 shutdown_connections 2023-03-17T10:21:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:42.942+0000 7f795c685700 1 -- 172.21.15.35:0/3678724092 wait complete. 2023-03-17T10:21:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.066+0000 7fb5c1a97700 1 -- 172.21.15.35:0/1185454912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 msgr2=0x7fb5bc10a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.066+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/1185454912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc10a1d0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009990 tx=0x7fb5b0009ca0 comp rx=0 tx=0).stop 2023-03-17T10:21:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 -- 172.21.15.35:0/1185454912 shutdown_connections 2023-03-17T10:21:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/1185454912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5bc10a7a0 0x7fb5bc10cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/1185454912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5bc1013d0 0x7fb5bc1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/1185454912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc10a1d0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 -- 172.21.15.35:0/1185454912 >> 172.21.15.35:0/1185454912 conn(0x7fb5bc076330 msgr2=0x7fb5bc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 -- 172.21.15.35:0/1185454912 shutdown_connections 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 -- 172.21.15.35:0/1185454912 wait complete. 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 Processor -- start 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.067+0000 7fb5c1a97700 1 -- start start 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5c1a97700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5bc1013d0 0x7fb5bc1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5c1a97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5c1a97700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5bc10a7a0 0x7fb5bc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5c1a97700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc19b180 con 0x7fb5bc101ce0 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5c1a97700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc19b2f0 con 0x7fb5bc10a7a0 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5c1a97700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc19b4b0 con 0x7fb5bc1013d0 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc1966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49958/0 (socket says 172.21.15.35:49958) 2023-03-17T10:21:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 -- 172.21.15.35:0/3172674512 learned_addr learned my addr 172.21.15.35:0/3172674512 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5bc1013d0 0x7fb5bc1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 -- 172.21.15.35:0/3172674512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5bc1013d0 msgr2=0x7fb5bc1961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5bc1013d0 0x7fb5bc1961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 -- 172.21.15.35:0/3172674512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5bc10a7a0 msgr2=0x7fb5bc19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5bbfff700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5bc10a7a0 0x7fb5bc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5bc10a7a0 0x7fb5bc19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 -- 172.21.15.35:0/3172674512 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00095f0 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc1966e0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0005910 tx=0x7fb5b0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.068+0000 7fb5b8ff9700 1 -- 172.21.15.35:0/3172674512 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b001d070 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.069+0000 7fb5b8ff9700 1 -- 172.21.15.35:0/3172674512 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5b0003f40 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.069+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc110110 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.069+0000 7fb5b8ff9700 1 -- 172.21.15.35:0/3172674512 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000fc60 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.069+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc10ff80 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.071+0000 7fb5b8ff9700 1 -- 172.21.15.35:0/3172674512 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb5b00040b0 con 0x7fb5bc101ce0 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.072+0000 7fb5b8ff9700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5a409f6c0 0x7fb5a40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.072+0000 7fb5b8ff9700 1 -- 172.21.15.35:0/3172674512 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb5b00cb5f0 con 0x7fb5bc101ce0 2023-03-17T10:21:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.072+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5a409f6c0 0x7fb5a40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:42.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.072+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5a409f6c0 0x7fb5a40a1b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac005950 tx=0x7fb5ac0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 Processor -- start 2023-03-17T10:21:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 -- start start 2023-03-17T10:21:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5888830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:45.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a58891c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a578b010 con 0x5634a588e8a0 2023-03-17T10:21:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a57dd950 con 0x5634a5888d70 2023-03-17T10:21:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a57d6de0 con 0x5634a588df90 2023-03-17T10:21:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5888830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5888830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49966/0 (socket says 172.21.15.35:49966) 2023-03-17T10:21:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 -- 172.21.15.35:0/51409755 learned_addr learned my addr 172.21.15.35:0/51409755 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5bbfff700 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a58891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:48.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 -- 172.21.15.35:0/51409755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 msgr2=0x5634a588e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:48.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:48.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 -- 172.21.15.35:0/51409755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 msgr2=0x5634a58891c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:48.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a58891c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 -- 172.21.15.35:0/51409755 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634a56585d0 con 0x5634a588e8a0 2023-03-17T10:21:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:21:50.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.073+0000 7fb5baffd700 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5888830 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00c9380 tx=0x7fb5b0098cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239c46fdc380e59a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5a1ffb700 1 -- 172.21.15.35:0/51409755 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0099130 con 0x5634a588e8a0 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5a1ffb700 1 -- 172.21.15.35:0/51409755 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5b00a1290 con 0x5634a588e8a0 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5a1ffb700 1 -- 172.21.15.35:0/51409755 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b00a0e00 con 0x5634a588e8a0 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/51409755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 msgr2=0x5634a5888830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5888830 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00c9380 tx=0x7fb5b0098cf0 comp rx=0 tx=0).stop 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/51409755 shutdown_connections 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a58891c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:50.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/51409755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5888830 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/51409755 >> 172.21.15.35:0/51409755 conn(0x5634a56e16b0 msgr2=0x5634a587ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:21:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/51409755 shutdown_connections 2023-03-17T10:21:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.074+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/51409755 wait complete. 2023-03-17T10:21:50.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.075+0000 7fb5cdc24b80 1 -- start start 2023-03-17T10:21:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.075+0000 7fb5cdc24b80 1 Processor -- start 2023-03-17T10:21:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a5894860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588df90 0x5634a5891ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588e8a0 0x5634a5892180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a565a8c0 con 0x5634a5888d70 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a58928f0 con 0x5634a588df90 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a589e060 con 0x5634a588e8a0 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5cdc24b80 10 client.0 _ll_register_callbacks cb 0x5634a567c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a5894860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a5894860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49970/0 (socket says 172.21.15.35:49970) 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/3726179191 learned_addr learned my addr 172.21.15.35:0/3726179191 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bbfff700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588e8a0 0x5634a5892180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588df90 0x5634a5891ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/3726179191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588e8a0 msgr2=0x5634a5892180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588e8a0 0x5634a5892180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588df90 msgr2=0x5634a5891ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588df90 0x5634a5891ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/3726179191 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc10ff80 con 0x5634a5888d70 2023-03-17T10:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588df90 0x5634a5891ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a5894860 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00ff20 tx=0x7fb5ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a5655684ab7a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb59affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.076+0000 7fb59affd700 1 -- 172.21.15.35:0/3726179191 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac01f630 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb59affd700 1 -- 172.21.15.35:0/3726179191 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb5ac01f790 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634a5799390 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb59affd700 1 -- 172.21.15.35:0/3726179191 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5ac011e70 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 10 client.18624 fetch_fsmap learned FSMap version 41 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5634a5604d80 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb59affd700 1 -- 172.21.15.35:0/3726179191 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634a5799390 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb59affd700 1 -- 172.21.15.35:0/3726179191 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb5ac025020 con 0x5634a5888d70 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 10 client.18624 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 10 client.18624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 20 client.18624 populate_metadata read hostname 'smithi035' 2023-03-17T10:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58a21f0 0x5634a58a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:21:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 4 client.18624 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:21:59.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:36 smithi035 ceph-mon[92535]: pgmap v2792: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T10:21:59.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:38 smithi035 ceph-mon[92535]: pgmap v2793: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T10:21:59.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:40 smithi035 ceph-mon[92535]: pgmap v2794: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:21:59.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:42 smithi035 ceph-mon[92535]: pgmap v2795: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:22:00.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:44 smithi035 ceph-mon[92535]: pgmap v2796: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:22:00.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:46 smithi035 ceph-mon[92535]: pgmap v2797: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:22:00.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:48 smithi035 ceph-mon[92535]: pgmap v2798: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:22:00.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:50 smithi035 ceph-mon[92535]: pgmap v2799: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:22:00.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:52 smithi035 ceph-mon[92535]: pgmap v2800: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:22:00.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:54 smithi035 ceph-mon[92535]: pgmap v2801: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:22:00.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:56 smithi035 ceph-mon[92535]: pgmap v2802: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:11:58 smithi035 ceph-mon[92535]: pgmap v2803: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:00 smithi035 ceph-mon[92535]: pgmap v2804: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:02 smithi035 ceph-mon[92535]: pgmap v2805: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:04 smithi035 ceph-mon[92535]: pgmap v2806: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:06 smithi035 ceph-mon[92535]: pgmap v2807: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:08 smithi035 ceph-mon[92535]: pgmap v2808: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:22:01.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:09 smithi035 ceph-mon[92535]: osdmap e251: 12 total, 12 up, 12 in 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:10 smithi035 ceph-mon[92535]: pgmap v2810: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:12 smithi035 ceph-mon[92535]: pgmap v2811: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:14 smithi035 ceph-mon[92535]: pgmap v2812: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:16 smithi035 ceph-mon[92535]: pgmap v2813: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:16 smithi035 ceph-mon[92535]: osdmap e252: 12 total, 12 up, 12 in 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:18 smithi035 ceph-mon[92535]: pgmap v2815: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:20 smithi035 ceph-mon[92535]: pgmap v2816: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:22 smithi035 ceph-mon[92535]: pgmap v2817: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:24 smithi035 ceph-mon[92535]: pgmap v2818: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:26 smithi035 ceph-mon[92535]: pgmap v2819: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:28 smithi035 ceph-mon[92535]: pgmap v2820: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 89 B/s wr, 13 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:30 smithi035 ceph-mon[92535]: pgmap v2821: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:22:01.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:31 smithi035 ceph-mon[92535]: pgmap v2822: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T10:22:01.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:31 smithi035 ceph-mon[92535]: pgmap v2823: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:22:01.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:33 smithi035 ceph-mon[92535]: pgmap v2824: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:35 smithi035 ceph-mon[92535]: pgmap v2825: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:37 smithi035 ceph-mon[92535]: pgmap v2826: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:39 smithi035 ceph-mon[92535]: pgmap v2827: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:41 smithi035 ceph-mon[92535]: pgmap v2828: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:43 smithi035 ceph-mon[92535]: pgmap v2829: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:45 smithi035 ceph-mon[92535]: pgmap v2830: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:47 smithi035 ceph-mon[92535]: pgmap v2831: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:49 smithi035 ceph-mon[92535]: pgmap v2832: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:51 smithi035 ceph-mon[92535]: pgmap v2833: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:53 smithi035 ceph-mon[92535]: pgmap v2834: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T10:22:02.951 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:55 smithi035 ceph-mon[92535]: pgmap v2835: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:22:02.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:57 smithi035 ceph-mon[92535]: pgmap v2836: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:22:02.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:12:59 smithi035 ceph-mon[92535]: pgmap v2837: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:22:02.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:01 smithi035 ceph-mon[92535]: pgmap v2838: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:22:02.952 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:03 smithi035 ceph-mon[92535]: pgmap v2839: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:22:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:22:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:22:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:22:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:22:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:22:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:22:05.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:22:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.077+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634a57a5600 con 0x5634a58a21f0 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.078+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58a21f0 0x5634a58a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.078+0000 7fb5baffd700 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58a21f0 0x5634a58a4600 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fcb55529d7139cb server_cookie=5eda2fb4117c8f92 in_seq=0 out_seq=0 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.078+0000 7fb59affd700 10 client.18624 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb59affd700 1 -- 172.21.15.35:0/3726179191 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5634a57a5600 con 0x5634a58a21f0 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb59affd700 10 client.18624 handle_command_reply: tid=0 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 client.18624 shutdown 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 msgr2=0x5634a5894860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a5894860 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00ff20 tx=0x7fb5ac004750 comp rx=0 tx=0).stop 2023-03-17T10:22:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 shutdown_connections 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58a21f0 0x5634a58a4600 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588e8a0 0x5634a5892180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb59affd700 0 client.18624 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a5894860 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/3726179191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588df90 0x5634a5891ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 >> 172.21.15.35:0/3726179191 conn(0x5634a56e16b0 msgr2=0x5634a5883410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 shutdown_connections 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/3726179191 wait complete. 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.079+0000 7fb5cdc24b80 20 client.18624 trim_cache size 0 max 16384 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 Processor -- start 2023-03-17T10:22:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 -- start start 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a58a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588e8a0 0x5634a5898fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a5888870 con 0x5634a5888d70 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a587f6f0 con 0x5634a588e8a0 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a588c6b0 con 0x5634a588df90 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a58a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a58a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49978/0 (socket says 172.21.15.35:49978) 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/4091315603 learned_addr learned my addr 172.21.15.35:0/4091315603 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5bbfff700 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588e8a0 0x5634a5898fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.094+0000 7fb5baffd700 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/4091315603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 msgr2=0x5634a588c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/4091315603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588e8a0 msgr2=0x5634a5898fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588e8a0 0x5634a5898fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bb7fe700 1 -- 172.21.15.35:0/4091315603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634a579d130 con 0x5634a5888d70 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bbfff700 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588e8a0 0x5634a5898fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a58a45d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac014040 tx=0x7fb5ac00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249d24eeff53a2f1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5a27fc700 1 -- 172.21.15.35:0/4091315603 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac011ab0 con 0x5634a5888d70 2023-03-17T10:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5a27fc700 1 -- 172.21.15.35:0/4091315603 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ac010b10 con 0x5634a5888d70 2023-03-17T10:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5a27fc700 1 -- 172.21.15.35:0/4091315603 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac01fa70 con 0x5634a5888d70 2023-03-17T10:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/4091315603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 msgr2=0x5634a58a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a58a45d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac014040 tx=0x7fb5ac00b4e0 comp rx=0 tx=0).stop 2023-03-17T10:22:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/4091315603 shutdown_connections 2023-03-17T10:22:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a588e8a0 0x5634a5898fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a5888d70 0x5634a58a45d0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/4091315603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a588c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.095+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/4091315603 >> 172.21.15.35:0/4091315603 conn(0x5634a56e16b0 msgr2=0x5634a588ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.096+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/4091315603 shutdown_connections 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.096+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/4091315603 wait complete. 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.096+0000 7fb5cdc24b80 1 -- start start 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.096+0000 7fb5cdc24b80 1 Processor -- start 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.096+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a5887e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a5886640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5cdc24b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5886b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a5888520 con 0x5634a588e8a0 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a5888690 con 0x5634a5888d70 2023-03-17T10:22:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5cdc24b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634a58870c0 con 0x5634a588df90 2023-03-17T10:22:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5cdc24b80 10 client.0 _ll_register_callbacks cb 0x5634a567c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:22:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5bbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5886b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5bbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5886b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49988/0 (socket says 172.21.15.35:49988) 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5bbfff700 1 -- 172.21.15.35:0/251565684 learned_addr learned my addr 172.21.15.35:0/251565684 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a5886640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a5887e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 -- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 msgr2=0x5634a5887e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a5887e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 -- 172.21.15.35:0/251565684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 msgr2=0x5634a5886b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5886b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 -- 172.21.15.35:0/251565684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634a5604d80 con 0x5634a588df90 2023-03-17T10:22:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb5baffd700 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a5886640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5634a5889810 tx=0x7fb5b0005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf85f96d8b73c33 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.097+0000 7fb59affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:22:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb59affd700 1 -- 172.21.15.35:0/251565684 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b00c8600 con 0x5634a588df90 2023-03-17T10:22:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634a58541e0 con 0x5634a588df90 2023-03-17T10:22:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb59affd700 1 -- 172.21.15.35:0/251565684 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(222..222 src has 1..222) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb5b00b1230 con 0x5634a588df90 2023-03-17T10:22:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb59affd700 1 -- 172.21.15.35:0/251565684 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5b00b13f0 con 0x5634a588df90 2023-03-17T10:22:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 10 client.27922 fetch_fsmap learned FSMap version 41 2023-03-17T10:22:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5634a562b1f0 con 0x5634a588df90 2023-03-17T10:22:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb59affd700 1 -- 172.21.15.35:0/251565684 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634a58541e0 con 0x5634a588df90 2023-03-17T10:22:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb59affd700 1 -- 172.21.15.35:0/251565684 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb5b00b5c80 con 0x5634a588df90 2023-03-17T10:22:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 10 client.27922 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 10 client.27922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 20 client.27922 populate_metadata read hostname 'smithi035' 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58f2df0 0x5634a58f5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 4 client.27922 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5634a565af00 con 0x5634a58f2df0 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.098+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58f2df0 0x5634a58f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.099+0000 7fb5bb7fe700 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58f2df0 0x5634a58f5200 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddc22eea7827033e server_cookie=52224f7f4c9a9434 in_seq=0 out_seq=0 2023-03-17T10:22:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.099+0000 7fb59affd700 10 client.27922 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.103+0000 7fb59affd700 1 -- 172.21.15.35:0/251565684 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5634a565af00 con 0x5634a58f2df0 2023-03-17T10:22:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.103+0000 7fb59affd700 10 client.27922 handle_command_reply: tid=0 2023-03-17T10:22:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.103+0000 7fb5cdc24b80 1 client.27922 shutdown 2023-03-17T10:22:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 msgr2=0x5634a5886640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a5886640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5634a5889810 tx=0x7fb5b0005bc0 comp rx=0 tx=0).stop 2023-03-17T10:22:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 shutdown_connections 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634a58f2df0 0x5634a58f5200 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634a588e8a0 0x5634a5886b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634a5888d70 0x5634a5887e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 --2- 172.21.15.35:0/251565684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634a588df90 0x5634a5886640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb59affd700 0 client.27922 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 >> 172.21.15.35:0/251565684 conn(0x5634a56e16b0 msgr2=0x5634a588ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 shutdown_connections 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 1 -- 172.21.15.35:0/251565684 wait complete. 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5cdc24b80 20 client.27922 trim_cache size 0 max 16384 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5a409f6c0 msgr2=0x7fb5a40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5a409f6c0 0x7fb5a40a1b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac005950 tx=0x7fb5ac0058e0 comp rx=0 tx=0).stop 2023-03-17T10:22:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 msgr2=0x7fb5bc1966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc1966e0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0005910 tx=0x7fb5b0009580 comp rx=0 tx=0).stop 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 shutdown_connections 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb5a409f6c0 0x7fb5a40a1b70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5bc10a7a0 0x7fb5bc19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5bc1013d0 0x7fb5bc1961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 --2- 172.21.15.35:0/3172674512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb5bc101ce0 0x7fb5bc1966e0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 >> 172.21.15.35:0/3172674512 conn(0x7fb5bc076330 msgr2=0x7fb5bc0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 shutdown_connections 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:57:56.104+0000 7fb5c1a97700 1 -- 172.21.15.35:0/3172674512 wait complete. 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 -- 172.21.15.35:0/771481477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ffd00 msgr2=0x7fa83410a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 --2- 172.21.15.35:0/771481477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ffd00 0x7fa83410a770 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009990 tx=0x7fa81c009ca0 comp rx=0 tx=0).stop 2023-03-17T10:22:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 -- 172.21.15.35:0/771481477 shutdown_connections 2023-03-17T10:22:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 --2- 172.21.15.35:0/771481477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa83410acb0 0x7fa83410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 --2- 172.21.15.35:0/771481477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ff3f0 0x7fa8340ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 --2- 172.21.15.35:0/771481477 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ffd00 0x7fa83410a770 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 -- 172.21.15.35:0/771481477 >> 172.21.15.35:0/771481477 conn(0x7fa8340749e0 msgr2=0x7fa834074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.737+0000 7fa8393bb700 1 -- 172.21.15.35:0/771481477 shutdown_connections 2023-03-17T10:22:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 -- 172.21.15.35:0/771481477 wait complete. 2023-03-17T10:22:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 Processor -- start 2023-03-17T10:22:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 -- start start 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 0x7fa834196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ffd00 0x7fa834196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa83410acb0 0x7fa83419acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83419b300 con 0x7fa8340ff3f0 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83419b470 con 0x7fa83410acb0 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa8393bb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83419b630 con 0x7fa8340ffd00 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 0x7fa834196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 0x7fa834196320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:49998/0 (socket says 172.21.15.35:49998) 2023-03-17T10:22:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.738+0000 7fa832ffd700 1 -- 172.21.15.35:0/2770202118 learned_addr learned my addr 172.21.15.35:0/2770202118 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa8337fe700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa83410acb0 0x7fa83419acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa82bfff700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ffd00 0x7fa834196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa832ffd700 1 -- 172.21.15.35:0/2770202118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ffd00 msgr2=0x7fa834196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa832ffd700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ffd00 0x7fa834196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa832ffd700 1 -- 172.21.15.35:0/2770202118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa83410acb0 msgr2=0x7fa83419acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa832ffd700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa83410acb0 0x7fa83419acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa832ffd700 1 -- 172.21.15.35:0/2770202118 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0095f0 con 0x7fa8340ff3f0 2023-03-17T10:22:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa82bfff700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ffd00 0x7fa834196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa832ffd700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 0x7fa834196320 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa82400d980 tx=0x7fa82400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa830ff9700 1 -- 172.21.15.35:0/2770202118 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82400bb60 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa830ff9700 1 -- 172.21.15.35:0/2770202118 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa824007640 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa834110260 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa830ff9700 1 -- 172.21.15.35:0/2770202118 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824004d60 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.739+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8341100d0 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.742+0000 7fa830ff9700 1 -- 172.21.15.35:0/2770202118 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa824004020 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.742+0000 7fa830ff9700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa82009f640 0x7fa8200a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.742+0000 7fa830ff9700 1 -- 172.21.15.35:0/2770202118 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa8240ca4b0 con 0x7fa8340ff3f0 2023-03-17T10:22:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.742+0000 7fa82bfff700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa82009f640 0x7fa8200a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.743+0000 7fa82bfff700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa82009f640 0x7fa8200a1af0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005f50 tx=0x7fa81c005e80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:21.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.743+0000 7fa845548b80 1 Processor -- start 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.743+0000 7fa845548b80 1 -- start start 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa845548b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c7be0 0x55b7266c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa845548b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa845548b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa845548b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7265c9010 con 0x55b7266c2960 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa845548b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72661b950 con 0x55b7266c84f0 2023-03-17T10:22:21.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa845548b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b726614de0 con 0x55b7266c7be0 2023-03-17T10:22:21.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:21.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:05 smithi035 ceph-mon[92535]: pgmap v2840: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:22:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50010/0 (socket says 172.21.15.35:50010) 2023-03-17T10:22:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 -- 172.21.15.35:0/164121473 learned_addr learned my addr 172.21.15.35:0/164121473 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa82bfff700 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:24.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa832ffd700 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c7be0 0x55b7266c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 -- 172.21.15.35:0/164121473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c7be0 msgr2=0x55b7266c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c7be0 0x55b7266c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 -- 172.21.15.35:0/164121473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 msgr2=0x55b7266c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 -- 172.21.15.35:0/164121473 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7264965d0 con 0x55b7266c2960 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8337fe700 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266c2d90 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009cb0 tx=0x7fa82c007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e304f4c72b47a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.744+0000 7fa8297fa700 1 -- 172.21.15.35:0/164121473 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c018070 con 0x55b7266c2960 2023-03-17T10:22:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa8297fa700 1 -- 172.21.15.35:0/164121473 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa82c00f050 con 0x55b7266c2960 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa8297fa700 1 -- 172.21.15.35:0/164121473 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c005940 con 0x55b7266c2960 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 -- 172.21.15.35:0/164121473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 msgr2=0x55b7266c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266c2d90 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009cb0 tx=0x7fa82c007500 comp rx=0 tx=0).stop 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 -- 172.21.15.35:0/164121473 shutdown_connections 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266c2d90 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c7be0 0x55b7266c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 --2- 172.21.15.35:0/164121473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 -- 172.21.15.35:0/164121473 >> 172.21.15.35:0/164121473 conn(0x55b72651f6b0 msgr2=0x55b7266bca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 -- 172.21.15.35:0/164121473 shutdown_connections 2023-03-17T10:22:28.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.745+0000 7fa845548b80 1 -- 172.21.15.35:0/164121473 wait complete. 2023-03-17T10:22:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 -- start start 2023-03-17T10:22:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 Processor -- start 2023-03-17T10:22:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7264988c0 con 0x55b7266c2960 2023-03-17T10:22:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266cc250 con 0x55b7266c7be0 2023-03-17T10:22:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266cc410 con 0x55b7266c84f0 2023-03-17T10:22:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa845548b80 10 client.0 _ll_register_callbacks cb 0x55b7264ba230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:22:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50012/0 (socket says 172.21.15.35:50012) 2023-03-17T10:22:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa832ffd700 1 -- 172.21.15.35:0/4239299806 learned_addr learned my addr 172.21.15.35:0/4239299806 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:32.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa8337fe700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.746+0000 7fa82bfff700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa832ffd700 1 -- 172.21.15.35:0/4239299806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 msgr2=0x55b7266cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa832ffd700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa832ffd700 1 -- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 msgr2=0x55b7266cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:35.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa832ffd700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:35.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa832ffd700 1 -- 172.21.15.35:0/4239299806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c0098e0 con 0x55b7266c2960 2023-03-17T10:22:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa832ffd700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266ce3c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa824097c60 tx=0x7fa8240043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe7ad6446b3f586 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa81a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:22:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa81a7fc700 1 -- 172.21.15.35:0/4239299806 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8240b0220 con 0x55b7266c2960 2023-03-17T10:22:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa81a7fc700 1 -- 172.21.15.35:0/4239299806 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa824097450 con 0x55b7266c2960 2023-03-17T10:22:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7265d7390 con 0x55b7266c2960 2023-03-17T10:22:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa81a7fc700 1 -- 172.21.15.35:0/4239299806 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa824097610 con 0x55b7266c2960 2023-03-17T10:22:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa845548b80 10 client.18642 fetch_fsmap learned FSMap version 41 2023-03-17T10:22:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b726442d80 con 0x55b7266c2960 2023-03-17T10:22:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.747+0000 7fa81a7fc700 1 -- 172.21.15.35:0/4239299806 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7265d7390 con 0x55b7266c2960 2023-03-17T10:22:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa81a7fc700 1 -- 172.21.15.35:0/4239299806 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa8240ca040 con 0x55b7266c2960 2023-03-17T10:22:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa845548b80 10 client.18642 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:22:37.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa845548b80 10 client.18642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa845548b80 20 client.18642 populate_metadata read hostname 'smithi035' 2023-03-17T10:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa845548b80 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b7266dbf70 0x55b7266de350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa845548b80 4 client.18642 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7265e3600 con 0x55b7266dbf70 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa82bfff700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b7266dbf70 0x55b7266de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa82bfff700 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b7266dbf70 0x55b7266de350 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6bd76e6a6a010f2 server_cookie=d0227e5750a2b1c7 in_seq=0 out_seq=0 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.748+0000 7fa81a7fc700 10 client.18642 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa81a7fc700 1 -- 172.21.15.35:0/4239299806 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b7265e3600 con 0x55b7266dbf70 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa81a7fc700 10 client.18642 handle_command_reply: tid=0 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 client.18642 shutdown 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 msgr2=0x55b7266ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266ce3c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa824097c60 tx=0x7fa8240043d0 comp rx=0 tx=0).stop 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 shutdown_connections 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b7266dbf70 0x55b7266de350 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266ce3c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa81a7fc700 0 client.18642 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 --2- 172.21.15.35:0/4239299806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 >> 172.21.15.35:0/4239299806 conn(0x55b72651f6b0 msgr2=0x55b7266bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 shutdown_connections 2023-03-17T10:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 1 -- 172.21.15.35:0/4239299806 wait complete. 2023-03-17T10:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.749+0000 7fa845548b80 20 client.18642 trim_cache size 0 max 16384 2023-03-17T10:22:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.764+0000 7fa845548b80 1 Processor -- start 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 -- start start 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c2960 0x55b7266c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 0x55b7266bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7265d73c0 con 0x55b7266c7be0 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266b8120 con 0x55b7266c84f0 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa845548b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266c95e0 con 0x55b7266c2960 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 0x55b7266bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 0x55b7266bcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50020/0 (socket says 172.21.15.35:50020) 2023-03-17T10:22:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 -- 172.21.15.35:0/1608742886 learned_addr learned my addr 172.21.15.35:0/1608742886 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa832ffd700 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c2960 0x55b7266c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa8337fe700 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 -- 172.21.15.35:0/1608742886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c2960 msgr2=0x55b7266c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c2960 0x55b7266c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 -- 172.21.15.35:0/1608742886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 msgr2=0x55b7266c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa82bfff700 1 -- 172.21.15.35:0/1608742886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7266c3000 con 0x55b7266c7be0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.765+0000 7fa8337fe700 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa82bfff700 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 0x55b7266bcac0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa834197930 tx=0x7fa81c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2757ada7bd359492 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa829ffb700 1 -- 172.21.15.35:0/1608742886 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c01e070 con 0x55b7266c7be0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa829ffb700 1 -- 172.21.15.35:0/1608742886 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa81c02d040 con 0x55b7266c7be0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa829ffb700 1 -- 172.21.15.35:0/1608742886 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c003820 con 0x55b7266c7be0 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 -- 172.21.15.35:0/1608742886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 msgr2=0x55b7266bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 0x55b7266bcac0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa834197930 tx=0x7fa81c021000 comp rx=0 tx=0).stop 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 -- 172.21.15.35:0/1608742886 shutdown_connections 2023-03-17T10:22:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c84f0 0x55b7266c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c2960 0x55b7266c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 --2- 172.21.15.35:0/1608742886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c7be0 0x55b7266bcac0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 -- 172.21.15.35:0/1608742886 >> 172.21.15.35:0/1608742886 conn(0x55b72651f6b0 msgr2=0x55b7266c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.766+0000 7fa845548b80 1 -- 172.21.15.35:0/1608742886 shutdown_connections 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 -- 172.21.15.35:0/1608742886 wait complete. 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 -- start start 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 Processor -- start 2023-03-17T10:22:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266cf840 con 0x55b7266c2960 2023-03-17T10:22:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266cf9b0 con 0x55b7266c7be0 2023-03-17T10:22:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7266cfb70 con 0x55b7266c84f0 2023-03-17T10:22:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa845548b80 10 client.0 _ll_register_callbacks cb 0x55b7264ba230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:22:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50026/0 (socket says 172.21.15.35:50026) 2023-03-17T10:22:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa832ffd700 1 -- 172.21.15.35:0/796539861 learned_addr learned my addr 172.21.15.35:0/796539861 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa82bfff700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.767+0000 7fa8337fe700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa832ffd700 1 -- 172.21.15.35:0/796539861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 msgr2=0x55b7266cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:53.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa832ffd700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa832ffd700 1 -- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 msgr2=0x55b7266d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa832ffd700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa832ffd700 1 -- 172.21.15.35:0/796539861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83410d9c0 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa832ffd700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266d2be0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c8240 tx=0x7fa824004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae9910becbfcdf9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa81a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa81a7fc700 1 -- 172.21.15.35:0/796539861 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824093e40 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa81a7fc700 1 -- 172.21.15.35:0/796539861 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa824097450 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7266921e0 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa81a7fc700 1 -- 172.21.15.35:0/796539861 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa824097610 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa845548b80 10 client.18648 fetch_fsmap learned FSMap version 41 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b72642bc00 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa81a7fc700 1 -- 172.21.15.35:0/796539861 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7266921e0 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa81a7fc700 1 -- 172.21.15.35:0/796539861 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa8240970c0 con 0x55b7266c2960 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa845548b80 10 client.18648 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:22:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa845548b80 10 client.18648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.768+0000 7fa845548b80 20 client.18648 populate_metadata read hostname 'smithi035' 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.769+0000 7fa845548b80 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b726730c30 0x55b726733040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.769+0000 7fa845548b80 4 client.18648 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.769+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b726498f00 con 0x55b726730c30 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.769+0000 7fa82bfff700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b726730c30 0x55b726733040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.769+0000 7fa81a7fc700 10 client.18648 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.769+0000 7fa82bfff700 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b726730c30 0x55b726733040 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb89084434daf364 server_cookie=3b874b8d70c5ffc3 in_seq=0 out_seq=0 2023-03-17T10:22:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.778+0000 7fa81a7fc700 1 -- 172.21.15.35:0/796539861 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b726498f00 con 0x55b726730c30 2023-03-17T10:22:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.778+0000 7fa81a7fc700 10 client.18648 handle_command_reply: tid=0 2023-03-17T10:22:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.778+0000 7fa845548b80 1 client.18648 shutdown 2023-03-17T10:22:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 msgr2=0x55b7266d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266d2be0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa8240c8240 tx=0x7fa824004640 comp rx=0 tx=0).stop 2023-03-17T10:22:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 shutdown_connections 2023-03-17T10:22:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b726730c30 0x55b726733040 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b7266c84f0 0x55b7266cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b7266c2960 0x55b7266d2be0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 --2- 172.21.15.35:0/796539861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7266c7be0 0x55b7266d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa81a7fc700 0 client.18648 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:22:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 >> 172.21.15.35:0/796539861 conn(0x55b72651f6b0 msgr2=0x55b7266c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 shutdown_connections 2023-03-17T10:22:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 1 -- 172.21.15.35:0/796539861 wait complete. 2023-03-17T10:22:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa845548b80 20 client.18648 trim_cache size 0 max 16384 2023-03-17T10:22:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa82009f640 msgr2=0x7fa8200a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa82009f640 0x7fa8200a1af0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005f50 tx=0x7fa81c005e80 comp rx=0 tx=0).stop 2023-03-17T10:22:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 msgr2=0x7fa834196320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:58.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:07 smithi035 ceph-mon[92535]: pgmap v2841: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:22:58.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 0x7fa834196320 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa82400d980 tx=0x7fa82400dd40 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 shutdown_connections 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa82009f640 0x7fa8200a1af0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa83410acb0 0x7fa83419acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa8340ff3f0 0x7fa834196320 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 --2- 172.21.15.35:0/2770202118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8340ffd00 0x7fa834196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.779+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 >> 172.21.15.35:0/2770202118 conn(0x7fa8340749e0 msgr2=0x7fa8340fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.780+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 shutdown_connections 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:21.780+0000 7fa8393bb700 1 -- 172.21.15.35:0/2770202118 wait complete. 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 -- 172.21.15.35:0/2106522554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 msgr2=0x7fcd90103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 --2- 172.21.15.35:0/2106522554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90103cc0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fcd800099c0 tx=0x7fcd80009cd0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 -- 172.21.15.35:0/2106522554 shutdown_connections 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 --2- 172.21.15.35:0/2106522554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd901043a0 0x7fcd9010bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 --2- 172.21.15.35:0/2106522554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd900ff360 0x7fcd900ff730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 --2- 172.21.15.35:0/2106522554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90103cc0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 -- 172.21.15.35:0/2106522554 >> 172.21.15.35:0/2106522554 conn(0x7fcd900761c0 msgr2=0x7fcd900765c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 -- 172.21.15.35:0/2106522554 shutdown_connections 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.901+0000 7fcd98413700 1 -- 172.21.15.35:0/2106522554 wait complete. 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 Processor -- start 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 -- start start 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd900ff360 0x7fcd901970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd901043a0 0x7fcd901a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90197f30 con 0x7fcd900ffd00 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901a26a0 con 0x7fcd900ff360 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd98413700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901a2810 con 0x7fcd901043a0 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50042/0 (socket says 172.21.15.35:50042) 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 -- 172.21.15.35:0/3101833185 learned_addr learned my addr 172.21.15.35:0/3101833185 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:22:59.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd961af700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd900ff360 0x7fcd901970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:22:59.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd969b0700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd901043a0 0x7fcd901a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 -- 172.21.15.35:0/3101833185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd901043a0 msgr2=0x7fcd901a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd901043a0 0x7fcd901a2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 -- 172.21.15.35:0/3101833185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd900ff360 msgr2=0x7fcd901970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.902+0000 7fcd959ae700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd900ff360 0x7fcd901970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd959ae700 1 -- 172.21.15.35:0/3101833185 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800095f0 con 0x7fcd900ffd00 2023-03-17T10:23:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd959ae700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90197620 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009990 tx=0x7fcd80009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd877fe700 1 -- 172.21.15.35:0/3101833185 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8001d070 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd877fe700 1 -- 172.21.15.35:0/3101833185 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd80004040 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9010f020 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd877fe700 1 -- 172.21.15.35:0/3101833185 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000fd90 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.903+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9010ee90 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.905+0000 7fcd877fe700 1 -- 172.21.15.35:0/3101833185 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcd8000f4f0 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.906+0000 7fcd877fe700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7c09f640 0x7fcd7c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.906+0000 7fcd961af700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7c09f640 0x7fcd7c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.906+0000 7fcd877fe700 1 -- 172.21.15.35:0/3101833185 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd800cb4f0 con 0x7fcd900ffd00 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.906+0000 7fcd961af700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7c09f640 0x7fcd7c0a1af0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005fd0 tx=0x7fcd8c005f60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 Processor -- start 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 -- start start 2023-03-17T10:23:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f6bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6c4f0 0x55e414f66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f66960 0x55e414f66d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414e6d010 con 0x55e414f6bbe0 2023-03-17T10:23:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414ebf950 con 0x55e414f66960 2023-03-17T10:23:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414eb8de0 con 0x55e414f6c4f0 2023-03-17T10:23:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcd961af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f6bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcd961af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f6bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50048/0 (socket says 172.21.15.35:50048) 2023-03-17T10:23:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.907+0000 7fcd961af700 1 -- 172.21.15.35:0/563934621 learned_addr learned my addr 172.21.15.35:0/563934621 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd969b0700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f66960 0x55e414f66d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd959ae700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6c4f0 0x55e414f66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd961af700 1 -- 172.21.15.35:0/563934621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6c4f0 msgr2=0x55e414f66420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd961af700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6c4f0 0x55e414f66420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd961af700 1 -- 172.21.15.35:0/563934621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f66960 msgr2=0x55e414f66d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:02.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd961af700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f66960 0x55e414f66d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd961af700 1 -- 172.21.15.35:0/563934621 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e414d3a5d0 con 0x55e414f6bbe0 2023-03-17T10:23:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd959ae700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6c4f0 0x55e414f66420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:23:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd969b0700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f66960 0x55e414f66d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd961af700 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f6bfb0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00fc90 tx=0x7fcd8c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92903a69ab9740e0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd84dae700 1 -- 172.21.15.35:0/563934621 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c011b80 con 0x55e414f6bbe0 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd84dae700 1 -- 172.21.15.35:0/563934621 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd8c011ce0 con 0x55e414f6bbe0 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.908+0000 7fcd84dae700 1 -- 172.21.15.35:0/563934621 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c01d610 con 0x55e414f6bbe0 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 -- 172.21.15.35:0/563934621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 msgr2=0x55e414f6bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f6bfb0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00fc90 tx=0x7fcd8c012000 comp rx=0 tx=0).stop 2023-03-17T10:23:04.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 -- 172.21.15.35:0/563934621 shutdown_connections 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f66960 0x55e414f66d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f6bfb0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/563934621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6c4f0 0x55e414f66420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 -- 172.21.15.35:0/563934621 >> 172.21.15.35:0/563934621 conn(0x55e414dc36b0 msgr2=0x55e414f60a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 -- 172.21.15.35:0/563934621 shutdown_connections 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 -- 172.21.15.35:0/563934621 wait complete. 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 -- start start 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.909+0000 7fcda45a0b80 1 Processor -- start 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f6f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f6fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414d3c8c0 con 0x55e414f66960 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414f704a0 con 0x55e414f6c4f0 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414f80440 con 0x55e414f6bbe0 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcda45a0b80 10 client.0 _ll_register_callbacks cb 0x55e414d5e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:23:04.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50054/0 (socket says 172.21.15.35:50054) 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 -- 172.21.15.35:0/4111669370 learned_addr learned my addr 172.21.15.35:0/4111669370 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd959ae700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f6f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd969b0700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f6fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 -- 172.21.15.35:0/4111669370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 msgr2=0x55e414f6f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f6f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 -- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 msgr2=0x55e414f6fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:04.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f6fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 -- 172.21.15.35:0/4111669370 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c00f970 con 0x55e414f66960 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd961af700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f724b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c011e00 tx=0x7fcd8c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8227f5dd125f79ef server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.910+0000 7fcd79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcd79ffb700 1 -- 172.21.15.35:0/4111669370 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c02d070 con 0x55e414f66960 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcd79ffb700 1 -- 172.21.15.35:0/4111669370 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd8c005260 con 0x55e414f66960 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e414e7b390 con 0x55e414f66960 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcd79ffb700 1 -- 172.21.15.35:0/4111669370 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd8c005460 con 0x55e414f66960 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 10 client.18660 fetch_fsmap learned FSMap version 41 2023-03-17T10:23:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55e414ce6d80 con 0x55e414f66960 2023-03-17T10:23:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcd79ffb700 1 -- 172.21.15.35:0/4111669370 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e414e7b390 con 0x55e414f66960 2023-03-17T10:23:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcd79ffb700 1 -- 172.21.15.35:0/4111669370 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd8c0049b0 con 0x55e414f66960 2023-03-17T10:23:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 10 client.18660 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 10 client.18660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 20 client.18660 populate_metadata read hostname 'smithi035' 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414f84270 0x55e414f86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 4 client.18660 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e414e87600 con 0x55e414f84270 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.911+0000 7fcd959ae700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414f84270 0x55e414f86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.912+0000 7fcd79ffb700 10 client.18660 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.912+0000 7fcd959ae700 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414f84270 0x55e414f86680 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f0e248f36ce6ead server_cookie=3c4b2e44e6697017 in_seq=0 out_seq=0 2023-03-17T10:23:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.912+0000 7fcd79ffb700 1 -- 172.21.15.35:0/4111669370 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e414e87600 con 0x55e414f84270 2023-03-17T10:23:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.912+0000 7fcd79ffb700 10 client.18660 handle_command_reply: tid=0 2023-03-17T10:23:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 client.18660 shutdown 2023-03-17T10:23:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 msgr2=0x55e414f724b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:07.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f724b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c011e00 tx=0x7fcd8c011e30 comp rx=0 tx=0).stop 2023-03-17T10:23:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 shutdown_connections 2023-03-17T10:23:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414f84270 0x55e414f86680 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f724b0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/4111669370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f6f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcd79ffb700 0 client.18660 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:23:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 >> 172.21.15.35:0/4111669370 conn(0x55e414dc36b0 msgr2=0x55e414f65410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 shutdown_connections 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 1 -- 172.21.15.35:0/4111669370 wait complete. 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.913+0000 7fcda45a0b80 20 client.18660 trim_cache size 0 max 16384 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 Processor -- start 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 -- start start 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f60ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f76f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f71fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414f61000 con 0x55e414f66960 2023-03-17T10:23:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414f667a0 con 0x55e414f6c4f0 2023-03-17T10:23:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414f706b0 con 0x55e414f6bbe0 2023-03-17T10:23:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f60ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f60ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50062/0 (socket says 172.21.15.35:50062) 2023-03-17T10:23:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 -- 172.21.15.35:0/892549378 learned_addr learned my addr 172.21.15.35:0/892549378 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd969b0700 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f71fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 -- 172.21.15.35:0/892549378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 msgr2=0x55e414f76f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd959ae700 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f76f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f76f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 -- 172.21.15.35:0/892549378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 msgr2=0x55e414f71fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f71fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.928+0000 7fcd961af700 1 -- 172.21.15.35:0/892549378 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e414e7f130 con 0x55e414f66960 2023-03-17T10:23:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcd961af700 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f60ac0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005020 tx=0x7fcd8c004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407918171a560461 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcd855af700 1 -- 172.21.15.35:0/892549378 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c02d040 con 0x55e414f66960 2023-03-17T10:23:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcd855af700 1 -- 172.21.15.35:0/892549378 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd8c0324b0 con 0x55e414f66960 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcd855af700 1 -- 172.21.15.35:0/892549378 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c032a60 con 0x55e414f66960 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 -- 172.21.15.35:0/892549378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 msgr2=0x55e414f60ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f60ac0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005020 tx=0x7fcd8c004f00 comp rx=0 tx=0).stop 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 -- 172.21.15.35:0/892549378 shutdown_connections 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414f71fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f66960 0x55e414f60ac0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/892549378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f6bbe0 0x55e414f76f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 -- 172.21.15.35:0/892549378 >> 172.21.15.35:0/892549378 conn(0x55e414dc36b0 msgr2=0x55e414f65a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 -- 172.21.15.35:0/892549378 shutdown_connections 2023-03-17T10:23:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.929+0000 7fcda45a0b80 1 -- 172.21.15.35:0/892549378 wait complete. 2023-03-17T10:23:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 -- start start 2023-03-17T10:23:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 Processor -- start 2023-03-17T10:23:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f66960 0x55e414f75150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f75690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414fd7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414fd7650 con 0x55e414f6bbe0 2023-03-17T10:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414fd7790 con 0x55e414f6c4f0 2023-03-17T10:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e414fd7900 con 0x55e414f66960 2023-03-17T10:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcda45a0b80 10 client.0 _ll_register_callbacks cb 0x55e414d5e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd959ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f75690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd959ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f75690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50070/0 (socket says 172.21.15.35:50070) 2023-03-17T10:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd961af700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f66960 0x55e414f75150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd959ae700 1 -- 172.21.15.35:0/1110435375 learned_addr learned my addr 172.21.15.35:0/1110435375 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd969b0700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414fd7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd959ae700 1 -- 172.21.15.35:0/1110435375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f66960 msgr2=0x55e414f75150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.930+0000 7fcd959ae700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f66960 0x55e414f75150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd959ae700 1 -- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 msgr2=0x55e414fd7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd959ae700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414fd7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd959ae700 1 -- 172.21.15.35:0/1110435375 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e414ce6d80 con 0x55e414f6bbe0 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd961af700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f66960 0x55e414f75150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd959ae700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f75690 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fcd800c9280 tx=0x7fcd80003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20775d5df7487a20 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd79ffb700 1 -- 172.21.15.35:0/1110435375 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800a1190 con 0x55e414f6bbe0 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd79ffb700 1 -- 172.21.15.35:0/1110435375 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd80099290 con 0x55e414f6bbe0 2023-03-17T10:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e414f361e0 con 0x55e414f6bbe0 2023-03-17T10:23:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd79ffb700 1 -- 172.21.15.35:0/1110435375 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd80099450 con 0x55e414f6bbe0 2023-03-17T10:23:14.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 10 client.18666 fetch_fsmap learned FSMap version 41 2023-03-17T10:23:14.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55e414d0d1f0 con 0x55e414f6bbe0 2023-03-17T10:23:14.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd79ffb700 1 -- 172.21.15.35:0/1110435375 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e414f361e0 con 0x55e414f6bbe0 2023-03-17T10:23:14.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcd79ffb700 1 -- 172.21.15.35:0/1110435375 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd800a0d00 con 0x55e414f6bbe0 2023-03-17T10:23:14.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 10 client.18666 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:23:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 10 client.18666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 20 client.18666 populate_metadata read hostname 'smithi035' 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414fd8cb0 0x55e414fdb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 4 client.18666 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.931+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e414d3cf00 con 0x55e414fd8cb0 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.932+0000 7fcd961af700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414fd8cb0 0x55e414fdb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.932+0000 7fcd961af700 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414fd8cb0 0x55e414fdb0c0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7d40ea6e6cf1f26 server_cookie=a06a28ed31a3cd3e in_seq=0 out_seq=0 2023-03-17T10:23:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.932+0000 7fcd79ffb700 10 client.18666 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:23:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.936+0000 7fcd79ffb700 1 -- 172.21.15.35:0/1110435375 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e414d3cf00 con 0x55e414fd8cb0 2023-03-17T10:23:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.936+0000 7fcd79ffb700 10 client.18666 handle_command_reply: tid=0 2023-03-17T10:23:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 client.18666 shutdown 2023-03-17T10:23:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 msgr2=0x55e414f75690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f75690 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fcd800c9280 tx=0x7fcd80003920 comp rx=0 tx=0).stop 2023-03-17T10:23:17.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 shutdown_connections 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e414fd8cb0 0x55e414fdb0c0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e414f6c4f0 0x55e414fd7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e414f66960 0x55e414f75150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 --2- 172.21.15.35:0/1110435375 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e414f6bbe0 0x55e414f75690 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 >> 172.21.15.35:0/1110435375 conn(0x55e414dc36b0 msgr2=0x55e414f696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcd79ffb700 0 client.18666 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 shutdown_connections 2023-03-17T10:23:17.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 1 -- 172.21.15.35:0/1110435375 wait complete. 2023-03-17T10:23:17.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcda45a0b80 20 client.18666 trim_cache size 0 max 16384 2023-03-17T10:23:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7c09f640 msgr2=0x7fcd7c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcd98413700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7c09f640 0x7fcd7c0a1af0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005fd0 tx=0x7fcd8c005f60 comp rx=0 tx=0).stop 2023-03-17T10:23:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 msgr2=0x7fcd90197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.937+0000 7fcd98413700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90197620 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009990 tx=0x7fcd80009510 comp rx=0 tx=0).stop 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 shutdown_connections 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7c09f640 0x7fcd7c0a1af0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd901043a0 0x7fcd901a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd900ff360 0x7fcd901970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 --2- 172.21.15.35:0/3101833185 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd900ffd00 0x7fcd90197620 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 >> 172.21.15.35:0/3101833185 conn(0x7fcd900761c0 msgr2=0x7fcd900fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 shutdown_connections 2023-03-17T10:23:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:34.938+0000 7fcd98413700 1 -- 172.21.15.35:0/3101833185 wait complete. 2023-03-17T10:23:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 -- 172.21.15.35:0/1790954835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88800ff350 msgr2=0x7f88800ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 --2- 172.21.15.35:0/1790954835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88800ff350 0x7f88800ff720 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f88700099c0 tx=0x7f8870009cd0 comp rx=0 tx=0).stop 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 -- 172.21.15.35:0/1790954835 shutdown_connections 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 --2- 172.21.15.35:0/1790954835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8880104390 0x7f888010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 --2- 172.21.15.35:0/1790954835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88800ff350 0x7f88800ff720 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 --2- 172.21.15.35:0/1790954835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88800ffcf0 0x7f8880103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.060+0000 7f88887a7700 1 -- 172.21.15.35:0/1790954835 >> 172.21.15.35:0/1790954835 conn(0x7f8880076330 msgr2=0x7f8880076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 -- 172.21.15.35:0/1790954835 shutdown_connections 2023-03-17T10:23:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 -- 172.21.15.35:0/1790954835 wait complete. 2023-03-17T10:23:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 Processor -- start 2023-03-17T10:23:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 -- start start 2023-03-17T10:23:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88800ff350 0x7f88801962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800ffcf0 0x7f8880196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 0x7f888019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888019b2a0 con 0x7f8880104390 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888019b410 con 0x7f88800ff350 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.061+0000 7f88887a7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888019b5d0 con 0x7f88800ffcf0 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 0x7f888019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 0x7f888019ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50086/0 (socket says 172.21.15.35:50086) 2023-03-17T10:23:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 -- 172.21.15.35:0/3919735395 learned_addr learned my addr 172.21.15.35:0/3919735395 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8885d42700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800ffcf0 0x7f8880196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886543700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88800ff350 0x7f88801962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 -- 172.21.15.35:0/3919735395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800ffcf0 msgr2=0x7f8880196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800ffcf0 0x7f8880196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 -- 172.21.15.35:0/3919735395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88800ff350 msgr2=0x7f88801962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:26.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88800ff350 0x7f88801962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:26.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 -- 172.21.15.35:0/3919735395 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700095f0 con 0x7f8880104390 2023-03-17T10:23:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f8886d44700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 0x7f888019ac60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f887800ef30 tx=0x7f887800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f88777fe700 1 -- 172.21.15.35:0/3919735395 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878018070 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888010f000 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f88777fe700 1 -- 172.21.15.35:0/3919735395 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f887800f040 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f88777fe700 1 -- 172.21.15.35:0/3919735395 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800cc70 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.062+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888010ee70 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.065+0000 7f88777fe700 1 -- 172.21.15.35:0/3919735395 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8878007500 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.066+0000 7f88777fe700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f886c09f640 0x7f886c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.066+0000 7f88777fe700 1 -- 172.21.15.35:0/3919735395 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88780ca1d0 con 0x7f8880104390 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.066+0000 7f8886543700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f886c09f640 0x7f886c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8886543700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f886c09f640 0x7f886c0a1af0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f887000b580 tx=0x7f887001a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 Processor -- start 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 -- start start 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e2d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d2960 0x55b70e2d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e1d9010 con 0x55b70e2d7be0 2023-03-17T10:23:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e22b950 con 0x55b70e2d2960 2023-03-17T10:23:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8894934b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e224de0 con 0x55b70e2d84f0 2023-03-17T10:23:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2d7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50090/0 (socket says 172.21.15.35:50090) 2023-03-17T10:23:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.067+0000 7f8886543700 1 -- 172.21.15.35:0/3962006604 learned_addr learned my addr 172.21.15.35:0/3962006604 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:31.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886d44700 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d2960 0x55b70e2d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8885d42700 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e2d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886543700 1 -- 172.21.15.35:0/3962006604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 msgr2=0x55b70e2d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886543700 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e2d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886543700 1 -- 172.21.15.35:0/3962006604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d2960 msgr2=0x55b70e2d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886543700 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d2960 0x55b70e2d2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886543700 1 -- 172.21.15.35:0/3962006604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b70e0a65d0 con 0x55b70e2d7be0 2023-03-17T10:23:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8886543700 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2d7fb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f887000bad0 tx=0x7f887001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d7f0863e826870 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8874ff9700 1 -- 172.21.15.35:0/3962006604 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887001d040 con 0x55b70e2d7be0 2023-03-17T10:23:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8874ff9700 1 -- 172.21.15.35:0/3962006604 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8870029040 con 0x55b70e2d7be0 2023-03-17T10:23:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.068+0000 7f8874ff9700 1 -- 172.21.15.35:0/3962006604 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870023c60 con 0x55b70e2d7be0 2023-03-17T10:23:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 -- 172.21.15.35:0/3962006604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 msgr2=0x55b70e2d7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:23:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2d7fb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f887000bad0 tx=0x7f887001e000 comp rx=0 tx=0).stop 2023-03-17T10:23:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 -- 172.21.15.35:0/3962006604 shutdown_connections 2023-03-17T10:23:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d2960 0x55b70e2d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2d7fb0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 --2- 172.21.15.35:0/3962006604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e2d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 -- 172.21.15.35:0/3962006604 >> 172.21.15.35:0/3962006604 conn(0x55b70e12f6b0 msgr2=0x55b70e2cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:23:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 -- 172.21.15.35:0/3962006604 shutdown_connections 2023-03-17T10:23:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 -- 172.21.15.35:0/3962006604 wait complete. 2023-03-17T10:23:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 -- start start 2023-03-17T10:23:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.069+0000 7f8894934b80 1 Processor -- start 2023-03-17T10:23:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 0x55b70e2de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d7be0 0x55b70e2db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:23:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e0a88c0 con 0x55b70e2d2960 2023-03-17T10:23:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2dc430 con 0x55b70e2d84f0 2023-03-17T10:23:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2e7fa0 con 0x55b70e2d7be0 2023-03-17T10:23:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8894934b80 10 client.0 _ll_register_callbacks cb 0x55b70e0ca230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:23:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 0x55b70e2de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 0x55b70e2de430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50096/0 (socket says 172.21.15.35:50096) 2023-03-17T10:23:43.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 -- 172.21.15.35:0/3145170773 learned_addr learned my addr 172.21.15.35:0/3145170773 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:23:43.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886d44700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8885d42700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d7be0 0x55b70e2db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:23:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 -- 172.21.15.35:0/3145170773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d7be0 msgr2=0x55b70e2db6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d7be0 0x55b70e2db6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 -- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 msgr2=0x55b70e2dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:23:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:23:45.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 -- 172.21.15.35:0/3145170773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888010c7a0 con 0x55b70e2d2960 2023-03-17T10:23:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8885d42700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d7be0 0x55b70e2db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:23:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8886543700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 0x55b70e2de430 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8870023640 tx=0x7f8870005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c997d95cfa47b89 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:23:45.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:09 smithi035 ceph-mon[92535]: osdmap e253: 12 total, 12 up, 12 in 2023-03-17T10:23:48.094 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:09 smithi035 ceph-mon[92535]: pgmap v2843: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:23:48.094 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:11 smithi035 ceph-mon[92535]: pgmap v2844: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:23:48.094 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:13 smithi035 ceph-mon[92535]: pgmap v2845: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:23:48.095 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:15 smithi035 ceph-mon[92535]: pgmap v2846: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:23:48.095 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:17 smithi035 ceph-mon[92535]: osdmap e254: 12 total, 12 up, 12 in 2023-03-17T10:23:48.095 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:17 smithi035 ceph-mon[92535]: pgmap v2848: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 874 B/s wr, 7 op/s 2023-03-17T10:23:48.095 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:19 smithi035 ceph-mon[92535]: pgmap v2849: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:23:49.532 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:21 smithi035 ceph-mon[92535]: pgmap v2850: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T10:23:49.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:23 smithi035 ceph-mon[92535]: pgmap v2851: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:23:49.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:25 smithi035 ceph-mon[92535]: pgmap v2852: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T10:23:49.533 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:27 smithi035 ceph-mon[92535]: pgmap v2853: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 498 B/s wr, 10 op/s 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:29 smithi035 ceph-mon[92535]: pgmap v2854: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:31 smithi035 ceph-mon[92535]: pgmap v2855: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:23:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:32 smithi035 ceph-mon[92535]: pgmap v2856: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:32 smithi035 ceph-mon[92535]: pgmap v2857: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:34 smithi035 ceph-mon[92535]: pgmap v2858: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:36 smithi035 ceph-mon[92535]: pgmap v2859: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:38 smithi035 ceph-mon[92535]: pgmap v2860: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:40 smithi035 ceph-mon[92535]: pgmap v2861: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:42 smithi035 ceph-mon[92535]: pgmap v2862: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:44 smithi035 ceph-mon[92535]: pgmap v2863: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:46 smithi035 ceph-mon[92535]: pgmap v2864: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:48 smithi035 ceph-mon[92535]: pgmap v2865: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:50 smithi035 ceph-mon[92535]: pgmap v2866: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:51.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:52 smithi035 ceph-mon[92535]: pgmap v2867: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:52.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:54 smithi035 ceph-mon[92535]: pgmap v2868: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:23:52.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:56 smithi035 ceph-mon[92535]: pgmap v2869: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:52.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:13:58 smithi035 ceph-mon[92535]: pgmap v2870: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T10:23:52.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:00 smithi035 ceph-mon[92535]: pgmap v2871: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:52.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:02 smithi035 ceph-mon[92535]: pgmap v2872: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:52.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:04 smithi035 ceph-mon[92535]: pgmap v2873: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:06 smithi035 ceph-mon[92535]: pgmap v2874: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:08 smithi035 ceph-mon[92535]: pgmap v2875: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:09 smithi035 ceph-mon[92535]: osdmap e255: 12 total, 12 up, 12 in 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:10 smithi035 ceph-mon[92535]: pgmap v2877: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:12 smithi035 ceph-mon[92535]: pgmap v2878: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:14 smithi035 ceph-mon[92535]: pgmap v2879: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:16 smithi035 ceph-mon[92535]: pgmap v2880: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:16 smithi035 ceph-mon[92535]: osdmap e256: 12 total, 12 up, 12 in 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:18 smithi035 ceph-mon[92535]: pgmap v2882: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:20 smithi035 ceph-mon[92535]: pgmap v2883: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:22 smithi035 ceph-mon[92535]: pgmap v2884: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T10:23:54.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:24 smithi035 ceph-mon[92535]: pgmap v2885: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:23:55.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:26 smithi035 ceph-mon[92535]: pgmap v2886: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:23:55.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:28 smithi035 ceph-mon[92535]: pgmap v2887: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 92 B/s wr, 13 op/s 2023-03-17T10:23:55.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:30 smithi035 ceph-mon[92535]: pgmap v2888: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:55.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: pgmap v2889: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T10:23:56.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:23:56.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:23:56.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:23:56.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: pgmap v2890: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 36 op/s 2023-03-17T10:23:58.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: pgmap v2891: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.5 MiB/s wr, 39 op/s 2023-03-17T10:23:58.051 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:23:58.549 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:34 smithi035 ceph-mon[92535]: pgmap v2892: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.5 MiB/s wr, 39 op/s 2023-03-17T10:23:58.549 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:36 smithi035 ceph-mon[92535]: pgmap v2893: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-03-17T10:23:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:24:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:24:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:24:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:24:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:24:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:24:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:24:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:24:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8869ffb700 1 -- 172.21.15.35:0/3145170773 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000fc80 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.070+0000 7f8869ffb700 1 -- 172.21.15.35:0/3145170773 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f887000fde0 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b70e1e7390 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8869ffb700 1 -- 172.21.15.35:0/3145170773 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8870042470 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 10 client.18678 fetch_fsmap learned FSMap version 41 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b70e052d80 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8869ffb700 1 -- 172.21.15.35:0/3145170773 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b70e1e7390 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8869ffb700 1 -- 172.21.15.35:0/3145170773 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f887002c070 con 0x55b70e2d2960 2023-03-17T10:24:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 10 client.18678 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:24:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 10 client.18678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:24:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 20 client.18678 populate_metadata read hostname 'smithi035' 2023-03-17T10:24:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e2ebb60 0x55b70e2edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 4 client.18678 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:24:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b70e1f3600 con 0x55b70e2ebb60 2023-03-17T10:24:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.071+0000 7f8885d42700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e2ebb60 0x55b70e2edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.072+0000 7f8869ffb700 10 client.18678 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.072+0000 7f8885d42700 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e2ebb60 0x55b70e2edf70 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a690b39831d6084 server_cookie=eafb6f5c96ae4968 in_seq=0 out_seq=0 2023-03-17T10:24:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.072+0000 7f8869ffb700 1 -- 172.21.15.35:0/3145170773 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b70e1f3600 con 0x55b70e2ebb60 2023-03-17T10:24:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.072+0000 7f8869ffb700 10 client.18678 handle_command_reply: tid=0 2023-03-17T10:24:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.072+0000 7f8894934b80 1 client.18678 shutdown 2023-03-17T10:24:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 msgr2=0x55b70e2de430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 0x55b70e2de430 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8870023640 tx=0x7f8870005980 comp rx=0 tx=0).stop 2023-03-17T10:24:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 shutdown_connections 2023-03-17T10:24:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e2ebb60 0x55b70e2edf70 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:04.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d2960 0x55b70e2de430 secure :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8870023640 tx=0x7f8870005980 comp rx=0 tx=0).stop 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 --2- 172.21.15.35:0/3145170773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d7be0 0x55b70e2db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8869ffb700 0 client.18678 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 >> 172.21.15.35:0/3145170773 conn(0x55b70e12f6b0 msgr2=0x55b70e2d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 shutdown_connections 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 1 -- 172.21.15.35:0/3145170773 wait complete. 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.073+0000 7f8894934b80 20 client.18678 trim_cache size 0 max 16384 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.088+0000 7f8894934b80 1 Processor -- start 2023-03-17T10:24:04.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.088+0000 7f8894934b80 1 -- start start 2023-03-17T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.088+0000 7f8894934b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.088+0000 7f8894934b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2e2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.088+0000 7f8894934b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2db810 0x55b70e2e8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8894934b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2c80f0 con 0x55b70e2d7be0 2023-03-17T10:24:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8894934b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2c9b80 con 0x55b70e2d84f0 2023-03-17T10:24:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8894934b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2cd000 con 0x55b70e2db810 2023-03-17T10:24:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50106/0 (socket says 172.21.15.35:50106) 2023-03-17T10:24:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 -- 172.21.15.35:0/3166158625 learned_addr learned my addr 172.21.15.35:0/3166158625 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886d44700 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2db810 0x55b70e2e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8885d42700 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2e2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 -- 172.21.15.35:0/3166158625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2db810 msgr2=0x55b70e2e8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2db810 0x55b70e2e8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 -- 172.21.15.35:0/3166158625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 msgr2=0x55b70e2e2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:07.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2e2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 -- 172.21.15.35:0/3166158625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b70e1eb130 con 0x55b70e2d7be0 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f8886543700 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2ccac0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f887000f740 tx=0x7f8870023dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac1cd3c880e0555 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f88757fa700 1 -- 172.21.15.35:0/3166158625 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887001d070 con 0x55b70e2d7be0 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f88757fa700 1 -- 172.21.15.35:0/3166158625 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8870029040 con 0x55b70e2d7be0 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.089+0000 7f88757fa700 1 -- 172.21.15.35:0/3166158625 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870016db0 con 0x55b70e2d7be0 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 -- 172.21.15.35:0/3166158625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 msgr2=0x55b70e2ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2ccac0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f887000f740 tx=0x7f8870023dc0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 -- 172.21.15.35:0/3166158625 shutdown_connections 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2db810 0x55b70e2e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e2ccac0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 --2- 172.21.15.35:0/3166158625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2d84f0 0x55b70e2e2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 -- 172.21.15.35:0/3166158625 >> 172.21.15.35:0/3166158625 conn(0x55b70e12f6b0 msgr2=0x55b70e2d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 -- 172.21.15.35:0/3166158625 shutdown_connections 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 -- 172.21.15.35:0/3166158625 wait complete. 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 -- start start 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.090+0000 7f8894934b80 1 Processor -- start 2023-03-17T10:24:08.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e338d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e3392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2db810 0x55b70e2e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2e14a0 con 0x55b70e2d7be0 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2e1610 con 0x55b70e2db810 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70e2e17d0 con 0x55b70e2d84f0 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8894934b80 10 client.0 _ll_register_callbacks cb 0x55b70e0ca230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e338d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e338d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50110/0 (socket says 172.21.15.35:50110) 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 -- 172.21.15.35:0/3644048726 learned_addr learned my addr 172.21.15.35:0/3644048726 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886d44700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2db810 0x55b70e2e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8885d42700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e3392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 -- 172.21.15.35:0/3644048726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 msgr2=0x55b70e3392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e3392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 -- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2db810 msgr2=0x55b70e2e0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2db810 0x55b70e2e0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 -- 172.21.15.35:0/3644048726 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b70e052d80 con 0x55b70e2d7be0 2023-03-17T10:24:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8886543700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e338d90 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f8870036da0 tx=0x7f8870036dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3317d13b74f4a568 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:24:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.091+0000 7f8869ffb700 1 -- 172.21.15.35:0/3644048726 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887001d040 con 0x55b70e2d7be0 2023-03-17T10:24:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8869ffb700 1 -- 172.21.15.35:0/3644048726 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f887000fa80 con 0x55b70e2d7be0 2023-03-17T10:24:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b70e2a21e0 con 0x55b70e2d7be0 2023-03-17T10:24:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8869ffb700 1 -- 172.21.15.35:0/3644048726 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8870016e50 con 0x55b70e2d7be0 2023-03-17T10:24:10.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 10 client.18684 fetch_fsmap learned FSMap version 41 2023-03-17T10:24:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b70e0791f0 con 0x55b70e2d7be0 2023-03-17T10:24:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8869ffb700 1 -- 172.21.15.35:0/3644048726 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b70e2a21e0 con 0x55b70e2d7be0 2023-03-17T10:24:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8869ffb700 1 -- 172.21.15.35:0/3644048726 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f887002c070 con 0x55b70e2d7be0 2023-03-17T10:24:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 10 client.18684 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:24:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 10 client.18684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 20 client.18684 populate_metadata read hostname 'smithi035' 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e340690 0x55b70e342a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 4 client.18684 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b70e0a8f00 con 0x55b70e340690 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.092+0000 7f8885d42700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e340690 0x55b70e342a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.093+0000 7f8869ffb700 10 client.18684 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.093+0000 7f8885d42700 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e340690 0x55b70e342a70 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0568c1ce2ba6b84 server_cookie=2e93066532c63b44 in_seq=0 out_seq=0 2023-03-17T10:24:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.097+0000 7f8869ffb700 1 -- 172.21.15.35:0/3644048726 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b70e0a8f00 con 0x55b70e340690 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.097+0000 7f8869ffb700 10 client.18684 handle_command_reply: tid=0 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.097+0000 7f8894934b80 1 client.18684 shutdown 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 msgr2=0x55b70e338d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e338d90 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f8870036da0 tx=0x7f8870036dd0 comp rx=0 tx=0).stop 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 shutdown_connections 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b70e340690 0x55b70e342a70 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b70e2db810 0x55b70e2e0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b70e2d7be0 0x55b70e338d90 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8869ffb700 0 client.18684 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 --2- 172.21.15.35:0/3644048726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b70e2d84f0 0x55b70e3392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 >> 172.21.15.35:0/3644048726 conn(0x55b70e12f6b0 msgr2=0x55b70e2e8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 shutdown_connections 2023-03-17T10:24:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 1 -- 172.21.15.35:0/3644048726 wait complete. 2023-03-17T10:24:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f8894934b80 20 client.18684 trim_cache size 0 max 16384 2023-03-17T10:24:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f886c09f640 msgr2=0x7f886c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f886c09f640 0x7f886c0a1af0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f887000b580 tx=0x7f887001a040 comp rx=0 tx=0).stop 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 msgr2=0x7f888019ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 0x7f888019ac60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f887800ef30 tx=0x7f887800c3a0 comp rx=0 tx=0).stop 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 shutdown_connections 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f886c09f640 0x7f886c0a1af0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8880104390 0x7f888019ac60 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:15.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88800ff350 0x7f88801962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 --2- 172.21.15.35:0/3919735395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88800ffcf0 0x7f8880196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:15.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.098+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 >> 172.21.15.35:0/3919735395 conn(0x7f8880076330 msgr2=0x7f8880068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.099+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 shutdown_connections 2023-03-17T10:24:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T09:59:48.099+0000 7f88887a7700 1 -- 172.21.15.35:0/3919735395 wait complete. 2023-03-17T10:24:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 -- 172.21.15.35:0/1799088591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 msgr2=0x7f44e0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 --2- 172.21.15.35:0/1799088591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e0103cb0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f44c80099c0 tx=0x7f44c8009cd0 comp rx=0 tx=0).stop 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 -- 172.21.15.35:0/1799088591 shutdown_connections 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 --2- 172.21.15.35:0/1799088591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104390 0x7f44e010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 --2- 172.21.15.35:0/1799088591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44e00ff350 0x7f44e00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 --2- 172.21.15.35:0/1799088591 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e0103cb0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 -- 172.21.15.35:0/1799088591 >> 172.21.15.35:0/1799088591 conn(0x7f44e0076330 msgr2=0x7f44e0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 -- 172.21.15.35:0/1799088591 shutdown_connections 2023-03-17T10:24:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.217+0000 7f44e4b89700 1 -- 172.21.15.35:0/1799088591 wait complete. 2023-03-17T10:24:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 Processor -- start 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 -- start start 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44e00ff350 0x7f44e010c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e010cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104390 0x7f44e01a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e010d5e0 con 0x7f44e00ffcf0 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01a49b0 con 0x7f44e00ff350 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44e4b89700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e01a4af0 con 0x7f44e0104390 2023-03-17T10:24:19.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e010cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e010cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50168/0 (socket says 172.21.15.35:50168) 2023-03-17T10:24:19.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2417816460 learned_addr learned my addr 172.21.15.35:0/2417816460 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44de59c700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44e00ff350 0x7f44e010c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.218+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104390 0x7f44e01a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:21.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2417816460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104390 msgr2=0x7f44e01a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104390 0x7f44e01a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2417816460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44e00ff350 msgr2=0x7f44e010c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44e00ff350 0x7f44e010c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2417816460 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80095f0 con 0x7f44e00ffcf0 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e010cdb0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f44c800b580 tx=0x7f44c8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44d77fe700 1 -- 172.21.15.35:0/2417816460 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c801d070 con 0x7f44e00ffcf0 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44d77fe700 1 -- 172.21.15.35:0/2417816460 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c8003f40 con 0x7f44e00ffcf0 2023-03-17T10:24:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e0110170 con 0x7f44e00ffcf0 2023-03-17T10:24:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44d77fe700 1 -- 172.21.15.35:0/2417816460 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8022b10 con 0x7f44e00ffcf0 2023-03-17T10:24:21.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.219+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e010ffe0 con 0x7f44e00ffcf0 2023-03-17T10:24:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.221+0000 7f44d77fe700 1 -- 172.21.15.35:0/2417816460 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f44c80040b0 con 0x7f44e00ffcf0 2023-03-17T10:24:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.222+0000 7f44d77fe700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f44cc09f6c0 0x7f44cc0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.222+0000 7f44d77fe700 1 -- 172.21.15.35:0/2417816460 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f44c80cbaf0 con 0x7f44e00ffcf0 2023-03-17T10:24:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.222+0000 7f44de59c700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f44cc09f6c0 0x7f44cc0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout:0 of 1 processes prepared for launch 0 sec 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout:1 of 1 processes prepared for launch 0 sec 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout:releasing clients 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 1 904 21.68 MB/sec warmup 1 sec latency 10.497 ms 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 1 1589 13.08 MB/sec warmup 2 sec latency 13.535 ms 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 1 2321 9.27 MB/sec warmup 3 sec latency 13.892 ms 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 1 3169 8.53 MB/sec warmup 4 sec latency 14.244 ms 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 1 3695 7.75 MB/sec warmup 5 sec latency 13.805 ms 2023-03-17T10:24:29.304 INFO:tasks.workunit.client.0.smithi035.stdout: 1 4112 6.68 MB/sec warmup 6 sec latency 16.642 ms 2023-03-17T10:24:29.305 INFO:tasks.workunit.client.0.smithi035.stdout: 1 4684 6.01 MB/sec warmup 7 sec latency 14.193 ms 2023-03-17T10:24:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.222+0000 7f44de59c700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f44cc09f6c0 0x7f44cc0a1b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f44d0007be0 tx=0x7f44d00073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 Processor -- start 2023-03-17T10:24:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 -- start start 2023-03-17T10:24:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53ad4f0 0x5637e53a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e52ae010 con 0x5637e53a7960 2023-03-17T10:24:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e5300950 con 0x5637e53ad4f0 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e52f9de0 con 0x5637e53acbe0 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44ded9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44ded9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53a7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50178/0 (socket says 172.21.15.35:50178) 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44ded9d700 1 -- 172.21.15.35:0/2987573710 learned_addr learned my addr 172.21.15.35:0/2987573710 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.223+0000 7f44de59c700 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53ad4f0 0x5637e53a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ded9d700 1 -- 172.21.15.35:0/2987573710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 msgr2=0x5637e53acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ded9d700 1 -- 172.21.15.35:0/2987573710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53ad4f0 msgr2=0x5637e53a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53ad4f0 0x5637e53a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ded9d700 1 -- 172.21.15.35:0/2987573710 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e517b5d0 con 0x5637e53a7960 2023-03-17T10:24:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53ad4f0 0x5637e53a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53a7d90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009cf0 tx=0x7f44d8007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f300bf19a01b231 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44d4ff9700 1 -- 172.21.15.35:0/2987573710 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8018070 con 0x5637e53a7960 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44d4ff9700 1 -- 172.21.15.35:0/2987573710 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44d800f050 con 0x5637e53a7960 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.224+0000 7f44d4ff9700 1 -- 172.21.15.35:0/2987573710 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8005860 con 0x5637e53a7960 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2987573710 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 msgr2=0x5637e53a7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53a7d90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009cf0 tx=0x7f44d8007500 comp rx=0 tx=0).stop 2023-03-17T10:24:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2987573710 shutdown_connections 2023-03-17T10:24:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53a7d90 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2987573710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53ad4f0 0x5637e53a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2987573710 >> 172.21.15.35:0/2987573710 conn(0x5637e52046b0 msgr2=0x5637e53a1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2987573710 shutdown_connections 2023-03-17T10:24:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2987573710 wait complete. 2023-03-17T10:24:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 -- start start 2023-03-17T10:24:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.225+0000 7f44f0d16b80 1 Processor -- start 2023-03-17T10:24:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53acbe0 0x5637e53b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53ad4f0 0x5637e53b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e517d8c0 con 0x5637e53a7960 2023-03-17T10:24:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e53b1320 con 0x5637e53acbe0 2023-03-17T10:24:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e53b14e0 con 0x5637e53ad4f0 2023-03-17T10:24:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 10 client.0 _ll_register_callbacks cb 0x5637e519f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50180/0 (socket says 172.21.15.35:50180) 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 -- 172.21.15.35:0/3133489595 learned_addr learned my addr 172.21.15.35:0/3133489595 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44ded9d700 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53ad4f0 0x5637e53b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 -- 172.21.15.35:0/3133489595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53ad4f0 msgr2=0x5637e53b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53ad4f0 0x5637e53b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 -- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53acbe0 msgr2=0x5637e53b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53acbe0 0x5637e53b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 -- 172.21.15.35:0/3133489595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d8009920 con 0x5637e53a7960 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44de59c700 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b3430 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f44d00042e0 tx=0x7f44d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0b3a963a3c0c8d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44c5ffb700 1 -- 172.21.15.35:0/3133489595 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0003d10 con 0x5637e53a7960 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44c5ffb700 1 -- 172.21.15.35:0/3133489595 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f44d0017070 con 0x5637e53a7960 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637e52bc390 con 0x5637e53a7960 2023-03-17T10:24:36.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44c5ffb700 1 -- 172.21.15.35:0/3133489595 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44d0003e70 con 0x5637e53a7960 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 10 client.18714 fetch_fsmap learned FSMap version 41 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.226+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5637e5127d80 con 0x5637e53a7960 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44c5ffb700 1 -- 172.21.15.35:0/3133489595 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637e52bc390 con 0x5637e53a7960 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44c5ffb700 1 -- 172.21.15.35:0/3133489595 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f44d0020410 con 0x5637e53a7960 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44f0d16b80 10 client.18714 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44f0d16b80 10 client.18714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44f0d16b80 20 client.18714 populate_metadata read hostname 'smithi035' 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53c0fc0 0x5637e53c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44f0d16b80 4 client.18714 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637e52c8600 con 0x5637e53c0fc0 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.227+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53c0fc0 0x5637e53c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44c5ffb700 10 client.18714 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53c0fc0 0x5637e53c33d0 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417f6bc6a2fd04a9 server_cookie=f9080e531bac6e92 in_seq=0 out_seq=0 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44c5ffb700 1 -- 172.21.15.35:0/3133489595 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5637e52c8600 con 0x5637e53c0fc0 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44c5ffb700 10 client.18714 handle_command_reply: tid=0 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 client.18714 shutdown 2023-03-17T10:24:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 msgr2=0x5637e53b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b3430 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f44d00042e0 tx=0x7f44d00047c0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 shutdown_connections 2023-03-17T10:24:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53c0fc0 0x5637e53c33d0 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53ad4f0 0x5637e53b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44c5ffb700 0 client.18714 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b3430 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/3133489595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53acbe0 0x5637e53b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 >> 172.21.15.35:0/3133489595 conn(0x5637e52046b0 msgr2=0x5637e53a1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 shutdown_connections 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.228+0000 7f44f0d16b80 1 -- 172.21.15.35:0/3133489595 wait complete. 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.229+0000 7f44f0d16b80 20 client.18714 trim_cache size 0 max 16384 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 Processor -- start 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 -- start start 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e52046b0 0x5637e53a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53a7960 0x5637e53ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 0x5637e53a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e539d0f0 con 0x5637e53acbe0 2023-03-17T10:24:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e53be6a0 con 0x5637e53a7960 2023-03-17T10:24:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.243+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e53a2000 con 0x5637e52046b0 2023-03-17T10:24:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 0x5637e53a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 0x5637e53a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50190/0 (socket says 172.21.15.35:50190) 2023-03-17T10:24:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 -- 172.21.15.35:0/2104354886 learned_addr learned my addr 172.21.15.35:0/2104354886 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 -- 172.21.15.35:0/2104354886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e52046b0 msgr2=0x5637e53a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44de59c700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e52046b0 0x5637e53a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e52046b0 0x5637e53a7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 -- 172.21.15.35:0/2104354886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53a7960 msgr2=0x5637e53ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53a7960 0x5637e53ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53a7960 0x5637e53ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 -- 172.21.15.35:0/2104354886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e52c0130 con 0x5637e53acbe0 2023-03-17T10:24:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44de59c700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e52046b0 0x5637e53a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:24:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53a7960 0x5637e53ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:24:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 0x5637e53a1ac0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f44d8017000 tx=0x7f44d80096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfa0b7d6a2bec7f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44d57fa700 1 -- 172.21.15.35:0/2104354886 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8018040 con 0x5637e53acbe0 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44d57fa700 1 -- 172.21.15.35:0/2104354886 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44d8019040 con 0x5637e53acbe0 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.244+0000 7f44d57fa700 1 -- 172.21.15.35:0/2104354886 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8014670 con 0x5637e53acbe0 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2104354886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 msgr2=0x5637e53a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 0x5637e53a1ac0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f44d8017000 tx=0x7f44d80096c0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2104354886 shutdown_connections 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53acbe0 0x5637e53a1ac0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e52046b0 0x5637e53a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2104354886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e53a7960 0x5637e53ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2104354886 >> 172.21.15.35:0/2104354886 conn(0x5637e53bca40 msgr2=0x5637e53aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2104354886 shutdown_connections 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2104354886 wait complete. 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- start start 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 Processor -- start 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e52046b0 0x5637e53b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e53b4fe0 con 0x5637e53a7960 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e53b5150 con 0x5637e52046b0 2023-03-17T10:24:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.245+0000 7f44f0d16b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e5414e60 con 0x5637e53acbe0 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44f0d16b80 10 client.0 _ll_register_callbacks cb 0x5637e519f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50196/0 (socket says 172.21.15.35:50196) 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2871322815 learned_addr learned my addr 172.21.15.35:0/2871322815 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44de59c700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e52046b0 0x5637e53b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ded9d700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2871322815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 msgr2=0x5637e53b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:38.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e52046b0 msgr2=0x5637e53b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:38.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e52046b0 0x5637e53b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:38.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 -- 172.21.15.35:0/2871322815 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637e517b5d0 con 0x5637e53a7960 2023-03-17T10:24:38.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44de59c700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e52046b0 0x5637e53b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:24:38.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44ddd9b700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b4370 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c92e0 tx=0x7f44c809f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05f531ec319a611 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44c5ffb700 1 -- 172.21.15.35:0/2871322815 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c809f2c0 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44c5ffb700 1 -- 172.21.15.35:0/2871322815 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(226..226 src has 1..226) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f44c80ace40 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637e53771e0 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44c5ffb700 1 -- 172.21.15.35:0/2871322815 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44c8099890 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44f0d16b80 10 client.18720 fetch_fsmap learned FSMap version 41 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.246+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5637e514e1f0 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44c5ffb700 1 -- 172.21.15.35:0/2871322815 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c807c080 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44c5ffb700 1 -- 172.21.15.35:0/2871322815 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 41) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f44c80a1300 con 0x5637e53a7960 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44f0d16b80 10 client.18720 fetch_fsmap finished waiting for FSMap version 41 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44f0d16b80 10 client.18720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44f0d16b80 20 client.18720 populate_metadata read hostname 'smithi035' 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53ad4f0 0x5637e5418120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44f0d16b80 4 client.18720 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5637e517df00 con 0x5637e53ad4f0 2023-03-17T10:24:38.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44de59c700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53ad4f0 0x5637e5418120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44de59c700 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53ad4f0 0x5637e5418120 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e6faf3af2f438ed server_cookie=eee6838e83f7b9e1 in_seq=0 out_seq=0 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:01.247+0000 7f44c5ffb700 10 client.18720 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44c5ffb700 1 -- 172.21.15.35:0/2871322815 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5637e517df00 con 0x5637e53ad4f0 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44c5ffb700 10 client.18720 handle_command_reply: tid=0 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 client.18720 shutdown 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 msgr2=0x5637e53b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:38.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b4370 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c92e0 tx=0x7f44c809f040 comp rx=0 tx=0).stop 2023-03-17T10:24:38.894 INFO:tasks.workunit.client.0.smithi035.stdout: 1 5385 5.68 MB/sec warmup 8 sec latency 14.570 ms 2023-03-17T10:24:39.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:38 smithi035 ceph-mon[92535]: pgmap v2894: 97 pgs: 97 active+clean; 27 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 3.5 MiB/s wr, 123 op/s 2023-03-17T10:24:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 shutdown_connections 2023-03-17T10:24:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637e53ad4f0 0x5637e5418120 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637e53acbe0 0x5637e53b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637e52046b0 0x5637e53b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 --2- 172.21.15.35:0/2871322815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637e53a7960 0x5637e53b4370 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44c5ffb700 0 client.18720 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 >> 172.21.15.35:0/2871322815 conn(0x5637e53bca40 msgr2=0x5637e53adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 shutdown_connections 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 1 -- 172.21.15.35:0/2871322815 wait complete. 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44f0d16b80 20 client.18720 trim_cache size 0 max 16384 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f44cc09f6c0 msgr2=0x7f44cc0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f44cc09f6c0 0x7f44cc0a1b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f44d0007be0 tx=0x7f44d00073d0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 msgr2=0x7f44e010cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e010cdb0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f44c800b580 tx=0x7f44c8009580 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 shutdown_connections 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f44cc09f6c0 0x7f44cc0a1b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104390 0x7f44e01a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44e00ff350 0x7f44e010c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 --2- 172.21.15.35:0/2417816460 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44e00ffcf0 0x7f44e010cdb0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.306+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 >> 172.21.15.35:0/2417816460 conn(0x7f44e0076330 msgr2=0x7f44e0102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.307+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 shutdown_connections 2023-03-17T10:24:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:03.307+0000 7f44e4b89700 1 -- 172.21.15.35:0/2417816460 wait complete. 2023-03-17T10:24:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/1153702582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f68104390 msgr2=0x7f5f6810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/1153702582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f68104390 0x7f5f6810bf60 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000b0d0 tx=0x7f5f6000b3e0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/1153702582 shutdown_connections 2023-03-17T10:24:39.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/1153702582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f68104390 0x7f5f6810bf60 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:39.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/1153702582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f680ff350 0x7f5f680ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/1153702582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f680ffcf0 0x7f5f68103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/1153702582 >> 172.21.15.35:0/1153702582 conn(0x7f5f68076330 msgr2=0x7f5f68076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/1153702582 shutdown_connections 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.434+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/1153702582 wait complete. 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 Processor -- start 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 -- start start 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 0x7f5f68197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f680ffcf0 0x7f5f68197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f68104390 0x7f5f681a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68198030 con 0x7f5f680ff350 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681a27d0 con 0x7f5f680ffcf0 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f6e9a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681a2910 con 0x7f5f68104390 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 0x7f5f68197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 0x7f5f68197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50254/0 (socket says 172.21.15.35:50254) 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.435+0000 7f5f67fff700 1 -- 172.21.15.35:0/3555631220 learned_addr learned my addr 172.21.15.35:0/3555631220 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f680ffcf0 0x7f5f68197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f68104390 0x7f5f681a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f67fff700 1 -- 172.21.15.35:0/3555631220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f68104390 msgr2=0x7f5f681a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f67fff700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f68104390 0x7f5f681a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f67fff700 1 -- 172.21.15.35:0/3555631220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f680ffcf0 msgr2=0x7f5f68197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f67fff700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f680ffcf0 0x7f5f68197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f67fff700 1 -- 172.21.15.35:0/3555631220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f60009d00 con 0x7f5f680ff350 2023-03-17T10:24:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f68104390 0x7f5f681a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f67fff700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 0x7f5f68197210 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e9a0 tx=0x7f5f5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f657fa700 1 -- 172.21.15.35:0/3555631220 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58009790 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f657fa700 1 -- 172.21.15.35:0/3555631220 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f5800cbd0 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6810efc0 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f657fa700 1 -- 172.21.15.35:0/3555631220 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58018680 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.436+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6810ee30 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.438+0000 7f5f657fa700 1 -- 172.21.15.35:0/3555631220 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5f5800cd40 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.439+0000 7f5f657fa700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f5009f640 0x7f5f500a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.439+0000 7f5f657fa700 1 -- 172.21.15.35:0/3555631220 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(229..229 src has 1..229) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f5f58014070 con 0x7f5f680ff350 2023-03-17T10:24:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.439+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f5009f640 0x7f5f500a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f5009f640 0x7f5f500a1af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5f68068860 tx=0x7f5f5c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 Processor -- start 2023-03-17T10:24:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 -- start start 2023-03-17T10:24:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534077fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b534072420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b533f79010 con 0x55b534072960 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b533fcb950 con 0x55b534077be0 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b533fc4de0 con 0x55b5340784f0 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f6cf42700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f6cf42700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50266/0 (socket says 172.21.15.35:50266) 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f6cf42700 1 -- 172.21.15.35:0/1591464807 learned_addr learned my addr 172.21.15.35:0/1591464807 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f67fff700 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534077fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.440+0000 7f5f677fe700 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b534072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f6cf42700 1 -- 172.21.15.35:0/1591464807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 msgr2=0x55b534072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b534072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f6cf42700 1 -- 172.21.15.35:0/1591464807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 msgr2=0x55b534077fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534077fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f6cf42700 1 -- 172.21.15.35:0/1591464807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b533e465d0 con 0x55b534072960 2023-03-17T10:24:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f677fe700 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b534072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:24:42.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072d90 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009c90 tx=0x7f5f600092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1ccdbf719cd865 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:42.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f4e7fc700 1 -- 172.21.15.35:0/1591464807 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000e030 con 0x55b534072960 2023-03-17T10:24:42.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f4e7fc700 1 -- 172.21.15.35:0/1591464807 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f60007d90 con 0x55b534072960 2023-03-17T10:24:42.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.441+0000 7f5f4e7fc700 1 -- 172.21.15.35:0/1591464807 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60004c70 con 0x55b534072960 2023-03-17T10:24:42.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/1591464807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 msgr2=0x55b534072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:42.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072d90 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009c90 tx=0x7f5f600092e0 comp rx=0 tx=0).stop 2023-03-17T10:24:42.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/1591464807 shutdown_connections 2023-03-17T10:24:42.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072d90 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534077fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/1591464807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b534072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/1591464807 >> 172.21.15.35:0/1591464807 conn(0x55b533ecf6b0 msgr2=0x55b53406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/1591464807 shutdown_connections 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/1591464807 wait complete. 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 -- start start 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.442+0000 7f5f7ab32b80 1 Processor -- start 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534072960 0x55b53407e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 0x55b53407b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b53407bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b533e488c0 con 0x55b534077be0 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b53407c330 con 0x55b5340784f0 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b53407c4f0 con 0x55b534072960 2023-03-17T10:24:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f7ab32b80 10 client.0 _ll_register_callbacks cb 0x55b533e6a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:24:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 0x55b53407b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 0x55b53407b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50270/0 (socket says 172.21.15.35:50270) 2023-03-17T10:24:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 -- 172.21.15.35:0/440963757 learned_addr learned my addr 172.21.15.35:0/440963757 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f67fff700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534072960 0x55b53407e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b53407bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:44.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 -- 172.21.15.35:0/440963757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534072960 msgr2=0x55b53407e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:44.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534072960 0x55b53407e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:44.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 -- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 msgr2=0x55b53407bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b53407bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 -- 172.21.15.35:0/440963757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6810c7a0 con 0x55b534077be0 2023-03-17T10:24:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f677fe700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 0x55b53407b660 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c011590 tx=0x7f5f5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124dac12098147a1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f477fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:24:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.443+0000 7f5f477fe700 1 -- 172.21.15.35:0/440963757 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c028670 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f477fe700 1 -- 172.21.15.35:0/440963757 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(229..229 src has 1..229) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f5f5c017070 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b533f87390 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f477fe700 1 -- 172.21.15.35:0/440963757 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f5c0287d0 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 10 client.18738 fetch_fsmap learned FSMap version 43 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b533df2d80 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f477fe700 1 -- 172.21.15.35:0/440963757 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b533f87390 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f477fe700 1 -- 172.21.15.35:0/440963757 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f5c01faf0 con 0x55b534077be0 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 10 client.18738 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 10 client.18738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 20 client.18738 populate_metadata read hostname 'smithi035' 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b53408c040 0x55b53408e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 4 client.18738 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:24:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b533f93600 con 0x55b53408c040 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.444+0000 7f5f67fff700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b53408c040 0x55b53408e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.445+0000 7f5f477fe700 10 client.18738 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.445+0000 7f5f67fff700 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b53408c040 0x55b53408e450 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c07c7c59d7a1144d server_cookie=c49c4aa0cf610e0e in_seq=0 out_seq=0 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.445+0000 7f5f477fe700 1 -- 172.21.15.35:0/440963757 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b533f93600 con 0x55b53408c040 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.445+0000 7f5f477fe700 10 client.18738 handle_command_reply: tid=0 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 client.18738 shutdown 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 msgr2=0x55b53407b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 0x55b53407b660 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c011590 tx=0x7f5f5c0047c0 comp rx=0 tx=0).stop 2023-03-17T10:24:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 shutdown_connections 2023-03-17T10:24:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b53408c040 0x55b53408e450 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b53407bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f477fe700 0 client.18738 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534072960 0x55b53407e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/440963757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534077be0 0x55b53407b660 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 >> 172.21.15.35:0/440963757 conn(0x55b533ecf6b0 msgr2=0x55b53406ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 shutdown_connections 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/440963757 wait complete. 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.446+0000 7f5f7ab32b80 20 client.18738 trim_cache size 0 max 16384 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 Processor -- start 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 -- start start 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534077be0 0x55b53406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b534078990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b53406d710 con 0x55b534072960 2023-03-17T10:24:47.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5340680f0 con 0x55b5340784f0 2023-03-17T10:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b534089740 con 0x55b534077be0 2023-03-17T10:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50276/0 (socket says 172.21.15.35:50276) 2023-03-17T10:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f67fff700 1 -- 172.21.15.35:0/337240359 learned_addr learned my addr 172.21.15.35:0/337240359 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:47.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b534078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f677fe700 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534077be0 0x55b53406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f67fff700 1 -- 172.21.15.35:0/337240359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534077be0 msgr2=0x55b53406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f67fff700 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534077be0 0x55b53406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:48.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.461+0000 7f5f67fff700 1 -- 172.21.15.35:0/337240359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 msgr2=0x55b534078990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f67fff700 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b534078990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f67fff700 1 -- 172.21.15.35:0/337240359 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b534073000 con 0x55b534072960 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f677fe700 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534077be0 0x55b53406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f67fff700 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072420 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e970 tx=0x7f5f5801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d862cdf11bf64fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f4effd700 1 -- 172.21.15.35:0/337240359 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58096840 con 0x55b534072960 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f4effd700 1 -- 172.21.15.35:0/337240359 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f5809c0b0 con 0x55b534072960 2023-03-17T10:24:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f4effd700 1 -- 172.21.15.35:0/337240359 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58097bf0 con 0x55b534072960 2023-03-17T10:24:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/337240359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 msgr2=0x55b534072420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072420 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e970 tx=0x7f5f5801f000 comp rx=0 tx=0).stop 2023-03-17T10:24:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/337240359 shutdown_connections 2023-03-17T10:24:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5340784f0 0x55b534078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534072420 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.462+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/337240359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b534077be0 0x55b53406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/337240359 >> 172.21.15.35:0/337240359 conn(0x55b533ecf6b0 msgr2=0x55b534075840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/337240359 shutdown_connections 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/337240359 wait complete. 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- start start 2023-03-17T10:24:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 Processor -- start 2023-03-17T10:24:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534082e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534081160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b5340816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b534081be0 con 0x55b534072960 2023-03-17T10:24:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b534081d20 con 0x55b534077be0 2023-03-17T10:24:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b534081ee0 con 0x55b5340784f0 2023-03-17T10:24:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f7ab32b80 10 client.0 _ll_register_callbacks cb 0x55b533e6a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:24:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534082e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534082e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50282/0 (socket says 172.21.15.35:50282) 2023-03-17T10:24:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.463+0000 7f5f67fff700 1 -- 172.21.15.35:0/3309034294 learned_addr learned my addr 172.21.15.35:0/3309034294 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534081160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b5340816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f67fff700 1 -- 172.21.15.35:0/3309034294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 msgr2=0x55b5340816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f67fff700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b5340816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f67fff700 1 -- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 msgr2=0x55b534081160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f67fff700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534081160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f67fff700 1 -- 172.21.15.35:0/3309034294 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6810ee30 con 0x55b534072960 2023-03-17T10:24:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f6cf42700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b5340816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:24:52.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534081160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:24:52.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f67fff700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534082e70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f5f58094950 tx=0x7f5f5809c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153c74d4134298b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:52.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f477fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:24:52.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f477fe700 1 -- 172.21.15.35:0/3309034294 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58097b90 con 0x55b534072960 2023-03-17T10:24:52.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f477fe700 1 -- 172.21.15.35:0/3309034294 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(229..229 src has 1..229) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f5f58098700 con 0x55b534072960 2023-03-17T10:24:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5340421e0 con 0x55b534072960 2023-03-17T10:24:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f477fe700 1 -- 172.21.15.35:0/3309034294 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f580988c0 con 0x55b534072960 2023-03-17T10:24:53.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f7ab32b80 10 client.18744 fetch_fsmap learned FSMap version 43 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b533ddbc00 con 0x55b534072960 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.464+0000 7f5f477fe700 1 -- 172.21.15.35:0/3309034294 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b5340421e0 con 0x55b534072960 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f477fe700 1 -- 172.21.15.35:0/3309034294 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f58094290 con 0x55b534072960 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f7ab32b80 10 client.18744 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f7ab32b80 10 client.18744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f7ab32b80 20 client.18744 populate_metadata read hostname 'smithi035' 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5340e0e30 0x55b5340e3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f7ab32b80 4 client.18744 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b533e48f00 con 0x55b5340e0e30 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5340e0e30 0x55b5340e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f477fe700 10 client.18744 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.465+0000 7f5f677fe700 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5340e0e30 0x55b5340e3210 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72814e7c448c2330 server_cookie=6b805135bca7907a in_seq=0 out_seq=0 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.473+0000 7f5f477fe700 1 -- 172.21.15.35:0/3309034294 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b533e48f00 con 0x55b5340e0e30 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.473+0000 7f5f477fe700 10 client.18744 handle_command_reply: tid=0 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.473+0000 7f5f7ab32b80 1 client.18744 shutdown 2023-03-17T10:24:53.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.473+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 msgr2=0x55b534082e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.473+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534082e70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f5f58094950 tx=0x7f5f5809c2d0 comp rx=0 tx=0).stop 2023-03-17T10:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 shutdown_connections 2023-03-17T10:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5340e0e30 0x55b5340e3210 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b5340784f0 0x55b5340816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f477fe700 0 client.18744 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b534072960 0x55b534082e70 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 --2- 172.21.15.35:0/3309034294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b534077be0 0x55b534081160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 >> 172.21.15.35:0/3309034294 conn(0x55b533ecf6b0 msgr2=0x55b534078990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 shutdown_connections 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 1 -- 172.21.15.35:0/3309034294 wait complete. 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f7ab32b80 20 client.18744 trim_cache size 0 max 16384 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f5009f640 msgr2=0x7f5f500a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f5009f640 0x7f5f500a1af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5f68068860 tx=0x7f5f5c00b410 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 msgr2=0x7f5f68197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 0x7f5f68197210 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800e9a0 tx=0x7f5f5800ecb0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 shutdown_connections 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f5009f640 0x7f5f500a1af0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f68104390 0x7f5f681a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f680ff350 0x7f5f68197210 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 --2- 172.21.15.35:0/3555631220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f680ffcf0 0x7f5f68197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 >> 172.21.15.35:0/3555631220 conn(0x7f5f68076330 msgr2=0x7f5f680fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 shutdown_connections 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:00:16.474+0000 7f5f6e9a5700 1 -- 172.21.15.35:0/3555631220 wait complete. 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 -- 172.21.15.35:0/3988429130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ffcf0 msgr2=0x7fbe0c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 --2- 172.21.15.35:0/3988429130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c103cb0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fbe080099c0 tx=0x7fbe08009cd0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 -- 172.21.15.35:0/3988429130 shutdown_connections 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 --2- 172.21.15.35:0/3988429130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c104390 0x7fbe0c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 --2- 172.21.15.35:0/3988429130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 --2- 172.21.15.35:0/3988429130 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c103cb0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 -- 172.21.15.35:0/3988429130 >> 172.21.15.35:0/3988429130 conn(0x7fbe0c076330 msgr2=0x7fbe0c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 -- 172.21.15.35:0/3988429130 shutdown_connections 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 -- 172.21.15.35:0/3988429130 wait complete. 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 Processor -- start 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.387+0000 7fbe13812700 1 -- start start 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 0x7fbe0c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c19b2b0 con 0x7fbe0c104390 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c19b420 con 0x7fbe0c0ffcf0 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c19b5e0 con 0x7fbe0c0ff350 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 0x7fbe0c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 0x7fbe0c19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50328/0 (socket says 172.21.15.35:50328) 2023-03-17T10:24:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 -- 172.21.15.35:0/2885964459 learned_addr learned my addr 172.21.15.35:0/2885964459 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe115ae700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe10dad700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 -- 172.21.15.35:0/2885964459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ff350 msgr2=0x7fbe0c1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 -- 172.21.15.35:0/2885964459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 msgr2=0x7fbe0c196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:24:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 -- 172.21.15.35:0/2885964459 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080095f0 con 0x7fbe0c104390 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe10dad700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe11daf700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 0x7fbe0c19ac70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbe04007ee0 tx=0x7fbe0400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbdfe7fc700 1 -- 172.21.15.35:0/2885964459 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04017070 con 0x7fbe0c104390 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.388+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c10f040 con 0x7fbe0c104390 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.389+0000 7fbdfe7fc700 1 -- 172.21.15.35:0/2885964459 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0400f040 con 0x7fbe0c104390 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.389+0000 7fbdfe7fc700 1 -- 172.21.15.35:0/2885964459 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04005710 con 0x7fbe0c104390 2023-03-17T10:24:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.389+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c10eeb0 con 0x7fbe0c104390 2023-03-17T10:24:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.391+0000 7fbdfe7fc700 1 -- 172.21.15.35:0/2885964459 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbe04005870 con 0x7fbe0c104390 2023-03-17T10:24:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.391+0000 7fbdfe7fc700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf809f640 0x7fbdf80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.391+0000 7fbdfe7fc700 1 -- 172.21.15.35:0/2885964459 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbe040c9df0 con 0x7fbe0c104390 2023-03-17T10:24:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.391+0000 7fbe115ae700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf809f640 0x7fbdf80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.392+0000 7fbe115ae700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf809f640 0x7fbdf80a1af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009a10 tx=0x7fbe00009190 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:24:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.392+0000 7fbe1f99fb80 1 Processor -- start 2023-03-17T10:24:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.392+0000 7fbe1f99fb80 1 -- start start 2023-03-17T10:24:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc51afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc515420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc515d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc41c010 con 0x5561fc51b4f0 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc46e950 con 0x5561fc515960 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc467de0 con 0x5561fc51abe0 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc515420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc515420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50334/0 (socket says 172.21.15.35:50334) 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 -- 172.21.15.35:0/274674530 learned_addr learned my addr 172.21.15.35:0/274674530 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:24:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe115ae700 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc51afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe11daf700 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc515d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:24:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 -- 172.21.15.35:0/274674530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 msgr2=0x5561fc51afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:24:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc51afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 -- 172.21.15.35:0/274674530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 msgr2=0x5561fc515d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc515d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 -- 172.21.15.35:0/274674530 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561fc2e95d0 con 0x5561fc51b4f0 2023-03-17T10:25:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe115ae700 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc51afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:25:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.393+0000 7fbe10dad700 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc515420 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbe080036c0 tx=0x7fbe08005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c11db594092a13 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbdf77fe700 1 -- 172.21.15.35:0/274674530 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08005230 con 0x5561fc51b4f0 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbdf77fe700 1 -- 172.21.15.35:0/274674530 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0801e040 con 0x5561fc51b4f0 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbdf77fe700 1 -- 172.21.15.35:0/274674530 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08004880 con 0x5561fc51b4f0 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/274674530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 msgr2=0x5561fc515420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc515420 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbe080036c0 tx=0x7fbe08005c80 comp rx=0 tx=0).stop 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/274674530 shutdown_connections 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc515d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc51afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/274674530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc515420 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/274674530 >> 172.21.15.35:0/274674530 conn(0x5561fc3726b0 msgr2=0x5561fc50fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/274674530 shutdown_connections 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.394+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/274674530 wait complete. 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 -- start start 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 Processor -- start 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc515960 0x5561fc521470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc51e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc51ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc2eb8c0 con 0x5561fc51b4f0 2023-03-17T10:25:02.215 INFO:tasks.workunit.client.0.smithi035.stdout: 1 6014 5.25 MB/sec warmup 9 sec latency 13.062 ms 2023-03-17T10:25:03.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:40 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:25:03.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:40 smithi035 ceph-mon[92535]: pgmap v2895: 97 pgs: 97 active+clean; 27 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 3.5 MiB/s wr, 123 op/s 2023-03-17T10:25:03.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:42 smithi035 ceph-mon[92535]: pgmap v2896: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2023-03-17T10:25:03.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:44 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:25:03.440 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:44 smithi035 ceph-mon[92535]: pgmap v2897: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2023-03-17T10:25:03.441 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:46 smithi035 ceph-mon[92535]: pgmap v2898: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2023-03-17T10:25:03.441 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:48 smithi035 ceph-mon[92535]: pgmap v2899: 97 pgs: 97 active+clean; 29 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 1.9 MiB/s wr, 173 op/s 2023-03-17T10:25:04.247 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:50 smithi035 ceph-mon[92535]: pgmap v2900: 97 pgs: 97 active+clean; 29 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 1.2 MiB/s wr, 107 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:52 smithi035 ceph-mon[92535]: pgmap v2901: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:54 smithi035 ceph-mon[92535]: pgmap v2902: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:56 smithi035 ceph-mon[92535]: pgmap v2903: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:14:58 smithi035 ceph-mon[92535]: pgmap v2904: 97 pgs: 97 active+clean; 32 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:00 smithi035 ceph-mon[92535]: pgmap v2905: 97 pgs: 97 active+clean; 32 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:02 smithi035 ceph-mon[92535]: pgmap v2906: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-03-17T10:25:04.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:04 smithi035 ceph-mon[92535]: osdmap e257: 12 total, 12 up, 12 in 2023-03-17T10:25:04.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:04 smithi035 ceph-mon[92535]: pgmap v2908: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-03-17T10:25:04.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:06 smithi035 ceph-mon[92535]: pgmap v2909: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-03-17T10:25:05.200 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:08 smithi035 ceph-mon[92535]: pgmap v2910: 97 pgs: 97 active+clean; 30 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-03-17T10:25:05.200 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:10 smithi035 ceph-mon[92535]: pgmap v2911: 97 pgs: 97 active+clean; 30 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-03-17T10:25:05.200 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:12 smithi035 ceph-mon[92535]: osdmap e258: 12 total, 12 up, 12 in 2023-03-17T10:25:05.200 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:12 smithi035 ceph-mon[92535]: pgmap v2913: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.4 MiB/s wr, 165 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:14 smithi035 ceph-mon[92535]: pgmap v2914: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:16 smithi035 ceph-mon[92535]: pgmap v2915: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:18 smithi035 ceph-mon[92535]: pgmap v2916: 97 pgs: 97 active+clean; 35 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:20 smithi035 ceph-mon[92535]: pgmap v2917: 97 pgs: 97 active+clean; 35 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:22 smithi035 ceph-mon[92535]: pgmap v2918: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.9 MiB/s wr, 198 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:24 smithi035 ceph-mon[92535]: pgmap v2919: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-03-17T10:25:05.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:26 smithi035 ceph-mon[92535]: pgmap v2920: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-03-17T10:25:05.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:28 smithi035 ceph-mon[92535]: pgmap v2921: 97 pgs: 97 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.7 MiB/s wr, 179 op/s 2023-03-17T10:25:05.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:30 smithi035 ceph-mon[92535]: pgmap v2922: 97 pgs: 97 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T10:25:05.606 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:32 smithi035 ceph-mon[92535]: pgmap v2923: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.7 MiB/s wr, 178 op/s 2023-03-17T10:25:06.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:25:06.342 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:25:06.342 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:25:06.342 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:33 smithi035 ceph-mon[92535]: pgmap v2924: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T10:25:07.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:33 smithi035 ceph-mon[92535]: pgmap v2925: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T10:25:07.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:25:07.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:36 smithi035 ceph-mon[92535]: pgmap v2926: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T10:25:07.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:37 smithi035 ceph-mon[92535]: pgmap v2927: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2023-03-17T10:25:07.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:40 smithi035 ceph-mon[92535]: pgmap v2928: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:42 smithi035 ceph-mon[92535]: pgmap v2929: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 635 KiB/s wr, 81 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:44 smithi035 ceph-mon[92535]: pgmap v2930: 97 pgs: 97 active+clean; 43 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1.3 MiB/s wr, 144 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:46 smithi035 ceph-mon[92535]: pgmap v2931: 97 pgs: 97 active+clean; 43 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:47 smithi035 ceph-mon[92535]: pgmap v2932: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:50 smithi035 ceph-mon[92535]: pgmap v2933: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:52 smithi035 ceph-mon[92535]: pgmap v2934: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:54 smithi035 ceph-mon[92535]: pgmap v2935: 97 pgs: 97 active+clean; 45 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.8 MiB/s wr, 178 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:56 smithi035 ceph-mon[92535]: pgmap v2936: 97 pgs: 97 active+clean; 45 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T10:25:08.526 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:15:57 smithi035 ceph-mon[92535]: pgmap v2937: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2023-03-17T10:25:08.856 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:00 smithi035 ceph-mon[92535]: pgmap v2938: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-03-17T10:25:08.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:02 smithi035 ceph-mon[92535]: pgmap v2939: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-03-17T10:25:10.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:04 smithi035 ceph-mon[92535]: pgmap v2940: 97 pgs: 97 active+clean; 50 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2023-03-17T10:25:10.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:05 smithi035 ceph-mon[92535]: osdmap e259: 12 total, 12 up, 12 in 2023-03-17T10:25:10.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:06 smithi035 ceph-mon[92535]: pgmap v2942: 97 pgs: 97 active+clean; 50 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2023-03-17T10:25:10.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:07 smithi035 ceph-mon[92535]: pgmap v2943: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T10:25:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:25:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:25:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:25:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:25:10.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:25:10.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc51f520 con 0x5561fc51abe0 2023-03-17T10:25:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc52afa0 con 0x5561fc515960 2023-03-17T10:25:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe1f99fb80 10 client.0 _ll_register_callbacks cb 0x5561fc30d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:25:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe11daf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc51ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.395+0000 7fbe11daf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc51ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50342/0 (socket says 172.21.15.35:50342) 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 -- 172.21.15.35:0/4115760082 learned_addr learned my addr 172.21.15.35:0/4115760082 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe115ae700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc515960 0x5561fc521470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe10dad700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc51e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 -- 172.21.15.35:0/4115760082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc515960 msgr2=0x5561fc521470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc515960 0x5561fc521470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 -- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 msgr2=0x5561fc51e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc51e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 -- 172.21.15.35:0/4115760082 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c10c7a0 con 0x5561fc51b4f0 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe11daf700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc51ede0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fbe040975a0 tx=0x7fbe04095e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c735c5cb19c56a82 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbdf4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/4115760082 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04097d00 con 0x5561fc51b4f0 2023-03-17T10:25:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/4115760082 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbe0409fa90 con 0x5561fc51b4f0 2023-03-17T10:25:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561fc42a390 con 0x5561fc51b4f0 2023-03-17T10:25:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/4115760082 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe04096d90 con 0x5561fc51b4f0 2023-03-17T10:25:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe1f99fb80 10 client.18756 fetch_fsmap learned FSMap version 43 2023-03-17T10:25:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.396+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5561fc295d80 con 0x5561fc51b4f0 2023-03-17T10:25:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/4115760082 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5561fc42a390 con 0x5561fc51b4f0 2023-03-17T10:25:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/4115760082 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbe0409f690 con 0x5561fc51b4f0 2023-03-17T10:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe1f99fb80 10 client.18756 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:25:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe1f99fb80 10 client.18756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:25:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe1f99fb80 20 client.18756 populate_metadata read hostname 'smithi035' 2023-03-17T10:25:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc52f140 0x5561fc531550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe1f99fb80 4 client.18756 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:25:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561fc436600 con 0x5561fc52f140 2023-03-17T10:25:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe115ae700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc52f140 0x5561fc531550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbdf4ff9700 10 client.18756 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.397+0000 7fbe115ae700 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc52f140 0x5561fc531550 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90ae6988926dbae8 server_cookie=8c784605269b2813 in_seq=0 out_seq=0 2023-03-17T10:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.398+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/4115760082 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5561fc436600 con 0x5561fc52f140 2023-03-17T10:25:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.398+0000 7fbdf4ff9700 10 client.18756 handle_command_reply: tid=0 2023-03-17T10:25:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.398+0000 7fbe1f99fb80 1 client.18756 shutdown 2023-03-17T10:25:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.398+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 msgr2=0x5561fc51ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.398+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc51ede0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fbe040975a0 tx=0x7fbe04095e50 comp rx=0 tx=0).stop 2023-03-17T10:25:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 shutdown_connections 2023-03-17T10:25:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc52f140 0x5561fc531550 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc51ede0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc515960 0x5561fc521470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/4115760082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc51e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbdf4ff9700 0 client.18756 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 >> 172.21.15.35:0/4115760082 conn(0x5561fc3726b0 msgr2=0x5561fc514410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 shutdown_connections 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/4115760082 wait complete. 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.399+0000 7fbe1f99fb80 20 client.18756 trim_cache size 0 max 16384 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 Processor -- start 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 -- start start 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc50fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc525ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc5186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc42b050 con 0x5561fc51b4f0 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc50b0f0 con 0x5561fc515960 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc51f180 con 0x5561fc51abe0 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc5186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc5186b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50350/0 (socket says 172.21.15.35:50350) 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 -- 172.21.15.35:0/1604988954 learned_addr learned my addr 172.21.15.35:0/1604988954 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe10dad700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc525ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe115ae700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc50fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 -- 172.21.15.35:0/1604988954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 msgr2=0x5561fc525ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc525ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 -- 172.21.15.35:0/1604988954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 msgr2=0x5561fc50fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc50fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 -- 172.21.15.35:0/1604988954 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561fc516000 con 0x5561fc51b4f0 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe10dad700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc525ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe115ae700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc50fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.414+0000 7fbe11daf700 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc5186b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fbe04096800 tx=0x7fbe040941c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf418c4733e8342 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbdf7fff700 1 -- 172.21.15.35:0/1604988954 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040968d0 con 0x5561fc51b4f0 2023-03-17T10:25:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbdf7fff700 1 -- 172.21.15.35:0/1604988954 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe040ac070 con 0x5561fc51b4f0 2023-03-17T10:25:20.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbdf7fff700 1 -- 172.21.15.35:0/1604988954 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04096be0 con 0x5561fc51b4f0 2023-03-17T10:25:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1604988954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 msgr2=0x5561fc5186b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc5186b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fbe04096800 tx=0x7fbe040941c0 comp rx=0 tx=0).stop 2023-03-17T10:25:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1604988954 shutdown_connections 2023-03-17T10:25:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc51b4f0 0x5561fc5186b0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc515960 0x5561fc50fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1604988954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51abe0 0x5561fc525ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1604988954 >> 172.21.15.35:0/1604988954 conn(0x5561fc3726b0 msgr2=0x5561fc52b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1604988954 shutdown_connections 2023-03-17T10:25:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1604988954 wait complete. 2023-03-17T10:25:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.415+0000 7fbe1f99fb80 1 -- start start 2023-03-17T10:25:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 Processor -- start 2023-03-17T10:25:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 0x5561fc580b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc581080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51b4f0 0x5561fc57b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc57b990 con 0x5561fc515960 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc57bb00 con 0x5561fc51abe0 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fc57bcc0 con 0x5561fc51b4f0 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe1f99fb80 10 client.0 _ll_register_callbacks cb 0x5561fc30d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 0x5561fc580b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 0x5561fc580b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50352/0 (socket says 172.21.15.35:50352) 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 -- 172.21.15.35:0/1939228682 learned_addr learned my addr 172.21.15.35:0/1939228682 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe10dad700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc581080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe11daf700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51b4f0 0x5561fc57b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 -- 172.21.15.35:0/1939228682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51b4f0 msgr2=0x5561fc57b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51b4f0 0x5561fc57b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 -- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 msgr2=0x5561fc581080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc581080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.416+0000 7fbe115ae700 1 -- 172.21.15.35:0/1939228682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561fc295d80 con 0x5561fc515960 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe115ae700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 0x5561fc580b40 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fbe000097f0 tx=0x7fbe00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771993eb841806fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbdf4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/1939228682 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000eea0 con 0x5561fc515960 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/1939228682 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbe000283c0 con 0x5561fc515960 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561fc4e51e0 con 0x5561fc515960 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/1939228682 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe00028580 con 0x5561fc515960 2023-03-17T10:25:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 10 client.18762 fetch_fsmap learned FSMap version 43 2023-03-17T10:25:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5561fc27ec00 con 0x5561fc515960 2023-03-17T10:25:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/1939228682 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5561fc4e51e0 con 0x5561fc515960 2023-03-17T10:25:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/1939228682 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbe0002e020 con 0x5561fc515960 2023-03-17T10:25:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 10 client.18762 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 10 client.18762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 20 client.18762 populate_metadata read hostname 'smithi035' 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc588970 0x5561fc58ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 4 client.18762 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.417+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5561fc2ebf00 con 0x5561fc588970 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.418+0000 7fbe10dad700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc588970 0x5561fc58ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.418+0000 7fbe10dad700 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc588970 0x5561fc58ad80 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d65b3a38a53fe29 server_cookie=8b38595b1405bfa7 in_seq=0 out_seq=0 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.418+0000 7fbdf4ff9700 10 client.18762 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.427+0000 7fbdf4ff9700 1 -- 172.21.15.35:0/1939228682 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5561fc2ebf00 con 0x5561fc588970 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.427+0000 7fbdf4ff9700 10 client.18762 handle_command_reply: tid=0 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.427+0000 7fbe1f99fb80 1 client.18762 shutdown 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.427+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 msgr2=0x5561fc580b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.427+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 0x5561fc580b40 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fbe000097f0 tx=0x7fbe00004750 comp rx=0 tx=0).stop 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 shutdown_connections 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5561fc588970 0x5561fc58ad80 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561fc51b4f0 0x5561fc57b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbdf4ff9700 0 client.18762 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5561fc515960 0x5561fc580b40 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 --2- 172.21.15.35:0/1939228682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561fc51abe0 0x5561fc581080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 >> 172.21.15.35:0/1939228682 conn(0x5561fc3726b0 msgr2=0x5561fc5186b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 shutdown_connections 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 1 -- 172.21.15.35:0/1939228682 wait complete. 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe1f99fb80 20 client.18762 trim_cache size 0 max 16384 2023-03-17T10:25:27.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf809f640 msgr2=0x7fbdf80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf809f640 0x7fbdf80a1af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009a10 tx=0x7fbe00009190 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 msgr2=0x7fbe0c19ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 0x7fbe0c19ac70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbe04007ee0 tx=0x7fbe0400d3b0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 shutdown_connections 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf809f640 0x7fbdf80a1af0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c104390 0x7fbe0c19ac70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 --2- 172.21.15.35:0/2885964459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 >> 172.21.15.35:0/2885964459 conn(0x7fbe0c076330 msgr2=0x7fbe0c103030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 shutdown_connections 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:35.428+0000 7fbe13812700 1 -- 172.21.15.35:0/2885964459 wait complete. 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.550+0000 7f2487401700 1 -- 172.21.15.35:0/3177006562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ff350 msgr2=0x7f24800ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.550+0000 7f2487401700 1 --2- 172.21.15.35:0/3177006562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ff350 0x7f24800ff720 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f247c0099c0 tx=0x7f247c009cd0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 -- 172.21.15.35:0/3177006562 shutdown_connections 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 --2- 172.21.15.35:0/3177006562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 0x7f248010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 --2- 172.21.15.35:0/3177006562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ff350 0x7f24800ff720 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 --2- 172.21.15.35:0/3177006562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24800ffcf0 0x7f2480103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 -- 172.21.15.35:0/3177006562 >> 172.21.15.35:0/3177006562 conn(0x7f2480076330 msgr2=0x7f2480076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 -- 172.21.15.35:0/3177006562 shutdown_connections 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 -- 172.21.15.35:0/3177006562 wait complete. 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.551+0000 7f2487401700 1 Processor -- start 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 -- start start 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24800ff350 0x7f24801962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 0x7f2480196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 0x7f248019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248019b2a0 con 0x7f24800ffcf0 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248019b410 con 0x7f2480104390 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f2487401700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248019b5d0 con 0x7f24800ff350 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 0x7f2480196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 0x7f2480196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50368/0 (socket says 172.21.15.35:50368) 2023-03-17T10:25:27.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 -- 172.21.15.35:0/3498098060 learned_addr learned my addr 172.21.15.35:0/3498098060 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:27.399 INFO:tasks.workunit.client.0.smithi035.stdout: 1 6853 5.45 MB/sec warmup 10 sec latency 11.656 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 7269 5.26 MB/sec warmup 11 sec latency 12.460 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 7544 4.93 MB/sec warmup 12 sec latency 13.324 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 7926 4.59 MB/sec warmup 13 sec latency 12.579 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 8393 4.38 MB/sec warmup 14 sec latency 16.600 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 9021 4.31 MB/sec warmup 15 sec latency 11.300 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 9574 4.18 MB/sec warmup 16 sec latency 13.419 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 10311 4.27 MB/sec warmup 17 sec latency 17.410 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 10733 4.27 MB/sec warmup 18 sec latency 17.595 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 11034 4.12 MB/sec warmup 19 sec latency 19.366 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 11337 3.93 MB/sec warmup 20 sec latency 40.390 ms 2023-03-17T10:25:29.715 INFO:tasks.workunit.client.0.smithi035.stdout: 1 11856 3.83 MB/sec warmup 21 sec latency 13.918 ms 2023-03-17T10:25:29.716 INFO:tasks.workunit.client.0.smithi035.stdout: 1 12482 3.80 MB/sec warmup 22 sec latency 13.763 ms 2023-03-17T10:25:30.290 INFO:tasks.workunit.client.0.smithi035.stdout: 1 13072 3.72 MB/sec warmup 23 sec latency 11.885 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 13681 3.79 MB/sec warmup 24 sec latency 13.574 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 14208 3.83 MB/sec warmup 25 sec latency 38.164 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 14562 3.75 MB/sec warmup 26 sec latency 13.686 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 14822 3.61 MB/sec warmup 27 sec latency 14.837 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 15360 3.55 MB/sec warmup 28 sec latency 17.897 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 15902 3.54 MB/sec warmup 29 sec latency 16.537 ms 2023-03-17T10:25:31.392 INFO:tasks.workunit.client.0.smithi035.stdout: 1 16557 3.48 MB/sec warmup 30 sec latency 14.130 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 17135 3.55 MB/sec warmup 31 sec latency 20.116 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 17579 3.50 MB/sec warmup 32 sec latency 15.672 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 18042 3.52 MB/sec warmup 33 sec latency 12.696 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 18308 3.43 MB/sec warmup 34 sec latency 20.349 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 18780 3.39 MB/sec warmup 35 sec latency 15.345 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 19302 3.38 MB/sec warmup 36 sec latency 16.531 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 19968 3.31 MB/sec warmup 37 sec latency 11.765 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 20499 3.36 MB/sec warmup 38 sec latency 18.461 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 21101 3.36 MB/sec warmup 39 sec latency 16.830 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 21563 3.39 MB/sec warmup 40 sec latency 15.402 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 21801 3.31 MB/sec warmup 41 sec latency 13.302 ms 2023-03-17T10:25:31.393 INFO:tasks.workunit.client.0.smithi035.stdout: 1 22217 3.25 MB/sec warmup 42 sec latency 14.781 ms 2023-03-17T10:25:32.474 INFO:tasks.workunit.client.0.smithi035.stdout: 1 22757 3.27 MB/sec warmup 43 sec latency 13.221 ms 2023-03-17T10:25:32.474 INFO:tasks.workunit.client.0.smithi035.stdout: 1 23375 3.21 MB/sec warmup 44 sec latency 11.884 ms 2023-03-17T10:25:32.474 INFO:tasks.workunit.client.0.smithi035.stdout: 1 23885 3.19 MB/sec warmup 45 sec latency 14.382 ms 2023-03-17T10:25:32.474 INFO:tasks.workunit.client.0.smithi035.stdout: 1 24605 3.26 MB/sec warmup 46 sec latency 98.467 ms 2023-03-17T10:25:32.474 INFO:tasks.workunit.client.0.smithi035.stdout: 1 25001 3.27 MB/sec warmup 47 sec latency 11.981 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 25252 3.23 MB/sec warmup 48 sec latency 171.180 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 25541 3.16 MB/sec warmup 49 sec latency 12.501 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 26054 3.14 MB/sec warmup 50 sec latency 14.859 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 26653 3.14 MB/sec warmup 51 sec latency 13.983 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 27244 3.11 MB/sec warmup 52 sec latency 48.971 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 27847 3.16 MB/sec warmup 53 sec latency 12.527 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 28267 3.14 MB/sec warmup 54 sec latency 20.328 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 28730 3.16 MB/sec warmup 55 sec latency 14.960 ms 2023-03-17T10:25:33.692 INFO:tasks.workunit.client.0.smithi035.stdout: 1 28993 3.11 MB/sec warmup 56 sec latency 13.189 ms 2023-03-17T10:25:34.512 INFO:tasks.workunit.client.0.smithi035.stdout: 1 29466 3.09 MB/sec warmup 57 sec latency 24.652 ms 2023-03-17T10:25:34.512 INFO:tasks.workunit.client.0.smithi035.stdout: 1 30014 3.09 MB/sec warmup 58 sec latency 14.458 ms 2023-03-17T10:25:34.512 INFO:tasks.workunit.client.0.smithi035.stdout: 1 30668 3.05 MB/sec warmup 59 sec latency 14.067 ms 2023-03-17T10:25:34.512 INFO:tasks.workunit.client.0.smithi035.stdout: 1 31179 3.08 MB/sec warmup 60 sec latency 26.780 ms 2023-03-17T10:25:34.512 INFO:tasks.workunit.client.0.smithi035.stdout: 1 31745 3.09 MB/sec warmup 61 sec latency 23.280 ms 2023-03-17T10:25:34.512 INFO:tasks.workunit.client.0.smithi035.stdout: 1 32216 3.11 MB/sec warmup 62 sec latency 25.656 ms 2023-03-17T10:25:35.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 32467 3.07 MB/sec warmup 63 sec latency 12.470 ms 2023-03-17T10:25:35.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 32894 3.03 MB/sec warmup 64 sec latency 14.533 ms 2023-03-17T10:25:35.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 33445 3.05 MB/sec warmup 65 sec latency 14.036 ms 2023-03-17T10:25:35.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 34030 3.01 MB/sec warmup 66 sec latency 16.885 ms 2023-03-17T10:25:35.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 34544 3.00 MB/sec warmup 67 sec latency 14.971 ms 2023-03-17T10:25:35.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 35267 3.05 MB/sec warmup 68 sec latency 11.858 ms 2023-03-17T10:25:36.642 INFO:tasks.workunit.client.0.smithi035.stdout: 1 35719 3.07 MB/sec warmup 69 sec latency 11.494 ms 2023-03-17T10:25:36.642 INFO:tasks.workunit.client.0.smithi035.stdout: 1 35965 3.03 MB/sec warmup 70 sec latency 12.474 ms 2023-03-17T10:25:36.642 INFO:tasks.workunit.client.0.smithi035.stdout: 1 36375 3.00 MB/sec warmup 71 sec latency 12.966 ms 2023-03-17T10:25:36.642 INFO:tasks.workunit.client.0.smithi035.stdout: 1 36920 3.02 MB/sec warmup 72 sec latency 15.183 ms 2023-03-17T10:25:36.642 INFO:tasks.workunit.client.0.smithi035.stdout: 1 37489 2.98 MB/sec warmup 73 sec latency 15.103 ms 2023-03-17T10:25:36.642 INFO:tasks.workunit.client.0.smithi035.stdout: 1 38003 2.97 MB/sec warmup 74 sec latency 16.180 ms 2023-03-17T10:25:37.226 INFO:tasks.workunit.client.0.smithi035.stdout: 1 38786 3.02 MB/sec warmup 75 sec latency 13.969 ms 2023-03-17T10:25:37.226 INFO:tasks.workunit.client.0.smithi035.stdout: 1 39191 3.03 MB/sec warmup 76 sec latency 11.015 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 39476 3.00 MB/sec warmup 77 sec latency 14.043 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 39811 2.97 MB/sec warmup 78 sec latency 18.102 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 40319 2.96 MB/sec warmup 79 sec latency 11.960 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 40934 2.96 MB/sec warmup 80 sec latency 15.418 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 41497 2.94 MB/sec warmup 81 sec latency 14.771 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 42230 2.98 MB/sec warmup 82 sec latency 15.177 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 42669 3.00 MB/sec warmup 83 sec latency 15.116 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 42985 2.98 MB/sec warmup 84 sec latency 12.477 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 43290 2.95 MB/sec warmup 85 sec latency 14.069 ms 2023-03-17T10:25:37.993 INFO:tasks.workunit.client.0.smithi035.stdout: 1 43805 2.94 MB/sec warmup 86 sec latency 13.664 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 44421 2.94 MB/sec warmup 87 sec latency 12.162 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 44997 2.93 MB/sec warmup 88 sec latency 14.853 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 45588 2.96 MB/sec warmup 89 sec latency 31.145 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 46120 2.98 MB/sec warmup 90 sec latency 15.068 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 46472 2.96 MB/sec warmup 91 sec latency 13.060 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 46746 2.93 MB/sec warmup 92 sec latency 15.279 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 47242 2.92 MB/sec warmup 93 sec latency 13.980 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 47765 2.92 MB/sec warmup 94 sec latency 61.736 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 48407 2.90 MB/sec warmup 95 sec latency 15.404 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 48920 2.92 MB/sec warmup 96 sec latency 14.848 ms 2023-03-17T10:25:37.994 INFO:tasks.workunit.client.0.smithi035.stdout: 1 49476 2.93 MB/sec warmup 97 sec latency 14.423 ms 2023-03-17T10:25:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248519d700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24800ff350 0x7f24801962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248599e700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 0x7f248019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 -- 172.21.15.35:0/3498098060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24800ff350 msgr2=0x7f24801962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24800ff350 0x7f24801962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 -- 172.21.15.35:0/3498098060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 msgr2=0x7f248019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 0x7f248019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 -- 172.21.15.35:0/3498098060 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0095f0 con 0x7f24800ffcf0 2023-03-17T10:25:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248599e700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 0x7f248019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.552+0000 7f248499c700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 0x7f2480196800 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f247400d980 tx=0x7f247400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.553+0000 7f24727fc700 1 -- 172.21.15.35:0/3498098060 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474004a30 con 0x7f24800ffcf0 2023-03-17T10:25:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.553+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248010f020 con 0x7f24800ffcf0 2023-03-17T10:25:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.553+0000 7f24727fc700 1 -- 172.21.15.35:0/3498098060 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f247400b5e0 con 0x7f24800ffcf0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.553+0000 7f24727fc700 1 -- 172.21.15.35:0/3498098060 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474009ab0 con 0x7f24800ffcf0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.553+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248010ee90 con 0x7f24800ffcf0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.555+0000 7f24727fc700 1 -- 172.21.15.35:0/3498098060 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2474009c10 con 0x7f24800ffcf0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.555+0000 7f24727fc700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f246c09f640 0x7f246c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.556+0000 7f24727fc700 1 -- 172.21.15.35:0/3498098060 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f24740c9e90 con 0x7f24800ffcf0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.556+0000 7f248519d700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f246c09f640 0x7f246c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.556+0000 7f248519d700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f246c09f640 0x7f246c0a1af0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f247c00b580 tx=0x7f247c009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 Processor -- start 2023-03-17T10:25:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 -- start start 2023-03-17T10:25:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e6be0 0x55b1401e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e74f0 0x55b1401e1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1400e8010 con 0x55b1401e1960 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14013a950 con 0x55b1401e74f0 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f249358eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b140133de0 con 0x55b1401e6be0 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50378/0 (socket says 172.21.15.35:50378) 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 -- 172.21.15.35:0/2292020725 learned_addr learned my addr 172.21.15.35:0/2292020725 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248499c700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e74f0 0x55b1401e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248519d700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e6be0 0x55b1401e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 -- 172.21.15.35:0/2292020725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e6be0 msgr2=0x55b1401e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e6be0 0x55b1401e6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 -- 172.21.15.35:0/2292020725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e74f0 msgr2=0x55b1401e1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e74f0 0x55b1401e1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248599e700 1 -- 172.21.15.35:0/2292020725 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b13ffb55d0 con 0x55b1401e1960 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248519d700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e6be0 0x55b1401e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.557+0000 7f248499c700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e74f0 0x55b1401e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.558+0000 7f248599e700 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1d90 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2478009dd0 tx=0x7f24780077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb3aa699a25f000 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.558+0000 7f246b7fe700 1 -- 172.21.15.35:0/2292020725 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478018070 con 0x55b1401e1960 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.558+0000 7f246b7fe700 1 -- 172.21.15.35:0/2292020725 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f247800f050 con 0x55b1401e1960 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.558+0000 7f246b7fe700 1 -- 172.21.15.35:0/2292020725 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478005970 con 0x55b1401e1960 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 -- 172.21.15.35:0/2292020725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 msgr2=0x55b1401e1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1d90 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2478009dd0 tx=0x7f24780077e0 comp rx=0 tx=0).stop 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 -- 172.21.15.35:0/2292020725 shutdown_connections 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1d90 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e6be0 0x55b1401e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 --2- 172.21.15.35:0/2292020725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e74f0 0x55b1401e1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 -- 172.21.15.35:0/2292020725 >> 172.21.15.35:0/2292020725 conn(0x55b14003e6b0 msgr2=0x55b1401dba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 -- 172.21.15.35:0/2292020725 shutdown_connections 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 -- 172.21.15.35:0/2292020725 wait complete. 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 -- start start 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.559+0000 7f249358eb80 1 Processor -- start 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401ed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401ea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b13ffb78c0 con 0x55b1401e74f0 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401eb3d0 con 0x55b1401e6be0 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401f7000 con 0x55b1401e1960 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 10 client.0 _ll_register_callbacks cb 0x55b13ffd9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50384/0 (socket says 172.21.15.35:50384) 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 -- 172.21.15.35:0/267367487 learned_addr learned my addr 172.21.15.35:0/267367487 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248519d700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248499c700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 -- 172.21.15.35:0/267367487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 msgr2=0x55b1401ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 -- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 msgr2=0x55b1401ea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401ea680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 -- 172.21.15.35:0/267367487 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478009a00 con 0x55b1401e74f0 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248499c700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f248599e700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401eac60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f24780051b0 tx=0x7f2478005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f073f34ad71cc65 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f2468ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f2468ff9700 1 -- 172.21.15.35:0/267367487 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478018030 con 0x55b1401e74f0 2023-03-17T10:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f2468ff9700 1 -- 172.21.15.35:0/267367487 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f247801e450 con 0x55b1401e74f0 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.560+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1400f6390 con 0x55b1401e74f0 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f2468ff9700 1 -- 172.21.15.35:0/267367487 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2478005a80 con 0x55b1401e74f0 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 10 client.18774 fetch_fsmap learned FSMap version 43 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b13ff61d80 con 0x55b1401e74f0 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f2468ff9700 1 -- 172.21.15.35:0/267367487 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b1400f6390 con 0x55b1401e74f0 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f2468ff9700 1 -- 172.21.15.35:0/267367487 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2478014640 con 0x55b1401e74f0 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 10 client.18774 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 10 client.18774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 20 client.18774 populate_metadata read hostname 'smithi035' 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b1401fb030 0x55b1401fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 4 client.18774 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:25:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b140102600 con 0x55b1401fb030 2023-03-17T10:25:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.561+0000 7f248519d700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b1401fb030 0x55b1401fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.562+0000 7f248519d700 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b1401fb030 0x55b1401fd440 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab4053c2eb77bc38 server_cookie=1a8ec8b0bdf8f30f in_seq=0 out_seq=0 2023-03-17T10:25:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.562+0000 7f2468ff9700 10 client.18774 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.562+0000 7f2468ff9700 1 -- 172.21.15.35:0/267367487 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b140102600 con 0x55b1401fb030 2023-03-17T10:25:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.562+0000 7f2468ff9700 10 client.18774 handle_command_reply: tid=0 2023-03-17T10:25:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.562+0000 7f249358eb80 1 client.18774 shutdown 2023-03-17T10:25:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 msgr2=0x55b1401eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401eac60 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f24780051b0 tx=0x7f2478005290 comp rx=0 tx=0).stop 2023-03-17T10:25:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 shutdown_connections 2023-03-17T10:25:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b1401fb030 0x55b1401fd440 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401eac60 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 --2- 172.21.15.35:0/267367487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f2468ff9700 0 client.18774 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 >> 172.21.15.35:0/267367487 conn(0x55b14003e6b0 msgr2=0x55b1401dba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 shutdown_connections 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 1 -- 172.21.15.35:0/267367487 wait complete. 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.563+0000 7f249358eb80 20 client.18774 trim_cache size 0 max 16384 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 Processor -- start 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 -- start start 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e74f0 0x55b1401e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401ddc30 con 0x55b1401e1960 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401eb5e0 con 0x55b1401e6be0 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f249358eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401dc000 con 0x55b1401e74f0 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50388/0 (socket says 172.21.15.35:50388) 2023-03-17T10:25:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 -- 172.21.15.35:0/722074566 learned_addr learned my addr 172.21.15.35:0/722074566 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248499c700 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 -- 172.21.15.35:0/722074566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e74f0 msgr2=0x55b1401e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e74f0 0x55b1401e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 -- 172.21.15.35:0/722074566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 msgr2=0x55b1401dbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:47.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.578+0000 7f248519d700 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401dbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f248519d700 1 -- 172.21.15.35:0/722074566 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1400fa130 con 0x55b1401e1960 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f248499c700 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401dbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f248519d700 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1420 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f247c005cd0 tx=0x7f247c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c2277d3c586ce6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f246bfff700 1 -- 172.21.15.35:0/722074566 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c034df0 con 0x55b1401e1960 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f246bfff700 1 -- 172.21.15.35:0/722074566 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f247c01e040 con 0x55b1401e1960 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f246bfff700 1 -- 172.21.15.35:0/722074566 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c004760 con 0x55b1401e1960 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 -- 172.21.15.35:0/722074566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 msgr2=0x55b1401e1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1420 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f247c005cd0 tx=0x7f247c020000 comp rx=0 tx=0).stop 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 -- 172.21.15.35:0/722074566 shutdown_connections 2023-03-17T10:25:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e74f0 0x55b1401e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e1960 0x55b1401e1420 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 --2- 172.21.15.35:0/722074566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401dbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.579+0000 7f249358eb80 1 -- 172.21.15.35:0/722074566 >> 172.21.15.35:0/722074566 conn(0x55b14003e6b0 msgr2=0x55b1401e47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 -- 172.21.15.35:0/722074566 shutdown_connections 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 -- 172.21.15.35:0/722074566 wait complete. 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 -- start start 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 Processor -- start 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401f0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401f0730 con 0x55b1401e74f0 2023-03-17T10:25:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401f08a0 con 0x55b1401e6be0 2023-03-17T10:25:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1401f0a60 con 0x55b1401e1960 2023-03-17T10:25:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f249358eb80 10 client.0 _ll_register_callbacks cb 0x55b13ffd9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:25:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.580+0000 7f248599e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401f0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50398/0 (socket says 172.21.15.35:50398) 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 -- 172.21.15.35:0/1197516025 learned_addr learned my addr 172.21.15.35:0/1197516025 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248519d700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248499c700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 -- 172.21.15.35:0/1197516025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 msgr2=0x55b1401f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 -- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 msgr2=0x55b1401f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 -- 172.21.15.35:0/1197516025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c02c040 con 0x55b1401e74f0 2023-03-17T10:25:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248519d700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:25:49.296 INFO:tasks.workunit.client.0.smithi035.stdout: 1 49957 2.94 MB/sec warmup 98 sec latency 12.011 ms 2023-03-17T10:25:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f248599e700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401f0020 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f24780061b0 tx=0x7f2478009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d96e58c8517092e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f2468ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:25:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f2468ff9700 1 -- 172.21.15.35:0/1197516025 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478018070 con 0x55b1401e74f0 2023-03-17T10:25:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f2468ff9700 1 -- 172.21.15.35:0/1197516025 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2478014410 con 0x55b1401e74f0 2023-03-17T10:25:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1401b11e0 con 0x55b1401e74f0 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f2468ff9700 1 -- 172.21.15.35:0/1197516025 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2478005a80 con 0x55b1401e74f0 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f249358eb80 10 client.18780 fetch_fsmap learned FSMap version 43 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b13ff881f0 con 0x55b1401e74f0 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.581+0000 7f2468ff9700 1 -- 172.21.15.35:0/1197516025 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f247803e020 con 0x55b1401e74f0 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f2468ff9700 1 -- 172.21.15.35:0/1197516025 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f24780313f0 con 0x55b1401e74f0 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f249358eb80 10 client.18780 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f249358eb80 10 client.18780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f249358eb80 20 client.18780 populate_metadata read hostname 'smithi035' 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f249358eb80 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b14024fdd0 0x55b1402521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f249358eb80 4 client.18780 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:25:53.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b13ffb7f00 con 0x55b14024fdd0 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f248519d700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b14024fdd0 0x55b1402521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f2468ff9700 10 client.18780 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.582+0000 7f248519d700 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b14024fdd0 0x55b1402521b0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57109b24aa6f2ff server_cookie=5dbe00a85343d0f6 in_seq=0 out_seq=0 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f2468ff9700 1 -- 172.21.15.35:0/1197516025 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b13ffb7f00 con 0x55b14024fdd0 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f2468ff9700 10 client.18780 handle_command_reply: tid=0 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 client.18780 shutdown 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 msgr2=0x55b1401f0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401f0020 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f24780061b0 tx=0x7f2478009100 comp rx=0 tx=0).stop 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 shutdown_connections 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b14024fdd0 0x55b1402521b0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b1401e74f0 0x55b1401f0020 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b1401e1960 0x55b1401f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f2468ff9700 0 client.18780 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 --2- 172.21.15.35:0/1197516025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1401e6be0 0x55b1401f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 >> 172.21.15.35:0/1197516025 conn(0x55b14003e6b0 msgr2=0x55b1401e78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 shutdown_connections 2023-03-17T10:25:53.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.587+0000 7f249358eb80 1 -- 172.21.15.35:0/1197516025 wait complete. 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f249358eb80 20 client.18780 trim_cache size 0 max 16384 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f246c09f640 msgr2=0x7f246c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f246c09f640 0x7f246c0a1af0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f247c00b580 tx=0x7f247c009f10 comp rx=0 tx=0).stop 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 msgr2=0x7f2480196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 0x7f2480196800 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f247400d980 tx=0x7f247400dc90 comp rx=0 tx=0).stop 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 shutdown_connections 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f246c09f640 0x7f246c0a1af0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2480104390 0x7f248019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24800ff350 0x7f24801962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 --2- 172.21.15.35:0/3498098060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f24800ffcf0 0x7f2480196800 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 >> 172.21.15.35:0/3498098060 conn(0x7f2480076330 msgr2=0x7f2480103030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 shutdown_connections 2023-03-17T10:25:53.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:01:48.588+0000 7f2487401700 1 -- 172.21.15.35:0/3498098060 wait complete. 2023-03-17T10:25:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.711+0000 7f2934e66700 1 -- 172.21.15.35:0/4076559469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 msgr2=0x7f2930103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.711+0000 7f2934e66700 1 --2- 172.21.15.35:0/4076559469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f2930103cb0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f29200099c0 tx=0x7f2920009cd0 comp rx=0 tx=0).stop 2023-03-17T10:25:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 -- 172.21.15.35:0/4076559469 shutdown_connections 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 --2- 172.21.15.35:0/4076559469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2930104390 0x7f293010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 --2- 172.21.15.35:0/4076559469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29300ff350 0x7f29300ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 --2- 172.21.15.35:0/4076559469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f2930103cb0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 -- 172.21.15.35:0/4076559469 >> 172.21.15.35:0/4076559469 conn(0x7f2930076330 msgr2=0x7f2930076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 -- 172.21.15.35:0/4076559469 shutdown_connections 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.712+0000 7f2934e66700 1 -- 172.21.15.35:0/4076559469 wait complete. 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 Processor -- start 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 -- start start 2023-03-17T10:25:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29300ff350 0x7f29301961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f29301966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2930104390 0x7f293019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293019b190 con 0x7f29300ffcf0 2023-03-17T10:25:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293019b300 con 0x7f29300ff350 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f2934e66700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293019b4c0 con 0x7f2930104390 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f292dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f29301966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f292dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f29301966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50410/0 (socket says 172.21.15.35:50410) 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f292dd9b700 1 -- 172.21.15.35:0/3718843205 learned_addr learned my addr 172.21.15.35:0/3718843205 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f292e59c700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29300ff350 0x7f29301961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.713+0000 7f292dd9b700 1 -- 172.21.15.35:0/3718843205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2930104390 msgr2=0x7f293019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2930104390 0x7f293019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f292dd9b700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2930104390 0x7f293019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f292dd9b700 1 -- 172.21.15.35:0/3718843205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29300ff350 msgr2=0x7f29301961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f292dd9b700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29300ff350 0x7f29301961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f292dd9b700 1 -- 172.21.15.35:0/3718843205 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200095f0 con 0x7f29300ffcf0 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f292dd9b700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f29301966f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2920009fd0 tx=0x7f292000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f29277fe700 1 -- 172.21.15.35:0/3718843205 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292001d070 con 0x7f29300ffcf0 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f29277fe700 1 -- 172.21.15.35:0/3718843205 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29200059a0 con 0x7f29300ffcf0 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2930110170 con 0x7f29300ffcf0 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f29277fe700 1 -- 172.21.15.35:0/3718843205 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920022e90 con 0x7f29300ffcf0 2023-03-17T10:25:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.714+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293010ffe0 con 0x7f29300ffcf0 2023-03-17T10:25:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.716+0000 7f29277fe700 1 -- 172.21.15.35:0/3718843205 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2920022470 con 0x7f29300ffcf0 2023-03-17T10:25:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.717+0000 7f29277fe700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f291c09f640 0x7f291c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.717+0000 7f292e59c700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f291c09f640 0x7f291c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:25:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.717+0000 7f29277fe700 1 -- 172.21.15.35:0/3718843205 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f29200cb630 con 0x7f29300ffcf0 2023-03-17T10:25:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.717+0000 7f292e59c700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f291c09f640 0x7f291c0a1af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2918009c60 tx=0x7f2918009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:25:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 Processor -- start 2023-03-17T10:25:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 -- start start 2023-03-17T10:25:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc38363be0 0x55cc38363fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc383644f0 0x55cc3835e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:25:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3835ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc38265010 con 0x55cc3835e960 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc382b7950 con 0x55cc38363be0 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.718+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc382b0de0 con 0x55cc383644f0 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3835ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3835ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50420/0 (socket says 172.21.15.35:50420) 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 -- 172.21.15.35:0/3746862718 learned_addr learned my addr 172.21.15.35:0/3746862718 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292dd9b700 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc383644f0 0x55cc3835e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292e59c700 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc38363be0 0x55cc38363fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 -- 172.21.15.35:0/3746862718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc383644f0 msgr2=0x55cc3835e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc383644f0 0x55cc3835e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 -- 172.21.15.35:0/3746862718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc38363be0 msgr2=0x55cc38363fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc38363be0 0x55cc38363fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 -- 172.21.15.35:0/3746862718 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc381325d0 con 0x55cc3835e960 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3835ed90 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f292800d1d0 tx=0x7f292800d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d673babb368864 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f2924ff9700 1 -- 172.21.15.35:0/3746862718 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280123f0 con 0x55cc3835e960 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f2924ff9700 1 -- 172.21.15.35:0/3746862718 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29280129e0 con 0x55cc3835e960 2023-03-17T10:26:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.719+0000 7f2924ff9700 1 -- 172.21.15.35:0/3746862718 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928011900 con 0x55cc3835e960 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3746862718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 msgr2=0x55cc3835ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3835ed90 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f292800d1d0 tx=0x7f292800d4e0 comp rx=0 tx=0).stop 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3746862718 shutdown_connections 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3835ed90 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc38363be0 0x55cc38363fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3746862718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc383644f0 0x55cc3835e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3746862718 >> 172.21.15.35:0/3746862718 conn(0x55cc381bb6b0 msgr2=0x55cc38358a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3746862718 shutdown_connections 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3746862718 wait complete. 2023-03-17T10:26:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.720+0000 7f2940ff3b80 1 -- start start 2023-03-17T10:26:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 Processor -- start 2023-03-17T10:26:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3836a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc38367620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38367ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc381348c0 con 0x55cc3835e960 2023-03-17T10:26:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc38368310 con 0x55cc383644f0 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc383684d0 con 0x55cc38363be0 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2940ff3b80 10 client.0 _ll_register_callbacks cb 0x55cc38156230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3836a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3836a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50422/0 (socket says 172.21.15.35:50422) 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 -- 172.21.15.35:0/4269480873 learned_addr learned my addr 172.21.15.35:0/4269480873 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292dd9b700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc38367620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292ed9d700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38367ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 -- 172.21.15.35:0/4269480873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 msgr2=0x55cc38367620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc38367620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 -- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 msgr2=0x55cc38367ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38367ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 -- 172.21.15.35:0/4269480873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2928007cd0 con 0x55cc3835e960 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292dd9b700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc38367620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292ed9d700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38367ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f292e59c700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3836a3a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f2918005910 tx=0x7f29180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17abca1ac01496bd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.721+0000 7f2915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2915ffb700 1 -- 172.21.15.35:0/4269480873 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918022070 con 0x55cc3835e960 2023-03-17T10:26:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2915ffb700 1 -- 172.21.15.35:0/4269480873 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f291801d820 con 0x55cc3835e960 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc38273390 con 0x55cc3835e960 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2915ffb700 1 -- 172.21.15.35:0/4269480873 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f291801d9e0 con 0x55cc3835e960 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 10 client.18792 fetch_fsmap learned FSMap version 43 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55cc380ded80 con 0x55cc3835e960 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2915ffb700 1 -- 172.21.15.35:0/4269480873 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cc38273390 con 0x55cc3835e960 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2915ffb700 1 -- 172.21.15.35:0/4269480873 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2918027ad0 con 0x55cc3835e960 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 10 client.18792 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 10 client.18792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 20 client.18792 populate_metadata read hostname 'smithi035' 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc38378070 0x55cc3837a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 4 client.18792 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.722+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc3827f600 con 0x55cc38378070 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.723+0000 7f292dd9b700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc38378070 0x55cc3837a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.723+0000 7f2915ffb700 10 client.18792 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.723+0000 7f292dd9b700 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc38378070 0x55cc3837a480 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316595ed43175a2 server_cookie=4f37a33f5ea006b6 in_seq=0 out_seq=0 2023-03-17T10:26:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2915ffb700 1 -- 172.21.15.35:0/4269480873 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55cc3827f600 con 0x55cc38378070 2023-03-17T10:26:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2915ffb700 10 client.18792 handle_command_reply: tid=0 2023-03-17T10:26:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 client.18792 shutdown 2023-03-17T10:26:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 msgr2=0x55cc3836a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3836a3a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f2918005910 tx=0x7f29180047c0 comp rx=0 tx=0).stop 2023-03-17T10:26:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 shutdown_connections 2023-03-17T10:26:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc38378070 0x55cc3837a480 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2915ffb700 0 client.18792 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:26:09.944 INFO:tasks.workunit.client.0.smithi035.stdout: 1 50220 2.92 MB/sec warmup 99 sec latency 14.213 ms 2023-03-17T10:26:09.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38367ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc3836a3a0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/4269480873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc38367620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 >> 172.21.15.35:0/4269480873 conn(0x55cc381bb6b0 msgr2=0x55cc38358a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 shutdown_connections 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 1 -- 172.21.15.35:0/4269480873 wait complete. 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.724+0000 7f2940ff3b80 20 client.18792 trim_cache size 0 max 16384 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 Processor -- start 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 -- start start 2023-03-17T10:26:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc38358ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc383650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38369f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc38273390 con 0x55cc3835e960 2023-03-17T10:26:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc383540f0 con 0x55cc383644f0 2023-03-17T10:26:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc38375720 con 0x55cc38363be0 2023-03-17T10:26:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f292e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc38358ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f292e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc38358ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50430/0 (socket says 172.21.15.35:50430) 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.739+0000 7f292e59c700 1 -- 172.21.15.35:0/2919417016 learned_addr learned my addr 172.21.15.35:0/2919417016 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292e59c700 1 -- 172.21.15.35:0/2919417016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 msgr2=0x55cc383650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292e59c700 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc383650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292e59c700 1 -- 172.21.15.35:0/2919417016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 msgr2=0x55cc38369f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292ed9d700 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38369f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292e59c700 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38369f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292e59c700 1 -- 172.21.15.35:0/2919417016 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc38277130 con 0x55cc3835e960 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292ed9d700 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38369f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f292e59c700 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc38358ac0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f2918016040 tx=0x7f2918004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c25293086d414d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f29257fa700 1 -- 172.21.15.35:0/2919417016 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918022070 con 0x55cc3835e960 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f29257fa700 1 -- 172.21.15.35:0/2919417016 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2918003f50 con 0x55cc3835e960 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f29257fa700 1 -- 172.21.15.35:0/2919417016 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291801dae0 con 0x55cc3835e960 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f2940ff3b80 1 -- 172.21.15.35:0/2919417016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 msgr2=0x55cc38358ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc38358ac0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f2918016040 tx=0x7f2918004700 comp rx=0 tx=0).stop 2023-03-17T10:26:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f2940ff3b80 1 -- 172.21.15.35:0/2919417016 shutdown_connections 2023-03-17T10:26:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc383644f0 0x55cc38369f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.740+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3835e960 0x55cc38358ac0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/2919417016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc383650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- 172.21.15.35:0/2919417016 >> 172.21.15.35:0/2919417016 conn(0x55cc381bb6b0 msgr2=0x55cc38364990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- 172.21.15.35:0/2919417016 shutdown_connections 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- 172.21.15.35:0/2919417016 wait complete. 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- start start 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 Processor -- start 2023-03-17T10:26:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3835e960 0x55cc3836ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc3836d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 0x55cc3836d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3836dfa0 con 0x55cc383644f0 2023-03-17T10:26:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3836e110 con 0x55cc3835e960 2023-03-17T10:26:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc383cbf20 con 0x55cc38363be0 2023-03-17T10:26:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f2940ff3b80 10 client.0 _ll_register_callbacks cb 0x55cc38156230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:26:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f292ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 0x55cc3836d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f292ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 0x55cc3836d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50440/0 (socket says 172.21.15.35:50440) 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f292ed9d700 1 -- 172.21.15.35:0/3141146982 learned_addr learned my addr 172.21.15.35:0/3141146982 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.741+0000 7f292e59c700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3835e960 0x55cc3836ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292dd9b700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc3836d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292ed9d700 1 -- 172.21.15.35:0/3141146982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 msgr2=0x55cc3836d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc3836d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292ed9d700 1 -- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3835e960 msgr2=0x55cc3836ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3835e960 0x55cc3836ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292ed9d700 1 -- 172.21.15.35:0/3141146982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc380ded80 con 0x55cc383644f0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f292ed9d700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 0x55cc3836d860 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f292800d830 tx=0x7f2928004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78dcc382e7de5116 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2915ffb700 1 -- 172.21.15.35:0/3141146982 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280116d0 con 0x55cc383644f0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2915ffb700 1 -- 172.21.15.35:0/3141146982 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(231..231 src has 1..231) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2928011830 con 0x55cc383644f0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc3832e1e0 con 0x55cc383644f0 2023-03-17T10:26:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2915ffb700 1 -- 172.21.15.35:0/3141146982 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29280119f0 con 0x55cc383644f0 2023-03-17T10:26:15.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2940ff3b80 10 client.18798 fetch_fsmap learned FSMap version 43 2023-03-17T10:26:15.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55cc381051f0 con 0x55cc383644f0 2023-03-17T10:26:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2915ffb700 1 -- 172.21.15.35:0/3141146982 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cc3832e1e0 con 0x55cc383644f0 2023-03-17T10:26:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2915ffb700 1 -- 172.21.15.35:0/3141146982 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 43) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2928005800 con 0x55cc383644f0 2023-03-17T10:26:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.742+0000 7f2940ff3b80 10 client.18798 fetch_fsmap finished waiting for FSMap version 43 2023-03-17T10:26:17.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f2940ff3b80 10 client.18798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:26:17.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f2940ff3b80 20 client.18798 populate_metadata read hostname 'smithi035' 2023-03-17T10:26:17.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc383cd4c0 0x55cc383cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:17.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f2940ff3b80 4 client.18798 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:26:17.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc38134f00 con 0x55cc383cd4c0 2023-03-17T10:26:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f292e59c700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc383cd4c0 0x55cc383cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f292e59c700 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc383cd4c0 0x55cc383cf8d0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf972adafcd526b server_cookie=7874b7ae8bc0bee in_seq=0 out_seq=0 2023-03-17T10:26:18.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:01.743+0000 7f2915ffb700 10 client.18798 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:26:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2915ffb700 1 -- 172.21.15.35:0/3141146982 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc38134f00 con 0x55cc383cd4c0 2023-03-17T10:26:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2915ffb700 10 client.18798 handle_command_reply: tid=0 2023-03-17T10:26:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 client.18798 shutdown 2023-03-17T10:26:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 msgr2=0x55cc3836d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 0x55cc3836d860 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f292800d830 tx=0x7f2928004ea0 comp rx=0 tx=0).stop 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 shutdown_connections 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc383cd4c0 0x55cc383cf8d0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc383644f0 0x55cc3836d860 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3835e960 0x55cc3836ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2915ffb700 0 client.18798 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 --2- 172.21.15.35:0/3141146982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc38363be0 0x55cc3836d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 >> 172.21.15.35:0/3141146982 conn(0x55cc381bb6b0 msgr2=0x55cc38362720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 shutdown_connections 2023-03-17T10:26:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 1 -- 172.21.15.35:0/3141146982 wait complete. 2023-03-17T10:26:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.308+0000 7f2940ff3b80 20 client.18798 trim_cache size 0 max 16384 2023-03-17T10:26:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f291c09f640 msgr2=0x7f291c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f291c09f640 0x7f291c0a1af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2918009c60 tx=0x7f2918009260 comp rx=0 tx=0).stop 2023-03-17T10:26:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 msgr2=0x7f29301966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f29301966f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2920009fd0 tx=0x7f292000f690 comp rx=0 tx=0).stop 2023-03-17T10:26:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 shutdown_connections 2023-03-17T10:26:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f291c09f640 0x7f291c0a1af0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2930104390 0x7f293019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29300ff350 0x7f29301961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 --2- 172.21.15.35:0/3718843205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f29300ffcf0 0x7f29301966f0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 >> 172.21.15.35:0/3718843205 conn(0x7f2930076330 msgr2=0x7f2930102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 shutdown_connections 2023-03-17T10:26:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:03.309+0000 7f2934e66700 1 -- 172.21.15.35:0/3718843205 wait complete. 2023-03-17T10:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 -- 172.21.15.35:0/672285534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b8101d00 msgr2=0x7f13b810a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 --2- 172.21.15.35:0/672285534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b8101d00 0x7f13b810a1f0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009990 tx=0x7f13a8009ca0 comp rx=0 tx=0).stop 2023-03-17T10:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 -- 172.21.15.35:0/672285534 shutdown_connections 2023-03-17T10:26:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 --2- 172.21.15.35:0/672285534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b810a730 0x7f13b810cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 --2- 172.21.15.35:0/672285534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b81013f0 0x7f13b81017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 --2- 172.21.15.35:0/672285534 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b8101d00 0x7f13b810a1f0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 -- 172.21.15.35:0/672285534 >> 172.21.15.35:0/672285534 conn(0x7f13b8076330 msgr2=0x7f13b8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:25.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 -- 172.21.15.35:0/672285534 shutdown_connections 2023-03-17T10:26:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.436+0000 7f13bf654700 1 -- 172.21.15.35:0/672285534 wait complete. 2023-03-17T10:26:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 Processor -- start 2023-03-17T10:26:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 -- start start 2023-03-17T10:26:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b81013f0 0x7f13b8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b8101d00 0x7f13b8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 0x7f13b819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b819d3e0 con 0x7f13b810a730 2023-03-17T10:26:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b819d550 con 0x7f13b81013f0 2023-03-17T10:26:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bf654700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b819d710 con 0x7f13b8101d00 2023-03-17T10:26:28.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bdbf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 0x7f13b819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bdbf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 0x7f13b819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50476/0 (socket says 172.21.15.35:50476) 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bdbf1700 1 -- 172.21.15.35:0/29891527 learned_addr learned my addr 172.21.15.35:0/29891527 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bcbef700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b8101d00 0x7f13b8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.437+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b81013f0 0x7f13b8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bdbf1700 1 -- 172.21.15.35:0/29891527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b8101d00 msgr2=0x7f13b8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b8101d00 0x7f13b8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bdbf1700 1 -- 172.21.15.35:0/29891527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b81013f0 msgr2=0x7f13b8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:28.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b81013f0 0x7f13b8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bdbf1700 1 -- 172.21.15.35:0/29891527 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80095f0 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 0x7f13b819cda0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f13b0007ee0 tx=0x7f13b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13ae7fc700 1 -- 172.21.15.35:0/29891527 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0017070 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13ae7fc700 1 -- 172.21.15.35:0/29891527 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b000f040 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b81100b0 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13ae7fc700 1 -- 172.21.15.35:0/29891527 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0005570 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.438+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b810ff20 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.441+0000 7f13ae7fc700 1 -- 172.21.15.35:0/29891527 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f13b000db20 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.441+0000 7f13ae7fc700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f13a409f640 0x7f13a40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.442+0000 7f13ae7fc700 1 -- 172.21.15.35:0/29891527 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f13b00c9cf0 con 0x7f13b810a730 2023-03-17T10:26:29.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.442+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f13a409f640 0x7f13a40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.442+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f13a409f640 0x7f13a40a1af0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f13b4005950 tx=0x7f13b400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.442+0000 7f13cb7e1b80 1 Processor -- start 2023-03-17T10:26:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 -- start start 2023-03-17T10:26:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 0x55b574251fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b57424c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b57424cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b574153010 con 0x55b574251be0 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5741a5950 con 0x55b5742524f0 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57419ede0 con 0x55b57424c960 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 0x55b574251fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 0x55b574251fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50480/0 (socket says 172.21.15.35:50480) 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1649070998 learned_addr learned my addr 172.21.15.35:0/1649070998 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bcbef700 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b57424c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b57424cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1649070998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 msgr2=0x55b57424cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b57424cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1649070998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 msgr2=0x55b57424c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b57424c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1649070998 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5740205d0 con 0x55b574251be0 2023-03-17T10:26:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bcbef700 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b57424c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:26:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.443+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 0x55b574251fb0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f13b4010fa0 tx=0x7f13b4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b0ac4fcf412123 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:31.004 INFO:tasks.workunit.client.0.smithi035.stdout: 1 50632 2.90 MB/sec warmup 100 sec latency 14.339 ms 2023-03-17T10:26:32.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:10 smithi035 ceph-mon[92535]: pgmap v2944: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T10:26:32.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:12 smithi035 ceph-mon[92535]: pgmap v2945: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:12 smithi035 ceph-mon[92535]: osdmap e260: 12 total, 12 up, 12 in 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:14 smithi035 ceph-mon[92535]: pgmap v2947: 97 pgs: 97 active+clean; 53 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 1.5 MiB/s wr, 162 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:16 smithi035 ceph-mon[92535]: pgmap v2948: 97 pgs: 97 active+clean; 53 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:17 smithi035 ceph-mon[92535]: pgmap v2949: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:20 smithi035 ceph-mon[92535]: pgmap v2950: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:22 smithi035 ceph-mon[92535]: pgmap v2951: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:24 smithi035 ceph-mon[92535]: pgmap v2952: 97 pgs: 97 active+clean; 59 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 1.8 MiB/s wr, 186 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:26 smithi035 ceph-mon[92535]: pgmap v2953: 97 pgs: 97 active+clean; 59 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.3 MiB/s wr, 117 op/s 2023-03-17T10:26:32.661 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:27 smithi035 ceph-mon[92535]: pgmap v2954: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2023-03-17T10:26:32.662 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:30 smithi035 ceph-mon[92535]: pgmap v2955: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T10:26:33.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:32 smithi035 ceph-mon[92535]: pgmap v2956: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T10:26:33.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:34 smithi035 ceph-mon[92535]: pgmap v2957: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T10:26:33.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:26:33.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:26:33.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:26:34.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:26:34.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:35 smithi035 ceph-mon[92535]: pgmap v2958: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2023-03-17T10:26:34.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:35 smithi035 ceph-mon[92535]: pgmap v2959: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.7 MiB/s wr, 168 op/s 2023-03-17T10:26:34.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:35 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:26:34.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:37 smithi035 ceph-mon[92535]: pgmap v2960: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 963 KiB/s wr, 83 op/s 2023-03-17T10:26:34.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:39 smithi035 ceph-mon[92535]: pgmap v2961: 97 pgs: 97 active+clean; 65 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.8 MiB/s wr, 159 op/s 2023-03-17T10:26:34.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:41 smithi035 ceph-mon[92535]: pgmap v2962: 97 pgs: 97 active+clean; 65 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.8 MiB/s wr, 159 op/s 2023-03-17T10:26:34.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:42 smithi035 ceph-mon[92535]: pgmap v2963: 97 pgs: 97 active+clean; 66 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2023-03-17T10:26:34.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:44 smithi035 ceph-mon[92535]: pgmap v2964: 97 pgs: 97 active+clean; 65 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.3 MiB/s wr, 138 op/s 2023-03-17T10:26:34.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:46 smithi035 ceph-mon[92535]: pgmap v2965: 97 pgs: 97 active+clean; 65 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2023-03-17T10:26:35.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:49 smithi035 ceph-mon[92535]: pgmap v2966: 97 pgs: 97 active+clean; 68 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.7 MiB/s wr, 177 op/s 2023-03-17T10:26:35.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:51 smithi035 ceph-mon[92535]: pgmap v2967: 97 pgs: 97 active+clean; 68 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T10:26:35.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:52 smithi035 ceph-mon[92535]: pgmap v2968: 97 pgs: 97 active+clean; 70 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 1.5 MiB/s wr, 174 op/s 2023-03-17T10:26:35.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:54 smithi035 ceph-mon[92535]: pgmap v2969: 97 pgs: 97 active+clean; 70 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2023-03-17T10:26:35.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:57 smithi035 ceph-mon[92535]: pgmap v2970: 97 pgs: 97 active+clean; 70 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:16:59 smithi035 ceph-mon[92535]: pgmap v2971: 97 pgs: 97 active+clean; 72 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.9 MiB/s wr, 178 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:00 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:01 smithi035 ceph-mon[92535]: pgmap v2972: 97 pgs: 97 active+clean; 72 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 1.2 MiB/s wr, 116 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:02 smithi035 ceph-mon[92535]: pgmap v2973: 97 pgs: 97 active+clean; 56 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.6 MiB/s wr, 193 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:04 smithi035 ceph-mon[92535]: osdmap e261: 12 total, 12 up, 12 in 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:04 smithi035 ceph-mon[92535]: pgmap v2975: 97 pgs: 97 active+clean; 57 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:07 smithi035 ceph-mon[92535]: pgmap v2976: 97 pgs: 97 active+clean; 57 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:09 smithi035 ceph-mon[92535]: pgmap v2977: 97 pgs: 97 active+clean; 61 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:11 smithi035 ceph-mon[92535]: pgmap v2978: 97 pgs: 97 active+clean; 61 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:12 smithi035 ceph-mon[92535]: osdmap e262: 12 total, 12 up, 12 in 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:12 smithi035 ceph-mon[92535]: pgmap v2980: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2023-03-17T10:26:36.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:14 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:14 smithi035 ceph-mon[92535]: pgmap v2981: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.5 MiB/s wr, 139 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:17 smithi035 ceph-mon[92535]: pgmap v2982: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.5 MiB/s wr, 139 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:19 smithi035 ceph-mon[92535]: pgmap v2983: 97 pgs: 97 active+clean; 59 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:21 smithi035 ceph-mon[92535]: pgmap v2984: 97 pgs: 97 active+clean; 59 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:22 smithi035 ceph-mon[92535]: pgmap v2985: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 2.0 MiB/s wr, 206 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:25 smithi035 ceph-mon[92535]: pgmap v2986: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:27 smithi035 ceph-mon[92535]: pgmap v2987: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2023-03-17T10:26:36.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:29 smithi035 ceph-mon[92535]: pgmap v2988: 97 pgs: 97 active+clean; 61 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.9 MiB/s wr, 184 op/s 2023-03-17T10:26:39.520 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:31 smithi035 ceph-mon[92535]: pgmap v2989: 97 pgs: 97 active+clean; 61 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T10:26:39.520 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:32 smithi035 ceph-mon[92535]: pgmap v2990: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.8 MiB/s wr, 181 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:35 smithi035 ceph-mon[92535]: pgmap v2991: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:36 smithi035 ceph-mon[92535]: pgmap v2992: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:36 smithi035 ceph-mon[92535]: pgmap v2993: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.4 MiB/s wr, 161 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:37 smithi035 ceph-mon[92535]: pgmap v2994: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:40 smithi035 ceph-mon[92535]: pgmap v2995: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:42 smithi035 ceph-mon[92535]: pgmap v2996: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 927 KiB/s wr, 78 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:44 smithi035 ceph-mon[92535]: pgmap v2997: 97 pgs: 97 active+clean; 67 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T10:26:39.521 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:46 smithi035 ceph-mon[92535]: pgmap v2998: 97 pgs: 97 active+clean; 67 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.6 MiB/s wr, 143 op/s 2023-03-17T10:26:39.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:47 smithi035 ceph-mon[92535]: pgmap v2999: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.9 MiB/s wr, 181 op/s 2023-03-17T10:26:39.522 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:50 smithi035 ceph-mon[92535]: pgmap v3000: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T10:26:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:26:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:26:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:26:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:26:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:26:41.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:26:41.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:26:41.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13a37fe700 1 -- 172.21.15.35:0/1649070998 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4011db0 con 0x55b574251be0 2023-03-17T10:26:42.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13a37fe700 1 -- 172.21.15.35:0/1649070998 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b4015070 con 0x55b574251be0 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13a37fe700 1 -- 172.21.15.35:0/1649070998 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b401c5f0 con 0x55b574251be0 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1649070998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 msgr2=0x55b574251fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 0x55b574251fb0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f13b4010fa0 tx=0x7f13b4013000 comp rx=0 tx=0).stop 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1649070998 shutdown_connections 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b57424cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b574251be0 0x55b574251fb0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1649070998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b57424c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1649070998 >> 172.21.15.35:0/1649070998 conn(0x55b5740a96b0 msgr2=0x55b574246a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:46.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1649070998 shutdown_connections 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.444+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1649070998 wait complete. 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 -- start start 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 Processor -- start 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b5742583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b574251be0 0x55b574255630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b574255bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5740228c0 con 0x55b5742524f0 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b574256340 con 0x55b574251be0 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b574256500 con 0x55b57424c960 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13cb7e1b80 10 client.0 _ll_register_callbacks cb 0x55b574044230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13bdbf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b574255bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13bdbf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b574255bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50490/0 (socket says 172.21.15.35:50490) 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.445+0000 7f13bdbf1700 1 -- 172.21.15.35:0/547746535 learned_addr learned my addr 172.21.15.35:0/547746535 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:46.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b5742583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bcbef700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b574251be0 0x55b574255630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bdbf1700 1 -- 172.21.15.35:0/547746535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 msgr2=0x55b5742583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b5742583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bdbf1700 1 -- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b574251be0 msgr2=0x55b574255630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b574251be0 0x55b574255630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bdbf1700 1 -- 172.21.15.35:0/547746535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b4010c50 con 0x55b5742524f0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bcbef700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b574251be0 0x55b574255630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b574255bd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f13b0094240 tx=0x7f13b0097310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b41cc73cca5359d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13a0ff9700 1 -- 172.21.15.35:0/547746535 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b000ddd0 con 0x55b5742524f0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13a0ff9700 1 -- 172.21.15.35:0/547746535 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(234..234 src has 1..234) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f13b00977d0 con 0x55b5742524f0 2023-03-17T10:26:47.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b574161390 con 0x55b5742524f0 2023-03-17T10:26:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13a0ff9700 1 -- 172.21.15.35:0/547746535 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13b009f9c0 con 0x55b5742524f0 2023-03-17T10:26:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13cb7e1b80 10 client.18816 fetch_fsmap learned FSMap version 45 2023-03-17T10:26:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55b573fccd80 con 0x55b5742524f0 2023-03-17T10:26:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.446+0000 7f13a0ff9700 1 -- 172.21.15.35:0/547746535 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b574161390 con 0x55b5742524f0 2023-03-17T10:26:47.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13a0ff9700 1 -- 172.21.15.35:0/547746535 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f13b009f5c0 con 0x55b5742524f0 2023-03-17T10:26:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13cb7e1b80 10 client.18816 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:26:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13cb7e1b80 10 client.18816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:26:51.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13cb7e1b80 20 client.18816 populate_metadata read hostname 'smithi035' 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b574266020 0x55b574268430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13cb7e1b80 4 client.18816 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b57416d600 con 0x55b574266020 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b574266020 0x55b574268430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13a0ff9700 10 client.18816 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.447+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b574266020 0x55b574268430 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a099a4cd0e40cc server_cookie=535ebbe213885171 in_seq=0 out_seq=0 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13a0ff9700 1 -- 172.21.15.35:0/547746535 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b57416d600 con 0x55b574266020 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13a0ff9700 10 client.18816 handle_command_reply: tid=0 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 client.18816 shutdown 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 msgr2=0x55b574255bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b574255bd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f13b0094240 tx=0x7f13b0097310 comp rx=0 tx=0).stop 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 shutdown_connections 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b574266020 0x55b574268430 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b574255bd0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b57424c960 0x55b5742583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13a0ff9700 0 client.18816 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/547746535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b574251be0 0x55b574255630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.448+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 >> 172.21.15.35:0/547746535 conn(0x55b5740a96b0 msgr2=0x55b57424b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.449+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 shutdown_connections 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.449+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/547746535 wait complete. 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.449+0000 7f13cb7e1b80 20 client.18816 trim_cache size 0 max 16384 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 Processor -- start 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 -- start start 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b57424c960 0x55b574246ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b57425cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b57424f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b574161390 con 0x55b5742524f0 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b574162050 con 0x55b57424c960 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b574247000 con 0x55b574251be0 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b57424f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b57424f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50498/0 (socket says 172.21.15.35:50498) 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 -- 172.21.15.35:0/3181311345 learned_addr learned my addr 172.21.15.35:0/3181311345 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:26:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b57424c960 0x55b574246ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bcbef700 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b57425cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 -- 172.21.15.35:0/3181311345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 msgr2=0x55b57425cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b57425cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 -- 172.21.15.35:0/3181311345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b57424c960 msgr2=0x55b574246ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b57424c960 0x55b574246ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.464+0000 7f13bdbf1700 1 -- 172.21.15.35:0/3181311345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b574165130 con 0x55b5742524f0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b57424f6b0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f13b0095b20 tx=0x7f13b0004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af536d8c5f2f5125 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13a3fff700 1 -- 172.21.15.35:0/3181311345 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0097130 con 0x55b5742524f0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13a3fff700 1 -- 172.21.15.35:0/3181311345 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13b00afb30 con 0x55b5742524f0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13a3fff700 1 -- 172.21.15.35:0/3181311345 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b009f730 con 0x55b5742524f0 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/3181311345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 msgr2=0x55b57424f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b57424f6b0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f13b0095b20 tx=0x7f13b0004e70 comp rx=0 tx=0).stop 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/3181311345 shutdown_connections 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b5742524f0 0x55b57424f6b0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b57424c960 0x55b574246ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/3181311345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b57425cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/3181311345 >> 172.21.15.35:0/3181311345 conn(0x55b5740a96b0 msgr2=0x55b574262240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.465+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/3181311345 shutdown_connections 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.466+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/3181311345 wait complete. 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.466+0000 7f13cb7e1b80 1 -- start start 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.466+0000 7f13cb7e1b80 1 Processor -- start 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.466+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 0x55b5742ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.466+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b5742ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13cb7e1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b5742b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:26:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5742b9410 con 0x55b57424c960 2023-03-17T10:26:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5742b9550 con 0x55b5742524f0 2023-03-17T10:26:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13cb7e1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5742b9690 con 0x55b574251be0 2023-03-17T10:26:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13cb7e1b80 10 client.0 _ll_register_callbacks cb 0x55b574044230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:26:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 0x55b5742ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 0x55b5742ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50500/0 (socket says 172.21.15.35:50500) 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1185845319 learned_addr learned my addr 172.21.15.35:0/1185845319 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bcbef700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b5742ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b5742b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1185845319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 msgr2=0x55b5742ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b5742ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 msgr2=0x55b5742b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b5742b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 -- 172.21.15.35:0/1185845319 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b573fccd80 con 0x55b57424c960 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bdbf1700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b5742b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13bd3f0700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 0x55b5742ae040 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f13b4010f70 tx=0x7f13b4010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd8715ca295a89 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13a0ff9700 1 -- 172.21.15.35:0/1185845319 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b402b030 con 0x55b57424c960 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13a0ff9700 1 -- 172.21.15.35:0/1185845319 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(234..234 src has 1..234) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f13b4017070 con 0x55b57424c960 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.467+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b57421c1e0 con 0x55b57424c960 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13a0ff9700 1 -- 172.21.15.35:0/1185845319 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13b4032390 con 0x55b57424c960 2023-03-17T10:27:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 10 client.18822 fetch_fsmap learned FSMap version 45 2023-03-17T10:27:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55b573ff31f0 con 0x55b57424c960 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13a0ff9700 1 -- 172.21.15.35:0/1185845319 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b57421c1e0 con 0x55b57424c960 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13a0ff9700 1 -- 172.21.15.35:0/1185845319 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f13b4011720 con 0x55b57424c960 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 10 client.18822 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 10 client.18822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 20 client.18822 populate_metadata read hostname 'smithi035' 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5742bae20 0x55b5742bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 4 client.18822 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:27:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b574022f00 con 0x55b5742bae20 2023-03-17T10:27:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.468+0000 7f13bcbef700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5742bae20 0x55b5742bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.469+0000 7f13a0ff9700 10 client.18822 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:27:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.469+0000 7f13bcbef700 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5742bae20 0x55b5742bd230 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61784bf7bba74844 server_cookie=6085233187802c0f in_seq=0 out_seq=0 2023-03-17T10:27:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.476+0000 7f13a0ff9700 1 -- 172.21.15.35:0/1185845319 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b574022f00 con 0x55b5742bae20 2023-03-17T10:27:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.476+0000 7f13a0ff9700 10 client.18822 handle_command_reply: tid=0 2023-03-17T10:27:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.476+0000 7f13cb7e1b80 1 client.18822 shutdown 2023-03-17T10:27:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 msgr2=0x55b5742ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:04.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 0x55b5742ae040 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f13b4010f70 tx=0x7f13b4010fd0 comp rx=0 tx=0).stop 2023-03-17T10:27:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 shutdown_connections 2023-03-17T10:27:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b5742bae20 0x55b5742bd230 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b5742524f0 0x55b5742b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13a0ff9700 0 client.18822 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:27:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b57424c960 0x55b5742ae040 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 --2- 172.21.15.35:0/1185845319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b574251be0 0x55b5742ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 >> 172.21.15.35:0/1185845319 conn(0x55b5740a96b0 msgr2=0x55b57424b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 shutdown_connections 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 1 -- 172.21.15.35:0/1185845319 wait complete. 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13cb7e1b80 20 client.18822 trim_cache size 0 max 16384 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f13a409f640 msgr2=0x7f13a40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13bf654700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f13a409f640 0x7f13a40a1af0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f13b4005950 tx=0x7f13b400b410 comp rx=0 tx=0).stop 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 msgr2=0x7f13b819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.477+0000 7f13bf654700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 0x7f13b819cda0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f13b0007ee0 tx=0x7f13b000d3b0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 shutdown_connections 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f13a409f640 0x7f13a40a1af0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f13b810a730 0x7f13b819cda0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b81013f0 0x7f13b8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 --2- 172.21.15.35:0/29891527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13b8101d00 0x7f13b8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 >> 172.21.15.35:0/29891527 conn(0x7f13b8076330 msgr2=0x7f13b80ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 shutdown_connections 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:16.478+0000 7f13bf654700 1 -- 172.21.15.35:0/29891527 wait complete. 2023-03-17T10:27:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 -- 172.21.15.35:0/2048571314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101490 msgr2=0x7facb4101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 --2- 172.21.15.35:0/2048571314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101490 0x7facb4101860 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7faca4009990 tx=0x7faca4009ca0 comp rx=0 tx=0).stop 2023-03-17T10:27:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 -- 172.21.15.35:0/2048571314 shutdown_connections 2023-03-17T10:27:07.097 INFO:tasks.workunit.client.0.smithi035.stdout: 1 51196 2.91 MB/sec warmup 101 sec latency 15.767 ms 2023-03-17T10:27:08.506 INFO:tasks.workunit.client.0.smithi035.stdout: 1 51790 2.89 MB/sec warmup 102 sec latency 15.511 ms 2023-03-17T10:27:08.506 INFO:tasks.workunit.client.0.smithi035.stdout: 1 52292 2.88 MB/sec warmup 103 sec latency 14.874 ms 2023-03-17T10:27:08.506 INFO:tasks.workunit.client.0.smithi035.stdout: 1 52997 2.91 MB/sec warmup 104 sec latency 15.729 ms 2023-03-17T10:27:08.506 INFO:tasks.workunit.client.0.smithi035.stdout: 1 53451 2.93 MB/sec warmup 105 sec latency 14.292 ms 2023-03-17T10:27:09.225 INFO:tasks.workunit.client.0.smithi035.stdout: 1 53693 2.90 MB/sec warmup 106 sec latency 13.012 ms 2023-03-17T10:27:09.225 INFO:tasks.workunit.client.0.smithi035.stdout: 1 54070 2.88 MB/sec warmup 107 sec latency 14.789 ms 2023-03-17T10:27:09.225 INFO:tasks.workunit.client.0.smithi035.stdout: 1 54624 2.90 MB/sec warmup 108 sec latency 15.772 ms 2023-03-17T10:27:09.225 INFO:tasks.workunit.client.0.smithi035.stdout: 1 55212 2.87 MB/sec warmup 109 sec latency 13.103 ms 2023-03-17T10:27:09.226 INFO:tasks.workunit.client.0.smithi035.stdout: 1 55734 2.87 MB/sec warmup 110 sec latency 14.431 ms 2023-03-17T10:27:10.765 INFO:tasks.workunit.client.0.smithi035.stdout: 1 56516 2.90 MB/sec warmup 111 sec latency 14.956 ms 2023-03-17T10:27:10.765 INFO:tasks.workunit.client.0.smithi035.stdout: 1 56911 2.91 MB/sec warmup 112 sec latency 15.148 ms 2023-03-17T10:27:10.765 INFO:tasks.workunit.client.0.smithi035.stdout: 1 57197 2.89 MB/sec warmup 113 sec latency 45.366 ms 2023-03-17T10:27:12.988 INFO:tasks.workunit.client.0.smithi035.stdout: 1 57539 2.87 MB/sec warmup 114 sec latency 13.865 ms 2023-03-17T10:27:12.988 INFO:tasks.workunit.client.0.smithi035.stdout: 1 58055 2.86 MB/sec warmup 115 sec latency 14.356 ms 2023-03-17T10:27:12.988 INFO:tasks.workunit.client.0.smithi035.stdout: 1 58655 2.86 MB/sec warmup 116 sec latency 15.919 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 59232 2.86 MB/sec warmup 117 sec latency 12.179 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 59975 2.88 MB/sec warmup 118 sec latency 14.039 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 60402 2.90 MB/sec warmup 119 sec latency 15.179 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 61045 0.26 MB/sec execute 1 sec latency 13.859 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 61549 1.06 MB/sec execute 2 sec latency 14.385 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 62161 1.80 MB/sec execute 3 sec latency 15.025 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 62722 1.76 MB/sec execute 4 sec latency 17.136 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 63322 2.52 MB/sec execute 5 sec latency 11.919 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 63851 2.90 MB/sec execute 6 sec latency 12.036 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 64210 2.73 MB/sec execute 7 sec latency 14.472 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 64466 2.39 MB/sec execute 8 sec latency 42.748 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 64942 2.34 MB/sec execute 9 sec latency 27.722 ms 2023-03-17T10:27:14.735 INFO:tasks.workunit.client.0.smithi035.stdout: 1 65482 2.43 MB/sec execute 10 sec latency 42.414 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 66074 2.27 MB/sec execute 11 sec latency 53.769 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 66637 2.51 MB/sec execute 12 sec latency 13.993 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 67195 2.58 MB/sec execute 13 sec latency 14.603 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 67662 2.71 MB/sec execute 14 sec latency 15.788 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 67905 2.55 MB/sec execute 15 sec latency 13.000 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 68341 2.44 MB/sec execute 16 sec latency 11.245 ms 2023-03-17T10:27:14.736 INFO:tasks.workunit.client.0.smithi035.stdout: 1 68870 2.55 MB/sec execute 17 sec latency 15.213 ms 2023-03-17T10:27:16.807 INFO:tasks.workunit.client.0.smithi035.stdout: 1 69442 2.44 MB/sec execute 18 sec latency 16.685 ms 2023-03-17T10:27:16.807 INFO:tasks.workunit.client.0.smithi035.stdout: 1 69970 2.43 MB/sec execute 19 sec latency 17.258 ms 2023-03-17T10:27:16.808 INFO:tasks.workunit.client.0.smithi035.stdout: 1 70702 2.63 MB/sec execute 20 sec latency 13.574 ms 2023-03-17T10:27:16.808 INFO:tasks.workunit.client.0.smithi035.stdout: 1 71101 2.67 MB/sec execute 21 sec latency 14.459 ms 2023-03-17T10:27:17.970 INFO:tasks.workunit.client.0.smithi035.stdout: 1 71380 2.61 MB/sec execute 22 sec latency 14.149 ms 2023-03-17T10:27:18.544 INFO:tasks.workunit.client.0.smithi035.stdout: 1 71720 2.51 MB/sec execute 23 sec latency 14.616 ms 2023-03-17T10:27:18.544 INFO:tasks.workunit.client.0.smithi035.stdout: 1 72213 2.48 MB/sec execute 24 sec latency 14.801 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 72829 2.51 MB/sec execute 25 sec latency 14.773 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 73429 2.48 MB/sec execute 26 sec latency 12.557 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 74160 2.62 MB/sec execute 27 sec latency 11.464 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 74548 2.68 MB/sec execute 28 sec latency 15.026 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 74904 2.64 MB/sec execute 29 sec latency 13.306 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 75144 2.55 MB/sec execute 30 sec latency 16.377 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 75626 2.53 MB/sec execute 31 sec latency 20.801 ms 2023-03-17T10:27:18.545 INFO:tasks.workunit.client.0.smithi035.stdout: 1 76164 2.56 MB/sec execute 32 sec latency 16.244 ms 2023-03-17T10:27:18.939 INFO:tasks.workunit.client.0.smithi035.stdout: 1 76838 2.53 MB/sec execute 33 sec latency 15.596 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 77414 2.58 MB/sec execute 34 sec latency 12.927 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 77878 2.60 MB/sec execute 35 sec latency 13.976 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 78360 2.65 MB/sec execute 36 sec latency 12.992 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 78628 2.59 MB/sec execute 37 sec latency 13.035 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 79066 2.54 MB/sec execute 38 sec latency 12.004 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 79618 2.59 MB/sec execute 39 sec latency 13.839 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 80236 2.54 MB/sec execute 40 sec latency 14.675 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 80703 2.53 MB/sec execute 41 sec latency 13.732 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 81397 2.62 MB/sec execute 42 sec latency 14.712 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 81842 2.66 MB/sec execute 43 sec latency 44.088 ms 2023-03-17T10:27:18.940 INFO:tasks.workunit.client.0.smithi035.stdout: 1 82049 2.61 MB/sec execute 44 sec latency 66.995 ms 2023-03-17T10:27:20.059 INFO:tasks.workunit.client.0.smithi035.stdout: 1 82393 2.56 MB/sec execute 45 sec latency 13.629 ms 2023-03-17T10:27:20.059 INFO:tasks.workunit.client.0.smithi035.stdout: 1 82887 2.54 MB/sec execute 46 sec latency 14.687 ms 2023-03-17T10:27:20.059 INFO:tasks.workunit.client.0.smithi035.stdout: 1 83482 2.56 MB/sec execute 47 sec latency 15.443 ms 2023-03-17T10:27:20.059 INFO:tasks.workunit.client.0.smithi035.stdout: 1 84043 2.54 MB/sec execute 48 sec latency 41.072 ms 2023-03-17T10:27:20.059 INFO:tasks.workunit.client.0.smithi035.stdout: 1 84645 2.60 MB/sec execute 49 sec latency 16.318 ms 2023-03-17T10:27:20.059 INFO:tasks.workunit.client.0.smithi035.stdout: 1 85184 2.65 MB/sec execute 50 sec latency 12.059 ms 2023-03-17T10:27:20.690 INFO:tasks.workunit.client.0.smithi035.stdout: 1 85541 2.63 MB/sec execute 51 sec latency 14.104 ms 2023-03-17T10:27:20.691 INFO:tasks.workunit.client.0.smithi035.stdout: 1 85798 2.58 MB/sec execute 52 sec latency 14.623 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 86340 2.57 MB/sec execute 53 sec latency 14.564 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 86891 2.58 MB/sec execute 54 sec latency 13.060 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 87544 2.56 MB/sec execute 55 sec latency 15.544 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 88116 2.62 MB/sec execute 56 sec latency 14.744 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 88569 2.60 MB/sec execute 57 sec latency 15.105 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 89030 2.63 MB/sec execute 58 sec latency 16.901 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 89291 2.59 MB/sec execute 59 sec latency 40.167 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 89764 2.58 MB/sec execute 60 sec latency 38.134 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 90306 2.59 MB/sec execute 61 sec latency 15.252 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 90911 2.56 MB/sec execute 62 sec latency 15.355 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 91443 2.60 MB/sec execute 63 sec latency 14.586 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 92045 2.62 MB/sec execute 64 sec latency 17.170 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 92496 2.64 MB/sec execute 65 sec latency 15.979 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 92733 2.61 MB/sec execute 66 sec latency 13.980 ms 2023-03-17T10:27:20.895 INFO:tasks.workunit.client.0.smithi035.stdout: 1 93139 2.58 MB/sec execute 67 sec latency 13.635 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 93673 2.61 MB/sec execute 68 sec latency 15.738 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 94249 2.57 MB/sec execute 69 sec latency 16.797 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 94761 2.57 MB/sec execute 70 sec latency 22.492 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 95542 2.63 MB/sec execute 71 sec latency 14.526 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 95935 2.64 MB/sec execute 72 sec latency 12.762 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 96224 2.62 MB/sec execute 73 sec latency 14.630 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 96572 2.59 MB/sec execute 74 sec latency 13.604 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 97065 2.58 MB/sec execute 75 sec latency 14.575 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 97680 2.59 MB/sec execute 76 sec latency 13.985 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 98247 2.58 MB/sec execute 77 sec latency 15.085 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 98986 2.62 MB/sec execute 78 sec latency 17.224 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 99367 2.64 MB/sec execute 79 sec latency 65.132 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 99724 2.63 MB/sec execute 80 sec latency 14.308 ms 2023-03-17T10:27:20.896 INFO:tasks.workunit.client.0.smithi035.stdout: 1 99978 2.60 MB/sec execute 81 sec latency 12.469 ms 2023-03-17T10:27:20.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 --2- 172.21.15.35:0/2048571314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 0x7facb410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 --2- 172.21.15.35:0/2048571314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101490 0x7facb4101860 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 --2- 172.21.15.35:0/2048571314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb4101da0 0x7facb410a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 -- 172.21.15.35:0/2048571314 >> 172.21.15.35:0/2048571314 conn(0x7facb4075f60 msgr2=0x7facb4076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:22.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 -- 172.21.15.35:0/2048571314 shutdown_connections 2023-03-17T10:27:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.600+0000 7facb9d8e700 1 -- 172.21.15.35:0/2048571314 wait complete. 2023-03-17T10:27:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 Processor -- start 2023-03-17T10:27:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 -- start start 2023-03-17T10:27:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb4101490 0x7facb40ff0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 0x7facb40ff620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 0x7facb41a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40ffe50 con 0x7facb4101da0 2023-03-17T10:27:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41a4930 con 0x7facb4101490 2023-03-17T10:27:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb9d8e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41a4a70 con 0x7facb410a7d0 2023-03-17T10:27:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 0x7facb40ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 0x7facb40ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50516/0 (socket says 172.21.15.35:50516) 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 -- 172.21.15.35:0/950935920 learned_addr learned my addr 172.21.15.35:0/950935920 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb37fe700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb4101490 0x7facb40ff0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 -- 172.21.15.35:0/950935920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 msgr2=0x7facb41a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb3fff700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 0x7facb41a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 0x7facb41a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 -- 172.21.15.35:0/950935920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb4101490 msgr2=0x7facb40ff0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb4101490 0x7facb40ff0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb2ffd700 1 -- 172.21.15.35:0/950935920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40095f0 con 0x7facb4101da0 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.601+0000 7facb3fff700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 0x7facb41a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.602+0000 7facb2ffd700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 0x7facb40ff620 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7faca800e9a0 tx=0x7faca800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.602+0000 7facb0ff9700 1 -- 172.21.15.35:0/950935920 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8009790 con 0x7facb4101da0 2023-03-17T10:27:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.602+0000 7facb0ff9700 1 -- 172.21.15.35:0/950935920 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca800cbd0 con 0x7facb4101da0 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.602+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb4110110 con 0x7facb4101da0 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.602+0000 7facb0ff9700 1 -- 172.21.15.35:0/950935920 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8018680 con 0x7facb4101da0 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.602+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb410ff80 con 0x7facb4101da0 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 Processor -- start 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 -- start start 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb0ff9700 1 -- 172.21.15.35:0/950935920 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7faca800cd40 con 0x7facb4101da0 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacdbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacd6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baabdd010 con 0x562baacdc530 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baac2f950 con 0x562baacdbc20 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baac28de0 con 0x562baacd6960 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50522/0 (socket says 172.21.15.35:50522) 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 -- 172.21.15.35:0/478165231 learned_addr learned my addr 172.21.15.35:0/478165231 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb3fff700 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacdbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb2ffd700 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacd6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 -- 172.21.15.35:0/478165231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 msgr2=0x562baacd6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacd6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 -- 172.21.15.35:0/478165231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 msgr2=0x562baacdbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacdbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.606+0000 7facb37fe700 1 -- 172.21.15.35:0/478165231 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562baaaaa5d0 con 0x562baacdc530 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7facb37fe700 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd6420 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7faca4000c00 tx=0x7faca4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9266fab10438320 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7facb0ff9700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fac9c09f640 0x7fac9c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7facb3fff700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fac9c09f640 0x7fac9c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7facb0ff9700 1 -- 172.21.15.35:0/950935920 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(234..234 src has 1..234) v4 ==== 8411+0+0 (secure 0 0 0) 0x7faca8014070 con 0x7facb4101da0 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7fac99ffb700 1 -- 172.21.15.35:0/478165231 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca401d070 con 0x562baacdc530 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7fac99ffb700 1 -- 172.21.15.35:0/478165231 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca401e040 con 0x562baacdc530 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.607+0000 7fac99ffb700 1 -- 172.21.15.35:0/478165231 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4004850 con 0x562baacdc530 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 -- 172.21.15.35:0/478165231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 msgr2=0x562baacd6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facb3fff700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fac9c09f640 0x7fac9c0a1af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7facac0094f0 tx=0x7facac009040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd6420 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7faca4000c00 tx=0x7faca4005c70 comp rx=0 tx=0).stop 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 -- 172.21.15.35:0/478165231 shutdown_connections 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacd6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacdbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/478165231 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd6420 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 -- 172.21.15.35:0/478165231 >> 172.21.15.35:0/478165231 conn(0x562baab336b0 msgr2=0x562baacd0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 -- 172.21.15.35:0/478165231 shutdown_connections 2023-03-17T10:27:25.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 -- 172.21.15.35:0/478165231 wait complete. 2023-03-17T10:27:25.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.608+0000 7facc5f1bb80 1 -- start start 2023-03-17T10:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 Processor -- start 2023-03-17T10:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacd6960 0x562baace4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 0x562baace4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacdc530 0x562baace0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baaaac8c0 con 0x562baacdbc20 2023-03-17T10:27:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baace0800 con 0x562baacd6960 2023-03-17T10:27:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baace09c0 con 0x562baacdc530 2023-03-17T10:27:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facc5f1bb80 10 client.0 _ll_register_callbacks cb 0x562baaace230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 0x562baace4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 0x562baace4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50530/0 (socket says 172.21.15.35:50530) 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 -- 172.21.15.35:0/2902359807 learned_addr learned my addr 172.21.15.35:0/2902359807 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb37fe700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacd6960 0x562baace4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb3fff700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacdc530 0x562baace0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 -- 172.21.15.35:0/2902359807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacdc530 msgr2=0x562baace0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacdc530 0x562baace0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 -- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacd6960 msgr2=0x562baace4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacd6960 0x562baace4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb2ffd700 1 -- 172.21.15.35:0/2902359807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb410d8f0 con 0x562baacdbc20 2023-03-17T10:27:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.609+0000 7facb3fff700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacdc530 0x562baace0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:27:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facb2ffd700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 0x562baace4da0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7faca800e970 tx=0x7faca8098030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76dd30438bd1625 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7fac92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:27:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7fac92ffd700 1 -- 172.21.15.35:0/2902359807 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca80a0660 con 0x562baacdbc20 2023-03-17T10:27:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7fac92ffd700 1 -- 172.21.15.35:0/2902359807 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(234..234 src has 1..234) v4 ==== 8411+0+0 (secure 0 0 0) 0x7faca809c120 con 0x562baacdbc20 2023-03-17T10:27:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562baabeb390 con 0x562baacdbc20 2023-03-17T10:27:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7fac92ffd700 1 -- 172.21.15.35:0/2902359807 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7faca8097960 con 0x562baacdbc20 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 10 client.18834 fetch_fsmap learned FSMap version 45 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x562baaa56d80 con 0x562baacdbc20 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7fac92ffd700 1 -- 172.21.15.35:0/2902359807 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562baabeb390 con 0x562baacdbc20 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7fac92ffd700 1 -- 172.21.15.35:0/2902359807 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7faca80a02f0 con 0x562baacdbc20 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 10 client.18834 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 10 client.18834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:27:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 20 client.18834 populate_metadata read hostname 'smithi035' 2023-03-17T10:27:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baacf0070 0x562baacf2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:33.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 4 client.18834 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:27:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.610+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562baabf7600 con 0x562baacf0070 2023-03-17T10:27:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.611+0000 7facb37fe700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baacf0070 0x562baacf2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.611+0000 7fac92ffd700 10 client.18834 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:27:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.611+0000 7facb37fe700 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baacf0070 0x562baacf2480 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4845be0f146bee11 server_cookie=379c2228f89d9731 in_seq=0 out_seq=0 2023-03-17T10:27:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7fac92ffd700 1 -- 172.21.15.35:0/2902359807 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562baabf7600 con 0x562baacf0070 2023-03-17T10:27:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7fac92ffd700 10 client.18834 handle_command_reply: tid=0 2023-03-17T10:27:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 client.18834 shutdown 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 msgr2=0x562baace4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 0x562baace4da0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7faca800e970 tx=0x7faca8098030 comp rx=0 tx=0).stop 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 shutdown_connections 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baacf0070 0x562baacf2480 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacdc530 0x562baace0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacd6960 0x562baace4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/2902359807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdbc20 0x562baace4da0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7fac92ffd700 0 client.18834 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 >> 172.21.15.35:0/2902359807 conn(0x562baab336b0 msgr2=0x562baacd0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 shutdown_connections 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 1 -- 172.21.15.35:0/2902359807 wait complete. 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.612+0000 7facc5f1bb80 20 client.18834 trim_cache size 0 max 16384 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 Processor -- start 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 -- start start 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacf2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baacd2cf0 con 0x562baacdc530 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baace50f0 con 0x562baacdbc20 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baacd9920 con 0x562baacd6960 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facb3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facb3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50538/0 (socket says 172.21.15.35:50538) 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facb3fff700 1 -- 172.21.15.35:0/191917921 learned_addr learned my addr 172.21.15.35:0/191917921 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.627+0000 7facb2ffd700 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacd0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb37fe700 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacf2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb3fff700 1 -- 172.21.15.35:0/191917921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 msgr2=0x562baacf2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb3fff700 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacf2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb3fff700 1 -- 172.21.15.35:0/191917921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 msgr2=0x562baacd0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb3fff700 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacd0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb3fff700 1 -- 172.21.15.35:0/191917921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562baabef130 con 0x562baacdc530 2023-03-17T10:27:36.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb37fe700 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacf2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:27:37.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facb3fff700 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd4410 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7facac0165b0 tx=0x7facac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc71949bd80fd3f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7fac9a7fc700 1 -- 172.21.15.35:0/191917921 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac016d30 con 0x562baacdc530 2023-03-17T10:27:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7fac9a7fc700 1 -- 172.21.15.35:0/191917921 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facac016e90 con 0x562baacdc530 2023-03-17T10:27:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7fac9a7fc700 1 -- 172.21.15.35:0/191917921 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac017760 con 0x562baacdc530 2023-03-17T10:27:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facc5f1bb80 1 -- 172.21.15.35:0/191917921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 msgr2=0x562baacd4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.628+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd4410 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7facac0165b0 tx=0x7facac014000 comp rx=0 tx=0).stop 2023-03-17T10:27:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- 172.21.15.35:0/191917921 shutdown_connections 2023-03-17T10:27:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baacd4410 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baacf2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/191917921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baacd0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- 172.21.15.35:0/191917921 >> 172.21.15.35:0/191917921 conn(0x562baab336b0 msgr2=0x562baacd5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- 172.21.15.35:0/191917921 shutdown_connections 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- 172.21.15.35:0/191917921 wait complete. 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- start start 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 Processor -- start 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baace7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baace78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baace7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baad43f00 con 0x562baacdc530 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baad44040 con 0x562baacdbc20 2023-03-17T10:27:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562baad44180 con 0x562baacd6960 2023-03-17T10:27:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facc5f1bb80 10 client.0 _ll_register_callbacks cb 0x562baaace230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:27:42.655 INFO:tasks.workunit.client.0.smithi035.stdout: 1 100487 2.59 MB/sec execute 82 sec latency 14.445 ms 2023-03-17T10:27:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:27:48.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:27:48.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.629+0000 7facb3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baace7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baace7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50546/0 (socket says 172.21.15.35:50546) 2023-03-17T10:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 -- 172.21.15.35:0/425472562 learned_addr learned my addr 172.21.15.35:0/425472562 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:48.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb37fe700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baace7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb2ffd700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baace78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 -- 172.21.15.35:0/425472562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 msgr2=0x562baace7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baace7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 -- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 msgr2=0x562baace78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baace78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 -- 172.21.15.35:0/425472562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac007d90 con 0x562baacdc530 2023-03-17T10:27:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facb3fff700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baace7e10 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7facac0236b0 tx=0x7facac0236e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d879e827750cc075 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7fac92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:27:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7fac92ffd700 1 -- 172.21.15.35:0/425472562 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac023da0 con 0x562baacdc530 2023-03-17T10:27:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7fac92ffd700 1 -- 172.21.15.35:0/425472562 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(234..234 src has 1..234) v4 ==== 8411+0+0 (secure 0 0 0) 0x7facac023b10 con 0x562baacdc530 2023-03-17T10:27:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.630+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562baaca61e0 con 0x562baacdc530 2023-03-17T10:27:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7fac92ffd700 1 -- 172.21.15.35:0/425472562 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7facac004ad0 con 0x562baacdc530 2023-03-17T10:27:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 10 client.18840 fetch_fsmap learned FSMap version 45 2023-03-17T10:27:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x562baaa7d1f0 con 0x562baacdc530 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7fac92ffd700 1 -- 172.21.15.35:0/425472562 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562baaca61e0 con 0x562baacdc530 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7fac92ffd700 1 -- 172.21.15.35:0/425472562 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7facac034530 con 0x562baacdc530 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 10 client.18840 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 10 client.18840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 20 client.18840 populate_metadata read hostname 'smithi035' 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baae556f0 0x562baae57b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 4 client.18840 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:27:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562baaaacf00 con 0x562baae556f0 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.631+0000 7facb37fe700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baae556f0 0x562baae57b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.632+0000 7fac92ffd700 10 client.18840 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.632+0000 7facb37fe700 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baae556f0 0x562baae57b00 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba9017a2a9c20aad server_cookie=e0581383eb75a6c4 in_seq=0 out_seq=0 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.636+0000 7fac92ffd700 1 -- 172.21.15.35:0/425472562 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562baaaacf00 con 0x562baae556f0 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.636+0000 7fac92ffd700 10 client.18840 handle_command_reply: tid=0 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.636+0000 7facc5f1bb80 1 client.18840 shutdown 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 msgr2=0x562baace7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:51.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baace7e10 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7facac0236b0 tx=0x7facac0236e0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 shutdown_connections 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562baae556f0 0x562baae57b00 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562baacdc530 0x562baace7e10 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7fac92ffd700 0 client.18840 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562baacd6960 0x562baace7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 --2- 172.21.15.35:0/425472562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562baacdbc20 0x562baace78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 >> 172.21.15.35:0/425472562 conn(0x562baab336b0 msgr2=0x562baacd9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 shutdown_connections 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 1 -- 172.21.15.35:0/425472562 wait complete. 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facc5f1bb80 20 client.18840 trim_cache size 0 max 16384 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fac9c09f640 msgr2=0x7fac9c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fac9c09f640 0x7fac9c0a1af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7facac0094f0 tx=0x7facac009040 comp rx=0 tx=0).stop 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 msgr2=0x7facb40ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 0x7facb40ff620 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7faca800e9a0 tx=0x7faca800ecb0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 shutdown_connections 2023-03-17T10:27:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fac9c09f640 0x7fac9c0a1af0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facb410a7d0 0x7facb41a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facb4101490 0x7facb40ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 --2- 172.21.15.35:0/950935920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7facb4101da0 0x7facb40ff620 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.637+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 >> 172.21.15.35:0/950935920 conn(0x7facb4075f60 msgr2=0x7facb40fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.638+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 shutdown_connections 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:02:29.638+0000 7facb9d8e700 1 -- 172.21.15.35:0/950935920 wait complete. 2023-03-17T10:27:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 -- 172.21.15.35:0/3397481314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 msgr2=0x7f747c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:55.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 --2- 172.21.15.35:0/3397481314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c103cb0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f74640099c0 tx=0x7f7464009cd0 comp rx=0 tx=0).stop 2023-03-17T10:27:55.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 -- 172.21.15.35:0/3397481314 shutdown_connections 2023-03-17T10:27:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 --2- 172.21.15.35:0/3397481314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f747c104390 0x7f747c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 --2- 172.21.15.35:0/3397481314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747c0ff350 0x7f747c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 --2- 172.21.15.35:0/3397481314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c103cb0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:56.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 -- 172.21.15.35:0/3397481314 >> 172.21.15.35:0/3397481314 conn(0x7f747c076330 msgr2=0x7f747c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 -- 172.21.15.35:0/3397481314 shutdown_connections 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.792+0000 7f7481cee700 1 -- 172.21.15.35:0/3397481314 wait complete. 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 Processor -- start 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 -- start start 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f747c0ff350 0x7f747c196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c1967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747c104390 0x7f747c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c19b240 con 0x7f747c0ffcf0 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c19b3b0 con 0x7f747c0ff350 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f7481cee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c19b570 con 0x7f747c104390 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f747affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c1967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f747affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c1967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50558/0 (socket says 172.21.15.35:50558) 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.793+0000 7f747affd700 1 -- 172.21.15.35:0/1299047892 learned_addr learned my addr 172.21.15.35:0/1299047892 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f747c0ff350 0x7f747c196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747bfff700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747c104390 0x7f747c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747affd700 1 -- 172.21.15.35:0/1299047892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747c104390 msgr2=0x7f747c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:57.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747affd700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747c104390 0x7f747c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747affd700 1 -- 172.21.15.35:0/1299047892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f747c0ff350 msgr2=0x7f747c196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747affd700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f747c0ff350 0x7f747c196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747affd700 1 -- 172.21.15.35:0/1299047892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74640095f0 con 0x7f747c0ffcf0 2023-03-17T10:27:57.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f747affd700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c1967a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7464009fd0 tx=0x7f746400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f7478ff9700 1 -- 172.21.15.35:0/1299047892 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746401d070 con 0x7f747c0ffcf0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f7478ff9700 1 -- 172.21.15.35:0/1299047892 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74640059a0 con 0x7f747c0ffcf0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c10efc0 con 0x7f747c0ffcf0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f7478ff9700 1 -- 172.21.15.35:0/1299047892 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464022e90 con 0x7f747c0ffcf0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.794+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c10ee30 con 0x7f747c0ffcf0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.797+0000 7f7478ff9700 1 -- 172.21.15.35:0/1299047892 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7464022470 con 0x7f747c0ffcf0 2023-03-17T10:27:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.797+0000 7f7478ff9700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746809f6c0 0x7f74680a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.797+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746809f6c0 0x7f74680a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.797+0000 7f7478ff9700 1 -- 172.21.15.35:0/1299047892 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(236..236 src has 1..236) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74640cb550 con 0x7f747c0ffcf0 2023-03-17T10:27:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746809f6c0 0x7f74680a1b70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f746c005950 tx=0x7f746c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 Processor -- start 2023-03-17T10:27:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 -- start start 2023-03-17T10:27:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 0x55758f19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a4170 0x55758f1a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:27:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f0a2010 con 0x55758f19fa20 2023-03-17T10:27:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f0f4950 con 0x55758f1a4170 2023-03-17T10:27:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f748de7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f0edde0 con 0x55758f1a0330 2023-03-17T10:27:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.798+0000 7f747b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 0x55758f19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 0x55758f19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50564/0 (socket says 172.21.15.35:50564) 2023-03-17T10:27:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 -- 172.21.15.35:0/1235984354 learned_addr learned my addr 172.21.15.35:0/1235984354 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:27:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747affd700 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747bfff700 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a4170 0x55758f1a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:27:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 -- 172.21.15.35:0/1235984354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 msgr2=0x55758f1a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 -- 172.21.15.35:0/1235984354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a4170 msgr2=0x55758f1a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:27:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a4170 0x55758f1a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:27:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 -- 172.21.15.35:0/1235984354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55758ef6f5d0 con 0x55758f19fa20 2023-03-17T10:27:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 0x55758f19fdf0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f746c010fa0 tx=0x7f746c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a5e9530a5ba23e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:27:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f7471ffb700 1 -- 172.21.15.35:0/1235984354 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c011db0 con 0x55758f19fa20 2023-03-17T10:27:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f7471ffb700 1 -- 172.21.15.35:0/1235984354 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f746c015070 con 0x55758f19fa20 2023-03-17T10:27:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.799+0000 7f7471ffb700 1 -- 172.21.15.35:0/1235984354 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c01c610 con 0x55758f19fa20 2023-03-17T10:27:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 -- 172.21.15.35:0/1235984354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 msgr2=0x55758f19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:27:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 0x55758f19fdf0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f746c010fa0 tx=0x7f746c013000 comp rx=0 tx=0).stop 2023-03-17T10:28:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 -- 172.21.15.35:0/1235984354 shutdown_connections 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a4170 0x55758f1a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f19fa20 0x55758f19fdf0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1235984354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 -- 172.21.15.35:0/1235984354 >> 172.21.15.35:0/1235984354 conn(0x55758eff86b0 msgr2=0x55758f195a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 -- 172.21.15.35:0/1235984354 shutdown_connections 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 -- 172.21.15.35:0/1235984354 wait complete. 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.800+0000 7f748de7bb80 1 -- start start 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 Processor -- start 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f1ab920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758ef718c0 con 0x55758f1a4170 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f1a9960 con 0x55758f1a0330 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f1b53e0 con 0x55758f19fa20 2023-03-17T10:28:01.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f748de7bb80 10 client.0 _ll_register_callbacks cb 0x55758ef93230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f747bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f747bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50574/0 (socket says 172.21.15.35:50574) 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f747bfff700 1 -- 172.21.15.35:0/1070645321 learned_addr learned my addr 172.21.15.35:0/1070645321 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f747affd700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.801+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f1ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747bfff700 1 -- 172.21.15.35:0/1070645321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 msgr2=0x55758f1ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747bfff700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f1ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747bfff700 1 -- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 msgr2=0x55758f1a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747bfff700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747bfff700 1 -- 172.21.15.35:0/1070645321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c010c50 con 0x55758f1a4170 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f1ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:28:01.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f747bfff700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a9220 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f7474007ed0 tx=0x7f7474007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5784ab242fee866c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f745affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:28:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f745affd700 1 -- 172.21.15.35:0/1070645321 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400e070 con 0x55758f1a4170 2023-03-17T10:28:02.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55758f0b0390 con 0x55758f1a4170 2023-03-17T10:28:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f745affd700 1 -- 172.21.15.35:0/1070645321 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(236..236 src has 1..236) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74740093f0 con 0x55758f1a4170 2023-03-17T10:28:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f745affd700 1 -- 172.21.15.35:0/1070645321 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7474013b30 con 0x55758f1a4170 2023-03-17T10:28:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f748de7bb80 10 client.18852 fetch_fsmap learned FSMap version 45 2023-03-17T10:28:02.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55758ef1bd80 con 0x55758f1a4170 2023-03-17T10:28:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f745affd700 1 -- 172.21.15.35:0/1070645321 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55758f0b0390 con 0x55758f1a4170 2023-03-17T10:28:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f745affd700 1 -- 172.21.15.35:0/1070645321 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f747401e3b0 con 0x55758f1a4170 2023-03-17T10:28:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f748de7bb80 10 client.18852 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:28:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f748de7bb80 10 client.18852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:28:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.802+0000 7f748de7bb80 20 client.18852 populate_metadata read hostname 'smithi035' 2023-03-17T10:28:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.803+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f1b94f0 0x55758f1bb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.803+0000 7f748de7bb80 4 client.18852 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:28:02.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:52 smithi035 ceph-mon[92535]: pgmap v3001: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T10:28:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.803+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55758f0bc600 con 0x55758f1b94f0 2023-03-17T10:28:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.803+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f1b94f0 0x55758f1bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:03.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.803+0000 7f745affd700 10 client.18852 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.803+0000 7f747b7fe700 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f1b94f0 0x55758f1bb900 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b854c8f8acbeb4 server_cookie=d83b96a0ff515bd4 in_seq=0 out_seq=0 2023-03-17T10:28:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f745affd700 1 -- 172.21.15.35:0/1070645321 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55758f0bc600 con 0x55758f1b94f0 2023-03-17T10:28:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f745affd700 10 client.18852 handle_command_reply: tid=0 2023-03-17T10:28:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 client.18852 shutdown 2023-03-17T10:28:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 msgr2=0x55758f1a9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a9220 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f7474007ed0 tx=0x7f7474007f00 comp rx=0 tx=0).stop 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 shutdown_connections 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f1b94f0 0x55758f1bb900 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a9220 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f745affd700 0 client.18852 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f1ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 --2- 172.21.15.35:0/1070645321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 >> 172.21.15.35:0/1070645321 conn(0x55758eff86b0 msgr2=0x55758f19a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 shutdown_connections 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 1 -- 172.21.15.35:0/1070645321 wait complete. 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.804+0000 7f748de7bb80 20 client.18852 trim_cache size 0 max 16384 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 Processor -- start 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 -- start start 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f1b6bf0 con 0x55758f1a4170 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f196420 con 0x55758f1a0330 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.819+0000 7f748de7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f197620 con 0x55758f19fa20 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50582/0 (socket says 172.21.15.35:50582) 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 -- 172.21.15.35:0/327137489 learned_addr learned my addr 172.21.15.35:0/327137489 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747b7fe700 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747affd700 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 -- 172.21.15.35:0/327137489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 msgr2=0x55758f195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 -- 172.21.15.35:0/327137489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 msgr2=0x55758f1b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 -- 172.21.15.35:0/327137489 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55758f0b4130 con 0x55758f1a4170 2023-03-17T10:28:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747affd700 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:28:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f747bfff700 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a5550 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7474013610 tx=0x7f7474013640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818b909add592c95 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f74727fc700 1 -- 172.21.15.35:0/327137489 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400e040 con 0x55758f1a4170 2023-03-17T10:28:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f74727fc700 1 -- 172.21.15.35:0/327137489 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f747400f040 con 0x55758f1a4170 2023-03-17T10:28:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.820+0000 7f74727fc700 1 -- 172.21.15.35:0/327137489 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747401e510 con 0x55758f1a4170 2023-03-17T10:28:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 -- 172.21.15.35:0/327137489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 msgr2=0x55758f1a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a5550 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f7474013610 tx=0x7f7474013640 comp rx=0 tx=0).stop 2023-03-17T10:28:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 -- 172.21.15.35:0/327137489 shutdown_connections 2023-03-17T10:28:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1a5550 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:12.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f19fa20 0x55758f195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 --2- 172.21.15.35:0/327137489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f1a0330 0x55758f1b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:12.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 -- 172.21.15.35:0/327137489 >> 172.21.15.35:0/327137489 conn(0x55758eff86b0 msgr2=0x55758f1b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 -- 172.21.15.35:0/327137489 shutdown_connections 2023-03-17T10:28:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 -- 172.21.15.35:0/327137489 wait complete. 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.821+0000 7f748de7bb80 1 -- start start 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 Processor -- start 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f19fa20 0x55758f1b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f1acf20 con 0x55758f1a4170 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f1ad060 con 0x55758f19fa20 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55758f1ad220 con 0x55758f1a0330 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f748de7bb80 10 client.0 _ll_register_callbacks cb 0x55758ef93230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1ac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50588/0 (socket says 172.21.15.35:50588) 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 -- 172.21.15.35:0/572752131 learned_addr learned my addr 172.21.15.35:0/572752131 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747b7fe700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f19fa20 0x55758f1b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747affd700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 -- 172.21.15.35:0/572752131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 msgr2=0x55758f1ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 -- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f19fa20 msgr2=0x55758f1b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f19fa20 0x55758f1b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.822+0000 7f747bfff700 1 -- 172.21.15.35:0/572752131 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55758ef1bd80 con 0x55758f1a4170 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f747affd700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f747bfff700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1ac9e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f747401e5e0 tx=0x7f747401e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d69dbb0ac107ae server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f745affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f745affd700 1 -- 172.21.15.35:0/572752131 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400e040 con 0x55758f1a4170 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f745affd700 1 -- 172.21.15.35:0/572752131 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(236..236 src has 1..236) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74740093f0 con 0x55758f1a4170 2023-03-17T10:28:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55758f16b1e0 con 0x55758f1a4170 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f745affd700 1 -- 172.21.15.35:0/572752131 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f747401ee80 con 0x55758f1a4170 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 10 client.18858 fetch_fsmap learned FSMap version 45 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55758ef421f0 con 0x55758f1a4170 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f745affd700 1 -- 172.21.15.35:0/572752131 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7474040020 con 0x55758f1a4170 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f745affd700 1 -- 172.21.15.35:0/572752131 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f747403c490 con 0x55758f1a4170 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 10 client.18858 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:28:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 10 client.18858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:28:15.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 20 client.18858 populate_metadata read hostname 'smithi035' 2023-03-17T10:28:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f20e220 0x55758f210600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 4 client.18858 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:28:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.823+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55758ef71f00 con 0x55758f20e220 2023-03-17T10:28:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.824+0000 7f747b7fe700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f20e220 0x55758f210600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.824+0000 7f747b7fe700 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f20e220 0x55758f210600 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc662f665fce8948 server_cookie=7eccf24f874197a in_seq=0 out_seq=0 2023-03-17T10:28:15.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.824+0000 7f745affd700 10 client.18858 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f745affd700 1 -- 172.21.15.35:0/572752131 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55758ef71f00 con 0x55758f20e220 2023-03-17T10:28:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f745affd700 10 client.18858 handle_command_reply: tid=0 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 client.18858 shutdown 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 msgr2=0x55758f1ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1ac9e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f747401e5e0 tx=0x7f747401e610 comp rx=0 tx=0).stop 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 shutdown_connections 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55758f20e220 0x55758f210600 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55758f1a4170 0x55758f1ac9e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f745affd700 0 client.18858 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55758f19fa20 0x55758f1b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 --2- 172.21.15.35:0/572752131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55758f1a0330 0x55758f1ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.833+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 >> 172.21.15.35:0/572752131 conn(0x55758eff86b0 msgr2=0x55758f1a6550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 shutdown_connections 2023-03-17T10:28:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f748de7bb80 1 -- 172.21.15.35:0/572752131 wait complete. 2023-03-17T10:28:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f748de7bb80 20 client.18858 trim_cache size 0 max 16384 2023-03-17T10:28:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746809f6c0 msgr2=0x7f74680a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746809f6c0 0x7f74680a1b70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f746c005950 tx=0x7f746c00b410 comp rx=0 tx=0).stop 2023-03-17T10:28:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 msgr2=0x7f747c1967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c1967a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7464009fd0 tx=0x7f746400f690 comp rx=0 tx=0).stop 2023-03-17T10:28:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 shutdown_connections 2023-03-17T10:28:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f746809f6c0 0x7f74680a1b70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:21.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f747c104390 0x7f747c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f747c0ff350 0x7f747c196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 --2- 172.21.15.35:0/1299047892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f747c0ffcf0 0x7f747c1967a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 >> 172.21.15.35:0/1299047892 conn(0x7f747c076330 msgr2=0x7f747c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 shutdown_connections 2023-03-17T10:28:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:03:52.834+0000 7f7481cee700 1 -- 172.21.15.35:0/1299047892 wait complete. 2023-03-17T10:28:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 -- 172.21.15.35:0/874140549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 msgr2=0x7f783c104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 --2- 172.21.15.35:0/874140549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c104d90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f78240099c0 tx=0x7f7824009cd0 comp rx=0 tx=0).stop 2023-03-17T10:28:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 -- 172.21.15.35:0/874140549 shutdown_connections 2023-03-17T10:28:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 --2- 172.21.15.35:0/874140549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c105470 0x7f783c10d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 --2- 172.21.15.35:0/874140549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f783c100430 0x7f783c100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 --2- 172.21.15.35:0/874140549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c104d90 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 -- 172.21.15.35:0/874140549 >> 172.21.15.35:0/874140549 conn(0x7f783c0fbca0 msgr2=0x7f783c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 -- 172.21.15.35:0/874140549 shutdown_connections 2023-03-17T10:28:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.956+0000 7f7842057700 1 -- 172.21.15.35:0/874140549 wait complete. 2023-03-17T10:28:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 Processor -- start 2023-03-17T10:28:25.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 -- start start 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c100430 0x7f783c196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f783c105470 0x7f783c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c19b230 con 0x7f783c100dd0 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c19b3a0 con 0x7f783c105470 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f7842057700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c19b560 con 0x7f783c100430 2023-03-17T10:28:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.957+0000 7f783affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50600/0 (socket says 172.21.15.35:50600) 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 -- 172.21.15.35:0/1368497482 learned_addr learned my addr 172.21.15.35:0/1368497482 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783b7fe700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c100430 0x7f783c196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783bfff700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f783c105470 0x7f783c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 -- 172.21.15.35:0/1368497482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c100430 msgr2=0x7f783c196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c100430 0x7f783c196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 -- 172.21.15.35:0/1368497482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f783c105470 msgr2=0x7f783c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f783c105470 0x7f783c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 -- 172.21.15.35:0/1368497482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240095f0 con 0x7f783c100dd0 2023-03-17T10:28:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f783affd700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c196790 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f7824009fd0 tx=0x7f782400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f7838ff9700 1 -- 172.21.15.35:0/1368497482 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782401d070 con 0x7f783c100dd0 2023-03-17T10:28:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f7838ff9700 1 -- 172.21.15.35:0/1368497482 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78240059a0 con 0x7f783c100dd0 2023-03-17T10:28:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c1100a0 con 0x7f783c100dd0 2023-03-17T10:28:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f7838ff9700 1 -- 172.21.15.35:0/1368497482 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240173f0 con 0x7f783c100dd0 2023-03-17T10:28:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.958+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c10ff10 con 0x7f783c100dd0 2023-03-17T10:28:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.960+0000 7f7838ff9700 1 -- 172.21.15.35:0/1368497482 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7824022470 con 0x7f783c100dd0 2023-03-17T10:28:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.961+0000 7f7838ff9700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f782809f6c0 0x7f78280a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.961+0000 7f783b7fe700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f782809f6c0 0x7f78280a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.961+0000 7f7838ff9700 1 -- 172.21.15.35:0/1368497482 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(236..236 src has 1..236) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f78240cb670 con 0x7f783c100dd0 2023-03-17T10:28:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f783b7fe700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f782809f6c0 0x7f78280a1b70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f782c005950 tx=0x7f782c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 Processor -- start 2023-03-17T10:28:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 -- start start 2023-03-17T10:28:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cb4f0 0x5637cc9c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 0x5637cc9c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc8cc010 con 0x5637cc9c5960 2023-03-17T10:28:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc91e950 con 0x5637cc9cabe0 2023-03-17T10:28:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.962+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc917de0 con 0x5637cc9cb4f0 2023-03-17T10:28:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 0x5637cc9c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:54 smithi035 ceph-mon[92535]: pgmap v3002: 97 pgs: 97 active+clean; 72 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:56 smithi035 ceph-mon[92535]: pgmap v3003: 97 pgs: 97 active+clean; 72 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:17:57 smithi035 ceph-mon[92535]: pgmap v3004: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:00 smithi035 ceph-mon[92535]: pgmap v3005: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:02 smithi035 ceph-mon[92535]: pgmap v3006: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:04 smithi035 ceph-mon[92535]: pgmap v3007: 97 pgs: 97 active+clean; 68 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.7 MiB/s wr, 185 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:05 smithi035 ceph-mon[92535]: osdmap e263: 12 total, 12 up, 12 in 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:06 smithi035 ceph-mon[92535]: pgmap v3009: 97 pgs: 97 active+clean; 68 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:07 smithi035 ceph-mon[92535]: pgmap v3010: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T10:28:32.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:10 smithi035 ceph-mon[92535]: pgmap v3011: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T10:28:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 0x5637cc9c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50610/0 (socket says 172.21.15.35:50610) 2023-03-17T10:28:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 -- 172.21.15.35:0/375990332 learned_addr learned my addr 172.21.15.35:0/375990332 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783affd700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cb4f0 0x5637cc9c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783b7fe700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 -- 172.21.15.35:0/375990332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cb4f0 msgr2=0x5637cc9c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cb4f0 0x5637cc9c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 -- 172.21.15.35:0/375990332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 msgr2=0x5637cc9cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 -- 172.21.15.35:0/375990332 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637cc7995d0 con 0x5637cc9c5960 2023-03-17T10:28:34.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783b7fe700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:28:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783affd700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cb4f0 0x5637cc9c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:28:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f783bfff700 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 0x5637cc9c5d90 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7834009440 tx=0x7f7834009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d6bcc04aabd4c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f7831ffb700 1 -- 172.21.15.35:0/375990332 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400e070 con 0x5637cc9c5960 2023-03-17T10:28:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f7831ffb700 1 -- 172.21.15.35:0/375990332 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f783400f040 con 0x5637cc9c5960 2023-03-17T10:28:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.963+0000 7f7831ffb700 1 -- 172.21.15.35:0/375990332 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834015af0 con 0x5637cc9c5960 2023-03-17T10:28:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 -- 172.21.15.35:0/375990332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 msgr2=0x5637cc9c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 0x5637cc9c5d90 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7834009440 tx=0x7f7834009920 comp rx=0 tx=0).stop 2023-03-17T10:28:45.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 -- 172.21.15.35:0/375990332 shutdown_connections 2023-03-17T10:28:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9c5960 0x5637cc9c5d90 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:45.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/375990332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cb4f0 0x5637cc9c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 -- 172.21.15.35:0/375990332 >> 172.21.15.35:0/375990332 conn(0x5637cc8226b0 msgr2=0x5637cc9bfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 -- 172.21.15.35:0/375990332 shutdown_connections 2023-03-17T10:28:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 -- 172.21.15.35:0/375990332 wait complete. 2023-03-17T10:28:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.964+0000 7f784e1e4b80 1 -- start start 2023-03-17T10:28:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 Processor -- start 2023-03-17T10:28:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc79b8c0 con 0x5637cc9cb4f0 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc9cf4e0 con 0x5637cc9cabe0 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc9db000 con 0x5637cc9c5960 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f784e1e4b80 10 client.0 _ll_register_callbacks cb 0x5637cc7bd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50616/0 (socket says 172.21.15.35:50616) 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f783bfff700 1 -- 172.21.15.35:0/327769605 learned_addr learned my addr 172.21.15.35:0/327769605 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f783affd700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.965+0000 7f783b7fe700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783bfff700 1 -- 172.21.15.35:0/327769605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 msgr2=0x5637cc9d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783bfff700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783bfff700 1 -- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 msgr2=0x5637cc9ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783bfff700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783bfff700 1 -- 172.21.15.35:0/327769605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78340090f0 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783b7fe700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f783bfff700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9ced70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7834009510 tx=0x7f7834016e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84255db1d1c13ce6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f781affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f781affd700 1 -- 172.21.15.35:0/327769605 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400e040 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f781affd700 1 -- 172.21.15.35:0/327769605 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(236..236 src has 1..236) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f78340095e0 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637cc8da390 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f781affd700 1 -- 172.21.15.35:0/327769605 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7834004ce0 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f784e1e4b80 10 client.18870 fetch_fsmap learned FSMap version 45 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5637cc745d80 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f781affd700 1 -- 172.21.15.35:0/327769605 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637cc8da390 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.966+0000 7f781affd700 1 -- 172.21.15.35:0/327769605 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7834007500 con 0x5637cc9cb4f0 2023-03-17T10:28:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f784e1e4b80 10 client.18870 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f784e1e4b80 10 client.18870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f784e1e4b80 20 client.18870 populate_metadata read hostname 'smithi035' 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cc9deed0 0x5637cc9e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f784e1e4b80 4 client.18870 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637cc8e6600 con 0x5637cc9deed0 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f783b7fe700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cc9deed0 0x5637cc9e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f781affd700 10 client.18870 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.967+0000 7f783b7fe700 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cc9deed0 0x5637cc9e12e0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61f22ca13d13afc server_cookie=bcb44363ca9a75a9 in_seq=0 out_seq=0 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f781affd700 1 -- 172.21.15.35:0/327769605 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5637cc8e6600 con 0x5637cc9deed0 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f781affd700 10 client.18870 handle_command_reply: tid=0 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 client.18870 shutdown 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 msgr2=0x5637cc9ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9ced70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7834009510 tx=0x7f7834016e10 comp rx=0 tx=0).stop 2023-03-17T10:28:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 shutdown_connections 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cc9deed0 0x5637cc9e12e0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9ced70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f781affd700 0 client.18870 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/327769605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 >> 172.21.15.35:0/327769605 conn(0x5637cc8226b0 msgr2=0x5637cc9bfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 shutdown_connections 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.968+0000 7f784e1e4b80 1 -- 172.21.15.35:0/327769605 wait complete. 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.969+0000 7f784e1e4b80 20 client.18870 trim_cache size 0 max 16384 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.983+0000 7f784e1e4b80 1 Processor -- start 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.983+0000 7f784e1e4b80 1 -- start start 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9c5960 0x5637cc9bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cabe0 0x5637cc9c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc9c03c0 con 0x5637cc9cb4f0 2023-03-17T10:28:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc9c0000 con 0x5637cc9c5960 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cc9d1a80 con 0x5637cc9cabe0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50624/0 (socket says 172.21.15.35:50624) 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 -- 172.21.15.35:0/410847721 learned_addr learned my addr 172.21.15.35:0/410847721 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783b7fe700 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9c5960 0x5637cc9bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783affd700 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cabe0 0x5637cc9c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 -- 172.21.15.35:0/410847721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cabe0 msgr2=0x5637cc9c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cabe0 0x5637cc9c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 -- 172.21.15.35:0/410847721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9c5960 msgr2=0x5637cc9bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9c5960 0x5637cc9bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 -- 172.21.15.35:0/410847721 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637cc8de130 con 0x5637cc9cb4f0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f783bfff700 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9d0ff0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f7834009920 tx=0x7f7834017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2a9780fbd98a07 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f78327fc700 1 -- 172.21.15.35:0/410847721 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78340095e0 con 0x5637cc9cb4f0 2023-03-17T10:28:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f78327fc700 1 -- 172.21.15.35:0/410847721 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7834005a70 con 0x5637cc9cb4f0 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.984+0000 7f78327fc700 1 -- 172.21.15.35:0/410847721 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834004ce0 con 0x5637cc9cb4f0 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 -- 172.21.15.35:0/410847721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 msgr2=0x5637cc9d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9d0ff0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f7834009920 tx=0x7f7834017f40 comp rx=0 tx=0).stop 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 -- 172.21.15.35:0/410847721 shutdown_connections 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cc9d0ff0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9c5960 0x5637cc9bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/410847721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9cabe0 0x5637cc9c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 -- 172.21.15.35:0/410847721 >> 172.21.15.35:0/410847721 conn(0x5637cc8226b0 msgr2=0x5637cc9c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 -- 172.21.15.35:0/410847721 shutdown_connections 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 -- 172.21.15.35:0/410847721 wait complete. 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.985+0000 7f784e1e4b80 1 -- start start 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 Processor -- start 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cca2bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cca2c2f0 con 0x5637cc9cb4f0 2023-03-17T10:28:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cca2c430 con 0x5637cc9cabe0 2023-03-17T10:28:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637cca2c5f0 con 0x5637cc9c5960 2023-03-17T10:28:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f784e1e4b80 10 client.0 _ll_register_callbacks cb 0x5637cc7bd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:28:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cca2bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f783bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cca2bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50630/0 (socket says 172.21.15.35:50630) 2023-03-17T10:28:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f783b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f783bfff700 1 -- 172.21.15.35:0/92872010 learned_addr learned my addr 172.21.15.35:0/92872010 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.986+0000 7f783affd700 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f783bfff700 1 -- 172.21.15.35:0/92872010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 msgr2=0x5637cc9d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f783bfff700 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f783bfff700 1 -- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 msgr2=0x5637cc9d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f783bfff700 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9d4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f783bfff700 1 -- 172.21.15.35:0/92872010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637cc745d80 con 0x5637cc9cb4f0 2023-03-17T10:28:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f783bfff700 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cca2bdb0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7834005130 tx=0x7f7834009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ae0fe54c73c22d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:28:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f781affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:28:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f781affd700 1 -- 172.21.15.35:0/92872010 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400e070 con 0x5637cc9cb4f0 2023-03-17T10:28:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f781affd700 1 -- 172.21.15.35:0/92872010 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(236..236 src has 1..236) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7834026530 con 0x5637cc9cb4f0 2023-03-17T10:28:55.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637cc9951e0 con 0x5637cc9cb4f0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f781affd700 1 -- 172.21.15.35:0/92872010 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7834009550 con 0x5637cc9cb4f0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 10 client.18876 fetch_fsmap learned FSMap version 45 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5637cc76c1f0 con 0x5637cc9cb4f0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f781affd700 1 -- 172.21.15.35:0/92872010 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637cc9951e0 con 0x5637cc9cb4f0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f781affd700 1 -- 172.21.15.35:0/92872010 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f78340267e0 con 0x5637cc9cb4f0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 10 client.18876 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 10 client.18876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 20 client.18876 populate_metadata read hostname 'smithi035' 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.987+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cca33890 0x5637cca35ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.988+0000 7f784e1e4b80 4 client.18876 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.988+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5637cc79bf00 con 0x5637cca33890 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.988+0000 7f783b7fe700 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cca33890 0x5637cca35ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.988+0000 7f781affd700 10 client.18876 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.988+0000 7f783b7fe700 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cca33890 0x5637cca35ca0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b8e2dc7988afbc server_cookie=d004fe3b2f8d13eb in_seq=0 out_seq=0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f781affd700 1 -- 172.21.15.35:0/92872010 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5637cc79bf00 con 0x5637cca33890 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f781affd700 10 client.18876 handle_command_reply: tid=0 2023-03-17T10:28:55.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 client.18876 shutdown 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 msgr2=0x5637cca2bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cca2bdb0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7834005130 tx=0x7f7834009a90 comp rx=0 tx=0).stop 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 shutdown_connections 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637cca33890 0x5637cca35ca0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637cc9cb4f0 0x5637cca2bdb0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637cc9c5960 0x5637cc9d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f781affd700 0 client.18876 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 --2- 172.21.15.35:0/92872010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637cc9cabe0 0x5637cc9d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:28:55.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 >> 172.21.15.35:0/92872010 conn(0x5637cc8226b0 msgr2=0x5637cc9ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:28:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 shutdown_connections 2023-03-17T10:28:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 1 -- 172.21.15.35:0/92872010 wait complete. 2023-03-17T10:28:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.997+0000 7f784e1e4b80 20 client.18876 trim_cache size 0 max 16384 2023-03-17T10:28:55.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f782809f6c0 msgr2=0x7f78280a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:28:55.783 INFO:tasks.workunit.client.0.smithi035.stdout: 1 101047 2.60 MB/sec execute 83 sec latency 22.414 ms 2023-03-17T10:28:56.919 INFO:tasks.workunit.client.0.smithi035.stdout: 1 101695 2.59 MB/sec execute 84 sec latency 14.615 ms 2023-03-17T10:28:59.236 INFO:tasks.workunit.client.0.smithi035.stdout: 1 102233 2.61 MB/sec execute 85 sec latency 77.838 ms 2023-03-17T10:28:59.236 INFO:tasks.workunit.client.0.smithi035.stdout: 1 102695 2.61 MB/sec execute 86 sec latency 14.916 ms 2023-03-17T10:28:59.236 INFO:tasks.workunit.client.0.smithi035.stdout: 1 103172 2.63 MB/sec execute 87 sec latency 13.672 ms 2023-03-17T10:28:59.236 INFO:tasks.workunit.client.0.smithi035.stdout: 1 103430 2.61 MB/sec execute 88 sec latency 16.656 ms 2023-03-17T10:29:00.441 INFO:tasks.workunit.client.0.smithi035.stdout: 1 103853 2.59 MB/sec execute 89 sec latency 14.167 ms 2023-03-17T10:29:00.441 INFO:tasks.workunit.client.0.smithi035.stdout: 1 104363 2.61 MB/sec execute 90 sec latency 79.364 ms 2023-03-17T10:29:00.441 INFO:tasks.workunit.client.0.smithi035.stdout: 1 104686 2.58 MB/sec execute 91 sec latency 426.222 ms 2023-03-17T10:29:00.441 INFO:tasks.workunit.client.0.smithi035.stdout: 1 104775 2.55 MB/sec execute 92 sec latency 1242.786 ms 2023-03-17T10:29:00.441 INFO:tasks.workunit.client.0.smithi035.stdout: 1 105344 2.55 MB/sec execute 93 sec latency 13.575 ms 2023-03-17T10:29:00.441 INFO:tasks.workunit.client.0.smithi035.stdout: 1 106076 2.58 MB/sec execute 94 sec latency 14.079 ms 2023-03-17T10:29:00.442 INFO:tasks.workunit.client.0.smithi035.stdout: 1 106465 2.60 MB/sec execute 95 sec latency 16.956 ms 2023-03-17T10:29:00.442 INFO:tasks.workunit.client.0.smithi035.stdout: 1 106820 2.59 MB/sec execute 96 sec latency 13.893 ms 2023-03-17T10:29:00.442 INFO:tasks.workunit.client.0.smithi035.stdout: 1 107070 2.56 MB/sec execute 97 sec latency 13.837 ms 2023-03-17T10:29:00.442 INFO:tasks.workunit.client.0.smithi035.stdout: 1 107575 2.56 MB/sec execute 98 sec latency 15.117 ms 2023-03-17T10:29:00.442 INFO:tasks.workunit.client.0.smithi035.stdout: 1 107835 2.56 MB/sec execute 99 sec latency 582.358 ms 2023-03-17T10:29:01.285 INFO:tasks.workunit.client.0.smithi035.stdout: 1 107835 2.54 MB/sec execute 100 sec latency 1582.484 ms 2023-03-17T10:29:01.285 INFO:tasks.workunit.client.0.smithi035.stdout: 1 107835 2.51 MB/sec execute 101 sec latency 2582.590 ms 2023-03-17T10:29:01.285 INFO:tasks.workunit.client.0.smithi035.stdout: 1 107885 2.49 MB/sec execute 102 sec latency 3426.654 ms 2023-03-17T10:29:01.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:12 smithi035 ceph-mon[92535]: pgmap v3012: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T10:29:02.095 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:12 smithi035 ceph-mon[92535]: osdmap e264: 12 total, 12 up, 12 in 2023-03-17T10:29:02.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f782809f6c0 0x7f78280a1b70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f782c005950 tx=0x7f782c0058e0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 msgr2=0x7f783c196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c196790 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f7824009fd0 tx=0x7f782400f740 comp rx=0 tx=0).stop 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 shutdown_connections 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f782809f6c0 0x7f78280a1b70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f783c105470 0x7f783c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c100430 0x7f783c196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 --2- 172.21.15.35:0/1368497482 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f783c100dd0 0x7f783c196790 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 >> 172.21.15.35:0/1368497482 conn(0x7f783c0fbca0 msgr2=0x7f783c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 shutdown_connections 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:05.998+0000 7f7842057700 1 -- 172.21.15.35:0/1368497482 wait complete. 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3805604656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c18101ce0 msgr2=0x7f8c1810a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3805604656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c18101ce0 0x7f8c1810a1d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009990 tx=0x7f8c00009ca0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3805604656 shutdown_connections 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3805604656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 0x7f8c1810cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3805604656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c181013d0 0x7f8c181017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3805604656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c18101ce0 0x7f8c1810a1d0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3805604656 >> 172.21.15.35:0/3805604656 conn(0x7f8c18076330 msgr2=0x7f8c18076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3805604656 shutdown_connections 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.120+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3805604656 wait complete. 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.121+0000 7f8c1dd0c700 1 Processor -- start 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.121+0000 7f8c1dd0c700 1 -- start start 2023-03-17T10:29:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 0x7f8c181961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18101ce0 0x7f8c18196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 0x7f8c1819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1819b1d0 con 0x7f8c181013d0 2023-03-17T10:29:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1819b340 con 0x7f8c1810a7a0 2023-03-17T10:29:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1819b500 con 0x7f8c18101ce0 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 0x7f8c181961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 0x7f8c181961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50640/0 (socket says 172.21.15.35:50640) 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 -- 172.21.15.35:0/3005551474 learned_addr learned my addr 172.21.15.35:0/3005551474 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c17fff700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 0x7f8c1819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18101ce0 0x7f8c18196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 -- 172.21.15.35:0/3005551474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18101ce0 msgr2=0x7f8c18196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18101ce0 0x7f8c18196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:11.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 -- 172.21.15.35:0/3005551474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 msgr2=0x7f8c1819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 0x7f8c1819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 -- 172.21.15.35:0/3005551474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000095f0 con 0x7f8c181013d0 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c17fff700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 0x7f8c1819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18101ce0 0x7f8c18196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c177fe700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 0x7f8c181961f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800d950 tx=0x7f8c0800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c157fa700 1 -- 172.21.15.35:0/3005551474 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08009b40 con 0x7f8c181013d0 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c157fa700 1 -- 172.21.15.35:0/3005551474 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c08009ca0 con 0x7f8c181013d0 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c181100c0 con 0x7f8c181013d0 2023-03-17T10:29:11.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c157fa700 1 -- 172.21.15.35:0/3005551474 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800f620 con 0x7f8c181013d0 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.122+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1810ff30 con 0x7f8c181013d0 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.125+0000 7f8c157fa700 1 -- 172.21.15.35:0/3005551474 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8c08010460 con 0x7f8c181013d0 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.125+0000 7f8c157fa700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0409f640 0x7f8c040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.125+0000 7f8c157fa700 1 -- 172.21.15.35:0/3005551474 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(238..238 src has 1..238) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c080ca9a0 con 0x7f8c181013d0 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.125+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0409f640 0x7f8c040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.126+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0409f640 0x7f8c040a1af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8c000095c0 tx=0x7f8c00009550 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.126+0000 7f8c29e99b80 1 Processor -- start 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.126+0000 7f8c29e99b80 1 -- start start 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a2be0 0x561d861a2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 0x561d8619d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:11.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d8619dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d860a4010 con 0x561d861a34f0 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d860f6950 con 0x561d861a2be0 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d860efde0 con 0x561d8619d960 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 0x561d8619d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 0x561d8619d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50650/0 (socket says 172.21.15.35:50650) 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 -- 172.21.15.35:0/450440778 learned_addr learned my addr 172.21.15.35:0/450440778 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c177fe700 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a2be0 0x561d861a2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c17fff700 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d8619dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 -- 172.21.15.35:0/450440778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 msgr2=0x561d8619dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d8619dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 -- 172.21.15.35:0/450440778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a2be0 msgr2=0x561d861a2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a2be0 0x561d861a2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:12.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 -- 172.21.15.35:0/450440778 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d85f715d0 con 0x561d861a34f0 2023-03-17T10:29:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c17fff700 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d8619dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:29:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.127+0000 7f8c0effd700 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 0x561d8619d420 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f8c00015000 tx=0x7f8c0001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b9cfb4ab06449 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c0dffb700 1 -- 172.21.15.35:0/450440778 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0001e070 con 0x561d861a34f0 2023-03-17T10:29:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c0dffb700 1 -- 172.21.15.35:0/450440778 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c000055e0 con 0x561d861a34f0 2023-03-17T10:29:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c0dffb700 1 -- 172.21.15.35:0/450440778 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00003820 con 0x561d861a34f0 2023-03-17T10:29:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 -- 172.21.15.35:0/450440778 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 msgr2=0x561d8619d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:15.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 0x561d8619d420 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f8c00015000 tx=0x7f8c0001e000 comp rx=0 tx=0).stop 2023-03-17T10:29:15.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 -- 172.21.15.35:0/450440778 shutdown_connections 2023-03-17T10:29:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d8619dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a2be0 0x561d861a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/450440778 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a34f0 0x561d8619d420 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 -- 172.21.15.35:0/450440778 >> 172.21.15.35:0/450440778 conn(0x561d85ffa6b0 msgr2=0x561d86197a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 -- 172.21.15.35:0/450440778 shutdown_connections 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.128+0000 7f8c29e99b80 1 -- 172.21.15.35:0/450440778 wait complete. 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 -- start start 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 Processor -- start 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d861a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 0x561d861a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d861a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:17.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d85f738c0 con 0x561d861a2be0 2023-03-17T10:29:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d861a7480 con 0x561d861a34f0 2023-03-17T10:29:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d861b3000 con 0x561d8619d960 2023-03-17T10:29:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c29e99b80 10 client.0 _ll_register_callbacks cb 0x561d85f95230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:29:17.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.129+0000 7f8c0effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 0x561d861a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 0x561d861a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50656/0 (socket says 172.21.15.35:50656) 2023-03-17T10:29:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 -- 172.21.15.35:0/1410552099 learned_addr learned my addr 172.21.15.35:0/1410552099 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c177fe700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d861a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c17fff700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d861a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 -- 172.21.15.35:0/1410552099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 msgr2=0x561d861a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d861a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 -- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 msgr2=0x561d861a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d861a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 -- 172.21.15.35:0/1410552099 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1810d880 con 0x561d861a2be0 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c17fff700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d861a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:29:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c0effd700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 0x561d861a66e0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8c00020040 tx=0x7f8c00004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ad576f37dc1c47 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8bf6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:29:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/1410552099 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00004bf0 con 0x561d861a2be0 2023-03-17T10:29:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/1410552099 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(238..238 src has 1..238) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c00004d50 con 0x561d861a2be0 2023-03-17T10:29:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d860b2390 con 0x561d861a2be0 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/1410552099 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c00003820 con 0x561d861a2be0 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c29e99b80 10 client.18888 fetch_fsmap learned FSMap version 45 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.130+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x561d85f1dd80 con 0x561d861a2be0 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/1410552099 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561d860b2390 con 0x561d861a2be0 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/1410552099 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8c000306e0 con 0x561d861a2be0 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c29e99b80 10 client.18888 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c29e99b80 10 client.18888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c29e99b80 20 client.18888 populate_metadata read hostname 'smithi035' 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d861b6c50 0x561d861b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c29e99b80 4 client.18888 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d860be600 con 0x561d861b6c50 2023-03-17T10:29:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c177fe700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d861b6c50 0x561d861b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8bf6ffd700 10 client.18888 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.131+0000 7f8c177fe700 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d861b6c50 0x561d861b9060 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696148b83e56e186 server_cookie=8bfcc2f7ced75d2d in_seq=0 out_seq=0 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/1410552099 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561d860be600 con 0x561d861b6c50 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8bf6ffd700 10 client.18888 handle_command_reply: tid=0 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 client.18888 shutdown 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 msgr2=0x561d861a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 0x561d861a66e0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8c00020040 tx=0x7f8c00004500 comp rx=0 tx=0).stop 2023-03-17T10:29:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 shutdown_connections 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d861b6c50 0x561d861b9060 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d861a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8bf6ffd700 0 client.18888 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d8619d960 0x561d861a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1410552099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d861a2be0 0x561d861a66e0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 >> 172.21.15.35:0/1410552099 conn(0x561d85ffa6b0 msgr2=0x561d8619c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 shutdown_connections 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.132+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1410552099 wait complete. 2023-03-17T10:29:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.133+0000 7f8c29e99b80 20 client.18888 trim_cache size 0 max 16384 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 Processor -- start 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 -- start start 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d86197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d8619ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d8619d7d0 con 0x561d8619d960 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d86198000 con 0x561d861a34f0 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d86193100 con 0x561d861a2be0 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d86197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:22.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d86197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50662/0 (socket says 172.21.15.35:50662) 2023-03-17T10:29:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 -- 172.21.15.35:0/1988820819 learned_addr learned my addr 172.21.15.35:0/1988820819 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c0effd700 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c17fff700 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d8619ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 -- 172.21.15.35:0/1988820819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 msgr2=0x561d861adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 -- 172.21.15.35:0/1988820819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 msgr2=0x561d8619ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d8619ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.148+0000 7f8c177fe700 1 -- 172.21.15.35:0/1988820819 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d860b6130 con 0x561d8619d960 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.149+0000 7f8c0effd700 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.149+0000 7f8c177fe700 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d86197ac0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8c080c8190 tx=0x7f8c080ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77324a7730e1ee0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.151+0000 7f8c0e7fc700 1 -- 172.21.15.35:0/1988820819 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c080967f0 con 0x561d8619d960 2023-03-17T10:29:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.151+0000 7f8c0e7fc700 1 -- 172.21.15.35:0/1988820819 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c08010710 con 0x561d8619d960 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.151+0000 7f8c0e7fc700 1 -- 172.21.15.35:0/1988820819 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c080986b0 con 0x561d8619d960 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1988820819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 msgr2=0x561d86197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d86197ac0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8c080c8190 tx=0x7f8c080ca040 comp rx=0 tx=0).stop 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1988820819 shutdown_connections 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d8619ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d86197ac0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/1988820819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1988820819 >> 172.21.15.35:0/1988820819 conn(0x561d85ffa6b0 msgr2=0x561d861b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1988820819 shutdown_connections 2023-03-17T10:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 -- 172.21.15.35:0/1988820819 wait complete. 2023-03-17T10:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 -- start start 2023-03-17T10:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.152+0000 7f8c29e99b80 1 Processor -- start 2023-03-17T10:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d861fec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861ff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d86202af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d862030a0 con 0x561d8619d960 2023-03-17T10:29:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d86203210 con 0x561d861a34f0 2023-03-17T10:29:30.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d862033d0 con 0x561d861a2be0 2023-03-17T10:29:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c29e99b80 10 client.0 _ll_register_callbacks cb 0x561d85f95230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:29:32.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d861fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d861fec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50668/0 (socket says 172.21.15.35:50668) 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 -- 172.21.15.35:0/3139339554 learned_addr learned my addr 172.21.15.35:0/3139339554 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c17fff700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d86202af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 -- 172.21.15.35:0/3139339554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 msgr2=0x561d861ff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861ff170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 -- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 msgr2=0x561d86202af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d86202af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 -- 172.21.15.35:0/3139339554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1810ff30 con 0x561d8619d960 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c17fff700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d86202af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:29:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8c177fe700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d861fec30 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8c080983e0 tx=0x7f8c08010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4274482cb6beeea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8bf6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.153+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/3139339554 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0809c0b0 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/3139339554 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(238..238 src has 1..238) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c0809c210 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d8616d1e0 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/3139339554 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c08097940 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 10 client.18894 fetch_fsmap learned FSMap version 45 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x561d85f441f0 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/3139339554 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561d8616d1e0 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/3139339554 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8c080a01b0 con 0x561d8619d960 2023-03-17T10:29:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 10 client.18894 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:29:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 10 client.18894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:29:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 20 client.18894 populate_metadata read hostname 'smithi035' 2023-03-17T10:29:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d8620b900 0x561d8620dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 4 client.18894 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:29:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d85f73f00 con 0x561d8620b900 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.154+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d8620b900 0x561d8620dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.155+0000 7f8bf6ffd700 10 client.18894 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.155+0000 7f8c0effd700 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d8620b900 0x561d8620dd10 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cb6e123e214ecb3 server_cookie=67755d6476b91eeb in_seq=0 out_seq=0 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8bf6ffd700 1 -- 172.21.15.35:0/3139339554 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f8c0002b040 con 0x561d8620b900 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8bf6ffd700 10 client.18894 handle_command_reply: tid=0 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 client.18894 shutdown 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 msgr2=0x561d861fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d861fec30 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8c080983e0 tx=0x7f8c08010a70 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 shutdown_connections 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561d8620b900 0x561d8620dd10 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d861a34f0 0x561d86202af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561d8619d960 0x561d861fec30 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8bf6ffd700 0 client.18894 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 --2- 172.21.15.35:0/3139339554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561d861a2be0 0x561d861ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 >> 172.21.15.35:0/3139339554 conn(0x561d85ffa6b0 msgr2=0x561d8619ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 shutdown_connections 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.163+0000 7f8c29e99b80 1 -- 172.21.15.35:0/3139339554 wait complete. 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c29e99b80 20 client.18894 trim_cache size 0 max 16384 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0409f640 msgr2=0x7f8c040a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0409f640 0x7f8c040a1af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8c000095c0 tx=0x7f8c00009550 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 msgr2=0x7f8c181961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 0x7f8c181961f0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800d950 tx=0x7f8c0800dd10 comp rx=0 tx=0).stop 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 shutdown_connections 2023-03-17T10:29:40.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0409f640 0x7f8c040a1af0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c1810a7a0 0x7f8c1819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c181013d0 0x7f8c181961f0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 --2- 172.21.15.35:0/3005551474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c18101ce0 0x7f8c18196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 >> 172.21.15.35:0/3005551474 conn(0x7f8c18076330 msgr2=0x7f8c180fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 shutdown_connections 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:19.164+0000 7f8c1dd0c700 1 -- 172.21.15.35:0/3005551474 wait complete. 2023-03-17T10:29:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 -- 172.21.15.35:0/1967685763 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9194104390 msgr2=0x7f919410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 --2- 172.21.15.35:0/1967685763 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9194104390 0x7f919410bf60 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b1d0 tx=0x7f918c00b4e0 comp rx=0 tx=0).stop 2023-03-17T10:29:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 -- 172.21.15.35:0/1967685763 shutdown_connections 2023-03-17T10:29:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 --2- 172.21.15.35:0/1967685763 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9194104390 0x7f919410bf60 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 --2- 172.21.15.35:0/1967685763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91940ff350 0x7f91940ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 --2- 172.21.15.35:0/1967685763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91940ffcf0 0x7f9194103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 -- 172.21.15.35:0/1967685763 >> 172.21.15.35:0/1967685763 conn(0x7f9194076330 msgr2=0x7f9194076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 -- 172.21.15.35:0/1967685763 shutdown_connections 2023-03-17T10:29:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 -- 172.21.15.35:0/1967685763 wait complete. 2023-03-17T10:29:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 Processor -- start 2023-03-17T10:29:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.287+0000 7f919ae4b700 1 -- start start 2023-03-17T10:29:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f919ae4b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 0x7f9194194050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f919ae4b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91940ffcf0 0x7f9194194590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f919ae4b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9194104390 0x7f91941989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f919ae4b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194199030 con 0x7f91940ff350 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f919ae4b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91941991a0 con 0x7f91940ffcf0 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f919ae4b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194199360 con 0x7f9194104390 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 0x7f9194194050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 0x7f9194194050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50682/0 (socket says 172.21.15.35:50682) 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 -- 172.21.15.35:0/3475780124 learned_addr learned my addr 172.21.15.35:0/3475780124 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9193fff700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91940ffcf0 0x7f9194194590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f91993e8700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9194104390 0x7f91941989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 -- 172.21.15.35:0/3475780124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9194104390 msgr2=0x7f91941989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9194104390 0x7f91941989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 -- 172.21.15.35:0/3475780124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91940ffcf0 msgr2=0x7f9194194590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91940ffcf0 0x7f9194194590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 -- 172.21.15.35:0/3475780124 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c009d00 con 0x7f91940ff350 2023-03-17T10:29:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9198be7700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 0x7f9194194050 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f918400abb0 tx=0x7f918400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.288+0000 7f9191ffb700 1 -- 172.21.15.35:0/3475780124 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184010070 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.289+0000 7f9191ffb700 1 -- 172.21.15.35:0/3475780124 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9184007d50 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.289+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919410df70 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.289+0000 7f9191ffb700 1 -- 172.21.15.35:0/3475780124 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184014db0 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.289+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919410dde0 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.291+0000 7f9191ffb700 1 -- 172.21.15.35:0/3475780124 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f91840078c0 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.291+0000 7f9191ffb700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f918009f6c0 0x7f91800a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.292+0000 7f9191ffb700 1 -- 172.21.15.35:0/3475780124 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(238..238 src has 1..238) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f91840c97e0 con 0x7f91940ff350 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.292+0000 7f9193fff700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f918009f6c0 0x7f91800a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.292+0000 7f9193fff700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f918009f6c0 0x7f91800a1b70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9194195660 tx=0x7f917c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.292+0000 7f91a6fd8b80 1 Processor -- start 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 -- start start 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebacbe0 0x5652aebacfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aeba7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeaae010 con 0x5652aeba7960 2023-03-17T10:29:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeb00950 con 0x5652aebacbe0 2023-03-17T10:29:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeaf9de0 con 0x5652aebad4f0 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50694/0 (socket says 172.21.15.35:50694) 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 -- 172.21.15.35:0/3672932879 learned_addr learned my addr 172.21.15.35:0/3672932879 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f9198be7700 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebacbe0 0x5652aebacfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f9193fff700 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aeba7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 -- 172.21.15.35:0/3672932879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 msgr2=0x5652aeba7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aeba7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 -- 172.21.15.35:0/3672932879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebacbe0 msgr2=0x5652aebacfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebacbe0 0x5652aebacfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 -- 172.21.15.35:0/3672932879 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652ae97b5d0 con 0x5652aeba7960 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.293+0000 7f91993e8700 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba7d90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f918c0097a0 tx=0x7f918c0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ec1976e74a0932 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f918affd700 1 -- 172.21.15.35:0/3672932879 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c025070 con 0x5652aeba7960 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f918affd700 1 -- 172.21.15.35:0/3672932879 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f918c00bf40 con 0x5652aeba7960 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f918affd700 1 -- 172.21.15.35:0/3672932879 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c007a80 con 0x5652aeba7960 2023-03-17T10:29:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/3672932879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 msgr2=0x5652aeba7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba7d90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f918c0097a0 tx=0x7f918c0097d0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/3672932879 shutdown_connections 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba7d90 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebacbe0 0x5652aebacfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/3672932879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aeba7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/3672932879 >> 172.21.15.35:0/3672932879 conn(0x5652aea046b0 msgr2=0x5652aeba1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/3672932879 shutdown_connections 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.294+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/3672932879 wait complete. 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.295+0000 7f91a6fd8b80 1 -- start start 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.295+0000 7f91a6fd8b80 1 Processor -- start 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.295+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aeba7960 0x5652aebb33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 0x5652aebb0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aebb0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652ae97d8c0 con 0x5652aebacbe0 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aebb1410 con 0x5652aeba7960 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aebbcfd0 con 0x5652aebad4f0 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 10 client.0 _ll_register_callbacks cb 0x5652ae99f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 0x5652aebb0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 0x5652aebb0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50698/0 (socket says 172.21.15.35:50698) 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 -- 172.21.15.35:0/1989247064 learned_addr learned my addr 172.21.15.35:0/1989247064 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9198be7700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aeba7960 0x5652aebb33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91993e8700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aebb0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:44.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 -- 172.21.15.35:0/1989247064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 msgr2=0x5652aebb0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:44.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aebb0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.380 INFO:tasks.workunit.client.0.smithi035.stdout: 1 108376 2.47 MB/sec execute 103 sec latency 21.282 ms 2023-03-17T10:29:44.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 -- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aeba7960 msgr2=0x5652aebb33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:44.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aeba7960 0x5652aebb33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:44.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 -- 172.21.15.35:0/1989247064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918c01c040 con 0x5652aebacbe0 2023-03-17T10:29:44.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9198be7700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aeba7960 0x5652aebb33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:29:44.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9193fff700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 0x5652aebb0670 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f917c0114e0 tx=0x7f917c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5123aaaab6972b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:44.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9173fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:29:44.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9173fff700 1 -- 172.21.15.35:0/1989247064 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c004a30 con 0x5652aebacbe0 2023-03-17T10:29:45.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f9173fff700 1 -- 172.21.15.35:0/1989247064 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(238..238 src has 1..238) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f917c017070 con 0x5652aebacbe0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.296+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652aeabc390 con 0x5652aebacbe0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f9173fff700 1 -- 172.21.15.35:0/1989247064 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f917c004b90 con 0x5652aebacbe0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 10 client.18906 fetch_fsmap learned FSMap version 45 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5652ae927d80 con 0x5652aebacbe0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f9173fff700 1 -- 172.21.15.35:0/1989247064 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5652aeabc390 con 0x5652aebacbe0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f9173fff700 1 -- 172.21.15.35:0/1989247064 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f917c030560 con 0x5652aebacbe0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 10 client.18906 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 10 client.18906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 20 client.18906 populate_metadata read hostname 'smithi035' 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aebc1010 0x5652aebc3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 4 client.18906 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652aeac8600 con 0x5652aebc1010 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.297+0000 7f9198be7700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aebc1010 0x5652aebc3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.298+0000 7f9198be7700 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aebc1010 0x5652aebc3420 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b013f94f1e80a9c server_cookie=400adbdb11a5e698 in_seq=0 out_seq=0 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.298+0000 7f9173fff700 10 client.18906 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.298+0000 7f9173fff700 1 -- 172.21.15.35:0/1989247064 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5652aeac8600 con 0x5652aebc1010 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.298+0000 7f9173fff700 10 client.18906 handle_command_reply: tid=0 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.298+0000 7f91a6fd8b80 1 client.18906 shutdown 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 msgr2=0x5652aebb0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 0x5652aebb0670 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f917c0114e0 tx=0x7f917c0047c0 comp rx=0 tx=0).stop 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 shutdown_connections 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aebc1010 0x5652aebc3420 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebad4f0 0x5652aebb0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f9173fff700 0 client.18906 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aeba7960 0x5652aebb33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/1989247064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aebacbe0 0x5652aebb0670 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 >> 172.21.15.35:0/1989247064 conn(0x5652aea046b0 msgr2=0x5652aeba1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 shutdown_connections 2023-03-17T10:29:45.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/1989247064 wait complete. 2023-03-17T10:29:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.299+0000 7f91a6fd8b80 20 client.18906 trim_cache size 0 max 16384 2023-03-17T10:29:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 Processor -- start 2023-03-17T10:29:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 -- start start 2023-03-17T10:29:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aebb7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aebae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeba2730 con 0x5652aeba7960 2023-03-17T10:29:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeba2030 con 0x5652aebad4f0 2023-03-17T10:29:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeb9eb60 con 0x5652aebacbe0 2023-03-17T10:29:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50704/0 (socket says 172.21.15.35:50704) 2023-03-17T10:29:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 -- 172.21.15.35:0/398598635 learned_addr learned my addr 172.21.15.35:0/398598635 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 -- 172.21.15.35:0/398598635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 msgr2=0x5652aebb7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aebb7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 -- 172.21.15.35:0/398598635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 msgr2=0x5652aebae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aebae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 -- 172.21.15.35:0/398598635 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652aeac0130 con 0x5652aeba7960 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.314+0000 7f9198be7700 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba1ac0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f9184093790 tx=0x7f918409a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1e28dca3a24e06 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f918b7fe700 1 -- 172.21.15.35:0/398598635 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184097290 con 0x5652aeba7960 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f918b7fe700 1 -- 172.21.15.35:0/398598635 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f918409f480 con 0x5652aeba7960 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f918b7fe700 1 -- 172.21.15.35:0/398598635 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840974f0 con 0x5652aeba7960 2023-03-17T10:29:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/398598635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 msgr2=0x5652aeba1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba1ac0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f9184093790 tx=0x7f918409a040 comp rx=0 tx=0).stop 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/398598635 shutdown_connections 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aebae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aeba1ac0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/398598635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aebb7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/398598635 >> 172.21.15.35:0/398598635 conn(0x5652aea046b0 msgr2=0x5652aebad990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/398598635 shutdown_connections 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/398598635 wait complete. 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.315+0000 7f91a6fd8b80 1 -- start start 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 Processor -- start 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aebb8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aeba8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aeba9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aeba9b10 con 0x5652aeba7960 2023-03-17T10:29:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aec14eb0 con 0x5652aebad4f0 2023-03-17T10:29:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652aec14ff0 con 0x5652aebacbe0 2023-03-17T10:29:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91a6fd8b80 10 client.0 _ll_register_callbacks cb 0x5652ae99f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:29:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aebb8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aebb8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50710/0 (socket says 172.21.15.35:50710) 2023-03-17T10:29:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 -- 172.21.15.35:0/483672487 learned_addr learned my addr 172.21.15.35:0/483672487 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9193fff700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aeba8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f91993e8700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aeba9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 -- 172.21.15.35:0/483672487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 msgr2=0x5652aeba8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aeba8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 -- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 msgr2=0x5652aeba9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:29:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.316+0000 7f9198be7700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aeba9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9198be7700 1 -- 172.21.15.35:0/483672487 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919410dde0 con 0x5652aeba7960 2023-03-17T10:29:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9198be7700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aebb8110 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f91840074a0 tx=0x7f91840075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a433776c4cff7ed6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9173fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9173fff700 1 -- 172.21.15.35:0/483672487 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840c6ab0 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9173fff700 1 -- 172.21.15.35:0/483672487 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(238..238 src has 1..238) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f91840af040 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652aeb771e0 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9173fff700 1 -- 172.21.15.35:0/483672487 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91840c6c10 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 10 client.18912 fetch_fsmap learned FSMap version 45 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5652ae94e1f0 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9173fff700 1 -- 172.21.15.35:0/483672487 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5652aeb771e0 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f9173fff700 1 -- 172.21.15.35:0/483672487 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f91840b5070 con 0x5652aeba7960 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 10 client.18912 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 10 client.18912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 20 client.18912 populate_metadata read hostname 'smithi035' 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aec16460 0x5652aec18870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 4 client.18912 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:29:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.317+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5652ae97df00 con 0x5652aec16460 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.318+0000 7f9193fff700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aec16460 0x5652aec18870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.318+0000 7f9193fff700 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aec16460 0x5652aec18870 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bad2c64ddc84b4d server_cookie=904be5380c3e49be in_seq=0 out_seq=0 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.318+0000 7f9173fff700 10 client.18912 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f9173fff700 1 -- 172.21.15.35:0/483672487 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5652ae97df00 con 0x5652aec16460 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f9173fff700 10 client.18912 handle_command_reply: tid=0 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 client.18912 shutdown 2023-03-17T10:29:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 msgr2=0x5652aebb8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aebb8110 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f91840074a0 tx=0x7f91840075d0 comp rx=0 tx=0).stop 2023-03-17T10:29:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 shutdown_connections 2023-03-17T10:29:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5652aec16460 0x5652aec18870 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652aebad4f0 0x5652aeba9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f9173fff700 0 client.18912 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:29:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5652aeba7960 0x5652aebb8110 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 --2- 172.21.15.35:0/483672487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5652aebacbe0 0x5652aeba8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 >> 172.21.15.35:0/483672487 conn(0x5652aea046b0 msgr2=0x5652aebab790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 shutdown_connections 2023-03-17T10:29:55.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.323+0000 7f91a6fd8b80 1 -- 172.21.15.35:0/483672487 wait complete. 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f91a6fd8b80 20 client.18912 trim_cache size 0 max 16384 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f918009f6c0 msgr2=0x7f91800a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f918009f6c0 0x7f91800a1b70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9194195660 tx=0x7f917c00b410 comp rx=0 tx=0).stop 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 msgr2=0x7f9194194050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 0x7f9194194050 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f918400abb0 tx=0x7f918400aec0 comp rx=0 tx=0).stop 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 shutdown_connections 2023-03-17T10:29:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f918009f6c0 0x7f91800a1b70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9194104390 0x7f91941989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f91940ff350 0x7f9194194050 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 --2- 172.21.15.35:0/3475780124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91940ffcf0 0x7f9194194590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 >> 172.21.15.35:0/3475780124 conn(0x7f9194076330 msgr2=0x7f91940fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 shutdown_connections 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:04:32.324+0000 7f919ae4b700 1 -- 172.21.15.35:0/3475780124 wait complete. 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/325946522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 msgr2=0x7ffa28103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/325946522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa28103cb0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7ffa180099c0 tx=0x7ffa18009cd0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/325946522 shutdown_connections 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/325946522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa28104390 0x7ffa2810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/325946522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa280ff350 0x7ffa280ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/325946522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa28103cb0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/325946522 >> 172.21.15.35:0/325946522 conn(0x7ffa28076330 msgr2=0x7ffa28076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/325946522 shutdown_connections 2023-03-17T10:29:57.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.619+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/325946522 wait complete. 2023-03-17T10:29:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 Processor -- start 2023-03-17T10:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 -- start start 2023-03-17T10:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa280ff350 0x7ffa28196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa281967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa28104390 0x7ffa2819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:29:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2819b270 con 0x7ffa280ffcf0 2023-03-17T10:29:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2819b3e0 con 0x7ffa280ff350 2023-03-17T10:29:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.620+0000 7ffa2d8ac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2819b5a0 con 0x7ffa28104390 2023-03-17T10:29:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa281967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa281967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50726/0 (socket says 172.21.15.35:50726) 2023-03-17T10:29:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 -- 172.21.15.35:0/2091031871 learned_addr learned my addr 172.21.15.35:0/2091031871 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:29:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa277fe700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa28104390 0x7ffa2819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa280ff350 0x7ffa28196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:29:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 -- 172.21.15.35:0/2091031871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa28104390 msgr2=0x7ffa2819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa28104390 0x7ffa2819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 -- 172.21.15.35:0/2091031871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa280ff350 msgr2=0x7ffa28196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:29:59.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa280ff350 0x7ffa28196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:29:59.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 -- 172.21.15.35:0/2091031871 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180095f0 con 0x7ffa280ffcf0 2023-03-17T10:29:59.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa267fc700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa281967d0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c00 tx=0x7ffa1800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:29:59.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa2c8aa700 1 -- 172.21.15.35:0/2091031871 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1801d070 con 0x7ffa280ffcf0 2023-03-17T10:29:59.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2810efc0 con 0x7ffa280ffcf0 2023-03-17T10:29:59.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa2c8aa700 1 -- 172.21.15.35:0/2091031871 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa18005050 con 0x7ffa280ffcf0 2023-03-17T10:29:59.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa2c8aa700 1 -- 172.21.15.35:0/2091031871 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18004970 con 0x7ffa280ffcf0 2023-03-17T10:29:59.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.621+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2810ee30 con 0x7ffa280ffcf0 2023-03-17T10:29:59.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.623+0000 7ffa2c8aa700 1 -- 172.21.15.35:0/2091031871 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ffa180051c0 con 0x7ffa280ffcf0 2023-03-17T10:29:59.573 INFO:tasks.workunit.client.0.smithi035.stdout: 1 108892 2.46 MB/sec execute 104 sec latency 21.349 ms 2023-03-17T10:30:00.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:14 smithi035 ceph-mon[92535]: pgmap v3014: 97 pgs: 97 active+clean; 72 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.2 MiB/s wr, 114 op/s 2023-03-17T10:30:00.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:16 smithi035 ceph-mon[92535]: pgmap v3015: 97 pgs: 97 active+clean; 72 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.1 MiB/s wr, 102 op/s 2023-03-17T10:30:00.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:17 smithi035 ceph-mon[92535]: pgmap v3016: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:20 smithi035 ceph-mon[92535]: pgmap v3017: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:22 smithi035 ceph-mon[92535]: pgmap v3018: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:24 smithi035 ceph-mon[92535]: pgmap v3019: 97 pgs: 97 active+clean; 78 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:26 smithi035 ceph-mon[92535]: pgmap v3020: 97 pgs: 97 active+clean; 78 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 1.2 MiB/s wr, 109 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:27 smithi035 ceph-mon[92535]: pgmap v3021: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:30 smithi035 ceph-mon[92535]: pgmap v3022: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:32 smithi035 ceph-mon[92535]: pgmap v3023: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-03-17T10:30:00.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:34 smithi035 ceph-mon[92535]: pgmap v3024: 97 pgs: 97 active+clean; 84 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.9 MiB/s wr, 173 op/s 2023-03-17T10:30:01.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:36 smithi035 ceph-mon[92535]: pgmap v3025: 97 pgs: 97 active+clean; 84 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 1.4 MiB/s wr, 115 op/s 2023-03-17T10:30:01.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:30:01.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:37 smithi035 ceph-mon[92535]: pgmap v3026: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 172 op/s 2023-03-17T10:30:01.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: pgmap v3027: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:01.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:01.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:02.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:02.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:03.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:03.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:04.002 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:04.002 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:30:04.002 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:30:04.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:30:04.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:30:04.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:41 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T10:30:04.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:41 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T10:30:04.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:41 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T10:30:04.595 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:41 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:30:04.595 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:41 smithi035 ceph-mon[92535]: pgmap v3028: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.3 MiB/s wr, 121 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:41 smithi035 ceph-mon[92535]: pgmap v3029: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:42 smithi035 ceph-mon[92535]: pgmap v3030: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:45 smithi035 ceph-mon[92535]: pgmap v3031: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:47 smithi035 ceph-mon[92535]: pgmap v3032: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 924 KiB/s wr, 77 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:49 smithi035 ceph-mon[92535]: pgmap v3033: 97 pgs: 97 active+clean; 91 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:51 smithi035 ceph-mon[92535]: pgmap v3034: 97 pgs: 97 active+clean; 91 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:52 smithi035 ceph-mon[92535]: pgmap v3035: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.8 MiB/s wr, 175 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:55 smithi035 ceph-mon[92535]: pgmap v3036: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T10:30:07.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:57 smithi035 ceph-mon[92535]: pgmap v3037: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T10:30:07.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:18:59 smithi035 ceph-mon[92535]: pgmap v3038: 97 pgs: 97 active+clean; 80 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.9 MiB/s wr, 177 op/s 2023-03-17T10:30:07.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:01 smithi035 ceph-mon[92535]: pgmap v3039: 97 pgs: 97 active+clean; 80 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 1.2 MiB/s wr, 123 op/s 2023-03-17T10:30:07.015 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:02 smithi035 ceph-mon[92535]: pgmap v3040: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 1.9 MiB/s wr, 193 op/s 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:04 smithi035 ceph-mon[92535]: osdmap e265: 12 total, 12 up, 12 in 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:04 smithi035 ceph-mon[92535]: pgmap v3042: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:07 smithi035 ceph-mon[92535]: pgmap v3043: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:09 smithi035 ceph-mon[92535]: pgmap v3044: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:11 smithi035 ceph-mon[92535]: pgmap v3045: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:12 smithi035 ceph-mon[92535]: osdmap e266: 12 total, 12 up, 12 in 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:12 smithi035 ceph-mon[92535]: pgmap v3047: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 1.7 MiB/s wr, 166 op/s 2023-03-17T10:30:07.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:15 smithi035 ceph-mon[92535]: pgmap v3048: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2023-03-17T10:30:08.340 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:17 smithi035 ceph-mon[92535]: pgmap v3049: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2023-03-17T10:30:08.340 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:19 smithi035 ceph-mon[92535]: pgmap v3050: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2023-03-17T10:30:08.340 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:21 smithi035 ceph-mon[92535]: pgmap v3051: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2023-03-17T10:30:08.340 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:22 smithi035 ceph-mon[92535]: pgmap v3052: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.1 MiB/s wr, 199 op/s 2023-03-17T10:30:08.340 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:25 smithi035 ceph-mon[92535]: pgmap v3053: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T10:30:08.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:27 smithi035 ceph-mon[92535]: pgmap v3054: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T10:30:10.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:29 smithi035 ceph-mon[92535]: pgmap v3055: 97 pgs: 97 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.9 MiB/s wr, 179 op/s 2023-03-17T10:30:10.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:31 smithi035 ceph-mon[92535]: pgmap v3056: 97 pgs: 97 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T10:30:10.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:32 smithi035 ceph-mon[92535]: pgmap v3057: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.9 MiB/s wr, 177 op/s 2023-03-17T10:30:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:30:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:30:13.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:30:13.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:30:13.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:30:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:30:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.624+0000 7ffa2c8aa700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa1409f640 0x7ffa140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.624+0000 7ffa2c8aa700 1 -- 172.21.15.35:0/2091031871 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(239..239 src has 1..239) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ffa180cb2c0 con 0x7ffa280ffcf0 2023-03-17T10:30:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.624+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa1409f640 0x7ffa140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa1409f640 0x7ffa140a1af0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009c60 tx=0x7ffa10009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:30:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 Processor -- start 2023-03-17T10:30:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 -- start start 2023-03-17T10:30:15.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f140efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1409420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:17.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1409d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1310010 con 0x5637f140ebe0 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1362950 con 0x5637f1409960 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f135bde0 con 0x5637f140f4f0 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.625+0000 7ffa26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f140efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f140efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50732/0 (socket says 172.21.15.35:50732) 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1975404736 learned_addr learned my addr 172.21.15.35:0/1975404736 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa267fc700 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1409420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa277fe700 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1409d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1975404736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 msgr2=0x5637f1409420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1409420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1975404736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 msgr2=0x5637f1409d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1409d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1975404736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637f11dd5d0 con 0x5637f140ebe0 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa267fc700 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1409420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f140efb0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000e4e0 tx=0x7ffa10014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8a4c8f792c3ca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa1dffb700 1 -- 172.21.15.35:0/1975404736 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000ee00 con 0x5637f140ebe0 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa1dffb700 1 -- 172.21.15.35:0/1975404736 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa10021070 con 0x5637f140ebe0 2023-03-17T10:30:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.626+0000 7ffa1dffb700 1 -- 172.21.15.35:0/1975404736 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1001d650 con 0x5637f140ebe0 2023-03-17T10:30:18.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1975404736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 msgr2=0x5637f140efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f140efb0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000e4e0 tx=0x7ffa10014000 comp rx=0 tx=0).stop 2023-03-17T10:30:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1975404736 shutdown_connections 2023-03-17T10:30:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1409d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f140efb0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1975404736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1409420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1975404736 >> 172.21.15.35:0/1975404736 conn(0x5637f12666b0 msgr2=0x5637f1403a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1975404736 shutdown_connections 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1975404736 wait complete. 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.627+0000 7ffa39a39b80 1 -- start start 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 Processor -- start 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f1409960 0x5637f14153c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1412640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1412be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f11df8c0 con 0x5637f140ebe0 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1413350 con 0x5637f140f4f0 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1413510 con 0x5637f1409960 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa39a39b80 10 client.0 _ll_register_callbacks cb 0x5637f1201230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1412640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1412640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50740/0 (socket says 172.21.15.35:50740) 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa267fc700 1 -- 172.21.15.35:0/3076055678 learned_addr learned my addr 172.21.15.35:0/3076055678 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f1409960 0x5637f14153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.628+0000 7ffa277fe700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1412be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa267fc700 1 -- 172.21.15.35:0/3076055678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f1409960 msgr2=0x5637f14153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa267fc700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f1409960 0x5637f14153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa267fc700 1 -- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 msgr2=0x5637f1412be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa267fc700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1412be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:20.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa267fc700 1 -- 172.21.15.35:0/3076055678 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa10017070 con 0x5637f140ebe0 2023-03-17T10:30:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa277fe700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1412be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:30:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa267fc700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1412640 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ffa18095840 tx=0x7ffa18098ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213dd4fd3fddad87 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:30:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:30:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3076055678 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18099030 con 0x5637f140ebe0 2023-03-17T10:30:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3076055678 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(239..239 src has 1..239) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ffa18099190 con 0x5637f140ebe0 2023-03-17T10:30:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637f131e390 con 0x5637f140ebe0 2023-03-17T10:30:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3076055678 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa180982c0 con 0x5637f140ebe0 2023-03-17T10:30:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 10 client.18924 fetch_fsmap learned FSMap version 45 2023-03-17T10:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5637f1189d80 con 0x5637f140ebe0 2023-03-17T10:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3076055678 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637f131e390 con 0x5637f140ebe0 2023-03-17T10:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3076055678 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ffa18004ad0 con 0x5637f140ebe0 2023-03-17T10:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 10 client.18924 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 10 client.18924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:30:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 20 client.18924 populate_metadata read hostname 'smithi035' 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1425070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 4 client.18924 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.629+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637f132a600 con 0x5637f1422c90 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.630+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1425070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.630+0000 7ffa06ffd700 10 client.18924 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.630+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1425070 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e07bbeda38eb98 server_cookie=2abce6bb04af1f7 in_seq=0 out_seq=0 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3076055678 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5637f132a600 con 0x5637f1422c90 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa06ffd700 10 client.18924 handle_command_reply: tid=0 2023-03-17T10:30:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 client.18924 shutdown 2023-03-17T10:30:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 msgr2=0x5637f1412640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1412640 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ffa18095840 tx=0x7ffa18098ec0 comp rx=0 tx=0).stop 2023-03-17T10:30:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 shutdown_connections 2023-03-17T10:30:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1425070 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1412be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa06ffd700 0 client.18924 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:30:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f1409960 0x5637f14153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3076055678 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1412640 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 >> 172.21.15.35:0/3076055678 conn(0x5637f12666b0 msgr2=0x5637f1408410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:30:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 shutdown_connections 2023-03-17T10:30:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3076055678 wait complete. 2023-03-17T10:30:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.631+0000 7ffa39a39b80 20 client.18924 trim_cache size 0 max 16384 2023-03-17T10:30:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.646+0000 7ffa39a39b80 1 Processor -- start 2023-03-17T10:30:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.646+0000 7ffa39a39b80 1 -- start start 2023-03-17T10:30:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 0x5637f1403ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140ebe0 0x5637f1419f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1411e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f132a600 con 0x5637f1409960 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f131e390 con 0x5637f140f4f0 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1404000 con 0x5637f140ebe0 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 0x5637f1403ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 0x5637f1403ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50746/0 (socket says 172.21.15.35:50746) 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1283738916 learned_addr learned my addr 172.21.15.35:0/1283738916 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa277fe700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1411e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1283738916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140ebe0 msgr2=0x5637f1419f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa267fc700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140ebe0 0x5637f1419f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140ebe0 0x5637f1419f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1283738916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 msgr2=0x5637f1411e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1411e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:28.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 -- 172.21.15.35:0/1283738916 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637f1322130 con 0x5637f1409960 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa277fe700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1411e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa267fc700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140ebe0 0x5637f1419f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 0x5637f1403ac0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000e480 tx=0x7ffa10005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f04a98dfa1d6093 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.647+0000 7ffa1e7fc700 1 -- 172.21.15.35:0/1283738916 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10031bf0 con 0x5637f1409960 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa1e7fc700 1 -- 172.21.15.35:0/1283738916 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa10021070 con 0x5637f1409960 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa1e7fc700 1 -- 172.21.15.35:0/1283738916 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100054d0 con 0x5637f1409960 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1283738916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 msgr2=0x5637f1403ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 0x5637f1403ac0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000e480 tx=0x7ffa10005ce0 comp rx=0 tx=0).stop 2023-03-17T10:30:28.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1283738916 shutdown_connections 2023-03-17T10:30:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f140f4f0 0x5637f1411e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f1409960 0x5637f1403ac0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/1283738916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140ebe0 0x5637f1419f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1283738916 >> 172.21.15.35:0/1283738916 conn(0x5637f12666b0 msgr2=0x5637f1412600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1283738916 shutdown_connections 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 -- 172.21.15.35:0/1283738916 wait complete. 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.648+0000 7ffa39a39b80 1 -- start start 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 Processor -- start 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1419e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1418120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1418660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1418ba0 con 0x5637f140ebe0 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1418ce0 con 0x5637f1409960 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637f1418ea0 con 0x5637f140f4f0 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa39a39b80 10 client.0 _ll_register_callbacks cb 0x5637f1201230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1418120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1418120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50754/0 (socket says 172.21.15.35:50754) 2023-03-17T10:30:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 -- 172.21.15.35:0/3709288500 learned_addr learned my addr 172.21.15.35:0/3709288500 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:30:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa277fe700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1418660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1419e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 -- 172.21.15.35:0/3709288500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 msgr2=0x5637f1418660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1418660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 -- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 msgr2=0x5637f1419e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.649+0000 7ffa267fc700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1419e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa267fc700 1 -- 172.21.15.35:0/3709288500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1002a040 con 0x5637f140ebe0 2023-03-17T10:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa277fe700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1418660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa267fc700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1418120 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7ffa18098d60 tx=0x7ffa180057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab71cbc6ca52e3b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:30:33.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3709288500 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18004ef0 con 0x5637f140ebe0 2023-03-17T10:30:34.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3709288500 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(239..239 src has 1..239) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ffa180a0ca0 con 0x5637f140ebe0 2023-03-17T10:30:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637f13d91e0 con 0x5637f140ebe0 2023-03-17T10:30:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3709288500 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa18099030 con 0x5637f140ebe0 2023-03-17T10:30:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 10 client.18930 fetch_fsmap learned FSMap version 45 2023-03-17T10:30:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5637f11b01f0 con 0x5637f140ebe0 2023-03-17T10:30:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3709288500 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa18080020 con 0x5637f140ebe0 2023-03-17T10:30:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3709288500 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ffa18094dc0 con 0x5637f140ebe0 2023-03-17T10:30:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 10 client.18930 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:30:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 10 client.18930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:30:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 20 client.18930 populate_metadata read hostname 'smithi035' 2023-03-17T10:30:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1479a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:30:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 4 client.18930 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:30:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.650+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5637f11dff00 con 0x5637f1422c90 2023-03-17T10:30:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.651+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1479a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:30:37.856 INFO:tasks.workunit.client.0.smithi035.stdout: 1 109639 2.49 MB/sec execute 105 sec latency 11.169 ms 2023-03-17T10:30:37.856 INFO:tasks.workunit.client.0.smithi035.stdout: 1 110076 2.51 MB/sec execute 106 sec latency 12.011 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 110380 2.50 MB/sec execute 107 sec latency 14.953 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 110665 2.48 MB/sec execute 108 sec latency 18.539 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 111165 2.48 MB/sec execute 109 sec latency 12.128 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 111649 2.48 MB/sec execute 110 sec latency 26.437 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 112206 2.46 MB/sec execute 111 sec latency 21.618 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 112757 2.49 MB/sec execute 112 sec latency 14.957 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 113324 2.50 MB/sec execute 113 sec latency 41.244 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 113795 2.51 MB/sec execute 114 sec latency 11.873 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 114042 2.49 MB/sec execute 115 sec latency 12.380 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 114475 2.48 MB/sec execute 116 sec latency 20.696 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 114996 2.50 MB/sec execute 117 sec latency 19.407 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 115459 2.48 MB/sec execute 118 sec latency 20.928 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 115976 2.47 MB/sec execute 119 sec latency 63.194 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 116714 2.50 MB/sec execute 120 sec latency 14.377 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 117108 2.52 MB/sec execute 121 sec latency 37.933 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 117458 2.51 MB/sec execute 122 sec latency 13.210 ms 2023-03-17T10:30:37.857 INFO:tasks.workunit.client.0.smithi035.stdout: 1 117711 2.49 MB/sec execute 123 sec latency 20.564 ms 2023-03-17T10:30:37.858 INFO:tasks.workunit.client.0.smithi035.stdout: 1 118245 2.48 MB/sec execute 124 sec latency 14.007 ms 2023-03-17T10:30:37.858 INFO:tasks.workunit.client.0.smithi035.stdout: 1 118739 2.49 MB/sec execute 125 sec latency 21.300 ms 2023-03-17T10:30:37.858 INFO:tasks.workunit.client.0.smithi035.stdout: 1 119290 2.47 MB/sec execute 126 sec latency 23.992 ms 2023-03-17T10:30:37.858 INFO:tasks.workunit.client.0.smithi035.stdout: 1 119690 2.47 MB/sec execute 127 sec latency 64.144 ms 2023-03-17T10:30:38.831 INFO:tasks.workunit.client.0.smithi035.stdout: 1 120386 2.50 MB/sec execute 128 sec latency 16.630 ms 2023-03-17T10:30:45.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 120761 2.51 MB/sec execute 129 sec latency 16.648 ms 2023-03-17T10:30:45.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 121029 2.50 MB/sec execute 130 sec latency 14.473 ms 2023-03-17T10:30:46.031 INFO:tasks.workunit.client.0.smithi035.stdout: 1 121326 2.48 MB/sec execute 131 sec latency 17.822 ms 2023-03-17T10:30:46.031 INFO:tasks.workunit.client.0.smithi035.stdout: 1 121813 2.48 MB/sec execute 132 sec latency 14.500 ms 2023-03-17T10:30:46.031 INFO:tasks.workunit.client.0.smithi035.stdout: 1 122301 2.48 MB/sec execute 133 sec latency 21.972 ms 2023-03-17T10:30:46.031 INFO:tasks.workunit.client.0.smithi035.stdout: 1 122926 2.48 MB/sec execute 134 sec latency 22.440 ms 2023-03-17T10:30:46.907 INFO:tasks.workunit.client.0.smithi035.stdout: 1 123394 2.49 MB/sec execute 135 sec latency 14.588 ms 2023-03-17T10:30:46.907 INFO:tasks.workunit.client.0.smithi035.stdout: 1 123962 2.50 MB/sec execute 136 sec latency 11.435 ms 2023-03-17T10:30:46.907 INFO:tasks.workunit.client.0.smithi035.stdout: 1 124431 2.51 MB/sec execute 137 sec latency 15.397 ms 2023-03-17T10:30:46.907 INFO:tasks.workunit.client.0.smithi035.stdout: 1 124679 2.49 MB/sec execute 138 sec latency 15.990 ms 2023-03-17T10:30:46.907 INFO:tasks.workunit.client.0.smithi035.stdout: 1 125103 2.48 MB/sec execute 139 sec latency 20.621 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 125617 2.50 MB/sec execute 140 sec latency 22.961 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 126096 2.48 MB/sec execute 141 sec latency 20.922 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 126635 2.47 MB/sec execute 142 sec latency 21.165 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 127380 2.50 MB/sec execute 143 sec latency 13.104 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 127815 2.51 MB/sec execute 144 sec latency 13.946 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 128121 2.51 MB/sec execute 145 sec latency 14.351 ms 2023-03-17T10:30:48.424 INFO:tasks.workunit.client.0.smithi035.stdout: 1 128410 2.49 MB/sec execute 146 sec latency 28.360 ms 2023-03-17T10:30:49.864 INFO:tasks.workunit.client.0.smithi035.stdout: 1 128910 2.49 MB/sec execute 147 sec latency 43.140 ms 2023-03-17T10:30:49.864 INFO:tasks.workunit.client.0.smithi035.stdout: 1 129395 2.49 MB/sec execute 148 sec latency 21.840 ms 2023-03-17T10:30:49.864 INFO:tasks.workunit.client.0.smithi035.stdout: 1 129987 2.48 MB/sec execute 149 sec latency 21.827 ms 2023-03-17T10:30:49.864 INFO:tasks.workunit.client.0.smithi035.stdout: 1 130598 2.50 MB/sec execute 150 sec latency 14.444 ms 2023-03-17T10:30:49.864 INFO:tasks.workunit.client.0.smithi035.stdout: 1 131060 2.50 MB/sec execute 151 sec latency 22.132 ms 2023-03-17T10:30:49.864 INFO:tasks.workunit.client.0.smithi035.stdout: 1 131537 2.51 MB/sec execute 152 sec latency 14.626 ms 2023-03-17T10:30:49.865 INFO:tasks.workunit.client.0.smithi035.stdout: 1 131788 2.50 MB/sec execute 153 sec latency 26.474 ms 2023-03-17T10:30:49.865 INFO:tasks.workunit.client.0.smithi035.stdout: 1 132189 2.49 MB/sec execute 154 sec latency 60.336 ms 2023-03-17T10:30:50.527 INFO:tasks.workunit.client.0.smithi035.stdout: 1 132705 2.50 MB/sec execute 155 sec latency 21.774 ms 2023-03-17T10:30:50.527 INFO:tasks.workunit.client.0.smithi035.stdout: 1 133180 2.49 MB/sec execute 156 sec latency 21.727 ms 2023-03-17T10:30:50.527 INFO:tasks.workunit.client.0.smithi035.stdout: 1 133713 2.48 MB/sec execute 157 sec latency 22.234 ms 2023-03-17T10:30:50.527 INFO:tasks.workunit.client.0.smithi035.stdout: 1 134299 2.50 MB/sec execute 158 sec latency 52.583 ms 2023-03-17T10:30:50.527 INFO:tasks.workunit.client.0.smithi035.stdout: 1 134805 2.52 MB/sec execute 159 sec latency 63.629 ms 2023-03-17T10:30:51.180 INFO:tasks.workunit.client.0.smithi035.stdout: 1 135163 2.51 MB/sec execute 160 sec latency 65.937 ms 2023-03-17T10:30:51.180 INFO:tasks.workunit.client.0.smithi035.stdout: 1 135429 2.49 MB/sec execute 161 sec latency 19.740 ms 2023-03-17T10:30:51.180 INFO:tasks.workunit.client.0.smithi035.stdout: 1 135944 2.49 MB/sec execute 162 sec latency 14.834 ms 2023-03-17T10:30:51.180 INFO:tasks.workunit.client.0.smithi035.stdout: 1 136441 2.50 MB/sec execute 163 sec latency 23.290 ms 2023-03-17T10:30:51.180 INFO:tasks.workunit.client.0.smithi035.stdout: 1 136999 2.48 MB/sec execute 164 sec latency 23.375 ms 2023-03-17T10:30:51.180 INFO:tasks.workunit.client.0.smithi035.stdout: 1 137537 2.50 MB/sec execute 165 sec latency 12.779 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 138137 2.51 MB/sec execute 166 sec latency 13.117 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 138601 2.52 MB/sec execute 167 sec latency 24.149 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 138841 2.50 MB/sec execute 168 sec latency 14.719 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 139240 2.49 MB/sec execute 169 sec latency 21.318 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 139777 2.50 MB/sec execute 170 sec latency 21.734 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 140231 2.49 MB/sec execute 171 sec latency 22.833 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 140781 2.49 MB/sec execute 172 sec latency 21.829 ms 2023-03-17T10:30:51.793 INFO:tasks.workunit.client.0.smithi035.stdout: 1 141389 2.50 MB/sec execute 173 sec latency 11.742 ms 2023-03-17T10:30:53.249 INFO:tasks.workunit.client.0.smithi035.stdout: 1 141912 2.52 MB/sec execute 174 sec latency 19.491 ms 2023-03-17T10:30:53.249 INFO:tasks.workunit.client.0.smithi035.stdout: 1 142269 2.51 MB/sec execute 175 sec latency 14.160 ms 2023-03-17T10:30:53.249 INFO:tasks.workunit.client.0.smithi035.stdout: 1 142530 2.50 MB/sec execute 176 sec latency 17.127 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 143066 2.50 MB/sec execute 177 sec latency 12.808 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 143536 2.50 MB/sec execute 178 sec latency 21.934 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 144096 2.49 MB/sec execute 179 sec latency 22.078 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 144531 2.49 MB/sec execute 180 sec latency 17.253 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 145224 2.51 MB/sec execute 181 sec latency 28.338 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 145685 2.52 MB/sec execute 182 sec latency 15.198 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 145930 2.51 MB/sec execute 183 sec latency 13.283 ms 2023-03-17T10:30:54.057 INFO:tasks.workunit.client.0.smithi035.stdout: 1 146323 2.50 MB/sec execute 184 sec latency 66.979 ms 2023-03-17T10:30:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.651+0000 7ffa26ffd700 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1479a60 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e76c86c9ee5c13e9 server_cookie=dfe6561396a493f0 in_seq=0 out_seq=0 2023-03-17T10:30:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.651+0000 7ffa06ffd700 10 client.18930 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:30:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa06ffd700 1 -- 172.21.15.35:0/3709288500 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5637f11dff00 con 0x5637f1422c90 2023-03-17T10:30:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa06ffd700 10 client.18930 handle_command_reply: tid=0 2023-03-17T10:30:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 client.18930 shutdown 2023-03-17T10:30:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 msgr2=0x5637f1418120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1418120 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7ffa18098d60 tx=0x7ffa180057a0 comp rx=0 tx=0).stop 2023-03-17T10:30:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 shutdown_connections 2023-03-17T10:30:54.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5637f1422c90 0x5637f1479a60 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f140f4f0 0x5637f1418660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa06ffd700 0 client.18930 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5637f1409960 0x5637f1419e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 --2- 172.21.15.35:0/3709288500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5637f140ebe0 0x5637f1418120 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.659+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 >> 172.21.15.35:0/3709288500 conn(0x5637f12666b0 msgr2=0x5637f140f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 shutdown_connections 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa39a39b80 1 -- 172.21.15.35:0/3709288500 wait complete. 2023-03-17T10:30:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa39a39b80 20 client.18930 trim_cache size 0 max 16384 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa1409f640 msgr2=0x7ffa140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa1409f640 0x7ffa140a1af0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009c60 tx=0x7ffa10009260 comp rx=0 tx=0).stop 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 msgr2=0x7ffa281967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa281967d0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c00 tx=0x7ffa1800f690 comp rx=0 tx=0).stop 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 shutdown_connections 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffa1409f640 0x7ffa140a1af0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa28104390 0x7ffa2819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa280ff350 0x7ffa28196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 --2- 172.21.15.35:0/2091031871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffa280ffcf0 0x7ffa281967d0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 >> 172.21.15.35:0/2091031871 conn(0x7ffa28076330 msgr2=0x7ffa280680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 shutdown_connections 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:14.660+0000 7ffa2d8ac700 1 -- 172.21.15.35:0/2091031871 wait complete. 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 -- 172.21.15.35:0/3608772747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270105530 msgr2=0x7f627010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:30:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 --2- 172.21.15.35:0/3608772747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270105530 0x7f627010d100 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f62600099c0 tx=0x7f6260009cd0 comp rx=0 tx=0).stop 2023-03-17T10:30:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 -- 172.21.15.35:0/3608772747 shutdown_connections 2023-03-17T10:30:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 --2- 172.21.15.35:0/3608772747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270105530 0x7f627010d100 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 --2- 172.21.15.35:0/3608772747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 0x7f62701008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:30:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 --2- 172.21.15.35:0/3608772747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100e90 0x7f6270104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.782+0000 7f627731f700 1 -- 172.21.15.35:0/3608772747 >> 172.21.15.35:0/3608772747 conn(0x7f6270078170 msgr2=0x7f6270078570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 -- 172.21.15.35:0/3608772747 shutdown_connections 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 -- 172.21.15.35:0/3608772747 wait complete. 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 Processor -- start 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 -- start start 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 0x7f6270196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 0x7f6270196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:01.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270105530 0x7f627019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:01.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627019b210 con 0x7f6270100e90 2023-03-17T10:31:01.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627019b380 con 0x7f62701004f0 2023-03-17T10:31:01.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.783+0000 7f627731f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627019b540 con 0x7f6270105530 2023-03-17T10:31:01.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 0x7f6270196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:01.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 0x7f6270196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50768/0 (socket says 172.21.15.35:50768) 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 -- 172.21.15.35:0/4206435486 learned_addr learned my addr 172.21.15.35:0/4206435486 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62758bc700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270105530 0x7f627019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62750bb700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 0x7f6270196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 -- 172.21.15.35:0/4206435486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270105530 msgr2=0x7f627019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270105530 0x7f627019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 -- 172.21.15.35:0/4206435486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 msgr2=0x7f6270196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 0x7f6270196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 -- 172.21.15.35:0/4206435486 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600095f0 con 0x7f6270100e90 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62750bb700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 0x7f6270196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62758bc700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270105530 0x7f627019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:31:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f62748ba700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 0x7f6270196770 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f626400d950 tx=0x7f626400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:02.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f626e7fc700 1 -- 172.21.15.35:0/4206435486 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264009b40 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f626e7fc700 1 -- 172.21.15.35:0/4206435486 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626400de30 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6270110200 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f626e7fc700 1 -- 172.21.15.35:0/4206435486 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400f620 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.784+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6270110070 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.786+0000 7f626e7fc700 1 -- 172.21.15.35:0/4206435486 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6264010460 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.787+0000 7f626e7fc700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f625809f640 0x7f62580a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.787+0000 7f62750bb700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f625809f640 0x7f62580a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.787+0000 7f626e7fc700 1 -- 172.21.15.35:0/4206435486 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f62640ca1f0 con 0x7f6270100e90 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62750bb700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f625809f640 0x7f62580a1af0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62680094f0 tx=0x7f6268009040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 Processor -- start 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 -- start start 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 0x55a45b54ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b5504f0 0x55a45b54a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b54ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b451010 con 0x55a45b54fbe0 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b4a3950 con 0x55a45b54a960 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.788+0000 7f62834acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b49cde0 con 0x55a45b5504f0 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 0x55a45b54ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 0x55a45b54ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50774/0 (socket says 172.21.15.35:50774) 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 -- 172.21.15.35:0/2919946505 learned_addr learned my addr 172.21.15.35:0/2919946505 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62748ba700 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b5504f0 0x55a45b54a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62758bc700 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b54ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 -- 172.21.15.35:0/2919946505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b5504f0 msgr2=0x55a45b54a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b5504f0 0x55a45b54a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 -- 172.21.15.35:0/2919946505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 msgr2=0x55a45b54ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b54ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 -- 172.21.15.35:0/2919946505 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a45b31e5d0 con 0x55a45b54fbe0 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62750bb700 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 0x55a45b54ffb0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6268018540 tx=0x7f6268011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fb0d910a873b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62577fe700 1 -- 172.21.15.35:0/2919946505 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626801d070 con 0x55a45b54fbe0 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62577fe700 1 -- 172.21.15.35:0/2919946505 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62680180d0 con 0x55a45b54fbe0 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.789+0000 7f62577fe700 1 -- 172.21.15.35:0/2919946505 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268016ea0 con 0x55a45b54fbe0 2023-03-17T10:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 -- 172.21.15.35:0/2919946505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 msgr2=0x55a45b54ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 0x55a45b54ffb0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f6268018540 tx=0x7f6268011000 comp rx=0 tx=0).stop 2023-03-17T10:31:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 -- 172.21.15.35:0/2919946505 shutdown_connections 2023-03-17T10:31:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b54ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b54fbe0 0x55a45b54ffb0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 --2- 172.21.15.35:0/2919946505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b5504f0 0x55a45b54a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 -- 172.21.15.35:0/2919946505 >> 172.21.15.35:0/2919946505 conn(0x55a45b3a76b0 msgr2=0x55a45b544a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 -- 172.21.15.35:0/2919946505 shutdown_connections 2023-03-17T10:31:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 -- 172.21.15.35:0/2919946505 wait complete. 2023-03-17T10:31:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.790+0000 7f62834acb80 1 -- start start 2023-03-17T10:31:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 Processor -- start 2023-03-17T10:31:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54a960 0x55a45b556560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54fbe0 0x55a45b553770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b553eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b3208c0 con 0x55a45b5504f0 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b5545f0 con 0x55a45b54fbe0 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b560030 con 0x55a45b54a960 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62834acb80 10 client.0 _ll_register_callbacks cb 0x55a45b342230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62758bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b553eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62750bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54a960 0x55a45b556560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62748ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54fbe0 0x55a45b553770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62758bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b553eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50784/0 (socket says 172.21.15.35:50784) 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 -- 172.21.15.35:0/2939274555 learned_addr learned my addr 172.21.15.35:0/2939274555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.791+0000 7f62750bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54a960 0x55a45b556560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:42546/0 (socket says 172.21.15.35:42546) 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 -- 172.21.15.35:0/2939274555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54a960 msgr2=0x55a45b556560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54a960 0x55a45b556560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 -- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54fbe0 msgr2=0x55a45b553770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54fbe0 0x55a45b553770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:08.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 -- 172.21.15.35:0/2939274555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6268007de0 con 0x55a45b5504f0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62758bc700 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b553eb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f62600099c0 tx=0x7f6260005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa43fa7120f3a28 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f6254ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f6254ff9700 1 -- 172.21.15.35:0/2939274555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000bba0 con 0x55a45b5504f0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f6254ff9700 1 -- 172.21.15.35:0/2939274555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f626000bd00 con 0x55a45b5504f0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a45b45f390 con 0x55a45b5504f0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f6254ff9700 1 -- 172.21.15.35:0/2939274555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f626000bec0 con 0x55a45b5504f0 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62834acb80 10 client.18942 fetch_fsmap learned FSMap version 45 2023-03-17T10:31:08.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.792+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a45b2cad80 con 0x55a45b5504f0 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f6254ff9700 1 -- 172.21.15.35:0/2939274555 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a45b45f390 con 0x55a45b5504f0 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f6254ff9700 1 -- 172.21.15.35:0/2939274555 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6260003920 con 0x55a45b5504f0 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62834acb80 10 client.18942 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62834acb80 10 client.18942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62834acb80 20 client.18942 populate_metadata read hostname 'smithi035' 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62834acb80 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b564200 0x55a45b566610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62834acb80 4 client.18942 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a45b46b600 con 0x55a45b564200 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.793+0000 7f62750bb700 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b564200 0x55a45b566610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:08.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.794+0000 7f6254ff9700 10 client.18942 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.794+0000 7f62750bb700 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b564200 0x55a45b566610 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c63bbef45fff6a5b server_cookie=a124d1686bcf728b in_seq=0 out_seq=0 2023-03-17T10:31:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.794+0000 7f6254ff9700 1 -- 172.21.15.35:0/2939274555 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a45b46b600 con 0x55a45b564200 2023-03-17T10:31:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.794+0000 7f6254ff9700 10 client.18942 handle_command_reply: tid=0 2023-03-17T10:31:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.794+0000 7f62834acb80 1 client.18942 shutdown 2023-03-17T10:31:12.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 msgr2=0x55a45b553eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b553eb0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f62600099c0 tx=0x7f6260005750 comp rx=0 tx=0).stop 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 shutdown_connections 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b564200 0x55a45b566610 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b553eb0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f6254ff9700 0 client.18942 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54a960 0x55a45b556560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 --2- 172.21.15.35:0/2939274555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54fbe0 0x55a45b553770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 >> 172.21.15.35:0/2939274555 conn(0x55a45b3a76b0 msgr2=0x55a45b549410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 shutdown_connections 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 1 -- 172.21.15.35:0/2939274555 wait complete. 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.795+0000 7f62834acb80 20 client.18942 trim_cache size 0 max 16384 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 Processor -- start 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 -- start start 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b544ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b55af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b556090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b5400d0 con 0x55a45b5504f0 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b5455d0 con 0x55a45b54a960 2023-03-17T10:31:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.810+0000 7f62834acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b546570 con 0x55a45b54fbe0 2023-03-17T10:31:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b556090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:12.945 INFO:tasks.workunit.client.0.smithi035.stdout: 1 146847 2.51 MB/sec execute 185 sec latency 21.669 ms 2023-03-17T10:31:13.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:35 smithi035 ceph-mon[92535]: pgmap v3058: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.4 MiB/s wr, 118 op/s 2023-03-17T10:31:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b556090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50792/0 (socket says 172.21.15.35:50792) 2023-03-17T10:31:16.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 -- 172.21.15.35:0/3375765702 learned_addr learned my addr 172.21.15.35:0/3375765702 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62748ba700 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b55af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62750bb700 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b544ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:18.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 -- 172.21.15.35:0/3375765702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 msgr2=0x55a45b55af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:18.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b55af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:18.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 -- 172.21.15.35:0/3375765702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 msgr2=0x55a45b544ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:18.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b544ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 -- 172.21.15.35:0/3375765702 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a45b463130 con 0x55a45b5504f0 2023-03-17T10:31:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62750bb700 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b544ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:31:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f62758bc700 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b556090 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f6260005f50 tx=0x7f6260009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fb8d53bc0b3fc6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f6257fff700 1 -- 172.21.15.35:0/3375765702 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260004230 con 0x55a45b5504f0 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f6257fff700 1 -- 172.21.15.35:0/3375765702 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626001e050 con 0x55a45b5504f0 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.811+0000 7f6257fff700 1 -- 172.21.15.35:0/3375765702 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600047f0 con 0x55a45b5504f0 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 -- 172.21.15.35:0/3375765702 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 msgr2=0x55a45b556090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b556090 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f6260005f50 tx=0x7f6260009cd0 comp rx=0 tx=0).stop 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 -- 172.21.15.35:0/3375765702 shutdown_connections 2023-03-17T10:31:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b556090 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b544ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 --2- 172.21.15.35:0/3375765702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b55af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 -- 172.21.15.35:0/3375765702 >> 172.21.15.35:0/3375765702 conn(0x55a45b3a76b0 msgr2=0x55a45b55f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 -- 172.21.15.35:0/3375765702 shutdown_connections 2023-03-17T10:31:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 -- 172.21.15.35:0/3375765702 wait complete. 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 -- start start 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.812+0000 7f62834acb80 1 Processor -- start 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b558f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b559470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b5b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b559d50 con 0x55a45b5504f0 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b5b75e0 con 0x55a45b54a960 2023-03-17T10:31:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a45b5b7720 con 0x55a45b54fbe0 2023-03-17T10:31:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62834acb80 10 client.0 _ll_register_callbacks cb 0x55a45b342230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:31:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b5b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b5b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50798/0 (socket says 172.21.15.35:50798) 2023-03-17T10:31:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 -- 172.21.15.35:0/4063535635 learned_addr learned my addr 172.21.15.35:0/4063535635 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62750bb700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b558f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62748ba700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b559470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:29.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 -- 172.21.15.35:0/4063535635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 msgr2=0x55a45b559470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b559470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:29.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 -- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 msgr2=0x55a45b558f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b558f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.813+0000 7f62758bc700 1 -- 172.21.15.35:0/4063535635 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a45b2cad80 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62758bc700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b5b70a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f62600099c0 tx=0x7f6260004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a7353e7c96b53b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f6254ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f6254ff9700 1 -- 172.21.15.35:0/4063535635 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000bdb0 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a45b51a1e0 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f6254ff9700 1 -- 172.21.15.35:0/4063535635 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6260000e40 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f6254ff9700 1 -- 172.21.15.35:0/4063535635 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6260004500 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 10 client.18948 fetch_fsmap learned FSMap version 45 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a45b2f11f0 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f6254ff9700 1 -- 172.21.15.35:0/4063535635 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a45b51a1e0 con 0x55a45b5504f0 2023-03-17T10:31:29.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f6254ff9700 1 -- 172.21.15.35:0/4063535635 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f626000f4f0 con 0x55a45b5504f0 2023-03-17T10:31:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 10 client.18948 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:31:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 10 client.18948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:31:29.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 20 client.18948 populate_metadata read hostname 'smithi035' 2023-03-17T10:31:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b5b8880 0x55a45b5bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 4 client.18948 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:31:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.814+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a45b320f00 con 0x55a45b5b8880 2023-03-17T10:31:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.815+0000 7f62750bb700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b5b8880 0x55a45b5bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.815+0000 7f6254ff9700 10 client.18948 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:32.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.815+0000 7f62750bb700 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b5b8880 0x55a45b5bac60 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4e16baf0348f47 server_cookie=c2e0edd5eebc5899 in_seq=0 out_seq=0 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f6254ff9700 1 -- 172.21.15.35:0/4063535635 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a45b320f00 con 0x55a45b5b8880 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f6254ff9700 10 client.18948 handle_command_reply: tid=0 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 client.18948 shutdown 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 msgr2=0x55a45b5b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b5b70a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f62600099c0 tx=0x7f6260004230 comp rx=0 tx=0).stop 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 shutdown_connections 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a45b5b8880 0x55a45b5bac60 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a45b5504f0 0x55a45b5b70a0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a45b54a960 0x55a45b558f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f6254ff9700 0 client.18948 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 --2- 172.21.15.35:0/4063535635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a45b54fbe0 0x55a45b559470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 >> 172.21.15.35:0/4063535635 conn(0x55a45b3a76b0 msgr2=0x55a45b552fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 shutdown_connections 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 1 -- 172.21.15.35:0/4063535635 wait complete. 2023-03-17T10:31:32.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.820+0000 7f62834acb80 20 client.18948 trim_cache size 0 max 16384 2023-03-17T10:31:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f625809f640 msgr2=0x7f62580a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f625809f640 0x7f62580a1af0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62680094f0 tx=0x7f6268009040 comp rx=0 tx=0).stop 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 msgr2=0x7f6270196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 0x7f6270196770 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f626400d950 tx=0x7f626400dd10 comp rx=0 tx=0).stop 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 shutdown_connections 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f625809f640 0x7f62580a1af0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270105530 0x7f627019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62701004f0 0x7f6270196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 --2- 172.21.15.35:0/4206435486 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6270100e90 0x7f6270196770 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 >> 172.21.15.35:0/4206435486 conn(0x7f6270078170 msgr2=0x7f62700fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 shutdown_connections 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:27.821+0000 7f627731f700 1 -- 172.21.15.35:0/4206435486 wait complete. 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 -- 172.21.15.35:0/1115553282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f4104390 msgr2=0x7f50f410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 --2- 172.21.15.35:0/1115553282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f4104390 0x7f50f410bf60 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00b0d0 tx=0x7f50ec00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 -- 172.21.15.35:0/1115553282 shutdown_connections 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 --2- 172.21.15.35:0/1115553282 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f4104390 0x7f50f410bf60 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 --2- 172.21.15.35:0/1115553282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 0x7f50f40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 --2- 172.21.15.35:0/1115553282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f40ffcf0 0x7f50f4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 -- 172.21.15.35:0/1115553282 >> 172.21.15.35:0/1115553282 conn(0x7f50f4076330 msgr2=0x7f50f4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 -- 172.21.15.35:0/1115553282 shutdown_connections 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.944+0000 7f50fb949700 1 -- 172.21.15.35:0/1115553282 wait complete. 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 Processor -- start 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 -- start start 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 0x7f50f4100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 0x7f50f4101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4104390 0x7f50f41a4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4101ac0 con 0x7f50f40ffcf0 2023-03-17T10:31:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41a4a90 con 0x7f50f40ff350 2023-03-17T10:31:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50fb949700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41a4bd0 con 0x7f50f4104390 2023-03-17T10:31:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 0x7f50f4101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 0x7f50f4101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50810/0 (socket says 172.21.15.35:50810) 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 -- 172.21.15.35:0/629878756 learned_addr learned my addr 172.21.15.35:0/629878756 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f96e5700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 0x7f50f4100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4104390 0x7f50f41a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 -- 172.21.15.35:0/629878756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4104390 msgr2=0x7f50f41a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4104390 0x7f50f41a4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 -- 172.21.15.35:0/629878756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 msgr2=0x7f50f4100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:37.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 0x7f50f4100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 -- 172.21.15.35:0/629878756 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009d00 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f96e5700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 0x7f50f4100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4104390 0x7f50f41a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.945+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 0x7f50f4101290 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f50e400e940 tx=0x7f50e400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.946+0000 7f50ea7fc700 1 -- 172.21.15.35:0/629878756 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4009730 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.946+0000 7f50ea7fc700 1 -- 172.21.15.35:0/629878756 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50e400cbd0 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.946+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f410efc0 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.946+0000 7f50ea7fc700 1 -- 172.21.15.35:0/629878756 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4018680 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.946+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f410ee30 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.948+0000 7f50ea7fc700 1 -- 172.21.15.35:0/629878756 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f50e400cd40 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.948+0000 7f50ea7fc700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50e009f6c0 0x7f50e00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.949+0000 7f50ea7fc700 1 -- 172.21.15.35:0/629878756 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50e4014070 con 0x7f50f40ffcf0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.949+0000 7f50f96e5700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50e009f6c0 0x7f50e00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.949+0000 7f50f96e5700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50e009f6c0 0x7f50e00a1b70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009be0 tx=0x7f50f0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 Processor -- start 2023-03-17T10:31:37.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 -- start start 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 0x56238177cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177d4f0 0x562381777420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562381777960 0x562381777d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56238167e010 con 0x56238177cbe0 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623816d0950 con 0x562381777960 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623816c9de0 con 0x56238177d4f0 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 0x56238177cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 0x56238177cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50816/0 (socket says 172.21.15.35:50816) 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f50f96e5700 1 -- 172.21.15.35:0/754460680 learned_addr learned my addr 172.21.15.35:0/754460680 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177d4f0 0x562381777420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.950+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562381777960 0x562381777d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f96e5700 1 -- 172.21.15.35:0/754460680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177d4f0 msgr2=0x562381777420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f96e5700 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177d4f0 0x562381777420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f96e5700 1 -- 172.21.15.35:0/754460680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562381777960 msgr2=0x562381777d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f96e5700 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562381777960 0x562381777d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f96e5700 1 -- 172.21.15.35:0/754460680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56238154b5d0 con 0x56238177cbe0 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177d4f0 0x562381777420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:31:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50f96e5700 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 0x56238177cfb0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f50f0010d00 tx=0x7f50f0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb4635a98fdc27c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50df7fe700 1 -- 172.21.15.35:0/754460680 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0012ab0 con 0x56238177cbe0 2023-03-17T10:31:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50df7fe700 1 -- 172.21.15.35:0/754460680 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50f0012c10 con 0x56238177cbe0 2023-03-17T10:31:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.951+0000 7f50df7fe700 1 -- 172.21.15.35:0/754460680 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f001e610 con 0x56238177cbe0 2023-03-17T10:31:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 -- 172.21.15.35:0/754460680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 msgr2=0x56238177cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 0x56238177cfb0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f50f0010d00 tx=0x7f50f0013000 comp rx=0 tx=0).stop 2023-03-17T10:31:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 -- 172.21.15.35:0/754460680 shutdown_connections 2023-03-17T10:31:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562381777960 0x562381777d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56238177cbe0 0x56238177cfb0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/754460680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177d4f0 0x562381777420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 -- 172.21.15.35:0/754460680 >> 172.21.15.35:0/754460680 conn(0x5623815d46b0 msgr2=0x562381771a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 -- 172.21.15.35:0/754460680 shutdown_connections 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 -- 172.21.15.35:0/754460680 wait complete. 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 -- start start 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.952+0000 7f5107ad6b80 1 Processor -- start 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817833c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381780640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381780be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56238154d8c0 con 0x562381777960 2023-03-17T10:31:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562381781350 con 0x56238177d4f0 2023-03-17T10:31:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562381781510 con 0x56238177cbe0 2023-03-17T10:31:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f5107ad6b80 10 client.0 _ll_register_callbacks cb 0x56238156f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:31:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817833c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817833c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50822/0 (socket says 172.21.15.35:50822) 2023-03-17T10:31:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 -- 172.21.15.35:0/3988419442 learned_addr learned my addr 172.21.15.35:0/3988419442 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381780640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381780be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 -- 172.21.15.35:0/3988419442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 msgr2=0x562381780640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381780640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 -- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 msgr2=0x562381780be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381780be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.953+0000 7f50f96e5700 1 -- 172.21.15.35:0/3988419442 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f00109b0 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381780be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50f96e5700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817833c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f50f0010950 tx=0x7f50f0012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f340387d2d7c16c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50dcff9700 1 -- 172.21.15.35:0/3988419442 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f002f070 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50dcff9700 1 -- 172.21.15.35:0/3988419442 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50f0012e40 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56238168c390 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50dcff9700 1 -- 172.21.15.35:0/3988419442 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50f0005040 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 10 client.18960 fetch_fsmap learned FSMap version 45 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5623814f7d80 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50dcff9700 1 -- 172.21.15.35:0/3988419442 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56238168c390 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f50dcff9700 1 -- 172.21.15.35:0/3988419442 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f50f00036a0 con 0x562381777960 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 10 client.18960 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 10 client.18960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 20 client.18960 populate_metadata read hostname 'smithi035' 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562381790ee0 0x5623817932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 4 client.18960 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:31:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.954+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562381698600 con 0x562381790ee0 2023-03-17T10:31:42.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.955+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562381790ee0 0x5623817932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.955+0000 7f50dcff9700 10 client.18960 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.955+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562381790ee0 0x5623817932f0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a738c2ee622adb83 server_cookie=1aea4357282d9b0e in_seq=0 out_seq=0 2023-03-17T10:31:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f50dcff9700 1 -- 172.21.15.35:0/3988419442 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562381698600 con 0x562381790ee0 2023-03-17T10:31:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f50dcff9700 10 client.18960 handle_command_reply: tid=0 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 client.18960 shutdown 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 msgr2=0x5623817833c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817833c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f50f0010950 tx=0x7f50f0012960 comp rx=0 tx=0).stop 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 shutdown_connections 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562381790ee0 0x5623817932f0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381780be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f50dcff9700 0 client.18960 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817833c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/3988419442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381780640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 >> 172.21.15.35:0/3988419442 conn(0x5623815d46b0 msgr2=0x562381776410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 shutdown_connections 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 1 -- 172.21.15.35:0/3988419442 wait complete. 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.956+0000 7f5107ad6b80 20 client.18960 trim_cache size 0 max 16384 2023-03-17T10:31:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 Processor -- start 2023-03-17T10:31:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 -- start start 2023-03-17T10:31:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x56238177e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381787f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381782f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56238176d0f0 con 0x562381777960 2023-03-17T10:31:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562381781780 con 0x56238177d4f0 2023-03-17T10:31:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.971+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562381781c50 con 0x56238177cbe0 2023-03-17T10:31:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x56238177e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x56238177e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50830/0 (socket says 172.21.15.35:50830) 2023-03-17T10:31:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 -- 172.21.15.35:0/546596168 learned_addr learned my addr 172.21.15.35:0/546596168 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381787f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381782f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 -- 172.21.15.35:0/546596168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 msgr2=0x562381787f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381787f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 -- 172.21.15.35:0/546596168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 msgr2=0x562381782f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381782f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 -- 172.21.15.35:0/546596168 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562381690130 con 0x562381777960 2023-03-17T10:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50f96e5700 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x56238177e0a0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f50f00099c0 tx=0x7f50f0009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89d5a128296df1e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50dffff700 1 -- 172.21.15.35:0/546596168 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f002f020 con 0x562381777960 2023-03-17T10:31:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50dffff700 1 -- 172.21.15.35:0/546596168 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50f0003c40 con 0x562381777960 2023-03-17T10:31:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.972+0000 7f50dffff700 1 -- 172.21.15.35:0/546596168 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00287c0 con 0x562381777960 2023-03-17T10:31:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 -- 172.21.15.35:0/546596168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 msgr2=0x56238177e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x56238177e0a0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f50f00099c0 tx=0x7f50f0009950 comp rx=0 tx=0).stop 2023-03-17T10:31:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 -- 172.21.15.35:0/546596168 shutdown_connections 2023-03-17T10:31:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381782f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x56238177e0a0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/546596168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x562381787f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 -- 172.21.15.35:0/546596168 >> 172.21.15.35:0/546596168 conn(0x5623815d46b0 msgr2=0x56238177d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 -- 172.21.15.35:0/546596168 shutdown_connections 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 -- 172.21.15.35:0/546596168 wait complete. 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 -- start start 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.973+0000 7f5107ad6b80 1 Processor -- start 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817de020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x5623817de560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381785f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562381786470 con 0x562381777960 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623817865b0 con 0x56238177d4f0 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562381786770 con 0x56238177cbe0 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f5107ad6b80 10 client.0 _ll_register_callbacks cb 0x56238156f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:31:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817de020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50836/0 (socket says 172.21.15.35:50836) 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 -- 172.21.15.35:0/211695892 learned_addr learned my addr 172.21.15.35:0/211695892 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f9ee6700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381785f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x5623817de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 -- 172.21.15.35:0/211695892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 msgr2=0x5623817de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x5623817de560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 -- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 msgr2=0x562381785f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:31:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381785f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 -- 172.21.15.35:0/211695892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623814f7d80 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x5623817de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50f96e5700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817de020 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009310 tx=0x7f50f00038d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14208f567ac308cd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.974+0000 7f50dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f50dcff9700 1 -- 172.21.15.35:0/211695892 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f002f030 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f50dcff9700 1 -- 172.21.15.35:0/211695892 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50f0012e40 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623817471e0 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f50dcff9700 1 -- 172.21.15.35:0/211695892 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50f0005540 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 10 client.18966 fetch_fsmap learned FSMap version 45 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x56238151e1f0 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f50dcff9700 1 -- 172.21.15.35:0/211695892 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623817471e0 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f50dcff9700 1 -- 172.21.15.35:0/211695892 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f50f00468d0 con 0x562381777960 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 10 client.18966 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 10 client.18966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 20 client.18966 populate_metadata read hostname 'smithi035' 2023-03-17T10:31:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623817e58c0 0x5623817e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 4 client.18966 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:31:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56238154df00 con 0x5623817e58c0 2023-03-17T10:31:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.975+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623817e58c0 0x5623817e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:31:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.976+0000 7f50dcff9700 10 client.18966 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.976+0000 7f50f8ee4700 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623817e58c0 0x5623817e7ca0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492b49afcd396ce1 server_cookie=5c7d4ff05c22927d in_seq=0 out_seq=0 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.980+0000 7f50dcff9700 1 -- 172.21.15.35:0/211695892 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56238154df00 con 0x5623817e58c0 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.980+0000 7f50dcff9700 10 client.18966 handle_command_reply: tid=0 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.980+0000 7f5107ad6b80 1 client.18966 shutdown 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.980+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 msgr2=0x5623817de020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.980+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817de020 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009310 tx=0x7f50f00038d0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 shutdown_connections 2023-03-17T10:31:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623817e58c0 0x5623817e7ca0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56238177d4f0 0x562381785f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50dcff9700 0 client.18966 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562381777960 0x5623817de020 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 --2- 172.21.15.35:0/211695892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56238177cbe0 0x5623817de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 >> 172.21.15.35:0/211695892 conn(0x5623815d46b0 msgr2=0x562381776410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 shutdown_connections 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 1 -- 172.21.15.35:0/211695892 wait complete. 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f5107ad6b80 20 client.18966 trim_cache size 0 max 16384 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50e009f6c0 msgr2=0x7f50e00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50e009f6c0 0x7f50e00a1b70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009be0 tx=0x7f50f0009260 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 msgr2=0x7f50f4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 0x7f50f4101290 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f50e400e940 tx=0x7f50e400ed00 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 shutdown_connections 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50e009f6c0 0x7f50e00a1b70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4104390 0x7f50f41a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50f40ff350 0x7f50f4100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 --2- 172.21.15.35:0/629878756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50f40ffcf0 0x7f50f4101290 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 >> 172.21.15.35:0/629878756 conn(0x7f50f4076330 msgr2=0x7f50f4068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.981+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 shutdown_connections 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:40.982+0000 7f50fb949700 1 -- 172.21.15.35:0/629878756 wait complete. 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 -- 172.21.15.35:0/3444529420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c1054f0 msgr2=0x7efd1c10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 --2- 172.21.15.35:0/3444529420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c1054f0 0x7efd1c10d100 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7efd1400b0d0 tx=0x7efd1400b3e0 comp rx=0 tx=0).stop 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 -- 172.21.15.35:0/3444529420 shutdown_connections 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 --2- 172.21.15.35:0/3444529420 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c1054f0 0x7efd1c10d100 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 --2- 172.21.15.35:0/3444529420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c100be0 0x7efd1c100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 --2- 172.21.15.35:0/3444529420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c101580 0x7efd1c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:31:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 -- 172.21.15.35:0/3444529420 >> 172.21.15.35:0/3444529420 conn(0x7efd1c0774e0 msgr2=0x7efd1c0778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:31:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 -- 172.21.15.35:0/3444529420 shutdown_connections 2023-03-17T10:31:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 -- 172.21.15.35:0/3444529420 wait complete. 2023-03-17T10:31:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 Processor -- start 2023-03-17T10:31:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.103+0000 7efd233e8700 1 -- start start 2023-03-17T10:31:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 0x7efd1c196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c101580 0x7efd1c196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c1054f0 0x7efd1c19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:31:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c19b320 con 0x7efd1c100be0 2023-03-17T10:31:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c19b490 con 0x7efd1c101580 2023-03-17T10:31:56.493 INFO:tasks.workunit.client.0.smithi035.stdout: 1 147309 2.50 MB/sec execute 186 sec latency 22.739 ms 2023-03-17T10:31:57.339 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:37 smithi035 ceph-mon[92535]: pgmap v3059: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.4 MiB/s wr, 118 op/s 2023-03-17T10:31:57.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:39 smithi035 ceph-mon[92535]: pgmap v3060: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.9 MiB/s wr, 176 op/s 2023-03-17T10:31:57.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:41 smithi035 ceph-mon[92535]: pgmap v3061: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2023-03-17T10:31:57.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:31:57.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:31:57.883 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:31:57.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:31:57.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:42 smithi035 ceph-mon[92535]: pgmap v3062: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2023-03-17T10:31:57.884 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:42 smithi035 ceph-mon[92535]: pgmap v3063: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 675 KiB/s wr, 79 op/s 2023-03-17T10:31:59.435 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:44 smithi035 ceph-mon[92535]: pgmap v3064: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:46 smithi035 ceph-mon[92535]: pgmap v3065: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:47 smithi035 ceph-mon[92535]: pgmap v3066: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.7 MiB/s wr, 154 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:50 smithi035 ceph-mon[92535]: pgmap v3067: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.9 MiB/s wr, 157 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:52 smithi035 ceph-mon[92535]: pgmap v3068: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.7 MiB/s wr, 139 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:54 smithi035 ceph-mon[92535]: pgmap v3069: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 1.9 MiB/s wr, 176 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:56 smithi035 ceph-mon[92535]: pgmap v3070: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 115 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:19:57 smithi035 ceph-mon[92535]: pgmap v3071: 97 pgs: 97 active+clean; 100 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.7 MiB/s wr, 176 op/s 2023-03-17T10:31:59.436 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:00 smithi035 ceph-mon[92535]: pgmap v3072: 97 pgs: 97 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.4 MiB/s wr, 123 op/s 2023-03-17T10:31:59.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T10:31:59.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:02 smithi035 ceph-mon[92535]: pgmap v3073: 97 pgs: 97 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T10:31:59.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:04 smithi035 ceph-mon[92535]: pgmap v3074: 97 pgs: 97 active+clean; 104 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.9 MiB/s wr, 190 op/s 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:05 smithi035 ceph-mon[92535]: osdmap e267: 12 total, 12 up, 12 in 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:06 smithi035 ceph-mon[92535]: pgmap v3076: 97 pgs: 97 active+clean; 104 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:07 smithi035 ceph-mon[92535]: pgmap v3077: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:10 smithi035 ceph-mon[92535]: pgmap v3078: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.5 MiB/s wr, 152 op/s 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:12 smithi035 ceph-mon[92535]: pgmap v3079: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.5 MiB/s wr, 152 op/s 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:12 smithi035 ceph-mon[92535]: osdmap e268: 12 total, 12 up, 12 in 2023-03-17T10:32:00.982 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:14 smithi035 ceph-mon[92535]: pgmap v3081: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-03-17T10:32:00.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:16 smithi035 ceph-mon[92535]: pgmap v3082: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 1.5 MiB/s wr, 143 op/s 2023-03-17T10:32:00.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:17 smithi035 ceph-mon[92535]: pgmap v3083: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2023-03-17T10:32:00.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:20 smithi035 ceph-mon[92535]: pgmap v3084: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2023-03-17T10:32:00.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:22 smithi035 ceph-mon[92535]: pgmap v3085: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:24 smithi035 ceph-mon[92535]: pgmap v3086: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.9 MiB/s wr, 179 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:26 smithi035 ceph-mon[92535]: pgmap v3087: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:27 smithi035 ceph-mon[92535]: pgmap v3088: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.8 MiB/s wr, 171 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:30 smithi035 ceph-mon[92535]: pgmap v3089: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:32 smithi035 ceph-mon[92535]: pgmap v3090: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:34 smithi035 ceph-mon[92535]: pgmap v3091: 97 pgs: 97 active+clean; 122 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:36 smithi035 ceph-mon[92535]: pgmap v3092: 97 pgs: 97 active+clean; 122 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.5 MiB/s wr, 113 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:37 smithi035 ceph-mon[92535]: pgmap v3093: 97 pgs: 97 active+clean; 124 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:40 smithi035 ceph-mon[92535]: pgmap v3094: 97 pgs: 97 active+clean; 123 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 1.4 MiB/s wr, 113 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:42 smithi035 ceph-mon[92535]: pgmap v3095: 97 pgs: 97 active+clean; 123 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:32:02.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:44 smithi035 ceph-mon[92535]: pgmap v3096: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.1 MiB/s wr, 180 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:44 smithi035 ceph-mon[92535]: pgmap v3097: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:46 smithi035 ceph-mon[92535]: pgmap v3098: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:48 smithi035 ceph-mon[92535]: pgmap v3099: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:50 smithi035 ceph-mon[92535]: pgmap v3100: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.8 MiB/s wr, 141 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:52 smithi035 ceph-mon[92535]: pgmap v3101: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.8 MiB/s wr, 141 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:54 smithi035 ceph-mon[92535]: pgmap v3102: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.4 MiB/s wr, 136 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:56 smithi035 ceph-mon[92535]: pgmap v3103: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:20:58 smithi035 ceph-mon[92535]: pgmap v3104: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T10:32:02.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:00 smithi035 ceph-mon[92535]: pgmap v3105: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 1.9 MiB/s wr, 169 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:02 smithi035 ceph-mon[92535]: pgmap v3106: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.3 MiB/s wr, 117 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:04 smithi035 ceph-mon[92535]: pgmap v3107: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.0 MiB/s wr, 187 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:05 smithi035 ceph-mon[92535]: osdmap e269: 12 total, 12 up, 12 in 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:06 smithi035 ceph-mon[92535]: pgmap v3109: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 150 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:08 smithi035 ceph-mon[92535]: pgmap v3110: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 150 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:10 smithi035 ceph-mon[92535]: pgmap v3111: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:12 smithi035 ceph-mon[92535]: pgmap v3112: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:12 smithi035 ceph-mon[92535]: osdmap e270: 12 total, 12 up, 12 in 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:14 smithi035 ceph-mon[92535]: pgmap v3114: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 2.0 MiB/s wr, 170 op/s 2023-03-17T10:32:05.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:16 smithi035 ceph-mon[92535]: pgmap v3115: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2023-03-17T10:32:06.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:18 smithi035 ceph-mon[92535]: pgmap v3116: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2023-03-17T10:32:06.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:20 smithi035 ceph-mon[92535]: pgmap v3117: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2023-03-17T10:32:06.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:22 smithi035 ceph-mon[92535]: pgmap v3118: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2023-03-17T10:32:06.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:24 smithi035 ceph-mon[92535]: pgmap v3119: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 2.2 MiB/s wr, 187 op/s 2023-03-17T10:32:06.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:26 smithi035 ceph-mon[92535]: pgmap v3120: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2023-03-17T10:32:06.690 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:28 smithi035 ceph-mon[92535]: pgmap v3121: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2023-03-17T10:32:07.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:30 smithi035 ceph-mon[92535]: pgmap v3122: 97 pgs: 97 active+clean; 155 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:32 smithi035 ceph-mon[92535]: pgmap v3123: 97 pgs: 97 active+clean; 155 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:34 smithi035 ceph-mon[92535]: pgmap v3124: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:36 smithi035 ceph-mon[92535]: pgmap v3125: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:38 smithi035 ceph-mon[92535]: pgmap v3126: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:40 smithi035 ceph-mon[92535]: pgmap v3127: 97 pgs: 97 active+clean; 162 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.0 MiB/s wr, 169 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:42 smithi035 ceph-mon[92535]: pgmap v3128: 97 pgs: 97 active+clean; 162 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.3 MiB/s wr, 112 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:44 smithi035 ceph-mon[92535]: pgmap v3129: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:44 smithi035 ceph-mon[92535]: pgmap v3130: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.5 MiB/s wr, 127 op/s 2023-03-17T10:32:07.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:44 smithi035 ceph-mon[92535]: pgmap v3131: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:46 smithi035 ceph-mon[92535]: pgmap v3132: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:47 smithi035 ceph-mon[92535]: pgmap v3133: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.6 MiB/s wr, 155 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:50 smithi035 ceph-mon[92535]: pgmap v3134: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.6 MiB/s wr, 155 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:52 smithi035 ceph-mon[92535]: pgmap v3135: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 698 KiB/s wr, 74 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:54 smithi035 ceph-mon[92535]: pgmap v3136: 97 pgs: 97 active+clean; 130 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:56 smithi035 ceph-mon[92535]: pgmap v3137: 97 pgs: 97 active+clean; 130 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:21:57 smithi035 ceph-mon[92535]: pgmap v3138: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T10:32:08.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:00 smithi035 ceph-mon[92535]: pgmap v3139: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-03-17T10:32:08.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:02 smithi035 ceph-mon[92535]: pgmap v3140: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-03-17T10:32:08.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:04 smithi035 ceph-mon[92535]: pgmap v3141: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.0 MiB/s wr, 190 op/s 2023-03-17T10:32:08.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:05 smithi035 ceph-mon[92535]: osdmap e271: 12 total, 12 up, 12 in 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:06 smithi035 ceph-mon[92535]: pgmap v3143: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:07 smithi035 ceph-mon[92535]: pgmap v3144: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:10 smithi035 ceph-mon[92535]: pgmap v3145: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:12 smithi035 ceph-mon[92535]: pgmap v3146: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:12 smithi035 ceph-mon[92535]: osdmap e272: 12 total, 12 up, 12 in 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:13 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:13 smithi035 ceph-mon[92535]: pgmap v3148: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.9 MiB/s wr, 155 op/s 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:16 smithi035 ceph-mon[92535]: pgmap v3149: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 1.7 MiB/s wr, 139 op/s 2023-03-17T10:32:09.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:17 smithi035 ceph-mon[92535]: pgmap v3150: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T10:32:10.026 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:19 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:32:10.026 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:19 smithi035 ceph-mon[92535]: pgmap v3151: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T10:32:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:32:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:32:13.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:32:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:32:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:32:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:32:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:32:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:32:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:32:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:32:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:32:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:32:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:32:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:32:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:32:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:32:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:32:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:32:23.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:32:23.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:32:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c19b650 con 0x7efd1c1054f0 2023-03-17T10:32:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 0x7efd1c196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 0x7efd1c196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50850/0 (socket says 172.21.15.35:50850) 2023-03-17T10:32:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 -- 172.21.15.35:0/1927822677 learned_addr learned my addr 172.21.15.35:0/1927822677 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd20983700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c101580 0x7efd1c196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21985700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c1054f0 0x7efd1c19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 -- 172.21.15.35:0/1927822677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c1054f0 msgr2=0x7efd1c19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c1054f0 0x7efd1c19ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 -- 172.21.15.35:0/1927822677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c101580 msgr2=0x7efd1c196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c101580 0x7efd1c196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 -- 172.21.15.35:0/1927822677 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14009d00 con 0x7efd1c100be0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd20983700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c101580 0x7efd1c196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd21184700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 0x7efd1c196340 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d950 tx=0x7efd0c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd127fc700 1 -- 172.21.15.35:0/1927822677 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c009b40 con 0x7efd1c100be0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd127fc700 1 -- 172.21.15.35:0/1927822677 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd0c009ca0 con 0x7efd1c100be0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c110170 con 0x7efd1c100be0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.104+0000 7efd127fc700 1 -- 172.21.15.35:0/1927822677 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00f620 con 0x7efd1c100be0 2023-03-17T10:32:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.105+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c10ffe0 con 0x7efd1c100be0 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.107+0000 7efd127fc700 1 -- 172.21.15.35:0/1927822677 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7efd0c010460 con 0x7efd1c100be0 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.107+0000 7efd127fc700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efd0809f6c0 0x7efd080a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.107+0000 7efd127fc700 1 -- 172.21.15.35:0/1927822677 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efd0c0ca920 con 0x7efd1c100be0 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.107+0000 7efd20983700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efd0809f6c0 0x7efd080a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.108+0000 7efd20983700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efd0809f6c0 0x7efd080a1b70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd1c197950 tx=0x7efd18009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.108+0000 7efd2f575b80 1 Processor -- start 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 -- start start 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 0x564a79501fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a794fc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a794fc960 0x564a794fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a79403010 con 0x564a79501be0 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a79455950 con 0x564a794fc960 2023-03-17T10:32:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd2f575b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7944ede0 con 0x564a795024f0 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 0x564a79501fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 0x564a79501fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50858/0 (socket says 172.21.15.35:50858) 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 -- 172.21.15.35:0/4059131314 learned_addr learned my addr 172.21.15.35:0/4059131314 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd20983700 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a794fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21985700 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a794fc960 0x564a794fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 -- 172.21.15.35:0/4059131314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 msgr2=0x564a794fc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a794fc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 -- 172.21.15.35:0/4059131314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a794fc960 msgr2=0x564a794fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a794fc960 0x564a794fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 -- 172.21.15.35:0/4059131314 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a792d05d0 con 0x564a79501be0 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd21184700 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 0x564a79501fb0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7efd0c094e40 tx=0x7efd0c098220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fb4aa69fd8735a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.109+0000 7efd077fe700 1 -- 172.21.15.35:0/4059131314 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c09c1b0 con 0x564a79501be0 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd077fe700 1 -- 172.21.15.35:0/4059131314 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd0c0983d0 con 0x564a79501be0 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd077fe700 1 -- 172.21.15.35:0/4059131314 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c098630 con 0x564a79501be0 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 -- 172.21.15.35:0/4059131314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 msgr2=0x564a79501fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 0x564a79501fb0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7efd0c094e40 tx=0x7efd0c098220 comp rx=0 tx=0).stop 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 -- 172.21.15.35:0/4059131314 shutdown_connections 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a794fc960 0x564a794fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a79501be0 0x564a79501fb0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 --2- 172.21.15.35:0/4059131314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a794fc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 -- 172.21.15.35:0/4059131314 >> 172.21.15.35:0/4059131314 conn(0x564a793596b0 msgr2=0x564a794f6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 -- 172.21.15.35:0/4059131314 shutdown_connections 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.110+0000 7efd2f575b80 1 -- 172.21.15.35:0/4059131314 wait complete. 2023-03-17T10:32:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 -- start start 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 Processor -- start 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a79508510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a79505800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79505f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a792d28c0 con 0x564a794fc960 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a79506680 con 0x564a795024f0 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a795162f0 con 0x564a79501be0 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd2f575b80 10 client.0 _ll_register_callbacks cb 0x564a792f4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a79508510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a79508510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50864/0 (socket says 172.21.15.35:50864) 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd21184700 1 -- 172.21.15.35:0/2699888248 learned_addr learned my addr 172.21.15.35:0/2699888248 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.111+0000 7efd20983700 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a79505800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd21184700 1 -- 172.21.15.35:0/2699888248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 msgr2=0x564a79505800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd21184700 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a79505800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd21184700 1 -- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 msgr2=0x564a79505f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd21184700 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79505f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd21184700 1 -- 172.21.15.35:0/2699888248 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c10ffe0 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd21184700 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a79508510 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0c86b0 tx=0x7efd0c00dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131867e78239d4a8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd04ff9700 1 -- 172.21.15.35:0/2699888248 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0a05c0 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd04ff9700 1 -- 172.21.15.35:0/2699888248 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efd0c0978c0 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a79411390 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd04ff9700 1 -- 172.21.15.35:0/2699888248 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd0c097a80 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd2f575b80 10 client.18978 fetch_fsmap learned FSMap version 45 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x564a7927cd80 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd04ff9700 1 -- 172.21.15.35:0/2699888248 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a79411390 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd04ff9700 1 -- 172.21.15.35:0/2699888248 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7efd0c098630 con 0x564a794fc960 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.112+0000 7efd2f575b80 10 client.18978 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:32:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd2f575b80 10 client.18978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd2f575b80 20 client.18978 populate_metadata read hostname 'smithi035' 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7951a020 0x564a7951c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd2f575b80 4 client.18978 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a7941d600 con 0x564a7951a020 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd20983700 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7951a020 0x564a7951c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd04ff9700 10 client.18978 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.113+0000 7efd20983700 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7951a020 0x564a7951c430 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c0b4661e047e357 server_cookie=f479f1a891ece11d in_seq=0 out_seq=0 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd04ff9700 1 -- 172.21.15.35:0/2699888248 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564a7941d600 con 0x564a7951a020 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd04ff9700 10 client.18978 handle_command_reply: tid=0 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 client.18978 shutdown 2023-03-17T10:32:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 msgr2=0x564a79508510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a79508510 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0c86b0 tx=0x7efd0c00dfa0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 shutdown_connections 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7951a020 0x564a7951c430 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79505f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a79508510 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2699888248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a79505800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd04ff9700 0 client.18978 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 >> 172.21.15.35:0/2699888248 conn(0x564a793596b0 msgr2=0x564a794fb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 shutdown_connections 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.114+0000 7efd2f575b80 1 -- 172.21.15.35:0/2699888248 wait complete. 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.115+0000 7efd2f575b80 20 client.18978 trim_cache size 0 max 16384 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.129+0000 7efd2f575b80 1 Processor -- start 2023-03-17T10:32:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.129+0000 7efd2f575b80 1 -- start start 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a794f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a795080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79504fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd2f575b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a794f20f0 con 0x564a794fc960 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd2f575b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a795067c0 con 0x564a795024f0 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd2f575b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a794f7000 con 0x564a79501be0 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a794f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a794f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50872/0 (socket says 172.21.15.35:50872) 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 -- 172.21.15.35:0/2895027013 learned_addr learned my addr 172.21.15.35:0/2895027013 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd20983700 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a795080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 -- 172.21.15.35:0/2895027013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 msgr2=0x564a795080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21985700 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79504fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a795080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 -- 172.21.15.35:0/2895027013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 msgr2=0x564a79504fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79504fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 -- 172.21.15.35:0/2895027013 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a79415130 con 0x564a794fc960 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21985700 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79504fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd21184700 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a794f6ac0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7efd0c094e40 tx=0x7efd0c0a0130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72b19bca0a442c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd07fff700 1 -- 172.21.15.35:0/2895027013 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0983d0 con 0x564a794fc960 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd07fff700 1 -- 172.21.15.35:0/2895027013 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd0c010e70 con 0x564a794fc960 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.130+0000 7efd07fff700 1 -- 172.21.15.35:0/2895027013 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c098630 con 0x564a794fc960 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 -- 172.21.15.35:0/2895027013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 msgr2=0x564a794f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a794f6ac0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7efd0c094e40 tx=0x7efd0c0a0130 comp rx=0 tx=0).stop 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 -- 172.21.15.35:0/2895027013 shutdown_connections 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a795024f0 0x564a79504fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a794f6ac0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 --2- 172.21.15.35:0/2895027013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a79501be0 0x564a795080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 -- 172.21.15.35:0/2895027013 >> 172.21.15.35:0/2895027013 conn(0x564a793596b0 msgr2=0x564a79515a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 -- 172.21.15.35:0/2895027013 shutdown_connections 2023-03-17T10:32:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 -- 172.21.15.35:0/2895027013 wait complete. 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 -- start start 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.131+0000 7efd2f575b80 1 Processor -- start 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a7950f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a79501be0 0x564a7950f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a7956ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a79510100 con 0x564a794fc960 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7956d3c0 con 0x564a79501be0 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7956d500 con 0x564a795024f0 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 10 client.0 _ll_register_callbacks cb 0x564a792f4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a7950f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a7950f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50878/0 (socket says 172.21.15.35:50878) 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 -- 172.21.15.35:0/3408292374 learned_addr learned my addr 172.21.15.35:0/3408292374 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd20983700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a79501be0 0x564a7950f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21985700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a7956ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 -- 172.21.15.35:0/3408292374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 msgr2=0x564a7956ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a7956ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 -- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a79501be0 msgr2=0x564a7950f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a79501be0 0x564a7950f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 -- 172.21.15.35:0/3408292374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a7927cd80 con 0x564a794fc960 2023-03-17T10:32:34.638 INFO:tasks.workunit.client.0.smithi035.stdout: 1 147862 2.49 MB/sec execute 187 sec latency 23.136 ms 2023-03-17T10:32:34.638 INFO:tasks.workunit.client.0.smithi035.stdout: 1 148469 2.51 MB/sec execute 188 sec latency 12.631 ms 2023-03-17T10:32:34.638 INFO:tasks.workunit.client.0.smithi035.stdout: 1 149000 2.52 MB/sec execute 189 sec latency 17.976 ms 2023-03-17T10:32:34.638 INFO:tasks.workunit.client.0.smithi035.stdout: 1 149345 2.52 MB/sec execute 190 sec latency 13.659 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 149594 2.50 MB/sec execute 191 sec latency 18.677 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 150069 2.50 MB/sec execute 192 sec latency 22.865 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 150559 2.50 MB/sec execute 193 sec latency 20.964 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 151060 2.49 MB/sec execute 194 sec latency 47.590 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 151566 2.49 MB/sec execute 195 sec latency 20.629 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 152294 2.51 MB/sec execute 196 sec latency 14.594 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 152693 2.52 MB/sec execute 197 sec latency 14.963 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 152970 2.51 MB/sec execute 198 sec latency 13.915 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 153333 2.50 MB/sec execute 199 sec latency 16.077 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 153812 2.50 MB/sec execute 200 sec latency 14.667 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 154326 2.50 MB/sec execute 201 sec latency 23.373 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 154909 2.50 MB/sec execute 202 sec latency 23.057 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 155480 2.51 MB/sec execute 203 sec latency 14.577 ms 2023-03-17T10:32:34.639 INFO:tasks.workunit.client.0.smithi035.stdout: 1 155938 2.51 MB/sec execute 204 sec latency 13.931 ms 2023-03-17T10:32:35.363 INFO:tasks.workunit.client.0.smithi035.stdout: 1 156402 2.52 MB/sec execute 205 sec latency 12.160 ms 2023-03-17T10:32:35.363 INFO:tasks.workunit.client.0.smithi035.stdout: 1 156669 2.51 MB/sec execute 206 sec latency 12.876 ms 2023-03-17T10:32:35.363 INFO:tasks.workunit.client.0.smithi035.stdout: 1 157142 2.50 MB/sec execute 207 sec latency 21.012 ms 2023-03-17T10:32:35.363 INFO:tasks.workunit.client.0.smithi035.stdout: 1 157623 2.51 MB/sec execute 208 sec latency 21.283 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 158157 2.50 MB/sec execute 209 sec latency 23.314 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 158667 2.50 MB/sec execute 210 sec latency 19.452 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 159382 2.52 MB/sec execute 211 sec latency 32.788 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 159789 2.52 MB/sec execute 212 sec latency 12.274 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 160067 2.51 MB/sec execute 213 sec latency 14.606 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 160397 2.50 MB/sec execute 214 sec latency 49.590 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 160878 2.50 MB/sec execute 215 sec latency 15.243 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 161346 2.50 MB/sec execute 216 sec latency 23.123 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 161970 2.50 MB/sec execute 217 sec latency 24.972 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 162542 2.51 MB/sec execute 218 sec latency 13.034 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 163003 2.51 MB/sec execute 219 sec latency 19.617 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 163469 2.52 MB/sec execute 220 sec latency 12.753 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 163732 2.51 MB/sec execute 221 sec latency 14.788 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 164162 2.50 MB/sec execute 222 sec latency 17.131 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 164680 2.51 MB/sec execute 223 sec latency 22.342 ms 2023-03-17T10:32:35.364 INFO:tasks.workunit.client.0.smithi035.stdout: 1 165186 2.50 MB/sec execute 224 sec latency 21.780 ms 2023-03-17T10:32:36.152 INFO:tasks.workunit.client.0.smithi035.stdout: 1 165669 2.50 MB/sec execute 225 sec latency 25.216 ms 2023-03-17T10:32:36.152 INFO:tasks.workunit.client.0.smithi035.stdout: 1 166411 2.51 MB/sec execute 226 sec latency 14.750 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 166817 2.52 MB/sec execute 227 sec latency 12.258 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 167121 2.52 MB/sec execute 228 sec latency 12.863 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 167359 2.51 MB/sec execute 229 sec latency 63.747 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 167857 2.50 MB/sec execute 230 sec latency 87.991 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 168348 2.51 MB/sec execute 231 sec latency 23.359 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 168884 2.50 MB/sec execute 232 sec latency 23.267 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 169332 2.50 MB/sec execute 233 sec latency 82.187 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 170040 2.51 MB/sec execute 234 sec latency 16.256 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 170498 2.52 MB/sec execute 235 sec latency 14.225 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 170737 2.51 MB/sec execute 236 sec latency 16.966 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 171137 2.50 MB/sec execute 237 sec latency 20.629 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 171665 2.51 MB/sec execute 238 sec latency 19.022 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 172115 2.50 MB/sec execute 239 sec latency 21.675 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 172664 2.50 MB/sec execute 240 sec latency 23.952 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 173266 2.51 MB/sec execute 241 sec latency 12.621 ms 2023-03-17T10:32:36.153 INFO:tasks.workunit.client.0.smithi035.stdout: 1 173795 2.52 MB/sec execute 242 sec latency 11.643 ms 2023-03-17T10:32:36.154 INFO:tasks.workunit.client.0.smithi035.stdout: 1 174148 2.52 MB/sec execute 243 sec latency 13.449 ms 2023-03-17T10:32:36.154 INFO:tasks.workunit.client.0.smithi035.stdout: 1 174419 2.51 MB/sec execute 244 sec latency 15.906 ms 2023-03-17T10:32:36.154 INFO:tasks.workunit.client.0.smithi035.stdout: 1 174915 2.51 MB/sec execute 245 sec latency 14.678 ms 2023-03-17T10:32:36.154 INFO:tasks.workunit.client.0.smithi035.stdout: 1 175355 2.51 MB/sec execute 246 sec latency 73.421 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 175879 2.50 MB/sec execute 247 sec latency 28.325 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 176378 2.50 MB/sec execute 248 sec latency 40.267 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 177110 2.52 MB/sec execute 249 sec latency 13.063 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 177523 2.52 MB/sec execute 250 sec latency 14.679 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 177788 2.51 MB/sec execute 251 sec latency 13.839 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 178095 2.51 MB/sec execute 252 sec latency 20.325 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 178573 2.50 MB/sec execute 253 sec latency 14.082 ms 2023-03-17T10:32:37.051 INFO:tasks.workunit.client.0.smithi035.stdout: 1 179058 2.51 MB/sec execute 254 sec latency 21.685 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 179670 2.50 MB/sec execute 255 sec latency 22.347 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 180234 2.51 MB/sec execute 256 sec latency 14.665 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 180699 2.51 MB/sec execute 257 sec latency 11.478 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 181166 2.52 MB/sec execute 258 sec latency 15.176 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 181414 2.51 MB/sec execute 259 sec latency 15.086 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 181823 2.50 MB/sec execute 260 sec latency 23.006 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 182322 2.51 MB/sec execute 261 sec latency 68.584 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 182784 2.50 MB/sec execute 262 sec latency 75.276 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 183327 2.50 MB/sec execute 263 sec latency 21.789 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 183935 2.51 MB/sec execute 264 sec latency 13.114 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 184462 2.52 MB/sec execute 265 sec latency 13.737 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 184818 2.52 MB/sec execute 266 sec latency 13.023 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 185069 2.51 MB/sec execute 267 sec latency 16.573 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 185582 2.50 MB/sec execute 268 sec latency 14.273 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 186068 2.51 MB/sec execute 269 sec latency 24.015 ms 2023-03-17T10:32:37.052 INFO:tasks.workunit.client.0.smithi035.stdout: 1 186599 2.50 MB/sec execute 270 sec latency 37.888 ms 2023-03-17T10:32:37.053 INFO:tasks.workunit.client.0.smithi035.stdout: 1 187058 2.50 MB/sec execute 271 sec latency 14.871 ms 2023-03-17T10:32:37.053 INFO:tasks.workunit.client.0.smithi035.stdout: 1 187763 2.51 MB/sec execute 272 sec latency 14.263 ms 2023-03-17T10:32:37.053 INFO:tasks.workunit.client.0.smithi035.stdout: 1 188213 2.52 MB/sec execute 273 sec latency 16.266 ms 2023-03-17T10:32:37.053 INFO:tasks.workunit.client.0.smithi035.stdout: 1 188455 2.51 MB/sec execute 274 sec latency 15.118 ms 2023-03-17T10:32:37.053 INFO:tasks.workunit.client.0.smithi035.stdout: 1 188828 2.51 MB/sec execute 275 sec latency 19.200 ms 2023-03-17T10:32:37.053 INFO:tasks.workunit.client.0.smithi035.stdout: 1 189289 2.50 MB/sec execute 276 sec latency 14.719 ms 2023-03-17T10:32:37.619 INFO:tasks.workunit.client.0.smithi035.stdout: 1 189797 2.50 MB/sec execute 277 sec latency 22.584 ms 2023-03-17T10:32:38.145 INFO:tasks.workunit.client.0.smithi035.stdout: 1 190367 2.50 MB/sec execute 278 sec latency 25.538 ms 2023-03-17T10:32:39.322 INFO:tasks.workunit.client.0.smithi035.stdout: 1 190944 2.51 MB/sec execute 279 sec latency 13.699 ms 2023-03-17T10:32:39.322 INFO:tasks.workunit.client.0.smithi035.stdout: 1 191395 2.51 MB/sec execute 280 sec latency 14.319 ms 2023-03-17T10:32:39.322 INFO:tasks.workunit.client.0.smithi035.stdout: 1 191844 2.52 MB/sec execute 281 sec latency 22.848 ms 2023-03-17T10:32:39.322 INFO:tasks.workunit.client.0.smithi035.stdout: 1 192099 2.51 MB/sec execute 282 sec latency 22.022 ms 2023-03-17T10:32:39.997 INFO:tasks.workunit.client.0.smithi035.stdout: 1 192527 2.50 MB/sec execute 283 sec latency 19.573 ms 2023-03-17T10:32:39.998 INFO:tasks.workunit.client.0.smithi035.stdout: 1 193046 2.51 MB/sec execute 284 sec latency 22.237 ms 2023-03-17T10:32:39.998 INFO:tasks.workunit.client.0.smithi035.stdout: 1 193559 2.50 MB/sec execute 285 sec latency 22.657 ms 2023-03-17T10:32:39.998 INFO:tasks.workunit.client.0.smithi035.stdout: 1 194041 2.50 MB/sec execute 286 sec latency 21.471 ms 2023-03-17T10:32:39.998 INFO:tasks.workunit.client.0.smithi035.stdout: 1 194823 2.52 MB/sec execute 287 sec latency 13.897 ms 2023-03-17T10:32:39.998 INFO:tasks.workunit.client.0.smithi035.stdout: 1 195185 2.52 MB/sec execute 288 sec latency 16.126 ms 2023-03-17T10:32:43.760 INFO:tasks.workunit.client.0.smithi035.stdout: 1 195478 2.51 MB/sec execute 289 sec latency 15.554 ms 2023-03-17T10:32:43.760 INFO:tasks.workunit.client.0.smithi035.stdout: 1 195753 2.51 MB/sec execute 290 sec latency 17.257 ms 2023-03-17T10:32:43.760 INFO:tasks.workunit.client.0.smithi035.stdout: 1 196251 2.50 MB/sec execute 291 sec latency 14.778 ms 2023-03-17T10:32:43.760 INFO:tasks.workunit.client.0.smithi035.stdout: 1 196721 2.51 MB/sec execute 292 sec latency 23.721 ms 2023-03-17T10:32:44.805 INFO:tasks.workunit.client.0.smithi035.stdout: 1 197280 2.50 MB/sec execute 293 sec latency 24.208 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 197716 2.50 MB/sec execute 294 sec latency 14.728 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 198405 2.51 MB/sec execute 295 sec latency 14.771 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 198861 2.52 MB/sec execute 296 sec latency 14.952 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 199093 2.51 MB/sec execute 297 sec latency 13.860 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 199462 2.50 MB/sec execute 298 sec latency 20.412 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 199930 2.50 MB/sec execute 299 sec latency 15.230 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 200453 2.50 MB/sec execute 300 sec latency 24.973 ms 2023-03-17T10:32:44.806 INFO:tasks.workunit.client.0.smithi035.stdout: 1 201007 2.50 MB/sec execute 301 sec latency 24.376 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 201574 2.51 MB/sec execute 302 sec latency 12.398 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 202007 2.51 MB/sec execute 303 sec latency 32.452 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 202462 2.52 MB/sec execute 304 sec latency 14.132 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 202709 2.51 MB/sec execute 305 sec latency 14.319 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 203100 2.50 MB/sec execute 306 sec latency 22.502 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 203584 2.51 MB/sec execute 307 sec latency 74.037 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 204018 2.50 MB/sec execute 308 sec latency 25.013 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 204564 2.50 MB/sec execute 309 sec latency 24.327 ms 2023-03-17T10:32:46.168 INFO:tasks.workunit.client.0.smithi035.stdout: 1 205154 2.51 MB/sec execute 310 sec latency 30.776 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 205577 2.51 MB/sec execute 311 sec latency 15.354 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 206026 2.51 MB/sec execute 312 sec latency 16.916 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 206278 2.50 MB/sec execute 313 sec latency 14.437 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 206691 2.50 MB/sec execute 314 sec latency 18.623 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 207221 2.51 MB/sec execute 315 sec latency 22.490 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 207708 2.50 MB/sec execute 316 sec latency 25.139 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 208177 2.50 MB/sec execute 317 sec latency 76.143 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 208894 2.51 MB/sec execute 318 sec latency 14.548 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 209286 2.51 MB/sec execute 319 sec latency 18.192 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 209640 2.51 MB/sec execute 320 sec latency 13.021 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 209898 2.50 MB/sec execute 321 sec latency 21.087 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 210420 2.50 MB/sec execute 322 sec latency 14.396 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 210899 2.50 MB/sec execute 323 sec latency 20.793 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 211455 2.50 MB/sec execute 324 sec latency 22.441 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 211899 2.50 MB/sec execute 325 sec latency 12.957 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 212590 2.51 MB/sec execute 326 sec latency 14.084 ms 2023-03-17T10:32:46.169 INFO:tasks.workunit.client.0.smithi035.stdout: 1 213051 2.51 MB/sec execute 327 sec latency 13.738 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 213290 2.51 MB/sec execute 328 sec latency 13.671 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 213693 2.50 MB/sec execute 329 sec latency 21.194 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 214230 2.51 MB/sec execute 330 sec latency 21.868 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 214666 2.50 MB/sec execute 331 sec latency 23.269 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 215261 2.50 MB/sec execute 332 sec latency 22.479 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 215862 2.51 MB/sec execute 333 sec latency 14.701 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 216389 2.51 MB/sec execute 334 sec latency 14.311 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 216745 2.51 MB/sec execute 335 sec latency 21.595 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 216990 2.50 MB/sec execute 336 sec latency 17.432 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 217422 2.50 MB/sec execute 337 sec latency 16.493 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 217915 2.50 MB/sec execute 338 sec latency 21.651 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 218389 2.50 MB/sec execute 339 sec latency 25.612 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 218872 2.50 MB/sec execute 340 sec latency 21.966 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 219595 2.51 MB/sec execute 341 sec latency 12.858 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 219965 2.51 MB/sec execute 342 sec latency 18.860 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 220268 2.51 MB/sec execute 343 sec latency 22.674 ms 2023-03-17T10:32:46.170 INFO:tasks.workunit.client.0.smithi035.stdout: 1 220497 2.50 MB/sec execute 344 sec latency 84.393 ms 2023-03-17T10:32:46.171 INFO:tasks.workunit.client.0.smithi035.stdout: 1 220889 2.50 MB/sec execute 345 sec latency 20.941 ms 2023-03-17T10:32:46.171 INFO:tasks.workunit.client.0.smithi035.stdout: 1 221400 2.50 MB/sec execute 346 sec latency 23.714 ms 2023-03-17T10:32:46.171 INFO:tasks.workunit.client.0.smithi035.stdout: 1 221863 2.50 MB/sec execute 347 sec latency 23.809 ms 2023-03-17T10:32:46.171 INFO:tasks.workunit.client.0.smithi035.stdout: 1 222393 2.49 MB/sec execute 348 sec latency 24.842 ms 2023-03-17T10:32:50.104 INFO:tasks.workunit.client.0.smithi035.stdout: 1 222975 2.50 MB/sec execute 349 sec latency 12.629 ms 2023-03-17T10:32:50.104 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223476 2.51 MB/sec execute 350 sec latency 19.559 ms 2023-03-17T10:32:50.946 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223582 2.50 MB/sec execute 351 sec latency 753.326 ms 2023-03-17T10:32:50.947 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T10:32:50.947 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 -- 172.21.15.35:0/3465581901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ffd20 msgr2=0x7fa7c0103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:50.947 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/3465581901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ffd20 0x7fa7c0103ce0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00099c0 tx=0x7fa7b0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:32:52.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 -- 172.21.15.35:0/3465581901 shutdown_connections 2023-03-17T10:32:52.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/3465581901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7c01043c0 0x7fa7c010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:52.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/3465581901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ff380 0x7fa7c00ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:53.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/3465581901 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ffd20 0x7fa7c0103ce0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:53.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 -- 172.21.15.35:0/3465581901 >> 172.21.15.35:0/3465581901 conn(0x7fa7c0076300 msgr2=0x7fa7c0076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:32:53.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 -- 172.21.15.35:0/3465581901 shutdown_connections 2023-03-17T10:32:53.561 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 -- 172.21.15.35:0/3465581901 wait complete. 2023-03-17T10:32:54.626 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.215+0000 7fa7c73d7700 1 Processor -- start 2023-03-17T10:32:54.626 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 -- start start 2023-03-17T10:32:54.626 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 0x7fa7c010b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:54.626 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ffd20 0x7fa7c010ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:54.626 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7c01043c0 0x7fa7c019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:55.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c019d3e0 con 0x7fa7c00ff380 2023-03-17T10:32:55.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c019d550 con 0x7fa7c01043c0 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c73d7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c019d710 con 0x7fa7c00ffd20 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c5173700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 0x7fa7c010b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c5173700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 0x7fa7c010b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52096/0 (socket says 172.21.15.35:52096) 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c4972700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ffd20 0x7fa7c010ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c5173700 1 -- 172.21.15.35:0/1486086754 learned_addr learned my addr 172.21.15.35:0/1486086754 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c5974700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7c01043c0 0x7fa7c019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c4972700 1 -- 172.21.15.35:0/1486086754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7c01043c0 msgr2=0x7fa7c019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7c01043c0 0x7fa7c019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c4972700 1 -- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 msgr2=0x7fa7c010b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 0x7fa7c010b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c4972700 1 -- 172.21.15.35:0/1486086754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b00095f0 con 0x7fa7c00ffd20 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.216+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 0x7fa7c010b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.217+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ffd20 0x7fa7c010ba00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00098e0 tx=0x7fa7b000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.217+0000 7fa7b67fc700 1 -- 172.21.15.35:0/1486086754 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b001d070 con 0x7fa7c00ffd20 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.217+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0068c60 con 0x7fa7c00ffd20 2023-03-17T10:32:55.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.217+0000 7fa7b67fc700 1 -- 172.21.15.35:0/1486086754 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7b00059a0 con 0x7fa7c00ffd20 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.217+0000 7fa7b67fc700 1 -- 172.21.15.35:0/1486086754 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0022de0 con 0x7fa7c00ffd20 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.217+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c0068ad0 con 0x7fa7c00ffd20 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.219+0000 7fa7b67fc700 1 -- 172.21.15.35:0/1486086754 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa7b00225e0 con 0x7fa7c00ffd20 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.220+0000 7fa7b67fc700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa7ac09f640 0x7fa7ac0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.220+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa7ac09f640 0x7fa7ac0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.220+0000 7fa7b67fc700 1 -- 172.21.15.35:0/1486086754 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa7b00cb5c0 con 0x7fa7c00ffd20 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa7ac09f640 0x7fa7ac0a1af0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005950 tx=0x7fa7bc00b500 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 Processor -- start 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 -- start start 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bed5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3beda0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bedaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bddc070 con 0x561a3beda630 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3be2e9b0 con 0x561a3bed57d0 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3be27e40 con 0x561a3bed60e0 2023-03-17T10:32:55.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7c5974700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bedaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7c5974700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bedaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52106/0 (socket says 172.21.15.35:52106) 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7c5974700 1 -- 172.21.15.35:0/1610615893 learned_addr learned my addr 172.21.15.35:0/1610615893 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.221+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bed5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3beda0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5173700 1 -- 172.21.15.35:0/1610615893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 msgr2=0x561a3beda0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3beda0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5173700 1 -- 172.21.15.35:0/1610615893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 msgr2=0x561a3bedaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bedaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5173700 1 -- 172.21.15.35:0/1610615893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3bca9630 con 0x561a3bed57d0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5974700 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bedaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bed5ba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc011760 tx=0x7fa7bc013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c862435634dfd6e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7ab7fe700 1 -- 172.21.15.35:0/1610615893 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc004220 con 0x561a3bed57d0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7ab7fe700 1 -- 172.21.15.35:0/1610615893 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7bc015070 con 0x561a3bed57d0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.222+0000 7fa7ab7fe700 1 -- 172.21.15.35:0/1610615893 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc01e660 con 0x561a3bed57d0 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1610615893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 msgr2=0x561a3bed5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bed5ba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc011760 tx=0x7fa7bc013000 comp rx=0 tx=0).stop 2023-03-17T10:32:55.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1610615893 shutdown_connections 2023-03-17T10:32:55.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bedaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bed5ba0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1610615893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3beda0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:55.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1610615893 >> 172.21.15.35:0/1610615893 conn(0x561a3bed0030 msgr2=0x561a3bed0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:32:57.914 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1610615893 shutdown_connections 2023-03-17T10:32:58.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1610615893 wait complete. 2023-03-17T10:32:58.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 -- start start 2023-03-17T10:32:58.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.223+0000 7fa7d3564b80 1 Processor -- start 2023-03-17T10:32:58.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:58.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 0x561a3bedf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:58.732 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3beda630 0x561a3bedf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bcab920 con 0x561a3bed60e0 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bedfe90 con 0x561a3bed57d0 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3beeb8e0 con 0x561a3beda630 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7d3564b80 10 client.0 _ll_register_callbacks cb 0x561a3bccd290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 0x561a3bedf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 0x561a3bedf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52110/0 (socket says 172.21.15.35:52110) 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 -- 172.21.15.35:0/1016766747 learned_addr learned my addr 172.21.15.35:0/1016766747 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:32:58.733 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c5974700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3beda630 0x561a3bedf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:58.734 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:32:58.734 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 -- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3beda630 msgr2=0x561a3bedf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:58.734 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3beda630 0x561a3bedf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:59.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 -- 172.21.15.35:0/1016766747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 msgr2=0x561a3bee1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c4972700 1 -- 172.21.15.35:0/1016766747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc011440 con 0x561a3bed60e0 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.224+0000 7fa7c5974700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3beda630 0x561a3bedf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 0x561a3bedf040 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00c8e00 tx=0x7fa7b0098a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bfca3e63f23ec1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:32:59.150 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1016766747 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b009e040 con 0x561a3bed60e0 2023-03-17T10:33:01.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a3bdea3f0 con 0x561a3bed60e0 2023-03-17T10:33:01.632 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1016766747 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa7b00c5020 con 0x561a3bed60e0 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1016766747 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7b00a1260 con 0x561a3bed60e0 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 10 client.19482 fetch_fsmap learned FSMap version 50 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x561a3bc55de0 con 0x561a3bed60e0 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1016766747 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a3bdea3f0 con 0x561a3bed60e0 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1016766747 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa7b00cb0b0 con 0x561a3bed60e0 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 10 client.19482 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 10 client.19482 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 20 client.19482 populate_metadata read hostname 'smithi035' 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3beef610 0x561a3bef1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 4 client.19482 mds_command: new command op to 24445 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.225+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a3bdf6660 con 0x561a3beef610 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.226+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3beef610 0x561a3bef1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:01.633 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.226+0000 7fa7a8ff9700 10 client.19482 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T10:33:02.231 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.226+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3beef610 0x561a3bef1a20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=604c9bfa09f7af4a server_cookie=dc5ccbe0af2a8491 in_seq=0 out_seq=0 2023-03-17T10:33:02.231 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.226+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1016766747 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561a3bdf6660 con 0x561a3beef610 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7a8ff9700 10 client.19482 handle_command_reply: tid=0 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 client.19482 shutdown 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 msgr2=0x561a3bedf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 0x561a3bedf040 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00c8e00 tx=0x7fa7b0098a60 comp rx=0 tx=0).stop 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 shutdown_connections 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3beef610 0x561a3bef1a20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3beda630 0x561a3bedf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7a8ff9700 0 client.19482 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1016766747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed60e0 0x561a3bedf040 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:03.507 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 >> 172.21.15.35:0/1016766747 conn(0x561a3bed0030 msgr2=0x561a3bed0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:04.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 shutdown_connections 2023-03-17T10:33:04.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1016766747 wait complete. 2023-03-17T10:33:04.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.227+0000 7fa7d3564b80 20 client.19482 trim_cache size 0 max 16384 2023-03-17T10:33:04.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.241+0000 7fa7d3564b80 1 Processor -- start 2023-03-17T10:33:04.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.241+0000 7fa7d3564b80 1 -- start start 2023-03-17T10:33:04.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 0x561a3bee6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:04.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:05.176 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3beda630 0x561a3bed86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:05.176 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bed6700 con 0x561a3bed57d0 2023-03-17T10:33:05.176 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3becf2f0 con 0x561a3beda630 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bee6d60 con 0x561a3bed60e0 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 0x561a3bee6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 0x561a3bee6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52116/0 (socket says 172.21.15.35:52116) 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 -- 172.21.15.35:0/1901932473 learned_addr learned my addr 172.21.15.35:0/1901932473 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5974700 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3beda630 0x561a3bed86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:05.177 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 -- 172.21.15.35:0/1901932473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 msgr2=0x561a3bee1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 -- 172.21.15.35:0/1901932473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3beda630 msgr2=0x561a3bed86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3beda630 0x561a3bed86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 -- 172.21.15.35:0/1901932473 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3bed06d0 con 0x561a3bed57d0 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.242+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 0x561a3bee6820 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc011d50 tx=0x7fa7bc010410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bf7b555379cdd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.243+0000 7fa7abfff700 1 -- 172.21.15.35:0/1901932473 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc02b040 con 0x561a3bed57d0 2023-03-17T10:33:05.844 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.243+0000 7fa7abfff700 1 -- 172.21.15.35:0/1901932473 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7bc038070 con 0x561a3bed57d0 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.243+0000 7fa7abfff700 1 -- 172.21.15.35:0/1901932473 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0328e0 con 0x561a3bed57d0 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.244+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1901932473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 msgr2=0x561a3bee6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.244+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 0x561a3bee6820 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc011d50 tx=0x7fa7bc010410 comp rx=0 tx=0).stop 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1901932473 shutdown_connections 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3beda630 0x561a3bed86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3bed57d0 0x561a3bee6820 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1901932473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:05.845 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1901932473 >> 172.21.15.35:0/1901932473 conn(0x561a3bed0030 msgr2=0x561a3beeafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:05.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1901932473 shutdown_connections 2023-03-17T10:33:05.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1901932473 wait complete. 2023-03-17T10:33:05.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 -- start start 2023-03-17T10:33:05.846 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.245+0000 7fa7d3564b80 1 Processor -- start 2023-03-17T10:33:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd21184700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a7950f270 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005950 tx=0x7efd0c098010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f83372be136fd3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:33:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd04ff9700 1 -- 172.21.15.35:0/3408292374 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0983d0 con 0x564a794fc960 2023-03-17T10:33:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd04ff9700 1 -- 172.21.15.35:0/3408292374 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7efd0c0a05c0 con 0x564a794fc960 2023-03-17T10:33:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.132+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a794cc1e0 con 0x564a794fc960 2023-03-17T10:33:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd04ff9700 1 -- 172.21.15.35:0/3408292374 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd0c0a0250 con 0x564a794fc960 2023-03-17T10:33:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 10 client.18984 fetch_fsmap learned FSMap version 45 2023-03-17T10:33:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x564a792a31f0 con 0x564a794fc960 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd04ff9700 1 -- 172.21.15.35:0/3408292374 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a794cc1e0 con 0x564a794fc960 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd04ff9700 1 -- 172.21.15.35:0/3408292374 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7efd0c097330 con 0x564a794fc960 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 10 client.18984 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 10 client.18984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 20 client.18984 populate_metadata read hostname 'smithi035' 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7956e770 0x564a79570b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 4 client.18984 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:33:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a792d2f00 con 0x564a7956e770 2023-03-17T10:33:09.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.133+0000 7efd20983700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7956e770 0x564a79570b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.134+0000 7efd04ff9700 10 client.18984 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:33:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.134+0000 7efd20983700 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7956e770 0x564a79570b80 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d3f8b5f18b0982c server_cookie=65db0a38878d8e8e in_seq=0 out_seq=0 2023-03-17T10:33:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd04ff9700 1 -- 172.21.15.35:0/3408292374 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a792d2f00 con 0x564a7956e770 2023-03-17T10:33:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd04ff9700 10 client.18984 handle_command_reply: tid=0 2023-03-17T10:33:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 client.18984 shutdown 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 msgr2=0x564a7950f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a7950f270 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7efd0c005950 tx=0x7efd0c098010 comp rx=0 tx=0).stop 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 shutdown_connections 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564a7956e770 0x564a79570b80 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a795024f0 0x564a7956ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd04ff9700 0 client.18984 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564a794fc960 0x564a7950f270 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 --2- 172.21.15.35:0/3408292374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a79501be0 0x564a7950f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 >> 172.21.15.35:0/3408292374 conn(0x564a793596b0 msgr2=0x564a794ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.138+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 shutdown_connections 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd2f575b80 1 -- 172.21.15.35:0/3408292374 wait complete. 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd2f575b80 20 client.18984 trim_cache size 0 max 16384 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efd0809f6c0 msgr2=0x7efd080a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efd0809f6c0 0x7efd080a1b70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd1c197950 tx=0x7efd18009260 comp rx=0 tx=0).stop 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 msgr2=0x7efd1c196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 0x7efd1c196340 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00d950 tx=0x7efd0c00dd10 comp rx=0 tx=0).stop 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 shutdown_connections 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7efd0809f6c0 0x7efd080a1b70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd1c1054f0 0x7efd1c19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7efd1c100be0 0x7efd1c196340 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 --2- 172.21.15.35:0/1927822677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd1c101580 0x7efd1c196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 >> 172.21.15.35:0/1927822677 conn(0x7efd1c0774e0 msgr2=0x7efd1c0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:11.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 shutdown_connections 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:06:54.139+0000 7efd233e8700 1 -- 172.21.15.35:0/1927822677 wait complete. 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.260+0000 7f380a624700 1 -- 172.21.15.35:0/2704198492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3804101410 msgr2=0x7f38041017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.260+0000 7f380a624700 1 --2- 172.21.15.35:0/2704198492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3804101410 0x7f38041017e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009990 tx=0x7f37f4009ca0 comp rx=0 tx=0).stop 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 -- 172.21.15.35:0/2704198492 shutdown_connections 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 --2- 172.21.15.35:0/2704198492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f380410a750 0x7f380410cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 --2- 172.21.15.35:0/2704198492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3804101410 0x7f38041017e0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 --2- 172.21.15.35:0/2704198492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3804101d20 0x7f380410a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 -- 172.21.15.35:0/2704198492 >> 172.21.15.35:0/2704198492 conn(0x7f3804076330 msgr2=0x7f3804076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:12.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 -- 172.21.15.35:0/2704198492 shutdown_connections 2023-03-17T10:33:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 -- 172.21.15.35:0/2704198492 wait complete. 2023-03-17T10:33:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 Processor -- start 2023-03-17T10:33:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.261+0000 7f380a624700 1 -- start start 2023-03-17T10:33:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f380a624700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3804101410 0x7f3804196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f380a624700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3804101d20 0x7f38041967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f380a624700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 0x7f380419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f380a624700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380419b240 con 0x7f380410a750 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f380a624700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380419b3b0 con 0x7f3804101d20 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f380a624700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380419b570 con 0x7f3804101410 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 0x7f380419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 0x7f380419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50896/0 (socket says 172.21.15.35:50896) 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 -- 172.21.15.35:0/3778968033 learned_addr learned my addr 172.21.15.35:0/3778968033 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3803fff700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3804101410 0x7f3804196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f38037fe700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3804101d20 0x7f38041967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 -- 172.21.15.35:0/3778968033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3804101410 msgr2=0x7f3804196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3804101410 0x7f3804196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 -- 172.21.15.35:0/3778968033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3804101d20 msgr2=0x7f38041967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3804101d20 0x7f38041967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 -- 172.21.15.35:0/3778968033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40095f0 con 0x7f380410a750 2023-03-17T10:33:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.262+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 0x7f380419ac00 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f37fc007ee0 tx=0x7f37fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.263+0000 7f38017fa700 1 -- 172.21.15.35:0/3778968033 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc017070 con 0x7f380410a750 2023-03-17T10:33:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.263+0000 7f38017fa700 1 -- 172.21.15.35:0/3778968033 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37fc00f040 con 0x7f380410a750 2023-03-17T10:33:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.263+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3804110100 con 0x7f380410a750 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.263+0000 7f38017fa700 1 -- 172.21.15.35:0/3778968033 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc005570 con 0x7f380410a750 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.263+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380410ff70 con 0x7f380410a750 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.265+0000 7f38017fa700 1 -- 172.21.15.35:0/3778968033 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f37fc00db20 con 0x7f380410a750 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.265+0000 7f38017fa700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37ec09f640 0x7f37ec0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.266+0000 7f38017fa700 1 -- 172.21.15.35:0/3778968033 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37fc0c9d20 con 0x7f380410a750 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.266+0000 7f3803fff700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37ec09f640 0x7f37ec0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.266+0000 7f3803fff700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37ec09f640 0x7f37ec0a1af0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37f4006010 tx=0x7f37f400b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.266+0000 7f38167b1b80 1 Processor -- start 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.266+0000 7f38167b1b80 1 -- start start 2023-03-17T10:33:18.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e630ff410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630f9830 0x560e630f9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 0x560e63105dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38167b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e62ffc010 con 0x560e630fa1e0 2023-03-17T10:33:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38167b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6304e950 con 0x560e630f9830 2023-03-17T10:33:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38167b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e63047de0 con 0x560e630ff040 2023-03-17T10:33:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 0x560e63105dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 0x560e63105dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50904/0 (socket says 172.21.15.35:50904) 2023-03-17T10:33:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 -- 172.21.15.35:0/3070286747 learned_addr learned my addr 172.21.15.35:0/3070286747 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3803fff700 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e630ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f38037fe700 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630f9830 0x560e630f9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 -- 172.21.15.35:0/3070286747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 msgr2=0x560e630ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e630ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 -- 172.21.15.35:0/3070286747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630f9830 msgr2=0x560e630f9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630f9830 0x560e630f9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 -- 172.21.15.35:0/3070286747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e62ec95d0 con 0x560e630fa1e0 2023-03-17T10:33:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 0x560e63105dd0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f37fc09f490 tx=0x7f37fc097670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7510ee6980e8b49 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f37ea7fc700 1 -- 172.21.15.35:0/3070286747 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00ddd0 con 0x560e630fa1e0 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f37ea7fc700 1 -- 172.21.15.35:0/3070286747 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37fc0977d0 con 0x560e630fa1e0 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.267+0000 7f37ea7fc700 1 -- 172.21.15.35:0/3070286747 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc097d00 con 0x560e630fa1e0 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 -- 172.21.15.35:0/3070286747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 msgr2=0x560e63105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 0x560e63105dd0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f37fc09f490 tx=0x7f37fc097670 comp rx=0 tx=0).stop 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 -- 172.21.15.35:0/3070286747 shutdown_connections 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630fa1e0 0x560e63105dd0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e630ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3070286747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630f9830 0x560e630f9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 -- 172.21.15.35:0/3070286747 >> 172.21.15.35:0/3070286747 conn(0x560e62f526b0 msgr2=0x560e630efa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 -- 172.21.15.35:0/3070286747 shutdown_connections 2023-03-17T10:33:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.268+0000 7f38167b1b80 1 -- 172.21.15.35:0/3070286747 wait complete. 2023-03-17T10:33:29.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 -- start start 2023-03-17T10:33:31.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 Processor -- start 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e63105d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630fa1e0 0x560e63103030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e63103770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e62ecb8c0 con 0x560e630f9830 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e63103ee0 con 0x560e630fa1e0 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.269+0000 7f38167b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6310f480 con 0x560e630ff040 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f38167b1b80 10 client.0 _ll_register_callbacks cb 0x560e62eed230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e63105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e63105d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50906/0 (socket says 172.21.15.35:50906) 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 -- 172.21.15.35:0/1450956307 learned_addr learned my addr 172.21.15.35:0/1450956307 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3808bc1700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e63103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f38037fe700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630fa1e0 0x560e63103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:31.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 -- 172.21.15.35:0/1450956307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 msgr2=0x560e63103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e63103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 -- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630fa1e0 msgr2=0x560e63103030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630fa1e0 0x560e63103030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 -- 172.21.15.35:0/1450956307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380410ff70 con 0x560e630f9830 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f3803fff700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e63105d40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f37f400beb0 tx=0x7f37f401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61d40939c82ed21 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f37e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f37e37fe700 1 -- 172.21.15.35:0/1450956307 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400bee0 con 0x560e630f9830 2023-03-17T10:33:31.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e6300a390 con 0x560e630f9830 2023-03-17T10:33:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f37e37fe700 1 -- 172.21.15.35:0/1450956307 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37f4030420 con 0x560e630f9830 2023-03-17T10:33:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f37e37fe700 1 -- 172.21.15.35:0/1450956307 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f40305e0 con 0x560e630f9830 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f38167b1b80 10 client.18996 fetch_fsmap learned FSMap version 45 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.270+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560e62e75d80 con 0x560e630f9830 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f37e37fe700 1 -- 172.21.15.35:0/1450956307 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e6300a390 con 0x560e630f9830 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f37e37fe700 1 -- 172.21.15.35:0/1450956307 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f37f4024870 con 0x560e630f9830 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38167b1b80 10 client.18996 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38167b1b80 10 client.18996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38167b1b80 20 client.18996 populate_metadata read hostname 'smithi035' 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38167b1b80 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e63113620 0x560e63115a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38167b1b80 4 client.18996 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e63016600 con 0x560e63113620 2023-03-17T10:33:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.271+0000 7f38037fe700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e63113620 0x560e63115a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38037fe700 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e63113620 0x560e63115a30 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7105daeeaaefe44 server_cookie=7eaec05f8af685f1 in_seq=0 out_seq=0 2023-03-17T10:33:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f37e37fe700 10 client.18996 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:33:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f37e37fe700 1 -- 172.21.15.35:0/1450956307 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560e63016600 con 0x560e63113620 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f37e37fe700 10 client.18996 handle_command_reply: tid=0 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 client.18996 shutdown 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 msgr2=0x560e63105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e63105d40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f37f400beb0 tx=0x7f37f401a050 comp rx=0 tx=0).stop 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 shutdown_connections 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e63113620 0x560e63115a30 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630ff040 0x560e63103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f37e37fe700 0 client.18996 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:33:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e63105d40 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:36.272 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223582 2.49 MB/sec execute 352 sec latency 1753.434 ms 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bee13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bf434b0 con 0x561a3beda630 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bf435f0 con 0x561a3bed57d0 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3bf43760 con 0x561a3bed60e0 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7d3564b80 10 client.0 _ll_register_callbacks cb 0x561a3bccd290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7c5974700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bee13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:36.273 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7c5173700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:36.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7c5974700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bee13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52124/0 (socket says 172.21.15.35:52124) 2023-03-17T10:33:36.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7c5974700 1 -- 172.21.15.35:0/1166407234 learned_addr learned my addr 172.21.15.35:0/1166407234 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:36.274 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.246+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:37.442 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5173700 1 -- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 msgr2=0x561a3bee0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5173700 1 -- 172.21.15.35:0/1166407234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 msgr2=0x561a3bee13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bee13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5173700 1 -- 172.21.15.35:0/1166407234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a3bc55de0 con 0x561a3bed57d0 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5974700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bee13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7c5173700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee0950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc011730 tx=0x7fa7bc010d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fd400412fa4b34 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:37.957 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:33:39.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1166407234 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0340d0 con 0x561a3bed57d0 2023-03-17T10:33:39.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a3bea5240 con 0x561a3bed57d0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1166407234 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa7bc017070 con 0x561a3bed57d0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1166407234 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7bc034230 con 0x561a3bed57d0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7d3564b80 10 client.28649 fetch_fsmap learned FSMap version 50 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x561a3bca9630 con 0x561a3bed57d0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1166407234 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7bc04d020 con 0x561a3bed57d0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.247+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1166407234 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa7bc024030 con 0x561a3bed57d0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 10 client.28649 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 10 client.28649 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 20 client.28649 populate_metadata read hostname 'smithi035' 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3bf449c0 0x561a3bf46da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 4 client.28649 mds_command: new command op to 24445 tid=0[{"prefix": "damage ls"}] 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561a3bcabf60 con 0x561a3bf449c0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3bf449c0 0x561a3bf46da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7a8ff9700 10 client.28649 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T10:33:39.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7c4972700 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3bf449c0 0x561a3bf46da0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=122462b5dd08c3e server_cookie=cb932d1b28a33c1c in_seq=0 out_seq=0 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7a8ff9700 1 -- 172.21.15.35:0/1166407234 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561a3bcabf60 con 0x561a3bf449c0 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7a8ff9700 10 client.28649 handle_command_reply: tid=0 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 client.28649 shutdown 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 msgr2=0x561a3bee0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee0950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc011730 tx=0x7fa7bc010d60 comp rx=0 tx=0).stop 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 shutdown_connections 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x561a3bf449c0 0x561a3bf46da0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.859 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a3beda630 0x561a3bee13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a3bed57d0 0x561a3bee0950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7a8ff9700 0 client.28649 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 --2- 172.21.15.35:0/1166407234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a3bed60e0 0x561a3bee0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.248+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 >> 172.21.15.35:0/1166407234 conn(0x561a3bed0030 msgr2=0x561a3bed86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 shutdown_connections 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7d3564b80 1 -- 172.21.15.35:0/1166407234 wait complete. 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7d3564b80 20 client.28649 trim_cache size 0 max 16384 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa7ac09f640 msgr2=0x7fa7ac0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa7ac09f640 0x7fa7ac0a1af0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005950 tx=0x7fa7bc00b500 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ffd20 msgr2=0x7fa7c010ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ffd20 0x7fa7c010ba00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00098e0 tx=0x7fa7b000f690 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 shutdown_connections 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa7ac09f640 0x7fa7ac0a1af0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7c01043c0 0x7fa7c019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa7c00ff380 0x7fa7c010b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 --2- 172.21.15.35:0/1486086754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7c00ffd20 0x7fa7c010ba00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:39.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 >> 172.21.15.35:0/1486086754 conn(0x7fa7c0076300 msgr2=0x7fa7c0100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:39.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 shutdown_connections 2023-03-17T10:33:39.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:21:59.249+0000 7fa7c73d7700 1 -- 172.21.15.35:0/1486086754 wait complete. 2023-03-17T10:33:39.861 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:22 smithi035 ceph-mon[92535]: pgmap v3152: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:23 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:23 smithi035 ceph-mon[92535]: pgmap v3153: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.7 MiB/s wr, 153 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:24 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:25 smithi035 ceph-mon[92535]: pgmap v3154: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.0 MiB/s wr, 97 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:27 smithi035 ceph-mon[92535]: pgmap v3155: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.2 MiB/s wr, 110 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:30 smithi035 ceph-mon[92535]: pgmap v3156: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 677 KiB/s wr, 52 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:32 smithi035 ceph-mon[92535]: pgmap v3157: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 677 KiB/s wr, 52 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:33 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:33 smithi035 ceph-mon[92535]: pgmap v3158: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.1 MiB/s wr, 108 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:36 smithi035 ceph-mon[92535]: pgmap v3159: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 599 KiB/s wr, 68 op/s 2023-03-17T10:33:41.010 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:37 smithi035 ceph-mon[92535]: pgmap v3160: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T10:33:41.365 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:40 smithi035 ceph-mon[92535]: pgmap v3161: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 918 KiB/s wr, 90 op/s 2023-03-17T10:33:41.365 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:42 smithi035 ceph-mon[92535]: pgmap v3162: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 918 KiB/s wr, 90 op/s 2023-03-17T10:33:41.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:44 smithi035 ceph-mon[92535]: pgmap v3163: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 955 KiB/s wr, 100 op/s 2023-03-17T10:33:41.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:33:41.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:33:41.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:33:41.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:33:41.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:45 smithi035 ceph-mon[92535]: pgmap v3164: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 544 KiB/s wr, 49 op/s 2023-03-17T10:33:41.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:45 smithi035 ceph-mon[92535]: pgmap v3165: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 667 KiB/s wr, 60 op/s 2023-03-17T10:33:41.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:47 smithi035 ceph-mon[92535]: pgmap v3166: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 KiB/s wr, 12 op/s 2023-03-17T10:33:41.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:49 smithi035 ceph-mon[92535]: pgmap v3167: 97 pgs: 97 active+clean; 134 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 665 KiB/s wr, 70 op/s 2023-03-17T10:33:41.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:51 smithi035 ceph-mon[92535]: pgmap v3168: 97 pgs: 97 active+clean; 134 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 665 KiB/s wr, 70 op/s 2023-03-17T10:33:41.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:52 smithi035 ceph-mon[92535]: pgmap v3169: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T10:33:41.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:55 smithi035 ceph-mon[92535]: pgmap v3170: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.2 MiB/s wr, 105 op/s 2023-03-17T10:33:41.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:57 smithi035 ceph-mon[92535]: pgmap v3171: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 1004 KiB/s wr, 87 op/s 2023-03-17T10:33:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:33:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:33:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:33:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:33:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 --2- 172.21.15.35:0/1450956307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630fa1e0 0x560e63103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.272+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 >> 172.21.15.35:0/1450956307 conn(0x560e62f526b0 msgr2=0x560e630f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.273+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 shutdown_connections 2023-03-17T10:33:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.273+0000 7f38167b1b80 1 -- 172.21.15.35:0/1450956307 wait complete. 2023-03-17T10:33:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.273+0000 7f38167b1b80 20 client.18996 trim_cache size 0 max 16384 2023-03-17T10:33:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 Processor -- start 2023-03-17T10:33:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 -- start start 2023-03-17T10:33:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e630fca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e630efac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e63110ce0 con 0x560e630f9830 2023-03-17T10:33:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e630eb0f0 con 0x560e630ff040 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38167b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e630f0000 con 0x560e630fa1e0 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e630fca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e630fca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50914/0 (socket says 172.21.15.35:50914) 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 -- 172.21.15.35:0/2235965656 learned_addr learned my addr 172.21.15.35:0/2235965656 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f38037fe700 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e630efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3808bc1700 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 -- 172.21.15.35:0/2235965656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 msgr2=0x560e630efac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e630efac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 -- 172.21.15.35:0/2235965656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 msgr2=0x560e631058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 -- 172.21.15.35:0/2235965656 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e6300e130 con 0x560e630f9830 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f3803fff700 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e630fca60 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f37f4005850 tx=0x7f37f400fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad48a01dc0f01ff6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f37eaffd700 1 -- 172.21.15.35:0/2235965656 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400bee0 con 0x560e630f9830 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.288+0000 7f37eaffd700 1 -- 172.21.15.35:0/2235965656 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37f401e040 con 0x560e630f9830 2023-03-17T10:33:43.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f37eaffd700 1 -- 172.21.15.35:0/2235965656 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4018ab0 con 0x560e630f9830 2023-03-17T10:33:43.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 -- 172.21.15.35:0/2235965656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 msgr2=0x560e630fca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e630fca60 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f37f4005850 tx=0x7f37f400fa20 comp rx=0 tx=0).stop 2023-03-17T10:33:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 -- 172.21.15.35:0/2235965656 shutdown_connections 2023-03-17T10:33:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e630fca60 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 --2- 172.21.15.35:0/2235965656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e630efac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 -- 172.21.15.35:0/2235965656 >> 172.21.15.35:0/2235965656 conn(0x560e62f526b0 msgr2=0x560e630fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 -- 172.21.15.35:0/2235965656 shutdown_connections 2023-03-17T10:33:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 -- 172.21.15.35:0/2235965656 wait complete. 2023-03-17T10:33:44.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.289+0000 7f38167b1b80 1 -- start start 2023-03-17T10:33:44.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 Processor -- start 2023-03-17T10:33:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e631095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e63109b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6310a440 con 0x560e630f9830 2023-03-17T10:33:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e63177a10 con 0x560e630ff040 2023-03-17T10:33:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e63177b50 con 0x560e630fa1e0 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e631095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38167b1b80 10 client.0 _ll_register_callbacks cb 0x560e62eed230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e631095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50920/0 (socket says 172.21.15.35:50920) 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 -- 172.21.15.35:0/3023008844 learned_addr learned my addr 172.21.15.35:0/3023008844 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38037fe700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e63109b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 -- 172.21.15.35:0/3023008844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 msgr2=0x560e63109b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e63109b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 -- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 msgr2=0x560e631774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 -- 172.21.15.35:0/3023008844 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e62e75d80 con 0x560e630f9830 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3808bc1700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:33:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f38037fe700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e63109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:33:47.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f3803fff700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e631095f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009ce0 tx=0x7f37f40247f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d3cbc738810ed9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:47.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.290+0000 7f37e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:33:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f37e37fe700 1 -- 172.21.15.35:0/3023008844 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4005a00 con 0x560e630f9830 2023-03-17T10:33:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f37e37fe700 1 -- 172.21.15.35:0/3023008844 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(240..240 src has 1..240) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37f400be80 con 0x560e630f9830 2023-03-17T10:33:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e630c51e0 con 0x560e630f9830 2023-03-17T10:33:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f37e37fe700 1 -- 172.21.15.35:0/3023008844 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37f4018520 con 0x560e630f9830 2023-03-17T10:33:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 10 client.19002 fetch_fsmap learned FSMap version 45 2023-03-17T10:33:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560e62e9c1f0 con 0x560e630f9830 2023-03-17T10:33:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f37e37fe700 1 -- 172.21.15.35:0/3023008844 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e630c51e0 con 0x560e630f9830 2023-03-17T10:33:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f37e37fe700 1 -- 172.21.15.35:0/3023008844 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f37f4044a20 con 0x560e630f9830 2023-03-17T10:33:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 10 client.19002 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:33:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 10 client.19002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:33:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 20 client.19002 populate_metadata read hostname 'smithi035' 2023-03-17T10:33:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e6315d890 0x560e6315fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 4 client.19002 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:33:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e62ecbf00 con 0x560e6315d890 2023-03-17T10:33:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.291+0000 7f38037fe700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e6315d890 0x560e6315fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.292+0000 7f38037fe700 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e6315d890 0x560e6315fca0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea4a10e9a06bd7 server_cookie=a1859aac8ec7ae3c in_seq=0 out_seq=0 2023-03-17T10:33:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.292+0000 7f37e37fe700 10 client.19002 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:33:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f37e37fe700 1 -- 172.21.15.35:0/3023008844 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e62ecbf00 con 0x560e6315d890 2023-03-17T10:33:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f37e37fe700 10 client.19002 handle_command_reply: tid=0 2023-03-17T10:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 client.19002 shutdown 2023-03-17T10:33:52.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 msgr2=0x560e631095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e631095f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009ce0 tx=0x7f37f40247f0 comp rx=0 tx=0).stop 2023-03-17T10:33:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 shutdown_connections 2023-03-17T10:33:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560e6315d890 0x560e6315fca0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e630ff040 0x560e631774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560e630f9830 0x560e631095f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 --2- 172.21.15.35:0/3023008844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560e630fa1e0 0x560e63109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f37e37fe700 0 client.19002 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 >> 172.21.15.35:0/3023008844 conn(0x560e62f526b0 msgr2=0x560e630fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 shutdown_connections 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 1 -- 172.21.15.35:0/3023008844 wait complete. 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.301+0000 7f38167b1b80 20 client.19002 trim_cache size 0 max 16384 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37ec09f640 msgr2=0x7f37ec0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37ec09f640 0x7f37ec0a1af0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37f4006010 tx=0x7f37f400b260 comp rx=0 tx=0).stop 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 msgr2=0x7f380419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 0x7f380419ac00 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f37fc007ee0 tx=0x7f37fc00d3b0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 shutdown_connections 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37ec09f640 0x7f37ec0a1af0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f380410a750 0x7f380419ac00 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3804101410 0x7f3804196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 --2- 172.21.15.35:0/3778968033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3804101d20 0x7f38041967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 >> 172.21.15.35:0/3778968033 conn(0x7f3804076330 msgr2=0x7f38041021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 shutdown_connections 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:07:07.302+0000 7f380a624700 1 -- 172.21.15.35:0/3778968033 wait complete. 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 -- 172.21.15.35:0/1097870564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ffcf0 msgr2=0x7fabbc103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/1097870564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ffcf0 0x7fabbc103cb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fabb00099c0 tx=0x7fabb0009cd0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 -- 172.21.15.35:0/1097870564 shutdown_connections 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/1097870564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc104390 0x7fabbc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/1097870564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabbc0ff350 0x7fabbc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/1097870564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ffcf0 0x7fabbc103cb0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 -- 172.21.15.35:0/1097870564 >> 172.21.15.35:0/1097870564 conn(0x7fabbc076330 msgr2=0x7fabbc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:33:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 -- 172.21.15.35:0/1097870564 shutdown_connections 2023-03-17T10:33:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.932+0000 7fabc3ba4700 1 -- 172.21.15.35:0/1097870564 wait complete. 2023-03-17T10:33:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 Processor -- start 2023-03-17T10:33:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 -- start start 2023-03-17T10:33:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 0x7fabbc197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabbc0ffcf0 0x7fabbc1975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc104390 0x7fabbc1a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc197eb0 con 0x7fabbc0ff350 2023-03-17T10:33:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1a2650 con 0x7fabbc0ffcf0 2023-03-17T10:33:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc3ba4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc1a2790 con 0x7fabbc104390 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.933+0000 7fabc1940700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 0x7fabbc197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 0x7fabbc197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50930/0 (socket says 172.21.15.35:50930) 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 -- 172.21.15.35:0/757816160 learned_addr learned my addr 172.21.15.35:0/757816160 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc113f700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabbc0ffcf0 0x7fabbc1975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc2141700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc104390 0x7fabbc1a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 -- 172.21.15.35:0/757816160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc104390 msgr2=0x7fabbc1a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc104390 0x7fabbc1a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 -- 172.21.15.35:0/757816160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabbc0ffcf0 msgr2=0x7fabbc1975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabbc0ffcf0 0x7fabbc1975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 -- 172.21.15.35:0/757816160 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00095f0 con 0x7fabbc0ff350 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc1940700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 0x7fabbc197090 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c9b0 tx=0x7fabb800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabaeffd700 1 -- 172.21.15.35:0/757816160 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8007b00 con 0x7fabbc0ff350 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabaeffd700 1 -- 172.21.15.35:0/757816160 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabb8007c60 con 0x7fabbc0ff350 2023-03-17T10:33:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabaeffd700 1 -- 172.21.15.35:0/757816160 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8018660 con 0x7fabbc0ff350 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc10efc0 con 0x7fabbc0ff350 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.934+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc10ee30 con 0x7fabbc0ff350 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.937+0000 7fabaeffd700 1 -- 172.21.15.35:0/757816160 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fabb800f450 con 0x7fabbc0ff350 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.937+0000 7fabaeffd700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faba809f640 0x7faba80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.938+0000 7fabc113f700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faba809f640 0x7faba80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.938+0000 7fabaeffd700 1 -- 172.21.15.35:0/757816160 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fabb80ca6e0 con 0x7fabbc0ff350 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.938+0000 7fabc113f700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faba809f640 0x7faba80a1af0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabb000b580 tx=0x7fabb0005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.938+0000 7fabcfd31b80 1 Processor -- start 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 -- start start 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d39fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d34420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d34d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:33:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03c3b010 con 0x55af03d3a4f0 2023-03-17T10:33:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03c8d950 con 0x55af03d39be0 2023-03-17T10:33:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03c86de0 con 0x55af03d34960 2023-03-17T10:33:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d34420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d34420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50938/0 (socket says 172.21.15.35:50938) 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 -- 172.21.15.35:0/2151215700 learned_addr learned my addr 172.21.15.35:0/2151215700 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc1940700 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d39fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc2141700 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d34d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 -- 172.21.15.35:0/2151215700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 msgr2=0x55af03d34d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d34d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 -- 172.21.15.35:0/2151215700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 msgr2=0x55af03d39fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d39fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.939+0000 7fabc113f700 1 -- 172.21.15.35:0/2151215700 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af03b085d0 con 0x55af03d3a4f0 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.940+0000 7fabc113f700 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d34420 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fabb00099c0 tx=0x7fabb001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1bfae75b7baefd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:33:59.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.940+0000 7faba7fff700 1 -- 172.21.15.35:0/2151215700 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb002b070 con 0x55af03d3a4f0 2023-03-17T10:33:59.783 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T10:33:59.783 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223649 2.49 MB/sec execute 353 sec latency 1978.106 ms 2023-03-17T10:33:59.783 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223649 2.48 MB/sec execute 354 sec latency 1485.340 ms 2023-03-17T10:33:59.783 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223649 2.47 MB/sec execute 355 sec latency 2485.448 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223649 2.47 MB/sec execute 356 sec latency 3485.573 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223716 2.46 MB/sec execute 357 sec latency 4291.174 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 223943 2.46 MB/sec execute 358 sec latency 15.581 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 224272 2.45 MB/sec execute 359 sec latency 18.242 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 224749 2.45 MB/sec execute 360 sec latency 13.099 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 225217 2.45 MB/sec execute 361 sec latency 22.265 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 225815 2.45 MB/sec execute 362 sec latency 26.221 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 226272 2.45 MB/sec execute 363 sec latency 30.587 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 226837 2.46 MB/sec execute 364 sec latency 12.643 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227128 2.46 MB/sec execute 365 sec latency 424.272 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227128 2.45 MB/sec execute 366 sec latency 1424.321 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227128 2.45 MB/sec execute 367 sec latency 2424.438 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227195 2.44 MB/sec execute 368 sec latency 2652.323 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227195 2.43 MB/sec execute 369 sec latency 1504.916 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227195 2.43 MB/sec execute 370 sec latency 2505.054 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227195 2.42 MB/sec execute 371 sec latency 3505.168 ms 2023-03-17T10:33:59.784 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227195 2.41 MB/sec execute 372 sec latency 4505.247 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227207 2.41 MB/sec execute 373 sec latency 4727.740 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227339 2.40 MB/sec execute 374 sec latency 1218.589 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227559 2.40 MB/sec execute 375 sec latency 14.831 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 227960 2.39 MB/sec execute 376 sec latency 18.673 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 228466 2.40 MB/sec execute 377 sec latency 19.033 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 228903 2.39 MB/sec execute 378 sec latency 62.719 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 229453 2.39 MB/sec execute 379 sec latency 29.569 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230031 2.40 MB/sec execute 380 sec latency 14.385 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230447 2.40 MB/sec execute 381 sec latency 14.996 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230672 2.40 MB/sec execute 382 sec latency 698.092 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230739 2.39 MB/sec execute 383 sec latency 926.156 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230739 2.39 MB/sec execute 384 sec latency 1502.714 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230739 2.38 MB/sec execute 385 sec latency 2502.810 ms 2023-03-17T10:33:59.785 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230739 2.37 MB/sec execute 386 sec latency 3502.904 ms 2023-03-17T10:34:00.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230739 2.37 MB/sec execute 387 sec latency 4503.006 ms 2023-03-17T10:34:00.355 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230751 2.36 MB/sec execute 388 sec latency 4729.174 ms 2023-03-17T10:34:00.357 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-03-17T10:34:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.940+0000 7faba7fff700 1 -- 172.21.15.35:0/2151215700 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabb001e040 con 0x55af03d3a4f0 2023-03-17T10:34:03.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.940+0000 7faba7fff700 1 -- 172.21.15.35:0/2151215700 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004c30 con 0x55af03d3a4f0 2023-03-17T10:34:03.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.940+0000 7fabcfd31b80 1 -- 172.21.15.35:0/2151215700 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 msgr2=0x55af03d34420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:05.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.940+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d34420 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fabb00099c0 tx=0x7fabb001f000 comp rx=0 tx=0).stop 2023-03-17T10:34:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 -- 172.21.15.35:0/2151215700 shutdown_connections 2023-03-17T10:34:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d34d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d39fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/2151215700 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d34420 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 -- 172.21.15.35:0/2151215700 >> 172.21.15.35:0/2151215700 conn(0x55af03b916b0 msgr2=0x55af03d2ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 -- 172.21.15.35:0/2151215700 shutdown_connections 2023-03-17T10:34:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 -- 172.21.15.35:0/2151215700 wait complete. 2023-03-17T10:34:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 -- start start 2023-03-17T10:34:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.941+0000 7fabcfd31b80 1 Processor -- start 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d3dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03b0a8c0 con 0x55af03d3a4f0 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d3e4a0 con 0x55af03d39be0 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d49fa0 con 0x55af03d34960 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 10 client.0 _ll_register_callbacks cb 0x55af03b2c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d3dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:05.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc113f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d3dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50948/0 (socket says 172.21.15.35:50948) 2023-03-17T10:34:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 -- 172.21.15.35:0/1284846549 learned_addr learned my addr 172.21.15.35:0/1284846549 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc1940700 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 -- 172.21.15.35:0/1284846549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 msgr2=0x55af03d404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 -- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 msgr2=0x55af03d3d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 -- 172.21.15.35:0/1284846549 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc10c7a0 con 0x55af03d3a4f0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabc2141700 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d3dd60 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007fd0 tx=0x7fabb4008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbecb7b63472f055 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7faba57fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7faba57fa700 1 -- 172.21.15.35:0/1284846549 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4010bc0 con 0x55af03d3a4f0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7faba57fa700 1 -- 172.21.15.35:0/1284846549 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fabb4010d20 con 0x55af03d3a4f0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.942+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af03c49390 con 0x55af03d3a4f0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7faba57fa700 1 -- 172.21.15.35:0/1284846549 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb4010ee0 con 0x55af03d3a4f0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 10 client.19014 fetch_fsmap learned FSMap version 45 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55af03ab4d80 con 0x55af03d3a4f0 2023-03-17T10:34:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7faba57fa700 1 -- 172.21.15.35:0/1284846549 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55af03c49390 con 0x55af03d3a4f0 2023-03-17T10:34:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7faba57fa700 1 -- 172.21.15.35:0/1284846549 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fabb4015460 con 0x55af03d3a4f0 2023-03-17T10:34:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 10 client.19014 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:34:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 10 client.19014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 20 client.19014 populate_metadata read hostname 'smithi035' 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03d4e0d0 0x55af03d504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 4 client.19014 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af03c55600 con 0x55af03d4e0d0 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.943+0000 7fabc1940700 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03d4e0d0 0x55af03d504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.944+0000 7faba57fa700 10 client.19014 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.944+0000 7fabc1940700 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03d4e0d0 0x55af03d504e0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4785e526b0f84097 server_cookie=2c6630c1207d8ba1 in_seq=0 out_seq=0 2023-03-17T10:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.944+0000 7faba57fa700 1 -- 172.21.15.35:0/1284846549 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55af03c55600 con 0x55af03d4e0d0 2023-03-17T10:34:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.944+0000 7faba57fa700 10 client.19014 handle_command_reply: tid=0 2023-03-17T10:34:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.944+0000 7fabcfd31b80 1 client.19014 shutdown 2023-03-17T10:34:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 msgr2=0x55af03d3dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d3dd60 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007fd0 tx=0x7fabb4008ef0 comp rx=0 tx=0).stop 2023-03-17T10:34:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 shutdown_connections 2023-03-17T10:34:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03d4e0d0 0x55af03d504e0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d3dd60 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1284846549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7faba57fa700 0 client.19014 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 >> 172.21.15.35:0/1284846549 conn(0x55af03b916b0 msgr2=0x55af03d33410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 shutdown_connections 2023-03-17T10:34:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1284846549 wait complete. 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.945+0000 7fabcfd31b80 20 client.19014 trim_cache size 0 max 16384 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 Processor -- start 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 -- start start 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d44ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d37650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d2fe40 con 0x55af03d3a4f0 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03c55600 con 0x55af03d39be0 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d2a0d0 con 0x55af03d34960 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d37650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d37650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50956/0 (socket says 172.21.15.35:50956) 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 -- 172.21.15.35:0/1825994481 learned_addr learned my addr 172.21.15.35:0/1825994481 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc113f700 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc1940700 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d44ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 -- 172.21.15.35:0/1825994481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 msgr2=0x55af03d44ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d44ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 -- 172.21.15.35:0/1825994481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 msgr2=0x55af03d3ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.960+0000 7fabc2141700 1 -- 172.21.15.35:0/1825994481 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af03d35000 con 0x55af03d3a4f0 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabc2141700 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d37650 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fabb4002230 tx=0x7fabb40105f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f1c4a9af87464f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabacdae700 1 -- 172.21.15.35:0/1825994481 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40159e0 con 0x55af03d3a4f0 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabacdae700 1 -- 172.21.15.35:0/1825994481 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabb4015b40 con 0x55af03d3a4f0 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabacdae700 1 -- 172.21.15.35:0/1825994481 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4010c40 con 0x55af03d3a4f0 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1825994481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 msgr2=0x55af03d37650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d37650 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fabb4002230 tx=0x7fabb40105f0 comp rx=0 tx=0).stop 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1825994481 shutdown_connections 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d3a4f0 0x55af03d37650 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d34960 0x55af03d44ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1825994481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d3ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1825994481 >> 172.21.15.35:0/1825994481 conn(0x55af03b916b0 msgr2=0x55af03d49680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1825994481 shutdown_connections 2023-03-17T10:34:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.961+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1825994481 wait complete. 2023-03-17T10:34:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 -- start start 2023-03-17T10:34:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 Processor -- start 2023-03-17T10:34:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 0x55af03d9a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d9a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d3a4f0 0x55af03d95f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d965a0 con 0x55af03d34960 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d96710 con 0x55af03d39be0 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af03d968d0 con 0x55af03d3a4f0 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabcfd31b80 10 client.0 _ll_register_callbacks cb 0x55af03b2c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabc1940700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 0x55af03d9a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabc1940700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 0x55af03d9a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50958/0 (socket says 172.21.15.35:50958) 2023-03-17T10:34:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.962+0000 7fabc1940700 1 -- 172.21.15.35:0/1783912383 learned_addr learned my addr 172.21.15.35:0/1783912383 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc113f700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d9a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc2141700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d3a4f0 0x55af03d95f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc1940700 1 -- 172.21.15.35:0/1783912383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d3a4f0 msgr2=0x55af03d95f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc1940700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d3a4f0 0x55af03d95f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc1940700 1 -- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 msgr2=0x55af03d9a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc1940700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d9a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc1940700 1 -- 172.21.15.35:0/1783912383 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af03ab4d80 con 0x55af03d34960 2023-03-17T10:34:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc2141700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d3a4f0 0x55af03d95f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:34:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabc1940700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 0x55af03d9a300 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fabb8094c00 tx=0x7fabb8094580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425ba349130cd8c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7faba57fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:34:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7faba57fa700 1 -- 172.21.15.35:0/1783912383 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80a0380 con 0x55af03d34960 2023-03-17T10:34:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7faba57fa700 1 -- 172.21.15.35:0/1783912383 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fabb80b0070 con 0x55af03d34960 2023-03-17T10:34:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af03d041e0 con 0x55af03d34960 2023-03-17T10:34:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7faba57fa700 1 -- 172.21.15.35:0/1783912383 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb800f700 con 0x55af03d34960 2023-03-17T10:34:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabcfd31b80 10 client.19020 fetch_fsmap learned FSMap version 45 2023-03-17T10:34:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55af03a9dc00 con 0x55af03d34960 2023-03-17T10:34:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.963+0000 7faba57fa700 1 -- 172.21.15.35:0/1783912383 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55af03d041e0 con 0x55af03d34960 2023-03-17T10:34:14.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7faba57fa700 1 -- 172.21.15.35:0/1783912383 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fabb80983f0 con 0x55af03d34960 2023-03-17T10:34:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabcfd31b80 10 client.19020 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:34:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabcfd31b80 10 client.19020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:34:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabcfd31b80 20 client.19020 populate_metadata read hostname 'smithi035' 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03da3270 0x55af03da5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabcfd31b80 4 client.19020 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55af03b0af00 con 0x55af03da3270 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabc113f700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03da3270 0x55af03da5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7fabc113f700 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03da3270 0x55af03da5680 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b95aada0fe6a5e server_cookie=879c070d8ab8490c in_seq=0 out_seq=0 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.964+0000 7faba57fa700 10 client.19020 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7faba57fa700 1 -- 172.21.15.35:0/1783912383 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55af03b0af00 con 0x55af03da3270 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7faba57fa700 10 client.19020 handle_command_reply: tid=0 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 client.19020 shutdown 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 msgr2=0x55af03d9a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 0x55af03d9a300 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fabb8094c00 tx=0x7fabb8094580 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 shutdown_connections 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55af03da3270 0x55af03da5680 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55af03d3a4f0 0x55af03d95f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55af03d34960 0x55af03d9a300 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 --2- 172.21.15.35:0/1783912383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55af03d39be0 0x55af03d9a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7faba57fa700 0 client.19020 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 >> 172.21.15.35:0/1783912383 conn(0x55af03b916b0 msgr2=0x55af03d37650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 shutdown_connections 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 1 -- 172.21.15.35:0/1783912383 wait complete. 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.974+0000 7fabcfd31b80 20 client.19020 trim_cache size 0 max 16384 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faba809f640 msgr2=0x7faba80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faba809f640 0x7faba80a1af0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabb000b580 tx=0x7fabb0005c00 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 msgr2=0x7fabbc197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 0x7fabbc197090 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c9b0 tx=0x7fabb800cd70 comp rx=0 tx=0).stop 2023-03-17T10:34:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 shutdown_connections 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faba809f640 0x7faba80a1af0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabbc104390 0x7fabbc1a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fabbc0ff350 0x7fabbc197090 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 --2- 172.21.15.35:0/757816160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabbc0ffcf0 0x7fabbc1975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 >> 172.21.15.35:0/757816160 conn(0x7fabbc076330 msgr2=0x7fabbc102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 shutdown_connections 2023-03-17T10:34:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:18.975+0000 7fabc3ba4700 1 -- 172.21.15.35:0/757816160 wait complete. 2023-03-17T10:34:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/1699035453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc40ff350 msgr2=0x7f8cc40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/1699035453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc40ff350 0x7f8cc40ff720 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40099c0 tx=0x7f8cb4009cd0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/1699035453 shutdown_connections 2023-03-17T10:34:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/1699035453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc4104390 0x7f8cc410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/1699035453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc40ff350 0x7f8cc40ff720 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:21.291 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230751 2.36 MB/sec execute 389 sec latency 1706.161 ms 2023-03-17T10:34:21.292 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:22:59 smithi035 ceph-mon[92535]: pgmap v3172: 97 pgs: 97 active+clean; 136 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.0 MiB/s wr, 98 op/s 2023-03-17T10:34:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/1699035453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 0x7f8cc4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/1699035453 >> 172.21.15.35:0/1699035453 conn(0x7f8cc4076330 msgr2=0x7f8cc4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/1699035453 shutdown_connections 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.098+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/1699035453 wait complete. 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 Processor -- start 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 -- start start 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc40ff350 0x7f8cc4196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 0x7f8cc4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 0x7f8cc41a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4197e40 con 0x7f8cc4104390 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41a2580 con 0x7f8cc40ffcf0 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8ccb6b8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41a2740 con 0x7f8cc40ff350 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8cc9c55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 0x7f8cc41a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8cc9c55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 0x7f8cc41a2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50974/0 (socket says 172.21.15.35:50974) 2023-03-17T10:34:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8cc9c55700 1 -- 172.21.15.35:0/754233422 learned_addr learned my addr 172.21.15.35:0/754233422 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:27.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.099+0000 7f8cc9454700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc40ff350 0x7f8cc4196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:27.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 0x7f8cc4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:27.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9c55700 1 -- 172.21.15.35:0/754233422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc40ff350 msgr2=0x7f8cc4196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:27.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc40ff350 0x7f8cc4196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:27.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9c55700 1 -- 172.21.15.35:0/754233422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 msgr2=0x7f8cc4197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 0x7f8cc4197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9c55700 1 -- 172.21.15.35:0/754233422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40095f0 con 0x7f8cc4104390 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9454700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc40ff350 0x7f8cc4196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 0x7f8cc4197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 0x7f8cc41a2040 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc007d70 tx=0x7f8cbc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cba7fc700 1 -- 172.21.15.35:0/754233422 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00ad40 con 0x7f8cc4104390 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc410f000 con 0x7f8cc4104390 2023-03-17T10:34:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cba7fc700 1 -- 172.21.15.35:0/754233422 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cbc0128b0 con 0x7f8cc4104390 2023-03-17T10:34:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8cba7fc700 1 -- 172.21.15.35:0/754233422 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0116b0 con 0x7f8cc4104390 2023-03-17T10:34:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.100+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc410ee70 con 0x7f8cc4104390 2023-03-17T10:34:29.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.102+0000 7f8cba7fc700 1 -- 172.21.15.35:0/754233422 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8cbc012a20 con 0x7f8cc4104390 2023-03-17T10:34:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.103+0000 7f8cba7fc700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8cb009f640 0x7f8cb00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.103+0000 7f8cc9454700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8cb009f640 0x7f8cb00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.103+0000 7f8cba7fc700 1 -- 172.21.15.35:0/754233422 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8cbc0ca860 con 0x7f8cc4104390 2023-03-17T10:34:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.103+0000 7f8cc9454700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8cb009f640 0x7f8cb00a1af0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4000c00 tx=0x7f8cb4005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:29.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 Processor -- start 2023-03-17T10:34:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 -- start start 2023-03-17T10:34:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 0x562039c82fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039c7d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c7dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039b84010 con 0x562039c82be0 2023-03-17T10:34:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039bd6950 con 0x562039c834f0 2023-03-17T10:34:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039bcfde0 con 0x562039c7d960 2023-03-17T10:34:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cc9454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 0x562039c82fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cc9454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 0x562039c82fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50978/0 (socket says 172.21.15.35:50978) 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cc9454700 1 -- 172.21.15.35:0/494811340 learned_addr learned my addr 172.21.15.35:0/494811340 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c7dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.104+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039c7d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8cc9454700 1 -- 172.21.15.35:0/494811340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 msgr2=0x562039c7dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8cc9454700 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c7dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8cc9454700 1 -- 172.21.15.35:0/494811340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 msgr2=0x562039c7d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8cc9454700 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039c7d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8cc9454700 1 -- 172.21.15.35:0/494811340 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562039a515d0 con 0x562039c82be0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8cc9454700 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 0x562039c82fb0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40099c0 tx=0x7f8cb401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8dceafdbc29150 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8caf7fe700 1 -- 172.21.15.35:0/494811340 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb402b070 con 0x562039c82be0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8caf7fe700 1 -- 172.21.15.35:0/494811340 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cb401e040 con 0x562039c82be0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.105+0000 7f8caf7fe700 1 -- 172.21.15.35:0/494811340 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4004bf0 con 0x562039c82be0 2023-03-17T10:34:34.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 -- 172.21.15.35:0/494811340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 msgr2=0x562039c82fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 0x562039c82fb0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40099c0 tx=0x7f8cb401f000 comp rx=0 tx=0).stop 2023-03-17T10:34:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 -- 172.21.15.35:0/494811340 shutdown_connections 2023-03-17T10:34:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c7dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:34.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c82be0 0x562039c82fb0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/494811340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039c7d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 -- 172.21.15.35:0/494811340 >> 172.21.15.35:0/494811340 conn(0x562039ada6b0 msgr2=0x562039c77a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 -- 172.21.15.35:0/494811340 shutdown_connections 2023-03-17T10:34:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 -- 172.21.15.35:0/494811340 wait complete. 2023-03-17T10:34:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 -- start start 2023-03-17T10:34:36.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.106+0000 7f8cd7845b80 1 Processor -- start 2023-03-17T10:34:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c893e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c82be0 0x562039c86660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:36.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c86c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039a538c0 con 0x562039c834f0 2023-03-17T10:34:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039c87390 con 0x562039c82be0 2023-03-17T10:34:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039c92f40 con 0x562039c7d960 2023-03-17T10:34:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cd7845b80 10 client.0 _ll_register_callbacks cb 0x562039a75230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:34:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c86c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c86c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50988/0 (socket says 172.21.15.35:50988) 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 -- 172.21.15.35:0/972432568 learned_addr learned my addr 172.21.15.35:0/972432568 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9454700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c893e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c82be0 0x562039c86660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 -- 172.21.15.35:0/972432568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 msgr2=0x562039c893e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c893e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 -- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c82be0 msgr2=0x562039c86660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c82be0 0x562039c86660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 -- 172.21.15.35:0/972432568 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc410c7a0 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c82be0 0x562039c86660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c86c20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0c8100 tx=0x7f8cbc019460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e00a54f80c8de80 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cacff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.107+0000 7f8cacff9700 1 -- 172.21.15.35:0/972432568 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc098820 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cacff9700 1 -- 172.21.15.35:0/972432568 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8cbc0978b0 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562039b92390 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cacff9700 1 -- 172.21.15.35:0/972432568 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cbc097a70 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 10 client.19032 fetch_fsmap learned FSMap version 45 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5620399fdd80 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cacff9700 1 -- 172.21.15.35:0/972432568 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cbc0b6030 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cacff9700 1 -- 172.21.15.35:0/972432568 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8cbc0941b0 con 0x562039c834f0 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 10 client.19032 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 10 client.19032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 20 client.19032 populate_metadata read hostname 'smithi035' 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039c96fe0 0x562039c993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 4 client.19032 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:34:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562039b9e600 con 0x562039c96fe0 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.108+0000 7f8cc9454700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039c96fe0 0x562039c993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.109+0000 7f8cc9454700 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039c96fe0 0x562039c993f0 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1315b7fea16ec04b server_cookie=5ba006e55fcad36c in_seq=0 out_seq=0 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.109+0000 7f8cacff9700 10 client.19032 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.109+0000 7f8cacff9700 1 -- 172.21.15.35:0/972432568 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562039b9e600 con 0x562039c96fe0 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.109+0000 7f8cacff9700 10 client.19032 handle_command_reply: tid=0 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 client.19032 shutdown 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 msgr2=0x562039c86c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c86c20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0c8100 tx=0x7f8cbc019460 comp rx=0 tx=0).stop 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 shutdown_connections 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039c96fe0 0x562039c993f0 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c86c20 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cacff9700 0 client.19032 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c7d960 0x562039c893e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/972432568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c82be0 0x562039c86660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 >> 172.21.15.35:0/972432568 conn(0x562039ada6b0 msgr2=0x562039c7c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 shutdown_connections 2023-03-17T10:34:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 1 -- 172.21.15.35:0/972432568 wait complete. 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.110+0000 7f8cd7845b80 20 client.19032 trim_cache size 0 max 16384 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 Processor -- start 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 -- start start 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c7d960 0x562039c77ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039c8de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c80650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039c78000 con 0x562039c834f0 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039c730d0 con 0x562039c7d960 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039c811b0 con 0x562039c82be0 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cc9c55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c80650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cc9c55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c80650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50996/0 (socket says 172.21.15.35:50996) 2023-03-17T10:34:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cc9c55700 1 -- 172.21.15.35:0/3695398674 learned_addr learned my addr 172.21.15.35:0/3695398674 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039c8de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.125+0000 7f8cc9454700 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c7d960 0x562039c77ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cc9c55700 1 -- 172.21.15.35:0/3695398674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 msgr2=0x562039c8de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039c8de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cc9c55700 1 -- 172.21.15.35:0/3695398674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c7d960 msgr2=0x562039c77ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c7d960 0x562039c77ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cc9c55700 1 -- 172.21.15.35:0/3695398674 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562039b96130 con 0x562039c834f0 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c80650 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc007d40 tx=0x7f8cbc012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5a0d311cc892ee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8caffff700 1 -- 172.21.15.35:0/3695398674 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0b61b0 con 0x562039c834f0 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8caffff700 1 -- 172.21.15.35:0/3695398674 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cbc0b6040 con 0x562039c834f0 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8caffff700 1 -- 172.21.15.35:0/3695398674 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc097b10 con 0x562039c834f0 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3695398674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 msgr2=0x562039c80650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c80650 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc007d40 tx=0x7f8cbc012ef0 comp rx=0 tx=0).stop 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3695398674 shutdown_connections 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c834f0 0x562039c80650 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c7d960 0x562039c77ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3695398674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039c8de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.126+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3695398674 >> 172.21.15.35:0/3695398674 conn(0x562039ada6b0 msgr2=0x562039c92620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3695398674 shutdown_connections 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3695398674 wait complete. 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 -- start start 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 Processor -- start 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 0x562039ce3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039ce37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039cdee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039cdf4f0 con 0x562039c7d960 2023-03-17T10:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039cdf660 con 0x562039c834f0 2023-03-17T10:34:45.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562039cdf820 con 0x562039c82be0 2023-03-17T10:34:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cd7845b80 10 client.0 _ll_register_callbacks cb 0x562039a75230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:34:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cc9454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 0x562039ce3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cc9454700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 0x562039ce3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:50998/0 (socket says 172.21.15.35:50998) 2023-03-17T10:34:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.127+0000 7f8cc9454700 1 -- 172.21.15.35:0/3044340053 learned_addr learned my addr 172.21.15.35:0/3044340053 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:34:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039ce37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9c55700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039cdee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9454700 1 -- 172.21.15.35:0/3044340053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 msgr2=0x562039ce37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9454700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039ce37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9454700 1 -- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 msgr2=0x562039cdee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9454700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039cdee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9454700 1 -- 172.21.15.35:0/3044340053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620399fdd80 con 0x562039c7d960 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039ce37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cc9454700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 0x562039ce3280 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40099c0 tx=0x7f8cb4005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9af9378654c7c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cacff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cacff9700 1 -- 172.21.15.35:0/3044340053 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb402b040 con 0x562039c7d960 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562039c4d1e0 con 0x562039c7d960 2023-03-17T10:34:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cacff9700 1 -- 172.21.15.35:0/3044340053 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8cb400bd70 con 0x562039c7d960 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cacff9700 1 -- 172.21.15.35:0/3044340053 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cb40399d0 con 0x562039c7d960 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cd7845b80 10 client.19038 fetch_fsmap learned FSMap version 45 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.128+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x562039a241f0 con 0x562039c7d960 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cacff9700 1 -- 172.21.15.35:0/3044340053 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562039c4d1e0 con 0x562039c7d960 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cacff9700 1 -- 172.21.15.35:0/3044340053 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8cb4004d20 con 0x562039c7d960 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cd7845b80 10 client.19038 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cd7845b80 10 client.19038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cd7845b80 20 client.19038 populate_metadata read hostname 'smithi035' 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039cebbe0 0x562039cedfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cd7845b80 4 client.19038 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562039a53f00 con 0x562039cebbe0 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039cebbe0 0x562039cedfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:34:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cacff9700 10 client.19038 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:50.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.129+0000 7f8cc8c53700 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039cebbe0 0x562039cedfc0 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b40b6bb4e36d8731 server_cookie=340163ec3e89a082 in_seq=0 out_seq=0 2023-03-17T10:34:50.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.134+0000 7f8cacff9700 1 -- 172.21.15.35:0/3044340053 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562039a53f00 con 0x562039cebbe0 2023-03-17T10:34:50.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.134+0000 7f8cacff9700 10 client.19038 handle_command_reply: tid=0 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.134+0000 7f8cd7845b80 1 client.19038 shutdown 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 msgr2=0x562039ce3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 0x562039ce3280 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40099c0 tx=0x7f8cb4005f00 comp rx=0 tx=0).stop 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 shutdown_connections 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562039cebbe0 0x562039cedfc0 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562039c834f0 0x562039cdee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:50.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562039c7d960 0x562039ce3280 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 --2- 172.21.15.35:0/3044340053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562039c82be0 0x562039ce37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cacff9700 0 client.19038 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:34:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 >> 172.21.15.35:0/3044340053 conn(0x562039ada6b0 msgr2=0x562039c80650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 shutdown_connections 2023-03-17T10:34:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 1 -- 172.21.15.35:0/3044340053 wait complete. 2023-03-17T10:34:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8cd7845b80 20 client.19038 trim_cache size 0 max 16384 2023-03-17T10:34:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8cb009f640 msgr2=0x7f8cb00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8cb009f640 0x7f8cb00a1af0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4000c00 tx=0x7f8cb4005fb0 comp rx=0 tx=0).stop 2023-03-17T10:34:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 msgr2=0x7f8cc41a2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:54.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 0x7f8cc41a2040 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc007d70 tx=0x7f8cbc00a340 comp rx=0 tx=0).stop 2023-03-17T10:34:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 shutdown_connections 2023-03-17T10:34:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8cb009f640 0x7f8cb00a1af0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8cc4104390 0x7f8cc41a2040 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cc40ff350 0x7f8cc4196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:55.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 --2- 172.21.15.35:0/754233422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cc40ffcf0 0x7f8cc4197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:55.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 >> 172.21.15.35:0/754233422 conn(0x7f8cc4076330 msgr2=0x7f8cc40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.135+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 shutdown_connections 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:32.136+0000 7f8ccb6b8700 1 -- 172.21.15.35:0/754233422 wait complete. 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 -- 172.21.15.35:0/1978564419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 msgr2=0x7f5c14104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 --2- 172.21.15.35:0/1978564419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c14104e30 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f5c080099c0 tx=0x7f5c08009cd0 comp rx=0 tx=0).stop 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 -- 172.21.15.35:0/1978564419 shutdown_connections 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 --2- 172.21.15.35:0/1978564419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 0x7f5c1410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 --2- 172.21.15.35:0/1978564419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 0x7f5c140fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 --2- 172.21.15.35:0/1978564419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c14104e30 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 -- 172.21.15.35:0/1978564419 >> 172.21.15.35:0/1978564419 conn(0x7f5c14074590 msgr2=0x7f5c14074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 -- 172.21.15.35:0/1978564419 shutdown_connections 2023-03-17T10:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 -- 172.21.15.35:0/1978564419 wait complete. 2023-03-17T10:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.258+0000 7f5c19842700 1 Processor -- start 2023-03-17T10:34:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 -- start start 2023-03-17T10:34:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 0x7f5c140ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c140ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 0x7f5c141a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:34:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14100710 con 0x7f5c140ff3d0 2023-03-17T10:35:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c141a48b0 con 0x7f5c14105510 2023-03-17T10:35:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c19842700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c141a49f0 con 0x7f5c140fea30 2023-03-17T10:35:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c140ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c140ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51014/0 (socket says 172.21.15.35:51014) 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 -- 172.21.15.35:0/201653736 learned_addr learned my addr 172.21.15.35:0/201653736 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c137fe700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 0x7f5c141a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 0x7f5c140ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 -- 172.21.15.35:0/201653736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 msgr2=0x7f5c140ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 0x7f5c140ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 -- 172.21.15.35:0/201653736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 msgr2=0x7f5c141a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 0x7f5c141a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c127fc700 1 -- 172.21.15.35:0/201653736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080095f0 con 0x7f5c140ff3d0 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c137fe700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 0x7f5c141a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:35:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.259+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 0x7f5c140ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:35:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.260+0000 7f5c127fc700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c140ffee0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b580 tx=0x7f5c08009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.260+0000 7f5c18840700 1 -- 172.21.15.35:0/201653736 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0801d070 con 0x7f5c140ff3d0 2023-03-17T10:35:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.260+0000 7f5c18840700 1 -- 172.21.15.35:0/201653736 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c080058e0 con 0x7f5c140ff3d0 2023-03-17T10:35:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.260+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c14110160 con 0x7f5c140ff3d0 2023-03-17T10:35:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.260+0000 7f5c18840700 1 -- 172.21.15.35:0/201653736 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08022ba0 con 0x7f5c140ff3d0 2023-03-17T10:35:02.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.260+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1410ffd0 con 0x7f5c140ff3d0 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.262+0000 7f5c18840700 1 -- 172.21.15.35:0/201653736 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5c08003bb0 con 0x7f5c140ff3d0 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.263+0000 7f5c18840700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bfc09f640 0x7f5bfc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.263+0000 7f5c18840700 1 -- 172.21.15.35:0/201653736 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5c080cbb10 con 0x7f5c140ff3d0 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.263+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bfc09f640 0x7f5bfc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.263+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bfc09f640 0x7f5bfc0a1af0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005fd0 tx=0x7f5c04005e20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.263+0000 7f5c259cfb80 1 Processor -- start 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 -- start start 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c33fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c2e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c2ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509b35010 con 0x560509c344f0 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509b87950 con 0x560509c2e960 2023-03-17T10:35:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509b80de0 con 0x560509c33be0 2023-03-17T10:35:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c2e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c2e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51022/0 (socket says 172.21.15.35:51022) 2023-03-17T10:35:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 -- 172.21.15.35:0/2718766169 learned_addr learned my addr 172.21.15.35:0/2718766169 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:35:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c137fe700 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c2ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c33fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 -- 172.21.15.35:0/2718766169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 msgr2=0x560509c33fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c33fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 -- 172.21.15.35:0/2718766169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 msgr2=0x560509c2ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c2ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 -- 172.21.15.35:0/2718766169 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560509a025d0 con 0x560509c344f0 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.264+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c2e420 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f5c080960c0 tx=0x7f5c08095350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2184eadf349ca724 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5bf9ffb700 1 -- 172.21.15.35:0/2718766169 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080a17b0 con 0x560509c344f0 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5bf9ffb700 1 -- 172.21.15.35:0/2718766169 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c08022470 con 0x560509c344f0 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5bf9ffb700 1 -- 172.21.15.35:0/2718766169 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080998b0 con 0x560509c344f0 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2718766169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 msgr2=0x560509c2e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c2e420 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f5c080960c0 tx=0x7f5c08095350 comp rx=0 tx=0).stop 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2718766169 shutdown_connections 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c2ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:05.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c33fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2718766169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c2e420 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2718766169 >> 172.21.15.35:0/2718766169 conn(0x560509a8b6b0 msgr2=0x560509c28a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2718766169 shutdown_connections 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.265+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2718766169 wait complete. 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 -- start start 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 Processor -- start 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c3a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c37730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c37db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509a048c0 con 0x560509c344f0 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c384f0 con 0x560509c2e960 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c43c60 con 0x560509c33be0 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c259cfb80 10 client.0 _ll_register_callbacks cb 0x560509a26230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:35:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.266+0000 7f5c137fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c37db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c127fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c37730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c37db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51030/0 (socket says 172.21.15.35:51030) 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c127fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c37730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:42794/0 (socket says 172.21.15.35:42794) 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 -- 172.21.15.35:0/2225412019 learned_addr learned my addr 172.21.15.35:0/2225412019 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c3a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 -- 172.21.15.35:0/2225412019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 msgr2=0x560509c37730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c37730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 -- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 msgr2=0x560509c3a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c3a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 -- 172.21.15.35:0/2225412019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1410ffd0 con 0x560509c344f0 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c37730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c137fe700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c37db0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c007b50 tx=0x7f5c0c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b496d1d76377e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5bf2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2225412019 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c012ac0 con 0x560509c344f0 2023-03-17T10:35:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2225412019 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5c0c012c20 con 0x560509c344f0 2023-03-17T10:35:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560509b43390 con 0x560509c344f0 2023-03-17T10:35:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2225412019 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c0c012de0 con 0x560509c344f0 2023-03-17T10:35:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c259cfb80 10 client.19050 fetch_fsmap learned FSMap version 45 2023-03-17T10:35:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.267+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5605099aed80 con 0x560509c344f0 2023-03-17T10:35:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2225412019 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560509b43390 con 0x560509c344f0 2023-03-17T10:35:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2225412019 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5c0c014040 con 0x560509c344f0 2023-03-17T10:35:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c259cfb80 10 client.19050 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:35:07.559 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230751 2.35 MB/sec execute 390 sec latency 2706.283 ms 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:01 smithi035 ceph-mon[92535]: pgmap v3173: 97 pgs: 97 active+clean; 136 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 590 KiB/s wr, 56 op/s 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:02 smithi035 ceph-mon[92535]: pgmap v3174: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 751 KiB/s wr, 81 op/s 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:04 smithi035 ceph-mon[92535]: osdmap e273: 12 total, 12 up, 12 in 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:04 smithi035 ceph-mon[92535]: pgmap v3176: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 241 KiB/s wr, 43 op/s 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:07 smithi035 ceph-mon[92535]: pgmap v3177: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 241 KiB/s wr, 43 op/s 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:09 smithi035 ceph-mon[92535]: pgmap v3178: 97 pgs: 97 active+clean; 139 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 762 KiB/s wr, 93 op/s 2023-03-17T10:35:08.816 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:11 smithi035 ceph-mon[92535]: pgmap v3179: 97 pgs: 97 active+clean; 139 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 762 KiB/s wr, 93 op/s 2023-03-17T10:35:09.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:12 smithi035 ceph-mon[92535]: osdmap e274: 12 total, 12 up, 12 in 2023-03-17T10:35:09.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:12 smithi035 ceph-mon[92535]: pgmap v3181: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T10:35:09.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:15 smithi035 ceph-mon[92535]: pgmap v3182: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T10:35:11.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:17 smithi035 ceph-mon[92535]: pgmap v3183: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T10:35:11.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:19 smithi035 ceph-mon[92535]: pgmap v3184: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 605 KiB/s wr, 50 op/s 2023-03-17T10:35:11.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:21 smithi035 ceph-mon[92535]: pgmap v3185: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 605 KiB/s wr, 50 op/s 2023-03-17T10:35:11.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:22 smithi035 ceph-mon[92535]: pgmap v3186: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:25 smithi035 ceph-mon[92535]: pgmap v3187: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 552 KiB/s wr, 63 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:27 smithi035 ceph-mon[92535]: pgmap v3188: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 552 KiB/s wr, 63 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:29 smithi035 ceph-mon[92535]: pgmap v3189: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.0 MiB/s wr, 98 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:31 smithi035 ceph-mon[92535]: pgmap v3190: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:32 smithi035 ceph-mon[92535]: pgmap v3191: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:35 smithi035 ceph-mon[92535]: pgmap v3192: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 553 KiB/s wr, 44 op/s 2023-03-17T10:35:13.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:37 smithi035 ceph-mon[92535]: pgmap v3193: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 553 KiB/s wr, 44 op/s 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:39 smithi035 ceph-mon[92535]: pgmap v3194: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.0 MiB/s wr, 100 op/s 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:41 smithi035 ceph-mon[92535]: pgmap v3195: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 563 KiB/s wr, 65 op/s 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:42 smithi035 ceph-mon[92535]: pgmap v3196: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 101 op/s 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:45 smithi035 ceph-mon[92535]: pgmap v3197: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.0 MiB/s wr, 91 op/s 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:35:15.353 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:46 smithi035 ceph-mon[92535]: pgmap v3198: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:46 smithi035 ceph-mon[92535]: pgmap v3199: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:47 smithi035 ceph-mon[92535]: pgmap v3200: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 747 KiB/s wr, 62 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:49 smithi035 ceph-mon[92535]: pgmap v3201: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 748 KiB/s wr, 62 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:51 smithi035 ceph-mon[92535]: pgmap v3202: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 51 KiB/s wr, 13 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:53 smithi035 ceph-mon[92535]: pgmap v3203: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 790 KiB/s wr, 91 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:55 smithi035 ceph-mon[92535]: pgmap v3204: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 697 KiB/s wr, 80 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:57 smithi035 ceph-mon[92535]: pgmap v3205: 97 pgs: 97 active+clean; 157 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 933 KiB/s wr, 99 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:23:59 smithi035 ceph-mon[92535]: pgmap v3206: 97 pgs: 97 active+clean; 158 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.0 MiB/s wr, 90 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:01 smithi035 ceph-mon[92535]: pgmap v3207: 97 pgs: 97 active+clean; 158 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:03 smithi035 ceph-mon[92535]: pgmap v3208: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:04 smithi035 ceph-mon[92535]: osdmap e275: 12 total, 12 up, 12 in 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:05 smithi035 ceph-mon[92535]: pgmap v3210: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 647 KiB/s wr, 53 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:07 smithi035 ceph-mon[92535]: pgmap v3211: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 841 KiB/s wr, 95 op/s 2023-03-17T10:35:15.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:09 smithi035 ceph-mon[92535]: pgmap v3212: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 775 KiB/s wr, 96 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:11 smithi035 ceph-mon[92535]: pgmap v3213: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 775 KiB/s wr, 96 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:11 smithi035 ceph-mon[92535]: osdmap e276: 12 total, 12 up, 12 in 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:13 smithi035 ceph-mon[92535]: pgmap v3215: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:15 smithi035 ceph-mon[92535]: pgmap v3216: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.3 MiB/s wr, 123 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:17 smithi035 ceph-mon[92535]: pgmap v3217: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 792 KiB/s wr, 53 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:18 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:19 smithi035 ceph-mon[92535]: pgmap v3218: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 692 KiB/s wr, 52 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:21 smithi035 ceph-mon[92535]: pgmap v3219: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 692 KiB/s wr, 52 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:23 smithi035 ceph-mon[92535]: pgmap v3220: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 734 KiB/s wr, 56 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:25 smithi035 ceph-mon[92535]: pgmap v3221: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 169 KiB/s wr, 19 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:27 smithi035 ceph-mon[92535]: pgmap v3222: 97 pgs: 97 active+clean; 168 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 637 KiB/s wr, 73 op/s 2023-03-17T10:35:15.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:29 smithi035 ceph-mon[92535]: pgmap v3223: 97 pgs: 97 active+clean; 167 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 686 KiB/s wr, 66 op/s 2023-03-17T10:35:16.949 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:31 smithi035 ceph-mon[92535]: pgmap v3224: 97 pgs: 97 active+clean; 167 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 681 KiB/s wr, 66 op/s 2023-03-17T10:35:16.949 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:33 smithi035 ceph-mon[92535]: pgmap v3225: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2023-03-17T10:35:16.949 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:35 smithi035 ceph-mon[92535]: pgmap v3226: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 980 KiB/s wr, 85 op/s 2023-03-17T10:35:16.949 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:37 smithi035 ceph-mon[92535]: pgmap v3227: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1012 KiB/s wr, 94 op/s 2023-03-17T10:35:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c259cfb80 10 client.19050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:35:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c259cfb80 20 client.19050 populate_metadata read hostname 'smithi035' 2023-03-17T10:35:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c47dd0 0x560509c4a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c259cfb80 4 client.19050 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:35:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560509b4f600 con 0x560509c47dd0 2023-03-17T10:35:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c47dd0 0x560509c4a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5bf2ffd700 10 client.19050 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:35:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.268+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c47dd0 0x560509c4a1e0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=260471e443914233 server_cookie=ea637173a3d0a872 in_seq=0 out_seq=0 2023-03-17T10:35:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2225412019 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560509b4f600 con 0x560509c47dd0 2023-03-17T10:35:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5bf2ffd700 10 client.19050 handle_command_reply: tid=0 2023-03-17T10:35:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 client.19050 shutdown 2023-03-17T10:35:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 msgr2=0x560509c37db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c37db0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c007b50 tx=0x7f5c0c007e60 comp rx=0 tx=0).stop 2023-03-17T10:35:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 shutdown_connections 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c47dd0 0x560509c4a1e0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c344f0 0x560509c37db0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5bf2ffd700 0 client.19050 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c2e960 0x560509c3a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2225412019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c37730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.269+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 >> 172.21.15.35:0/2225412019 conn(0x560509a8b6b0 msgr2=0x560509c2d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.270+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 shutdown_connections 2023-03-17T10:35:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.270+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2225412019 wait complete. 2023-03-17T10:35:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.270+0000 7f5c259cfb80 20 client.19050 trim_cache size 0 max 16384 2023-03-17T10:35:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.284+0000 7f5c259cfb80 1 Processor -- start 2023-03-17T10:35:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 -- start start 2023-03-17T10:35:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c28ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c3eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c2da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509b43390 con 0x560509c2e960 2023-03-17T10:35:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c45460 con 0x560509c344f0 2023-03-17T10:35:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c29000 con 0x560509c33be0 2023-03-17T10:35:25.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c28ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c28ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51034/0 (socket says 172.21.15.35:51034) 2023-03-17T10:35:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 -- 172.21.15.35:0/1864372577 learned_addr learned my addr 172.21.15.35:0/1864372577 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:35:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c127fc700 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c3eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 -- 172.21.15.35:0/1864372577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 msgr2=0x560509c3eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c137fe700 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c2da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c3eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 -- 172.21.15.35:0/1864372577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 msgr2=0x560509c2da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c2da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 -- 172.21.15.35:0/1864372577 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560509c2f000 con 0x560509c2e960 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c137fe700 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c2da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c28ac0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x560509c4aaf0 tx=0x7f5c04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc26fefad7c3fa56 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.285+0000 7f5bfa7fc700 1 -- 172.21.15.35:0/1864372577 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04022040 con 0x560509c2e960 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5bfa7fc700 1 -- 172.21.15.35:0/1864372577 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c04024580 con 0x560509c2e960 2023-03-17T10:35:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5bfa7fc700 1 -- 172.21.15.35:0/1864372577 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0401caf0 con 0x560509c2e960 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 -- 172.21.15.35:0/1864372577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 msgr2=0x560509c28ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c28ac0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x560509c4aaf0 tx=0x7f5c04013000 comp rx=0 tx=0).stop 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 -- 172.21.15.35:0/1864372577 shutdown_connections 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c2da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c28ac0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/1864372577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c3eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 -- 172.21.15.35:0/1864372577 >> 172.21.15.35:0/1864372577 conn(0x560509a8b6b0 msgr2=0x560509c43330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 -- 172.21.15.35:0/1864372577 shutdown_connections 2023-03-17T10:35:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 -- 172.21.15.35:0/1864372577 wait complete. 2023-03-17T10:35:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.286+0000 7f5c259cfb80 1 -- start start 2023-03-17T10:35:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 Processor -- start 2023-03-17T10:35:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c8fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c90330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c94cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c95200 con 0x560509c2e960 2023-03-17T10:35:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c95370 con 0x560509c344f0 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560509c95530 con 0x560509c33be0 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c259cfb80 10 client.0 _ll_register_callbacks cb 0x560509a26230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c8fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c8fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51040/0 (socket says 172.21.15.35:51040) 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 -- 172.21.15.35:0/2547544404 learned_addr learned my addr 172.21.15.35:0/2547544404 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c137fe700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c94cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 -- 172.21.15.35:0/2547544404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 msgr2=0x560509c90330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c90330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 -- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 msgr2=0x560509c94cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:35:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c94cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c12ffd700 1 -- 172.21.15.35:0/2547544404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0400dc10 con 0x560509c2e960 2023-03-17T10:35:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.287+0000 7f5c137fe700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c94cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:35:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c90330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:35:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5c12ffd700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c8fdf0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400da10 tx=0x7f5c04004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d6adf78d16b4ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5bf2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:35:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2547544404 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04022040 con 0x560509c2e960 2023-03-17T10:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2547544404 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5c04004e10 con 0x560509c2e960 2023-03-17T10:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560509bfe1e0 con 0x560509c2e960 2023-03-17T10:35:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2547544404 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c0401c530 con 0x560509c2e960 2023-03-17T10:35:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5c259cfb80 10 client.19056 fetch_fsmap learned FSMap version 45 2023-03-17T10:35:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560509997c00 con 0x560509c2e960 2023-03-17T10:35:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2547544404 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560509bfe1e0 con 0x560509c2e960 2023-03-17T10:35:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.288+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2547544404 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5c04005040 con 0x560509c2e960 2023-03-17T10:35:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c259cfb80 10 client.19056 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:35:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c259cfb80 10 client.19056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:35:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c259cfb80 20 client.19056 populate_metadata read hostname 'smithi035' 2023-03-17T10:35:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c9cc20 0x560509c9f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c259cfb80 4 client.19056 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:35:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560509a04f00 con 0x560509c9cc20 2023-03-17T10:35:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c9cc20 0x560509c9f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5bf2ffd700 10 client.19056 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:35:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.289+0000 7f5c127fc700 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c9cc20 0x560509c9f030 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ed6151d96bd358 server_cookie=f5a5fccd725c0a03 in_seq=0 out_seq=0 2023-03-17T10:35:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5bf2ffd700 1 -- 172.21.15.35:0/2547544404 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560509a04f00 con 0x560509c9cc20 2023-03-17T10:35:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5bf2ffd700 10 client.19056 handle_command_reply: tid=0 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 client.19056 shutdown 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 msgr2=0x560509c8fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c8fdf0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400da10 tx=0x7f5c04004b30 comp rx=0 tx=0).stop 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 shutdown_connections 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560509c9cc20 0x560509c9f030 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560509c344f0 0x560509c94cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560509c2e960 0x560509c8fdf0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5bf2ffd700 0 client.19056 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:35:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 --2- 172.21.15.35:0/2547544404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560509c33be0 0x560509c90330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:42.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 >> 172.21.15.35:0/2547544404 conn(0x560509a8b6b0 msgr2=0x560509c2da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 shutdown_connections 2023-03-17T10:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 1 -- 172.21.15.35:0/2547544404 wait complete. 2023-03-17T10:35:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.294+0000 7f5c259cfb80 20 client.19056 trim_cache size 0 max 16384 2023-03-17T10:35:44.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bfc09f640 msgr2=0x7f5bfc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bfc09f640 0x7f5bfc0a1af0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005fd0 tx=0x7f5c04005e20 comp rx=0 tx=0).stop 2023-03-17T10:35:44.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 msgr2=0x7f5c140ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:45.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c140ffee0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b580 tx=0x7f5c08009580 comp rx=0 tx=0).stop 2023-03-17T10:35:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 shutdown_connections 2023-03-17T10:35:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bfc09f640 0x7f5bfc0a1af0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c14105510 0x7f5c141a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:45.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c140fea30 0x7f5c140ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 --2- 172.21.15.35:0/201653736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5c140ff3d0 0x7f5c140ffee0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 >> 172.21.15.35:0/201653736 conn(0x7f5c14074590 msgr2=0x7f5c14103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 shutdown_connections 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:45.295+0000 7f5c19842700 1 -- 172.21.15.35:0/201653736 wait complete. 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.418+0000 7f0064826700 1 -- 172.21.15.35:0/940781535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00601013d0 msgr2=0x7f00601017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.418+0000 7f0064826700 1 --2- 172.21.15.35:0/940781535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00601013d0 0x7f00601017a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f0050009990 tx=0x7f0050009ca0 comp rx=0 tx=0).stop 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 -- 172.21.15.35:0/940781535 shutdown_connections 2023-03-17T10:35:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 --2- 172.21.15.35:0/940781535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f006010a7a0 0x7f006010cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 --2- 172.21.15.35:0/940781535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00601013d0 0x7f00601017a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 --2- 172.21.15.35:0/940781535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0060101ce0 0x7f006010a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 -- 172.21.15.35:0/940781535 >> 172.21.15.35:0/940781535 conn(0x7f0060076330 msgr2=0x7f0060076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:35:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 -- 172.21.15.35:0/940781535 shutdown_connections 2023-03-17T10:35:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.419+0000 7f0064826700 1 -- 172.21.15.35:0/940781535 wait complete. 2023-03-17T10:35:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 Processor -- start 2023-03-17T10:35:46.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 -- start start 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00601013d0 0x7f00601983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0060101ce0 0x7f0060198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 0x7f006019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006019d3b0 con 0x7f006010a7a0 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006019d520 con 0x7f00601013d0 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f0064826700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006019d6e0 con 0x7f0060101ce0 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 0x7f006019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 0x7f006019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51056/0 (socket says 172.21.15.35:51056) 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 -- 172.21.15.35:0/2342445783 learned_addr learned my addr 172.21.15.35:0/2342445783 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005e59c700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00601013d0 0x7f00601983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:46.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0060101ce0 0x7f0060198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 -- 172.21.15.35:0/2342445783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0060101ce0 msgr2=0x7f0060198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0060101ce0 0x7f0060198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 -- 172.21.15.35:0/2342445783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00601013d0 msgr2=0x7f00601983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:35:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00601013d0 0x7f00601983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:35:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.420+0000 7f005ed9d700 1 -- 172.21.15.35:0/2342445783 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500095f0 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.421+0000 7f005ed9d700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 0x7f006019cd70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f0058007ee0 tx=0x7f005800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.421+0000 7f004f7fe700 1 -- 172.21.15.35:0/2342445783 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058017070 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.421+0000 7f004f7fe700 1 -- 172.21.15.35:0/2342445783 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f005800f040 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.421+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00601100b0 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.421+0000 7f004f7fe700 1 -- 172.21.15.35:0/2342445783 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058005570 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.421+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006010ff20 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.423+0000 7f004f7fe700 1 -- 172.21.15.35:0/2342445783 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f005800db20 con 0x7f006010a7a0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.424+0000 7f004f7fe700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f004809f640 0x7f00480a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.424+0000 7f005e59c700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f004809f640 0x7f00480a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:35:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.424+0000 7f004f7fe700 1 -- 172.21.15.35:0/2342445783 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f00580c9d20 con 0x7f006010a7a0 2023-03-17T10:35:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.424+0000 7f005e59c700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f004809f640 0x7f00480a1af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f005000b5c0 tx=0x7f0050005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:35:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.424+0000 7f00709b3b80 1 Processor -- start 2023-03-17T10:35:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 -- start start 2023-03-17T10:35:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba765420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230751 2.34 MB/sec execute 391 sec latency 3706.384 ms 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 230824 2.34 MB/sec execute 392 sec latency 4507.670 ms 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 231037 2.34 MB/sec execute 393 sec latency 14.758 ms 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 231351 2.33 MB/sec execute 394 sec latency 21.293 ms 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 231821 2.33 MB/sec execute 395 sec latency 14.940 ms 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 232299 2.33 MB/sec execute 396 sec latency 21.516 ms 2023-03-17T10:35:51.467 INFO:tasks.workunit.client.0.smithi035.stdout: 1 232907 2.33 MB/sec execute 397 sec latency 23.433 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 233364 2.33 MB/sec execute 398 sec latency 14.732 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 233927 2.34 MB/sec execute 399 sec latency 13.926 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234220 2.34 MB/sec execute 400 sec latency 407.126 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234220 2.33 MB/sec execute 401 sec latency 1407.229 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234220 2.33 MB/sec execute 402 sec latency 2407.282 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234287 2.32 MB/sec execute 403 sec latency 2632.313 ms 2023-03-17T10:35:53.600 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234287 2.32 MB/sec execute 404 sec latency 1507.496 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234287 2.31 MB/sec execute 405 sec latency 2507.616 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234287 2.30 MB/sec execute 406 sec latency 3507.713 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234287 2.30 MB/sec execute 407 sec latency 4507.842 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234488 2.30 MB/sec execute 408 sec latency 4733.981 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 234733 2.29 MB/sec execute 409 sec latency 16.270 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 235185 2.29 MB/sec execute 410 sec latency 16.798 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 235653 2.29 MB/sec execute 411 sec latency 26.061 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 236126 2.29 MB/sec execute 412 sec latency 48.258 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 236615 2.29 MB/sec execute 413 sec latency 24.256 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237350 2.30 MB/sec execute 414 sec latency 13.751 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237755 2.30 MB/sec execute 415 sec latency 20.076 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237764 2.29 MB/sec execute 416 sec latency 989.659 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237764 2.29 MB/sec execute 417 sec latency 1989.770 ms 2023-03-17T10:35:53.601 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237831 2.28 MB/sec execute 418 sec latency 2215.682 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237831 2.28 MB/sec execute 419 sec latency 1512.099 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237831 2.27 MB/sec execute 420 sec latency 2512.187 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237831 2.27 MB/sec execute 421 sec latency 3512.250 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 237831 2.26 MB/sec execute 422 sec latency 4512.372 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 238021 2.26 MB/sec execute 423 sec latency 4734.640 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 238282 2.26 MB/sec execute 424 sec latency 17.027 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 238752 2.25 MB/sec execute 425 sec latency 19.836 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 239207 2.26 MB/sec execute 426 sec latency 68.893 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 239734 2.25 MB/sec execute 427 sec latency 23.859 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 240246 2.25 MB/sec execute 428 sec latency 22.056 ms 2023-03-17T10:35:53.602 INFO:tasks.workunit.client.0.smithi035.stdout: 1 240974 2.26 MB/sec execute 429 sec latency 15.182 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241310 2.26 MB/sec execute 430 sec latency 104.542 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241310 2.26 MB/sec execute 431 sec latency 1104.654 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241310 2.25 MB/sec execute 432 sec latency 2104.724 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241377 2.25 MB/sec execute 433 sec latency 2324.705 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241377 2.24 MB/sec execute 434 sec latency 1526.753 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241377 2.24 MB/sec execute 435 sec latency 2526.822 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241377 2.23 MB/sec execute 436 sec latency 3526.860 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241377 2.23 MB/sec execute 437 sec latency 4526.978 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241601 2.23 MB/sec execute 438 sec latency 4744.255 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 241858 2.22 MB/sec execute 439 sec latency 19.420 ms 2023-03-17T10:35:55.353 INFO:tasks.workunit.client.0.smithi035.stdout: 1 242382 2.22 MB/sec execute 440 sec latency 14.493 ms 2023-03-17T10:35:55.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 242864 2.22 MB/sec execute 441 sec latency 24.607 ms 2023-03-17T10:35:55.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 243421 2.22 MB/sec execute 442 sec latency 26.081 ms 2023-03-17T10:35:55.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 243854 2.22 MB/sec execute 443 sec latency 14.846 ms 2023-03-17T10:35:55.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244546 2.23 MB/sec execute 444 sec latency 16.960 ms 2023-03-17T10:35:55.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244855 2.23 MB/sec execute 445 sec latency 280.766 ms 2023-03-17T10:35:55.354 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244855 2.23 MB/sec execute 446 sec latency 1280.859 ms 2023-03-17T10:35:57.329 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244855 2.22 MB/sec execute 447 sec latency 2280.967 ms 2023-03-17T10:35:58.004 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244922 2.22 MB/sec execute 448 sec latency 2505.997 ms 2023-03-17T10:35:58.005 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244922 2.21 MB/sec execute 449 sec latency 1519.350 ms 2023-03-17T10:35:58.005 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244922 2.21 MB/sec execute 450 sec latency 2519.399 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244922 2.20 MB/sec execute 451 sec latency 3519.457 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 244922 2.20 MB/sec execute 452 sec latency 4519.536 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 245134 2.20 MB/sec execute 453 sec latency 4738.034 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 245391 2.19 MB/sec execute 454 sec latency 19.399 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 245890 2.19 MB/sec execute 455 sec latency 14.400 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 246381 2.19 MB/sec execute 456 sec latency 22.368 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 246887 2.19 MB/sec execute 457 sec latency 22.829 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 247378 2.19 MB/sec execute 458 sec latency 21.420 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248090 2.20 MB/sec execute 459 sec latency 16.722 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248402 2.20 MB/sec execute 460 sec latency 265.157 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248402 2.20 MB/sec execute 461 sec latency 1265.273 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248402 2.19 MB/sec execute 462 sec latency 2265.384 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248469 2.19 MB/sec execute 463 sec latency 2485.865 ms 2023-03-17T10:35:59.778 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248469 2.18 MB/sec execute 464 sec latency 1528.886 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248469 2.18 MB/sec execute 465 sec latency 2528.979 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248469 2.17 MB/sec execute 466 sec latency 3529.098 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248469 2.17 MB/sec execute 467 sec latency 4529.189 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248481 2.16 MB/sec execute 468 sec latency 4745.997 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248481 2.16 MB/sec execute 469 sec latency 1718.287 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248481 2.15 MB/sec execute 470 sec latency 2718.397 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248481 2.15 MB/sec execute 471 sec latency 3718.506 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248558 2.15 MB/sec execute 472 sec latency 4517.335 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 248791 2.14 MB/sec execute 473 sec latency 13.681 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 249163 2.14 MB/sec execute 474 sec latency 21.662 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 249716 2.14 MB/sec execute 475 sec latency 21.418 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 250163 2.14 MB/sec execute 476 sec latency 22.005 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 250721 2.14 MB/sec execute 477 sec latency 21.545 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 251319 2.15 MB/sec execute 478 sec latency 14.138 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 251818 2.15 MB/sec execute 479 sec latency 60.377 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 251946 2.15 MB/sec execute 480 sec latency 736.270 ms 2023-03-17T10:35:59.779 INFO:tasks.workunit.client.0.smithi035.stdout: 1 251946 2.14 MB/sec execute 481 sec latency 1736.331 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 251946 2.14 MB/sec execute 482 sec latency 2736.443 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252013 2.14 MB/sec execute 483 sec latency 2953.312 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252013 2.13 MB/sec execute 484 sec latency 1525.451 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252013 2.13 MB/sec execute 485 sec latency 2525.580 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252013 2.12 MB/sec execute 486 sec latency 3525.683 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252013 2.12 MB/sec execute 487 sec latency 4525.793 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252025 2.11 MB/sec execute 488 sec latency 4743.440 ms 2023-03-17T10:35:59.780 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252025 2.11 MB/sec execute 489 sec latency 1718.577 ms 2023-03-17T10:35:59.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba765d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba66c010 con 0x5615ba76b4f0 2023-03-17T10:36:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba6be950 con 0x5615ba76abe0 2023-03-17T10:36:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f00709b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba6b7de0 con 0x5615ba765960 2023-03-17T10:36:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba765420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba765420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51062/0 (socket says 172.21.15.35:51062) 2023-03-17T10:36:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 -- 172.21.15.35:0/2309952871 learned_addr learned my addr 172.21.15.35:0/2309952871 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005ed9d700 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba765d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005e59c700 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 -- 172.21.15.35:0/2309952871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 msgr2=0x5615ba765d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba765d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:03.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 -- 172.21.15.35:0/2309952871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 msgr2=0x5615ba76afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005dd9b700 1 -- 172.21.15.35:0/2309952871 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615ba5395d0 con 0x5615ba76b4f0 2023-03-17T10:36:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.425+0000 7f005e59c700 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:36:03.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.426+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba765420 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f005400bd30 tx=0x7f00540106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6da09b44e00e41 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.426+0000 7f004cff9700 1 -- 172.21.15.35:0/2309952871 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054010ec0 con 0x5615ba76b4f0 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.426+0000 7f004cff9700 1 -- 172.21.15.35:0/2309952871 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0054015070 con 0x5615ba76b4f0 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.426+0000 7f004cff9700 1 -- 172.21.15.35:0/2309952871 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054003dd0 con 0x5615ba76b4f0 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.426+0000 7f00709b3b80 1 -- 172.21.15.35:0/2309952871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 msgr2=0x5615ba765420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.426+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba765420 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f005400bd30 tx=0x7f00540106b0 comp rx=0 tx=0).stop 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- 172.21.15.35:0/2309952871 shutdown_connections 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba765d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2309952871 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba765420 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- 172.21.15.35:0/2309952871 >> 172.21.15.35:0/2309952871 conn(0x5615ba5c26b0 msgr2=0x5615ba75fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- 172.21.15.35:0/2309952871 shutdown_connections 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- 172.21.15.35:0/2309952871 wait complete. 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- start start 2023-03-17T10:36:05.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 Processor -- start 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba771480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba76ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba53b8c0 con 0x5615ba76b4f0 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba76f4d0 con 0x5615ba76abe0 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba77b000 con 0x5615ba765960 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.427+0000 7f00709b3b80 10 client.0 _ll_register_callbacks cb 0x5615ba55d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba771480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba76ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba771480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:42832/0 (socket says 172.21.15.35:42832) 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 -- 172.21.15.35:0/3894816138 learned_addr learned my addr 172.21.15.35:0/3894816138 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005dd9b700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 -- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 msgr2=0x5615ba76e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:05.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 -- 172.21.15.35:0/3894816138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 msgr2=0x5615ba76ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba76ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 -- 172.21.15.35:0/3894816138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005400b960 con 0x5615ba765960 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005ed9d700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba76ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f005e59c700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba771480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f005000ba50 tx=0x7f005001a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fa4bfe773f8c24 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f0045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f0045ffb700 1 -- 172.21.15.35:0/3894816138 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050004990 con 0x5615ba765960 2023-03-17T10:36:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615ba67a390 con 0x5615ba765960 2023-03-17T10:36:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f0045ffb700 1 -- 172.21.15.35:0/3894816138 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0050004af0 con 0x5615ba765960 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.428+0000 7f0045ffb700 1 -- 172.21.15.35:0/3894816138 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0050004cb0 con 0x5615ba765960 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 10 client.28243 fetch_fsmap learned FSMap version 45 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5615ba4e5d80 con 0x5615ba765960 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f0045ffb700 1 -- 172.21.15.35:0/3894816138 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f005003d020 con 0x5615ba765960 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f0045ffb700 1 -- 172.21.15.35:0/3894816138 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0050039470 con 0x5615ba765960 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 10 client.28243 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 10 client.28243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 20 client.28243 populate_metadata read hostname 'smithi035' 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba77eed0 0x5615ba7812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 4 client.28243 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615ba686600 con 0x5615ba77eed0 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.429+0000 7f005dd9b700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba77eed0 0x5615ba7812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f0045ffb700 10 client.28243 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f005dd9b700 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba77eed0 0x5615ba7812e0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2937a56963bb7a93 server_cookie=14030f80d9d1d478 in_seq=0 out_seq=0 2023-03-17T10:36:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f0045ffb700 1 -- 172.21.15.35:0/3894816138 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5615ba686600 con 0x5615ba77eed0 2023-03-17T10:36:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f0045ffb700 10 client.28243 handle_command_reply: tid=0 2023-03-17T10:36:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 client.28243 shutdown 2023-03-17T10:36:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 msgr2=0x5615ba771480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba771480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f005000ba50 tx=0x7f005001a050 comp rx=0 tx=0).stop 2023-03-17T10:36:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 shutdown_connections 2023-03-17T10:36:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba77eed0 0x5615ba7812e0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba76ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba771480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3894816138 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f0045ffb700 0 client.28243 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 >> 172.21.15.35:0/3894816138 conn(0x5615ba5c26b0 msgr2=0x5615ba764410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.430+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 shutdown_connections 2023-03-17T10:36:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.431+0000 7f00709b3b80 1 -- 172.21.15.35:0/3894816138 wait complete. 2023-03-17T10:36:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.431+0000 7f00709b3b80 20 client.28243 trim_cache size 0 max 16384 2023-03-17T10:36:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.445+0000 7f00709b3b80 1 Processor -- start 2023-03-17T10:36:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.445+0000 7f00709b3b80 1 -- start start 2023-03-17T10:36:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.445+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.445+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba771020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f00709b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba75c5c0 con 0x5615ba76b4f0 2023-03-17T10:36:14.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f00709b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba7606d0 con 0x5615ba76abe0 2023-03-17T10:36:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f00709b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba7657b0 con 0x5615ba765960 2023-03-17T10:36:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba771020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba771020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51078/0 (socket says 172.21.15.35:51078) 2023-03-17T10:36:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 -- 172.21.15.35:0/3815307785 learned_addr learned my addr 172.21.15.35:0/3815307785 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005e59c700 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005dd9b700 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 -- 172.21.15.35:0/3815307785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 msgr2=0x5615ba775f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 -- 172.21.15.35:0/3815307785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 msgr2=0x5615ba76dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 -- 172.21.15.35:0/3815307785 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615ba766000 con 0x5615ba76b4f0 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005e59c700 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f005ed9d700 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba771020 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0058094240 tx=0x7f00580c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c3cbe933f27668 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f004d7fa700 1 -- 172.21.15.35:0/3815307785 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058004c40 con 0x5615ba76b4f0 2023-03-17T10:36:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f004d7fa700 1 -- 172.21.15.35:0/3815307785 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f005800ddd0 con 0x5615ba76b4f0 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.446+0000 7f004d7fa700 1 -- 172.21.15.35:0/3815307785 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058096cc0 con 0x5615ba76b4f0 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- 172.21.15.35:0/3815307785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 msgr2=0x5615ba771020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba771020 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0058094240 tx=0x7f00580c9040 comp rx=0 tx=0).stop 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- 172.21.15.35:0/3815307785 shutdown_connections 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76b4f0 0x5615ba771020 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- 172.21.15.35:0/3815307785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76abe0 0x5615ba76dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- 172.21.15.35:0/3815307785 >> 172.21.15.35:0/3815307785 conn(0x5615ba5c26b0 msgr2=0x5615ba77b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- 172.21.15.35:0/3815307785 shutdown_connections 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- 172.21.15.35:0/3815307785 wait complete. 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- start start 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 Processor -- start 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 0x5615ba775d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76b4f0 0x5615ba773c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba774280 con 0x5615ba76abe0 2023-03-17T10:36:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba7743f0 con 0x5615ba76b4f0 2023-03-17T10:36:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.447+0000 7f00709b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615ba7745b0 con 0x5615ba765960 2023-03-17T10:36:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f00709b3b80 10 client.0 _ll_register_callbacks cb 0x5615ba55d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:36:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 0x5615ba775d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 0x5615ba775d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51082/0 (socket says 172.21.15.35:51082) 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005ed9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76b4f0 0x5615ba773c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 -- 172.21.15.35:0/2078711275 learned_addr learned my addr 172.21.15.35:0/2078711275 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 -- 172.21.15.35:0/2078711275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 msgr2=0x5615ba775850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 -- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76b4f0 msgr2=0x5615ba773c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76b4f0 0x5615ba773c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 -- 172.21.15.35:0/2078711275 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006010ff20 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005ed9d700 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76b4f0 0x5615ba773c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f005dd9b700 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 0x5615ba775d90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x5615ba7606a0 tx=0x7f005400bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b546820efaf20c78 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f0045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f0045ffb700 1 -- 172.21.15.35:0/2078711275 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054021040 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f0045ffb700 1 -- 172.21.15.35:0/2078711275 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(246..246 src has 1..246) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0054017070 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.448+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615ba7351e0 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f0045ffb700 1 -- 172.21.15.35:0/2078711275 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0054005ee0 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 10 client.19074 fetch_fsmap learned FSMap version 45 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5615ba4cec00 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f0045ffb700 1 -- 172.21.15.35:0/2078711275 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5615ba7351e0 con 0x5615ba76abe0 2023-03-17T10:36:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f0045ffb700 1 -- 172.21.15.35:0/2078711275 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0054003ae0 con 0x5615ba76abe0 2023-03-17T10:36:21.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 10 client.19074 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:36:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 10 client.19074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:36:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 20 client.19074 populate_metadata read hostname 'smithi035' 2023-03-17T10:36:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba7d3d70 0x5615ba7d6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 4 client.19074 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:36:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5615ba53bf00 con 0x5615ba7d3d70 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.449+0000 7f005e59c700 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba7d3d70 0x5615ba7d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.450+0000 7f0045ffb700 10 client.19074 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.450+0000 7f005e59c700 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba7d3d70 0x5615ba7d6180 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8739bd65a50705 server_cookie=79b4a9c9211cf5d5 in_seq=0 out_seq=0 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.454+0000 7f0045ffb700 1 -- 172.21.15.35:0/2078711275 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5615ba53bf00 con 0x5615ba7d3d70 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0045ffb700 10 client.19074 handle_command_reply: tid=0 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 client.19074 shutdown 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 msgr2=0x5615ba775d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 0x5615ba775d90 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x5615ba7606a0 tx=0x7f005400bfc0 comp rx=0 tx=0).stop 2023-03-17T10:36:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 shutdown_connections 2023-03-17T10:36:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5615ba7d3d70 0x5615ba7d6180 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5615ba76b4f0 0x5615ba773c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0045ffb700 0 client.19074 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:23.480 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252025 2.10 MB/sec execute 490 sec latency 2718.628 ms 2023-03-17T10:36:25.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:39 smithi035 ceph-mon[92535]: pgmap v3228: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 547 KiB/s wr, 41 op/s 2023-03-17T10:36:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615ba765960 0x5615ba775850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:27.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 --2- 172.21.15.35:0/2078711275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5615ba76abe0 0x5615ba775d90 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 >> 172.21.15.35:0/2078711275 conn(0x5615ba5c26b0 msgr2=0x5615ba7686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 shutdown_connections 2023-03-17T10:36:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 1 -- 172.21.15.35:0/2078711275 wait complete. 2023-03-17T10:36:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f00709b3b80 20 client.19074 trim_cache size 0 max 16384 2023-03-17T10:36:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f004809f640 msgr2=0x7f00480a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0064826700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f004809f640 0x7f00480a1af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f005000b5c0 tx=0x7f0050005fb0 comp rx=0 tx=0).stop 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 msgr2=0x7f006019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0064826700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 0x7f006019cd70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f0058007ee0 tx=0x7f005800d3b0 comp rx=0 tx=0).stop 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 shutdown_connections 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.455+0000 7f0064826700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f004809f640 0x7f00480a1af0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.456+0000 7f0064826700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f006010a7a0 0x7f006019cd70 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.456+0000 7f0064826700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00601013d0 0x7f00601983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.456+0000 7f0064826700 1 --2- 172.21.15.35:0/2342445783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0060101ce0 0x7f0060198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.456+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 >> 172.21.15.35:0/2342445783 conn(0x7f0060076330 msgr2=0x7f00600ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.456+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 shutdown_connections 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:09:58.456+0000 7f0064826700 1 -- 172.21.15.35:0/2342445783 wait complete. 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 -- 172.21.15.35:0/1348384466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0180ff350 msgr2=0x7ff0180ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 --2- 172.21.15.35:0/1348384466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0180ff350 0x7ff0180ff720 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff0080099c0 tx=0x7ff008009cd0 comp rx=0 tx=0).stop 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 -- 172.21.15.35:0/1348384466 shutdown_connections 2023-03-17T10:36:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 --2- 172.21.15.35:0/1348384466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff018104390 0x7ff01810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 --2- 172.21.15.35:0/1348384466 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff0180ff350 0x7ff0180ff720 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 --2- 172.21.15.35:0/1348384466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ffcf0 0x7ff018103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.578+0000 7ff020467700 1 -- 172.21.15.35:0/1348384466 >> 172.21.15.35:0/1348384466 conn(0x7ff018076330 msgr2=0x7ff018076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 -- 172.21.15.35:0/1348384466 shutdown_connections 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 -- 172.21.15.35:0/1348384466 wait complete. 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 Processor -- start 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 -- start start 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ff350 0x7ff0181970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0180ffcf0 0x7ff0181975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 0x7ff0181a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff018197f00 con 0x7ff018104390 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181a2670 con 0x7ff0180ffcf0 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.579+0000 7ff020467700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181a27e0 con 0x7ff0180ff350 2023-03-17T10:36:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 0x7ff0181a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 0x7ff0181a2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51096/0 (socket says 172.21.15.35:51096) 2023-03-17T10:36:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 -- 172.21.15.35:0/732454916 learned_addr learned my addr 172.21.15.35:0/732454916 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01da02700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0180ffcf0 0x7ff0181975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01e203700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ff350 0x7ff0181970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 -- 172.21.15.35:0/732454916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ff350 msgr2=0x7ff0181970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ff350 0x7ff0181970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 -- 172.21.15.35:0/732454916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0180ffcf0 msgr2=0x7ff0181975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:33.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0180ffcf0 0x7ff0181975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 -- 172.21.15.35:0/732454916 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080095f0 con 0x7ff018104390 2023-03-17T10:36:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01e203700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ff350 0x7ff0181970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:36:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff01ea04700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 0x7ff0181a2130 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7ff010007d70 tx=0x7ff01000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff00f7fe700 1 -- 172.21.15.35:0/732454916 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000ad40 con 0x7ff018104390 2023-03-17T10:36:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01810f050 con 0x7ff018104390 2023-03-17T10:36:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff00f7fe700 1 -- 172.21.15.35:0/732454916 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0100128b0 con 0x7ff018104390 2023-03-17T10:36:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff00f7fe700 1 -- 172.21.15.35:0/732454916 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100115a0 con 0x7ff018104390 2023-03-17T10:36:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.580+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01810eec0 con 0x7ff018104390 2023-03-17T10:36:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.582+0000 7ff00f7fe700 1 -- 172.21.15.35:0/732454916 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff010012a20 con 0x7ff018104390 2023-03-17T10:36:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.583+0000 7ff00f7fe700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff00409f640 0x7ff0040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.583+0000 7ff00f7fe700 1 -- 172.21.15.35:0/732454916 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(247..247 src has 1..247) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff0100ca770 con 0x7ff018104390 2023-03-17T10:36:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.583+0000 7ff01e203700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff00409f640 0x7ff0040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.584+0000 7ff01e203700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff00409f640 0x7ff0040a1af0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff008006010 tx=0x7ff008000bc0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.584+0000 7ff02c5f4b80 1 Processor -- start 2023-03-17T10:36:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.584+0000 7ff02c5f4b80 1 -- start start 2023-03-17T10:36:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f3433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f33d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f33e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f240010 con 0x560a9f342ff0 2023-03-17T10:36:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f292950 con 0x560a9f343900 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f28bde0 con 0x560a9f33ddc0 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f3433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f3433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51102/0 (socket says 172.21.15.35:51102) 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 -- 172.21.15.35:0/3265228061 learned_addr learned my addr 172.21.15.35:0/3265228061 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01da02700 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f33d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01ea04700 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f33e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 -- 172.21.15.35:0/3265228061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 msgr2=0x560a9f33e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f33e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 -- 172.21.15.35:0/3265228061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 msgr2=0x560a9f33d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f33d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 -- 172.21.15.35:0/3265228061 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a9f10d5d0 con 0x560a9f342ff0 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01da02700 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f33d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.585+0000 7ff01e203700 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f3433c0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7ff00800b8d0 tx=0x7ff008019050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c764f597ccdee14f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff00cdae700 1 -- 172.21.15.35:0/3265228061 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00802a070 con 0x560a9f342ff0 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff00cdae700 1 -- 172.21.15.35:0/3265228061 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff00801d040 con 0x560a9f342ff0 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff00cdae700 1 -- 172.21.15.35:0/3265228061 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008004230 con 0x560a9f342ff0 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/3265228061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 msgr2=0x560a9f3433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f3433c0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7ff00800b8d0 tx=0x7ff008019050 comp rx=0 tx=0).stop 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/3265228061 shutdown_connections 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f33e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f3433c0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/3265228061 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f33d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/3265228061 >> 172.21.15.35:0/3265228061 conn(0x560a9f1966b0 msgr2=0x560a9f333a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/3265228061 shutdown_connections 2023-03-17T10:36:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.586+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/3265228061 wait complete. 2023-03-17T10:36:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 -- start start 2023-03-17T10:36:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 Processor -- start 2023-03-17T10:36:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f33ddc0 0x560a9f3498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f346b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f343900 0x560a9f347260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f10f8c0 con 0x560a9f342ff0 2023-03-17T10:36:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f3479a0 con 0x560a9f33ddc0 2023-03-17T10:36:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f353340 con 0x560a9f343900 2023-03-17T10:36:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.587+0000 7ff02c5f4b80 10 client.0 _ll_register_callbacks cb 0x560a9f131230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:36:39.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f346b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f346b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51110/0 (socket says 172.21.15.35:51110) 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 -- 172.21.15.35:0/1585033589 learned_addr learned my addr 172.21.15.35:0/1585033589 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01e203700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f33ddc0 0x560a9f3498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01ea04700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f343900 0x560a9f347260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 -- 172.21.15.35:0/1585033589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f343900 msgr2=0x560a9f347260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f343900 0x560a9f347260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 -- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f33ddc0 msgr2=0x560a9f3498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f33ddc0 0x560a9f3498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 -- 172.21.15.35:0/1585033589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01810c7a0 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01ea04700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f343900 0x560a9f347260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff01da02700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f346b20 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff0140128c0 tx=0x7ff014012c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5e63e04a6626c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff001ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff001ffb700 1 -- 172.21.15.35:0/1585033589 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014010cd0 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff001ffb700 1 -- 172.21.15.35:0/1585033589 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(247..247 src has 1..247) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff014010e30 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a9f24e390 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff001ffb700 1 -- 172.21.15.35:0/1585033589 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff014004020 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff02c5f4b80 10 client.19086 fetch_fsmap learned FSMap version 45 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.588+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560a9f0b9d80 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff001ffb700 1 -- 172.21.15.35:0/1585033589 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a9f24e390 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff001ffb700 1 -- 172.21.15.35:0/1585033589 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff014020020 con 0x560a9f342ff0 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff02c5f4b80 10 client.19086 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:36:39.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff02c5f4b80 10 client.19086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:36:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff02c5f4b80 20 client.19086 populate_metadata read hostname 'smithi035' 2023-03-17T10:36:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f357510 0x560a9f359920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff02c5f4b80 4 client.19086 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:36:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a9f25a600 con 0x560a9f357510 2023-03-17T10:36:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff01e203700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f357510 0x560a9f359920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff001ffb700 10 client.19086 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.589+0000 7ff01e203700 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f357510 0x560a9f359920 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3322af7687d11381 server_cookie=90321e93542533f in_seq=0 out_seq=0 2023-03-17T10:36:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff001ffb700 1 -- 172.21.15.35:0/1585033589 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560a9f25a600 con 0x560a9f357510 2023-03-17T10:36:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff001ffb700 10 client.19086 handle_command_reply: tid=0 2023-03-17T10:36:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 client.19086 shutdown 2023-03-17T10:36:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 msgr2=0x560a9f346b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f346b20 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff0140128c0 tx=0x7ff014012c80 comp rx=0 tx=0).stop 2023-03-17T10:36:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 shutdown_connections 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f357510 0x560a9f359920 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f343900 0x560a9f347260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f33ddc0 0x560a9f3498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff001ffb700 0 client.19086 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1585033589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f346b20 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.590+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 >> 172.21.15.35:0/1585033589 conn(0x560a9f1966b0 msgr2=0x560a9f338410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.591+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 shutdown_connections 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.591+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1585033589 wait complete. 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.591+0000 7ff02c5f4b80 20 client.19086 trim_cache size 0 max 16384 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 Processor -- start 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 -- start start 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f346ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f333ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f3493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f342c80 con 0x560a9f342ff0 2023-03-17T10:36:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f334000 con 0x560a9f343900 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f3305f0 con 0x560a9f33ddc0 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff01da02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f333ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff01da02700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f333ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51118/0 (socket says 172.21.15.35:51118) 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff01da02700 1 -- 172.21.15.35:0/274492150 learned_addr learned my addr 172.21.15.35:0/274492150 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff01e203700 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f346ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff01da02700 1 -- 172.21.15.35:0/274492150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 msgr2=0x560a9f346ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.606+0000 7ff01da02700 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f346ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff01ea04700 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f3493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff01da02700 1 -- 172.21.15.35:0/274492150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 msgr2=0x560a9f3493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff01da02700 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f3493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff01da02700 1 -- 172.21.15.35:0/274492150 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a9f252130 con 0x560a9f342ff0 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff01ea04700 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f3493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff01da02700 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f333ac0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff014001eb0 tx=0x7ff014005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5290e794049d72c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff00d5af700 1 -- 172.21.15.35:0/274492150 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01401a5d0 con 0x560a9f342ff0 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff00d5af700 1 -- 172.21.15.35:0/274492150 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff01401ab80 con 0x560a9f342ff0 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.607+0000 7ff00d5af700 1 -- 172.21.15.35:0/274492150 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014003680 con 0x560a9f342ff0 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/274492150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 msgr2=0x560a9f333ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f333ac0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff014001eb0 tx=0x7ff014005aa0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/274492150 shutdown_connections 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f343900 0x560a9f3493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f346ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/274492150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f342ff0 0x560a9f333ac0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/274492150 >> 172.21.15.35:0/274492150 conn(0x560a9f1966b0 msgr2=0x560a9f3463c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/274492150 shutdown_connections 2023-03-17T10:36:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/274492150 wait complete. 2023-03-17T10:36:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- start start 2023-03-17T10:36:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 Processor -- start 2023-03-17T10:36:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f34c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f342ff0 0x560a9f34c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:46.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 0x560a9f3a4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:46.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f3a4930 con 0x560a9f343900 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f3a4aa0 con 0x560a9f342ff0 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9f3a4c60 con 0x560a9f33ddc0 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff02c5f4b80 10 client.0 _ll_register_callbacks cb 0x560a9f131230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff01ea04700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 0x560a9f3a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff01ea04700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 0x560a9f3a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51126/0 (socket says 172.21.15.35:51126) 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff01ea04700 1 -- 172.21.15.35:0/1899887744 learned_addr learned my addr 172.21.15.35:0/1899887744 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.608+0000 7ff01e203700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f34c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01da02700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f342ff0 0x560a9f34c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01ea04700 1 -- 172.21.15.35:0/1899887744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 msgr2=0x560a9f34c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01ea04700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f34c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01ea04700 1 -- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f342ff0 msgr2=0x560a9f34c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01ea04700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f342ff0 0x560a9f34c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01ea04700 1 -- 172.21.15.35:0/1899887744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a9f0b9d80 con 0x560a9f343900 2023-03-17T10:36:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01da02700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f342ff0 0x560a9f34c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff01ea04700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 0x560a9f3a4380 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff010098290 tx=0x7ff010098450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5555d54896f51e96 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff001ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff001ffb700 1 -- 172.21.15.35:0/1899887744 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100af070 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a9f3091e0 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff001ffb700 1 -- 172.21.15.35:0/1899887744 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(247..247 src has 1..247) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff010098770 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff001ffb700 1 -- 172.21.15.35:0/1899887744 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff010096780 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff02c5f4b80 10 client.19092 fetch_fsmap learned FSMap version 45 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.609+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560a9f0e01f0 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff001ffb700 1 -- 172.21.15.35:0/1899887744 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0100b4020 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff001ffb700 1 -- 172.21.15.35:0/1899887744 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff0100abba0 con 0x560a9f343900 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff02c5f4b80 10 client.19092 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff02c5f4b80 10 client.19092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff02c5f4b80 20 client.19092 populate_metadata read hostname 'smithi035' 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f3ac4a0 0x560a9f3ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff02c5f4b80 4 client.19092 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:36:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a9f10ff00 con 0x560a9f3ac4a0 2023-03-17T10:36:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff01e203700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f3ac4a0 0x560a9f3ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff01e203700 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f3ac4a0 0x560a9f3ae880 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6842bbde49aadec server_cookie=932a68fdbdfeb5ec in_seq=0 out_seq=0 2023-03-17T10:36:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.610+0000 7ff001ffb700 10 client.19092 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff001ffb700 1 -- 172.21.15.35:0/1899887744 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a9f10ff00 con 0x560a9f3ac4a0 2023-03-17T10:36:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff001ffb700 10 client.19092 handle_command_reply: tid=0 2023-03-17T10:36:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 client.19092 shutdown 2023-03-17T10:36:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 msgr2=0x560a9f3a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 0x560a9f3a4380 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff010098290 tx=0x7ff010098450 comp rx=0 tx=0).stop 2023-03-17T10:36:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 shutdown_connections 2023-03-17T10:36:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560a9f3ac4a0 0x560a9f3ae880 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560a9f343900 0x560a9f3a4380 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff001ffb700 0 client.19092 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:36:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560a9f33ddc0 0x560a9f34c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 --2- 172.21.15.35:0/1899887744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a9f342ff0 0x560a9f34c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 >> 172.21.15.35:0/1899887744 conn(0x560a9f1966b0 msgr2=0x560a9f341cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.619+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 shutdown_connections 2023-03-17T10:36:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff02c5f4b80 1 -- 172.21.15.35:0/1899887744 wait complete. 2023-03-17T10:36:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff02c5f4b80 20 client.19092 trim_cache size 0 max 16384 2023-03-17T10:36:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff00409f640 msgr2=0x7ff0040a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff00409f640 0x7ff0040a1af0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff008006010 tx=0x7ff008000bc0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 msgr2=0x7ff0181a2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 0x7ff0181a2130 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7ff010007d70 tx=0x7ff01000a340 comp rx=0 tx=0).stop 2023-03-17T10:36:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 shutdown_connections 2023-03-17T10:36:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff00409f640 0x7ff0040a1af0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff018104390 0x7ff0181a2130 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0180ff350 0x7ff0181970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 --2- 172.21.15.35:0/732454916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0180ffcf0 0x7ff0181975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 >> 172.21.15.35:0/732454916 conn(0x7ff018076330 msgr2=0x7ff0180fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 shutdown_connections 2023-03-17T10:36:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:10:11.620+0000 7ff020467700 1 -- 172.21.15.35:0/732454916 wait complete. 2023-03-17T10:36:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 -- 172.21.15.35:0/2313571763 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 msgr2=0x7f397410d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 --2- 172.21.15.35:0/2313571763 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397410d100 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f396c00b0d0 tx=0x7f396c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 -- 172.21.15.35:0/2313571763 shutdown_connections 2023-03-17T10:36:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 --2- 172.21.15.35:0/2313571763 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397410d100 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 --2- 172.21.15.35:0/2313571763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3974100be0 0x7f3974100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 --2- 172.21.15.35:0/2313571763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3974101580 0x7f3974104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 -- 172.21.15.35:0/2313571763 >> 172.21.15.35:0/2313571763 conn(0x7f39740774e0 msgr2=0x7f39740778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 -- 172.21.15.35:0/2313571763 shutdown_connections 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.409+0000 7f3978f38700 1 -- 172.21.15.35:0/2313571763 wait complete. 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 Processor -- start 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 -- start start 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3974100be0 0x7f3974198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3974101580 0x7f3974198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397419d610 con 0x7f39741054f0 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397419d780 con 0x7f3974101580 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3978f38700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397419d940 con 0x7f3974100be0 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3972d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3972d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397419cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51140/0 (socket says 172.21.15.35:51140) 2023-03-17T10:36:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.410+0000 7f3972d9d700 1 -- 172.21.15.35:0/3966172165 learned_addr learned my addr 172.21.15.35:0/3966172165 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3971d9b700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3974101580 0x7f3974198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f397259c700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3974100be0 0x7f3974198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3972d9d700 1 -- 172.21.15.35:0/3966172165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3974100be0 msgr2=0x7f3974198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3972d9d700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3974100be0 0x7f3974198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3972d9d700 1 -- 172.21.15.35:0/3966172165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3974101580 msgr2=0x7f3974198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3972d9d700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3974101580 0x7f3974198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:52.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3972d9d700 1 -- 172.21.15.35:0/3966172165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c009d00 con 0x7f39741054f0 2023-03-17T10:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3972d9d700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397419cfd0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f396c009380 tx=0x7f396c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f396b7fe700 1 -- 172.21.15.35:0/3966172165 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c00e040 con 0x7f39741054f0 2023-03-17T10:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f396b7fe700 1 -- 172.21.15.35:0/3966172165 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f396c003e10 con 0x7f39741054f0 2023-03-17T10:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39741101c0 con 0x7f39741054f0 2023-03-17T10:36:53.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f396b7fe700 1 -- 172.21.15.35:0/3966172165 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c01ba00 con 0x7f39741054f0 2023-03-17T10:36:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.411+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3974110030 con 0x7f39741054f0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.413+0000 7f396b7fe700 1 -- 172.21.15.35:0/3966172165 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f396c024410 con 0x7f39741054f0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.414+0000 7f396b7fe700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f396009f6c0 0x7f39600a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.414+0000 7f396b7fe700 1 -- 172.21.15.35:0/3966172165 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f396c0cbd40 con 0x7f39741054f0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.414+0000 7f397259c700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f396009f6c0 0x7f39600a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f397259c700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f396009f6c0 0x7f39600a1b70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f395c005fd0 tx=0x7f395c005f60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 Processor -- start 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 -- start start 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67c04f0 0x55a4f67ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f66c1010 con 0x55a4f67ba960 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6713950 con 0x55a4f67c04f0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f39850c5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f670cde0 con 0x55a4f67bfbe0 2023-03-17T10:36:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.415+0000 7f3972d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51146/0 (socket says 172.21.15.35:51146) 2023-03-17T10:36:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 -- 172.21.15.35:0/3026262180 learned_addr learned my addr 172.21.15.35:0/3026262180 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:36:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f397259c700 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3971d9b700 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67c04f0 0x55a4f67ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 -- 172.21.15.35:0/3026262180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 msgr2=0x55a4f67bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 -- 172.21.15.35:0/3026262180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67c04f0 msgr2=0x55a4f67ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67c04f0 0x55a4f67ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 -- 172.21.15.35:0/3026262180 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4f658e5d0 con 0x55a4f67ba960 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3971d9b700 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67c04f0 0x55a4f67ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3972d9d700 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67bad90 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f396c0a1450 tx=0x7f396c01b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7526cb40bace00 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3968ff9700 1 -- 172.21.15.35:0/3026262180 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c0a1980 con 0x55a4f67ba960 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3968ff9700 1 -- 172.21.15.35:0/3026262180 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f396c095f30 con 0x55a4f67ba960 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.416+0000 7f3968ff9700 1 -- 172.21.15.35:0/3026262180 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c098f10 con 0x55a4f67ba960 2023-03-17T10:36:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 -- 172.21.15.35:0/3026262180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 msgr2=0x55a4f67bad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67bad90 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f396c0a1450 tx=0x7f396c01b470 comp rx=0 tx=0).stop 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 -- 172.21.15.35:0/3026262180 shutdown_connections 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67bad90 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 --2- 172.21.15.35:0/3026262180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67c04f0 0x55a4f67ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 -- 172.21.15.35:0/3026262180 >> 172.21.15.35:0/3026262180 conn(0x55a4f66176b0 msgr2=0x55a4f67b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 -- 172.21.15.35:0/3026262180 shutdown_connections 2023-03-17T10:36:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 -- 172.21.15.35:0/3026262180 wait complete. 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 -- start start 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.417+0000 7f39850c5b80 1 Processor -- start 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f67c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f65908c0 con 0x55a4f67ba960 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f67c44a0 con 0x55a4f67bfbe0 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f67cfd30 con 0x55a4f67c04f0 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f39850c5b80 10 client.0 _ll_register_callbacks cb 0x55a4f65b2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:36:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51150/0 (socket says 172.21.15.35:51150) 2023-03-17T10:36:56.480 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252025 2.10 MB/sec execute 491 sec latency 3718.681 ms 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:41 smithi035 ceph-mon[92535]: pgmap v3229: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 459 KiB/s wr, 39 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:43 smithi035 ceph-mon[92535]: pgmap v3230: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 588 KiB/s wr, 50 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:45 smithi035 ceph-mon[92535]: pgmap v3231: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 163 KiB/s wr, 20 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:46 smithi035 ceph-mon[92535]: pgmap v3232: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:46 smithi035 ceph-mon[92535]: pgmap v3233: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 178 KiB/s wr, 15 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:48 smithi035 ceph-mon[92535]: pgmap v3234: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 946 KiB/s wr, 91 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:50 smithi035 ceph-mon[92535]: pgmap v3235: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 946 KiB/s wr, 91 op/s 2023-03-17T10:36:56.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:52 smithi035 ceph-mon[92535]: pgmap v3236: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 771 KiB/s wr, 76 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:54 smithi035 ceph-mon[92535]: pgmap v3237: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:56 smithi035 ceph-mon[92535]: pgmap v3238: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:24:58 smithi035 ceph-mon[92535]: pgmap v3239: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:00 smithi035 ceph-mon[92535]: pgmap v3240: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 468 KiB/s wr, 47 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:02 smithi035 ceph-mon[92535]: pgmap v3241: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 468 KiB/s wr, 47 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:04 smithi035 ceph-mon[92535]: osdmap e277: 12 total, 12 up, 12 in 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:04 smithi035 ceph-mon[92535]: pgmap v3243: 97 pgs: 97 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 702 KiB/s wr, 95 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:06 smithi035 ceph-mon[92535]: pgmap v3244: 97 pgs: 97 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 702 KiB/s wr, 95 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:08 smithi035 ceph-mon[92535]: pgmap v3245: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:10 smithi035 ceph-mon[92535]: pgmap v3246: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:12 smithi035 ceph-mon[92535]: osdmap e278: 12 total, 12 up, 12 in 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:12 smithi035 ceph-mon[92535]: pgmap v3248: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 762 KiB/s wr, 55 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:14 smithi035 ceph-mon[92535]: pgmap v3249: 97 pgs: 97 active+clean; 152 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 679 KiB/s wr, 57 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:16 smithi035 ceph-mon[92535]: pgmap v3250: 97 pgs: 97 active+clean; 152 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 679 KiB/s wr, 57 op/s 2023-03-17T10:36:56.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:18 smithi035 ceph-mon[92535]: pgmap v3251: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 704 KiB/s wr, 83 op/s 2023-03-17T10:36:56.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:18 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:36:56.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:20 smithi035 ceph-mon[92535]: pgmap v3252: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 704 KiB/s wr, 83 op/s 2023-03-17T10:36:56.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:22 smithi035 ceph-mon[92535]: pgmap v3253: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 682 KiB/s wr, 81 op/s 2023-03-17T10:36:56.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:23 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:36:56.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:24 smithi035 ceph-mon[92535]: pgmap v3254: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1.1 MiB/s wr, 106 op/s 2023-03-17T10:36:56.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:26 smithi035 ceph-mon[92535]: pgmap v3255: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.0 MiB/s wr, 96 op/s 2023-03-17T10:36:57.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:28 smithi035 ceph-mon[92535]: pgmap v3256: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 1.1 MiB/s wr, 107 op/s 2023-03-17T10:36:57.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:30 smithi035 ceph-mon[92535]: pgmap v3257: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 552 KiB/s wr, 46 op/s 2023-03-17T10:36:57.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:32 smithi035 ceph-mon[92535]: pgmap v3258: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 552 KiB/s wr, 46 op/s 2023-03-17T10:36:57.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:33 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:36:57.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:34 smithi035 ceph-mon[92535]: pgmap v3259: 97 pgs: 97 active+clean; 155 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 863 KiB/s wr, 81 op/s 2023-03-17T10:36:57.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:36 smithi035 ceph-mon[92535]: pgmap v3260: 97 pgs: 97 active+clean; 155 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 353 KiB/s wr, 44 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:38 smithi035 ceph-mon[92535]: pgmap v3261: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 968 KiB/s wr, 97 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:40 smithi035 ceph-mon[92535]: pgmap v3262: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 926 KiB/s wr, 86 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:42 smithi035 ceph-mon[92535]: pgmap v3263: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 926 KiB/s wr, 86 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:44 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:44 smithi035 ceph-mon[92535]: pgmap v3264: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:46 smithi035 ceph-mon[92535]: pgmap v3265: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 752 KiB/s wr, 69 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:47 smithi035 ceph-mon[92535]: pgmap v3266: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 832 KiB/s wr, 76 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:47 smithi035 ceph-mon[92535]: pgmap v3267: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 185 KiB/s wr, 22 op/s 2023-03-17T10:36:57.510 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:49 smithi035 ceph-mon[92535]: pgmap v3268: 97 pgs: 97 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 581 KiB/s wr, 65 op/s 2023-03-17T10:36:59.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:51 smithi035 ceph-mon[92535]: pgmap v3269: 97 pgs: 97 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 581 KiB/s wr, 65 op/s 2023-03-17T10:36:59.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:53 smithi035 ceph-mon[92535]: pgmap v3270: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T10:36:59.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:55 smithi035 ceph-mon[92535]: pgmap v3271: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T10:36:59.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:57 smithi035 ceph-mon[92535]: pgmap v3272: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.1 MiB/s wr, 104 op/s 2023-03-17T10:36:59.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:25:59 smithi035 ceph-mon[92535]: pgmap v3273: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.0 MiB/s wr, 102 op/s 2023-03-17T10:36:59.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:01 smithi035 ceph-mon[92535]: pgmap v3274: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 761 KiB/s wr, 70 op/s 2023-03-17T10:37:01.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:03 smithi035 ceph-mon[92535]: pgmap v3275: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2023-03-17T10:37:01.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:04 smithi035 ceph-mon[92535]: osdmap e279: 12 total, 12 up, 12 in 2023-03-17T10:37:01.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:05 smithi035 ceph-mon[92535]: pgmap v3277: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 527 KiB/s wr, 74 op/s 2023-03-17T10:37:01.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:07 smithi035 ceph-mon[92535]: pgmap v3278: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 527 KiB/s wr, 74 op/s 2023-03-17T10:37:01.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:37:03.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:37:03.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:37:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:37:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:37:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:37:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:37:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:37:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:37:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:37:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:37:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:37:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:37:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:37:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:37:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 -- 172.21.15.35:0/4004600588 learned_addr learned my addr 172.21.15.35:0/4004600588 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f3971d9b700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f3972d9d700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f67c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 -- 172.21.15.35:0/4004600588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 msgr2=0x55a4f67c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f67c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 -- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67bfbe0 msgr2=0x55a4f67c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 -- 172.21.15.35:0/4004600588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3974110030 con 0x55a4f67ba960 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f397259c700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67c6450 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f395c00ffe0 tx=0x7f395c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f6f3cb9a2766ae server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:37:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.418+0000 7f3959ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f3959ffb700 1 -- 172.21.15.35:0/4004600588 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c028670 con 0x55a4f67ba960 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4f66cf390 con 0x55a4f67ba960 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f3959ffb700 1 -- 172.21.15.35:0/4004600588 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f395c0287d0 con 0x55a4f67ba960 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f3959ffb700 1 -- 172.21.15.35:0/4004600588 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f395c028990 con 0x55a4f67ba960 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 10 client.19104 fetch_fsmap learned FSMap version 45 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a4f653ad80 con 0x55a4f67ba960 2023-03-17T10:37:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f3959ffb700 1 -- 172.21.15.35:0/4004600588 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a4f66cf390 con 0x55a4f67ba960 2023-03-17T10:37:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f3959ffb700 1 -- 172.21.15.35:0/4004600588 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f395c01e430 con 0x55a4f67ba960 2023-03-17T10:37:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 10 client.19104 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:37:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 10 client.19104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 20 client.19104 populate_metadata read hostname 'smithi035' 2023-03-17T10:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f67d3eb0 0x55a4f67d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 4 client.19104 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4f66db600 con 0x55a4f67d3eb0 2023-03-17T10:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.419+0000 7f3971d9b700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f67d3eb0 0x55a4f67d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.420+0000 7f3971d9b700 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f67d3eb0 0x55a4f67d62c0 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a0eae1f6b5e63e server_cookie=4cc58061c1ca5607 in_seq=0 out_seq=0 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.420+0000 7f3959ffb700 10 client.19104 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f3959ffb700 1 -- 172.21.15.35:0/4004600588 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a4f66db600 con 0x55a4f67d3eb0 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f3959ffb700 10 client.19104 handle_command_reply: tid=0 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 client.19104 shutdown 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 msgr2=0x55a4f67c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67c6450 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f395c00ffe0 tx=0x7f395c004750 comp rx=0 tx=0).stop 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 shutdown_connections 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f67d3eb0 0x55a4f67d62c0 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f67c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67ba960 0x55a4f67c6450 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f3959ffb700 0 client.19104 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 --2- 172.21.15.35:0/4004600588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 >> 172.21.15.35:0/4004600588 conn(0x55a4f66176b0 msgr2=0x55a4f67b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 shutdown_connections 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 1 -- 172.21.15.35:0/4004600588 wait complete. 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.421+0000 7f39850c5b80 20 client.19104 trim_cache size 0 max 16384 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.436+0000 7f39850c5b80 1 Processor -- start 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 -- start start 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 0x55a4f67bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f67b15c0 con 0x55a4f67c04f0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f67c4cb0 con 0x55a4f67ba960 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f39850c5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f67ba7a0 con 0x55a4f67bfbe0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 0x55a4f67bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 0x55a4f67bd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51162/0 (socket says 172.21.15.35:51162) 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 -- 172.21.15.35:0/1054190378 learned_addr learned my addr 172.21.15.35:0/1054190378 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f397259c700 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3971d9b700 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 -- 172.21.15.35:0/1054190378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 msgr2=0x55a4f67c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 -- 172.21.15.35:0/1054190378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 msgr2=0x55a4f67cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 -- 172.21.15.35:0/1054190378 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4f66d3130 con 0x55a4f67c04f0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.437+0000 7f3972d9d700 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 0x55a4f67bd6b0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f396c099520 tx=0x7f396c095c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1211c64251c23c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39697fa700 1 -- 172.21.15.35:0/1054190378 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c099360 con 0x55a4f67c04f0 2023-03-17T10:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39697fa700 1 -- 172.21.15.35:0/1054190378 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f396c0a1980 con 0x55a4f67c04f0 2023-03-17T10:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39697fa700 1 -- 172.21.15.35:0/1054190378 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c099a80 con 0x55a4f67c04f0 2023-03-17T10:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 -- 172.21.15.35:0/1054190378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 msgr2=0x55a4f67bd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 0x55a4f67bd6b0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f396c099520 tx=0x7f396c095c90 comp rx=0 tx=0).stop 2023-03-17T10:37:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 -- 172.21.15.35:0/1054190378 shutdown_connections 2023-03-17T10:37:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67c04f0 0x55a4f67bd6b0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 --2- 172.21.15.35:0/1054190378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:15.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 -- 172.21.15.35:0/1054190378 >> 172.21.15.35:0/1054190378 conn(0x55a4f66176b0 msgr2=0x55a4f67b9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:37:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 -- 172.21.15.35:0/1054190378 shutdown_connections 2023-03-17T10:37:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.438+0000 7f39850c5b80 1 -- 172.21.15.35:0/1054190378 wait complete. 2023-03-17T10:37:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 -- start start 2023-03-17T10:37:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 Processor -- start 2023-03-17T10:37:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f6826d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6827250 con 0x55a4f67bfbe0 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6827390 con 0x55a4f67ba960 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f6827500 con 0x55a4f67c04f0 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f39850c5b80 10 client.0 _ll_register_callbacks cb 0x55a4f65b2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f3971d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f397259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f3971d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51166/0 (socket says 172.21.15.35:51166) 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f3971d9b700 1 -- 172.21.15.35:0/2570424093 learned_addr learned my addr 172.21.15.35:0/2570424093 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:37:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f3972d9d700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f6826d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f397259c700 1 -- 172.21.15.35:0/2570424093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 msgr2=0x55a4f6826d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f397259c700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f6826d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:18.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f397259c700 1 -- 172.21.15.35:0/2570424093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 msgr2=0x55a4f67c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f397259c700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.439+0000 7f397259c700 1 -- 172.21.15.35:0/2570424093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4f658e5d0 con 0x55a4f67ba960 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3972d9d700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f6826d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3971d9b700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f397259c700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67c8e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f395c00f8d0 tx=0x7f395c01ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f588497eb70509b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3959ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3959ffb700 1 -- 172.21.15.35:0/2570424093 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c01e9b0 con 0x55a4f67ba960 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4f678a1e0 con 0x55a4f67ba960 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3959ffb700 1 -- 172.21.15.35:0/2570424093 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f395c01eb10 con 0x55a4f67ba960 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3959ffb700 1 -- 172.21.15.35:0/2570424093 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f395c005040 con 0x55a4f67ba960 2023-03-17T10:37:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f39850c5b80 10 client.28286 fetch_fsmap learned FSMap version 45 2023-03-17T10:37:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a4f65611f0 con 0x55a4f67ba960 2023-03-17T10:37:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.440+0000 7f3959ffb700 1 -- 172.21.15.35:0/2570424093 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f395c047020 con 0x55a4f67ba960 2023-03-17T10:37:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f3959ffb700 1 -- 172.21.15.35:0/2570424093 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f395c004c20 con 0x55a4f67ba960 2023-03-17T10:37:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f39850c5b80 10 client.28286 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:37:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f39850c5b80 10 client.28286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:37:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f39850c5b80 20 client.28286 populate_metadata read hostname 'smithi035' 2023-03-17T10:37:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f39850c5b80 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f6828c00 0x55a4f682b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f39850c5b80 4 client.28286 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:37:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a4f6590f00 con 0x55a4f6828c00 2023-03-17T10:37:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f3971d9b700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f6828c00 0x55a4f682b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f3959ffb700 10 client.28286 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:37:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.441+0000 7f3971d9b700 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f6828c00 0x55a4f682b010 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc3fb2d4c2f022fb server_cookie=96cf78a6c2b8bb83 in_seq=0 out_seq=0 2023-03-17T10:37:24.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f3959ffb700 1 -- 172.21.15.35:0/2570424093 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a4f6590f00 con 0x55a4f6828c00 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f3959ffb700 10 client.28286 handle_command_reply: tid=0 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 client.28286 shutdown 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 msgr2=0x55a4f67c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67c8e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f395c00f8d0 tx=0x7f395c01ed40 comp rx=0 tx=0).stop 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 shutdown_connections 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a4f6828c00 0x55a4f682b010 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4f67c04f0 0x55a4f6826d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f3959ffb700 0 client.28286 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a4f67ba960 0x55a4f67c8e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 --2- 172.21.15.35:0/2570424093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a4f67bfbe0 0x55a4f67c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 >> 172.21.15.35:0/2570424093 conn(0x55a4f66176b0 msgr2=0x55a4f67bd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 shutdown_connections 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 1 -- 172.21.15.35:0/2570424093 wait complete. 2023-03-17T10:37:24.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.450+0000 7f39850c5b80 20 client.28286 trim_cache size 0 max 16384 2023-03-17T10:37:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f396009f6c0 msgr2=0x7f39600a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f396009f6c0 0x7f39600a1b70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f395c005fd0 tx=0x7f395c005f60 comp rx=0 tx=0).stop 2023-03-17T10:37:24.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 msgr2=0x7f397419cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:25.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397419cfd0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f396c009380 tx=0x7f396c0093b0 comp rx=0 tx=0).stop 2023-03-17T10:37:25.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 shutdown_connections 2023-03-17T10:37:25.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f396009f6c0 0x7f39600a1b70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f39741054f0 0x7f397419cfd0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3974100be0 0x7f3974198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 --2- 172.21.15.35:0/3966172165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3974101580 0x7f3974198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 >> 172.21.15.35:0/3966172165 conn(0x7f39740774e0 msgr2=0x7f39740feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:37:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 shutdown_connections 2023-03-17T10:37:27.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:41.451+0000 7f3978f38700 1 -- 172.21.15.35:0/3966172165 wait complete. 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 -- 172.21.15.35:0/29475857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b8105530 msgr2=0x7fc0b810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/29475857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b8105530 0x7fc0b810d100 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b0d0 tx=0x7fc0b000b3e0 comp rx=0 tx=0).stop 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 -- 172.21.15.35:0/29475857 shutdown_connections 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/29475857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b8105530 0x7fc0b810d100 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/29475857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b81004f0 0x7fc0b81008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/29475857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b8100e90 0x7fc0b8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.573+0000 7fc0c01a4700 1 -- 172.21.15.35:0/29475857 >> 172.21.15.35:0/29475857 conn(0x7fc0b8078170 msgr2=0x7fc0b8078570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.574+0000 7fc0c01a4700 1 -- 172.21.15.35:0/29475857 shutdown_connections 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.574+0000 7fc0c01a4700 1 -- 172.21.15.35:0/29475857 wait complete. 2023-03-17T10:37:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.574+0000 7fc0c01a4700 1 Processor -- start 2023-03-17T10:37:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.574+0000 7fc0c01a4700 1 -- start start 2023-03-17T10:37:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0c01a4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 0x7fc0b8196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0c01a4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b8100e90 0x7fc0b81968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0c01a4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b8105530 0x7fc0b819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0c01a4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b819b340 con 0x7fc0b81004f0 2023-03-17T10:37:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0c01a4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b819b4b0 con 0x7fc0b8105530 2023-03-17T10:37:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0c01a4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b819b670 con 0x7fc0b8100e90 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 0x7fc0b8196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 0x7fc0b8196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51178/0 (socket says 172.21.15.35:51178) 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1818886913 learned_addr learned my addr 172.21.15.35:0/1818886913 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0be741700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b8105530 0x7fc0b819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b8100e90 0x7fc0b81968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1818886913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b8100e90 msgr2=0x7fc0b81968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b8100e90 0x7fc0b81968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:31.589 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252106 2.10 MB/sec execute 492 sec latency 4514.140 ms 2023-03-17T10:37:32.777 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252346 2.09 MB/sec execute 493 sec latency 12.918 ms 2023-03-17T10:37:32.777 INFO:tasks.workunit.client.0.smithi035.stdout: 1 252760 2.09 MB/sec execute 494 sec latency 18.215 ms 2023-03-17T10:37:32.777 INFO:tasks.workunit.client.0.smithi035.stdout: 1 253304 2.10 MB/sec execute 495 sec latency 22.833 ms 2023-03-17T10:37:32.777 INFO:tasks.workunit.client.0.smithi035.stdout: 1 253744 2.09 MB/sec execute 496 sec latency 22.741 ms 2023-03-17T10:37:32.777 INFO:tasks.workunit.client.0.smithi035.stdout: 1 254288 2.09 MB/sec execute 497 sec latency 24.281 ms 2023-03-17T10:37:34.026 INFO:tasks.workunit.client.0.smithi035.stdout: 1 254895 2.10 MB/sec execute 498 sec latency 14.910 ms 2023-03-17T10:37:34.027 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255404 2.10 MB/sec execute 499 sec latency 17.123 ms 2023-03-17T10:37:34.027 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255493 2.10 MB/sec execute 500 sec latency 822.736 ms 2023-03-17T10:37:34.027 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255493 2.10 MB/sec execute 501 sec latency 1822.845 ms 2023-03-17T10:37:34.027 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255493 2.09 MB/sec execute 502 sec latency 2822.923 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255560 2.09 MB/sec execute 503 sec latency 3042.086 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255560 2.08 MB/sec execute 504 sec latency 1528.700 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255560 2.08 MB/sec execute 505 sec latency 2528.777 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255560 2.08 MB/sec execute 506 sec latency 3528.912 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255560 2.07 MB/sec execute 507 sec latency 4528.963 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 255783 2.07 MB/sec execute 508 sec latency 4746.398 ms 2023-03-17T10:37:34.825 INFO:tasks.workunit.client.0.smithi035.stdout: 1 256034 2.07 MB/sec execute 509 sec latency 21.209 ms 2023-03-17T10:37:36.035 INFO:tasks.workunit.client.0.smithi035.stdout: 1 256541 2.07 MB/sec execute 510 sec latency 14.790 ms 2023-03-17T10:37:36.035 INFO:tasks.workunit.client.0.smithi035.stdout: 1 257012 2.07 MB/sec execute 511 sec latency 24.892 ms 2023-03-17T10:37:36.035 INFO:tasks.workunit.client.0.smithi035.stdout: 1 257515 2.07 MB/sec execute 512 sec latency 34.683 ms 2023-03-17T10:37:37.271 INFO:tasks.workunit.client.0.smithi035.stdout: 1 258003 2.07 MB/sec execute 513 sec latency 24.281 ms 2023-03-17T10:37:37.271 INFO:tasks.workunit.client.0.smithi035.stdout: 1 258709 2.07 MB/sec execute 514 sec latency 33.907 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259038 2.08 MB/sec execute 515 sec latency 146.374 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259038 2.07 MB/sec execute 516 sec latency 1146.462 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259038 2.07 MB/sec execute 517 sec latency 2146.579 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259105 2.06 MB/sec execute 518 sec latency 2366.400 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259105 2.06 MB/sec execute 519 sec latency 1509.875 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259105 2.06 MB/sec execute 520 sec latency 2509.973 ms 2023-03-17T10:37:40.361 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259105 2.05 MB/sec execute 521 sec latency 3510.028 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259105 2.05 MB/sec execute 522 sec latency 4510.077 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259295 2.05 MB/sec execute 523 sec latency 4727.097 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 259558 2.04 MB/sec execute 524 sec latency 17.358 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 260028 2.04 MB/sec execute 525 sec latency 21.605 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 260503 2.05 MB/sec execute 526 sec latency 25.424 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 261025 2.04 MB/sec execute 527 sec latency 22.210 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 261519 2.04 MB/sec execute 528 sec latency 21.833 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262252 2.05 MB/sec execute 529 sec latency 14.165 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262584 2.05 MB/sec execute 530 sec latency 117.897 ms 2023-03-17T10:37:40.362 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262584 2.05 MB/sec execute 531 sec latency 1117.976 ms 2023-03-17T10:37:41.486 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262584 2.05 MB/sec execute 532 sec latency 2118.036 ms 2023-03-17T10:37:42.871 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262651 2.04 MB/sec execute 533 sec latency 2338.803 ms 2023-03-17T10:37:42.871 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262651 2.04 MB/sec execute 534 sec latency 1514.516 ms 2023-03-17T10:37:42.871 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262651 2.03 MB/sec execute 535 sec latency 2514.639 ms 2023-03-17T10:37:42.871 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262651 2.03 MB/sec execute 536 sec latency 3514.725 ms 2023-03-17T10:37:42.874 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262651 2.03 MB/sec execute 537 sec latency 4514.776 ms 2023-03-17T10:37:43.946 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262663 2.02 MB/sec execute 538 sec latency 4728.882 ms 2023-03-17T10:37:43.947 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262663 2.02 MB/sec execute 539 sec latency 1714.756 ms 2023-03-17T10:37:43.947 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262676 2.02 MB/sec execute 540 sec latency 2653.042 ms 2023-03-17T10:37:43.947 INFO:tasks.workunit.client.0.smithi035.stdout: 1 262929 2.01 MB/sec execute 541 sec latency 14.197 ms 2023-03-17T10:37:43.947 INFO:tasks.workunit.client.0.smithi035.stdout: 1 263235 2.01 MB/sec execute 542 sec latency 18.118 ms 2023-03-17T10:37:43.947 INFO:tasks.workunit.client.0.smithi035.stdout: 1 263733 2.01 MB/sec execute 543 sec latency 11.520 ms 2023-03-17T10:37:44.477 INFO:tasks.workunit.client.0.smithi035.stdout: 1 264209 2.01 MB/sec execute 544 sec latency 22.083 ms 2023-03-17T10:37:45.494 INFO:tasks.workunit.client.0.smithi035.stdout: 1 264838 2.01 MB/sec execute 545 sec latency 22.105 ms 2023-03-17T10:37:45.494 INFO:tasks.workunit.client.0.smithi035.stdout: 1 265133 2.01 MB/sec execute 546 sec latency 150.379 ms 2023-03-17T10:37:45.494 INFO:tasks.workunit.client.0.smithi035.stdout: 1 265827 2.02 MB/sec execute 547 sec latency 32.145 ms 2023-03-17T10:37:45.494 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266128 2.02 MB/sec execute 548 sec latency 360.233 ms 2023-03-17T10:37:45.494 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266128 2.02 MB/sec execute 549 sec latency 1360.342 ms 2023-03-17T10:37:45.494 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266128 2.01 MB/sec execute 550 sec latency 2360.452 ms 2023-03-17T10:37:45.497 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266128 2.01 MB/sec execute 551 sec latency 3360.556 ms 2023-03-17T10:37:45.497 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266128 2.01 MB/sec execute 552 sec latency 4360.655 ms 2023-03-17T10:37:45.497 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266195 2.00 MB/sec execute 553 sec latency 4574.996 ms 2023-03-17T10:37:45.497 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266195 2.00 MB/sec execute 554 sec latency 1513.644 ms 2023-03-17T10:37:45.497 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266207 2.00 MB/sec execute 555 sec latency 2453.129 ms 2023-03-17T10:37:46.635 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266473 1.99 MB/sec execute 556 sec latency 25.650 ms 2023-03-17T10:37:46.635 INFO:tasks.workunit.client.0.smithi035.stdout: 1 266771 1.99 MB/sec execute 557 sec latency 20.725 ms 2023-03-17T10:37:47.391 INFO:tasks.workunit.client.0.smithi035.stdout: 1 267267 1.99 MB/sec execute 558 sec latency 15.816 ms 2023-03-17T10:37:47.391 INFO:tasks.workunit.client.0.smithi035.stdout: 1 267752 1.99 MB/sec execute 559 sec latency 22.373 ms 2023-03-17T10:37:47.391 INFO:tasks.workunit.client.0.smithi035.stdout: 1 268355 1.99 MB/sec execute 560 sec latency 22.931 ms 2023-03-17T10:37:47.391 INFO:tasks.workunit.client.0.smithi035.stdout: 1 268839 2.00 MB/sec execute 561 sec latency 14.988 ms 2023-03-17T10:37:48.263 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269392 2.00 MB/sec execute 562 sec latency 15.156 ms 2023-03-17T10:37:48.264 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269675 2.00 MB/sec execute 563 sec latency 503.433 ms 2023-03-17T10:37:48.264 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269675 2.00 MB/sec execute 564 sec latency 1503.532 ms 2023-03-17T10:37:50.443 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269675 1.99 MB/sec execute 565 sec latency 2503.649 ms 2023-03-17T10:37:50.444 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269675 1.99 MB/sec execute 566 sec latency 3503.764 ms 2023-03-17T10:37:50.444 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269675 1.99 MB/sec execute 567 sec latency 4503.864 ms 2023-03-17T10:37:50.444 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269742 1.98 MB/sec execute 568 sec latency 4716.532 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269742 1.98 MB/sec execute 569 sec latency 1503.017 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269754 1.98 MB/sec execute 570 sec latency 2444.295 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 269998 1.98 MB/sec execute 571 sec latency 22.190 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 270284 1.97 MB/sec execute 572 sec latency 20.653 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 270785 1.97 MB/sec execute 573 sec latency 12.371 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 271254 1.97 MB/sec execute 574 sec latency 24.116 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 271803 1.97 MB/sec execute 575 sec latency 24.807 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 272347 1.98 MB/sec execute 576 sec latency 15.042 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 272919 1.98 MB/sec execute 577 sec latency 15.055 ms 2023-03-17T10:37:51.575 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273219 1.98 MB/sec execute 578 sec latency 353.353 ms 2023-03-17T10:37:51.576 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273219 1.98 MB/sec execute 579 sec latency 1353.469 ms 2023-03-17T10:37:51.576 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273219 1.98 MB/sec execute 580 sec latency 2353.582 ms 2023-03-17T10:37:51.577 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:09 smithi035 ceph-mon[92535]: pgmap v3279: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T10:37:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1818886913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b8105530 msgr2=0x7fc0b819ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b8105530 0x7fc0b819ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1818886913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009d00 con 0x7fc0b81004f0 2023-03-17T10:37:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.575+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 0x7fc0b8196360 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400d980 tx=0x7fc0b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:37:52.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.576+0000 7fc0aeffd700 1 -- 172.21.15.35:0/1818886913 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4004220 con 0x7fc0b81004f0 2023-03-17T10:37:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.576+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b81101b0 con 0x7fc0b81004f0 2023-03-17T10:37:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.576+0000 7fc0aeffd700 1 -- 172.21.15.35:0/1818886913 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0b4007640 con 0x7fc0b81004f0 2023-03-17T10:37:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.576+0000 7fc0aeffd700 1 -- 172.21.15.35:0/1818886913 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40055e0 con 0x7fc0b81004f0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.576+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b8110020 con 0x7fc0b81004f0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.578+0000 7fc0aeffd700 1 -- 172.21.15.35:0/1818886913 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc0b4004750 con 0x7fc0b81004f0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.578+0000 7fc0aeffd700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc0a409f640 0x7fc0a40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.579+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc0a409f640 0x7fc0a40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.579+0000 7fc0aeffd700 1 -- 172.21.15.35:0/1818886913 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc0b40ca4a0 con 0x7fc0b81004f0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.579+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc0a409f640 0x7fc0a40a1af0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8197970 tx=0x7fc0a800d4b0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.579+0000 7fc0cc331b80 1 Processor -- start 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.579+0000 7fc0cc331b80 1 -- start start 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 0x563614c17420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c17960 0x563614c17d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614b1e010 con 0x563614c1d4f0 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614b70950 con 0x563614c17960 2023-03-17T10:37:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614b69de0 con 0x563614c1cbe0 2023-03-17T10:37:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 0x563614c17420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 0x563614c17420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51188/0 (socket says 172.21.15.35:51188) 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 -- 172.21.15.35:0/3184346295 learned_addr learned my addr 172.21.15.35:0/3184346295 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0be741700 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c17960 0x563614c17d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c1cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 -- 172.21.15.35:0/3184346295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 msgr2=0x563614c1cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c1cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 -- 172.21.15.35:0/3184346295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c17960 msgr2=0x563614c17d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c17960 0x563614c17d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 -- 172.21.15.35:0/3184346295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636149eb5d0 con 0x563614c1d4f0 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 0x563614c17420 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800fbc0 tx=0x7fc0a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab6b28bf6304ee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.580+0000 7fc0a3fff700 1 -- 172.21.15.35:0/3184346295 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8011ad0 con 0x563614c1d4f0 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0a3fff700 1 -- 172.21.15.35:0/3184346295 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0a8011c30 con 0x563614c1d4f0 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0a3fff700 1 -- 172.21.15.35:0/3184346295 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a801d610 con 0x563614c1d4f0 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 -- 172.21.15.35:0/3184346295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 msgr2=0x563614c17420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 0x563614c17420 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800fbc0 tx=0x7fc0a8012000 comp rx=0 tx=0).stop 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 -- 172.21.15.35:0/3184346295 shutdown_connections 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c17960 0x563614c17d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/3184346295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1d4f0 0x563614c17420 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 -- 172.21.15.35:0/3184346295 >> 172.21.15.35:0/3184346295 conn(0x563614a746b0 msgr2=0x563614c11a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 -- 172.21.15.35:0/3184346295 shutdown_connections 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.581+0000 7fc0cc331b80 1 -- 172.21.15.35:0/3184346295 wait complete. 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 -- start start 2023-03-17T10:37:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 Processor -- start 2023-03-17T10:37:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c233e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1cbe0 0x563614c206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1d4f0 0x563614c20c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:37:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636149ed8c0 con 0x563614c17960 2023-03-17T10:37:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c21400 con 0x563614c1cbe0 2023-03-17T10:37:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c2d060 con 0x563614c1d4f0 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0cc331b80 10 client.0 _ll_register_callbacks cb 0x563614a0f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0bdf40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0bdf40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c233e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51192/0 (socket says 172.21.15.35:51192) 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.582+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1985988733 learned_addr learned my addr 172.21.15.35:0/1985988733 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1cbe0 0x563614c206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0be741700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1d4f0 0x563614c20c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:37:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1985988733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1d4f0 msgr2=0x563614c20c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:37:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1d4f0 0x563614c20c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1cbe0 msgr2=0x563614c206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1cbe0 0x563614c206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bdf40700 1 -- 172.21.15.35:0/1985988733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a800f8a0 con 0x563614c17960 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0be741700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1d4f0 0x563614c20c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c233e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4000c00 tx=0x7fc0b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a6610badc19dd8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0a17fa700 1 -- 172.21.15.35:0/1985988733 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4097ef0 con 0x563614c17960 2023-03-17T10:38:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0a17fa700 1 -- 172.21.15.35:0/1985988733 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc0b40a00e0 con 0x563614c17960 2023-03-17T10:38:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563614b2c390 con 0x563614c17960 2023-03-17T10:38:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0a17fa700 1 -- 172.21.15.35:0/1985988733 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0b40b0220 con 0x563614c17960 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0cc331b80 10 client.19122 fetch_fsmap learned FSMap version 45 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x563614997d80 con 0x563614c17960 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.583+0000 7fc0a17fa700 1 -- 172.21.15.35:0/1985988733 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0b40b4020 con 0x563614c17960 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0a17fa700 1 -- 172.21.15.35:0/1985988733 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc0b409fd70 con 0x563614c17960 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0cc331b80 10 client.19122 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0cc331b80 10 client.19122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0cc331b80 20 client.19122 populate_metadata read hostname 'smithi035' 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c310d0 0x563614c334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0cc331b80 4 client.19122 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563614b38600 con 0x563614c310d0 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c310d0 0x563614c334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c310d0 0x563614c334b0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf28f98eb98f219c server_cookie=5ec5594961bdd38e in_seq=0 out_seq=0 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.584+0000 7fc0a17fa700 10 client.19122 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0a17fa700 1 -- 172.21.15.35:0/1985988733 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563614b38600 con 0x563614c310d0 2023-03-17T10:38:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0a17fa700 10 client.19122 handle_command_reply: tid=0 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 client.19122 shutdown 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 msgr2=0x563614c233e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c233e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4000c00 tx=0x7fc0b4005830 comp rx=0 tx=0).stop 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 shutdown_connections 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c310d0 0x563614c334b0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1d4f0 0x563614c20c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0a17fa700 0 client.19122 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c233e0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/1985988733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1cbe0 0x563614c206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 >> 172.21.15.35:0/1985988733 conn(0x563614a746b0 msgr2=0x563614c16410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 shutdown_connections 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 1 -- 172.21.15.35:0/1985988733 wait complete. 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.585+0000 7fc0cc331b80 20 client.19122 trim_cache size 0 max 16384 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 Processor -- start 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 -- start start 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c17960 0x563614c27fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 0x563614c22f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c1a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c2e800 con 0x563614c1cbe0 2023-03-17T10:38:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c126d0 con 0x563614c1d4f0 2023-03-17T10:38:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c0eb90 con 0x563614c17960 2023-03-17T10:38:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 0x563614c22f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 0x563614c22f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51202/0 (socket says 172.21.15.35:51202) 2023-03-17T10:38:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 -- 172.21.15.35:0/445291157 learned_addr learned my addr 172.21.15.35:0/445291157 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c17960 0x563614c27fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0be741700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c1a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 -- 172.21.15.35:0/445291157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c17960 msgr2=0x563614c27fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c17960 0x563614c27fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 -- 172.21.15.35:0/445291157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 msgr2=0x563614c1a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c1a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bd73f700 1 -- 172.21.15.35:0/445291157 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563614b30130 con 0x563614c1cbe0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0be741700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c1a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.601+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c17960 0x563614c27fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 0x563614c22f80 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800fb90 tx=0x7fc0a8011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d75c15f0613cf5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0acff9700 1 -- 172.21.15.35:0/445291157 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a802d040 con 0x563614c1cbe0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0acff9700 1 -- 172.21.15.35:0/445291157 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0a802e040 con 0x563614c1cbe0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0acff9700 1 -- 172.21.15.35:0/445291157 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8005040 con 0x563614c1cbe0 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 -- 172.21.15.35:0/445291157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 msgr2=0x563614c22f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 0x563614c22f80 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800fb90 tx=0x7fc0a8011a10 comp rx=0 tx=0).stop 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 -- 172.21.15.35:0/445291157 shutdown_connections 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c1a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c17960 0x563614c27fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/445291157 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c1cbe0 0x563614c22f80 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 -- 172.21.15.35:0/445291157 >> 172.21.15.35:0/445291157 conn(0x563614a746b0 msgr2=0x563614c2c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 -- 172.21.15.35:0/445291157 shutdown_connections 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.602+0000 7fc0cc331b80 1 -- 172.21.15.35:0/445291157 wait complete. 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 -- start start 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 Processor -- start 2023-03-17T10:38:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c27c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c28150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c26140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c26850 con 0x563614c17960 2023-03-17T10:38:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c269c0 con 0x563614c1d4f0 2023-03-17T10:38:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563614c26b80 con 0x563614c1cbe0 2023-03-17T10:38:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0cc331b80 10 client.0 _ll_register_callbacks cb 0x563614a0f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:38:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0bdf40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c27c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0bdf40700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c27c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51206/0 (socket says 172.21.15.35:51206) 2023-03-17T10:38:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.603+0000 7fc0bdf40700 1 -- 172.21.15.35:0/2958282245 learned_addr learned my addr 172.21.15.35:0/2958282245 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0be741700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c26140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c28150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bdf40700 1 -- 172.21.15.35:0/2958282245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 msgr2=0x563614c28150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c28150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bdf40700 1 -- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 msgr2=0x563614c26140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c26140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bdf40700 1 -- 172.21.15.35:0/2958282245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636149eb5d0 con 0x563614c17960 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0be741700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:38:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0bdf40700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c27c10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fc0b409fbb0 tx=0x7fc0b400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660a16f8a8ad7e3e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0a17fa700 1 -- 172.21.15.35:0/2958282245 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4093f40 con 0x563614c17960 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0a17fa700 1 -- 172.21.15.35:0/2958282245 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc0b40b5080 con 0x563614c17960 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563614be71e0 con 0x563614c17960 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0a17fa700 1 -- 172.21.15.35:0/2958282245 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0b4097ef0 con 0x563614c17960 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0cc331b80 10 client.19128 fetch_fsmap learned FSMap version 45 2023-03-17T10:38:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5636149be1f0 con 0x563614c17960 2023-03-17T10:38:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0a17fa700 1 -- 172.21.15.35:0/2958282245 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563614be71e0 con 0x563614c17960 2023-03-17T10:38:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.604+0000 7fc0a17fa700 1 -- 172.21.15.35:0/2958282245 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc0b4061c80 con 0x563614c17960 2023-03-17T10:38:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0cc331b80 10 client.19128 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0cc331b80 10 client.19128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0cc331b80 20 client.19128 populate_metadata read hostname 'smithi035' 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c8a1d0 0x563614c8c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0cc331b80 4 client.19128 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5636149edf00 con 0x563614c8a1d0 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c8a1d0 0x563614c8c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0bd73f700 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c8a1d0 0x563614c8c5e0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7374e5be315c6198 server_cookie=59dbec158362a17c in_seq=0 out_seq=0 2023-03-17T10:38:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.605+0000 7fc0a17fa700 10 client.19128 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0a17fa700 1 -- 172.21.15.35:0/2958282245 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5636149edf00 con 0x563614c8a1d0 2023-03-17T10:38:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0a17fa700 10 client.19128 handle_command_reply: tid=0 2023-03-17T10:38:14.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 client.19128 shutdown 2023-03-17T10:38:14.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 msgr2=0x563614c27c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:14.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c27c10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fc0b409fbb0 tx=0x7fc0b400f3c0 comp rx=0 tx=0).stop 2023-03-17T10:38:14.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 shutdown_connections 2023-03-17T10:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563614c8a1d0 0x563614c8c5e0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563614c1d4f0 0x563614c26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563614c17960 0x563614c27c10 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 --2- 172.21.15.35:0/2958282245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563614c1cbe0 0x563614c28150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0a17fa700 0 client.19128 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 >> 172.21.15.35:0/2958282245 conn(0x563614a746b0 msgr2=0x563614c1a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 shutdown_connections 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 1 -- 172.21.15.35:0/2958282245 wait complete. 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.610+0000 7fc0cc331b80 20 client.19128 trim_cache size 0 max 16384 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc0a409f640 msgr2=0x7fc0a40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc0a409f640 0x7fc0a40a1af0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8197970 tx=0x7fc0a800d4b0 comp rx=0 tx=0).stop 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 msgr2=0x7fc0b8196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 0x7fc0b8196360 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400d980 tx=0x7fc0b400dc90 comp rx=0 tx=0).stop 2023-03-17T10:38:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 shutdown_connections 2023-03-17T10:38:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc0a409f640 0x7fc0a40a1af0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0b8105530 0x7fc0b819ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc0b81004f0 0x7fc0b8196360 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 --2- 172.21.15.35:0/1818886913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b8100e90 0x7fc0b81968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 >> 172.21.15.35:0/1818886913 conn(0x7fc0b8078170 msgr2=0x7fc0b80fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 shutdown_connections 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:12:54.611+0000 7fc0c01a4700 1 -- 172.21.15.35:0/1818886913 wait complete. 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 -- 172.21.15.35:0/3284513715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 msgr2=0x7f3f2c101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3284513715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c101800 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009990 tx=0x7f3f1c009ca0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 -- 172.21.15.35:0/3284513715 shutdown_connections 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3284513715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c10a770 0x7f3f2c10cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3284513715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c101800 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3284513715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c101d40 0x7f3f2c10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 -- 172.21.15.35:0/3284513715 >> 172.21.15.35:0/3284513715 conn(0x7f3f2c076330 msgr2=0x7f3f2c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 -- 172.21.15.35:0/3284513715 shutdown_connections 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.733+0000 7f3f31b29700 1 -- 172.21.15.35:0/3284513715 wait complete. 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 Processor -- start 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 -- start start 2023-03-17T10:38:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:18.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c101d40 0x7f3f2c196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:18.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c10a770 0x7f3f2c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:18.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c19b120 con 0x7f3f2c101430 2023-03-17T10:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c19b290 con 0x7f3f2c10a770 2023-03-17T10:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f31b29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c19b450 con 0x7f3f2c101d40 2023-03-17T10:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51220/0 (socket says 172.21.15.35:51220) 2023-03-17T10:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3312495046 learned_addr learned my addr 172.21.15.35:0/3312495046 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:20.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f2affd700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c101d40 0x7f3f2c196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:20.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.734+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c10a770 0x7f3f2c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:20.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3312495046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c101d40 msgr2=0x7f3f2c196680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:20.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c101d40 0x7f3f2c196680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3312495046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c10a770 msgr2=0x7f3f2c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c10a770 0x7f3f2c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3312495046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0095f0 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c10a770 0x7f3f2c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2affd700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c101d40 0x7f3f2c196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c196140 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c006010 tx=0x7f3f1c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f28ff9700 1 -- 172.21.15.35:0/3312495046 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c01d070 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c1100b0 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f28ff9700 1 -- 172.21.15.35:0/3312495046 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f1c004100 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f28ff9700 1 -- 172.21.15.35:0/3312495046 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c022ce0 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.735+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c10ff20 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.737+0000 7f3f28ff9700 1 -- 172.21.15.35:0/3312495046 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3f1c022470 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.738+0000 7f3f28ff9700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3f1409f640 0x7f3f140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.738+0000 7f3f28ff9700 1 -- 172.21.15.35:0/3312495046 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3f1c022e40 con 0x7f3f2c101430 2023-03-17T10:38:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.738+0000 7f3f2affd700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3f1409f640 0x7f3f140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.738+0000 7f3f2affd700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3f1409f640 0x7f3f140a1af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3f20005fd0 tx=0x7f3f20005e30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 Processor -- start 2023-03-17T10:38:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 -- start start 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5574721664f0 0x557472160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557472067010 con 0x557472160960 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574720b9950 con 0x5574721664f0 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.739+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574720b2de0 con 0x557472165be0 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51232/0 (socket says 172.21.15.35:51232) 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 -- 172.21.15.35:0/33644355 learned_addr learned my addr 172.21.15.35:0/33644355 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2affd700 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5574721664f0 0x557472160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 -- 172.21.15.35:0/33644355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 msgr2=0x557472165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 -- 172.21.15.35:0/33644355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5574721664f0 msgr2=0x557472160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:24.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5574721664f0 0x557472160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 -- 172.21.15.35:0/33644355 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557471f345d0 con 0x557472160960 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160d90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009dd0 tx=0x7f3f240077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea411d0308aeae4a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f11ffb700 1 -- 172.21.15.35:0/33644355 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24018070 con 0x557472160960 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f11ffb700 1 -- 172.21.15.35:0/33644355 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f2400f050 con 0x557472160960 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.740+0000 7f3f11ffb700 1 -- 172.21.15.35:0/33644355 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24005970 con 0x557472160960 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/33644355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 msgr2=0x557472160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160d90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009dd0 tx=0x7f3f240077e0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/33644355 shutdown_connections 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160d90 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/33644355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5574721664f0 0x557472160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/33644355 >> 172.21.15.35:0/33644355 conn(0x557471fbd6b0 msgr2=0x55747215aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/33644355 shutdown_connections 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/33644355 wait complete. 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.741+0000 7f3f3dcb6b80 1 -- start start 2023-03-17T10:38:24.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 Processor -- start 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472160960 0x55747216c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472169640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 0x557472169be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557471f368c0 con 0x5574721664f0 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747216a320 con 0x557472160960 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747216a4e0 con 0x557472165be0 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f3dcb6b80 10 client.0 _ll_register_callbacks cb 0x557471f58230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 0x557472169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 0x557472169be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51238/0 (socket says 172.21.15.35:51238) 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 -- 172.21.15.35:0/4127017910 learned_addr learned my addr 172.21.15.35:0/4127017910 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472160960 0x55747216c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 -- 172.21.15.35:0/4127017910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 msgr2=0x557472169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 -- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472160960 msgr2=0x55747216c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472160960 0x55747216c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.742+0000 7f3f2bfff700 1 -- 172.21.15.35:0/4127017910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f24009a00 con 0x5574721664f0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 0x557472169be0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3f24000f80 tx=0x7f3f24009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69418535f41cd7d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f0affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f0affd700 1 -- 172.21.15.35:0/4127017910 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24018030 con 0x5574721664f0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f0affd700 1 -- 172.21.15.35:0/4127017910 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3f24005960 con 0x5574721664f0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557472075390 con 0x5574721664f0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f0affd700 1 -- 172.21.15.35:0/4127017910 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f2401e450 con 0x5574721664f0 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 10 client.19140 fetch_fsmap learned FSMap version 45 2023-03-17T10:38:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x557471ee0d80 con 0x5574721664f0 2023-03-17T10:38:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f0affd700 1 -- 172.21.15.35:0/4127017910 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557472075390 con 0x5574721664f0 2023-03-17T10:38:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f0affd700 1 -- 172.21.15.35:0/4127017910 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3f24014410 con 0x5574721664f0 2023-03-17T10:38:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 10 client.19140 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:38:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 10 client.19140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:38:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 20 client.19140 populate_metadata read hostname 'smithi035' 2023-03-17T10:38:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557472179fe0 0x55747217c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 4 client.19140 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:38:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.743+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557472081600 con 0x557472179fe0 2023-03-17T10:38:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.744+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557472179fe0 0x55747217c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.744+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557472179fe0 0x55747217c3f0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34d3757f7a76042 server_cookie=6bd4cc0d0fef9b5 in_seq=0 out_seq=0 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.744+0000 7f3f0affd700 10 client.19140 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f0affd700 1 -- 172.21.15.35:0/4127017910 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557472081600 con 0x557472179fe0 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f0affd700 10 client.19140 handle_command_reply: tid=0 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 client.19140 shutdown 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 msgr2=0x557472169be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 0x557472169be0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3f24000f80 tx=0x7f3f24009960 comp rx=0 tx=0).stop 2023-03-17T10:38:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 shutdown_connections 2023-03-17T10:38:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557472179fe0 0x55747217c3f0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5574721664f0 0x557472169be0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472160960 0x55747216c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f0affd700 0 client.19140 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/4127017910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557472165be0 0x557472169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 >> 172.21.15.35:0/4127017910 conn(0x557471fbd6b0 msgr2=0x55747215aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 shutdown_connections 2023-03-17T10:38:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/4127017910 wait complete. 2023-03-17T10:38:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.745+0000 7f3f3dcb6b80 20 client.19140 trim_cache size 0 max 16384 2023-03-17T10:38:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 Processor -- start 2023-03-17T10:38:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 -- start start 2023-03-17T10:38:30.800 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273219 1.97 MB/sec execute 581 sec latency 3353.698 ms 2023-03-17T10:38:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747215aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x557472170f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747216ca30 con 0x557472160960 2023-03-17T10:38:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574721560f0 con 0x557472165be0 2023-03-17T10:38:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747215b000 con 0x5574721664f0 2023-03-17T10:38:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51242/0 (socket says 172.21.15.35:51242) 2023-03-17T10:38:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3222379720 learned_addr learned my addr 172.21.15.35:0/3222379720 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f2affd700 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747215aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.760+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x557472170f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3222379720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 msgr2=0x557472170f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x557472170f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3222379720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 msgr2=0x55747215aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747215aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/3222379720 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557472161000 con 0x557472160960 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x557472170f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160420 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c096170 tx=0x7f3f1c0cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7869cc3072139b47 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f127fc700 1 -- 172.21.15.35:0/3222379720 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c097900 con 0x557472160960 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f127fc700 1 -- 172.21.15.35:0/3222379720 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f1c099960 con 0x557472160960 2023-03-17T10:38:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f127fc700 1 -- 172.21.15.35:0/3222379720 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0a1630 con 0x557472160960 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/3222379720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 msgr2=0x557472160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160420 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c096170 tx=0x7f3f1c0cb040 comp rx=0 tx=0).stop 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.761+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/3222379720 shutdown_connections 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x557472170f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x557472160420 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/3222379720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747215aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/3222379720 >> 172.21.15.35:0/3222379720 conn(0x557471fbd6b0 msgr2=0x5574721668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/3222379720 shutdown_connections 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/3222379720 wait complete. 2023-03-17T10:38:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- start start 2023-03-17T10:38:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 Processor -- start 2023-03-17T10:38:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x55747216cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747216d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x5574721cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747216dbd0 con 0x557472160960 2023-03-17T10:38:34.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55747216dd40 con 0x557472165be0 2023-03-17T10:38:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574721cd370 con 0x5574721664f0 2023-03-17T10:38:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.762+0000 7f3f3dcb6b80 10 client.0 _ll_register_callbacks cb 0x557471f58230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:38:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x55747216cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x55747216cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51248/0 (socket says 172.21.15.35:51248) 2023-03-17T10:38:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/2215578270 learned_addr learned my addr 172.21.15.35:0/2215578270 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2bfff700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x5574721cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2affd700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747216d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/2215578270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 msgr2=0x5574721cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x5574721cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 msgr2=0x55747216d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747216d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 -- 172.21.15.35:0/2215578270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c10ff20 con 0x557472160960 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f2b7fe700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x55747216cf20 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0059d0 tx=0x7f3f1c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21a8d4271f95523 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f0affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f0affd700 1 -- 172.21.15.35:0/2215578270 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c098e00 con 0x557472160960 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f0affd700 1 -- 172.21.15.35:0/2215578270 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(252..252 src has 1..252) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3f1c09f0f0 con 0x557472160960 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574721301e0 con 0x557472160960 2023-03-17T10:38:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f0affd700 1 -- 172.21.15.35:0/2215578270 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f1c09f2b0 con 0x557472160960 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f3dcb6b80 10 client.19146 fetch_fsmap learned FSMap version 45 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x557471ec9c00 con 0x557472160960 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.763+0000 7f3f0affd700 1 -- 172.21.15.35:0/2215578270 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f1c063080 con 0x557472160960 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f0affd700 1 -- 172.21.15.35:0/2215578270 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3f1c09ad00 con 0x557472160960 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f3dcb6b80 10 client.19146 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f3dcb6b80 10 client.19146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f3dcb6b80 20 client.19146 populate_metadata read hostname 'smithi035' 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5574721ce560 0x5574721d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f3dcb6b80 4 client.19146 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557471f36f00 con 0x5574721ce560 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f2affd700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5574721ce560 0x5574721d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f0affd700 10 client.19146 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.764+0000 7f3f2affd700 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5574721ce560 0x5574721d0970 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6dc67e6250dd34 server_cookie=b661fb55dbf27121 in_seq=0 out_seq=0 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.773+0000 7f3f0affd700 1 -- 172.21.15.35:0/2215578270 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557471f36f00 con 0x5574721ce560 2023-03-17T10:38:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.773+0000 7f3f0affd700 10 client.19146 handle_command_reply: tid=0 2023-03-17T10:38:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.773+0000 7f3f3dcb6b80 1 client.19146 shutdown 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 msgr2=0x55747216cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x55747216cf20 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0059d0 tx=0x7f3f1c009ca0 comp rx=0 tx=0).stop 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 shutdown_connections 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5574721ce560 0x5574721d0970 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574721664f0 0x5574721cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557472160960 0x55747216cf20 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f0affd700 0 client.19146 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 --2- 172.21.15.35:0/2215578270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557472165be0 0x55747216d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 >> 172.21.15.35:0/2215578270 conn(0x557471fbd6b0 msgr2=0x557472167150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 shutdown_connections 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 1 -- 172.21.15.35:0/2215578270 wait complete. 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f3dcb6b80 20 client.19146 trim_cache size 0 max 16384 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3f1409f640 msgr2=0x7f3f140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3f1409f640 0x7f3f140a1af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3f20005fd0 tx=0x7f3f20005e30 comp rx=0 tx=0).stop 2023-03-17T10:38:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 msgr2=0x7f3f2c196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c196140 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c006010 tx=0x7f3f1c005ef0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 shutdown_connections 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3f1409f640 0x7f3f140a1af0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f2c10a770 0x7f3f2c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3f2c101430 0x7f3f2c196140 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 --2- 172.21.15.35:0/3312495046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f2c101d40 0x7f3f2c196680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.774+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 >> 172.21.15.35:0/3312495046 conn(0x7f3f2c076330 msgr2=0x7f3f2c0fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.775+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 shutdown_connections 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:07.775+0000 7f3f31b29700 1 -- 172.21.15.35:0/3312495046 wait complete. 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 -- 172.21.15.35:0/2753040671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc41045a0 msgr2=0x7f5bc410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 --2- 172.21.15.35:0/2753040671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc41045a0 0x7f5bc410c170 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00b0d0 tx=0x7f5bbc00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 -- 172.21.15.35:0/2753040671 shutdown_connections 2023-03-17T10:38:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 --2- 172.21.15.35:0/2753040671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc41045a0 0x7f5bc410c170 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 --2- 172.21.15.35:0/2753040671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc40ffa80 0x7f5bc40ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 --2- 172.21.15.35:0/2753040671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc4100420 0x7f5bc4103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 -- 172.21.15.35:0/2753040671 >> 172.21.15.35:0/2753040671 conn(0x7f5bc40757a0 msgr2=0x7f5bc4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 -- 172.21.15.35:0/2753040671 shutdown_connections 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.896+0000 7f5bc9198700 1 -- 172.21.15.35:0/2753040671 wait complete. 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 Processor -- start 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 -- start start 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc40ffa80 0x7f5bc4195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 0x7f5bc4195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc41045a0 0x7f5bc4199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc419a430 con 0x7f5bc4100420 2023-03-17T10:38:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc419a5a0 con 0x7f5bc40ffa80 2023-03-17T10:38:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.897+0000 7f5bc9198700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc419a760 con 0x7f5bc41045a0 2023-03-17T10:38:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 0x7f5bc4195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 0x7f5bc4195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51264/0 (socket says 172.21.15.35:51264) 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 -- 172.21.15.35:0/1440816034 learned_addr learned my addr 172.21.15.35:0/1440816034 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc40ffa80 0x7f5bc4195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc359e700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc41045a0 0x7f5bc4199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 -- 172.21.15.35:0/1440816034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc41045a0 msgr2=0x7f5bc4199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc41045a0 0x7f5bc4199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 -- 172.21.15.35:0/1440816034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc40ffa80 msgr2=0x7f5bc4195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc40ffa80 0x7f5bc4195450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 -- 172.21.15.35:0/1440816034 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc009d00 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 0x7f5bc4195990 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00d950 tx=0x7f5bac00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc0d99700 1 -- 172.21.15.35:0/1440816034 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac009930 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc0d99700 1 -- 172.21.15.35:0/1440816034 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bac010460 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc410f1d0 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc0d99700 1 -- 172.21.15.35:0/1440816034 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00f620 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.898+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc410f040 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.901+0000 7f5bc0d99700 1 -- 172.21.15.35:0/1440816034 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5bac009a90 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.901+0000 7f5bc0d99700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bb009f640 0x7f5bb00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.901+0000 7f5bc0d99700 1 -- 172.21.15.35:0/1440816034 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(254..254 src has 1..254) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5bac0ca100 con 0x7f5bc4100420 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.901+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bb009f640 0x7f5bb00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.902+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bb009f640 0x7f5bb00a1af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009c60 tx=0x7f5bb4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.902+0000 7f5bd5325b80 1 Processor -- start 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.902+0000 7f5bd5325b80 1 -- start start 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a7be0 0x55b83e0a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0a2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e0a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83dfa9010 con 0x55b83e0a2960 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83dffb950 con 0x55b83e0a7be0 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83dff4de0 con 0x55b83e0a84f0 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e0a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e0a2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51274/0 (socket says 172.21.15.35:51274) 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 -- 172.21.15.35:0/1139227079 learned_addr learned my addr 172.21.15.35:0/1139227079 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a7be0 0x55b83e0a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0a2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 -- 172.21.15.35:0/1139227079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 msgr2=0x55b83e0a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0a2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 -- 172.21.15.35:0/1139227079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a7be0 msgr2=0x55b83e0a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:38:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a7be0 0x55b83e0a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 -- 172.21.15.35:0/1139227079 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b83de765d0 con 0x55b83e0a2960 2023-03-17T10:38:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a7be0 0x55b83e0a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:38:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.903+0000 7f5bc359e700 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e0a2d90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009c20 tx=0x7f5bbc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15c06bc7c0fbed1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:38:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bb97fa700 1 -- 172.21.15.35:0/1139227079 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00e030 con 0x55b83e0a2960 2023-03-17T10:38:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bb97fa700 1 -- 172.21.15.35:0/1139227079 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bbc007d90 con 0x55b83e0a2960 2023-03-17T10:38:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bb97fa700 1 -- 172.21.15.35:0/1139227079 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc004c90 con 0x55b83e0a2960 2023-03-17T10:38:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 -- 172.21.15.35:0/1139227079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 msgr2=0x55b83e0a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:38:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e0a2d90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009c20 tx=0x7f5bbc009c50 comp rx=0 tx=0).stop 2023-03-17T10:38:43.290 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273219 1.97 MB/sec execute 582 sec latency 4353.833 ms 2023-03-17T10:38:45.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:11 smithi035 ceph-mon[92535]: pgmap v3280: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T10:38:45.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:11 smithi035 ceph-mon[92535]: osdmap e280: 12 total, 12 up, 12 in 2023-03-17T10:38:45.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:13 smithi035 ceph-mon[92535]: pgmap v3282: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.0 MiB/s wr, 94 op/s 2023-03-17T10:38:46.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:15 smithi035 ceph-mon[92535]: pgmap v3283: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 943 KiB/s wr, 84 op/s 2023-03-17T10:38:46.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:17 smithi035 ceph-mon[92535]: pgmap v3284: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 943 KiB/s wr, 84 op/s 2023-03-17T10:38:46.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:19 smithi035 ceph-mon[92535]: pgmap v3285: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 30 op/s 2023-03-17T10:38:46.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:21 smithi035 ceph-mon[92535]: pgmap v3286: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 30 op/s 2023-03-17T10:38:46.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:23 smithi035 ceph-mon[92535]: pgmap v3287: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 783 KiB/s wr, 89 op/s 2023-03-17T10:38:46.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:25 smithi035 ceph-mon[92535]: pgmap v3288: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 585 KiB/s wr, 66 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:27 smithi035 ceph-mon[92535]: pgmap v3289: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 585 KiB/s wr, 66 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:29 smithi035 ceph-mon[92535]: pgmap v3290: 97 pgs: 97 active+clean; 173 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:31 smithi035 ceph-mon[92535]: pgmap v3291: 97 pgs: 97 active+clean; 173 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:33 smithi035 ceph-mon[92535]: pgmap v3292: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 8.0 MiB/s wr, 148 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:35 smithi035 ceph-mon[92535]: pgmap v3293: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 7.5 MiB/s wr, 90 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:36 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:37 smithi035 ceph-mon[92535]: pgmap v3294: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 7.5 MiB/s wr, 90 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:39 smithi035 ceph-mon[92535]: pgmap v3295: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 18 MiB/s wr, 217 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:41 smithi035 ceph-mon[92535]: pgmap v3296: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 18 MiB/s wr, 181 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:41 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:43 smithi035 ceph-mon[92535]: pgmap v3297: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 19 MiB/s wr, 270 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:44 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:45 smithi035 ceph-mon[92535]: pgmap v3298: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 12 MiB/s wr, 215 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:47 smithi035 ceph-mon[92535]: pgmap v3299: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 12 MiB/s wr, 215 op/s 2023-03-17T10:38:46.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:38:46.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:38:46.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:38:46.769 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:48 smithi035 ceph-mon[92535]: pgmap v3300: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 326 op/s 2023-03-17T10:38:48.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:48 smithi035 ceph-mon[92535]: pgmap v3301: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-03-17T10:38:49.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:38:49.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:50 smithi035 ceph-mon[92535]: pgmap v3302: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-03-17T10:38:49.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:52 smithi035 ceph-mon[92535]: pgmap v3303: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 2.0 MiB/s wr, 109 op/s 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:54 smithi035 ceph-mon[92535]: pgmap v3304: 97 pgs: 97 active+clean; 414 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.3 MiB/s wr, 223 op/s 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:56 smithi035 ceph-mon[92535]: pgmap v3305: 97 pgs: 97 active+clean; 414 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.3 MiB/s wr, 223 op/s 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:26:58 smithi035 ceph-mon[92535]: pgmap v3306: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.4 MiB/s wr, 249 op/s 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:00 smithi035 ceph-mon[92535]: pgmap v3307: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:02 smithi035 ceph-mon[92535]: pgmap v3308: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:04 smithi035 ceph-mon[92535]: osdmap e281: 12 total, 12 up, 12 in 2023-03-17T10:38:49.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:04 smithi035 ceph-mon[92535]: pgmap v3310: 97 pgs: 97 active+clean; 385 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2023-03-17T10:38:51.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:06 smithi035 ceph-mon[92535]: pgmap v3311: 97 pgs: 97 active+clean; 385 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2023-03-17T10:38:51.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:08 smithi035 ceph-mon[92535]: pgmap v3312: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2023-03-17T10:38:52.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:10 smithi035 ceph-mon[92535]: pgmap v3313: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2023-03-17T10:38:52.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:12 smithi035 ceph-mon[92535]: osdmap e282: 12 total, 12 up, 12 in 2023-03-17T10:38:52.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:12 smithi035 ceph-mon[92535]: pgmap v3315: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T10:38:52.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:14 smithi035 ceph-mon[92535]: pgmap v3316: 97 pgs: 97 active+clean; 407 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2023-03-17T10:38:52.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:16 smithi035 ceph-mon[92535]: pgmap v3317: 97 pgs: 97 active+clean; 407 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2023-03-17T10:38:52.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:18 smithi035 ceph-mon[92535]: pgmap v3318: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:20 smithi035 ceph-mon[92535]: pgmap v3319: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:22 smithi035 ceph-mon[92535]: pgmap v3320: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 225 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:24 smithi035 ceph-mon[92535]: pgmap v3321: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.4 MiB/s wr, 313 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:26 smithi035 ceph-mon[92535]: pgmap v3322: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 211 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:28 smithi035 ceph-mon[92535]: pgmap v3323: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 336 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:30 smithi035 ceph-mon[92535]: pgmap v3324: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:32 smithi035 ceph-mon[92535]: pgmap v3325: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:34 smithi035 ceph-mon[92535]: pgmap v3326: 97 pgs: 97 active+clean; 424 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 349 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:36 smithi035 ceph-mon[92535]: pgmap v3327: 97 pgs: 97 active+clean; 424 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 2.9 MiB/s wr, 226 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:38 smithi035 ceph-mon[92535]: pgmap v3328: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:40 smithi035 ceph-mon[92535]: pgmap v3329: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:42 smithi035 ceph-mon[92535]: pgmap v3330: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:44 smithi035 ceph-mon[92535]: pgmap v3331: 97 pgs: 97 active+clean; 448 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 295 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:46 smithi035 ceph-mon[92535]: pgmap v3332: 97 pgs: 97 active+clean; 448 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 194 op/s 2023-03-17T10:38:52.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:48 smithi035 ceph-mon[92535]: pgmap v3333: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 310 op/s 2023-03-17T10:38:53.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:48 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:38:53.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:38:53.460 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:38:54.303 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:38:54.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:38:54.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:49 smithi035 ceph-mon[92535]: pgmap v3334: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 219 op/s 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:49 smithi035 ceph-mon[92535]: pgmap v3335: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 265 op/s 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:52 smithi035 ceph-mon[92535]: pgmap v3336: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 265 op/s 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:54 smithi035 ceph-mon[92535]: pgmap v3337: 97 pgs: 97 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:56 smithi035 ceph-mon[92535]: pgmap v3338: 97 pgs: 97 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2023-03-17T10:38:55.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:27:57 smithi035 ceph-mon[92535]: pgmap v3339: 97 pgs: 97 active+clean; 452 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2023-03-17T10:38:56.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:00 smithi035 ceph-mon[92535]: pgmap v3340: 97 pgs: 97 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 264 op/s 2023-03-17T10:38:56.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:02 smithi035 ceph-mon[92535]: pgmap v3341: 97 pgs: 97 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 3.1 MiB/s wr, 220 op/s 2023-03-17T10:38:56.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:04 smithi035 ceph-mon[92535]: pgmap v3342: 97 pgs: 97 active+clean; 468 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 328 op/s 2023-03-17T10:38:56.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:05 smithi035 ceph-mon[92535]: osdmap e283: 12 total, 12 up, 12 in 2023-03-17T10:38:56.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:06 smithi035 ceph-mon[92535]: pgmap v3344: 97 pgs: 97 active+clean; 468 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 242 op/s 2023-03-17T10:38:56.124 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:07 smithi035 ceph-mon[92535]: pgmap v3345: 97 pgs: 97 active+clean; 484 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 254 op/s 2023-03-17T10:38:58.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:10 smithi035 ceph-mon[92535]: pgmap v3346: 97 pgs: 97 active+clean; 485 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 255 op/s 2023-03-17T10:38:58.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:12 smithi035 ceph-mon[92535]: pgmap v3347: 97 pgs: 97 active+clean; 485 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 255 op/s 2023-03-17T10:38:58.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:12 smithi035 ceph-mon[92535]: osdmap e284: 12 total, 12 up, 12 in 2023-03-17T10:38:58.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:14 smithi035 ceph-mon[92535]: pgmap v3349: 97 pgs: 97 active+clean; 494 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 292 op/s 2023-03-17T10:38:58.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:16 smithi035 ceph-mon[92535]: pgmap v3350: 97 pgs: 97 active+clean; 494 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 261 op/s 2023-03-17T10:38:58.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:17 smithi035 ceph-mon[92535]: pgmap v3351: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 258 op/s 2023-03-17T10:38:58.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:20 smithi035 ceph-mon[92535]: pgmap v3352: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 259 op/s 2023-03-17T10:38:58.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:22 smithi035 ceph-mon[92535]: pgmap v3353: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 259 op/s 2023-03-17T10:38:58.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:23 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:38:59.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:23 smithi035 ceph-mon[92535]: pgmap v3354: 97 pgs: 97 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 326 op/s 2023-03-17T10:38:59.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:26 smithi035 ceph-mon[92535]: pgmap v3355: 97 pgs: 97 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 4.0 MiB/s wr, 200 op/s 2023-03-17T10:38:59.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:27 smithi035 ceph-mon[92535]: pgmap v3356: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.9 MiB/s wr, 287 op/s 2023-03-17T10:38:59.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:30 smithi035 ceph-mon[92535]: pgmap v3357: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 206 op/s 2023-03-17T10:38:59.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:31 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:38:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:38:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:38:59.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:38:59.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:38:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:38:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:38:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:38:59.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:38:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:38:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:38:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:38:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:38:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:38:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 -- 172.21.15.35:0/1139227079 shutdown_connections 2023-03-17T10:38:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e0a2d90 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a7be0 0x55b83e0a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/1139227079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0a2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.904+0000 7f5bd5325b80 1 -- 172.21.15.35:0/1139227079 >> 172.21.15.35:0/1139227079 conn(0x55b83deff6b0 msgr2=0x55b83e09ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 -- 172.21.15.35:0/1139227079 shutdown_connections 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 -- 172.21.15.35:0/1139227079 wait complete. 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 -- start start 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 Processor -- start 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0ab640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83de788c0 con 0x55b83e0a7be0 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0ac2f0 con 0x55b83e0a2960 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0ac4b0 con 0x55b83e0a84f0 2023-03-17T10:38:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bd5325b80 10 client.0 _ll_register_callbacks cb 0x55b83de9a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:39:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51278/0 (socket says 172.21.15.35:51278) 2023-03-17T10:39:00.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.905+0000 7f5bbbfff700 1 -- 172.21.15.35:0/2429228832 learned_addr learned my addr 172.21.15.35:0/2429228832 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bc359e700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bbbfff700 1 -- 172.21.15.35:0/2429228832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 msgr2=0x55b83e0abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:00.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bbbfff700 1 -- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 msgr2=0x55b83e0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:01.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bbbfff700 1 -- 172.21.15.35:0/2429228832 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc410c9b0 con 0x55b83e0a7be0 2023-03-17T10:39:01.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0ab640 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0c78f0 tx=0x7f5bac010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433c605e54c540bc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5baa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:39:02.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5baa7fc700 1 -- 172.21.15.35:0/2429228832 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0af070 con 0x55b83e0a7be0 2023-03-17T10:39:03.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5baa7fc700 1 -- 172.21.15.35:0/2429228832 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(254..254 src has 1..254) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5bac097e10 con 0x55b83e0a7be0 2023-03-17T10:39:03.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b83dfb7390 con 0x55b83e0a7be0 2023-03-17T10:39:03.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5baa7fc700 1 -- 172.21.15.35:0/2429228832 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bac0b1070 con 0x55b83e0a7be0 2023-03-17T10:39:03.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bd5325b80 10 client.19158 fetch_fsmap learned FSMap version 45 2023-03-17T10:39:03.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55b83de22d80 con 0x55b83e0a7be0 2023-03-17T10:39:03.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.906+0000 7f5baa7fc700 1 -- 172.21.15.35:0/2429228832 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b83dfb7390 con 0x55b83e0a7be0 2023-03-17T10:39:03.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5baa7fc700 1 -- 172.21.15.35:0/2429228832 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5bac09f910 con 0x55b83e0a7be0 2023-03-17T10:39:03.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bd5325b80 10 client.19158 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:39:03.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bd5325b80 10 client.19158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:39:03.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bd5325b80 20 client.19158 populate_metadata read hostname 'smithi035' 2023-03-17T10:39:03.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e0bc050 0x55b83e0be460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bd5325b80 4 client.19158 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:39:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b83dfc3600 con 0x55b83e0bc050 2023-03-17T10:39:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e0bc050 0x55b83e0be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5baa7fc700 10 client.19158 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.907+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e0bc050 0x55b83e0be460 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261eb9db3dfd74b4 server_cookie=cdd3de3169f4f26d in_seq=0 out_seq=0 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5baa7fc700 1 -- 172.21.15.35:0/2429228832 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b83dfc3600 con 0x55b83e0bc050 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5baa7fc700 10 client.19158 handle_command_reply: tid=0 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 client.19158 shutdown 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 msgr2=0x55b83e0ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0ab640 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0c78f0 tx=0x7f5bac010860 comp rx=0 tx=0).stop 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 shutdown_connections 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e0bc050 0x55b83e0be460 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5baa7fc700 0 client.19158 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/2429228832 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0ab640 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 >> 172.21.15.35:0/2429228832 conn(0x55b83deff6b0 msgr2=0x55b83e09ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 shutdown_connections 2023-03-17T10:39:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 1 -- 172.21.15.35:0/2429228832 wait complete. 2023-03-17T10:39:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.908+0000 7f5bd5325b80 20 client.19158 trim_cache size 0 max 16384 2023-03-17T10:39:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.923+0000 7f5bd5325b80 1 Processor -- start 2023-03-17T10:39:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.923+0000 7f5bd5325b80 1 -- start start 2023-03-17T10:39:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e09cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a7be0 0x55b83e0a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a84f0 0x55b83e0adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:07.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0995c0 con 0x55b83e0a2960 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0a7fb0 con 0x55b83e0a84f0 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0acbb0 con 0x55b83e0a7be0 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e09cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e09cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51284/0 (socket says 172.21.15.35:51284) 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 -- 172.21.15.35:0/3769246789 learned_addr learned my addr 172.21.15.35:0/3769246789 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc359e700 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a84f0 0x55b83e0adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a7be0 0x55b83e0a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 -- 172.21.15.35:0/3769246789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a7be0 msgr2=0x55b83e0a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a7be0 0x55b83e0a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 -- 172.21.15.35:0/3769246789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a84f0 msgr2=0x55b83e0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a84f0 0x55b83e0adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 -- 172.21.15.35:0/3769246789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b83dfbb130 con 0x55b83e0a2960 2023-03-17T10:39:07.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc359e700 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a84f0 0x55b83e0adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:39:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e09cac0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4013010 tx=0x7f5bb4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab1ff18ecfe3752 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bb9ffb700 1 -- 172.21.15.35:0/3769246789 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4023040 con 0x55b83e0a2960 2023-03-17T10:39:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bb9ffb700 1 -- 172.21.15.35:0/3769246789 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bb4028420 con 0x55b83e0a2960 2023-03-17T10:39:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.924+0000 7f5bb9ffb700 1 -- 172.21.15.35:0/3769246789 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb401d790 con 0x55b83e0a2960 2023-03-17T10:39:07.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 -- 172.21.15.35:0/3769246789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 msgr2=0x55b83e09cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e09cac0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4013010 tx=0x7f5bb4014000 comp rx=0 tx=0).stop 2023-03-17T10:39:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 -- 172.21.15.35:0/3769246789 shutdown_connections 2023-03-17T10:39:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a84f0 0x55b83e0adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a2960 0x55b83e09cac0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/3769246789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a7be0 0x55b83e0a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 -- 172.21.15.35:0/3769246789 >> 172.21.15.35:0/3769246789 conn(0x55b83deff6b0 msgr2=0x55b83e0a8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 -- 172.21.15.35:0/3769246789 shutdown_connections 2023-03-17T10:39:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.925+0000 7f5bd5325b80 1 -- 172.21.15.35:0/3769246789 wait complete. 2023-03-17T10:39:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 -- start start 2023-03-17T10:39:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 Processor -- start 2023-03-17T10:39:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0b2200 con 0x55b83e0a7be0 2023-03-17T10:39:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e0b2370 con 0x55b83e0a2960 2023-03-17T10:39:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83e10ff00 con 0x55b83e0a84f0 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bd5325b80 10 client.0 _ll_register_callbacks cb 0x55b83de9a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51292/0 (socket says 172.21.15.35:51292) 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bbbfff700 1 -- 172.21.15.35:0/312893028 learned_addr learned my addr 172.21.15.35:0/312893028 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bc359e700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.926+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bbbfff700 1 -- 172.21.15.35:0/312893028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 msgr2=0x55b83e0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bbbfff700 1 -- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 msgr2=0x55b83e0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bbbfff700 1 -- 172.21.15.35:0/312893028 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb4017070 con 0x55b83e0a7be0 2023-03-17T10:39:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bc359e700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bbbfff700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0b1570 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f5bac097b40 tx=0x7f5bac010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8235d9d132093a85 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5baa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5baa7fc700 1 -- 172.21.15.35:0/312893028 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0af070 con 0x55b83e0a7be0 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5baa7fc700 1 -- 172.21.15.35:0/312893028 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(254..254 src has 1..254) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5bac097e10 con 0x55b83e0a7be0 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b83e0721e0 con 0x55b83e0a7be0 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5baa7fc700 1 -- 172.21.15.35:0/312893028 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bac0b1040 con 0x55b83e0a7be0 2023-03-17T10:39:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 10 client.19164 fetch_fsmap learned FSMap version 45 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55b83de491f0 con 0x55b83e0a7be0 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5baa7fc700 1 -- 172.21.15.35:0/312893028 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bac07a020 con 0x55b83e0a7be0 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5baa7fc700 1 -- 172.21.15.35:0/312893028 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5bac0939a0 con 0x55b83e0a7be0 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 10 client.19164 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 10 client.19164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 20 client.19164 populate_metadata read hostname 'smithi035' 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e111080 0x55b83e113460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 4 client.19164 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.927+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b83de78f00 con 0x55b83e111080 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.928+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e111080 0x55b83e113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.928+0000 7f5bc2d9d700 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e111080 0x55b83e113460 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41f7879cbc25948 server_cookie=365fbbb434ba5ac0 in_seq=0 out_seq=0 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.928+0000 7f5baa7fc700 10 client.19164 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5baa7fc700 1 -- 172.21.15.35:0/312893028 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b83de78f00 con 0x55b83e111080 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5baa7fc700 10 client.19164 handle_command_reply: tid=0 2023-03-17T10:39:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 client.19164 shutdown 2023-03-17T10:39:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 msgr2=0x55b83e0b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0b1570 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f5bac097b40 tx=0x7f5bac010b60 comp rx=0 tx=0).stop 2023-03-17T10:39:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 shutdown_connections 2023-03-17T10:39:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b83e111080 0x55b83e113460 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b83e0a84f0 0x55b83e0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b83e0a2960 0x55b83e0b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5baa7fc700 0 client.19164 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 --2- 172.21.15.35:0/312893028 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b83e0a7be0 0x55b83e0b1570 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 >> 172.21.15.35:0/312893028 conn(0x55b83deff6b0 msgr2=0x55b83e0a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 shutdown_connections 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.936+0000 7f5bd5325b80 1 -- 172.21.15.35:0/312893028 wait complete. 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bd5325b80 20 client.19164 trim_cache size 0 max 16384 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bb009f640 msgr2=0x7f5bb00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bb009f640 0x7f5bb00a1af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009c60 tx=0x7f5bb4009260 comp rx=0 tx=0).stop 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 msgr2=0x7f5bc4195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 0x7f5bc4195990 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00d950 tx=0x7f5bac00dc60 comp rx=0 tx=0).stop 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 shutdown_connections 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5bb009f640 0x7f5bb00a1af0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc41045a0 0x7f5bc4199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc40ffa80 0x7f5bc4195450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 --2- 172.21.15.35:0/1440816034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5bc4100420 0x7f5bc4195990 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 >> 172.21.15.35:0/1440816034 conn(0x7f5bc40757a0 msgr2=0x7f5bc40fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 shutdown_connections 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:20.937+0000 7f5bc9198700 1 -- 172.21.15.35:0/1440816034 wait complete. 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.059+0000 7f8fea9ec700 1 -- 172.21.15.35:0/1727034127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 msgr2=0x7f8fe410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.059+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/1727034127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe410bf60 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00b0d0 tx=0x7f8fdc00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 -- 172.21.15.35:0/1727034127 shutdown_connections 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/1727034127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe410bf60 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/1727034127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe40ff350 0x7f8fe40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/1727034127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fe40ffcf0 0x7f8fe4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 -- 172.21.15.35:0/1727034127 >> 172.21.15.35:0/1727034127 conn(0x7f8fe4076330 msgr2=0x7f8fe4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 -- 172.21.15.35:0/1727034127 shutdown_connections 2023-03-17T10:39:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 -- 172.21.15.35:0/1727034127 wait complete. 2023-03-17T10:39:16.809 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273231 1.97 MB/sec execute 583 sec latency 4567.286 ms 2023-03-17T10:39:16.809 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273231 1.96 MB/sec execute 584 sec latency 1717.540 ms 2023-03-17T10:39:16.809 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273242 1.96 MB/sec execute 585 sec latency 2657.449 ms 2023-03-17T10:39:16.809 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273286 1.96 MB/sec execute 586 sec latency 852.129 ms 2023-03-17T10:39:16.809 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273286 1.95 MB/sec execute 587 sec latency 1852.167 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273488 1.95 MB/sec execute 588 sec latency 2064.637 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 273721 1.95 MB/sec execute 589 sec latency 84.699 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 274155 1.95 MB/sec execute 590 sec latency 20.328 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 274648 1.95 MB/sec execute 591 sec latency 22.527 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 275131 1.95 MB/sec execute 592 sec latency 22.104 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 275604 1.95 MB/sec execute 593 sec latency 23.342 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 276322 1.95 MB/sec execute 594 sec latency 13.865 ms 2023-03-17T10:39:17.417 INFO:tasks.workunit.client.0.smithi035.stdout: 1 276702 1.96 MB/sec execute 595 sec latency 15.628 ms 2023-03-17T10:39:19.047 INFO:tasks.workunit.client.0.smithi035.stdout: 1 276766 1.95 MB/sec execute 596 sec latency 911.421 ms 2023-03-17T10:39:19.047 INFO:tasks.workunit.client.0.smithi035.stdout: 1 276766 1.95 MB/sec execute 597 sec latency 1911.485 ms 2023-03-17T10:39:19.047 INFO:tasks.workunit.client.0.smithi035.stdout: 1 276833 1.95 MB/sec execute 598 sec latency 2128.331 ms 2023-03-17T10:39:19.047 INFO:tasks.workunit.client.0.smithi035.stdout: 1 276833 1.95 MB/sec execute 599 sec latency 1512.984 ms 2023-03-17T10:39:19.047 INFO:tasks.workunit.client.0.smithi035.stdout: 1 cleanup 600 sec 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: 1 cleanup 601 sec 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: 0 cleanup 601 sec 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: Operation Count AvgLat MaxLat 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: ---------------------------------------- 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: NTCreateX 37346 3.983 84.694 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: Close 27445 0.055 1.502 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: Rename 1586 90.036 4746.388 2023-03-17T10:39:19.048 INFO:tasks.workunit.client.0.smithi035.stdout: Unlink 7540 4.122 38.130 2023-03-17T10:39:19.049 INFO:tasks.workunit.client.0.smithi035.stdout: Qpathinfo 33899 3.561 3426.646 2023-03-17T10:39:19.049 INFO:tasks.workunit.client.0.smithi035.stdout: Qfileinfo 5916 0.078 1.640 2023-03-17T10:39:19.049 INFO:tasks.workunit.client.0.smithi035.stdout: Qfsinfo 6213 0.316 5.217 2023-03-17T10:39:19.049 INFO:tasks.workunit.client.0.smithi035.stdout: Sfileinfo 3050 1.391 12.762 2023-03-17T10:39:19.049 INFO:tasks.workunit.client.0.smithi035.stdout: Find 13109 10.469 150.373 2023-03-17T10:39:20.288 INFO:tasks.workunit.client.0.smithi035.stdout: WriteX 18464 0.175 3.975 2023-03-17T10:39:24.882 INFO:tasks.workunit.client.0.smithi035.stdout: ReadX 58696 0.004 0.214 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout: LockX 122 0.675 1.122 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout: UnlockX 122 0.552 0.865 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout: Flush 2623 2.705 16.858 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout: 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout:Throughput 1.94516 MB/sec 1 clients 1 procs max_latency=4746.398 ms 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-03-17T10:39:24.883 INFO:tasks.workunit.client.0.smithi035.stdout: 2023-03-17T10:39:26.193 INFO:tasks.workunit.client.0.smithi035.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-03-17T10:39:26.193 INFO:tasks.workunit.client.0.smithi035.stdout:8 of 10 processes prepared for launch 0 sec 2023-03-17T10:39:26.193 INFO:tasks.workunit.client.0.smithi035.stdout:10 of 10 processes prepared for launch 0 sec 2023-03-17T10:39:26.193 INFO:tasks.workunit.client.0.smithi035.stdout:releasing clients 2023-03-17T10:39:26.193 INFO:tasks.workunit.client.0.smithi035.stdout: 10 252 95.79 MB/sec warmup 1 sec latency 82.529 ms 2023-03-17T10:39:26.193 INFO:tasks.workunit.client.0.smithi035.stdout: 10 478 83.66 MB/sec warmup 2 sec latency 91.594 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 665 69.38 MB/sec warmup 3 sec latency 102.651 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 815 53.70 MB/sec warmup 4 sec latency 115.377 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 923 43.49 MB/sec warmup 5 sec latency 171.533 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1047 37.99 MB/sec warmup 6 sec latency 173.384 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1158 32.86 MB/sec warmup 7 sec latency 206.319 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1311 30.34 MB/sec warmup 8 sec latency 197.105 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1488 28.96 MB/sec warmup 9 sec latency 79.684 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1618 26.16 MB/sec warmup 10 sec latency 126.539 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1765 23.90 MB/sec warmup 11 sec latency 76.404 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 1931 22.05 MB/sec warmup 12 sec latency 95.946 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 2085 20.53 MB/sec warmup 13 sec latency 160.225 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 2232 19.43 MB/sec warmup 14 sec latency 87.612 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 2404 18.81 MB/sec warmup 15 sec latency 86.630 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 2568 18.58 MB/sec warmup 16 sec latency 82.952 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 2744 18.10 MB/sec warmup 17 sec latency 85.846 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 2984 18.28 MB/sec warmup 18 sec latency 73.016 ms 2023-03-17T10:39:26.194 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3182 18.18 MB/sec warmup 19 sec latency 69.910 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3322 17.95 MB/sec warmup 20 sec latency 74.335 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3498 17.68 MB/sec warmup 21 sec latency 77.139 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3631 17.32 MB/sec warmup 22 sec latency 88.341 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3729 16.77 MB/sec warmup 23 sec latency 444.269 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3859 16.48 MB/sec warmup 24 sec latency 92.949 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 3991 15.92 MB/sec warmup 25 sec latency 69.018 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 4122 15.45 MB/sec warmup 26 sec latency 67.791 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 4252 14.97 MB/sec warmup 27 sec latency 64.554 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 4400 14.66 MB/sec warmup 28 sec latency 61.221 ms 2023-03-17T10:39:26.195 INFO:tasks.workunit.client.0.smithi035.stdout: 10 4539 14.21 MB/sec warmup 29 sec latency 68.591 ms 2023-03-17T10:39:28.848 INFO:tasks.workunit.client.0.smithi035.stdout: 10 4708 14.27 MB/sec warmup 30 sec latency 82.581 ms 2023-03-17T10:39:28.848 INFO:tasks.workunit.client.0.smithi035.stdout: 10 4853 13.88 MB/sec warmup 31 sec latency 67.665 ms 2023-03-17T10:39:29.708 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5033 13.82 MB/sec warmup 32 sec latency 75.475 ms 2023-03-17T10:39:29.709 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5170 13.47 MB/sec warmup 33 sec latency 92.698 ms 2023-03-17T10:39:30.569 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5334 13.20 MB/sec warmup 34 sec latency 70.662 ms 2023-03-17T10:39:30.569 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5510 13.14 MB/sec warmup 35 sec latency 75.333 ms 2023-03-17T10:39:31.410 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5642 12.83 MB/sec warmup 36 sec latency 62.039 ms 2023-03-17T10:39:31.411 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5804 12.65 MB/sec warmup 37 sec latency 66.758 ms 2023-03-17T10:39:31.411 INFO:tasks.workunit.client.0.smithi035.stdout: 10 5993 12.72 MB/sec warmup 38 sec latency 83.064 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 6191 12.65 MB/sec warmup 39 sec latency 62.357 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 6380 12.70 MB/sec warmup 40 sec latency 71.075 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 6547 12.67 MB/sec warmup 41 sec latency 64.840 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 6713 12.73 MB/sec warmup 42 sec latency 91.399 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 6894 12.80 MB/sec warmup 43 sec latency 66.321 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7021 12.69 MB/sec warmup 44 sec latency 67.828 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7167 12.70 MB/sec warmup 45 sec latency 77.393 ms 2023-03-17T10:39:33.866 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7296 12.56 MB/sec warmup 46 sec latency 70.667 ms 2023-03-17T10:39:34.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7423 12.44 MB/sec warmup 47 sec latency 60.650 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7546 12.23 MB/sec warmup 48 sec latency 62.023 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7670 12.05 MB/sec warmup 49 sec latency 63.929 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7806 11.97 MB/sec warmup 50 sec latency 76.354 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 7930 11.77 MB/sec warmup 51 sec latency 135.515 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8093 11.81 MB/sec warmup 52 sec latency 64.270 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8235 11.66 MB/sec warmup 53 sec latency 103.409 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8378 11.52 MB/sec warmup 54 sec latency 129.306 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8534 11.43 MB/sec warmup 55 sec latency 85.758 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8683 11.33 MB/sec warmup 56 sec latency 95.356 ms 2023-03-17T10:39:34.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8836 11.21 MB/sec warmup 57 sec latency 68.669 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 8986 11.15 MB/sec warmup 58 sec latency 69.231 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 9127 11.03 MB/sec warmup 59 sec latency 73.423 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 9295 10.98 MB/sec warmup 60 sec latency 144.747 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 9500 11.06 MB/sec warmup 61 sec latency 59.116 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 9715 11.09 MB/sec warmup 62 sec latency 62.356 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 9844 11.07 MB/sec warmup 63 sec latency 60.943 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 9962 10.99 MB/sec warmup 64 sec latency 77.303 ms 2023-03-17T10:39:36.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 10182 11.15 MB/sec warmup 65 sec latency 78.500 ms 2023-03-17T10:39:37.135 INFO:tasks.workunit.client.0.smithi035.stdout: 10 10362 11.18 MB/sec warmup 66 sec latency 65.759 ms 2023-03-17T10:39:37.135 INFO:tasks.workunit.client.0.smithi035.stdout: 10 10498 11.10 MB/sec warmup 67 sec latency 67.185 ms 2023-03-17T10:39:37.135 INFO:tasks.workunit.client.0.smithi035.stdout: 10 10625 11.08 MB/sec warmup 68 sec latency 60.989 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 10739 11.00 MB/sec warmup 69 sec latency 62.340 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 10867 10.92 MB/sec warmup 70 sec latency 72.647 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11019 10.86 MB/sec warmup 71 sec latency 69.752 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11158 10.82 MB/sec warmup 72 sec latency 70.847 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11293 10.75 MB/sec warmup 73 sec latency 68.067 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11456 10.69 MB/sec warmup 74 sec latency 59.554 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11600 10.68 MB/sec warmup 75 sec latency 65.854 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11740 10.58 MB/sec warmup 76 sec latency 85.667 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 11890 10.52 MB/sec warmup 77 sec latency 88.825 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 12043 10.48 MB/sec warmup 78 sec latency 88.054 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 12201 10.44 MB/sec warmup 79 sec latency 73.526 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 12347 10.37 MB/sec warmup 80 sec latency 69.485 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 12500 10.35 MB/sec warmup 81 sec latency 63.070 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 12649 10.30 MB/sec warmup 82 sec latency 60.104 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 12848 10.34 MB/sec warmup 83 sec latency 63.944 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13042 10.32 MB/sec warmup 84 sec latency 63.745 ms 2023-03-17T10:39:37.136 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13192 10.29 MB/sec warmup 85 sec latency 67.201 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13326 10.28 MB/sec warmup 86 sec latency 60.854 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13520 10.37 MB/sec warmup 87 sec latency 65.477 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13696 10.38 MB/sec warmup 88 sec latency 95.987 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13839 10.37 MB/sec warmup 89 sec latency 67.834 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 13957 10.35 MB/sec warmup 90 sec latency 91.359 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14098 10.34 MB/sec warmup 91 sec latency 121.797 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14250 10.32 MB/sec warmup 92 sec latency 77.160 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14371 10.23 MB/sec warmup 93 sec latency 78.889 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14503 10.18 MB/sec warmup 94 sec latency 87.005 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14643 10.17 MB/sec warmup 95 sec latency 76.173 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14766 10.09 MB/sec warmup 96 sec latency 107.642 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 14920 10.10 MB/sec warmup 97 sec latency 65.528 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15057 10.06 MB/sec warmup 98 sec latency 74.402 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15193 9.99 MB/sec warmup 99 sec latency 71.454 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15352 9.96 MB/sec warmup 100 sec latency 104.077 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15514 9.93 MB/sec warmup 101 sec latency 65.287 ms 2023-03-17T10:39:37.137 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15685 9.92 MB/sec warmup 102 sec latency 83.718 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15827 9.86 MB/sec warmup 103 sec latency 71.236 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 15969 9.84 MB/sec warmup 104 sec latency 65.044 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 16141 9.83 MB/sec warmup 105 sec latency 64.385 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 16348 9.90 MB/sec warmup 106 sec latency 60.808 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 16538 9.90 MB/sec warmup 107 sec latency 62.947 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 16668 9.86 MB/sec warmup 108 sec latency 59.089 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 16802 9.87 MB/sec warmup 109 sec latency 66.876 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 16978 9.91 MB/sec warmup 110 sec latency 61.903 ms 2023-03-17T10:39:37.138 INFO:tasks.workunit.client.0.smithi035.stdout: 10 17172 9.94 MB/sec warmup 111 sec latency 65.455 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 17305 9.92 MB/sec warmup 112 sec latency 80.659 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 17412 9.87 MB/sec warmup 113 sec latency 59.368 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 17572 9.88 MB/sec warmup 114 sec latency 68.024 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 17732 9.87 MB/sec warmup 115 sec latency 73.193 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 17885 9.83 MB/sec warmup 116 sec latency 73.997 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 18025 9.83 MB/sec warmup 117 sec latency 74.961 ms 2023-03-17T10:39:37.484 INFO:tasks.workunit.client.0.smithi035.stdout: 10 18156 9.79 MB/sec warmup 118 sec latency 72.117 ms 2023-03-17T10:39:38.368 INFO:tasks.workunit.client.0.smithi035.stdout: 10 18311 9.78 MB/sec warmup 119 sec latency 67.204 ms 2023-03-17T10:39:38.368 INFO:tasks.workunit.client.0.smithi035.stdout: 10 18616 2.73 MB/sec execute 1 sec latency 63.031 ms 2023-03-17T10:39:38.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:32 smithi035 ceph-mon[92535]: pgmap v3358: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 199 op/s 2023-03-17T10:39:38.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 Processor -- start 2023-03-17T10:39:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.060+0000 7f8fea9ec700 1 -- start start 2023-03-17T10:39:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fea9ec700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe40ff350 0x7f8fe4195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fea9ec700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fe40ffcf0 0x7f8fe41957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fea9ec700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe4199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:40.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fea9ec700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419a260 con 0x7f8fe4104390 2023-03-17T10:39:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fea9ec700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419a3d0 con 0x7f8fe40ffcf0 2023-03-17T10:39:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fea9ec700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419a590 con 0x7f8fe40ff350 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe4199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe4199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51308/0 (socket says 172.21.15.35:51308) 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 -- 172.21.15.35:0/848639209 learned_addr learned my addr 172.21.15.35:0/848639209 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fe40ffcf0 0x7f8fe41957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe40ff350 0x7f8fe4195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 -- 172.21.15.35:0/848639209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe40ff350 msgr2=0x7f8fe4195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe40ff350 0x7f8fe4195280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 -- 172.21.15.35:0/848639209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fe40ffcf0 msgr2=0x7f8fe41957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fe40ffcf0 0x7f8fe41957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 -- 172.21.15.35:0/848639209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009d00 con 0x7f8fe4104390 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe4199c20 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009fd0 tx=0x7f8fdc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.061+0000 7f8fe17fa700 1 -- 172.21.15.35:0/848639209 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00e040 con 0x7f8fe4104390 2023-03-17T10:39:41.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.062+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe410f010 con 0x7f8fe4104390 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.062+0000 7f8fe17fa700 1 -- 172.21.15.35:0/848639209 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fdc003e10 con 0x7f8fe4104390 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.062+0000 7f8fe17fa700 1 -- 172.21.15.35:0/848639209 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0052a0 con 0x7f8fe4104390 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.062+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe410ee80 con 0x7f8fe4104390 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.064+0000 7f8fe17fa700 1 -- 172.21.15.35:0/848639209 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8fdc005400 con 0x7f8fe4104390 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.064+0000 7f8fe17fa700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8fcc09f640 0x7f8fcc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.064+0000 7f8fe17fa700 1 -- 172.21.15.35:0/848639209 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(254..254 src has 1..254) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8fdc0cb810 con 0x7f8fe4104390 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.064+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8fcc09f640 0x7f8fcc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.065+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8fcc09f640 0x7f8fcc0a1af0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4005950 tx=0x7f8fd40058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.065+0000 7f8ff6b79b80 1 Processor -- start 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.065+0000 7f8ff6b79b80 1 -- start start 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff39737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff398e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff398e570 0x560ff3990950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff387a010 con 0x560ff3973d30 2023-03-17T10:39:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff38cc950 con 0x560ff398e570 2023-03-17T10:39:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff38c5de0 con 0x560ff3973420 2023-03-17T10:39:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff398e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff398e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51314/0 (socket says 172.21.15.35:51314) 2023-03-17T10:39:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 -- 172.21.15.35:0/2737878075 learned_addr learned my addr 172.21.15.35:0/2737878075 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff398e570 0x560ff3990950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff39737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 -- 172.21.15.35:0/2737878075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 msgr2=0x560ff39737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:43.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff39737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 -- 172.21.15.35:0/2737878075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff398e570 msgr2=0x560ff3990950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff398e570 0x560ff3990950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 -- 172.21.15.35:0/2737878075 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff37475d0 con 0x560ff3973d30 2023-03-17T10:39:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff398e030 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009c30 tx=0x7f8fd8009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7761f205212a4725 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fca7fc700 1 -- 172.21.15.35:0/2737878075 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8033d20 con 0x560ff3973d30 2023-03-17T10:39:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fca7fc700 1 -- 172.21.15.35:0/2737878075 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fd8033e80 con 0x560ff3973d30 2023-03-17T10:39:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.066+0000 7f8fca7fc700 1 -- 172.21.15.35:0/2737878075 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8005240 con 0x560ff3973d30 2023-03-17T10:39:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/2737878075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 msgr2=0x560ff398e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff398e030 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009c30 tx=0x7f8fd8009f40 comp rx=0 tx=0).stop 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/2737878075 shutdown_connections 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff398e570 0x560ff3990950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff39737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/2737878075 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff398e030 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/2737878075 >> 172.21.15.35:0/2737878075 conn(0x560ff37d06b0 msgr2=0x560ff396cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/2737878075 shutdown_connections 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.067+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/2737878075 wait complete. 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 -- start start 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 Processor -- start 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff3981630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:46.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3981b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff397d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff37498c0 con 0x560ff398e570 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff397d900 con 0x560ff3973d30 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff397dac0 con 0x560ff3973420 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8ff6b79b80 10 client.0 _ll_register_callbacks cb 0x560ff376b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8fe8f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff397d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8fe8f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff397d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51322/0 (socket says 172.21.15.35:51322) 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8fe8f89700 1 -- 172.21.15.35:0/4227688907 learned_addr learned my addr 172.21.15.35:0/4227688907 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3981b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.068+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff3981630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fe8f89700 1 -- 172.21.15.35:0/4227688907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 msgr2=0x560ff3981630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff3981630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fe8f89700 1 -- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 msgr2=0x560ff3981b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3981b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:46.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fe8f89700 1 -- 172.21.15.35:0/4227688907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd80098e0 con 0x560ff398e570 2023-03-17T10:39:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff397d1c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0992e0 tx=0x7f8fdc098f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c169e0411681465 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:39:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fc37fe700 1 -- 172.21.15.35:0/4227688907 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc099350 con 0x560ff398e570 2023-03-17T10:39:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fc37fe700 1 -- 172.21.15.35:0/4227688907 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(254..254 src has 1..254) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8fdc0a14b0 con 0x560ff398e570 2023-03-17T10:39:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ff3888390 con 0x560ff398e570 2023-03-17T10:39:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fc37fe700 1 -- 172.21.15.35:0/4227688907 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fdc0997c0 con 0x560ff398e570 2023-03-17T10:39:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 10 client.19176 fetch_fsmap learned FSMap version 45 2023-03-17T10:39:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560ff36f3d80 con 0x560ff398e570 2023-03-17T10:39:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fc37fe700 1 -- 172.21.15.35:0/4227688907 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ff3888390 con 0x560ff398e570 2023-03-17T10:39:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8fc37fe700 1 -- 172.21.15.35:0/4227688907 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8fdc0a1020 con 0x560ff398e570 2023-03-17T10:39:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 10 client.19176 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:39:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 10 client.19176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:39:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 20 client.19176 populate_metadata read hostname 'smithi035' 2023-03-17T10:39:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.069+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff398cbc0 0x560ff398cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.070+0000 7f8ff6b79b80 4 client.19176 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:39:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.070+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ff3894600 con 0x560ff398cbc0 2023-03-17T10:39:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.070+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff398cbc0 0x560ff398cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.070+0000 7f8fc37fe700 10 client.19176 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.070+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff398cbc0 0x560ff398cf90 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515385f13fb0a654 server_cookie=d11861e66b28a719 in_seq=0 out_seq=0 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8fc37fe700 1 -- 172.21.15.35:0/4227688907 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560ff3894600 con 0x560ff398cbc0 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8fc37fe700 10 client.19176 handle_command_reply: tid=0 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 client.19176 shutdown 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 msgr2=0x560ff397d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff397d1c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0992e0 tx=0x7f8fdc098f80 comp rx=0 tx=0).stop 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 shutdown_connections 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff398cbc0 0x560ff398cf90 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff397d1c0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff3981630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/4227688907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3981b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8fc37fe700 0 client.19176 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 >> 172.21.15.35:0/4227688907 conn(0x560ff37d06b0 msgr2=0x560ff3979250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 shutdown_connections 2023-03-17T10:39:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/4227688907 wait complete. 2023-03-17T10:39:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.071+0000 7f8ff6b79b80 20 client.19176 trim_cache size 0 max 16384 2023-03-17T10:39:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 Processor -- start 2023-03-17T10:39:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 -- start start 2023-03-17T10:39:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff398dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3975600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff39d8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:48.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff396ab60 con 0x560ff398e570 2023-03-17T10:39:48.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff39784f0 con 0x560ff3973d30 2023-03-17T10:39:48.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.086+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff3973b70 con 0x560ff3973420 2023-03-17T10:39:48.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff39d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:48.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff39d8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51330/0 (socket says 172.21.15.35:51330) 2023-03-17T10:39:48.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 -- 172.21.15.35:0/1485374879 learned_addr learned my addr 172.21.15.35:0/1485374879 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:48.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3975600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff398dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 -- 172.21.15.35:0/1485374879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 msgr2=0x560ff398dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff398dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 -- 172.21.15.35:0/1485374879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 msgr2=0x560ff3975600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3975600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 -- 172.21.15.35:0/1485374879 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ff388c130 con 0x560ff398e570 2023-03-17T10:39:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff398dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:39:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fe8f89700 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff39d8b90 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0c95a0 tx=0x7f8fdc00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59174bebac971834 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fcaffd700 1 -- 172.21.15.35:0/1485374879 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc009b80 con 0x560ff398e570 2023-03-17T10:39:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fcaffd700 1 -- 172.21.15.35:0/1485374879 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fdc0997c0 con 0x560ff398e570 2023-03-17T10:39:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.087+0000 7f8fcaffd700 1 -- 172.21.15.35:0/1485374879 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0b7230 con 0x560ff398e570 2023-03-17T10:39:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/1485374879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 msgr2=0x560ff39d8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff39d8b90 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0c95a0 tx=0x7f8fdc00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:39:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/1485374879 shutdown_connections 2023-03-17T10:39:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff398e570 0x560ff39d8b90 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff3973420 0x560ff398dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/1485374879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973d30 0x560ff3975600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/1485374879 >> 172.21.15.35:0/1485374879 conn(0x560ff37d06b0 msgr2=0x560ff398d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/1485374879 shutdown_connections 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/1485374879 wait complete. 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 -- start start 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.088+0000 7f8ff6b79b80 1 Processor -- start 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973420 0x560ff3985330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff3985870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff398e570 0x560ff3985db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff39d7ca0 con 0x560ff3973d30 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff39d7e10 con 0x560ff3973420 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ff39d7fd0 con 0x560ff398e570 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 10 client.0 _ll_register_callbacks cb 0x560ff376b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff3985870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff3985870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51334/0 (socket says 172.21.15.35:51334) 2023-03-17T10:39:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 -- 172.21.15.35:0/535103296 learned_addr learned my addr 172.21.15.35:0/535103296 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973420 0x560ff3985330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 -- 172.21.15.35:0/535103296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff398e570 msgr2=0x560ff3985db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff398e570 0x560ff3985db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 -- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973420 msgr2=0x560ff3985330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:39:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973420 0x560ff3985330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 -- 172.21.15.35:0/535103296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ff36f3d80 con 0x560ff3973d30 2023-03-17T10:39:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973420 0x560ff3985330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:39:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fe37fe700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff3985870 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8000c00 tx=0x7f8fd8005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce7e7ada698789b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:39:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:39:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fc37fe700 1 -- 172.21.15.35:0/535103296 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8003680 con 0x560ff3973d30 2023-03-17T10:39:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fc37fe700 1 -- 172.21.15.35:0/535103296 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(254..254 src has 1..254) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8fd80037e0 con 0x560ff3973d30 2023-03-17T10:39:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ff39431e0 con 0x560ff3973d30 2023-03-17T10:39:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8fc37fe700 1 -- 172.21.15.35:0/535103296 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd80039a0 con 0x560ff3973d30 2023-03-17T10:39:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 10 client.19182 fetch_fsmap learned FSMap version 45 2023-03-17T10:39:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.089+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560ff371a1f0 con 0x560ff3973d30 2023-03-17T10:39:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8fc37fe700 1 -- 172.21.15.35:0/535103296 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ff39431e0 con 0x560ff3973d30 2023-03-17T10:39:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8fc37fe700 1 -- 172.21.15.35:0/535103296 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8fd8010b10 con 0x560ff3973d30 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8ff6b79b80 10 client.19182 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8ff6b79b80 10 client.19182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8ff6b79b80 20 client.19182 populate_metadata read hostname 'smithi035' 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff3a69e80 0x560ff3a6c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8ff6b79b80 4 client.19182 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ff3749f00 con 0x560ff3a69e80 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.090+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff3a69e80 0x560ff3a6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.091+0000 7f8fc37fe700 10 client.19182 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.091+0000 7f8fe3fff700 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff3a69e80 0x560ff3a6c290 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e1a8be009411366 server_cookie=ccc0f481ece9197 in_seq=0 out_seq=0 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8fc37fe700 1 -- 172.21.15.35:0/535103296 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ff3749f00 con 0x560ff3a69e80 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8fc37fe700 10 client.19182 handle_command_reply: tid=0 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 client.19182 shutdown 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 msgr2=0x560ff3985870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff3985870 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8000c00 tx=0x7f8fd8005300 comp rx=0 tx=0).stop 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 shutdown_connections 2023-03-17T10:39:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ff3a69e80 0x560ff3a6c290 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ff398e570 0x560ff3985db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ff3973420 0x560ff3985330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8fc37fe700 0 client.19182 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 --2- 172.21.15.35:0/535103296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ff3973d30 0x560ff3985870 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 >> 172.21.15.35:0/535103296 conn(0x560ff37d06b0 msgr2=0x560ff39889f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 shutdown_connections 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 1 -- 172.21.15.35:0/535103296 wait complete. 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.096+0000 7f8ff6b79b80 20 client.19182 trim_cache size 0 max 16384 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8fcc09f640 msgr2=0x7f8fcc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:54.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8fcc09f640 0x7f8fcc0a1af0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4005950 tx=0x7f8fd40058e0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 msgr2=0x7f8fe4199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe4199c20 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009fd0 tx=0x7f8fdc00cce0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 shutdown_connections 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8fcc09f640 0x7f8fcc0a1af0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8fe4104390 0x7f8fe4199c20 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fe40ff350 0x7f8fe4195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 --2- 172.21.15.35:0/848639209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8fe40ffcf0 0x7f8fe41957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 >> 172.21.15.35:0/848639209 conn(0x7f8fe4076330 msgr2=0x7f8fe40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 shutdown_connections 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:13:34.097+0000 7f8fea9ec700 1 -- 172.21.15.35:0/848639209 wait complete. 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.367+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2913849483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe838104390 msgr2=0x7fe83810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:54.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.367+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2913849483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe838104390 0x7fe83810bf60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe83000b0d0 tx=0x7fe83000b3e0 comp rx=0 tx=0).stop 2023-03-17T10:39:56.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.367+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2913849483 shutdown_connections 2023-03-17T10:39:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2913849483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe838104390 0x7fe83810bf60 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2913849483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8380ff350 0x7fe8380ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2913849483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8380ffcf0 0x7fe838103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:56.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2913849483 >> 172.21.15.35:0/2913849483 conn(0x7fe838076330 msgr2=0x7fe838076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2913849483 shutdown_connections 2023-03-17T10:39:56.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2913849483 wait complete. 2023-03-17T10:39:56.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.368+0000 7fe83f2ff700 1 Processor -- start 2023-03-17T10:39:57.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 -- start start 2023-03-17T10:39:57.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 0x7fe838197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8380ffcf0 0x7fe838197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe838104390 0x7fe8381a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381980a0 con 0x7fe8380ff350 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381a27e0 con 0x7fe838104390 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83f2ff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8381a29a0 con 0x7fe8380ffcf0 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 0x7fe838197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d89c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe838104390 0x7fe8381a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 0x7fe838197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51366/0 (socket says 172.21.15.35:51366) 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 -- 172.21.15.35:0/2401718771 learned_addr learned my addr 172.21.15.35:0/2401718771 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83c89a700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8380ffcf0 0x7fe838197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 -- 172.21.15.35:0/2401718771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8380ffcf0 msgr2=0x7fe838197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8380ffcf0 0x7fe838197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 -- 172.21.15.35:0/2401718771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe838104390 msgr2=0x7fe8381a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe838104390 0x7fe8381a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:39:59.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d09b700 1 -- 172.21.15.35:0/2401718771 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830009d00 con 0x7fe8380ff350 2023-03-17T10:39:59.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.369+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe838104390 0x7fe8381a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:39:59.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.370+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 0x7fe838197220 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe83400d980 tx=0x7fe83400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.370+0000 7fe82a7fc700 1 -- 172.21.15.35:0/2401718771 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834004220 con 0x7fe8380ff350 2023-03-17T10:40:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.370+0000 7fe82a7fc700 1 -- 172.21.15.35:0/2401718771 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe834007640 con 0x7fe8380ff350 2023-03-17T10:40:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.370+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83810f060 con 0x7fe8380ff350 2023-03-17T10:40:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.370+0000 7fe82a7fc700 1 -- 172.21.15.35:0/2401718771 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834005660 con 0x7fe8380ff350 2023-03-17T10:40:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.370+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83810eed0 con 0x7fe8380ff350 2023-03-17T10:40:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.372+0000 7fe82a7fc700 1 -- 172.21.15.35:0/2401718771 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe834004750 con 0x7fe8380ff350 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.373+0000 7fe82a7fc700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe82409f640 0x7fe8240a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.373+0000 7fe83c89a700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe82409f640 0x7fe8240a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.373+0000 7fe82a7fc700 1 -- 172.21.15.35:0/2401718771 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe8340ca370 con 0x7fe8380ff350 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe83c89a700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe82409f640 0x7fe8240a1af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe8380688b0 tx=0x7fe82c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 Processor -- start 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 -- start start 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 0x55c5f7483fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f74844f0 0x55c5f747e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f747ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f7385010 con 0x55c5f7483be0 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f73d7950 con 0x55c5f74844f0 2023-03-17T10:40:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f73d0de0 con 0x55c5f747e960 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe83d09b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 0x55c5f7483fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe83d09b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 0x55c5f7483fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51374/0 (socket says 172.21.15.35:51374) 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.374+0000 7fe83d09b700 1 -- 172.21.15.35:0/4048000356 learned_addr learned my addr 172.21.15.35:0/4048000356 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83c89a700 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f74844f0 0x55c5f747e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d89c700 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f747ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d09b700 1 -- 172.21.15.35:0/4048000356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 msgr2=0x55c5f747ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d09b700 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f747ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d09b700 1 -- 172.21.15.35:0/4048000356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f74844f0 msgr2=0x55c5f747e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d09b700 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f74844f0 0x55c5f747e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d09b700 1 -- 172.21.15.35:0/4048000356 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f72525d0 con 0x55c5f7483be0 2023-03-17T10:40:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d89c700 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f747ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:40:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe83d09b700 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 0x55c5f7483fb0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe834097db0 tx=0x7fe834097800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185ea216784cb8a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe8237fe700 1 -- 172.21.15.35:0/4048000356 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340c1ea0 con 0x55c5f7483be0 2023-03-17T10:40:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe8237fe700 1 -- 172.21.15.35:0/4048000356 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe834097e20 con 0x55c5f7483be0 2023-03-17T10:40:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.375+0000 7fe8237fe700 1 -- 172.21.15.35:0/4048000356 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340af070 con 0x55c5f7483be0 2023-03-17T10:40:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 -- 172.21.15.35:0/4048000356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 msgr2=0x55c5f7483fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 0x55c5f7483fb0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe834097db0 tx=0x7fe834097800 comp rx=0 tx=0).stop 2023-03-17T10:40:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 -- 172.21.15.35:0/4048000356 shutdown_connections 2023-03-17T10:40:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f747ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f7483be0 0x55c5f7483fb0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/4048000356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f74844f0 0x55c5f747e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 -- 172.21.15.35:0/4048000356 >> 172.21.15.35:0/4048000356 conn(0x55c5f72db6b0 msgr2=0x55c5f7478a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 -- 172.21.15.35:0/4048000356 shutdown_connections 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 -- 172.21.15.35:0/4048000356 wait complete. 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.376+0000 7fe84b48cb80 1 -- start start 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 Processor -- start 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f7487740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f7487de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f72548c0 con 0x55c5f74844f0 2023-03-17T10:40:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f7488550 con 0x55c5f7483be0 2023-03-17T10:40:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f7493fd0 con 0x55c5f747e960 2023-03-17T10:40:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe84b48cb80 10 client.0 _ll_register_callbacks cb 0x55c5f7276230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:40:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83d89c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f7487de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83d89c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f7487de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51384/0 (socket says 172.21.15.35:51384) 2023-03-17T10:40:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83d89c700 1 -- 172.21.15.35:0/2616854684 learned_addr learned my addr 172.21.15.35:0/2616854684 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:40:14.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83c89a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f7487740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83d89c700 1 -- 172.21.15.35:0/2616854684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 msgr2=0x55c5f748a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.377+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe83d89c700 1 -- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 msgr2=0x55c5f7487740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f7487740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:14.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe83d89c700 1 -- 172.21.15.35:0/2616854684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83810eed0 con 0x55c5f74844f0 2023-03-17T10:40:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe83c89a700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f7487740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:40:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:40:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f7487de0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe830004c70 tx=0x7fe830004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b933d85110c9e72 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe820ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:40:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe820ff9700 1 -- 172.21.15.35:0/2616854684 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83000e040 con 0x55c5f74844f0 2023-03-17T10:40:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe820ff9700 1 -- 172.21.15.35:0/2616854684 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe830005450 con 0x55c5f74844f0 2023-03-17T10:40:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5f7393390 con 0x55c5f74844f0 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe820ff9700 1 -- 172.21.15.35:0/2616854684 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe830005610 con 0x55c5f74844f0 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe84b48cb80 10 client.19194 fetch_fsmap learned FSMap version 45 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55c5f71fed80 con 0x55c5f74844f0 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe820ff9700 1 -- 172.21.15.35:0/2616854684 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c5f7393390 con 0x55c5f74844f0 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe820ff9700 1 -- 172.21.15.35:0/2616854684 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe830019070 con 0x55c5f74844f0 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe84b48cb80 10 client.19194 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.378+0000 7fe84b48cb80 10 client.19194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe84b48cb80 20 client.19194 populate_metadata read hostname 'smithi035' 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f7498170 0x55c5f749a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe84b48cb80 4 client.19194 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5f739f600 con 0x55c5f7498170 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f7498170 0x55c5f749a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe820ff9700 10 client.19194 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:40:16.384 INFO:tasks.workunit.client.0.smithi035.stdout: 10 18767 3.34 MB/sec execute 2 sec latency 68.335 ms 2023-03-17T10:40:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.379+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f7498170 0x55c5f749a580 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4df9cb41dd38dda9 server_cookie=59bc92edefb3a571 in_seq=0 out_seq=0 2023-03-17T10:40:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe820ff9700 1 -- 172.21.15.35:0/2616854684 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c5f739f600 con 0x55c5f7498170 2023-03-17T10:40:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe820ff9700 10 client.19194 handle_command_reply: tid=0 2023-03-17T10:40:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 client.19194 shutdown 2023-03-17T10:40:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 msgr2=0x55c5f7487de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f7487de0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe830004c70 tx=0x7fe830004ca0 comp rx=0 tx=0).stop 2023-03-17T10:40:17.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 shutdown_connections 2023-03-17T10:40:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f7498170 0x55c5f749a580 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f7487de0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe820ff9700 0 client.19194 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:40:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2616854684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f7487740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 >> 172.21.15.35:0/2616854684 conn(0x55c5f72db6b0 msgr2=0x55c5f747d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 shutdown_connections 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2616854684 wait complete. 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.380+0000 7fe84b48cb80 20 client.19194 trim_cache size 0 max 16384 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 Processor -- start 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 -- start start 2023-03-17T10:40:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 0x55c5f7478ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f74844f0 0x55c5f747a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f7479380 con 0x55c5f747e960 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f7479000 con 0x55c5f7483be0 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.396+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f74740d0 con 0x55c5f74844f0 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 0x55c5f7478ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 0x55c5f7478ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51388/0 (socket says 172.21.15.35:51388) 2023-03-17T10:40:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 -- 172.21.15.35:0/2855602041 learned_addr learned my addr 172.21.15.35:0/2855602041 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:40:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83c89a700 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f74844f0 0x55c5f747a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 -- 172.21.15.35:0/2855602041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f74844f0 msgr2=0x55c5f747a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f74844f0 0x55c5f747a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 -- 172.21.15.35:0/2855602041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 msgr2=0x55c5f748ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 -- 172.21.15.35:0/2855602041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f7397130 con 0x55c5f747e960 2023-03-17T10:40:21.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f74844f0 0x55c5f747a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:40:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 0x55c5f7478ac0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fe834097b20 tx=0x7fe834000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c06cff6b699cb7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe823fff700 1 -- 172.21.15.35:0/2855602041 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340af040 con 0x55c5f747e960 2023-03-17T10:40:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe823fff700 1 -- 172.21.15.35:0/2855602041 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8340b0040 con 0x55c5f747e960 2023-03-17T10:40:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.397+0000 7fe823fff700 1 -- 172.21.15.35:0/2855602041 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340c7040 con 0x55c5f747e960 2023-03-17T10:40:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2855602041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 msgr2=0x55c5f7478ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 0x55c5f7478ac0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fe834097b20 tx=0x7fe834000bc0 comp rx=0 tx=0).stop 2023-03-17T10:40:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2855602041 shutdown_connections 2023-03-17T10:40:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f74844f0 0x55c5f747a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f747e960 0x55c5f7478ac0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2855602041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2855602041 >> 172.21.15.35:0/2855602041 conn(0x55c5f72db6b0 msgr2=0x55c5f74936b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2855602041 shutdown_connections 2023-03-17T10:40:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2855602041 wait complete. 2023-03-17T10:40:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 -- start start 2023-03-17T10:40:23.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.398+0000 7fe84b48cb80 1 Processor -- start 2023-03-17T10:40:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f748eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f74eb210 con 0x55c5f74844f0 2023-03-17T10:40:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f74eb380 con 0x55c5f7483be0 2023-03-17T10:40:23.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f74eb540 con 0x55c5f747e960 2023-03-17T10:40:25.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe84b48cb80 10 client.0 _ll_register_callbacks cb 0x55c5f7276230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:40:25.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83c89a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f748eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83c89a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53192/0 (socket says 172.21.15.35:53192) 2023-03-17T10:40:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f748eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51398/0 (socket says 172.21.15.35:51398) 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83c89a700 1 -- 172.21.15.35:0/2016360327 learned_addr learned my addr 172.21.15.35:0/2016360327 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 -- 172.21.15.35:0/2016360327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 msgr2=0x55c5f748e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 -- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 msgr2=0x55c5f748e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83d89c700 1 -- 172.21.15.35:0/2016360327 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5f72525d0 con 0x55c5f74844f0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.399+0000 7fe83c89a700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe83d89c700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f748eb90 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe830004c40 tx=0x7fe830009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9486fff008dfd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe820ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe820ff9700 1 -- 172.21.15.35:0/2016360327 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830035070 con 0x55c5f74844f0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe820ff9700 1 -- 172.21.15.35:0/2016360327 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe830005460 con 0x55c5f74844f0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5f744e1e0 con 0x55c5f74844f0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe820ff9700 1 -- 172.21.15.35:0/2016360327 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe83000e040 con 0x55c5f74844f0 2023-03-17T10:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 10 client.19200 fetch_fsmap learned FSMap version 45 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55c5f72251f0 con 0x55c5f74844f0 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe820ff9700 1 -- 172.21.15.35:0/2016360327 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c5f744e1e0 con 0x55c5f74844f0 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe820ff9700 1 -- 172.21.15.35:0/2016360327 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 45) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe830038030 con 0x55c5f74844f0 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 10 client.19200 fetch_fsmap finished waiting for FSMap version 45 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 10 client.19200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 20 client.19200 populate_metadata read hostname 'smithi035' 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f74ec820 0x55c5f74eec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 4 client.19200 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.400+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c5f7254f00 con 0x55c5f74ec820 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.401+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f74ec820 0x55c5f74eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.401+0000 7fe820ff9700 10 client.19200 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.401+0000 7fe83d09b700 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f74ec820 0x55c5f74eec00 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1bc6ee9cd3c9125 server_cookie=50f00069b597749d in_seq=0 out_seq=0 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.449+0000 7fe820ff9700 1 -- 172.21.15.35:0/2016360327 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c5f7254f00 con 0x55c5f74ec820 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.449+0000 7fe820ff9700 10 client.19200 handle_command_reply: tid=0 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.449+0000 7fe84b48cb80 1 client.19200 shutdown 2023-03-17T10:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.449+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 msgr2=0x55c5f748eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.449+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f748eb90 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe830004c40 tx=0x7fe830009650 comp rx=0 tx=0).stop 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 shutdown_connections 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c5f74ec820 0x55c5f74eec00 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c5f74844f0 0x55c5f748eb90 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe820ff9700 0 client.19200 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5f747e960 0x55c5f748e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 --2- 172.21.15.35:0/2016360327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c5f7483be0 0x55c5f748e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 >> 172.21.15.35:0/2016360327 conn(0x55c5f72db6b0 msgr2=0x55c5f747a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 shutdown_connections 2023-03-17T10:40:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 1 -- 172.21.15.35:0/2016360327 wait complete. 2023-03-17T10:40:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe84b48cb80 20 client.19200 trim_cache size 0 max 16384 2023-03-17T10:40:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe82409f640 msgr2=0x7fe8240a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe82409f640 0x7fe8240a1af0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe8380688b0 tx=0x7fe82c00b410 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 msgr2=0x7fe838197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 0x7fe838197220 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe83400d980 tx=0x7fe83400dc90 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 shutdown_connections 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe82409f640 0x7fe8240a1af0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe838104390 0x7fe8381a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8380ff350 0x7fe838197220 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 --2- 172.21.15.35:0/2401718771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8380ffcf0 0x7fe838197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.450+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 >> 172.21.15.35:0/2401718771 conn(0x7fe838076330 msgr2=0x7fe8380fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.451+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 shutdown_connections 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:35.451+0000 7fe83f2ff700 1 -- 172.21.15.35:0/2401718771 wait complete. 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 -- 172.21.15.35:0/4041287530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ffcf0 msgr2=0x7fea08103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 --2- 172.21.15.35:0/4041287530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ffcf0 0x7fea08103cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009990 tx=0x7fe9f8009ca0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 -- 172.21.15.35:0/4041287530 shutdown_connections 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 --2- 172.21.15.35:0/4041287530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 0x7fea0810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 --2- 172.21.15.35:0/4041287530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea080ff350 0x7fea080ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 --2- 172.21.15.35:0/4041287530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ffcf0 0x7fea08103cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 -- 172.21.15.35:0/4041287530 >> 172.21.15.35:0/4041287530 conn(0x7fea08076330 msgr2=0x7fea08076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 -- 172.21.15.35:0/4041287530 shutdown_connections 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.573+0000 7fea103fb700 1 -- 172.21.15.35:0/4041287530 wait complete. 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 Processor -- start 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 -- start start 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 0x7fea08197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea080ffcf0 0x7fea081976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 0x7fea081a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea081a2730 con 0x7fea08104390 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea081a2870 con 0x7fea080ff350 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea103fb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea081a29b0 con 0x7fea080ffcf0 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.574+0000 7fea0e197700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 0x7fea08197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e998700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 0x7fea081a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 0x7fea08197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53204/0 (socket says 172.21.15.35:53204) 2023-03-17T10:40:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 -- 172.21.15.35:0/1930980266 learned_addr learned my addr 172.21.15.35:0/1930980266 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:40:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0d996700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea080ffcf0 0x7fea081976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 -- 172.21.15.35:0/1930980266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea080ffcf0 msgr2=0x7fea081976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea080ffcf0 0x7fea081976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 -- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 msgr2=0x7fea081a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 0x7fea081a21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 -- 172.21.15.35:0/1930980266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04009520 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e998700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 0x7fea081a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea0e197700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 0x7fea08197170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fea0400eb30 tx=0x7fea0400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fe9ff7fe700 1 -- 172.21.15.35:0/1930980266 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04009880 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fe9ff7fe700 1 -- 172.21.15.35:0/1930980266 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea040044b0 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fe9ff7fe700 1 -- 172.21.15.35:0/1930980266 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04003ce0 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f80095f0 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.575+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0810efc0 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.578+0000 7fe9ff7fe700 1 -- 172.21.15.35:0/1930980266 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fea04003e40 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.578+0000 7fe9ff7fe700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe9f409f6c0 0x7fe9f40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fe9ff7fe700 1 -- 172.21.15.35:0/1930980266 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fea04014070 con 0x7fea080ff350 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea0d996700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe9f409f6c0 0x7fe9f40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 Processor -- start 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 -- start start 2023-03-17T10:40:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea0d996700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe9f409f6c0 0x7fe9f40a1b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800b650 tx=0x7fe9f8005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea17410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea11ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea1ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae914010 con 0x559aaea11830 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae966950 con 0x559aaea17040 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.579+0000 7fea1c588b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae95fde0 con 0x559aaea121e0 2023-03-17T10:40:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea11ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:28.449 INFO:tasks.workunit.client.0.smithi035.stdout: 10 18925 3.42 MB/sec execute 3 sec latency 76.616 ms 2023-03-17T10:40:30.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:34 smithi035 ceph-mon[92535]: pgmap v3359: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 311 op/s 2023-03-17T10:40:30.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:34 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:30.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:36 smithi035 ceph-mon[92535]: pgmap v3360: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 214 op/s 2023-03-17T10:40:30.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:37 smithi035 ceph-mon[92535]: pgmap v3361: 97 pgs: 97 active+clean; 528 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 310 op/s 2023-03-17T10:40:30.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:40 smithi035 ceph-mon[92535]: pgmap v3362: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2023-03-17T10:40:30.811 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:42 smithi035 ceph-mon[92535]: pgmap v3363: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 221 op/s 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:44 smithi035 ceph-mon[92535]: pgmap v3364: 97 pgs: 97 active+clean; 541 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 314 op/s 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:46 smithi035 ceph-mon[92535]: pgmap v3365: 97 pgs: 97 active+clean; 541 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 202 op/s 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:47 smithi035 ceph-mon[92535]: pgmap v3366: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 290 op/s 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:50 smithi035 ceph-mon[92535]: pgmap v3367: 97 pgs: 97 active+clean; 556 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 198 op/s 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:51 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:51 smithi035 ceph-mon[92535]: pgmap v3368: 97 pgs: 97 active+clean; 556 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2023-03-17T10:40:30.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:33.888 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:33.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:33.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:33.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T10:40:33.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:40:35.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: pgmap v3369: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.4 MiB/s wr, 297 op/s 2023-03-17T10:40:35.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:35.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:35.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:55 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T10:40:37.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:55 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:55 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:55 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:55 smithi035 ceph-mon[92535]: pgmap v3370: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 223 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:57 smithi035 ceph-mon[92535]: pgmap v3371: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 223 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:28:59 smithi035 ceph-mon[92535]: pgmap v3372: 97 pgs: 97 active+clean; 553 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 250 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:01 smithi035 ceph-mon[92535]: pgmap v3373: 97 pgs: 97 active+clean; 553 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 246 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:02 smithi035 ceph-mon[92535]: pgmap v3374: 97 pgs: 97 active+clean; 565 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.5 MiB/s wr, 362 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:04 smithi035 ceph-mon[92535]: osdmap e285: 12 total, 12 up, 12 in 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:04 smithi035 ceph-mon[92535]: pgmap v3376: 97 pgs: 97 active+clean; 566 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:06 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:06 smithi035 ceph-mon[92535]: pgmap v3377: 97 pgs: 97 active+clean; 566 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-03-17T10:40:37.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:09 smithi035 ceph-mon[92535]: pgmap v3378: 97 pgs: 97 active+clean; 585 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2023-03-17T10:40:37.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:11 smithi035 ceph-mon[92535]: pgmap v3379: 97 pgs: 97 active+clean; 585 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2023-03-17T10:40:37.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:12 smithi035 ceph-mon[92535]: osdmap e286: 12 total, 12 up, 12 in 2023-03-17T10:40:37.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:12 smithi035 ceph-mon[92535]: pgmap v3381: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 262 op/s 2023-03-17T10:40:37.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:14 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:37.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:14 smithi035 ceph-mon[92535]: pgmap v3382: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 231 op/s 2023-03-17T10:40:39.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:17 smithi035 ceph-mon[92535]: pgmap v3383: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 231 op/s 2023-03-17T10:40:39.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:18 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:39.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:18 smithi035 ceph-mon[92535]: pgmap v3384: 97 pgs: 97 active+clean; 605 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-03-17T10:40:39.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:21 smithi035 ceph-mon[92535]: pgmap v3385: 97 pgs: 97 active+clean; 605 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-03-17T10:40:39.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:22 smithi035 ceph-mon[92535]: pgmap v3386: 97 pgs: 97 active+clean; 604 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 364 op/s 2023-03-17T10:40:39.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:25 smithi035 ceph-mon[92535]: pgmap v3387: 97 pgs: 97 active+clean; 602 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 239 op/s 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:27 smithi035 ceph-mon[92535]: pgmap v3388: 97 pgs: 97 active+clean; 602 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 232 op/s 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:29 smithi035 ceph-mon[92535]: pgmap v3389: 97 pgs: 97 active+clean; 617 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:31 smithi035 ceph-mon[92535]: pgmap v3390: 97 pgs: 97 active+clean; 617 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:32 smithi035 ceph-mon[92535]: pgmap v3391: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 296 op/s 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:34 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:34 smithi035 ceph-mon[92535]: pgmap v3392: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 189 op/s 2023-03-17T10:40:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:37 smithi035 ceph-mon[92535]: pgmap v3393: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 182 op/s 2023-03-17T10:40:41.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:39 smithi035 ceph-mon[92535]: pgmap v3394: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 290 op/s 2023-03-17T10:40:41.792 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:40 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:41 smithi035 ceph-mon[92535]: pgmap v3395: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 199 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:42 smithi035 ceph-mon[92535]: pgmap v3396: 97 pgs: 97 active+clean; 634 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 307 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:45 smithi035 ceph-mon[92535]: pgmap v3397: 97 pgs: 97 active+clean; 635 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 228 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:47 smithi035 ceph-mon[92535]: pgmap v3398: 97 pgs: 97 active+clean; 635 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:49 smithi035 ceph-mon[92535]: pgmap v3399: 97 pgs: 97 active+clean; 645 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 334 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:51 smithi035 ceph-mon[92535]: pgmap v3400: 97 pgs: 97 active+clean; 645 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 226 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:52 smithi035 ceph-mon[92535]: pgmap v3401: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 312 op/s 2023-03-17T10:40:45.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:55 smithi035 ceph-mon[92535]: pgmap v3402: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 209 op/s 2023-03-17T10:40:46.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:40:46.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:40:46.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:40:46.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:40:48.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:56 smithi035 ceph-mon[92535]: pgmap v3403: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-03-17T10:40:48.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:56 smithi035 ceph-mon[92535]: pgmap v3404: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 270 op/s 2023-03-17T10:40:48.217 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:29:57 smithi035 ceph-mon[92535]: pgmap v3405: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 270 op/s 2023-03-17T10:40:48.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:00 smithi035 ceph-mon[92535]: pgmap v3406: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 270 op/s 2023-03-17T10:40:48.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T10:40:48.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:02 smithi035 ceph-mon[92535]: pgmap v3407: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 2.5 MiB/s wr, 155 op/s 2023-03-17T10:40:48.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:04 smithi035 ceph-mon[92535]: pgmap v3408: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 296 op/s 2023-03-17T10:40:48.218 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:05 smithi035 ceph-mon[92535]: osdmap e287: 12 total, 12 up, 12 in 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:06 smithi035 ceph-mon[92535]: pgmap v3410: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 268 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:07 smithi035 ceph-mon[92535]: pgmap v3411: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:10 smithi035 ceph-mon[92535]: pgmap v3412: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:12 smithi035 ceph-mon[92535]: pgmap v3413: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:12 smithi035 ceph-mon[92535]: osdmap e288: 12 total, 12 up, 12 in 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:14 smithi035 ceph-mon[92535]: pgmap v3415: 97 pgs: 97 active+clean; 674 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 310 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:16 smithi035 ceph-mon[92535]: pgmap v3416: 97 pgs: 97 active+clean; 674 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 277 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:17 smithi035 ceph-mon[92535]: pgmap v3417: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T10:40:50.641 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:20 smithi035 ceph-mon[92535]: pgmap v3418: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:22 smithi035 ceph-mon[92535]: pgmap v3419: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:24 smithi035 ceph-mon[92535]: pgmap v3420: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 340 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:26 smithi035 ceph-mon[92535]: pgmap v3421: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:27 smithi035 ceph-mon[92535]: pgmap v3422: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.8 MiB/s wr, 331 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:30 smithi035 ceph-mon[92535]: pgmap v3423: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:32 smithi035 ceph-mon[92535]: pgmap v3424: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:34 smithi035 ceph-mon[92535]: pgmap v3425: 97 pgs: 97 active+clean; 703 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 335 op/s 2023-03-17T10:40:50.642 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:36 smithi035 ceph-mon[92535]: pgmap v3426: 97 pgs: 97 active+clean; 703 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2023-03-17T10:40:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:40:50.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:40:53.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:40:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:40:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:40:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0e197700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea17410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0e197700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea17410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53212/0 (socket says 172.21.15.35:53212) 2023-03-17T10:40:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0e197700 1 -- 172.21.15.35:0/4188894186 learned_addr learned my addr 172.21.15.35:0/4188894186 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0e998700 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea1ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 -- 172.21.15.35:0/4188894186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 msgr2=0x559aaea1ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea1ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 -- 172.21.15.35:0/4188894186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 msgr2=0x559aaea17410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea17410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 -- 172.21.15.35:0/4188894186 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aae7e15d0 con 0x559aaea11830 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0e998700 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea1ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:40:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fea0d996700 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea11ca0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8000c00 tx=0x7fe9f8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11db6285ecd560b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:40:57.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fe9fcdae700 1 -- 172.21.15.35:0/4188894186 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800f660 con 0x559aaea11830 2023-03-17T10:40:57.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fe9fcdae700 1 -- 172.21.15.35:0/4188894186 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9f801e040 con 0x559aaea11830 2023-03-17T10:40:57.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.580+0000 7fe9fcdae700 1 -- 172.21.15.35:0/4188894186 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f802f7c0 con 0x559aaea11830 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 -- 172.21.15.35:0/4188894186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 msgr2=0x559aaea11ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea11ca0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8000c00 tx=0x7fe9f8020000 comp rx=0 tx=0).stop 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 -- 172.21.15.35:0/4188894186 shutdown_connections 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea1ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea17410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 --2- 172.21.15.35:0/4188894186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea11ca0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 -- 172.21.15.35:0/4188894186 >> 172.21.15.35:0/4188894186 conn(0x559aae86a6b0 msgr2=0x559aaea07a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:40:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 -- 172.21.15.35:0/4188894186 shutdown_connections 2023-03-17T10:40:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 -- 172.21.15.35:0/4188894186 wait complete. 2023-03-17T10:40:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.581+0000 7fea1c588b80 1 -- start start 2023-03-17T10:40:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 Processor -- start 2023-03-17T10:40:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea1dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:40:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea1af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea1b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aae7e38c0 con 0x559aaea121e0 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea1bdd0 con 0x559aaea11830 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea27440 con 0x559aaea17040 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea1c588b80 10 client.0 _ll_register_callbacks cb 0x559aae805230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea1af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea1af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51424/0 (socket says 172.21.15.35:51424) 2023-03-17T10:41:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 -- 172.21.15.35:0/3788578184 learned_addr learned my addr 172.21.15.35:0/3788578184 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0e197700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea1dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0e998700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea1b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 -- 172.21.15.35:0/3788578184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 msgr2=0x559aaea1b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea1b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 -- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 msgr2=0x559aaea1dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea1dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 -- 172.21.15.35:0/3788578184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0810c7a0 con 0x559aaea121e0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fea0d996700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea1af50 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80057d0 tx=0x7fe9f802f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b746ef304c577 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fe9f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.582+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/3788578184 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800f870 con 0x559aaea121e0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/3788578184 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe9f800f9d0 con 0x559aaea121e0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559aae922390 con 0x559aaea121e0 2023-03-17T10:41:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/3788578184 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9f802f850 con 0x559aaea121e0 2023-03-17T10:41:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 10 client.19212 fetch_fsmap learned FSMap version 47 2023-03-17T10:41:03.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559aae78dd80 con 0x559aaea121e0 2023-03-17T10:41:03.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/3788578184 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559aae922390 con 0x559aaea121e0 2023-03-17T10:41:03.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/3788578184 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 47) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fe9f8036070 con 0x559aaea121e0 2023-03-17T10:41:03.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 10 client.19212 fetch_fsmap finished waiting for FSMap version 47 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 10 client.19212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 20 client.19212 populate_metadata read hostname 'smithi035' 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea2b040 0x559aaea2d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 4 client.19212 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559aae92e600 con 0x559aaea2b040 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.583+0000 7fea0e197700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea2b040 0x559aaea2d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fe9f1ffb700 10 client.19212 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea0e197700 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea2b040 0x559aaea2d450 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=305bcded74eac40e server_cookie=f5b939d55026c667 in_seq=0 out_seq=0 2023-03-17T10:41:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/3788578184 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559aae92e600 con 0x559aaea2b040 2023-03-17T10:41:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fe9f1ffb700 10 client.19212 handle_command_reply: tid=0 2023-03-17T10:41:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 client.19212 shutdown 2023-03-17T10:41:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 msgr2=0x559aaea1af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea1af50 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80057d0 tx=0x7fe9f802f670 comp rx=0 tx=0).stop 2023-03-17T10:41:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 shutdown_connections 2023-03-17T10:41:08.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea2b040 0x559aaea2d450 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea1b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:10.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fe9f1ffb700 0 client.19212 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea1dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 --2- 172.21.15.35:0/3788578184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea1af50 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 >> 172.21.15.35:0/3788578184 conn(0x559aae86a6b0 msgr2=0x559aaea0c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.584+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 shutdown_connections 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.585+0000 7fea1c588b80 1 -- 172.21.15.35:0/3788578184 wait complete. 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.585+0000 7fea1c588b80 20 client.19212 trim_cache size 0 max 16384 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 Processor -- start 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 -- start start 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea223d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea1d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea08b70 con 0x559aaea11830 2023-03-17T10:41:11.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea09c20 con 0x559aaea17040 2023-03-17T10:41:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.601+0000 7fea1c588b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea08000 con 0x559aaea121e0 2023-03-17T10:41:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0d996700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:11.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea07ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51430/0 (socket says 172.21.15.35:51430) 2023-03-17T10:41:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 -- 172.21.15.35:0/2251237274 learned_addr learned my addr 172.21.15.35:0/2251237274 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e998700 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea1d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 -- 172.21.15.35:0/2251237274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 msgr2=0x559aaea223d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea223d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 -- 172.21.15.35:0/2251237274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 msgr2=0x559aaea1d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea1d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 -- 172.21.15.35:0/2251237274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aae926130 con 0x559aaea11830 2023-03-17T10:41:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0d996700 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:41:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e998700 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea1d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:41:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fea0e197700 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea07ac0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fea04098320 tx=0x7fea0409b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6943a7528c2f4991 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fe9fd5af700 1 -- 172.21.15.35:0/2251237274 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040b4070 con 0x559aaea11830 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fe9fd5af700 1 -- 172.21.15.35:0/2251237274 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea0401e2e0 con 0x559aaea11830 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.602+0000 7fe9fd5af700 1 -- 172.21.15.35:0/2251237274 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040b0040 con 0x559aaea11830 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 -- 172.21.15.35:0/2251237274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 msgr2=0x559aaea07ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea07ac0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fea04098320 tx=0x7fea0409b040 comp rx=0 tx=0).stop 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 -- 172.21.15.35:0/2251237274 shutdown_connections 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea17040 0x559aaea1d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea11830 0x559aaea07ac0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2251237274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea121e0 0x559aaea223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 -- 172.21.15.35:0/2251237274 >> 172.21.15.35:0/2251237274 conn(0x559aae86a6b0 msgr2=0x559aaea150f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 -- 172.21.15.35:0/2251237274 shutdown_connections 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 -- 172.21.15.35:0/2251237274 wait complete. 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 -- start start 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 Processor -- start 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea20310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.603+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea20850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea1c588b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea77e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea1c588b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea783f0 con 0x559aaea121e0 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea1c588b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea78560 con 0x559aaea11830 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea1c588b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aaea78720 con 0x559aaea17040 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea1c588b80 10 client.0 _ll_register_callbacks cb 0x559aae805230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea20310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea20310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53232/0 (socket says 172.21.15.35:53232) 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 -- 172.21.15.35:0/2629822158 learned_addr learned my addr 172.21.15.35:0/2629822158 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0d996700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea20850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e998700 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea77e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 -- 172.21.15.35:0/2629822158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 msgr2=0x559aaea77e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea77e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 -- 172.21.15.35:0/2629822158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 msgr2=0x559aaea20850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea20850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 -- 172.21.15.35:0/2629822158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aae78dd80 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea0e197700 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea20310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea040c82a0 tx=0x7fea040949e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8638c151d77f6fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fe9f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/2629822158 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040b4070 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/2629822158 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fea0400cbd0 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.604+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559aae9dd1e0 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/2629822158 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea040b0040 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 10 client.28379 fetch_fsmap learned FSMap version 47 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7fea0810efc0 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/2629822158 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559aae9dd1e0 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/2629822158 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 47) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fea04097b10 con 0x559aaea11830 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 10 client.28379 fetch_fsmap finished waiting for FSMap version 47 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 10 client.28379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 20 client.28379 populate_metadata read hostname 'smithi035' 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea7fbd0 0x559aaea81fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 4 client.28379 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:41:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559aae7e3f00 con 0x559aaea7fbd0 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.605+0000 7fea0d996700 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea7fbd0 0x559aaea81fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.606+0000 7fe9f1ffb700 10 client.28379 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.606+0000 7fea0d996700 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea7fbd0 0x559aaea81fe0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e72ad12dbdb397 server_cookie=34e5a48e4d973640 in_seq=0 out_seq=0 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fe9f1ffb700 1 -- 172.21.15.35:0/2629822158 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559aae7e3f00 con 0x559aaea7fbd0 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fe9f1ffb700 10 client.28379 handle_command_reply: tid=0 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 client.28379 shutdown 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 msgr2=0x559aaea20310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea20310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea040c82a0 tx=0x7fea040949e0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 shutdown_connections 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559aaea7fbd0 0x559aaea81fe0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559aaea17040 0x559aaea77e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559aaea11830 0x559aaea20310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fe9f1ffb700 0 client.28379 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 --2- 172.21.15.35:0/2629822158 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559aaea121e0 0x559aaea20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.626+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 >> 172.21.15.35:0/2629822158 conn(0x559aae86a6b0 msgr2=0x559aaea16070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 shutdown_connections 2023-03-17T10:41:17.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea1c588b80 1 -- 172.21.15.35:0/2629822158 wait complete. 2023-03-17T10:41:17.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea1c588b80 20 client.28379 trim_cache size 0 max 16384 2023-03-17T10:41:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe9f409f6c0 msgr2=0x7fe9f40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:22.830 INFO:tasks.workunit.client.0.smithi035.stdout: 10 19090 5.37 MB/sec execute 4 sec latency 86.701 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 19240 5.30 MB/sec execute 5 sec latency 76.107 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 19390 5.17 MB/sec execute 6 sec latency 69.909 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 19579 6.42 MB/sec execute 7 sec latency 83.920 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 19784 7.49 MB/sec execute 8 sec latency 58.646 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 19997 7.83 MB/sec execute 9 sec latency 62.839 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 20130 7.84 MB/sec execute 10 sec latency 65.051 ms 2023-03-17T10:41:22.831 INFO:tasks.workunit.client.0.smithi035.stdout: 10 20239 7.68 MB/sec execute 11 sec latency 66.365 ms 2023-03-17T10:41:23.665 INFO:tasks.workunit.client.0.smithi035.stdout: 10 20451 8.92 MB/sec execute 12 sec latency 64.269 ms 2023-03-17T10:41:23.665 INFO:tasks.workunit.client.0.smithi035.stdout: 10 20639 8.99 MB/sec execute 13 sec latency 65.863 ms 2023-03-17T10:41:23.665 INFO:tasks.workunit.client.0.smithi035.stdout: 10 20789 8.98 MB/sec execute 14 sec latency 62.203 ms 2023-03-17T10:41:23.665 INFO:tasks.workunit.client.0.smithi035.stdout: 10 20898 8.73 MB/sec execute 15 sec latency 58.765 ms 2023-03-17T10:41:23.666 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21011 8.43 MB/sec execute 16 sec latency 124.924 ms 2023-03-17T10:41:24.206 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21169 8.56 MB/sec execute 17 sec latency 79.342 ms 2023-03-17T10:41:24.206 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21309 8.40 MB/sec execute 18 sec latency 77.018 ms 2023-03-17T10:41:24.206 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21456 8.44 MB/sec execute 19 sec latency 73.490 ms 2023-03-17T10:41:24.206 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21600 8.30 MB/sec execute 20 sec latency 98.110 ms 2023-03-17T10:41:24.206 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21735 8.24 MB/sec execute 21 sec latency 86.417 ms 2023-03-17T10:41:24.955 INFO:tasks.workunit.client.0.smithi035.stdout: 10 21867 8.23 MB/sec execute 22 sec latency 81.940 ms 2023-03-17T10:41:24.955 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22003 8.07 MB/sec execute 23 sec latency 71.824 ms 2023-03-17T10:41:24.955 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22156 8.05 MB/sec execute 24 sec latency 68.075 ms 2023-03-17T10:41:24.955 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22310 7.91 MB/sec execute 25 sec latency 69.555 ms 2023-03-17T10:41:24.955 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22463 7.75 MB/sec execute 26 sec latency 69.114 ms 2023-03-17T10:41:24.955 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22632 7.88 MB/sec execute 27 sec latency 80.870 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22775 7.79 MB/sec execute 28 sec latency 57.543 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 22941 7.72 MB/sec execute 29 sec latency 61.934 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 23117 7.88 MB/sec execute 30 sec latency 119.775 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 23317 7.99 MB/sec execute 31 sec latency 62.911 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 23495 8.01 MB/sec execute 32 sec latency 62.843 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 23601 7.90 MB/sec execute 33 sec latency 74.686 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 23760 8.03 MB/sec execute 34 sec latency 64.704 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 23973 8.45 MB/sec execute 35 sec latency 66.363 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24145 8.49 MB/sec execute 36 sec latency 64.458 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24291 8.45 MB/sec execute 37 sec latency 60.411 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24395 8.37 MB/sec execute 38 sec latency 66.333 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24541 8.35 MB/sec execute 39 sec latency 61.322 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24713 8.40 MB/sec execute 40 sec latency 69.105 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24848 8.36 MB/sec execute 41 sec latency 64.451 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 24979 8.32 MB/sec execute 42 sec latency 62.245 ms 2023-03-17T10:41:24.956 INFO:tasks.workunit.client.0.smithi035.stdout: 10 25114 8.28 MB/sec execute 43 sec latency 95.207 ms 2023-03-17T10:41:24.957 INFO:tasks.workunit.client.0.smithi035.stdout: 10 25271 8.36 MB/sec execute 44 sec latency 63.599 ms 2023-03-17T10:41:24.957 INFO:tasks.workunit.client.0.smithi035.stdout: 10 25428 8.29 MB/sec execute 45 sec latency 84.952 ms 2023-03-17T10:41:24.957 INFO:tasks.workunit.client.0.smithi035.stdout: 10 25570 8.17 MB/sec execute 46 sec latency 85.668 ms 2023-03-17T10:41:24.957 INFO:tasks.workunit.client.0.smithi035.stdout: 10 25718 8.08 MB/sec execute 47 sec latency 70.855 ms 2023-03-17T10:41:24.957 INFO:tasks.workunit.client.0.smithi035.stdout: 10 25872 8.00 MB/sec execute 48 sec latency 65.585 ms 2023-03-17T10:41:24.957 INFO:tasks.workunit.client.0.smithi035.stdout: 10 26049 8.13 MB/sec execute 49 sec latency 73.938 ms 2023-03-17T10:41:26.443 INFO:tasks.workunit.client.0.smithi035.stdout: 10 26193 8.10 MB/sec execute 50 sec latency 65.647 ms 2023-03-17T10:41:26.443 INFO:tasks.workunit.client.0.smithi035.stdout: 10 26345 8.06 MB/sec execute 51 sec latency 69.012 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 26543 8.21 MB/sec execute 52 sec latency 66.998 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 26728 8.22 MB/sec execute 53 sec latency 87.273 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 26891 8.18 MB/sec execute 54 sec latency 68.390 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27020 8.13 MB/sec execute 55 sec latency 67.902 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27140 8.10 MB/sec execute 56 sec latency 105.739 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27310 8.19 MB/sec execute 57 sec latency 61.924 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27509 8.37 MB/sec execute 58 sec latency 74.581 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27698 8.42 MB/sec execute 59 sec latency 91.849 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27803 8.35 MB/sec execute 60 sec latency 80.566 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 27923 8.30 MB/sec execute 61 sec latency 108.535 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28101 8.38 MB/sec execute 62 sec latency 73.855 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28262 8.35 MB/sec execute 63 sec latency 68.302 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28386 8.29 MB/sec execute 64 sec latency 68.941 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28524 8.32 MB/sec execute 65 sec latency 65.873 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28636 8.26 MB/sec execute 66 sec latency 186.903 ms 2023-03-17T10:41:26.444 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28791 8.30 MB/sec execute 67 sec latency 64.148 ms 2023-03-17T10:41:26.445 INFO:tasks.workunit.client.0.smithi035.stdout: 10 28937 8.26 MB/sec execute 68 sec latency 66.934 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 29095 8.19 MB/sec execute 69 sec latency 68.213 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 29252 8.14 MB/sec execute 70 sec latency 66.125 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 29400 8.09 MB/sec execute 71 sec latency 65.505 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 29557 8.17 MB/sec execute 72 sec latency 65.225 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 29705 8.18 MB/sec execute 73 sec latency 61.423 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 29870 8.17 MB/sec execute 74 sec latency 61.452 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30077 8.27 MB/sec execute 75 sec latency 62.261 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30251 8.24 MB/sec execute 76 sec latency 67.910 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30395 8.21 MB/sec execute 77 sec latency 77.739 ms 2023-03-17T10:41:27.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30506 8.18 MB/sec execute 78 sec latency 108.760 ms 2023-03-17T10:41:29.047 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30660 8.24 MB/sec execute 79 sec latency 61.081 ms 2023-03-17T10:41:29.047 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30829 8.30 MB/sec execute 80 sec latency 90.501 ms 2023-03-17T10:41:29.047 INFO:tasks.workunit.client.0.smithi035.stdout: 10 30997 8.33 MB/sec execute 81 sec latency 65.177 ms 2023-03-17T10:41:29.724 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31168 8.32 MB/sec execute 82 sec latency 61.123 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31279 8.28 MB/sec execute 83 sec latency 92.283 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31389 8.24 MB/sec execute 84 sec latency 88.073 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31549 8.26 MB/sec execute 85 sec latency 84.160 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31692 8.25 MB/sec execute 86 sec latency 79.140 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31822 8.22 MB/sec execute 87 sec latency 65.851 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 31963 8.23 MB/sec execute 88 sec latency 68.948 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 32120 8.27 MB/sec execute 89 sec latency 68.607 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 32252 8.23 MB/sec execute 90 sec latency 134.207 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 32402 8.18 MB/sec execute 91 sec latency 80.955 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 32538 8.12 MB/sec execute 92 sec latency 72.027 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 32673 8.07 MB/sec execute 93 sec latency 124.385 ms 2023-03-17T10:41:30.402 INFO:tasks.workunit.client.0.smithi035.stdout: 10 32845 8.11 MB/sec execute 94 sec latency 98.382 ms 2023-03-17T10:41:30.403 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33013 8.11 MB/sec execute 95 sec latency 109.232 ms 2023-03-17T10:41:30.403 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33169 8.17 MB/sec execute 96 sec latency 106.054 ms 2023-03-17T10:41:30.403 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33313 8.16 MB/sec execute 97 sec latency 67.957 ms 2023-03-17T10:41:30.403 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33499 8.19 MB/sec execute 98 sec latency 80.459 ms 2023-03-17T10:41:30.403 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33680 8.23 MB/sec execute 99 sec latency 89.339 ms 2023-03-17T10:41:32.250 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33814 8.19 MB/sec execute 100 sec latency 84.309 ms 2023-03-17T10:41:32.250 INFO:tasks.workunit.client.0.smithi035.stdout: 10 33942 8.18 MB/sec execute 101 sec latency 62.207 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34065 8.16 MB/sec execute 102 sec latency 105.577 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34232 8.21 MB/sec execute 103 sec latency 64.963 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34402 8.25 MB/sec execute 104 sec latency 65.226 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34570 8.25 MB/sec execute 105 sec latency 67.956 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34696 8.21 MB/sec execute 106 sec latency 68.918 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34830 8.22 MB/sec execute 107 sec latency 65.719 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 34986 8.21 MB/sec execute 108 sec latency 67.873 ms 2023-03-17T10:41:32.992 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35159 8.25 MB/sec execute 109 sec latency 72.362 ms 2023-03-17T10:41:32.993 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35281 8.22 MB/sec execute 110 sec latency 128.018 ms 2023-03-17T10:41:33.703 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35423 8.22 MB/sec execute 111 sec latency 64.077 ms 2023-03-17T10:41:34.208 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35563 8.21 MB/sec execute 112 sec latency 93.996 ms 2023-03-17T10:41:34.208 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35692 8.19 MB/sec execute 113 sec latency 67.212 ms 2023-03-17T10:41:34.208 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35827 8.13 MB/sec execute 114 sec latency 69.347 ms 2023-03-17T10:41:34.208 INFO:tasks.workunit.client.0.smithi035.stdout: 10 35979 8.09 MB/sec execute 115 sec latency 70.261 ms 2023-03-17T10:41:34.208 INFO:tasks.workunit.client.0.smithi035.stdout: 10 36127 8.08 MB/sec execute 116 sec latency 65.377 ms 2023-03-17T10:41:34.208 INFO:tasks.workunit.client.0.smithi035.stdout: 10 36283 8.06 MB/sec execute 117 sec latency 71.126 ms 2023-03-17T10:41:34.209 INFO:tasks.workunit.client.0.smithi035.stdout: 10 36460 8.10 MB/sec execute 118 sec latency 65.100 ms 2023-03-17T10:41:34.813 INFO:tasks.workunit.client.0.smithi035.stdout: 10 36616 8.12 MB/sec execute 119 sec latency 72.305 ms 2023-03-17T10:41:34.813 INFO:tasks.workunit.client.0.smithi035.stdout: 10 36783 8.15 MB/sec execute 120 sec latency 66.719 ms 2023-03-17T10:41:34.813 INFO:tasks.workunit.client.0.smithi035.stdout: 10 36956 8.17 MB/sec execute 121 sec latency 98.000 ms 2023-03-17T10:41:34.813 INFO:tasks.workunit.client.0.smithi035.stdout: 10 37128 8.20 MB/sec execute 122 sec latency 62.456 ms 2023-03-17T10:41:34.813 INFO:tasks.workunit.client.0.smithi035.stdout: 10 37288 8.19 MB/sec execute 123 sec latency 68.648 ms 2023-03-17T10:41:35.999 INFO:tasks.workunit.client.0.smithi035.stdout: 10 37418 8.18 MB/sec execute 124 sec latency 68.950 ms 2023-03-17T10:41:35.999 INFO:tasks.workunit.client.0.smithi035.stdout: 10 37547 8.18 MB/sec execute 125 sec latency 61.956 ms 2023-03-17T10:41:36.924 INFO:tasks.workunit.client.0.smithi035.stdout: 10 37691 8.20 MB/sec execute 126 sec latency 62.944 ms 2023-03-17T10:41:36.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:37 smithi035 ceph-mon[92535]: pgmap v3427: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 316 op/s 2023-03-17T10:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe9f409f6c0 0x7fe9f40a1b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800b650 tx=0x7fe9f8005fb0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 msgr2=0x7fea08197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 0x7fea08197170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fea0400eb30 tx=0x7fea0400ee40 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 shutdown_connections 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe9f409f6c0 0x7fe9f40a1b70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fea08104390 0x7fea081a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea080ff350 0x7fea08197170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 --2- 172.21.15.35:0/1930980266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea080ffcf0 0x7fea081976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 >> 172.21.15.35:0/1930980266 conn(0x7fea08076330 msgr2=0x7fea080fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 shutdown_connections 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:14:48.627+0000 7fea103fb700 1 -- 172.21.15.35:0/1930980266 wait complete. 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 -- 172.21.15.35:0/2942285240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 msgr2=0x7fe880103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2942285240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe880103d20 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fe8740099c0 tx=0x7fe874009cd0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 -- 172.21.15.35:0/2942285240 shutdown_connections 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2942285240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe880104400 0x7fe88010bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2942285240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8800ff3c0 0x7fe8800ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2942285240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe880103d20 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 -- 172.21.15.35:0/2942285240 >> 172.21.15.35:0/2942285240 conn(0x7fe880076300 msgr2=0x7fe880076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 -- 172.21.15.35:0/2942285240 shutdown_connections 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.750+0000 7fe8865d0700 1 -- 172.21.15.35:0/2942285240 wait complete. 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 Processor -- start 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 -- start start 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8800ff3c0 0x7fe880197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe8801975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe880104400 0x7fe8801a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880197f00 con 0x7fe8800ffd60 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801a2640 con 0x7fe8800ff3c0 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe8865d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8801a2800 con 0x7fe880104400 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.751+0000 7fe87f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe8801975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe8801975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51452/0 (socket says 172.21.15.35:51452) 2023-03-17T10:41:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 -- 172.21.15.35:0/2151548271 learned_addr learned my addr 172.21.15.35:0/2151548271 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe884b6d700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe880104400 0x7fe8801a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87ffff700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8800ff3c0 0x7fe880197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:38.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 -- 172.21.15.35:0/2151548271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe880104400 msgr2=0x7fe8801a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:40.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe880104400 0x7fe8801a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:40.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 -- 172.21.15.35:0/2151548271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8800ff3c0 msgr2=0x7fe880197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:40.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8800ff3c0 0x7fe880197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:40.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 -- 172.21.15.35:0/2151548271 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740095f0 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe8801975c0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fe8740098e0 tx=0x7fe87400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87d7fa700 1 -- 172.21.15.35:0/2151548271 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87401d070 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87d7fa700 1 -- 172.21.15.35:0/2151548271 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe874005050 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe87d7fa700 1 -- 172.21.15.35:0/2151548271 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874004970 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88010f030 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.752+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88010eea0 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.755+0000 7fe87d7fa700 1 -- 172.21.15.35:0/2151548271 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe874005430 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.756+0000 7fe87d7fa700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe86809f640 0x7fe8680a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.756+0000 7fe87d7fa700 1 -- 172.21.15.35:0/2151548271 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe8740cb2a0 con 0x7fe8800ffd60 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.756+0000 7fe87ffff700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe86809f640 0x7fe8680a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.756+0000 7fe87ffff700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe86809f640 0x7fe8680a1af0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe870009c60 tx=0x7fe870009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 Processor -- start 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 -- start start 2023-03-17T10:41:40.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 0x562f7869edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869f330 0x562f786a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f785a1010 con 0x562f786a3170 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f785f3950 con 0x562f7869f330 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe89275db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f785ecde0 con 0x562f7869ea20 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 0x562f7869edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869f330 0x562f786a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe884b6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 0x562f7869edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43224/0 (socket says 172.21.15.35:43224) 2023-03-17T10:41:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 -- 172.21.15.35:0/3030125846 learned_addr learned my addr 172.21.15.35:0/3030125846 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 -- 172.21.15.35:0/3030125846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869f330 msgr2=0x562f786a2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869f330 0x562f786a2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 -- 172.21.15.35:0/3030125846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 msgr2=0x562f786a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 -- 172.21.15.35:0/3030125846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f7846e5d0 con 0x562f7869ea20 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.757+0000 7fe87ffff700 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 0x562f7869edf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e4e0 tx=0x7fe870014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2203b599bb00b10f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe8667fc700 1 -- 172.21.15.35:0/3030125846 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000ee00 con 0x562f7869ea20 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe8667fc700 1 -- 172.21.15.35:0/3030125846 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe870021070 con 0x562f7869ea20 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe8667fc700 1 -- 172.21.15.35:0/3030125846 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87001d650 con 0x562f7869ea20 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 -- 172.21.15.35:0/3030125846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 msgr2=0x562f7869edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 0x562f7869edf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e4e0 tx=0x7fe870014000 comp rx=0 tx=0).stop 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 -- 172.21.15.35:0/3030125846 shutdown_connections 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869ea20 0x562f7869edf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 --2- 172.21.15.35:0/3030125846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869f330 0x562f786a2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 -- 172.21.15.35:0/3030125846 >> 172.21.15.35:0/3030125846 conn(0x562f784f76b0 msgr2=0x562f78694a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 -- 172.21.15.35:0/3030125846 shutdown_connections 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.758+0000 7fe89275db80 1 -- 172.21.15.35:0/3030125846 wait complete. 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 -- start start 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 Processor -- start 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f784708c0 con 0x562f786a3170 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f786a8a80 con 0x562f7869ea20 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f786b4410 con 0x562f7869f330 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe89275db80 10 client.0 _ll_register_callbacks cb 0x562f78492230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe884b6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe87ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe87f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe87ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786aa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53260/0 (socket says 172.21.15.35:53260) 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.759+0000 7fe87ffff700 1 -- 172.21.15.35:0/266701373 learned_addr learned my addr 172.21.15.35:0/266701373 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe884b6d700 1 -- 172.21.15.35:0/266701373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 msgr2=0x562f786a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe884b6d700 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe884b6d700 1 -- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 msgr2=0x562f786aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe884b6d700 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786aa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe884b6d700 1 -- 172.21.15.35:0/266701373 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870017070 con 0x562f786a3170 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe87ffff700 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:41:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe884b6d700 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a8370 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fe878011e90 tx=0x7fe878014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111424ca3ea925c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe85f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe85f7fe700 1 -- 172.21.15.35:0/266701373 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800e040 con 0x562f786a3170 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe85f7fe700 1 -- 172.21.15.35:0/266701373 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe8780093a0 con 0x562f786a3170 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f785af390 con 0x562f786a3170 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe85f7fe700 1 -- 172.21.15.35:0/266701373 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe878004db0 con 0x562f786a3170 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe89275db80 10 client.19230 fetch_fsmap learned FSMap version 47 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.760+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x562f7841ad80 con 0x562f786a3170 2023-03-17T10:41:44.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe85f7fe700 1 -- 172.21.15.35:0/266701373 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f785af390 con 0x562f786a3170 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe85f7fe700 1 -- 172.21.15.35:0/266701373 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 47) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fe87801c030 con 0x562f786a3170 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe89275db80 10 client.19230 fetch_fsmap finished waiting for FSMap version 47 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe89275db80 10 client.19230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe89275db80 20 client.19230 populate_metadata read hostname 'smithi035' 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe89275db80 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f786b86c0 0x562f786baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe89275db80 4 client.19230 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f785bb600 con 0x562f786b86c0 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe87ffff700 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f786b86c0 0x562f786baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe85f7fe700 10 client.19230 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.761+0000 7fe87ffff700 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f786b86c0 0x562f786baad0 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a9d13bcb281d8ff server_cookie=bbc58ac95d22088b in_seq=0 out_seq=0 2023-03-17T10:41:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe85f7fe700 1 -- 172.21.15.35:0/266701373 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562f785bb600 con 0x562f786b86c0 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe85f7fe700 10 client.19230 handle_command_reply: tid=0 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 client.19230 shutdown 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 msgr2=0x562f786a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a8370 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fe878011e90 tx=0x7fe878014600 comp rx=0 tx=0).stop 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 shutdown_connections 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f786b86c0 0x562f786baad0 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786a8370 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe85f7fe700 0 client.19230 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 --2- 172.21.15.35:0/266701373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 >> 172.21.15.35:0/266701373 conn(0x562f784f76b0 msgr2=0x562f78699410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 shutdown_connections 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 1 -- 172.21.15.35:0/266701373 wait complete. 2023-03-17T10:41:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.762+0000 7fe89275db80 20 client.19230 trim_cache size 0 max 16384 2023-03-17T10:41:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 Processor -- start 2023-03-17T10:41:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 -- start start 2023-03-17T10:41:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786aa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f78691b60 con 0x562f786a3170 2023-03-17T10:41:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f786b5c50 con 0x562f7869ea20 2023-03-17T10:41:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe89275db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f786a86d0 con 0x562f7869f330 2023-03-17T10:41:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe884b6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe884b6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786aa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51476/0 (socket says 172.21.15.35:51476) 2023-03-17T10:41:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe884b6d700 1 -- 172.21.15.35:0/113072632 learned_addr learned my addr 172.21.15.35:0/113072632 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.780+0000 7fe87ffff700 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe87f7fe700 1 -- 172.21.15.35:0/113072632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 msgr2=0x562f786a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe87f7fe700 1 -- 172.21.15.35:0/113072632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 msgr2=0x562f786aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe87f7fe700 1 -- 172.21.15.35:0/113072632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f785b3130 con 0x562f7869f330 2023-03-17T10:41:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe884b6d700 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:41:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786af360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8740c8a30 tx=0x7fe874098860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2091447c4009e48c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe866ffd700 1 -- 172.21.15.35:0/113072632 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874097180 con 0x562f7869f330 2023-03-17T10:41:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe866ffd700 1 -- 172.21.15.35:0/113072632 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe874099040 con 0x562f7869f330 2023-03-17T10:41:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.781+0000 7fe866ffd700 1 -- 172.21.15.35:0/113072632 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740a0ab0 con 0x562f7869f330 2023-03-17T10:41:54.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 -- 172.21.15.35:0/113072632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 msgr2=0x562f786af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:41:54.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786af360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8740c8a30 tx=0x7fe874098860 comp rx=0 tx=0).stop 2023-03-17T10:41:54.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 -- 172.21.15.35:0/113072632 shutdown_connections 2023-03-17T10:41:54.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f786a3170 0x562f786aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 --2- 172.21.15.35:0/113072632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f7869f330 0x562f786af360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 -- 172.21.15.35:0/113072632 >> 172.21.15.35:0/113072632 conn(0x562f784f76b0 msgr2=0x562f786a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:41:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 -- 172.21.15.35:0/113072632 shutdown_connections 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 -- 172.21.15.35:0/113072632 wait complete. 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 -- start start 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.782+0000 7fe89275db80 1 Processor -- start 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 0x562f786ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f786a3170 0x562f7870b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7870ba60 con 0x562f7869f330 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7870bba0 con 0x562f7869ea20 2023-03-17T10:41:54.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7870bce0 con 0x562f786a3170 2023-03-17T10:41:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 10 client.0 _ll_register_callbacks cb 0x562f78492230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:41:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 0x562f786ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 0x562f786ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51480/0 (socket says 172.21.15.35:51480) 2023-03-17T10:41:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 -- 172.21.15.35:0/3818644907 learned_addr learned my addr 172.21.15.35:0/3818644907 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:41:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe884b6d700 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f786a3170 0x562f7870b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 -- 172.21.15.35:0/3818644907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f786a3170 msgr2=0x562f7870b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f786a3170 0x562f7870b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 -- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 msgr2=0x562f786ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 -- 172.21.15.35:0/3818644907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f7841ad80 con 0x562f7869f330 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe87f7fe700 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 0x562f786ada70 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe874098d20 tx=0x7fe8740a1080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33df791b5992ccf5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe85f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe85f7fe700 1 -- 172.21.15.35:0/3818644907 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740a0ab0 con 0x562f7869f330 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f7866a1e0 con 0x562f7869f330 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.783+0000 7fe85f7fe700 1 -- 172.21.15.35:0/3818644907 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(256..256 src has 1..256) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe8740a0c10 con 0x562f7869f330 2023-03-17T10:41:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe85f7fe700 1 -- 172.21.15.35:0/3818644907 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8740652f0 con 0x562f7869f330 2023-03-17T10:41:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 10 client.19236 fetch_fsmap learned FSMap version 47 2023-03-17T10:41:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7fe88010eea0 con 0x562f7869f330 2023-03-17T10:41:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe85f7fe700 1 -- 172.21.15.35:0/3818644907 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f7866a1e0 con 0x562f7869f330 2023-03-17T10:41:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe85f7fe700 1 -- 172.21.15.35:0/3818644907 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 47) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fe87409c050 con 0x562f7869f330 2023-03-17T10:41:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 10 client.19236 fetch_fsmap finished waiting for FSMap version 47 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 10 client.19236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 20 client.19236 populate_metadata read hostname 'smithi035' 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f7870d130 0x562f7870f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 4 client.19236 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562f78470f00 con 0x562f7870d130 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe87ffff700 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f7870d130 0x562f7870f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:41:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe85f7fe700 10 client.19236 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:41:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.784+0000 7fe87ffff700 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f7870d130 0x562f7870f540 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=874c6f8c392f38cb server_cookie=5be8c3682d485a95 in_seq=0 out_seq=0 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe85f7fe700 1 -- 172.21.15.35:0/3818644907 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562f78470f00 con 0x562f7870d130 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe85f7fe700 10 client.19236 handle_command_reply: tid=0 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 client.19236 shutdown 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 msgr2=0x562f786ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 0x562f786ada70 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fe874098d20 tx=0x7fe8740a1080 comp rx=0 tx=0).stop 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 shutdown_connections 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562f7870d130 0x562f7870f540 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f786a3170 0x562f7870b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562f7869ea20 0x562f786ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 --2- 172.21.15.35:0/3818644907 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562f7869f330 0x562f786ada70 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe85f7fe700 0 client.19236 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 >> 172.21.15.35:0/3818644907 conn(0x562f784f76b0 msgr2=0x562f786a12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 shutdown_connections 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 1 -- 172.21.15.35:0/3818644907 wait complete. 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.808+0000 7fe89275db80 20 client.19236 trim_cache size 0 max 16384 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe86809f640 msgr2=0x7fe8680a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe86809f640 0x7fe8680a1af0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe870009c60 tx=0x7fe870009260 comp rx=0 tx=0).stop 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 msgr2=0x7fe8801975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe8801975c0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fe8740098e0 tx=0x7fe87400f690 comp rx=0 tx=0).stop 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 shutdown_connections 2023-03-17T10:42:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe86809f640 0x7fe8680a1af0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe880104400 0x7fe8801a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8800ff3c0 0x7fe880197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 --2- 172.21.15.35:0/2151548271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe8800ffd60 0x7fe8801975c0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 >> 172.21.15.35:0/2151548271 conn(0x7fe880076300 msgr2=0x7fe8800fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 shutdown_connections 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:01.809+0000 7fe8865d0700 1 -- 172.21.15.35:0/2151548271 wait complete. 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 -- 172.21.15.35:0/491000101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 msgr2=0x7f1d900ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 --2- 172.21.15.35:0/491000101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 0x7f1d900ffce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009990 tx=0x7f1d84009ca0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 -- 172.21.15.35:0/491000101 shutdown_connections 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 --2- 172.21.15.35:0/491000101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d90100220 0x7f1d9010beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 --2- 172.21.15.35:0/491000101 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90104040 0x7f1d90104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 --2- 172.21.15.35:0/491000101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 0x7f1d900ffce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 -- 172.21.15.35:0/491000101 >> 172.21.15.35:0/491000101 conn(0x7f1d900757a0 msgr2=0x7f1d90075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 -- 172.21.15.35:0/491000101 shutdown_connections 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.929+0000 7f1d95724700 1 -- 172.21.15.35:0/491000101 wait complete. 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 Processor -- start 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 -- start start 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 0x7f1d90100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 0x7f1d90101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d90104040 0x7f1d901a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d90101ac0 con 0x7f1d90100220 2023-03-17T10:42:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901a49b0 con 0x7f1d900ff870 2023-03-17T10:42:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d95724700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901a4af0 con 0x7f1d90104040 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.930+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 0x7f1d90101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 0x7f1d90100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 0x7f1d90101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51504/0 (socket says 172.21.15.35:51504) 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/1113312335 learned_addr learned my addr 172.21.15.35:0/1113312335 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d90104040 0x7f1d901a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/1113312335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d90104040 msgr2=0x7f1d901a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d90104040 0x7f1d901a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/1113312335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 msgr2=0x7f1d90100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 0x7f1d90100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/1113312335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009520 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 0x7f1d90101290 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000c00 tx=0x7f1d8400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d77fff700 1 -- 172.21.15.35:0/1113312335 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8401d070 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d77fff700 1 -- 172.21.15.35:0/1113312335 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d84021410 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d840095f0 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d77fff700 1 -- 172.21.15.35:0/1113312335 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84017650 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.931+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9010f0f0 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.934+0000 7f1d77fff700 1 -- 172.21.15.35:0/1113312335 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1d84021580 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.934+0000 7f1d77fff700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d7809f640 0x7f1d780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1d8effd700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d7809f640 0x7f1d780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1d77fff700 1 -- 172.21.15.35:0/1113312335 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(258..258 src has 1..258) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1d840cb9d0 con 0x7f1d90100220 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1da18b1b80 1 Processor -- start 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1d8effd700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d7809f640 0x7f1d780a1af0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009d70 tx=0x7f1d80009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1da18b1b80 1 -- start start 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d74fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d6f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d6fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.935+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49c76010 con 0x557d49d74be0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49cc8950 con 0x557d49d6f960 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49cc1de0 con 0x557d49d754f0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d74fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d74fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51512/0 (socket says 172.21.15.35:51512) 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8effd700 1 -- 172.21.15.35:0/2966204461 learned_addr learned my addr 172.21.15.35:0/2966204461 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d6f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8f7fe700 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d6fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/2966204461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 msgr2=0x557d49d6fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d6fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/2966204461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 msgr2=0x557d49d74fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d74fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/2966204461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d49b435d0 con 0x557d49d754f0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d6f420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d840c9160 tx=0x7f1d84098e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6beca5e54cb106 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:04.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d757fa700 1 -- 172.21.15.35:0/2966204461 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a1670 con 0x557d49d754f0 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d757fa700 1 -- 172.21.15.35:0/2966204461 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d84095c20 con 0x557d49d754f0 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.936+0000 7f1d757fa700 1 -- 172.21.15.35:0/2966204461 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84098a00 con 0x557d49d754f0 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2966204461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 msgr2=0x557d49d6f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d6f420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d840c9160 tx=0x7f1d84098e70 comp rx=0 tx=0).stop 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2966204461 shutdown_connections 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d6fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d74fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2966204461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d6f420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2966204461 >> 172.21.15.35:0/2966204461 conn(0x557d49bcc6b0 msgr2=0x557d49d69a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2966204461 shutdown_connections 2023-03-17T10:42:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.937+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2966204461 wait complete. 2023-03-17T10:42:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 -- start start 2023-03-17T10:42:07.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 Processor -- start 2023-03-17T10:42:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d78610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:07.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d78b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49b458c0 con 0x557d49d6f960 2023-03-17T10:42:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49d79300 con 0x557d49d74be0 2023-03-17T10:42:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49d794c0 con 0x557d49d754f0 2023-03-17T10:42:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1da18b1b80 10 client.0 _ll_register_callbacks cb 0x557d49b67230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:42:09.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:09.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d78610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d78610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53316/0 (socket says 172.21.15.35:53316) 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51518/0 (socket says 172.21.15.35:51518) 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/249473269 learned_addr learned my addr 172.21.15.35:0/249473269 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8f7fe700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d78b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/249473269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 msgr2=0x557d49d78b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d78b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/249473269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 msgr2=0x557d49d7b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:11.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/249473269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9010f0f0 con 0x557d49d74be0 2023-03-17T10:42:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.938+0000 7f1d8effd700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:42:14.369 INFO:tasks.workunit.client.0.smithi035.stdout: 10 37862 8.24 MB/sec execute 127 sec latency 64.067 ms 2023-03-17T10:42:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:42:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:42:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:42:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:42:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d78610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d84005910 tx=0x7f1d84005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f3c21b12cba0b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d72ff5700 1 -- 172.21.15.35:0/249473269 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a16f0 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d72ff5700 1 -- 172.21.15.35:0/249473269 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(258..258 src has 1..258) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1d84098c10 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d49c84390 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d72ff5700 1 -- 172.21.15.35:0/249473269 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d840b7320 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 10 client.28409 fetch_fsmap learned FSMap version 47 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x557d49aefd80 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d72ff5700 1 -- 172.21.15.35:0/249473269 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d49c84390 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1d72ff5700 1 -- 172.21.15.35:0/249473269 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 47) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f1d840acd20 con 0x557d49d74be0 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 10 client.28409 fetch_fsmap finished waiting for FSMap version 47 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 10 client.28409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:42:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 20 client.28409 populate_metadata read hostname 'smithi035' 2023-03-17T10:42:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49d887d0 0x557d49d8abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 4 client.28409 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:42:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.939+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d49c90600 con 0x557d49d887d0 2023-03-17T10:42:18.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.940+0000 7f1d8effd700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49d887d0 0x557d49d8abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.940+0000 7f1d72ff5700 10 client.28409 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.940+0000 7f1d8effd700 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49d887d0 0x557d49d8abb0 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8cff5211691341 server_cookie=722d28b79ce568e7 in_seq=0 out_seq=0 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1d72ff5700 1 -- 172.21.15.35:0/249473269 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557d49c90600 con 0x557d49d887d0 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1d72ff5700 10 client.28409 handle_command_reply: tid=0 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 client.28409 shutdown 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 msgr2=0x557d49d78610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d78610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d84005910 tx=0x7f1d84005c70 comp rx=0 tx=0).stop 2023-03-17T10:42:18.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 shutdown_connections 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49d887d0 0x557d49d8abb0 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d78b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1d72ff5700 0 client.28409 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/249473269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d78610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 >> 172.21.15.35:0/249473269 conn(0x557d49bcc6b0 msgr2=0x557d49d6e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:18.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 shutdown_connections 2023-03-17T10:42:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 1 -- 172.21.15.35:0/249473269 wait complete. 2023-03-17T10:42:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.941+0000 7f1da18b1b80 20 client.28409 trim_cache size 0 max 16384 2023-03-17T10:42:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.956+0000 7f1da18b1b80 1 Processor -- start 2023-03-17T10:42:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 -- start start 2023-03-17T10:42:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d69ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d7fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d72650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49c84390 con 0x557d49d74be0 2023-03-17T10:42:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49c85050 con 0x557d49d6f960 2023-03-17T10:42:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49d650f0 con 0x557d49d754f0 2023-03-17T10:42:21.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d7fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d69ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d7fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51528/0 (socket says 172.21.15.35:51528) 2023-03-17T10:42:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/3402254590 learned_addr learned my addr 172.21.15.35:0/3402254590 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8f7fe700 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d72650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:21.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 -- 172.21.15.35:0/3402254590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 msgr2=0x557d49d72650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d72650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 -- 172.21.15.35:0/3402254590 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 msgr2=0x557d49d7fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d7fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 -- 172.21.15.35:0/3402254590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d49c88130 con 0x557d49d6f960 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d7fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.957+0000 7f1d8effd700 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d69ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x557d49d8b420 tx=0x7f1d80014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bdeb533651b0fcf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.958+0000 7f1d75ffb700 1 -- 172.21.15.35:0/3402254590 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80024040 con 0x557d49d6f960 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.958+0000 7f1d75ffb700 1 -- 172.21.15.35:0/3402254590 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d8000ee40 con 0x557d49d6f960 2023-03-17T10:42:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.958+0000 7f1d75ffb700 1 -- 172.21.15.35:0/3402254590 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800038e0 con 0x557d49d6f960 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.958+0000 7f1da18b1b80 1 -- 172.21.15.35:0/3402254590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 msgr2=0x557d49d69ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.958+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d69ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x557d49d8b420 tx=0x7f1d80014000 comp rx=0 tx=0).stop 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- 172.21.15.35:0/3402254590 shutdown_connections 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d72650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d6f960 0x557d49d69ac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/3402254590 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d74be0 0x557d49d7fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- 172.21.15.35:0/3402254590 >> 172.21.15.35:0/3402254590 conn(0x557d49bcc6b0 msgr2=0x557d49d737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- 172.21.15.35:0/3402254590 shutdown_connections 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- 172.21.15.35:0/3402254590 wait complete. 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- start start 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 Processor -- start 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d7e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49d802b0 con 0x557d49d6f960 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49d7e780 con 0x557d49d74be0 2023-03-17T10:42:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.959+0000 7f1da18b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d49d7e940 con 0x557d49d754f0 2023-03-17T10:42:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1da18b1b80 10 client.0 _ll_register_callbacks cb 0x557d49b67230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:42:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d7dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53330/0 (socket says 172.21.15.35:53330) 2023-03-17T10:42:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8e7fc700 1 -- 172.21.15.35:0/2384624793 learned_addr learned my addr 172.21.15.35:0/2384624793 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8f7fe700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d7e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 -- 172.21.15.35:0/2384624793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 msgr2=0x557d49d7e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d7e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 -- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 msgr2=0x557d49d7dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d7dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 -- 172.21.15.35:0/2384624793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9010f0f0 con 0x557d49d6f960 2023-03-17T10:42:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d7dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d8effd700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7f9e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005d90 tx=0x7f1d80004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b390acd6f2c964 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d72ff5700 1 -- 172.21.15.35:0/2384624793 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80024050 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1d72ff5700 1 -- 172.21.15.35:0/2384624793 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(258..258 src has 1..258) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1d80029940 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.960+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d49d3f1e0 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1d72ff5700 1 -- 172.21.15.35:0/2384624793 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d80029b00 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 10 client.19254 fetch_fsmap learned FSMap version 47 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f1d80017070 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1d72ff5700 1 -- 172.21.15.35:0/2384624793 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d49d3f1e0 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1d72ff5700 1 -- 172.21.15.35:0/2384624793 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 47) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f1d8001e420 con 0x557d49d6f960 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 10 client.19254 fetch_fsmap finished waiting for FSMap version 47 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 10 client.19254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 20 client.19254 populate_metadata read hostname 'smithi035' 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49ddd7e0 0x557d49ddfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 4 client.19254 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:42:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557d49b45f00 con 0x557d49ddd7e0 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49ddd7e0 0x557d49ddfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1d72ff5700 10 client.19254 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.961+0000 7f1d8e7fc700 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49ddd7e0 0x557d49ddfbf0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2abae4267cc655c2 server_cookie=d2e032ee2ee1eb97 in_seq=0 out_seq=0 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1d72ff5700 1 -- 172.21.15.35:0/2384624793 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557d49b45f00 con 0x557d49ddd7e0 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1d72ff5700 10 client.19254 handle_command_reply: tid=0 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 client.19254 shutdown 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 msgr2=0x557d49d7f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7f9e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005d90 tx=0x7f1d80004420 comp rx=0 tx=0).stop 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 shutdown_connections 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557d49ddd7e0 0x557d49ddfbf0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d49d754f0 0x557d49d7e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557d49d6f960 0x557d49d7f9e0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 --2- 172.21.15.35:0/2384624793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d49d74be0 0x557d49d7dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 >> 172.21.15.35:0/2384624793 conn(0x557d49bcc6b0 msgr2=0x557d49d72650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1d72ff5700 0 client.19254 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 shutdown_connections 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 1 -- 172.21.15.35:0/2384624793 wait complete. 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.981+0000 7f1da18b1b80 20 client.19254 trim_cache size 0 max 16384 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d7809f640 msgr2=0x7f1d780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d7809f640 0x7f1d780a1af0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009d70 tx=0x7f1d80009260 comp rx=0 tx=0).stop 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 msgr2=0x7f1d90101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 0x7f1d90101290 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000c00 tx=0x7f1d8400bfd0 comp rx=0 tx=0).stop 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 shutdown_connections 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1d7809f640 0x7f1d780a1af0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d90104040 0x7f1d901a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d900ff870 0x7f1d90100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 --2- 172.21.15.35:0/1113312335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1d90100220 0x7f1d90101290 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 >> 172.21.15.35:0/1113312335 conn(0x7f1d900757a0 msgr2=0x7f1d90102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 shutdown_connections 2023-03-17T10:42:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:15:14.982+0000 7f1d95724700 1 -- 172.21.15.35:0/1113312335 wait complete. 2023-03-17T10:42:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.385+0000 7f0f55a28700 1 -- 172.21.15.35:0/3466221968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f500ffcf0 msgr2=0x7f0f50103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.385+0000 7f0f55a28700 1 --2- 172.21.15.35:0/3466221968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f500ffcf0 0x7f0f50103cb0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f0f440099c0 tx=0x7f0f44009cd0 comp rx=0 tx=0).stop 2023-03-17T10:42:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.385+0000 7f0f55a28700 1 -- 172.21.15.35:0/3466221968 shutdown_connections 2023-03-17T10:42:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.385+0000 7f0f55a28700 1 --2- 172.21.15.35:0/3466221968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50104390 0x7f0f5010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.385+0000 7f0f55a28700 1 --2- 172.21.15.35:0/3466221968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.386+0000 7f0f55a28700 1 --2- 172.21.15.35:0/3466221968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f500ffcf0 0x7f0f50103cb0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.386+0000 7f0f55a28700 1 -- 172.21.15.35:0/3466221968 >> 172.21.15.35:0/3466221968 conn(0x7f0f50076330 msgr2=0x7f0f50076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.386+0000 7f0f55a28700 1 -- 172.21.15.35:0/3466221968 shutdown_connections 2023-03-17T10:42:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.386+0000 7f0f55a28700 1 -- 172.21.15.35:0/3466221968 wait complete. 2023-03-17T10:42:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.386+0000 7f0f55a28700 1 Processor -- start 2023-03-17T10:42:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 -- start start 2023-03-17T10:42:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f501970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f500ffcf0 0x7f0f50197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 0x7f0f501a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50197f40 con 0x7f0f50104390 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f501a2680 con 0x7f0f500ff350 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f55a28700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f501a2840 con 0x7f0f500ffcf0 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 0x7f0f501a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f501970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f501970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53378/0 (socket says 172.21.15.35:53378) 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 0x7f0f501a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51586/0 (socket says 172.21.15.35:51586) 2023-03-17T10:42:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 -- 172.21.15.35:0/755200521 learned_addr learned my addr 172.21.15.35:0/755200521 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:34.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f500ffcf0 0x7f0f50197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 -- 172.21.15.35:0/755200521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f500ffcf0 msgr2=0x7f0f50197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f500ffcf0 0x7f0f50197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 -- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 msgr2=0x7f0f501a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 0x7f0f501a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4effd700 1 -- 172.21.15.35:0/755200521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440095f0 con 0x7f0f500ff350 2023-03-17T10:42:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.387+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 0x7f0f501a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:42:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.388+0000 7f0f4effd700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f501970c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000e9a0 tx=0x7f0f4000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.388+0000 7f0f54a26700 1 -- 172.21.15.35:0/755200521 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40009790 con 0x7f0f500ff350 2023-03-17T10:42:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.388+0000 7f0f54a26700 1 -- 172.21.15.35:0/755200521 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f40010430 con 0x7f0f500ff350 2023-03-17T10:42:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.388+0000 7f0f54a26700 1 -- 172.21.15.35:0/755200521 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000cea0 con 0x7f0f500ff350 2023-03-17T10:42:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.388+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5010f010 con 0x7f0f500ff350 2023-03-17T10:42:42.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:40 smithi035 ceph-mon[92535]: pgmap v3428: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 193 op/s 2023-03-17T10:42:42.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:42 smithi035 ceph-mon[92535]: pgmap v3429: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 193 op/s 2023-03-17T10:42:42.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:44 smithi035 ceph-mon[92535]: pgmap v3430: 97 pgs: 97 active+clean; 724 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 307 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:46 smithi035 ceph-mon[92535]: pgmap v3431: 97 pgs: 97 active+clean; 724 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:47 smithi035 ceph-mon[92535]: pgmap v3432: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.3 MiB/s wr, 318 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:50 smithi035 ceph-mon[92535]: pgmap v3433: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 225 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:52 smithi035 ceph-mon[92535]: pgmap v3434: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 225 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:54 smithi035 ceph-mon[92535]: pgmap v3435: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 351 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:56 smithi035 ceph-mon[92535]: pgmap v3436: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 237 op/s 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:42:42.997 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:57 smithi035 ceph-mon[92535]: pgmap v3437: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 241 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:57 smithi035 ceph-mon[92535]: pgmap v3438: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 1.9 MiB/s wr, 155 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:30:59 smithi035 ceph-mon[92535]: pgmap v3439: 97 pgs: 97 active+clean; 738 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 275 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:01 smithi035 ceph-mon[92535]: pgmap v3440: 97 pgs: 97 active+clean; 738 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 275 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:03 smithi035 ceph-mon[92535]: pgmap v3441: 97 pgs: 97 active+clean; 758 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.7 MiB/s wr, 243 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:04 smithi035 ceph-mon[92535]: osdmap e289: 12 total, 12 up, 12 in 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:05 smithi035 ceph-mon[92535]: pgmap v3443: 97 pgs: 97 active+clean; 758 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 298 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:07 smithi035 ceph-mon[92535]: pgmap v3444: 97 pgs: 97 active+clean; 767 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 300 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:09 smithi035 ceph-mon[92535]: pgmap v3445: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 252 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:11 smithi035 ceph-mon[92535]: pgmap v3446: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 252 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:11 smithi035 ceph-mon[92535]: osdmap e290: 12 total, 12 up, 12 in 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:13 smithi035 ceph-mon[92535]: pgmap v3448: 97 pgs: 97 active+clean; 785 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 289 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:15 smithi035 ceph-mon[92535]: pgmap v3449: 97 pgs: 97 active+clean; 785 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 259 op/s 2023-03-17T10:42:42.998 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:17 smithi035 ceph-mon[92535]: pgmap v3450: 97 pgs: 97 active+clean; 791 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 280 op/s 2023-03-17T10:42:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:19 smithi035 ceph-mon[92535]: pgmap v3451: 97 pgs: 97 active+clean; 792 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 247 op/s 2023-03-17T10:42:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:21 smithi035 ceph-mon[92535]: pgmap v3452: 97 pgs: 97 active+clean; 792 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 247 op/s 2023-03-17T10:42:42.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:23 smithi035 ceph-mon[92535]: pgmap v3453: 97 pgs: 97 active+clean; 808 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 313 op/s 2023-03-17T10:42:44.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:25 smithi035 ceph-mon[92535]: pgmap v3454: 97 pgs: 97 active+clean; 808 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 188 op/s 2023-03-17T10:42:44.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:27 smithi035 ceph-mon[92535]: pgmap v3455: 97 pgs: 97 active+clean; 822 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 252 op/s 2023-03-17T10:42:44.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:29 smithi035 ceph-mon[92535]: pgmap v3456: 97 pgs: 97 active+clean; 827 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 215 op/s 2023-03-17T10:42:44.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:31 smithi035 ceph-mon[92535]: pgmap v3457: 97 pgs: 97 active+clean; 827 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2023-03-17T10:42:44.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:33 smithi035 ceph-mon[92535]: pgmap v3458: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.0 MiB/s wr, 297 op/s 2023-03-17T10:42:45.620 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:35 smithi035 ceph-mon[92535]: pgmap v3459: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 208 op/s 2023-03-17T10:42:45.620 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:37 smithi035 ceph-mon[92535]: pgmap v3460: 97 pgs: 97 active+clean; 828 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 287 op/s 2023-03-17T10:42:45.620 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:39 smithi035 ceph-mon[92535]: pgmap v3461: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 257 op/s 2023-03-17T10:42:45.620 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:41 smithi035 ceph-mon[92535]: pgmap v3462: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 224 op/s 2023-03-17T10:42:45.620 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:43 smithi035 ceph-mon[92535]: pgmap v3463: 97 pgs: 97 active+clean; 841 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 324 op/s 2023-03-17T10:42:46.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:45 smithi035 ceph-mon[92535]: pgmap v3464: 97 pgs: 97 active+clean; 841 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 211 op/s 2023-03-17T10:42:46.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:47 smithi035 ceph-mon[92535]: pgmap v3465: 97 pgs: 97 active+clean; 851 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 268 op/s 2023-03-17T10:42:46.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:49 smithi035 ceph-mon[92535]: pgmap v3466: 97 pgs: 97 active+clean; 855 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 218 op/s 2023-03-17T10:42:46.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:51 smithi035 ceph-mon[92535]: pgmap v3467: 97 pgs: 97 active+clean; 855 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 185 op/s 2023-03-17T10:42:46.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:53 smithi035 ceph-mon[92535]: pgmap v3468: 97 pgs: 97 active+clean; 870 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 283 op/s 2023-03-17T10:42:46.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:55 smithi035 ceph-mon[92535]: pgmap v3469: 97 pgs: 97 active+clean; 870 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 183 op/s 2023-03-17T10:42:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:42:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:42:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:42:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:42:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.388+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5010ee80 con 0x7f0f500ff350 2023-03-17T10:42:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.390+0000 7f0f54a26700 1 -- 172.21.15.35:0/755200521 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f0f400105a0 con 0x7f0f500ff350 2023-03-17T10:42:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.391+0000 7f0f54a26700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f3809f6c0 0x7f0f380a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.391+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f3809f6c0 0x7f0f380a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.391+0000 7f0f54a26700 1 -- 172.21.15.35:0/755200521 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(260..260 src has 1..260) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0f40014070 con 0x7f0f500ff350 2023-03-17T10:42:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f3809f6c0 0x7f0f380a1b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009990 tx=0x7f0f4401e040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 Processor -- start 2023-03-17T10:42:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 -- start start 2023-03-17T10:42:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b171fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:50.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b1724f0 0x56535b16c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b16cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b073010 con 0x56535b16c960 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b0c5950 con 0x56535b171be0 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b0bede0 con 0x56535b1724f0 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b16cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b16cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51594/0 (socket says 172.21.15.35:51594) 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/2830838705 learned_addr learned my addr 172.21.15.35:0/2830838705 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.392+0000 7f0f4effd700 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b171fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:50.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b1724f0 0x56535b16c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/2830838705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b1724f0 msgr2=0x56535b16c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b1724f0 0x56535b16c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/2830838705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 msgr2=0x56535b171fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b171fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/2830838705 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56535af405d0 con 0x56535b16c960 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b16cd90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003eb0 tx=0x7f0f48009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e4041099fe54be server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f35ffb700 1 -- 172.21.15.35:0/2830838705 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480092d0 con 0x56535b16c960 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f35ffb700 1 -- 172.21.15.35:0/2830838705 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f4800f040 con 0x56535b16c960 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.393+0000 7f0f35ffb700 1 -- 172.21.15.35:0/2830838705 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800e750 con 0x56535b16c960 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/2830838705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 msgr2=0x56535b16cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b16cd90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003eb0 tx=0x7f0f48009920 comp rx=0 tx=0).stop 2023-03-17T10:42:52.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/2830838705 shutdown_connections 2023-03-17T10:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b16cd90 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b171fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/2830838705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b1724f0 0x56535b16c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/2830838705 >> 172.21.15.35:0/2830838705 conn(0x56535afc96b0 msgr2=0x56535b166a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/2830838705 shutdown_connections 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/2830838705 wait complete. 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.394+0000 7f0f61bb5b80 1 -- start start 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 Processor -- start 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b1783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b171be0 0x56535b175670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b1724f0 0x56535b175c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535af428c0 con 0x56535b16c960 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b176410 con 0x56535b1724f0 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b182030 con 0x56535b171be0 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f61bb5b80 10 client.0 _ll_register_callbacks cb 0x56535af64230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b1783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b1783f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51596/0 (socket says 172.21.15.35:51596) 2023-03-17T10:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 -- 172.21.15.35:0/1580910176 learned_addr learned my addr 172.21.15.35:0/1580910176 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b171be0 0x56535b175670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b1724f0 0x56535b175c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:54.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 -- 172.21.15.35:0/1580910176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b171be0 msgr2=0x56535b175670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b171be0 0x56535b175670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 -- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b1724f0 msgr2=0x56535b175c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b1724f0 0x56535b175c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 -- 172.21.15.35:0/1580910176 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f48003b90 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f4effd700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b1783f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f0f400982e0 tx=0x7f0f40010930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc39fc8ad5019391 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.395+0000 7f0f2effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f2effd700 1 -- 172.21.15.35:0/1580910176 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4009c160 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f2effd700 1 -- 172.21.15.35:0/1580910176 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(260..260 src has 1..260) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0f400a0540 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56535b081390 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f2effd700 1 -- 172.21.15.35:0/1580910176 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f400a00b0 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 10 client.19266 fetch_fsmap learned FSMap version 49 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x56535aeecd80 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f2effd700 1 -- 172.21.15.35:0/1580910176 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56535b081390 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f2effd700 1 -- 172.21.15.35:0/1580910176 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 49) v1 ==== 6921+0+0 (secure 0 0 0) 0x7f0f400c6c80 con 0x56535b16c960 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 10 client.19266 fetch_fsmap finished waiting for FSMap version 49 2023-03-17T10:42:54.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 10 client.19266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:42:54.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 20 client.19266 populate_metadata read hostname 'smithi035' 2023-03-17T10:42:54.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1860e0 0x56535b1884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:54.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 4 client.19266 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56535b08d600 con 0x56535b1860e0 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.396+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1860e0 0x56535b1884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.397+0000 7f0f2effd700 10 client.19266 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.397+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1860e0 0x56535b1884c0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a68d871a911f83b server_cookie=5721979b604bc56c in_seq=0 out_seq=0 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.397+0000 7f0f2effd700 1 -- 172.21.15.35:0/1580910176 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56535b08d600 con 0x56535b1860e0 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.397+0000 7f0f2effd700 10 client.19266 handle_command_reply: tid=0 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.397+0000 7f0f61bb5b80 1 client.19266 shutdown 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 msgr2=0x56535b1783f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:42:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b1783f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f0f400982e0 tx=0x7f0f40010930 comp rx=0 tx=0).stop 2023-03-17T10:42:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 shutdown_connections 2023-03-17T10:42:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1860e0 0x56535b1884c0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b1724f0 0x56535b175c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f2effd700 0 client.19266 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:42:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b16c960 0x56535b1783f0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1580910176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b171be0 0x56535b175670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:42:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 >> 172.21.15.35:0/1580910176 conn(0x56535afc96b0 msgr2=0x56535b166a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:42:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 shutdown_connections 2023-03-17T10:42:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1580910176 wait complete. 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.398+0000 7f0f61bb5b80 20 client.19266 trim_cache size 0 max 16384 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 Processor -- start 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 -- start start 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b17cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b1730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b1620f0 con 0x56535b1724f0 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b176230 con 0x56535b171be0 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b171fb0 con 0x56535b16c960 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b1730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b1730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51608/0 (socket says 172.21.15.35:51608) 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.413+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/209248209 learned_addr learned my addr 172.21.15.35:0/209248209 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:42:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b17cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4effd700 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/209248209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 msgr2=0x56535b166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/209248209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 msgr2=0x56535b17cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b17cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/209248209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56535b085130 con 0x56535b1724f0 2023-03-17T10:43:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b1730a0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003e80 tx=0x7f0f48006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2efa180d8ec7706 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f367fc700 1 -- 172.21.15.35:0/209248209 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480093d0 con 0x56535b1724f0 2023-03-17T10:43:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f367fc700 1 -- 172.21.15.35:0/209248209 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f48007500 con 0x56535b1724f0 2023-03-17T10:43:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.414+0000 7f0f367fc700 1 -- 172.21.15.35:0/209248209 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800e750 con 0x56535b1724f0 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/209248209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 msgr2=0x56535b1730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b1730a0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003e80 tx=0x7f0f48006000 comp rx=0 tx=0).stop 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/209248209 shutdown_connections 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b1730a0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/209248209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b17cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/209248209 >> 172.21.15.35:0/209248209 conn(0x56535afc96b0 msgr2=0x56535b172990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/209248209 shutdown_connections 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/209248209 wait complete. 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.415+0000 7f0f61bb5b80 1 -- start start 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 Processor -- start 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b17cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b16d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b16ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b16e4a0 con 0x56535b1724f0 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b16e610 con 0x56535b171be0 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535b1d9f50 con 0x56535b16c960 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f61bb5b80 10 client.0 _ll_register_callbacks cb 0x56535af64230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b16ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b16ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51614/0 (socket says 172.21.15.35:51614) 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/1769795898 learned_addr learned my addr 172.21.15.35:0/1769795898 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4effd700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b17cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4e7fc700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b16d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/1769795898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 msgr2=0x56535b17cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b17cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 msgr2=0x56535b16d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b16d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.416+0000 7f0f4f7fe700 1 -- 172.21.15.35:0/1769795898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56535af405d0 con 0x56535b1724f0 2023-03-17T10:43:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f4f7fe700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b16ddc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003f10 tx=0x7f0f48009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170d72500b62546c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:02.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f2effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f2effd700 1 -- 172.21.15.35:0/1769795898 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48004c90 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f2effd700 1 -- 172.21.15.35:0/1769795898 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(260..260 src has 1..260) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0f48004df0 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56535b13c1e0 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f2effd700 1 -- 172.21.15.35:0/1769795898 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f4800e4f0 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 10 client.19272 fetch_fsmap learned FSMap version 49 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x56535af131f0 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f2effd700 1 -- 172.21.15.35:0/1769795898 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56535b13c1e0 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f2effd700 1 -- 172.21.15.35:0/1769795898 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 49) v1 ==== 6921+0+0 (secure 0 0 0) 0x7f0f480155e0 con 0x56535b1724f0 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 10 client.19272 fetch_fsmap finished waiting for FSMap version 49 2023-03-17T10:43:02.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 10 client.19272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 20 client.19272 populate_metadata read hostname 'smithi035' 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1db0f0 0x56535b1dd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 4 client.19272 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.417+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56535af42f00 con 0x56535b1db0f0 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.418+0000 7f0f4effd700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1db0f0 0x56535b1dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.418+0000 7f0f2effd700 10 client.19272 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.418+0000 7f0f4effd700 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1db0f0 0x56535b1dd500 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad4e6c073a30892 server_cookie=20c40fe6ccd03109 in_seq=0 out_seq=0 2023-03-17T10:43:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f2effd700 1 -- 172.21.15.35:0/1769795898 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56535af42f00 con 0x56535b1db0f0 2023-03-17T10:43:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f2effd700 10 client.19272 handle_command_reply: tid=0 2023-03-17T10:43:04.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 client.19272 shutdown 2023-03-17T10:43:04.414 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38006 8.23 MB/sec execute 128 sec latency 83.575 ms 2023-03-17T10:43:05.699 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38153 8.21 MB/sec execute 129 sec latency 79.174 ms 2023-03-17T10:43:05.699 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38281 8.19 MB/sec execute 130 sec latency 61.502 ms 2023-03-17T10:43:05.699 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38433 8.17 MB/sec execute 131 sec latency 79.455 ms 2023-03-17T10:43:05.700 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38610 8.21 MB/sec execute 132 sec latency 70.953 ms 2023-03-17T10:43:07.827 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38753 8.21 MB/sec execute 133 sec latency 65.541 ms 2023-03-17T10:43:07.827 INFO:tasks.workunit.client.0.smithi035.stdout: 10 38894 8.23 MB/sec execute 134 sec latency 83.687 ms 2023-03-17T10:43:07.827 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39033 8.22 MB/sec execute 135 sec latency 67.504 ms 2023-03-17T10:43:08.653 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39164 8.20 MB/sec execute 136 sec latency 65.625 ms 2023-03-17T10:43:08.654 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39306 8.15 MB/sec execute 137 sec latency 72.398 ms 2023-03-17T10:43:08.654 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39457 8.11 MB/sec execute 138 sec latency 63.311 ms 2023-03-17T10:43:08.654 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39597 8.07 MB/sec execute 139 sec latency 71.215 ms 2023-03-17T10:43:08.654 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39755 8.06 MB/sec execute 140 sec latency 67.719 ms 2023-03-17T10:43:08.654 INFO:tasks.workunit.client.0.smithi035.stdout: 10 39903 8.07 MB/sec execute 141 sec latency 93.202 ms 2023-03-17T10:43:08.654 INFO:tasks.workunit.client.0.smithi035.stdout: 10 40060 8.10 MB/sec execute 142 sec latency 64.332 ms 2023-03-17T10:43:09.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 40227 8.11 MB/sec execute 143 sec latency 67.865 ms 2023-03-17T10:43:09.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 40436 8.17 MB/sec execute 144 sec latency 85.023 ms 2023-03-17T10:43:09.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 40598 8.18 MB/sec execute 145 sec latency 67.110 ms 2023-03-17T10:43:09.257 INFO:tasks.workunit.client.0.smithi035.stdout: 10 40749 8.16 MB/sec execute 146 sec latency 82.671 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 40883 8.17 MB/sec execute 147 sec latency 84.682 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41012 8.16 MB/sec execute 148 sec latency 63.089 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41168 8.20 MB/sec execute 149 sec latency 68.088 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41323 8.21 MB/sec execute 150 sec latency 95.990 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41487 8.23 MB/sec execute 151 sec latency 62.712 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41628 8.21 MB/sec execute 152 sec latency 65.596 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41742 8.19 MB/sec execute 153 sec latency 86.005 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 41875 8.18 MB/sec execute 154 sec latency 91.295 ms 2023-03-17T10:43:09.863 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42043 8.20 MB/sec execute 155 sec latency 81.158 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42183 8.20 MB/sec execute 156 sec latency 69.738 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42312 8.19 MB/sec execute 157 sec latency 84.448 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42451 8.19 MB/sec execute 158 sec latency 68.289 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42588 8.19 MB/sec execute 159 sec latency 102.744 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42705 8.14 MB/sec execute 160 sec latency 138.768 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42840 8.11 MB/sec execute 161 sec latency 83.296 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 42991 8.09 MB/sec execute 162 sec latency 73.337 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 43136 8.07 MB/sec execute 163 sec latency 62.340 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 43286 8.06 MB/sec execute 164 sec latency 81.473 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 43432 8.07 MB/sec execute 165 sec latency 119.289 ms 2023-03-17T10:43:10.497 INFO:tasks.workunit.client.0.smithi035.stdout: 10 43578 8.07 MB/sec execute 166 sec latency 119.401 ms 2023-03-17T10:43:11.982 INFO:tasks.workunit.client.0.smithi035.stdout: 10 43758 8.08 MB/sec execute 167 sec latency 64.340 ms 2023-03-17T10:43:11.982 INFO:tasks.workunit.client.0.smithi035.stdout: 10 43952 8.13 MB/sec execute 168 sec latency 70.252 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 44111 8.12 MB/sec execute 169 sec latency 110.020 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 44263 8.12 MB/sec execute 170 sec latency 102.073 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 44390 8.11 MB/sec execute 171 sec latency 82.391 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 44539 8.14 MB/sec execute 172 sec latency 67.788 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 44699 8.16 MB/sec execute 173 sec latency 66.148 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 44868 8.17 MB/sec execute 174 sec latency 139.842 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45034 8.18 MB/sec execute 175 sec latency 62.210 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45161 8.16 MB/sec execute 176 sec latency 73.365 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45283 8.16 MB/sec execute 177 sec latency 69.614 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45434 8.15 MB/sec execute 178 sec latency 69.535 ms 2023-03-17T10:43:11.983 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45615 8.18 MB/sec execute 179 sec latency 95.505 ms 2023-03-17T10:43:13.827 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45751 8.18 MB/sec execute 180 sec latency 68.505 ms 2023-03-17T10:43:13.827 INFO:tasks.workunit.client.0.smithi035.stdout: 10 45874 8.16 MB/sec execute 181 sec latency 85.263 ms 2023-03-17T10:43:13.827 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46019 8.17 MB/sec execute 182 sec latency 61.499 ms 2023-03-17T10:43:14.539 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46151 8.15 MB/sec execute 183 sec latency 71.656 ms 2023-03-17T10:43:14.539 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46282 8.12 MB/sec execute 184 sec latency 76.463 ms 2023-03-17T10:43:14.539 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46421 8.09 MB/sec execute 185 sec latency 107.763 ms 2023-03-17T10:43:15.371 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46565 8.07 MB/sec execute 186 sec latency 73.147 ms 2023-03-17T10:43:15.371 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46710 8.06 MB/sec execute 187 sec latency 75.053 ms 2023-03-17T10:43:15.372 INFO:tasks.workunit.client.0.smithi035.stdout: 10 46860 8.06 MB/sec execute 188 sec latency 75.724 ms 2023-03-17T10:43:15.372 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47020 8.07 MB/sec execute 189 sec latency 69.477 ms 2023-03-17T10:43:15.372 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47196 8.10 MB/sec execute 190 sec latency 70.254 ms 2023-03-17T10:43:18.072 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47351 8.09 MB/sec execute 191 sec latency 74.715 ms 2023-03-17T10:43:18.072 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47529 8.12 MB/sec execute 192 sec latency 72.179 ms 2023-03-17T10:43:18.072 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47687 8.12 MB/sec execute 193 sec latency 63.554 ms 2023-03-17T10:43:18.072 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47822 8.11 MB/sec execute 194 sec latency 70.122 ms 2023-03-17T10:43:18.073 INFO:tasks.workunit.client.0.smithi035.stdout: 10 47959 8.11 MB/sec execute 195 sec latency 76.134 ms 2023-03-17T10:43:18.073 INFO:tasks.workunit.client.0.smithi035.stdout: 10 48103 8.12 MB/sec execute 196 sec latency 117.834 ms 2023-03-17T10:43:18.073 INFO:tasks.workunit.client.0.smithi035.stdout: 10 48254 8.13 MB/sec execute 197 sec latency 68.955 ms 2023-03-17T10:43:18.073 INFO:tasks.workunit.client.0.smithi035.stdout: 10 48419 8.14 MB/sec execute 198 sec latency 68.160 ms 2023-03-17T10:43:18.073 INFO:tasks.workunit.client.0.smithi035.stdout: 10 48561 8.13 MB/sec execute 199 sec latency 315.869 ms 2023-03-17T10:43:20.451 INFO:tasks.workunit.client.0.smithi035.stdout: 10 48698 8.12 MB/sec execute 200 sec latency 709.119 ms 2023-03-17T10:43:20.451 INFO:tasks.workunit.client.0.smithi035.stdout: 10 48853 8.14 MB/sec execute 201 sec latency 66.821 ms 2023-03-17T10:43:20.451 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49025 8.15 MB/sec execute 202 sec latency 73.498 ms 2023-03-17T10:43:20.451 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49165 8.16 MB/sec execute 203 sec latency 81.138 ms 2023-03-17T10:43:20.451 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49284 8.15 MB/sec execute 204 sec latency 69.328 ms 2023-03-17T10:43:20.452 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49404 8.13 MB/sec execute 205 sec latency 70.609 ms 2023-03-17T10:43:20.452 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49554 8.14 MB/sec execute 206 sec latency 78.421 ms 2023-03-17T10:43:20.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 msgr2=0x56535b16ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b16ddc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003f10 tx=0x7f0f48009910 comp rx=0 tx=0).stop 2023-03-17T10:43:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 shutdown_connections 2023-03-17T10:43:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56535b1db0f0 0x56535b1dd500 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56535b1724f0 0x56535b16ddc0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56535b16c960 0x56535b17cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f2effd700 0 client.19272 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 --2- 172.21.15.35:0/1769795898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56535b171be0 0x56535b16d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 >> 172.21.15.35:0/1769795898 conn(0x56535afc96b0 msgr2=0x56535b173150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 shutdown_connections 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.442+0000 7f0f61bb5b80 1 -- 172.21.15.35:0/1769795898 wait complete. 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.443+0000 7f0f61bb5b80 20 client.19272 trim_cache size 0 max 16384 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.443+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f3809f6c0 msgr2=0x7f0f380a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.443+0000 7f0f55a28700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f3809f6c0 0x7f0f380a1b70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009990 tx=0x7f0f4401e040 comp rx=0 tx=0).stop 2023-03-17T10:43:25.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.443+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 msgr2=0x7f0f501970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.443+0000 7f0f55a28700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f501970c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000e9a0 tx=0x7f0f4000ecb0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 shutdown_connections 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f3809f6c0 0x7f0f380a1b70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f50104390 0x7f0f501a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f500ff350 0x7f0f501970c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 --2- 172.21.15.35:0/755200521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f500ffcf0 0x7f0f50197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 >> 172.21.15.35:0/755200521 conn(0x7f0f50076330 msgr2=0x7f0f500fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:25.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 shutdown_connections 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:16:59.444+0000 7f0f55a28700 1 -- 172.21.15.35:0/755200521 wait complete. 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.564+0000 7f5583096700 1 -- 172.21.15.35:0/1393588693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 msgr2=0x7f557c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.564+0000 7f5583096700 1 --2- 172.21.15.35:0/1393588693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c0ff720 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f55700099c0 tx=0x7f5570009cd0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- 172.21.15.35:0/1393588693 shutdown_connections 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 --2- 172.21.15.35:0/1393588693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 0x7f557c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 --2- 172.21.15.35:0/1393588693 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c0ff720 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 --2- 172.21.15.35:0/1393588693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- 172.21.15.35:0/1393588693 >> 172.21.15.35:0/1393588693 conn(0x7f557c076330 msgr2=0x7f557c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- 172.21.15.35:0/1393588693 shutdown_connections 2023-03-17T10:43:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- 172.21.15.35:0/1393588693 wait complete. 2023-03-17T10:43:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 Processor -- start 2023-03-17T10:43:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- start start 2023-03-17T10:43:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c1975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 0x7f557c1a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c197f00 con 0x7f557c0ff350 2023-03-17T10:43:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1a2640 con 0x7f557c104390 2023-03-17T10:43:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.565+0000 7f5583096700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1a2800 con 0x7f557c0ffcf0 2023-03-17T10:43:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51624/0 (socket says 172.21.15.35:51624) 2023-03-17T10:43:29.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f557bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c1975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 -- 172.21.15.35:0/1296207471 learned_addr learned my addr 172.21.15.35:0/1296207471 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5581633700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 0x7f557c1a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:29.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 -- 172.21.15.35:0/1296207471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 msgr2=0x7f557c1975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c1975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 -- 172.21.15.35:0/1296207471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 msgr2=0x7f557c1a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 0x7f557c1a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 -- 172.21.15.35:0/1296207471 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700095f0 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f557bfff700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c1975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5580e32700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c197080 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f5570005910 tx=0x7f5570009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5579ffb700 1 -- 172.21.15.35:0/1296207471 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557001d070 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5579ffb700 1 -- 172.21.15.35:0/1296207471 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5570022470 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5579ffb700 1 -- 172.21.15.35:0/1296207471 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570017650 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.566+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c10f000 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.567+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c10ee70 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.569+0000 7f5579ffb700 1 -- 172.21.15.35:0/1296207471 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f55700225e0 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.570+0000 7f5579ffb700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556c09f640 0x7f556c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.570+0000 7f5579ffb700 1 -- 172.21.15.35:0/1296207471 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f55700cb620 con 0x7f557c0ff350 2023-03-17T10:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.570+0000 7f557bfff700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556c09f640 0x7f556c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.570+0000 7f557bfff700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556c09f640 0x7f556c0a1af0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f557c0688b0 tx=0x7f5568009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 Processor -- start 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 -- start start 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9d9ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9da04f0 0x559af9d9a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9d9a960 0x559af9d9ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9ca1010 con 0x559af9d9a960 2023-03-17T10:43:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9cf3950 con 0x559af9d9fbe0 2023-03-17T10:43:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f558f223b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9cecde0 con 0x559af9da04f0 2023-03-17T10:43:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9d9a960 0x559af9d9ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f5580e32700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9d9ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f5580e32700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9d9ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53428/0 (socket says 172.21.15.35:53428) 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f5580e32700 1 -- 172.21.15.35:0/1313284399 learned_addr learned my addr 172.21.15.35:0/1313284399 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.571+0000 7f557bfff700 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9da04f0 0x559af9d9a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5580e32700 1 -- 172.21.15.35:0/1313284399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9da04f0 msgr2=0x559af9d9a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5580e32700 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9da04f0 0x559af9d9a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5580e32700 1 -- 172.21.15.35:0/1313284399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9d9a960 msgr2=0x559af9d9ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5580e32700 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9d9a960 0x559af9d9ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5580e32700 1 -- 172.21.15.35:0/1313284399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559af9b6e5d0 con 0x559af9d9fbe0 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5580e32700 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9d9ffb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55700a0d90 tx=0x7f5570022f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b665d590d5bbb733 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5566ffd700 1 -- 172.21.15.35:0/1313284399 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570099160 con 0x559af9d9fbe0 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5566ffd700 1 -- 172.21.15.35:0/1313284399 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55700a12c0 con 0x559af9d9fbe0 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.572+0000 7f5566ffd700 1 -- 172.21.15.35:0/1313284399 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570098650 con 0x559af9d9fbe0 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 -- 172.21.15.35:0/1313284399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 msgr2=0x559af9d9ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9d9ffb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55700a0d90 tx=0x7f5570022f90 comp rx=0 tx=0).stop 2023-03-17T10:43:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 -- 172.21.15.35:0/1313284399 shutdown_connections 2023-03-17T10:43:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9d9a960 0x559af9d9ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9d9ffb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 --2- 172.21.15.35:0/1313284399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9da04f0 0x559af9d9a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 -- 172.21.15.35:0/1313284399 >> 172.21.15.35:0/1313284399 conn(0x559af9bf76b0 msgr2=0x559af9d94a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 -- 172.21.15.35:0/1313284399 shutdown_connections 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 -- 172.21.15.35:0/1313284399 wait complete. 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 -- start start 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.573+0000 7f558f223b80 1 Processor -- start 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9da64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9da3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9b708c0 con 0x559af9da04f0 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9da4530 con 0x559af9d9fbe0 2023-03-17T10:43:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9dafcf0 con 0x559af9d9a960 2023-03-17T10:43:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f558f223b80 10 client.0 _ll_register_callbacks cb 0x559af9b92230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:43:36.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5580e32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9da64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9da3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9da3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51642/0 (socket says 172.21.15.35:51642) 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5580e32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9da64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43404/0 (socket says 172.21.15.35:43404) 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5581633700 1 -- 172.21.15.35:0/1946637320 learned_addr learned my addr 172.21.15.35:0/1946637320 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f557bfff700 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5580e32700 1 -- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 msgr2=0x559af9da3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5580e32700 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5580e32700 1 -- 172.21.15.35:0/1946637320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 msgr2=0x559af9da3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.574+0000 7f5580e32700 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9da3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f5580e32700 1 -- 172.21.15.35:0/1946637320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c10ee70 con 0x559af9d9a960 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f5580e32700 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9da64a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55700997c0 tx=0x7f5570099650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65a7f2c153c69f4e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f555bfff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:43:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f555bfff700 1 -- 172.21.15.35:0/1946637320 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700a12c0 con 0x559af9d9a960 2023-03-17T10:43:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559af9caf390 con 0x559af9d9a960 2023-03-17T10:43:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f555bfff700 1 -- 172.21.15.35:0/1946637320 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f557009e040 con 0x559af9d9a960 2023-03-17T10:43:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f555bfff700 1 -- 172.21.15.35:0/1946637320 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55700b1470 con 0x559af9d9a960 2023-03-17T10:43:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 10 client.28429 fetch_fsmap learned FSMap version 49 2023-03-17T10:43:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x559af9b1ad80 con 0x559af9d9a960 2023-03-17T10:43:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f555bfff700 1 -- 172.21.15.35:0/1946637320 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5570065030 con 0x559af9d9a960 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f555bfff700 1 -- 172.21.15.35:0/1946637320 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 49) v1 ==== 6921+0+0 (secure 0 0 0) 0x7f55700980c0 con 0x559af9d9a960 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 10 client.28429 fetch_fsmap finished waiting for FSMap version 49 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 10 client.28429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 20 client.28429 populate_metadata read hostname 'smithi035' 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.575+0000 7f558f223b80 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9db39c0 0x559af9db5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.576+0000 7f558f223b80 4 client.28429 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.576+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559af9cbb600 con 0x559af9db39c0 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.576+0000 7f557bfff700 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9db39c0 0x559af9db5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.576+0000 7f557bfff700 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9db39c0 0x559af9db5da0 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3948386283f0040 server_cookie=81f95b682bdf43d in_seq=0 out_seq=0 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.576+0000 7f555bfff700 10 client.28429 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f555bfff700 1 -- 172.21.15.35:0/1946637320 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559af9cbb600 con 0x559af9db39c0 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f555bfff700 10 client.28429 handle_command_reply: tid=0 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 client.28429 shutdown 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 msgr2=0x559af9da64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9da64a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55700997c0 tx=0x7f5570099650 comp rx=0 tx=0).stop 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 shutdown_connections 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9db39c0 0x559af9db5da0 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9da3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9da64a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f555bfff700 0 client.28429 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 --2- 172.21.15.35:0/1946637320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 >> 172.21.15.35:0/1946637320 conn(0x559af9bf76b0 msgr2=0x559af9d99410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 shutdown_connections 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 1 -- 172.21.15.35:0/1946637320 wait complete. 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.577+0000 7f558f223b80 20 client.28429 trim_cache size 0 max 16384 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 Processor -- start 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 -- start start 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9daacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9d9d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9d956d0 con 0x559af9da04f0 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9d91b60 con 0x559af9d9fbe0 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f558f223b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9da4d00 con 0x559af9d9a960 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9d9d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9d9d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51650/0 (socket says 172.21.15.35:51650) 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f5580e32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9daacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f557bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.595+0000 7f5581633700 1 -- 172.21.15.35:0/2380829295 learned_addr learned my addr 172.21.15.35:0/2380829295 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5581633700 1 -- 172.21.15.35:0/2380829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 msgr2=0x559af9daacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:39.949 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:57 smithi035 ceph-mon[92535]: pgmap v3470: 97 pgs: 97 active+clean; 873 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 251 op/s 2023-03-17T10:43:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5581633700 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9daacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5581633700 1 -- 172.21.15.35:0/2380829295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 msgr2=0x559af9da6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5581633700 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5581633700 1 -- 172.21.15.35:0/2380829295 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559af9cb3130 con 0x559af9da04f0 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f557bfff700 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5580e32700 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9daacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f5581633700 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9d9d6b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5574018790 tx=0x7f5574009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2c7c7cbe926e42 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f55677fe700 1 -- 172.21.15.35:0/2380829295 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557401d070 con 0x559af9da04f0 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f55677fe700 1 -- 172.21.15.35:0/2380829295 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f557400f040 con 0x559af9da04f0 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.596+0000 7f55677fe700 1 -- 172.21.15.35:0/2380829295 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400e040 con 0x559af9da04f0 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 -- 172.21.15.35:0/2380829295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 msgr2=0x559af9d9d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9d9d6b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5574018790 tx=0x7f5574009920 comp rx=0 tx=0).stop 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 -- 172.21.15.35:0/2380829295 shutdown_connections 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9d9d6b0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9daacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 --2- 172.21.15.35:0/2380829295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9da6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 -- 172.21.15.35:0/2380829295 >> 172.21.15.35:0/2380829295 conn(0x559af9bf76b0 msgr2=0x559af9db0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 -- 172.21.15.35:0/2380829295 shutdown_connections 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 -- 172.21.15.35:0/2380829295 wait complete. 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 -- start start 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.597+0000 7f558f223b80 1 Processor -- start 2023-03-17T10:43:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9dfb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9dfbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9dffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9e00220 con 0x559af9da04f0 2023-03-17T10:43:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9e00390 con 0x559af9d9fbe0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559af9e00550 con 0x559af9d9a960 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f558f223b80 10 client.0 _ll_register_callbacks cb 0x559af9b92230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9dffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9dffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51656/0 (socket says 172.21.15.35:51656) 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 -- 172.21.15.35:0/2160834296 learned_addr learned my addr 172.21.15.35:0/2160834296 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5580e32700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9dfb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f557bfff700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9dfbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 -- 172.21.15.35:0/2160834296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 msgr2=0x559af9dfb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9dfb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 -- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 msgr2=0x559af9dfbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9dfbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 -- 172.21.15.35:0/2160834296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559af9b1ad80 con 0x559af9da04f0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f5581633700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9dffc70 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f5574024040 tx=0x7f5574003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b449747bb3e52e8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.598+0000 7f555bfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:43:42.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f555bfff700 1 -- 172.21.15.35:0/2160834296 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557401d030 con 0x559af9da04f0 2023-03-17T10:43:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559af9d6a1e0 con 0x559af9da04f0 2023-03-17T10:43:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f555bfff700 1 -- 172.21.15.35:0/2160834296 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f557401e070 con 0x559af9da04f0 2023-03-17T10:43:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f555bfff700 1 -- 172.21.15.35:0/2160834296 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f557400e040 con 0x559af9da04f0 2023-03-17T10:43:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 10 client.19290 fetch_fsmap learned FSMap version 49 2023-03-17T10:43:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f5568017070 con 0x559af9da04f0 2023-03-17T10:43:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f555bfff700 1 -- 172.21.15.35:0/2160834296 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5574037080 con 0x559af9da04f0 2023-03-17T10:43:42.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f555bfff700 1 -- 172.21.15.35:0/2160834296 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 49) v1 ==== 6921+0+0 (secure 0 0 0) 0x7f5574028030 con 0x559af9da04f0 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 10 client.19290 fetch_fsmap finished waiting for FSMap version 49 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 10 client.19290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 20 client.19290 populate_metadata read hostname 'smithi035' 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9e08ee0 0x559af9e0b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 4 client.19290 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559af9b70f00 con 0x559af9e08ee0 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.599+0000 7f5580e32700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9e08ee0 0x559af9e0b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.600+0000 7f555bfff700 10 client.19290 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.600+0000 7f5580e32700 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9e08ee0 0x559af9e0b2f0 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6901b2d03a7f35 server_cookie=875134842b5b1080 in_seq=0 out_seq=0 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f555bfff700 1 -- 172.21.15.35:0/2160834296 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559af9b70f00 con 0x559af9e08ee0 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f555bfff700 10 client.19290 handle_command_reply: tid=0 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 client.19290 shutdown 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 msgr2=0x559af9dffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9dffc70 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f5574024040 tx=0x7f5574003cb0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 shutdown_connections 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559af9e08ee0 0x559af9e0b2f0 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559af9da04f0 0x559af9dffc70 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559af9d9a960 0x559af9dfb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f555bfff700 0 client.19290 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 --2- 172.21.15.35:0/2160834296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559af9d9fbe0 0x559af9dfbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 >> 172.21.15.35:0/2160834296 conn(0x559af9bf76b0 msgr2=0x559af9d9d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 shutdown_connections 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 1 -- 172.21.15.35:0/2160834296 wait complete. 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.619+0000 7f558f223b80 20 client.19290 trim_cache size 0 max 16384 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556c09f640 msgr2=0x7f556c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556c09f640 0x7f556c0a1af0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f557c0688b0 tx=0x7f5568009260 comp rx=0 tx=0).stop 2023-03-17T10:43:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 msgr2=0x7f557c197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:43.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c197080 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f5570005910 tx=0x7f5570009580 comp rx=0 tx=0).stop 2023-03-17T10:43:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 shutdown_connections 2023-03-17T10:43:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556c09f640 0x7f556c0a1af0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 0x7f557c1a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c197080 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 --2- 172.21.15.35:0/1296207471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c1975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:43.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 >> 172.21.15.35:0/1296207471 conn(0x7f557c076330 msgr2=0x7f557c102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 shutdown_connections 2023-03-17T10:43:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:12.620+0000 7f5583096700 1 -- 172.21.15.35:0/1296207471 wait complete. 2023-03-17T10:43:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 -- 172.21.15.35:0/3189593085 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd88101580 msgr2=0x7fcd88104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/3189593085 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd88101580 0x7fcd88104e10 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0099c0 tx=0x7fcd7c009cd0 comp rx=0 tx=0).stop 2023-03-17T10:43:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 -- 172.21.15.35:0/3189593085 shutdown_connections 2023-03-17T10:43:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/3189593085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd881054f0 0x7fcd8810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/3189593085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd88100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/3189593085 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd88101580 0x7fcd88104e10 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 -- 172.21.15.35:0/3189593085 >> 172.21.15.35:0/3189593085 conn(0x7fcd880774e0 msgr2=0x7fcd880778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 -- 172.21.15.35:0/3189593085 shutdown_connections 2023-03-17T10:43:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.743+0000 7fcd8e35a700 1 -- 172.21.15.35:0/3189593085 wait complete. 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 Processor -- start 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 -- start start 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd881962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd88101580 0x7fcd881967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd881054f0 0x7fcd8819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8819b280 con 0x7fcd881054f0 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8819b3f0 con 0x7fcd88100be0 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8e35a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8819b5b0 con 0x7fcd88101580 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd881962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd8c8f7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd881054f0 0x7fcd8819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd881962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53464/0 (socket says 172.21.15.35:53464) 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd87fff700 1 -- 172.21.15.35:0/753372614 learned_addr learned my addr 172.21.15.35:0/753372614 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.744+0000 7fcd877fe700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd88101580 0x7fcd881967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd87fff700 1 -- 172.21.15.35:0/753372614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd88101580 msgr2=0x7fcd881967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd87fff700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd88101580 0x7fcd881967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd87fff700 1 -- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd881054f0 msgr2=0x7fcd8819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd87fff700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd881054f0 0x7fcd8819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd87fff700 1 -- 172.21.15.35:0/753372614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009520 con 0x7fcd88100be0 2023-03-17T10:43:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd8c8f7700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd881054f0 0x7fcd8819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:43:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd87fff700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd881962a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800eb30 tx=0x7fcd7800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd857fa700 1 -- 172.21.15.35:0/753372614 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78009880 con 0x7fcd88100be0 2023-03-17T10:43:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c0095f0 con 0x7fcd88100be0 2023-03-17T10:43:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd857fa700 1 -- 172.21.15.35:0/753372614 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd780044b0 con 0x7fcd88100be0 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd857fa700 1 -- 172.21.15.35:0/753372614 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78003ce0 con 0x7fcd88100be0 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.745+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd881101b0 con 0x7fcd88100be0 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.748+0000 7fcd857fa700 1 -- 172.21.15.35:0/753372614 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcd78003e40 con 0x7fcd88100be0 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.748+0000 7fcd857fa700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7009f640 0x7fcd700a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.748+0000 7fcd857fa700 1 -- 172.21.15.35:0/753372614 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd78014070 con 0x7fcd88100be0 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.748+0000 7fcd877fe700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7009f640 0x7fcd700a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd877fe700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7009f640 0x7fcd700a1af0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009990 tx=0x7fcd7c00b9b0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 Processor -- start 2023-03-17T10:43:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 -- start start 2023-03-17T10:43:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 0x5578eabdbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabd6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabd6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eaadd010 con 0x5578eabdbbe0 2023-03-17T10:43:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eab2f950 con 0x5578eabdc4f0 2023-03-17T10:43:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eab28de0 con 0x5578eabd6960 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 0x5578eabdbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 0x5578eabdbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51676/0 (socket says 172.21.15.35:51676) 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd87fff700 1 -- 172.21.15.35:0/659562220 learned_addr learned my addr 172.21.15.35:0/659562220 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd877fe700 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabd6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.749+0000 7fcd8c8f7700 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabd6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd87fff700 1 -- 172.21.15.35:0/659562220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 msgr2=0x5578eabd6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd87fff700 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabd6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd87fff700 1 -- 172.21.15.35:0/659562220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 msgr2=0x5578eabd6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd87fff700 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabd6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd87fff700 1 -- 172.21.15.35:0/659562220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578ea9aa5d0 con 0x5578eabdbbe0 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd87fff700 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 0x5578eabdbfb0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fcd780c8420 tx=0x7fcd78098320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fdd6816024ae8e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd6e7fc700 1 -- 172.21.15.35:0/659562220 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800cbd0 con 0x5578eabdbbe0 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd6e7fc700 1 -- 172.21.15.35:0/659562220 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd780986e0 con 0x5578eabdbbe0 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.750+0000 7fcd6e7fc700 1 -- 172.21.15.35:0/659562220 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78098ba0 con 0x5578eabdbbe0 2023-03-17T10:43:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/659562220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 msgr2=0x5578eabdbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 0x5578eabdbfb0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fcd780c8420 tx=0x7fcd78098320 comp rx=0 tx=0).stop 2023-03-17T10:43:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/659562220 shutdown_connections 2023-03-17T10:43:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabd6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdbbe0 0x5578eabdbfb0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/659562220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabd6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/659562220 >> 172.21.15.35:0/659562220 conn(0x5578eaa336b0 msgr2=0x5578eabd0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:43:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/659562220 shutdown_connections 2023-03-17T10:43:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/659562220 wait complete. 2023-03-17T10:43:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 -- start start 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.751+0000 7fcd9a4e7b80 1 Processor -- start 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabd6960 0x5578eabe2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabdbbe0 0x5578eabdf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabdfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578ea9ac8c0 con 0x5578eabd6960 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eabe0500 con 0x5578eabdc4f0 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eabec000 con 0x5578eabdbbe0 2023-03-17T10:43:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd9a4e7b80 10 client.0 _ll_register_callbacks cb 0x5578ea9ce230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:43:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabdfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabdfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53482/0 (socket says 172.21.15.35:53482) 2023-03-17T10:43:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 -- 172.21.15.35:0/370004740 learned_addr learned my addr 172.21.15.35:0/370004740 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:43:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd877fe700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabdbbe0 0x5578eabdf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd87fff700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabd6960 0x5578eabe2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 -- 172.21.15.35:0/370004740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabdbbe0 msgr2=0x5578eabdf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabdbbe0 0x5578eabdf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 -- 172.21.15.35:0/370004740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabd6960 msgr2=0x5578eabe2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabd6960 0x5578eabe2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.752+0000 7fcd8c8f7700 1 -- 172.21.15.35:0/370004740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd881101b0 con 0x5578eabdc4f0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd8c8f7700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabdfd90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd80004710 tx=0x7fcd80004a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d109ca107198a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd677fe700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd677fe700 1 -- 172.21.15.35:0/370004740 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000e9c0 con 0x5578eabdc4f0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd677fe700 1 -- 172.21.15.35:0/370004740 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd8000eb20 con 0x5578eabdc4f0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578eaaeb390 con 0x5578eabdc4f0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd677fe700 1 -- 172.21.15.35:0/370004740 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd8000ed20 con 0x5578eabdc4f0 2023-03-17T10:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd9a4e7b80 10 client.28463 fetch_fsmap learned FSMap version 50 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5578ea956d80 con 0x5578eabdc4f0 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd677fe700 1 -- 172.21.15.35:0/370004740 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5578eaaeb390 con 0x5578eabdc4f0 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd677fe700 1 -- 172.21.15.35:0/370004740 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd8001c020 con 0x5578eabdc4f0 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd9a4e7b80 10 client.28463 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd9a4e7b80 10 client.28463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.753+0000 7fcd9a4e7b80 20 client.28463 populate_metadata read hostname 'smithi035' 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.754+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eabf0140 0x5578eabf2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.754+0000 7fcd9a4e7b80 4 client.28463 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.754+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578eaaf7600 con 0x5578eabf0140 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.754+0000 7fcd87fff700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eabf0140 0x5578eabf2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.754+0000 7fcd87fff700 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eabf0140 0x5578eabf2550 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4679ee324423bf57 server_cookie=57d0bc4a32b1edb6 in_seq=0 out_seq=0 2023-03-17T10:43:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.754+0000 7fcd677fe700 10 client.28463 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd677fe700 1 -- 172.21.15.35:0/370004740 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5578eaaf7600 con 0x5578eabf0140 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd677fe700 10 client.28463 handle_command_reply: tid=0 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 client.28463 shutdown 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 msgr2=0x5578eabdfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabdfd90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd80004710 tx=0x7fcd80004a20 comp rx=0 tx=0).stop 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 shutdown_connections 2023-03-17T10:43:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eabf0140 0x5578eabf2550 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdc4f0 0x5578eabdfd90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabd6960 0x5578eabe2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd677fe700 0 client.28463 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:43:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/370004740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabdbbe0 0x5578eabdf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:43:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 >> 172.21.15.35:0/370004740 conn(0x5578eaa336b0 msgr2=0x5578eabd5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 shutdown_connections 2023-03-17T10:44:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/370004740 wait complete. 2023-03-17T10:44:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.755+0000 7fcd9a4e7b80 20 client.28463 trim_cache size 0 max 16384 2023-03-17T10:44:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.770+0000 7fcd9a4e7b80 1 Processor -- start 2023-03-17T10:44:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.770+0000 7fcd9a4e7b80 1 -- start start 2023-03-17T10:44:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabe6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eabe2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eabd96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:00.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eabcd5c0 con 0x5578eabdc4f0 2023-03-17T10:44:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eabd67a0 con 0x5578eabdbbe0 2023-03-17T10:44:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eabddcc0 con 0x5578eabd6960 2023-03-17T10:44:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd8c8f7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eabd96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:03.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabe6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabe6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43456/0 (socket says 172.21.15.35:43456) 2023-03-17T10:44:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eabe2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd8c8f7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eabd96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51694/0 (socket says 172.21.15.35:51694) 2023-03-17T10:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 -- 172.21.15.35:0/4205890342 learned_addr learned my addr 172.21.15.35:0/4205890342 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 -- 172.21.15.35:0/4205890342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 msgr2=0x5578eabe2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eabe2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 -- 172.21.15.35:0/4205890342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 msgr2=0x5578eabd96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eabd96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 -- 172.21.15.35:0/4205890342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578eaaef130 con 0x5578eabd6960 2023-03-17T10:44:13.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd8c8f7700 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eabd96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:44:13.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.771+0000 7fcd87fff700 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabe6f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd78094be0 tx=0x7fcd78003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c0d2e713a9e949 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.772+0000 7fcd6effd700 1 -- 172.21.15.35:0/4205890342 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd780a08d0 con 0x5578eabd6960 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.772+0000 7fcd6effd700 1 -- 172.21.15.35:0/4205890342 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd780986e0 con 0x5578eabd6960 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.772+0000 7fcd6effd700 1 -- 172.21.15.35:0/4205890342 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78097e30 con 0x5578eabd6960 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.772+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/4205890342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 msgr2=0x5578eabe6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.772+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabe6f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd78094be0 tx=0x7fcd78003680 comp rx=0 tx=0).stop 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/4205890342 shutdown_connections 2023-03-17T10:44:14.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eabd96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eabe6f50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/4205890342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eabe2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/4205890342 >> 172.21.15.35:0/4205890342 conn(0x5578eaa336b0 msgr2=0x5578eabd5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/4205890342 shutdown_connections 2023-03-17T10:44:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/4205890342 wait complete. 2023-03-17T10:44:14.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 -- start start 2023-03-17T10:44:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 Processor -- start 2023-03-17T10:44:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eac38160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eac386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.773+0000 7fcd9a4e7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eac42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eac38d90 con 0x5578eabdc4f0 2023-03-17T10:44:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eac43530 con 0x5578eabdbbe0 2023-03-17T10:44:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd9a4e7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578eac43670 con 0x5578eabd6960 2023-03-17T10:44:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd9a4e7b80 10 client.0 _ll_register_callbacks cb 0x5578ea9ce230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:44:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eac386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd8c8f7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eac42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eac386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53494/0 (socket says 172.21.15.35:53494) 2023-03-17T10:44:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 -- 172.21.15.35:0/2064735095 learned_addr learned my addr 172.21.15.35:0/2064735095 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd87fff700 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eac38160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 -- 172.21.15.35:0/2064735095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 msgr2=0x5578eac38160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eac38160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 -- 172.21.15.35:0/2064735095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 msgr2=0x5578eac42ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eac42ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 -- 172.21.15.35:0/2064735095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578ea956d80 con 0x5578eabdbbe0 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd877fe700 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eac386a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b980 tx=0x7fcd7c009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ab5ab9f2f7ccd5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd677fe700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd677fe700 1 -- 172.21.15.35:0/2064735095 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c02b030 con 0x5578eabdbbe0 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd677fe700 1 -- 172.21.15.35:0/2064735095 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd7c003e20 con 0x5578eabdbbe0 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.774+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578eaba61e0 con 0x5578eabdbbe0 2023-03-17T10:44:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd677fe700 1 -- 172.21.15.35:0/2064735095 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd7c00f870 con 0x5578eabdbbe0 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 10 client.28469 fetch_fsmap learned FSMap version 50 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5578ea9aa5d0 con 0x5578eabdbbe0 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd677fe700 1 -- 172.21.15.35:0/2064735095 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5578eaba61e0 con 0x5578eabdbbe0 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd677fe700 1 -- 172.21.15.35:0/2064735095 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd7c032820 con 0x5578eabdbbe0 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 10 client.28469 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 10 client.28469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 20 client.28469 populate_metadata read hostname 'smithi035' 2023-03-17T10:44:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eac44e80 0x5578eac47290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:24.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 4 client.28469 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:44:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5578ea9acf00 con 0x5578eac44e80 2023-03-17T10:44:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd87fff700 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eac44e80 0x5578eac47290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd87fff700 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eac44e80 0x5578eac47290 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281b8d6cb156134d server_cookie=fb7d130d32eb3e81 in_seq=0 out_seq=0 2023-03-17T10:44:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.775+0000 7fcd677fe700 10 client.28469 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:44:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd677fe700 1 -- 172.21.15.35:0/2064735095 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5578ea9acf00 con 0x5578eac44e80 2023-03-17T10:44:26.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd677fe700 10 client.28469 handle_command_reply: tid=0 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd9a4e7b80 1 client.28469 shutdown 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 msgr2=0x5578eac386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eac386a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b980 tx=0x7fcd7c009cd0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 shutdown_connections 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5578eac44e80 0x5578eac47290 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5578eabdc4f0 0x5578eac42ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.797+0000 7fcd677fe700 0 client.28469 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5578eabd6960 0x5578eac38160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd9a4e7b80 1 --2- 172.21.15.35:0/2064735095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5578eabdbbe0 0x5578eac386a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 >> 172.21.15.35:0/2064735095 conn(0x5578eaa336b0 msgr2=0x5578eabd96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 shutdown_connections 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd9a4e7b80 1 -- 172.21.15.35:0/2064735095 wait complete. 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd9a4e7b80 20 client.28469 trim_cache size 0 max 16384 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7009f640 msgr2=0x7fcd700a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7009f640 0x7fcd700a1af0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009990 tx=0x7fcd7c00b9b0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 msgr2=0x7fcd881962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd881962a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800eb30 tx=0x7fcd7800ee40 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 shutdown_connections 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd7009f640 0x7fcd700a1af0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd881054f0 0x7fcd8819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd88100be0 0x7fcd881962a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 --2- 172.21.15.35:0/753372614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd88101580 0x7fcd881967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 >> 172.21.15.35:0/753372614 conn(0x7fcd880774e0 msgr2=0x7fcd880fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.798+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 shutdown_connections 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:25.799+0000 7fcd8e35a700 1 -- 172.21.15.35:0/753372614 wait complete. 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 -- 172.21.15.35:0/2692261644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ffd60 msgr2=0x7f4f80103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 --2- 172.21.15.35:0/2692261644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ffd60 0x7f4f80103d20 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f4f700099c0 tx=0x7f4f70009cd0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 -- 172.21.15.35:0/2692261644 shutdown_connections 2023-03-17T10:44:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 --2- 172.21.15.35:0/2692261644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f80104400 0x7f4f8010bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 --2- 172.21.15.35:0/2692261644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f800ff3c0 0x7f4f800ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 --2- 172.21.15.35:0/2692261644 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ffd60 0x7f4f80103d20 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.924+0000 7f4f87760700 1 -- 172.21.15.35:0/2692261644 >> 172.21.15.35:0/2692261644 conn(0x7f4f80076300 msgr2=0x7f4f80076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 -- 172.21.15.35:0/2692261644 shutdown_connections 2023-03-17T10:44:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 -- 172.21.15.35:0/2692261644 wait complete. 2023-03-17T10:44:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 Processor -- start 2023-03-17T10:44:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 -- start start 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 0x7f4f801984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f800ffd60 0x7f4f80198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f80104400 0x7f4f8019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8019d4a0 con 0x7f4f800ff3c0 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8019d610 con 0x7f4f80104400 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f87760700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8019d7d0 con 0x7f4f800ffd60 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.925+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 0x7f4f801984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:30.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f84cfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f800ffd60 0x7f4f80198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 0x7f4f801984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51712/0 (socket says 172.21.15.35:51712) 2023-03-17T10:44:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 -- 172.21.15.35:0/2300852997 learned_addr learned my addr 172.21.15.35:0/2300852997 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f80104400 0x7f4f8019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:32.210 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49686 8.12 MB/sec execute 207 sec latency 74.567 ms 2023-03-17T10:44:32.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:44:32.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:31:59 smithi035 ceph-mon[92535]: pgmap v3471: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-03-17T10:44:32.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:01 smithi035 ceph-mon[92535]: pgmap v3472: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 197 op/s 2023-03-17T10:44:32.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:44:32.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:44:32.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:01 smithi035 ceph-mon[92535]: pgmap v3473: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 230 op/s 2023-03-17T10:44:32.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:44:32.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:04 smithi035 ceph-mon[92535]: pgmap v3474: 97 pgs: 97 active+clean; 879 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-03-17T10:44:32.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:05 smithi035 ceph-mon[92535]: osdmap e291: 12 total, 12 up, 12 in 2023-03-17T10:44:33.535 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:06 smithi035 ceph-mon[92535]: pgmap v3476: 97 pgs: 97 active+clean; 879 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 218 op/s 2023-03-17T10:44:33.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:07 smithi035 ceph-mon[92535]: pgmap v3477: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2023-03-17T10:44:33.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:10 smithi035 ceph-mon[92535]: pgmap v3478: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2023-03-17T10:44:33.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:12 smithi035 ceph-mon[92535]: pgmap v3479: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 264 op/s 2023-03-17T10:44:33.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:12 smithi035 ceph-mon[92535]: osdmap e292: 12 total, 12 up, 12 in 2023-03-17T10:44:33.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:14 smithi035 ceph-mon[92535]: pgmap v3481: 97 pgs: 97 active+clean; 898 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 253 op/s 2023-03-17T10:44:33.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:16 smithi035 ceph-mon[92535]: pgmap v3482: 97 pgs: 97 active+clean; 898 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 226 op/s 2023-03-17T10:44:34.774 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:17 smithi035 ceph-mon[92535]: pgmap v3483: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T10:44:35.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:20 smithi035 ceph-mon[92535]: pgmap v3484: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T10:44:35.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:22 smithi035 ceph-mon[92535]: pgmap v3485: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T10:44:36.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:24 smithi035 ceph-mon[92535]: pgmap v3486: 97 pgs: 97 active+clean; 916 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 304 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:26 smithi035 ceph-mon[92535]: pgmap v3487: 97 pgs: 97 active+clean; 916 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 206 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:27 smithi035 ceph-mon[92535]: pgmap v3488: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 315 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:30 smithi035 ceph-mon[92535]: pgmap v3489: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:32 smithi035 ceph-mon[92535]: pgmap v3490: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:34 smithi035 ceph-mon[92535]: pgmap v3491: 97 pgs: 97 active+clean; 936 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 307 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:36 smithi035 ceph-mon[92535]: pgmap v3492: 97 pgs: 97 active+clean; 936 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 205 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:37 smithi035 ceph-mon[92535]: pgmap v3493: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 300 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:40 smithi035 ceph-mon[92535]: pgmap v3494: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 190 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:42 smithi035 ceph-mon[92535]: pgmap v3495: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 190 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:44 smithi035 ceph-mon[92535]: pgmap v3496: 97 pgs: 97 active+clean; 957 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 295 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:46 smithi035 ceph-mon[92535]: pgmap v3497: 97 pgs: 97 active+clean; 957 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:47 smithi035 ceph-mon[92535]: pgmap v3498: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 293 op/s 2023-03-17T10:44:36.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:50 smithi035 ceph-mon[92535]: pgmap v3499: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 199 op/s 2023-03-17T10:44:36.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:52 smithi035 ceph-mon[92535]: pgmap v3500: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 199 op/s 2023-03-17T10:44:36.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:54 smithi035 ceph-mon[92535]: pgmap v3501: 97 pgs: 97 active+clean; 973 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 305 op/s 2023-03-17T10:44:36.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:56 smithi035 ceph-mon[92535]: pgmap v3502: 97 pgs: 97 active+clean; 973 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2023-03-17T10:44:36.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:32:57 smithi035 ceph-mon[92535]: pgmap v3503: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 296 op/s 2023-03-17T10:44:36.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:00 smithi035 ceph-mon[92535]: pgmap v3504: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 201 op/s 2023-03-17T10:44:36.768 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:02 smithi035 ceph-mon[92535]: pgmap v3505: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 201 op/s 2023-03-17T10:44:37.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:44:37.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:44:37.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:44:37.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:44:37.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:04 smithi035 ceph-mon[92535]: pgmap v3506: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 344 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:04 smithi035 ceph-mon[92535]: pgmap v3507: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.2 MiB/s wr, 279 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:05 smithi035 ceph-mon[92535]: osdmap e293: 12 total, 12 up, 12 in 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:06 smithi035 ceph-mon[92535]: pgmap v3509: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 200 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:08 smithi035 ceph-mon[92535]: pgmap v3510: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 200 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:10 smithi035 ceph-mon[92535]: pgmap v3511: 97 pgs: 97 active+clean; 1013 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.0 MiB/s wr, 366 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:12 smithi035 ceph-mon[92535]: pgmap v3512: 97 pgs: 97 active+clean; 1013 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 149 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:12 smithi035 ceph-mon[92535]: osdmap e294: 12 total, 12 up, 12 in 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:14 smithi035 ceph-mon[92535]: pgmap v3514: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 292 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:16 smithi035 ceph-mon[92535]: pgmap v3515: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:18 smithi035 ceph-mon[92535]: pgmap v3516: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:20 smithi035 ceph-mon[92535]: pgmap v3517: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:22 smithi035 ceph-mon[92535]: pgmap v3518: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:24 smithi035 ceph-mon[92535]: pgmap v3519: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.2 MiB/s wr, 344 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:26 smithi035 ceph-mon[92535]: pgmap v3520: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 211 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:28 smithi035 ceph-mon[92535]: pgmap v3521: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 211 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:30 smithi035 ceph-mon[92535]: pgmap v3522: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 330 op/s 2023-03-17T10:44:37.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:32 smithi035 ceph-mon[92535]: pgmap v3523: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 224 op/s 2023-03-17T10:44:37.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:34 smithi035 ceph-mon[92535]: pgmap v3524: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 322 op/s 2023-03-17T10:44:37.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:36 smithi035 ceph-mon[92535]: pgmap v3525: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-03-17T10:44:37.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:38 smithi035 ceph-mon[92535]: pgmap v3526: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-03-17T10:44:37.601 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:40 smithi035 ceph-mon[92535]: pgmap v3527: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 343 op/s 2023-03-17T10:44:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:44:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:44:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:44:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:44:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:44:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:44:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:44:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:44:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 -- 172.21.15.35:0/2300852997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f800ffd60 msgr2=0x7f4f80198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f800ffd60 0x7f4f80198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 -- 172.21.15.35:0/2300852997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f80104400 msgr2=0x7f4f8019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f80104400 0x7f4f8019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 -- 172.21.15.35:0/2300852997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f700095f0 con 0x7f4f800ff3c0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f854fc700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 0x7f4f801984c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00e9a0 tx=0x7f4f7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f767fc700 1 -- 172.21.15.35:0/2300852997 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c009790 con 0x7f4f800ff3c0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f767fc700 1 -- 172.21.15.35:0/2300852997 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f7c010430 con 0x7f4f800ff3c0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f767fc700 1 -- 172.21.15.35:0/2300852997 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00cea0 con 0x7f4f800ff3c0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8010f080 con 0x7f4f800ff3c0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.926+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8010eef0 con 0x7f4f800ff3c0 2023-03-17T10:44:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.929+0000 7f4f767fc700 1 -- 172.21.15.35:0/2300852997 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4f7c0105a0 con 0x7f4f800ff3c0 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.929+0000 7f4f767fc700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4f6c09f640 0x7f4f6c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.929+0000 7f4f767fc700 1 -- 172.21.15.35:0/2300852997 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4f7c014070 con 0x7f4f800ff3c0 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.929+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4f6c09f640 0x7f4f6c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.930+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4f6c09f640 0x7f4f6c0a1af0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f7000b9b0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 Processor -- start 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 -- start start 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c44fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c3f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:41.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:41.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28b46010 con 0x557a28c454f0 2023-03-17T10:44:41.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28b98950 con 0x557a28c3f960 2023-03-17T10:44:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f938edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28b91de0 con 0x557a28c44be0 2023-03-17T10:44:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.931+0000 7f4f84cfb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c3f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c44fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f84cfb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c3f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51722/0 (socket says 172.21.15.35:51722) 2023-03-17T10:44:42.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c44fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43486/0 (socket says 172.21.15.35:43486) 2023-03-17T10:44:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f84cfb700 1 -- 172.21.15.35:0/4188798245 learned_addr learned my addr 172.21.15.35:0/4188798245 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 -- 172.21.15.35:0/4188798245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 msgr2=0x557a28c3fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 -- 172.21.15.35:0/4188798245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 msgr2=0x557a28c3f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c3f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 -- 172.21.15.35:0/4188798245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a28a135d0 con 0x557a28c44be0 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f854fc700 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c44fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0c80e0 tx=0x7f4f7c097fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cebaf9936fd10a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f6b7fe700 1 -- 172.21.15.35:0/4188798245 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c098400 con 0x557a28c44be0 2023-03-17T10:44:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f6b7fe700 1 -- 172.21.15.35:0/4188798245 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f7c0a05f0 con 0x557a28c44be0 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.932+0000 7f4f6b7fe700 1 -- 172.21.15.35:0/4188798245 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c097b50 con 0x557a28c44be0 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 -- 172.21.15.35:0/4188798245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 msgr2=0x557a28c44fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c44fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0c80e0 tx=0x7f4f7c097fc0 comp rx=0 tx=0).stop 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 -- 172.21.15.35:0/4188798245 shutdown_connections 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c44fb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 --2- 172.21.15.35:0/4188798245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c3f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 -- 172.21.15.35:0/4188798245 >> 172.21.15.35:0/4188798245 conn(0x557a28a9c6b0 msgr2=0x557a28c39a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 -- 172.21.15.35:0/4188798245 shutdown_connections 2023-03-17T10:44:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.933+0000 7f4f938edb80 1 -- 172.21.15.35:0/4188798245 wait complete. 2023-03-17T10:44:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 -- start start 2023-03-17T10:44:44.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 Processor -- start 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 0x557a28c4b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c48760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28c48ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28a158c0 con 0x557a28c3f960 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28c495e0 con 0x557a28c454f0 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28c55000 con 0x557a28c44be0 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f938edb80 10 client.0 _ll_register_callbacks cb 0x557a28a37230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 0x557a28c4b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 0x557a28c4b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51726/0 (socket says 172.21.15.35:51726) 2023-03-17T10:44:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f854fc700 1 -- 172.21.15.35:0/406164104 learned_addr learned my addr 172.21.15.35:0/406164104 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c48760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:48.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.934+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28c48ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f854fc700 1 -- 172.21.15.35:0/406164104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 msgr2=0x557a28c48760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f854fc700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c48760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f854fc700 1 -- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 msgr2=0x557a28c48ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f854fc700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28c48ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f854fc700 1 -- 172.21.15.35:0/406164104 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8010eef0 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f854fc700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 0x557a28c4b550 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00e970 tx=0x7f4f7c010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0948629eb99bcfe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f68ff9700 1 -- 172.21.15.35:0/406164104 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c098860 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f68ff9700 1 -- 172.21.15.35:0/406164104 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4f7c0a0160 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a28b54390 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f68ff9700 1 -- 172.21.15.35:0/406164104 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f7c0a0320 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f938edb80 10 client.19320 fetch_fsmap learned FSMap version 50 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.935+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x557a289bfd80 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f68ff9700 1 -- 172.21.15.35:0/406164104 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a28b54390 con 0x557a28c3f960 2023-03-17T10:44:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f68ff9700 1 -- 172.21.15.35:0/406164104 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4f7c094280 con 0x557a28c3f960 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f938edb80 10 client.19320 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f938edb80 10 client.19320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f938edb80 20 client.19320 populate_metadata read hostname 'smithi035' 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f938edb80 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28c58d50 0x557a28c5b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f938edb80 4 client.19320 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a28b60600 con 0x557a28c58d50 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.936+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28c58d50 0x557a28c5b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f68ff9700 10 client.19320 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:44:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28c58d50 0x557a28c5b130 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c917447d08d25d4 server_cookie=b6719dd0e09c59bf in_seq=0 out_seq=0 2023-03-17T10:44:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f68ff9700 1 -- 172.21.15.35:0/406164104 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557a28b60600 con 0x557a28c58d50 2023-03-17T10:44:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f68ff9700 10 client.19320 handle_command_reply: tid=0 2023-03-17T10:44:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f938edb80 1 client.19320 shutdown 2023-03-17T10:44:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 msgr2=0x557a28c4b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.937+0000 7f4f938edb80 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 0x557a28c4b550 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00e970 tx=0x7f4f7c010a70 comp rx=0 tx=0).stop 2023-03-17T10:44:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 shutdown_connections 2023-03-17T10:44:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28c58d50 0x557a28c5b130 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:51.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28c48ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c3f960 0x557a28c4b550 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 --2- 172.21.15.35:0/406164104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c48760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 >> 172.21.15.35:0/406164104 conn(0x557a28a9c6b0 msgr2=0x557a28c3e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f68ff9700 0 client.19320 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 shutdown_connections 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 1 -- 172.21.15.35:0/406164104 wait complete. 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.938+0000 7f4f938edb80 20 client.19320 trim_cache size 0 max 16384 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 Processor -- start 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 -- start start 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c39ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c4ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28c498d0 con 0x557a28c454f0 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28b60600 con 0x557a28c3f960 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.957+0000 7f4f938edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28b54390 con 0x557a28c44be0 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c4ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f84cfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c39ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c4ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51738/0 (socket says 172.21.15.35:51738) 2023-03-17T10:44:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53530/0 (socket says 172.21.15.35:53530) 2023-03-17T10:44:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 -- 172.21.15.35:0/2433839973 learned_addr learned my addr 172.21.15.35:0/2433839973 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 -- 172.21.15.35:0/2433839973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 msgr2=0x557a28c39ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c39ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:55.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 -- 172.21.15.35:0/2433839973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 msgr2=0x557a28c3ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:55.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 -- 172.21.15.35:0/2433839973 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a28b58130 con 0x557a28c454f0 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c39ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f854fc700 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c4ff50 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f4f780127c0 tx=0x7f4f78009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455104057e7b47ca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f6bfff700 1 -- 172.21.15.35:0/2433839973 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800e040 con 0x557a28c454f0 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f6bfff700 1 -- 172.21.15.35:0/2433839973 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f7800f040 con 0x557a28c454f0 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.958+0000 7f4f6bfff700 1 -- 172.21.15.35:0/2433839973 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78004270 con 0x557a28c454f0 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 -- 172.21.15.35:0/2433839973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 msgr2=0x557a28c4ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:44:56.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c4ff50 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f4f780127c0 tx=0x7f4f78009920 comp rx=0 tx=0).stop 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 -- 172.21.15.35:0/2433839973 shutdown_connections 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c454f0 0x557a28c4ff50 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c3f960 0x557a28c3ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 --2- 172.21.15.35:0/2433839973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c44be0 0x557a28c39ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 -- 172.21.15.35:0/2433839973 >> 172.21.15.35:0/2433839973 conn(0x557a28a9c6b0 msgr2=0x557a28c553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 -- 172.21.15.35:0/2433839973 shutdown_connections 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 -- 172.21.15.35:0/2433839973 wait complete. 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.959+0000 7f4f938edb80 1 -- start start 2023-03-17T10:44:56.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 Processor -- start 2023-03-17T10:44:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c3f960 0x557a28c4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 0x557a28c4e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28cabb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:44:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28cac0a0 con 0x557a28c44be0 2023-03-17T10:44:57.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28cac1e0 con 0x557a28c454f0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28cac320 con 0x557a28c3f960 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f938edb80 10 client.0 _ll_register_callbacks cb 0x557a28a37230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f84cfb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 0x557a28c4e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f84cfb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 0x557a28c4e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51742/0 (socket says 172.21.15.35:51742) 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f84cfb700 1 -- 172.21.15.35:0/839335728 learned_addr learned my addr 172.21.15.35:0/839335728 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f854fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c3f960 0x557a28c4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.960+0000 7f4f85cfd700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28cabb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f84cfb700 1 -- 172.21.15.35:0/839335728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c3f960 msgr2=0x557a28c4e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c3f960 0x557a28c4e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f84cfb700 1 -- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 msgr2=0x557a28cabb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28cabb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f84cfb700 1 -- 172.21.15.35:0/839335728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a289bfd80 con 0x557a28c44be0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f854fc700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c3f960 0x557a28c4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f84cfb700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 0x557a28c4e660 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000b680 tx=0x7f4f70009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74696571958c355 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:44:57.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:44:57.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49809 8.09 MB/sec execute 208 sec latency 119.939 ms 2023-03-17T10:44:59.758 INFO:tasks.workunit.client.0.smithi035.stdout: 10 49960 8.08 MB/sec execute 209 sec latency 73.678 ms 2023-03-17T10:44:59.758 INFO:tasks.workunit.client.0.smithi035.stdout: 10 50078 8.06 MB/sec execute 210 sec latency 119.985 ms 2023-03-17T10:44:59.758 INFO:tasks.workunit.client.0.smithi035.stdout: 10 50213 8.05 MB/sec execute 211 sec latency 96.555 ms 2023-03-17T10:44:59.758 INFO:tasks.workunit.client.0.smithi035.stdout: 10 50377 8.06 MB/sec execute 212 sec latency 68.157 ms 2023-03-17T10:44:59.758 INFO:tasks.workunit.client.0.smithi035.stdout: 10 50523 8.06 MB/sec execute 213 sec latency 122.814 ms 2023-03-17T10:44:59.758 INFO:tasks.workunit.client.0.smithi035.stdout: 10 50696 8.07 MB/sec execute 214 sec latency 90.979 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 50871 8.08 MB/sec execute 215 sec latency 81.616 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51015 8.07 MB/sec execute 216 sec latency 66.886 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51174 8.07 MB/sec execute 217 sec latency 64.218 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51323 8.09 MB/sec execute 218 sec latency 69.681 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51474 8.09 MB/sec execute 219 sec latency 59.812 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51645 8.11 MB/sec execute 220 sec latency 72.025 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51802 8.11 MB/sec execute 221 sec latency 64.144 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 51956 8.11 MB/sec execute 222 sec latency 62.488 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52093 8.10 MB/sec execute 223 sec latency 69.036 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52239 8.11 MB/sec execute 224 sec latency 64.638 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52383 8.11 MB/sec execute 225 sec latency 61.589 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52558 8.13 MB/sec execute 226 sec latency 63.586 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52693 8.13 MB/sec execute 227 sec latency 80.140 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52819 8.13 MB/sec execute 228 sec latency 62.033 ms 2023-03-17T10:45:00.638 INFO:tasks.workunit.client.0.smithi035.stdout: 10 52972 8.13 MB/sec execute 229 sec latency 61.609 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 53126 8.11 MB/sec execute 230 sec latency 77.592 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 53253 8.08 MB/sec execute 231 sec latency 75.653 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 53393 8.07 MB/sec execute 232 sec latency 71.276 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 53531 8.05 MB/sec execute 233 sec latency 75.430 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 53691 8.07 MB/sec execute 234 sec latency 77.677 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 53868 8.08 MB/sec execute 235 sec latency 68.249 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54035 8.10 MB/sec execute 236 sec latency 69.535 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54194 8.09 MB/sec execute 237 sec latency 67.960 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54341 8.09 MB/sec execute 238 sec latency 67.239 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54518 8.10 MB/sec execute 239 sec latency 64.169 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54657 8.10 MB/sec execute 240 sec latency 60.538 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54785 8.08 MB/sec execute 241 sec latency 69.073 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 54924 8.08 MB/sec execute 242 sec latency 67.767 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55088 8.10 MB/sec execute 243 sec latency 98.215 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55251 8.10 MB/sec execute 244 sec latency 60.917 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55414 8.11 MB/sec execute 245 sec latency 69.742 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55567 8.11 MB/sec execute 246 sec latency 99.672 ms 2023-03-17T10:45:00.639 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55691 8.12 MB/sec execute 247 sec latency 89.054 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55817 8.10 MB/sec execute 248 sec latency 103.384 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 55988 8.12 MB/sec execute 249 sec latency 134.215 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56131 8.13 MB/sec execute 250 sec latency 67.981 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56238 8.11 MB/sec execute 251 sec latency 129.914 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56367 8.10 MB/sec execute 252 sec latency 106.038 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56497 8.09 MB/sec execute 253 sec latency 65.330 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56617 8.07 MB/sec execute 254 sec latency 71.950 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56758 8.06 MB/sec execute 255 sec latency 87.078 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 56878 8.03 MB/sec execute 256 sec latency 116.373 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 57041 8.04 MB/sec execute 257 sec latency 72.821 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 57207 8.05 MB/sec execute 258 sec latency 70.479 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 57375 8.06 MB/sec execute 259 sec latency 63.284 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 57545 8.08 MB/sec execute 260 sec latency 64.662 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 57696 8.07 MB/sec execute 261 sec latency 61.290 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 57870 8.09 MB/sec execute 262 sec latency 165.181 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58028 8.09 MB/sec execute 263 sec latency 83.278 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58164 8.08 MB/sec execute 264 sec latency 73.142 ms 2023-03-17T10:45:00.640 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58307 8.08 MB/sec execute 265 sec latency 62.279 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58456 8.09 MB/sec execute 266 sec latency 64.369 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58593 8.08 MB/sec execute 267 sec latency 59.156 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58745 8.08 MB/sec execute 268 sec latency 71.900 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 58910 8.09 MB/sec execute 269 sec latency 62.960 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59067 8.08 MB/sec execute 270 sec latency 94.377 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59220 8.09 MB/sec execute 271 sec latency 78.768 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59354 8.09 MB/sec execute 272 sec latency 81.865 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59518 8.11 MB/sec execute 273 sec latency 109.920 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59653 8.11 MB/sec execute 274 sec latency 123.144 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59779 8.10 MB/sec execute 275 sec latency 69.633 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 59919 8.10 MB/sec execute 276 sec latency 202.408 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60050 8.08 MB/sec execute 277 sec latency 180.164 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60185 8.06 MB/sec execute 278 sec latency 77.641 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60323 8.04 MB/sec execute 279 sec latency 82.075 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60467 8.03 MB/sec execute 280 sec latency 72.041 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60624 8.04 MB/sec execute 281 sec latency 101.551 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60787 8.04 MB/sec execute 282 sec latency 106.268 ms 2023-03-17T10:45:00.641 INFO:tasks.workunit.client.0.smithi035.stdout: 10 60957 8.06 MB/sec execute 283 sec latency 80.723 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 61146 8.08 MB/sec execute 284 sec latency 58.578 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 61323 8.08 MB/sec execute 285 sec latency 74.263 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 61485 8.09 MB/sec execute 286 sec latency 71.569 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 61621 8.08 MB/sec execute 287 sec latency 72.349 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 61755 8.08 MB/sec execute 288 sec latency 67.891 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 61890 8.08 MB/sec execute 289 sec latency 91.484 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62044 8.08 MB/sec execute 290 sec latency 95.383 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62201 8.08 MB/sec execute 291 sec latency 65.565 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62344 8.08 MB/sec execute 292 sec latency 88.931 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62496 8.08 MB/sec execute 293 sec latency 77.261 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62625 8.07 MB/sec execute 294 sec latency 64.489 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62789 8.09 MB/sec execute 295 sec latency 66.950 ms 2023-03-17T10:45:00.642 INFO:tasks.workunit.client.0.smithi035.stdout: 10 62951 8.10 MB/sec execute 296 sec latency 66.335 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63098 8.10 MB/sec execute 297 sec latency 101.588 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63223 8.10 MB/sec execute 298 sec latency 88.507 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63336 8.09 MB/sec execute 299 sec latency 108.555 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63473 8.08 MB/sec execute 300 sec latency 71.348 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63611 8.06 MB/sec execute 301 sec latency 78.557 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63757 8.06 MB/sec execute 302 sec latency 86.696 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 63889 8.04 MB/sec execute 303 sec latency 84.502 ms 2023-03-17T10:45:01.181 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64037 8.05 MB/sec execute 304 sec latency 67.603 ms 2023-03-17T10:45:01.182 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64197 8.05 MB/sec execute 305 sec latency 64.301 ms 2023-03-17T10:45:01.182 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64357 8.05 MB/sec execute 306 sec latency 67.695 ms 2023-03-17T10:45:01.182 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64539 8.06 MB/sec execute 307 sec latency 72.649 ms 2023-03-17T10:45:01.182 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64699 8.06 MB/sec execute 308 sec latency 73.195 ms 2023-03-17T10:45:01.182 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64846 8.06 MB/sec execute 309 sec latency 65.698 ms 2023-03-17T10:45:01.182 INFO:tasks.workunit.client.0.smithi035.stdout: 10 64988 8.07 MB/sec execute 310 sec latency 62.882 ms 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f68ff9700 1 -- 172.21.15.35:0/839335728 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70029040 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f68ff9700 1 -- 172.21.15.35:0/839335728 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4f700050f0 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a28c0f1e0 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f68ff9700 1 -- 172.21.15.35:0/839335728 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f700052b0 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f938edb80 10 client.19326 fetch_fsmap learned FSMap version 50 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f4f8010c810 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.961+0000 7f4f68ff9700 1 -- 172.21.15.35:0/839335728 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a28c0f1e0 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f68ff9700 1 -- 172.21.15.35:0/839335728 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4f7003c470 con 0x557a28c44be0 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f938edb80 10 client.19326 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f938edb80 10 client.19326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f938edb80 20 client.19326 populate_metadata read hostname 'smithi035' 2023-03-17T10:45:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f938edb80 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28cada00 0x557a28cafe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f938edb80 4 client.19326 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a28a15f00 con 0x557a28cada00 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f854fc700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28cada00 0x557a28cafe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f68ff9700 10 client.19326 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.962+0000 7f4f854fc700 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28cada00 0x557a28cafe10 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f259fb411998ae84 server_cookie=7977e8b7f8c13207 in_seq=0 out_seq=0 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f68ff9700 1 -- 172.21.15.35:0/839335728 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a28a15f00 con 0x557a28cada00 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f68ff9700 10 client.19326 handle_command_reply: tid=0 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 client.19326 shutdown 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 msgr2=0x557a28c4e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 0x557a28c4e660 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000b680 tx=0x7f4f70009cd0 comp rx=0 tx=0).stop 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 shutdown_connections 2023-03-17T10:45:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a28cada00 0x557a28cafe10 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:01.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a28c454f0 0x557a28cabb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f68ff9700 0 client.19326 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a28c3f960 0x557a28c4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 --2- 172.21.15.35:0/839335728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a28c44be0 0x557a28c4e660 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.986+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 >> 172.21.15.35:0/839335728 conn(0x557a28a9c6b0 msgr2=0x557a28c47fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 shutdown_connections 2023-03-17T10:45:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f938edb80 1 -- 172.21.15.35:0/839335728 wait complete. 2023-03-17T10:45:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f938edb80 20 client.19326 trim_cache size 0 max 16384 2023-03-17T10:45:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4f6c09f640 msgr2=0x7f4f6c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4f6c09f640 0x7f4f6c0a1af0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f7000b9b0 comp rx=0 tx=0).stop 2023-03-17T10:45:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 msgr2=0x7f4f801984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 0x7f4f801984c0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00e9a0 tx=0x7f4f7c00ecb0 comp rx=0 tx=0).stop 2023-03-17T10:45:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 shutdown_connections 2023-03-17T10:45:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4f6c09f640 0x7f4f6c0a1af0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f80104400 0x7f4f8019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4f800ff3c0 0x7f4f801984c0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:03.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 --2- 172.21.15.35:0/2300852997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f800ffd60 0x7f4f80198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 >> 172.21.15.35:0/2300852997 conn(0x7f4f80076300 msgr2=0x7f4f800fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 shutdown_connections 2023-03-17T10:45:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:38.987+0000 7f4f87760700 1 -- 172.21.15.35:0/2300852997 wait complete. 2023-03-17T10:45:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 -- 172.21.15.35:0/91007866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c0ff350 msgr2=0x7f4e9c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 --2- 172.21.15.35:0/91007866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c0ff720 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0099c0 tx=0x7f4e8c009cd0 comp rx=0 tx=0).stop 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 -- 172.21.15.35:0/91007866 shutdown_connections 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 --2- 172.21.15.35:0/91007866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e9c104390 0x7f4e9c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 --2- 172.21.15.35:0/91007866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c0ff720 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 --2- 172.21.15.35:0/91007866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ffcf0 0x7f4e9c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 -- 172.21.15.35:0/91007866 >> 172.21.15.35:0/91007866 conn(0x7f4e9c076330 msgr2=0x7f4e9c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 -- 172.21.15.35:0/91007866 shutdown_connections 2023-03-17T10:45:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.102+0000 7f4ea1964700 1 -- 172.21.15.35:0/91007866 wait complete. 2023-03-17T10:45:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.103+0000 7f4ea1964700 1 Processor -- start 2023-03-17T10:45:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.103+0000 7f4ea1964700 1 -- start start 2023-03-17T10:45:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.103+0000 7f4ea1964700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.103+0000 7f4ea1964700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e9c0ffcf0 0x7f4e9c1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea1964700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c104390 0x7f4e9c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:08.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea1964700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19b270 con 0x7f4e9c104390 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea1964700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19b3e0 con 0x7f4e9c0ffcf0 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea1964700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19b5a0 con 0x7f4e9c0ff350 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c104390 0x7f4e9c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c196290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43520/0 (socket says 172.21.15.35:43520) 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 -- 172.21.15.35:0/2910182210 learned_addr learned my addr 172.21.15.35:0/2910182210 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e9c0ffcf0 0x7f4e9c1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:08.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 -- 172.21.15.35:0/2910182210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e9c0ffcf0 msgr2=0x7f4e9c1967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e9c0ffcf0 0x7f4e9c1967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 -- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c104390 msgr2=0x7f4e9c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c104390 0x7f4e9c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:08.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 -- 172.21.15.35:0/2910182210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0095f0 con 0x7f4e9c0ff350 2023-03-17T10:45:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c104390 0x7f4e9c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:45:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4e9affd700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c196290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c005910 tx=0x7f4e8c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea0962700 1 -- 172.21.15.35:0/2910182210 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c01d070 con 0x7f4e9c0ff350 2023-03-17T10:45:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c10f000 con 0x7f4e9c0ff350 2023-03-17T10:45:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea0962700 1 -- 172.21.15.35:0/2910182210 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e8c022470 con 0x7f4e9c0ff350 2023-03-17T10:45:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea0962700 1 -- 172.21.15.35:0/2910182210 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c017650 con 0x7f4e9c0ff350 2023-03-17T10:45:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.104+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c10ee70 con 0x7f4e9c0ff350 2023-03-17T10:45:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.107+0000 7f4ea0962700 1 -- 172.21.15.35:0/2910182210 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4e8c0225e0 con 0x7f4e9c0ff350 2023-03-17T10:45:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.107+0000 7f4ea0962700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e8409f640 0x7f4e840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.107+0000 7f4ea0962700 1 -- 172.21.15.35:0/2910182210 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4e8c0cb620 con 0x7f4e9c0ff350 2023-03-17T10:45:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.107+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e8409f640 0x7f4e840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.108+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e8409f640 0x7f4e840a1af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c1978a0 tx=0x7f4e90009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 Processor -- start 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 -- start start 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x559433299fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x559433294420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x559433294d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943319b010 con 0x55943329a4f0 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594331ed950 con 0x559433294960 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594331e6de0 con 0x559433299be0 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x559433294420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x559433299fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x559433299fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43528/0 (socket says 172.21.15.35:43528) 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x559433294420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51764/0 (socket says 172.21.15.35:51764) 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 -- 172.21.15.35:0/1314300467 learned_addr learned my addr 172.21.15.35:0/1314300467 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x559433294d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 -- 172.21.15.35:0/1314300467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 msgr2=0x559433294d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x559433294d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 -- 172.21.15.35:0/1314300467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 msgr2=0x559433294420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x559433294420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 -- 172.21.15.35:0/1314300467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594330685d0 con 0x559433299be0 2023-03-17T10:45:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x559433294420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:45:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.109+0000 7f4e9affd700 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x559433299fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0a0d90 tx=0x7f4e8c022f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a41de82e3e775cd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4e81ffb700 1 -- 172.21.15.35:0/1314300467 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c099160 con 0x559433299be0 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4e81ffb700 1 -- 172.21.15.35:0/1314300467 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e8c0a12c0 con 0x559433299be0 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4e81ffb700 1 -- 172.21.15.35:0/1314300467 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0988b0 con 0x559433299be0 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/1314300467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 msgr2=0x559433299fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x559433299fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0a0d90 tx=0x7f4e8c022f90 comp rx=0 tx=0).stop 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/1314300467 shutdown_connections 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x559433294d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x559433299fb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/1314300467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x559433294420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/1314300467 >> 172.21.15.35:0/1314300467 conn(0x5594330f16b0 msgr2=0x55943328ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/1314300467 shutdown_connections 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.110+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/1314300467 wait complete. 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 -- start start 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 Processor -- start 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433299be0 0x55943329d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:16.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x55943329de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943306a8c0 con 0x559433299be0 2023-03-17T10:45:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943329e580 con 0x559433294960 2023-03-17T10:45:16.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594332a9cf0 con 0x55943329a4f0 2023-03-17T10:45:17.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4eadaf1b80 10 client.0 _ll_register_callbacks cb 0x55943308c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:45:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4e9a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433299be0 0x55943329d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53564/0 (socket says 172.21.15.35:53564) 2023-03-17T10:45:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.111+0000 7f4e9affd700 1 -- 172.21.15.35:0/681626330 learned_addr learned my addr 172.21.15.35:0/681626330 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x55943329de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9affd700 1 -- 172.21.15.35:0/681626330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 msgr2=0x55943329de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9affd700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x55943329de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9affd700 1 -- 172.21.15.35:0/681626330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433299be0 msgr2=0x55943329d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9affd700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433299be0 0x55943329d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9affd700 1 -- 172.21.15.35:0/681626330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c10ee70 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x55943329de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e9affd700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a04f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0c93b0 tx=0x7f4e8c0989b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c334fc3a8a71bb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e7affd700 1 -- 172.21.15.35:0/681626330 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c099160 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594331a9390 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e7affd700 1 -- 172.21.15.35:0/681626330 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4e8c09e040 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e7affd700 1 -- 172.21.15.35:0/681626330 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e8c0993c0 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4eadaf1b80 10 client.28499 fetch_fsmap learned FSMap version 50 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x559433014d80 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.112+0000 7f4e7affd700 1 -- 172.21.15.35:0/681626330 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e8c063020 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4e7affd700 1 -- 172.21.15.35:0/681626330 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4e8c0980c0 con 0x559433294960 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4eadaf1b80 10 client.28499 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:45:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4eadaf1b80 10 client.28499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:45:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4eadaf1b80 20 client.28499 populate_metadata read hostname 'smithi035' 2023-03-17T10:45:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5594332ad9b0 0x5594332afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4eadaf1b80 4 client.28499 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:45:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594331b5600 con 0x5594332ad9b0 2023-03-17T10:45:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5594332ad9b0 0x5594332afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4e7affd700 10 client.28499 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.113+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5594332ad9b0 0x5594332afdc0 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54125ca7b2ef745 server_cookie=301b501761e1e1f0 in_seq=0 out_seq=0 2023-03-17T10:45:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4e7affd700 1 -- 172.21.15.35:0/681626330 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5594331b5600 con 0x5594332ad9b0 2023-03-17T10:45:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4e7affd700 10 client.28499 handle_command_reply: tid=0 2023-03-17T10:45:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 client.28499 shutdown 2023-03-17T10:45:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 msgr2=0x5594332a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a04f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c0c93b0 tx=0x7f4e8c0989b0 comp rx=0 tx=0).stop 2023-03-17T10:45:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 shutdown_connections 2023-03-17T10:45:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5594332ad9b0 0x5594332afdc0 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:24.819 INFO:tasks.workunit.client.0.smithi035.stdout: 10 65126 8.07 MB/sec execute 311 sec latency 89.292 ms 2023-03-17T10:45:24.820 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:42 smithi035 ceph-mon[92535]: pgmap v3528: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 224 op/s 2023-03-17T10:45:27.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x55943329de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4e7affd700 0 client.28499 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:27.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a04f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/681626330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433299be0 0x55943329d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 >> 172.21.15.35:0/681626330 conn(0x5594330f16b0 msgr2=0x559433293410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 shutdown_connections 2023-03-17T10:45:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/681626330 wait complete. 2023-03-17T10:45:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.114+0000 7f4eadaf1b80 20 client.28499 trim_cache size 0 max 16384 2023-03-17T10:45:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.131+0000 7f4eadaf1b80 1 Processor -- start 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.131+0000 7f4eadaf1b80 1 -- start start 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 0x55943328eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433299be0 0x5594332a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x5594332a0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943328bba0 con 0x559433294960 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943328fdd0 con 0x559433299be0 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559433294750 con 0x55943329a4f0 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 0x55943328eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 0x55943328eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51776/0 (socket says 172.21.15.35:51776) 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 -- 172.21.15.35:0/874091973 learned_addr learned my addr 172.21.15.35:0/874091973 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x5594332a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433299be0 0x5594332a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 -- 172.21.15.35:0/874091973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 msgr2=0x5594332a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x5594332a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 -- 172.21.15.35:0/874091973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433299be0 msgr2=0x5594332a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433299be0 0x5594332a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 -- 172.21.15.35:0/874091973 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594331ad130 con 0x559433294960 2023-03-17T10:45:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x5594332a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:45:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e9affd700 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 0x55943328eac0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c000c00 tx=0x7f4e8c022bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=face44870cb4b76c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e827fc700 1 -- 172.21.15.35:0/874091973 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0a12c0 con 0x559433294960 2023-03-17T10:45:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e827fc700 1 -- 172.21.15.35:0/874091973 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e8c063070 con 0x559433294960 2023-03-17T10:45:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.132+0000 7f4e827fc700 1 -- 172.21.15.35:0/874091973 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c0993c0 con 0x559433294960 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/874091973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 msgr2=0x55943328eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 0x55943328eac0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c000c00 tx=0x7f4e8c022bd0 comp rx=0 tx=0).stop 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/874091973 shutdown_connections 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55943329a4f0 0x5594332a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559433294960 0x55943328eac0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/874091973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433299be0 0x5594332a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/874091973 >> 172.21.15.35:0/874091973 conn(0x5594330f16b0 msgr2=0x559433293a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/874091973 shutdown_connections 2023-03-17T10:45:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/874091973 wait complete. 2023-03-17T10:45:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.133+0000 7f4eadaf1b80 1 -- start start 2023-03-17T10:45:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 Processor -- start 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x5594332a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x5594332a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594332a3340 con 0x55943329a4f0 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594332a34b0 con 0x559433294960 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594332a3670 con 0x559433299be0 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4eadaf1b80 10 client.0 _ll_register_callbacks cb 0x55943308c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x5594332a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x5594332a2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51786/0 (socket says 172.21.15.35:51786) 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4e9b7fe700 1 -- 172.21.15.35:0/2284682302 learned_addr learned my addr 172.21.15.35:0/2284682302 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x5594332a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.134+0000 7f4e9affd700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9a7fc700 1 -- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 msgr2=0x5594332a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9a7fc700 1 -- 172.21.15.35:0/2284682302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 msgr2=0x5594332a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:37.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x5594332a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9a7fc700 1 -- 172.21.15.35:0/2284682302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559433014d80 con 0x559433299be0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9b7fe700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x5594332a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e9a7fc700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x5594332a4cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55943329edb0 tx=0x7f4e900047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf1712db4b8b572 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e7affd700 1 -- 172.21.15.35:0/2284682302 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90022070 con 0x559433299be0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e7affd700 1 -- 172.21.15.35:0/2284682302 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(262..262 src has 1..262) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4e9002bd70 con 0x559433299be0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594332641e0 con 0x559433299be0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4e7affd700 1 -- 172.21.15.35:0/2284682302 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e90004050 con 0x559433299be0 2023-03-17T10:45:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4eadaf1b80 10 client.28489 fetch_fsmap learned FSMap version 50 2023-03-17T10:45:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.135+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55943303b1f0 con 0x559433299be0 2023-03-17T10:45:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4e7affd700 1 -- 172.21.15.35:0/2284682302 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594332641e0 con 0x559433299be0 2023-03-17T10:45:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4e7affd700 1 -- 172.21.15.35:0/2284682302 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4e90003d20 con 0x559433299be0 2023-03-17T10:45:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4eadaf1b80 10 client.28489 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:45:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4eadaf1b80 10 client.28489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:45:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4eadaf1b80 20 client.28489 populate_metadata read hostname 'smithi035' 2023-03-17T10:45:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559433302970 0x559433304d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4eadaf1b80 4 client.28489 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:45:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55943306af00 con 0x559433302970 2023-03-17T10:45:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4e9affd700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559433302970 0x559433304d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4e7affd700 10 client.28489 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.136+0000 7f4e9affd700 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559433302970 0x559433304d80 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bac01d4c4aa8f6 server_cookie=e471e1e3cf8672b9 in_seq=0 out_seq=0 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4e7affd700 1 -- 172.21.15.35:0/2284682302 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55943306af00 con 0x559433302970 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4e7affd700 10 client.28489 handle_command_reply: tid=0 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 client.28489 shutdown 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 msgr2=0x5594332a4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x5594332a4cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55943329edb0 tx=0x7f4e900047c0 comp rx=0 tx=0).stop 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 shutdown_connections 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559433302970 0x559433304d80 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55943329a4f0 0x5594332a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4e7affd700 0 client.28489 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559433294960 0x5594332a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 --2- 172.21.15.35:0/2284682302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559433299be0 0x5594332a4cb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 >> 172.21.15.35:0/2284682302 conn(0x5594330f16b0 msgr2=0x55943329cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.158+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 shutdown_connections 2023-03-17T10:45:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4eadaf1b80 1 -- 172.21.15.35:0/2284682302 wait complete. 2023-03-17T10:45:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4eadaf1b80 20 client.28489 trim_cache size 0 max 16384 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e8409f640 msgr2=0x7f4e840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e8409f640 0x7f4e840a1af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c1978a0 tx=0x7f4e90009260 comp rx=0 tx=0).stop 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 msgr2=0x7f4e9c196290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c196290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c005910 tx=0x7f4e8c009580 comp rx=0 tx=0).stop 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 shutdown_connections 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4e8409f640 0x7f4e840a1af0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4e9c104390 0x7f4e9c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e9c0ff350 0x7f4e9c196290 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 --2- 172.21.15.35:0/2910182210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e9c0ffcf0 0x7f4e9c1967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 >> 172.21.15.35:0/2910182210 conn(0x7f4e9c076330 msgr2=0x7f4e9c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 shutdown_connections 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:17:52.159+0000 7f4ea1964700 1 -- 172.21.15.35:0/2910182210 wait complete. 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 -- 172.21.15.35:0/1270810768 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad7010a7a0 msgr2=0x7fad7010cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 --2- 172.21.15.35:0/1270810768 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad7010a7a0 0x7fad7010cbc0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b0a0 tx=0x7fad6800b3b0 comp rx=0 tx=0).stop 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 -- 172.21.15.35:0/1270810768 shutdown_connections 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 --2- 172.21.15.35:0/1270810768 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad7010a7a0 0x7fad7010cbc0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 --2- 172.21.15.35:0/1270810768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad701013d0 0x7fad701017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 --2- 172.21.15.35:0/1270810768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad70101ce0 0x7fad7010a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 -- 172.21.15.35:0/1270810768 >> 172.21.15.35:0/1270810768 conn(0x7fad70076330 msgr2=0x7fad70076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 -- 172.21.15.35:0/1270810768 shutdown_connections 2023-03-17T10:45:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 -- 172.21.15.35:0/1270810768 wait complete. 2023-03-17T10:45:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.553+0000 7fad77300700 1 Processor -- start 2023-03-17T10:45:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 -- start start 2023-03-17T10:45:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad701013d0 0x7fad70196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 0x7fad70196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7010a7a0 0x7fad7019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019b2e0 con 0x7fad70101ce0 2023-03-17T10:45:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019b450 con 0x7fad701013d0 2023-03-17T10:45:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad77300700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7019b610 con 0x7fad7010a7a0 2023-03-17T10:45:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 0x7fad70196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 0x7fad70196840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51798/0 (socket says 172.21.15.35:51798) 2023-03-17T10:45:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 -- 172.21.15.35:0/2154161733 learned_addr learned my addr 172.21.15.35:0/2154161733 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7589d700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7010a7a0 0x7fad7019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7509c700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad701013d0 0x7fad70196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 -- 172.21.15.35:0/2154161733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7010a7a0 msgr2=0x7fad7019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7010a7a0 0x7fad7019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:47.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 -- 172.21.15.35:0/2154161733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad701013d0 msgr2=0x7fad70196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:47.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad701013d0 0x7fad70196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:47.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 -- 172.21.15.35:0/2154161733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009d00 con 0x7fad70101ce0 2023-03-17T10:45:47.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad7489b700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 0x7fad70196840 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fad6000e9a0 tx=0x7fad6000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.554+0000 7fad667fc700 1 -- 172.21.15.35:0/2154161733 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60009790 con 0x7fad70101ce0 2023-03-17T10:45:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.555+0000 7fad667fc700 1 -- 172.21.15.35:0/2154161733 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad60010430 con 0x7fad70101ce0 2023-03-17T10:45:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.555+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad70110050 con 0x7fad70101ce0 2023-03-17T10:45:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.555+0000 7fad667fc700 1 -- 172.21.15.35:0/2154161733 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000cea0 con 0x7fad70101ce0 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.555+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7010fec0 con 0x7fad70101ce0 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.557+0000 7fad667fc700 1 -- 172.21.15.35:0/2154161733 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fad600105a0 con 0x7fad70101ce0 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.558+0000 7fad667fc700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fad5c09f640 0x7fad5c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.558+0000 7fad7509c700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fad5c09f640 0x7fad5c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.558+0000 7fad667fc700 1 -- 172.21.15.35:0/2154161733 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(264..264 src has 1..264) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fad60014070 con 0x7fad70101ce0 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.558+0000 7fad7509c700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fad5c09f640 0x7fad5c0a1af0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009c60 tx=0x7fad6c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:49.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 Processor -- start 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 -- start start 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcc6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbcc1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcc1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbbc8010 con 0x55cedbcc6be0 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbc1a950 con 0x55cedbcc74f0 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad8348db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbc13de0 con 0x55cedbcc1960 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad7509c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcc6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad7509c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcc6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51804/0 (socket says 172.21.15.35:51804) 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad7509c700 1 -- 172.21.15.35:0/859975255 learned_addr learned my addr 172.21.15.35:0/859975255 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad7589d700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcc1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.559+0000 7fad7489b700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbcc1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7509c700 1 -- 172.21.15.35:0/859975255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 msgr2=0x55cedbcc1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7509c700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcc1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7509c700 1 -- 172.21.15.35:0/859975255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 msgr2=0x55cedbcc1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:49.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7509c700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbcc1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7509c700 1 -- 172.21.15.35:0/859975255 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cedba955d0 con 0x55cedbcc6be0 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7589d700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcc1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7489b700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbcc1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad7509c700 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcc6fb0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4e0 tx=0x7fad6c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2132b03288fab4e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad5b7fe700 1 -- 172.21.15.35:0/859975255 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00ee00 con 0x55cedbcc6be0 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad5b7fe700 1 -- 172.21.15.35:0/859975255 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad6c021070 con 0x55cedbcc6be0 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.560+0000 7fad5b7fe700 1 -- 172.21.15.35:0/859975255 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c01d650 con 0x55cedbcc6be0 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 -- 172.21.15.35:0/859975255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 msgr2=0x55cedbcc6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcc6fb0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4e0 tx=0x7fad6c014000 comp rx=0 tx=0).stop 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 -- 172.21.15.35:0/859975255 shutdown_connections 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcc1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcc6fb0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 --2- 172.21.15.35:0/859975255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbcc1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 -- 172.21.15.35:0/859975255 >> 172.21.15.35:0/859975255 conn(0x55cedbb1e6b0 msgr2=0x55cedbcbba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 -- 172.21.15.35:0/859975255 shutdown_connections 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 -- 172.21.15.35:0/859975255 wait complete. 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 -- start start 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.561+0000 7fad8348db80 1 Processor -- start 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbccd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbccac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedba978c0 con 0x55cedbcc6be0 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbccb390 con 0x55cedbcc74f0 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbcdb410 con 0x55cedbcc1960 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad8348db80 10 client.0 _ll_register_callbacks cb 0x55cedbab9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7489b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbccd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7489b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51812/0 (socket says 172.21.15.35:51812) 2023-03-17T10:45:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7489b700 1 -- 172.21.15.35:0/740438632 learned_addr learned my addr 172.21.15.35:0/740438632 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7589d700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbccac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 -- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 msgr2=0x55cedbccac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbccac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 -- 172.21.15.35:0/740438632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 msgr2=0x55cedbcca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 -- 172.21.15.35:0/740438632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c017070 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7589d700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbccac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad7509c700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbccd3e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4b0 tx=0x7fad6c00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4472c6e88873ed server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.562+0000 7fad58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad58ff9700 1 -- 172.21.15.35:0/740438632 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c005450 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad58ff9700 1 -- 172.21.15.35:0/740438632 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(264..264 src has 1..264) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fad6c0055b0 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cedbbd6390 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad58ff9700 1 -- 172.21.15.35:0/740438632 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6c003680 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 10 client.28501 fetch_fsmap learned FSMap version 50 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55cedba41d80 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad58ff9700 1 -- 172.21.15.35:0/740438632 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cedbbd6390 con 0x55cedbcc1960 2023-03-17T10:45:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad58ff9700 1 -- 172.21.15.35:0/740438632 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fad6c01c710 con 0x55cedbcc1960 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 10 client.28501 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 10 client.28501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 20 client.28501 populate_metadata read hostname 'smithi035' 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbcdf310 0x55cedbce1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 4 client.28501 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cedbbe2600 con 0x55cedbcdf310 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.563+0000 7fad7489b700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbcdf310 0x55cedbce1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.564+0000 7fad58ff9700 10 client.28501 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.564+0000 7fad7489b700 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbcdf310 0x55cedbce1720 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98d0fca11de5e08 server_cookie=b27d4339319e5dc0 in_seq=0 out_seq=0 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.564+0000 7fad58ff9700 1 -- 172.21.15.35:0/740438632 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55cedbbe2600 con 0x55cedbcdf310 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.564+0000 7fad58ff9700 10 client.28501 handle_command_reply: tid=0 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.564+0000 7fad8348db80 1 client.28501 shutdown 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 msgr2=0x55cedbccd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbccd3e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e4b0 tx=0x7fad6c00ec00 comp rx=0 tx=0).stop 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 shutdown_connections 2023-03-17T10:45:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbcdf310 0x55cedbce1720 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc74f0 0x55cedbccac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbccd3e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad58ff9700 0 client.28501 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 --2- 172.21.15.35:0/740438632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc6be0 0x55cedbcca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 >> 172.21.15.35:0/740438632 conn(0x55cedbb1e6b0 msgr2=0x55cedbcc0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 shutdown_connections 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 1 -- 172.21.15.35:0/740438632 wait complete. 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.565+0000 7fad8348db80 20 client.28501 trim_cache size 0 max 16384 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 Processor -- start 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 -- start start 2023-03-17T10:45:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbcc4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbcb70f0 con 0x55cedbcc74f0 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbcbd6a0 con 0x55cedbcc6be0 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.581+0000 7fad8348db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbcc51b0 con 0x55cedbcc1960 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbcc4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7509c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:54.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7489b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbcc4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51822/0 (socket says 172.21.15.35:51822) 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 -- 172.21.15.35:0/1211991910 learned_addr learned my addr 172.21.15.35:0/1211991910 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 -- 172.21.15.35:0/1211991910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 msgr2=0x55cedbcd63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 -- 172.21.15.35:0/1211991910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 msgr2=0x55cedbcccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 -- 172.21.15.35:0/1211991910 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cedbbda130 con 0x55cedbcc74f0 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7489b700 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad7589d700 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbcc4650 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fad68009570 tx=0x7fad680095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a54c7645ebd234 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad5bfff700 1 -- 172.21.15.35:0/1211991910 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800e040 con 0x55cedbcc74f0 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad5bfff700 1 -- 172.21.15.35:0/1211991910 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad6800bcb0 con 0x55cedbcc74f0 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.582+0000 7fad5bfff700 1 -- 172.21.15.35:0/1211991910 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680052a0 con 0x55cedbcc74f0 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 -- 172.21.15.35:0/1211991910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 msgr2=0x55cedbcc4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbcc4650 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fad68009570 tx=0x7fad680095a0 comp rx=0 tx=0).stop 2023-03-17T10:45:54.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 -- 172.21.15.35:0/1211991910 shutdown_connections 2023-03-17T10:45:54.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbcc4650 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:54.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 --2- 172.21.15.35:0/1211991910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 -- 172.21.15.35:0/1211991910 >> 172.21.15.35:0/1211991910 conn(0x55cedbb1e6b0 msgr2=0x55cedbce6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:45:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 -- 172.21.15.35:0/1211991910 shutdown_connections 2023-03-17T10:45:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 -- 172.21.15.35:0/1211991910 wait complete. 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 -- start start 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.583+0000 7fad8348db80 1 Processor -- start 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcd4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbd2c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbd2c6c0 con 0x55cedbcc74f0 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbd2c800 con 0x55cedbcc6be0 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cedbd2c990 con 0x55cedbcc1960 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad8348db80 10 client.0 _ll_register_callbacks cb 0x55cedbab9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43590/0 (socket says 172.21.15.35:43590) 2023-03-17T10:45:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 -- 172.21.15.35:0/160737453 learned_addr learned my addr 172.21.15.35:0/160737453 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7589d700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbd2c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7489b700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcd4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 -- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 msgr2=0x55cedbcd4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcd4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 -- 172.21.15.35:0/160737453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 msgr2=0x55cedbd2c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbd2c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.584+0000 7fad7509c700 1 -- 172.21.15.35:0/160737453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad70110050 con 0x55cedbcc1960 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad7509c700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd45b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad6c01caf0 tx=0x7fad6c01cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894116dbfb85c9a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad58ff9700 1 -- 172.21.15.35:0/160737453 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c01c610 con 0x55cedbcc1960 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad58ff9700 1 -- 172.21.15.35:0/160737453 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(264..264 src has 1..264) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fad6c01cc90 con 0x55cedbcc1960 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cedbc911e0 con 0x55cedbcc1960 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad58ff9700 1 -- 172.21.15.35:0/160737453 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6c01c770 con 0x55cedbcc1960 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 10 client.28507 fetch_fsmap learned FSMap version 50 2023-03-17T10:45:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7fad68009300 con 0x55cedbcc1960 2023-03-17T10:45:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad58ff9700 1 -- 172.21.15.35:0/160737453 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cedbc911e0 con 0x55cedbcc1960 2023-03-17T10:45:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad58ff9700 1 -- 172.21.15.35:0/160737453 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fad6c02e5c0 con 0x55cedbcc1960 2023-03-17T10:45:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 10 client.28507 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:45:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 10 client.28507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:45:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 20 client.28507 populate_metadata read hostname 'smithi035' 2023-03-17T10:45:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbd33d70 0x55cedbd36180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:45:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 4 client.28507 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:45:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.585+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cedba97f00 con 0x55cedbd33d70 2023-03-17T10:45:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.586+0000 7fad7489b700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbd33d70 0x55cedbd36180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:45:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.586+0000 7fad58ff9700 10 client.28507 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:45:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.586+0000 7fad7489b700 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbd33d70 0x55cedbd36180 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75173ce93ce4d859 server_cookie=2cd40d3f78140423 in_seq=0 out_seq=0 2023-03-17T10:45:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.610+0000 7fad58ff9700 1 -- 172.21.15.35:0/160737453 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cedba97f00 con 0x55cedbd33d70 2023-03-17T10:45:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.610+0000 7fad58ff9700 10 client.28507 handle_command_reply: tid=0 2023-03-17T10:45:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.610+0000 7fad8348db80 1 client.28507 shutdown 2023-03-17T10:45:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.610+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 msgr2=0x55cedbcd45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:45:58.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.610+0000 7fad8348db80 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd45b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad6c01caf0 tx=0x7fad6c01cef0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 shutdown_connections 2023-03-17T10:46:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cedbd33d70 0x55cedbd36180 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cedbcc74f0 0x55cedbd2c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cedbcc1960 0x55cedbcd45b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad58ff9700 0 client.28507 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:46:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 --2- 172.21.15.35:0/160737453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cedbcc6be0 0x55cedbcd4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 >> 172.21.15.35:0/160737453 conn(0x55cedbb1e6b0 msgr2=0x55cedbcc4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 shutdown_connections 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 1 -- 172.21.15.35:0/160737453 wait complete. 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad8348db80 20 client.28507 trim_cache size 0 max 16384 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fad5c09f640 msgr2=0x7fad5c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.613+0000 7fad77300700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fad5c09f640 0x7fad5c0a1af0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009c60 tx=0x7fad6c009260 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 msgr2=0x7fad70196840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 0x7fad70196840 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fad6000e9a0 tx=0x7fad6000ecb0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 shutdown_connections 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fad5c09f640 0x7fad5c0a1af0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad7010a7a0 0x7fad7019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad701013d0 0x7fad70196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 --2- 172.21.15.35:0/2154161733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fad70101ce0 0x7fad70196840 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 >> 172.21.15.35:0/2154161733 conn(0x7fad70076330 msgr2=0x7fad70102170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:00.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 shutdown_connections 2023-03-17T10:46:00.283 INFO:tasks.workunit.client.0.smithi035.stdout: 10 65280 8.07 MB/sec execute 312 sec latency 75.003 ms 2023-03-17T10:46:00.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:44 smithi035 ceph-mon[92535]: pgmap v3529: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 324 op/s 2023-03-17T10:46:01.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:46 smithi035 ceph-mon[92535]: pgmap v3530: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 225 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:48 smithi035 ceph-mon[92535]: pgmap v3531: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 225 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:50 smithi035 ceph-mon[92535]: pgmap v3532: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 331 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:52 smithi035 ceph-mon[92535]: pgmap v3533: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 204 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:54 smithi035 ceph-mon[92535]: pgmap v3534: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.0 MiB/s wr, 313 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:56 smithi035 ceph-mon[92535]: pgmap v3535: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 214 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:33:58 smithi035 ceph-mon[92535]: pgmap v3536: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 214 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:00 smithi035 ceph-mon[92535]: pgmap v3537: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 321 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:02 smithi035 ceph-mon[92535]: pgmap v3538: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 216 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:04 smithi035 ceph-mon[92535]: pgmap v3539: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 342 op/s 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:46:01.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:05 smithi035 ceph-mon[92535]: pgmap v3540: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 244 op/s 2023-03-17T10:46:01.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:05 smithi035 ceph-mon[92535]: pgmap v3541: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2023-03-17T10:46:01.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:05 smithi035 ceph-mon[92535]: osdmap e295: 12 total, 12 up, 12 in 2023-03-17T10:46:01.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:07 smithi035 ceph-mon[92535]: pgmap v3543: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2023-03-17T10:46:01.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:09 smithi035 ceph-mon[92535]: pgmap v3544: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 347 op/s 2023-03-17T10:46:04.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:11 smithi035 ceph-mon[92535]: pgmap v3545: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 145 op/s 2023-03-17T10:46:04.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:12 smithi035 ceph-mon[92535]: osdmap e296: 12 total, 12 up, 12 in 2023-03-17T10:46:04.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:12 smithi035 ceph-mon[92535]: pgmap v3547: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 252 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:14 smithi035 ceph-mon[92535]: pgmap v3548: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 229 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:16 smithi035 ceph-mon[92535]: pgmap v3549: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 220 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:18 smithi035 ceph-mon[92535]: pgmap v3550: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 237 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:20 smithi035 ceph-mon[92535]: pgmap v3551: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 237 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:22 smithi035 ceph-mon[92535]: pgmap v3552: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 304 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:24 smithi035 ceph-mon[92535]: pgmap v3553: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:25 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:26 smithi035 ceph-mon[92535]: pgmap v3554: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:28 smithi035 ceph-mon[92535]: pgmap v3555: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 326 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:30 smithi035 ceph-mon[92535]: pgmap v3556: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 221 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:32 smithi035 ceph-mon[92535]: pgmap v3557: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 281 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:34 smithi035 ceph-mon[92535]: pgmap v3558: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 251 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:36 smithi035 ceph-mon[92535]: pgmap v3559: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 200 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:38 smithi035 ceph-mon[92535]: pgmap v3560: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.8 MiB/s wr, 293 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:40 smithi035 ceph-mon[92535]: pgmap v3561: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 186 op/s 2023-03-17T10:46:05.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:42 smithi035 ceph-mon[92535]: pgmap v3562: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 255 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:44 smithi035 ceph-mon[92535]: pgmap v3563: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 228 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:46 smithi035 ceph-mon[92535]: pgmap v3564: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 195 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:48 smithi035 ceph-mon[92535]: pgmap v3565: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 291 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:50 smithi035 ceph-mon[92535]: pgmap v3566: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 198 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:52 smithi035 ceph-mon[92535]: pgmap v3567: 97 pgs: 97 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 272 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:54 smithi035 ceph-mon[92535]: pgmap v3568: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 228 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:56 smithi035 ceph-mon[92535]: pgmap v3569: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 195 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:34:58 smithi035 ceph-mon[92535]: pgmap v3570: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 290 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:00 smithi035 ceph-mon[92535]: pgmap v3571: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:02 smithi035 ceph-mon[92535]: pgmap v3572: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.4 MiB/s wr, 291 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:04 smithi035 ceph-mon[92535]: osdmap e297: 12 total, 12 up, 12 in 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:04 smithi035 ceph-mon[92535]: pgmap v3574: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 258 op/s 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:46:05.001 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:46:05.002 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:46:05.002 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:05 smithi035 ceph-mon[92535]: pgmap v3575: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 275 op/s 2023-03-17T10:46:06.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:05 smithi035 ceph-mon[92535]: pgmap v3576: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 195 op/s 2023-03-17T10:46:06.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:46:06.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:07 smithi035 ceph-mon[92535]: pgmap v3577: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 353 op/s 2023-03-17T10:46:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:46:08.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:46:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:46:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:46:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:46:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:46:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:46:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:46:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:18:49.614+0000 7fad77300700 1 -- 172.21.15.35:0/2154161733 wait complete. 2023-03-17T10:46:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.732+0000 7ffad0547700 1 -- 172.21.15.35:0/2937152604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ff350 msgr2=0x7ffac80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.732+0000 7ffad0547700 1 --2- 172.21.15.35:0/2937152604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ff350 0x7ffac80ff720 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7ffac40099c0 tx=0x7ffac4009cd0 comp rx=0 tx=0).stop 2023-03-17T10:46:11.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.732+0000 7ffad0547700 1 -- 172.21.15.35:0/2937152604 shutdown_connections 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.732+0000 7ffad0547700 1 --2- 172.21.15.35:0/2937152604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 0x7ffac810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.732+0000 7ffad0547700 1 --2- 172.21.15.35:0/2937152604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ff350 0x7ffac80ff720 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.732+0000 7ffad0547700 1 --2- 172.21.15.35:0/2937152604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ffcf0 0x7ffac8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- 172.21.15.35:0/2937152604 >> 172.21.15.35:0/2937152604 conn(0x7ffac8076330 msgr2=0x7ffac8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- 172.21.15.35:0/2937152604 shutdown_connections 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- 172.21.15.35:0/2937152604 wait complete. 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 Processor -- start 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- start start 2023-03-17T10:46:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 0x7ffac8197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ffcf0 0x7ffac81975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 0x7ffac81a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81a2640 con 0x7ffac80ffcf0 2023-03-17T10:46:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81a2780 con 0x7ffac80ff350 2023-03-17T10:46:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.733+0000 7ffad0547700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81a28c0 con 0x7ffac8104390 2023-03-17T10:46:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7fface2e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 0x7ffac8197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ffcf0 0x7ffac81975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7fface2e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 0x7ffac8197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53634/0 (socket says 172.21.15.35:53634) 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7fface2e3700 1 -- 172.21.15.35:0/2646339217 learned_addr learned my addr 172.21.15.35:0/2646339217 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffaceae4700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 0x7ffac81a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 -- 172.21.15.35:0/2646339217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 msgr2=0x7ffac81a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 0x7ffac81a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 -- 172.21.15.35:0/2646339217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 msgr2=0x7ffac8197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 0x7ffac8197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 -- 172.21.15.35:0/2646339217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40095f0 con 0x7ffac80ffcf0 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffaceae4700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 0x7ffac81a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7fface2e3700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 0x7ffac8197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffacdae2700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ffcf0 0x7ffac81975c0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7ffac81000c0 tx=0x7ffab800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffabf7fe700 1 -- 172.21.15.35:0/2646339217 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800cbd0 con 0x7ffac80ffcf0 2023-03-17T10:46:18.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffabf7fe700 1 -- 172.21.15.35:0/2646339217 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffab800ee80 con 0x7ffac80ffcf0 2023-03-17T10:46:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac810f000 con 0x7ffac80ffcf0 2023-03-17T10:46:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffabf7fe700 1 -- 172.21.15.35:0/2646339217 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8018680 con 0x7ffac80ffcf0 2023-03-17T10:46:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.734+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac810ee70 con 0x7ffac80ffcf0 2023-03-17T10:46:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.737+0000 7ffabf7fe700 1 -- 172.21.15.35:0/2646339217 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ffab8010430 con 0x7ffac80ffcf0 2023-03-17T10:46:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.737+0000 7ffabf7fe700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffab409f6c0 0x7ffab40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.737+0000 7fface2e3700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffab409f6c0 0x7ffab40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.737+0000 7ffabf7fe700 1 -- 172.21.15.35:0/2646339217 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(264..264 src has 1..264) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ffab8014070 con 0x7ffac80ffcf0 2023-03-17T10:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.738+0000 7fface2e3700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffab409f6c0 0x7ffab40a1b70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000c00 tx=0x7ffac4005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.738+0000 7ffadc6d4b80 1 Processor -- start 2023-03-17T10:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 -- start start 2023-03-17T10:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f64fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f5f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 0x562352f5fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352e66010 con 0x562352f654f0 2023-03-17T10:46:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352eb8950 con 0x562352f5f960 2023-03-17T10:46:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352eb1de0 con 0x562352f64be0 2023-03-17T10:46:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffaceae4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 0x562352f5fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f5f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffaceae4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 0x562352f5fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53644/0 (socket says 172.21.15.35:53644) 2023-03-17T10:46:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7fface2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f64fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffaceae4700 1 -- 172.21.15.35:0/852979067 learned_addr learned my addr 172.21.15.35:0/852979067 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 -- 172.21.15.35:0/852979067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 msgr2=0x562352f64fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f64fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 -- 172.21.15.35:0/852979067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 msgr2=0x562352f5fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 0x562352f5fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 -- 172.21.15.35:0/852979067 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562352d335d0 con 0x562352f654f0 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffaceae4700 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 0x562352f5fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.739+0000 7ffacdae2700 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f5f420 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7ffab80c7fc0 tx=0x7ffab8097c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337c065fd91dafdc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffabcff9700 1 -- 172.21.15.35:0/852979067 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80af070 con 0x562352f654f0 2023-03-17T10:46:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffabcff9700 1 -- 172.21.15.35:0/852979067 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffab80982e0 con 0x562352f654f0 2023-03-17T10:46:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffabcff9700 1 -- 172.21.15.35:0/852979067 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8098540 con 0x562352f654f0 2023-03-17T10:46:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/852979067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 msgr2=0x562352f5f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f5f420 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7ffab80c7fc0 tx=0x7ffab8097c40 comp rx=0 tx=0).stop 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/852979067 shutdown_connections 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f5f960 0x562352f5fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f64fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/852979067 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f5f420 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.740+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/852979067 >> 172.21.15.35:0/852979067 conn(0x562352dbc6b0 msgr2=0x562352f59a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/852979067 shutdown_connections 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/852979067 wait complete. 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 -- start start 2023-03-17T10:46:24.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 Processor -- start 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f6b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f68e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352d358c0 con 0x562352f654f0 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352f695b0 con 0x562352f64be0 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352f75000 con 0x562352f5f960 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffadc6d4b80 10 client.0 _ll_register_callbacks cb 0x562352d57230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7fface2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f6b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7ffacdae2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.741+0000 7fface2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f6b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43618/0 (socket says 172.21.15.35:43618) 2023-03-17T10:46:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7fface2e3700 1 -- 172.21.15.35:0/2030888044 learned_addr learned my addr 172.21.15.35:0/2030888044 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffaceae4700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f68e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffacdae2700 1 -- 172.21.15.35:0/2030888044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 msgr2=0x562352f6b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffacdae2700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f6b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffacdae2700 1 -- 172.21.15.35:0/2030888044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 msgr2=0x562352f68e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffacdae2700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f68e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffacdae2700 1 -- 172.21.15.35:0/2030888044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac810ee70 con 0x562352f64be0 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffaceae4700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f68e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:46:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7fface2e3700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f6b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffacdae2700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000c00 tx=0x7ffab8009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f00316a8f5a7892 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffab1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffab1ffb700 1 -- 172.21.15.35:0/2030888044 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80af040 con 0x562352f64be0 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562352e74390 con 0x562352f64be0 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffab1ffb700 1 -- 172.21.15.35:0/2030888044 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(264..264 src has 1..264) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ffab80a04d0 con 0x562352f64be0 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffab1ffb700 1 -- 172.21.15.35:0/2030888044 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab80b62d0 con 0x562352f64be0 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffadc6d4b80 10 client.28535 fetch_fsmap learned FSMap version 50 2023-03-17T10:46:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.742+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x562352cdfd80 con 0x562352f64be0 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffab1ffb700 1 -- 172.21.15.35:0/2030888044 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffab807b080 con 0x562352f64be0 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffab1ffb700 1 -- 172.21.15.35:0/2030888044 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ffab80abb80 con 0x562352f64be0 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffadc6d4b80 10 client.28535 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffadc6d4b80 10 client.28535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffadc6d4b80 20 client.28535 populate_metadata read hostname 'smithi035' 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352f78c10 0x562352f7aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffadc6d4b80 4 client.28535 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:46:28.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562352e80600 con 0x562352f78c10 2023-03-17T10:46:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7fface2e3700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352f78c10 0x562352f7aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:29.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7ffab1ffb700 10 client.28535 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:46:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.743+0000 7fface2e3700 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352f78c10 0x562352f7aff0 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3fb590c053c9d75 server_cookie=83a16f4ca8a0a42d in_seq=0 out_seq=0 2023-03-17T10:46:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffab1ffb700 1 -- 172.21.15.35:0/2030888044 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562352e80600 con 0x562352f78c10 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffab1ffb700 10 client.28535 handle_command_reply: tid=0 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 client.28535 shutdown 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 msgr2=0x562352f687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000c00 tx=0x7ffab8009ef0 comp rx=0 tx=0).stop 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 shutdown_connections 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352f78c10 0x562352f7aff0 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f68e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f6b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffab1ffb700 0 client.28535 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:46:32.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/2030888044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f687a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:32.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 >> 172.21.15.35:0/2030888044 conn(0x562352dbc6b0 msgr2=0x562352f5e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:32.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 shutdown_connections 2023-03-17T10:46:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/2030888044 wait complete. 2023-03-17T10:46:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.744+0000 7ffadc6d4b80 20 client.28535 trim_cache size 0 max 16384 2023-03-17T10:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 Processor -- start 2023-03-17T10:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 -- start start 2023-03-17T10:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f6ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f746e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352f5a000 con 0x562352f654f0 2023-03-17T10:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352f550d0 con 0x562352f64be0 2023-03-17T10:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352f56b60 con 0x562352f5f960 2023-03-17T10:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffaceae4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffaceae4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51864/0 (socket says 172.21.15.35:51864) 2023-03-17T10:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffacdae2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f6ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7ffaceae4700 1 -- 172.21.15.35:0/1511346197 learned_addr learned my addr 172.21.15.35:0/1511346197 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.760+0000 7fface2e3700 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffaceae4700 1 -- 172.21.15.35:0/1511346197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 msgr2=0x562352f59ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffaceae4700 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f59ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffaceae4700 1 -- 172.21.15.35:0/1511346197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 msgr2=0x562352f6ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffaceae4700 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f6ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffaceae4700 1 -- 172.21.15.35:0/1511346197 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562352e78130 con 0x562352f654f0 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffacdae2700 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f6ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffaceae4700 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f746e0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009e40 tx=0x7ffac00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115ac49476d523e1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffabd7fa700 1 -- 172.21.15.35:0/1511346197 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0004db0 con 0x562352f654f0 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffabd7fa700 1 -- 172.21.15.35:0/1511346197 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffac000f040 con 0x562352f654f0 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.761+0000 7ffabd7fa700 1 -- 172.21.15.35:0/1511346197 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0005280 con 0x562352f654f0 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1511346197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 msgr2=0x562352f746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f746e0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009e40 tx=0x7ffac00077e0 comp rx=0 tx=0).stop 2023-03-17T10:46:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1511346197 shutdown_connections 2023-03-17T10:46:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f654f0 0x562352f746e0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f5f960 0x562352f59ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1511346197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f64be0 0x562352f6ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1511346197 >> 172.21.15.35:0/1511346197 conn(0x562352dbc6b0 msgr2=0x562352f6b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1511346197 shutdown_connections 2023-03-17T10:46:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1511346197 wait complete. 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 65430 8.07 MB/sec execute 313 sec latency 60.816 ms 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 65592 8.07 MB/sec execute 314 sec latency 62.347 ms 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 65747 8.08 MB/sec execute 315 sec latency 70.816 ms 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 65881 8.07 MB/sec execute 316 sec latency 134.927 ms 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66033 8.07 MB/sec execute 317 sec latency 65.700 ms 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66166 8.06 MB/sec execute 318 sec latency 68.911 ms 2023-03-17T10:46:38.944 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66335 8.09 MB/sec execute 319 sec latency 58.543 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66506 8.10 MB/sec execute 320 sec latency 63.508 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66641 8.10 MB/sec execute 321 sec latency 107.409 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66777 8.09 MB/sec execute 322 sec latency 57.348 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 66912 8.08 MB/sec execute 323 sec latency 69.713 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67037 8.06 MB/sec execute 324 sec latency 84.727 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67189 8.06 MB/sec execute 325 sec latency 81.599 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67323 8.04 MB/sec execute 326 sec latency 76.177 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67464 8.04 MB/sec execute 327 sec latency 89.661 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67621 8.05 MB/sec execute 328 sec latency 77.672 ms 2023-03-17T10:46:40.752 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67788 8.05 MB/sec execute 329 sec latency 99.784 ms 2023-03-17T10:46:41.494 INFO:tasks.workunit.client.0.smithi035.stdout: 10 67937 8.07 MB/sec execute 330 sec latency 99.725 ms 2023-03-17T10:46:41.494 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68075 8.07 MB/sec execute 331 sec latency 71.889 ms 2023-03-17T10:46:41.494 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68234 8.06 MB/sec execute 332 sec latency 85.574 ms 2023-03-17T10:46:41.494 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68371 8.06 MB/sec execute 333 sec latency 78.331 ms 2023-03-17T10:46:43.157 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68485 8.05 MB/sec execute 334 sec latency 139.886 ms 2023-03-17T10:46:43.157 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68617 8.05 MB/sec execute 335 sec latency 86.692 ms 2023-03-17T10:46:43.959 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68771 8.05 MB/sec execute 336 sec latency 77.314 ms 2023-03-17T10:46:43.959 INFO:tasks.workunit.client.0.smithi035.stdout: 10 68907 8.05 MB/sec execute 337 sec latency 74.194 ms 2023-03-17T10:46:43.959 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69059 8.05 MB/sec execute 338 sec latency 66.335 ms 2023-03-17T10:46:43.959 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69191 8.05 MB/sec execute 339 sec latency 96.598 ms 2023-03-17T10:46:43.959 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69340 8.05 MB/sec execute 340 sec latency 78.652 ms 2023-03-17T10:46:43.959 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69499 8.05 MB/sec execute 341 sec latency 84.954 ms 2023-03-17T10:46:44.489 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69640 8.04 MB/sec execute 342 sec latency 86.871 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69798 8.06 MB/sec execute 343 sec latency 70.772 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 69949 8.06 MB/sec execute 344 sec latency 66.806 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70077 8.06 MB/sec execute 345 sec latency 63.979 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70206 8.06 MB/sec execute 346 sec latency 70.084 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70362 8.06 MB/sec execute 347 sec latency 119.288 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70502 8.05 MB/sec execute 348 sec latency 78.671 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70633 8.04 MB/sec execute 349 sec latency 64.954 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70765 8.02 MB/sec execute 350 sec latency 76.204 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 70906 8.03 MB/sec execute 351 sec latency 65.059 ms 2023-03-17T10:46:45.483 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71063 8.03 MB/sec execute 352 sec latency 68.801 ms 2023-03-17T10:46:47.084 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71226 8.04 MB/sec execute 353 sec latency 68.087 ms 2023-03-17T10:46:49.037 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71368 8.04 MB/sec execute 354 sec latency 66.500 ms 2023-03-17T10:46:49.038 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71531 8.04 MB/sec execute 355 sec latency 67.445 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71704 8.05 MB/sec execute 356 sec latency 83.906 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71846 8.04 MB/sec execute 357 sec latency 69.233 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 71990 8.04 MB/sec execute 358 sec latency 69.888 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 72126 8.04 MB/sec execute 359 sec latency 67.058 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 72284 8.05 MB/sec execute 360 sec latency 62.966 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 72425 8.04 MB/sec execute 361 sec latency 61.854 ms 2023-03-17T10:46:50.312 INFO:tasks.workunit.client.0.smithi035.stdout: 10 72565 8.04 MB/sec execute 362 sec latency 135.078 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 72713 8.04 MB/sec execute 363 sec latency 95.621 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 72872 8.04 MB/sec execute 364 sec latency 71.205 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73006 8.03 MB/sec execute 365 sec latency 119.014 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73139 8.03 MB/sec execute 366 sec latency 72.669 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73289 8.04 MB/sec execute 367 sec latency 76.823 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73451 8.04 MB/sec execute 368 sec latency 71.900 ms 2023-03-17T10:46:50.313 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73600 8.05 MB/sec execute 369 sec latency 70.811 ms 2023-03-17T10:46:50.961 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73730 8.04 MB/sec execute 370 sec latency 77.161 ms 2023-03-17T10:46:50.961 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73872 8.04 MB/sec execute 371 sec latency 75.082 ms 2023-03-17T10:46:50.961 INFO:tasks.workunit.client.0.smithi035.stdout: 10 73999 8.03 MB/sec execute 372 sec latency 74.236 ms 2023-03-17T10:46:50.961 INFO:tasks.workunit.client.0.smithi035.stdout: 10 74140 8.02 MB/sec execute 373 sec latency 75.957 ms 2023-03-17T10:46:50.961 INFO:tasks.workunit.client.0.smithi035.stdout: 10 74294 8.02 MB/sec execute 374 sec latency 71.707 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 74441 8.02 MB/sec execute 375 sec latency 128.227 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 74566 8.02 MB/sec execute 376 sec latency 98.025 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 74718 8.02 MB/sec execute 377 sec latency 98.276 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 74869 8.03 MB/sec execute 378 sec latency 74.565 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75021 8.03 MB/sec execute 379 sec latency 65.317 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75171 8.04 MB/sec execute 380 sec latency 72.636 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75305 8.03 MB/sec execute 381 sec latency 65.242 ms 2023-03-17T10:46:51.772 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75419 8.03 MB/sec execute 382 sec latency 132.975 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75550 8.02 MB/sec execute 383 sec latency 75.620 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75711 8.03 MB/sec execute 384 sec latency 93.499 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75850 8.02 MB/sec execute 385 sec latency 71.540 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 75988 8.02 MB/sec execute 386 sec latency 69.030 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 76139 8.02 MB/sec execute 387 sec latency 75.083 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 76300 8.02 MB/sec execute 388 sec latency 74.416 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 76451 8.02 MB/sec execute 389 sec latency 69.998 ms 2023-03-17T10:46:52.741 INFO:tasks.workunit.client.0.smithi035.stdout: 10 76569 8.02 MB/sec execute 390 sec latency 103.282 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 76720 8.02 MB/sec execute 391 sec latency 66.328 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 76887 8.03 MB/sec execute 392 sec latency 66.175 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77013 8.02 MB/sec execute 393 sec latency 134.845 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77136 8.02 MB/sec execute 394 sec latency 80.933 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77264 8.00 MB/sec execute 395 sec latency 117.614 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77403 8.00 MB/sec execute 396 sec latency 66.904 ms 2023-03-17T10:46:52.742 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77543 7.99 MB/sec execute 397 sec latency 79.686 ms 2023-03-17T10:46:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- start start 2023-03-17T10:46:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 Processor -- start 2023-03-17T10:46:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 0x562352f70120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f6e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f654f0 0x562352f6ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352f6f380 con 0x562352f5f960 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352fcca60 con 0x562352f654f0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.762+0000 7ffadc6d4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562352fccba0 con 0x562352f64be0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffadc6d4b80 10 client.0 _ll_register_callbacks cb 0x562352d57230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 0x562352f70120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 0x562352f70120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51866/0 (socket says 172.21.15.35:51866) 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 -- 172.21.15.35:0/1714429242 learned_addr learned my addr 172.21.15.35:0/1714429242 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffacdae2700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f6e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffaceae4700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f654f0 0x562352f6ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 -- 172.21.15.35:0/1714429242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 msgr2=0x562352f6e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f6e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 -- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f654f0 msgr2=0x562352f6ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f654f0 0x562352f6ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 -- 172.21.15.35:0/1714429242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562352cdfd80 con 0x562352f5f960 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7fface2e3700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 0x562352f70120 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x562352f7b8d0 tx=0x7ffac4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d164786970ac3245 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffab1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffab1ffb700 1 -- 172.21.15.35:0/1714429242 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4029040 con 0x562352f5f960 2023-03-17T10:46:56.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562352f2f1e0 con 0x562352f5f960 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffab1ffb700 1 -- 172.21.15.35:0/1714429242 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(264..264 src has 1..264) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ffac40038a0 con 0x562352f5f960 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffab1ffb700 1 -- 172.21.15.35:0/1714429242 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac4003a60 con 0x562352f5f960 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffadc6d4b80 10 client.19380 fetch_fsmap learned FSMap version 50 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.763+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7ffac0009af0 con 0x562352f5f960 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffab1ffb700 1 -- 172.21.15.35:0/1714429242 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562352f2f1e0 con 0x562352f5f960 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffab1ffb700 1 -- 172.21.15.35:0/1714429242 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ffac400fbb0 con 0x562352f5f960 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffadc6d4b80 10 client.19380 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffadc6d4b80 10 client.19380 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffadc6d4b80 20 client.19380 populate_metadata read hostname 'smithi035' 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352fce1f0 0x562352fd0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffadc6d4b80 4 client.19380 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562352d35f00 con 0x562352fce1f0 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffacdae2700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352fce1f0 0x562352fd0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:46:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffacdae2700 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352fce1f0 0x562352fd0600 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d05efb4ed6148be server_cookie=804710d5f22a6d56 in_seq=0 out_seq=0 2023-03-17T10:46:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.764+0000 7ffab1ffb700 10 client.19380 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:46:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.787+0000 7ffab1ffb700 1 -- 172.21.15.35:0/1714429242 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562352d35f00 con 0x562352fce1f0 2023-03-17T10:46:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.787+0000 7ffab1ffb700 10 client.19380 handle_command_reply: tid=0 2023-03-17T10:46:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.787+0000 7ffadc6d4b80 1 client.19380 shutdown 2023-03-17T10:46:57.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.787+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 msgr2=0x562352f70120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:57.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.787+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 0x562352f70120 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x562352f7b8d0 tx=0x7ffac4009cd0 comp rx=0 tx=0).stop 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 shutdown_connections 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562352fce1f0 0x562352fd0600 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562352f654f0 0x562352f6ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562352f5f960 0x562352f70120 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 --2- 172.21.15.35:0/1714429242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562352f64be0 0x562352f6e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffab1ffb700 0 client.19380 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:46:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 >> 172.21.15.35:0/1714429242 conn(0x562352dbc6b0 msgr2=0x562352f62650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 shutdown_connections 2023-03-17T10:46:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 1 -- 172.21.15.35:0/1714429242 wait complete. 2023-03-17T10:46:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffadc6d4b80 20 client.19380 trim_cache size 0 max 16384 2023-03-17T10:46:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffab409f6c0 msgr2=0x7ffab40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffab409f6c0 0x7ffab40a1b70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000c00 tx=0x7ffac4005fb0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ffcf0 msgr2=0x7ffac81975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ffcf0 0x7ffac81975c0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7ffac81000c0 tx=0x7ffab800eca0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 shutdown_connections 2023-03-17T10:46:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffab409f6c0 0x7ffab40a1b70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffac8104390 0x7ffac81a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac80ff350 0x7ffac8197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 --2- 172.21.15.35:0/2646339217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffac80ffcf0 0x7ffac81975c0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.788+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 >> 172.21.15.35:0/2646339217 conn(0x7ffac8076330 msgr2=0x7ffac80fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.789+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 shutdown_connections 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:02.789+0000 7ffad0547700 1 -- 172.21.15.35:0/2646339217 wait complete. 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.913+0000 7fc98a63c700 1 -- 172.21.15.35:0/2906595834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc9840ffcf0 msgr2=0x7fc984103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.913+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2906595834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc9840ffcf0 0x7fc984103cb0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc978009920 tx=0x7fc978009c30 comp rx=0 tx=0).stop 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.913+0000 7fc98a63c700 1 -- 172.21.15.35:0/2906595834 shutdown_connections 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.913+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2906595834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc984104390 0x7fc98410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.913+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2906595834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 0x7fc9840ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.913+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2906595834 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc9840ffcf0 0x7fc984103cb0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.914+0000 7fc98a63c700 1 -- 172.21.15.35:0/2906595834 >> 172.21.15.35:0/2906595834 conn(0x7fc984076330 msgr2=0x7fc984076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.914+0000 7fc98a63c700 1 -- 172.21.15.35:0/2906595834 shutdown_connections 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.914+0000 7fc98a63c700 1 -- 172.21.15.35:0/2906595834 wait complete. 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.914+0000 7fc98a63c700 1 Processor -- start 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.914+0000 7fc98a63c700 1 -- start start 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc98a63c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 0x7fc9841111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc98a63c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9840ffcf0 0x7fc98410f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc98a63c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 0x7fc98410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:46:59.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc98a63c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9841103c0 con 0x7fc984104390 2023-03-17T10:46:59.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc98a63c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc984110530 con 0x7fc9840ff350 2023-03-17T10:47:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc98a63c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9841106f0 con 0x7fc9840ffcf0 2023-03-17T10:47:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 0x7fc9841111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 0x7fc98410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9840ffcf0 0x7fc98410f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 0x7fc98410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51884/0 (socket says 172.21.15.35:51884) 2023-03-17T10:47:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9840ffcf0 0x7fc98410f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43648/0 (socket says 172.21.15.35:43648) 2023-03-17T10:47:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 0x7fc9841111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53676/0 (socket says 172.21.15.35:53676) 2023-03-17T10:47:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 -- 172.21.15.35:0/2805110746 learned_addr learned my addr 172.21.15.35:0/2805110746 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 -- 172.21.15.35:0/2805110746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9840ffcf0 msgr2=0x7fc98410f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9840ffcf0 0x7fc98410f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 -- 172.21.15.35:0/2805110746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 msgr2=0x7fc9841111a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 0x7fc9841111a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 -- 172.21.15.35:0/2805110746 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978009520 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc988bd9700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 0x7fc98410fdb0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c110 tx=0x7fc97c00c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.915+0000 7fc9817fa700 1 -- 172.21.15.35:0/2805110746 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c017070 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.916+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98410efc0 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.916+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98410ee30 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.916+0000 7fc9817fa700 1 -- 172.21.15.35:0/2805110746 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97c00e050 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.916+0000 7fc9817fa700 1 -- 172.21.15.35:0/2805110746 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c007820 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.919+0000 7fc9817fa700 1 -- 172.21.15.35:0/2805110746 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc97c0092e0 con 0x7fc984104390 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 Processor -- start 2023-03-17T10:47:01.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 -- start start 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9817fa700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc96c09f640 0x7fc96c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 0x555ffad93fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad8ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffac95010 con 0x555ffad944f0 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fface7950 con 0x555ffad93be0 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fface0de0 con 0x555ffad8e960 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9817fa700 1 -- 172.21.15.35:0/2805110746 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc97c0c9d70 con 0x7fc984104390 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9837fe700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc96c09f640 0x7fc96c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc988bd9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad8ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 0x555ffad93fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc988bd9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad8ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43658/0 (socket says 172.21.15.35:43658) 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc988bd9700 1 -- 172.21.15.35:0/3912139342 learned_addr learned my addr 172.21.15.35:0/3912139342 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.920+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 0x555ffad93fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53684/0 (socket says 172.21.15.35:53684) 2023-03-17T10:47:01.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc988bd9700 1 -- 172.21.15.35:0/3912139342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 msgr2=0x555ffad93fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc988bd9700 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 0x555ffad93fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc988bd9700 1 -- 172.21.15.35:0/3912139342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 msgr2=0x555ffad8e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc988bd9700 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad8e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc988bd9700 1 -- 172.21.15.35:0/3912139342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ffab625d0 con 0x555ffad8e960 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc983fff700 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 0x555ffad93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc9837fe700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc96c09f640 0x7fc96c0a1af0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc978005e90 tx=0x7fc97800bf80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc988bd9700 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad8ed90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc97c09f4e0 tx=0x7fc97c0977b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b21523924b5f113 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc96a7fc700 1 -- 172.21.15.35:0/3912139342 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c09fa10 con 0x555ffad8e960 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc96a7fc700 1 -- 172.21.15.35:0/3912139342 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97c00f040 con 0x555ffad8e960 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.921+0000 7fc96a7fc700 1 -- 172.21.15.35:0/3912139342 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c097000 con 0x555ffad8e960 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 -- 172.21.15.35:0/3912139342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 msgr2=0x555ffad8ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad8ed90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc97c09f4e0 tx=0x7fc97c0977b0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 -- 172.21.15.35:0/3912139342 shutdown_connections 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad8ed90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad93be0 0x555ffad93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/3912139342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad8e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 -- 172.21.15.35:0/3912139342 >> 172.21.15.35:0/3912139342 conn(0x555ffabeb6b0 msgr2=0x555ffad88a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 -- 172.21.15.35:0/3912139342 shutdown_connections 2023-03-17T10:47:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 -- 172.21.15.35:0/3912139342 wait complete. 2023-03-17T10:47:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.922+0000 7fc9967c9b80 1 -- start start 2023-03-17T10:47:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 Processor -- start 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad976c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad944f0 0x555ffad97c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffab648c0 con 0x555ffad93be0 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffad983f0 con 0x555ffad8e960 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffada3ee0 con 0x555ffad944f0 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9967c9b80 10 client.0 _ll_register_callbacks cb 0x555ffab86230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad976c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51896/0 (socket says 172.21.15.35:51896) 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc9837fe700 1 -- 172.21.15.35:0/4163826289 learned_addr learned my addr 172.21.15.35:0/4163826289 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:04.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc988bd9700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad944f0 0x555ffad97c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc983fff700 1 -- 172.21.15.35:0/4163826289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad944f0 msgr2=0x555ffad97c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.923+0000 7fc983fff700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad944f0 0x555ffad97c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc983fff700 1 -- 172.21.15.35:0/4163826289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 msgr2=0x555ffad976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc983fff700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc983fff700 1 -- 172.21.15.35:0/4163826289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98410ee30 con 0x555ffad8e960 2023-03-17T10:47:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc988bd9700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad944f0 0x555ffad97c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:47:04.802 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77701 7.99 MB/sec execute 398 sec latency 62.363 ms 2023-03-17T10:47:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9837fe700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc983fff700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9a3d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc974017e40 tx=0x7fc97400e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4b7c622a785a39f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9637fe700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9637fe700 1 -- 172.21.15.35:0/4163826289 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974004230 con 0x555ffad8e960 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9637fe700 1 -- 172.21.15.35:0/4163826289 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc974004390 con 0x555ffad8e960 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ffaca3390 con 0x555ffad8e960 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9637fe700 1 -- 172.21.15.35:0/4163826289 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc974004550 con 0x555ffad8e960 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9967c9b80 10 client.28553 fetch_fsmap learned FSMap version 50 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x555ffab0ed80 con 0x555ffad8e960 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.924+0000 7fc9637fe700 1 -- 172.21.15.35:0/4163826289 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ffaca3390 con 0x555ffad8e960 2023-03-17T10:47:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9637fe700 1 -- 172.21.15.35:0/4163826289 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc97402a530 con 0x555ffad8e960 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9967c9b80 10 client.28553 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9967c9b80 10 client.28553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9967c9b80 20 client.28553 populate_metadata read hostname 'smithi035' 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffada7ff0 0x555ffadaa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9967c9b80 4 client.28553 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ffacaf600 con 0x555ffada7ff0 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9837fe700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffada7ff0 0x555ffadaa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9637fe700 10 client.28553 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:07.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.925+0000 7fc9837fe700 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffada7ff0 0x555ffadaa400 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=308c46b950be1338 server_cookie=479b73653efd5a3e in_seq=0 out_seq=0 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9637fe700 1 -- 172.21.15.35:0/4163826289 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555ffacaf600 con 0x555ffada7ff0 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9637fe700 10 client.28553 handle_command_reply: tid=0 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 client.28553 shutdown 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 msgr2=0x555ffad9a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9a3d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc974017e40 tx=0x7fc97400e690 comp rx=0 tx=0).stop 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 shutdown_connections 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffada7ff0 0x555ffadaa400 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad944f0 0x555ffad97c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9a3d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/4163826289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9637fe700 0 client.28553 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.926+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 >> 172.21.15.35:0/4163826289 conn(0x555ffabeb6b0 msgr2=0x555ffad8d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.927+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 shutdown_connections 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.927+0000 7fc9967c9b80 1 -- 172.21.15.35:0/4163826289 wait complete. 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.927+0000 7fc9967c9b80 20 client.28553 trim_cache size 0 max 16384 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 Processor -- start 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 -- start start 2023-03-17T10:47:07.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad9ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad99f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad944f0 0x555ffad8d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:07.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffad840f0 con 0x555ffad93be0 2023-03-17T10:47:07.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffada5640 con 0x555ffad944f0 2023-03-17T10:47:09.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffad896d0 con 0x555ffad8e960 2023-03-17T10:47:09.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad99f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:09.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad99f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51902/0 (socket says 172.21.15.35:51902) 2023-03-17T10:47:09.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 -- 172.21.15.35:0/804785143 learned_addr learned my addr 172.21.15.35:0/804785143 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:09.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc988bd9700 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad944f0 0x555ffad8d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc983fff700 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad9ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 -- 172.21.15.35:0/804785143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 msgr2=0x555ffad9ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:16.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad9ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:16.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 -- 172.21.15.35:0/804785143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad944f0 msgr2=0x555ffad8d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:16.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad944f0 0x555ffad8d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:16.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.945+0000 7fc9837fe700 1 -- 172.21.15.35:0/804785143 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ffaca7130 con 0x555ffad93be0 2023-03-17T10:47:16.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.946+0000 7fc9837fe700 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad99f70 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc978009230 tx=0x7fc97801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad25bb525bf2fca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.946+0000 7fc96affd700 1 -- 172.21.15.35:0/804785143 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97802d040 con 0x555ffad93be0 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.946+0000 7fc96affd700 1 -- 172.21.15.35:0/804785143 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc97800bbc0 con 0x555ffad93be0 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.946+0000 7fc96affd700 1 -- 172.21.15.35:0/804785143 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9780052a0 con 0x555ffad93be0 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 -- 172.21.15.35:0/804785143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 msgr2=0x555ffad99f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad99f70 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc978009230 tx=0x7fc97801c000 comp rx=0 tx=0).stop 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 -- 172.21.15.35:0/804785143 shutdown_connections 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad944f0 0x555ffad8d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad8e960 0x555ffad9ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/804785143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad93be0 0x555ffad99f70 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 -- 172.21.15.35:0/804785143 >> 172.21.15.35:0/804785143 conn(0x555ffabeb6b0 msgr2=0x555ffad916b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 -- 172.21.15.35:0/804785143 shutdown_connections 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 -- 172.21.15.35:0/804785143 wait complete. 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 -- start start 2023-03-17T10:47:16.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 Processor -- start 2023-03-17T10:47:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.947+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad93be0 0x555ffad9cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad9d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffad9d9f0 con 0x555ffad944f0 2023-03-17T10:47:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffad9db60 con 0x555ffad8e960 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffad9dcd0 con 0x555ffad93be0 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 10 client.0 _ll_register_callbacks cb 0x555ffab86230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc988bd9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad9d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53704/0 (socket says 172.21.15.35:53704) 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 -- 172.21.15.35:0/40362359 learned_addr learned my addr 172.21.15.35:0/40362359 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9837fe700 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad93be0 0x555ffad9cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 -- 172.21.15.35:0/40362359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad93be0 msgr2=0x555ffad9cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad93be0 0x555ffad9cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 -- 172.21.15.35:0/40362359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 msgr2=0x555ffad9d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad9d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 -- 172.21.15.35:0/40362359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97801f040 con 0x555ffad8e960 2023-03-17T10:47:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc983fff700 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc974017d30 tx=0x7fc974005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee9d8697956dbf2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9637fe700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:47:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9637fe700 1 -- 172.21.15.35:0/40362359 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97402a710 con 0x555ffad8e960 2023-03-17T10:47:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9637fe700 1 -- 172.21.15.35:0/40362359 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc97402abb0 con 0x555ffad8e960 2023-03-17T10:47:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.948+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ffad5e1e0 con 0x555ffad8e960 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9637fe700 1 -- 172.21.15.35:0/40362359 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc974021770 con 0x555ffad8e960 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 10 client.28559 fetch_fsmap learned FSMap version 50 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x555ffab351f0 con 0x555ffad8e960 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9637fe700 1 -- 172.21.15.35:0/40362359 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ffad5e1e0 con 0x555ffad8e960 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9637fe700 1 -- 172.21.15.35:0/40362359 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc9740054a0 con 0x555ffad8e960 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 10 client.28559 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 10 client.28559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:47:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 20 client.28559 populate_metadata read hostname 'smithi035' 2023-03-17T10:47:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffadfd270 0x555ffadff680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 4 client.28559 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:47:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555ffab64f00 con 0x555ffadfd270 2023-03-17T10:47:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.949+0000 7fc9837fe700 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffadfd270 0x555ffadff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.950+0000 7fc9637fe700 10 client.28559 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:21.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.950+0000 7fc9837fe700 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffadfd270 0x555ffadff680 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a971dae24070cd server_cookie=790a5dca4aff8070 in_seq=0 out_seq=0 2023-03-17T10:47:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9637fe700 1 -- 172.21.15.35:0/40362359 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555ffab64f00 con 0x555ffadfd270 2023-03-17T10:47:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9637fe700 10 client.28559 handle_command_reply: tid=0 2023-03-17T10:47:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 client.28559 shutdown 2023-03-17T10:47:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 msgr2=0x555ffad9ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc974017d30 tx=0x7fc974005e00 comp rx=0 tx=0).stop 2023-03-17T10:47:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 shutdown_connections 2023-03-17T10:47:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555ffadfd270 0x555ffadff680 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555ffad944f0 0x555ffad9d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:28.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9637fe700 0 client.28559 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555ffad8e960 0x555ffad9ec40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 --2- 172.21.15.35:0/40362359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555ffad93be0 0x555ffad9cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 >> 172.21.15.35:0/40362359 conn(0x555ffabeb6b0 msgr2=0x555ffad8d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 shutdown_connections 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 1 -- 172.21.15.35:0/40362359 wait complete. 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.975+0000 7fc9967c9b80 20 client.28559 trim_cache size 0 max 16384 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc96c09f640 msgr2=0x7fc96c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc96c09f640 0x7fc96c0a1af0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc978005e90 tx=0x7fc97800bf80 comp rx=0 tx=0).stop 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 msgr2=0x7fc98410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 0x7fc98410fdb0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00c110 tx=0x7fc97c00c420 comp rx=0 tx=0).stop 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 shutdown_connections 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc96c09f640 0x7fc96c0a1af0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc984104390 0x7fc98410fdb0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9840ff350 0x7fc9841111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 --2- 172.21.15.35:0/2805110746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9840ffcf0 0x7fc98410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 >> 172.21.15.35:0/2805110746 conn(0x7fc984076330 msgr2=0x7fc984100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 shutdown_connections 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:15.976+0000 7fc98a63c700 1 -- 172.21.15.35:0/2805110746 wait complete. 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 -- 172.21.15.35:0/419634259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ff350 msgr2=0x7fec800ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 --2- 172.21.15.35:0/419634259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ff350 0x7fec800ff720 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fec700099c0 tx=0x7fec70009cd0 comp rx=0 tx=0).stop 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 -- 172.21.15.35:0/419634259 shutdown_connections 2023-03-17T10:47:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 --2- 172.21.15.35:0/419634259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec80104390 0x7fec8010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 --2- 172.21.15.35:0/419634259 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ff350 0x7fec800ff720 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 --2- 172.21.15.35:0/419634259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec800ffcf0 0x7fec80103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 -- 172.21.15.35:0/419634259 >> 172.21.15.35:0/419634259 conn(0x7fec80076330 msgr2=0x7fec80076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 -- 172.21.15.35:0/419634259 shutdown_connections 2023-03-17T10:47:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.095+0000 7fec84881700 1 -- 172.21.15.35:0/419634259 wait complete. 2023-03-17T10:47:34.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 Processor -- start 2023-03-17T10:47:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 -- start start 2023-03-17T10:47:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec800ff350 0x7fec80195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 0x7fec80195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec80104390 0x7fec80199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8019a1f0 con 0x7fec800ffcf0 2023-03-17T10:47:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8019a360 con 0x7fec800ff350 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec84881700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8019a520 con 0x7fec80104390 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 0x7fec80195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 0x7fec80195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51926/0 (socket says 172.21.15.35:51926) 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2023223993 learned_addr learned my addr 172.21.15.35:0/2023223993 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7e59c700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec800ff350 0x7fec80195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec80104390 0x7fec80199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2023223993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec80104390 msgr2=0x7fec80199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec80104390 0x7fec80199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2023223993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec800ff350 msgr2=0x7fec80195210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.096+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec800ff350 0x7fec80195210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2023223993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700095f0 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 0x7fec80195750 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d950 tx=0x7fec7400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec6f7fe700 1 -- 172.21.15.35:0/2023223993 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400f890 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec6f7fe700 1 -- 172.21.15.35:0/2023223993 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec7400fe80 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8010f080 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec6f7fe700 1 -- 172.21.15.35:0/2023223993 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400e3b0 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.097+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8010eef0 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.099+0000 7fec6f7fe700 1 -- 172.21.15.35:0/2023223993 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fec7400f9f0 con 0x7fec800ffcf0 2023-03-17T10:47:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.100+0000 7fec6f7fe700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fec6809f640 0x7fec680a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:37.622 INFO:tasks.workunit.client.0.smithi035.stdout: 10 77851 7.99 MB/sec execute 399 sec latency 71.852 ms 2023-03-17T10:47:37.622 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:10 smithi035 ceph-mon[92535]: pgmap v3578: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 195 op/s 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.100+0000 7fec6f7fe700 1 -- 172.21.15.35:0/2023223993 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fec740ca100 con 0x7fec800ffcf0 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.100+0000 7fec7e59c700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fec6809f640 0x7fec680a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.100+0000 7fec7e59c700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fec6809f640 0x7fec680a1af0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec70006010 tx=0x7fec70005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 Processor -- start 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 -- start start 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c677604fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6776054f0 0x55c6775ff420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6775ff960 0x55c6775ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c677506010 con 0x55c6775ff960 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c677558950 con 0x55c677604be0 2023-03-17T10:47:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.101+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c677551de0 con 0x55c6776054f0 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6775ff960 0x55c6775ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c677604fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c677604fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53728/0 (socket says 172.21.15.35:53728) 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7e59c700 1 -- 172.21.15.35:0/1936762021 learned_addr learned my addr 172.21.15.35:0/1936762021 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6776054f0 0x55c6775ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 -- 172.21.15.35:0/1936762021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6776054f0 msgr2=0x55c6775ff420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6776054f0 0x55c6775ff420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 -- 172.21.15.35:0/1936762021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 msgr2=0x55c677604fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c677604fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 -- 172.21.15.35:0/1936762021 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6773d35d0 con 0x55c6775ff960 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7e59c700 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c677604fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6775ff960 0x55c6775ffd90 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fec78011580 tx=0x7fec78009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45e8b4d04a0780e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec6cff9700 1 -- 172.21.15.35:0/1936762021 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800e040 con 0x55c6775ff960 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec6cff9700 1 -- 172.21.15.35:0/1936762021 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec7800f040 con 0x55c6775ff960 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.102+0000 7fec6cff9700 1 -- 172.21.15.35:0/1936762021 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78004320 con 0x55c6775ff960 2023-03-17T10:47:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 -- 172.21.15.35:0/1936762021 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6775ff960 msgr2=0x55c6775ffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6775ff960 0x55c6775ffd90 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fec78011580 tx=0x7fec78009920 comp rx=0 tx=0).stop 2023-03-17T10:47:41.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 -- 172.21.15.35:0/1936762021 shutdown_connections 2023-03-17T10:47:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6775ff960 0x55c6775ffd90 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c677604fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/1936762021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6776054f0 0x55c6775ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 -- 172.21.15.35:0/1936762021 >> 172.21.15.35:0/1936762021 conn(0x55c67745c6b0 msgr2=0x55c6775f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 -- 172.21.15.35:0/1936762021 shutdown_connections 2023-03-17T10:47:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 -- 172.21.15.35:0/1936762021 wait complete. 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.103+0000 7fec90a0eb80 1 -- start start 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 Processor -- start 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c67760b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 0x55c677608690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6776054f0 0x55c677608cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6773d58c0 con 0x55c677604be0 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6776093f0 con 0x55c6776054f0 2023-03-17T10:47:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c677615030 con 0x55c6775ff960 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec90a0eb80 10 client.0 _ll_register_callbacks cb 0x55c6773f7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 0x55c677608690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c67760b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 0x55c677608690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51940/0 (socket says 172.21.15.35:51940) 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c67760b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43704/0 (socket says 172.21.15.35:43704) 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 -- 172.21.15.35:0/723176908 learned_addr learned my addr 172.21.15.35:0/723176908 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6776054f0 0x55c677608cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 -- 172.21.15.35:0/723176908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 msgr2=0x55c67760b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c67760b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 -- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6776054f0 msgr2=0x55c677608cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6776054f0 0x55c677608cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7dd9b700 1 -- 172.21.15.35:0/723176908 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec78011230 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.104+0000 7fec7e59c700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c67760b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 0x55c677608690 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fec740c7940 tx=0x7fec7400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5e82f0c6559794 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec65ffb700 1 -- 172.21.15.35:0/723176908 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740af070 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec65ffb700 1 -- 172.21.15.35:0/723176908 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fec74097e10 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c677514390 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec65ffb700 1 -- 172.21.15.35:0/723176908 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec740b1020 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 10 client.19410 fetch_fsmap learned FSMap version 50 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55c67737fd80 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec65ffb700 1 -- 172.21.15.35:0/723176908 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c677514390 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec65ffb700 1 -- 172.21.15.35:0/723176908 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fec7409f910 con 0x55c677604be0 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 10 client.19410 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 10 client.19410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 20 client.19410 populate_metadata read hostname 'smithi035' 2023-03-17T10:47:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c677619060 0x55c67761b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 4 client.19410 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c677520600 con 0x55c677619060 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.105+0000 7fec7e59c700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c677619060 0x55c67761b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.106+0000 7fec65ffb700 10 client.19410 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.106+0000 7fec7e59c700 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c677619060 0x55c67761b440 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df74aedb4d5e060 server_cookie=59cfb561bfdcf70d in_seq=0 out_seq=0 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec65ffb700 1 -- 172.21.15.35:0/723176908 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c677520600 con 0x55c677619060 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec65ffb700 10 client.19410 handle_command_reply: tid=0 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 client.19410 shutdown 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 msgr2=0x55c677608690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:44.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 0x55c677608690 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fec740c7940 tx=0x7fec7400fd10 comp rx=0 tx=0).stop 2023-03-17T10:47:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 shutdown_connections 2023-03-17T10:47:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c677619060 0x55c67761b440 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:46.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6776054f0 0x55c677608cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec65ffb700 0 client.19410 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c67760b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/723176908 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c677604be0 0x55c677608690 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:47.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 >> 172.21.15.35:0/723176908 conn(0x55c67745c6b0 msgr2=0x55c6775f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 shutdown_connections 2023-03-17T10:47:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 1 -- 172.21.15.35:0/723176908 wait complete. 2023-03-17T10:47:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.107+0000 7fec90a0eb80 20 client.19410 trim_cache size 0 max 16384 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 Processor -- start 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 -- start start 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6775ff960 0x55c6775f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c677604be0 0x55c6776060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c677514390 con 0x55c6776054f0 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6775fa710 con 0x55c6775ff960 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.125+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6775fa000 con 0x55c677604be0 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6775ff960 0x55c6775f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c677604be0 0x55c6776060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51950/0 (socket says 172.21.15.35:51950) 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7ed9d700 1 -- 172.21.15.35:0/2232773056 learned_addr learned my addr 172.21.15.35:0/2232773056 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2232773056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6775ff960 msgr2=0x55c6775f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6775ff960 0x55c6775f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2232773056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 msgr2=0x55c67760afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 -- 172.21.15.35:0/2232773056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c677518130 con 0x55c677604be0 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c677604be0 0x55c6776060a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec74097b40 tx=0x7fec74094020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a82a6ee858a6b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec6d7fa700 1 -- 172.21.15.35:0/2232773056 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740af070 con 0x55c677604be0 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec6d7fa700 1 -- 172.21.15.35:0/2232773056 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec740939f0 con 0x55c677604be0 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.126+0000 7fec6d7fa700 1 -- 172.21.15.35:0/2232773056 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740b1040 con 0x55c677604be0 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2232773056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c677604be0 msgr2=0x55c6776060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:47:50.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c677604be0 0x55c6776060a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec74097b40 tx=0x7fec74094020 comp rx=0 tx=0).stop 2023-03-17T10:47:50.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2232773056 shutdown_connections 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6775ff960 0x55c6775f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2232773056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c677604be0 0x55c6776060a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2232773056 >> 172.21.15.35:0/2232773056 conn(0x55c67745c6b0 msgr2=0x55c677605990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2232773056 shutdown_connections 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.127+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2232773056 wait complete. 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 -- start start 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 Processor -- start 2023-03-17T10:47:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c677668380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c6776688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67760e4a0 con 0x55c6776054f0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67760e5e0 con 0x55c677604be0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67760e7a0 con 0x55c6775ff960 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec90a0eb80 10 client.0 _ll_register_callbacks cb 0x55c6773f7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51956/0 (socket says 172.21.15.35:51956) 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 -- 172.21.15.35:0/2218756784 learned_addr learned my addr 172.21.15.35:0/2218756784 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c6776688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7e59c700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c677668380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 -- 172.21.15.35:0/2218756784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 msgr2=0x55c677668380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c677668380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 -- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 msgr2=0x55c6776688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c6776688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7ed9d700 1 -- 172.21.15.35:0/2218756784 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6773d35d0 con 0x55c6776054f0 2023-03-17T10:47:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.128+0000 7fec7dd9b700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c6776688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec7ed9d700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760df60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fec7800b010 tx=0x7fec78009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c029233c98ef7a96 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec65ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec65ffb700 1 -- 172.21.15.35:0/2218756784 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800e040 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6775cf1e0 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec65ffb700 1 -- 172.21.15.35:0/2218756784 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fec780079d0 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec65ffb700 1 -- 172.21.15.35:0/2218756784 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec78007bd0 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec90a0eb80 10 client.19416 fetch_fsmap learned FSMap version 50 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55c67737fd80 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec65ffb700 1 -- 172.21.15.35:0/2218756784 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c6775cf1e0 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec65ffb700 1 -- 172.21.15.35:0/2218756784 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fec7801b020 con 0x55c6776054f0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec90a0eb80 10 client.19416 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec90a0eb80 10 client.19416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.129+0000 7fec90a0eb80 20 client.19416 populate_metadata read hostname 'smithi035' 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.130+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c67761c0c0 0x55c67761c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.130+0000 7fec90a0eb80 4 client.19416 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.130+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c6773d5f00 con 0x55c67761c0c0 2023-03-17T10:47:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.130+0000 7fec7e59c700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c67761c0c0 0x55c67761c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:47:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.130+0000 7fec65ffb700 10 client.19416 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:47:51.650 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:12 smithi035 ceph-mon[92535]: pgmap v3579: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 151 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:12 smithi035 ceph-mon[92535]: osdmap e298: 12 total, 12 up, 12 in 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:14 smithi035 ceph-mon[92535]: pgmap v3581: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 294 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:16 smithi035 ceph-mon[92535]: pgmap v3582: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 235 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:17 smithi035 ceph-mon[92535]: pgmap v3583: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:20 smithi035 ceph-mon[92535]: pgmap v3584: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:22 smithi035 ceph-mon[92535]: pgmap v3585: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:24 smithi035 ceph-mon[92535]: pgmap v3586: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 290 op/s 2023-03-17T10:47:53.718 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:26 smithi035 ceph-mon[92535]: pgmap v3587: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 183 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:27 smithi035 ceph-mon[92535]: pgmap v3588: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 299 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:30 smithi035 ceph-mon[92535]: pgmap v3589: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 203 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:32 smithi035 ceph-mon[92535]: pgmap v3590: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 203 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:34 smithi035 ceph-mon[92535]: pgmap v3591: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 297 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:36 smithi035 ceph-mon[92535]: pgmap v3592: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 210 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:37 smithi035 ceph-mon[92535]: pgmap v3593: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 314 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:40 smithi035 ceph-mon[92535]: pgmap v3594: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:42 smithi035 ceph-mon[92535]: pgmap v3595: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:44 smithi035 ceph-mon[92535]: pgmap v3596: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 293 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:46 smithi035 ceph-mon[92535]: pgmap v3597: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 199 op/s 2023-03-17T10:47:53.719 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:47 smithi035 ceph-mon[92535]: pgmap v3598: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.4 MiB/s wr, 298 op/s 2023-03-17T10:47:55.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:50 smithi035 ceph-mon[92535]: pgmap v3599: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 193 op/s 2023-03-17T10:47:55.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:52 smithi035 ceph-mon[92535]: pgmap v3600: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 193 op/s 2023-03-17T10:47:55.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:54 smithi035 ceph-mon[92535]: pgmap v3601: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 304 op/s 2023-03-17T10:47:55.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:56 smithi035 ceph-mon[92535]: pgmap v3602: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 210 op/s 2023-03-17T10:47:55.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:35:57 smithi035 ceph-mon[92535]: pgmap v3603: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.8 MiB/s wr, 305 op/s 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:00 smithi035 ceph-mon[92535]: pgmap v3604: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 206 op/s 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:02 smithi035 ceph-mon[92535]: pgmap v3605: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 206 op/s 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:04 smithi035 ceph-mon[92535]: pgmap v3606: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 324 op/s 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:04 smithi035 ceph-mon[92535]: osdmap e299: 12 total, 12 up, 12 in 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:06 smithi035 ceph-mon[92535]: pgmap v3608: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 255 op/s 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:47:55.970 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:07 smithi035 ceph-mon[92535]: pgmap v3609: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 157 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:07 smithi035 ceph-mon[92535]: pgmap v3610: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 203 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:09 smithi035 ceph-mon[92535]: pgmap v3611: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.2 MiB/s wr, 362 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:11 smithi035 ceph-mon[92535]: pgmap v3612: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 158 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:12 smithi035 ceph-mon[92535]: osdmap e300: 12 total, 12 up, 12 in 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:12 smithi035 ceph-mon[92535]: pgmap v3614: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.7 MiB/s wr, 329 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:15 smithi035 ceph-mon[92535]: pgmap v3615: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.6 MiB/s wr, 287 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:17 smithi035 ceph-mon[92535]: pgmap v3616: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 229 op/s 2023-03-17T10:47:55.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:19 smithi035 ceph-mon[92535]: pgmap v3617: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 245 op/s 2023-03-17T10:47:55.972 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:21 smithi035 ceph-mon[92535]: pgmap v3618: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 245 op/s 2023-03-17T10:47:57.198 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:22 smithi035 ceph-mon[92535]: pgmap v3619: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.2 MiB/s wr, 350 op/s 2023-03-17T10:47:57.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:25 smithi035 ceph-mon[92535]: pgmap v3620: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T10:47:57.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:27 smithi035 ceph-mon[92535]: pgmap v3621: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T10:47:57.199 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:29 smithi035 ceph-mon[92535]: pgmap v3622: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 339 op/s 2023-03-17T10:47:57.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:30 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:47:57.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:31 smithi035 ceph-mon[92535]: pgmap v3623: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 233 op/s 2023-03-17T10:47:57.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:32 smithi035 ceph-mon[92535]: pgmap v3624: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 326 op/s 2023-03-17T10:47:57.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:35 smithi035 ceph-mon[92535]: pgmap v3625: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2023-03-17T10:47:58.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:37 smithi035 ceph-mon[92535]: pgmap v3626: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2023-03-17T10:47:58.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:38 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T10:47:58.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:38 smithi035 ceph-mon[92535]: osdmap e301: 12 total, 12 up, 12 in 2023-03-17T10:47:58.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:39 smithi035 ceph-mon[92535]: pgmap v3628: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 242 op/s 2023-03-17T10:47:58.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:39 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/515552454,v1:172.21.15.35:6837/515552454] up:boot 2023-03-17T10:47:58.467 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:39 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:39 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:41 smithi035 ceph-mon[92535]: pgmap v3629: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 242 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:42 smithi035 ceph-mon[92535]: pgmap v3630: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:45 smithi035 ceph-mon[92535]: pgmap v3631: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:47 smithi035 ceph-mon[92535]: pgmap v3632: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:49 smithi035 ceph-mon[92535]: pgmap v3633: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 256 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:51 smithi035 ceph-mon[92535]: pgmap v3634: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 216 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:52 smithi035 ceph-mon[92535]: pgmap v3635: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 337 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:55 smithi035 ceph-mon[92535]: pgmap v3636: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:57 smithi035 ceph-mon[92535]: pgmap v3637: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:36:59 smithi035 ceph-mon[92535]: pgmap v3638: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 316 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:01 smithi035 ceph-mon[92535]: pgmap v3639: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:02 smithi035 ceph-mon[92535]: pgmap v3640: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 331 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:04 smithi035 ceph-mon[92535]: osdmap e302: 12 total, 12 up, 12 in 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:04 smithi035 ceph-mon[92535]: pgmap v3642: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 252 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:07 smithi035 ceph-mon[92535]: pgmap v3643: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 252 op/s 2023-03-17T10:47:58.468 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:47:58.469 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:47:58.469 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:47:59.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:08 smithi035 ceph-mon[92535]: pgmap v3644: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.3 MiB/s wr, 296 op/s 2023-03-17T10:47:59.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:08 smithi035 ceph-mon[92535]: pgmap v3645: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.1 MiB/s wr, 380 op/s 2023-03-17T10:47:59.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:48:00.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:10 smithi035 ceph-mon[92535]: pgmap v3646: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2023-03-17T10:48:00.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:12 smithi035 ceph-mon[92535]: pgmap v3647: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2023-03-17T10:48:00.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:12 smithi035 ceph-mon[92535]: osdmap e303: 12 total, 12 up, 12 in 2023-03-17T10:48:00.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:14 smithi035 ceph-mon[92535]: pgmap v3649: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.1 MiB/s wr, 356 op/s 2023-03-17T10:48:00.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:16 smithi035 ceph-mon[92535]: pgmap v3650: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 157 op/s 2023-03-17T10:48:00.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:17 smithi035 ceph-mon[92535]: pgmap v3651: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T10:48:02.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:20 smithi035 ceph-mon[92535]: pgmap v3652: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T10:48:02.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:21 smithi035 ceph-mon[92535]: pgmap v3653: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T10:48:02.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:23 smithi035 ceph-mon[92535]: pgmap v3654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.4 MiB/s wr, 324 op/s 2023-03-17T10:48:02.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:25 smithi035 ceph-mon[92535]: pgmap v3655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 211 op/s 2023-03-17T10:48:02.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:27 smithi035 ceph-mon[92535]: pgmap v3656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 315 op/s 2023-03-17T10:48:02.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:29 smithi035 ceph-mon[92535]: pgmap v3657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-03-17T10:48:02.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:31 smithi035 ceph-mon[92535]: pgmap v3658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-03-17T10:48:02.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:33 smithi035 ceph-mon[92535]: pgmap v3659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 314 op/s 2023-03-17T10:48:02.430 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:35 smithi035 ceph-mon[92535]: pgmap v3660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 196 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:37 smithi035 ceph-mon[92535]: pgmap v3661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 301 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:39 smithi035 ceph-mon[92535]: pgmap v3662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:41 smithi035 ceph-mon[92535]: pgmap v3663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:43 smithi035 ceph-mon[92535]: pgmap v3664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.1 MiB/s wr, 291 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:45 smithi035 ceph-mon[92535]: pgmap v3665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 197 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:47 smithi035 ceph-mon[92535]: pgmap v3666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.1 MiB/s wr, 300 op/s 2023-03-17T10:48:04.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:49 smithi035 ceph-mon[92535]: pgmap v3667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 195 op/s 2023-03-17T10:48:04.501 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:36:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: ignoring --setuser ceph since I am not root 2023-03-17T10:48:05.216 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:36:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: ignoring --setgroup ceph since I am not root 2023-03-17T10:48:05.216 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:36:38 smithi035 ceph-mds[177573]: -- 172.21.15.35:0/681910092 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aaba92ab60 con 0x55aaba900800 2023-03-17T10:48:05.216 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 10:36:38 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: starting mds.d at 2023-03-17T10:48:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:48:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:48:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:48:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:48:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:48:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:48:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:48:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:48:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:48:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:48:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:48:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:48:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:48:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:48:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:48:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:48:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:48:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:48:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:48:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:48:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.130+0000 7fec7e59c700 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c67761c0c0 0x55c67761c4e0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d43c1a601af41d6 server_cookie=1d489a0b1dd0c984 in_seq=0 out_seq=0 2023-03-17T10:48:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec65ffb700 1 -- 172.21.15.35:0/2218756784 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c6773d5f00 con 0x55c67761c0c0 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec65ffb700 10 client.19416 handle_command_reply: tid=0 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 client.19416 shutdown 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 msgr2=0x55c67760df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760df60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fec7800b010 tx=0x7fec78009510 comp rx=0 tx=0).stop 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 shutdown_connections 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c67761c0c0 0x55c67761c4e0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6776054f0 0x55c67760df60 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec65ffb700 0 client.19416 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6775ff960 0x55c677668380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 --2- 172.21.15.35:0/2218756784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c677604be0 0x55c6776688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 >> 172.21.15.35:0/2218756784 conn(0x55c67745c6b0 msgr2=0x55c677603790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 shutdown_connections 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 1 -- 172.21.15.35:0/2218756784 wait complete. 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.149+0000 7fec90a0eb80 20 client.19416 trim_cache size 0 max 16384 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fec6809f640 msgr2=0x7fec680a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fec6809f640 0x7fec680a1af0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fec70006010 tx=0x7fec70005c00 comp rx=0 tx=0).stop 2023-03-17T10:48:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 msgr2=0x7fec80195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 0x7fec80195750 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d950 tx=0x7fec7400dc60 comp rx=0 tx=0).stop 2023-03-17T10:48:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 shutdown_connections 2023-03-17T10:48:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fec6809f640 0x7fec680a1af0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:10.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec80104390 0x7fec80199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:10.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec800ff350 0x7fec80195210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 --2- 172.21.15.35:0/2023223993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fec800ffcf0 0x7fec80195750 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 >> 172.21.15.35:0/2023223993 conn(0x7fec80076330 msgr2=0x7fec80102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 shutdown_connections 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:29.150+0000 7fec84881700 1 -- 172.21.15.35:0/2023223993 wait complete. 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/3278911021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 msgr2=0x7fb4e4103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/3278911021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e4103cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009990 tx=0x7fb4d8009ca0 comp rx=0 tx=0).stop 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/3278911021 shutdown_connections 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/3278911021 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/3278911021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 0x7fb4e40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/3278911021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e4103cb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/3278911021 >> 172.21.15.35:0/3278911021 conn(0x7fb4e4076330 msgr2=0x7fb4e4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/3278911021 shutdown_connections 2023-03-17T10:48:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.277+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/3278911021 wait complete. 2023-03-17T10:48:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 Processor -- start 2023-03-17T10:48:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 -- start start 2023-03-17T10:48:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 0x7fb4e4196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:14.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e41967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e419b240 con 0x7fb4e4104390 2023-03-17T10:48:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e419b3b0 con 0x7fb4e40ffcf0 2023-03-17T10:48:16.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.278+0000 7fb4e9ab7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e419b570 con 0x7fb4e40ff350 2023-03-17T10:48:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51970/0 (socket says 172.21.15.35:51970) 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e41967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 -- 172.21.15.35:0/4122618539 learned_addr learned my addr 172.21.15.35:0/4122618539 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 0x7fb4e4196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 -- 172.21.15.35:0/4122618539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 msgr2=0x7fb4e4196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 0x7fb4e4196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 -- 172.21.15.35:0/4122618539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 msgr2=0x7fb4e41967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e41967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 -- 172.21.15.35:0/4122618539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009520 con 0x7fb4e4104390 2023-03-17T10:48:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e41967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 0x7fb4e4196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e419ac00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00c370 tx=0x7fb4dc00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e0ff9700 1 -- 172.21.15.35:0/4122618539 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc017070 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e0ff9700 1 -- 172.21.15.35:0/4122618539 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4dc00f040 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc009c40 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e0ff9700 1 -- 172.21.15.35:0/4122618539 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00e050 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.279+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d80095f0 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.282+0000 7fb4e0ff9700 1 -- 172.21.15.35:0/4122618539 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb4dc003a00 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.283+0000 7fb4e0ff9700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb4cc09f640 0x7fb4cc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.283+0000 7fb4e0ff9700 1 -- 172.21.15.35:0/4122618539 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb4dc0c9b00 con 0x7fb4e4104390 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.283+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb4cc09f640 0x7fb4cc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 Processor -- start 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 -- start start 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb4cc09f640 0x7fb4cc0a1af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009e40 tx=0x7fb4d4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 0x55b031925410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b03191f830 0x55b03191fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b03192bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b031822010 con 0x55b03191f830 2023-03-17T10:48:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b031874950 con 0x55b0319201e0 2023-03-17T10:48:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03186dde0 con 0x55b031925040 2023-03-17T10:48:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 0x55b031925410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b03191f830 0x55b03191fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 0x55b031925410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43740/0 (socket says 172.21.15.35:43740) 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e37fe700 1 -- 172.21.15.35:0/3336453197 learned_addr learned my addr 172.21.15.35:0/3336453197 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b03192bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e2ffd700 1 -- 172.21.15.35:0/3336453197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 msgr2=0x55b031925410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 0x55b031925410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e2ffd700 1 -- 172.21.15.35:0/3336453197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 msgr2=0x55b03192bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b03192bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e2ffd700 1 -- 172.21.15.35:0/3336453197 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0316ef5d0 con 0x55b03191f830 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.284+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 0x55b031925410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.285+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b03191f830 0x55b03191fca0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8000c00 tx=0x7fb4d8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af4aa08ddbe1bae server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:48:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.285+0000 7fb4c9ffb700 1 -- 172.21.15.35:0/3336453197 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d801d070 con 0x55b03191f830 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.285+0000 7fb4c9ffb700 1 -- 172.21.15.35:0/3336453197 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4d801e040 con 0x55b03191f830 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.285+0000 7fb4c9ffb700 1 -- 172.21.15.35:0/3336453197 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8004b00 con 0x55b03191f830 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/3336453197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b03191f830 msgr2=0x55b03191fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b03191f830 0x55b03191fca0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8000c00 tx=0x7fb4d8005e80 comp rx=0 tx=0).stop 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/3336453197 shutdown_connections 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b03192bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b031925040 0x55b031925410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/3336453197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b03191f830 0x55b03191fca0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/3336453197 >> 172.21.15.35:0/3336453197 conn(0x55b0317786b0 msgr2=0x55b031915a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/3336453197 shutdown_connections 2023-03-17T10:48:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/3336453197 wait complete. 2023-03-17T10:48:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- start start 2023-03-17T10:48:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 Processor -- start 2023-03-17T10:48:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b03192bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031928fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b031929640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0316f18c0 con 0x55b031925040 2023-03-17T10:48:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b031929d70 con 0x55b0319201e0 2023-03-17T10:48:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.286+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b031935440 con 0x55b03191f830 2023-03-17T10:48:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4f5c44b80 10 client.0 _ll_register_callbacks cb 0x55b031713230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b03192bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b03192bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43746/0 (socket says 172.21.15.35:43746) 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 -- 172.21.15.35:0/4048892261 learned_addr learned my addr 172.21.15.35:0/4048892261 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b031929640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031928fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 -- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 msgr2=0x55b031928fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031928fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 -- 172.21.15.35:0/4048892261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 msgr2=0x55b031929640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b031929640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 -- 172.21.15.35:0/4048892261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e410c7a0 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b031929640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031928fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b03192bcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4011e00 tx=0x7fb4d40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d04fe3df98b6a345 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4048892261 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4031850 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4048892261 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb4d4018070 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.287+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b031830390 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4048892261 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d40319b0 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 10 client.28573 fetch_fsmap learned FSMap version 50 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55b03169bd80 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4048892261 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b031830390 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4048892261 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb4d4043b80 con 0x55b03191f830 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 10 client.28573 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 10 client.28573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:48:22.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 20 client.28573 populate_metadata read hostname 'smithi035' 2023-03-17T10:48:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031939520 0x55b03193b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 4 client.28573 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:48:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b03183c600 con 0x55b031939520 2023-03-17T10:48:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031939520 0x55b03193b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031939520 0x55b03193b930 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673eafb5ec0a9ec2 server_cookie=4ebf1d0a0f1bda43 in_seq=0 out_seq=0 2023-03-17T10:48:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.288+0000 7fb4c2ffd700 10 client.28573 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:48:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4048892261 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b03183c600 con 0x55b031939520 2023-03-17T10:48:24.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4c2ffd700 10 client.28573 handle_command_reply: tid=0 2023-03-17T10:48:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4f5c44b80 1 client.28573 shutdown 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 msgr2=0x55b03192bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b03192bcd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4011e00 tx=0x7fb4d40047c0 comp rx=0 tx=0).stop 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 shutdown_connections 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031939520 0x55b03193b930 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.289+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b031929640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b03192bcd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4c2ffd700 0 client.28573 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4048892261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031928fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 >> 172.21.15.35:0/4048892261 conn(0x55b0317786b0 msgr2=0x55b03191a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 shutdown_connections 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4048892261 wait complete. 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.290+0000 7fb4f5c44b80 20 client.28573 trim_cache size 0 max 16384 2023-03-17T10:48:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.306+0000 7fb4f5c44b80 1 Processor -- start 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.306+0000 7fb4f5c44b80 1 -- start start 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b031926c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031922a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b0319303d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0319110f0 con 0x55b031925040 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0319125c0 con 0x55b0319201e0 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0319166b0 con 0x55b03191f830 2023-03-17T10:48:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b0319303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:26.184 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78029 8.00 MB/sec execute 400 sec latency 115.446 ms 2023-03-17T10:48:26.184 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78210 8.01 MB/sec execute 401 sec latency 68.748 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78374 8.02 MB/sec execute 402 sec latency 68.258 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78522 8.02 MB/sec execute 403 sec latency 62.386 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78658 8.03 MB/sec execute 404 sec latency 85.253 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78805 8.03 MB/sec execute 405 sec latency 173.617 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 78940 8.03 MB/sec execute 406 sec latency 125.525 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79053 8.02 MB/sec execute 407 sec latency 74.504 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79197 8.02 MB/sec execute 408 sec latency 72.166 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79330 8.01 MB/sec execute 409 sec latency 67.349 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79444 8.00 MB/sec execute 410 sec latency 77.266 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79587 8.00 MB/sec execute 411 sec latency 71.498 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79763 8.01 MB/sec execute 412 sec latency 76.355 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 79906 8.00 MB/sec execute 413 sec latency 82.352 ms 2023-03-17T10:48:28.107 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80041 8.00 MB/sec execute 414 sec latency 81.348 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80190 8.01 MB/sec execute 415 sec latency 68.791 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80366 8.03 MB/sec execute 416 sec latency 67.979 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80487 8.02 MB/sec execute 417 sec latency 96.992 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80600 8.01 MB/sec execute 418 sec latency 132.917 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80743 8.00 MB/sec execute 419 sec latency 74.354 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 80878 7.99 MB/sec execute 420 sec latency 65.180 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81015 7.98 MB/sec execute 421 sec latency 70.165 ms 2023-03-17T10:48:28.108 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81157 7.97 MB/sec execute 422 sec latency 92.347 ms 2023-03-17T10:48:29.625 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81310 7.97 MB/sec execute 423 sec latency 60.169 ms 2023-03-17T10:48:30.314 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81456 7.97 MB/sec execute 424 sec latency 96.031 ms 2023-03-17T10:48:30.314 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81626 7.98 MB/sec execute 425 sec latency 62.143 ms 2023-03-17T10:48:30.315 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81802 7.99 MB/sec execute 426 sec latency 126.313 ms 2023-03-17T10:48:30.315 INFO:tasks.workunit.client.0.smithi035.stdout: 10 81982 8.00 MB/sec execute 427 sec latency 62.329 ms 2023-03-17T10:48:30.315 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82152 8.01 MB/sec execute 428 sec latency 74.327 ms 2023-03-17T10:48:30.315 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82284 8.01 MB/sec execute 429 sec latency 79.871 ms 2023-03-17T10:48:30.315 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82405 8.01 MB/sec execute 430 sec latency 78.775 ms 2023-03-17T10:48:30.315 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82542 8.01 MB/sec execute 431 sec latency 64.282 ms 2023-03-17T10:48:31.400 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82694 8.01 MB/sec execute 432 sec latency 102.793 ms 2023-03-17T10:48:31.401 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82836 8.01 MB/sec execute 433 sec latency 75.874 ms 2023-03-17T10:48:31.401 INFO:tasks.workunit.client.0.smithi035.stdout: 10 82949 8.00 MB/sec execute 434 sec latency 69.469 ms 2023-03-17T10:48:31.401 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83078 7.99 MB/sec execute 435 sec latency 74.098 ms 2023-03-17T10:48:31.401 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83250 8.00 MB/sec execute 436 sec latency 72.024 ms 2023-03-17T10:48:32.006 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83392 8.00 MB/sec execute 437 sec latency 92.890 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83518 8.00 MB/sec execute 438 sec latency 82.778 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83658 8.00 MB/sec execute 439 sec latency 123.002 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83829 8.01 MB/sec execute 440 sec latency 68.525 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 83949 8.00 MB/sec execute 441 sec latency 78.778 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84082 8.00 MB/sec execute 442 sec latency 76.579 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84218 7.99 MB/sec execute 443 sec latency 76.829 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84347 7.98 MB/sec execute 444 sec latency 68.221 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84488 7.98 MB/sec execute 445 sec latency 81.109 ms 2023-03-17T10:48:32.007 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84631 7.97 MB/sec execute 446 sec latency 76.576 ms 2023-03-17T10:48:33.185 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84785 7.97 MB/sec execute 447 sec latency 73.985 ms 2023-03-17T10:48:33.668 INFO:tasks.workunit.client.0.smithi035.stdout: 10 84943 7.97 MB/sec execute 448 sec latency 69.079 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85094 7.97 MB/sec execute 449 sec latency 66.591 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85243 7.97 MB/sec execute 450 sec latency 105.378 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85417 7.99 MB/sec execute 451 sec latency 78.257 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85563 7.98 MB/sec execute 452 sec latency 62.383 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85696 7.98 MB/sec execute 453 sec latency 149.833 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85846 7.99 MB/sec execute 454 sec latency 61.480 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 85986 7.99 MB/sec execute 455 sec latency 67.135 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86126 7.99 MB/sec execute 456 sec latency 75.674 ms 2023-03-17T10:48:33.669 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86280 7.99 MB/sec execute 457 sec latency 70.502 ms 2023-03-17T10:48:34.997 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86409 7.98 MB/sec execute 458 sec latency 83.846 ms 2023-03-17T10:48:36.488 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86527 7.98 MB/sec execute 459 sec latency 97.949 ms 2023-03-17T10:48:36.488 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86675 7.99 MB/sec execute 460 sec latency 101.073 ms 2023-03-17T10:48:36.488 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86848 7.99 MB/sec execute 461 sec latency 76.864 ms 2023-03-17T10:48:36.489 INFO:tasks.workunit.client.0.smithi035.stdout: 10 86990 7.99 MB/sec execute 462 sec latency 67.426 ms 2023-03-17T10:48:36.489 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87127 7.99 MB/sec execute 463 sec latency 392.831 ms 2023-03-17T10:48:36.489 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87286 8.00 MB/sec execute 464 sec latency 60.045 ms 2023-03-17T10:48:37.769 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87410 7.99 MB/sec execute 465 sec latency 98.692 ms 2023-03-17T10:48:37.769 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87538 7.98 MB/sec execute 466 sec latency 96.410 ms 2023-03-17T10:48:37.769 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87686 7.98 MB/sec execute 467 sec latency 73.741 ms 2023-03-17T10:48:37.770 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87810 7.97 MB/sec execute 468 sec latency 87.848 ms 2023-03-17T10:48:37.770 INFO:tasks.workunit.client.0.smithi035.stdout: 10 87954 7.97 MB/sec execute 469 sec latency 88.790 ms 2023-03-17T10:48:37.770 INFO:tasks.workunit.client.0.smithi035.stdout: 10 88106 7.96 MB/sec execute 470 sec latency 76.062 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 88259 7.96 MB/sec execute 471 sec latency 69.915 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 88420 7.97 MB/sec execute 472 sec latency 79.306 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 88571 7.97 MB/sec execute 473 sec latency 118.876 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 88735 7.97 MB/sec execute 474 sec latency 67.738 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 88903 7.98 MB/sec execute 475 sec latency 94.989 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89036 7.98 MB/sec execute 476 sec latency 66.719 ms 2023-03-17T10:48:38.365 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89190 7.98 MB/sec execute 477 sec latency 69.965 ms 2023-03-17T10:48:38.366 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89317 7.97 MB/sec execute 478 sec latency 60.858 ms 2023-03-17T10:48:39.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89478 7.98 MB/sec execute 479 sec latency 62.247 ms 2023-03-17T10:48:39.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89643 7.98 MB/sec execute 480 sec latency 62.849 ms 2023-03-17T10:48:39.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89790 7.97 MB/sec execute 481 sec latency 59.414 ms 2023-03-17T10:48:39.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 89899 7.96 MB/sec execute 482 sec latency 120.692 ms 2023-03-17T10:48:39.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90035 7.96 MB/sec execute 483 sec latency 70.420 ms 2023-03-17T10:48:39.543 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90231 7.98 MB/sec execute 484 sec latency 66.235 ms 2023-03-17T10:48:39.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90407 7.99 MB/sec execute 485 sec latency 105.715 ms 2023-03-17T10:48:39.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90562 7.99 MB/sec execute 486 sec latency 73.471 ms 2023-03-17T10:48:39.544 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90677 7.99 MB/sec execute 487 sec latency 80.873 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90806 7.99 MB/sec execute 488 sec latency 68.467 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 90959 7.99 MB/sec execute 489 sec latency 70.948 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91086 7.98 MB/sec execute 490 sec latency 118.141 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91225 7.98 MB/sec execute 491 sec latency 78.719 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91360 7.97 MB/sec execute 492 sec latency 63.054 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91487 7.96 MB/sec execute 493 sec latency 62.481 ms 2023-03-17T10:48:40.139 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91640 7.97 MB/sec execute 494 sec latency 67.445 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91802 7.97 MB/sec execute 495 sec latency 73.405 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 91945 7.97 MB/sec execute 496 sec latency 72.582 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92109 7.97 MB/sec execute 497 sec latency 67.477 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92277 7.98 MB/sec execute 498 sec latency 75.978 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92422 7.98 MB/sec execute 499 sec latency 64.024 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92563 7.98 MB/sec execute 500 sec latency 117.184 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92697 7.98 MB/sec execute 501 sec latency 71.845 ms 2023-03-17T10:48:40.140 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92835 7.98 MB/sec execute 502 sec latency 78.820 ms 2023-03-17T10:48:40.644 INFO:tasks.workunit.client.0.smithi035.stdout: 10 92976 7.97 MB/sec execute 503 sec latency 74.180 ms 2023-03-17T10:48:40.644 INFO:tasks.workunit.client.0.smithi035.stdout: 10 93125 7.97 MB/sec execute 504 sec latency 64.290 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 93273 7.97 MB/sec execute 505 sec latency 78.434 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 93398 7.96 MB/sec execute 506 sec latency 66.684 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 93554 7.96 MB/sec execute 507 sec latency 73.186 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 93723 7.97 MB/sec execute 508 sec latency 73.471 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 93888 7.97 MB/sec execute 509 sec latency 73.254 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94027 7.98 MB/sec execute 510 sec latency 101.068 ms 2023-03-17T10:48:41.667 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94165 7.98 MB/sec execute 511 sec latency 74.397 ms 2023-03-17T10:48:43.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94289 7.98 MB/sec execute 512 sec latency 123.038 ms 2023-03-17T10:48:43.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94415 7.98 MB/sec execute 513 sec latency 168.022 ms 2023-03-17T10:48:43.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94564 7.97 MB/sec execute 514 sec latency 63.691 ms 2023-03-17T10:48:43.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94697 7.97 MB/sec execute 515 sec latency 109.868 ms 2023-03-17T10:48:43.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94815 7.96 MB/sec execute 516 sec latency 74.874 ms 2023-03-17T10:48:43.777 INFO:tasks.workunit.client.0.smithi035.stdout: 10 94942 7.96 MB/sec execute 517 sec latency 87.146 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95097 7.96 MB/sec execute 518 sec latency 72.828 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95262 7.96 MB/sec execute 519 sec latency 120.404 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95417 7.96 MB/sec execute 520 sec latency 295.125 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95565 7.96 MB/sec execute 521 sec latency 71.415 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95719 7.97 MB/sec execute 522 sec latency 67.816 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95852 7.97 MB/sec execute 523 sec latency 82.885 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 95991 7.97 MB/sec execute 524 sec latency 82.293 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96111 7.97 MB/sec execute 525 sec latency 72.203 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96234 7.96 MB/sec execute 526 sec latency 65.217 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96378 7.96 MB/sec execute 527 sec latency 72.249 ms 2023-03-17T10:48:43.778 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96522 7.95 MB/sec execute 528 sec latency 68.130 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96679 7.95 MB/sec execute 529 sec latency 65.409 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96804 7.94 MB/sec execute 530 sec latency 74.323 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 96956 7.95 MB/sec execute 531 sec latency 67.993 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 97142 7.96 MB/sec execute 532 sec latency 67.530 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 97316 7.96 MB/sec execute 533 sec latency 79.569 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 97478 7.97 MB/sec execute 534 sec latency 114.871 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 97614 7.97 MB/sec execute 535 sec latency 63.584 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 97735 7.96 MB/sec execute 536 sec latency 84.586 ms 2023-03-17T10:48:44.480 INFO:tasks.workunit.client.0.smithi035.stdout: 10 97882 7.96 MB/sec execute 537 sec latency 71.992 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98037 7.97 MB/sec execute 538 sec latency 75.152 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98158 7.96 MB/sec execute 539 sec latency 65.041 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98288 7.95 MB/sec execute 540 sec latency 61.090 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98428 7.95 MB/sec execute 541 sec latency 97.877 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98589 7.95 MB/sec execute 542 sec latency 65.526 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98741 7.95 MB/sec execute 543 sec latency 79.217 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 98918 7.96 MB/sec execute 544 sec latency 86.049 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99050 7.95 MB/sec execute 545 sec latency 96.405 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99191 7.96 MB/sec execute 546 sec latency 139.113 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99349 7.97 MB/sec execute 547 sec latency 69.426 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99485 7.97 MB/sec execute 548 sec latency 136.802 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99600 7.97 MB/sec execute 549 sec latency 198.072 ms 2023-03-17T10:48:45.615 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99727 7.96 MB/sec execute 550 sec latency 73.378 ms 2023-03-17T10:48:46.691 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99858 7.96 MB/sec execute 551 sec latency 82.966 ms 2023-03-17T10:48:46.691 INFO:tasks.workunit.client.0.smithi035.stdout: 10 99995 7.95 MB/sec execute 552 sec latency 67.968 ms 2023-03-17T10:48:46.691 INFO:tasks.workunit.client.0.smithi035.stdout: 10 100140 7.95 MB/sec execute 553 sec latency 135.563 ms 2023-03-17T10:48:46.691 INFO:tasks.workunit.client.0.smithi035.stdout: 10 100251 7.94 MB/sec execute 554 sec latency 105.025 ms 2023-03-17T10:48:46.691 INFO:tasks.workunit.client.0.smithi035.stdout: 10 100381 7.93 MB/sec execute 555 sec latency 67.664 ms 2023-03-17T10:48:46.691 INFO:tasks.workunit.client.0.smithi035.stdout: 10 100549 7.95 MB/sec execute 556 sec latency 68.387 ms 2023-03-17T10:48:46.692 INFO:tasks.workunit.client.0.smithi035.stdout: 10 100717 7.94 MB/sec execute 557 sec latency 67.866 ms 2023-03-17T10:48:46.692 INFO:tasks.workunit.client.0.smithi035.stdout: 10 100894 7.96 MB/sec execute 558 sec latency 67.988 ms 2023-03-17T10:48:46.692 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101047 7.96 MB/sec execute 559 sec latency 65.788 ms 2023-03-17T10:48:49.013 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101189 7.95 MB/sec execute 560 sec latency 63.937 ms 2023-03-17T10:48:49.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:51 smithi035 ceph-mon[92535]: pgmap v3668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 195 op/s 2023-03-17T10:48:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b031926c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:49.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b0319303d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51992/0 (socket says 172.21.15.35:51992) 2023-03-17T10:48:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e3fff700 1 -- 172.21.15.35:0/451709723 learned_addr learned my addr 172.21.15.35:0/451709723 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:48:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031922a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 -- 172.21.15.35:0/451709723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 msgr2=0x55b031922a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031922a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 -- 172.21.15.35:0/451709723 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 msgr2=0x55b0319303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b0319303d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 -- 172.21.15.35:0/451709723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b031834130 con 0x55b03191f830 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031922a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:51.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e3fff700 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b0319303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.307+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b031926c60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009c20 tx=0x7fb4d4005b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89724126325f9f83 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:48:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4ca7fc700 1 -- 172.21.15.35:0/451709723 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4011e30 con 0x55b03191f830 2023-03-17T10:48:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4ca7fc700 1 -- 172.21.15.35:0/451709723 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4d4016070 con 0x55b03191f830 2023-03-17T10:48:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4ca7fc700 1 -- 172.21.15.35:0/451709723 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4003e00 con 0x55b03191f830 2023-03-17T10:48:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/451709723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 msgr2=0x55b031926c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b031926c60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009c20 tx=0x7fb4d4005b20 comp rx=0 tx=0).stop 2023-03-17T10:48:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/451709723 shutdown_connections 2023-03-17T10:48:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b0319303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b03191f830 0x55b031926c60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/451709723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0319201e0 0x55b031922a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/451709723 >> 172.21.15.35:0/451709723 conn(0x55b0317786b0 msgr2=0x55b031935800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/451709723 shutdown_connections 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.308+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/451709723 wait complete. 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 -- start start 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 Processor -- start 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b03191f830 0x55b0319ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0319201e0 0x55b0319cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b03192e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03192e8f0 con 0x55b031925040 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03192ea60 con 0x55b03191f830 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03192ec20 con 0x55b0319201e0 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4f5c44b80 10 client.0 _ll_register_callbacks cb 0x55b031713230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4e3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b03192e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4e2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0319201e0 0x55b0319cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4e3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b03192e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:51998/0 (socket says 172.21.15.35:51998) 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.309+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b03191f830 0x55b0319ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e3fff700 1 -- 172.21.15.35:0/4215886268 learned_addr learned my addr 172.21.15.35:0/4215886268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e2ffd700 1 -- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b03191f830 msgr2=0x55b0319ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b03191f830 0x55b0319ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e2ffd700 1 -- 172.21.15.35:0/4215886268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 msgr2=0x55b03192e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b03192e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e2ffd700 1 -- 172.21.15.35:0/4215886268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0316ef5d0 con 0x55b0319201e0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b03191f830 0x55b0319ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4e2ffd700 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0319201e0 0x55b0319cab40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800b2e0 tx=0x7fb4d8005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54eea1f829de1767 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4215886268 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8055040 con 0x55b0319201e0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4215886268 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(266..266 src has 1..266) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb4d80553b0 con 0x55b0319201e0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0318eb1e0 con 0x55b0319201e0 2023-03-17T10:48:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4215886268 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d801d040 con 0x55b0319201e0 2023-03-17T10:48:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4f5c44b80 10 client.28579 fetch_fsmap learned FSMap version 50 2023-03-17T10:48:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.310+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7fb4d80095f0 con 0x55b0319201e0 2023-03-17T10:48:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4215886268 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b0318eb1e0 con 0x55b0319201e0 2023-03-17T10:48:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4215886268 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb4d800fbd0 con 0x55b0319201e0 2023-03-17T10:48:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4f5c44b80 10 client.28579 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:48:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4f5c44b80 10 client.28579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:48:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4f5c44b80 20 client.28579 populate_metadata read hostname 'smithi035' 2023-03-17T10:48:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031987e20 0x55b03198a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:48:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4f5c44b80 4 client.28579 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b0316f1f00 con 0x55b031987e20 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031987e20 0x55b03198a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4c2ffd700 10 client.28579 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.311+0000 7fb4e37fe700 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031987e20 0x55b03198a230 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bd199f4cc5f3e02 server_cookie=26980485f2428b9f in_seq=0 out_seq=0 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.339+0000 7fb4c2ffd700 1 -- 172.21.15.35:0/4215886268 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b0316f1f00 con 0x55b031987e20 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.339+0000 7fb4c2ffd700 10 client.28579 handle_command_reply: tid=0 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.339+0000 7fb4f5c44b80 1 client.28579 shutdown 2023-03-17T10:48:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0319201e0 msgr2=0x55b0319cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0319201e0 0x55b0319cab40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800b2e0 tx=0x7fb4d8005f10 comp rx=0 tx=0).stop 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 shutdown_connections 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b031987e20 0x55b03198a230 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b031925040 0x55b03192e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4c2ffd700 0 client.28579 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b03191f830 0x55b0319ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 --2- 172.21.15.35:0/4215886268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0319201e0 0x55b0319cab40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 >> 172.21.15.35:0/4215886268 conn(0x55b0317786b0 msgr2=0x55b03191a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:48:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 shutdown_connections 2023-03-17T10:48:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 1 -- 172.21.15.35:0/4215886268 wait complete. 2023-03-17T10:48:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.340+0000 7fb4f5c44b80 20 client.28579 trim_cache size 0 max 16384 2023-03-17T10:48:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb4cc09f640 msgr2=0x7fb4cc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb4cc09f640 0x7fb4cc0a1af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009e40 tx=0x7fb4d4009260 comp rx=0 tx=0).stop 2023-03-17T10:48:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 msgr2=0x7fb4e419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:48:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e419ac00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00c370 tx=0x7fb4dc00c680 comp rx=0 tx=0).stop 2023-03-17T10:48:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 shutdown_connections 2023-03-17T10:48:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb4cc09f640 0x7fb4cc0a1af0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:48:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb4e4104390 0x7fb4e419ac00 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4e40ff350 0x7fb4e4196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 --2- 172.21.15.35:0/4122618539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4e40ffcf0 0x7fb4e41967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 >> 172.21.15.35:0/4122618539 conn(0x7fb4e4076330 msgr2=0x7fb4e4068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 shutdown_connections 2023-03-17T10:49:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:19:42.341+0000 7fb4e9ab7700 1 -- 172.21.15.35:0/4122618539 wait complete. 2023-03-17T10:49:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 -- 172.21.15.35:0/3434731083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 msgr2=0x7f92140ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 --2- 172.21.15.35:0/3434731083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f92140ff720 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f92100099c0 tx=0x7f9210009cd0 comp rx=0 tx=0).stop 2023-03-17T10:49:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 -- 172.21.15.35:0/3434731083 shutdown_connections 2023-03-17T10:49:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 --2- 172.21.15.35:0/3434731083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 0x7f921410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 --2- 172.21.15.35:0/3434731083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f92140ff720 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 --2- 172.21.15.35:0/3434731083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 0x7f9214103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 -- 172.21.15.35:0/3434731083 >> 172.21.15.35:0/3434731083 conn(0x7f9214076330 msgr2=0x7f9214076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 -- 172.21.15.35:0/3434731083 shutdown_connections 2023-03-17T10:49:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.408+0000 7f921c746700 1 -- 172.21.15.35:0/3434731083 wait complete. 2023-03-17T10:49:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 Processor -- start 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 -- start start 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f9214100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 0x7f9214101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 0x7f92141a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214101ac0 con 0x7f92140ff350 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141a4950 con 0x7f92140ffcf0 2023-03-17T10:49:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921c746700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141a4a90 con 0x7f9214104390 2023-03-17T10:49:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f9214100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f9214100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52010/0 (socket says 172.21.15.35:52010) 2023-03-17T10:49:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921a4e2700 1 -- 172.21.15.35:0/2913479149 learned_addr learned my addr 172.21.15.35:0/2913479149 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f921ace3700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 0x7f92141a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.409+0000 7f9219ce1700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 0x7f9214101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921a4e2700 1 -- 172.21.15.35:0/2913479149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 msgr2=0x7f92141a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921a4e2700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 0x7f92141a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921a4e2700 1 -- 172.21.15.35:0/2913479149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 msgr2=0x7f9214101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921a4e2700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 0x7f9214101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921a4e2700 1 -- 172.21.15.35:0/2913479149 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100095f0 con 0x7f92140ff350 2023-03-17T10:49:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921ace3700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 0x7f92141a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f9219ce1700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 0x7f9214101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921a4e2700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f9214100d50 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f9210009fd0 tx=0x7f921000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f920b7fe700 1 -- 172.21.15.35:0/2913479149 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921001d070 con 0x7f92140ff350 2023-03-17T10:49:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f920b7fe700 1 -- 172.21.15.35:0/2913479149 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9210005030 con 0x7f92140ff350 2023-03-17T10:49:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f920b7fe700 1 -- 172.21.15.35:0/2913479149 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210004990 con 0x7f92140ff350 2023-03-17T10:49:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921410f000 con 0x7f92140ff350 2023-03-17T10:49:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.410+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921410ee70 con 0x7f92140ff350 2023-03-17T10:49:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.412+0000 7f920b7fe700 1 -- 172.21.15.35:0/2913479149 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f92100051a0 con 0x7f92140ff350 2023-03-17T10:49:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.413+0000 7f920b7fe700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f920009f6c0 0x7f92000a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.413+0000 7f9219ce1700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f920009f6c0 0x7f92000a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.413+0000 7f920b7fe700 1 -- 172.21.15.35:0/2913479149 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f92100cb320 con 0x7f92140ff350 2023-03-17T10:49:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.414+0000 7f92288d3b80 1 Processor -- start 2023-03-17T10:49:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.414+0000 7f9219ce1700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f920009f6c0 0x7f92000a1b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9214102540 tx=0x7f9204009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.414+0000 7f92288d3b80 1 -- start start 2023-03-17T10:49:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe1fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe20170 0x5563bfe205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:06.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f92288d3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfd1e010 con 0x5563bfe20170 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f92288d3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfd70950 con 0x5563bfe25d00 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f92288d3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfd69de0 con 0x5563bfe253f0 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921ace3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe20170 0x5563bfe205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe257c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43784/0 (socket says 172.21.15.35:43784) 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 -- 172.21.15.35:0/1388623212 learned_addr learned my addr 172.21.15.35:0/1388623212 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:08.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f9219ce1700 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe1fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 -- 172.21.15.35:0/1388623212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 msgr2=0x5563bfe1fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe1fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 -- 172.21.15.35:0/1388623212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe20170 msgr2=0x5563bfe205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe20170 0x5563bfe205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 -- 172.21.15.35:0/1388623212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563bfbeb5d0 con 0x5563bfe253f0 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f921a4e2700 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe257c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92100958d0 tx=0x7f9210098f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bef8544046e9f8d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.415+0000 7f9208ff9700 1 -- 172.21.15.35:0/1388623212 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100990c0 con 0x5563bfe253f0 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f9208ff9700 1 -- 172.21.15.35:0/1388623212 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f921009ce90 con 0x5563bfe253f0 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f9208ff9700 1 -- 172.21.15.35:0/1388623212 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100a0b30 con 0x5563bfe253f0 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 -- 172.21.15.35:0/1388623212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 msgr2=0x5563bfe257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe257c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92100958d0 tx=0x7f9210098f50 comp rx=0 tx=0).stop 2023-03-17T10:49:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 -- 172.21.15.35:0/1388623212 shutdown_connections 2023-03-17T10:49:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe20170 0x5563bfe205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe257c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1388623212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe1fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 -- 172.21.15.35:0/1388623212 >> 172.21.15.35:0/1388623212 conn(0x5563bfc746b0 msgr2=0x5563bfe11a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 -- 172.21.15.35:0/1388623212 shutdown_connections 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.416+0000 7f92288d3b80 1 -- 172.21.15.35:0/1388623212 wait complete. 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 -- start start 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 Processor -- start 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe20170 0x5563bfe1a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe1ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe1f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfbed8c0 con 0x5563bfe25d00 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe1f9c0 con 0x5563bfe20170 2023-03-17T10:49:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe1fb80 con 0x5563bfe253f0 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f92288d3b80 10 client.0 _ll_register_callbacks cb 0x5563bfc0f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe20170 0x5563bfe1a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f921ace3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe1f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f9219ce1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe1ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe20170 0x5563bfe1a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53820/0 (socket says 172.21.15.35:53820) 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f921a4e2700 1 -- 172.21.15.35:0/4245854340 learned_addr learned my addr 172.21.15.35:0/4245854340 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f9219ce1700 1 -- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe20170 msgr2=0x5563bfe1a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f9219ce1700 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe20170 0x5563bfe1a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f9219ce1700 1 -- 172.21.15.35:0/4245854340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 msgr2=0x5563bfe1f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f9219ce1700 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe1f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.417+0000 7f9219ce1700 1 -- 172.21.15.35:0/4245854340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921410ee70 con 0x5563bfe253f0 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f921ace3700 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe1f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f9219ce1700 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe1ab10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5563bfe126a0 tx=0x7f92040047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab05eb59772790fd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f91fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f91fdffb700 1 -- 172.21.15.35:0/4245854340 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920401e800 con 0x5563bfe253f0 2023-03-17T10:49:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f91fdffb700 1 -- 172.21.15.35:0/4245854340 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f920401e960 con 0x5563bfe253f0 2023-03-17T10:49:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563bfd2c390 con 0x5563bfe253f0 2023-03-17T10:49:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f91fdffb700 1 -- 172.21.15.35:0/4245854340 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f920401eb20 con 0x5563bfe253f0 2023-03-17T10:49:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f92288d3b80 10 client.28591 fetch_fsmap learned FSMap version 50 2023-03-17T10:49:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5563bfb97d80 con 0x5563bfe253f0 2023-03-17T10:49:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.418+0000 7f91fdffb700 1 -- 172.21.15.35:0/4245854340 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563bfd2c390 con 0x5563bfe253f0 2023-03-17T10:49:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f91fdffb700 1 -- 172.21.15.35:0/4245854340 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9204031bd0 con 0x5563bfe253f0 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f92288d3b80 10 client.28591 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f92288d3b80 10 client.28591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f92288d3b80 20 client.28591 populate_metadata read hostname 'smithi035' 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f92288d3b80 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe41db0 0x5563bfe441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f92288d3b80 4 client.28591 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563bfd38600 con 0x5563bfe41db0 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f921a4e2700 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe41db0 0x5563bfe441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f921a4e2700 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe41db0 0x5563bfe441c0 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ad47b4a9c837244 server_cookie=1390ef47d2575889 in_seq=0 out_seq=0 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.419+0000 7f91fdffb700 10 client.28591 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f91fdffb700 1 -- 172.21.15.35:0/4245854340 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5563bfd38600 con 0x5563bfe41db0 2023-03-17T10:49:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f91fdffb700 10 client.28591 handle_command_reply: tid=0 2023-03-17T10:49:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 client.28591 shutdown 2023-03-17T10:49:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 msgr2=0x5563bfe1ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe1ab10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5563bfe126a0 tx=0x7f92040047c0 comp rx=0 tx=0).stop 2023-03-17T10:49:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 shutdown_connections 2023-03-17T10:49:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe41db0 0x5563bfe441c0 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe1f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe20170 0x5563bfe1a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f91fdffb700 0 client.28591 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 --2- 172.21.15.35:0/4245854340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe253f0 0x5563bfe1ab10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 >> 172.21.15.35:0/4245854340 conn(0x5563bfc746b0 msgr2=0x5563bfe23010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 shutdown_connections 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 1 -- 172.21.15.35:0/4245854340 wait complete. 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.420+0000 7f92288d3b80 20 client.28591 trim_cache size 0 max 16384 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 Processor -- start 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 -- start start 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe23ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 0x5563bfe268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe26df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe0eb60 con 0x5563bfe253f0 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe1ffc0 con 0x5563bfe25d00 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f92288d3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe13570 con 0x5563bfe20170 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 0x5563bfe268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 0x5563bfe268b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52034/0 (socket says 172.21.15.35:52034) 2023-03-17T10:49:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 -- 172.21.15.35:0/648677913 learned_addr learned my addr 172.21.15.35:0/648677913 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f921ace3700 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe26df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f921a4e2700 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe23ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 -- 172.21.15.35:0/648677913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 msgr2=0x5563bfe23ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe23ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 -- 172.21.15.35:0/648677913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 msgr2=0x5563bfe26df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe26df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f9219ce1700 1 -- 172.21.15.35:0/648677913 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563bfe20810 con 0x5563bfe253f0 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.439+0000 7f921ace3700 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe26df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:18.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.440+0000 7f9219ce1700 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 0x5563bfe268b0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f9204004680 tx=0x7f92040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab0f41ea4137f87 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.440+0000 7f92097fa700 1 -- 172.21.15.35:0/648677913 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204028630 con 0x5563bfe253f0 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.440+0000 7f92097fa700 1 -- 172.21.15.35:0/648677913 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9204028d00 con 0x5563bfe253f0 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.440+0000 7f92097fa700 1 -- 172.21.15.35:0/648677913 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920401ecf0 con 0x5563bfe253f0 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.440+0000 7f92288d3b80 1 -- 172.21.15.35:0/648677913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 msgr2=0x5563bfe268b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.440+0000 7f92288d3b80 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 0x5563bfe268b0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f9204004680 tx=0x7f92040046b0 comp rx=0 tx=0).stop 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- 172.21.15.35:0/648677913 shutdown_connections 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe25d00 0x5563bfe26df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe23ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 --2- 172.21.15.35:0/648677913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe253f0 0x5563bfe268b0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- 172.21.15.35:0/648677913 >> 172.21.15.35:0/648677913 conn(0x5563bfc746b0 msgr2=0x5563bfe261a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- 172.21.15.35:0/648677913 shutdown_connections 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- 172.21.15.35:0/648677913 wait complete. 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- start start 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 Processor -- start 2023-03-17T10:49:18.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 0x5563bfe18bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe94c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe95190 con 0x5563bfe25d00 2023-03-17T10:49:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe952d0 con 0x5563bfe253f0 2023-03-17T10:49:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.441+0000 7f92288d3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563bfe95410 con 0x5563bfe20170 2023-03-17T10:49:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f92288d3b80 10 client.0 _ll_register_callbacks cb 0x5563bfc0f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:49:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f9219ce1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 0x5563bfe18bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921ace3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe94c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe18680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43804/0 (socket says 172.21.15.35:43804) 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f9219ce1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 0x5563bfe18bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53836/0 (socket says 172.21.15.35:53836) 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 -- 172.21.15.35:0/1926536597 learned_addr learned my addr 172.21.15.35:0/1926536597 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 -- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 msgr2=0x5563bfe18bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 0x5563bfe18bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 -- 172.21.15.35:0/1926536597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 msgr2=0x5563bfe94c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe94c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 -- 172.21.15.35:0/1926536597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c003db0 con 0x5563bfe20170 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f9219ce1700 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 0x5563bfe18bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f921a4e2700 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe18680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9210095360 tx=0x7f9210097410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3c7ef93c767c8fa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f91fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f91fdffb700 1 -- 172.21.15.35:0/1926536597 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100992c0 con 0x5563bfe20170 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f91fdffb700 1 -- 172.21.15.35:0/1926536597 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9210098350 con 0x5563bfe20170 2023-03-17T10:49:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563bfde71e0 con 0x5563bfe20170 2023-03-17T10:49:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f91fdffb700 1 -- 172.21.15.35:0/1926536597 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9210098510 con 0x5563bfe20170 2023-03-17T10:49:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f92288d3b80 10 client.28597 fetch_fsmap learned FSMap version 50 2023-03-17T10:49:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.442+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5563bfb97d80 con 0x5563bfe20170 2023-03-17T10:49:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f91fdffb700 1 -- 172.21.15.35:0/1926536597 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563bfde71e0 con 0x5563bfe20170 2023-03-17T10:49:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f91fdffb700 1 -- 172.21.15.35:0/1926536597 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f92100b5c80 con 0x5563bfe20170 2023-03-17T10:49:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f92288d3b80 10 client.28597 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f92288d3b80 10 client.28597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f92288d3b80 20 client.28597 populate_metadata read hostname 'smithi035' 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe96670 0x5563bfe98a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f92288d3b80 4 client.28597 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5563bfbedf00 con 0x5563bfe96670 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f9219ce1700 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe96670 0x5563bfe98a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f91fdffb700 10 client.28597 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.443+0000 7f9219ce1700 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe96670 0x5563bfe98a50 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1401bb9eabba94e server_cookie=423bd18ac185bc12 in_seq=0 out_seq=0 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.475+0000 7f91fdffb700 1 -- 172.21.15.35:0/1926536597 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5563bfbedf00 con 0x5563bfe96670 2023-03-17T10:49:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.475+0000 7f91fdffb700 10 client.28597 handle_command_reply: tid=0 2023-03-17T10:49:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.475+0000 7f92288d3b80 1 client.28597 shutdown 2023-03-17T10:49:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.477+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 msgr2=0x5563bfe18680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.477+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe18680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9210095360 tx=0x7f9210097410 comp rx=0 tx=0).stop 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 shutdown_connections 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563bfe96670 0x5563bfe98a50 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563bfe25d00 0x5563bfe94c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563bfe20170 0x5563bfe18680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 --2- 172.21.15.35:0/1926536597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563bfe253f0 0x5563bfe18bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 >> 172.21.15.35:0/1926536597 conn(0x5563bfc746b0 msgr2=0x5563bfe26a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f91fdffb700 0 client.28597 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 shutdown_connections 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 1 -- 172.21.15.35:0/1926536597 wait complete. 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.478+0000 7f92288d3b80 20 client.28597 trim_cache size 0 max 16384 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f920009f6c0 msgr2=0x7f92000a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f920009f6c0 0x7f92000a1b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9214102540 tx=0x7f9204009260 comp rx=0 tx=0).stop 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 msgr2=0x7f9214100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:25.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f9214100d50 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f9210009fd0 tx=0x7f921000f690 comp rx=0 tx=0).stop 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 shutdown_connections 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f920009f6c0 0x7f92000a1b70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9214104390 0x7f92141a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f92140ff350 0x7f9214100d50 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 --2- 172.21.15.35:0/2913479149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92140ffcf0 0x7f9214101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 >> 172.21.15.35:0/2913479149 conn(0x7f9214076330 msgr2=0x7f9214068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 shutdown_connections 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:39.479+0000 7f921c746700 1 -- 172.21.15.35:0/2913479149 wait complete. 2023-03-17T10:49:25.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3513712422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 msgr2=0x7ff4381017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3513712422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4381017a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff428009990 tx=0x7ff428009ca0 comp rx=0 tx=0).stop 2023-03-17T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3513712422 shutdown_connections 2023-03-17T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3513712422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43810a7a0 0x7ff43810cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:26.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3513712422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4381017a0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3513712422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff438101ce0 0x7ff43810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3513712422 >> 172.21.15.35:0/3513712422 conn(0x7ff438076330 msgr2=0x7ff438076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3513712422 shutdown_connections 2023-03-17T10:49:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3513712422 wait complete. 2023-03-17T10:49:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.594+0000 7ff43dbf7700 1 Processor -- start 2023-03-17T10:49:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 -- start start 2023-03-17T10:49:27.461 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101332 7.96 MB/sec execute 561 sec latency 75.566 ms 2023-03-17T10:49:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4380ff020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff438101ce0 0x7ff4380ff560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43810a7a0 0x7ff4380ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381a8bb0 con 0x7ff4381013d0 2023-03-17T10:49:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381a8cf0 con 0x7ff43810a7a0 2023-03-17T10:49:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff43dbf7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381a8e30 con 0x7ff438101ce0 2023-03-17T10:49:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4380ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4380ff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52052/0 (socket says 172.21.15.35:52052) 2023-03-17T10:49:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 -- 172.21.15.35:0/3288786199 learned_addr learned my addr 172.21.15.35:0/3288786199 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff437fff700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43810a7a0 0x7ff4380ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff436ffd700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff438101ce0 0x7ff4380ff560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 -- 172.21.15.35:0/3288786199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff438101ce0 msgr2=0x7ff4380ff560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff438101ce0 0x7ff4380ff560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:33.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 -- 172.21.15.35:0/3288786199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43810a7a0 msgr2=0x7ff4380ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43810a7a0 0x7ff4380ffaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 -- 172.21.15.35:0/3288786199 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280095f0 con 0x7ff4381013d0 2023-03-17T10:49:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.595+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4380ff020 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ff428000c00 tx=0x7ff428004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.596+0000 7ff434ff9700 1 -- 172.21.15.35:0/3288786199 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42801d070 con 0x7ff4381013d0 2023-03-17T10:49:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.596+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff438110100 con 0x7ff4381013d0 2023-03-17T10:49:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.596+0000 7ff434ff9700 1 -- 172.21.15.35:0/3288786199 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff428022470 con 0x7ff4381013d0 2023-03-17T10:49:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.596+0000 7ff434ff9700 1 -- 172.21.15.35:0/3288786199 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428017650 con 0x7ff4381013d0 2023-03-17T10:49:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.596+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43810ff70 con 0x7ff4381013d0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.599+0000 7ff434ff9700 1 -- 172.21.15.35:0/3288786199 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff4280225e0 con 0x7ff4381013d0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.599+0000 7ff434ff9700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42009f640 0x7ff4200a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.599+0000 7ff434ff9700 1 -- 172.21.15.35:0/3288786199 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff4280cba10 con 0x7ff4381013d0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.599+0000 7ff436ffd700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42009f640 0x7ff4200a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 Processor -- start 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 -- start start 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff436ffd700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42009f640 0x7ff4200a1af0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff438100810 tx=0x7ff42c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89c7c010 con 0x559d89d7abe0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89cce950 con 0x559d89d75960 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff449d84b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89cc7de0 con 0x559d89d7b4f0 2023-03-17T10:49:36.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52060/0 (socket says 172.21.15.35:52060) 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff436ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 -- 172.21.15.35:0/3376680411 learned_addr learned my addr 172.21.15.35:0/3376680411 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff437fff700 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 -- 172.21.15.35:0/3376680411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 msgr2=0x559d89d75420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d75420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 -- 172.21.15.35:0/3376680411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 msgr2=0x559d89d75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.600+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d75d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff4377fe700 1 -- 172.21.15.35:0/3376680411 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d89b495d0 con 0x559d89d7abe0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7afb0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ff428095fc0 tx=0x7ff428099320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476ad60650683f96 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff41dffb700 1 -- 172.21.15.35:0/3376680411 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280228c0 con 0x559d89d7abe0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff41dffb700 1 -- 172.21.15.35:0/3376680411 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff428099550 con 0x559d89d7abe0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff41dffb700 1 -- 172.21.15.35:0/3376680411 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428098a40 con 0x559d89d7abe0 2023-03-17T10:49:36.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff449d84b80 1 -- 172.21.15.35:0/3376680411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 msgr2=0x559d89d7afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.601+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7afb0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ff428095fc0 tx=0x7ff428099320 comp rx=0 tx=0).stop 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 -- 172.21.15.35:0/3376680411 shutdown_connections 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7afb0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3376680411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 -- 172.21.15.35:0/3376680411 >> 172.21.15.35:0/3376680411 conn(0x559d89bd26b0 msgr2=0x559d89d6fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 -- 172.21.15.35:0/3376680411 shutdown_connections 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 -- 172.21.15.35:0/3376680411 wait complete. 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 -- start start 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.602+0000 7ff449d84b80 1 Processor -- start 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89b4b8c0 con 0x559d89d7abe0 2023-03-17T10:49:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d7f2e0 con 0x559d89d75960 2023-03-17T10:49:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d7f4a0 con 0x559d89d7b4f0 2023-03-17T10:49:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff449d84b80 10 client.0 _ll_register_callbacks cb 0x559d89b6d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:49:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d81410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53862/0 (socket says 172.21.15.35:53862) 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 -- 172.21.15.35:0/697583671 learned_addr learned my addr 172.21.15.35:0/697583671 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff437fff700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff436ffd700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 -- 172.21.15.35:0/697583671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 msgr2=0x559d89d7eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d7eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 -- 172.21.15.35:0/697583671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 msgr2=0x559d89d7e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff4377fe700 1 -- 172.21.15.35:0/697583671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43810ff70 con 0x559d89d75960 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.603+0000 7ff437fff700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d7eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff4377fe700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d81410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4280994e0 tx=0x7ff428098c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98d381fe68d64c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff416ffd700 1 -- 172.21.15.35:0/697583671 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280c8070 con 0x559d89d75960 2023-03-17T10:49:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff416ffd700 1 -- 172.21.15.35:0/697583671 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff4280228c0 con 0x559d89d75960 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d89c8a390 con 0x559d89d75960 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff416ffd700 1 -- 172.21.15.35:0/697583671 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff428099550 con 0x559d89d75960 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 10 client.28625 fetch_fsmap learned FSMap version 50 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x559d89af5d80 con 0x559d89d75960 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff416ffd700 1 -- 172.21.15.35:0/697583671 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff428063020 con 0x559d89d75960 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff416ffd700 1 -- 172.21.15.35:0/697583671 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff4280a1340 con 0x559d89d75960 2023-03-17T10:49:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 10 client.28625 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:49:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 10 client.28625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:49:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 20 client.28625 populate_metadata read hostname 'smithi035' 2023-03-17T10:49:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89d8e7c0 0x559d89d90ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 4 client.28625 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.604+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d89c96600 con 0x559d89d8e7c0 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.605+0000 7ff436ffd700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89d8e7c0 0x559d89d90ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.605+0000 7ff416ffd700 10 client.28625 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.605+0000 7ff436ffd700 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89d8e7c0 0x559d89d90ba0 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56fc1f0428c269a server_cookie=82fa6e3402cac8ed in_seq=0 out_seq=0 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.605+0000 7ff416ffd700 1 -- 172.21.15.35:0/697583671 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559d89c96600 con 0x559d89d8e7c0 2023-03-17T10:49:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.605+0000 7ff416ffd700 10 client.28625 handle_command_reply: tid=0 2023-03-17T10:49:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.605+0000 7ff449d84b80 1 client.28625 shutdown 2023-03-17T10:49:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 msgr2=0x559d89d81410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d81410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4280994e0 tx=0x7ff428098c70 comp rx=0 tx=0).stop 2023-03-17T10:49:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 shutdown_connections 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89d8e7c0 0x559d89d90ba0 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7b4f0 0x559d89d7eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff416ffd700 0 client.28625 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d81410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 --2- 172.21.15.35:0/697583671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7abe0 0x559d89d7e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 >> 172.21.15.35:0/697583671 conn(0x559d89bd26b0 msgr2=0x559d89d74410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 shutdown_connections 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 1 -- 172.21.15.35:0/697583671 wait complete. 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.606+0000 7ff449d84b80 20 client.28625 trim_cache size 0 max 16384 2023-03-17T10:49:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 Processor -- start 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 -- start start 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 0x559d89d6fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d7b4f0 0x559d89d80f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d6b0f0 con 0x559d89d75960 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d70000 con 0x559d89d7b4f0 2023-03-17T10:49:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff449d84b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d7a830 con 0x559d89d7abe0 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 0x559d89d6fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 0x559d89d6fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52074/0 (socket says 172.21.15.35:52074) 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff436ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff4377fe700 1 -- 172.21.15.35:0/4163011962 learned_addr learned my addr 172.21.15.35:0/4163011962 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff437fff700 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d7b4f0 0x559d89d80f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff436ffd700 1 -- 172.21.15.35:0/4163011962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d7b4f0 msgr2=0x559d89d80f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff436ffd700 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d7b4f0 0x559d89d80f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.623+0000 7ff436ffd700 1 -- 172.21.15.35:0/4163011962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 msgr2=0x559d89d6fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff436ffd700 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 0x559d89d6fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff436ffd700 1 -- 172.21.15.35:0/4163011962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d89c8e130 con 0x559d89d7abe0 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff4377fe700 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 0x559d89d6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff436ffd700 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x559d89d7fcd0 tx=0x7ff42c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54a0dd1ec7dcf90 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff41e7fc700 1 -- 172.21.15.35:0/4163011962 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c022070 con 0x559d89d7abe0 2023-03-17T10:49:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff41e7fc700 1 -- 172.21.15.35:0/4163011962 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff42c023040 con 0x559d89d7abe0 2023-03-17T10:49:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.624+0000 7ff41e7fc700 1 -- 172.21.15.35:0/4163011962 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0038e0 con 0x559d89d7abe0 2023-03-17T10:49:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 -- 172.21.15.35:0/4163011962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 msgr2=0x559d89d85cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:49:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85cc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x559d89d7fcd0 tx=0x7ff42c014000 comp rx=0 tx=0).stop 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 -- 172.21.15.35:0/4163011962 shutdown_connections 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d7b4f0 0x559d89d80f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d75960 0x559d89d6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 --2- 172.21.15.35:0/4163011962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85cc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 -- 172.21.15.35:0/4163011962 >> 172.21.15.35:0/4163011962 conn(0x559d89bd26b0 msgr2=0x559d89d786b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 -- 172.21.15.35:0/4163011962 shutdown_connections 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 -- 172.21.15.35:0/4163011962 wait complete. 2023-03-17T10:49:49.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 -- start start 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 Processor -- start 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.625+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d85740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 0x559d89d83ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d84330 con 0x559d89d7b4f0 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d844a0 con 0x559d89d75960 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89d84660 con 0x559d89d7abe0 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 10 client.0 _ll_register_callbacks cb 0x559d89b6d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d85740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff437fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 0x559d89d83ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff436ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d85740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53876/0 (socket says 172.21.15.35:53876) 2023-03-17T10:49:49.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff437fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 0x559d89d83ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52084/0 (socket says 172.21.15.35:52084) 2023-03-17T10:49:49.020 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101465 7.95 MB/sec execute 562 sec latency 79.321 ms 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:53 smithi035 ceph-mon[92535]: pgmap v3669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 297 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:55 smithi035 ceph-mon[92535]: pgmap v3670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 204 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:57 smithi035 ceph-mon[92535]: pgmap v3671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 298 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:37:59 smithi035 ceph-mon[92535]: pgmap v3672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 195 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:01 smithi035 ceph-mon[92535]: pgmap v3673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 195 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:04 smithi035 ceph-mon[92535]: pgmap v3674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.5 MiB/s wr, 317 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:04 smithi035 ceph-mon[92535]: osdmap e304: 12 total, 12 up, 12 in 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:05 smithi035 ceph-mon[92535]: pgmap v3676: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:07 smithi035 ceph-mon[92535]: pgmap v3677: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:49:50.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:10 smithi035 ceph-mon[92535]: pgmap v3678: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:11 smithi035 ceph-mon[92535]: pgmap v3679: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:12 smithi035 ceph-mon[92535]: osdmap e305: 12 total, 12 up, 12 in 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:12 smithi035 ceph-mon[92535]: pgmap v3681: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.1 MiB/s wr, 285 op/s 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:12 smithi035 ceph-mon[92535]: pgmap v3682: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.2 MiB/s wr, 370 op/s 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:49:50.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:15 smithi035 ceph-mon[92535]: pgmap v3683: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 199 op/s 2023-03-17T10:49:51.486 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:17 smithi035 ceph-mon[92535]: pgmap v3684: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 199 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:19 smithi035 ceph-mon[92535]: pgmap v3685: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.9 MiB/s wr, 382 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:21 smithi035 ceph-mon[92535]: pgmap v3686: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.1 MiB/s wr, 303 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:22 smithi035 ceph-mon[92535]: pgmap v3687: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 229 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:25 smithi035 ceph-mon[92535]: pgmap v3688: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 191 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:27 smithi035 ceph-mon[92535]: pgmap v3689: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 191 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:29 smithi035 ceph-mon[92535]: pgmap v3690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 289 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:31 smithi035 ceph-mon[92535]: pgmap v3691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 188 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:32 smithi035 ceph-mon[92535]: pgmap v3692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.7 MiB/s wr, 286 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:35 smithi035 ceph-mon[92535]: pgmap v3693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 195 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:36 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:37 smithi035 ceph-mon[92535]: pgmap v3694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 195 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:38 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:38 smithi035 ceph-mon[92535]: pgmap v3695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.6 MiB/s wr, 292 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:41 smithi035 ceph-mon[92535]: pgmap v3696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 193 op/s 2023-03-17T10:49:51.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:42 smithi035 ceph-mon[92535]: pgmap v3697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 204 op/s 2023-03-17T10:49:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 -- 172.21.15.35:0/3873942060 learned_addr learned my addr 172.21.15.35:0/3873942060 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 -- 172.21.15.35:0/3873942060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 msgr2=0x559d89d85c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 -- 172.21.15.35:0/3873942060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 msgr2=0x559d89d83ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 0x559d89d83ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 -- 172.21.15.35:0/3873942060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43810ff70 con 0x559d89d75960 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff436ffd700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff437fff700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 0x559d89d83ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff4377fe700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d85740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff4280978a0 tx=0x7ff4280959b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7bb5bbd3c4296d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:49:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff416ffd700 1 -- 172.21.15.35:0/3873942060 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280c8070 con 0x559d89d75960 2023-03-17T10:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff416ffd700 1 -- 172.21.15.35:0/3873942060 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(270..270 src has 1..270) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff428064080 con 0x559d89d75960 2023-03-17T10:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.626+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d89d451e0 con 0x559d89d75960 2023-03-17T10:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff416ffd700 1 -- 172.21.15.35:0/3873942060 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff428095480 con 0x559d89d75960 2023-03-17T10:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 10 client.28631 fetch_fsmap learned FSMap version 50 2023-03-17T10:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7ff42c017070 con 0x559d89d75960 2023-03-17T10:49:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff416ffd700 1 -- 172.21.15.35:0/3873942060 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d89d451e0 con 0x559d89d75960 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff416ffd700 1 -- 172.21.15.35:0/3873942060 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff4280a1220 con 0x559d89d75960 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 10 client.28631 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 10 client.28631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 20 client.28631 populate_metadata read hostname 'smithi035' 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89de3230 0x559d89de5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 4 client.28631 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:49:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d89b4bf00 con 0x559d89de3230 2023-03-17T10:49:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff436ffd700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89de3230 0x559d89de5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:49:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff416ffd700 10 client.28631 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:49:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.627+0000 7ff436ffd700 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89de3230 0x559d89de5640 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e0a9acf5c54b85 server_cookie=66aeb4ee95180a03 in_seq=0 out_seq=0 2023-03-17T10:49:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff416ffd700 1 -- 172.21.15.35:0/3873942060 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d89b4bf00 con 0x559d89de3230 2023-03-17T10:49:57.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff416ffd700 10 client.28631 handle_command_reply: tid=0 2023-03-17T10:50:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 client.28631 shutdown 2023-03-17T10:50:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 msgr2=0x559d89d85740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d85740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff4280978a0 tx=0x7ff4280959b0 comp rx=0 tx=0).stop 2023-03-17T10:50:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 shutdown_connections 2023-03-17T10:50:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559d89de3230 0x559d89de5640 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559d89d7b4f0 0x559d89d83ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:01.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff416ffd700 0 client.28631 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559d89d75960 0x559d89d85740 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 --2- 172.21.15.35:0/3873942060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d89d7abe0 0x559d89d85c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 >> 172.21.15.35:0/3873942060 conn(0x559d89bd26b0 msgr2=0x559d89d7dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 shutdown_connections 2023-03-17T10:50:01.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 1 -- 172.21.15.35:0/3873942060 wait complete. 2023-03-17T10:50:01.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.654+0000 7ff449d84b80 20 client.28631 trim_cache size 0 max 16384 2023-03-17T10:50:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42009f640 msgr2=0x7ff4200a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:04.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42009f640 0x7ff4200a1af0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff438100810 tx=0x7ff42c009260 comp rx=0 tx=0).stop 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 msgr2=0x7ff4380ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4380ff020 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7ff428000c00 tx=0x7ff428004730 comp rx=0 tx=0).stop 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 shutdown_connections 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff42009f640 0x7ff4200a1af0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff43810a7a0 0x7ff4380ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4381013d0 0x7ff4380ff020 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 --2- 172.21.15.35:0/3288786199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff438101ce0 0x7ff4380ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 >> 172.21.15.35:0/3288786199 conn(0x7ff438076330 msgr2=0x7ff438102170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 shutdown_connections 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:21:52.655+0000 7ff43dbf7700 1 -- 172.21.15.35:0/3288786199 wait complete. 2023-03-17T10:50:05.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 -- 172.21.15.35:0/16136993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64901004e0 msgr2=0x7f6490103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 --2- 172.21.15.35:0/16136993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64901004e0 0x7f6490103d10 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f64800099c0 tx=0x7f6480009cd0 comp rx=0 tx=0).stop 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 -- 172.21.15.35:0/16136993 shutdown_connections 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 --2- 172.21.15.35:0/16136993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6490104440 0x7f649010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 --2- 172.21.15.35:0/16136993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64900fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 --2- 172.21.15.35:0/16136993 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64901004e0 0x7f6490103d10 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 -- 172.21.15.35:0/16136993 >> 172.21.15.35:0/16136993 conn(0x7f6490074590 msgr2=0x7f6490074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 -- 172.21.15.35:0/16136993 shutdown_connections 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.779+0000 7f649556c700 1 -- 172.21.15.35:0/16136993 wait complete. 2023-03-17T10:50:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 Processor -- start 2023-03-17T10:50:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 -- start start 2023-03-17T10:50:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64901962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64901004e0 0x7f6490196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6490104440 0x7f649019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019b2c0 con 0x7f6490104440 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019b430 con 0x7f64901004e0 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f649556c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649019b5f0 con 0x7f64900ffb40 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6490104440 0x7f649019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64901004e0 0x7f6490196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64901962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64901962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43902/0 (socket says 172.21.15.35:43902) 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64901004e0 0x7f6490196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53934/0 (socket says 172.21.15.35:53934) 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6490104440 0x7f649019ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52140/0 (socket says 172.21.15.35:52140) 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 -- 172.21.15.35:0/36501616 learned_addr learned my addr 172.21.15.35:0/36501616 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 -- 172.21.15.35:0/36501616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64901004e0 msgr2=0x7f6490196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64901004e0 0x7f6490196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 -- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6490104440 msgr2=0x7f649019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6490104440 0x7f649019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.780+0000 7f648effd700 1 -- 172.21.15.35:0/36501616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484009520 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.781+0000 7f648effd700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64901962e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f648400eb30 tx=0x7f648400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.781+0000 7f6477fff700 1 -- 172.21.15.35:0/36501616 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484009880 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.781+0000 7f6477fff700 1 -- 172.21.15.35:0/36501616 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64840044b0 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.781+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488009c40 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.781+0000 7f6477fff700 1 -- 172.21.15.35:0/36501616 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484003ce0 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.781+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64800095f0 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.783+0000 7f6477fff700 1 -- 172.21.15.35:0/36501616 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6484003e40 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.784+0000 7f6477fff700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647809f640 0x7f64780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.784+0000 7f648e7fc700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647809f640 0x7f64780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.784+0000 7f6477fff700 1 -- 172.21.15.35:0/36501616 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(271..271 src has 1..271) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f6484014070 con 0x7f64900ffb40 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f648e7fc700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647809f640 0x7f64780a1af0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6480000c00 tx=0x7f648000b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 Processor -- start 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 -- start start 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee24be0 0x55f0eee24fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee1f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee1f960 0x55f0eee1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eed26010 con 0x55f0eee254f0 2023-03-17T10:50:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eed78950 con 0x55f0eee24be0 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eed71de0 con 0x55f0eee1f960 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee1f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee1f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52146/0 (socket says 172.21.15.35:52146) 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f648e7fc700 1 -- 172.21.15.35:0/775878183 learned_addr learned my addr 172.21.15.35:0/775878183 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f648f7fe700 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee1f960 0x55f0eee1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.785+0000 7f648effd700 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee24be0 0x55f0eee24fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f648e7fc700 1 -- 172.21.15.35:0/775878183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee1f960 msgr2=0x55f0eee1fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f648e7fc700 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee1f960 0x55f0eee1fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f648e7fc700 1 -- 172.21.15.35:0/775878183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee24be0 msgr2=0x55f0eee24fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:11.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f648e7fc700 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee24be0 0x55f0eee24fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f648e7fc700 1 -- 172.21.15.35:0/775878183 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0eebf35d0 con 0x55f0eee254f0 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f648e7fc700 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee1f420 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f648000a010 tx=0x7f648001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe40ac70972baba server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f64757fa700 1 -- 172.21.15.35:0/775878183 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480029070 con 0x55f0eee254f0 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f64757fa700 1 -- 172.21.15.35:0/775878183 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f648001e040 con 0x55f0eee254f0 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.786+0000 7f64757fa700 1 -- 172.21.15.35:0/775878183 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000f460 con 0x55f0eee254f0 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 -- 172.21.15.35:0/775878183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 msgr2=0x55f0eee1f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee1f420 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f648000a010 tx=0x7f648001f000 comp rx=0 tx=0).stop 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 -- 172.21.15.35:0/775878183 shutdown_connections 2023-03-17T10:50:11.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee1f960 0x55f0eee1fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee24be0 0x55f0eee24fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/775878183 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee1f420 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 -- 172.21.15.35:0/775878183 >> 172.21.15.35:0/775878183 conn(0x55f0eec7c6b0 msgr2=0x55f0eee19a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 -- 172.21.15.35:0/775878183 shutdown_connections 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 -- 172.21.15.35:0/775878183 wait complete. 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 -- start start 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.787+0000 7f64a16f9b80 1 Processor -- start 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee28730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:11.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee28d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eebf58c0 con 0x55f0eee254f0 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee294a0 con 0x55f0eee1f960 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee34fa0 con 0x55f0eee24be0 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 10 client.0 _ll_register_callbacks cb 0x55f0eec17230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee28d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee28730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53946/0 (socket says 172.21.15.35:53946) 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee28d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52154/0 (socket says 172.21.15.35:52154) 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee28730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:43918/0 (socket says 172.21.15.35:43918) 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 -- 172.21.15.35:0/3541982337 learned_addr learned my addr 172.21.15.35:0/3541982337 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 -- 172.21.15.35:0/3541982337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 msgr2=0x55f0eee28730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee28730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 -- 172.21.15.35:0/3541982337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 msgr2=0x55f0eee28d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee28d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 -- 172.21.15.35:0/3541982337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649010c800 con 0x55f0eee1f960 2023-03-17T10:50:11.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648f7fe700 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee28d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f648effd700 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2b4b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f648400c5b0 tx=0x7f6484096c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a39856803e731cd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f6472ff5700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f6472ff5700 1 -- 172.21.15.35:0/3541982337 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840c6070 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0eed34390 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.788+0000 7f6472ff5700 1 -- 172.21.15.35:0/3541982337 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(271..271 src has 1..271) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f648400cbd0 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f6472ff5700 1 -- 172.21.15.35:0/3541982337 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6484004300 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 10 client.28661 fetch_fsmap learned FSMap version 50 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55f0eeb9fd80 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f6472ff5700 1 -- 172.21.15.35:0/3541982337 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6484062080 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f6472ff5700 1 -- 172.21.15.35:0/3541982337 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6484097bd0 con 0x55f0eee1f960 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 10 client.28661 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 10 client.28661 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:50:11.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 20 client.28661 populate_metadata read hostname 'smithi035' 2023-03-17T10:50:11.970 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101604 7.95 MB/sec execute 563 sec latency 76.351 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101742 7.95 MB/sec execute 564 sec latency 70.132 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 101878 7.95 MB/sec execute 565 sec latency 122.578 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102032 7.95 MB/sec execute 566 sec latency 78.990 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102187 7.95 MB/sec execute 567 sec latency 107.779 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102334 7.94 MB/sec execute 568 sec latency 86.194 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102498 7.95 MB/sec execute 569 sec latency 67.362 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102629 7.94 MB/sec execute 570 sec latency 85.571 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102815 7.96 MB/sec execute 571 sec latency 67.107 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 102956 7.96 MB/sec execute 572 sec latency 65.092 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103078 7.96 MB/sec execute 573 sec latency 127.026 ms 2023-03-17T10:50:14.590 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103217 7.96 MB/sec execute 574 sec latency 70.247 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103354 7.95 MB/sec execute 575 sec latency 66.686 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103511 7.95 MB/sec execute 576 sec latency 69.067 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103646 7.94 MB/sec execute 577 sec latency 111.089 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103766 7.94 MB/sec execute 578 sec latency 350.060 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 103923 7.94 MB/sec execute 579 sec latency 71.069 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104079 7.95 MB/sec execute 580 sec latency 79.395 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104261 7.95 MB/sec execute 581 sec latency 90.368 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104414 7.96 MB/sec execute 582 sec latency 68.562 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104535 7.95 MB/sec execute 583 sec latency 70.526 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104675 7.95 MB/sec execute 584 sec latency 72.492 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104828 7.95 MB/sec execute 585 sec latency 73.121 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 104980 7.95 MB/sec execute 586 sec latency 69.534 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105109 7.94 MB/sec execute 587 sec latency 107.912 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105239 7.94 MB/sec execute 588 sec latency 67.777 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105374 7.94 MB/sec execute 589 sec latency 71.023 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105551 7.95 MB/sec execute 590 sec latency 102.689 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105703 7.95 MB/sec execute 591 sec latency 73.536 ms 2023-03-17T10:50:14.591 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105840 7.94 MB/sec execute 592 sec latency 143.739 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 105986 7.95 MB/sec execute 593 sec latency 71.407 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 106126 7.95 MB/sec execute 594 sec latency 65.799 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 106279 7.95 MB/sec execute 595 sec latency 70.149 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 106418 7.95 MB/sec execute 596 sec latency 69.928 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 106501 7.94 MB/sec execute 597 sec latency 126.507 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 106634 7.94 MB/sec execute 598 sec latency 112.351 ms 2023-03-17T10:50:14.592 INFO:tasks.workunit.client.0.smithi035.stdout: 10 106782 7.94 MB/sec execute 599 sec latency 75.553 ms 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: 10 cleanup 600 sec 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: 5 cleanup 601 sec 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: 0 cleanup 602 sec 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: Operation Count AvgLat MaxLat 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: ---------------------------------------- 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: NTCreateX 153143 11.251 709.116 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: Close 112564 0.227 71.183 2023-03-17T10:50:16.391 INFO:tasks.workunit.client.0.smithi035.stdout: Rename 6478 26.319 392.826 2023-03-17T10:50:17.142 INFO:tasks.workunit.client.0.smithi035.stdout: Unlink 30840 9.093 92.110 2023-03-17T10:50:17.142 INFO:tasks.workunit.client.0.smithi035.stdout: Qpathinfo 138845 7.296 155.814 2023-03-17T10:50:17.142 INFO:tasks.workunit.client.0.smithi035.stdout: Qfileinfo 24225 0.426 9.591 2023-03-17T10:50:17.142 INFO:tasks.workunit.client.0.smithi035.stdout: Qfsinfo 25353 1.054 17.623 2023-03-17T10:50:17.142 INFO:tasks.workunit.client.0.smithi035.stdout: Sfileinfo 12451 3.300 77.727 2023-03-17T10:50:17.142 INFO:tasks.workunit.client.0.smithi035.stdout: Find 53568 47.749 186.899 2023-03-17T10:50:17.953 INFO:tasks.workunit.client.0.smithi035.stdout: WriteX 75606 0.777 50.896 2023-03-17T10:50:17.953 INFO:tasks.workunit.client.0.smithi035.stdout: ReadX 239948 0.009 12.986 2023-03-17T10:50:17.954 INFO:tasks.workunit.client.0.smithi035.stdout: LockX 498 2.185 11.456 2023-03-17T10:50:17.954 INFO:tasks.workunit.client.0.smithi035.stdout: UnlockX 498 1.998 11.086 2023-03-17T10:50:17.954 INFO:tasks.workunit.client.0.smithi035.stdout: Flush 10702 8.012 85.955 2023-03-17T10:50:17.954 INFO:tasks.workunit.client.0.smithi035.stdout: 2023-03-17T10:50:17.954 INFO:tasks.workunit.client.0.smithi035.stdout:Throughput 7.93822 MB/sec 10 clients 10 procs max_latency=709.119 ms 2023-03-17T10:50:17.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:45 smithi035 ceph-mon[92535]: pgmap v3698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 428 KiB/s wr, 106 op/s 2023-03-17T10:50:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee38fd0 0x55f0eee3b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 4 client.28661 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:50:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0eed40600 con 0x55f0eee38fd0 2023-03-17T10:50:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.789+0000 7f648e7fc700 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee38fd0 0x55f0eee3b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.790+0000 7f648e7fc700 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee38fd0 0x55f0eee3b3b0 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76cdf58dbc63621 server_cookie=b186ac683b2a12ff in_seq=0 out_seq=0 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.790+0000 7f6472ff5700 10 client.28661 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.790+0000 7f6472ff5700 1 -- 172.21.15.35:0/3541982337 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f0eed40600 con 0x55f0eee38fd0 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.790+0000 7f6472ff5700 10 client.28661 handle_command_reply: tid=0 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.790+0000 7f64a16f9b80 1 client.28661 shutdown 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 msgr2=0x55f0eee2b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2b4b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f648400c5b0 tx=0x7f6484096c90 comp rx=0 tx=0).stop 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 shutdown_connections 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee38fd0 0x55f0eee3b3b0 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee28d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f6472ff5700 0 client.28661 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2b4b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:24.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3541982337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee28730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:24.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 >> 172.21.15.35:0/3541982337 conn(0x55f0eec7c6b0 msgr2=0x55f0eee1e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:24.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 shutdown_connections 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3541982337 wait complete. 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.792+0000 7f64a16f9b80 20 client.28661 trim_cache size 0 max 16384 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.807+0000 7f64a16f9b80 1 Processor -- start 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.807+0000 7f64a16f9b80 1 -- start start 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee19ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee2fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee34680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee29720 con 0x55f0eee254f0 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee1a030 con 0x55f0eee1f960 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee1f780 con 0x55f0eee24be0 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee19ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee19ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:53954/0 (socket says 172.21.15.35:53954) 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee34680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 -- 172.21.15.35:0/3583644490 learned_addr learned my addr 172.21.15.35:0/3583644490 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:24.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648e7fc700 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee2fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 -- 172.21.15.35:0/3583644490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 msgr2=0x55f0eee2fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee2fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 -- 172.21.15.35:0/3583644490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 msgr2=0x55f0eee34680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee34680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 -- 172.21.15.35:0/3583644490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0eed38130 con 0x55f0eee1f960 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f648effd700 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee19ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64840983e0 tx=0x7f6484003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd79e756c6bb6c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f6475ffb700 1 -- 172.21.15.35:0/3583644490 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840c6070 con 0x55f0eee1f960 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.808+0000 7f6475ffb700 1 -- 172.21.15.35:0/3583644490 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0eed34390 con 0x55f0eee1f960 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f6475ffb700 1 -- 172.21.15.35:0/3583644490 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840986e0 con 0x55f0eee1f960 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3583644490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 msgr2=0x55f0eee19ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee19ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64840983e0 tx=0x7f6484003680 comp rx=0 tx=0).stop 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3583644490 shutdown_connections 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee254f0 0x55f0eee34680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee19ac0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/3583644490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee24be0 0x55f0eee2fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3583644490 >> 172.21.15.35:0/3583644490 conn(0x55f0eec7c6b0 msgr2=0x55f0eee1e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3583644490 shutdown_connections 2023-03-17T10:50:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 -- 172.21.15.35:0/3583644490 wait complete. 2023-03-17T10:50:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.809+0000 7f64a16f9b80 1 -- start start 2023-03-17T10:50:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 Processor -- start 2023-03-17T10:50:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 0x55f0eee2fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee254f0 0x55f0eee2ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee2e4f0 con 0x55f0eee24be0 2023-03-17T10:50:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee2e660 con 0x55f0eee1f960 2023-03-17T10:50:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eee2e820 con 0x55f0eee254f0 2023-03-17T10:50:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f64a16f9b80 10 client.0 _ll_register_callbacks cb 0x55f0eec17230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:50:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 0x55f0eee2fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 0x55f0eee2fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52166/0 (socket says 172.21.15.35:52166) 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648e7fc700 1 -- 172.21.15.35:0/2072909275 learned_addr learned my addr 172.21.15.35:0/2072909275 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648f7fe700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee254f0 0x55f0eee2ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648effd700 1 -- 172.21.15.35:0/2072909275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee254f0 msgr2=0x55f0eee2ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648effd700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee254f0 0x55f0eee2ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648effd700 1 -- 172.21.15.35:0/2072909275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 msgr2=0x55f0eee2fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648effd700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 0x55f0eee2fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648effd700 1 -- 172.21.15.35:0/2072909275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0eeb9fd80 con 0x55f0eee1f960 2023-03-17T10:50:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.810+0000 7f648e7fc700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 0x55f0eee2fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:50:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f648effd700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2f7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6484060040 tx=0x7f64840a06d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9899b504c4124a85 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f6472ff5700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f6472ff5700 1 -- 172.21.15.35:0/2072909275 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840c6030 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f6472ff5700 1 -- 172.21.15.35:0/2072909275 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(271..271 src has 1..271) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f648400cbd0 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0eedef1e0 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f6472ff5700 1 -- 172.21.15.35:0/2072909275 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6484004300 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 10 client.28667 fetch_fsmap learned FSMap version 50 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55f0eebc61f0 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f6472ff5700 1 -- 172.21.15.35:0/2072909275 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0eedef1e0 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f6472ff5700 1 -- 172.21.15.35:0/2072909275 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f64840c8b10 con 0x55f0eee1f960 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 10 client.28667 fetch_fsmap finished waiting for FSMap version 50 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 10 client.28667 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 20 client.28667 populate_metadata read hostname 'smithi035' 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee8d9e0 0x55f0eee8fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 4 client.28667 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:50:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f0eebf5f00 con 0x55f0eee8d9e0 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.811+0000 7f648e7fc700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee8d9e0 0x55f0eee8fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.812+0000 7f6472ff5700 10 client.28667 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.812+0000 7f648e7fc700 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee8d9e0 0x55f0eee8fdc0 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51f9edb6970b2de server_cookie=aeb44d8a43cec848 in_seq=0 out_seq=0 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f6472ff5700 1 -- 172.21.15.35:0/2072909275 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f0eebf5f00 con 0x55f0eee8d9e0 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f6472ff5700 10 client.28667 handle_command_reply: tid=0 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 client.28667 shutdown 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 msgr2=0x55f0eee2f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2f7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6484060040 tx=0x7f64840a06d0 comp rx=0 tx=0).stop 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 shutdown_connections 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f0eee8d9e0 0x55f0eee8fdc0 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0eee254f0 0x55f0eee2ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0eee1f960 0x55f0eee2f7f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f6472ff5700 0 client.28667 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 --2- 172.21.15.35:0/2072909275 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f0eee24be0 0x55f0eee2fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.834+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 >> 172.21.15.35:0/2072909275 conn(0x55f0eec7c6b0 msgr2=0x55f0eee352a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.838+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 shutdown_connections 2023-03-17T10:50:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.838+0000 7f64a16f9b80 1 -- 172.21.15.35:0/2072909275 wait complete. 2023-03-17T10:50:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.838+0000 7f64a16f9b80 20 client.28667 trim_cache size 0 max 16384 2023-03-17T10:50:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647809f640 msgr2=0x7f64780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647809f640 0x7f64780a1af0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6480000c00 tx=0x7f648000b540 comp rx=0 tx=0).stop 2023-03-17T10:50:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 msgr2=0x7f64901962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64901962e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f648400eb30 tx=0x7f648400ee40 comp rx=0 tx=0).stop 2023-03-17T10:50:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 shutdown_connections 2023-03-17T10:50:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647809f640 0x7f64780a1af0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6490104440 0x7f649019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64900ffb40 0x7f64901962e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 --2- 172.21.15.35:0/36501616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64901004e0 0x7f6490196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 >> 172.21.15.35:0/36501616 conn(0x7f6490074590 msgr2=0x7f6490102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 shutdown_connections 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:05.839+0000 7f649556c700 1 -- 172.21.15.35:0/36501616 wait complete. 2023-03-17T10:50:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.963+0000 7fed10da9700 1 -- 172.21.15.35:0/1504157264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ff350 msgr2=0x7fed0c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.963+0000 7fed10da9700 1 --2- 172.21.15.35:0/1504157264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ff350 0x7fed0c0ff720 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0099c0 tx=0x7fecfc009cd0 comp rx=0 tx=0).stop 2023-03-17T10:50:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.963+0000 7fed10da9700 1 -- 172.21.15.35:0/1504157264 shutdown_connections 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.963+0000 7fed10da9700 1 --2- 172.21.15.35:0/1504157264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c104390 0x7fed0c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.963+0000 7fed10da9700 1 --2- 172.21.15.35:0/1504157264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ff350 0x7fed0c0ff720 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.963+0000 7fed10da9700 1 --2- 172.21.15.35:0/1504157264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.964+0000 7fed10da9700 1 -- 172.21.15.35:0/1504157264 >> 172.21.15.35:0/1504157264 conn(0x7fed0c076330 msgr2=0x7fed0c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.964+0000 7fed10da9700 1 -- 172.21.15.35:0/1504157264 shutdown_connections 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.964+0000 7fed10da9700 1 -- 172.21.15.35:0/1504157264 wait complete. 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.964+0000 7fed10da9700 1 Processor -- start 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.964+0000 7fed10da9700 1 -- start start 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed10da9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c0ff350 0x7fed0c195140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed10da9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed10da9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed0c104390 0x7fed0c199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed10da9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c19a120 con 0x7fed0c0ffcf0 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed10da9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c19a290 con 0x7fed0c0ff350 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed10da9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c19a450 con 0x7fed0c104390 2023-03-17T10:50:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed09d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:34.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed09d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52180/0 (socket says 172.21.15.35:52180) 2023-03-17T10:50:34.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed09d9b700 1 -- 172.21.15.35:0/3929688251 learned_addr learned my addr 172.21.15.35:0/3929688251 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed0c104390 0x7fed0c199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c0ff350 0x7fed0c195140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 -- 172.21.15.35:0/3929688251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed0c104390 msgr2=0x7fed0c199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed0c104390 0x7fed0c199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 -- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 msgr2=0x7fed0c195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 -- 172.21.15.35:0/3929688251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0095f0 con 0x7fed0c0ff350 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed09d9b700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c0ff350 0x7fed0c195140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009fd0 tx=0x7fecfc009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.965+0000 7fecfb7fe700 1 -- 172.21.15.35:0/3929688251 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc01d070 con 0x7fed0c0ff350 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.966+0000 7fecfb7fe700 1 -- 172.21.15.35:0/3929688251 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc0059a0 con 0x7fed0c0ff350 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.966+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c10f000 con 0x7fed0c0ff350 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.966+0000 7fecfb7fe700 1 -- 172.21.15.35:0/3929688251 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc022cb0 con 0x7fed0c0ff350 2023-03-17T10:50:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.966+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c10ee70 con 0x7fed0c0ff350 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.968+0000 7fecfb7fe700 1 -- 172.21.15.35:0/3929688251 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fecfc022470 con 0x7fed0c0ff350 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.969+0000 7fecfb7fe700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecf409f640 0x7fecf40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.969+0000 7fed09d9b700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecf409f640 0x7fecf40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.969+0000 7fecfb7fe700 1 -- 172.21.15.35:0/3929688251 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(272..272 src has 1..272) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fecfc0cb720 con 0x7fed0c0ff350 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.969+0000 7fed09d9b700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecf409f640 0x7fecf40a1af0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed0c196750 tx=0x7fed00009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 Processor -- start 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 -- start start 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 0x55a76cd15160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd0f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd0fb70 0x55a76cd0ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cc14010 con 0x55a76cd14d90 2023-03-17T10:50:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cc66950 con 0x55a76cd156a0 2023-03-17T10:50:37.423 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-03-17T10:50:39.064 DEBUG:teuthology.orchestra.run.smithi035:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-03-17T10:50:39.065 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:47 smithi035 ceph-mon[92535]: pgmap v3699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 428 KiB/s wr, 106 op/s 2023-03-17T10:50:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cc5fde0 con 0x55a76cd0fb70 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 0x55a76cd15160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 0x55a76cd15160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52186/0 (socket says 172.21.15.35:52186) 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed0a59c700 1 -- 172.21.15.35:0/3445348361 learned_addr learned my addr 172.21.15.35:0/3445348361 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.970+0000 7fed09d9b700 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd0f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0ad9d700 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd0fb70 0x55a76cd0ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0a59c700 1 -- 172.21.15.35:0/3445348361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd0fb70 msgr2=0x55a76cd0ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:42.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd0fb70 0x55a76cd0ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0a59c700 1 -- 172.21.15.35:0/3445348361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 msgr2=0x55a76cd0f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd0f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0a59c700 1 -- 172.21.15.35:0/3445348361 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a76cae15d0 con 0x55a76cd14d90 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed09d9b700 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd0f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 0x55a76cd15160 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0a0e90 tx=0x7fecfc0956c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39603566d123e2ed server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fecf8ff9700 1 -- 172.21.15.35:0/3445348361 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0a13c0 con 0x55a76cd14d90 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fecf8ff9700 1 -- 172.21.15.35:0/3445348361 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc0994c0 con 0x55a76cd14d90 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.971+0000 7fecf8ff9700 1 -- 172.21.15.35:0/3445348361 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0a0f30 con 0x55a76cd14d90 2023-03-17T10:50:42.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3445348361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 msgr2=0x55a76cd15160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 0x55a76cd15160 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0a0e90 tx=0x7fecfc0956c0 comp rx=0 tx=0).stop 2023-03-17T10:50:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3445348361 shutdown_connections 2023-03-17T10:50:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd0fb70 0x55a76cd0ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:42.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd14d90 0x55a76cd15160 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3445348361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd0f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3445348361 >> 172.21.15.35:0/3445348361 conn(0x55a76cb6a6b0 msgr2=0x55a76cd07a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3445348361 shutdown_connections 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3445348361 wait complete. 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 -- start start 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.972+0000 7fed1cf36b80 1 Processor -- start 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd18970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cae38c0 con 0x55a76cd0fb70 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cd197f0 con 0x55a76cd14d90 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cd24e60 con 0x55a76cd156a0 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed1cf36b80 10 client.0 _ll_register_callbacks cb 0x55a76cb05230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52192/0 (socket says 172.21.15.35:52192) 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 -- 172.21.15.35:0/2262277010 learned_addr learned my addr 172.21.15.35:0/2262277010 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0ad9d700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed09d9b700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd18970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 -- 172.21.15.35:0/2262277010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 msgr2=0x55a76cd190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 -- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 msgr2=0x55a76cd18970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd18970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 -- 172.21.15.35:0/2262277010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c10ee70 con 0x55a76cd0fb70 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed09d9b700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd18970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fed0a59c700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1b6f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0991f0 tx=0x7fecfc098a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c50f3ab3c17a12f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fecf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:50:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.973+0000 7fecf1ffb700 1 -- 172.21.15.35:0/2262277010 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0a1140 con 0x55a76cd0fb70 2023-03-17T10:50:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fecf1ffb700 1 -- 172.21.15.35:0/2262277010 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(272..272 src has 1..272) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fecfc0b1260 con 0x55a76cd0fb70 2023-03-17T10:50:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a76cc22390 con 0x55a76cd0fb70 2023-03-17T10:50:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fecf1ffb700 1 -- 172.21.15.35:0/2262277010 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecfc0b1460 con 0x55a76cd0fb70 2023-03-17T10:50:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 10 client.19518 fetch_fsmap learned FSMap version 52 2023-03-17T10:50:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55a76ca8dd80 con 0x55a76cd0fb70 2023-03-17T10:50:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fecf1ffb700 1 -- 172.21.15.35:0/2262277010 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a76cc22390 con 0x55a76cd0fb70 2023-03-17T10:50:49.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fecf1ffb700 1 -- 172.21.15.35:0/2262277010 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 52) v1 ==== 6925+0+0 (secure 0 0 0) 0x7fecfc0c5070 con 0x55a76cd0fb70 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 10 client.19518 fetch_fsmap finished waiting for FSMap version 52 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 10 client.19518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 20 client.19518 populate_metadata read hostname 'smithi035' 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd28be0 0x55a76cd2aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 4 client.19518 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a76cc2e600 con 0x55a76cd28be0 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.974+0000 7fed09d9b700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd28be0 0x55a76cd2aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.975+0000 7fecf1ffb700 10 client.19518 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.975+0000 7fed09d9b700 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd28be0 0x55a76cd2aff0 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f3f8b9a6cf98ec server_cookie=af7511359fa81b21 in_seq=0 out_seq=0 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fecf1ffb700 1 -- 172.21.15.35:0/2262277010 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a76cc2e600 con 0x55a76cd28be0 2023-03-17T10:50:49.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fecf1ffb700 10 client.19518 handle_command_reply: tid=0 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 client.19518 shutdown 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 msgr2=0x55a76cd1b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1b6f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0991f0 tx=0x7fecfc098a00 comp rx=0 tx=0).stop 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 shutdown_connections 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd28be0 0x55a76cd2aff0 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1b6f0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fecf1ffb700 0 client.19518 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/2262277010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd18970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 >> 172.21.15.35:0/2262277010 conn(0x55a76cb6a6b0 msgr2=0x55a76cd0c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 shutdown_connections 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 1 -- 172.21.15.35:0/2262277010 wait complete. 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.976+0000 7fed1cf36b80 20 client.19518 trim_cache size 0 max 16384 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 Processor -- start 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 -- start start 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd18920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd1b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cd19ae0 con 0x55a76cd0fb70 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cc2e630 con 0x55a76cd14d90 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cc23050 con 0x55a76cd156a0 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd18920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd18920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52200/0 (socket says 172.21.15.35:52200) 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed0a59c700 1 -- 172.21.15.35:0/3049471883 learned_addr learned my addr 172.21.15.35:0/3049471883 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed0ad9d700 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd1b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.992+0000 7fed09d9b700 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0a59c700 1 -- 172.21.15.35:0/3049471883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 msgr2=0x55a76cd1b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd1b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0a59c700 1 -- 172.21.15.35:0/3049471883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 msgr2=0x55a76cd07ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd07ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0a59c700 1 -- 172.21.15.35:0/3049471883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a76cc26130 con 0x55a76cd0fb70 2023-03-17T10:50:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0ad9d700 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd1b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:50:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fed0a59c700 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd18920 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0c8f10 tx=0x7fecfc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7aeb3735e5c576 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fecf97fa700 1 -- 172.21.15.35:0/3049471883 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0b71a0 con 0x55a76cd0fb70 2023-03-17T10:50:54.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fecf97fa700 1 -- 172.21.15.35:0/3049471883 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc0a1140 con 0x55a76cd0fb70 2023-03-17T10:50:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.993+0000 7fecf97fa700 1 -- 172.21.15.35:0/3049471883 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0981c0 con 0x55a76cd0fb70 2023-03-17T10:50:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3049471883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 msgr2=0x55a76cd18920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd18920 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0c8f10 tx=0x7fecfc000bc0 comp rx=0 tx=0).stop 2023-03-17T10:50:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3049471883 shutdown_connections 2023-03-17T10:50:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd156a0 0x55a76cd1b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd18920 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/3049471883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd14d90 0x55a76cd07ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3049471883 >> 172.21.15.35:0/3049471883 conn(0x55a76cb6a6b0 msgr2=0x55a76cd18210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:50:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3049471883 shutdown_connections 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 -- 172.21.15.35:0/3049471883 wait complete. 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 -- start start 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.994+0000 7fed1cf36b80 1 Processor -- start 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd14d90 0x55a76cd1e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd75a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cd75fc0 con 0x55a76cd0fb70 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cd76130 con 0x55a76cd156a0 2023-03-17T10:50:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76cd762f0 con 0x55a76cd14d90 2023-03-17T10:50:57.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 10 client.0 _ll_register_callbacks cb 0x55a76cb05230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:50:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52206/0 (socket says 172.21.15.35:52206) 2023-03-17T10:50:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 -- 172.21.15.35:0/788665795 learned_addr learned my addr 172.21.15.35:0/788665795 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:50:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0ad9d700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd75a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed09d9b700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd14d90 0x55a76cd1e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 -- 172.21.15.35:0/788665795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd14d90 msgr2=0x55a76cd1e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd14d90 0x55a76cd1e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 -- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 msgr2=0x55a76cd75a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd75a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 -- 172.21.15.35:0/788665795 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed040092a0 con 0x55a76cd0fb70 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed09d9b700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd14d90 0x55a76cd1e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed0a59c700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1dfa0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0098e0 tx=0x7fecfc0a12b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6651f90d062555f5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fecf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fecf1ffb700 1 -- 172.21.15.35:0/788665795 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0b71a0 con 0x55a76cd0fb70 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fecf1ffb700 1 -- 172.21.15.35:0/788665795 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(272..272 src has 1..272) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fecfc0b1260 con 0x55a76cd0fb70 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.995+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a76ccdd1e0 con 0x55a76cd0fb70 2023-03-17T10:50:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fecf1ffb700 1 -- 172.21.15.35:0/788665795 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecfc0983d0 con 0x55a76cd0fb70 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 10 client.19524 fetch_fsmap learned FSMap version 52 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55a76ca8dd80 con 0x55a76cd0fb70 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fecf1ffb700 1 -- 172.21.15.35:0/788665795 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc0a5080 con 0x55a76cd0fb70 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fecf1ffb700 1 -- 172.21.15.35:0/788665795 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 52) v1 ==== 6925+0+0 (secure 0 0 0) 0x7fecfc0c5070 con 0x55a76cd0fb70 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 10 client.19524 fetch_fsmap finished waiting for FSMap version 52 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 10 client.19524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 20 client.19524 populate_metadata read hostname 'smithi035' 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd0d940 0x55a76cd0dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:50:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 4 client.19524 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a76cae3f00 con 0x55a76cd0d940 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed09d9b700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd0d940 0x55a76cd0dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fecf1ffb700 10 client.19524 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:18.996+0000 7fed09d9b700 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd0d940 0x55a76cd0dd10 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964d76e7963f3b22 server_cookie=67c4ef67c573f0f in_seq=0 out_seq=0 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.021+0000 7fecf1ffb700 1 -- 172.21.15.35:0/788665795 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a76cae3f00 con 0x55a76cd0d940 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.021+0000 7fecf1ffb700 10 client.19524 handle_command_reply: tid=0 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.021+0000 7fed1cf36b80 1 client.19524 shutdown 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 msgr2=0x55a76cd1dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:50:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1dfa0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0098e0 tx=0x7fecfc0a12b0 comp rx=0 tx=0).stop 2023-03-17T10:51:00.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 shutdown_connections 2023-03-17T10:51:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a76cd0d940 0x55a76cd0dd10 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a76cd156a0 0x55a76cd75a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a76cd0fb70 0x55a76cd1dfa0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:00.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 --2- 172.21.15.35:0/788665795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a76cd14d90 0x55a76cd1e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:00.083 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:49 smithi035 ceph-mon[92535]: pgmap v3700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 444 KiB/s wr, 114 op/s 2023-03-17T10:51:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 >> 172.21.15.35:0/788665795 conn(0x55a76cb6a6b0 msgr2=0x55a76cd15a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fecf1ffb700 0 client.19524 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 shutdown_connections 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 1 -- 172.21.15.35:0/788665795 wait complete. 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed1cf36b80 20 client.19524 trim_cache size 0 max 16384 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecf409f640 msgr2=0x7fecf40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecf409f640 0x7fecf40a1af0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed0c196750 tx=0x7fed00009260 comp rx=0 tx=0).stop 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c0ff350 msgr2=0x7fed0c195140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c0ff350 0x7fed0c195140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009fd0 tx=0x7fecfc009580 comp rx=0 tx=0).stop 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 shutdown_connections 2023-03-17T10:51:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fecf409f640 0x7fecf40a1af0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed0c104390 0x7fed0c199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed0c0ff350 0x7fed0c195140 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 --2- 172.21.15.35:0/3929688251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fed0c0ffcf0 0x7fed0c195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.022+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 >> 172.21.15.35:0/3929688251 conn(0x7fed0c076330 msgr2=0x7fed0c102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.023+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 shutdown_connections 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:19.023+0000 7fed10da9700 1 -- 172.21.15.35:0/3929688251 wait complete. 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 -- 172.21.15.35:0/868800207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ffcf0 msgr2=0x7fc2c4103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/868800207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c4103cb0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40099c0 tx=0x7fc2b4009cd0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 -- 172.21.15.35:0/868800207 shutdown_connections 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/868800207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c4104390 0x7fc2c410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/868800207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ff350 0x7fc2c40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:03.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/868800207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c4103cb0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:06.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 -- 172.21.15.35:0/868800207 >> 172.21.15.35:0/868800207 conn(0x7fc2c4076330 msgr2=0x7fc2c4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 -- 172.21.15.35:0/868800207 shutdown_connections 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.147+0000 7fc2cbfae700 1 -- 172.21.15.35:0/868800207 wait complete. 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 Processor -- start 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 -- start start 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 0x7fc2c4195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c41956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c4104390 0x7fc2c4199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c419a160 con 0x7fc2c40ff350 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c419a2d0 con 0x7fc2c40ffcf0 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2cbfae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c419a490 con 0x7fc2c4104390 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 0x7fc2c4195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 0x7fc2c4195180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52222/0 (socket says 172.21.15.35:52222) 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/2480348352 learned_addr learned my addr 172.21.15.35:0/2480348352 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:06.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9549700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c41956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c4104390 0x7fc2c4199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/2480348352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c4104390 msgr2=0x7fc2c4199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c4104390 0x7fc2c4199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/2480348352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ffcf0 msgr2=0x7fc2c41956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c41956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/2480348352 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b40095f0 con 0x7fc2c40ff350 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.148+0000 7fc2c9549700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c41956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.149+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 0x7fc2c4195180 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000e9a0 tx=0x7fc2c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.149+0000 7fc2baffd700 1 -- 172.21.15.35:0/2480348352 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0009790 con 0x7fc2c40ff350 2023-03-17T10:51:06.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.149+0000 7fc2baffd700 1 -- 172.21.15.35:0/2480348352 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2c0021440 con 0x7fc2c40ff350 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.149+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c410f010 con 0x7fc2c40ff350 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.149+0000 7fc2baffd700 1 -- 172.21.15.35:0/2480348352 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000cea0 con 0x7fc2c40ff350 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.149+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c410ee80 con 0x7fc2c40ff350 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.151+0000 7fc2baffd700 1 -- 172.21.15.35:0/2480348352 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc2c00215b0 con 0x7fc2c40ff350 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.152+0000 7fc2baffd700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc2b009f640 0x7fc2b00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.152+0000 7fc2c9549700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc2b009f640 0x7fc2b00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.152+0000 7fc2baffd700 1 -- 172.21.15.35:0/2480348352 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(272..272 src has 1..272) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc2c0025070 con 0x7fc2c40ff350 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.152+0000 7fc2c9549700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc2b009f640 0x7fc2b00a1af0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009990 tx=0x7fc2b401a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 Processor -- start 2023-03-17T10:51:06.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 -- start start 2023-03-17T10:51:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f0be0 0x5586941f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586940f2010 con 0x5586941eb960 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558694144950 con 0x5586941f0be0 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55869413dde0 con 0x5586941f14f0 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2ca54b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2ca54b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941ebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52232/0 (socket says 172.21.15.35:52232) 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2ca54b700 1 -- 172.21.15.35:0/1218359912 learned_addr learned my addr 172.21.15.35:0/1218359912 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.153+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f0be0 0x5586941f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9549700 1 -- 172.21.15.35:0/1218359912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f0be0 msgr2=0x5586941f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f0be0 0x5586941f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9549700 1 -- 172.21.15.35:0/1218359912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 msgr2=0x5586941ebd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941ebd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9549700 1 -- 172.21.15.35:0/1218359912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558693fbf5d0 con 0x5586941f14f0 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f0be0 0x5586941f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941eb420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009fd0 tx=0x7fc2b401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74defd68642379d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2affff700 1 -- 172.21.15.35:0/1218359912 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b40056a0 con 0x5586941f14f0 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2affff700 1 -- 172.21.15.35:0/1218359912 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2b401e040 con 0x5586941f14f0 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.154+0000 7fc2affff700 1 -- 172.21.15.35:0/1218359912 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400f950 con 0x5586941f14f0 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1218359912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 msgr2=0x5586941eb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941eb420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009fd0 tx=0x7fc2b401f000 comp rx=0 tx=0).stop 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1218359912 shutdown_connections 2023-03-17T10:51:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f0be0 0x5586941f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:10.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1218359912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941eb420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1218359912 >> 172.21.15.35:0/1218359912 conn(0x5586940486b0 msgr2=0x5586941e5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1218359912 shutdown_connections 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.155+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1218359912 wait complete. 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 -- start start 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 Processor -- start 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 0x5586941f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558693fc18c0 con 0x5586941f0be0 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941f55b0 con 0x5586941eb960 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558694200fa0 con 0x5586941f14f0 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2d813bb80 10 client.0 _ll_register_callbacks cb 0x558693fe3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2c9549700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 0x5586941f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2c9549700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 0x5586941f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52236/0 (socket says 172.21.15.35:52236) 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2c9549700 1 -- 172.21.15.35:0/2267365699 learned_addr learned my addr 172.21.15.35:0/2267365699 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.156+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ca54b700 1 -- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 msgr2=0x5586941f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ca54b700 1 -- 172.21.15.35:0/2267365699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 msgr2=0x5586941f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 0x5586941f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ca54b700 1 -- 172.21.15.35:0/2267365699 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c410c7a0 con 0x5586941f14f0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2c9549700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 0x5586941f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941f4e40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc055dc0 tx=0x7fc2bc011510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed118b1e014655fb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/2267365699 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00e040 con 0x5586941f14f0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/2267365699 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(272..272 src has 1..272) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc2bc004db0 con 0x5586941f14f0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558694100390 con 0x5586941f14f0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/2267365699 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2bc0092e0 con 0x5586941f14f0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2d813bb80 10 client.28681 fetch_fsmap learned FSMap version 54 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.157+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x558693f6bd80 con 0x5586941f14f0 2023-03-17T10:51:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/2267365699 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558694100390 con 0x5586941f14f0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/2267365699 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 54) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fc2bc01b020 con 0x5586941f14f0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2d813bb80 10 client.28681 fetch_fsmap finished waiting for FSMap version 54 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2d813bb80 10 client.28681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2d813bb80 20 client.28681 populate_metadata read hostname 'smithi035' 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5586942051f0 0x558694207600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2d813bb80 4 client.28681 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55869410c600 con 0x5586942051f0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5586942051f0 0x558694207600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2ad7fa700 10 client.28681 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.158+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5586942051f0 0x558694207600 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9cc026f1a64de8 server_cookie=e44e393c85ea3d4f in_seq=0 out_seq=0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/2267365699 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55869410c600 con 0x5586942051f0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2ad7fa700 10 client.28681 handle_command_reply: tid=0 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 client.28681 shutdown 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 msgr2=0x5586941f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941f4e40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc055dc0 tx=0x7fc2bc011510 comp rx=0 tx=0).stop 2023-03-17T10:51:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 shutdown_connections 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5586942051f0 0x558694207600 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f14f0 0x5586941f4e40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/2267365699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f0be0 0x5586941f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2ad7fa700 0 client.28681 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 >> 172.21.15.35:0/2267365699 conn(0x5586940486b0 msgr2=0x5586941ea410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 shutdown_connections 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 1 -- 172.21.15.35:0/2267365699 wait complete. 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.159+0000 7fc2d813bb80 20 client.28681 trim_cache size 0 max 16384 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.176+0000 7fc2d813bb80 1 Processor -- start 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.176+0000 7fc2d813bb80 1 -- start start 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.176+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 0x5586941f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941f56f0 con 0x5586941f14f0 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941e2b60 con 0x5586941eb960 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941f5d10 con 0x5586941f0be0 2023-03-17T10:51:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 0x5586941f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 0x5586941f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52246/0 (socket says 172.21.15.35:52246) 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 -- 172.21.15.35:0/1275191990 learned_addr learned my addr 172.21.15.35:0/1275191990 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 -- 172.21.15.35:0/1275191990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 msgr2=0x5586941f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 -- 172.21.15.35:0/1275191990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 msgr2=0x5586941fbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941fbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:16.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:51 smithi035 ceph-mon[92535]: pgmap v3701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 18 op/s 2023-03-17T10:51:16.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:52 smithi035 ceph-mon[92535]: pgmap v3702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 67 KiB/s wr, 23 op/s 2023-03-17T10:51:16.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:54 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:17.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:54 smithi035 ceph-mon[92535]: pgmap v3703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 13 op/s 2023-03-17T10:51:17.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:57 smithi035 ceph-mon[92535]: pgmap v3704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 13 op/s 2023-03-17T10:51:17.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:58 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:20.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:58 smithi035 ceph-mon[92535]: pgmap v3705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 72 KiB/s wr, 20 op/s 2023-03-17T10:51:20.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:38:59 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:20.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:00 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:20.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:00 smithi035 ceph-mon[92535]: pgmap v3706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 12 op/s 2023-03-17T10:51:20.614 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:02 smithi035 ceph-mon[92535]: pgmap v3707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 170 KiB/s wr, 34 op/s 2023-03-17T10:51:22.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:03 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:22.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:04 smithi035 ceph-mon[92535]: pgmap v3708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 28 op/s 2023-03-17T10:51:22.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:07 smithi035 ceph-mon[92535]: pgmap v3709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 28 op/s 2023-03-17T10:51:22.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:08 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:22.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:09 smithi035 ceph-mon[92535]: pgmap v3710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 535 KiB/s wr, 49 op/s 2023-03-17T10:51:22.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:10 smithi035 ceph-mon[92535]: osdmap e306: 12 total, 12 up, 12 in 2023-03-17T10:51:22.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:11 smithi035 ceph-mon[92535]: pgmap v3712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 585 KiB/s wr, 50 op/s 2023-03-17T10:51:22.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:12 smithi035 ceph-mon[92535]: pgmap v3713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T10:51:22.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:51:24.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:14 smithi035 ceph-mon[92535]: pgmap v3714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T10:51:24.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:17 smithi035 ceph-mon[92535]: pgmap v3715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:17 smithi035 ceph-mon[92535]: osdmap e307: 12 total, 12 up, 12 in 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:24.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:24.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T10:51:24.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T10:51:24.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:51:24.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T10:51:25.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: pgmap v3717: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 70 KiB/s wr, 42 op/s 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:51:25.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: pgmap v3718: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-03-17T10:51:27.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: pgmap v3719: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 51 op/s 2023-03-17T10:51:27.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:27.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:21 smithi035 ceph-mon[92535]: pgmap v3720: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 51 op/s 2023-03-17T10:51:27.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:22 smithi035 ceph-mon[92535]: pgmap v3721: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 443 KiB/s wr, 77 op/s 2023-03-17T10:51:27.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:24 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:27.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:24 smithi035 ceph-mon[92535]: pgmap v3722: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 364 KiB/s wr, 63 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:26 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:26 smithi035 ceph-mon[92535]: pgmap v3723: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 261 KiB/s wr, 19 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:29 smithi035 ceph-mon[92535]: pgmap v3724: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 424 KiB/s wr, 35 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:31 smithi035 ceph-mon[92535]: pgmap v3725: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 353 KiB/s wr, 29 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:31 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:32 smithi035 ceph-mon[92535]: pgmap v3726: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 357 KiB/s wr, 34 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:35 smithi035 ceph-mon[92535]: pgmap v3727: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 180 KiB/s wr, 21 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:37 smithi035 ceph-mon[92535]: pgmap v3728: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 180 KiB/s wr, 21 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:39 smithi035 ceph-mon[92535]: pgmap v3729: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:41 smithi035 ceph-mon[92535]: pgmap v3730: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:42 smithi035 ceph-mon[92535]: pgmap v3731: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:45 smithi035 ceph-mon[92535]: pgmap v3732: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:47 smithi035 ceph-mon[92535]: pgmap v3733: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2023-03-17T10:51:27.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:49 smithi035 ceph-mon[92535]: pgmap v3734: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 18 op/s 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:51 smithi035 ceph-mon[92535]: pgmap v3735: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 13 op/s 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:52 smithi035 ceph-mon[92535]: pgmap v3736: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 18 op/s 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:55 smithi035 ceph-mon[92535]: pgmap v3737: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:57 smithi035 ceph-mon[92535]: pgmap v3738: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:39:59 smithi035 ceph-mon[92535]: pgmap v3739: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T10:51:30.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:01 smithi035 ceph-mon[92535]: pgmap v3740: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2023-03-17T10:51:30.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:02 smithi035 ceph-mon[92535]: pgmap v3741: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 28 op/s 2023-03-17T10:51:32.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:05 smithi035 ceph-mon[92535]: pgmap v3742: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:07 smithi035 ceph-mon[92535]: pgmap v3743: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:09 smithi035 ceph-mon[92535]: pgmap v3744: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 29 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:10 smithi035 ceph-mon[92535]: osdmap e308: 12 total, 12 up, 12 in 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:11 smithi035 ceph-mon[92535]: pgmap v3746: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:12 smithi035 ceph-mon[92535]: pgmap v3747: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:15 smithi035 ceph-mon[92535]: pgmap v3748: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:17 smithi035 ceph-mon[92535]: pgmap v3749: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:17 smithi035 ceph-mon[92535]: osdmap e309: 12 total, 12 up, 12 in 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:19 smithi035 ceph-mon[92535]: pgmap v3751: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 114 B/s wr, 12 op/s 2023-03-17T10:51:32.723 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:51:32.724 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:21 smithi035 ceph-mon[92535]: pgmap v3752: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:51:33.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: pgmap v3753: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T10:51:33.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:33.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:33.810 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: pgmap v3754: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 127 B/s wr, 13 op/s 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: pgmap v3755: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 169 B/s wr, 18 op/s 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:25 smithi035 ceph-mon[92535]: pgmap v3756: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 136 B/s wr, 14 op/s 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:27 smithi035 ceph-mon[92535]: pgmap v3757: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T10:51:34.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:29 smithi035 ceph-mon[92535]: pgmap v3758: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 op/s 2023-03-17T10:51:34.147 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:31 smithi035 ceph-mon[92535]: pgmap v3759: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T10:51:34.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:32 smithi035 ceph-mon[92535]: pgmap v3760: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:51:34.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:35 smithi035 ceph-mon[92535]: pgmap v3761: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:51:34.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:37 smithi035 ceph-mon[92535]: pgmap v3762: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:51:34.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:39 smithi035 ceph-mon[92535]: pgmap v3763: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:51:34.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:41 smithi035 ceph-mon[92535]: pgmap v3764: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:51:34.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:42 smithi035 ceph-mon[92535]: pgmap v3765: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:51:34.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:45 smithi035 ceph-mon[92535]: pgmap v3766: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:51:34.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:47 smithi035 ceph-mon[92535]: pgmap v3767: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:51:34.992 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:49 smithi035 ceph-mon[92535]: pgmap v3768: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:51:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:51:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:51:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:51:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:51:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:51:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:51:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:51:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:51:35.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:51:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:51:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:51:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:51:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:51:36.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:51:36.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 -- 172.21.15.35:0/1275191990 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558694104130 con 0x5586941f14f0 2023-03-17T10:51:36.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 0x5586941f3f60 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009360 tx=0x7fc2bc009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fdca15e1c815dc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2b8ff9700 1 -- 172.21.15.35:0/1275191990 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00e030 con 0x5586941f14f0 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2b8ff9700 1 -- 172.21.15.35:0/1275191990 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2bc00f040 con 0x5586941f14f0 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.177+0000 7fc2b8ff9700 1 -- 172.21.15.35:0/1275191990 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc01ea00 con 0x5586941f14f0 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1275191990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 msgr2=0x5586941f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 0x5586941f3f60 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009360 tx=0x7fc2bc009390 comp rx=0 tx=0).stop 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1275191990 shutdown_connections 2023-03-17T10:51:37.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941f14f0 0x5586941f3f60 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941eb960 0x5586941fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1275191990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1275191990 >> 172.21.15.35:0/1275191990 conn(0x5586940486b0 msgr2=0x5586942013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1275191990 shutdown_connections 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1275191990 wait complete. 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 -- start start 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.178+0000 7fc2d813bb80 1 Processor -- start 2023-03-17T10:51:37.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f14f0 0x5586941fa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:37.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941fa720 con 0x5586941eb960 2023-03-17T10:51:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941fa860 con 0x5586941f14f0 2023-03-17T10:51:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586941faa20 con 0x5586941f0be0 2023-03-17T10:51:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941fbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52248/0 (socket says 172.21.15.35:52248) 2023-03-17T10:51:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/1998971543 learned_addr learned my addr 172.21.15.35:0/1998971543 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2d813bb80 10 client.0 _ll_register_callbacks cb 0x558693fe3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:51:41.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f14f0 0x5586941fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/1998971543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 msgr2=0x5586941fc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941fc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f14f0 msgr2=0x5586941fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f14f0 0x5586941fa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2c9d4a700 1 -- 172.21.15.35:0/1998971543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558693f6bd80 con 0x5586941eb960 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.179+0000 7fc2ca54b700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f14f0 0x5586941fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2c9d4a700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941fbbb0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00d9710 tx=0x7fc2c002b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b90f237e3d96c96 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/1998971543 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00b1620 con 0x5586941eb960 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586941bb1e0 con 0x5586941eb960 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/1998971543 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(272..272 src has 1..272) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc2c00a8920 con 0x5586941eb960 2023-03-17T10:51:41.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/1998971543 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2c00a8ae0 con 0x5586941eb960 2023-03-17T10:51:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 10 client.19542 fetch_fsmap learned FSMap version 54 2023-03-17T10:51:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x558693f921f0 con 0x5586941eb960 2023-03-17T10:51:41.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/1998971543 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2c0073020 con 0x5586941eb960 2023-03-17T10:51:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/1998971543 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 54) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fc2c00a5220 con 0x5586941eb960 2023-03-17T10:51:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 10 client.19542 fetch_fsmap finished waiting for FSMap version 54 2023-03-17T10:51:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 10 client.19542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:51:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 20 client.19542 populate_metadata read hostname 'smithi035' 2023-03-17T10:51:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55869436a350 0x55869436c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:42.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 4 client.19542 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558693fc1f00 con 0x55869436a350 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.180+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55869436a350 0x55869436c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.181+0000 7fc2c9549700 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55869436a350 0x55869436c760 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48d49e48da762bc2 server_cookie=2f772805b1ed1613 in_seq=0 out_seq=0 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.181+0000 7fc2ad7fa700 10 client.19542 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2ad7fa700 1 -- 172.21.15.35:0/1998971543 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558693fc1f00 con 0x55869436a350 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2ad7fa700 10 client.19542 handle_command_reply: tid=0 2023-03-17T10:51:42.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 client.19542 shutdown 2023-03-17T10:51:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 msgr2=0x5586941fbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941fbbb0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00d9710 tx=0x7fc2c002b040 comp rx=0 tx=0).stop 2023-03-17T10:51:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 shutdown_connections 2023-03-17T10:51:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55869436a350 0x55869436c760 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586941f14f0 0x5586941fa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:44.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5586941eb960 0x5586941fbbb0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2ad7fa700 0 client.19542 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 --2- 172.21.15.35:0/1998971543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5586941f0be0 0x5586941fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 >> 172.21.15.35:0/1998971543 conn(0x5586940486b0 msgr2=0x5586941ee6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 shutdown_connections 2023-03-17T10:51:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.213+0000 7fc2d813bb80 1 -- 172.21.15.35:0/1998971543 wait complete. 2023-03-17T10:51:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.214+0000 7fc2d813bb80 20 client.19542 trim_cache size 0 max 16384 2023-03-17T10:51:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.214+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc2b009f640 msgr2=0x7fc2b00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.214+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc2b009f640 0x7fc2b00a1af0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009990 tx=0x7fc2b401a040 comp rx=0 tx=0).stop 2023-03-17T10:51:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.214+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 msgr2=0x7fc2c4195180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.214+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 0x7fc2c4195180 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000e9a0 tx=0x7fc2c000ecb0 comp rx=0 tx=0).stop 2023-03-17T10:51:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 shutdown_connections 2023-03-17T10:51:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc2b009f640 0x7fc2b00a1af0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2c4104390 0x7fc2c4199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc2c40ff350 0x7fc2c4195180 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 --2- 172.21.15.35:0/2480348352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c40ffcf0 0x7fc2c41956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 >> 172.21.15.35:0/2480348352 conn(0x7fc2c4076330 msgr2=0x7fc2c40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 shutdown_connections 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:22:32.215+0000 7fc2cbfae700 1 -- 172.21.15.35:0/2480348352 wait complete. 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 -- 172.21.15.35:0/3225990764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c10cbc0 msgr2=0x7f537c10efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 --2- 172.21.15.35:0/3225990764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c10cbc0 0x7f537c10efa0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f537400b0a0 tx=0x7f537400b3b0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 -- 172.21.15.35:0/3225990764 shutdown_connections 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 --2- 172.21.15.35:0/3225990764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c10cbc0 0x7f537c10efa0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 --2- 172.21.15.35:0/3225990764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff010 0x7f537c0ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 --2- 172.21.15.35:0/3225990764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c0ff920 0x7f537c10c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 -- 172.21.15.35:0/3225990764 >> 172.21.15.35:0/3225990764 conn(0x7f537c075f60 msgr2=0x7f537c076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 -- 172.21.15.35:0/3225990764 shutdown_connections 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 -- 172.21.15.35:0/3225990764 wait complete. 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 Processor -- start 2023-03-17T10:51:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.067+0000 7f5383e88700 1 -- start start 2023-03-17T10:51:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5383e88700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 0x7f537c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:47.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5383e88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff920 0x7f537c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5383e88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c10cbc0 0x7f537c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5383e88700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c19d590 con 0x7f537c0ff010 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5383e88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c19d700 con 0x7f537c10cbc0 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5383e88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c19d8c0 con 0x7f537c0ff920 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 0x7f537c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 0x7f537c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52264/0 (socket says 172.21.15.35:52264) 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 -- 172.21.15.35:0/3453153945 learned_addr learned my addr 172.21.15.35:0/3453153945 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5382425700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c10cbc0 0x7f537c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381423700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff920 0x7f537c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 -- 172.21.15.35:0/3453153945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff920 msgr2=0x7f537c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff920 0x7f537c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 -- 172.21.15.35:0/3453153945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c10cbc0 msgr2=0x7f537c19cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c10cbc0 0x7f537c19cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 -- 172.21.15.35:0/3453153945 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374009d00 con 0x7f537c0ff010 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5382425700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c10cbc0 0x7f537c19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381423700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff920 0x7f537c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:51:47.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5381c24700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 0x7f537c1985b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f537800e9a0 tx=0x7f537800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5372ffd700 1 -- 172.21.15.35:0/3453153945 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378009790 con 0x7f537c0ff010 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.068+0000 7f5372ffd700 1 -- 172.21.15.35:0/3453153945 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f537800cbd0 con 0x7f537c0ff010 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.069+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c1122d0 con 0x7f537c0ff010 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.069+0000 7f5372ffd700 1 -- 172.21.15.35:0/3453153945 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378018680 con 0x7f537c0ff010 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.069+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c112140 con 0x7f537c0ff010 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.071+0000 7f5372ffd700 1 -- 172.21.15.35:0/3453153945 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f537800cd40 con 0x7f537c0ff010 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.072+0000 7f5372ffd700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f536809f640 0x7f53680a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.072+0000 7f5372ffd700 1 -- 172.21.15.35:0/3453153945 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(276..276 src has 1..276) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5378014070 con 0x7f537c0ff010 2023-03-17T10:51:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.072+0000 7f5381423700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f536809f640 0x7f53680a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.072+0000 7f5381423700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f536809f640 0x7f53680a1af0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f537c199bc0 tx=0x7f536c009550 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.072+0000 7f5390015b80 1 Processor -- start 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 -- start start 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc6be0 0x563b69bc6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc1960 0x563b69bc1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69ac8010 con 0x563b69bc74f0 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69b1a950 con 0x563b69bc6be0 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5390015b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69b13de0 con 0x563b69bc1960 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52274/0 (socket says 172.21.15.35:52274) 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 -- 172.21.15.35:0/1359576650 learned_addr learned my addr 172.21.15.35:0/1359576650 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5382425700 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc1960 0x563b69bc1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381c24700 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc6be0 0x563b69bc6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 -- 172.21.15.35:0/1359576650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc1960 msgr2=0x563b69bc1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc1960 0x563b69bc1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 -- 172.21.15.35:0/1359576650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc6be0 msgr2=0x563b69bc6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc6be0 0x563b69bc6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.073+0000 7f5381423700 1 -- 172.21.15.35:0/1359576650 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b699955d0 con 0x563b69bc74f0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.074+0000 7f5381423700 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc1420 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ed40 tx=0x7f536c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daec7ad04b4a5b3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.074+0000 7f5367fff700 1 -- 172.21.15.35:0/1359576650 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c011be0 con 0x563b69bc74f0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.074+0000 7f5367fff700 1 -- 172.21.15.35:0/1359576650 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f536c011d40 con 0x563b69bc74f0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.074+0000 7f5367fff700 1 -- 172.21.15.35:0/1359576650 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c010630 con 0x563b69bc74f0 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 -- 172.21.15.35:0/1359576650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 msgr2=0x563b69bc1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc1420 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ed40 tx=0x7f536c009f90 comp rx=0 tx=0).stop 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 -- 172.21.15.35:0/1359576650 shutdown_connections 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc1960 0x563b69bc1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc6be0 0x563b69bc6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 --2- 172.21.15.35:0/1359576650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc1420 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:50.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 -- 172.21.15.35:0/1359576650 >> 172.21.15.35:0/1359576650 conn(0x563b69a1e6b0 msgr2=0x563b69bbba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 -- 172.21.15.35:0/1359576650 shutdown_connections 2023-03-17T10:51:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 -- 172.21.15.35:0/1359576650 wait complete. 2023-03-17T10:51:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 -- start start 2023-03-17T10:51:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.075+0000 7f5390015b80 1 Processor -- start 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bcd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bcac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b699978c0 con 0x563b69bc74f0 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bcb3d0 con 0x563b69bc1960 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bcb590 con 0x563b69bc6be0 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5390015b80 10 client.0 _ll_register_callbacks cb 0x563b699b9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:51:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5381c24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bcd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:51.494 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:50 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5382425700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bcac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5381c24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bcd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54074/0 (socket says 172.21.15.35:54074) 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5381c24700 1 -- 172.21.15.35:0/201046164 learned_addr learned my addr 172.21.15.35:0/201046164 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5381423700 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5382425700 1 -- 172.21.15.35:0/201046164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 msgr2=0x563b69bca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5382425700 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5382425700 1 -- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 msgr2=0x563b69bcd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:51.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5382425700 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bcd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.076+0000 7f5382425700 1 -- 172.21.15.35:0/201046164 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c00ea20 con 0x563b69bc74f0 2023-03-17T10:51:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5382425700 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bcac90 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f537400b070 tx=0x7f537400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115da54ff0ade56 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f53657fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f53657fa700 1 -- 172.21.15.35:0/201046164 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400e040 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f53657fa700 1 -- 172.21.15.35:0/201046164 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(276..276 src has 1..276) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5374022070 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b69ad6390 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f53657fa700 1 -- 172.21.15.35:0/201046164 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53740078f0 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 10 client.19554 fetch_fsmap learned FSMap version 56 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x563b69941d80 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f53657fa700 1 -- 172.21.15.35:0/201046164 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b69ad6390 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f53657fa700 1 -- 172.21.15.35:0/201046164 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 56) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f537400b0d0 con 0x563b69bc74f0 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 10 client.19554 fetch_fsmap finished waiting for FSMap version 56 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 10 client.19554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 20 client.19554 populate_metadata read hostname 'smithi035' 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69bdb050 0x563b69bdd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 4 client.19554 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.077+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b69ae2600 con 0x563b69bdb050 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.078+0000 7f5381c24700 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69bdb050 0x563b69bdd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.078+0000 7f53657fa700 10 client.19554 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.078+0000 7f5381c24700 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69bdb050 0x563b69bdd460 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b17c4f16ea6a64e5 server_cookie=7b6845f807f3e884 in_seq=0 out_seq=0 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f53657fa700 1 -- 172.21.15.35:0/201046164 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563b69ae2600 con 0x563b69bdb050 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f53657fa700 10 client.19554 handle_command_reply: tid=0 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 client.19554 shutdown 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 msgr2=0x563b69bcac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bcac90 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f537400b070 tx=0x7f537400bce0 comp rx=0 tx=0).stop 2023-03-17T10:51:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 shutdown_connections 2023-03-17T10:51:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69bdb050 0x563b69bdd460 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bcac90 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bcd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f53657fa700 0 client.19554 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:51:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 --2- 172.21.15.35:0/201046164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 >> 172.21.15.35:0/201046164 conn(0x563b69a1e6b0 msgr2=0x563b69bc0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 shutdown_connections 2023-03-17T10:51:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 1 -- 172.21.15.35:0/201046164 wait complete. 2023-03-17T10:51:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.079+0000 7f5390015b80 20 client.19554 trim_cache size 0 max 16384 2023-03-17T10:51:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 Processor -- start 2023-03-17T10:51:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 -- start start 2023-03-17T10:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bbbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bb85c0 con 0x563b69bc74f0 2023-03-17T10:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bd86e0 con 0x563b69bc1960 2023-03-17T10:51:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.094+0000 7f5390015b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bbc6d0 con 0x563b69bc6be0 2023-03-17T10:51:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52290/0 (socket says 172.21.15.35:52290) 2023-03-17T10:51:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 -- 172.21.15.35:0/2081431936 learned_addr learned my addr 172.21.15.35:0/2081431936 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:51:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5381c24700 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bbbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5381423700 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:51:59.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 -- 172.21.15.35:0/2081431936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 msgr2=0x563b69bccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 -- 172.21.15.35:0/2081431936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 msgr2=0x563b69bbbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bbbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 -- 172.21.15.35:0/2081431936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b69ada130 con 0x563b69bc74f0 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5381c24700 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bbbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5382425700 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc46b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f53740097f0 tx=0x7f537400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3d386867938d31 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5370ff9700 1 -- 172.21.15.35:0/2081431936 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400e070 con 0x563b69bc74f0 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5370ff9700 1 -- 172.21.15.35:0/2081431936 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5374020070 con 0x563b69bc74f0 2023-03-17T10:51:59.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.095+0000 7f5370ff9700 1 -- 172.21.15.35:0/2081431936 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374007710 con 0x563b69bc74f0 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 -- 172.21.15.35:0/2081431936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 msgr2=0x563b69bc46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc46b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f53740097f0 tx=0x7f537400b7c0 comp rx=0 tx=0).stop 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 -- 172.21.15.35:0/2081431936 shutdown_connections 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc74f0 0x563b69bc46b0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bbbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 --2- 172.21.15.35:0/2081431936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc6be0 0x563b69bccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 -- 172.21.15.35:0/2081431936 >> 172.21.15.35:0/2081431936 conn(0x563b69a1e6b0 msgr2=0x563b69bc0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 -- 172.21.15.35:0/2081431936 shutdown_connections 2023-03-17T10:51:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 -- 172.21.15.35:0/2081431936 wait complete. 2023-03-17T10:51:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 -- start start 2023-03-17T10:51:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.096+0000 7f5390015b80 1 Processor -- start 2023-03-17T10:51:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bd18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 0x563b69bd1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc74f0 0x563b69bcff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:51:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bd0500 con 0x563b69bc6be0 2023-03-17T10:52:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bd0670 con 0x563b69bc1960 2023-03-17T10:52:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b69bd0830 con 0x563b69bc74f0 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5390015b80 10 client.0 _ll_register_callbacks cb 0x563b699b9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 0x563b69bd1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 0x563b69bd1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52294/0 (socket says 172.21.15.35:52294) 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 -- 172.21.15.35:0/631858307 learned_addr learned my addr 172.21.15.35:0/631858307 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381c24700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bd18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5382425700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc74f0 0x563b69bcff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 -- 172.21.15.35:0/631858307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc74f0 msgr2=0x563b69bcff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:01.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc74f0 0x563b69bcff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 -- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 msgr2=0x563b69bd18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bd18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.097+0000 7f5381423700 1 -- 172.21.15.35:0/631858307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c112140 con 0x563b69bc6be0 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5381423700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 0x563b69bd1e00 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ed40 tx=0x7f536c00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7630201eca5ae770 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f53657fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f53657fa700 1 -- 172.21.15.35:0/631858307 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c02e070 con 0x563b69bc6be0 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b69b911e0 con 0x563b69bc6be0 2023-03-17T10:52:01.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f53657fa700 1 -- 172.21.15.35:0/631858307 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(276..276 src has 1..276) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f536c005310 con 0x563b69bc6be0 2023-03-17T10:52:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f53657fa700 1 -- 172.21.15.35:0/631858307 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f536c0054d0 con 0x563b69bc6be0 2023-03-17T10:52:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 10 client.19560 fetch_fsmap learned FSMap version 56 2023-03-17T10:52:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x563b69941d80 con 0x563b69bc6be0 2023-03-17T10:52:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f53657fa700 1 -- 172.21.15.35:0/631858307 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b69b911e0 con 0x563b69bc6be0 2023-03-17T10:52:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f53657fa700 1 -- 172.21.15.35:0/631858307 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 56) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f536c004a50 con 0x563b69bc6be0 2023-03-17T10:52:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 10 client.19560 fetch_fsmap finished waiting for FSMap version 56 2023-03-17T10:52:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 10 client.19560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:52:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 20 client.19560 populate_metadata read hostname 'smithi035' 2023-03-17T10:52:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69c2ff50 0x563b69c32360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 4 client.19560 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:52:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.098+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563b69997f00 con 0x563b69c2ff50 2023-03-17T10:52:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.099+0000 7f5381c24700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69c2ff50 0x563b69c32360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.099+0000 7f5381c24700 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69c2ff50 0x563b69c32360 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274061bdcaa0e4d6 server_cookie=3db8698ab55165ca in_seq=0 out_seq=0 2023-03-17T10:52:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.099+0000 7f53657fa700 10 client.19560 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f53657fa700 1 -- 172.21.15.35:0/631858307 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563b69997f00 con 0x563b69c2ff50 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f53657fa700 10 client.19560 handle_command_reply: tid=0 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f5390015b80 1 client.19560 shutdown 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 msgr2=0x563b69bd1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f5390015b80 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 0x563b69bd1e00 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f536c00ed40 tx=0x7f536c00eed0 comp rx=0 tx=0).stop 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 shutdown_connections 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.138+0000 7f5390015b80 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b69c2ff50 0x563b69c32360 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f5390015b80 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b69bc74f0 0x563b69bcff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f5390015b80 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b69bc1960 0x563b69bd18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f5390015b80 1 --2- 172.21.15.35:0/631858307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b69bc6be0 0x563b69bd1e00 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 >> 172.21.15.35:0/631858307 conn(0x563b69a1e6b0 msgr2=0x563b69bc46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f53657fa700 0 client.19560 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 shutdown_connections 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.139+0000 7f5390015b80 1 -- 172.21.15.35:0/631858307 wait complete. 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.140+0000 7f5390015b80 20 client.19560 trim_cache size 0 max 16384 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f536809f640 msgr2=0x7f53680a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f536809f640 0x7f53680a1af0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f537c199bc0 tx=0x7f536c009550 comp rx=0 tx=0).stop 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 msgr2=0x7f537c1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 0x7f537c1985b0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f537800e9a0 tx=0x7f537800ed60 comp rx=0 tx=0).stop 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 shutdown_connections 2023-03-17T10:52:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f536809f640 0x7f53680a1af0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f537c10cbc0 0x7f537c19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f537c0ff010 0x7f537c1985b0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 --2- 172.21.15.35:0/3453153945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f537c0ff920 0x7f537c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 >> 172.21.15.35:0/3453153945 conn(0x7f537c075f60 msgr2=0x7f537c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 shutdown_connections 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:24:50.141+0000 7f5383e88700 1 -- 172.21.15.35:0/3453153945 wait complete. 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.265+0000 7f5acf535700 1 -- 172.21.15.35:0/1452941016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 msgr2=0x7f5ac80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.265+0000 7f5acf535700 1 --2- 172.21.15.35:0/1452941016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac80ff720 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40099c0 tx=0x7f5ac4009cd0 comp rx=0 tx=0).stop 2023-03-17T10:52:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 -- 172.21.15.35:0/1452941016 shutdown_connections 2023-03-17T10:52:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 --2- 172.21.15.35:0/1452941016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 0x7f5ac810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 --2- 172.21.15.35:0/1452941016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac80ff720 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 --2- 172.21.15.35:0/1452941016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 -- 172.21.15.35:0/1452941016 >> 172.21.15.35:0/1452941016 conn(0x7f5ac8076330 msgr2=0x7f5ac8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:13.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 -- 172.21.15.35:0/1452941016 shutdown_connections 2023-03-17T10:52:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 -- 172.21.15.35:0/1452941016 wait complete. 2023-03-17T10:52:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.266+0000 7f5acf535700 1 Processor -- start 2023-03-17T10:52:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 -- start start 2023-03-17T10:52:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac8197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac81975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:15.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 0x7f5ac81a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:15.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8197f00 con 0x7f5ac80ff350 2023-03-17T10:52:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81a2640 con 0x7f5ac8104390 2023-03-17T10:52:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acf535700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81a2800 con 0x7f5ac80ffcf0 2023-03-17T10:52:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5accad0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac81975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5accad0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac81975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44074/0 (socket says 172.21.15.35:44074) 2023-03-17T10:52:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5accad0700 1 -- 172.21.15.35:0/625296284 learned_addr learned my addr 172.21.15.35:0/625296284 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac8197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.267+0000 7f5acdad2700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 0x7f5ac81a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5accad0700 1 -- 172.21.15.35:0/625296284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 msgr2=0x7f5ac81a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5accad0700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 0x7f5ac81a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:18.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5accad0700 1 -- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 msgr2=0x7f5ac8197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:18.774 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:51 smithi035 ceph-mon[92535]: pgmap v3769: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:52:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5accad0700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac8197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5accad0700 1 -- 172.21.15.35:0/625296284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40095f0 con 0x7f5ac80ffcf0 2023-03-17T10:52:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac8197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5acdad2700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 0x7f5ac81a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5accad0700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac81975c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800e940 tx=0x7f5ab800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5abe7fc700 1 -- 172.21.15.35:0/625296284 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8009730 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5abe7fc700 1 -- 172.21.15.35:0/625296284 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ab800ce70 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac810f000 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5abe7fc700 1 -- 172.21.15.35:0/625296284 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8018420 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.268+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac810ee70 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.270+0000 7f5abe7fc700 1 -- 172.21.15.35:0/625296284 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5ab800c9e0 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.271+0000 7f5abe7fc700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ab409f640 0x7f5ab40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.271+0000 7f5abe7fc700 1 -- 172.21.15.35:0/625296284 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(276..276 src has 1..276) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5ab8014070 con 0x7f5ac80ffcf0 2023-03-17T10:52:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.271+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ab409f640 0x7f5ab40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.272+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ab409f640 0x7f5ab40a1af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b580 tx=0x7f5ac4005c40 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.272+0000 7f5adb6c2b80 1 Processor -- start 2023-03-17T10:52:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.272+0000 7f5adb6c2b80 1 -- start start 2023-03-17T10:52:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 0x565159cc3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:24.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cbe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cbe960 0x565159cbed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159bc5010 con 0x565159cc3be0 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159c17950 con 0x565159cc44f0 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159c10de0 con 0x565159cbe960 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 0x565159cc3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 0x565159cc3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52314/0 (socket says 172.21.15.35:52314) 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 -- 172.21.15.35:0/4155579841 learned_addr learned my addr 172.21.15.35:0/4155579841 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:24.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acdad2700 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cbe960 0x565159cbed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5accad0700 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cbe420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 -- 172.21.15.35:0/4155579841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cbe960 msgr2=0x565159cbed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cbe960 0x565159cbed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 -- 172.21.15.35:0/4155579841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 msgr2=0x565159cbe420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cbe420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 -- 172.21.15.35:0/4155579841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565159a925d0 con 0x565159cc3be0 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5accad0700 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cbe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 0x565159cc3fb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4005f50 tx=0x7f5ac4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab1042e2c521fb2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.273+0000 7f5ab37fe700 1 -- 172.21.15.35:0/4155579841 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4039070 con 0x565159cc3be0 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5ab37fe700 1 -- 172.21.15.35:0/4155579841 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ac4003cb0 con 0x565159cc3be0 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5ab37fe700 1 -- 172.21.15.35:0/4155579841 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400fba0 con 0x565159cc3be0 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/4155579841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 msgr2=0x565159cc3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 0x565159cc3fb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4005f50 tx=0x7f5ac4030000 comp rx=0 tx=0).stop 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/4155579841 shutdown_connections 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cbe960 0x565159cbed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cc3be0 0x565159cc3fb0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/4155579841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cbe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/4155579841 >> 172.21.15.35:0/4155579841 conn(0x565159b1b6b0 msgr2=0x565159cb8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/4155579841 shutdown_connections 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.274+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/4155579841 wait complete. 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 -- start start 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 Processor -- start 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159cca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc3be0 0x565159cc7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc44f0 0x565159cc7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159a948c0 con 0x565159cbe960 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159cc8350 con 0x565159cc3be0 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159cc8510 con 0x565159cc44f0 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5adb6c2b80 10 client.0 _ll_register_callbacks cb 0x565159ab6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.275+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159cca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159cca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52320/0 (socket says 172.21.15.35:52320) 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 -- 172.21.15.35:0/1297514942 learned_addr learned my addr 172.21.15.35:0/1297514942 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acdad2700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc44f0 0x565159cc7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5accad0700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc3be0 0x565159cc7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 -- 172.21.15.35:0/1297514942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc44f0 msgr2=0x565159cc7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc44f0 0x565159cc7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 -- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc3be0 msgr2=0x565159cc7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc3be0 0x565159cc7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 -- 172.21.15.35:0/1297514942 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac810c7a0 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5accad0700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc3be0 0x565159cc7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159cca3c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4040040 tx=0x7f5ac400ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20094f16062a45e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5ab0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1297514942 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4039040 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1297514942 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(276..276 src has 1..276) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5ac400fbf0 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565159bd3390 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1297514942 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ac4003a20 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5adb6c2b80 10 client.19572 fetch_fsmap learned FSMap version 56 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.276+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x565159a3ed80 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1297514942 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565159bd3390 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1297514942 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 56) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f5ac4033c30 con 0x565159cbe960 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5adb6c2b80 10 client.19572 fetch_fsmap finished waiting for FSMap version 56 2023-03-17T10:52:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5adb6c2b80 10 client.19572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5adb6c2b80 20 client.19572 populate_metadata read hostname 'smithi035' 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159cd7b60 0x565159cd9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5adb6c2b80 4 client.19572 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565159bdf600 con 0x565159cd7b60 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.277+0000 7f5accad0700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159cd7b60 0x565159cd9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5ab0ff9700 10 client.19572 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5accad0700 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159cd7b60 0x565159cd9f70 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5162e4a122d661 server_cookie=99f267d00b33db94 in_seq=0 out_seq=0 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1297514942 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x565159bdf600 con 0x565159cd7b60 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5ab0ff9700 10 client.19572 handle_command_reply: tid=0 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 client.19572 shutdown 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 msgr2=0x565159cca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159cca3c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4040040 tx=0x7f5ac400ff60 comp rx=0 tx=0).stop 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 shutdown_connections 2023-03-17T10:52:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159cd7b60 0x565159cd9f70 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc44f0 0x565159cc7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5ab0ff9700 0 client.19572 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159cca3c0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1297514942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc3be0 0x565159cc7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.278+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 >> 172.21.15.35:0/1297514942 conn(0x565159b1b6b0 msgr2=0x565159cbd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.279+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 shutdown_connections 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.279+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1297514942 wait complete. 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.279+0000 7f5adb6c2b80 20 client.19572 trim_cache size 0 max 16384 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 Processor -- start 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 -- start start 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159cc9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cc16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159cc2330 con 0x565159cbe960 2023-03-17T10:52:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159ccaaa0 con 0x565159cc44f0 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.296+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159ccf3a0 con 0x565159cc3be0 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5accad0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159cc9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52328/0 (socket says 172.21.15.35:52328) 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 -- 172.21.15.35:0/341111495 learned_addr learned my addr 172.21.15.35:0/341111495 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acdad2700 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cc16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 -- 172.21.15.35:0/341111495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 msgr2=0x565159cc9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159cc9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 -- 172.21.15.35:0/341111495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 msgr2=0x565159cc16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cc16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 -- 172.21.15.35:0/341111495 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565159bd7130 con 0x565159cbe960 2023-03-17T10:52:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5accad0700 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159cc9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccee60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4005ea0 tx=0x7f5ac4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77633fb04c497d3a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5ab3fff700 1 -- 172.21.15.35:0/341111495 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4039040 con 0x565159cbe960 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5ab3fff700 1 -- 172.21.15.35:0/341111495 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ac403dd50 con 0x565159cbe960 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.297+0000 7f5ab3fff700 1 -- 172.21.15.35:0/341111495 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4003bc0 con 0x565159cbe960 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/341111495 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 msgr2=0x565159ccee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccee60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4005ea0 tx=0x7f5ac4009cd0 comp rx=0 tx=0).stop 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/341111495 shutdown_connections 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cc16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccee60 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/341111495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159cc9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/341111495 >> 172.21.15.35:0/341111495 conn(0x565159b1b6b0 msgr2=0x565159cde890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/341111495 shutdown_connections 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/341111495 wait complete. 2023-03-17T10:52:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.298+0000 7f5adb6c2b80 1 -- start start 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 Processor -- start 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159ccca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159d2a9c0 con 0x565159cbe960 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159d2ab00 con 0x565159cc44f0 2023-03-17T10:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x565159d2ac90 con 0x565159cc3be0 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5adb6c2b80 10 client.0 _ll_register_callbacks cb 0x565159ab6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5acd2d1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52334/0 (socket says 172.21.15.35:52334) 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5acd2d1700 1 -- 172.21.15.35:0/1181701278 learned_addr learned my addr 172.21.15.35:0/1181701278 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5accad0700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159ccca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5acdad2700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5accad0700 1 -- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 msgr2=0x565159cccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5accad0700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5accad0700 1 -- 172.21.15.35:0/1181701278 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 msgr2=0x565159ccc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5accad0700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:34.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5accad0700 1 -- 172.21.15.35:0/1181701278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac810f000 con 0x565159cc3be0 2023-03-17T10:52:34.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.299+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:36.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5accad0700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159ccca50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80c8040 tx=0x7f5ab801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eddadb473f7c7da3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5ab0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:52:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1181701278 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8010680 con 0x565159cc3be0 2023-03-17T10:52:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1181701278 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(276..276 src has 1..276) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5ab800cc90 con 0x565159cc3be0 2023-03-17T10:52:36.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565159c8e1e0 con 0x565159cc3be0 2023-03-17T10:52:36.770 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:52 smithi035 ceph-mon[92535]: pgmap v3770: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:52:36.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1181701278 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ab8098360 con 0x565159cc3be0 2023-03-17T10:52:37.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 10 client.28720 fetch_fsmap learned FSMap version 56 2023-03-17T10:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x565159a3ed80 con 0x565159cc3be0 2023-03-17T10:52:38.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1181701278 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565159c8e1e0 con 0x565159cc3be0 2023-03-17T10:52:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1181701278 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 56) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f5ab8098650 con 0x565159cc3be0 2023-03-17T10:52:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 10 client.28720 fetch_fsmap finished waiting for FSMap version 56 2023-03-17T10:52:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 10 client.28720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 20 client.28720 populate_metadata read hostname 'smithi035' 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159d2c410 0x565159d2e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 4 client.28720 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.300+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565159a94f00 con 0x565159d2c410 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.301+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159d2c410 0x565159d2e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.301+0000 7f5ab0ff9700 10 client.28720 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.301+0000 7f5acd2d1700 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159d2c410 0x565159d2e820 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=761e4c7aa5e68c50 server_cookie=d8bf52938e92c7f4 in_seq=0 out_seq=0 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5ab0ff9700 1 -- 172.21.15.35:0/1181701278 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565159a94f00 con 0x565159d2c410 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5ab0ff9700 10 client.28720 handle_command_reply: tid=0 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 client.28720 shutdown 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 msgr2=0x565159ccca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159ccca50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80c8040 tx=0x7f5ab801a040 comp rx=0 tx=0).stop 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 shutdown_connections 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x565159d2c410 0x565159d2e820 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x565159cc44f0 0x565159cccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x565159cbe960 0x565159ccc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5ab0ff9700 0 client.28720 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 --2- 172.21.15.35:0/1181701278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565159cc3be0 0x565159ccca50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 >> 172.21.15.35:0/1181701278 conn(0x565159b1b6b0 msgr2=0x565159cc16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.325+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 shutdown_connections 2023-03-17T10:52:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5adb6c2b80 1 -- 172.21.15.35:0/1181701278 wait complete. 2023-03-17T10:52:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5adb6c2b80 20 client.28720 trim_cache size 0 max 16384 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ab409f640 msgr2=0x7f5ab40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ab409f640 0x7f5ab40a1af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b580 tx=0x7f5ac4005c40 comp rx=0 tx=0).stop 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 msgr2=0x7f5ac81975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac81975c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800e940 tx=0x7f5ab800ec50 comp rx=0 tx=0).stop 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 shutdown_connections 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ab409f640 0x7f5ab40a1af0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac8104390 0x7f5ac81a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ac80ff350 0x7f5ac8197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 --2- 172.21.15.35:0/625296284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac80ffcf0 0x7f5ac81975c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 >> 172.21.15.35:0/625296284 conn(0x7f5ac8076330 msgr2=0x7f5ac8102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 shutdown_connections 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:03.326+0000 7f5acf535700 1 -- 172.21.15.35:0/625296284 wait complete. 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 -- 172.21.15.35:0/3324678402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94740ffcf0 msgr2=0x7f9474103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 --2- 172.21.15.35:0/3324678402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94740ffcf0 0x7f9474103cb0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f945c0099c0 tx=0x7f945c009cd0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 -- 172.21.15.35:0/3324678402 shutdown_connections 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 --2- 172.21.15.35:0/3324678402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9474104390 0x7f947410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 --2- 172.21.15.35:0/3324678402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94740ff350 0x7f94740ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 --2- 172.21.15.35:0/3324678402 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f94740ffcf0 0x7f9474103cb0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 -- 172.21.15.35:0/3324678402 >> 172.21.15.35:0/3324678402 conn(0x7f9474076330 msgr2=0x7f9474076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 -- 172.21.15.35:0/3324678402 shutdown_connections 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.450+0000 7f94795a7700 1 -- 172.21.15.35:0/3324678402 wait complete. 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 Processor -- start 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 -- start start 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94740ff350 0x7f9474100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94740ffcf0 0x7f9474101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 0x7f94741a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9474101ac0 con 0x7f9474104390 2023-03-17T10:52:44.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94741a4980 con 0x7f94740ffcf0 2023-03-17T10:52:45.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.451+0000 7f94795a7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94741a4ac0 con 0x7f94740ff350 2023-03-17T10:52:45.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 0x7f94741a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 0x7f94741a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52352/0 (socket says 172.21.15.35:52352) 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 -- 172.21.15.35:0/829737068 learned_addr learned my addr 172.21.15.35:0/829737068 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f9472ffd700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94740ff350 0x7f9474100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f946a7fc700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94740ffcf0 0x7f9474101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 -- 172.21.15.35:0/829737068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94740ff350 msgr2=0x7f9474100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94740ff350 0x7f9474100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 -- 172.21.15.35:0/829737068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94740ffcf0 msgr2=0x7f9474101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94740ffcf0 0x7f9474101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 -- 172.21.15.35:0/829737068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0095f0 con 0x7f9474104390 2023-03-17T10:52:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f946a7fc700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94740ffcf0 0x7f9474101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:52:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94737fe700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 0x7f94741a4440 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f946c00ef30 tx=0x7f946c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f9470ff9700 1 -- 172.21.15.35:0/829737068 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c018070 con 0x7f9474104390 2023-03-17T10:52:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f9470ff9700 1 -- 172.21.15.35:0/829737068 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f946c00f040 con 0x7f9474104390 2023-03-17T10:52:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947410efc0 con 0x7f9474104390 2023-03-17T10:52:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f9470ff9700 1 -- 172.21.15.35:0/829737068 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c00cc70 con 0x7f9474104390 2023-03-17T10:52:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.452+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947410ee30 con 0x7f9474104390 2023-03-17T10:52:47.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.455+0000 7f9470ff9700 1 -- 172.21.15.35:0/829737068 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f946c007500 con 0x7f9474104390 2023-03-17T10:52:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.456+0000 7f9470ff9700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f946009f6c0 0x7f94600a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.456+0000 7f9472ffd700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f946009f6c0 0x7f94600a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.456+0000 7f9470ff9700 1 -- 172.21.15.35:0/829737068 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(278..278 src has 1..278) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f946c0ca0f0 con 0x7f9474104390 2023-03-17T10:52:47.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.456+0000 7f9472ffd700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f946009f6c0 0x7f94600a1b70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9464009c60 tx=0x7f9464009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 Processor -- start 2023-03-17T10:52:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 -- start start 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b396be0 0x55ee7b396fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b391420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 0x55ee7b391d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b298010 con 0x55ee7b391960 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b2ea950 con 0x55ee7b396be0 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9485734b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b2e3de0 con 0x55ee7b3974f0 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f94737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 0x55ee7b391d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f94737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 0x55ee7b391d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52360/0 (socket says 172.21.15.35:52360) 2023-03-17T10:52:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f9472ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b396be0 0x55ee7b396fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f94737fe700 1 -- 172.21.15.35:0/761060002 learned_addr learned my addr 172.21.15.35:0/761060002 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.457+0000 7f946a7fc700 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b391420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94737fe700 1 -- 172.21.15.35:0/761060002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 msgr2=0x55ee7b391420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94737fe700 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b391420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94737fe700 1 -- 172.21.15.35:0/761060002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b396be0 msgr2=0x55ee7b396fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94737fe700 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b396be0 0x55ee7b396fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94737fe700 1 -- 172.21.15.35:0/761060002 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee7b1655d0 con 0x55ee7b391960 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f9472ffd700 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b396be0 0x55ee7b396fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:50.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f946a7fc700 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b391420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94737fe700 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 0x55ee7b391d90 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f946c0090a0 tx=0x7f946c097590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98d61f17bffafd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94697fa700 1 -- 172.21.15.35:0/761060002 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c09b050 con 0x55ee7b391960 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94697fa700 1 -- 172.21.15.35:0/761060002 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f946c097cb0 con 0x55ee7b391960 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.458+0000 7f94697fa700 1 -- 172.21.15.35:0/761060002 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c097120 con 0x55ee7b391960 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 -- 172.21.15.35:0/761060002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 msgr2=0x55ee7b391d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 0x55ee7b391d90 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f946c0090a0 tx=0x7f946c097590 comp rx=0 tx=0).stop 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 -- 172.21.15.35:0/761060002 shutdown_connections 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b391960 0x55ee7b391d90 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b396be0 0x55ee7b396fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 --2- 172.21.15.35:0/761060002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b391420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 -- 172.21.15.35:0/761060002 >> 172.21.15.35:0/761060002 conn(0x55ee7b1ee6b0 msgr2=0x55ee7b38ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 -- 172.21.15.35:0/761060002 shutdown_connections 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 -- 172.21.15.35:0/761060002 wait complete. 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.459+0000 7f9485734b80 1 -- start start 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 Processor -- start 2023-03-17T10:52:50.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b39d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b39a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b39ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b1678c0 con 0x55ee7b3974f0 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b39b5c0 con 0x55ee7b391960 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b3a7030 con 0x55ee7b396be0 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9485734b80 10 client.0 _ll_register_callbacks cb 0x55ee7b189230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9472ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b39d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:51.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b39ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9472ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b39d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54158/0 (socket says 172.21.15.35:54158) 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9472ffd700 1 -- 172.21.15.35:0/3670702587 learned_addr learned my addr 172.21.15.35:0/3670702587 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f946a7fc700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b39a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 -- 172.21.15.35:0/3670702587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 msgr2=0x55ee7b39a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b39a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 -- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 msgr2=0x55ee7b39d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b39d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 -- 172.21.15.35:0/3670702587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947410ee30 con 0x55ee7b3974f0 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f9472ffd700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b39d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f94737fe700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b39ae50 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f946c0946a0 tx=0x7f946c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4173fc354836ac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:52:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.460+0000 7f945a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f945a7fc700 1 -- 172.21.15.35:0/3670702587 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c095fd0 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f945a7fc700 1 -- 172.21.15.35:0/3670702587 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(278..278 src has 1..278) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f946c097e90 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee7b2a6390 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f945a7fc700 1 -- 172.21.15.35:0/3670702587 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f946c098050 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 10 client.19590 fetch_fsmap learned FSMap version 56 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55ee7b111d80 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f945a7fc700 1 -- 172.21.15.35:0/3670702587 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee7b2a6390 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f945a7fc700 1 -- 172.21.15.35:0/3670702587 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 56) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f946c078bc0 con 0x55ee7b3974f0 2023-03-17T10:52:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 10 client.19590 fetch_fsmap finished waiting for FSMap version 56 2023-03-17T10:52:52.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 10 client.19590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:52:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 20 client.19590 populate_metadata read hostname 'smithi035' 2023-03-17T10:52:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3aac50 0x55ee7b3ad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 4 client.19590 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee7b2b2600 con 0x55ee7b3aac50 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.461+0000 7f9472ffd700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3aac50 0x55ee7b3ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.462+0000 7f945a7fc700 10 client.19590 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.462+0000 7f9472ffd700 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3aac50 0x55ee7b3ad030 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd7acaf69b5ee68b server_cookie=64757d6da926f971 in_seq=0 out_seq=0 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.462+0000 7f945a7fc700 1 -- 172.21.15.35:0/3670702587 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ee7b2b2600 con 0x55ee7b3aac50 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.462+0000 7f945a7fc700 10 client.19590 handle_command_reply: tid=0 2023-03-17T10:52:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.462+0000 7f9485734b80 1 client.19590 shutdown 2023-03-17T10:52:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 msgr2=0x55ee7b39ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:52:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b39ae50 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f946c0946a0 tx=0x7f946c00c850 comp rx=0 tx=0).stop 2023-03-17T10:52:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 shutdown_connections 2023-03-17T10:52:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3aac50 0x55ee7b3ad030 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b39ae50 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f945a7fc700 0 client.19590 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:52:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b39d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:52:56.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:55 smithi035 ceph-mon[92535]: pgmap v3771: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:52:58.357 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:57 smithi035 ceph-mon[92535]: pgmap v3772: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:40:59 smithi035 ceph-mon[92535]: pgmap v3773: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:01 smithi035 ceph-mon[92535]: pgmap v3774: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:02 smithi035 ceph-mon[92535]: pgmap v3775: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:03 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:04 smithi035 ceph-mon[92535]: pgmap v3776: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:07 smithi035 ceph-mon[92535]: pgmap v3777: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:09 smithi035 ceph-mon[92535]: pgmap v3778: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T10:52:58.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:10 smithi035 ceph-mon[92535]: osdmap e310: 12 total, 12 up, 12 in 2023-03-17T10:52:59.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:11 smithi035 ceph-mon[92535]: pgmap v3780: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T10:53:01.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:12 smithi035 ceph-mon[92535]: pgmap v3781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:53:01.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:15 smithi035 ceph-mon[92535]: pgmap v3782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:53:01.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:17 smithi035 ceph-mon[92535]: pgmap v3783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:53:01.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:17 smithi035 ceph-mon[92535]: osdmap e311: 12 total, 12 up, 12 in 2023-03-17T10:53:01.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:19 smithi035 ceph-mon[92535]: pgmap v3785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 12 op/s 2023-03-17T10:53:02.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:21 smithi035 ceph-mon[92535]: pgmap v3786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:53:02.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:22 smithi035 ceph-mon[92535]: pgmap v3787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:53:02.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:53:02.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:53:02.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:23 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:24 smithi035 ceph-mon[92535]: pgmap v3788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:26 smithi035 ceph-mon[92535]: pgmap v3789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 105 B/s wr, 11 op/s 2023-03-17T10:53:03.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:53:05.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:29 smithi035 ceph-mon[92535]: pgmap v3790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 91 B/s wr, 14 op/s 2023-03-17T10:53:05.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:31 smithi035 ceph-mon[92535]: pgmap v3791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T10:53:05.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:32 smithi035 ceph-mon[92535]: pgmap v3792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:35 smithi035 ceph-mon[92535]: pgmap v3793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:36 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:37 smithi035 ceph-mon[92535]: pgmap v3794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:39 smithi035 ceph-mon[92535]: pgmap v3795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:41 smithi035 ceph-mon[92535]: pgmap v3796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:43 smithi035 ceph-mon[92535]: pgmap v3797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:43 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:45 smithi035 ceph-mon[92535]: pgmap v3798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:47 smithi035 ceph-mon[92535]: pgmap v3799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:48 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:49 smithi035 ceph-mon[92535]: pgmap v3800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:53:05.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:49 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:05.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:51 smithi035 ceph-mon[92535]: pgmap v3801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:53:05.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:52 smithi035 ceph-mon[92535]: pgmap v3802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-03-17T10:53:05.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:55 smithi035 ceph-mon[92535]: pgmap v3803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T10:53:05.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:57 smithi035 ceph-mon[92535]: pgmap v3804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:53:05.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:41:59 smithi035 ceph-mon[92535]: pgmap v3805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:53:05.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:01 smithi035 ceph-mon[92535]: pgmap v3806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:53:05.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:02 smithi035 ceph-mon[92535]: pgmap v3807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 23 op/s 2023-03-17T10:53:07.235 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:04 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:07.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:04 smithi035 ceph-mon[92535]: pgmap v3808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-03-17T10:53:07.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:06 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:07.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:06 smithi035 ceph-mon[92535]: pgmap v3809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T10:53:07.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:08 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:07.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:08 smithi035 ceph-mon[92535]: pgmap v3810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T10:53:07.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:09 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:07.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:09 smithi035 ceph-mon[92535]: osdmap e312: 12 total, 12 up, 12 in 2023-03-17T10:53:07.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:10 smithi035 ceph-mon[92535]: pgmap v3812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T10:53:07.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:12 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:07.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:12 smithi035 ceph-mon[92535]: pgmap v3813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 14 op/s 2023-03-17T10:53:08.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:14 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:53:11.865 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:14 smithi035 ceph-mon[92535]: pgmap v3814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:53:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 --2- 172.21.15.35:0/3670702587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b39a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 >> 172.21.15.35:0/3670702587 conn(0x55ee7b1ee6b0 msgr2=0x55ee7b390410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 shutdown_connections 2023-03-17T10:53:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 1 -- 172.21.15.35:0/3670702587 wait complete. 2023-03-17T10:53:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.463+0000 7f9485734b80 20 client.19590 trim_cache size 0 max 16384 2023-03-17T10:53:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.479+0000 7f9485734b80 1 Processor -- start 2023-03-17T10:53:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.479+0000 7f9485734b80 1 -- start start 2023-03-17T10:53:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9485734b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b394d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9485734b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 0x55ee7b38bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9485734b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b39d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9485734b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b38c000 con 0x55ee7b396be0 2023-03-17T10:53:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9485734b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b3870d0 con 0x55ee7b391960 2023-03-17T10:53:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9485734b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b38d3d0 con 0x55ee7b3974f0 2023-03-17T10:53:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 0x55ee7b38bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9472ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b394d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 0x55ee7b38bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52372/0 (socket says 172.21.15.35:52372) 2023-03-17T10:53:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 -- 172.21.15.35:0/2813247330 learned_addr learned my addr 172.21.15.35:0/2813247330 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f94737fe700 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b39d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 -- 172.21.15.35:0/2813247330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 msgr2=0x55ee7b39d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b39d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 -- 172.21.15.35:0/2813247330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 msgr2=0x55ee7b394d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b394d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 -- 172.21.15.35:0/2813247330 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee7b392000 con 0x55ee7b396be0 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f9472ffd700 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b394d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.480+0000 7f946a7fc700 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 0x55ee7b38bac0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b580 tx=0x7f945c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f8545364f18c52 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9469ffb700 1 -- 172.21.15.35:0/2813247330 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c01d040 con 0x55ee7b396be0 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9469ffb700 1 -- 172.21.15.35:0/2813247330 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f945c0055f0 con 0x55ee7b396be0 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9469ffb700 1 -- 172.21.15.35:0/2813247330 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c003e00 con 0x55ee7b396be0 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 -- 172.21.15.35:0/2813247330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 msgr2=0x55ee7b38bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 0x55ee7b38bac0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b580 tx=0x7f945c01a040 comp rx=0 tx=0).stop 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 -- 172.21.15.35:0/2813247330 shutdown_connections 2023-03-17T10:53:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b3974f0 0x55ee7b39d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b394d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 --2- 172.21.15.35:0/2813247330 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b396be0 0x55ee7b38bac0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 -- 172.21.15.35:0/2813247330 >> 172.21.15.35:0/2813247330 conn(0x55ee7b1ee6b0 msgr2=0x55ee7b394650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 -- 172.21.15.35:0/2813247330 shutdown_connections 2023-03-17T10:53:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.481+0000 7f9485734b80 1 -- 172.21.15.35:0/2813247330 wait complete. 2023-03-17T10:53:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 -- start start 2023-03-17T10:53:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 Processor -- start 2023-03-17T10:53:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b3a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b3a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b3fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b3fe000 con 0x55ee7b3974f0 2023-03-17T10:53:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b3fe140 con 0x55ee7b391960 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b3fe280 con 0x55ee7b396be0 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9485734b80 10 client.0 _ll_register_callbacks cb 0x55ee7b189230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f94737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b3fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f946a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b3a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f9472ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b3a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f946a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b3a1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44144/0 (socket says 172.21.15.35:44144) 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f946a7fc700 1 -- 172.21.15.35:0/1380646757 learned_addr learned my addr 172.21.15.35:0/1380646757 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.482+0000 7f946a7fc700 1 -- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 msgr2=0x55ee7b3a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f946a7fc700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b3a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f946a7fc700 1 -- 172.21.15.35:0/1380646757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 msgr2=0x55ee7b3fdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f946a7fc700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b3fdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f946a7fc700 1 -- 172.21.15.35:0/1380646757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9464004560 con 0x55ee7b396be0 2023-03-17T10:53:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f94737fe700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b3fdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:53:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9472ffd700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b3a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:53:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f946a7fc700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b3a1a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f945c0098e0 tx=0x7f945c0057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a354f8e231ee4c0e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f945a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:53:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f945a7fc700 1 -- 172.21.15.35:0/1380646757 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c01d030 con 0x55ee7b396be0 2023-03-17T10:53:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f945a7fc700 1 -- 172.21.15.35:0/1380646757 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(278..278 src has 1..278) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f945c00b9a0 con 0x55ee7b396be0 2023-03-17T10:53:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee7b3611e0 con 0x55ee7b396be0 2023-03-17T10:53:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f945a7fc700 1 -- 172.21.15.35:0/1380646757 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f945c00bb60 con 0x55ee7b396be0 2023-03-17T10:53:25.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 10 client.28738 fetch_fsmap learned FSMap version 56 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x7f945c0050b0 con 0x55ee7b396be0 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f945a7fc700 1 -- 172.21.15.35:0/1380646757 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee7b3611e0 con 0x55ee7b396be0 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f945a7fc700 1 -- 172.21.15.35:0/1380646757 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 56) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f945c02d450 con 0x55ee7b396be0 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 10 client.28738 fetch_fsmap finished waiting for FSMap version 56 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 10 client.28738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 20 client.28738 populate_metadata read hostname 'smithi035' 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3ff4c0 0x55ee7b4018a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 4 client.28738 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:53:26.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.483+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee7b167f00 con 0x55ee7b3ff4c0 2023-03-17T10:53:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.484+0000 7f9472ffd700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3ff4c0 0x55ee7b4018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.484+0000 7f9472ffd700 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3ff4c0 0x55ee7b4018a0 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f4510a9417faa5a server_cookie=8ed6d9a1bb7aeb3e in_seq=0 out_seq=0 2023-03-17T10:53:26.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.484+0000 7f945a7fc700 10 client.28738 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:53:27.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f945a7fc700 1 -- 172.21.15.35:0/1380646757 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee7b167f00 con 0x55ee7b3ff4c0 2023-03-17T10:53:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f945a7fc700 10 client.28738 handle_command_reply: tid=0 2023-03-17T10:53:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 client.28738 shutdown 2023-03-17T10:53:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 msgr2=0x55ee7b3a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b3a1a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f945c0098e0 tx=0x7f945c0057b0 comp rx=0 tx=0).stop 2023-03-17T10:53:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 shutdown_connections 2023-03-17T10:53:28.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ee7b3ff4c0 0x55ee7b4018a0 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:28.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ee7b3974f0 0x55ee7b3fdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:28.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f945a7fc700 0 client.28738 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:53:28.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee7b391960 0x55ee7b3a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:28.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 --2- 172.21.15.35:0/1380646757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee7b396be0 0x55ee7b3a1a30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 >> 172.21.15.35:0/1380646757 conn(0x55ee7b1ee6b0 msgr2=0x55ee7b390410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.510+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 shutdown_connections 2023-03-17T10:53:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f9485734b80 1 -- 172.21.15.35:0/1380646757 wait complete. 2023-03-17T10:53:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f9485734b80 20 client.28738 trim_cache size 0 max 16384 2023-03-17T10:53:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f946009f6c0 msgr2=0x7f94600a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f946009f6c0 0x7f94600a1b70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9464009c60 tx=0x7f9464009260 comp rx=0 tx=0).stop 2023-03-17T10:53:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 msgr2=0x7f94741a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 0x7f94741a4440 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f946c00ef30 tx=0x7f946c00c3a0 comp rx=0 tx=0).stop 2023-03-17T10:53:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 shutdown_connections 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f946009f6c0 0x7f94600a1b70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9474104390 0x7f94741a4440 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94740ff350 0x7f9474100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 --2- 172.21.15.35:0/829737068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94740ffcf0 0x7f9474101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 >> 172.21.15.35:0/829737068 conn(0x7f9474076330 msgr2=0x7f9474102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 shutdown_connections 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:16.511+0000 7f94795a7700 1 -- 172.21.15.35:0/829737068 wait complete. 2023-03-17T10:53:31.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 -- 172.21.15.35:0/3722942966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ff350 msgr2=0x7ff8980ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 --2- 172.21.15.35:0/3722942966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ff350 0x7ff8980ff720 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff8940099c0 tx=0x7ff894009cd0 comp rx=0 tx=0).stop 2023-03-17T10:53:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 -- 172.21.15.35:0/3722942966 shutdown_connections 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 --2- 172.21.15.35:0/3722942966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff898104390 0x7ff89810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 --2- 172.21.15.35:0/3722942966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ff350 0x7ff8980ff720 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 --2- 172.21.15.35:0/3722942966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8980ffcf0 0x7ff898103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 -- 172.21.15.35:0/3722942966 >> 172.21.15.35:0/3722942966 conn(0x7ff898076330 msgr2=0x7ff898076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 -- 172.21.15.35:0/3722942966 shutdown_connections 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.633+0000 7ff89f99c700 1 -- 172.21.15.35:0/3722942966 wait complete. 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 Processor -- start 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 -- start start 2023-03-17T10:53:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8980ff350 0x7ff898196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 0x7ff898196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff898104390 0x7ff89819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89819b220 con 0x7ff8980ffcf0 2023-03-17T10:53:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89819b390 con 0x7ff8980ff350 2023-03-17T10:53:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89f99c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89819b550 con 0x7ff898104390 2023-03-17T10:53:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 0x7ff898196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 0x7ff898196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52392/0 (socket says 172.21.15.35:52392) 2023-03-17T10:53:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89cf37700 1 -- 172.21.15.35:0/105066450 learned_addr learned my addr 172.21.15.35:0/105066450 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89d738700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8980ff350 0x7ff898196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.634+0000 7ff89df39700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff898104390 0x7ff89819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89cf37700 1 -- 172.21.15.35:0/105066450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff898104390 msgr2=0x7ff89819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89cf37700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff898104390 0x7ff89819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89cf37700 1 -- 172.21.15.35:0/105066450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8980ff350 msgr2=0x7ff898196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89cf37700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8980ff350 0x7ff898196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89cf37700 1 -- 172.21.15.35:0/105066450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940095f0 con 0x7ff8980ffcf0 2023-03-17T10:53:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89cf37700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 0x7ff898196780 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00d950 tx=0x7ff88c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff88a7fc700 1 -- 172.21.15.35:0/105066450 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c009930 con 0x7ff8980ffcf0 2023-03-17T10:53:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff88a7fc700 1 -- 172.21.15.35:0/105066450 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff88c010460 con 0x7ff8980ffcf0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89810f000 con 0x7ff8980ffcf0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff88a7fc700 1 -- 172.21.15.35:0/105066450 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00f620 con 0x7ff8980ffcf0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.635+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89810ee70 con 0x7ff8980ffcf0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.637+0000 7ff88a7fc700 1 -- 172.21.15.35:0/105066450 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff88c009a90 con 0x7ff8980ffcf0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.638+0000 7ff88a7fc700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff88409f640 0x7ff8840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.638+0000 7ff89d738700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff88409f640 0x7ff8840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.638+0000 7ff88a7fc700 1 -- 172.21.15.35:0/105066450 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(278..278 src has 1..278) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff88c0ca200 con 0x7ff8980ffcf0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.638+0000 7ff89d738700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff88409f640 0x7ff8840a1af0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff894009990 tx=0x7ff894003680 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 Processor -- start 2023-03-17T10:53:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 -- start start 2023-03-17T10:53:35.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df42be0 0x56104df42fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df3d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df3dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104de44010 con 0x56104df434f0 2023-03-17T10:53:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104de96950 con 0x56104df42be0 2023-03-17T10:53:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104de8fde0 con 0x56104df3d960 2023-03-17T10:53:35.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df3d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df3d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52400/0 (socket says 172.21.15.35:52400) 2023-03-17T10:53:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.639+0000 7ff89cf37700 1 -- 172.21.15.35:0/1736246041 learned_addr learned my addr 172.21.15.35:0/1736246041 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89df39700 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df3dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89d738700 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df42be0 0x56104df42fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89cf37700 1 -- 172.21.15.35:0/1736246041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 msgr2=0x56104df3dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89cf37700 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df3dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89cf37700 1 -- 172.21.15.35:0/1736246041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df42be0 msgr2=0x56104df42fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89cf37700 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df42be0 0x56104df42fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89cf37700 1 -- 172.21.15.35:0/1736246041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104dd115d0 con 0x56104df434f0 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89d738700 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df42be0 0x56104df42fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff89cf37700 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df3d420 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7ff88c094150 tx=0x7ff88c097b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef729cdbdd69b358 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff8837fe700 1 -- 172.21.15.35:0/1736246041 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c09fe40 con 0x56104df434f0 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff8837fe700 1 -- 172.21.15.35:0/1736246041 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff88c095ff0 con 0x56104df434f0 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.640+0000 7ff8837fe700 1 -- 172.21.15.35:0/1736246041 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c097140 con 0x56104df434f0 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 -- 172.21.15.35:0/1736246041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 msgr2=0x56104df3d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df3d420 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7ff88c094150 tx=0x7ff88c097b50 comp rx=0 tx=0).stop 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 -- 172.21.15.35:0/1736246041 shutdown_connections 2023-03-17T10:53:35.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df3dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df42be0 0x56104df42fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/1736246041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df3d420 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 -- 172.21.15.35:0/1736246041 >> 172.21.15.35:0/1736246041 conn(0x56104dd9a6b0 msgr2=0x56104df37a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 -- 172.21.15.35:0/1736246041 shutdown_connections 2023-03-17T10:53:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 -- 172.21.15.35:0/1736246041 wait complete. 2023-03-17T10:53:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 -- start start 2023-03-17T10:53:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.641+0000 7ff8abb29b80 1 Processor -- start 2023-03-17T10:53:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df42be0 0x56104df46740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df46e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104dd138c0 con 0x56104df434f0 2023-03-17T10:53:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df475f0 con 0x56104df3d960 2023-03-17T10:53:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df53000 con 0x56104df42be0 2023-03-17T10:53:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff8abb29b80 10 client.0 _ll_register_callbacks cb 0x56104dd35230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df46e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df46e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52408/0 (socket says 172.21.15.35:52408) 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 -- 172.21.15.35:0/900242267 learned_addr learned my addr 172.21.15.35:0/900242267 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89cf37700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df42be0 0x56104df46740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89d738700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 -- 172.21.15.35:0/900242267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df42be0 msgr2=0x56104df46740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df42be0 0x56104df46740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 -- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 msgr2=0x56104df494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.642+0000 7ff89df39700 1 -- 172.21.15.35:0/900242267 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89810ee70 con 0x56104df434f0 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff89df39700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df46e80 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff890007940 tx=0x7ff890007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f4b1d467bd862f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff880ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff880ff9700 1 -- 172.21.15.35:0/900242267 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890015610 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff880ff9700 1 -- 172.21.15.35:0/900242267 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(278..278 src has 1..278) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff890015770 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104de52390 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff880ff9700 1 -- 172.21.15.35:0/900242267 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff890015930 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 10 client.19608 fetch_fsmap learned FSMap version 58 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x56104dcbdd80 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff880ff9700 1 -- 172.21.15.35:0/900242267 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56104de52390 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff880ff9700 1 -- 172.21.15.35:0/900242267 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 58) v1 ==== 6945+0+0 (secure 0 0 0) 0x7ff89001dab0 con 0x56104df434f0 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 10 client.19608 fetch_fsmap finished waiting for FSMap version 58 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 10 client.19608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 20 client.19608 populate_metadata read hostname 'smithi035' 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104df57150 0x56104df59560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 4 client.19608 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.643+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56104de5e600 con 0x56104df57150 2023-03-17T10:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.644+0000 7ff89d738700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104df57150 0x56104df59560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.644+0000 7ff880ff9700 10 client.19608 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.644+0000 7ff89d738700 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104df57150 0x56104df59560 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7730f16c83c2c server_cookie=275e1770873203b3 in_seq=0 out_seq=0 2023-03-17T10:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff880ff9700 1 -- 172.21.15.35:0/900242267 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56104de5e600 con 0x56104df57150 2023-03-17T10:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff880ff9700 10 client.19608 handle_command_reply: tid=0 2023-03-17T10:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 client.19608 shutdown 2023-03-17T10:53:41.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 msgr2=0x56104df46e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df46e80 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff890007940 tx=0x7ff890007c50 comp rx=0 tx=0).stop 2023-03-17T10:53:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 shutdown_connections 2023-03-17T10:53:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104df57150 0x56104df59560 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df434f0 0x56104df46e80 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff880ff9700 0 client.19608 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:53:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/900242267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df42be0 0x56104df46740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 >> 172.21.15.35:0/900242267 conn(0x56104dd9a6b0 msgr2=0x56104df3c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 shutdown_connections 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 1 -- 172.21.15.35:0/900242267 wait complete. 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.645+0000 7ff8abb29b80 20 client.19608 trim_cache size 0 max 16384 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 Processor -- start 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 -- start start 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df37ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df434f0 0x56104df526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df39570 con 0x56104df42be0 2023-03-17T10:53:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df38000 con 0x56104df3d960 2023-03-17T10:53:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df33100 con 0x56104df434f0 2023-03-17T10:53:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52414/0 (socket says 172.21.15.35:52414) 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.660+0000 7ff89cf37700 1 -- 172.21.15.35:0/927918064 learned_addr learned my addr 172.21.15.35:0/927918064 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89df39700 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df434f0 0x56104df526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89d738700 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df37ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89cf37700 1 -- 172.21.15.35:0/927918064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df434f0 msgr2=0x56104df526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89cf37700 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df434f0 0x56104df526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89cf37700 1 -- 172.21.15.35:0/927918064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 msgr2=0x56104df37ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89cf37700 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df37ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89cf37700 1 -- 172.21.15.35:0/927918064 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104de56130 con 0x56104df42be0 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff89cf37700 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4df20 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x56104df49a70 tx=0x7ff88c00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e82f190d3826ec server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff883fff700 1 -- 172.21.15.35:0/927918064 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c09fe40 con 0x56104df42be0 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff883fff700 1 -- 172.21.15.35:0/927918064 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff88c095ff0 con 0x56104df42be0 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.661+0000 7ff883fff700 1 -- 172.21.15.35:0/927918064 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c097140 con 0x56104df42be0 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 -- 172.21.15.35:0/927918064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 msgr2=0x56104df4df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4df20 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x56104df49a70 tx=0x7ff88c00df90 comp rx=0 tx=0).stop 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 -- 172.21.15.35:0/927918064 shutdown_connections 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df434f0 0x56104df526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df3d960 0x56104df37ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/927918064 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4df20 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 -- 172.21.15.35:0/927918064 >> 172.21.15.35:0/927918064 conn(0x56104dd9a6b0 msgr2=0x56104df490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 -- 172.21.15.35:0/927918064 shutdown_connections 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 -- 172.21.15.35:0/927918064 wait complete. 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 -- start start 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.662+0000 7ff8abb29b80 1 Processor -- start 2023-03-17T10:53:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df4d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df434f0 0x56104df4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df4c5d0 con 0x56104df42be0 2023-03-17T10:53:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df4c740 con 0x56104df434f0 2023-03-17T10:53:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104df4c900 con 0x56104df3d960 2023-03-17T10:53:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff8abb29b80 10 client.0 _ll_register_callbacks cb 0x56104dd35230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:53:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52420/0 (socket says 172.21.15.35:52420) 2023-03-17T10:53:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 -- 172.21.15.35:0/2546227414 learned_addr learned my addr 172.21.15.35:0/2546227414 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:53:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89df39700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df434f0 0x56104df4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89d738700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df4d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 -- 172.21.15.35:0/2546227414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 msgr2=0x56104df4d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df4d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 -- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df434f0 msgr2=0x56104df4bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df434f0 0x56104df4bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 -- 172.21.15.35:0/2546227414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56104dd115d0 con 0x56104df42be0 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89df39700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df434f0 0x56104df4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89d738700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df4d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff89cf37700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4dda0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0ad040 tx=0x7ff88c005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cad4728d5bcdd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff880ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.663+0000 7ff880ff9700 1 -- 172.21.15.35:0/2546227414 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c064300 con 0x56104df42be0 2023-03-17T10:53:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff880ff9700 1 -- 172.21.15.35:0/2546227414 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(278..278 src has 1..278) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff88c097eb0 con 0x56104df42be0 2023-03-17T10:53:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104df0d1e0 con 0x56104df42be0 2023-03-17T10:53:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff880ff9700 1 -- 172.21.15.35:0/2546227414 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff88c098070 con 0x56104df42be0 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 10 client.19614 fetch_fsmap learned FSMap version 58 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x56104dce41f0 con 0x56104df42be0 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff880ff9700 1 -- 172.21.15.35:0/2546227414 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56104df0d1e0 con 0x56104df42be0 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff880ff9700 1 -- 172.21.15.35:0/2546227414 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 58) v1 ==== 6945+0+0 (secure 0 0 0) 0x7ff88c09f9b0 con 0x56104df42be0 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 10 client.19614 fetch_fsmap finished waiting for FSMap version 58 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 10 client.19614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 20 client.19614 populate_metadata read hostname 'smithi035' 2023-03-17T10:53:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104dfabb70 0x56104dfadf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 4 client.19614 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56104dd13f00 con 0x56104dfabb70 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.664+0000 7ff89d738700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104dfabb70 0x56104dfadf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.665+0000 7ff880ff9700 10 client.19614 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.665+0000 7ff89d738700 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104dfabb70 0x56104dfadf50 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d0ae0a2b6415ce server_cookie=4663b0775c1f3632 in_seq=0 out_seq=0 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.695+0000 7ff880ff9700 1 -- 172.21.15.35:0/2546227414 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56104dd13f00 con 0x56104dfabb70 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.695+0000 7ff880ff9700 10 client.19614 handle_command_reply: tid=0 2023-03-17T10:53:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.695+0000 7ff8abb29b80 1 client.19614 shutdown 2023-03-17T10:53:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 msgr2=0x56104df4dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4dda0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0ad040 tx=0x7ff88c005900 comp rx=0 tx=0).stop 2023-03-17T10:53:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 shutdown_connections 2023-03-17T10:53:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56104dfabb70 0x56104dfadf50 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56104df434f0 0x56104df4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:57.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff880ff9700 0 client.19614 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:53:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56104df3d960 0x56104df4d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:57.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 --2- 172.21.15.35:0/2546227414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56104df42be0 0x56104df4dda0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 >> 172.21.15.35:0/2546227414 conn(0x56104dd9a6b0 msgr2=0x56104df3ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 shutdown_connections 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 1 -- 172.21.15.35:0/2546227414 wait complete. 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.696+0000 7ff8abb29b80 20 client.19614 trim_cache size 0 max 16384 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff88409f640 msgr2=0x7ff8840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff88409f640 0x7ff8840a1af0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff894009990 tx=0x7ff894003680 comp rx=0 tx=0).stop 2023-03-17T10:53:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 msgr2=0x7ff898196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:53:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 0x7ff898196780 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00d950 tx=0x7ff88c00dc60 comp rx=0 tx=0).stop 2023-03-17T10:53:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 shutdown_connections 2023-03-17T10:53:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff88409f640 0x7ff8840a1af0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff898104390 0x7ff89819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:53:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8980ff350 0x7ff898196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 --2- 172.21.15.35:0/105066450 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff8980ffcf0 0x7ff898196780 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 >> 172.21.15.35:0/105066450 conn(0x7ff898076330 msgr2=0x7ff898068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 shutdown_connections 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:25:29.697+0000 7ff89f99c700 1 -- 172.21.15.35:0/105066450 wait complete. 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 -- 172.21.15.35:0/2206579332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4140ff350 msgr2=0x7fe4140ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 --2- 172.21.15.35:0/2206579332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4140ff350 0x7fe4140ff720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4100099c0 tx=0x7fe410009cd0 comp rx=0 tx=0).stop 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 -- 172.21.15.35:0/2206579332 shutdown_connections 2023-03-17T10:54:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 --2- 172.21.15.35:0/2206579332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe414104390 0x7fe41410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:01.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 --2- 172.21.15.35:0/2206579332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4140ff350 0x7fe4140ff720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:01.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 --2- 172.21.15.35:0/2206579332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 0x7fe414103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 -- 172.21.15.35:0/2206579332 >> 172.21.15.35:0/2206579332 conn(0x7fe414076330 msgr2=0x7fe414076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 -- 172.21.15.35:0/2206579332 shutdown_connections 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.845+0000 7fe41c31d700 1 -- 172.21.15.35:0/2206579332 wait complete. 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 Processor -- start 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 -- start start 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 0x7fe4141940a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 0x7fe4141945e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe414104390 0x7fe414198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe414199080 con 0x7fe4140ff350 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141991f0 con 0x7fe4140ffcf0 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41c31d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141993b0 con 0x7fe414104390 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41a0b9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 0x7fe4141940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41a0b9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 0x7fe4141940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52432/0 (socket says 172.21.15.35:52432) 2023-03-17T10:54:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe41a0b9700 1 -- 172.21.15.35:0/238497615 learned_addr learned my addr 172.21.15.35:0/238497615 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:03.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.846+0000 7fe4198b8700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 0x7fe4141945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe414104390 0x7fe414198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a0b9700 1 -- 172.21.15.35:0/238497615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe414104390 msgr2=0x7fe414198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe414104390 0x7fe414198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a0b9700 1 -- 172.21.15.35:0/238497615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 msgr2=0x7fe4141945e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:04.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 0x7fe4141945e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:05.042 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a0b9700 1 -- 172.21.15.35:0/238497615 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100095f0 con 0x7fe4140ff350 2023-03-17T10:54:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe4198b8700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 0x7fe4141945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:54:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 0x7fe4141940a0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fe410006010 tx=0x7fe41000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe40b7fe700 1 -- 172.21.15.35:0/238497615 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41001d070 con 0x7fe4140ff350 2023-03-17T10:54:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe40b7fe700 1 -- 172.21.15.35:0/238497615 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe410005030 con 0x7fe4140ff350 2023-03-17T10:54:05.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41410dfc0 con 0x7fe4140ff350 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe40b7fe700 1 -- 172.21.15.35:0/238497615 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410004a00 con 0x7fe4140ff350 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.847+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41410de30 con 0x7fe4140ff350 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.850+0000 7fe40b7fe700 1 -- 172.21.15.35:0/238497615 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe4100051a0 con 0x7fe4140ff350 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.851+0000 7fe40b7fe700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe40009f640 0x7fe4000a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.851+0000 7fe4198b8700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe40009f640 0x7fe4000a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.851+0000 7fe40b7fe700 1 -- 172.21.15.35:0/238497615 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(280..280 src has 1..280) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe4100cb270 con 0x7fe4140ff350 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4198b8700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe40009f640 0x7fe4000a1af0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe4141956b0 tx=0x7fe40400d040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:05.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 Processor -- start 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 -- start start 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f196efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196f4f0 0x5650f1969420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f1969960 0x5650f1969d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f1870010 con 0x5650f196f4f0 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.852+0000 7fe4284aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f18c2950 con 0x5650f196ebe0 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe4284aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f18bbde0 con 0x5650f1969960 2023-03-17T10:54:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196f4f0 0x5650f1969420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196f4f0 0x5650f1969420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52442/0 (socket says 172.21.15.35:52442) 2023-03-17T10:54:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f1969960 0x5650f1969d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe4198b8700 1 -- 172.21.15.35:0/541366980 learned_addr learned my addr 172.21.15.35:0/541366980 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f196efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 -- 172.21.15.35:0/541366980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 msgr2=0x5650f196efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f196efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 -- 172.21.15.35:0/541366980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196f4f0 msgr2=0x5650f1969420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:12.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196f4f0 0x5650f1969420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:12.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 -- 172.21.15.35:0/541366980 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f173d5d0 con 0x5650f1969960 2023-03-17T10:54:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f1969960 0x5650f1969d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00f7f0 tx=0x7fe40c00dd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b74735366ae64a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe408dae700 1 -- 172.21.15.35:0/541366980 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c012040 con 0x5650f1969960 2023-03-17T10:54:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe408dae700 1 -- 172.21.15.35:0/541366980 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe40c013040 con 0x5650f1969960 2023-03-17T10:54:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.853+0000 7fe408dae700 1 -- 172.21.15.35:0/541366980 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00d110 con 0x5650f1969960 2023-03-17T10:54:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 -- 172.21.15.35:0/541366980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f1969960 msgr2=0x5650f1969d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:17.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f1969960 0x5650f1969d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00f7f0 tx=0x7fe40c00dd30 comp rx=0 tx=0).stop 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 -- 172.21.15.35:0/541366980 shutdown_connections 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f1969960 0x5650f1969d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f196efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 --2- 172.21.15.35:0/541366980 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196f4f0 0x5650f1969420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 -- 172.21.15.35:0/541366980 >> 172.21.15.35:0/541366980 conn(0x5650f17c66b0 msgr2=0x5650f1963a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.854+0000 7fe4284aab80 1 -- 172.21.15.35:0/541366980 shutdown_connections 2023-03-17T10:54:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 -- 172.21.15.35:0/541366980 wait complete. 2023-03-17T10:54:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 -- start start 2023-03-17T10:54:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 Processor -- start 2023-03-17T10:54:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1975450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f19726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1972d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f173f8c0 con 0x5650f196ebe0 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f1973470 con 0x5650f1969960 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f197f000 con 0x5650f196f4f0 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.855+0000 7fe4284aab80 10 client.0 _ll_register_callbacks cb 0x5650f1761230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1975450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f19726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1975450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54242/0 (socket says 172.21.15.35:54242) 2023-03-17T10:54:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 -- 172.21.15.35:0/3925604038 learned_addr learned my addr 172.21.15.35:0/3925604038 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1972d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:20.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 -- 172.21.15.35:0/3925604038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 msgr2=0x5650f1972d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1972d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 -- 172.21.15.35:0/3925604038 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 msgr2=0x5650f19726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f19726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 -- 172.21.15.35:0/3925604038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c00f4d0 con 0x5650f1969960 2023-03-17T10:54:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1975450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe41000ffd0 tx=0x7fe410098ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb78c39c7d0574d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe3fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:54:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe3fdffb700 1 -- 172.21.15.35:0/3925604038 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100b0070 con 0x5650f1969960 2023-03-17T10:54:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe3fdffb700 1 -- 172.21.15.35:0/3925604038 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(280..280 src has 1..280) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe4100982a0 con 0x5650f1969960 2023-03-17T10:54:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.856+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650f187e390 con 0x5650f1969960 2023-03-17T10:54:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe3fdffb700 1 -- 172.21.15.35:0/3925604038 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4100992e0 con 0x5650f1969960 2023-03-17T10:54:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 10 client.28784 fetch_fsmap learned FSMap version 63 2023-03-17T10:54:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x5650f16e9d80 con 0x5650f1969960 2023-03-17T10:54:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe3fdffb700 1 -- 172.21.15.35:0/3925604038 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5650f187e390 con 0x5650f1969960 2023-03-17T10:54:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe3fdffb700 1 -- 172.21.15.35:0/3925604038 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fe410094ba0 con 0x5650f1969960 2023-03-17T10:54:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 10 client.28784 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:54:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 10 client.28784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:54:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 20 client.28784 populate_metadata read hostname 'smithi035' 2023-03-17T10:54:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f1982e50 0x5650f1985260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:24.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 4 client.28784 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:54:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650f188a600 con 0x5650f1982e50 2023-03-17T10:54:24.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.857+0000 7fe4198b8700 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f1982e50 0x5650f1985260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe3fdffb700 10 client.28784 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:54:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4198b8700 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f1982e50 0x5650f1985260 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae622e1aa62362c server_cookie=126f694557135327 in_seq=0 out_seq=0 2023-03-17T10:54:25.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe3fdffb700 1 -- 172.21.15.35:0/3925604038 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5650f188a600 con 0x5650f1982e50 2023-03-17T10:54:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe3fdffb700 10 client.28784 handle_command_reply: tid=0 2023-03-17T10:54:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 client.28784 shutdown 2023-03-17T10:54:25.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 msgr2=0x5650f1975450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1975450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe41000ffd0 tx=0x7fe410098ef0 comp rx=0 tx=0).stop 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 shutdown_connections 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f1982e50 0x5650f1985260 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1972d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1975450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe3fdffb700 0 client.28784 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 --2- 172.21.15.35:0/3925604038 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f19726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.858+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 >> 172.21.15.35:0/3925604038 conn(0x5650f17c66b0 msgr2=0x5650f1968410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.859+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 shutdown_connections 2023-03-17T10:54:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.859+0000 7fe4284aab80 1 -- 172.21.15.35:0/3925604038 wait complete. 2023-03-17T10:54:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.859+0000 7fe4284aab80 20 client.28784 trim_cache size 0 max 16384 2023-03-17T10:54:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 Processor -- start 2023-03-17T10:54:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 -- start start 2023-03-17T10:54:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1979f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f1974ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f196c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f195f0f0 con 0x5650f196ebe0 2023-03-17T10:54:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f1964380 con 0x5650f1969960 2023-03-17T10:54:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4284aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f19605c0 con 0x5650f196f4f0 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f1974ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe41a0b9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1979f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f1974ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52456/0 (socket says 172.21.15.35:52456) 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe41a8ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f196c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 -- 172.21.15.35:0/4124655041 learned_addr learned my addr 172.21.15.35:0/4124655041 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 -- 172.21.15.35:0/4124655041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 msgr2=0x5650f196c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f196c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 -- 172.21.15.35:0/4124655041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 msgr2=0x5650f1979f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.882+0000 7fe4198b8700 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1979f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.883+0000 7fe4198b8700 1 -- 172.21.15.35:0/4124655041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650f1882130 con 0x5650f196ebe0 2023-03-17T10:54:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.883+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1979f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:54:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.883+0000 7fe4198b8700 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f1974ff0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x5650f19646a0 tx=0x7fe404019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f30d2a8e024ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.883+0000 7fe4095af700 1 -- 172.21.15.35:0/4124655041 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404010040 con 0x5650f196ebe0 2023-03-17T10:54:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.883+0000 7fe4095af700 1 -- 172.21.15.35:0/4124655041 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe404034580 con 0x5650f196ebe0 2023-03-17T10:54:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.883+0000 7fe4095af700 1 -- 172.21.15.35:0/4124655041 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404021ce0 con 0x5650f196ebe0 2023-03-17T10:54:31.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 -- 172.21.15.35:0/4124655041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 msgr2=0x5650f1974ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:31.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f1974ff0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x5650f19646a0 tx=0x7fe404019000 comp rx=0 tx=0).stop 2023-03-17T10:54:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 -- 172.21.15.35:0/4124655041 shutdown_connections 2023-03-17T10:54:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f196c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f1969960 0x5650f1979f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 --2- 172.21.15.35:0/4124655041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f196ebe0 0x5650f1974ff0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 -- 172.21.15.35:0/4124655041 >> 172.21.15.35:0/4124655041 conn(0x5650f17c66b0 msgr2=0x5650f1968a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 -- 172.21.15.35:0/4124655041 shutdown_connections 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 -- 172.21.15.35:0/4124655041 wait complete. 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.884+0000 7fe4284aab80 1 -- start start 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 Processor -- start 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f1969960 0x5650f19cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f19d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1977f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f1978470 con 0x5650f1969960 2023-03-17T10:54:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f19785b0 con 0x5650f196ebe0 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650f1978770 con 0x5650f196f4f0 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4284aab80 10 client.0 _ll_register_callbacks cb 0x5650f1761230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f19d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4198b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f19d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54258/0 (socket says 172.21.15.35:54258) 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe4198b8700 1 -- 172.21.15.35:0/2428608842 learned_addr learned my addr 172.21.15.35:0/2428608842 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f1969960 0x5650f19cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.885+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1977f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a0b9700 1 -- 172.21.15.35:0/2428608842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 msgr2=0x5650f1977f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1977f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a0b9700 1 -- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 msgr2=0x5650f19d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f19d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a0b9700 1 -- 172.21.15.35:0/2428608842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe404029040 con 0x5650f1969960 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a8ba700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1977f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe4198b8700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f19d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe41a0b9700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f1969960 0x5650f19cfeb0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe4100952b0 tx=0x7fe4100a0f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ccacd6e19c4f0f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe3fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe3fdffb700 1 -- 172.21.15.35:0/2428608842 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100b0070 con 0x5650f1969960 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe3fdffb700 1 -- 172.21.15.35:0/2428608842 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(280..280 src has 1..280) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe410004b60 con 0x5650f1969960 2023-03-17T10:54:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650f19391e0 con 0x5650f1969960 2023-03-17T10:54:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe3fdffb700 1 -- 172.21.15.35:0/2428608842 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4100992e0 con 0x5650f1969960 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe4284aab80 10 client.19632 fetch_fsmap learned FSMap version 63 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x5650f17101f0 con 0x5650f1969960 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.886+0000 7fe3fdffb700 1 -- 172.21.15.35:0/2428608842 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5650f19391e0 con 0x5650f1969960 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe3fdffb700 1 -- 172.21.15.35:0/2428608842 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fe410065260 con 0x5650f1969960 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4284aab80 10 client.19632 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4284aab80 10 client.19632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:54:38.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4284aab80 20 client.19632 populate_metadata read hostname 'smithi035' 2023-03-17T10:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4284aab80 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f19d7860 0x5650f19d9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4284aab80 4 client.19632 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5650f173ff00 con 0x5650f19d7860 2023-03-17T10:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4198b8700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f19d7860 0x5650f19d9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe4198b8700 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f19d7860 0x5650f19d9c70 crc :-1 s=READY pgs=541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1985e9b0e74b7bff server_cookie=490cd88b30870ab5 in_seq=0 out_seq=0 2023-03-17T10:54:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.887+0000 7fe3fdffb700 10 client.19632 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:54:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.970+0000 7fe3fdffb700 1 -- 172.21.15.35:0/2428608842 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5650f173ff00 con 0x5650f19d7860 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.970+0000 7fe3fdffb700 10 client.19632 handle_command_reply: tid=0 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.970+0000 7fe4284aab80 1 client.19632 shutdown 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.970+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f1969960 msgr2=0x5650f19cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.970+0000 7fe4284aab80 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f1969960 0x5650f19cfeb0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe4100952b0 tx=0x7fe4100a0f90 comp rx=0 tx=0).stop 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 shutdown_connections 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5650f19d7860 0x5650f19d9c70 crc :-1 s=READY pgs=541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5650f196f4f0 0x5650f1977f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5650f1969960 0x5650f19cfeb0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 --2- 172.21.15.35:0/2428608842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5650f196ebe0 0x5650f19d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 >> 172.21.15.35:0/2428608842 conn(0x5650f17c66b0 msgr2=0x5650f196c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe3fdffb700 0 client.19632 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 shutdown_connections 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 1 -- 172.21.15.35:0/2428608842 wait complete. 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.971+0000 7fe4284aab80 20 client.19632 trim_cache size 0 max 16384 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe40009f640 msgr2=0x7fe4000a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe40009f640 0x7fe4000a1af0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe4141956b0 tx=0x7fe40400d040 comp rx=0 tx=0).stop 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 msgr2=0x7fe4141940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 0x7fe4141940a0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fe410006010 tx=0x7fe41000f670 comp rx=0 tx=0).stop 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 shutdown_connections 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe40009f640 0x7fe4000a1af0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe414104390 0x7fe414198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4140ff350 0x7fe4141940a0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 --2- 172.21.15.35:0/238497615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4140ffcf0 0x7fe4141945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 >> 172.21.15.35:0/238497615 conn(0x7fe414076330 msgr2=0x7fe4140fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 shutdown_connections 2023-03-17T10:54:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:26:54.972+0000 7fe41c31d700 1 -- 172.21.15.35:0/238497615 wait complete. 2023-03-17T10:54:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 -- 172.21.15.35:0/3298541053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6484104400 msgr2=0x7f648410bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 --2- 172.21.15.35:0/3298541053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6484104400 0x7f648410bfd0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f647c00b0d0 tx=0x7f647c00b3e0 comp rx=0 tx=0).stop 2023-03-17T10:54:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 -- 172.21.15.35:0/3298541053 shutdown_connections 2023-03-17T10:54:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 --2- 172.21.15.35:0/3298541053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6484104400 0x7f648410bfd0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 --2- 172.21.15.35:0/3298541053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64840ff3c0 0x7f64840ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 --2- 172.21.15.35:0/3298541053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64840ffd60 0x7f6484103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 -- 172.21.15.35:0/3298541053 >> 172.21.15.35:0/3298541053 conn(0x7f6484076300 msgr2=0x7f6484076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 -- 172.21.15.35:0/3298541053 shutdown_connections 2023-03-17T10:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.138+0000 7f648b06f700 1 -- 172.21.15.35:0/3298541053 wait complete. 2023-03-17T10:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 Processor -- start 2023-03-17T10:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 -- start start 2023-03-17T10:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 0x7f6484195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64840ffd60 0x7f64841958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484104400 0x7f6484199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648419a350 con 0x7f64840ff3c0 2023-03-17T10:54:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648419a4c0 con 0x7f64840ffd60 2023-03-17T10:54:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648b06f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648419a680 con 0x7f6484104400 2023-03-17T10:54:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 0x7f6484195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 0x7f6484195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52476/0 (socket says 172.21.15.35:52476) 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 -- 172.21.15.35:0/1844244372 learned_addr learned my addr 172.21.15.35:0/1844244372 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648960c700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484104400 0x7f6484199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6483fff700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64840ffd60 0x7f64841958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 -- 172.21.15.35:0/1844244372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484104400 msgr2=0x7f6484199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484104400 0x7f6484199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 -- 172.21.15.35:0/1844244372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64840ffd60 msgr2=0x7f64841958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64840ffd60 0x7f64841958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f6488e0b700 1 -- 172.21.15.35:0/1844244372 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009520 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.139+0000 7f648960c700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484104400 0x7f6484199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.140+0000 7f6488e0b700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 0x7f6484195370 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f647800ec40 tx=0x7f647800ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.140+0000 7f6481ffb700 1 -- 172.21.15.35:0/1844244372 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478013070 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.140+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c009d00 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.140+0000 7f6481ffb700 1 -- 172.21.15.35:0/1844244372 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6478004020 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.140+0000 7f6481ffb700 1 -- 172.21.15.35:0/1844244372 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478003a00 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.140+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648410f030 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.143+0000 7f6481ffb700 1 -- 172.21.15.35:0/1844244372 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6478004190 con 0x7f64840ff3c0 2023-03-17T10:54:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.143+0000 7f6481ffb700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647409f640 0x7f64740a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.144+0000 7f6481ffb700 1 -- 172.21.15.35:0/1844244372 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(281..281 src has 1..281) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f64780cbcc0 con 0x7f64840ff3c0 2023-03-17T10:54:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.144+0000 7f6483fff700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647409f640 0x7f64740a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.144+0000 7f6483fff700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647409f640 0x7f64740a1af0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6484196980 tx=0x7f6470009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 Processor -- start 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 -- start start 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb0a7010 con 0x556adb1a5be0 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb0f9950 con 0x556adb1a64f0 2023-03-17T10:54:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f64971fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb0f2de0 con 0x556adb1a0960 2023-03-17T10:54:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f6483fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f6483fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54282/0 (socket says 172.21.15.35:54282) 2023-03-17T10:54:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f6483fff700 1 -- 172.21.15.35:0/3123310668 learned_addr learned my addr 172.21.15.35:0/3123310668 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.145+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f648960c700 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f6483fff700 1 -- 172.21.15.35:0/3123310668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 msgr2=0x556adb1a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f6483fff700 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f6483fff700 1 -- 172.21.15.35:0/3123310668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 msgr2=0x556adb1a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f6483fff700 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f6483fff700 1 -- 172.21.15.35:0/3123310668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556adaf745d0 con 0x556adb1a64f0 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f6483fff700 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a0420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6470011cd0 tx=0x7f6470014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d10d012818a0b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f646effd700 1 -- 172.21.15.35:0/3123310668 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470004020 con 0x556adb1a64f0 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f646effd700 1 -- 172.21.15.35:0/3123310668 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f647000e840 con 0x556adb1a64f0 2023-03-17T10:54:56.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.146+0000 7f646effd700 1 -- 172.21.15.35:0/3123310668 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470003a00 con 0x556adb1a64f0 2023-03-17T10:54:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 -- 172.21.15.35:0/3123310668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 msgr2=0x556adb1a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:54:56.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a0420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6470011cd0 tx=0x7f6470014000 comp rx=0 tx=0).stop 2023-03-17T10:54:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 -- 172.21.15.35:0/3123310668 shutdown_connections 2023-03-17T10:54:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3123310668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a0420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 -- 172.21.15.35:0/3123310668 >> 172.21.15.35:0/3123310668 conn(0x556adaffd6b0 msgr2=0x556adb19aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 -- 172.21.15.35:0/3123310668 shutdown_connections 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.147+0000 7f64971fcb80 1 -- 172.21.15.35:0/3123310668 wait complete. 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.148+0000 7f64971fcb80 1 -- start start 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.148+0000 7f64971fcb80 1 Processor -- start 2023-03-17T10:54:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.148+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.148+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.148+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.148+0000 7f64971fcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adaf768c0 con 0x556adb1a5be0 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f64971fcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb1aa4e0 con 0x556adb1a64f0 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f64971fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb1b6000 con 0x556adb1a0960 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f64971fcb80 10 client.0 _ll_register_callbacks cb 0x556adaf98230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:54:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44256/0 (socket says 172.21.15.35:44256) 2023-03-17T10:54:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 -- 172.21.15.35:0/2786716337 learned_addr learned my addr 172.21.15.35:0/2786716337 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:54:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6483fff700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f648960c700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:54:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 -- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 msgr2=0x556adb1a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 -- 172.21.15.35:0/2786716337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 msgr2=0x556adb1a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:54:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:54:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 -- 172.21.15.35:0/2786716337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470017070 con 0x556adb1a0960 2023-03-17T10:54:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f648960c700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:54:59.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6488e0b700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1ac4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6478099440 tx=0x7f6478099740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76681e7301af67f1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.149+0000 7f6463fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:55:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f6463fff700 1 -- 172.21.15.35:0/2786716337 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780a14a0 con 0x556adb1a0960 2023-03-17T10:55:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556adb0b5390 con 0x556adb1a0960 2023-03-17T10:55:00.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f6463fff700 1 -- 172.21.15.35:0/2786716337 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(281..281 src has 1..281) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f64780a1600 con 0x556adb1a0960 2023-03-17T10:55:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f6463fff700 1 -- 172.21.15.35:0/2786716337 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f647809aba0 con 0x556adb1a0960 2023-03-17T10:55:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 10 client.28780 fetch_fsmap learned FSMap version 63 2023-03-17T10:55:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x556adaf20d80 con 0x556adb1a0960 2023-03-17T10:55:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f6463fff700 1 -- 172.21.15.35:0/2786716337 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64780c9030 con 0x556adb1a0960 2023-03-17T10:55:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f6463fff700 1 -- 172.21.15.35:0/2786716337 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7f6478003b60 con 0x556adb1a0960 2023-03-17T10:55:01.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 10 client.28780 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:55:01.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:15 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:55:01.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:16 smithi035 ceph-mon[92535]: pgmap v3815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:55:03.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:16 smithi035 ceph-mon[92535]: osdmap e313: 12 total, 12 up, 12 in 2023-03-17T10:55:03.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:19 smithi035 ceph-mon[92535]: pgmap v3817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T10:55:03.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:20 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T10:55:03.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:21 smithi035 ceph-mon[92535]: pgmap v3818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2023-03-17T10:55:03.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:22 smithi035 ceph-mon[92535]: pgmap v3819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2023-03-17T10:55:03.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:25 smithi035 ceph-mon[92535]: pgmap v3820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2023-03-17T10:55:03.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:27 smithi035 ceph-mon[92535]: pgmap v3821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2023-03-17T10:55:03.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:55:04.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:29 smithi035 ceph-mon[92535]: pgmap v3822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-03-17T10:55:04.075 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: pgmap v3823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: pgmap v3824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: pgmap v3825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:32 smithi035 ceph-mon[92535]: pgmap v3826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:35 smithi035 ceph-mon[92535]: pgmap v3827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:37 smithi035 ceph-mon[92535]: pgmap v3828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:39 smithi035 ceph-mon[92535]: pgmap v3829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:41 smithi035 ceph-mon[92535]: pgmap v3830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:42 smithi035 ceph-mon[92535]: pgmap v3831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:45 smithi035 ceph-mon[92535]: pgmap v3832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:47 smithi035 ceph-mon[92535]: pgmap v3833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:04.076 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:49 smithi035 ceph-mon[92535]: pgmap v3834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:55:04.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:51 smithi035 ceph-mon[92535]: pgmap v3835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:55:04.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:52 smithi035 ceph-mon[92535]: pgmap v3836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:55:04.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:55 smithi035 ceph-mon[92535]: pgmap v3837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:55:04.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:57 smithi035 ceph-mon[92535]: pgmap v3838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:55:04.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:42:59 smithi035 ceph-mon[92535]: pgmap v3839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:01 smithi035 ceph-mon[92535]: pgmap v3840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:02 smithi035 ceph-mon[92535]: pgmap v3841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:05 smithi035 ceph-mon[92535]: pgmap v3842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:07 smithi035 ceph-mon[92535]: pgmap v3843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:09 smithi035 ceph-mon[92535]: pgmap v3844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:10 smithi035 ceph-mon[92535]: osdmap e314: 12 total, 12 up, 12 in 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:11 smithi035 ceph-mon[92535]: pgmap v3846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:55:05.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:12 smithi035 ceph-mon[92535]: pgmap v3847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:55:05.291 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:15 smithi035 ceph-mon[92535]: pgmap v3848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:55:05.291 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:17 smithi035 ceph-mon[92535]: pgmap v3849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:17 smithi035 ceph-mon[92535]: osdmap e315: 12 total, 12 up, 12 in 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:19 smithi035 ceph-mon[92535]: pgmap v3851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 13 op/s 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:21 smithi035 ceph-mon[92535]: pgmap v3852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:22 smithi035 ceph-mon[92535]: pgmap v3853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:25 smithi035 ceph-mon[92535]: pgmap v3854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:27 smithi035 ceph-mon[92535]: pgmap v3855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:55:07.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:29 smithi035 ceph-mon[92535]: pgmap v3856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 90 B/s wr, 14 op/s 2023-03-17T10:55:07.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:31 smithi035 ceph-mon[92535]: pgmap v3857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:07.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:55:07.146 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:55:07.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:55:07.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:55:07.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:32 smithi035 ceph-mon[92535]: pgmap v3858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T10:55:07.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:32 smithi035 ceph-mon[92535]: pgmap v3859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T10:55:08.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:34 smithi035 ceph-mon[92535]: pgmap v3860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:08.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:36 smithi035 ceph-mon[92535]: pgmap v3861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:08.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:37 smithi035 ceph-mon[92535]: pgmap v3862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T10:55:08.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:39 smithi035 ceph-mon[92535]: pgmap v3863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:08.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:41 smithi035 ceph-mon[92535]: pgmap v3864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:55:08.423 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:43 smithi035 ceph-mon[92535]: pgmap v3865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:55:09.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:45 smithi035 ceph-mon[92535]: pgmap v3866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:47 smithi035 ceph-mon[92535]: pgmap v3867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:49 smithi035 ceph-mon[92535]: pgmap v3868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:55:09.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:51 smithi035 ceph-mon[92535]: pgmap v3869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:53 smithi035 ceph-mon[92535]: pgmap v3870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:55 smithi035 ceph-mon[92535]: pgmap v3871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:57 smithi035 ceph-mon[92535]: pgmap v3872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:43:59 smithi035 ceph-mon[92535]: pgmap v3873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:01 smithi035 ceph-mon[92535]: pgmap v3874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:03 smithi035 ceph-mon[92535]: pgmap v3875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:05 smithi035 ceph-mon[92535]: pgmap v3876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:07 smithi035 ceph-mon[92535]: pgmap v3877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:09 smithi035 ceph-mon[92535]: osdmap e316: 12 total, 12 up, 12 in 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:09 smithi035 ceph-mon[92535]: pgmap v3879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:11 smithi035 ceph-mon[92535]: pgmap v3880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:13 smithi035 ceph-mon[92535]: pgmap v3881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:15 smithi035 ceph-mon[92535]: pgmap v3882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:17 smithi035 ceph-mon[92535]: osdmap e317: 12 total, 12 up, 12 in 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:17 smithi035 ceph-mon[92535]: pgmap v3884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 B/s wr, 7 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:19 smithi035 ceph-mon[92535]: pgmap v3885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:55:09.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:21 smithi035 ceph-mon[92535]: pgmap v3886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:23 smithi035 ceph-mon[92535]: pgmap v3887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:25 smithi035 ceph-mon[92535]: pgmap v3888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:27 smithi035 ceph-mon[92535]: pgmap v3889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 100 B/s wr, 11 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:29 smithi035 ceph-mon[92535]: pgmap v3890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:31 smithi035 ceph-mon[92535]: pgmap v3891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:32 smithi035 ceph-mon[92535]: pgmap v3892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:32 smithi035 ceph-mon[92535]: pgmap v3893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T10:55:09.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:34 smithi035 ceph-mon[92535]: pgmap v3894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:10.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:36 smithi035 ceph-mon[92535]: pgmap v3895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:55:10.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:55:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:55:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:55:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:55:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:55:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:55:10.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:55:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:55:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:55:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:55:14.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:55:14.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:55:14.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 10 client.28780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:55:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 20 client.28780 populate_metadata read hostname 'smithi035' 2023-03-17T10:55:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb1ba140 0x556adb1bc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 4 client.28780 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:55:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.150+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556adb0c1600 con 0x556adb1ba140 2023-03-17T10:55:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.151+0000 7f6483fff700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb1ba140 0x556adb1bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.151+0000 7f6463fff700 10 client.28780 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.151+0000 7f6483fff700 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb1ba140 0x556adb1bc550 crc :-1 s=READY pgs=542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f888e26de375ddc server_cookie=715fc0ee45698cfb in_seq=0 out_seq=0 2023-03-17T10:55:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f6463fff700 1 -- 172.21.15.35:0/2786716337 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556adb0c1600 con 0x556adb1ba140 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f6463fff700 10 client.28780 handle_command_reply: tid=0 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 client.28780 shutdown 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 msgr2=0x556adb1ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1ac4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6478099440 tx=0x7f6478099740 comp rx=0 tx=0).stop 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 shutdown_connections 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb1ba140 0x556adb1bc550 crc :-1 s=READY pgs=542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a64f0 0x556adb1a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a0960 0x556adb1ac4c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 --2- 172.21.15.35:0/2786716337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 >> 172.21.15.35:0/2786716337 conn(0x556adaffd6b0 msgr2=0x556adb19f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f6463fff700 0 client.28780 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 shutdown_connections 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.152+0000 7f64971fcb80 1 -- 172.21.15.35:0/2786716337 wait complete. 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.153+0000 7f64971fcb80 20 client.28780 trim_cache size 0 max 16384 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.175+0000 7f64971fcb80 1 Processor -- start 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.175+0000 7f64971fcb80 1 -- start start 2023-03-17T10:55:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.175+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.175+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb1bc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f64971fcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb1a07d0 con 0x556adb1a5be0 2023-03-17T10:55:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f64971fcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb1975c0 con 0x556adb1a0960 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f64971fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb1b7750 con 0x556adb1a64f0 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54294/0 (socket says 172.21.15.35:54294) 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 -- 172.21.15.35:0/3985962108 learned_addr learned my addr 172.21.15.35:0/3985962108 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f648960c700 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb1bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6483fff700 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 -- 172.21.15.35:0/3985962108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 msgr2=0x556adb1bc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb1bc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 -- 172.21.15.35:0/3985962108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 msgr2=0x556adb1a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 -- 172.21.15.35:0/3985962108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556adb0b9130 con 0x556adb1a0960 2023-03-17T10:55:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1b0f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64780c9a20 tx=0x7f6478009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f5f8b6b760e8ac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.176+0000 7f646f7fe700 1 -- 172.21.15.35:0/3985962108 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478003b60 con 0x556adb1a0960 2023-03-17T10:55:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.177+0000 7f646f7fe700 1 -- 172.21.15.35:0/3985962108 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64780c9040 con 0x556adb1a0960 2023-03-17T10:55:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.177+0000 7f646f7fe700 1 -- 172.21.15.35:0/3985962108 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647800ba80 con 0x556adb1a0960 2023-03-17T10:55:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.177+0000 7f64971fcb80 1 -- 172.21.15.35:0/3985962108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 msgr2=0x556adb1b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.177+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1b0f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64780c9a20 tx=0x7f6478009940 comp rx=0 tx=0).stop 2023-03-17T10:55:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 -- 172.21.15.35:0/3985962108 shutdown_connections 2023-03-17T10:55:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb1bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1b0f50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3985962108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 -- 172.21.15.35:0/3985962108 >> 172.21.15.35:0/3985962108 conn(0x556adaffd6b0 msgr2=0x556adb19fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 -- 172.21.15.35:0/3985962108 shutdown_connections 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 -- 172.21.15.35:0/3985962108 wait complete. 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 -- start start 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.178+0000 7f64971fcb80 1 Processor -- start 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb206fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:19.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb207520 con 0x556adb1a5be0 2023-03-17T10:55:19.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb207690 con 0x556adb1a0960 2023-03-17T10:55:19.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556adb207850 con 0x556adb1a64f0 2023-03-17T10:55:19.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f64971fcb80 10 client.0 _ll_register_callbacks cb 0x556adaf98230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:55:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54300/0 (socket says 172.21.15.35:54300) 2023-03-17T10:55:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 -- 172.21.15.35:0/3448252864 learned_addr learned my addr 172.21.15.35:0/3448252864 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f648960c700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb206fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6483fff700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 -- 172.21.15.35:0/3448252864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 msgr2=0x556adb206fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:21.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb206fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 -- 172.21.15.35:0/3448252864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 msgr2=0x556adb1af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 -- 172.21.15.35:0/3448252864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556adaf20d80 con 0x556adb1a0960 2023-03-17T10:55:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f648960c700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb206fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6483fff700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:55:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6488e0b700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1af120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f64780954c0 tx=0x7f64780a14a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c120435f55d06d0c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.179+0000 7f6463fff700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:55:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f6463fff700 1 -- 172.21.15.35:0/3448252864 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647809ada0 con 0x556adb1a0960 2023-03-17T10:55:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556adb1701e0 con 0x556adb1a0960 2023-03-17T10:55:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f6463fff700 1 -- 172.21.15.35:0/3448252864 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(281..281 src has 1..281) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f64780c9b70 con 0x556adb1a0960 2023-03-17T10:55:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f6463fff700 1 -- 172.21.15.35:0/3448252864 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64780c9d70 con 0x556adb1a0960 2023-03-17T10:55:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 10 client.28808 fetch_fsmap learned FSMap version 63 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x556adaf471f0 con 0x556adb1a0960 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f6463fff700 1 -- 172.21.15.35:0/3448252864 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556adb1701e0 con 0x556adb1a0960 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f6463fff700 1 -- 172.21.15.35:0/3448252864 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7f6478095530 con 0x556adb1a0960 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 10 client.28808 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 10 client.28808 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 20 client.28808 populate_metadata read hostname 'smithi035' 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb20eba0 0x556adb210f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:24.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 4 client.28808 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:55:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556adaf76f00 con 0x556adb20eba0 2023-03-17T10:55:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.180+0000 7f6483fff700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb20eba0 0x556adb210f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.181+0000 7f6463fff700 10 client.28808 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.181+0000 7f6483fff700 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb20eba0 0x556adb210f80 crc :-1 s=READY pgs=543 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f5d79b5064e87cc server_cookie=51bdf8fa5753825b in_seq=0 out_seq=0 2023-03-17T10:55:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f6463fff700 1 -- 172.21.15.35:0/3448252864 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556adaf76f00 con 0x556adb20eba0 2023-03-17T10:55:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f6463fff700 10 client.28808 handle_command_reply: tid=0 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 client.28808 shutdown 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 msgr2=0x556adb1af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1af120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f64780954c0 tx=0x7f64780a14a0 comp rx=0 tx=0).stop 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 shutdown_connections 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556adb20eba0 0x556adb210f80 crc :-1 s=READY pgs=543 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556adb1a64f0 0x556adb206fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556adb1a0960 0x556adb1af120 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f6463fff700 0 client.28808 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 --2- 172.21.15.35:0/3448252864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556adb1a5be0 0x556adb1af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 >> 172.21.15.35:0/3448252864 conn(0x556adaffd6b0 msgr2=0x556adb1bc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 shutdown_connections 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 1 -- 172.21.15.35:0/3448252864 wait complete. 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.228+0000 7f64971fcb80 20 client.28808 trim_cache size 0 max 16384 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647409f640 msgr2=0x7f64740a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647409f640 0x7f64740a1af0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6484196980 tx=0x7f6470009260 comp rx=0 tx=0).stop 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 msgr2=0x7f6484195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 0x7f6484195370 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f647800ec40 tx=0x7f647800ef50 comp rx=0 tx=0).stop 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 shutdown_connections 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f647409f640 0x7f64740a1af0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6484104400 0x7f6484199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f64840ff3c0 0x7f6484195370 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 --2- 172.21.15.35:0/1844244372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64840ffd60 0x7f64841958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 >> 172.21.15.35:0/1844244372 conn(0x7f6484076300 msgr2=0x7f64840fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 shutdown_connections 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:08.229+0000 7f648b06f700 1 -- 172.21.15.35:0/1844244372 wait complete. 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 -- 172.21.15.35:0/4274817127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 msgr2=0x7f9af40fecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 --2- 172.21.15.35:0/4274817127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 0x7f9af40fecc0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4009990 tx=0x7f9ae4009ca0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 -- 172.21.15.35:0/4274817127 shutdown_connections 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 --2- 172.21.15.35:0/4274817127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af40ff200 0x7f9af410b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 --2- 172.21.15.35:0/4274817127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af4104860 0x7f9af4104c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 --2- 172.21.15.35:0/4274817127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 0x7f9af40fecc0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 -- 172.21.15.35:0/4274817127 >> 172.21.15.35:0/4274817127 conn(0x7f9af40757a0 msgr2=0x7f9af4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 -- 172.21.15.35:0/4274817127 shutdown_connections 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.383+0000 7f9afb980700 1 -- 172.21.15.35:0/4274817127 wait complete. 2023-03-17T10:55:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 Processor -- start 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 -- start start 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 0x7f9af4196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 0x7f9af41966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af4104860 0x7f9af419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419b160 con 0x7f9af40fe850 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419b2d0 con 0x7f9af4104860 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9afb980700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af419b490 con 0x7f9af40ff200 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9af8f1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 0x7f9af41966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af4104860 0x7f9af419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9af8f1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 0x7f9af41966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44286/0 (socket says 172.21.15.35:44286) 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9af8f1b700 1 -- 172.21.15.35:0/1035078788 learned_addr learned my addr 172.21.15.35:0/1035078788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.384+0000 7f9af971c700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 0x7f9af4196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af8f1b700 1 -- 172.21.15.35:0/1035078788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af4104860 msgr2=0x7f9af419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af4104860 0x7f9af419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af8f1b700 1 -- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 msgr2=0x7f9af4196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 0x7f9af4196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af8f1b700 1 -- 172.21.15.35:0/1035078788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40095f0 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af4104860 0x7f9af419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 0x7f9af41966c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4000c00 tx=0x7f9ae4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9aea7fc700 1 -- 172.21.15.35:0/1035078788 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae401d070 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af410df60 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af410ddd0 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9aea7fc700 1 -- 172.21.15.35:0/1035078788 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ae4022470 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.385+0000 7f9aea7fc700 1 -- 172.21.15.35:0/1035078788 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4017650 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.388+0000 7f9aea7fc700 1 -- 172.21.15.35:0/1035078788 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9ae400fac0 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.388+0000 7f9aea7fc700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ae00a3a50 0x7f9ae00a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.389+0000 7f9aea7fc700 1 -- 172.21.15.35:0/1035078788 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9ae40cb980 con 0x7f9af40ff200 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.389+0000 7f9af971c700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ae00a3a50 0x7f9ae00a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.390+0000 7f9af971c700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ae00a3a50 0x7f9ae00a5f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9af40ff990 tx=0x7f9af0010040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.390+0000 7f9b07b0db80 1 Processor -- start 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.390+0000 7f9b07b0db80 1 -- start start 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fc89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fdec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:32.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:38 smithi035 ceph-mon[92535]: pgmap v3896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fdf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45ecf010 con 0x559c45fc8f20 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45f21950 con 0x559c45fc8610 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45f1ade0 con 0x559c45fdf160 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fdf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af8f1b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fdec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fdf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44294/0 (socket says 172.21.15.35:44294) 2023-03-17T10:55:34.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 -- 172.21.15.35:0/1855987560 learned_addr learned my addr 172.21.15.35:0/1855987560 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af8f1b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fdec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52530/0 (socket says 172.21.15.35:52530) 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af971c700 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fc89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 -- 172.21.15.35:0/1855987560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 msgr2=0x559c45fc89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fc89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 -- 172.21.15.35:0/1855987560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 msgr2=0x559c45fdec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fdec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af9f1d700 1 -- 172.21.15.35:0/1855987560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c45d9c5d0 con 0x559c45fdf160 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.391+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fdec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.392+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fdf590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9aec003eb0 tx=0x7f9aec009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6426fc78e6a1de6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:34.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.392+0000 7f9adf7fe700 1 -- 172.21.15.35:0/1855987560 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0092d0 con 0x559c45fdf160 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.392+0000 7f9adf7fe700 1 -- 172.21.15.35:0/1855987560 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aec00f040 con 0x559c45fdf160 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.392+0000 7f9adf7fe700 1 -- 172.21.15.35:0/1855987560 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00e730 con 0x559c45fdf160 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 -- 172.21.15.35:0/1855987560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 msgr2=0x559c45fdf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fdf590 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9aec003eb0 tx=0x7f9aec009920 comp rx=0 tx=0).stop 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 -- 172.21.15.35:0/1855987560 shutdown_connections 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fdf590 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fc89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/1855987560 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fdec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 -- 172.21.15.35:0/1855987560 >> 172.21.15.35:0/1855987560 conn(0x559c45e256b0 msgr2=0x559c45fc2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 -- 172.21.15.35:0/1855987560 shutdown_connections 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 -- 172.21.15.35:0/1855987560 wait complete. 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 -- start start 2023-03-17T10:55:35.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.393+0000 7f9b07b0db80 1 Processor -- start 2023-03-17T10:55:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fe56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fe29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fe2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:35.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45d9e8c0 con 0x559c45fc8f20 2023-03-17T10:55:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45fe3750 con 0x559c45fc8610 2023-03-17T10:55:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45fef270 con 0x559c45fdf160 2023-03-17T10:55:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9b07b0db80 10 client.0 _ll_register_callbacks cb 0x559c45dc0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:55:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fe2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fe56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:37.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fe56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54328/0 (socket says 172.21.15.35:54328) 2023-03-17T10:55:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af8f1b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fe29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 -- 172.21.15.35:0/3763600220 learned_addr learned my addr 172.21.15.35:0/3763600220 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 -- 172.21.15.35:0/3763600220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 msgr2=0x559c45fe2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fe2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 -- 172.21.15.35:0/3763600220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 msgr2=0x559c45fe29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fe29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af971c700 1 -- 172.21.15.35:0/3763600220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec003b90 con 0x559c45fc8610 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.394+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fe2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9af971c700 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fe56e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9af001bc10 tx=0x7f9af00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91d039abb3b5cf2f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9adcff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9adcff9700 1 -- 172.21.15.35:0/3763600220 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0029070 con 0x559c45fc8610 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9adcff9700 1 -- 172.21.15.35:0/3763600220 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9af001b0d0 con 0x559c45fc8610 2023-03-17T10:55:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c45edd390 con 0x559c45fc8610 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9adcff9700 1 -- 172.21.15.35:0/3763600220 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af0020050 con 0x559c45fc8610 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9b07b0db80 10 client.28820 fetch_fsmap learned FSMap version 63 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x559c45d48d80 con 0x559c45fc8610 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9adcff9700 1 -- 172.21.15.35:0/3763600220 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559c45edd390 con 0x559c45fc8610 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9adcff9700 1 -- 172.21.15.35:0/3763600220 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7f9af002c020 con 0x559c45fc8610 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9b07b0db80 10 client.28820 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.395+0000 7f9b07b0db80 10 client.28820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9b07b0db80 20 client.28820 populate_metadata read hostname 'smithi035' 2023-03-17T10:55:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c45ff3480 0x559c45ff5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9b07b0db80 4 client.28820 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c45ee9600 con 0x559c45ff3480 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c45ff3480 0x559c45ff5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c45ff3480 0x559c45ff5890 crc :-1 s=READY pgs=544 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3047397868cdd4 server_cookie=e42d1855088043c2 in_seq=0 out_seq=0 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.396+0000 7f9adcff9700 10 client.28820 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9adcff9700 1 -- 172.21.15.35:0/3763600220 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559c45ee9600 con 0x559c45ff3480 2023-03-17T10:55:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9adcff9700 10 client.28820 handle_command_reply: tid=0 2023-03-17T10:55:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 client.28820 shutdown 2023-03-17T10:55:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 msgr2=0x559c45fe56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fe56e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9af001bc10 tx=0x7f9af00047c0 comp rx=0 tx=0).stop 2023-03-17T10:55:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 shutdown_connections 2023-03-17T10:55:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c45ff3480 0x559c45ff5890 crc :-1 s=READY pgs=544 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fdf160 0x559c45fe2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9adcff9700 0 client.28820 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8610 0x559c45fe56e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3763600220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8f20 0x559c45fe29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.397+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 >> 172.21.15.35:0/3763600220 conn(0x559c45e256b0 msgr2=0x559c45fc2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.398+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 shutdown_connections 2023-03-17T10:55:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.398+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3763600220 wait complete. 2023-03-17T10:55:50.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.398+0000 7f9b07b0db80 20 client.28820 trim_cache size 0 max 16384 2023-03-17T10:55:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.419+0000 7f9b07b0db80 1 Processor -- start 2023-03-17T10:55:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 -- start start 2023-03-17T10:55:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8610 0x559c45fe0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8f20 0x559c45fcd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 0x559c45fe5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45fbe120 con 0x559c45fdf160 2023-03-17T10:55:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45fc3ba0 con 0x559c45fc8f20 2023-03-17T10:55:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c45fbfb60 con 0x559c45fc8610 2023-03-17T10:55:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 0x559c45fe5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 0x559c45fe5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52542/0 (socket says 172.21.15.35:52542) 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3295827760 learned_addr learned my addr 172.21.15.35:0/3295827760 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af971c700 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8610 0x559c45fe0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8f20 0x559c45fcd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3295827760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8610 msgr2=0x559c45fe0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8610 0x559c45fe0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3295827760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8f20 msgr2=0x559c45fcd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8f20 0x559c45fcd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3295827760 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c45ee1130 con 0x559c45fdf160 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.420+0000 7f9af971c700 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8610 0x559c45fe0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.421+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 0x559c45fe5280 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9aec01a000 tx=0x7f9aec003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b892fd3a9214eced server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.421+0000 7f9adffff700 1 -- 172.21.15.35:0/3295827760 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec007ea0 con 0x559c45fdf160 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.421+0000 7f9adffff700 1 -- 172.21.15.35:0/3295827760 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aec004c20 con 0x559c45fdf160 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.421+0000 7f9adffff700 1 -- 172.21.15.35:0/3295827760 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00e730 con 0x559c45fdf160 2023-03-17T10:55:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3295827760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 msgr2=0x559c45fe5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 0x559c45fe5280 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9aec01a000 tx=0x7f9aec003ab0 comp rx=0 tx=0).stop 2023-03-17T10:55:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3295827760 shutdown_connections 2023-03-17T10:55:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fdf160 0x559c45fe5280 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8610 0x559c45fe0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3295827760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fc8f20 0x559c45fcd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3295827760 >> 172.21.15.35:0/3295827760 conn(0x559c45e256b0 msgr2=0x559c45fccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3295827760 shutdown_connections 2023-03-17T10:55:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3295827760 wait complete. 2023-03-17T10:55:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 -- start start 2023-03-17T10:55:54.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.422+0000 7f9b07b0db80 1 Processor -- start 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 0x559c45fe8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8f20 0x559c45fe88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fdf160 0x559c46046320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c46046860 con 0x559c45fc8610 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c460469a0 con 0x559c45fdf160 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c46046ae0 con 0x559c45fc8f20 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9b07b0db80 10 client.0 _ll_register_callbacks cb 0x559c45dc0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9af971c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 0x559c45fe8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9af9f1d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fdf160 0x559c46046320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9af971c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 0x559c45fe8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52544/0 (socket says 172.21.15.35:52544) 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9af971c700 1 -- 172.21.15.35:0/3064181664 learned_addr learned my addr 172.21.15.35:0/3064181664 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.423+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8f20 0x559c45fe88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3064181664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8f20 msgr2=0x559c45fe88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8f20 0x559c45fe88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3064181664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 msgr2=0x559c45fe8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 0x559c45fe8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af9f1d700 1 -- 172.21.15.35:0/3064181664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c45d48d80 con 0x559c45fdf160 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af8f1b700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8f20 0x559c45fe88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af971c700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 0x559c45fe8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9af9f1d700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fdf160 0x559c46046320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x559c45ffa910 tx=0x7f9aec007b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e1b983b531046 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9adcff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9adcff9700 1 -- 172.21.15.35:0/3064181664 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00e700 con 0x559c45fdf160 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9adcff9700 1 -- 172.21.15.35:0/3064181664 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9aec00e860 con 0x559c45fdf160 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c45f981e0 con 0x559c45fdf160 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9adcff9700 1 -- 172.21.15.35:0/3064181664 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aec00ea40 con 0x559c45fdf160 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9b07b0db80 10 client.28826 fetch_fsmap learned FSMap version 63 2023-03-17T10:55:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.424+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x559c45d9c5d0 con 0x559c45fdf160 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9adcff9700 1 -- 172.21.15.35:0/3064181664 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559c45f981e0 con 0x559c45fdf160 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9adcff9700 1 -- 172.21.15.35:0/3064181664 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7f9aec0274f0 con 0x559c45fdf160 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9b07b0db80 10 client.28826 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9b07b0db80 10 client.28826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9b07b0db80 20 client.28826 populate_metadata read hostname 'smithi035' 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c46048120 0x559c4604a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9b07b0db80 4 client.28826 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c45d9ef00 con 0x559c46048120 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.425+0000 7f9af971c700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c46048120 0x559c4604a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.426+0000 7f9af971c700 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c46048120 0x559c4604a530 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1d79b949cf3b038 server_cookie=fbb1318c6d970c6c in_seq=0 out_seq=0 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.426+0000 7f9adcff9700 10 client.28826 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.478+0000 7f9adcff9700 1 -- 172.21.15.35:0/3064181664 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c45d9ef00 con 0x559c46048120 2023-03-17T10:55:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.478+0000 7f9adcff9700 10 client.28826 handle_command_reply: tid=0 2023-03-17T10:55:55.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.478+0000 7f9b07b0db80 1 client.28826 shutdown 2023-03-17T10:55:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.478+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fdf160 msgr2=0x559c46046320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.478+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fdf160 0x559c46046320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x559c45ffa910 tx=0x7f9aec007b60 comp rx=0 tx=0).stop 2023-03-17T10:55:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 shutdown_connections 2023-03-17T10:55:56.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:40 smithi035 ceph-mon[92535]: pgmap v3897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559c46048120 0x559c4604a530 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559c45fdf160 0x559c46046320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559c45fc8610 0x559c45fe8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 --2- 172.21.15.35:0/3064181664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c45fc8f20 0x559c45fe88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9adcff9700 0 client.28826 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 >> 172.21.15.35:0/3064181664 conn(0x559c45e256b0 msgr2=0x559c45fcd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 shutdown_connections 2023-03-17T10:55:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 1 -- 172.21.15.35:0/3064181664 wait complete. 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9b07b0db80 20 client.28826 trim_cache size 0 max 16384 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ae00a3a50 msgr2=0x7f9ae00a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9afb980700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ae00a3a50 0x7f9ae00a5f00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9af40ff990 tx=0x7f9af0010040 comp rx=0 tx=0).stop 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 msgr2=0x7f9af41966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.479+0000 7f9afb980700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 0x7f9af41966c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4000c00 tx=0x7f9ae4004730 comp rx=0 tx=0).stop 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 shutdown_connections 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ae00a3a50 0x7f9ae00a5f00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9af4104860 0x7f9af419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9af40fe850 0x7f9af4196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 --2- 172.21.15.35:0/1035078788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9af40ff200 0x7f9af41966c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 >> 172.21.15.35:0/1035078788 conn(0x7f9af40757a0 msgr2=0x7f9af40fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 shutdown_connections 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:21.480+0000 7f9afb980700 1 -- 172.21.15.35:0/1035078788 wait complete. 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 -- 172.21.15.35:0/2415749494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940fe970 msgr2=0x7fa1940fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 --2- 172.21.15.35:0/2415749494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940fe970 0x7fa1940fed40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa184009920 tx=0x7fa184009c30 comp rx=0 tx=0).stop 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 -- 172.21.15.35:0/2415749494 shutdown_connections 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 --2- 172.21.15.35:0/2415749494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa194105510 0x7fa19410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 --2- 172.21.15.35:0/2415749494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940fe970 0x7fa1940fed40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 --2- 172.21.15.35:0/2415749494 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa1940ff310 0x7fa194104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 -- 172.21.15.35:0/2415749494 >> 172.21.15.35:0/2415749494 conn(0x7fa1940757a0 msgr2=0x7fa194075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 -- 172.21.15.35:0/2415749494 shutdown_connections 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.635+0000 7fa199129700 1 -- 172.21.15.35:0/2415749494 wait complete. 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 Processor -- start 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 -- start start 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 0x7fa194196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940ff310 0x7fa194196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa194105510 0x7fa19419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419b2f0 con 0x7fa194105510 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419b460 con 0x7fa1940fe970 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa199129700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419b620 con 0x7fa1940ff310 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa19359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa194105510 0x7fa19419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 0x7fa194196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa19359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa194105510 0x7fa19419acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52562/0 (socket says 172.21.15.35:52562) 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 0x7fa194196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54354/0 (socket says 172.21.15.35:54354) 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa19359e700 1 -- 172.21.15.35:0/2529486589 learned_addr learned my addr 172.21.15.35:0/2529486589 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.636+0000 7fa19259c700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940ff310 0x7fa194196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa192d9d700 1 -- 172.21.15.35:0/2529486589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940ff310 msgr2=0x7fa194196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940ff310 0x7fa194196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa192d9d700 1 -- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa194105510 msgr2=0x7fa19419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa194105510 0x7fa19419acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa192d9d700 1 -- 172.21.15.35:0/2529486589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184009520 con 0x7fa1940fe970 2023-03-17T10:55:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa19259c700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940ff310 0x7fa194196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:56:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 0x7fa194196310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa18400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa17bfff700 1 -- 172.21.15.35:0/2529486589 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18401c070 con 0x7fa1940fe970 2023-03-17T10:56:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa17bfff700 1 -- 172.21.15.35:0/2529486589 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa18400ba70 con 0x7fa1940fe970 2023-03-17T10:56:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa194110180 con 0x7fa1940fe970 2023-03-17T10:56:00.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa17bfff700 1 -- 172.21.15.35:0/2529486589 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840046d0 con 0x7fa1940fe970 2023-03-17T10:56:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.637+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19410fff0 con 0x7fa1940fe970 2023-03-17T10:56:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.640+0000 7fa17bfff700 1 -- 172.21.15.35:0/2529486589 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa184020070 con 0x7fa1940fe970 2023-03-17T10:56:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.641+0000 7fa17bfff700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa17c09f640 0x7fa17c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:01.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.641+0000 7fa19259c700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa17c09f640 0x7fa17c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.641+0000 7fa17bfff700 1 -- 172.21.15.35:0/2529486589 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa1840cb200 con 0x7fa1940fe970 2023-03-17T10:56:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.641+0000 7fa19259c700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa17c09f640 0x7fa17c0a1af0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa194197920 tx=0x7fa188009310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 Processor -- start 2023-03-17T10:56:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 -- start start 2023-03-17T10:56:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:04.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128dc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:04.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a127e3010 con 0x562a128e24f0 2023-03-17T10:56:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a12835950 con 0x562a128e1be0 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1282ede0 con 0x562a128dc960 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128e1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54362/0 (socket says 172.21.15.35:54362) 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 -- 172.21.15.35:0/4024205614 learned_addr learned my addr 172.21.15.35:0/4024205614 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa19259c700 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa19359e700 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 -- 172.21.15.35:0/4024205614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 msgr2=0x562a128dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 -- 172.21.15.35:0/4024205614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 msgr2=0x562a128dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128dc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa192d9d700 1 -- 172.21.15.35:0/4024205614 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a126b05d0 con 0x562a128e1be0 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.642+0000 7fa19259c700 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.643+0000 7fa192d9d700 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128e1fb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1840957b0 tx=0x7fa1840986a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8531bfb0f5af5f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.643+0000 7fa1797fa700 1 -- 172.21.15.35:0/4024205614 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840c8c10 con 0x562a128e1be0 2023-03-17T10:56:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.643+0000 7fa1797fa700 1 -- 172.21.15.35:0/4024205614 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1840cb070 con 0x562a128e1be0 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.643+0000 7fa1797fa700 1 -- 172.21.15.35:0/4024205614 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184098490 con 0x562a128e1be0 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/4024205614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 msgr2=0x562a128e1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128e1fb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1840957b0 tx=0x7fa1840986a0 comp rx=0 tx=0).stop 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/4024205614 shutdown_connections 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128e1fb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/4024205614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/4024205614 >> 172.21.15.35:0/4024205614 conn(0x562a127396b0 msgr2=0x562a128d6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/4024205614 shutdown_connections 2023-03-17T10:56:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/4024205614 wait complete. 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 -- start start 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.644+0000 7fa1a52b6b80 1 Processor -- start 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128e8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e1be0 0x562a128e5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e24f0 0x562a128e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a126b28c0 con 0x562a128e1be0 2023-03-17T10:56:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a128e63a0 con 0x562a128e24f0 2023-03-17T10:56:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a128fa500 con 0x562a128dc960 2023-03-17T10:56:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa1a52b6b80 10 client.0 _ll_register_callbacks cb 0x562a126d4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:56:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128e8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44338/0 (socket says 172.21.15.35:44338) 2023-03-17T10:56:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 -- 172.21.15.35:0/2697871383 learned_addr learned my addr 172.21.15.35:0/2697871383 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa19259c700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e1be0 0x562a128e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa19359e700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e24f0 0x562a128e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 -- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e24f0 msgr2=0x562a128e5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e24f0 0x562a128e5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 -- 172.21.15.35:0/2697871383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e1be0 msgr2=0x562a128e5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e1be0 0x562a128e5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 -- 172.21.15.35:0/2697871383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19410fff0 con 0x562a128dc960 2023-03-17T10:56:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128e8470 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa184098cd0 tx=0x7fa184005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17a1e1c92b55baa4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.645+0000 7fa176ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa176ff5700 1 -- 172.21.15.35:0/2697871383 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840c8070 con 0x562a128dc960 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa176ff5700 1 -- 172.21.15.35:0/2697871383 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa1840991a0 con 0x562a128dc960 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a127f1390 con 0x562a128dc960 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa176ff5700 1 -- 172.21.15.35:0/2697871383 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa184098500 con 0x562a128dc960 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 10 client.28816 fetch_fsmap learned FSMap version 63 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x562a1265cd80 con 0x562a128dc960 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa176ff5700 1 -- 172.21.15.35:0/2697871383 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a127f1390 con 0x562a128dc960 2023-03-17T10:56:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa176ff5700 1 -- 172.21.15.35:0/2697871383 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fa184097ca0 con 0x562a128dc960 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 10 client.28816 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 10 client.28816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 20 client.28816 populate_metadata read hostname 'smithi035' 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a128fe140 0x562a12900550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 4 client.28816 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a127fd600 con 0x562a128fe140 2023-03-17T10:56:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.646+0000 7fa19259c700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a128fe140 0x562a12900550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.647+0000 7fa176ff5700 10 client.28816 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.647+0000 7fa19259c700 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a128fe140 0x562a12900550 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5a9308376d9fb5 server_cookie=140d2d2609e9d534 in_seq=0 out_seq=0 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa176ff5700 1 -- 172.21.15.35:0/2697871383 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562a127fd600 con 0x562a128fe140 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa176ff5700 10 client.28816 handle_command_reply: tid=0 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 client.28816 shutdown 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 msgr2=0x562a128e8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128e8470 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa184098cd0 tx=0x7fa184005850 comp rx=0 tx=0).stop 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 shutdown_connections 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a128fe140 0x562a12900550 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e24f0 0x562a128e5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa176ff5700 0 client.28816 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128e8470 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2697871383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e1be0 0x562a128e5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 >> 172.21.15.35:0/2697871383 conn(0x562a127396b0 msgr2=0x562a128db410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.648+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 shutdown_connections 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.649+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2697871383 wait complete. 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.649+0000 7fa1a52b6b80 20 client.28816 trim_cache size 0 max 16384 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.672+0000 7fa1a52b6b80 1 Processor -- start 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.672+0000 7fa1a52b6b80 1 -- start start 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 0x562a128d6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 0x562a128f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a128d20f0 con 0x562a128e24f0 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a128d7b70 con 0x562a128dc960 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a128d35c0 con 0x562a128e1be0 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa19359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 0x562a128d6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa19259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 0x562a128f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 0x562a128d6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54376/0 (socket says 172.21.15.35:54376) 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa19359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52584/0 (socket says 172.21.15.35:52584) 2023-03-17T10:56:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 -- 172.21.15.35:0/2846830868 learned_addr learned my addr 172.21.15.35:0/2846830868 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:18.948 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:42 smithi035 ceph-mon[92535]: pgmap v3898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:56:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa19259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 0x562a128f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44348/0 (socket says 172.21.15.35:44348) 2023-03-17T10:56:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 -- 172.21.15.35:0/2846830868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 msgr2=0x562a128f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 0x562a128f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 -- 172.21.15.35:0/2846830868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 msgr2=0x562a128f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa192d9d700 1 -- 172.21.15.35:0/2846830868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a128dd040 con 0x562a128dc960 2023-03-17T10:56:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.673+0000 7fa19259c700 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 0x562a128f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.674+0000 7fa192d9d700 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 0x562a128d6ac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa184097090 tx=0x7fa1840986a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a71729e129fabd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.674+0000 7fa179ffb700 1 -- 172.21.15.35:0/2846830868 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840c8040 con 0x562a128dc960 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.674+0000 7fa179ffb700 1 -- 172.21.15.35:0/2846830868 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1840cb040 con 0x562a128dc960 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.674+0000 7fa179ffb700 1 -- 172.21.15.35:0/2846830868 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840a0a10 con 0x562a128dc960 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2846830868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 msgr2=0x562a128d6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 0x562a128d6ac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa184097090 tx=0x7fa1840986a0 comp rx=0 tx=0).stop 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2846830868 shutdown_connections 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128dc960 0x562a128d6ac0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/2846830868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128e1be0 0x562a128f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2846830868 >> 172.21.15.35:0/2846830868 conn(0x562a127396b0 msgr2=0x562a128d8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2846830868 shutdown_connections 2023-03-17T10:56:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/2846830868 wait complete. 2023-03-17T10:56:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 -- start start 2023-03-17T10:56:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.675+0000 7fa1a52b6b80 1 Processor -- start 2023-03-17T10:56:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a12951110 con 0x562a128e24f0 2023-03-17T10:56:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a12951280 con 0x562a128e1be0 2023-03-17T10:56:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a12951440 con 0x562a128dc960 2023-03-17T10:56:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa1a52b6b80 10 client.0 _ll_register_callbacks cb 0x562a126d4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:56:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa19359e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44352/0 (socket says 172.21.15.35:44352) 2023-03-17T10:56:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 -- 172.21.15.35:0/392221239 learned_addr learned my addr 172.21.15.35:0/392221239 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa19259c700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 -- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 msgr2=0x562a128f39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128f39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 -- 172.21.15.35:0/392221239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 msgr2=0x562a128f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa192d9d700 1 -- 172.21.15.35:0/392221239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa188017070 con 0x562a128dc960 2023-03-17T10:56:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.676+0000 7fa19359e700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:56:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa192d9d700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128f34b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa184098cd0 tx=0x7fa184005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9b873f9b2f72c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa176ff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa176ff5700 1 -- 172.21.15.35:0/392221239 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840c8040 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa176ff5700 1 -- 172.21.15.35:0/392221239 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa184064060 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a128ac1e0 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa176ff5700 1 -- 172.21.15.35:0/392221239 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa184098500 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 10 client.28822 fetch_fsmap learned FSMap version 63 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x562a1265cd80 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa176ff5700 1 -- 172.21.15.35:0/392221239 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a128ac1e0 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa176ff5700 1 -- 172.21.15.35:0/392221239 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 63) v1 ==== 6969+0+0 (secure 0 0 0) 0x7fa18400b680 con 0x562a128dc960 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 10 client.28822 fetch_fsmap finished waiting for FSMap version 63 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 10 client.28822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 20 client.28822 populate_metadata read hostname 'smithi035' 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a12952660 0x562a12954a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 4 client.28822 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.677+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a126b2f00 con 0x562a12952660 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.678+0000 7fa19259c700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a12952660 0x562a12954a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.678+0000 7fa176ff5700 10 client.28822 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.678+0000 7fa19259c700 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a12952660 0x562a12954a40 crc :-1 s=READY pgs=547 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e68a294c57159294 server_cookie=1f2d4b68b0aee8fc in_seq=0 out_seq=0 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa176ff5700 1 -- 172.21.15.35:0/392221239 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a126b2f00 con 0x562a12952660 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa176ff5700 10 client.28822 handle_command_reply: tid=0 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa1a52b6b80 1 client.28822 shutdown 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 msgr2=0x562a128f34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128f34b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa184098cd0 tx=0x7fa184005de0 comp rx=0 tx=0).stop 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 shutdown_connections 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a12952660 0x562a12954a40 crc :-1 s=READY pgs=547 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa176ff5700 0 client.28822 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.725+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a128e24f0 0x562a128f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.726+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a128dc960 0x562a128f34b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.726+0000 7fa1a52b6b80 1 --2- 172.21.15.35:0/392221239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a128e1be0 0x562a128f39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.726+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 >> 172.21.15.35:0/392221239 conn(0x562a127396b0 msgr2=0x562a128f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.726+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 shutdown_connections 2023-03-17T10:56:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.726+0000 7fa1a52b6b80 1 -- 172.21.15.35:0/392221239 wait complete. 2023-03-17T10:56:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.726+0000 7fa1a52b6b80 20 client.28822 trim_cache size 0 max 16384 2023-03-17T10:56:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa17c09f640 msgr2=0x7fa17c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa17c09f640 0x7fa17c0a1af0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa194197920 tx=0x7fa188009310 comp rx=0 tx=0).stop 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 msgr2=0x7fa194196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 0x7fa194196310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa18400fa00 comp rx=0 tx=0).stop 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 shutdown_connections 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa17c09f640 0x7fa17c0a1af0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa194105510 0x7fa19419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1940fe970 0x7fa194196310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 --2- 172.21.15.35:0/2529486589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1940ff310 0x7fa194196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.727+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 >> 172.21.15.35:0/2529486589 conn(0x7fa1940757a0 msgr2=0x7fa1940fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.728+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 shutdown_connections 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:34.729+0000 7fa199129700 1 -- 172.21.15.35:0/2529486589 wait complete. 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 -- 172.21.15.35:0/2855627048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ff3b0 msgr2=0x7f55440ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 --2- 172.21.15.35:0/2855627048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ff3b0 0x7f55440ff780 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5534009990 tx=0x7f5534009ca0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 -- 172.21.15.35:0/2855627048 shutdown_connections 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 --2- 172.21.15.35:0/2855627048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441043f0 0x7f5544069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 --2- 172.21.15.35:0/2855627048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ff3b0 0x7f55440ff780 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 --2- 172.21.15.35:0/2855627048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55440ffd50 0x7f5544103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 -- 172.21.15.35:0/2855627048 >> 172.21.15.35:0/2855627048 conn(0x7f55440762d0 msgr2=0x7f55440766d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 -- 172.21.15.35:0/2855627048 shutdown_connections 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.898+0000 7f55499f5700 1 -- 172.21.15.35:0/2855627048 wait complete. 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 Processor -- start 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 -- start start 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 0x7f5544198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ffd50 0x7f5544198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441043f0 0x7f554419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554419d510 con 0x7f55440ffd50 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554419d680 con 0x7f55441043f0 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55499f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554419d840 con 0x7f55440ff3b0 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 0x7f5544198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.899+0000 7f55427fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ffd50 0x7f5544198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441043f0 0x7f554419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 0x7f5544198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44366/0 (socket says 172.21.15.35:44366) 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f5542ffd700 1 -- 172.21.15.35:0/3397294104 learned_addr learned my addr 172.21.15.35:0/3397294104 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55427fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ffd50 0x7f5544198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52604/0 (socket says 172.21.15.35:52604) 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 -- 172.21.15.35:0/3397294104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 msgr2=0x7f5544198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 0x7f5544198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 -- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ffd50 msgr2=0x7f5544198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ffd50 0x7f5544198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 -- 172.21.15.35:0/3397294104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340095f0 con 0x7f55441043f0 2023-03-17T10:56:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 0x7f5544198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:56:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55437fe700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441043f0 0x7f554419ced0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f553c00be20 tx=0x7f553c009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55489f3700 1 -- 172.21.15.35:0/3397294104 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00cb90 con 0x7f55441043f0 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5544109fa0 con 0x7f55441043f0 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55489f3700 1 -- 172.21.15.35:0/3397294104 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f553c00ccf0 con 0x7f55441043f0 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55489f3700 1 -- 172.21.15.35:0/3397294104 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0125a0 con 0x7f55441043f0 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.900+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5544109e10 con 0x7f55441043f0 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.903+0000 7f55489f3700 1 -- 172.21.15.35:0/3397294104 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f553c014440 con 0x7f55441043f0 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.904+0000 7f55489f3700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f552c09f640 0x7f552c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.904+0000 7f55489f3700 1 -- 172.21.15.35:0/3397294104 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f553c006e40 con 0x7f55441043f0 2023-03-17T10:56:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.905+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f552c09f640 0x7f552c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.905+0000 7f5555b82b80 1 Processor -- start 2023-03-17T10:56:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f552c09f640 0x7f552c0a1af0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5534006010 tx=0x7f5534005960 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:30.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 -- start start 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc776830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc768420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc768960 0x55d7fc768db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc66f010 con 0x55d7fc776460 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc6c1950 con 0x55d7fc776d70 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5555b82b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc6bade0 con 0x55d7fc768960 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc776830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f55427fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc768420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc776830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52608/0 (socket says 172.21.15.35:52608) 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f5542ffd700 1 -- 172.21.15.35:0/2939196959 learned_addr learned my addr 172.21.15.35:0/2939196959 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.907+0000 7f55437fe700 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc768960 0x55d7fc768db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f55437fe700 1 -- 172.21.15.35:0/2939196959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 msgr2=0x55d7fc768420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f55437fe700 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc768420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f55437fe700 1 -- 172.21.15.35:0/2939196959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 msgr2=0x55d7fc776830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f55437fe700 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc776830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f55437fe700 1 -- 172.21.15.35:0/2939196959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7fc53c5d0 con 0x55d7fc768960 2023-03-17T10:56:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f55437fe700 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc768960 0x55d7fc768db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f553c0c7670 tx=0x7f553c097370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6aa80bfed36a61 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:30.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f5529ffb700 1 -- 172.21.15.35:0/2939196959 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c09fb80 con 0x55d7fc768960 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f5529ffb700 1 -- 172.21.15.35:0/2939196959 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f553c095d30 con 0x55d7fc768960 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.908+0000 7f5529ffb700 1 -- 172.21.15.35:0/2939196959 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0970e0 con 0x55d7fc768960 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 -- 172.21.15.35:0/2939196959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc768960 msgr2=0x55d7fc768db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc768960 0x55d7fc768db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f553c0c7670 tx=0x7f553c097370 comp rx=0 tx=0).stop 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 -- 172.21.15.35:0/2939196959 shutdown_connections 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc768960 0x55d7fc768db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc776830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2939196959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc768420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 -- 172.21.15.35:0/2939196959 >> 172.21.15.35:0/2939196959 conn(0x55d7fc5c56b0 msgr2=0x55d7fc762a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 -- 172.21.15.35:0/2939196959 shutdown_connections 2023-03-17T10:56:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.909+0000 7f5555b82b80 1 -- 172.21.15.35:0/2939196959 wait complete. 2023-03-17T10:56:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.910+0000 7f5555b82b80 1 -- start start 2023-03-17T10:56:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.910+0000 7f5555b82b80 1 Processor -- start 2023-03-17T10:56:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.910+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc77ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:31.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.910+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc779fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:31.628 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:44 smithi035 ceph-mon[92535]: pgmap v3899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:56:32.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:47 smithi035 ceph-mon[92535]: pgmap v3900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:49 smithi035 ceph-mon[92535]: pgmap v3901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:56:32.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:51 smithi035 ceph-mon[92535]: pgmap v3902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:53 smithi035 ceph-mon[92535]: pgmap v3903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:55 smithi035 ceph-mon[92535]: pgmap v3904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:56:32.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:57 smithi035 ceph-mon[92535]: pgmap v3905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:44:59 smithi035 ceph-mon[92535]: pgmap v3906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:56:32.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:01 smithi035 ceph-mon[92535]: pgmap v3907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:03 smithi035 ceph-mon[92535]: pgmap v3908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:05 smithi035 ceph-mon[92535]: pgmap v3909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:07 smithi035 ceph-mon[92535]: pgmap v3910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:09 smithi035 ceph-mon[92535]: pgmap v3911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:10 smithi035 ceph-mon[92535]: osdmap e318: 12 total, 12 up, 12 in 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:11 smithi035 ceph-mon[92535]: pgmap v3913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:13 smithi035 ceph-mon[92535]: pgmap v3914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:15 smithi035 ceph-mon[92535]: pgmap v3915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:17 smithi035 ceph-mon[92535]: pgmap v3916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:17 smithi035 ceph-mon[92535]: osdmap e319: 12 total, 12 up, 12 in 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:19 smithi035 ceph-mon[92535]: pgmap v3918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 14 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:21 smithi035 ceph-mon[92535]: pgmap v3919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:23 smithi035 ceph-mon[92535]: pgmap v3920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:25 smithi035 ceph-mon[92535]: pgmap v3921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:27 smithi035 ceph-mon[92535]: pgmap v3922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:29 smithi035 ceph-mon[92535]: pgmap v3923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2023-03-17T10:56:32.546 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:31 smithi035 ceph-mon[92535]: pgmap v3924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:32 smithi035 ceph-mon[92535]: pgmap v3925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:34 smithi035 ceph-mon[92535]: pgmap v3926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 KiB/s wr, 15 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:34 smithi035 ceph-mon[92535]: pgmap v3927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:36 smithi035 ceph-mon[92535]: pgmap v3928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:38 smithi035 ceph-mon[92535]: pgmap v3929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:40 smithi035 ceph-mon[92535]: pgmap v3930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:42 smithi035 ceph-mon[92535]: pgmap v3931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T10:56:32.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:44 smithi035 ceph-mon[92535]: pgmap v3932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T10:56:33.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:46 smithi035 ceph-mon[92535]: pgmap v3933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:56:33.318 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:48 smithi035 ceph-mon[92535]: pgmap v3934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:50 smithi035 ceph-mon[92535]: pgmap v3935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:52 smithi035 ceph-mon[92535]: pgmap v3936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:54 smithi035 ceph-mon[92535]: pgmap v3937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:56 smithi035 ceph-mon[92535]: pgmap v3938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:45:58 smithi035 ceph-mon[92535]: pgmap v3939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:00 smithi035 ceph-mon[92535]: pgmap v3940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:02 smithi035 ceph-mon[92535]: pgmap v3941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:04 smithi035 ceph-mon[92535]: pgmap v3942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T10:56:33.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:06 smithi035 ceph-mon[92535]: pgmap v3943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T10:56:33.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:08 smithi035 ceph-mon[92535]: pgmap v3944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T10:56:33.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:10 smithi035 ceph-mon[92535]: pgmap v3945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T10:56:33.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:10 smithi035 ceph-mon[92535]: osdmap e320: 12 total, 12 up, 12 in 2023-03-17T10:56:33.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:12 smithi035 ceph-mon[92535]: pgmap v3947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:56:33.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:14 smithi035 ceph-mon[92535]: pgmap v3948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:16 smithi035 ceph-mon[92535]: pgmap v3949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:17 smithi035 ceph-mon[92535]: pgmap v3950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:17 smithi035 ceph-mon[92535]: osdmap e321: 12 total, 12 up, 12 in 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:19 smithi035 ceph-mon[92535]: pgmap v3952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 325 B/s wr, 12 op/s 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:21 smithi035 ceph-mon[92535]: pgmap v3953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:23 smithi035 ceph-mon[92535]: pgmap v3954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:33.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:25 smithi035 ceph-mon[92535]: pgmap v3955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:33.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:27 smithi035 ceph-mon[92535]: pgmap v3956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:56:33.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:29 smithi035 ceph-mon[92535]: pgmap v3957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 173 B/s wr, 14 op/s 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:31 smithi035 ceph-mon[92535]: pgmap v3958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:33 smithi035 ceph-mon[92535]: pgmap v3959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:33 smithi035 ceph-mon[92535]: pgmap v3960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T10:56:35.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:33 smithi035 ceph-mon[92535]: pgmap v3961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:56:35.519 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:56:35.519 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:36 smithi035 ceph-mon[92535]: pgmap v3962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:56:35.519 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:37 smithi035 ceph-mon[92535]: pgmap v3963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T10:56:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T10:56:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc77a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5555b82b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc53e8c0 con 0x55d7fc776460 2023-03-17T10:56:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5555b82b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc77ae70 con 0x55d7fc768960 2023-03-17T10:56:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5555b82b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc770a00 con 0x55d7fc776d70 2023-03-17T10:56:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5555b82b80 10 client.0 _ll_register_callbacks cb 0x55d7fc560230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:56:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc779fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc77ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc779fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52614/0 (socket says 172.21.15.35:52614) 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 -- 172.21.15.35:0/2480374311 learned_addr learned my addr 172.21.15.35:0/2480374311 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55437fe700 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc77a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 -- 172.21.15.35:0/2480374311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 msgr2=0x55d7fc77a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc77a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 -- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 msgr2=0x55d7fc77ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc77ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 -- 172.21.15.35:0/2480374311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5544109e10 con 0x55d7fc776460 2023-03-17T10:56:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f55427fc700 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc779fc0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f55380126b0 tx=0x7f55380129c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5d694909e18c58 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.911+0000 7f5522ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:56:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5522ffd700 1 -- 172.21.15.35:0/2480374311 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538017070 con 0x55d7fc776460 2023-03-17T10:56:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5522ffd700 1 -- 172.21.15.35:0/2480374311 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5538004830 con 0x55d7fc776460 2023-03-17T10:56:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7fc67d390 con 0x55d7fc776460 2023-03-17T10:56:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5522ffd700 1 -- 172.21.15.35:0/2480374311 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55380049f0 con 0x55d7fc776460 2023-03-17T10:56:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 10 client.19698 fetch_fsmap learned FSMap version 64 2023-03-17T10:56:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55d7fc4e8d80 con 0x55d7fc776460 2023-03-17T10:56:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5522ffd700 1 -- 172.21.15.35:0/2480374311 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d7fc67d390 con 0x55d7fc776460 2023-03-17T10:56:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5522ffd700 1 -- 172.21.15.35:0/2480374311 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 64) v1 ==== 6965+0+0 (secure 0 0 0) 0x7f553801c570 con 0x55d7fc776460 2023-03-17T10:56:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 10 client.19698 fetch_fsmap finished waiting for FSMap version 64 2023-03-17T10:56:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 10 client.19698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:56:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 20 client.19698 populate_metadata read hostname 'smithi035' 2023-03-17T10:56:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7932a0 0x55d7fc7956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 4 client.19698 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.912+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7fc689600 con 0x55d7fc7932a0 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.913+0000 7f5542ffd700 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7932a0 0x55d7fc7956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.913+0000 7f5522ffd700 10 client.19698 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.913+0000 7f5542ffd700 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7932a0 0x55d7fc7956b0 crc :-1 s=READY pgs=548 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00ff8bc70e9d24f server_cookie=2c0903d6d792d19e in_seq=0 out_seq=0 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5522ffd700 1 -- 172.21.15.35:0/2480374311 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d7fc689600 con 0x55d7fc7932a0 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5522ffd700 10 client.19698 handle_command_reply: tid=0 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 client.19698 shutdown 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 msgr2=0x55d7fc779fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc779fc0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f55380126b0 tx=0x7f55380129c0 comp rx=0 tx=0).stop 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 shutdown_connections 2023-03-17T10:56:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7932a0 0x55d7fc7956b0 crc :-1 s=READY pgs=548 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc77a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc77ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5522ffd700 0 client.19698 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 --2- 172.21.15.35:0/2480374311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc779fc0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 >> 172.21.15.35:0/2480374311 conn(0x55d7fc5c56b0 msgr2=0x55d7fc767410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 shutdown_connections 2023-03-17T10:56:40.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 1 -- 172.21.15.35:0/2480374311 wait complete. 2023-03-17T10:56:40.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.914+0000 7f5555b82b80 20 client.19698 trim_cache size 0 max 16384 2023-03-17T10:56:40.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.940+0000 7f5555b82b80 1 Processor -- start 2023-03-17T10:56:40.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.940+0000 7f5555b82b80 1 -- start start 2023-03-17T10:56:40.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc762ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:40.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc76d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc773e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5555b82b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc7908c0 con 0x55d7fc776460 2023-03-17T10:56:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5555b82b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc763380 con 0x55d7fc768960 2023-03-17T10:56:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5555b82b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc75fb60 con 0x55d7fc776d70 2023-03-17T10:56:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc762ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc762ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54416/0 (socket says 172.21.15.35:54416) 2023-03-17T10:56:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f55437fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc773e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 -- 172.21.15.35:0/3970620043 learned_addr learned my addr 172.21.15.35:0/3970620043 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f55427fc700 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc76d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 -- 172.21.15.35:0/3970620043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 msgr2=0x55d7fc773e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc773e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 -- 172.21.15.35:0/3970620043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 msgr2=0x55d7fc76d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:43.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc76d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f5542ffd700 1 -- 172.21.15.35:0/3970620043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7fc681130 con 0x55d7fc768960 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.941+0000 7f55427fc700 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc76d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.942+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc762ac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55340092c0 tx=0x7f5534020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dcac6ad2049ffee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.942+0000 7f552a7fc700 1 -- 172.21.15.35:0/3970620043 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553403a070 con 0x55d7fc768960 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.942+0000 7f552a7fc700 1 -- 172.21.15.35:0/3970620043 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f553402c040 con 0x55d7fc768960 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.942+0000 7f552a7fc700 1 -- 172.21.15.35:0/3970620043 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553402b040 con 0x55d7fc768960 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 -- 172.21.15.35:0/3970620043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 msgr2=0x55d7fc762ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc762ac0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55340092c0 tx=0x7f5534020000 comp rx=0 tx=0).stop 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 -- 172.21.15.35:0/3970620043 shutdown_connections 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776d70 0x55d7fc773e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc768960 0x55d7fc762ac0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3970620043 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc776460 0x55d7fc76d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 -- 172.21.15.35:0/3970620043 >> 172.21.15.35:0/3970620043 conn(0x55d7fc5c56b0 msgr2=0x55d7fc770e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 -- 172.21.15.35:0/3970620043 shutdown_connections 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 -- 172.21.15.35:0/3970620043 wait complete. 2023-03-17T10:56:43.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.943+0000 7f5555b82b80 1 -- start start 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 Processor -- start 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc768960 0x55d7fc77b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776460 0x55d7fc77bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc77c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc786a60 con 0x55d7fc768960 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc786bd0 con 0x55d7fc776d70 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7fc786d90 con 0x55d7fc776460 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.944+0000 7f5555b82b80 10 client.0 _ll_register_callbacks cb 0x55d7fc560230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f55427fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776460 0x55d7fc77bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f55427fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776460 0x55d7fc77bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44394/0 (socket says 172.21.15.35:44394) 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f55427fc700 1 -- 172.21.15.35:0/3994811603 learned_addr learned my addr 172.21.15.35:0/3994811603 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc768960 0x55d7fc77b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f55437fe700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc77c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 -- 172.21.15.35:0/3994811603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776460 msgr2=0x55d7fc77bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776460 0x55d7fc77bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 -- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 msgr2=0x55d7fc77c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc77c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 -- 172.21.15.35:0/3994811603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440699c0 con 0x55d7fc768960 2023-03-17T10:56:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f55437fe700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc77c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:56:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5542ffd700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc768960 0x55d7fc77b860 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f5534009290 tx=0x7f5534036600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74831746c2fb25e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.945+0000 7f5522ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:56:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5522ffd700 1 -- 172.21.15.35:0/3994811603 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553403a070 con 0x55d7fc768960 2023-03-17T10:56:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5522ffd700 1 -- 172.21.15.35:0/3994811603 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(282..282 src has 1..282) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f55340362e0 con 0x55d7fc768960 2023-03-17T10:56:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7fc7381e0 con 0x55d7fc768960 2023-03-17T10:56:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5522ffd700 1 -- 172.21.15.35:0/3994811603 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f553402b040 con 0x55d7fc768960 2023-03-17T10:56:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5555b82b80 10 client.19701 fetch_fsmap learned FSMap version 64 2023-03-17T10:56:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55d7fc50f1f0 con 0x55d7fc768960 2023-03-17T10:56:44.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.946+0000 7f5522ffd700 1 -- 172.21.15.35:0/3994811603 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d7fc7381e0 con 0x55d7fc768960 2023-03-17T10:56:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5522ffd700 1 -- 172.21.15.35:0/3994811603 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 64) v1 ==== 6965+0+0 (secure 0 0 0) 0x7f5534043cb0 con 0x55d7fc768960 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5555b82b80 10 client.19701 fetch_fsmap finished waiting for FSMap version 64 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5555b82b80 10 client.19701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5555b82b80 20 client.19701 populate_metadata read hostname 'smithi035' 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7880f0 0x55d7fc78a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5555b82b80 4 client.19701 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d7fc53ef00 con 0x55d7fc7880f0 2023-03-17T10:56:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.947+0000 7f55427fc700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7880f0 0x55d7fc78a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.948+0000 7f55427fc700 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7880f0 0x55d7fc78a500 crc :-1 s=READY pgs=549 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b930151622b36727 server_cookie=8221404ba1858959 in_seq=0 out_seq=0 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:47.948+0000 7f5522ffd700 10 client.19701 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.004+0000 7f5522ffd700 1 -- 172.21.15.35:0/3994811603 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d7fc53ef00 con 0x55d7fc7880f0 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.004+0000 7f5522ffd700 10 client.19701 handle_command_reply: tid=0 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.004+0000 7f5555b82b80 1 client.19701 shutdown 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.004+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc768960 msgr2=0x55d7fc77b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc768960 0x55d7fc77b860 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f5534009290 tx=0x7f5534036600 comp rx=0 tx=0).stop 2023-03-17T10:56:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 shutdown_connections 2023-03-17T10:56:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d7fc7880f0 0x55d7fc78a500 crc :-1 s=READY pgs=549 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d7fc776d70 0x55d7fc77c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d7fc768960 0x55d7fc77b860 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 --2- 172.21.15.35:0/3994811603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d7fc776460 0x55d7fc77bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 >> 172.21.15.35:0/3994811603 conn(0x55d7fc5c56b0 msgr2=0x55d7fc773e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5522ffd700 0 client.19701 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:56:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 shutdown_connections 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 1 -- 172.21.15.35:0/3994811603 wait complete. 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f5555b82b80 20 client.19701 trim_cache size 0 max 16384 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f552c09f640 msgr2=0x7f552c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.005+0000 7f55499f5700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f552c09f640 0x7f552c0a1af0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5534006010 tx=0x7f5534005960 comp rx=0 tx=0).stop 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441043f0 msgr2=0x7f554419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441043f0 0x7f554419ced0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f553c00be20 tx=0x7f553c009ed0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 shutdown_connections 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f552c09f640 0x7f552c0a1af0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441043f0 0x7f554419ced0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440ff3b0 0x7f5544198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 --2- 172.21.15.35:0/3397294104 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55440ffd50 0x7f5544198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.006+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 >> 172.21.15.35:0/3397294104 conn(0x7f55440762d0 msgr2=0x7f55440fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.008+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 shutdown_connections 2023-03-17T10:56:48.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:27:48.008+0000 7f55499f5700 1 -- 172.21.15.35:0/3397294104 wait complete. 2023-03-17T10:56:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 -- 172.21.15.35:0/3522656529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d701012d0 msgr2=0x7f7d701016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 --2- 172.21.15.35:0/3522656529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d701012d0 0x7f7d701016a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009990 tx=0x7f7d60009ca0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 -- 172.21.15.35:0/3522656529 shutdown_connections 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 --2- 172.21.15.35:0/3522656529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d7010cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 --2- 172.21.15.35:0/3522656529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d701012d0 0x7f7d701016a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 --2- 172.21.15.35:0/3522656529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d70101be0 0x7f7d7010a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 -- 172.21.15.35:0/3522656529 >> 172.21.15.35:0/3522656529 conn(0x7f7d70077010 msgr2=0x7f7d70077410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 -- 172.21.15.35:0/3522656529 shutdown_connections 2023-03-17T10:56:48.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.500+0000 7f7d75abc700 1 -- 172.21.15.35:0/3522656529 wait complete. 2023-03-17T10:56:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.501+0000 7f7d75abc700 1 Processor -- start 2023-03-17T10:56:48.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.501+0000 7f7d75abc700 1 -- start start 2023-03-17T10:56:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d75abc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d701012d0 0x7f7d700ff100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d75abc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70101be0 0x7f7d700ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d75abc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d700ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d75abc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701a8bf0 con 0x7f7d701012d0 2023-03-17T10:56:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d75abc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701a8d30 con 0x7f7d70101be0 2023-03-17T10:56:51.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d75abc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701a8e70 con 0x7f7d7010a7f0 2023-03-17T10:56:51.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d700ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d700ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44412/0 (socket says 172.21.15.35:44412) 2023-03-17T10:56:53.124 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T10:56:53.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 -- 172.21.15.35:0/430174843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c800ffd40 msgr2=0x7f9c80103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:53.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 --2- 172.21.15.35:0/430174843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c800ffd40 0x7f9c80103d00 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f9c700099c0 tx=0x7f9c70009cd0 comp rx=0 tx=0).stop 2023-03-17T10:56:53.125 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 -- 172.21.15.35:0/430174843 shutdown_connections 2023-03-17T10:56:53.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 --2- 172.21.15.35:0/430174843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c801043e0 0x7f9c8010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:53.126 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 --2- 172.21.15.35:0/430174843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ff3a0 0x7f9c800ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:54.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 --2- 172.21.15.35:0/430174843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c800ffd40 0x7f9c80103d00 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:54.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 -- 172.21.15.35:0/430174843 >> 172.21.15.35:0/430174843 conn(0x7f9c80076330 msgr2=0x7f9c80076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:56:54.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 -- 172.21.15.35:0/430174843 shutdown_connections 2023-03-17T10:56:54.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 -- 172.21.15.35:0/430174843 wait complete. 2023-03-17T10:56:54.169 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 Processor -- start 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.524+0000 7f9c87b64700 1 -- start start 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c87b64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c800ff3a0 0x7f9c80197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c87b64700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ffd40 0x7f9c80197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c87b64700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 0x7f9c801a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c87b64700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c80197fb0 con 0x7f9c801043e0 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c87b64700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801a26f0 con 0x7f9c800ffd40 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c87b64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801a28b0 con 0x7f9c800ff3a0 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 0x7f9c801a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:54.170 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 0x7f9c801a21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53888/0 (socket says 172.21.15.35:53888) 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 -- 172.21.15.35:0/144281320 learned_addr learned my addr 172.21.15.35:0/144281320 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c85900700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c800ff3a0 0x7f9c80197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c850ff700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ffd40 0x7f9c80197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 -- 172.21.15.35:0/144281320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c800ff3a0 msgr2=0x7f9c80197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c800ff3a0 0x7f9c80197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 -- 172.21.15.35:0/144281320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ffd40 msgr2=0x7f9c80197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ffd40 0x7f9c80197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 -- 172.21.15.35:0/144281320 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c700095f0 con 0x7f9c801043e0 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c850ff700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ffd40 0x7f9c80197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c86101700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 0x7f9c801a21b0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9c78007d70 tx=0x7f9c7800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.525+0000 7f9c76ffd700 1 -- 172.21.15.35:0/144281320 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800ad40 con 0x7f9c801043e0 2023-03-17T10:56:55.429 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.526+0000 7f9c76ffd700 1 -- 172.21.15.35:0/144281320 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c780128b0 con 0x7f9c801043e0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.526+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8010f010 con 0x7f9c801043e0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.526+0000 7f9c76ffd700 1 -- 172.21.15.35:0/144281320 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780116b0 con 0x7f9c801043e0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.526+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8010ee80 con 0x7f9c801043e0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.528+0000 7f9c76ffd700 1 -- 172.21.15.35:0/144281320 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9c78012a20 con 0x7f9c801043e0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.528+0000 7f9c76ffd700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9c6c09f640 0x7f9c6c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c76ffd700 1 -- 172.21.15.35:0/144281320 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9c780ca800 con 0x7f9c801043e0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c85900700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9c6c09f640 0x7f9c6c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c85900700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9c6c09f640 0x7f9c6c0a1af0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c005950 tx=0x7f9c7c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c93cf1b80 1 Processor -- start 2023-03-17T10:56:55.430 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c93cf1b80 1 -- start start 2023-03-17T10:56:56.452 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:56.452 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.529+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:56.452 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c4630 0x55b9865c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:56:56.452 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9864c6070 con 0x55b9865c00e0 2023-03-17T10:56:56.452 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865189b0 con 0x55b9865bf7d0 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b986511e40 con 0x55b9865c4630 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53894/0 (socket says 172.21.15.35:53894) 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 -- 172.21.15.35:0/2085447096 learned_addr learned my addr 172.21.15.35:0/2085447096 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c85900700 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c86101700 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c4630 0x55b9865c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 -- 172.21.15.35:0/2085447096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c4630 msgr2=0x55b9865c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c4630 0x55b9865c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 -- 172.21.15.35:0/2085447096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 msgr2=0x55b9865bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865bfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 -- 172.21.15.35:0/2085447096 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b986393630 con 0x55b9865c00e0 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c86101700 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c4630 0x55b9865c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:56:56.453 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c850ff700 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c40f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f9c70000c00 tx=0x7f9c70005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815a37230e4d2958 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c6bfff700 1 -- 172.21.15.35:0/2085447096 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70005340 con 0x55b9865c00e0 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c6bfff700 1 -- 172.21.15.35:0/2085447096 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c7001e040 con 0x55b9865c00e0 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.530+0000 7f9c6bfff700 1 -- 172.21.15.35:0/2085447096 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700047f0 con 0x55b9865c00e0 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2085447096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 msgr2=0x55b9865c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c40f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f9c70000c00 tx=0x7f9c70005c00 comp rx=0 tx=0).stop 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2085447096 shutdown_connections 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c4630 0x55b9865c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:59.377 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865bfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:59.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2085447096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c40f0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:56:59.378 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2085447096 >> 172.21.15.35:0/2085447096 conn(0x55b9865ba030 msgr2=0x55b9865ba400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:01.160 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2085447096 shutdown_connections 2023-03-17T10:57:01.160 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2085447096 wait complete. 2023-03-17T10:57:01.160 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.531+0000 7f9c93cf1b80 1 -- start start 2023-03-17T10:57:01.160 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 Processor -- start 2023-03-17T10:57:01.894 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865bf7d0 0x55b9865c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:01.894 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:01.894 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865c4630 0x55b9865c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:01.894 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b986395920 con 0x55b9865c00e0 2023-03-17T10:57:01.894 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865d5880 con 0x55b9865c4630 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865d59c0 con 0x55b9865bf7d0 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c93cf1b80 10 client.0 _ll_register_callbacks cb 0x55b9863b7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c850ff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c850ff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53900/0 (socket says 172.21.15.35:53900) 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c850ff700 1 -- 172.21.15.35:0/677105630 learned_addr learned my addr 172.21.15.35:0/677105630 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c86101700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865c4630 0x55b9865c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c85900700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865bf7d0 0x55b9865c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c850ff700 1 -- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865bf7d0 msgr2=0x55b9865c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:01.895 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.532+0000 7f9c850ff700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865bf7d0 0x55b9865c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:02.324 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c850ff700 1 -- 172.21.15.35:0/677105630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865c4630 msgr2=0x55b9865c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:02.327 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c850ff700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865c4630 0x55b9865c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:03.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c850ff700 1 -- 172.21.15.35:0/677105630 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8010c7f0 con 0x55b9865c00e0 2023-03-17T10:57:03.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c850ff700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c9630 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009d10 tx=0x7f9c700057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb3a53a177e285d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:03.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c697fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:57:04.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c697fa700 1 -- 172.21.15.35:0/677105630 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000bd60 con 0x55b9865c00e0 2023-03-17T10:57:04.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c697fa700 1 -- 172.21.15.35:0/677105630 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9c70004500 con 0x55b9865c00e0 2023-03-17T10:57:04.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9864d43f0 con 0x55b9865c00e0 2023-03-17T10:57:04.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c697fa700 1 -- 172.21.15.35:0/677105630 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c7000bec0 con 0x55b9865c00e0 2023-03-17T10:57:04.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 10 client.20205 fetch_fsmap learned FSMap version 102 2023-03-17T10:57:04.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55b98633fde0 con 0x55b9865c00e0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c697fa700 1 -- 172.21.15.35:0/677105630 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b9864d43f0 con 0x55b9865c00e0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c697fa700 1 -- 172.21.15.35:0/677105630 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9c70003b30 con 0x55b9865c00e0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 10 client.20205 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 10 client.20205 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 20 client.20205 populate_metadata read hostname 'smithi035' 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b9865d94e0 0x55b9865db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 4 client.20205 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.533+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9864e0660 con 0x55b9865d94e0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.534+0000 7f9c85900700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b9865d94e0 0x55b9865db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.534+0000 7f9c697fa700 10 client.20205 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.534+0000 7f9c85900700 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b9865d94e0 0x55b9865db8f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=664b2a62086c1780 server_cookie=961a69aa67b7304c in_seq=0 out_seq=0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c697fa700 1 -- 172.21.15.35:0/677105630 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b9864e0660 con 0x55b9865d94e0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c697fa700 10 client.20205 handle_command_reply: tid=0 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 client.20205 shutdown 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 msgr2=0x55b9865c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c9630 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009d10 tx=0x7f9c700057e0 comp rx=0 tx=0).stop 2023-03-17T10:57:04.984 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 shutdown_connections 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865c4630 0x55b9865c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865bf7d0 0x55b9865c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b9865d94e0 0x55b9865db8f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/677105630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c00e0 0x55b9865c9630 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c697fa700 0 client.20205 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 >> 172.21.15.35:0/677105630 conn(0x55b9865ba030 msgr2=0x55b9865b9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 shutdown_connections 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/677105630 wait complete. 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.535+0000 7f9c93cf1b80 20 client.20205 trim_cache size 0 max 16384 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.548+0000 7f9c93cf1b80 1 Processor -- start 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.548+0000 7f9c93cf1b80 1 -- start start 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:04.985 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865b25b0 con 0x55b9865c4630 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865c7120 con 0x55b9865bf7d0 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865c76a0 con 0x55b9865c00e0 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865d4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53910/0 (socket says 172.21.15.35:53910) 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 -- 172.21.15.35:0/2587739953 learned_addr learned my addr 172.21.15.35:0/2587739953 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c85900700 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c850ff700 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 -- 172.21.15.35:0/2587739953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 msgr2=0x55b9865c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 -- 172.21.15.35:0/2587739953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 msgr2=0x55b9865c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:04.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:07.276 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 -- 172.21.15.35:0/2587739953 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9865ba6d0 con 0x55b9865c4630 2023-03-17T10:57:09.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c85900700 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:57:09.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c86101700 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865d4f60 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f9c780c8100 tx=0x7f9c780ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b35cb20e481054a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:09.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c74dae700 1 -- 172.21.15.35:0/2587739953 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a05b0 con 0x55b9865c4630 2023-03-17T10:57:09.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c74dae700 1 -- 172.21.15.35:0/2587739953 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c78096760 con 0x55b9865c4630 2023-03-17T10:57:09.318 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.549+0000 7f9c74dae700 1 -- 172.21.15.35:0/2587739953 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a0120 con 0x55b9865c4630 2023-03-17T10:57:10.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2587739953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 msgr2=0x55b9865d4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:10.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865d4f60 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f9c780c8100 tx=0x7f9c780ca040 comp rx=0 tx=0).stop 2023-03-17T10:57:10.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2587739953 shutdown_connections 2023-03-17T10:57:10.151 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865d4f60 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:12.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:12.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2587739953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:12.054 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2587739953 >> 172.21.15.35:0/2587739953 conn(0x55b9865ba030 msgr2=0x55b9865c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:12.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2587739953 shutdown_connections 2023-03-17T10:57:12.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2587739953 wait complete. 2023-03-17T10:57:12.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 -- start start 2023-03-17T10:57:12.055 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.550+0000 7f9c93cf1b80 1 Processor -- start 2023-03-17T10:57:13.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:13.058 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:13.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:40 smithi035 ceph-mon[92535]: pgmap v3964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:57:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.502+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1522499900 learned_addr learned my addr 172.21.15.35:0/1522499900 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d701012d0 0x7f7d700ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1522499900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70101be0 msgr2=0x7f7d700ff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70101be0 0x7f7d700ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d701012d0 msgr2=0x7f7d700ff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d701012d0 0x7f7d700ff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6ffff700 1 -- 172.21.15.35:0/1522499900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600095f0 con 0x7f7d7010a7f0 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d701012d0 0x7f7d700ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:57:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.503+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d700ffb80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800ef90 tx=0x7f7d6800c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:15.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.504+0000 7f7d6cff9700 1 -- 172.21.15.35:0/1522499900 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68018070 con 0x7f7d7010a7f0 2023-03-17T10:57:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.504+0000 7f7d6cff9700 1 -- 172.21.15.35:0/1522499900 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d6800f040 con 0x7f7d7010a7f0 2023-03-17T10:57:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.504+0000 7f7d6cff9700 1 -- 172.21.15.35:0/1522499900 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68003de0 con 0x7f7d7010a7f0 2023-03-17T10:57:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.504+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d70110110 con 0x7f7d7010a7f0 2023-03-17T10:57:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.504+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7010ff80 con 0x7f7d7010a7f0 2023-03-17T10:57:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.507+0000 7f7d6cff9700 1 -- 172.21.15.35:0/1522499900 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7d6800cb00 con 0x7f7d7010a7f0 2023-03-17T10:57:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.508+0000 7f7d6cff9700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f790 0x7f7d580a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.508+0000 7f7d6cff9700 1 -- 172.21.15.35:0/1522499900 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(286..286 src has 1..286) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7d680ca0c0 con 0x7f7d7010a7f0 2023-03-17T10:57:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.508+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f790 0x7f7d580a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 Processor -- start 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 -- start start 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f790 0x7f7d580a1c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000b2e0 tx=0x7f7d60005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a4bb010 con 0x56299a5b9be0 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a50d950 con 0x56299a5ba4f0 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.509+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a506de0 con 0x56299a5b4960 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52654/0 (socket says 172.21.15.35:52654) 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/684268838 learned_addr learned my addr 172.21.15.35:0/684268838 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6effd700 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/684268838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 msgr2=0x56299a5b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/684268838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 msgr2=0x56299a5b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/684268838 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299a3885d0 con 0x56299a5b9be0 2023-03-17T10:57:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6effd700 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:57:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.510+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5b9fb0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005830 tx=0x7f7d6001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d588bf5733748151 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d55ffb700 1 -- 172.21.15.35:0/684268838 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6001e070 con 0x56299a5b9be0 2023-03-17T10:57:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d55ffb700 1 -- 172.21.15.35:0/684268838 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d6000be90 con 0x56299a5b9be0 2023-03-17T10:57:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d55ffb700 1 -- 172.21.15.35:0/684268838 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60004860 con 0x56299a5b9be0 2023-03-17T10:57:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 -- 172.21.15.35:0/684268838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 msgr2=0x56299a5b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5b9fb0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005830 tx=0x7f7d6001e000 comp rx=0 tx=0).stop 2023-03-17T10:57:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 -- 172.21.15.35:0/684268838 shutdown_connections 2023-03-17T10:57:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5b9fb0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/684268838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.511+0000 7f7d81c49b80 1 -- 172.21.15.35:0/684268838 >> 172.21.15.35:0/684268838 conn(0x56299a4116b0 msgr2=0x56299a5aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.512+0000 7f7d81c49b80 1 -- 172.21.15.35:0/684268838 shutdown_connections 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.512+0000 7f7d81c49b80 1 -- 172.21.15.35:0/684268838 wait complete. 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.512+0000 7f7d81c49b80 1 -- start start 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.512+0000 7f7d81c49b80 1 Processor -- start 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b9be0 0x56299a5bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5ba4f0 0x56299a5bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a38a8c0 con 0x56299a5ba4f0 2023-03-17T10:57:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a5be400 con 0x56299a5b9be0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a5db010 con 0x56299a5b4960 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d81c49b80 10 client.0 _ll_register_callbacks cb 0x56299a3ac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44426/0 (socket says 172.21.15.35:44426) 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/3303248686 learned_addr learned my addr 172.21.15.35:0/3303248686 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5ba4f0 0x56299a5bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6effd700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b9be0 0x56299a5bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b9be0 msgr2=0x56299a5bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b9be0 0x56299a5bd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/3303248686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5ba4f0 msgr2=0x56299a5bdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5ba4f0 0x56299a5bdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.513+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/3303248686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7010d920 con 0x56299a5b4960 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5c04a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005cd0 tx=0x7f7d6000f8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb69e81b3e76d45 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d4effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d4effd700 1 -- 172.21.15.35:0/3303248686 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60005460 con 0x56299a5b4960 2023-03-17T10:57:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d4effd700 1 -- 172.21.15.35:0/3303248686 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(286..286 src has 1..286) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7d60004620 con 0x56299a5b4960 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56299a4c9390 con 0x56299a5b4960 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d4effd700 1 -- 172.21.15.35:0/3303248686 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d600055c0 con 0x56299a5b4960 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d81c49b80 10 client.28849 fetch_fsmap learned FSMap version 73 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x56299a334d80 con 0x56299a5b4960 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.514+0000 7f7d4effd700 1 -- 172.21.15.35:0/3303248686 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56299a4c9390 con 0x56299a5b4960 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d4effd700 1 -- 172.21.15.35:0/3303248686 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7d600308b0 con 0x56299a5b4960 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d81c49b80 10 client.28849 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:57:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d81c49b80 10 client.28849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:57:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d81c49b80 20 client.28849 populate_metadata read hostname 'smithi035' 2023-03-17T10:57:22.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a5dee30 0x56299a5e1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d81c49b80 4 client.28849 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:57:23.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56299a4d5600 con 0x56299a5dee30 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d6effd700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a5dee30 0x56299a5e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d4effd700 10 client.28849 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.515+0000 7f7d6effd700 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a5dee30 0x56299a5e1240 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29746c098ef0c511 server_cookie=60314273033fb928 in_seq=0 out_seq=0 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d4effd700 1 -- 172.21.15.35:0/3303248686 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56299a4d5600 con 0x56299a5dee30 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d4effd700 10 client.28849 handle_command_reply: tid=0 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 client.28849 shutdown 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 msgr2=0x56299a5c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5c04a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005cd0 tx=0x7f7d6000f8f0 comp rx=0 tx=0).stop 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 shutdown_connections 2023-03-17T10:57:23.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a5dee30 0x56299a5e1240 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5ba4f0 0x56299a5bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5c04a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/3303248686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b9be0 0x56299a5bd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 >> 172.21.15.35:0/3303248686 conn(0x56299a4116b0 msgr2=0x56299a5b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d4effd700 0 client.28849 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:57:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 shutdown_connections 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.516+0000 7f7d81c49b80 1 -- 172.21.15.35:0/3303248686 wait complete. 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.517+0000 7f7d81c49b80 20 client.28849 trim_cache size 0 max 16384 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 Processor -- start 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 -- start start 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a5af000 con 0x56299a5b9be0 2023-03-17T10:57:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a5aa0d0 con 0x56299a5ba4f0 2023-03-17T10:57:24.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a5be2f0 con 0x56299a5b4960 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44434/0 (socket says 172.21.15.35:44434) 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54466/0 (socket says 172.21.15.35:54466) 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.542+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/2880356072 learned_addr learned my addr 172.21.15.35:0/2880356072 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/2880356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 msgr2=0x56299a5b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/2880356072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 msgr2=0x56299a5d5f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6f7fe700 1 -- 172.21.15.35:0/2880356072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56299a4cd130 con 0x56299a5b4960 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5aeac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009ce0 tx=0x7f7d60005940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=475e0366bcebbeee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d567fc700 1 -- 172.21.15.35:0/2880356072 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6001e040 con 0x56299a5b4960 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d567fc700 1 -- 172.21.15.35:0/2880356072 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d60005460 con 0x56299a5b4960 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.543+0000 7f7d567fc700 1 -- 172.21.15.35:0/2880356072 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60004bc0 con 0x56299a5b4960 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2880356072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 msgr2=0x56299a5aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5aeac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009ce0 tx=0x7f7d60005940 comp rx=0 tx=0).stop 2023-03-17T10:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2880356072 shutdown_connections 2023-03-17T10:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5ba4f0 0x56299a5b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5b4960 0x56299a5aeac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2880356072 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2880356072 >> 172.21.15.35:0/2880356072 conn(0x56299a4116b0 msgr2=0x56299a5e0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2880356072 shutdown_connections 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2880356072 wait complete. 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.544+0000 7f7d81c49b80 1 -- start start 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 Processor -- start 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b4960 0x56299a5d3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5ba4f0 0x56299a5d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a631db0 con 0x56299a5b9be0 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a631f20 con 0x56299a5b4960 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56299a6430f0 con 0x56299a5ba4f0 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d81c49b80 10 client.0 _ll_register_callbacks cb 0x56299a3ac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d6effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d6ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5ba4f0 0x56299a5d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d6effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52676/0 (socket says 172.21.15.35:52676) 2023-03-17T10:57:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d6f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b4960 0x56299a5d3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.545+0000 7f7d6effd700 1 -- 172.21.15.35:0/2666113442 learned_addr learned my addr 172.21.15.35:0/2666113442 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d6ffff700 1 -- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b4960 msgr2=0x56299a5d3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b4960 0x56299a5d3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d6ffff700 1 -- 172.21.15.35:0/2666113442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 msgr2=0x56299a5d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d6ffff700 1 -- 172.21.15.35:0/2666113442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7010ff80 con 0x56299a5ba4f0 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d6ffff700 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5ba4f0 0x56299a5d49c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d680c78f0 tx=0x7f7d6800ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b55cc2e5648e8e10 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d4effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:57:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d4effd700 1 -- 172.21.15.35:0/2666113442 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68097ca0 con 0x56299a5ba4f0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865cd7d0 con 0x55b9865c4630 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9865cd940 con 0x55b9865bf7d0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b98662d340 con 0x55b9865c00e0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 10 client.0 _ll_register_callbacks cb 0x55b9863b7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53916/0 (socket says 172.21.15.35:53916) 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 -- 172.21.15.35:0/2931423911 learned_addr learned my addr 172.21.15.35:0/2931423911 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c850ff700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c85900700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 -- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 msgr2=0x55b9865ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:30.654 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:33.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 -- 172.21.15.35:0/2931423911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 msgr2=0x55b9865d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:33.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:33.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 -- 172.21.15.35:0/2931423911 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8010ee80 con 0x55b9865c4630 2023-03-17T10:57:33.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c850ff700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:57:33.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c86101700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865cd130 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f9c78094e30 tx=0x7f9c78094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8788358b60c7f1be server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:33.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c697fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:57:33.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c697fa700 1 -- 172.21.15.35:0/2931423911 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780988f0 con 0x55b9865c4630 2023-03-17T10:57:33.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c697fa700 1 -- 172.21.15.35:0/2931423911 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9c780978b0 con 0x55b9865c4630 2023-03-17T10:57:33.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b98658f240 con 0x55b9865c4630 2023-03-17T10:57:33.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c697fa700 1 -- 172.21.15.35:0/2931423911 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c78097a70 con 0x55b9865c4630 2023-03-17T10:57:33.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 10 client.20211 fetch_fsmap learned FSMap version 102 2023-03-17T10:57:34.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.551+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55b986328c60 con 0x55b9865c4630 2023-03-17T10:57:34.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c697fa700 1 -- 172.21.15.35:0/2931423911 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b98658f240 con 0x55b9865c4630 2023-03-17T10:57:34.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c697fa700 1 -- 172.21.15.35:0/2931423911 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9c78094350 con 0x55b9865c4630 2023-03-17T10:57:34.295 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c93cf1b80 10 client.20211 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c93cf1b80 10 client.20211 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c93cf1b80 20 client.20211 populate_metadata read hostname 'smithi035' 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b98662e550 0x55b986630960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c93cf1b80 4 client.20211 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b986395f60 con 0x55b98662e550 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.552+0000 7f9c85900700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b98662e550 0x55b986630960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c697fa700 10 client.20211 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c85900700 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b98662e550 0x55b986630960 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81551e917141591e server_cookie=7831b032ab88cb47 in_seq=0 out_seq=0 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c697fa700 1 -- 172.21.15.35:0/2931423911 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b986395f60 con 0x55b98662e550 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c697fa700 10 client.20211 handle_command_reply: tid=0 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 client.20211 shutdown 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 msgr2=0x55b9865cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865cd130 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f9c78094e30 tx=0x7f9c78094040 comp rx=0 tx=0).stop 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 shutdown_connections 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x55b98662e550 0x55b986630960 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:34.296 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b9865c4630 0x55b9865cd130 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b9865bf7d0 0x55b9865d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c697fa700 0 client.20211 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 --2- 172.21.15.35:0/2931423911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b9865c00e0 0x55b9865ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 >> 172.21.15.35:0/2931423911 conn(0x55b9865ba030 msgr2=0x55b9865c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 shutdown_connections 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 1 -- 172.21.15.35:0/2931423911 wait complete. 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.553+0000 7f9c93cf1b80 20 client.20211 trim_cache size 0 max 16384 2023-03-17T10:57:38.076 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9c6c09f640 msgr2=0x7f9c6c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9c6c09f640 0x7f9c6c0a1af0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c005950 tx=0x7f9c7c0058e0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 msgr2=0x7f9c801a21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 0x7f9c801a21b0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9c78007d70 tx=0x7f9c7800a340 comp rx=0 tx=0).stop 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 shutdown_connections 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9c6c09f640 0x7f9c6c0a1af0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9c801043e0 0x7f9c801a21b0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c800ff3a0 0x7f9c80197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 --2- 172.21.15.35:0/144281320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800ffd40 0x7f9c80197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 >> 172.21.15.35:0/144281320 conn(0x7f9c80076330 msgr2=0x7f9c800fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 shutdown_connections 2023-03-17T10:57:38.077 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T10:46:00.554+0000 7f9c87b64700 1 -- 172.21.15.35:0/144281320 wait complete. 2023-03-17T10:57:38.078 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:42 smithi035 ceph-mon[92535]: pgmap v3965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T10:57:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56299a5841e0 con 0x56299a5ba4f0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d4effd700 1 -- 172.21.15.35:0/2666113442 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(286..286 src has 1..286) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7d680b1020 con 0x56299a5ba4f0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d4effd700 1 -- 172.21.15.35:0/2666113442 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d6809fe00 con 0x56299a5ba4f0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d81c49b80 10 client.28855 fetch_fsmap learned FSMap version 73 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.546+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x56299a334d80 con 0x56299a5ba4f0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d4effd700 1 -- 172.21.15.35:0/2666113442 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56299a5841e0 con 0x56299a5ba4f0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d4effd700 1 -- 172.21.15.35:0/2666113442 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7d68093b00 con 0x56299a5ba4f0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d81c49b80 10 client.28855 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d81c49b80 10 client.28855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d81c49b80 20 client.28855 populate_metadata read hostname 'smithi035' 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a644880 0x56299a646c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d81c49b80 4 client.28855 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56299a38af00 con 0x56299a644880 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a644880 0x56299a646c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d6f7fe700 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a644880 0x56299a646c90 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=226d09c5bf858a33 server_cookie=fd15c1bcca718d5f in_seq=0 out_seq=0 2023-03-17T10:57:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.547+0000 7f7d4effd700 10 client.28855 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:57:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.601+0000 7f7d4effd700 1 -- 172.21.15.35:0/2666113442 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56299a38af00 con 0x56299a644880 2023-03-17T10:57:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.601+0000 7f7d4effd700 10 client.28855 handle_command_reply: tid=0 2023-03-17T10:57:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.601+0000 7f7d81c49b80 1 client.28855 shutdown 2023-03-17T10:57:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5ba4f0 msgr2=0x56299a5d49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5ba4f0 0x56299a5d49c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d680c78f0 tx=0x7f7d6800ce20 comp rx=0 tx=0).stop 2023-03-17T10:57:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 shutdown_connections 2023-03-17T10:57:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56299a644880 0x56299a646c90 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56299a5ba4f0 0x56299a5d49c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56299a5b4960 0x56299a5d3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 --2- 172.21.15.35:0/2666113442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56299a5b9be0 0x56299a5d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:40.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 >> 172.21.15.35:0/2666113442 conn(0x56299a4116b0 msgr2=0x56299a5da6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d4effd700 0 client.28855 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 shutdown_connections 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.602+0000 7f7d81c49b80 1 -- 172.21.15.35:0/2666113442 wait complete. 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.604+0000 7f7d81c49b80 20 client.28855 trim_cache size 0 max 16384 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f790 msgr2=0x7f7d580a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f790 0x7f7d580a1c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000b2e0 tx=0x7f7d60005fb0 comp rx=0 tx=0).stop 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 msgr2=0x7f7d700ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:40.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d700ffb80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800ef90 tx=0x7f7d6800c450 comp rx=0 tx=0).stop 2023-03-17T10:57:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 shutdown_connections 2023-03-17T10:57:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7d5809f790 0x7f7d580a1c40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d7010a7f0 0x7f7d700ffb80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:40.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7d701012d0 0x7f7d700ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 --2- 172.21.15.35:0/1522499900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d70101be0 0x7f7d700ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 >> 172.21.15.35:0/1522499900 conn(0x7f7d70077010 msgr2=0x7f7d700fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 shutdown_connections 2023-03-17T10:57:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:29:55.606+0000 7f7d75abc700 1 -- 172.21.15.35:0/1522499900 wait complete. 2023-03-17T10:57:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 -- 172.21.15.35:0/3222513447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 msgr2=0x7fe568104c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:41.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/3222513447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe568104c30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098f0 tx=0x7fe564009c00 comp rx=0 tx=0).stop 2023-03-17T10:57:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 -- 172.21.15.35:0/3222513447 shutdown_connections 2023-03-17T10:57:42.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/3222513447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680ff200 0x7fe56810b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/3222513447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe568104c30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/3222513447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680fe850 0x7fe5680fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 -- 172.21.15.35:0/3222513447 >> 172.21.15.35:0/3222513447 conn(0x7fe5680757a0 msgr2=0x7fe568075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 -- 172.21.15.35:0/3222513447 shutdown_connections 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.766+0000 7fe56f4b7700 1 -- 172.21.15.35:0/3222513447 wait complete. 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 Processor -- start 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 -- start start 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680fe850 0x7fe568194010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680ff200 0x7fe568194550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe5681989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568198ff0 con 0x7fe5680ff200 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568199160 con 0x7fe568104860 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56f4b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568199320 con 0x7fe5680fe850 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56d253700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680fe850 0x7fe568194010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.767+0000 7fe56ca52700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680ff200 0x7fe568194550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56da54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe5681989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56ca52700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680ff200 0x7fe568194550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52698/0 (socket says 172.21.15.35:52698) 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56da54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe5681989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54492/0 (socket says 172.21.15.35:54492) 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56ca52700 1 -- 172.21.15.35:0/2381612800 learned_addr learned my addr 172.21.15.35:0/2381612800 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56d253700 1 -- 172.21.15.35:0/2381612800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 msgr2=0x7fe5681989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56d253700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe5681989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56d253700 1 -- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680ff200 msgr2=0x7fe568194550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56d253700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680ff200 0x7fe568194550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56d253700 1 -- 172.21.15.35:0/2381612800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55800a700 con 0x7fe5680fe850 2023-03-17T10:57:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56da54700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe5681989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:57:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56d253700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680fe850 0x7fe568194010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe564009230 tx=0x7fe56400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe55e7fc700 1 -- 172.21.15.35:0/2381612800 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56401c070 con 0x7fe5680fe850 2023-03-17T10:57:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564009520 con 0x7fe5680fe850 2023-03-17T10:57:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe55e7fc700 1 -- 172.21.15.35:0/2381612800 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe56400b9f0 con 0x7fe5680fe850 2023-03-17T10:57:45.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.768+0000 7fe55e7fc700 1 -- 172.21.15.35:0/2381612800 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564003680 con 0x7fe5680fe850 2023-03-17T10:57:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.769+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56810dec0 con 0x7fe5680fe850 2023-03-17T10:57:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.772+0000 7fe55e7fc700 1 -- 172.21.15.35:0/2381612800 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe564020030 con 0x7fe5680fe850 2023-03-17T10:57:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe55e7fc700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe55409f6c0 0x7fe5540a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe55e7fc700 1 -- 172.21.15.35:0/2381612800 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(287..287 src has 1..287) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fe5640cb3c0 con 0x7fe5680fe850 2023-03-17T10:57:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe56ca52700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe55409f6c0 0x7fe5540a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:45.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe57b644b80 1 Processor -- start 2023-03-17T10:57:46.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe57b644b80 1 -- start start 2023-03-17T10:57:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe56ca52700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe55409f6c0 0x7fe5540a1b70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe568195620 tx=0x7fe558010040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.773+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b822be0 0x562e6b822fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b81d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 0x562e6b81dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe57b644b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b724010 con 0x562e6b81d960 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe57b644b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b776950 con 0x562e6b822be0 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe57b644b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b76fde0 con 0x562e6b8234f0 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56da54700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 0x562e6b81dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56da54700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 0x562e6b81dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52706/0 (socket says 172.21.15.35:52706) 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56da54700 1 -- 172.21.15.35:0/436936813 learned_addr learned my addr 172.21.15.35:0/436936813 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b822be0 0x562e6b822fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56ca52700 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b81d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 -- 172.21.15.35:0/436936813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 msgr2=0x562e6b81d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b81d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 -- 172.21.15.35:0/436936813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 msgr2=0x562e6b81dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 0x562e6b81dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 -- 172.21.15.35:0/436936813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e6b5f15d0 con 0x562e6b822be0 2023-03-17T10:57:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56da54700 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 0x562e6b81dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:57:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.774+0000 7fe56d253700 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b822be0 0x562e6b822fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5640c8b20 tx=0x7fe564005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6aa321aa4d977d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:50.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.775+0000 7fe5537fe700 1 -- 172.21.15.35:0/436936813 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a1030 con 0x562e6b822be0 2023-03-17T10:57:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.775+0000 7fe5537fe700 1 -- 172.21.15.35:0/436936813 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5640c8da0 con 0x562e6b822be0 2023-03-17T10:57:50.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.775+0000 7fe5537fe700 1 -- 172.21.15.35:0/436936813 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564099130 con 0x562e6b822be0 2023-03-17T10:57:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.775+0000 7fe57b644b80 1 -- 172.21.15.35:0/436936813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b822be0 msgr2=0x562e6b822fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.775+0000 7fe57b644b80 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b822be0 0x562e6b822fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5640c8b20 tx=0x7fe564005a00 comp rx=0 tx=0).stop 2023-03-17T10:57:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 -- 172.21.15.35:0/436936813 shutdown_connections 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b81d960 0x562e6b81dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b822be0 0x562e6b822fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 --2- 172.21.15.35:0/436936813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b81d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 -- 172.21.15.35:0/436936813 >> 172.21.15.35:0/436936813 conn(0x562e6b67a6b0 msgr2=0x562e6b817a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 -- 172.21.15.35:0/436936813 shutdown_connections 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 -- 172.21.15.35:0/436936813 wait complete. 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 -- start start 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.776+0000 7fe57b644b80 1 Processor -- start 2023-03-17T10:57:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b8291d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:54.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b822be0 0x562e6b82c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:54.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 0x562e6b82ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b5f38c0 con 0x562e6b8234f0 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b82d390 con 0x562e6b81d960 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b82d550 con 0x562e6b822be0 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe57b644b80 10 client.0 _ll_register_callbacks cb 0x562e6b615230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56da54700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 0x562e6b82ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56da54700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 0x562e6b82ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52712/0 (socket says 172.21.15.35:52712) 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56da54700 1 -- 172.21.15.35:0/3409579919 learned_addr learned my addr 172.21.15.35:0/3409579919 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b8291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56ca52700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b822be0 0x562e6b82c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 -- 172.21.15.35:0/3409579919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b822be0 msgr2=0x562e6b82c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b822be0 0x562e6b82c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 -- 172.21.15.35:0/3409579919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 msgr2=0x562e6b82ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 0x562e6b82ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 -- 172.21.15.35:0/3409579919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56810dec0 con 0x562e6b81d960 2023-03-17T10:57:54.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56da54700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 0x562e6b82ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe56d253700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b8291d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe564097220 tx=0x7fe5640c8fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7163b5734cae4a71 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.777+0000 7fe550ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe550ff9700 1 -- 172.21.15.35:0/3409579919 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a1030 con 0x562e6b81d960 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe550ff9700 1 -- 172.21.15.35:0/3409579919 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(287..287 src has 1..287) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fe564097270 con 0x562e6b81d960 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e6b732390 con 0x562e6b81d960 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe550ff9700 1 -- 172.21.15.35:0/3409579919 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe564005040 con 0x562e6b81d960 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 10 client.28889 fetch_fsmap learned FSMap version 73 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x562e6b59dd80 con 0x562e6b81d960 2023-03-17T10:57:54.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe550ff9700 1 -- 172.21.15.35:0/3409579919 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e6b732390 con 0x562e6b81d960 2023-03-17T10:57:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe550ff9700 1 -- 172.21.15.35:0/3409579919 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe564099130 con 0x562e6b81d960 2023-03-17T10:57:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 10 client.28889 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:57:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 10 client.28889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:57:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 20 client.28889 populate_metadata read hostname 'smithi035' 2023-03-17T10:57:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b83f130 0x562e6b841510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:57:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 4 client.28889 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:57:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e6b73e600 con 0x562e6b83f130 2023-03-17T10:57:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.778+0000 7fe56ca52700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b83f130 0x562e6b841510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:57:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.779+0000 7fe550ff9700 10 client.28889 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:57:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.779+0000 7fe56ca52700 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b83f130 0x562e6b841510 crc :-1 s=READY pgs=552 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b470d5bbe6154d2 server_cookie=d6e4e80840ead8e0 in_seq=0 out_seq=0 2023-03-17T10:57:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.779+0000 7fe550ff9700 1 -- 172.21.15.35:0/3409579919 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562e6b73e600 con 0x562e6b83f130 2023-03-17T10:57:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.779+0000 7fe550ff9700 10 client.28889 handle_command_reply: tid=0 2023-03-17T10:57:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 client.28889 shutdown 2023-03-17T10:57:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 msgr2=0x562e6b8291d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:57:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b8291d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe564097220 tx=0x7fe5640c8fd0 comp rx=0 tx=0).stop 2023-03-17T10:57:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 shutdown_connections 2023-03-17T10:57:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b83f130 0x562e6b841510 crc :-1 s=READY pgs=552 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b8234f0 0x562e6b82ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:57:58.506 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T10:57:58.508 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-03-17T10:58:01.088 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:44 smithi035 ceph-mon[92535]: pgmap v3966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:58:01.088 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:46 smithi035 ceph-mon[92535]: pgmap v3967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:58:01.088 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:47 smithi035 ceph-mon[92535]: pgmap v3968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:58:01.088 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:50 smithi035 ceph-mon[92535]: pgmap v3969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:58:01.088 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:52 smithi035 ceph-mon[92535]: pgmap v3970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:54 smithi035 ceph-mon[92535]: pgmap v3971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:56 smithi035 ceph-mon[92535]: pgmap v3972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:46:57 smithi035 ceph-mon[92535]: pgmap v3973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:00 smithi035 ceph-mon[92535]: pgmap v3974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:02 smithi035 ceph-mon[92535]: pgmap v3975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:04 smithi035 ceph-mon[92535]: pgmap v3976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T10:58:06.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:06 smithi035 ceph-mon[92535]: pgmap v3977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:07 smithi035 ceph-mon[92535]: pgmap v3978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:09 smithi035 ceph-mon[92535]: osdmap e322: 12 total, 12 up, 12 in 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:09 smithi035 ceph-mon[92535]: pgmap v3980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:12 smithi035 ceph-mon[92535]: pgmap v3981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:14 smithi035 ceph-mon[92535]: pgmap v3982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:16 smithi035 ceph-mon[92535]: pgmap v3983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:58:07.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:17 smithi035 ceph-mon[92535]: osdmap e323: 12 total, 12 up, 12 in 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:17 smithi035 ceph-mon[92535]: pgmap v3985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 13 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:20 smithi035 ceph-mon[92535]: pgmap v3986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:22 smithi035 ceph-mon[92535]: pgmap v3987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:24 smithi035 ceph-mon[92535]: pgmap v3988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:26 smithi035 ceph-mon[92535]: pgmap v3989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:27 smithi035 ceph-mon[92535]: pgmap v3990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 96 B/s wr, 15 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:30 smithi035 ceph-mon[92535]: pgmap v3991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:32 smithi035 ceph-mon[92535]: pgmap v3992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:34 smithi035 ceph-mon[92535]: pgmap v3993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:58:09.576 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:58:09.577 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:58:09.577 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:58:09.577 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:35 smithi035 ceph-mon[92535]: pgmap v3994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T10:58:09.577 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:35 smithi035 ceph-mon[92535]: pgmap v3995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:58:09.577 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:37 smithi035 ceph-mon[92535]: pgmap v3996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T10:58:09.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b8291d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 --2- 172.21.15.35:0/3409579919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b822be0 0x562e6b82c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe550ff9700 0 client.28889 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 >> 172.21.15.35:0/3409579919 conn(0x562e6b67a6b0 msgr2=0x562e6b81c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 shutdown_connections 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 1 -- 172.21.15.35:0/3409579919 wait complete. 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.780+0000 7fe57b644b80 20 client.28889 trim_cache size 0 max 16384 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 Processor -- start 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 -- start start 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b81d960 0x562e6b817ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b820d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 0x562e6b828c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b8130f0 con 0x562e6b822be0 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b818000 con 0x562e6b8234f0 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.805+0000 7fe57b644b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b8186d0 con 0x562e6b81d960 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56ca52700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b820d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:09.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 0x562e6b828c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 0x562e6b828c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54516/0 (socket says 172.21.15.35:54516) 2023-03-17T10:58:09.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56ca52700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b820d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52718/0 (socket says 172.21.15.35:52718) 2023-03-17T10:58:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 -- 172.21.15.35:0/4201493865 learned_addr learned my addr 172.21.15.35:0/4201493865 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:12.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56d253700 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b81d960 0x562e6b817ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 -- 172.21.15.35:0/4201493865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b81d960 msgr2=0x562e6b817ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b81d960 0x562e6b817ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 -- 172.21.15.35:0/4201493865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 msgr2=0x562e6b820d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b820d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 -- 172.21.15.35:0/4201493865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e6b736130 con 0x562e6b8234f0 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe56da54700 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 0x562e6b828c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe560004480 tx=0x7fe560009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e7735e60f0b4b81 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.806+0000 7fe553fff700 1 -- 172.21.15.35:0/4201493865 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000e920 con 0x562e6b8234f0 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe553fff700 1 -- 172.21.15.35:0/4201493865 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe56000f040 con 0x562e6b8234f0 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe553fff700 1 -- 172.21.15.35:0/4201493865 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560007c60 con 0x562e6b8234f0 2023-03-17T10:58:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 -- 172.21.15.35:0/4201493865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 msgr2=0x562e6b828c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 0x562e6b828c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe560004480 tx=0x7fe560009920 comp rx=0 tx=0).stop 2023-03-17T10:58:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 -- 172.21.15.35:0/4201493865 shutdown_connections 2023-03-17T10:58:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b8234f0 0x562e6b828c60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b81d960 0x562e6b817ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 --2- 172.21.15.35:0/4201493865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b820d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:17.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.807+0000 7fe57b644b80 1 -- 172.21.15.35:0/4201493865 >> 172.21.15.35:0/4201493865 conn(0x562e6b67a6b0 msgr2=0x562e6b820650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.808+0000 7fe57b644b80 1 -- 172.21.15.35:0/4201493865 shutdown_connections 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.808+0000 7fe57b644b80 1 -- 172.21.15.35:0/4201493865 wait complete. 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.808+0000 7fe57b644b80 1 -- start start 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.808+0000 7fe57b644b80 1 Processor -- start 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b83be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b838180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b8386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b83c780 con 0x562e6b822be0 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b838c00 con 0x562e6b81d960 2023-03-17T10:58:17.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6b838dc0 con 0x562e6b8234f0 2023-03-17T10:58:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe57b644b80 10 client.0 _ll_register_callbacks cb 0x562e6b615230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:58:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56ca52700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b838180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b83be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b83be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54518/0 (socket says 172.21.15.35:54518) 2023-03-17T10:58:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56ca52700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b838180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52724/0 (socket says 172.21.15.35:52724) 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 -- 172.21.15.35:0/2688911305 learned_addr learned my addr 172.21.15.35:0/2688911305 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56da54700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b8386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 -- 172.21.15.35:0/2688911305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 msgr2=0x562e6b8386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b8386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 -- 172.21.15.35:0/2688911305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 msgr2=0x562e6b838180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b838180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 -- 172.21.15.35:0/2688911305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe560004130 con 0x562e6b81d960 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56ca52700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b838180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe56d253700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b83be70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe5640977c0 tx=0x7fe564098950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e091fdd09f18c842 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.809+0000 7fe550ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe550ff9700 1 -- 172.21.15.35:0/2688911305 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a1030 con 0x562e6b81d960 2023-03-17T10:58:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe550ff9700 1 -- 172.21.15.35:0/2688911305 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(287..287 src has 1..287) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fe564097270 con 0x562e6b81d960 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e6b7ed1e0 con 0x562e6b81d960 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe550ff9700 1 -- 172.21.15.35:0/2688911305 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5640983c0 con 0x562e6b81d960 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 10 client.28895 fetch_fsmap learned FSMap version 73 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x562e6b5c41f0 con 0x562e6b81d960 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe550ff9700 1 -- 172.21.15.35:0/2688911305 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e6b7ed1e0 con 0x562e6b81d960 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe550ff9700 1 -- 172.21.15.35:0/2688911305 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe564081020 con 0x562e6b81d960 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 10 client.28895 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 10 client.28895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:58:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 20 client.28895 populate_metadata read hostname 'smithi035' 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b8a4c80 0x562e6b8a7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 4 client.28895 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.810+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e6b5f3f00 con 0x562e6b8a4c80 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.811+0000 7fe56ca52700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b8a4c80 0x562e6b8a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.811+0000 7fe56ca52700 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b8a4c80 0x562e6b8a7060 crc :-1 s=READY pgs=553 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7147e9298b1b5ef0 server_cookie=87f850ec5f327f3b in_seq=0 out_seq=0 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.811+0000 7fe550ff9700 10 client.28895 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.867+0000 7fe550ff9700 1 -- 172.21.15.35:0/2688911305 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e6b5f3f00 con 0x562e6b8a4c80 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.867+0000 7fe550ff9700 10 client.28895 handle_command_reply: tid=0 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 client.28895 shutdown 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 msgr2=0x562e6b83be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b83be70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe5640977c0 tx=0x7fe564098950 comp rx=0 tx=0).stop 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 shutdown_connections 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562e6b8a4c80 0x562e6b8a7060 crc :-1 s=READY pgs=553 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562e6b8234f0 0x562e6b8386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe550ff9700 0 client.28895 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562e6b81d960 0x562e6b83be70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 --2- 172.21.15.35:0/2688911305 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562e6b822be0 0x562e6b838180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 >> 172.21.15.35:0/2688911305 conn(0x562e6b67a6b0 msgr2=0x562e6b829b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 shutdown_connections 2023-03-17T10:58:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 1 -- 172.21.15.35:0/2688911305 wait complete. 2023-03-17T10:58:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.868+0000 7fe57b644b80 20 client.28895 trim_cache size 0 max 16384 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe55409f6c0 msgr2=0x7fe5540a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe55409f6c0 0x7fe5540a1b70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe568195620 tx=0x7fe558010040 comp rx=0 tx=0).stop 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680fe850 msgr2=0x7fe568194010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680fe850 0x7fe568194010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe564009230 tx=0x7fe56400fa00 comp rx=0 tx=0).stop 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 shutdown_connections 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe55409f6c0 0x7fe5540a1b70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe568104860 0x7fe5681989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5680fe850 0x7fe568194010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 --2- 172.21.15.35:0/2381612800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe5680ff200 0x7fe568194550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.870+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 >> 172.21.15.35:0/2381612800 conn(0x7fe5680757a0 msgr2=0x7fe5680fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.871+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 shutdown_connections 2023-03-17T10:58:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:08.871+0000 7fe56f4b7700 1 -- 172.21.15.35:0/2381612800 wait complete. 2023-03-17T10:58:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.025+0000 7f8ed39a1700 1 -- 172.21.15.35:0/3845342201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 msgr2=0x7f8ecc10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/3845342201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc10d100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009920 tx=0x7f8ebc009c30 comp rx=0 tx=0).stop 2023-03-17T10:58:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 -- 172.21.15.35:0/3845342201 shutdown_connections 2023-03-17T10:58:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/3845342201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc10d100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:27.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/3845342201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc100be0 0x7f8ecc100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/3845342201 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc101580 0x7f8ecc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 -- 172.21.15.35:0/3845342201 >> 172.21.15.35:0/3845342201 conn(0x7f8ecc0774e0 msgr2=0x7f8ecc0778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 -- 172.21.15.35:0/3845342201 shutdown_connections 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.026+0000 7f8ed39a1700 1 -- 172.21.15.35:0/3845342201 wait complete. 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 Processor -- start 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 -- start start 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 0x7f8ecc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc101580 0x7f8ecc196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19b2e0 con 0x7f8ecc100be0 2023-03-17T10:58:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19b450 con 0x7f8ecc101580 2023-03-17T10:58:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed39a1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19b610 con 0x7f8ecc1054f0 2023-03-17T10:58:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 0x7f8ecc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:30.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 0x7f8ecc196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52736/0 (socket says 172.21.15.35:52736) 2023-03-17T10:58:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed173d700 1 -- 172.21.15.35:0/864756001 learned_addr learned my addr 172.21.15.35:0/864756001 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.027+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc101580 0x7f8ecc196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed173d700 1 -- 172.21.15.35:0/864756001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 msgr2=0x7f8ecc19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed173d700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed173d700 1 -- 172.21.15.35:0/864756001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc101580 msgr2=0x7f8ecc196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed173d700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc101580 0x7f8ecc196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed173d700 1 -- 172.21.15.35:0/864756001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009520 con 0x7f8ecc100be0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc101580 0x7f8ecc196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed173d700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 0x7f8ecc196300 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400ef30 tx=0x7f8ec400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ec27fc700 1 -- 172.21.15.35:0/864756001 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4018070 con 0x7f8ecc100be0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc110210 con 0x7f8ecc100be0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ec27fc700 1 -- 172.21.15.35:0/864756001 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec400f040 con 0x7f8ecc100be0 2023-03-17T10:58:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc110080 con 0x7f8ecc100be0 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.028+0000 7f8ec27fc700 1 -- 172.21.15.35:0/864756001 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4003ce0 con 0x7f8ecc100be0 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.031+0000 7f8ec27fc700 1 -- 172.21.15.35:0/864756001 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8ec400ca60 con 0x7f8ecc100be0 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.032+0000 7f8ec27fc700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8eb809f640 0x7f8eb80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.032+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8eb809f640 0x7f8eb80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.032+0000 7f8ec27fc700 1 -- 172.21.15.35:0/864756001 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8ec40ca2f0 con 0x7f8ecc100be0 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 Processor -- start 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 -- start start 2023-03-17T10:58:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8eb809f640 0x7f8eb80a1af0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc197910 tx=0x7f8ec8009310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd35fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd30420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd30d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edc37010 con 0x5626edd364f0 2023-03-17T10:58:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edc89950 con 0x5626edd35be0 2023-03-17T10:58:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edc82de0 con 0x5626edd30960 2023-03-17T10:58:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8ed0f3c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd30420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8ed1f3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd30d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8ed1f3e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd30d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44512/0 (socket says 172.21.15.35:44512) 2023-03-17T10:58:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.033+0000 7f8ed1f3e700 1 -- 172.21.15.35:0/1990685428 learned_addr learned my addr 172.21.15.35:0/1990685428 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed173d700 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd35fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed1f3e700 1 -- 172.21.15.35:0/1990685428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 msgr2=0x5626edd35fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd35fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:36.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:39 smithi035 ceph-mon[92535]: pgmap v3997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:58:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed1f3e700 1 -- 172.21.15.35:0/1990685428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 msgr2=0x5626edd30420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd30420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed1f3e700 1 -- 172.21.15.35:0/1990685428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626edb045d0 con 0x5626edd30960 2023-03-17T10:58:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd30420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:58:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd30d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0094b0 tx=0x7f8ebc00bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89675cf89c7661d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8eb77fe700 1 -- 172.21.15.35:0/1990685428 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc01c040 con 0x5626edd30960 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8eb77fe700 1 -- 172.21.15.35:0/1990685428 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ebc00f8f0 con 0x5626edd30960 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.034+0000 7f8eb77fe700 1 -- 172.21.15.35:0/1990685428 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0052a0 con 0x5626edd30960 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1990685428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 msgr2=0x5626edd30d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd30d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0094b0 tx=0x7f8ebc00bec0 comp rx=0 tx=0).stop 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1990685428 shutdown_connections 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd30d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd35fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1990685428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd30420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1990685428 >> 172.21.15.35:0/1990685428 conn(0x5626edb8d6b0 msgr2=0x5626edd2aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1990685428 shutdown_connections 2023-03-17T10:58:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.035+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1990685428 wait complete. 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 -- start start 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 Processor -- start 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd3c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd35be0 0x5626edd397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd364f0 0x5626edd39d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edb068c0 con 0x5626edd35be0 2023-03-17T10:58:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd3a4f0 con 0x5626edd364f0 2023-03-17T10:58:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd45fa0 con 0x5626edd30960 2023-03-17T10:58:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.036+0000 7f8edfb2eb80 10 client.0 _ll_register_callbacks cb 0x5626edb28230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:58:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed0f3c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd35be0 0x5626edd397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd3c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed0f3c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd35be0 0x5626edd397c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52752/0 (socket says 172.21.15.35:52752) 2023-03-17T10:58:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd3c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44516/0 (socket says 172.21.15.35:44516) 2023-03-17T10:58:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed0f3c700 1 -- 172.21.15.35:0/1410562613 learned_addr learned my addr 172.21.15.35:0/1410562613 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd364f0 0x5626edd39d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 -- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd364f0 msgr2=0x5626edd39d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd364f0 0x5626edd39d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 -- 172.21.15.35:0/1410562613 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd35be0 msgr2=0x5626edd397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd35be0 0x5626edd397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 -- 172.21.15.35:0/1410562613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc10d940 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8ed173d700 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd3c4d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40c7a80 tx=0x7f8ec4004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53bc8a862f63f939 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8eb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/1410562613 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40982a0 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/1410562613 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8ec4097320 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.037+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626edc45390 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/1410562613 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec40974e0 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 10 client.28885 fetch_fsmap learned FSMap version 73 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x5626edab0d80 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/1410562613 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626edc45390 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/1410562613 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8ec4093e20 con 0x5626edd30960 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 10 client.28885 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 10 client.28885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 20 client.28885 populate_metadata read hostname 'smithi035' 2023-03-17T10:58:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edd49e90 0x5626edd4c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 4 client.28885 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626edc51600 con 0x5626edd49e90 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.038+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edd49e90 0x5626edd4c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.039+0000 7f8eb4ff9700 10 client.28885 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.039+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edd49e90 0x5626edd4c2a0 crc :-1 s=READY pgs=554 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a95d4e05b6a5f9 server_cookie=f23c89157fa96b53 in_seq=0 out_seq=0 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/1410562613 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5626edc51600 con 0x5626edd49e90 2023-03-17T10:58:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8eb4ff9700 10 client.28885 handle_command_reply: tid=0 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 client.28885 shutdown 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 msgr2=0x5626edd3c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd3c4d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40c7a80 tx=0x7f8ec4004c10 comp rx=0 tx=0).stop 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 shutdown_connections 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edd49e90 0x5626edd4c2a0 crc :-1 s=READY pgs=554 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd364f0 0x5626edd39d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8eb4ff9700 0 client.28885 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd3c4d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:44.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/1410562613 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd35be0 0x5626edd397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 >> 172.21.15.35:0/1410562613 conn(0x5626edb8d6b0 msgr2=0x5626edd2f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 shutdown_connections 2023-03-17T10:58:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/1410562613 wait complete. 2023-03-17T10:58:46.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.040+0000 7f8edfb2eb80 20 client.28885 trim_cache size 0 max 16384 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 Processor -- start 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 -- start start 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd38fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd2b380 con 0x5626edd364f0 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd469d0 con 0x5626edd35be0 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd27b60 con 0x5626edd30960 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44524/0 (socket says 172.21.15.35:44524) 2023-03-17T10:58:48.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8ed0f3c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8ed173d700 1 -- 172.21.15.35:0/774112925 learned_addr learned my addr 172.21.15.35:0/774112925 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.063+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd38fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed0f3c700 1 -- 172.21.15.35:0/774112925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 msgr2=0x5626edd40ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed0f3c700 1 -- 172.21.15.35:0/774112925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 msgr2=0x5626edd38fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd38fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed0f3c700 1 -- 172.21.15.35:0/774112925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626edc49130 con 0x5626edd35be0 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed173d700 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3c070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5626edd4cb50 tx=0x7f8ec8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549b4c11ecd29096 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8eb7fff700 1 -- 172.21.15.35:0/774112925 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8024040 con 0x5626edd35be0 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8eb7fff700 1 -- 172.21.15.35:0/774112925 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec8029dd0 con 0x5626edd35be0 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.064+0000 7f8eb7fff700 1 -- 172.21.15.35:0/774112925 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec801e860 con 0x5626edd35be0 2023-03-17T10:58:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/774112925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 msgr2=0x5626edd3c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3c070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5626edd4cb50 tx=0x7f8ec8014000 comp rx=0 tx=0).stop 2023-03-17T10:58:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/774112925 shutdown_connections 2023-03-17T10:58:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd38fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/774112925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3c070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/774112925 >> 172.21.15.35:0/774112925 conn(0x5626edb8d6b0 msgr2=0x5626edd462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/774112925 shutdown_connections 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.065+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/774112925 wait complete. 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 -- start start 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 Processor -- start 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd3f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd3fed0 con 0x5626edd364f0 2023-03-17T10:58:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd40040 con 0x5626edd35be0 2023-03-17T10:58:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626edd9dd40 con 0x5626edd30960 2023-03-17T10:58:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.066+0000 7f8edfb2eb80 10 client.0 _ll_register_callbacks cb 0x5626edb28230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:58:53.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed0f3c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed0f3c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54562/0 (socket says 172.21.15.35:54562) 2023-03-17T10:58:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed0f3c700 1 -- 172.21.15.35:0/3433297969 learned_addr learned my addr 172.21.15.35:0/3433297969 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:58:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44530/0 (socket says 172.21.15.35:44530) 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed1f3e700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd3f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 -- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 msgr2=0x5626edd3f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 -- 172.21.15.35:0/3433297969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 msgr2=0x5626edd3f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd3f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 -- 172.21.15.35:0/3433297969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626edab0d80 con 0x5626edd30960 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8ed173d700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400ef00 tx=0x7f8ec40c8010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fc0fd848f84ca15 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:58:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8eb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:58:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/3433297969 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40982a0 con 0x5626edd30960 2023-03-17T10:58:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/3433297969 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8ec4097e30 con 0x5626edd30960 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.067+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626edd001e0 con 0x5626edd30960 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/3433297969 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec4097530 con 0x5626edd30960 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 10 client.28891 fetch_fsmap learned FSMap version 73 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7f8ec8004270 con 0x5626edd30960 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/3433297969 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626edd001e0 con 0x5626edd30960 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/3433297969 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8ec4093cb0 con 0x5626edd30960 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 10 client.28891 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 10 client.28891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 20 client.28891 populate_metadata read hostname 'smithi035' 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edda7830 0x5626edda9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 4 client.28891 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:58:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5626edb06f00 con 0x5626edda7830 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.068+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edda7830 0x5626edda9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.069+0000 7f8ed0f3c700 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edda7830 0x5626edda9c40 crc :-1 s=READY pgs=555 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cafc8cffeaeae1 server_cookie=dac45c59b80830e8 in_seq=0 out_seq=0 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.069+0000 7f8eb4ff9700 10 client.28891 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8eb4ff9700 1 -- 172.21.15.35:0/3433297969 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5626edb06f00 con 0x5626edda7830 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8eb4ff9700 10 client.28891 handle_command_reply: tid=0 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 client.28891 shutdown 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 msgr2=0x5626edd40e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400ef00 tx=0x7f8ec40c8010 comp rx=0 tx=0).stop 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 shutdown_connections 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5626edda7830 0x5626edda9c40 crc :-1 s=READY pgs=555 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626edd364f0 0x5626edd3f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8eb4ff9700 0 client.28891 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626edd30960 0x5626edd40e70 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400ef00 tx=0x7f8ec40c8010 comp rx=0 tx=0).stop 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 --2- 172.21.15.35:0/3433297969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626edd35be0 0x5626edd3f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.133+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 >> 172.21.15.35:0/3433297969 conn(0x5626edb8d6b0 msgr2=0x5626edd336b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.135+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 shutdown_connections 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.135+0000 7f8edfb2eb80 1 -- 172.21.15.35:0/3433297969 wait complete. 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.135+0000 7f8edfb2eb80 20 client.28891 trim_cache size 0 max 16384 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8eb809f640 msgr2=0x7f8eb80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8eb809f640 0x7f8eb80a1af0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc197910 tx=0x7f8ec8009310 comp rx=0 tx=0).stop 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 msgr2=0x7f8ecc196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 0x7f8ecc196300 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400ef30 tx=0x7f8ec400c450 comp rx=0 tx=0).stop 2023-03-17T10:58:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 shutdown_connections 2023-03-17T10:58:59.942 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:41 smithi035 ceph-mon[92535]: pgmap v3998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:59:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8eb809f640 0x7f8eb80a1af0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1054f0 0x7f8ecc19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8ecc100be0 0x7f8ecc196300 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 --2- 172.21.15.35:0/864756001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ecc101580 0x7f8ecc196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 >> 172.21.15.35:0/864756001 conn(0x7f8ecc0774e0 msgr2=0x7f8ecc0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 shutdown_connections 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:22.136+0000 7f8ed39a1700 1 -- 172.21.15.35:0/864756001 wait complete. 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 -- 172.21.15.35:0/118286458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee4104390 msgr2=0x7f9ee410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 --2- 172.21.15.35:0/118286458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee4104390 0x7f9ee410bf60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009f90 tx=0x7f9edc00b330 comp rx=0 tx=0).stop 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 -- 172.21.15.35:0/118286458 shutdown_connections 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 --2- 172.21.15.35:0/118286458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee4104390 0x7f9ee410bf60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 --2- 172.21.15.35:0/118286458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ff350 0x7f9ee40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 --2- 172.21.15.35:0/118286458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 -- 172.21.15.35:0/118286458 >> 172.21.15.35:0/118286458 conn(0x7f9ee4076330 msgr2=0x7f9ee4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 -- 172.21.15.35:0/118286458 shutdown_connections 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.252+0000 7f9eea03f700 1 -- 172.21.15.35:0/118286458 wait complete. 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.253+0000 7f9eea03f700 1 Processor -- start 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.253+0000 7f9eea03f700 1 -- start start 2023-03-17T10:59:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9eea03f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee40ff350 0x7f9ee41963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9eea03f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9eea03f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104390 0x7f9ee419ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9eea03f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee419b3b0 con 0x7f9ee40ffcf0 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9eea03f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee419b520 con 0x7f9ee40ff350 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9eea03f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee419b6e0 con 0x7f9ee4104390 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52780/0 (socket says 172.21.15.35:52780) 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee2ffd700 1 -- 172.21.15.35:0/2975403198 learned_addr learned my addr 172.21.15.35:0/2975403198 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104390 0x7f9ee419ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee40ff350 0x7f9ee41963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee3fff700 1 -- 172.21.15.35:0/2975403198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee40ff350 msgr2=0x7f9ee41963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee40ff350 0x7f9ee41963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee3fff700 1 -- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 msgr2=0x7f9ee4196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee3fff700 1 -- 172.21.15.35:0/2975403198 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80095f0 con 0x7f9ee4104390 2023-03-17T10:59:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.254+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:59:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.255+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104390 0x7f9ee419ad70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b6c0 tx=0x7f9edc008aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.255+0000 7f9ee0ff9700 1 -- 172.21.15.35:0/2975403198 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e040 con 0x7f9ee4104390 2023-03-17T10:59:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.255+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc009c40 con 0x7f9ee4104390 2023-03-17T10:59:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.255+0000 7f9ee0ff9700 1 -- 172.21.15.35:0/2975403198 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9edc00bbf0 con 0x7f9ee4104390 2023-03-17T10:59:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.255+0000 7f9ee0ff9700 1 -- 172.21.15.35:0/2975403198 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0052a0 con 0x7f9ee4104390 2023-03-17T10:59:02.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.255+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee40688b0 con 0x7f9ee4104390 2023-03-17T10:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.258+0000 7f9ee0ff9700 1 -- 172.21.15.35:0/2975403198 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9edc01d470 con 0x7f9ee4104390 2023-03-17T10:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.259+0000 7f9ee0ff9700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ecc09f640 0x7f9ecc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.259+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ecc09f640 0x7f9ecc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.259+0000 7f9ee0ff9700 1 -- 172.21.15.35:0/2975403198 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9edc0cba90 con 0x7f9ee4104390 2023-03-17T10:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.259+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ecc09f640 0x7f9ecc0a1af0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8005fd0 tx=0x7f9ed8009310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 Processor -- start 2023-03-17T10:59:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 -- start start 2023-03-17T10:59:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f689fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 0x56099f684420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:04.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f684960 0x56099f684d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f58b010 con 0x56099f68a4f0 2023-03-17T10:59:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f5dd950 con 0x56099f684960 2023-03-17T10:59:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f5d6de0 con 0x56099f689be0 2023-03-17T10:59:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 0x56099f684420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 0x56099f684420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52788/0 (socket says 172.21.15.35:52788) 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ee2ffd700 1 -- 172.21.15.35:0/765102771 learned_addr learned my addr 172.21.15.35:0/765102771 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f684960 0x56099f684d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.270+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f689fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee2ffd700 1 -- 172.21.15.35:0/765102771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 msgr2=0x56099f689fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f689fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee2ffd700 1 -- 172.21.15.35:0/765102771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f684960 msgr2=0x56099f684d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f684960 0x56099f684d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee2ffd700 1 -- 172.21.15.35:0/765102771 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099f4585d0 con 0x56099f68a4f0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f684960 0x56099f684d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 0x56099f684420 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40115f0 tx=0x7f9ed4011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a78c79e155160 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ec9ffb700 1 -- 172.21.15.35:0/765102771 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4019630 con 0x56099f68a4f0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ec9ffb700 1 -- 172.21.15.35:0/765102771 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ed4019c20 con 0x56099f68a4f0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.271+0000 7f9ec9ffb700 1 -- 172.21.15.35:0/765102771 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400ec70 con 0x56099f68a4f0 2023-03-17T10:59:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/765102771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 msgr2=0x56099f684420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:08.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 0x56099f684420 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40115f0 tx=0x7f9ed4011900 comp rx=0 tx=0).stop 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/765102771 shutdown_connections 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f684960 0x56099f684d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f689fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/765102771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f68a4f0 0x56099f684420 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/765102771 >> 172.21.15.35:0/765102771 conn(0x56099f4e16b0 msgr2=0x56099f67ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/765102771 shutdown_connections 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.272+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/765102771 wait complete. 2023-03-17T10:59:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.273+0000 7f9ef61ccb80 1 -- start start 2023-03-17T10:59:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.273+0000 7f9ef61ccb80 1 Processor -- start 2023-03-17T10:59:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.273+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f690430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.273+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f689be0 0x56099f68d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.273+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f68a4f0 0x56099f68dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.273+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f45a8c0 con 0x56099f684960 2023-03-17T10:59:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f68e4a0 con 0x56099f689be0 2023-03-17T10:59:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f69a000 con 0x56099f68a4f0 2023-03-17T10:59:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ef61ccb80 10 client.0 _ll_register_callbacks cb 0x56099f47c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:59:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f690430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f690430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52792/0 (socket says 172.21.15.35:52792) 2023-03-17T10:59:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f68a4f0 0x56099f68dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2181287434 learned_addr learned my addr 172.21.15.35:0/2181287434 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2181287434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f68a4f0 msgr2=0x56099f68dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f68a4f0 0x56099f68dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f689be0 msgr2=0x56099f68d720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-17T10:59:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f689be0 0x56099f68d720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2181287434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed4009d40 con 0x56099f684960 2023-03-17T10:59:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f690430 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8012c40 tx=0x7f9ed80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa226dc0cc21c27 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.274+0000 7f9ec2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T10:59:15.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/2181287434 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed801f850 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56099f599390 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/2181287434 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9ed8018070 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/2181287434 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed801f9b0 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 10 client.19761 fetch_fsmap learned FSMap version 73 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x56099f404d80 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/2181287434 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56099f599390 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/2181287434 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9ed8029c40 con 0x56099f684960 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 10 client.19761 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 10 client.19761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 20 client.19761 populate_metadata read hostname 'smithi035' 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f69e1a0 0x56099f6a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:16.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 4 client.19761 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.275+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56099f5a5600 con 0x56099f69e1a0 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.276+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f69e1a0 0x56099f6a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.277+0000 7f9ec2ffd700 10 client.19761 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.277+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f69e1a0 0x56099f6a05b0 crc :-1 s=READY pgs=556 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86945f4d53aa48d8 server_cookie=547b1b1cea770aa3 in_seq=0 out_seq=0 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.277+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/2181287434 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56099f5a5600 con 0x56099f69e1a0 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.277+0000 7f9ec2ffd700 10 client.19761 handle_command_reply: tid=0 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.277+0000 7f9ef61ccb80 1 client.19761 shutdown 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 msgr2=0x56099f690430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f690430 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8012c40 tx=0x7f9ed80047c0 comp rx=0 tx=0).stop 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 shutdown_connections 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f69e1a0 0x56099f6a05b0 crc :-1 s=READY pgs=556 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:16.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f68a4f0 0x56099f68dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f690430 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2181287434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f689be0 0x56099f68d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 >> 172.21.15.35:0/2181287434 conn(0x56099f4e16b0 msgr2=0x56099f683410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ec2ffd700 0 client.19761 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 shutdown_connections 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2181287434 wait complete. 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.278+0000 7f9ef61ccb80 20 client.19761 trim_cache size 0 max 16384 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 Processor -- start 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 -- start start 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f694f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f6a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f68ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f69aaa0 con 0x56099f684960 2023-03-17T10:59:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f67a0f0 con 0x56099f68a4f0 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.300+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f690a10 con 0x56099f689be0 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f694f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f6a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f694f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52800/0 (socket says 172.21.15.35:52800) 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f68ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2243857111 learned_addr learned my addr 172.21.15.35:0/2243857111 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2243857111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 msgr2=0x56099f6a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f6a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2243857111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 msgr2=0x56099f68ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f68ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 -- 172.21.15.35:0/2243857111 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56099f59d130 con 0x56099f684960 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f6a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f68ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f694f50 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9ed802aff0 tx=0x7f9ed8009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d452b877b46a3ff server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.301+0000 7f9eca7fc700 1 -- 172.21.15.35:0/2243857111 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011ed0 con 0x56099f684960 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9eca7fc700 1 -- 172.21.15.35:0/2243857111 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ed8024070 con 0x56099f684960 2023-03-17T10:59:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9eca7fc700 1 -- 172.21.15.35:0/2243857111 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8029430 con 0x56099f684960 2023-03-17T10:59:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2243857111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 msgr2=0x56099f694f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f694f50 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f9ed802aff0 tx=0x7f9ed8009c40 comp rx=0 tx=0).stop 2023-03-17T10:59:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2243857111 shutdown_connections 2023-03-17T10:59:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f68ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f684960 0x56099f694f50 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/2243857111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f689be0 0x56099f6a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:20.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:42 smithi035 ceph-mon[92535]: pgmap v3999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T10:59:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2243857111 >> 172.21.15.35:0/2243857111 conn(0x56099f4e16b0 msgr2=0x56099f69a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2243857111 shutdown_connections 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.302+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/2243857111 wait complete. 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.303+0000 7f9ef61ccb80 1 -- start start 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.303+0000 7f9ef61ccb80 1 Processor -- start 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.303+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 0x56099f693120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.303+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f689be0 0x56099f693660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.303+0000 7f9ef61ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f6eb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f6eb5c0 con 0x56099f689be0 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f6eb730 con 0x56099f68a4f0 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ef61ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56099f6eb8f0 con 0x56099f684960 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ef61ccb80 10 client.0 _ll_register_callbacks cb 0x56099f47c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 0x56099f693120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f689be0 0x56099f693660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 0x56099f693120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44572/0 (socket says 172.21.15.35:44572) 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 -- 172.21.15.35:0/1819882381 learned_addr learned my addr 172.21.15.35:0/1819882381 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee3fff700 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f6eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 -- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 msgr2=0x56099f6eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f6eb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 -- 172.21.15.35:0/1819882381 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f689be0 msgr2=0x56099f693660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f689be0 0x56099f693660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 -- 172.21.15.35:0/1819882381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56099f4585d0 con 0x56099f684960 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ee37fe700 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 0x56099f693120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8020430 tx=0x7f9ed801f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4683516d987cea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ec2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.304+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/1819882381 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80205d0 con 0x56099f684960 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56099f6541e0 con 0x56099f684960 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/1819882381 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9ed8018040 con 0x56099f684960 2023-03-17T10:59:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/1819882381 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed8020730 con 0x56099f684960 2023-03-17T10:59:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 10 client.28909 fetch_fsmap learned FSMap version 73 2023-03-17T10:59:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7f9edc009c40 con 0x56099f684960 2023-03-17T10:59:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/1819882381 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56099f6541e0 con 0x56099f684960 2023-03-17T10:59:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/1819882381 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9ed8004710 con 0x56099f684960 2023-03-17T10:59:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 10 client.28909 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T10:59:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 10 client.28909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T10:59:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 20 client.28909 populate_metadata read hostname 'smithi035' 2023-03-17T10:59:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f6f2c40 0x56099f6f5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 4 client.28909 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T10:59:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56099f45af00 con 0x56099f6f2c40 2023-03-17T10:59:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.305+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f6f2c40 0x56099f6f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.306+0000 7f9ee2ffd700 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f6f2c40 0x56099f6f5020 crc :-1 s=READY pgs=557 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62998f3314e3d0e server_cookie=55915fb19ffedc2d in_seq=0 out_seq=0 2023-03-17T10:59:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.306+0000 7f9ec2ffd700 10 client.28909 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T10:59:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ec2ffd700 1 -- 172.21.15.35:0/1819882381 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56099f45af00 con 0x56099f6f2c40 2023-03-17T10:59:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ec2ffd700 10 client.28909 handle_command_reply: tid=0 2023-03-17T10:59:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 client.28909 shutdown 2023-03-17T10:59:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 msgr2=0x56099f693120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 0x56099f693120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8020430 tx=0x7f9ed801f950 comp rx=0 tx=0).stop 2023-03-17T10:59:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 shutdown_connections 2023-03-17T10:59:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56099f6f2c40 0x56099f6f5020 crc :-1 s=READY pgs=557 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56099f68a4f0 0x56099f6eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ec2ffd700 0 client.28909 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56099f684960 0x56099f693120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 --2- 172.21.15.35:0/1819882381 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56099f689be0 0x56099f693660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 >> 172.21.15.35:0/1819882381 conn(0x56099f4e16b0 msgr2=0x56099f6a01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 shutdown_connections 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 1 -- 172.21.15.35:0/1819882381 wait complete. 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.366+0000 7f9ef61ccb80 20 client.28909 trim_cache size 0 max 16384 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ecc09f640 msgr2=0x7f9ecc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ecc09f640 0x7f9ecc0a1af0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8005fd0 tx=0x7f9ed8009310 comp rx=0 tx=0).stop 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104390 msgr2=0x7f9ee419ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104390 0x7f9ee419ad70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b6c0 tx=0x7f9edc008aa0 comp rx=0 tx=0).stop 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 shutdown_connections 2023-03-17T10:59:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9ecc09f640 0x7f9ecc0a1af0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ee4104390 0x7f9ee419ad70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ee40ff350 0x7f9ee41963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 --2- 172.21.15.35:0/2975403198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9ee40ffcf0 0x7f9ee4196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 >> 172.21.15.35:0/2975403198 conn(0x7f9ee4076330 msgr2=0x7f9ee40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 shutdown_connections 2023-03-17T10:59:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:38.367+0000 7f9eea03f700 1 -- 172.21.15.35:0/2975403198 wait complete. 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1625308835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 msgr2=0x7f9d901017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1625308835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d901017a0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009990 tx=0x7f9d80009ca0 comp rx=0 tx=0).stop 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1625308835 shutdown_connections 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1625308835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9010a7a0 0x7f9d9010cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1625308835 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d901017a0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1625308835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d90101ce0 0x7f9d9010a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1625308835 >> 172.21.15.35:0/1625308835 conn(0x7f9d90076330 msgr2=0x7f9d90076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1625308835 shutdown_connections 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.754+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1625308835 wait complete. 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 Processor -- start 2023-03-17T10:59:35.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 -- start start 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d90196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 0x7f9d90196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9010a7a0 0x7f9d9019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9019b220 con 0x7f9d901013d0 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9019b390 con 0x7f9d90101ce0 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.755+0000 7f9d95cb3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9019b550 con 0x7f9d9010a7a0 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 0x7f9d90196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9010a7a0 0x7f9d9019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 0x7f9d90196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54616/0 (socket says 172.21.15.35:54616) 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 -- 172.21.15.35:0/1930602193 learned_addr learned my addr 172.21.15.35:0/1930602193 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d90196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:38.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 -- 172.21.15.35:0/1930602193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9010a7a0 msgr2=0x7f9d9019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9010a7a0 0x7f9d9019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 -- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 msgr2=0x7f9d90196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d90196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 -- 172.21.15.35:0/1930602193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800095f0 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d90196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8effd700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 0x7f9d90196780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400d980 tx=0x7f9d8400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8cff9700 1 -- 172.21.15.35:0/1930602193 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84004220 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d901100b0 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8cff9700 1 -- 172.21.15.35:0/1930602193 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d84007640 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d8cff9700 1 -- 172.21.15.35:0/1930602193 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840055e0 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.756+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9010ff20 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.759+0000 7f9d8cff9700 1 -- 172.21.15.35:0/1930602193 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9d84004750 con 0x7f9d90101ce0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.759+0000 7f9d8cff9700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d7809f640 0x7f9d780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.760+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d7809f640 0x7f9d780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.760+0000 7f9d8cff9700 1 -- 172.21.15.35:0/1930602193 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d840ca430 con 0x7f9d90101ce0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.760+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d7809f640 0x7f9d780a1af0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d80005fd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.771+0000 7f9da1e40b80 1 Processor -- start 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 -- start start 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 0x55a255574fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25556f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a25556fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a255476010 con 0x55a2555754f0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2554c8950 con 0x55a25556f960 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2554c1de0 con 0x55a255574be0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25556f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 0x55a255574fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25556f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52830/0 (socket says 172.21.15.35:52830) 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 0x55a255574fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44594/0 (socket says 172.21.15.35:44594) 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8effd700 1 -- 172.21.15.35:0/1746770232 learned_addr learned my addr 172.21.15.35:0/1746770232 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a25556fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/1746770232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 msgr2=0x55a25556fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a25556fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/1746770232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 msgr2=0x55a25556f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25556f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/1746770232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2553435d0 con 0x55a255574be0 2023-03-17T10:59:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.772+0000 7f9d8effd700 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25556f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:59:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.773+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 0x55a255574fb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9d80005910 tx=0x7f9d8001e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7d9060a73080aa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T10:59:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.773+0000 7f9d75ffb700 1 -- 172.21.15.35:0/1746770232 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001e070 con 0x55a255574be0 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.773+0000 7f9d75ffb700 1 -- 172.21.15.35:0/1746770232 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d8000bdd0 con 0x55a255574be0 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.773+0000 7f9d75ffb700 1 -- 172.21.15.35:0/1746770232 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000f730 con 0x55a255574be0 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 -- 172.21.15.35:0/1746770232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 msgr2=0x55a255574fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 0x55a255574fb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9d80005910 tx=0x7f9d8001e000 comp rx=0 tx=0).stop 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 -- 172.21.15.35:0/1746770232 shutdown_connections 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a25556fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a255574be0 0x55a255574fb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/1746770232 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25556f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 -- 172.21.15.35:0/1746770232 >> 172.21.15.35:0/1746770232 conn(0x55a2553cc6b0 msgr2=0x55a255569a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 -- 172.21.15.35:0/1746770232 shutdown_connections 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.774+0000 7f9da1e40b80 1 -- 172.21.15.35:0/1746770232 wait complete. 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 -- start start 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 Processor -- start 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25557b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a2555786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2555754f0 0x55a255578d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2553458c0 con 0x55a255574be0 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a255579440 con 0x55a2555754f0 2023-03-17T10:59:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2555a6f50 con 0x55a25556f960 2023-03-17T10:59:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.775+0000 7f9da1e40b80 10 client.0 _ll_register_callbacks cb 0x55a255367230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T10:59:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25557b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25557b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44600/0 (socket says 172.21.15.35:44600) 2023-03-17T10:59:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/2947589741 learned_addr learned my addr 172.21.15.35:0/2947589741 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T10:59:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8effd700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a2555786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8ffff700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2555754f0 0x55a255578d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T10:59:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2555754f0 msgr2=0x55a255578d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2555754f0 0x55a255578d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/2947589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 msgr2=0x55a2555786d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T10:59:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a2555786d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T10:59:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/2947589741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9010d880 con 0x55a25556f960 2023-03-17T10:59:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8effd700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a2555786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T10:59:44.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:45 smithi035 ceph-mon[92535]: pgmap v4000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T10:59:47.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:47 smithi035 ceph-mon[92535]: pgmap v4001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:47.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:49 smithi035 ceph-mon[92535]: pgmap v4002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:59:47.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:51 smithi035 ceph-mon[92535]: pgmap v4003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:47.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:52 smithi035 ceph-mon[92535]: pgmap v4004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:59:47.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:55 smithi035 ceph-mon[92535]: pgmap v4005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:57 smithi035 ceph-mon[92535]: pgmap v4006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:47:59 smithi035 ceph-mon[92535]: pgmap v4007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:01 smithi035 ceph-mon[92535]: pgmap v4008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:02 smithi035 ceph-mon[92535]: pgmap v4009: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:05 smithi035 ceph-mon[92535]: pgmap v4010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:07 smithi035 ceph-mon[92535]: pgmap v4011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:09 smithi035 ceph-mon[92535]: pgmap v4012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:10 smithi035 ceph-mon[92535]: osdmap e324: 12 total, 12 up, 12 in 2023-03-17T10:59:48.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:11 smithi035 ceph-mon[92535]: pgmap v4014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:12 smithi035 ceph-mon[92535]: pgmap v4015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:15 smithi035 ceph-mon[92535]: pgmap v4016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:17 smithi035 ceph-mon[92535]: pgmap v4017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:17 smithi035 ceph-mon[92535]: osdmap e325: 12 total, 12 up, 12 in 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:19 smithi035 ceph-mon[92535]: pgmap v4019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:21 smithi035 ceph-mon[92535]: pgmap v4020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:22 smithi035 ceph-mon[92535]: pgmap v4021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:25 smithi035 ceph-mon[92535]: pgmap v4022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:27 smithi035 ceph-mon[92535]: pgmap v4023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:29 smithi035 ceph-mon[92535]: pgmap v4024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:31 smithi035 ceph-mon[92535]: pgmap v4025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:32 smithi035 ceph-mon[92535]: pgmap v4026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:35 smithi035 ceph-mon[92535]: pgmap v4027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:48.709 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:59:49.821 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:59:49.821 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:59:50.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T10:59:50.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:37 smithi035 ceph-mon[92535]: pgmap v4028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:37 smithi035 ceph-mon[92535]: pgmap v4029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:39 smithi035 ceph-mon[92535]: pgmap v4030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:41 smithi035 ceph-mon[92535]: pgmap v4031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:43 smithi035 ceph-mon[92535]: pgmap v4032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:45 smithi035 ceph-mon[92535]: pgmap v4033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T10:59:53.597 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:47 smithi035 ceph-mon[92535]: pgmap v4034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:49 smithi035 ceph-mon[92535]: pgmap v4035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:51 smithi035 ceph-mon[92535]: pgmap v4036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:53 smithi035 ceph-mon[92535]: pgmap v4037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:55 smithi035 ceph-mon[92535]: pgmap v4038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:57 smithi035 ceph-mon[92535]: pgmap v4039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:48:59 smithi035 ceph-mon[92535]: pgmap v4040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:01 smithi035 ceph-mon[92535]: pgmap v4041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:03 smithi035 ceph-mon[92535]: pgmap v4042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:05 smithi035 ceph-mon[92535]: pgmap v4043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:07 smithi035 ceph-mon[92535]: pgmap v4044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T10:59:53.598 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:09 smithi035 ceph-mon[92535]: pgmap v4045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:10 smithi035 ceph-mon[92535]: osdmap e326: 12 total, 12 up, 12 in 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:11 smithi035 ceph-mon[92535]: pgmap v4047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:13 smithi035 ceph-mon[92535]: pgmap v4048: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:15 smithi035 ceph-mon[92535]: pgmap v4049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:17 smithi035 ceph-mon[92535]: pgmap v4050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:17 smithi035 ceph-mon[92535]: osdmap e327: 12 total, 12 up, 12 in 2023-03-17T10:59:57.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:19 smithi035 ceph-mon[92535]: pgmap v4052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 375 B/s wr, 14 op/s 2023-03-17T10:59:57.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:21 smithi035 ceph-mon[92535]: pgmap v4053: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T10:59:57.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:23 smithi035 ceph-mon[92535]: pgmap v4054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T10:59:57.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:25 smithi035 ceph-mon[92535]: pgmap v4055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:59:57.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:27 smithi035 ceph-mon[92535]: pgmap v4056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T10:59:58.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:29 smithi035 ceph-mon[92535]: pgmap v4057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 15 op/s 2023-03-17T10:59:58.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:31 smithi035 ceph-mon[92535]: pgmap v4058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:58.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:33 smithi035 ceph-mon[92535]: pgmap v4059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:58.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:35 smithi035 ceph-mon[92535]: pgmap v4060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T10:59:59.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T10:59:59.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:59:59.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T10:59:59.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:37 smithi035 ceph-mon[92535]: pgmap v4061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T10:59:59.447 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: pgmap v4062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:00:01.586 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:01.586 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: pgmap v4063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:02.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:04.857 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:04.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:04.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:05.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:00:05.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:00:07.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:00:07.373 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:00:08.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:00:08.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: pgmap v4064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2023-03-17T11:00:08.396 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: pgmap v4065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T11:00:11.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:00:11.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:42 smithi035 ceph-mon[92535]: pgmap v4066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 op/s 2023-03-17T11:00:11.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:45 smithi035 ceph-mon[92535]: pgmap v4067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T11:00:11.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:47 smithi035 ceph-mon[92535]: pgmap v4068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T11:00:11.113 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:49 smithi035 ceph-mon[92535]: pgmap v4069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T11:00:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:00:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:00:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:00:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:00:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:00:11.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:00:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:00:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:00:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:00:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:00:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:00:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:00:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:00:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:00:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:00:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:00:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:00:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:00:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:00:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:00:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25557b4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009350 tx=0x7f9d800049e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06eb6fb07a6074f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d6effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:00:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d6effd700 1 -- 172.21.15.35:0/2947589741 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8002a070 con 0x55a25556f960 2023-03-17T11:00:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9d6effd700 1 -- 172.21.15.35:0/2947589741 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d80005580 con 0x55a25556f960 2023-03-17T11:00:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.776+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a255484390 con 0x55a25556f960 2023-03-17T11:00:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9d6effd700 1 -- 172.21.15.35:0/2947589741 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d8000bd50 con 0x55a25556f960 2023-03-17T11:00:13.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 10 client.28921 fetch_fsmap learned FSMap version 73 2023-03-17T11:00:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55a2552efd80 con 0x55a25556f960 2023-03-17T11:00:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9d6effd700 1 -- 172.21.15.35:0/2947589741 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a255484390 con 0x55a25556f960 2023-03-17T11:00:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9d6effd700 1 -- 172.21.15.35:0/2947589741 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9d800264b0 con 0x55a25556f960 2023-03-17T11:00:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 10 client.28921 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:00:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 10 client.28921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:00:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 20 client.28921 populate_metadata read hostname 'smithi035' 2023-03-17T11:00:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a25557e300 0x55a2555806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 4 client.28921 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a255490600 con 0x55a25557e300 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.777+0000 7f9d8effd700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a25557e300 0x55a2555806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.778+0000 7f9d6effd700 10 client.28921 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.778+0000 7f9d8effd700 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a25557e300 0x55a2555806e0 crc :-1 s=READY pgs=558 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70a3a2b3cb90dfd1 server_cookie=2e7f0a507300dfc3 in_seq=0 out_seq=0 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.778+0000 7f9d6effd700 1 -- 172.21.15.35:0/2947589741 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a255490600 con 0x55a25557e300 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.778+0000 7f9d6effd700 10 client.28921 handle_command_reply: tid=0 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.778+0000 7f9da1e40b80 1 client.28921 shutdown 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 msgr2=0x55a25557b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25557b4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009350 tx=0x7f9d800049e0 comp rx=0 tx=0).stop 2023-03-17T11:00:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 shutdown_connections 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a25557e300 0x55a2555806e0 crc :-1 s=READY pgs=558 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2555754f0 0x55a255578d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25557b4c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/2947589741 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a2555786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9d6effd700 0 client.28921 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 >> 172.21.15.35:0/2947589741 conn(0x55a2553cc6b0 msgr2=0x55a25556e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 shutdown_connections 2023-03-17T11:00:15.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 1 -- 172.21.15.35:0/2947589741 wait complete. 2023-03-17T11:00:16.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.779+0000 7f9da1e40b80 20 client.28921 trim_cache size 0 max 16384 2023-03-17T11:00:16.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.802+0000 7f9da1e40b80 1 Processor -- start 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.803+0000 7f9da1e40b80 1 -- start start 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a255569ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a25558df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2555754f0 0x55a25556ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a25556f790 con 0x55a255574be0 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a25556a6a0 con 0x55a25556f960 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a25556ad10 con 0x55a2555754f0 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a25558df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a25558df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52844/0 (socket says 172.21.15.35:52844) 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8effd700 1 -- 172.21.15.35:0/3156607920 learned_addr learned my addr 172.21.15.35:0/3156607920 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8ffff700 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2555754f0 0x55a25556ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a255569ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:16.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8ffff700 1 -- 172.21.15.35:0/3156607920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 msgr2=0x55a255569ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8ffff700 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a255569ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8ffff700 1 -- 172.21.15.35:0/3156607920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 msgr2=0x55a25558df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8ffff700 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a25558df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.804+0000 7f9d8ffff700 1 -- 172.21.15.35:0/3156607920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a255488130 con 0x55a2555754f0 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.805+0000 7f9d8ffff700 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2555754f0 0x55a25556ea90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55a255575960 tx=0x7f9d88009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb416e251c49d49c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.805+0000 7f9d767fc700 1 -- 172.21.15.35:0/3156607920 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800e040 con 0x55a2555754f0 2023-03-17T11:00:16.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.805+0000 7f9d767fc700 1 -- 172.21.15.35:0/3156607920 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d8800f040 con 0x55a2555754f0 2023-03-17T11:00:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.805+0000 7f9d767fc700 1 -- 172.21.15.35:0/3156607920 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88017c20 con 0x55a2555754f0 2023-03-17T11:00:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 -- 172.21.15.35:0/3156607920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2555754f0 msgr2=0x55a25556ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2555754f0 0x55a25556ea90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55a255575960 tx=0x7f9d88009920 comp rx=0 tx=0).stop 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 -- 172.21.15.35:0/3156607920 shutdown_connections 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a2555754f0 0x55a25556ea90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a25556f960 0x55a255569ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/3156607920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a255574be0 0x55a25558df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 -- 172.21.15.35:0/3156607920 >> 172.21.15.35:0/3156607920 conn(0x55a2553cc6b0 msgr2=0x55a2555a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 -- 172.21.15.35:0/3156607920 shutdown_connections 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 -- 172.21.15.35:0/3156607920 wait complete. 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.806+0000 7f9da1e40b80 1 -- start start 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.807+0000 7f9da1e40b80 1 Processor -- start 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25558da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a255574be0 0x55a25558bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25558c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a25558c970 con 0x55a2555754f0 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a25558cae0 con 0x55a255574be0 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a25558cca0 con 0x55a25556f960 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9da1e40b80 10 client.0 _ll_register_callbacks cb 0x55a255367230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25558c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25558da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25558c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52852/0 (socket says 172.21.15.35:52852) 2023-03-17T11:00:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25558da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44614/0 (socket says 172.21.15.35:44614) 2023-03-17T11:00:18.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8ffff700 1 -- 172.21.15.35:0/4083143239 learned_addr learned my addr 172.21.15.35:0/4083143239 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:19.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8effd700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a255574be0 0x55a25558bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a255574be0 msgr2=0x55a25558bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a255574be0 0x55a25558bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/4083143239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 msgr2=0x55a25558c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25558c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 -- 172.21.15.35:0/4083143239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88007580 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8ffff700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25558c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d8f7fe700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25558da90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d800268c0 tx=0x7f9d8000bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b4cfd8aca01d606 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.808+0000 7f9d6effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9d6effd700 1 -- 172.21.15.35:0/4083143239 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8002a070 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9d6effd700 1 -- 172.21.15.35:0/4083143239 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(288..288 src has 1..288) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d80026630 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a25553f1e0 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9d6effd700 1 -- 172.21.15.35:0/4083143239 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d8001e040 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 10 client.28927 fetch_fsmap learned FSMap version 73 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55a2553161f0 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9d6effd700 1 -- 172.21.15.35:0/4083143239 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a25553f1e0 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9d6effd700 1 -- 172.21.15.35:0/4083143239 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9d80038500 con 0x55a25556f960 2023-03-17T11:00:19.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 10 client.28927 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 10 client.28927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 20 client.28927 populate_metadata read hostname 'smithi035' 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2555b3620 0x55a2555b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 4 client.28927 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.809+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a255345f00 con 0x55a2555b3620 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.810+0000 7f9d8effd700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2555b3620 0x55a2555b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.810+0000 7f9d6effd700 10 client.28927 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.810+0000 7f9d8effd700 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2555b3620 0x55a2555b5a00 crc :-1 s=READY pgs=559 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47288ce05205ff4 server_cookie=1803013c7a80ab45 in_seq=0 out_seq=0 2023-03-17T11:00:19.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9d6effd700 1 -- 172.21.15.35:0/4083143239 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a255345f00 con 0x55a2555b3620 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9d6effd700 10 client.28927 handle_command_reply: tid=0 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 client.28927 shutdown 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 msgr2=0x55a25558da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25558da90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d800268c0 tx=0x7f9d8000bf80 comp rx=0 tx=0).stop 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 shutdown_connections 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a2555b3620 0x55a2555b5a00 crc :-1 s=READY pgs=559 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a2555754f0 0x55a25558c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a25556f960 0x55a25558da90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9d6effd700 0 client.28927 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 --2- 172.21.15.35:0/4083143239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a255574be0 0x55a25558bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 >> 172.21.15.35:0/4083143239 conn(0x55a2553cc6b0 msgr2=0x55a25556ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:21.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 shutdown_connections 2023-03-17T11:00:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.867+0000 7f9da1e40b80 1 -- 172.21.15.35:0/4083143239 wait complete. 2023-03-17T11:00:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9da1e40b80 20 client.28927 trim_cache size 0 max 16384 2023-03-17T11:00:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d7809f640 msgr2=0x7f9d780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d7809f640 0x7f9d780a1af0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d80005fd0 comp rx=0 tx=0).stop 2023-03-17T11:00:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 msgr2=0x7f9d90196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 0x7f9d90196780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400d980 tx=0x7f9d8400dc90 comp rx=0 tx=0).stop 2023-03-17T11:00:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 shutdown_connections 2023-03-17T11:00:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9d7809f640 0x7f9d780a1af0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d9010a7a0 0x7f9d9019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d901013d0 0x7f9d90196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 --2- 172.21.15.35:0/1930602193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d90101ce0 0x7f9d90196780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.868+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 >> 172.21.15.35:0/1930602193 conn(0x7f9d90076330 msgr2=0x7f9d900fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.869+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 shutdown_connections 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:30:51.869+0000 7f9d95cb3700 1 -- 172.21.15.35:0/1930602193 wait complete. 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 -- 172.21.15.35:0/3102886238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 msgr2=0x7f557c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 --2- 172.21.15.35:0/3102886238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c103cb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f556c0098f0 tx=0x7f556c009c00 comp rx=0 tx=0).stop 2023-03-17T11:00:26.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 -- 172.21.15.35:0/3102886238 shutdown_connections 2023-03-17T11:00:26.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 --2- 172.21.15.35:0/3102886238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c104390 0x7f557c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:26.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 --2- 172.21.15.35:0/3102886238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c0ff350 0x7f557c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:26.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 --2- 172.21.15.35:0/3102886238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ffcf0 0x7f557c103cb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 -- 172.21.15.35:0/3102886238 >> 172.21.15.35:0/3102886238 conn(0x7f557c076330 msgr2=0x7f557c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 -- 172.21.15.35:0/3102886238 shutdown_connections 2023-03-17T11:00:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.927+0000 7f5583f7f700 1 -- 172.21.15.35:0/3102886238 wait complete. 2023-03-17T11:00:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 Processor -- start 2023-03-17T11:00:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 -- start start 2023-03-17T11:00:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ff350 0x7f557c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:29.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c0ffcf0 0x7f557c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 0x7f557c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c19d490 con 0x7f557c104390 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c19d600 con 0x7f557c0ffcf0 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5583f7f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c19d7c0 con 0x7f557c0ff350 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f5581d1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ff350 0x7f557c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f558251c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 0x7f557c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f558251c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 0x7f557c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52900/0 (socket says 172.21.15.35:52900) 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f558251c700 1 -- 172.21.15.35:0/616040068 learned_addr learned my addr 172.21.15.35:0/616040068 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.928+0000 7f558151a700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c0ffcf0 0x7f557c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f558251c700 1 -- 172.21.15.35:0/616040068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ff350 msgr2=0x7f557c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f558251c700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ff350 0x7f557c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f558251c700 1 -- 172.21.15.35:0/616040068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c0ffcf0 msgr2=0x7f557c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f558251c700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c0ffcf0 0x7f557c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f558251c700 1 -- 172.21.15.35:0/616040068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c009520 con 0x7f557c104390 2023-03-17T11:00:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f5581d1b700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ff350 0x7f557c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:00:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f558251c700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 0x7f557c19ce50 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f557400ef30 tx=0x7f557400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f5572ffd700 1 -- 172.21.15.35:0/616040068 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574018070 con 0x7f557c104390 2023-03-17T11:00:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c110150 con 0x7f557c104390 2023-03-17T11:00:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f5572ffd700 1 -- 172.21.15.35:0/616040068 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f557400f040 con 0x7f557c104390 2023-03-17T11:00:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f5572ffd700 1 -- 172.21.15.35:0/616040068 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400cbb0 con 0x7f557c104390 2023-03-17T11:00:32.455 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:51 smithi035 ceph-mon[92535]: pgmap v4070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:00:32.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.929+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c10ffc0 con 0x7f557c104390 2023-03-17T11:00:32.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.932+0000 7f5572ffd700 1 -- 172.21.15.35:0/616040068 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5574007500 con 0x7f557c104390 2023-03-17T11:00:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.933+0000 7f5572ffd700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556809f6c0 0x7f55680a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.933+0000 7f5572ffd700 1 -- 172.21.15.35:0/616040068 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f55740ca0d0 con 0x7f557c104390 2023-03-17T11:00:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f5581d1b700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556809f6c0 0x7f55680a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:33.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 Processor -- start 2023-03-17T11:00:33.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 -- start start 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f5581d1b700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556809f6c0 0x7f55680a1b70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5578005fd0 tx=0x7f5578009310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad39b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad395c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad396170 0x55aaad3965a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad294010 con 0x55aaad396170 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad2e6950 con 0x55aaad39b3f0 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.934+0000 7f559010cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad2dfde0 con 0x55aaad39bd00 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f558151a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad395c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f558151a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad395c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44672/0 (socket says 172.21.15.35:44672) 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f558151a700 1 -- 172.21.15.35:0/3080716113 learned_addr learned my addr 172.21.15.35:0/3080716113 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad39b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f558251c700 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad396170 0x55aaad3965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 -- 172.21.15.35:0/3080716113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 msgr2=0x55aaad395c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad395c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 -- 172.21.15.35:0/3080716113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad396170 msgr2=0x55aaad3965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad396170 0x55aaad3965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 -- 172.21.15.35:0/3080716113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaad1615d0 con 0x55aaad39b3f0 2023-03-17T11:00:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f558151a700 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad395c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:00:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5581d1b700 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad39b7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f55780042f0 tx=0x7f5578014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f90c4c5d48ae753 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5567fff700 1 -- 172.21.15.35:0/3080716113 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578003d10 con 0x55aaad39b3f0 2023-03-17T11:00:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5567fff700 1 -- 172.21.15.35:0/3080716113 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5578003e70 con 0x55aaad39b3f0 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.935+0000 7f5567fff700 1 -- 172.21.15.35:0/3080716113 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557801e650 con 0x55aaad39b3f0 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 -- 172.21.15.35:0/3080716113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 msgr2=0x55aaad39b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad39b7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f55780042f0 tx=0x7f5578014000 comp rx=0 tx=0).stop 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 -- 172.21.15.35:0/3080716113 shutdown_connections 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad396170 0x55aaad3965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad39b7c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 --2- 172.21.15.35:0/3080716113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad395c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.936+0000 7f559010cb80 1 -- 172.21.15.35:0/3080716113 >> 172.21.15.35:0/3080716113 conn(0x55aaad1ea6b0 msgr2=0x55aaad387a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.937+0000 7f559010cb80 1 -- 172.21.15.35:0/3080716113 shutdown_connections 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.937+0000 7f559010cb80 1 -- 172.21.15.35:0/3080716113 wait complete. 2023-03-17T11:00:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.937+0000 7f559010cb80 1 -- start start 2023-03-17T11:00:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.937+0000 7f559010cb80 1 Processor -- start 2023-03-17T11:00:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39b3f0 0x55aaad39eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad39f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad1638c0 con 0x55aaad39b3f0 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad39fc80 con 0x55aaad396170 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad3ab810 con 0x55aaad39bd00 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f559010cb80 10 client.0 _ll_register_callbacks cb 0x55aaad185230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558151a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39b3f0 0x55aaad39eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad39f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad39f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44680/0 (socket says 172.21.15.35:44680) 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 -- 172.21.15.35:0/1237639669 learned_addr learned my addr 172.21.15.35:0/1237639669 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f5581d1b700 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 -- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 msgr2=0x55aaad3a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:41.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 -- 172.21.15.35:0/1237639669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39b3f0 msgr2=0x55aaad39eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39b3f0 0x55aaad39eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 -- 172.21.15.35:0/1237639669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5578017070 con 0x55aaad39bd00 2023-03-17T11:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f558251c700 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad39f510 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55740978b0 tx=0x7f55740c7d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cca6b8187880fc5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.938+0000 7f55657fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f55657fa700 1 -- 172.21.15.35:0/1237639669 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574097bb0 con 0x55aaad39bd00 2023-03-17T11:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f55657fa700 1 -- 172.21.15.35:0/1237639669 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f557409fd10 con 0x55aaad39bd00 2023-03-17T11:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aaad2a2390 con 0x55aaad39bd00 2023-03-17T11:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f55657fa700 1 -- 172.21.15.35:0/1237639669 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5574097e10 con 0x55aaad39bd00 2023-03-17T11:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 10 client.28939 fetch_fsmap learned FSMap version 73 2023-03-17T11:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55aaad10dd80 con 0x55aaad39bd00 2023-03-17T11:00:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f55657fa700 1 -- 172.21.15.35:0/1237639669 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aaad2a2390 con 0x55aaad39bd00 2023-03-17T11:00:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f55657fa700 1 -- 172.21.15.35:0/1237639669 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f557409f880 con 0x55aaad39bd00 2023-03-17T11:00:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 10 client.28939 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:00:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 10 client.28939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:00:45.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 20 client.28939 populate_metadata read hostname 'smithi035' 2023-03-17T11:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad3af860 0x55aaad3b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 4 client.28939 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aaad2ae600 con 0x55aaad3af860 2023-03-17T11:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.939+0000 7f5581d1b700 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad3af860 0x55aaad3b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.940+0000 7f5581d1b700 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad3af860 0x55aaad3b1c40 crc :-1 s=READY pgs=560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bbf6898f7dae557 server_cookie=b420be55d2dfccd1 in_seq=0 out_seq=0 2023-03-17T11:00:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.940+0000 7f55657fa700 10 client.28939 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.940+0000 7f55657fa700 1 -- 172.21.15.35:0/1237639669 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55aaad2ae600 con 0x55aaad3af860 2023-03-17T11:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.940+0000 7f55657fa700 10 client.28939 handle_command_reply: tid=0 2023-03-17T11:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 client.28939 shutdown 2023-03-17T11:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 msgr2=0x55aaad39f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad39f510 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55740978b0 tx=0x7f55740c7d60 comp rx=0 tx=0).stop 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 shutdown_connections 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad3af860 0x55aaad3b1c40 crc :-1 s=READY pgs=560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39bd00 0x55aaad39f510 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 --2- 172.21.15.35:0/1237639669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39b3f0 0x55aaad39eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 >> 172.21.15.35:0/1237639669 conn(0x55aaad1ea6b0 msgr2=0x55aaad394c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f55657fa700 0 client.28939 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 shutdown_connections 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 1 -- 172.21.15.35:0/1237639669 wait complete. 2023-03-17T11:00:48.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.941+0000 7f559010cb80 20 client.28939 trim_cache size 0 max 16384 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 Processor -- start 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 -- start start 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 0x55aaad387ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad3a6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad3aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad3830d0 con 0x55aaad39bd00 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad3845c0 con 0x55aaad39b3f0 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f559010cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad388e10 con 0x55aaad396170 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f558251c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad3aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.963+0000 7f5581d1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 0x55aaad387ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 0x55aaad387ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44684/0 (socket says 172.21.15.35:44684) 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 -- 172.21.15.35:0/2888126348 learned_addr learned my addr 172.21.15.35:0/2888126348 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f558151a700 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad3a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 -- 172.21.15.35:0/2888126348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 msgr2=0x55aaad3a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad3a6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:48.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 -- 172.21.15.35:0/2888126348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 msgr2=0x55aaad3aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad3aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 -- 172.21.15.35:0/2888126348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaad396810 con 0x55aaad396170 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5581d1b700 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 0x55aaad387ac0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5578005950 tx=0x7f5578009380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3048ca32b482feec server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5570ff9700 1 -- 172.21.15.35:0/2888126348 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557802b040 con 0x55aaad396170 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5570ff9700 1 -- 172.21.15.35:0/2888126348 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f557802c040 con 0x55aaad396170 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.964+0000 7f5570ff9700 1 -- 172.21.15.35:0/2888126348 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578005440 con 0x55aaad396170 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 -- 172.21.15.35:0/2888126348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 msgr2=0x55aaad387ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:48.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 0x55aaad387ac0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5578005950 tx=0x7f5578009380 comp rx=0 tx=0).stop 2023-03-17T11:00:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 -- 172.21.15.35:0/2888126348 shutdown_connections 2023-03-17T11:00:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad3aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad396170 0x55aaad387ac0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 --2- 172.21.15.35:0/2888126348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad39b3f0 0x55aaad3a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 -- 172.21.15.35:0/2888126348 >> 172.21.15.35:0/2888126348 conn(0x55aaad1ea6b0 msgr2=0x55aaad3a1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 -- 172.21.15.35:0/2888126348 shutdown_connections 2023-03-17T11:00:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.965+0000 7f559010cb80 1 -- 172.21.15.35:0/2888126348 wait complete. 2023-03-17T11:00:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 -- start start 2023-03-17T11:00:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 Processor -- start 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39b3f0 0x55aaad3f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad402680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad402bc0 con 0x55aaad39bd00 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad402d00 con 0x55aaad396170 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaad402e70 con 0x55aaad39b3f0 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f559010cb80 10 client.0 _ll_register_callbacks cb 0x55aaad185230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f558251c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad402680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f5581d1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f558251c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad402680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52928/0 (socket says 172.21.15.35:52928) 2023-03-17T11:00:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f558151a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39b3f0 0x55aaad3f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f5581d1b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3f77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54720/0 (socket says 172.21.15.35:54720) 2023-03-17T11:00:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.966+0000 7f558251c700 1 -- 172.21.15.35:0/974289055 learned_addr learned my addr 172.21.15.35:0/974289055 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f558251c700 1 -- 172.21.15.35:0/974289055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39b3f0 msgr2=0x55aaad3f7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f558251c700 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39b3f0 0x55aaad3f7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f558251c700 1 -- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 msgr2=0x55aaad3f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f558251c700 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f558251c700 1 -- 172.21.15.35:0/974289055 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aaad1615d0 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f558251c700 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad402680 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f55740979c0 tx=0x7f5574009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9cd00b19cc1eee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f55657fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f55657fa700 1 -- 172.21.15.35:0/974289055 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740c1bf0 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f55657fa700 1 -- 172.21.15.35:0/974289055 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f557409fd10 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aaad35d1e0 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f55657fa700 1 -- 172.21.15.35:0/974289055 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5574064340 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f559010cb80 10 client.19800 fetch_fsmap learned FSMap version 73 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.967+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55aaad2a6130 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f55657fa700 1 -- 172.21.15.35:0/974289055 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aaad35d1e0 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f55657fa700 1 -- 172.21.15.35:0/974289055 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f557407e020 con 0x55aaad39bd00 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f559010cb80 10 client.19800 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:00:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f559010cb80 10 client.19800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:00:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f559010cb80 20 client.19800 populate_metadata read hostname 'smithi035' 2023-03-17T11:00:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f559010cb80 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad404180 0x55aaad406590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f559010cb80 4 client.19800 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:00:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aaad163f00 con 0x55aaad404180 2023-03-17T11:00:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.968+0000 7f5581d1b700 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad404180 0x55aaad406590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.969+0000 7f55657fa700 10 client.19800 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:54.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:19.969+0000 7f5581d1b700 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad404180 0x55aaad406590 crc :-1 s=READY pgs=561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d3c72250215ea server_cookie=4a16db199cbab477 in_seq=0 out_seq=0 2023-03-17T11:00:54.088 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:52 smithi035 ceph-mon[92535]: pgmap v4071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:00:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.071+0000 7f55657fa700 1 -- 172.21.15.35:0/974289055 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aaad163f00 con 0x55aaad404180 2023-03-17T11:00:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.071+0000 7f55657fa700 10 client.19800 handle_command_reply: tid=0 2023-03-17T11:00:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.071+0000 7f559010cb80 1 client.19800 shutdown 2023-03-17T11:00:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 msgr2=0x55aaad402680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:55.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad402680 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f55740979c0 tx=0x7f5574009ed0 comp rx=0 tx=0).stop 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 shutdown_connections 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55aaad404180 0x55aaad406590 crc :-1 s=READY pgs=561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55aaad39bd00 0x55aaad402680 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aaad396170 0x55aaad3f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 --2- 172.21.15.35:0/974289055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aaad39b3f0 0x55aaad3f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 >> 172.21.15.35:0/974289055 conn(0x55aaad1ea6b0 msgr2=0x55aaad398ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f55657fa700 0 client.19800 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.072+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 shutdown_connections 2023-03-17T11:00:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.073+0000 7f559010cb80 1 -- 172.21.15.35:0/974289055 wait complete. 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.073+0000 7f559010cb80 20 client.19800 trim_cache size 0 max 16384 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.073+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556809f6c0 msgr2=0x7f55680a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.073+0000 7f5583f7f700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556809f6c0 0x7f55680a1b70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5578005fd0 tx=0x7f5578009310 comp rx=0 tx=0).stop 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.073+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 msgr2=0x7f557c19ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.073+0000 7f5583f7f700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 0x7f557c19ce50 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f557400ef30 tx=0x7f557400c3a0 comp rx=0 tx=0).stop 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 shutdown_connections 2023-03-17T11:00:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f556809f6c0 0x7f55680a1b70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f557c104390 0x7f557c19ce50 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f557c0ff350 0x7f557c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 --2- 172.21.15.35:0/616040068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f557c0ffcf0 0x7f557c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 >> 172.21.15.35:0/616040068 conn(0x7f557c076330 msgr2=0x7f557c0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 shutdown_connections 2023-03-17T11:00:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:20.074+0000 7f5583f7f700 1 -- 172.21.15.35:0/616040068 wait complete. 2023-03-17T11:00:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 -- 172.21.15.35:0/2719656636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ff3b0 msgr2=0x7f569c0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 --2- 172.21.15.35:0/2719656636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ff3b0 0x7f569c0ff780 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f568c0099c0 tx=0x7f568c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:00:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 -- 172.21.15.35:0/2719656636 shutdown_connections 2023-03-17T11:00:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 --2- 172.21.15.35:0/2719656636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 0x7f569c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 --2- 172.21.15.35:0/2719656636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ff3b0 0x7f569c0ff780 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:57.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 --2- 172.21.15.35:0/2719656636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569c0ffd50 0x7f569c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 -- 172.21.15.35:0/2719656636 >> 172.21.15.35:0/2719656636 conn(0x7f569c075f50 msgr2=0x7f569c076350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:00:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 -- 172.21.15.35:0/2719656636 shutdown_connections 2023-03-17T11:00:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.249+0000 7f56a2773700 1 -- 172.21.15.35:0/2719656636 wait complete. 2023-03-17T11:00:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 Processor -- start 2023-03-17T11:00:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 -- start start 2023-03-17T11:00:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569c0ff3b0 0x7f569c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ffd50 0x7f569c197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 0x7f569c1a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:00:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c197f60 con 0x7f569c0ffd50 2023-03-17T11:00:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1a26d0 con 0x7f569c0ff3b0 2023-03-17T11:00:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.250+0000 7f56a2773700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1a2840 con 0x7f569c1043f0 2023-03-17T11:00:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ffd50 0x7f569c197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 0x7f569c1a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ffd50 0x7f569c197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52942/0 (socket says 172.21.15.35:52942) 2023-03-17T11:00:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f569b7fe700 1 -- 172.21.15.35:0/843921694 learned_addr learned my addr 172.21.15.35:0/843921694 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:00:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f569bfff700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569c0ff3b0 0x7f569c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:00:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 -- 172.21.15.35:0/843921694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569c0ff3b0 msgr2=0x7f569c197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569c0ff3b0 0x7f569c197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 -- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ffd50 msgr2=0x7f569c197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ffd50 0x7f569c197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 -- 172.21.15.35:0/843921694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0095f0 con 0x7f569c1043f0 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a0d10700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 0x7f569c1a2190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f569400b330 tx=0x7f569400b640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56997fa700 1 -- 172.21.15.35:0/843921694 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694015070 con 0x7f569c1043f0 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c10f060 con 0x7f569c1043f0 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56997fa700 1 -- 172.21.15.35:0/843921694 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f569400bdd0 con 0x7f569c1043f0 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56997fa700 1 -- 172.21.15.35:0/843921694 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694007bf0 con 0x7f569c1043f0 2023-03-17T11:00:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.251+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c10eed0 con 0x7f569c1043f0 2023-03-17T11:00:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.254+0000 7f56997fa700 1 -- 172.21.15.35:0/843921694 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5694007d50 con 0x7f569c1043f0 2023-03-17T11:00:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.255+0000 7f56997fa700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f568409f640 0x7f56840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.255+0000 7f56997fa700 1 -- 172.21.15.35:0/843921694 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f56940cdd00 con 0x7f569c1043f0 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.256+0000 7f56ae900b80 1 Processor -- start 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.256+0000 7f569bfff700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f568409f640 0x7f56840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.256+0000 7f56ae900b80 1 -- start start 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 0x55a492b34fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b354f0 0x55a492b2f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b2fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56ae900b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492a36010 con 0x55a492b354f0 2023-03-17T11:01:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56ae900b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492a88950 con 0x55a492b34be0 2023-03-17T11:01:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56ae900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492a81de0 con 0x55a492b2f960 2023-03-17T11:01:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 0x55a492b34fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 0x55a492b34fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54744/0 (socket says 172.21.15.35:54744) 2023-03-17T11:01:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 -- 172.21.15.35:0/469916877 learned_addr learned my addr 172.21.15.35:0/469916877 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f568409f640 0x7f56840a1af0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b580 tx=0x7f568c005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f56a0d10700 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b2fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569b7fe700 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b354f0 0x55a492b2f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 -- 172.21.15.35:0/469916877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 msgr2=0x55a492b2fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b2fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 -- 172.21.15.35:0/469916877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b354f0 msgr2=0x55a492b2f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b354f0 0x55a492b2f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 -- 172.21.15.35:0/469916877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4929035d0 con 0x55a492b34be0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569b7fe700 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b354f0 0x55a492b2f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.257+0000 7f569bfff700 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 0x55a492b34fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f568c015000 tx=0x7f568c024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce63d47abe9ee1c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.258+0000 7f56827fc700 1 -- 172.21.15.35:0/469916877 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c0056d0 con 0x55a492b34be0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.258+0000 7f56827fc700 1 -- 172.21.15.35:0/469916877 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f568c01e040 con 0x55a492b34be0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.258+0000 7f56827fc700 1 -- 172.21.15.35:0/469916877 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00f860 con 0x55a492b34be0 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.259+0000 7f56ae900b80 1 -- 172.21.15.35:0/469916877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 msgr2=0x55a492b34fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.259+0000 7f56ae900b80 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 0x55a492b34fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f568c015000 tx=0x7f568c024000 comp rx=0 tx=0).stop 2023-03-17T11:01:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 -- 172.21.15.35:0/469916877 shutdown_connections 2023-03-17T11:01:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b2fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b34be0 0x55a492b34fb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 --2- 172.21.15.35:0/469916877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b354f0 0x55a492b2f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 -- 172.21.15.35:0/469916877 >> 172.21.15.35:0/469916877 conn(0x55a49298c6b0 msgr2=0x55a492b29a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:02.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 -- 172.21.15.35:0/469916877 shutdown_connections 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 -- 172.21.15.35:0/469916877 wait complete. 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 -- start start 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.260+0000 7f56ae900b80 1 Processor -- start 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b3b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b38760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 0x55a492b38ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4929058c0 con 0x55a492b2f960 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492b395e0 con 0x55a492b354f0 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492b55fb0 con 0x55a492b34be0 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56ae900b80 10 client.0 _ll_register_callbacks cb 0x55a492927230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 0x55a492b38ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 0x55a492b38ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54752/0 (socket says 172.21.15.35:54752) 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 -- 172.21.15.35:0/3590580404 learned_addr learned my addr 172.21.15.35:0/3590580404 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f569bfff700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b3b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f569b7fe700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b38760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 -- 172.21.15.35:0/3590580404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 msgr2=0x55a492b38760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b38760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 -- 172.21.15.35:0/3590580404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 msgr2=0x55a492b3b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b3b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.261+0000 7f56a0d10700 1 -- 172.21.15.35:0/3590580404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c10c800 con 0x55a492b354f0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56a0d10700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 0x55a492b38ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56940cb4f0 tx=0x7f569409b1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca08d7a0ece91744 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f567fff7700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f567fff7700 1 -- 172.21.15.35:0/3590580404 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569409bc10 con 0x55a492b354f0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f567fff7700 1 -- 172.21.15.35:0/3590580404 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f56940b2030 con 0x55a492b354f0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a492a44390 con 0x55a492b354f0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f567fff7700 1 -- 172.21.15.35:0/3590580404 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56940a39a0 con 0x55a492b354f0 2023-03-17T11:01:03.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 10 client.28976 fetch_fsmap learned FSMap version 73 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55a4928afd80 con 0x55a492b354f0 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f567fff7700 1 -- 172.21.15.35:0/3590580404 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a492a44390 con 0x55a492b354f0 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f567fff7700 1 -- 172.21.15.35:0/3590580404 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f56940a3510 con 0x55a492b354f0 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 10 client.28976 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 10 client.28976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 20 client.28976 populate_metadata read hostname 'smithi035' 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b5a170 0x55a492b5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 4 client.28976 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:01:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.262+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a492a50600 con 0x55a492b5a170 2023-03-17T11:01:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.263+0000 7f569bfff700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b5a170 0x55a492b5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.263+0000 7f567fff7700 10 client.28976 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:03.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.263+0000 7f569bfff700 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b5a170 0x55a492b5c580 crc :-1 s=READY pgs=562 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48168739ddb6d3a9 server_cookie=513a295b3dfb20de in_seq=0 out_seq=0 2023-03-17T11:01:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f567fff7700 1 -- 172.21.15.35:0/3590580404 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a492a50600 con 0x55a492b5a170 2023-03-17T11:01:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f567fff7700 10 client.28976 handle_command_reply: tid=0 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 client.28976 shutdown 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 msgr2=0x55a492b38ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 0x55a492b38ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56940cb4f0 tx=0x7f569409b1e0 comp rx=0 tx=0).stop 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 shutdown_connections 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b5a170 0x55a492b5c580 crc :-1 s=READY pgs=562 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a492b354f0 0x55a492b38ea0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b3b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:04.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f567fff7700 0 client.28976 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 --2- 172.21.15.35:0/3590580404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b38760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:04.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 >> 172.21.15.35:0/3590580404 conn(0x55a49298c6b0 msgr2=0x55a492b2e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 shutdown_connections 2023-03-17T11:01:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 1 -- 172.21.15.35:0/3590580404 wait complete. 2023-03-17T11:01:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.264+0000 7f56ae900b80 20 client.28976 trim_cache size 0 max 16384 2023-03-17T11:01:04.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.291+0000 7f56ae900b80 1 Processor -- start 2023-03-17T11:01:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.291+0000 7f56ae900b80 1 -- start start 2023-03-17T11:01:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b29ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b50f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b3b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56ae900b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492b56b30 con 0x55a492b2f960 2023-03-17T11:01:06.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56ae900b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492a50600 con 0x55a49298c6b0 2023-03-17T11:01:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56ae900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492a44390 con 0x55a492b34be0 2023-03-17T11:01:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b50f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f569bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b29ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b3b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44730/0 (socket says 172.21.15.35:44730) 2023-03-17T11:01:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 -- 172.21.15.35:0/2070880136 learned_addr learned my addr 172.21.15.35:0/2070880136 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 -- 172.21.15.35:0/2070880136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 msgr2=0x55a492b29ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:13.065 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:55 smithi035 ceph-mon[92535]: pgmap v4072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:01:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b29ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 -- 172.21.15.35:0/2070880136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 msgr2=0x55a492b50f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b50f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 -- 172.21.15.35:0/2070880136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a492a48130 con 0x55a492b34be0 2023-03-17T11:01:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f569bfff700 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.292+0000 7f56a0d10700 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b3b080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56940cba90 tx=0x7f5694009e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3900412e9b6e60b5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.293+0000 7f5682ffd700 1 -- 172.21.15.35:0/2070880136 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569409a760 con 0x55a492b34be0 2023-03-17T11:01:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.293+0000 7f5682ffd700 1 -- 172.21.15.35:0/2070880136 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56940a39a0 con 0x55a492b34be0 2023-03-17T11:01:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.293+0000 7f5682ffd700 1 -- 172.21.15.35:0/2070880136 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940a3510 con 0x55a492b34be0 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.293+0000 7f56ae900b80 1 -- 172.21.15.35:0/2070880136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 msgr2=0x55a492b3b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.293+0000 7f56ae900b80 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b3b080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56940cba90 tx=0x7f5694009e90 comp rx=0 tx=0).stop 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- 172.21.15.35:0/2070880136 shutdown_connections 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b34be0 0x55a492b3b080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 --2- 172.21.15.35:0/2070880136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b2f960 0x55a492b50f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- 172.21.15.35:0/2070880136 >> 172.21.15.35:0/2070880136 conn(0x55a492b39010 msgr2=0x55a492b2ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- 172.21.15.35:0/2070880136 shutdown_connections 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- 172.21.15.35:0/2070880136 wait complete. 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- start start 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 Processor -- start 2023-03-17T11:01:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b50b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b51070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b34be0 0x55a492b4efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492b4f710 con 0x55a492b34be0 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492b4f880 con 0x55a49298c6b0 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a492b4fa40 con 0x55a492b2f960 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.294+0000 7f56ae900b80 10 client.0 _ll_register_callbacks cb 0x55a492927230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b51070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b50b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b50b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54764/0 (socket says 172.21.15.35:54764) 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b51070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44736/0 (socket says 172.21.15.35:44736) 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569bfff700 1 -- 172.21.15.35:0/167322663 learned_addr learned my addr 172.21.15.35:0/167322663 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f56a0d10700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b34be0 0x55a492b4efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 -- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 msgr2=0x55a492b50b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b50b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 -- 172.21.15.35:0/167322663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b34be0 msgr2=0x55a492b4efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b34be0 0x55a492b4efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 -- 172.21.15.35:0/167322663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4929035d0 con 0x55a492b2f960 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569bfff700 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b50b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f569b7fe700 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b51070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a492b39d10 tx=0x7f5690010a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e2c754518ddee33 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f567fff7700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f567fff7700 1 -- 172.21.15.35:0/167322663 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690004520 con 0x55a492b2f960 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f567fff7700 1 -- 172.21.15.35:0/167322663 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5690004830 con 0x55a492b2f960 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.295+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a492aff1e0 con 0x55a492b2f960 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f567fff7700 1 -- 172.21.15.35:0/167322663 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56900049f0 con 0x55a492b2f960 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 10 client.28963 fetch_fsmap learned FSMap version 73 2023-03-17T11:01:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55a4928afd80 con 0x55a492b2f960 2023-03-17T11:01:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f567fff7700 1 -- 172.21.15.35:0/167322663 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a492aff1e0 con 0x55a492b2f960 2023-03-17T11:01:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f567fff7700 1 -- 172.21.15.35:0/167322663 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f569001e820 con 0x55a492b2f960 2023-03-17T11:01:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 10 client.28963 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:01:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 10 client.28963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:01:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 20 client.28963 populate_metadata read hostname 'smithi035' 2023-03-17T11:01:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b354f0 0x55a492bb1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:17.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 4 client.28963 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a492905f00 con 0x55a492b354f0 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.296+0000 7f569bfff700 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b354f0 0x55a492bb1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.297+0000 7f567fff7700 10 client.28963 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.297+0000 7f569bfff700 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b354f0 0x55a492bb1410 crc :-1 s=READY pgs=563 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bedf8e63928f8f7 server_cookie=8d4e901a8c7593a6 in_seq=0 out_seq=0 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f567fff7700 1 -- 172.21.15.35:0/167322663 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a492905f00 con 0x55a492b354f0 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f567fff7700 10 client.28963 handle_command_reply: tid=0 2023-03-17T11:01:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 client.28963 shutdown 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 msgr2=0x55a492b51070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b51070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a492b39d10 tx=0x7f5690010a00 comp rx=0 tx=0).stop 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 shutdown_connections 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a492b354f0 0x55a492bb1410 crc :-1 s=READY pgs=563 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a492b34be0 0x55a492b4efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f567fff7700 0 client.28963 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a49298c6b0 0x55a492b50b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 --2- 172.21.15.35:0/167322663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a492b2f960 0x55a492b51070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 >> 172.21.15.35:0/167322663 conn(0x55a492b39010 msgr2=0x55a492b326b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 shutdown_connections 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.363+0000 7f56ae900b80 1 -- 172.21.15.35:0/167322663 wait complete. 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56ae900b80 20 client.28963 trim_cache size 0 max 16384 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f568409f640 msgr2=0x7f56840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f568409f640 0x7f56840a1af0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b580 tx=0x7f568c005c00 comp rx=0 tx=0).stop 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 msgr2=0x7f569c1a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 0x7f569c1a2190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f569400b330 tx=0x7f569400b640 comp rx=0 tx=0).stop 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 shutdown_connections 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f568409f640 0x7f56840a1af0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043f0 0x7f569c1a2190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f569c0ff3b0 0x7f569c197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 --2- 172.21.15.35:0/843921694 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f569c0ffd50 0x7f569c197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.364+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 >> 172.21.15.35:0/843921694 conn(0x7f569c075f50 msgr2=0x7f569c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.365+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 shutdown_connections 2023-03-17T11:01:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:33.365+0000 7f56a2773700 1 -- 172.21.15.35:0/843921694 wait complete. 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/767581743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 msgr2=0x7f5dc8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/767581743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 0x7f5dc8110ae0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009990 tx=0x7f5dbc009ca0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/767581743 shutdown_connections 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/767581743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc8111020 0x7f5dc8113400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/767581743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc80fe300 0x7f5dc80fe6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/767581743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 0x7f5dc8110ae0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/767581743 >> 172.21.15.35:0/767581743 conn(0x7f5dc8076270 msgr2=0x7f5dc8076670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/767581743 shutdown_connections 2023-03-17T11:01:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.527+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/767581743 wait complete. 2023-03-17T11:01:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 Processor -- start 2023-03-17T11:01:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 -- start start 2023-03-17T11:01:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 0x7f5dc81a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 0x7f5dc81a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8111020 0x7f5dc819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc819cd70 con 0x7f5dc80fec10 2023-03-17T11:01:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc819cee0 con 0x7f5dc80fe300 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.528+0000 7f5dcd1b2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc819d0a0 con 0x7f5dc8111020 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 0x7f5dc81a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8111020 0x7f5dc819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 0x7f5dc81a2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54778/0 (socket says 172.21.15.35:54778) 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc759e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8111020 0x7f5dc819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44750/0 (socket says 172.21.15.35:44750) 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/3595933393 learned_addr learned my addr 172.21.15.35:0/3595933393 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc659c700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 0x7f5dc81a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/3595933393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8111020 msgr2=0x7f5dc819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8111020 0x7f5dc819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 msgr2=0x7f5dc81a2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 0x7f5dc81a2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/3595933393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0095f0 con 0x7f5dc80fe300 2023-03-17T11:01:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 0x7f5dc81a2690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5db800b550 tx=0x7f5db800b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5daffff700 1 -- 172.21.15.35:0/3595933393 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8011830 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc81167b0 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5daffff700 1 -- 172.21.15.35:0/3595933393 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db8011e20 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5daffff700 1 -- 172.21.15.35:0/3595933393 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8010cf0 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.529+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc8116620 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.532+0000 7f5daffff700 1 -- 172.21.15.35:0/3595933393 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5db8011990 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.533+0000 7f5daffff700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5db009f640 0x7f5db00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.533+0000 7f5daffff700 1 -- 172.21.15.35:0/3595933393 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5db80c9ec0 con 0x7f5dc80fe300 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.533+0000 7f5dc659c700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5db009f640 0x7f5db00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.534+0000 7f5dc659c700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5db009f640 0x7f5db00a1af0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5dc819db70 tx=0x7f5dbc005e80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.534+0000 7f5dd933fb80 1 Processor -- start 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.534+0000 7f5dd933fb80 1 -- start start 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d99dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d998420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d998d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d89f010 con 0x55948d998960 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d8f1950 con 0x55948d99e4f0 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d8eade0 con 0x55948d99dbe0 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d998d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d99dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d998d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:52994/0 (socket says 172.21.15.35:52994) 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d99dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44756/0 (socket says 172.21.15.35:44756) 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 -- 172.21.15.35:0/1331570546 learned_addr learned my addr 172.21.15.35:0/1331570546 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc659c700 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d998420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 -- 172.21.15.35:0/1331570546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 msgr2=0x55948d99dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d99dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 -- 172.21.15.35:0/1331570546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 msgr2=0x55948d998420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d998420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 -- 172.21.15.35:0/1331570546 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55948d76c5d0 con 0x55948d998960 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d99dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc659c700 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d998420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.535+0000 7f5dc759e700 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d998d90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0011600 tx=0x7f5dc0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c9a3fd7134d939 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.536+0000 7f5dad7fa700 1 -- 172.21.15.35:0/1331570546 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000e040 con 0x55948d998960 2023-03-17T11:01:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.536+0000 7f5dad7fa700 1 -- 172.21.15.35:0/1331570546 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc000f040 con 0x55948d998960 2023-03-17T11:01:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.536+0000 7f5dad7fa700 1 -- 172.21.15.35:0/1331570546 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004610 con 0x55948d998960 2023-03-17T11:01:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.536+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1331570546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 msgr2=0x55948d998d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.536+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d998d90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0011600 tx=0x7f5dc0009920 comp rx=0 tx=0).stop 2023-03-17T11:01:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1331570546 shutdown_connections 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d998d90 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d99dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1331570546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d998420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1331570546 >> 172.21.15.35:0/1331570546 conn(0x55948d7f56b0 msgr2=0x55948d992a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1331570546 shutdown_connections 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1331570546 wait complete. 2023-03-17T11:01:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 -- start start 2023-03-17T11:01:22.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 Processor -- start 2023-03-17T11:01:22.671 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:57 smithi035 ceph-mon[92535]: pgmap v4073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:23.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:49:59 smithi035 ceph-mon[92535]: pgmap v4074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:01:24.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:01:24.824 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:01 smithi035 ceph-mon[92535]: pgmap v4075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:02 smithi035 ceph-mon[92535]: pgmap v4076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:05 smithi035 ceph-mon[92535]: pgmap v4077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:07 smithi035 ceph-mon[92535]: pgmap v4078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:09 smithi035 ceph-mon[92535]: pgmap v4079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:10 smithi035 ceph-mon[92535]: osdmap e328: 12 total, 12 up, 12 in 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:11 smithi035 ceph-mon[92535]: pgmap v4081: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:12 smithi035 ceph-mon[92535]: pgmap v4082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:15 smithi035 ceph-mon[92535]: pgmap v4083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:17 smithi035 ceph-mon[92535]: pgmap v4084: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:17 smithi035 ceph-mon[92535]: osdmap e329: 12 total, 12 up, 12 in 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:19 smithi035 ceph-mon[92535]: pgmap v4086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 228 B/s wr, 12 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:21 smithi035 ceph-mon[92535]: pgmap v4087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:01:24.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:22 smithi035 ceph-mon[92535]: pgmap v4088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:25 smithi035 ceph-mon[92535]: pgmap v4089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:27 smithi035 ceph-mon[92535]: pgmap v4090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:29 smithi035 ceph-mon[92535]: pgmap v4091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:31 smithi035 ceph-mon[92535]: pgmap v4092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:32 smithi035 ceph-mon[92535]: pgmap v4093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:35 smithi035 ceph-mon[92535]: pgmap v4094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:24.826 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:37 smithi035 ceph-mon[92535]: pgmap v4095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:39 smithi035 ceph-mon[92535]: pgmap v4096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:41 smithi035 ceph-mon[92535]: pgmap v4097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:42 smithi035 ceph-mon[92535]: pgmap v4098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:42 smithi035 ceph-mon[92535]: pgmap v4099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:44 smithi035 ceph-mon[92535]: pgmap v4100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:46 smithi035 ceph-mon[92535]: pgmap v4101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:48 smithi035 ceph-mon[92535]: pgmap v4102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:50 smithi035 ceph-mon[92535]: pgmap v4103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:01:25.417 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:52 smithi035 ceph-mon[92535]: pgmap v4104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:01:25.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:54 smithi035 ceph-mon[92535]: pgmap v4105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:01:25.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:56 smithi035 ceph-mon[92535]: pgmap v4106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:25.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:50:58 smithi035 ceph-mon[92535]: pgmap v4107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:01:28.036 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:00 smithi035 ceph-mon[92535]: pgmap v4108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T11:01:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:01:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:01:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:01:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:01:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 0x55948d9a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.537+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99dbe0 0x55948d9a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99e4f0 0x55948d9a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d76e8c0 con 0x55948d99dbe0 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d9a2310 con 0x55948d998960 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d9a24d0 con 0x55948d99e4f0 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dd933fb80 10 client.0 _ll_register_callbacks cb 0x55948d790230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 0x55948d9a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 0x55948d9a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54792/0 (socket says 172.21.15.35:54792) 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/1364292955 learned_addr learned my addr 172.21.15.35:0/1364292955 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc659c700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99dbe0 0x55948d9a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc759e700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99e4f0 0x55948d9a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/1364292955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99e4f0 msgr2=0x55948d9a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99e4f0 0x55948d9a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/1364292955 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99dbe0 msgr2=0x55948d9a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99dbe0 0x55948d9a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/1364292955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc00112b0 con 0x55948d998960 2023-03-17T11:01:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 0x55948d9a43f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5db80107a0 tx=0x7f5db80973e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126cb3f6f383bef3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:30.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.538+0000 7f5daaff5700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:01:30.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5daaff5700 1 -- 172.21.15.35:0/1364292955 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8097ee0 con 0x55948d998960 2023-03-17T11:01:30.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5daaff5700 1 -- 172.21.15.35:0/1364292955 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5db8097a80 con 0x55948d998960 2023-03-17T11:01:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55948d8ad390 con 0x55948d998960 2023-03-17T11:01:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5daaff5700 1 -- 172.21.15.35:0/1364292955 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5db809fc70 con 0x55948d998960 2023-03-17T11:01:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 10 client.28994 fetch_fsmap learned FSMap version 73 2023-03-17T11:01:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55948d718d80 con 0x55948d998960 2023-03-17T11:01:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5daaff5700 1 -- 172.21.15.35:0/1364292955 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55948d8ad390 con 0x55948d998960 2023-03-17T11:01:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5daaff5700 1 -- 172.21.15.35:0/1364292955 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5db8096f70 con 0x55948d998960 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 10 client.28994 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 10 client.28994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 20 client.28994 populate_metadata read hostname 'smithi035' 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948d9b1f70 0x55948d9b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 4 client.28994 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55948d8b9600 con 0x55948d9b1f70 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.539+0000 7f5dc659c700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948d9b1f70 0x55948d9b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.540+0000 7f5daaff5700 10 client.28994 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.540+0000 7f5dc659c700 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948d9b1f70 0x55948d9b4350 crc :-1 s=READY pgs=564 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae8bca93fd150b03 server_cookie=43f1407317b8c688 in_seq=0 out_seq=0 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.540+0000 7f5daaff5700 1 -- 172.21.15.35:0/1364292955 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55948d8b9600 con 0x55948d9b1f70 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5daaff5700 10 client.28994 handle_command_reply: tid=0 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 client.28994 shutdown 2023-03-17T11:01:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 msgr2=0x55948d9a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 0x55948d9a43f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5db80107a0 tx=0x7f5db80973e0 comp rx=0 tx=0).stop 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 shutdown_connections 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948d9b1f70 0x55948d9b4350 crc :-1 s=READY pgs=564 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99e4f0 0x55948d9a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5daaff5700 0 client.28994 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d998960 0x55948d9a43f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/1364292955 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99dbe0 0x55948d9a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 >> 172.21.15.35:0/1364292955 conn(0x55948d7f56b0 msgr2=0x55948d992a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 shutdown_connections 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 1 -- 172.21.15.35:0/1364292955 wait complete. 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.541+0000 7f5dd933fb80 20 client.28994 trim_cache size 0 max 16384 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 Processor -- start 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 -- start start 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d992ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d9a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d9a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d8ad390 con 0x55948d998960 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d98e0f0 con 0x55948d99e4f0 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d993000 con 0x55948d99dbe0 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d992ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dc759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d9a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dc659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d9a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d992ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53004/0 (socket says 172.21.15.35:53004) 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/2834631875 learned_addr learned my addr 172.21.15.35:0/2834631875 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.564+0000 7f5dc759e700 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d9a3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54804/0 (socket says 172.21.15.35:54804) 2023-03-17T11:01:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/2834631875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 msgr2=0x55948d9a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d9a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/2834631875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 msgr2=0x55948d9a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d9a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/2834631875 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55948d999000 con 0x55948d998960 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc759e700 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d9a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc659c700 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d9a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d992ac0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f5db8097780 tx=0x7f5db8093790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403205042708ce4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dadffb700 1 -- 172.21.15.35:0/2834631875 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db809f900 con 0x55948d998960 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dadffb700 1 -- 172.21.15.35:0/2834631875 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db8076e90 con 0x55948d998960 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.565+0000 7f5dadffb700 1 -- 172.21.15.35:0/2834631875 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db809fd00 con 0x55948d998960 2023-03-17T11:01:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 -- 172.21.15.35:0/2834631875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 msgr2=0x55948d992ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d992ac0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f5db8097780 tx=0x7f5db8093790 comp rx=0 tx=0).stop 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 -- 172.21.15.35:0/2834631875 shutdown_connections 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99e4f0 0x55948d9a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d998960 0x55948d992ac0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/2834631875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d99dbe0 0x55948d9a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 -- 172.21.15.35:0/2834631875 >> 172.21.15.35:0/2834631875 conn(0x55948d7f56b0 msgr2=0x55948d99b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 -- 172.21.15.35:0/2834631875 shutdown_connections 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 -- 172.21.15.35:0/2834631875 wait complete. 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.566+0000 7f5dd933fb80 1 -- start start 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 Processor -- start 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 0x55948d99a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99dbe0 0x55948d99ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99e4f0 0x55948d9996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d999be0 con 0x55948d99e4f0 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d999d50 con 0x55948d99dbe0 2023-03-17T11:01:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948d999f10 con 0x55948d998960 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dd933fb80 10 client.0 _ll_register_callbacks cb 0x55948d790230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99e4f0 0x55948d9996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 0x55948d99a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 0x55948d99a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44776/0 (socket says 172.21.15.35:44776) 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/566479940 learned_addr learned my addr 172.21.15.35:0/566479940 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc659c700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99dbe0 0x55948d99ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99dbe0 msgr2=0x55948d99ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99dbe0 0x55948d99ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/566479940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99e4f0 msgr2=0x55948d9996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99e4f0 0x55948d9996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc6d9d700 1 -- 172.21.15.35:0/566479940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc00bc10 con 0x55948d998960 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.567+0000 7f5dc759e700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99e4f0 0x55948d9996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dc6d9d700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 0x55948d99a940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5db80c7bd0 tx=0x7f5db8011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb9b1f3d3beb23e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5daaff5700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5daaff5700 1 -- 172.21.15.35:0/566479940 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80c7450 con 0x55948d998960 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5daaff5700 1 -- 172.21.15.35:0/566479940 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5db809fc70 con 0x55948d998960 2023-03-17T11:01:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55948d9681e0 con 0x55948d998960 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5daaff5700 1 -- 172.21.15.35:0/566479940 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5db8097ce0 con 0x55948d998960 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 10 client.28978 fetch_fsmap learned FSMap version 73 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55948d718d80 con 0x55948d998960 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5daaff5700 1 -- 172.21.15.35:0/566479940 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55948d9681e0 con 0x55948d998960 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5daaff5700 1 -- 172.21.15.35:0/566479940 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5db80969e0 con 0x55948d998960 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 10 client.28978 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 10 client.28978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 20 client.28978 populate_metadata read hostname 'smithi035' 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948da06840 0x55948da08c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 4 client.28978 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.568+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55948d76ef00 con 0x55948da06840 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.569+0000 7f5dc659c700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948da06840 0x55948da08c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.569+0000 7f5daaff5700 10 client.28978 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.569+0000 7f5dc659c700 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948da06840 0x55948da08c20 crc :-1 s=READY pgs=565 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6da177b8d0f1ff2d server_cookie=55c7ae2bf9da3b4e in_seq=0 out_seq=0 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5daaff5700 1 -- 172.21.15.35:0/566479940 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55948d76ef00 con 0x55948da06840 2023-03-17T11:01:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5daaff5700 10 client.28978 handle_command_reply: tid=0 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 client.28978 shutdown 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 msgr2=0x55948d99a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 0x55948d99a940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5db80c7bd0 tx=0x7f5db8011f90 comp rx=0 tx=0).stop 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 shutdown_connections 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55948da06840 0x55948da08c20 crc :-1 s=READY pgs=565 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55948d99e4f0 0x55948d9996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5daaff5700 0 client.28978 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55948d998960 0x55948d99a940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 --2- 172.21.15.35:0/566479940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55948d99dbe0 0x55948d99ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 >> 172.21.15.35:0/566479940 conn(0x55948d7f56b0 msgr2=0x55948d99e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 shutdown_connections 2023-03-17T11:01:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.643+0000 7f5dd933fb80 1 -- 172.21.15.35:0/566479940 wait complete. 2023-03-17T11:01:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.644+0000 7f5dd933fb80 20 client.28978 trim_cache size 0 max 16384 2023-03-17T11:01:34.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.644+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5db009f640 msgr2=0x7f5db00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.644+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5db009f640 0x7f5db00a1af0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5dc819db70 tx=0x7f5dbc005e80 comp rx=0 tx=0).stop 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.644+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 msgr2=0x7f5dc81a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.644+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 0x7f5dc81a2690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5db800b550 tx=0x7f5db800b860 comp rx=0 tx=0).stop 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.644+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 shutdown_connections 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5db009f640 0x7f5db00a1af0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8111020 0x7f5dc819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dc80fe300 0x7f5dc81a2690 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 --2- 172.21.15.35:0/3595933393 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5dc80fec10 0x7f5dc81a2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 >> 172.21.15.35:0/3595933393 conn(0x7f5dc8076270 msgr2=0x7f5dc810eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 shutdown_connections 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:46.645+0000 7f5dcd1b2700 1 -- 172.21.15.35:0/3595933393 wait complete. 2023-03-17T11:01:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1747215625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 msgr2=0x7f0f8c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1747215625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c103d30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009920 tx=0x7f0f80009c30 comp rx=0 tx=0).stop 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1747215625 shutdown_connections 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1747215625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 0x7f0f8c10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1747215625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1747215625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c103d30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1747215625 >> 172.21.15.35:0/1747215625 conn(0x7f0f8c076f80 msgr2=0x7f0f8c077380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1747215625 shutdown_connections 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.832+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1747215625 wait complete. 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 Processor -- start 2023-03-17T11:01:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 -- start start 2023-03-17T11:01:37.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c1952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:37.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c1957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:37.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 0x7f0f8c199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:37.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:02 smithi035 ceph-mon[92535]: pgmap v4109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T11:01:37.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c19a280 con 0x7f0f8c0ff3d0 2023-03-17T11:01:37.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c19a3f0 con 0x7f0f8c104410 2023-03-17T11:01:37.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f90bcd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c19a5b0 con 0x7f0f8c0ffd70 2023-03-17T11:01:37.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f8a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c1952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:37.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f8a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c1952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53024/0 (socket says 172.21.15.35:53024) 2023-03-17T11:01:37.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f8a59c700 1 -- 172.21.15.35:0/1586323461 learned_addr learned my addr 172.21.15.35:0/1586323461 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c1957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.833+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 0x7f0f8c199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1586323461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 msgr2=0x7f0f8c199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 0x7f0f8c199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:38.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 msgr2=0x7f0f8c1952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c1952a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1586323461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0095f0 con 0x7f0f8c0ffd70 2023-03-17T11:01:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 0x7f0f8c199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c1952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c1957e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f80000c00 tx=0x7f0f8000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f7b7fe700 1 -- 172.21.15.35:0/1586323461 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8001c070 con 0x7f0f8c0ffd70 2023-03-17T11:01:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f7b7fe700 1 -- 172.21.15.35:0/1586323461 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f8000bab0 con 0x7f0f8c0ffd70 2023-03-17T11:01:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f80009520 con 0x7f0f8c0ffd70 2023-03-17T11:01:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f7b7fe700 1 -- 172.21.15.35:0/1586323461 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80004950 con 0x7f0f8c0ffd70 2023-03-17T11:01:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.834+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c10f040 con 0x7f0f8c0ffd70 2023-03-17T11:01:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.837+0000 7f0f7b7fe700 1 -- 172.21.15.35:0/1586323461 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f0f80020070 con 0x7f0f8c0ffd70 2023-03-17T11:01:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.837+0000 7f0f7b7fe700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f7409f640 0x7f0f740a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.837+0000 7f0f7b7fe700 1 -- 172.21.15.35:0/1586323461 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0f800cb1f0 con 0x7f0f8c0ffd70 2023-03-17T11:01:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.838+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f7409f640 0x7f0f740a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.838+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f7409f640 0x7f0f740a1af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c005d10 tx=0x7f0f7c009310 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 Processor -- start 2023-03-17T11:01:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 -- start start 2023-03-17T11:01:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21bbe0 0x55784a21bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a216420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a216d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a11d010 con 0x55784a21bbe0 2023-03-17T11:01:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a16f950 con 0x55784a216960 2023-03-17T11:01:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a168de0 con 0x55784a21c4f0 2023-03-17T11:01:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f8a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21bbe0 0x55784a21bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f89d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a216420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f8a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21bbe0 0x55784a21bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53032/0 (socket says 172.21.15.35:53032) 2023-03-17T11:01:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f8a59c700 1 -- 172.21.15.35:0/930036308 learned_addr learned my addr 172.21.15.35:0/930036308 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.839+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a216d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f89d9b700 1 -- 172.21.15.35:0/930036308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 msgr2=0x55784a216d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a216d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f89d9b700 1 -- 172.21.15.35:0/930036308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21bbe0 msgr2=0x55784a21bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21bbe0 0x55784a21bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f89d9b700 1 -- 172.21.15.35:0/930036308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557849fea5d0 con 0x55784a21c4f0 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a216420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f800c8980 tx=0x7f0f80098690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c3af4e1345c476c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f78ff9700 1 -- 172.21.15.35:0/930036308 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800970d0 con 0x55784a21c4f0 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f78ff9700 1 -- 172.21.15.35:0/930036308 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f80095440 con 0x55784a21c4f0 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.840+0000 7f0f78ff9700 1 -- 172.21.15.35:0/930036308 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80098220 con 0x55784a21c4f0 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/930036308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 msgr2=0x55784a216420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a216420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f800c8980 tx=0x7f0f80098690 comp rx=0 tx=0).stop 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/930036308 shutdown_connections 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a216d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21bbe0 0x55784a21bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/930036308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a216420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/930036308 >> 172.21.15.35:0/930036308 conn(0x55784a0736b0 msgr2=0x55784a210a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/930036308 shutdown_connections 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.841+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/930036308 wait complete. 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 -- start start 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 Processor -- start 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a222510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21bbe0 0x55784a21f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 0x55784a21fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557849fec8c0 con 0x55784a21c4f0 2023-03-17T11:01:47.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a2204e0 con 0x55784a216960 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a229ce0 con 0x55784a21bbe0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f9cd5ab80 10 client.0 _ll_register_callbacks cb 0x55784a00e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f8ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 0x55784a21fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f8ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 0x55784a21fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53040/0 (socket says 172.21.15.35:53040) 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f8ad9d700 1 -- 172.21.15.35:0/1247569145 learned_addr learned my addr 172.21.15.35:0/1247569145 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.842+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21bbe0 0x55784a21f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a222510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 msgr2=0x55784a222510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a222510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1247569145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 msgr2=0x55784a21fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 0x55784a21fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1247569145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c10f040 con 0x55784a21bbe0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 0x55784a21fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21bbe0 0x55784a21f720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f80097080 tx=0x7f0f80009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7b40c269c46f66f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:01:47.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1247569145 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80098420 con 0x55784a21bbe0 2023-03-17T11:01:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1247569145 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0f8009b070 con 0x55784a21bbe0 2023-03-17T11:01:47.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.843+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55784a12b390 con 0x55784a21bbe0 2023-03-17T11:01:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1247569145 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f800971d0 con 0x55784a21bbe0 2023-03-17T11:01:49.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 10 client.28990 fetch_fsmap learned FSMap version 73 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x557849f96d80 con 0x55784a21bbe0 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1247569145 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f80063080 con 0x55784a21bbe0 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1247569145 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0f800c2d20 con 0x55784a21bbe0 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 10 client.28990 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 10 client.28990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 20 client.28990 populate_metadata read hostname 'smithi035' 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a22d900 0x55784a23a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 4 client.28990 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55784a137600 con 0x55784a22d900 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.844+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a22d900 0x55784a23a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.845+0000 7f0f71ffb700 10 client.28990 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.845+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a22d900 0x55784a23a920 crc :-1 s=READY pgs=566 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d99d03784045f9f server_cookie=22fc66f0c5a37a34 in_seq=0 out_seq=0 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1247569145 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55784a137600 con 0x55784a22d900 2023-03-17T11:01:49.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f71ffb700 10 client.28990 handle_command_reply: tid=0 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 client.28990 shutdown 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21bbe0 msgr2=0x55784a21f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21bbe0 0x55784a21f720 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0f80097080 tx=0x7f0f80009c30 comp rx=0 tx=0).stop 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 shutdown_connections 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a22d900 0x55784a23a920 crc :-1 s=READY pgs=566 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a21c4f0 0x55784a21fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a216960 0x55784a222510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f71ffb700 0 client.28990 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1247569145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21bbe0 0x55784a21f720 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 >> 172.21.15.35:0/1247569145 conn(0x55784a0736b0 msgr2=0x55784a215410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 shutdown_connections 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1247569145 wait complete. 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.846+0000 7f0f9cd5ab80 20 client.28990 trim_cache size 0 max 16384 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.869+0000 7f0f9cd5ab80 1 Processor -- start 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 -- start start 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a219d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:49.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a210ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a222040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a21b830 con 0x55784a216960 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a211dd0 con 0x55784a21bbe0 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a20ad70 con 0x55784a21c4f0 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a219d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a219d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53046/0 (socket says 172.21.15.35:53046) 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 -- 172.21.15.35:0/407662439 learned_addr learned my addr 172.21.15.35:0/407662439 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a210ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a222040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 -- 172.21.15.35:0/407662439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 msgr2=0x55784a222040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a222040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 -- 172.21.15.35:0/407662439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 msgr2=0x55784a210ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a210ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:49.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.870+0000 7f0f8a59c700 1 -- 172.21.15.35:0/407662439 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55784a12f130 con 0x55784a216960 2023-03-17T11:01:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.871+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a210ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.871+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a219d60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00f530 tx=0x7f0f7c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305870bfbb434abe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.871+0000 7f0f797fa700 1 -- 172.21.15.35:0/407662439 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c022040 con 0x55784a216960 2023-03-17T11:01:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.871+0000 7f0f797fa700 1 -- 172.21.15.35:0/407662439 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f7c023040 con 0x55784a216960 2023-03-17T11:01:50.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.871+0000 7f0f797fa700 1 -- 172.21.15.35:0/407662439 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0044e0 con 0x55784a216960 2023-03-17T11:01:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/407662439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 msgr2=0x55784a219d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a219d60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00f530 tx=0x7f0f7c014000 comp rx=0 tx=0).stop 2023-03-17T11:01:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/407662439 shutdown_connections 2023-03-17T11:01:50.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a222040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a219d60 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/407662439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a210ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/407662439 >> 172.21.15.35:0/407662439 conn(0x55784a0736b0 msgr2=0x55784a219650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/407662439 shutdown_connections 2023-03-17T11:01:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.872+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/407662439 wait complete. 2023-03-17T11:01:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 -- start start 2023-03-17T11:01:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 Processor -- start 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a23ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a23b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a28afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a28b4f0 con 0x55784a216960 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a28b630 con 0x55784a21bbe0 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784a29c7b0 con 0x55784a21c4f0 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f9cd5ab80 10 client.0 _ll_register_callbacks cb 0x55784a00e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f89d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a23b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f8ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a28afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f89d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a23b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54848/0 (socket says 172.21.15.35:54848) 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f89d9b700 1 -- 172.21.15.35:0/1743333155 learned_addr learned my addr 172.21.15.35:0/1743333155 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.873+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a23ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f8ad9d700 1 -- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 msgr2=0x55784a23b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:52.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:04 smithi035 ceph-mon[92535]: pgmap v4110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T11:01:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a23b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f8ad9d700 1 -- 172.21.15.35:0/1743333155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 msgr2=0x55784a23ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:01:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a23ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f8ad9d700 1 -- 172.21.15.35:0/1743333155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557849f96d80 con 0x55784a21c4f0 2023-03-17T11:01:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f89d9b700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a23b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:01:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f8ad9d700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a28afb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f840047f0 tx=0x7f0f840077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b48b13a55b4424b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1743333155 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8401c070 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.874+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1743333155 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(294..294 src has 1..294) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0f84004bb0 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55784a1e61e0 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1743333155 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f84007ea0 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 10 client.28996 fetch_fsmap learned FSMap version 73 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7f0f7c017070 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1743333155 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55784a1e61e0 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1743333155 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 73) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0f84020430 con 0x55784a21c4f0 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 10 client.28996 fetch_fsmap finished waiting for FSMap version 73 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 10 client.28996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 20 client.28996 populate_metadata read hostname 'smithi035' 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a29df70 0x55784a2a0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 4 client.28996 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:01:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557849fecf00 con 0x55784a29df70 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.875+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a29df70 0x55784a2a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.876+0000 7f0f71ffb700 10 client.28996 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.876+0000 7f0f8a59c700 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a29df70 0x55784a2a0380 crc :-1 s=READY pgs=567 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5234f2d2db9184ea server_cookie=3e2f8602cb5108f4 in_seq=0 out_seq=0 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f71ffb700 1 -- 172.21.15.35:0/1743333155 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557849fecf00 con 0x55784a29df70 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f71ffb700 10 client.28996 handle_command_reply: tid=0 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 client.28996 shutdown 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 msgr2=0x55784a28afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a28afb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f840047f0 tx=0x7f0f840077e0 comp rx=0 tx=0).stop 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 shutdown_connections 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55784a29df70 0x55784a2a0380 crc :-1 s=READY pgs=567 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55784a21c4f0 0x55784a28afb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55784a216960 0x55784a23ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 --2- 172.21.15.35:0/1743333155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55784a21bbe0 0x55784a23b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f71ffb700 0 client.28996 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 >> 172.21.15.35:0/1743333155 conn(0x55784a0736b0 msgr2=0x55784a21b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 shutdown_connections 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 1 -- 172.21.15.35:0/1743333155 wait complete. 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.974+0000 7f0f9cd5ab80 20 client.28996 trim_cache size 0 max 16384 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f7409f640 msgr2=0x7f0f740a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f7409f640 0x7f0f740a1af0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c005d10 tx=0x7f0f7c009310 comp rx=0 tx=0).stop 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 msgr2=0x7f0f8c1957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:01:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c1957e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f80000c00 tx=0x7f0f8000fa00 comp rx=0 tx=0).stop 2023-03-17T11:01:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 shutdown_connections 2023-03-17T11:01:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0f7409f640 0x7f0f740a1af0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8c104410 0x7f0f8c199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:01:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0f8c0ff3d0 0x7f0f8c1952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 --2- 172.21.15.35:0/1586323461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8c0ffd70 0x7f0f8c1957e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.975+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 >> 172.21.15.35:0/1586323461 conn(0x7f0f8c076f80 msgr2=0x7f0f8c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.977+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 shutdown_connections 2023-03-17T11:02:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:33:59.977+0000 7f0f90bcd700 1 -- 172.21.15.35:0/1586323461 wait complete. 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 -- 172.21.15.35:0/28099650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd63810c850 msgr2=0x7fd63810cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/28099650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd63810c850 0x7fd63810cc20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd628009990 tx=0x7fd628009ca0 comp rx=0 tx=0).stop 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 -- 172.21.15.35:0/28099650 shutdown_connections 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/28099650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd638107020 0x7fd638113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/28099650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd63810c850 0x7fd63810cc20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/28099650 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 -- 172.21.15.35:0/28099650 >> 172.21.15.35:0/28099650 conn(0x7fd638074800 msgr2=0x7fd638076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 -- 172.21.15.35:0/28099650 shutdown_connections 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.871+0000 7fd63ddc9700 1 -- 172.21.15.35:0/28099650 wait complete. 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.872+0000 7fd63ddc9700 1 Processor -- start 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 -- start start 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd638107020 0x7fd63819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd63810c850 0x7fd63819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381a1900 con 0x7fd63810d160 2023-03-17T11:02:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381a1a70 con 0x7fd63810c850 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd63ddc9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381a1c30 con 0x7fd638107020 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381a1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53070/0 (socket says 172.21.15.35:53070) 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 -- 172.21.15.35:0/2583351479 learned_addr learned my addr 172.21.15.35:0/2583351479 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd636ffd700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd63810c850 0x7fd63819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd6377fe700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd638107020 0x7fd63819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 -- 172.21.15.35:0/2583351479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd638107020 msgr2=0x7fd63819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:01.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd638107020 0x7fd63819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 -- 172.21.15.35:0/2583351479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd63810c850 msgr2=0x7fd63819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd63810c850 0x7fd63819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd637fff700 1 -- 172.21.15.35:0/2583351479 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280095f0 con 0x7fd63810d160 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.873+0000 7fd636ffd700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd63810c850 0x7fd63819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.874+0000 7fd637fff700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381a1330 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fd63000ef30 tx=0x7fd63000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.874+0000 7fd634ff9700 1 -- 172.21.15.35:0/2583351479 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630018070 con 0x7fd63810d160 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.874+0000 7fd634ff9700 1 -- 172.21.15.35:0/2583351479 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd63000f040 con 0x7fd63810d160 2023-03-17T11:02:01.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.874+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd638116770 con 0x7fd63810d160 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.874+0000 7fd634ff9700 1 -- 172.21.15.35:0/2583351479 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63000cbc0 con 0x7fd63810d160 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.874+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6381165e0 con 0x7fd63810d160 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.877+0000 7fd634ff9700 1 -- 172.21.15.35:0/2583351479 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd630007500 con 0x7fd63810d160 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.878+0000 7fd634ff9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd62009f6c0 0x7fd6200a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.878+0000 7fd634ff9700 1 -- 172.21.15.35:0/2583351479 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(300..300 src has 1..300) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd6300ca0a0 con 0x7fd63810d160 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd6377fe700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd62009f6c0 0x7fd6200a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 Processor -- start 2023-03-17T11:02:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 -- start start 2023-03-17T11:02:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd06420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dc0d010 con 0x55e53dd0bbe0 2023-03-17T11:02:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dc5f950 con 0x55e53dd0c4f0 2023-03-17T11:02:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.879+0000 7fd649f56b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dc58de0 con 0x55e53dd06960 2023-03-17T11:02:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd06420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd06420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54872/0 (socket says 172.21.15.35:54872) 2023-03-17T11:02:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 -- 172.21.15.35:0/949249990 learned_addr learned my addr 172.21.15.35:0/949249990 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd6377fe700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd62009f6c0 0x7fd6200a1b70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd628006010 tx=0x7fd62800b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd637fff700 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:04.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd6377fe700 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 -- 172.21.15.35:0/949249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 msgr2=0x55e53dd06d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd06d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 -- 172.21.15.35:0/949249990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 msgr2=0x55e53dd0bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 -- 172.21.15.35:0/949249990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e53dada5d0 con 0x55e53dd0c4f0 2023-03-17T11:02:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd6377fe700 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd636ffd700 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd06420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0114f0 tx=0x7fd62c011800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a352f69cabd35b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd61dffb700 1 -- 172.21.15.35:0/949249990 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c004230 con 0x55e53dd0c4f0 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd61dffb700 1 -- 172.21.15.35:0/949249990 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd62c004390 con 0x55e53dd0c4f0 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.880+0000 7fd61dffb700 1 -- 172.21.15.35:0/949249990 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00e8b0 con 0x55e53dd0c4f0 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 -- 172.21.15.35:0/949249990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 msgr2=0x55e53dd06420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd06420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0114f0 tx=0x7fd62c011800 comp rx=0 tx=0).stop 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 -- 172.21.15.35:0/949249990 shutdown_connections 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd06d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:05.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 --2- 172.21.15.35:0/949249990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd06420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.881+0000 7fd649f56b80 1 -- 172.21.15.35:0/949249990 >> 172.21.15.35:0/949249990 conn(0x55e53db636b0 msgr2=0x55e53dd00a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.882+0000 7fd649f56b80 1 -- 172.21.15.35:0/949249990 shutdown_connections 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.882+0000 7fd649f56b80 1 -- 172.21.15.35:0/949249990 wait complete. 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.882+0000 7fd649f56b80 1 -- start start 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.882+0000 7fd649f56b80 1 Processor -- start 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.882+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd12480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.882+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 0x55e53dd0fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd649f56b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dadc8c0 con 0x55e53dd0c4f0 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd649f56b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd104d0 con 0x55e53dd0bbe0 2023-03-17T11:02:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd649f56b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd1c000 con 0x55e53dd06960 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd649f56b80 10 client.0 _ll_register_callbacks cb 0x55e53dafe230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 0x55e53dd0fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54880/0 (socket says 172.21.15.35:54880) 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 0x55e53dd0fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53086/0 (socket says 172.21.15.35:53086) 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd636ffd700 1 -- 172.21.15.35:0/4275476997 learned_addr learned my addr 172.21.15.35:0/4275476997 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd6377fe700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd12480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 -- 172.21.15.35:0/4275476997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 msgr2=0x55e53dd12480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd12480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 -- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 msgr2=0x55e53dd0f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 -- 172.21.15.35:0/4275476997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c009c90 con 0x55e53dd0c4f0 2023-03-17T11:02:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd636ffd700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:02:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd637fff700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 0x55e53dd0fd60 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fd6300c7830 tx=0x7fd630097610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d725a691752207bc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd616ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:02:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.883+0000 7fd616ffd700 1 -- 172.21.15.35:0/4275476997 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63009fd40 con 0x55e53dd0c4f0 2023-03-17T11:02:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd616ffd700 1 -- 172.21.15.35:0/4275476997 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(300..300 src has 1..300) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd6300970d0 con 0x55e53dd0c4f0 2023-03-17T11:02:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e53dc1b390 con 0x55e53dd0c4f0 2023-03-17T11:02:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd616ffd700 1 -- 172.21.15.35:0/4275476997 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd630097290 con 0x55e53dd0c4f0 2023-03-17T11:02:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 10 client.19866 fetch_fsmap learned FSMap version 74 2023-03-17T11:02:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55e53da86d80 con 0x55e53dd0c4f0 2023-03-17T11:02:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd616ffd700 1 -- 172.21.15.35:0/4275476997 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e53dc1b390 con 0x55e53dd0c4f0 2023-03-17T11:02:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd616ffd700 1 -- 172.21.15.35:0/4275476997 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 74) v1 ==== 6921+0+0 (secure 0 0 0) 0x7fd630096b40 con 0x55e53dd0c4f0 2023-03-17T11:02:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 10 client.19866 fetch_fsmap finished waiting for FSMap version 74 2023-03-17T11:02:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 10 client.19866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 20 client.19866 populate_metadata read hostname 'smithi035' 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd20030 0x55e53dd22440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 4 client.19866 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e53dc27600 con 0x55e53dd20030 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.884+0000 7fd6377fe700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd20030 0x55e53dd22440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.885+0000 7fd616ffd700 10 client.19866 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.885+0000 7fd6377fe700 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd20030 0x55e53dd22440 crc :-1 s=READY pgs=568 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd63a1073a5fbd3 server_cookie=a02c29cd662aadbe in_seq=0 out_seq=0 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd616ffd700 1 -- 172.21.15.35:0/4275476997 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e53dc27600 con 0x55e53dd20030 2023-03-17T11:02:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd616ffd700 10 client.19866 handle_command_reply: tid=0 2023-03-17T11:02:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 client.19866 shutdown 2023-03-17T11:02:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 msgr2=0x55e53dd0fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 0x55e53dd0fd60 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fd6300c7830 tx=0x7fd630097610 comp rx=0 tx=0).stop 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 shutdown_connections 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd20030 0x55e53dd22440 crc :-1 s=READY pgs=568 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0c4f0 0x55e53dd0fd60 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd06960 0x55e53dd12480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd616ffd700 0 client.19866 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 --2- 172.21.15.35:0/4275476997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0bbe0 0x55e53dd0f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 >> 172.21.15.35:0/4275476997 conn(0x55e53db636b0 msgr2=0x55e53dd05410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:16.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 shutdown_connections 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 1 -- 172.21.15.35:0/4275476997 wait complete. 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.886+0000 7fd649f56b80 20 client.19866 trim_cache size 0 max 16384 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 Processor -- start 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 -- start start 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 0x55e53dd00ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0bbe0 0x55e53dd16f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd05a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd10150 con 0x55e53dd06960 2023-03-17T11:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd01030 con 0x55e53dd0c4f0 2023-03-17T11:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd649f56b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd06780 con 0x55e53dd0bbe0 2023-03-17T11:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 0x55e53dd00ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0bbe0 0x55e53dd16f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.914+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 0x55e53dd00ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53090/0 (socket says 172.21.15.35:53090) 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 -- 172.21.15.35:0/1530437728 learned_addr learned my addr 172.21.15.35:0/1530437728 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd637fff700 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd05a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 -- 172.21.15.35:0/1530437728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0bbe0 msgr2=0x55e53dd16f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0bbe0 0x55e53dd16f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 -- 172.21.15.35:0/1530437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 msgr2=0x55e53dd05a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd05a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 -- 172.21.15.35:0/1530437728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e53dc1f130 con 0x55e53dd06960 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd6377fe700 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 0x55e53dd00ac0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fd628009990 tx=0x7fd628020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4d6ad8f60f439e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd61e7fc700 1 -- 172.21.15.35:0/1530437728 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800bd50 con 0x55e53dd06960 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd61e7fc700 1 -- 172.21.15.35:0/1530437728 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd62801e040 con 0x55e53dd06960 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.915+0000 7fd61e7fc700 1 -- 172.21.15.35:0/1530437728 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628004500 con 0x55e53dd06960 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 -- 172.21.15.35:0/1530437728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 msgr2=0x55e53dd00ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 0x55e53dd00ac0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fd628009990 tx=0x7fd628020000 comp rx=0 tx=0).stop 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 -- 172.21.15.35:0/1530437728 shutdown_connections 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd0c4f0 0x55e53dd05a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd06960 0x55e53dd00ac0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 --2- 172.21.15.35:0/1530437728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0bbe0 0x55e53dd16f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 -- 172.21.15.35:0/1530437728 >> 172.21.15.35:0/1530437728 conn(0x55e53db636b0 msgr2=0x55e53dd1b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 -- 172.21.15.35:0/1530437728 shutdown_connections 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.916+0000 7fd649f56b80 1 -- 172.21.15.35:0/1530437728 wait complete. 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 -- start start 2023-03-17T11:02:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 Processor -- start 2023-03-17T11:02:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd06960 0x55e53dd6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd6c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 0x55e53dd6d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd6d880 con 0x55e53dd0bbe0 2023-03-17T11:02:24.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd6d9f0 con 0x55e53dd06960 2023-03-17T11:02:24.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53dd6dbb0 con 0x55e53dd0c4f0 2023-03-17T11:02:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd649f56b80 10 client.0 _ll_register_callbacks cb 0x55e53dafe230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:02:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd6c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd06960 0x55e53dd6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd637fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 0x55e53dd6d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd636ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd6c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53100/0 (socket says 172.21.15.35:53100) 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd6377fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd06960 0x55e53dd6c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54892/0 (socket says 172.21.15.35:54892) 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd636ffd700 1 -- 172.21.15.35:0/2166427468 learned_addr learned my addr 172.21.15.35:0/2166427468 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.917+0000 7fd637fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 0x55e53dd6d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44864/0 (socket says 172.21.15.35:44864) 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd637fff700 1 -- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd06960 msgr2=0x55e53dd6c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd637fff700 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd06960 0x55e53dd6c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd637fff700 1 -- 172.21.15.35:0/2166427468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 msgr2=0x55e53dd6c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd637fff700 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd6c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd637fff700 1 -- 172.21.15.35:0/2166427468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd638113ed0 con 0x55e53dd0c4f0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd637fff700 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 0x55e53dd6d170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd63009f810 tx=0x7fd630094050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=582e27c91bb4bc26 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd616ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd616ffd700 1 -- 172.21.15.35:0/2166427468 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630096f10 con 0x55e53dd0c4f0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd616ffd700 1 -- 172.21.15.35:0/2166427468 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(300..300 src has 1..300) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd63009fb20 con 0x55e53dd0c4f0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.918+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e53dcd61e0 con 0x55e53dd0c4f0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd616ffd700 1 -- 172.21.15.35:0/2166427468 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd63009fd40 con 0x55e53dd0c4f0 2023-03-17T11:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 10 client.29014 fetch_fsmap learned FSMap version 74 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55e53daad1f0 con 0x55e53dd0c4f0 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd616ffd700 1 -- 172.21.15.35:0/2166427468 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e53dcd61e0 con 0x55e53dd0c4f0 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd616ffd700 1 -- 172.21.15.35:0/2166427468 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 74) v1 ==== 6921+0+0 (secure 0 0 0) 0x7fd6300970d0 con 0x55e53dd0c4f0 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 10 client.29014 fetch_fsmap finished waiting for FSMap version 74 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 10 client.29014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 20 client.29014 populate_metadata read hostname 'smithi035' 2023-03-17T11:02:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd74e60 0x55e53dd77240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 4 client.29014 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:02:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e53dadcf00 con 0x55e53dd74e60 2023-03-17T11:02:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.919+0000 7fd6377fe700 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd74e60 0x55e53dd77240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.920+0000 7fd616ffd700 10 client.29014 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:02:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:23.920+0000 7fd6377fe700 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd74e60 0x55e53dd77240 crc :-1 s=READY pgs=569 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97890c34eedf0d4d server_cookie=aef5d4efdf091e08 in_seq=0 out_seq=0 2023-03-17T11:02:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.028+0000 7fd616ffd700 1 -- 172.21.15.35:0/2166427468 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e53dadcf00 con 0x55e53dd74e60 2023-03-17T11:02:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.028+0000 7fd616ffd700 10 client.29014 handle_command_reply: tid=0 2023-03-17T11:02:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.030+0000 7fd649f56b80 1 client.29014 shutdown 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.031+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 msgr2=0x55e53dd6d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.031+0000 7fd649f56b80 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 0x55e53dd6d170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd63009f810 tx=0x7fd630094050 comp rx=0 tx=0).stop 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 shutdown_connections 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd649f56b80 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e53dd74e60 0x55e53dd77240 crc :-1 s=READY pgs=569 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd649f56b80 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e53dd0c4f0 0x55e53dd6d170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd649f56b80 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e53dd06960 0x55e53dd6c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd649f56b80 1 --2- 172.21.15.35:0/2166427468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e53dd0bbe0 0x55e53dd6c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 >> 172.21.15.35:0/2166427468 conn(0x55e53db636b0 msgr2=0x55e53dd096b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.032+0000 7fd616ffd700 0 client.29014 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.033+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 shutdown_connections 2023-03-17T11:02:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.033+0000 7fd649f56b80 1 -- 172.21.15.35:0/2166427468 wait complete. 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.037+0000 7fd649f56b80 20 client.29014 trim_cache size 0 max 16384 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd62009f6c0 msgr2=0x7fd6200a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd62009f6c0 0x7fd6200a1b70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd628006010 tx=0x7fd62800b260 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 msgr2=0x7fd6381a1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381a1330 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fd63000ef30 tx=0x7fd63000c3a0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 shutdown_connections 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd62009f6c0 0x7fd6200a1b70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd63810d160 0x7fd6381a1330 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd638107020 0x7fd63819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 --2- 172.21.15.35:0/2583351479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd63810c850 0x7fd63819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 >> 172.21.15.35:0/2583351479 conn(0x7fd638074800 msgr2=0x7fd638076190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 shutdown_connections 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:24.038+0000 7fd63ddc9700 1 -- 172.21.15.35:0/2583351479 wait complete. 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 -- 172.21.15.35:0/1340460894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ffcf0 msgr2=0x7f3cdc103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 --2- 172.21.15.35:0/1340460894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc103cb0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0099c0 tx=0x7f3ccc009cd0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 -- 172.21.15.35:0/1340460894 shutdown_connections 2023-03-17T11:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 --2- 172.21.15.35:0/1340460894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc104390 0x7f3cdc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 --2- 172.21.15.35:0/1340460894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 --2- 172.21.15.35:0/1340460894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc103cb0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 -- 172.21.15.35:0/1340460894 >> 172.21.15.35:0/1340460894 conn(0x7f3cdc076330 msgr2=0x7f3cdc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 -- 172.21.15.35:0/1340460894 shutdown_connections 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.193+0000 7f3ce414b700 1 -- 172.21.15.35:0/1340460894 wait complete. 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 Processor -- start 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 -- start start 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc104390 0x7f3cdc1a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1a26b0 con 0x7f3cdc0ff350 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1a27f0 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.194+0000 7f3ce414b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1a2930 con 0x7f3cdc104390 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc1970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53110/0 (socket says 172.21.15.35:53110) 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/406951669 learned_addr learned my addr 172.21.15.35:0/406951669 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc104390 0x7f3cdc1a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 -- 172.21.15.35:0/406951669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc104390 msgr2=0x7f3cdc1a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc104390 0x7f3cdc1a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 -- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 msgr2=0x7f3cdc1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 -- 172.21.15.35:0/406951669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0095f0 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc104390 0x7f3cdc1a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc197630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009fd0 tx=0x7f3ccc00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3cd2ffd700 1 -- 172.21.15.35:0/406951669 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc01d070 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc10f010 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3cd2ffd700 1 -- 172.21.15.35:0/406951669 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ccc022470 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3cd2ffd700 1 -- 172.21.15.35:0/406951669 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0173f0 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.195+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc10ee80 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.198+0000 7f3cd2ffd700 1 -- 172.21.15.35:0/406951669 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3ccc0227e0 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.199+0000 7f3cd2ffd700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3cc809f640 0x7f3cc80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.199+0000 7f3cd2ffd700 1 -- 172.21.15.35:0/406951669 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(300..300 src has 1..300) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3ccc0cb560 con 0x7f3cdc0ffcf0 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.199+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3cc809f640 0x7f3cc80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 Processor -- start 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 -- start start 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3cc809f640 0x7f3cc80a1af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8011550 tx=0x7f3cd8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b525a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b524d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 0x5623b524dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b5154010 con 0x5623b524d960 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b51a6950 con 0x5623b525ac20 2023-03-17T11:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.200+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b519fde0 con 0x5623b525a310 2023-03-17T11:02:31.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:06 smithi035 ceph-mon[92535]: pgmap v4111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T11:02:36.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:08 smithi035 ceph-mon[92535]: pgmap v4112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T11:02:36.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:10 smithi035 ceph-mon[92535]: pgmap v4113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T11:02:36.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:10 smithi035 ceph-mon[92535]: osdmap e330: 12 total, 12 up, 12 in 2023-03-17T11:02:36.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:12 smithi035 ceph-mon[92535]: pgmap v4115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T11:02:36.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:14 smithi035 ceph-mon[92535]: pgmap v4116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:02:38.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:16 smithi035 ceph-mon[92535]: pgmap v4117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:02:38.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:17 smithi035 ceph-mon[92535]: pgmap v4118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:02:38.087 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:17 smithi035 ceph-mon[92535]: osdmap e331: 12 total, 12 up, 12 in 2023-03-17T11:02:39.033 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:19 smithi035 ceph-mon[92535]: pgmap v4120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 105 B/s wr, 11 op/s 2023-03-17T11:02:40.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:21 smithi035 ceph-mon[92535]: pgmap v4121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:02:40.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:23 smithi035 ceph-mon[92535]: pgmap v4122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T11:02:40.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:25 smithi035 ceph-mon[92535]: pgmap v4123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T11:02:40.569 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:27 smithi035 ceph-mon[92535]: pgmap v4124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T11:02:41.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:29 smithi035 ceph-mon[92535]: pgmap v4125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2023-03-17T11:02:41.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:31 smithi035 ceph-mon[92535]: pgmap v4126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T11:02:41.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:33 smithi035 ceph-mon[92535]: pgmap v4127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T11:02:41.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:35 smithi035 ceph-mon[92535]: pgmap v4128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:02:41.106 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:37 smithi035 ceph-mon[92535]: pgmap v4129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:02:41.828 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:39 smithi035 ceph-mon[92535]: pgmap v4130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:42 smithi035 ceph-mon[92535]: pgmap v4131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:02:41.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:02:41.831 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:43 smithi035 ceph-mon[92535]: pgmap v4132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 15 op/s 2023-03-17T11:02:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:43 smithi035 ceph-mon[92535]: pgmap v4133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T11:02:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:45 smithi035 ceph-mon[92535]: pgmap v4134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T11:02:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:47 smithi035 ceph-mon[92535]: pgmap v4135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T11:02:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:49 smithi035 ceph-mon[92535]: pgmap v4136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T11:02:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:51 smithi035 ceph-mon[92535]: pgmap v4137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T11:02:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:52 smithi035 ceph-mon[92535]: pgmap v4138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T11:02:44.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:55 smithi035 ceph-mon[92535]: pgmap v4139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:02:44.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:57 smithi035 ceph-mon[92535]: pgmap v4140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:02:44.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:51:59 smithi035 ceph-mon[92535]: pgmap v4141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:02:44.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:01 smithi035 ceph-mon[92535]: pgmap v4142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:02:44.131 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:02 smithi035 ceph-mon[92535]: pgmap v4143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:02:45.084 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:05 smithi035 ceph-mon[92535]: pgmap v4144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:07 smithi035 ceph-mon[92535]: pgmap v4145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:09 smithi035 ceph-mon[92535]: pgmap v4146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:10 smithi035 ceph-mon[92535]: osdmap e332: 12 total, 12 up, 12 in 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:11 smithi035 ceph-mon[92535]: pgmap v4148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:12 smithi035 ceph-mon[92535]: pgmap v4149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:15 smithi035 ceph-mon[92535]: pgmap v4150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:17 smithi035 ceph-mon[92535]: pgmap v4151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:17 smithi035 ceph-mon[92535]: osdmap e333: 12 total, 12 up, 12 in 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:19 smithi035 ceph-mon[92535]: pgmap v4153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 12 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:21 smithi035 ceph-mon[92535]: pgmap v4154: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:22 smithi035 ceph-mon[92535]: pgmap v4155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:25 smithi035 ceph-mon[92535]: pgmap v4156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:27 smithi035 ceph-mon[92535]: pgmap v4157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:02:45.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:29 smithi035 ceph-mon[92535]: pgmap v4158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:31 smithi035 ceph-mon[92535]: pgmap v4159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:32 smithi035 ceph-mon[92535]: pgmap v4160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:35 smithi035 ceph-mon[92535]: pgmap v4161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:37 smithi035 ceph-mon[92535]: pgmap v4162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:39 smithi035 ceph-mon[92535]: pgmap v4163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:41 smithi035 ceph-mon[92535]: pgmap v4164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:42 smithi035 ceph-mon[92535]: pgmap v4165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:02:45.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:02:46.861 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:43 smithi035 ceph-mon[92535]: pgmap v4166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:43 smithi035 ceph-mon[92535]: pgmap v4167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:46 smithi035 ceph-mon[92535]: pgmap v4168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:47 smithi035 ceph-mon[92535]: pgmap v4169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:50 smithi035 ceph-mon[92535]: pgmap v4170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:52 smithi035 ceph-mon[92535]: pgmap v4171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T11:02:46.862 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:54 smithi035 ceph-mon[92535]: pgmap v4172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:02:49.319 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:56 smithi035 ceph-mon[92535]: pgmap v4173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:02:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:02:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:02:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:02:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:02:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:02:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:02:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:02:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:02:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:02:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:02:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:02:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:02:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:02:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:02:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:02:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:02:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce26e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 0x5623b524dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b525a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce16e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b524d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce26e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 0x5623b524dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53122/0 (socket says 172.21.15.35:53122) 2023-03-17T11:02:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce26e8700 1 -- 172.21.15.35:0/2171119549 learned_addr learned my addr 172.21.15.35:0/2171119549 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/2171119549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 msgr2=0x5623b524d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b524d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/2171119549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 msgr2=0x5623b524dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 0x5623b524dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/2171119549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623b50215d0 con 0x5623b525a310 2023-03-17T11:02:53.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 0x5623b524dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b525a6e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8011ca0 tx=0x7f3cd8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf2ce1173a335f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3cc7fff700 1 -- 172.21.15.35:0/2171119549 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004830 con 0x5623b525a310 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3cc7fff700 1 -- 172.21.15.35:0/2171119549 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3cd8021070 con 0x5623b525a310 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.201+0000 7f3cc7fff700 1 -- 172.21.15.35:0/2171119549 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd801c630 con 0x5623b525a310 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/2171119549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 msgr2=0x5623b525a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b525a6e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8011ca0 tx=0x7f3cd8014000 comp rx=0 tx=0).stop 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/2171119549 shutdown_connections 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b524d960 0x5623b524dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b525a6e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/2171119549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b524d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/2171119549 >> 172.21.15.35:0/2171119549 conn(0x5623b50aa6b0 msgr2=0x5623b5247a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/2171119549 shutdown_connections 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.202+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/2171119549 wait complete. 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 -- start start 2023-03-17T11:02:53.632 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 Processor -- start 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5261cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525a310 0x5623b525ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b525f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b50238c0 con 0x5623b525a310 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b525fd20 con 0x5623b525ac20 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b5258e10 con 0x5623b524d960 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3cf02d8b80 10 client.0 _ll_register_callbacks cb 0x5623b5045230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5261cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.203+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5261cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44890/0 (socket says 172.21.15.35:44890) 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/25770671 learned_addr learned my addr 172.21.15.35:0/25770671 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b525f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525a310 0x5623b525ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:53.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 msgr2=0x5623b525f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b525f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/25770671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525a310 msgr2=0x5623b525ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:02:53.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525a310 0x5623b525ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 -- 172.21.15.35:0/25770671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd8017070 con 0x5623b524d960 2023-03-17T11:02:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5261cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8005570 tx=0x7f3cd80055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d3b37048046fd80 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:02:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3cc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:02:54.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3cc57fa700 1 -- 172.21.15.35:0/25770671 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8026890 con 0x5623b524d960 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3cc57fa700 1 -- 172.21.15.35:0/25770671 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(300..300 src has 1..300) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3cd80269f0 con 0x5623b524d960 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623b5162390 con 0x5623b524d960 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.204+0000 7f3cc57fa700 1 -- 172.21.15.35:0/25770671 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cd8026bb0 con 0x5623b524d960 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.205+0000 7f3cf02d8b80 10 client.29026 fetch_fsmap learned FSMap version 75 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.205+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x5623b4fcdd80 con 0x5623b524d960 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.205+0000 7f3cc57fa700 1 -- 172.21.15.35:0/25770671 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623b5162390 con 0x5623b524d960 2023-03-17T11:02:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cc57fa700 1 -- 172.21.15.35:0/25770671 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 75) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3cd8004f70 con 0x5623b524d960 2023-03-17T11:02:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cf02d8b80 10 client.29026 fetch_fsmap finished waiting for FSMap version 75 2023-03-17T11:02:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cf02d8b80 10 client.29026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cf02d8b80 20 client.29026 populate_metadata read hostname 'smithi035' 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b5278000 0x5623b527a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cf02d8b80 4 client.29026 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623b516e600 con 0x5623b5278000 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b5278000 0x5623b527a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3cc57fa700 10 client.29026 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:02:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.206+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b5278000 0x5623b527a3e0 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ebc960563488f45 server_cookie=3814e243e5d2f07b in_seq=0 out_seq=0 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cc57fa700 1 -- 172.21.15.35:0/25770671 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5623b516e600 con 0x5623b5278000 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cc57fa700 10 client.29026 handle_command_reply: tid=0 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cf02d8b80 1 client.29026 shutdown 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 msgr2=0x5623b5261cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5261cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8005570 tx=0x7f3cd80055a0 comp rx=0 tx=0).stop 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 shutdown_connections 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.207+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b5278000 0x5623b527a3e0 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:02:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525ac20 0x5623b525f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5261cb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/25770671 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525a310 0x5623b525ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 >> 172.21.15.35:0/25770671 conn(0x5623b50aa6b0 msgr2=0x5623b52507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cc57fa700 0 client.29026 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 shutdown_connections 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/25770671 wait complete. 2023-03-17T11:03:01.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.208+0000 7f3cf02d8b80 20 client.29026 trim_cache size 0 max 16384 2023-03-17T11:03:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 Processor -- start 2023-03-17T11:03:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 -- start start 2023-03-17T11:03:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b524d960 0x5623b5255d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b5261850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b525e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b52517a0 con 0x5623b525ac20 2023-03-17T11:03:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b52486c0 con 0x5623b524d960 2023-03-17T11:03:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b524e1d0 con 0x5623b525a310 2023-03-17T11:03:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3ce26e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b525e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3ce26e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b525e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53136/0 (socket says 172.21.15.35:53136) 2023-03-17T11:03:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3ce26e8700 1 -- 172.21.15.35:0/3728432306 learned_addr learned my addr 172.21.15.35:0/3728432306 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.238+0000 7f3ce16e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b5261850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b524d960 0x5623b5255d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce26e8700 1 -- 172.21.15.35:0/3728432306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 msgr2=0x5623b5261850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b5261850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce26e8700 1 -- 172.21.15.35:0/3728432306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b524d960 msgr2=0x5623b5255d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b524d960 0x5623b5255d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce26e8700 1 -- 172.21.15.35:0/3728432306 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623b5166130 con 0x5623b525ac20 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b525e6f0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007690 tx=0x7f3cd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71b39555c381c3a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3cd0ff9700 1 -- 172.21.15.35:0/3728432306 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400e040 con 0x5623b525ac20 2023-03-17T11:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3cd0ff9700 1 -- 172.21.15.35:0/3728432306 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3cd400f040 con 0x5623b525ac20 2023-03-17T11:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.239+0000 7f3cd0ff9700 1 -- 172.21.15.35:0/3728432306 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4016af0 con 0x5623b525ac20 2023-03-17T11:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3728432306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 msgr2=0x5623b525e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b525e6f0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4007690 tx=0x7f3cd400b040 comp rx=0 tx=0).stop 2023-03-17T11:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3728432306 shutdown_connections 2023-03-17T11:03:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b525e6f0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b524d960 0x5623b5255d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3728432306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b525a310 0x5623b5261850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3728432306 >> 172.21.15.35:0/3728432306 conn(0x5623b50aa6b0 msgr2=0x5623b524b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3728432306 shutdown_connections 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.240+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3728432306 wait complete. 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 -- start start 2023-03-17T11:03:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 Processor -- start 2023-03-17T11:03:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5255730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 0x5623b5255c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b5253d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b52543c0 con 0x5623b525ac20 2023-03-17T11:03:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b5254530 con 0x5623b525a310 2023-03-17T11:03:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623b52546f0 con 0x5623b524d960 2023-03-17T11:03:08.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.241+0000 7f3cf02d8b80 10 client.0 _ll_register_callbacks cb 0x5623b5045230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 0x5623b5255c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5255730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 0x5623b5255c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54936/0 (socket says 172.21.15.35:54936) 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 -- 172.21.15.35:0/3796355017 learned_addr learned my addr 172.21.15.35:0/3796355017 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce1ee7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5255730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44904/0 (socket says 172.21.15.35:44904) 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b5253d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:12.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 -- 172.21.15.35:0/3796355017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 msgr2=0x5623b5255730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:12.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5255730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 -- 172.21.15.35:0/3796355017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 msgr2=0x5623b5253d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b5253d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 -- 172.21.15.35:0/3796355017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd4009360 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5255730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce26e8700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b5253d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3ce16e6700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 0x5623b5255c70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0095c0 tx=0x7f3ccc01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e766fcf7173b43e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3cc57fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3cc57fa700 1 -- 172.21.15.35:0/3796355017 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0c8830 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3cc57fa700 1 -- 172.21.15.35:0/3796355017 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(300..300 src has 1..300) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3ccc0c6070 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.242+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623b521d1e0 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cc57fa700 1 -- 172.21.15.35:0/3796355017 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ccc0c8990 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 10 client.29054 fetch_fsmap learned FSMap version 75 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x5623b4ff41f0 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cc57fa700 1 -- 172.21.15.35:0/3796355017 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ccc07c080 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cc57fa700 1 -- 172.21.15.35:0/3796355017 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 75) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3ccc0986b0 con 0x5623b525a310 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 10 client.29054 fetch_fsmap finished waiting for FSMap version 75 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 10 client.29054 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:03:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 20 client.29054 populate_metadata read hostname 'smithi035' 2023-03-17T11:03:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b52ccbd0 0x5623b52cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 4 client.29054 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623b5023f00 con 0x5623b52ccbd0 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.243+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b52ccbd0 0x5623b52cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.244+0000 7f3cc57fa700 10 client.29054 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.244+0000 7f3ce1ee7700 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b52ccbd0 0x5623b52cefe0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cb49c5158349bcf server_cookie=1b6d4bc6db5f1a4f in_seq=0 out_seq=0 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cc57fa700 1 -- 172.21.15.35:0/3796355017 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623b5023f00 con 0x5623b52ccbd0 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cc57fa700 10 client.29054 handle_command_reply: tid=0 2023-03-17T11:03:15.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 client.29054 shutdown 2023-03-17T11:03:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 msgr2=0x5623b5255c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:15.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 0x5623b5255c70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0095c0 tx=0x7f3ccc01a040 comp rx=0 tx=0).stop 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 shutdown_connections 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623b52ccbd0 0x5623b52cefe0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623b525ac20 0x5623b5253d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cc57fa700 0 client.29054 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623b524d960 0x5623b5255730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 --2- 172.21.15.35:0/3796355017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b525a310 0x5623b5255c70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 >> 172.21.15.35:0/3796355017 conn(0x5623b50aa6b0 msgr2=0x5623b5250650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 shutdown_connections 2023-03-17T11:03:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 1 -- 172.21.15.35:0/3796355017 wait complete. 2023-03-17T11:03:16.228 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:52:57 smithi035 ceph-mon[92535]: pgmap v4174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:03:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.326+0000 7f3cf02d8b80 20 client.29054 trim_cache size 0 max 16384 2023-03-17T11:03:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3cc809f640 msgr2=0x7f3cc80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3cc809f640 0x7f3cc80a1af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8011550 tx=0x7f3cd8009260 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc0ffcf0 msgr2=0x7f3cdc197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc197630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009fd0 tx=0x7f3ccc00f690 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 shutdown_connections 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3cc809f640 0x7f3cc80a1af0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cdc104390 0x7f3cdc1a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3cdc0ff350 0x7f3cdc1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 --2- 172.21.15.35:0/406951669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cdc0ffcf0 0x7f3cdc197630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 >> 172.21.15.35:0/406951669 conn(0x7f3cdc076330 msgr2=0x7f3cdc0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 shutdown_connections 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:37.327+0000 7f3ce414b700 1 -- 172.21.15.35:0/406951669 wait complete. 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 -- 172.21.15.35:0/2678420709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0100be0 msgr2=0x7f41a0100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 --2- 172.21.15.35:0/2678420709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0100be0 0x7f41a0100fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4190009990 tx=0x7f4190009ca0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 -- 172.21.15.35:0/2678420709 shutdown_connections 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 --2- 172.21.15.35:0/2678420709 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41a01054f0 0x7f41a010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 --2- 172.21.15.35:0/2678420709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0100be0 0x7f41a0100fb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 --2- 172.21.15.35:0/2678420709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0101580 0x7f41a0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 -- 172.21.15.35:0/2678420709 >> 172.21.15.35:0/2678420709 conn(0x7f41a00774e0 msgr2=0x7f41a00778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 -- 172.21.15.35:0/2678420709 shutdown_connections 2023-03-17T11:03:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.499+0000 7f41a58d4700 1 -- 172.21.15.35:0/2678420709 wait complete. 2023-03-17T11:03:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.500+0000 7f41a58d4700 1 Processor -- start 2023-03-17T11:03:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.500+0000 7f41a58d4700 1 -- start start 2023-03-17T11:03:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.500+0000 7f41a58d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 0x7f41a0072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f41a58d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0101580 0x7f41a00732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f41a58d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41a01054f0 0x7f41a01a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f41a58d4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0073af0 con 0x7f41a01054f0 2023-03-17T11:03:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f41a58d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a01a4960 con 0x7f41a0101580 2023-03-17T11:03:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f41a58d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a01a4aa0 con 0x7f41a0100be0 2023-03-17T11:03:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 0x7f41a0072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41a01054f0 0x7f41a01a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0101580 0x7f41a00732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 0x7f41a0072d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44944/0 (socket says 172.21.15.35:44944) 2023-03-17T11:03:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 -- 172.21.15.35:0/1494517915 learned_addr learned my addr 172.21.15.35:0/1494517915 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 -- 172.21.15.35:0/1494517915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0101580 msgr2=0x7f41a00732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0101580 0x7f41a00732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 -- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41a01054f0 msgr2=0x7f41a01a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41a01054f0 0x7f41a01a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 -- 172.21.15.35:0/1494517915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900095f0 con 0x7f41a0100be0 2023-03-17T11:03:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419e7fc700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0101580 0x7f41a00732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.501+0000 7f419effd700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 0x7f41a0072d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4190000c00 tx=0x7f419000bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.502+0000 7f41a48d2700 1 -- 172.21.15.35:0/1494517915 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419001d070 con 0x7f41a0100be0 2023-03-17T11:03:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.502+0000 7f41a48d2700 1 -- 172.21.15.35:0/1494517915 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4190021410 con 0x7f41a0100be0 2023-03-17T11:03:21.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.502+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a01101f0 con 0x7f41a0100be0 2023-03-17T11:03:22.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.502+0000 7f41a48d2700 1 -- 172.21.15.35:0/1494517915 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190017650 con 0x7f41a0100be0 2023-03-17T11:03:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.502+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a0110060 con 0x7f41a0100be0 2023-03-17T11:03:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.504+0000 7f41a48d2700 1 -- 172.21.15.35:0/1494517915 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4190021580 con 0x7f41a0100be0 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.505+0000 7f41a48d2700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f418809f6c0 0x7f41880a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.505+0000 7f41a48d2700 1 -- 172.21.15.35:0/1494517915 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(301..301 src has 1..301) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f41900cb930 con 0x7f41a0100be0 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.505+0000 7f419e7fc700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f418809f6c0 0x7f41880a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.506+0000 7f419e7fc700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f418809f6c0 0x7f41880a1b70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f41a0074570 tx=0x7f4194009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.506+0000 7f41b1a61b80 1 Processor -- start 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.506+0000 7f41b1a61b80 1 -- start start 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5db420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:23.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5db960 0x55b99b5dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b4e2010 con 0x55b99b5db960 2023-03-17T11:03:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b534950 con 0x55b99b5e14f0 2023-03-17T11:03:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b52dde0 con 0x55b99b5e0be0 2023-03-17T11:03:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44952/0 (socket says 172.21.15.35:44952) 2023-03-17T11:03:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5db420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:54984/0 (socket says 172.21.15.35:54984) 2023-03-17T11:03:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419effd700 1 -- 172.21.15.35:0/3385263029 learned_addr learned my addr 172.21.15.35:0/3385263029 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419f7fe700 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5db960 0x55b99b5dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 -- 172.21.15.35:0/3385263029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 msgr2=0x55b99b5e0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 -- 172.21.15.35:0/3385263029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5db960 msgr2=0x55b99b5dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5db960 0x55b99b5dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 -- 172.21.15.35:0/3385263029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b99b3af5d0 con 0x55b99b5e14f0 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419effd700 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.507+0000 7f419e7fc700 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5db420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41a0101950 tx=0x7f4194014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e03f16571ac8158 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.508+0000 7f4185ffb700 1 -- 172.21.15.35:0/3385263029 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194003d10 con 0x55b99b5e14f0 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.508+0000 7f4185ffb700 1 -- 172.21.15.35:0/3385263029 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4194003e70 con 0x55b99b5e14f0 2023-03-17T11:03:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.508+0000 7f4185ffb700 1 -- 172.21.15.35:0/3385263029 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419401e630 con 0x55b99b5e14f0 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.508+0000 7f41b1a61b80 1 -- 172.21.15.35:0/3385263029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 msgr2=0x55b99b5db420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.508+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5db420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f41a0101950 tx=0x7f4194014000 comp rx=0 tx=0).stop 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 -- 172.21.15.35:0/3385263029 shutdown_connections 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5db960 0x55b99b5dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/3385263029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5db420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 -- 172.21.15.35:0/3385263029 >> 172.21.15.35:0/3385263029 conn(0x55b99b4386b0 msgr2=0x55b99b5d5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 -- 172.21.15.35:0/3385263029 shutdown_connections 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 -- 172.21.15.35:0/3385263029 wait complete. 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 -- start start 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.509+0000 7f41b1a61b80 1 Processor -- start 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 0x55b99b5e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5e4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b3b18c0 con 0x55b99b5e0be0 2023-03-17T11:03:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b5e5550 con 0x55b99b5e14f0 2023-03-17T11:03:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b5f0fe0 con 0x55b99b5db960 2023-03-17T11:03:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f41b1a61b80 10 client.0 _ll_register_callbacks cb 0x55b99b3d3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:03:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 0x55b99b5e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 0x55b99b5e74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44958/0 (socket says 172.21.15.35:44958) 2023-03-17T11:03:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 -- 172.21.15.35:0/2176351171 learned_addr learned my addr 172.21.15.35:0/2176351171 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419f7fe700 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 -- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 msgr2=0x55b99b5e4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5e4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 -- 172.21.15.35:0/2176351171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 msgr2=0x55b99b5e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5e4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 -- 172.21.15.35:0/2176351171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4194017070 con 0x55b99b5db960 2023-03-17T11:03:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f419effd700 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 0x55b99b5e74c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41900c96f0 tx=0x7f4190099360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=912f1da093ca125c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.510+0000 7f417effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:03:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f417effd700 1 -- 172.21.15.35:0/2176351171 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190099900 con 0x55b99b5db960 2023-03-17T11:03:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f417effd700 1 -- 172.21.15.35:0/2176351171 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(301..301 src has 1..301) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f419009f0d0 con 0x55b99b5db960 2023-03-17T11:03:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b99b4f0390 con 0x55b99b5db960 2023-03-17T11:03:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f417effd700 1 -- 172.21.15.35:0/2176351171 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4190098990 con 0x55b99b5db960 2023-03-17T11:03:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 10 client.29050 fetch_fsmap learned FSMap version 77 2023-03-17T11:03:35.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) v3 -- 0x55b99b35bd80 con 0x55b99b5db960 2023-03-17T11:03:35.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f417effd700 1 -- 172.21.15.35:0/2176351171 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b99b4f0390 con 0x55b99b5db960 2023-03-17T11:03:35.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f417effd700 1 -- 172.21.15.35:0/2176351171 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 77) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4190095290 con 0x55b99b5db960 2023-03-17T11:03:35.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 10 client.29050 fetch_fsmap finished waiting for FSMap version 77 2023-03-17T11:03:35.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 10 client.29050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:03:35.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 20 client.29050 populate_metadata read hostname 'smithi035' 2023-03-17T11:03:35.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b5f4d90 0x55b99b5f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 4 client.29050 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:03:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.511+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b99b4fc600 con 0x55b99b5f4d90 2023-03-17T11:03:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.512+0000 7f419e7fc700 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b5f4d90 0x55b99b5f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.512+0000 7f417effd700 10 client.29050 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.512+0000 7f419e7fc700 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b5f4d90 0x55b99b5f71a0 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2aec59a95a6f93a server_cookie=fee51a356aa6cb8f in_seq=0 out_seq=0 2023-03-17T11:03:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f417effd700 1 -- 172.21.15.35:0/2176351171 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b99b4fc600 con 0x55b99b5f4d90 2023-03-17T11:03:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f417effd700 10 client.29050 handle_command_reply: tid=0 2023-03-17T11:03:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 client.29050 shutdown 2023-03-17T11:03:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 msgr2=0x55b99b5e74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 0x55b99b5e74c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41900c96f0 tx=0x7f4190099360 comp rx=0 tx=0).stop 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 shutdown_connections 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b5f4d90 0x55b99b5f71a0 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5e14f0 0x55b99b5e4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5db960 0x55b99b5e74c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2176351171 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 >> 172.21.15.35:0/2176351171 conn(0x55b99b4386b0 msgr2=0x55b99b5da410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f417effd700 0 client.29050 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 shutdown_connections 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2176351171 wait complete. 2023-03-17T11:03:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.513+0000 7f41b1a61b80 20 client.29050 trim_cache size 0 max 16384 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.534+0000 7f41b1a61b80 1 Processor -- start 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 -- start start 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e14f0 0x55b99b5de6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b5e5710 con 0x55b99b5e14f0 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b5d10f0 con 0x55b99b5db960 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b5d25c0 con 0x55b99b5e0be0 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e14f0 0x55b99b5de6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44968/0 (socket says 172.21.15.35:44968) 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e14f0 0x55b99b5de6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53204/0 (socket says 172.21.15.35:53204) 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5ebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419e7fc700 1 -- 172.21.15.35:0/2661507317 learned_addr learned my addr 172.21.15.35:0/2661507317 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419effd700 1 -- 172.21.15.35:0/2661507317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 msgr2=0x55b99b5e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419effd700 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419effd700 1 -- 172.21.15.35:0/2661507317 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e14f0 msgr2=0x55b99b5de6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.535+0000 7f419effd700 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e14f0 0x55b99b5de6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.536+0000 7f419effd700 1 -- 172.21.15.35:0/2661507317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b99b5dc000 con 0x55b99b5db960 2023-03-17T11:03:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.536+0000 7f419e7fc700 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.536+0000 7f419effd700 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5ebfb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41900c9150 tx=0x7f4190009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730d9e3fb9ec3cc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:38.392 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:00 smithi035 ceph-mon[92535]: pgmap v4175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.536+0000 7f41867fc700 1 -- 172.21.15.35:0/2661507317 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419009f0d0 con 0x55b99b5db960 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.536+0000 7f41867fc700 1 -- 172.21.15.35:0/2661507317 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41900b7290 con 0x55b99b5db960 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.536+0000 7f41867fc700 1 -- 172.21.15.35:0/2661507317 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900953f0 con 0x55b99b5db960 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2661507317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 msgr2=0x55b99b5ebfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5ebfb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f41900c9150 tx=0x7f4190009ca0 comp rx=0 tx=0).stop 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2661507317 shutdown_connections 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e14f0 0x55b99b5de6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5ebfb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2661507317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e0be0 0x55b99b5e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2661507317 >> 172.21.15.35:0/2661507317 conn(0x55b99b4386b0 msgr2=0x55b99b5f1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2661507317 shutdown_connections 2023-03-17T11:03:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2661507317 wait complete. 2023-03-17T11:03:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.537+0000 7f41b1a61b80 1 -- start start 2023-03-17T11:03:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 Processor -- start 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 0x55b99b5eaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b647d40 con 0x55b99b5e0be0 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b647eb0 con 0x55b99b5db960 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b99b648070 con 0x55b99b5e14f0 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f41b1a61b80 10 client.0 _ll_register_callbacks cb 0x55b99b3d3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:03:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 0x55b99b5eaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 0x55b99b5eaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44976/0 (socket says 172.21.15.35:44976) 2023-03-17T11:03:44.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419effd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5e9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55002/0 (socket says 172.21.15.35:55002) 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 -- 172.21.15.35:0/2689919779 learned_addr learned my addr 172.21.15.35:0/2689919779 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 -- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 msgr2=0x55b99b5e9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5e9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 -- 172.21.15.35:0/2689919779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 msgr2=0x55b99b5ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.538+0000 7f419f7fe700 1 -- 172.21.15.35:0/2689919779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b99b3af5d0 con 0x55b99b5e14f0 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f419f7fe700 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 0x55b99b5eaa10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4198007c60 tx=0x7f4198007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a99247785ede0d76 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f417effd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f417effd700 1 -- 172.21.15.35:0/2689919779 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419801c070 con 0x55b99b5e14f0 2023-03-17T11:03:44.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f417effd700 1 -- 172.21.15.35:0/2689919779 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(301..301 src has 1..301) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f4198011ca0 con 0x55b99b5e14f0 2023-03-17T11:03:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b99b5ab1e0 con 0x55b99b5e14f0 2023-03-17T11:03:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f417effd700 1 -- 172.21.15.35:0/2689919779 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f419800e040 con 0x55b99b5e14f0 2023-03-17T11:03:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f41b1a61b80 10 client.29056 fetch_fsmap learned FSMap version 77 2023-03-17T11:03:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) v3 -- 0x55b99b35bd80 con 0x55b99b5e14f0 2023-03-17T11:03:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f417effd700 1 -- 172.21.15.35:0/2689919779 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f419802e020 con 0x55b99b5e14f0 2023-03-17T11:03:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.539+0000 7f417effd700 1 -- 172.21.15.35:0/2689919779 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 77) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4198016400 con 0x55b99b5e14f0 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f41b1a61b80 10 client.29056 fetch_fsmap finished waiting for FSMap version 77 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f41b1a61b80 10 client.29056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f41b1a61b80 20 client.29056 populate_metadata read hostname 'smithi035' 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b6497a0 0x55b99b64bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f41b1a61b80 4 client.29056 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b99b3b1f00 con 0x55b99b6497a0 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f419effd700 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b6497a0 0x55b99b64bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f417effd700 10 client.29056 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.540+0000 7f419effd700 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b6497a0 0x55b99b64bbb0 crc :-1 s=READY pgs=573 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902868d85957777f server_cookie=9e99776b607af5cd in_seq=0 out_seq=0 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.625+0000 7f417effd700 1 -- 172.21.15.35:0/2689919779 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b99b3b1f00 con 0x55b99b6497a0 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.625+0000 7f417effd700 10 client.29056 handle_command_reply: tid=0 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.625+0000 7f41b1a61b80 1 client.29056 shutdown 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.625+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 msgr2=0x55b99b5eaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.625+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 0x55b99b5eaa10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4198007c60 tx=0x7f4198007f70 comp rx=0 tx=0).stop 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 shutdown_connections 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b99b6497a0 0x55b99b64bbb0 crc :-1 s=READY pgs=573 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b99b5e14f0 0x55b99b5eaa10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b99b5db960 0x55b99b5e9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 --2- 172.21.15.35:0/2689919779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b99b5e0be0 0x55b99b5ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 >> 172.21.15.35:0/2689919779 conn(0x55b99b4386b0 msgr2=0x55b99b5de6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f417effd700 0 client.29056 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 shutdown_connections 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 1 -- 172.21.15.35:0/2689919779 wait complete. 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.626+0000 7f41b1a61b80 20 client.29056 trim_cache size 0 max 16384 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.627+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f418809f6c0 msgr2=0x7f41880a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.627+0000 7f41a58d4700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f418809f6c0 0x7f41880a1b70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f41a0074570 tx=0x7f4194009260 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.627+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 msgr2=0x7f41a0072d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.627+0000 7f41a58d4700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 0x7f41a0072d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4190000c00 tx=0x7f419000bfd0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 shutdown_connections 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f418809f6c0 0x7f41880a1b70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f41a01054f0 0x7f41a01a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a0100be0 0x7f41a0072d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 --2- 172.21.15.35:0/1494517915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41a0101580 0x7f41a00732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 >> 172.21.15.35:0/1494517915 conn(0x7f41a00774e0 msgr2=0x7f41a00fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 shutdown_connections 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:36:50.629+0000 7f41a58d4700 1 -- 172.21.15.35:0/1494517915 wait complete. 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 -- 172.21.15.35:0/1299129234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 msgr2=0x7fbfcc10cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 --2- 172.21.15.35:0/1299129234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc10cc20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009990 tx=0x7fbfc8009ca0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 -- 172.21.15.35:0/1299129234 shutdown_connections 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 --2- 172.21.15.35:0/1299129234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfcc107020 0x7fbfcc113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 --2- 172.21.15.35:0/1299129234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc10cc20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 --2- 172.21.15.35:0/1299129234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfcc10d160 0x7fbfcc1068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 -- 172.21.15.35:0/1299129234 >> 172.21.15.35:0/1299129234 conn(0x7fbfcc074800 msgr2=0x7fbfcc076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 -- 172.21.15.35:0/1299129234 shutdown_connections 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.831+0000 7fbfd4495700 1 -- 172.21.15.35:0/1299129234 wait complete. 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 Processor -- start 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 -- start start 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfcc107020 0x7fbfcc06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc06c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfcc10d160 0x7fbfcc070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06c9e0 con 0x7fbfcc107020 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc070c50 con 0x7fbfcc10c850 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.832+0000 7fbfd4495700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc070dc0 con 0x7fbfcc10d160 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc06c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc06c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55016/0 (socket says 172.21.15.35:55016) 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 -- 172.21.15.35:0/3498484555 learned_addr learned my addr 172.21.15.35:0/3498484555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfcc10d160 0x7fbfcc070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:46.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 -- 172.21.15.35:0/3498484555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfcc10d160 msgr2=0x7fbfcc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:46.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfcc10d160 0x7fbfcc070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:46.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 -- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfcc107020 msgr2=0x7fbfcc06bb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-17T11:03:46.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfcc107020 0x7fbfcc06bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 -- 172.21.15.35:0/3498484555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009c40 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.833+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc06c0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e970 tx=0x7fbfbc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.834+0000 7fbfc37fe700 1 -- 172.21.15.35:0/3498484555 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00cbd0 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.834+0000 7fbfc37fe700 1 -- 172.21.15.35:0/3498484555 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfbc00cd30 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.834+0000 7fbfc37fe700 1 -- 172.21.15.35:0/3498484555 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0055e0 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.834+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc80095f0 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.834+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc06a980 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.839+0000 7fbfc37fe700 1 -- 172.21.15.35:0/3498484555 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbfbc004750 con 0x7fbfcc10c850 2023-03-17T11:03:46.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 Processor -- start 2023-03-17T11:03:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 -- start start 2023-03-17T11:03:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b135fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b130d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfc37fe700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb809f790 0x7fbfb80a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b037010 con 0x556a2b1364f0 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b089950 con 0x556a2b130960 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.840+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b082de0 con 0x556a2b135be0 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b135fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b135fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:44990/0 (socket says 172.21.15.35:44990) 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 -- 172.21.15.35:0/552448882 learned_addr learned my addr 172.21.15.35:0/552448882 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd1a30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b130d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2231700 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb809f790 0x7fbfb80a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfc37fe700 1 -- 172.21.15.35:0/3498484555 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(302..302 src has 1..302) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fbfbc014070 con 0x7fbfcc10c850 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 -- 172.21.15.35:0/552448882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 msgr2=0x556a2b130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b130d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 -- 172.21.15.35:0/552448882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 msgr2=0x556a2b130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b130420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 -- 172.21.15.35:0/552448882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2af045d0 con 0x556a2b135be0 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b130d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b135fb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40184b0 tx=0x7fbfc40187c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c161f0150440f94 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb809f790 0x7fbfb80a1c40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4018b10 tx=0x7fbfc400e000 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfc0dae700 1 -- 172.21.15.35:0/552448882 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400e070 con 0x556a2b135be0 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfc0dae700 1 -- 172.21.15.35:0/552448882 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfc4018e40 con 0x556a2b135be0 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.841+0000 7fbfc0dae700 1 -- 172.21.15.35:0/552448882 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4007500 con 0x556a2b135be0 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 -- 172.21.15.35:0/552448882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 msgr2=0x556a2b135fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b135fb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40184b0 tx=0x7fbfc40187c0 comp rx=0 tx=0).stop 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 -- 172.21.15.35:0/552448882 shutdown_connections 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b130d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b135fb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/552448882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.842+0000 7fbfe0622b80 1 -- 172.21.15.35:0/552448882 >> 172.21.15.35:0/552448882 conn(0x556a2af8d6b0 msgr2=0x556a2b12aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 -- 172.21.15.35:0/552448882 shutdown_connections 2023-03-17T11:03:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 -- 172.21.15.35:0/552448882 wait complete. 2023-03-17T11:03:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 -- start start 2023-03-17T11:03:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 Processor -- start 2023-03-17T11:03:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 0x556a2b13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 0x556a2b139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2af068c0 con 0x556a2b130960 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b13a390 con 0x556a2b135be0 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.843+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b146000 con 0x556a2b1364f0 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfe0622b80 10 client.0 _ll_register_callbacks cb 0x556a2af28230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 0x556a2b13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2a32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 0x556a2b139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 0x556a2b13c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53232/0 (socket says 172.21.15.35:53232) 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2a32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 0x556a2b139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:45000/0 (socket says 172.21.15.35:45000) 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 -- 172.21.15.35:0/2080235742 learned_addr learned my addr 172.21.15.35:0/2080235742 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:51.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:02 smithi035 ceph-mon[92535]: pgmap v4176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:03:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 -- 172.21.15.35:0/2080235742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 msgr2=0x556a2b139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 0x556a2b139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 -- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 msgr2=0x556a2b139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 -- 172.21.15.35:0/2080235742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4011d10 con 0x556a2b130960 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 0x556a2b139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfd2231700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 0x556a2b13c3e0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009990 tx=0x7fbfc8005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f6f993631d089c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.844+0000 7fbfb5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/2080235742 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc801d070 con 0x556a2b130960 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/2080235742 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(302..302 src has 1..302) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fbfc8004500 con 0x556a2b130960 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a2b045390 con 0x556a2b130960 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/2080235742 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc80046c0 con 0x556a2b130960 2023-03-17T11:03:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 10 client.19917 fetch_fsmap learned FSMap version 77 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) v3 -- 0x556a2aeb0d80 con 0x556a2b130960 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/2080235742 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556a2b045390 con 0x556a2b130960 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/2080235742 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 77) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbfc800f560 con 0x556a2b130960 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 10 client.19917 fetch_fsmap finished waiting for FSMap version 77 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 10 client.19917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 20 client.19917 populate_metadata read hostname 'smithi035' 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b14a0b0 0x556a2b14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 4 client.19917 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:03:53.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.845+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a2b051600 con 0x556a2b14a0b0 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.846+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b14a0b0 0x556a2b14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.846+0000 7fbfb5ffb700 10 client.19917 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.846+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b14a0b0 0x556a2b14c4c0 crc :-1 s=READY pgs=574 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=207b69370a843384 server_cookie=c48480389bed53e6 in_seq=0 out_seq=0 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.846+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/2080235742 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556a2b051600 con 0x556a2b14a0b0 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.846+0000 7fbfb5ffb700 10 client.19917 handle_command_reply: tid=0 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 client.19917 shutdown 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 msgr2=0x556a2b13c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 0x556a2b13c3e0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009990 tx=0x7fbfc8005750 comp rx=0 tx=0).stop 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 shutdown_connections 2023-03-17T11:03:53.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b14a0b0 0x556a2b14c4c0 crc :-1 s=READY pgs=574 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b1364f0 0x556a2b139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b130960 0x556a2b13c3e0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfb5ffb700 0 client.19917 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2080235742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 >> 172.21.15.35:0/2080235742 conn(0x556a2af8d6b0 msgr2=0x556a2b12f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 shutdown_connections 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2080235742 wait complete. 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.847+0000 7fbfe0622b80 20 client.19917 trim_cache size 0 max 16384 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 Processor -- start 2023-03-17T11:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 -- start start 2023-03-17T11:03:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b12aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b13bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b12f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b126130 con 0x556a2b1364f0 2023-03-17T11:03:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b12c550 con 0x556a2b130960 2023-03-17T11:03:55.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b1341b0 con 0x556a2b135be0 2023-03-17T11:03:57.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfd2a32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b12f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfd2231700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b12aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfd2231700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b12aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55036/0 (socket says 172.21.15.35:55036) 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfd2231700 1 -- 172.21.15.35:0/2690077244 learned_addr learned my addr 172.21.15.35:0/2690077244 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.882+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b13bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2231700 1 -- 172.21.15.35:0/2690077244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 msgr2=0x556a2b13bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2231700 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b13bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2231700 1 -- 172.21.15.35:0/2690077244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 msgr2=0x556a2b12f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2231700 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b12f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2231700 1 -- 172.21.15.35:0/2690077244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2b049130 con 0x556a2b130960 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2a32700 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b12f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b13bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfd2231700 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b12aac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005c20 tx=0x7fbfc8005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bdd9474d13d3fb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfc15af700 1 -- 172.21.15.35:0/2690077244 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc801d040 con 0x556a2b130960 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfc15af700 1 -- 172.21.15.35:0/2690077244 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbfc801e040 con 0x556a2b130960 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.883+0000 7fbfc15af700 1 -- 172.21.15.35:0/2690077244 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800f460 con 0x556a2b130960 2023-03-17T11:03:59.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2690077244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 msgr2=0x556a2b12aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b12aac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005c20 tx=0x7fbfc8005c50 comp rx=0 tx=0).stop 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2690077244 shutdown_connections 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b12f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b130960 0x556a2b12aac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/2690077244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b135be0 0x556a2b13bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2690077244 >> 172.21.15.35:0/2690077244 conn(0x556a2af8d6b0 msgr2=0x556a2b1336b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2690077244 shutdown_connections 2023-03-17T11:03:59.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 -- 172.21.15.35:0/2690077244 wait complete. 2023-03-17T11:03:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.884+0000 7fbfe0622b80 1 -- start start 2023-03-17T11:03:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 Processor -- start 2023-03-17T11:03:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 0x556a2b13ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:03:59.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:01.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b19d490 con 0x556a2b1364f0 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b19d5d0 con 0x556a2b135be0 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2b19d710 con 0x556a2b130960 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfe0622b80 10 client.0 _ll_register_callbacks cb 0x556a2af28230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 0x556a2b13ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2a32700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 0x556a2b13ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:45012/0 (socket says 172.21.15.35:45012) 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 -- 172.21.15.35:0/3419785815 learned_addr learned my addr 172.21.15.35:0/3419785815 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd1a30700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 -- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 msgr2=0x556a2b13f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b13f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 -- 172.21.15.35:0/3419785815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 msgr2=0x556a2b19cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b19cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.885+0000 7fbfd2231700 1 -- 172.21.15.35:0/3419785815 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc80095f0 con 0x556a2b130960 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b13f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfd2231700 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 0x556a2b13ec90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005d90 tx=0x7fbfc8005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49d0ba3f25cff73 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfb5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:04:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/3419785815 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc801d070 con 0x556a2b130960 2023-03-17T11:04:02.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/3419785815 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(302..302 src has 1..302) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fbfc8000e40 con 0x556a2b130960 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a2b1001e0 con 0x556a2b130960 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/3419785815 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc800b380 con 0x556a2b130960 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfe0622b80 10 client.29071 fetch_fsmap learned FSMap version 77 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) v3 -- 0x556a2af045d0 con 0x556a2b130960 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.886+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/3419785815 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556a2b1001e0 con 0x556a2b130960 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/3419785815 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 77) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbfc8045070 con 0x556a2b130960 2023-03-17T11:04:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfe0622b80 10 client.29071 fetch_fsmap finished waiting for FSMap version 77 2023-03-17T11:04:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfe0622b80 10 client.29071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:04:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfe0622b80 20 client.29071 populate_metadata read hostname 'smithi035' 2023-03-17T11:04:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b19e9d0 0x556a2b1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfe0622b80 4 client.29071 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556a2af06f00 con 0x556a2b19e9d0 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b19e9d0 0x556a2b1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfb5ffb700 10 client.29071 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:03.887+0000 7fbfd1a30700 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b19e9d0 0x556a2b1a0db0 crc :-1 s=READY pgs=575 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ed6729e46a5f741 server_cookie=eaede5182503440d in_seq=0 out_seq=0 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.036+0000 7fbfb5ffb700 1 -- 172.21.15.35:0/3419785815 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556a2af06f00 con 0x556a2b19e9d0 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.036+0000 7fbfb5ffb700 10 client.29071 handle_command_reply: tid=0 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.036+0000 7fbfe0622b80 1 client.29071 shutdown 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.036+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 msgr2=0x556a2b13ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.036+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 0x556a2b13ec90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005d90 tx=0x7fbfc8005a00 comp rx=0 tx=0).stop 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 shutdown_connections 2023-03-17T11:04:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556a2b19e9d0 0x556a2b1a0db0 crc :-1 s=READY pgs=575 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfb5ffb700 0 client.29071 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556a2b1364f0 0x556a2b19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2b130960 0x556a2b13ec90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 --2- 172.21.15.35:0/3419785815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556a2b135be0 0x556a2b13f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 >> 172.21.15.35:0/3419785815 conn(0x556a2af8d6b0 msgr2=0x556a2b12f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 shutdown_connections 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 1 -- 172.21.15.35:0/3419785815 wait complete. 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfe0622b80 20 client.29071 trim_cache size 0 max 16384 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb809f790 msgr2=0x7fbfb80a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfd4495700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb809f790 0x7fbfb80a1c40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4018b10 tx=0x7fbfc400e000 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 msgr2=0x7fbfcc06c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.037+0000 7fbfd4495700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc06c0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00e970 tx=0x7fbfbc00ed30 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 shutdown_connections 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbfb809f790 0x7fbfb80a1c40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfcc10d160 0x7fbfcc070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbfcc107020 0x7fbfcc06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 --2- 172.21.15.35:0/3498484555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfcc10c850 0x7fbfcc06c0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 >> 172.21.15.35:0/3498484555 conn(0x7fbfcc074800 msgr2=0x7fbfcc10a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 shutdown_connections 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:04.038+0000 7fbfd4495700 1 -- 172.21.15.35:0/3498484555 wait complete. 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 -- 172.21.15.35:0/2100365771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c0ffd60 msgr2=0x7f2b9c103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 --2- 172.21.15.35:0/2100365771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c103d20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b900099c0 tx=0x7f2b90009cd0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 -- 172.21.15.35:0/2100365771 shutdown_connections 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 --2- 172.21.15.35:0/2100365771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c104400 0x7f2b9c10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 --2- 172.21.15.35:0/2100365771 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 0x7f2b9c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 --2- 172.21.15.35:0/2100365771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c103d20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.199+0000 7f2ba1963700 1 -- 172.21.15.35:0/2100365771 >> 172.21.15.35:0/2100365771 conn(0x7f2b9c076300 msgr2=0x7f2b9c076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.200+0000 7f2ba1963700 1 -- 172.21.15.35:0/2100365771 shutdown_connections 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.200+0000 7f2ba1963700 1 -- 172.21.15.35:0/2100365771 wait complete. 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.200+0000 7f2ba1963700 1 Processor -- start 2023-03-17T11:04:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 -- start start 2023-03-17T11:04:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 0x7f2b9c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c104400 0x7f2b9c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c19d440 con 0x7f2b9c0ff3c0 2023-03-17T11:04:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c19d5b0 con 0x7f2b9c0ffd60 2023-03-17T11:04:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2ba1963700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c19d770 con 0x7f2b9c104400 2023-03-17T11:04:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 0x7f2b9c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:07.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55058/0 (socket says 172.21.15.35:55058) 2023-03-17T11:04:07.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/3243368697 learned_addr learned my addr 172.21.15.35:0/3243368697 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:07.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2b9b7fe700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c104400 0x7f2b9c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:09.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.201+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/3243368697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c104400 msgr2=0x7f2b9c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:09.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c104400 0x7f2b9c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:09.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 msgr2=0x7f2b9c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 0x7f2b9c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/3243368697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c009520 con 0x7f2b9c0ffd60 2023-03-17T11:04:11.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:04 smithi035 ceph-mon[92535]: pgmap v4177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:04:11.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:06 smithi035 ceph-mon[92535]: pgmap v4178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:04:11.264 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:07 smithi035 ceph-mon[92535]: pgmap v4179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:04:11.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:09 smithi035 ceph-mon[92535]: osdmap e334: 12 total, 12 up, 12 in 2023-03-17T11:04:11.265 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:09 smithi035 ceph-mon[92535]: pgmap v4181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:04:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2b9affd700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 0x7f2b9c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:04:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c1989a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009fd0 tx=0x7f2b90009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:12.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2ba0961700 1 -- 172.21.15.35:0/3243368697 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9001d070 con 0x7f2b9c0ffd60 2023-03-17T11:04:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2ba0961700 1 -- 172.21.15.35:0/3243368697 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b900059a0 con 0x7f2b9c0ffd60 2023-03-17T11:04:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b900095f0 con 0x7f2b9c0ffd60 2023-03-17T11:04:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2ba0961700 1 -- 172.21.15.35:0/3243368697 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90022d10 con 0x7f2b9c0ffd60 2023-03-17T11:04:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.202+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c1101a0 con 0x7f2b9c0ffd60 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.205+0000 7f2ba0961700 1 -- 172.21.15.35:0/3243368697 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2b90022470 con 0x7f2b9c0ffd60 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.206+0000 7f2ba0961700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2b8409f640 0x7f2b840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.206+0000 7f2ba0961700 1 -- 172.21.15.35:0/3243368697 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(303..303 src has 1..303) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2b900cb690 con 0x7f2b9c0ffd60 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.206+0000 7f2b9affd700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2b8409f640 0x7f2b840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.206+0000 7f2b9affd700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2b8409f640 0x7f2b840a1af0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009fd0 tx=0x7f2b8c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 Processor -- start 2023-03-17T11:04:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 -- start start 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15e4f0 0x55d8fa158420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa05f010 con 0x55d8fa15dbe0 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa0b1950 con 0x55d8fa15e4f0 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa0aade0 con 0x55d8fa158960 2023-03-17T11:04:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa15dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53268/0 (socket says 172.21.15.35:53268) 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9affd700 1 -- 172.21.15.35:0/1903450489 learned_addr learned my addr 172.21.15.35:0/1903450489 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15e4f0 0x55d8fa158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9b7fe700 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9b7fe700 1 -- 172.21.15.35:0/1903450489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15e4f0 msgr2=0x55d8fa158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9b7fe700 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15e4f0 0x55d8fa158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9b7fe700 1 -- 172.21.15.35:0/1903450489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 msgr2=0x55d8fa15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9b7fe700 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa15dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.207+0000 7f2b9b7fe700 1 -- 172.21.15.35:0/1903450489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f9f2c5d0 con 0x55d8fa158960 2023-03-17T11:04:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.208+0000 7f2b9b7fe700 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa158d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b94011580 tx=0x7f2b94009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d414c4e3eed4e63 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.208+0000 7f2b81ffb700 1 -- 172.21.15.35:0/1903450489 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400e040 con 0x55d8fa158960 2023-03-17T11:04:22.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.208+0000 7f2b81ffb700 1 -- 172.21.15.35:0/1903450489 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b9400f040 con 0x55d8fa158960 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.208+0000 7f2b81ffb700 1 -- 172.21.15.35:0/1903450489 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94004290 con 0x55d8fa158960 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1903450489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 msgr2=0x55d8fa158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa158d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b94011580 tx=0x7f2b94009920 comp rx=0 tx=0).stop 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1903450489 shutdown_connections 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa158d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1903450489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15e4f0 0x55d8fa158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1903450489 >> 172.21.15.35:0/1903450489 conn(0x55d8f9fb56b0 msgr2=0x55d8fa152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1903450489 shutdown_connections 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.209+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1903450489 wait complete. 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.210+0000 7f2badaf0b80 1 -- start start 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.210+0000 7f2badaf0b80 1 Processor -- start 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.210+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.210+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa161680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.210+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15e4f0 0x55d8fa161c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f9f2e8c0 con 0x55d8fa15e4f0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa1623d0 con 0x55d8fa15dbe0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa176810 con 0x55d8fa158960 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2badaf0b80 10 client.0 _ll_register_callbacks cb 0x55d8f9f50230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15e4f0 0x55d8fa161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa164400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:45040/0 (socket says 172.21.15.35:45040) 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15e4f0 0x55d8fa161c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53278/0 (socket says 172.21.15.35:53278) 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 -- 172.21.15.35:0/3723524686 learned_addr learned my addr 172.21.15.35:0/3723524686 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 -- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 msgr2=0x55d8fa161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa161680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 -- 172.21.15.35:0/3723524686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15e4f0 msgr2=0x55d8fa161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15e4f0 0x55d8fa161c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 -- 172.21.15.35:0/3723524686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b94011230 con 0x55d8fa158960 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b9affd700 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa164400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00ebd0 tx=0x7f2b8c013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5932841e22372e69 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.211+0000 7f2b7affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2b7affd700 1 -- 172.21.15.35:0/3723524686 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c021040 con 0x55d8fa158960 2023-03-17T11:04:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2b7affd700 1 -- 172.21.15.35:0/3723524686 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(303..303 src has 1..303) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2b8c01cab0 con 0x55d8fa158960 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8fa06d390 con 0x55d8fa158960 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2b7affd700 1 -- 172.21.15.35:0/3723524686 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b8c01cc70 con 0x55d8fa158960 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 10 client.29083 fetch_fsmap learned FSMap version 77 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) v3 -- 0x55d8f9ed8d80 con 0x55d8fa158960 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2b7affd700 1 -- 172.21.15.35:0/3723524686 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b8c035020 con 0x55d8fa158960 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2b7affd700 1 -- 172.21.15.35:0/3723524686 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 77) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2b8c027430 con 0x55d8fa158960 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 10 client.29083 fetch_fsmap finished waiting for FSMap version 77 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 10 client.29083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 20 client.29083 populate_metadata read hostname 'smithi035' 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa17cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 4 client.29083 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8fa079600 con 0x55d8fa17a860 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.212+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa17cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.213+0000 7f2b7affd700 10 client.29083 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.213+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa17cc70 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf4e62846914d7a server_cookie=4331113207fcd9f9 in_seq=0 out_seq=0 2023-03-17T11:04:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.213+0000 7f2b7affd700 1 -- 172.21.15.35:0/3723524686 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d8fa079600 con 0x55d8fa17a860 2023-03-17T11:04:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.213+0000 7f2b7affd700 10 client.29083 handle_command_reply: tid=0 2023-03-17T11:04:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.213+0000 7f2badaf0b80 1 client.29083 shutdown 2023-03-17T11:04:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 msgr2=0x55d8fa164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa164400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00ebd0 tx=0x7f2b8c013040 comp rx=0 tx=0).stop 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 shutdown_connections 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa17cc70 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15e4f0 0x55d8fa161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2b7affd700 0 client.29083 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa158960 0x55d8fa164400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/3723524686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 >> 172.21.15.35:0/3723524686 conn(0x55d8f9fb56b0 msgr2=0x55d8fa152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 shutdown_connections 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 1 -- 172.21.15.35:0/3723524686 wait complete. 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.214+0000 7f2badaf0b80 20 client.29083 trim_cache size 0 max 16384 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 Processor -- start 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 -- start start 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa158960 0x55d8fa152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa153000 con 0x55d8fa15dbe0 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa14f5c0 con 0x55d8fa158960 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa177f60 con 0x55d8fa15e4f0 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53284/0 (socket says 172.21.15.35:53284) 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/1620343819 learned_addr learned my addr 172.21.15.35:0/1620343819 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2b9affd700 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa158960 0x55d8fa152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.241+0000 7f2b9b7fe700 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9affd700 1 -- 172.21.15.35:0/1620343819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 msgr2=0x55d8fa15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9affd700 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9affd700 1 -- 172.21.15.35:0/1620343819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 msgr2=0x55d8fa1717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9affd700 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9affd700 1 -- 172.21.15.35:0/1620343819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8fa071130 con 0x55d8fa158960 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:04:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b9affd700 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa158960 0x55d8fa152ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c016040 tx=0x7f2b8c00e590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e45ba1d8e6597ca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b827fc700 1 -- 172.21.15.35:0/1620343819 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c021070 con 0x55d8fa158960 2023-03-17T11:04:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b827fc700 1 -- 172.21.15.35:0/1620343819 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b8c035040 con 0x55d8fa158960 2023-03-17T11:04:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.242+0000 7f2b827fc700 1 -- 172.21.15.35:0/1620343819 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c005360 con 0x55d8fa158960 2023-03-17T11:04:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1620343819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa158960 msgr2=0x55d8fa152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa158960 0x55d8fa152ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c016040 tx=0x7f2b8c00e590 comp rx=0 tx=0).stop 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1620343819 shutdown_connections 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa158960 0x55d8fa152ac0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/1620343819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1620343819 >> 172.21.15.35:0/1620343819 conn(0x55d8f9fb56b0 msgr2=0x55d8fa15c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1620343819 shutdown_connections 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 -- 172.21.15.35:0/1620343819 wait complete. 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.243+0000 7f2badaf0b80 1 -- start start 2023-03-17T11:04:32.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 Processor -- start 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 0x55d8fa1717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa15a120 con 0x55d8fa158960 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa15a290 con 0x55d8fa15dbe0 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8fa15a450 con 0x55d8fa15e4f0 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2badaf0b80 10 client.0 _ll_register_callbacks cb 0x55d8f9f50230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 0x55d8fa1717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9a7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55086/0 (socket says 172.21.15.35:55086) 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 0x55d8fa1717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53288/0 (socket says 172.21.15.35:53288) 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:45058/0 (socket says 172.21.15.35:45058) 2023-03-17T11:04:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.244+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/528440632 learned_addr learned my addr 172.21.15.35:0/528440632 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/528440632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 msgr2=0x55d8fa159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/528440632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 msgr2=0x55d8fa1717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 0x55d8fa1717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9a7fc700 1 -- 172.21.15.35:0/528440632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c1101a0 con 0x55d8fa15dbe0 2023-03-17T11:04:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9affd700 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 0x55d8fa1717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:04:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b9a7fc700 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1596a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b90095c40 tx=0x7f2b90098e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc2b766de24719b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b7affd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:04:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b7affd700 1 -- 172.21.15.35:0/528440632 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900c8b70 con 0x55d8fa15dbe0 2023-03-17T11:04:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b7affd700 1 -- 172.21.15.35:0/528440632 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(303..303 src has 1..303) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2b90097630 con 0x55d8fa15dbe0 2023-03-17T11:04:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8fa1281e0 con 0x55d8fa15dbe0 2023-03-17T11:04:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b7affd700 1 -- 172.21.15.35:0/528440632 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b90099430 con 0x55d8fa15dbe0 2023-03-17T11:04:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2badaf0b80 10 client.29111 fetch_fsmap learned FSMap version 77 2023-03-17T11:04:34.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:12 smithi035 ceph-mon[92535]: pgmap v4182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) v3 -- 0x55d8f9ed8d80 con 0x55d8fa15dbe0 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.245+0000 7f2b7affd700 1 -- 172.21.15.35:0/528440632 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b90063020 con 0x55d8fa15dbe0 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2b7affd700 1 -- 172.21.15.35:0/528440632 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 77) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2b900a0fc0 con 0x55d8fa15dbe0 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2badaf0b80 10 client.29111 fetch_fsmap finished waiting for FSMap version 77 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2badaf0b80 10 client.29111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2badaf0b80 20 client.29111 populate_metadata read hostname 'smithi035' 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa1d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:35.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2badaf0b80 4 client.29111 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8f9f2ef00 con 0x55d8fa17a860 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2b9affd700 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa1d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2b7affd700 10 client.29111 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.246+0000 7f2b9affd700 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa1d1830 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d01be0186f0818 server_cookie=2b17bcdc9a821cbd in_seq=0 out_seq=0 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2b7affd700 1 -- 172.21.15.35:0/528440632 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8f9f2ef00 con 0x55d8fa17a860 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2b7affd700 10 client.29111 handle_command_reply: tid=0 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 client.29111 shutdown 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 msgr2=0x55d8fa1596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1596a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2b90095c40 tx=0x7f2b90098e30 comp rx=0 tx=0).stop 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 shutdown_connections 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d8fa17a860 0x55d8fa1d1830 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8fa15e4f0 0x55d8fa159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d8fa158960 0x55d8fa1717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2b7affd700 0 client.29111 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 --2- 172.21.15.35:0/528440632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8fa15dbe0 0x55d8fa1596a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:35.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.324+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 >> 172.21.15.35:0/528440632 conn(0x55d8f9fb56b0 msgr2=0x55d8fa15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 shutdown_connections 2023-03-17T11:04:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2badaf0b80 1 -- 172.21.15.35:0/528440632 wait complete. 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2badaf0b80 20 client.29111 trim_cache size 0 max 16384 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2b8409f640 msgr2=0x7f2b840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2ba1963700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2b8409f640 0x7f2b840a1af0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009fd0 tx=0x7f2b8c009260 comp rx=0 tx=0).stop 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 msgr2=0x7f2b9c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.325+0000 7f2ba1963700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c1989a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009fd0 tx=0x7f2b90009580 comp rx=0 tx=0).stop 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 shutdown_connections 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2b8409f640 0x7f2b840a1af0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9c104400 0x7f2b9c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2b9c0ff3c0 0x7f2b9c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 --2- 172.21.15.35:0/3243368697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b9c0ffd60 0x7f2b9c1989a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 >> 172.21.15.35:0/3243368697 conn(0x7f2b9c076300 msgr2=0x7f2b9c0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 shutdown_connections 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:37:17.326+0000 7f2ba1963700 1 -- 172.21.15.35:0/3243368697 wait complete. 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 -- 172.21.15.35:0/409554383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b8104390 msgr2=0x7fd9b810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 --2- 172.21.15.35:0/409554383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b8104390 0x7fd9b810bf60 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b0d0 tx=0x7fd9b000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 -- 172.21.15.35:0/409554383 shutdown_connections 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 --2- 172.21.15.35:0/409554383 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b8104390 0x7fd9b810bf60 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 --2- 172.21.15.35:0/409554383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b80ff350 0x7fd9b80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 --2- 172.21.15.35:0/409554383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b80ffcf0 0x7fd9b8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 -- 172.21.15.35:0/409554383 >> 172.21.15.35:0/409554383 conn(0x7fd9b8076330 msgr2=0x7fd9b8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 -- 172.21.15.35:0/409554383 shutdown_connections 2023-03-17T11:04:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.008+0000 7fd9c027a700 1 -- 172.21.15.35:0/409554383 wait complete. 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 Processor -- start 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 -- start start 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 0x7fd9b81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b80ffcf0 0x7fd9b8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b8104390 0x7fd9b819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819d5d0 con 0x7fd9b80ff350 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819d740 con 0x7fd9b8104390 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9c027a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819d900 con 0x7fd9b80ffcf0 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 0x7fd9b81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 0x7fd9b81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53304/0 (socket says 172.21.15.35:53304) 2023-03-17T11:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 -- 172.21.15.35:0/1593892777 learned_addr learned my addr 172.21.15.35:0/1593892777 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:42.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9bd815700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b80ffcf0 0x7fd9b8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be817700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b8104390 0x7fd9b819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 -- 172.21.15.35:0/1593892777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b80ffcf0 msgr2=0x7fd9b8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b80ffcf0 0x7fd9b8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 -- 172.21.15.35:0/1593892777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b8104390 msgr2=0x7fd9b819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b8104390 0x7fd9b819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:42.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.009+0000 7fd9be016700 1 -- 172.21.15.35:0/1593892777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009d00 con 0x7fd9b80ff350 2023-03-17T11:04:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9be817700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b8104390 0x7fd9b819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9be016700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 0x7fd9b81985f0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e9a0 tx=0x7fd9b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9af7fe700 1 -- 172.21.15.35:0/1593892777 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4009790 con 0x7fd9b80ff350 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9af7fe700 1 -- 172.21.15.35:0/1593892777 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9b400cbd0 con 0x7fd9b80ff350 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b810efc0 con 0x7fd9b80ff350 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9af7fe700 1 -- 172.21.15.35:0/1593892777 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4018680 con 0x7fd9b80ff350 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.010+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b810ee30 con 0x7fd9b80ff350 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.012+0000 7fd9af7fe700 1 -- 172.21.15.35:0/1593892777 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd9b400cd40 con 0x7fd9b80ff350 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.013+0000 7fd9af7fe700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd9a409f6c0 0x7fd9a40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.013+0000 7fd9bd815700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd9a409f6c0 0x7fd9a40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:43.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.013+0000 7fd9af7fe700 1 -- 172.21.15.35:0/1593892777 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(306..306 src has 1..306) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fd9b4014070 con 0x7fd9b80ff350 2023-03-17T11:04:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.013+0000 7fd9bd815700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd9a409f6c0 0x7fd9a40a1b70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8199c00 tx=0x7fd9a8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.013+0000 7fd9cc407b80 1 Processor -- start 2023-03-17T11:04:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 -- start start 2023-03-17T11:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c66fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c61420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c61d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72b68010 con 0x55ca72c674f0 2023-03-17T11:04:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72bba950 con 0x55ca72c61960 2023-03-17T11:04:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72bb3de0 con 0x55ca72c66be0 2023-03-17T11:04:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c61420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c61420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53314/0 (socket says 172.21.15.35:53314) 2023-03-17T11:04:44.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 -- 172.21.15.35:0/2096021595 learned_addr learned my addr 172.21.15.35:0/2096021595 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9be016700 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c66fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9be817700 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c61d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 -- 172.21.15.35:0/2096021595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 msgr2=0x55ca72c66fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c66fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 -- 172.21.15.35:0/2096021595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 msgr2=0x55ca72c61d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c61d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.014+0000 7fd9bd815700 1 -- 172.21.15.35:0/2096021595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca72a355d0 con 0x55ca72c674f0 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.015+0000 7fd9bd815700 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c61420 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097b0 tx=0x7fd9a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85da6961754a9d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:45.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.015+0000 7fd9acdae700 1 -- 172.21.15.35:0/2096021595 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8011bb0 con 0x55ca72c674f0 2023-03-17T11:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.015+0000 7fd9acdae700 1 -- 172.21.15.35:0/2096021595 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9a8015070 con 0x55ca72c674f0 2023-03-17T11:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.015+0000 7fd9acdae700 1 -- 172.21.15.35:0/2096021595 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a801c3b0 con 0x55ca72c674f0 2023-03-17T11:04:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.015+0000 7fd9cc407b80 1 -- 172.21.15.35:0/2096021595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 msgr2=0x55ca72c61420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.015+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c61420 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097b0 tx=0x7fd9a8013000 comp rx=0 tx=0).stop 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- 172.21.15.35:0/2096021595 shutdown_connections 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c61d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c66fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/2096021595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c61420 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- 172.21.15.35:0/2096021595 >> 172.21.15.35:0/2096021595 conn(0x55ca72abe6b0 msgr2=0x55ca72c5ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- 172.21.15.35:0/2096021595 shutdown_connections 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- 172.21.15.35:0/2096021595 wait complete. 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- start start 2023-03-17T11:04:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 Processor -- start 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 0x55ca72c6d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c66be0 0x55ca72c6a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c674f0 0x55ca72c6ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72a378c0 con 0x55ca72c61960 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c6b4e0 con 0x55ca72c66be0 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.016+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c77000 con 0x55ca72c674f0 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9cc407b80 10 client.0 _ll_register_callbacks cb 0x55ca72a59230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 0x55ca72c6d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 0x55ca72c6d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53318/0 (socket says 172.21.15.35:53318) 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 -- 172.21.15.35:0/228732366 learned_addr learned my addr 172.21.15.35:0/228732366 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be817700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c674f0 0x55ca72c6ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9bd815700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c66be0 0x55ca72c6a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 -- 172.21.15.35:0/228732366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c674f0 msgr2=0x55ca72c6ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c674f0 0x55ca72c6ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:46.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 -- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c66be0 msgr2=0x55ca72c6a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c66be0 0x55ca72c6a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 -- 172.21.15.35:0/228732366 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a8010aa0 con 0x55ca72c61960 2023-03-17T11:04:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9bd815700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c66be0 0x55ca72c6a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9be016700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 0x55ca72c6d450 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4094990 tx=0x7fd9b40985d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686f90a74746f8a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/228732366 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4097bd0 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/228732366 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(306..306 src has 1..306) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fd9b40a0240 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca72b76390 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/228732366 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b40a0400 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9cc407b80 10 client.19953 fetch_fsmap learned FSMap version 85 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.017+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) v3 -- 0x55ca729e1d80 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/228732366 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ca72b76390 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/228732366 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 85) v1 ==== 6961+0+0 (secure 0 0 0) 0x7fd9b40b0a60 con 0x55ca72c61960 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9cc407b80 10 client.19953 fetch_fsmap finished waiting for FSMap version 85 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9cc407b80 10 client.19953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9cc407b80 20 client.19953 populate_metadata read hostname 'smithi035' 2023-03-17T11:04:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72c7b0c0 0x55ca72c7d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9cc407b80 4 client.19953 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:04:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca72b82600 con 0x55ca72c7b0c0 2023-03-17T11:04:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.018+0000 7fd9bd815700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72c7b0c0 0x55ca72c7d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.019+0000 7fd9bd815700 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72c7b0c0 0x55ca72c7d4d0 crc :-1 s=READY pgs=578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0ee06df926f14b server_cookie=ecea0d81c094f115 in_seq=0 out_seq=0 2023-03-17T11:04:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.019+0000 7fd9a1ffb700 10 client.19953 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.019+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/228732366 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ca72b82600 con 0x55ca72c7b0c0 2023-03-17T11:04:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.019+0000 7fd9a1ffb700 10 client.19953 handle_command_reply: tid=0 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 client.19953 shutdown 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 msgr2=0x55ca72c6d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 0x55ca72c6d450 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4094990 tx=0x7fd9b40985d0 comp rx=0 tx=0).stop 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 shutdown_connections 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72c7b0c0 0x55ca72c7d4d0 crc :-1 s=READY pgs=578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c674f0 0x55ca72c6ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c61960 0x55ca72c6d450 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9a1ffb700 0 client.19953 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/228732366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c66be0 0x55ca72c6a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 >> 172.21.15.35:0/228732366 conn(0x55ca72abe6b0 msgr2=0x55ca72c60410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 shutdown_connections 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 1 -- 172.21.15.35:0/228732366 wait complete. 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.020+0000 7fd9cc407b80 20 client.19953 trim_cache size 0 max 16384 2023-03-17T11:04:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 Processor -- start 2023-03-17T11:04:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 -- start start 2023-03-17T11:04:49.375 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:14 smithi035 ceph-mon[92535]: pgmap v4183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:04:50.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:50.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c6cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:50.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:50.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c60ad0 con 0x55ca72c674f0 2023-03-17T11:04:50.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c617f0 con 0x55ca72c61960 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c5c720 con 0x55ca72c66be0 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9be817700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9be817700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53330/0 (socket says 172.21.15.35:53330) 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9be817700 1 -- 172.21.15.35:0/1136851555 learned_addr learned my addr 172.21.15.35:0/1136851555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.035+0000 7fd9be016700 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9bd815700 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c6cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9be817700 1 -- 172.21.15.35:0/1136851555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 msgr2=0x55ca72c6cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9be817700 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c6cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9be817700 1 -- 172.21.15.35:0/1136851555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 msgr2=0x55ca72c71f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:50.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9be817700 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9be817700 1 -- 172.21.15.35:0/1136851555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca72b7a130 con 0x55ca72c674f0 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9be817700 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c646b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009c50 tx=0x7fd9b0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a682c85b0e57334b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9ad5af700 1 -- 172.21.15.35:0/1136851555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000e040 con 0x55ca72c674f0 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9ad5af700 1 -- 172.21.15.35:0/1136851555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9b0021070 con 0x55ca72c674f0 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.036+0000 7fd9ad5af700 1 -- 172.21.15.35:0/1136851555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0004a50 con 0x55ca72c674f0 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- 172.21.15.35:0/1136851555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 msgr2=0x55ca72c646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:51.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c646b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009c50 tx=0x7fd9b0009c80 comp rx=0 tx=0).stop 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- 172.21.15.35:0/1136851555 shutdown_connections 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c646b0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/1136851555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c6cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- 172.21.15.35:0/1136851555 >> 172.21.15.35:0/1136851555 conn(0x55ca72abe6b0 msgr2=0x55ca72c766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- 172.21.15.35:0/1136851555 shutdown_connections 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- 172.21.15.35:0/1136851555 wait complete. 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- start start 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 Processor -- start 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c71eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c6ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c70500 con 0x55ca72c674f0 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c70670 con 0x55ca72c61960 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca72c70830 con 0x55ca72c66be0 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9cc407b80 10 client.0 _ll_register_callbacks cb 0x55ca72a59230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:04:51.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9be817700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c6ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:51.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9be016700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:51.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9be817700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c6ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53336/0 (socket says 172.21.15.35:53336) 2023-03-17T11:04:51.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9be016700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55128/0 (socket says 172.21.15.35:55128) 2023-03-17T11:04:51.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9be817700 1 -- 172.21.15.35:0/3609555704 learned_addr learned my addr 172.21.15.35:0/3609555704 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:51.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.037+0000 7fd9bd815700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c71eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be817700 1 -- 172.21.15.35:0/3609555704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 msgr2=0x55ca72c71eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:53.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be817700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c71eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be817700 1 -- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 msgr2=0x55ca72c71970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be817700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be817700 1 -- 172.21.15.35:0/3609555704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b810c7a0 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be016700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9be817700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c6ff30 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b770 tx=0x7fd9b0009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f6b4014f6edc24 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/3609555704 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000e030 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca72c311e0 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/3609555704 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(306..306 src has 1..306) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fd9b00076a0 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/3609555704 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b000be70 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9cc407b80 10 client.19959 fetch_fsmap learned FSMap version 85 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.038+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) v3 -- 0x55ca72a081f0 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/3609555704 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ca72c311e0 con 0x55ca72c674f0 2023-03-17T11:04:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/3609555704 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 85) v1 ==== 6961+0+0 (secure 0 0 0) 0x7fd9b002e030 con 0x55ca72c674f0 2023-03-17T11:04:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9cc407b80 10 client.19959 fetch_fsmap finished waiting for FSMap version 85 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9cc407b80 10 client.19959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9cc407b80 20 client.19959 populate_metadata read hostname 'smithi035' 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72ccff50 0x55ca72cd2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9cc407b80 4 client.19959 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ca72a37f00 con 0x55ca72ccff50 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9be016700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72ccff50 0x55ca72cd2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9be016700 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72ccff50 0x55ca72cd2360 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840adb1fb949592 server_cookie=d200ac1a8c46b70f in_seq=0 out_seq=0 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.039+0000 7fd9a1ffb700 10 client.19959 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9a1ffb700 1 -- 172.21.15.35:0/3609555704 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ca72a37f00 con 0x55ca72ccff50 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9a1ffb700 10 client.19959 handle_command_reply: tid=0 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 client.19959 shutdown 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 msgr2=0x55ca72c6ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c6ff30 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b770 tx=0x7fd9b0009570 comp rx=0 tx=0).stop 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 shutdown_connections 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ca72ccff50 0x55ca72cd2360 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ca72c674f0 0x55ca72c6ff30 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca72c61960 0x55ca72c71970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9a1ffb700 0 client.19959 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 --2- 172.21.15.35:0/3609555704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ca72c66be0 0x55ca72c71eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 >> 172.21.15.35:0/3609555704 conn(0x55ca72abe6b0 msgr2=0x55ca72c646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 shutdown_connections 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 1 -- 172.21.15.35:0/3609555704 wait complete. 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.126+0000 7fd9cc407b80 20 client.19959 trim_cache size 0 max 16384 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd9a409f6c0 msgr2=0x7fd9a40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd9a409f6c0 0x7fd9a40a1b70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8199c00 tx=0x7fd9a8009260 comp rx=0 tx=0).stop 2023-03-17T11:04:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 msgr2=0x7fd9b81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 0x7fd9b81985f0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400e9a0 tx=0x7fd9b400ed60 comp rx=0 tx=0).stop 2023-03-17T11:04:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 shutdown_connections 2023-03-17T11:04:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd9a409f6c0 0x7fd9a40a1b70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9b8104390 0x7fd9b819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd9b80ff350 0x7fd9b81985f0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 --2- 172.21.15.35:0/1593892777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9b80ffcf0 0x7fd9b8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 >> 172.21.15.35:0/1593892777 conn(0x7fd9b8076330 msgr2=0x7fd9b8067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 shutdown_connections 2023-03-17T11:04:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:13.127+0000 7fd9c027a700 1 -- 172.21.15.35:0/1593892777 wait complete. 2023-03-17T11:04:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 -- 172.21.15.35:0/3357048099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 msgr2=0x7f7cc8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/3357048099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc8104e10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80099c0 tx=0x7f7cb8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 -- 172.21.15.35:0/3357048099 shutdown_connections 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/3357048099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc81054f0 0x7f7cc810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/3357048099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc8100be0 0x7f7cc8100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/3357048099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc8104e10 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 -- 172.21.15.35:0/3357048099 >> 172.21.15.35:0/3357048099 conn(0x7f7cc80774e0 msgr2=0x7f7cc80778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:04:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 -- 172.21.15.35:0/3357048099 shutdown_connections 2023-03-17T11:04:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.253+0000 7f7ccfecd700 1 -- 172.21.15.35:0/3357048099 wait complete. 2023-03-17T11:04:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 Processor -- start 2023-03-17T11:04:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 -- start start 2023-03-17T11:04:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc8100be0 0x7f7cc8072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc80732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc81054f0 0x7f7cc81a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:04:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8073af0 con 0x7f7cc8101580 2023-03-17T11:04:59.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81a49b0 con 0x7f7cc81054f0 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccfecd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81a4af0 con 0x7f7cc8100be0 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc80732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc80732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53346/0 (socket says 172.21.15.35:53346) 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccd468700 1 -- 172.21.15.35:0/338143332 learned_addr learned my addr 172.21.15.35:0/338143332 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc8100be0 0x7f7cc8072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.254+0000 7f7cce46a700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc81054f0 0x7f7cc81a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:04:59.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccd468700 1 -- 172.21.15.35:0/338143332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc8100be0 msgr2=0x7f7cc8072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccd468700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc8100be0 0x7f7cc8072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccd468700 1 -- 172.21.15.35:0/338143332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc81054f0 msgr2=0x7f7cc81a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccd468700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc81054f0 0x7f7cc81a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccd468700 1 -- 172.21.15.35:0/338143332 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80095f0 con 0x7f7cc8101580 2023-03-17T11:05:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccd468700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc80732c0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009990 tx=0x7f7cb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7cbeffd700 1 -- 172.21.15.35:0/338143332 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb801d070 con 0x7f7cc8101580 2023-03-17T11:05:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7cbeffd700 1 -- 172.21.15.35:0/338143332 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cb8003ec0 con 0x7f7cc8101580 2023-03-17T11:05:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc81101b0 con 0x7f7cc8101580 2023-03-17T11:05:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7cbeffd700 1 -- 172.21.15.35:0/338143332 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8022c60 con 0x7f7cc8101580 2023-03-17T11:05:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.255+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc8110020 con 0x7f7cc8101580 2023-03-17T11:05:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.258+0000 7f7cbeffd700 1 -- 172.21.15.35:0/338143332 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7cb8004030 con 0x7f7cc8101580 2023-03-17T11:05:03.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.258+0000 7f7cbeffd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cb409f640 0x7f7cb40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.259+0000 7f7cbeffd700 1 -- 172.21.15.35:0/338143332 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cb80cba50 con 0x7f7cc8101580 2023-03-17T11:05:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.259+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cb409f640 0x7f7cb40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.259+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cb409f640 0x7f7cb40a1af0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005950 tx=0x7f7cc400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.259+0000 7f7cdc05ab80 1 Processor -- start 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 -- start start 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac47be0 0x558a8ac47fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 0x558a8ac42420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac42d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ab49010 con 0x558a8ac484f0 2023-03-17T11:05:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ab9b950 con 0x558a8ac42960 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ab94de0 con 0x558a8ac47be0 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 0x558a8ac42420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 0x558a8ac42420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53352/0 (socket says 172.21.15.35:53352) 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 -- 172.21.15.35:0/502126786 learned_addr learned my addr 172.21.15.35:0/502126786 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac47be0 0x558a8ac47fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7cce46a700 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac42d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 -- 172.21.15.35:0/502126786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac47be0 msgr2=0x558a8ac47fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac47be0 0x558a8ac47fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 -- 172.21.15.35:0/502126786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 msgr2=0x558a8ac42d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac42d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.260+0000 7f7ccd468700 1 -- 172.21.15.35:0/502126786 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a8aa165d0 con 0x558a8ac484f0 2023-03-17T11:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.261+0000 7f7ccd468700 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 0x558a8ac42420 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80a1160 tx=0x7f7cb8098f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8e83e1f8b1327c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.261+0000 7f7cb3fff700 1 -- 172.21.15.35:0/502126786 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb809f0d0 con 0x558a8ac484f0 2023-03-17T11:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.261+0000 7f7cb3fff700 1 -- 172.21.15.35:0/502126786 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cb8095040 con 0x558a8ac484f0 2023-03-17T11:05:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.261+0000 7f7cb3fff700 1 -- 172.21.15.35:0/502126786 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8098a20 con 0x558a8ac484f0 2023-03-17T11:05:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.261+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/502126786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 msgr2=0x558a8ac42420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:06.316 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:16 smithi035 ceph-mon[92535]: pgmap v4184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.261+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 0x558a8ac42420 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80a1160 tx=0x7f7cb8098f10 comp rx=0 tx=0).stop 2023-03-17T11:05:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/502126786 shutdown_connections 2023-03-17T11:05:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac42d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac47be0 0x558a8ac47fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/502126786 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac484f0 0x558a8ac42420 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/502126786 >> 172.21.15.35:0/502126786 conn(0x558a8aa9f6b0 msgr2=0x558a8ac3ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/502126786 shutdown_connections 2023-03-17T11:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/502126786 wait complete. 2023-03-17T11:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- start start 2023-03-17T11:05:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 Processor -- start 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac4e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac4b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8aa188c0 con 0x558a8ac47be0 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ac4c3a0 con 0x558a8ac42960 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ac57cf0 con 0x558a8ac484f0 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.262+0000 7f7cdc05ab80 10 client.0 _ll_register_callbacks cb 0x558a8aa3a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac4b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac4b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53358/0 (socket says 172.21.15.35:53358) 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 -- 172.21.15.35:0/1164659873 learned_addr learned my addr 172.21.15.35:0/1164659873 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac4e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cce46a700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 -- 172.21.15.35:0/1164659873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 msgr2=0x558a8ac4bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 -- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 msgr2=0x558a8ac4e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac4e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:11.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 -- 172.21.15.35:0/1164659873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc8110020 con 0x558a8ac47be0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac4e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac4b650 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006010 tx=0x7f7cb8098a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c789171b5476dbf7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1164659873 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8099990 con 0x558a8ac47be0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1164659873 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cb80a1200 con 0x558a8ac47be0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a8ab57390 con 0x558a8ac47be0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1164659873 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cb80a13e0 con 0x558a8ac47be0 2023-03-17T11:05:11.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cdc05ab80 10 client.19971 fetch_fsmap learned FSMap version 87 2023-03-17T11:05:14.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.263+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x558a8a9c2d80 con 0x558a8ac47be0 2023-03-17T11:05:14.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1164659873 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a8ab57390 con 0x558a8ac47be0 2023-03-17T11:05:14.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1164659873 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 87) v1 ==== 6969+0+0 (secure 0 0 0) 0x7f7cb8095320 con 0x558a8ac47be0 2023-03-17T11:05:14.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cdc05ab80 10 client.19971 fetch_fsmap finished waiting for FSMap version 87 2023-03-17T11:05:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cdc05ab80 10 client.19971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:05:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cdc05ab80 20 client.19971 populate_metadata read hostname 'smithi035' 2023-03-17T11:05:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8ac5b930 0x558a8ac5dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cdc05ab80 4 client.19971 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:05:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a8ab63600 con 0x558a8ac5b930 2023-03-17T11:05:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.264+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8ac5b930 0x558a8ac5dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.265+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8ac5b930 0x558a8ac5dd40 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9dfa1080a0f6658 server_cookie=6f696a5425e372ce in_seq=0 out_seq=0 2023-03-17T11:05:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.265+0000 7f7cb17fa700 10 client.19971 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:18.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1164659873 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558a8ab63600 con 0x558a8ac5b930 2023-03-17T11:05:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cb17fa700 10 client.19971 handle_command_reply: tid=0 2023-03-17T11:05:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 client.19971 shutdown 2023-03-17T11:05:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 msgr2=0x558a8ac4b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:18.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac4b650 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006010 tx=0x7f7cb8098a20 comp rx=0 tx=0).stop 2023-03-17T11:05:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 shutdown_connections 2023-03-17T11:05:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8ac5b930 0x558a8ac5dd40 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac4e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cb17fa700 0 client.19971 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1164659873 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac4b650 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 >> 172.21.15.35:0/1164659873 conn(0x558a8aa9f6b0 msgr2=0x558a8ac41410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 shutdown_connections 2023-03-17T11:05:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1164659873 wait complete. 2023-03-17T11:05:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.266+0000 7f7cdc05ab80 20 client.19971 trim_cache size 0 max 16384 2023-03-17T11:05:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 Processor -- start 2023-03-17T11:05:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 -- start start 2023-03-17T11:05:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac52cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:21.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ab57390 con 0x558a8ac47be0 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ac3e4f0 con 0x558a8ac42960 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8ac380d0 con 0x558a8ac484f0 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.281+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53366/0 (socket says 172.21.15.35:53366) 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 -- 172.21.15.35:0/2259495422 learned_addr learned my addr 172.21.15.35:0/2259495422 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccdc69700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac52cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7cce46a700 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 -- 172.21.15.35:0/2259495422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 msgr2=0x558a8ac4df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 -- 172.21.15.35:0/2259495422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 msgr2=0x558a8ac52cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac52cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 -- 172.21.15.35:0/2259495422 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a8ab5b130 con 0x558a8ac47be0 2023-03-17T11:05:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7cce46a700 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:05:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7ccd468700 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac490a0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8095fa0 tx=0x7f7cb80a1810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73bfd82ea14be22 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7cbcff9700 1 -- 172.21.15.35:0/2259495422 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8095320 con 0x558a8ac47be0 2023-03-17T11:05:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7cbcff9700 1 -- 172.21.15.35:0/2259495422 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cb8095040 con 0x558a8ac47be0 2023-03-17T11:05:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.282+0000 7f7cbcff9700 1 -- 172.21.15.35:0/2259495422 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80a1200 con 0x558a8ac47be0 2023-03-17T11:05:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/2259495422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 msgr2=0x558a8ac490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac490a0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8095fa0 tx=0x7f7cb80a1810 comp rx=0 tx=0).stop 2023-03-17T11:05:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/2259495422 shutdown_connections 2023-03-17T11:05:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8ac4df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac42960 0x558a8ac52cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/2259495422 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac47be0 0x558a8ac490a0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/2259495422 >> 172.21.15.35:0/2259495422 conn(0x558a8aa9f6b0 msgr2=0x558a8ac48990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/2259495422 shutdown_connections 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/2259495422 wait complete. 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- start start 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 Processor -- start 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 0x558a8ac50e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac47be0 0x558a8ac513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8acae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8acaecd0 con 0x558a8ac42960 2023-03-17T11:05:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8acaee10 con 0x558a8ac47be0 2023-03-17T11:05:24.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8acaef50 con 0x558a8ac484f0 2023-03-17T11:05:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7cdc05ab80 10 client.0 _ll_register_callbacks cb 0x558a8aa3a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:05:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.283+0000 7f7ccdc69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 0x558a8ac50e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 0x558a8ac50e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53370/0 (socket says 172.21.15.35:53370) 2023-03-17T11:05:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 -- 172.21.15.35:0/1776617354 learned_addr learned my addr 172.21.15.35:0/1776617354 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac47be0 0x558a8ac513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cce46a700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8acae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 -- 172.21.15.35:0/1776617354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 msgr2=0x558a8acae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8acae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 -- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac47be0 msgr2=0x558a8ac513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac47be0 0x558a8ac513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 -- 172.21.15.35:0/1776617354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a8a9c2d80 con 0x558a8ac42960 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cce46a700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8acae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac47be0 0x558a8ac513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7ccdc69700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 0x558a8ac50e90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x558a8ac5e610 tx=0x7f7cc40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc7b62099efa1d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1776617354 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4024040 con 0x558a8ac42960 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a8ac121e0 con 0x558a8ac42960 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1776617354 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cc4017070 con 0x558a8ac42960 2023-03-17T11:05:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1776617354 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cc4004a30 con 0x558a8ac42960 2023-03-17T11:05:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cdc05ab80 10 client.19977 fetch_fsmap learned FSMap version 87 2023-03-17T11:05:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.284+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x558a8a9e91f0 con 0x558a8ac42960 2023-03-17T11:05:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1776617354 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a8ac121e0 con 0x558a8ac42960 2023-03-17T11:05:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1776617354 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 87) v1 ==== 6969+0+0 (secure 0 0 0) 0x7f7cc4011560 con 0x558a8ac42960 2023-03-17T11:05:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cdc05ab80 10 client.19977 fetch_fsmap finished waiting for FSMap version 87 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cdc05ab80 10 client.19977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cdc05ab80 20 client.19977 populate_metadata read hostname 'smithi035' 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8acb06b0 0x558a8acb2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cdc05ab80 4 client.19977 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558a8aa18f00 con 0x558a8acb06b0 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8acb06b0 0x558a8acb2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7cb17fa700 10 client.19977 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.285+0000 7f7ccd468700 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8acb06b0 0x558a8acb2ac0 crc :-1 s=READY pgs=581 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f0b20d82b06a994 server_cookie=8bd1b03837cbf326 in_seq=0 out_seq=0 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.315+0000 7f7cb17fa700 1 -- 172.21.15.35:0/1776617354 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558a8aa18f00 con 0x558a8acb06b0 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.315+0000 7f7cb17fa700 10 client.19977 handle_command_reply: tid=0 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.315+0000 7f7cdc05ab80 1 client.19977 shutdown 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 msgr2=0x558a8ac50e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 0x558a8ac50e90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x558a8ac5e610 tx=0x7f7cc40047c0 comp rx=0 tx=0).stop 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 shutdown_connections 2023-03-17T11:05:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558a8acb06b0 0x558a8acb2ac0 crc :-1 s=READY pgs=581 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558a8ac484f0 0x558a8acae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cb17fa700 0 client.19977 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558a8ac42960 0x558a8ac50e90 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 --2- 172.21.15.35:0/1776617354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558a8ac47be0 0x558a8ac513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 >> 172.21.15.35:0/1776617354 conn(0x558a8aa9f6b0 msgr2=0x558a8ac41410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 shutdown_connections 2023-03-17T11:05:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 1 -- 172.21.15.35:0/1776617354 wait complete. 2023-03-17T11:05:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7cdc05ab80 20 client.19977 trim_cache size 0 max 16384 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cb409f640 msgr2=0x7f7cb40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cb409f640 0x7f7cb40a1af0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005950 tx=0x7f7cc400b410 comp rx=0 tx=0).stop 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 msgr2=0x7f7cc80732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc80732c0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009990 tx=0x7f7cb8004730 comp rx=0 tx=0).stop 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 shutdown_connections 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7cb409f640 0x7f7cb40a1af0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cc81054f0 0x7f7cc81a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc8100be0 0x7f7cc8072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 --2- 172.21.15.35:0/338143332 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cc8101580 0x7f7cc80732c0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.316+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 >> 172.21.15.35:0/338143332 conn(0x7f7cc80774e0 msgr2=0x7f7cc80fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.317+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 shutdown_connections 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:26.317+0000 7f7ccfecd700 1 -- 172.21.15.35:0/338143332 wait complete. 2023-03-17T11:05:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 -- 172.21.15.35:0/2925681336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840105490 msgr2=0x7f684010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 --2- 172.21.15.35:0/2925681336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840105490 0x7f684010d060 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f683800b0d0 tx=0x7f683800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 -- 172.21.15.35:0/2925681336 shutdown_connections 2023-03-17T11:05:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 --2- 172.21.15.35:0/2925681336 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840105490 0x7f684010d060 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 --2- 172.21.15.35:0/2925681336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840100450 0x7f6840100820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:17 smithi035 ceph-mon[92535]: osdmap e335: 12 total, 12 up, 12 in 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:17 smithi035 ceph-mon[92535]: pgmap v4186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 14 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:20 smithi035 ceph-mon[92535]: pgmap v4187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:22 smithi035 ceph-mon[92535]: pgmap v4188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:24 smithi035 ceph-mon[92535]: pgmap v4189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:26 smithi035 ceph-mon[92535]: pgmap v4190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:27 smithi035 ceph-mon[92535]: pgmap v4191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:30 smithi035 ceph-mon[92535]: pgmap v4192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:30.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:32 smithi035 ceph-mon[92535]: pgmap v4193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:31.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:34 smithi035 ceph-mon[92535]: pgmap v4194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:31.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:36 smithi035 ceph-mon[92535]: pgmap v4195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:31.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:37 smithi035 ceph-mon[92535]: pgmap v4196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:31.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:40 smithi035 ceph-mon[92535]: pgmap v4197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:31.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:42 smithi035 ceph-mon[92535]: pgmap v4198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:31.165 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:44 smithi035 ceph-mon[92535]: pgmap v4199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T11:05:31.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:05:31.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:45 smithi035 ceph-mon[92535]: pgmap v4200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 KiB/s wr, 10 op/s 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:45 smithi035 ceph-mon[92535]: pgmap v4201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:47 smithi035 ceph-mon[92535]: pgmap v4202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:49 smithi035 ceph-mon[92535]: pgmap v4203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:51 smithi035 ceph-mon[92535]: pgmap v4204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:53 smithi035 ceph-mon[92535]: pgmap v4205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6 op/s 2023-03-17T11:05:31.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:55 smithi035 ceph-mon[92535]: pgmap v4206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T11:05:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:57 smithi035 ceph-mon[92535]: pgmap v4207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T11:05:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:53:59 smithi035 ceph-mon[92535]: pgmap v4208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:05:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:01 smithi035 ceph-mon[92535]: pgmap v4209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:05:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:03 smithi035 ceph-mon[92535]: pgmap v4210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:05:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:05 smithi035 ceph-mon[92535]: pgmap v4211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T11:05:33.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:07 smithi035 ceph-mon[92535]: pgmap v4212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:09 smithi035 ceph-mon[92535]: pgmap v4213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:10 smithi035 ceph-mon[92535]: osdmap e336: 12 total, 12 up, 12 in 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:11 smithi035 ceph-mon[92535]: pgmap v4215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:13 smithi035 ceph-mon[92535]: pgmap v4216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:15 smithi035 ceph-mon[92535]: pgmap v4217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:17 smithi035 ceph-mon[92535]: pgmap v4218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:17 smithi035 ceph-mon[92535]: osdmap e337: 12 total, 12 up, 12 in 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:19 smithi035 ceph-mon[92535]: pgmap v4220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:21 smithi035 ceph-mon[92535]: pgmap v4221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:23 smithi035 ceph-mon[92535]: pgmap v4222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:25 smithi035 ceph-mon[92535]: pgmap v4223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:27 smithi035 ceph-mon[92535]: pgmap v4224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:29 smithi035 ceph-mon[92535]: pgmap v4225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:31 smithi035 ceph-mon[92535]: pgmap v4226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:33 smithi035 ceph-mon[92535]: pgmap v4227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:35 smithi035 ceph-mon[92535]: pgmap v4228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2023-03-17T11:05:33.559 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:37 smithi035 ceph-mon[92535]: pgmap v4229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:39 smithi035 ceph-mon[92535]: pgmap v4230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:41 smithi035 ceph-mon[92535]: pgmap v4231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:43 smithi035 ceph-mon[92535]: pgmap v4232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:45 smithi035 ceph-mon[92535]: pgmap v4233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:46 smithi035 ceph-mon[92535]: pgmap v4234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:48 smithi035 ceph-mon[92535]: pgmap v4235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:50 smithi035 ceph-mon[92535]: pgmap v4236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:52 smithi035 ceph-mon[92535]: pgmap v4237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:54 smithi035 ceph-mon[92535]: pgmap v4238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 15 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:56 smithi035 ceph-mon[92535]: pgmap v4239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:54:58 smithi035 ceph-mon[92535]: pgmap v4240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:33.560 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:00 smithi035 ceph-mon[92535]: pgmap v4241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:02 smithi035 ceph-mon[92535]: pgmap v4242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:04 smithi035 ceph-mon[92535]: pgmap v4243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:06 smithi035 ceph-mon[92535]: pgmap v4244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:08 smithi035 ceph-mon[92535]: pgmap v4245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:10 smithi035 ceph-mon[92535]: pgmap v4246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:10 smithi035 ceph-mon[92535]: osdmap e338: 12 total, 12 up, 12 in 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:12 smithi035 ceph-mon[92535]: pgmap v4248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:14 smithi035 ceph-mon[92535]: pgmap v4249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:16 smithi035 ceph-mon[92535]: pgmap v4250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:33.561 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:17 smithi035 ceph-mon[92535]: pgmap v4251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:34.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:17 smithi035 ceph-mon[92535]: osdmap e339: 12 total, 12 up, 12 in 2023-03-17T11:05:34.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:19 smithi035 ceph-mon[92535]: pgmap v4253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 12 op/s 2023-03-17T11:05:34.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:21 smithi035 ceph-mon[92535]: pgmap v4254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:34.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:23 smithi035 ceph-mon[92535]: pgmap v4255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:35.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:25 smithi035 ceph-mon[92535]: pgmap v4256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:35.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:27 smithi035 ceph-mon[92535]: pgmap v4257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:35.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:29 smithi035 ceph-mon[92535]: pgmap v4258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-17T11:05:35.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:31 smithi035 ceph-mon[92535]: pgmap v4259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:35.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:33 smithi035 ceph-mon[92535]: pgmap v4260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:35 smithi035 ceph-mon[92535]: pgmap v4261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:37 smithi035 ceph-mon[92535]: pgmap v4262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:39 smithi035 ceph-mon[92535]: pgmap v4263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:41 smithi035 ceph-mon[92535]: pgmap v4264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:43 smithi035 ceph-mon[92535]: pgmap v4265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:46 smithi035 ceph-mon[92535]: pgmap v4266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:36.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:05:36.212 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:05:36.212 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:46 smithi035 ceph-mon[92535]: pgmap v4267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:46 smithi035 ceph-mon[92535]: pgmap v4268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:47 smithi035 ceph-mon[92535]: pgmap v4269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:50 smithi035 ceph-mon[92535]: pgmap v4270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:52 smithi035 ceph-mon[92535]: pgmap v4271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:54 smithi035 ceph-mon[92535]: pgmap v4272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:05:36.739 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:56 smithi035 ceph-mon[92535]: pgmap v4273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:05:38.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:55:57 smithi035 ceph-mon[92535]: pgmap v4274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:00 smithi035 ceph-mon[92535]: pgmap v4275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:02 smithi035 ceph-mon[92535]: pgmap v4276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:04 smithi035 ceph-mon[92535]: pgmap v4277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:06 smithi035 ceph-mon[92535]: pgmap v4278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:07 smithi035 ceph-mon[92535]: pgmap v4279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:09 smithi035 ceph-mon[92535]: osdmap e340: 12 total, 12 up, 12 in 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:09 smithi035 ceph-mon[92535]: pgmap v4281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:12 smithi035 ceph-mon[92535]: pgmap v4282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:14 smithi035 ceph-mon[92535]: pgmap v4283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:38.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:16 smithi035 ceph-mon[92535]: pgmap v4284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:39.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:17 smithi035 ceph-mon[92535]: osdmap e341: 12 total, 12 up, 12 in 2023-03-17T11:05:39.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:17 smithi035 ceph-mon[92535]: pgmap v4286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 13 op/s 2023-03-17T11:05:39.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:20 smithi035 ceph-mon[92535]: pgmap v4287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:39.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:22 smithi035 ceph-mon[92535]: pgmap v4288: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:05:39.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:24 smithi035 ceph-mon[92535]: pgmap v4289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:39.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:26 smithi035 ceph-mon[92535]: pgmap v4290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:05:39.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:27 smithi035 ceph-mon[92535]: pgmap v4291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:05:39.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:30 smithi035 ceph-mon[92535]: pgmap v4292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:39.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:32 smithi035 ceph-mon[92535]: pgmap v4293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:39.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:34 smithi035 ceph-mon[92535]: pgmap v4294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:05:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:05:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:05:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:05:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:05:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:05:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:05:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:05:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:05:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:05:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 --2- 172.21.15.35:0/2925681336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6840100df0 0x7f6840104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 -- 172.21.15.35:0/2925681336 >> 172.21.15.35:0/2925681336 conn(0x7f68400fbca0 msgr2=0x7f68400fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 -- 172.21.15.35:0/2925681336 shutdown_connections 2023-03-17T11:05:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 -- 172.21.15.35:0/2925681336 wait complete. 2023-03-17T11:05:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.440+0000 7f6845b22700 1 Processor -- start 2023-03-17T11:05:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 -- start start 2023-03-17T11:05:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840100450 0x7f6840072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 0x7f68400732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6840105490 0x7f68401a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6840073af0 con 0x7f6840100df0 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68401a4a70 con 0x7f6840100450 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f6845b22700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68401a4bb0 con 0x7f6840105490 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 0x7f68400732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 0x7f68400732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53386/0 (socket says 172.21.15.35:53386) 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 -- 172.21.15.35:0/561479572 learned_addr learned my addr 172.21.15.35:0/561479572 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683f7fe700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840100450 0x7f6840072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683ffff700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6840105490 0x7f68401a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 -- 172.21.15.35:0/561479572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6840105490 msgr2=0x7f68401a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6840105490 0x7f68401a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 -- 172.21.15.35:0/561479572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840100450 msgr2=0x7f6840072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:44.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840100450 0x7f6840072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 -- 172.21.15.35:0/561479572 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838009d00 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.441+0000 7f683effd700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 0x7f68400732c0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f683400d950 tx=0x7f683400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.442+0000 7f683cff9700 1 -- 172.21.15.35:0/561479572 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683400f890 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.442+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68401100c0 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.442+0000 7f683cff9700 1 -- 172.21.15.35:0/561479572 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f683400fe80 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.442+0000 7f683cff9700 1 -- 172.21.15.35:0/561479572 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683400e3b0 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.442+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684010ff30 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.444+0000 7f683cff9700 1 -- 172.21.15.35:0/561479572 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f683400f9f0 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.445+0000 7f683cff9700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f682809f640 0x7f68280a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.445+0000 7f683cff9700 1 -- 172.21.15.35:0/561479572 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f68340ca0a0 con 0x7f6840100df0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.445+0000 7f683f7fe700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f682809f640 0x7f68280a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.445+0000 7f683f7fe700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f682809f640 0x7f68280a1af0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6830009c60 tx=0x7f6830009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 Processor -- start 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 -- start start 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e40fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e3bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3d42010 con 0x557aa3e414f0 2023-03-17T11:05:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3d94950 con 0x557aa3e3b960 2023-03-17T11:05:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f6851cafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3d8dde0 con 0x557aa3e40be0 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53394/0 (socket says 172.21.15.35:53394) 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 -- 172.21.15.35:0/1028429307 learned_addr learned my addr 172.21.15.35:0/1028429307 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683ffff700 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e3bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683f7fe700 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e40fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 -- 172.21.15.35:0/1028429307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 msgr2=0x557aa3e40fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e40fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 -- 172.21.15.35:0/1028429307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 msgr2=0x557aa3e3bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e3bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.446+0000 7f683effd700 1 -- 172.21.15.35:0/1028429307 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aa3c0f5d0 con 0x557aa3e414f0 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.447+0000 7f683effd700 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3b420 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f68340945c0 tx=0x7f6834097530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62cdfd69f874627 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.447+0000 7f6825ffb700 1 -- 172.21.15.35:0/1028429307 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683409fd40 con 0x557aa3e414f0 2023-03-17T11:05:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.447+0000 7f6825ffb700 1 -- 172.21.15.35:0/1028429307 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6834095ef0 con 0x557aa3e414f0 2023-03-17T11:05:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.447+0000 7f6825ffb700 1 -- 172.21.15.35:0/1028429307 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834097040 con 0x557aa3e414f0 2023-03-17T11:05:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.447+0000 7f6851cafb80 1 -- 172.21.15.35:0/1028429307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 msgr2=0x557aa3e3b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.447+0000 7f6851cafb80 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3b420 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f68340945c0 tx=0x7f6834097530 comp rx=0 tx=0).stop 2023-03-17T11:05:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- 172.21.15.35:0/1028429307 shutdown_connections 2023-03-17T11:05:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e3bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e40fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 --2- 172.21.15.35:0/1028429307 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3b420 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- 172.21.15.35:0/1028429307 >> 172.21.15.35:0/1028429307 conn(0x557aa3c986b0 msgr2=0x557aa3e35a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- 172.21.15.35:0/1028429307 shutdown_connections 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- 172.21.15.35:0/1028429307 wait complete. 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- start start 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 Processor -- start 2023-03-17T11:05:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 0x557aa3e47470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e414f0 0x557aa3e44de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3c118c0 con 0x557aa3e3b960 2023-03-17T11:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e45520 con 0x557aa3e414f0 2023-03-17T11:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e51030 con 0x557aa3e40be0 2023-03-17T11:05:48.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f6851cafb80 10 client.0 _ll_register_callbacks cb 0x557aa3c33230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f683f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 0x557aa3e47470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f683f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 0x557aa3e47470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53398/0 (socket says 172.21.15.35:53398) 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f683f7fe700 1 -- 172.21.15.35:0/627226794 learned_addr learned my addr 172.21.15.35:0/627226794 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.448+0000 7f683ffff700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e414f0 0x557aa3e44de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683effd700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683f7fe700 1 -- 172.21.15.35:0/627226794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 msgr2=0x557aa3e44760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683f7fe700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e44760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683f7fe700 1 -- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e414f0 msgr2=0x557aa3e44de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683f7fe700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e414f0 0x557aa3e44de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683f7fe700 1 -- 172.21.15.35:0/627226794 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684010ff30 con 0x557aa3e3b960 2023-03-17T11:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683ffff700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e414f0 0x557aa3e44de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f683f7fe700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 0x557aa3e47470 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6830003930 tx=0x7f68300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154c5730b8af9eaa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f681effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:05:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f681effd700 1 -- 172.21.15.35:0/627226794 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830022070 con 0x557aa3e3b960 2023-03-17T11:05:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f681effd700 1 -- 172.21.15.35:0/627226794 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f683001d620 con 0x557aa3e3b960 2023-03-17T11:05:49.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557aa3d50390 con 0x557aa3e3b960 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f681effd700 1 -- 172.21.15.35:0/627226794 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f683001d7e0 con 0x557aa3e3b960 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f6851cafb80 10 client.19989 fetch_fsmap learned FSMap version 88 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.449+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x557aa3bbbd80 con 0x557aa3e3b960 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f681effd700 1 -- 172.21.15.35:0/627226794 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557aa3d50390 con 0x557aa3e3b960 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f681effd700 1 -- 172.21.15.35:0/627226794 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 88) v1 ==== 6973+0+0 (secure 0 0 0) 0x7f6830027870 con 0x557aa3e3b960 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f6851cafb80 10 client.19989 fetch_fsmap finished waiting for FSMap version 88 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f6851cafb80 10 client.19989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f6851cafb80 20 client.19989 populate_metadata read hostname 'smithi035' 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f6851cafb80 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3e55240 0x557aa3e57650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f6851cafb80 4 client.19989 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557aa3d5c600 con 0x557aa3e55240 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f683effd700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3e55240 0x557aa3e57650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f681effd700 10 client.19989 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.450+0000 7f683effd700 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3e55240 0x557aa3e57650 crc :-1 s=READY pgs=582 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ebf3bb39ed67a5a server_cookie=b9573b0ab6707d7c in_seq=0 out_seq=0 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f681effd700 1 -- 172.21.15.35:0/627226794 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557aa3d5c600 con 0x557aa3e55240 2023-03-17T11:05:49.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f681effd700 10 client.19989 handle_command_reply: tid=0 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 client.19989 shutdown 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 msgr2=0x557aa3e47470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 0x557aa3e47470 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6830003930 tx=0x7f68300047c0 comp rx=0 tx=0).stop 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 shutdown_connections 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3e55240 0x557aa3e57650 crc :-1 s=READY pgs=582 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e414f0 0x557aa3e44de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f681effd700 0 client.19989 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e3b960 0x557aa3e47470 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 --2- 172.21.15.35:0/627226794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:49.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 >> 172.21.15.35:0/627226794 conn(0x557aa3c986b0 msgr2=0x557aa3e3a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 shutdown_connections 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 1 -- 172.21.15.35:0/627226794 wait complete. 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.451+0000 7f6851cafb80 20 client.19989 trim_cache size 0 max 16384 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 Processor -- start 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 -- start start 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e3b960 0x557aa3e4bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e40be0 0x557aa3e47010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e363c0 con 0x557aa3e414f0 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e325f0 con 0x557aa3e40be0 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f6851cafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e36e60 con 0x557aa3e3b960 2023-03-17T11:05:50.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53410/0 (socket says 172.21.15.35:53410) 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 -- 172.21.15.35:0/2558196819 learned_addr learned my addr 172.21.15.35:0/2558196819 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683f7fe700 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e3b960 0x557aa3e4bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683effd700 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e40be0 0x557aa3e47010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 -- 172.21.15.35:0/2558196819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e3b960 msgr2=0x557aa3e4bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e3b960 0x557aa3e4bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:50.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 -- 172.21.15.35:0/2558196819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e40be0 msgr2=0x557aa3e47010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e40be0 0x557aa3e47010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.467+0000 7f683ffff700 1 -- 172.21.15.35:0/2558196819 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aa3d54130 con 0x557aa3e414f0 2023-03-17T11:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f683ffff700 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3e6b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f683800b770 tx=0x7f6838008c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636137ad79998ed6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f68267fc700 1 -- 172.21.15.35:0/2558196819 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838021070 con 0x557aa3e414f0 2023-03-17T11:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f68267fc700 1 -- 172.21.15.35:0/2558196819 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6838008e30 con 0x557aa3e414f0 2023-03-17T11:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f68267fc700 1 -- 172.21.15.35:0/2558196819 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800e040 con 0x557aa3e414f0 2023-03-17T11:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 -- 172.21.15.35:0/2558196819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 msgr2=0x557aa3e3e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3e6b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f683800b770 tx=0x7f6838008c80 comp rx=0 tx=0).stop 2023-03-17T11:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 -- 172.21.15.35:0/2558196819 shutdown_connections 2023-03-17T11:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3e3e6b0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e3b960 0x557aa3e4bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2558196819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e40be0 0x557aa3e47010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 -- 172.21.15.35:0/2558196819 >> 172.21.15.35:0/2558196819 conn(0x557aa3c986b0 msgr2=0x557aa3e3ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:05:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 -- 172.21.15.35:0/2558196819 shutdown_connections 2023-03-17T11:05:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.468+0000 7f6851cafb80 1 -- 172.21.15.35:0/2558196819 wait complete. 2023-03-17T11:05:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 -- start start 2023-03-17T11:05:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 Processor -- start 2023-03-17T11:05:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e49f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e4a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3ea80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e4adf0 con 0x557aa3e414f0 2023-03-17T11:05:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3ea85e0 con 0x557aa3e3b960 2023-03-17T11:05:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3ea8720 con 0x557aa3e40be0 2023-03-17T11:05:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f6851cafb80 10 client.0 _ll_register_callbacks cb 0x557aa3c33230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:05:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3ea80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:54.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3ea80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53416/0 (socket says 172.21.15.35:53416) 2023-03-17T11:05:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 -- 172.21.15.35:0/2989271759 learned_addr learned my addr 172.21.15.35:0/2989271759 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:05:55.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:36 smithi035 ceph-mon[92535]: pgmap v4295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:05:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683f7fe700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e49f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683effd700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e4a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 -- 172.21.15.35:0/2989271759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 msgr2=0x557aa3e4a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e4a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 -- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 msgr2=0x557aa3e49f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:05:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e49f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:05:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683ffff700 1 -- 172.21.15.35:0/2989271759 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684010d8a0 con 0x557aa3e414f0 2023-03-17T11:05:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.469+0000 7f683f7fe700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e49f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:05:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f683ffff700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3ea80a0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6838007a30 tx=0x7f6838007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5141f8173f07173e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f681effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f681effd700 1 -- 172.21.15.35:0/2989271759 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838021040 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f681effd700 1 -- 172.21.15.35:0/2989271759 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6838003a00 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557aa3e0b1e0 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f681effd700 1 -- 172.21.15.35:0/2989271759 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f683800e040 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 10 client.19995 fetch_fsmap learned FSMap version 88 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x557aa3be21f0 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f681effd700 1 -- 172.21.15.35:0/2989271759 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557aa3e0b1e0 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f681effd700 1 -- 172.21.15.35:0/2989271759 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 88) v1 ==== 6973+0+0 (secure 0 0 0) 0x7f683802d030 con 0x557aa3e414f0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 10 client.19995 fetch_fsmap finished waiting for FSMap version 88 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 10 client.19995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 20 client.19995 populate_metadata read hostname 'smithi035' 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3ea9df0 0x557aa3eac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 4 client.19995 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.470+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557aa3c11f00 con 0x557aa3ea9df0 2023-03-17T11:05:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.471+0000 7f683f7fe700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3ea9df0 0x557aa3eac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:05:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.471+0000 7f681effd700 10 client.19995 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:05:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.471+0000 7f683f7fe700 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3ea9df0 0x557aa3eac200 crc :-1 s=READY pgs=583 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=390525461d9097ab server_cookie=9a6384fc8dd41065 in_seq=0 out_seq=0 2023-03-17T11:05:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f681effd700 1 -- 172.21.15.35:0/2989271759 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557aa3c11f00 con 0x557aa3ea9df0 2023-03-17T11:05:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f681effd700 10 client.19995 handle_command_reply: tid=0 2023-03-17T11:05:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 client.19995 shutdown 2023-03-17T11:05:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 msgr2=0x557aa3ea80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:05:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3ea80a0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6838007a30 tx=0x7f6838007e40 comp rx=0 tx=0).stop 2023-03-17T11:05:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 shutdown_connections 2023-03-17T11:05:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557aa3ea9df0 0x557aa3eac200 crc :-1 s=READY pgs=583 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557aa3e414f0 0x557aa3ea80a0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557aa3e3b960 0x557aa3e49f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 --2- 172.21.15.35:0/2989271759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aa3e40be0 0x557aa3e4a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f681effd700 0 client.19995 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 >> 172.21.15.35:0/2989271759 conn(0x557aa3c986b0 msgr2=0x557aa3e3e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 shutdown_connections 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 1 -- 172.21.15.35:0/2989271759 wait complete. 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.501+0000 7f6851cafb80 20 client.19995 trim_cache size 0 max 16384 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f682809f640 msgr2=0x7f68280a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f682809f640 0x7f68280a1af0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6830009c60 tx=0x7f6830009260 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 msgr2=0x7f68400732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 0x7f68400732c0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f683400d950 tx=0x7f683400dc60 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 shutdown_connections 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f682809f640 0x7f68280a1af0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6840105490 0x7f68401a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6840100450 0x7f6840072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 --2- 172.21.15.35:0/561479572 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6840100df0 0x7f68400732c0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 >> 172.21.15.35:0/561479572 conn(0x7f68400fbca0 msgr2=0x7f68400fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 shutdown_connections 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:39.502+0000 7f6845b22700 1 -- 172.21.15.35:0/561479572 wait complete. 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.625+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/998783397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80ff3d0 msgr2=0x7fb0a8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.625+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/998783397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80ff3d0 0x7fb0a8104e30 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0099c0 tx=0x7fb09c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/998783397 shutdown_connections 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/998783397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0a8105510 0x7fb0a810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/998783397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0a80fea30 0x7fb0a80fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/998783397 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80ff3d0 0x7fb0a8104e30 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/998783397 >> 172.21.15.35:0/998783397 conn(0x7fb0a8074590 msgr2=0x7fb0a8074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/998783397 shutdown_connections 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/998783397 wait complete. 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 Processor -- start 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.626+0000 7fb0ad5cc700 1 -- start start 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0ad5cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 0x7fb0a8196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0ad5cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0a80ff3d0 0x7fb0a81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0ad5cc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0a8105510 0x7fb0a819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0ad5cc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a819b240 con 0x7fb0a80fea30 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0ad5cc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a819b3b0 con 0x7fb0a8105510 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0ad5cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a819b570 con 0x7fb0a80ff3d0 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 0x7fb0a8196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 0x7fb0a8196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53426/0 (socket says 172.21.15.35:53426) 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 -- 172.21.15.35:0/4111916388 learned_addr learned my addr 172.21.15.35:0/4111916388 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0a8105510 0x7fb0a819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0a80ff3d0 0x7fb0a81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 -- 172.21.15.35:0/4111916388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0a80ff3d0 msgr2=0x7fb0a81967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0a80ff3d0 0x7fb0a81967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 -- 172.21.15.35:0/4111916388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0a8105510 msgr2=0x7fb0a819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0a8105510 0x7fb0a819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 -- 172.21.15.35:0/4111916388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0095f0 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.627+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 0x7fb0a8196260 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fb09800e9a0 tx=0x7fb09800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.628+0000 7fb08ffff700 1 -- 172.21.15.35:0/4111916388 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098009790 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.628+0000 7fb08ffff700 1 -- 172.21.15.35:0/4111916388 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb09800cbd0 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.628+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a8110160 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.628+0000 7fb08ffff700 1 -- 172.21.15.35:0/4111916388 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098018680 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.628+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a810ffd0 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.630+0000 7fb08ffff700 1 -- 172.21.15.35:0/4111916388 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb09800cd40 con 0x7fb0a80fea30 2023-03-17T11:06:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.630+0000 7fb08ffff700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb09009f640 0x7fb0900a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.630+0000 7fb08ffff700 1 -- 172.21.15.35:0/4111916388 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb098014070 con 0x7fb0a80fea30 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.630+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb09009f640 0x7fb0900a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.631+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb09009f640 0x7fb0900a1af0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009990 tx=0x7fb09c01a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 Processor -- start 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 -- start start 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d985be0 0x55836d985fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d980420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 0x55836d980d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d887010 con 0x55836d980960 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d8d9950 con 0x55836d9864f0 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d8d2de0 con 0x55836d985be0 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 0x55836d980d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 0x55836d980d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53438/0 (socket says 172.21.15.35:53438) 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 -- 172.21.15.35:0/3178438619 learned_addr learned my addr 172.21.15.35:0/3178438619 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d985be0 0x55836d985fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d980420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 -- 172.21.15.35:0/3178438619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d985be0 msgr2=0x55836d985fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d985be0 0x55836d985fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 -- 172.21.15.35:0/3178438619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 msgr2=0x55836d980420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d980420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 -- 172.21.15.35:0/3178438619 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55836d7545d0 con 0x55836d980960 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.632+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 0x55836d980d90 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0011670 tx=0x7fb0a0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7a6b750c62bb4a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb08d7fa700 1 -- 172.21.15.35:0/3178438619 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000e040 con 0x55836d980960 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb08d7fa700 1 -- 172.21.15.35:0/3178438619 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0a000f040 con 0x55836d980960 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb08d7fa700 1 -- 172.21.15.35:0/3178438619 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00045b0 con 0x55836d980960 2023-03-17T11:06:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3178438619 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 msgr2=0x55836d980d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 0x55836d980d90 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0011670 tx=0x7fb0a0009920 comp rx=0 tx=0).stop 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3178438619 shutdown_connections 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d980960 0x55836d980d90 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d985be0 0x55836d985fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3178438619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d980420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3178438619 >> 172.21.15.35:0/3178438619 conn(0x55836d7dd6b0 msgr2=0x55836d97aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3178438619 shutdown_connections 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.633+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3178438619 wait complete. 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 -- start start 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 Processor -- start 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d98c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d9895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d989b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d7568c0 con 0x55836d985be0 2023-03-17T11:06:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d98a250 con 0x55836d9864f0 2023-03-17T11:06:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d98a410 con 0x55836d980960 2023-03-17T11:06:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.634+0000 7fb0b9759b80 10 client.0 _ll_register_callbacks cb 0x55836d778230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:06:01.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d98c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d9895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d98c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:45206/0 (socket says 172.21.15.35:45206) 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a6ffd700 1 -- 172.21.15.35:0/3167480230 learned_addr learned my addr 172.21.15.35:0/3167480230 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d989b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3167480230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 msgr2=0x55836d98c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d98c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 msgr2=0x55836d989b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d989b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3167480230 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a0011350 con 0x55836d985be0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d9895d0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098e0 tx=0x7fb09c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabdbf4393bca758 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb08aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb08aff5700 1 -- 172.21.15.35:0/3167480230 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c01d040 con 0x55836d985be0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb08aff5700 1 -- 172.21.15.35:0/3167480230 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb09c02f670 con 0x55836d985be0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55836d895390 con 0x55836d985be0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb08aff5700 1 -- 172.21.15.35:0/3167480230 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb09c02f870 con 0x55836d985be0 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0b9759b80 10 client.20007 fetch_fsmap learned FSMap version 88 2023-03-17T11:06:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.635+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x55836d700d80 con 0x55836d985be0 2023-03-17T11:06:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb08aff5700 1 -- 172.21.15.35:0/3167480230 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55836d895390 con 0x55836d985be0 2023-03-17T11:06:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb08aff5700 1 -- 172.21.15.35:0/3167480230 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 88) v1 ==== 6973+0+0 (secure 0 0 0) 0x7fb09c023910 con 0x55836d985be0 2023-03-17T11:06:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0b9759b80 10 client.20007 fetch_fsmap finished waiting for FSMap version 88 2023-03-17T11:06:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0b9759b80 10 client.20007 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:06:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0b9759b80 20 client.20007 populate_metadata read hostname 'smithi035' 2023-03-17T11:06:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d99a060 0x55836d99c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0b9759b80 4 client.20007 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:06:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55836d8a1600 con 0x55836d99a060 2023-03-17T11:06:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d99a060 0x55836d99c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb08aff5700 10 client.20007 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:05.812 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:37 smithi035 ceph-mon[92535]: pgmap v4296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T11:06:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.636+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d99a060 0x55836d99c470 crc :-1 s=READY pgs=584 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba4468ccd974c3c server_cookie=835feb800f3ee54d in_seq=0 out_seq=0 2023-03-17T11:06:06.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb08aff5700 1 -- 172.21.15.35:0/3167480230 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55836d8a1600 con 0x55836d99a060 2023-03-17T11:06:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb08aff5700 10 client.20007 handle_command_reply: tid=0 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 client.20007 shutdown 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 msgr2=0x55836d9895d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d9895d0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0098e0 tx=0x7fb09c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 shutdown_connections 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d99a060 0x55836d99c470 crc :-1 s=READY pgs=584 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d989b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d98c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3167480230 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d9895d0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb08aff5700 0 client.20007 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 >> 172.21.15.35:0/3167480230 conn(0x55836d7dd6b0 msgr2=0x55836d97aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 shutdown_connections 2023-03-17T11:06:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3167480230 wait complete. 2023-03-17T11:06:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.637+0000 7fb0b9759b80 20 client.20007 trim_cache size 0 max 16384 2023-03-17T11:06:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.652+0000 7fb0b9759b80 1 Processor -- start 2023-03-17T11:06:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.652+0000 7fb0b9759b80 1 -- start start 2023-03-17T11:06:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d980420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d97aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d9870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d97b000 con 0x55836d985be0 2023-03-17T11:06:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d9875e0 con 0x55836d9864f0 2023-03-17T11:06:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d9760d0 con 0x55836d980960 2023-03-17T11:06:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d97aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d97aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53450/0 (socket says 172.21.15.35:53450) 2023-03-17T11:06:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 -- 172.21.15.35:0/862146221 learned_addr learned my addr 172.21.15.35:0/862146221 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d980420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d9870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 -- 172.21.15.35:0/862146221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 msgr2=0x55836d980420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d980420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 -- 172.21.15.35:0/862146221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 msgr2=0x55836d9870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d9870a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 -- 172.21.15.35:0/862146221 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55836d981000 con 0x55836d985be0 2023-03-17T11:06:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d97aac0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fb09c023fb0 tx=0x7fb09c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408282fd6ec29ce6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb08dffb700 1 -- 172.21.15.35:0/862146221 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c01d070 con 0x55836d985be0 2023-03-17T11:06:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb08dffb700 1 -- 172.21.15.35:0/862146221 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb09c029050 con 0x55836d985be0 2023-03-17T11:06:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.653+0000 7fb08dffb700 1 -- 172.21.15.35:0/862146221 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0179d0 con 0x55836d985be0 2023-03-17T11:06:13.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 -- 172.21.15.35:0/862146221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 msgr2=0x55836d97aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:13.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d97aac0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fb09c023fb0 tx=0x7fb09c000bc0 comp rx=0 tx=0).stop 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 -- 172.21.15.35:0/862146221 shutdown_connections 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d9870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d980420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/862146221 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d97aac0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 -- 172.21.15.35:0/862146221 >> 172.21.15.35:0/862146221 conn(0x55836d7dd6b0 msgr2=0x55836d986990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 -- 172.21.15.35:0/862146221 shutdown_connections 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 -- 172.21.15.35:0/862146221 wait complete. 2023-03-17T11:06:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 -- start start 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.654+0000 7fb0b9759b80 1 Processor -- start 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d9816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d981be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d982120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d982740 con 0x55836d985be0 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d9828b0 con 0x55836d9864f0 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836d982a70 con 0x55836d980960 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0b9759b80 10 client.0 _ll_register_callbacks cb 0x55836d778230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d981be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d981be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53458/0 (socket says 172.21.15.35:53458) 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3407465309 learned_addr learned my addr 172.21.15.35:0/3407465309 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d9816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d982120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3407465309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 msgr2=0x55836d9816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d9816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 msgr2=0x55836d982120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d982120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 -- 172.21.15.35:0/3407465309 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55836d700d80 con 0x55836d985be0 2023-03-17T11:06:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a77fe700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d982120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:06:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb0a67fc700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d981be0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0099c0 tx=0x7fb09c023b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bff0e881c2c7884 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.655+0000 7fb08aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb08aff5700 1 -- 172.21.15.35:0/3407465309 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c01d040 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb08aff5700 1 -- 172.21.15.35:0/3407465309 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb09c0178d0 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55836d9501e0 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb08aff5700 1 -- 172.21.15.35:0/3407465309 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb09c017a90 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 10 client.20013 fetch_fsmap learned FSMap version 88 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x55836d6e9c00 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb08aff5700 1 -- 172.21.15.35:0/3407465309 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55836d9501e0 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb08aff5700 1 -- 172.21.15.35:0/3407465309 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 88) v1 ==== 6973+0+0 (secure 0 0 0) 0x7fb09c039ca0 con 0x55836d985be0 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 10 client.20013 fetch_fsmap finished waiting for FSMap version 88 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 10 client.20013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 20 client.20013 populate_metadata read hostname 'smithi035' 2023-03-17T11:06:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d9ee890 0x55836d9f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 4 client.20013 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55836d756f00 con 0x55836d9ee890 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.656+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d9ee890 0x55836d9f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.657+0000 7fb0a6ffd700 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d9ee890 0x55836d9f0ca0 crc :-1 s=READY pgs=585 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78cf2bffef687c2a server_cookie=5ccff1a23cc36646 in_seq=0 out_seq=0 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.657+0000 7fb08aff5700 10 client.20013 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb08aff5700 1 -- 172.21.15.35:0/3407465309 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55836d756f00 con 0x55836d9ee890 2023-03-17T11:06:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb08aff5700 10 client.20013 handle_command_reply: tid=0 2023-03-17T11:06:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 client.20013 shutdown 2023-03-17T11:06:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 msgr2=0x55836d981be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d981be0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0099c0 tx=0x7fb09c023b20 comp rx=0 tx=0).stop 2023-03-17T11:06:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 shutdown_connections 2023-03-17T11:06:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55836d9ee890 0x55836d9f0ca0 crc :-1 s=READY pgs=585 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55836d9864f0 0x55836d982120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb08aff5700 0 client.20013 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55836d980960 0x55836d9816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 --2- 172.21.15.35:0/3407465309 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55836d985be0 0x55836d981be0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:21.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 >> 172.21.15.35:0/3407465309 conn(0x55836d7dd6b0 msgr2=0x55836d9846c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.675+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 shutdown_connections 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0b9759b80 1 -- 172.21.15.35:0/3407465309 wait complete. 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0b9759b80 20 client.20013 trim_cache size 0 max 16384 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb09009f640 msgr2=0x7fb0900a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb09009f640 0x7fb0900a1af0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009990 tx=0x7fb09c01a040 comp rx=0 tx=0).stop 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 msgr2=0x7fb0a8196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 0x7fb0a8196260 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fb09800e9a0 tx=0x7fb09800ecb0 comp rx=0 tx=0).stop 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 shutdown_connections 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb09009f640 0x7fb0900a1af0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:21.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0a8105510 0x7fb0a819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb0a80fea30 0x7fb0a8196260 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 --2- 172.21.15.35:0/4111916388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0a80ff3d0 0x7fb0a81967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 >> 172.21.15.35:0/4111916388 conn(0x7fb0a8074590 msgr2=0x7fb0a81046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.676+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 shutdown_connections 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:39:52.677+0000 7fb0ad5cc700 1 -- 172.21.15.35:0/4111916388 wait complete. 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 -- 172.21.15.35:0/3074315359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 msgr2=0x7faa78100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 --2- 172.21.15.35:0/3074315359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78100820 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7faa680099c0 tx=0x7faa68009cd0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 -- 172.21.15.35:0/3074315359 shutdown_connections 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 --2- 172.21.15.35:0/3074315359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa78105490 0x7faa7810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 --2- 172.21.15.35:0/3074315359 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78100820 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 --2- 172.21.15.35:0/3074315359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa78100df0 0x7faa78104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 -- 172.21.15.35:0/3074315359 >> 172.21.15.35:0/3074315359 conn(0x7faa780fbca0 msgr2=0x7faa780fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 -- 172.21.15.35:0/3074315359 shutdown_connections 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 -- 172.21.15.35:0/3074315359 wait complete. 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 Processor -- start 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.800+0000 7faa7e28d700 1 -- start start 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7e28d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7e28d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa78100df0 0x7faa781967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7e28d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa78105490 0x7faa7819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7e28d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7819b250 con 0x7faa78100450 2023-03-17T11:06:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7e28d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7819b3c0 con 0x7faa78100df0 2023-03-17T11:06:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7e28d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7819b580 con 0x7faa78105490 2023-03-17T11:06:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53468/0 (socket says 172.21.15.35:53468) 2023-03-17T11:06:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 -- 172.21.15.35:0/2313048179 learned_addr learned my addr 172.21.15.35:0/2313048179 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa777fe700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa78100df0 0x7faa781967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa7c82a700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa78105490 0x7faa7819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 -- 172.21.15.35:0/2313048179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa78105490 msgr2=0x7faa7819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa78105490 0x7faa7819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 -- 172.21.15.35:0/2313048179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa78100df0 msgr2=0x7faa781967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa78100df0 0x7faa781967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 -- 172.21.15.35:0/2313048179 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680095f0 con 0x7faa78100450 2023-03-17T11:06:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.801+0000 7faa77fff700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78196270 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7faa68000c00 tx=0x7faa68005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:23.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.802+0000 7faa757fa700 1 -- 172.21.15.35:0/2313048179 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6801d070 con 0x7faa78100450 2023-03-17T11:06:25.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.802+0000 7faa757fa700 1 -- 172.21.15.35:0/2313048179 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa6800fe70 con 0x7faa78100450 2023-03-17T11:06:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.802+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa78110150 con 0x7faa78100450 2023-03-17T11:06:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.802+0000 7faa757fa700 1 -- 172.21.15.35:0/2313048179 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680173f0 con 0x7faa78100450 2023-03-17T11:06:25.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.802+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7810ffc0 con 0x7faa78100450 2023-03-17T11:06:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.804+0000 7faa757fa700 1 -- 172.21.15.35:0/2313048179 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7faa6800f9e0 con 0x7faa78100450 2023-03-17T11:06:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.804+0000 7faa757fa700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faa6409f640 0x7faa640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.805+0000 7faa757fa700 1 -- 172.21.15.35:0/2313048179 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faa680cb7b0 con 0x7faa78100450 2023-03-17T11:06:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.805+0000 7faa777fe700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faa6409f640 0x7faa640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.805+0000 7faa777fe700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faa6409f640 0x7faa640a1af0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faa78197880 tx=0x7faa6000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.805+0000 7faa8a41ab80 1 Processor -- start 2023-03-17T11:06:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 -- start start 2023-03-17T11:06:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5932fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e592d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 0x55e8e592dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:26.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e5834010 con 0x55e8e592d960 2023-03-17T11:06:26.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e5886950 con 0x55e8e5932be0 2023-03-17T11:06:26.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e587fde0 con 0x55e8e59334f0 2023-03-17T11:06:26.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 0x55e8e592dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 0x55e8e592dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53480/0 (socket says 172.21.15.35:53480) 2023-03-17T11:06:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 -- 172.21.15.35:0/682446540 learned_addr learned my addr 172.21.15.35:0/682446540 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa777fe700 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e592d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:26.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa77fff700 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5932fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:26.868 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:40 smithi035 ceph-mon[92535]: pgmap v4297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 -- 172.21.15.35:0/682446540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 msgr2=0x55e8e592d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e592d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 -- 172.21.15.35:0/682446540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 msgr2=0x55e8e5932fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5932fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.806+0000 7faa7c82a700 1 -- 172.21.15.35:0/682446540 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8e57015d0 con 0x55e8e592d960 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa7c82a700 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 0x55e8e592dd90 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7faa70011680 tx=0x7faa70009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a172ae2ada48ca94 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa6e7fc700 1 -- 172.21.15.35:0/682446540 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000e040 con 0x55e8e592d960 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa6e7fc700 1 -- 172.21.15.35:0/682446540 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa7000f040 con 0x55e8e592d960 2023-03-17T11:06:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa6e7fc700 1 -- 172.21.15.35:0/682446540 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70004730 con 0x55e8e592d960 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 -- 172.21.15.35:0/682446540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 msgr2=0x55e8e592dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 0x55e8e592dd90 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7faa70011680 tx=0x7faa70009920 comp rx=0 tx=0).stop 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 -- 172.21.15.35:0/682446540 shutdown_connections 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e592d960 0x55e8e592dd90 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5932fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/682446540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e592d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.807+0000 7faa8a41ab80 1 -- 172.21.15.35:0/682446540 >> 172.21.15.35:0/682446540 conn(0x55e8e578a6b0 msgr2=0x55e8e5927a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 -- 172.21.15.35:0/682446540 shutdown_connections 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 -- 172.21.15.35:0/682446540 wait complete. 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 -- start start 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 Processor -- start 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e59393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5936670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e5936c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e57038c0 con 0x55e8e59334f0 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e5937410 con 0x55e8e5932be0 2023-03-17T11:06:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.808+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e5943030 con 0x55e8e592d960 2023-03-17T11:06:28.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa8a41ab80 10 client.0 _ll_register_callbacks cb 0x55e8e5725230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:06:28.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa7c82a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e5936c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:28.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5936670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa77fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e59393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa7c82a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e5936c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53486/0 (socket says 172.21.15.35:53486) 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa7c82a700 1 -- 172.21.15.35:0/2012487968 learned_addr learned my addr 172.21.15.35:0/2012487968 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 -- 172.21.15.35:0/2012487968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 msgr2=0x55e8e59393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e59393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 -- 172.21.15.35:0/2012487968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 msgr2=0x55e8e5936c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e5936c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 -- 172.21.15.35:0/2012487968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa70011330 con 0x55e8e5932be0 2023-03-17T11:06:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa7c82a700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e5936c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa77fff700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e59393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa777fe700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5936670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faa6000ba80 tx=0x7faa600047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21cff6bb315fa909 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa577fe700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa577fe700 1 -- 172.21.15.35:0/2012487968 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60011cb0 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8e5842390 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.809+0000 7faa577fe700 1 -- 172.21.15.35:0/2012487968 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faa60017070 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa577fe700 1 -- 172.21.15.35:0/2012487968 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa60011e10 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 10 client.29186 fetch_fsmap learned FSMap version 88 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x55e8e56add80 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa577fe700 1 -- 172.21.15.35:0/2012487968 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e8e5842390 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa577fe700 1 -- 172.21.15.35:0/2012487968 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 88) v1 ==== 6973+0+0 (secure 0 0 0) 0x7faa6001e6e0 con 0x55e8e5932be0 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 10 client.29186 fetch_fsmap finished waiting for FSMap version 88 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 10 client.29186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 20 client.29186 populate_metadata read hostname 'smithi035' 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e5947220 0x55e8e5949630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 4 client.29186 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:06:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e8e584e600 con 0x55e8e5947220 2023-03-17T11:06:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.810+0000 7faa77fff700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e5947220 0x55e8e5949630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa577fe700 10 client.29186 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa77fff700 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e5947220 0x55e8e5949630 crc :-1 s=READY pgs=586 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45dad338ab584615 server_cookie=5556fe49af46bd87 in_seq=0 out_seq=0 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa577fe700 1 -- 172.21.15.35:0/2012487968 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e8e584e600 con 0x55e8e5947220 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa577fe700 10 client.29186 handle_command_reply: tid=0 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 client.29186 shutdown 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 msgr2=0x55e8e5936670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5936670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faa6000ba80 tx=0x7faa600047c0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 shutdown_connections 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e5947220 0x55e8e5949630 crc :-1 s=READY pgs=586 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e5936c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e59393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa577fe700 0 client.29186 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/2012487968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e5936670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.811+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 >> 172.21.15.35:0/2012487968 conn(0x55e8e578a6b0 msgr2=0x55e8e5927a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.812+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 shutdown_connections 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.812+0000 7faa8a41ab80 1 -- 172.21.15.35:0/2012487968 wait complete. 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.812+0000 7faa8a41ab80 20 client.29186 trim_cache size 0 max 16384 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 Processor -- start 2023-03-17T11:06:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 -- start start 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e592d960 0x55e8e592d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 0x55e8e5927ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e593df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e5932fb0 con 0x55e8e5932be0 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e59286f0 con 0x55e8e592d960 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.827+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e5928000 con 0x55e8e59334f0 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 0x55e8e5927ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 0x55e8e5927ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53492/0 (socket says 172.21.15.35:53492) 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 -- 172.21.15.35:0/301051194 learned_addr learned my addr 172.21.15.35:0/301051194 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa77fff700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e592d960 0x55e8e592d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 -- 172.21.15.35:0/301051194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 msgr2=0x55e8e593df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa7c82a700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e593df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e593df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 -- 172.21.15.35:0/301051194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e592d960 msgr2=0x55e8e592d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e592d960 0x55e8e592d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 -- 172.21.15.35:0/301051194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8e5846130 con 0x55e8e5932be0 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa7c82a700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e593df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa77fff700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e592d960 0x55e8e592d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa777fe700 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 0x55e8e5927ac0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7faa6001eb30 tx=0x7faa60005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9123a4fd31bd888d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa6effd700 1 -- 172.21.15.35:0/301051194 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60011720 con 0x55e8e5932be0 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa6effd700 1 -- 172.21.15.35:0/301051194 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa60015070 con 0x55e8e5932be0 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.828+0000 7faa6effd700 1 -- 172.21.15.35:0/301051194 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60004d80 con 0x55e8e5932be0 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- 172.21.15.35:0/301051194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 msgr2=0x55e8e5927ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 0x55e8e5927ac0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7faa6001eb30 tx=0x7faa60005da0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- 172.21.15.35:0/301051194 shutdown_connections 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e59334f0 0x55e8e593df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e592d960 0x55e8e592d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/301051194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e5932be0 0x55e8e5927ac0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:31.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- 172.21.15.35:0/301051194 >> 172.21.15.35:0/301051194 conn(0x55e8e578a6b0 msgr2=0x55e8e5930840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- 172.21.15.35:0/301051194 shutdown_connections 2023-03-17T11:06:31.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- 172.21.15.35:0/301051194 wait complete. 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- start start 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 Processor -- start 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e592fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e592fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e592e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e592ed90 con 0x55e8e59334f0 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e592ef00 con 0x55e8e5932be0 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.829+0000 7faa8a41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8e592f0c0 con 0x55e8e592d960 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e592e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa8a41ab80 10 client.0 _ll_register_callbacks cb 0x55e8e5725230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e592e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53500/0 (socket says 172.21.15.35:53500) 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 -- 172.21.15.35:0/1468801802 learned_addr learned my addr 172.21.15.35:0/1468801802 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa777fe700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e592fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa77fff700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e592fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 -- 172.21.15.35:0/1468801802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 msgr2=0x55e8e592fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e592fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 -- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 msgr2=0x55e8e592fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e592fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 -- 172.21.15.35:0/1468801802 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8e56add80 con 0x55e8e59334f0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa7c82a700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e592e6a0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7faa70011300 tx=0x7faa70007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fec6e7396df670f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa577fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa577fe700 1 -- 172.21.15.35:0/1468801802 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000e040 con 0x55e8e59334f0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8e58fd1e0 con 0x55e8e59334f0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa577fe700 1 -- 172.21.15.35:0/1468801802 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(307..307 src has 1..307) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faa700092e0 con 0x55e8e59334f0 2023-03-17T11:06:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa577fe700 1 -- 172.21.15.35:0/1468801802 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa70006000 con 0x55e8e59334f0 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa8a41ab80 10 client.20031 fetch_fsmap learned FSMap version 88 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.830+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x55e8e56d41f0 con 0x55e8e59334f0 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa577fe700 1 -- 172.21.15.35:0/1468801802 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e8e58fd1e0 con 0x55e8e59334f0 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa577fe700 1 -- 172.21.15.35:0/1468801802 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 88) v1 ==== 6973+0+0 (secure 0 0 0) 0x7faa700277d0 con 0x55e8e59334f0 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa8a41ab80 10 client.20031 fetch_fsmap finished waiting for FSMap version 88 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa8a41ab80 10 client.20031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa8a41ab80 20 client.20031 populate_metadata read hostname 'smithi035' 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e59939d0 0x55e8e5995de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa8a41ab80 4 client.20031 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e8e5703f00 con 0x55e8e59939d0 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.831+0000 7faa77fff700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e59939d0 0x55e8e5995de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.832+0000 7faa577fe700 10 client.20031 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.832+0000 7faa77fff700 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e59939d0 0x55e8e5995de0 crc :-1 s=READY pgs=587 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a002362c625ede09 server_cookie=d26852bc348186a8 in_seq=0 out_seq=0 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa577fe700 1 -- 172.21.15.35:0/1468801802 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e8e5703f00 con 0x55e8e59939d0 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa577fe700 10 client.20031 handle_command_reply: tid=0 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 client.20031 shutdown 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 msgr2=0x55e8e592e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e592e6a0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7faa70011300 tx=0x7faa70007bc0 comp rx=0 tx=0).stop 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 shutdown_connections 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e8e59939d0 0x55e8e5995de0 crc :-1 s=READY pgs=587 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e8e59334f0 0x55e8e592e6a0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8e592d960 0x55e8e592fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 --2- 172.21.15.35:0/1468801802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8e5932be0 0x55e8e592fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa577fe700 0 client.20031 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 >> 172.21.15.35:0/1468801802 conn(0x55e8e578a6b0 msgr2=0x55e8e5937f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 shutdown_connections 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 1 -- 172.21.15.35:0/1468801802 wait complete. 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.849+0000 7faa8a41ab80 20 client.20031 trim_cache size 0 max 16384 2023-03-17T11:06:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faa6409f640 msgr2=0x7faa640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faa6409f640 0x7faa640a1af0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faa78197880 tx=0x7faa6000b410 comp rx=0 tx=0).stop 2023-03-17T11:06:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 msgr2=0x7faa78196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78196270 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7faa68000c00 tx=0x7faa68005f10 comp rx=0 tx=0).stop 2023-03-17T11:06:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 shutdown_connections 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:42 smithi035 ceph-mon[92535]: pgmap v4298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:44 smithi035 ceph-mon[92535]: pgmap v4299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:46 smithi035 ceph-mon[92535]: pgmap v4300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:47 smithi035 ceph-mon[92535]: pgmap v4301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:47 smithi035 ceph-mon[92535]: pgmap v4302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:49 smithi035 ceph-mon[92535]: pgmap v4303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:51 smithi035 ceph-mon[92535]: pgmap v4304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:52 smithi035 ceph-mon[92535]: pgmap v4305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:55 smithi035 ceph-mon[92535]: pgmap v4306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:57 smithi035 ceph-mon[92535]: pgmap v4307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T11:06:35.599 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:56:59 smithi035 ceph-mon[92535]: pgmap v4308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:06:35.600 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:01 smithi035 ceph-mon[92535]: pgmap v4309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:06:37.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:02 smithi035 ceph-mon[92535]: pgmap v4310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T11:06:37.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:05 smithi035 ceph-mon[92535]: pgmap v4311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T11:06:37.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:07 smithi035 ceph-mon[92535]: pgmap v4312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T11:06:37.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:09 smithi035 ceph-mon[92535]: pgmap v4313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T11:06:37.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:09 smithi035 ceph-mon[92535]: osdmap e342: 12 total, 12 up, 12 in 2023-03-17T11:06:37.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:11 smithi035 ceph-mon[92535]: pgmap v4315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 59 KiB/s wr, 29 op/s 2023-03-17T11:06:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:06:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:06:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:06:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:06:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:06:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:06:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:06:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:06:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:06:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:06:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:06:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:06:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faa6409f640 0x7faa640a1af0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa78105490 0x7faa7819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:38.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faa78100450 0x7faa78196270 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 --2- 172.21.15.35:0/2313048179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa78100df0 0x7faa781967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 >> 172.21.15.35:0/2313048179 conn(0x7faa780fbca0 msgr2=0x7faa780fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 shutdown_connections 2023-03-17T11:06:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:40:05.850+0000 7faa7e28d700 1 -- 172.21.15.35:0/2313048179 wait complete. 2023-03-17T11:06:39.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 -- 172.21.15.35:0/761959864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 msgr2=0x7ff02810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/761959864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff02810bf60 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7ff02000b0d0 tx=0x7ff02000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 -- 172.21.15.35:0/761959864 shutdown_connections 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/761959864 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff02810bf60 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/761959864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0280ff350 0x7ff0280ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/761959864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0280ffcf0 0x7ff028103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.065+0000 7ff02ed0d700 1 -- 172.21.15.35:0/761959864 >> 172.21.15.35:0/761959864 conn(0x7ff028076330 msgr2=0x7ff028076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 -- 172.21.15.35:0/761959864 shutdown_connections 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 -- 172.21.15.35:0/761959864 wait complete. 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 Processor -- start 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 -- start start 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0280ff350 0x7ff028195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0280ffcf0 0x7ff0281957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff028199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02819a250 con 0x7ff028104390 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02819a3c0 con 0x7ff0280ffcf0 2023-03-17T11:06:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.066+0000 7ff02ed0d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02819a580 con 0x7ff0280ff350 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff028199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff028199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53512/0 (socket says 172.21.15.35:53512) 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 -- 172.21.15.35:0/4206768414 learned_addr learned my addr 172.21.15.35:0/4206768414 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02caa9700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0280ff350 0x7ff028195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff027fff700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0280ffcf0 0x7ff0281957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 -- 172.21.15.35:0/4206768414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0280ff350 msgr2=0x7ff028195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0280ff350 0x7ff028195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 -- 172.21.15.35:0/4206768414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0280ffcf0 msgr2=0x7ff0281957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0280ffcf0 0x7ff0281957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 -- 172.21.15.35:0/4206768414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020009d00 con 0x7ff028104390 2023-03-17T11:06:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff028199c10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff020009380 tx=0x7ff0200093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff025ffb700 1 -- 172.21.15.35:0/4206768414 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000e040 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff025ffb700 1 -- 172.21.15.35:0/4206768414 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff020003e10 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02810f010 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.067+0000 7ff025ffb700 1 -- 172.21.15.35:0/4206768414 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02001ba00 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.068+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02810ee80 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.070+0000 7ff025ffb700 1 -- 172.21.15.35:0/4206768414 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff020024400 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.071+0000 7ff025ffb700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff01809f640 0x7ff0180a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.071+0000 7ff025ffb700 1 -- 172.21.15.35:0/4206768414 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(312..312 src has 1..312) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff0200cbeb0 con 0x7ff028104390 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.071+0000 7ff02caa9700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff01809f640 0x7ff0180a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff02caa9700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff01809f640 0x7ff0180a1af0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff01c005950 tx=0x7ff01c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 Processor -- start 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 -- start start 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab531d90 0x55dcab532160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab52c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab52cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab431010 con 0x55dcab52cb70 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab483950 con 0x55dcab5326a0 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab47cde0 con 0x55dcab531d90 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff02d2aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab52cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff02d2aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab52cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53520/0 (socket says 172.21.15.35:53520) 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff02d2aa700 1 -- 172.21.15.35:0/856889489 learned_addr learned my addr 172.21.15.35:0/856889489 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff02caa9700 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab531d90 0x55dcab532160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.072+0000 7ff027fff700 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab52c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02d2aa700 1 -- 172.21.15.35:0/856889489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab531d90 msgr2=0x55dcab532160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab531d90 0x55dcab532160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02d2aa700 1 -- 172.21.15.35:0/856889489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 msgr2=0x55dcab52c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab52c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02d2aa700 1 -- 172.21.15.35:0/856889489 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcab2fe5d0 con 0x55dcab52cb70 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02caa9700 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab531d90 0x55dcab532160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab52cfc0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff0200963d0 tx=0x7ff02000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b8754f735d595b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff012ffd700 1 -- 172.21.15.35:0/856889489 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200a1ac0 con 0x55dcab52cb70 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff012ffd700 1 -- 172.21.15.35:0/856889489 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff020096070 con 0x55dcab52cb70 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.073+0000 7ff012ffd700 1 -- 172.21.15.35:0/856889489 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020099100 con 0x55dcab52cb70 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/856889489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 msgr2=0x55dcab52cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab52cfc0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff0200963d0 tx=0x7ff02000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/856889489 shutdown_connections 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab52cfc0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab531d90 0x55dcab532160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/856889489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab52c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/856889489 >> 172.21.15.35:0/856889489 conn(0x55dcab3876b0 msgr2=0x55dcab524a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/856889489 shutdown_connections 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/856889489 wait complete. 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 -- start start 2023-03-17T11:06:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.074+0000 7ff03ae9ab80 1 Processor -- start 2023-03-17T11:06:41.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab538650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 0x55dcab535940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab535fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab3008c0 con 0x55dcab531d90 2023-03-17T11:06:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab536750 con 0x55dcab5326a0 2023-03-17T11:06:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab541fd0 con 0x55dcab52cb70 2023-03-17T11:06:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff03ae9ab80 10 client.0 _ll_register_callbacks cb 0x55dcab322230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:06:44.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 0x55dcab535940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 0x55dcab535940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53524/0 (socket says 172.21.15.35:53524) 2023-03-17T11:06:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 -- 172.21.15.35:0/3209163051 learned_addr learned my addr 172.21.15.35:0/3209163051 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff02caa9700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab538650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab535fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 -- 172.21.15.35:0/3209163051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 msgr2=0x55dcab538650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab538650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 -- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 msgr2=0x55dcab535fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab535fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 -- 172.21.15.35:0/3209163051 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02810ee80 con 0x55dcab531d90 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff027fff700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 0x55dcab535940 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff01400fe50 tx=0x7ff0140116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a208ee5569add8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.075+0000 7ff007fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff007fff700 1 -- 172.21.15.35:0/3209163051 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014011ee0 con 0x55dcab531d90 2023-03-17T11:06:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff007fff700 1 -- 172.21.15.35:0/3209163051 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(312..312 src has 1..312) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff014018070 con 0x55dcab531d90 2023-03-17T11:06:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcab43f390 con 0x55dcab531d90 2023-03-17T11:06:47.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff007fff700 1 -- 172.21.15.35:0/3209163051 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff014004a30 con 0x55dcab531d90 2023-03-17T11:06:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 10 client.20043 fetch_fsmap learned FSMap version 101 2023-03-17T11:06:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=4+}) v3 -- 0x55dcab2aad80 con 0x55dcab531d90 2023-03-17T11:06:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff007fff700 1 -- 172.21.15.35:0/3209163051 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dcab43f390 con 0x55dcab531d90 2023-03-17T11:06:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff007fff700 1 -- 172.21.15.35:0/3209163051 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 101) v1 ==== 6921+0+0 (secure 0 0 0) 0x7ff014023070 con 0x55dcab531d90 2023-03-17T11:06:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 10 client.20043 fetch_fsmap finished waiting for FSMap version 101 2023-03-17T11:06:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 10 client.20043 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 20 client.20043 populate_metadata read hostname 'smithi035' 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab546220 0x55dcab548630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 4 client.20043 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcab44b600 con 0x55dcab546220 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.076+0000 7ff02caa9700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab546220 0x55dcab548630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.077+0000 7ff007fff700 10 client.20043 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.077+0000 7ff02caa9700 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab546220 0x55dcab548630 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24996c8296e0ce10 server_cookie=58fafcef27fd0d9a in_seq=0 out_seq=0 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff007fff700 1 -- 172.21.15.35:0/3209163051 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55dcab44b600 con 0x55dcab546220 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff007fff700 10 client.20043 handle_command_reply: tid=0 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 client.20043 shutdown 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 msgr2=0x55dcab535940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 0x55dcab535940 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff01400fe50 tx=0x7ff0140116c0 comp rx=0 tx=0).stop 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 shutdown_connections 2023-03-17T11:06:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab546220 0x55dcab548630 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab5326a0 0x55dcab535fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff007fff700 0 client.20043 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:06:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab538650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3209163051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab531d90 0x55dcab535940 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 >> 172.21.15.35:0/3209163051 conn(0x55dcab3876b0 msgr2=0x55dcab529410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 shutdown_connections 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3209163051 wait complete. 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.078+0000 7ff03ae9ab80 20 client.20043 trim_cache size 0 max 16384 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 Processor -- start 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 -- start start 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab524ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab53cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 0x55dcab529410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab525be0 con 0x55dcab5326a0 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab536a50 con 0x55dcab531d90 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab525dd0 con 0x55dcab52cb70 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 0x55dcab529410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 0x55dcab529410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53534/0 (socket says 172.21.15.35:53534) 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 -- 172.21.15.35:0/3325971865 learned_addr learned my addr 172.21.15.35:0/3325971865 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02caa9700 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab524ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff027fff700 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab53cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 -- 172.21.15.35:0/3325971865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 msgr2=0x55dcab524ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab524ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 -- 172.21.15.35:0/3325971865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 msgr2=0x55dcab53cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab53cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.093+0000 7ff02d2aa700 1 -- 172.21.15.35:0/3325971865 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcab52d210 con 0x55dcab5326a0 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 0x55dcab529410 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff020099660 tx=0x7ff020009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b30ea3083fc39b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff0137fe700 1 -- 172.21.15.35:0/3325971865 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0200a1ac0 con 0x55dcab5326a0 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff0137fe700 1 -- 172.21.15.35:0/3325971865 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff020097d00 con 0x55dcab5326a0 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff0137fe700 1 -- 172.21.15.35:0/3325971865 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020099e20 con 0x55dcab5326a0 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3325971865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 msgr2=0x55dcab529410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 0x55dcab529410 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff020099660 tx=0x7ff020009c70 comp rx=0 tx=0).stop 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3325971865 shutdown_connections 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab5326a0 0x55dcab529410 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab52cb70 0x55dcab524ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/3325971865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab53cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3325971865 >> 172.21.15.35:0/3325971865 conn(0x55dcab3876b0 msgr2=0x55dcab5263d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3325971865 shutdown_connections 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.094+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/3325971865 wait complete. 2023-03-17T11:06:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 -- start start 2023-03-17T11:06:54.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:12 smithi035 ceph-mon[92535]: pgmap v4316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T11:06:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 Processor -- start 2023-03-17T11:06:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab538f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab539470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab5326a0 0x55dcab5399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:06:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab59b470 con 0x55dcab52cb70 2023-03-17T11:06:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab59b5b0 con 0x55dcab531d90 2023-03-17T11:06:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcab59b770 con 0x55dcab5326a0 2023-03-17T11:06:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff03ae9ab80 10 client.0 _ll_register_callbacks cb 0x55dcab322230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:06:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff02caa9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab538f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff02caa9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab538f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53536/0 (socket says 172.21.15.35:53536) 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff02caa9700 1 -- 172.21.15.35:0/1067899764 learned_addr learned my addr 172.21.15.35:0/1067899764 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff027fff700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab539470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.095+0000 7ff02d2aa700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab5326a0 0x55dcab5399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff02caa9700 1 -- 172.21.15.35:0/1067899764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab5326a0 msgr2=0x55dcab5399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff02caa9700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab5326a0 0x55dcab5399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff02caa9700 1 -- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 msgr2=0x55dcab539470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff02caa9700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab539470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff02caa9700 1 -- 172.21.15.35:0/1067899764 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcab2fe5d0 con 0x55dcab52cb70 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff02caa9700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab538f30 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x55dcab548ed0 tx=0x7ff01c013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2a89a468bd213 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff007fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff007fff700 1 -- 172.21.15.35:0/1067899764 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c027040 con 0x55dcab52cb70 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff007fff700 1 -- 172.21.15.35:0/1067899764 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(312..312 src has 1..312) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff01c017070 con 0x55dcab52cb70 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcab4fa1e0 con 0x55dcab52cb70 2023-03-17T11:06:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff007fff700 1 -- 172.21.15.35:0/1067899764 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff01c0273a0 con 0x55dcab52cb70 2023-03-17T11:06:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff03ae9ab80 10 client.20049 fetch_fsmap learned FSMap version 101 2023-03-17T11:06:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=4+}) v3 -- 0x55dcab293c00 con 0x55dcab52cb70 2023-03-17T11:06:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.096+0000 7ff007fff700 1 -- 172.21.15.35:0/1067899764 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dcab4fa1e0 con 0x55dcab52cb70 2023-03-17T11:06:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff007fff700 1 -- 172.21.15.35:0/1067899764 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 101) v1 ==== 6921+0+0 (secure 0 0 0) 0x7ff01c02d020 con 0x55dcab52cb70 2023-03-17T11:06:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff03ae9ab80 10 client.20049 fetch_fsmap finished waiting for FSMap version 101 2023-03-17T11:06:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff03ae9ab80 10 client.20049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:06:59.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff03ae9ab80 20 client.20049 populate_metadata read hostname 'smithi035' 2023-03-17T11:07:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab59cec0 0x55dcab59f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff03ae9ab80 4 client.20049 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:07:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dcab300f00 con 0x55dcab59cec0 2023-03-17T11:07:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff027fff700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab59cec0 0x55dcab59f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff027fff700 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab59cec0 0x55dcab59f2d0 crc :-1 s=READY pgs=589 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b88f8838ccaee4 server_cookie=59e67b26eda5f116 in_seq=0 out_seq=0 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.097+0000 7ff007fff700 10 client.20049 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff007fff700 1 -- 172.21.15.35:0/1067899764 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dcab300f00 con 0x55dcab59cec0 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff007fff700 10 client.20049 handle_command_reply: tid=0 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 client.20049 shutdown 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 msgr2=0x55dcab538f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab538f30 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x55dcab548ed0 tx=0x7ff01c013070 comp rx=0 tx=0).stop 2023-03-17T11:07:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 shutdown_connections 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dcab59cec0 0x55dcab59f2d0 crc :-1 s=READY pgs=589 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dcab5326a0 0x55dcab5399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff007fff700 0 client.20049 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dcab52cb70 0x55dcab538f30 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 --2- 172.21.15.35:0/1067899764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dcab531d90 0x55dcab539470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 >> 172.21.15.35:0/1067899764 conn(0x55dcab3876b0 msgr2=0x55dcab529410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.115+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 shutdown_connections 2023-03-17T11:07:02.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff03ae9ab80 1 -- 172.21.15.35:0/1067899764 wait complete. 2023-03-17T11:07:02.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff03ae9ab80 20 client.20049 trim_cache size 0 max 16384 2023-03-17T11:07:02.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff01809f640 msgr2=0x7ff0180a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff01809f640 0x7ff0180a1af0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff01c005950 tx=0x7ff01c00b410 comp rx=0 tx=0).stop 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 msgr2=0x7ff028199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff028199c10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff020009380 tx=0x7ff0200093b0 comp rx=0 tx=0).stop 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 shutdown_connections 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff01809f640 0x7ff0180a1af0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff028104390 0x7ff028199c10 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0280ff350 0x7ff028195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 --2- 172.21.15.35:0/4206768414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0280ffcf0 0x7ff0281957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 >> 172.21.15.35:0/4206768414 conn(0x7ff028076330 msgr2=0x7ff028102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 shutdown_connections 2023-03-17T11:07:04.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:16.116+0000 7ff02ed0d700 1 -- 172.21.15.35:0/4206768414 wait complete. 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 -- 172.21.15.35:0/4280364096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b8100be0 msgr2=0x7fe4b8100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/4280364096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b8100be0 0x7fe4b8100fb0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00099c0 tx=0x7fe4a0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 -- 172.21.15.35:0/4280364096 shutdown_connections 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/4280364096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b81054f0 0x7fe4b810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/4280364096 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b8100be0 0x7fe4b8100fb0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/4280364096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b8101580 0x7fe4b8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 -- 172.21.15.35:0/4280364096 >> 172.21.15.35:0/4280364096 conn(0x7fe4b80774e0 msgr2=0x7fe4b80778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 -- 172.21.15.35:0/4280364096 shutdown_connections 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.239+0000 7fe4bcc90700 1 -- 172.21.15.35:0/4280364096 wait complete. 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 Processor -- start 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 -- start start 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b8100be0 0x7fe4b8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b8101580 0x7fe4b8196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 0x7fe4b819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:04.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b819b230 con 0x7fe4b81054f0 2023-03-17T11:07:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b819b3a0 con 0x7fe4b8101580 2023-03-17T11:07:06.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4bcc90700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b819b560 con 0x7fe4b8100be0 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 0x7fe4b819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 0x7fe4b819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53554/0 (socket says 172.21.15.35:53554) 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/3871630133 learned_addr learned my addr 172.21.15.35:0/3871630133 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.240+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b8101580 0x7fe4b8196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b659c700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b8100be0 0x7fe4b8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/3871630133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b8100be0 msgr2=0x7fe4b8196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b8100be0 0x7fe4b8196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/3871630133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b8101580 msgr2=0x7fe4b8196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b8101580 0x7fe4b8196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/3871630133 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00095f0 con 0x7fe4b81054f0 2023-03-17T11:07:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 0x7fe4b819abf0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0007ee0 tx=0x7fe4b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4af7fe700 1 -- 172.21.15.35:0/3871630133 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0017070 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4af7fe700 1 -- 172.21.15.35:0/3871630133 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4b000f040 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b81101a0 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4af7fe700 1 -- 172.21.15.35:0/3871630133 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0005570 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.241+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b8110010 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.244+0000 7fe4af7fe700 1 -- 172.21.15.35:0/3871630133 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe4b000db20 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.245+0000 7fe4af7fe700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe4a409f6c0 0x7fe4a40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.245+0000 7fe4af7fe700 1 -- 172.21.15.35:0/3871630133 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe4b00c9c80 con 0x7fe4b81054f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.245+0000 7fe4b659c700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe4a409f6c0 0x7fe4a40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.245+0000 7fe4b659c700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe4a409f6c0 0x7fe4a40a1b70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000b580 tx=0x7fe4a0009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.245+0000 7fe4c8e1db80 1 Processor -- start 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 -- start start 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76cf960 0x5604a76cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a75d6010 con 0x5604a76d54f0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a7628950 con 0x5604a76d4be0 2023-03-17T11:07:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a7621de0 con 0x5604a76cf960 2023-03-17T11:07:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53560/0 (socket says 172.21.15.35:53560) 2023-03-17T11:07:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 -- 172.21.15.35:0/3511952556 learned_addr learned my addr 172.21.15.35:0/3511952556 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76cf960 0x5604a76cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b659c700 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 -- 172.21.15.35:0/3511952556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76cf960 msgr2=0x5604a76cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76cf960 0x5604a76cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 -- 172.21.15.35:0/3511952556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 msgr2=0x5604a76d4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76d4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.246+0000 7fe4b5d9b700 1 -- 172.21.15.35:0/3511952556 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604a74a35d0 con 0x5604a76d54f0 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76cf420 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800bcb0 tx=0x7fe4a80103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6f9bd1c902e50 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4acff9700 1 -- 172.21.15.35:0/3511952556 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8010d10 con 0x5604a76d54f0 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4acff9700 1 -- 172.21.15.35:0/3511952556 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4a8015070 con 0x5604a76d54f0 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4acff9700 1 -- 172.21.15.35:0/3511952556 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8004e70 con 0x5604a76d54f0 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/3511952556 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 msgr2=0x5604a76cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76cf420 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800bcb0 tx=0x7fe4a80103d0 comp rx=0 tx=0).stop 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/3511952556 shutdown_connections 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76cf960 0x5604a76cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76d4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/3511952556 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76cf420 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.247+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/3511952556 >> 172.21.15.35:0/3511952556 conn(0x5604a752c6b0 msgr2=0x5604a76c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.248+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/3511952556 shutdown_connections 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.248+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/3511952556 wait complete. 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.248+0000 7fe4c8e1db80 1 -- start start 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.248+0000 7fe4c8e1db80 1 Processor -- start 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76db440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76d86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d54f0 0x5604a76d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a74a58c0 con 0x5604a76cf960 2023-03-17T11:07:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76d9460 con 0x5604a76d54f0 2023-03-17T11:07:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76e5000 con 0x5604a76d4be0 2023-03-17T11:07:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 10 client.0 _ll_register_callbacks cb 0x5604a74c7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:07:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:10.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76db440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53564/0 (socket says 172.21.15.35:53564) 2023-03-17T11:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 -- 172.21.15.35:0/2836424788 learned_addr learned my addr 172.21.15.35:0/2836424788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76d86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d54f0 0x5604a76d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 -- 172.21.15.35:0/2836424788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 msgr2=0x5604a76d86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76d86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 -- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d54f0 msgr2=0x5604a76d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d54f0 0x5604a76d8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 -- 172.21.15.35:0/2836424788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a800b8e0 con 0x5604a76cf960 2023-03-17T11:07:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d54f0 0x5604a76d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:07:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4b659c700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76db440 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0015000 tx=0x7fe4a001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a9fb22d6a8448c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe49dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:07:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe49dffb700 1 -- 172.21.15.35:0/2836424788 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000be70 con 0x5604a76cf960 2023-03-17T11:07:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe49dffb700 1 -- 172.21.15.35:0/2836424788 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe4a0004ba0 con 0x5604a76cf960 2023-03-17T11:07:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.249+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604a75e4390 con 0x5604a76cf960 2023-03-17T11:07:12.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe49dffb700 1 -- 172.21.15.35:0/2836424788 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a0004da0 con 0x5604a76cf960 2023-03-17T11:07:12.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:15 smithi035 ceph-mon[92535]: pgmap v4317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T11:07:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 10 client.20061 fetch_fsmap learned FSMap version 102 2023-03-17T11:07:12.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5604a744fd80 con 0x5604a76cf960 2023-03-17T11:07:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe49dffb700 1 -- 172.21.15.35:0/2836424788 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604a75e4390 con 0x5604a76cf960 2023-03-17T11:07:12.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe49dffb700 1 -- 172.21.15.35:0/2836424788 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe4a000f460 con 0x5604a76cf960 2023-03-17T11:07:14.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 10 client.20061 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:07:14.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 10 client.20061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:07:14.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 20 client.20061 populate_metadata read hostname 'smithi035' 2023-03-17T11:07:14.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a76e90e0 0x5604a76eb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 4 client.20061 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:07:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604a75f0600 con 0x5604a76e90e0 2023-03-17T11:07:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.250+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a76e90e0 0x5604a76eb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe49dffb700 10 client.20061 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a76e90e0 0x5604a76eb4f0 crc :-1 s=READY pgs=590 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ecae8ea9bd8aab4 server_cookie=fd5acf02b43235e2 in_seq=0 out_seq=0 2023-03-17T11:07:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe49dffb700 1 -- 172.21.15.35:0/2836424788 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5604a75f0600 con 0x5604a76e90e0 2023-03-17T11:07:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe49dffb700 10 client.20061 handle_command_reply: tid=0 2023-03-17T11:07:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe4c8e1db80 1 client.20061 shutdown 2023-03-17T11:07:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 msgr2=0x5604a76db440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:15.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.251+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76db440 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0015000 tx=0x7fe4a001a050 comp rx=0 tx=0).stop 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 shutdown_connections 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a76e90e0 0x5604a76eb4f0 crc :-1 s=READY pgs=590 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d54f0 0x5604a76d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe49dffb700 0 client.20061 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76db440 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/2836424788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76d86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 >> 172.21.15.35:0/2836424788 conn(0x5604a752c6b0 msgr2=0x5604a76ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 shutdown_connections 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/2836424788 wait complete. 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.252+0000 7fe4c8e1db80 20 client.20061 trim_cache size 0 max 16384 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.266+0000 7fe4c8e1db80 1 Processor -- start 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.266+0000 7fe4c8e1db80 1 -- start start 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76cf960 0x5604a76dff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:15.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76c50f0 con 0x5604a76d54f0 2023-03-17T11:07:15.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76d9670 con 0x5604a76cf960 2023-03-17T11:07:15.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76ca6d0 con 0x5604a76d4be0 2023-03-17T11:07:15.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:15.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53576/0 (socket says 172.21.15.35:53576) 2023-03-17T11:07:15.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/1185202354 learned_addr learned my addr 172.21.15.35:0/1185202354 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:18.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:18.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b659c700 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76cf960 0x5604a76dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/1185202354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 msgr2=0x5604a76dafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76dafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/1185202354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76cf960 msgr2=0x5604a76dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76cf960 0x5604a76dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:20.046 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 -- 172.21.15.35:0/1185202354 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604a75e8130 con 0x5604a76d54f0 2023-03-17T11:07:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76d26b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0093c30 tx=0x7fe4b00c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef9594b4cc63638 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.267+0000 7fe4ad7fa700 1 -- 172.21.15.35:0/1185202354 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0004c40 con 0x5604a76d54f0 2023-03-17T11:07:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4ad7fa700 1 -- 172.21.15.35:0/1185202354 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4b0097730 con 0x5604a76d54f0 2023-03-17T11:07:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4ad7fa700 1 -- 172.21.15.35:0/1185202354 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0097bf0 con 0x5604a76d54f0 2023-03-17T11:07:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/1185202354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 msgr2=0x5604a76d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76d26b0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0093c30 tx=0x7fe4b00c9040 comp rx=0 tx=0).stop 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/1185202354 shutdown_connections 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76d54f0 0x5604a76d26b0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76cf960 0x5604a76dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/1185202354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d4be0 0x5604a76dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/1185202354 >> 172.21.15.35:0/1185202354 conn(0x5604a752c6b0 msgr2=0x5604a76cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/1185202354 shutdown_connections 2023-03-17T11:07:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/1185202354 wait complete. 2023-03-17T11:07:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.268+0000 7fe4c8e1db80 1 -- start start 2023-03-17T11:07:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 Processor -- start 2023-03-17T11:07:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76dfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76de060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d54f0 0x5604a76de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76deae0 con 0x5604a76cf960 2023-03-17T11:07:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76dec50 con 0x5604a76d4be0 2023-03-17T11:07:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a76dee10 con 0x5604a76d54f0 2023-03-17T11:07:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4c8e1db80 10 client.0 _ll_register_callbacks cb 0x5604a74c7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:07:24.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76dfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76dfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53578/0 (socket says 172.21.15.35:53578) 2023-03-17T11:07:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 -- 172.21.15.35:0/9510360 learned_addr learned my addr 172.21.15.35:0/9510360 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b6d9d700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d54f0 0x5604a76de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 -- 172.21.15.35:0/9510360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d54f0 msgr2=0x5604a76de5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d54f0 0x5604a76de5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 -- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 msgr2=0x5604a76de060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76de060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 -- 172.21.15.35:0/9510360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b8110010 con 0x5604a76cf960 2023-03-17T11:07:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe4b659c700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76dfd30 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000f870 tx=0x7fe4a000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfaac6966b094d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.269+0000 7fe49dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe49dffb700 1 -- 172.21.15.35:0/9510360 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000be70 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe49dffb700 1 -- 172.21.15.35:0/9510360 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe4a0004db0 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604a769f1e0 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe49dffb700 1 -- 172.21.15.35:0/9510360 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a0005bc0 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 10 client.20067 fetch_fsmap learned FSMap version 102 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5604a74761f0 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe49dffb700 1 -- 172.21.15.35:0/9510360 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604a769f1e0 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe49dffb700 1 -- 172.21.15.35:0/9510360 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe4a000bae0 con 0x5604a76cf960 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 10 client.20067 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 10 client.20067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:07:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 20 client.20067 populate_metadata read hostname 'smithi035' 2023-03-17T11:07:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a773dee0 0x5604a77402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 4 client.20067 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:07:31.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5604a74a5f00 con 0x5604a773dee0 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.270+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a773dee0 0x5604a77402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.271+0000 7fe49dffb700 10 client.20067 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.271+0000 7fe4b5d9b700 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a773dee0 0x5604a77402f0 crc :-1 s=READY pgs=591 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60e1e82f9b1f17da server_cookie=73965d6c5b4745ac in_seq=0 out_seq=0 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe49dffb700 1 -- 172.21.15.35:0/9510360 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5604a74a5f00 con 0x5604a773dee0 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe49dffb700 10 client.20067 handle_command_reply: tid=0 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 client.20067 shutdown 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 msgr2=0x5604a76dfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76dfd30 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000f870 tx=0x7fe4a000fa00 comp rx=0 tx=0).stop 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 shutdown_connections 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5604a773dee0 0x5604a77402f0 crc :-1 s=READY pgs=591 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5604a76d54f0 0x5604a76de5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5604a76cf960 0x5604a76dfd30 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 --2- 172.21.15.35:0/9510360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5604a76d4be0 0x5604a76de060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe49dffb700 0 client.20067 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 >> 172.21.15.35:0/9510360 conn(0x5604a752c6b0 msgr2=0x5604a76d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 shutdown_connections 2023-03-17T11:07:31.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.282+0000 7fe4c8e1db80 1 -- 172.21.15.35:0/9510360 wait complete. 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4c8e1db80 20 client.20067 trim_cache size 0 max 16384 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe4a409f6c0 msgr2=0x7fe4a40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe4a409f6c0 0x7fe4a40a1b70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000b580 tx=0x7fe4a0009f10 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 msgr2=0x7fe4b819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 0x7fe4b819abf0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0007ee0 tx=0x7fe4b000d3b0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 shutdown_connections 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe4a409f6c0 0x7fe4a40a1b70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe4b81054f0 0x7fe4b819abf0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4b8100be0 0x7fe4b8196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 --2- 172.21.15.35:0/3871630133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b8101580 0x7fe4b8196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 >> 172.21.15.35:0/3871630133 conn(0x7fe4b80774e0 msgr2=0x7fe4b80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 shutdown_connections 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:29.283+0000 7fe4bcc90700 1 -- 172.21.15.35:0/3871630133 wait complete. 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 -- 172.21.15.35:0/1163078984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 msgr2=0x7fae1810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/1163078984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1810bf60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fae1000b0d0 tx=0x7fae1000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 -- 172.21.15.35:0/1163078984 shutdown_connections 2023-03-17T11:07:31.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/1163078984 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1810bf60 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/1163078984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae180ff350 0x7fae180ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/1163078984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae180ffcf0 0x7fae18103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 -- 172.21.15.35:0/1163078984 >> 172.21.15.35:0/1163078984 conn(0x7fae18076330 msgr2=0x7fae18076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 -- 172.21.15.35:0/1163078984 shutdown_connections 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.404+0000 7fae1ed2a700 1 -- 172.21.15.35:0/1163078984 wait complete. 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 Processor -- start 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 -- start start 2023-03-17T11:07:31.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae180ff350 0x7fae18198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae180ffcf0 0x7fae18198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1819d5f0 con 0x7fae18104390 2023-03-17T11:07:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1819d760 con 0x7fae180ffcf0 2023-03-17T11:07:33.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1ed2a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1819d920 con 0x7fae180ff350 2023-03-17T11:07:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1d2c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1d2c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1819cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53596/0 (socket says 172.21.15.35:53596) 2023-03-17T11:07:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae1d2c7700 1 -- 172.21.15.35:0/4101607797 learned_addr learned my addr 172.21.15.35:0/4101607797 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.405+0000 7fae17fff700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae180ffcf0 0x7fae18198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1cac6700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae180ff350 0x7fae18198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1d2c7700 1 -- 172.21.15.35:0/4101607797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae180ff350 msgr2=0x7fae18198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae180ff350 0x7fae18198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1d2c7700 1 -- 172.21.15.35:0/4101607797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae180ffcf0 msgr2=0x7fae18198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae180ffcf0 0x7fae18198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1d2c7700 1 -- 172.21.15.35:0/4101607797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae10009d00 con 0x7fae18104390 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1819cfb0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fae10008e50 tx=0x7fae10008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae15ffb700 1 -- 172.21.15.35:0/4101607797 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000e040 con 0x7fae18104390 2023-03-17T11:07:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae15ffb700 1 -- 172.21.15.35:0/4101607797 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae10003e90 con 0x7fae18104390 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1810efc0 con 0x7fae18104390 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae15ffb700 1 -- 172.21.15.35:0/4101607797 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1001b6c0 con 0x7fae18104390 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.406+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1810ee30 con 0x7fae18104390 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.409+0000 7fae15ffb700 1 -- 172.21.15.35:0/4101607797 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fae10003a00 con 0x7fae18104390 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.409+0000 7fae15ffb700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae0809f640 0x7fae080a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.409+0000 7fae15ffb700 1 -- 172.21.15.35:0/4101607797 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fae100cb7a0 con 0x7fae18104390 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.410+0000 7fae1cac6700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae0809f640 0x7fae080a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.410+0000 7fae1cac6700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae0809f640 0x7fae080a1af0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009bf0 tx=0x7fae0c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.410+0000 7fae2aeb7b80 1 Processor -- start 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.410+0000 7fae2aeb7b80 1 -- start start 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.410+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c32fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.410+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c2d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:35.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:17 smithi035 ceph-mon[92535]: pgmap v4318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T11:07:38.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:17 smithi035 ceph-mon[92535]: osdmap e343: 12 total, 12 up, 12 in 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c2dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1b34010 con 0x5598c1c2d960 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1b86950 con 0x5598c1c334f0 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1b7fde0 con 0x5598c1c32be0 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c2dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c2dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53604/0 (socket says 172.21.15.35:53604) 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 -- 172.21.15.35:0/209777505 learned_addr learned my addr 172.21.15.35:0/209777505 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae17fff700 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c2d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:38.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1cac6700 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c32fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:38.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 -- 172.21.15.35:0/209777505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 msgr2=0x5598c1c32fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:38.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c32fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 -- 172.21.15.35:0/209777505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 msgr2=0x5598c1c2d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c2d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 -- 172.21.15.35:0/209777505 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c1a015d0 con 0x5598c1c2d960 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c2dd90 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fae100a0eb0 tx=0x7fae10094f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5916e5c37832d6fe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae02ffd700 1 -- 172.21.15.35:0/209777505 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10098be0 con 0x5598c1c2d960 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae02ffd700 1 -- 172.21.15.35:0/209777505 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae10005290 con 0x5598c1c2d960 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.411+0000 7fae02ffd700 1 -- 172.21.15.35:0/209777505 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae100a1450 con 0x5598c1c2d960 2023-03-17T11:07:41.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/209777505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 msgr2=0x5598c1c2dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c2dd90 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fae100a0eb0 tx=0x7fae10094f20 comp rx=0 tx=0).stop 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/209777505 shutdown_connections 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c2dd90 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c32fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/209777505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c2d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/209777505 >> 172.21.15.35:0/209777505 conn(0x5598c1a8a6b0 msgr2=0x5598c1c27a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/209777505 shutdown_connections 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/209777505 wait complete. 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 -- start start 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.412+0000 7fae2aeb7b80 1 Processor -- start 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c36730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c36dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1a038c0 con 0x5598c1c2d960 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c37540 con 0x5598c1c334f0 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c42dd0 con 0x5598c1c32be0 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae2aeb7b80 10 client.0 _ll_register_callbacks cb 0x5598c1a25230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:07:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53606/0 (socket says 172.21.15.35:53606) 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 -- 172.21.15.35:0/3744319322 learned_addr learned my addr 172.21.15.35:0/3744319322 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c36dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae17fff700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c36730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 -- 172.21.15.35:0/3744319322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 msgr2=0x5598c1c36730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c36730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 -- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 msgr2=0x5598c1c36dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c36dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.413+0000 7fae1cac6700 1 -- 172.21.15.35:0/3744319322 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1810ee30 con 0x5598c1c2d960 2023-03-17T11:07:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae1cac6700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c394b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0128a0 tx=0x7fae0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d137977bec99a4f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fadf7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:07:44.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fadf7fff700 1 -- 172.21.15.35:0/3744319322 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c029630 con 0x5598c1c2d960 2023-03-17T11:07:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fadf7fff700 1 -- 172.21.15.35:0/3744319322 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fae0c018070 con 0x5598c1c2d960 2023-03-17T11:07:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598c1b42390 con 0x5598c1c2d960 2023-03-17T11:07:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fadf7fff700 1 -- 172.21.15.35:0/3744319322 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0c029790 con 0x5598c1c2d960 2023-03-17T11:07:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 10 client.20079 fetch_fsmap learned FSMap version 102 2023-03-17T11:07:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5598c19add80 con 0x5598c1c2d960 2023-03-17T11:07:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fadf7fff700 1 -- 172.21.15.35:0/3744319322 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598c1b42390 con 0x5598c1c2d960 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fadf7fff700 1 -- 172.21.15.35:0/3744319322 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fae0c0209d0 con 0x5598c1c2d960 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 10 client.20079 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 10 client.20079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 20 client.20079 populate_metadata read hostname 'smithi035' 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c46ff0 0x5598c1c49400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 4 client.20079 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.414+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598c1b4e600 con 0x5598c1c46ff0 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.415+0000 7fae17fff700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c46ff0 0x5598c1c49400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.415+0000 7fadf7fff700 10 client.20079 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.415+0000 7fae17fff700 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c46ff0 0x5598c1c49400 crc :-1 s=READY pgs=592 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf1ae732a22fe3c server_cookie=caf99240e1feea7b in_seq=0 out_seq=0 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fadf7fff700 1 -- 172.21.15.35:0/3744319322 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5598c1b4e600 con 0x5598c1c46ff0 2023-03-17T11:07:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fadf7fff700 10 client.20079 handle_command_reply: tid=0 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 client.20079 shutdown 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 msgr2=0x5598c1c394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c394b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0128a0 tx=0x7fae0c0047c0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 shutdown_connections 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c46ff0 0x5598c1c49400 crc :-1 s=READY pgs=592 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c334f0 0x5598c1c36dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c2d960 0x5598c1c394b0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/3744319322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c32be0 0x5598c1c36730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fadf7fff700 0 client.20079 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 >> 172.21.15.35:0/3744319322 conn(0x5598c1a8a6b0 msgr2=0x5598c1c2c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 shutdown_connections 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/3744319322 wait complete. 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.416+0000 7fae2aeb7b80 20 client.20079 trim_cache size 0 max 16384 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 Processor -- start 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 -- start start 2023-03-17T11:07:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c2d960 0x5598c1c3dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c32be0 0x5598c1c39050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 0x5598c1c306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c28530 con 0x5598c1c334f0 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c44620 con 0x5598c1c32be0 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.431+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c230d0 con 0x5598c1c2d960 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 0x5598c1c306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 0x5598c1c306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53618/0 (socket says 172.21.15.35:53618) 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 -- 172.21.15.35:0/787736801 learned_addr learned my addr 172.21.15.35:0/787736801 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae17fff700 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c32be0 0x5598c1c39050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1cac6700 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c2d960 0x5598c1c3dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 -- 172.21.15.35:0/787736801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c2d960 msgr2=0x5598c1c3dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c2d960 0x5598c1c3dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 -- 172.21.15.35:0/787736801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c32be0 msgr2=0x5598c1c39050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c32be0 0x5598c1c39050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 -- 172.21.15.35:0/787736801 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c1b46130 con 0x5598c1c334f0 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 0x5598c1c306b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fae1000b420 tx=0x7fae100cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e74c8d290876d7b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae037fe700 1 -- 172.21.15.35:0/787736801 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10098be0 con 0x5598c1c334f0 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae037fe700 1 -- 172.21.15.35:0/787736801 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae10005290 con 0x5598c1c334f0 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.432+0000 7fae037fe700 1 -- 172.21.15.35:0/787736801 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10003cb0 con 0x5598c1c334f0 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/787736801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 msgr2=0x5598c1c306b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 0x5598c1c306b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fae1000b420 tx=0x7fae100cb040 comp rx=0 tx=0).stop 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/787736801 shutdown_connections 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c334f0 0x5598c1c306b0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c2d960 0x5598c1c3dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/787736801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c32be0 0x5598c1c39050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/787736801 >> 172.21.15.35:0/787736801 conn(0x5598c1a8a6b0 msgr2=0x5598c1c2ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/787736801 shutdown_connections 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/787736801 wait complete. 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 -- start start 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.433+0000 7fae2aeb7b80 1 Processor -- start 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c2d960 0x5598c1c3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 0x5598c1c3c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c334f0 0x5598c1c99e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c9a390 con 0x5598c1c32be0 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c9a4d0 con 0x5598c1c2d960 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c1c9a610 con 0x5598c1c334f0 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae2aeb7b80 10 client.0 _ll_register_callbacks cb 0x5598c1a25230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 0x5598c1c3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 0x5598c1c3c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53622/0 (socket says 172.21.15.35:53622) 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 -- 172.21.15.35:0/453409446 learned_addr learned my addr 172.21.15.35:0/453409446 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae1d2c7700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c334f0 0x5598c1c99e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae1cac6700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c2d960 0x5598c1c3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 -- 172.21.15.35:0/453409446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c334f0 msgr2=0x5598c1c99e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c334f0 0x5598c1c99e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 -- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c2d960 msgr2=0x5598c1c3bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c2d960 0x5598c1c3bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 -- 172.21.15.35:0/453409446 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598c1a015d0 con 0x5598c1c32be0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae1cac6700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c2d960 0x5598c1c3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fae17fff700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 0x5598c1c3c470 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fae1806a350 tx=0x7fae04009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed2177b2ac2d3b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.434+0000 7fadf7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fadf7fff700 1 -- 172.21.15.35:0/453409446 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04016070 con 0x5598c1c32be0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fadf7fff700 1 -- 172.21.15.35:0/453409446 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fae0401f450 con 0x5598c1c32be0 2023-03-17T11:07:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598c1bfd1e0 con 0x5598c1c32be0 2023-03-17T11:07:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fadf7fff700 1 -- 172.21.15.35:0/453409446 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0401f610 con 0x5598c1c32be0 2023-03-17T11:07:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 10 client.20085 fetch_fsmap learned FSMap version 102 2023-03-17T11:07:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5598c19d41f0 con 0x5598c1c32be0 2023-03-17T11:07:50.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fadf7fff700 1 -- 172.21.15.35:0/453409446 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598c1bfd1e0 con 0x5598c1c32be0 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fadf7fff700 1 -- 172.21.15.35:0/453409446 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fae040105f0 con 0x5598c1c32be0 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 10 client.20085 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 10 client.20085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 20 client.20085 populate_metadata read hostname 'smithi035' 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c9be10 0x5598c1c9e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 4 client.20085 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5598c1a03f00 con 0x5598c1c9be10 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.435+0000 7fae1cac6700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c9be10 0x5598c1c9e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.436+0000 7fae1cac6700 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c9be10 0x5598c1c9e220 crc :-1 s=READY pgs=593 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd3701f557ea00be server_cookie=a53c75ed33d51430 in_seq=0 out_seq=0 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.436+0000 7fadf7fff700 10 client.20085 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fadf7fff700 1 -- 172.21.15.35:0/453409446 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5598c1a03f00 con 0x5598c1c9be10 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fadf7fff700 10 client.20085 handle_command_reply: tid=0 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 client.20085 shutdown 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 msgr2=0x5598c1c3c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 0x5598c1c3c470 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fae1806a350 tx=0x7fae04009b10 comp rx=0 tx=0).stop 2023-03-17T11:07:50.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 shutdown_connections 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598c1c9be10 0x5598c1c9e220 crc :-1 s=READY pgs=593 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598c1c334f0 0x5598c1c99e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5598c1c2d960 0x5598c1c3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fae2aeb7b80 1 --2- 172.21.15.35:0/453409446 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5598c1c32be0 0x5598c1c3c470 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.445+0000 7fadf7fff700 0 client.20085 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 >> 172.21.15.35:0/453409446 conn(0x5598c1a8a6b0 msgr2=0x5598c1c306b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 shutdown_connections 2023-03-17T11:07:50.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae2aeb7b80 1 -- 172.21.15.35:0/453409446 wait complete. 2023-03-17T11:07:50.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:19 smithi035 ceph-mon[92535]: pgmap v4320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2023-03-17T11:07:51.677 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:21 smithi035 ceph-mon[92535]: pgmap v4321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:07:51.677 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:22 smithi035 ceph-mon[92535]: pgmap v4322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:07:52.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:25 smithi035 ceph-mon[92535]: pgmap v4323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:07:52.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:27 smithi035 ceph-mon[92535]: pgmap v4324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:29 smithi035 ceph-mon[92535]: pgmap v4325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:31 smithi035 ceph-mon[92535]: pgmap v4326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:32 smithi035 ceph-mon[92535]: pgmap v4327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:35 smithi035 ceph-mon[92535]: pgmap v4328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:37 smithi035 ceph-mon[92535]: pgmap v4329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:39 smithi035 ceph-mon[92535]: pgmap v4330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:41 smithi035 ceph-mon[92535]: pgmap v4331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:43 smithi035 ceph-mon[92535]: pgmap v4332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:45 smithi035 ceph-mon[92535]: pgmap v4333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:47 smithi035 ceph-mon[92535]: pgmap v4334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:07:55.405 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:48 smithi035 ceph-mon[92535]: pgmap v4335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 15 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:48 smithi035 ceph-mon[92535]: pgmap v4336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:50 smithi035 ceph-mon[92535]: pgmap v4337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:52 smithi035 ceph-mon[92535]: pgmap v4338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:54 smithi035 ceph-mon[92535]: pgmap v4339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:56 smithi035 ceph-mon[92535]: pgmap v4340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:57:58 smithi035 ceph-mon[92535]: pgmap v4341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:00 smithi035 ceph-mon[92535]: pgmap v4342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:02 smithi035 ceph-mon[92535]: pgmap v4343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:04 smithi035 ceph-mon[92535]: pgmap v4344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:06 smithi035 ceph-mon[92535]: pgmap v4345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:08 smithi035 ceph-mon[92535]: pgmap v4346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:10 smithi035 ceph-mon[92535]: osdmap e344: 12 total, 12 up, 12 in 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:10 smithi035 ceph-mon[92535]: pgmap v4348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:12 smithi035 ceph-mon[92535]: pgmap v4349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:14 smithi035 ceph-mon[92535]: pgmap v4350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:16 smithi035 ceph-mon[92535]: pgmap v4351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:18 smithi035 ceph-mon[92535]: osdmap e345: 12 total, 12 up, 12 in 2023-03-17T11:07:55.406 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:18 smithi035 ceph-mon[92535]: pgmap v4353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 13 op/s 2023-03-17T11:07:55.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:20 smithi035 ceph-mon[92535]: pgmap v4354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:07:57.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:22 smithi035 ceph-mon[92535]: pgmap v4355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:07:58.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:24 smithi035 ceph-mon[92535]: pgmap v4356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:07:58.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:26 smithi035 ceph-mon[92535]: pgmap v4357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:07:58.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:28 smithi035 ceph-mon[92535]: pgmap v4358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2023-03-17T11:07:58.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:30 smithi035 ceph-mon[92535]: pgmap v4359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T11:07:58.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:32 smithi035 ceph-mon[92535]: pgmap v4360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:34 smithi035 ceph-mon[92535]: pgmap v4361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:36 smithi035 ceph-mon[92535]: pgmap v4362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:38 smithi035 ceph-mon[92535]: pgmap v4363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:40 smithi035 ceph-mon[92535]: pgmap v4364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:42 smithi035 ceph-mon[92535]: pgmap v4365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:44 smithi035 ceph-mon[92535]: pgmap v4366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:46 smithi035 ceph-mon[92535]: pgmap v4367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:07:59.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:48 smithi035 ceph-mon[92535]: pgmap v4368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:08:00.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:08:00.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:08:00.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:08:00.278 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:08:01.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:08:01.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:49 smithi035 ceph-mon[92535]: pgmap v4369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T11:08:02.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:08:02.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:51 smithi035 ceph-mon[92535]: pgmap v4370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T11:08:02.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:53 smithi035 ceph-mon[92535]: pgmap v4371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 14 op/s 2023-03-17T11:08:06.740 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:55 smithi035 ceph-mon[92535]: pgmap v4372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T11:08:08.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:57 smithi035 ceph-mon[92535]: pgmap v4373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T11:08:08.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:58:59 smithi035 ceph-mon[92535]: pgmap v4374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T11:08:08.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:01 smithi035 ceph-mon[92535]: pgmap v4375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:03 smithi035 ceph-mon[92535]: pgmap v4376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:05 smithi035 ceph-mon[92535]: pgmap v4377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:07 smithi035 ceph-mon[92535]: pgmap v4378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:09 smithi035 ceph-mon[92535]: pgmap v4379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:09 smithi035 ceph-mon[92535]: osdmap e346: 12 total, 12 up, 12 in 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:11 smithi035 ceph-mon[92535]: pgmap v4381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:13 smithi035 ceph-mon[92535]: pgmap v4382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:15 smithi035 ceph-mon[92535]: pgmap v4383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:17 smithi035 ceph-mon[92535]: pgmap v4384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:17 smithi035 ceph-mon[92535]: osdmap e347: 12 total, 12 up, 12 in 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:19 smithi035 ceph-mon[92535]: pgmap v4386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 11 op/s 2023-03-17T11:08:10.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:21 smithi035 ceph-mon[92535]: pgmap v4387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:08:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:08:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:08:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:08:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:08:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae2aeb7b80 20 client.20085 trim_cache size 0 max 16384 2023-03-17T11:08:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae0809f640 msgr2=0x7fae080a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae0809f640 0x7fae080a1af0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009bf0 tx=0x7fae0c009260 comp rx=0 tx=0).stop 2023-03-17T11:08:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 msgr2=0x7fae1819cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1819cfb0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fae10008e50 tx=0x7fae10008e80 comp rx=0 tx=0).stop 2023-03-17T11:08:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 shutdown_connections 2023-03-17T11:08:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fae0809f640 0x7fae080a1af0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fae18104390 0x7fae1819cfb0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae180ff350 0x7fae18198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 --2- 172.21.15.35:0/4101607797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae180ffcf0 0x7fae18198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 >> 172.21.15.35:0/4101607797 conn(0x7fae18076330 msgr2=0x7fae180688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 shutdown_connections 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:42.446+0000 7fae1ed2a700 1 -- 172.21.15.35:0/4101607797 wait complete. 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 -- 172.21.15.35:0/3970187938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82200ffcf0 msgr2=0x7f8220103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 --2- 172.21.15.35:0/3970187938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82200ffcf0 0x7f8220103cb0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f821c0099c0 tx=0x7f821c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 -- 172.21.15.35:0/3970187938 shutdown_connections 2023-03-17T11:08:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 --2- 172.21.15.35:0/3970187938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8220104390 0x7f822010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 --2- 172.21.15.35:0/3970187938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200ff350 0x7f82200ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 --2- 172.21.15.35:0/3970187938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f82200ffcf0 0x7f8220103cb0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.569+0000 7f8227e4c700 1 -- 172.21.15.35:0/3970187938 >> 172.21.15.35:0/3970187938 conn(0x7f8220076330 msgr2=0x7f8220076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 -- 172.21.15.35:0/3970187938 shutdown_connections 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 -- 172.21.15.35:0/3970187938 wait complete. 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 Processor -- start 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 -- start start 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82200ff350 0x7f82201940b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200ffcf0 0x7f82201945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.570+0000 7f8227e4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 0x7f8220198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8227e4c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8220199090 con 0x7f8220104390 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8227e4c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8220199200 con 0x7f82200ffcf0 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8227e4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201993c0 con 0x7f82200ff350 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 0x7f8220198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 0x7f8220198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53638/0 (socket says 172.21.15.35:53638) 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 -- 172.21.15.35:0/2340495577 learned_addr learned my addr 172.21.15.35:0/2340495577 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:08:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82253e7700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200ffcf0 0x7f82201945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8225be8700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82200ff350 0x7f82201940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 -- 172.21.15.35:0/2340495577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82200ff350 msgr2=0x7f82201940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82200ff350 0x7f82201940b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 -- 172.21.15.35:0/2340495577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200ffcf0 msgr2=0x7f82201945f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200ffcf0 0x7f82201945f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 -- 172.21.15.35:0/2340495577 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0095f0 con 0x7f8220104390 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f82263e9700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 0x7f8220198a50 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f821800ef30 tx=0x7f821800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:18.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8216ffd700 1 -- 172.21.15.35:0/2340495577 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218018070 con 0x7f8220104390 2023-03-17T11:08:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8216ffd700 1 -- 172.21.15.35:0/2340495577 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f821800f040 con 0x7f8220104390 2023-03-17T11:08:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822010df10 con 0x7f8220104390 2023-03-17T11:08:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8216ffd700 1 -- 172.21.15.35:0/2340495577 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800cbc0 con 0x7f8220104390 2023-03-17T11:08:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.571+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822010dd80 con 0x7f8220104390 2023-03-17T11:08:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.574+0000 7f8216ffd700 1 -- 172.21.15.35:0/2340495577 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f821800cd80 con 0x7f8220104390 2023-03-17T11:08:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.575+0000 7f8216ffd700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f820c09f640 0x7f820c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.575+0000 7f8225be8700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f820c09f640 0x7f820c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.575+0000 7f8216ffd700 1 -- 172.21.15.35:0/2340495577 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f82180ca0b0 con 0x7f8220104390 2023-03-17T11:08:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.575+0000 7f8225be8700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f820c09f640 0x7f820c0a1af0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8210015340 tx=0x7f821000f040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 Processor -- start 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 -- start start 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x558751215420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751215d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875111c010 con 0x55875121b4f0 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875116e950 con 0x558751215960 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558751167de0 con 0x55875121abe0 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f82253e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x558751215420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f82253e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x558751215420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53644/0 (socket says 172.21.15.35:53644) 2023-03-17T11:08:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f82253e7700 1 -- 172.21.15.35:0/1556646558 learned_addr learned my addr 172.21.15.35:0/1556646558 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f82263e9700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751215d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.576+0000 7f8225be8700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82253e7700 1 -- 172.21.15.35:0/1556646558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 msgr2=0x55875121afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82253e7700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82253e7700 1 -- 172.21.15.35:0/1556646558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 msgr2=0x558751215d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82253e7700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751215d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82253e7700 1 -- 172.21.15.35:0/1556646558 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558750fe95d0 con 0x55875121b4f0 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82263e9700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751215d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f8225be8700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f82253e7700 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x558751215420 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d790 tx=0x7f821c005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31af1c00f82ed00 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f820bfff700 1 -- 172.21.15.35:0/1556646558 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c01a040 con 0x55875121b4f0 2023-03-17T11:08:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f820bfff700 1 -- 172.21.15.35:0/1556646558 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f821c009ea0 con 0x55875121b4f0 2023-03-17T11:08:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.577+0000 7f820bfff700 1 -- 172.21.15.35:0/1556646558 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c005700 con 0x55875121b4f0 2023-03-17T11:08:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 -- 172.21.15.35:0/1556646558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 msgr2=0x558751215420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x558751215420 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d790 tx=0x7f821c005960 comp rx=0 tx=0).stop 2023-03-17T11:08:23.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 -- 172.21.15.35:0/1556646558 shutdown_connections 2023-03-17T11:08:23.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751215d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/1556646558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x558751215420 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 -- 172.21.15.35:0/1556646558 >> 172.21.15.35:0/1556646558 conn(0x5587510726b0 msgr2=0x55875120fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 -- 172.21.15.35:0/1556646558 shutdown_connections 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 -- 172.21.15.35:0/1556646558 wait complete. 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 -- start start 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.578+0000 7f8233fd9b80 1 Processor -- start 2023-03-17T11:08:24.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751221380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875121eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558750feb8c0 con 0x55875121b4f0 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875121f2d0 con 0x558751215960 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875121f490 con 0x55875121abe0 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 10 client.0 _ll_register_callbacks cb 0x55875100d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875121eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875121eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53652/0 (socket says 172.21.15.35:53652) 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 -- 172.21.15.35:0/3103814511 learned_addr learned my addr 172.21.15.35:0/3103814511 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:08:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82253e7700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8225be8700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751221380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 -- 172.21.15.35:0/3103814511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 msgr2=0x55875121e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 -- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 msgr2=0x558751221380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751221380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 -- 172.21.15.35:0/3103814511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822010c7a0 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82263e9700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875121eb60 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f8218009f40 tx=0x7f821809fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22184d6bcaa509d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82097fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82097fa700 1 -- 172.21.15.35:0/3103814511 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218096050 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f82097fa700 1 -- 172.21.15.35:0/3103814511 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f821809f8c0 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.579+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55875112a390 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f82097fa700 1 -- 172.21.15.35:0/3103814511 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f821809fa80 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 10 client.20097 fetch_fsmap learned FSMap version 102 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x558750f95d80 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f82097fa700 1 -- 172.21.15.35:0/3103814511 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55875112a390 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f82097fa700 1 -- 172.21.15.35:0/3103814511 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f82180c7230 con 0x55875121b4f0 2023-03-17T11:08:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 10 client.20097 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:08:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 10 client.20097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:08:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 20 client.20097 populate_metadata read hostname 'smithi035' 2023-03-17T11:08:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55875122efc0 0x5587512313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 4 client.20097 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:08:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558751136600 con 0x55875122efc0 2023-03-17T11:08:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.580+0000 7f8225be8700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55875122efc0 0x5587512313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f8225be8700 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55875122efc0 0x5587512313d0 crc :-1 s=READY pgs=594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d658199f0abb182 server_cookie=6fea339eb21ec25b in_seq=0 out_seq=0 2023-03-17T11:08:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f82097fa700 10 client.20097 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:08:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f82097fa700 1 -- 172.21.15.35:0/3103814511 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558751136600 con 0x55875122efc0 2023-03-17T11:08:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f82097fa700 10 client.20097 handle_command_reply: tid=0 2023-03-17T11:08:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f8233fd9b80 1 client.20097 shutdown 2023-03-17T11:08:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 msgr2=0x55875121eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.581+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875121eb60 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f8218009f40 tx=0x7f821809fd50 comp rx=0 tx=0).stop 2023-03-17T11:08:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 shutdown_connections 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55875122efc0 0x5587512313d0 crc :-1 s=READY pgs=594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875121eb60 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f82097fa700 0 client.20097 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558751215960 0x558751221380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3103814511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55875121abe0 0x55875121e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 >> 172.21.15.35:0/3103814511 conn(0x5587510726b0 msgr2=0x558751214410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 shutdown_connections 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3103814511 wait complete. 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.582+0000 7f8233fd9b80 20 client.20097 trim_cache size 0 max 16384 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 Processor -- start 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 -- start start 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x558751225ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 0x55875121bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121b4f0 0x558751220f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875120b120 con 0x55875121abe0 2023-03-17T11:08:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875122c650 con 0x55875121b4f0 2023-03-17T11:08:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558751221960 con 0x558751215960 2023-03-17T11:08:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f82253e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 0x55875121bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f82253e7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 0x55875121bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53658/0 (socket says 172.21.15.35:53658) 2023-03-17T11:08:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.597+0000 7f82253e7700 1 -- 172.21.15.35:0/3329696239 learned_addr learned my addr 172.21.15.35:0/3329696239 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:08:28.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f8225be8700 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x558751225ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82263e9700 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121b4f0 0x558751220f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82253e7700 1 -- 172.21.15.35:0/3329696239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 msgr2=0x558751225ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82253e7700 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x558751225ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82253e7700 1 -- 172.21.15.35:0/3329696239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121b4f0 msgr2=0x558751220f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82253e7700 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121b4f0 0x558751220f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82253e7700 1 -- 172.21.15.35:0/3329696239 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558751216000 con 0x55875121abe0 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f82253e7700 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 0x55875121bfd0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d790 tx=0x7f821c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f225ddc95f8a111 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f8214ff9700 1 -- 172.21.15.35:0/3329696239 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c01a040 con 0x55875121abe0 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f8214ff9700 1 -- 172.21.15.35:0/3329696239 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f821c003880 con 0x55875121abe0 2023-03-17T11:08:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.598+0000 7f8214ff9700 1 -- 172.21.15.35:0/3329696239 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c015440 con 0x55875121abe0 2023-03-17T11:08:31.479 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:23 smithi035 ceph-mon[92535]: pgmap v4388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T11:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3329696239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 msgr2=0x55875121bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:33.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 0x55875121bfd0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d790 tx=0x7f821c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:08:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3329696239 shutdown_connections 2023-03-17T11:08:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121b4f0 0x558751220f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x558751225ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/3329696239 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121abe0 0x55875121bfd0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3329696239 >> 172.21.15.35:0/3329696239 conn(0x5587510726b0 msgr2=0x55875121b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3329696239 shutdown_connections 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 -- 172.21.15.35:0/3329696239 wait complete. 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 -- start start 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.599+0000 7f8233fd9b80 1 Processor -- start 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x55875127b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:34.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121abe0 0x55875127b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875127be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875127c550 con 0x55875121b4f0 2023-03-17T11:08:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875127c6c0 con 0x55875121abe0 2023-03-17T11:08:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875127c880 con 0x558751215960 2023-03-17T11:08:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 10 client.0 _ll_register_callbacks cb 0x55875100d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:08:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875127be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875127be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53666/0 (socket says 172.21.15.35:53666) 2023-03-17T11:08:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 -- 172.21.15.35:0/2607838418 learned_addr learned my addr 172.21.15.35:0/2607838418 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:08:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82253e7700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121abe0 0x55875127b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8225be8700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x55875127b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 -- 172.21.15.35:0/2607838418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 msgr2=0x55875127b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x55875127b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 -- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121abe0 msgr2=0x55875127b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121abe0 0x55875127b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 -- 172.21.15.35:0/2607838418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558750fe95d0 con 0x55875121b4f0 2023-03-17T11:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82253e7700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121abe0 0x55875127b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82263e9700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875127be70 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f82180c7e40 tx=0x7f8218004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aed061972a529eb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82097fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:08:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82097fa700 1 -- 172.21.15.35:0/2607838418 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821809f8c0 con 0x55875121b4f0 2023-03-17T11:08:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f82097fa700 1 -- 172.21.15.35:0/2607838418 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f821809fa20 con 0x55875121b4f0 2023-03-17T11:08:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.600+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587511e51e0 con 0x55875121b4f0 2023-03-17T11:08:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f82097fa700 1 -- 172.21.15.35:0/2607838418 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82180642d0 con 0x55875121b4f0 2023-03-17T11:08:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 10 client.20103 fetch_fsmap learned FSMap version 102 2023-03-17T11:08:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x558750f7ec00 con 0x55875121b4f0 2023-03-17T11:08:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f82097fa700 1 -- 172.21.15.35:0/2607838418 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f821807a020 con 0x55875121b4f0 2023-03-17T11:08:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f82097fa700 1 -- 172.21.15.35:0/2607838418 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8218003a90 con 0x55875121b4f0 2023-03-17T11:08:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 10 client.20103 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:08:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 10 client.20103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:08:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 20 client.20103 populate_metadata read hostname 'smithi035' 2023-03-17T11:08:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558751283be0 0x558751285ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 4 client.20103 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:08:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558750febf00 con 0x558751283be0 2023-03-17T11:08:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.601+0000 7f8225be8700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558751283be0 0x558751285ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:49.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.602+0000 7f82097fa700 10 client.20103 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:08:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.602+0000 7f8225be8700 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558751283be0 0x558751285ff0 crc :-1 s=READY pgs=595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cca52d5cadf8d4a4 server_cookie=d4dd2e21b68e26aa in_seq=0 out_seq=0 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f82097fa700 1 -- 172.21.15.35:0/2607838418 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558750febf00 con 0x558751283be0 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f82097fa700 10 client.20103 handle_command_reply: tid=0 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f8233fd9b80 1 client.20103 shutdown 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 msgr2=0x55875127be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875127be70 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f82180c7e40 tx=0x7f8218004ca0 comp rx=0 tx=0).stop 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 shutdown_connections 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558751283be0 0x558751285ff0 crc :-1 s=READY pgs=595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.610+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55875121b4f0 0x55875127be70 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f82097fa700 0 client.20103 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:08:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558751215960 0x55875127b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8233fd9b80 1 --2- 172.21.15.35:0/2607838418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55875121abe0 0x55875127b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 >> 172.21.15.35:0/2607838418 conn(0x5587510726b0 msgr2=0x55875121b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 shutdown_connections 2023-03-17T11:08:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8233fd9b80 1 -- 172.21.15.35:0/2607838418 wait complete. 2023-03-17T11:08:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8233fd9b80 20 client.20103 trim_cache size 0 max 16384 2023-03-17T11:08:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f820c09f640 msgr2=0x7f820c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f820c09f640 0x7f820c0a1af0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8210015340 tx=0x7f821000f040 comp rx=0 tx=0).stop 2023-03-17T11:08:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 msgr2=0x7f8220198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 0x7f8220198a50 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f821800ef30 tx=0x7f821800c3a0 comp rx=0 tx=0).stop 2023-03-17T11:08:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 shutdown_connections 2023-03-17T11:08:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f820c09f640 0x7f820c0a1af0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8220104390 0x7f8220198a50 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82200ff350 0x7f82201940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 --2- 172.21.15.35:0/2340495577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200ffcf0 0x7f82201945f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 >> 172.21.15.35:0/2340495577 conn(0x7f8220076330 msgr2=0x7f82200fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 shutdown_connections 2023-03-17T11:08:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:42:55.611+0000 7f8227e4c700 1 -- 172.21.15.35:0/2340495577 wait complete. 2023-03-17T11:08:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.732+0000 7f1b7827f700 1 -- 172.21.15.35:0/4017669419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 msgr2=0x7f1b7010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.732+0000 7f1b7827f700 1 --2- 172.21.15.35:0/4017669419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b7010bfc0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800b0d0 tx=0x7f1b6800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:08:54.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- 172.21.15.35:0/4017669419 shutdown_connections 2023-03-17T11:08:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 --2- 172.21.15.35:0/4017669419 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b7010bfc0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 --2- 172.21.15.35:0/4017669419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700ff3b0 0x7f1b700ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 --2- 172.21.15.35:0/4017669419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b700ffd50 0x7f1b70103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- 172.21.15.35:0/4017669419 >> 172.21.15.35:0/4017669419 conn(0x7f1b70075f60 msgr2=0x7f1b70076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:08:57.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- 172.21.15.35:0/4017669419 shutdown_connections 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- 172.21.15.35:0/4017669419 wait complete. 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 Processor -- start 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- start start 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700ff3b0 0x7f1b70195240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b700ffd50 0x7f1b70195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b70199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019a220 con 0x7f1b701043f0 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019a390 con 0x7f1b700ff3b0 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.733+0000 7f1b7827f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019a550 con 0x7f1b700ffd50 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b70199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b70199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53680/0 (socket says 172.21.15.35:53680) 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 -- 172.21.15.35:0/3804877974 learned_addr learned my addr 172.21.15.35:0/3804877974 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:08:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7601b700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700ff3b0 0x7f1b70195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7581a700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b700ffd50 0x7f1b70195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 -- 172.21.15.35:0/3804877974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b700ffd50 msgr2=0x7f1b70195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b700ffd50 0x7f1b70195780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 -- 172.21.15.35:0/3804877974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700ff3b0 msgr2=0x7f1b70195240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700ff3b0 0x7f1b70195240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 -- 172.21.15.35:0/3804877974 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b68009d00 con 0x7f1b701043f0 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7681c700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b70199be0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009380 tx=0x7f1b680093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:08:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b637fe700 1 -- 172.21.15.35:0/3804877974 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800e040 con 0x7f1b701043f0 2023-03-17T11:09:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b637fe700 1 -- 172.21.15.35:0/3804877974 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b68003e10 con 0x7f1b701043f0 2023-03-17T11:09:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7010f070 con 0x7f1b701043f0 2023-03-17T11:09:01.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b637fe700 1 -- 172.21.15.35:0/3804877974 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6801ba00 con 0x7f1b701043f0 2023-03-17T11:09:02.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.734+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7010eee0 con 0x7f1b701043f0 2023-03-17T11:09:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.736+0000 7f1b637fe700 1 -- 172.21.15.35:0/3804877974 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1b68024410 con 0x7f1b701043f0 2023-03-17T11:09:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.737+0000 7f1b637fe700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1b5c09f640 0x7f1b5c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.737+0000 7f1b637fe700 1 -- 172.21.15.35:0/3804877974 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1b680cbd50 con 0x7f1b701043f0 2023-03-17T11:09:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.737+0000 7f1b7601b700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1b5c09f640 0x7f1b5c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:03.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.738+0000 7f1b7601b700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1b5c09f640 0x7f1b5c0a1af0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005950 tx=0x7f1b6c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.738+0000 7f1b8440cb80 1 Processor -- start 2023-03-17T11:09:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.738+0000 7f1b8440cb80 1 -- start start 2023-03-17T11:09:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626212fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x5626212f9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562621200010 con 0x5626212ff4f0 2023-03-17T11:09:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562621252950 con 0x5626212f9960 2023-03-17T11:09:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56262124bde0 con 0x5626212febe0 2023-03-17T11:09:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x5626212f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x5626212f9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53686/0 (socket says 172.21.15.35:53686) 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 -- 172.21.15.35:0/1571271761 learned_addr learned my addr 172.21.15.35:0/1571271761 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7681c700 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7601b700 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626212fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 -- 172.21.15.35:0/1571271761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 msgr2=0x5626212fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626212fefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 -- 172.21.15.35:0/1571271761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 msgr2=0x5626212f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:10.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 -- 172.21.15.35:0/1571271761 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626210cd5d0 con 0x5626212ff4f0 2023-03-17T11:09:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b7581a700 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x5626212f9420 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009b10 tx=0x7f1b64009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca6463dfe02b905 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b60dae700 1 -- 172.21.15.35:0/1571271761 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64004a30 con 0x5626212ff4f0 2023-03-17T11:09:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b60dae700 1 -- 172.21.15.35:0/1571271761 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b640054b0 con 0x5626212ff4f0 2023-03-17T11:09:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.739+0000 7f1b60dae700 1 -- 172.21.15.35:0/1571271761 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6400ec00 con 0x5626212ff4f0 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1571271761 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 msgr2=0x5626212f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x5626212f9420 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009b10 tx=0x7f1b64009e20 comp rx=0 tx=0).stop 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1571271761 shutdown_connections 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626212fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1571271761 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x5626212f9420 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1571271761 >> 172.21.15.35:0/1571271761 conn(0x5626211566b0 msgr2=0x5626212f3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1571271761 shutdown_connections 2023-03-17T11:09:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.740+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1571271761 wait complete. 2023-03-17T11:09:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 -- start start 2023-03-17T11:09:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 Processor -- start 2023-03-17T11:09:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x5626213053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212ff4f0 0x562621302c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626210cf8c0 con 0x5626212f9960 2023-03-17T11:09:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213033b0 con 0x5626212ff4f0 2023-03-17T11:09:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562621303570 con 0x5626212febe0 2023-03-17T11:09:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b7601b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x5626213053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b7601b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x5626213053b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53690/0 (socket says 172.21.15.35:53690) 2023-03-17T11:09:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b8440cb80 10 client.0 _ll_register_callbacks cb 0x5626210f1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:09:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b7601b700 1 -- 172.21.15.35:0/1916161893 learned_addr learned my addr 172.21.15.35:0/1916161893 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.741+0000 7f1b7681c700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212ff4f0 0x562621302c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7581a700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7601b700 1 -- 172.21.15.35:0/1916161893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 msgr2=0x5626213026a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7601b700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213026a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:18.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7601b700 1 -- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212ff4f0 msgr2=0x562621302c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:18.243 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:25 smithi035 ceph-mon[92535]: pgmap v4389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T11:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7601b700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212ff4f0 0x562621302c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7601b700 1 -- 172.21.15.35:0/1916161893 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64009740 con 0x5626212f9960 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b7601b700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x5626213053b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0116c0 tx=0x7f1b6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7fc3f39c3806b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b59ffb700 1 -- 172.21.15.35:0/1916161893 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c004a30 con 0x5626212f9960 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b59ffb700 1 -- 172.21.15.35:0/1916161893 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1b6c017070 con 0x5626212f9960 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56262120e390 con 0x5626212f9960 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b59ffb700 1 -- 172.21.15.35:0/1916161893 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b6c004b90 con 0x5626212f9960 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b8440cb80 10 client.20115 fetch_fsmap learned FSMap version 102 2023-03-17T11:09:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x562621079d80 con 0x5626212f9960 2023-03-17T11:09:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.742+0000 7f1b59ffb700 1 -- 172.21.15.35:0/1916161893 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56262120e390 con 0x5626212f9960 2023-03-17T11:09:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b59ffb700 1 -- 172.21.15.35:0/1916161893 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1b6c01f640 con 0x5626212f9960 2023-03-17T11:09:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b8440cb80 10 client.20115 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:09:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b8440cb80 10 client.20115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:09:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b8440cb80 20 client.20115 populate_metadata read hostname 'smithi035' 2023-03-17T11:09:20.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562621309400 0x56262130b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b8440cb80 4 client.20115 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:09:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56262121a600 con 0x562621309400 2023-03-17T11:09:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b7581a700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562621309400 0x56262130b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b59ffb700 10 client.20115 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.743+0000 7f1b7581a700 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562621309400 0x56262130b810 crc :-1 s=READY pgs=596 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e9a615a3895ab2 server_cookie=8936a9532274c348 in_seq=0 out_seq=0 2023-03-17T11:09:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b59ffb700 1 -- 172.21.15.35:0/1916161893 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56262121a600 con 0x562621309400 2023-03-17T11:09:23.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b59ffb700 10 client.20115 handle_command_reply: tid=0 2023-03-17T11:09:23.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 client.20115 shutdown 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 msgr2=0x5626213053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x5626213053b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0116c0 tx=0x7f1b6c0047c0 comp rx=0 tx=0).stop 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 shutdown_connections 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562621309400 0x56262130b810 crc :-1 s=READY pgs=596 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212ff4f0 0x562621302c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x5626213053b0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/1916161893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b59ffb700 0 client.20115 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 >> 172.21.15.35:0/1916161893 conn(0x5626211566b0 msgr2=0x5626212f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 shutdown_connections 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 1 -- 172.21.15.35:0/1916161893 wait complete. 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.744+0000 7f1b8440cb80 20 client.20115 trim_cache size 0 max 16384 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.759+0000 7f1b8440cb80 1 Processor -- start 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.759+0000 7f1b8440cb80 1 -- start start 2023-03-17T11:09:23.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x562621319080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:23.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626212ef0f0 con 0x5626212ff4f0 2023-03-17T11:09:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562621306b00 con 0x5626212f9960 2023-03-17T11:09:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626212f8a90 con 0x5626212febe0 2023-03-17T11:09:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x562621319080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x562621319080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53698/0 (socket says 172.21.15.35:53698) 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 -- 172.21.15.35:0/2157099764 learned_addr learned my addr 172.21.15.35:0/2157099764 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7601b700 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7581a700 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 -- 172.21.15.35:0/2157099764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 msgr2=0x5626213308b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213308b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 -- 172.21.15.35:0/2157099764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 msgr2=0x5626212fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 -- 172.21.15.35:0/2157099764 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562621212130 con 0x5626212ff4f0 2023-03-17T11:09:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b7681c700 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x562621319080 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f1b68099590 tx=0x7f1b680099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139f4f8931c0b007 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:26.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b615af700 1 -- 172.21.15.35:0/2157099764 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680a19f0 con 0x5626212ff4f0 2023-03-17T11:09:26.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b615af700 1 -- 172.21.15.35:0/2157099764 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b680af070 con 0x5626212ff4f0 2023-03-17T11:09:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.760+0000 7f1b615af700 1 -- 172.21.15.35:0/2157099764 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68098d80 con 0x5626212ff4f0 2023-03-17T11:09:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 -- 172.21.15.35:0/2157099764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 msgr2=0x562621319080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:26.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x562621319080 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f1b68099590 tx=0x7f1b680099e0 comp rx=0 tx=0).stop 2023-03-17T11:09:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 -- 172.21.15.35:0/2157099764 shutdown_connections 2023-03-17T11:09:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212ff4f0 0x562621319080 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212f9960 0x5626212fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/2157099764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212febe0 0x5626213308b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 -- 172.21.15.35:0/2157099764 >> 172.21.15.35:0/2157099764 conn(0x5626211566b0 msgr2=0x5626212fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:28.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 -- 172.21.15.35:0/2157099764 shutdown_connections 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 -- 172.21.15.35:0/2157099764 wait complete. 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 -- start start 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.761+0000 7f1b8440cb80 1 Processor -- start 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x562621334ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212febe0 0x562621335530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212ff4f0 0x562621318070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562621318670 con 0x5626212f9960 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213187e0 con 0x5626212febe0 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626213189a0 con 0x5626212ff4f0 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 10 client.0 _ll_register_callbacks cb 0x5626210f1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x562621334ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x562621334ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53702/0 (socket says 172.21.15.35:53702) 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 -- 172.21.15.35:0/3544246112 learned_addr learned my addr 172.21.15.35:0/3544246112 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7581a700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212febe0 0x562621335530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7681c700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212ff4f0 0x562621318070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:28.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 -- 172.21.15.35:0/3544246112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212ff4f0 msgr2=0x562621318070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212ff4f0 0x562621318070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 -- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212febe0 msgr2=0x562621335530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212febe0 0x562621335530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:28.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 -- 172.21.15.35:0/3544246112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7010eee0 con 0x5626212f9960 2023-03-17T11:09:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7681c700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212ff4f0 0x562621318070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:09:30.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b7601b700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x562621334ff0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c01f950 tx=0x7f1b6c0276d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec77645072dbf576 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b59ffb700 1 -- 172.21.15.35:0/3544246112 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00b8f0 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626212c91e0 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b59ffb700 1 -- 172.21.15.35:0/3544246112 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(313..313 src has 1..313) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1b6c017040 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b59ffb700 1 -- 172.21.15.35:0/3544246112 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b6c011e10 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 10 client.20121 fetch_fsmap learned FSMap version 102 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.762+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5626210a01f0 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b59ffb700 1 -- 172.21.15.35:0/3544246112 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b6c04a020 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b59ffb700 1 -- 172.21.15.35:0/3544246112 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1b6c046750 con 0x5626212f9960 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b8440cb80 10 client.20121 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b8440cb80 10 client.20121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b8440cb80 20 client.20121 populate_metadata read hostname 'smithi035' 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56262133df20 0x562621340330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b8440cb80 4 client.20121 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:09:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5626210cff00 con 0x56262133df20 2023-03-17T11:09:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b7581a700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56262133df20 0x562621340330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b59ffb700 10 client.20121 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.763+0000 7f1b7581a700 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56262133df20 0x562621340330 crc :-1 s=READY pgs=597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8b7ed44239d645 server_cookie=6d9f0cc113822b7a in_seq=0 out_seq=0 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.781+0000 7f1b59ffb700 1 -- 172.21.15.35:0/3544246112 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5626210cff00 con 0x56262133df20 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.781+0000 7f1b59ffb700 10 client.20121 handle_command_reply: tid=0 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.781+0000 7f1b8440cb80 1 client.20121 shutdown 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 msgr2=0x562621334ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x562621334ff0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c01f950 tx=0x7f1b6c0276d0 comp rx=0 tx=0).stop 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 shutdown_connections 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56262133df20 0x562621340330 crc :-1 s=READY pgs=597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5626212ff4f0 0x562621318070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5626212f9960 0x562621334ff0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b59ffb700 0 client.20121 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 --2- 172.21.15.35:0/3544246112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626212febe0 0x562621335530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 >> 172.21.15.35:0/3544246112 conn(0x5626211566b0 msgr2=0x5626212fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:34.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 shutdown_connections 2023-03-17T11:09:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 1 -- 172.21.15.35:0/3544246112 wait complete. 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b8440cb80 20 client.20121 trim_cache size 0 max 16384 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1b5c09f640 msgr2=0x7f1b5c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1b5c09f640 0x7f1b5c0a1af0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c005950 tx=0x7f1b6c00b410 comp rx=0 tx=0).stop 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 msgr2=0x7f1b70199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b70199be0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009380 tx=0x7f1b680093b0 comp rx=0 tx=0).stop 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 shutdown_connections 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1b5c09f640 0x7f1b5c0a1af0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1b701043f0 0x7f1b70199be0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700ff3b0 0x7f1b70195240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 --2- 172.21.15.35:0/3804877974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b700ffd50 0x7f1b70195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.782+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 >> 172.21.15.35:0/3804877974 conn(0x7f1b70075f60 msgr2=0x7f1b700fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.783+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 shutdown_connections 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:43:08.783+0000 7f1b7827f700 1 -- 172.21.15.35:0/3804877974 wait complete. 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 -- 172.21.15.35:0/2585681895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 msgr2=0x7fdb9810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 --2- 172.21.15.35:0/2585681895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb9810d090 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000b0d0 tx=0x7fdb9000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 -- 172.21.15.35:0/2585681895 shutdown_connections 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 --2- 172.21.15.35:0/2585681895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb9810d090 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 --2- 172.21.15.35:0/2585681895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb980fe970 0x7fdb980fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 --2- 172.21.15.35:0/2585681895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb980ff310 0x7fdb98104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 -- 172.21.15.35:0/2585681895 >> 172.21.15.35:0/2585681895 conn(0x7fdb980757a0 msgr2=0x7fdb98075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 -- 172.21.15.35:0/2585681895 shutdown_connections 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 -- 172.21.15.35:0/2585681895 wait complete. 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.304+0000 7fdba00df700 1 Processor -- start 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 -- start start 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb980fe970 0x7fdb980ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb980ff310 0x7fdb980ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb981a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb98100650 con 0x7fdb98105510 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981a4a40 con 0x7fdb980ff310 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdba00df700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981a4b80 con 0x7fdb980fe970 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb981a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb981a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53720/0 (socket says 172.21.15.35:53720) 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 -- 172.21.15.35:0/3981710491 learned_addr learned my addr 172.21.15.35:0/3981710491 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb980fe970 0x7fdb980ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb980ff310 0x7fdb980ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 -- 172.21.15.35:0/3981710491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb980fe970 msgr2=0x7fdb980ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb980fe970 0x7fdb980ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 -- 172.21.15.35:0/3981710491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb980ff310 msgr2=0x7fdb980ffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb980ff310 0x7fdb980ffe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 -- 172.21.15.35:0/3981710491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90009d00 con 0x7fdb98105510 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.305+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb981a4500 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009fd0 tx=0x7fdb9000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.306+0000 7fdb8effd700 1 -- 172.21.15.35:0/3981710491 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9000e040 con 0x7fdb98105510 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.306+0000 7fdb8effd700 1 -- 172.21.15.35:0/3981710491 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb90003e10 con 0x7fdb98105510 2023-03-17T11:09:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.306+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb98110140 con 0x7fdb98105510 2023-03-17T11:09:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.306+0000 7fdb8effd700 1 -- 172.21.15.35:0/3981710491 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900052a0 con 0x7fdb98105510 2023-03-17T11:09:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.306+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9810ffb0 con 0x7fdb98105510 2023-03-17T11:09:39.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:27 smithi035 ceph-mon[92535]: pgmap v4390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T11:09:40.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.308+0000 7fdb8effd700 1 -- 172.21.15.35:0/3981710491 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdb9001b450 con 0x7fdb98105510 2023-03-17T11:09:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.308+0000 7fdb8effd700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb8409f6c0 0x7fdb840a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.309+0000 7fdb8effd700 1 -- 172.21.15.35:0/3981710491 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(318..318 src has 1..318) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fdb900cb8e0 con 0x7fdb98105510 2023-03-17T11:09:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.309+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb8409f6c0 0x7fdb840a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.309+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb8409f6c0 0x7fdb840a1b70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdb94005950 tx=0x7fdb9400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.309+0000 7fdbac26cb80 1 Processor -- start 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 -- start start 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf292fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf28d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf28dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf194010 con 0x564faf292be0 2023-03-17T11:09:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf1e6950 con 0x564faf2934f0 2023-03-17T11:09:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf1dfde0 con 0x564faf28d960 2023-03-17T11:09:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf292fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:45.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf292fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53724/0 (socket says 172.21.15.35:53724) 2023-03-17T11:09:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 -- 172.21.15.35:0/2785476335 learned_addr learned my addr 172.21.15.35:0/2785476335 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf28dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf28d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 -- 172.21.15.35:0/2785476335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 msgr2=0x564faf28dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf28dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 -- 172.21.15.35:0/2785476335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 msgr2=0x564faf28d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf28d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 -- 172.21.15.35:0/2785476335 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564faf0615d0 con 0x564faf292be0 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf28d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.310+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf292fb0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fdb94010fa0 tx=0x7fdb94013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ca944a5872bb07 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdb83fff700 1 -- 172.21.15.35:0/2785476335 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94011db0 con 0x564faf292be0 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdb83fff700 1 -- 172.21.15.35:0/2785476335 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb94015070 con 0x564faf292be0 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdb83fff700 1 -- 172.21.15.35:0/2785476335 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9401c610 con 0x564faf292be0 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 -- 172.21.15.35:0/2785476335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 msgr2=0x564faf292fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf292fb0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fdb94010fa0 tx=0x7fdb94013000 comp rx=0 tx=0).stop 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 -- 172.21.15.35:0/2785476335 shutdown_connections 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf28dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf292fb0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/2785476335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf28d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 -- 172.21.15.35:0/2785476335 >> 172.21.15.35:0/2785476335 conn(0x564faf0ea6b0 msgr2=0x564faf287a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 -- 172.21.15.35:0/2785476335 shutdown_connections 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.311+0000 7fdbac26cb80 1 -- 172.21.15.35:0/2785476335 wait complete. 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 -- start start 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 Processor -- start 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf2994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf2966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf296d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf0638c0 con 0x564faf292be0 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf297440 con 0x564faf2934f0 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf2a3060 con 0x564faf28d960 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdbac26cb80 10 client.0 _ll_register_callbacks cb 0x564faf085230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.312+0000 7fdb9d67a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf2966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf2966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53732/0 (socket says 172.21.15.35:53732) 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 -- 172.21.15.35:0/87366886 learned_addr learned my addr 172.21.15.35:0/87366886 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf296d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf2994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 -- 172.21.15.35:0/87366886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 msgr2=0x564faf2994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf2994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 -- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 msgr2=0x564faf296d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf296d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 -- 172.21.15.35:0/87366886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb94010c50 con 0x564faf292be0 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf2966d0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fdb880116a0 tx=0x7fdb880119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b77898cdbf1aa0e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb817fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb817fa700 1 -- 172.21.15.35:0/87366886 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88016070 con 0x564faf292be0 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb817fa700 1 -- 172.21.15.35:0/87366886 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(318..318 src has 1..318) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fdb88004320 con 0x564faf292be0 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564faf1a2390 con 0x564faf292be0 2023-03-17T11:09:47.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdb817fa700 1 -- 172.21.15.35:0/87366886 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb880044e0 con 0x564faf292be0 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdbac26cb80 10 client.20133 fetch_fsmap learned FSMap version 102 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.313+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x564faf00dd80 con 0x564faf292be0 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdb817fa700 1 -- 172.21.15.35:0/87366886 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564faf1a2390 con 0x564faf292be0 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdb817fa700 1 -- 172.21.15.35:0/87366886 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdb8801a7c0 con 0x564faf292be0 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdbac26cb80 10 client.20133 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdbac26cb80 10 client.20133 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdbac26cb80 20 client.20133 populate_metadata read hostname 'smithi035' 2023-03-17T11:09:47.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2a7260 0x564faf2a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdbac26cb80 4 client.20133 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564faf1ae600 con 0x564faf2a7260 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.314+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2a7260 0x564faf2a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdb817fa700 10 client.20133 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2a7260 0x564faf2a9670 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7de445263712bd server_cookie=cafa42b03c7ab791 in_seq=0 out_seq=0 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdb817fa700 1 -- 172.21.15.35:0/87366886 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x564faf1ae600 con 0x564faf2a7260 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdb817fa700 10 client.20133 handle_command_reply: tid=0 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdbac26cb80 1 client.20133 shutdown 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 msgr2=0x564faf2966d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.315+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf2966d0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fdb880116a0 tx=0x7fdb880119b0 comp rx=0 tx=0).stop 2023-03-17T11:09:47.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 shutdown_connections 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2a7260 0x564faf2a9670 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf2934f0 0x564faf296d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf28d960 0x564faf2994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/87366886 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf2966d0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdb817fa700 0 client.20133 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 >> 172.21.15.35:0/87366886 conn(0x564faf0ea6b0 msgr2=0x564faf28c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 shutdown_connections 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 1 -- 172.21.15.35:0/87366886 wait complete. 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.316+0000 7fdbac26cb80 20 client.20133 trim_cache size 0 max 16384 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 Processor -- start 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 -- start start 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf28d960 0x564faf287ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf29dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:47.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf298ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:48.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf1a2390 con 0x564faf292be0 2023-03-17T11:09:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf297650 con 0x564faf28d960 2023-03-17T11:09:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf288000 con 0x564faf2934f0 2023-03-17T11:09:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdb9d67a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf29dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdb9d67a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf29dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53740/0 (socket says 172.21.15.35:53740) 2023-03-17T11:09:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdb9d67a700 1 -- 172.21.15.35:0/3294231532 learned_addr learned my addr 172.21.15.35:0/3294231532 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf28d960 0x564faf287ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf298ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.331+0000 7fdb9d67a700 1 -- 172.21.15.35:0/3294231532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 msgr2=0x564faf298ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf298ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9d67a700 1 -- 172.21.15.35:0/3294231532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf28d960 msgr2=0x564faf287ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:51.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf28d960 0x564faf287ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9d67a700 1 -- 172.21.15.35:0/3294231532 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564faf1a6130 con 0x564faf292be0 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf298ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf28d960 0x564faf287ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf29dfb0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fdb8801aba0 tx=0x7fdb880093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd531cf6e1df3b5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb8cff9700 1 -- 172.21.15.35:0/3294231532 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88016070 con 0x564faf292be0 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb8cff9700 1 -- 172.21.15.35:0/3294231532 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb8801ae40 con 0x564faf292be0 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdb8cff9700 1 -- 172.21.15.35:0/3294231532 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88003a60 con 0x564faf292be0 2023-03-17T11:09:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3294231532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 msgr2=0x564faf29dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:09:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf29dfb0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fdb8801aba0 tx=0x7fdb880093d0 comp rx=0 tx=0).stop 2023-03-17T11:09:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3294231532 shutdown_connections 2023-03-17T11:09:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.332+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf298ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf28d960 0x564faf287ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3294231532 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf292be0 0x564faf29dfb0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3294231532 >> 172.21.15.35:0/3294231532 conn(0x564faf0ea6b0 msgr2=0x564faf28cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3294231532 shutdown_connections 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3294231532 wait complete. 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 -- start start 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.333+0000 7fdbac26cb80 1 Processor -- start 2023-03-17T11:09:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 0x564faf29dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf292be0 0x564faf29c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf29c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf29cad0 con 0x564faf28d960 2023-03-17T11:09:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf29cc40 con 0x564faf292be0 2023-03-17T11:09:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564faf29ce00 con 0x564faf2934f0 2023-03-17T11:09:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 10 client.0 _ll_register_callbacks cb 0x564faf085230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:09:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 0x564faf29dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 0x564faf29dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53744/0 (socket says 172.21.15.35:53744) 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 -- 172.21.15.35:0/3935608791 learned_addr learned my addr 172.21.15.35:0/3935608791 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9e67c700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf29c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf292be0 0x564faf29c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 -- 172.21.15.35:0/3935608791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 msgr2=0x564faf29c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf29c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 -- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf292be0 msgr2=0x564faf29c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf292be0 0x564faf29c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 -- 172.21.15.35:0/3935608791 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564faf00dd80 con 0x564faf28d960 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb9de7b700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 0x564faf29dd20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fdb94010f40 tx=0x7fdb9400bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f12861c160dbf2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:09:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb817fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:09:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb817fa700 1 -- 172.21.15.35:0/3935608791 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9402b040 con 0x564faf28d960 2023-03-17T11:09:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdb817fa700 1 -- 172.21.15.35:0/3935608791 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(318..318 src has 1..318) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fdb94017070 con 0x564faf28d960 2023-03-17T11:09:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.334+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564faf25d1e0 con 0x564faf28d960 2023-03-17T11:09:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdb817fa700 1 -- 172.21.15.35:0/3935608791 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb94034ca0 con 0x564faf28d960 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 10 client.20139 fetch_fsmap learned FSMap version 102 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x564faf0341f0 con 0x564faf28d960 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdb817fa700 1 -- 172.21.15.35:0/3935608791 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564faf25d1e0 con 0x564faf28d960 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdb817fa700 1 -- 172.21.15.35:0/3935608791 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdb9401e710 con 0x564faf28d960 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 10 client.20139 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 10 client.20139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 20 client.20139 populate_metadata read hostname 'smithi035' 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2fc3b0 0x564faf2fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 4 client.20139 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564faf063f00 con 0x564faf2fc3b0 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.335+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2fc3b0 0x564faf2fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:09:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.336+0000 7fdb817fa700 10 client.20139 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:29 smithi035 ceph-mon[92535]: pgmap v4391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:31 smithi035 ceph-mon[92535]: pgmap v4392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:33 smithi035 ceph-mon[92535]: pgmap v4393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:35 smithi035 ceph-mon[92535]: pgmap v4394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:37 smithi035 ceph-mon[92535]: pgmap v4395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:39 smithi035 ceph-mon[92535]: pgmap v4396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:41 smithi035 ceph-mon[92535]: pgmap v4397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:43 smithi035 ceph-mon[92535]: pgmap v4398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:45 smithi035 ceph-mon[92535]: pgmap v4399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:47 smithi035 ceph-mon[92535]: pgmap v4400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T11:09:54.624 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:49 smithi035 ceph-mon[92535]: pgmap v4401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:51 smithi035 ceph-mon[92535]: pgmap v4402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.962 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: pgmap v4403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: pgmap v4404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: pgmap v4405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:55 smithi035 ceph-mon[92535]: pgmap v4406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:57 smithi035 ceph-mon[92535]: pgmap v4407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-03-17T11:09:54.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 10:59:59 smithi035 ceph-mon[92535]: pgmap v4408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T11:09:55.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:09:55.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:01 smithi035 ceph-mon[92535]: pgmap v4409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T11:09:55.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:03 smithi035 ceph-mon[92535]: pgmap v4410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T11:09:56.237 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:05 smithi035 ceph-mon[92535]: pgmap v4411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T11:09:56.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:07 smithi035 ceph-mon[92535]: pgmap v4412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T11:09:56.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:09 smithi035 ceph-mon[92535]: pgmap v4413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T11:09:56.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:09 smithi035 ceph-mon[92535]: osdmap e348: 12 total, 12 up, 12 in 2023-03-17T11:09:56.866 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:11 smithi035 ceph-mon[92535]: pgmap v4415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T11:09:56.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:13 smithi035 ceph-mon[92535]: pgmap v4416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:09:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:15 smithi035 ceph-mon[92535]: pgmap v4417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:09:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:17 smithi035 ceph-mon[92535]: pgmap v4418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:09:57.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:17 smithi035 ceph-mon[92535]: osdmap e349: 12 total, 12 up, 12 in 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:19 smithi035 ceph-mon[92535]: pgmap v4420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:21 smithi035 ceph-mon[92535]: pgmap v4421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:23 smithi035 ceph-mon[92535]: pgmap v4422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:25 smithi035 ceph-mon[92535]: pgmap v4423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:27 smithi035 ceph-mon[92535]: pgmap v4424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:29 smithi035 ceph-mon[92535]: pgmap v4425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 89 B/s wr, 11 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:31 smithi035 ceph-mon[92535]: pgmap v4426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:33 smithi035 ceph-mon[92535]: pgmap v4427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:35 smithi035 ceph-mon[92535]: pgmap v4428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:37 smithi035 ceph-mon[92535]: pgmap v4429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:39 smithi035 ceph-mon[92535]: pgmap v4430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:41 smithi035 ceph-mon[92535]: pgmap v4431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:43 smithi035 ceph-mon[92535]: pgmap v4432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:09:57.632 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:45 smithi035 ceph-mon[92535]: pgmap v4433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:57.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:47 smithi035 ceph-mon[92535]: pgmap v4434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:57.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:49 smithi035 ceph-mon[92535]: pgmap v4435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:09:57.633 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:51 smithi035 ceph-mon[92535]: pgmap v4436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:09:58.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:53 smithi035 ceph-mon[92535]: pgmap v4437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T11:09:58.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:09:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:09:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:09:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:09:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:09:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:09:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:09:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:10:00.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:10:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:10:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:10:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:10:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:10:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:10:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:10:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:10:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:10:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.336+0000 7fdb9d67a700 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2fc3b0 0x564faf2fe7c0 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa83e63be91a438 server_cookie=7d8e0d24fbcb84ba in_seq=0 out_seq=0 2023-03-17T11:10:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.352+0000 7fdb817fa700 1 -- 172.21.15.35:0/3935608791 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564faf063f00 con 0x564faf2fc3b0 2023-03-17T11:10:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.352+0000 7fdb817fa700 10 client.20139 handle_command_reply: tid=0 2023-03-17T11:10:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 client.20139 shutdown 2023-03-17T11:10:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 msgr2=0x564faf29dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 0x564faf29dd20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fdb94010f40 tx=0x7fdb9400bb20 comp rx=0 tx=0).stop 2023-03-17T11:10:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 shutdown_connections 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x564faf2fc3b0 0x564faf2fe7c0 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564faf2934f0 0x564faf29c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdb817fa700 0 client.20139 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x564faf28d960 0x564faf29dd20 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 --2- 172.21.15.35:0/3935608791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564faf292be0 0x564faf29c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 >> 172.21.15.35:0/3935608791 conn(0x564faf0ea6b0 msgr2=0x564faf2906b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 shutdown_connections 2023-03-17T11:10:03.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 1 -- 172.21.15.35:0/3935608791 wait complete. 2023-03-17T11:10:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdbac26cb80 20 client.20139 trim_cache size 0 max 16384 2023-03-17T11:10:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.353+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb8409f6c0 msgr2=0x7fdb840a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb8409f6c0 0x7fdb840a1b70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdb94005950 tx=0x7fdb9400b410 comp rx=0 tx=0).stop 2023-03-17T11:10:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 msgr2=0x7fdb981a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb981a4500 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009fd0 tx=0x7fdb9000cce0 comp rx=0 tx=0).stop 2023-03-17T11:10:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 shutdown_connections 2023-03-17T11:10:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdb8409f6c0 0x7fdb840a1b70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:07.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdb98105510 0x7fdb981a4500 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:07.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb980fe970 0x7fdb980ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:07.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 --2- 172.21.15.35:0/3981710491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb980ff310 0x7fdb980ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 >> 172.21.15.35:0/3981710491 conn(0x7fdb980757a0 msgr2=0x7fdb980fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 shutdown_connections 2023-03-17T11:10:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:14.354+0000 7fdba00df700 1 -- 172.21.15.35:0/3981710491 wait complete. 2023-03-17T11:10:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 -- 172.21.15.35:0/3094203363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c0ffcf0 msgr2=0x7f807c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 --2- 172.21.15.35:0/3094203363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c0ffcf0 0x7f807c103cb0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f80700099c0 tx=0x7f8070009cd0 comp rx=0 tx=0).stop 2023-03-17T11:10:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 -- 172.21.15.35:0/3094203363 shutdown_connections 2023-03-17T11:10:07.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 --2- 172.21.15.35:0/3094203363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c104390 0x7f807c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 --2- 172.21.15.35:0/3094203363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 0x7f807c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 --2- 172.21.15.35:0/3094203363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c0ffcf0 0x7f807c103cb0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 -- 172.21.15.35:0/3094203363 >> 172.21.15.35:0/3094203363 conn(0x7f807c076330 msgr2=0x7f807c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 -- 172.21.15.35:0/3094203363 shutdown_connections 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.476+0000 7f808093c700 1 -- 172.21.15.35:0/3094203363 wait complete. 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 Processor -- start 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 -- start start 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 0x7f807c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0ffcf0 0x7f807c197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 0x7f807c1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c197f50 con 0x7f807c104390 2023-03-17T11:10:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c1a26c0 con 0x7f807c0ffcf0 2023-03-17T11:10:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f808093c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c1a2830 con 0x7f807c0ff350 2023-03-17T11:10:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.477+0000 7f807ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 0x7f807c1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 0x7f807c1a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53762/0 (socket says 172.21.15.35:53762) 2023-03-17T11:10:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 -- 172.21.15.35:0/2799774447 learned_addr learned my addr 172.21.15.35:0/2799774447 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807a59c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 0x7f807c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f8079d9b700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0ffcf0 0x7f807c197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 -- 172.21.15.35:0/2799774447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 msgr2=0x7f807c197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 0x7f807c197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 -- 172.21.15.35:0/2799774447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0ffcf0 msgr2=0x7f807c197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0ffcf0 0x7f807c197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 -- 172.21.15.35:0/2799774447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80700095f0 con 0x7f807c104390 2023-03-17T11:10:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807a59c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 0x7f807c197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:10:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f807ad9d700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 0x7f807c1a2180 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f8074007ee0 tx=0x7f807400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f806b7fe700 1 -- 172.21.15.35:0/2799774447 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400ddd0 con 0x7f807c104390 2023-03-17T11:10:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c10efc0 con 0x7f807c104390 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f806b7fe700 1 -- 172.21.15.35:0/2799774447 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f807400f040 con 0x7f807c104390 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f806b7fe700 1 -- 172.21.15.35:0/2799774447 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074004870 con 0x7f807c104390 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.478+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c10ee30 con 0x7f807c104390 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.481+0000 7f806b7fe700 1 -- 172.21.15.35:0/2799774447 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8074003a00 con 0x7f807c104390 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f806b7fe700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f806409f640 0x7f80640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807a59c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f806409f640 0x7f80640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f806b7fe700 1 -- 172.21.15.35:0/2799774447 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f80740c9f90 con 0x7f807c104390 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807a59c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f806409f640 0x7f80640a1af0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f806c00bc10 tx=0x7f806c00b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 Processor -- start 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 -- start start 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c46420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c46d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00b4d010 con 0x563b00c46960 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00b9f950 con 0x563b00c4bbe0 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f808cac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00b98de0 con 0x563b00c4c4f0 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c46d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c46d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53770/0 (socket says 172.21.15.35:53770) 2023-03-17T11:10:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807ad9d700 1 -- 172.21.15.35:0/2957980246 learned_addr learned my addr 172.21.15.35:0/2957980246 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f8079d9b700 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c46420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807a59c700 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807ad9d700 1 -- 172.21.15.35:0/2957980246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 msgr2=0x563b00c46420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.483+0000 7f807ad9d700 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c46420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f807ad9d700 1 -- 172.21.15.35:0/2957980246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 msgr2=0x563b00c4bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f807ad9d700 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f807ad9d700 1 -- 172.21.15.35:0/2957980246 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b00a1a5d0 con 0x563b00c46960 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f807ad9d700 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c46d90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f80740c7780 tx=0x7f8074097810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4814f46d919b1a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f8068ff9700 1 -- 172.21.15.35:0/2957980246 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074098ea0 con 0x563b00c46960 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f8068ff9700 1 -- 172.21.15.35:0/2957980246 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8074097a40 con 0x563b00c46960 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.484+0000 7f8068ff9700 1 -- 172.21.15.35:0/2957980246 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074097ca0 con 0x563b00c46960 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- 172.21.15.35:0/2957980246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 msgr2=0x563b00c46d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c46d90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f80740c7780 tx=0x7f8074097810 comp rx=0 tx=0).stop 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- 172.21.15.35:0/2957980246 shutdown_connections 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c46d90 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- 172.21.15.35:0/2957980246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c46420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- 172.21.15.35:0/2957980246 >> 172.21.15.35:0/2957980246 conn(0x563b00aa36b0 msgr2=0x563b00c40a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- 172.21.15.35:0/2957980246 shutdown_connections 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- 172.21.15.35:0/2957980246 wait complete. 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- start start 2023-03-17T11:10:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 Processor -- start 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00a1c8c0 con 0x563b00c46960 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c52900 con 0x563b00c4bbe0 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.485+0000 7f808cac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c5c000 con 0x563b00c4c4f0 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f808cac9b80 10 client.0 _ll_register_callbacks cb 0x563b00a3e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c4f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53772/0 (socket says 172.21.15.35:53772) 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 -- 172.21.15.35:0/547442547 learned_addr learned my addr 172.21.15.35:0/547442547 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807ad9d700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f8079d9b700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 -- 172.21.15.35:0/547442547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 msgr2=0x563b00c501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 -- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 msgr2=0x563b00c4fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 -- 172.21.15.35:0/547442547 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80740c7e70 con 0x563b00c46960 2023-03-17T11:10:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f807a59c700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c4f760 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f806c00ff10 tx=0x7f806c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f41f978cbbb69b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f8061ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f8061ffb700 1 -- 172.21.15.35:0/547442547 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c01f630 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f8061ffb700 1 -- 172.21.15.35:0/547442547 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f806c01f790 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b00b5b390 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f8061ffb700 1 -- 172.21.15.35:0/547442547 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f806c011e70 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f808cac9b80 10 client.20151 fetch_fsmap learned FSMap version 102 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.486+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x563b009c6d80 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f8061ffb700 1 -- 172.21.15.35:0/547442547 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b00b5b390 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f8061ffb700 1 -- 172.21.15.35:0/547442547 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f806c025020 con 0x563b00c46960 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f808cac9b80 10 client.20151 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f808cac9b80 10 client.20151 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f808cac9b80 20 client.20151 populate_metadata read hostname 'smithi035' 2023-03-17T11:10:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f808cac9b80 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00c601f0 0x563b00c62600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f808cac9b80 4 client.20151 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b00b67600 con 0x563b00c601f0 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.487+0000 7f8079d9b700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00c601f0 0x563b00c62600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f8061ffb700 10 client.20151 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f8079d9b700 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00c601f0 0x563b00c62600 crc :-1 s=READY pgs=600 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=503b4fe58b08e1bc server_cookie=f45ae4f525735a9a in_seq=0 out_seq=0 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f8061ffb700 1 -- 172.21.15.35:0/547442547 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563b00b67600 con 0x563b00c601f0 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f8061ffb700 10 client.20151 handle_command_reply: tid=0 2023-03-17T11:10:15.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 client.20151 shutdown 2023-03-17T11:10:15.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 msgr2=0x563b00c4f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:15.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c4f760 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f806c00ff10 tx=0x7f806c004750 comp rx=0 tx=0).stop 2023-03-17T11:10:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 shutdown_connections 2023-03-17T11:10:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00c601f0 0x563b00c62600 crc :-1 s=READY pgs=600 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c4c4f0 0x563b00c501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f8061ffb700 0 client.20151 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c46960 0x563b00c4f760 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 --2- 172.21.15.35:0/547442547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4bbe0 0x563b00c4fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 >> 172.21.15.35:0/547442547 conn(0x563b00aa36b0 msgr2=0x563b00c45410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 shutdown_connections 2023-03-17T11:10:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.488+0000 7f808cac9b80 1 -- 172.21.15.35:0/547442547 wait complete. 2023-03-17T11:10:18.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.489+0000 7f808cac9b80 20 client.20151 trim_cache size 0 max 16384 2023-03-17T11:10:18.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.503+0000 7f808cac9b80 1 Processor -- start 2023-03-17T11:10:18.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.503+0000 7f808cac9b80 1 -- start start 2023-03-17T11:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c49dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c40ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c50010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f808cac9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00b5c050 con 0x563b00c4bbe0 2023-03-17T11:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f808cac9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c3c0f0 con 0x563b00c4c4f0 2023-03-17T11:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f808cac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c41000 con 0x563b00c46960 2023-03-17T11:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c40ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c40ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53782/0 (socket says 172.21.15.35:53782) 2023-03-17T11:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 -- 172.21.15.35:0/1139734246 learned_addr learned my addr 172.21.15.35:0/1139734246 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f807a59c700 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c49dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f807ad9d700 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c50010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:21.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:10:21.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:10:21.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:54 smithi035 ceph-mon[92535]: pgmap v4438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T11:10:21.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:54 smithi035 ceph-mon[92535]: pgmap v4439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:10:21.361 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:10:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 -- 172.21.15.35:0/1139734246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 msgr2=0x563b00c49dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c49dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 -- 172.21.15.35:0/1139734246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 msgr2=0x563b00c50010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c50010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 -- 172.21.15.35:0/1139734246 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b00b5f130 con 0x563b00c4bbe0 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f807ad9d700 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c50010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.504+0000 7f8079d9b700 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c40ac0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f807c1000c0 tx=0x7f80700092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735fd53d63d3dade server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f80697fa700 1 -- 172.21.15.35:0/1139734246 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070028ac0 con 0x563b00c4bbe0 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f80697fa700 1 -- 172.21.15.35:0/1139734246 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f807001e040 con 0x563b00c4bbe0 2023-03-17T11:10:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f80697fa700 1 -- 172.21.15.35:0/1139734246 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807000b730 con 0x563b00c4bbe0 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 -- 172.21.15.35:0/1139734246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 msgr2=0x563b00c40ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c40ac0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f807c1000c0 tx=0x7f80700092f0 comp rx=0 tx=0).stop 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 -- 172.21.15.35:0/1139734246 shutdown_connections 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c50010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c49dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 --2- 172.21.15.35:0/1139734246 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c40ac0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 -- 172.21.15.35:0/1139734246 >> 172.21.15.35:0/1139734246 conn(0x563b00aa36b0 msgr2=0x563b00c496b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 -- 172.21.15.35:0/1139734246 shutdown_connections 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.505+0000 7f808cac9b80 1 -- 172.21.15.35:0/1139734246 wait complete. 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 -- start start 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 Processor -- start 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c56d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c55050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c55590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c55ad0 con 0x563b00c4bbe0 2023-03-17T11:10:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c55c40 con 0x563b00c4c4f0 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b00c55e00 con 0x563b00c46960 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f808cac9b80 10 client.0 _ll_register_callbacks cb 0x563b00a3e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c55050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c55050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53788/0 (socket says 172.21.15.35:53788) 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 -- 172.21.15.35:0/3408204198 learned_addr learned my addr 172.21.15.35:0/3408204198 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f807a59c700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c56d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f807ad9d700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c55590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 -- 172.21.15.35:0/3408204198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 msgr2=0x563b00c56d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c56d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 -- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 msgr2=0x563b00c55590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c55590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.506+0000 7f8079d9b700 1 -- 172.21.15.35:0/3408204198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c10c7a0 con 0x563b00c4bbe0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8079d9b700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c55050 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f80700098e0 tx=0x7f8070005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73a3e5104bce3ac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8061ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8061ffb700 1 -- 172.21.15.35:0/3408204198 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070028420 con 0x563b00c4bbe0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8061ffb700 1 -- 172.21.15.35:0/3408204198 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8070028580 con 0x563b00c4bbe0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b00c161e0 con 0x563b00c4bbe0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8061ffb700 1 -- 172.21.15.35:0/3408204198 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8070005320 con 0x563b00c4bbe0 2023-03-17T11:10:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 10 client.20157 fetch_fsmap learned FSMap version 102 2023-03-17T11:10:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x563b009ed1f0 con 0x563b00c4bbe0 2023-03-17T11:10:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8061ffb700 1 -- 172.21.15.35:0/3408204198 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8070042020 con 0x563b00c4bbe0 2023-03-17T11:10:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f8061ffb700 1 -- 172.21.15.35:0/3408204198 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f80700099f0 con 0x563b00c4bbe0 2023-03-17T11:10:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 10 client.20157 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:10:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 10 client.20157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 20 client.20157 populate_metadata read hostname 'smithi035' 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00cb4f50 0x563b00cb7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 4 client.20157 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.507+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563b00a1cf00 con 0x563b00cb4f50 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.508+0000 7f807a59c700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00cb4f50 0x563b00cb7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.508+0000 7f8061ffb700 10 client.20157 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.508+0000 7f807a59c700 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00cb4f50 0x563b00cb7360 crc :-1 s=READY pgs=601 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa1cfaeb20f6758 server_cookie=4a98b5fd3546653f in_seq=0 out_seq=0 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.517+0000 7f8061ffb700 1 -- 172.21.15.35:0/3408204198 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563b00a1cf00 con 0x563b00cb4f50 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.517+0000 7f8061ffb700 10 client.20157 handle_command_reply: tid=0 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.517+0000 7f808cac9b80 1 client.20157 shutdown 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 msgr2=0x563b00c55050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c55050 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f80700098e0 tx=0x7f8070005ae0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 shutdown_connections 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563b00cb4f50 0x563b00cb7360 crc :-1 s=READY pgs=601 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563b00c4c4f0 0x563b00c55590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f8061ffb700 0 client.20157 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b00c46960 0x563b00c56d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 --2- 172.21.15.35:0/3408204198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563b00c4bbe0 0x563b00c55050 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 >> 172.21.15.35:0/3408204198 conn(0x563b00aa36b0 msgr2=0x563b00c4df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 shutdown_connections 2023-03-17T11:10:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 1 -- 172.21.15.35:0/3408204198 wait complete. 2023-03-17T11:10:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808cac9b80 20 client.20157 trim_cache size 0 max 16384 2023-03-17T11:10:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f806409f640 msgr2=0x7f80640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f806409f640 0x7f80640a1af0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f806c00bc10 tx=0x7f806c00b5f0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 msgr2=0x7f807c1a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 0x7f807c1a2180 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f8074007ee0 tx=0x7f807400d3b0 comp rx=0 tx=0).stop 2023-03-17T11:10:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 shutdown_connections 2023-03-17T11:10:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f806409f640 0x7f80640a1af0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f807c104390 0x7f807c1a2180 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f807c0ff350 0x7f807c197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 --2- 172.21.15.35:0/2799774447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0ffcf0 0x7f807c197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.518+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 >> 172.21.15.35:0/2799774447 conn(0x7f807c076330 msgr2=0x7f807c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.519+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 shutdown_connections 2023-03-17T11:10:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:27.519+0000 7f808093c700 1 -- 172.21.15.35:0/2799774447 wait complete. 2023-03-17T11:10:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 -- 172.21.15.35:0/855989099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 msgr2=0x7f23440ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 --2- 172.21.15.35:0/855989099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f23440ff720 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f23340099c0 tx=0x7f2334009cd0 comp rx=0 tx=0).stop 2023-03-17T11:10:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 -- 172.21.15.35:0/855989099 shutdown_connections 2023-03-17T11:10:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 --2- 172.21.15.35:0/855989099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344104390 0x7f234410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 --2- 172.21.15.35:0/855989099 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f23440ff720 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 --2- 172.21.15.35:0/855989099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440ffcf0 0x7f2344103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:35.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 -- 172.21.15.35:0/855989099 >> 172.21.15.35:0/855989099 conn(0x7f2344076330 msgr2=0x7f2344076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 -- 172.21.15.35:0/855989099 shutdown_connections 2023-03-17T11:10:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.641+0000 7f234a696700 1 -- 172.21.15.35:0/855989099 wait complete. 2023-03-17T11:10:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 Processor -- start 2023-03-17T11:10:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 -- start start 2023-03-17T11:10:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f2344194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440ffcf0 0x7f2344195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344104390 0x7f2344195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441a4830 con 0x7f23440ff350 2023-03-17T11:10:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441a49a0 con 0x7f23440ffcf0 2023-03-17T11:10:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.642+0000 7f234a696700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441a4b60 con 0x7f2344104390 2023-03-17T11:10:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f2344194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f2344194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53800/0 (socket says 172.21.15.35:53800) 2023-03-17T11:10:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 -- 172.21.15.35:0/932266789 learned_addr learned my addr 172.21.15.35:0/932266789 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f23437fe700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440ffcf0 0x7f2344195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2348c33700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344104390 0x7f2344195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 -- 172.21.15.35:0/932266789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344104390 msgr2=0x7f2344195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344104390 0x7f2344195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 -- 172.21.15.35:0/932266789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440ffcf0 msgr2=0x7f2344195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440ffcf0 0x7f2344195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 -- 172.21.15.35:0/932266789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23340095f0 con 0x7f23440ff350 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f2343fff700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f2344194ff0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f2334005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f23417fa700 1 -- 172.21.15.35:0/932266789 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233401d070 con 0x7f23440ff350 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f23417fa700 1 -- 172.21.15.35:0/932266789 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2334022470 con 0x7f23440ff350 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234410f050 con 0x7f23440ff350 2023-03-17T11:10:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f23417fa700 1 -- 172.21.15.35:0/932266789 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334017650 con 0x7f23440ff350 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.643+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234410eec0 con 0x7f23440ff350 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.645+0000 7f23417fa700 1 -- 172.21.15.35:0/932266789 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f23340225e0 con 0x7f23440ff350 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.646+0000 7f23417fa700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f232c09f640 0x7f232c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.646+0000 7f23417fa700 1 -- 172.21.15.35:0/932266789 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f23340cb860 con 0x7f23440ff350 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.646+0000 7f23437fe700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f232c09f640 0x7f232c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f23437fe700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f232c09f640 0x7f232c0a1af0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2344068940 tx=0x7f2338009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 Processor -- start 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 -- start start 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de65fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36de60420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de60d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36dd67010 con 0x55f36de664f0 2023-03-17T11:10:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36ddb9950 con 0x55f36de60960 2023-03-17T11:10:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f2356823b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36ddb2de0 con 0x55f36de65be0 2023-03-17T11:10:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.647+0000 7f23437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36de60420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36de60420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53810/0 (socket says 172.21.15.35:53810) 2023-03-17T11:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 -- 172.21.15.35:0/1247646027 learned_addr learned my addr 172.21.15.35:0/1247646027 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f2348c33700 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de60d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f2343fff700 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de65fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 -- 172.21.15.35:0/1247646027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 msgr2=0x55f36de65fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de65fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 -- 172.21.15.35:0/1247646027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 msgr2=0x55f36de60d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de60d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 -- 172.21.15.35:0/1247646027 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f36dc345d0 con 0x55f36de664f0 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f2343fff700 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de65fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f23437fe700 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36de60420 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f23380095f0 tx=0x7f2338014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e34c8799e03c67 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f232a7fc700 1 -- 172.21.15.35:0/1247646027 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338012bc0 con 0x55f36de664f0 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f232a7fc700 1 -- 172.21.15.35:0/1247646027 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2338016070 con 0x55f36de664f0 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.648+0000 7f232a7fc700 1 -- 172.21.15.35:0/1247646027 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338003bb0 con 0x55f36de664f0 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 -- 172.21.15.35:0/1247646027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 msgr2=0x55f36de60420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36de60420 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f23380095f0 tx=0x7f2338014000 comp rx=0 tx=0).stop 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 -- 172.21.15.35:0/1247646027 shutdown_connections 2023-03-17T11:10:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de60d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de65fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 --2- 172.21.15.35:0/1247646027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36de60420 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 -- 172.21.15.35:0/1247646027 >> 172.21.15.35:0/1247646027 conn(0x55f36dcbd6b0 msgr2=0x55f36de5aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 -- 172.21.15.35:0/1247646027 shutdown_connections 2023-03-17T11:10:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 -- 172.21.15.35:0/1247646027 wait complete. 2023-03-17T11:10:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.649+0000 7f2356823b80 1 -- start start 2023-03-17T11:10:48.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 Processor -- start 2023-03-17T11:10:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de6c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 0x55f36de696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de664f0 0x55f36de69d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36dc368c0 con 0x55f36de65be0 2023-03-17T11:10:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36de6a490 con 0x55f36de60960 2023-03-17T11:10:48.313 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:56 smithi035 ceph-mon[92535]: pgmap v4440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:10:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36de75ff0 con 0x55f36de664f0 2023-03-17T11:10:48.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2356823b80 10 client.0 _ll_register_callbacks cb 0x55f36dc58230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:10:48.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 0x55f36de696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 0x55f36de696e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53816/0 (socket says 172.21.15.35:53816) 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 -- 172.21.15.35:0/1895386888 learned_addr learned my addr 172.21.15.35:0/1895386888 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2343fff700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de6c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2348c33700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de664f0 0x55f36de69d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 -- 172.21.15.35:0/1895386888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de664f0 msgr2=0x55f36de69d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de664f0 0x55f36de69d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 -- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 msgr2=0x55f36de6c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de6c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f23437fe700 1 -- 172.21.15.35:0/1895386888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2338011a90 con 0x55f36de65be0 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.650+0000 7f2348c33700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de664f0 0x55f36de69d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:10:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23437fe700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 0x55f36de696e0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2338011840 tx=0x7f2338005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a300892a67efe0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23237fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23237fe700 1 -- 172.21.15.35:0/1895386888 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233802e070 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23237fe700 1 -- 172.21.15.35:0/1895386888 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2338018070 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f36dd75390 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23237fe700 1 -- 172.21.15.35:0/1895386888 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23380296d0 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 10 client.20169 fetch_fsmap learned FSMap version 102 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55f36dbe0d80 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23237fe700 1 -- 172.21.15.35:0/1895386888 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f36dd75390 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f23237fe700 1 -- 172.21.15.35:0/1895386888 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2338025070 con 0x55f36de65be0 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 10 client.20169 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 10 client.20169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 20 client.20169 populate_metadata read hostname 'smithi035' 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36de79ff0 0x55f36de7c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 4 client.20169 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:10:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.651+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f36dd81600 con 0x55f36de79ff0 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.652+0000 7f2343fff700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36de79ff0 0x55f36de7c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.652+0000 7f23237fe700 10 client.20169 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.652+0000 7f2343fff700 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36de79ff0 0x55f36de7c400 crc :-1 s=READY pgs=602 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb8f3c9323aabd server_cookie=c7602cb058ae57df in_seq=0 out_seq=0 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f23237fe700 1 -- 172.21.15.35:0/1895386888 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f36dd81600 con 0x55f36de79ff0 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f23237fe700 10 client.20169 handle_command_reply: tid=0 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 client.20169 shutdown 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 msgr2=0x55f36de696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 0x55f36de696e0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2338011840 tx=0x7f2338005da0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 shutdown_connections 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36de79ff0 0x55f36de7c400 crc :-1 s=READY pgs=602 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de664f0 0x55f36de69d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36de6c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 --2- 172.21.15.35:0/1895386888 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de65be0 0x55f36de696e0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f23237fe700 0 client.20169 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 >> 172.21.15.35:0/1895386888 conn(0x55f36dcbd6b0 msgr2=0x55f36de5f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 shutdown_connections 2023-03-17T11:10:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 1 -- 172.21.15.35:0/1895386888 wait complete. 2023-03-17T11:10:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.653+0000 7f2356823b80 20 client.20169 trim_cache size 0 max 16384 2023-03-17T11:10:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 Processor -- start 2023-03-17T11:10:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 -- start start 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 0x55f36de5aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de70f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de664f0 0x55f36de5fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36de5b710 con 0x55f36de60960 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36de76ac0 con 0x55f36de664f0 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2356823b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36de5b000 con 0x55f36de65be0 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2343fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 0x55f36de5aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2343fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 0x55f36de5aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53822/0 (socket says 172.21.15.35:53822) 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.668+0000 7f2343fff700 1 -- 172.21.15.35:0/3463905833 learned_addr learned my addr 172.21.15.35:0/3463905833 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2348c33700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de664f0 0x55f36de5fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:54.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f23437fe700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de70f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2343fff700 1 -- 172.21.15.35:0/3463905833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 msgr2=0x55f36de70f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2343fff700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de70f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2343fff700 1 -- 172.21.15.35:0/3463905833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de664f0 msgr2=0x55f36de5fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2343fff700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de664f0 0x55f36de5fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2343fff700 1 -- 172.21.15.35:0/3463905833 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f36dd79130 con 0x55f36de60960 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f23437fe700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de70f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2348c33700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de664f0 0x55f36de5fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f2343fff700 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 0x55f36de5aac0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f23340c95f0 tx=0x7f2334095790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990502ac4bd373de server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f232affd700 1 -- 172.21.15.35:0/3463905833 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334097740 con 0x55f36de60960 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f232affd700 1 -- 172.21.15.35:0/3463905833 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f233409d0b0 con 0x55f36de60960 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.669+0000 7f232affd700 1 -- 172.21.15.35:0/3463905833 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334099600 con 0x55f36de60960 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 -- 172.21.15.35:0/3463905833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 msgr2=0x55f36de5aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 0x55f36de5aac0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f23340c95f0 tx=0x7f2334095790 comp rx=0 tx=0).stop 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 -- 172.21.15.35:0/3463905833 shutdown_connections 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de664f0 0x55f36de5fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:54.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de60960 0x55f36de5aac0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 --2- 172.21.15.35:0/3463905833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36de70f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 -- 172.21.15.35:0/3463905833 >> 172.21.15.35:0/3463905833 conn(0x55f36dcbd6b0 msgr2=0x55f36de763b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 -- 172.21.15.35:0/3463905833 shutdown_connections 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 -- 172.21.15.35:0/3463905833 wait complete. 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 -- start start 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 Processor -- start 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36dec1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.670+0000 7f2356823b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36dec2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2356823b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36dec6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2356823b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36dec7410 con 0x55f36de664f0 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2356823b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36dec7580 con 0x55f36de60960 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2356823b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f36dec7740 con 0x55f36de65be0 2023-03-17T11:10:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2356823b80 10 client.0 _ll_register_callbacks cb 0x55f36dc58230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36dec6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36dec6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53832/0 (socket says 172.21.15.35:53832) 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 -- 172.21.15.35:0/1520381294 learned_addr learned my addr 172.21.15.35:0/1520381294 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2343fff700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36dec1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f23437fe700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36dec2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 -- 172.21.15.35:0/1520381294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 msgr2=0x55f36dec2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36dec2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 -- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 msgr2=0x55f36dec1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:10:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36dec1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 -- 172.21.15.35:0/1520381294 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234410eec0 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2343fff700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36dec1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2348c33700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36dec6ea0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f233c007b20 tx=0x7f233c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8bd9cdb0e27304 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f23237fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f23237fe700 1 -- 172.21.15.35:0/1520381294 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0095e0 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f23237fe700 1 -- 172.21.15.35:0/1520381294 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f233c009e30 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.671+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f36de301e0 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f23237fe700 1 -- 172.21.15.35:0/1520381294 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f233c015b90 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 10 client.20175 fetch_fsmap learned FSMap version 102 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55f36dc071f0 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f23237fe700 1 -- 172.21.15.35:0/1520381294 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f36de301e0 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f23237fe700 1 -- 172.21.15.35:0/1520381294 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f233c0213b0 con 0x55f36de664f0 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 10 client.20175 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 10 client.20175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 20 client.20175 populate_metadata read hostname 'smithi035' 2023-03-17T11:10:56.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36deceed0 0x55f36ded12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 4 client.20175 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f36dc36f00 con 0x55f36deceed0 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.672+0000 7f2343fff700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36deceed0 0x55f36ded12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.673+0000 7f23237fe700 10 client.20175 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.673+0000 7f2343fff700 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36deceed0 0x55f36ded12e0 crc :-1 s=READY pgs=603 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81d543da29607bbc server_cookie=a98bbb0b831df0a in_seq=0 out_seq=0 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f23237fe700 1 -- 172.21.15.35:0/1520381294 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f36dc36f00 con 0x55f36deceed0 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f23237fe700 10 client.20175 handle_command_reply: tid=0 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 client.20175 shutdown 2023-03-17T11:10:56.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 msgr2=0x55f36dec6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36dec6ea0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f233c007b20 tx=0x7f233c007e30 comp rx=0 tx=0).stop 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 shutdown_connections 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f36deceed0 0x55f36ded12e0 crc :-1 s=READY pgs=603 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f36de664f0 0x55f36dec6ea0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f36de60960 0x55f36dec1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 --2- 172.21.15.35:0/1520381294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f36de65be0 0x55f36dec2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f23237fe700 0 client.20175 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 >> 172.21.15.35:0/1520381294 conn(0x55f36dcbd6b0 msgr2=0x55f36de636b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 shutdown_connections 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 1 -- 172.21.15.35:0/1520381294 wait complete. 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.685+0000 7f2356823b80 20 client.20175 trim_cache size 0 max 16384 2023-03-17T11:10:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f232c09f640 msgr2=0x7f232c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f232c09f640 0x7f232c0a1af0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2344068940 tx=0x7f2338009260 comp rx=0 tx=0).stop 2023-03-17T11:10:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 msgr2=0x7f2344194ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f2344194ff0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f2334005f10 comp rx=0 tx=0).stop 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 shutdown_connections 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f232c09f640 0x7f232c0a1af0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344104390 0x7f2344195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23440ff350 0x7f2344194ff0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 --2- 172.21.15.35:0/932266789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23440ffcf0 0x7f2344195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 >> 172.21.15.35:0/932266789 conn(0x7f2344076330 msgr2=0x7f23440fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 shutdown_connections 2023-03-17T11:10:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:40.686+0000 7f234a696700 1 -- 172.21.15.35:0/932266789 wait complete. 2023-03-17T11:10:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 -- 172.21.15.35:0/4226934003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ffcf0 msgr2=0x7f1bfc103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:10:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4226934003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ffcf0 0x7f1bfc103cb0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00099c0 tx=0x7f1bf0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 -- 172.21.15.35:0/4226934003 shutdown_connections 2023-03-17T11:10:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4226934003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bfc104390 0x7f1bfc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4226934003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4226934003 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ffcf0 0x7f1bfc103cb0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 -- 172.21.15.35:0/4226934003 >> 172.21.15.35:0/4226934003 conn(0x7f1bfc076330 msgr2=0x7f1bfc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 -- 172.21.15.35:0/4226934003 shutdown_connections 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.808+0000 7f1c009f2700 1 -- 172.21.15.35:0/4226934003 wait complete. 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 Processor -- start 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 -- start start 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bfc0ffcf0 0x7f1bfc196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc104390 0x7f1bfc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc19b230 con 0x7f1bfc0ff350 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc19b3a0 con 0x7f1bfc0ffcf0 2023-03-17T11:10:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1c009f2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc19b560 con 0x7f1bfc104390 2023-03-17T11:10:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:10:59.187 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:00:58 smithi035 ceph-mon[92535]: pgmap v4441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:10:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53842/0 (socket says 172.21.15.35:53842) 2023-03-17T11:11:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 -- 172.21.15.35:0/4087885655 learned_addr learned my addr 172.21.15.35:0/4087885655 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bfc0ffcf0 0x7f1bfc196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc104390 0x7f1bfc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 -- 172.21.15.35:0/4087885655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc104390 msgr2=0x7f1bfc19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc104390 0x7f1bfc19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 -- 172.21.15.35:0/4087885655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bfc0ffcf0 msgr2=0x7f1bfc196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:04.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bfc0ffcf0 0x7f1bfc196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.809+0000 7f1bfa59c700 1 -- 172.21.15.35:0/4087885655 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00095f0 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.810+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc196250 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d950 tx=0x7f1bec00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.810+0000 7f1beb7fe700 1 -- 172.21.15.35:0/4087885655 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec009b40 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.810+0000 7f1beb7fe700 1 -- 172.21.15.35:0/4087885655 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bec009ca0 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.810+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc10f010 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.810+0000 7f1beb7fe700 1 -- 172.21.15.35:0/4087885655 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00f620 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.810+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc10ee80 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.813+0000 7f1beb7fe700 1 -- 172.21.15.35:0/4087885655 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1bec010460 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.813+0000 7f1beb7fe700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1be409f6c0 0x7f1be40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.813+0000 7f1beb7fe700 1 -- 172.21.15.35:0/4087885655 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1bec0ca940 con 0x7f1bfc0ff350 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.813+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1be409f6c0 0x7f1be40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1be409f6c0 0x7f1be40a1b70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000b580 tx=0x7f1bf0005fd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 Processor -- start 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 -- start start 2023-03-17T11:11:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fa9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 0x55e5f4fadc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fae170 0x55e5f4fae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4eac010 con 0x55e5f4faa330 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4efe950 con 0x55e5f4fae170 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4ef7de0 con 0x55e5f4fa9a20 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.814+0000 7f1bf9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 0x55e5f4fadc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fa9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 0x55e5f4fadc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53852/0 (socket says 172.21.15.35:53852) 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 -- 172.21.15.35:0/4201709279 learned_addr learned my addr 172.21.15.35:0/4201709279 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fae170 0x55e5f4fae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 -- 172.21.15.35:0/4201709279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fa9a20 msgr2=0x55e5f4fa9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fa9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 -- 172.21.15.35:0/4201709279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fae170 msgr2=0x55e5f4fae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:05.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fae170 0x55e5f4fae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 -- 172.21.15.35:0/4201709279 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5f4d795d0 con 0x55e5f4faa330 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 0x55e5f4fadc30 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00099c0 tx=0x7f1bf001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f805f16cbfbc7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1be8ff9700 1 -- 172.21.15.35:0/4201709279 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf002b070 con 0x55e5f4faa330 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1be8ff9700 1 -- 172.21.15.35:0/4201709279 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bf001e040 con 0x55e5f4faa330 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.815+0000 7f1be8ff9700 1 -- 172.21.15.35:0/4201709279 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0004aa0 con 0x55e5f4faa330 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/4201709279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 msgr2=0x55e5f4fadc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 0x55e5f4fadc30 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00099c0 tx=0x7f1bf001f000 comp rx=0 tx=0).stop 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/4201709279 shutdown_connections 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fae170 0x55e5f4fae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fa9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/4201709279 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4faa330 0x55e5f4fadc30 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/4201709279 >> 172.21.15.35:0/4201709279 conn(0x55e5f4e026b0 msgr2=0x55e5f4f9fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/4201709279 shutdown_connections 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.816+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/4201709279 wait complete. 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 -- start start 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 Processor -- start 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f4fb32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4d7b8c0 con 0x55e5f4fae170 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4fb3a00 con 0x55e5f4fa9a20 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4fbf320 con 0x55e5f4faa330 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1c0cb7fb80 10 client.0 _ll_register_callbacks cb 0x55e5f4d9d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f4fb32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f4fb32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53860/0 (socket says 172.21.15.35:53860) 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1bfad9d700 1 -- 172.21.15.35:0/3234613895 learned_addr learned my addr 172.21.15.35:0/3234613895 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.817+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfad9d700 1 -- 172.21.15.35:0/3234613895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 msgr2=0x55e5f4fb2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfad9d700 1 -- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 msgr2=0x55e5f4fb5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfad9d700 1 -- 172.21.15.35:0/3234613895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc10c7a0 con 0x55e5f4fae170 2023-03-17T11:11:07.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:11:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:11:07.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f4fb32c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4011d30 tx=0x7f1bf400f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0dfa6af932951d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1be1ffb700 1 -- 172.21.15.35:0/3234613895 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400fac0 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1be1ffb700 1 -- 172.21.15.35:0/3234613895 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1bf400fc20 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5f4eba390 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1be1ffb700 1 -- 172.21.15.35:0/3234613895 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bf400fde0 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1c0cb7fb80 10 client.20187 fetch_fsmap learned FSMap version 102 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55e5f4d25d80 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.818+0000 7f1be1ffb700 1 -- 172.21.15.35:0/3234613895 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e5f4eba390 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1be1ffb700 1 -- 172.21.15.35:0/3234613895 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1bf4014460 con 0x55e5f4fae170 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1c0cb7fb80 10 client.20187 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:11:07.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1c0cb7fb80 10 client.20187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:11:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1c0cb7fb80 20 client.20187 populate_metadata read hostname 'smithi035' 2023-03-17T11:11:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f4fc34a0 0x55e5f4fc58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:07.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1c0cb7fb80 4 client.20187 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:11:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5f4ec6600 con 0x55e5f4fc34a0 2023-03-17T11:11:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f4fc34a0 0x55e5f4fc58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1be1ffb700 10 client.20187 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:09.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.819+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f4fc34a0 0x55e5f4fc58b0 crc :-1 s=READY pgs=604 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afee8bb6ec75c98d server_cookie=2d1ac6783d4d7840 in_seq=0 out_seq=0 2023-03-17T11:11:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1be1ffb700 1 -- 172.21.15.35:0/3234613895 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e5f4ec6600 con 0x55e5f4fc34a0 2023-03-17T11:11:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1be1ffb700 10 client.20187 handle_command_reply: tid=0 2023-03-17T11:11:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 client.20187 shutdown 2023-03-17T11:11:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 msgr2=0x55e5f4fb32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f4fb32c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4011d30 tx=0x7f1bf400f4b0 comp rx=0 tx=0).stop 2023-03-17T11:11:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 shutdown_connections 2023-03-17T11:11:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f4fc34a0 0x55e5f4fc58b0 crc :-1 s=READY pgs=604 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f4fb32c0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:11.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/3234613895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1be1ffb700 0 client.20187 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:11.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.820+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 >> 172.21.15.35:0/3234613895 conn(0x55e5f4e026b0 msgr2=0x55e5f4fa4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.821+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 shutdown_connections 2023-03-17T11:11:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.821+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/3234613895 wait complete. 2023-03-17T11:11:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.821+0000 7f1c0cb7fb80 20 client.20187 trim_cache size 0 max 16384 2023-03-17T11:11:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 Processor -- start 2023-03-17T11:11:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 -- start start 2023-03-17T11:11:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 0x55e5f4f9fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4faa330 0x55e5f4fba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fae170 0x55e5f4fae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4fa0e30 con 0x55e5f4fa9a20 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4fa1620 con 0x55e5f4faa330 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4fa0000 con 0x55e5f4fae170 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 0x55e5f4f9fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 0x55e5f4f9fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53864/0 (socket says 172.21.15.35:53864) 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 -- 172.21.15.35:0/88455733 learned_addr learned my addr 172.21.15.35:0/88455733 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4faa330 0x55e5f4fba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fae170 0x55e5f4fae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 -- 172.21.15.35:0/88455733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fae170 msgr2=0x55e5f4fae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fae170 0x55e5f4fae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 -- 172.21.15.35:0/88455733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4faa330 msgr2=0x55e5f4fba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4faa330 0x55e5f4fba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfa59c700 1 -- 172.21.15.35:0/88455733 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5f4ebe130 con 0x55e5f4fa9a20 2023-03-17T11:11:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.836+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fae170 0x55e5f4fae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 0x55e5f4f9fac0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0c8180 tx=0x7f1bec09b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64202877662d9cf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1be97fa700 1 -- 172.21.15.35:0/88455733 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0983f0 con 0x55e5f4fa9a20 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1be97fa700 1 -- 172.21.15.35:0/88455733 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bec014050 con 0x55e5f4fa9a20 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1be97fa700 1 -- 172.21.15.35:0/88455733 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec094b00 con 0x55e5f4fa9a20 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/88455733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 msgr2=0x55e5f4f9fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 0x55e5f4f9fac0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0c8180 tx=0x7f1bec09b040 comp rx=0 tx=0).stop 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/88455733 shutdown_connections 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4fae170 0x55e5f4fae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fa9a20 0x55e5f4f9fac0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/88455733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4faa330 0x55e5f4fba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/88455733 >> 172.21.15.35:0/88455733 conn(0x55e5f4e026b0 msgr2=0x55e5f4fca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/88455733 shutdown_connections 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.837+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/88455733 wait complete. 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 -- start start 2023-03-17T11:11:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 Processor -- start 2023-03-17T11:11:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f5016340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f5016880 con 0x55e5f4fae170 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f50169c0 con 0x55e5f4fa9a20 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f5016b00 con 0x55e5f4faa330 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1c0cb7fb80 10 client.0 _ll_register_callbacks cb 0x55e5f4d9d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f5016340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55666/0 (socket says 172.21.15.35:55666) 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfa59c700 1 -- 172.21.15.35:0/2085015962 learned_addr learned my addr 172.21.15.35:0/2085015962 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfad9d700 1 -- 172.21.15.35:0/2085015962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 msgr2=0x55e5f4fb8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfad9d700 1 -- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 msgr2=0x55e5f4fb8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfad9d700 1 -- 172.21.15.35:0/2085015962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc10ee80 con 0x55e5f4fae170 2023-03-17T11:11:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bf9d9b700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:11:20.162 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:00 smithi035 ceph-mon[92535]: pgmap v4442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T11:11:21.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:02 smithi035 ceph-mon[92535]: pgmap v4443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T11:11:21.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:04 smithi035 ceph-mon[92535]: pgmap v4444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:11:21.481 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:06 smithi035 ceph-mon[92535]: pgmap v4445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:11:22.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:08 smithi035 ceph-mon[92535]: pgmap v4446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T11:11:22.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:10 smithi035 ceph-mon[92535]: osdmap e350: 12 total, 12 up, 12 in 2023-03-17T11:11:22.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:10 smithi035 ceph-mon[92535]: pgmap v4448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:11:22.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:12 smithi035 ceph-mon[92535]: pgmap v4449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T11:11:22.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:14 smithi035 ceph-mon[92535]: pgmap v4450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:11:22.014 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:16 smithi035 ceph-mon[92535]: pgmap v4451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:11:22.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:18 smithi035 ceph-mon[92535]: osdmap e351: 12 total, 12 up, 12 in 2023-03-17T11:11:22.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:18 smithi035 ceph-mon[92535]: pgmap v4453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 13 op/s 2023-03-17T11:11:23.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:20 smithi035 ceph-mon[92535]: pgmap v4454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:11:23.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:22 smithi035 ceph-mon[92535]: pgmap v4455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T11:11:23.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:24 smithi035 ceph-mon[92535]: pgmap v4456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:11:23.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:25 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:11:23.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:26 smithi035 ceph-mon[92535]: pgmap v4457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:26 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:28 smithi035 ceph-mon[92535]: pgmap v4458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 293 KiB/s wr, 26 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:28 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:30 smithi035 ceph-mon[92535]: pgmap v4459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 22 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:32 smithi035 ceph-mon[92535]: pgmap v4460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 22 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:34 smithi035 ceph-mon[92535]: pgmap v4461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 259 KiB/s wr, 29 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:36 smithi035 ceph-mon[92535]: pgmap v4462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 259 KiB/s wr, 25 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:38 smithi035 ceph-mon[92535]: pgmap v4463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 266 KiB/s wr, 30 op/s 2023-03-17T11:11:23.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:40 smithi035 ceph-mon[92535]: pgmap v4464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:42 smithi035 ceph-mon[92535]: pgmap v4465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:44 smithi035 ceph-mon[92535]: pgmap v4466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 16 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:46 smithi035 ceph-mon[92535]: pgmap v4467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 KiB/s wr, 9 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:48 smithi035 ceph-mon[92535]: pgmap v4468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 KiB/s wr, 13 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:50 smithi035 ceph-mon[92535]: pgmap v4469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:52 smithi035 ceph-mon[92535]: pgmap v4470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:54 smithi035 ceph-mon[92535]: pgmap v4471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.2 KiB/s wr, 25 op/s 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:11:25.262 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:11:25.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:11:25.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:11:25.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:11:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.838+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:11:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1bfad9d700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f5016340 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40116e0 tx=0x7f1bf40077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c5d155e34fed1c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:11:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1be1ffb700 1 -- 172.21.15.35:0/2085015962 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4014ed0 con 0x55e5f4fae170 2023-03-17T11:11:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1be1ffb700 1 -- 172.21.15.35:0/2085015962 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(319..319 src has 1..319) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1bf4014a80 con 0x55e5f4fae170 2023-03-17T11:11:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5f4f751e0 con 0x55e5f4fae170 2023-03-17T11:11:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1be1ffb700 1 -- 172.21.15.35:0/2085015962 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bf40110e0 con 0x55e5f4fae170 2023-03-17T11:11:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 10 client.20193 fetch_fsmap learned FSMap version 102 2023-03-17T11:11:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55e5f4d4c1f0 con 0x55e5f4fae170 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1be1ffb700 1 -- 172.21.15.35:0/2085015962 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bf4037020 con 0x55e5f4fae170 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1be1ffb700 1 -- 172.21.15.35:0/2085015962 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1bf401d700 con 0x55e5f4fae170 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 10 client.20193 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 10 client.20193 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 20 client.20193 populate_metadata read hostname 'smithi035' 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f50181e0 0x55e5f501a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 4 client.20193 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.839+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e5f4d7bf00 con 0x55e5f50181e0 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.840+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f50181e0 0x55e5f501a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.840+0000 7f1be1ffb700 10 client.20193 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.840+0000 7f1bfa59c700 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f50181e0 0x55e5f501a5f0 crc :-1 s=READY pgs=605 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1ddb03bbb624c4 server_cookie=1b9f569b8560f96f in_seq=0 out_seq=0 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1be1ffb700 1 -- 172.21.15.35:0/2085015962 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e5f4d7bf00 con 0x55e5f50181e0 2023-03-17T11:11:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1be1ffb700 10 client.20193 handle_command_reply: tid=0 2023-03-17T11:11:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 client.20193 shutdown 2023-03-17T11:11:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 msgr2=0x55e5f5016340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f5016340 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40116e0 tx=0x7f1bf40077b0 comp rx=0 tx=0).stop 2023-03-17T11:11:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 shutdown_connections 2023-03-17T11:11:28.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5f50181e0 0x55e5f501a5f0 crc :-1 s=READY pgs=605 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5f4fae170 0x55e5f5016340 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5f4fa9a20 0x55e5f4fb8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 --2- 172.21.15.35:0/2085015962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5f4faa330 0x55e5f4fb8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 >> 172.21.15.35:0/2085015962 conn(0x55e5f4e026b0 msgr2=0x55e5f4fae540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1be1ffb700 0 client.20193 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 shutdown_connections 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 1 -- 172.21.15.35:0/2085015962 wait complete. 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.849+0000 7f1c0cb7fb80 20 client.20193 trim_cache size 0 max 16384 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1be409f6c0 msgr2=0x7f1be40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1be409f6c0 0x7f1be40a1b70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000b580 tx=0x7f1bf0005fd0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 msgr2=0x7f1bfc196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc196250 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d950 tx=0x7f1bec00dd10 comp rx=0 tx=0).stop 2023-03-17T11:11:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 shutdown_connections 2023-03-17T11:11:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1be409f6c0 0x7f1be40a1b70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bfc104390 0x7f1bfc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1bfc0ff350 0x7f1bfc196250 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 --2- 172.21.15.35:0/4087885655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bfc0ffcf0 0x7f1bfc196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 >> 172.21.15.35:0/4087885655 conn(0x7f1bfc076330 msgr2=0x7f1bfc067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 shutdown_connections 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:45:53.850+0000 7f1c009f2700 1 -- 172.21.15.35:0/4087885655 wait complete. 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 -- 172.21.15.35:0/4266646480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5830104390 msgr2=0x7f583010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 --2- 172.21.15.35:0/4266646480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5830104390 0x7f583010bf60 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f582800b0d0 tx=0x7f582800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 -- 172.21.15.35:0/4266646480 shutdown_connections 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 --2- 172.21.15.35:0/4266646480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5830104390 0x7f583010bf60 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 --2- 172.21.15.35:0/4266646480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58300ff350 0x7f58300ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 --2- 172.21.15.35:0/4266646480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58300ffcf0 0x7f5830103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 -- 172.21.15.35:0/4266646480 >> 172.21.15.35:0/4266646480 conn(0x7f5830076330 msgr2=0x7f5830076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 -- 172.21.15.35:0/4266646480 shutdown_connections 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.944+0000 7f5834a76700 1 -- 172.21.15.35:0/4266646480 wait complete. 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 Processor -- start 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 -- start start 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58300ff350 0x7f5830196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 0x7f58301968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5830104390 0x7f583019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583019b2e0 con 0x7f58300ffcf0 2023-03-17T11:11:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583019b450 con 0x7f5830104390 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f5834a76700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583019b610 con 0x7f58300ff350 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f582dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 0x7f58301968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f582dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 0x7f58301968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53954/0 (socket says 172.21.15.35:53954) 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f582dd9b700 1 -- 172.21.15.35:0/2031279933 learned_addr learned my addr 172.21.15.35:0/2031279933 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f582e59c700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58300ff350 0x7f5830196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.945+0000 7f582ed9d700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5830104390 0x7f583019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f582dd9b700 1 -- 172.21.15.35:0/2031279933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58300ff350 msgr2=0x7f5830196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f582dd9b700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58300ff350 0x7f5830196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f582dd9b700 1 -- 172.21.15.35:0/2031279933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5830104390 msgr2=0x7f583019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f582dd9b700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5830104390 0x7f583019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f582dd9b700 1 -- 172.21.15.35:0/2031279933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828009d00 con 0x7f58300ffcf0 2023-03-17T11:11:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f582dd9b700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 0x7f58301968b0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f582400e940 tx=0x7f582400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f581f7fe700 1 -- 172.21.15.35:0/2031279933 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824009730 con 0x7f58300ffcf0 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f581f7fe700 1 -- 172.21.15.35:0/2031279933 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f582400ce70 con 0x7f58300ffcf0 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583010efc0 con 0x7f58300ffcf0 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f581f7fe700 1 -- 172.21.15.35:0/2031279933 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824018420 con 0x7f58300ffcf0 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.946+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583010ee30 con 0x7f58300ffcf0 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.948+0000 7f581f7fe700 1 -- 172.21.15.35:0/2031279933 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f582400c9e0 con 0x7f58300ffcf0 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.949+0000 7f581f7fe700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f581809f640 0x7f58180a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.949+0000 7f581f7fe700 1 -- 172.21.15.35:0/2031279933 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(323..323 src has 1..323) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5824014070 con 0x7f58300ffcf0 2023-03-17T11:11:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.949+0000 7f582e59c700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f581809f640 0x7f58180a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.949+0000 7f582e59c700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f581809f640 0x7f58180a1af0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5820009c60 tx=0x7f5820009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 Processor -- start 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 -- start start 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 0x5638358b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358b7960 0x5638358b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638357be010 con 0x5638358bd4f0 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563835810950 con 0x5638358bcbe0 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f5840c03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563835809de0 con 0x5638358b7960 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f582dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 0x5638358b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f582dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 0x5638358b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53962/0 (socket says 172.21.15.35:53962) 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.950+0000 7f582dd9b700 1 -- 172.21.15.35:0/2500573032 learned_addr learned my addr 172.21.15.35:0/2500573032 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582e59c700 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582dd9b700 1 -- 172.21.15.35:0/2500573032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358b7960 msgr2=0x5638358b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582dd9b700 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358b7960 0x5638358b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582dd9b700 1 -- 172.21.15.35:0/2500573032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 msgr2=0x5638358bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582dd9b700 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582dd9b700 1 -- 172.21.15.35:0/2500573032 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56383568b5d0 con 0x5638358bd4f0 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f582dd9b700 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 0x5638358b7420 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f582409ff60 tx=0x7f5824097c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554c66304061b99d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f581cff9700 1 -- 172.21.15.35:0/2500573032 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240982a0 con 0x5638358bd4f0 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f581cff9700 1 -- 172.21.15.35:0/2500573032 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58240a0490 con 0x5638358bd4f0 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.951+0000 7f581cff9700 1 -- 172.21.15.35:0/2500573032 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824097990 con 0x5638358bd4f0 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- 172.21.15.35:0/2500573032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 msgr2=0x5638358b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 0x5638358b7420 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f582409ff60 tx=0x7f5824097c00 comp rx=0 tx=0).stop 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- 172.21.15.35:0/2500573032 shutdown_connections 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358b7960 0x5638358b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- 172.21.15.35:0/2500573032 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358bd4f0 0x5638358b7420 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- 172.21.15.35:0/2500573032 >> 172.21.15.35:0/2500573032 conn(0x5638357146b0 msgr2=0x5638358b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- 172.21.15.35:0/2500573032 shutdown_connections 2023-03-17T11:11:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- 172.21.15.35:0/2500573032 wait complete. 2023-03-17T11:11:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- start start 2023-03-17T11:11:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 Processor -- start 2023-03-17T11:11:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 0x5638358c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358c0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bd4f0 0x5638358c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56383568d8c0 con 0x5638358b7960 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638358c15f0 con 0x5638358bcbe0 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638358cd030 con 0x5638358bd4f0 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f582e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 0x5638358c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.952+0000 7f5840c03b80 10 client.0 _ll_register_callbacks cb 0x5638356af230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 0x5638358c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53966/0 (socket says 172.21.15.35:53966) 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 -- 172.21.15.35:0/488195793 learned_addr learned my addr 172.21.15.35:0/488195793 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582dd9b700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582ed9d700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bd4f0 0x5638358c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 -- 172.21.15.35:0/488195793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bd4f0 msgr2=0x5638358c0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bd4f0 0x5638358c0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 -- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 msgr2=0x5638358c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358c0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 -- 172.21.15.35:0/488195793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583010ee30 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f582e59c700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 0x5638358c34c0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f582001ebe0 tx=0x7f58200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f62358233c6559a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5815ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5815ffb700 1 -- 172.21.15.35:0/488195793 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000ec50 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638357cc390 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5815ffb700 1 -- 172.21.15.35:0/488195793 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(323..323 src has 1..323) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f582000edb0 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5815ffb700 1 -- 172.21.15.35:0/488195793 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5820009ea0 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5840c03b80 10 client.20223 fetch_fsmap learned FSMap version 102 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.953+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x563835637d80 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5815ffb700 1 -- 172.21.15.35:0/488195793 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638357cc390 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5815ffb700 1 -- 172.21.15.35:0/488195793 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5820003cd0 con 0x5638358b7960 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5840c03b80 10 client.20223 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5840c03b80 10 client.20223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5840c03b80 20 client.20223 populate_metadata read hostname 'smithi035' 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5840c03b80 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358d1190 0x5638358d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5840c03b80 4 client.20223 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:11:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638357d8600 con 0x5638358d1190 2023-03-17T11:11:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f582dd9b700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358d1190 0x5638358d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f5815ffb700 10 client.20223 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.954+0000 7f582dd9b700 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358d1190 0x5638358d35a0 crc :-1 s=READY pgs=607 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d79a29b635f4565 server_cookie=36a45e4a67c41c62 in_seq=0 out_seq=0 2023-03-17T11:11:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5815ffb700 1 -- 172.21.15.35:0/488195793 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5638357d8600 con 0x5638358d1190 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5815ffb700 10 client.20223 handle_command_reply: tid=0 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 client.20223 shutdown 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 msgr2=0x5638358c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 0x5638358c34c0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f582001ebe0 tx=0x7f58200047c0 comp rx=0 tx=0).stop 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 shutdown_connections 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358d1190 0x5638358d35a0 crc :-1 s=READY pgs=607 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bd4f0 0x5638358c0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638358b7960 0x5638358c34c0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:33.188 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-03-17T11:11:33.678 DEBUG:teuthology.orchestra.run.smithi035:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-03-17T11:11:33.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:11:33.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:11:33.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:55 smithi035 ceph-mon[92535]: pgmap v4472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9.8 KiB/s wr, 22 op/s 2023-03-17T11:11:33.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:55 smithi035 ceph-mon[92535]: pgmap v4473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T11:11:33.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:11:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 --2- 172.21.15.35:0/488195793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358bcbe0 0x5638358c0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5815ffb700 0 client.20223 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 >> 172.21.15.35:0/488195793 conn(0x5638357146b0 msgr2=0x5638358b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 shutdown_connections 2023-03-17T11:11:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 1 -- 172.21.15.35:0/488195793 wait complete. 2023-03-17T11:11:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.955+0000 7f5840c03b80 20 client.20223 trim_cache size 0 max 16384 2023-03-17T11:11:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 Processor -- start 2023-03-17T11:11:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 -- start start 2023-03-17T11:11:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358badc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638357d8600 con 0x5638357146b0 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638357cc390 con 0x5638358b7960 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f5840c03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638358b2530 con 0x5638358bcbe0 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358badc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53974/0 (socket says 172.21.15.35:53974) 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 -- 172.21.15.35:0/1949854016 learned_addr learned my addr 172.21.15.35:0/1949854016 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582ed9d700 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582dd9b700 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:34.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 -- 172.21.15.35:0/1949854016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 msgr2=0x5638358c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 -- 172.21.15.35:0/1949854016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 msgr2=0x5638358c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 -- 172.21.15.35:0/1949854016 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638357d0130 con 0x5638357146b0 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.971+0000 7f582e59c700 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358badc0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f5820005c50 tx=0x7f58200096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44ac4ce40550342 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f581d7fa700 1 -- 172.21.15.35:0/1949854016 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820031630 con 0x5638357146b0 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f581d7fa700 1 -- 172.21.15.35:0/1949854016 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5820004030 con 0x5638357146b0 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f581d7fa700 1 -- 172.21.15.35:0/1949854016 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820031bc0 con 0x5638357146b0 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 -- 172.21.15.35:0/1949854016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 msgr2=0x5638358badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358badc0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f5820005c50 tx=0x7f58200096d0 comp rx=0 tx=0).stop 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 -- 172.21.15.35:0/1949854016 shutdown_connections 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358badc0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 --2- 172.21.15.35:0/1949854016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 -- 172.21.15.35:0/1949854016 >> 172.21.15.35:0/1949854016 conn(0x5638358b6770 msgr2=0x5638358ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 -- 172.21.15.35:0/1949854016 shutdown_connections 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.972+0000 7f5840c03b80 1 -- 172.21.15.35:0/1949854016 wait complete. 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 -- start start 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 Processor -- start 2023-03-17T11:11:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638358c8560 con 0x5638357146b0 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563835925040 con 0x5638358b7960 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638359251b0 con 0x5638358bcbe0 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5840c03b80 10 client.0 _ll_register_callbacks cb 0x5638356af230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53980/0 (socket says 172.21.15.35:53980) 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 -- 172.21.15.35:0/890099684 learned_addr learned my addr 172.21.15.35:0/890099684 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582ed9d700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582dd9b700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 -- 172.21.15.35:0/890099684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 msgr2=0x5638358c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 -- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 msgr2=0x5638358c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 -- 172.21.15.35:0/890099684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563835637d80 con 0x5638357146b0 2023-03-17T11:11:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582ed9d700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f582e59c700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358c6570 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f5820009370 tx=0x7f58200314f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee9bf67cc8763ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.973+0000 7f5815ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5815ffb700 1 -- 172.21.15.35:0/890099684 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820031a70 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5815ffb700 1 -- 172.21.15.35:0/890099684 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(323..323 src has 1..323) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5820031bd0 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638358871e0 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5815ffb700 1 -- 172.21.15.35:0/890099684 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5820031d90 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 10 client.20229 fetch_fsmap learned FSMap version 102 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56383565e1f0 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5815ffb700 1 -- 172.21.15.35:0/890099684 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638358871e0 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5815ffb700 1 -- 172.21.15.35:0/890099684 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5820004ad0 con 0x5638357146b0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 10 client.20229 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 10 client.20229 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 20 client.20229 populate_metadata read hostname 'smithi035' 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358bd4f0 0x563835928400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 4 client.20229 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.974+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56383568df00 con 0x5638358bd4f0 2023-03-17T11:11:36.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.975+0000 7f582dd9b700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358bd4f0 0x563835928400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.975+0000 7f582dd9b700 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358bd4f0 0x563835928400 crc :-1 s=READY pgs=608 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9597f7e881cc07b2 server_cookie=21f0d77f8de52f78 in_seq=0 out_seq=0 2023-03-17T11:11:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.975+0000 7f5815ffb700 10 client.20229 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5815ffb700 1 -- 172.21.15.35:0/890099684 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56383568df00 con 0x5638358bd4f0 2023-03-17T11:11:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5815ffb700 10 client.20229 handle_command_reply: tid=0 2023-03-17T11:11:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 client.20229 shutdown 2023-03-17T11:11:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 msgr2=0x5638358c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358c6570 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f5820009370 tx=0x7f58200314f0 comp rx=0 tx=0).stop 2023-03-17T11:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 shutdown_connections 2023-03-17T11:11:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5638358bd4f0 0x563835928400 crc :-1 s=READY pgs=608 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638358bcbe0 0x5638358c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5815ffb700 0 client.20229 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5638357146b0 0x5638358c6570 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 --2- 172.21.15.35:0/890099684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5638358b7960 0x5638358c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 >> 172.21.15.35:0/890099684 conn(0x5638358b6770 msgr2=0x5638358bb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 shutdown_connections 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 1 -- 172.21.15.35:0/890099684 wait complete. 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.993+0000 7f5840c03b80 20 client.20229 trim_cache size 0 max 16384 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f581809f640 msgr2=0x7f58180a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f581809f640 0x7f58180a1af0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5820009c60 tx=0x7f5820009260 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 msgr2=0x7f58301968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 0x7f58301968b0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f582400e940 tx=0x7f582400ec50 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 shutdown_connections 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f581809f640 0x7f58180a1af0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5830104390 0x7f583019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58300ff350 0x7f5830196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 --2- 172.21.15.35:0/2031279933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58300ffcf0 0x7f58301968b0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 >> 172.21.15.35:0/2031279933 conn(0x7f5830076330 msgr2=0x7f5830068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 shutdown_connections 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:47:57.994+0000 7f5834a76700 1 -- 172.21.15.35:0/2031279933 wait complete. 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.112+0000 7f79fda63700 1 -- 172.21.15.35:0/2702017939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f80ff350 msgr2=0x7f79f80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.112+0000 7f79fda63700 1 --2- 172.21.15.35:0/2702017939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f80ff350 0x7f79f80ff720 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f79e80099c0 tx=0x7f79e8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 -- 172.21.15.35:0/2702017939 shutdown_connections 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 --2- 172.21.15.35:0/2702017939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f8104390 0x7f79f810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 --2- 172.21.15.35:0/2702017939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f80ff350 0x7f79f80ff720 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 --2- 172.21.15.35:0/2702017939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f80ffcf0 0x7f79f8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 -- 172.21.15.35:0/2702017939 >> 172.21.15.35:0/2702017939 conn(0x7f79f8076330 msgr2=0x7f79f8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 -- 172.21.15.35:0/2702017939 shutdown_connections 2023-03-17T11:11:41.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 -- 172.21.15.35:0/2702017939 wait complete. 2023-03-17T11:11:41.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 Processor -- start 2023-03-17T11:11:41.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.113+0000 7f79fda63700 1 -- start start 2023-03-17T11:11:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79fda63700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f80ff350 0x7f79f81970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79fda63700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ffcf0 0x7f79f8197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79fda63700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 0x7f79f81a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79fda63700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f8197f20 con 0x7f79f8104390 2023-03-17T11:11:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79fda63700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f81a2690 con 0x7f79f80ff350 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79fda63700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f81a2800 con 0x7f79f80ffcf0 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 0x7f79f81a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 0x7f79f81a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:53998/0 (socket says 172.21.15.35:53998) 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 -- 172.21.15.35:0/135712585 learned_addr learned my addr 172.21.15.35:0/135712585 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f77fe700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f80ff350 0x7f79f81970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ffcf0 0x7f79f8197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 -- 172.21.15.35:0/135712585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ffcf0 msgr2=0x7f79f8197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ffcf0 0x7f79f8197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 -- 172.21.15.35:0/135712585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f80ff350 msgr2=0x7f79f81970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f80ff350 0x7f79f81970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 -- 172.21.15.35:0/135712585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80095f0 con 0x7f79f8104390 2023-03-17T11:11:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f7fff700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 0x7f79f81a2150 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f79f0007ee0 tx=0x7f79f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.114+0000 7f79f4ff9700 1 -- 172.21.15.35:0/135712585 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0017070 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.115+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f810f000 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.115+0000 7f79f4ff9700 1 -- 172.21.15.35:0/135712585 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f000f040 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.115+0000 7f79f4ff9700 1 -- 172.21.15.35:0/135712585 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0005570 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.115+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f810ee70 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.117+0000 7f79f4ff9700 1 -- 172.21.15.35:0/135712585 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f79f000db20 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.118+0000 7f79f4ff9700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f79e009f640 0x7f79e00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.118+0000 7f79f4ff9700 1 -- 172.21.15.35:0/135712585 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(324..324 src has 1..324) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f79f00c9e00 con 0x7f79f8104390 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.118+0000 7f79f77fe700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f79e009f640 0x7f79e00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f79f77fe700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f79e009f640 0x7f79e00a1af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f79e80036c0 tx=0x7f79e8005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 Processor -- start 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 -- start start 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e90753b8a0 0x55e907535830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 0x55e9075361c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907438010 con 0x55e907535d70 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90748a950 con 0x55e90753b8a0 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907483de0 con 0x55e90753af90 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 0x55e9075361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 0x55e9075361c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54006/0 (socket says 172.21.15.35:54006) 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f79f7fff700 1 -- 172.21.15.35:0/3912877760 learned_addr learned my addr 172.21.15.35:0/3912877760 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e90753b8a0 0x55e907535830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.119+0000 7f79f77fe700 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79f7fff700 1 -- 172.21.15.35:0/3912877760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 msgr2=0x55e90753b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79f7fff700 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79f7fff700 1 -- 172.21.15.35:0/3912877760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e90753b8a0 msgr2=0x55e907535830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79f7fff700 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e90753b8a0 0x55e907535830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79f7fff700 1 -- 172.21.15.35:0/3912877760 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9073055d0 con 0x55e907535d70 2023-03-17T11:11:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79f7fff700 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 0x55e9075361c0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f79f009f4e0 tx=0x7f79f0097460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582446638a82a445 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79ddffb700 1 -- 172.21.15.35:0/3912877760 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0097820 con 0x55e907535d70 2023-03-17T11:11:46.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79ddffb700 1 -- 172.21.15.35:0/3912877760 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f009fa10 con 0x55e907535d70 2023-03-17T11:11:46.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:56 smithi035 ceph-mon[92535]: pgmap v4474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 KiB/s wr, 21 op/s 2023-03-17T11:11:46.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.120+0000 7f79ddffb700 1 -- 172.21.15.35:0/3912877760 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0096d10 con 0x55e907535d70 2023-03-17T11:11:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3912877760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 msgr2=0x55e9075361c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 0x55e9075361c0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f79f009f4e0 tx=0x7f79f0097460 comp rx=0 tx=0).stop 2023-03-17T11:11:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3912877760 shutdown_connections 2023-03-17T11:11:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e907535d70 0x55e9075361c0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3912877760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e90753b8a0 0x55e907535830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3912877760 >> 172.21.15.35:0/3912877760 conn(0x55e90738e6b0 msgr2=0x55e90752ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3912877760 shutdown_connections 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3912877760 wait complete. 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 -- start start 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.121+0000 7f7a09bf0b80 1 Processor -- start 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e9075417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e90753f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9073078c0 con 0x55e90753b8a0 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90753f800 con 0x55e907535d70 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90754b3d0 con 0x55e90753af90 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 10 client.0 _ll_register_callbacks cb 0x55e907329230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e90753f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:50.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e90753f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54012/0 (socket says 172.21.15.35:54012) 2023-03-17T11:11:50.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 -- 172.21.15.35:0/799431517 learned_addr learned my addr 172.21.15.35:0/799431517 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:11:51.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f77fe700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e9075417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 -- 172.21.15.35:0/799431517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 msgr2=0x55e90753ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 -- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 msgr2=0x55e9075417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:11:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e9075417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 -- 172.21.15.35:0/799431517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f810ee70 con 0x55e90753b8a0 2023-03-17T11:11:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79f7fff700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e90753f090 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f79f00c7a80 tx=0x7f79f0097820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f7160a35b51b43 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:11:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:11:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79d6ffd700 1 -- 172.21.15.35:0/799431517 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0095cc0 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f79d6ffd700 1 -- 172.21.15.35:0/799431517 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(324..324 src has 1..324) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f79f00c7180 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.122+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e907446390 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f79d6ffd700 1 -- 172.21.15.35:0/799431517 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79f0097a80 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 10 client.20241 fetch_fsmap learned FSMap version 102 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55e9072b1d80 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f79d6ffd700 1 -- 172.21.15.35:0/799431517 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e907446390 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f79d6ffd700 1 -- 172.21.15.35:0/799431517 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f79f0096810 con 0x55e90753b8a0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 10 client.20241 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 10 client.20241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 20 client.20241 populate_metadata read hostname 'smithi035' 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e90754f1b0 0x55e9075515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 4 client.20241 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e907452600 con 0x55e90754f1b0 2023-03-17T11:11:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.123+0000 7f79f77fe700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e90754f1b0 0x55e9075515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:11:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f79d6ffd700 10 client.20241 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f79f77fe700 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e90754f1b0 0x55e9075515c0 crc :-1 s=READY pgs=609 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f867d507700a3b9b server_cookie=9a07ec14141ae352 in_seq=0 out_seq=0 2023-03-17T11:11:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f79d6ffd700 1 -- 172.21.15.35:0/799431517 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e907452600 con 0x55e90754f1b0 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f79d6ffd700 10 client.20241 handle_command_reply: tid=0 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 client.20241 shutdown 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 msgr2=0x55e90753f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e90753f090 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f79f00c7a80 tx=0x7f79f0097820 comp rx=0 tx=0).stop 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 shutdown_connections 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e90754f1b0 0x55e9075515c0 crc :-1 s=READY pgs=609 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e90753f090 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f79d6ffd700 0 client.20241 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e9075417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/799431517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e90753ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 >> 172.21.15.35:0/799431517 conn(0x55e90738e6b0 msgr2=0x55e907530410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:11:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.124+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 shutdown_connections 2023-03-17T11:12:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.125+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/799431517 wait complete. 2023-03-17T11:12:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.125+0000 7f7a09bf0b80 20 client.20241 trim_cache size 0 max 16384 2023-03-17T11:12:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 Processor -- start 2023-03-17T11:12:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 -- start start 2023-03-17T11:12:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907539170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e907546320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e907541380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90752c6c0 con 0x55e90753b8a0 2023-03-17T11:12:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907528b60 con 0x55e907535d70 2023-03-17T11:12:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.139+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907540040 con 0x55e90753af90 2023-03-17T11:12:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e907541380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e907541380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54020/0 (socket says 172.21.15.35:54020) 2023-03-17T11:12:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 -- 172.21.15.35:0/328092549 learned_addr learned my addr 172.21.15.35:0/328092549 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f77fe700 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907539170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 -- 172.21.15.35:0/328092549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 msgr2=0x55e907546320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e907546320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e907546320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 -- 172.21.15.35:0/328092549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 msgr2=0x55e907539170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907539170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 -- 172.21.15.35:0/328092549 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90744a130 con 0x55e90753b8a0 2023-03-17T11:12:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e907546320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:12:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79f7fff700 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e907541380 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f79f0093d20 tx=0x7f79f0097460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41d124e50c7ea13 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79de7fc700 1 -- 172.21.15.35:0/328092549 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00930e0 con 0x55e90753b8a0 2023-03-17T11:12:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79de7fc700 1 -- 172.21.15.35:0/328092549 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79f0096f20 con 0x55e90753b8a0 2023-03-17T11:12:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.140+0000 7f79de7fc700 1 -- 172.21.15.35:0/328092549 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0095ce0 con 0x55e90753b8a0 2023-03-17T11:12:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/328092549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 msgr2=0x55e907541380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e907541380 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f79f0093d20 tx=0x7f79f0097460 comp rx=0 tx=0).stop 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/328092549 shutdown_connections 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e907541380 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907539170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/328092549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e907546320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/328092549 >> 172.21.15.35:0/328092549 conn(0x55e90738e6b0 msgr2=0x55e907538a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/328092549 shutdown_connections 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/328092549 wait complete. 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- start start 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 Processor -- start 2023-03-17T11:12:04.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907597190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:04.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e9075976d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:04.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e9075a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907597dc0 con 0x55e90753b8a0 2023-03-17T11:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9075a2560 con 0x55e907535d70 2023-03-17T11:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9075a26a0 con 0x55e90753af90 2023-03-17T11:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.141+0000 7f7a09bf0b80 10 client.0 _ll_register_callbacks cb 0x55e907329230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e9075a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e9075a2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54026/0 (socket says 172.21.15.35:54026) 2023-03-17T11:12:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f7fff700 1 -- 172.21.15.35:0/3523766213 learned_addr learned my addr 172.21.15.35:0/3523766213 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907597190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e9075976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 -- 172.21.15.35:0/3523766213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 msgr2=0x55e9075976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e9075976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 -- 172.21.15.35:0/3523766213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 msgr2=0x55e9075a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e9075a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 -- 172.21.15.35:0/3523766213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9072b1d80 con 0x55e907535d70 2023-03-17T11:12:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f7fff700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e9075a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:12:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79f77fe700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907597190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79e80098e0 tx=0x7f79e8009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87d141fd5794a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79d6ffd700 1 -- 172.21.15.35:0/3523766213 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8034df0 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f79d6ffd700 1 -- 172.21.15.35:0/3523766213 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(324..324 src has 1..324) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f79e8034430 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.142+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9075011e0 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f79d6ffd700 1 -- 172.21.15.35:0/3523766213 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e80345f0 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 10 client.29384 fetch_fsmap learned FSMap version 102 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55e9072d81f0 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f79d6ffd700 1 -- 172.21.15.35:0/3523766213 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79e8049080 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f79d6ffd700 1 -- 172.21.15.35:0/3523766213 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f79e8003da0 con 0x55e907535d70 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 10 client.29384 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 10 client.29384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 20 client.29384 populate_metadata read hostname 'smithi035' 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e9075a3d10 0x55e9075a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 4 client.29384 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e907307f00 con 0x55e9075a3d10 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.143+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e9075a3d10 0x55e9075a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.144+0000 7f79d6ffd700 10 client.29384 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.144+0000 7f79f6ffd700 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e9075a3d10 0x55e9075a6120 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ecf3b5293441741 server_cookie=e25a39b1199dfa7b in_seq=0 out_seq=0 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.160+0000 7f79d6ffd700 1 -- 172.21.15.35:0/3523766213 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e907307f00 con 0x55e9075a3d10 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.160+0000 7f79d6ffd700 10 client.29384 handle_command_reply: tid=0 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 client.29384 shutdown 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 msgr2=0x55e907597190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907597190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f79e80098e0 tx=0x7f79e8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 shutdown_connections 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e9075a3d10 0x55e9075a6120 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e90753b8a0 0x55e9075a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e907535d70 0x55e907597190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 --2- 172.21.15.35:0/3523766213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e90753af90 0x55e9075976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79d6ffd700 0 client.29384 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 >> 172.21.15.35:0/3523766213 conn(0x55e90738e6b0 msgr2=0x55e907539b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 shutdown_connections 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 1 -- 172.21.15.35:0/3523766213 wait complete. 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f7a09bf0b80 20 client.29384 trim_cache size 0 max 16384 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f79e009f640 msgr2=0x7f79e00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79fda63700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f79e009f640 0x7f79e00a1af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f79e80036c0 tx=0x7f79e8005fb0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 msgr2=0x7f79f81a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79fda63700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 0x7f79f81a2150 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f79f0007ee0 tx=0x7f79f000d3b0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 shutdown_connections 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.161+0000 7f79fda63700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f79e009f640 0x7f79e00a1af0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.162+0000 7f79fda63700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f79f8104390 0x7f79f81a2150 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.162+0000 7f79fda63700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f80ff350 0x7f79f81970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.162+0000 7f79fda63700 1 --2- 172.21.15.35:0/135712585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79f80ffcf0 0x7f79f8197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.162+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 >> 172.21.15.35:0/135712585 conn(0x7f79f8076330 msgr2=0x7f79f80fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.162+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 shutdown_connections 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:11.162+0000 7f79fda63700 1 -- 172.21.15.35:0/135712585 wait complete. 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 -- 172.21.15.35:0/3822118392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 msgr2=0x7f96000ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 --2- 172.21.15.35:0/3822118392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f96000ff720 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f95f00099c0 tx=0x7f95f0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 -- 172.21.15.35:0/3822118392 shutdown_connections 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 --2- 172.21.15.35:0/3822118392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 0x7f960010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 --2- 172.21.15.35:0/3822118392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f96000ff720 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:08.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:01:58 smithi035 ceph-mon[92535]: pgmap v4475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T11:12:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 --2- 172.21.15.35:0/3822118392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96000ffcf0 0x7f9600103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 -- 172.21.15.35:0/3822118392 >> 172.21.15.35:0/3822118392 conn(0x7f9600076330 msgr2=0x7f9600076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 -- 172.21.15.35:0/3822118392 shutdown_connections 2023-03-17T11:12:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.283+0000 7f9607cde700 1 -- 172.21.15.35:0/3822118392 wait complete. 2023-03-17T11:12:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 Processor -- start 2023-03-17T11:12:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 -- start start 2023-03-17T11:12:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f9600196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96000ffcf0 0x7f9600196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 0x7f960019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960019b220 con 0x7f96000ff350 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960019b390 con 0x7f9600104390 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9607cde700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960019b550 con 0x7f96000ffcf0 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f9600196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f9600196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54036/0 (socket says 172.21.15.35:54036) 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 -- 172.21.15.35:0/21216567 learned_addr learned my addr 172.21.15.35:0/21216567 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605279700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96000ffcf0 0x7f9600196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f960627b700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 0x7f960019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 -- 172.21.15.35:0/21216567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96000ffcf0 msgr2=0x7f9600196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96000ffcf0 0x7f9600196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 -- 172.21.15.35:0/21216567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 msgr2=0x7f960019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 0x7f960019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f9605a7a700 1 -- 172.21.15.35:0/21216567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00095f0 con 0x7f96000ff350 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.284+0000 7f960627b700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 0x7f960019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.285+0000 7f9605a7a700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f9600196240 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009f50 tx=0x7f95f0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.285+0000 7f95f6ffd700 1 -- 172.21.15.35:0/21216567 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f001d070 con 0x7f96000ff350 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.285+0000 7f95f6ffd700 1 -- 172.21.15.35:0/21216567 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f0003fc0 con 0x7f96000ff350 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.285+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960010f000 con 0x7f96000ff350 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.285+0000 7f95f6ffd700 1 -- 172.21.15.35:0/21216567 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0022c30 con 0x7f96000ff350 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.285+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960010ee70 con 0x7f96000ff350 2023-03-17T11:12:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.287+0000 7f95f6ffd700 1 -- 172.21.15.35:0/21216567 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f95f0022470 con 0x7f96000ff350 2023-03-17T11:12:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.288+0000 7f95f6ffd700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95ec09f6c0 0x7f95ec0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.288+0000 7f95f6ffd700 1 -- 172.21.15.35:0/21216567 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95f00cba50 con 0x7f96000ff350 2023-03-17T11:12:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.288+0000 7f9605279700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95ec09f6c0 0x7f95ec0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.288+0000 7f9605279700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95ec09f6c0 0x7f95ec0a1b70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9600197850 tx=0x7f95fc00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 Processor -- start 2023-03-17T11:12:10.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 -- start start 2023-03-17T11:12:10.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:10.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 0x55dfaa59c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:10.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa59d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:10.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa49f010 con 0x55dfaa5a2900 2023-03-17T11:12:10.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa4f1950 con 0x55dfaa59cdc0 2023-03-17T11:12:10.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa4eade0 con 0x55dfaa5a1ff0 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9605279700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 0x55dfaa59c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9605279700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 0x55dfaa59c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54046/0 (socket says 172.21.15.35:54046) 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.289+0000 7f9605279700 1 -- 172.21.15.35:0/3947566475 learned_addr learned my addr 172.21.15.35:0/3947566475 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f960627b700 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa59d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605a7a700 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605279700 1 -- 172.21.15.35:0/3947566475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 msgr2=0x55dfaa5a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605279700 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605279700 1 -- 172.21.15.35:0/3947566475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 msgr2=0x55dfaa59d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605279700 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa59d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605279700 1 -- 172.21.15.35:0/3947566475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfaa36c5d0 con 0x55dfaa5a2900 2023-03-17T11:12:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f9605279700 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 0x55dfaa59c830 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f95fc005d90 tx=0x7f95fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d05f882d1e8001 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f95ebfff700 1 -- 172.21.15.35:0/3947566475 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc004830 con 0x55dfaa5a2900 2023-03-17T11:12:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f95ebfff700 1 -- 172.21.15.35:0/3947566475 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95fc015070 con 0x55dfaa5a2900 2023-03-17T11:12:11.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.290+0000 7f95ebfff700 1 -- 172.21.15.35:0/3947566475 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc01e480 con 0x55dfaa5a2900 2023-03-17T11:12:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3947566475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 msgr2=0x55dfaa59c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 0x55dfaa59c830 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f95fc005d90 tx=0x7f95fc013000 comp rx=0 tx=0).stop 2023-03-17T11:12:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3947566475 shutdown_connections 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa59d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3947566475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a2900 0x55dfaa59c830 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3947566475 >> 172.21.15.35:0/3947566475 conn(0x55dfaa3f56b0 msgr2=0x55dfaa592a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3947566475 shutdown_connections 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3947566475 wait complete. 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 -- start start 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.291+0000 7f9613e6bb80 1 Processor -- start 2023-03-17T11:12:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa36e8c0 con 0x55dfaa5a1ff0 2023-03-17T11:12:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa5a8cd0 con 0x55dfaa59cdc0 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa5b2430 con 0x55dfaa5a2900 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9613e6bb80 10 client.0 _ll_register_callbacks cb 0x55dfaa390230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9605279700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9605279700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54052/0 (socket says 172.21.15.35:54052) 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f9605279700 1 -- 172.21.15.35:0/394801992 learned_addr learned my addr 172.21.15.35:0/394801992 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 -- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 msgr2=0x55dfaa5a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 -- 172.21.15.35:0/394801992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a1ff0 msgr2=0x55dfaa5a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 -- 172.21.15.35:0/394801992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc010c20 con 0x55dfaa5a2900 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f960627b700 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a65b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95f8007940 tx=0x7f95f8007c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3014bbb2020b0c12 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.292+0000 7f95e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f95e97fa700 1 -- 172.21.15.35:0/394801992 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80155f0 con 0x55dfaa5a2900 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f95e97fa700 1 -- 172.21.15.35:0/394801992 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95f8015750 con 0x55dfaa5a2900 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfaa4ad390 con 0x55dfaa5a2900 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f95e97fa700 1 -- 172.21.15.35:0/394801992 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f8015910 con 0x55dfaa5a2900 2023-03-17T11:12:12.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 10 client.29362 fetch_fsmap learned FSMap version 102 2023-03-17T11:12:13.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55dfaa318d80 con 0x55dfaa5a2900 2023-03-17T11:12:13.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f95e97fa700 1 -- 172.21.15.35:0/394801992 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dfaa4ad390 con 0x55dfaa5a2900 2023-03-17T11:12:13.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f95e97fa700 1 -- 172.21.15.35:0/394801992 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f95f8016b20 con 0x55dfaa5a2900 2023-03-17T11:12:13.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 10 client.29362 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:12:13.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 10 client.29362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:12:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 20 client.29362 populate_metadata read hostname 'smithi035' 2023-03-17T11:12:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa5b6680 0x55dfaa5b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 4 client.29362 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:12:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.293+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfaa4b9600 con 0x55dfaa5b6680 2023-03-17T11:12:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.294+0000 7f9605a7a700 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa5b6680 0x55dfaa5b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.294+0000 7f9605a7a700 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa5b6680 0x55dfaa5b8a90 crc :-1 s=READY pgs=611 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=781de011824d7d03 server_cookie=19bf83a371b913d3 in_seq=0 out_seq=0 2023-03-17T11:12:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.294+0000 7f95e97fa700 10 client.29362 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:14.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f95e97fa700 1 -- 172.21.15.35:0/394801992 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55dfaa4b9600 con 0x55dfaa5b6680 2023-03-17T11:12:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f95e97fa700 10 client.29362 handle_command_reply: tid=0 2023-03-17T11:12:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 client.29362 shutdown 2023-03-17T11:12:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 msgr2=0x55dfaa5a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a65b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95f8007940 tx=0x7f95f8007c50 comp rx=0 tx=0).stop 2023-03-17T11:12:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 shutdown_connections 2023-03-17T11:12:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa5b6680 0x55dfaa5b8a90 crc :-1 s=READY pgs=611 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:14.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a65b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:14.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f95e97fa700 0 client.29362 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/394801992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:17.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 >> 172.21.15.35:0/394801992 conn(0x55dfaa3f56b0 msgr2=0x55dfaa597410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:18.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 shutdown_connections 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 1 -- 172.21.15.35:0/394801992 wait complete. 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.295+0000 7f9613e6bb80 20 client.29362 trim_cache size 0 max 16384 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 Processor -- start 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 -- start start 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa592ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa4ad390 con 0x55dfaa59cdc0 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa5943d0 con 0x55dfaa5a1ff0 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa5b3cb0 con 0x55dfaa5a2900 2023-03-17T11:12:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54058/0 (socket says 172.21.15.35:54058) 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9605a7a700 1 -- 172.21.15.35:0/1267819211 learned_addr learned my addr 172.21.15.35:0/1267819211 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.310+0000 7f9605279700 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa592ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f960627b700 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605a7a700 1 -- 172.21.15.35:0/1267819211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 msgr2=0x55dfaa5a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605a7a700 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605a7a700 1 -- 172.21.15.35:0/1267819211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a1ff0 msgr2=0x55dfaa592ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605a7a700 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa592ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605a7a700 1 -- 172.21.15.35:0/1267819211 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfaa59d460 con 0x55dfaa59cdc0 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605279700 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa592ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.311+0000 7f9605a7a700 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a0170 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009fd0 tx=0x7f95f001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f40937f9430cd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.313+0000 7f95f4ff9700 1 -- 172.21.15.35:0/1267819211 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00976d0 con 0x55dfaa59cdc0 2023-03-17T11:12:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.313+0000 7f95f4ff9700 1 -- 172.21.15.35:0/1267819211 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f0097930 con 0x55dfaa59cdc0 2023-03-17T11:12:21.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.313+0000 7f95f4ff9700 1 -- 172.21.15.35:0/1267819211 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0098a80 con 0x55dfaa59cdc0 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 -- 172.21.15.35:0/1267819211 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 msgr2=0x55dfaa5a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a0170 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009fd0 tx=0x7f95f001a040 comp rx=0 tx=0).stop 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 -- 172.21.15.35:0/1267819211 shutdown_connections 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a2900 0x55dfaa5a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5a0170 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/1267819211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa592ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 -- 172.21.15.35:0/1267819211 >> 172.21.15.35:0/1267819211 conn(0x55dfaa3f56b0 msgr2=0x55dfaa59fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 -- 172.21.15.35:0/1267819211 shutdown_connections 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 -- 172.21.15.35:0/1267819211 wait complete. 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.314+0000 7f9613e6bb80 1 -- start start 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 Processor -- start 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5aade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a2900 0x55dfaa609520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa5abbc0 con 0x55dfaa59cdc0 2023-03-17T11:12:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa609a60 con 0x55dfaa5a2900 2023-03-17T11:12:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfaa609ba0 con 0x55dfaa5a1ff0 2023-03-17T11:12:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9613e6bb80 10 client.0 _ll_register_callbacks cb 0x55dfaa390230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:12:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54064/0 (socket says 172.21.15.35:54064) 2023-03-17T11:12:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 -- 172.21.15.35:0/3938986039 learned_addr learned my addr 172.21.15.35:0/3938986039 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:21.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:00 smithi035 ceph-mon[92535]: pgmap v4476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:03 smithi035 ceph-mon[92535]: pgmap v4477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:04 smithi035 ceph-mon[92535]: pgmap v4478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:06 smithi035 ceph-mon[92535]: pgmap v4479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:09 smithi035 ceph-mon[92535]: osdmap e352: 12 total, 12 up, 12 in 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:09 smithi035 ceph-mon[92535]: pgmap v4481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:10 smithi035 ceph-mon[92535]: pgmap v4482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T11:12:23.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:13 smithi035 ceph-mon[92535]: pgmap v4483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T11:12:26.664 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:14 smithi035 ceph-mon[92535]: pgmap v4484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T11:12:26.665 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:16 smithi035 ceph-mon[92535]: pgmap v4485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T11:12:26.665 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:18 smithi035 ceph-mon[92535]: osdmap e353: 12 total, 12 up, 12 in 2023-03-17T11:12:27.974 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:19 smithi035 ceph-mon[92535]: pgmap v4487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:20 smithi035 ceph-mon[92535]: pgmap v4488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:23 smithi035 ceph-mon[92535]: pgmap v4489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:24 smithi035 ceph-mon[92535]: pgmap v4490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:26 smithi035 ceph-mon[92535]: pgmap v4491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:28 smithi035 ceph-mon[92535]: pgmap v4492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 265 B/s wr, 9 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:30 smithi035 ceph-mon[92535]: pgmap v4493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:33 smithi035 ceph-mon[92535]: pgmap v4494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:34 smithi035 ceph-mon[92535]: pgmap v4495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:36 smithi035 ceph-mon[92535]: pgmap v4496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:38 smithi035 ceph-mon[92535]: pgmap v4497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:40 smithi035 ceph-mon[92535]: pgmap v4498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:43 smithi035 ceph-mon[92535]: pgmap v4499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:44 smithi035 ceph-mon[92535]: pgmap v4500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:46 smithi035 ceph-mon[92535]: pgmap v4501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:48 smithi035 ceph-mon[92535]: pgmap v4502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:12:27.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:50 smithi035 ceph-mon[92535]: pgmap v4503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:53 smithi035 ceph-mon[92535]: pgmap v4504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:54 smithi035 ceph-mon[92535]: pgmap v4505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:55 smithi035 ceph-mon[92535]: pgmap v4506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:55 smithi035 ceph-mon[92535]: pgmap v4507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:02:58 smithi035 ceph-mon[92535]: pgmap v4508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:00 smithi035 ceph-mon[92535]: pgmap v4509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:02 smithi035 ceph-mon[92535]: pgmap v4510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:04 smithi035 ceph-mon[92535]: pgmap v4511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:06 smithi035 ceph-mon[92535]: pgmap v4512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:08 smithi035 ceph-mon[92535]: pgmap v4513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:10 smithi035 ceph-mon[92535]: osdmap e354: 12 total, 12 up, 12 in 2023-03-17T11:12:27.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:10 smithi035 ceph-mon[92535]: pgmap v4515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:12:27.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:12 smithi035 ceph-mon[92535]: pgmap v4516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:12:27.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:14 smithi035 ceph-mon[92535]: pgmap v4517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:12:27.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:16 smithi035 ceph-mon[92535]: pgmap v4518: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:12:27.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:18 smithi035 ceph-mon[92535]: osdmap e355: 12 total, 12 up, 12 in 2023-03-17T11:12:27.977 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:18 smithi035 ceph-mon[92535]: pgmap v4520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:20 smithi035 ceph-mon[92535]: pgmap v4521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:22 smithi035 ceph-mon[92535]: pgmap v4522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:24 smithi035 ceph-mon[92535]: pgmap v4523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:26 smithi035 ceph-mon[92535]: pgmap v4524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:28 smithi035 ceph-mon[92535]: pgmap v4525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:30 smithi035 ceph-mon[92535]: pgmap v4526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:32 smithi035 ceph-mon[92535]: pgmap v4527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:12:30.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:34 smithi035 ceph-mon[92535]: pgmap v4528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:12:32.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:36 smithi035 ceph-mon[92535]: pgmap v4529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:12:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:12:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:12:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:12:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:12:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f960627b700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a2900 0x55dfaa609520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605279700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 -- 172.21.15.35:0/3938986039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 msgr2=0x55dfaa5ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 -- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a2900 msgr2=0x55dfaa609520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:36.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a2900 0x55dfaa609520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.315+0000 7f9605a7a700 1 -- 172.21.15.35:0/3938986039 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960010ee70 con 0x55dfaa59cdc0 2023-03-17T11:12:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9605a7a700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5aade0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f95f0099290 tx=0x7f95f0099490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a8042f7cb84bc1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f95e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f95e97fa700 1 -- 172.21.15.35:0/3938986039 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0098a80 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f95e97fa700 1 -- 172.21.15.35:0/3938986039 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95f0098be0 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfaa5681e0 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f95e97fa700 1 -- 172.21.15.35:0/3938986039 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f00997f0 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 10 client.20265 fetch_fsmap learned FSMap version 102 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55dfaa301c00 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f95e97fa700 1 -- 172.21.15.35:0/3938986039 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f007c080 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f95e97fa700 1 -- 172.21.15.35:0/3938986039 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f95f009d0b0 con 0x55dfaa59cdc0 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 10 client.20265 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 10 client.20265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 20 client.20265 populate_metadata read hostname 'smithi035' 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa60ae00 0x55dfaa60d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 4 client.20265 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dfaa36ef00 con 0x55dfaa60ae00 2023-03-17T11:12:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.316+0000 7f9605279700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa60ae00 0x55dfaa60d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.317+0000 7f95e97fa700 10 client.20265 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.317+0000 7f9605279700 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa60ae00 0x55dfaa60d1e0 crc :-1 s=READY pgs=612 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e0e17ee46530b75 server_cookie=ed795b4b3ecf8a67 in_seq=0 out_seq=0 2023-03-17T11:12:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f95e97fa700 1 -- 172.21.15.35:0/3938986039 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dfaa36ef00 con 0x55dfaa60ae00 2023-03-17T11:12:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f95e97fa700 10 client.20265 handle_command_reply: tid=0 2023-03-17T11:12:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 client.20265 shutdown 2023-03-17T11:12:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 msgr2=0x55dfaa5aade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5aade0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f95f0099290 tx=0x7f95f0099490 comp rx=0 tx=0).stop 2023-03-17T11:12:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 shutdown_connections 2023-03-17T11:12:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dfaa60ae00 0x55dfaa60d1e0 crc :-1 s=READY pgs=612 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfaa5a2900 0x55dfaa609520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f95e97fa700 0 client.20265 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dfaa59cdc0 0x55dfaa5aade0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 --2- 172.21.15.35:0/3938986039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfaa5a1ff0 0x55dfaa5ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 >> 172.21.15.35:0/3938986039 conn(0x55dfaa3f56b0 msgr2=0x55dfaa5a6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 shutdown_connections 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.326+0000 7f9613e6bb80 1 -- 172.21.15.35:0/3938986039 wait complete. 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9613e6bb80 20 client.20265 trim_cache size 0 max 16384 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95ec09f6c0 msgr2=0x7f95ec0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95ec09f6c0 0x7f95ec0a1b70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9600197850 tx=0x7f95fc00b410 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 msgr2=0x7f9600196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f9600196240 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009f50 tx=0x7f95f0004710 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 shutdown_connections 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95ec09f6c0 0x7f95ec0a1b70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9600104390 0x7f960019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f96000ff350 0x7f9600196240 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:40.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 --2- 172.21.15.35:0/21216567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96000ffcf0 0x7f9600196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:40.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 >> 172.21.15.35:0/21216567 conn(0x7f9600076330 msgr2=0x7f9600102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 shutdown_connections 2023-03-17T11:12:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:24.327+0000 7f9607cde700 1 -- 172.21.15.35:0/21216567 wait complete. 2023-03-17T11:12:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 -- 172.21.15.35:0/1924812651 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 msgr2=0x7f889c0ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 --2- 172.21.15.35:0/1924812651 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c0ffe50 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f88900099c0 tx=0x7f8890009cd0 comp rx=0 tx=0).stop 2023-03-17T11:12:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 -- 172.21.15.35:0/1924812651 shutdown_connections 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 --2- 172.21.15.35:0/1924812651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f889c1045a0 0x7f889c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 --2- 172.21.15.35:0/1924812651 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c0ffe50 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 --2- 172.21.15.35:0/1924812651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 0x7f889c103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 -- 172.21.15.35:0/1924812651 >> 172.21.15.35:0/1924812651 conn(0x7f889c0757a0 msgr2=0x7f889c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 -- 172.21.15.35:0/1924812651 shutdown_connections 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.449+0000 7f88a0972700 1 -- 172.21.15.35:0/1924812651 wait complete. 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.450+0000 7f88a0972700 1 Processor -- start 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.450+0000 7f88a0972700 1 -- start start 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 0x7f889c195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f889c1045a0 0x7f889c199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c19a330 con 0x7f889c0ffa80 2023-03-17T11:12:42.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c19a4a0 con 0x7f889c100420 2023-03-17T11:12:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c19a660 con 0x7f889c1045a0 2023-03-17T11:12:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:42.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c195350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54078/0 (socket says 172.21.15.35:54078) 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 -- 172.21.15.35:0/2221987996 learned_addr learned my addr 172.21.15.35:0/2221987996 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889ad9d700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f889c1045a0 0x7f889c199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f8899d9b700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 0x7f889c195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 -- 172.21.15.35:0/2221987996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f889c1045a0 msgr2=0x7f889c199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f889c1045a0 0x7f889c199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 -- 172.21.15.35:0/2221987996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 msgr2=0x7f889c195890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 0x7f889c195890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 -- 172.21.15.35:0/2221987996 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88900095f0 con 0x7f889c0ffa80 2023-03-17T11:12:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f8899d9b700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 0x7f889c195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:12:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f889a59c700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c195350 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f8890009f50 tx=0x7f8890005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f888b7fe700 1 -- 172.21.15.35:0/2221987996 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889001d070 con 0x7f889c0ffa80 2023-03-17T11:12:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.451+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c10f210 con 0x7f889c0ffa80 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.452+0000 7f888b7fe700 1 -- 172.21.15.35:0/2221987996 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8890003fc0 con 0x7f889c0ffa80 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.452+0000 7f888b7fe700 1 -- 172.21.15.35:0/2221987996 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890022d10 con 0x7f889c0ffa80 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.452+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c10f080 con 0x7f889c0ffa80 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.454+0000 7f888b7fe700 1 -- 172.21.15.35:0/2221987996 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8890022470 con 0x7f889c0ffa80 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.454+0000 7f888b7fe700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f888409f640 0x7f88840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.454+0000 7f888b7fe700 1 -- 172.21.15.35:0/2221987996 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88900cb990 con 0x7f889c0ffa80 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.454+0000 7f8899d9b700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f888409f640 0x7f88840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.455+0000 7f8899d9b700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f888409f640 0x7f88840a1af0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f888c005950 tx=0x7f888c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.455+0000 7f88acaffb80 1 Processor -- start 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.455+0000 7f88acaffb80 1 -- start start 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d34650160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d3464a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d3464afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f88acaffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3454f010 con 0x560d346506a0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f88acaffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d345a1950 con 0x560d3464fd90 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f88acaffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3459ade0 con 0x560d3464ab70 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d3464a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d3464a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54088/0 (socket says 172.21.15.35:54088) 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 -- 172.21.15.35:0/95052920 learned_addr learned my addr 172.21.15.35:0/95052920 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f889a59c700 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d34650160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f889ad9d700 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d3464afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 -- 172.21.15.35:0/95052920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 msgr2=0x560d3464afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d3464afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 -- 172.21.15.35:0/95052920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 msgr2=0x560d34650160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d34650160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 -- 172.21.15.35:0/95052920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d3441c5d0 con 0x560d346506a0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8899d9b700 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d3464a630 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f888c00fd70 tx=0x7f888c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57557c68fd611188 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8888ff9700 1 -- 172.21.15.35:0/95052920 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c017040 con 0x560d346506a0 2023-03-17T11:12:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.456+0000 7f8888ff9700 1 -- 172.21.15.35:0/95052920 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f888c003d10 con 0x560d346506a0 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f8888ff9700 1 -- 172.21.15.35:0/95052920 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c01fb20 con 0x560d346506a0 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 -- 172.21.15.35:0/95052920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 msgr2=0x560d3464a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d3464a630 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f888c00fd70 tx=0x7f888c012000 comp rx=0 tx=0).stop 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 -- 172.21.15.35:0/95052920 shutdown_connections 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d3464afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d34650160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 --2- 172.21.15.35:0/95052920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d3464a630 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 -- 172.21.15.35:0/95052920 >> 172.21.15.35:0/95052920 conn(0x560d344a56b0 msgr2=0x560d34642a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 -- 172.21.15.35:0/95052920 shutdown_connections 2023-03-17T11:12:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.457+0000 7f88acaffb80 1 -- 172.21.15.35:0/95052920 wait complete. 2023-03-17T11:12:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 -- start start 2023-03-17T11:12:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 Processor -- start 2023-03-17T11:12:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 0x560d34656600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464fd90 0x560d34653810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d346506a0 0x560d34653e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3441e8c0 con 0x560d3464ab70 2023-03-17T11:12:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d34654520 con 0x560d346506a0 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d346546e0 con 0x560d3464fd90 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f88acaffb80 10 client.0 _ll_register_callbacks cb 0x560d34440230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 0x560d34656600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 0x560d34656600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54092/0 (socket says 172.21.15.35:54092) 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 -- 172.21.15.35:0/948609713 learned_addr learned my addr 172.21.15.35:0/948609713 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f8899d9b700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464fd90 0x560d34653810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889ad9d700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d346506a0 0x560d34653e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 -- 172.21.15.35:0/948609713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464fd90 msgr2=0x560d34653810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464fd90 0x560d34653810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 -- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d346506a0 msgr2=0x560d34653e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d346506a0 0x560d34653e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 -- 172.21.15.35:0/948609713 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c00be70 con 0x560d3464ab70 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f889a59c700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 0x560d34656600 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f88900c9180 tx=0x7f8890003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249bd121510eff63 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:12:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.458+0000 7f8881ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:12:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f8881ffb700 1 -- 172.21.15.35:0/948609713 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900a1630 con 0x560d3464ab70 2023-03-17T11:12:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f8881ffb700 1 -- 172.21.15.35:0/948609713 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f889009d160 con 0x560d3464ab70 2023-03-17T11:12:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d3455d390 con 0x560d3464ab70 2023-03-17T11:12:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f8881ffb700 1 -- 172.21.15.35:0/948609713 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f889009d320 con 0x560d3464ab70 2023-03-17T11:12:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 10 client.20277 fetch_fsmap learned FSMap version 102 2023-03-17T11:12:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x560d343c8d80 con 0x560d3464ab70 2023-03-17T11:12:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f8881ffb700 1 -- 172.21.15.35:0/948609713 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88900b5020 con 0x560d3464ab70 2023-03-17T11:12:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f8881ffb700 1 -- 172.21.15.35:0/948609713 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f88900c7c80 con 0x560d3464ab70 2023-03-17T11:12:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 10 client.20277 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:12:53.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 10 client.20277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:12:54.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 20 client.20277 populate_metadata read hostname 'smithi035' 2023-03-17T11:12:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d34663f10 0x560d34666320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:12:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 4 client.20277 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:12:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.459+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d34569600 con 0x560d34663f10 2023-03-17T11:12:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.460+0000 7f8899d9b700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d34663f10 0x560d34666320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:12:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.460+0000 7f8881ffb700 10 client.20277 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:12:58.034 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:38 smithi035 ceph-mon[92535]: pgmap v4530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:12:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.460+0000 7f8899d9b700 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d34663f10 0x560d34666320 crc :-1 s=READY pgs=613 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b85db211bd377982 server_cookie=3f33c5e6c33d2de7 in_seq=0 out_seq=0 2023-03-17T11:12:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f8881ffb700 1 -- 172.21.15.35:0/948609713 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560d34569600 con 0x560d34663f10 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f8881ffb700 10 client.20277 handle_command_reply: tid=0 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 client.20277 shutdown 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 msgr2=0x560d34656600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 0x560d34656600 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f88900c9180 tx=0x7f8890003680 comp rx=0 tx=0).stop 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 shutdown_connections 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d34663f10 0x560d34666320 crc :-1 s=READY pgs=613 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d346506a0 0x560d34653e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f8881ffb700 0 client.20277 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464ab70 0x560d34656600 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 --2- 172.21.15.35:0/948609713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464fd90 0x560d34653810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 >> 172.21.15.35:0/948609713 conn(0x560d344a56b0 msgr2=0x560d34647410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 shutdown_connections 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 1 -- 172.21.15.35:0/948609713 wait complete. 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.461+0000 7f88acaffb80 20 client.20277 trim_cache size 0 max 16384 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 Processor -- start 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 -- start start 2023-03-17T11:13:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d34642ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d3465b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d34656130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d346434e0 con 0x560d346506a0 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d34569600 con 0x560d3464fd90 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f88acaffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3455e050 con 0x560d3464ab70 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f889ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d34656130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f889ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d34656130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54104/0 (socket says 172.21.15.35:54104) 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f889ad9d700 1 -- 172.21.15.35:0/2256310374 learned_addr learned my addr 172.21.15.35:0/2256310374 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f8899d9b700 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d3465b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.476+0000 7f889a59c700 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d34642ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f889ad9d700 1 -- 172.21.15.35:0/2256310374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 msgr2=0x560d34642ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f889ad9d700 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d34642ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f889ad9d700 1 -- 172.21.15.35:0/2256310374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 msgr2=0x560d3465b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f889ad9d700 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d3465b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f889ad9d700 1 -- 172.21.15.35:0/2256310374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d34561130 con 0x560d346506a0 2023-03-17T11:13:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f889ad9d700 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d34656130 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f8894009910 tx=0x7f8894009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798c2e4dde38cfe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f88897fa700 1 -- 172.21.15.35:0/2256310374 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894003bf0 con 0x560d346506a0 2023-03-17T11:13:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f88897fa700 1 -- 172.21.15.35:0/2256310374 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f889400f040 con 0x560d346506a0 2023-03-17T11:13:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.477+0000 7f88897fa700 1 -- 172.21.15.35:0/2256310374 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007d40 con 0x560d346506a0 2023-03-17T11:13:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- 172.21.15.35:0/2256310374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 msgr2=0x560d34656130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d34656130 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f8894009910 tx=0x7f8894009940 comp rx=0 tx=0).stop 2023-03-17T11:13:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- 172.21.15.35:0/2256310374 shutdown_connections 2023-03-17T11:13:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d346506a0 0x560d34656130 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d3464ab70 0x560d34642ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- 172.21.15.35:0/2256310374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464fd90 0x560d3465b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- 172.21.15.35:0/2256310374 >> 172.21.15.35:0/2256310374 conn(0x560d344a56b0 msgr2=0x560d34647410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- 172.21.15.35:0/2256310374 shutdown_connections 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- 172.21.15.35:0/2256310374 wait complete. 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- start start 2023-03-17T11:13:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 Processor -- start 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464ab70 0x560d3465b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 0x560d34657360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d346506a0 0x560d346578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d34657de0 con 0x560d3464fd90 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d34657f20 con 0x560d3464ab70 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d346580b0 con 0x560d346506a0 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f88acaffb80 10 client.0 _ll_register_callbacks cb 0x560d34440230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f8899d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 0x560d34657360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f8899d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 0x560d34657360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54108/0 (socket says 172.21.15.35:54108) 2023-03-17T11:13:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.478+0000 7f8899d9b700 1 -- 172.21.15.35:0/3951281267 learned_addr learned my addr 172.21.15.35:0/3951281267 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f889ad9d700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d346506a0 0x560d346578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f889a59c700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464ab70 0x560d3465b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8899d9b700 1 -- 172.21.15.35:0/3951281267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d346506a0 msgr2=0x560d346578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8899d9b700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d346506a0 0x560d346578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8899d9b700 1 -- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464ab70 msgr2=0x560d3465b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8899d9b700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464ab70 0x560d3465b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8899d9b700 1 -- 172.21.15.35:0/3951281267 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8894003d50 con 0x560d3464fd90 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8899d9b700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 0x560d34657360 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f888c00be40 tx=0x7f888c034400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e056df55cd690777 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8881ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8881ffb700 1 -- 172.21.15.35:0/3951281267 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c030040 con 0x560d3464fd90 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d346181e0 con 0x560d3464fd90 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8881ffb700 1 -- 172.21.15.35:0/3951281267 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f888c034ae0 con 0x560d3464fd90 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8881ffb700 1 -- 172.21.15.35:0/3951281267 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f888c034770 con 0x560d3464fd90 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f88acaffb80 10 client.20283 fetch_fsmap learned FSMap version 102 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x560d343ef1f0 con 0x560d3464fd90 2023-03-17T11:13:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.479+0000 7f8881ffb700 1 -- 172.21.15.35:0/3951281267 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d346181e0 con 0x560d3464fd90 2023-03-17T11:13:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f8881ffb700 1 -- 172.21.15.35:0/3951281267 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f888c01d040 con 0x560d3464fd90 2023-03-17T11:13:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f88acaffb80 10 client.20283 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:13:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f88acaffb80 10 client.20283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:13:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f88acaffb80 20 client.20283 populate_metadata read hostname 'smithi035' 2023-03-17T11:13:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f88acaffb80 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d346bb700 0x560d346bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f88acaffb80 4 client.20283 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:13:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d3441ef00 con 0x560d346bb700 2023-03-17T11:13:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f889a59c700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d346bb700 0x560d346bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f8881ffb700 10 client.20283 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.480+0000 7f889a59c700 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d346bb700 0x560d346bdb10 crc :-1 s=READY pgs=614 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a66b1d56ed7206 server_cookie=c474276db9c3c827 in_seq=0 out_seq=0 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f8881ffb700 1 -- 172.21.15.35:0/3951281267 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d3441ef00 con 0x560d346bb700 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f8881ffb700 10 client.20283 handle_command_reply: tid=0 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 client.20283 shutdown 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 msgr2=0x560d34657360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 0x560d34657360 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f888c00be40 tx=0x7f888c034400 comp rx=0 tx=0).stop 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 shutdown_connections 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d346bb700 0x560d346bdb10 crc :-1 s=READY pgs=614 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d346506a0 0x560d346578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d3464ab70 0x560d3465b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f8881ffb700 0 client.20283 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 --2- 172.21.15.35:0/3951281267 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d3464fd90 0x560d34657360 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 >> 172.21.15.35:0/3951281267 conn(0x560d344a56b0 msgr2=0x560d3464d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 shutdown_connections 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 1 -- 172.21.15.35:0/3951281267 wait complete. 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.490+0000 7f88acaffb80 20 client.20283 trim_cache size 0 max 16384 2023-03-17T11:13:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f888409f640 msgr2=0x7f88840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f888409f640 0x7f88840a1af0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f888c005950 tx=0x7f888c0058e0 comp rx=0 tx=0).stop 2023-03-17T11:13:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 msgr2=0x7f889c195350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c195350 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f8890009f50 tx=0x7f8890005740 comp rx=0 tx=0).stop 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 shutdown_connections 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f888409f640 0x7f88840a1af0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f889c1045a0 0x7f889c199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f889c0ffa80 0x7f889c195350 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 --2- 172.21.15.35:0/2221987996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f889c100420 0x7f889c195890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 >> 172.21.15.35:0/2221987996 conn(0x7f889c0757a0 msgr2=0x7f889c0fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 shutdown_connections 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:37.491+0000 7f88a0972700 1 -- 172.21.15.35:0/2221987996 wait complete. 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/2531561149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 msgr2=0x7fbc080ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/2531561149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc080ff720 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fbbf00099c0 tx=0x7fbbf0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/2531561149 shutdown_connections 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/2531561149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc08104390 0x7fbc0810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/2531561149 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc080ff720 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/2531561149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc080ffcf0 0x7fbc08103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:11.896 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/2531561149 >> 172.21.15.35:0/2531561149 conn(0x7fbc08076330 msgr2=0x7fbc08076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/2531561149 shutdown_connections 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.613+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/2531561149 wait complete. 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 Processor -- start 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 -- start start 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc08196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ffcf0 0x7fbc08196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc08104390 0x7fbc0819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0819b220 con 0x7fbc080ff350 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0819b390 con 0x7fbc08104390 2023-03-17T11:13:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0e5c2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0819b550 con 0x7fbc080ffcf0 2023-03-17T11:13:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc08196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc08196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54118/0 (socket says 172.21.15.35:54118) 2023-03-17T11:13:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc07fff700 1 -- 172.21.15.35:0/290689564 learned_addr learned my addr 172.21.15.35:0/290689564 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc077fe700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ffcf0 0x7fbc08196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.614+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc08104390 0x7fbc0819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc07fff700 1 -- 172.21.15.35:0/290689564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ffcf0 msgr2=0x7fbc08196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc07fff700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ffcf0 0x7fbc08196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc07fff700 1 -- 172.21.15.35:0/290689564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc08104390 msgr2=0x7fbc0819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc07fff700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc08104390 0x7fbc0819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc07fff700 1 -- 172.21.15.35:0/290689564 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf00095f0 con 0x7fbc080ff350 2023-03-17T11:13:14.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc08104390 0x7fbc0819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:13:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc07fff700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc08196240 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0005910 tx=0x7fbbf000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc057fa700 1 -- 172.21.15.35:0/290689564 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf001d070 con 0x7fbc080ff350 2023-03-17T11:13:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc057fa700 1 -- 172.21.15.35:0/290689564 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf00054e0 con 0x7fbc080ff350 2023-03-17T11:13:14.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc057fa700 1 -- 172.21.15.35:0/290689564 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0004ab0 con 0x7fbc080ff350 2023-03-17T11:13:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0810f000 con 0x7fbc080ff350 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.615+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0810ee70 con 0x7fbc080ff350 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.617+0000 7fbc057fa700 1 -- 172.21.15.35:0/290689564 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbbf000fb80 con 0x7fbc080ff350 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.618+0000 7fbc057fa700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbbf409f640 0x7fbbf40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.618+0000 7fbc057fa700 1 -- 172.21.15.35:0/290689564 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbbf00cb500 con 0x7fbc080ff350 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.618+0000 7fbc077fe700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbbf409f640 0x7fbbf40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc077fe700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbbf409f640 0x7fbbf40a1af0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbc08197850 tx=0x7fbbf8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 Processor -- start 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 -- start start 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a24fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a1f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485926010 con 0x561485a1f960 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485978950 con 0x561485a254f0 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485971de0 con 0x561485a24be0 2023-03-17T11:13:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.619+0000 7fbc0cb5f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a1f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a1f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:55924/0 (socket says 172.21.15.35:55924) 2023-03-17T11:13:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc0cb5f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a1fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54130/0 (socket says 172.21.15.35:54130) 2023-03-17T11:13:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 -- 172.21.15.35:0/3083368756 learned_addr learned my addr 172.21.15.35:0/3083368756 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:15.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:40 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:13:16.444 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:40 smithi035 ceph-mon[92535]: pgmap v4531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc07fff700 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a24fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 -- 172.21.15.35:0/3083368756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 msgr2=0x561485a24fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:16.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a24fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:16.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 -- 172.21.15.35:0/3083368756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 msgr2=0x561485a1fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a1fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 -- 172.21.15.35:0/3083368756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614857f35d0 con 0x561485a254f0 2023-03-17T11:13:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc07fff700 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a24fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:13:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a1fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:13:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbc077fe700 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a1f420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8011cf0 tx=0x7fbbf8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd7d51abe7076f47 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbbfe7fc700 1 -- 172.21.15.35:0/3083368756 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf800ea40 con 0x561485a254f0 2023-03-17T11:13:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbbfe7fc700 1 -- 172.21.15.35:0/3083368756 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf8021070 con 0x561485a254f0 2023-03-17T11:13:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.620+0000 7fbbfe7fc700 1 -- 172.21.15.35:0/3083368756 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf801d410 con 0x561485a254f0 2023-03-17T11:13:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/3083368756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 msgr2=0x561485a1f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a1f420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8011cf0 tx=0x7fbbf8014000 comp rx=0 tx=0).stop 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/3083368756 shutdown_connections 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a1fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a24fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/3083368756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a1f420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/3083368756 >> 172.21.15.35:0/3083368756 conn(0x56148587c6b0 msgr2=0x561485a19a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/3083368756 shutdown_connections 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/3083368756 wait complete. 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.621+0000 7fbc1a74fb80 1 -- start start 2023-03-17T11:13:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 Processor -- start 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a2b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a28df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614857f58c0 con 0x561485a1f960 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a29530 con 0x561485a254f0 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a35000 con 0x561485a24be0 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a2b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc1a74fb80 10 client.0 _ll_register_callbacks cb 0x561485817230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a2b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54132/0 (socket says 172.21.15.35:54132) 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 -- 172.21.15.35:0/646516066 learned_addr learned my addr 172.21.15.35:0/646516066 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a28df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc077fe700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 -- 172.21.15.35:0/646516066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 msgr2=0x561485a287c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a287c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 -- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 msgr2=0x561485a28df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a28df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 -- 172.21.15.35:0/646516066 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf8017070 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a28df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbc07fff700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a2b540 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000c00 tx=0x7fbbf00a1140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8140f30f9929811b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.622+0000 7fbbe77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbbe77fe700 1 -- 172.21.15.35:0/646516066 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00b1220 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561485934390 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbbe77fe700 1 -- 172.21.15.35:0/646516066 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbbf00984d0 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbbe77fe700 1 -- 172.21.15.35:0/646516066 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbf0098690 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 10 client.20295 fetch_fsmap learned FSMap version 102 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56148579fd80 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbbe77fe700 1 -- 172.21.15.35:0/646516066 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf00b5020 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbbe77fe700 1 -- 172.21.15.35:0/646516066 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbbf0094f60 con 0x561485a1f960 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 10 client.20295 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 10 client.20295 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 20 client.20295 populate_metadata read hostname 'smithi035' 2023-03-17T11:13:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a38d60 0x561485a3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 4 client.20295 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561485940600 con 0x561485a38d60 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.623+0000 7fbc077fe700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a38d60 0x561485a3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.624+0000 7fbc077fe700 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a38d60 0x561485a3b140 crc :-1 s=READY pgs=615 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5515411d787848e6 server_cookie=aac364b1d904edce in_seq=0 out_seq=0 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.624+0000 7fbbe77fe700 10 client.20295 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.624+0000 7fbbe77fe700 1 -- 172.21.15.35:0/646516066 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561485940600 con 0x561485a38d60 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.624+0000 7fbbe77fe700 10 client.20295 handle_command_reply: tid=0 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.624+0000 7fbc1a74fb80 1 client.20295 shutdown 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 msgr2=0x561485a2b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a2b540 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000c00 tx=0x7fbbf00a1140 comp rx=0 tx=0).stop 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 shutdown_connections 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a38d60 0x561485a3b140 crc :-1 s=READY pgs=615 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a254f0 0x561485a28df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbbe77fe700 0 client.20295 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a1f960 0x561485a2b540 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/646516066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a287c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 >> 172.21.15.35:0/646516066 conn(0x56148587c6b0 msgr2=0x561485a1e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 shutdown_connections 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/646516066 wait complete. 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.625+0000 7fbc1a74fb80 20 client.20295 trim_cache size 0 max 16384 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 Processor -- start 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 -- start start 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56148587c6b0 0x561485a28770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a19ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 0x561485a2ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a29770 con 0x561485a24be0 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a16b60 con 0x561485a1f960 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a1a000 con 0x56148587c6b0 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 0x561485a2ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 0x561485a2ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54144/0 (socket says 172.21.15.35:54144) 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 -- 172.21.15.35:0/187645843 learned_addr learned my addr 172.21.15.35:0/187645843 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc07fff700 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56148587c6b0 0x561485a28770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc077fe700 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a19ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 -- 172.21.15.35:0/187645843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56148587c6b0 msgr2=0x561485a28770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56148587c6b0 0x561485a28770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 -- 172.21.15.35:0/187645843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 msgr2=0x561485a19ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a19ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 -- 172.21.15.35:0/187645843 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561485938130 con 0x561485a24be0 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc07fff700 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56148587c6b0 0x561485a28770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.640+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 0x561485a2ff50 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009f30 tx=0x7fbc000077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49fd6b1011368a1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbbfeffd700 1 -- 172.21.15.35:0/187645843 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00009a80 con 0x561485a24be0 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbbfeffd700 1 -- 172.21.15.35:0/187645843 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc0000f040 con 0x561485a24be0 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbbfeffd700 1 -- 172.21.15.35:0/187645843 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc000053a0 con 0x561485a24be0 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/187645843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 msgr2=0x561485a2ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 0x561485a2ff50 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009f30 tx=0x7fbc000077e0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/187645843 shutdown_connections 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561485a24be0 0x561485a2ff50 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56148587c6b0 0x561485a28770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/187645843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a19ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/187645843 >> 172.21.15.35:0/187645843 conn(0x561485a1efe0 msgr2=0x561485a28060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/187645843 shutdown_connections 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.641+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/187645843 wait complete. 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 -- start start 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 Processor -- start 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 0x561485a2e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a2ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a2f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a8cc40 con 0x56148587c6b0 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a8cd80 con 0x561485a1f960 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561485a8cf40 con 0x561485a24be0 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc1a74fb80 10 client.0 _ll_register_callbacks cb 0x561485817230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 0x561485a2e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 0x561485a2e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54146/0 (socket says 172.21.15.35:54146) 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 -- 172.21.15.35:0/220160880 learned_addr learned my addr 172.21.15.35:0/220160880 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc077fe700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a2ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a2f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 -- 172.21.15.35:0/220160880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 msgr2=0x561485a2f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a2f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 -- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 msgr2=0x561485a2ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a2ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 -- 172.21.15.35:0/220160880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc00009be0 con 0x56148587c6b0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc0cb5f700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a2f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbc07fff700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 0x561485a2e710 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009550 tx=0x7fbbf0095420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7b35f4e83dbc87 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.642+0000 7fbbe77fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbbe77fe700 1 -- 172.21.15.35:0/220160880 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00984d0 con 0x56148587c6b0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbbe77fe700 1 -- 172.21.15.35:0/220160880 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(325..325 src has 1..325) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbbf00b6080 con 0x56148587c6b0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561485a1f3b0 con 0x56148587c6b0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbbe77fe700 1 -- 172.21.15.35:0/220160880 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbf0098630 con 0x56148587c6b0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 10 client.20301 fetch_fsmap learned FSMap version 102 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5614857c61f0 con 0x56148587c6b0 2023-03-17T11:13:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbbe77fe700 1 -- 172.21.15.35:0/220160880 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561485a1f3b0 con 0x56148587c6b0 2023-03-17T11:13:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbbe77fe700 1 -- 172.21.15.35:0/220160880 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbbf0099dc0 con 0x56148587c6b0 2023-03-17T11:13:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 10 client.20301 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:13:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 10 client.20301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:13:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 20 client.20301 populate_metadata read hostname 'smithi035' 2023-03-17T11:13:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a254f0 0x561485a8f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 4 client.20301 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:13:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5614859ef1e0 con 0x561485a254f0 2023-03-17T11:13:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.643+0000 7fbc077fe700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a254f0 0x561485a8f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.644+0000 7fbbe77fe700 10 client.20301 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.644+0000 7fbc077fe700 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a254f0 0x561485a8f0a0 crc :-1 s=READY pgs=616 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd6de8403fa197c4 server_cookie=c66c3bbb3ddd5113 in_seq=0 out_seq=0 2023-03-17T11:13:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbbe77fe700 1 -- 172.21.15.35:0/220160880 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5614859ef1e0 con 0x561485a254f0 2023-03-17T11:13:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbbe77fe700 10 client.20301 handle_command_reply: tid=0 2023-03-17T11:13:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 client.20301 shutdown 2023-03-17T11:13:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 msgr2=0x561485a2e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 0x561485a2e710 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009550 tx=0x7fbbf0095420 comp rx=0 tx=0).stop 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 shutdown_connections 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561485a254f0 0x561485a8f0a0 crc :-1 s=READY pgs=616 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561485a24be0 0x561485a2f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56148587c6b0 0x561485a2e710 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 --2- 172.21.15.35:0/220160880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561485a1f960 0x561485a2ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 >> 172.21.15.35:0/220160880 conn(0x561485a1efe0 msgr2=0x561485a226b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbbe77fe700 0 client.20301 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 shutdown_connections 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 1 -- 172.21.15.35:0/220160880 wait complete. 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc1a74fb80 20 client.20301 trim_cache size 0 max 16384 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbbf409f640 msgr2=0x7fbbf40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.654+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbbf409f640 0x7fbbf40a1af0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbc08197850 tx=0x7fbbf8009260 comp rx=0 tx=0).stop 2023-03-17T11:13:18.986 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:41 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:13:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 msgr2=0x7fbc08196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc08196240 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0005910 tx=0x7fbbf000f690 comp rx=0 tx=0).stop 2023-03-17T11:13:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 shutdown_connections 2023-03-17T11:13:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbbf409f640 0x7fbbf40a1af0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc08104390 0x7fbc0819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbc080ff350 0x7fbc08196240 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 --2- 172.21.15.35:0/290689564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc080ffcf0 0x7fbc08196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 >> 172.21.15.35:0/290689564 conn(0x7fbc08076330 msgr2=0x7fbc08068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 shutdown_connections 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:48:50.655+0000 7fbc0e5c2700 1 -- 172.21.15.35:0/290689564 wait complete. 2023-03-17T11:13:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 -- 172.21.15.35:0/53681150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 msgr2=0x7f54f4105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 --2- 172.21.15.35:0/53681150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4105510 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f54e80099c0 tx=0x7f54e8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 -- 172.21.15.35:0/53681150 shutdown_connections 2023-03-17T11:13:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 --2- 172.21.15.35:0/53681150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 0x7f54f410cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 --2- 172.21.15.35:0/53681150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4105510 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 --2- 172.21.15.35:0/53681150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4100970 0x7f54f4100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 -- 172.21.15.35:0/53681150 >> 172.21.15.35:0/53681150 conn(0x7f54f40774c0 msgr2=0x7f54f40778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 -- 172.21.15.35:0/53681150 shutdown_connections 2023-03-17T11:13:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.192+0000 7f54f9442700 1 -- 172.21.15.35:0/53681150 wait complete. 2023-03-17T11:13:21.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 Processor -- start 2023-03-17T11:13:21.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 -- start start 2023-03-17T11:13:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4100970 0x7f54f419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 0x7f54f419e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4198910 con 0x7f54f4105140 2023-03-17T11:13:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4198a80 con 0x7f54f4101320 2023-03-17T11:13:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f9442700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4198c40 con 0x7f54f4100970 2023-03-17T11:13:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54164/0 (socket says 172.21.15.35:54164) 2023-03-17T11:13:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f37fe700 1 -- 172.21.15.35:0/2282937034 learned_addr learned my addr 172.21.15.35:0/2282937034 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4100970 0x7f54f419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.193+0000 7f54f27fc700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 0x7f54f419e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f37fe700 1 -- 172.21.15.35:0/2282937034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4100970 msgr2=0x7f54f419e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f37fe700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4100970 0x7f54f419e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f37fe700 1 -- 172.21.15.35:0/2282937034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 msgr2=0x7f54f419e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f37fe700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 0x7f54f419e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f37fe700 1 -- 172.21.15.35:0/2282937034 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80095f0 con 0x7f54f4105140 2023-03-17T11:13:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f27fc700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 0x7f54f419e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:13:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f37fe700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4198280 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00ef30 tx=0x7f54ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54dbfff700 1 -- 172.21.15.35:0/2282937034 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec018070 con 0x7f54f4105140 2023-03-17T11:13:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f4073ed0 con 0x7f54f4105140 2023-03-17T11:13:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54dbfff700 1 -- 172.21.15.35:0/2282937034 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54ec00f040 con 0x7f54f4105140 2023-03-17T11:13:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f4073d40 con 0x7f54f4105140 2023-03-17T11:13:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.194+0000 7f54dbfff700 1 -- 172.21.15.35:0/2282937034 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00cc70 con 0x7f54f4105140 2023-03-17T11:13:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.196+0000 7f54dbfff700 1 -- 172.21.15.35:0/2282937034 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f54ec007500 con 0x7f54f4105140 2023-03-17T11:13:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.197+0000 7f54dbfff700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54dc09f640 0x7f54dc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.198+0000 7f54dbfff700 1 -- 172.21.15.35:0/2282937034 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(329..329 src has 1..329) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f54ec0ca1e0 con 0x7f54f4105140 2023-03-17T11:13:28.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.198+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54dc09f640 0x7f54dc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.198+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54dc09f640 0x7f54dc0a1af0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f54e800b580 tx=0x7f54e8005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.198+0000 7f55055cfb80 1 Processor -- start 2023-03-17T11:13:28.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.198+0000 7f55055cfb80 1 -- start start 2023-03-17T11:13:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412b4f0 0x5617e4125420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4125d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f55055cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e402c010 con 0x5617e4125960 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f55055cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e407e950 con 0x5617e412b4f0 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f55055cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e4077de0 con 0x5617e412abe0 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4125d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4125d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54172/0 (socket says 172.21.15.35:54172) 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 -- 172.21.15.35:0/1176979387 learned_addr learned my addr 172.21.15.35:0/1176979387 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f27fc700 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412b4f0 0x5617e4125420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 -- 172.21.15.35:0/1176979387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 msgr2=0x5617e412afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 -- 172.21.15.35:0/1176979387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412b4f0 msgr2=0x5617e4125420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412b4f0 0x5617e4125420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 -- 172.21.15.35:0/1176979387 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617e3ef95d0 con 0x5617e4125960 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54f37fe700 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4125d90 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f54ec094790 tx=0x7f54ec097b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50979644ddb89b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.199+0000 7f54d97fa700 1 -- 172.21.15.35:0/1176979387 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0ca040 con 0x5617e4125960 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f54d97fa700 1 -- 172.21.15.35:0/1176979387 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54ec097d20 con 0x5617e4125960 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f54d97fa700 1 -- 172.21.15.35:0/1176979387 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec097470 con 0x5617e4125960 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 -- 172.21.15.35:0/1176979387 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 msgr2=0x5617e4125d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4125d90 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f54ec094790 tx=0x7f54ec097b70 comp rx=0 tx=0).stop 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 -- 172.21.15.35:0/1176979387 shutdown_connections 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4125d90 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1176979387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412b4f0 0x5617e4125420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 -- 172.21.15.35:0/1176979387 >> 172.21.15.35:0/1176979387 conn(0x5617e3f826b0 msgr2=0x5617e411fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 -- 172.21.15.35:0/1176979387 shutdown_connections 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.200+0000 7f55055cfb80 1 -- 172.21.15.35:0/1176979387 wait complete. 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 -- start start 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 Processor -- start 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4131420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e412ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e3efb8c0 con 0x5617e412b4f0 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e412f4b0 con 0x5617e4125960 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e413b000 con 0x5617e412abe0 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f55055cfb80 10 client.0 _ll_register_callbacks cb 0x5617e3f1d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e412ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e412ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54178/0 (socket says 172.21.15.35:54178) 2023-03-17T11:13:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f2ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4131420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 -- 172.21.15.35:0/3134653777 learned_addr learned my addr 172.21.15.35:0/3134653777 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f27fc700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 -- 172.21.15.35:0/3134653777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 msgr2=0x5617e412e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 -- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 msgr2=0x5617e4131420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.201+0000 7f54f37fe700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4131420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54f37fe700 1 -- 172.21.15.35:0/3134653777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f4073d40 con 0x5617e412b4f0 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4131420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54f37fe700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e412ed40 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0c7f70 tx=0x7f54ec007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183bc31f161f9e78 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:13:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54d6ff5700 1 -- 172.21.15.35:0/3134653777 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec098180 con 0x5617e412b4f0 2023-03-17T11:13:33.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54d6ff5700 1 -- 172.21.15.35:0/3134653777 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(329..329 src has 1..329) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f54ec09fe80 con 0x5617e412b4f0 2023-03-17T11:13:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617e403a390 con 0x5617e412b4f0 2023-03-17T11:13:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54d6ff5700 1 -- 172.21.15.35:0/3134653777 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54ec078050 con 0x5617e412b4f0 2023-03-17T11:13:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 10 client.20313 fetch_fsmap learned FSMap version 102 2023-03-17T11:13:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5617e3ea5d80 con 0x5617e412b4f0 2023-03-17T11:13:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54d6ff5700 1 -- 172.21.15.35:0/3134653777 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5617e403a390 con 0x5617e412b4f0 2023-03-17T11:13:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f54d6ff5700 1 -- 172.21.15.35:0/3134653777 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f54ec093cf0 con 0x5617e412b4f0 2023-03-17T11:13:34.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 10 client.20313 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 10 client.20313 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 20 client.20313 populate_metadata read hostname 'smithi035' 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.202+0000 7f55055cfb80 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e413eb90 0x5617e4140f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.203+0000 7f55055cfb80 4 client.20313 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.203+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617e4046600 con 0x5617e413eb90 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.203+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e413eb90 0x5617e4140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.203+0000 7f54d6ff5700 10 client.20313 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.203+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e413eb90 0x5617e4140f70 crc :-1 s=READY pgs=617 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad9da9eedd8b2b5d server_cookie=b6118d3b1c5acc00 in_seq=0 out_seq=0 2023-03-17T11:13:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f54d6ff5700 1 -- 172.21.15.35:0/3134653777 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5617e4046600 con 0x5617e413eb90 2023-03-17T11:13:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f54d6ff5700 10 client.20313 handle_command_reply: tid=0 2023-03-17T11:13:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 client.20313 shutdown 2023-03-17T11:13:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 msgr2=0x5617e412ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e412ed40 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0c7f70 tx=0x7f54ec007f30 comp rx=0 tx=0).stop 2023-03-17T11:13:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 shutdown_connections 2023-03-17T11:13:36.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e413eb90 0x5617e4140f70 crc :-1 s=READY pgs=617 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e412ed40 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4131420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f54d6ff5700 0 client.20313 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 --2- 172.21.15.35:0/3134653777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e412e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 >> 172.21.15.35:0/3134653777 conn(0x5617e3f826b0 msgr2=0x5617e4124410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 shutdown_connections 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 1 -- 172.21.15.35:0/3134653777 wait complete. 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.204+0000 7f55055cfb80 20 client.20313 trim_cache size 0 max 16384 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 Processor -- start 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 -- start start 2023-03-17T11:13:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4128d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e4135f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e4130fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e4120380 con 0x5617e412b4f0 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e411b0d0 con 0x5617e4125960 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f55055cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e41206d0 con 0x5617e412abe0 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e4130fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f54f37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e4130fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54186/0 (socket says 172.21.15.35:54186) 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.219+0000 7f54f37fe700 1 -- 172.21.15.35:0/1778769936 learned_addr learned my addr 172.21.15.35:0/1778769936 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4128d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f27fc700 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e4135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f37fe700 1 -- 172.21.15.35:0/1778769936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 msgr2=0x5617e4135f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f37fe700 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e4135f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f37fe700 1 -- 172.21.15.35:0/1778769936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 msgr2=0x5617e4128d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f37fe700 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4128d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f37fe700 1 -- 172.21.15.35:0/1778769936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617e403e130 con 0x5617e412b4f0 2023-03-17T11:13:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54f37fe700 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e4130fc0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f54ec094790 tx=0x7f54ec004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce4a282d9406228 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54d9ffb700 1 -- 172.21.15.35:0/1778769936 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec078030 con 0x5617e412b4f0 2023-03-17T11:13:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54d9ffb700 1 -- 172.21.15.35:0/1778769936 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54ec09fe80 con 0x5617e412b4f0 2023-03-17T11:13:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f54d9ffb700 1 -- 172.21.15.35:0/1778769936 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0981e0 con 0x5617e412b4f0 2023-03-17T11:13:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f55055cfb80 1 -- 172.21.15.35:0/1778769936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 msgr2=0x5617e4130fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.220+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e4130fc0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f54ec094790 tx=0x7f54ec004bf0 comp rx=0 tx=0).stop 2023-03-17T11:13:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- 172.21.15.35:0/1778769936 shutdown_connections 2023-03-17T11:13:43.511 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:42 smithi035 ceph-mon[92535]: pgmap v4532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:45.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:43 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:44 smithi035 ceph-mon[92535]: pgmap v4533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:46 smithi035 ceph-mon[92535]: pgmap v4534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:48 smithi035 ceph-mon[92535]: pgmap v4535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:50 smithi035 ceph-mon[92535]: pgmap v4536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:52 smithi035 ceph-mon[92535]: pgmap v4537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:54 smithi035 ceph-mon[92535]: pgmap v4538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:56 smithi035 ceph-mon[92535]: pgmap v4539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:45.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:57 smithi035 ceph-mon[92535]: pgmap v4540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:57 smithi035 ceph-mon[92535]: pgmap v4541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:03:59 smithi035 ceph-mon[92535]: pgmap v4542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:01 smithi035 ceph-mon[92535]: pgmap v4543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:03 smithi035 ceph-mon[92535]: pgmap v4544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T11:13:45.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:05 smithi035 ceph-mon[92535]: pgmap v4545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:07 smithi035 ceph-mon[92535]: pgmap v4546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:09 smithi035 ceph-mon[92535]: pgmap v4547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:10 smithi035 ceph-mon[92535]: osdmap e356: 12 total, 12 up, 12 in 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:11 smithi035 ceph-mon[92535]: pgmap v4549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:13 smithi035 ceph-mon[92535]: pgmap v4550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:15 smithi035 ceph-mon[92535]: pgmap v4551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:17 smithi035 ceph-mon[92535]: pgmap v4552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:13:45.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:17 smithi035 ceph-mon[92535]: osdmap e357: 12 total, 12 up, 12 in 2023-03-17T11:13:45.904 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:19 smithi035 ceph-mon[92535]: pgmap v4554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-03-17T11:13:45.904 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:21 smithi035 ceph-mon[92535]: pgmap v4555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:23 smithi035 ceph-mon[92535]: pgmap v4556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:25 smithi035 ceph-mon[92535]: pgmap v4557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:27 smithi035 ceph-mon[92535]: pgmap v4558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:29 smithi035 ceph-mon[92535]: pgmap v4559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:31 smithi035 ceph-mon[92535]: pgmap v4560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:33 smithi035 ceph-mon[92535]: pgmap v4561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:35 smithi035 ceph-mon[92535]: pgmap v4562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:37 smithi035 ceph-mon[92535]: pgmap v4563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:13:46.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:39 smithi035 ceph-mon[92535]: pgmap v4564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:41 smithi035 ceph-mon[92535]: pgmap v4565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:43 smithi035 ceph-mon[92535]: pgmap v4566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:45 smithi035 ceph-mon[92535]: pgmap v4567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:47 smithi035 ceph-mon[92535]: pgmap v4568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:49 smithi035 ceph-mon[92535]: pgmap v4569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:51 smithi035 ceph-mon[92535]: pgmap v4570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:53 smithi035 ceph-mon[92535]: pgmap v4571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:55 smithi035 ceph-mon[92535]: pgmap v4572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:57 smithi035 ceph-mon[92535]: pgmap v4573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:58 smithi035 ceph-mon[92535]: pgmap v4574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 283 B/s wr, 14 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:04:58 smithi035 ceph-mon[92535]: pgmap v4575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:13:46.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:00 smithi035 ceph-mon[92535]: pgmap v4576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:02 smithi035 ceph-mon[92535]: pgmap v4577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:04 smithi035 ceph-mon[92535]: pgmap v4578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 KiB/s wr, 28 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:06 smithi035 ceph-mon[92535]: pgmap v4579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 KiB/s wr, 28 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:08 smithi035 ceph-mon[92535]: pgmap v4580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 25 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:10 smithi035 ceph-mon[92535]: pgmap v4581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:12 smithi035 ceph-mon[92535]: pgmap v4582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:14 smithi035 ceph-mon[92535]: pgmap v4583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:16 smithi035 ceph-mon[92535]: pgmap v4584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:18 smithi035 ceph-mon[92535]: pgmap v4585: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:20 smithi035 ceph-mon[92535]: pgmap v4586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:22 smithi035 ceph-mon[92535]: pgmap v4587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:24 smithi035 ceph-mon[92535]: pgmap v4588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:26 smithi035 ceph-mon[92535]: pgmap v4589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:28 smithi035 ceph-mon[92535]: pgmap v4590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:30 smithi035 ceph-mon[92535]: pgmap v4591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:32 smithi035 ceph-mon[92535]: pgmap v4592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:34 smithi035 ceph-mon[92535]: pgmap v4593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:13:46.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:36 smithi035 ceph-mon[92535]: pgmap v4594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:13:46.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:38 smithi035 ceph-mon[92535]: pgmap v4595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:13:46.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:13:46.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:13:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:13:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:13:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:13:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:13:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:13:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e412b4f0 0x5617e4130fc0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e4125960 0x5617e4128d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 --2- 172.21.15.35:0/1778769936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412abe0 0x5617e4135f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- 172.21.15.35:0/1778769936 >> 172.21.15.35:0/1778769936 conn(0x5617e3f826b0 msgr2=0x5617e4128650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- 172.21.15.35:0/1778769936 shutdown_connections 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- 172.21.15.35:0/1778769936 wait complete. 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- start start 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 Processor -- start 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4186b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412abe0 0x5617e41870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412b4f0 0x5617e418b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e418bf20 con 0x5617e4125960 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e418c090 con 0x5617e412abe0 2023-03-17T11:13:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e418c250 con 0x5617e412b4f0 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f55055cfb80 10 client.0 _ll_register_callbacks cb 0x5617e3f1d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f54f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4186b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f54f2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4186b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54188/0 (socket says 172.21.15.35:54188) 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.221+0000 7f54f2ffd700 1 -- 172.21.15.35:0/2198259023 learned_addr learned my addr 172.21.15.35:0/2198259023 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f27fc700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412abe0 0x5617e41870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f2ffd700 1 -- 172.21.15.35:0/2198259023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412b4f0 msgr2=0x5617e418b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f37fe700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412b4f0 0x5617e418b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412b4f0 0x5617e418b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f2ffd700 1 -- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412abe0 msgr2=0x5617e41870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412abe0 0x5617e41870c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f2ffd700 1 -- 172.21.15.35:0/2198259023 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5617e3ea5d80 con 0x5617e4125960 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f27fc700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412abe0 0x5617e41870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54f2ffd700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4186b80 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f54e80099c0 tx=0x7f54e8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9b7d268bfe4531 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54d6ff5700 1 -- 172.21.15.35:0/2198259023 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8028040 con 0x5617e4125960 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54d6ff5700 1 -- 172.21.15.35:0/2198259023 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(329..329 src has 1..329) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f54e80056b0 con 0x5617e4125960 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617e40f51e0 con 0x5617e4125960 2023-03-17T11:13:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54d6ff5700 1 -- 172.21.15.35:0/2198259023 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54e80320f0 con 0x5617e4125960 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f55055cfb80 10 client.20319 fetch_fsmap learned FSMap version 102 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5617e3ecc1f0 con 0x5617e4125960 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.222+0000 7f54d6ff5700 1 -- 172.21.15.35:0/2198259023 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5617e40f51e0 con 0x5617e4125960 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f54d6ff5700 1 -- 172.21.15.35:0/2198259023 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f54e800f9f0 con 0x5617e4125960 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f55055cfb80 10 client.20319 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f55055cfb80 10 client.20319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f55055cfb80 20 client.20319 populate_metadata read hostname 'smithi035' 2023-03-17T11:13:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f55055cfb80 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e41938c0 0x5617e4195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f55055cfb80 4 client.20319 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:13:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5617e3efbf00 con 0x5617e41938c0 2023-03-17T11:13:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f54f27fc700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e41938c0 0x5617e4195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f54d6ff5700 10 client.20319 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.223+0000 7f54f27fc700 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e41938c0 0x5617e4195cd0 crc :-1 s=READY pgs=618 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3850b1c2124a6524 server_cookie=e6f0cdbefae7f53c in_seq=0 out_seq=0 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f54d6ff5700 1 -- 172.21.15.35:0/2198259023 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5617e3efbf00 con 0x5617e41938c0 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f54d6ff5700 10 client.20319 handle_command_reply: tid=0 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 client.20319 shutdown 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 msgr2=0x5617e4186b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4186b80 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f54e80099c0 tx=0x7f54e8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 shutdown_connections 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5617e41938c0 0x5617e4195cd0 crc :-1 s=READY pgs=618 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617e412b4f0 0x5617e418b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f54d6ff5700 0 client.20319 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5617e4125960 0x5617e4186b80 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 --2- 172.21.15.35:0/2198259023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5617e412abe0 0x5617e41870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 >> 172.21.15.35:0/2198259023 conn(0x5617e3f826b0 msgr2=0x5617e4129830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 shutdown_connections 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 1 -- 172.21.15.35:0/2198259023 wait complete. 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.242+0000 7f55055cfb80 20 client.20319 trim_cache size 0 max 16384 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54dc09f640 msgr2=0x7f54dc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54dc09f640 0x7f54dc0a1af0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f54e800b580 tx=0x7f54e8005c00 comp rx=0 tx=0).stop 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 msgr2=0x7f54f4198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4198280 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00ef30 tx=0x7f54ec00c3a0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 shutdown_connections 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f54dc09f640 0x7f54dc0a1af0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f54f4105140 0x7f54f4198280 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f4100970 0x7f54f419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 --2- 172.21.15.35:0/2282937034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54f4101320 0x7f54f419e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:51.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 >> 172.21.15.35:0/2282937034 conn(0x7f54f40774c0 msgr2=0x7f54f40fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 shutdown_connections 2023-03-17T11:13:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:50:52.243+0000 7f54f9442700 1 -- 172.21.15.35:0/2282937034 wait complete. 2023-03-17T11:13:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.366+0000 7f999e240700 1 -- 172.21.15.35:0/1976540148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9998101580 msgr2=0x7f9998104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.366+0000 7f999e240700 1 --2- 172.21.15.35:0/1976540148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9998101580 0x7f9998104e10 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f998c0099c0 tx=0x7f998c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:13:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 -- 172.21.15.35:0/1976540148 shutdown_connections 2023-03-17T11:13:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 --2- 172.21.15.35:0/1976540148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99981054f0 0x7f999810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 --2- 172.21.15.35:0/1976540148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998100be0 0x7f9998100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 --2- 172.21.15.35:0/1976540148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9998101580 0x7f9998104e10 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 -- 172.21.15.35:0/1976540148 >> 172.21.15.35:0/1976540148 conn(0x7f99980774e0 msgr2=0x7f99980778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 -- 172.21.15.35:0/1976540148 shutdown_connections 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.367+0000 7f999e240700 1 -- 172.21.15.35:0/1976540148 wait complete. 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 Processor -- start 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 -- start start 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9998100be0 0x7f9998196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998101580 0x7f9998196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 0x7f999819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:54.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999819b220 con 0x7f99981054f0 2023-03-17T11:13:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999819b390 con 0x7f9998101580 2023-03-17T11:13:54.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f999e240700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999819b550 con 0x7f9998100be0 2023-03-17T11:13:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 0x7f999819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 0x7f999819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54206/0 (socket says 172.21.15.35:54206) 2023-03-17T11:13:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f9997fff700 1 -- 172.21.15.35:0/2349653543 learned_addr learned my addr 172.21.15.35:0/2349653543 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.368+0000 7f9996ffd700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998101580 0x7f9998196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f99977fe700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9998100be0 0x7f9998196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9997fff700 1 -- 172.21.15.35:0/2349653543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9998100be0 msgr2=0x7f9998196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9997fff700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9998100be0 0x7f9998196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9997fff700 1 -- 172.21.15.35:0/2349653543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998101580 msgr2=0x7f9998196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9997fff700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998101580 0x7f9998196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9997fff700 1 -- 172.21.15.35:0/2349653543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0095f0 con 0x7f99981054f0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9997fff700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 0x7f999819abe0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f999000ef30 tx=0x7f999000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9994ff9700 1 -- 172.21.15.35:0/2349653543 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990018070 con 0x7f99981054f0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9994ff9700 1 -- 172.21.15.35:0/2349653543 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f999000f040 con 0x7f99981054f0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9998110160 con 0x7f99981054f0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f9994ff9700 1 -- 172.21.15.35:0/2349653543 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999000cbc0 con 0x7f99981054f0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.369+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999810ffd0 con 0x7f99981054f0 2023-03-17T11:13:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.371+0000 7f9994ff9700 1 -- 172.21.15.35:0/2349653543 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f999000cd60 con 0x7f99981054f0 2023-03-17T11:13:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.372+0000 7f9994ff9700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f998009f6c0 0x7f99800a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.372+0000 7f9994ff9700 1 -- 172.21.15.35:0/2349653543 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(329..329 src has 1..329) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99900c9fe0 con 0x7f99981054f0 2023-03-17T11:13:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.372+0000 7f99977fe700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f998009f6c0 0x7f99800a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99977fe700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f998009f6c0 0x7f99800a1b70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9988009c60 tx=0x7f9988009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:13:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 Processor -- start 2023-03-17T11:13:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 -- start start 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3f040 0x56432ab3f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab39ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 0x56432ab45dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432aa3c010 con 0x56432ab3a1e0 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432aa8e950 con 0x56432ab39830 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432aa87de0 con 0x56432ab3f040 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 0x56432ab45dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 0x56432ab45dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54214/0 (socket says 172.21.15.35:54214) 2023-03-17T11:13:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f9997fff700 1 -- 172.21.15.35:0/4073624204 learned_addr learned my addr 172.21.15.35:0/4073624204 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:13:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f99977fe700 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3f040 0x56432ab3f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.373+0000 7f9996ffd700 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab39ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:13:58.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f9997fff700 1 -- 172.21.15.35:0/4073624204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3f040 msgr2=0x56432ab3f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f9997fff700 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3f040 0x56432ab3f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f9997fff700 1 -- 172.21.15.35:0/4073624204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 msgr2=0x56432ab39ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f9997fff700 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab39ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f9997fff700 1 -- 172.21.15.35:0/4073624204 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56432a9095d0 con 0x56432ab3a1e0 2023-03-17T11:14:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f9997fff700 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 0x56432ab45dd0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f9990009f40 tx=0x7f9990097480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c65ab4b3c3a312 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f997dffb700 1 -- 172.21.15.35:0/4073624204 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990095ec0 con 0x56432ab3a1e0 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f997dffb700 1 -- 172.21.15.35:0/4073624204 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9990097d80 con 0x56432ab3a1e0 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.374+0000 7f997dffb700 1 -- 172.21.15.35:0/4073624204 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999009f7f0 con 0x56432ab3a1e0 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/4073624204 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 msgr2=0x56432ab45dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 0x56432ab45dd0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f9990009f40 tx=0x7f9990097480 comp rx=0 tx=0).stop 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/4073624204 shutdown_connections 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3a1e0 0x56432ab45dd0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3f040 0x56432ab3f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/4073624204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab39ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/4073624204 >> 172.21.15.35:0/4073624204 conn(0x56432a9926b0 msgr2=0x56432ab2fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/4073624204 shutdown_connections 2023-03-17T11:14:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/4073624204 wait complete. 2023-03-17T11:14:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 -- start start 2023-03-17T11:14:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.375+0000 7f99aa3cdb80 1 Processor -- start 2023-03-17T11:14:04.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab48c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:04.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab49150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab42f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432a90b8c0 con 0x56432ab3f040 2023-03-17T11:14:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432ab43520 con 0x56432ab39830 2023-03-17T11:14:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432ab436e0 con 0x56432ab3a1e0 2023-03-17T11:14:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99aa3cdb80 10 client.0 _ll_register_callbacks cb 0x56432a92d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:14:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab42f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:08.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab42f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54220/0 (socket says 172.21.15.35:54220) 2023-03-17T11:14:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 -- 172.21.15.35:0/1880483806 learned_addr learned my addr 172.21.15.35:0/1880483806 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9996ffd700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab49150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:09.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99977fe700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab48c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 -- 172.21.15.35:0/1880483806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 msgr2=0x56432ab49150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab49150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 -- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 msgr2=0x56432ab48c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab48c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 -- 172.21.15.35:0/1880483806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999810ffd0 con 0x56432ab3f040 2023-03-17T11:14:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f99977fe700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab48c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:14:10.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:40 smithi035 ceph-mon[92535]: pgmap v4596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9997fff700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab42f10 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f99900c7820 tx=0x7f9990004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113bc1348f240a01 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9976ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.376+0000 7f9976ffd700 1 -- 172.21.15.35:0/1880483806 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990097210 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f9976ffd700 1 -- 172.21.15.35:0/1880483806 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(329..329 src has 1..329) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f999009f7f0 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56432aa4a390 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f9976ffd700 1 -- 172.21.15.35:0/1880483806 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99900b3070 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 10 client.20331 fetch_fsmap learned FSMap version 102 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56432a8b5d80 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f9976ffd700 1 -- 172.21.15.35:0/1880483806 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56432aa4a390 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f9976ffd700 1 -- 172.21.15.35:0/1880483806 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9990093910 con 0x56432ab3f040 2023-03-17T11:14:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 10 client.20331 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:14:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 10 client.20331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:14:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 20 client.20331 populate_metadata read hostname 'smithi035' 2023-03-17T11:14:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432ab52f40 0x56432ab55320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 4 client.20331 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:14:12.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56432aa56600 con 0x56432ab52f40 2023-03-17T11:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.377+0000 7f99977fe700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432ab52f40 0x56432ab55320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.378+0000 7f9976ffd700 10 client.20331 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.378+0000 7f99977fe700 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432ab52f40 0x56432ab55320 crc :-1 s=READY pgs=619 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe480a025e1bf73 server_cookie=8255f00226aab7d0 in_seq=0 out_seq=0 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.378+0000 7f9976ffd700 1 -- 172.21.15.35:0/1880483806 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56432aa56600 con 0x56432ab52f40 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.378+0000 7f9976ffd700 10 client.20331 handle_command_reply: tid=0 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.378+0000 7f99aa3cdb80 1 client.20331 shutdown 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 msgr2=0x56432ab42f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab42f10 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f99900c7820 tx=0x7f9990004bf0 comp rx=0 tx=0).stop 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 shutdown_connections 2023-03-17T11:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432ab52f40 0x56432ab55320 crc :-1 s=READY pgs=619 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab42f10 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab39830 0x56432ab48c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1880483806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab49150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f9976ffd700 0 client.20331 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 >> 172.21.15.35:0/1880483806 conn(0x56432a9926b0 msgr2=0x56432ab34410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 shutdown_connections 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1880483806 wait complete. 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.379+0000 7f99aa3cdb80 20 client.20331 trim_cache size 0 max 16384 2023-03-17T11:14:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 Processor -- start 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 -- start start 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab39830 0x56432ab39c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3a1e0 0x56432ab2fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab427b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432ab2b0f0 con 0x56432ab3f040 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432ab30e30 con 0x56432ab3a1e0 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432ab30000 con 0x56432ab39830 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54228/0 (socket says 172.21.15.35:54228) 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 -- 172.21.15.35:0/1248848564 learned_addr learned my addr 172.21.15.35:0/1248848564 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9996ffd700 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3a1e0 0x56432ab2fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f99977fe700 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab39830 0x56432ab39c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 -- 172.21.15.35:0/1248848564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab39830 msgr2=0x56432ab39c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab39830 0x56432ab39c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 -- 172.21.15.35:0/1248848564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3a1e0 msgr2=0x56432ab2fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3a1e0 0x56432ab2fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9997fff700 1 -- 172.21.15.35:0/1248848564 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56432aa4e130 con 0x56432ab3f040 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.394+0000 7f9996ffd700 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3a1e0 0x56432ab2fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f9997fff700 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab427b0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f9990009f40 tx=0x7f9990004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703a11ea27f5a700 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f997e7fc700 1 -- 172.21.15.35:0/1248848564 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900b5900 con 0x56432ab3f040 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f997e7fc700 1 -- 172.21.15.35:0/1248848564 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99900c1e90 con 0x56432ab3f040 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f997e7fc700 1 -- 172.21.15.35:0/1248848564 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999009f7f0 con 0x56432ab3f040 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1248848564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 msgr2=0x56432ab427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab427b0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f9990009f40 tx=0x7f9990004b40 comp rx=0 tx=0).stop 2023-03-17T11:14:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1248848564 shutdown_connections 2023-03-17T11:14:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab3f040 0x56432ab427b0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab39830 0x56432ab39c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1248848564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3a1e0 0x56432ab2fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1248848564 >> 172.21.15.35:0/1248848564 conn(0x56432a9926b0 msgr2=0x56432ab59c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1248848564 shutdown_connections 2023-03-17T11:14:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.395+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1248848564 wait complete. 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 -- start start 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 Processor -- start 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 0x56432ab9aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab9b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3f040 0x56432aba5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432aba6290 con 0x56432ab39830 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432aba63d0 con 0x56432ab3f040 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.396+0000 7f99aa3cdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432aba6510 con 0x56432ab3a1e0 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 0x56432ab9aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99aa3cdb80 10 client.0 _ll_register_callbacks cb 0x56432a92d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:14:18.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 0x56432ab9aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54230/0 (socket says 172.21.15.35:54230) 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 -- 172.21.15.35:0/1613093917 learned_addr learned my addr 172.21.15.35:0/1613093917 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9996ffd700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab9b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9997fff700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3f040 0x56432aba5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 -- 172.21.15.35:0/1613093917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 msgr2=0x56432ab9b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab9b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 -- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3f040 msgr2=0x56432aba5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3f040 0x56432aba5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 -- 172.21.15.35:0/1613093917 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56432a8b5d80 con 0x56432ab39830 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9997fff700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3f040 0x56432aba5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:14:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99977fe700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 0x56432ab9aec0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x56432ab55bc0 tx=0x7f99880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56eab4423a17827a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9976ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:14:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9976ffd700 1 -- 172.21.15.35:0/1613093917 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998802a240 con 0x56432ab39830 2023-03-17T11:14:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9976ffd700 1 -- 172.21.15.35:0/1613093917 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(329..329 src has 1..329) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f998802a3a0 con 0x56432ab39830 2023-03-17T11:14:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56432ab051e0 con 0x56432ab39830 2023-03-17T11:14:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f9976ffd700 1 -- 172.21.15.35:0/1613093917 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f998802a560 con 0x56432ab39830 2023-03-17T11:14:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.397+0000 7f99aa3cdb80 10 client.20337 fetch_fsmap learned FSMap version 102 2023-03-17T11:14:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x56432a8dc1f0 con 0x56432ab39830 2023-03-17T11:14:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f9976ffd700 1 -- 172.21.15.35:0/1613093917 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56432ab051e0 con 0x56432ab39830 2023-03-17T11:14:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f9976ffd700 1 -- 172.21.15.35:0/1613093917 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9988033900 con 0x56432ab39830 2023-03-17T11:14:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 10 client.20337 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 10 client.20337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 20 client.20337 populate_metadata read hostname 'smithi035' 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432aba7c00 0x56432abaa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 4 client.20337 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56432a90bf00 con 0x56432aba7c00 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f9996ffd700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432aba7c00 0x56432abaa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f9996ffd700 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432aba7c00 0x56432abaa010 crc :-1 s=READY pgs=620 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47a9b843105adc79 server_cookie=4ab5988d058f92fd in_seq=0 out_seq=0 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.398+0000 7f9976ffd700 10 client.20337 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f9976ffd700 1 -- 172.21.15.35:0/1613093917 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56432a90bf00 con 0x56432aba7c00 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f9976ffd700 10 client.20337 handle_command_reply: tid=0 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 client.20337 shutdown 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 msgr2=0x56432ab9aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 0x56432ab9aec0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x56432ab55bc0 tx=0x7f99880047c0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 shutdown_connections 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56432aba7c00 0x56432abaa010 crc :-1 s=READY pgs=620 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56432ab3f040 0x56432aba5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f9976ffd700 0 client.20337 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56432ab39830 0x56432ab9aec0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 --2- 172.21.15.35:0/1613093917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56432ab3a1e0 0x56432ab9b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 >> 172.21.15.35:0/1613093917 conn(0x56432a9926b0 msgr2=0x56432ab427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 shutdown_connections 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 1 -- 172.21.15.35:0/1613093917 wait complete. 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.416+0000 7f99aa3cdb80 20 client.20337 trim_cache size 0 max 16384 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f998009f6c0 msgr2=0x7f99800a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f998009f6c0 0x7f99800a1b70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9988009c60 tx=0x7f9988009260 comp rx=0 tx=0).stop 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 msgr2=0x7f999819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 0x7f999819abe0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f999000ef30 tx=0x7f999000c3a0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 shutdown_connections 2023-03-17T11:14:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f998009f6c0 0x7f99800a1b70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99981054f0 0x7f999819abe0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9998100be0 0x7f9998196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 --2- 172.21.15.35:0/2349653543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998101580 0x7f9998196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 >> 172.21.15.35:0/2349653543 conn(0x7f99980774e0 msgr2=0x7f99980fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 shutdown_connections 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:05.417+0000 7f999e240700 1 -- 172.21.15.35:0/2349653543 wait complete. 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 -- 172.21.15.35:0/2635063046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b41013f0 msgr2=0x7fb6b41017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/2635063046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b41013f0 0x7fb6b41017c0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009990 tx=0x7fb6b0009ca0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 -- 172.21.15.35:0/2635063046 shutdown_connections 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/2635063046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6b410a730 0x7fb6b410cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/2635063046 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b41013f0 0x7fb6b41017c0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/2635063046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b4101d00 0x7fb6b410a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 -- 172.21.15.35:0/2635063046 >> 172.21.15.35:0/2635063046 conn(0x7fb6b4076330 msgr2=0x7fb6b4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 -- 172.21.15.35:0/2635063046 shutdown_connections 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.539+0000 7fb6bbe15700 1 -- 172.21.15.35:0/2635063046 wait complete. 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 Processor -- start 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 -- start start 2023-03-17T11:14:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b41013f0 0x7fb6b41961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 0x7fb6b4196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6b410a730 0x7fb6b419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b419b1a0 con 0x7fb6b4101d00 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b419b310 con 0x7fb6b410a730 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6bbe15700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b419b4d0 con 0x7fb6b41013f0 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 0x7fb6b4196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 0x7fb6b4196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54246/0 (socket says 172.21.15.35:54246) 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1787163992 learned_addr learned my addr 172.21.15.35:0/1787163992 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6b410a730 0x7fb6b419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b41013f0 0x7fb6b41961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1787163992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b41013f0 msgr2=0x7fb6b41961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b41013f0 0x7fb6b41961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1787163992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6b410a730 msgr2=0x7fb6b419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:24.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6b410a730 0x7fb6b419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.540+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1787163992 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00095f0 con 0x7fb6b4101d00 2023-03-17T11:14:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.541+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 0x7fb6b4196700 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400d980 tx=0x7fb6a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.541+0000 7fb6aaffd700 1 -- 172.21.15.35:0/1787163992 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4004220 con 0x7fb6b4101d00 2023-03-17T11:14:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.541+0000 7fb6aaffd700 1 -- 172.21.15.35:0/1787163992 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6a4007640 con 0x7fb6b4101d00 2023-03-17T11:14:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.541+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b41100a0 con 0x7fb6b4101d00 2023-03-17T11:14:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.541+0000 7fb6aaffd700 1 -- 172.21.15.35:0/1787163992 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40055e0 con 0x7fb6b4101d00 2023-03-17T11:14:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.541+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b410ff10 con 0x7fb6b4101d00 2023-03-17T11:14:25.499 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:42 smithi035 ceph-mon[92535]: pgmap v4597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:14:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.543+0000 7fb6aaffd700 1 -- 172.21.15.35:0/1787163992 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb6a4004750 con 0x7fb6b4101d00 2023-03-17T11:14:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.544+0000 7fb6aaffd700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb6a009f6c0 0x7fb6a00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.544+0000 7fb6aaffd700 1 -- 172.21.15.35:0/1787163992 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb6a40ca420 con 0x7fb6b4101d00 2023-03-17T11:14:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.544+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb6a009f6c0 0x7fb6a00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.544+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb6a009f6c0 0x7fb6a00a1b70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b5c0 tx=0x7fb6b0005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 Processor -- start 2023-03-17T11:14:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 -- start start 2023-03-17T11:14:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518dbe0 0x5555a518dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518e4f0 0x5555a5188420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a508f010 con 0x5555a5188960 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a50e1950 con 0x5555a518e4f0 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a50dade0 con 0x5555a518dbe0 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6ba3b2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6ba3b2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54256/0 (socket says 172.21.15.35:54256) 2023-03-17T11:14:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/77872755 learned_addr learned my addr 172.21.15.35:0/77872755 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.545+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518e4f0 0x5555a5188420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518dbe0 0x5555a518dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/77872755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518dbe0 msgr2=0x5555a518dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518dbe0 0x5555a518dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/77872755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518e4f0 msgr2=0x5555a5188420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518e4f0 0x5555a5188420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/77872755 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555a4f5c5d0 con 0x5555a5188960 2023-03-17T11:14:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188d90 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac003fa0 tx=0x7fb6ac009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f525bad42b868c86 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb69ffff700 1 -- 172.21.15.35:0/77872755 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac019070 con 0x5555a5188960 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb69ffff700 1 -- 172.21.15.35:0/77872755 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6ac00f040 con 0x5555a5188960 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.546+0000 7fb69ffff700 1 -- 172.21.15.35:0/77872755 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac007900 con 0x5555a5188960 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/77872755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 msgr2=0x5555a5188d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188d90 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac003fa0 tx=0x7fb6ac009ba0 comp rx=0 tx=0).stop 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/77872755 shutdown_connections 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188d90 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518dbe0 0x5555a518dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/77872755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518e4f0 0x5555a5188420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/77872755 >> 172.21.15.35:0/77872755 conn(0x5555a4fe56b0 msgr2=0x5555a5182a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/77872755 shutdown_connections 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/77872755 wait complete. 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 -- start start 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.547+0000 7fb6c7fa2b80 1 Processor -- start 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a5188960 0x5555a51943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 0x5555a51915d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5191b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a4f5e8c0 con 0x5555a518dbe0 2023-03-17T11:14:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a5192250 con 0x5555a5188960 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a5192410 con 0x5555a518e4f0 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6c7fa2b80 10 client.0 _ll_register_callbacks cb 0x5555a4f80230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 0x5555a51915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 0x5555a51915d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54260/0 (socket says 172.21.15.35:54260) 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1333113272 learned_addr learned my addr 172.21.15.35:0/1333113272 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a5188960 0x5555a51943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:28.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5191b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1333113272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 msgr2=0x5555a5191b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5191b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a5188960 msgr2=0x5555a51943c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a5188960 0x5555a51943c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b93b0700 1 -- 172.21.15.35:0/1333113272 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac003bd0 con 0x5555a518dbe0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.548+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a5188960 0x5555a51943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 0x5555a51915d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40948e0 tx=0x7fb6a40044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685b42435d4b23a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb69d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb69d7fa700 1 -- 172.21.15.35:0/1333113272 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40b0210 con 0x5555a518dbe0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb69d7fa700 1 -- 172.21.15.35:0/1333113272 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb6a40a0060 con 0x5555a518dbe0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555a509d390 con 0x5555a518dbe0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb69d7fa700 1 -- 172.21.15.35:0/1333113272 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6a4097360 con 0x5555a518dbe0 2023-03-17T11:14:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 10 client.20349 fetch_fsmap learned FSMap version 102 2023-03-17T11:14:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5555a4f08d80 con 0x5555a518dbe0 2023-03-17T11:14:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb69d7fa700 1 -- 172.21.15.35:0/1333113272 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5555a509d390 con 0x5555a518dbe0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb69d7fa700 1 -- 172.21.15.35:0/1333113272 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb6a4096dd0 con 0x5555a518dbe0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 10 client.20349 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 10 client.20349 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 20 client.20349 populate_metadata read hostname 'smithi035' 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51a1ef0 0x5555a51a4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 4 client.20349 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.549+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555a50a9600 con 0x5555a51a1ef0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.550+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51a1ef0 0x5555a51a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.550+0000 7fb69d7fa700 10 client.20349 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.550+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51a1ef0 0x5555a51a4300 crc :-1 s=READY pgs=621 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba798f611b852327 server_cookie=d7722f433534a17f in_seq=0 out_seq=0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb69d7fa700 1 -- 172.21.15.35:0/1333113272 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5555a50a9600 con 0x5555a51a1ef0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb69d7fa700 10 client.20349 handle_command_reply: tid=0 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 client.20349 shutdown 2023-03-17T11:14:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 msgr2=0x5555a51915d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 0x5555a51915d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40948e0 tx=0x7fb6a40044a0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 shutdown_connections 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51a1ef0 0x5555a51a4300 crc :-1 s=READY pgs=621 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5191b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a5188960 0x5555a51943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1333113272 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518dbe0 0x5555a51915d0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb69d7fa700 0 client.20349 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 >> 172.21.15.35:0/1333113272 conn(0x5555a4fe56b0 msgr2=0x5555a5182a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 shutdown_connections 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.551+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1333113272 wait complete. 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.552+0000 7fb6c7fa2b80 20 client.20349 trim_cache size 0 max 16384 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 Processor -- start 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 -- start start 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a518f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5182ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a509d390 con 0x5555a5188960 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a517e0f0 con 0x5555a518dbe0 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a5183000 con 0x5555a518e4f0 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54266/0 (socket says 172.21.15.35:54266) 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 -- 172.21.15.35:0/1361522581 learned_addr learned my addr 172.21.15.35:0/1361522581 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a518f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5182ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 -- 172.21.15.35:0/1361522581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 msgr2=0x5555a5182ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5182ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 -- 172.21.15.35:0/1361522581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 msgr2=0x5555a518f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a518f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 -- 172.21.15.35:0/1361522581 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555a5189000 con 0x5555a5188960 2023-03-17T11:14:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a518f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5182ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.567+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188420 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009990 tx=0x7fb6b0022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924a0a132c910417 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6a8ff9700 1 -- 172.21.15.35:0/1361522581 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0033db0 con 0x5555a5188960 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6a8ff9700 1 -- 172.21.15.35:0/1361522581 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6b002c050 con 0x5555a5188960 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6a8ff9700 1 -- 172.21.15.35:0/1361522581 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0004500 con 0x5555a5188960 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1361522581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 msgr2=0x5555a5188420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188420 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009990 tx=0x7fb6b0022000 comp rx=0 tx=0).stop 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1361522581 shutdown_connections 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a518e4f0 0x5555a5182ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a5188960 0x5555a5188420 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/1361522581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a518f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1361522581 >> 172.21.15.35:0/1361522581 conn(0x5555a4fe56b0 msgr2=0x5555a518c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1361522581 shutdown_connections 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.568+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/1361522581 wait complete. 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 -- start start 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 Processor -- start 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a5188960 0x5555a5198f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a5195370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 0x5555a51958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a5195fc0 con 0x5555a518e4f0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a5196130 con 0x5555a518dbe0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a51f5d50 con 0x5555a5188960 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6c7fa2b80 10 client.0 _ll_register_callbacks cb 0x5555a4f80230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6ba3b2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 0x5555a51958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6ba3b2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 0x5555a51958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54276/0 (socket says 172.21.15.35:54276) 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/484262417 learned_addr learned my addr 172.21.15.35:0/484262417 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a5195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.569+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a5188960 0x5555a5198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/484262417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a5188960 msgr2=0x5555a5198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a5188960 0x5555a5198f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 msgr2=0x5555a5195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a5195370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6ba3b2700 1 -- 172.21.15.35:0/484262417 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b410d880 con 0x5555a518e4f0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6b93b0700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a5195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6ba3b2700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 0x5555a51958b0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x5555a518e960 tx=0x7fb6ac005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9560fff35105fba8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:33.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb69d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb69d7fa700 1 -- 172.21.15.35:0/484262417 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac019040 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb69d7fa700 1 -- 172.21.15.35:0/484262417 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb6ac015710 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555a51581e0 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb69d7fa700 1 -- 172.21.15.35:0/484262417 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6ac0158d0 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6c7fa2b80 10 client.20355 fetch_fsmap learned FSMap version 102 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5555a4ef1c00 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.570+0000 7fb69d7fa700 1 -- 172.21.15.35:0/484262417 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5555a51581e0 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb69d7fa700 1 -- 172.21.15.35:0/484262417 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb6ac030b30 con 0x5555a518e4f0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6c7fa2b80 10 client.20355 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6c7fa2b80 10 client.20355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6c7fa2b80 20 client.20355 populate_metadata read hostname 'smithi035' 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51f7320 0x5555a51f9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6c7fa2b80 4 client.20355 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5555a4f5ef00 con 0x5555a51f7320 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51f7320 0x5555a51f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:33.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb69d7fa700 10 client.20355 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:33.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:44 smithi035 ceph-mon[92535]: pgmap v4598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:14:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.571+0000 7fb6b9bb1700 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51f7320 0x5555a51f9730 crc :-1 s=READY pgs=622 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4289e039c9ce19f server_cookie=b72d16150557ea27 in_seq=0 out_seq=0 2023-03-17T11:14:34.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb69d7fa700 1 -- 172.21.15.35:0/484262417 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5555a4f5ef00 con 0x5555a51f7320 2023-03-17T11:14:34.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb69d7fa700 10 client.20355 handle_command_reply: tid=0 2023-03-17T11:14:34.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 client.20355 shutdown 2023-03-17T11:14:34.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 msgr2=0x5555a51958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:34.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 0x5555a51958b0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x5555a518e960 tx=0x7fb6ac005b70 comp rx=0 tx=0).stop 2023-03-17T11:14:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 shutdown_connections 2023-03-17T11:14:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5555a51f7320 0x5555a51f9730 crc :-1 s=READY pgs=622 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:35.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5555a518e4f0 0x5555a51958b0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb69d7fa700 0 client.20355 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555a5188960 0x5555a5198f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 --2- 172.21.15.35:0/484262417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5555a518dbe0 0x5555a5195370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:35.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 >> 172.21.15.35:0/484262417 conn(0x5555a4fe56b0 msgr2=0x5555a518f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 shutdown_connections 2023-03-17T11:14:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 1 -- 172.21.15.35:0/484262417 wait complete. 2023-03-17T11:14:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.588+0000 7fb6c7fa2b80 20 client.20355 trim_cache size 0 max 16384 2023-03-17T11:14:36.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb6a009f6c0 msgr2=0x7fb6a00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:36.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb6a009f6c0 0x7fb6a00a1b70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b5c0 tx=0x7fb6b0005fb0 comp rx=0 tx=0).stop 2023-03-17T11:14:36.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 msgr2=0x7fb6b4196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:36.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 0x7fb6b4196700 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400d980 tx=0x7fb6a400dc90 comp rx=0 tx=0).stop 2023-03-17T11:14:36.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 shutdown_connections 2023-03-17T11:14:36.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb6a009f6c0 0x7fb6a00a1b70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:36.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6b410a730 0x7fb6b419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:36.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b41013f0 0x7fb6b41961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 --2- 172.21.15.35:0/1787163992 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb6b4101d00 0x7fb6b4196700 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 >> 172.21.15.35:0/1787163992 conn(0x7fb6b4076330 msgr2=0x7fb6b4102190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 shutdown_connections 2023-03-17T11:14:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:18.589+0000 7fb6bbe15700 1 -- 172.21.15.35:0/1787163992 wait complete. 2023-03-17T11:14:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 -- 172.21.15.35:0/4003133011 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101430 msgr2=0x7fc344101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:36.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 --2- 172.21.15.35:0/4003133011 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101430 0x7fc344101800 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fc340009990 tx=0x7fc340009ca0 comp rx=0 tx=0).stop 2023-03-17T11:14:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 -- 172.21.15.35:0/4003133011 shutdown_connections 2023-03-17T11:14:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 --2- 172.21.15.35:0/4003133011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34410a770 0x7fc34410cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 --2- 172.21.15.35:0/4003133011 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101430 0x7fc344101800 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 --2- 172.21.15.35:0/4003133011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc344101d40 0x7fc34410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 -- 172.21.15.35:0/4003133011 >> 172.21.15.35:0/4003133011 conn(0x7fc344076330 msgr2=0x7fc344076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 -- 172.21.15.35:0/4003133011 shutdown_connections 2023-03-17T11:14:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.712+0000 7fc34b54d700 1 -- 172.21.15.35:0/4003133011 wait complete. 2023-03-17T11:14:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 Processor -- start 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 -- start start 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc344101430 0x7fc3441962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 0x7fc344196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc34410a770 0x7fc34419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34419b2a0 con 0x7fc344101d40 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34419b410 con 0x7fc34410a770 2023-03-17T11:14:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc34b54d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34419b5d0 con 0x7fc344101430 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 0x7fc344196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 0x7fc344196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54286/0 (socket says 172.21.15.35:54286) 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 -- 172.21.15.35:0/498535458 learned_addr learned my addr 172.21.15.35:0/498535458 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc349aea700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc34410a770 0x7fc34419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc3492e9700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc344101430 0x7fc3441962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 -- 172.21.15.35:0/498535458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc344101430 msgr2=0x7fc3441962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc344101430 0x7fc3441962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 -- 172.21.15.35:0/498535458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc34410a770 msgr2=0x7fc34419ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc34410a770 0x7fc34419ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.713+0000 7fc348ae8700 1 -- 172.21.15.35:0/498535458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400095f0 con 0x7fc344101d40 2023-03-17T11:14:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.714+0000 7fc348ae8700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 0x7fc344196800 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d950 tx=0x7fc33400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.714+0000 7fc33a7fc700 1 -- 172.21.15.35:0/498535458 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334009940 con 0x7fc344101d40 2023-03-17T11:14:40.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.714+0000 7fc33a7fc700 1 -- 172.21.15.35:0/498535458 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc334010460 con 0x7fc344101d40 2023-03-17T11:14:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.714+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3441100b0 con 0x7fc344101d40 2023-03-17T11:14:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.714+0000 7fc33a7fc700 1 -- 172.21.15.35:0/498535458 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400f620 con 0x7fc344101d40 2023-03-17T11:14:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.714+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34410ff20 con 0x7fc344101d40 2023-03-17T11:14:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.716+0000 7fc33a7fc700 1 -- 172.21.15.35:0/498535458 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc3340105d0 con 0x7fc344101d40 2023-03-17T11:14:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.716+0000 7fc33a7fc700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc33009f6c0 0x7fc3300a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:41.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.717+0000 7fc3492e9700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc33009f6c0 0x7fc3300a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.717+0000 7fc33a7fc700 1 -- 172.21.15.35:0/498535458 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc3340ca420 con 0x7fc344101d40 2023-03-17T11:14:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.717+0000 7fc3492e9700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc33009f6c0 0x7fc3300a1b70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc34000b5c0 tx=0x7fc340005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:41.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 Processor -- start 2023-03-17T11:14:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 -- start start 2023-03-17T11:14:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 0x562aee94dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee948420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee948960 0x562aee948d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee84f010 con 0x562aee94dbe0 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee8a1950 con 0x562aee948960 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3576dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee89ade0 con 0x562aee94e4f0 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 0x562aee94dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 0x562aee94dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54292/0 (socket says 172.21.15.35:54292) 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 -- 172.21.15.35:0/1830788240 learned_addr learned my addr 172.21.15.35:0/1830788240 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc348ae8700 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee948420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc349aea700 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee948960 0x562aee948d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 -- 172.21.15.35:0/1830788240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 msgr2=0x562aee948420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee948420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 -- 172.21.15.35:0/1830788240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee948960 msgr2=0x562aee948d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee948960 0x562aee948d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc3492e9700 1 -- 172.21.15.35:0/1830788240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aee71c5d0 con 0x562aee94dbe0 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.718+0000 7fc349aea700 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee948960 0x562aee948d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.719+0000 7fc3492e9700 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 0x562aee94dfb0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fc340015000 tx=0x7fc34001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5186f3579fbe0a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.719+0000 7fc32f7fe700 1 -- 172.21.15.35:0/1830788240 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002b070 con 0x562aee94dbe0 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.719+0000 7fc32f7fe700 1 -- 172.21.15.35:0/1830788240 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc34001e040 con 0x562aee94dbe0 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.719+0000 7fc32f7fe700 1 -- 172.21.15.35:0/1830788240 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340004a60 con 0x562aee94dbe0 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 -- 172.21.15.35:0/1830788240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 msgr2=0x562aee94dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 0x562aee94dfb0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fc340015000 tx=0x7fc34001f000 comp rx=0 tx=0).stop 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 -- 172.21.15.35:0/1830788240 shutdown_connections 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee948960 0x562aee948d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee94dbe0 0x562aee94dfb0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 --2- 172.21.15.35:0/1830788240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee948420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 -- 172.21.15.35:0/1830788240 >> 172.21.15.35:0/1830788240 conn(0x562aee7a56b0 msgr2=0x562aee942a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 -- 172.21.15.35:0/1830788240 shutdown_connections 2023-03-17T11:14:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 -- 172.21.15.35:0/1830788240 wait complete. 2023-03-17T11:14:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 -- start start 2023-03-17T11:14:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.720+0000 7fc3576dab80 1 Processor -- start 2023-03-17T11:14:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee9544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee951e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:43.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee71e8c0 con 0x562aee948960 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee952560 con 0x562aee94dbe0 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee95df40 con 0x562aee94e4f0 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 10 client.0 _ll_register_callbacks cb 0x562aee740230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee9544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee9544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54298/0 (socket says 172.21.15.35:54298) 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 -- 172.21.15.35:0/4123123256 learned_addr learned my addr 172.21.15.35:0/4123123256 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc349aea700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee951e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc348ae8700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 -- 172.21.15.35:0/4123123256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 msgr2=0x562aee951e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:45.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee951e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:45.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 -- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 msgr2=0x562aee9516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 -- 172.21.15.35:0/4123123256 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34410d890 con 0x562aee948960 2023-03-17T11:14:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc348ae8700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:14:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3492e9700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee9544d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fc3400098e0 tx=0x7fc340005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36559d0e841e8cb9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc32cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:14:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc32cff9700 1 -- 172.21.15.35:0/4123123256 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002b070 con 0x562aee948960 2023-03-17T11:14:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc32cff9700 1 -- 172.21.15.35:0/4123123256 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc3400049f0 con 0x562aee948960 2023-03-17T11:14:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.721+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aee85d390 con 0x562aee948960 2023-03-17T11:14:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc32cff9700 1 -- 172.21.15.35:0/4123123256 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc340004bb0 con 0x562aee948960 2023-03-17T11:14:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 10 client.20367 fetch_fsmap learned FSMap version 102 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x562aee6c8d80 con 0x562aee948960 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc32cff9700 1 -- 172.21.15.35:0/4123123256 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562aee85d390 con 0x562aee948960 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc32cff9700 1 -- 172.21.15.35:0/4123123256 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc34000f460 con 0x562aee948960 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 10 client.20367 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 10 client.20367 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 20 client.20367 populate_metadata read hostname 'smithi035' 2023-03-17T11:14:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee961c30 0x562aee964010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 4 client.20367 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:14:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562aee869600 con 0x562aee961c30 2023-03-17T11:14:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.722+0000 7fc348ae8700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee961c30 0x562aee964010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.723+0000 7fc32cff9700 10 client.20367 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.723+0000 7fc348ae8700 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee961c30 0x562aee964010 crc :-1 s=READY pgs=623 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9bcbe00861ad5 server_cookie=6583194f6dddc3b in_seq=0 out_seq=0 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.723+0000 7fc32cff9700 1 -- 172.21.15.35:0/4123123256 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562aee869600 con 0x562aee961c30 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.723+0000 7fc32cff9700 10 client.20367 handle_command_reply: tid=0 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 client.20367 shutdown 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 msgr2=0x562aee9544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee9544d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fc3400098e0 tx=0x7fc340005900 comp rx=0 tx=0).stop 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 shutdown_connections 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee961c30 0x562aee964010 crc :-1 s=READY pgs=623 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee951e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc32cff9700 0 client.20367 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee9544d0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 --2- 172.21.15.35:0/4123123256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 >> 172.21.15.35:0/4123123256 conn(0x562aee7a56b0 msgr2=0x562aee947410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:14:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 shutdown_connections 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 1 -- 172.21.15.35:0/4123123256 wait complete. 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.724+0000 7fc3576dab80 20 client.20367 trim_cache size 0 max 16384 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 Processor -- start 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 -- start start 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee958e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee954000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee94b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:14:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee93e0f0 con 0x562aee948960 2023-03-17T11:14:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee9526a0 con 0x562aee94dbe0 2023-03-17T11:14:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3576dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee943580 con 0x562aee94e4f0 2023-03-17T11:14:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee958e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee958e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54306/0 (socket says 172.21.15.35:54306) 2023-03-17T11:14:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc3492e9700 1 -- 172.21.15.35:0/2169983293 learned_addr learned my addr 172.21.15.35:0/2169983293 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:14:53.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:46 smithi035 ceph-mon[92535]: pgmap v4599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:14:53.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:48 smithi035 ceph-mon[92535]: pgmap v4600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:14:53.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:50 smithi035 ceph-mon[92535]: pgmap v4601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:14:54.172 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:52 smithi035 ceph-mon[92535]: pgmap v4602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:14:54.172 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:54 smithi035 ceph-mon[92535]: pgmap v4603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:14:54.172 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:56 smithi035 ceph-mon[92535]: pgmap v4604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:14:54.172 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:58 smithi035 ceph-mon[92535]: pgmap v4605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:14:54.172 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:14:54.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:14:55.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:14:55.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:14:55.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:05:59 smithi035 ceph-mon[92535]: pgmap v4606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:14:55.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:01 smithi035 ceph-mon[92535]: pgmap v4607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:14:55.937 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:03 smithi035 ceph-mon[92535]: pgmap v4608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 27 op/s 2023-03-17T11:14:56.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:05 smithi035 ceph-mon[92535]: pgmap v4609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T11:14:56.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:07 smithi035 ceph-mon[92535]: pgmap v4610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T11:14:56.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:09 smithi035 ceph-mon[92535]: pgmap v4611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T11:14:56.959 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:10 smithi035 ceph-mon[92535]: osdmap e358: 12 total, 12 up, 12 in 2023-03-17T11:14:56.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:11 smithi035 ceph-mon[92535]: pgmap v4613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:14:56.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:13 smithi035 ceph-mon[92535]: pgmap v4614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-03-17T11:14:56.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:15 smithi035 ceph-mon[92535]: pgmap v4615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:14:56.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:17 smithi035 ceph-mon[92535]: pgmap v4616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:14:56.960 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:17 smithi035 ceph-mon[92535]: osdmap e359: 12 total, 12 up, 12 in 2023-03-17T11:14:58.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:19 smithi035 ceph-mon[92535]: pgmap v4618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T11:14:58.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:21 smithi035 ceph-mon[92535]: pgmap v4619: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:14:58.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:23 smithi035 ceph-mon[92535]: pgmap v4620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:14:58.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:25 smithi035 ceph-mon[92535]: pgmap v4621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:14:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:14:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:14:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:14:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:14:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.739+0000 7fc348ae8700 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee954000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:14:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3492e9700 1 -- 172.21.15.35:0/2169983293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 msgr2=0x562aee94b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3492e9700 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee94b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3492e9700 1 -- 172.21.15.35:0/2169983293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 msgr2=0x562aee954000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:14:59.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3492e9700 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee954000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:14:59.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3492e9700 1 -- 172.21.15.35:0/2169983293 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aee861130 con 0x562aee948960 2023-03-17T11:14:59.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3492e9700 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee958e90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fc34000f790 tx=0x7fc34000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e48a56f0dbd177 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:14:59.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc32ffff700 1 -- 172.21.15.35:0/2169983293 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002b020 con 0x562aee948960 2023-03-17T11:14:59.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc32ffff700 1 -- 172.21.15.35:0/2169983293 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc34001e040 con 0x562aee948960 2023-03-17T11:15:00.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc32ffff700 1 -- 172.21.15.35:0/2169983293 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340003cd0 con 0x562aee948960 2023-03-17T11:15:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 -- 172.21.15.35:0/2169983293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 msgr2=0x562aee958e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee958e90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fc34000f790 tx=0x7fc34000bf00 comp rx=0 tx=0).stop 2023-03-17T11:15:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 -- 172.21.15.35:0/2169983293 shutdown_connections 2023-03-17T11:15:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee94b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee958e90 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 --2- 172.21.15.35:0/2169983293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee954000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 -- 172.21.15.35:0/2169983293 >> 172.21.15.35:0/2169983293 conn(0x562aee7a56b0 msgr2=0x562aee947a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 -- 172.21.15.35:0/2169983293 shutdown_connections 2023-03-17T11:15:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.740+0000 7fc3576dab80 1 -- 172.21.15.35:0/2169983293 wait complete. 2023-03-17T11:15:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 -- start start 2023-03-17T11:15:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 Processor -- start 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee956e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee9b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee957cc0 con 0x562aee948960 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee9b4fb0 con 0x562aee94dbe0 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aee9b50f0 con 0x562aee94e4f0 2023-03-17T11:15:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3576dab80 10 client.0 _ll_register_callbacks cb 0x562aee740230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:15:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee956e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3492e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee956e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54312/0 (socket says 172.21.15.35:54312) 2023-03-17T11:15:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.741+0000 7fc3492e9700 1 -- 172.21.15.35:0/3718308365 learned_addr learned my addr 172.21.15.35:0/3718308365 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc348ae8700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc349aea700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee9b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3492e9700 1 -- 172.21.15.35:0/3718308365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 msgr2=0x562aee9b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3492e9700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee9b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3492e9700 1 -- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 msgr2=0x562aee9573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3492e9700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3492e9700 1 -- 172.21.15.35:0/3718308365 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aee6c8d80 con 0x562aee948960 2023-03-17T11:15:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc348ae8700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:15:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc349aea700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee9b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:15:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3492e9700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee956e70 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fc34000f8c0 tx=0x7fc340009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f7a9a99d6b208f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc32cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:15:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc32cff9700 1 -- 172.21.15.35:0/3718308365 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002b030 con 0x562aee948960 2023-03-17T11:15:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc32cff9700 1 -- 172.21.15.35:0/3718308365 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc340003a20 con 0x562aee948960 2023-03-17T11:15:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aee9181e0 con 0x562aee948960 2023-03-17T11:15:09.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc32cff9700 1 -- 172.21.15.35:0/3718308365 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc340003be0 con 0x562aee948960 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3576dab80 10 client.20373 fetch_fsmap learned FSMap version 102 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x562aee6ef1f0 con 0x562aee948960 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.742+0000 7fc32cff9700 1 -- 172.21.15.35:0/3718308365 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562aee9181e0 con 0x562aee948960 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc32cff9700 1 -- 172.21.15.35:0/3718308365 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc340040b80 con 0x562aee948960 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc3576dab80 10 client.20373 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc3576dab80 10 client.20373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:15:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc3576dab80 20 client.20373 populate_metadata read hostname 'smithi035' 2023-03-17T11:15:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc3576dab80 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee9b6320 0x562aee9b8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc3576dab80 4 client.20373 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:15:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562aee71ef00 con 0x562aee9b6320 2023-03-17T11:15:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc348ae8700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee9b6320 0x562aee9b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc32cff9700 10 client.20373 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.743+0000 7fc348ae8700 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee9b6320 0x562aee9b8700 crc :-1 s=READY pgs=624 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28887b5d8ecd577 server_cookie=28bc399097de425a in_seq=0 out_seq=0 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc32cff9700 1 -- 172.21.15.35:0/3718308365 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562aee71ef00 con 0x562aee9b6320 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc32cff9700 10 client.20373 handle_command_reply: tid=0 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 client.20373 shutdown 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 msgr2=0x562aee956e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee956e70 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fc34000f8c0 tx=0x7fc340009ca0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 shutdown_connections 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562aee9b6320 0x562aee9b8700 crc :-1 s=READY pgs=624 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562aee94e4f0 0x562aee9b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562aee948960 0x562aee956e70 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 --2- 172.21.15.35:0/3718308365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562aee94dbe0 0x562aee9573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc32cff9700 0 client.20373 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 >> 172.21.15.35:0/3718308365 conn(0x562aee7a56b0 msgr2=0x562aee94b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 shutdown_connections 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 1 -- 172.21.15.35:0/3718308365 wait complete. 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.756+0000 7fc3576dab80 20 client.20373 trim_cache size 0 max 16384 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc33009f6c0 msgr2=0x7fc3300a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc33009f6c0 0x7fc3300a1b70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc34000b5c0 tx=0x7fc340005fb0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 msgr2=0x7fc344196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 0x7fc344196800 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc33400d950 tx=0x7fc33400dc60 comp rx=0 tx=0).stop 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 shutdown_connections 2023-03-17T11:15:14.115 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc33009f6c0 0x7fc3300a1b70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc34410a770 0x7fc34419ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc344101430 0x7fc3441962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 --2- 172.21.15.35:0/498535458 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc344101d40 0x7fc344196800 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 >> 172.21.15.35:0/498535458 conn(0x7fc344076330 msgr2=0x7fc3441021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 shutdown_connections 2023-03-17T11:15:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:31.757+0000 7fc34b54d700 1 -- 172.21.15.35:0/498535458 wait complete. 2023-03-17T11:15:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1166053956 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100450 msgr2=0x7ff398100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1166053956 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100450 0x7ff398100820 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff3880099c0 tx=0x7ff388009cd0 comp rx=0 tx=0).stop 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1166053956 shutdown_connections 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1166053956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398105490 0x7ff39810d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1166053956 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100450 0x7ff398100820 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1166053956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100df0 0x7ff398104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1166053956 >> 172.21.15.35:0/1166053956 conn(0x7ff3980fbca0 msgr2=0x7ff3980fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1166053956 shutdown_connections 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.879+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1166053956 wait complete. 2023-03-17T11:15:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 Processor -- start 2023-03-17T11:15:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 -- start start 2023-03-17T11:15:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100450 0x7ff398196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 0x7ff3981967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398105490 0x7ff39819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39819b250 con 0x7ff398100df0 2023-03-17T11:15:17.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39819b3c0 con 0x7ff398105490 2023-03-17T11:15:17.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff39e9ba700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39819b580 con 0x7ff398100450 2023-03-17T11:15:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff3977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 0x7ff3981967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff3977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 0x7ff3981967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54332/0 (socket says 172.21.15.35:54332) 2023-03-17T11:15:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.880+0000 7ff3977fe700 1 -- 172.21.15.35:0/1736271789 learned_addr learned my addr 172.21.15.35:0/1736271789 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff39cf57700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398105490 0x7ff39819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff397fff700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100450 0x7ff398196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3977fe700 1 -- 172.21.15.35:0/1736271789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100450 msgr2=0x7ff398196270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3977fe700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100450 0x7ff398196270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3977fe700 1 -- 172.21.15.35:0/1736271789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398105490 msgr2=0x7ff39819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3977fe700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398105490 0x7ff39819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3977fe700 1 -- 172.21.15.35:0/1736271789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880095f0 con 0x7ff398100df0 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff397fff700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100450 0x7ff398196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3977fe700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 0x7ff3981967b0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff38000e940 tx=0x7ff38000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3957fa700 1 -- 172.21.15.35:0/1736271789 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380009730 con 0x7ff398100df0 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3957fa700 1 -- 172.21.15.35:0/1736271789 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff38000ee90 con 0x7ff398100df0 2023-03-17T11:15:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398110150 con 0x7ff398100df0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff3957fa700 1 -- 172.21.15.35:0/1736271789 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380018420 con 0x7ff398100df0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.881+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39810ffc0 con 0x7ff398100df0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.884+0000 7ff3957fa700 1 -- 172.21.15.35:0/1736271789 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff38000cbd0 con 0x7ff398100df0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.885+0000 7ff3957fa700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff38409f640 0x7ff3840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.885+0000 7ff3957fa700 1 -- 172.21.15.35:0/1736271789 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff380014070 con 0x7ff398100df0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.885+0000 7ff397fff700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff38409f640 0x7ff3840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.885+0000 7ff397fff700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff38409f640 0x7ff3840a1af0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff388000c00 tx=0x7ff38801a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.885+0000 7ff3aab47b80 1 Processor -- start 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.885+0000 7ff3aab47b80 1 -- start start 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a0be0 0x55bffd4a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd49b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd3a2010 con 0x55bffd49b960 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd3f4950 con 0x55bffd4a0be0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd3edde0 con 0x55bffd4a14f0 2023-03-17T11:15:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54342/0 (socket says 172.21.15.35:54342) 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 -- 172.21.15.35:0/377741631 learned_addr learned my addr 172.21.15.35:0/377741631 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff3977fe700 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd49b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff397fff700 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a0be0 0x55bffd4a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 -- 172.21.15.35:0/377741631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 msgr2=0x55bffd49b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd49b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 -- 172.21.15.35:0/377741631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a0be0 msgr2=0x55bffd4a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a0be0 0x55bffd4a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 -- 172.21.15.35:0/377741631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bffd26f5d0 con 0x55bffd49b960 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff39cf57700 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49bd90 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ff390011680 tx=0x7ff390009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249c03eaeb1aca22 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.886+0000 7ff38e7fc700 1 -- 172.21.15.35:0/377741631 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39000e040 con 0x55bffd49b960 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff38e7fc700 1 -- 172.21.15.35:0/377741631 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff39000f040 con 0x55bffd49b960 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff38e7fc700 1 -- 172.21.15.35:0/377741631 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390004730 con 0x55bffd49b960 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 -- 172.21.15.35:0/377741631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 msgr2=0x55bffd49bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49bd90 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ff390011680 tx=0x7ff390009920 comp rx=0 tx=0).stop 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 -- 172.21.15.35:0/377741631 shutdown_connections 2023-03-17T11:15:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49bd90 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a0be0 0x55bffd4a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/377741631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd49b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 -- 172.21.15.35:0/377741631 >> 172.21.15.35:0/377741631 conn(0x55bffd2f86b0 msgr2=0x55bffd495a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 -- 172.21.15.35:0/377741631 shutdown_connections 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.887+0000 7ff3aab47b80 1 -- 172.21.15.35:0/377741631 wait complete. 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 -- start start 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 Processor -- start 2023-03-17T11:15:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd49b960 0x55bffd4a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 0x55bffd4a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd4a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:23.607 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:27 smithi035 ceph-mon[92535]: pgmap v4622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:15:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd2718c0 con 0x55bffd4a0be0 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4a5350 con 0x55bffd49b960 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4a5510 con 0x55bffd4a14f0 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3aab47b80 10 client.0 _ll_register_callbacks cb 0x55bffd293230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 0x55bffd4a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3977fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 0x55bffd4a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54346/0 (socket says 172.21.15.35:54346) 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff3977fe700 1 -- 172.21.15.35:0/3306267620 learned_addr learned my addr 172.21.15.35:0/3306267620 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff397fff700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd49b960 0x55bffd4a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:25.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.888+0000 7ff39cf57700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd4a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3977fe700 1 -- 172.21.15.35:0/3306267620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 msgr2=0x55bffd4a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3977fe700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd4a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3977fe700 1 -- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd49b960 msgr2=0x55bffd4a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3977fe700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd49b960 0x55bffd4a73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3977fe700 1 -- 172.21.15.35:0/3306267620 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff390011330 con 0x55bffd4a0be0 2023-03-17T11:15:26.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3977fe700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 0x55bffd4a4640 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ff380094e70 tx=0x7ff380097e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9684bf4df0469c7c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:27.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3777fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3777fe700 1 -- 172.21.15.35:0/3306267620 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380097af0 con 0x55bffd4a0be0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3777fe700 1 -- 172.21.15.35:0/3306267620 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff3800a05f0 con 0x55bffd4a0be0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bffd3b0390 con 0x55bffd4a0be0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3777fe700 1 -- 172.21.15.35:0/3306267620 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3800a0160 con 0x55bffd4a0be0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3aab47b80 10 client.20385 fetch_fsmap learned FSMap version 102 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55bffd21bd80 con 0x55bffd4a0be0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.889+0000 7ff3777fe700 1 -- 172.21.15.35:0/3306267620 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bffd3b0390 con 0x55bffd4a0be0 2023-03-17T11:15:27.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3777fe700 1 -- 172.21.15.35:0/3306267620 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff380094380 con 0x55bffd4a0be0 2023-03-17T11:15:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3aab47b80 10 client.20385 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:15:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3aab47b80 10 client.20385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:15:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3aab47b80 20 client.20385 populate_metadata read hostname 'smithi035' 2023-03-17T11:15:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd4b5060 0x55bffd4b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3aab47b80 4 client.20385 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:15:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bffd3bc600 con 0x55bffd4b5060 2023-03-17T11:15:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff397fff700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd4b5060 0x55bffd4b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff3777fe700 10 client.20385 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:15:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.890+0000 7ff397fff700 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd4b5060 0x55bffd4b7470 crc :-1 s=READY pgs=625 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e86949b90f2cbb02 server_cookie=d1815f3fc326afe4 in_seq=0 out_seq=0 2023-03-17T11:15:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3777fe700 1 -- 172.21.15.35:0/3306267620 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55bffd3bc600 con 0x55bffd4b5060 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3777fe700 10 client.20385 handle_command_reply: tid=0 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 client.20385 shutdown 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 msgr2=0x55bffd4a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 0x55bffd4a4640 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ff380094e70 tx=0x7ff380097e60 comp rx=0 tx=0).stop 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 shutdown_connections 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd4b5060 0x55bffd4b7470 crc :-1 s=READY pgs=625 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a14f0 0x55bffd4a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3777fe700 0 client.20385 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:15:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd49b960 0x55bffd4a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/3306267620 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd4a0be0 0x55bffd4a4640 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 >> 172.21.15.35:0/3306267620 conn(0x55bffd2f86b0 msgr2=0x55bffd495a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 shutdown_connections 2023-03-17T11:15:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 1 -- 172.21.15.35:0/3306267620 wait complete. 2023-03-17T11:15:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.891+0000 7ff3aab47b80 20 client.20385 trim_cache size 0 max 16384 2023-03-17T11:15:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.906+0000 7ff3aab47b80 1 Processor -- start 2023-03-17T11:15:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 -- start start 2023-03-17T11:15:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd495ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd49d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd496000 con 0x55bffd49b960 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4910d0 con 0x55bffd4a14f0 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4925c0 con 0x55bffd4a0be0 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54354/0 (socket says 172.21.15.35:54354) 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 -- 172.21.15.35:0/4260325020 learned_addr learned my addr 172.21.15.35:0/4260325020 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff39cf57700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd49d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3977fe700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd495ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 -- 172.21.15.35:0/4260325020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 msgr2=0x55bffd495ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd495ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 -- 172.21.15.35:0/4260325020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 msgr2=0x55bffd49d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd49d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 -- 172.21.15.35:0/4260325020 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bffd3b4130 con 0x55bffd49b960 2023-03-17T11:15:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff39cf57700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd49d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:15:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff3977fe700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd495ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:15:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff397fff700 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49b420 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ff388009fd0 tx=0x7ff388021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03df98b88a03cfa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.907+0000 7ff38effd700 1 -- 172.21.15.35:0/4260325020 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38801d040 con 0x55bffd49b960 2023-03-17T11:15:35.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff38effd700 1 -- 172.21.15.35:0/4260325020 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff38802b040 con 0x55bffd49b960 2023-03-17T11:15:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff38effd700 1 -- 172.21.15.35:0/4260325020 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388003b20 con 0x55bffd49b960 2023-03-17T11:15:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 -- 172.21.15.35:0/4260325020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 msgr2=0x55bffd49b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49b420 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ff388009fd0 tx=0x7ff388021000 comp rx=0 tx=0).stop 2023-03-17T11:15:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 -- 172.21.15.35:0/4260325020 shutdown_connections 2023-03-17T11:15:35.263 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd49d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd49b420 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/4260325020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd495ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 -- 172.21.15.35:0/4260325020 >> 172.21.15.35:0/4260325020 conn(0x55bffd2f86b0 msgr2=0x55bffd49e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 -- 172.21.15.35:0/4260325020 shutdown_connections 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 -- 172.21.15.35:0/4260325020 wait complete. 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.908+0000 7ff3aab47b80 1 -- start start 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 Processor -- start 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd4abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd4ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd4aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4aa830 con 0x55bffd49b960 2023-03-17T11:15:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4aa9a0 con 0x55bffd4a14f0 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffd4aab60 con 0x55bffd4a0be0 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3aab47b80 10 client.0 _ll_register_callbacks cb 0x55bffd293230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd4abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd4abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54358/0 (socket says 172.21.15.35:54358) 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 -- 172.21.15.35:0/2846269496 learned_addr learned my addr 172.21.15.35:0/2846269496 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff39cf57700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd4aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff3977fe700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd4ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 -- 172.21.15.35:0/2846269496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 msgr2=0x55bffd4ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd4ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 -- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 msgr2=0x55bffd4aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd4aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff397fff700 1 -- 172.21.15.35:0/2846269496 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39810d8a0 con 0x55bffd49b960 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.909+0000 7ff39cf57700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd4aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:15:36.283 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff397fff700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd4abc70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7ff3880053a0 tx=0x7ff388034e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd700408d475393b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3777fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:15:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3777fe700 1 -- 172.21.15.35:0/2846269496 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38801d070 con 0x55bffd49b960 2023-03-17T11:15:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3777fe700 1 -- 172.21.15.35:0/2846269496 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(331..331 src has 1..331) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff388034520 con 0x55bffd49b960 2023-03-17T11:15:37.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bffd46b1e0 con 0x55bffd49b960 2023-03-17T11:15:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3777fe700 1 -- 172.21.15.35:0/2846269496 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff388003760 con 0x55bffd49b960 2023-03-17T11:15:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 10 client.20391 fetch_fsmap learned FSMap version 102 2023-03-17T11:15:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55bffd2421f0 con 0x55bffd49b960 2023-03-17T11:15:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3777fe700 1 -- 172.21.15.35:0/2846269496 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bffd46b1e0 con 0x55bffd49b960 2023-03-17T11:15:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3777fe700 1 -- 172.21.15.35:0/2846269496 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff38803e9d0 con 0x55bffd49b960 2023-03-17T11:15:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 10 client.20391 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:15:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 10 client.20391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:15:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 20 client.20391 populate_metadata read hostname 'smithi035' 2023-03-17T11:15:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd509d70 0x55bffd50c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:41.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 4 client.20391 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:15:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.910+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bffd271f00 con 0x55bffd509d70 2023-03-17T11:15:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.911+0000 7ff3977fe700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd509d70 0x55bffd50c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.911+0000 7ff3977fe700 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd509d70 0x55bffd50c180 crc :-1 s=READY pgs=626 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c0efa9a269399b9 server_cookie=9b4cc6cc2dee8775 in_seq=0 out_seq=0 2023-03-17T11:15:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.911+0000 7ff3777fe700 10 client.20391 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.924+0000 7ff3777fe700 1 -- 172.21.15.35:0/2846269496 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bffd271f00 con 0x55bffd509d70 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.924+0000 7ff3777fe700 10 client.20391 handle_command_reply: tid=0 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 client.20391 shutdown 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 msgr2=0x55bffd4abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd4abc70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7ff3880053a0 tx=0x7ff388034e70 comp rx=0 tx=0).stop 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 shutdown_connections 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55bffd509d70 0x55bffd50c180 crc :-1 s=READY pgs=626 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bffd4a14f0 0x55bffd4aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bffd49b960 0x55bffd4abc70 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 --2- 172.21.15.35:0/2846269496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bffd4a0be0 0x55bffd4ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3777fe700 0 client.20391 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:15:43.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 >> 172.21.15.35:0/2846269496 conn(0x55bffd2f86b0 msgr2=0x55bffd4a1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 shutdown_connections 2023-03-17T11:15:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 1 -- 172.21.15.35:0/2846269496 wait complete. 2023-03-17T11:15:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.925+0000 7ff3aab47b80 20 client.20391 trim_cache size 0 max 16384 2023-03-17T11:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff38409f640 msgr2=0x7ff3840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff38409f640 0x7ff3840a1af0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff388000c00 tx=0x7ff38801a040 comp rx=0 tx=0).stop 2023-03-17T11:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 msgr2=0x7ff3981967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 0x7ff3981967b0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff38000e940 tx=0x7ff38000ec50 comp rx=0 tx=0).stop 2023-03-17T11:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 shutdown_connections 2023-03-17T11:15:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff38409f640 0x7ff3840a1af0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398105490 0x7ff39819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff398100450 0x7ff398196270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 --2- 172.21.15.35:0/1736271789 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff398100df0 0x7ff3981967b0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 >> 172.21.15.35:0/1736271789 conn(0x7ff3980fbca0 msgr2=0x7ff3980fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 shutdown_connections 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:51:44.926+0000 7ff39e9ba700 1 -- 172.21.15.35:0/1736271789 wait complete. 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 -- 172.21.15.35:0/1815171954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600ff310 msgr2=0x7f1460104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 --2- 172.21.15.35:0/1815171954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600ff310 0x7f1460104de0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f14500099c0 tx=0x7f1450009cd0 comp rx=0 tx=0).stop 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 -- 172.21.15.35:0/1815171954 shutdown_connections 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 --2- 172.21.15.35:0/1815171954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1460105510 0x7f146010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 --2- 172.21.15.35:0/1815171954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14600fe970 0x7f14600fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 --2- 172.21.15.35:0/1815171954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600ff310 0x7f1460104de0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 -- 172.21.15.35:0/1815171954 >> 172.21.15.35:0/1815171954 conn(0x7f14600757a0 msgr2=0x7f1460075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 -- 172.21.15.35:0/1815171954 shutdown_connections 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.842+0000 7f1468700700 1 -- 172.21.15.35:0/1815171954 wait complete. 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 Processor -- start 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 -- start start 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 0x7f1460196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14600ff310 0x7f14601967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1460105510 0x7f146019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146019b240 con 0x7f14600fe970 2023-03-17T11:15:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146019b3b0 con 0x7f14600ff310 2023-03-17T11:15:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1468700700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146019b570 con 0x7f1460105510 2023-03-17T11:15:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f146649c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 0x7f1460196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:47.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:29 smithi035 ceph-mon[92535]: pgmap v4623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 850 B/s wr, 10 op/s 2023-03-17T11:15:49.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f146649c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 0x7f1460196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54372/0 (socket says 172.21.15.35:54372) 2023-03-17T11:15:49.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f146649c700 1 -- 172.21.15.35:0/3929679238 learned_addr learned my addr 172.21.15.35:0/3929679238 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.843+0000 7f1465c9b700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14600ff310 0x7f14601967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f146649c700 1 -- 172.21.15.35:0/3929679238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1460105510 msgr2=0x7f146019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f1466c9d700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1460105510 0x7f146019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f146649c700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1460105510 0x7f146019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f146649c700 1 -- 172.21.15.35:0/3929679238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14600ff310 msgr2=0x7f14601967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:15:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f146649c700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14600ff310 0x7f14601967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:15:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f146649c700 1 -- 172.21.15.35:0/3929679238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500095f0 con 0x7f14600fe970 2023-03-17T11:15:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f1465c9b700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14600ff310 0x7f14601967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:15:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f146649c700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 0x7f1460196260 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c920 tx=0x7f145c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f14577fe700 1 -- 172.21.15.35:0/3929679238 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c007b00 con 0x7f14600fe970 2023-03-17T11:15:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14601100f0 con 0x7f14600fe970 2023-03-17T11:15:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f14577fe700 1 -- 172.21.15.35:0/3929679238 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f145c004cc0 con 0x7f14600fe970 2023-03-17T11:15:54.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f14577fe700 1 -- 172.21.15.35:0/3929679238 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c005490 con 0x7f14600fe970 2023-03-17T11:15:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.844+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146010ff60 con 0x7f14600fe970 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.846+0000 7f14577fe700 1 -- 172.21.15.35:0/3929679238 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f145c004750 con 0x7f14600fe970 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.847+0000 7f14577fe700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f144c09f640 0x7f144c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.847+0000 7f1465c9b700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f144c09f640 0x7f144c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.847+0000 7f14577fe700 1 -- 172.21.15.35:0/3929679238 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f145c0ca2d0 con 0x7f14600fe970 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f1465c9b700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f144c09f640 0x7f144c0a1af0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f14500098e0 tx=0x7f145000bfb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 Processor -- start 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 -- start start 2023-03-17T11:15:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14cbe0 0x55c53b14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b147420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:15:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b04e010 con 0x55c53b147960 2023-03-17T11:15:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b0a0950 con 0x55c53b14cbe0 2023-03-17T11:15:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f147488db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b099de0 con 0x55c53b14d4f0 2023-03-17T11:15:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f1466c9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f1466c9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54384/0 (socket says 172.21.15.35:54384) 2023-03-17T11:15:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f1466c9d700 1 -- 172.21.15.35:0/392230020 learned_addr learned my addr 172.21.15.35:0/392230020 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:15:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.848+0000 7f146649c700 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14cbe0 0x55c53b14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1465c9b700 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:15:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1466c9d700 1 -- 172.21.15.35:0/392230020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 msgr2=0x55c53b147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1466c9d700 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1466c9d700 1 -- 172.21.15.35:0/392230020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14cbe0 msgr2=0x55c53b14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1466c9d700 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14cbe0 0x55c53b14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1466c9d700 1 -- 172.21.15.35:0/392230020 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c53af1b5d0 con 0x55c53b147960 2023-03-17T11:16:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1465c9b700 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:16:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1466c9d700 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147d90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f1458009fd0 tx=0x7f1458009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ee8e0ac7a81f30 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:00.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1454ff9700 1 -- 172.21.15.35:0/392230020 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458009e70 con 0x55c53b147960 2023-03-17T11:16:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1454ff9700 1 -- 172.21.15.35:0/392230020 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1458011040 con 0x55c53b147960 2023-03-17T11:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.849+0000 7f1454ff9700 1 -- 172.21.15.35:0/392230020 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580153f0 con 0x55c53b147960 2023-03-17T11:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 -- 172.21.15.35:0/392230020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 msgr2=0x55c53b147d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147d90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f1458009fd0 tx=0x7f1458009920 comp rx=0 tx=0).stop 2023-03-17T11:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 -- 172.21.15.35:0/392230020 shutdown_connections 2023-03-17T11:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147d90 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14cbe0 0x55c53b14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 --2- 172.21.15.35:0/392230020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 -- 172.21.15.35:0/392230020 >> 172.21.15.35:0/392230020 conn(0x55c53afa46b0 msgr2=0x55c53b141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 -- 172.21.15.35:0/392230020 shutdown_connections 2023-03-17T11:16:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 -- 172.21.15.35:0/392230020 wait complete. 2023-03-17T11:16:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 -- start start 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.850+0000 7f147488db80 1 Processor -- start 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 0x55c53b150c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53af1d8c0 con 0x55c53b14d4f0 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b151390 con 0x55c53b147960 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b15d090 con 0x55c53b14cbe0 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f147488db80 10 client.0 _ll_register_callbacks cb 0x55c53af3f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 0x55c53b150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 0x55c53b150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54390/0 (socket says 172.21.15.35:54390) 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f146649c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 -- 172.21.15.35:0/2704854006 learned_addr learned my addr 172.21.15.35:0/2704854006 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1465c9b700 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 -- 172.21.15.35:0/2704854006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 msgr2=0x55c53b150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 -- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 msgr2=0x55c53b1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:04.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 -- 172.21.15.35:0/2704854006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1458009050 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1466c9d700 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 0x55c53b150c20 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f1458018040 tx=0x7f1458004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633869888c5108fa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1449ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.851+0000 7f1449ffb700 1 -- 172.21.15.35:0/2704854006 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458003a00 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f1449ffb700 1 -- 172.21.15.35:0/2704854006 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1458003b60 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c53b05c390 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f1449ffb700 1 -- 172.21.15.35:0/2704854006 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1458003d20 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 10 client.20403 fetch_fsmap learned FSMap version 102 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55c53aec7d80 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f1449ffb700 1 -- 172.21.15.35:0/2704854006 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c53b05c390 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f1449ffb700 1 -- 172.21.15.35:0/2704854006 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1458005700 con 0x55c53b14d4f0 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 10 client.20403 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:16:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 10 client.20403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 20 client.20403 populate_metadata read hostname 'smithi035' 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b160f40 0x55c53b163350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 4 client.20403 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c53b068600 con 0x55c53b160f40 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.852+0000 7f146649c700 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b160f40 0x55c53b163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.853+0000 7f146649c700 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b160f40 0x55c53b163350 crc :-1 s=READY pgs=627 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=250aec70cc269350 server_cookie=8db0b4e2e1a6cf80 in_seq=0 out_seq=0 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.853+0000 7f1449ffb700 10 client.20403 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.853+0000 7f1449ffb700 1 -- 172.21.15.35:0/2704854006 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c53b068600 con 0x55c53b160f40 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.853+0000 7f1449ffb700 10 client.20403 handle_command_reply: tid=0 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.853+0000 7f147488db80 1 client.20403 shutdown 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 msgr2=0x55c53b150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 0x55c53b150c20 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f1458018040 tx=0x7f1458004f20 comp rx=0 tx=0).stop 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 shutdown_connections 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b160f40 0x55c53b163350 crc :-1 s=READY pgs=627 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14d4f0 0x55c53b150c20 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 --2- 172.21.15.35:0/2704854006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f1449ffb700 0 client.20403 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 >> 172.21.15.35:0/2704854006 conn(0x55c53afa46b0 msgr2=0x55c53b141a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 shutdown_connections 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 1 -- 172.21.15.35:0/2704854006 wait complete. 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.854+0000 7f147488db80 20 client.20403 trim_cache size 0 max 16384 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 Processor -- start 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 -- start start 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b14e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14d4f0 0x55c53b157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b14e690 con 0x55c53b147960 2023-03-17T11:16:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b13d0f0 con 0x55c53b14d4f0 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f147488db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b13e5c0 con 0x55c53b14cbe0 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f146649c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f146649c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54394/0 (socket says 172.21.15.35:54394) 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f146649c700 1 -- 172.21.15.35:0/3541874337 learned_addr learned my addr 172.21.15.35:0/3541874337 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f1466c9d700 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14d4f0 0x55c53b157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.869+0000 7f1465c9b700 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f146649c700 1 -- 172.21.15.35:0/3541874337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 msgr2=0x55c53b14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f146649c700 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f146649c700 1 -- 172.21.15.35:0/3541874337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14d4f0 msgr2=0x55c53b157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f146649c700 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14d4f0 0x55c53b157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f146649c700 1 -- 172.21.15.35:0/3541874337 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c53b148000 con 0x55c53b147960 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f146649c700 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147420 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f145c097a20 tx=0x7f145c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa6bf32c80d2a64 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f14557fa700 1 -- 172.21.15.35:0/3541874337 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0960c0 con 0x55c53b147960 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f14557fa700 1 -- 172.21.15.35:0/3541874337 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f145c004a00 con 0x55c53b147960 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f14557fa700 1 -- 172.21.15.35:0/3541874337 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c097f80 con 0x55c53b147960 2023-03-17T11:16:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f147488db80 1 -- 172.21.15.35:0/3541874337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 msgr2=0x55c53b147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.870+0000 7f147488db80 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147420 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f145c097a20 tx=0x7f145c000bc0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- 172.21.15.35:0/3541874337 shutdown_connections 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b14d4f0 0x55c53b157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b147960 0x55c53b147420 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 --2- 172.21.15.35:0/3541874337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14cbe0 0x55c53b14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- 172.21.15.35:0/3541874337 >> 172.21.15.35:0/3541874337 conn(0x55c53afa46b0 msgr2=0x55c53b14b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- 172.21.15.35:0/3541874337 shutdown_connections 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- 172.21.15.35:0/3541874337 wait complete. 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- start start 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 Processor -- start 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 0x55c53b1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b156910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b156fe0 con 0x55c53b14cbe0 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b157150 con 0x55c53b147960 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53b1b4db0 con 0x55c53b14d4f0 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f147488db80 10 client.0 _ll_register_callbacks cb 0x55c53af3f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:16:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f1465c9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 0x55c53b1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f1465c9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 0x55c53b1563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54402/0 (socket says 172.21.15.35:54402) 2023-03-17T11:16:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f1465c9b700 1 -- 172.21.15.35:0/1121868125 learned_addr learned my addr 172.21.15.35:0/1121868125 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.871+0000 7f146649c700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1466c9d700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1465c9b700 1 -- 172.21.15.35:0/1121868125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 msgr2=0x55c53b156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1465c9b700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1465c9b700 1 -- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 msgr2=0x55c53b158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1465c9b700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1465c9b700 1 -- 172.21.15.35:0/1121868125 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146010ff60 con 0x55c53b14cbe0 2023-03-17T11:16:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f146649c700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:16:08.949 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:31 smithi035 ceph-mon[92535]: pgmap v4624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1465c9b700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 0x55c53b1563d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f14500099c0 tx=0x7f145001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc355eedb7071ce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1449ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1449ffb700 1 -- 172.21.15.35:0/1121868125 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450003b60 con 0x55c53b14cbe0 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c53b1171e0 con 0x55c53b14cbe0 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1449ffb700 1 -- 172.21.15.35:0/1121868125 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1450003cc0 con 0x55c53b14cbe0 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1449ffb700 1 -- 172.21.15.35:0/1121868125 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1450003e80 con 0x55c53b14cbe0 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f147488db80 10 client.20409 fetch_fsmap learned FSMap version 102 2023-03-17T11:16:08.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55c53aeb0c00 con 0x55c53b14cbe0 2023-03-17T11:16:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.872+0000 7f1449ffb700 1 -- 172.21.15.35:0/1121868125 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c53b1171e0 con 0x55c53b14cbe0 2023-03-17T11:16:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f1449ffb700 1 -- 172.21.15.35:0/1121868125 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f1450024480 con 0x55c53b14cbe0 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f147488db80 10 client.20409 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f147488db80 10 client.20409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f147488db80 20 client.20409 populate_metadata read hostname 'smithi035' 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f147488db80 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b1b64f0 0x55c53b1b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f147488db80 4 client.20409 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c53af1df00 con 0x55c53b1b64f0 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f146649c700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b1b64f0 0x55c53b1b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f146649c700 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b1b64f0 0x55c53b1b8900 crc :-1 s=READY pgs=628 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7942b1a12e2ec1d0 server_cookie=80298f045034b229 in_seq=0 out_seq=0 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.873+0000 7f1449ffb700 10 client.20409 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f1449ffb700 1 -- 172.21.15.35:0/1121868125 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c53af1df00 con 0x55c53b1b64f0 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f1449ffb700 10 client.20409 handle_command_reply: tid=0 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 client.20409 shutdown 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 msgr2=0x55c53b1563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 0x55c53b1563d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f14500099c0 tx=0x7f145001a050 comp rx=0 tx=0).stop 2023-03-17T11:16:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 shutdown_connections 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c53b1b64f0 0x55c53b1b8900 crc :-1 s=READY pgs=628 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c53b14d4f0 0x55c53b156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f1449ffb700 0 client.20409 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c53b147960 0x55c53b158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 --2- 172.21.15.35:0/1121868125 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c53b14cbe0 0x55c53b1563d0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 >> 172.21.15.35:0/1121868125 conn(0x55c53afa46b0 msgr2=0x55c53b14bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 shutdown_connections 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 1 -- 172.21.15.35:0/1121868125 wait complete. 2023-03-17T11:16:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.891+0000 7f147488db80 20 client.20409 trim_cache size 0 max 16384 2023-03-17T11:16:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f144c09f640 msgr2=0x7f144c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f144c09f640 0x7f144c0a1af0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f14500098e0 tx=0x7f145000bfb0 comp rx=0 tx=0).stop 2023-03-17T11:16:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 msgr2=0x7f1460196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 0x7f1460196260 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c920 tx=0x7f145c00cce0 comp rx=0 tx=0).stop 2023-03-17T11:16:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 shutdown_connections 2023-03-17T11:16:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f144c09f640 0x7f144c0a1af0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1460105510 0x7f146019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14600fe970 0x7f1460196260 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 --2- 172.21.15.35:0/3929679238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14600ff310 0x7f14601967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 >> 172.21.15.35:0/3929679238 conn(0x7f14600757a0 msgr2=0x7f14600fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 shutdown_connections 2023-03-17T11:16:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:41.892+0000 7f1468700700 1 -- 172.21.15.35:0/3929679238 wait complete. 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 -- 172.21.15.35:0/680185069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c00ff390 msgr2=0x7f83c00ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 --2- 172.21.15.35:0/680185069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c00ff390 0x7f83c00ff760 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f83a80099c0 tx=0x7f83a8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 -- 172.21.15.35:0/680185069 shutdown_connections 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 --2- 172.21.15.35:0/680185069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83c01043d0 0x7f83c010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 --2- 172.21.15.35:0/680185069 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c00ff390 0x7f83c00ff760 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 --2- 172.21.15.35:0/680185069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c00ffd30 0x7f83c0103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 -- 172.21.15.35:0/680185069 >> 172.21.15.35:0/680185069 conn(0x7f83c0075f30 msgr2=0x7f83c0076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 -- 172.21.15.35:0/680185069 shutdown_connections 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.014+0000 7f83c5234700 1 -- 172.21.15.35:0/680185069 wait complete. 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 Processor -- start 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 -- start start 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83c00ff390 0x7f83c0196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c00ffd30 0x7f83c0196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 0x7f83c019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:18.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c019b2e0 con 0x7f83c01043d0 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c019b450 con 0x7f83c00ffd30 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83c5234700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c019b610 con 0x7f83c00ff390 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83bf59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 0x7f83c019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83bf59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 0x7f83c019aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54418/0 (socket says 172.21.15.35:54418) 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.015+0000 7f83bf59e700 1 -- 172.21.15.35:0/1364771817 learned_addr learned my addr 172.21.15.35:0/1364771817 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83be59c700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c00ffd30 0x7f83c0196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bed9d700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83c00ff390 0x7f83c0196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bf59e700 1 -- 172.21.15.35:0/1364771817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83c00ff390 msgr2=0x7f83c0196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bf59e700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83c00ff390 0x7f83c0196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bf59e700 1 -- 172.21.15.35:0/1364771817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c00ffd30 msgr2=0x7f83c0196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bf59e700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c00ffd30 0x7f83c0196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bf59e700 1 -- 172.21.15.35:0/1364771817 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a80095f0 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83bf59e700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 0x7f83c019aca0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f83b8007ee0 tx=0x7f83b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83b7fff700 1 -- 172.21.15.35:0/1364771817 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8017070 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83b7fff700 1 -- 172.21.15.35:0/1364771817 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83b800f040 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83b7fff700 1 -- 172.21.15.35:0/1364771817 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8005710 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c010f040 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.016+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c010eeb0 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.018+0000 7f83b7fff700 1 -- 172.21.15.35:0/1364771817 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f83b8005870 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.019+0000 7f83b7fff700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f83ac09f640 0x7f83ac0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.019+0000 7f83bed9d700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f83ac09f640 0x7f83ac0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.019+0000 7f83b7fff700 1 -- 172.21.15.35:0/1364771817 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f83b80c9f10 con 0x7f83c01043d0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.020+0000 7f83bed9d700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f83ac09f640 0x7f83ac0a1af0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b580 tx=0x7f83a801a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.020+0000 7f83d13c1b80 1 Processor -- start 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.020+0000 7f83d13c1b80 1 -- start start 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.020+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb6125040 0x557fb6125410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb611f830 0x557fb611fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb612bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6022010 con 0x557fb6125040 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6074950 con 0x557fb611f830 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb606dde0 con 0x557fb61201e0 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83be59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb611f830 0x557fb611fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb6125040 0x557fb6125410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bf59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb612bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83be59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb611f830 0x557fb611fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:56220/0 (socket says 172.21.15.35:56220) 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83be59c700 1 -- 172.21.15.35:0/185279861 learned_addr learned my addr 172.21.15.35:0/185279861 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 -- 172.21.15.35:0/185279861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 msgr2=0x557fb612bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb612bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 -- 172.21.15.35:0/185279861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb611f830 msgr2=0x557fb611fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb611f830 0x557fb611fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 -- 172.21.15.35:0/185279861 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fb5eef5d0 con 0x557fb6125040 2023-03-17T11:16:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bf59e700 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb612bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:16:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83bed9d700 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb6125040 0x557fb6125410 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eead51cc2ef8cfed server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.021+0000 7f83b57fa700 1 -- 172.21.15.35:0/185279861 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8032070 con 0x557fb6125040 2023-03-17T11:16:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83b57fa700 1 -- 172.21.15.35:0/185279861 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a800bdb0 con 0x557fb6125040 2023-03-17T11:16:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83b57fa700 1 -- 172.21.15.35:0/185279861 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a801d040 con 0x557fb6125040 2023-03-17T11:16:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 -- 172.21.15.35:0/185279861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb6125040 msgr2=0x557fb6125410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb6125040 0x557fb6125410 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a801e000 comp rx=0 tx=0).stop 2023-03-17T11:16:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 -- 172.21.15.35:0/185279861 shutdown_connections 2023-03-17T11:16:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb612bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb6125040 0x557fb6125410 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/185279861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb611f830 0x557fb611fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 -- 172.21.15.35:0/185279861 >> 172.21.15.35:0/185279861 conn(0x557fb5f786b0 msgr2=0x557fb6115a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 -- 172.21.15.35:0/185279861 shutdown_connections 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.022+0000 7f83d13c1b80 1 -- 172.21.15.35:0/185279861 wait complete. 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 -- start start 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 Processor -- start 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb611f830 0x557fb612a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 0x557fb612aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb611e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb5ef18c0 con 0x557fb61201e0 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb611ee50 con 0x557fb6125040 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb611f010 con 0x557fb611f830 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83d13c1b80 10 client.0 _ll_register_callbacks cb 0x557fb5f13230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83be59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 0x557fb612aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83be59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 0x557fb612aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54430/0 (socket says 172.21.15.35:54430) 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83be59c700 1 -- 172.21.15.35:0/1193883511 learned_addr learned my addr 172.21.15.35:0/1193883511 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83bed9d700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb611f830 0x557fb612a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.023+0000 7f83bf59e700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb611e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83be59c700 1 -- 172.21.15.35:0/1193883511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb611f830 msgr2=0x557fb612a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83be59c700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb611f830 0x557fb612a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83be59c700 1 -- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 msgr2=0x557fb611e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83be59c700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb611e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83be59c700 1 -- 172.21.15.35:0/1193883511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c010c7e0 con 0x557fb61201e0 2023-03-17T11:16:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83bf59e700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb611e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:16:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83be59c700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 0x557fb612aed0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f83b0013710 tx=0x7f83b0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ed884843699853 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83a67fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:16:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83a67fc700 1 -- 172.21.15.35:0/1193883511 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0009810 con 0x557fb61201e0 2023-03-17T11:16:24.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83a67fc700 1 -- 172.21.15.35:0/1193883511 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f83b0004220 con 0x557fb61201e0 2023-03-17T11:16:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557fb6030390 con 0x557fb61201e0 2023-03-17T11:16:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83a67fc700 1 -- 172.21.15.35:0/1193883511 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83b0004420 con 0x557fb61201e0 2023-03-17T11:16:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83d13c1b80 10 client.20421 fetch_fsmap learned FSMap version 102 2023-03-17T11:16:25.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x557fb5e9bd80 con 0x557fb61201e0 2023-03-17T11:16:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.024+0000 7f83a67fc700 1 -- 172.21.15.35:0/1193883511 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557fb6030390 con 0x557fb61201e0 2023-03-17T11:16:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83a67fc700 1 -- 172.21.15.35:0/1193883511 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f83b0003a50 con 0x557fb61201e0 2023-03-17T11:16:25.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83d13c1b80 10 client.20421 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83d13c1b80 10 client.20421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83d13c1b80 20 client.20421 populate_metadata read hostname 'smithi035' 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6135220 0x557fb6137630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83d13c1b80 4 client.20421 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557fb603c600 con 0x557fb6135220 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83bed9d700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6135220 0x557fb6137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83a67fc700 10 client.20421 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.025+0000 7f83bed9d700 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6135220 0x557fb6137630 crc :-1 s=READY pgs=629 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d840049f44e262ea server_cookie=fe86db15951b6d94 in_seq=0 out_seq=0 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83a67fc700 1 -- 172.21.15.35:0/1193883511 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557fb603c600 con 0x557fb6135220 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83a67fc700 10 client.20421 handle_command_reply: tid=0 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 client.20421 shutdown 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 msgr2=0x557fb612aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 0x557fb612aed0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f83b0013710 tx=0x7f83b0009f90 comp rx=0 tx=0).stop 2023-03-17T11:16:26.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 shutdown_connections 2023-03-17T11:16:26.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6135220 0x557fb6137630 crc :-1 s=READY pgs=629 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:26.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb611e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:26.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:33 smithi035 ceph-mon[92535]: pgmap v4625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:35 smithi035 ceph-mon[92535]: pgmap v4626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:37 smithi035 ceph-mon[92535]: pgmap v4627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:39 smithi035 ceph-mon[92535]: pgmap v4628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:41 smithi035 ceph-mon[92535]: pgmap v4629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:43 smithi035 ceph-mon[92535]: pgmap v4630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:45 smithi035 ceph-mon[92535]: pgmap v4631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:47 smithi035 ceph-mon[92535]: pgmap v4632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:49 smithi035 ceph-mon[92535]: pgmap v4633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:51 smithi035 ceph-mon[92535]: pgmap v4634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:53 smithi035 ceph-mon[92535]: pgmap v4635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:55 smithi035 ceph-mon[92535]: pgmap v4636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:57 smithi035 ceph-mon[92535]: pgmap v4637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:16:27.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:59 smithi035 ceph-mon[92535]: pgmap v4638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:06:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:00 smithi035 ceph-mon[92535]: pgmap v4639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:00 smithi035 ceph-mon[92535]: pgmap v4640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:02 smithi035 ceph-mon[92535]: pgmap v4641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:04 smithi035 ceph-mon[92535]: pgmap v4642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:06 smithi035 ceph-mon[92535]: pgmap v4643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:08 smithi035 ceph-mon[92535]: pgmap v4644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 26 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:10 smithi035 ceph-mon[92535]: pgmap v4645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:10 smithi035 ceph-mon[92535]: osdmap e360: 12 total, 12 up, 12 in 2023-03-17T11:16:27.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:12 smithi035 ceph-mon[92535]: pgmap v4647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:16:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:16:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:16:28.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:16:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:16:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:16:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:16:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:16:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:16:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83a67fc700 0 client.20421 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb611f830 0x557fb612a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/1193883511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb61201e0 0x557fb612aed0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 >> 172.21.15.35:0/1193883511 conn(0x557fb5f786b0 msgr2=0x557fb611a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 shutdown_connections 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.026+0000 7f83d13c1b80 1 -- 172.21.15.35:0/1193883511 wait complete. 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.027+0000 7f83d13c1b80 20 client.20421 trim_cache size 0 max 16384 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 Processor -- start 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 -- start start 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb611fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb61201e0 0x557fb6115ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb6125040 0x557fb611e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6117c20 con 0x557fb611f830 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6122cb0 con 0x557fb61201e0 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb61177b0 con 0x557fb6125040 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb611fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb611fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54436/0 (socket says 172.21.15.35:54436) 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 -- 172.21.15.35:0/2511746937 learned_addr learned my addr 172.21.15.35:0/2511746937 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83be59c700 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb61201e0 0x557fb6115ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bf59e700 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb6125040 0x557fb611e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 -- 172.21.15.35:0/2511746937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb6125040 msgr2=0x557fb611e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb6125040 0x557fb611e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 -- 172.21.15.35:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb61201e0 msgr2=0x557fb6115ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb61201e0 0x557fb6115ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.042+0000 7f83bed9d700 1 -- 172.21.15.35:0/2511746937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fb6034130 con 0x557fb611f830 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83bed9d700 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb611fc00 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a8019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2c4b21ed42ef1d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83b5ffb700 1 -- 172.21.15.35:0/2511746937 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a801d050 con 0x557fb611f830 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83b5ffb700 1 -- 172.21.15.35:0/2511746937 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a8043560 con 0x557fb611f830 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83b5ffb700 1 -- 172.21.15.35:0/2511746937 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8032040 con 0x557fb611f830 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2511746937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 msgr2=0x557fb611fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb611fc00 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a8019040 comp rx=0 tx=0).stop 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2511746937 shutdown_connections 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb6125040 0x557fb611e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb611fc00 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2511746937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb61201e0 0x557fb6115ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2511746937 >> 172.21.15.35:0/2511746937 conn(0x557fb5f786b0 msgr2=0x557fb613bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.043+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2511746937 shutdown_connections 2023-03-17T11:16:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2511746937 wait complete. 2023-03-17T11:16:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 -- start start 2023-03-17T11:16:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 Processor -- start 2023-03-17T11:16:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb617d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb617d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb617dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6188200 con 0x557fb611f830 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6188340 con 0x557fb6125040 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fb6188500 con 0x557fb61201e0 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83d13c1b80 10 client.0 _ll_register_callbacks cb 0x557fb5f13230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:16:29.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb617d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb617d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54442/0 (socket says 172.21.15.35:54442) 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83bed9d700 1 -- 172.21.15.35:0/2775868044 learned_addr learned my addr 172.21.15.35:0/2775868044 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.044+0000 7f83bf59e700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb617dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83be59c700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb617d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bed9d700 1 -- 172.21.15.35:0/2775868044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 msgr2=0x557fb617d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bed9d700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb617d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bed9d700 1 -- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 msgr2=0x557fb617dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bed9d700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb617dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bed9d700 1 -- 172.21.15.35:0/2775868044 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557fb5eef5d0 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bf59e700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb617dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83bed9d700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb617d050 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b9a0 tx=0x7f83a8043180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a758fef0ea31bd83 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83a67fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83a67fc700 1 -- 172.21.15.35:0/2775868044 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8032040 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83a67fc700 1 -- 172.21.15.35:0/2775868044 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f83a8043c20 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557fb60eb1e0 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83a67fc700 1 -- 172.21.15.35:0/2775868044 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83a801d020 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83d13c1b80 10 client.20427 fetch_fsmap learned FSMap version 102 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x557fb5ec21f0 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83a67fc700 1 -- 172.21.15.35:0/2775868044 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83a805d020 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.045+0000 7f83a67fc700 1 -- 172.21.15.35:0/2775868044 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f83a8051c80 con 0x557fb611f830 2023-03-17T11:16:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83d13c1b80 10 client.20427 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:16:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83d13c1b80 10 client.20427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:16:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83d13c1b80 20 client.20427 populate_metadata read hostname 'smithi035' 2023-03-17T11:16:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6189790 0x557fb618bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83d13c1b80 4 client.20427 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:16:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557fb5ef1f00 con 0x557fb6189790 2023-03-17T11:16:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83be59c700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6189790 0x557fb618bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83be59c700 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6189790 0x557fb618bb70 crc :-1 s=READY pgs=630 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e53345497ee02 server_cookie=cc8115212b2360cc in_seq=0 out_seq=0 2023-03-17T11:16:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.046+0000 7f83a67fc700 10 client.20427 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83a67fc700 1 -- 172.21.15.35:0/2775868044 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557fb5ef1f00 con 0x557fb6189790 2023-03-17T11:16:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83a67fc700 10 client.20427 handle_command_reply: tid=0 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 client.20427 shutdown 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 msgr2=0x557fb617d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb617d050 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b9a0 tx=0x7f83a8043180 comp rx=0 tx=0).stop 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 shutdown_connections 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557fb6189790 0x557fb618bb70 crc :-1 s=READY pgs=630 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557fb6125040 0x557fb617dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557fb611f830 0x557fb617d050 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 --2- 172.21.15.35:0/2775868044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557fb61201e0 0x557fb617d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83a67fc700 0 client.20427 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 >> 172.21.15.35:0/2775868044 conn(0x557fb5f786b0 msgr2=0x557fb613bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 shutdown_connections 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 1 -- 172.21.15.35:0/2775868044 wait complete. 2023-03-17T11:16:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.059+0000 7f83d13c1b80 20 client.20427 trim_cache size 0 max 16384 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f83ac09f640 msgr2=0x7f83ac0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f83ac09f640 0x7f83ac0a1af0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b580 tx=0x7f83a801a040 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 msgr2=0x7f83c019aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 0x7f83c019aca0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f83b8007ee0 tx=0x7f83b800d3b0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 shutdown_connections 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f83ac09f640 0x7f83ac0a1af0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f83c01043d0 0x7f83c019aca0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83c00ff390 0x7f83c0196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 --2- 172.21.15.35:0/1364771817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83c00ffd30 0x7f83c0196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 >> 172.21.15.35:0/1364771817 conn(0x7f83c0075f30 msgr2=0x7f83c0068d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 shutdown_connections 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:53:55.060+0000 7f83c5234700 1 -- 172.21.15.35:0/1364771817 wait complete. 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 -- 172.21.15.35:0/3309408093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc608104390 msgr2=0x7fc60810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 --2- 172.21.15.35:0/3309408093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc608104390 0x7fc60810bf60 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fc60000b0d0 tx=0x7fc60000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 -- 172.21.15.35:0/3309408093 shutdown_connections 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 --2- 172.21.15.35:0/3309408093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc608104390 0x7fc60810bf60 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 --2- 172.21.15.35:0/3309408093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6080ff350 0x7fc6080ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 --2- 172.21.15.35:0/3309408093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ffcf0 0x7fc608103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 -- 172.21.15.35:0/3309408093 >> 172.21.15.35:0/3309408093 conn(0x7fc608076330 msgr2=0x7fc608076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 -- 172.21.15.35:0/3309408093 shutdown_connections 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.183+0000 7fc60fb73700 1 -- 172.21.15.35:0/3309408093 wait complete. 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 Processor -- start 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 -- start start 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6080ff350 0x7fc608196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 0x7fc608196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc608104390 0x7fc60819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60819b330 con 0x7fc6080ffcf0 2023-03-17T11:16:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60819b4a0 con 0x7fc6080ff350 2023-03-17T11:16:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60fb73700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60819b660 con 0x7fc608104390 2023-03-17T11:16:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60d10e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 0x7fc608196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60d10e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 0x7fc608196890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54458/0 (socket says 172.21.15.35:54458) 2023-03-17T11:16:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60d10e700 1 -- 172.21.15.35:0/2307378720 learned_addr learned my addr 172.21.15.35:0/2307378720 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60d90f700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6080ff350 0x7fc608196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.184+0000 7fc60e110700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc608104390 0x7fc60819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60d10e700 1 -- 172.21.15.35:0/2307378720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc608104390 msgr2=0x7fc60819acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60d10e700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc608104390 0x7fc60819acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60d10e700 1 -- 172.21.15.35:0/2307378720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6080ff350 msgr2=0x7fc608196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60d10e700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6080ff350 0x7fc608196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60d10e700 1 -- 172.21.15.35:0/2307378720 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600009d00 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60d10e700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 0x7fc608196890 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00d950 tx=0x7fc5fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc5faffd700 1 -- 172.21.15.35:0/2307378720 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00f890 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60810efc0 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc5faffd700 1 -- 172.21.15.35:0/2307378720 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5fc00fe80 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc5faffd700 1 -- 172.21.15.35:0/2307378720 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00e3b0 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.185+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60810ee30 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.188+0000 7fc5faffd700 1 -- 172.21.15.35:0/2307378720 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc5fc00f9f0 con 0x7fc6080ffcf0 2023-03-17T11:16:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.189+0000 7fc5faffd700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc5f409f640 0x7fc5f40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.189+0000 7fc5faffd700 1 -- 172.21.15.35:0/2307378720 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc5fc0ca100 con 0x7fc6080ffcf0 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.189+0000 7fc60d90f700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc5f409f640 0x7fc5f40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.189+0000 7fc61bd00b80 1 Processor -- start 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.189+0000 7fc60d90f700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc5f409f640 0x7fc5f40a1af0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc604009c60 tx=0x7fc604009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 -- start start 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362cc960 0x55e4362ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4361d3010 con 0x55e4362d24f0 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e436225950 con 0x55e4362cc960 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e43621ede0 con 0x55e4362d1be0 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54466/0 (socket says 172.21.15.35:54466) 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 -- 172.21.15.35:0/2614851967 learned_addr learned my addr 172.21.15.35:0/2614851967 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d90f700 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60e110700 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362cc960 0x55e4362ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:37.981 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 -- 172.21.15.35:0/2614851967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 msgr2=0x55e4362d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 -- 172.21.15.35:0/2614851967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362cc960 msgr2=0x55e4362ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362cc960 0x55e4362ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 -- 172.21.15.35:0/2614851967 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4360a05d0 con 0x55e4362d24f0 2023-03-17T11:16:37.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.190+0000 7fc60d10e700 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cc420 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc09f810 tx=0x7fc5fc0974b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d305b8c4ed37a0e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:37.983 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:14 smithi035 ceph-mon[92535]: pgmap v4648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:16:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc5f3fff700 1 -- 172.21.15.35:0/2614851967 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc09fd40 con 0x55e4362d24f0 2023-03-17T11:16:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc5f3fff700 1 -- 172.21.15.35:0/2614851967 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5fc095ef0 con 0x55e4362d24f0 2023-03-17T11:16:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc5f3fff700 1 -- 172.21.15.35:0/2614851967 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc097040 con 0x55e4362d24f0 2023-03-17T11:16:40.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 -- 172.21.15.35:0/2614851967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 msgr2=0x55e4362cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:41.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cc420 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc09f810 tx=0x7fc5fc0974b0 comp rx=0 tx=0).stop 2023-03-17T11:16:41.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 -- 172.21.15.35:0/2614851967 shutdown_connections 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362cc960 0x55e4362ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/2614851967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cc420 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 -- 172.21.15.35:0/2614851967 >> 172.21.15.35:0/2614851967 conn(0x55e4361296b0 msgr2=0x55e4362c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 -- 172.21.15.35:0/2614851967 shutdown_connections 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.191+0000 7fc61bd00b80 1 -- 172.21.15.35:0/2614851967 wait complete. 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 -- start start 2023-03-17T11:16:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 Processor -- start 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 0x55e4362d8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362d5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4360a28c0 con 0x55e4362cc960 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362d6520 con 0x55e4362d24f0 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362e1fd0 con 0x55e4362d1be0 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc61bd00b80 10 client.0 _ll_register_callbacks cb 0x55e4360c4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc60d90f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 0x55e4362d8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.192+0000 7fc60d90f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 0x55e4362d8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54470/0 (socket says 172.21.15.35:54470) 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 -- 172.21.15.35:0/3186263285 learned_addr learned my addr 172.21.15.35:0/3186263285 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60e110700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362d5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d10e700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 -- 172.21.15.35:0/3186263285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 msgr2=0x55e4362d5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 -- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 msgr2=0x55e4362d5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362d5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 -- 172.21.15.35:0/3186263285 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60810ee30 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60e110700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc60d90f700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 0x55e4362d8490 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fc60401ec10 tx=0x7fc6040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b17666c0e3a719 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc5f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc5f17fa700 1 -- 172.21.15.35:0/3186263285 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400ec20 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc5f17fa700 1 -- 172.21.15.35:0/3186263285 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc60400ed80 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4361e1390 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc5f17fa700 1 -- 172.21.15.35:0/3186263285 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc604031420 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc61bd00b80 10 client.20439 fetch_fsmap learned FSMap version 102 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55e43604cd80 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.193+0000 7fc5f17fa700 1 -- 172.21.15.35:0/3186263285 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e4361e1390 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc5f17fa700 1 -- 172.21.15.35:0/3186263285 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc60401c410 con 0x55e4362cc960 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc61bd00b80 10 client.20439 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:16:44.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc61bd00b80 10 client.20439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:16:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc61bd00b80 20 client.20439 populate_metadata read hostname 'smithi035' 2023-03-17T11:16:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4362e6240 0x55e4362e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc61bd00b80 4 client.20439 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:16:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4361ed600 con 0x55e4362e6240 2023-03-17T11:16:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.194+0000 7fc60d10e700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4362e6240 0x55e4362e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc5f17fa700 10 client.20439 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc60d10e700 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4362e6240 0x55e4362e8650 crc :-1 s=READY pgs=631 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efda74ef1effe240 server_cookie=cc50b9c15e671880 in_seq=0 out_seq=0 2023-03-17T11:16:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc5f17fa700 1 -- 172.21.15.35:0/3186263285 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e4361ed600 con 0x55e4362e6240 2023-03-17T11:16:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc5f17fa700 10 client.20439 handle_command_reply: tid=0 2023-03-17T11:16:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 client.20439 shutdown 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 msgr2=0x55e4362d8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 0x55e4362d8490 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fc60401ec10 tx=0x7fc6040047c0 comp rx=0 tx=0).stop 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 shutdown_connections 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4362e6240 0x55e4362e8650 crc :-1 s=READY pgs=631 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362d5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362cc960 0x55e4362d8490 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc5f17fa700 0 client.20439 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3186263285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362d1be0 0x55e4362d5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.195+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 >> 172.21.15.35:0/3186263285 conn(0x55e4361296b0 msgr2=0x55e4362cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.196+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 shutdown_connections 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.196+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3186263285 wait complete. 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.196+0000 7fc61bd00b80 20 client.20439 trim_cache size 0 max 16384 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.210+0000 7fc61bd00b80 1 Processor -- start 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.210+0000 7fc61bd00b80 1 -- start start 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d1be0 0x55e4362d8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362d6cf0 con 0x55e4362d24f0 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362cc7a0 con 0x55e4362d1be0 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362e3820 con 0x55e4362cc960 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54482/0 (socket says 172.21.15.35:54482) 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 -- 172.21.15.35:0/3755887576 learned_addr learned my addr 172.21.15.35:0/3755887576 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60d90f700 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60d10e700 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d1be0 0x55e4362d8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 -- 172.21.15.35:0/3755887576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 msgr2=0x55e4362dcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 -- 172.21.15.35:0/3755887576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d1be0 msgr2=0x55e4362d8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d1be0 0x55e4362d8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 -- 172.21.15.35:0/3755887576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4361e5130 con 0x55e4362d24f0 2023-03-17T11:16:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60d10e700 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d1be0 0x55e4362d8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:16:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc60e110700 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cf6b0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fc6000092e0 tx=0x7fc60000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96588c36c584df6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc5f8dae700 1 -- 172.21.15.35:0/3755887576 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000e040 con 0x55e4362d24f0 2023-03-17T11:16:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.211+0000 7fc5f8dae700 1 -- 172.21.15.35:0/3755887576 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc600007d90 con 0x55e4362d24f0 2023-03-17T11:16:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc5f8dae700 1 -- 172.21.15.35:0/3755887576 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600003c60 con 0x55e4362d24f0 2023-03-17T11:16:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3755887576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 msgr2=0x55e4362cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cf6b0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fc6000092e0 tx=0x7fc60000b040 comp rx=0 tx=0).stop 2023-03-17T11:16:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3755887576 shutdown_connections 2023-03-17T11:16:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d24f0 0x55e4362cf6b0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/3755887576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d1be0 0x55e4362d8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3755887576 >> 172.21.15.35:0/3755887576 conn(0x55e4361296b0 msgr2=0x55e4362cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3755887576 shutdown_connections 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 -- 172.21.15.35:0/3755887576 wait complete. 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.212+0000 7fc61bd00b80 1 -- start start 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 Processor -- start 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 0x55e4362db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362dbb20 con 0x55e4362d1be0 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362dbc90 con 0x55e4362d24f0 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4362dbe50 con 0x55e4362cc960 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc61bd00b80 10 client.0 _ll_register_callbacks cb 0x55e4360c4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 0x55e4362db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 0x55e4362db0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54486/0 (socket says 172.21.15.35:54486) 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 -- 172.21.15.35:0/4084765576 learned_addr learned my addr 172.21.15.35:0/4084765576 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d90f700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60e110700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 -- 172.21.15.35:0/4084765576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 msgr2=0x55e4362dcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 -- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 msgr2=0x55e4362db5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362db5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60d10e700 1 -- 172.21.15.35:0/4084765576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60810c7a0 con 0x55e4362d1be0 2023-03-17T11:16:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.213+0000 7fc60e110700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362db5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:16:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc60d10e700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 0x55e4362db0a0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc097850 tx=0x7fc5fc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d671936a1b689d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:16:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc5f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:16:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc5f17fa700 1 -- 172.21.15.35:0/4084765576 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0c7070 con 0x55e4362d1be0 2023-03-17T11:16:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc5f17fa700 1 -- 172.21.15.35:0/4084765576 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(335..335 src has 1..335) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc5fc097db0 con 0x55e4362d1be0 2023-03-17T11:16:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e43629c1e0 con 0x55e4362d1be0 2023-03-17T11:16:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc5f17fa700 1 -- 172.21.15.35:0/4084765576 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5fc097f70 con 0x55e4362d1be0 2023-03-17T11:16:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc61bd00b80 10 client.20445 fetch_fsmap learned FSMap version 102 2023-03-17T11:16:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55e4360731f0 con 0x55e4362d1be0 2023-03-17T11:16:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.214+0000 7fc5f17fa700 1 -- 172.21.15.35:0/4084765576 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e43629c1e0 con 0x55e4362d1be0 2023-03-17T11:16:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc5f17fa700 1 -- 172.21.15.35:0/4084765576 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc5fc097040 con 0x55e4362d1be0 2023-03-17T11:16:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc61bd00b80 10 client.20445 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:16:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc61bd00b80 10 client.20445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:16:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc61bd00b80 20 client.20445 populate_metadata read hostname 'smithi035' 2023-03-17T11:16:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e43633b0a0 0x55e43633d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:16:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc61bd00b80 4 client.20445 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:16:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e4360a2f00 con 0x55e43633b0a0 2023-03-17T11:16:53.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc60d90f700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e43633b0a0 0x55e43633d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:16:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc5f17fa700 10 client.20445 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:55.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.215+0000 7fc60d90f700 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e43633b0a0 0x55e43633d480 crc :-1 s=READY pgs=632 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140486c29a44d1e8 server_cookie=c48611e2e9eb6d0b in_seq=0 out_seq=0 2023-03-17T11:16:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc5f17fa700 1 -- 172.21.15.35:0/4084765576 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e4360a2f00 con 0x55e43633b0a0 2023-03-17T11:16:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc5f17fa700 10 client.20445 handle_command_reply: tid=0 2023-03-17T11:16:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 client.20445 shutdown 2023-03-17T11:16:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 msgr2=0x55e4362db0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 0x55e4362db0a0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc097850 tx=0x7fc5fc010000 comp rx=0 tx=0).stop 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 shutdown_connections 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e43633b0a0 0x55e43633d480 crc :-1 s=READY pgs=632 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4362d24f0 0x55e4362db5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc5f17fa700 0 client.20445 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4362cc960 0x55e4362dcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 --2- 172.21.15.35:0/4084765576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4362d1be0 0x55e4362db0a0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 >> 172.21.15.35:0/4084765576 conn(0x55e4361296b0 msgr2=0x55e4362cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 shutdown_connections 2023-03-17T11:16:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.233+0000 7fc61bd00b80 1 -- 172.21.15.35:0/4084765576 wait complete. 2023-03-17T11:16:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc61bd00b80 20 client.20445 trim_cache size 0 max 16384 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc5f409f640 msgr2=0x7fc5f40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc5f409f640 0x7fc5f40a1af0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc604009c60 tx=0x7fc604009260 comp rx=0 tx=0).stop 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 msgr2=0x7fc608196890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 0x7fc608196890 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00d950 tx=0x7fc5fc00dc60 comp rx=0 tx=0).stop 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 shutdown_connections 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc5f409f640 0x7fc5f40a1af0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc608104390 0x7fc60819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6080ff350 0x7fc608196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 --2- 172.21.15.35:0/2307378720 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc6080ffcf0 0x7fc608196890 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:16:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 >> 172.21.15.35:0/2307378720 conn(0x7fc608076330 msgr2=0x7fc608068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:16:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 shutdown_connections 2023-03-17T11:16:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:08.234+0000 7fc60fb73700 1 -- 172.21.15.35:0/2307378720 wait complete. 2023-03-17T11:16:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 -- 172.21.15.35:0/3769228937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ffcf0 msgr2=0x7fa944103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:16:58.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:16 smithi035 ceph-mon[92535]: pgmap v4649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:17:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 --2- 172.21.15.35:0/3769228937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ffcf0 0x7fa944103cb0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0099c0 tx=0x7fa92c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:17:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 -- 172.21.15.35:0/3769228937 shutdown_connections 2023-03-17T11:17:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 --2- 172.21.15.35:0/3769228937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa944104390 0x7fa94410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 --2- 172.21.15.35:0/3769228937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ff350 0x7fa9440ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 --2- 172.21.15.35:0/3769228937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ffcf0 0x7fa944103cb0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 -- 172.21.15.35:0/3769228937 >> 172.21.15.35:0/3769228937 conn(0x7fa944076330 msgr2=0x7fa944076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 -- 172.21.15.35:0/3769228937 shutdown_connections 2023-03-17T11:17:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.356+0000 7fa949eaf700 1 -- 172.21.15.35:0/3769228937 wait complete. 2023-03-17T11:17:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 Processor -- start 2023-03-17T11:17:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 -- start start 2023-03-17T11:17:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 0x7fa9441962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ffcf0 0x7fa9441967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa944104390 0x7fa94419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94419b290 con 0x7fa9440ff350 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94419b400 con 0x7fa9440ffcf0 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa949eaf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94419b5c0 con 0x7fa944104390 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.357+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 0x7fa9441962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 0x7fa9441962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54498/0 (socket says 172.21.15.35:54498) 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 -- 172.21.15.35:0/743687148 learned_addr learned my addr 172.21.15.35:0/743687148 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa943fff700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa944104390 0x7fa94419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa942ffd700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ffcf0 0x7fa9441967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 -- 172.21.15.35:0/743687148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa944104390 msgr2=0x7fa94419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa944104390 0x7fa94419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 -- 172.21.15.35:0/743687148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ffcf0 msgr2=0x7fa9441967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:08.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ffcf0 0x7fa9441967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 -- 172.21.15.35:0/743687148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0095f0 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa942ffd700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ffcf0 0x7fa9441967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa9437fe700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 0x7fa9441962b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa93400d950 tx=0x7fa93400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa940ff9700 1 -- 172.21.15.35:0/743687148 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934009940 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa940ff9700 1 -- 172.21.15.35:0/743687148 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa934010460 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94410efc0 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa940ff9700 1 -- 172.21.15.35:0/743687148 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400f620 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.358+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94410ee30 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.360+0000 7fa940ff9700 1 -- 172.21.15.35:0/743687148 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa9340105d0 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.361+0000 7fa940ff9700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa93009f640 0x7fa9300a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.361+0000 7fa940ff9700 1 -- 172.21.15.35:0/743687148 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(337..337 src has 1..337) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa9340ca470 con 0x7fa9440ff350 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.361+0000 7fa942ffd700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa93009f640 0x7fa9300a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa942ffd700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa93009f640 0x7fa9300a1af0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa9441978c0 tx=0x7fa92c000bc0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 Processor -- start 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 -- start start 2023-03-17T11:17:08.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b30fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 0x55d911b2b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b2b960 0x55d911b2bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911a32010 con 0x55d911b314f0 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911a84950 con 0x55d911b30be0 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa95603cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911a7dde0 con 0x55d911b2b960 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 0x55d911b2b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 0x55d911b2b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54508/0 (socket says 172.21.15.35:54508) 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa942ffd700 1 -- 172.21.15.35:0/3684801331 learned_addr learned my addr 172.21.15.35:0/3684801331 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.362+0000 7fa9437fe700 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b30fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa943fff700 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b2b960 0x55d911b2bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa942ffd700 1 -- 172.21.15.35:0/3684801331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b2b960 msgr2=0x55d911b2bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa942ffd700 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b2b960 0x55d911b2bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:08.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa942ffd700 1 -- 172.21.15.35:0/3684801331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 msgr2=0x55d911b30fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa942ffd700 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b30fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa942ffd700 1 -- 172.21.15.35:0/3684801331 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9118ff5d0 con 0x55d911b314f0 2023-03-17T11:17:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa942ffd700 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 0x55d911b2b420 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa92c015000 tx=0x7fa92c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c583581d4e262e6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa939ffb700 1 -- 172.21.15.35:0/3684801331 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c01d070 con 0x55d911b314f0 2023-03-17T11:17:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa939ffb700 1 -- 172.21.15.35:0/3684801331 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa92c00be40 con 0x55d911b314f0 2023-03-17T11:17:10.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.363+0000 7fa939ffb700 1 -- 172.21.15.35:0/3684801331 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c02f6e0 con 0x55d911b314f0 2023-03-17T11:17:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 -- 172.21.15.35:0/3684801331 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 msgr2=0x55d911b2b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 0x55d911b2b420 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa92c015000 tx=0x7fa92c01d000 comp rx=0 tx=0).stop 2023-03-17T11:17:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 -- 172.21.15.35:0/3684801331 shutdown_connections 2023-03-17T11:17:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b2b960 0x55d911b2bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b30fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:10.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 --2- 172.21.15.35:0/3684801331 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b314f0 0x55d911b2b420 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 -- 172.21.15.35:0/3684801331 >> 172.21.15.35:0/3684801331 conn(0x55d9119886b0 msgr2=0x55d911b25a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 -- 172.21.15.35:0/3684801331 shutdown_connections 2023-03-17T11:17:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 -- 172.21.15.35:0/3684801331 wait complete. 2023-03-17T11:17:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 -- start start 2023-03-17T11:17:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.364+0000 7fa95603cb80 1 Processor -- start 2023-03-17T11:17:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b2b960 0x55d911b37460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 0x55d911b346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b34cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9119018c0 con 0x55d911b30be0 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b353f0 con 0x55d911b2b960 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b355b0 con 0x55d911b314f0 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa95603cb80 10 client.0 _ll_register_callbacks cb 0x55d911923230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 0x55d911b346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 0x55d911b346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54514/0 (socket says 172.21.15.35:54514) 2023-03-17T11:17:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 -- 172.21.15.35:0/574272004 learned_addr learned my addr 172.21.15.35:0/574272004 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:14.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa9437fe700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b2b960 0x55d911b37460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa943fff700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b34cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:14.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 -- 172.21.15.35:0/574272004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 msgr2=0x55d911b34cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b34cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 -- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b2b960 msgr2=0x55d911b37460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b2b960 0x55d911b37460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 -- 172.21.15.35:0/574272004 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94410c7a0 con 0x55d911b30be0 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa942ffd700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 0x55d911b346e0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00a010 tx=0x7fa92c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2b3df14332ee58 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa922ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa922ffd700 1 -- 172.21.15.35:0/574272004 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c003960 con 0x55d911b30be0 2023-03-17T11:17:15.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.365+0000 7fa922ffd700 1 -- 172.21.15.35:0/574272004 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(337..337 src has 1..337) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa92c003ac0 con 0x55d911b30be0 2023-03-17T11:17:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d911a40390 con 0x55d911b30be0 2023-03-17T11:17:15.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa922ffd700 1 -- 172.21.15.35:0/574272004 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa92c02f960 con 0x55d911b30be0 2023-03-17T11:17:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 10 client.20457 fetch_fsmap learned FSMap version 102 2023-03-17T11:17:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55d9118abd80 con 0x55d911b30be0 2023-03-17T11:17:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa922ffd700 1 -- 172.21.15.35:0/574272004 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d911a40390 con 0x55d911b30be0 2023-03-17T11:17:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa922ffd700 1 -- 172.21.15.35:0/574272004 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa92c00fb60 con 0x55d911b30be0 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 10 client.20457 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 10 client.20457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 20 client.20457 populate_metadata read hostname 'smithi035' 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b44c60 0x55d911b47070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 4 client.20457 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d911a4c600 con 0x55d911b44c60 2023-03-17T11:17:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.366+0000 7fa9437fe700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b44c60 0x55d911b47070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.367+0000 7fa922ffd700 10 client.20457 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.367+0000 7fa9437fe700 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b44c60 0x55d911b47070 crc :-1 s=READY pgs=633 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada71ff7b7ada35b server_cookie=daa7c5b28eaceddf in_seq=0 out_seq=0 2023-03-17T11:17:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.367+0000 7fa922ffd700 1 -- 172.21.15.35:0/574272004 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d911a4c600 con 0x55d911b44c60 2023-03-17T11:17:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.367+0000 7fa922ffd700 10 client.20457 handle_command_reply: tid=0 2023-03-17T11:17:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.367+0000 7fa95603cb80 1 client.20457 shutdown 2023-03-17T11:17:18.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 msgr2=0x55d911b346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 0x55d911b346e0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00a010 tx=0x7fa92c003d00 comp rx=0 tx=0).stop 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 shutdown_connections 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b44c60 0x55d911b47070 crc :-1 s=READY pgs=633 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b34cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa922ffd700 0 client.20457 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b2b960 0x55d911b37460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 --2- 172.21.15.35:0/574272004 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b30be0 0x55d911b346e0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 >> 172.21.15.35:0/574272004 conn(0x55d9119886b0 msgr2=0x55d911b2a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 shutdown_connections 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 1 -- 172.21.15.35:0/574272004 wait complete. 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.368+0000 7fa95603cb80 20 client.20457 trim_cache size 0 max 16384 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.382+0000 7fa95603cb80 1 Processor -- start 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 -- start start 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b27770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b25ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:18.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b36f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b210f0 con 0x55d911b2b960 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b26000 con 0x55d911b30be0 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa95603cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b225c0 con 0x55d911b314f0 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b27770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b27770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54520/0 (socket says 172.21.15.35:54520) 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 -- 172.21.15.35:0/1205732520 learned_addr learned my addr 172.21.15.35:0/1205732520 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:18.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa942ffd700 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b25ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa943fff700 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b36f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 -- 172.21.15.35:0/1205732520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 msgr2=0x55d911b36f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b36f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 -- 172.21.15.35:0/1205732520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 msgr2=0x55d911b25ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b25ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 -- 172.21.15.35:0/1205732520 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d911a44130 con 0x55d911b2b960 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa9437fe700 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b27770 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fa93400bfd0 tx=0x7fa934094390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b803197ccaad97 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.383+0000 7fa93a7fc700 1 -- 172.21.15.35:0/1205732520 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340962c0 con 0x55d911b2b960 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa93a7fc700 1 -- 172.21.15.35:0/1205732520 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9340b0170 con 0x55d911b2b960 2023-03-17T11:17:19.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa93a7fc700 1 -- 172.21.15.35:0/1205732520 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934097670 con 0x55d911b2b960 2023-03-17T11:17:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 -- 172.21.15.35:0/1205732520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 msgr2=0x55d911b27770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b27770 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fa93400bfd0 tx=0x7fa934094390 comp rx=0 tx=0).stop 2023-03-17T11:17:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 -- 172.21.15.35:0/1205732520 shutdown_connections 2023-03-17T11:17:20.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b36f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b27770 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 --2- 172.21.15.35:0/1205732520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b25ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 -- 172.21.15.35:0/1205732520 >> 172.21.15.35:0/1205732520 conn(0x55d9119886b0 msgr2=0x55d911b41300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 -- 172.21.15.35:0/1205732520 shutdown_connections 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 -- 172.21.15.35:0/1205732520 wait complete. 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.384+0000 7fa95603cb80 1 -- start start 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 Processor -- start 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b39e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b3a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b91b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b92040 con 0x55d911b2b960 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b92180 con 0x55d911b30be0 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d911b92340 con 0x55d911b314f0 2023-03-17T11:17:20.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa95603cb80 10 client.0 _ll_register_callbacks cb 0x55d911923230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:17:20.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:18 smithi035 ceph-mon[92535]: pgmap v4650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:17:21.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:18 smithi035 ceph-mon[92535]: osdmap e361: 12 total, 12 up, 12 in 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b39e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b39e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54526/0 (socket says 172.21.15.35:54526) 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 -- 172.21.15.35:0/2960214997 learned_addr learned my addr 172.21.15.35:0/2960214997 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa943fff700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b91b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa942ffd700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b3a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 -- 172.21.15.35:0/2960214997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 msgr2=0x55d911b91b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b91b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 -- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 msgr2=0x55d911b3a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b3a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.385+0000 7fa9437fe700 1 -- 172.21.15.35:0/2960214997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94410ee30 con 0x55d911b2b960 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa9437fe700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b39e90 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fa934094990 tx=0x7fa9340108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38014ad6d9ac63e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa922ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa922ffd700 1 -- 172.21.15.35:0/2960214997 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934097610 con 0x55d911b2b960 2023-03-17T11:17:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa922ffd700 1 -- 172.21.15.35:0/2960214997 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(337..337 src has 1..337) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa934098180 con 0x55d911b2b960 2023-03-17T11:17:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d911afb1e0 con 0x55d911b2b960 2023-03-17T11:17:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa922ffd700 1 -- 172.21.15.35:0/2960214997 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa934098340 con 0x55d911b2b960 2023-03-17T11:17:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 10 client.20463 fetch_fsmap learned FSMap version 102 2023-03-17T11:17:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55d9118d21f0 con 0x55d911b2b960 2023-03-17T11:17:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa922ffd700 1 -- 172.21.15.35:0/2960214997 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d911afb1e0 con 0x55d911b2b960 2023-03-17T11:17:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa922ffd700 1 -- 172.21.15.35:0/2960214997 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa934093d10 con 0x55d911b2b960 2023-03-17T11:17:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 10 client.20463 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 10 client.20463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 20 client.20463 populate_metadata read hostname 'smithi035' 2023-03-17T11:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b99650 0x55d911b9ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 4 client.20463 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:17:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.386+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d911901f00 con 0x55d911b99650 2023-03-17T11:17:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.387+0000 7fa942ffd700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b99650 0x55d911b9ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.387+0000 7fa922ffd700 10 client.20463 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.387+0000 7fa942ffd700 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b99650 0x55d911b9ba60 crc :-1 s=READY pgs=634 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a288753e4f7351d4 server_cookie=411977a7599854a5 in_seq=0 out_seq=0 2023-03-17T11:17:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa922ffd700 1 -- 172.21.15.35:0/2960214997 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d911901f00 con 0x55d911b99650 2023-03-17T11:17:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa922ffd700 10 client.20463 handle_command_reply: tid=0 2023-03-17T11:17:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 client.20463 shutdown 2023-03-17T11:17:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 msgr2=0x55d911b39e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b39e90 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fa934094990 tx=0x7fa9340108d0 comp rx=0 tx=0).stop 2023-03-17T11:17:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 shutdown_connections 2023-03-17T11:17:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d911b99650 0x55d911b9ba60 crc :-1 s=READY pgs=634 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d911b314f0 0x55d911b91b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa922ffd700 0 client.20463 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d911b2b960 0x55d911b39e90 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 --2- 172.21.15.35:0/2960214997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d911b30be0 0x55d911b3a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 >> 172.21.15.35:0/2960214997 conn(0x55d9119886b0 msgr2=0x55d911b2a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:27.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 shutdown_connections 2023-03-17T11:17:27.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 1 -- 172.21.15.35:0/2960214997 wait complete. 2023-03-17T11:17:27.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.404+0000 7fa95603cb80 20 client.20463 trim_cache size 0 max 16384 2023-03-17T11:17:27.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa93009f640 msgr2=0x7fa9300a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:27.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa93009f640 0x7fa9300a1af0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa9441978c0 tx=0x7fa92c000bc0 comp rx=0 tx=0).stop 2023-03-17T11:17:27.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 msgr2=0x7fa9441962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:28.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 0x7fa9441962b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa93400d950 tx=0x7fa93400dc60 comp rx=0 tx=0).stop 2023-03-17T11:17:28.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 shutdown_connections 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa93009f640 0x7fa9300a1af0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa944104390 0x7fa94419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa9440ff350 0x7fa9441962b0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 --2- 172.21.15.35:0/743687148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9440ffcf0 0x7fa9441967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 >> 172.21.15.35:0/743687148 conn(0x7fa944076330 msgr2=0x7fa9440680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 shutdown_connections 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:21.405+0000 7fa949eaf700 1 -- 172.21.15.35:0/743687148 wait complete. 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2514256734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 msgr2=0x7fbe0c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2514256734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c0ff720 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0099c0 tx=0x7fbdfc009cd0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2514256734 shutdown_connections 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2514256734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c104390 0x7fbe0c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2514256734 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c0ff720 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2514256734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2514256734 >> 172.21.15.35:0/2514256734 conn(0x7fbe0c076330 msgr2=0x7fbe0c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2514256734 shutdown_connections 2023-03-17T11:17:28.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.527+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2514256734 wait complete. 2023-03-17T11:17:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 Processor -- start 2023-03-17T11:17:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 -- start start 2023-03-17T11:17:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:28.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c104390 0x7fbe0c1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c101ac0 con 0x7fbe0c0ff350 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1a4970 con 0x7fbe0c0ffcf0 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe10eb3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1a4ab0 con 0x7fbe0c104390 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54540/0 (socket says 172.21.15.35:54540) 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 -- 172.21.15.35:0/2236539847 learned_addr learned my addr 172.21.15.35:0/2236539847 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0ad9d700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c104390 0x7fbe0c1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 -- 172.21.15.35:0/2236539847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c104390 msgr2=0x7fbe0c1a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c104390 0x7fbe0c1a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 -- 172.21.15.35:0/2236539847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 msgr2=0x7fbe0c101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.528+0000 7fbe0a59c700 1 -- 172.21.15.35:0/2236539847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0095f0 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbe0ad9d700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c104390 0x7fbe0c1a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c100d50 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc005910 tx=0x7fbdfc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/2236539847 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc01d070 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/2236539847 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdfc0054e0 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c10f000 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/2236539847 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc004ab0 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.529+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c10ee70 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.531+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/2236539847 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbdfc00fb80 con 0x7fbe0c0ff350 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.532+0000 7fbdfb7fe700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf409f640 0x7fbdf40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.532+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/2236539847 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(337..337 src has 1..337) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbdfc0cb4b0 con 0x7fbe0c0ff350 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.532+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf409f640 0x7fbdf40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.532+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf409f640 0x7fbdf40a1af0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c102540 tx=0x7fbe000073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 Processor -- start 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 -- start start 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04457fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 0x561c04452420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:32.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c04452d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c04359010 con 0x561c044584f0 2023-03-17T11:17:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c043ab950 con 0x561c04457be0 2023-03-17T11:17:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c043a4de0 con 0x561c04452960 2023-03-17T11:17:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe09d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 0x561c04452420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe09d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 0x561c04452420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54550/0 (socket says 172.21.15.35:54550) 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3829919639 learned_addr learned my addr 172.21.15.35:0/3829919639 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.533+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04457fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3829919639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 msgr2=0x561c04452d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c04452d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3829919639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 msgr2=0x561c04457fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04457fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3829919639 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c042265d0 con 0x561c044584f0 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04457fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 0x561c04452420 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fbe000044f0 tx=0x7fbe00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6444f97847c4008 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3829919639 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00003680 con 0x561c044584f0 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3829919639 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe00003c70 con 0x561c044584f0 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3829919639 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00011ba0 con 0x561c044584f0 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3829919639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 msgr2=0x561c04452420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 0x561c04452420 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fbe000044f0 tx=0x7fbe00013000 comp rx=0 tx=0).stop 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3829919639 shutdown_connections 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c04452d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:32.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04457fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3829919639 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c044584f0 0x561c04452420 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:32.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3829919639 >> 172.21.15.35:0/3829919639 conn(0x561c042af6b0 msgr2=0x561c0444ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3829919639 shutdown_connections 2023-03-17T11:17:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3829919639 wait complete. 2023-03-17T11:17:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 -- start start 2023-03-17T11:17:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 Processor -- start 2023-03-17T11:17:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.535+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c0445e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04457be0 0x561c0445b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c042288c0 con 0x561c04452960 2023-03-17T11:17:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0445c5f0 con 0x561c044584f0 2023-03-17T11:17:33.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c04465c50 con 0x561c04457be0 2023-03-17T11:17:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 10 client.0 _ll_register_callbacks cb 0x561c0424a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:17:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c0445e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c0445e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54554/0 (socket says 172.21.15.35:54554) 2023-03-17T11:17:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 -- 172.21.15.35:0/3689366583 learned_addr learned my addr 172.21.15.35:0/3689366583 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04457be0 0x561c0445b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 -- 172.21.15.35:0/3689366583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04457be0 msgr2=0x561c0445b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04457be0 0x561c0445b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 -- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 msgr2=0x561c0445beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 -- 172.21.15.35:0/3689366583 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe000041a0 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c0445e4f0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc098f80 tx=0x7fbdfc0990a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659f6e01f5628310 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbdf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/3689366583 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc099460 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/3689366583 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(337..337 src has 1..337) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbdfc0b1120 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c04367390 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/3689366583 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdfc0b12e0 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 10 client.20475 fetch_fsmap learned FSMap version 102 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.536+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x561c041d2d80 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/3689366583 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdfc0b5080 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/3689366583 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbdfc0b6d60 con 0x561c04452960 2023-03-17T11:17:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe1d040b80 10 client.20475 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:17:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe1d040b80 10 client.20475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:17:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe1d040b80 20 client.20475 populate_metadata read hostname 'smithi035' 2023-03-17T11:17:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c0446bf80 0x561c0446e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe1d040b80 4 client.20475 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:17:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c04373600 con 0x561c0446bf80 2023-03-17T11:17:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.537+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c0446bf80 0x561c0446e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:38.987 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:20 smithi035 ceph-mon[92535]: pgmap v4652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 967 B/s wr, 11 op/s 2023-03-17T11:17:38.987 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:22 smithi035 ceph-mon[92535]: pgmap v4653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:17:38.987 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:24 smithi035 ceph-mon[92535]: pgmap v4654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:26 smithi035 ceph-mon[92535]: pgmap v4655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:28 smithi035 ceph-mon[92535]: pgmap v4656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:30 smithi035 ceph-mon[92535]: pgmap v4657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:32 smithi035 ceph-mon[92535]: pgmap v4658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:34 smithi035 ceph-mon[92535]: pgmap v4659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:36 smithi035 ceph-mon[92535]: pgmap v4660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:38 smithi035 ceph-mon[92535]: pgmap v4661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:40 smithi035 ceph-mon[92535]: pgmap v4662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:42 smithi035 ceph-mon[92535]: pgmap v4663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:44 smithi035 ceph-mon[92535]: pgmap v4664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:46 smithi035 ceph-mon[92535]: pgmap v4665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:48 smithi035 ceph-mon[92535]: pgmap v4666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:50 smithi035 ceph-mon[92535]: pgmap v4667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:52 smithi035 ceph-mon[92535]: pgmap v4668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:54 smithi035 ceph-mon[92535]: pgmap v4669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:56 smithi035 ceph-mon[92535]: pgmap v4670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:38.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:58 smithi035 ceph-mon[92535]: pgmap v4671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:07:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:00 smithi035 ceph-mon[92535]: pgmap v4672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:00 smithi035 ceph-mon[92535]: pgmap v4673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:00 smithi035 ceph-mon[92535]: pgmap v4674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:17:38.989 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:02 smithi035 ceph-mon[92535]: pgmap v4675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:04 smithi035 ceph-mon[92535]: pgmap v4676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:06 smithi035 ceph-mon[92535]: pgmap v4677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:08 smithi035 ceph-mon[92535]: pgmap v4678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:10 smithi035 ceph-mon[92535]: osdmap e362: 12 total, 12 up, 12 in 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:10 smithi035 ceph-mon[92535]: pgmap v4680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:12 smithi035 ceph-mon[92535]: pgmap v4681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:14 smithi035 ceph-mon[92535]: pgmap v4682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:17:40.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:16 smithi035 ceph-mon[92535]: pgmap v4683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:17:41.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:18 smithi035 ceph-mon[92535]: osdmap e363: 12 total, 12 up, 12 in 2023-03-17T11:17:41.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:18 smithi035 ceph-mon[92535]: pgmap v4685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-17T11:17:41.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:20 smithi035 ceph-mon[92535]: pgmap v4686: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:17:41.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:22 smithi035 ceph-mon[92535]: pgmap v4687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:17:41.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:24 smithi035 ceph-mon[92535]: pgmap v4688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:17:41.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:26 smithi035 ceph-mon[92535]: pgmap v4689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:17:42.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:28 smithi035 ceph-mon[92535]: pgmap v4690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T11:17:43.472 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:30 smithi035 ceph-mon[92535]: pgmap v4691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbdf1ffb700 10 client.20475 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c0446bf80 0x561c0446e360 crc :-1 s=READY pgs=635 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2e46afe98ed92f server_cookie=e5fb7e4aac565f13 in_seq=0 out_seq=0 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/3689366583 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561c04373600 con 0x561c0446bf80 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbdf1ffb700 10 client.20475 handle_command_reply: tid=0 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 client.20475 shutdown 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 msgr2=0x561c0445e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c0445e4f0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc098f80 tx=0x7fbdfc0990a0 comp rx=0 tx=0).stop 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 shutdown_connections 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c0446bf80 0x561c0446e360 crc :-1 s=READY pgs=635 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c0445e4f0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3689366583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04457be0 0x561c0445b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbdf1ffb700 0 client.20475 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 >> 172.21.15.35:0/3689366583 conn(0x561c042af6b0 msgr2=0x561c04451410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 shutdown_connections 2023-03-17T11:17:43.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.538+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3689366583 wait complete. 2023-03-17T11:17:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.539+0000 7fbe1d040b80 20 client.20475 trim_cache size 0 max 16384 2023-03-17T11:17:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 Processor -- start 2023-03-17T11:17:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 -- start start 2023-03-17T11:17:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c0444cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 0x561c04462c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0444e570 con 0x561c04457be0 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c04449b60 con 0x561c044584f0 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c04465ac0 con 0x561c04452960 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe09d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 0x561c04462c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe09d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 0x561c04462c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54564/0 (socket says 172.21.15.35:54564) 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.553+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3213309548 learned_addr learned my addr 172.21.15.35:0/3213309548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe0ad9d700 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c0444cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3213309548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 msgr2=0x561c0444cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c0444cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3213309548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 msgr2=0x561c0445e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:46.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe09d9b700 1 -- 172.21.15.35:0/3213309548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c04453000 con 0x561c04457be0 2023-03-17T11:17:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c0444cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 0x561c04462c30 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fbe00010c20 tx=0x7fbe00007460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aaac2ba7732c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbdf97fa700 1 -- 172.21.15.35:0/3213309548 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00003680 con 0x561c04457be0 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbdf97fa700 1 -- 172.21.15.35:0/3213309548 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe000b9070 con 0x561c04457be0 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.554+0000 7fbdf97fa700 1 -- 172.21.15.35:0/3213309548 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00011b60 con 0x561c04457be0 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3213309548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 msgr2=0x561c04462c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 0x561c04462c30 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fbe00010c20 tx=0x7fbe00007460 comp rx=0 tx=0).stop 2023-03-17T11:17:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3213309548 shutdown_connections 2023-03-17T11:17:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c044584f0 0x561c0445e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c04452960 0x561c0444cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/3213309548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04457be0 0x561c04462c30 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3213309548 >> 172.21.15.35:0/3213309548 conn(0x561c042af6b0 msgr2=0x561c044653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3213309548 shutdown_connections 2023-03-17T11:17:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- 172.21.15.35:0/3213309548 wait complete. 2023-03-17T11:17:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- start start 2023-03-17T11:17:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 Processor -- start 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c04462a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04460df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c044584f0 0x561c04461330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c04461870 con 0x561c04452960 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c044619e0 con 0x561c04457be0 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c04461ba0 con 0x561c044584f0 2023-03-17T11:17:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.555+0000 7fbe1d040b80 10 client.0 _ll_register_callbacks cb 0x561c0424a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:17:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c04462a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c04462a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54568/0 (socket says 172.21.15.35:54568) 2023-03-17T11:17:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 -- 172.21.15.35:0/85210731 learned_addr learned my addr 172.21.15.35:0/85210731 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:17:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04460df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:53.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0ad9d700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c044584f0 0x561c04461330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 -- 172.21.15.35:0/85210731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c044584f0 msgr2=0x561c04461330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c044584f0 0x561c04461330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 -- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 msgr2=0x561c04460df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04460df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 -- 172.21.15.35:0/85210731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c042265d0 con 0x561c04452960 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe0a59c700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c04462a90 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0954f0 tx=0x7fbdfc0953b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109919c0246f042d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbdf1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/85210731 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc099460 con 0x561c04452960 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/85210731 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(337..337 src has 1..337) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbdfc0984e0 con 0x561c04452960 2023-03-17T11:17:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c044221e0 con 0x561c04452960 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/85210731 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdfc0986a0 con 0x561c04452960 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe1d040b80 10 client.20481 fetch_fsmap learned FSMap version 102 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.556+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x561c0436b130 con 0x561c04452960 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/85210731 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c044221e0 con 0x561c04452960 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/85210731 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbdfc099ef0 con 0x561c04452960 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe1d040b80 10 client.20481 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe1d040b80 10 client.20481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe1d040b80 20 client.20481 populate_metadata read hostname 'smithi035' 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c044c0b90 0x561c044c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe1d040b80 4 client.20481 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:17:56.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c04228f00 con 0x561c044c0b90 2023-03-17T11:17:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c044c0b90 0x561c044c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:17:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbdf1ffb700 10 client.20481 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.557+0000 7fbe09d9b700 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c044c0b90 0x561c044c2f70 crc :-1 s=READY pgs=636 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d2c7e7c3396a511 server_cookie=e40274a4aa69a111 in_seq=0 out_seq=0 2023-03-17T11:17:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.569+0000 7fbdf1ffb700 1 -- 172.21.15.35:0/85210731 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c04228f00 con 0x561c044c0b90 2023-03-17T11:17:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.569+0000 7fbdf1ffb700 10 client.20481 handle_command_reply: tid=0 2023-03-17T11:17:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.569+0000 7fbe1d040b80 1 client.20481 shutdown 2023-03-17T11:17:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 msgr2=0x561c04462a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c04462a90 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0954f0 tx=0x7fbdfc0953b0 comp rx=0 tx=0).stop 2023-03-17T11:17:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 shutdown_connections 2023-03-17T11:17:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c044c0b90 0x561c044c2f70 crc :-1 s=READY pgs=636 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c044584f0 0x561c04461330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbdf1ffb700 0 client.20481 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c04452960 0x561c04462a90 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 --2- 172.21.15.35:0/85210731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c04457be0 0x561c04460df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 >> 172.21.15.35:0/85210731 conn(0x561c042af6b0 msgr2=0x561c044556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 shutdown_connections 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 1 -- 172.21.15.35:0/85210731 wait complete. 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe1d040b80 20 client.20481 trim_cache size 0 max 16384 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf409f640 msgr2=0x7fbdf40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf409f640 0x7fbdf40a1af0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c102540 tx=0x7fbe000073d0 comp rx=0 tx=0).stop 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 msgr2=0x7fbe0c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:17:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c100d50 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc005910 tx=0x7fbdfc00f690 comp rx=0 tx=0).stop 2023-03-17T11:18:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 shutdown_connections 2023-03-17T11:18:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdf409f640 0x7fbdf40a1af0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe0c104390 0x7fbe0c1a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe0c0ff350 0x7fbe0c100d50 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.570+0000 7fbe10eb3700 1 --2- 172.21.15.35:0/2236539847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe0c0ffcf0 0x7fbe0c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.571+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 >> 172.21.15.35:0/2236539847 conn(0x7fbe0c076330 msgr2=0x7fbe0c0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.571+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 shutdown_connections 2023-03-17T11:18:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:54:34.571+0000 7fbe10eb3700 1 -- 172.21.15.35:0/2236539847 wait complete. 2023-03-17T11:18:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 -- 172.21.15.35:0/1318767475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc0ffcf0 msgr2=0x7f88dc103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/1318767475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc103cb0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f88c40099c0 tx=0x7f88c4009cd0 comp rx=0 tx=0).stop 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 -- 172.21.15.35:0/1318767475 shutdown_connections 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/1318767475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88dc104390 0x7f88dc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/1318767475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ff350 0x7f88dc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/1318767475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc103cb0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 -- 172.21.15.35:0/1318767475 >> 172.21.15.35:0/1318767475 conn(0x7f88dc076330 msgr2=0x7f88dc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 -- 172.21.15.35:0/1318767475 shutdown_connections 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.073+0000 7f88e0bdc700 1 -- 172.21.15.35:0/1318767475 wait complete. 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 Processor -- start 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 -- start start 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88dc0ff350 0x7f88dc196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc1967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 0x7f88dc19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc19b260 con 0x7f88dc104390 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc19b3d0 con 0x7f88dc0ff350 2023-03-17T11:18:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88e0bdc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc19b590 con 0x7f88dc0ffcf0 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 0x7f88dc19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 0x7f88dc19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54584/0 (socket says 172.21.15.35:54584) 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 -- 172.21.15.35:0/2725652638 learned_addr learned my addr 172.21.15.35:0/2725652638 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88da59c700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88dc0ff350 0x7f88dc196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc1967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 -- 172.21.15.35:0/2725652638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ffcf0 msgr2=0x7f88dc1967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc1967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 -- 172.21.15.35:0/2725652638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88dc0ff350 msgr2=0x7f88dc196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.074+0000 7f88dad9d700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88dc0ff350 0x7f88dc196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88dad9d700 1 -- 172.21.15.35:0/2725652638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40095f0 con 0x7f88dc104390 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc1967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88dad9d700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 0x7f88dc19ac20 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f88d4007ee0 tx=0x7f88d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88d37fe700 1 -- 172.21.15.35:0/2725652638 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4017070 con 0x7f88dc104390 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88d37fe700 1 -- 172.21.15.35:0/2725652638 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88d400f040 con 0x7f88dc104390 2023-03-17T11:18:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc110110 con 0x7f88dc104390 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88d37fe700 1 -- 172.21.15.35:0/2725652638 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4005710 con 0x7f88dc104390 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.075+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc10ff80 con 0x7f88dc104390 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.077+0000 7f88d37fe700 1 -- 172.21.15.35:0/2725652638 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f88d4005870 con 0x7f88dc104390 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.078+0000 7f88d37fe700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f88c809f640 0x7f88c80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.078+0000 7f88da59c700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f88c809f640 0x7f88c80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.078+0000 7f88d37fe700 1 -- 172.21.15.35:0/2725652638 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88d40c9e60 con 0x7f88dc104390 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.078+0000 7f88da59c700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f88c809f640 0x7f88c80a1af0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f88cc005fd0 tx=0x7f88cc005f60 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 Processor -- start 2023-03-17T11:18:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 -- start start 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c37b5010 con 0x55c6c38b3be0 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c3807950 con 0x55c6c38b44f0 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c3800de0 con 0x55c6c38ae960 2023-03-17T11:18:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88da59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88da59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54588/0 (socket says 172.21.15.35:54588) 2023-03-17T11:18:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88da59c700 1 -- 172.21.15.35:0/2620156703 learned_addr learned my addr 172.21.15.35:0/2620156703 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:04.783 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T11:18:04.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 -- 172.21.15.35:0/1654019848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f00ff400 msgr2=0x7ff9f00ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1654019848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f00ff400 0x7ff9f00ff7d0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00099c0 tx=0x7ff9e0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 -- 172.21.15.35:0/1654019848 shutdown_connections 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1654019848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9f0104440 0x7ff9f010c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1654019848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f00ff400 0x7ff9f00ff7d0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1654019848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f00ffda0 0x7ff9f0103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 -- 172.21.15.35:0/1654019848 >> 172.21.15.35:0/1654019848 conn(0x7ff9f0076030 msgr2=0x7ff9f0076430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 -- 172.21.15.35:0/1654019848 shutdown_connections 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.083+0000 7ff9f6320700 1 -- 172.21.15.35:0/1654019848 wait complete. 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 Processor -- start 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 -- start start 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f00ff400 0x7ff9f0100e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9f00ffda0 0x7ff9f0101340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 0x7ff9f01a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f0101b70 con 0x7ff9f0104440 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f01a49c0 con 0x7ff9f00ffda0 2023-03-17T11:18:04.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f6320700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f01a4b00 con 0x7ff9f00ff400 2023-03-17T11:18:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f48bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 0x7ff9f01a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:04.785 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f48bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 0x7ff9f01a4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55674/0 (socket says 172.21.15.35:55674) 2023-03-17T11:18:05.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f48bd700 1 -- 172.21.15.35:0/1259596604 learned_addr learned my addr 172.21.15.35:0/1259596604 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:05.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9effff700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f00ff400 0x7ff9f0100e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9f00ffda0 0x7ff9f0101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f48bd700 1 -- 172.21.15.35:0/1259596604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f00ff400 msgr2=0x7ff9f0100e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f00ff400 0x7ff9f0100e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.084+0000 7ff9f48bd700 1 -- 172.21.15.35:0/1259596604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9f00ffda0 msgr2=0x7ff9f0101340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9f00ffda0 0x7ff9f0101340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9f48bd700 1 -- 172.21.15.35:0/1259596604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00095f0 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 0x7ff9f01a4480 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8007ee0 tx=0x7ff9e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9ed7fa700 1 -- 172.21.15.35:0/1259596604 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8017070 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9ed7fa700 1 -- 172.21.15.35:0/1259596604 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9e800f040 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f010f100 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9ed7fa700 1 -- 172.21.15.35:0/1259596604 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8005710 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.085+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f010ef70 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.088+0000 7ff9ed7fa700 1 -- 172.21.15.35:0/1259596604 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff9e8005870 con 0x7ff9f0104440 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.088+0000 7ff9ed7fa700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9d809f640 0x7ff9d80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:05.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.088+0000 7ff9ed7fa700 1 -- 172.21.15.35:0/1259596604 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(361..361 src has 1..361) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9e80c9db0 con 0x7ff9f0104440 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.088+0000 7ff9effff700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9d809f640 0x7ff9d80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ff9effff700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9d809f640 0x7ff9d80a1af0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006010 tx=0x7ff9e0005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 Processor -- start 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 -- start start 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be87d0 0x556257be8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257beda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257aef070 con 0x556257bed630 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257b419b0 con 0x556257be90e0 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ffa024adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257b3ae40 con 0x556257be87d0 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ff9f48bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257beda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ff9f48bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257beda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55682/0 (socket says 172.21.15.35:55682) 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2798079059 learned_addr learned my addr 172.21.15.35:0/2798079059 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:05.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:05.412 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.089+0000 7ff9effff700 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be87d0 0x556257be8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2798079059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be87d0 msgr2=0x556257be8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be87d0 0x556257be8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2798079059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 msgr2=0x556257bed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2798079059 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562579bc630 con 0x556257bed630 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257beda80 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80977f0 tx=0x7ff9e8097420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf40dfa17b6fe2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9d67fc700 1 -- 172.21.15.35:0/2798079059 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e809fa50 con 0x556257bed630 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9d67fc700 1 -- 172.21.15.35:0/2798079059 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9e80c77c0 con 0x556257bed630 2023-03-17T11:18:06.646 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ff9d67fc700 1 -- 172.21.15.35:0/2798079059 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8097d00 con 0x556257bed630 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ffa024adb80 1 -- 172.21.15.35:0/2798079059 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 msgr2=0x556257beda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.090+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257beda80 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80977f0 tx=0x7ff9e8097420 comp rx=0 tx=0).stop 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- 172.21.15.35:0/2798079059 shutdown_connections 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257beda80 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be87d0 0x556257be8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2798079059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- 172.21.15.35:0/2798079059 >> 172.21.15.35:0/2798079059 conn(0x556257be3030 msgr2=0x556257be3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- 172.21.15.35:0/2798079059 shutdown_connections 2023-03-17T11:18:08.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- 172.21.15.35:0/2798079059 wait complete. 2023-03-17T11:18:11.431 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- start start 2023-03-17T11:18:14.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 Processor -- start 2023-03-17T11:18:14.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be87d0 0x556257bf4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:14.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257bf2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:14.331 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257bf27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:15.181 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562579be920 con 0x556257bed630 2023-03-17T11:18:16.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257bf2f30 con 0x556257be87d0 2023-03-17T11:18:16.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.091+0000 7ffa024adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257bfe8b0 con 0x556257be90e0 2023-03-17T11:18:16.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ffa024adb80 10 client.0 _ll_register_callbacks cb 0x5562579e0290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:18:16.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257bf27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:16.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257bf27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55688/0 (socket says 172.21.15.35:55688) 2023-03-17T11:18:17.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2844118502 learned_addr learned my addr 172.21.15.35:0/2844118502 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:17.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9effff700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be87d0 0x556257bf4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:17.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257bf2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:17.485 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2844118502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 msgr2=0x556257bf2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:17.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257bf2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:17.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be87d0 msgr2=0x556257bf4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:17.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be87d0 0x556257bf4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:17.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 -- 172.21.15.35:0/2844118502 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f010ef70 con 0x556257bed630 2023-03-17T11:18:17.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257bf27c0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009460 tx=0x7ff9e80941a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6d2125f982b8e1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:18:21.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/2844118502 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80c5070 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/2844118502 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(361..361 src has 1..361) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9e8095c00 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556257afd3f0 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/2844118502 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e80c72b0 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.092+0000 7ffa024adb80 10 client.20925 fetch_fsmap learned FSMap version 108 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x556257968de0 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/2844118502 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9e80b5030 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/2844118502 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff9e809f5c0 con 0x556257bed630 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 10 client.20925 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 10 client.20925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 20 client.20925 populate_metadata read hostname 'smithi035' 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c02670 0x556257c04a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:23.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 4 client.20925 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556257b09660 con 0x556257c02670 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.093+0000 7ff9effff700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c02670 0x556257c04a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ff9cf7fe700 10 client.20925 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ff9effff700 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c02670 0x556257c04a80 crc :-1 s=READY pgs=689 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=786200ccf2bee5fc server_cookie=979504d1128cbe71 in_seq=0 out_seq=0 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/2844118502 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556257b09660 con 0x556257c02670 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ff9cf7fe700 10 client.20925 handle_command_reply: tid=0 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 client.20925 shutdown 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 msgr2=0x556257bf27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257bf27c0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009460 tx=0x7ff9e80941a0 comp rx=0 tx=0).stop 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 shutdown_connections 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c02670 0x556257c04a80 crc :-1 s=READY pgs=689 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:23.747 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257bed630 0x556257bf27c0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:23.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be87d0 0x556257bf4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:23.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2844118502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257bf2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:23.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.094+0000 7ff9cf7fe700 0 client.20925 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:18:23.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.095+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 >> 172.21.15.35:0/2844118502 conn(0x556257be3030 msgr2=0x556257be2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:24.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.095+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 shutdown_connections 2023-03-17T11:18:24.937 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.095+0000 7ffa024adb80 1 -- 172.21.15.35:0/2844118502 wait complete. 2023-03-17T11:18:25.474 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.095+0000 7ffa024adb80 20 client.20925 trim_cache size 0 max 16384 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 Processor -- start 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 -- start start 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257beb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257bed630 0x556257bebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257be9700 con 0x556257be87d0 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257be4260 con 0x556257bed630 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ffa024adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257be22f0 con 0x556257be90e0 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55692/0 (socket says 172.21.15.35:55692) 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 -- 172.21.15.35:0/2093539084 learned_addr learned my addr 172.21.15.35:0/2093539084 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257bed630 0x556257bebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257beb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:26.404 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 -- 172.21.15.35:0/2093539084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 msgr2=0x556257beb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257beb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 -- 172.21.15.35:0/2093539084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257bed630 msgr2=0x556257bebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257bed630 0x556257bebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 -- 172.21.15.35:0/2093539084 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556257b01190 con 0x556257be87d0 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257bed630 0x556257bebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.108+0000 7ff9effff700 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf97d0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009fd0 tx=0x7ff9e0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639adaa508a7511c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ff9d6ffd700 1 -- 172.21.15.35:0/2093539084 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0029040 con 0x556257be87d0 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ff9d6ffd700 1 -- 172.21.15.35:0/2093539084 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9e002a040 con 0x556257be87d0 2023-03-17T11:18:27.046 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ff9d6ffd700 1 -- 172.21.15.35:0/2093539084 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0003e00 con 0x556257be87d0 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 -- 172.21.15.35:0/2093539084 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 msgr2=0x556257bf97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf97d0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009fd0 tx=0x7ff9e0021000 comp rx=0 tx=0).stop 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 -- 172.21.15.35:0/2093539084 shutdown_connections 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257bed630 0x556257bebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf97d0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 --2- 172.21.15.35:0/2093539084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257be90e0 0x556257beb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 -- 172.21.15.35:0/2093539084 >> 172.21.15.35:0/2093539084 conn(0x556257be3030 msgr2=0x556257bfdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 -- 172.21.15.35:0/2093539084 shutdown_connections 2023-03-17T11:18:27.047 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.109+0000 7ffa024adb80 1 -- 172.21.15.35:0/2093539084 wait complete. 2023-03-17T11:18:27.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 -- start start 2023-03-17T11:18:27.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 Processor -- start 2023-03-17T11:18:27.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:27.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bf7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:28.411 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257bed630 0x556257bf81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:31.371 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257bf8850 con 0x556257be87d0 2023-03-17T11:18:31.372 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:32 smithi035 ceph-mon[92535]: pgmap v4692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:18:31.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.079+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88dad9d700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88da59c700 1 -- 172.21.15.35:0/2620156703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 msgr2=0x55c6c38aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88da59c700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88da59c700 1 -- 172.21.15.35:0/2620156703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 msgr2=0x55c6c38ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:33.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88da59c700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88da59c700 1 -- 172.21.15.35:0/2620156703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6c36825d0 con 0x55c6c38b3be0 2023-03-17T11:18:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:18:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88dad9d700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:18:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88da59c700 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b3fb0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00fc90 tx=0x7f88cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4d6a2957b6a860 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88d0ff9700 1 -- 172.21.15.35:0/2620156703 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc011b80 con 0x55c6c38b3be0 2023-03-17T11:18:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88d0ff9700 1 -- 172.21.15.35:0/2620156703 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88cc011ce0 con 0x55c6c38b3be0 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.080+0000 7f88d0ff9700 1 -- 172.21.15.35:0/2620156703 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc01d610 con 0x55c6c38b3be0 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 -- 172.21.15.35:0/2620156703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 msgr2=0x55c6c38b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b3fb0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00fc90 tx=0x7f88cc012000 comp rx=0 tx=0).stop 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 -- 172.21.15.35:0/2620156703 shutdown_connections 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b3fb0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:34.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/2620156703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 -- 172.21.15.35:0/2620156703 >> 172.21.15.35:0/2620156703 conn(0x55c6c370b6b0 msgr2=0x55c6c38a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 -- 172.21.15.35:0/2620156703 shutdown_connections 2023-03-17T11:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 -- 172.21.15.35:0/2620156703 wait complete. 2023-03-17T11:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 -- start start 2023-03-17T11:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.081+0000 7f88ecd69b80 1 Processor -- start 2023-03-17T11:18:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38ba460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c36848c0 con 0x55c6c38b3be0 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c38b8500 con 0x55c6c38b44f0 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c38c4000 con 0x55c6c38ae960 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88ecd69b80 10 client.0 _ll_register_callbacks cb 0x55c6c36a6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54596/0 (socket says 172.21.15.35:54596) 2023-03-17T11:18:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 -- 172.21.15.35:0/3183759898 learned_addr learned my addr 172.21.15.35:0/3183759898 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88da59c700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38ba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88dad9d700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 -- 172.21.15.35:0/3183759898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 msgr2=0x55c6c38ba460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38ba460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 -- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 msgr2=0x55c6c38b7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38b7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 -- 172.21.15.35:0/3183759898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc00f970 con 0x55c6c38b3be0 2023-03-17T11:18:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88dad9d700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b7750 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f88c40036c0 tx=0x7f88c4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80df7a111c124ba6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.082+0000 7f88c1ffb700 1 -- 172.21.15.35:0/3183759898 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400bba0 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88c1ffb700 1 -- 172.21.15.35:0/3183759898 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88c400bd00 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6c37c3390 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88c1ffb700 1 -- 172.21.15.35:0/3183759898 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88c400bee0 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 10 client.20493 fetch_fsmap learned FSMap version 102 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55c6c362ed80 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88c1ffb700 1 -- 172.21.15.35:0/3183759898 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88c4031020 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88c1ffb700 1 -- 172.21.15.35:0/3183759898 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f88c4003a20 con 0x55c6c38b3be0 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 10 client.20493 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:18:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 10 client.20493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:18:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 20 client.20493 populate_metadata read hostname 'smithi035' 2023-03-17T11:18:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c38c7fc0 0x55c6c38ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 4 client.20493 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:18:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6c37cf600 con 0x55c6c38c7fc0 2023-03-17T11:18:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.083+0000 7f88da59c700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c38c7fc0 0x55c6c38ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.084+0000 7f88c1ffb700 10 client.20493 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:18:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.084+0000 7f88da59c700 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c38c7fc0 0x55c6c38ca3d0 crc :-1 s=READY pgs=637 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=562a82d8293ffb11 server_cookie=c0a8a21cfbb6c7d8 in_seq=0 out_seq=0 2023-03-17T11:18:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.084+0000 7f88c1ffb700 1 -- 172.21.15.35:0/3183759898 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c6c37cf600 con 0x55c6c38c7fc0 2023-03-17T11:18:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.084+0000 7f88c1ffb700 10 client.20493 handle_command_reply: tid=0 2023-03-17T11:18:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 client.20493 shutdown 2023-03-17T11:18:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 msgr2=0x55c6c38b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b7750 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f88c40036c0 tx=0x7f88c4005e80 comp rx=0 tx=0).stop 2023-03-17T11:18:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 shutdown_connections 2023-03-17T11:18:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c38c7fc0 0x55c6c38ca3d0 crc :-1 s=READY pgs=637 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38ba460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88c1ffb700 0 client.20493 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/3183759898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38b7750 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 >> 172.21.15.35:0/3183759898 conn(0x55c6c370b6b0 msgr2=0x55c6c38ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 shutdown_connections 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 1 -- 172.21.15.35:0/3183759898 wait complete. 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.085+0000 7f88ecd69b80 20 client.20493 trim_cache size 0 max 16384 2023-03-17T11:18:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 Processor -- start 2023-03-17T11:18:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 -- start start 2023-03-17T11:18:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c38a55c0 con 0x55c6c38b3be0 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c38adb20 con 0x55c6c38b44f0 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c38a9cc0 con 0x55c6c38ae960 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54604/0 (socket says 172.21.15.35:54604) 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88d9d9b700 1 -- 172.21.15.35:0/447229748 learned_addr learned my addr 172.21.15.35:0/447229748 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.100+0000 7f88dad9d700 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d9d9b700 1 -- 172.21.15.35:0/447229748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 msgr2=0x55c6c38bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d9d9b700 1 -- 172.21.15.35:0/447229748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 msgr2=0x55c6c38ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d9d9b700 1 -- 172.21.15.35:0/447229748 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6c37c7130 con 0x55c6c38b3be0 2023-03-17T11:18:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38c43c0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f88c4030040 tx=0x7f88c4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333f9e76de7b6b44 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d17fa700 1 -- 172.21.15.35:0/447229748 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400b540 con 0x55c6c38b3be0 2023-03-17T11:18:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d17fa700 1 -- 172.21.15.35:0/447229748 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88c4031030 con 0x55c6c38b3be0 2023-03-17T11:18:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88d17fa700 1 -- 172.21.15.35:0/447229748 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400e3e0 con 0x55c6c38b3be0 2023-03-17T11:18:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 -- 172.21.15.35:0/447229748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 msgr2=0x55c6c38c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38c43c0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f88c4030040 tx=0x7f88c4009cd0 comp rx=0 tx=0).stop 2023-03-17T11:18:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 -- 172.21.15.35:0/447229748 shutdown_connections 2023-03-17T11:18:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38b44f0 0x55c6c38ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38ae960 0x55c6c38bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/447229748 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b3be0 0x55c6c38c43c0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.101+0000 7f88ecd69b80 1 -- 172.21.15.35:0/447229748 >> 172.21.15.35:0/447229748 conn(0x55c6c370b6b0 msgr2=0x55c6c38ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:45.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 -- 172.21.15.35:0/447229748 shutdown_connections 2023-03-17T11:18:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 -- 172.21.15.35:0/447229748 wait complete. 2023-03-17T11:18:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 -- start start 2023-03-17T11:18:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 Processor -- start 2023-03-17T11:18:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38ae960 0x55c6c38bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38b3be0 0x55c6c38bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 0x55c6c3914ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c39153e0 con 0x55c6c38b44f0 2023-03-17T11:18:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c3915550 con 0x55c6c38ae960 2023-03-17T11:18:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6c3915710 con 0x55c6c38b3be0 2023-03-17T11:18:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88ecd69b80 10 client.0 _ll_register_callbacks cb 0x55c6c36a6230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:18:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88dad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 0x55c6c3914ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88da59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38ae960 0x55c6c38bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88dad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 0x55c6c3914ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54612/0 (socket says 172.21.15.35:54612) 2023-03-17T11:18:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88dad9d700 1 -- 172.21.15.35:0/690486596 learned_addr learned my addr 172.21.15.35:0/690486596 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:18:49.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.102+0000 7f88d9d9b700 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38b3be0 0x55c6c38bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:52.113 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88dad9d700 1 -- 172.21.15.35:0/690486596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38b3be0 msgr2=0x55c6c38bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88dad9d700 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38b3be0 0x55c6c38bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88dad9d700 1 -- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38ae960 msgr2=0x55c6c38bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:18:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88dad9d700 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38ae960 0x55c6c38bd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:52.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88dad9d700 1 -- 172.21.15.35:0/690486596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6c362ed80 con 0x55c6c38b44f0 2023-03-17T11:18:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88dad9d700 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 0x55c6c3914ea0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f88d4094380 tx=0x7f88d40972f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04e32317a4d9f70 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:18:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:18:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88c1ffb700 1 -- 172.21.15.35:0/690486596 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4022450 con 0x55c6c38b44f0 2023-03-17T11:18:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88c1ffb700 1 -- 172.21.15.35:0/690486596 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88d4097910 con 0x55c6c38b44f0 2023-03-17T11:18:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6c387e1e0 con 0x55c6c38b44f0 2023-03-17T11:18:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88c1ffb700 1 -- 172.21.15.35:0/690486596 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88d409fb00 con 0x55c6c38b44f0 2023-03-17T11:18:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88ecd69b80 10 client.20499 fetch_fsmap learned FSMap version 102 2023-03-17T11:18:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55c6c36551f0 con 0x55c6c38b44f0 2023-03-17T11:18:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.103+0000 7f88c1ffb700 1 -- 172.21.15.35:0/690486596 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c6c387e1e0 con 0x55c6c38b44f0 2023-03-17T11:18:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88c1ffb700 1 -- 172.21.15.35:0/690486596 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f88d4096e00 con 0x55c6c38b44f0 2023-03-17T11:18:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88ecd69b80 10 client.20499 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:18:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88ecd69b80 10 client.20499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:18:56.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88ecd69b80 20 client.20499 populate_metadata read hostname 'smithi035' 2023-03-17T11:18:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c391ce30 0x55c6c391f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:18:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88ecd69b80 4 client.20499 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:18:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c6c3684f00 con 0x55c6c391ce30 2023-03-17T11:18:57.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88da59c700 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c391ce30 0x55c6c391f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88c1ffb700 10 client.20499 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.104+0000 7f88da59c700 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c391ce30 0x55c6c391f210 crc :-1 s=READY pgs=638 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea13592b906d849 server_cookie=63655f3d9b0bae7a in_seq=0 out_seq=0 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88c1ffb700 1 -- 172.21.15.35:0/690486596 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c6c3684f00 con 0x55c6c391ce30 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88c1ffb700 10 client.20499 handle_command_reply: tid=0 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 client.20499 shutdown 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 msgr2=0x55c6c3914ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 0x55c6c3914ea0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f88d4094380 tx=0x7f88d40972f0 comp rx=0 tx=0).stop 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 shutdown_connections 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c6c391ce30 0x55c6c391f210 crc :-1 s=READY pgs=638 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c6c38b44f0 0x55c6c3914ea0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c6c38ae960 0x55c6c38bd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88c1ffb700 0 client.20499 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:18:57.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 --2- 172.21.15.35:0/690486596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c6c38b3be0 0x55c6c38bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:18:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 >> 172.21.15.35:0/690486596 conn(0x55c6c370b6b0 msgr2=0x55c6c38b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:18:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 shutdown_connections 2023-03-17T11:18:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 1 -- 172.21.15.35:0/690486596 wait complete. 2023-03-17T11:18:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.124+0000 7f88ecd69b80 20 client.20499 trim_cache size 0 max 16384 2023-03-17T11:18:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f88c809f640 msgr2=0x7f88c80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:18:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f88c809f640 0x7f88c80a1af0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f88cc005fd0 tx=0x7f88cc005f60 comp rx=0 tx=0).stop 2023-03-17T11:18:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 msgr2=0x7f88dc19ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:01.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 0x7f88dc19ac20 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f88d4007ee0 tx=0x7f88d400d3b0 comp rx=0 tx=0).stop 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257bf89c0 con 0x556257be90e0 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556257c564e0 con 0x556257bed630 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ffa024adb80 10 client.0 _ll_register_callbacks cb 0x5562579e0290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ff9effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ff9effff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55698/0 (socket says 172.21.15.35:55698) 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ff9effff700 1 -- 172.21.15.35:0/1106469954 learned_addr learned my addr 172.21.15.35:0/1106469954 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bf7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.110+0000 7ff9f48bd700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257bed630 0x556257bf81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9effff700 1 -- 172.21.15.35:0/1106469954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257bed630 msgr2=0x556257bf81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:01.086 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9effff700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257bed630 0x556257bf81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:01.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9effff700 1 -- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 msgr2=0x556257bf7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:01.087 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9effff700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bf7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:01.700 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9effff700 1 -- 172.21.15.35:0/1106469954 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f010c850 con 0x556257be87d0 2023-03-17T11:19:02.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9effff700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf9920 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00098e0 tx=0x7ff9e0030430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e9ab2ef2264ace server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:02.279 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:19:02.280 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1106469954 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0030bc0 con 0x556257be87d0 2023-03-17T11:19:03.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1106469954 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(361..361 src has 1..361) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9e0030d20 con 0x556257be87d0 2023-03-17T11:19:03.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556257bb8240 con 0x556257be87d0 2023-03-17T11:19:03.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1106469954 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e003a460 con 0x556257be87d0 2023-03-17T11:19:03.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 10 client.20931 fetch_fsmap learned FSMap version 108 2023-03-17T11:19:03.336 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55625798f250 con 0x556257be87d0 2023-03-17T11:19:04.380 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1106469954 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556257bb8240 con 0x556257be87d0 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1106469954 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff9e000f580 con 0x556257be87d0 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 10 client.20931 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 10 client.20931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 20 client.20931 populate_metadata read hostname 'smithi035' 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c57670 0x556257c59a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 4 client.20931 mds_command: new command op to 24452 tid=0[{"prefix": "damage ls"}] 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.111+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562579bef60 con 0x556257c57670 2023-03-17T11:19:04.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.112+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c57670 0x556257c59a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:05.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.112+0000 7ff9ef7fe700 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c57670 0x556257c59a50 crc :-1 s=READY pgs=690 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97146a271e75410 server_cookie=b300a57992dfc66c in_seq=0 out_seq=0 2023-03-17T11:19:05.069 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.112+0000 7ff9cf7fe700 10 client.20931 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.112+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1106469954 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562579bef60 con 0x556257c57670 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.112+0000 7ff9cf7fe700 10 client.20931 handle_command_reply: tid=0 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.112+0000 7ffa024adb80 1 client.20931 shutdown 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 msgr2=0x556257bf9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf9920 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00098e0 tx=0x7ff9e0030430 comp rx=0 tx=0).stop 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 shutdown_connections 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556257c57670 0x556257c59a50 crc :-1 s=READY pgs=690 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:05.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556257bed630 0x556257bf81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:05.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9cf7fe700 0 client.20931 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:05.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556257be87d0 0x556257bf9920 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.232 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 --2- 172.21.15.35:0/1106469954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556257be90e0 0x556257bf7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.232 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 >> 172.21.15.35:0/1106469954 conn(0x556257be3030 msgr2=0x556257beb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:06.232 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 shutdown_connections 2023-03-17T11:19:06.232 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 1 -- 172.21.15.35:0/1106469954 wait complete. 2023-03-17T11:19:06.232 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ffa024adb80 20 client.20931 trim_cache size 0 max 16384 2023-03-17T11:19:06.232 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9d809f640 msgr2=0x7ff9d80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9d809f640 0x7ff9d80a1af0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006010 tx=0x7ff9e0005c00 comp rx=0 tx=0).stop 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 msgr2=0x7ff9f01a4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 0x7ff9f01a4480 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8007ee0 tx=0x7ff9e800d3b0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 shutdown_connections 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9d809f640 0x7ff9d80a1af0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9f0104440 0x7ff9f01a4480 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.569 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f00ff400 0x7ff9f0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 --2- 172.21.15.35:0/1259596604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9f00ffda0 0x7ff9f0101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:06.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.113+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 >> 172.21.15.35:0/1259596604 conn(0x7ff9f0076030 msgr2=0x7ff9f0102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:06.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.114+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 shutdown_connections 2023-03-17T11:19:06.570 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:07:51.114+0000 7ff9f6320700 1 -- 172.21.15.35:0/1259596604 wait complete. 2023-03-17T11:19:06.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:34 smithi035 ceph-mon[92535]: pgmap v4693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 shutdown_connections 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f88c809f640 0x7f88c80a1af0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88dc104390 0x7f88dc19ac20 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88dc0ff350 0x7f88dc196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 --2- 172.21.15.35:0/2725652638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88dc0ffcf0 0x7f88dc1967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 >> 172.21.15.35:0/2725652638 conn(0x7f88dc076330 msgr2=0x7f88dc0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 shutdown_connections 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:32.125+0000 7f88e0bdc700 1 -- 172.21.15.35:0/2725652638 wait complete. 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 -- 172.21.15.35:0/3448455152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 msgr2=0x7f44a00ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 --2- 172.21.15.35:0/3448455152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a00ff720 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f449c0099c0 tx=0x7f449c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 -- 172.21.15.35:0/3448455152 shutdown_connections 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 --2- 172.21.15.35:0/3448455152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 0x7f44a010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 --2- 172.21.15.35:0/3448455152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a00ff720 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 --2- 172.21.15.35:0/3448455152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 0x7f44a0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 -- 172.21.15.35:0/3448455152 >> 172.21.15.35:0/3448455152 conn(0x7f44a0076330 msgr2=0x7f44a0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.247+0000 7f44a73a5700 1 -- 172.21.15.35:0/3448455152 shutdown_connections 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 -- 172.21.15.35:0/3448455152 wait complete. 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 Processor -- start 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 -- start start 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a0195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 0x7f44a01956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 0x7f44a0199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a019a160 con 0x7f44a00ff350 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a019a2d0 con 0x7f44a00ffcf0 2023-03-17T11:19:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a73a5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a019a490 con 0x7f44a0104390 2023-03-17T11:19:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a5141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a0195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.248+0000 7f44a5141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a0195180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54622/0 (socket says 172.21.15.35:54622) 2023-03-17T11:19:08.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 -- 172.21.15.35:0/1912170425 learned_addr learned my addr 172.21.15.35:0/1912170425 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a4940700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 0x7f44a01956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5942700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 0x7f44a0199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 -- 172.21.15.35:0/1912170425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 msgr2=0x7f44a0199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 0x7f44a0199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 -- 172.21.15.35:0/1912170425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 msgr2=0x7f44a01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 0x7f44a01956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 -- 172.21.15.35:0/1912170425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0095f0 con 0x7f44a00ff350 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a4940700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 0x7f44a01956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:19:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5942700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 0x7f44a0199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:19:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a5141700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a0195180 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f449c009f50 tx=0x7f449c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44927fc700 1 -- 172.21.15.35:0/1912170425 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c01f070 con 0x7f44a00ff350 2023-03-17T11:19:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44927fc700 1 -- 172.21.15.35:0/1912170425 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f449c01ac20 con 0x7f44a00ff350 2023-03-17T11:19:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44927fc700 1 -- 172.21.15.35:0/1912170425 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c003fe0 con 0x7f44a00ff350 2023-03-17T11:19:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a010f000 con 0x7f44a00ff350 2023-03-17T11:19:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.249+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a010ee70 con 0x7f44a00ff350 2023-03-17T11:19:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.251+0000 7f44927fc700 1 -- 172.21.15.35:0/1912170425 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f449c023070 con 0x7f44a00ff350 2023-03-17T11:19:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.252+0000 7f44927fc700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f448c09f640 0x7f448c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:10.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.252+0000 7f44927fc700 1 -- 172.21.15.35:0/1912170425 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f449c0cd7d0 con 0x7f44a00ff350 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.252+0000 7f44a4940700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f448c09f640 0x7f448c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.253+0000 7f44a4940700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f448c09f640 0x7f448c0a1af0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4494005fd0 tx=0x7f4494005ee0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.253+0000 7f44b3532b80 1 Processor -- start 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.253+0000 7f44b3532b80 1 -- start start 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.253+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a8be0 0x5612ab8a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.253+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a94f0 0x5612ab8a3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.253+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44b3532b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab7aa010 con 0x5612ab8a3960 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44b3532b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab7fc950 con 0x5612ab8a8be0 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44b3532b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab7f5de0 con 0x5612ab8a94f0 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54634/0 (socket says 172.21.15.35:54634) 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 -- 172.21.15.35:0/2707126053 learned_addr learned my addr 172.21.15.35:0/2707126053 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a4940700 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a94f0 0x5612ab8a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:10.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5141700 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a8be0 0x5612ab8a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 -- 172.21.15.35:0/2707126053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a94f0 msgr2=0x5612ab8a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a94f0 0x5612ab8a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 -- 172.21.15.35:0/2707126053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a8be0 msgr2=0x5612ab8a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a8be0 0x5612ab8a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 -- 172.21.15.35:0/2707126053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612ab6775d0 con 0x5612ab8a3960 2023-03-17T11:19:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5141700 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a8be0 0x5612ab8a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:19:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f44a5942700 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3d90 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f4498009ca0 tx=0x7f4498007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6621dcecdd4516 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f448b7fe700 1 -- 172.21.15.35:0/2707126053 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498004bb0 con 0x5612ab8a3960 2023-03-17T11:19:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f448b7fe700 1 -- 172.21.15.35:0/2707126053 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4498004d10 con 0x5612ab8a3960 2023-03-17T11:19:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.254+0000 7f448b7fe700 1 -- 172.21.15.35:0/2707126053 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498014660 con 0x5612ab8a3960 2023-03-17T11:19:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 -- 172.21.15.35:0/2707126053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 msgr2=0x5612ab8a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3d90 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f4498009ca0 tx=0x7f4498007500 comp rx=0 tx=0).stop 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 -- 172.21.15.35:0/2707126053 shutdown_connections 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3d90 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a8be0 0x5612ab8a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 --2- 172.21.15.35:0/2707126053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a94f0 0x5612ab8a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 -- 172.21.15.35:0/2707126053 >> 172.21.15.35:0/2707126053 conn(0x5612ab7006b0 msgr2=0x5612ab89da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 -- 172.21.15.35:0/2707126053 shutdown_connections 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.255+0000 7f44b3532b80 1 -- 172.21.15.35:0/2707126053 wait complete. 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 -- start start 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 Processor -- start 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab8accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab6798c0 con 0x5612ab8a94f0 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab8ad3f0 con 0x5612ab8a3960 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab8b9000 con 0x5612ab8a8be0 2023-03-17T11:19:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44b3532b80 10 client.0 _ll_register_callbacks cb 0x5612ab69b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.256+0000 7f44a5942700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab8accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab8accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54640/0 (socket says 172.21.15.35:54640) 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 -- 172.21.15.35:0/548998240 learned_addr learned my addr 172.21.15.35:0/548998240 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a4940700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5141700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 -- 172.21.15.35:0/548998240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 msgr2=0x5612ab8ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 -- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 msgr2=0x5612ab8af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 -- 172.21.15.35:0/548998240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4498009900 con 0x5612ab8a94f0 2023-03-17T11:19:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a4940700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:19:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44a5942700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab8accc0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f4498000f80 tx=0x7f4498004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ce81d52e2232b3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f4488ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:19:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f4488ff9700 1 -- 172.21.15.35:0/548998240 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44980056c0 con 0x5612ab8a94f0 2023-03-17T11:19:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f4488ff9700 1 -- 172.21.15.35:0/548998240 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4498005820 con 0x5612ab8a94f0 2023-03-17T11:19:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612ab7b8390 con 0x5612ab8a94f0 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f4488ff9700 1 -- 172.21.15.35:0/548998240 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4498005a00 con 0x5612ab8a94f0 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44b3532b80 10 client.20511 fetch_fsmap learned FSMap version 102 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.257+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5612ab623d80 con 0x5612ab8a94f0 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f4488ff9700 1 -- 172.21.15.35:0/548998240 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5612ab7b8390 con 0x5612ab8a94f0 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f4488ff9700 1 -- 172.21.15.35:0/548998240 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f449801d4d0 con 0x5612ab8a94f0 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44b3532b80 10 client.20511 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44b3532b80 10 client.20511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44b3532b80 20 client.20511 populate_metadata read hostname 'smithi035' 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44b3532b80 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab8bd020 0x5612ab8bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44b3532b80 4 client.20511 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612ab7c4600 con 0x5612ab8bd020 2023-03-17T11:19:13.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44a5141700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab8bd020 0x5612ab8bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f4488ff9700 10 client.20511 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.258+0000 7f44a5141700 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab8bd020 0x5612ab8bf430 crc :-1 s=READY pgs=639 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e487f97ba3fb898 server_cookie=60c59465940e8159 in_seq=0 out_seq=0 2023-03-17T11:19:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f4488ff9700 1 -- 172.21.15.35:0/548998240 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5612ab7c4600 con 0x5612ab8bd020 2023-03-17T11:19:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f4488ff9700 10 client.20511 handle_command_reply: tid=0 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 client.20511 shutdown 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 msgr2=0x5612ab8accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab8accc0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f4498000f80 tx=0x7f4498004f90 comp rx=0 tx=0).stop 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 shutdown_connections 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab8bd020 0x5612ab8bf430 crc :-1 s=READY pgs=639 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab8accc0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f4488ff9700 0 client.20511 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 --2- 172.21.15.35:0/548998240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 >> 172.21.15.35:0/548998240 conn(0x5612ab7006b0 msgr2=0x5612ab89da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 shutdown_connections 2023-03-17T11:19:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.259+0000 7f44b3532b80 1 -- 172.21.15.35:0/548998240 wait complete. 2023-03-17T11:19:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.260+0000 7f44b3532b80 20 client.20511 trim_cache size 0 max 16384 2023-03-17T11:19:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 Processor -- start 2023-03-17T11:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 -- start start 2023-03-17T11:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:17.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab89dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a94f0 0x5612ab8a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab8a8fb0 con 0x5612ab8a3960 2023-03-17T11:19:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab8afa10 con 0x5612ab8a94f0 2023-03-17T11:19:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44b3532b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab89e000 con 0x5612ab8a8be0 2023-03-17T11:19:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54644/0 (socket says 172.21.15.35:54644) 2023-03-17T11:19:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 -- 172.21.15.35:0/1520520729 learned_addr learned my addr 172.21.15.35:0/1520520729 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5942700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a94f0 0x5612ab8a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a4940700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab89dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 -- 172.21.15.35:0/1520520729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 msgr2=0x5612ab89dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab89dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 -- 172.21.15.35:0/1520520729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a94f0 msgr2=0x5612ab8a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a94f0 0x5612ab8a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5141700 1 -- 172.21.15.35:0/1520520729 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612ab7bc130 con 0x5612ab8a3960 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a4940700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab89dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.275+0000 7f44a5942700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a94f0 0x5612ab8a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44a5141700 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3420 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f449c000c00 tx=0x7f449c005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fbbe728d3d002b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f448bfff700 1 -- 172.21.15.35:0/1520520729 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c01adf0 con 0x5612ab8a3960 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f448bfff700 1 -- 172.21.15.35:0/1520520729 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f449c004140 con 0x5612ab8a3960 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f448bfff700 1 -- 172.21.15.35:0/1520520729 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c09b570 con 0x5612ab8a3960 2023-03-17T11:19:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 -- 172.21.15.35:0/1520520729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 msgr2=0x5612ab8a3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:20.694 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T11:19:20.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:36 smithi035 ceph-mon[92535]: pgmap v4694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:22.177 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:38 smithi035 ceph-mon[92535]: pgmap v4695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:22.177 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:40 smithi035 ceph-mon[92535]: pgmap v4696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:24.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:42 smithi035 ceph-mon[92535]: pgmap v4697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:24.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:44 smithi035 ceph-mon[92535]: pgmap v4698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:19:26.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:46 smithi035 ceph-mon[92535]: pgmap v4699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:19:26.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:48 smithi035 ceph-mon[92535]: pgmap v4700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:19:26.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:50 smithi035 ceph-mon[92535]: pgmap v4701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:19:28.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:52 smithi035 ceph-mon[92535]: pgmap v4702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:19:28.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:54 smithi035 ceph-mon[92535]: pgmap v4703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T11:19:28.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:56 smithi035 ceph-mon[92535]: pgmap v4704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:19:28.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:08:58 smithi035 ceph-mon[92535]: pgmap v4705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:19:28.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:00 smithi035 ceph-mon[92535]: pgmap v4706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:19:28.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:02 smithi035 ceph-mon[92535]: pgmap v4707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 272 B/s wr, 9 op/s 2023-03-17T11:19:29.924 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:02 smithi035 ceph-mon[92535]: pgmap v4708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T11:19:29.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:04 smithi035 ceph-mon[92535]: pgmap v4709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T11:19:29.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:04 smithi035 ceph-mon[92535]: osdmap e364: 12 total, 12 up, 12 in 2023-03-17T11:19:29.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:06 smithi035 ceph-mon[92535]: pgmap v4711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 73 KiB/s wr, 30 op/s 2023-03-17T11:19:31.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:08 smithi035 ceph-mon[92535]: pgmap v4712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 74 KiB/s wr, 38 op/s 2023-03-17T11:19:31.484 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:10 smithi035 ceph-mon[92535]: pgmap v4713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 68 KiB/s wr, 35 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:12 smithi035 ceph-mon[92535]: pgmap v4714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:12 smithi035 ceph-mon[92535]: osdmap e365: 12 total, 12 up, 12 in 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:14 smithi035 ceph-mon[92535]: pgmap v4716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:16 smithi035 ceph-mon[92535]: pgmap v4717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:18 smithi035 ceph-mon[92535]: pgmap v4718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:20 smithi035 ceph-mon[92535]: pgmap v4719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:22 smithi035 ceph-mon[92535]: pgmap v4720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:24 smithi035 ceph-mon[92535]: pgmap v4721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 381 B/s wr, 9 op/s 2023-03-17T11:19:31.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:26 smithi035 ceph-mon[92535]: pgmap v4722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:19:33.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:28 smithi035 ceph-mon[92535]: pgmap v4723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:19:33.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:30 smithi035 ceph-mon[92535]: pgmap v4724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T11:19:33.466 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:32 smithi035 ceph-mon[92535]: pgmap v4725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:35.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:34 smithi035 ceph-mon[92535]: pgmap v4726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T11:19:35.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:36 smithi035 ceph-mon[92535]: pgmap v4727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:35.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:38 smithi035 ceph-mon[92535]: pgmap v4728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:35.074 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:40 smithi035 ceph-mon[92535]: pgmap v4729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:35.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:42 smithi035 ceph-mon[92535]: pgmap v4730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:36.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:44 smithi035 ceph-mon[92535]: pgmap v4731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:36.473 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:46 smithi035 ceph-mon[92535]: pgmap v4732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:36.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:48 smithi035 ceph-mon[92535]: pgmap v4733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:36.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:50 smithi035 ceph-mon[92535]: pgmap v4734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:36.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:52 smithi035 ceph-mon[92535]: pgmap v4735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:36.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:54 smithi035 ceph-mon[92535]: pgmap v4736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:56 smithi035 ceph-mon[92535]: pgmap v4737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:09:58 smithi035 ceph-mon[92535]: pgmap v4738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:00 smithi035 ceph-mon[92535]: pgmap v4739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:02 smithi035 ceph-mon[92535]: pgmap v4740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: pgmap v4741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:37.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:37.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:37.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:37.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:38.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.742 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:06 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:06 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:06 smithi035 ceph-mon[92535]: pgmap v4742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:06 smithi035 ceph-mon[92535]: pgmap v4743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:08 smithi035 ceph-mon[92535]: pgmap v4744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 22 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:09 smithi035 ceph-mon[92535]: osdmap e366: 12 total, 12 up, 12 in 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:10 smithi035 ceph-mon[92535]: pgmap v4746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 68 KiB/s wr, 35 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:12 smithi035 ceph-mon[92535]: pgmap v4747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 129 B/s wr, 6 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:14 smithi035 ceph-mon[92535]: pgmap v4748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:16 smithi035 ceph-mon[92535]: pgmap v4749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:18 smithi035 ceph-mon[92535]: pgmap v4750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:19:39.743 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:18 smithi035 ceph-mon[92535]: osdmap e367: 12 total, 12 up, 12 in 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:20 smithi035 ceph-mon[92535]: pgmap v4752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:22 smithi035 ceph-mon[92535]: pgmap v4753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:24 smithi035 ceph-mon[92535]: pgmap v4754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:26 smithi035 ceph-mon[92535]: pgmap v4755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:28 smithi035 ceph-mon[92535]: pgmap v4756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:30 smithi035 ceph-mon[92535]: pgmap v4757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:32 smithi035 ceph-mon[92535]: pgmap v4758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:34 smithi035 ceph-mon[92535]: pgmap v4759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:36 smithi035 ceph-mon[92535]: pgmap v4760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:38 smithi035 ceph-mon[92535]: pgmap v4761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:40 smithi035 ceph-mon[92535]: pgmap v4762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:42 smithi035 ceph-mon[92535]: pgmap v4763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:44 smithi035 ceph-mon[92535]: pgmap v4764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:19:39.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:46 smithi035 ceph-mon[92535]: pgmap v4765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:19:40.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:19:40.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:19:40.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:19:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:19:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:19:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:19:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:19:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:19:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:19:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3420 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f449c000c00 tx=0x7f449c005a60 comp rx=0 tx=0).stop 2023-03-17T11:19:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 -- 172.21.15.35:0/1520520729 shutdown_connections 2023-03-17T11:19:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a94f0 0x5612ab8a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:42.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a3960 0x5612ab8a3420 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:43.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1520520729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab89dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 -- 172.21.15.35:0/1520520729 >> 172.21.15.35:0/1520520729 conn(0x5612ab7006b0 msgr2=0x5612ab8a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 -- 172.21.15.35:0/1520520729 shutdown_connections 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.276+0000 7f44b3532b80 1 -- 172.21.15.35:0/1520520729 wait complete. 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 -- start start 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 Processor -- start 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab90fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab910400 con 0x5612ab8a94f0 2023-03-17T11:19:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab910540 con 0x5612ab8a3960 2023-03-17T11:19:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ab9106b0 con 0x5612ab8a8be0 2023-03-17T11:19:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44b3532b80 10 client.0 _ll_register_callbacks cb 0x5612ab69b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:19:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44a5942700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab90fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44a5942700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab90fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54654/0 (socket says 172.21.15.35:54654) 2023-03-17T11:19:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44a5942700 1 -- 172.21.15.35:0/1111113656 learned_addr learned my addr 172.21.15.35:0/1111113656 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44a5141700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.277+0000 7f44a4940700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5942700 1 -- 172.21.15.35:0/1111113656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 msgr2=0x5612ab8b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5942700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5942700 1 -- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 msgr2=0x5612ab8b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5942700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5942700 1 -- 172.21.15.35:0/1111113656 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a010ee70 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a4940700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5141700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44a5942700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab90fec0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f4498004e20 tx=0x7f449801dfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa0f949a41b6d16 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f4488ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f4488ff9700 1 -- 172.21.15.35:0/1111113656 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498036030 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f4488ff9700 1 -- 172.21.15.35:0/1111113656 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4498037070 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612ab8731e0 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f4488ff9700 1 -- 172.21.15.35:0/1111113656 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f449801d650 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44b3532b80 10 client.20517 fetch_fsmap learned FSMap version 102 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5612ab64a1f0 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f4488ff9700 1 -- 172.21.15.35:0/1111113656 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5612ab8731e0 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f4488ff9700 1 -- 172.21.15.35:0/1111113656 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4498004040 con 0x5612ab8a94f0 2023-03-17T11:19:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.278+0000 7f44b3532b80 10 client.20517 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44b3532b80 10 client.20517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44b3532b80 20 client.20517 populate_metadata read hostname 'smithi035' 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab911a90 0x5612ab913e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44b3532b80 4 client.20517 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5612ab679f00 con 0x5612ab911a90 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44a5141700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab911a90 0x5612ab913e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f44a5141700 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab911a90 0x5612ab913e70 crc :-1 s=READY pgs=640 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b58489014a95629 server_cookie=5ce242042130c8ad in_seq=0 out_seq=0 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.279+0000 7f4488ff9700 10 client.20517 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:47.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f4488ff9700 1 -- 172.21.15.35:0/1111113656 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5612ab679f00 con 0x5612ab911a90 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f4488ff9700 10 client.20517 handle_command_reply: tid=0 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 client.20517 shutdown 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 msgr2=0x5612ab90fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab90fec0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f4498004e20 tx=0x7f449801dfe0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 shutdown_connections 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5612ab911a90 0x5612ab913e70 crc :-1 s=READY pgs=640 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5612ab8a94f0 0x5612ab90fec0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5612ab8a3960 0x5612ab8b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f4488ff9700 0 client.20517 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 --2- 172.21.15.35:0/1111113656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612ab8a8be0 0x5612ab8b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 >> 172.21.15.35:0/1111113656 conn(0x5612ab7006b0 msgr2=0x5612ab8a98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 shutdown_connections 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 1 -- 172.21.15.35:0/1111113656 wait complete. 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.289+0000 7f44b3532b80 20 client.20517 trim_cache size 0 max 16384 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f448c09f640 msgr2=0x7f448c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f448c09f640 0x7f448c0a1af0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4494005fd0 tx=0x7f4494005ee0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 msgr2=0x7f44a0195180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a0195180 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f449c009f50 tx=0x7f449c0047c0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 shutdown_connections 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f448c09f640 0x7f448c0a1af0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a0104390 0x7f44a0199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f44a00ff350 0x7f44a0195180 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 --2- 172.21.15.35:0/1912170425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00ffcf0 0x7f44a01956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 >> 172.21.15.35:0/1912170425 conn(0x7f44a0076330 msgr2=0x7f44a00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 shutdown_connections 2023-03-17T11:19:48.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:45.290+0000 7f44a73a5700 1 -- 172.21.15.35:0/1912170425 wait complete. 2023-03-17T11:19:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 -- 172.21.15.35:0/1848215889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 msgr2=0x7fa70010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 --2- 172.21.15.35:0/1848215889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa70010bf60 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800b0d0 tx=0x7fa6f800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:19:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 -- 172.21.15.35:0/1848215889 shutdown_connections 2023-03-17T11:19:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 --2- 172.21.15.35:0/1848215889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa70010bf60 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 --2- 172.21.15.35:0/1848215889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7000ff350 0x7fa7000ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 --2- 172.21.15.35:0/1848215889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7000ffcf0 0x7fa700103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 -- 172.21.15.35:0/1848215889 >> 172.21.15.35:0/1848215889 conn(0x7fa700076330 msgr2=0x7fa700076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 -- 172.21.15.35:0/1848215889 shutdown_connections 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.412+0000 7fa7075da700 1 -- 172.21.15.35:0/1848215889 wait complete. 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.413+0000 7fa7075da700 1 Processor -- start 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.413+0000 7fa7075da700 1 -- start start 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa7075da700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7000ff350 0x7fa700195260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa7075da700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7000ffcf0 0x7fa7001957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa7075da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa700199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa7075da700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019a240 con 0x7fa700104390 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa7075da700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019a3b0 con 0x7fa7000ffcf0 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa7075da700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019a570 con 0x7fa7000ff350 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa700199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa700199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54668/0 (socket says 172.21.15.35:54668) 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 -- 172.21.15.35:0/3142556253 learned_addr learned my addr 172.21.15.35:0/3142556253 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705376700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7000ff350 0x7fa700195260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa704b75700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7000ffcf0 0x7fa7001957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 -- 172.21.15.35:0/3142556253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7000ff350 msgr2=0x7fa700195260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7000ff350 0x7fa700195260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 -- 172.21.15.35:0/3142556253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7000ffcf0 msgr2=0x7fa7001957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7000ffcf0 0x7fa7001957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 -- 172.21.15.35:0/3142556253 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009d00 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa705b77700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa700199c00 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009380 tx=0x7fa6f80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.414+0000 7fa6f67fc700 1 -- 172.21.15.35:0/3142556253 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800e040 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.415+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70010f010 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.415+0000 7fa6f67fc700 1 -- 172.21.15.35:0/3142556253 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f8003e10 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.415+0000 7fa6f67fc700 1 -- 172.21.15.35:0/3142556253 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f801a990 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.415+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70010ee80 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.417+0000 7fa6f67fc700 1 -- 172.21.15.35:0/3142556253 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa6f8005690 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.417+0000 7fa6f67fc700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa6ec09f640 0x7fa6ec0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.418+0000 7fa6f67fc700 1 -- 172.21.15.35:0/3142556253 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa6f801e070 con 0x7fa700104390 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.418+0000 7fa705376700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa6ec09f640 0x7fa6ec0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.418+0000 7fa705376700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa6ec09f640 0x7fa6ec0a1af0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc005950 tx=0x7fa6fc00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 Processor -- start 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 -- start start 2023-03-17T11:19:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b26c1010 con 0x5608b27ba960 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b2713950 con 0x5608b27c04f0 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa713767b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b270cde0 con 0x5608b27bfbe0 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa705b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa705b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54676/0 (socket says 172.21.15.35:54676) 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa705b77700 1 -- 172.21.15.35:0/4259870527 learned_addr learned my addr 172.21.15.35:0/4259870527 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa704b75700 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.419+0000 7fa705376700 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa705b77700 1 -- 172.21.15.35:0/4259870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 msgr2=0x5608b27bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa705b77700 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa705b77700 1 -- 172.21.15.35:0/4259870527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 msgr2=0x5608b27ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa705b77700 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa705b77700 1 -- 172.21.15.35:0/4259870527 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608b258e5d0 con 0x5608b27ba960 2023-03-17T11:19:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa705b77700 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27bad90 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80a36c0 tx=0x7fa6f809b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133dad7b1f9a6bf1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa6eb7fe700 1 -- 172.21.15.35:0/4259870527 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80a3bf0 con 0x5608b27ba960 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa6eb7fe700 1 -- 172.21.15.35:0/4259870527 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f8020c00 con 0x5608b27ba960 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.420+0000 7fa6eb7fe700 1 -- 172.21.15.35:0/4259870527 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f809b180 con 0x5608b27ba960 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 -- 172.21.15.35:0/4259870527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 msgr2=0x5608b27bad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27bad90 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80a36c0 tx=0x7fa6f809b650 comp rx=0 tx=0).stop 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 -- 172.21.15.35:0/4259870527 shutdown_connections 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27bad90 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 --2- 172.21.15.35:0/4259870527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 -- 172.21.15.35:0/4259870527 >> 172.21.15.35:0/4259870527 conn(0x5608b26176b0 msgr2=0x5608b27b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:19:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 -- 172.21.15.35:0/4259870527 shutdown_connections 2023-03-17T11:19:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 -- 172.21.15.35:0/4259870527 wait complete. 2023-03-17T11:19:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 -- start start 2023-03-17T11:19:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.421+0000 7fa713767b80 1 Processor -- start 2023-03-17T11:19:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27ba960 0x5608b27c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 0x5608b27c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b25908c0 con 0x5608b27bfbe0 2023-03-17T11:19:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27c4560 con 0x5608b27c04f0 2023-03-17T11:19:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27cfdd0 con 0x5608b27ba960 2023-03-17T11:19:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa713767b80 10 client.0 _ll_register_callbacks cb 0x5608b25b2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 0x5608b27c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 0x5608b27c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54680/0 (socket says 172.21.15.35:54680) 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 -- 172.21.15.35:0/1661559077 learned_addr learned my addr 172.21.15.35:0/1661559077 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa705376700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27ba960 0x5608b27c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa705b77700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 -- 172.21.15.35:0/1661559077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27ba960 msgr2=0x5608b27c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27ba960 0x5608b27c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:54.712 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:48 smithi035 ceph-mon[92535]: pgmap v4766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:19:56.903 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-03-17T11:19:56.904 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-03-17T11:19:56.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 -- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 msgr2=0x5608b27c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 -- 172.21.15.35:0/1661559077 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70010ee80 con 0x5608b27bfbe0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa704b75700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 0x5608b27c36e0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000be70 tx=0x7fa6f0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3754c23c5e0e19e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.422+0000 7fa6e8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/1661559077 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0016070 con 0x5608b27bfbe0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/1661559077 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa6f0004830 con 0x5608b27bfbe0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608b26cf390 con 0x5608b27bfbe0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/1661559077 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6f00049f0 con 0x5608b27bfbe0 2023-03-17T11:19:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 10 client.20529 fetch_fsmap learned FSMap version 102 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5608b253ad80 con 0x5608b27bfbe0 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/1661559077 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5608b26cf390 con 0x5608b27bfbe0 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/1661559077 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa6f001a780 con 0x5608b27bfbe0 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 10 client.20529 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 10 client.20529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 20 client.20529 populate_metadata read hostname 'smithi035' 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b27d6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 4 client.20529 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.423+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608b26db600 con 0x5608b27d3f40 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.424+0000 7fa705376700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b27d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.424+0000 7fa705376700 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b27d6350 crc :-1 s=READY pgs=641 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232ce8e9262b35bb server_cookie=a8facfeab0e7d3ce in_seq=0 out_seq=0 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.424+0000 7fa6e8ff9700 10 client.20529 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/1661559077 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5608b26db600 con 0x5608b27d3f40 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa6e8ff9700 10 client.20529 handle_command_reply: tid=0 2023-03-17T11:19:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 client.20529 shutdown 2023-03-17T11:20:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 msgr2=0x5608b27c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 0x5608b27c36e0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000be70 tx=0x7fa6f0011720 comp rx=0 tx=0).stop 2023-03-17T11:20:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 shutdown_connections 2023-03-17T11:20:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b27d6350 crc :-1 s=READY pgs=641 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27c04f0 0x5608b27c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa6e8ff9700 0 client.20529 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27ba960 0x5608b27c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 --2- 172.21.15.35:0/1661559077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27bfbe0 0x5608b27c36e0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 >> 172.21.15.35:0/1661559077 conn(0x5608b26176b0 msgr2=0x5608b27b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 shutdown_connections 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 1 -- 172.21.15.35:0/1661559077 wait complete. 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.425+0000 7fa713767b80 20 client.20529 trim_cache size 0 max 16384 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 Processor -- start 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 -- start start 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27bfbe0 0x5608b27cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27c04f0 0x5608b27c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b26d0050 con 0x5608b27ba960 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27b00f0 con 0x5608b27bfbe0 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa713767b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27b5000 con 0x5608b27c04f0 2023-03-17T11:20:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54686/0 (socket says 172.21.15.35:54686) 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 -- 172.21.15.35:0/1980450500 learned_addr learned my addr 172.21.15.35:0/1980450500 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa704b75700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27bfbe0 0x5608b27cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705b77700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27c04f0 0x5608b27c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 -- 172.21.15.35:0/1980450500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27c04f0 msgr2=0x5608b27c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27c04f0 0x5608b27c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 -- 172.21.15.35:0/1980450500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27bfbe0 msgr2=0x5608b27cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27bfbe0 0x5608b27cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705376700 1 -- 172.21.15.35:0/1980450500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608b26d3130 con 0x5608b27ba960 2023-03-17T11:20:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa704b75700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27bfbe0 0x5608b27cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.440+0000 7fa705b77700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27c04f0 0x5608b27c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa705376700 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27b4ac0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc005d90 tx=0x7fa6fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ceffd082c26c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa6ebfff700 1 -- 172.21.15.35:0/1980450500 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc025070 con 0x5608b27ba960 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa6ebfff700 1 -- 172.21.15.35:0/1980450500 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6fc015070 con 0x5608b27ba960 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa6ebfff700 1 -- 172.21.15.35:0/1980450500 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0116e0 con 0x5608b27ba960 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 -- 172.21.15.35:0/1980450500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 msgr2=0x5608b27b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27b4ac0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc005d90 tx=0x7fa6fc013000 comp rx=0 tx=0).stop 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 -- 172.21.15.35:0/1980450500 shutdown_connections 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27c04f0 0x5608b27c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27ba960 0x5608b27b4ac0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 --2- 172.21.15.35:0/1980450500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27bfbe0 0x5608b27cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 -- 172.21.15.35:0/1980450500 >> 172.21.15.35:0/1980450500 conn(0x5608b26176b0 msgr2=0x5608b27b9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 -- 172.21.15.35:0/1980450500 shutdown_connections 2023-03-17T11:20:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.441+0000 7fa713767b80 1 -- 172.21.15.35:0/1980450500 wait complete. 2023-03-17T11:20:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 -- start start 2023-03-17T11:20:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 Processor -- start 2023-03-17T11:20:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27ba960 0x5608b27caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 0x5608b27c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27cb340 con 0x5608b27c04f0 2023-03-17T11:20:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27c9800 con 0x5608b27ba960 2023-03-17T11:20:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b27c99c0 con 0x5608b27bfbe0 2023-03-17T11:20:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa713767b80 10 client.0 _ll_register_callbacks cb 0x5608b25b2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:20:13.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa705b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 0x5608b27c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:13.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa705b77700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 0x5608b27c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54696/0 (socket says 172.21.15.35:54696) 2023-03-17T11:20:13.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa705b77700 1 -- 172.21.15.35:0/2245543187 learned_addr learned my addr 172.21.15.35:0/2245543187 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.442+0000 7fa704b75700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705376700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27ba960 0x5608b27caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705b77700 1 -- 172.21.15.35:0/2245543187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 msgr2=0x5608b27c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705b77700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705b77700 1 -- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27ba960 msgr2=0x5608b27caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705b77700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27ba960 0x5608b27caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:13.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705b77700 1 -- 172.21.15.35:0/2245543187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc00b8f0 con 0x5608b27c04f0 2023-03-17T11:20:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa704b75700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:20:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa705b77700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 0x5608b27c92c0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80cbce0 tx=0x7fa6f8097e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e506392f631351a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa6e8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:20:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/2245543187 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f809b180 con 0x5608b27c04f0 2023-03-17T11:20:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/2245543187 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(341..341 src has 1..341) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa6f80cb400 con 0x5608b27c04f0 2023-03-17T11:20:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608b278a1e0 con 0x5608b27c04f0 2023-03-17T11:20:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/2245543187 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6f80a3bf0 con 0x5608b27c04f0 2023-03-17T11:20:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa713767b80 10 client.20535 fetch_fsmap learned FSMap version 102 2023-03-17T11:20:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5608b25611f0 con 0x5608b27c04f0 2023-03-17T11:20:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.443+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/2245543187 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f8068020 con 0x5608b27c04f0 2023-03-17T11:20:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/2245543187 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa6f80a3760 con 0x5608b27c04f0 2023-03-17T11:20:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa713767b80 10 client.20535 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:20:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa713767b80 10 client.20535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:20:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa713767b80 20 client.20535 populate_metadata read hostname 'smithi035' 2023-03-17T11:20:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa713767b80 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b282abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa713767b80 4 client.20535 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:20:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5608b2590f00 con 0x5608b27d3f40 2023-03-17T11:20:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.444+0000 7fa705376700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b282abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.445+0000 7fa6e8ff9700 10 client.20535 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:18.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.445+0000 7fa705376700 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b282abb0 crc :-1 s=READY pgs=642 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec1d79d955e349b4 server_cookie=5aae75577c7b1568 in_seq=0 out_seq=0 2023-03-17T11:20:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa6e8ff9700 1 -- 172.21.15.35:0/2245543187 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5608b2590f00 con 0x5608b27d3f40 2023-03-17T11:20:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa6e8ff9700 10 client.20535 handle_command_reply: tid=0 2023-03-17T11:20:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 client.20535 shutdown 2023-03-17T11:20:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 msgr2=0x5608b27c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 0x5608b27c92c0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80cbce0 tx=0x7fa6f8097e60 comp rx=0 tx=0).stop 2023-03-17T11:20:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 shutdown_connections 2023-03-17T11:20:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5608b27d3f40 0x5608b282abb0 crc :-1 s=READY pgs=642 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5608b27c04f0 0x5608b27c92c0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa6e8ff9700 0 client.20535 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608b27ba960 0x5608b27caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 --2- 172.21.15.35:0/2245543187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5608b27bfbe0 0x5608b27c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 >> 172.21.15.35:0/2245543187 conn(0x5608b26176b0 msgr2=0x5608b27c2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 shutdown_connections 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 1 -- 172.21.15.35:0/2245543187 wait complete. 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.454+0000 7fa713767b80 20 client.20535 trim_cache size 0 max 16384 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa6ec09f640 msgr2=0x7fa6ec0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa6ec09f640 0x7fa6ec0a1af0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc005950 tx=0x7fa6fc00b410 comp rx=0 tx=0).stop 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 msgr2=0x7fa700199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa700199c00 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009380 tx=0x7fa6f80093b0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 shutdown_connections 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa6ec09f640 0x7fa6ec0a1af0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa700104390 0x7fa700199c00 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7000ff350 0x7fa700195260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 --2- 172.21.15.35:0/3142556253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7000ffcf0 0x7fa7001957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 >> 172.21.15.35:0/3142556253 conn(0x7fa700076330 msgr2=0x7fa7000fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 shutdown_connections 2023-03-17T11:20:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:56:58.455+0000 7fa7075da700 1 -- 172.21.15.35:0/3142556253 wait complete. 2023-03-17T11:20:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/3770558767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c8104390 msgr2=0x7fa5c810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/3770558767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c8104390 0x7fa5c810bf60 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000b0d0 tx=0x7fa5c000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:20:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/3770558767 shutdown_connections 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/3770558767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c8104390 0x7fa5c810bf60 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/3770558767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c80ff350 0x7fa5c80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/3770558767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/3770558767 >> 172.21.15.35:0/3770558767 conn(0x7fa5c8076330 msgr2=0x7fa5c8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/3770558767 shutdown_connections 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.577+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/3770558767 wait complete. 2023-03-17T11:20:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 Processor -- start 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 -- start start 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5c80ff350 0x7fa5c8195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c81957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8104390 0x7fa5c8199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c819a250 con 0x7fa5c80ffcf0 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c819a3c0 con 0x7fa5c8104390 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cf5b8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c819a580 con 0x7fa5c80ff350 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5ccb53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c81957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5ccb53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c81957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54710/0 (socket says 172.21.15.35:54710) 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5ccb53700 1 -- 172.21.15.35:0/4090219900 learned_addr learned my addr 172.21.15.35:0/4090219900 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.578+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8104390 0x7fa5c8199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5cd354700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5c80ff350 0x7fa5c8195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5ccb53700 1 -- 172.21.15.35:0/4090219900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5c80ff350 msgr2=0x7fa5c8195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5c80ff350 0x7fa5c8195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5ccb53700 1 -- 172.21.15.35:0/4090219900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8104390 msgr2=0x7fa5c8199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8104390 0x7fa5c8199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5ccb53700 1 -- 172.21.15.35:0/4090219900 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009d00 con 0x7fa5c80ffcf0 2023-03-17T11:20:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c81957b0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d950 tx=0x7fa5b800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5be7fc700 1 -- 172.21.15.35:0/4090219900 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800f890 con 0x7fa5c80ffcf0 2023-03-17T11:20:25.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:50 smithi035 ceph-mon[92535]: pgmap v4767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c810f010 con 0x7fa5c80ffcf0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5be7fc700 1 -- 172.21.15.35:0/4090219900 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5b800fe80 con 0x7fa5c80ffcf0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5be7fc700 1 -- 172.21.15.35:0/4090219900 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800e3b0 con 0x7fa5c80ffcf0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.579+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c810ee80 con 0x7fa5c80ffcf0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.581+0000 7fa5be7fc700 1 -- 172.21.15.35:0/4090219900 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa5b800f9f0 con 0x7fa5c80ffcf0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.582+0000 7fa5be7fc700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5b409f640 0x7fa5b40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.582+0000 7fa5be7fc700 1 -- 172.21.15.35:0/4090219900 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(342..342 src has 1..342) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fa5b80ca0d0 con 0x7fa5c80ffcf0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.582+0000 7fa5cd354700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5b409f640 0x7fa5b40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.582+0000 7fa5cd354700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5b409f640 0x7fa5b40a1af0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4005950 tx=0x7fa5c400b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 Processor -- start 2023-03-17T11:20:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 -- start start 2023-03-17T11:20:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b21619e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b21619efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2160a3010 con 0x55b2161a46a0 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2160f5950 con 0x55b2161a3d90 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.583+0000 7fa5db745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2160eede0 con 0x55b21619eb70 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b21619e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b21619e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54718/0 (socket says 172.21.15.35:54718) 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 -- 172.21.15.35:0/1776894093 learned_addr learned my addr 172.21.15.35:0/1776894093 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5cd354700 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b21619efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 -- 172.21.15.35:0/1776894093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 msgr2=0x55b21619efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b21619efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 -- 172.21.15.35:0/1776894093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 msgr2=0x55b2161a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 -- 172.21.15.35:0/1776894093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b215f705d0 con 0x55b2161a46a0 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b21619efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b21619e630 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80945c0 tx=0x7fa5b80974b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ddbe49c07cacc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5b37fe700 1 -- 172.21.15.35:0/1776894093 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b809fd40 con 0x55b2161a46a0 2023-03-17T11:20:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5b37fe700 1 -- 172.21.15.35:0/1776894093 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5b8095ef0 con 0x55b2161a46a0 2023-03-17T11:20:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.584+0000 7fa5b37fe700 1 -- 172.21.15.35:0/1776894093 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8097240 con 0x55b2161a46a0 2023-03-17T11:20:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 -- 172.21.15.35:0/1776894093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 msgr2=0x55b21619e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b21619e630 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80945c0 tx=0x7fa5b80974b0 comp rx=0 tx=0).stop 2023-03-17T11:20:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 -- 172.21.15.35:0/1776894093 shutdown_connections 2023-03-17T11:20:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b21619efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 --2- 172.21.15.35:0/1776894093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b21619e630 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 -- 172.21.15.35:0/1776894093 >> 172.21.15.35:0/1776894093 conn(0x55b215ff96b0 msgr2=0x55b216196a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 -- 172.21.15.35:0/1776894093 shutdown_connections 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 -- 172.21.15.35:0/1776894093 wait complete. 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 -- start start 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.585+0000 7fa5db745b80 1 Processor -- start 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 0x55b2161a7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a46a0 0x55b2161a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:31.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b215f728c0 con 0x55b21619eb70 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2161aaac0 con 0x55b2161a3d90 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2161b41d0 con 0x55b2161a46a0 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5db745b80 10 client.0 _ll_register_callbacks cb 0x55b215f94230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 0x55b2161a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 0x55b2161a7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54722/0 (socket says 172.21.15.35:54722) 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 -- 172.21.15.35:0/769827965 learned_addr learned my addr 172.21.15.35:0/769827965 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a46a0 0x55b2161a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 -- 172.21.15.35:0/769827965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a46a0 msgr2=0x55b2161a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a46a0 0x55b2161a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 -- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 msgr2=0x55b2161a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cd354700 1 -- 172.21.15.35:0/769827965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c810ee80 con 0x55b21619eb70 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.586+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a46a0 0x55b2161a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:31.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5cd354700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 0x55b2161a7990 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4011720 tx=0x7fa5c40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b36dbad7047b368 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/769827965 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4010ee0 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/769827965 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(342..342 src has 1..342) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fa5c4017070 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2160b1390 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/769827965 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c401f840 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 10 client.20547 fetch_fsmap learned FSMap version 102 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55b215f1cd80 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/769827965 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2160b1390 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/769827965 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa5c4031b20 con 0x55b21619eb70 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 10 client.20547 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 10 client.20547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 20 client.20547 populate_metadata read hostname 'smithi035' 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b2161b8340 0x55b2161ba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 4 client.20547 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.587+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2160bd600 con 0x55b2161b8340 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.588+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b2161b8340 0x55b2161ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:31.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.588+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b2161b8340 0x55b2161ba750 crc :-1 s=READY pgs=643 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ec6ff7e7a5a679 server_cookie=8c3912bcbd183b5d in_seq=0 out_seq=0 2023-03-17T11:20:31.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.588+0000 7fa5b0ff9700 10 client.20547 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/769827965 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b2160bd600 con 0x55b2161b8340 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5b0ff9700 10 client.20547 handle_command_reply: tid=0 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 client.20547 shutdown 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 msgr2=0x55b2161a7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 0x55b2161a7990 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4011720 tx=0x7fa5c40047c0 comp rx=0 tx=0).stop 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 shutdown_connections 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b2161b8340 0x55b2161ba750 crc :-1 s=READY pgs=643 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a46a0 0x55b2161a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5b0ff9700 0 client.20547 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b21619eb70 0x55b2161a7990 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 --2- 172.21.15.35:0/769827965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 >> 172.21.15.35:0/769827965 conn(0x55b215ff96b0 msgr2=0x55b21619b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 shutdown_connections 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 1 -- 172.21.15.35:0/769827965 wait complete. 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.589+0000 7fa5db745b80 20 client.20547 trim_cache size 0 max 16384 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 Processor -- start 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 -- start start 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b21619eb70 0x55b216196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a3d90 0x55b2161a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2160b2050 con 0x55b2161a46a0 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2161920f0 con 0x55b21619eb70 2023-03-17T11:20:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5db745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b216197e30 con 0x55b2161a3d90 2023-03-17T11:20:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5cdb55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5cdb55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161a8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54734/0 (socket says 172.21.15.35:54734) 2023-03-17T11:20:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.604+0000 7fa5cdb55700 1 -- 172.21.15.35:0/562116301 learned_addr learned my addr 172.21.15.35:0/562116301 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cd354700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b21619eb70 0x55b216196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a3d90 0x55b2161a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cdb55700 1 -- 172.21.15.35:0/562116301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a3d90 msgr2=0x55b2161a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a3d90 0x55b2161a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cdb55700 1 -- 172.21.15.35:0/562116301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b21619eb70 msgr2=0x55b216196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b21619eb70 0x55b216196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cdb55700 1 -- 172.21.15.35:0/562116301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2160b5130 con 0x55b2161a46a0 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a3d90 0x55b2161a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cd354700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b21619eb70 0x55b216196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161a8240 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009c30 tx=0x7fa5c0009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6865c552c165f4ad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5b3fff700 1 -- 172.21.15.35:0/562116301 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000e040 con 0x55b2161a46a0 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5b3fff700 1 -- 172.21.15.35:0/562116301 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5c0009480 con 0x55b2161a46a0 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.605+0000 7fa5b3fff700 1 -- 172.21.15.35:0/562116301 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00054c0 con 0x55b2161a46a0 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 -- 172.21.15.35:0/562116301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 msgr2=0x55b2161a8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161a8240 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009c30 tx=0x7fa5c0009c60 comp rx=0 tx=0).stop 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 -- 172.21.15.35:0/562116301 shutdown_connections 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161a8240 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b21619eb70 0x55b216196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 --2- 172.21.15.35:0/562116301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2161a3d90 0x55b2161a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 -- 172.21.15.35:0/562116301 >> 172.21.15.35:0/562116301 conn(0x55b215ff96b0 msgr2=0x55b2161a1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:35.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 -- 172.21.15.35:0/562116301 shutdown_connections 2023-03-17T11:20:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 -- 172.21.15.35:0/562116301 wait complete. 2023-03-17T11:20:35.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 -- start start 2023-03-17T11:20:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 Processor -- start 2023-03-17T11:20:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b2161aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.606+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:37.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2161ad9d0 con 0x55b2161a46a0 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2161adb40 con 0x55b2161a3d90 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2161add00 con 0x55b21619eb70 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 10 client.0 _ll_register_callbacks cb 0x55b215f94230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54740/0 (socket says 172.21.15.35:54740) 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 -- 172.21.15.35:0/2517134434 learned_addr learned my addr 172.21.15.35:0/2517134434 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cd354700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b2161aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 -- 172.21.15.35:0/2517134434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 msgr2=0x55b2161aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b2161aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 -- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 msgr2=0x55b2161af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:37.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 -- 172.21.15.35:0/2517134434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c810c7a0 con 0x55b2161a46a0 2023-03-17T11:20:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cd354700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b2161aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:20:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5ccb53700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5cdb55700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161ad300 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000d010 tx=0x7fa5c0003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6666c4dc324bcb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:20:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/2517134434 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000e040 con 0x55b2161a46a0 2023-03-17T11:20:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/2517134434 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(342..342 src has 1..342) v4 ==== 8499+0+0 (secure 0 0 0) 0x7fa5c0025870 con 0x55b2161a46a0 2023-03-17T11:20:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b21616c1e0 con 0x55b2161a46a0 2023-03-17T11:20:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/2517134434 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c0025a30 con 0x55b2161a46a0 2023-03-17T11:20:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 10 client.20553 fetch_fsmap learned FSMap version 102 2023-03-17T11:20:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.607+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55b215f431f0 con 0x55b2161a46a0 2023-03-17T11:20:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/2517134434 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b21616c1e0 con 0x55b2161a46a0 2023-03-17T11:20:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/2517134434 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa5c002d020 con 0x55b2161a46a0 2023-03-17T11:20:39.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:52 smithi035 ceph-mon[92535]: pgmap v4768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:39.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5db745b80 10 client.20553 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:20:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5db745b80 10 client.20553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:20:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5db745b80 20 client.20553 populate_metadata read hostname 'smithi035' 2023-03-17T11:20:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5db745b80 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b21620d040 0x55b21620f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5db745b80 4 client.20553 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:20:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b215f72f00 con 0x55b21620d040 2023-03-17T11:20:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5cd354700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b21620d040 0x55b21620f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5b0ff9700 10 client.20553 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.608+0000 7fa5cd354700 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b21620d040 0x55b21620f450 crc :-1 s=READY pgs=644 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dea03d3459b6a82 server_cookie=c62de9bdc7e4e50c in_seq=0 out_seq=0 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5b0ff9700 1 -- 172.21.15.35:0/2517134434 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b215f72f00 con 0x55b21620d040 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5b0ff9700 10 client.20553 handle_command_reply: tid=0 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 client.20553 shutdown 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 msgr2=0x55b2161ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161ad300 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000d010 tx=0x7fa5c0003d90 comp rx=0 tx=0).stop 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 shutdown_connections 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b21620d040 0x55b21620f450 crc :-1 s=READY pgs=644 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b2161a46a0 0x55b2161ad300 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b21619eb70 0x55b2161aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 --2- 172.21.15.35:0/2517134434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2161a3d90 0x55b2161af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 >> 172.21.15.35:0/2517134434 conn(0x55b215ff96b0 msgr2=0x55b2161a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5b0ff9700 0 client.20553 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 shutdown_connections 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 1 -- 172.21.15.35:0/2517134434 wait complete. 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.627+0000 7fa5db745b80 20 client.20553 trim_cache size 0 max 16384 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5b409f640 msgr2=0x7fa5b40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5b409f640 0x7fa5b40a1af0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4005950 tx=0x7fa5c400b410 comp rx=0 tx=0).stop 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 msgr2=0x7fa5c81957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c81957b0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d950 tx=0x7fa5b800dc60 comp rx=0 tx=0).stop 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 shutdown_connections 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa5b409f640 0x7fa5b40a1af0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8104390 0x7fa5c8199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5c80ff350 0x7fa5c8195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 --2- 172.21.15.35:0/4090219900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa5c80ffcf0 0x7fa5c81957b0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 >> 172.21.15.35:0/4090219900 conn(0x7fa5c8076330 msgr2=0x7fa5c8102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 shutdown_connections 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:57:11.628+0000 7fa5cf5b8700 1 -- 172.21.15.35:0/4090219900 wait complete. 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 -- 172.21.15.35:0/79772438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 msgr2=0x7f65bc10a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 --2- 172.21.15.35:0/79772438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc10a210 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009990 tx=0x7f65b0009ca0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 -- 172.21.15.35:0/79772438 shutdown_connections 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 --2- 172.21.15.35:0/79772438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc10a750 0x7f65bc10cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 --2- 172.21.15.35:0/79772438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 0x7f65bc1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 --2- 172.21.15.35:0/79772438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc10a210 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 -- 172.21.15.35:0/79772438 >> 172.21.15.35:0/79772438 conn(0x7f65bc076330 msgr2=0x7f65bc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 -- 172.21.15.35:0/79772438 shutdown_connections 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.202+0000 7f65c269a700 1 -- 172.21.15.35:0/79772438 wait complete. 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 Processor -- start 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 -- start start 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 0x7f65bc1961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc10a750 0x7f65bc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19b1a0 con 0x7f65bc101d20 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19b310 con 0x7f65bc101410 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.203+0000 7f65c269a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19b4d0 con 0x7f65bc10a750 2023-03-17T11:20:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54756/0 (socket says 172.21.15.35:54756) 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 -- 172.21.15.35:0/2589999858 learned_addr learned my addr 172.21.15.35:0/2589999858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65c0c37700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc10a750 0x7f65bc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 0x7f65bc1961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 -- 172.21.15.35:0/2589999858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc10a750 msgr2=0x7f65bc19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc10a750 0x7f65bc19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 -- 172.21.15.35:0/2589999858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 msgr2=0x7f65bc1961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 0x7f65bc1961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 -- 172.21.15.35:0/2589999858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00095f0 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 0x7f65bc1961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc196700 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006010 tx=0x7f65b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65b97fa700 1 -- 172.21.15.35:0/2589999858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b001d070 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65b97fa700 1 -- 172.21.15.35:0/2589999858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65b0004000 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc1100b0 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65b97fa700 1 -- 172.21.15.35:0/2589999858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0022b50 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.204+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc10ff20 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.206+0000 7f65b97fa700 1 -- 172.21.15.35:0/2589999858 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f65b0003b70 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.207+0000 7f65b97fa700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f65a409f640 0x7f65a40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.207+0000 7f65b97fa700 1 -- 172.21.15.35:0/2589999858 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f65b00cbce0 con 0x7f65bc101d20 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.207+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f65a409f640 0x7f65a40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.208+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f65a409f640 0x7f65a40a1af0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac005e30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.208+0000 7f65ce827b80 1 Processor -- start 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.208+0000 7f65ce827b80 1 -- start start 2023-03-17T11:20:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.208+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.208+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d37ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.208+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d43dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65ce827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67c3a010 con 0x558f67d3d040 2023-03-17T11:20:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65ce827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67c8c950 con 0x558f67d381e0 2023-03-17T11:20:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65ce827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67c85de0 con 0x558f67d37830 2023-03-17T11:20:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:46.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54762/0 (socket says 172.21.15.35:54762) 2023-03-17T11:20:47.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 -- 172.21.15.35:0/893644404 learned_addr learned my addr 172.21.15.35:0/893644404 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:47.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d37ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65c0c37700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d43dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 -- 172.21.15.35:0/893644404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 msgr2=0x558f67d37ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d37ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 -- 172.21.15.35:0/893644404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 msgr2=0x558f67d43dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d43dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 -- 172.21.15.35:0/893644404 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f67b075d0 con 0x558f67d3d040 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d37ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65c0c37700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d43dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65bbfff700 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3d410 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00a5c0 tx=0x7f65ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcf62d0fd854cb5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65a27fc700 1 -- 172.21.15.35:0/893644404 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac010e50 con 0x558f67d3d040 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65a27fc700 1 -- 172.21.15.35:0/893644404 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65ac00eec0 con 0x558f67d3d040 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.209+0000 7f65a27fc700 1 -- 172.21.15.35:0/893644404 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00f800 con 0x558f67d3d040 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 -- 172.21.15.35:0/893644404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 msgr2=0x558f67d3d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3d410 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00a5c0 tx=0x7f65ac011000 comp rx=0 tx=0).stop 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 -- 172.21.15.35:0/893644404 shutdown_connections 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d43dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3d410 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 --2- 172.21.15.35:0/893644404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d37ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 -- 172.21.15.35:0/893644404 >> 172.21.15.35:0/893644404 conn(0x558f67b906b0 msgr2=0x558f67d2da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 -- 172.21.15.35:0/893644404 shutdown_connections 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 -- 172.21.15.35:0/893644404 wait complete. 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.210+0000 7f65ce827b80 1 -- start start 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 Processor -- start 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d43cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d381e0 0x558f67d40fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d41640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67b098c0 con 0x558f67d3d040 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67d41d70 con 0x558f67d37830 2023-03-17T11:20:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67d4d480 con 0x558f67d381e0 2023-03-17T11:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65ce827b80 10 client.0 _ll_register_callbacks cb 0x558f67b2b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d41640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d41640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54772/0 (socket says 172.21.15.35:54772) 2023-03-17T11:20:47.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 -- 172.21.15.35:0/2124589867 learned_addr learned my addr 172.21.15.35:0/2124589867 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:20:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d43cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d381e0 0x558f67d40fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 -- 172.21.15.35:0/2124589867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d381e0 msgr2=0x558f67d40fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d381e0 0x558f67d40fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 -- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 msgr2=0x558f67d43cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d43cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65c0c37700 1 -- 172.21.15.35:0/2124589867 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac00eba0 con 0x558f67d3d040 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.211+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d381e0 0x558f67d40fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65c0c37700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d41640 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f65b4003fc0 tx=0x7f65b4004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19c4b1a119f6b03 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:20:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f659b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:20:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f659b7fe700 1 -- 172.21.15.35:0/2124589867 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4007710 con 0x558f67d3d040 2023-03-17T11:20:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f659b7fe700 1 -- 172.21.15.35:0/2124589867 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f65b4007870 con 0x558f67d3d040 2023-03-17T11:20:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f67c48390 con 0x558f67d3d040 2023-03-17T11:20:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f659b7fe700 1 -- 172.21.15.35:0/2124589867 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65b4004bb0 con 0x558f67d3d040 2023-03-17T11:20:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 10 client.20565 fetch_fsmap learned FSMap version 102 2023-03-17T11:20:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x558f67ab3d80 con 0x558f67d3d040 2023-03-17T11:20:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f659b7fe700 1 -- 172.21.15.35:0/2124589867 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558f67c48390 con 0x558f67d3d040 2023-03-17T11:20:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f659b7fe700 1 -- 172.21.15.35:0/2124589867 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f65b4014070 con 0x558f67d3d040 2023-03-17T11:20:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 10 client.20565 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:20:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 10 client.20565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:20:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 20 client.20565 populate_metadata read hostname 'smithi035' 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67d51540 0x558f67d53950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 4 client.20565 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.212+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f67c54600 con 0x558f67d51540 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.213+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67d51540 0x558f67d53950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.213+0000 7f659b7fe700 10 client.20565 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.213+0000 7f65bbfff700 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67d51540 0x558f67d53950 crc :-1 s=READY pgs=648 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d77295c3eb5279 server_cookie=b5c2246de2c5996d in_seq=0 out_seq=0 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f659b7fe700 1 -- 172.21.15.35:0/2124589867 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558f67c54600 con 0x558f67d51540 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f659b7fe700 10 client.20565 handle_command_reply: tid=0 2023-03-17T11:20:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 client.20565 shutdown 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 msgr2=0x558f67d41640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d41640 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f65b4003fc0 tx=0x7f65b4004320 comp rx=0 tx=0).stop 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 shutdown_connections 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67d51540 0x558f67d53950 crc :-1 s=READY pgs=648 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d41640 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f659b7fe700 0 client.20565 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:20:54.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d43cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 --2- 172.21.15.35:0/2124589867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d381e0 0x558f67d40fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:20:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 >> 172.21.15.35:0/2124589867 conn(0x558f67b906b0 msgr2=0x558f67d32410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:20:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 shutdown_connections 2023-03-17T11:20:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 1 -- 172.21.15.35:0/2124589867 wait complete. 2023-03-17T11:20:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.214+0000 7f65ce827b80 20 client.20565 trim_cache size 0 max 16384 2023-03-17T11:20:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 Processor -- start 2023-03-17T11:20:56.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 -- start start 2023-03-17T11:20:56.839 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:54 smithi035 ceph-mon[92535]: pgmap v4769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:20:58.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:56 smithi035 ceph-mon[92535]: pgmap v4770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:58.152 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:10:58 smithi035 ceph-mon[92535]: pgmap v4771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:58.153 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:00 smithi035 ceph-mon[92535]: pgmap v4772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:20:58.153 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:02 smithi035 ceph-mon[92535]: pgmap v4773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:58.153 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:04 smithi035 ceph-mon[92535]: pgmap v4774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:20:58.153 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:20:58.153 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:06 smithi035 ceph-mon[92535]: pgmap v4775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:08 smithi035 ceph-mon[92535]: pgmap v4776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: pgmap v4777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: pgmap v4778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:09 smithi035 ceph-mon[92535]: osdmap e368: 12 total, 12 up, 12 in 2023-03-17T11:20:59.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:11 smithi035 ceph-mon[92535]: pgmap v4780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 128 B/s wr, 6 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:14 smithi035 ceph-mon[92535]: pgmap v4781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 256 B/s wr, 13 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:16 smithi035 ceph-mon[92535]: pgmap v4782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 256 B/s wr, 13 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:18 smithi035 ceph-mon[92535]: pgmap v4783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:18 smithi035 ceph-mon[92535]: osdmap e369: 12 total, 12 up, 12 in 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:20 smithi035 ceph-mon[92535]: pgmap v4785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 962 B/s wr, 11 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:22 smithi035 ceph-mon[92535]: pgmap v4786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:24 smithi035 ceph-mon[92535]: pgmap v4787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:26 smithi035 ceph-mon[92535]: pgmap v4788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:28 smithi035 ceph-mon[92535]: pgmap v4789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:30 smithi035 ceph-mon[92535]: pgmap v4790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 263 B/s wr, 8 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:32 smithi035 ceph-mon[92535]: pgmap v4791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:34 smithi035 ceph-mon[92535]: pgmap v4792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:36 smithi035 ceph-mon[92535]: pgmap v4793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:38 smithi035 ceph-mon[92535]: pgmap v4794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:40 smithi035 ceph-mon[92535]: pgmap v4795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:20:59.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:42 smithi035 ceph-mon[92535]: pgmap v4796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:44 smithi035 ceph-mon[92535]: pgmap v4797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:46 smithi035 ceph-mon[92535]: pgmap v4798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:48 smithi035 ceph-mon[92535]: pgmap v4799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:50 smithi035 ceph-mon[92535]: pgmap v4800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:52 smithi035 ceph-mon[92535]: pgmap v4801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:54 smithi035 ceph-mon[92535]: pgmap v4802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:56 smithi035 ceph-mon[92535]: pgmap v4803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:11:58 smithi035 ceph-mon[92535]: pgmap v4804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:20:59.764 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:00 smithi035 ceph-mon[92535]: pgmap v4805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:21:01.280 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:02 smithi035 ceph-mon[92535]: pgmap v4806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:21:02.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:04 smithi035 ceph-mon[92535]: pgmap v4807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:21:02.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:06 smithi035 ceph-mon[92535]: pgmap v4808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:21:02.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:08 smithi035 ceph-mon[92535]: pgmap v4809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:21:02.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:09 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:21:02.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:10 smithi035 ceph-mon[92535]: pgmap v4810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T11:21:02.397 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:10 smithi035 ceph-mon[92535]: osdmap e370: 12 total, 12 up, 12 in 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:12 smithi035 ceph-mon[92535]: pgmap v4812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:13 smithi035 ceph-mon[92535]: pgmap v4813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:15 smithi035 ceph-mon[92535]: pgmap v4814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:17 smithi035 ceph-mon[92535]: pgmap v4815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T11:21:02.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:17 smithi035 ceph-mon[92535]: osdmap e371: 12 total, 12 up, 12 in 2023-03-17T11:21:04.683 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:19 smithi035 ceph-mon[92535]: pgmap v4817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 112 B/s wr, 11 op/s 2023-03-17T11:21:04.683 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:21 smithi035 ceph-mon[92535]: pgmap v4818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 107 B/s wr, 10 op/s 2023-03-17T11:21:04.683 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:23 smithi035 ceph-mon[92535]: pgmap v4819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:21:04.683 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:25 smithi035 ceph-mon[92535]: pgmap v4820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:21:04.684 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:27 smithi035 ceph-mon[92535]: pgmap v4821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:21:04.684 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:29 smithi035 ceph-mon[92535]: pgmap v4822: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T11:21:04.684 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:31 smithi035 ceph-mon[92535]: pgmap v4823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:21:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:21:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:21:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:21:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:21:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:21:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:21:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:21:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:21:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:21:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:21:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:21:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:21:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:21:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d2dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d483d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67d2e000 con 0x558f67d3d040 2023-03-17T11:21:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67d290d0 con 0x558f67d381e0 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65ce827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67d2a5c0 con 0x558f67d37830 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65c0c37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65c0c37700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54780/0 (socket says 172.21.15.35:54780) 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65c0c37700 1 -- 172.21.15.35:0/1546235106 learned_addr learned my addr 172.21.15.35:0/1546235106 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65bbfff700 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d2dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.229+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65c0c37700 1 -- 172.21.15.35:0/1546235106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 msgr2=0x558f67d2dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:09.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65c0c37700 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d2dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65c0c37700 1 -- 172.21.15.35:0/1546235106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 msgr2=0x558f67d483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65c0c37700 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65c0c37700 1 -- 172.21.15.35:0/1546235106 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f67c4c130 con 0x558f67d3d040 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65c0c37700 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3c250 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009fd0 tx=0x7f65b4004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bdb4361e0e608b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65a2ffd700 1 -- 172.21.15.35:0/1546235106 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4005650 con 0x558f67d3d040 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65a2ffd700 1 -- 172.21.15.35:0/1546235106 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65b400f070 con 0x558f67d3d040 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65a2ffd700 1 -- 172.21.15.35:0/1546235106 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4007970 con 0x558f67d3d040 2023-03-17T11:21:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65ce827b80 1 -- 172.21.15.35:0/1546235106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 msgr2=0x558f67d3c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.230+0000 7f65ce827b80 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3c250 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009fd0 tx=0x7f65b4004820 comp rx=0 tx=0).stop 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 -- 172.21.15.35:0/1546235106 shutdown_connections 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d3d040 0x558f67d3c250 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d37830 0x558f67d2dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 --2- 172.21.15.35:0/1546235106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d381e0 0x558f67d483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 -- 172.21.15.35:0/1546235106 >> 172.21.15.35:0/1546235106 conn(0x558f67b906b0 msgr2=0x558f67d3b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 -- 172.21.15.35:0/1546235106 shutdown_connections 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 -- 172.21.15.35:0/1546235106 wait complete. 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 -- start start 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.231+0000 7f65ce827b80 1 Processor -- start 2023-03-17T11:21:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d99520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 0x558f67d99a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d3d040 0x558f67da43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67da48f0 con 0x558f67d381e0 2023-03-17T11:21:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67da4a30 con 0x558f67d37830 2023-03-17T11:21:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f67da4ba0 con 0x558f67d3d040 2023-03-17T11:21:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 10 client.0 _ll_register_callbacks cb 0x558f67b2b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:21:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 0x558f67d99a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 0x558f67d99a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54784/0 (socket says 172.21.15.35:54784) 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 -- 172.21.15.35:0/4085261510 learned_addr learned my addr 172.21.15.35:0/4085261510 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65c0c37700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d3d040 0x558f67da43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bbfff700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d99520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 -- 172.21.15.35:0/4085261510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d3d040 msgr2=0x558f67da43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d3d040 0x558f67da43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 -- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 msgr2=0x558f67d99520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d99520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 -- 172.21.15.35:0/4085261510 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f67ab3d80 con 0x558f67d381e0 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65bb7fe700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 0x558f67d99a60 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f65b00036c0 tx=0x7f65b0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9326f72ff9c3665c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f659b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:21:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f659b7fe700 1 -- 172.21.15.35:0/4085261510 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00a1980 con 0x558f67d381e0 2023-03-17T11:21:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f659b7fe700 1 -- 172.21.15.35:0/4085261510 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f65b0098d10 con 0x558f67d381e0 2023-03-17T11:21:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.232+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f67d031e0 con 0x558f67d381e0 2023-03-17T11:21:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f659b7fe700 1 -- 172.21.15.35:0/4085261510 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65b00c91a0 con 0x558f67d381e0 2023-03-17T11:21:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 10 client.20571 fetch_fsmap learned FSMap version 102 2023-03-17T11:21:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x558f67ada1f0 con 0x558f67d381e0 2023-03-17T11:21:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f659b7fe700 1 -- 172.21.15.35:0/4085261510 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558f67d031e0 con 0x558f67d381e0 2023-03-17T11:21:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f659b7fe700 1 -- 172.21.15.35:0/4085261510 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f65b00c9bc0 con 0x558f67d381e0 2023-03-17T11:21:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 10 client.20571 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:21:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 10 client.20571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:21:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 20 client.20571 populate_metadata read hostname 'smithi035' 2023-03-17T11:21:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67da5fc0 0x558f67da83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 4 client.20571 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:21:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f67b09f00 con 0x558f67da5fc0 2023-03-17T11:21:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.233+0000 7f65bbfff700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67da5fc0 0x558f67da83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.234+0000 7f659b7fe700 10 client.20571 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.234+0000 7f65bbfff700 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67da5fc0 0x558f67da83d0 crc :-1 s=READY pgs=649 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e33a76669989a3b server_cookie=18e1e8f8cb851e27 in_seq=0 out_seq=0 2023-03-17T11:21:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.250+0000 7f659b7fe700 1 -- 172.21.15.35:0/4085261510 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f67b09f00 con 0x558f67da5fc0 2023-03-17T11:21:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.250+0000 7f659b7fe700 10 client.20571 handle_command_reply: tid=0 2023-03-17T11:21:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.250+0000 7f65ce827b80 1 client.20571 shutdown 2023-03-17T11:21:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 msgr2=0x558f67d99a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 0x558f67d99a60 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f65b00036c0 tx=0x7f65b0009ca0 comp rx=0 tx=0).stop 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 shutdown_connections 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558f67da5fc0 0x558f67da83d0 crc :-1 s=READY pgs=649 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f67d3d040 0x558f67da43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f659b7fe700 0 client.20571 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f67d37830 0x558f67d99520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 --2- 172.21.15.35:0/4085261510 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558f67d381e0 0x558f67d99a60 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 >> 172.21.15.35:0/4085261510 conn(0x558f67b906b0 msgr2=0x558f67d3c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 shutdown_connections 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 1 -- 172.21.15.35:0/4085261510 wait complete. 2023-03-17T11:21:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65ce827b80 20 client.20571 trim_cache size 0 max 16384 2023-03-17T11:21:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f65a409f640 msgr2=0x7f65a40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f65a409f640 0x7f65a40a1af0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac005e30 comp rx=0 tx=0).stop 2023-03-17T11:21:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 msgr2=0x7f65bc196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc196700 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f65b0006010 tx=0x7f65b0004730 comp rx=0 tx=0).stop 2023-03-17T11:21:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 shutdown_connections 2023-03-17T11:21:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f65a409f640 0x7f65a40a1af0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc10a750 0x7f65bc19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc101410 0x7f65bc1961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 --2- 172.21.15.35:0/2589999858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65bc101d20 0x7f65bc196700 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.251+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 >> 172.21.15.35:0/2589999858 conn(0x7f65bc076330 msgr2=0x7f65bc0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.252+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 shutdown_connections 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:21.252+0000 7f65c269a700 1 -- 172.21.15.35:0/2589999858 wait complete. 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.373+0000 7f4ec3802700 1 -- 172.21.15.35:0/1904589621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ffcf0 msgr2=0x7f4ebc103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.373+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1904589621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ffcf0 0x7f4ebc103cb0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0099c0 tx=0x7f4eac009cd0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 -- 172.21.15.35:0/1904589621 shutdown_connections 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1904589621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc104390 0x7f4ebc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1904589621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1904589621 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ffcf0 0x7f4ebc103cb0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 -- 172.21.15.35:0/1904589621 >> 172.21.15.35:0/1904589621 conn(0x7f4ebc076330 msgr2=0x7f4ebc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 -- 172.21.15.35:0/1904589621 shutdown_connections 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 -- 172.21.15.35:0/1904589621 wait complete. 2023-03-17T11:21:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 Processor -- start 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.374+0000 7f4ec3802700 1 -- start start 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc194090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0ffcf0 0x7f4ebc1945d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc104390 0x7f4ebc198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc199070 con 0x7f4ebc0ff350 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc1991e0 con 0x7f4ebc104390 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc1993a0 con 0x7f4ebc0ffcf0 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc194090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc194090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54818/0 (socket says 172.21.15.35:54818) 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 -- 172.21.15.35:0/1261554256 learned_addr learned my addr 172.21.15.35:0/1261554256 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0ffcf0 0x7f4ebc1945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc104390 0x7f4ebc198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 -- 172.21.15.35:0/1261554256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0ffcf0 msgr2=0x7f4ebc1945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0ffcf0 0x7f4ebc1945d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 -- 172.21.15.35:0/1261554256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc104390 msgr2=0x7f4ebc198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc104390 0x7f4ebc198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 -- 172.21.15.35:0/1261554256 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0095f0 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc104390 0x7f4ebc198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec159e700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc194090 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8007bd0 tx=0x7f4eb8007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4eb27fc700 1 -- 172.21.15.35:0/1261554256 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8010040 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4eb27fc700 1 -- 172.21.15.35:0/1261554256 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4eb800fe60 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc10df10 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.375+0000 7f4eb27fc700 1 -- 172.21.15.35:0/1261554256 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8015e70 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.376+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc10dd80 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.378+0000 7f4eb27fc700 1 -- 172.21.15.35:0/1261554256 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4eb800f9d0 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.378+0000 7f4eb27fc700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ea809f6c0 0x7f4ea80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.378+0000 7f4eb27fc700 1 -- 172.21.15.35:0/1261554256 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4eb80caae0 con 0x7f4ebc0ff350 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.378+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ea809f6c0 0x7f4ea80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.379+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ea809f6c0 0x7f4ea80a1b70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4eac000c00 tx=0x7f4eac00b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.379+0000 7f4ecf98fb80 1 Processor -- start 2023-03-17T11:21:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.379+0000 7f4ecf98fb80 1 -- start start 2023-03-17T11:21:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x56064352efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352f4f0 0x560643529420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643529d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560643430010 con 0x56064352ebe0 2023-03-17T11:21:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560643482950 con 0x56064352f4f0 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064347bde0 con 0x560643529960 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x56064352efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x56064352efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54826/0 (socket says 172.21.15.35:54826) 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 -- 172.21.15.35:0/2704440999 learned_addr learned my addr 172.21.15.35:0/2704440999 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643529d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352f4f0 0x560643529420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 -- 172.21.15.35:0/2704440999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 msgr2=0x560643529d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643529d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 -- 172.21.15.35:0/2704440999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352f4f0 msgr2=0x560643529420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352f4f0 0x560643529420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 -- 172.21.15.35:0/2704440999 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606432fd5d0 con 0x56064352ebe0 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352f4f0 0x560643529420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x56064352efb0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80a0250 tx=0x7f4eb8098430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7989ba549c3fe7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ea77fe700 1 -- 172.21.15.35:0/2704440999 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800fc80 con 0x56064352ebe0 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ea77fe700 1 -- 172.21.15.35:0/2704440999 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4eb8098590 con 0x56064352ebe0 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.380+0000 7f4ea77fe700 1 -- 172.21.15.35:0/2704440999 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb809c3e0 con 0x56064352ebe0 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2704440999 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 msgr2=0x56064352efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x56064352efb0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80a0250 tx=0x7f4eb8098430 comp rx=0 tx=0).stop 2023-03-17T11:21:24.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:33 smithi035 ceph-mon[92535]: pgmap v4824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:21:26.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2704440999 shutdown_connections 2023-03-17T11:21:26.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643529d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:26.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x56064352efb0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2704440999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352f4f0 0x560643529420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2704440999 >> 172.21.15.35:0/2704440999 conn(0x5606433866b0 msgr2=0x560643523a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2704440999 shutdown_connections 2023-03-17T11:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.381+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2704440999 wait complete. 2023-03-17T11:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 -- start start 2023-03-17T11:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 Processor -- start 2023-03-17T11:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560643529960 0x560643535520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x560643532730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643532e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606432ff8c0 con 0x56064352ebe0 2023-03-17T11:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606435335b0 con 0x560643529960 2023-03-17T11:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064353f000 con 0x56064352f4f0 2023-03-17T11:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ecf98fb80 10 client.0 _ll_register_callbacks cb 0x560643321230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:21:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ec0d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x560643532730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ec0d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x560643532730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54834/0 (socket says 172.21.15.35:54834) 2023-03-17T11:21:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ec0d9d700 1 -- 172.21.15.35:0/4070859966 learned_addr learned my addr 172.21.15.35:0/4070859966 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.382+0000 7f4ec159e700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560643529960 0x560643535520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:28.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643532e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec0d9d700 1 -- 172.21.15.35:0/4070859966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 msgr2=0x560643532e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643532e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec0d9d700 1 -- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560643529960 msgr2=0x560643535520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560643529960 0x560643535520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec0d9d700 1 -- 172.21.15.35:0/4070859966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc10dd80 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x560643532730 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f4eac015000 tx=0x7f4eac009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be15479fd5e902b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ea4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/4070859966 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac003dd0 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/4070859966 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4eac00f460 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56064343e390 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/4070859966 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4eac00f620 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ecf98fb80 10 client.20583 fetch_fsmap learned FSMap version 102 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5606432a9d80 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.383+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/4070859966 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56064343e390 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/4070859966 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4eac022770 con 0x56064352ebe0 2023-03-17T11:21:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ecf98fb80 10 client.20583 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:21:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ecf98fb80 10 client.20583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:21:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ecf98fb80 20 client.20583 populate_metadata read hostname 'smithi035' 2023-03-17T11:21:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643543120 0x560643545530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ecf98fb80 4 client.20583 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:21:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56064344a600 con 0x560643543120 2023-03-17T11:21:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ec159e700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643543120 0x560643545530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ea4ff9700 10 client.20583 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.384+0000 7f4ec159e700 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643543120 0x560643545530 crc :-1 s=READY pgs=650 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eb60755465fa2d7 server_cookie=74e22304014aeb4b in_seq=0 out_seq=0 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/4070859966 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56064344a600 con 0x560643543120 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ea4ff9700 10 client.20583 handle_command_reply: tid=0 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 client.20583 shutdown 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 msgr2=0x560643532730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x560643532730 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f4eac015000 tx=0x7f4eac009310 comp rx=0 tx=0).stop 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 shutdown_connections 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643543120 0x560643545530 crc :-1 s=READY pgs=650 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643532e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ea4ff9700 0 client.20583 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560643529960 0x560643535520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/4070859966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352ebe0 0x560643532730 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 >> 172.21.15.35:0/4070859966 conn(0x5606433866b0 msgr2=0x560643528410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 shutdown_connections 2023-03-17T11:21:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/4070859966 wait complete. 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.385+0000 7f4ecf98fb80 20 client.20583 trim_cache size 0 max 16384 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.400+0000 7f4ecf98fb80 1 Processor -- start 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 -- start start 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643523ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x560643539f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 0x560643535050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064343e390 con 0x56064352f4f0 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56064351f0f0 con 0x56064352ebe0 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560643524000 con 0x560643529960 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 0x560643535050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 0x560643535050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54844/0 (socket says 172.21.15.35:54844) 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 -- 172.21.15.35:0/2524258438 learned_addr learned my addr 172.21.15.35:0/2524258438 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643523ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x560643539f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 -- 172.21.15.35:0/2524258438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 msgr2=0x560643523ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643523ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 -- 172.21.15.35:0/2524258438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 msgr2=0x560643539f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x560643539f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 -- 172.21.15.35:0/2524258438 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560643442130 con 0x56064352f4f0 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.401+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 0x560643535050 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40094c0 tx=0x7f4eb4011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6141638012d2ef01 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ea7fff700 1 -- 172.21.15.35:0/2524258438 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4014070 con 0x56064352f4f0 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ea7fff700 1 -- 172.21.15.35:0/2524258438 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4eb4015040 con 0x56064352f4f0 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ea7fff700 1 -- 172.21.15.35:0/2524258438 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400e890 con 0x56064352f4f0 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2524258438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 msgr2=0x560643535050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 0x560643535050 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40094c0 tx=0x7f4eb4011040 comp rx=0 tx=0).stop 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2524258438 shutdown_connections 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56064352f4f0 0x560643535050 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560643529960 0x560643523ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2524258438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x560643539f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2524258438 >> 172.21.15.35:0/2524258438 conn(0x5606433866b0 msgr2=0x560643528a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2524258438 shutdown_connections 2023-03-17T11:21:31.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.402+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2524258438 wait complete. 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 -- start start 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 Processor -- start 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 0x560643539c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x56064353a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643538170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560643538850 con 0x560643529960 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606435389c0 con 0x56064352ebe0 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560643538b80 con 0x56064352f4f0 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ecf98fb80 10 client.0 _ll_register_callbacks cb 0x560643321230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ec159e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 0x560643539c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ec159e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 0x560643539c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54846/0 (socket says 172.21.15.35:54846) 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ec159e700 1 -- 172.21.15.35:0/2274795178 learned_addr learned my addr 172.21.15.35:0/2274795178 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x56064353a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ec1d9f700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643538170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.403+0000 7f4ec159e700 1 -- 172.21.15.35:0/2274795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 msgr2=0x560643538170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643538170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ec159e700 1 -- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 msgr2=0x56064353a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x56064353a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ec159e700 1 -- 172.21.15.35:0/2274795178 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb4009170 con 0x560643529960 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x56064353a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ec159e700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 0x560643539c10 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8098290 tx=0x7f4eb8098200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586b78348d94fdf8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ea4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/2274795178 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80a0780 con 0x560643529960 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/2274795178 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4eb809c150 con 0x560643529960 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606434f91e0 con 0x560643529960 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/2274795178 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4eb809c310 con 0x560643529960 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 10 client.20589 fetch_fsmap learned FSMap version 102 2023-03-17T11:21:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5606432d01f0 con 0x560643529960 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/2274795178 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5606434f91e0 con 0x560643529960 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/2274795178 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f4eb80b3c80 con 0x560643529960 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 10 client.20589 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 10 client.20589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 20 client.20589 populate_metadata read hostname 'smithi035' 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643597e00 0x56064359a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 4 client.20589 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.404+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5606432fff00 con 0x560643597e00 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.405+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643597e00 0x56064359a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.405+0000 7f4ea4ff9700 10 client.20589 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.405+0000 7f4ec0d9d700 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643597e00 0x56064359a210 crc :-1 s=READY pgs=651 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a8617b0c8e3cf9e server_cookie=152ee1eb9d2927f4 in_seq=0 out_seq=0 2023-03-17T11:21:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ea4ff9700 1 -- 172.21.15.35:0/2274795178 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5606432fff00 con 0x560643597e00 2023-03-17T11:21:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ea4ff9700 10 client.20589 handle_command_reply: tid=0 2023-03-17T11:21:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 client.20589 shutdown 2023-03-17T11:21:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 msgr2=0x560643539c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 0x560643539c10 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8098290 tx=0x7f4eb8098200 comp rx=0 tx=0).stop 2023-03-17T11:21:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 shutdown_connections 2023-03-17T11:21:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560643597e00 0x56064359a210 crc :-1 s=READY pgs=651 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56064352f4f0 0x560643538170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ea4ff9700 0 client.20589 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560643529960 0x560643539c10 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 --2- 172.21.15.35:0/2274795178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56064352ebe0 0x56064353a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 >> 172.21.15.35:0/2274795178 conn(0x5606433866b0 msgr2=0x560643531fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 shutdown_connections 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 1 -- 172.21.15.35:0/2274795178 wait complete. 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.414+0000 7f4ecf98fb80 20 client.20589 trim_cache size 0 max 16384 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ea809f6c0 msgr2=0x7f4ea80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ea809f6c0 0x7f4ea80a1b70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4eac000c00 tx=0x7f4eac00b540 comp rx=0 tx=0).stop 2023-03-17T11:21:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 msgr2=0x7f4ebc194090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc194090 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8007bd0 tx=0x7f4eb8007ee0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 shutdown_connections 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4ea809f6c0 0x7f4ea80a1b70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ebc104390 0x7f4ebc198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4ebc0ff350 0x7f4ebc194090 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 --2- 172.21.15.35:0/1261554256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0ffcf0 0x7f4ebc1945d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 >> 172.21.15.35:0/1261554256 conn(0x7f4ebc076330 msgr2=0x7f4ebc0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 shutdown_connections 2023-03-17T11:21:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:34.415+0000 7f4ec3802700 1 -- 172.21.15.35:0/1261554256 wait complete. 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 -- 172.21.15.35:0/197940492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 msgr2=0x7fdc1010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/197940492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc1010bfc0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800b0d0 tx=0x7fdc0800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 -- 172.21.15.35:0/197940492 shutdown_connections 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/197940492 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc1010bfc0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/197940492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 0x7fdc100ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/197940492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc100ffd50 0x7fdc10103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 -- 172.21.15.35:0/197940492 >> 172.21.15.35:0/197940492 conn(0x7fdc10075f60 msgr2=0x7fdc10076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 -- 172.21.15.35:0/197940492 shutdown_connections 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.537+0000 7fdc16f0e700 1 -- 172.21.15.35:0/197940492 wait complete. 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 Processor -- start 2023-03-17T11:21:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 -- start start 2023-03-17T11:21:36.815 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:35 smithi035 ceph-mon[92535]: pgmap v4825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:21:36.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 0x7fdc10100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc100ffd50 0x7fdc101012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc101a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10101b20 con 0x7fdc101043f0 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc101a4ad0 con 0x7fdc100ffd50 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc16f0e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc101a4c10 con 0x7fdc100ff3b0 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc101a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc101a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54868/0 (socket says 172.21.15.35:54868) 2023-03-17T11:21:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 -- 172.21.15.35:0/4174420758 learned_addr learned my addr 172.21.15.35:0/4174420758 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc100ffd50 0x7fdc101012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc14caa700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 0x7fdc10100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 -- 172.21.15.35:0/4174420758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 msgr2=0x7fdc10100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 0x7fdc10100db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 -- 172.21.15.35:0/4174420758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc100ffd50 msgr2=0x7fdc101012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.538+0000 7fdc154ab700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc100ffd50 0x7fdc101012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc154ab700 1 -- 172.21.15.35:0/4174420758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009d00 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc14caa700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 0x7fdc10100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc154ab700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc101a4590 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fdc08008ec0 tx=0x7fdc08008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc0dffb700 1 -- 172.21.15.35:0/4174420758 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800e040 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc0dffb700 1 -- 172.21.15.35:0/4174420758 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc0800be30 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1010f020 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc0dffb700 1 -- 172.21.15.35:0/4174420758 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0801b6c0 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.539+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1010ee90 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.541+0000 7fdc0dffb700 1 -- 172.21.15.35:0/4174420758 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdc08024410 con 0x7fdc101043f0 2023-03-17T11:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.542+0000 7fdc0dffb700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc0009f6c0 0x7fdc000a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.542+0000 7fdc0dffb700 1 -- 172.21.15.35:0/4174420758 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdc080cb7a0 con 0x7fdc101043f0 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.542+0000 7fdc14caa700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc0009f6c0 0x7fdc000a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc14caa700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc0009f6c0 0x7fdc000a1b70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009be0 tx=0x7fdc04009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 Processor -- start 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 -- start start 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b8161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b815c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b8063010 con 0x5579b8161be0 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b80b5950 con 0x5579b815c960 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b80aede0 con 0x5579b81624f0 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc14caa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b8161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc14caa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b8161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54872/0 (socket says 172.21.15.35:54872) 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.543+0000 7fdc14caa700 1 -- 172.21.15.35:0/1709466045 learned_addr learned my addr 172.21.15.35:0/1709466045 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc154ab700 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc14caa700 1 -- 172.21.15.35:0/1709466045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 msgr2=0x5579b815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc14caa700 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b815c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc14caa700 1 -- 172.21.15.35:0/1709466045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 msgr2=0x5579b815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc14caa700 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc14caa700 1 -- 172.21.15.35:0/1709466045 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579b7f305d0 con 0x5579b8161be0 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc154ab700 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdc14caa700 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b8161fb0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fdc04010d00 tx=0x7fdc04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cd513a09ecee63 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdbfaffd700 1 -- 172.21.15.35:0/1709466045 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04012b60 con 0x5579b8161be0 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdbfaffd700 1 -- 172.21.15.35:0/1709466045 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc04012cc0 con 0x5579b8161be0 2023-03-17T11:21:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.544+0000 7fdbfaffd700 1 -- 172.21.15.35:0/1709466045 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0401e610 con 0x5579b8161be0 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1709466045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 msgr2=0x5579b8161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b8161fb0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fdc04010d00 tx=0x7fdc04013000 comp rx=0 tx=0).stop 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1709466045 shutdown_connections 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b8161fb0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1709466045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1709466045 >> 172.21.15.35:0/1709466045 conn(0x5579b7fb96b0 msgr2=0x5579b8156a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1709466045 shutdown_connections 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1709466045 wait complete. 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 -- start start 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.545+0000 7fdc2309bb80 1 Processor -- start 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b8168400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b8161be0 0x5579b8165610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8165b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b7f328c0 con 0x5579b815c960 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b81662d0 con 0x5579b8161be0 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b8166490 con 0x5579b81624f0 2023-03-17T11:21:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc2309bb80 10 client.0 _ll_register_callbacks cb 0x5579b7f54230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b8168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b8168400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54878/0 (socket says 172.21.15.35:54878) 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 -- 172.21.15.35:0/1687526227 learned_addr learned my addr 172.21.15.35:0/1687526227 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc154ab700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b8161be0 0x5579b8165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 -- 172.21.15.35:0/1687526227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 msgr2=0x5579b8165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8165b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 -- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b8161be0 msgr2=0x5579b8165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b8161be0 0x5579b8165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 -- 172.21.15.35:0/1687526227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc040109b0 con 0x5579b815c960 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdc14caa700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b8168400 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fdc04010950 tx=0x7fdc04012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d817777078ea862a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.546+0000 7fdbeffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdbeffff700 1 -- 172.21.15.35:0/1687526227 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0402f070 con 0x5579b815c960 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdbeffff700 1 -- 172.21.15.35:0/1687526227 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdc04005250 con 0x5579b815c960 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579b8071390 con 0x5579b815c960 2023-03-17T11:21:42.376 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdbeffff700 1 -- 172.21.15.35:0/1687526227 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc04012e00 con 0x5579b815c960 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 10 client.20601 fetch_fsmap learned FSMap version 102 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5579b7edcd80 con 0x5579b815c960 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdbeffff700 1 -- 172.21.15.35:0/1687526227 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5579b8071390 con 0x5579b815c960 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdbeffff700 1 -- 172.21.15.35:0/1687526227 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdc040036a0 con 0x5579b815c960 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 10 client.20601 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 10 client.20601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 20 client.20601 populate_metadata read hostname 'smithi035' 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b8175ee0 0x5579b81782f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 4 client.20601 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.547+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579b807d600 con 0x5579b8175ee0 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.548+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b8175ee0 0x5579b81782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.548+0000 7fdbeffff700 10 client.20601 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.548+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b8175ee0 0x5579b81782f0 crc :-1 s=READY pgs=652 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b30a4464025d36 server_cookie=c43da018c2c02a5d in_seq=0 out_seq=0 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdbeffff700 1 -- 172.21.15.35:0/1687526227 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5579b807d600 con 0x5579b8175ee0 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdbeffff700 10 client.20601 handle_command_reply: tid=0 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 client.20601 shutdown 2023-03-17T11:21:42.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 msgr2=0x5579b8168400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b8168400 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fdc04010950 tx=0x7fdc04012be0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 shutdown_connections 2023-03-17T11:21:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b8175ee0 0x5579b81782f0 crc :-1 s=READY pgs=652 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:42.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:44.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b8168400 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdbeffff700 0 client.20601 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/1687526227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b8161be0 0x5579b8165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 >> 172.21.15.35:0/1687526227 conn(0x5579b7fb96b0 msgr2=0x5579b815b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 shutdown_connections 2023-03-17T11:21:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 1 -- 172.21.15.35:0/1687526227 wait complete. 2023-03-17T11:21:44.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.549+0000 7fdc2309bb80 20 client.20601 trim_cache size 0 max 16384 2023-03-17T11:21:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.564+0000 7fdc2309bb80 1 Processor -- start 2023-03-17T11:21:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.564+0000 7fdc2309bb80 1 -- start start 2023-03-17T11:21:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b8156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b816cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8167f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b8157000 con 0x5579b8161be0 2023-03-17T11:21:48.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b81601b0 con 0x5579b815c960 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b81576d0 con 0x5579b81624f0 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b816cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b816cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54888/0 (socket says 172.21.15.35:54888) 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 -- 172.21.15.35:0/280942301 learned_addr learned my addr 172.21.15.35:0/280942301 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc154ab700 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 -- 172.21.15.35:0/280942301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 msgr2=0x5579b8167f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8167f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:48.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc14caa700 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b8156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 -- 172.21.15.35:0/280942301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 msgr2=0x5579b8156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b8156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 -- 172.21.15.35:0/280942301 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579b8075130 con 0x5579b8161be0 2023-03-17T11:21:48.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc14caa700 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b816cfb0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fdc101025a0 tx=0x7fdbfc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fd1b9efe4e1d4f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdbfb7fe700 1 -- 172.21.15.35:0/280942301 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc017040 con 0x5579b8161be0 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdbfb7fe700 1 -- 172.21.15.35:0/280942301 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbfc01c5a0 con 0x5579b8161be0 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.565+0000 7fdbfb7fe700 1 -- 172.21.15.35:0/280942301 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0043d0 con 0x5579b8161be0 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 -- 172.21.15.35:0/280942301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 msgr2=0x5579b816cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b816cfb0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fdc101025a0 tx=0x7fdbfc011720 comp rx=0 tx=0).stop 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 -- 172.21.15.35:0/280942301 shutdown_connections 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b81624f0 0x5579b8167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b815c960 0x5579b8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/280942301 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b8161be0 0x5579b816cfb0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 -- 172.21.15.35:0/280942301 >> 172.21.15.35:0/280942301 conn(0x5579b7fb96b0 msgr2=0x5579b8171740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 -- 172.21.15.35:0/280942301 shutdown_connections 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.566+0000 7fdc2309bb80 1 -- 172.21.15.35:0/280942301 wait complete. 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 -- start start 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 Processor -- start 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b816cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b8161be0 0x5579b816b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b81624f0 0x5579b816b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b816bf40 con 0x5579b815c960 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b816c0b0 con 0x5579b81624f0 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579b816c270 con 0x5579b8161be0 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc2309bb80 10 client.0 _ll_register_callbacks cb 0x5579b7f54230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc14caa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b816cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc14caa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b816cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54892/0 (socket says 172.21.15.35:54892) 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc14caa700 1 -- 172.21.15.35:0/2763477511 learned_addr learned my addr 172.21.15.35:0/2763477511 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:21:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc154ab700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b81624f0 0x5579b816b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:49.277 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:37 smithi035 ceph-mon[92535]: pgmap v4826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:21:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.567+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b8161be0 0x5579b816b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc14caa700 1 -- 172.21.15.35:0/2763477511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b8161be0 msgr2=0x5579b816b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc14caa700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b8161be0 0x5579b816b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc14caa700 1 -- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b81624f0 msgr2=0x5579b816b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:21:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc14caa700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b81624f0 0x5579b816b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc14caa700 1 -- 172.21.15.35:0/2763477511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc007a20 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b8161be0 0x5579b816b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc14caa700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b816cf10 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009700 tx=0x7fdc04004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2421176060878a1b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdbeffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdbeffff700 1 -- 172.21.15.35:0/2763477511 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0402f040 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdbeffff700 1 -- 172.21.15.35:0/2763477511 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdc04005460 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579b812c1e0 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdbeffff700 1 -- 172.21.15.35:0/2763477511 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc04005620 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc2309bb80 10 client.20607 fetch_fsmap learned FSMap version 102 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x5579b7f031f0 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdbeffff700 1 -- 172.21.15.35:0/2763477511 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5579b812c1e0 con 0x5579b815c960 2023-03-17T11:21:54.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.568+0000 7fdbeffff700 1 -- 172.21.15.35:0/2763477511 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdc04028450 con 0x5579b815c960 2023-03-17T11:21:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc2309bb80 10 client.20607 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:21:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc2309bb80 10 client.20607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:21:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc2309bb80 20 client.20607 populate_metadata read hostname 'smithi035' 2023-03-17T11:21:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b81caea0 0x5579b81cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:21:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc2309bb80 4 client.20607 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:21:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5579b7f32f00 con 0x5579b81caea0 2023-03-17T11:21:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b81caea0 0x5579b81cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:21:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdbeffff700 10 client.20607 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:21:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.569+0000 7fdc0ffff700 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b81caea0 0x5579b81cd2b0 crc :-1 s=READY pgs=653 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa76f88347a2d9d server_cookie=58f2db777c82f8e1 in_seq=0 out_seq=0 2023-03-17T11:21:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.578+0000 7fdbeffff700 1 -- 172.21.15.35:0/2763477511 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5579b7f32f00 con 0x5579b81caea0 2023-03-17T11:21:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.578+0000 7fdbeffff700 10 client.20607 handle_command_reply: tid=0 2023-03-17T11:21:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.578+0000 7fdc2309bb80 1 client.20607 shutdown 2023-03-17T11:21:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 msgr2=0x5579b816cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:21:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b816cf10 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009700 tx=0x7fdc04004c90 comp rx=0 tx=0).stop 2023-03-17T11:21:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 shutdown_connections 2023-03-17T11:21:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5579b81caea0 0x5579b81cd2b0 crc :-1 s=READY pgs=653 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:21:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5579b81624f0 0x5579b816b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdbeffff700 0 client.20607 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5579b815c960 0x5579b816cf10 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 --2- 172.21.15.35:0/2763477511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579b8161be0 0x5579b816b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 >> 172.21.15.35:0/2763477511 conn(0x5579b7fb96b0 msgr2=0x5579b815f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 shutdown_connections 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 1 -- 172.21.15.35:0/2763477511 wait complete. 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc2309bb80 20 client.20607 trim_cache size 0 max 16384 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc0009f6c0 msgr2=0x7fdc000a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc0009f6c0 0x7fdc000a1b70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009be0 tx=0x7fdc04009260 comp rx=0 tx=0).stop 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 msgr2=0x7fdc101a4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.579+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc101a4590 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fdc08008ec0 tx=0x7fdc08008ef0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 shutdown_connections 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc0009f6c0 0x7fdc000a1b70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc101043f0 0x7fdc101a4590 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc100ff3b0 0x7fdc10100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 --2- 172.21.15.35:0/4174420758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc100ffd50 0x7fdc101012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 >> 172.21.15.35:0/4174420758 conn(0x7fdc10075f60 msgr2=0x7fdc10068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 shutdown_connections 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T10:59:47.580+0000 7fdc16f0e700 1 -- 172.21.15.35:0/4174420758 wait complete. 2023-03-17T11:22:00.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 -- 172.21.15.35:0/2305659765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 msgr2=0x7f637c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 --2- 172.21.15.35:0/2305659765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c10d090 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f637400b0d0 tx=0x7f637400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:22:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 -- 172.21.15.35:0/2305659765 shutdown_connections 2023-03-17T11:22:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 --2- 172.21.15.35:0/2305659765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c10d090 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 --2- 172.21.15.35:0/2305659765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0fe970 0x7f637c0fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 --2- 172.21.15.35:0/2305659765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0ff310 0x7f637c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 -- 172.21.15.35:0/2305659765 >> 172.21.15.35:0/2305659765 conn(0x7f637c0757a0 msgr2=0x7f637c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 -- 172.21.15.35:0/2305659765 shutdown_connections 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.716+0000 7f63834cc700 1 -- 172.21.15.35:0/2305659765 wait complete. 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 Processor -- start 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 -- start start 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0fe970 0x7f637c0ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0ff310 0x7f637c0ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c1a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c100650 con 0x7f637c105510 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1a4b30 con 0x7f637c0fe970 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f63834cc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1a4c70 con 0x7f637c0ff310 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f6381a69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c1a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.717+0000 7f6380a67700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0ff310 0x7f637c0ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c1a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54906/0 (socket says 172.21.15.35:54906) 2023-03-17T11:22:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 -- 172.21.15.35:0/153153518 learned_addr learned my addr 172.21.15.35:0/153153518 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381268700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0fe970 0x7f637c0ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:03.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 -- 172.21.15.35:0/153153518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0ff310 msgr2=0x7f637c0ffe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:03.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0ff310 0x7f637c0ffe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:03.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 -- 172.21.15.35:0/153153518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0fe970 msgr2=0x7f637c0ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:03.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0fe970 0x7f637c0ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:03.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 -- 172.21.15.35:0/153153518 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009520 con 0x7f637c105510 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6380a67700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0ff310 0x7f637c0ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f6381a69700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c1a45f0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f6374008e50 tx=0x7f6374008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f63727fc700 1 -- 172.21.15.35:0/153153518 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400e040 con 0x7f637c105510 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f63727fc700 1 -- 172.21.15.35:0/153153518 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6374003e90 con 0x7f637c105510 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f63727fc700 1 -- 172.21.15.35:0/153153518 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637401b460 con 0x7f637c105510 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6374009d00 con 0x7f637c105510 2023-03-17T11:22:05.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.718+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c1100f0 con 0x7f637c105510 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.721+0000 7f63727fc700 1 -- 172.21.15.35:0/153153518 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6374003a00 con 0x7f637c105510 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.725+0000 7f638f659b80 1 Processor -- start 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.725+0000 7f638f659b80 1 -- start start 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f638f659b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c607787c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f638f659b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c60778d00 0x561c60772c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f638f659b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c60773630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f638f659b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60671010 con 0x561c607783f0 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f638f659b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c606c3950 con 0x561c607731c0 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f638f659b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c606bcde0 con 0x561c60778d00 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f63727fc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f636809f6c0 0x7f63680a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f6380a67700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c60773630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f6380a67700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c607787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:05.183 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f6380a67700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c607787c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54908/0 (socket says 172.21.15.35:54908) 2023-03-17T11:22:05.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f6380a67700 1 -- 172.21.15.35:0/1354495868 learned_addr learned my addr 172.21.15.35:0/1354495868 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.726+0000 7f63727fc700 1 -- 172.21.15.35:0/153153518 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f63740cb630 con 0x7f637c105510 2023-03-17T11:22:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6380a67700 1 -- 172.21.15.35:0/1354495868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c60778d00 msgr2=0x561c60772c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-17T11:22:08.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6380a67700 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c60778d00 0x561c60772c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6380a67700 1 -- 172.21.15.35:0/1354495868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 msgr2=0x561c60773630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6380a67700 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c60773630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6380a67700 1 -- 172.21.15.35:0/1354495868 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c6053e5d0 con 0x561c607783f0 2023-03-17T11:22:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6381a69700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f636809f6c0 0x7f63680a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f6380a67700 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c607787c0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f636c009fd0 tx=0x7f636c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87b741e601eecec server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f63677fe700 1 -- 172.21.15.35:0/1354495868 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c013070 con 0x561c607783f0 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f63677fe700 1 -- 172.21.15.35:0/1354495868 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f636c0044c0 con 0x561c607783f0 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.727+0000 7f63677fe700 1 -- 172.21.15.35:0/1354495868 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c004cb0 con 0x561c607783f0 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 -- 172.21.15.35:0/1354495868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 msgr2=0x561c607787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f6381a69700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f636809f6c0 0x7f63680a1b70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6374095be0 tx=0x7f6374009600 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c607787c0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f636c009fd0 tx=0x7f636c009260 comp rx=0 tx=0).stop 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 -- 172.21.15.35:0/1354495868 shutdown_connections 2023-03-17T11:22:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c60773630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c607787c0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 --2- 172.21.15.35:0/1354495868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c60778d00 0x561c60772c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 -- 172.21.15.35:0/1354495868 >> 172.21.15.35:0/1354495868 conn(0x561c605c76b0 msgr2=0x561c60764a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 -- 172.21.15.35:0/1354495868 shutdown_connections 2023-03-17T11:22:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.728+0000 7f638f659b80 1 -- 172.21.15.35:0/1354495868 wait complete. 2023-03-17T11:22:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.729+0000 7f638f659b80 1 -- start start 2023-03-17T11:22:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.729+0000 7f638f659b80 1 Processor -- start 2023-03-17T11:22:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.729+0000 7f638f659b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c6077c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:14.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.729+0000 7f638f659b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c6077c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f638f659b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 0x561c607719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f638f659b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c605408c0 con 0x561c607783f0 2023-03-17T11:22:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f638f659b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c6077d360 con 0x561c60778d00 2023-03-17T11:22:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f638f659b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60771ee0 con 0x561c607731c0 2023-03-17T11:22:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f638f659b80 10 client.0 _ll_register_callbacks cb 0x561c60562230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:22:14.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 0x561c607719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 0x561c607719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:56714/0 (socket says 172.21.15.35:56714) 2023-03-17T11:22:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 -- 172.21.15.35:0/2520086428 learned_addr learned my addr 172.21.15.35:0/2520086428 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c6077c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6381268700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c6077c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 -- 172.21.15.35:0/2520086428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 msgr2=0x561c6077c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c6077c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 -- 172.21.15.35:0/2520086428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 msgr2=0x561c6077c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c6077c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.730+0000 7f6380a67700 1 -- 172.21.15.35:0/2520086428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c01b040 con 0x561c60778d00 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f6380a67700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 0x561c607719a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f636c0130a0 tx=0x7f636c0058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6baa3a553b3c6f7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f6364ff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:22:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f6364ff9700 1 -- 172.21.15.35:0/2520086428 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c004020 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c6067f390 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f6364ff9700 1 -- 172.21.15.35:0/2520086428 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f636c004180 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f6364ff9700 1 -- 172.21.15.35:0/2520086428 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f636c004340 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f638f659b80 10 client.29699 fetch_fsmap learned FSMap version 102 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x561c604ead80 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.731+0000 7f6364ff9700 1 -- 172.21.15.35:0/2520086428 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c6067f390 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f6364ff9700 1 -- 172.21.15.35:0/2520086428 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f636c0106b0 con 0x561c60778d00 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f638f659b80 10 client.29699 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f638f659b80 10 client.29699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f638f659b80 20 client.29699 populate_metadata read hostname 'smithi035' 2023-03-17T11:22:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f638f659b80 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607950b0 0x561c607974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f638f659b80 4 client.29699 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c6068b600 con 0x561c607950b0 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f6381268700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607950b0 0x561c607974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f6364ff9700 10 client.29699 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.732+0000 7f6381268700 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607950b0 0x561c607974c0 crc :-1 s=READY pgs=654 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6a26fc66a3e2f5 server_cookie=8861f3e78c224edb in_seq=0 out_seq=0 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f6364ff9700 1 -- 172.21.15.35:0/2520086428 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561c6068b600 con 0x561c607950b0 2023-03-17T11:22:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f6364ff9700 10 client.29699 handle_command_reply: tid=0 2023-03-17T11:22:19.479 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:39 smithi035 ceph-mon[92535]: pgmap v4827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:22:20.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:41 smithi035 ceph-mon[92535]: pgmap v4828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:43 smithi035 ceph-mon[92535]: pgmap v4829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:22:20.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:45 smithi035 ceph-mon[92535]: pgmap v4830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.798 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:47 smithi035 ceph-mon[92535]: pgmap v4831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:49 smithi035 ceph-mon[92535]: pgmap v4832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:51 smithi035 ceph-mon[92535]: pgmap v4833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:53 smithi035 ceph-mon[92535]: pgmap v4834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:55 smithi035 ceph-mon[92535]: pgmap v4835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:57 smithi035 ceph-mon[92535]: pgmap v4836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:12:59 smithi035 ceph-mon[92535]: pgmap v4837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:01 smithi035 ceph-mon[92535]: pgmap v4838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:22:20.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:03 smithi035 ceph-mon[92535]: pgmap v4839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:05 smithi035 ceph-mon[92535]: pgmap v4840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:07 smithi035 ceph-mon[92535]: pgmap v4841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:09 smithi035 ceph-mon[92535]: pgmap v4842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:09 smithi035 ceph-mon[92535]: osdmap e372: 12 total, 12 up, 12 in 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:11 smithi035 ceph-mon[92535]: pgmap v4844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:13 smithi035 ceph-mon[92535]: pgmap v4845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:15 smithi035 ceph-mon[92535]: pgmap v4846: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:22:20.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:22:20.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:22:20.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:22:20.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:22:21.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:17 smithi035 ceph-mon[92535]: pgmap v4847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-17T11:22:21.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:22:21.369 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:18 smithi035 ceph-mon[92535]: osdmap e373: 12 total, 12 up, 12 in 2023-03-17T11:22:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 client.29699 shutdown 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 msgr2=0x561c607719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 0x561c607719a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f636c0130a0 tx=0x7f636c0058e0 comp rx=0 tx=0).stop 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 shutdown_connections 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607950b0 0x561c607974c0 crc :-1 s=READY pgs=654 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c60778d00 0x561c607719a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c6077c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f6364ff9700 0 client.29699 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 --2- 172.21.15.35:0/2520086428 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c607783f0 0x561c6077c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 >> 172.21.15.35:0/2520086428 conn(0x561c605c76b0 msgr2=0x561c60769410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.733+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 shutdown_connections 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.734+0000 7f638f659b80 1 -- 172.21.15.35:0/2520086428 wait complete. 2023-03-17T11:22:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.734+0000 7f638f659b80 20 client.29699 trim_cache size 0 max 16384 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 Processor -- start 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 -- start start 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c60764ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607783f0 0x561c6076e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6077ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60772a30 con 0x561c60778d00 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60761b60 con 0x561c607783f0 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f638f659b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c60765000 con 0x561c607731c0 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f6380a67700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6077ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f6380a67700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6077ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54926/0 (socket says 172.21.15.35:54926) 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f6380a67700 1 -- 172.21.15.35:0/2312006380 learned_addr learned my addr 172.21.15.35:0/2312006380 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f6381268700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607783f0 0x561c6076e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.751+0000 7f6380a67700 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c60764ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6380a67700 1 -- 172.21.15.35:0/2312006380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 msgr2=0x561c60764ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6380a67700 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c60764ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6380a67700 1 -- 172.21.15.35:0/2312006380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607783f0 msgr2=0x561c6076e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6380a67700 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607783f0 0x561c6076e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6380a67700 1 -- 172.21.15.35:0/2312006380 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c60776130 con 0x561c60778d00 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6380a67700 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6077ba20 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f636c011010 tx=0x7f636c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddea0397657f0469 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6367fff700 1 -- 172.21.15.35:0/2312006380 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c010d30 con 0x561c60778d00 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6367fff700 1 -- 172.21.15.35:0/2312006380 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f636c0044b0 con 0x561c60778d00 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.752+0000 7f6367fff700 1 -- 172.21.15.35:0/2312006380 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c010890 con 0x561c60778d00 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 -- 172.21.15.35:0/2312006380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 msgr2=0x561c6077ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6077ba20 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f636c011010 tx=0x7f636c009f50 comp rx=0 tx=0).stop 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 -- 172.21.15.35:0/2312006380 shutdown_connections 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6077ba20 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607731c0 0x561c60764ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 --2- 172.21.15.35:0/2312006380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607783f0 0x561c6076e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 -- 172.21.15.35:0/2312006380 >> 172.21.15.35:0/2312006380 conn(0x561c605c76b0 msgr2=0x561c60772320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 -- 172.21.15.35:0/2312006380 shutdown_connections 2023-03-17T11:22:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 -- 172.21.15.35:0/2312006380 wait complete. 2023-03-17T11:22:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 -- start start 2023-03-17T11:22:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.753+0000 7f638f659b80 1 Processor -- start 2023-03-17T11:22:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c6076c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607783f0 0x561c6076c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6076cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c607e8040 con 0x561c60778d00 2023-03-17T11:22:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c607e81b0 con 0x561c607731c0 2023-03-17T11:22:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c607e8370 con 0x561c607783f0 2023-03-17T11:22:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f638f659b80 10 client.0 _ll_register_callbacks cb 0x561c60562230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:22:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6076cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6076cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54932/0 (socket says 172.21.15.35:54932) 2023-03-17T11:22:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 -- 172.21.15.35:0/34081646 learned_addr learned my addr 172.21.15.35:0/34081646 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c6076c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6381268700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607783f0 0x561c6076c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 -- 172.21.15.35:0/34081646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607783f0 msgr2=0x561c6076c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607783f0 0x561c6076c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 -- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 msgr2=0x561c6076c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c6076c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6380a67700 1 -- 172.21.15.35:0/34081646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c604ead80 con 0x561c60778d00 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.754+0000 7f6381268700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607783f0 0x561c6076c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6380a67700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6076cc60 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f636c0138a0 tx=0x7f636c014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62350413846ad51e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6364ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6364ff9700 1 -- 172.21.15.35:0/34081646 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c018040 con 0x561c60778d00 2023-03-17T11:22:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6364ff9700 1 -- 172.21.15.35:0/34081646 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(347..347 src has 1..347) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f636c000e40 con 0x561c60778d00 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c6073a1e0 con 0x561c60778d00 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6364ff9700 1 -- 172.21.15.35:0/34081646 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f636c0042e0 con 0x561c60778d00 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 10 client.20625 fetch_fsmap learned FSMap version 102 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x561c604d3c00 con 0x561c60778d00 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6364ff9700 1 -- 172.21.15.35:0/34081646 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c6073a1e0 con 0x561c60778d00 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f6364ff9700 1 -- 172.21.15.35:0/34081646 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f636c004e90 con 0x561c60778d00 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 10 client.20625 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 10 client.20625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:22:39.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 20 client.20625 populate_metadata read hostname 'smithi035' 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607e95b0 0x561c607eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 4 client.20625 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.755+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c60540f00 con 0x561c607e95b0 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.756+0000 7f6381268700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607e95b0 0x561c607eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.756+0000 7f6364ff9700 10 client.20625 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.756+0000 7f6381268700 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607e95b0 0x561c607eb990 crc :-1 s=READY pgs=655 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44fe84692f554eb8 server_cookie=ebbedcea503b5d97 in_seq=0 out_seq=0 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f6364ff9700 1 -- 172.21.15.35:0/34081646 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c60540f00 con 0x561c607e95b0 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f6364ff9700 10 client.20625 handle_command_reply: tid=0 2023-03-17T11:22:39.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 client.20625 shutdown 2023-03-17T11:22:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 msgr2=0x561c6076cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:39.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6076cc60 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f636c0138a0 tx=0x7f636c014f90 comp rx=0 tx=0).stop 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 shutdown_connections 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561c607e95b0 0x561c607eb990 crc :-1 s=READY pgs=655 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561c60778d00 0x561c6076cc60 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561c607731c0 0x561c6076c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f6364ff9700 0 client.20625 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 --2- 172.21.15.35:0/34081646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c607783f0 0x561c6076c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 >> 172.21.15.35:0/34081646 conn(0x561c605c76b0 msgr2=0x561c60777640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 shutdown_connections 2023-03-17T11:22:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 1 -- 172.21.15.35:0/34081646 wait complete. 2023-03-17T11:22:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.777+0000 7f638f659b80 20 client.20625 trim_cache size 0 max 16384 2023-03-17T11:22:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f636809f6c0 msgr2=0x7f63680a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f636809f6c0 0x7f63680a1b70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6374095be0 tx=0x7f6374009600 comp rx=0 tx=0).stop 2023-03-17T11:22:41.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 msgr2=0x7f637c1a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c1a45f0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f6374008e50 tx=0x7f6374008e80 comp rx=0 tx=0).stop 2023-03-17T11:22:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 shutdown_connections 2023-03-17T11:22:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f636809f6c0 0x7f63680a1b70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f637c105510 0x7f637c1a45f0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:41.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f637c0fe970 0x7f637c0ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 --2- 172.21.15.35:0/153153518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f637c0ff310 0x7f637c0ffe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 >> 172.21.15.35:0/153153518 conn(0x7f637c0757a0 msgr2=0x7f637c0fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 shutdown_connections 2023-03-17T11:22:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:00.778+0000 7f63834cc700 1 -- 172.21.15.35:0/153153518 wait complete. 2023-03-17T11:22:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 -- 172.21.15.35:0/1599193150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ffcf0 msgr2=0x7f229c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:44.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 --2- 172.21.15.35:0/1599193150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ffcf0 0x7f229c103cb0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f22840099c0 tx=0x7f2284009cd0 comp rx=0 tx=0).stop 2023-03-17T11:22:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 -- 172.21.15.35:0/1599193150 shutdown_connections 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 --2- 172.21.15.35:0/1599193150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c104390 0x7f229c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 --2- 172.21.15.35:0/1599193150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f229c0ff350 0x7f229c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 --2- 172.21.15.35:0/1599193150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ffcf0 0x7f229c103cb0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 -- 172.21.15.35:0/1599193150 >> 172.21.15.35:0/1599193150 conn(0x7f229c076330 msgr2=0x7f229c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 -- 172.21.15.35:0/1599193150 shutdown_connections 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.899+0000 7f22a1048700 1 -- 172.21.15.35:0/1599193150 wait complete. 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.900+0000 7f22a1048700 1 Processor -- start 2023-03-17T11:22:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 -- start start 2023-03-17T11:22:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 0x7f229c1951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0ffcf0 0x7f229c1956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f229c104390 0x7f229c199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c19a180 con 0x7f229c0ff350 2023-03-17T11:22:49.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c19a2f0 con 0x7f229c104390 2023-03-17T11:22:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f22a1048700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c19a4b0 con 0x7f229c0ffcf0 2023-03-17T11:22:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 0x7f229c1951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 0x7f229c1951a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54960/0 (socket says 172.21.15.35:54960) 2023-03-17T11:22:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 -- 172.21.15.35:0/1673674862 learned_addr learned my addr 172.21.15.35:0/1673674862 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229b59e700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f229c104390 0x7f229c199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229a59c700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0ffcf0 0x7f229c1956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 -- 172.21.15.35:0/1673674862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0ffcf0 msgr2=0x7f229c1956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0ffcf0 0x7f229c1956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 -- 172.21.15.35:0/1673674862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f229c104390 msgr2=0x7f229c199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f229c104390 0x7f229c199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.901+0000 7f229ad9d700 1 -- 172.21.15.35:0/1673674862 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840095f0 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.902+0000 7f229ad9d700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 0x7f229c1951a0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f228c0060b0 tx=0x7f228c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.902+0000 7f2293fff700 1 -- 172.21.15.35:0/1673674862 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00de20 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.902+0000 7f2293fff700 1 -- 172.21.15.35:0/1673674862 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f228c00f040 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.902+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c10efc0 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.902+0000 7f2293fff700 1 -- 172.21.15.35:0/1673674862 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c014690 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.902+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c10ee30 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.904+0000 7f2293fff700 1 -- 172.21.15.35:0/1673674862 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f228c015400 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.905+0000 7f2293fff700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f228809f640 0x7f22880a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.905+0000 7f229a59c700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f228809f640 0x7f22880a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.905+0000 7f2293fff700 1 -- 172.21.15.35:0/1673674862 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(348..348 src has 1..348) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f228c0ca190 con 0x7f229c0ff350 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.905+0000 7f229a59c700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f228809f640 0x7f22880a1af0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2284009990 tx=0x7f228401a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 Processor -- start 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 -- start start 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f66fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f66f9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:52.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66f9960 0x55c8f66f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f6600010 con 0x55c8f66ff4f0 2023-03-17T11:22:52.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f6652950 con 0x55c8f66f9960 2023-03-17T11:22:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f664bde0 con 0x55c8f66febe0 2023-03-17T11:22:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f229a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f66f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f229a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f66f9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54970/0 (socket says 172.21.15.35:54970) 2023-03-17T11:22:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.906+0000 7f229a59c700 1 -- 172.21.15.35:0/2229231555 learned_addr learned my addr 172.21.15.35:0/2229231555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229b59e700 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66f9960 0x55c8f66f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229ad9d700 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f66fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229a59c700 1 -- 172.21.15.35:0/2229231555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 msgr2=0x55c8f66fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229a59c700 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f66fefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:55.535 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:19 smithi035 ceph-mon[92535]: pgmap v4849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T11:22:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229a59c700 1 -- 172.21.15.35:0/2229231555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66f9960 msgr2=0x55c8f66f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:22:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229a59c700 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66f9960 0x55c8f66f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229a59c700 1 -- 172.21.15.35:0/2229231555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8f64cd5d0 con 0x55c8f66ff4f0 2023-03-17T11:22:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229ad9d700 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f66fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:22:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f229a59c700 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f66f9420 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f2284000c00 tx=0x7f228401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178cf804f1aa9a41 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:22:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f22917fa700 1 -- 172.21.15.35:0/2229231555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228401d040 con 0x55c8f66ff4f0 2023-03-17T11:22:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f22917fa700 1 -- 172.21.15.35:0/2229231555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f228400be20 con 0x55c8f66ff4f0 2023-03-17T11:22:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.907+0000 7f22917fa700 1 -- 172.21.15.35:0/2229231555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228402cb80 con 0x55c8f66ff4f0 2023-03-17T11:22:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2229231555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 msgr2=0x55c8f66f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:22:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f66f9420 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f2284000c00 tx=0x7f228401e000 comp rx=0 tx=0).stop 2023-03-17T11:22:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2229231555 shutdown_connections 2023-03-17T11:22:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66f9960 0x55c8f66f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f66fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2229231555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f66f9420 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2229231555 >> 172.21.15.35:0/2229231555 conn(0x55c8f65566b0 msgr2=0x55c8f66f3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2229231555 shutdown_connections 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2229231555 wait complete. 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 -- start start 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.908+0000 7f22ad1d5b80 1 Processor -- start 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6705480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f6702700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:58.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66ff4f0 0x55c8f6702d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f64cf8c0 con 0x55c8f66f9960 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f67034d0 con 0x55c8f66ff4f0 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f670efd0 con 0x55c8f66febe0 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f22ad1d5b80 10 client.0 _ll_register_callbacks cb 0x55c8f64f1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6705480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6705480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54974/0 (socket says 172.21.15.35:54974) 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 -- 172.21.15.35:0/206789731 learned_addr learned my addr 172.21.15.35:0/206789731 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229b59e700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66ff4f0 0x55c8f6702d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:22:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229a59c700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f6702700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:01.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 -- 172.21.15.35:0/206789731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 msgr2=0x55c8f6702700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:01.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f6702700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:03.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 -- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66ff4f0 msgr2=0x55c8f6702d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:03.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66ff4f0 0x55c8f6702d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.909+0000 7f229ad9d700 1 -- 172.21.15.35:0/206789731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c10c7a0 con 0x55c8f66f9960 2023-03-17T11:23:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f229ad9d700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6705480 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f228c00d740 tx=0x7f228c015a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586e8b9221637cc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22827fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:23:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22827fc700 1 -- 172.21.15.35:0/206789731 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c098010 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22827fc700 1 -- 172.21.15.35:0/206789731 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(348..348 src has 1..348) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f228c09fda0 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8f660e390 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22827fc700 1 -- 172.21.15.35:0/206789731 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f228c0b1020 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22ad1d5b80 10 client.20637 fetch_fsmap learned FSMap version 102 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55c8f6479d80 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.910+0000 7f22827fc700 1 -- 172.21.15.35:0/206789731 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c8f660e390 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22827fc700 1 -- 172.21.15.35:0/206789731 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f228c0c7300 con 0x55c8f66f9960 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22ad1d5b80 10 client.20637 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22ad1d5b80 10 client.20637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22ad1d5b80 20 client.20637 populate_metadata read hostname 'smithi035' 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f6713000 0x55c8f67153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22ad1d5b80 4 client.20637 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:23:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8f661a600 con 0x55c8f6713000 2023-03-17T11:23:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.911+0000 7f229a59c700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f6713000 0x55c8f67153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.912+0000 7f22827fc700 10 client.20637 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.912+0000 7f229a59c700 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f6713000 0x55c8f67153e0 crc :-1 s=READY pgs=656 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187ea1a261513b40 server_cookie=c4bdc895fc86a83 in_seq=0 out_seq=0 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.912+0000 7f22827fc700 1 -- 172.21.15.35:0/206789731 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c8f661a600 con 0x55c8f6713000 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.912+0000 7f22827fc700 10 client.20637 handle_command_reply: tid=0 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.912+0000 7f22ad1d5b80 1 client.20637 shutdown 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 msgr2=0x55c8f6705480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6705480 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f228c00d740 tx=0x7f228c015a00 comp rx=0 tx=0).stop 2023-03-17T11:23:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 shutdown_connections 2023-03-17T11:23:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f6713000 0x55c8f67153e0 crc :-1 s=READY pgs=656 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66ff4f0 0x55c8f6702d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22827fc700 0 client.20637 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6705480 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/206789731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66febe0 0x55c8f6702700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 >> 172.21.15.35:0/206789731 conn(0x55c8f65566b0 msgr2=0x55c8f66f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:10.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 shutdown_connections 2023-03-17T11:23:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/206789731 wait complete. 2023-03-17T11:23:10.367 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.913+0000 7f22ad1d5b80 20 client.20637 trim_cache size 0 max 16384 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 Processor -- start 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 -- start start 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66f9960 0x55c8f66fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6709f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f6705020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f6710740 con 0x55c8f66ff4f0 2023-03-17T11:23:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f66f05c0 con 0x55c8f66febe0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f66f46d0 con 0x55c8f66f9960 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f6705020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f6705020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54986/0 (socket says 172.21.15.35:54986) 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 -- 172.21.15.35:0/2968688345 learned_addr learned my addr 172.21.15.35:0/2968688345 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229ad9d700 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66f9960 0x55c8f66fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229a59c700 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6709f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 -- 172.21.15.35:0/2968688345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66f9960 msgr2=0x55c8f66fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66f9960 0x55c8f66fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 -- 172.21.15.35:0/2968688345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 msgr2=0x55c8f6709f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.928+0000 7f229b59e700 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6709f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f229b59e700 1 -- 172.21.15.35:0/2968688345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8f66fa000 con 0x55c8f66ff4f0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f229a59c700 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6709f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f229b59e700 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f6705020 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f2294003700 tx=0x7f2294003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d4456cf6e63806 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f2291ffb700 1 -- 172.21.15.35:0/2968688345 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294017070 con 0x55c8f66ff4f0 2023-03-17T11:23:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f2291ffb700 1 -- 172.21.15.35:0/2968688345 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2294009a50 con 0x55c8f66ff4f0 2023-03-17T11:23:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f2291ffb700 1 -- 172.21.15.35:0/2968688345 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011b10 con 0x55c8f66ff4f0 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2968688345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 msgr2=0x55c8f6705020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f6705020 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f2294003700 tx=0x7f2294003a10 comp rx=0 tx=0).stop 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2968688345 shutdown_connections 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66ff4f0 0x55c8f6705020 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.929+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66f9960 0x55c8f66fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/2968688345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6709f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2968688345 >> 172.21.15.35:0/2968688345 conn(0x55c8f65566b0 msgr2=0x55c8f66fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2968688345 shutdown_connections 2023-03-17T11:23:15.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/2968688345 wait complete. 2023-03-17T11:23:15.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- start start 2023-03-17T11:23:18.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 Processor -- start 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6708650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6708b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66ff4f0 0x55c8f67090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f6766e10 con 0x55c8f66f9960 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f6766f50 con 0x55c8f66febe0 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f22ad1d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8f6767090 con 0x55c8f66ff4f0 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.930+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6708650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6708650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:54988/0 (socket says 172.21.15.35:54988) 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 -- 172.21.15.35:0/854577537 learned_addr learned my addr 172.21.15.35:0/854577537 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22ad1d5b80 10 client.0 _ll_register_callbacks cb 0x55c8f64f1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229b59e700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66ff4f0 0x55c8f67090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 -- 172.21.15.35:0/854577537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66ff4f0 msgr2=0x55c8f67090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66ff4f0 0x55c8f67090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:18.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229a59c700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6708b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 -- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 msgr2=0x55c8f6708b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6708b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 -- 172.21.15.35:0/854577537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2294004400 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f229ad9d700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6708650 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f228c0979c0 tx=0x7f228c009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732296967b104959 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22827fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22827fc700 1 -- 172.21.15.35:0/854577537 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0972f0 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22827fc700 1 -- 172.21.15.35:0/854577537 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(348..348 src has 1..348) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f228c09fda0 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8f66c91e0 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22827fc700 1 -- 172.21.15.35:0/854577537 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f228c098020 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22ad1d5b80 10 client.20643 fetch_fsmap learned FSMap version 102 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x55c8f6462c00 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.931+0000 7f22827fc700 1 -- 172.21.15.35:0/854577537 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c8f66c91e0 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22827fc700 1 -- 172.21.15.35:0/854577537 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 102) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f228c078bd0 con 0x55c8f66f9960 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22ad1d5b80 10 client.20643 fetch_fsmap finished waiting for FSMap version 102 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22ad1d5b80 10 client.20643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:23:18.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22ad1d5b80 20 client.20643 populate_metadata read hostname 'smithi035' 2023-03-17T11:23:18.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f67683a0 0x55c8f676a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:19.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22ad1d5b80 4 client.20643 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:23:19.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c8f64cff00 con 0x55c8f67683a0 2023-03-17T11:23:19.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f229a59c700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f67683a0 0x55c8f676a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f22827fc700 10 client.20643 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.932+0000 7f229a59c700 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f67683a0 0x55c8f676a780 crc :-1 s=READY pgs=657 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f7a68193cbc4b6 server_cookie=146b3370c2500843 in_seq=0 out_seq=0 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22827fc700 1 -- 172.21.15.35:0/854577537 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c8f64cff00 con 0x55c8f67683a0 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22827fc700 10 client.20643 handle_command_reply: tid=0 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 client.20643 shutdown 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 msgr2=0x55c8f6708650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6708650 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f228c0979c0 tx=0x7f228c009950 comp rx=0 tx=0).stop 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 shutdown_connections 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c8f67683a0 0x55c8f676a780 crc :-1 s=READY pgs=657 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c8f66ff4f0 0x55c8f67090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c8f66f9960 0x55c8f6708650 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 --2- 172.21.15.35:0/854577537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c8f66febe0 0x55c8f6708b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22827fc700 0 client.20643 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 >> 172.21.15.35:0/854577537 conn(0x55c8f65566b0 msgr2=0x55c8f66fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 shutdown_connections 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.950+0000 7f22ad1d5b80 1 -- 172.21.15.35:0/854577537 wait complete. 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22ad1d5b80 20 client.20643 trim_cache size 0 max 16384 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f228809f640 msgr2=0x7f22880a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f228809f640 0x7f22880a1af0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2284009990 tx=0x7f228401a040 comp rx=0 tx=0).stop 2023-03-17T11:23:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 msgr2=0x7f229c1951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 0x7f229c1951a0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f228c0060b0 tx=0x7f228c007f90 comp rx=0 tx=0).stop 2023-03-17T11:23:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 shutdown_connections 2023-03-17T11:23:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f228809f640 0x7f22880a1af0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f229c104390 0x7f229c199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f229c0ff350 0x7f229c1951a0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 --2- 172.21.15.35:0/1673674862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f229c0ffcf0 0x7f229c1956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 >> 172.21.15.35:0/1673674862 conn(0x7f229c076330 msgr2=0x7f229c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 shutdown_connections 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:00:13.951+0000 7f22a1048700 1 -- 172.21.15.35:0/1673674862 wait complete. 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 -- 172.21.15.35:0/1197286573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101da0 msgr2=0x7fbe1010a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 --2- 172.21.15.35:0/1197286573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101da0 0x7fbe1010a290 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009990 tx=0x7fbe0c009ca0 comp rx=0 tx=0).stop 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 -- 172.21.15.35:0/1197286573 shutdown_connections 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 --2- 172.21.15.35:0/1197286573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe1010a7d0 0x7fbe1010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 --2- 172.21.15.35:0/1197286573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe10101490 0x7fbe10101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 --2- 172.21.15.35:0/1197286573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101da0 0x7fbe1010a290 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 -- 172.21.15.35:0/1197286573 >> 172.21.15.35:0/1197286573 conn(0x7fbe10075f60 msgr2=0x7fbe10076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 -- 172.21.15.35:0/1197286573 shutdown_connections 2023-03-17T11:23:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 -- 172.21.15.35:0/1197286573 wait complete. 2023-03-17T11:23:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 Processor -- start 2023-03-17T11:23:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.525+0000 7fbe1749b700 1 -- start start 2023-03-17T11:23:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 0x7fbe10196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe10101da0 0x7fbe10196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe1010a7d0 0x7fbe1019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1019b230 con 0x7fbe10101490 2023-03-17T11:23:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1019b3a0 con 0x7fbe1010a7d0 2023-03-17T11:23:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1019b560 con 0x7fbe10101da0 2023-03-17T11:23:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 0x7fbe10196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:31.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 0x7fbe10196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55030/0 (socket says 172.21.15.35:55030) 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 -- 172.21.15.35:0/3632017737 learned_addr learned my addr 172.21.15.35:0/3632017737 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe14a36700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe10101da0 0x7fbe10196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15a38700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe1010a7d0 0x7fbe1019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 -- 172.21.15.35:0/3632017737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe10101da0 msgr2=0x7fbe10196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe10101da0 0x7fbe10196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 -- 172.21.15.35:0/3632017737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe1010a7d0 msgr2=0x7fbe1019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe1010a7d0 0x7fbe1019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 -- 172.21.15.35:0/3632017737 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0095f0 con 0x7fbe10101490 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15a38700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe1010a7d0 0x7fbe1019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe15237700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 0x7fbe10196250 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000d950 tx=0x7fbe0000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe067fc700 1 -- 172.21.15.35:0/3632017737 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00009b40 con 0x7fbe10101490 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe067fc700 1 -- 172.21.15.35:0/3632017737 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe00009ca0 con 0x7fbe10101490 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe10110120 con 0x7fbe10101490 2023-03-17T11:23:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.526+0000 7fbe067fc700 1 -- 172.21.15.35:0/3632017737 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000f620 con 0x7fbe10101490 2023-03-17T11:23:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.527+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1010ff90 con 0x7fbe10101490 2023-03-17T11:23:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.529+0000 7fbe067fc700 1 -- 172.21.15.35:0/3632017737 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbe00010460 con 0x7fbe10101490 2023-03-17T11:23:31.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.529+0000 7fbe067fc700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdfc09f640 0x7fbdfc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.529+0000 7fbe067fc700 1 -- 172.21.15.35:0/3632017737 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(351..351 src has 1..351) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbe000ca9a0 con 0x7fbe10101490 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.529+0000 7fbe14a36700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdfc09f640 0x7fbdfc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.530+0000 7fbe14a36700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdfc09f640 0x7fbdfc0a1af0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0098e0 tx=0x7fbe0c005e80 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.530+0000 7fbe23628b80 1 Processor -- start 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.530+0000 7fbe23628b80 1 -- start start 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f04dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f048420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f048d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe23628b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68ef4f010 con 0x55d68f04e4f0 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe23628b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68efa1950 con 0x55d68f04dbe0 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe23628b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68ef9ade0 con 0x55d68f048960 2023-03-17T11:23:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f048420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f048420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55040/0 (socket says 172.21.15.35:55040) 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 -- 172.21.15.35:0/604253255 learned_addr learned my addr 172.21.15.35:0/604253255 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe15a38700 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f048d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe15237700 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f04dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 -- 172.21.15.35:0/604253255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 msgr2=0x55d68f048d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f048d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 -- 172.21.15.35:0/604253255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 msgr2=0x55d68f04dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f04dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 -- 172.21.15.35:0/604253255 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d68ee1c5d0 con 0x55d68f04e4f0 2023-03-17T11:23:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe15237700 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f04dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:23:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbe14a36700 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f048420 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009990 tx=0x7fbe0c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bf1a40e7ad9645 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/604253255 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c01e070 con 0x55d68f04e4f0 2023-03-17T11:23:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.531+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/604253255 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0c00fc50 con 0x55d68f04e4f0 2023-03-17T11:23:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbdfb7fe700 1 -- 172.21.15.35:0/604253255 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c030c50 con 0x55d68f04e4f0 2023-03-17T11:23:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 -- 172.21.15.35:0/604253255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 msgr2=0x55d68f048420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f048420 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009990 tx=0x7fbe0c01e000 comp rx=0 tx=0).stop 2023-03-17T11:23:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 -- 172.21.15.35:0/604253255 shutdown_connections 2023-03-17T11:23:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f048d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f04dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 --2- 172.21.15.35:0/604253255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f048420 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 -- 172.21.15.35:0/604253255 >> 172.21.15.35:0/604253255 conn(0x55d68eea56b0 msgr2=0x55d68f042a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 -- 172.21.15.35:0/604253255 shutdown_connections 2023-03-17T11:23:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.532+0000 7fbe23628b80 1 -- 172.21.15.35:0/604253255 wait complete. 2023-03-17T11:23:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 -- start start 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 Processor -- start 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f054460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f0516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68ee1e8c0 con 0x55d68f04e4f0 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f0523f0 con 0x55d68f04dbe0 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f0525b0 con 0x55d68f048960 2023-03-17T11:23:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe23628b80 10 client.0 _ll_register_callbacks cb 0x55d68ee40230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe15a38700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe15a38700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f051cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55048/0 (socket says 172.21.15.35:55048) 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe15a38700 1 -- 172.21.15.35:0/3503028315 learned_addr learned my addr 172.21.15.35:0/3503028315 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.533+0000 7fbe14a36700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f0516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15237700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f054460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15a38700 1 -- 172.21.15.35:0/3503028315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 msgr2=0x55d68f054460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15a38700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f054460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15a38700 1 -- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 msgr2=0x55d68f0516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15a38700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f0516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15a38700 1 -- 172.21.15.35:0/3503028315 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1010d8f0 con 0x55d68f04e4f0 2023-03-17T11:23:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe15a38700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f051cf0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fbe08007b60 tx=0x7fbe08009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5923895af764c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbdf8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3503028315 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080118d0 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3503028315 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(351..351 src has 1..351) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbe08011a30 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d68ef5d390 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3503028315 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe08011bf0 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe23628b80 10 client.20655 fetch_fsmap learned FSMap version 105 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55d68edc8d80 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.534+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3503028315 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d68ef5d390 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3503028315 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fbe08016070 con 0x55d68f04e4f0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe23628b80 10 client.20655 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe23628b80 10 client.20655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe23628b80 20 client.20655 populate_metadata read hostname 'smithi035' 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe23628b80 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f062100 0x55d68f064510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe23628b80 4 client.20655 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d68ef69600 con 0x55d68f062100 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe15237700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f062100 0x55d68f064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbdf8ff9700 10 client.20655 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.535+0000 7fbe15237700 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f062100 0x55d68f064510 crc :-1 s=READY pgs=658 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f6fc595c882d8f server_cookie=baff109b933d2c73 in_seq=0 out_seq=0 2023-03-17T11:23:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/3503028315 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d68ef69600 con 0x55d68f062100 2023-03-17T11:23:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbdf8ff9700 10 client.20655 handle_command_reply: tid=0 2023-03-17T11:23:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 client.20655 shutdown 2023-03-17T11:23:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 msgr2=0x55d68f051cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f051cf0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fbe08007b60 tx=0x7fbe08009510 comp rx=0 tx=0).stop 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 shutdown_connections 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f062100 0x55d68f064510 crc :-1 s=READY pgs=658 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f051cf0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f048960 0x55d68f054460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 --2- 172.21.15.35:0/3503028315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f04dbe0 0x55d68f0516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 >> 172.21.15.35:0/3503028315 conn(0x55d68eea56b0 msgr2=0x55d68f047410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.536+0000 7fbdf8ff9700 0 client.20655 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.537+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 shutdown_connections 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.537+0000 7fbe23628b80 1 -- 172.21.15.35:0/3503028315 wait complete. 2023-03-17T11:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.537+0000 7fbe23628b80 20 client.20655 trim_cache size 0 max 16384 2023-03-17T11:23:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 Processor -- start 2023-03-17T11:23:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 -- start start 2023-03-17T11:23:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f058f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04dbe0 0x55d68f053f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f04b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f044570 con 0x55d68f04e4f0 2023-03-17T11:23:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f03e0d0 con 0x55d68f048960 2023-03-17T11:23:43.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe23628b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f03f5f0 con 0x55d68f04dbe0 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f04b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f04b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55056/0 (socket says 172.21.15.35:55056) 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 -- 172.21.15.35:0/827608664 learned_addr learned my addr 172.21.15.35:0/827608664 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15237700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f058f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe14a36700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04dbe0 0x55d68f053f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 -- 172.21.15.35:0/827608664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04dbe0 msgr2=0x55d68f053f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04dbe0 0x55d68f053f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 -- 172.21.15.35:0/827608664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 msgr2=0x55d68f058f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f058f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:43.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15a38700 1 -- 172.21.15.35:0/827608664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d68ef61130 con 0x55d68f04e4f0 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe14a36700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04dbe0 0x55d68f053f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.552+0000 7fbe15237700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f058f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe15a38700 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f04b6b0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000f80 tx=0x7fbe080204a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a959a39dd2af1bf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbdfbfff700 1 -- 172.21.15.35:0/827608664 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08020570 con 0x55d68f04e4f0 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbdfbfff700 1 -- 172.21.15.35:0/827608664 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe08013040 con 0x55d68f04e4f0 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbdfbfff700 1 -- 172.21.15.35:0/827608664 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080116d0 con 0x55d68f04e4f0 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 -- 172.21.15.35:0/827608664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 msgr2=0x55d68f04b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f04b6b0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000f80 tx=0x7fbe080204a0 comp rx=0 tx=0).stop 2023-03-17T11:23:43.276 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 -- 172.21.15.35:0/827608664 shutdown_connections 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04e4f0 0x55d68f04b6b0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f058f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 --2- 172.21.15.35:0/827608664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04dbe0 0x55d68f053f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 -- 172.21.15.35:0/827608664 >> 172.21.15.35:0/827608664 conn(0x55d68eea56b0 msgr2=0x55d68f064110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 -- 172.21.15.35:0/827608664 shutdown_connections 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.553+0000 7fbe23628b80 1 -- 172.21.15.35:0/827608664 wait complete. 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 -- start start 2023-03-17T11:23:43.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 Processor -- start 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 0x55d68f0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04e4f0 0x55d68f0b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f0af120 con 0x55d68f04dbe0 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f0b9900 con 0x55d68f048960 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d68f0b9a40 con 0x55d68f04e4f0 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe23628b80 10 client.0 _ll_register_callbacks cb 0x55d68ee40230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe14a36700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 0x55d68f0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe14a36700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 0x55d68f0aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55060/0 (socket says 172.21.15.35:55060) 2023-03-17T11:23:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe14a36700 1 -- 172.21.15.35:0/1888871578 learned_addr learned my addr 172.21.15.35:0/1888871578 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.554+0000 7fbe15a38700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04e4f0 0x55d68f0b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe15237700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe14a36700 1 -- 172.21.15.35:0/1888871578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04e4f0 msgr2=0x55d68f0b93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe14a36700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04e4f0 0x55d68f0b93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe14a36700 1 -- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 msgr2=0x55d68f0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:23:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe14a36700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe14a36700 1 -- 172.21.15.35:0/1888871578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d68edc8d80 con 0x55d68f04dbe0 2023-03-17T11:23:45.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe15237700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:23:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe14a36700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 0x55d68f0aea70 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02f000 tx=0x7fbe0c005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5a4c48bd24dcd1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:23:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbdf8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:23:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/1888871578 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c035040 con 0x55d68f04dbe0 2023-03-17T11:23:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/1888871578 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(351..351 src has 1..351) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbe0c00f9c0 con 0x55d68f04dbe0 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d68f0181e0 con 0x55d68f04dbe0 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/1888871578 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe0c030e70 con 0x55d68f04dbe0 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe23628b80 10 client.20661 fetch_fsmap learned FSMap version 105 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55d68edef1f0 con 0x55d68f04dbe0 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.555+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/1888871578 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0c047020 con 0x55d68f04dbe0 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/1888871578 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fbe0c03abc0 con 0x55d68f04dbe0 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe23628b80 10 client.20661 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:23:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe23628b80 10 client.20661 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:23:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe23628b80 20 client.20661 populate_metadata read hostname 'smithi035' 2023-03-17T11:23:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe23628b80 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f0bacb0 0x55d68f0bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe23628b80 4 client.20661 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:23:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d68ee1ef00 con 0x55d68f0bacb0 2023-03-17T11:23:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe15237700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f0bacb0 0x55d68f0bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbdf8ff9700 10 client.20661 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.556+0000 7fbe15237700 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f0bacb0 0x55d68f0bd0c0 crc :-1 s=READY pgs=659 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25d719b4028e222 server_cookie=20b062d8b59200e9 in_seq=0 out_seq=0 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbdf8ff9700 1 -- 172.21.15.35:0/1888871578 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d68ee1ef00 con 0x55d68f0bacb0 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbdf8ff9700 10 client.20661 handle_command_reply: tid=0 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 client.20661 shutdown 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 msgr2=0x55d68f0aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 0x55d68f0aea70 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c02f000 tx=0x7fbe0c005990 comp rx=0 tx=0).stop 2023-03-17T11:23:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 shutdown_connections 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d68f0bacb0 0x55d68f0bd0c0 crc :-1 s=READY pgs=659 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68f04e4f0 0x55d68f0b93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d68f048960 0x55d68f0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbdf8ff9700 0 client.20661 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 --2- 172.21.15.35:0/1888871578 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d68f04dbe0 0x55d68f0aea70 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 >> 172.21.15.35:0/1888871578 conn(0x55d68eea56b0 msgr2=0x55d68f04b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 shutdown_connections 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 1 -- 172.21.15.35:0/1888871578 wait complete. 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.611+0000 7fbe23628b80 20 client.20661 trim_cache size 0 max 16384 2023-03-17T11:23:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdfc09f640 msgr2=0x7fbdfc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdfc09f640 0x7fbdfc0a1af0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0098e0 tx=0x7fbe0c005e80 comp rx=0 tx=0).stop 2023-03-17T11:23:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 msgr2=0x7fbe10196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 0x7fbe10196250 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000d950 tx=0x7fbe0000dd10 comp rx=0 tx=0).stop 2023-03-17T11:23:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 shutdown_connections 2023-03-17T11:23:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbdfc09f640 0x7fbdfc0a1af0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe1010a7d0 0x7fbe1019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbe10101490 0x7fbe10196250 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 --2- 172.21.15.35:0/3632017737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe10101da0 0x7fbe10196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 >> 172.21.15.35:0/3632017737 conn(0x7fbe10075f60 msgr2=0x7fbe1010b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 shutdown_connections 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:01:50.612+0000 7fbe1749b700 1 -- 172.21.15.35:0/3632017737 wait complete. 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1241036614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c104390 msgr2=0x7fa49c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1241036614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c104390 0x7fa49c10bf60 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa49400b0d0 tx=0x7fa49400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1241036614 shutdown_connections 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1241036614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c104390 0x7fa49c10bf60 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1241036614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 0x7fa49c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1241036614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1241036614 >> 172.21.15.35:0/1241036614 conn(0x7fa49c076330 msgr2=0x7fa49c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1241036614 shutdown_connections 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1241036614 wait complete. 2023-03-17T11:23:52.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.736+0000 7fa4a1bc3700 1 Processor -- start 2023-03-17T11:23:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 -- start start 2023-03-17T11:23:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 0x7fa49c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c1977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c104390 0x7fa49c1a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:23:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c198050 con 0x7fa49c0ffcf0 2023-03-17T11:23:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1a2840 con 0x7fa49c104390 2023-03-17T11:23:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa4a1bc3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1a2980 con 0x7fa49c0ff350 2023-03-17T11:23:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c1977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c1977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55074/0 (socket says 172.21.15.35:55074) 2023-03-17T11:23:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 -- 172.21.15.35:0/1371730852 learned_addr learned my addr 172.21.15.35:0/1371730852 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:23:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 0x7fa49c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49bfff700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c104390 0x7fa49c1a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:23:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 -- 172.21.15.35:0/1371730852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 msgr2=0x7fa49c197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:23:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 0x7fa49c197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:23:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 -- 172.21.15.35:0/1371730852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c104390 msgr2=0x7fa49c1a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c104390 0x7fa49c1a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 -- 172.21.15.35:0/1371730852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494009d00 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 0x7fa49c197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49bfff700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c104390 0x7fa49c1a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.737+0000 7fa49affd700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c1977c0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa49000e940 tx=0x7fa49000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.738+0000 7fa498ff9700 1 -- 172.21.15.35:0/1371730852 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490009730 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.738+0000 7fa498ff9700 1 -- 172.21.15.35:0/1371730852 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa49000cbd0 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.738+0000 7fa498ff9700 1 -- 172.21.15.35:0/1371730852 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490018680 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.738+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c10efc0 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.738+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c10ee30 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.740+0000 7fa498ff9700 1 -- 172.21.15.35:0/1371730852 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa49000cd40 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.740+0000 7fa498ff9700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa48409f6c0 0x7fa4840a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.741+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa48409f6c0 0x7fa4840a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.741+0000 7fa498ff9700 1 -- 172.21.15.35:0/1371730852 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(351..351 src has 1..351) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa490014070 con 0x7fa49c0ffcf0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.741+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa48409f6c0 0x7fa4840a1b70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009cb0 tx=0x7fa48c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.741+0000 7fa4add50b80 1 Processor -- start 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 -- start start 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdcbe0 0x558639fdcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639ede010 con 0x558639fd7960 2023-03-17T11:24:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639f30950 con 0x558639fdd4f0 2023-03-17T11:24:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa4add50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639f29de0 con 0x558639fdcbe0 2023-03-17T11:24:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55084/0 (socket says 172.21.15.35:55084) 2023-03-17T11:24:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 -- 172.21.15.35:0/47497199 learned_addr learned my addr 172.21.15.35:0/47497199 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:01.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdcbe0 0x558639fdcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49affd700 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 -- 172.21.15.35:0/47497199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdcbe0 msgr2=0x558639fdcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdcbe0 0x558639fdcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 -- 172.21.15.35:0/47497199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 msgr2=0x558639fd7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 -- 172.21.15.35:0/47497199 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558639dab5d0 con 0x558639fd7960 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdcbe0 0x558639fdcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.742+0000 7fa49bfff700 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd7d90 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fa494009310 tx=0x7fa494009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a76569cb489472 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa481ffb700 1 -- 172.21.15.35:0/47497199 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400e040 con 0x558639fd7960 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa481ffb700 1 -- 172.21.15.35:0/47497199 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa494007d90 con 0x558639fd7960 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa481ffb700 1 -- 172.21.15.35:0/47497199 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494004d60 con 0x558639fd7960 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 -- 172.21.15.35:0/47497199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 msgr2=0x558639fd7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd7d90 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fa494009310 tx=0x7fa494009340 comp rx=0 tx=0).stop 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 -- 172.21.15.35:0/47497199 shutdown_connections 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd7d90 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdcbe0 0x558639fdcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 --2- 172.21.15.35:0/47497199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 -- 172.21.15.35:0/47497199 >> 172.21.15.35:0/47497199 conn(0x558639e346b0 msgr2=0x558639fd1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 -- 172.21.15.35:0/47497199 shutdown_connections 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.743+0000 7fa4add50b80 1 -- 172.21.15.35:0/47497199 wait complete. 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 -- start start 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 Processor -- start 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fd7960 0x558639fe33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fe0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639dad8c0 con 0x558639fdcbe0 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639fe1350 con 0x558639fd7960 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639fe1510 con 0x558639fdd4f0 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa4add50b80 10 client.0 _ll_register_callbacks cb 0x558639dcf230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.744+0000 7fa49affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fe0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fe0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55088/0 (socket says 172.21.15.35:55088) 2023-03-17T11:24:01.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 -- 172.21.15.35:0/1664905633 learned_addr learned my addr 172.21.15.35:0/1664905633 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49bfff700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fd7960 0x558639fe33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 -- 172.21.15.35:0/1664905633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 msgr2=0x558639fe0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 -- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fd7960 msgr2=0x558639fe33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fd7960 0x558639fe33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 -- 172.21.15.35:0/1664905633 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c10c7a0 con 0x558639fdcbe0 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fd7960 0x558639fe33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:01.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa49affd700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fe0640 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fa490098100 tx=0x7fa490097e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c507efb183f67867 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:01.302 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:21 smithi035 ceph-mon[92535]: pgmap v4850: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-17T11:24:03.036 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:23 smithi035 ceph-mon[92535]: pgmap v4851: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T11:24:03.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:25 smithi035 ceph-mon[92535]: pgmap v4852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T11:24:03.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:27 smithi035 ceph-mon[92535]: pgmap v4853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:24:03.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:29 smithi035 ceph-mon[92535]: pgmap v4854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 844 B/s wr, 9 op/s 2023-03-17T11:24:03.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:31 smithi035 ceph-mon[92535]: pgmap v4855: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:24:03.638 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:33 smithi035 ceph-mon[92535]: pgmap v4856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:24:03.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:35 smithi035 ceph-mon[92535]: pgmap v4857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:24:03.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:37 smithi035 ceph-mon[92535]: pgmap v4858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:24:03.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:39 smithi035 ceph-mon[92535]: pgmap v4859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:24:03.639 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:41 smithi035 ceph-mon[92535]: pgmap v4860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:24:06.832 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:43 smithi035 ceph-mon[92535]: pgmap v4861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:45 smithi035 ceph-mon[92535]: pgmap v4862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:47 smithi035 ceph-mon[92535]: pgmap v4863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:49 smithi035 ceph-mon[92535]: pgmap v4864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:51 smithi035 ceph-mon[92535]: pgmap v4865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:53 smithi035 ceph-mon[92535]: pgmap v4866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:55 smithi035 ceph-mon[92535]: pgmap v4867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:57 smithi035 ceph-mon[92535]: pgmap v4868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:13:59 smithi035 ceph-mon[92535]: pgmap v4869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:01 smithi035 ceph-mon[92535]: pgmap v4870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:03 smithi035 ceph-mon[92535]: pgmap v4871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:05 smithi035 ceph-mon[92535]: pgmap v4872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:07 smithi035 ceph-mon[92535]: pgmap v4873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:09 smithi035 ceph-mon[92535]: pgmap v4874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:10 smithi035 ceph-mon[92535]: osdmap e374: 12 total, 12 up, 12 in 2023-03-17T11:24:06.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:11 smithi035 ceph-mon[92535]: pgmap v4876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:13 smithi035 ceph-mon[92535]: pgmap v4877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:15 smithi035 ceph-mon[92535]: pgmap v4878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:17 smithi035 ceph-mon[92535]: pgmap v4879: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:17 smithi035 ceph-mon[92535]: osdmap e375: 12 total, 12 up, 12 in 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:18 smithi035 ceph-mon[92535]: pgmap v4880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:18 smithi035 ceph-mon[92535]: pgmap v4881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:20 smithi035 ceph-mon[92535]: pgmap v4883: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:22 smithi035 ceph-mon[92535]: pgmap v4884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:24 smithi035 ceph-mon[92535]: pgmap v4885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:26 smithi035 ceph-mon[92535]: pgmap v4886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T11:24:06.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:28 smithi035 ceph-mon[92535]: pgmap v4887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:24:06.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:30 smithi035 ceph-mon[92535]: pgmap v4888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T11:24:08.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:32 smithi035 ceph-mon[92535]: pgmap v4889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:24:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:24:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:24:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:24:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:24:10.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:24:12.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:24:12.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:24:12.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:24:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:24:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:24:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:24:13.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa47affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa47affd700 1 -- 172.21.15.35:0/1664905633 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900af070 con 0x558639fdcbe0 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa47affd700 1 -- 172.21.15.35:0/1664905633 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(351..351 src has 1..351) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa4900978f0 con 0x558639fdcbe0 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558639eec390 con 0x558639fdcbe0 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa47affd700 1 -- 172.21.15.35:0/1664905633 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa490097ab0 con 0x558639fdcbe0 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa4add50b80 10 client.20673 fetch_fsmap learned FSMap version 105 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.745+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x558639d57d80 con 0x558639fdcbe0 2023-03-17T11:24:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa47affd700 1 -- 172.21.15.35:0/1664905633 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4900b4020 con 0x558639fdcbe0 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa47affd700 1 -- 172.21.15.35:0/1664905633 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fa4900973d0 con 0x558639fdcbe0 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa4add50b80 10 client.20673 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa4add50b80 10 client.20673 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa4add50b80 20 client.20673 populate_metadata read hostname 'smithi035' 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa4add50b80 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558639ff0f80 0x558639ff3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa4add50b80 4 client.20673 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:24:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558639ef8600 con 0x558639ff0f80 2023-03-17T11:24:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558639ff0f80 0x558639ff3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa47affd700 10 client.20673 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.746+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558639ff0f80 0x558639ff3360 crc :-1 s=READY pgs=660 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95bab924d4b9d8d3 server_cookie=b34793d473593e03 in_seq=0 out_seq=0 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa47affd700 1 -- 172.21.15.35:0/1664905633 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558639ef8600 con 0x558639ff0f80 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa47affd700 10 client.20673 handle_command_reply: tid=0 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 client.20673 shutdown 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 msgr2=0x558639fe0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fe0640 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fa490098100 tx=0x7fa490097e50 comp rx=0 tx=0).stop 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 shutdown_connections 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558639ff0f80 0x558639ff3360 crc :-1 s=READY pgs=660 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa47affd700 0 client.20673 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fd7960 0x558639fe33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 --2- 172.21.15.35:0/1664905633 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fe0640 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 >> 172.21.15.35:0/1664905633 conn(0x558639e346b0 msgr2=0x558639fd1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 shutdown_connections 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.747+0000 7fa4add50b80 1 -- 172.21.15.35:0/1664905633 wait complete. 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.748+0000 7fa4add50b80 20 client.20673 trim_cache size 0 max 16384 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.762+0000 7fa4add50b80 1 Processor -- start 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.762+0000 7fa4add50b80 1 -- start start 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdcbe0 0x558639fde0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4add50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639fd26f0 con 0x558639fd7960 2023-03-17T11:24:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4add50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639fd2000 con 0x558639fdcbe0 2023-03-17T11:24:19.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4add50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639fce5c0 con 0x558639fdd4f0 2023-03-17T11:24:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55094/0 (socket says 172.21.15.35:55094) 2023-03-17T11:24:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 -- 172.21.15.35:0/2105553554 learned_addr learned my addr 172.21.15.35:0/2105553554 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49affd700 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdcbe0 0x558639fde0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49bfff700 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 -- 172.21.15.35:0/2105553554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 msgr2=0x558639fe7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 -- 172.21.15.35:0/2105553554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdcbe0 msgr2=0x558639fde0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdcbe0 0x558639fde0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 -- 172.21.15.35:0/2105553554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558639ef0130 con 0x558639fd7960 2023-03-17T11:24:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49bfff700 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:24:21.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd1ac0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fa48c011ef0 tx=0x7fa48c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214901d07b08dd36 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:24.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4827fc700 1 -- 172.21.15.35:0/2105553554 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c026070 con 0x558639fd7960 2023-03-17T11:24:24.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4827fc700 1 -- 172.21.15.35:0/2105553554 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa48c003e70 con 0x558639fd7960 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.763+0000 7fa4827fc700 1 -- 172.21.15.35:0/2105553554 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c026da0 con 0x558639fd7960 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 -- 172.21.15.35:0/2105553554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 msgr2=0x558639fd1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd1ac0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fa48c011ef0 tx=0x7fa48c014000 comp rx=0 tx=0).stop 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 -- 172.21.15.35:0/2105553554 shutdown_connections 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fdd4f0 0x558639fe7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fd7960 0x558639fd1ac0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 --2- 172.21.15.35:0/2105553554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdcbe0 0x558639fde0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 -- 172.21.15.35:0/2105553554 >> 172.21.15.35:0/2105553554 conn(0x558639e346b0 msgr2=0x558639fdd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 -- 172.21.15.35:0/2105553554 shutdown_connections 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 -- 172.21.15.35:0/2105553554 wait complete. 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 -- start start 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.764+0000 7fa4add50b80 1 Processor -- start 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fd7960 0x558639fd8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fd9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:24.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558639fe8500 con 0x558639fdcbe0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55863a044df0 con 0x558639fdd4f0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55863a044f30 con 0x558639fd7960 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa4add50b80 10 client.0 _ll_register_callbacks cb 0x558639dcf230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fd9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fd9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55102/0 (socket says 172.21.15.35:55102) 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 -- 172.21.15.35:0/124246220 learned_addr learned my addr 172.21.15.35:0/124246220 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49bfff700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fd7960 0x558639fd8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 -- 172.21.15.35:0/124246220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fd7960 msgr2=0x558639fd8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fd7960 0x558639fd8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 -- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 msgr2=0x558639fd9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 -- 172.21.15.35:0/124246220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c004130 con 0x558639fdcbe0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49bfff700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa49affd700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fd9050 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fa490094900 tx=0x7fa49000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884fa632a9143976 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa47affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa47affd700 1 -- 172.21.15.35:0/124246220 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900af070 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.765+0000 7fa47affd700 1 -- 172.21.15.35:0/124246220 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(351..351 src has 1..351) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa4900b5080 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558639fa71e0 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa47affd700 1 -- 172.21.15.35:0/124246220 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa490097700 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 10 client.20679 fetch_fsmap learned FSMap version 105 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x558639d7e1f0 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa47affd700 1 -- 172.21.15.35:0/124246220 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558639fa71e0 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa47affd700 1 -- 172.21.15.35:0/124246220 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fa490010670 con 0x558639fdcbe0 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 10 client.20679 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 10 client.20679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 20 client.20679 populate_metadata read hostname 'smithi035' 2023-03-17T11:24:24.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55863a046320 0x55863a048730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 4 client.20679 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:24:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558639dadf00 con 0x55863a046320 2023-03-17T11:24:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.766+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55863a046320 0x55863a048730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.767+0000 7fa47affd700 10 client.20679 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.767+0000 7fa49b7fe700 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55863a046320 0x55863a048730 crc :-1 s=READY pgs=661 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a0451447ad64a1c server_cookie=e2fd006294583ef1 in_seq=0 out_seq=0 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa47affd700 1 -- 172.21.15.35:0/124246220 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558639dadf00 con 0x55863a046320 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa47affd700 10 client.20679 handle_command_reply: tid=0 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 client.20679 shutdown 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 msgr2=0x558639fd9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fd9050 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fa490094900 tx=0x7fa49000c750 comp rx=0 tx=0).stop 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 shutdown_connections 2023-03-17T11:24:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55863a046320 0x55863a048730 crc :-1 s=READY pgs=661 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558639fdd4f0 0x558639fd9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558639fd7960 0x558639fd8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa47affd700 0 client.20679 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 --2- 172.21.15.35:0/124246220 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558639fdcbe0 0x558639fd9050 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.787+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 >> 172.21.15.35:0/124246220 conn(0x558639e346b0 msgr2=0x558639fdb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 shutdown_connections 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4add50b80 1 -- 172.21.15.35:0/124246220 wait complete. 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4add50b80 20 client.20679 trim_cache size 0 max 16384 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa48409f6c0 msgr2=0x7fa4840a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa48409f6c0 0x7fa4840a1b70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009cb0 tx=0x7fa48c009260 comp rx=0 tx=0).stop 2023-03-17T11:24:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 msgr2=0x7fa49c1977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c1977c0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa49000e940 tx=0x7fa49000ed00 comp rx=0 tx=0).stop 2023-03-17T11:24:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 shutdown_connections 2023-03-17T11:24:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa48409f6c0 0x7fa4840a1b70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa49c104390 0x7fa49c1a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa49c0ff350 0x7fa49c197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 --2- 172.21.15.35:0/1371730852 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa49c0ffcf0 0x7fa49c1977c0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 >> 172.21.15.35:0/1371730852 conn(0x7fa49c076330 msgr2=0x7fa49c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 shutdown_connections 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:03.788+0000 7fa4a1bc3700 1 -- 172.21.15.35:0/1371730852 wait complete. 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 -- 172.21.15.35:0/3007810193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 msgr2=0x7f4d1810a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3007810193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d1810a1d0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009990 tx=0x7f4d08009ca0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 -- 172.21.15.35:0/3007810193 shutdown_connections 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3007810193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d1810a7a0 0x7f4d1810cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3007810193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d181013d0 0x7f4d181017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3007810193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d1810a1d0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 -- 172.21.15.35:0/3007810193 >> 172.21.15.35:0/3007810193 conn(0x7f4d18076330 msgr2=0x7f4d18076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 -- 172.21.15.35:0/3007810193 shutdown_connections 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 -- 172.21.15.35:0/3007810193 wait complete. 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 Processor -- start 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.911+0000 7f4d2047f700 1 -- start start 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d2047f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181013d0 0x7f4d18196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d2047f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d18196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d2047f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d1810a7a0 0x7f4d1819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d2047f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1819b210 con 0x7f4d18101ce0 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d2047f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1819b380 con 0x7f4d1810a7a0 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d2047f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1819b540 con 0x7f4d181013d0 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d18196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d18196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55118/0 (socket says 172.21.15.35:55118) 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 -- 172.21.15.35:0/3589758437 learned_addr learned my addr 172.21.15.35:0/3589758437 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181013d0 0x7f4d18196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d1810a7a0 0x7f4d1819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 -- 172.21.15.35:0/3589758437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181013d0 msgr2=0x7f4d18196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181013d0 0x7f4d18196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 -- 172.21.15.35:0/3589758437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d1810a7a0 msgr2=0x7f4d1819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d1810a7a0 0x7f4d1819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 -- 172.21.15.35:0/3589758437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080095f0 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.912+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d18196770 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f4d08006010 tx=0x7f4d08005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.913+0000 7f4d0f7fe700 1 -- 172.21.15.35:0/3589758437 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0801d070 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.913+0000 7f4d0f7fe700 1 -- 172.21.15.35:0/3589758437 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d08004000 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.913+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d181100c0 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.913+0000 7f4d0f7fe700 1 -- 172.21.15.35:0/3589758437 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08022c00 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.913+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1810ff30 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.915+0000 7f4d0f7fe700 1 -- 172.21.15.35:0/3589758437 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4d08022470 con 0x7f4d18101ce0 2023-03-17T11:24:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.915+0000 7f4d0f7fe700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4d0409f640 0x7f4d040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:34.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:34 smithi035 ceph-mon[92535]: pgmap v4890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:24:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.915+0000 7f4d0f7fe700 1 -- 172.21.15.35:0/3589758437 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(352..352 src has 1..352) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f4d080cbc40 con 0x7f4d18101ce0 2023-03-17T11:24:37.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.916+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4d0409f640 0x7f4d040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.916+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4d0409f640 0x7f4d040a1af0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4d14007be0 tx=0x7f4d140073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.916+0000 7f4d2c60cb80 1 Processor -- start 2023-03-17T11:24:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 -- start start 2023-03-17T11:24:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 0x562fd64bf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:37.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd63bc010 con 0x562fd64bef90 2023-03-17T11:24:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd640e950 con 0x562fd64b9d70 2023-03-17T11:24:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6407de0 con 0x562fd64bf8a0 2023-03-17T11:24:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 0x562fd64bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 0x562fd64bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55124/0 (socket says 172.21.15.35:55124) 2023-03-17T11:24:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 -- 172.21.15.35:0/2683398184 learned_addr learned my addr 172.21.15.35:0/2683398184 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:38.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 -- 172.21.15.35:0/2683398184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 msgr2=0x562fd64b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 -- 172.21.15.35:0/2683398184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 msgr2=0x562fd64ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1e21b700 1 -- 172.21.15.35:0/2683398184 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fd62895d0 con 0x562fd64bef90 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.917+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:24:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.918+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 0x562fd64bf360 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f4d14010e80 tx=0x7f4d14013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2121d42de35b42ef server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.918+0000 7f4d0cdae700 1 -- 172.21.15.35:0/2683398184 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14010eb0 con 0x562fd64bef90 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.918+0000 7f4d0cdae700 1 -- 172.21.15.35:0/2683398184 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d14003b10 con 0x562fd64bef90 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.918+0000 7f4d0cdae700 1 -- 172.21.15.35:0/2683398184 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14011a90 con 0x562fd64bef90 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.918+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/2683398184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 msgr2=0x562fd64bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.918+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 0x562fd64bf360 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f4d14010e80 tx=0x7f4d14013000 comp rx=0 tx=0).stop 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/2683398184 shutdown_connections 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bef90 0x562fd64bf360 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/2683398184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/2683398184 >> 172.21.15.35:0/2683398184 conn(0x562fd63126b0 msgr2=0x562fd64afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/2683398184 shutdown_connections 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/2683398184 wait complete. 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- start start 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 Processor -- start 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bef90 0x562fd64c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64c3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd628b8c0 con 0x562fd64b9d70 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64c38c0 con 0x562fd64bef90 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64cf430 con 0x562fd64bf8a0 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d2c60cb80 10 client.0 _ll_register_callbacks cb 0x562fd62ad230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d1e21b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.919+0000 7f4d1e21b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55128/0 (socket says 172.21.15.35:55128) 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4005604876 learned_addr learned my addr 172.21.15.35:0/4005604876 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bef90 0x562fd64c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4005604876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 msgr2=0x562fd64c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bef90 msgr2=0x562fd64c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bef90 0x562fd64c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4005604876 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d14010b60 con 0x562fd64b9d70 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c5810 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005790 tx=0x7f4d140057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77589f54d92891f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4005604876 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14011b60 con 0x562fd64b9d70 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4005604876 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(352..352 src has 1..352) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f4d14017070 con 0x562fd64b9d70 2023-03-17T11:24:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fd63ca390 con 0x562fd64b9d70 2023-03-17T11:24:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4005604876 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d14011cc0 con 0x562fd64b9d70 2023-03-17T11:24:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d2c60cb80 10 client.20691 fetch_fsmap learned FSMap version 105 2023-03-17T11:24:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.920+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x562fd6235d80 con 0x562fd64b9d70 2023-03-17T11:24:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4005604876 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562fd63ca390 con 0x562fd64b9d70 2023-03-17T11:24:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4005604876 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f4d1401f5a0 con 0x562fd64b9d70 2023-03-17T11:24:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d2c60cb80 10 client.20691 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d2c60cb80 10 client.20691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d2c60cb80 20 client.20691 populate_metadata read hostname 'smithi035' 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd64d32d0 0x562fd64d56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d2c60cb80 4 client.20691 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fd63d6600 con 0x562fd64d32d0 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd64d32d0 0x562fd64d56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd64d32d0 0x562fd64d56e0 crc :-1 s=READY pgs=662 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55829fd98f8fdfae server_cookie=8c9b1f4a05dc4529 in_seq=0 out_seq=0 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.921+0000 7f4d01ffb700 10 client.20691 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4005604876 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562fd63d6600 con 0x562fd64d32d0 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d01ffb700 10 client.20691 handle_command_reply: tid=0 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 client.20691 shutdown 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 msgr2=0x562fd64c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c5810 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005790 tx=0x7f4d140057c0 comp rx=0 tx=0).stop 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 shutdown_connections 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd64d32d0 0x562fd64d56e0 crc :-1 s=READY pgs=662 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bf8a0 0x562fd64c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d01ffb700 0 client.20691 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c5810 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4005604876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bef90 0x562fd64c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 >> 172.21.15.35:0/4005604876 conn(0x562fd63126b0 msgr2=0x562fd64b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 shutdown_connections 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.922+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4005604876 wait complete. 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.923+0000 7f4d2c60cb80 20 client.20691 trim_cache size 0 max 16384 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.937+0000 7f4d2c60cb80 1 Processor -- start 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.937+0000 7f4d2c60cb80 1 -- start start 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 0x562fd64c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64ab0f0 con 0x562fd64bf8a0 2023-03-17T11:24:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64ac5c0 con 0x562fd64b9d70 2023-03-17T11:24:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64b1600 con 0x562fd64bef90 2023-03-17T11:24:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 0x562fd64c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 0x562fd64c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55140/0 (socket says 172.21.15.35:55140) 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 -- 172.21.15.35:0/757917730 learned_addr learned my addr 172.21.15.35:0/757917730 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 -- 172.21.15.35:0/757917730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 msgr2=0x562fd64ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 -- 172.21.15.35:0/757917730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 msgr2=0x562fd64bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 -- 172.21.15.35:0/757917730 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fd63ce130 con 0x562fd64bf8a0 2023-03-17T11:24:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 0x562fd64c53b0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f4d10007f60 tx=0x7f4d10007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9f85765169f072 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d0d5af700 1 -- 172.21.15.35:0/757917730 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10013e80 con 0x562fd64bf8a0 2023-03-17T11:24:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d0d5af700 1 -- 172.21.15.35:0/757917730 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d100168e0 con 0x562fd64bf8a0 2023-03-17T11:24:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.938+0000 7f4d0d5af700 1 -- 172.21.15.35:0/757917730 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1001e6f0 con 0x562fd64bf8a0 2023-03-17T11:24:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/757917730 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 msgr2=0x562fd64c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 0x562fd64c53b0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f4d10007f60 tx=0x7f4d10007f90 comp rx=0 tx=0).stop 2023-03-17T11:24:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/757917730 shutdown_connections 2023-03-17T11:24:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64bf8a0 0x562fd64c53b0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64b9d70 0x562fd64bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/757917730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/757917730 >> 172.21.15.35:0/757917730 conn(0x562fd63126b0 msgr2=0x562fd64bca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/757917730 shutdown_connections 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/757917730 wait complete. 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 -- start start 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.939+0000 7f4d2c60cb80 1 Processor -- start 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bf8a0 0x562fd64c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64c8c70 con 0x562fd64b9d70 2023-03-17T11:24:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64c8de0 con 0x562fd64bf8a0 2023-03-17T11:24:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd64c8fa0 con 0x562fd64bef90 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 10 client.0 _ll_register_callbacks cb 0x562fd62ad230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55142/0 (socket says 172.21.15.35:55142) 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4285311550 learned_addr learned my addr 172.21.15.35:0/4285311550 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bf8a0 0x562fd64c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4285311550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 msgr2=0x562fd64ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bf8a0 msgr2=0x562fd64c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bf8a0 0x562fd64c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 -- 172.21.15.35:0/4285311550 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1000f040 con 0x562fd64b9d70 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1ea1c700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bf8a0 0x562fd64c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d1e21b700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c9fe0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005790 tx=0x7f4d1401f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b1f335d6e80629 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4285311550 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14027740 con 0x562fd64b9d70 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4285311550 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(352..352 src has 1..352) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f4d14020e40 con 0x562fd64b9d70 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.940+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fd64851e0 con 0x562fd64b9d70 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4285311550 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d14010e30 con 0x562fd64b9d70 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 10 client.20697 fetch_fsmap learned FSMap version 105 2023-03-17T11:24:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x562fd625c1f0 con 0x562fd64b9d70 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4285311550 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d1404b020 con 0x562fd64b9d70 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4285311550 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f4d14011c00 con 0x562fd64b9d70 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 10 client.20697 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 10 client.20697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 20 client.20697 populate_metadata read hostname 'smithi035' 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd6527fa0 0x562fd652a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 4 client.20697 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562fd628bf00 con 0x562fd6527fa0 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.941+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd6527fa0 0x562fd652a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.942+0000 7f4d1da1a700 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd6527fa0 0x562fd652a3b0 crc :-1 s=READY pgs=663 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612d3179b763258b server_cookie=432a35cf83be07f9 in_seq=0 out_seq=0 2023-03-17T11:24:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.942+0000 7f4d01ffb700 10 client.20697 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:52.969 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:36 smithi035 ceph-mon[92535]: pgmap v4891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d01ffb700 1 -- 172.21.15.35:0/4285311550 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562fd628bf00 con 0x562fd6527fa0 2023-03-17T11:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d01ffb700 10 client.20697 handle_command_reply: tid=0 2023-03-17T11:24:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 client.20697 shutdown 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 msgr2=0x562fd64c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c9fe0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005790 tx=0x7f4d1401f790 comp rx=0 tx=0).stop 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 shutdown_connections 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562fd6527fa0 0x562fd652a3b0 crc :-1 s=READY pgs=663 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562fd64bf8a0 0x562fd64c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562fd64b9d70 0x562fd64c9fe0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 --2- 172.21.15.35:0/4285311550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562fd64bef90 0x562fd64ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 >> 172.21.15.35:0/4285311550 conn(0x562fd63126b0 msgr2=0x562fd64bfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d01ffb700 0 client.20697 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 shutdown_connections 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 1 -- 172.21.15.35:0/4285311550 wait complete. 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.958+0000 7f4d2c60cb80 20 client.20697 trim_cache size 0 max 16384 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4d0409f640 msgr2=0x7f4d040a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4d0409f640 0x7f4d040a1af0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4d14007be0 tx=0x7f4d140073d0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 msgr2=0x7f4d18196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d18196770 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f4d08006010 tx=0x7f4d08005740 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 shutdown_connections 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f4d0409f640 0x7f4d040a1af0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d1810a7a0 0x7f4d1819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181013d0 0x7f4d18196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 --2- 172.21.15.35:0/3589758437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4d18101ce0 0x7f4d18196770 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 >> 172.21.15.35:0/3589758437 conn(0x7f4d18076330 msgr2=0x7f4d180fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:24:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 shutdown_connections 2023-03-17T11:24:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:16.959+0000 7f4d2047f700 1 -- 172.21.15.35:0/3589758437 wait complete. 2023-03-17T11:24:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 -- 172.21.15.35:0/2899502969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 msgr2=0x7fa05810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:24:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 --2- 172.21.15.35:0/2899502969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa05810bf60 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fa050009fc0 tx=0x7fa05000b330 comp rx=0 tx=0).stop 2023-03-17T11:24:58.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 -- 172.21.15.35:0/2899502969 shutdown_connections 2023-03-17T11:24:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 --2- 172.21.15.35:0/2899502969 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa05810bf60 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:24:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 --2- 172.21.15.35:0/2899502969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ff350 0x7fa0580ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 --2- 172.21.15.35:0/2899502969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0580ffcf0 0x7fa058103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.081+0000 7fa05fd86700 1 -- 172.21.15.35:0/2899502969 >> 172.21.15.35:0/2899502969 conn(0x7fa058076330 msgr2=0x7fa058076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.082+0000 7fa05fd86700 1 -- 172.21.15.35:0/2899502969 shutdown_connections 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.082+0000 7fa05fd86700 1 -- 172.21.15.35:0/2899502969 wait complete. 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.082+0000 7fa05fd86700 1 Processor -- start 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.082+0000 7fa05fd86700 1 -- start start 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0580ff350 0x7fa058197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ffcf0 0x7fa058197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa0581a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581980a0 con 0x7fa058104390 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581a27e0 con 0x7fa0580ffcf0 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581a29a0 con 0x7fa0580ff350 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa0581a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05db22700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0580ff350 0x7fa058197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa0581a22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55160/0 (socket says 172.21.15.35:55160) 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 -- 172.21.15.35:0/1112881709 learned_addr learned my addr 172.21.15.35:0/1112881709 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05d321700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ffcf0 0x7fa058197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 -- 172.21.15.35:0/1112881709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0580ff350 msgr2=0x7fa058197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0580ff350 0x7fa058197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 -- 172.21.15.35:0/1112881709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ffcf0 msgr2=0x7fa058197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ffcf0 0x7fa058197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 -- 172.21.15.35:0/1112881709 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009c40 con 0x7fa058104390 2023-03-17T11:25:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05d321700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ffcf0 0x7fa058197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:25:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05e323700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa0581a22a0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fa050009470 tx=0x7fa050008a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa04affd700 1 -- 172.21.15.35:0/1112881709 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000e040 con 0x7fa058104390 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa04affd700 1 -- 172.21.15.35:0/1112881709 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa05000bbf0 con 0x7fa058104390 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05810f010 con 0x7fa058104390 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa04affd700 1 -- 172.21.15.35:0/1112881709 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0500052a0 con 0x7fa058104390 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.083+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05810ee80 con 0x7fa058104390 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.086+0000 7fa04affd700 1 -- 172.21.15.35:0/1112881709 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa05001d470 con 0x7fa058104390 2023-03-17T11:25:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.086+0000 7fa04affd700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa04409f6c0 0x7fa0440a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.087+0000 7fa05db22700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa04409f6c0 0x7fa0440a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.087+0000 7fa04affd700 1 -- 172.21.15.35:0/1112881709 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(353..353 src has 1..353) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa0500cb9b0 con 0x7fa058104390 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.087+0000 7fa05db22700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa04409f6c0 0x7fa0440a1b70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa054009c60 tx=0x7fa054009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 Processor -- start 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 -- start start 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 0x5568b7d61fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d5c960 0x5568b7d5cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7c63010 con 0x5568b7d61be0 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7cb5950 con 0x5568b7d624f0 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7caede0 con 0x5568b7d5c960 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 0x5568b7d61fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 0x5568b7d61fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55164/0 (socket says 172.21.15.35:55164) 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa05db22700 1 -- 172.21.15.35:0/676088268 learned_addr learned my addr 172.21.15.35:0/676088268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa05d321700 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa05e323700 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d5c960 0x5568b7d5cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.088+0000 7fa05db22700 1 -- 172.21.15.35:0/676088268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d5c960 msgr2=0x5568b7d5cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa05db22700 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d5c960 0x5568b7d5cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa05db22700 1 -- 172.21.15.35:0/676088268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 msgr2=0x5568b7d5c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa05db22700 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa05db22700 1 -- 172.21.15.35:0/676088268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568b7b305d0 con 0x5568b7d61be0 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa05db22700 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 0x5568b7d61fb0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e4e0 tx=0x7fa054014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6047eb6efb03 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa043fff700 1 -- 172.21.15.35:0/676088268 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054026430 con 0x5568b7d61be0 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa043fff700 1 -- 172.21.15.35:0/676088268 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa054021070 con 0x5568b7d61be0 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.089+0000 7fa043fff700 1 -- 172.21.15.35:0/676088268 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05401d670 con 0x5568b7d61be0 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 -- 172.21.15.35:0/676088268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 msgr2=0x5568b7d61fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 0x5568b7d61fb0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e4e0 tx=0x7fa054014000 comp rx=0 tx=0).stop 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 -- 172.21.15.35:0/676088268 shutdown_connections 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d5c960 0x5568b7d5cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d61be0 0x5568b7d61fb0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/676088268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 -- 172.21.15.35:0/676088268 >> 172.21.15.35:0/676088268 conn(0x5568b7bb96b0 msgr2=0x5568b7d56a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 -- 172.21.15.35:0/676088268 shutdown_connections 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 -- 172.21.15.35:0/676088268 wait complete. 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 -- start start 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.090+0000 7fa06bf13b80 1 Processor -- start 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d68400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d65680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d65c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7b328c0 con 0x5568b7d5c960 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7d663d0 con 0x5568b7d624f0 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7d72000 con 0x5568b7d61be0 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa06bf13b80 10 client.0 _ll_register_callbacks cb 0x5568b7b54230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d68400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d68400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55170/0 (socket says 172.21.15.35:55170) 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 -- 172.21.15.35:0/3761430968 learned_addr learned my addr 172.21.15.35:0/3761430968 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05e323700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d65c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05d321700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d65680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 -- 172.21.15.35:0/3761430968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 msgr2=0x5568b7d65680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d65680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 -- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 msgr2=0x5568b7d65c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d65c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 -- 172.21.15.35:0/3761430968 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa054017070 con 0x5568b7d5c960 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05d321700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d65680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa05db22700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d68400 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fa054009340 tx=0x7fa05400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d745c4aceded79c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.091+0000 7fa0417fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa0417fa700 1 -- 172.21.15.35:0/3761430968 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05401c820 con 0x5568b7d5c960 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa0417fa700 1 -- 172.21.15.35:0/3761430968 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(353..353 src has 1..353) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa05401c980 con 0x5568b7d5c960 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568b7c71390 con 0x5568b7d5c960 2023-03-17T11:25:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa0417fa700 1 -- 172.21.15.35:0/3761430968 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa05401ce70 con 0x5568b7d5c960 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 10 client.20709 fetch_fsmap learned FSMap version 105 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x5568b7adcd80 con 0x5568b7d5c960 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa0417fa700 1 -- 172.21.15.35:0/3761430968 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568b7c71390 con 0x5568b7d5c960 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa0417fa700 1 -- 172.21.15.35:0/3761430968 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fa054003970 con 0x5568b7d5c960 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 10 client.20709 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 10 client.20709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 20 client.20709 populate_metadata read hostname 'smithi035' 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7d75f20 0x5568b7d78330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 4 client.20709 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.092+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568b7c7d600 con 0x5568b7d75f20 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.093+0000 7fa05d321700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7d75f20 0x5568b7d78330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.093+0000 7fa0417fa700 10 client.20709 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.093+0000 7fa05d321700 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7d75f20 0x5568b7d78330 crc :-1 s=READY pgs=664 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2cd6960ac4f8b94 server_cookie=c672e9f82af4e5bc in_seq=0 out_seq=0 2023-03-17T11:25:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa0417fa700 1 -- 172.21.15.35:0/3761430968 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5568b7c7d600 con 0x5568b7d75f20 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa0417fa700 10 client.20709 handle_command_reply: tid=0 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 client.20709 shutdown 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 msgr2=0x5568b7d68400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d68400 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fa054009340 tx=0x7fa05400ee70 comp rx=0 tx=0).stop 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 shutdown_connections 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7d75f20 0x5568b7d78330 crc :-1 s=READY pgs=664 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d65c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d68400 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa0417fa700 0 client.20709 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:25:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/3761430968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d65680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:14.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 >> 172.21.15.35:0/3761430968 conn(0x5568b7bb96b0 msgr2=0x5568b7d5b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 shutdown_connections 2023-03-17T11:25:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 1 -- 172.21.15.35:0/3761430968 wait complete. 2023-03-17T11:25:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.094+0000 7fa06bf13b80 20 client.20709 trim_cache size 0 max 16384 2023-03-17T11:25:14.746 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 Processor -- start 2023-03-17T11:25:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 -- start start 2023-03-17T11:25:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d67fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7d665e0 con 0x5568b7d5c960 2023-03-17T11:25:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7d66c30 con 0x5568b7d624f0 2023-03-17T11:25:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7d58620 con 0x5568b7d61be0 2023-03-17T11:25:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55178/0 (socket says 172.21.15.35:55178) 2023-03-17T11:25:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa05db22700 1 -- 172.21.15.35:0/431168468 learned_addr learned my addr 172.21.15.35:0/431168468 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa05e323700 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:21.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:38 smithi035 ceph-mon[92535]: pgmap v4892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:25:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.109+0000 7fa05d321700 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d67fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa05db22700 1 -- 172.21.15.35:0/431168468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 msgr2=0x5568b7d67fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa05db22700 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d67fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa05db22700 1 -- 172.21.15.35:0/431168468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 msgr2=0x5568b7d5f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa05db22700 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa05db22700 1 -- 172.21.15.35:0/431168468 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568b7c75130 con 0x5568b7d5c960 2023-03-17T11:25:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa05db22700 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6cf50 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fa054039ff0 tx=0x7fa054005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cb4798b0696c18 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa048ff9700 1 -- 172.21.15.35:0/431168468 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05401ce90 con 0x5568b7d5c960 2023-03-17T11:25:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa048ff9700 1 -- 172.21.15.35:0/431168468 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa054021070 con 0x5568b7d5c960 2023-03-17T11:25:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa048ff9700 1 -- 172.21.15.35:0/431168468 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054005340 con 0x5568b7d5c960 2023-03-17T11:25:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa06bf13b80 1 -- 172.21.15.35:0/431168468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 msgr2=0x5568b7d6cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.110+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6cf50 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fa054039ff0 tx=0x7fa054005ce0 comp rx=0 tx=0).stop 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 -- 172.21.15.35:0/431168468 shutdown_connections 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d624f0 0x5568b7d5f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6cf50 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/431168468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d61be0 0x5568b7d67fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 -- 172.21.15.35:0/431168468 >> 172.21.15.35:0/431168468 conn(0x5568b7bb96b0 msgr2=0x5568b7d5bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 -- 172.21.15.35:0/431168468 shutdown_connections 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 -- 172.21.15.35:0/431168468 wait complete. 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 -- start start 2023-03-17T11:25:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.111+0000 7fa06bf13b80 1 Processor -- start 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d61be0 0x5568b7d6b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d624f0 0x5568b7dc8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7d6bde0 con 0x5568b7d5c960 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7dc9330 con 0x5568b7d61be0 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568b7dc94f0 con 0x5568b7d624f0 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 10 client.0 _ll_register_callbacks cb 0x5568b7b54230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55184/0 (socket says 172.21.15.35:55184) 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 -- 172.21.15.35:0/1395535684 learned_addr learned my addr 172.21.15.35:0/1395535684 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05d321700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d61be0 0x5568b7d6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 -- 172.21.15.35:0/1395535684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d624f0 msgr2=0x5568b7dc8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05e323700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d624f0 0x5568b7dc8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d624f0 0x5568b7dc8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 -- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d61be0 msgr2=0x5568b7d6b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d61be0 0x5568b7d6b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 -- 172.21.15.35:0/1395535684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568b7adcd80 con 0x5568b7d5c960 2023-03-17T11:25:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05d321700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d61be0 0x5568b7d6b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:25:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05e323700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d624f0 0x5568b7dc8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:25:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa05db22700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6b120 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fa05400eeb0 tx=0x7fa054003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef8932e272bb85d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa0417fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:25:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa0417fa700 1 -- 172.21.15.35:0/1395535684 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05401cea0 con 0x5568b7d5c960 2023-03-17T11:25:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568b7d2c1e0 con 0x5568b7d5c960 2023-03-17T11:25:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.112+0000 7fa0417fa700 1 -- 172.21.15.35:0/1395535684 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(353..353 src has 1..353) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa05401c620 con 0x5568b7d5c960 2023-03-17T11:25:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa0417fa700 1 -- 172.21.15.35:0/1395535684 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa05401c7e0 con 0x5568b7d5c960 2023-03-17T11:25:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 10 client.20715 fetch_fsmap learned FSMap version 105 2023-03-17T11:25:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x5568b7b031f0 con 0x5568b7d5c960 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa0417fa700 1 -- 172.21.15.35:0/1395535684 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568b7d2c1e0 con 0x5568b7d5c960 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa0417fa700 1 -- 172.21.15.35:0/1395535684 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7fa05402e9b0 con 0x5568b7d5c960 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 10 client.20715 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 10 client.20715 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 20 client.20715 populate_metadata read hostname 'smithi035' 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7dca710 0x5568b7dccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 4 client.20715 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:25:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5568b7b32f00 con 0x5568b7dca710 2023-03-17T11:25:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.113+0000 7fa05d321700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7dca710 0x5568b7dccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.114+0000 7fa0417fa700 10 client.20715 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:25:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.114+0000 7fa05d321700 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7dca710 0x5568b7dccaf0 crc :-1 s=READY pgs=665 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c908c141979159 server_cookie=a66c473403bee8ee in_seq=0 out_seq=0 2023-03-17T11:25:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa0417fa700 1 -- 172.21.15.35:0/1395535684 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5568b7b32f00 con 0x5568b7dca710 2023-03-17T11:25:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa0417fa700 10 client.20715 handle_command_reply: tid=0 2023-03-17T11:25:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 client.20715 shutdown 2023-03-17T11:25:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 msgr2=0x5568b7d6b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:37.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6b120 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fa05400eeb0 tx=0x7fa054003de0 comp rx=0 tx=0).stop 2023-03-17T11:25:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 shutdown_connections 2023-03-17T11:25:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5568b7dca710 0x5568b7dccaf0 crc :-1 s=READY pgs=665 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5568b7d624f0 0x5568b7dc8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5568b7d5c960 0x5568b7d6b120 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 --2- 172.21.15.35:0/1395535684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5568b7d61be0 0x5568b7d6b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa0417fa700 0 client.20715 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.125+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 >> 172.21.15.35:0/1395535684 conn(0x5568b7bb96b0 msgr2=0x5568b7d5f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 shutdown_connections 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa06bf13b80 1 -- 172.21.15.35:0/1395535684 wait complete. 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa06bf13b80 20 client.20715 trim_cache size 0 max 16384 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa04409f6c0 msgr2=0x7fa0440a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa04409f6c0 0x7fa0440a1b70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa054009c60 tx=0x7fa054009260 comp rx=0 tx=0).stop 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 msgr2=0x7fa0581a22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:42.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa0581a22a0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fa050009470 tx=0x7fa050008a70 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 shutdown_connections 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa04409f6c0 0x7fa0440a1b70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa058104390 0x7fa0581a22a0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0580ff350 0x7fa058197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 --2- 172.21.15.35:0/1112881709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0580ffcf0 0x7fa058197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 >> 172.21.15.35:0/1112881709 conn(0x7fa058076330 msgr2=0x7fa0580fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 shutdown_connections 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:30.126+0000 7fa05fd86700 1 -- 172.21.15.35:0/1112881709 wait complete. 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 -- 172.21.15.35:0/779490985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a241045a0 msgr2=0x7f1a2410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 --2- 172.21.15.35:0/779490985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a241045a0 0x7f1a2410c170 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00b0d0 tx=0x7f1a1c00b3e0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 -- 172.21.15.35:0/779490985 shutdown_connections 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 --2- 172.21.15.35:0/779490985 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a241045a0 0x7f1a2410c170 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 --2- 172.21.15.35:0/779490985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a240ffa80 0x7f1a240ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 --2- 172.21.15.35:0/779490985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a24100420 0x7f1a24103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 -- 172.21.15.35:0/779490985 >> 172.21.15.35:0/779490985 conn(0x7f1a240757a0 msgr2=0x7f1a24075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:42.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 -- 172.21.15.35:0/779490985 shutdown_connections 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.248+0000 7f1a29692700 1 -- 172.21.15.35:0/779490985 wait complete. 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 Processor -- start 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 -- start start 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a240ffa80 0x7f1a24100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 0x7f1a241014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a241045a0 0x7f1a241a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24101cd0 con 0x7f1a24100420 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241a4c50 con 0x7f1a241045a0 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a29692700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241a4d90 con 0x7f1a240ffa80 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a227fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 0x7f1a241014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a227fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 0x7f1a241014a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55200/0 (socket says 172.21.15.35:55200) 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a227fc700 1 -- 172.21.15.35:0/2867785925 learned_addr learned my addr 172.21.15.35:0/2867785925 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.249+0000 7f1a237fe700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a241045a0 0x7f1a241a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a240ffa80 0x7f1a24100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a227fc700 1 -- 172.21.15.35:0/2867785925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a240ffa80 msgr2=0x7f1a24100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:42.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a227fc700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a240ffa80 0x7f1a24100f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a227fc700 1 -- 172.21.15.35:0/2867785925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a241045a0 msgr2=0x7f1a241a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a227fc700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a241045a0 0x7f1a241a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:42.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a227fc700 1 -- 172.21.15.35:0/2867785925 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009d00 con 0x7f1a24100420 2023-03-17T11:25:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a227fc700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 0x7f1a241014a0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e940 tx=0x7f1a1800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a0bfff700 1 -- 172.21.15.35:0/2867785925 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18009730 con 0x7f1a24100420 2023-03-17T11:25:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2410f1d0 con 0x7f1a24100420 2023-03-17T11:25:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a0bfff700 1 -- 172.21.15.35:0/2867785925 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a1800ee90 con 0x7f1a24100420 2023-03-17T11:25:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a0bfff700 1 -- 172.21.15.35:0/2867785925 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18018420 con 0x7f1a24100420 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.250+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2410f040 con 0x7f1a24100420 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.253+0000 7f1a0bfff700 1 -- 172.21.15.35:0/2867785925 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f1a1800cbd0 con 0x7f1a24100420 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.253+0000 7f1a0bfff700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1a0c09f640 0x7f1a0c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.253+0000 7f1a0bfff700 1 -- 172.21.15.35:0/2867785925 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(353..353 src has 1..353) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1a18014070 con 0x7f1a24100420 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.253+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1a0c09f640 0x7f1a0c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.254+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1a0c09f640 0x7f1a0c0a1af0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009bf0 tx=0x7f1a14009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.254+0000 7f1a3581fb80 1 Processor -- start 2023-03-17T11:25:46.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.254+0000 7f1a3581fb80 1 -- start start 2023-03-17T11:25:46.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:46.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8da4f0 0x563cba8d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d4960 0x563cba8d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba7db010 con 0x563cba8d9be0 2023-03-17T11:25:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba82d950 con 0x563cba8d4960 2023-03-17T11:25:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba826de0 con 0x563cba8da4f0 2023-03-17T11:25:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55206/0 (socket says 172.21.15.35:55206) 2023-03-17T11:25:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 -- 172.21.15.35:0/1475281846 learned_addr learned my addr 172.21.15.35:0/1475281846 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a237fe700 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d4960 0x563cba8d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a227fc700 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8da4f0 0x563cba8d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 -- 172.21.15.35:0/1475281846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8da4f0 msgr2=0x563cba8d4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8da4f0 0x563cba8d4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 -- 172.21.15.35:0/1475281846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d4960 msgr2=0x563cba8d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d4960 0x563cba8d4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 -- 172.21.15.35:0/1475281846 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cba6a85d0 con 0x563cba8d9be0 2023-03-17T11:25:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a237fe700 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d4960 0x563cba8d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:25:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8d9fb0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f1a14011e40 tx=0x7f1a14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b434c3891b06b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a097fa700 1 -- 172.21.15.35:0/1475281846 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14004220 con 0x563cba8d9be0 2023-03-17T11:25:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a097fa700 1 -- 172.21.15.35:0/1475281846 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a14016070 con 0x563cba8d9be0 2023-03-17T11:25:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.255+0000 7f1a097fa700 1 -- 172.21.15.35:0/1475281846 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1401f640 con 0x563cba8d9be0 2023-03-17T11:25:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1475281846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 msgr2=0x563cba8d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8d9fb0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f1a14011e40 tx=0x7f1a14014000 comp rx=0 tx=0).stop 2023-03-17T11:25:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1475281846 shutdown_connections 2023-03-17T11:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d4960 0x563cba8d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8d9fb0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1475281846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8da4f0 0x563cba8d4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1475281846 >> 172.21.15.35:0/1475281846 conn(0x563cba7316b0 msgr2=0x563cba8cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:25:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1475281846 shutdown_connections 2023-03-17T11:25:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1475281846 wait complete. 2023-03-17T11:25:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.256+0000 7f1a3581fb80 1 -- start start 2023-03-17T11:25:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 Processor -- start 2023-03-17T11:25:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:51.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:40 smithi035 ceph-mon[92535]: pgmap v4893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:51.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:42 smithi035 ceph-mon[92535]: pgmap v4894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:51.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:44 smithi035 ceph-mon[92535]: pgmap v4895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:25:53.235 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:46 smithi035 ceph-mon[92535]: pgmap v4896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:53.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:48 smithi035 ceph-mon[92535]: pgmap v4897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:25:53.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:50 smithi035 ceph-mon[92535]: pgmap v4898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:53.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:52 smithi035 ceph-mon[92535]: pgmap v4899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:53.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:54 smithi035 ceph-mon[92535]: pgmap v4900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:25:53.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:56 smithi035 ceph-mon[92535]: pgmap v4901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:53.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:14:58 smithi035 ceph-mon[92535]: pgmap v4902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:25:55.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:00 smithi035 ceph-mon[92535]: pgmap v4903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:55.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:02 smithi035 ceph-mon[92535]: pgmap v4904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:55.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:04 smithi035 ceph-mon[92535]: pgmap v4905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:25:56.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:06 smithi035 ceph-mon[92535]: pgmap v4906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:25:56.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:08 smithi035 ceph-mon[92535]: pgmap v4907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:25:56.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:09 smithi035 ceph-mon[92535]: osdmap e376: 12 total, 12 up, 12 in 2023-03-17T11:25:56.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:10 smithi035 ceph-mon[92535]: pgmap v4909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:25:56.735 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:12 smithi035 ceph-mon[92535]: pgmap v4910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:14 smithi035 ceph-mon[92535]: pgmap v4911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:16 smithi035 ceph-mon[92535]: pgmap v4912: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:17 smithi035 ceph-mon[92535]: osdmap e377: 12 total, 12 up, 12 in 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:18 smithi035 ceph-mon[92535]: pgmap v4913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:19 smithi035 ceph-mon[92535]: pgmap v4915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:25:56.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:19 smithi035 ceph-mon[92535]: pgmap v4916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:21 smithi035 ceph-mon[92535]: pgmap v4917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:23 smithi035 ceph-mon[92535]: pgmap v4918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:25 smithi035 ceph-mon[92535]: pgmap v4919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:27 smithi035 ceph-mon[92535]: pgmap v4920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:29 smithi035 ceph-mon[92535]: pgmap v4921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:31 smithi035 ceph-mon[92535]: pgmap v4922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:33 smithi035 ceph-mon[92535]: pgmap v4923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:35 smithi035 ceph-mon[92535]: pgmap v4924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:25:56.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:37 smithi035 ceph-mon[92535]: pgmap v4925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:25:57.756 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:39 smithi035 ceph-mon[92535]: pgmap v4926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:25:57.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:41 smithi035 ceph-mon[92535]: pgmap v4927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:57.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:43 smithi035 ceph-mon[92535]: pgmap v4928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:25:57.757 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:45 smithi035 ceph-mon[92535]: pgmap v4929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:25:57.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba6aa8c0 con 0x563cba8d9be0 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8de240 con 0x563cba8da4f0 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8de400 con 0x563cba8d4960 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a3581fb80 10 client.0 _ll_register_callbacks cb 0x563cba6cc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55214/0 (socket says 172.21.15.35:55214) 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 -- 172.21.15.35:0/2794180848 learned_addr learned my addr 172.21.15.35:0/2794180848 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a237fe700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 -- 172.21.15.35:0/2794180848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 msgr2=0x563cba8e03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:57.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 -- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 msgr2=0x563cba8ddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8ddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 -- 172.21.15.35:0/2794180848 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a14011b20 con 0x563cba8d9be0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a237fe700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a227fc700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dd5c0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f1a18094850 tx=0x7f1a18097dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bc7052bff5b9a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.257+0000 7f1a06ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a06ff5700 1 -- 172.21.15.35:0/2794180848 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1809c170 con 0x563cba8d9be0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a06ff5700 1 -- 172.21.15.35:0/2794180848 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(353..353 src has 1..353) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1a180a0540 con 0x563cba8d9be0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cba7e9390 con 0x563cba8d9be0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a06ff5700 1 -- 172.21.15.35:0/2794180848 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a180a00b0 con 0x563cba8d9be0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 10 client.20727 fetch_fsmap learned FSMap version 105 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x563cba654d80 con 0x563cba8d9be0 2023-03-17T11:25:57.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a06ff5700 1 -- 172.21.15.35:0/2794180848 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563cba7e9390 con 0x563cba8d9be0 2023-03-17T11:25:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a06ff5700 1 -- 172.21.15.35:0/2794180848 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f1a180972b0 con 0x563cba8d9be0 2023-03-17T11:25:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 10 client.20727 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:25:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 10 client.20727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:25:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 20 client.20727 populate_metadata read hostname 'smithi035' 2023-03-17T11:25:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba8ee0d0 0x563cba8f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:25:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 4 client.20727 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:25:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.258+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cba7f5600 con 0x563cba8ee0d0 2023-03-17T11:25:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.259+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba8ee0d0 0x563cba8f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:25:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.259+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba8ee0d0 0x563cba8f04e0 crc :-1 s=READY pgs=667 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b08f60e6682f643 server_cookie=786a03690e657b1c in_seq=0 out_seq=0 2023-03-17T11:25:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.259+0000 7f1a06ff5700 10 client.20727 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a06ff5700 1 -- 172.21.15.35:0/2794180848 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563cba7f5600 con 0x563cba8ee0d0 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a06ff5700 10 client.20727 handle_command_reply: tid=0 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 client.20727 shutdown 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 msgr2=0x563cba8dd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dd5c0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f1a18094850 tx=0x7f1a18097dc0 comp rx=0 tx=0).stop 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 shutdown_connections 2023-03-17T11:25:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba8ee0d0 0x563cba8f04e0 crc :-1 s=READY pgs=667 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:25:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/2794180848 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dd5c0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a06ff5700 0 client.20727 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 >> 172.21.15.35:0/2794180848 conn(0x563cba7316b0 msgr2=0x563cba8d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 shutdown_connections 2023-03-17T11:26:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 1 -- 172.21.15.35:0/2794180848 wait complete. 2023-03-17T11:26:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.260+0000 7f1a3581fb80 20 client.20727 trim_cache size 0 max 16384 2023-03-17T11:26:00.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 Processor -- start 2023-03-17T11:26:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 -- start start 2023-03-17T11:26:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8ca0d0 con 0x563cba8d9be0 2023-03-17T11:26:00.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8cf680 con 0x563cba8da4f0 2023-03-17T11:26:00.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8dbbc0 con 0x563cba8d4960 2023-03-17T11:26:00.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a227fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a227fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55222/0 (socket says 172.21.15.35:55222) 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.275+0000 7f1a227fc700 1 -- 172.21.15.35:0/3462973346 learned_addr learned my addr 172.21.15.35:0/3462973346 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a237fe700 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a227fc700 1 -- 172.21.15.35:0/3462973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 msgr2=0x563cba8ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a227fc700 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a227fc700 1 -- 172.21.15.35:0/3462973346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 msgr2=0x563cba8d76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a227fc700 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8d76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a227fc700 1 -- 172.21.15.35:0/3462973346 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cba7ed130 con 0x563cba8d9be0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a227fc700 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dfee0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1a180c80e0 tx=0x7f1a180996d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf87e2f7e67890b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a09ffb700 1 -- 172.21.15.35:0/3462973346 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1809c170 con 0x563cba8d9be0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a09ffb700 1 -- 172.21.15.35:0/3462973346 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a18099130 con 0x563cba8d9be0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a09ffb700 1 -- 172.21.15.35:0/3462973346 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18099560 con 0x563cba8d9be0 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a3581fb80 1 -- 172.21.15.35:0/3462973346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 msgr2=0x563cba8dfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.276+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dfee0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1a180c80e0 tx=0x7f1a180996d0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- 172.21.15.35:0/3462973346 shutdown_connections 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8da4f0 0x563cba8d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/3462973346 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8d9be0 0x563cba8dfee0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- 172.21.15.35:0/3462973346 >> 172.21.15.35:0/3462973346 conn(0x563cba7316b0 msgr2=0x563cba8d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- 172.21.15.35:0/3462973346 shutdown_connections 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- 172.21.15.35:0/3462973346 wait complete. 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- start start 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 Processor -- start 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d9be0 0x563cba8e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 0x563cba8e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8e36a0 con 0x563cba8da4f0 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8e3810 con 0x563cba8d9be0 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cba8e39d0 con 0x563cba8d4960 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.277+0000 7f1a3581fb80 10 client.0 _ll_register_callbacks cb 0x563cba6cc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:26:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 0x563cba8e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 0x563cba8e2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55230/0 (socket says 172.21.15.35:55230) 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 -- 172.21.15.35:0/1694122946 learned_addr learned my addr 172.21.15.35:0/1694122946 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a227fc700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d9be0 0x563cba8e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 -- 172.21.15.35:0/1694122946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 msgr2=0x563cba8e49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 -- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d9be0 msgr2=0x563cba8e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d9be0 0x563cba8e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 -- 172.21.15.35:0/1694122946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cba654d80 con 0x563cba8da4f0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a237fe700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 0x563cba8e2f90 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00b0d0 tx=0x7f1a1c00baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7bae4483f02e7e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a06ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a06ff5700 1 -- 172.21.15.35:0/1694122946 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c021070 con 0x563cba8da4f0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a06ff5700 1 -- 172.21.15.35:0/1694122946 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(353..353 src has 1..353) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f1a1c00be20 con 0x563cba8da4f0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cba8a41e0 con 0x563cba8da4f0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a06ff5700 1 -- 172.21.15.35:0/1694122946 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a1c00e040 con 0x563cba8da4f0 2023-03-17T11:26:01.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a3581fb80 10 client.20733 fetch_fsmap learned FSMap version 105 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.278+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x563cba67b1f0 con 0x563cba8da4f0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a06ff5700 1 -- 172.21.15.35:0/1694122946 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563cba8a41e0 con 0x563cba8da4f0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a06ff5700 1 -- 172.21.15.35:0/1694122946 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 105) v1 ==== 6933+0+0 (secure 0 0 0) 0x7f1a1c00b100 con 0x563cba8da4f0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a3581fb80 10 client.20733 fetch_fsmap finished waiting for FSMap version 105 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a3581fb80 10 client.20733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a3581fb80 20 client.20733 populate_metadata read hostname 'smithi035' 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba9cb1d0 0x563cba9cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a3581fb80 4 client.20733 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563cba6aaf00 con 0x563cba9cb1d0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba9cb1d0 0x563cba9cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a06ff5700 10 client.20733 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.279+0000 7f1a22ffd700 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba9cb1d0 0x563cba9cd5e0 crc :-1 s=READY pgs=668 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ee9d54a17be2efe server_cookie=28fdecdb499b35a6 in_seq=0 out_seq=0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a06ff5700 1 -- 172.21.15.35:0/1694122946 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563cba6aaf00 con 0x563cba9cb1d0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a06ff5700 10 client.20733 handle_command_reply: tid=0 2023-03-17T11:26:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 client.20733 shutdown 2023-03-17T11:26:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 msgr2=0x563cba8e2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 0x563cba8e2f90 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00b0d0 tx=0x7f1a1c00baa0 comp rx=0 tx=0).stop 2023-03-17T11:26:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 shutdown_connections 2023-03-17T11:26:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563cba9cb1d0 0x563cba9cd5e0 crc :-1 s=READY pgs=668 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563cba8da4f0 0x563cba8e2f90 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a06ff5700 0 client.20733 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563cba8d4960 0x563cba8e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 --2- 172.21.15.35:0/1694122946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563cba8d9be0 0x563cba8e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 >> 172.21.15.35:0/1694122946 conn(0x563cba7316b0 msgr2=0x563cba8d76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 shutdown_connections 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 1 -- 172.21.15.35:0/1694122946 wait complete. 2023-03-17T11:26:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.291+0000 7f1a3581fb80 20 client.20733 trim_cache size 0 max 16384 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1a0c09f640 msgr2=0x7f1a0c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1a0c09f640 0x7f1a0c0a1af0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009bf0 tx=0x7f1a14009260 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 msgr2=0x7f1a241014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 0x7f1a241014a0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e940 tx=0x7f1a1800ec50 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 shutdown_connections 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f1a0c09f640 0x7f1a0c0a1af0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a241045a0 0x7f1a241a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a240ffa80 0x7f1a24100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 --2- 172.21.15.35:0/2867785925 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1a24100420 0x7f1a241014a0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 >> 172.21.15.35:0/2867785925 conn(0x7f1a240757a0 msgr2=0x7f1a240fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 shutdown_connections 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:02:43.292+0000 7f1a29692700 1 -- 172.21.15.35:0/2867785925 wait complete. 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.127+0000 7f8e01310700 1 -- 172.21.15.35:0/2198059164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc101580 msgr2=0x7f8dfc104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.127+0000 7f8e01310700 1 --2- 172.21.15.35:0/2198059164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc101580 0x7f8dfc104e10 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0099c0 tx=0x7f8dec009cd0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 -- 172.21.15.35:0/2198059164 shutdown_connections 2023-03-17T11:26:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 --2- 172.21.15.35:0/2198059164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc10d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 --2- 172.21.15.35:0/2198059164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 0x7f8dfc100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 --2- 172.21.15.35:0/2198059164 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc101580 0x7f8dfc104e10 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 -- 172.21.15.35:0/2198059164 >> 172.21.15.35:0/2198059164 conn(0x7f8dfc077480 msgr2=0x7f8dfc077880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 -- 172.21.15.35:0/2198059164 shutdown_connections 2023-03-17T11:26:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 -- 172.21.15.35:0/2198059164 wait complete. 2023-03-17T11:26:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.128+0000 7f8e01310700 1 Processor -- start 2023-03-17T11:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 -- start start 2023-03-17T11:26:03.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 0x7f8dfc1962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dfc101580 0x7f8dfc196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc19b2c0 con 0x7f8dfc1054f0 2023-03-17T11:26:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc19b430 con 0x7f8dfc101580 2023-03-17T11:26:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8e01310700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc19b5f0 con 0x7f8dfc100be0 2023-03-17T11:26:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8dfb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8dfb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55246/0 (socket says 172.21.15.35:55246) 2023-03-17T11:26:04.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8dfb7fe700 1 -- 172.21.15.35:0/2661786384 learned_addr learned my addr 172.21.15.35:0/2661786384 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:04.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:47 smithi035 ceph-mon[92535]: pgmap v4930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:26:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dfc101580 0x7f8dfc196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.129+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 0x7f8dfc1962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfb7fe700 1 -- 172.21.15.35:0/2661786384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 msgr2=0x7f8dfc1962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 0x7f8dfc1962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfb7fe700 1 -- 172.21.15.35:0/2661786384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dfc101580 msgr2=0x7f8dfc196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dfc101580 0x7f8dfc196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfb7fe700 1 -- 172.21.15.35:0/2661786384 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec0095f0 con 0x7f8dfc1054f0 2023-03-17T11:26:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 0x7f8dfc1962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:26:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc19ac80 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f8df400ef30 tx=0x7f8df400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8df3fff700 1 -- 172.21.15.35:0/2661786384 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4018070 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8df3fff700 1 -- 172.21.15.35:0/2661786384 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8df400f040 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc110160 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8df3fff700 1 -- 172.21.15.35:0/2661786384 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400cc70 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.130+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc10ffd0 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.132+0000 7f8df3fff700 1 -- 172.21.15.35:0/2661786384 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8df4007500 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.133+0000 7f8df3fff700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8de809f640 0x7f8de80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.133+0000 7f8df3fff700 1 -- 172.21.15.35:0/2661786384 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(356..356 src has 1..356) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f8df40ca0e0 con 0x7f8dfc1054f0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.133+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8de809f640 0x7f8de80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.133+0000 7f8e0d49db80 1 Processor -- start 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8de809f640 0x7f8de80a1af0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8de400bc10 tx=0x7f8de400b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 -- start start 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc3d6010 con 0x55d2cc4d54f0 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc428950 con 0x55d2cc4cf960 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc421de0 con 0x55d2cc4d4be0 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:07.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55252/0 (socket says 172.21.15.35:55252) 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/3800033757 learned_addr learned my addr 172.21.15.35:0/3800033757 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/3800033757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 msgr2=0x55d2cc4d4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/3800033757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 msgr2=0x55d2cc4cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/3800033757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2cc2a35d0 con 0x55d2cc4d54f0 2023-03-17T11:26:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.134+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:26:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.135+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4cf420 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc101950 tx=0x7f8dec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75380df79190c77 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.135+0000 7f8df17fa700 1 -- 172.21.15.35:0/3800033757 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00bbb0 con 0x55d2cc4d54f0 2023-03-17T11:26:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.135+0000 7f8df17fa700 1 -- 172.21.15.35:0/3800033757 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dec01e040 con 0x55d2cc4d54f0 2023-03-17T11:26:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.135+0000 7f8df17fa700 1 -- 172.21.15.35:0/3800033757 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec003960 con 0x55d2cc4d54f0 2023-03-17T11:26:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- 172.21.15.35:0/3800033757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 msgr2=0x55d2cc4cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4cf420 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc101950 tx=0x7f8dec00b790 comp rx=0 tx=0).stop 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- 172.21.15.35:0/3800033757 shutdown_connections 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/3800033757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4cf420 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- 172.21.15.35:0/3800033757 >> 172.21.15.35:0/3800033757 conn(0x55d2cc32c6b0 msgr2=0x55d2cc4c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- 172.21.15.35:0/3800033757 shutdown_connections 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- 172.21.15.35:0/3800033757 wait complete. 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- start start 2023-03-17T11:26:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 Processor -- start 2023-03-17T11:26:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4db430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc2a58c0 con 0x55d2cc4cf960 2023-03-17T11:26:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc4d94a0 con 0x55d2cc4d4be0 2023-03-17T11:26:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.136+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc4e4fa0 con 0x55d2cc4d54f0 2023-03-17T11:26:09.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8e0d49db80 10 client.0 _ll_register_callbacks cb 0x55d2cc2c7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:26:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4db430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55256/0 (socket says 172.21.15.35:55256) 2023-03-17T11:26:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 -- 172.21.15.35:0/4243229623 learned_addr learned my addr 172.21.15.35:0/4243229623 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfa7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:09.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 -- 172.21.15.35:0/4243229623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 msgr2=0x55d2cc4d8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 -- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d4be0 msgr2=0x55d2cc4d8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 -- 172.21.15.35:0/4243229623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc10d940 con 0x55d2cc4cf960 2023-03-17T11:26:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:26:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4db430 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f8de400feb0 tx=0x7f8de4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56ddbd24957698 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8de27fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:26:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8de27fc700 1 -- 172.21.15.35:0/4243229623 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400fee0 con 0x55d2cc4cf960 2023-03-17T11:26:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8de27fc700 1 -- 172.21.15.35:0/4243229623 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(356..356 src has 1..356) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f8de401f430 con 0x55d2cc4cf960 2023-03-17T11:26:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.137+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2cc3e4390 con 0x55d2cc4cf960 2023-03-17T11:26:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8de27fc700 1 -- 172.21.15.35:0/4243229623 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de401f5f0 con 0x55d2cc4cf960 2023-03-17T11:26:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 10 client.20745 fetch_fsmap learned FSMap version 108 2023-03-17T11:26:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55d2cc24fd80 con 0x55d2cc4cf960 2023-03-17T11:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8de27fc700 1 -- 172.21.15.35:0/4243229623 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d2cc3e4390 con 0x55d2cc4cf960 2023-03-17T11:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8de27fc700 1 -- 172.21.15.35:0/4243229623 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8de402e070 con 0x55d2cc4cf960 2023-03-17T11:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 10 client.20745 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:26:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 10 client.20745 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:26:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 20 client.20745 populate_metadata read hostname 'smithi035' 2023-03-17T11:26:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc4e90c0 0x55d2cc4eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 4 client.20745 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:26:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2cc3f0600 con 0x55d2cc4e90c0 2023-03-17T11:26:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.138+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc4e90c0 0x55d2cc4eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.139+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc4e90c0 0x55d2cc4eb4d0 crc :-1 s=READY pgs=669 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=878013a6b5163829 server_cookie=8a9eda7fdbbd02bc in_seq=0 out_seq=0 2023-03-17T11:26:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.139+0000 7f8de27fc700 10 client.20745 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8de27fc700 1 -- 172.21.15.35:0/4243229623 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d2cc3f0600 con 0x55d2cc4e90c0 2023-03-17T11:26:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8de27fc700 10 client.20745 handle_command_reply: tid=0 2023-03-17T11:26:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 client.20745 shutdown 2023-03-17T11:26:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 msgr2=0x55d2cc4db430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4db430 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f8de400feb0 tx=0x7f8de4004750 comp rx=0 tx=0).stop 2023-03-17T11:26:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 shutdown_connections 2023-03-17T11:26:14.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc4e90c0 0x55d2cc4eb4d0 crc :-1 s=READY pgs=669 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4db430 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8de27fc700 0 client.20745 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/4243229623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4d8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 >> 172.21.15.35:0/4243229623 conn(0x55d2cc32c6b0 msgr2=0x55d2cc4ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 shutdown_connections 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 1 -- 172.21.15.35:0/4243229623 wait complete. 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.140+0000 7f8e0d49db80 20 client.20745 trim_cache size 0 max 16384 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.155+0000 7f8e0d49db80 1 Processor -- start 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.155+0000 7f8e0d49db80 1 -- start start 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4dafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc4c5330 con 0x55d2cc4d4be0 2023-03-17T11:26:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc3f0630 con 0x55d2cc4cf960 2023-03-17T11:26:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc4cea90 con 0x55d2cc4d54f0 2023-03-17T11:26:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4dafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4dafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55266/0 (socket says 172.21.15.35:55266) 2023-03-17T11:26:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/359936314 learned_addr learned my addr 172.21.15.35:0/359936314 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/359936314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 msgr2=0x55d2cc4d7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/359936314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 msgr2=0x55d2cc4dfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 -- 172.21.15.35:0/359936314 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2cc3e8130 con 0x55d2cc4d4be0 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4dafd0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0056f0 tx=0x7f8dec01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ff99b5c9b15e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.156+0000 7f8df1ffb700 1 -- 172.21.15.35:0/359936314 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec038070 con 0x55d2cc4d4be0 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8df1ffb700 1 -- 172.21.15.35:0/359936314 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dec032070 con 0x55d2cc4d4be0 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8df1ffb700 1 -- 172.21.15.35:0/359936314 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00bb80 con 0x55d2cc4d4be0 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 -- 172.21.15.35:0/359936314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 msgr2=0x55d2cc4dafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4dafd0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0056f0 tx=0x7f8dec01a040 comp rx=0 tx=0).stop 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 -- 172.21.15.35:0/359936314 shutdown_connections 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4d7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/359936314 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4dafd0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 -- 172.21.15.35:0/359936314 >> 172.21.15.35:0/359936314 conn(0x55d2cc32c6b0 msgr2=0x55d2cc4e4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 -- 172.21.15.35:0/359936314 shutdown_connections 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.157+0000 7f8e0d49db80 1 -- 172.21.15.35:0/359936314 wait complete. 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 -- start start 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 Processor -- start 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4de410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4de950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc53c110 con 0x55d2cc4cf960 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc53c280 con 0x55d2cc4d54f0 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2cc53c440 con 0x55d2cc4d4be0 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8e0d49db80 10 client.0 _ll_register_callbacks cb 0x55d2cc2c7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8dfaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55268/0 (socket says 172.21.15.35:55268) 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8dfaffd700 1 -- 172.21.15.35:0/1263932889 learned_addr learned my addr 172.21.15.35:0/1263932889 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.158+0000 7f8dfb7fe700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4de410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfaffd700 1 -- 172.21.15.35:0/1263932889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 msgr2=0x55d2cc4de410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4de410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfaffd700 1 -- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d54f0 msgr2=0x55d2cc4de950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4de950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfaffd700 1 -- 172.21.15.35:0/1263932889 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2cc2a35d0 con 0x55d2cc4cf960 2023-03-17T11:26:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4de410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:26:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8dfaffd700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dded0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005a60 tx=0x7f8de4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb9a76a22aca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8de27fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:26:19.469 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:49 smithi035 ceph-mon[92535]: pgmap v4931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8de27fc700 1 -- 172.21.15.35:0/1263932889 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de403d070 con 0x55d2cc4cf960 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8de27fc700 1 -- 172.21.15.35:0/1263932889 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(356..356 src has 1..356) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f8de4004020 con 0x55d2cc4cf960 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2cc49f1e0 con 0x55d2cc4cf960 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8de27fc700 1 -- 172.21.15.35:0/1263932889 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de40041e0 con 0x55d2cc4cf960 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8e0d49db80 10 client.20751 fetch_fsmap learned FSMap version 108 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55d2cc2761f0 con 0x55d2cc4cf960 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.159+0000 7f8de27fc700 1 -- 172.21.15.35:0/1263932889 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d2cc49f1e0 con 0x55d2cc4cf960 2023-03-17T11:26:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8de27fc700 1 -- 172.21.15.35:0/1263932889 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8de4040020 con 0x55d2cc4cf960 2023-03-17T11:26:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8e0d49db80 10 client.20751 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8e0d49db80 10 client.20751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8e0d49db80 20 client.20751 populate_metadata read hostname 'smithi035' 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc53db80 0x55d2cc53ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8e0d49db80 4 client.20751 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d2cc2a5f00 con 0x55d2cc53db80 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc53db80 0x55d2cc53ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8dfa7fc700 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc53db80 0x55d2cc53ff90 crc :-1 s=READY pgs=670 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae4b8ffe8c899b0a server_cookie=e83621a0d2de9a38 in_seq=0 out_seq=0 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.160+0000 7f8de27fc700 10 client.20751 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8de27fc700 1 -- 172.21.15.35:0/1263932889 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d2cc2a5f00 con 0x55d2cc53db80 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8de27fc700 10 client.20751 handle_command_reply: tid=0 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 client.20751 shutdown 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 msgr2=0x55d2cc4dded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dded0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005a60 tx=0x7f8de4011ab0 comp rx=0 tx=0).stop 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 shutdown_connections 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d2cc53db80 0x55d2cc53ff90 crc :-1 s=READY pgs=670 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2cc4d54f0 0x55d2cc4de950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d2cc4cf960 0x55d2cc4dded0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 --2- 172.21.15.35:0/1263932889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d2cc4d4be0 0x55d2cc4de410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8de27fc700 0 client.20751 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:21.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.177+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 >> 172.21.15.35:0/1263932889 conn(0x55d2cc32c6b0 msgr2=0x55d2cc4d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 shutdown_connections 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e0d49db80 1 -- 172.21.15.35:0/1263932889 wait complete. 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e0d49db80 20 client.20751 trim_cache size 0 max 16384 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8de809f640 msgr2=0x7f8de80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8de809f640 0x7f8de80a1af0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8de400bc10 tx=0x7f8de400b5f0 comp rx=0 tx=0).stop 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 msgr2=0x7f8dfc19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc19ac80 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f8df400ef30 tx=0x7f8df400c3a0 comp rx=0 tx=0).stop 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 shutdown_connections 2023-03-17T11:26:21.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8de809f640 0x7f8de80a1af0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:23.647 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dfc1054f0 0x7f8dfc19ac80 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc100be0 0x7f8dfc1962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:23.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 --2- 172.21.15.35:0/2661786384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dfc101580 0x7f8dfc196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 >> 172.21.15.35:0/2661786384 conn(0x7f8dfc077480 msgr2=0x7f8dfc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 shutdown_connections 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:14.178+0000 7f8e01310700 1 -- 172.21.15.35:0/2661786384 wait complete. 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 -- 172.21.15.35:0/2568376931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec0ff350 msgr2=0x7f5aec0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2568376931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec0ff350 0x7f5aec0ff720 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00099c0 tx=0x7f5ae0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 -- 172.21.15.35:0/2568376931 shutdown_connections 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2568376931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aec104390 0x7f5aec10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2568376931 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec0ff350 0x7f5aec0ff720 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2568376931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aec0ffcf0 0x7f5aec103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:26.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 -- 172.21.15.35:0/2568376931 >> 172.21.15.35:0/2568376931 conn(0x7f5aec076330 msgr2=0x7f5aec076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 -- 172.21.15.35:0/2568376931 shutdown_connections 2023-03-17T11:26:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.300+0000 7f5af1c99700 1 -- 172.21.15.35:0/2568376931 wait complete. 2023-03-17T11:26:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.301+0000 7f5af1c99700 1 Processor -- start 2023-03-17T11:26:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.301+0000 7f5af1c99700 1 -- start start 2023-03-17T11:26:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.301+0000 7f5af1c99700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aec0ff350 0x7f5aec1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5af1c99700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aec0ffcf0 0x7f5aec196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:28.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5af1c99700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 0x7f5aec19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5af1c99700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec19b2b0 con 0x7f5aec104390 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5af1c99700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec19b420 con 0x7f5aec0ff350 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5af1c99700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec19b5e0 con 0x7f5aec0ffcf0 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 0x7f5aec19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 0x7f5aec19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55286/0 (socket says 172.21.15.35:55286) 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 -- 172.21.15.35:0/2480101127 learned_addr learned my addr 172.21.15.35:0/2480101127 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aeb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aec0ff350 0x7f5aec1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aeaffd700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aec0ffcf0 0x7f5aec196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 -- 172.21.15.35:0/2480101127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aec0ffcf0 msgr2=0x7f5aec196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aec0ffcf0 0x7f5aec196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 -- 172.21.15.35:0/2480101127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aec0ff350 msgr2=0x7f5aec1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aec0ff350 0x7f5aec1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 -- 172.21.15.35:0/2480101127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00095f0 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5aebfff700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 0x7f5aec19ac70 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400ef30 tx=0x7f5ae400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5ae8ff9700 1 -- 172.21.15.35:0/2480101127 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4018070 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec10f000 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.302+0000 7f5ae8ff9700 1 -- 172.21.15.35:0/2480101127 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ae400f040 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.303+0000 7f5ae8ff9700 1 -- 172.21.15.35:0/2480101127 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400cbc0 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.303+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec10ee70 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.305+0000 7f5ae8ff9700 1 -- 172.21.15.35:0/2480101127 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5ae4007500 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.306+0000 7f5ae8ff9700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ad409f640 0x7f5ad40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.306+0000 7f5ae8ff9700 1 -- 172.21.15.35:0/2480101127 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5ae40ca0f0 con 0x7f5aec104390 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.306+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ad409f640 0x7f5ad40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ad409f640 0x7f5ad40a1af0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000b580 tx=0x7f5ae0005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 Processor -- start 2023-03-17T11:26:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 -- start start 2023-03-17T11:26:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b719be0 0x561e9b719fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b714420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b714d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b61b010 con 0x561e9b714960 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b66d950 con 0x561e9b719be0 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5afde26b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b666de0 con 0x561e9b71a4f0 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b714d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b714d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55294/0 (socket says 172.21.15.35:55294) 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5aebfff700 1 -- 172.21.15.35:0/3271236652 learned_addr learned my addr 172.21.15.35:0/3271236652 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.307+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b719be0 0x561e9b719fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aeaffd700 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b714420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aebfff700 1 -- 172.21.15.35:0/3271236652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 msgr2=0x561e9b714420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aebfff700 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b714420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aebfff700 1 -- 172.21.15.35:0/3271236652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b719be0 msgr2=0x561e9b719fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aebfff700 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b719be0 0x561e9b719fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aebfff700 1 -- 172.21.15.35:0/3271236652 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e9b4e85d0 con 0x561e9b714960 2023-03-17T11:26:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5aebfff700 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b714d90 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40090a0 tx=0x7f5ae4097710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c33f5dcbe02eb4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5ad1ffb700 1 -- 172.21.15.35:0/3271236652 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4097bd0 con 0x561e9b714960 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5ad1ffb700 1 -- 172.21.15.35:0/3271236652 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ae409fd30 con 0x561e9b714960 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.308+0000 7f5ad1ffb700 1 -- 172.21.15.35:0/3271236652 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40970c0 con 0x561e9b714960 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 -- 172.21.15.35:0/3271236652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 msgr2=0x561e9b714d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b714d90 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40090a0 tx=0x7f5ae4097710 comp rx=0 tx=0).stop 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 -- 172.21.15.35:0/3271236652 shutdown_connections 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b714d90 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b719be0 0x561e9b719fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3271236652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b714420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 -- 172.21.15.35:0/3271236652 >> 172.21.15.35:0/3271236652 conn(0x561e9b5716b0 msgr2=0x561e9b70ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 -- 172.21.15.35:0/3271236652 shutdown_connections 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 -- 172.21.15.35:0/3271236652 wait complete. 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 -- start start 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.309+0000 7f5afde26b80 1 Processor -- start 2023-03-17T11:26:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b720490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b71d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 0x561e9b71ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b4ea8c0 con 0x561e9b71a4f0 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b71e520 con 0x561e9b714960 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b729fa0 con 0x561e9b719be0 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 10 client.0 _ll_register_callbacks cb 0x561e9b50c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 0x561e9b71ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 0x561e9b71ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55300/0 (socket says 172.21.15.35:55300) 2023-03-17T11:26:39.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 -- 172.21.15.35:0/2933074424 learned_addr learned my addr 172.21.15.35:0/2933074424 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:39.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b720490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:39.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aeaffd700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b71d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 -- 172.21.15.35:0/2933074424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 msgr2=0x561e9b71d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b71d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 -- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 msgr2=0x561e9b720490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b720490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 -- 172.21.15.35:0/2933074424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec10ee70 con 0x561e9b71a4f0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5aebfff700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 0x561e9b71ddb0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40978d0 tx=0x7f5ae4094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbb3365376c9db3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5acaffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5acaffd700 1 -- 172.21.15.35:0/2933074424 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4097bd0 con 0x561e9b71a4f0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5acaffd700 1 -- 172.21.15.35:0/2933074424 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5ae4098040 con 0x561e9b71a4f0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.310+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e9b629390 con 0x561e9b71a4f0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5acaffd700 1 -- 172.21.15.35:0/2933074424 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ae409f8a0 con 0x561e9b71a4f0 2023-03-17T11:26:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 10 client.20763 fetch_fsmap learned FSMap version 108 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x561e9b494d80 con 0x561e9b71a4f0 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5acaffd700 1 -- 172.21.15.35:0/2933074424 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e9b629390 con 0x561e9b71a4f0 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5acaffd700 1 -- 172.21.15.35:0/2933074424 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5ae40c6c80 con 0x561e9b71a4f0 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 10 client.20763 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 10 client.20763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 20 client.20763 populate_metadata read hostname 'smithi035' 2023-03-17T11:26:45.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b72dd00 0x561e9b730110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 4 client.20763 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:26:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e9b635600 con 0x561e9b72dd00 2023-03-17T11:26:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.311+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b72dd00 0x561e9b730110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.312+0000 7f5acaffd700 10 client.20763 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.312+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b72dd00 0x561e9b730110 crc :-1 s=READY pgs=671 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dce5b1b16467d36 server_cookie=cb8116de6207d90d in_seq=0 out_seq=0 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.312+0000 7f5acaffd700 1 -- 172.21.15.35:0/2933074424 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561e9b635600 con 0x561e9b72dd00 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.312+0000 7f5acaffd700 10 client.20763 handle_command_reply: tid=0 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.312+0000 7f5afde26b80 1 client.20763 shutdown 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 msgr2=0x561e9b71ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 0x561e9b71ddb0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40978d0 tx=0x7f5ae4094040 comp rx=0 tx=0).stop 2023-03-17T11:26:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 shutdown_connections 2023-03-17T11:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b72dd00 0x561e9b730110 crc :-1 s=READY pgs=671 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b71a4f0 0x561e9b71ddb0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b720490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5acaffd700 0 client.20763 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 --2- 172.21.15.35:0/2933074424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b71d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 >> 172.21.15.35:0/2933074424 conn(0x561e9b5716b0 msgr2=0x561e9b713410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:26:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:26:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:26:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:26:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 shutdown_connections 2023-03-17T11:26:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 1 -- 172.21.15.35:0/2933074424 wait complete. 2023-03-17T11:26:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.313+0000 7f5afde26b80 20 client.20763 trim_cache size 0 max 16384 2023-03-17T11:26:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 Processor -- start 2023-03-17T11:26:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 -- start start 2023-03-17T11:26:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b717dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b724ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b71a4f0 0x561e9b720030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:50.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b70fb70 con 0x561e9b714960 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b71e170 con 0x561e9b71a4f0 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5afde26b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b720a70 con 0x561e9b719be0 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b717dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b717dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55304/0 (socket says 172.21.15.35:55304) 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 -- 172.21.15.35:0/3987604306 learned_addr learned my addr 172.21.15.35:0/3987604306 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 -- 172.21.15.35:0/3987604306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 msgr2=0x561e9b724ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b724ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 -- 172.21.15.35:0/3987604306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b71a4f0 msgr2=0x561e9b720030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b71a4f0 0x561e9b720030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 -- 172.21.15.35:0/3987604306 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e9b715020 con 0x561e9b714960 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.328+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b717dc0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00099c0 tx=0x7f5ae001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62852f3ca1ad4a4a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5ad27fc700 1 -- 172.21.15.35:0/3987604306 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0028040 con 0x561e9b714960 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5ad27fc700 1 -- 172.21.15.35:0/3987604306 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ae0029040 con 0x561e9b714960 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5ad27fc700 1 -- 172.21.15.35:0/3987604306 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0003bc0 con 0x561e9b714960 2023-03-17T11:26:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 -- 172.21.15.35:0/3987604306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 msgr2=0x561e9b717dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:26:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b717dc0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00099c0 tx=0x7f5ae001f000 comp rx=0 tx=0).stop 2023-03-17T11:26:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 -- 172.21.15.35:0/3987604306 shutdown_connections 2023-03-17T11:26:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b71a4f0 0x561e9b720030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b714960 0x561e9b717dc0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 --2- 172.21.15.35:0/3987604306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b719be0 0x561e9b724ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 -- 172.21.15.35:0/3987604306 >> 172.21.15.35:0/3987604306 conn(0x561e9b5716b0 msgr2=0x561e9b7176b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 -- 172.21.15.35:0/3987604306 shutdown_connections 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.329+0000 7f5afde26b80 1 -- 172.21.15.35:0/3987604306 wait complete. 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 -- start start 2023-03-17T11:26:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 Processor -- start 2023-03-17T11:26:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b77f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 0x561e9b77fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:56.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b779f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:26:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b77a510 con 0x561e9b719be0 2023-03-17T11:26:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b77a680 con 0x561e9b714960 2023-03-17T11:26:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b77a840 con 0x561e9b71a4f0 2023-03-17T11:26:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5afde26b80 10 client.0 _ll_register_callbacks cb 0x561e9b50c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:26:57.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 0x561e9b77fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:26:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 0x561e9b77fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55312/0 (socket says 172.21.15.35:55312) 2023-03-17T11:26:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 -- 172.21.15.35:0/4102168849 learned_addr learned my addr 172.21.15.35:0/4102168849 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:26:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b77f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 -- 172.21.15.35:0/4102168849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 msgr2=0x561e9b779f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b779f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 -- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 msgr2=0x561e9b77f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b77f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.330+0000 7f5aeaffd700 1 -- 172.21.15.35:0/4102168849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec10c7a0 con 0x561e9b719be0 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5aeaffd700 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 0x561e9b77fca0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f5aec1978e0 tx=0x7f5adc010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6ddd8c86234aad server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5acaffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5acaffd700 1 -- 172.21.15.35:0/4102168849 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc004a30 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5acaffd700 1 -- 172.21.15.35:0/4102168849 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5adc004b90 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e9b6e41e0 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5acaffd700 1 -- 172.21.15.35:0/4102168849 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5adc004d50 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 10 client.20769 fetch_fsmap learned FSMap version 108 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x561e9b47dc00 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5acaffd700 1 -- 172.21.15.35:0/4102168849 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e9b6e41e0 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5acaffd700 1 -- 172.21.15.35:0/4102168849 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5adc00f900 con 0x561e9b719be0 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 10 client.20769 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 10 client.20769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 20 client.20769 populate_metadata read hostname 'smithi035' 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b787720 0x561e9b789b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 4 client.20769 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:27:00.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.331+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e9b4eaf00 con 0x561e9b787720 2023-03-17T11:27:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.332+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b787720 0x561e9b789b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.332+0000 7f5acaffd700 10 client.20769 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:27:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.332+0000 7f5aeb7fe700 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b787720 0x561e9b789b30 crc :-1 s=READY pgs=672 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0add310857ba16 server_cookie=2329760061625a8 in_seq=0 out_seq=0 2023-03-17T11:27:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5acaffd700 1 -- 172.21.15.35:0/4102168849 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e9b4eaf00 con 0x561e9b787720 2023-03-17T11:27:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5acaffd700 10 client.20769 handle_command_reply: tid=0 2023-03-17T11:27:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 client.20769 shutdown 2023-03-17T11:27:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 msgr2=0x561e9b77fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 0x561e9b77fca0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f5aec1978e0 tx=0x7f5adc010a00 comp rx=0 tx=0).stop 2023-03-17T11:27:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 shutdown_connections 2023-03-17T11:27:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561e9b787720 0x561e9b789b30 crc :-1 s=READY pgs=672 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561e9b71a4f0 0x561e9b779f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561e9b714960 0x561e9b77f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 --2- 172.21.15.35:0/4102168849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561e9b719be0 0x561e9b77fca0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5acaffd700 0 client.20769 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:27:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 >> 172.21.15.35:0/4102168849 conn(0x561e9b5716b0 msgr2=0x561e9b718830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 shutdown_connections 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.341+0000 7f5afde26b80 1 -- 172.21.15.35:0/4102168849 wait complete. 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5afde26b80 20 client.20769 trim_cache size 0 max 16384 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ad409f640 msgr2=0x7f5ad40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ad409f640 0x7f5ad40a1af0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000b580 tx=0x7f5ae0005c00 comp rx=0 tx=0).stop 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 msgr2=0x7f5aec19ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 0x7f5aec19ac70 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400ef30 tx=0x7f5ae400c3a0 comp rx=0 tx=0).stop 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 shutdown_connections 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5ad409f640 0x7f5ad40a1af0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5aec104390 0x7f5aec19ac70 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5aec0ff350 0x7f5aec1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 --2- 172.21.15.35:0/2480101127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5aec0ffcf0 0x7f5aec196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 >> 172.21.15.35:0/2480101127 conn(0x7f5aec076330 msgr2=0x7f5aec102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 shutdown_connections 2023-03-17T11:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:27.342+0000 7f5af1c99700 1 -- 172.21.15.35:0/2480101127 wait complete. 2023-03-17T11:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 -- 172.21.15.35:0/2882650824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd980ff3b0 msgr2=0x7fcd980ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2882650824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd980ff3b0 0x7fcd980ff780 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcd940099c0 tx=0x7fcd94009cd0 comp rx=0 tx=0).stop 2023-03-17T11:27:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 -- 172.21.15.35:0/2882650824 shutdown_connections 2023-03-17T11:27:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2882650824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd981043f0 0x7fcd9810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2882650824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd980ff3b0 0x7fcd980ff780 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2882650824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd980ffd50 0x7fcd98103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 -- 172.21.15.35:0/2882650824 >> 172.21.15.35:0/2882650824 conn(0x7fcd98075f60 msgr2=0x7fcd98076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 -- 172.21.15.35:0/2882650824 shutdown_connections 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.466+0000 7fcda05fa700 1 -- 172.21.15.35:0/2882650824 wait complete. 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 Processor -- start 2023-03-17T11:27:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 -- start start 2023-03-17T11:27:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd980ff3b0 0x7fcd98196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd980ffd50 0x7fcd98196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 0x7fcd9819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9819b2f0 con 0x7fcd981043f0 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9819b460 con 0x7fcd980ffd50 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcda05fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9819b620 con 0x7fcd980ff3b0 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 0x7fcd9819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 0x7fcd9819acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55328/0 (socket says 172.21.15.35:55328) 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 -- 172.21.15.35:0/2909970841 learned_addr learned my addr 172.21.15.35:0/2909970841 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9e396700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd980ff3b0 0x7fcd98196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9db95700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd980ffd50 0x7fcd98196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 -- 172.21.15.35:0/2909970841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd980ff3b0 msgr2=0x7fcd98196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd980ff3b0 0x7fcd98196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 -- 172.21.15.35:0/2909970841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd980ffd50 msgr2=0x7fcd98196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd980ffd50 0x7fcd98196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.467+0000 7fcd9eb97700 1 -- 172.21.15.35:0/2909970841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940095f0 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.468+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 0x7fcd9819acb0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fcd90007ee0 tx=0x7fcd9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.468+0000 7fcd8f7fe700 1 -- 172.21.15.35:0/2909970841 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000dd20 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.468+0000 7fcd8f7fe700 1 -- 172.21.15.35:0/2909970841 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd9000f040 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.468+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9810f060 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.468+0000 7fcd8f7fe700 1 -- 172.21.15.35:0/2909970841 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90004750 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.468+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9810eed0 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.470+0000 7fcd8f7fe700 1 -- 172.21.15.35:0/2909970841 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcd90003a00 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.470+0000 7fcd8f7fe700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd8409f640 0x7fcd840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.471+0000 7fcd8f7fe700 1 -- 172.21.15.35:0/2909970841 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd900c9e90 con 0x7fcd981043f0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.471+0000 7fcd9e396700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd8409f640 0x7fcd840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.471+0000 7fcd9e396700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd8409f640 0x7fcd840a1af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b580 tx=0x7fcd94005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:13.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 Processor -- start 2023-03-17T11:27:13.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 -- start start 2023-03-17T11:27:13.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cb9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:13.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cba4f0 0x557df4cb4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:13.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cb4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:13.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4bbb010 con 0x557df4cb9be0 2023-03-17T11:27:13.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4c0d950 con 0x557df4cba4f0 2023-03-17T11:27:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcdac787b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4c06de0 con 0x557df4cb4960 2023-03-17T11:27:15.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcd9e396700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cb9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:15.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcd9e396700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cb9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55332/0 (socket says 172.21.15.35:55332) 2023-03-17T11:27:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcd9e396700 1 -- 172.21.15.35:0/3727190544 learned_addr learned my addr 172.21.15.35:0/3727190544 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:15.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.472+0000 7fcd9db95700 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cba4f0 0x557df4cb4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:15.688 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cb4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9e396700 1 -- 172.21.15.35:0/3727190544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 msgr2=0x557df4cb4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9e396700 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cb4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9e396700 1 -- 172.21.15.35:0/3727190544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cba4f0 msgr2=0x557df4cb4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9e396700 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cba4f0 0x557df4cb4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9e396700 1 -- 172.21.15.35:0/3727190544 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557df4a885d0 con 0x557df4cb9be0 2023-03-17T11:27:16.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9db95700 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cba4f0 0x557df4cb4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:27:16.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd9e396700 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cb9fb0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fcd94015000 tx=0x7fcd9401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8cb62a15e631d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd8cff9700 1 -- 172.21.15.35:0/3727190544 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94028070 con 0x557df4cb9be0 2023-03-17T11:27:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd8cff9700 1 -- 172.21.15.35:0/3727190544 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd9401e040 con 0x557df4cb9be0 2023-03-17T11:27:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.473+0000 7fcd8cff9700 1 -- 172.21.15.35:0/3727190544 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400f6c0 con 0x557df4cb9be0 2023-03-17T11:27:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 -- 172.21.15.35:0/3727190544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 msgr2=0x557df4cb9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cb9fb0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fcd94015000 tx=0x7fcd9401f000 comp rx=0 tx=0).stop 2023-03-17T11:27:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 -- 172.21.15.35:0/3727190544 shutdown_connections 2023-03-17T11:27:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cb4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:17.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cb9fb0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:17.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:51 smithi035 ceph-mon[92535]: pgmap v4932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:27:18.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:53 smithi035 ceph-mon[92535]: pgmap v4933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:27:18.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:55 smithi035 ceph-mon[92535]: pgmap v4934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T11:27:18.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:57 smithi035 ceph-mon[92535]: pgmap v4935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:27:18.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:15:59 smithi035 ceph-mon[92535]: pgmap v4936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:27:18.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:01 smithi035 ceph-mon[92535]: pgmap v4937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:27:18.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:03 smithi035 ceph-mon[92535]: pgmap v4938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-03-17T11:27:18.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:05 smithi035 ceph-mon[92535]: pgmap v4939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:27:18.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:07 smithi035 ceph-mon[92535]: pgmap v4940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:27:18.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:09 smithi035 ceph-mon[92535]: pgmap v4941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:27:18.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:09 smithi035 ceph-mon[92535]: osdmap e378: 12 total, 12 up, 12 in 2023-03-17T11:27:19.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:11 smithi035 ceph-mon[92535]: pgmap v4943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:27:19.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:13 smithi035 ceph-mon[92535]: pgmap v4944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-17T11:27:19.092 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:15 smithi035 ceph-mon[92535]: pgmap v4945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:27:19.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:17 smithi035 ceph-mon[92535]: pgmap v4946: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:27:19.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:17 smithi035 ceph-mon[92535]: osdmap e379: 12 total, 12 up, 12 in 2023-03-17T11:27:19.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:27:19.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:19 smithi035 ceph-mon[92535]: pgmap v4948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T11:27:19.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:27:19.269 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:27:19.270 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:19 smithi035 ceph-mon[92535]: pgmap v4949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T11:27:20.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:19 smithi035 ceph-mon[92535]: pgmap v4950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 150 B/s wr, 9 op/s 2023-03-17T11:27:20.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:27:20.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:21 smithi035 ceph-mon[92535]: pgmap v4951: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T11:27:20.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:23 smithi035 ceph-mon[92535]: pgmap v4952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T11:27:20.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:25 smithi035 ceph-mon[92535]: pgmap v4953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T11:27:20.173 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:27 smithi035 ceph-mon[92535]: pgmap v4954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:27:20.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:29 smithi035 ceph-mon[92535]: pgmap v4955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:27:20.813 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:31 smithi035 ceph-mon[92535]: pgmap v4956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:21.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:33 smithi035 ceph-mon[92535]: pgmap v4957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:27:21.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:35 smithi035 ceph-mon[92535]: pgmap v4958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:21.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:37 smithi035 ceph-mon[92535]: pgmap v4959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:21.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:39 smithi035 ceph-mon[92535]: pgmap v4960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:27:22.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:41 smithi035 ceph-mon[92535]: pgmap v4961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:22.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:43 smithi035 ceph-mon[92535]: pgmap v4962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:27:22.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:45 smithi035 ceph-mon[92535]: pgmap v4963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:22.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:47 smithi035 ceph-mon[92535]: pgmap v4964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:22.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:49 smithi035 ceph-mon[92535]: pgmap v4965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:27:23.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:51 smithi035 ceph-mon[92535]: pgmap v4966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:23.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:53 smithi035 ceph-mon[92535]: pgmap v4967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:27:23.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:55 smithi035 ceph-mon[92535]: pgmap v4968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:23.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:57 smithi035 ceph-mon[92535]: pgmap v4969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:27:23.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:16:59 smithi035 ceph-mon[92535]: pgmap v4970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:27:23.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:01 smithi035 ceph-mon[92535]: pgmap v4971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:03 smithi035 ceph-mon[92535]: pgmap v4972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:05 smithi035 ceph-mon[92535]: pgmap v4973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:07 smithi035 ceph-mon[92535]: pgmap v4974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:09 smithi035 ceph-mon[92535]: pgmap v4975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:09 smithi035 ceph-mon[92535]: osdmap e380: 12 total, 12 up, 12 in 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:11 smithi035 ceph-mon[92535]: pgmap v4977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:13 smithi035 ceph-mon[92535]: pgmap v4978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:15 smithi035 ceph-mon[92535]: pgmap v4979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:17 smithi035 ceph-mon[92535]: pgmap v4980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:27:24.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:17 smithi035 ceph-mon[92535]: osdmap e381: 12 total, 12 up, 12 in 2023-03-17T11:27:24.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:19 smithi035 ceph-mon[92535]: pgmap v4982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T11:27:24.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:27:24.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:27:24.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:27:24.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:27:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:27:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:27:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:27:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:27:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 --2- 172.21.15.35:0/3727190544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cba4f0 0x557df4cb4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 -- 172.21.15.35:0/3727190544 >> 172.21.15.35:0/3727190544 conn(0x557df4b116b0 msgr2=0x557df4caea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 -- 172.21.15.35:0/3727190544 shutdown_connections 2023-03-17T11:27:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 -- 172.21.15.35:0/3727190544 wait complete. 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 -- start start 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.474+0000 7fcdac787b80 1 Processor -- start 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cc0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cbd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 0x557df4cbde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4a8a8c0 con 0x557df4cba4f0 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4cbe560 con 0x557df4cb9be0 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4cc9fa0 con 0x557df4cb4960 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcdac787b80 10 client.0 _ll_register_callbacks cb 0x557df4aac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 0x557df4cbde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 0x557df4cbde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55342/0 (socket says 172.21.15.35:55342) 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 -- 172.21.15.35:0/1175363631 learned_addr learned my addr 172.21.15.35:0/1175363631 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9e396700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cc0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9db95700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cbd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 -- 172.21.15.35:0/1175363631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 msgr2=0x557df4cc0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cc0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 -- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 msgr2=0x557df4cbd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cbd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 -- 172.21.15.35:0/1175363631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9810c800 con 0x557df4cba4f0 2023-03-17T11:27:26.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 0x557df4cbde20 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c7c20 tx=0x7fcd90003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc40221fbc16ca8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:26.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.475+0000 7fcd81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:27:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcd81ffb700 1 -- 172.21.15.35:0/1175363631 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900c5070 con 0x557df4cba4f0 2023-03-17T11:27:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557df4bc9390 con 0x557df4cba4f0 2023-03-17T11:27:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcd81ffb700 1 -- 172.21.15.35:0/1175363631 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd90009410 con 0x557df4cba4f0 2023-03-17T11:27:29.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcd81ffb700 1 -- 172.21.15.35:0/1175363631 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd90097940 con 0x557df4cba4f0 2023-03-17T11:27:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 10 client.20781 fetch_fsmap learned FSMap version 108 2023-03-17T11:27:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557df4a34d80 con 0x557df4cba4f0 2023-03-17T11:27:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcd81ffb700 1 -- 172.21.15.35:0/1175363631 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557df4bc9390 con 0x557df4cba4f0 2023-03-17T11:27:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcd81ffb700 1 -- 172.21.15.35:0/1175363631 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd90096e30 con 0x557df4cba4f0 2023-03-17T11:27:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 10 client.20781 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 10 client.20781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 20 client.20781 populate_metadata read hostname 'smithi035' 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4cce0a0 0x557df4cd04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 4 client.20781 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557df4bd5600 con 0x557df4cce0a0 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.476+0000 7fcd9e396700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4cce0a0 0x557df4cd04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.477+0000 7fcd9e396700 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4cce0a0 0x557df4cd04b0 crc :-1 s=READY pgs=673 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd433e075e6b6e5 server_cookie=823bbf9cb854c9de in_seq=0 out_seq=0 2023-03-17T11:27:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.477+0000 7fcd81ffb700 10 client.20781 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.477+0000 7fcd81ffb700 1 -- 172.21.15.35:0/1175363631 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557df4bd5600 con 0x557df4cce0a0 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.477+0000 7fcd81ffb700 10 client.20781 handle_command_reply: tid=0 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.477+0000 7fcdac787b80 1 client.20781 shutdown 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 msgr2=0x557df4cbde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 0x557df4cbde20 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c7c20 tx=0x7fcd90003d30 comp rx=0 tx=0).stop 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 shutdown_connections 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4cce0a0 0x557df4cd04b0 crc :-1 s=READY pgs=673 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cba4f0 0x557df4cbde20 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cb4960 0x557df4cc0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1175363631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cbd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcd81ffb700 0 client.20781 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 >> 172.21.15.35:0/1175363631 conn(0x557df4b116b0 msgr2=0x557df4cb3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 shutdown_connections 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 1 -- 172.21.15.35:0/1175363631 wait complete. 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.478+0000 7fcdac787b80 20 client.20781 trim_cache size 0 max 16384 2023-03-17T11:27:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 Processor -- start 2023-03-17T11:27:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 -- start start 2023-03-17T11:27:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 0x557df4caeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cc4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4cc0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4cbe6a0 con 0x557df4cb4960 2023-03-17T11:27:33.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4cb47d0 con 0x557df4cb9be0 2023-03-17T11:27:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcdac787b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4cbe1d0 con 0x557df4cba4f0 2023-03-17T11:27:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 0x557df4caeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 0x557df4caeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55346/0 (socket says 172.21.15.35:55346) 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 -- 172.21.15.35:0/1115842463 learned_addr learned my addr 172.21.15.35:0/1115842463 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9db95700 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cc4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4cc0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 -- 172.21.15.35:0/1115842463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 msgr2=0x557df4cc0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4cc0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 -- 172.21.15.35:0/1115842463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 msgr2=0x557df4cc4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cc4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.493+0000 7fcd9e396700 1 -- 172.21.15.35:0/1115842463 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557df4bcd130 con 0x557df4cb4960 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcd9e396700 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 0x557df4caeac0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fcd94000c00 tx=0x7fcd94003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f26ad242bf00c7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcd8d7fa700 1 -- 172.21.15.35:0/1115842463 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94028040 con 0x557df4cb4960 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcd8d7fa700 1 -- 172.21.15.35:0/1115842463 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd9401e040 con 0x557df4cb4960 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcd8d7fa700 1 -- 172.21.15.35:0/1115842463 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94036c10 con 0x557df4cb4960 2023-03-17T11:27:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 -- 172.21.15.35:0/1115842463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 msgr2=0x557df4caeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 0x557df4caeac0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fcd94000c00 tx=0x7fcd94003d70 comp rx=0 tx=0).stop 2023-03-17T11:27:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 -- 172.21.15.35:0/1115842463 shutdown_connections 2023-03-17T11:27:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4cc0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb4960 0x557df4caeac0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 --2- 172.21.15.35:0/1115842463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb9be0 0x557df4cc4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 -- 172.21.15.35:0/1115842463 >> 172.21.15.35:0/1115842463 conn(0x557df4b116b0 msgr2=0x557df4cb3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 -- 172.21.15.35:0/1115842463 shutdown_connections 2023-03-17T11:27:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.494+0000 7fcdac787b80 1 -- 172.21.15.35:0/1115842463 wait complete. 2023-03-17T11:27:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 -- start start 2023-03-17T11:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 Processor -- start 2023-03-17T11:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb4960 0x557df4cc30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cc3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4d20f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:37.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4cc3d50 con 0x557df4cb9be0 2023-03-17T11:27:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4d21480 con 0x557df4cb4960 2023-03-17T11:27:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df4d215c0 con 0x557df4cba4f0 2023-03-17T11:27:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcdac787b80 10 client.0 _ll_register_callbacks cb 0x557df4aac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:27:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cc3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cc3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55354/0 (socket says 172.21.15.35:55354) 2023-03-17T11:27:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 -- 172.21.15.35:0/2302163198 learned_addr learned my addr 172.21.15.35:0/2302163198 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9eb97700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4d20f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9e396700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb4960 0x557df4cc30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 -- 172.21.15.35:0/2302163198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 msgr2=0x557df4d20f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4d20f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 -- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb4960 msgr2=0x557df4cc30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb4960 0x557df4cc30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.495+0000 7fcd9db95700 1 -- 172.21.15.35:0/2302163198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557df4a885d0 con 0x557df4cb9be0 2023-03-17T11:27:43.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd9db95700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cc3600 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fcd98100120 tx=0x7fcd88012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93db3387e8e729f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:27:43.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd81ffb700 1 -- 172.21.15.35:0/2302163198 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88017040 con 0x557df4cb9be0 2023-03-17T11:27:44.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd81ffb700 1 -- 172.21.15.35:0/2302163198 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd88004a30 con 0x557df4cb9be0 2023-03-17T11:27:44.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557df4c841e0 con 0x557df4cb9be0 2023-03-17T11:27:44.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd81ffb700 1 -- 172.21.15.35:0/2302163198 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd88004bf0 con 0x557df4cb9be0 2023-03-17T11:27:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 10 client.20787 fetch_fsmap learned FSMap version 108 2023-03-17T11:27:46.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557df4a5b1f0 con 0x557df4cb9be0 2023-03-17T11:27:46.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd81ffb700 1 -- 172.21.15.35:0/2302163198 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd8802b020 con 0x557df4cb9be0 2023-03-17T11:27:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcd81ffb700 1 -- 172.21.15.35:0/2302163198 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd88025070 con 0x557df4cb9be0 2023-03-17T11:27:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 10 client.20787 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:27:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 10 client.20787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:27:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 20 client.20787 populate_metadata read hostname 'smithi035' 2023-03-17T11:27:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4d22e30 0x557df4d25240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 4 client.20787 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:27:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.496+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557df4a8af00 con 0x557df4d22e30 2023-03-17T11:27:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.497+0000 7fcd9e396700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4d22e30 0x557df4d25240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.497+0000 7fcd9e396700 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4d22e30 0x557df4d25240 crc :-1 s=READY pgs=674 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7cfa09e2138f72d server_cookie=a72c9f9ca895f168 in_seq=0 out_seq=0 2023-03-17T11:27:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.497+0000 7fcd81ffb700 10 client.20787 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:27:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcd81ffb700 1 -- 172.21.15.35:0/2302163198 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557df4a8af00 con 0x557df4d22e30 2023-03-17T11:27:47.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcd81ffb700 10 client.20787 handle_command_reply: tid=0 2023-03-17T11:27:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 client.20787 shutdown 2023-03-17T11:27:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 msgr2=0x557df4cc3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cc3600 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fcd98100120 tx=0x7fcd88012c90 comp rx=0 tx=0).stop 2023-03-17T11:27:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 shutdown_connections 2023-03-17T11:27:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557df4d22e30 0x557df4d25240 crc :-1 s=READY pgs=674 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557df4cba4f0 0x557df4d20f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557df4cb4960 0x557df4cc30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 --2- 172.21.15.35:0/2302163198 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557df4cb9be0 0x557df4cc3600 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 >> 172.21.15.35:0/2302163198 conn(0x557df4b116b0 msgr2=0x557df4cbcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcd81ffb700 0 client.20787 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 shutdown_connections 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.506+0000 7fcdac787b80 1 -- 172.21.15.35:0/2302163198 wait complete. 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcdac787b80 20 client.20787 trim_cache size 0 max 16384 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd8409f640 msgr2=0x7fcd840a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd8409f640 0x7fcd840a1af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b580 tx=0x7fcd94005c00 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 msgr2=0x7fcd9819acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 0x7fcd9819acb0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fcd90007ee0 tx=0x7fcd9000d3b0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 shutdown_connections 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd8409f640 0x7fcd840a1af0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd981043f0 0x7fcd9819acb0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd980ff3b0 0x7fcd98196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 --2- 172.21.15.35:0/2909970841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd980ffd50 0x7fcd98196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 >> 172.21.15.35:0/2909970841 conn(0x7fcd98075f60 msgr2=0x7fcd98068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 shutdown_connections 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:40.507+0000 7fcda05fa700 1 -- 172.21.15.35:0/2909970841 wait complete. 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 -- 172.21.15.35:0/2381996757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc0ff310 msgr2=0x7f50dc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 --2- 172.21.15.35:0/2381996757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc0ff310 0x7f50dc104de0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0099c0 tx=0x7f50cc009cd0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 -- 172.21.15.35:0/2381996757 shutdown_connections 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 --2- 172.21.15.35:0/2381996757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50dc105510 0x7f50dc10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 --2- 172.21.15.35:0/2381996757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc0fe970 0x7f50dc0fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 --2- 172.21.15.35:0/2381996757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc0ff310 0x7f50dc104de0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 -- 172.21.15.35:0/2381996757 >> 172.21.15.35:0/2381996757 conn(0x7f50dc0757a0 msgr2=0x7f50dc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:27:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 -- 172.21.15.35:0/2381996757 shutdown_connections 2023-03-17T11:27:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.629+0000 7f50e3d90700 1 -- 172.21.15.35:0/2381996757 wait complete. 2023-03-17T11:27:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 Processor -- start 2023-03-17T11:27:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 -- start start 2023-03-17T11:27:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50dc0fe970 0x7f50dc196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc0ff310 0x7f50dc1967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 0x7f50dc19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc19b240 con 0x7f50dc105510 2023-03-17T11:27:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc19b3b0 con 0x7f50dc0fe970 2023-03-17T11:27:52.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:20 smithi035 ceph-mon[92535]: pgmap v4983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T11:27:55.094 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:20 smithi035 ceph-mon[92535]: pgmap v4984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e3d90700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc19b570 con 0x7f50dc0ff310 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.630+0000 7f50e232d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 0x7f50dc19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 0x7f50dc19ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55370/0 (socket says 172.21.15.35:55370) 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 -- 172.21.15.35:0/4189362894 learned_addr learned my addr 172.21.15.35:0/4189362894 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50dc0fe970 0x7f50dc196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e132b700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc0ff310 0x7f50dc1967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 -- 172.21.15.35:0/4189362894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc0ff310 msgr2=0x7f50dc1967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc0ff310 0x7f50dc1967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 -- 172.21.15.35:0/4189362894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50dc0fe970 msgr2=0x7f50dc196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:55.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50dc0fe970 0x7f50dc196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 -- 172.21.15.35:0/4189362894 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0095f0 con 0x7f50dc105510 2023-03-17T11:27:55.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e232d700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 0x7f50dc19ac00 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f50d4007ee0 tx=0x7f50d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50d2ffd700 1 -- 172.21.15.35:0/4189362894 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4017070 con 0x7f50dc105510 2023-03-17T11:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50d2ffd700 1 -- 172.21.15.35:0/4189362894 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50d400f040 con 0x7f50dc105510 2023-03-17T11:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc1100f0 con 0x7f50dc105510 2023-03-17T11:27:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50d2ffd700 1 -- 172.21.15.35:0/4189362894 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4005570 con 0x7f50dc105510 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.631+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc10ff60 con 0x7f50dc105510 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.633+0000 7f50d2ffd700 1 -- 172.21.15.35:0/4189362894 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f50d400db20 con 0x7f50dc105510 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.634+0000 7f50d2ffd700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50c809f640 0x7f50c80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.635+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50c809f640 0x7f50c80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.635+0000 7f50d2ffd700 1 -- 172.21.15.35:0/4189362894 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50d40c9cf0 con 0x7f50dc105510 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.635+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50c809f640 0x7f50c80a1af0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009c60 tx=0x7f50d8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.635+0000 7f50eff1db80 1 Processor -- start 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 -- start start 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c340be0 0x55a93c340fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c33bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c242010 con 0x55a93c33b960 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c294950 con 0x55a93c340be0 2023-03-17T11:27:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50eff1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c28dde0 con 0x55a93c3414f0 2023-03-17T11:27:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c33bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c33bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55378/0 (socket says 172.21.15.35:55378) 2023-03-17T11:27:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 -- 172.21.15.35:0/2105809475 learned_addr learned my addr 172.21.15.35:0/2105809475 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:27:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e1b2c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c340be0 0x55a93c340fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e132b700 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:27:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 -- 172.21.15.35:0/2105809475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 msgr2=0x55a93c33b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 -- 172.21.15.35:0/2105809475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c340be0 msgr2=0x55a93c340fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c340be0 0x55a93c340fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.636+0000 7f50e232d700 1 -- 172.21.15.35:0/2105809475 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a93c10f5d0 con 0x55a93c33b960 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50e232d700 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c33bd90 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f50d4094210 tx=0x7f50d4093bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19e325acb81e2b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50c7fff700 1 -- 172.21.15.35:0/2105809475 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d400ddd0 con 0x55a93c33b960 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50c7fff700 1 -- 172.21.15.35:0/2105809475 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50d40977a0 con 0x55a93c33b960 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50c7fff700 1 -- 172.21.15.35:0/2105809475 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4097c60 con 0x55a93c33b960 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 -- 172.21.15.35:0/2105809475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 msgr2=0x55a93c33bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:27:59.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c33bd90 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f50d4094210 tx=0x7f50d4093bf0 comp rx=0 tx=0).stop 2023-03-17T11:27:59.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 -- 172.21.15.35:0/2105809475 shutdown_connections 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c33bd90 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c340be0 0x55a93c340fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2105809475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.637+0000 7f50eff1db80 1 -- 172.21.15.35:0/2105809475 >> 172.21.15.35:0/2105809475 conn(0x55a93c1986b0 msgr2=0x55a93c335a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 -- 172.21.15.35:0/2105809475 shutdown_connections 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 -- 172.21.15.35:0/2105809475 wait complete. 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 -- start start 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 Processor -- start 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c347480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:01.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c344700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 0x55a93c344da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c1118c0 con 0x55a93c3414f0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c345510 con 0x55a93c33b960 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.638+0000 7f50eff1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c350fd0 con 0x55a93c340be0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50eff1db80 10 client.0 _ll_register_callbacks cb 0x55a93c133230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 0x55a93c344da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 0x55a93c344da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55384/0 (socket says 172.21.15.35:55384) 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 -- 172.21.15.35:0/2754524774 learned_addr learned my addr 172.21.15.35:0/2754524774 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c347480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e132b700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c344700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 -- 172.21.15.35:0/2754524774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 msgr2=0x55a93c344700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c344700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 -- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 msgr2=0x55a93c347480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c347480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 -- 172.21.15.35:0/2754524774 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc10ff60 con 0x55a93c3414f0 2023-03-17T11:28:01.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50e232d700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 0x55a93c344da0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f50d4097730 tx=0x7f50d4096f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339a5e3ce8d92cdd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:28:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50c57fa700 1 -- 172.21.15.35:0/2754524774 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d40977a0 con 0x55a93c3414f0 2023-03-17T11:28:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50c57fa700 1 -- 172.21.15.35:0/2754524774 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50d409f990 con 0x55a93c3414f0 2023-03-17T11:28:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a93c250390 con 0x55a93c3414f0 2023-03-17T11:28:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50c57fa700 1 -- 172.21.15.35:0/2754524774 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d4097c10 con 0x55a93c3414f0 2023-03-17T11:28:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50eff1db80 10 client.20799 fetch_fsmap learned FSMap version 108 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.639+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55a93c0bbd80 con 0x55a93c3414f0 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50c57fa700 1 -- 172.21.15.35:0/2754524774 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a93c250390 con 0x55a93c3414f0 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50c57fa700 1 -- 172.21.15.35:0/2754524774 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f50d40afd20 con 0x55a93c3414f0 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50eff1db80 10 client.20799 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50eff1db80 10 client.20799 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50eff1db80 20 client.20799 populate_metadata read hostname 'smithi035' 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c354e70 0x55a93c357280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50eff1db80 4 client.20799 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a93c25c600 con 0x55a93c354e70 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.640+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c354e70 0x55a93c357280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50c57fa700 10 client.20799 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c354e70 0x55a93c357280 crc :-1 s=READY pgs=675 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a5b98349d5d8b6c server_cookie=3a20004fad69c60c in_seq=0 out_seq=0 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50c57fa700 1 -- 172.21.15.35:0/2754524774 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a93c25c600 con 0x55a93c354e70 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50c57fa700 10 client.20799 handle_command_reply: tid=0 2023-03-17T11:28:03.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50eff1db80 1 client.20799 shutdown 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 msgr2=0x55a93c344da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.641+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 0x55a93c344da0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f50d4097730 tx=0x7f50d4096f70 comp rx=0 tx=0).stop 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 shutdown_connections 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c354e70 0x55a93c357280 crc :-1 s=READY pgs=675 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c3414f0 0x55a93c344da0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c347480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 --2- 172.21.15.35:0/2754524774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c344700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50c57fa700 0 client.20799 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 >> 172.21.15.35:0/2754524774 conn(0x55a93c1986b0 msgr2=0x55a93c33a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 shutdown_connections 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 1 -- 172.21.15.35:0/2754524774 wait complete. 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.642+0000 7f50eff1db80 20 client.20799 trim_cache size 0 max 16384 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 Processor -- start 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 -- start start 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c34bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 0x55a93c347020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:03.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c33b7a0 con 0x55a93c340be0 2023-03-17T11:28:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c345630 con 0x55a93c33b960 2023-03-17T11:28:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50eff1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c340830 con 0x55a93c3414f0 2023-03-17T11:28:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50e132b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 0x55a93c347020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50e132b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 0x55a93c347020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55390/0 (socket says 172.21.15.35:55390) 2023-03-17T11:28:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50e132b700 1 -- 172.21.15.35:0/39494912 learned_addr learned my addr 172.21.15.35:0/39494912 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c34bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:05.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.657+0000 7f50e232d700 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50e132b700 1 -- 172.21.15.35:0/39494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 msgr2=0x55a93c33e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50e132b700 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50e132b700 1 -- 172.21.15.35:0/39494912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 msgr2=0x55a93c34bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50e132b700 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c34bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50e132b700 1 -- 172.21.15.35:0/39494912 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a93c254130 con 0x55a93c340be0 2023-03-17T11:28:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50e132b700 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 0x55a93c347020 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b580 tx=0x7f50cc005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bac8cadabf5db4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50d0ff9700 1 -- 172.21.15.35:0/39494912 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc005330 con 0x55a93c340be0 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50d0ff9700 1 -- 172.21.15.35:0/39494912 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50cc01e070 con 0x55a93c340be0 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.658+0000 7f50d0ff9700 1 -- 172.21.15.35:0/39494912 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0039c0 con 0x55a93c340be0 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 -- 172.21.15.35:0/39494912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 msgr2=0x55a93c347020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 0x55a93c347020 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00b580 tx=0x7f50cc005040 comp rx=0 tx=0).stop 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 -- 172.21.15.35:0/39494912 shutdown_connections 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c3414f0 0x55a93c33e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c33b960 0x55a93c34bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 --2- 172.21.15.35:0/39494912 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c340be0 0x55a93c347020 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 -- 172.21.15.35:0/39494912 >> 172.21.15.35:0/39494912 conn(0x55a93c1986b0 msgr2=0x55a93c33aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 -- 172.21.15.35:0/39494912 shutdown_connections 2023-03-17T11:28:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 -- 172.21.15.35:0/39494912 wait complete. 2023-03-17T11:28:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 -- start start 2023-03-17T11:28:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.659+0000 7f50eff1db80 1 Processor -- start 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c3a1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c3a1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c3414f0 0x55a93c39cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c39d260 con 0x55a93c33b960 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c39d3d0 con 0x55a93c3414f0 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a93c39d590 con 0x55a93c340be0 2023-03-17T11:28:10.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 10 client.0 _ll_register_callbacks cb 0x55a93c133230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c3a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c3a1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55394/0 (socket says 172.21.15.35:55394) 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 -- 172.21.15.35:0/3490325567 learned_addr learned my addr 172.21.15.35:0/3490325567 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e132b700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c3a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e232d700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c3414f0 0x55a93c39cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 -- 172.21.15.35:0/3490325567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 msgr2=0x55a93c3a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c3a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 -- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c3414f0 msgr2=0x55a93c39cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c3414f0 0x55a93c39cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 -- 172.21.15.35:0/3490325567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc10d8d0 con 0x55a93c33b960 2023-03-17T11:28:10.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50e1b2c700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c3a1100 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x55a93c357b20 tx=0x7f50d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06d26f8da817123 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:28:13.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:22 smithi035 ceph-mon[92535]: pgmap v4985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T11:28:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50c57fa700 1 -- 172.21.15.35:0/3490325567 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8022040 con 0x55a93c33b960 2023-03-17T11:28:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a93c30b1e0 con 0x55a93c33b960 2023-03-17T11:28:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.660+0000 7f50c57fa700 1 -- 172.21.15.35:0/3490325567 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f50d802b240 con 0x55a93c33b960 2023-03-17T11:28:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50c57fa700 1 -- 172.21.15.35:0/3490325567 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d802b400 con 0x55a93c33b960 2023-03-17T11:28:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 10 client.20805 fetch_fsmap learned FSMap version 108 2023-03-17T11:28:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55a93c0e21f0 con 0x55a93c33b960 2023-03-17T11:28:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50c57fa700 1 -- 172.21.15.35:0/3490325567 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a93c30b1e0 con 0x55a93c33b960 2023-03-17T11:28:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50c57fa700 1 -- 172.21.15.35:0/3490325567 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f50d8034630 con 0x55a93c33b960 2023-03-17T11:28:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 10 client.20805 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:28:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 10 client.20805 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:28:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 20 client.20805 populate_metadata read hostname 'smithi035' 2023-03-17T11:28:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c3aa0d0 0x55a93c3ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 4 client.20805 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:28:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a93c111f00 con 0x55a93c3aa0d0 2023-03-17T11:28:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.661+0000 7f50e132b700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c3aa0d0 0x55a93c3ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.662+0000 7f50c57fa700 10 client.20805 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.662+0000 7f50e132b700 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c3aa0d0 0x55a93c3ac4e0 crc :-1 s=READY pgs=676 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a7e9d58d3339c0 server_cookie=4b291921c1bebbe0 in_seq=0 out_seq=0 2023-03-17T11:28:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50c57fa700 1 -- 172.21.15.35:0/3490325567 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a93c111f00 con 0x55a93c3aa0d0 2023-03-17T11:28:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50c57fa700 10 client.20805 handle_command_reply: tid=0 2023-03-17T11:28:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 client.20805 shutdown 2023-03-17T11:28:18.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 msgr2=0x55a93c3a1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c3a1100 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x55a93c357b20 tx=0x7f50d80047c0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 shutdown_connections 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a93c3aa0d0 0x55a93c3ac4e0 crc :-1 s=READY pgs=676 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a93c3414f0 0x55a93c39cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a93c33b960 0x55a93c3a1100 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50c57fa700 0 client.20805 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 --2- 172.21.15.35:0/3490325567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a93c340be0 0x55a93c3a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 >> 172.21.15.35:0/3490325567 conn(0x55a93c1986b0 msgr2=0x55a93c33e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 shutdown_connections 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 1 -- 172.21.15.35:0/3490325567 wait complete. 2023-03-17T11:28:18.792 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.670+0000 7f50eff1db80 20 client.20805 trim_cache size 0 max 16384 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50c809f640 msgr2=0x7f50c80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50c809f640 0x7f50c80a1af0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009c60 tx=0x7f50d8009260 comp rx=0 tx=0).stop 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 msgr2=0x7f50dc19ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 0x7f50dc19ac00 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f50d4007ee0 tx=0x7f50d400d3b0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 shutdown_connections 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f50c809f640 0x7f50c80a1af0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f50dc105510 0x7f50dc19ac00 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50dc0fe970 0x7f50dc196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 --2- 172.21.15.35:0/4189362894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc0ff310 0x7f50dc1967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 >> 172.21.15.35:0/4189362894 conn(0x7f50dc0757a0 msgr2=0x7f50dc0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 shutdown_connections 2023-03-17T11:28:18.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:04:53.671+0000 7f50e3d90700 1 -- 172.21.15.35:0/4189362894 wait complete. 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 -- 172.21.15.35:0/3644579777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ff350 msgr2=0x7fc4180ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 --2- 172.21.15.35:0/3644579777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ff350 0x7fc4180ff720 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0099c0 tx=0x7fc40c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 -- 172.21.15.35:0/3644579777 shutdown_connections 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 --2- 172.21.15.35:0/3644579777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc418104390 0x7fc41810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 --2- 172.21.15.35:0/3644579777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ff350 0x7fc4180ff720 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 --2- 172.21.15.35:0/3644579777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4180ffcf0 0x7fc418103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 -- 172.21.15.35:0/3644579777 >> 172.21.15.35:0/3644579777 conn(0x7fc418076330 msgr2=0x7fc418076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 -- 172.21.15.35:0/3644579777 shutdown_connections 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 -- 172.21.15.35:0/3644579777 wait complete. 2023-03-17T11:28:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.792+0000 7fc41f099700 1 Processor -- start 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 -- start start 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4180ff350 0x7fc418198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 0x7fc4181989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc418104390 0x7fc41819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41819d450 con 0x7fc4180ffcf0 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41819d5c0 con 0x7fc418104390 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41f099700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41819d780 con 0x7fc4180ff350 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 0x7fc4181989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 0x7fc4181989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55410/0 (socket says 172.21.15.35:55410) 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 -- 172.21.15.35:0/2907539976 learned_addr learned my addr 172.21.15.35:0/2907539976 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41d636700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc418104390 0x7fc41819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc41ce35700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4180ff350 0x7fc418198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 -- 172.21.15.35:0/2907539976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4180ff350 msgr2=0x7fc418198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4180ff350 0x7fc418198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 -- 172.21.15.35:0/2907539976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc418104390 msgr2=0x7fc41819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc418104390 0x7fc41819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 -- 172.21.15.35:0/2907539976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c0095f0 con 0x7fc4180ffcf0 2023-03-17T11:28:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.793+0000 7fc417fff700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 0x7fc4181989b0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fc40400d950 tx=0x7fc40400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.794+0000 7fc415ffb700 1 -- 172.21.15.35:0/2907539976 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404009930 con 0x7fc4180ffcf0 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.794+0000 7fc415ffb700 1 -- 172.21.15.35:0/2907539976 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc404010460 con 0x7fc4180ffcf0 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.794+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41810f000 con 0x7fc4180ffcf0 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.794+0000 7fc415ffb700 1 -- 172.21.15.35:0/2907539976 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400f620 con 0x7fc4180ffcf0 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.794+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41810ee70 con 0x7fc4180ffcf0 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.796+0000 7fc415ffb700 1 -- 172.21.15.35:0/2907539976 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc404009a90 con 0x7fc4180ffcf0 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.797+0000 7fc415ffb700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc40809f640 0x7fc4080a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.797+0000 7fc415ffb700 1 -- 172.21.15.35:0/2907539976 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc4040c9b90 con 0x7fc4180ffcf0 2023-03-17T11:28:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.797+0000 7fc41ce35700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc40809f640 0x7fc4080a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.797+0000 7fc41ce35700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc40809f640 0x7fc4080a1af0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009fd0 tx=0x7fc40c005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.797+0000 7fc42b226b80 1 Processor -- start 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.797+0000 7fc42b226b80 1 -- start start 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994af4f0 0x55ba994a9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994a9960 0x55ba994a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc42b226b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba993b0010 con 0x55ba994aebe0 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc42b226b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba99402950 con 0x55ba994a9960 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc42b226b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba993fbde0 con 0x55ba994af4f0 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55416/0 (socket says 172.21.15.35:55416) 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 -- 172.21.15.35:0/2535419293 learned_addr learned my addr 172.21.15.35:0/2535419293 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41d636700 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994a9960 0x55ba994a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc417fff700 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994af4f0 0x55ba994a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 -- 172.21.15.35:0/2535419293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994af4f0 msgr2=0x55ba994a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994af4f0 0x55ba994a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 -- 172.21.15.35:0/2535419293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994a9960 msgr2=0x55ba994a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994a9960 0x55ba994a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 -- 172.21.15.35:0/2535419293 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba9927d5d0 con 0x55ba994aebe0 2023-03-17T11:28:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc41ce35700 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994aefb0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fc40c005cd0 tx=0x7fc40c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906aab575485ad79 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc402ffd700 1 -- 172.21.15.35:0/2535419293 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c02b070 con 0x55ba994aebe0 2023-03-17T11:28:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.798+0000 7fc402ffd700 1 -- 172.21.15.35:0/2535419293 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc40c01e040 con 0x55ba994aebe0 2023-03-17T11:28:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc402ffd700 1 -- 172.21.15.35:0/2535419293 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c004a50 con 0x55ba994aebe0 2023-03-17T11:28:23.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 -- 172.21.15.35:0/2535419293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 msgr2=0x55ba994aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994aefb0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fc40c005cd0 tx=0x7fc40c01f000 comp rx=0 tx=0).stop 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 -- 172.21.15.35:0/2535419293 shutdown_connections 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994a9960 0x55ba994a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994aefb0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 --2- 172.21.15.35:0/2535419293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994af4f0 0x55ba994a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 -- 172.21.15.35:0/2535419293 >> 172.21.15.35:0/2535419293 conn(0x55ba993066b0 msgr2=0x55ba994a3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 -- 172.21.15.35:0/2535419293 shutdown_connections 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.799+0000 7fc42b226b80 1 -- 172.21.15.35:0/2535419293 wait complete. 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 -- start start 2023-03-17T11:28:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 Processor -- start 2023-03-17T11:28:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994af4f0 0x55ba994b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:27.696 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9927f8c0 con 0x55ba994aebe0 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994b32d0 con 0x55ba994af4f0 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc42b226b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994b3490 con 0x55ba994a9960 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.800+0000 7fc417fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc42b226b80 10 client.0 _ll_register_callbacks cb 0x55ba992a1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55424/0 (socket says 172.21.15.35:55424) 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 -- 172.21.15.35:0/3897303849 learned_addr learned my addr 172.21.15.35:0/3897303849 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc41d636700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994af4f0 0x55ba994b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 -- 172.21.15.35:0/3897303849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 msgr2=0x55ba994b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 -- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994af4f0 msgr2=0x55ba994b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994af4f0 0x55ba994b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 -- 172.21.15.35:0/3897303849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41810c7a0 con 0x55ba994aebe0 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc417fff700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994b2610 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fc404097570 tx=0x7fc404096fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67b62c08336693a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc3f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3897303849 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40409f7d0 con 0x55ba994aebe0 2023-03-17T11:28:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3897303849 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc404097840 con 0x55ba994aebe0 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba993be390 con 0x55ba994aebe0 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3897303849 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc404097a00 con 0x55ba994aebe0 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc42b226b80 10 client.20817 fetch_fsmap learned FSMap version 108 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55ba99229d80 con 0x55ba994aebe0 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.801+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3897303849 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4040b3020 con 0x55ba994aebe0 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3897303849 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc4040c5c80 con 0x55ba994aebe0 2023-03-17T11:28:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc42b226b80 10 client.20817 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc42b226b80 10 client.20817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc42b226b80 20 client.20817 populate_metadata read hostname 'smithi035' 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba994c0fb0 0x55ba994c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc42b226b80 4 client.20817 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba993ca600 con 0x55ba994c0fb0 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba994c0fb0 0x55ba994c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba994c0fb0 0x55ba994c33c0 crc :-1 s=READY pgs=677 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81026e670934eea6 server_cookie=53e556309b67182c in_seq=0 out_seq=0 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.802+0000 7fc3f7fff700 10 client.20817 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3897303849 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55ba993ca600 con 0x55ba994c0fb0 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc3f7fff700 10 client.20817 handle_command_reply: tid=0 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 client.20817 shutdown 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 msgr2=0x55ba994b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994b2610 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fc404097570 tx=0x7fc404096fc0 comp rx=0 tx=0).stop 2023-03-17T11:28:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 shutdown_connections 2023-03-17T11:28:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba994c0fb0 0x55ba994c33c0 crc :-1 s=READY pgs=677 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994af4f0 0x55ba994b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3897303849 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994aebe0 0x55ba994b2610 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 >> 172.21.15.35:0/3897303849 conn(0x55ba993066b0 msgr2=0x55ba994a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc3f7fff700 0 client.20817 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:32.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:24 smithi035 ceph-mon[92535]: pgmap v4986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T11:28:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 shutdown_connections 2023-03-17T11:28:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 1 -- 172.21.15.35:0/3897303849 wait complete. 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.803+0000 7fc42b226b80 20 client.20817 trim_cache size 0 max 16384 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 Processor -- start 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 -- start start 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994a4000 con 0x55ba994af4f0 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9949f0d0 con 0x55ba994aebe0 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.818+0000 7fc42b226b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994ad1b0 con 0x55ba994a9960 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55434/0 (socket says 172.21.15.35:55434) 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 -- 172.21.15.35:0/3110252667 learned_addr learned my addr 172.21.15.35:0/3110252667 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc417fff700 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 -- 172.21.15.35:0/3110252667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 msgr2=0x55ba994a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 -- 172.21.15.35:0/3110252667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 msgr2=0x55ba994b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 -- 172.21.15.35:0/3110252667 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba993c2130 con 0x55ba994af4f0 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc41d636700 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b4f30 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fc410009940 tx=0x7fc410009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffa5c109b7e2207 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc4037fe700 1 -- 172.21.15.35:0/3110252667 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410003b90 con 0x55ba994af4f0 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc4037fe700 1 -- 172.21.15.35:0/3110252667 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc41000f040 con 0x55ba994af4f0 2023-03-17T11:28:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.819+0000 7fc4037fe700 1 -- 172.21.15.35:0/3110252667 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410016980 con 0x55ba994af4f0 2023-03-17T11:28:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 -- 172.21.15.35:0/3110252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 msgr2=0x55ba994b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b4f30 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fc410009940 tx=0x7fc410009970 comp rx=0 tx=0).stop 2023-03-17T11:28:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 -- 172.21.15.35:0/3110252667 shutdown_connections 2023-03-17T11:28:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b4f30 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:35.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3110252667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 -- 172.21.15.35:0/3110252667 >> 172.21.15.35:0/3110252667 conn(0x55ba993066b0 msgr2=0x55ba994c2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 -- 172.21.15.35:0/3110252667 shutdown_connections 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 -- 172.21.15.35:0/3110252667 wait complete. 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 -- start start 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.820+0000 7fc42b226b80 1 Processor -- start 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:38.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994b8770 con 0x55ba994af4f0 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994b88e0 con 0x55ba994aebe0 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba994b8aa0 con 0x55ba994a9960 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc42b226b80 10 client.0 _ll_register_callbacks cb 0x55ba992a1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55440/0 (socket says 172.21.15.35:55440) 2023-03-17T11:28:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 -- 172.21.15.35:0/3983191481 learned_addr learned my addr 172.21.15.35:0/3983191481 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc417fff700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 -- 172.21.15.35:0/3983191481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 msgr2=0x55ba994b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 -- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 msgr2=0x55ba994ba090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994ba090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.821+0000 7fc41d636700 1 -- 172.21.15.35:0/3983191481 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc410003cf0 con 0x55ba994af4f0 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc41d636700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b80a0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fc410004480 tx=0x7fc410003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c88de6929615a74 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc3f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:28:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3983191481 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410024070 con 0x55ba994af4f0 2023-03-17T11:28:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3983191481 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(357..357 src has 1..357) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc410016560 con 0x55ba994af4f0 2023-03-17T11:28:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba994791e0 con 0x55ba994af4f0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3983191481 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4100095e0 con 0x55ba994af4f0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 10 client.20823 fetch_fsmap learned FSMap version 108 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55ba992501f0 con 0x55ba994af4f0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3983191481 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba994791e0 con 0x55ba994af4f0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3983191481 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc410029910 con 0x55ba994af4f0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 10 client.20823 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 10 client.20823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 20 client.20823 populate_metadata read hostname 'smithi035' 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba995569b0 0x55ba99556db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 4 client.20823 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.822+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ba9927ff00 con 0x55ba995569b0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.823+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba995569b0 0x55ba99556db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.823+0000 7fc3f7fff700 10 client.20823 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.823+0000 7fc41ce35700 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba995569b0 0x55ba99556db0 crc :-1 s=READY pgs=678 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cdb98c576a7fb50 server_cookie=c0cde29a167ba4c6 in_seq=0 out_seq=0 2023-03-17T11:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc3f7fff700 1 -- 172.21.15.35:0/3983191481 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ba9927ff00 con 0x55ba995569b0 2023-03-17T11:28:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc3f7fff700 10 client.20823 handle_command_reply: tid=0 2023-03-17T11:28:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 client.20823 shutdown 2023-03-17T11:28:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 msgr2=0x55ba994b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b80a0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fc410004480 tx=0x7fc410003c80 comp rx=0 tx=0).stop 2023-03-17T11:28:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 shutdown_connections 2023-03-17T11:28:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55ba995569b0 0x55ba99556db0 crc :-1 s=READY pgs=678 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55ba994af4f0 0x55ba994b80a0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba994a9960 0x55ba994b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 --2- 172.21.15.35:0/3983191481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba994aebe0 0x55ba994ba090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc3f7fff700 0 client.20823 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:28:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 >> 172.21.15.35:0/3983191481 conn(0x55ba993066b0 msgr2=0x55ba994ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 shutdown_connections 2023-03-17T11:28:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 1 -- 172.21.15.35:0/3983191481 wait complete. 2023-03-17T11:28:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.841+0000 7fc42b226b80 20 client.20823 trim_cache size 0 max 16384 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc40809f640 msgr2=0x7fc4080a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc40809f640 0x7fc4080a1af0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009fd0 tx=0x7fc40c005fb0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 msgr2=0x7fc4181989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 0x7fc4181989b0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fc40400d950 tx=0x7fc40400dc60 comp rx=0 tx=0).stop 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 shutdown_connections 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc40809f640 0x7fc4080a1af0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc418104390 0x7fc41819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4180ff350 0x7fc418198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 --2- 172.21.15.35:0/2907539976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc4180ffcf0 0x7fc4181989b0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 >> 172.21.15.35:0/2907539976 conn(0x7fc418076330 msgr2=0x7fc4180fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 shutdown_connections 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:05:06.842+0000 7fc41f099700 1 -- 172.21.15.35:0/2907539976 wait complete. 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 -- 172.21.15.35:0/1930848508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d900ff350 msgr2=0x7f6d900ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 --2- 172.21.15.35:0/1930848508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d900ff350 0x7f6d900ff720 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f6d800099c0 tx=0x7f6d80009cd0 comp rx=0 tx=0).stop 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 -- 172.21.15.35:0/1930848508 shutdown_connections 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 --2- 172.21.15.35:0/1930848508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d90104390 0x7f6d9010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 --2- 172.21.15.35:0/1930848508 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d900ff350 0x7f6d900ff720 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 --2- 172.21.15.35:0/1930848508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ffcf0 0x7f6d90103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.930+0000 7f6d95d87700 1 -- 172.21.15.35:0/1930848508 >> 172.21.15.35:0/1930848508 conn(0x7f6d90076330 msgr2=0x7f6d90076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:28:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.931+0000 7f6d95d87700 1 -- 172.21.15.35:0/1930848508 shutdown_connections 2023-03-17T11:28:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.931+0000 7f6d95d87700 1 -- 172.21.15.35:0/1930848508 wait complete. 2023-03-17T11:28:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.931+0000 7f6d95d87700 1 Processor -- start 2023-03-17T11:28:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.931+0000 7f6d95d87700 1 -- start start 2023-03-17T11:28:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d95d87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ff350 0x7f6d90100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:47.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d95d87700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d900ffcf0 0x7f6d90101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:47.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d95d87700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 0x7f6d901a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:47.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d95d87700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90101b30 con 0x7f6d90104390 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d95d87700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d901a49b0 con 0x7f6d900ffcf0 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d95d87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d901a4af0 con 0x7f6d900ff350 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 0x7f6d901a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 0x7f6d901a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55454/0 (socket says 172.21.15.35:55454) 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 -- 172.21.15.35:0/899075565 learned_addr learned my addr 172.21.15.35:0/899075565 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8effd700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d900ffcf0 0x7f6d90101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:48.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ff350 0x7f6d90100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 -- 172.21.15.35:0/899075565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ff350 msgr2=0x7f6d90100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:48.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ff350 0x7f6d90100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 -- 172.21.15.35:0/899075565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d900ffcf0 msgr2=0x7f6d90101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:28:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d900ffcf0 0x7f6d90101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 -- 172.21.15.35:0/899075565 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800095f0 con 0x7f6d90104390 2023-03-17T11:28:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ff350 0x7f6d90100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:28:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.932+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 0x7f6d901a4470 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800ef60 tx=0x7f6d8800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.933+0000 7f6d8cff9700 1 -- 172.21.15.35:0/899075565 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88018070 con 0x7f6d90104390 2023-03-17T11:28:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.933+0000 7f6d8cff9700 1 -- 172.21.15.35:0/899075565 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d8800f040 con 0x7f6d90104390 2023-03-17T11:28:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.933+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9010f000 con 0x7f6d90104390 2023-03-17T11:28:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.933+0000 7f6d8cff9700 1 -- 172.21.15.35:0/899075565 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800cd10 con 0x7f6d90104390 2023-03-17T11:28:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.933+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9010ee70 con 0x7f6d90104390 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.935+0000 7f6d8cff9700 1 -- 172.21.15.35:0/899075565 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6d88004ad0 con 0x7f6d90104390 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.935+0000 7f6d8cff9700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6d7809f640 0x7f6d780a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.935+0000 7f6d8cff9700 1 -- 172.21.15.35:0/899075565 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6d880ca0c0 con 0x7f6d90104390 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.935+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6d7809f640 0x7f6d780a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6d7809f640 0x7f6d780a1af0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000b580 tx=0x7f6d8001a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 Processor -- start 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 -- start start 2023-03-17T11:28:50.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x55986023dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860238420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860238d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:28:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55986013f010 con 0x55986023dbe0 2023-03-17T11:28:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860191950 con 0x55986023e4f0 2023-03-17T11:28:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.936+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55986018ade0 con 0x559860238960 2023-03-17T11:28:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x55986023dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x55986023dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55458/0 (socket says 172.21.15.35:55458) 2023-03-17T11:28:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 -- 172.21.15.35:0/1103099407 learned_addr learned my addr 172.21.15.35:0/1103099407 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:28:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860238d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8effd700 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860238420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:28:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 -- 172.21.15.35:0/1103099407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 msgr2=0x559860238d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860238d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 -- 172.21.15.35:0/1103099407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 msgr2=0x559860238420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:28:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860238420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:28:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 -- 172.21.15.35:0/1103099407 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55986000c5d0 con 0x55986023dbe0 2023-03-17T11:28:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x55986023dfb0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6d80005970 tx=0x7f6d8001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439bbfb2be1f0d0b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:28:54.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d75ffb700 1 -- 172.21.15.35:0/1103099407 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8002a070 con 0x55986023dbe0 2023-03-17T11:28:54.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d75ffb700 1 -- 172.21.15.35:0/1103099407 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d800056b0 con 0x55986023dbe0 2023-03-17T11:28:54.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:26 smithi035 ceph-mon[92535]: pgmap v4987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:28 smithi035 ceph-mon[92535]: pgmap v4988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:30 smithi035 ceph-mon[92535]: pgmap v4989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:32 smithi035 ceph-mon[92535]: pgmap v4990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:34 smithi035 ceph-mon[92535]: pgmap v4991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:36 smithi035 ceph-mon[92535]: pgmap v4992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:38 smithi035 ceph-mon[92535]: pgmap v4993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:40 smithi035 ceph-mon[92535]: pgmap v4994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:28:55.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:42 smithi035 ceph-mon[92535]: pgmap v4995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:44 smithi035 ceph-mon[92535]: pgmap v4996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:46 smithi035 ceph-mon[92535]: pgmap v4997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:48 smithi035 ceph-mon[92535]: pgmap v4998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:50 smithi035 ceph-mon[92535]: pgmap v4999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:52 smithi035 ceph-mon[92535]: pgmap v5000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:54 smithi035 ceph-mon[92535]: pgmap v5001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:28:56.149 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:56 smithi035 ceph-mon[92535]: pgmap v5002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:17:58 smithi035 ceph-mon[92535]: pgmap v5003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:00 smithi035 ceph-mon[92535]: pgmap v5004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:02 smithi035 ceph-mon[92535]: pgmap v5005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:04 smithi035 ceph-mon[92535]: pgmap v5006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:06 smithi035 ceph-mon[92535]: pgmap v5007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:08 smithi035 ceph-mon[92535]: pgmap v5008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:10 smithi035 ceph-mon[92535]: osdmap e382: 12 total, 12 up, 12 in 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:10 smithi035 ceph-mon[92535]: pgmap v5010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:28:56.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:12 smithi035 ceph-mon[92535]: pgmap v5011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:28:56.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:14 smithi035 ceph-mon[92535]: pgmap v5012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:28:56.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:16 smithi035 ceph-mon[92535]: pgmap v5013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:28:56.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:18 smithi035 ceph-mon[92535]: osdmap e383: 12 total, 12 up, 12 in 2023-03-17T11:28:56.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:18 smithi035 ceph-mon[92535]: pgmap v5015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 124 B/s wr, 12 op/s 2023-03-17T11:28:56.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:20 smithi035 ceph-mon[92535]: pgmap v5016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:28:58.245 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:28:58.245 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:28:58.245 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:28:58.245 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:28:58.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:21 smithi035 ceph-mon[92535]: pgmap v5017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 115 B/s wr, 11 op/s 2023-03-17T11:28:58.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:21 smithi035 ceph-mon[92535]: pgmap v5018: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T11:28:58.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:23 smithi035 ceph-mon[92535]: pgmap v5019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 149 B/s wr, 14 op/s 2023-03-17T11:28:58.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:25 smithi035 ceph-mon[92535]: pgmap v5020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T11:28:58.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:27 smithi035 ceph-mon[92535]: pgmap v5021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T11:28:58.246 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:29 smithi035 ceph-mon[92535]: pgmap v5022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:28:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:28:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:28:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:28:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:28:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:28:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:28:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.937+0000 7f6d75ffb700 1 -- 172.21.15.35:0/1103099407 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8001d040 con 0x55986023dbe0 2023-03-17T11:29:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1103099407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 msgr2=0x55986023dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x55986023dfb0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6d80005970 tx=0x7f6d8001e000 comp rx=0 tx=0).stop 2023-03-17T11:29:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1103099407 shutdown_connections 2023-03-17T11:29:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860238d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x55986023dfb0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:04.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1103099407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860238420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1103099407 >> 172.21.15.35:0/1103099407 conn(0x5598600956b0 msgr2=0x559860232a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1103099407 shutdown_connections 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1103099407 wait complete. 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.938+0000 7f6da1f14b80 1 -- start start 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 Processor -- start 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x5598602444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x5598602416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:04.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860241e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55986000e8c0 con 0x55986023dbe0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860242560 con 0x55986023e4f0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55986024df70 con 0x559860238960 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6da1f14b80 10 client.0 _ll_register_callbacks cb 0x559860030230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x5598602416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x5598602416e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55466/0 (socket says 172.21.15.35:55466) 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8effd700 1 -- 172.21.15.35:0/1572855673 learned_addr learned my addr 172.21.15.35:0/1572855673 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860241e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x5598602444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8effd700 1 -- 172.21.15.35:0/1572855673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 msgr2=0x5598602444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.939+0000 7f6d8effd700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x5598602444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d8effd700 1 -- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 msgr2=0x559860241e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d8effd700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860241e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d8effd700 1 -- 172.21.15.35:0/1572855673 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9010c7a0 con 0x55986023dbe0 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x5598602444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:29:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d8effd700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x5598602416e0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6d84010810 tx=0x7f6d84010b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f94e071cfe49f98 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d6effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:29:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d6effd700 1 -- 172.21.15.35:0/1572855673 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84015070 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d6effd700 1 -- 172.21.15.35:0/1572855673 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6d84004830 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55986014d390 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d6effd700 1 -- 172.21.15.35:0/1572855673 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d840049f0 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6da1f14b80 10 client.20835 fetch_fsmap learned FSMap version 108 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55985ffb8d80 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d6effd700 1 -- 172.21.15.35:0/1572855673 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55986014d390 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6d6effd700 1 -- 172.21.15.35:0/1572855673 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6d840199f0 con 0x55986023dbe0 2023-03-17T11:29:06.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6da1f14b80 10 client.20835 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:29:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6da1f14b80 10 client.20835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:29:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.940+0000 7f6da1f14b80 20 client.20835 populate_metadata read hostname 'smithi035' 2023-03-17T11:29:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.941+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559860252060 0x559860254470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.941+0000 7f6da1f14b80 4 client.20835 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.941+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559860159600 con 0x559860252060 2023-03-17T11:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.941+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559860252060 0x559860254470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.941+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559860252060 0x559860254470 crc :-1 s=READY pgs=679 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f019bf6294d34b server_cookie=b420016f71ff3eaf in_seq=0 out_seq=0 2023-03-17T11:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.941+0000 7f6d6effd700 10 client.20835 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6d6effd700 1 -- 172.21.15.35:0/1572855673 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559860159600 con 0x559860252060 2023-03-17T11:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6d6effd700 10 client.20835 handle_command_reply: tid=0 2023-03-17T11:29:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 client.20835 shutdown 2023-03-17T11:29:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 msgr2=0x5598602416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x5598602416e0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6d84010810 tx=0x7f6d84010b20 comp rx=0 tx=0).stop 2023-03-17T11:29:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 shutdown_connections 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559860252060 0x559860254470 crc :-1 s=READY pgs=679 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023e4f0 0x559860241e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.942+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x5598602444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.943+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/1572855673 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023dbe0 0x5598602416e0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.943+0000 7f6d6effd700 0 client.20835 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.943+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 >> 172.21.15.35:0/1572855673 conn(0x5598600956b0 msgr2=0x559860237410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.943+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 shutdown_connections 2023-03-17T11:29:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.943+0000 7f6da1f14b80 1 -- 172.21.15.35:0/1572855673 wait complete. 2023-03-17T11:29:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.943+0000 7f6da1f14b80 20 client.20835 trim_cache size 0 max 16384 2023-03-17T11:29:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 Processor -- start 2023-03-17T11:29:14.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 -- start start 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559860238960 0x559860232ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55986023dbe0 0x559860248ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x559860244000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55986022fb60 con 0x55986023e4f0 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860238760 con 0x559860238960 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860234620 con 0x55986023dbe0 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x559860244000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x559860244000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55476/0 (socket says 172.21.15.35:55476) 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.958+0000 7f6d8ffff700 1 -- 172.21.15.35:0/3834169312 learned_addr learned my addr 172.21.15.35:0/3834169312 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8effd700 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55986023dbe0 0x559860248ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559860238960 0x559860232ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8ffff700 1 -- 172.21.15.35:0/3834169312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55986023dbe0 msgr2=0x559860248ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:14.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55986023dbe0 0x559860248ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8ffff700 1 -- 172.21.15.35:0/3834169312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559860238960 msgr2=0x559860232ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559860238960 0x559860232ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8ffff700 1 -- 172.21.15.35:0/3834169312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559860151130 con 0x55986023e4f0 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8effd700 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55986023dbe0 0x559860248ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x559860244000 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f6d88004fd0 tx=0x7f6d8809d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c312455cc0a6d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d767fc700 1 -- 172.21.15.35:0/3834169312 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8809fe00 con 0x55986023e4f0 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d767fc700 1 -- 172.21.15.35:0/3834169312 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d88097f00 con 0x55986023e4f0 2023-03-17T11:29:14.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.959+0000 7f6d767fc700 1 -- 172.21.15.35:0/3834169312 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8809f970 con 0x55986023e4f0 2023-03-17T11:29:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 -- 172.21.15.35:0/3834169312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 msgr2=0x559860244000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x559860244000 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f6d88004fd0 tx=0x7f6d8809d040 comp rx=0 tx=0).stop 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 -- 172.21.15.35:0/3834169312 shutdown_connections 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x559860244000 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559860238960 0x559860232ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/3834169312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55986023dbe0 0x559860248ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 -- 172.21.15.35:0/3834169312 >> 172.21.15.35:0/3834169312 conn(0x5598600956b0 msgr2=0x559860237a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 -- 172.21.15.35:0/3834169312 shutdown_connections 2023-03-17T11:29:21.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 -- 172.21.15.35:0/3834169312 wait complete. 2023-03-17T11:29:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 -- start start 2023-03-17T11:29:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.960+0000 7f6da1f14b80 1 Processor -- start 2023-03-17T11:29:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860248d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:21.598 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023dbe0 0x559860247080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x5598602475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860247b00 con 0x55986023e4f0 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860247c70 con 0x55986023dbe0 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559860247e30 con 0x559860238960 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6da1f14b80 10 client.0 _ll_register_callbacks cb 0x559860030230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x5598602475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x5598602475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55482/0 (socket says 172.21.15.35:55482) 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 -- 172.21.15.35:0/594434251 learned_addr learned my addr 172.21.15.35:0/594434251 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860248d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:27.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8effd700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023dbe0 0x559860247080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 -- 172.21.15.35:0/594434251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 msgr2=0x559860248d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860248d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 -- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023dbe0 msgr2=0x559860247080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023dbe0 0x559860247080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 -- 172.21.15.35:0/594434251 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9010ee70 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8effd700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023dbe0 0x559860247080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d8ffff700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x5598602475c0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f6d88097c30 tx=0x7f6d880982a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58bfdc69d57bce2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d6effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d6effd700 1 -- 172.21.15.35:0/594434251 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8809fe00 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.961+0000 7f6d6effd700 1 -- 172.21.15.35:0/594434251 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6d880b1070 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598602081e0 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6d6effd700 1 -- 172.21.15.35:0/594434251 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d8809fb80 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 10 client.20841 fetch_fsmap learned FSMap version 108 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55985ffdf1f0 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6d6effd700 1 -- 172.21.15.35:0/594434251 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598602081e0 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6d6effd700 1 -- 172.21.15.35:0/594434251 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6d88096c00 con 0x55986023e4f0 2023-03-17T11:29:28.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 10 client.20841 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:29:28.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 10 client.20841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:29:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 20 client.20841 populate_metadata read hostname 'smithi035' 2023-03-17T11:29:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598602a6ee0 0x5598602a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 4 client.20841 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:29:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55986000ef00 con 0x5598602a6ee0 2023-03-17T11:29:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.962+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598602a6ee0 0x5598602a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.963+0000 7f6d8f7fe700 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598602a6ee0 0x5598602a92c0 crc :-1 s=READY pgs=680 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9337e72b297635fb server_cookie=51c5cefadc19a008 in_seq=0 out_seq=0 2023-03-17T11:29:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.963+0000 7f6d6effd700 10 client.20841 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:29:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6d6effd700 1 -- 172.21.15.35:0/594434251 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55986000ef00 con 0x5598602a6ee0 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6d6effd700 10 client.20841 handle_command_reply: tid=0 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 client.20841 shutdown 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 msgr2=0x5598602475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x5598602475c0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f6d88097c30 tx=0x7f6d880982a0 comp rx=0 tx=0).stop 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 shutdown_connections 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5598602a6ee0 0x5598602a92c0 crc :-1 s=READY pgs=680 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55986023e4f0 0x5598602475c0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559860238960 0x559860248d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6d6effd700 0 client.20841 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 --2- 172.21.15.35:0/594434251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55986023dbe0 0x559860247080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 >> 172.21.15.35:0/594434251 conn(0x5598600956b0 msgr2=0x559860240f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 shutdown_connections 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.981+0000 7f6da1f14b80 1 -- 172.21.15.35:0/594434251 wait complete. 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6da1f14b80 20 client.20841 trim_cache size 0 max 16384 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6d7809f640 msgr2=0x7f6d780a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6d7809f640 0x7f6d780a1af0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000b580 tx=0x7f6d8001a040 comp rx=0 tx=0).stop 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 msgr2=0x7f6d901a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 0x7f6d901a4470 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800ef60 tx=0x7f6d8800ef90 comp rx=0 tx=0).stop 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 shutdown_connections 2023-03-17T11:29:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6d7809f640 0x7f6d780a1af0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6d90104390 0x7f6d901a4470 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d900ff350 0x7f6d90100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 --2- 172.21.15.35:0/899075565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d900ffcf0 0x7f6d90101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 >> 172.21.15.35:0/899075565 conn(0x7f6d90076330 msgr2=0x7f6d90103030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 shutdown_connections 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:18.982+0000 7f6d95d87700 1 -- 172.21.15.35:0/899075565 wait complete. 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 -- 172.21.15.35:0/272774361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f940ffcf0 msgr2=0x7f5f94103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 --2- 172.21.15.35:0/272774361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f940ffcf0 0x7f5f94103cb0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0099c0 tx=0x7f5f7c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 -- 172.21.15.35:0/272774361 shutdown_connections 2023-03-17T11:29:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 --2- 172.21.15.35:0/272774361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f94104390 0x7f5f9410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:32.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:31 smithi035 ceph-mon[92535]: pgmap v5023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 --2- 172.21.15.35:0/272774361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f940ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 --2- 172.21.15.35:0/272774361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f940ffcf0 0x7f5f94103cb0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 -- 172.21.15.35:0/272774361 >> 172.21.15.35:0/272774361 conn(0x7f5f94076330 msgr2=0x7f5f94076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 -- 172.21.15.35:0/272774361 shutdown_connections 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 -- 172.21.15.35:0/272774361 wait complete. 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 Processor -- start 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 -- start start 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.105+0000 7f5f9b037700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f94197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f9b037700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f941a2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f9b037700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f94197f60 con 0x7f5f94104390 2023-03-17T11:29:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f9b037700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f941a26a0 con 0x7f5f940ff350 2023-03-17T11:29:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f9b037700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f941a2860 con 0x7f5f940ffcf0 2023-03-17T11:29:34.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f941a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f941a2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55496/0 (socket says 172.21.15.35:55496) 2023-03-17T11:29:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f94197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 -- 172.21.15.35:0/3047638753 learned_addr learned my addr 172.21.15.35:0/3047638753 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 -- 172.21.15.35:0/3047638753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 msgr2=0x7f5f94197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f94197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 -- 172.21.15.35:0/3047638753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 msgr2=0x7f5f941970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 -- 172.21.15.35:0/3047638753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0095f0 con 0x7f5f94104390 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f995d4700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f941a2160 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007ee0 tx=0x7f5f8c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f91ffb700 1 -- 172.21.15.35:0/3047638753 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c017070 con 0x7f5f94104390 2023-03-17T11:29:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9410efc0 con 0x7f5f94104390 2023-03-17T11:29:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.106+0000 7f5f91ffb700 1 -- 172.21.15.35:0/3047638753 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f8c00f040 con 0x7f5f94104390 2023-03-17T11:29:37.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.107+0000 7f5f91ffb700 1 -- 172.21.15.35:0/3047638753 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c005710 con 0x7f5f94104390 2023-03-17T11:29:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.107+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9410ee30 con 0x7f5f94104390 2023-03-17T11:29:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.109+0000 7f5f91ffb700 1 -- 172.21.15.35:0/3047638753 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5f8c005870 con 0x7f5f94104390 2023-03-17T11:29:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.109+0000 7f5f91ffb700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.109+0000 7f5f91ffb700 1 -- 172.21.15.35:0/3047638753 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f8c0c9e00 con 0x7f5f94104390 2023-03-17T11:29:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.109+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.110+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400bc10 tx=0x7f5f8400b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.110+0000 7f5fa71c4b80 1 Processor -- start 2023-03-17T11:29:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.110+0000 7f5fa71c4b80 1 -- start start 2023-03-17T11:29:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea168afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168b4f0 0x557ea1685420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:40.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea1685d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea158c010 con 0x557ea1685960 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea15de950 con 0x557ea168abe0 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea15d7de0 con 0x557ea168b4f0 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea1685d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea1685d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55504/0 (socket says 172.21.15.35:55504) 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 -- 172.21.15.35:0/782276825 learned_addr learned my addr 172.21.15.35:0/782276825 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f93fff700 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168b4f0 0x557ea1685420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea168afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 -- 172.21.15.35:0/782276825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168b4f0 msgr2=0x557ea1685420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168b4f0 0x557ea1685420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 -- 172.21.15.35:0/782276825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 msgr2=0x557ea168afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea168afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 -- 172.21.15.35:0/782276825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ea14595d0 con 0x557ea1685960 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.111+0000 7f5f995d4700 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea1685d90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c097840 tx=0x7f5f8c097470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e709ee3eddcfac8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5f8affd700 1 -- 172.21.15.35:0/782276825 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0978b0 con 0x557ea1685960 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5f8affd700 1 -- 172.21.15.35:0/782276825 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f8c09faa0 con 0x557ea1685960 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5f8affd700 1 -- 172.21.15.35:0/782276825 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c097d10 con 0x557ea1685960 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/782276825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 msgr2=0x557ea1685d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea1685d90 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c097840 tx=0x7f5f8c097470 comp rx=0 tx=0).stop 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/782276825 shutdown_connections 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea1685d90 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea168afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/782276825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168b4f0 0x557ea1685420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/782276825 >> 172.21.15.35:0/782276825 conn(0x557ea14e26b0 msgr2=0x557ea167fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/782276825 shutdown_connections 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.112+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/782276825 wait complete. 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 -- start start 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 Processor -- start 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea16914f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168abe0 0x557ea168e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168b4f0 0x557ea168eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea145b8c0 con 0x557ea1685960 2023-03-17T11:29:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea168f5f0 con 0x557ea168b4f0 2023-03-17T11:29:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea169afa0 con 0x557ea168abe0 2023-03-17T11:29:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5fa71c4b80 10 client.0 _ll_register_callbacks cb 0x557ea147d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:29:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.113+0000 7f5f98dd3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea16914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea16914f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55506/0 (socket says 172.21.15.35:55506) 2023-03-17T11:29:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 -- 172.21.15.35:0/1860151824 learned_addr learned my addr 172.21.15.35:0/1860151824 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:41.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f93fff700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168abe0 0x557ea168e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:41.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f995d4700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168b4f0 0x557ea168eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:41.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 -- 172.21.15.35:0/1860151824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168abe0 msgr2=0x557ea168e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:41.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168abe0 0x557ea168e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:41.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 -- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168b4f0 msgr2=0x557ea168eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168b4f0 0x557ea168eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:43.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 -- 172.21.15.35:0/1860151824 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9410ee30 con 0x557ea1685960 2023-03-17T11:29:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea16914f0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f5f84011470 tx=0x7f5f84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791d63ba0c88c63e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:29:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f73fff700 1 -- 172.21.15.35:0/1860151824 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400fa00 con 0x557ea1685960 2023-03-17T11:29:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f73fff700 1 -- 172.21.15.35:0/1860151824 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f8401f430 con 0x557ea1685960 2023-03-17T11:29:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ea159a390 con 0x557ea1685960 2023-03-17T11:29:44.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5f73fff700 1 -- 172.21.15.35:0/1860151824 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f84011e50 con 0x557ea1685960 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5fa71c4b80 10 client.20853 fetch_fsmap learned FSMap version 108 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.114+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557ea1405d80 con 0x557ea1685960 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5f73fff700 1 -- 172.21.15.35:0/1860151824 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557ea159a390 con 0x557ea1685960 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5f73fff700 1 -- 172.21.15.35:0/1860151824 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f8401f990 con 0x557ea1685960 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5fa71c4b80 10 client.20853 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5fa71c4b80 10 client.20853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5fa71c4b80 20 client.20853 populate_metadata read hostname 'smithi035' 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea169f0d0 0x557ea16a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5fa71c4b80 4 client.20853 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ea15a6600 con 0x557ea169f0d0 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.115+0000 7f5f93fff700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea169f0d0 0x557ea16a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5f93fff700 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea169f0d0 0x557ea16a14e0 crc :-1 s=READY pgs=681 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56809d0cd1be2bf server_cookie=cc6322e6cf87adea in_seq=0 out_seq=0 2023-03-17T11:29:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5f73fff700 10 client.20853 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5f73fff700 1 -- 172.21.15.35:0/1860151824 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557ea15a6600 con 0x557ea169f0d0 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5f73fff700 10 client.20853 handle_command_reply: tid=0 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 client.20853 shutdown 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 msgr2=0x557ea16914f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea16914f0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f5f84011470 tx=0x7f5f84004750 comp rx=0 tx=0).stop 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 shutdown_connections 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea169f0d0 0x557ea16a14e0 crc :-1 s=READY pgs=681 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168b4f0 0x557ea168eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea1685960 0x557ea16914f0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/1860151824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea168abe0 0x557ea168e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5f73fff700 0 client.20853 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:29:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.116+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 >> 172.21.15.35:0/1860151824 conn(0x557ea14e26b0 msgr2=0x557ea1684410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.117+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 shutdown_connections 2023-03-17T11:29:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.117+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/1860151824 wait complete. 2023-03-17T11:29:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.117+0000 7f5fa71c4b80 20 client.20853 trim_cache size 0 max 16384 2023-03-17T11:29:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.131+0000 7f5fa71c4b80 1 Processor -- start 2023-03-17T11:29:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.131+0000 7f5fa71c4b80 1 -- start start 2023-03-17T11:29:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea167fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea1695ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea1691020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea167cb60 con 0x557ea168b4f0 2023-03-17T11:29:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea1680000 con 0x557ea168abe0 2023-03-17T11:29:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea1681400 con 0x557ea1685960 2023-03-17T11:29:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea1691020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea1691020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55518/0 (socket says 172.21.15.35:55518) 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 -- 172.21.15.35:0/2669502986 learned_addr learned my addr 172.21.15.35:0/2669502986 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea167fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f93fff700 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea1695ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 -- 172.21.15.35:0/2669502986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 msgr2=0x557ea167fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea167fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 -- 172.21.15.35:0/2669502986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 msgr2=0x557ea1695ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea1695ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 -- 172.21.15.35:0/2669502986 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ea159e130 con 0x557ea168b4f0 2023-03-17T11:29:51.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f995d4700 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea1691020 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c097560 tx=0x7f5f8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f388915547fff2b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.132+0000 7f5f8b7fe700 1 -- 172.21.15.35:0/2669502986 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0b3070 con 0x557ea168b4f0 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5f8b7fe700 1 -- 172.21.15.35:0/2669502986 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f8c0c5070 con 0x557ea168b4f0 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5f8b7fe700 1 -- 172.21.15.35:0/2669502986 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0c7810 con 0x557ea168b4f0 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/2669502986 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 msgr2=0x557ea1691020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea1691020 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c097560 tx=0x7f5f8c00b040 comp rx=0 tx=0).stop 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/2669502986 shutdown_connections 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea1691020 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:51.564 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea167fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/2669502986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea1695ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/2669502986 >> 172.21.15.35:0/2669502986 conn(0x557ea14e26b0 msgr2=0x557ea1684a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:29:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/2669502986 shutdown_connections 2023-03-17T11:29:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/2669502986 wait complete. 2023-03-17T11:29:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.133+0000 7f5fa71c4b80 1 -- start start 2023-03-17T11:29:54.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 Processor -- start 2023-03-17T11:29:54.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea1695ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:54.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea16960e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:54.831 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea16940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:29:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea16947a0 con 0x557ea168b4f0 2023-03-17T11:29:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea1694910 con 0x557ea168abe0 2023-03-17T11:29:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea1694ad0 con 0x557ea1685960 2023-03-17T11:29:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5fa71c4b80 10 client.0 _ll_register_callbacks cb 0x557ea147d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:29:54.832 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea16940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5f98dd3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea1695ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:55.291 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:33 smithi035 ceph-mon[92535]: pgmap v5024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:29:55.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5f98dd3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea1695ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:47286/0 (socket says 172.21.15.35:47286) 2023-03-17T11:29:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5f995d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea16940d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55524/0 (socket says 172.21.15.35:55524) 2023-03-17T11:29:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5f98dd3700 1 -- 172.21.15.35:0/555465467 learned_addr learned my addr 172.21.15.35:0/555465467 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:29:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.134+0000 7f5f93fff700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea16960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:29:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f98dd3700 1 -- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 msgr2=0x557ea16960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea16960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f98dd3700 1 -- 172.21.15.35:0/555465467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 msgr2=0x557ea16940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:29:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea16940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:29:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f98dd3700 1 -- 172.21.15.35:0/555465467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ea14595d0 con 0x557ea1685960 2023-03-17T11:29:58.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f995d4700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea16940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:29:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f98dd3700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea1695ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f84011440 tx=0x7f5f8400f6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69340f590ce8aee2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:29:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T11:29:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f73fff700 1 -- 172.21.15.35:0/555465467 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84011e50 con 0x557ea1685960 2023-03-17T11:29:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ea16551e0 con 0x557ea1685960 2023-03-17T11:29:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f73fff700 1 -- 172.21.15.35:0/555465467 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f84031490 con 0x557ea1685960 2023-03-17T11:29:58.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f73fff700 1 -- 172.21.15.35:0/555465467 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f840047c0 con 0x557ea1685960 2023-03-17T11:30:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5fa71c4b80 10 client.29845 fetch_fsmap learned FSMap version 108 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557ea142c1f0 con 0x557ea1685960 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.135+0000 7f5f73fff700 1 -- 172.21.15.35:0/555465467 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f84049020 con 0x557ea1685960 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5f73fff700 1 -- 172.21.15.35:0/555465467 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f84039070 con 0x557ea1685960 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5fa71c4b80 10 client.29845 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5fa71c4b80 10 client.29845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5fa71c4b80 20 client.29845 populate_metadata read hostname 'smithi035' 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea16f41b0 0x557ea16f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5fa71c4b80 4 client.29845 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557ea145bf00 con 0x557ea16f41b0 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5f93fff700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea16f41b0 0x557ea16f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5f73fff700 10 client.29845 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.136+0000 7f5f93fff700 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea16f41b0 0x557ea16f65c0 crc :-1 s=READY pgs=682 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e1d23839dc0f04 server_cookie=eca2cdf2b6766476 in_seq=0 out_seq=0 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.148+0000 7f5f73fff700 1 -- 172.21.15.35:0/555465467 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557ea145bf00 con 0x557ea16f41b0 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.148+0000 7f5f73fff700 10 client.29845 handle_command_reply: tid=0 2023-03-17T11:30:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 client.29845 shutdown 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 msgr2=0x557ea1695ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea1695ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f84011440 tx=0x7f5f8400f6f0 comp rx=0 tx=0).stop 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 shutdown_connections 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557ea16f41b0 0x557ea16f65c0 crc :-1 s=READY pgs=682 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557ea168b4f0 0x557ea16940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ea1685960 0x557ea1695ba0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5f73fff700 0 client.29845 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 --2- 172.21.15.35:0/555465467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557ea168abe0 0x557ea16960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 >> 172.21.15.35:0/555465467 conn(0x557ea14e26b0 msgr2=0x557ea168e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 shutdown_connections 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 1 -- 172.21.15.35:0/555465467 wait complete. 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.149+0000 7f5fa71c4b80 20 client.29845 trim_cache size 0 max 16384 2023-03-17T11:30:00.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 msgr2=0x7f5f800a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:03.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400bc10 tx=0x7f5f8400b5f0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 msgr2=0x7f5f941a2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f941a2160 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007ee0 tx=0x7f5f8c00d3b0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 shutdown_connections 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f941a2160 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 --2- 172.21.15.35:0/3047638753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f94197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 >> 172.21.15.35:0/3047638753 conn(0x7f5f94076330 msgr2=0x7f5f940fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 shutdown_connections 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:32.150+0000 7f5f9b037700 1 -- 172.21.15.35:0/3047638753 wait complete. 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 -- 172.21.15.35:0/35244518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 msgr2=0x7f275010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 --2- 172.21.15.35:0/35244518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f275010bf60 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f274800b0d0 tx=0x7f274800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 -- 172.21.15.35:0/35244518 shutdown_connections 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 --2- 172.21.15.35:0/35244518 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f275010bf60 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 --2- 172.21.15.35:0/35244518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27500ff350 0x7f27500ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 --2- 172.21.15.35:0/35244518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500ffcf0 0x7f2750103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 -- 172.21.15.35:0/35244518 >> 172.21.15.35:0/35244518 conn(0x7f2750076330 msgr2=0x7f2750076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 -- 172.21.15.35:0/35244518 shutdown_connections 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.273+0000 7f275640d700 1 -- 172.21.15.35:0/35244518 wait complete. 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.274+0000 7f275640d700 1 Processor -- start 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.274+0000 7f275640d700 1 -- start start 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f275640d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27500ff350 0x7f27501951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f275640d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500ffcf0 0x7f27501956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f275640d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f2750199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f275640d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275019a190 con 0x7f2750104390 2023-03-17T11:30:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f275640d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275019a300 con 0x7f27500ffcf0 2023-03-17T11:30:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f275640d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275019a4c0 con 0x7f27500ff350 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f2750199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f2750199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55548/0 (socket says 172.21.15.35:55548) 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 -- 172.21.15.35:0/3486210634 learned_addr learned my addr 172.21.15.35:0/3486210634 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f274f7fe700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500ffcf0 0x7f27501956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f274ffff700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27500ff350 0x7f27501951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 -- 172.21.15.35:0/3486210634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27500ff350 msgr2=0x7f27501951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27500ff350 0x7f27501951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 -- 172.21.15.35:0/3486210634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500ffcf0 msgr2=0x7f27501956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500ffcf0 0x7f27501956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 -- 172.21.15.35:0/3486210634 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009d00 con 0x7f2750104390 2023-03-17T11:30:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.275+0000 7f27549aa700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f2750199b50 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f2748008ec0 tx=0x7f2748008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.276+0000 7f274d7fa700 1 -- 172.21.15.35:0/3486210634 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800e040 con 0x7f2750104390 2023-03-17T11:30:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.276+0000 7f274d7fa700 1 -- 172.21.15.35:0/3486210634 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f274800be30 con 0x7f2750104390 2023-03-17T11:30:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.276+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275010efc0 con 0x7f2750104390 2023-03-17T11:30:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.276+0000 7f274d7fa700 1 -- 172.21.15.35:0/3486210634 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274801b6c0 con 0x7f2750104390 2023-03-17T11:30:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.276+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275010ee30 con 0x7f2750104390 2023-03-17T11:30:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.278+0000 7f274d7fa700 1 -- 172.21.15.35:0/3486210634 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2748024410 con 0x7f2750104390 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.279+0000 7f274d7fa700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f273809f640 0x7f27380a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.279+0000 7f274d7fa700 1 -- 172.21.15.35:0/3486210634 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f27480cb7f0 con 0x7f2750104390 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.279+0000 7f274ffff700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f273809f640 0x7f27380a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.279+0000 7f274ffff700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f273809f640 0x7f27380a1af0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2740005ea0 tx=0x7f2740005e30 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 Processor -- start 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 -- start start 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab871ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 0x563ab871a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab871a960 0x563ab871ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8621010 con 0x563ab87204f0 2023-03-17T11:30:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8673950 con 0x563ab871fbe0 2023-03-17T11:30:12.124 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f276259ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab866cde0 con 0x563ab871a960 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 0x563ab871a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 0x563ab871a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55554/0 (socket says 172.21.15.35:55554) 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274f7fe700 1 -- 172.21.15.35:0/837119725 learned_addr learned my addr 172.21.15.35:0/837119725 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274ffff700 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab871ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f27549aa700 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab871a960 0x563ab871ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274f7fe700 1 -- 172.21.15.35:0/837119725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab871a960 msgr2=0x563ab871ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274f7fe700 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab871a960 0x563ab871ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.280+0000 7f274f7fe700 1 -- 172.21.15.35:0/837119725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 msgr2=0x563ab871ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f274f7fe700 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab871ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:12.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f274f7fe700 1 -- 172.21.15.35:0/837119725 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ab84ee5d0 con 0x563ab87204f0 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f274ffff700 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab871ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f274f7fe700 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 0x563ab871a420 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f2744009c30 tx=0x7f2744009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45958d05a4a2a8c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f27367fc700 1 -- 172.21.15.35:0/837119725 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744011dc0 con 0x563ab87204f0 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f27367fc700 1 -- 172.21.15.35:0/837119725 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27440044e0 con 0x563ab87204f0 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.281+0000 7f27367fc700 1 -- 172.21.15.35:0/837119725 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744005280 con 0x563ab87204f0 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 -- 172.21.15.35:0/837119725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 msgr2=0x563ab871a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 0x563ab871a420 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f2744009c30 tx=0x7f2744009f40 comp rx=0 tx=0).stop 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 -- 172.21.15.35:0/837119725 shutdown_connections 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab871a960 0x563ab871ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab871ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 --2- 172.21.15.35:0/837119725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab87204f0 0x563ab871a420 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 -- 172.21.15.35:0/837119725 >> 172.21.15.35:0/837119725 conn(0x563ab85776b0 msgr2=0x563ab8714a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 -- 172.21.15.35:0/837119725 shutdown_connections 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 -- 172.21.15.35:0/837119725 wait complete. 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 -- start start 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.282+0000 7f276259ab80 1 Processor -- start 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab8726430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab87236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8723cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab84f08c0 con 0x563ab871a960 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8724430 con 0x563ab871fbe0 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8730000 con 0x563ab87204f0 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 10 client.0 _ll_register_callbacks cb 0x563ab8512230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab8726430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab8726430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55558/0 (socket says 172.21.15.35:55558) 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 -- 172.21.15.35:0/4178934689 learned_addr learned my addr 172.21.15.35:0/4178934689 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274f7fe700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab87236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 -- 172.21.15.35:0/4178934689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 msgr2=0x563ab8723cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f27549aa700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8723cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8723cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 -- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 msgr2=0x563ab87236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab87236b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 -- 172.21.15.35:0/4178934689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27440098e0 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f27549aa700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8723cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f274ffff700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab8726430 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f274000a9e0 tx=0x7f27400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0738d5f82db546 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f272f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f272f7fe700 1 -- 172.21.15.35:0/4178934689 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000e9c0 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f272f7fe700 1 -- 172.21.15.35:0/4178934689 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f274000fc60 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.283+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ab862f390 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f272f7fe700 1 -- 172.21.15.35:0/4178934689 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2740010e70 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 10 client.20871 fetch_fsmap learned FSMap version 108 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563ab849ad80 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f272f7fe700 1 -- 172.21.15.35:0/4178934689 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563ab862f390 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f272f7fe700 1 -- 172.21.15.35:0/4178934689 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2740024020 con 0x563ab871a960 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 10 client.20871 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:30:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 10 client.20871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:30:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 20 client.20871 populate_metadata read hostname 'smithi035' 2023-03-17T11:30:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab87340e0 0x563ab87364f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:13.894 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:35 smithi035 ceph-mon[92535]: pgmap v5025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 4 client.20871 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:30:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ab863b600 con 0x563ab87340e0 2023-03-17T11:30:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.284+0000 7f274f7fe700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab87340e0 0x563ab87364f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.285+0000 7f274f7fe700 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab87340e0 0x563ab87364f0 crc :-1 s=READY pgs=683 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2107b9ba004682f2 server_cookie=d67346e9fa9faa1a in_seq=0 out_seq=0 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.285+0000 7f272f7fe700 10 client.20871 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f272f7fe700 1 -- 172.21.15.35:0/4178934689 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563ab863b600 con 0x563ab87340e0 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f272f7fe700 10 client.20871 handle_command_reply: tid=0 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 client.20871 shutdown 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 msgr2=0x563ab8726430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab8726430 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f274000a9e0 tx=0x7f27400047c0 comp rx=0 tx=0).stop 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 shutdown_connections 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab87340e0 0x563ab87364f0 crc :-1 s=READY pgs=683 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8723cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab8726430 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f272f7fe700 0 client.20871 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 --2- 172.21.15.35:0/4178934689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab87236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 >> 172.21.15.35:0/4178934689 conn(0x563ab85776b0 msgr2=0x563ab8719410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 shutdown_connections 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 1 -- 172.21.15.35:0/4178934689 wait complete. 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.286+0000 7f276259ab80 20 client.20871 trim_cache size 0 max 16384 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 Processor -- start 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 -- start start 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871a960 0x563ab872af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 0x563ab8725fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8722ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:16.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab87100f0 con 0x563ab871fbe0 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab87317b0 con 0x563ab871a960 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f276259ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab87115c0 con 0x563ab87204f0 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f274f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 0x563ab8725fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f274f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 0x563ab8725fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55568/0 (socket says 172.21.15.35:55568) 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.301+0000 7f274f7fe700 1 -- 172.21.15.35:0/3822018704 learned_addr learned my addr 172.21.15.35:0/3822018704 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f27549aa700 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8722ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274f7fe700 1 -- 172.21.15.35:0/3822018704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 msgr2=0x563ab8722ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274ffff700 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871a960 0x563ab872af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274f7fe700 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8722ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274f7fe700 1 -- 172.21.15.35:0/3822018704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871a960 msgr2=0x563ab872af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274f7fe700 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871a960 0x563ab872af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274f7fe700 1 -- 172.21.15.35:0/3822018704 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ab8633130 con 0x563ab871fbe0 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f274f7fe700 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 0x563ab8725fd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x563ab87156a0 tx=0x7f2744009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cfcd86f83f412a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f2736ffd700 1 -- 172.21.15.35:0/3822018704 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744004950 con 0x563ab871fbe0 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f2736ffd700 1 -- 172.21.15.35:0/3822018704 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2744011bc0 con 0x563ab871fbe0 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.302+0000 7f2736ffd700 1 -- 172.21.15.35:0/3822018704 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744004040 con 0x563ab871fbe0 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 -- 172.21.15.35:0/3822018704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 msgr2=0x563ab8725fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 0x563ab8725fd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x563ab87156a0 tx=0x7f2744009230 comp rx=0 tx=0).stop 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 -- 172.21.15.35:0/3822018704 shutdown_connections 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab8722ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871a960 0x563ab872af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 --2- 172.21.15.35:0/3822018704 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871fbe0 0x563ab8725fd0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 -- 172.21.15.35:0/3822018704 >> 172.21.15.35:0/3822018704 conn(0x563ab85776b0 msgr2=0x563ab8719c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 -- 172.21.15.35:0/3822018704 shutdown_connections 2023-03-17T11:30:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 -- 172.21.15.35:0/3822018704 wait complete. 2023-03-17T11:30:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 -- start start 2023-03-17T11:30:21.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.303+0000 7f276259ab80 1 Processor -- start 2023-03-17T11:30:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab872ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab8729090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab87295d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8729b10 con 0x563ab871a960 2023-03-17T11:30:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8729c80 con 0x563ab871fbe0 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ab8729df0 con 0x563ab87204f0 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 10 client.0 _ll_register_callbacks cb 0x563ab8512230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab872ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab872ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55572/0 (socket says 172.21.15.35:55572) 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 -- 172.21.15.35:0/2012800989 learned_addr learned my addr 172.21.15.35:0/2012800989 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f27549aa700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab87295d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:23.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 -- 172.21.15.35:0/2012800989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 msgr2=0x563ab87295d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab87295d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274f7fe700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab8729090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 -- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 msgr2=0x563ab8729090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab8729090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 -- 172.21.15.35:0/2012800989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274401d040 con 0x563ab871a960 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f27549aa700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab87295d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274f7fe700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab8729090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:30:23.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f274ffff700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab872ad60 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f2740005e00 tx=0x7f274001ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d7e37c71d0d3a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f272f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:30:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f272f7fe700 1 -- 172.21.15.35:0/2012800989 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000e9a0 con 0x563ab871a960 2023-03-17T11:30:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f272f7fe700 1 -- 172.21.15.35:0/2012800989 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f274001e7a0 con 0x563ab871a960 2023-03-17T11:30:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.304+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ab86ea1e0 con 0x563ab871a960 2023-03-17T11:30:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f272f7fe700 1 -- 172.21.15.35:0/2012800989 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274000f6a0 con 0x563ab871a960 2023-03-17T11:30:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 10 client.20877 fetch_fsmap learned FSMap version 108 2023-03-17T11:30:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563ab84c11f0 con 0x563ab871a960 2023-03-17T11:30:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f272f7fe700 1 -- 172.21.15.35:0/2012800989 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563ab86ea1e0 con 0x563ab871a960 2023-03-17T11:30:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f272f7fe700 1 -- 172.21.15.35:0/2012800989 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2740024040 con 0x563ab871a960 2023-03-17T11:30:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 10 client.20877 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:30:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 10 client.20877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:30:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 20 client.20877 populate_metadata read hostname 'smithi035' 2023-03-17T11:30:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab878d860 0x563ab878fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 4 client.20877 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:30:28.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563ab84f0f00 con 0x563ab878d860 2023-03-17T11:30:28.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.305+0000 7f274f7fe700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab878d860 0x563ab878fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:28.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.306+0000 7f274f7fe700 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab878d860 0x563ab878fc70 crc :-1 s=READY pgs=684 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450fe295178b0b82 server_cookie=7242e42dc21b3cbf in_seq=0 out_seq=0 2023-03-17T11:30:28.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.306+0000 7f272f7fe700 10 client.20877 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.317+0000 7f272f7fe700 1 -- 172.21.15.35:0/2012800989 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563ab84f0f00 con 0x563ab878d860 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.317+0000 7f272f7fe700 10 client.20877 handle_command_reply: tid=0 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.317+0000 7f276259ab80 1 client.20877 shutdown 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 msgr2=0x563ab872ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab872ad60 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f2740005e00 tx=0x7f274001ed60 comp rx=0 tx=0).stop 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 shutdown_connections 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563ab878d860 0x563ab878fc70 crc :-1 s=READY pgs=684 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563ab87204f0 0x563ab87295d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563ab871a960 0x563ab872ad60 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 --2- 172.21.15.35:0/2012800989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ab871fbe0 0x563ab8729090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 >> 172.21.15.35:0/2012800989 conn(0x563ab85776b0 msgr2=0x563ab871d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f272f7fe700 0 client.20877 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 shutdown_connections 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 1 -- 172.21.15.35:0/2012800989 wait complete. 2023-03-17T11:30:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f276259ab80 20 client.20877 trim_cache size 0 max 16384 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f273809f640 msgr2=0x7f27380a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f273809f640 0x7f27380a1af0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2740005ea0 tx=0x7f2740005e30 comp rx=0 tx=0).stop 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 msgr2=0x7f2750199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f2750199b50 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f2748008ec0 tx=0x7f2748008ef0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 shutdown_connections 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f273809f640 0x7f27380a1af0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2750104390 0x7f2750199b50 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27500ff350 0x7f27501951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 --2- 172.21.15.35:0/3486210634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27500ffcf0 0x7f27501956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.318+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 >> 172.21.15.35:0/3486210634 conn(0x7f2750076330 msgr2=0x7f27500fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.319+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 shutdown_connections 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:45.319+0000 7f275640d700 1 -- 172.21.15.35:0/3486210634 wait complete. 2023-03-17T11:30:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.436+0000 7f9d14a2d700 1 -- 172.21.15.35:0/3974347615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d10100820 msgr2=0x7f9d10103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.436+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/3974347615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d10100820 0x7f9d10103d80 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009990 tx=0x7f9d04009ca0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 -- 172.21.15.35:0/3974347615 shutdown_connections 2023-03-17T11:30:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/3974347615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10104490 0x7f9d1010c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/3974347615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d100fff10 0x7f9d101002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/3974347615 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d10100820 0x7f9d10103d80 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 -- 172.21.15.35:0/3974347615 >> 172.21.15.35:0/3974347615 conn(0x7f9d10076270 msgr2=0x7f9d10076670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 -- 172.21.15.35:0/3974347615 shutdown_connections 2023-03-17T11:30:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 -- 172.21.15.35:0/3974347615 wait complete. 2023-03-17T11:30:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 Processor -- start 2023-03-17T11:30:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 -- start start 2023-03-17T11:30:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.437+0000 7f9d14a2d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 0x7f9d101970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10100820 0x7f9d10197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10104490 0x7f9d101a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10197f20 con 0x7f9d100fff10 2023-03-17T11:30:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101a2690 con 0x7f9d10100820 2023-03-17T11:30:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101a2800 con 0x7f9d10104490 2023-03-17T11:30:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 0x7f9d101970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 0x7f9d101970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55586/0 (socket says 172.21.15.35:55586) 2023-03-17T11:30:34.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 -- 172.21.15.35:0/1890474762 learned_addr learned my addr 172.21.15.35:0/1890474762 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:34.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10100820 0x7f9d10197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:34.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0ed9d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10104490 0x7f9d101a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 -- 172.21.15.35:0/1890474762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10104490 msgr2=0x7f9d101a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10104490 0x7f9d101a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 -- 172.21.15.35:0/1890474762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10100820 msgr2=0x7f9d10197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10100820 0x7f9d10197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 -- 172.21.15.35:0/1890474762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040095f0 con 0x7f9d100fff10 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10100820 0x7f9d10197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 0x7f9d101970d0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000d950 tx=0x7f9d0000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9cff7fe700 1 -- 172.21.15.35:0/1890474762 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00009b40 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1010f070 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9cff7fe700 1 -- 172.21.15.35:0/1890474762 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d00009ca0 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9cff7fe700 1 -- 172.21.15.35:0/1890474762 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000f620 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.438+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1010eee0 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.441+0000 7f9cff7fe700 1 -- 172.21.15.35:0/1890474762 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9d00010460 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.442+0000 7f9cff7fe700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9cf809f640 0x7f9cf80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.442+0000 7f9cff7fe700 1 -- 172.21.15.35:0/1890474762 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d000caa20 con 0x7f9d100fff10 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.442+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9cf809f640 0x7f9cf80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.442+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9cf809f640 0x7f9cf80a1af0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b5c0 tx=0x7f9d04005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.442+0000 7f9d20bbab80 1 Processor -- start 2023-03-17T11:30:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 -- start start 2023-03-17T11:30:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 0x555e30d0d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d0dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30c14010 con 0x555e30d134f0 2023-03-17T11:30:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30c66950 con 0x555e30d0d960 2023-03-17T11:30:37.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:37 smithi035 ceph-mon[92535]: pgmap v5026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:39.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:39 smithi035 ceph-mon[92535]: pgmap v5027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:39.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:41 smithi035 ceph-mon[92535]: pgmap v5028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:39.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:43 smithi035 ceph-mon[92535]: pgmap v5029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:39.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:45 smithi035 ceph-mon[92535]: pgmap v5030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:39.765 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:47 smithi035 ceph-mon[92535]: pgmap v5031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:40.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:49 smithi035 ceph-mon[92535]: pgmap v5032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:40.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:51 smithi035 ceph-mon[92535]: pgmap v5033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:40.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:53 smithi035 ceph-mon[92535]: pgmap v5034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:40.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:55 smithi035 ceph-mon[92535]: pgmap v5035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:40.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:57 smithi035 ceph-mon[92535]: pgmap v5036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:41.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:18:59 smithi035 ceph-mon[92535]: pgmap v5037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:41.536 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:01 smithi035 ceph-mon[92535]: pgmap v5038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:41.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:03 smithi035 ceph-mon[92535]: pgmap v5039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:30:42.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:05 smithi035 ceph-mon[92535]: pgmap v5040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:30:42.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:07 smithi035 ceph-mon[92535]: pgmap v5041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:30:42.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:09 smithi035 ceph-mon[92535]: pgmap v5042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:30:42.008 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:09 smithi035 ceph-mon[92535]: osdmap e384: 12 total, 12 up, 12 in 2023-03-17T11:30:43.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:11 smithi035 ceph-mon[92535]: pgmap v5044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:30:43.144 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:13 smithi035 ceph-mon[92535]: pgmap v5045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:43.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:15 smithi035 ceph-mon[92535]: pgmap v5046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:43.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:17 smithi035 ceph-mon[92535]: pgmap v5047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:43.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:17 smithi035 ceph-mon[92535]: osdmap e385: 12 total, 12 up, 12 in 2023-03-17T11:30:43.145 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:19 smithi035 ceph-mon[92535]: pgmap v5049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T11:30:43.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:21 smithi035 ceph-mon[92535]: pgmap v5050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:43.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:30:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:30:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:30:45.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:22 smithi035 ceph-mon[92535]: pgmap v5051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-17T11:30:45.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:22 smithi035 ceph-mon[92535]: pgmap v5052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T11:30:45.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:45.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:24 smithi035 ceph-mon[92535]: pgmap v5053: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 140 B/s wr, 14 op/s 2023-03-17T11:30:45.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:26 smithi035 ceph-mon[92535]: pgmap v5054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:28 smithi035 ceph-mon[92535]: pgmap v5055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:30 smithi035 ceph-mon[92535]: pgmap v5056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:32 smithi035 ceph-mon[92535]: pgmap v5057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:34 smithi035 ceph-mon[92535]: pgmap v5058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:36 smithi035 ceph-mon[92535]: pgmap v5059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:38 smithi035 ceph-mon[92535]: pgmap v5060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:40 smithi035 ceph-mon[92535]: pgmap v5061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:42 smithi035 ceph-mon[92535]: pgmap v5062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:44 smithi035 ceph-mon[92535]: pgmap v5063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:46 smithi035 ceph-mon[92535]: pgmap v5064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:48 smithi035 ceph-mon[92535]: pgmap v5065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:50 smithi035 ceph-mon[92535]: pgmap v5066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:52 smithi035 ceph-mon[92535]: pgmap v5067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:54 smithi035 ceph-mon[92535]: pgmap v5068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:56 smithi035 ceph-mon[92535]: pgmap v5069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:19:58 smithi035 ceph-mon[92535]: pgmap v5070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:00 smithi035 ceph-mon[92535]: pgmap v5071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:02 smithi035 ceph-mon[92535]: pgmap v5072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:04 smithi035 ceph-mon[92535]: pgmap v5073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:06 smithi035 ceph-mon[92535]: pgmap v5074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:08 smithi035 ceph-mon[92535]: pgmap v5075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:10 smithi035 ceph-mon[92535]: osdmap e386: 12 total, 12 up, 12 in 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:10 smithi035 ceph-mon[92535]: pgmap v5077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:12 smithi035 ceph-mon[92535]: pgmap v5078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:14 smithi035 ceph-mon[92535]: pgmap v5079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:16 smithi035 ceph-mon[92535]: pgmap v5080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:18 smithi035 ceph-mon[92535]: osdmap e387: 12 total, 12 up, 12 in 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:18 smithi035 ceph-mon[92535]: pgmap v5082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:20 smithi035 ceph-mon[92535]: pgmap v5083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:22 smithi035 ceph-mon[92535]: pgmap v5084: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:30:47.331 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:49.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:49.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:24 smithi035 ceph-mon[92535]: pgmap v5085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:30:52.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:52.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:52.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:52.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.431 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.431 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:30:53.432 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:30:53.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:26 smithi035 ceph-mon[92535]: pgmap v5086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:30:53.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:53.433 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:55.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:55.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:55.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:30:55.477 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: pgmap v5087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: pgmap v5088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:29 smithi035 ceph-mon[92535]: pgmap v5089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T11:30:55.478 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:31 smithi035 ceph-mon[92535]: pgmap v5090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T11:30:57.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:33 smithi035 ceph-mon[92535]: pgmap v5091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T11:30:57.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:35 smithi035 ceph-mon[92535]: pgmap v5092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T11:30:57.708 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:37 smithi035 ceph-mon[92535]: pgmap v5093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30c5fde0 con 0x555e30d12be0 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 0x555e30d0d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 0x555e30d0d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55596/0 (socket says 172.21.15.35:55596) 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/1821981967 learned_addr learned my addr 172.21.15.35:0/1821981967 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0ed9d700 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d0dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/1821981967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 msgr2=0x555e30d12fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d12fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/1821981967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 msgr2=0x555e30d0dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d0dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.443+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/1821981967 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e30ae15d0 con 0x555e30d134f0 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 0x555e30d0d420 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f9d04005b20 tx=0x7f9d0401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ff5650c4fb211a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:30:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9cfcff9700 1 -- 172.21.15.35:0/1821981967 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0402b070 con 0x555e30d134f0 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9cfcff9700 1 -- 172.21.15.35:0/1821981967 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d0401e040 con 0x555e30d134f0 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9cfcff9700 1 -- 172.21.15.35:0/1821981967 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004ac0 con 0x555e30d134f0 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 -- 172.21.15.35:0/1821981967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 msgr2=0x555e30d0d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 0x555e30d0d420 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f9d04005b20 tx=0x7f9d0401f000 comp rx=0 tx=0).stop 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 -- 172.21.15.35:0/1821981967 shutdown_connections 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d0dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d12fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/1821981967 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d134f0 0x555e30d0d420 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.444+0000 7f9d20bbab80 1 -- 172.21.15.35:0/1821981967 >> 172.21.15.35:0/1821981967 conn(0x555e30b6a6b0 msgr2=0x555e30d07a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 -- 172.21.15.35:0/1821981967 shutdown_connections 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 -- 172.21.15.35:0/1821981967 wait complete. 2023-03-17T11:30:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 -- start start 2023-03-17T11:30:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 Processor -- start 2023-03-17T11:30:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d19490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d12be0 0x555e30d16710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.445+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d16d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:30:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30ae38c0 con 0x555e30d0d960 2023-03-17T11:30:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d17500 con 0x555e30d12be0 2023-03-17T11:30:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d22fa0 con 0x555e30d134f0 2023-03-17T11:30:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 10 client.0 _ll_register_callbacks cb 0x555e30b05230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:30:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d19490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d19490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55600/0 (socket says 172.21.15.35:55600) 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 -- 172.21.15.35:0/3548764363 learned_addr learned my addr 172.21.15.35:0/3548764363 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0ed9d700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d16d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d12be0 0x555e30d16710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 -- 172.21.15.35:0/3548764363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 msgr2=0x555e30d16d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d16d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 -- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d12be0 msgr2=0x555e30d16710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d12be0 0x555e30d16710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 -- 172.21.15.35:0/3548764363 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1010c800 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d12be0 0x555e30d16710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d19490 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009520 tx=0x7f9d00098030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64f853b442d726e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3548764363 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000a0660 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3548764363 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d00094b80 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e30c22390 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3548764363 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d00094d40 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 10 client.20889 fetch_fsmap learned FSMap version 108 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x555e30a8dd80 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.446+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3548764363 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555e30c22390 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3548764363 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9d00097960 con 0x555e30d0d960 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d20bbab80 10 client.20889 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d20bbab80 10 client.20889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d20bbab80 20 client.20889 populate_metadata read hostname 'smithi035' 2023-03-17T11:31:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d270b0 0x555e30d294c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d20bbab80 4 client.20889 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:31:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e30c2e600 con 0x555e30d270b0 2023-03-17T11:31:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d270b0 0x555e30d294c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d270b0 0x555e30d294c0 crc :-1 s=READY pgs=685 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cd512a7de23bbca server_cookie=7105a42c0ea5b4e5 in_seq=0 out_seq=0 2023-03-17T11:31:01.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.447+0000 7f9cf5ffb700 10 client.20889 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:01.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3548764363 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555e30c2e600 con 0x555e30d270b0 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9cf5ffb700 10 client.20889 handle_command_reply: tid=0 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 client.20889 shutdown 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 msgr2=0x555e30d19490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d19490 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009520 tx=0x7f9d00098030 comp rx=0 tx=0).stop 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 shutdown_connections 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d270b0 0x555e30d294c0 crc :-1 s=READY pgs=685 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d16d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9cf5ffb700 0 client.20889 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d19490 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3548764363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d12be0 0x555e30d16710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 >> 172.21.15.35:0/3548764363 conn(0x555e30b6a6b0 msgr2=0x555e30d0c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 shutdown_connections 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3548764363 wait complete. 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.448+0000 7f9d20bbab80 20 client.20889 trim_cache size 0 max 16384 2023-03-17T11:31:01.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 Processor -- start 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 -- start start 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d1def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d19030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d134f0 0x555e30d106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d03120 con 0x555e30d0d960 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d17880 con 0x555e30d134f0 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d0d790 con 0x555e30d12be0 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d1def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d1def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55608/0 (socket says 172.21.15.35:55608) 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 -- 172.21.15.35:0/811728797 learned_addr learned my addr 172.21.15.35:0/811728797 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0ed9d700 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d134f0 0x555e30d106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 -- 172.21.15.35:0/811728797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 msgr2=0x555e30d19030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d19030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 -- 172.21.15.35:0/811728797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d134f0 msgr2=0x555e30d106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d134f0 0x555e30d106b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.552 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 -- 172.21.15.35:0/811728797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e30c26130 con 0x555e30d0d960 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0ed9d700 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d134f0 0x555e30d106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.463+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d1def0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f9d00098400 tx=0x7f9d00096a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c589c1e5980dd7f4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9cfd7fa700 1 -- 172.21.15.35:0/811728797 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000a0270 con 0x555e30d0d960 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9cfd7fa700 1 -- 172.21.15.35:0/811728797 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d000a0460 con 0x555e30d0d960 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9cfd7fa700 1 -- 172.21.15.35:0/811728797 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000986d0 con 0x555e30d0d960 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 -- 172.21.15.35:0/811728797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 msgr2=0x555e30d1def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d1def0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f9d00098400 tx=0x7f9d00096a20 comp rx=0 tx=0).stop 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 -- 172.21.15.35:0/811728797 shutdown_connections 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d134f0 0x555e30d106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d0d960 0x555e30d1def0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/811728797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d12be0 0x555e30d19030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 -- 172.21.15.35:0/811728797 >> 172.21.15.35:0/811728797 conn(0x555e30b6a6b0 msgr2=0x555e30d093d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 -- 172.21.15.35:0/811728797 shutdown_connections 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 -- 172.21.15.35:0/811728797 wait complete. 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.464+0000 7f9d20bbab80 1 -- start start 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 Processor -- start 2023-03-17T11:31:01.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d1d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 0x555e30d1de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d1bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d1c4e0 con 0x555e30d12be0 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d1c650 con 0x555e30d0d960 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e30d1c810 con 0x555e30d134f0 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d20bbab80 10 client.0 _ll_register_callbacks cb 0x555e30b05230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 0x555e30d1de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 0x555e30d1de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55616/0 (socket says 172.21.15.35:55616) 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/3240531552 learned_addr learned my addr 172.21.15.35:0/3240531552 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d1d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0ed9d700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d1bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/3240531552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 msgr2=0x555e30d1bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:01.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d1bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 msgr2=0x555e30d1d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d1d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 -- 172.21.15.35:0/3240531552 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e30a8dd80 con 0x555e30d12be0 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9d0dd9b700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 0x555e30d1de20 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009990 tx=0x7f9d04009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9d37fab9190527 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.465+0000 7f9cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3240531552 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0402b040 con 0x555e30d12be0 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3240531552 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(359..359 src has 1..359) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9d040364c0 con 0x555e30d12be0 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e30cdd1e0 con 0x555e30d12be0 2023-03-17T11:31:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3240531552 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d04005260 con 0x555e30d12be0 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 10 client.20895 fetch_fsmap learned FSMap version 108 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x555e30ab41f0 con 0x555e30d12be0 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3240531552 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555e30cdd1e0 con 0x555e30d12be0 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3240531552 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9d04004600 con 0x555e30d12be0 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 10 client.20895 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 10 client.20895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 20 client.20895 populate_metadata read hostname 'smithi035' 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d7bc90 0x555e30d7e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 4 client.20895 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555e30ae3f00 con 0x555e30d7bc90 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.466+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d7bc90 0x555e30d7e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.467+0000 7f9cf5ffb700 10 client.20895 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.467+0000 7f9d0e59c700 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d7bc90 0x555e30d7e0a0 crc :-1 s=READY pgs=686 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf80e6b25152d8b9 server_cookie=babb533855bec490 in_seq=0 out_seq=0 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9cf5ffb700 1 -- 172.21.15.35:0/3240531552 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555e30ae3f00 con 0x555e30d7bc90 2023-03-17T11:31:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9cf5ffb700 10 client.20895 handle_command_reply: tid=0 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 client.20895 shutdown 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 msgr2=0x555e30d1de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 0x555e30d1de20 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009990 tx=0x7f9d04009ca0 comp rx=0 tx=0).stop 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 shutdown_connections 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555e30d7bc90 0x555e30d7e0a0 crc :-1 s=READY pgs=686 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e30d134f0 0x555e30d1bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9cf5ffb700 0 client.20895 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e30d0d960 0x555e30d1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 --2- 172.21.15.35:0/3240531552 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555e30d12be0 0x555e30d1de20 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 >> 172.21.15.35:0/3240531552 conn(0x555e30b6a6b0 msgr2=0x555e30d106b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 shutdown_connections 2023-03-17T11:31:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 1 -- 172.21.15.35:0/3240531552 wait complete. 2023-03-17T11:31:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.474+0000 7f9d20bbab80 20 client.20895 trim_cache size 0 max 16384 2023-03-17T11:31:05.572 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:39 smithi035 ceph-mon[92535]: pgmap v5094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:31:07.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9cf809f640 msgr2=0x7f9cf80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9cf809f640 0x7f9cf80a1af0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b5c0 tx=0x7f9d04005fb0 comp rx=0 tx=0).stop 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 msgr2=0x7f9d101970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 0x7f9d101970d0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000d950 tx=0x7f9d0000dd10 comp rx=0 tx=0).stop 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 shutdown_connections 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f9cf809f640 0x7f9cf80a1af0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10104490 0x7f9d101a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9d100fff10 0x7f9d101970d0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 --2- 172.21.15.35:0/1890474762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d10100820 0x7f9d10197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 >> 172.21.15.35:0/1890474762 conn(0x7f9d10076270 msgr2=0x7f9d100fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 shutdown_connections 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:06:58.475+0000 7f9d14a2d700 1 -- 172.21.15.35:0/1890474762 wait complete. 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 -- 172.21.15.35:0/2801824168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ff3b0 msgr2=0x7f27600ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:07.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 --2- 172.21.15.35:0/2801824168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ff3b0 0x7f27600ff780 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f27540099c0 tx=0x7f2754009cd0 comp rx=0 tx=0).stop 2023-03-17T11:31:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 -- 172.21.15.35:0/2801824168 shutdown_connections 2023-03-17T11:31:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 --2- 172.21.15.35:0/2801824168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27601043f0 0x7f276010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 --2- 172.21.15.35:0/2801824168 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ff3b0 0x7f27600ff780 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 --2- 172.21.15.35:0/2801824168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27600ffd50 0x7f2760103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 -- 172.21.15.35:0/2801824168 >> 172.21.15.35:0/2801824168 conn(0x7f2760075f60 msgr2=0x7f2760076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 -- 172.21.15.35:0/2801824168 shutdown_connections 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 -- 172.21.15.35:0/2801824168 wait complete. 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 Processor -- start 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.596+0000 7f27671b5700 1 -- start start 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f27671b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27600ff3b0 0x7f2760196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f27671b5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 0x7f2760196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f27671b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27601043f0 0x7f276019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f27671b5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276019b2f0 con 0x7f27600ffd50 2023-03-17T11:31:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f27671b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276019b460 con 0x7f27601043f0 2023-03-17T11:31:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f27671b5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276019b620 con 0x7f27600ff3b0 2023-03-17T11:31:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f275ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 0x7f2760196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f275ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 0x7f2760196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55630/0 (socket says 172.21.15.35:55630) 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27600ff3b0 0x7f2760196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f275ffff700 1 -- 172.21.15.35:0/371621236 learned_addr learned my addr 172.21.15.35:0/371621236 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2765752700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27601043f0 0x7f276019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 -- 172.21.15.35:0/371621236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27601043f0 msgr2=0x7f276019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27601043f0 0x7f276019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 -- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 msgr2=0x7f2760196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 0x7f2760196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 -- 172.21.15.35:0/371621236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540095f0 con 0x7f27600ff3b0 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f275ffff700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 0x7f2760196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:31:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.597+0000 7f2764f51700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27600ff3b0 0x7f2760196310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27540036c0 tx=0x7f2754004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:10.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.598+0000 7f275dffb700 1 -- 172.21.15.35:0/371621236 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275401d070 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.598+0000 7f275dffb700 1 -- 172.21.15.35:0/371621236 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2754004c70 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.598+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276010f060 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.598+0000 7f275dffb700 1 -- 172.21.15.35:0/371621236 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754003af0 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.598+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276010eed0 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.600+0000 7f275dffb700 1 -- 172.21.15.35:0/371621236 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2754005020 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.601+0000 7f275dffb700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f27500b0650 0x7f27500b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.601+0000 7f275dffb700 1 -- 172.21.15.35:0/371621236 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(360..360 src has 1..360) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f27540cb0a0 con 0x7f27600ff3b0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.601+0000 7f275ffff700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f27500b0650 0x7f27500b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.601+0000 7f275ffff700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f27500b0650 0x7f27500b2b00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2760197920 tx=0x7f274c00b460 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.601+0000 7f2773342b80 1 Processor -- start 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 -- start start 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 0x559347a55430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a55970 0x559347a55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55934793a010 con 0x559347a5a680 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55934798c950 con 0x559347a55970 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2773342b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347985de0 con 0x559347a59d70 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 0x559347a55430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 0x559347a55430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55638/0 (socket says 172.21.15.35:55638) 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 -- 172.21.15.35:0/4024108721 learned_addr learned my addr 172.21.15.35:0/4024108721 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2764f51700 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2765752700 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a55970 0x559347a55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 -- 172.21.15.35:0/4024108721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 msgr2=0x559347a5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 -- 172.21.15.35:0/4024108721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a55970 msgr2=0x559347a55da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a55970 0x559347a55da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 -- 172.21.15.35:0/4024108721 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593478075d0 con 0x559347a5a680 2023-03-17T11:31:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f2765752700 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a55970 0x559347a55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.602+0000 7f275ffff700 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 0x559347a55430 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f274c0117f0 tx=0x7f274c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d26478383b6ed7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f274affd700 1 -- 172.21.15.35:0/4024108721 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c01e620 con 0x559347a5a680 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f274affd700 1 -- 172.21.15.35:0/4024108721 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f274c015070 con 0x559347a5a680 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f274affd700 1 -- 172.21.15.35:0/4024108721 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c01ca80 con 0x559347a5a680 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 -- 172.21.15.35:0/4024108721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 msgr2=0x559347a55430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 0x559347a55430 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f274c0117f0 tx=0x7f274c013000 comp rx=0 tx=0).stop 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 -- 172.21.15.35:0/4024108721 shutdown_connections 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a55970 0x559347a55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 --2- 172.21.15.35:0/4024108721 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a5a680 0x559347a55430 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 -- 172.21.15.35:0/4024108721 >> 172.21.15.35:0/4024108721 conn(0x5593478906b0 msgr2=0x559347a2da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 -- 172.21.15.35:0/4024108721 shutdown_connections 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.603+0000 7f2773342b80 1 -- 172.21.15.35:0/4024108721 wait complete. 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 -- start start 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 Processor -- start 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a35670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a35bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593478098c0 con 0x559347a55970 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a31020 con 0x559347a59d70 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a311e0 con 0x559347a5a680 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2773342b80 10 client.0 _ll_register_callbacks cb 0x55934782b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2764f51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a35670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2764f51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a35670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55642/0 (socket says 172.21.15.35:55642) 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2764f51700 1 -- 172.21.15.35:0/3413130877 learned_addr learned my addr 172.21.15.35:0/3413130877 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.604+0000 7f2765752700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f275ffff700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a35bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2764f51700 1 -- 172.21.15.35:0/3413130877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 msgr2=0x559347a30940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2764f51700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a30940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2764f51700 1 -- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 msgr2=0x559347a35bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2764f51700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a35bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2764f51700 1 -- 172.21.15.35:0/3413130877 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c0114a0 con 0x559347a55970 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2765752700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a30940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f275ffff700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a35bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2764f51700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a35670 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f27540c8860 tx=0x7f2754098800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2221e23a348fb913 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f273ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f273ffff700 1 -- 172.21.15.35:0/3413130877 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540a0d10 con 0x559347a55970 2023-03-17T11:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f273ffff700 1 -- 172.21.15.35:0/3413130877 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(360..360 src has 1..360) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f2754099020 con 0x559347a55970 2023-03-17T11:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559347948390 con 0x559347a55970 2023-03-17T11:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f273ffff700 1 -- 172.21.15.35:0/3413130877 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27540980a0 con 0x559347a55970 2023-03-17T11:31:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 10 client.20907 fetch_fsmap learned FSMap version 108 2023-03-17T11:31:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5593477b3d80 con 0x559347a55970 2023-03-17T11:31:20.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f273ffff700 1 -- 172.21.15.35:0/3413130877 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2754063080 con 0x559347a55970 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f273ffff700 1 -- 172.21.15.35:0/3413130877 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f27540c8330 con 0x559347a55970 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 10 client.20907 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 10 client.20907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 20 client.20907 populate_metadata read hostname 'smithi035' 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.605+0000 7f2773342b80 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347a40a00 0x559347a42e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.606+0000 7f2773342b80 4 client.20907 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.606+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559347954600 con 0x559347a40a00 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.606+0000 7f275ffff700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347a40a00 0x559347a42e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.606+0000 7f275ffff700 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347a40a00 0x559347a42e10 crc :-1 s=READY pgs=687 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c65e53cc1c28f8ef server_cookie=e20e26a915e361dd in_seq=0 out_seq=0 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.606+0000 7f273ffff700 10 client.20907 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f273ffff700 1 -- 172.21.15.35:0/3413130877 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559347954600 con 0x559347a40a00 2023-03-17T11:31:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f273ffff700 10 client.20907 handle_command_reply: tid=0 2023-03-17T11:31:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 client.20907 shutdown 2023-03-17T11:31:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 msgr2=0x559347a35670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a35670 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f27540c8860 tx=0x7f2754098800 comp rx=0 tx=0).stop 2023-03-17T11:31:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 shutdown_connections 2023-03-17T11:31:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347a40a00 0x559347a42e10 crc :-1 s=READY pgs=687 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a30940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f273ffff700 0 client.20907 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a35670 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 --2- 172.21.15.35:0/3413130877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a35bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 >> 172.21.15.35:0/3413130877 conn(0x5593478906b0 msgr2=0x559347a58a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 shutdown_connections 2023-03-17T11:31:22.983 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 1 -- 172.21.15.35:0/3413130877 wait complete. 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.607+0000 7f2773342b80 20 client.20907 trim_cache size 0 max 16384 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 Processor -- start 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 -- start start 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a30900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a2dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a35270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a29120 con 0x559347a55970 2023-03-17T11:31:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a2f6c0 con 0x559347a59d70 2023-03-17T11:31:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2773342b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a31910 con 0x559347a5a680 2023-03-17T11:31:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2764f51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a30900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2764f51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a30900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55650/0 (socket says 172.21.15.35:55650) 2023-03-17T11:31:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.622+0000 7f2764f51700 1 -- 172.21.15.35:0/3742173573 learned_addr learned my addr 172.21.15.35:0/3742173573 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f275ffff700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a2dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2764f51700 1 -- 172.21.15.35:0/3742173573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 msgr2=0x559347a35270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2765752700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a35270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2764f51700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a35270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2764f51700 1 -- 172.21.15.35:0/3742173573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 msgr2=0x559347a2dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2764f51700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a2dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2764f51700 1 -- 172.21.15.35:0/3742173573 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55934794c130 con 0x559347a55970 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f275ffff700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a2dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2765752700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a35270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2764f51700 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a30900 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f27540950b0 tx=0x7f2754095020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfa398015c27595 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f274b7fe700 1 -- 172.21.15.35:0/3742173573 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540c2cf0 con 0x559347a55970 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f274b7fe700 1 -- 172.21.15.35:0/3742173573 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559347948390 con 0x559347a55970 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f274b7fe700 1 -- 172.21.15.35:0/3742173573 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540980a0 con 0x559347a55970 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2773342b80 1 -- 172.21.15.35:0/3742173573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 msgr2=0x559347a30900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.623+0000 7f2773342b80 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a30900 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f27540950b0 tx=0x7f2754095020 comp rx=0 tx=0).stop 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- 172.21.15.35:0/3742173573 shutdown_connections 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a5a680 0x559347a35270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a30900 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 --2- 172.21.15.35:0/3742173573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a59d70 0x559347a2dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- 172.21.15.35:0/3742173573 >> 172.21.15.35:0/3742173573 conn(0x5593478906b0 msgr2=0x559347a5d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- 172.21.15.35:0/3742173573 shutdown_connections 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- 172.21.15.35:0/3742173573 wait complete. 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- start start 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 Processor -- start 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a3a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a5a680 0x559347a37950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a37e90 con 0x559347a55970 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a38000 con 0x559347a5a680 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559347a381c0 con 0x559347a59d70 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2773342b80 10 client.0 _ll_register_callbacks cb 0x55934782b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2764f51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a3a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2764f51700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a3a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55656/0 (socket says 172.21.15.35:55656) 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.624+0000 7f2764f51700 1 -- 172.21.15.35:0/2152474113 learned_addr learned my addr 172.21.15.35:0/2152474113 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2765752700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a5a680 0x559347a37950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f275ffff700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2764f51700 1 -- 172.21.15.35:0/2152474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 msgr2=0x559347a37410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2764f51700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a37410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2764f51700 1 -- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a5a680 msgr2=0x559347a37950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2764f51700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a5a680 0x559347a37950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2764f51700 1 -- 172.21.15.35:0/2152474113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593477b3d80 con 0x559347a55970 2023-03-17T11:31:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f275ffff700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a37410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:31:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2764f51700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a3a0f0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f27540988b0 tx=0x7f27540c8810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2948b20022551cd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f273ffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:31:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f273ffff700 1 -- 172.21.15.35:0/2152474113 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540c84b0 con 0x559347a55970 2023-03-17T11:31:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f273ffff700 1 -- 172.21.15.35:0/2152474113 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(360..360 src has 1..360) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f27540982a0 con 0x559347a55970 2023-03-17T11:31:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559347a031e0 con 0x559347a55970 2023-03-17T11:31:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f273ffff700 1 -- 172.21.15.35:0/2152474113 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27540a0880 con 0x559347a55970 2023-03-17T11:31:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2773342b80 10 client.20913 fetch_fsmap learned FSMap version 108 2023-03-17T11:31:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5593477da1f0 con 0x559347a55970 2023-03-17T11:31:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.625+0000 7f273ffff700 1 -- 172.21.15.35:0/2152474113 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559347a031e0 con 0x559347a55970 2023-03-17T11:31:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f273ffff700 1 -- 172.21.15.35:0/2152474113 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f275407e070 con 0x559347a55970 2023-03-17T11:31:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f2773342b80 10 client.20913 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:31:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f2773342b80 10 client.20913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:31:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f2773342b80 20 client.20913 populate_metadata read hostname 'smithi035' 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f2773342b80 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347aa1e80 0x559347aa4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f2773342b80 4 client.20913 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559347809f00 con 0x559347aa1e80 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f275ffff700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347aa1e80 0x559347aa4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f275ffff700 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347aa1e80 0x559347aa4260 crc :-1 s=READY pgs=688 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=668fddbec4104603 server_cookie=a18886670e4041a8 in_seq=0 out_seq=0 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.626+0000 7f273ffff700 10 client.20913 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.643+0000 7f273ffff700 1 -- 172.21.15.35:0/2152474113 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559347809f00 con 0x559347aa1e80 2023-03-17T11:31:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.643+0000 7f273ffff700 10 client.20913 handle_command_reply: tid=0 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.643+0000 7f2773342b80 1 client.20913 shutdown 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 msgr2=0x559347a3a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a3a0f0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f27540988b0 tx=0x7f27540c8810 comp rx=0 tx=0).stop 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 shutdown_connections 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559347aa1e80 0x559347aa4260 crc :-1 s=READY pgs=688 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559347a5a680 0x559347a37950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559347a55970 0x559347a3a0f0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f273ffff700 0 client.20913 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 --2- 172.21.15.35:0/2152474113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559347a59d70 0x559347a37410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 >> 172.21.15.35:0/2152474113 conn(0x5593478906b0 msgr2=0x559347a5d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 shutdown_connections 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 1 -- 172.21.15.35:0/2152474113 wait complete. 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f2773342b80 20 client.20913 trim_cache size 0 max 16384 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f27500b0650 msgr2=0x7f27500b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f27500b0650 0x7f27500b2b00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2760197920 tx=0x7f274c00b460 comp rx=0 tx=0).stop 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27600ff3b0 msgr2=0x7f2760196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27600ff3b0 0x7f2760196310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27540036c0 tx=0x7f2754004730 comp rx=0 tx=0).stop 2023-03-17T11:31:33.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 shutdown_connections 2023-03-17T11:31:33.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f27500b0650 0x7f27500b2b00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:33.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27601043f0 0x7f276019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27600ff3b0 0x7f2760196310 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 --2- 172.21.15.35:0/371621236 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f27600ffd50 0x7f2760196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.644+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 >> 172.21.15.35:0/371621236 conn(0x7f2760075f60 msgr2=0x7f2760068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.645+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 shutdown_connections 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:07:11.645+0000 7f27671b5700 1 -- 172.21.15.35:0/371621236 wait complete. 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 -- 172.21.15.35:0/288620568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c0ffb60 msgr2=0x7fa53c0fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 --2- 172.21.15.35:0/288620568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c0ffb60 0x7fa53c0fff30 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009990 tx=0x7fa52c009ca0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 -- 172.21.15.35:0/288620568 shutdown_connections 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 --2- 172.21.15.35:0/288620568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa53c104460 0x7fa53c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 --2- 172.21.15.35:0/288620568 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c0ffb60 0x7fa53c0fff30 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 --2- 172.21.15.35:0/288620568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa53c100500 0x7fa53c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 -- 172.21.15.35:0/288620568 >> 172.21.15.35:0/288620568 conn(0x7fa53c074590 msgr2=0x7fa53c074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 -- 172.21.15.35:0/288620568 shutdown_connections 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 -- 172.21.15.35:0/288620568 wait complete. 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.019+0000 7fa541356700 1 Processor -- start 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 -- start start 2023-03-17T11:31:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa53c0ffb60 0x7fa53c196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa53c100500 0x7fa53c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 0x7fa53c1a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c197e30 con 0x7fa53c104460 2023-03-17T11:31:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c1a2570 con 0x7fa53c100500 2023-03-17T11:31:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa541356700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c1a2730 con 0x7fa53c0ffb60 2023-03-17T11:31:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 0x7fa53c1a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 0x7fa53c1a2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55716/0 (socket says 172.21.15.35:55716) 2023-03-17T11:31:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 -- 172.21.15.35:0/3264493361 learned_addr learned my addr 172.21.15.35:0/3264493361 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa53c100500 0x7fa53c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53affd700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa53c0ffb60 0x7fa53c196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 -- 172.21.15.35:0/3264493361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa53c0ffb60 msgr2=0x7fa53c196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa53c0ffb60 0x7fa53c196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 -- 172.21.15.35:0/3264493361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa53c100500 msgr2=0x7fa53c1974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:36.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa53c100500 0x7fa53c1974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 -- 172.21.15.35:0/3264493361 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0095f0 con 0x7fa53c104460 2023-03-17T11:31:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.020+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 0x7fa53c1a2030 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fa53400efc0 tx=0x7fa53400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.021+0000 7fa533fff700 1 -- 172.21.15.35:0/3264493361 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534018070 con 0x7fa53c104460 2023-03-17T11:31:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.021+0000 7fa533fff700 1 -- 172.21.15.35:0/3264493361 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa53400f040 con 0x7fa53c104460 2023-03-17T11:31:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.021+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c10f030 con 0x7fa53c104460 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.021+0000 7fa533fff700 1 -- 172.21.15.35:0/3264493361 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400cce0 con 0x7fa53c104460 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.021+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c10eea0 con 0x7fa53c104460 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.023+0000 7fa533fff700 1 -- 172.21.15.35:0/3264493361 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa534004ad0 con 0x7fa53c104460 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.024+0000 7fa533fff700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa52809f640 0x7fa5280a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.024+0000 7fa53affd700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa52809f640 0x7fa5280a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.024+0000 7fa533fff700 1 -- 172.21.15.35:0/3264493361 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa5340ca180 con 0x7fa53c104460 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.025+0000 7fa53affd700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa52809f640 0x7fa5280a1af0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0098e0 tx=0x7fa52c005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.025+0000 7fa54d4e3b80 1 Processor -- start 2023-03-17T11:31:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.025+0000 7fa54d4e3b80 1 -- start start 2023-03-17T11:31:40.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e3b3010 con 0x557a1e4b1be0 2023-03-17T11:31:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e405950 con 0x557a1e4b24f0 2023-03-17T11:31:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e3fede0 con 0x557a1e4ac960 2023-03-17T11:31:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55720/0 (socket says 172.21.15.35:55720) 2023-03-17T11:31:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 -- 172.21.15.35:0/685479355 learned_addr learned my addr 172.21.15.35:0/685479355 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:40.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:41.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 -- 172.21.15.35:0/685479355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 msgr2=0x557a1e4acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 -- 172.21.15.35:0/685479355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 msgr2=0x557a1e4ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 -- 172.21.15.35:0/685479355 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1e2805d0 con 0x557a1e4b1be0 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa53affd700 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b1fb0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fa52c005ae0 tx=0x7fa52c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b1d938c7914d62 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.026+0000 7fa5317fa700 1 -- 172.21.15.35:0/685479355 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c01e070 con 0x557a1e4b1be0 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa5317fa700 1 -- 172.21.15.35:0/685479355 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa52c00be80 con 0x557a1e4b1be0 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa5317fa700 1 -- 172.21.15.35:0/685479355 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0306a0 con 0x557a1e4b1be0 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/685479355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 msgr2=0x557a1e4b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b1fb0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fa52c005ae0 tx=0x7fa52c01e000 comp rx=0 tx=0).stop 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/685479355 shutdown_connections 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b1fb0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/685479355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/685479355 >> 172.21.15.35:0/685479355 conn(0x557a1e3096b0 msgr2=0x557a1e4a6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/685479355 shutdown_connections 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.027+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/685479355 wait complete. 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 -- start start 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 Processor -- start 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e2828c0 con 0x557a1e4b1be0 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e4b64b0 con 0x557a1e4b24f0 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e4c1fa0 con 0x557a1e4ac960 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa54d4e3b80 10 client.0 _ll_register_callbacks cb 0x557a1e2a4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:31:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa53a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa53a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55728/0 (socket says 172.21.15.35:55728) 2023-03-17T11:31:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa53a7fc700 1 -- 172.21.15.35:0/771347414 learned_addr learned my addr 172.21.15.35:0/771347414 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa53affd700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.028+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa53a7fc700 1 -- 172.21.15.35:0/771347414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 msgr2=0x557a1e4b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa53a7fc700 1 -- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 msgr2=0x557a1e4b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa53a7fc700 1 -- 172.21.15.35:0/771347414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c10c7b0 con 0x557a1e4b1be0 2023-03-17T11:31:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b5740 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fa524011830 tx=0x7fa524011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eff204c43473f88 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa5227fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:31:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa5227fc700 1 -- 172.21.15.35:0/771347414 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52400f9f0 con 0x557a1e4b1be0 2023-03-17T11:31:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a1e3c1390 con 0x557a1e4b1be0 2023-03-17T11:31:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa5227fc700 1 -- 172.21.15.35:0/771347414 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa52400fb50 con 0x557a1e4b1be0 2023-03-17T11:31:44.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa5227fc700 1 -- 172.21.15.35:0/771347414 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa52400fd10 con 0x557a1e4b1be0 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa54d4e3b80 10 client.20943 fetch_fsmap learned FSMap version 108 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557a1e22cd80 con 0x557a1e4b1be0 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa5227fc700 1 -- 172.21.15.35:0/771347414 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a1e3c1390 con 0x557a1e4b1be0 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa5227fc700 1 -- 172.21.15.35:0/771347414 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa524021370 con 0x557a1e4b1be0 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa54d4e3b80 10 client.20943 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.029+0000 7fa54d4e3b80 10 client.20943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa54d4e3b80 20 client.20943 populate_metadata read hostname 'smithi035' 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e4c60d0 0x557a1e4c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa54d4e3b80 4 client.20943 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a1e3cd600 con 0x557a1e4c60d0 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa53affd700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e4c60d0 0x557a1e4c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa5227fc700 10 client.20943 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.030+0000 7fa53affd700 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e4c60d0 0x557a1e4c84e0 crc :-1 s=READY pgs=691 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c05bcdae94cf64a server_cookie=ceb4721f16923e7a in_seq=0 out_seq=0 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa5227fc700 1 -- 172.21.15.35:0/771347414 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557a1e3cd600 con 0x557a1e4c60d0 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa5227fc700 10 client.20943 handle_command_reply: tid=0 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 client.20943 shutdown 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 msgr2=0x557a1e4b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b5740 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fa524011830 tx=0x7fa524011b40 comp rx=0 tx=0).stop 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 shutdown_connections 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e4c60d0 0x557a1e4c84e0 crc :-1 s=READY pgs=691 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4ac960 0x557a1e4b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/771347414 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4b5740 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa5227fc700 0 client.20943 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 >> 172.21.15.35:0/771347414 conn(0x557a1e3096b0 msgr2=0x557a1e4ab410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 shutdown_connections 2023-03-17T11:31:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/771347414 wait complete. 2023-03-17T11:31:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.031+0000 7fa54d4e3b80 20 client.20943 trim_cache size 0 max 16384 2023-03-17T11:31:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 Processor -- start 2023-03-17T11:31:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 -- start start 2023-03-17T11:31:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 0x557a1e4a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b1be0 0x557a1e4bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e4a7e40 con 0x557a1e4ac960 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e3cd600 con 0x557a1e4b24f0 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e4a20f0 con 0x557a1e4b1be0 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa53affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 0x557a1e4a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa53affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 0x557a1e4a6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55734/0 (socket says 172.21.15.35:55734) 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.046+0000 7fa53affd700 1 -- 172.21.15.35:0/1077497942 learned_addr learned my addr 172.21.15.35:0/1077497942 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b1be0 0x557a1e4bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53affd700 1 -- 172.21.15.35:0/1077497942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b1be0 msgr2=0x557a1e4bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53affd700 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b1be0 0x557a1e4bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53affd700 1 -- 172.21.15.35:0/1077497942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 msgr2=0x557a1e4b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:47.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53affd700 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53affd700 1 -- 172.21.15.35:0/1077497942 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1e4ad000 con 0x557a1e4ac960 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa53affd700 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 0x557a1e4a6ac0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009990 tx=0x7fa52c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d7f75a1e03fae1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa531ffb700 1 -- 172.21.15.35:0/1077497942 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c035040 con 0x557a1e4ac960 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa531ffb700 1 -- 172.21.15.35:0/1077497942 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa52c0395e0 con 0x557a1e4ac960 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.047+0000 7fa531ffb700 1 -- 172.21.15.35:0/1077497942 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c039770 con 0x557a1e4ac960 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/1077497942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 msgr2=0x557a1e4a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 0x557a1e4a6ac0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009990 tx=0x7fa52c005780 comp rx=0 tx=0).stop 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/1077497942 shutdown_connections 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4b24f0 0x557a1e4b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4ac960 0x557a1e4a6ac0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/1077497942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b1be0 0x557a1e4bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/1077497942 >> 172.21.15.35:0/1077497942 conn(0x557a1e3096b0 msgr2=0x557a1e4aba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/1077497942 shutdown_connections 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/1077497942 wait complete. 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- start start 2023-03-17T11:31:47.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 Processor -- start 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4ac960 0x557a1e4baed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4bb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b24f0 0x557a1e4bb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e519080 con 0x557a1e4b1be0 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e5191f0 con 0x557a1e4ac960 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.048+0000 7fa54d4e3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1e5193b0 con 0x557a1e4b24f0 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa54d4e3b80 10 client.0 _ll_register_callbacks cb 0x557a1e2a4230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4bb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55742/0 (socket says 172.21.15.35:55742) 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 -- 172.21.15.35:0/109351410 learned_addr learned my addr 172.21.15.35:0/109351410 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53b7fe700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b24f0 0x557a1e4bb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53affd700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4ac960 0x557a1e4baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 -- 172.21.15.35:0/109351410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b24f0 msgr2=0x557a1e4bb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b24f0 0x557a1e4bb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 -- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4ac960 msgr2=0x557a1e4baed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:31:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4ac960 0x557a1e4baed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 -- 172.21.15.35:0/109351410 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a1e2805d0 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53affd700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4ac960 0x557a1e4baed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa53a7fc700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4bb410 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fa524000c00 tx=0x7fa524021ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925c696f98acea67 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa5227fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa5227fc700 1 -- 172.21.15.35:0/109351410 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524005450 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa5227fc700 1 -- 172.21.15.35:0/109351410 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa524000e40 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a1e47c1e0 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa5227fc700 1 -- 172.21.15.35:0/109351410 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa524021910 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa54d4e3b80 10 client.20949 fetch_fsmap learned FSMap version 108 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.049+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557a1e215c00 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa5227fc700 1 -- 172.21.15.35:0/109351410 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a1e47c1e0 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa5227fc700 1 -- 172.21.15.35:0/109351410 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa524023470 con 0x557a1e4b1be0 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa54d4e3b80 10 client.20949 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa54d4e3b80 10 client.20949 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:31:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa54d4e3b80 20 client.20949 populate_metadata read hostname 'smithi035' 2023-03-17T11:31:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e51aa80 0x557a1e51ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa54d4e3b80 4 client.20949 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a1e282f00 con 0x557a1e51aa80 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa53affd700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e51aa80 0x557a1e51ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa5227fc700 10 client.20949 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.050+0000 7fa53affd700 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e51aa80 0x557a1e51ce60 crc :-1 s=READY pgs=692 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83c7f121686f34 server_cookie=4c3dd8552f955c5f in_seq=0 out_seq=0 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa5227fc700 1 -- 172.21.15.35:0/109351410 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a1e282f00 con 0x557a1e51aa80 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa5227fc700 10 client.20949 handle_command_reply: tid=0 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 client.20949 shutdown 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 msgr2=0x557a1e4bb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4bb410 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fa524000c00 tx=0x7fa524021ee0 comp rx=0 tx=0).stop 2023-03-17T11:31:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 shutdown_connections 2023-03-17T11:31:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557a1e51aa80 0x557a1e51ce60 crc :-1 s=READY pgs=692 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a1e4b24f0 0x557a1e4bb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa5227fc700 0 client.20949 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557a1e4ac960 0x557a1e4baed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 --2- 172.21.15.35:0/109351410 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557a1e4b1be0 0x557a1e4bb410 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.067+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 >> 172.21.15.35:0/109351410 conn(0x557a1e3096b0 msgr2=0x557a1e4b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 shutdown_connections 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa54d4e3b80 1 -- 172.21.15.35:0/109351410 wait complete. 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa54d4e3b80 20 client.20949 trim_cache size 0 max 16384 2023-03-17T11:31:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa52809f640 msgr2=0x7fa5280a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa52809f640 0x7fa5280a1af0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0098e0 tx=0x7fa52c005fb0 comp rx=0 tx=0).stop 2023-03-17T11:31:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 msgr2=0x7fa53c1a2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 0x7fa53c1a2030 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fa53400efc0 tx=0x7fa53400c3a0 comp rx=0 tx=0).stop 2023-03-17T11:31:50.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 shutdown_connections 2023-03-17T11:31:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa52809f640 0x7fa5280a1af0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:50.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa53c104460 0x7fa53c1a2030 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa53c0ffb60 0x7fa53c196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 --2- 172.21.15.35:0/3264493361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa53c100500 0x7fa53c1974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 >> 172.21.15.35:0/3264493361 conn(0x7fa53c074590 msgr2=0x7fa53c0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 shutdown_connections 2023-03-17T11:31:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:37.068+0000 7fa541356700 1 -- 172.21.15.35:0/3264493361 wait complete. 2023-03-17T11:31:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 -- 172.21.15.35:0/1428898035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 msgr2=0x7f998c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:53.006 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 --2- 172.21.15.35:0/1428898035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c10bf60 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f998400b0d0 tx=0x7f998400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:31:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 -- 172.21.15.35:0/1428898035 shutdown_connections 2023-03-17T11:31:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 --2- 172.21.15.35:0/1428898035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c10bf60 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 --2- 172.21.15.35:0/1428898035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c0ff350 0x7f998c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 --2- 172.21.15.35:0/1428898035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f998c0ffcf0 0x7f998c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:31:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 -- 172.21.15.35:0/1428898035 >> 172.21.15.35:0/1428898035 conn(0x7f998c076330 msgr2=0x7f998c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:31:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 -- 172.21.15.35:0/1428898035 shutdown_connections 2023-03-17T11:31:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.190+0000 7f99918ea700 1 -- 172.21.15.35:0/1428898035 wait complete. 2023-03-17T11:31:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 Processor -- start 2023-03-17T11:31:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 -- start start 2023-03-17T11:31:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c0ff350 0x7f998c100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f998c0ffcf0 0x7f998c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c1a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:31:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c101ac0 con 0x7f998c104390 2023-03-17T11:31:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1a4a80 con 0x7f998c0ff350 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.191+0000 7f99918ea700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1a4bc0 con 0x7f998c0ffcf0 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c1a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c1a4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55758/0 (socket says 172.21.15.35:55758) 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 -- 172.21.15.35:0/1307418589 learned_addr learned my addr 172.21.15.35:0/1307418589 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998affd700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c0ff350 0x7f998c100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f998c0ffcf0 0x7f998c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:31:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 -- 172.21.15.35:0/1307418589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f998c0ffcf0 msgr2=0x7f998c101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:31:59.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f998c0ffcf0 0x7f998c101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 -- 172.21.15.35:0/1307418589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c0ff350 msgr2=0x7f998c100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c0ff350 0x7f998c100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 -- 172.21.15.35:0/1307418589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984009d00 con 0x7f998c104390 2023-03-17T11:32:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f998b7fe700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c1a4540 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9984008ec0 tx=0x7f9984008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f99908e8700 1 -- 172.21.15.35:0/1307418589 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998400e040 con 0x7f998c104390 2023-03-17T11:32:01.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:41 smithi035 ceph-mon[92535]: pgmap v5095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:01.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:43 smithi035 ceph-mon[92535]: pgmap v5096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:32:01.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:45 smithi035 ceph-mon[92535]: pgmap v5097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:32:01.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:47 smithi035 ceph-mon[92535]: pgmap v5098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:32:02.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:49 smithi035 ceph-mon[92535]: pgmap v5099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:32:02.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:51 smithi035 ceph-mon[92535]: pgmap v5100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:32:02.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:53 smithi035 ceph-mon[92535]: pgmap v5101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:32:02.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:55 smithi035 ceph-mon[92535]: pgmap v5102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:57 smithi035 ceph-mon[92535]: pgmap v5103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:20:59 smithi035 ceph-mon[92535]: pgmap v5104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:01 smithi035 ceph-mon[92535]: pgmap v5105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:03 smithi035 ceph-mon[92535]: pgmap v5106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:05 smithi035 ceph-mon[92535]: pgmap v5107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:07 smithi035 ceph-mon[92535]: pgmap v5108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:09 smithi035 ceph-mon[92535]: pgmap v5109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:09 smithi035 ceph-mon[92535]: osdmap e388: 12 total, 12 up, 12 in 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:11 smithi035 ceph-mon[92535]: pgmap v5111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:13 smithi035 ceph-mon[92535]: pgmap v5112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:15 smithi035 ceph-mon[92535]: pgmap v5113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:32:03.016 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:17 smithi035 ceph-mon[92535]: pgmap v5114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:32:03.017 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:17 smithi035 ceph-mon[92535]: osdmap e389: 12 total, 12 up, 12 in 2023-03-17T11:32:03.017 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:19 smithi035 ceph-mon[92535]: pgmap v5116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 104 B/s wr, 10 op/s 2023-03-17T11:32:03.017 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:21 smithi035 ceph-mon[92535]: pgmap v5117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:32:03.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:23 smithi035 ceph-mon[92535]: pgmap v5118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:32:03.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:25 smithi035 ceph-mon[92535]: pgmap v5119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:32:03.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:32:03.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:27 smithi035 ceph-mon[92535]: pgmap v5120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:32:03.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:28 smithi035 ceph-mon[92535]: pgmap v5121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 422 B/s wr, 10 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:28 smithi035 ceph-mon[92535]: pgmap v5122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:30 smithi035 ceph-mon[92535]: pgmap v5123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:32 smithi035 ceph-mon[92535]: pgmap v5124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:34 smithi035 ceph-mon[92535]: pgmap v5125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:36 smithi035 ceph-mon[92535]: pgmap v5126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:38 smithi035 ceph-mon[92535]: pgmap v5127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:40 smithi035 ceph-mon[92535]: pgmap v5128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:42 smithi035 ceph-mon[92535]: pgmap v5129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:44 smithi035 ceph-mon[92535]: pgmap v5130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:46 smithi035 ceph-mon[92535]: pgmap v5131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:48 smithi035 ceph-mon[92535]: pgmap v5132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:50 smithi035 ceph-mon[92535]: pgmap v5133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:52 smithi035 ceph-mon[92535]: pgmap v5134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:54 smithi035 ceph-mon[92535]: pgmap v5135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:32:03.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:56 smithi035 ceph-mon[92535]: pgmap v5136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:21:58 smithi035 ceph-mon[92535]: pgmap v5137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:32:03.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:00 smithi035 ceph-mon[92535]: pgmap v5138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:02 smithi035 ceph-mon[92535]: pgmap v5139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:32:03.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:04 smithi035 ceph-mon[92535]: pgmap v5140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:32:03.836 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:06 smithi035 ceph-mon[92535]: pgmap v5141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:32:04.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:08 smithi035 ceph-mon[92535]: pgmap v5142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:32:04.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:09 smithi035 ceph-mon[92535]: osdmap e390: 12 total, 12 up, 12 in 2023-03-17T11:32:04.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:10 smithi035 ceph-mon[92535]: pgmap v5144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:32:04.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:12 smithi035 ceph-mon[92535]: pgmap v5145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:32:04.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:14 smithi035 ceph-mon[92535]: pgmap v5146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:32:04.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:16 smithi035 ceph-mon[92535]: pgmap v5147: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:32:04.347 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:18 smithi035 ceph-mon[92535]: pgmap v5148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:32:04.516 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:18 smithi035 ceph-mon[92535]: osdmap e391: 12 total, 12 up, 12 in 2023-03-17T11:32:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:32:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:32:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:32:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:32:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:32:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:32:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:32:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:32:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:32:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:32:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:32:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c10efc0 con 0x7f998c104390 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f99908e8700 1 -- 172.21.15.35:0/1307418589 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9984003e90 con 0x7f998c104390 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f99908e8700 1 -- 172.21.15.35:0/1307418589 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998401b6c0 con 0x7f998c104390 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.192+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c10ee30 con 0x7f998c104390 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.194+0000 7f99908e8700 1 -- 172.21.15.35:0/1307418589 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9984003a00 con 0x7f998c104390 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.195+0000 7f99908e8700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f997409f640 0x7f99740a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.195+0000 7f99908e8700 1 -- 172.21.15.35:0/1307418589 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99840cb740 con 0x7f998c104390 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.195+0000 7f998affd700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f997409f640 0x7f99740a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f998affd700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f997409f640 0x7f99740a1af0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9980009c60 tx=0x7f9980009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 Processor -- start 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 -- start start 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685e8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2684ef010 con 0x55f2685edbe0 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f268541950 con 0x55f2685e8960 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f999da77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f26853ade0 con 0x55f2685ee4f0 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.196+0000 7f998affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55762/0 (socket says 172.21.15.35:55762) 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 -- 172.21.15.35:0/546329965 learned_addr learned my addr 172.21.15.35:0/546329965 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998a7fc700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998b7fe700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 -- 172.21.15.35:0/546329965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 msgr2=0x55f2685e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685e8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 -- 172.21.15.35:0/546329965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 msgr2=0x55f2685e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685e8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 -- 172.21.15.35:0/546329965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2683bc5d0 con 0x55f2685edbe0 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998b7fe700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:32:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998a7fc700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f998affd700 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685edfb0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f998000e4e0 tx=0x7f9980014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b45e47e866dc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f9971ffb700 1 -- 172.21.15.35:0/546329965 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980026430 con 0x55f2685edbe0 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f9971ffb700 1 -- 172.21.15.35:0/546329965 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9980021070 con 0x55f2685edbe0 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.197+0000 7f9971ffb700 1 -- 172.21.15.35:0/546329965 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998001d630 con 0x55f2685edbe0 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 -- 172.21.15.35:0/546329965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 msgr2=0x55f2685edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685edfb0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f998000e4e0 tx=0x7f9980014000 comp rx=0 tx=0).stop 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 -- 172.21.15.35:0/546329965 shutdown_connections 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685edfb0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 --2- 172.21.15.35:0/546329965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 -- 172.21.15.35:0/546329965 >> 172.21.15.35:0/546329965 conn(0x55f2684456b0 msgr2=0x55f2685e2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 -- 172.21.15.35:0/546329965 shutdown_connections 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 -- 172.21.15.35:0/546329965 wait complete. 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.198+0000 7f999da77b80 1 -- start start 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 Processor -- start 2023-03-17T11:32:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685f1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2683be8c0 con 0x55f2685edbe0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685f24d0 con 0x55f2685e8960 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685fe000 con 0x55f2685ee4f0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f999da77b80 10 client.0 _ll_register_callbacks cb 0x55f2683e0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f998a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f998a7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55770/0 (socket says 172.21.15.35:55770) 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f998a7fc700 1 -- 172.21.15.35:0/1492488882 learned_addr learned my addr 172.21.15.35:0/1492488882 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.199+0000 7f998affd700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998b7fe700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998a7fc700 1 -- 172.21.15.35:0/1492488882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 msgr2=0x55f2685f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998a7fc700 1 -- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 msgr2=0x55f2685f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998a7fc700 1 -- 172.21.15.35:0/1492488882 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9980017070 con 0x55f2685edbe0 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998affd700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:32:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685f1700 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f997c007e60 tx=0x7f997c012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db9011263087fa4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f996affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:32:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f996affd700 1 -- 172.21.15.35:0/1492488882 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c004320 con 0x55f2685edbe0 2023-03-17T11:32:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f996affd700 1 -- 172.21.15.35:0/1492488882 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f997c004480 con 0x55f2685edbe0 2023-03-17T11:32:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2684fd390 con 0x55f2685edbe0 2023-03-17T11:32:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f996affd700 1 -- 172.21.15.35:0/1492488882 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f997c003680 con 0x55f2685edbe0 2023-03-17T11:32:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f999da77b80 10 client.20961 fetch_fsmap learned FSMap version 108 2023-03-17T11:32:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55f268368d80 con 0x55f2685edbe0 2023-03-17T11:32:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.200+0000 7f996affd700 1 -- 172.21.15.35:0/1492488882 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f2684fd390 con 0x55f2685edbe0 2023-03-17T11:32:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f996affd700 1 -- 172.21.15.35:0/1492488882 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f997c0248d0 con 0x55f2685edbe0 2023-03-17T11:32:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f999da77b80 10 client.20961 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:32:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f999da77b80 10 client.20961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:32:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f999da77b80 20 client.20961 populate_metadata read hostname 'smithi035' 2023-03-17T11:32:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f999da77b80 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2686020b0 0x55f2686044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f999da77b80 4 client.20961 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:32:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f268509600 con 0x55f2686020b0 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f998affd700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2686020b0 0x55f2686044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f996affd700 10 client.20961 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.201+0000 7f998affd700 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2686020b0 0x55f2686044c0 crc :-1 s=READY pgs=693 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3812dfe1de08aab server_cookie=ad939f5b373a608a in_seq=0 out_seq=0 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f996affd700 1 -- 172.21.15.35:0/1492488882 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f268509600 con 0x55f2686020b0 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f996affd700 10 client.20961 handle_command_reply: tid=0 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 client.20961 shutdown 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 msgr2=0x55f2685f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685f1700 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f997c007e60 tx=0x7f997c012730 comp rx=0 tx=0).stop 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 shutdown_connections 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2686020b0 0x55f2686044c0 crc :-1 s=READY pgs=693 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f996affd700 0 client.20961 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 --2- 172.21.15.35:0/1492488882 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685edbe0 0x55f2685f1700 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 >> 172.21.15.35:0/1492488882 conn(0x55f2684456b0 msgr2=0x55f2685e7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 shutdown_connections 2023-03-17T11:32:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.202+0000 7f999da77b80 1 -- 172.21.15.35:0/1492488882 wait complete. 2023-03-17T11:32:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.203+0000 7f999da77b80 20 client.20961 trim_cache size 0 max 16384 2023-03-17T11:32:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.217+0000 7f999da77b80 1 Processor -- start 2023-03-17T11:32:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 -- start start 2023-03-17T11:32:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685edbe0 0x55f2685f4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685ee4f0 0x55f2685eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685de0f0 con 0x55f2685ee4f0 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685ff800 con 0x55f2685e8960 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f999da77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685df5c0 con 0x55f2685edbe0 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685ee4f0 0x55f2685eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:57572/0 (socket says 172.21.15.35:57572) 2023-03-17T11:32:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 -- 172.21.15.35:0/621264788 learned_addr learned my addr 172.21.15.35:0/621264788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998a7fc700 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685edbe0 0x55f2685f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 -- 172.21.15.35:0/621264788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685edbe0 msgr2=0x55f2685f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685edbe0 0x55f2685f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 -- 172.21.15.35:0/621264788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685ee4f0 msgr2=0x55f2685eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685ee4f0 0x55f2685eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 -- 172.21.15.35:0/621264788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f268501130 con 0x55f2685e8960 2023-03-17T11:32:15.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998a7fc700 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685edbe0 0x55f2685f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998b7fe700 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685ee4f0 0x55f2685eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.218+0000 7f998affd700 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f8f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f998000e4e0 tx=0x7f99800092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d219ee5000f5f7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f99727fc700 1 -- 172.21.15.35:0/621264788 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000ecb0 con 0x55f2685e8960 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f99727fc700 1 -- 172.21.15.35:0/621264788 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9980021040 con 0x55f2685e8960 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f99727fc700 1 -- 172.21.15.35:0/621264788 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980005040 con 0x55f2685e8960 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 -- 172.21.15.35:0/621264788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 msgr2=0x55f2685f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f8f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f998000e4e0 tx=0x7f99800092d0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 -- 172.21.15.35:0/621264788 shutdown_connections 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685ee4f0 0x55f2685eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685e8960 0x55f2685f8f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 --2- 172.21.15.35:0/621264788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685edbe0 0x55f2685f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 -- 172.21.15.35:0/621264788 >> 172.21.15.35:0/621264788 conn(0x55f2684456b0 msgr2=0x55f2685e7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 -- 172.21.15.35:0/621264788 shutdown_connections 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.219+0000 7f999da77b80 1 -- 172.21.15.35:0/621264788 wait complete. 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 -- start start 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 Processor -- start 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 0x55f2685f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685edbe0 0x55f2685f7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685f7fb0 con 0x55f2685e8960 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2685f8120 con 0x55f2685edbe0 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f268655f60 con 0x55f2685ee4f0 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f998affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 0x55f2685f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.220+0000 7f999da77b80 10 client.0 _ll_register_callbacks cb 0x55f2683e0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 0x55f2685f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55782/0 (socket says 172.21.15.35:55782) 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 -- 172.21.15.35:0/1180179052 learned_addr learned my addr 172.21.15.35:0/1180179052 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998b7fe700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685edbe0 0x55f2685f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 -- 172.21.15.35:0/1180179052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 msgr2=0x55f2685f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 -- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685edbe0 msgr2=0x55f2685f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685edbe0 0x55f2685f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 -- 172.21.15.35:0/1180179052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c10ee30 con 0x55f2685e8960 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685edbe0 0x55f2685f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f998affd700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 0x55f2685f8ef0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f998000e4b0 tx=0x7f998000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be0569d1b2d6957 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f996affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f996affd700 1 -- 172.21.15.35:0/1180179052 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980030c20 con 0x55f2685e8960 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f996affd700 1 -- 172.21.15.35:0/1180179052 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9980030d80 con 0x55f2685e8960 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2685b81e0 con 0x55f2685e8960 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f996affd700 1 -- 172.21.15.35:0/1180179052 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99800300d0 con 0x55f2685e8960 2023-03-17T11:32:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f999da77b80 10 client.20967 fetch_fsmap learned FSMap version 108 2023-03-17T11:32:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.221+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x7f998002a040 con 0x55f2685e8960 2023-03-17T11:32:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f996affd700 1 -- 172.21.15.35:0/1180179052 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9980045020 con 0x55f2685e8960 2023-03-17T11:32:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f996affd700 1 -- 172.21.15.35:0/1180179052 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9980037070 con 0x55f2685e8960 2023-03-17T11:32:17.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:20 smithi035 ceph-mon[92535]: pgmap v5150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:32:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f999da77b80 10 client.20967 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f999da77b80 10 client.20967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f999da77b80 20 client.20967 populate_metadata read hostname 'smithi035' 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f999da77b80 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f268657170 0x55f268659580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f999da77b80 4 client.20967 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f2683bef00 con 0x55f268657170 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f268657170 0x55f268659580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f998a7fc700 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f268657170 0x55f268659580 crc :-1 s=READY pgs=694 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3276586f284c4a server_cookie=a146b67ccdd5281b in_seq=0 out_seq=0 2023-03-17T11:32:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.222+0000 7f996affd700 10 client.20967 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.231+0000 7f996affd700 1 -- 172.21.15.35:0/1180179052 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f2683bef00 con 0x55f268657170 2023-03-17T11:32:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.231+0000 7f996affd700 10 client.20967 handle_command_reply: tid=0 2023-03-17T11:32:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 client.20967 shutdown 2023-03-17T11:32:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 msgr2=0x55f2685f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 0x55f2685f8ef0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f998000e4b0 tx=0x7f998000ee70 comp rx=0 tx=0).stop 2023-03-17T11:32:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 shutdown_connections 2023-03-17T11:32:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f268657170 0x55f268659580 crc :-1 s=READY pgs=694 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2685ee4f0 0x55f2685f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f996affd700 0 client.20967 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2685e8960 0x55f2685f8ef0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 --2- 172.21.15.35:0/1180179052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2685edbe0 0x55f2685f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 >> 172.21.15.35:0/1180179052 conn(0x55f2684456b0 msgr2=0x55f2685eb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 shutdown_connections 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 1 -- 172.21.15.35:0/1180179052 wait complete. 2023-03-17T11:32:23.601 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.232+0000 7f999da77b80 20 client.20967 trim_cache size 0 max 16384 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f997409f640 msgr2=0x7f99740a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f997409f640 0x7f99740a1af0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9980009c60 tx=0x7f9980009260 comp rx=0 tx=0).stop 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 msgr2=0x7f998c1a4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c1a4540 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9984008ec0 tx=0x7f9984008ef0 comp rx=0 tx=0).stop 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 shutdown_connections 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f997409f640 0x7f99740a1af0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f998c104390 0x7f998c1a4540 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:25.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c0ff350 0x7f998c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:25.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 --2- 172.21.15.35:0/1307418589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f998c0ffcf0 0x7f998c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:25.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 >> 172.21.15.35:0/1307418589 conn(0x7f998c076330 msgr2=0x7f998c068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:25.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 shutdown_connections 2023-03-17T11:32:25.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:08:50.233+0000 7f99918ea700 1 -- 172.21.15.35:0/1307418589 wait complete. 2023-03-17T11:32:25.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 -- 172.21.15.35:0/1343095913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98000ffe50 msgr2=0x7f9800103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 --2- 172.21.15.35:0/1343095913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98000ffe50 0x7f9800103df0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f97f00099c0 tx=0x7f97f0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:32:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 -- 172.21.15.35:0/1343095913 shutdown_connections 2023-03-17T11:32:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 --2- 172.21.15.35:0/1343095913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98001044d0 0x7f980010c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 --2- 172.21.15.35:0/1343095913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98000ff4b0 0x7f98000ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 --2- 172.21.15.35:0/1343095913 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98000ffe50 0x7f9800103df0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 -- 172.21.15.35:0/1343095913 >> 172.21.15.35:0/1343095913 conn(0x7f9800077220 msgr2=0x7f9800077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:30.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 -- 172.21.15.35:0/1343095913 shutdown_connections 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.355+0000 7f9805e3a700 1 -- 172.21.15.35:0/1343095913 wait complete. 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 Processor -- start 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 -- start start 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98000ff4b0 0x7f9800100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98000ffe50 0x7f98001013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 0x7f98001a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:30.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800101c00 con 0x7f98001044d0 2023-03-17T11:32:30.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98001a49f0 con 0x7f98000ffe50 2023-03-17T11:32:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f9805e3a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98001a4b30 con 0x7f98000ff4b0 2023-03-17T11:32:31.117 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.356+0000 7f97fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 0x7f98001a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 0x7f98001a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55800/0 (socket says 172.21.15.35:55800) 2023-03-17T11:32:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 -- 172.21.15.35:0/3751906240 learned_addr learned my addr 172.21.15.35:0/3751906240 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98000ff4b0 0x7f9800100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97feffd700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98000ffe50 0x7f98001013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 -- 172.21.15.35:0/3751906240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98000ff4b0 msgr2=0x7f9800100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98000ff4b0 0x7f9800100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 -- 172.21.15.35:0/3751906240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98000ffe50 msgr2=0x7f98001013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98000ffe50 0x7f98001013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 -- 172.21.15.35:0/3751906240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00095f0 con 0x7f98001044d0 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97feffd700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98000ffe50 0x7f98001013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fffff700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 0x7f98001a44b0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f97f8007ee0 tx=0x7f97f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fcff9700 1 -- 172.21.15.35:0/3751906240 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8017070 con 0x7f98001044d0 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980010f0f0 con 0x7f98001044d0 2023-03-17T11:32:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fcff9700 1 -- 172.21.15.35:0/3751906240 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97f800f040 con 0x7f98001044d0 2023-03-17T11:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f97fcff9700 1 -- 172.21.15.35:0/3751906240 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8005710 con 0x7f98001044d0 2023-03-17T11:32:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.357+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980010ef60 con 0x7f98001044d0 2023-03-17T11:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.359+0000 7f97fcff9700 1 -- 172.21.15.35:0/3751906240 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f97f8005870 con 0x7f98001044d0 2023-03-17T11:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.360+0000 7f97fcff9700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f97e809f640 0x7f97e80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.360+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f97e809f640 0x7f97e80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.361+0000 7f97fcff9700 1 -- 172.21.15.35:0/3751906240 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f97f80c9e80 con 0x7f98001044d0 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.361+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f97e809f640 0x7f97e80a1af0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009bf0 tx=0x7f97f4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.361+0000 7f9811fc7b80 1 Processor -- start 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 -- start start 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7cfbe0 0x56414b7cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 0x56414b7ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b6d1010 con 0x56414b7d04f0 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b723950 con 0x56414b7cfbe0 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b71cde0 con 0x56414b7ca960 2023-03-17T11:32:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 0x56414b7ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97ff7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7cfbe0 0x56414b7cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 0x56414b7ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55806/0 (socket says 172.21.15.35:55806) 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 -- 172.21.15.35:0/1386490370 learned_addr learned my addr 172.21.15.35:0/1386490370 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97fffff700 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 -- 172.21.15.35:0/1386490370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 msgr2=0x56414b7cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 -- 172.21.15.35:0/1386490370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7cfbe0 msgr2=0x56414b7cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7cfbe0 0x56414b7cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.362+0000 7f97feffd700 1 -- 172.21.15.35:0/1386490370 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56414b59e5d0 con 0x56414b7d04f0 2023-03-17T11:32:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.363+0000 7f97feffd700 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 0x56414b7ca420 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f97f00099c0 tx=0x7f97f0009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cc956347977f7d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.363+0000 7f97e5ffb700 1 -- 172.21.15.35:0/1386490370 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f001d070 con 0x56414b7d04f0 2023-03-17T11:32:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.363+0000 7f97e5ffb700 1 -- 172.21.15.35:0/1386490370 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97f000bc20 con 0x56414b7d04f0 2023-03-17T11:32:36.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.363+0000 7f97e5ffb700 1 -- 172.21.15.35:0/1386490370 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0003760 con 0x56414b7d04f0 2023-03-17T11:32:36.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.363+0000 7f9811fc7b80 1 -- 172.21.15.35:0/1386490370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 msgr2=0x56414b7ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.363+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 0x56414b7ca420 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f97f00099c0 tx=0x7f97f0009530 comp rx=0 tx=0).stop 2023-03-17T11:32:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 -- 172.21.15.35:0/1386490370 shutdown_connections 2023-03-17T11:32:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7cfbe0 0x56414b7cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/1386490370 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7d04f0 0x56414b7ca420 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 -- 172.21.15.35:0/1386490370 >> 172.21.15.35:0/1386490370 conn(0x56414b6276b0 msgr2=0x56414b7c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 -- 172.21.15.35:0/1386490370 shutdown_connections 2023-03-17T11:32:37.621 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 -- 172.21.15.35:0/1386490370 wait complete. 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 -- start start 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.364+0000 7f9811fc7b80 1 Processor -- start 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 0x56414b7d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7cfbe0 0x56414b7d3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b5a08c0 con 0x56414b7ca960 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b7d44d0 con 0x56414b7d04f0 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b7dffa0 con 0x56414b7cfbe0 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f9811fc7b80 10 client.0 _ll_register_callbacks cb 0x56414b5c2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 0x56414b7d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:37.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 0x56414b7d6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55810/0 (socket says 172.21.15.35:55810) 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 -- 172.21.15.35:0/2551441665 learned_addr learned my addr 172.21.15.35:0/2551441665 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97fffff700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97feffd700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7cfbe0 0x56414b7d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 -- 172.21.15.35:0/2551441665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7cfbe0 msgr2=0x56414b7d3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7cfbe0 0x56414b7d3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 -- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 msgr2=0x56414b7d3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 -- 172.21.15.35:0/2551441665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980010c8b0 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97feffd700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7cfbe0 0x56414b7d3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 0x56414b7d6480 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f97f4012910 tx=0x7f97f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fb8a10125f849b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.365+0000 7f97deffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f97deffd700 1 -- 172.21.15.35:0/2551441665 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4020840 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f97deffd700 1 -- 172.21.15.35:0/2551441665 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f97f4018070 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56414b6df390 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f97deffd700 1 -- 172.21.15.35:0/2551441665 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97f4012e80 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 10 client.20979 fetch_fsmap learned FSMap version 108 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x56414b54ad80 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f97deffd700 1 -- 172.21.15.35:0/2551441665 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56414b6df390 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f97deffd700 1 -- 172.21.15.35:0/2551441665 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f97f4029b50 con 0x56414b7ca960 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 10 client.20979 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:32:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 10 client.20979 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:32:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 20 client.20979 populate_metadata read hostname 'smithi035' 2023-03-17T11:32:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b7e4120 0x56414b7e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 4 client.20979 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:32:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56414b6eb600 con 0x56414b7e4120 2023-03-17T11:32:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.366+0000 7f97feffd700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b7e4120 0x56414b7e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.367+0000 7f97feffd700 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b7e4120 0x56414b7e6530 crc :-1 s=READY pgs=695 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57bec12d79ff8041 server_cookie=1746feae8ed94378 in_seq=0 out_seq=0 2023-03-17T11:32:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.367+0000 7f97deffd700 10 client.20979 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f97deffd700 1 -- 172.21.15.35:0/2551441665 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56414b6eb600 con 0x56414b7e4120 2023-03-17T11:32:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f97deffd700 10 client.20979 handle_command_reply: tid=0 2023-03-17T11:32:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 client.20979 shutdown 2023-03-17T11:32:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 msgr2=0x56414b7d6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 0x56414b7d6480 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f97f4012910 tx=0x7f97f40047c0 comp rx=0 tx=0).stop 2023-03-17T11:32:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 shutdown_connections 2023-03-17T11:32:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b7e4120 0x56414b7e6530 crc :-1 s=READY pgs=695 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f97deffd700 0 client.20979 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7ca960 0x56414b7d6480 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2551441665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7cfbe0 0x56414b7d3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 >> 172.21.15.35:0/2551441665 conn(0x56414b6276b0 msgr2=0x56414b7c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 shutdown_connections 2023-03-17T11:32:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2551441665 wait complete. 2023-03-17T11:32:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.368+0000 7f9811fc7b80 20 client.20979 trim_cache size 0 max 16384 2023-03-17T11:32:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 Processor -- start 2023-03-17T11:32:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 -- start start 2023-03-17T11:32:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7ca960 0x56414b7c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7daef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7d04f0 0x56414b7c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:42.351 DEBUG:teuthology.parallel:result is None 2023-03-17T11:32:43.554 DEBUG:teuthology.orchestra.run.smithi035:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-03-17T11:32:43.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:22 smithi035 ceph-mon[92535]: pgmap v5151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:32:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b7c56d0 con 0x56414b7cfbe0 2023-03-17T11:32:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b7cf830 con 0x56414b7ca960 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b7d4810 con 0x56414b7d04f0 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7daef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55820/0 (socket says 172.21.15.35:55820) 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 -- 172.21.15.35:0/2313572334 learned_addr learned my addr 172.21.15.35:0/2313572334 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7ca960 0x56414b7c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97fffff700 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7d04f0 0x56414b7c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 -- 172.21.15.35:0/2313572334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7d04f0 msgr2=0x56414b7c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7d04f0 0x56414b7c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 -- 172.21.15.35:0/2313572334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7ca960 msgr2=0x56414b7c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7ca960 0x56414b7c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97feffd700 1 -- 172.21.15.35:0/2313572334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56414b6e3130 con 0x56414b7cfbe0 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.383+0000 7f97fffff700 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7d04f0 0x56414b7c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:32:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f97feffd700 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7daef0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f97f0024040 tx=0x7f97f001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dccd4356dffdea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f97e67fc700 1 -- 172.21.15.35:0/2313572334 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f001d040 con 0x56414b7cfbe0 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f97e67fc700 1 -- 172.21.15.35:0/2313572334 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97f002e430 con 0x56414b7cfbe0 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f97e67fc700 1 -- 172.21.15.35:0/2313572334 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000bd60 con 0x56414b7cfbe0 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2313572334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 msgr2=0x56414b7daef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7daef0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f97f0024040 tx=0x7f97f001a040 comp rx=0 tx=0).stop 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2313572334 shutdown_connections 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7d04f0 0x56414b7c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7ca960 0x56414b7c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/2313572334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7daef0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2313572334 >> 172.21.15.35:0/2313572334 conn(0x56414b6276b0 msgr2=0x56414b7c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2313572334 shutdown_connections 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.384+0000 7f9811fc7b80 1 -- 172.21.15.35:0/2313572334 wait complete. 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 -- start start 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 Processor -- start 2023-03-17T11:32:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7d8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7d9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b837060 con 0x56414b7cfbe0 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b8371a0 con 0x56414b7d04f0 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56414b837360 con 0x56414b7ca960 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f9811fc7b80 10 client.0 _ll_register_callbacks cb 0x56414b5c2230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f97feffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f97feffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7d9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55826/0 (socket says 172.21.15.35:55826) 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.385+0000 7f97feffd700 1 -- 172.21.15.35:0/590795347 learned_addr learned my addr 172.21.15.35:0/590795347 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97fffff700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7d8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97feffd700 1 -- 172.21.15.35:0/590795347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 msgr2=0x56414b7d8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97feffd700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7d8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.492 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97feffd700 1 -- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 msgr2=0x56414b7d9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:32:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97feffd700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97feffd700 1 -- 172.21.15.35:0/590795347 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56414b59e5d0 con 0x56414b7cfbe0 2023-03-17T11:32:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97fffff700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:32:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7d8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:32:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97feffd700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7d9410 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009d10 tx=0x7f97f0005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d732cc8233595274 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:32:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97deffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:32:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97deffd700 1 -- 172.21.15.35:0/590795347 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f001d040 con 0x56414b7cfbe0 2023-03-17T11:32:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97deffd700 1 -- 172.21.15.35:0/590795347 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(363..363 src has 1..363) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f97f000b990 con 0x56414b7cfbe0 2023-03-17T11:32:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56414b79a1e0 con 0x56414b7cfbe0 2023-03-17T11:32:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97deffd700 1 -- 172.21.15.35:0/590795347 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97f000bb50 con 0x56414b7cfbe0 2023-03-17T11:32:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f9811fc7b80 10 client.20985 fetch_fsmap learned FSMap version 108 2023-03-17T11:32:49.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x56414b5711f0 con 0x56414b7cfbe0 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97deffd700 1 -- 172.21.15.35:0/590795347 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56414b79a1e0 con 0x56414b7cfbe0 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.386+0000 7f97deffd700 1 -- 172.21.15.35:0/590795347 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f97f0035070 con 0x56414b7cfbe0 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f9811fc7b80 10 client.20985 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f9811fc7b80 10 client.20985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f9811fc7b80 20 client.20985 populate_metadata read hostname 'smithi035' 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b838500 0x56414b83a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f9811fc7b80 4 client.20985 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56414b5a0f00 con 0x56414b838500 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b838500 0x56414b83a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f97deffd700 10 client.20985 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.387+0000 7f97ff7fe700 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b838500 0x56414b83a910 crc :-1 s=READY pgs=696 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b0ddf16eb31850 server_cookie=6efb1c46140fb851 in_seq=0 out_seq=0 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.419+0000 7f97deffd700 1 -- 172.21.15.35:0/590795347 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56414b5a0f00 con 0x56414b838500 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.419+0000 7f97deffd700 10 client.20985 handle_command_reply: tid=0 2023-03-17T11:32:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.419+0000 7f9811fc7b80 1 client.20985 shutdown 2023-03-17T11:32:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 msgr2=0x56414b7d9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7d9410 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009d10 tx=0x7f97f0005c90 comp rx=0 tx=0).stop 2023-03-17T11:32:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 shutdown_connections 2023-03-17T11:32:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56414b838500 0x56414b83a910 crc :-1 s=READY pgs=696 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56414b7d04f0 0x56414b7d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f97deffd700 0 client.20985 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56414b7ca960 0x56414b7d8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 --2- 172.21.15.35:0/590795347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56414b7cfbe0 0x56414b7d9410 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 >> 172.21.15.35:0/590795347 conn(0x56414b6276b0 msgr2=0x56414b7c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 shutdown_connections 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 1 -- 172.21.15.35:0/590795347 wait complete. 2023-03-17T11:32:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9811fc7b80 20 client.20985 trim_cache size 0 max 16384 2023-03-17T11:32:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f97e809f640 msgr2=0x7f97e80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f97e809f640 0x7f97e80a1af0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009bf0 tx=0x7f97f4009260 comp rx=0 tx=0).stop 2023-03-17T11:32:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 msgr2=0x7f98001a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 0x7f98001a44b0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f97f8007ee0 tx=0x7f97f800d3b0 comp rx=0 tx=0).stop 2023-03-17T11:32:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 shutdown_connections 2023-03-17T11:32:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f97e809f640 0x7f97e80a1af0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f98001044d0 0x7f98001a44b0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98000ff4b0 0x7f9800100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 --2- 172.21.15.35:0/3751906240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98000ffe50 0x7f98001013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.420+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 >> 172.21.15.35:0/3751906240 conn(0x7f9800077220 msgr2=0x7f98000693a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.421+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 shutdown_connections 2023-03-17T11:32:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:03.421+0000 7f9805e3a700 1 -- 172.21.15.35:0/3751906240 wait complete. 2023-03-17T11:32:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 -- 172.21.15.35:0/2351031187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308105500 msgr2=0x7f130810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 --2- 172.21.15.35:0/2351031187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308105500 0x7f130810d0b0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f130000b0d0 tx=0x7f130000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 -- 172.21.15.35:0/2351031187 shutdown_connections 2023-03-17T11:32:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 --2- 172.21.15.35:0/2351031187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308105500 0x7f130810d0b0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 --2- 172.21.15.35:0/2351031187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 0x7f1308069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 --2- 172.21.15.35:0/2351031187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308069e10 0x7f1308104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 -- 172.21.15.35:0/2351031187 >> 172.21.15.35:0/2351031187 conn(0x7f1308076f80 msgr2=0x7f1308077380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 -- 172.21.15.35:0/2351031187 shutdown_connections 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 -- 172.21.15.35:0/2351031187 wait complete. 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 Processor -- start 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.543+0000 7f130f120700 1 -- start start 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130f120700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 0x7f13081962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130f120700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 0x7f1308196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130f120700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308105500 0x7f130819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130f120700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130819b2c0 con 0x7f1308069e10 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130f120700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130819b430 con 0x7f1308105500 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130f120700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130819b5f0 con 0x7f1308069470 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 0x7f1308196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 0x7f1308196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55840/0 (socket says 172.21.15.35:55840) 2023-03-17T11:32:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 -- 172.21.15.35:0/4220303390 learned_addr learned my addr 172.21.15.35:0/4220303390 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130d6bd700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308105500 0x7f130819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130cebc700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 0x7f13081962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 -- 172.21.15.35:0/4220303390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 msgr2=0x7f13081962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 0x7f13081962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 -- 172.21.15.35:0/4220303390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308105500 msgr2=0x7f130819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308105500 0x7f130819ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 -- 172.21.15.35:0/4220303390 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300009d00 con 0x7f1308069e10 2023-03-17T11:32:57.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130cebc700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 0x7f13081962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:33:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f130d6bd700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308105500 0x7f130819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1307fff700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 0x7f1308196820 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e940 tx=0x7f12f400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1305ffb700 1 -- 172.21.15.35:0/4220303390 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4009730 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.544+0000 7f1305ffb700 1 -- 172.21.15.35:0/4220303390 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12f400cbd0 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.545+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13081100a0 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.545+0000 7f1305ffb700 1 -- 172.21.15.35:0/4220303390 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4018680 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.545+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130810ff10 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.547+0000 7f1305ffb700 1 -- 172.21.15.35:0/4220303390 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f12f400cd40 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.547+0000 7f1305ffb700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f12f809f6c0 0x7f12f80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.548+0000 7f1305ffb700 1 -- 172.21.15.35:0/4220303390 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(365..365 src has 1..365) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f12f4014070 con 0x7f1308069e10 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.548+0000 7f130cebc700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f12f809f6c0 0x7f12f80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.548+0000 7f130cebc700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f12f809f6c0 0x7f12f80a1b70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005950 tx=0x7f12fc0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.548+0000 7f131b2adb80 1 Processor -- start 2023-03-17T11:33:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 -- start start 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee3bf010 con 0x5591ee4be4f0 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee411950 con 0x5591ee4b8960 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f131b2adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee40ade0 con 0x5591ee4bdbe0 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55848/0 (socket says 172.21.15.35:55848) 2023-03-17T11:33:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 -- 172.21.15.35:0/607445666 learned_addr learned my addr 172.21.15.35:0/607445666 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f130cebc700 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f130d6bd700 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 -- 172.21.15.35:0/607445666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 msgr2=0x5591ee4bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 -- 172.21.15.35:0/607445666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 msgr2=0x5591ee4b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4b8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 -- 172.21.15.35:0/607445666 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ee28c5d0 con 0x5591ee4be4f0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.549+0000 7f1307fff700 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4b8420 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f12f4094970 tx=0x7f12f40948e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eef0be3c42f7d4a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f12f2ffd700 1 -- 172.21.15.35:0/607445666 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40af070 con 0x5591ee4be4f0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f12f2ffd700 1 -- 172.21.15.35:0/607445666 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12f40a0660 con 0x5591ee4be4f0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f12f2ffd700 1 -- 172.21.15.35:0/607445666 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4097960 con 0x5591ee4be4f0 2023-03-17T11:33:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 -- 172.21.15.35:0/607445666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 msgr2=0x5591ee4b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:04.618 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:24 smithi035 ceph-mon[92535]: pgmap v5152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:33:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4b8420 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f12f4094970 tx=0x7f12f40948e0 comp rx=0 tx=0).stop 2023-03-17T11:33:05.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 -- 172.21.15.35:0/607445666 shutdown_connections 2023-03-17T11:33:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 --2- 172.21.15.35:0/607445666 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4b8420 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 -- 172.21.15.35:0/607445666 >> 172.21.15.35:0/607445666 conn(0x5591ee3156b0 msgr2=0x5591ee4b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 -- 172.21.15.35:0/607445666 shutdown_connections 2023-03-17T11:33:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.550+0000 7f131b2adb80 1 -- 172.21.15.35:0/607445666 wait complete. 2023-03-17T11:33:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 -- start start 2023-03-17T11:33:07.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 Processor -- start 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4b8960 0x5591ee4c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4be4f0 0x5591ee4c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee28e8c0 con 0x5591ee4bdbe0 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4c25e0 con 0x5591ee4be4f0 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4ce000 con 0x5591ee4b8960 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f131b2adb80 10 client.0 _ll_register_callbacks cb 0x5591ee2b0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f1307fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.551+0000 7f1307fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55852/0 (socket says 172.21.15.35:55852) 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 -- 172.21.15.35:0/1374979264 learned_addr learned my addr 172.21.15.35:0/1374979264 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f130cebc700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4b8960 0x5591ee4c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f130d6bd700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4be4f0 0x5591ee4c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 -- 172.21.15.35:0/1374979264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4b8960 msgr2=0x5591ee4c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4b8960 0x5591ee4c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 -- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4be4f0 msgr2=0x5591ee4c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4be4f0 0x5591ee4c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:07.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 -- 172.21.15.35:0/1374979264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130810ff10 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f130d6bd700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4be4f0 0x5591ee4c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f1307fff700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c1730 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f12f40caae0 tx=0x7f12f400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8702d22d78605faf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f12e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f12e7fff700 1 -- 172.21.15.35:0/1374979264 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40af070 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f12e7fff700 1 -- 172.21.15.35:0/1374979264 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(365..365 src has 1..365) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f12f40986d0 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591ee3cd390 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f12e7fff700 1 -- 172.21.15.35:0/1374979264 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f40988d0 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f131b2adb80 10 client.20997 fetch_fsmap learned FSMap version 108 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5591ee238d80 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.552+0000 7f12e7fff700 1 -- 172.21.15.35:0/1374979264 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12f407b080 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f12e7fff700 1 -- 172.21.15.35:0/1374979264 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f12f40973d0 con 0x5591ee4bdbe0 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f131b2adb80 10 client.20997 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f131b2adb80 10 client.20997 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f131b2adb80 20 client.20997 populate_metadata read hostname 'smithi035' 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f131b2adb80 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee4d1d60 0x5591ee4d4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:07.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f131b2adb80 4 client.20997 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591ee3d9600 con 0x5591ee4d1d60 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f130cebc700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee4d1d60 0x5591ee4d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f130cebc700 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee4d1d60 0x5591ee4d4140 crc :-1 s=READY pgs=697 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b7a2171706d2a55 server_cookie=858ac5871d33828c in_seq=0 out_seq=0 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.553+0000 7f12e7fff700 10 client.20997 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f12e7fff700 1 -- 172.21.15.35:0/1374979264 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5591ee3d9600 con 0x5591ee4d1d60 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f12e7fff700 10 client.20997 handle_command_reply: tid=0 2023-03-17T11:33:08.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 client.20997 shutdown 2023-03-17T11:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 msgr2=0x5591ee4c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c1730 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f12f40caae0 tx=0x7f12f400c750 comp rx=0 tx=0).stop 2023-03-17T11:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 shutdown_connections 2023-03-17T11:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee4d1d60 0x5591ee4d4140 crc :-1 s=READY pgs=697 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4be4f0 0x5591ee4c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f12e7fff700 0 client.20997 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4b8960 0x5591ee4c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 --2- 172.21.15.35:0/1374979264 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c1730 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 >> 172.21.15.35:0/1374979264 conn(0x5591ee3156b0 msgr2=0x5591ee4b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 shutdown_connections 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.554+0000 7f131b2adb80 1 -- 172.21.15.35:0/1374979264 wait complete. 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.555+0000 7f131b2adb80 20 client.20997 trim_cache size 0 max 16384 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.569+0000 7f131b2adb80 1 Processor -- start 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.569+0000 7f131b2adb80 1 -- start start 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4bc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f131b2adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4b3000 con 0x5591ee4be4f0 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f131b2adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4ae0d0 con 0x5591ee4b8960 2023-03-17T11:33:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f131b2adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4af5c0 con 0x5591ee4bdbe0 2023-03-17T11:33:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4bc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55862/0 (socket says 172.21.15.35:55862) 2023-03-17T11:33:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 -- 172.21.15.35:0/3118425049 learned_addr learned my addr 172.21.15.35:0/3118425049 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f1307fff700 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130cebc700 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 -- 172.21.15.35:0/3118425049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 msgr2=0x5591ee4b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 -- 172.21.15.35:0/3118425049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 msgr2=0x5591ee4bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 -- 172.21.15.35:0/3118425049 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ee3d1130 con 0x5591ee4be4f0 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130cebc700 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f130d6bd700 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4bc830 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f1300009ca0 tx=0x7f13000092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d23bf2237244704 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f12f37fe700 1 -- 172.21.15.35:0/3118425049 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130000e040 con 0x5591ee4be4f0 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f12f37fe700 1 -- 172.21.15.35:0/3118425049 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1300007d90 con 0x5591ee4be4f0 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.570+0000 7f12f37fe700 1 -- 172.21.15.35:0/3118425049 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300004cd0 con 0x5591ee4be4f0 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 -- 172.21.15.35:0/3118425049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 msgr2=0x5591ee4bc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4bc830 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f1300009ca0 tx=0x7f13000092e0 comp rx=0 tx=0).stop 2023-03-17T11:33:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 -- 172.21.15.35:0/3118425049 shutdown_connections 2023-03-17T11:33:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4be4f0 0x5591ee4bc830 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4b8960 0x5591ee4bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3118425049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4bdbe0 0x5591ee4b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 -- 172.21.15.35:0/3118425049 >> 172.21.15.35:0/3118425049 conn(0x5591ee3156b0 msgr2=0x5591ee4bb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 -- 172.21.15.35:0/3118425049 shutdown_connections 2023-03-17T11:33:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 -- 172.21.15.35:0/3118425049 wait complete. 2023-03-17T11:33:12.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 -- start start 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.571+0000 7f131b2adb80 1 Processor -- start 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 0x5591ee4c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4be4f0 0x5591ee4c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4c7f70 con 0x5591ee4b8960 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee4c80e0 con 0x5591ee4bdbe0 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ee525ba0 con 0x5591ee4be4f0 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f131b2adb80 10 client.0 _ll_register_callbacks cb 0x5591ee2b0230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 0x5591ee4c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 0x5591ee4c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55864/0 (socket says 172.21.15.35:55864) 2023-03-17T11:33:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 -- 172.21.15.35:0/3390981338 learned_addr learned my addr 172.21.15.35:0/3390981338 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f1307fff700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 -- 172.21.15.35:0/3390981338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4be4f0 msgr2=0x5591ee4c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4be4f0 0x5591ee4c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 -- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4bdbe0 msgr2=0x5591ee4c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f130cebc700 1 -- 172.21.15.35:0/3390981338 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130810d8c0 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.572+0000 7f1307fff700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f130cebc700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 0x5591ee4c8ff0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00f9d0 tx=0x7f12fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb0d02ef9a5f45f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f12e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f12e7fff700 1 -- 172.21.15.35:0/3390981338 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc017040 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f12e7fff700 1 -- 172.21.15.35:0/3390981338 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(365..365 src has 1..365) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f12fc028850 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591ee4881e0 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f12e7fff700 1 -- 172.21.15.35:0/3390981338 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12fc0285d0 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 10 client.21003 fetch_fsmap learned FSMap version 108 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5591ee25f1f0 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f12e7fff700 1 -- 172.21.15.35:0/3390981338 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591ee4881e0 con 0x5591ee4b8960 2023-03-17T11:33:14.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f12e7fff700 1 -- 172.21.15.35:0/3390981338 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f12fc003b60 con 0x5591ee4b8960 2023-03-17T11:33:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 10 client.21003 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:33:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 10 client.21003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:33:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 20 client.21003 populate_metadata read hostname 'smithi035' 2023-03-17T11:33:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee527070 0x5591ee529520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 4 client.21003 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.573+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5591ee28ef00 con 0x5591ee527070 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.574+0000 7f1307fff700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee527070 0x5591ee529520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.574+0000 7f1307fff700 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee527070 0x5591ee529520 crc :-1 s=READY pgs=698 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5da7f1850324461c server_cookie=3a43b548fd57812a in_seq=0 out_seq=0 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.574+0000 7f12e7fff700 10 client.21003 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.590+0000 7f12e7fff700 1 -- 172.21.15.35:0/3390981338 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5591ee28ef00 con 0x5591ee527070 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f12e7fff700 10 client.21003 handle_command_reply: tid=0 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 client.21003 shutdown 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 msgr2=0x5591ee4c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 0x5591ee4c8ff0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00f9d0 tx=0x7f12fc0047c0 comp rx=0 tx=0).stop 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 shutdown_connections 2023-03-17T11:33:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5591ee527070 0x5591ee529520 crc :-1 s=READY pgs=698 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591ee4be4f0 0x5591ee4c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5591ee4b8960 0x5591ee4c8ff0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f12e7fff700 0 client.21003 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 --2- 172.21.15.35:0/3390981338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5591ee4bdbe0 0x5591ee4c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 >> 172.21.15.35:0/3390981338 conn(0x5591ee3156b0 msgr2=0x5591ee4bd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 shutdown_connections 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 1 -- 172.21.15.35:0/3390981338 wait complete. 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.591+0000 7f131b2adb80 20 client.21003 trim_cache size 0 max 16384 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f12f809f6c0 msgr2=0x7f12f80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f12f809f6c0 0x7f12f80a1b70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f12fc005950 tx=0x7f12fc0058e0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 msgr2=0x7f1308196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 0x7f1308196820 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e940 tx=0x7f12f400ed00 comp rx=0 tx=0).stop 2023-03-17T11:33:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 shutdown_connections 2023-03-17T11:33:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f12f809f6c0 0x7f12f80a1b70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1308105500 0x7f130819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1308069470 0x7f13081962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 --2- 172.21.15.35:0/4220303390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1308069e10 0x7f1308196820 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 >> 172.21.15.35:0/4220303390 conn(0x7f1308076f80 msgr2=0x7f13080fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 shutdown_connections 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:09:16.592+0000 7f130f120700 1 -- 172.21.15.35:0/4220303390 wait complete. 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 -- 172.21.15.35:0/1939767058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ffcf0 msgr2=0x7ff83c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1939767058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ffcf0 0x7ff83c103cb0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7ff8300099c0 tx=0x7ff830009cd0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 -- 172.21.15.35:0/1939767058 shutdown_connections 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1939767058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff83c104390 0x7ff83c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1939767058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff83c0ff350 0x7ff83c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1939767058 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ffcf0 0x7ff83c103cb0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:18.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:26 smithi035 ceph-mon[92535]: pgmap v5153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:33:18.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:33:18.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:28 smithi035 ceph-mon[92535]: pgmap v5154: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:29 smithi035 ceph-mon[92535]: pgmap v5155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:29 smithi035 ceph-mon[92535]: pgmap v5156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:31 smithi035 ceph-mon[92535]: pgmap v5157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:33 smithi035 ceph-mon[92535]: pgmap v5158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:33:18.465 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:35 smithi035 ceph-mon[92535]: pgmap v5159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:33:19.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:37 smithi035 ceph-mon[92535]: pgmap v5160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T11:33:19.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:39 smithi035 ceph-mon[92535]: pgmap v5161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:33:19.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:41 smithi035 ceph-mon[92535]: pgmap v5162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:33:19.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:43 smithi035 ceph-mon[92535]: pgmap v5163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:33:19.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:45 smithi035 ceph-mon[92535]: pgmap v5164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:33:21.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:47 smithi035 ceph-mon[92535]: pgmap v5165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:33:21.211 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:49 smithi035 ceph-mon[92535]: pgmap v5166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:33:22.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:51 smithi035 ceph-mon[92535]: pgmap v5167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:33:22.384 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:53 smithi035 ceph-mon[92535]: pgmap v5168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:33:22.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:33:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:33:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:33:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:33:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 -- 172.21.15.35:0/1939767058 >> 172.21.15.35:0/1939767058 conn(0x7ff83c076330 msgr2=0x7ff83c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 -- 172.21.15.35:0/1939767058 shutdown_connections 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.092+0000 7ff8444a2700 1 -- 172.21.15.35:0/1939767058 wait complete. 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 Processor -- start 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 -- start start 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 0x7ff83c1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff83c0ffcf0 0x7ff83c197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff83c104390 0x7ff83c1a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c197ec0 con 0x7ff83c0ff350 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1a2680 con 0x7ff83c0ffcf0 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff8444a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1a27c0 con 0x7ff83c104390 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff84223e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 0x7ff83c1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff84223e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 0x7ff83c1970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55874/0 (socket says 172.21.15.35:55874) 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.093+0000 7ff84223e700 1 -- 172.21.15.35:0/1391524310 learned_addr learned my addr 172.21.15.35:0/1391524310 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff841a3d700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff83c0ffcf0 0x7ff83c197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff842a3f700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff83c104390 0x7ff83c1a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff84223e700 1 -- 172.21.15.35:0/1391524310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff83c104390 msgr2=0x7ff83c1a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff84223e700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff83c104390 0x7ff83c1a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff84223e700 1 -- 172.21.15.35:0/1391524310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff83c0ffcf0 msgr2=0x7ff83c197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff84223e700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff83c0ffcf0 0x7ff83c197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff84223e700 1 -- 172.21.15.35:0/1391524310 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300095f0 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff84223e700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 0x7ff83c1970c0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7ff83800d980 tx=0x7ff83800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff82f7fe700 1 -- 172.21.15.35:0/1391524310 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838004220 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff82f7fe700 1 -- 172.21.15.35:0/1391524310 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff838007640 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c10f010 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff82f7fe700 1 -- 172.21.15.35:0/1391524310 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8380055e0 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.094+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c10ee80 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.096+0000 7ff82f7fe700 1 -- 172.21.15.35:0/1391524310 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff838004750 con 0x7ff83c0ff350 2023-03-17T11:33:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.097+0000 7ff82f7fe700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff82809f640 0x7ff8280a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:26.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.097+0000 7ff82f7fe700 1 -- 172.21.15.35:0/1391524310 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(368..368 src has 1..368) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff8380ca460 con 0x7ff83c0ff350 2023-03-17T11:33:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.097+0000 7ff841a3d700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff82809f640 0x7ff8280a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff841a3d700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff82809f640 0x7ff8280a1af0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff83000b9b0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 Processor -- start 2023-03-17T11:33:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 -- start start 2023-03-17T11:33:27.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd93be0 0x563d5dd93fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 0x563d5dd8ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dc95010 con 0x563d5dd8e960 2023-03-17T11:33:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dce7950 con 0x563d5dd93be0 2023-03-17T11:33:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff85062fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dce0de0 con 0x563d5dd944f0 2023-03-17T11:33:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.098+0000 7ff842a3f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 0x563d5dd8ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 0x563d5dd8ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55886/0 (socket says 172.21.15.35:55886) 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 -- 172.21.15.35:0/3944679598 learned_addr learned my addr 172.21.15.35:0/3944679598 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff841a3d700 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff84223e700 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd93be0 0x563d5dd93fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 -- 172.21.15.35:0/3944679598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 msgr2=0x563d5dd8e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd8e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 -- 172.21.15.35:0/3944679598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd93be0 msgr2=0x563d5dd93fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd93be0 0x563d5dd93fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 -- 172.21.15.35:0/3944679598 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d5db625d0 con 0x563d5dd8e960 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff84223e700 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd93be0 0x563d5dd93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff842a3f700 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 0x563d5dd8ed90 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7ff834009440 tx=0x7ff834009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc4e4784fd61359 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff82cdae700 1 -- 172.21.15.35:0/3944679598 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400e070 con 0x563d5dd8e960 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff82cdae700 1 -- 172.21.15.35:0/3944679598 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff83400f040 con 0x563d5dd8e960 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.099+0000 7ff82cdae700 1 -- 172.21.15.35:0/3944679598 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834015a90 con 0x563d5dd8e960 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 -- 172.21.15.35:0/3944679598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 msgr2=0x563d5dd8ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 0x563d5dd8ed90 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7ff834009440 tx=0x7ff834009920 comp rx=0 tx=0).stop 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 -- 172.21.15.35:0/3944679598 shutdown_connections 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd8e960 0x563d5dd8ed90 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd93be0 0x563d5dd93fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3944679598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd8e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 -- 172.21.15.35:0/3944679598 >> 172.21.15.35:0/3944679598 conn(0x563d5dbeb6b0 msgr2=0x563d5dd88a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 -- 172.21.15.35:0/3944679598 shutdown_connections 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 -- 172.21.15.35:0/3944679598 wait complete. 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 -- start start 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.100+0000 7ff85062fb80 1 Processor -- start 2023-03-17T11:33:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd93be0 0x563d5dd97670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 0x563d5dd97c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5db648c0 con 0x563d5dd944f0 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd98410 con 0x563d5dd8e960 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dda4000 con 0x563d5dd93be0 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff85062fb80 10 client.0 _ll_register_callbacks cb 0x563d5db86230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 0x563d5dd97c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 0x563d5dd97c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55892/0 (socket says 172.21.15.35:55892) 2023-03-17T11:33:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 -- 172.21.15.35:0/3346040604 learned_addr learned my addr 172.21.15.35:0/3346040604 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff84223e700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff841a3d700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd93be0 0x563d5dd97670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 -- 172.21.15.35:0/3346040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd93be0 msgr2=0x563d5dd97670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd93be0 0x563d5dd97670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 -- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 msgr2=0x563d5dd9a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 -- 172.21.15.35:0/3346040604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8340090f0 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff841a3d700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd93be0 0x563d5dd97670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff842a3f700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 0x563d5dd97c50 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ff8340168c0 tx=0x7ff8340168f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde899fe6c0d95a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.101+0000 7ff825ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff825ffb700 1 -- 172.21.15.35:0/3346040604 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400e040 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff825ffb700 1 -- 172.21.15.35:0/3346040604 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(368..368 src has 1..368) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff8340095e0 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d5dca3390 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff825ffb700 1 -- 172.21.15.35:0/3346040604 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff834013550 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 10 client.21015 fetch_fsmap learned FSMap version 108 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563d5db0ed80 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff825ffb700 1 -- 172.21.15.35:0/3346040604 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d5dca3390 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff825ffb700 1 -- 172.21.15.35:0/3346040604 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff834007500 con 0x563d5dd944f0 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 10 client.21015 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:33:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 10 client.21015 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 20 client.21015 populate_metadata read hostname 'smithi035' 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5dda7f40 0x563d5ddaa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 4 client.21015 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d5dcaf600 con 0x563d5dda7f40 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.102+0000 7ff84223e700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5dda7f40 0x563d5ddaa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.103+0000 7ff84223e700 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5dda7f40 0x563d5ddaa320 crc :-1 s=READY pgs=699 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19009738878dfb21 server_cookie=a51ec7277ad17e7b in_seq=0 out_seq=0 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.103+0000 7ff825ffb700 10 client.21015 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff825ffb700 1 -- 172.21.15.35:0/3346040604 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563d5dcaf600 con 0x563d5dda7f40 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff825ffb700 10 client.21015 handle_command_reply: tid=0 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 client.21015 shutdown 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 msgr2=0x563d5dd97c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 0x563d5dd97c50 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7ff8340168c0 tx=0x7ff8340168f0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 shutdown_connections 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5dda7f40 0x563d5ddaa320 crc :-1 s=READY pgs=699 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd944f0 0x563d5dd97c50 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff825ffb700 0 client.21015 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 --2- 172.21.15.35:0/3346040604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd93be0 0x563d5dd97670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 >> 172.21.15.35:0/3346040604 conn(0x563d5dbeb6b0 msgr2=0x563d5dd88a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 shutdown_connections 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 1 -- 172.21.15.35:0/3346040604 wait complete. 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.104+0000 7ff85062fb80 20 client.21015 trim_cache size 0 max 16384 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 Processor -- start 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 -- start start 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd8e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd89000 con 0x563d5dd93be0 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd840d0 con 0x563d5dd8e960 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.119+0000 7ff85062fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd855c0 con 0x563d5dd944f0 2023-03-17T11:33:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd88ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55898/0 (socket says 172.21.15.35:55898) 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 -- 172.21.15.35:0/754679535 learned_addr learned my addr 172.21.15.35:0/754679535 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff84223e700 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd8e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff842a3f700 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 -- 172.21.15.35:0/754679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 msgr2=0x563d5dd906b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd906b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 -- 172.21.15.35:0/754679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 msgr2=0x563d5dd8e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd8e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 -- 172.21.15.35:0/754679535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d5dd8f000 con 0x563d5dd93be0 2023-03-17T11:33:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff842a3f700 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd906b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:33:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff841a3d700 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd88ac0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff83000b980 tx=0x7ff830021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8460474e88541b85 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff82d5af700 1 -- 172.21.15.35:0/754679535 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000be50 con 0x563d5dd93be0 2023-03-17T11:33:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff82d5af700 1 -- 172.21.15.35:0/754679535 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff83002a050 con 0x563d5dd93be0 2023-03-17T11:33:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.120+0000 7ff82d5af700 1 -- 172.21.15.35:0/754679535 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000fc20 con 0x563d5dd93be0 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- 172.21.15.35:0/754679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 msgr2=0x563d5dd88ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd88ac0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff83000b980 tx=0x7ff830021000 comp rx=0 tx=0).stop 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- 172.21.15.35:0/754679535 shutdown_connections 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd906b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd8e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- 172.21.15.35:0/754679535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd88ac0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- 172.21.15.35:0/754679535 >> 172.21.15.35:0/754679535 conn(0x563d5dbeb6b0 msgr2=0x563d5dd91840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- 172.21.15.35:0/754679535 shutdown_connections 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- 172.21.15.35:0/754679535 wait complete. 2023-03-17T11:33:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- start start 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 Processor -- start 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd9cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd9d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd9da50 con 0x563d5dd93be0 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd9dbc0 con 0x563d5dd8e960 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5dd9dd80 con 0x563d5dd944f0 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.121+0000 7ff85062fb80 10 client.0 _ll_register_callbacks cb 0x563d5db86230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd9cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd9cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55904/0 (socket says 172.21.15.35:55904) 2023-03-17T11:33:40.261 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:55 smithi035 ceph-mon[92535]: pgmap v5169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 -- 172.21.15.35:0/1426017035 learned_addr learned my addr 172.21.15.35:0/1426017035 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff84223e700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff842a3f700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd9d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 -- 172.21.15.35:0/1426017035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 msgr2=0x563d5dd9d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd9d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 -- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 msgr2=0x563d5dd9eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 -- 172.21.15.35:0/1426017035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c10c7a0 con 0x563d5dd93be0 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff842a3f700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd9d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff841a3d700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd9cfd0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7ff830009350 tx=0x7ff830003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc55ddc0214f0da5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff825ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff825ffb700 1 -- 172.21.15.35:0/1426017035 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000f870 con 0x563d5dd93be0 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff825ffb700 1 -- 172.21.15.35:0/1426017035 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(368..368 src has 1..368) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ff83000f9d0 con 0x563d5dd93be0 2023-03-17T11:33:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d5dd5e1e0 con 0x563d5dd93be0 2023-03-17T11:33:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff825ffb700 1 -- 172.21.15.35:0/1426017035 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff83000fb90 con 0x563d5dd93be0 2023-03-17T11:33:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff85062fb80 10 client.21021 fetch_fsmap learned FSMap version 108 2023-03-17T11:33:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.122+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563d5daf7c00 con 0x563d5dd93be0 2023-03-17T11:33:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff825ffb700 1 -- 172.21.15.35:0/1426017035 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff830049020 con 0x563d5dd93be0 2023-03-17T11:33:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff825ffb700 1 -- 172.21.15.35:0/1426017035 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff830038c90 con 0x563d5dd93be0 2023-03-17T11:33:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff85062fb80 10 client.21021 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff85062fb80 10 client.21021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff85062fb80 20 client.21021 populate_metadata read hostname 'smithi035' 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff85062fb80 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5ddfcd10 0x563d5ddff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff85062fb80 4 client.21021 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563d5db64f00 con 0x563d5ddfcd10 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff84223e700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5ddfcd10 0x563d5ddff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff825ffb700 10 client.21021 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:42.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.123+0000 7ff84223e700 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5ddfcd10 0x563d5ddff120 crc :-1 s=READY pgs=700 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=160c265f17260cba server_cookie=1f4d38e790718cd3 in_seq=0 out_seq=0 2023-03-17T11:33:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.140+0000 7ff825ffb700 1 -- 172.21.15.35:0/1426017035 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563d5db64f00 con 0x563d5ddfcd10 2023-03-17T11:33:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.140+0000 7ff825ffb700 10 client.21021 handle_command_reply: tid=0 2023-03-17T11:33:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.140+0000 7ff85062fb80 1 client.21021 shutdown 2023-03-17T11:33:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.140+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 msgr2=0x563d5dd9cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.140+0000 7ff85062fb80 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd9cfd0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7ff830009350 tx=0x7ff830003ee0 comp rx=0 tx=0).stop 2023-03-17T11:33:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.140+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 shutdown_connections 2023-03-17T11:33:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d5ddfcd10 0x563d5ddff120 crc :-1 s=READY pgs=700 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d5dd944f0 0x563d5dd9d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d5dd8e960 0x563d5dd9eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 --2- 172.21.15.35:0/1426017035 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d5dd93be0 0x563d5dd9cfd0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff825ffb700 0 client.21021 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 >> 172.21.15.35:0/1426017035 conn(0x563d5dbeb6b0 msgr2=0x563d5dd98f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 shutdown_connections 2023-03-17T11:33:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 1 -- 172.21.15.35:0/1426017035 wait complete. 2023-03-17T11:33:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff85062fb80 20 client.21021 trim_cache size 0 max 16384 2023-03-17T11:33:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff82809f640 msgr2=0x7ff8280a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff82809f640 0x7ff8280a1af0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff83000b9b0 comp rx=0 tx=0).stop 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 msgr2=0x7ff83c1970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 0x7ff83c1970c0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7ff83800d980 tx=0x7ff83800dc90 comp rx=0 tx=0).stop 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 shutdown_connections 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff82809f640 0x7ff8280a1af0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff83c104390 0x7ff83c1a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff83c0ff350 0x7ff83c1970c0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 --2- 172.21.15.35:0/1391524310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff83c0ffcf0 0x7ff83c197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 >> 172.21.15.35:0/1391524310 conn(0x7ff83c076330 msgr2=0x7ff83c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 shutdown_connections 2023-03-17T11:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:13.141+0000 7ff8444a2700 1 -- 172.21.15.35:0/1391524310 wait complete. 2023-03-17T11:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 -- 172.21.15.35:0/1247937807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101da0 msgr2=0x7f120410a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 --2- 172.21.15.35:0/1247937807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101da0 0x7f120410a290 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009990 tx=0x7f11f4009ca0 comp rx=0 tx=0).stop 2023-03-17T11:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 -- 172.21.15.35:0/1247937807 shutdown_connections 2023-03-17T11:33:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 --2- 172.21.15.35:0/1247937807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120410a7d0 0x7f120410cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 --2- 172.21.15.35:0/1247937807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1204101490 0x7f1204101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 --2- 172.21.15.35:0/1247937807 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101da0 0x7f120410a290 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 -- 172.21.15.35:0/1247937807 >> 172.21.15.35:0/1247937807 conn(0x7f1204075f60 msgr2=0x7f1204076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:47.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 -- 172.21.15.35:0/1247937807 shutdown_connections 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.264+0000 7f1209d5b700 1 -- 172.21.15.35:0/1247937807 wait complete. 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 Processor -- start 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 -- start start 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 0x7f1204196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1204101da0 0x7f12041967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f120410a7d0 0x7f120419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120419b260 con 0x7f1204101490 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120419b3d0 con 0x7f1204101da0 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.265+0000 7f1209d5b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120419b590 con 0x7f120410a7d0 2023-03-17T11:33:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 0x7f1204196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 0x7f1204196280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55914/0 (socket says 172.21.15.35:55914) 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 -- 172.21.15.35:0/341715512 learned_addr learned my addr 172.21.15.35:0/341715512 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1202ffd700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1204101da0 0x7f12041967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1203fff700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f120410a7d0 0x7f120419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 -- 172.21.15.35:0/341715512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f120410a7d0 msgr2=0x7f120419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f120410a7d0 0x7f120419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 -- 172.21.15.35:0/341715512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1204101da0 msgr2=0x7f12041967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1204101da0 0x7f12041967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 -- 172.21.15.35:0/341715512 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f40095f0 con 0x7f1204101490 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1202ffd700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1204101da0 0x7f12041967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f12037fe700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 0x7f1204196280 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f11f800e9a0 tx=0x7f11f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1200ff9700 1 -- 172.21.15.35:0/341715512 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8009790 con 0x7f1204101490 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1204110170 con 0x7f1204101490 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1200ff9700 1 -- 172.21.15.35:0/341715512 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11f8010430 con 0x7f1204101490 2023-03-17T11:33:48.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1200ff9700 1 -- 172.21.15.35:0/341715512 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800cea0 con 0x7f1204101490 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.266+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120410ffe0 con 0x7f1204101490 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.269+0000 7f1200ff9700 1 -- 172.21.15.35:0/341715512 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f11f80105a0 con 0x7f1204101490 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.269+0000 7f1200ff9700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f11ec09f640 0x7f11ec0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.269+0000 7f1202ffd700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f11ec09f640 0x7f11ec0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.269+0000 7f1200ff9700 1 -- 172.21.15.35:0/341715512 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f11f8014070 con 0x7f1204101490 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1202ffd700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f11ec09f640 0x7f11ec0a1af0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1204197890 tx=0x7f11f400b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 Processor -- start 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 -- start start 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc29fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc24420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefb2b010 con 0x558fefc29be0 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefb7d950 con 0x558fefc2a4f0 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefb76de0 con 0x558fefc24960 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.270+0000 7f12037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc29fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc29fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55922/0 (socket says 172.21.15.35:55922) 2023-03-17T11:33:48.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 -- 172.21.15.35:0/951946048 learned_addr learned my addr 172.21.15.35:0/951946048 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f1203fff700 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f1202ffd700 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc24420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 -- 172.21.15.35:0/951946048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 msgr2=0x558fefc24d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc24d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 -- 172.21.15.35:0/951946048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 msgr2=0x558fefc24420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc24420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 -- 172.21.15.35:0/951946048 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fef9f85d0 con 0x558fefc29be0 2023-03-17T11:33:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f12037fe700 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc29fb0 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f11f8094900 tx=0x7f11f8097fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bb39ef16c777cf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f11e9ffb700 1 -- 172.21.15.35:0/951946048 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80a05f0 con 0x558fefc29be0 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f11e9ffb700 1 -- 172.21.15.35:0/951946048 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11f80967a0 con 0x558fefc29be0 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.271+0000 7f11e9ffb700 1 -- 172.21.15.35:0/951946048 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8097b30 con 0x558fefc29be0 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 -- 172.21.15.35:0/951946048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 msgr2=0x558fefc29fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc29fb0 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f11f8094900 tx=0x7f11f8097fc0 comp rx=0 tx=0).stop 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 -- 172.21.15.35:0/951946048 shutdown_connections 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc24d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc29fb0 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/951946048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc24420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 -- 172.21.15.35:0/951946048 >> 172.21.15.35:0/951946048 conn(0x558fefa816b0 msgr2=0x558fefc1ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 -- 172.21.15.35:0/951946048 shutdown_connections 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 -- 172.21.15.35:0/951946048 wait complete. 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.272+0000 7f1215ee8b80 1 -- start start 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 Processor -- start 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc2d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc2de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef9fa8c0 con 0x558fefc29be0 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc2e5c0 con 0x558fefc2a4f0 2023-03-17T11:33:51.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc39fd0 con 0x558fefc24960 2023-03-17T11:33:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1215ee8b80 10 client.0 _ll_register_callbacks cb 0x558fefa1c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc2d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc2d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55930/0 (socket says 172.21.15.35:55930) 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 -- 172.21.15.35:0/1718240166 learned_addr learned my addr 172.21.15.35:0/1718240166 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1203fff700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc2de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f12037fe700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 -- 172.21.15.35:0/1718240166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 msgr2=0x558fefc304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 -- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 msgr2=0x558fefc2de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc2de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1202ffd700 1 -- 172.21.15.35:0/1718240166 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120410ffe0 con 0x558fefc29be0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.273+0000 7f1203fff700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc2de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1202ffd700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc2d740 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f11f4015000 tx=0x7f11f4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2ab4a0aac75881 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f11e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f11e2ffd700 1 -- 172.21.15.35:0/1718240166 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4024a20 con 0x558fefc29be0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f11e2ffd700 1 -- 172.21.15.35:0/1718240166 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f11f4024b80 con 0x558fefc29be0 2023-03-17T11:33:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fefb39390 con 0x558fefc29be0 2023-03-17T11:33:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f11e2ffd700 1 -- 172.21.15.35:0/1718240166 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11f4024d80 con 0x558fefc29be0 2023-03-17T11:33:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 10 client.21033 fetch_fsmap learned FSMap version 108 2023-03-17T11:33:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x558fef9a4d80 con 0x558fefc29be0 2023-03-17T11:33:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f11e2ffd700 1 -- 172.21.15.35:0/1718240166 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11f403e020 con 0x558fefc29be0 2023-03-17T11:33:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f11e2ffd700 1 -- 172.21.15.35:0/1718240166 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f11f40304c0 con 0x558fefc29be0 2023-03-17T11:33:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 10 client.21033 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:33:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 10 client.21033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:33:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 20 client.21033 populate_metadata read hostname 'smithi035' 2023-03-17T11:33:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc3e110 0x558fefc40520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 4 client.21033 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:33:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.274+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fefb45600 con 0x558fefc3e110 2023-03-17T11:33:52.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:57 smithi035 ceph-mon[92535]: pgmap v5170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:33:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.275+0000 7f12037fe700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc3e110 0x558fefc40520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:33:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.275+0000 7f11e2ffd700 10 client.21033 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.275+0000 7f12037fe700 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc3e110 0x558fefc40520 crc :-1 s=READY pgs=701 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452950aba23a619d server_cookie=608bc86c6ff8de7e in_seq=0 out_seq=0 2023-03-17T11:33:54.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f11e2ffd700 1 -- 172.21.15.35:0/1718240166 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558fefb45600 con 0x558fefc3e110 2023-03-17T11:33:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f11e2ffd700 10 client.21033 handle_command_reply: tid=0 2023-03-17T11:33:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 client.21033 shutdown 2023-03-17T11:33:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 msgr2=0x558fefc2d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:33:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc2d740 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f11f4015000 tx=0x7f11f4009ca0 comp rx=0 tx=0).stop 2023-03-17T11:33:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 shutdown_connections 2023-03-17T11:33:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc3e110 0x558fefc40520 crc :-1 s=READY pgs=701 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:57.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc2a4f0 0x558fefc2de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:57.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/1718240166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc2d740 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:33:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f11e2ffd700 0 client.21033 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:33:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 >> 172.21.15.35:0/1718240166 conn(0x558fefa816b0 msgr2=0x558fefc23410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:33:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 shutdown_connections 2023-03-17T11:33:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 1 -- 172.21.15.35:0/1718240166 wait complete. 2023-03-17T11:33:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.276+0000 7f1215ee8b80 20 client.21033 trim_cache size 0 max 16384 2023-03-17T11:33:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 Processor -- start 2023-03-17T11:33:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 -- start start 2023-03-17T11:33:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc1eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc29be0 0x558fefc34f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 0x558fefc2fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:33:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc1a0f0 con 0x558fefc2a4f0 2023-03-17T11:33:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc247d0 con 0x558fefc29be0 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc1f380 con 0x558fefc24960 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1203fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 0x558fefc2fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1203fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 0x558fefc2fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55940/0 (socket says 172.21.15.35:55940) 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1203fff700 1 -- 172.21.15.35:0/3565688012 learned_addr learned my addr 172.21.15.35:0/3565688012 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f12037fe700 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc1eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.292+0000 7f1202ffd700 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc29be0 0x558fefc34f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:00.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1203fff700 1 -- 172.21.15.35:0/3565688012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 msgr2=0x558fefc1eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1203fff700 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc1eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1203fff700 1 -- 172.21.15.35:0/3565688012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc29be0 msgr2=0x558fefc34f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1203fff700 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc29be0 0x558fefc34f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1203fff700 1 -- 172.21.15.35:0/3565688012 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fefb3d130 con 0x558fefc2a4f0 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1203fff700 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 0x558fefc2fff0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009ea0 tx=0x7f11fc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7bdcaec9bf2aa8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f11ea7fc700 1 -- 172.21.15.35:0/3565688012 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc007d20 con 0x558fefc2a4f0 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f11ea7fc700 1 -- 172.21.15.35:0/3565688012 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11fc00f040 con 0x558fefc2a4f0 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f11ea7fc700 1 -- 172.21.15.35:0/3565688012 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc01f660 con 0x558fefc2a4f0 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3565688012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 msgr2=0x558fefc2fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.293+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 0x558fefc2fff0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009ea0 tx=0x7f11fc009ed0 comp rx=0 tx=0).stop 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3565688012 shutdown_connections 2023-03-17T11:34:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc2a4f0 0x558fefc2fff0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc24960 0x558fefc1eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3565688012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc29be0 0x558fefc34f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3565688012 >> 172.21.15.35:0/3565688012 conn(0x558fefa816b0 msgr2=0x558fefc23a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:01.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3565688012 shutdown_connections 2023-03-17T11:34:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3565688012 wait complete. 2023-03-17T11:34:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- start start 2023-03-17T11:34:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 Processor -- start 2023-03-17T11:34:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc24960 0x558fefc330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc33630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc2a4f0 0x558fefc8af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc8b530 con 0x558fefc29be0 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc8b6a0 con 0x558fefc24960 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.294+0000 7f1215ee8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fefc8b860 con 0x558fefc2a4f0 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1215ee8b80 10 client.0 _ll_register_callbacks cb 0x558fefa1c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc33630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc33630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55944/0 (socket says 172.21.15.35:55944) 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 -- 172.21.15.35:0/3432053139 learned_addr learned my addr 172.21.15.35:0/3432053139 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1203fff700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc2a4f0 0x558fefc8af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f12037fe700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc24960 0x558fefc330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 -- 172.21.15.35:0/3432053139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc2a4f0 msgr2=0x558fefc8af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:03.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc2a4f0 0x558fefc8af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 -- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc24960 msgr2=0x558fefc330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc24960 0x558fefc330f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 -- 172.21.15.35:0/3432053139 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc009b50 con 0x558fefc29be0 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f12037fe700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc24960 0x558fefc330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1202ffd700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc33630 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009990 tx=0x7f11f403a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7877ef563797c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f11e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f11e2ffd700 1 -- 172.21.15.35:0/3432053139 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4024b00 con 0x558fefc29be0 2023-03-17T11:34:03.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f11e2ffd700 1 -- 172.21.15.35:0/3432053139 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f11f403f080 con 0x558fefc29be0 2023-03-17T11:34:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fefbf41e0 con 0x558fefc29be0 2023-03-17T11:34:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f11e2ffd700 1 -- 172.21.15.35:0/3432053139 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11f40309f0 con 0x558fefc29be0 2023-03-17T11:34:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1215ee8b80 10 client.21039 fetch_fsmap learned FSMap version 108 2023-03-17T11:34:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.295+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x558fef9cb1f0 con 0x558fefc29be0 2023-03-17T11:34:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f11e2ffd700 1 -- 172.21.15.35:0/3432053139 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558fefbf41e0 con 0x558fefc29be0 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f11e2ffd700 1 -- 172.21.15.35:0/3432053139 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f11f400fb90 con 0x558fefc29be0 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f1215ee8b80 10 client.21039 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f1215ee8b80 10 client.21039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f1215ee8b80 20 client.21039 populate_metadata read hostname 'smithi035' 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc92c60 0x558fefc95070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f1215ee8b80 4 client.21039 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558fef9faf00 con 0x558fefc92c60 2023-03-17T11:34:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f12037fe700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc92c60 0x558fefc95070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f11e2ffd700 10 client.21039 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.296+0000 7f12037fe700 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc92c60 0x558fefc95070 crc :-1 s=READY pgs=702 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6430845549bf6e95 server_cookie=411804339b18dac1 in_seq=0 out_seq=0 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f11e2ffd700 1 -- 172.21.15.35:0/3432053139 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558fef9faf00 con 0x558fefc92c60 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f11e2ffd700 10 client.21039 handle_command_reply: tid=0 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 client.21039 shutdown 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 msgr2=0x558fefc33630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc33630 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009990 tx=0x7f11f403a960 comp rx=0 tx=0).stop 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 shutdown_connections 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fefc92c60 0x558fefc95070 crc :-1 s=READY pgs=702 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fefc2a4f0 0x558fefc8af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f11e2ffd700 0 client.21039 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fefc24960 0x558fefc330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 --2- 172.21.15.35:0/3432053139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fefc29be0 0x558fefc33630 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 >> 172.21.15.35:0/3432053139 conn(0x558fefa816b0 msgr2=0x558fefc2cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 shutdown_connections 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.309+0000 7f1215ee8b80 1 -- 172.21.15.35:0/3432053139 wait complete. 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1215ee8b80 20 client.21039 trim_cache size 0 max 16384 2023-03-17T11:34:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f11ec09f640 msgr2=0x7f11ec0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f11ec09f640 0x7f11ec0a1af0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1204197890 tx=0x7f11f400b260 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 msgr2=0x7f1204196280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 0x7f1204196280 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f11f800e9a0 tx=0x7f11f800ecb0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 shutdown_connections 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f11ec09f640 0x7f11ec0a1af0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f120410a7d0 0x7f120419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1204101490 0x7f1204196280 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 --2- 172.21.15.35:0/341715512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1204101da0 0x7f12041967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 >> 172.21.15.35:0/341715512 conn(0x7f1204075f60 msgr2=0x7f120410b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 shutdown_connections 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:26.310+0000 7f1209d5b700 1 -- 172.21.15.35:0/341715512 wait complete. 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 -- 172.21.15.35:0/2003167544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c2010cb00 msgr2=0x7f8c2010eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/2003167544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c2010cb00 0x7f8c2010eee0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800b0a0 tx=0x7f8c1800b3b0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 -- 172.21.15.35:0/2003167544 shutdown_connections 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/2003167544 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c2010cb00 0x7f8c2010eee0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/2003167544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c200fef50 0x7f8c200ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/2003167544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200ff860 0x7f8c2010c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 -- 172.21.15.35:0/2003167544 >> 172.21.15.35:0/2003167544 conn(0x7f8c20076330 msgr2=0x7f8c20076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 -- 172.21.15.35:0/2003167544 shutdown_connections 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.432+0000 7f8c27b9c700 1 -- 172.21.15.35:0/2003167544 wait complete. 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.433+0000 7f8c27b9c700 1 Processor -- start 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.433+0000 7f8c27b9c700 1 -- start start 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c27b9c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200fef50 0x7f8c20198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c27b9c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 0x7f8c20198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c27b9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c2010cb00 0x7f8c2019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:10.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c27b9c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2019d570 con 0x7f8c200ff860 2023-03-17T11:34:10.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c27b9c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2019d6e0 con 0x7f8c200fef50 2023-03-17T11:34:10.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c27b9c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2019d8a0 con 0x7f8c2010cb00 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 0x7f8c20198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 0x7f8c20198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55958/0 (socket says 172.21.15.35:55958) 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 -- 172.21.15.35:0/393193219 learned_addr learned my addr 172.21.15.35:0/393193219 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c26139700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c2010cb00 0x7f8c2019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25938700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200fef50 0x7f8c20198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 -- 172.21.15.35:0/393193219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c2010cb00 msgr2=0x7f8c2019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c2010cb00 0x7f8c2019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 -- 172.21.15.35:0/393193219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200fef50 msgr2=0x7f8c20198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200fef50 0x7f8c20198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 -- 172.21.15.35:0/393193219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18009d00 con 0x7f8c200ff860 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25938700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200fef50 0x7f8c20198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:34:10.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c25137700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 0x7f8c20198ad0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000e9a0 tx=0x7f8c1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c16ffd700 1 -- 172.21.15.35:0/393193219 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10009790 con 0x7f8c200ff860 2023-03-17T11:34:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.434+0000 7f8c16ffd700 1 -- 172.21.15.35:0/393193219 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c1000cbd0 con 0x7f8c200ff860 2023-03-17T11:34:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.435+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c201122d0 con 0x7f8c200ff860 2023-03-17T11:34:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.435+0000 7f8c16ffd700 1 -- 172.21.15.35:0/393193219 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10018680 con 0x7f8c200ff860 2023-03-17T11:34:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.435+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c20112140 con 0x7f8c200ff860 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.437+0000 7f8c16ffd700 1 -- 172.21.15.35:0/393193219 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8c1000cd40 con 0x7f8c200ff860 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.438+0000 7f8c16ffd700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0c09f640 0x7f8c0c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.438+0000 7f8c25938700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0c09f640 0x7f8c0c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.438+0000 7f8c16ffd700 1 -- 172.21.15.35:0/393193219 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c10014070 con 0x7f8c200ff860 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.438+0000 7f8c25938700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0c09f640 0x7f8c0c0a1af0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00bc10 tx=0x7f8c1c00b5f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.438+0000 7f8c33d29b80 1 Processor -- start 2023-03-17T11:34:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 -- start start 2023-03-17T11:34:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563481fc4010 con 0x5634820bd960 2023-03-17T11:34:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563482016950 con 0x5634820c34f0 2023-03-17T11:34:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348200fde0 con 0x5634820c2be0 2023-03-17T11:34:13.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c26139700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:13.094 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:22:59 smithi035 ceph-mon[92535]: pgmap v5171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:34:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c26139700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55968/0 (socket says 172.21.15.35:55968) 2023-03-17T11:34:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c25137700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c26139700 1 -- 172.21.15.35:0/397467625 learned_addr learned my addr 172.21.15.35:0/397467625 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.439+0000 7f8c25938700 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c26139700 1 -- 172.21.15.35:0/397467625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 msgr2=0x5634820c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c26139700 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c26139700 1 -- 172.21.15.35:0/397467625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 msgr2=0x5634820bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c26139700 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c26139700 1 -- 172.21.15.35:0/397467625 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563481e915d0 con 0x5634820bd960 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c25137700 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c26139700 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820bdd90 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f8c180062a0 tx=0x7f8c180093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f220eb8e5611cd31 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c0bfff700 1 -- 172.21.15.35:0/397467625 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800e040 con 0x5634820bd960 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c0bfff700 1 -- 172.21.15.35:0/397467625 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c18007d90 con 0x5634820bd960 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.440+0000 7f8c0bfff700 1 -- 172.21.15.35:0/397467625 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18003c60 con 0x5634820bd960 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 -- 172.21.15.35:0/397467625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 msgr2=0x5634820bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820bdd90 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f8c180062a0 tx=0x7f8c180093b0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 -- 172.21.15.35:0/397467625 shutdown_connections 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820bdd90 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/397467625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 -- 172.21.15.35:0/397467625 >> 172.21.15.35:0/397467625 conn(0x563481f1a6b0 msgr2=0x5634820b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 -- 172.21.15.35:0/397467625 shutdown_connections 2023-03-17T11:34:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 -- 172.21.15.35:0/397467625 wait complete. 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 -- start start 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.441+0000 7f8c33d29b80 1 Processor -- start 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563481e938c0 con 0x5634820bd960 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634820c7250 con 0x5634820c34f0 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634820c7410 con 0x5634820c2be0 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c33d29b80 10 client.0 _ll_register_callbacks cb 0x563481eb5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:34:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55970/0 (socket says 172.21.15.35:55970) 2023-03-17T11:34:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 -- 172.21.15.35:0/187775169 learned_addr learned my addr 172.21.15.35:0/187775169 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c26139700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25137700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 -- 172.21.15.35:0/187775169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 msgr2=0x5634820c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 -- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 msgr2=0x5634820c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 -- 172.21.15.35:0/187775169 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2010fab0 con 0x5634820bd960 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c26139700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25137700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c25938700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820c93c0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00fe60 tx=0x7f8c1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc64edcc1adf310d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.442+0000 7f8c097fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c097fa700 1 -- 172.21.15.35:0/187775169 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c01f630 con 0x5634820bd960 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c097fa700 1 -- 172.21.15.35:0/187775169 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c1c01f790 con 0x5634820bd960 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563481fd2390 con 0x5634820bd960 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c097fa700 1 -- 172.21.15.35:0/187775169 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c1c011e70 con 0x5634820bd960 2023-03-17T11:34:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 10 client.21051 fetch_fsmap learned FSMap version 108 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563481e3dd80 con 0x5634820bd960 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c097fa700 1 -- 172.21.15.35:0/187775169 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563481fd2390 con 0x5634820bd960 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c097fa700 1 -- 172.21.15.35:0/187775169 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8c1c025020 con 0x5634820bd960 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 10 client.21051 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 10 client.21051 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 20 client.21051 populate_metadata read hostname 'smithi035' 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634820d6f70 0x5634820d9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 4 client.21051 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.443+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563481fde600 con 0x5634820d6f70 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.444+0000 7f8c25137700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634820d6f70 0x5634820d9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.444+0000 7f8c25137700 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634820d6f70 0x5634820d9380 crc :-1 s=READY pgs=703 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9afff78dc9b0f91 server_cookie=939d6eb9bb2d92ba in_seq=0 out_seq=0 2023-03-17T11:34:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.444+0000 7f8c097fa700 10 client.21051 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c097fa700 1 -- 172.21.15.35:0/187775169 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563481fde600 con 0x5634820d6f70 2023-03-17T11:34:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c097fa700 10 client.21051 handle_command_reply: tid=0 2023-03-17T11:34:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 client.21051 shutdown 2023-03-17T11:34:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 msgr2=0x5634820c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820c93c0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00fe60 tx=0x7f8c1c004750 comp rx=0 tx=0).stop 2023-03-17T11:34:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 shutdown_connections 2023-03-17T11:34:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634820d6f70 0x5634820d9380 crc :-1 s=READY pgs=703 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c34f0 0x5634820c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820bd960 0x5634820c93c0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/187775169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c097fa700 0 client.21051 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 >> 172.21.15.35:0/187775169 conn(0x563481f1a6b0 msgr2=0x5634820b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 shutdown_connections 2023-03-17T11:34:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 1 -- 172.21.15.35:0/187775169 wait complete. 2023-03-17T11:34:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.445+0000 7f8c33d29b80 20 client.21051 trim_cache size 0 max 16384 2023-03-17T11:34:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 Processor -- start 2023-03-17T11:34:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 -- start start 2023-03-17T11:34:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820bd960 0x5634820bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563481fde600 con 0x5634820c34f0 2023-03-17T11:34:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563481fd2390 con 0x5634820bd960 2023-03-17T11:34:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634820b30f0 con 0x5634820c2be0 2023-03-17T11:34:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c26139700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c26139700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55982/0 (socket says 172.21.15.35:55982) 2023-03-17T11:34:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c26139700 1 -- 172.21.15.35:0/680465618 learned_addr learned my addr 172.21.15.35:0/680465618 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.460+0000 7f8c25938700 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820bd960 0x5634820bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c25137700 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c26139700 1 -- 172.21.15.35:0/680465618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 msgr2=0x5634820b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c26139700 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c26139700 1 -- 172.21.15.35:0/680465618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820bd960 msgr2=0x5634820bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c26139700 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820bd960 0x5634820bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c26139700 1 -- 172.21.15.35:0/680465618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634820be000 con 0x5634820c34f0 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c25137700 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c26139700 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820c40a0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800b0a0 tx=0x7f8c1800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb550e554d2a831 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c14dae700 1 -- 172.21.15.35:0/680465618 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800e040 con 0x5634820c34f0 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c14dae700 1 -- 172.21.15.35:0/680465618 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c1800bcb0 con 0x5634820c34f0 2023-03-17T11:34:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.461+0000 7f8c14dae700 1 -- 172.21.15.35:0/680465618 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18005310 con 0x5634820c34f0 2023-03-17T11:34:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- 172.21.15.35:0/680465618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 msgr2=0x5634820c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:18.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820c40a0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f8c1800b0a0 tx=0x7f8c1800b7b0 comp rx=0 tx=0).stop 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- 172.21.15.35:0/680465618 shutdown_connections 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820c40a0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820bd960 0x5634820bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/680465618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820c2be0 0x5634820b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- 172.21.15.35:0/680465618 >> 172.21.15.35:0/680465618 conn(0x563481f1a6b0 msgr2=0x5634820c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- 172.21.15.35:0/680465618 shutdown_connections 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- 172.21.15.35:0/680465618 wait complete. 2023-03-17T11:34:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- start start 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 Processor -- start 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820bd960 0x5634820c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c2be0 0x5634820ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.462+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563482129fb0 con 0x5634820c34f0 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348212a120 con 0x5634820c2be0 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c33d29b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56348212a2e0 con 0x5634820bd960 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c33d29b80 10 client.0 _ll_register_callbacks cb 0x563481eb5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55988/0 (socket says 172.21.15.35:55988) 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 -- 172.21.15.35:0/2142974943 learned_addr learned my addr 172.21.15.35:0/2142974943 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c25137700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c2be0 0x5634820ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c25938700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820bd960 0x5634820c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 -- 172.21.15.35:0/2142974943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820bd960 msgr2=0x5634820c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820bd960 0x5634820c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:24.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 -- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c2be0 msgr2=0x5634820ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c2be0 0x5634820ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 -- 172.21.15.35:0/2142974943 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563481e915d0 con 0x5634820c34f0 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c26139700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820ca960 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009040 tx=0x7f8c18003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56687b647181375 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c097fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c097fa700 1 -- 172.21.15.35:0/2142974943 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18003ea0 con 0x5634820c34f0 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c097fa700 1 -- 172.21.15.35:0/2142974943 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8c180052c0 con 0x5634820c34f0 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56348208d1e0 con 0x5634820c34f0 2023-03-17T11:34:24.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.463+0000 7f8c097fa700 1 -- 172.21.15.35:0/2142974943 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c1800be20 con 0x5634820c34f0 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 10 client.21057 fetch_fsmap learned FSMap version 108 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563481e26c00 con 0x5634820c34f0 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c097fa700 1 -- 172.21.15.35:0/2142974943 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56348208d1e0 con 0x5634820c34f0 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c097fa700 1 -- 172.21.15.35:0/2142974943 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8c18019050 con 0x5634820c34f0 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 10 client.21057 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 10 client.21057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 20 client.21057 populate_metadata read hostname 'smithi035' 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348212b4b0 0x56348212d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 4 client.21057 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563481e93f00 con 0x56348212b4b0 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.464+0000 7f8c25938700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348212b4b0 0x56348212d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.465+0000 7f8c097fa700 10 client.21057 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.465+0000 7f8c25938700 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348212b4b0 0x56348212d890 crc :-1 s=READY pgs=704 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3635c89731323d33 server_cookie=8fda9615efff0376 in_seq=0 out_seq=0 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c097fa700 1 -- 172.21.15.35:0/2142974943 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563481e93f00 con 0x56348212b4b0 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c097fa700 10 client.21057 handle_command_reply: tid=0 2023-03-17T11:34:24.021 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 client.21057 shutdown 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 msgr2=0x5634820ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820ca960 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009040 tx=0x7f8c18003c30 comp rx=0 tx=0).stop 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 shutdown_connections 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56348212b4b0 0x56348212d890 crc :-1 s=READY pgs=704 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5634820c34f0 0x5634820ca960 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5634820bd960 0x5634820c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c097fa700 0 client.21057 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 --2- 172.21.15.35:0/2142974943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634820c2be0 0x5634820ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 >> 172.21.15.35:0/2142974943 conn(0x563481f1a6b0 msgr2=0x5634820c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 shutdown_connections 2023-03-17T11:34:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 1 -- 172.21.15.35:0/2142974943 wait complete. 2023-03-17T11:34:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.477+0000 7f8c33d29b80 20 client.21057 trim_cache size 0 max 16384 2023-03-17T11:34:25.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:01 smithi035 ceph-mon[92535]: pgmap v5172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:34:25.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:03 smithi035 ceph-mon[92535]: pgmap v5173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:05 smithi035 ceph-mon[92535]: pgmap v5174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:07 smithi035 ceph-mon[92535]: pgmap v5175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:09 smithi035 ceph-mon[92535]: pgmap v5176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 28 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:09 smithi035 ceph-mon[92535]: osdmap e392: 12 total, 12 up, 12 in 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:11 smithi035 ceph-mon[92535]: pgmap v5178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:13 smithi035 ceph-mon[92535]: pgmap v5179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:15 smithi035 ceph-mon[92535]: pgmap v5180: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:17 smithi035 ceph-mon[92535]: pgmap v5181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:17 smithi035 ceph-mon[92535]: osdmap e393: 12 total, 12 up, 12 in 2023-03-17T11:34:25.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:19 smithi035 ceph-mon[92535]: pgmap v5183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 106 B/s wr, 10 op/s 2023-03-17T11:34:26.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:21 smithi035 ceph-mon[92535]: pgmap v5184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:34:26.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:23 smithi035 ceph-mon[92535]: pgmap v5185: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:34:26.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:25 smithi035 ceph-mon[92535]: pgmap v5186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:34:26.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:27 smithi035 ceph-mon[92535]: pgmap v5187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:34:26.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:34:26.605 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:29 smithi035 ceph-mon[92535]: pgmap v5188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 372 B/s wr, 9 op/s 2023-03-17T11:34:28.650 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:34:28.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:34:28.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:34:28.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:30 smithi035 ceph-mon[92535]: pgmap v5189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T11:34:28.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:30 smithi035 ceph-mon[92535]: pgmap v5190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T11:34:28.651 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:32 smithi035 ceph-mon[92535]: pgmap v5191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:34:30.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:34 smithi035 ceph-mon[92535]: pgmap v5192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:34:30.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:36 smithi035 ceph-mon[92535]: pgmap v5193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:34:30.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:38 smithi035 ceph-mon[92535]: pgmap v5194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:34:30.458 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:40 smithi035 ceph-mon[92535]: pgmap v5195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:34:30.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:42 smithi035 ceph-mon[92535]: pgmap v5196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:34:30.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:44 smithi035 ceph-mon[92535]: pgmap v5197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:34:30.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:46 smithi035 ceph-mon[92535]: pgmap v5198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:30.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:48 smithi035 ceph-mon[92535]: pgmap v5199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:34:30.984 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:50 smithi035 ceph-mon[92535]: pgmap v5200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:34:30.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:52 smithi035 ceph-mon[92535]: pgmap v5201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:34:30.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:54 smithi035 ceph-mon[92535]: pgmap v5202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:34:30.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:56 smithi035 ceph-mon[92535]: pgmap v5203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:34:30.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:23:58 smithi035 ceph-mon[92535]: pgmap v5204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:34:30.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:00 smithi035 ceph-mon[92535]: pgmap v5205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:32.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:02 smithi035 ceph-mon[92535]: pgmap v5206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:32.013 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:04 smithi035 ceph-mon[92535]: pgmap v5207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:06 smithi035 ceph-mon[92535]: pgmap v5208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:08 smithi035 ceph-mon[92535]: pgmap v5209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:09 smithi035 ceph-mon[92535]: osdmap e394: 12 total, 12 up, 12 in 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:10 smithi035 ceph-mon[92535]: pgmap v5211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:12 smithi035 ceph-mon[92535]: pgmap v5212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:14 smithi035 ceph-mon[92535]: pgmap v5213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:34:32.354 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:16 smithi035 ceph-mon[92535]: pgmap v5214: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:34:33.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:18 smithi035 ceph-mon[92535]: pgmap v5215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:34:33.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:18 smithi035 ceph-mon[92535]: osdmap e395: 12 total, 12 up, 12 in 2023-03-17T11:34:33.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:20 smithi035 ceph-mon[92535]: pgmap v5217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:34:33.975 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:22 smithi035 ceph-mon[92535]: pgmap v5218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:34:33.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:24 smithi035 ceph-mon[92535]: pgmap v5219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:34:33.976 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:26 smithi035 ceph-mon[92535]: pgmap v5220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:34:34.403 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:28 smithi035 ceph-mon[92535]: pgmap v5221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:34:35.619 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:34:35.619 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:30 smithi035 ceph-mon[92535]: pgmap v5222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:35.619 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:34:35.619 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:34:35.619 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:34:35.620 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:31 smithi035 ceph-mon[92535]: pgmap v5223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:31 smithi035 ceph-mon[92535]: pgmap v5224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:33 smithi035 ceph-mon[92535]: pgmap v5225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:35 smithi035 ceph-mon[92535]: pgmap v5226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:37 smithi035 ceph-mon[92535]: pgmap v5227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:39 smithi035 ceph-mon[92535]: pgmap v5228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:41 smithi035 ceph-mon[92535]: pgmap v5229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:34:36.610 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:43 smithi035 ceph-mon[92535]: pgmap v5230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:34:37.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:45 smithi035 ceph-mon[92535]: pgmap v5231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:37.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:47 smithi035 ceph-mon[92535]: pgmap v5232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:37.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:49 smithi035 ceph-mon[92535]: pgmap v5233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:34:37.150 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:51 smithi035 ceph-mon[92535]: pgmap v5234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:34:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:34:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:34:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:34:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:34:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:34:37.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:34:37.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:34:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0c09f640 msgr2=0x7f8c0c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0c09f640 0x7f8c0c0a1af0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00bc10 tx=0x7f8c1c00b5f0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 msgr2=0x7f8c20198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 0x7f8c20198ad0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000e9a0 tx=0x7f8c1000ecb0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 shutdown_connections 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8c0c09f640 0x7f8c0c0a1af0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c2010cb00 0x7f8c2019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c200fef50 0x7f8c20198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 --2- 172.21.15.35:0/393193219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8c200ff860 0x7f8c20198ad0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 >> 172.21.15.35:0/393193219 conn(0x7f8c20076330 msgr2=0x7f8c200fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 shutdown_connections 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:39.478+0000 7f8c27b9c700 1 -- 172.21.15.35:0/393193219 wait complete. 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 -- 172.21.15.35:0/1185139584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 msgr2=0x7f8dbc0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 --2- 172.21.15.35:0/1185139584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc0ff720 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f8db80099c0 tx=0x7f8db8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 -- 172.21.15.35:0/1185139584 shutdown_connections 2023-03-17T11:34:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 --2- 172.21.15.35:0/1185139584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc104390 0x7f8dbc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 --2- 172.21.15.35:0/1185139584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc0ff720 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 --2- 172.21.15.35:0/1185139584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dbc0ffcf0 0x7f8dbc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.600+0000 7f8dc3826700 1 -- 172.21.15.35:0/1185139584 >> 172.21.15.35:0/1185139584 conn(0x7f8dbc076330 msgr2=0x7f8dbc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 -- 172.21.15.35:0/1185139584 shutdown_connections 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 -- 172.21.15.35:0/1185139584 wait complete. 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 Processor -- start 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 -- start start 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dbc0ffcf0 0x7f8dbc196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc104390 0x7f8dbc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc19b220 con 0x7f8dbc0ff350 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc19b390 con 0x7f8dbc0ffcf0 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.601+0000 7f8dc3826700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc19b550 con 0x7f8dbc104390 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:55998/0 (socket says 172.21.15.35:55998) 2023-03-17T11:34:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 -- 172.21.15.35:0/3513139670 learned_addr learned my addr 172.21.15.35:0/3513139670 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc104390 0x7f8dbc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dbc0ffcf0 0x7f8dbc196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 -- 172.21.15.35:0/3513139670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc104390 msgr2=0x7f8dbc19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc104390 0x7f8dbc19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 -- 172.21.15.35:0/3513139670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dbc0ffcf0 msgr2=0x7f8dbc196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dbc0ffcf0 0x7f8dbc196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 -- 172.21.15.35:0/3513139670 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80095f0 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc196240 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f8db8005910 tx=0x7f8db8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8db27fc700 1 -- 172.21.15.35:0/3513139670 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db801d070 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc10f000 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8db27fc700 1 -- 172.21.15.35:0/3513139670 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8db8022470 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8db27fc700 1 -- 172.21.15.35:0/3513139670 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8017650 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.602+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc10ee70 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.605+0000 7f8db27fc700 1 -- 172.21.15.35:0/3513139670 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8db80225e0 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.605+0000 7f8db27fc700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8da809f640 0x7f8da80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.606+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8da809f640 0x7f8da80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.606+0000 7f8db27fc700 1 -- 172.21.15.35:0/3513139670 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8db80cb700 con 0x7f8dbc0ff350 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.606+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8da809f640 0x7f8da80a1af0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc197850 tx=0x7f8dac009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 Processor -- start 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 -- start start 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 0x55f47236ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4723704f0 0x55f47236a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f47236ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f472271010 con 0x55f47236a960 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4722c3950 con 0x55f47236fbe0 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4722bcde0 con 0x55f4723704f0 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dc1dc3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f47236ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dc15c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 0x55f47236ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dc1dc3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f47236ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56010/0 (socket says 172.21.15.35:56010) 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dc15c2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 0x55f47236ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:57802/0 (socket says 172.21.15.35:57802) 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dc1dc3700 1 -- 172.21.15.35:0/704165749 learned_addr learned my addr 172.21.15.35:0/704165749 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.607+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4723704f0 0x55f47236a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc1dc3700 1 -- 172.21.15.35:0/704165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4723704f0 msgr2=0x55f47236a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4723704f0 0x55f47236a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc1dc3700 1 -- 172.21.15.35:0/704165749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 msgr2=0x55f47236ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 0x55f47236ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc1dc3700 1 -- 172.21.15.35:0/704165749 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f47213e5d0 con 0x55f47236a960 2023-03-17T11:34:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 0x55f47236ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:34:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f47236ad90 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f8db4011680 tx=0x7f8db4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba73dca12f7e0a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:43.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8da77fe700 1 -- 172.21.15.35:0/704165749 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400e040 con 0x55f47236a960 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8da77fe700 1 -- 172.21.15.35:0/704165749 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8db400f040 con 0x55f47236a960 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.608+0000 7f8da77fe700 1 -- 172.21.15.35:0/704165749 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4004730 con 0x55f47236a960 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/704165749 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 msgr2=0x55f47236ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f47236ad90 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f8db4011680 tx=0x7f8db4009920 comp rx=0 tx=0).stop 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/704165749 shutdown_connections 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f47236ad90 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f47236fbe0 0x55f47236ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:43.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/704165749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4723704f0 0x55f47236a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/704165749 >> 172.21.15.35:0/704165749 conn(0x55f4721c76b0 msgr2=0x55f472364a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/704165749 shutdown_connections 2023-03-17T11:34:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/704165749 wait complete. 2023-03-17T11:34:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 -- start start 2023-03-17T11:34:43.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.609+0000 7f8dcf9b3b80 1 Processor -- start 2023-03-17T11:34:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f472376410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236fbe0 0x55f472373690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472373cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4721408c0 con 0x55f47236a960 2023-03-17T11:34:47.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4723743f0 con 0x55f4723704f0 2023-03-17T11:34:47.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f472380000 con 0x55f47236fbe0 2023-03-17T11:34:47.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 10 client.0 _ll_register_callbacks cb 0x55f472162230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:34:47.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f472376410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:47.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f472376410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56012/0 (socket says 172.21.15.35:56012) 2023-03-17T11:34:47.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 -- 172.21.15.35:0/1620204573 learned_addr learned my addr 172.21.15.35:0/1620204573 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472373cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236fbe0 0x55f472373690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 -- 172.21.15.35:0/1620204573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236fbe0 msgr2=0x55f472373690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236fbe0 0x55f472373690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 -- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 msgr2=0x55f472373cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472373cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 -- 172.21.15.35:0/1620204573 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db4011330 con 0x55f47236a960 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472373cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236fbe0 0x55f472373690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f472376410 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f8db8000c00 tx=0x7f8db8099370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59d624b88cdd3ce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8da4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1620204573 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8098930 con 0x55f47236a960 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1620204573 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8db80a0f10 con 0x55f47236a960 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f47227f390 con 0x55f47236a960 2023-03-17T11:34:47.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.610+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1620204573 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8db80a10d0 con 0x55f47236a960 2023-03-17T11:34:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 10 client.21069 fetch_fsmap learned FSMap version 108 2023-03-17T11:34:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55f4720ead80 con 0x55f47236a960 2023-03-17T11:34:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1620204573 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f47227f390 con 0x55f47236a960 2023-03-17T11:34:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1620204573 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8db8095030 con 0x55f47236a960 2023-03-17T11:34:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 10 client.21069 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:34:47.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 10 client.21069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:34:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 20 client.21069 populate_metadata read hostname 'smithi035' 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f472383ca0 0x55f472386080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 4 client.21069 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f47228b600 con 0x55f472383ca0 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.611+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f472383ca0 0x55f472386080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.612+0000 7f8da4ff9700 10 client.21069 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.612+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f472383ca0 0x55f472386080 crc :-1 s=READY pgs=705 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29642b263941802 server_cookie=560f3af2ab92c21e in_seq=0 out_seq=0 2023-03-17T11:34:49.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.612+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1620204573 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f47228b600 con 0x55f472383ca0 2023-03-17T11:34:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.612+0000 7f8da4ff9700 10 client.21069 handle_command_reply: tid=0 2023-03-17T11:34:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.612+0000 7f8dcf9b3b80 1 client.21069 shutdown 2023-03-17T11:34:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 msgr2=0x55f472376410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f472376410 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f8db8000c00 tx=0x7f8db8099370 comp rx=0 tx=0).stop 2023-03-17T11:34:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 shutdown_connections 2023-03-17T11:34:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f472383ca0 0x55f472386080 crc :-1 s=READY pgs=705 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472373cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236a960 0x55f472376410 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8da4ff9700 0 client.21069 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1620204573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236fbe0 0x55f472373690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 >> 172.21.15.35:0/1620204573 conn(0x55f4721c76b0 msgr2=0x55f472364a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 shutdown_connections 2023-03-17T11:34:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1620204573 wait complete. 2023-03-17T11:34:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.613+0000 7f8dcf9b3b80 20 client.21069 trim_cache size 0 max 16384 2023-03-17T11:34:50.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 Processor -- start 2023-03-17T11:34:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 -- start start 2023-03-17T11:34:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f472364ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:50.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472375fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4723615c0 con 0x55f47236fbe0 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4723656d0 con 0x55f4723704f0 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f472374c70 con 0x55f47236a960 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56020/0 (socket says 172.21.15.35:56020) 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/876741760 learned_addr learned my addr 172.21.15.35:0/876741760 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f472364ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472375fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/876741760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 msgr2=0x55f472364ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f472364ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/876741760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 msgr2=0x55f472375fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472375fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/876741760 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f472283130 con 0x55f47236fbe0 2023-03-17T11:34:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.628+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472375fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:34:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723710a0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x55f4723656a0 tx=0x7f8dac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6668ce2d3bffcf8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:52.890 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:53 smithi035 ceph-mon[92535]: pgmap v5235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:34:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8da7fff700 1 -- 172.21.15.35:0/876741760 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0283e0 con 0x55f47236fbe0 2023-03-17T11:34:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8da7fff700 1 -- 172.21.15.35:0/876741760 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dac016070 con 0x55f47236fbe0 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8da7fff700 1 -- 172.21.15.35:0/876741760 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac003c60 con 0x55f47236fbe0 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/876741760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 msgr2=0x55f4723710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723710a0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x55f4723656a0 tx=0x7f8dac014000 comp rx=0 tx=0).stop 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/876741760 shutdown_connections 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472375fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f472364ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/876741760 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723710a0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/876741760 >> 172.21.15.35:0/876741760 conn(0x55f4721c76b0 msgr2=0x55f472370990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/876741760 shutdown_connections 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.629+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/876741760 wait complete. 2023-03-17T11:34:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 -- start start 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 Processor -- start 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f47237adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472379610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f472379b50 con 0x55f47236fbe0 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f472379cc0 con 0x55f4723704f0 2023-03-17T11:34:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f472379e80 con 0x55f47236a960 2023-03-17T11:34:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dcf9b3b80 10 client.0 _ll_register_callbacks cb 0x55f472162230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:34:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dc0dc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dc0dc1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723790d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56028/0 (socket says 172.21.15.35:56028) 2023-03-17T11:34:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/1149826858 learned_addr learned my addr 172.21.15.35:0/1149826858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:34:53.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f47237adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.630+0000 7f8dc1dc3700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472379610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/1149826858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 msgr2=0x55f47237adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f47237adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 msgr2=0x55f472379610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472379610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc0dc1700 1 -- 172.21.15.35:0/1149826858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac011930 con 0x55f47236fbe0 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f47237adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dc0dc1700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723790d0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0097d0 tx=0x7f8dac028680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def94693832f5657 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:34:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8da4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1149826858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac005440 con 0x55f47236fbe0 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1149826858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8dac025070 con 0x55f47236fbe0 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f47233a1e0 con 0x55f47236fbe0 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1149826858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dac0055a0 con 0x55f47236fbe0 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 10 client.21075 fetch_fsmap learned FSMap version 108 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55f4721111f0 con 0x55f47236fbe0 2023-03-17T11:34:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1149826858 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f47233a1e0 con 0x55f47236fbe0 2023-03-17T11:34:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1149826858 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8dac038020 con 0x55f47236fbe0 2023-03-17T11:34:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 10 client.21075 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:34:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 10 client.21075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:34:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 20 client.21075 populate_metadata read hostname 'smithi035' 2023-03-17T11:34:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4723d8ef0 0x55f4723db300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:34:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 4 client.21075 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:34:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.631+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f472140f00 con 0x55f4723d8ef0 2023-03-17T11:34:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.632+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4723d8ef0 0x55f4723db300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:34:58.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.632+0000 7f8dc15c2700 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4723d8ef0 0x55f4723db300 crc :-1 s=READY pgs=706 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9084e55d47cb8550 server_cookie=b4af7fdc892b91c4 in_seq=0 out_seq=0 2023-03-17T11:34:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.632+0000 7f8da4ff9700 10 client.21075 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:34:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.640+0000 7f8da4ff9700 1 -- 172.21.15.35:0/1149826858 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f472140f00 con 0x55f4723d8ef0 2023-03-17T11:34:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.640+0000 7f8da4ff9700 10 client.21075 handle_command_reply: tid=0 2023-03-17T11:34:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.640+0000 7f8dcf9b3b80 1 client.21075 shutdown 2023-03-17T11:34:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 msgr2=0x55f4723790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:34:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723790d0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0097d0 tx=0x7f8dac028680 comp rx=0 tx=0).stop 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 shutdown_connections 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f4723d8ef0 0x55f4723db300 crc :-1 s=READY pgs=706 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f4723704f0 0x55f472379610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f47236a960 0x55f47237adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8da4ff9700 0 client.21075 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 --2- 172.21.15.35:0/1149826858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f47236fbe0 0x55f4723790d0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 >> 172.21.15.35:0/1149826858 conn(0x55f4721c76b0 msgr2=0x55f47236e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 shutdown_connections 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 1 -- 172.21.15.35:0/1149826858 wait complete. 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dcf9b3b80 20 client.21075 trim_cache size 0 max 16384 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8da809f640 msgr2=0x7f8da80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dc3826700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8da809f640 0x7f8da80a1af0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc197850 tx=0x7f8dac009260 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 msgr2=0x7f8dbc196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dc3826700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc196240 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f8db8005910 tx=0x7f8db8009580 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 shutdown_connections 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.641+0000 7f8dc3826700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f8da809f640 0x7f8da80a1af0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.642+0000 7f8dc3826700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dbc104390 0x7f8dbc19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.642+0000 7f8dc3826700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f8dbc0ff350 0x7f8dbc196240 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.642+0000 7f8dc3826700 1 --2- 172.21.15.35:0/3513139670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dbc0ffcf0 0x7f8dbc196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.642+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 >> 172.21.15.35:0/3513139670 conn(0x7f8dbc076330 msgr2=0x7f8dbc068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.642+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 shutdown_connections 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:11:52.642+0000 7f8dc3826700 1 -- 172.21.15.35:0/3513139670 wait complete. 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 -- 172.21.15.35:0/1925506114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 msgr2=0x7f062c10a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 --2- 172.21.15.35:0/1925506114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c10a290 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f0620009990 tx=0x7f0620009ca0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 -- 172.21.15.35:0/1925506114 shutdown_connections 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 --2- 172.21.15.35:0/1925506114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c10a7d0 0x7f062c10cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 --2- 172.21.15.35:0/1925506114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f062c1012b0 0x7f062c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 --2- 172.21.15.35:0/1925506114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c10a290 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 -- 172.21.15.35:0/1925506114 >> 172.21.15.35:0/1925506114 conn(0x7f062c075f30 msgr2=0x7f062c076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 -- 172.21.15.35:0/1925506114 shutdown_connections 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 -- 172.21.15.35:0/1925506114 wait complete. 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 Processor -- start 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.765+0000 7f0631eff700 1 -- start start 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0631eff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c1012b0 0x7f062c196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0631eff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c1967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0631eff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f062c10a7d0 0x7f062c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0631eff700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c19b240 con 0x7f062c101bc0 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0631eff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c19b3b0 con 0x7f062c1012b0 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0631eff700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c19b570 con 0x7f062c10a7d0 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c1967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c1967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56044/0 (socket says 172.21.15.35:56044) 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 -- 172.21.15.35:0/314103288 learned_addr learned my addr 172.21.15.35:0/314103288 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062b7fe700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c1012b0 0x7f062c196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062bfff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f062c10a7d0 0x7f062c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 -- 172.21.15.35:0/314103288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f062c10a7d0 msgr2=0x7f062c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f062c10a7d0 0x7f062c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 -- 172.21.15.35:0/314103288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c1012b0 msgr2=0x7f062c196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c1012b0 0x7f062c196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 -- 172.21.15.35:0/314103288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200095f0 con 0x7f062c101bc0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062b7fe700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c1012b0 0x7f062c196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f062affd700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c1967a0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f0620005910 tx=0x7f0620009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0628ff9700 1 -- 172.21.15.35:0/314103288 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062001d070 con 0x7f062c101bc0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.766+0000 7f0628ff9700 1 -- 172.21.15.35:0/314103288 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0620003f40 con 0x7f062c101bc0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.767+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c110150 con 0x7f062c101bc0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.767+0000 7f0628ff9700 1 -- 172.21.15.35:0/314103288 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000fc60 con 0x7f062c101bc0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.767+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c10ffc0 con 0x7f062c101bc0 2023-03-17T11:35:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.769+0000 7f0628ff9700 1 -- 172.21.15.35:0/314103288 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f06200040b0 con 0x7f062c101bc0 2023-03-17T11:35:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.769+0000 7f0628ff9700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f061409f640 0x7f06140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.769+0000 7f0628ff9700 1 -- 172.21.15.35:0/314103288 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f06200cb640 con 0x7f062c101bc0 2023-03-17T11:35:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.769+0000 7f062b7fe700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f061409f640 0x7f06140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.770+0000 7f062b7fe700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f061409f640 0x7f06140a1af0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f061c005950 tx=0x7f061c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.770+0000 7f063e08cb80 1 Processor -- start 2023-03-17T11:35:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.770+0000 7f063e08cb80 1 -- start start 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.770+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea52fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.770+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea4d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.770+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea4dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f063e08cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dace954010 con 0x55dacea52be0 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f063e08cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dace9a6950 con 0x55dacea534f0 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f063e08cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dace99fde0 con 0x55dacea4d960 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea52fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea52fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56050/0 (socket says 172.21.15.35:56050) 2023-03-17T11:35:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 -- 172.21.15.35:0/2476548941 learned_addr learned my addr 172.21.15.35:0/2476548941 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062bfff700 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea4dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062affd700 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea4d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 -- 172.21.15.35:0/2476548941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 msgr2=0x55dacea4dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea4dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 -- 172.21.15.35:0/2476548941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 msgr2=0x55dacea4d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea4d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 -- 172.21.15.35:0/2476548941 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dace8215d0 con 0x55dacea52be0 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f062b7fe700 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea52fb0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f061c00ff00 tx=0x7f061c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4562a53b895050c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f0611ffb700 1 -- 172.21.15.35:0/2476548941 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c017040 con 0x55dacea52be0 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f0611ffb700 1 -- 172.21.15.35:0/2476548941 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f061c003b10 con 0x55dacea52be0 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.771+0000 7f0611ffb700 1 -- 172.21.15.35:0/2476548941 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c01fbe0 con 0x55dacea52be0 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 -- 172.21.15.35:0/2476548941 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 msgr2=0x55dacea52fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea52fb0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f061c00ff00 tx=0x7f061c012000 comp rx=0 tx=0).stop 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 -- 172.21.15.35:0/2476548941 shutdown_connections 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea4dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea52fb0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2476548941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea4d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 -- 172.21.15.35:0/2476548941 >> 172.21.15.35:0/2476548941 conn(0x55dace8aa6b0 msgr2=0x55dacea47a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 -- 172.21.15.35:0/2476548941 shutdown_connections 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 -- 172.21.15.35:0/2476548941 wait complete. 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.772+0000 7f063e08cb80 1 -- start start 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 Processor -- start 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea59460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea56750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea56dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dace8238c0 con 0x55dacea52be0 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea57500 con 0x55dacea534f0 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea63000 con 0x55dacea4d960 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f063e08cb80 10 client.0 _ll_register_callbacks cb 0x55dace845230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea56750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea56750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56058/0 (socket says 172.21.15.35:56058) 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 -- 172.21.15.35:0/3164643680 learned_addr learned my addr 172.21.15.35:0/3164643680 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062b7fe700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea59460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062bfff700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea56dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:02.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:55 smithi035 ceph-mon[92535]: pgmap v5236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:35:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 -- 172.21.15.35:0/3164643680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 msgr2=0x55dacea59460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea59460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 -- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 msgr2=0x55dacea56dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea56dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.773+0000 7f062affd700 1 -- 172.21.15.35:0/3164643680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c00fbe0 con 0x55dacea52be0 2023-03-17T11:35:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f062affd700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea56750 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f06200c8e30 tx=0x7f0620098dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7a670da8206120 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f060affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f060affd700 1 -- 172.21.15.35:0/3164643680 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200b1420 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f060affd700 1 -- 172.21.15.35:0/3164643680 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f06200a12e0 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dace962390 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f060affd700 1 -- 172.21.15.35:0/3164643680 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0620098670 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 10 client.21087 fetch_fsmap learned FSMap version 108 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55dace7cdd80 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f060affd700 1 -- 172.21.15.35:0/3164643680 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dace962390 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f060affd700 1 -- 172.21.15.35:0/3164643680 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0620095100 con 0x55dacea52be0 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 10 client.21087 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 10 client.21087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:35:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 20 client.21087 populate_metadata read hostname 'smithi035' 2023-03-17T11:35:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dacea66d80 0x55dacea69190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 4 client.21087 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:35:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.774+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dace96e600 con 0x55dacea66d80 2023-03-17T11:35:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.775+0000 7f062b7fe700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dacea66d80 0x55dacea69190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.775+0000 7f060affd700 10 client.21087 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.775+0000 7f062b7fe700 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dacea66d80 0x55dacea69190 crc :-1 s=READY pgs=707 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40fa3bd854f61daf server_cookie=b4b0a2179e03a7d3 in_seq=0 out_seq=0 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f060affd700 1 -- 172.21.15.35:0/3164643680 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55dace96e600 con 0x55dacea66d80 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f060affd700 10 client.21087 handle_command_reply: tid=0 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 client.21087 shutdown 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 msgr2=0x55dacea56750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:08.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea56750 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f06200c8e30 tx=0x7f0620098dd0 comp rx=0 tx=0).stop 2023-03-17T11:35:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 shutdown_connections 2023-03-17T11:35:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55dacea66d80 0x55dacea69190 crc :-1 s=READY pgs=707 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea56dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:09.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea4d960 0x55dacea59460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:09.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f060affd700 0 client.21087 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3164643680 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea56750 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 >> 172.21.15.35:0/3164643680 conn(0x55dace8aa6b0 msgr2=0x55dacea4c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 shutdown_connections 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 1 -- 172.21.15.35:0/3164643680 wait complete. 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.776+0000 7f063e08cb80 20 client.21087 trim_cache size 0 max 16384 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 Processor -- start 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 -- start start 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea4d960 0x55dacea47ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea5df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea534f0 0x55dacea55f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dace962390 con 0x55dacea52be0 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea44b60 con 0x55dacea4d960 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f063e08cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea48000 con 0x55dacea534f0 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f062affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea5df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f062affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea5df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56066/0 (socket says 172.21.15.35:56066) 2023-03-17T11:35:10.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.791+0000 7f062affd700 1 -- 172.21.15.35:0/2463629934 learned_addr learned my addr 172.21.15.35:0/2463629934 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062b7fe700 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea4d960 0x55dacea47ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062affd700 1 -- 172.21.15.35:0/2463629934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea534f0 msgr2=0x55dacea55f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062affd700 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea534f0 0x55dacea55f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062affd700 1 -- 172.21.15.35:0/2463629934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea4d960 msgr2=0x55dacea47ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062affd700 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea4d960 0x55dacea47ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062affd700 1 -- 172.21.15.35:0/2463629934 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dace966130 con 0x55dacea52be0 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062b7fe700 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea4d960 0x55dacea47ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f062affd700 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea5df50 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f0620099110 tx=0x7f0620099300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa49a218073ef5ce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f06127fc700 1 -- 172.21.15.35:0/2463629934 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200b1420 con 0x55dacea52be0 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f06127fc700 1 -- 172.21.15.35:0/2463629934 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06200cb4c0 con 0x55dacea52be0 2023-03-17T11:35:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f06127fc700 1 -- 172.21.15.35:0/2463629934 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200a1070 con 0x55dacea52be0 2023-03-17T11:35:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f063e08cb80 1 -- 172.21.15.35:0/2463629934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 msgr2=0x55dacea5df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.792+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea5df50 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f0620099110 tx=0x7f0620099300 comp rx=0 tx=0).stop 2023-03-17T11:35:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- 172.21.15.35:0/2463629934 shutdown_connections 2023-03-17T11:35:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea534f0 0x55dacea55f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea4d960 0x55dacea47ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 --2- 172.21.15.35:0/2463629934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea52be0 0x55dacea5df50 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- 172.21.15.35:0/2463629934 >> 172.21.15.35:0/2463629934 conn(0x55dace8aa6b0 msgr2=0x55dacea4c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- 172.21.15.35:0/2463629934 shutdown_connections 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- 172.21.15.35:0/2463629934 wait complete. 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- start start 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 Processor -- start 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 0x55dacea5d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea52be0 0x55dacea5def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea5bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:16.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea5c640 con 0x55dacea4d960 2023-03-17T11:35:16.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea5c7b0 con 0x55dacea534f0 2023-03-17T11:35:16.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacea5c970 con 0x55dacea52be0 2023-03-17T11:35:16.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.793+0000 7f063e08cb80 10 client.0 _ll_register_callbacks cb 0x55dace845230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:35:16.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 0x55dacea5d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 0x55dacea5d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56070/0 (socket says 172.21.15.35:56070) 2023-03-17T11:35:18.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 -- 172.21.15.35:0/3828066728 learned_addr learned my addr 172.21.15.35:0/3828066728 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062bfff700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea5bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062affd700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea52be0 0x55dacea5def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 -- 172.21.15.35:0/3828066728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea52be0 msgr2=0x55dacea5def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea52be0 0x55dacea5def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 -- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 msgr2=0x55dacea5bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea5bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 -- 172.21.15.35:0/3828066728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dace7cdd80 con 0x55dacea4d960 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062affd700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea52be0 0x55dacea5def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f062b7fe700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 0x55dacea5d9b0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f061c0045f0 tx=0x7f061c01f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cc9e2d36197951 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f060affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f060affd700 1 -- 172.21.15.35:0/3828066728 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c030070 con 0x55dacea4d960 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f060affd700 1 -- 172.21.15.35:0/3828066728 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(369..369 src has 1..369) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f061c005240 con 0x55dacea4d960 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dace823f00 con 0x55dacea4d960 2023-03-17T11:35:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f060affd700 1 -- 172.21.15.35:0/3828066728 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f061c034770 con 0x55dacea4d960 2023-03-17T11:35:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f063e08cb80 10 client.21093 fetch_fsmap learned FSMap version 108 2023-03-17T11:35:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.794+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55dace7f41f0 con 0x55dacea4d960 2023-03-17T11:35:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f060affd700 1 -- 172.21.15.35:0/3828066728 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dace823f00 con 0x55dacea4d960 2023-03-17T11:35:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f060affd700 1 -- 172.21.15.35:0/3828066728 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f061c01d040 con 0x55dacea4d960 2023-03-17T11:35:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f063e08cb80 10 client.21093 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:35:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f063e08cb80 10 client.21093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:35:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f063e08cb80 20 client.21093 populate_metadata read hostname 'smithi035' 2023-03-17T11:35:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55daceabbe50 0x55daceabe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f063e08cb80 4 client.21093 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:35:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dace95c360 con 0x55daceabbe50 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f062affd700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55daceabbe50 0x55daceabe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f060affd700 10 client.21093 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.795+0000 7f062affd700 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55daceabbe50 0x55daceabe260 crc :-1 s=READY pgs=708 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=118b1dd9427d4105 server_cookie=d0d42565ec79682e in_seq=0 out_seq=0 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f060affd700 1 -- 172.21.15.35:0/3828066728 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dace95c360 con 0x55daceabbe50 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f060affd700 10 client.21093 handle_command_reply: tid=0 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 client.21093 shutdown 2023-03-17T11:35:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 msgr2=0x55dacea5d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 0x55dacea5d9b0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f061c0045f0 tx=0x7f061c01f460 comp rx=0 tx=0).stop 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 shutdown_connections 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55daceabbe50 0x55daceabe260 crc :-1 s=READY pgs=708 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dacea534f0 0x55dacea5bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55dacea4d960 0x55dacea5d9b0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 --2- 172.21.15.35:0/3828066728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacea52be0 0x55dacea5def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f060affd700 0 client.21093 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 >> 172.21.15.35:0/3828066728 conn(0x55dace8aa6b0 msgr2=0x55dacea626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 shutdown_connections 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 1 -- 172.21.15.35:0/3828066728 wait complete. 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.813+0000 7f063e08cb80 20 client.21093 trim_cache size 0 max 16384 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f061409f640 msgr2=0x7f06140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f061409f640 0x7f06140a1af0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f061c005950 tx=0x7f061c0058e0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 msgr2=0x7f062c1967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c1967a0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f0620005910 tx=0x7f0620009580 comp rx=0 tx=0).stop 2023-03-17T11:35:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 shutdown_connections 2023-03-17T11:35:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f061409f640 0x7f06140a1af0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f062c10a7d0 0x7f062c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f062c1012b0 0x7f062c196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 --2- 172.21.15.35:0/314103288 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f062c101bc0 0x7f062c1967a0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 >> 172.21.15.35:0/314103288 conn(0x7f062c075f30 msgr2=0x7f062c0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 shutdown_connections 2023-03-17T11:35:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:12:05.814+0000 7f0631eff700 1 -- 172.21.15.35:0/314103288 wait complete. 2023-03-17T11:35:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 -- 172.21.15.35:0/2344212714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee00ffcf0 msgr2=0x7f0ee0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/2344212714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee0103cb0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0099c0 tx=0x7f0ecc009cd0 comp rx=0 tx=0).stop 2023-03-17T11:35:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 -- 172.21.15.35:0/2344212714 shutdown_connections 2023-03-17T11:35:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/2344212714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee0104390 0x7f0ee010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/2344212714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ee00ff350 0x7f0ee00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/2344212714 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee0103cb0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 -- 172.21.15.35:0/2344212714 >> 172.21.15.35:0/2344212714 conn(0x7f0ee0076330 msgr2=0x7f0ee0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 -- 172.21.15.35:0/2344212714 shutdown_connections 2023-03-17T11:35:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.021+0000 7f0ee6c47700 1 -- 172.21.15.35:0/2344212714 wait complete. 2023-03-17T11:35:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 Processor -- start 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 -- start start 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ee00ff350 0x7f0ee0195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee01957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 0x7f0ee0199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee019a250 con 0x7f0ee0104390 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee019a3c0 con 0x7f0ee00ff350 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.022+0000 7f0ee6c47700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee019a580 con 0x7f0ee00ffcf0 2023-03-17T11:35:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 0x7f0ee0199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 0x7f0ee0199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56090/0 (socket says 172.21.15.35:56090) 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0edffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee01957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3697072312 learned_addr learned my addr 172.21.15.35:0/3697072312 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ee00ff350 0x7f0ee0195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3697072312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee00ffcf0 msgr2=0x7f0ee01957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee01957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3697072312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ee00ff350 msgr2=0x7f0ee0195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ee00ff350 0x7f0ee0195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3697072312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4009520 con 0x7f0ee0104390 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0edffff700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee01957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:35:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 0x7f0ee0199c10 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800ef30 tx=0x7f0ed800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:27.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:57 smithi035 ceph-mon[92535]: pgmap v5237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:35:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0eddffb700 1 -- 172.21.15.35:0/3697072312 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8018070 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0eddffb700 1 -- 172.21.15.35:0/3697072312 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed800f040 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0eddffb700 1 -- 172.21.15.35:0/3697072312 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800cbc0 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.023+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc0095f0 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.024+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee010efc0 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.026+0000 7f0eddffb700 1 -- 172.21.15.35:0/3697072312 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f0ed8007500 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.027+0000 7f0eddffb700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0ed009f6c0 0x7f0ed00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.027+0000 7f0eddffb700 1 -- 172.21.15.35:0/3697072312 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0ed80ca070 con 0x7f0ee0104390 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.027+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0ed009f6c0 0x7f0ed00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.027+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0ed009f6c0 0x7f0ed00a1b70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009df0 tx=0x7f0ed4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 Processor -- start 2023-03-17T11:35:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 -- start start 2023-03-17T11:35:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d918160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d9186a0 0x563d0d912630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 0x563d0d912fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d817010 con 0x563d0d912b70 2023-03-17T11:35:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d869950 con 0x563d0d9186a0 2023-03-17T11:35:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d862de0 con 0x563d0d917d90 2023-03-17T11:35:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 0x563d0d912fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 0x563d0d912fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56098/0 (socket says 172.21.15.35:56098) 2023-03-17T11:35:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3739630454 learned_addr learned my addr 172.21.15.35:0/3739630454 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0edffff700 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d9186a0 0x563d0d912630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.028+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d918160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3739630454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 msgr2=0x563d0d918160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d918160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3739630454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d9186a0 msgr2=0x563d0d912630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d9186a0 0x563d0d912630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3739630454 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0d6e45d0 con 0x563d0d912b70 2023-03-17T11:35:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 0x563d0d912fc0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f0ed809f780 tx=0x7f0ed8097530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6603ab995e14218 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ecaffd700 1 -- 172.21.15.35:0/3739630454 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed809fcb0 con 0x563d0d912b70 2023-03-17T11:35:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ecaffd700 1 -- 172.21.15.35:0/3739630454 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed8095ef0 con 0x563d0d912b70 2023-03-17T11:35:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.029+0000 7f0ecaffd700 1 -- 172.21.15.35:0/3739630454 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80972a0 con 0x563d0d912b70 2023-03-17T11:35:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3739630454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 msgr2=0x563d0d912fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 0x563d0d912fc0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f0ed809f780 tx=0x7f0ed8097530 comp rx=0 tx=0).stop 2023-03-17T11:35:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3739630454 shutdown_connections 2023-03-17T11:35:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d912b70 0x563d0d912fc0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d918160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3739630454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d9186a0 0x563d0d912630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3739630454 >> 172.21.15.35:0/3739630454 conn(0x563d0d76d6b0 msgr2=0x563d0d90aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3739630454 shutdown_connections 2023-03-17T11:35:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3739630454 wait complete. 2023-03-17T11:35:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 -- start start 2023-03-17T11:35:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.030+0000 7f0ef2dd4b80 1 Processor -- start 2023-03-17T11:35:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d91b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d91bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d91c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d6e68c0 con 0x563d0d9186a0 2023-03-17T11:35:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d91eb00 con 0x563d0d912b70 2023-03-17T11:35:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d928280 con 0x563d0d917d90 2023-03-17T11:35:44.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ef2dd4b80 10 client.0 _ll_register_callbacks cb 0x563d0d708230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d91c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d91c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56104/0 (socket says 172.21.15.35:56104) 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3808282746 learned_addr learned my addr 172.21.15.35:0/3808282746 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d91b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0edffff700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d91bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3808282746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 msgr2=0x563d0d91bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d91bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 msgr2=0x563d0d91b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d91b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.031+0000 7f0ee51e4700 1 -- 172.21.15.35:0/3808282746 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee010efc0 con 0x563d0d9186a0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d91c420 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8094050 tx=0x7f0ed80c77a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1aca42133e8e39 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ebffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:35:47.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ebffff700 1 -- 172.21.15.35:0/3808282746 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80c72c0 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ebffff700 1 -- 172.21.15.35:0/3808282746 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0ed80c7420 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d0d825390 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ebffff700 1 -- 172.21.15.35:0/3808282746 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed8097db0 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 10 client.21105 fetch_fsmap learned FSMap version 108 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563d0d690d80 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ebffff700 1 -- 172.21.15.35:0/3808282746 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed807a020 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ebffff700 1 -- 172.21.15.35:0/3808282746 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0ed80b4c80 con 0x563d0d9186a0 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 10 client.21105 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 10 client.21105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 20 client.21105 populate_metadata read hostname 'smithi035' 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d92e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 4 client.21105 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.032+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d0d831600 con 0x563d0d92bf10 2023-03-17T11:35:47.296 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.033+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d92e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.033+0000 7f0ebffff700 10 client.21105 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.033+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d92e2f0 crc :-1 s=READY pgs=709 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b751e835e787a54 server_cookie=37374dcfc2ceaa10 in_seq=0 out_seq=0 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ebffff700 1 -- 172.21.15.35:0/3808282746 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563d0d831600 con 0x563d0d92bf10 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ebffff700 10 client.21105 handle_command_reply: tid=0 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 client.21105 shutdown 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 msgr2=0x563d0d91c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d91c420 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8094050 tx=0x7f0ed80c77a0 comp rx=0 tx=0).stop 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 shutdown_connections 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d92e2f0 crc :-1 s=READY pgs=709 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d91c420 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ebffff700 0 client.21105 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d91b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/3808282746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d91bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 >> 172.21.15.35:0/3808282746 conn(0x563d0d76d6b0 msgr2=0x563d0d90f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 shutdown_connections 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/3808282746 wait complete. 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.034+0000 7f0ef2dd4b80 20 client.21105 trim_cache size 0 max 16384 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.049+0000 7f0ef2dd4b80 1 Processor -- start 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.049+0000 7f0ef2dd4b80 1 -- start start 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d912b70 0x563d0d90fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d917d90 0x563d0d90aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d923150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d90bb70 con 0x563d0d9186a0 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d90b000 con 0x563d0d917d90 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d9060d0 con 0x563d0d912b70 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d923150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d923150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56112/0 (socket says 172.21.15.35:56112) 2023-03-17T11:35:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2076694112 learned_addr learned my addr 172.21.15.35:0/2076694112 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee49e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d912b70 0x563d0d90fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2076694112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d912b70 msgr2=0x563d0d90fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d912b70 0x563d0d90fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2076694112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d917d90 msgr2=0x563d0d90aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0edffff700 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d917d90 0x563d0d90aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d917d90 0x563d0d90aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2076694112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d0d829130 con 0x563d0d9186a0 2023-03-17T11:35:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0edffff700 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d917d90 0x563d0d90aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:35:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d923150 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8097ae0 tx=0x7f0ed80c7880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6e8b7609548095 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ecb7fe700 1 -- 172.21.15.35:0/2076694112 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed809bc80 con 0x563d0d9186a0 2023-03-17T11:35:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ecb7fe700 1 -- 172.21.15.35:0/2076694112 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed807a070 con 0x563d0d9186a0 2023-03-17T11:35:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.050+0000 7f0ecb7fe700 1 -- 172.21.15.35:0/2076694112 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8096900 con 0x563d0d9186a0 2023-03-17T11:35:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2076694112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 msgr2=0x563d0d923150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:35:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d923150 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8097ae0 tx=0x7f0ed80c7880 comp rx=0 tx=0).stop 2023-03-17T11:35:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2076694112 shutdown_connections 2023-03-17T11:35:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d923150 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d912b70 0x563d0d90fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2076694112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d917d90 0x563d0d90aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2076694112 >> 172.21.15.35:0/2076694112 conn(0x563d0d76d6b0 msgr2=0x563d0d90f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2076694112 shutdown_connections 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2076694112 wait complete. 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 -- start start 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.051+0000 7f0ef2dd4b80 1 Processor -- start 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d973ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d974410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d97ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d97f2a0 con 0x563d0d9186a0 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d97f3e0 con 0x563d0d912b70 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d0d97f5a0 con 0x563d0d917d90 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ef2dd4b80 10 client.0 _ll_register_callbacks cb 0x563d0d708230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:35:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d97ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d97ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56118/0 (socket says 172.21.15.35:56118) 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee49e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d973ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2007518109 learned_addr learned my addr 172.21.15.35:0/2007518109 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0edffff700 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d974410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2007518109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 msgr2=0x563d0d974410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d974410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 msgr2=0x563d0d973ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d973ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.052+0000 7f0ee51e4700 1 -- 172.21.15.35:0/2007518109 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d0d690d80 con 0x563d0d9186a0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ee51e4700 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d97ed60 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8094050 tx=0x7f0ed8097530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a31f379823db3f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ebffff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ebffff700 1 -- 172.21.15.35:0/2007518109 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed809fa20 con 0x563d0d9186a0 2023-03-17T11:35:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ebffff700 1 -- 172.21.15.35:0/2007518109 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0ed807b080 con 0x563d0d9186a0 2023-03-17T11:35:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d0d8e01e0 con 0x563d0d9186a0 2023-03-17T11:35:58.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ebffff700 1 -- 172.21.15.35:0/2007518109 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed809fcb0 con 0x563d0d9186a0 2023-03-17T11:35:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 10 client.21111 fetch_fsmap learned FSMap version 108 2023-03-17T11:35:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x563d0d6b71f0 con 0x563d0d9186a0 2023-03-17T11:35:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ebffff700 1 -- 172.21.15.35:0/2007518109 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d0d8e01e0 con 0x563d0d9186a0 2023-03-17T11:35:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ebffff700 1 -- 172.21.15.35:0/2007518109 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0ed80b3be0 con 0x563d0d9186a0 2023-03-17T11:35:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 10 client.21111 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:35:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 10 client.21111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:36:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 20 client.21111 populate_metadata read hostname 'smithi035' 2023-03-17T11:36:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d982790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 4 client.21111 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:36:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.053+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563d0d6e6f00 con 0x563d0d92bf10 2023-03-17T11:36:01.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:24:59 smithi035 ceph-mon[92535]: pgmap v5238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:36:01.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:01 smithi035 ceph-mon[92535]: pgmap v5239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T11:36:01.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:03 smithi035 ceph-mon[92535]: pgmap v5240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T11:36:01.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:05 smithi035 ceph-mon[92535]: pgmap v5241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:36:01.782 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:07 smithi035 ceph-mon[92535]: pgmap v5242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:09 smithi035 ceph-mon[92535]: pgmap v5243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:09 smithi035 ceph-mon[92535]: osdmap e396: 12 total, 12 up, 12 in 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:11 smithi035 ceph-mon[92535]: pgmap v5245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:13 smithi035 ceph-mon[92535]: pgmap v5246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:15 smithi035 ceph-mon[92535]: pgmap v5247: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:17 smithi035 ceph-mon[92535]: pgmap v5248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:17 smithi035 ceph-mon[92535]: osdmap e397: 12 total, 12 up, 12 in 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:19 smithi035 ceph-mon[92535]: pgmap v5250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:21 smithi035 ceph-mon[92535]: pgmap v5251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:23 smithi035 ceph-mon[92535]: pgmap v5252: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:25 smithi035 ceph-mon[92535]: pgmap v5253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:27 smithi035 ceph-mon[92535]: pgmap v5254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:29 smithi035 ceph-mon[92535]: pgmap v5255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:31 smithi035 ceph-mon[92535]: pgmap v5256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:36:01.783 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:31 smithi035 ceph-mon[92535]: pgmap v5257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:31 smithi035 ceph-mon[92535]: pgmap v5258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:33 smithi035 ceph-mon[92535]: pgmap v5259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:34 smithi035 ceph-mon[92535]: pgmap v5260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:36 smithi035 ceph-mon[92535]: pgmap v5261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 116 B/s wr, 7 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:38 smithi035 ceph-mon[92535]: pgmap v5262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:40 smithi035 ceph-mon[92535]: pgmap v5263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:43 smithi035 ceph-mon[92535]: pgmap v5264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:44 smithi035 ceph-mon[92535]: pgmap v5265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:36:01.784 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:46 smithi035 ceph-mon[92535]: pgmap v5266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T11:36:03.036 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:48 smithi035 ceph-mon[92535]: pgmap v5267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T11:36:05.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:50 smithi035 ceph-mon[92535]: pgmap v5268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:36:05.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:53 smithi035 ceph-mon[92535]: pgmap v5269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:36:05.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:54 smithi035 ceph-mon[92535]: pgmap v5270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:36:05.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:56 smithi035 ceph-mon[92535]: pgmap v5271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-17T11:36:05.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:25:58 smithi035 ceph-mon[92535]: pgmap v5272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:00 smithi035 ceph-mon[92535]: pgmap v5273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-mon[92535]: pgmap v5274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:04 smithi035 ceph-mon[92535]: osdmap e398: 12 total, 12 up, 12 in 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:05 smithi035 ceph-mon[92535]: pgmap v5276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:06 smithi035 ceph-mon[92535]: pgmap v5277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:08 smithi035 ceph-mon[92535]: pgmap v5278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:10 smithi035 ceph-mon[92535]: pgmap v5279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:13 smithi035 ceph-mon[92535]: osdmap e399: 12 total, 12 up, 12 in 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:13 smithi035 ceph-mon[92535]: pgmap v5281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 542 B/s wr, 9 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:14 smithi035 ceph-mon[92535]: pgmap v5282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:15 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:15 smithi035 ceph-mon[92535]: osdmap e400: 12 total, 12 up, 12 in 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:17 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/1305502887,v1:172.21.15.35:6837/1305502887] up:boot 2023-03-17T11:36:05.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:17 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:17 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:17 smithi035 ceph-mon[92535]: pgmap v5284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 639 B/s wr, 9 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:18 smithi035 ceph-mon[92535]: pgmap v5285: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:20 smithi035 ceph-mon[92535]: pgmap v5286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 485 B/s wr, 6 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:23 smithi035 ceph-mon[92535]: pgmap v5287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:24 smithi035 ceph-mon[92535]: pgmap v5288: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:26 smithi035 ceph-mon[92535]: pgmap v5289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 351 B/s wr, 12 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:28 smithi035 ceph-mon[92535]: pgmap v5290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:30 smithi035 ceph-mon[92535]: pgmap v5291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:32 smithi035 ceph-mon[92535]: pgmap v5292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T11:36:05.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:32 smithi035 ceph-mon[92535]: pgmap v5293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:34 smithi035 ceph-mon[92535]: pgmap v5294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:36 smithi035 ceph-mon[92535]: pgmap v5295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 348 B/s wr, 7 op/s 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:38 smithi035 ceph-mon[92535]: pgmap v5296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:40 smithi035 ceph-mon[92535]: pgmap v5297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:42 smithi035 ceph-mon[92535]: pgmap v5298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:36:05.874 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:44 smithi035 ceph-mon[92535]: pgmap v5299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:36:07.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:46 smithi035 ceph-mon[92535]: pgmap v5300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:36:07.632 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: *** Caught signal (Segmentation fault) ** 2023-03-17T11:36:07.632 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: in thread 7f6c4f655700 thread_name:md_log_replay 2023-03-17T11:36:07.632 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:36:07.632 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6c5fde1cf0] 2023-03-17T11:36:07.633 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55aab93ef71f] 2023-03-17T11:36:07.633 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55aab93f1953] 2023-03-17T11:36:07.633 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 4: (MDLog::_replay_thread()+0x66d) [0x55aab945d07d] 2023-03-17T11:36:07.633 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55aab9110d91] 2023-03-17T11:36:07.633 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6c5fdd71ca] 2023-03-17T11:36:07.633 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 7: clone() 2023-03-17T11:36:08.763 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:26:03.928+0000 7f6c4f655700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T11:36:08.763 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: in thread 7f6c4f655700 thread_name:md_log_replay 2023-03-17T11:36:08.763 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:36:09.563 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:36:09.563 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6c5fde1cf0] 2023-03-17T11:36:09.563 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55aab93ef71f] 2023-03-17T11:36:09.564 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55aab93f1953] 2023-03-17T11:36:09.564 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 4: (MDLog::_replay_thread()+0x66d) [0x55aab945d07d] 2023-03-17T11:36:09.564 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55aab9110d91] 2023-03-17T11:36:10.108 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6c5fdd71ca] 2023-03-17T11:36:10.109 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 7: clone() 2023-03-17T11:36:10.109 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T11:36:11.257 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:36:11.257 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 0> 2023-03-17T11:26:03.928+0000 7f6c4f655700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T11:36:11.257 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: in thread 7f6c4f655700 thread_name:md_log_replay 2023-03-17T11:36:11.257 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:36:12.347 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:36:12.347 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6c5fde1cf0] 2023-03-17T11:36:12.347 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55aab93ef71f] 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55aab93f1953] 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 4: (MDLog::_replay_thread()+0x66d) [0x55aab945d07d] 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55aab9110d91] 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6c5fdd71ca] 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 7: clone() 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T11:36:12.348 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 0> 2023-03-17T11:26:03.928+0000 7f6c4f655700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: in thread 7f6c4f655700 thread_name:md_log_replay 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f6c5fde1cf0] 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x55aab93ef71f] 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55aab93f1953] 2023-03-17T11:36:13.531 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 4: (MDLog::_replay_thread()+0x66d) [0x55aab945d07d] 2023-03-17T11:36:14.206 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55aab9110d91] 2023-03-17T11:36:14.206 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f6c5fdd71ca] 2023-03-17T11:36:14.206 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 7: clone() 2023-03-17T11:36:14.206 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[177549]: 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 6. 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:14 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:14 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:14 smithi035 podman[207441]: 2023-03-17T11:36:14.816 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:15 smithi035 bash[207441]: fbafc1d84a22a00aba56e6addac6fd1e3be64094c3fc03846cd11651a47d0f45 2023-03-17T11:36:15.461 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:15 smithi035 ceph-mds[207481]: -- 172.21.15.35:0/1166185673 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56061e95ab60 con 0x56061e931000 2023-03-17T11:36:15.461 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: starting mds.d at 2023-03-17T11:36:15.461 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:26:15 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:36:15.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:36:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:36:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:36:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:36:18.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:36:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.054+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d982790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.054+0000 7f0ebffff700 10 client.21111 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.054+0000 7f0ee49e3700 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d982790 crc :-1 s=READY pgs=710 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52341385690c5002 server_cookie=e04918203c7d1172 in_seq=0 out_seq=0 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ebffff700 1 -- 172.21.15.35:0/2007518109 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563d0d6e6f00 con 0x563d0d92bf10 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ebffff700 10 client.21111 handle_command_reply: tid=0 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 client.21111 shutdown 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 msgr2=0x563d0d97ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d97ed60 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8094050 tx=0x7f0ed8097530 comp rx=0 tx=0).stop 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 shutdown_connections 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d0d92bf10 0x563d0d982790 crc :-1 s=READY pgs=710 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d0d9186a0 0x563d0d97ed60 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d0d912b70 0x563d0d973ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:20.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ebffff700 0 client.21111 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:36:20.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 --2- 172.21.15.35:0/2007518109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d0d917d90 0x563d0d974410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:20.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.070+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 >> 172.21.15.35:0/2007518109 conn(0x563d0d76d6b0 msgr2=0x563d0d915860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 shutdown_connections 2023-03-17T11:36:21.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ef2dd4b80 1 -- 172.21.15.35:0/2007518109 wait complete. 2023-03-17T11:36:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ef2dd4b80 20 client.21111 trim_cache size 0 max 16384 2023-03-17T11:36:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0ed009f6c0 msgr2=0x7f0ed00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0ed009f6c0 0x7f0ed00a1b70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009df0 tx=0x7f0ed4009260 comp rx=0 tx=0).stop 2023-03-17T11:36:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 msgr2=0x7f0ee0199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 0x7f0ee0199c10 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800ef30 tx=0x7f0ed800c3a0 comp rx=0 tx=0).stop 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 shutdown_connections 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0ed009f6c0 0x7f0ed00a1b70 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ee0104390 0x7f0ee0199c10 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ee00ff350 0x7f0ee0195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 --2- 172.21.15.35:0/3697072312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ee00ffcf0 0x7f0ee01957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 >> 172.21.15.35:0/3697072312 conn(0x7f0ee0076330 msgr2=0x7f0ee00fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 shutdown_connections 2023-03-17T11:36:21.917 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:21.071+0000 7f0ee6c47700 1 -- 172.21.15.35:0/3697072312 wait complete. 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 -- 172.21.15.35:0/1480544630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 msgr2=0x7f6588104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 --2- 172.21.15.35:0/1480544630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588104e00 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f6578009990 tx=0x7f6578009ca0 comp rx=0 tx=0).stop 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 -- 172.21.15.35:0/1480544630 shutdown_connections 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 --2- 172.21.15.35:0/1480544630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6588105530 0x7f658810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 --2- 172.21.15.35:0/1480544630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65880fe990 0x7f65880fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 --2- 172.21.15.35:0/1480544630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588104e00 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:22.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 -- 172.21.15.35:0/1480544630 >> 172.21.15.35:0/1480544630 conn(0x7f65880757a0 msgr2=0x7f6588075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:22.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 -- 172.21.15.35:0/1480544630 shutdown_connections 2023-03-17T11:36:23.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.194+0000 7f658ff24700 1 -- 172.21.15.35:0/1480544630 wait complete. 2023-03-17T11:36:23.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 Processor -- start 2023-03-17T11:36:23.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 -- start start 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65880fe990 0x7f6588196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6588105530 0x7f658819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819b210 con 0x7f65880ff330 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819b380 con 0x7f6588105530 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658ff24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819b540 con 0x7f65880fe990 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658d4bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658d4bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56130/0 (socket says 172.21.15.35:56130) 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.195+0000 7f658d4bf700 1 -- 172.21.15.35:0/1281622000 learned_addr learned my addr 172.21.15.35:0/1281622000 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65880fe990 0x7f6588196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658e4c1700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6588105530 0x7f658819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658d4bf700 1 -- 172.21.15.35:0/1281622000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65880fe990 msgr2=0x7f6588196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658d4bf700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65880fe990 0x7f6588196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658d4bf700 1 -- 172.21.15.35:0/1281622000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6588105530 msgr2=0x7f658819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658d4bf700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6588105530 0x7f658819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658d4bf700 1 -- 172.21.15.35:0/1281622000 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780095f0 con 0x7f65880ff330 2023-03-17T11:36:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658e4c1700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6588105530 0x7f658819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:36:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658d4bf700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588196770 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f6578004730 tx=0x7f6578009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f657effd700 1 -- 172.21.15.35:0/1281622000 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657801d070 con 0x7f65880ff330 2023-03-17T11:36:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f657effd700 1 -- 172.21.15.35:0/1281622000 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6578004ca0 con 0x7f65880ff330 2023-03-17T11:36:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6588110080 con 0x7f65880ff330 2023-03-17T11:36:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f657effd700 1 -- 172.21.15.35:0/1281622000 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578005030 con 0x7f65880ff330 2023-03-17T11:36:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.196+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658810fef0 con 0x7f65880ff330 2023-03-17T11:36:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.198+0000 7f657effd700 1 -- 172.21.15.35:0/1281622000 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6578003b70 con 0x7f65880ff330 2023-03-17T11:36:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.199+0000 7f657effd700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f657409f6c0 0x7f65740a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.200+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f657409f6c0 0x7f65740a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.200+0000 7f657effd700 1 -- 172.21.15.35:0/1281622000 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f65780cb5d0 con 0x7f65880ff330 2023-03-17T11:36:29.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.200+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f657409f6c0 0x7f65740a1b70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6584005950 tx=0x7f65840058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.200+0000 7f659c0b1b80 1 Processor -- start 2023-03-17T11:36:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 -- start start 2023-03-17T11:36:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1acd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1acdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d19d4010 con 0x55a1d1ad34f0 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1a26950 con 0x55a1d1acd960 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1a1fde0 con 0x55a1d1ad2be0 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1acd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1acd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56138/0 (socket says 172.21.15.35:56138) 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 -- 172.21.15.35:0/3498690593 learned_addr learned my addr 172.21.15.35:0/3498690593 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658e4c1700 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1acdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 -- 172.21.15.35:0/3498690593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 msgr2=0x55a1d1ad2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658dcc0700 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 -- 172.21.15.35:0/3498690593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 msgr2=0x55a1d1acdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1acdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 -- 172.21.15.35:0/3498690593 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d18a15d0 con 0x55a1d1ad34f0 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658dcc0700 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.201+0000 7f658d4bf700 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1acd420 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f6578095610 tx=0x7f6578098f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295454bc19bd6009 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f6573fff700 1 -- 172.21.15.35:0/3498690593 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578095820 con 0x55a1d1ad34f0 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f6573fff700 1 -- 172.21.15.35:0/3498690593 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f657809e040 con 0x55a1d1ad34f0 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f6573fff700 1 -- 172.21.15.35:0/3498690593 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578098600 con 0x55a1d1ad34f0 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 -- 172.21.15.35:0/3498690593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 msgr2=0x55a1d1acd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1acd420 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f6578095610 tx=0x7f6578098f90 comp rx=0 tx=0).stop 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 -- 172.21.15.35:0/3498690593 shutdown_connections 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1acdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/3498690593 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1acd420 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 -- 172.21.15.35:0/3498690593 >> 172.21.15.35:0/3498690593 conn(0x55a1d192a6b0 msgr2=0x55a1d1ac7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.202+0000 7f659c0b1b80 1 -- 172.21.15.35:0/3498690593 shutdown_connections 2023-03-17T11:36:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.203+0000 7f659c0b1b80 1 -- 172.21.15.35:0/3498690593 wait complete. 2023-03-17T11:36:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.203+0000 7f659c0b1b80 1 -- start start 2023-03-17T11:36:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.203+0000 7f659c0b1b80 1 Processor -- start 2023-03-17T11:36:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 0x55a1d1ad9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:34.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d18a38c0 con 0x55a1d1acd960 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1ad74d0 con 0x55a1d1ad34f0 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1ae2cf0 con 0x55a1d1ad2be0 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 10 client.0 _ll_register_callbacks cb 0x55a1d18c5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 0x55a1d1ad9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 0x55a1d1ad9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56142/0 (socket says 172.21.15.35:56142) 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 -- 172.21.15.35:0/967263213 learned_addr learned my addr 172.21.15.35:0/967263213 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658e4c1700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:34.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658d4bf700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 -- 172.21.15.35:0/967263213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 msgr2=0x55a1d1ad6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 -- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1ad34f0 msgr2=0x55a1d1ad6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 -- 172.21.15.35:0/967263213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658810fef0 con 0x55a1d1acd960 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f658dcc0700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 0x55a1d1ad9480 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f6584005fd0 tx=0x7f6584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644fa2423f0e5c37 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f65717fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:36:34.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f65717fa700 1 -- 172.21.15.35:0/967263213 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658401e620 con 0x55a1d1acd960 2023-03-17T11:36:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f65717fa700 1 -- 172.21.15.35:0/967263213 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6584011e40 con 0x55a1d1acd960 2023-03-17T11:36:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.204+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1d19e2390 con 0x55a1d1acd960 2023-03-17T11:36:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f65717fa700 1 -- 172.21.15.35:0/967263213 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f658401e780 con 0x55a1d1acd960 2023-03-17T11:36:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 10 client.21123 fetch_fsmap learned FSMap version 108 2023-03-17T11:36:35.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55a1d184dd80 con 0x55a1d1acd960 2023-03-17T11:36:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f65717fa700 1 -- 172.21.15.35:0/967263213 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a1d19e2390 con 0x55a1d1acd960 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f65717fa700 1 -- 172.21.15.35:0/967263213 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6584024020 con 0x55a1d1acd960 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 10 client.21123 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 10 client.21123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 20 client.21123 populate_metadata read hostname 'smithi035' 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1ae6d10 0x55a1d1ae9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 4 client.21123 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1d19ee600 con 0x55a1d1ae6d10 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.205+0000 7f658d4bf700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1ae6d10 0x55a1d1ae9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.206+0000 7f65717fa700 10 client.21123 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.206+0000 7f658d4bf700 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1ae6d10 0x55a1d1ae9120 crc :-1 s=READY pgs=711 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c05e1d05c764aa server_cookie=7675d342892bda7a in_seq=0 out_seq=0 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.206+0000 7f65717fa700 1 -- 172.21.15.35:0/967263213 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a1d19ee600 con 0x55a1d1ae6d10 2023-03-17T11:36:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.206+0000 7f65717fa700 10 client.21123 handle_command_reply: tid=0 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.206+0000 7f659c0b1b80 1 client.21123 shutdown 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 msgr2=0x55a1d1ad9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 0x55a1d1ad9480 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f6584005fd0 tx=0x7f6584004750 comp rx=0 tx=0).stop 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 shutdown_connections 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1ae6d10 0x55a1d1ae9120 crc :-1 s=READY pgs=711 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1acd960 0x55a1d1ad9480 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/967263213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f65717fa700 0 client.21123 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 >> 172.21.15.35:0/967263213 conn(0x55a1d192a6b0 msgr2=0x55a1d1acc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 shutdown_connections 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 1 -- 172.21.15.35:0/967263213 wait complete. 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.207+0000 7f659c0b1b80 20 client.21123 trim_cache size 0 max 16384 2023-03-17T11:36:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 Processor -- start 2023-03-17T11:36:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 -- start start 2023-03-17T11:36:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1addcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1ae4460 con 0x55a1d1ad34f0 2023-03-17T11:36:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1ae2b60 con 0x55a1d1acd960 2023-03-17T11:36:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1acd7c0 con 0x55a1d1ad2be0 2023-03-17T11:36:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56154/0 (socket says 172.21.15.35:56154) 2023-03-17T11:36:37.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:48 smithi035 ceph-mon[92535]: pgmap v5301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:36:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 -- 172.21.15.35:0/370733245 learned_addr learned my addr 172.21.15.35:0/370733245 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658dcc0700 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1addcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658d4bf700 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 -- 172.21.15.35:0/370733245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 msgr2=0x55a1d1ad9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 -- 172.21.15.35:0/370733245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 msgr2=0x55a1d1addcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1addcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.222+0000 7f658e4c1700 1 -- 172.21.15.35:0/370733245 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d19e6130 con 0x55a1d1ad34f0 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f658e4c1700 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad06b0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f6580009630 tx=0x7f6580009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ee4bb7d5a36b65 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f657cff9700 1 -- 172.21.15.35:0/370733245 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580007a50 con 0x55a1d1ad34f0 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f657cff9700 1 -- 172.21.15.35:0/370733245 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6580007bb0 con 0x55a1d1ad34f0 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f657cff9700 1 -- 172.21.15.35:0/370733245 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580015360 con 0x55a1d1ad34f0 2023-03-17T11:36:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 -- 172.21.15.35:0/370733245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 msgr2=0x55a1d1ad06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad06b0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f6580009630 tx=0x7f6580009040 comp rx=0 tx=0).stop 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 -- 172.21.15.35:0/370733245 shutdown_connections 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1ad06b0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1addcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/370733245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1ad9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 -- 172.21.15.35:0/370733245 >> 172.21.15.35:0/370733245 conn(0x55a1d192a6b0 msgr2=0x55a1d1ae2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 -- 172.21.15.35:0/370733245 shutdown_connections 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.223+0000 7f659c0b1b80 1 -- 172.21.15.35:0/370733245 wait complete. 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 -- start start 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 Processor -- start 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1add9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1adbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1adc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1adc760 con 0x55a1d1ad34f0 2023-03-17T11:36:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1adc8d0 con 0x55a1d1acd960 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d1adca90 con 0x55a1d1ad2be0 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.224+0000 7f659c0b1b80 10 client.0 _ll_register_callbacks cb 0x55a1d18c5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1adc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1adc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56160/0 (socket says 172.21.15.35:56160) 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 -- 172.21.15.35:0/1653174207 learned_addr learned my addr 172.21.15.35:0/1653174207 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1add9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658d4bf700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1adbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 -- 172.21.15.35:0/1653174207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 msgr2=0x55a1d1adbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1adbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 -- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 msgr2=0x55a1d1add9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1add9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 -- 172.21.15.35:0/1653174207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6580011040 con 0x55a1d1ad34f0 2023-03-17T11:36:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1add9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:36:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f658e4c1700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1adc220 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f6580007fd0 tx=0x7f6580009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9b8f07ff2d7d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f65717fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:36:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f65717fa700 1 -- 172.21.15.35:0/1653174207 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580004ad0 con 0x55a1d1ad34f0 2023-03-17T11:36:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f65717fa700 1 -- 172.21.15.35:0/1653174207 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6580004c30 con 0x55a1d1ad34f0 2023-03-17T11:36:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1d1a9d1e0 con 0x55a1d1ad34f0 2023-03-17T11:36:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f65717fa700 1 -- 172.21.15.35:0/1653174207 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6580004e10 con 0x55a1d1ad34f0 2023-03-17T11:36:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f659c0b1b80 10 client.21129 fetch_fsmap learned FSMap version 108 2023-03-17T11:36:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.225+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55a1d18741f0 con 0x55a1d1ad34f0 2023-03-17T11:36:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f65717fa700 1 -- 172.21.15.35:0/1653174207 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a1d1a9d1e0 con 0x55a1d1ad34f0 2023-03-17T11:36:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f65717fa700 1 -- 172.21.15.35:0/1653174207 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6580005040 con 0x55a1d1ad34f0 2023-03-17T11:36:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f659c0b1b80 10 client.21129 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:36:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f659c0b1b80 10 client.21129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:36:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f659c0b1b80 20 client.21129 populate_metadata read hostname 'smithi035' 2023-03-17T11:36:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1b3bdf0 0x55a1d1b3e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f659c0b1b80 4 client.21129 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a1d18a3f00 con 0x55a1d1b3bdf0 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1b3bdf0 0x55a1d1b3e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f65717fa700 10 client.21129 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.226+0000 7f658dcc0700 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1b3bdf0 0x55a1d1b3e200 crc :-1 s=READY pgs=712 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c7c360dab91dd74 server_cookie=d3a7cc560c147c74 in_seq=0 out_seq=0 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f65717fa700 1 -- 172.21.15.35:0/1653174207 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a1d18a3f00 con 0x55a1d1b3bdf0 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f65717fa700 10 client.21129 handle_command_reply: tid=0 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 client.21129 shutdown 2023-03-17T11:36:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 msgr2=0x55a1d1adc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1adc220 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f6580007fd0 tx=0x7f6580009970 comp rx=0 tx=0).stop 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 shutdown_connections 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a1d1b3bdf0 0x55a1d1b3e200 crc :-1 s=READY pgs=712 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a1d1ad34f0 0x55a1d1adc220 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a1d1acd960 0x55a1d1add9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 --2- 172.21.15.35:0/1653174207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1d1ad2be0 0x55a1d1adbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 >> 172.21.15.35:0/1653174207 conn(0x55a1d192a6b0 msgr2=0x55a1d1ad06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f65717fa700 0 client.21129 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:36:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 shutdown_connections 2023-03-17T11:36:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 1 -- 172.21.15.35:0/1653174207 wait complete. 2023-03-17T11:36:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.238+0000 7f659c0b1b80 20 client.21129 trim_cache size 0 max 16384 2023-03-17T11:36:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f657409f6c0 msgr2=0x7f65740a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f657409f6c0 0x7f65740a1b70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6584005950 tx=0x7f65840058e0 comp rx=0 tx=0).stop 2023-03-17T11:36:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 msgr2=0x7f6588196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588196770 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f6578004730 tx=0x7f6578009580 comp rx=0 tx=0).stop 2023-03-17T11:36:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 shutdown_connections 2023-03-17T11:36:52.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f657409f6c0 0x7f65740a1b70 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6588105530 0x7f658819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65880fe990 0x7f6588196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 --2- 172.21.15.35:0/1281622000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f65880ff330 0x7f6588196770 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 >> 172.21.15.35:0/1281622000 conn(0x7f65880757a0 msgr2=0x7f65880fc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 shutdown_connections 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:34.239+0000 7f658ff24700 1 -- 172.21.15.35:0/1281622000 wait complete. 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 -- 172.21.15.35:0/586277018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47181044d0 msgr2=0x7f471810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 --2- 172.21.15.35:0/586277018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47181044d0 0x7f471810c0a0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f471000b0d0 tx=0x7f471000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 -- 172.21.15.35:0/586277018 shutdown_connections 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 --2- 172.21.15.35:0/586277018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47181044d0 0x7f471810c0a0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 --2- 172.21.15.35:0/586277018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180ff4b0 0x7f47180ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 --2- 172.21.15.35:0/586277018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47180ffe50 0x7f4718103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 -- 172.21.15.35:0/586277018 >> 172.21.15.35:0/586277018 conn(0x7f4718077220 msgr2=0x7f4718077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 -- 172.21.15.35:0/586277018 shutdown_connections 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.363+0000 7f471d8a3700 1 -- 172.21.15.35:0/586277018 wait complete. 2023-03-17T11:36:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 Processor -- start 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 -- start start 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47180ff4b0 0x7f47181963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 0x7f4718196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47181044d0 0x7f471819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471819b3c0 con 0x7f47180ffe50 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471819b530 con 0x7f47181044d0 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f471d8a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471819b6f0 con 0x7f47180ff4b0 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 0x7f4718196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 0x7f4718196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56174/0 (socket says 172.21.15.35:56174) 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47167fc700 1 -- 172.21.15.35:0/3275728769 learned_addr learned my addr 172.21.15.35:0/3275728769 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47177fe700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47181044d0 0x7f471819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47180ff4b0 0x7f47181963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47167fc700 1 -- 172.21.15.35:0/3275728769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47180ff4b0 msgr2=0x7f47181963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47167fc700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47180ff4b0 0x7f47181963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.364+0000 7f47167fc700 1 -- 172.21.15.35:0/3275728769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47181044d0 msgr2=0x7f471819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f47167fc700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47181044d0 0x7f471819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f47167fc700 1 -- 172.21.15.35:0/3275728769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710009d00 con 0x7f47180ffe50 2023-03-17T11:36:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f47177fe700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47181044d0 0x7f471819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:36:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f47167fc700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 0x7f4718196920 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f470000d950 tx=0x7f470000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:53.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f471c8a1700 1 -- 172.21.15.35:0/3275728769 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000bb60 con 0x7f47180ffe50 2023-03-17T11:36:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471810f0e0 con 0x7f47180ffe50 2023-03-17T11:36:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f471c8a1700 1 -- 172.21.15.35:0/3275728769 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f470000de30 con 0x7f47180ffe50 2023-03-17T11:36:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f471c8a1700 1 -- 172.21.15.35:0/3275728769 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700005440 con 0x7f47180ffe50 2023-03-17T11:36:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.365+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471810ef50 con 0x7f47180ffe50 2023-03-17T11:36:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.367+0000 7f471c8a1700 1 -- 172.21.15.35:0/3275728769 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f47000055a0 con 0x7f47180ffe50 2023-03-17T11:36:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.368+0000 7f471c8a1700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f470409f640 0x7f47040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.368+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f470409f640 0x7f47040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.368+0000 7f471c8a1700 1 -- 172.21.15.35:0/3275728769 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47000c9fb0 con 0x7f47180ffe50 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f470409f640 0x7f47040a1af0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4708009b30 tx=0x7f4708009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 Processor -- start 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 -- start start 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 0x56420529fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a0330 0x5642052a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a4170 0x5642052a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642051a2010 con 0x56420529fa20 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642051f4950 con 0x5642052a0330 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4729a30b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642051edde0 con 0x5642052a4170 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4716ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 0x56420529fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4716ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 0x56420529fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56180/0 (socket says 172.21.15.35:56180) 2023-03-17T11:36:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f4716ffd700 1 -- 172.21.15.35:0/2964879916 learned_addr learned my addr 172.21.15.35:0/2964879916 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:36:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.369+0000 7f47167fc700 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a0330 0x5642052a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f47177fe700 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a4170 0x5642052a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:36:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f4716ffd700 1 -- 172.21.15.35:0/2964879916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a4170 msgr2=0x5642052a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f4716ffd700 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a4170 0x5642052a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f4716ffd700 1 -- 172.21.15.35:0/2964879916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a0330 msgr2=0x5642052a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:36:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f4716ffd700 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a0330 0x5642052a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f4716ffd700 1 -- 172.21.15.35:0/2964879916 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56420506f5d0 con 0x56420529fa20 2023-03-17T11:36:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f47167fc700 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a0330 0x5642052a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:36:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f4716ffd700 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 0x56420529fdf0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f4708010c20 tx=0x7f4708013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fecf7d4dd52fb27 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:36:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f470dffb700 1 -- 172.21.15.35:0/2964879916 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708012ae0 con 0x56420529fa20 2023-03-17T11:36:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f470dffb700 1 -- 172.21.15.35:0/2964879916 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4708004cc0 con 0x56420529fa20 2023-03-17T11:36:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.370+0000 7f470dffb700 1 -- 172.21.15.35:0/2964879916 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080055b0 con 0x56420529fa20 2023-03-17T11:36:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 -- 172.21.15.35:0/2964879916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 msgr2=0x56420529fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:36:59.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 0x56420529fdf0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f4708010c20 tx=0x7f4708013000 comp rx=0 tx=0).stop 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 -- 172.21.15.35:0/2964879916 shutdown_connections 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a4170 0x5642052a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56420529fa20 0x56420529fdf0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 --2- 172.21.15.35:0/2964879916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a0330 0x5642052a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 -- 172.21.15.35:0/2964879916 >> 172.21.15.35:0/2964879916 conn(0x5642050f86b0 msgr2=0x564205295a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 -- 172.21.15.35:0/2964879916 shutdown_connections 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 -- 172.21.15.35:0/2964879916 wait complete. 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 -- start start 2023-03-17T11:36:59.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.371+0000 7f4729a30b80 1 Processor -- start 2023-03-17T11:36:59.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:50 smithi035 ceph-mon[92535]: pgmap v5302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x5642052ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:01.306 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642050718c0 con 0x5642052a0330 2023-03-17T11:37:01.985 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642052a9a10 con 0x5642052a4170 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642052b5410 con 0x56420529fa20 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4729a30b80 10 client.0 _ll_register_callbacks cb 0x564205093230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56188/0 (socket says 172.21.15.35:56188) 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 -- 172.21.15.35:0/3527692500 learned_addr learned my addr 172.21.15.35:0/3527692500 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x5642052ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:01.986 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47177fe700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 -- 172.21.15.35:0/3527692500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 msgr2=0x5642052ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x5642052ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 -- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 msgr2=0x5642052a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 -- 172.21.15.35:0/3527692500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708010900 con 0x5642052a0330 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f47167fc700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052a8b60 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f47000c77f0 tx=0x7f470000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a309881c816aa22a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.372+0000 7f46f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f46f6ffd700 1 -- 172.21.15.35:0/3527692500 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700096f50 con 0x5642052a0330 2023-03-17T11:37:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f46f6ffd700 1 -- 172.21.15.35:0/3527692500 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f47000970b0 con 0x5642052a0330 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642051b0390 con 0x5642052a0330 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f46f6ffd700 1 -- 172.21.15.35:0/3527692500 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47000c72c0 con 0x5642052a0330 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 10 client.21141 fetch_fsmap learned FSMap version 108 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x56420501bd80 con 0x5642052a0330 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f46f6ffd700 1 -- 172.21.15.35:0/3527692500 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47000b3020 con 0x5642052a0330 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f46f6ffd700 1 -- 172.21.15.35:0/3527692500 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f47000969c0 con 0x5642052a0330 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 10 client.21141 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 10 client.21141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 20 client.21141 populate_metadata read hostname 'smithi035' 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642052b9470 0x5642052bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 4 client.21141 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642051bc600 con 0x5642052b9470 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.373+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642052b9470 0x5642052bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.374+0000 7f46f6ffd700 10 client.21141 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.374+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642052b9470 0x5642052bb880 crc :-1 s=READY pgs=713 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d77f3d526748529 server_cookie=bb83ee1936fcad68 in_seq=0 out_seq=0 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.374+0000 7f46f6ffd700 1 -- 172.21.15.35:0/3527692500 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5642051bc600 con 0x5642052b9470 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.374+0000 7f46f6ffd700 10 client.21141 handle_command_reply: tid=0 2023-03-17T11:37:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.374+0000 7f4729a30b80 1 client.21141 shutdown 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 msgr2=0x5642052a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052a8b60 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f47000c77f0 tx=0x7f470000bdf0 comp rx=0 tx=0).stop 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 shutdown_connections 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5642052b9470 0x5642052bb880 crc :-1 s=READY pgs=713 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x5642052ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f46f6ffd700 0 client.21141 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3527692500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052a8b60 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 >> 172.21.15.35:0/3527692500 conn(0x5642050f86b0 msgr2=0x56420529a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 shutdown_connections 2023-03-17T11:37:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 1 -- 172.21.15.35:0/3527692500 wait complete. 2023-03-17T11:37:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.375+0000 7f4729a30b80 20 client.21141 trim_cache size 0 max 16384 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 Processor -- start 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 -- start start 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x564205295ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642051bc600 con 0x5642052a0330 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x564205296e30 con 0x5642052a4170 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4729a30b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564205296000 con 0x56420529fa20 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56196/0 (socket says 172.21.15.35:56196) 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 -- 172.21.15.35:0/3818795006 learned_addr learned my addr 172.21.15.35:0/3818795006 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f4716ffd700 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x564205295ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47177fe700 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 -- 172.21.15.35:0/3818795006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 msgr2=0x564205295ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x564205295ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 -- 172.21.15.35:0/3818795006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 msgr2=0x5642052b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47167fc700 1 -- 172.21.15.35:0/3818795006 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642051b4130 con 0x5642052a0330 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.390+0000 7f47177fe700 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f47167fc700 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052b0360 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f470000b540 tx=0x7f4700007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd3d7439a667525 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f470e7fc700 1 -- 172.21.15.35:0/3818795006 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700093da0 con 0x5642052a0330 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f470e7fc700 1 -- 172.21.15.35:0/3818795006 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47000b3040 con 0x5642052a0330 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f470e7fc700 1 -- 172.21.15.35:0/3818795006 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470009f7c0 con 0x5642052a0330 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 -- 172.21.15.35:0/3818795006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 msgr2=0x5642052b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052b0360 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f470000b540 tx=0x7f4700007f70 comp rx=0 tx=0).stop 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 -- 172.21.15.35:0/3818795006 shutdown_connections 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5642052a4170 0x5642052b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56420529fa20 0x564205295ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 --2- 172.21.15.35:0/3818795006 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a0330 0x5642052b0360 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 -- 172.21.15.35:0/3818795006 >> 172.21.15.35:0/3818795006 conn(0x5642050f86b0 msgr2=0x5642052a6550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 -- 172.21.15.35:0/3818795006 shutdown_connections 2023-03-17T11:37:09.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.391+0000 7f4729a30b80 1 -- 172.21.15.35:0/3818795006 wait complete. 2023-03-17T11:37:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 -- start start 2023-03-17T11:37:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 Processor -- start 2023-03-17T11:37:09.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56420529fa20 0x5642052ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a0330 0x5642052aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 0x56420530c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642052af210 con 0x5642052a4170 2023-03-17T11:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420530c880 con 0x56420529fa20 2023-03-17T11:37:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420530ca40 con 0x5642052a0330 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4729a30b80 10 client.0 _ll_register_callbacks cb 0x564205093230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f47177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 0x56420530c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f47177fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 0x56420530c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56204/0 (socket says 172.21.15.35:56204) 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f47177fe700 1 -- 172.21.15.35:0/4043695739 learned_addr learned my addr 172.21.15.35:0/4043695739 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f4716ffd700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56420529fa20 0x5642052ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.392+0000 7f47167fc700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a0330 0x5642052aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f47177fe700 1 -- 172.21.15.35:0/4043695739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a0330 msgr2=0x5642052aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f47177fe700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a0330 0x5642052aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f47177fe700 1 -- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56420529fa20 msgr2=0x5642052ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f47177fe700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56420529fa20 0x5642052ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f47177fe700 1 -- 172.21.15.35:0/4043695739 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56420501bd80 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f47177fe700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 0x56420530c310 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f471000bcd0 tx=0x7f471000bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd139c1030c8efa server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f46f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f46f6ffd700 1 -- 172.21.15.35:0/4043695739 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000e040 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f46f6ffd700 1 -- 172.21.15.35:0/4043695739 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f4710009470 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56420526b1e0 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f46f6ffd700 1 -- 172.21.15.35:0/4043695739 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47100078f0 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f4729a30b80 10 client.21147 fetch_fsmap learned FSMap version 108 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5642050421f0 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f46f6ffd700 1 -- 172.21.15.35:0/4043695739 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56420526b1e0 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.393+0000 7f46f6ffd700 1 -- 172.21.15.35:0/4043695739 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f471000b100 con 0x5642052a4170 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4729a30b80 10 client.21147 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4729a30b80 10 client.21147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:37:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4729a30b80 20 client.21147 populate_metadata read hostname 'smithi035' 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4729a30b80 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56420530e180 0x564205310590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4729a30b80 4 client.21147 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564205071f00 con 0x56420530e180 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4716ffd700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56420530e180 0x564205310590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f4716ffd700 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56420530e180 0x564205310590 crc :-1 s=READY pgs=714 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4af19c2d4d0087d server_cookie=eb972f66f6f92c91 in_seq=0 out_seq=0 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.394+0000 7f46f6ffd700 10 client.21147 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.403+0000 7f46f6ffd700 1 -- 172.21.15.35:0/4043695739 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564205071f00 con 0x56420530e180 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.403+0000 7f46f6ffd700 10 client.21147 handle_command_reply: tid=0 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.403+0000 7f4729a30b80 1 client.21147 shutdown 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 msgr2=0x56420530c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 0x56420530c310 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f471000bcd0 tx=0x7f471000bd00 comp rx=0 tx=0).stop 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 shutdown_connections 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56420530e180 0x564205310590 crc :-1 s=READY pgs=714 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5642052a4170 0x56420530c310 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f46f6ffd700 0 client.21147 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56420529fa20 0x5642052ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 --2- 172.21.15.35:0/4043695739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642052a0330 0x5642052aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 >> 172.21.15.35:0/4043695739 conn(0x5642050f86b0 msgr2=0x5642052a2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 shutdown_connections 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 1 -- 172.21.15.35:0/4043695739 wait complete. 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f4729a30b80 20 client.21147 trim_cache size 0 max 16384 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f470409f640 msgr2=0x7f47040a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f471d8a3700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f470409f640 0x7f47040a1af0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4708009b30 tx=0x7f4708009260 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 msgr2=0x7f4718196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f471d8a3700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 0x7f4718196920 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f470000d950 tx=0x7f470000dd10 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.404+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 shutdown_connections 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f470409f640 0x7f47040a1af0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47181044d0 0x7f471819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47180ff4b0 0x7f47181963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 --2- 172.21.15.35:0/3275728769 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f47180ffe50 0x7f4718196920 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 >> 172.21.15.35:0/3275728769 conn(0x7f4718077220 msgr2=0x7f47180692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 shutdown_connections 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:13:47.405+0000 7f471d8a3700 1 -- 172.21.15.35:0/3275728769 wait complete. 2023-03-17T11:37:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 -- 172.21.15.35:0/1101778715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c0ffd30 msgr2=0x7f2f5c103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:12.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/1101778715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c103cf0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f2f500099c0 tx=0x7f2f50009cd0 comp rx=0 tx=0).stop 2023-03-17T11:37:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 -- 172.21.15.35:0/1101778715 shutdown_connections 2023-03-17T11:37:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/1101778715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/1101778715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 0x7f2f5c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/1101778715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c103cf0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:14.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 -- 172.21.15.35:0/1101778715 >> 172.21.15.35:0/1101778715 conn(0x7f2f5c075f30 msgr2=0x7f2f5c076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.535+0000 7f2f60bc3700 1 -- 172.21.15.35:0/1101778715 shutdown_connections 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.536+0000 7f2f60bc3700 1 -- 172.21.15.35:0/1101778715 wait complete. 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 Processor -- start 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 -- start start 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 0x7f2f5c1940e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c194620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c1990c0 con 0x7f2f5c1043d0 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c199230 con 0x7f2f5c0ffd30 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f60bc3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c1993f0 con 0x7f2f5c0ff390 2023-03-17T11:37:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:14.993 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:52 smithi035 ceph-mon[92535]: pgmap v5303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f59d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c194620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56216/0 (socket says 172.21.15.35:56216) 2023-03-17T11:37:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f5ad9d700 1 -- 172.21.15.35:0/910520285 learned_addr learned my addr 172.21.15.35:0/910520285 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 0x7f2f5c1940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.537+0000 7f2f59d9b700 1 -- 172.21.15.35:0/910520285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 msgr2=0x7f2f5c1940e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 0x7f2f5c1940e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f59d9b700 1 -- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 msgr2=0x7f2f5c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f59d9b700 1 -- 172.21.15.35:0/910520285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009c40 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 0x7f2f5c1940e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c194620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009fd0 tx=0x7f2f5000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f4b7fe700 1 -- 172.21.15.35:0/910520285 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5001d070 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f4b7fe700 1 -- 172.21.15.35:0/910520285 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f50022470 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f500095f0 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f4b7fe700 1 -- 172.21.15.35:0/910520285 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50017650 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.538+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c10e000 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.541+0000 7f2f4b7fe700 1 -- 172.21.15.35:0/910520285 <== mon.2 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2f50022850 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.542+0000 7f2f4b7fe700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f440a3a50 0x7f2f440a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.542+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f440a3a50 0x7f2f440a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.542+0000 7f2f4b7fe700 1 -- 172.21.15.35:0/910520285 <== mon.2 v2:172.21.15.78:3300/0 5 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f500cb450 con 0x7f2f5c0ffd30 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.542+0000 7f2f6cd50b80 1 Processor -- start 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.542+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f440a3a50 0x7f2f440a5f00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00bfd0 tx=0x7f2f4c00d040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 -- start start 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c90fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0c8b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c8b960 0x5562e0c8bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0b92010 con 0x5562e0c8b960 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0be4950 con 0x5562e0c914f0 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0bddde0 con 0x5562e0c90be0 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c90fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c8b960 0x5562e0c8bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c90fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:47986/0 (socket says 172.21.15.35:47986) 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 -- 172.21.15.35:0/2242392051 learned_addr learned my addr 172.21.15.35:0/2242392051 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0c8b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 -- 172.21.15.35:0/2242392051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 msgr2=0x5562e0c8b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0c8b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 -- 172.21.15.35:0/2242392051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c8b960 msgr2=0x5562e0c8bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c8b960 0x5562e0c8bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5a59c700 1 -- 172.21.15.35:0/2242392051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e0a5f5d0 con 0x5562e0c90be0 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.543+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c8b960 0x5562e0c8bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.544+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c90fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c018560 tx=0x7f2f4c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab305bb3baea192c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.544+0000 7f2f48ff9700 1 -- 172.21.15.35:0/2242392051 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c010040 con 0x5562e0c90be0 2023-03-17T11:37:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.544+0000 7f2f48ff9700 1 -- 172.21.15.35:0/2242392051 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f4c022880 con 0x5562e0c90be0 2023-03-17T11:37:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.544+0000 7f2f48ff9700 1 -- 172.21.15.35:0/2242392051 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c016850 con 0x5562e0c90be0 2023-03-17T11:37:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/2242392051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 msgr2=0x5562e0c90fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c90fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c018560 tx=0x7f2f4c014000 comp rx=0 tx=0).stop 2023-03-17T11:37:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/2242392051 shutdown_connections 2023-03-17T11:37:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c8b960 0x5562e0c8bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c90fb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/2242392051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0c8b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:22.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/2242392051 >> 172.21.15.35:0/2242392051 conn(0x5562e0ae86b0 msgr2=0x5562e0c85a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/2242392051 shutdown_connections 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/2242392051 wait complete. 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.545+0000 7f2f6cd50b80 1 -- start start 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 Processor -- start 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c8b960 0x5562e0c973e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c94c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0a618c0 con 0x5562e0c914f0 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0c95390 con 0x5562e0c8b960 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0ca1000 con 0x5562e0c90be0 2023-03-17T11:37:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f6cd50b80 10 client.0 _ll_register_callbacks cb 0x5562e0a83230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:37:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c94c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c94c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56230/0 (socket says 172.21.15.35:56230) 2023-03-17T11:37:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f59d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c94660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 -- 172.21.15.35:0/1347295088 learned_addr learned my addr 172.21.15.35:0/1347295088 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c8b960 0x5562e0c973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:24.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 -- 172.21.15.35:0/1347295088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 msgr2=0x5562e0c94660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c94660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 -- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c8b960 msgr2=0x5562e0c973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c8b960 0x5562e0c973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.546+0000 7f2f5ad9d700 1 -- 172.21.15.35:0/1347295088 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c009dc0 con 0x5562e0c914f0 2023-03-17T11:37:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c94c20 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400ef30 tx=0x7f2f540077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cb0a813d120970 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:37:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f41ffb700 1 -- 172.21.15.35:0/1347295088 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54004db0 con 0x5562e0c914f0 2023-03-17T11:37:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f41ffb700 1 -- 172.21.15.35:0/1347295088 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f54005020 con 0x5562e0c914f0 2023-03-17T11:37:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562e0ba0390 con 0x5562e0c914f0 2023-03-17T11:37:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f41ffb700 1 -- 172.21.15.35:0/1347295088 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f54005220 con 0x5562e0c914f0 2023-03-17T11:37:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f6cd50b80 10 client.21159 fetch_fsmap learned FSMap version 108 2023-03-17T11:37:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5562e0a0bd80 con 0x5562e0c914f0 2023-03-17T11:37:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f41ffb700 1 -- 172.21.15.35:0/1347295088 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562e0ba0390 con 0x5562e0c914f0 2023-03-17T11:37:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f41ffb700 1 -- 172.21.15.35:0/1347295088 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2f540166f0 con 0x5562e0c914f0 2023-03-17T11:37:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f6cd50b80 10 client.21159 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:37:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.547+0000 7f2f6cd50b80 10 client.21159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:37:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f6cd50b80 20 client.21159 populate_metadata read hostname 'smithi035' 2023-03-17T11:37:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0ca5060 0x5562e0ca7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f6cd50b80 4 client.21159 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:37:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562e0bac600 con 0x5562e0ca5060 2023-03-17T11:37:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0ca5060 0x5562e0ca7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0ca5060 0x5562e0ca7470 crc :-1 s=READY pgs=715 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9aaa9441ff61901 server_cookie=4f970cd0cd39ffa7 in_seq=0 out_seq=0 2023-03-17T11:37:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.548+0000 7f2f41ffb700 10 client.21159 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f41ffb700 1 -- 172.21.15.35:0/1347295088 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5562e0bac600 con 0x5562e0ca5060 2023-03-17T11:37:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f41ffb700 10 client.21159 handle_command_reply: tid=0 2023-03-17T11:37:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 client.21159 shutdown 2023-03-17T11:37:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 msgr2=0x5562e0c94c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c94c20 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400ef30 tx=0x7f2f540077e0 comp rx=0 tx=0).stop 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 shutdown_connections 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0ca5060 0x5562e0ca7470 crc :-1 s=READY pgs=715 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c94c20 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f41ffb700 0 client.21159 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c8b960 0x5562e0c973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/1347295088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c90be0 0x5562e0c94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 >> 172.21.15.35:0/1347295088 conn(0x5562e0ae86b0 msgr2=0x5562e0c8a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 shutdown_connections 2023-03-17T11:37:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/1347295088 wait complete. 2023-03-17T11:37:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.549+0000 7f2f6cd50b80 20 client.21159 trim_cache size 0 max 16384 2023-03-17T11:37:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 Processor -- start 2023-03-17T11:37:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 -- start start 2023-03-17T11:37:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0c9bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:31.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c90be0 0x5562e0c96f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c8a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0ba1050 con 0x5562e0c914f0 2023-03-17T11:37:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0c810f0 con 0x5562e0c90be0 2023-03-17T11:37:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0c95200 con 0x5562e0c8b960 2023-03-17T11:37:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c8a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0c9bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f59d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c90be0 0x5562e0c96f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f5ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c8a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56236/0 (socket says 172.21.15.35:56236) 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0c9bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:48000/0 (socket says 172.21.15.35:48000) 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.567+0000 7f2f5ad9d700 1 -- 172.21.15.35:0/3706440417 learned_addr learned my addr 172.21.15.35:0/3706440417 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f5a59c700 1 -- 172.21.15.35:0/3706440417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c90be0 msgr2=0x5562e0c96f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c90be0 0x5562e0c96f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f5a59c700 1 -- 172.21.15.35:0/3706440417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 msgr2=0x5562e0c8a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c8a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f5a59c700 1 -- 172.21.15.35:0/3706440417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e0ba4130 con 0x5562e0c8b960 2023-03-17T11:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0c9bf50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c018b50 tx=0x7f2f4c022ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815a8cbdba33f781 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f497fa700 1 -- 172.21.15.35:0/3706440417 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c010040 con 0x5562e0c8b960 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f497fa700 1 -- 172.21.15.35:0/3706440417 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f4c00b3a0 con 0x5562e0c8b960 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.568+0000 7f2f497fa700 1 -- 172.21.15.35:0/3706440417 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c005580 con 0x5562e0c8b960 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/3706440417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 msgr2=0x5562e0c9bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0c9bf50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c018b50 tx=0x7f2f4c022ec0 comp rx=0 tx=0).stop 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/3706440417 shutdown_connections 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c914f0 0x5562e0c8a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0c9bf50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/3706440417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c90be0 0x5562e0c96f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/3706440417 >> 172.21.15.35:0/3706440417 conn(0x5562e0ae86b0 msgr2=0x5562e0c8e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/3706440417 shutdown_connections 2023-03-17T11:37:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.569+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/3706440417 wait complete. 2023-03-17T11:37:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 -- start start 2023-03-17T11:37:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 Processor -- start 2023-03-17T11:37:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0ced040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 0x5562e0ced580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0cf1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0cf2450 con 0x5562e0c90be0 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0cf25c0 con 0x5562e0c914f0 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e0cf2780 con 0x5562e0c8b960 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f6cd50b80 10 client.0 _ll_register_callbacks cb 0x5562e0a83230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f59d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 0x5562e0ced580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f5a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0ced040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f59d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 0x5562e0ced580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56242/0 (socket says 172.21.15.35:56242) 2023-03-17T11:37:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f59d9b700 1 -- 172.21.15.35:0/4140187614 learned_addr learned my addr 172.21.15.35:0/4140187614 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.570+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0cf1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f59d9b700 1 -- 172.21.15.35:0/4140187614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 msgr2=0x5562e0ced040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0ced040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f59d9b700 1 -- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 msgr2=0x5562e0cf1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0cf1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:35.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:54 smithi035 ceph-mon[92535]: pgmap v5304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:37:36.045 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:56 smithi035 ceph-mon[92535]: pgmap v5305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:37.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:26:58 smithi035 ceph-mon[92535]: pgmap v5306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:37:37.693 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:00 smithi035 ceph-mon[92535]: pgmap v5307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:37.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:02 smithi035 ceph-mon[92535]: pgmap v5308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:39.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:04 smithi035 ceph-mon[92535]: pgmap v5309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:37:39.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:06 smithi035 ceph-mon[92535]: pgmap v5310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:37:39.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:08 smithi035 ceph-mon[92535]: pgmap v5311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:37:39.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:09 smithi035 ceph-mon[92535]: osdmap e401: 12 total, 12 up, 12 in 2023-03-17T11:37:39.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:10 smithi035 ceph-mon[92535]: pgmap v5313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:12 smithi035 ceph-mon[92535]: pgmap v5314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:14 smithi035 ceph-mon[92535]: pgmap v5315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:16 smithi035 ceph-mon[92535]: pgmap v5316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:18 smithi035 ceph-mon[92535]: osdmap e402: 12 total, 12 up, 12 in 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:18 smithi035 ceph-mon[92535]: pgmap v5318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:20 smithi035 ceph-mon[92535]: pgmap v5319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:22 smithi035 ceph-mon[92535]: pgmap v5320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:24 smithi035 ceph-mon[92535]: pgmap v5321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:26 smithi035 ceph-mon[92535]: pgmap v5322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:37:42.629 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:28 smithi035 ceph-mon[92535]: pgmap v5323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:30 smithi035 ceph-mon[92535]: pgmap v5324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:32 smithi035 ceph-mon[92535]: pgmap v5325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:33 smithi035 ceph-mon[92535]: pgmap v5326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:33 smithi035 ceph-mon[92535]: pgmap v5327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:35 smithi035 ceph-mon[92535]: pgmap v5328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:37 smithi035 ceph-mon[92535]: pgmap v5329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:37:42.630 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:39 smithi035 ceph-mon[92535]: pgmap v5330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:37:44.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:41 smithi035 ceph-mon[92535]: pgmap v5331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:37:44.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:43 smithi035 ceph-mon[92535]: pgmap v5332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:37:44.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:45 smithi035 ceph-mon[92535]: pgmap v5333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:44.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:47 smithi035 ceph-mon[92535]: pgmap v5334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:44.312 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:49 smithi035 ceph-mon[92535]: pgmap v5335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:37:44.313 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:51 smithi035 ceph-mon[92535]: pgmap v5336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f59d9b700 1 -- 172.21.15.35:0/4140187614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562e0a5f5d0 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f5ad9d700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0cf1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0ced040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f59d9b700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 0x5562e0ced580 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f2f500959a0 tx=0x7f2f500cb350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eb3dc93e9f0985 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f41ffb700 1 -- 172.21.15.35:0/4140187614 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500b1070 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f41ffb700 1 -- 172.21.15.35:0/4140187614 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(373..373 src has 1..373) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2f500b11d0 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562e0c5b1e0 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f41ffb700 1 -- 172.21.15.35:0/4140187614 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f50099390 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f6cd50b80 10 client.21165 fetch_fsmap learned FSMap version 108 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5562e0a321f0 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f41ffb700 1 -- 172.21.15.35:0/4140187614 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562e0c5b1e0 con 0x5562e0c90be0 2023-03-17T11:37:44.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.571+0000 7f2f41ffb700 1 -- 172.21.15.35:0/4140187614 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2f50094d20 con 0x5562e0c90be0 2023-03-17T11:37:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f6cd50b80 10 client.21165 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:37:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f6cd50b80 10 client.21165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:37:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f6cd50b80 20 client.21165 populate_metadata read hostname 'smithi035' 2023-03-17T11:37:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0cf9c00 0x5562e0cfc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f6cd50b80 4 client.21165 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:37:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5562e0a61f00 con 0x5562e0cf9c00 2023-03-17T11:37:46.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0cf9c00 0x5562e0cfc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f41ffb700 10 client.21165 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.572+0000 7f2f5a59c700 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0cf9c00 0x5562e0cfc010 crc :-1 s=READY pgs=716 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af730ce416dd2710 server_cookie=7aa021e463a37f94 in_seq=0 out_seq=0 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f41ffb700 1 -- 172.21.15.35:0/4140187614 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5562e0a61f00 con 0x5562e0cf9c00 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f41ffb700 10 client.21165 handle_command_reply: tid=0 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 client.21165 shutdown 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 msgr2=0x5562e0ced580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 0x5562e0ced580 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f2f500959a0 tx=0x7f2f500cb350 comp rx=0 tx=0).stop 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 shutdown_connections 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562e0cf9c00 0x5562e0cfc010 crc :-1 s=READY pgs=716 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562e0c914f0 0x5562e0cf1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f41ffb700 0 client.21165 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:37:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562e0c8b960 0x5562e0ced040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 --2- 172.21.15.35:0/4140187614 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562e0c90be0 0x5562e0ced580 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 >> 172.21.15.35:0/4140187614 conn(0x5562e0ae86b0 msgr2=0x5562e0c8a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 shutdown_connections 2023-03-17T11:37:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 1 -- 172.21.15.35:0/4140187614 wait complete. 2023-03-17T11:37:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.633+0000 7f2f6cd50b80 20 client.21165 trim_cache size 0 max 16384 2023-03-17T11:37:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f440a3a50 msgr2=0x7f2f440a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f440a3a50 0x7f2f440a5f00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00bfd0 tx=0x7f2f4c00d040 comp rx=0 tx=0).stop 2023-03-17T11:37:49.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c0ffd30 msgr2=0x7f2f5c194620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c194620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009fd0 tx=0x7f2f5000f690 comp rx=0 tx=0).stop 2023-03-17T11:37:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 shutdown_connections 2023-03-17T11:37:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2f440a3a50 0x7f2f440a5f00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2f5c1043d0 0x7f2f5c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c0ff390 0x7f2f5c1940e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 --2- 172.21.15.35:0/910520285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f5c0ffd30 0x7f2f5c194620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 >> 172.21.15.35:0/910520285 conn(0x7f2f5c075f30 msgr2=0x7f2f5c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 shutdown_connections 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:00.634+0000 7f2f60bc3700 1 -- 172.21.15.35:0/910520285 wait complete. 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 -- 172.21.15.35:0/396641765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21181043c0 msgr2=0x7f211810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 --2- 172.21.15.35:0/396641765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21181043c0 0x7f211810bf90 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f211000b0d0 tx=0x7f211000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 -- 172.21.15.35:0/396641765 shutdown_connections 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 --2- 172.21.15.35:0/396641765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21181043c0 0x7f211810bf90 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 --2- 172.21.15.35:0/396641765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180ff3d0 0x7f21180ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 --2- 172.21.15.35:0/396641765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21180ffd70 0x7f2118103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 -- 172.21.15.35:0/396641765 >> 172.21.15.35:0/396641765 conn(0x7f2118075f00 msgr2=0x7f2118076300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 -- 172.21.15.35:0/396641765 shutdown_connections 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.758+0000 7f211d1de700 1 -- 172.21.15.35:0/396641765 wait complete. 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.759+0000 7f211d1de700 1 Processor -- start 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.759+0000 7f211d1de700 1 -- start start 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211d1de700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180ff3d0 0x7f2118196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211d1de700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 0x7f2118196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211d1de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21181043c0 0x7f211819aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211d1de700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211819b510 con 0x7f21180ffd70 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211d1de700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211819b680 con 0x7f21181043c0 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211d1de700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211819b840 con 0x7f21180ff3d0 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 0x7f2118196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 0x7f2118196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56256/0 (socket says 172.21.15.35:56256) 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 -- 172.21.15.35:0/129615987 learned_addr learned my addr 172.21.15.35:0/129615987 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f2116d9d700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180ff3d0 0x7f2118196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211759e700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21181043c0 0x7f211819aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 -- 172.21.15.35:0/129615987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180ff3d0 msgr2=0x7f2118196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180ff3d0 0x7f2118196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 -- 172.21.15.35:0/129615987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21181043c0 msgr2=0x7f211819aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21181043c0 0x7f211819aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 -- 172.21.15.35:0/129615987 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110009d00 con 0x7f21180ffd70 2023-03-17T11:37:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f211659c700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 0x7f2118196a70 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f210800d950 tx=0x7f210800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.760+0000 7f210ffff700 1 -- 172.21.15.35:0/129615987 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800f890 con 0x7f21180ffd70 2023-03-17T11:37:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.761+0000 7f210ffff700 1 -- 172.21.15.35:0/129615987 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f210800fe80 con 0x7f21180ffd70 2023-03-17T11:37:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.761+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211810f040 con 0x7f21180ffd70 2023-03-17T11:37:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.761+0000 7f210ffff700 1 -- 172.21.15.35:0/129615987 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800e3b0 con 0x7f21180ffd70 2023-03-17T11:37:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.761+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211810eeb0 con 0x7f21180ffd70 2023-03-17T11:37:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.763+0000 7f210ffff700 1 -- 172.21.15.35:0/129615987 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f210800f9f0 con 0x7f21180ffd70 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.763+0000 7f210ffff700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f210409f640 0x7f21040a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.763+0000 7f210ffff700 1 -- 172.21.15.35:0/129615987 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(374..374 src has 1..374) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f21080ca0d0 con 0x7f21180ffd70 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.763+0000 7f2116d9d700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f210409f640 0x7f21040a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.764+0000 7f2116d9d700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f210409f640 0x7f21040a1af0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2100007be0 tx=0x7f21000073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.764+0000 7f212936bb80 1 Processor -- start 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.764+0000 7f212936bb80 1 -- start start 2023-03-17T11:37:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f212936bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52eafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f212936bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52e5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f212936bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f212936bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b51ec010 con 0x55c2b52eb4f0 2023-03-17T11:37:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f212936bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b523e950 con 0x55c2b52e5960 2023-03-17T11:37:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f212936bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b5237de0 con 0x55c2b52eabe0 2023-03-17T11:37:56.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56264/0 (socket says 172.21.15.35:56264) 2023-03-17T11:37:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 -- 172.21.15.35:0/3770989119 learned_addr learned my addr 172.21.15.35:0/3770989119 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 -- 172.21.15.35:0/3770989119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 msgr2=0x55c2b52eafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211759e700 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52eafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 -- 172.21.15.35:0/3770989119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 msgr2=0x55c2b52e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52e5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 -- 172.21.15.35:0/3770989119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2b50b95d0 con 0x55c2b52eb4f0 2023-03-17T11:37:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f211659c700 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52e5420 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f21080945c0 tx=0x7f21080974b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85731bc27a7ce227 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f210d7fa700 1 -- 172.21.15.35:0/3770989119 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210809fd40 con 0x55c2b52eb4f0 2023-03-17T11:37:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.765+0000 7f210d7fa700 1 -- 172.21.15.35:0/3770989119 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2108095ef0 con 0x55c2b52eb4f0 2023-03-17T11:37:58.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f210d7fa700 1 -- 172.21.15.35:0/3770989119 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108097240 con 0x55c2b52eb4f0 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 -- 172.21.15.35:0/3770989119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 msgr2=0x55c2b52e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52e5420 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f21080945c0 tx=0x7f21080974b0 comp rx=0 tx=0).stop 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 -- 172.21.15.35:0/3770989119 shutdown_connections 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52eafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 --2- 172.21.15.35:0/3770989119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52e5420 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 -- 172.21.15.35:0/3770989119 >> 172.21.15.35:0/3770989119 conn(0x55c2b51426b0 msgr2=0x55c2b52dfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 -- 172.21.15.35:0/3770989119 shutdown_connections 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.766+0000 7f212936bb80 1 -- 172.21.15.35:0/3770989119 wait complete. 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 -- start start 2023-03-17T11:37:59.751 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 Processor -- start 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52f1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52ee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b50bb8c0 con 0x55c2b52eb4f0 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b52ef650 con 0x55c2b52e5960 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b530c030 con 0x55c2b52eabe0 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f212936bb80 10 client.0 _ll_register_callbacks cb 0x55c2b50dd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f211759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f211759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56272/0 (socket says 172.21.15.35:56272) 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f211759e700 1 -- 172.21.15.35:0/4127205162 learned_addr learned my addr 172.21.15.35:0/4127205162 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f2116d9d700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f211659c700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52ee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.767+0000 7f211759e700 1 -- 172.21.15.35:0/4127205162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 msgr2=0x55c2b52ee7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:59.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f211759e700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52ee7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f211759e700 1 -- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 msgr2=0x55c2b52f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f211759e700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f211759e700 1 -- 172.21.15.35:0/4127205162 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211810eeb0 con 0x55c2b52eb4f0 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f211659c700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52ee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f211759e700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52eeee0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f2110007710 tx=0x7f21100077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94282df1634bcae server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f20fe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:37:59.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f20fe7fc700 1 -- 172.21.15.35:0/4127205162 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211000e040 con 0x55c2b52eb4f0 2023-03-17T11:38:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f20fe7fc700 1 -- 172.21.15.35:0/4127205162 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(374..374 src has 1..374) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f2110003c00 con 0x55c2b52eb4f0 2023-03-17T11:38:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2b51fa390 con 0x55c2b52eb4f0 2023-03-17T11:38:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f20fe7fc700 1 -- 172.21.15.35:0/4127205162 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2110003dc0 con 0x55c2b52eb4f0 2023-03-17T11:38:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 10 client.21177 fetch_fsmap learned FSMap version 108 2023-03-17T11:38:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55c2b5065d80 con 0x55c2b52eb4f0 2023-03-17T11:38:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f20fe7fc700 1 -- 172.21.15.35:0/4127205162 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c2b51fa390 con 0x55c2b52eb4f0 2023-03-17T11:38:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f20fe7fc700 1 -- 172.21.15.35:0/4127205162 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f211002b070 con 0x55c2b52eb4f0 2023-03-17T11:38:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 10 client.21177 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 10 client.21177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 20 client.21177 populate_metadata read hostname 'smithi035' 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b52f53b0 0x55c2b52f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 4 client.21177 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.768+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2b5206600 con 0x55c2b52f53b0 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.769+0000 7f2116d9d700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b52f53b0 0x55c2b52f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.769+0000 7f2116d9d700 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b52f53b0 0x55c2b52f77c0 crc :-1 s=READY pgs=717 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514066e5f146ca6d server_cookie=414d00c247a6c7a8 in_seq=0 out_seq=0 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.769+0000 7f20fe7fc700 10 client.21177 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f20fe7fc700 1 -- 172.21.15.35:0/4127205162 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c2b5206600 con 0x55c2b52f53b0 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f20fe7fc700 10 client.21177 handle_command_reply: tid=0 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 client.21177 shutdown 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 msgr2=0x55c2b52eeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52eeee0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f2110007710 tx=0x7f21100077f0 comp rx=0 tx=0).stop 2023-03-17T11:38:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 shutdown_connections 2023-03-17T11:38:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b52f53b0 0x55c2b52f77c0 crc :-1 s=READY pgs=717 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:03.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:53 smithi035 ceph-mon[92535]: pgmap v5337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:38:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b52eeee0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52e5960 0x55c2b52f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f20fe7fc700 0 client.21177 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 --2- 172.21.15.35:0/4127205162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52eabe0 0x55c2b52ee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 >> 172.21.15.35:0/4127205162 conn(0x55c2b51426b0 msgr2=0x55c2b52e4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 shutdown_connections 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 1 -- 172.21.15.35:0/4127205162 wait complete. 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.770+0000 7f212936bb80 20 client.21177 trim_cache size 0 max 16384 2023-03-17T11:38:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 Processor -- start 2023-03-17T11:38:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 -- start start 2023-03-17T11:38:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b52dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:06.970 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eabe0 0x55c2b52edf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b530b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b52e0e40 con 0x55c2b52eb4f0 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b52ef4c0 con 0x55c2b52eabe0 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f212936bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b52e03b0 con 0x55c2b52e5960 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b530b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211759e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b530b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56276/0 (socket says 172.21.15.35:56276) 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211759e700 1 -- 172.21.15.35:0/1855285163 learned_addr learned my addr 172.21.15.35:0/1855285163 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211659c700 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eabe0 0x55c2b52edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f2116d9d700 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b52dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211759e700 1 -- 172.21.15.35:0/1855285163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 msgr2=0x55c2b52dfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211759e700 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b52dfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.786+0000 7f211759e700 1 -- 172.21.15.35:0/1855285163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eabe0 msgr2=0x55c2b52edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f211759e700 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eabe0 0x55c2b52edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f211759e700 1 -- 172.21.15.35:0/1855285163 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2b51fe130 con 0x55c2b52eb4f0 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f211659c700 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eabe0 0x55c2b52edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f211759e700 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b530b7d0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f2110009670 tx=0x7f2110006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4e07b98684e714 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f210dffb700 1 -- 172.21.15.35:0/1855285163 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211000e070 con 0x55c2b52eb4f0 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f210dffb700 1 -- 172.21.15.35:0/1855285163 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f211001c850 con 0x55c2b52eb4f0 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.787+0000 7f210dffb700 1 -- 172.21.15.35:0/1855285163 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100053d0 con 0x55c2b52eb4f0 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 -- 172.21.15.35:0/1855285163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 msgr2=0x55c2b530b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b530b7d0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f2110009670 tx=0x7f2110006210 comp rx=0 tx=0).stop 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 -- 172.21.15.35:0/1855285163 shutdown_connections 2023-03-17T11:38:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eb4f0 0x55c2b530b7d0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b52dfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 --2- 172.21.15.35:0/1855285163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eabe0 0x55c2b52edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 -- 172.21.15.35:0/1855285163 >> 172.21.15.35:0/1855285163 conn(0x55c2b51426b0 msgr2=0x55c2b52fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 -- 172.21.15.35:0/1855285163 shutdown_connections 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 -- 172.21.15.35:0/1855285163 wait complete. 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 -- start start 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.788+0000 7f212936bb80 1 Processor -- start 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b5303200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 0x55c2b5303740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eb4f0 0x55c2b5393e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b5303ea0 con 0x55c2b52eabe0 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b53943b0 con 0x55c2b52eb4f0 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2b5394570 con 0x55c2b52e5960 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 10 client.0 _ll_register_callbacks cb 0x55c2b50dd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:38:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 0x55c2b5303740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 0x55c2b5303740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56282/0 (socket says 172.21.15.35:56282) 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 -- 172.21.15.35:0/1709883429 learned_addr learned my addr 172.21.15.35:0/1709883429 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 -- 172.21.15.35:0/1709883429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 msgr2=0x55c2b5303200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b5303200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 -- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eb4f0 msgr2=0x55c2b5393e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eb4f0 0x55c2b5393e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 -- 172.21.15.35:0/1709883429 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2b5065d80 con 0x55c2b52eabe0 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f211659c700 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 0x55c2b5303740 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f21080c7db0 tx=0x7f21080c7820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae5a570ea0e68bf server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f20fe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:38:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f20fe7fc700 1 -- 172.21.15.35:0/1709883429 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108097040 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f20fe7fc700 1 -- 172.21.15.35:0/1709883429 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(374..374 src has 1..374) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f21080971a0 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2b52b51e0 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f20fe7fc700 1 -- 172.21.15.35:0/1709883429 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2108097db0 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 10 client.21183 fetch_fsmap learned FSMap version 108 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.789+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55c2b508c1f0 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f20fe7fc700 1 -- 172.21.15.35:0/1709883429 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2108063030 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f20fe7fc700 1 -- 172.21.15.35:0/1709883429 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f21080c1bd0 con 0x55c2b52eabe0 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f212936bb80 10 client.21183 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f212936bb80 10 client.21183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f212936bb80 20 client.21183 populate_metadata read hostname 'smithi035' 2023-03-17T11:38:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f212936bb80 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b5331960 0x55c2b5333d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f212936bb80 4 client.21183 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c2b50bbf00 con 0x55c2b5331960 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.790+0000 7f2116d9d700 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b5331960 0x55c2b5333d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.791+0000 7f20fe7fc700 10 client.21183 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.791+0000 7f2116d9d700 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b5331960 0x55c2b5333d70 crc :-1 s=READY pgs=718 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f7ff9c597fbc7b server_cookie=543ccaf9f571f745 in_seq=0 out_seq=0 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f20fe7fc700 1 -- 172.21.15.35:0/1709883429 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c2b50bbf00 con 0x55c2b5331960 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f20fe7fc700 10 client.21183 handle_command_reply: tid=0 2023-03-17T11:38:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 client.21183 shutdown 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 msgr2=0x55c2b5303740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 0x55c2b5303740 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f21080c7db0 tx=0x7f21080c7820 comp rx=0 tx=0).stop 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 shutdown_connections 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c2b5331960 0x55c2b5333d70 crc :-1 s=READY pgs=718 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c2b52eb4f0 0x55c2b5393e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c2b52e5960 0x55c2b5303200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f20fe7fc700 0 client.21183 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 --2- 172.21.15.35:0/1709883429 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c2b52eabe0 0x55c2b5303740 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 >> 172.21.15.35:0/1709883429 conn(0x55c2b51426b0 msgr2=0x55c2b530b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 shutdown_connections 2023-03-17T11:38:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 1 -- 172.21.15.35:0/1709883429 wait complete. 2023-03-17T11:38:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.808+0000 7f212936bb80 20 client.21183 trim_cache size 0 max 16384 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f210409f640 msgr2=0x7f21040a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f210409f640 0x7f21040a1af0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2100007be0 tx=0x7f21000073d0 comp rx=0 tx=0).stop 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 msgr2=0x7f2118196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 0x7f2118196a70 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f210800d950 tx=0x7f210800dc60 comp rx=0 tx=0).stop 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 shutdown_connections 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f210409f640 0x7f21040a1af0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21181043c0 0x7f211819aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21180ff3d0 0x7f2118196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:14.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 --2- 172.21.15.35:0/129615987 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f21180ffd70 0x7f2118196a70 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 >> 172.21.15.35:0/129615987 conn(0x7f2118075f00 msgr2=0x7f2118102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 shutdown_connections 2023-03-17T11:38:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:14:13.809+0000 7f211d1de700 1 -- 172.21.15.35:0/129615987 wait complete. 2023-03-17T11:38:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 -- 172.21.15.35:0/838308025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 msgr2=0x7f560c10a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:14.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 --2- 172.21.15.35:0/838308025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c10a210 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f5600009990 tx=0x7f5600009ca0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 -- 172.21.15.35:0/838308025 shutdown_connections 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 --2- 172.21.15.35:0/838308025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f560c10a750 0x7f560c10cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 --2- 172.21.15.35:0/838308025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c101410 0x7f560c1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 --2- 172.21.15.35:0/838308025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c10a210 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 -- 172.21.15.35:0/838308025 >> 172.21.15.35:0/838308025 conn(0x7f560c076330 msgr2=0x7f560c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 -- 172.21.15.35:0/838308025 shutdown_connections 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 -- 172.21.15.35:0/838308025 wait complete. 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 Processor -- start 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.029+0000 7f5612728700 1 -- start start 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5612728700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f560c101410 0x7f560c196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5612728700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.424 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5612728700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c10a750 0x7f560c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5612728700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c19b1f0 con 0x7f560c101d20 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5612728700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c19b360 con 0x7f560c101410 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5612728700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c19b520 con 0x7f560c10a750 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56338/0 (socket says 172.21.15.35:56338) 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 -- 172.21.15.35:0/2197694273 learned_addr learned my addr 172.21.15.35:0/2197694273 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f5610cc5700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c10a750 0x7f560c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560bfff700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f560c101410 0x7f560c196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 -- 172.21.15.35:0/2197694273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c10a750 msgr2=0x7f560c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c10a750 0x7f560c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 -- 172.21.15.35:0/2197694273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f560c101410 msgr2=0x7f560c196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f560c101410 0x7f560c196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 -- 172.21.15.35:0/2197694273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000095f0 con 0x7f560c101d20 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f560b7fe700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c196750 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f5600005740 tx=0x7f5600005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.030+0000 7f56097fa700 1 -- 172.21.15.35:0/2197694273 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560001d070 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.031+0000 7f56097fa700 1 -- 172.21.15.35:0/2197694273 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5600022470 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.031+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c110100 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.031+0000 7f56097fa700 1 -- 172.21.15.35:0/2197694273 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600017650 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.031+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c10ff70 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.033+0000 7f56097fa700 1 -- 172.21.15.35:0/2197694273 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f560000fb00 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.033+0000 7f56097fa700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f55f409f6c0 0x7f55f40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.033+0000 7f56097fa700 1 -- 172.21.15.35:0/2197694273 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(376..376 src has 1..376) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f56000cbb30 con 0x7f560c101d20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.033+0000 7f560bfff700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f55f409f6c0 0x7f55f40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.034+0000 7f560bfff700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f55f409f6c0 0x7f55f40a1b70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f55fc005950 tx=0x7f55fc00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.034+0000 7f561e8b5b80 1 Processor -- start 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.034+0000 7f561e8b5b80 1 -- start start 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625385be010 con 0x5625386bba20 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562538610950 con 0x5625386bc330 2023-03-17T11:38:15.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562538609de0 con 0x5625386c0170 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56344/0 (socket says 172.21.15.35:56344) 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 -- 172.21.15.35:0/396787274 learned_addr learned my addr 172.21.15.35:0/396787274 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560b7fe700 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f5610cc5700 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 -- 172.21.15.35:0/396787274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 msgr2=0x5625386c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:15.427 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 -- 172.21.15.35:0/396787274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 msgr2=0x5625386bfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386bfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 -- 172.21.15.35:0/396787274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56253848b5d0 con 0x5625386bba20 2023-03-17T11:38:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f560bfff700 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386bbdf0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f55fc010fa0 tx=0x7f55fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0837a11ad9d0ab server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.035+0000 7f55f27fc700 1 -- 172.21.15.35:0/396787274 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc011db0 con 0x5625386bba20 2023-03-17T11:38:15.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f55f27fc700 1 -- 172.21.15.35:0/396787274 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55fc015070 con 0x5625386bba20 2023-03-17T11:38:15.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:55 smithi035 ceph-mon[92535]: pgmap v5338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:38:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f55f27fc700 1 -- 172.21.15.35:0/396787274 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc01c5b0 con 0x5625386bba20 2023-03-17T11:38:15.982 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 -- 172.21.15.35:0/396787274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 msgr2=0x5625386bbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386bbdf0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f55fc010fa0 tx=0x7f55fc013000 comp rx=0 tx=0).stop 2023-03-17T11:38:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 -- 172.21.15.35:0/396787274 shutdown_connections 2023-03-17T11:38:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386bbdf0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/396787274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 -- 172.21.15.35:0/396787274 >> 172.21.15.35:0/396787274 conn(0x5625385146b0 msgr2=0x5625386b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 -- 172.21.15.35:0/396787274 shutdown_connections 2023-03-17T11:38:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.036+0000 7f561e8b5b80 1 -- 172.21.15.35:0/396787274 wait complete. 2023-03-17T11:38:18.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 -- start start 2023-03-17T11:38:19.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 Processor -- start 2023-03-17T11:38:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bba20 0x5625386c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56253848d8c0 con 0x5625386bc330 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386c59c0 con 0x5625386bba20 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386d13e0 con 0x5625386c0170 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f561e8b5b80 10 client.0 _ll_register_callbacks cb 0x5625384af230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56352/0 (socket says 172.21.15.35:56352) 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f560b7fe700 1 -- 172.21.15.35:0/2701649554 learned_addr learned my addr 172.21.15.35:0/2701649554 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f560bfff700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bba20 0x5625386c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.037+0000 7f5610cc5700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f560b7fe700 1 -- 172.21.15.35:0/2701649554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 msgr2=0x5625386c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f560b7fe700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f560b7fe700 1 -- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bba20 msgr2=0x5625386c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f560b7fe700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bba20 0x5625386c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f560b7fe700 1 -- 172.21.15.35:0/2701649554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc010c50 con 0x5625386bc330 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f560b7fe700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c4bb0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f5600095b40 tx=0x7f5600005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcc723e6f8fb5e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f55eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:38:21.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f55eb7fe700 1 -- 172.21.15.35:0/2701649554 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000b0070 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f55eb7fe700 1 -- 172.21.15.35:0/2701649554 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(376..376 src has 1..376) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f5600099640 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625385cc390 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f55eb7fe700 1 -- 172.21.15.35:0/2701649554 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56000a17a0 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f561e8b5b80 10 client.21195 fetch_fsmap learned FSMap version 108 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x562538437d80 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.038+0000 7f55eb7fe700 1 -- 172.21.15.35:0/2701649554 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56000b5080 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f55eb7fe700 1 -- 172.21.15.35:0/2701649554 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5600098b30 con 0x5625386bc330 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f561e8b5b80 10 client.21195 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f561e8b5b80 10 client.21195 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:38:22.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f561e8b5b80 20 client.21195 populate_metadata read hostname 'smithi035' 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625386d5140 0x5625386d7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f561e8b5b80 4 client.21195 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625385d8600 con 0x5625386d5140 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f560bfff700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625386d5140 0x5625386d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f55eb7fe700 10 client.21195 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.039+0000 7f560bfff700 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625386d5140 0x5625386d7550 crc :-1 s=READY pgs=719 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe1bdfafb7b2d91 server_cookie=59b3d88175c83c8b in_seq=0 out_seq=0 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f55eb7fe700 1 -- 172.21.15.35:0/2701649554 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5625385d8600 con 0x5625386d5140 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f55eb7fe700 10 client.21195 handle_command_reply: tid=0 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 client.21195 shutdown 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 msgr2=0x5625386c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c4bb0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f5600095b40 tx=0x7f5600005c00 comp rx=0 tx=0).stop 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 shutdown_connections 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5625386d5140 0x5625386d7550 crc :-1 s=READY pgs=719 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:22.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f55eb7fe700 0 client.21195 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:22.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bba20 0x5625386c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/2701649554 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c4bb0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 >> 172.21.15.35:0/2701649554 conn(0x5625385146b0 msgr2=0x5625386b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 shutdown_connections 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.040+0000 7f561e8b5b80 1 -- 172.21.15.35:0/2701649554 wait complete. 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.041+0000 7f561e8b5b80 20 client.21195 trim_cache size 0 max 16384 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 Processor -- start 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 -- start start 2023-03-17T11:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386b2460 con 0x5625386bba20 2023-03-17T11:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386b2030 con 0x5625386bc330 2023-03-17T11:38:24.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386c5b00 con 0x5625386c0170 2023-03-17T11:38:24.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:24.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56358/0 (socket says 172.21.15.35:56358) 2023-03-17T11:38:24.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 -- 172.21.15.35:0/947946224 learned_addr learned my addr 172.21.15.35:0/947946224 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:24.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560b7fe700 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 -- 172.21.15.35:0/947946224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 msgr2=0x5625386c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 -- 172.21.15.35:0/947946224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 msgr2=0x5625386cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560bfff700 1 -- 172.21.15.35:0/947946224 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625385d0130 con 0x5625386bba20 2023-03-17T11:38:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.056+0000 7f560b7fe700 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:38:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f560bfff700 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386b1ac0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f55fc010fa0 tx=0x7f55fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66253d52152660b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f55f2ffd700 1 -- 172.21.15.35:0/947946224 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc02b070 con 0x5625386bba20 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f55f2ffd700 1 -- 172.21.15.35:0/947946224 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55fc015040 con 0x5625386bba20 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f55f2ffd700 1 -- 172.21.15.35:0/947946224 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc032de0 con 0x5625386bba20 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 -- 172.21.15.35:0/947946224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 msgr2=0x5625386b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386b1ac0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f55fc010fa0 tx=0x7f55fc016000 comp rx=0 tx=0).stop 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 -- 172.21.15.35:0/947946224 shutdown_connections 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386c0170 0x5625386c1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bba20 0x5625386b1ac0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/947946224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386bc330 0x5625386cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 -- 172.21.15.35:0/947946224 >> 172.21.15.35:0/947946224 conn(0x5625385146b0 msgr2=0x5625386be2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 -- 172.21.15.35:0/947946224 shutdown_connections 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.057+0000 7f561e8b5b80 1 -- 172.21.15.35:0/947946224 wait complete. 2023-03-17T11:38:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 -- start start 2023-03-17T11:38:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 Processor -- start 2023-03-17T11:38:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386bba20 0x5625386cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386c0170 0x5625386c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386c8ea0 con 0x5625386bc330 2023-03-17T11:38:26.181 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386c9010 con 0x5625386c0170 2023-03-17T11:38:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625386c91d0 con 0x5625386bba20 2023-03-17T11:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f561e8b5b80 10 client.0 _ll_register_callbacks cb 0x5625384af230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:38:28.648 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.058+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56366/0 (socket says 172.21.15.35:56366) 2023-03-17T11:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 -- 172.21.15.35:0/924729289 learned_addr learned my addr 172.21.15.35:0/924729289 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560bfff700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386bba20 0x5625386cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f5610cc5700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386c0170 0x5625386c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:28.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 -- 172.21.15.35:0/924729289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386bba20 msgr2=0x5625386cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386bba20 0x5625386cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 -- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386c0170 msgr2=0x5625386c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386c0170 0x5625386c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 -- 172.21.15.35:0/924729289 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56253848b5d0 con 0x5625386bc330 2023-03-17T11:38:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f560b7fe700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c8420 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f56000c9890 tx=0x7f56000c9340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af79ce180db1aff server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f55eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:38:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f55eb7fe700 1 -- 172.21.15.35:0/924729289 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000b0070 con 0x5625386bc330 2023-03-17T11:38:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625386871e0 con 0x5625386bc330 2023-03-17T11:38:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f55eb7fe700 1 -- 172.21.15.35:0/924729289 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(376..376 src has 1..376) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f5600099640 con 0x5625386bc330 2023-03-17T11:38:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f55eb7fe700 1 -- 172.21.15.35:0/924729289 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5600099180 con 0x5625386bc330 2023-03-17T11:38:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f561e8b5b80 10 client.21201 fetch_fsmap learned FSMap version 108 2023-03-17T11:38:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.059+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x56253845e1f0 con 0x5625386bc330 2023-03-17T11:38:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f55eb7fe700 1 -- 172.21.15.35:0/924729289 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5625386871e0 con 0x5625386bc330 2023-03-17T11:38:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f55eb7fe700 1 -- 172.21.15.35:0/924729289 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f56000b1bc0 con 0x5625386bc330 2023-03-17T11:38:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f561e8b5b80 10 client.21201 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:38:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f561e8b5b80 10 client.21201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:38:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f561e8b5b80 20 client.21201 populate_metadata read hostname 'smithi035' 2023-03-17T11:38:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562538729e70 0x56253872c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f561e8b5b80 4 client.21201 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:38:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56253848df00 con 0x562538729e70 2023-03-17T11:38:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f560bfff700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562538729e70 0x56253872c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f55eb7fe700 10 client.21201 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.060+0000 7f560bfff700 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562538729e70 0x56253872c250 crc :-1 s=READY pgs=720 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87aa7cbff520a634 server_cookie=f8b2fc147abf2caa in_seq=0 out_seq=0 2023-03-17T11:38:31.388 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.077+0000 7f55eb7fe700 1 -- 172.21.15.35:0/924729289 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56253848df00 con 0x562538729e70 2023-03-17T11:38:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.077+0000 7f55eb7fe700 10 client.21201 handle_command_reply: tid=0 2023-03-17T11:38:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.077+0000 7f561e8b5b80 1 client.21201 shutdown 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 msgr2=0x5625386c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c8420 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f56000c9890 tx=0x7f56000c9340 comp rx=0 tx=0).stop 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 shutdown_connections 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562538729e70 0x56253872c250 crc :-1 s=READY pgs=720 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625386c0170 0x5625386c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f55eb7fe700 0 client.21201 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5625386bba20 0x5625386cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 --2- 172.21.15.35:0/924729289 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5625386bc330 0x5625386c8420 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 >> 172.21.15.35:0/924729289 conn(0x5625385146b0 msgr2=0x5625386c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 shutdown_connections 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 1 -- 172.21.15.35:0/924729289 wait complete. 2023-03-17T11:38:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f561e8b5b80 20 client.21201 trim_cache size 0 max 16384 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f55f409f6c0 msgr2=0x7f55f40a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f5612728700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f55f409f6c0 0x7f55f40a1b70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f55fc005950 tx=0x7f55fc00b410 comp rx=0 tx=0).stop 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 msgr2=0x7f560c196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.078+0000 7f5612728700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c196750 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f5600005740 tx=0x7f5600005770 comp rx=0 tx=0).stop 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 shutdown_connections 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f55f409f6c0 0x7f55f40a1b70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c10a750 0x7f560c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f560c101410 0x7f560c196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 --2- 172.21.15.35:0/2197694273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f560c101d20 0x7f560c196750 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 >> 172.21.15.35:0/2197694273 conn(0x7f560c076330 msgr2=0x7f560c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 shutdown_connections 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:12.079+0000 7f5612728700 1 -- 172.21.15.35:0/2197694273 wait complete. 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 -- 172.21.15.35:0/2782586642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ffcf0 msgr2=0x7ff9d0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/2782586642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ffcf0 0x7ff9d0103cb0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00099c0 tx=0x7ff9c0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 -- 172.21.15.35:0/2782586642 shutdown_connections 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/2782586642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d0104390 0x7ff9d010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/2782586642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d00ff350 0x7ff9d00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/2782586642 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ffcf0 0x7ff9d0103cb0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:33.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 -- 172.21.15.35:0/2782586642 >> 172.21.15.35:0/2782586642 conn(0x7ff9d0076330 msgr2=0x7ff9d0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:34.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 -- 172.21.15.35:0/2782586642 shutdown_connections 2023-03-17T11:38:34.894 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:57 smithi035 ceph-mon[92535]: pgmap v5339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:38:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.202+0000 7ff9d60b1700 1 -- 172.21.15.35:0/2782586642 wait complete. 2023-03-17T11:38:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 Processor -- start 2023-03-17T11:38:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 -- start start 2023-03-17T11:38:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 0x7ff9d0197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d00ffcf0 0x7ff9d0197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d0104390 0x7ff9d01a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0197f50 con 0x7ff9d00ff350 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01a26c0 con 0x7ff9d00ffcf0 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9d60b1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01a2830 con 0x7ff9d0104390 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.203+0000 7ff9cf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 0x7ff9d0197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 0x7ff9d0197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56378/0 (socket says 172.21.15.35:56378) 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1878550670 learned_addr learned my addr 172.21.15.35:0/1878550670 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d00ffcf0 0x7ff9d0197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cffff700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d0104390 0x7ff9d01a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1878550670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d0104390 msgr2=0x7ff9d01a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d0104390 0x7ff9d01a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1878550670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d00ffcf0 msgr2=0x7ff9d0197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d00ffcf0 0x7ff9d0197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 -- 172.21.15.35:0/1878550670 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00095f0 con 0x7ff9d00ff350 2023-03-17T11:38:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 0x7ff9d0197100 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400e9a0 tx=0x7ff9c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9ccff9700 1 -- 172.21.15.35:0/1878550670 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4009790 con 0x7ff9d00ff350 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d010efc0 con 0x7ff9d00ff350 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9ccff9700 1 -- 172.21.15.35:0/1878550670 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9c4010430 con 0x7ff9d00ff350 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9ccff9700 1 -- 172.21.15.35:0/1878550670 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400cea0 con 0x7ff9d00ff350 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.204+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d010ee30 con 0x7ff9d00ff350 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.207+0000 7ff9ccff9700 1 -- 172.21.15.35:0/1878550670 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff9c40105a0 con 0x7ff9d00ff350 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.207+0000 7ff9ccff9700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9b809f640 0x7ff9b80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.208+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9b809f640 0x7ff9b80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.208+0000 7ff9ccff9700 1 -- 172.21.15.35:0/1878550670 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9c4014070 con 0x7ff9d00ff350 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.208+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9b809f640 0x7ff9b80a1af0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000c00 tx=0x7ff9c000b540 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.208+0000 7ff9e223eb80 1 Processor -- start 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 -- start start 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4759be0 0x558fb4759fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4754420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 0x558fb4754d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb465b010 con 0x558fb4754960 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb46ad950 con 0x558fb4759be0 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb46a6de0 con 0x558fb475a4f0 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 0x558fb4754d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 0x558fb4754d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56390/0 (socket says 172.21.15.35:56390) 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 -- 172.21.15.35:0/1045296898 learned_addr learned my addr 172.21.15.35:0/1045296898 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4754420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4759be0 0x558fb4759fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 -- 172.21.15.35:0/1045296898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 msgr2=0x558fb4754420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4754420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 -- 172.21.15.35:0/1045296898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4759be0 msgr2=0x558fb4759fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4759be0 0x558fb4759fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 -- 172.21.15.35:0/1045296898 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fb45285d0 con 0x558fb4754960 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4759be0 0x558fb4759fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:38:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.209+0000 7ff9cffff700 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 0x558fb4754d90 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8003fa0 tx=0x7ff9c8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a621759326885 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9b5ffb700 1 -- 172.21.15.35:0/1045296898 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8019070 con 0x558fb4754960 2023-03-17T11:38:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9b5ffb700 1 -- 172.21.15.35:0/1045296898 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9c800f040 con 0x558fb4754960 2023-03-17T11:38:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9b5ffb700 1 -- 172.21.15.35:0/1045296898 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8007a50 con 0x558fb4754960 2023-03-17T11:38:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1045296898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 msgr2=0x558fb4754d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 0x558fb4754d90 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8003fa0 tx=0x7ff9c8009ba0 comp rx=0 tx=0).stop 2023-03-17T11:38:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1045296898 shutdown_connections 2023-03-17T11:38:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4754960 0x558fb4754d90 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4759be0 0x558fb4759fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1045296898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4754420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1045296898 >> 172.21.15.35:0/1045296898 conn(0x558fb45b16b0 msgr2=0x558fb474ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1045296898 shutdown_connections 2023-03-17T11:38:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.210+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1045296898 wait complete. 2023-03-17T11:38:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 -- start start 2023-03-17T11:38:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 Processor -- start 2023-03-17T11:38:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb4754960 0x558fb4760460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb475d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb475a4f0 0x558fb475dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb452a8c0 con 0x558fb4759be0 2023-03-17T11:38:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb475e490 con 0x558fb475a4f0 2023-03-17T11:38:43.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb476a030 con 0x558fb4754960 2023-03-17T11:38:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.211+0000 7ff9e223eb80 10 client.0 _ll_register_callbacks cb 0x558fb454c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:38:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb475d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb475d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56394/0 (socket says 172.21.15.35:56394) 2023-03-17T11:38:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 -- 172.21.15.35:0/1341602126 learned_addr learned my addr 172.21.15.35:0/1341602126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb4754960 0x558fb4760460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:44.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9cffff700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb475a4f0 0x558fb475dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 -- 172.21.15.35:0/1341602126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb4754960 msgr2=0x558fb4760460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb4754960 0x558fb4760460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 -- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb475a4f0 msgr2=0x558fb475dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb475a4f0 0x558fb475dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 -- 172.21.15.35:0/1341602126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c8003bd0 con 0x558fb4759be0 2023-03-17T11:38:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb4754960 0x558fb4760460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:38:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb475d6e0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7ff9d01000c0 tx=0x7ff9c0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15fe226b673c559 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:38:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9aeffd700 1 -- 172.21.15.35:0/1341602126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0029050 con 0x558fb4759be0 2023-03-17T11:38:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9aeffd700 1 -- 172.21.15.35:0/1341602126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9c0003e20 con 0x558fb4759be0 2023-03-17T11:38:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fb4669390 con 0x558fb4759be0 2023-03-17T11:38:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9aeffd700 1 -- 172.21.15.35:0/1341602126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9c000f660 con 0x558fb4759be0 2023-03-17T11:38:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9e223eb80 10 client.21213 fetch_fsmap learned FSMap version 108 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.212+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x558fb44d4d80 con 0x558fb4759be0 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9aeffd700 1 -- 172.21.15.35:0/1341602126 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558fb4669390 con 0x558fb4759be0 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9aeffd700 1 -- 172.21.15.35:0/1341602126 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff9c00226d0 con 0x558fb4759be0 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9e223eb80 10 client.21213 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9e223eb80 10 client.21213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9e223eb80 20 client.21213 populate_metadata read hostname 'smithi035' 2023-03-17T11:38:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb476e0d0 0x558fb47704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:49.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9e223eb80 4 client.21213 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fb4675600 con 0x558fb476e0d0 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.213+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb476e0d0 0x558fb47704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb476e0d0 0x558fb47704e0 crc :-1 s=READY pgs=721 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233c4b2f09e77007 server_cookie=c39a46d2fcd9cb1f in_seq=0 out_seq=0 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9aeffd700 10 client.21213 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9aeffd700 1 -- 172.21.15.35:0/1341602126 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x558fb4675600 con 0x558fb476e0d0 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9aeffd700 10 client.21213 handle_command_reply: tid=0 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 client.21213 shutdown 2023-03-17T11:38:49.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 msgr2=0x558fb475d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb475d6e0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7ff9d01000c0 tx=0x7ff9c0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:38:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 shutdown_connections 2023-03-17T11:38:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb476e0d0 0x558fb47704e0 crc :-1 s=READY pgs=721 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb475a4f0 0x558fb475dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb4754960 0x558fb4760460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9aeffd700 0 client.21213 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:38:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/1341602126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb475d6e0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.214+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 >> 172.21.15.35:0/1341602126 conn(0x558fb45b16b0 msgr2=0x558fb474ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.215+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 shutdown_connections 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.215+0000 7ff9e223eb80 1 -- 172.21.15.35:0/1341602126 wait complete. 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.215+0000 7ff9e223eb80 20 client.21213 trim_cache size 0 max 16384 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.229+0000 7ff9e223eb80 1 Processor -- start 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.229+0000 7ff9e223eb80 1 -- start start 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb474eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4764f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4758f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb474f000 con 0x558fb4759be0 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb474b5c0 con 0x558fb4754960 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb4760c00 con 0x558fb475a4f0 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4764f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4764f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56402/0 (socket says 172.21.15.35:56402) 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 -- 172.21.15.35:0/349096923 learned_addr learned my addr 172.21.15.35:0/349096923 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:38:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9cffff700 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4758f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb474eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:38:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 -- 172.21.15.35:0/349096923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 msgr2=0x558fb4758f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4758f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 -- 172.21.15.35:0/349096923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 msgr2=0x558fb474eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:38:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb474eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 -- 172.21.15.35:0/349096923 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fb466d130 con 0x558fb4759be0 2023-03-17T11:38:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9cffff700 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4758f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:38:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4764f70 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0022b30 tx=0x7ff9c000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd57ff8d436cea7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:38:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9b67fc700 1 -- 172.21.15.35:0/349096923 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0029040 con 0x558fb4759be0 2023-03-17T11:38:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9b67fc700 1 -- 172.21.15.35:0/349096923 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff9c002a040 con 0x558fb4759be0 2023-03-17T11:38:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.230+0000 7ff9b67fc700 1 -- 172.21.15.35:0/349096923 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000f820 con 0x558fb4759be0 2023-03-17T11:38:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 -- 172.21.15.35:0/349096923 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 msgr2=0x558fb4764f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:38:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4764f70 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0022b30 tx=0x7ff9c000b8a0 comp rx=0 tx=0).stop 2023-03-17T11:38:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 -- 172.21.15.35:0/349096923 shutdown_connections 2023-03-17T11:38:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4758f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb474eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/349096923 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4764f70 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:38:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 -- 172.21.15.35:0/349096923 >> 172.21.15.35:0/349096923 conn(0x558fb45b16b0 msgr2=0x558fb4758800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:38:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 -- 172.21.15.35:0/349096923 shutdown_connections 2023-03-17T11:38:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 -- 172.21.15.35:0/349096923 wait complete. 2023-03-17T11:38:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.231+0000 7ff9e223eb80 1 -- start start 2023-03-17T11:38:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 Processor -- start 2023-03-17T11:38:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb47556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4755be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4756120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:38:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb4756830 con 0x558fb4759be0 2023-03-17T11:38:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb47569a0 con 0x558fb4754960 2023-03-17T11:39:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fb4756b60 con 0x558fb475a4f0 2023-03-17T11:39:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9e223eb80 10 client.0 _ll_register_callbacks cb 0x558fb454c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:39:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4755be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4755be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56408/0 (socket says 172.21.15.35:56408) 2023-03-17T11:39:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 -- 172.21.15.35:0/960092219 learned_addr learned my addr 172.21.15.35:0/960092219 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:00.201 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:27:59 smithi035 ceph-mon[92535]: pgmap v5340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:39:00.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:01 smithi035 ceph-mon[92535]: pgmap v5341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:02.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:03 smithi035 ceph-mon[92535]: pgmap v5342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:05 smithi035 ceph-mon[92535]: pgmap v5343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:07 smithi035 ceph-mon[92535]: pgmap v5344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:09 smithi035 ceph-mon[92535]: pgmap v5345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:09 smithi035 ceph-mon[92535]: osdmap e403: 12 total, 12 up, 12 in 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:11 smithi035 ceph-mon[92535]: pgmap v5347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:13 smithi035 ceph-mon[92535]: pgmap v5348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:15 smithi035 ceph-mon[92535]: pgmap v5349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:03.539 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:17 smithi035 ceph-mon[92535]: pgmap v5350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:04.362 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:17 smithi035 ceph-mon[92535]: osdmap e404: 12 total, 12 up, 12 in 2023-03-17T11:39:04.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:19 smithi035 ceph-mon[92535]: pgmap v5352: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T11:39:06.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:21 smithi035 ceph-mon[92535]: pgmap v5353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:39:06.360 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:23 smithi035 ceph-mon[92535]: pgmap v5354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:39:06.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:25 smithi035 ceph-mon[92535]: pgmap v5355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:39:06.363 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:27 smithi035 ceph-mon[92535]: pgmap v5356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:29 smithi035 ceph-mon[92535]: pgmap v5357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:31 smithi035 ceph-mon[92535]: pgmap v5358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:33 smithi035 ceph-mon[92535]: pgmap v5359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:34 smithi035 ceph-mon[92535]: pgmap v5360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 285 B/s wr, 9 op/s 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:34 smithi035 ceph-mon[92535]: pgmap v5361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T11:39:07.918 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:36 smithi035 ceph-mon[92535]: pgmap v5362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T11:39:08.793 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:38 smithi035 ceph-mon[92535]: pgmap v5363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T11:39:08.793 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:40 smithi035 ceph-mon[92535]: pgmap v5364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T11:39:08.794 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:42 smithi035 ceph-mon[92535]: pgmap v5365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T11:39:08.794 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:44 smithi035 ceph-mon[92535]: pgmap v5366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:39:08.794 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:46 smithi035 ceph-mon[92535]: pgmap v5367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:39:08.794 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:48 smithi035 ceph-mon[92535]: pgmap v5368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:39:11.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:50 smithi035 ceph-mon[92535]: pgmap v5369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:39:11.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:52 smithi035 ceph-mon[92535]: pgmap v5370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:39:11.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:54 smithi035 ceph-mon[92535]: pgmap v5371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:39:11.889 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:56 smithi035 ceph-mon[92535]: pgmap v5372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:28:58 smithi035 ceph-mon[92535]: pgmap v5373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:00 smithi035 ceph-mon[92535]: pgmap v5374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:02 smithi035 ceph-mon[92535]: pgmap v5375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:04 smithi035 ceph-mon[92535]: pgmap v5376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:06 smithi035 ceph-mon[92535]: pgmap v5377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:08 smithi035 ceph-mon[92535]: pgmap v5378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:09 smithi035 ceph-mon[92535]: osdmap e405: 12 total, 12 up, 12 in 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:10 smithi035 ceph-mon[92535]: pgmap v5380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:12 smithi035 ceph-mon[92535]: pgmap v5381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:14 smithi035 ceph-mon[92535]: pgmap v5382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:16 smithi035 ceph-mon[92535]: pgmap v5383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:18 smithi035 ceph-mon[92535]: pgmap v5384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:18 smithi035 ceph-mon[92535]: osdmap e406: 12 total, 12 up, 12 in 2023-03-17T11:39:13.323 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:20 smithi035 ceph-mon[92535]: pgmap v5386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:22 smithi035 ceph-mon[92535]: pgmap v5387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:24 smithi035 ceph-mon[92535]: pgmap v5388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:26 smithi035 ceph-mon[92535]: pgmap v5389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:28 smithi035 ceph-mon[92535]: pgmap v5390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:30 smithi035 ceph-mon[92535]: pgmap v5391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:32 smithi035 ceph-mon[92535]: pgmap v5392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:34 smithi035 ceph-mon[92535]: pgmap v5393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:35 smithi035 ceph-mon[92535]: pgmap v5394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:35 smithi035 ceph-mon[92535]: pgmap v5395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:37 smithi035 ceph-mon[92535]: pgmap v5396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T11:39:13.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:38 smithi035 ceph-mon[92535]: pgmap v5397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:41 smithi035 ceph-mon[92535]: pgmap v5398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:43 smithi035 ceph-mon[92535]: pgmap v5399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:45 smithi035 ceph-mon[92535]: pgmap v5400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:47 smithi035 ceph-mon[92535]: pgmap v5401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:49 smithi035 ceph-mon[92535]: pgmap v5402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:51 smithi035 ceph-mon[92535]: pgmap v5403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:53 smithi035 ceph-mon[92535]: pgmap v5404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:55 smithi035 ceph-mon[92535]: pgmap v5405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:57 smithi035 ceph-mon[92535]: pgmap v5406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:29:59 smithi035 ceph-mon[92535]: pgmap v5407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:39:13.325 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:01 smithi035 ceph-mon[92535]: pgmap v5408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:39:15.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:03 smithi035 ceph-mon[92535]: pgmap v5409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:39:15.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:05 smithi035 ceph-mon[92535]: pgmap v5410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:39:15.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:07 smithi035 ceph-mon[92535]: pgmap v5411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:39:15.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:09 smithi035 ceph-mon[92535]: pgmap v5412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:39:16.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:09 smithi035 ceph-mon[92535]: osdmap e407: 12 total, 12 up, 12 in 2023-03-17T11:39:16.058 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:11 smithi035 ceph-mon[92535]: pgmap v5414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:39:16.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:39:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:39:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:39:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:39:16.060 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:39:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:39:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:39:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:39:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:39:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9cffff700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4756120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb47556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 -- 172.21.15.35:0/960092219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 msgr2=0x558fb4756120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4756120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 -- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 msgr2=0x558fb47556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb47556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 -- 172.21.15.35:0/960092219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fb44d4d80 con 0x558fb4759be0 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9ceffd700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4755be0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0022b80 tx=0x7ff9c0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63401fab00bf567b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.232+0000 7ff9aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:39:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9aeffd700 1 -- 172.21.15.35:0/960092219 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000f460 con 0x558fb4759be0 2023-03-17T11:39:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9aeffd700 1 -- 172.21.15.35:0/960092219 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff9c000f5c0 con 0x558fb4759be0 2023-03-17T11:39:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fb47241e0 con 0x558fb4759be0 2023-03-17T11:39:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9aeffd700 1 -- 172.21.15.35:0/960092219 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9c000f780 con 0x558fb4759be0 2023-03-17T11:39:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 10 client.21219 fetch_fsmap learned FSMap version 108 2023-03-17T11:39:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x558fb44fb1f0 con 0x558fb4759be0 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9aeffd700 1 -- 172.21.15.35:0/960092219 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558fb47241e0 con 0x558fb4759be0 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9aeffd700 1 -- 172.21.15.35:0/960092219 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff9c004d900 con 0x558fb4759be0 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 10 client.21219 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 10 client.21219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 20 client.21219 populate_metadata read hostname 'smithi035' 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb47c26f0 0x558fb47c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 4 client.21219 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558fb452af00 con 0x558fb47c26f0 2023-03-17T11:39:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.233+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb47c26f0 0x558fb47c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.234+0000 7ff9aeffd700 10 client.21219 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.234+0000 7ff9cf7fe700 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb47c26f0 0x558fb47c4b00 crc :-1 s=READY pgs=722 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c62c6bad03f402c6 server_cookie=ed9390e82fd260e4 in_seq=0 out_seq=0 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9aeffd700 1 -- 172.21.15.35:0/960092219 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558fb452af00 con 0x558fb47c26f0 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9aeffd700 10 client.21219 handle_command_reply: tid=0 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 client.21219 shutdown 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 msgr2=0x558fb4755be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4755be0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0022b80 tx=0x7ff9c0021000 comp rx=0 tx=0).stop 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 shutdown_connections 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x558fb47c26f0 0x558fb47c4b00 crc :-1 s=READY pgs=722 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558fb475a4f0 0x558fb4756120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:21.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9aeffd700 0 client.21219 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558fb4754960 0x558fb47556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 --2- 172.21.15.35:0/960092219 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x558fb4759be0 0x558fb4755be0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 >> 172.21.15.35:0/960092219 conn(0x558fb45b16b0 msgr2=0x558fb4759090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 shutdown_connections 2023-03-17T11:39:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 1 -- 172.21.15.35:0/960092219 wait complete. 2023-03-17T11:39:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.243+0000 7ff9e223eb80 20 client.21219 trim_cache size 0 max 16384 2023-03-17T11:39:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9b809f640 msgr2=0x7ff9b80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9b809f640 0x7ff9b80a1af0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000c00 tx=0x7ff9c000b540 comp rx=0 tx=0).stop 2023-03-17T11:39:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 msgr2=0x7ff9d0197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 0x7ff9d0197100 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400e9a0 tx=0x7ff9c400ecb0 comp rx=0 tx=0).stop 2023-03-17T11:39:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 shutdown_connections 2023-03-17T11:39:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff9b809f640 0x7ff9b80a1af0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9d0104390 0x7ff9d01a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff9d00ff350 0x7ff9d0197100 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 --2- 172.21.15.35:0/1878550670 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9d00ffcf0 0x7ff9d0197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 >> 172.21.15.35:0/1878550670 conn(0x7ff9d0076330 msgr2=0x7ff9d00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 shutdown_connections 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:25.244+0000 7ff9d60b1700 1 -- 172.21.15.35:0/1878550670 wait complete. 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 -- 172.21.15.35:0/130644077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4740ff350 msgr2=0x7ff4740ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/130644077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4740ff350 0x7ff4740ff720 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7ff4640099c0 tx=0x7ff464009cd0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 -- 172.21.15.35:0/130644077 shutdown_connections 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/130644077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff474104390 0x7ff47410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/130644077 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff4740ff350 0x7ff4740ff720 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/130644077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 0x7ff474103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 -- 172.21.15.35:0/130644077 >> 172.21.15.35:0/130644077 conn(0x7ff474076330 msgr2=0x7ff474076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 -- 172.21.15.35:0/130644077 shutdown_connections 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 -- 172.21.15.35:0/130644077 wait complete. 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.366+0000 7ff47aa4c700 1 Processor -- start 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 -- start start 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4740ff350 0x7ff474196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 0x7ff474196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff474104390 0x7ff47419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47419b220 con 0x7ff474104390 2023-03-17T11:39:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47419b390 con 0x7ff4740ffcf0 2023-03-17T11:39:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff47aa4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47419b550 con 0x7ff4740ff350 2023-03-17T11:39:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 0x7ff474196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff478fe9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff474104390 0x7ff47419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 0x7ff474196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:58218/0 (socket says 172.21.15.35:58218) 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff4737fe700 1 -- 172.21.15.35:0/2445666936 learned_addr learned my addr 172.21.15.35:0/2445666936 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff473fff700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4740ff350 0x7ff474196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.367+0000 7ff478fe9700 1 -- 172.21.15.35:0/2445666936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4740ff350 msgr2=0x7ff474196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff478fe9700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4740ff350 0x7ff474196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff478fe9700 1 -- 172.21.15.35:0/2445666936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 msgr2=0x7ff474196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff478fe9700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 0x7ff474196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff478fe9700 1 -- 172.21.15.35:0/2445666936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640095f0 con 0x7ff474104390 2023-03-17T11:39:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff478fe9700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff474104390 0x7ff47419abe0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7ff46c007f10 tx=0x7ff46c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff4717fa700 1 -- 172.21.15.35:0/2445666936 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c004db0 con 0x7ff474104390 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff4717fa700 1 -- 172.21.15.35:0/2445666936 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff46c00f040 con 0x7ff474104390 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47410f000 con 0x7ff474104390 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff4717fa700 1 -- 172.21.15.35:0/2445666936 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005960 con 0x7ff474104390 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.368+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47410ee70 con 0x7ff474104390 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.370+0000 7ff4717fa700 1 -- 172.21.15.35:0/2445666936 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff46c00db20 con 0x7ff474104390 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.371+0000 7ff4717fa700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff45c09f640 0x7ff45c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.371+0000 7ff473fff700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff45c09f640 0x7ff45c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.371+0000 7ff4717fa700 1 -- 172.21.15.35:0/2445666936 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff46c0c9e80 con 0x7ff474104390 2023-03-17T11:39:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff473fff700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff45c09f640 0x7ff45c0a1af0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff46400b580 tx=0x7ff464009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 Processor -- start 2023-03-17T11:39:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 -- start start 2023-03-17T11:39:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e2d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e2d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e1db010 con 0x55a27e2da4f0 2023-03-17T11:39:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e22d950 con 0x55a27e2d4960 2023-03-17T11:39:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e226de0 con 0x55a27e2d9be0 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.372+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e2d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e2d4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56430/0 (socket says 172.21.15.35:56430) 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 -- 172.21.15.35:0/3729886388 learned_addr learned my addr 172.21.15.35:0/3729886388 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff473fff700 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff478fe9700 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e2d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 -- 172.21.15.35:0/3729886388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 msgr2=0x55a27e2d9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2d9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 -- 172.21.15.35:0/3729886388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 msgr2=0x55a27e2d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e2d4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 -- 172.21.15.35:0/3729886388 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a27e0a85d0 con 0x55a27e2da4f0 2023-03-17T11:39:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff4737fe700 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e2d4420 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7ff46800bda0 tx=0x7ff4680106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ca0ecc1bfd633e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff45a7fc700 1 -- 172.21.15.35:0/3729886388 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468010e10 con 0x55a27e2da4f0 2023-03-17T11:39:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff45a7fc700 1 -- 172.21.15.35:0/3729886388 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff468015070 con 0x55a27e2da4f0 2023-03-17T11:39:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.373+0000 7ff45a7fc700 1 -- 172.21.15.35:0/3729886388 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680116a0 con 0x55a27e2da4f0 2023-03-17T11:39:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3729886388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 msgr2=0x55a27e2d4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e2d4420 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7ff46800bda0 tx=0x7ff4680106b0 comp rx=0 tx=0).stop 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3729886388 shutdown_connections 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e2d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2d9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3729886388 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e2d4420 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3729886388 >> 172.21.15.35:0/3729886388 conn(0x55a27e1316b0 msgr2=0x55a27e2cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3729886388 shutdown_connections 2023-03-17T11:39:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3729886388 wait complete. 2023-03-17T11:39:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.374+0000 7ff486bd9b80 1 -- start start 2023-03-17T11:39:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 Processor -- start 2023-03-17T11:39:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2ddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e0aa8c0 con 0x55a27e2d4960 2023-03-17T11:39:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e2de4a0 con 0x55a27e2da4f0 2023-03-17T11:39:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e2ea000 con 0x55a27e2d9be0 2023-03-17T11:39:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff486bd9b80 10 client.0 _ll_register_callbacks cb 0x55a27e0cc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:39:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff473fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff473fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56434/0 (socket says 172.21.15.35:56434) 2023-03-17T11:39:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff473fff700 1 -- 172.21.15.35:0/3530356119 learned_addr learned my addr 172.21.15.35:0/3530356119 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff4737fe700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.375+0000 7ff478fe9700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2ddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff473fff700 1 -- 172.21.15.35:0/3530356119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 msgr2=0x55a27e2dd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:30.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff473fff700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff473fff700 1 -- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 msgr2=0x55a27e2ddd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff473fff700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2ddd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff473fff700 1 -- 172.21.15.35:0/3530356119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46800b9d0 con 0x55a27e2d4960 2023-03-17T11:39:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff478fe9700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:39:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff473fff700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e0430 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7ff4640099c0 tx=0x7ff464009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5249a57078f3bf06 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff4537fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:39:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff4537fe700 1 -- 172.21.15.35:0/3530356119 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464004b70 con 0x55a27e2d4960 2023-03-17T11:39:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff4537fe700 1 -- 172.21.15.35:0/3530356119 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff464004cd0 con 0x55a27e2d4960 2023-03-17T11:39:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a27e1e9390 con 0x55a27e2d4960 2023-03-17T11:39:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff4537fe700 1 -- 172.21.15.35:0/3530356119 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff464004e90 con 0x55a27e2d4960 2023-03-17T11:39:31.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff486bd9b80 10 client.21231 fetch_fsmap learned FSMap version 108 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55a27e054d80 con 0x55a27e2d4960 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff4537fe700 1 -- 172.21.15.35:0/3530356119 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a27e1e9390 con 0x55a27e2d4960 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.376+0000 7ff4537fe700 1 -- 172.21.15.35:0/3530356119 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff46402f070 con 0x55a27e2d4960 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff486bd9b80 10 client.21231 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff486bd9b80 10 client.21231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff486bd9b80 20 client.21231 populate_metadata read hostname 'smithi035' 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e2ee0f0 0x55a27e2f0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff486bd9b80 4 client.21231 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:39:31.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a27e1f5600 con 0x55a27e2ee0f0 2023-03-17T11:39:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff4737fe700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e2ee0f0 0x55a27e2f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff4537fe700 10 client.21231 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:32.659 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:13 smithi035 ceph-mon[92535]: pgmap v5415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.377+0000 7ff4737fe700 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e2ee0f0 0x55a27e2f0500 crc :-1 s=READY pgs=723 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bddd44811c1db4a server_cookie=73918b2e624cc5bb in_seq=0 out_seq=0 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff4537fe700 1 -- 172.21.15.35:0/3530356119 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a27e1f5600 con 0x55a27e2ee0f0 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff4537fe700 10 client.21231 handle_command_reply: tid=0 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 client.21231 shutdown 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 msgr2=0x55a27e2e0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e0430 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7ff4640099c0 tx=0x7ff464009cd0 comp rx=0 tx=0).stop 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 shutdown_connections 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e2ee0f0 0x55a27e2f0500 crc :-1 s=READY pgs=723 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e0430 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff4537fe700 0 client.21231 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/3530356119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 >> 172.21.15.35:0/3530356119 conn(0x55a27e1316b0 msgr2=0x55a27e2d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 shutdown_connections 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.378+0000 7ff486bd9b80 1 -- 172.21.15.35:0/3530356119 wait complete. 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.379+0000 7ff486bd9b80 20 client.21231 trim_cache size 0 max 16384 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.393+0000 7ff486bd9b80 1 Processor -- start 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 -- start start 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2d76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:34.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e2eaaa0 con 0x55a27e2d4960 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e2ca0f0 con 0x55a27e2da4f0 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e2cbbb0 con 0x55a27e2d9be0 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56442/0 (socket says 172.21.15.35:56442) 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 -- 172.21.15.35:0/2585889963 learned_addr learned my addr 172.21.15.35:0/2585889963 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff4737fe700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:34.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff478fe9700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2d76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 -- 172.21.15.35:0/2585889963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 msgr2=0x55a27e2dffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 -- 172.21.15.35:0/2585889963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 msgr2=0x55a27e2d76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2d76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 -- 172.21.15.35:0/2585889963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a27e1ed130 con 0x55a27e2d4960 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff478fe9700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff4737fe700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:39:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.394+0000 7ff473fff700 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e4f50 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7ff4640095b0 tx=0x7ff464005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92046b787882938 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:38.147 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff45affd700 1 -- 172.21.15.35:0/2585889963 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464005250 con 0x55a27e2d4960 2023-03-17T11:39:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff45affd700 1 -- 172.21.15.35:0/2585889963 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff464028070 con 0x55a27e2d4960 2023-03-17T11:39:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff45affd700 1 -- 172.21.15.35:0/2585889963 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464003b10 con 0x55a27e2d4960 2023-03-17T11:39:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 -- 172.21.15.35:0/2585889963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 msgr2=0x55a27e2e4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e4f50 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7ff4640095b0 tx=0x7ff464005cd0 comp rx=0 tx=0).stop 2023-03-17T11:39:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 -- 172.21.15.35:0/2585889963 shutdown_connections 2023-03-17T11:39:38.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2da4f0 0x55a27e2d76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2d4960 0x55a27e2e4f50 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/2585889963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e2dffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:38.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 -- 172.21.15.35:0/2585889963 >> 172.21.15.35:0/2585889963 conn(0x55a27e1316b0 msgr2=0x55a27e2ea390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 -- 172.21.15.35:0/2585889963 shutdown_connections 2023-03-17T11:39:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.395+0000 7ff486bd9b80 1 -- 172.21.15.35:0/2585889963 wait complete. 2023-03-17T11:39:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 -- start start 2023-03-17T11:39:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 Processor -- start 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e33b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e33b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e335f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e3364f0 con 0x55a27e2da4f0 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e336660 con 0x55a27e2d4960 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27e336820 con 0x55a27e2d9be0 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff486bd9b80 10 client.0 _ll_register_callbacks cb 0x55a27e0cc230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff478fe9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e335f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff478fe9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e335f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56452/0 (socket says 172.21.15.35:56452) 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff478fe9700 1 -- 172.21.15.35:0/161153715 learned_addr learned my addr 172.21.15.35:0/161153715 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.396+0000 7ff473fff700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e33b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4737fe700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e33b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:41.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff478fe9700 1 -- 172.21.15.35:0/161153715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 msgr2=0x55a27e33b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff478fe9700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e33b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff478fe9700 1 -- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 msgr2=0x55a27e33b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff478fe9700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e33b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff478fe9700 1 -- 172.21.15.35:0/161153715 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a27e054d80 con 0x55a27e2da4f0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4737fe700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e33b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff478fe9700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e335f20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0943a0 tx=0x7ff46c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3851019dbb76f62 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4537fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4537fe700 1 -- 172.21.15.35:0/161153715 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c097930 con 0x55a27e2da4f0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4537fe700 1 -- 172.21.15.35:0/161153715 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff46c09fb20 con 0x55a27e2da4f0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a27e2a41e0 con 0x55a27e2da4f0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4537fe700 1 -- 172.21.15.35:0/161153715 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff46c0c7300 con 0x55a27e2da4f0 2023-03-17T11:39:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 10 client.21237 fetch_fsmap learned FSMap version 108 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55a27e07b1f0 con 0x55a27e2da4f0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4537fe700 1 -- 172.21.15.35:0/161153715 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a27e2a41e0 con 0x55a27e2da4f0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff4537fe700 1 -- 172.21.15.35:0/161153715 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff46c0c7020 con 0x55a27e2da4f0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 10 client.21237 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 10 client.21237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 20 client.21237 populate_metadata read hostname 'smithi035' 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e3430f0 0x55a27e3454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 4 client.21237 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.397+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a27e0aaf00 con 0x55a27e3430f0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.398+0000 7ff473fff700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e3430f0 0x55a27e3454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.398+0000 7ff4537fe700 10 client.21237 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.398+0000 7ff473fff700 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e3430f0 0x55a27e3454d0 crc :-1 s=READY pgs=724 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=686e9c724a094251 server_cookie=205beb3a63f15141 in_seq=0 out_seq=0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.407+0000 7ff4537fe700 1 -- 172.21.15.35:0/161153715 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a27e0aaf00 con 0x55a27e3430f0 2023-03-17T11:39:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.407+0000 7ff4537fe700 10 client.21237 handle_command_reply: tid=0 2023-03-17T11:39:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.407+0000 7ff486bd9b80 1 client.21237 shutdown 2023-03-17T11:39:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.407+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 msgr2=0x55a27e335f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.407+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e335f20 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0943a0 tx=0x7ff46c009e20 comp rx=0 tx=0).stop 2023-03-17T11:39:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 shutdown_connections 2023-03-17T11:39:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a27e3430f0 0x55a27e3454d0 crc :-1 s=READY pgs=724 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a27e2da4f0 0x55a27e335f20 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff4537fe700 0 client.21237 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a27e2d4960 0x55a27e33b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 --2- 172.21.15.35:0/161153715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a27e2d9be0 0x55a27e33b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 >> 172.21.15.35:0/161153715 conn(0x55a27e1316b0 msgr2=0x55a27e2d76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 shutdown_connections 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 1 -- 172.21.15.35:0/161153715 wait complete. 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff486bd9b80 20 client.21237 trim_cache size 0 max 16384 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff45c09f640 msgr2=0x7ff45c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff45c09f640 0x7ff45c0a1af0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff46400b580 tx=0x7ff464009f10 comp rx=0 tx=0).stop 2023-03-17T11:39:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff474104390 msgr2=0x7ff47419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff474104390 0x7ff47419abe0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7ff46c007f10 tx=0x7ff46c00d3b0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 shutdown_connections 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff45c09f640 0x7ff45c0a1af0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff474104390 0x7ff47419abe0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4740ff350 0x7ff474196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 --2- 172.21.15.35:0/2445666936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4740ffcf0 0x7ff474196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 >> 172.21.15.35:0/2445666936 conn(0x7ff474076330 msgr2=0x7ff474068100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 shutdown_connections 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:38.408+0000 7ff47aa4c700 1 -- 172.21.15.35:0/2445666936 wait complete. 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 -- 172.21.15.35:0/3220300315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b810a7a0 msgr2=0x7fb8b810cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/3220300315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b810a7a0 0x7fb8b810cbc0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009990 tx=0x7fb8b0009ca0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 -- 172.21.15.35:0/3220300315 shutdown_connections 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/3220300315 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b810a7a0 0x7fb8b810cbc0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/3220300315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b81013d0 0x7fb8b81017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/3220300315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b8101ce0 0x7fb8b810a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 -- 172.21.15.35:0/3220300315 >> 172.21.15.35:0/3220300315 conn(0x7fb8b8076330 msgr2=0x7fb8b8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 -- 172.21.15.35:0/3220300315 shutdown_connections 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 -- 172.21.15.35:0/3220300315 wait complete. 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.532+0000 7fb8bde4e700 1 Processor -- start 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 -- start start 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b81013d0 0x7fb8b8196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 0x7fb8b8196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b810a7a0 0x7fb8b819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b819b130 con 0x7fb8b8101ce0 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b819b2a0 con 0x7fb8b810a7a0 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8bde4e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b819b460 con 0x7fb8b81013d0 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 0x7fb8b8196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 0x7fb8b8196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56464/0 (socket says 172.21.15.35:56464) 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1006267392 learned_addr learned my addr 172.21.15.35:0/1006267392 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b81013d0 0x7fb8b8196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b7fff700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b810a7a0 0x7fb8b819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1006267392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b81013d0 msgr2=0x7fb8b8196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b81013d0 0x7fb8b8196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1006267392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b810a7a0 msgr2=0x7fb8b819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b810a7a0 0x7fb8b819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1006267392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00095f0 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.533+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 0x7fb8b8196690 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00d950 tx=0x7fb8ac00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.534+0000 7fb8b4ff9700 1 -- 172.21.15.35:0/1006267392 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac009940 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.534+0000 7fb8b4ff9700 1 -- 172.21.15.35:0/1006267392 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8ac010460 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.534+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b81100a0 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.534+0000 7fb8b4ff9700 1 -- 172.21.15.35:0/1006267392 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00f620 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.534+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b810ff10 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.536+0000 7fb8b4ff9700 1 -- 172.21.15.35:0/1006267392 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb8ac0105d0 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.536+0000 7fb8b4ff9700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb8a009f640 0x7fb8a00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.537+0000 7fb8b4ff9700 1 -- 172.21.15.35:0/1006267392 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb8ac0ca430 con 0x7fb8b8101ce0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.537+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb8a009f640 0x7fb8a00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.537+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb8a009f640 0x7fb8a00a1af0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009550 tx=0x7fb8a80091f0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.537+0000 7fb8c9fdbb80 1 Processor -- start 2023-03-17T11:39:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.537+0000 7fb8c9fdbb80 1 -- start start 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x563220345420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220345d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322024c010 con 0x56322034abe0 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322029e950 con 0x56322034b4f0 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563220297de0 con 0x563220345960 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56470/0 (socket says 172.21.15.35:56470) 2023-03-17T11:39:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 -- 172.21.15.35:0/3442117997 learned_addr learned my addr 172.21.15.35:0/3442117997 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:44.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:15 smithi035 ceph-mon[92535]: pgmap v5416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:39:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x563220345420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 -- 172.21.15.35:0/3442117997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 msgr2=0x563220345d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220345d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 -- 172.21.15.35:0/3442117997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 msgr2=0x563220345420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x563220345420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 -- 172.21.15.35:0/3442117997 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632201195d0 con 0x56322034abe0 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.538+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034afb0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80094c0 tx=0x7fb8a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaaa02f834e6227 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb89dffb700 1 -- 172.21.15.35:0/3442117997 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8007da0 con 0x56322034abe0 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb89dffb700 1 -- 172.21.15.35:0/3442117997 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8a801a070 con 0x56322034abe0 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb89dffb700 1 -- 172.21.15.35:0/3442117997 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8015660 con 0x56322034abe0 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/3442117997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 msgr2=0x56322034afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034afb0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80094c0 tx=0x7fb8a8013000 comp rx=0 tx=0).stop 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/3442117997 shutdown_connections 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220345d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034afb0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/3442117997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x563220345420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/3442117997 >> 172.21.15.35:0/3442117997 conn(0x5632201a26b0 msgr2=0x56322033fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/3442117997 shutdown_connections 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.539+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/3442117997 wait complete. 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 -- start start 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 Processor -- start 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220351490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x56322034ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322011b8c0 con 0x56322034abe0 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322034f500 con 0x56322034b4f0 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322035b000 con 0x563220345960 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.540+0000 7fb8c9fdbb80 10 client.0 _ll_register_callbacks cb 0x56322013d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56478/0 (socket says 172.21.15.35:56478) 2023-03-17T11:39:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/2290983369 learned_addr learned my addr 172.21.15.35:0/2290983369 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:46.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220351490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b7fff700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x56322034ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/2290983369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 msgr2=0x563220351490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220351490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 msgr2=0x56322034ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x56322034ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/2290983369 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a80043c0 con 0x56322034abe0 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220351490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034e710 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac010880 tx=0x7fb8ac0978d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e6874cf7e03bcb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb896ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb896ffd700 1 -- 172.21.15.35:0/2290983369 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0982e0 con 0x56322034abe0 2023-03-17T11:39:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb896ffd700 1 -- 172.21.15.35:0/2290983369 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb8ac0a0070 con 0x56322034abe0 2023-03-17T11:39:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56322025a390 con 0x56322034abe0 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb896ffd700 1 -- 172.21.15.35:0/2290983369 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8ac0b0210 con 0x56322034abe0 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8c9fdbb80 10 client.21249 fetch_fsmap learned FSMap version 108 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.541+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5632200c5d80 con 0x56322034abe0 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb896ffd700 1 -- 172.21.15.35:0/2290983369 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8ac0b4020 con 0x56322034abe0 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb896ffd700 1 -- 172.21.15.35:0/2290983369 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb8ac09fc70 con 0x56322034abe0 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8c9fdbb80 10 client.21249 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8c9fdbb80 10 client.21249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8c9fdbb80 20 client.21249 populate_metadata read hostname 'smithi035' 2023-03-17T11:39:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56322035f090 0x5632203614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8c9fdbb80 4 client.21249 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:39:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563220266600 con 0x56322035f090 2023-03-17T11:39:50.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56322035f090 0x5632203614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:50.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.542+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56322035f090 0x5632203614a0 crc :-1 s=READY pgs=725 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb0258a7c20e6594 server_cookie=8f96688778f9ec7f in_seq=0 out_seq=0 2023-03-17T11:39:50.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb896ffd700 10 client.21249 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:50.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb896ffd700 1 -- 172.21.15.35:0/2290983369 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563220266600 con 0x56322035f090 2023-03-17T11:39:50.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb896ffd700 10 client.21249 handle_command_reply: tid=0 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 client.21249 shutdown 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 msgr2=0x56322034e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034e710 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac010880 tx=0x7fb8ac0978d0 comp rx=0 tx=0).stop 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 shutdown_connections 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56322035f090 0x5632203614a0 crc :-1 s=READY pgs=725 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034b4f0 0x56322034ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb896ffd700 0 client.21249 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220351490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:50.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2290983369 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x56322034e710 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.543+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 >> 172.21.15.35:0/2290983369 conn(0x5632201a26b0 msgr2=0x563220344410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.544+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 shutdown_connections 2023-03-17T11:39:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.544+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2290983369 wait complete. 2023-03-17T11:39:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.544+0000 7fb8c9fdbb80 20 client.21249 trim_cache size 0 max 16384 2023-03-17T11:39:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.558+0000 7fb8c9fdbb80 1 Processor -- start 2023-03-17T11:39:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.558+0000 7fb8c9fdbb80 1 -- start start 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220355f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034abe0 0x563220351030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 0x5632203486b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632203414a0 con 0x56322034b4f0 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563220345780 con 0x56322034abe0 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322034ccc0 con 0x563220345960 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 0x5632203486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 0x5632203486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56488/0 (socket says 172.21.15.35:56488) 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 -- 172.21.15.35:0/2931420738 learned_addr learned my addr 172.21.15.35:0/2931420738 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034abe0 0x563220351030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220355f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 -- 172.21.15.35:0/2931420738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 msgr2=0x563220355f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220355f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 -- 172.21.15.35:0/2931420738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034abe0 msgr2=0x563220351030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:39:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034abe0 0x563220351030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 -- 172.21.15.35:0/2931420738 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322025e130 con 0x56322034b4f0 2023-03-17T11:39:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb8b7fff700 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 0x5632203486b0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00098e0 tx=0x7fb8b00058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f58d25d83545193 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:39:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.559+0000 7fb89e7fc700 1 -- 172.21.15.35:0/2931420738 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0005240 con 0x56322034b4f0 2023-03-17T11:39:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb89e7fc700 1 -- 172.21.15.35:0/2931420738 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8b001e040 con 0x56322034b4f0 2023-03-17T11:39:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb89e7fc700 1 -- 172.21.15.35:0/2931420738 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0004760 con 0x56322034b4f0 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2931420738 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 msgr2=0x5632203486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 0x5632203486b0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00098e0 tx=0x7fb8b00058e0 comp rx=0 tx=0).stop 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2931420738 shutdown_connections 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034b4f0 0x5632203486b0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563220345960 0x563220355f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/2931420738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56322034abe0 0x563220351030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2931420738 >> 172.21.15.35:0/2931420738 conn(0x5632201a26b0 msgr2=0x563220344be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2931420738 shutdown_connections 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/2931420738 wait complete. 2023-03-17T11:39:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.560+0000 7fb8c9fdbb80 1 -- start start 2023-03-17T11:39:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 Processor -- start 2023-03-17T11:39:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563220345960 0x563220355910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:39:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x563220355e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56322034b4f0 0x563220353f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563220354500 con 0x56322034abe0 2023-03-17T11:40:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563220354670 con 0x563220345960 2023-03-17T11:40:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563220354830 con 0x56322034b4f0 2023-03-17T11:40:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8c9fdbb80 10 client.0 _ll_register_callbacks cb 0x56322013d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:40:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x563220355e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x563220355e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56492/0 (socket says 172.21.15.35:56492) 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1457498442 learned_addr learned my addr 172.21.15.35:0/1457498442 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563220345960 0x563220355910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b7fff700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56322034b4f0 0x563220353f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1457498442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56322034b4f0 msgr2=0x563220353f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56322034b4f0 0x563220353f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563220345960 msgr2=0x563220355910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563220345960 0x563220355910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.561+0000 7fb8b6ffd700 1 -- 172.21.15.35:0/1457498442 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b810d880 con 0x56322034abe0 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8b6ffd700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x563220355e50 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009520 tx=0x7fb8ac09fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d20f97b8b4a684 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb896ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb896ffd700 1 -- 172.21.15.35:0/1457498442 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac014070 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb896ffd700 1 -- 172.21.15.35:0/1457498442 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb8ac0b5080 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632203151e0 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb896ffd700 1 -- 172.21.15.35:0/1457498442 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8ac0b0210 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 10 client.21255 fetch_fsmap learned FSMap version 108 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5632200ec1f0 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb896ffd700 1 -- 172.21.15.35:0/1457498442 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5632203151e0 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb896ffd700 1 -- 172.21.15.35:0/1457498442 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb8ac0980e0 con 0x56322034abe0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 10 client.21255 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 10 client.21255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 20 client.21255 populate_metadata read hostname 'smithi035' 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632203b3cf0 0x5632203b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 4 client.21255 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.562+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56322011bf00 con 0x5632203b3cf0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.563+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632203b3cf0 0x5632203b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.563+0000 7fb896ffd700 10 client.21255 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:40:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.563+0000 7fb8b77fe700 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632203b3cf0 0x5632203b60d0 crc :-1 s=READY pgs=726 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=796682498c4f0a84 server_cookie=cc97db24590c6867 in_seq=0 out_seq=0 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.571+0000 7fb896ffd700 1 -- 172.21.15.35:0/1457498442 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56322011bf00 con 0x5632203b3cf0 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.571+0000 7fb896ffd700 10 client.21255 handle_command_reply: tid=0 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.571+0000 7fb8c9fdbb80 1 client.21255 shutdown 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.571+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 msgr2=0x563220355e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x563220355e50 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009520 tx=0x7fb8ac09fe90 comp rx=0 tx=0).stop 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 shutdown_connections 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5632203b3cf0 0x5632203b60d0 crc :-1 s=READY pgs=726 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56322034b4f0 0x563220353f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563220345960 0x563220355910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb896ffd700 0 client.21255 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 --2- 172.21.15.35:0/1457498442 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56322034abe0 0x563220355e50 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 >> 172.21.15.35:0/1457498442 conn(0x5632201a26b0 msgr2=0x5632203486b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 shutdown_connections 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 1 -- 172.21.15.35:0/1457498442 wait complete. 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8c9fdbb80 20 client.21255 trim_cache size 0 max 16384 2023-03-17T11:40:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb8a009f640 msgr2=0x7fb8a00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb8a009f640 0x7fb8a00a1af0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009550 tx=0x7fb8a80091f0 comp rx=0 tx=0).stop 2023-03-17T11:40:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 msgr2=0x7fb8b8196690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 0x7fb8b8196690 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00d950 tx=0x7fb8ac00dc60 comp rx=0 tx=0).stop 2023-03-17T11:40:02.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 shutdown_connections 2023-03-17T11:40:04.592 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb8a009f640 0x7fb8a00a1af0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8b810a7a0 0x7fb8b819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:04.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:17 smithi035 ceph-mon[92535]: pgmap v5417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:40:04.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:17 smithi035 ceph-mon[92535]: osdmap e408: 12 total, 12 up, 12 in 2023-03-17T11:40:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8b81013d0 0x7fb8b8196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 --2- 172.21.15.35:0/1006267392 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb8b8101ce0 0x7fb8b8196690 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 >> 172.21.15.35:0/1006267392 conn(0x7fb8b8076330 msgr2=0x7fb8b80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.572+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 shutdown_connections 2023-03-17T11:40:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:15:51.573+0000 7fb8bde4e700 1 -- 172.21.15.35:0/1006267392 wait complete. 2023-03-17T11:40:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 -- 172.21.15.35:0/1054152083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 msgr2=0x7fdc40100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 --2- 172.21.15.35:0/1054152083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40100840 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0099c0 tx=0x7fdc3c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 -- 172.21.15.35:0/1054152083 shutdown_connections 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 --2- 172.21.15.35:0/1054152083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc401054b0 0x7fdc4010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 --2- 172.21.15.35:0/1054152083 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40100840 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 --2- 172.21.15.35:0/1054152083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc40100e10 0x7fdc40104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 -- 172.21.15.35:0/1054152083 >> 172.21.15.35:0/1054152083 conn(0x7fdc400fbce0 msgr2=0x7fdc400fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 -- 172.21.15.35:0/1054152083 shutdown_connections 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.694+0000 7fdc48460700 1 -- 172.21.15.35:0/1054152083 wait complete. 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 Processor -- start 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 -- start start 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc40100e10 0x7fdc400732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc401054b0 0x7fdc401a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc40073af0 con 0x7fdc40100470 2023-03-17T11:40:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc401a4940 con 0x7fdc40100e10 2023-03-17T11:40:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc48460700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc401a4a80 con 0x7fdc401054b0 2023-03-17T11:40:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc459fb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc40100e10 0x7fdc400732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40072d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56532/0 (socket says 172.21.15.35:56532) 2023-03-17T11:40:08.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 -- 172.21.15.35:0/3306596108 learned_addr learned my addr 172.21.15.35:0/3306596108 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc469fd700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc401054b0 0x7fdc401a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 -- 172.21.15.35:0/3306596108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc401054b0 msgr2=0x7fdc401a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc401054b0 0x7fdc401a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 -- 172.21.15.35:0/3306596108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc40100e10 msgr2=0x7fdc400732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc40100e10 0x7fdc400732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc461fc700 1 -- 172.21.15.35:0/3306596108 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0095f0 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.695+0000 7fdc459fb700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc40100e10 0x7fdc400732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.696+0000 7fdc461fc700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40072d80 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009fd0 tx=0x7fdc3c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.696+0000 7fdc377fe700 1 -- 172.21.15.35:0/3306596108 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c01d070 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.696+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc40110120 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.696+0000 7fdc377fe700 1 -- 172.21.15.35:0/3306596108 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc3c0054c0 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.696+0000 7fdc377fe700 1 -- 172.21.15.35:0/3306596108 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c004a90 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.696+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4010ff90 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.698+0000 7fdc377fe700 1 -- 172.21.15.35:0/3306596108 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdc3c00fb80 con 0x7fdc40100470 2023-03-17T11:40:08.323 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.698+0000 7fdc377fe700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc2c0b0650 0x7fdc2c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.699+0000 7fdc377fe700 1 -- 172.21.15.35:0/3306596108 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdc3c0cb430 con 0x7fdc40100470 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.699+0000 7fdc459fb700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc2c0b0650 0x7fdc2c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.699+0000 7fdc459fb700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc2c0b0650 0x7fdc2c0b2b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdc40074570 tx=0x7fdc3000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.699+0000 7fdc545edb80 1 Processor -- start 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 -- start start 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d1a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d08e010 con 0x55d61d1a9430 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d0e0950 con 0x55d61d1aec40 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc545edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d0d9de0 con 0x55d61d1a9de0 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d1a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d1a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56542/0 (socket says 172.21.15.35:56542) 2023-03-17T11:40:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 -- 172.21.15.35:0/3081673542 learned_addr learned my addr 172.21.15.35:0/3081673542 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc461fc700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc469fd700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 -- 172.21.15.35:0/3081673542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 msgr2=0x55d61d1b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 -- 172.21.15.35:0/3081673542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 msgr2=0x55d61d1af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc459fb700 1 -- 172.21.15.35:0/3081673542 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d61cf5b5d0 con 0x55d61d1a9430 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc469fd700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.700+0000 7fdc461fc700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.701+0000 7fdc459fb700 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d1a98a0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fdc30011760 tx=0x7fdc30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae073113fedb39 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.701+0000 7fdc34dae700 1 -- 172.21.15.35:0/3081673542 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3001e420 con 0x55d61d1a9430 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.701+0000 7fdc34dae700 1 -- 172.21.15.35:0/3081673542 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc30015070 con 0x55d61d1a9430 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.701+0000 7fdc34dae700 1 -- 172.21.15.35:0/3081673542 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3001c940 con 0x55d61d1a9430 2023-03-17T11:40:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.701+0000 7fdc545edb80 1 -- 172.21.15.35:0/3081673542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 msgr2=0x55d61d1a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.701+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d1a98a0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fdc30011760 tx=0x7fdc30013000 comp rx=0 tx=0).stop 2023-03-17T11:40:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- 172.21.15.35:0/3081673542 shutdown_connections 2023-03-17T11:40:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3081673542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d1a98a0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- 172.21.15.35:0/3081673542 >> 172.21.15.35:0/3081673542 conn(0x55d61cfe46b0 msgr2=0x55d61d181a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- 172.21.15.35:0/3081673542 shutdown_connections 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- 172.21.15.35:0/3081673542 wait complete. 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- start start 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 Processor -- start 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d18f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d18f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d18a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61cf5d8c0 con 0x55d61d1a9430 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d18aed0 con 0x55d61d1aec40 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d18b090 con 0x55d61d1a9de0 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc545edb80 10 client.0 _ll_register_callbacks cb 0x55d61cf7f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc461fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d18f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc461fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d18f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56546/0 (socket says 172.21.15.35:56546) 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.702+0000 7fdc461fc700 1 -- 172.21.15.35:0/1246395166 learned_addr learned my addr 172.21.15.35:0/1246395166 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc461fc700 1 -- 172.21.15.35:0/1246395166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 msgr2=0x55d61d18f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc461fc700 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d18f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc461fc700 1 -- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 msgr2=0x55d61d18a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc461fc700 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d18a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc461fc700 1 -- 172.21.15.35:0/1246395166 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30011440 con 0x55d61d1a9430 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc461fc700 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d18f4b0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c095410 tx=0x7fdc3c0a1120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2f8fb7c84bc43c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc29ffb700 1 -- 172.21.15.35:0/1246395166 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0b0070 con 0x55d61d1a9430 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc29ffb700 1 -- 172.21.15.35:0/1246395166 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdc3c099380 con 0x55d61d1a9430 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d61d09c390 con 0x55d61d1a9430 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc29ffb700 1 -- 172.21.15.35:0/1246395166 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc3c098400 con 0x55d61d1a9430 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc545edb80 10 client.21267 fetch_fsmap learned FSMap version 108 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55d61cf07d80 con 0x55d61d1a9430 2023-03-17T11:40:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.703+0000 7fdc29ffb700 1 -- 172.21.15.35:0/1246395166 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d61d09c390 con 0x55d61d1a9430 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc29ffb700 1 -- 172.21.15.35:0/1246395166 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdc3c094d00 con 0x55d61d1a9430 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc545edb80 10 client.21267 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc545edb80 10 client.21267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc545edb80 20 client.21267 populate_metadata read hostname 'smithi035' 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc545edb80 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d19a7b0 0x55d61d19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc545edb80 4 client.21267 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d61d0a8600 con 0x55d61d19a7b0 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc459fb700 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d19a7b0 0x55d61d19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc459fb700 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d19a7b0 0x55d61d19cbc0 crc :-1 s=READY pgs=728 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b485b36119734366 server_cookie=c93aa1e9abd0a8e5 in_seq=0 out_seq=0 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.704+0000 7fdc29ffb700 10 client.21267 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.705+0000 7fdc29ffb700 1 -- 172.21.15.35:0/1246395166 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d61d0a8600 con 0x55d61d19a7b0 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.705+0000 7fdc29ffb700 10 client.21267 handle_command_reply: tid=0 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.705+0000 7fdc545edb80 1 client.21267 shutdown 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.705+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 msgr2=0x55d61d18f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.705+0000 7fdc545edb80 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d18f4b0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c095410 tx=0x7fdc3c0a1120 comp rx=0 tx=0).stop 2023-03-17T11:40:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 shutdown_connections 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d19a7b0 0x55d61d19cbc0 crc :-1 s=READY pgs=728 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d18a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc29ffb700 0 client.21267 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9430 0x55d61d18f4b0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 --2- 172.21.15.35:0/1246395166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d18f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 >> 172.21.15.35:0/1246395166 conn(0x55d61cfe46b0 msgr2=0x55d61d186410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 shutdown_connections 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 1 -- 172.21.15.35:0/1246395166 wait complete. 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.706+0000 7fdc545edb80 20 client.21267 trim_cache size 0 max 16384 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 Processor -- start 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 -- start start 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1a9430 0x55d61d18a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 0x55d61d181ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d17d0f0 con 0x55d61d1aec40 2023-03-17T11:40:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d1af660 con 0x55d61d1a9430 2023-03-17T11:40:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc545edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d17eb90 con 0x55d61d1a9de0 2023-03-17T11:40:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 0x55d61d181ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 0x55d61d181ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56558/0 (socket says 172.21.15.35:56558) 2023-03-17T11:40:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 -- 172.21.15.35:0/3026421676 learned_addr learned my addr 172.21.15.35:0/3026421676 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc461fc700 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1a9430 0x55d61d18a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 -- 172.21.15.35:0/3026421676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 msgr2=0x55d61d1837d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 -- 172.21.15.35:0/3026421676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1a9430 msgr2=0x55d61d18a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1a9430 0x55d61d18a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 -- 172.21.15.35:0/3026421676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d61d0a0130 con 0x55d61d1aec40 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc469fd700 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 0x55d61d181ac0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fdc380093d0 tx=0x7fdc38009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873ef6c6d07d3f26 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.721+0000 7fdc355af700 1 -- 172.21.15.35:0/3026421676 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800e030 con 0x55d61d1aec40 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc355af700 1 -- 172.21.15.35:0/3026421676 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc38007e90 con 0x55d61d1aec40 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc355af700 1 -- 172.21.15.35:0/3026421676 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38014770 con 0x55d61d1aec40 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 -- 172.21.15.35:0/3026421676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 msgr2=0x55d61d181ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 0x55d61d181ac0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fdc380093d0 tx=0x7fdc38009920 comp rx=0 tx=0).stop 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 -- 172.21.15.35:0/3026421676 shutdown_connections 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1aec40 0x55d61d181ac0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1a9430 0x55d61d18a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 --2- 172.21.15.35:0/3026421676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9de0 0x55d61d1837d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 -- 172.21.15.35:0/3026421676 >> 172.21.15.35:0/3026421676 conn(0x55d61cfe46b0 msgr2=0x55d61d18a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 -- 172.21.15.35:0/3026421676 shutdown_connections 2023-03-17T11:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 -- 172.21.15.35:0/3026421676 wait complete. 2023-03-17T11:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 -- start start 2023-03-17T11:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.722+0000 7fdc545edb80 1 Processor -- start 2023-03-17T11:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9430 0x55d61d18ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 0x55d61d18f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:16.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:19 smithi035 ceph-mon[92535]: pgmap v5419: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T11:40:16.591 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:21 smithi035 ceph-mon[92535]: pgmap v5420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:23 smithi035 ceph-mon[92535]: pgmap v5421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:25 smithi035 ceph-mon[92535]: pgmap v5422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:27 smithi035 ceph-mon[92535]: pgmap v5423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:29 smithi035 ceph-mon[92535]: pgmap v5424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:31 smithi035 ceph-mon[92535]: pgmap v5425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:33 smithi035 ceph-mon[92535]: pgmap v5426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:35 smithi035 ceph-mon[92535]: pgmap v5427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:16.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:35 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:18.114 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:37 smithi035 ceph-mon[92535]: pgmap v5428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:40:18.114 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:20.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:20.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:20.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:20.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: scrub queued for path: / 2023-03-17T11:40:20.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: scrub summary: idle+waiting paths [/] 2023-03-17T11:40:20.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: scrub summary: active paths [/] 2023-03-17T11:40:20.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: scrub summary: idle+waiting paths [/] 2023-03-17T11:40:20.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:20.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:23.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.213 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:26.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:26.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:26.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:40:26.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:40:26.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:40:26.442 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:38 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:40:26.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:40:26.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:40:26.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:40:26.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:40:26.443 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: scrub summary: idle 2023-03-17T11:40:30.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: pgmap v5429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:39 smithi035 ceph-mon[92535]: pgmap v5430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:41 smithi035 ceph-mon[92535]: pgmap v5431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:43 smithi035 ceph-mon[92535]: pgmap v5432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:45 smithi035 ceph-mon[92535]: pgmap v5433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:47 smithi035 ceph-mon[92535]: pgmap v5434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:49 smithi035 ceph-mon[92535]: pgmap v5435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:51 smithi035 ceph-mon[92535]: pgmap v5436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:53 smithi035 ceph-mon[92535]: pgmap v5437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 15 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:55 smithi035 ceph-mon[92535]: pgmap v5438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:40:30.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:57 smithi035 ceph-mon[92535]: pgmap v5439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:40:32.189 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:30:59 smithi035 ceph-mon[92535]: pgmap v5440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:40:32.189 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:01 smithi035 ceph-mon[92535]: pgmap v5441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:40:32.189 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:03 smithi035 ceph-mon[92535]: pgmap v5442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:40:32.189 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:05 smithi035 ceph-mon[92535]: pgmap v5443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d1ee0c0 con 0x55d61d1a9de0 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d1ee230 con 0x55d61d1aec40 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61d1ee3f0 con 0x55d61d1a9430 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 10 client.0 _ll_register_callbacks cb 0x55d61cf7f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 0x55d61d18f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 0x55d61d18f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56562/0 (socket says 172.21.15.35:56562) 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 -- 172.21.15.35:0/2845837810 learned_addr learned my addr 172.21.15.35:0/2845837810 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc461fc700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9430 0x55d61d18ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc469fd700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 -- 172.21.15.35:0/2845837810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9430 msgr2=0x55d61d18ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9430 0x55d61d18ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 -- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 msgr2=0x55d61d1edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 -- 172.21.15.35:0/2845837810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc380090b0 con 0x55d61d1a9de0 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc469fd700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc459fb700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 0x55d61d18f470 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fdc300058f0 tx=0x7fdc3001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d12f8171cb0bd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc29ffb700 1 -- 172.21.15.35:0/2845837810 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3002c040 con 0x55d61d1a9de0 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc29ffb700 1 -- 172.21.15.35:0/2845837810 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(377..377 src has 1..377) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdc30017070 con 0x55d61d1a9de0 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.723+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d61d1571e0 con 0x55d61d1a9de0 2023-03-17T11:40:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc29ffb700 1 -- 172.21.15.35:0/2845837810 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc30030770 con 0x55d61d1a9de0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 10 client.21273 fetch_fsmap learned FSMap version 108 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55d61cf2e1f0 con 0x55d61d1a9de0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc29ffb700 1 -- 172.21.15.35:0/2845837810 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc3003f020 con 0x55d61d1a9de0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc29ffb700 1 -- 172.21.15.35:0/2845837810 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdc3002f070 con 0x55d61d1a9de0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 10 client.21273 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 10 client.21273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 20 client.21273 populate_metadata read hostname 'smithi035' 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d1f5bc0 0x55d61d1f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 4 client.21273 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.724+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d61cf5df00 con 0x55d61d1f5bc0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.725+0000 7fdc461fc700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d1f5bc0 0x55d61d1f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.725+0000 7fdc461fc700 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d1f5bc0 0x55d61d1f7fd0 crc :-1 s=READY pgs=729 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c8a163169482aec server_cookie=4109bc2bc81bf062 in_seq=0 out_seq=0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.725+0000 7fdc29ffb700 10 client.21273 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc29ffb700 1 -- 172.21.15.35:0/2845837810 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d61cf5df00 con 0x55d61d1f5bc0 2023-03-17T11:40:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc29ffb700 10 client.21273 handle_command_reply: tid=0 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 client.21273 shutdown 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 msgr2=0x55d61d18f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 0x55d61d18f470 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fdc300058f0 tx=0x7fdc3001c3d0 comp rx=0 tx=0).stop 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 shutdown_connections 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55d61d1f5bc0 0x55d61d1f7fd0 crc :-1 s=READY pgs=729 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61d1aec40 0x55d61d1edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61d1a9430 0x55d61d18ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:37.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc29ffb700 0 client.21273 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 --2- 172.21.15.35:0/2845837810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55d61d1a9de0 0x55d61d18f470 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 >> 172.21.15.35:0/2845837810 conn(0x55d61cfe46b0 msgr2=0x55d61d196910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 shutdown_connections 2023-03-17T11:40:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 1 -- 172.21.15.35:0/2845837810 wait complete. 2023-03-17T11:40:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.745+0000 7fdc545edb80 20 client.21273 trim_cache size 0 max 16384 2023-03-17T11:40:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc2c0b0650 msgr2=0x7fdc2c0b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc2c0b0650 0x7fdc2c0b2b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fdc40074570 tx=0x7fdc3000b410 comp rx=0 tx=0).stop 2023-03-17T11:40:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 msgr2=0x7fdc40072d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40072d80 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009fd0 tx=0x7fdc3c00f690 comp rx=0 tx=0).stop 2023-03-17T11:40:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 shutdown_connections 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdc2c0b0650 0x7fdc2c0b2b00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc401054b0 0x7fdc401a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdc40100470 0x7fdc40072d80 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 --2- 172.21.15.35:0/3306596108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc40100e10 0x7fdc400732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 >> 172.21.15.35:0/3306596108 conn(0x7fdc400fbce0 msgr2=0x7fdc40103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 shutdown_connections 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:16:04.746+0000 7fdc48460700 1 -- 172.21.15.35:0/3306596108 wait complete. 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 -- 172.21.15.35:0/1081891982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0664104410 msgr2=0x7f066410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 --2- 172.21.15.35:0/1081891982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0664104410 0x7f066410bfe0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f065c00b0d0 tx=0x7f065c00b3e0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 -- 172.21.15.35:0/1081891982 shutdown_connections 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 --2- 172.21.15.35:0/1081891982 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0664104410 0x7f066410bfe0 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 --2- 172.21.15.35:0/1081891982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06640ff3d0 0x7f06640ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 --2- 172.21.15.35:0/1081891982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06640ffd70 0x7f0664103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 -- 172.21.15.35:0/1081891982 >> 172.21.15.35:0/1081891982 conn(0x7f0664076fb0 msgr2=0x7f06640773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 -- 172.21.15.35:0/1081891982 shutdown_connections 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.686+0000 7f06698b7700 1 -- 172.21.15.35:0/1081891982 wait complete. 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.687+0000 7f06698b7700 1 Processor -- start 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.687+0000 7f06698b7700 1 -- start start 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06698b7700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 0x7f0664197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06698b7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06640ffd70 0x7f0664197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06698b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664104410 0x7f06641a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06698b7700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641a2710 con 0x7f06640ff3d0 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06698b7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641a2850 con 0x7f06640ffd70 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06698b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641a2990 con 0x7f0664104410 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 0x7f0664197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 0x7f0664197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56580/0 (socket says 172.21.15.35:56580) 2023-03-17T11:40:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 -- 172.21.15.35:0/1753342877 learned_addr learned my addr 172.21.15.35:0/1753342877 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06627fc700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06640ffd70 0x7f0664197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06637fe700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664104410 0x7f06641a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 -- 172.21.15.35:0/1753342877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664104410 msgr2=0x7f06641a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664104410 0x7f06641a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 -- 172.21.15.35:0/1753342877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06640ffd70 msgr2=0x7f0664197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06640ffd70 0x7f0664197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 -- 172.21.15.35:0/1753342877 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c009d00 con 0x7f06640ff3d0 2023-03-17T11:40:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f0662ffd700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 0x7f0664197150 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f065400e9a0 tx=0x7f065400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06688b5700 1 -- 172.21.15.35:0/1753342877 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654009790 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.688+0000 7f06688b5700 1 -- 172.21.15.35:0/1753342877 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f065400cbd0 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.689+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066410f040 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.689+0000 7f06688b5700 1 -- 172.21.15.35:0/1753342877 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654018680 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.689+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066410eeb0 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.691+0000 7f06688b5700 1 -- 172.21.15.35:0/1753342877 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f065400cd40 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.692+0000 7f06688b5700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f064c09f640 0x7f064c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.692+0000 7f06688b5700 1 -- 172.21.15.35:0/1753342877 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0654014070 con 0x7f06640ff3d0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.692+0000 7f06627fc700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f064c09f640 0x7f064c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f06627fc700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f064c09f640 0x7f064c0a1af0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0664069050 tx=0x7f0658009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 Processor -- start 2023-03-17T11:40:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 -- start start 2023-03-17T11:40:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a95ca010 con 0x5584a96c8be0 2023-03-17T11:40:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a961c950 con 0x5584a96c94f0 2023-03-17T11:40:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0675a44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a9615de0 con 0x5584a96c3960 2023-03-17T11:40:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56588/0 (socket says 172.21.15.35:56588) 2023-03-17T11:40:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 -- 172.21.15.35:0/1790153918 learned_addr learned my addr 172.21.15.35:0/1790153918 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f06627fc700 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f06637fe700 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 -- 172.21.15.35:0/1790153918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 msgr2=0x5584a96c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 -- 172.21.15.35:0/1790153918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 msgr2=0x5584a96c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f0662ffd700 1 -- 172.21.15.35:0/1790153918 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584a94975d0 con 0x5584a96c8be0 2023-03-17T11:40:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.693+0000 7f06637fe700 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:40:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0662ffd700 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96c8fb0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f06540a0130 tx=0x7f06540980d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4011dcf7a97887e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0649ffb700 1 -- 172.21.15.35:0/1790153918 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540af070 con 0x5584a96c8be0 2023-03-17T11:40:53.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0649ffb700 1 -- 172.21.15.35:0/1790153918 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06540a0660 con 0x5584a96c8be0 2023-03-17T11:40:53.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0649ffb700 1 -- 172.21.15.35:0/1790153918 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654097960 con 0x5584a96c8be0 2023-03-17T11:40:53.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0675a44b80 1 -- 172.21.15.35:0/1790153918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 msgr2=0x5584a96c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:40:53.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0675a44b80 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96c8fb0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f06540a0130 tx=0x7f06540980d0 comp rx=0 tx=0).stop 2023-03-17T11:40:53.887 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.694+0000 7f0675a44b80 1 -- 172.21.15.35:0/1790153918 shutdown_connections 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96c8fb0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 --2- 172.21.15.35:0/1790153918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 -- 172.21.15.35:0/1790153918 >> 172.21.15.35:0/1790153918 conn(0x5584a95206b0 msgr2=0x5584a96bda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 -- 172.21.15.35:0/1790153918 shutdown_connections 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 -- 172.21.15.35:0/1790153918 wait complete. 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 -- start start 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.695+0000 7f0675a44b80 1 Processor -- start 2023-03-17T11:40:53.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:53.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:40:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a94998c0 con 0x5584a96c8be0 2023-03-17T11:40:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96cd5f0 con 0x5584a96c94f0 2023-03-17T11:40:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96d9030 con 0x5584a96c3960 2023-03-17T11:40:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0675a44b80 10 client.0 _ll_register_callbacks cb 0x5584a94bb230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:40:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56596/0 (socket says 172.21.15.35:56596) 2023-03-17T11:40:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 -- 172.21.15.35:0/356958825 learned_addr learned my addr 172.21.15.35:0/356958825 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:40:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0662ffd700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06637fe700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:40:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 -- 172.21.15.35:0/356958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 msgr2=0x5584a96cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 -- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 msgr2=0x5584a96cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:40:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:40:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 -- 172.21.15.35:0/356958825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066410eeb0 con 0x5584a96c8be0 2023-03-17T11:40:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f06627fc700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96cc740 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f065801f7a0 tx=0x7f06580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0892aff38d43ea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:40:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.696+0000 7f0642ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:40:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0642ffd700 1 -- 172.21.15.35:0/356958825 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065800e5c0 con 0x5584a96c8be0 2023-03-17T11:40:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0642ffd700 1 -- 172.21.15.35:0/356958825 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f065800e720 con 0x5584a96c8be0 2023-03-17T11:40:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584a95d8390 con 0x5584a96c8be0 2023-03-17T11:40:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0642ffd700 1 -- 172.21.15.35:0/356958825 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f065800e920 con 0x5584a96c8be0 2023-03-17T11:40:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 10 client.21285 fetch_fsmap learned FSMap version 108 2023-03-17T11:40:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5584a9443d80 con 0x5584a96c8be0 2023-03-17T11:41:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0642ffd700 1 -- 172.21.15.35:0/356958825 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5584a95d8390 con 0x5584a96c8be0 2023-03-17T11:41:00.714 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T11:41:03.056 INFO:teuthology.orchestra.run.smithi035.stdout: "return_code": 0, 2023-03-17T11:41:03.875 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_tag": "d72be019-a8dc-413c-9c0f-d2ee815e531d", 2023-03-17T11:41:03.875 INFO:teuthology.orchestra.run.smithi035.stdout: "mode": "asynchronous" 2023-03-17T11:41:03.875 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T11:41:03.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 -- 172.21.15.35:0/1005785018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd7810a7a0 msgr2=0x7fcd7810cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:03.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/1005785018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd7810a7a0 0x7fcd7810cc00 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000b0a0 tx=0x7fcd7000b3b0 comp rx=0 tx=0).stop 2023-03-17T11:41:04.734 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 -- 172.21.15.35:0/1005785018 shutdown_connections 2023-03-17T11:41:04.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/1005785018 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd7810a7a0 0x7fcd7810cc00 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:04.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/1005785018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101460 0x7fcd78101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:04.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/1005785018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd78101d70 0x7fcd7810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:04.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 -- 172.21.15.35:0/1005785018 >> 172.21.15.35:0/1005785018 conn(0x7fcd78076300 msgr2=0x7fcd78076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:04.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 -- 172.21.15.35:0/1005785018 shutdown_connections 2023-03-17T11:41:04.735 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.852+0000 7fcd7d81e700 1 -- 172.21.15.35:0/1005785018 wait complete. 2023-03-17T11:41:05.352 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 Processor -- start 2023-03-17T11:41:05.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 -- start start 2023-03-17T11:41:05.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 0x7fcd780ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:05.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101d70 0x7fcd780ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:05.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7810a7a0 0x7fcd781a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:05.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd780ffe20 con 0x7fcd78101460 2023-03-17T11:41:05.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd781a49a0 con 0x7fcd7810a7a0 2023-03-17T11:41:06.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd7d81e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd781a4ae0 con 0x7fcd78101d70 2023-03-17T11:41:06.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 0x7fcd780ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:06.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 0x7fcd780ff0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57632/0 (socket says 172.21.15.35:57632) 2023-03-17T11:41:06.771 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.853+0000 7fcd76ffd700 1 -- 172.21.15.35:0/2305574213 learned_addr learned my addr 172.21.15.35:0/2305574213 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:08.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd767fc700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101d70 0x7fcd780ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:08.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd777fe700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7810a7a0 0x7fcd781a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:08.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd76ffd700 1 -- 172.21.15.35:0/2305574213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101d70 msgr2=0x7fcd780ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:08.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101d70 0x7fcd780ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:08.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd76ffd700 1 -- 172.21.15.35:0/2305574213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7810a7a0 msgr2=0x7fcd781a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:08.219 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7810a7a0 0x7fcd781a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:08.220 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd76ffd700 1 -- 172.21.15.35:0/2305574213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70009d00 con 0x7fcd78101460 2023-03-17T11:41:08.220 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd767fc700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101d70 0x7fcd780ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:41:08.220 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 0x7fcd780ff0b0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800e9a0 tx=0x7fcd6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:09.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd7c81c700 1 -- 172.21.15.35:0/2305574213 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68009790 con 0x7fcd78101460 2023-03-17T11:41:09.745 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd7c81c700 1 -- 172.21.15.35:0/2305574213 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd68010430 con 0x7fcd78101460 2023-03-17T11:41:09.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd78110090 con 0x7fcd78101460 2023-03-17T11:41:09.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd7c81c700 1 -- 172.21.15.35:0/2305574213 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800cea0 con 0x7fcd78101460 2023-03-17T11:41:11.009 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.854+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7810ff00 con 0x7fcd78101460 2023-03-17T11:41:11.009 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.856+0000 7fcd7c81c700 1 -- 172.21.15.35:0/2305574213 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcd680105a0 con 0x7fcd78101460 2023-03-17T11:41:11.009 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.857+0000 7fcd7c81c700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd6009f640 0x7fcd600a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:11.009 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.857+0000 7fcd7c81c700 1 -- 172.21.15.35:0/2305574213 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(408..408 src has 1..408) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd68014070 con 0x7fcd78101460 2023-03-17T11:41:11.009 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.857+0000 7fcd767fc700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd6009f640 0x7fcd600a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.858+0000 7fcd767fc700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd6009f640 0x7fcd600a1af0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcd781008a0 tx=0x7fcd6c00a380 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.858+0000 7fcd899abb80 1 Processor -- start 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.858+0000 7fcd899abb80 1 -- start start 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed2cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed31170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed31b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:11.010 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd899abb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ec330f0 con 0x55e45ed316b0 2023-03-17T11:41:11.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd899abb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ec85a30 con 0x55e45ed2d160 2023-03-17T11:41:11.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd899abb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ec7eec0 con 0x55e45ed2c850 2023-03-17T11:41:11.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed31b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:11.011 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed31b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57644/0 (socket says 172.21.15.35:57644) 2023-03-17T11:41:12.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 -- 172.21.15.35:0/3330214345 learned_addr learned my addr 172.21.15.35:0/3330214345 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed2cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd767fc700 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed31170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 -- 172.21.15.35:0/3330214345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 msgr2=0x55e45ed2cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed2cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 -- 172.21.15.35:0/3330214345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 msgr2=0x55e45ed31170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed31170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 -- 172.21.15.35:0/3330214345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e45eb006b0 con 0x55e45ed316b0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd777fe700 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed31b00 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009410 tx=0x7fcd70009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4273630242b9e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd5dffb700 1 -- 172.21.15.35:0/3330214345 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000e040 con 0x55e45ed316b0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.859+0000 7fcd5dffb700 1 -- 172.21.15.35:0/3330214345 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd70007e10 con 0x55e45ed316b0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd5dffb700 1 -- 172.21.15.35:0/3330214345 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7001c440 con 0x55e45ed316b0 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 -- 172.21.15.35:0/3330214345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 msgr2=0x55e45ed31b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed31b00 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009410 tx=0x7fcd70009440 comp rx=0 tx=0).stop 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 -- 172.21.15.35:0/3330214345 shutdown_connections 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed31b00 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:12.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed2cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3330214345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed31170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 -- 172.21.15.35:0/3330214345 >> 172.21.15.35:0/3330214345 conn(0x55e45ed270b0 msgr2=0x55e45ed27480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 -- 172.21.15.35:0/3330214345 shutdown_connections 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.860+0000 7fcd899abb80 1 -- 172.21.15.35:0/3330214345 wait complete. 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 -- start start 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 Processor -- start 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed38e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed36080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed366e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45eb029a0 con 0x55e45ed316b0 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed36e50 con 0x55e45ed2d160 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed42900 con 0x55e45ed2c850 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd899abb80 10 client.0 _ll_register_callbacks cb 0x55e45eb24310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:12.727 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed38e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:12.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57650/0 (socket says 172.21.15.35:57650) 2023-03-17T11:41:12.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd76ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed38e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:49412/0 (socket says 172.21.15.35:49412) 2023-03-17T11:41:12.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd777fe700 1 -- 172.21.15.35:0/3336700041 learned_addr learned my addr 172.21.15.35:0/3336700041 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:12.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.861+0000 7fcd767fc700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed36080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:12.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd777fe700 1 -- 172.21.15.35:0/3336700041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 msgr2=0x55e45ed38e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:12.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd777fe700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed38e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd777fe700 1 -- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 msgr2=0x55e45ed36080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd777fe700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed36080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd777fe700 1 -- 172.21.15.35:0/3336700041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7810d8c0 con 0x55e45ed316b0 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed38e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd777fe700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed366e0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007e20 tx=0x7fcd70007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9922feeb2cfab9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd56ffd700 1 -- 172.21.15.35:0/3336700041 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000e040 con 0x55e45ed316b0 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd56ffd700 1 -- 172.21.15.35:0/3336700041 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(408..408 src has 1..408) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd70003aa0 con 0x55e45ed316b0 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e45ec41470 con 0x55e45ed316b0 2023-03-17T11:41:13.212 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd56ffd700 1 -- 172.21.15.35:0/3336700041 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd70003c60 con 0x55e45ed316b0 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd899abb80 10 client.21705 fetch_fsmap learned FSMap version 110 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55e45eaace60 con 0x55e45ed316b0 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd56ffd700 1 -- 172.21.15.35:0/3336700041 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e45ec41470 con 0x55e45ed316b0 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.862+0000 7fcd56ffd700 1 -- 172.21.15.35:0/3336700041 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd70019030 con 0x55e45ed316b0 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd899abb80 10 client.21705 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd899abb80 10 client.21705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd899abb80 20 client.21705 populate_metadata read hostname 'smithi035' 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed46630 0x55e45ed48a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd899abb80 4 client.21705 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e45ec4d6e0 con 0x55e45ed46630 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed46630 0x55e45ed48a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed46630 0x55e45ed48a40 crc :-1 s=READY pgs=783 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0678bfb5a929947 server_cookie=8b92abfae6698244 in_seq=0 out_seq=0 2023-03-17T11:41:14.073 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.863+0000 7fcd56ffd700 10 client.21705 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd56ffd700 1 -- 172.21.15.35:0/3336700041 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e45ec4d6e0 con 0x55e45ed46630 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd56ffd700 10 client.21705 handle_command_reply: tid=0 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 client.21705 shutdown 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 msgr2=0x55e45ed366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed366e0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007e20 tx=0x7fcd70007e50 comp rx=0 tx=0).stop 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 shutdown_connections 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed46630 0x55e45ed48a40 crc :-1 s=READY pgs=783 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed366e0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed38e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd56ffd700 0 client.21705 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 --2- 172.21.15.35:0/3336700041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed36080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 >> 172.21.15.35:0/3336700041 conn(0x55e45ed270b0 msgr2=0x55e45ed26790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 shutdown_connections 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 1 -- 172.21.15.35:0/3336700041 wait complete. 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.864+0000 7fcd899abb80 20 client.21705 trim_cache size 0 max 16384 2023-03-17T11:41:14.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 Processor -- start 2023-03-17T11:41:14.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 -- start start 2023-03-17T11:41:14.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed389a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:14.585 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 0x55e45ed306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:14.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 0x55e45ed30c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:14.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed2d9c0 con 0x55e45ed2d160 2023-03-17T11:41:14.956 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed2d780 con 0x55e45ed316b0 2023-03-17T11:41:15.558 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd899abb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed36f90 con 0x55e45ed2c850 2023-03-17T11:41:16.585 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd767fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 0x55e45ed306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:17.624 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 0x55e45ed30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:17.624 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 0x55e45ed30c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.35:59450/0 (socket says 172.21.15.35:59450) 2023-03-17T11:41:17.624 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd767fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 0x55e45ed306d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57656/0 (socket says 172.21.15.35:57656) 2023-03-17T11:41:18.032 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd777fe700 1 -- 172.21.15.35:0/459359093 learned_addr learned my addr 172.21.15.35:0/459359093 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.886+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd777fe700 1 -- 172.21.15.35:0/459359093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 msgr2=0x55e45ed389a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd777fe700 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed389a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd777fe700 1 -- 172.21.15.35:0/459359093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 msgr2=0x55e45ed306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd777fe700 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 0x55e45ed306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd777fe700 1 -- 172.21.15.35:0/459359093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e45ed27750 con 0x55e45ed316b0 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd767fc700 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 0x55e45ed306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd777fe700 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 0x55e45ed30c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007900 tx=0x7fcd70000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e90003e85e6e5e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd5e7fc700 1 -- 172.21.15.35:0/459359093 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000e040 con 0x55e45ed316b0 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd5e7fc700 1 -- 172.21.15.35:0/459359093 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd70003e90 con 0x55e45ed316b0 2023-03-17T11:41:18.033 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.887+0000 7fcd5e7fc700 1 -- 172.21.15.35:0/459359093 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7001caf0 con 0x55e45ed316b0 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 -- 172.21.15.35:0/459359093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 msgr2=0x55e45ed30c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 0x55e45ed30c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007900 tx=0x7fcd70000f40 comp rx=0 tx=0).stop 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 -- 172.21.15.35:0/459359093 shutdown_connections 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed316b0 0x55e45ed30c10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed389a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 --2- 172.21.15.35:0/459359093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed2d160 0x55e45ed306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:18.034 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 -- 172.21.15.35:0/459359093 >> 172.21.15.35:0/459359093 conn(0x55e45ed270b0 msgr2=0x55e45ed33a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:19.281 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 -- 172.21.15.35:0/459359093 shutdown_connections 2023-03-17T11:41:19.283 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 -- 172.21.15.35:0/459359093 wait complete. 2023-03-17T11:41:22.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 -- start start 2023-03-17T11:41:23.987 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.888+0000 7fcd899abb80 1 Processor -- start 2023-03-17T11:41:23.988 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:07 smithi035 ceph-mon[92535]: pgmap v5444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:41:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0642ffd700 1 -- 172.21.15.35:0/356958825 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0658027b20 con 0x5584a96c8be0 2023-03-17T11:41:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 10 client.21285 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:41:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 10 client.21285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:41:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 20 client.21285 populate_metadata read hostname 'smithi035' 2023-03-17T11:41:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a96dd240 0x5584a96df650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 4 client.21285 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.697+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584a95e4600 con 0x5584a96dd240 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.698+0000 7f0662ffd700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a96dd240 0x5584a96df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.698+0000 7f0642ffd700 10 client.21285 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.698+0000 7f0662ffd700 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a96dd240 0x5584a96df650 crc :-1 s=READY pgs=730 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453124b025fbf872 server_cookie=b15a356ced6cfb9e in_seq=0 out_seq=0 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0642ffd700 1 -- 172.21.15.35:0/356958825 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5584a95e4600 con 0x5584a96dd240 2023-03-17T11:41:24.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0642ffd700 10 client.21285 handle_command_reply: tid=0 2023-03-17T11:41:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 client.21285 shutdown 2023-03-17T11:41:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 msgr2=0x5584a96cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96cc740 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f065801f7a0 tx=0x7f06580047c0 comp rx=0 tx=0).stop 2023-03-17T11:41:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 shutdown_connections 2023-03-17T11:41:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a96dd240 0x5584a96df650 crc :-1 s=READY pgs=730 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0642ffd700 0 client.21285 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 --2- 172.21.15.35:0/356958825 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96cc740 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 >> 172.21.15.35:0/356958825 conn(0x5584a95206b0 msgr2=0x5584a96c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 shutdown_connections 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 1 -- 172.21.15.35:0/356958825 wait complete. 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.699+0000 7f0675a44b80 20 client.21285 trim_cache size 0 max 16384 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 Processor -- start 2023-03-17T11:41:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 -- start start 2023-03-17T11:41:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96c37c0 con 0x5584a96c8be0 2023-03-17T11:41:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96cd850 con 0x5584a96c94f0 2023-03-17T11:41:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f0675a44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96da870 con 0x5584a96c3960 2023-03-17T11:41:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f06627fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f06627fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96d3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56602/0 (socket says 172.21.15.35:56602) 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.714+0000 7f06627fc700 1 -- 172.21.15.35:0/946725788 learned_addr learned my addr 172.21.15.35:0/946725788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06637fe700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06627fc700 1 -- 172.21.15.35:0/946725788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 msgr2=0x5584a96bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f0662ffd700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06627fc700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96bdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06627fc700 1 -- 172.21.15.35:0/946725788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 msgr2=0x5584a96c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06627fc700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06627fc700 1 -- 172.21.15.35:0/946725788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584a95dc130 con 0x5584a96c8be0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f0662ffd700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06637fe700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f06627fc700 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96d3f50 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f0658000c00 tx=0x7f065801fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a65113b593d1ac server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f064a7fc700 1 -- 172.21.15.35:0/946725788 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658004040 con 0x5584a96c8be0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f064a7fc700 1 -- 172.21.15.35:0/946725788 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0658004630 con 0x5584a96c8be0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.715+0000 7f064a7fc700 1 -- 172.21.15.35:0/946725788 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658003680 con 0x5584a96c8be0 2023-03-17T11:41:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- 172.21.15.35:0/946725788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 msgr2=0x5584a96d3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96d3f50 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f0658000c00 tx=0x7f065801fec0 comp rx=0 tx=0).stop 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- 172.21.15.35:0/946725788 shutdown_connections 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c3960 0x5584a96bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- 172.21.15.35:0/946725788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c8be0 0x5584a96d3f50 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- 172.21.15.35:0/946725788 >> 172.21.15.35:0/946725788 conn(0x5584a95206b0 msgr2=0x5584a96cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- 172.21.15.35:0/946725788 shutdown_connections 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- 172.21.15.35:0/946725788 wait complete. 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- start start 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 Processor -- start 2023-03-17T11:41:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 0x5584a96d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c8be0 0x5584a96d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96d2640 con 0x5584a96c3960 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96d27b0 con 0x5584a96c94f0 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.716+0000 7f0675a44b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584a96d2970 con 0x5584a96c8be0 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0675a44b80 10 client.0 _ll_register_callbacks cb 0x5584a94bb230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 0x5584a96d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 0x5584a96d3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56608/0 (socket says 172.21.15.35:56608) 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 -- 172.21.15.35:0/3351955853 learned_addr learned my addr 172.21.15.35:0/3351955853 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f06627fc700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c8be0 0x5584a96d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f06637fe700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 -- 172.21.15.35:0/3351955853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c8be0 msgr2=0x5584a96d3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c8be0 0x5584a96d3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 -- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 msgr2=0x5584a96d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 -- 172.21.15.35:0/3351955853 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584a9443d80 con 0x5584a96c3960 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f06627fc700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c8be0 0x5584a96d3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:41:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f06637fe700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0662ffd700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 0x5584a96d3a30 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f06540a07a0 tx=0x7f065401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3f7e95262189d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0642ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0642ffd700 1 -- 172.21.15.35:0/3351955853 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540af040 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0642ffd700 1 -- 172.21.15.35:0/3351955853 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0654097960 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584a96931e0 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0642ffd700 1 -- 172.21.15.35:0/3351955853 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0654097b20 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0675a44b80 10 client.21291 fetch_fsmap learned FSMap version 108 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.717+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5584a946a1f0 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0642ffd700 1 -- 172.21.15.35:0/3351955853 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5584a96931e0 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0642ffd700 1 -- 172.21.15.35:0/3351955853 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0654098760 con 0x5584a96c3960 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0675a44b80 10 client.21291 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0675a44b80 10 client.21291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0675a44b80 20 client.21291 populate_metadata read hostname 'smithi035' 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0675a44b80 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a9736220 0x5584a9738600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0675a44b80 4 client.21291 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:41:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5584a9499f00 con 0x5584a9736220 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f06627fc700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a9736220 0x5584a9738600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f0642ffd700 10 client.21291 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.718+0000 7f06627fc700 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a9736220 0x5584a9738600 crc :-1 s=READY pgs=731 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7a769e80199c2c2 server_cookie=2920b991226b8466 in_seq=0 out_seq=0 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.735+0000 7f0642ffd700 1 -- 172.21.15.35:0/3351955853 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5584a9499f00 con 0x5584a9736220 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.735+0000 7f0642ffd700 10 client.21291 handle_command_reply: tid=0 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.735+0000 7f0675a44b80 1 client.21291 shutdown 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.735+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 msgr2=0x5584a96d3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.735+0000 7f0675a44b80 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 0x5584a96d3a30 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f06540a07a0 tx=0x7f065401f000 comp rx=0 tx=0).stop 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 shutdown_connections 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5584a9736220 0x5584a9738600 crc :-1 s=READY pgs=731 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584a96c94f0 0x5584a96d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5584a96c3960 0x5584a96d3a30 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 --2- 172.21.15.35:0/3351955853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a96c8be0 0x5584a96d3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0642ffd700 0 client.21291 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 >> 172.21.15.35:0/3351955853 conn(0x5584a95206b0 msgr2=0x5584a96c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:35.397 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 shutdown_connections 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 1 -- 172.21.15.35:0/3351955853 wait complete. 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f0675a44b80 20 client.21291 trim_cache size 0 max 16384 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f064c09f640 msgr2=0x7f064c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f064c09f640 0x7f064c0a1af0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0664069050 tx=0x7f0658009260 comp rx=0 tx=0).stop 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 msgr2=0x7f0664197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 0x7f0664197150 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f065400e9a0 tx=0x7f065400ecb0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 shutdown_connections 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f064c09f640 0x7f064c0a1af0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664104410 0x7f06641a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f06640ff3d0 0x7f0664197150 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 --2- 172.21.15.35:0/1753342877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06640ffd70 0x7f0664197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 >> 172.21.15.35:0/1753342877 conn(0x7f0664076fb0 msgr2=0x7f06640fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.736+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 shutdown_connections 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:26.737+0000 7f06698b7700 1 -- 172.21.15.35:0/1753342877 wait complete. 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 -- 172.21.15.35:0/1388651542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e8104390 msgr2=0x7f74e810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:35.398 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/1388651542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e8104390 0x7f74e810bf60 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f74e000b0d0 tx=0x7f74e000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 -- 172.21.15.35:0/1388651542 shutdown_connections 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/1388651542 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e8104390 0x7f74e810bf60 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/1388651542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e80ff350 0x7f74e80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/1388651542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80ffcf0 0x7f74e8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 -- 172.21.15.35:0/1388651542 >> 172.21.15.35:0/1388651542 conn(0x7f74e8076330 msgr2=0x7f74e8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 -- 172.21.15.35:0/1388651542 shutdown_connections 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.859+0000 7f74ecd7b700 1 -- 172.21.15.35:0/1388651542 wait complete. 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 Processor -- start 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 -- start start 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 0x7f74e8195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:35.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e80ffcf0 0x7f74e81957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8104390 0x7f74e8199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e819a270 con 0x7f74e80ff350 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e819a3e0 con 0x7f74e8104390 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.860+0000 7f74ecd7b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e819a5a0 con 0x7f74e80ffcf0 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 0x7f74e8195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e80ffcf0 0x7f74e81957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 0x7f74e8195290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56622/0 (socket says 172.21.15.35:56622) 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 -- 172.21.15.35:0/544358114 learned_addr learned my addr 172.21.15.35:0/544358114 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e6d9d700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8104390 0x7f74e8199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 -- 172.21.15.35:0/544358114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e80ffcf0 msgr2=0x7f74e81957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e80ffcf0 0x7f74e81957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 -- 172.21.15.35:0/544358114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8104390 msgr2=0x7f74e8199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8104390 0x7f74e8199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 -- 172.21.15.35:0/544358114 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009d00 con 0x7f74e80ff350 2023-03-17T11:41:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74e659c700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 0x7f74e8195290 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d950 tx=0x7f74d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74df7fe700 1 -- 172.21.15.35:0/544358114 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0009940 con 0x7f74e80ff350 2023-03-17T11:41:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74df7fe700 1 -- 172.21.15.35:0/544358114 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d0010460 con 0x7f74e80ff350 2023-03-17T11:41:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e810f010 con 0x7f74e80ff350 2023-03-17T11:41:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74df7fe700 1 -- 172.21.15.35:0/544358114 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000f620 con 0x7f74e80ff350 2023-03-17T11:41:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.861+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e810ee80 con 0x7f74e80ff350 2023-03-17T11:41:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.864+0000 7f74df7fe700 1 -- 172.21.15.35:0/544358114 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f74d00105d0 con 0x7f74e80ff350 2023-03-17T11:41:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.864+0000 7f74df7fe700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f74d409f640 0x7f74d40a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.864+0000 7f74df7fe700 1 -- 172.21.15.35:0/544358114 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74d00ca470 con 0x7f74e80ff350 2023-03-17T11:41:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.864+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f74d409f640 0x7f74d40a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f74d409f640 0x7f74d40a1af0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f74e81968a0 tx=0x7f74d800b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 Processor -- start 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed3c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed3cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed94470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed949b0 con 0x55e45ed316b0 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed94b20 con 0x55e45ed2d160 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e45ed94ce0 con 0x55e45ed2c850 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd899abb80 10 client.0 _ll_register_callbacks cb 0x55e45eb24310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed94470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd777fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed94470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57664/0 (socket says 172.21.15.35:57664) 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd777fe700 1 -- 172.21.15.35:0/1533041139 learned_addr learned my addr 172.21.15.35:0/1533041139 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed3c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd767fc700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed3cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd767fc700 1 -- 172.21.15.35:0/1533041139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 msgr2=0x55e45ed3c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:44.522 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd767fc700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed3c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd767fc700 1 -- 172.21.15.35:0/1533041139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 msgr2=0x55e45ed94470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd767fc700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed94470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd767fc700 1 -- 172.21.15.35:0/1533041139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c00feb0 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.889+0000 7fcd777fe700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed94470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd767fc700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed3cc60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00ae60 tx=0x7fcd6c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a27ff57675fd5e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd56ffd700 1 -- 172.21.15.35:0/1533041139 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c02a070 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e45ecfc2c0 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd56ffd700 1 -- 172.21.15.35:0/1533041139 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(408..408 src has 1..408) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcd6c01ca40 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd56ffd700 1 -- 172.21.15.35:0/1533041139 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd6c01cc00 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 10 client.30623 fetch_fsmap learned FSMap version 110 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55e45eaace60 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd56ffd700 1 -- 172.21.15.35:0/1533041139 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd6c033080 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd56ffd700 1 -- 172.21.15.35:0/1533041139 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcd6c025070 con 0x55e45ed2d160 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 10 client.30623 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:41:44.523 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 10 client.30623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T11:41:44.524 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 20 client.30623 populate_metadata read hostname 'smithi035' 2023-03-17T11:41:45.089 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed9c520 0x55e45ed9e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:47.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 4 client.30623 mds_command: new command op to 24452 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-03-17T11:41:47.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.890+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e45eb02fe0 con 0x55e45ed9c520 2023-03-17T11:41:47.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.891+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed9c520 0x55e45ed9e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:47.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.891+0000 7fcd56ffd700 10 client.30623 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:47.129 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.891+0000 7fcd76ffd700 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed9c520 0x55e45ed9e930 crc :-1 s=READY pgs=784 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d35c2dad441ba1a server_cookie=a74691e0770ec52b in_seq=0 out_seq=0 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd56ffd700 1 -- 172.21.15.35:0/1533041139 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e45eb02fe0 con 0x55e45ed9c520 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd56ffd700 10 client.30623 handle_command_reply: tid=0 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 client.30623 shutdown 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 msgr2=0x55e45ed3cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed3cc60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00ae60 tx=0x7fcd6c0047c0 comp rx=0 tx=0).stop 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 shutdown_connections 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e45ed9c520 0x55e45ed9e930 crc :-1 s=READY pgs=784 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e45ed316b0 0x55e45ed94470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd56ffd700 0 client.30623 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e45ed2c850 0x55e45ed3c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 --2- 172.21.15.35:0/1533041139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e45ed2d160 0x55e45ed3cc60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 >> 172.21.15.35:0/1533041139 conn(0x55e45ed270b0 msgr2=0x55e45ed30f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 shutdown_connections 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 1 -- 172.21.15.35:0/1533041139 wait complete. 2023-03-17T11:41:47.130 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.892+0000 7fcd899abb80 20 client.30623 trim_cache size 0 max 16384 2023-03-17T11:41:47.746 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd6009f640 msgr2=0x7fcd600a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:49.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd6009f640 0x7fcd600a1af0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcd781008a0 tx=0x7fcd6c00a380 comp rx=0 tx=0).stop 2023-03-17T11:41:49.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 msgr2=0x7fcd780ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:49.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 0x7fcd780ff0b0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800e9a0 tx=0x7fcd6800ecb0 comp rx=0 tx=0).stop 2023-03-17T11:41:49.831 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 shutdown_connections 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcd6009f640 0x7fcd600a1af0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7810a7a0 0x7fcd781a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcd78101460 0x7fcd780ff0b0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 --2- 172.21.15.35:0/2305574213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78101d70 0x7fcd780ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 >> 172.21.15.35:0/2305574213 conn(0x7fcd78076300 msgr2=0x7fcd78102200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 shutdown_connections 2023-03-17T11:41:49.832 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:30:37.893+0000 7fcd7d81e700 1 -- 172.21.15.35:0/2305574213 wait complete. 2023-03-17T11:41:49.833 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:09 smithi035 ceph-mon[92535]: pgmap v5445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:41:51.611 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:09 smithi035 ceph-mon[92535]: osdmap e409: 12 total, 12 up, 12 in 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 -- start start 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ec9820 0x559396ec9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396eca130 0x559396ecda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 0x559396ece3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396dce010 con 0x559396ecdf70 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396e20950 con 0x559396eca130 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.865+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396e19de0 con 0x559396ec9820 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 0x559396ece3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 0x559396ece3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56634/0 (socket says 172.21.15.35:56634) 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 -- 172.21.15.35:0/2041140932 learned_addr learned my addr 172.21.15.35:0/2041140932 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e659c700 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ec9820 0x559396ec9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396eca130 0x559396ecda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 -- 172.21.15.35:0/2041140932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ec9820 msgr2=0x559396ec9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ec9820 0x559396ec9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 -- 172.21.15.35:0/2041140932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396eca130 msgr2=0x559396ecda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396eca130 0x559396ecda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 -- 172.21.15.35:0/2041140932 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559396c9b5d0 con 0x559396ecdf70 2023-03-17T11:41:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74e6d9d700 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 0x559396ece3c0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009c30 tx=0x7f74e0009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631dba05dcca4400 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74dcff9700 1 -- 172.21.15.35:0/2041140932 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000e050 con 0x559396ecdf70 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74dcff9700 1 -- 172.21.15.35:0/2041140932 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74e00092d0 con 0x559396ecdf70 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.866+0000 7f74dcff9700 1 -- 172.21.15.35:0/2041140932 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00052a0 con 0x559396ecdf70 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 -- 172.21.15.35:0/2041140932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 msgr2=0x559396ece3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 0x559396ece3c0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009c30 tx=0x7f74e0009c60 comp rx=0 tx=0).stop 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 -- 172.21.15.35:0/2041140932 shutdown_connections 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ecdf70 0x559396ece3c0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ec9820 0x559396ec9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/2041140932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396eca130 0x559396ecda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 -- 172.21.15.35:0/2041140932 >> 172.21.15.35:0/2041140932 conn(0x559396d246b0 msgr2=0x559396ec1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 -- 172.21.15.35:0/2041140932 shutdown_connections 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.867+0000 7f74f8f08b80 1 -- 172.21.15.35:0/2041140932 wait complete. 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 -- start start 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 Processor -- start 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396ed56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ed29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396c9d8c0 con 0x559396eca130 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396ed3890 con 0x559396ec9820 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396edf1b0 con 0x559396ecdf70 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74f8f08b80 10 client.0 _ll_register_callbacks cb 0x559396cbf230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74e5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ed29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74e5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ed29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56638/0 (socket says 172.21.15.35:56638) 2023-03-17T11:41:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74e5d9b700 1 -- 172.21.15.35:0/649644820 learned_addr learned my addr 172.21.15.35:0/649644820 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.868+0000 7f74e659c700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396ed56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e6d9d700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e5d9b700 1 -- 172.21.15.35:0/649644820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 msgr2=0x559396ed3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e5d9b700 1 -- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 msgr2=0x559396ed56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396ed56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e5d9b700 1 -- 172.21.15.35:0/649644820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e810c7a0 con 0x559396eca130 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ed29e0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f74d80116c0 tx=0x7f74d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7169350ba13702 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74cdffb700 1 -- 172.21.15.35:0/649644820 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8004a30 con 0x559396eca130 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74cdffb700 1 -- 172.21.15.35:0/649644820 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74d8017070 con 0x559396eca130 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559396ddc390 con 0x559396eca130 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74cdffb700 1 -- 172.21.15.35:0/649644820 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d8010e80 con 0x559396eca130 2023-03-17T11:41:54.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74f8f08b80 10 client.21303 fetch_fsmap learned FSMap version 108 2023-03-17T11:41:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x559396c47d80 con 0x559396eca130 2023-03-17T11:41:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74cdffb700 1 -- 172.21.15.35:0/649644820 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559396ddc390 con 0x559396eca130 2023-03-17T11:41:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.869+0000 7f74cdffb700 1 -- 172.21.15.35:0/649644820 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f74d801f640 con 0x559396eca130 2023-03-17T11:41:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74f8f08b80 10 client.21303 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:41:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74f8f08b80 10 client.21303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:41:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74f8f08b80 20 client.21303 populate_metadata read hostname 'smithi035' 2023-03-17T11:41:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396ee32f0 0x559396ee5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74f8f08b80 4 client.21303 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:41:56.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559396de8600 con 0x559396ee32f0 2023-03-17T11:41:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74e659c700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396ee32f0 0x559396ee5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74e659c700 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396ee32f0 0x559396ee5700 crc :-1 s=READY pgs=732 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a5b39da0d167e server_cookie=dfdcf43bc6dcc376 in_seq=0 out_seq=0 2023-03-17T11:41:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.870+0000 7f74cdffb700 10 client.21303 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74cdffb700 1 -- 172.21.15.35:0/649644820 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559396de8600 con 0x559396ee32f0 2023-03-17T11:41:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74cdffb700 10 client.21303 handle_command_reply: tid=0 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 client.21303 shutdown 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 msgr2=0x559396ed29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ed29e0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f74d80116c0 tx=0x7f74d80047c0 comp rx=0 tx=0).stop 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 shutdown_connections 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396ee32f0 0x559396ee5700 crc :-1 s=READY pgs=732 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396ed56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/649644820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ed29e0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74cdffb700 0 client.21303 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 >> 172.21.15.35:0/649644820 conn(0x559396d246b0 msgr2=0x559396ec6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 shutdown_connections 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 1 -- 172.21.15.35:0/649644820 wait complete. 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.871+0000 7f74f8f08b80 20 client.21303 trim_cache size 0 max 16384 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.886+0000 7f74f8f08b80 1 Processor -- start 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.886+0000 7f74f8f08b80 1 -- start start 2023-03-17T11:41:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396eda0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ec33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396ec2d10 con 0x559396eca130 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396edfc70 con 0x559396ec9820 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396ed0f40 con 0x559396ecdf70 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ec33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ec33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56646/0 (socket says 172.21.15.35:56646) 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 -- 172.21.15.35:0/4283805618 learned_addr learned my addr 172.21.15.35:0/4283805618 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e659c700 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396eda0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 -- 172.21.15.35:0/4283805618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 msgr2=0x559396ed5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:41:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 -- 172.21.15.35:0/4283805618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 msgr2=0x559396eda0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396eda0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 -- 172.21.15.35:0/4283805618 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559396ec7030 con 0x559396eca130 2023-03-17T11:42:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ec33d0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f74d80059d0 tx=0x7f74d8004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa03fbf3af172a78 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.887+0000 7f74dd7fa700 1 -- 172.21.15.35:0/4283805618 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8010e60 con 0x559396eca130 2023-03-17T11:42:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74dd7fa700 1 -- 172.21.15.35:0/4283805618 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d8015070 con 0x559396eca130 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74dd7fa700 1 -- 172.21.15.35:0/4283805618 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8039c50 con 0x559396eca130 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 -- 172.21.15.35:0/4283805618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 msgr2=0x559396ec33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ec33d0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f74d80059d0 tx=0x7f74d8004710 comp rx=0 tx=0).stop 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 -- 172.21.15.35:0/4283805618 shutdown_connections 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396ecdf70 0x559396ed5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ec9820 0x559396eda0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/4283805618 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396eca130 0x559396ec33d0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 -- 172.21.15.35:0/4283805618 >> 172.21.15.35:0/4283805618 conn(0x559396d246b0 msgr2=0x559396ede860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:00.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 -- 172.21.15.35:0/4283805618 shutdown_connections 2023-03-17T11:42:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 -- 172.21.15.35:0/4283805618 wait complete. 2023-03-17T11:42:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.888+0000 7f74f8f08b80 1 -- start start 2023-03-17T11:42:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 Processor -- start 2023-03-17T11:42:01.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 0x559396f305e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396eca130 0x559396f30b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ecdf70 0x559396ed80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396ed8790 con 0x559396ec9820 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396ed8900 con 0x559396ecdf70 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559396ed8ac0 con 0x559396eca130 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74f8f08b80 10 client.0 _ll_register_callbacks cb 0x559396cbf230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:42:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 0x559396f305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 0x559396f305e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56650/0 (socket says 172.21.15.35:56650) 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 -- 172.21.15.35:0/1880559162 learned_addr learned my addr 172.21.15.35:0/1880559162 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e6d9d700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ecdf70 0x559396ed80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396eca130 0x559396f30b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 -- 172.21.15.35:0/1880559162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396eca130 msgr2=0x559396f30b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396eca130 0x559396f30b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 -- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ecdf70 msgr2=0x559396ed80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ecdf70 0x559396ed80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 -- 172.21.15.35:0/1880559162 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559396c47d80 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396eca130 0x559396f30b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.889+0000 7f74e659c700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 0x559396f305e0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b2f0 tx=0x7f74d000d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b5ef2d29fed862 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74cdffb700 1 -- 172.21.15.35:0/1880559162 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0098180 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74cdffb700 1 -- 172.21.15.35:0/1880559162 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f74d00982e0 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559396e971e0 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74cdffb700 1 -- 172.21.15.35:0/1880559162 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d0097410 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 10 client.21309 fetch_fsmap learned FSMap version 108 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x559396c30c00 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74cdffb700 1 -- 172.21.15.35:0/1880559162 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d0062020 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74cdffb700 1 -- 172.21.15.35:0/1880559162 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f74d009fda0 con 0x559396ec9820 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 10 client.21309 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 10 client.21309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:42:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 20 client.21309 populate_metadata read hostname 'smithi035' 2023-03-17T11:42:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396f38290 0x559396f3a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:05.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 4 client.21309 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559396c9df00 con 0x559396f38290 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.890+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396f38290 0x559396f3a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.891+0000 7f74cdffb700 10 client.21309 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.891+0000 7f74e5d9b700 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396f38290 0x559396f3a6a0 crc :-1 s=READY pgs=733 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b90e530852a424f8 server_cookie=da04aa75e897183b in_seq=0 out_seq=0 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.899+0000 7f74cdffb700 1 -- 172.21.15.35:0/1880559162 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559396c9df00 con 0x559396f38290 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.899+0000 7f74cdffb700 10 client.21309 handle_command_reply: tid=0 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.899+0000 7f74f8f08b80 1 client.21309 shutdown 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.899+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 msgr2=0x559396f305e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.899+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 0x559396f305e0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b2f0 tx=0x7f74d000d8d0 comp rx=0 tx=0).stop 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 shutdown_connections 2023-03-17T11:42:05.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x559396f38290 0x559396f3a6a0 crc :-1 s=READY pgs=733 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559396ecdf70 0x559396ed80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x559396ec9820 0x559396f305e0 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74cdffb700 0 client.21309 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:42:09.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 --2- 172.21.15.35:0/1880559162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559396eca130 0x559396f30b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:09.738 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T11:42:09.740 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-03-17T11:42:11.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:11 smithi035 ceph-mon[92535]: pgmap v5447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:42:11.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:13 smithi035 ceph-mon[92535]: pgmap v5448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T11:42:11.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:15 smithi035 ceph-mon[92535]: pgmap v5449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T11:42:11.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:17 smithi035 ceph-mon[92535]: pgmap v5450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T11:42:11.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:17 smithi035 ceph-mon[92535]: osdmap e410: 12 total, 12 up, 12 in 2023-03-17T11:42:11.990 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:19 smithi035 ceph-mon[92535]: pgmap v5452: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 927 B/s wr, 12 op/s 2023-03-17T11:42:11.991 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:21 smithi035 ceph-mon[92535]: pgmap v5453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T11:42:13.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:23 smithi035 ceph-mon[92535]: pgmap v5454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:42:14.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:25 smithi035 ceph-mon[92535]: pgmap v5455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:42:14.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:27 smithi035 ceph-mon[92535]: pgmap v5456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:42:14.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:29 smithi035 ceph-mon[92535]: pgmap v5457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 277 B/s wr, 9 op/s 2023-03-17T11:42:14.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:31 smithi035 ceph-mon[92535]: pgmap v5458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:14.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:33 smithi035 ceph-mon[92535]: pgmap v5459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:35 smithi035 ceph-mon[92535]: pgmap v5460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:37 smithi035 ceph-mon[92535]: pgmap v5461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:39 smithi035 ceph-mon[92535]: pgmap v5462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:40 smithi035 ceph-mon[92535]: pgmap v5463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:40 smithi035 ceph-mon[92535]: pgmap v5464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:42 smithi035 ceph-mon[92535]: pgmap v5465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:44 smithi035 ceph-mon[92535]: pgmap v5466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:46 smithi035 ceph-mon[92535]: pgmap v5467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:48 smithi035 ceph-mon[92535]: pgmap v5468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:50 smithi035 ceph-mon[92535]: pgmap v5469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:52 smithi035 ceph-mon[92535]: pgmap v5470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:54 smithi035 ceph-mon[92535]: pgmap v5471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T11:42:14.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:56 smithi035 ceph-mon[92535]: pgmap v5472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:14.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:31:58 smithi035 ceph-mon[92535]: pgmap v5473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:42:14.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:00 smithi035 ceph-mon[92535]: pgmap v5474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:14.779 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:02 smithi035 ceph-mon[92535]: pgmap v5475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:42:16.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:04 smithi035 ceph-mon[92535]: pgmap v5476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:42:16.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:06 smithi035 ceph-mon[92535]: pgmap v5477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:42:16.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:08 smithi035 ceph-mon[92535]: pgmap v5478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:42:16.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:09 smithi035 ceph-mon[92535]: osdmap e411: 12 total, 12 up, 12 in 2023-03-17T11:42:16.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:10 smithi035 ceph-mon[92535]: pgmap v5480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:42:16.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:12 smithi035 ceph-mon[92535]: pgmap v5481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:42:16.490 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:14 smithi035 ceph-mon[92535]: pgmap v5482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:16 smithi035 ceph-mon[92535]: pgmap v5483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:18 smithi035 ceph-mon[92535]: pgmap v5484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:18 smithi035 ceph-mon[92535]: osdmap e412: 12 total, 12 up, 12 in 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:20 smithi035 ceph-mon[92535]: pgmap v5486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:22 smithi035 ceph-mon[92535]: pgmap v5487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:24 smithi035 ceph-mon[92535]: pgmap v5488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:26 smithi035 ceph-mon[92535]: pgmap v5489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:42:17.238 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:28 smithi035 ceph-mon[92535]: pgmap v5490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:42:17.239 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:30 smithi035 ceph-mon[92535]: pgmap v5491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:42:19.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:32 smithi035 ceph-mon[92535]: pgmap v5492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:42:19.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:34 smithi035 ceph-mon[92535]: pgmap v5493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:42:19.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:36 smithi035 ceph-mon[92535]: pgmap v5494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:42:19.366 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:38 smithi035 ceph-mon[92535]: pgmap v5495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:42:19.367 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:39 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:42:22.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:40 smithi035 ceph-mon[92535]: pgmap v5496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:42:22.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:42:22.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:40 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:42:22.527 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:42:22.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:42:22.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:41 smithi035 ceph-mon[92535]: pgmap v5497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:42:22.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:41 smithi035 ceph-mon[92535]: pgmap v5498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:42:22.528 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:42:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:42:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:42:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:42:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:42:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:42:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:42:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:42:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 >> 172.21.15.35:0/1880559162 conn(0x559396d246b0 msgr2=0x559396ec33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 shutdown_connections 2023-03-17T11:42:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 1 -- 172.21.15.35:0/1880559162 wait complete. 2023-03-17T11:42:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74f8f08b80 20 client.21309 trim_cache size 0 max 16384 2023-03-17T11:42:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f74d409f640 msgr2=0x7f74d40a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f74d409f640 0x7f74d40a1af0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f74e81968a0 tx=0x7f74d800b410 comp rx=0 tx=0).stop 2023-03-17T11:42:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 msgr2=0x7f74e8195290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:29.269 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 0x7f74e8195290 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d950 tx=0x7f74d000dc60 comp rx=0 tx=0).stop 2023-03-17T11:42:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 shutdown_connections 2023-03-17T11:42:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f74d409f640 0x7f74d40a1af0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8104390 0x7f74e8199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74e80ff350 0x7f74e8195290 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 --2- 172.21.15.35:0/544358114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74e80ffcf0 0x7f74e81957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 >> 172.21.15.35:0/544358114 conn(0x7f74e8076330 msgr2=0x7f74e80fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 shutdown_connections 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:39.900+0000 7f74ecd7b700 1 -- 172.21.15.35:0/544358114 wait complete. 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 -- 172.21.15.35:0/827346609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ffcf0 msgr2=0x7f88a8103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/827346609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ffcf0 0x7f88a8103cb0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f88980099c0 tx=0x7f8898009cd0 comp rx=0 tx=0).stop 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 -- 172.21.15.35:0/827346609 shutdown_connections 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/827346609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 0x7f88a810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/827346609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ff350 0x7f88a80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/827346609 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ffcf0 0x7f88a8103cb0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 -- 172.21.15.35:0/827346609 >> 172.21.15.35:0/827346609 conn(0x7f88a8076330 msgr2=0x7f88a8076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 -- 172.21.15.35:0/827346609 shutdown_connections 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.022+0000 7f88ae2ef700 1 -- 172.21.15.35:0/827346609 wait complete. 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 Processor -- start 2023-03-17T11:42:34.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 -- start start 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 0x7f88a8100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ffcf0 0x7f88a8101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 0x7f88a81a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8101ac0 con 0x7f88a80ff350 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81a49c0 con 0x7f88a8104390 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88ae2ef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81a4b00 con 0x7f88a80ffcf0 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 0x7f88a8100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.023+0000 7f88a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 0x7f88a8100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56664/0 (socket says 172.21.15.35:56664) 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 -- 172.21.15.35:0/1083104757 learned_addr learned my addr 172.21.15.35:0/1083104757 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ffcf0 0x7f88a8101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88ac88c700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 0x7f88a81a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 -- 172.21.15.35:0/1083104757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ffcf0 msgr2=0x7f88a8101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ffcf0 0x7f88a8101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 -- 172.21.15.35:0/1083104757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 msgr2=0x7f88a81a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:34.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 0x7f88a81a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:34.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 -- 172.21.15.35:0/1083104757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980095f0 con 0x7f88a80ff350 2023-03-17T11:42:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ffcf0 0x7f88a8101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:42:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88ac88c700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 0x7f88a81a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 0x7f88a8100d50 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f889000d980 tx=0x7f889000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a57fa700 1 -- 172.21.15.35:0/1083104757 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000bb60 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a57fa700 1 -- 172.21.15.35:0/1083104757 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8890007640 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a810efc0 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88a57fa700 1 -- 172.21.15.35:0/1083104757 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890004d60 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.024+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a810ee30 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.027+0000 7f88a57fa700 1 -- 172.21.15.35:0/1083104757 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8890004020 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.028+0000 7f88a57fa700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f889409f640 0x7f88940a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.028+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f889409f640 0x7f88940a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.028+0000 7f88a57fa700 1 -- 172.21.15.35:0/1083104757 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88900ca510 con 0x7f88a80ff350 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.028+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f889409f640 0x7f88940a1af0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8898009990 tx=0x7f8898005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.028+0000 7f88ba47cb80 1 Processor -- start 2023-03-17T11:42:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 -- start start 2023-03-17T11:42:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f86442fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8643dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f86344010 con 0x555f8643d960 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f86396950 con 0x555f864434f0 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8638fde0 con 0x555f86442be0 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8643dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8643dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56676/0 (socket says 172.21.15.35:56676) 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 -- 172.21.15.35:0/2255067808 learned_addr learned my addr 172.21.15.35:0/2255067808 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88a7fff700 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f86442fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88a77fe700 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 -- 172.21.15.35:0/2255067808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 msgr2=0x555f86442fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f86442fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 -- 172.21.15.35:0/2255067808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 msgr2=0x555f8643d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 -- 172.21.15.35:0/2255067808 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f862115d0 con 0x555f8643d960 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.029+0000 7f88ac88c700 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8643dd90 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009ca0 tx=0x7f88a0007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c8bc673a6fc364 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f889e7fc700 1 -- 172.21.15.35:0/2255067808 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0014400 con 0x555f8643d960 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f889e7fc700 1 -- 172.21.15.35:0/2255067808 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88a00149f0 con 0x555f8643d960 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f889e7fc700 1 -- 172.21.15.35:0/2255067808 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0013910 con 0x555f8643d960 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2255067808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 msgr2=0x555f8643dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8643dd90 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009ca0 tx=0x7f88a0007500 comp rx=0 tx=0).stop 2023-03-17T11:42:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2255067808 shutdown_connections 2023-03-17T11:42:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8643dd90 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f86442fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2255067808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2255067808 >> 172.21.15.35:0/2255067808 conn(0x555f8629a6b0 msgr2=0x555f86437a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.030+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2255067808 shutdown_connections 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.031+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2255067808 wait complete. 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.031+0000 7f88ba47cb80 1 -- start start 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.031+0000 7f88ba47cb80 1 Processor -- start 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f8643d960 0x555f864493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f86442be0 0x555f86446600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 0x555f86446b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f862138c0 con 0x555f864434f0 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f86447310 con 0x555f86442be0 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f864474d0 con 0x555f8643d960 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ba47cb80 10 client.0 _ll_register_callbacks cb 0x555f86235230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 0x555f86446b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 0x555f86446b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56682/0 (socket says 172.21.15.35:56682) 2023-03-17T11:42:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 -- 172.21.15.35:0/2414365800 learned_addr learned my addr 172.21.15.35:0/2414365800 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88a77fe700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f86442be0 0x555f86446600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88a7fff700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f8643d960 0x555f864493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 -- 172.21.15.35:0/2414365800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f8643d960 msgr2=0x555f864493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f8643d960 0x555f864493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 -- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f86442be0 msgr2=0x555f86446600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f86442be0 0x555f86446600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 -- 172.21.15.35:0/2414365800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a0009900 con 0x555f864434f0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88ac88c700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 0x555f86446b80 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f88a00093e0 tx=0x7f88a0004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c40c76410c2d1a8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.032+0000 7f88877fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88877fe700 1 -- 172.21.15.35:0/2414365800 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0014990 con 0x555f864434f0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88877fe700 1 -- 172.21.15.35:0/2414365800 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88a0014af0 con 0x555f864434f0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f86352390 con 0x555f864434f0 2023-03-17T11:42:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88877fe700 1 -- 172.21.15.35:0/2414365800 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88a0014cb0 con 0x555f864434f0 2023-03-17T11:42:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 10 client.21321 fetch_fsmap learned FSMap version 108 2023-03-17T11:42:42.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x555f861bdd80 con 0x555f864434f0 2023-03-17T11:42:42.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88877fe700 1 -- 172.21.15.35:0/2414365800 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f86352390 con 0x555f864434f0 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88877fe700 1 -- 172.21.15.35:0/2414365800 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f88a0005160 con 0x555f864434f0 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 10 client.21321 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 10 client.21321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 20 client.21321 populate_metadata read hostname 'smithi035' 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f86456f60 0x555f86459370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 4 client.21321 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f8635e600 con 0x555f86456f60 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.033+0000 7f88a7fff700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f86456f60 0x555f86459370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.034+0000 7f88877fe700 10 client.21321 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.034+0000 7f88a7fff700 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f86456f60 0x555f86459370 crc :-1 s=READY pgs=738 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30105c46c3f3b620 server_cookie=93287f2f42cc74b9 in_seq=0 out_seq=0 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.034+0000 7f88877fe700 1 -- 172.21.15.35:0/2414365800 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x555f8635e600 con 0x555f86456f60 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.034+0000 7f88877fe700 10 client.21321 handle_command_reply: tid=0 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 client.21321 shutdown 2023-03-17T11:42:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 msgr2=0x555f86446b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 0x555f86446b80 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f88a00093e0 tx=0x7f88a0004f20 comp rx=0 tx=0).stop 2023-03-17T11:42:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 shutdown_connections 2023-03-17T11:42:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f86456f60 0x555f86459370 crc :-1 s=READY pgs=738 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f864434f0 0x555f86446b80 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:43.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f8643d960 0x555f864493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88877fe700 0 client.21321 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:42:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/2414365800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f86442be0 0x555f86446600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 >> 172.21.15.35:0/2414365800 conn(0x555f8629a6b0 msgr2=0x555f86437a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 shutdown_connections 2023-03-17T11:42:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 1 -- 172.21.15.35:0/2414365800 wait complete. 2023-03-17T11:42:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.035+0000 7f88ba47cb80 20 client.21321 trim_cache size 0 max 16384 2023-03-17T11:42:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 Processor -- start 2023-03-17T11:42:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 -- start start 2023-03-17T11:42:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f8643d960 0x555f8643d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 0x555f86437ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f864434f0 0x555f8644df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f86352390 con 0x555f86442be0 2023-03-17T11:42:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f864330f0 con 0x555f8643d960 2023-03-17T11:42:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f86443360 con 0x555f864434f0 2023-03-17T11:42:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 0x555f86437ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 0x555f86437ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56688/0 (socket says 172.21.15.35:56688) 2023-03-17T11:42:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 -- 172.21.15.35:0/1968022522 learned_addr learned my addr 172.21.15.35:0/1968022522 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f8643d960 0x555f8643d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ac88c700 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f864434f0 0x555f8644df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 -- 172.21.15.35:0/1968022522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f864434f0 msgr2=0x555f8644df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f864434f0 0x555f8644df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 -- 172.21.15.35:0/1968022522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f8643d960 msgr2=0x555f8643d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f8643d960 0x555f8643d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88a77fe700 1 -- 172.21.15.35:0/1968022522 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f86356130 con 0x555f86442be0 2023-03-17T11:42:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.050+0000 7f88ac88c700 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f864434f0 0x555f8644df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:42:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 0x555f86437ac0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f8898015000 tx=0x7f889801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0472ad7df9b92f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:46.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:43 smithi035 ceph-mon[92535]: pgmap v5499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:42:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f889effd700 1 -- 172.21.15.35:0/1968022522 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889802b040 con 0x555f86442be0 2023-03-17T11:42:47.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f889effd700 1 -- 172.21.15.35:0/1968022522 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f889802c040 con 0x555f86442be0 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f889effd700 1 -- 172.21.15.35:0/1968022522 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898003820 con 0x555f86442be0 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1968022522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 msgr2=0x555f86437ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 0x555f86437ac0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f8898015000 tx=0x7f889801f000 comp rx=0 tx=0).stop 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1968022522 shutdown_connections 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f864434f0 0x555f8644df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f8643d960 0x555f8643d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1968022522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f86442be0 0x555f86437ac0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1968022522 >> 172.21.15.35:0/1968022522 conn(0x555f8629a6b0 msgr2=0x555f864438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1968022522 shutdown_connections 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.051+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1968022522 wait complete. 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 -- start start 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 Processor -- start 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8644df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f8643e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:47.171 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8643f0c0 con 0x555f8643d960 2023-03-17T11:42:47.172 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8643f230 con 0x555f864434f0 2023-03-17T11:42:47.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.052+0000 7f88ba47cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8643f3f0 con 0x555f86442be0 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88ba47cb80 10 client.0 _ll_register_callbacks cb 0x555f86235230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8644df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8644df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56692/0 (socket says 172.21.15.35:56692) 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 -- 172.21.15.35:0/1146014559 learned_addr learned my addr 172.21.15.35:0/1146014559 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f8643e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88ac88c700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 -- 172.21.15.35:0/1146014559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 msgr2=0x555f8643e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f8643e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 -- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 msgr2=0x555f8643eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 -- 172.21.15.35:0/1146014559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a810c7a0 con 0x555f8643d960 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88ac88c700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f8643e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88a7fff700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8644df80 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f8890000c00 tx=0x7f88900a0150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed88069ec4b8cb19 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88877fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:42:48.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88877fe700 1 -- 172.21.15.35:0/1146014559 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88900c80d0 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88877fe700 1 -- 172.21.15.35:0/1146014559 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f88900983c0 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f8640d1e0 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88877fe700 1 -- 172.21.15.35:0/1146014559 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8890097450 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88ba47cb80 10 client.21327 fetch_fsmap learned FSMap version 108 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.053+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x555f861e41f0 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88877fe700 1 -- 172.21.15.35:0/1146014559 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8890064080 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88877fe700 1 -- 172.21.15.35:0/1146014559 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8890093d50 con 0x555f8643d960 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88ba47cb80 10 client.21327 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88ba47cb80 10 client.21327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88ba47cb80 20 client.21327 populate_metadata read hostname 'smithi035' 2023-03-17T11:42:48.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f864ac0f0 0x555f864ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88ba47cb80 4 client.21327 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555f86213f00 con 0x555f864ac0f0 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f864ac0f0 0x555f864ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88877fe700 10 client.21327 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.054+0000 7f88a77fe700 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f864ac0f0 0x555f864ae500 crc :-1 s=READY pgs=739 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d1115eb253612 server_cookie=6f70a03c588f018b in_seq=0 out_seq=0 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88877fe700 1 -- 172.21.15.35:0/1146014559 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555f86213f00 con 0x555f864ac0f0 2023-03-17T11:42:48.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88877fe700 10 client.21327 handle_command_reply: tid=0 2023-03-17T11:42:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 client.21327 shutdown 2023-03-17T11:42:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 msgr2=0x555f8644df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8644df80 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f8890000c00 tx=0x7f88900a0150 comp rx=0 tx=0).stop 2023-03-17T11:42:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 shutdown_connections 2023-03-17T11:42:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x555f864ac0f0 0x555f864ae500 crc :-1 s=READY pgs=739 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555f864434f0 0x555f8643eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88877fe700 0 client.21327 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:42:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x555f8643d960 0x555f8644df80 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 --2- 172.21.15.35:0/1146014559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555f86442be0 0x555f8643e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 >> 172.21.15.35:0/1146014559 conn(0x555f8629a6b0 msgr2=0x555f86444150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 shutdown_connections 2023-03-17T11:42:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 1 -- 172.21.15.35:0/1146014559 wait complete. 2023-03-17T11:42:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.066+0000 7f88ba47cb80 20 client.21327 trim_cache size 0 max 16384 2023-03-17T11:42:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f889409f640 msgr2=0x7f88940a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f889409f640 0x7f88940a1af0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8898009990 tx=0x7f8898005fb0 comp rx=0 tx=0).stop 2023-03-17T11:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 msgr2=0x7f88a8100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 0x7f88a8100d50 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f889000d980 tx=0x7f889000dd40 comp rx=0 tx=0).stop 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 shutdown_connections 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f889409f640 0x7f88940a1af0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88a8104390 0x7f88a81a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f88a80ff350 0x7f88a8100d50 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 --2- 172.21.15.35:0/1083104757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88a80ffcf0 0x7f88a8101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 >> 172.21.15.35:0/1083104757 conn(0x7f88a8076330 msgr2=0x7f88a80680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 shutdown_connections 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:17:53.067+0000 7f88ae2ef700 1 -- 172.21.15.35:0/1083104757 wait complete. 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 -- 172.21.15.35:0/271630636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff00ffcf0 msgr2=0x7f0ff0103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:53.626 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 --2- 172.21.15.35:0/271630636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff00ffcf0 0x7f0ff0103cb0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40099c0 tx=0x7f0fe4009cd0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 -- 172.21.15.35:0/271630636 shutdown_connections 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 --2- 172.21.15.35:0/271630636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff0104390 0x7f0ff010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 --2- 172.21.15.35:0/271630636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff00ff350 0x7f0ff00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 --2- 172.21.15.35:0/271630636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff00ffcf0 0x7f0ff0103cb0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 -- 172.21.15.35:0/271630636 >> 172.21.15.35:0/271630636 conn(0x7f0ff0076330 msgr2=0x7f0ff0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 -- 172.21.15.35:0/271630636 shutdown_connections 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.189+0000 7f0ff620f700 1 -- 172.21.15.35:0/271630636 wait complete. 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 Processor -- start 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 -- start start 2023-03-17T11:42:53.627 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff00ff350 0x7f0ff0195180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff00ffcf0 0x7f0ff01956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 0x7f0ff0199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff019a160 con 0x7f0ff0104390 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff019a2d0 con 0x7f0ff00ff350 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.190+0000 7f0ff620f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff019a490 con 0x7f0ff00ffcf0 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 0x7f0ff0199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:53.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 0x7f0ff0199b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56710/0 (socket says 172.21.15.35:56710) 2023-03-17T11:42:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 -- 172.21.15.35:0/1549648152 learned_addr learned my addr 172.21.15.35:0/1549648152 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:42:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff00ff350 0x7f0ff0195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feeffd700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff00ffcf0 0x7f0ff01956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 -- 172.21.15.35:0/1549648152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff00ffcf0 msgr2=0x7f0ff01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff00ffcf0 0x7f0ff01956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 -- 172.21.15.35:0/1549648152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff00ff350 msgr2=0x7f0ff0195180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:42:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff00ff350 0x7f0ff0195180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:42:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 -- 172.21.15.35:0/1549648152 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe40095f0 con 0x7f0ff0104390 2023-03-17T11:42:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff00ff350 0x7f0ff0195180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:42:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0feffff700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 0x7f0ff0199b20 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800ef30 tx=0x7f0fe800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:42:57.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0fecff9700 1 -- 172.21.15.35:0/1549648152 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8018070 con 0x7f0ff0104390 2023-03-17T11:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0fecff9700 1 -- 172.21.15.35:0/1549648152 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fe800f040 con 0x7f0ff0104390 2023-03-17T11:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff010f010 con 0x7f0ff0104390 2023-03-17T11:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0fecff9700 1 -- 172.21.15.35:0/1549648152 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800cbc0 con 0x7f0ff0104390 2023-03-17T11:42:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.191+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff010ee80 con 0x7f0ff0104390 2023-03-17T11:42:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.194+0000 7f0fecff9700 1 -- 172.21.15.35:0/1549648152 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f0fe800cd80 con 0x7f0ff0104390 2023-03-17T11:42:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.194+0000 7f0fecff9700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0fd809f640 0x7f0fd80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:42:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f0fecff9700 1 -- 172.21.15.35:0/1549648152 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0fe80ca110 con 0x7f0ff0104390 2023-03-17T11:42:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0fd809f640 0x7f0fd80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:42:59.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 Processor -- start 2023-03-17T11:43:00.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0fd809f640 0x7f0fd80a1af0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0011490 tx=0x7f0fe0009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:00.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 -- start start 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a025b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a02660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a02689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a0161010 con 0x55f2a025ade0 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a01b3950 con 0x55f2a025b6f0 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f100239cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a01acde0 con 0x55f2a02665e0 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a025b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a025b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56714/0 (socket says 172.21.15.35:56714) 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.195+0000 7f0fef7fe700 1 -- 172.21.15.35:0/1772792788 learned_addr learned my addr 172.21.15.35:0/1772792788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0feffff700 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a02689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0feeffd700 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a02660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fef7fe700 1 -- 172.21.15.35:0/1772792788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 msgr2=0x55f2a02689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a02689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fef7fe700 1 -- 172.21.15.35:0/1772792788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 msgr2=0x55f2a02660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a02660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fef7fe700 1 -- 172.21.15.35:0/1772792788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a002e5d0 con 0x55f2a025ade0 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0feeffd700 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a02660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:43:02.142 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a025b1b0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00043c0 tx=0x7f0fe0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a416b4150cc447d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fd5ffb700 1 -- 172.21.15.35:0/1772792788 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0003d10 con 0x55f2a025ade0 2023-03-17T11:43:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fd5ffb700 1 -- 172.21.15.35:0/1772792788 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fe0003e70 con 0x55f2a025ade0 2023-03-17T11:43:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.196+0000 7f0fd5ffb700 1 -- 172.21.15.35:0/1772792788 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe001e710 con 0x55f2a025ade0 2023-03-17T11:43:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 -- 172.21.15.35:0/1772792788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 msgr2=0x55f2a025b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a025b1b0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00043c0 tx=0x7f0fe0014000 comp rx=0 tx=0).stop 2023-03-17T11:43:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 -- 172.21.15.35:0/1772792788 shutdown_connections 2023-03-17T11:43:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a02689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a025b1b0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 --2- 172.21.15.35:0/1772792788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a02660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 -- 172.21.15.35:0/1772792788 >> 172.21.15.35:0/1772792788 conn(0x55f2a00b76b0 msgr2=0x55f2a02578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:07.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 -- 172.21.15.35:0/1772792788 shutdown_connections 2023-03-17T11:43:07.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 -- 172.21.15.35:0/1772792788 wait complete. 2023-03-17T11:43:07.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.197+0000 7f100239cb80 1 -- start start 2023-03-17T11:43:07.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 Processor -- start 2023-03-17T11:43:07.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a0263420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:07.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a0263960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a0263ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a00308c0 con 0x55f2a025ade0 2023-03-17T11:43:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a0272210 con 0x55f2a025b6f0 2023-03-17T11:43:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a0272350 con 0x55f2a02665e0 2023-03-17T11:43:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f100239cb80 10 client.0 _ll_register_callbacks cb 0x55f2a0052230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:43:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a0263420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a0263420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56720/0 (socket says 172.21.15.35:56720) 2023-03-17T11:43:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 -- 172.21.15.35:0/538074776 learned_addr learned my addr 172.21.15.35:0/538074776 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:08.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:45 smithi035 ceph-mon[92535]: pgmap v5500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:43:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0feeffd700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a0263960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0feffff700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a0263ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 -- 172.21.15.35:0/538074776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 msgr2=0x55f2a0263ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a0263ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 -- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 msgr2=0x55f2a0263960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a0263960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.198+0000 7f0fef7fe700 1 -- 172.21.15.35:0/538074776 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe0017070 con 0x55f2a025ade0 2023-03-17T11:43:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a0263420 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00097c0 tx=0x7f0fe00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec2db077a6b8b3e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fceffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:43:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fceffd700 1 -- 172.21.15.35:0/538074776 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe002b070 con 0x55f2a025ade0 2023-03-17T11:43:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fceffd700 1 -- 172.21.15.35:0/538074776 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0fe0026770 con 0x55f2a025ade0 2023-03-17T11:43:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2a016f390 con 0x55f2a025ade0 2023-03-17T11:43:12.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fceffd700 1 -- 172.21.15.35:0/538074776 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fe0026930 con 0x55f2a025ade0 2023-03-17T11:43:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 10 client.21339 fetch_fsmap learned FSMap version 108 2023-03-17T11:43:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55f29ffdad80 con 0x55f2a025ade0 2023-03-17T11:43:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fceffd700 1 -- 172.21.15.35:0/538074776 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f2a016f390 con 0x55f2a025ade0 2023-03-17T11:43:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f0fceffd700 1 -- 172.21.15.35:0/538074776 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0fe0024020 con 0x55f2a025ade0 2023-03-17T11:43:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 10 client.21339 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 10 client.21339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 20 client.21339 populate_metadata read hostname 'smithi035' 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a0276350 0x55f2a0278730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 4 client.21339 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.199+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2a017b600 con 0x55f2a0276350 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.200+0000 7f0feeffd700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a0276350 0x55f2a0278730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.200+0000 7f0feeffd700 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a0276350 0x55f2a0278730 crc :-1 s=READY pgs=740 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed5f16984610158e server_cookie=a35f8b131dcba143 in_seq=0 out_seq=0 2023-03-17T11:43:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.200+0000 7f0fceffd700 10 client.21339 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f0fceffd700 1 -- 172.21.15.35:0/538074776 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f2a017b600 con 0x55f2a0276350 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f0fceffd700 10 client.21339 handle_command_reply: tid=0 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 client.21339 shutdown 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 msgr2=0x55f2a0263420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a0263420 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00097c0 tx=0x7f0fe00057b0 comp rx=0 tx=0).stop 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 shutdown_connections 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a0276350 0x55f2a0278730 crc :-1 s=READY pgs=740 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a02665e0 0x55f2a0263ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f0fceffd700 0 client.21339 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a0263420 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 --2- 172.21.15.35:0/538074776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a025b6f0 0x55f2a0263960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 >> 172.21.15.35:0/538074776 conn(0x55f2a00b76b0 msgr2=0x55f2a025cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 shutdown_connections 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 1 -- 172.21.15.35:0/538074776 wait complete. 2023-03-17T11:43:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.201+0000 7f100239cb80 20 client.21339 trim_cache size 0 max 16384 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 Processor -- start 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 -- start start 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a026d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025b6f0 0x55f2a0253ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a0253ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a02500f0 con 0x55f2a025ade0 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a025c050 con 0x55f2a02665e0 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f100239cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a025baf0 con 0x55f2a025b6f0 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a026d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:16.100 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a026d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56728/0 (socket says 172.21.15.35:56728) 2023-03-17T11:43:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 -- 172.21.15.35:0/2041974344 learned_addr learned my addr 172.21.15.35:0/2041974344 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0feffff700 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a0253ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0feeffd700 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025b6f0 0x55f2a0253ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 -- 172.21.15.35:0/2041974344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025b6f0 msgr2=0x55f2a0253ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:17.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025b6f0 0x55f2a0253ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:17.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 -- 172.21.15.35:0/2041974344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 msgr2=0x55f2a0253ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:17.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a0253ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.216+0000 7f0fef7fe700 1 -- 172.21.15.35:0/2041974344 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2a0173130 con 0x55f2a025ade0 2023-03-17T11:43:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a026d160 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0030eb0 tx=0x7f0fe0011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0942acedcbf0f27 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f0fd67fc700 1 -- 172.21.15.35:0/2041974344 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe002b070 con 0x55f2a025ade0 2023-03-17T11:43:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f0fd67fc700 1 -- 172.21.15.35:0/2041974344 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fe0026c00 con 0x55f2a025ade0 2023-03-17T11:43:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f0fd67fc700 1 -- 172.21.15.35:0/2041974344 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0030b50 con 0x55f2a025ade0 2023-03-17T11:43:22.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 -- 172.21.15.35:0/2041974344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 msgr2=0x55f2a026d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:22.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a026d160 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0030eb0 tx=0x7f0fe0011be0 comp rx=0 tx=0).stop 2023-03-17T11:43:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 -- 172.21.15.35:0/2041974344 shutdown_connections 2023-03-17T11:43:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a0253ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025ade0 0x55f2a026d160 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 --2- 172.21.15.35:0/2041974344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025b6f0 0x55f2a0253ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 -- 172.21.15.35:0/2041974344 >> 172.21.15.35:0/2041974344 conn(0x55f2a00b76b0 msgr2=0x55f2a0257400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 -- 172.21.15.35:0/2041974344 shutdown_connections 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.217+0000 7f100239cb80 1 -- 172.21.15.35:0/2041974344 wait complete. 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 -- start start 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 Processor -- start 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025ade0 0x55f2a02c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 0x55f2a02c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a02be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a02be830 con 0x55f2a025b6f0 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a02be9a0 con 0x55f2a02665e0 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2a02beb60 con 0x55f2a025ade0 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f100239cb80 10 client.0 _ll_register_callbacks cb 0x55f2a0052230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f0feeffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 0x55f2a02c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f0feeffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 0x55f2a02c2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56736/0 (socket says 172.21.15.35:56736) 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f0feeffd700 1 -- 172.21.15.35:0/3914592883 learned_addr learned my addr 172.21.15.35:0/3914592883 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.218+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025ade0 0x55f2a02c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feffff700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a02be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feeffd700 1 -- 172.21.15.35:0/3914592883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025ade0 msgr2=0x55f2a02c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feeffd700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025ade0 0x55f2a02c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feeffd700 1 -- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 msgr2=0x55f2a02be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feeffd700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a02be120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feeffd700 1 -- 172.21.15.35:0/3914592883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f29ffdad80 con 0x55f2a025b6f0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feffff700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a02be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0feeffd700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 0x55f2a02c2a20 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f0ff01000c0 tx=0x7f0fe40054c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1364d25e330367c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0fceffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0fceffd700 1 -- 172.21.15.35:0/3914592883 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40270d0 con 0x55f2a025b6f0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0fceffd700 1 -- 172.21.15.35:0/3914592883 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(381..381 src has 1..381) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f0fe4027230 con 0x55f2a025b6f0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2a022a1e0 con 0x55f2a025b6f0 2023-03-17T11:43:24.221 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0fceffd700 1 -- 172.21.15.35:0/3914592883 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fe4027410 con 0x55f2a025b6f0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f100239cb80 10 client.21345 fetch_fsmap learned FSMap version 108 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55f2a00011f0 con 0x55f2a025b6f0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.219+0000 7f0fceffd700 1 -- 172.21.15.35:0/3914592883 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f2a022a1e0 con 0x55f2a025b6f0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f0fceffd700 1 -- 172.21.15.35:0/3914592883 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f0fe400b6d0 con 0x55f2a025b6f0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f100239cb80 10 client.21345 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f100239cb80 10 client.21345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f100239cb80 20 client.21345 populate_metadata read hostname 'smithi035' 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f100239cb80 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a02cb440 0x55f2a02cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f100239cb80 4 client.21345 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f2a0030f00 con 0x55f2a02cb440 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a02cb440 0x55f2a02cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f0fceffd700 10 client.21345 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.220+0000 7f0fef7fe700 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a02cb440 0x55f2a02cd850 crc :-1 s=READY pgs=741 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd500f20b118def server_cookie=95634959fd3ea6cb in_seq=0 out_seq=0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f0fceffd700 1 -- 172.21.15.35:0/3914592883 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f2a0030f00 con 0x55f2a02cb440 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f0fceffd700 10 client.21345 handle_command_reply: tid=0 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 client.21345 shutdown 2023-03-17T11:43:24.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 msgr2=0x55f2a02c2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 0x55f2a02c2a20 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f0ff01000c0 tx=0x7f0fe40054c0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 shutdown_connections 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f2a02cb440 0x55f2a02cd850 crc :-1 s=READY pgs=741 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2a02665e0 0x55f2a02be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f0fceffd700 0 client.21345 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f2a025ade0 0x55f2a02c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 --2- 172.21.15.35:0/3914592883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f2a025b6f0 0x55f2a02c2a20 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:24.223 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 >> 172.21.15.35:0/3914592883 conn(0x55f2a00b76b0 msgr2=0x55f2a0253ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 shutdown_connections 2023-03-17T11:43:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 1 -- 172.21.15.35:0/3914592883 wait complete. 2023-03-17T11:43:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.238+0000 7f100239cb80 20 client.21345 trim_cache size 0 max 16384 2023-03-17T11:43:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0fd809f640 msgr2=0x7f0fd80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0fd809f640 0x7f0fd80a1af0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0011490 tx=0x7f0fe0009260 comp rx=0 tx=0).stop 2023-03-17T11:43:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 msgr2=0x7f0ff0199b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 0x7f0ff0199b20 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800ef30 tx=0x7f0fe800c3a0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 shutdown_connections 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f0fd809f640 0x7f0fd80a1af0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f0ff0104390 0x7f0ff0199b20 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ff00ff350 0x7f0ff0195180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 --2- 172.21.15.35:0/1549648152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ff00ffcf0 0x7f0ff01956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 >> 172.21.15.35:0/1549648152 conn(0x7f0ff0076330 msgr2=0x7f0ff00fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 shutdown_connections 2023-03-17T11:43:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:18:06.239+0000 7f0ff620f700 1 -- 172.21.15.35:0/1549648152 wait complete. 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.147+0000 7f127abd3700 1 -- 172.21.15.35:0/300169356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f12740ff350 msgr2=0x7f12740ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.147+0000 7f127abd3700 1 --2- 172.21.15.35:0/300169356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f12740ff350 0x7f12740ff720 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f12680099c0 tx=0x7f1268009cd0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 -- 172.21.15.35:0/300169356 shutdown_connections 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 --2- 172.21.15.35:0/300169356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1274104390 0x7f127410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 --2- 172.21.15.35:0/300169356 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f12740ff350 0x7f12740ff720 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 --2- 172.21.15.35:0/300169356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12740ffcf0 0x7f1274103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 -- 172.21.15.35:0/300169356 >> 172.21.15.35:0/300169356 conn(0x7f1274076330 msgr2=0x7f1274076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 -- 172.21.15.35:0/300169356 shutdown_connections 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 -- 172.21.15.35:0/300169356 wait complete. 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.148+0000 7f127abd3700 1 Processor -- start 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 -- start start 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12740ff350 0x7f12741984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12740ffcf0 0x7f12741989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 0x7f127419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127419d490 con 0x7f1274104390 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127419d600 con 0x7f12740ffcf0 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127abd3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127419d7c0 con 0x7f12740ff350 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 0x7f127419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 0x7f127419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56754/0 (socket says 172.21.15.35:56754) 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 -- 172.21.15.35:0/901564526 learned_addr learned my addr 172.21.15.35:0/901564526 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1273fff700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12740ffcf0 0x7f12741989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f127896f700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12740ff350 0x7f12741984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 -- 172.21.15.35:0/901564526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12740ff350 msgr2=0x7f12741984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12740ff350 0x7f12741984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 -- 172.21.15.35:0/901564526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12740ffcf0 msgr2=0x7f12741989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12740ffcf0 0x7f12741989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:26.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:47 smithi035 ceph-mon[92535]: pgmap v5501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T11:43:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.149+0000 7f1279170700 1 -- 172.21.15.35:0/901564526 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680095f0 con 0x7f1274104390 2023-03-17T11:43:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.150+0000 7f1279170700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 0x7f127419ce50 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f126c007ee0 tx=0x7f126c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.150+0000 7f1271ffb700 1 -- 172.21.15.35:0/901564526 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c017070 con 0x7f1274104390 2023-03-17T11:43:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.150+0000 7f1271ffb700 1 -- 172.21.15.35:0/901564526 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f126c00f040 con 0x7f1274104390 2023-03-17T11:43:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.150+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127410f050 con 0x7f1274104390 2023-03-17T11:43:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.150+0000 7f1271ffb700 1 -- 172.21.15.35:0/901564526 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c005710 con 0x7f1274104390 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.150+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127410eec0 con 0x7f1274104390 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.152+0000 7f1271ffb700 1 -- 172.21.15.35:0/901564526 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f126c005870 con 0x7f1274104390 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.153+0000 7f1271ffb700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f126409f6c0 0x7f12640a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.153+0000 7f1271ffb700 1 -- 172.21.15.35:0/901564526 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f126c0c9d30 con 0x7f1274104390 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.153+0000 7f127896f700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f126409f6c0 0x7f12640a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.153+0000 7f127896f700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f126409f6c0 0x7f12640a1b70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1268000c00 tx=0x7f126801a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 Processor -- start 2023-03-17T11:43:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 -- start start 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 0x5653b2a1afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1b4f0 0x5653b2a15420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a15960 0x5653b2a15d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b291c010 con 0x5653b2a1abe0 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b296e950 con 0x5653b2a15960 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1286d60b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2967de0 con 0x5653b2a1b4f0 2023-03-17T11:43:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f127896f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 0x5653b2a1afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f127896f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 0x5653b2a1afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56758/0 (socket says 172.21.15.35:56758) 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f127896f700 1 -- 172.21.15.35:0/2437519963 learned_addr learned my addr 172.21.15.35:0/2437519963 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.154+0000 7f1279170700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a15960 0x5653b2a15d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f1273fff700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1b4f0 0x5653b2a15420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f127896f700 1 -- 172.21.15.35:0/2437519963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1b4f0 msgr2=0x5653b2a15420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f127896f700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1b4f0 0x5653b2a15420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f127896f700 1 -- 172.21.15.35:0/2437519963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a15960 msgr2=0x5653b2a15d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f127896f700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a15960 0x5653b2a15d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f127896f700 1 -- 172.21.15.35:0/2437519963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653b27e95d0 con 0x5653b2a1abe0 2023-03-17T11:43:28.787 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f1273fff700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1b4f0 0x5653b2a15420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:43:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f1279170700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a15960 0x5653b2a15d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:43:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f127896f700 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 0x5653b2a1afb0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f12680099c0 tx=0x7f126801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28965c40ace0eb1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f125effd700 1 -- 172.21.15.35:0/2437519963 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126801d040 con 0x5653b2a1abe0 2023-03-17T11:43:28.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f125effd700 1 -- 172.21.15.35:0/2437519963 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1268029040 con 0x5653b2a1abe0 2023-03-17T11:43:29.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.155+0000 7f125effd700 1 -- 172.21.15.35:0/2437519963 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268023b80 con 0x5653b2a1abe0 2023-03-17T11:43:29.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 -- 172.21.15.35:0/2437519963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 msgr2=0x5653b2a1afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:29.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 0x5653b2a1afb0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f12680099c0 tx=0x7f126801e000 comp rx=0 tx=0).stop 2023-03-17T11:43:29.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 -- 172.21.15.35:0/2437519963 shutdown_connections 2023-03-17T11:43:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a15960 0x5653b2a15d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1abe0 0x5653b2a1afb0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 --2- 172.21.15.35:0/2437519963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1b4f0 0x5653b2a15420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 -- 172.21.15.35:0/2437519963 >> 172.21.15.35:0/2437519963 conn(0x5653b28726b0 msgr2=0x5653b2a0fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 -- 172.21.15.35:0/2437519963 shutdown_connections 2023-03-17T11:43:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 -- 172.21.15.35:0/2437519963 wait complete. 2023-03-17T11:43:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 -- start start 2023-03-17T11:43:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.156+0000 7f1286d60b80 1 Processor -- start 2023-03-17T11:43:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a21400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a1e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a1ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b27eb8c0 con 0x5653b2a15960 2023-03-17T11:43:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a1f340 con 0x5653b2a1b4f0 2023-03-17T11:43:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a1f500 con 0x5653b2a1abe0 2023-03-17T11:43:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1286d60b80 10 client.0 _ll_register_callbacks cb 0x5653b280d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:43:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a21400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a21400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56764/0 (socket says 172.21.15.35:56764) 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 -- 172.21.15.35:0/952166872 learned_addr learned my addr 172.21.15.35:0/952166872 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1279170700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a1ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1273fff700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a1e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 -- 172.21.15.35:0/952166872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 msgr2=0x5653b2a1e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a1e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 -- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 msgr2=0x5653b2a1ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a1ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:33.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 -- 172.21.15.35:0/952166872 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127410c7a0 con 0x5653b2a15960 2023-03-17T11:43:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1273fff700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a1e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:43:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f127896f700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a21400 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f1268009d10 tx=0x7f126800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553283e97a1e4ae server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1253fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:43:33.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.157+0000 7f1253fff700 1 -- 172.21.15.35:0/952166872 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268005450 con 0x5653b2a15960 2023-03-17T11:43:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1253fff700 1 -- 172.21.15.35:0/952166872 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f12680055b0 con 0x5653b2a15960 2023-03-17T11:43:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653b292a390 con 0x5653b2a15960 2023-03-17T11:43:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1253fff700 1 -- 172.21.15.35:0/952166872 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12680235c0 con 0x5653b2a15960 2023-03-17T11:43:35.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 10 client.21357 fetch_fsmap learned FSMap version 108 2023-03-17T11:43:35.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5653b2795d80 con 0x5653b2a15960 2023-03-17T11:43:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1253fff700 1 -- 172.21.15.35:0/952166872 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653b292a390 con 0x5653b2a15960 2023-03-17T11:43:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1253fff700 1 -- 172.21.15.35:0/952166872 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f126802c070 con 0x5653b2a15960 2023-03-17T11:43:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 10 client.21357 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:43:35.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 10 client.21357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:43:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 20 client.21357 populate_metadata read hostname 'smithi035' 2023-03-17T11:43:35.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a2eb10 0x5653b2a30f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 4 client.21357 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:43:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653b2936600 con 0x5653b2a2eb10 2023-03-17T11:43:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.158+0000 7f1273fff700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a2eb10 0x5653b2a30f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.159+0000 7f1253fff700 10 client.21357 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.159+0000 7f1273fff700 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a2eb10 0x5653b2a30f20 crc :-1 s=READY pgs=742 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73208444eb4de87 server_cookie=892b56f1d4070e8d in_seq=0 out_seq=0 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.159+0000 7f1253fff700 1 -- 172.21.15.35:0/952166872 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5653b2936600 con 0x5653b2a2eb10 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.159+0000 7f1253fff700 10 client.21357 handle_command_reply: tid=0 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.159+0000 7f1286d60b80 1 client.21357 shutdown 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 msgr2=0x5653b2a21400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a21400 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f1268009d10 tx=0x7f126800fbf0 comp rx=0 tx=0).stop 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 shutdown_connections 2023-03-17T11:43:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a2eb10 0x5653b2a30f20 crc :-1 s=READY pgs=742 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a1ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a21400 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 --2- 172.21.15.35:0/952166872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a1e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1253fff700 0 client.21357 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 >> 172.21.15.35:0/952166872 conn(0x5653b28726b0 msgr2=0x5653b2a14410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 shutdown_connections 2023-03-17T11:43:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 1 -- 172.21.15.35:0/952166872 wait complete. 2023-03-17T11:43:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.160+0000 7f1286d60b80 20 client.21357 trim_cache size 0 max 16384 2023-03-17T11:43:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 Processor -- start 2023-03-17T11:43:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 -- start start 2023-03-17T11:43:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a0fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a25f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a20f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:38.110 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a191b0 con 0x5653b2a15960 2023-03-17T11:43:39.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a1f620 con 0x5653b2a1b4f0 2023-03-17T11:43:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1286d60b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a113d0 con 0x5653b2a1abe0 2023-03-17T11:43:39.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a0fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a0fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56772/0 (socket says 172.21.15.35:56772) 2023-03-17T11:43:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 -- 172.21.15.35:0/3365890784 learned_addr learned my addr 172.21.15.35:0/3365890784 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1273fff700 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a25f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1279170700 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a20f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 -- 172.21.15.35:0/3365890784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 msgr2=0x5653b2a25f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a25f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 -- 172.21.15.35:0/3365890784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 msgr2=0x5653b2a20f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a20f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 -- 172.21.15.35:0/3365890784 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653b292e130 con 0x5653b2a15960 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f1273fff700 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a25f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.175+0000 7f127896f700 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a0fac0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f126800f7c0 tx=0x7f1268036420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe191030469cc67 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f125f7fe700 1 -- 172.21.15.35:0/3365890784 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126801d040 con 0x5653b2a15960 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f125f7fe700 1 -- 172.21.15.35:0/3365890784 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1268029070 con 0x5653b2a15960 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f125f7fe700 1 -- 172.21.15.35:0/3365890784 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268036e70 con 0x5653b2a15960 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 -- 172.21.15.35:0/3365890784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 msgr2=0x5653b2a0fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a0fac0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f126800f7c0 tx=0x7f1268036420 comp rx=0 tx=0).stop 2023-03-17T11:43:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 -- 172.21.15.35:0/3365890784 shutdown_connections 2023-03-17T11:43:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1b4f0 0x5653b2a20f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a15960 0x5653b2a0fac0 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 --2- 172.21.15.35:0/3365890784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a1abe0 0x5653b2a25f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 -- 172.21.15.35:0/3365890784 >> 172.21.15.35:0/3365890784 conn(0x5653b28726b0 msgr2=0x5653b2a186b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:43:41.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 -- 172.21.15.35:0/3365890784 shutdown_connections 2023-03-17T11:43:41.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.176+0000 7f1286d60b80 1 -- 172.21.15.35:0/3365890784 wait complete. 2023-03-17T11:43:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 -- start start 2023-03-17T11:43:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 Processor -- start 2023-03-17T11:43:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a15960 0x5653b2a25530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1abe0 0x5653b2a25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 0x5653b2a81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a81eb0 con 0x5653b2a1b4f0 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a81ff0 con 0x5653b2a1abe0 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653b2a82160 con 0x5653b2a15960 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.177+0000 7f1286d60b80 10 client.0 _ll_register_callbacks cb 0x5653b280d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 0x5653b2a81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 0x5653b2a81970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56782/0 (socket says 172.21.15.35:56782) 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 -- 172.21.15.35:0/1929480976 learned_addr learned my addr 172.21.15.35:0/1929480976 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f127896f700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a15960 0x5653b2a25530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1273fff700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1abe0 0x5653b2a25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 -- 172.21.15.35:0/1929480976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a15960 msgr2=0x5653b2a25530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a15960 0x5653b2a25530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 -- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1abe0 msgr2=0x5653b2a25a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:43:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1abe0 0x5653b2a25a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:43:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 -- 172.21.15.35:0/1929480976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653b2795d80 con 0x5653b2a1b4f0 2023-03-17T11:43:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1273fff700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1abe0 0x5653b2a25a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:43:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1279170700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 0x5653b2a81970 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f126c009510 tx=0x7f126c00df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a1112b345a5025 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1253fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1253fff700 1 -- 172.21.15.35:0/1929480976 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c097c40 con 0x5653b2a1b4f0 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1253fff700 1 -- 172.21.15.35:0/1929480976 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f126c00dc60 con 0x5653b2a1b4f0 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653b29e51e0 con 0x5653b2a1b4f0 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1253fff700 1 -- 172.21.15.35:0/1929480976 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f126c0977e0 con 0x5653b2a1b4f0 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1286d60b80 10 client.21363 fetch_fsmap learned FSMap version 108 2023-03-17T11:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.178+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5653b27bc1f0 con 0x5653b2a1b4f0 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:49 smithi035 ceph-mon[92535]: pgmap v5502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:51 smithi035 ceph-mon[92535]: pgmap v5503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:53 smithi035 ceph-mon[92535]: pgmap v5504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:55 smithi035 ceph-mon[92535]: pgmap v5505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:57 smithi035 ceph-mon[92535]: pgmap v5506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:32:59 smithi035 ceph-mon[92535]: pgmap v5507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:01 smithi035 ceph-mon[92535]: pgmap v5508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:03 smithi035 ceph-mon[92535]: pgmap v5509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:05 smithi035 ceph-mon[92535]: pgmap v5510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:07 smithi035 ceph-mon[92535]: pgmap v5511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:09 smithi035 ceph-mon[92535]: pgmap v5512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:09 smithi035 ceph-mon[92535]: osdmap e413: 12 total, 12 up, 12 in 2023-03-17T11:43:45.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:11 smithi035 ceph-mon[92535]: pgmap v5514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:13 smithi035 ceph-mon[92535]: pgmap v5515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:15 smithi035 ceph-mon[92535]: pgmap v5516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:17 smithi035 ceph-mon[92535]: pgmap v5517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:17 smithi035 ceph-mon[92535]: osdmap e414: 12 total, 12 up, 12 in 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:19 smithi035 ceph-mon[92535]: pgmap v5519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:21 smithi035 ceph-mon[92535]: pgmap v5520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:23 smithi035 ceph-mon[92535]: pgmap v5521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:25 smithi035 ceph-mon[92535]: pgmap v5522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:27 smithi035 ceph-mon[92535]: pgmap v5523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:29 smithi035 ceph-mon[92535]: pgmap v5524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 366 B/s wr, 9 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:31 smithi035 ceph-mon[92535]: pgmap v5525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:33 smithi035 ceph-mon[92535]: pgmap v5526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:35 smithi035 ceph-mon[92535]: pgmap v5527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:37 smithi035 ceph-mon[92535]: pgmap v5528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:39 smithi035 ceph-mon[92535]: pgmap v5529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:41 smithi035 ceph-mon[92535]: pgmap v5530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:43:45.695 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:43:45.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:43:45.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:43:45.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:42 smithi035 ceph-mon[92535]: pgmap v5531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T11:43:45.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:42 smithi035 ceph-mon[92535]: pgmap v5532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-03-17T11:43:47.843 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:44 smithi035 ceph-mon[92535]: pgmap v5533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T11:43:47.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:46 smithi035 ceph-mon[92535]: pgmap v5534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T11:43:47.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:48 smithi035 ceph-mon[92535]: pgmap v5535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T11:43:47.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:50 smithi035 ceph-mon[92535]: pgmap v5536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T11:43:47.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:52 smithi035 ceph-mon[92535]: pgmap v5537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:43:47.844 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:54 smithi035 ceph-mon[92535]: pgmap v5538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:56 smithi035 ceph-mon[92535]: pgmap v5539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:33:58 smithi035 ceph-mon[92535]: pgmap v5540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:00 smithi035 ceph-mon[92535]: pgmap v5541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:02 smithi035 ceph-mon[92535]: pgmap v5542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:04 smithi035 ceph-mon[92535]: pgmap v5543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:06 smithi035 ceph-mon[92535]: pgmap v5544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:08 smithi035 ceph-mon[92535]: pgmap v5545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:43:49.845 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:09 smithi035 ceph-mon[92535]: osdmap e415: 12 total, 12 up, 12 in 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:10 smithi035 ceph-mon[92535]: pgmap v5547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:12 smithi035 ceph-mon[92535]: pgmap v5548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:14 smithi035 ceph-mon[92535]: pgmap v5549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:16 smithi035 ceph-mon[92535]: pgmap v5550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:18 smithi035 ceph-mon[92535]: pgmap v5552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:18 smithi035 ceph-mon[92535]: osdmap e416: 12 total, 12 up, 12 in 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:20 smithi035 ceph-mon[92535]: pgmap v5553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:22 smithi035 ceph-mon[92535]: pgmap v5554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:24 smithi035 ceph-mon[92535]: pgmap v5555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:26 smithi035 ceph-mon[92535]: pgmap v5556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:28 smithi035 ceph-mon[92535]: pgmap v5557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:43:49.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:30 smithi035 ceph-mon[92535]: pgmap v5558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:51.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:32 smithi035 ceph-mon[92535]: pgmap v5559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:51.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:34 smithi035 ceph-mon[92535]: pgmap v5560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:43:51.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:36 smithi035 ceph-mon[92535]: pgmap v5561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:43:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:43:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:43:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:43:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:43:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:43:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:43:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:43:54.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1253fff700 1 -- 172.21.15.35:0/1929480976 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653b29e51e0 con 0x5653b2a1b4f0 2023-03-17T11:43:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1253fff700 1 -- 172.21.15.35:0/1929480976 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f126c096cd0 con 0x5653b2a1b4f0 2023-03-17T11:43:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1286d60b80 10 client.21363 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:43:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1286d60b80 10 client.21363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:43:58.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1286d60b80 20 client.21363 populate_metadata read hostname 'smithi035' 2023-03-17T11:43:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1286d60b80 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a83830 0x5653b2a85c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:43:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1286d60b80 4 client.21363 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:43:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653b27ebf00 con 0x5653b2a83830 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f127896f700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a83830 0x5653b2a85c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f1253fff700 10 client.21363 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.179+0000 7f127896f700 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a83830 0x5653b2a85c40 crc :-1 s=READY pgs=743 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41532cbaf1efa703 server_cookie=14f1a815b6de2f7f in_seq=0 out_seq=0 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1253fff700 1 -- 172.21.15.35:0/1929480976 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653b27ebf00 con 0x5653b2a83830 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1253fff700 10 client.21363 handle_command_reply: tid=0 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 client.21363 shutdown 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 msgr2=0x5653b2a81970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 0x5653b2a81970 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f126c009510 tx=0x7f126c00df60 comp rx=0 tx=0).stop 2023-03-17T11:43:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 shutdown_connections 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5653b2a83830 0x5653b2a85c40 crc :-1 s=READY pgs=743 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5653b2a1b4f0 0x5653b2a81970 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653b2a15960 0x5653b2a25530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 --2- 172.21.15.35:0/1929480976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5653b2a1abe0 0x5653b2a25a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1253fff700 0 client.21363 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.196+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 >> 172.21.15.35:0/1929480976 conn(0x5653b28726b0 msgr2=0x5653b2a186b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 shutdown_connections 2023-03-17T11:44:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f1286d60b80 1 -- 172.21.15.35:0/1929480976 wait complete. 2023-03-17T11:44:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f1286d60b80 20 client.21363 trim_cache size 0 max 16384 2023-03-17T11:44:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f126409f6c0 msgr2=0x7f12640a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f126409f6c0 0x7f12640a1b70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1268000c00 tx=0x7f126801a040 comp rx=0 tx=0).stop 2023-03-17T11:44:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 msgr2=0x7f127419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 0x7f127419ce50 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f126c007ee0 tx=0x7f126c00d3b0 comp rx=0 tx=0).stop 2023-03-17T11:44:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 shutdown_connections 2023-03-17T11:44:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f126409f6c0 0x7f12640a1b70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1274104390 0x7f127419ce50 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12740ff350 0x7f12741984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 --2- 172.21.15.35:0/901564526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12740ffcf0 0x7f12741989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 >> 172.21.15.35:0/901564526 conn(0x7f1274076330 msgr2=0x7f1274068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 shutdown_connections 2023-03-17T11:44:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:40.197+0000 7f127abd3700 1 -- 172.21.15.35:0/901564526 wait complete. 2023-03-17T11:44:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 -- 172.21.15.35:0/3691821461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ff350 msgr2=0x7feab00ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3691821461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ff350 0x7feab00ff720 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7feaa00099c0 tx=0x7feaa0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:44:04.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 -- 172.21.15.35:0/3691821461 shutdown_connections 2023-03-17T11:44:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3691821461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab0104390 0x7feab010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3691821461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ff350 0x7feab00ff720 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3691821461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feab00ffcf0 0x7feab0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 -- 172.21.15.35:0/3691821461 >> 172.21.15.35:0/3691821461 conn(0x7feab0076330 msgr2=0x7feab0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 -- 172.21.15.35:0/3691821461 shutdown_connections 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.320+0000 7feab4ee4700 1 -- 172.21.15.35:0/3691821461 wait complete. 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 Processor -- start 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 -- start start 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab00ff350 0x7feab01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 0x7feab0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feab0104390 0x7feab019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab019d4c0 con 0x7feab00ffcf0 2023-03-17T11:44:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab019d630 con 0x7feab0104390 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feab4ee4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab019d7f0 con 0x7feab00ff350 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 0x7feab0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feaae59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab00ff350 0x7feab01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 0x7feab0198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56794/0 (socket says 172.21.15.35:56794) 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.321+0000 7feaadd9b700 1 -- 172.21.15.35:0/3083267143 learned_addr learned my addr 172.21.15.35:0/3083267143 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaaed9d700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feab0104390 0x7feab019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:08.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaadd9b700 1 -- 172.21.15.35:0/3083267143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab00ff350 msgr2=0x7feab01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:08.239 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaadd9b700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab00ff350 0x7feab01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaadd9b700 1 -- 172.21.15.35:0/3083267143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feab0104390 msgr2=0x7feab019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaadd9b700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feab0104390 0x7feab019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaadd9b700 1 -- 172.21.15.35:0/3083267143 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00095f0 con 0x7feab00ffcf0 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feaadd9b700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 0x7feab0198a20 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7feaa400d950 tx=0x7feaa400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7fea9f7fe700 1 -- 172.21.15.35:0/3083267143 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400f890 con 0x7feab00ffcf0 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7fea9f7fe700 1 -- 172.21.15.35:0/3083267143 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaa400fe80 con 0x7feab00ffcf0 2023-03-17T11:44:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab010f000 con 0x7feab00ffcf0 2023-03-17T11:44:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7fea9f7fe700 1 -- 172.21.15.35:0/3083267143 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400e3b0 con 0x7feab00ffcf0 2023-03-17T11:44:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.322+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab010ee70 con 0x7feab00ffcf0 2023-03-17T11:44:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.324+0000 7fea9f7fe700 1 -- 172.21.15.35:0/3083267143 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7feaa400f9f0 con 0x7feab00ffcf0 2023-03-17T11:44:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.325+0000 7fea9f7fe700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea9809f640 0x7fea980a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.325+0000 7fea9f7fe700 1 -- 172.21.15.35:0/3083267143 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7feaa40ca100 con 0x7feab00ffcf0 2023-03-17T11:44:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.325+0000 7feaae59c700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea9809f640 0x7fea980a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feaae59c700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea9809f640 0x7fea980a1af0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feaa000b580 tx=0x7feaa0009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 Processor -- start 2023-03-17T11:44:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 -- start start 2023-03-17T11:44:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c85be0 0x561ff9c85fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c80420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 0x561ff9c80d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9b87010 con 0x561ff9c80960 2023-03-17T11:44:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9bd9950 con 0x561ff9c85be0 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feac1071b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9bd2de0 con 0x561ff9c864f0 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feaaed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 0x561ff9c80d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feaaed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 0x561ff9c80d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56804/0 (socket says 172.21.15.35:56804) 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feaaed9d700 1 -- 172.21.15.35:0/2112366274 learned_addr learned my addr 172.21.15.35:0/2112366274 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.326+0000 7feaae59c700 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c85be0 0x561ff9c85fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaadd9b700 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c80420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaaed9d700 1 -- 172.21.15.35:0/2112366274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 msgr2=0x561ff9c80420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaaed9d700 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c80420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaaed9d700 1 -- 172.21.15.35:0/2112366274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c85be0 msgr2=0x561ff9c85fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaaed9d700 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c85be0 0x561ff9c85fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaaed9d700 1 -- 172.21.15.35:0/2112366274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ff9a545d0 con 0x561ff9c80960 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7feaaed9d700 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 0x561ff9c80d90 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003fa0 tx=0x7feaa8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c396aaaca2e6f47a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7fea9cff9700 1 -- 172.21.15.35:0/2112366274 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8019070 con 0x561ff9c80960 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7fea9cff9700 1 -- 172.21.15.35:0/2112366274 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaa800f040 con 0x561ff9c80960 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.327+0000 7fea9cff9700 1 -- 172.21.15.35:0/2112366274 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa80079f0 con 0x561ff9c80960 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 -- 172.21.15.35:0/2112366274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 msgr2=0x561ff9c80d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 0x561ff9c80d90 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003fa0 tx=0x7feaa8009ba0 comp rx=0 tx=0).stop 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 -- 172.21.15.35:0/2112366274 shutdown_connections 2023-03-17T11:44:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c80960 0x561ff9c80d90 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c85be0 0x561ff9c85fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 --2- 172.21.15.35:0/2112366274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c80420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 -- 172.21.15.35:0/2112366274 >> 172.21.15.35:0/2112366274 conn(0x561ff9add6b0 msgr2=0x561ff9c7aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 -- 172.21.15.35:0/2112366274 shutdown_connections 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 -- 172.21.15.35:0/2112366274 wait complete. 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.328+0000 7feac1071b80 1 -- start start 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 Processor -- start 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c89640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9c89be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9a568c0 con 0x561ff9c85be0 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9c8a350 con 0x561ff9c864f0 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9c8a510 con 0x561ff9c80960 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feac1071b80 10 client.0 _ll_register_callbacks cb 0x561ff9a78230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c89640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c89640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56808/0 (socket says 172.21.15.35:56808) 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 -- 172.21.15.35:0/3705723576 learned_addr learned my addr 172.21.15.35:0/3705723576 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:14.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaae59c700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 -- 172.21.15.35:0/3705723576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 msgr2=0x561ff9c8c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 -- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 msgr2=0x561ff9c89be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaaed9d700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9c89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9c89be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.329+0000 7feaadd9b700 1 -- 172.21.15.35:0/3705723576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa8003bd0 con 0x561ff9c85be0 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feaaed9d700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9c89be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feaadd9b700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c89640 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7feaa40c7e90 tx=0x7feaa4097bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd5acb6374b43 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7fea95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:44:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7fea95ffb700 1 -- 172.21.15.35:0/3705723576 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40af070 con 0x561ff9c85be0 2023-03-17T11:44:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7fea95ffb700 1 -- 172.21.15.35:0/3705723576 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7feaa4096010 con 0x561ff9c85be0 2023-03-17T11:44:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ff9b95390 con 0x561ff9c85be0 2023-03-17T11:44:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7fea95ffb700 1 -- 172.21.15.35:0/3705723576 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa40b1020 con 0x561ff9c85be0 2023-03-17T11:44:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 10 client.21375 fetch_fsmap learned FSMap version 108 2023-03-17T11:44:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x561ff9a00d80 con 0x561ff9c85be0 2023-03-17T11:44:17.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7fea95ffb700 1 -- 172.21.15.35:0/3705723576 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ff9b95390 con 0x561ff9c85be0 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7fea95ffb700 1 -- 172.21.15.35:0/3705723576 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7feaa409f980 con 0x561ff9c85be0 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 10 client.21375 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 10 client.21375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 20 client.21375 populate_metadata read hostname 'smithi035' 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9c9a080 0x561ff9c9c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 4 client.21375 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.330+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ff9ba1600 con 0x561ff9c9a080 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.331+0000 7feaae59c700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9c9a080 0x561ff9c9c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.331+0000 7fea95ffb700 10 client.21375 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.331+0000 7feaae59c700 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9c9a080 0x561ff9c9c490 crc :-1 s=READY pgs=744 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc4f9ad34b401c0d server_cookie=85af64e5e556ef82 in_seq=0 out_seq=0 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7fea95ffb700 1 -- 172.21.15.35:0/3705723576 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561ff9ba1600 con 0x561ff9c9a080 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7fea95ffb700 10 client.21375 handle_command_reply: tid=0 2023-03-17T11:44:17.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 client.21375 shutdown 2023-03-17T11:44:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 msgr2=0x561ff9c89640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c89640 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7feaa40c7e90 tx=0x7feaa4097bb0 comp rx=0 tx=0).stop 2023-03-17T11:44:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 shutdown_connections 2023-03-17T11:44:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9c9a080 0x561ff9c9c490 crc :-1 s=READY pgs=744 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9c89be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7fea95ffb700 0 client.21375 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:44:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 --2- 172.21.15.35:0/3705723576 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c89640 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 >> 172.21.15.35:0/3705723576 conn(0x561ff9add6b0 msgr2=0x561ff9c7aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 shutdown_connections 2023-03-17T11:44:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 1 -- 172.21.15.35:0/3705723576 wait complete. 2023-03-17T11:44:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.332+0000 7feac1071b80 20 client.21375 trim_cache size 0 max 16384 2023-03-17T11:44:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 Processor -- start 2023-03-17T11:44:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 -- start start 2023-03-17T11:44:21.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c80960 0x561ff9c80420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c7aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:22.744 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:38 smithi035 ceph-mon[92535]: pgmap v5562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:44:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9c7b6f0 con 0x561ff9c85be0 2023-03-17T11:44:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9c7b000 con 0x561ff9c80960 2023-03-17T11:44:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feac1071b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9c760d0 con 0x561ff9c864f0 2023-03-17T11:44:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c7aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c7aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56816/0 (socket says 172.21.15.35:56816) 2023-03-17T11:44:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feaadd9b700 1 -- 172.21.15.35:0/2873816517 learned_addr learned my addr 172.21.15.35:0/2873816517 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.347+0000 7feaae59c700 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c80960 0x561ff9c80420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaaed9d700 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaadd9b700 1 -- 172.21.15.35:0/2873816517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 msgr2=0x561ff9c826b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaadd9b700 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c826b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaadd9b700 1 -- 172.21.15.35:0/2873816517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c80960 msgr2=0x561ff9c80420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaadd9b700 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c80960 0x561ff9c80420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaadd9b700 1 -- 172.21.15.35:0/2873816517 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ff9b99130 con 0x561ff9c85be0 2023-03-17T11:44:24.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaae59c700 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c80960 0x561ff9c80420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feaadd9b700 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c7aac0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7feaa40c7940 tx=0x7feaa4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65fcb2f5cad248e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7fea9d7fa700 1 -- 172.21.15.35:0/2873816517 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40af070 con 0x561ff9c85be0 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7fea9d7fa700 1 -- 172.21.15.35:0/2873816517 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaa4096010 con 0x561ff9c85be0 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7fea9d7fa700 1 -- 172.21.15.35:0/2873816517 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40b1070 con 0x561ff9c85be0 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 -- 172.21.15.35:0/2873816517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 msgr2=0x561ff9c7aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c7aac0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7feaa40c7940 tx=0x7feaa4010000 comp rx=0 tx=0).stop 2023-03-17T11:44:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 -- 172.21.15.35:0/2873816517 shutdown_connections 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c864f0 0x561ff9c826b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c80960 0x561ff9c80420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 --2- 172.21.15.35:0/2873816517 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c7aac0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.348+0000 7feac1071b80 1 -- 172.21.15.35:0/2873816517 >> 172.21.15.35:0/2873816517 conn(0x561ff9add6b0 msgr2=0x561ff9c837e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 -- 172.21.15.35:0/2873816517 shutdown_connections 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 -- 172.21.15.35:0/2873816517 wait complete. 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 -- start start 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 Processor -- start 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c8f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9cecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9ced460 con 0x561ff9c85be0 2023-03-17T11:44:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9ced5a0 con 0x561ff9c864f0 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff9ced710 con 0x561ff9c80960 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feac1071b80 10 client.0 _ll_register_callbacks cb 0x561ff9a78230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.349+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c8f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c8f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56822/0 (socket says 172.21.15.35:56822) 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 -- 172.21.15.35:0/1601985318 learned_addr learned my addr 172.21.15.35:0/1601985318 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaae59c700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaaed9d700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9cecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 -- 172.21.15.35:0/1601985318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 msgr2=0x561ff9c8f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 -- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 msgr2=0x561ff9cecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9cecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 -- 172.21.15.35:0/1601985318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ff9a00d80 con 0x561ff9c85be0 2023-03-17T11:44:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaaed9d700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9cecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:44:27.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feaadd9b700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c8f690 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7feaa409f870 tx=0x7feaa4097620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c889c9f47a45a88 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7fea95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:44:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7fea95ffb700 1 -- 172.21.15.35:0/1601985318 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40af070 con 0x561ff9c85be0 2023-03-17T11:44:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7fea95ffb700 1 -- 172.21.15.35:0/1601985318 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7feaa4064300 con 0x561ff9c85be0 2023-03-17T11:44:27.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ff9c501e0 con 0x561ff9c85be0 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7fea95ffb700 1 -- 172.21.15.35:0/1601985318 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa40b1050 con 0x561ff9c85be0 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feac1071b80 10 client.21381 fetch_fsmap learned FSMap version 108 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.350+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x561ff9a271f0 con 0x561ff9c85be0 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7fea95ffb700 1 -- 172.21.15.35:0/1601985318 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ff9c501e0 con 0x561ff9c85be0 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7fea95ffb700 1 -- 172.21.15.35:0/1601985318 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7feaa4096b10 con 0x561ff9c85be0 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feac1071b80 10 client.21381 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feac1071b80 10 client.21381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feac1071b80 20 client.21381 populate_metadata read hostname 'smithi035' 2023-03-17T11:44:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feac1071b80 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9cee950 0x561ff9cf0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feac1071b80 4 client.21381 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561ff9a56f00 con 0x561ff9cee950 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.351+0000 7feaae59c700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9cee950 0x561ff9cf0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.352+0000 7fea95ffb700 10 client.21381 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.352+0000 7feaae59c700 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9cee950 0x561ff9cf0d30 crc :-1 s=READY pgs=745 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d9438efe6112fe server_cookie=510b76764af03b7c in_seq=0 out_seq=0 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7fea95ffb700 1 -- 172.21.15.35:0/1601985318 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561ff9a56f00 con 0x561ff9cee950 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7fea95ffb700 10 client.21381 handle_command_reply: tid=0 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 client.21381 shutdown 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 msgr2=0x561ff9c8f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c8f690 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7feaa409f870 tx=0x7feaa4097620 comp rx=0 tx=0).stop 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 shutdown_connections 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561ff9cee950 0x561ff9cf0d30 crc :-1 s=READY pgs=745 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff9c864f0 0x561ff9cecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ff9c80960 0x561ff9c8f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7fea95ffb700 0 client.21381 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 --2- 172.21.15.35:0/1601985318 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561ff9c85be0 0x561ff9c8f690 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 >> 172.21.15.35:0/1601985318 conn(0x561ff9add6b0 msgr2=0x561ff9c86990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 shutdown_connections 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 1 -- 172.21.15.35:0/1601985318 wait complete. 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.364+0000 7feac1071b80 20 client.21381 trim_cache size 0 max 16384 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea9809f640 msgr2=0x7fea980a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea9809f640 0x7fea980a1af0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feaa000b580 tx=0x7feaa0009f10 comp rx=0 tx=0).stop 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 msgr2=0x7feab0198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 0x7feab0198a20 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7feaa400d950 tx=0x7feaa400dc60 comp rx=0 tx=0).stop 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 shutdown_connections 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fea9809f640 0x7fea980a1af0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feab0104390 0x7feab019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab00ff350 0x7feab01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 --2- 172.21.15.35:0/3083267143 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7feab00ffcf0 0x7feab0198a20 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 >> 172.21.15.35:0/3083267143 conn(0x7feab0076330 msgr2=0x7feab0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 shutdown_connections 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:20:53.365+0000 7feab4ee4700 1 -- 172.21.15.35:0/3083267143 wait complete. 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 -- 172.21.15.35:0/2021454539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe060104390 msgr2=0x7fe06010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 --2- 172.21.15.35:0/2021454539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe060104390 0x7fe06010bf60 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fe05800b0d0 tx=0x7fe05800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 -- 172.21.15.35:0/2021454539 shutdown_connections 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 --2- 172.21.15.35:0/2021454539 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe060104390 0x7fe06010bf60 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 --2- 172.21.15.35:0/2021454539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0600ff350 0x7fe0600ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:31.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 --2- 172.21.15.35:0/2021454539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0600ffcf0 0x7fe060103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 -- 172.21.15.35:0/2021454539 >> 172.21.15.35:0/2021454539 conn(0x7fe060076330 msgr2=0x7fe060076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.489+0000 7fe067da8700 1 -- 172.21.15.35:0/2021454539 shutdown_connections 2023-03-17T11:44:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 -- 172.21.15.35:0/2021454539 wait complete. 2023-03-17T11:44:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 Processor -- start 2023-03-17T11:44:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 -- start start 2023-03-17T11:44:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 0x7fe060100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0600ffcf0 0x7fe060101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe060104390 0x7fe0601a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe060101ac0 con 0x7fe0600ff350 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601a4a80 con 0x7fe060104390 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe067da8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601a4bc0 con 0x7fe0600ffcf0 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.490+0000 7fe065b44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 0x7fe060100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 0x7fe060100d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56834/0 (socket says 172.21.15.35:56834) 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 -- 172.21.15.35:0/3672359025 learned_addr learned my addr 172.21.15.35:0/3672359025 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065343700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0600ffcf0 0x7fe060101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe066345700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe060104390 0x7fe0601a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 -- 172.21.15.35:0/3672359025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0600ffcf0 msgr2=0x7fe060101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:35.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0600ffcf0 0x7fe060101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 -- 172.21.15.35:0/3672359025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe060104390 msgr2=0x7fe0601a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe060104390 0x7fe0601a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 -- 172.21.15.35:0/3672359025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058009d00 con 0x7fe0600ff350 2023-03-17T11:44:37.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe066345700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe060104390 0x7fe0601a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:44:37.318 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe065b44700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 0x7fe060100d50 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fe05400e9a0 tx=0x7fe05400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe052ffd700 1 -- 172.21.15.35:0/3672359025 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054009790 con 0x7fe0600ff350 2023-03-17T11:44:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe052ffd700 1 -- 172.21.15.35:0/3672359025 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe05400cbd0 con 0x7fe0600ff350 2023-03-17T11:44:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06010efc0 con 0x7fe0600ff350 2023-03-17T11:44:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe052ffd700 1 -- 172.21.15.35:0/3672359025 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054018680 con 0x7fe0600ff350 2023-03-17T11:44:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.491+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06010ee30 con 0x7fe0600ff350 2023-03-17T11:44:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.493+0000 7fe052ffd700 1 -- 172.21.15.35:0/3672359025 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe05400cd40 con 0x7fe0600ff350 2023-03-17T11:44:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.494+0000 7fe052ffd700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe04c09f6c0 0x7fe04c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.494+0000 7fe052ffd700 1 -- 172.21.15.35:0/3672359025 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe054014070 con 0x7fe0600ff350 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.494+0000 7fe065343700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe04c09f6c0 0x7fe04c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe065343700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe04c09f6c0 0x7fe04c0a1b70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe060102540 tx=0x7fe05c009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 Processor -- start 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 -- start start 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3eb5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3dbc010 con 0x55fea3eb5960 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3e0e950 con 0x55fea3ebb4f0 2023-03-17T11:44:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe073f35b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3e07de0 con 0x55fea3ebabe0 2023-03-17T11:44:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe066345700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3eb5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe066345700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3eb5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56846/0 (socket says 172.21.15.35:56846) 2023-03-17T11:44:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe066345700 1 -- 172.21.15.35:0/1493059329 learned_addr learned my addr 172.21.15.35:0/1493059329 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.495+0000 7fe065343700 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065b44700 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065343700 1 -- 172.21.15.35:0/1493059329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 msgr2=0x55fea3ebafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065343700 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065343700 1 -- 172.21.15.35:0/1493059329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 msgr2=0x55fea3eb5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065343700 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3eb5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065343700 1 -- 172.21.15.35:0/1493059329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fea3c895d0 con 0x55fea3ebb4f0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe066345700 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3eb5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe065343700 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb5420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009fd0 tx=0x7fe05c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f79684799761349 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe04bfff700 1 -- 172.21.15.35:0/1493059329 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0119b0 con 0x55fea3ebb4f0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe04bfff700 1 -- 172.21.15.35:0/1493059329 <== mon.2 v2:172.21.15.78:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe05c0044b0 con 0x55fea3ebb4f0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.496+0000 7fe04bfff700 1 -- 172.21.15.35:0/1493059329 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0038e0 con 0x55fea3ebb4f0 2023-03-17T11:44:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 -- 172.21.15.35:0/1493059329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 msgr2=0x55fea3eb5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:44:42.767 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:40 smithi035 ceph-mon[92535]: pgmap v5563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:44:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb5420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009fd0 tx=0x7fe05c014000 comp rx=0 tx=0).stop 2023-03-17T11:44:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 -- 172.21.15.35:0/1493059329 shutdown_connections 2023-03-17T11:44:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3eb5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 --2- 172.21.15.35:0/1493059329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb5420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:42.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 -- 172.21.15.35:0/1493059329 >> 172.21.15.35:0/1493059329 conn(0x55fea3d126b0 msgr2=0x55fea3eafa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 -- 172.21.15.35:0/1493059329 shutdown_connections 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 -- 172.21.15.35:0/1493059329 wait complete. 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.497+0000 7fe073f35b80 1 -- start start 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 Processor -- start 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3ebede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3c8b8c0 con 0x55fea3eb5960 2023-03-17T11:44:45.268 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3ebf550 con 0x55fea3ebb4f0 2023-03-17T11:44:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3ecb030 con 0x55fea3ebabe0 2023-03-17T11:44:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe073f35b80 10 client.0 _ll_register_callbacks cb 0x55fea3cad230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:44:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56848/0 (socket says 172.21.15.35:56848) 2023-03-17T11:44:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 -- 172.21.15.35:0/3890624451 learned_addr learned my addr 172.21.15.35:0/3890624451 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:44:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe066345700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3ebede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:44:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 -- 172.21.15.35:0/3890624451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 msgr2=0x55fea3ebe780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-17T11:44:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebe780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 -- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 msgr2=0x55fea3ebede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:44:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.498+0000 7fe065b44700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3ebede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:44:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe065b44700 1 -- 172.21.15.35:0/3890624451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c017070 con 0x55fea3eb5960 2023-03-17T11:44:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe066345700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3ebede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:44:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe065b44700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec1500 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7fe05400e970 tx=0x7fe054098420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7eea68e4a3db35 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:44:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe0497fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:44:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe0497fa700 1 -- 172.21.15.35:0/3890624451 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054097b10 con 0x55fea3eb5960 2023-03-17T11:44:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe0497fa700 1 -- 172.21.15.35:0/3890624451 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe0540a0180 con 0x55fea3eb5960 2023-03-17T11:44:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fea3dca390 con 0x55fea3eb5960 2023-03-17T11:44:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe0497fa700 1 -- 172.21.15.35:0/3890624451 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0540a0340 con 0x55fea3eb5960 2023-03-17T11:44:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 10 client.21393 fetch_fsmap learned FSMap version 108 2023-03-17T11:44:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55fea3c35d80 con 0x55fea3eb5960 2023-03-17T11:44:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe0497fa700 1 -- 172.21.15.35:0/3890624451 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0540b6030 con 0x55fea3eb5960 2023-03-17T11:44:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe0497fa700 1 -- 172.21.15.35:0/3890624451 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe054094280 con 0x55fea3eb5960 2023-03-17T11:44:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 10 client.21393 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:44:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 10 client.21393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:44:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 20 client.21393 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3ecf140 0x55fea3ed1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 4 client.21393 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:45:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.499+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fea3dd6600 con 0x55fea3ecf140 2023-03-17T11:45:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.500+0000 7fe065343700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3ecf140 0x55fea3ed1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.500+0000 7fe0497fa700 10 client.21393 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.500+0000 7fe065343700 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3ecf140 0x55fea3ed1550 crc :-1 s=READY pgs=746 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8892616562296f79 server_cookie=3b0c6d306d7b76e in_seq=0 out_seq=0 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe0497fa700 1 -- 172.21.15.35:0/3890624451 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55fea3dd6600 con 0x55fea3ecf140 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe0497fa700 10 client.21393 handle_command_reply: tid=0 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 client.21393 shutdown 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 msgr2=0x55fea3ec1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec1500 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7fe05400e970 tx=0x7fe054098420 comp rx=0 tx=0).stop 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 shutdown_connections 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3ecf140 0x55fea3ed1550 crc :-1 s=READY pgs=746 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebb4f0 0x55fea3ebede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec1500 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3890624451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebabe0 0x55fea3ebe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe0497fa700 0 client.21393 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 >> 172.21.15.35:0/3890624451 conn(0x55fea3d126b0 msgr2=0x55fea3eb4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 shutdown_connections 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 1 -- 172.21.15.35:0/3890624451 wait complete. 2023-03-17T11:45:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.501+0000 7fe073f35b80 20 client.21393 trim_cache size 0 max 16384 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 Processor -- start 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 -- start start 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3eb5960 0x55fea3ec5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3eb0380 con 0x55fea3ebb4f0 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3eb06d0 con 0x55fea3ebabe0 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.516+0000 7fe073f35b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3ebfd60 con 0x55fea3eb5960 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56856/0 (socket says 172.21.15.35:56856) 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 -- 172.21.15.35:0/3229062569 learned_addr learned my addr 172.21.15.35:0/3229062569 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe065343700 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe065b44700 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3eb5960 0x55fea3ec5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 -- 172.21.15.35:0/3229062569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3eb5960 msgr2=0x55fea3ec5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3eb5960 0x55fea3ec5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 -- 172.21.15.35:0/3229062569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 msgr2=0x55fea3ec10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 -- 172.21.15.35:0/3229062569 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fea3dce130 con 0x55fea3ebb4f0 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe065343700 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe066345700 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb86b0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7fe058009540 tx=0x7fe058009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bc45d9aa2ecff server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe050ff9700 1 -- 172.21.15.35:0/3229062569 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05800e040 con 0x55fea3ebb4f0 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe050ff9700 1 -- 172.21.15.35:0/3229062569 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe058021070 con 0x55fea3ebb4f0 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.517+0000 7fe050ff9700 1 -- 172.21.15.35:0/3229062569 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580052a0 con 0x55fea3ebb4f0 2023-03-17T11:45:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 -- 172.21.15.35:0/3229062569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 msgr2=0x55fea3eb86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb86b0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7fe058009540 tx=0x7fe058009570 comp rx=0 tx=0).stop 2023-03-17T11:45:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 -- 172.21.15.35:0/3229062569 shutdown_connections 2023-03-17T11:45:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3ebb4f0 0x55fea3eb86b0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3eb5960 0x55fea3ec5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3229062569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 -- 172.21.15.35:0/3229062569 >> 172.21.15.35:0/3229062569 conn(0x55fea3d126b0 msgr2=0x55fea3eb4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 -- 172.21.15.35:0/3229062569 shutdown_connections 2023-03-17T11:45:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 -- 172.21.15.35:0/3229062569 wait complete. 2023-03-17T11:45:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 -- start start 2023-03-17T11:45:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.518+0000 7fe073f35b80 1 Processor -- start 2023-03-17T11:45:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebb4f0 0x55fea3f1af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3f1b4a0 con 0x55fea3eb5960 2023-03-17T11:45:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3f1b610 con 0x55fea3ebabe0 2023-03-17T11:45:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fea3f1b7d0 con 0x55fea3ebb4f0 2023-03-17T11:45:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe073f35b80 10 client.0 _ll_register_callbacks cb 0x55fea3cad230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:45:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56860/0 (socket says 172.21.15.35:56860) 2023-03-17T11:45:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 -- 172.21.15.35:0/3897136126 learned_addr learned my addr 172.21.15.35:0/3897136126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065343700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe066345700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebb4f0 0x55fea3f1af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 -- 172.21.15.35:0/3897136126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebb4f0 msgr2=0x55fea3f1af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebb4f0 0x55fea3f1af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 -- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 msgr2=0x55fea3ec4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 -- 172.21.15.35:0/3897136126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe058009380 con 0x55fea3eb5960 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe065b44700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec4050 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fe054094e90 tx=0x7fe054010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23442d9415469f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe0497fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe0497fa700 1 -- 172.21.15.35:0/3897136126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0540a0380 con 0x55fea3eb5960 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.519+0000 7fe0497fa700 1 -- 172.21.15.35:0/3897136126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(387..387 src has 1..387) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe054094420 con 0x55fea3eb5960 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fea3e851e0 con 0x55fea3eb5960 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe0497fa700 1 -- 172.21.15.35:0/3897136126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0540973a0 con 0x55fea3eb5960 2023-03-17T11:45:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 10 client.21399 fetch_fsmap learned FSMap version 108 2023-03-17T11:45:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55fea3c5c1f0 con 0x55fea3eb5960 2023-03-17T11:45:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe0497fa700 1 -- 172.21.15.35:0/3897136126 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fea3e851e0 con 0x55fea3eb5960 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe0497fa700 1 -- 172.21.15.35:0/3897136126 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fe054099290 con 0x55fea3eb5960 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 10 client.21399 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 10 client.21399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 20 client.21399 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3f23d70 0x55fea3f26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 4 client.21399 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fea3c8bf00 con 0x55fea3f23d70 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.520+0000 7fe065343700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3f23d70 0x55fea3f26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.521+0000 7fe0497fa700 10 client.21399 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.521+0000 7fe065343700 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3f23d70 0x55fea3f26180 crc :-1 s=READY pgs=747 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bacd99eb3550c11 server_cookie=bc5900787cfa9ab8 in_seq=0 out_seq=0 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe0497fa700 1 -- 172.21.15.35:0/3897136126 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fea3c8bf00 con 0x55fea3f23d70 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe0497fa700 10 client.21399 handle_command_reply: tid=0 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 client.21399 shutdown 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 msgr2=0x55fea3ec4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec4050 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fe054094e90 tx=0x7fe054010a70 comp rx=0 tx=0).stop 2023-03-17T11:45:07.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 shutdown_connections 2023-03-17T11:45:09.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55fea3f23d70 0x55fea3f26180 crc :-1 s=READY pgs=747 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:09.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fea3ebb4f0 0x55fea3f1af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:09.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe0497fa700 0 client.21399 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55fea3eb5960 0x55fea3ec4050 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 --2- 172.21.15.35:0/3897136126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fea3ebabe0 0x55fea3ec4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 >> 172.21.15.35:0/3897136126 conn(0x55fea3d126b0 msgr2=0x55fea3eb86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 shutdown_connections 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 1 -- 172.21.15.35:0/3897136126 wait complete. 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.537+0000 7fe073f35b80 20 client.21399 trim_cache size 0 max 16384 2023-03-17T11:45:09.995 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe04c09f6c0 msgr2=0x7fe04c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe04c09f6c0 0x7fe04c0a1b70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe060102540 tx=0x7fe05c009260 comp rx=0 tx=0).stop 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 msgr2=0x7fe060100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 0x7fe060100d50 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fe05400e9a0 tx=0x7fe05400ecb0 comp rx=0 tx=0).stop 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 shutdown_connections 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe04c09f6c0 0x7fe04c0a1b70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe060104390 0x7fe0601a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe0600ff350 0x7fe060100d50 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 --2- 172.21.15.35:0/3672359025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0600ffcf0 0x7fe060101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 >> 172.21.15.35:0/3672359025 conn(0x7fe060076330 msgr2=0x7fe060068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 shutdown_connections 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:06.538+0000 7fe067da8700 1 -- 172.21.15.35:0/3672359025 wait complete. 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 -- 172.21.15.35:0/3131569283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc0ffcf0 msgr2=0x7ff1bc103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 --2- 172.21.15.35:0/3131569283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc103cb0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0099c0 tx=0x7ff1ac009cd0 comp rx=0 tx=0).stop 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 -- 172.21.15.35:0/3131569283 shutdown_connections 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 --2- 172.21.15.35:0/3131569283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1bc104390 0x7ff1bc10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 --2- 172.21.15.35:0/3131569283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ff350 0x7ff1bc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 --2- 172.21.15.35:0/3131569283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc103cb0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 -- 172.21.15.35:0/3131569283 >> 172.21.15.35:0/3131569283 conn(0x7ff1bc076330 msgr2=0x7ff1bc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 -- 172.21.15.35:0/3131569283 shutdown_connections 2023-03-17T11:45:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.661+0000 7ff1c436c700 1 -- 172.21.15.35:0/3131569283 wait complete. 2023-03-17T11:45:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 Processor -- start 2023-03-17T11:45:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 -- start start 2023-03-17T11:45:13.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:42 smithi035 ceph-mon[92535]: pgmap v5564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:45:13.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:45:13.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:45:13.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:45:13.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:45:13.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1bc0ff350 0x7ff1bc1951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc1956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 0x7ff1bc199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc19a180 con 0x7ff1bc104390 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc19a2f0 con 0x7ff1bc0ffcf0 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c436c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc19a4b0 con 0x7ff1bc0ff350 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 0x7ff1bc199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 0x7ff1bc199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56878/0 (socket says 172.21.15.35:56878) 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 -- 172.21.15.35:0/1601218887 learned_addr learned my addr 172.21.15.35:0/1601218887 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c1907700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc1956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2108700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1bc0ff350 0x7ff1bc1951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 -- 172.21.15.35:0/1601218887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1bc0ff350 msgr2=0x7ff1bc1951a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1bc0ff350 0x7ff1bc1951a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 -- 172.21.15.35:0/1601218887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ffcf0 msgr2=0x7ff1bc1956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc1956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 -- 172.21.15.35:0/1601218887 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0095f0 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c1907700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc1956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.662+0000 7ff1c2909700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 0x7ff1bc199b40 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007f10 tx=0x7ff1b400f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.663+0000 7ff1b37fe700 1 -- 172.21.15.35:0/1601218887 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4003c00 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.663+0000 7ff1b37fe700 1 -- 172.21.15.35:0/1601218887 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1b400fea0 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.663+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc10efc0 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.663+0000 7ff1b37fe700 1 -- 172.21.15.35:0/1601218887 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b40126c0 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.663+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc10ee30 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.665+0000 7ff1b37fe700 1 -- 172.21.15.35:0/1601218887 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff1b4004020 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.666+0000 7ff1b37fe700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff1a809f640 0x7ff1a80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.666+0000 7ff1b37fe700 1 -- 172.21.15.35:0/1601218887 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(389..389 src has 1..389) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff1b40cc8b0 con 0x7ff1bc104390 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.666+0000 7ff1c2108700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff1a809f640 0x7ff1a80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1c2108700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff1a809f640 0x7ff1a80a1af0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8005950 tx=0x7ff1b80058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 Processor -- start 2023-03-17T11:45:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 -- start start 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd5830 0x55955cfd5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 0x55955cfe1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955ced8010 con 0x55955cfd61e0 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cf2a950 con 0x55955cfd5830 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cf23de0 con 0x55955cfdb040 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1c2909700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 0x55955cfe1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1c2909700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 0x55955cfe1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56886/0 (socket says 172.21.15.35:56886) 2023-03-17T11:45:16.231 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1c2909700 1 -- 172.21.15.35:0/2682739836 learned_addr learned my addr 172.21.15.35:0/2682739836 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.667+0000 7ff1c2108700 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c1907700 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd5830 0x55955cfd5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c2909700 1 -- 172.21.15.35:0/2682739836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 msgr2=0x55955cfdb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c2909700 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c2909700 1 -- 172.21.15.35:0/2682739836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd5830 msgr2=0x55955cfd5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c2909700 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd5830 0x55955cfd5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c2909700 1 -- 172.21.15.35:0/2682739836 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55955cda55d0 con 0x55955cfd61e0 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1c2909700 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 0x55955cfe1dd0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4096860 tx=0x7ff1b4099d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d6334bd62b2175 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1b0dae700 1 -- 172.21.15.35:0/2682739836 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b409e1b0 con 0x55955cfd61e0 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1b0dae700 1 -- 172.21.15.35:0/2682739836 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1b4098700 con 0x55955cfd61e0 2023-03-17T11:45:17.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.668+0000 7ff1b0dae700 1 -- 172.21.15.35:0/2682739836 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4004bd0 con 0x55955cfd61e0 2023-03-17T11:45:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2682739836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 msgr2=0x55955cfe1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 0x55955cfe1dd0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4096860 tx=0x7ff1b4099d40 comp rx=0 tx=0).stop 2023-03-17T11:45:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2682739836 shutdown_connections 2023-03-17T11:45:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd61e0 0x55955cfe1dd0 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:17.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2682739836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd5830 0x55955cfd5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2682739836 >> 172.21.15.35:0/2682739836 conn(0x55955ce2e6b0 msgr2=0x55955cfcba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2682739836 shutdown_connections 2023-03-17T11:45:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2682739836 wait complete. 2023-03-17T11:45:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 -- start start 2023-03-17T11:45:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.669+0000 7ff1d04f9b80 1 Processor -- start 2023-03-17T11:45:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955cfe4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfe5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cda78c0 con 0x55955cfd5830 2023-03-17T11:45:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cfdf6a0 con 0x55955cfd61e0 2023-03-17T11:45:20.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cfdf860 con 0x55955cfdb040 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 10 client.0 _ll_register_callbacks cb 0x55955cdc9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955cfe4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955cfe4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56888/0 (socket says 172.21.15.35:56888) 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 -- 172.21.15.35:0/3570308822 learned_addr learned my addr 172.21.15.35:0/3570308822 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2909700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c1907700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfe5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 -- 172.21.15.35:0/3570308822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 msgr2=0x55955cfdf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 -- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 msgr2=0x55955cfe5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfe5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 -- 172.21.15.35:0/3570308822 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc10ee30 con 0x55955cfd5830 2023-03-17T11:45:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1c2108700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955cfe4e00 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800ffa0 tx=0x7ff1b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e71e4f0d517998 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:45:21.341 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/3570308822 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8028670 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/3570308822 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(389..389 src has 1..389) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff1b80287d0 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.670+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55955cee6390 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/3570308822 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1b8011e70 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 10 client.21411 fetch_fsmap learned FSMap version 108 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55955cd51d80 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/3570308822 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55955cee6390 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/3570308822 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff1b8031480 con 0x55955cfd5830 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 10 client.21411 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 10 client.21411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 20 client.21411 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955cfef510 0x55955cff1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 4 client.21411 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55955cef2600 con 0x55955cfef510 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.671+0000 7ff1c1907700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955cfef510 0x55955cff1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1a5ffb700 10 client.21411 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1c1907700 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955cfef510 0x55955cff1920 crc :-1 s=READY pgs=748 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10f8823e127bb2fb server_cookie=b15957c3fbbf6dd in_seq=0 out_seq=0 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/3570308822 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55955cef2600 con 0x55955cfef510 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1a5ffb700 10 client.21411 handle_command_reply: tid=0 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1d04f9b80 1 client.21411 shutdown 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 msgr2=0x55955cfe4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.672+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955cfe4e00 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800ffa0 tx=0x7ff1b8004750 comp rx=0 tx=0).stop 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 shutdown_connections 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955cfef510 0x55955cff1920 crc :-1 s=READY pgs=748 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfdb040 0x55955cfdf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955cfe4e00 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3570308822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfe5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1a5ffb700 0 client.21411 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 >> 172.21.15.35:0/3570308822 conn(0x55955ce2e6b0 msgr2=0x55955cfd0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 shutdown_connections 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3570308822 wait complete. 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.673+0000 7ff1d04f9b80 20 client.21411 trim_cache size 0 max 16384 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 Processor -- start 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 -- start start 2023-03-17T11:45:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd5830 0x55955cfdcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfdf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 0x55955cfcbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cfc70f0 con 0x55955cfdb040 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cfcc000 con 0x55955cfd61e0 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.688+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955cfd65f0 con 0x55955cfd5830 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 0x55955cfcbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 0x55955cfcbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56900/0 (socket says 172.21.15.35:56900) 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 -- 172.21.15.35:0/3636536743 learned_addr learned my addr 172.21.15.35:0/3636536743 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2108700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd5830 0x55955cfdcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c1907700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfdf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 -- 172.21.15.35:0/3636536743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd5830 msgr2=0x55955cfdcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd5830 0x55955cfdcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 -- 172.21.15.35:0/3636536743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 msgr2=0x55955cfdf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfdf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 -- 172.21.15.35:0/3636536743 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55955ceea130 con 0x55955cfdb040 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c1907700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfdf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:45:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2108700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd5830 0x55955cfdcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1c2909700 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 0x55955cfcbac0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ca0f0 tx=0x7ff1b40cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c79abf7be2c5f05 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1b15af700 1 -- 172.21.15.35:0/3636536743 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b409e1b0 con 0x55955cfdb040 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1b15af700 1 -- 172.21.15.35:0/3636536743 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1b4009490 con 0x55955cfdb040 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.689+0000 7ff1b15af700 1 -- 172.21.15.35:0/3636536743 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4099ab0 con 0x55955cfdb040 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3636536743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 msgr2=0x55955cfcbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 0x55955cfcbac0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ca0f0 tx=0x7ff1b40cc040 comp rx=0 tx=0).stop 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3636536743 shutdown_connections 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfdb040 0x55955cfcbac0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd5830 0x55955cfdcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/3636536743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfd61e0 0x55955cfdf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3636536743 >> 172.21.15.35:0/3636536743 conn(0x55955ce2e6b0 msgr2=0x55955cfde960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3636536743 shutdown_connections 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/3636536743 wait complete. 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- start start 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 Processor -- start 2023-03-17T11:45:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955d03b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd61e0 0x55955d03bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfdb040 0x55955d037340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955d037a50 con 0x55955cfd5830 2023-03-17T11:45:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955d037bc0 con 0x55955cfdb040 2023-03-17T11:45:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955d037d80 con 0x55955cfd61e0 2023-03-17T11:45:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.690+0000 7ff1d04f9b80 10 client.0 _ll_register_callbacks cb 0x55955cdc9230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:45:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955d03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955d03b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56902/0 (socket says 172.21.15.35:56902) 2023-03-17T11:45:25.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 -- 172.21.15.35:0/2366045469 learned_addr learned my addr 172.21.15.35:0/2366045469 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:25.141 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c1907700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd61e0 0x55955d03bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:25.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:43 smithi035 ceph-mon[92535]: pgmap v5565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T11:45:25.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:43 smithi035 ceph-mon[92535]: pgmap v5566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:45:25.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:45 smithi035 ceph-mon[92535]: pgmap v5567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:45:25.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:47 smithi035 ceph-mon[92535]: pgmap v5568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:45:25.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:49 smithi035 ceph-mon[92535]: pgmap v5569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:45:25.515 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:51 smithi035 ceph-mon[92535]: pgmap v5570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:45:26.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:53 smithi035 ceph-mon[92535]: pgmap v5571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:45:26.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:55 smithi035 ceph-mon[92535]: pgmap v5572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:45:26.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:57 smithi035 ceph-mon[92535]: pgmap v5573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:45:26.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:34:59 smithi035 ceph-mon[92535]: pgmap v5574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:45:26.381 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:01 smithi035 ceph-mon[92535]: pgmap v5575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:03 smithi035 ceph-mon[92535]: pgmap v5576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:05 smithi035 ceph-mon[92535]: pgmap v5577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:07 smithi035 ceph-mon[92535]: pgmap v5578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:09 smithi035 ceph-mon[92535]: pgmap v5579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:09 smithi035 ceph-mon[92535]: osdmap e417: 12 total, 12 up, 12 in 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:11 smithi035 ceph-mon[92535]: pgmap v5581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:13 smithi035 ceph-mon[92535]: pgmap v5582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:15 smithi035 ceph-mon[92535]: pgmap v5583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:17 smithi035 ceph-mon[92535]: pgmap v5584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:17 smithi035 ceph-mon[92535]: osdmap e418: 12 total, 12 up, 12 in 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:19 smithi035 ceph-mon[92535]: pgmap v5586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 105 B/s wr, 10 op/s 2023-03-17T11:45:26.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:21 smithi035 ceph-mon[92535]: pgmap v5587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:45:27.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:23 smithi035 ceph-mon[92535]: pgmap v5588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:45:27.288 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:25 smithi035 ceph-mon[92535]: pgmap v5589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:45:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:45:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2909700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfdb040 0x55955d037340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 -- 172.21.15.35:0/2366045469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd61e0 msgr2=0x55955d03bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd61e0 0x55955d03bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 -- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfdb040 msgr2=0x55955d037340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:31.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfdb040 0x55955d037340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:31.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 -- 172.21.15.35:0/2366045469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55955cda55d0 con 0x55955cfd5830 2023-03-17T11:45:31.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2909700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfdb040 0x55955d037340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:45:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1c2108700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955d03b720 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800b480 tx=0x7ff1b80319e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f75c0d8d9f426d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:45:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/2366045469 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8031ad0 con 0x55955cfd5830 2023-03-17T11:45:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/2366045469 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(389..389 src has 1..389) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff1b8005250 con 0x55955cfd5830 2023-03-17T11:45:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55955cfa11e0 con 0x55955cfd5830 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/2366045469 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1b8005410 con 0x55955cfd5830 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1d04f9b80 10 client.21417 fetch_fsmap learned FSMap version 108 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.691+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55955cd781f0 con 0x55955cfd5830 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/2366045469 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1b8047020 con 0x55955cfd5830 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/2366045469 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff1b8043470 con 0x55955cfd5830 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1d04f9b80 10 client.21417 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1d04f9b80 10 client.21417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1d04f9b80 20 client.21417 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955d044620 0x55955d046a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1d04f9b80 4 client.21417 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55955cda7f00 con 0x55955d044620 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.692+0000 7ff1c1907700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955d044620 0x55955d046a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.693+0000 7ff1a5ffb700 10 client.21417 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.693+0000 7ff1c1907700 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955d044620 0x55955d046a30 crc :-1 s=READY pgs=749 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483d3ef738ede918 server_cookie=7a1af47616e4d19a in_seq=0 out_seq=0 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1a5ffb700 1 -- 172.21.15.35:0/2366045469 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55955cda7f00 con 0x55955d044620 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1a5ffb700 10 client.21417 handle_command_reply: tid=0 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 client.21417 shutdown 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 msgr2=0x55955d03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955d03b720 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800b480 tx=0x7ff1b80319e0 comp rx=0 tx=0).stop 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 shutdown_connections 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55955d044620 0x55955d046a30 crc :-1 s=READY pgs=749 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55955cfdb040 0x55955d037340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1a5ffb700 0 client.21417 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55955cfd5830 0x55955d03b720 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 --2- 172.21.15.35:0/2366045469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55955cfd61e0 0x55955d03bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 >> 172.21.15.35:0/2366045469 conn(0x55955ce2e6b0 msgr2=0x55955cfdd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 shutdown_connections 2023-03-17T11:45:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 1 -- 172.21.15.35:0/2366045469 wait complete. 2023-03-17T11:45:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.709+0000 7ff1d04f9b80 20 client.21417 trim_cache size 0 max 16384 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff1a809f640 msgr2=0x7ff1a80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff1a809f640 0x7ff1a80a1af0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8005950 tx=0x7ff1b80058e0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 msgr2=0x7ff1bc199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 0x7ff1bc199b40 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007f10 tx=0x7ff1b400f5c0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 shutdown_connections 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff1a809f640 0x7ff1a80a1af0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff1bc104390 0x7ff1bc199b40 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1bc0ff350 0x7ff1bc1951a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 --2- 172.21.15.35:0/1601218887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1bc0ffcf0 0x7ff1bc1956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 >> 172.21.15.35:0/1601218887 conn(0x7ff1bc076330 msgr2=0x7ff1bc0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 shutdown_connections 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:19.710+0000 7ff1c436c700 1 -- 172.21.15.35:0/1601218887 wait complete. 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 -- 172.21.15.35:0/1125711816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c81044d0 msgr2=0x7f37c810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 --2- 172.21.15.35:0/1125711816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c81044d0 0x7f37c810c0a0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f37c000b0d0 tx=0x7f37c000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 -- 172.21.15.35:0/1125711816 shutdown_connections 2023-03-17T11:45:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 --2- 172.21.15.35:0/1125711816 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c81044d0 0x7f37c810c0a0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 --2- 172.21.15.35:0/1125711816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37c80ff4b0 0x7f37c80ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 --2- 172.21.15.35:0/1125711816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37c80ffe50 0x7f37c8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 -- 172.21.15.35:0/1125711816 >> 172.21.15.35:0/1125711816 conn(0x7f37c8077220 msgr2=0x7f37c8077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 -- 172.21.15.35:0/1125711816 shutdown_connections 2023-03-17T11:45:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.832+0000 7f37cda29700 1 -- 172.21.15.35:0/1125711816 wait complete. 2023-03-17T11:45:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 Processor -- start 2023-03-17T11:45:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 -- start start 2023-03-17T11:45:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 0x7f37c81963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37c80ffe50 0x7f37c8196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:40.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37c81044d0 0x7f37c819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c819b3c0 con 0x7f37c80ff4b0 2023-03-17T11:45:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c819b530 con 0x7f37c80ffe50 2023-03-17T11:45:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.833+0000 7f37cda29700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c819b6f0 con 0x7f37c81044d0 2023-03-17T11:45:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 0x7f37c81963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 0x7f37c81963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56916/0 (socket says 172.21.15.35:56916) 2023-03-17T11:45:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 -- 172.21.15.35:0/1919429535 learned_addr learned my addr 172.21.15.35:0/1919429535 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c77fe700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37c81044d0 0x7f37c819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c67fc700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37c80ffe50 0x7f37c8196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 -- 172.21.15.35:0/1919429535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37c81044d0 msgr2=0x7f37c819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37c81044d0 0x7f37c819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 -- 172.21.15.35:0/1919429535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37c80ffe50 msgr2=0x7f37c8196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37c80ffe50 0x7f37c8196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 -- 172.21.15.35:0/1919429535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0009d00 con 0x7f37c80ff4b0 2023-03-17T11:45:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 0x7f37c81963e0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f37b800e9a0 tx=0x7f37b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37cca27700 1 -- 172.21.15.35:0/1919429535 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8009790 con 0x7f37c80ff4b0 2023-03-17T11:45:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37cca27700 1 -- 172.21.15.35:0/1919429535 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b800cbd0 con 0x7f37c80ff4b0 2023-03-17T11:45:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c810f0e0 con 0x7f37c80ff4b0 2023-03-17T11:45:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37cca27700 1 -- 172.21.15.35:0/1919429535 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8018680 con 0x7f37c80ff4b0 2023-03-17T11:45:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.834+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c810ef50 con 0x7f37c80ff4b0 2023-03-17T11:45:42.612 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37cca27700 1 -- 172.21.15.35:0/1919429535 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f37b800cd40 con 0x7f37c80ff4b0 2023-03-17T11:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37cca27700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37b009f640 0x7f37b00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37c67fc700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37b009f640 0x7f37b00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37cca27700 1 -- 172.21.15.35:0/1919429535 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(389..389 src has 1..389) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37b8014070 con 0x7f37c80ff4b0 2023-03-17T11:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37c67fc700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37b009f640 0x7f37b00a1af0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f37c81979f0 tx=0x7f37bc00d4b0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37d9bb6b80 1 Processor -- start 2023-03-17T11:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37d9bb6b80 1 -- start start 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.838+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed039fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed034420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed034d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fecf3b010 con 0x556fed034960 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fecf8d950 con 0x556fed039be0 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fecf86de0 con 0x556fed03a4f0 2023-03-17T11:45:44.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed034d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:44.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed034d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56928/0 (socket says 172.21.15.35:56928) 2023-03-17T11:45:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 -- 172.21.15.35:0/828437845 learned_addr learned my addr 172.21.15.35:0/828437845 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:44.849 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed039fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c67fc700 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed034420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 -- 172.21.15.35:0/828437845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 msgr2=0x556fed034420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed034420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 -- 172.21.15.35:0/828437845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 msgr2=0x556fed039fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed039fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 -- 172.21.15.35:0/828437845 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fece085d0 con 0x556fed034960 2023-03-17T11:45:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37c77fe700 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed034d90 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f37c0005ad0 tx=0x7f37c0009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d99200de9dccf9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37adffb700 1 -- 172.21.15.35:0/828437845 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000e040 con 0x556fed034960 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37adffb700 1 -- 172.21.15.35:0/828437845 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37c0007b90 con 0x556fed034960 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.839+0000 7f37adffb700 1 -- 172.21.15.35:0/828437845 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0003c60 con 0x556fed034960 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/828437845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 msgr2=0x556fed034d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed034d90 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f37c0005ad0 tx=0x7f37c0009c90 comp rx=0 tx=0).stop 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/828437845 shutdown_connections 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed034d90 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed039fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/828437845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed034420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/828437845 >> 172.21.15.35:0/828437845 conn(0x556fece916b0 msgr2=0x556fed02ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/828437845 shutdown_connections 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.840+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/828437845 wait complete. 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 -- start start 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 Processor -- start 2023-03-17T11:45:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed03d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fece0a8c0 con 0x556fed034960 2023-03-17T11:45:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed03e410 con 0x556fed03a4f0 2023-03-17T11:45:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed049fd0 con 0x556fed039be0 2023-03-17T11:45:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.841+0000 7f37d9bb6b80 10 client.0 _ll_register_callbacks cb 0x556fece2c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:45:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56930/0 (socket says 172.21.15.35:56930) 2023-03-17T11:45:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 -- 172.21.15.35:0/4272066747 learned_addr learned my addr 172.21.15.35:0/4272066747 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c77fe700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c67fc700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed03d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 -- 172.21.15.35:0/4272066747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 msgr2=0x556fed03d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:47.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed03d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:47.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 -- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 msgr2=0x556fed03dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 -- 172.21.15.35:0/4272066747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c810c8b0 con 0x556fed034960 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c67fc700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed03d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0403f0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f37b8098170 tx=0x7f37b8097f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8498ac4c751a61 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37a6ffd700 1 -- 172.21.15.35:0/4272066747 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8097b60 con 0x556fed034960 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37a6ffd700 1 -- 172.21.15.35:0/4272066747 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(389..389 src has 1..389) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37b80a01d0 con 0x556fed034960 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fecf49390 con 0x556fed034960 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37a6ffd700 1 -- 172.21.15.35:0/4272066747 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b80a0390 con 0x556fed034960 2023-03-17T11:45:48.083 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37d9bb6b80 10 client.21429 fetch_fsmap learned FSMap version 108 2023-03-17T11:45:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x556fecdb4d80 con 0x556fed034960 2023-03-17T11:45:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.842+0000 7f37a6ffd700 1 -- 172.21.15.35:0/4272066747 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b80b4020 con 0x556fed034960 2023-03-17T11:45:48.084 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37a6ffd700 1 -- 172.21.15.35:0/4272066747 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f37b80c6c80 con 0x556fed034960 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37d9bb6b80 10 client.21429 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37d9bb6b80 10 client.21429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37d9bb6b80 20 client.21429 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed04e020 0x556fed050430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37d9bb6b80 4 client.21429 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556fecf55600 con 0x556fed04e020 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37c67fc700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed04e020 0x556fed050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37a6ffd700 10 client.21429 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:48.489 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:27 smithi035 ceph-mon[92535]: pgmap v5590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:45:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.843+0000 7f37c67fc700 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed04e020 0x556fed050430 crc :-1 s=READY pgs=750 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95036019cd67473 server_cookie=2b811eeb2625e0da in_seq=0 out_seq=0 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37a6ffd700 1 -- 172.21.15.35:0/4272066747 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x556fecf55600 con 0x556fed04e020 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37a6ffd700 10 client.21429 handle_command_reply: tid=0 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 client.21429 shutdown 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 msgr2=0x556fed0403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0403f0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f37b8098170 tx=0x7f37b8097f00 comp rx=0 tx=0).stop 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 shutdown_connections 2023-03-17T11:45:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed04e020 0x556fed050430 crc :-1 s=READY pgs=750 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37a6ffd700 0 client.21429 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0403f0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/4272066747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed03d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 >> 172.21.15.35:0/4272066747 conn(0x556fece916b0 msgr2=0x556fed02ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.844+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 shutdown_connections 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.845+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/4272066747 wait complete. 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.845+0000 7f37d9bb6b80 20 client.21429 trim_cache size 0 max 16384 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 Processor -- start 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 -- start start 2023-03-17T11:45:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed02eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed044f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed02f000 con 0x556fed034960 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed02b5c0 con 0x556fed03a4f0 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed02f6d0 con 0x556fed039be0 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed02eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed02eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56938/0 (socket says 172.21.15.35:56938) 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3208263167 learned_addr learned my addr 172.21.15.35:0/3208263167 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c67fc700 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed044f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c77fe700 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3208263167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 msgr2=0x556fed044f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed044f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3208263167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 msgr2=0x556fed03b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3208263167 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fed035000 con 0x556fed034960 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c77fe700 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:45:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed02eac0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f37b8098400 tx=0x7f37b80948e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59db85a8cedb809f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37ae7fc700 1 -- 172.21.15.35:0/3208263167 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80974a0 con 0x556fed034960 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37ae7fc700 1 -- 172.21.15.35:0/3208263167 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b80b4070 con 0x556fed034960 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.860+0000 7f37ae7fc700 1 -- 172.21.15.35:0/3208263167 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80a0410 con 0x556fed034960 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3208263167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 msgr2=0x556fed02eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed02eac0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f37b8098400 tx=0x7f37b80948e0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3208263167 shutdown_connections 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed03a4f0 0x556fed03b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed02eac0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3208263167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed039be0 0x556fed044f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3208263167 >> 172.21.15.35:0/3208263167 conn(0x556fece916b0 msgr2=0x556fed03a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3208263167 shutdown_connections 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3208263167 wait complete. 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.861+0000 7f37d9bb6b80 1 -- start start 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 Processor -- start 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed036ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed0356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed035be0 con 0x556fed034960 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed035d50 con 0x556fed039be0 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fed035f10 con 0x556fed03a4f0 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37d9bb6b80 10 client.0 _ll_register_callbacks cb 0x556fece2c230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56944/0 (socket says 172.21.15.35:56944) 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3122142210 learned_addr learned my addr 172.21.15.35:0/3122142210 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c67fc700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed036ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c77fe700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed0356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3122142210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 msgr2=0x556fed0356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed0356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 msgr2=0x556fed036ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed036ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 -- 172.21.15.35:0/3122142210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fecdb4d80 con 0x556fed034960 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c67fc700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed036ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c77fe700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed0356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37c6ffd700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0369b0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f37b80967c0 tx=0x7f37b80a0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a71af7791d2b34 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.862+0000 7f37a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37a6ffd700 1 -- 172.21.15.35:0/3122142210 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80974a0 con 0x556fed034960 2023-03-17T11:45:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37a6ffd700 1 -- 172.21.15.35:0/3122142210 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(389..389 src has 1..389) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f37b80b5080 con 0x556fed034960 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fed0041e0 con 0x556fed034960 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37a6ffd700 1 -- 172.21.15.35:0/3122142210 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b80b6430 con 0x556fed034960 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 10 client.21435 fetch_fsmap learned FSMap version 108 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x556fecd9dc00 con 0x556fed034960 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37a6ffd700 1 -- 172.21.15.35:0/3122142210 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556fed0041e0 con 0x556fed034960 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37a6ffd700 1 -- 172.21.15.35:0/3122142210 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f37b8099250 con 0x556fed034960 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 10 client.21435 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 10 client.21435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 20 client.21435 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed0a2880 0x556fed0a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 4 client.21435 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556fece0af00 con 0x556fed0a2880 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.863+0000 7f37c67fc700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed0a2880 0x556fed0a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.864+0000 7f37c67fc700 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed0a2880 0x556fed0a4c60 crc :-1 s=READY pgs=751 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5094034f08a64cc server_cookie=5ccd0a93bfb03092 in_seq=0 out_seq=0 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.864+0000 7f37a6ffd700 10 client.21435 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37a6ffd700 1 -- 172.21.15.35:0/3122142210 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556fece0af00 con 0x556fed0a2880 2023-03-17T11:45:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37a6ffd700 10 client.21435 handle_command_reply: tid=0 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 client.21435 shutdown 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 msgr2=0x556fed0369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0369b0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f37b80967c0 tx=0x7f37b80a0570 comp rx=0 tx=0).stop 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 shutdown_connections 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x556fed0a2880 0x556fed0a4c60 crc :-1 s=READY pgs=751 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556fed03a4f0 0x556fed0356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x556fed034960 0x556fed0369b0 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37a6ffd700 0 client.21435 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 --2- 172.21.15.35:0/3122142210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556fed039be0 0x556fed036ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 >> 172.21.15.35:0/3122142210 conn(0x556fece916b0 msgr2=0x556fed038790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 shutdown_connections 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 1 -- 172.21.15.35:0/3122142210 wait complete. 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.872+0000 7f37d9bb6b80 20 client.21435 trim_cache size 0 max 16384 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37b009f640 msgr2=0x7f37b00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37b009f640 0x7f37b00a1af0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f37c81979f0 tx=0x7f37bc00d4b0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 msgr2=0x7f37c81963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 0x7f37c81963e0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f37b800e9a0 tx=0x7f37b800ecb0 comp rx=0 tx=0).stop 2023-03-17T11:45:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 shutdown_connections 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f37b009f640 0x7f37b00a1af0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37c81044d0 0x7f37c819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f37c80ff4b0 0x7f37c81963e0 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 --2- 172.21.15.35:0/1919429535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37c80ffe50 0x7f37c8196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 >> 172.21.15.35:0/1919429535 conn(0x7f37c8077220 msgr2=0x7f37c80692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 shutdown_connections 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:21:32.873+0000 7f37cda29700 1 -- 172.21.15.35:0/1919429535 wait complete. 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 -- 172.21.15.35:0/2584564404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 msgr2=0x7f826c103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 --2- 172.21.15.35:0/2584564404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c103cb0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f82600099c0 tx=0x7f8260009cd0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 -- 172.21.15.35:0/2584564404 shutdown_connections 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 --2- 172.21.15.35:0/2584564404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f826c104390 0x7f826c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 --2- 172.21.15.35:0/2584564404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0ff350 0x7f826c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 --2- 172.21.15.35:0/2584564404 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c103cb0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 -- 172.21.15.35:0/2584564404 >> 172.21.15.35:0/2584564404 conn(0x7f826c076330 msgr2=0x7f826c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 -- 172.21.15.35:0/2584564404 shutdown_connections 2023-03-17T11:45:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.291+0000 7f8270862700 1 -- 172.21.15.35:0/2584564404 wait complete. 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.292+0000 7f8270862700 1 Processor -- start 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.292+0000 7f8270862700 1 -- start start 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.292+0000 7f8270862700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0ff350 0x7f826c100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8270862700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8270862700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f826c104390 0x7f826c1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8270862700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c101ac0 con 0x7f826c0ffcf0 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8270862700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1a4970 con 0x7f826c104390 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8270862700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c1a4ab0 con 0x7f826c0ff350 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56974/0 (socket says 172.21.15.35:56974) 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 -- 172.21.15.35:0/2043154731 learned_addr learned my addr 172.21.15.35:0/2043154731 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f826a59c700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0ff350 0x7f826c100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f826ad9d700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f826c104390 0x7f826c1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 -- 172.21.15.35:0/2043154731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0ff350 msgr2=0x7f826c100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0ff350 0x7f826c100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 -- 172.21.15.35:0/2043154731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f826c104390 msgr2=0x7f826c1a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f826c104390 0x7f826c1a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 -- 172.21.15.35:0/2043154731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600095f0 con 0x7f826c0ffcf0 2023-03-17T11:45:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8269d9b700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c101290 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f826000b580 tx=0x7f8260009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f825b7fe700 1 -- 172.21.15.35:0/2043154731 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826001d070 con 0x7f826c0ffcf0 2023-03-17T11:45:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f825b7fe700 1 -- 172.21.15.35:0/2043154731 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82600058e0 con 0x7f826c0ffcf0 2023-03-17T11:45:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c10efc0 con 0x7f826c0ffcf0 2023-03-17T11:45:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.293+0000 7f825b7fe700 1 -- 172.21.15.35:0/2043154731 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260022a70 con 0x7f826c0ffcf0 2023-03-17T11:45:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.294+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c10ee30 con 0x7f826c0ffcf0 2023-03-17T11:45:50.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.296+0000 7f825b7fe700 1 -- 172.21.15.35:0/2043154731 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f8260003a30 con 0x7f826c0ffcf0 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.297+0000 7f825b7fe700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f825409f6c0 0x7f82540a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.297+0000 7f825b7fe700 1 -- 172.21.15.35:0/2043154731 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(391..391 src has 1..391) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f82600cb630 con 0x7f826c0ffcf0 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.297+0000 7f826a59c700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f825409f6c0 0x7f82540a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.297+0000 7f826a59c700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f825409f6c0 0x7f82540a1b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f825c007be0 tx=0x7f825c0073d0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 Processor -- start 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 -- start start 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7c4f0 0x5623ebe76420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.927 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe76960 0x5623ebe76d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:50.928 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebd7d010 con 0x5623ebe7bbe0 2023-03-17T11:45:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebdcf950 con 0x5623ebe76960 2023-03-17T11:45:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f827c9efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebdc8de0 con 0x5623ebe7c4f0 2023-03-17T11:45:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f826a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f826a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56980/0 (socket says 172.21.15.35:56980) 2023-03-17T11:45:51.872 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:29 smithi035 ceph-mon[92535]: pgmap v5591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T11:45:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f826a59c700 1 -- 172.21.15.35:0/3250329400 learned_addr learned my addr 172.21.15.35:0/3250329400 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.298+0000 7f8269d9b700 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7c4f0 0x5623ebe76420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826ad9d700 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe76960 0x5623ebe76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826a59c700 1 -- 172.21.15.35:0/3250329400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7c4f0 msgr2=0x5623ebe76420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826a59c700 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7c4f0 0x5623ebe76420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826a59c700 1 -- 172.21.15.35:0/3250329400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe76960 msgr2=0x5623ebe76d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826a59c700 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe76960 0x5623ebe76d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826a59c700 1 -- 172.21.15.35:0/3250329400 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623ebc4a5d0 con 0x5623ebe7bbe0 2023-03-17T11:45:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f826a59c700 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7bfb0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f825c010e80 tx=0x7f825c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fde129e39fa76 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f8258ff9700 1 -- 172.21.15.35:0/3250329400 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c010eb0 con 0x5623ebe7bbe0 2023-03-17T11:45:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f8258ff9700 1 -- 172.21.15.35:0/3250329400 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f825c003b10 con 0x5623ebe7bbe0 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.299+0000 7f8258ff9700 1 -- 172.21.15.35:0/3250329400 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c011a90 con 0x5623ebe7bbe0 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 -- 172.21.15.35:0/3250329400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 msgr2=0x5623ebe7bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7bfb0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f825c010e80 tx=0x7f825c013000 comp rx=0 tx=0).stop 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 -- 172.21.15.35:0/3250329400 shutdown_connections 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe76960 0x5623ebe76d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7bfb0 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3250329400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7c4f0 0x5623ebe76420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 -- 172.21.15.35:0/3250329400 >> 172.21.15.35:0/3250329400 conn(0x5623ebcd36b0 msgr2=0x5623ebe70a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 -- 172.21.15.35:0/3250329400 shutdown_connections 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 -- 172.21.15.35:0/3250329400 wait complete. 2023-03-17T11:45:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 -- start start 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.300+0000 7f827c9efb80 1 Processor -- start 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 0x5623ebe824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebc4c8c0 con 0x5623ebe76960 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe80670 con 0x5623ebe7c4f0 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe8c000 con 0x5623ebe7bbe0 2023-03-17T11:45:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 10 client.0 _ll_register_callbacks cb 0x5623ebc6e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:45:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 0x5623ebe824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 0x5623ebe824d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56986/0 (socket says 172.21.15.35:56986) 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 -- 172.21.15.35:0/2561753005 learned_addr learned my addr 172.21.15.35:0/2561753005 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f8269d9b700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826ad9d700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 -- 172.21.15.35:0/2561753005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7bbe0 msgr2=0x5623ebe7f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 -- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 msgr2=0x5623ebe7ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:45:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 -- 172.21.15.35:0/2561753005 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c010b60 con 0x5623ebe76960 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f826a59c700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 0x5623ebe824d0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f825c005790 tx=0x7f825c011600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775bfac091e8bfd2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f8251ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f8251ffb700 1 -- 172.21.15.35:0/2561753005 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c011b60 con 0x5623ebe76960 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f8251ffb700 1 -- 172.21.15.35:0/2561753005 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(391..391 src has 1..391) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f825c017070 con 0x5623ebe76960 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.301+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623ebd8b390 con 0x5623ebe76960 2023-03-17T11:45:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f8251ffb700 1 -- 172.21.15.35:0/2561753005 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f825c011cc0 con 0x5623ebe76960 2023-03-17T11:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 10 client.21447 fetch_fsmap learned FSMap version 108 2023-03-17T11:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5623ebbf6d80 con 0x5623ebe76960 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f8251ffb700 1 -- 172.21.15.35:0/2561753005 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623ebd8b390 con 0x5623ebe76960 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f8251ffb700 1 -- 172.21.15.35:0/2561753005 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f825c01f690 con 0x5623ebe76960 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 10 client.21447 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 10 client.21447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 20 client.21447 populate_metadata read hostname 'smithi035' 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebe8ff90 0x5623ebe92370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 4 client.21447 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623ebd97600 con 0x5623ebe8ff90 2023-03-17T11:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.302+0000 7f8269d9b700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebe8ff90 0x5623ebe92370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.303+0000 7f8251ffb700 10 client.21447 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.303+0000 7f8269d9b700 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebe8ff90 0x5623ebe92370 crc :-1 s=READY pgs=752 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a069f7a09873c44 server_cookie=4443b38ae0731227 in_seq=0 out_seq=0 2023-03-17T11:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f8251ffb700 1 -- 172.21.15.35:0/2561753005 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5623ebd97600 con 0x5623ebe8ff90 2023-03-17T11:45:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f8251ffb700 10 client.21447 handle_command_reply: tid=0 2023-03-17T11:45:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 client.21447 shutdown 2023-03-17T11:45:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 msgr2=0x5623ebe824d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:45:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 0x5623ebe824d0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f825c005790 tx=0x7f825c011600 comp rx=0 tx=0).stop 2023-03-17T11:45:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 shutdown_connections 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebe8ff90 0x5623ebe92370 crc :-1 s=READY pgs=752 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f8251ffb700 0 client.21447 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe76960 0x5623ebe824d0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 --2- 172.21.15.35:0/2561753005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe7bbe0 0x5623ebe7f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 >> 172.21.15.35:0/2561753005 conn(0x5623ebcd36b0 msgr2=0x5623ebe75410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 shutdown_connections 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 1 -- 172.21.15.35:0/2561753005 wait complete. 2023-03-17T11:45:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.304+0000 7f827c9efb80 20 client.21447 trim_cache size 0 max 16384 2023-03-17T11:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.319+0000 7f827c9efb80 1 Processor -- start 2023-03-17T11:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.319+0000 7f827c9efb80 1 -- start start 2023-03-17T11:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.319+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe86f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.319+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe82070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.319+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:45:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f827c9efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe80930 con 0x5623ebe7bbe0 2023-03-17T11:45:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f827c9efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebd97630 con 0x5623ebe7c4f0 2023-03-17T11:45:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f827c9efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe8cb50 con 0x5623ebe76960 2023-03-17T11:45:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe82070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe82070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:56996/0 (socket says 172.21.15.35:56996) 2023-03-17T11:46:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 -- 172.21.15.35:0/3087828758 learned_addr learned my addr 172.21.15.35:0/3087828758 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f826ad9d700 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f826a59c700 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe86f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 -- 172.21.15.35:0/3087828758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 msgr2=0x5623ebe86f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe86f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 -- 172.21.15.35:0/3087828758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 msgr2=0x5623ebe7ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 -- 172.21.15.35:0/3087828758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623ebe77000 con 0x5623ebe7bbe0 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f826a59c700 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe86f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f8269d9b700 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe82070 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f8260099100 tx=0x7f82600cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38649481c54d2be server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f82597fa700 1 -- 172.21.15.35:0/3087828758 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82600041d0 con 0x5623ebe7bbe0 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f82597fa700 1 -- 172.21.15.35:0/3087828758 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8260097510 con 0x5623ebe7bbe0 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.320+0000 7f82597fa700 1 -- 172.21.15.35:0/3087828758 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260003ce0 con 0x5623ebe7bbe0 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 -- 172.21.15.35:0/3087828758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 msgr2=0x5623ebe82070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe82070 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f8260099100 tx=0x7f82600cb040 comp rx=0 tx=0).stop 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 -- 172.21.15.35:0/3087828758 shutdown_connections 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7c4f0 0x5623ebe7ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe86f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3087828758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7bbe0 0x5623ebe82070 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 -- 172.21.15.35:0/3087828758 >> 172.21.15.35:0/3087828758 conn(0x5623ebcd36b0 msgr2=0x5623ebe8c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 -- 172.21.15.35:0/3087828758 shutdown_connections 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 -- 172.21.15.35:0/3087828758 wait complete. 2023-03-17T11:46:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 -- start start 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.321+0000 7f827c9efb80 1 Processor -- start 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe869b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7bbe0 0x5623ebe86ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 0x5623ebe84f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe85640 con 0x5623ebe7c4f0 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe857b0 con 0x5623ebe7bbe0 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623ebe85970 con 0x5623ebe76960 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 10 client.0 _ll_register_callbacks cb 0x5623ebc6e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:46:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 0x5623ebe84f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 0x5623ebe84f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57004/0 (socket says 172.21.15.35:57004) 2023-03-17T11:46:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 -- 172.21.15.35:0/3594538124 learned_addr learned my addr 172.21.15.35:0/3594538124 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826a59c700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f8269d9b700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7bbe0 0x5623ebe86ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:04.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 -- 172.21.15.35:0/3594538124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 msgr2=0x5623ebe869b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe869b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 -- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7bbe0 msgr2=0x5623ebe86ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7bbe0 0x5623ebe86ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 -- 172.21.15.35:0/3594538124 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82600c8770 con 0x5623ebe7c4f0 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f8269d9b700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7bbe0 0x5623ebe86ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f826ad9d700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 0x5623ebe84f30 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f82640042a0 tx=0x7f82640042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b418f5a6d512a75 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f8251ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f8251ffb700 1 -- 172.21.15.35:0/3594538124 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264007700 con 0x5623ebe7c4f0 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f8251ffb700 1 -- 172.21.15.35:0/3594538124 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(391..391 src has 1..391) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f8264007860 con 0x5623ebe7c4f0 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.322+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623ebe461e0 con 0x5623ebe7c4f0 2023-03-17T11:46:08.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f8251ffb700 1 -- 172.21.15.35:0/3594538124 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8264007a20 con 0x5623ebe7c4f0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 10 client.21453 fetch_fsmap learned FSMap version 108 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5623ebbdfc00 con 0x5623ebe7c4f0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f8251ffb700 1 -- 172.21.15.35:0/3594538124 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623ebe461e0 con 0x5623ebe7c4f0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f8251ffb700 1 -- 172.21.15.35:0/3594538124 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f8264020c80 con 0x5623ebe7c4f0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 10 client.21453 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 10 client.21453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 20 client.21453 populate_metadata read hostname 'smithi035' 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebee5000 0x5623ebee7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 4 client.21453 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623ebc4cf00 con 0x5623ebee5000 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.323+0000 7f826a59c700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebee5000 0x5623ebee7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.324+0000 7f8251ffb700 10 client.21453 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.324+0000 7f826a59c700 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebee5000 0x5623ebee7410 crc :-1 s=READY pgs=753 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e21a797ee7d69420 server_cookie=1709d3bab0303e57 in_seq=0 out_seq=0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f8251ffb700 1 -- 172.21.15.35:0/3594538124 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623ebc4cf00 con 0x5623ebee5000 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f8251ffb700 10 client.21453 handle_command_reply: tid=0 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 client.21453 shutdown 2023-03-17T11:46:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 msgr2=0x5623ebe84f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 0x5623ebe84f30 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f82640042a0 tx=0x7f82640042d0 comp rx=0 tx=0).stop 2023-03-17T11:46:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 shutdown_connections 2023-03-17T11:46:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5623ebee5000 0x5623ebee7410 crc :-1 s=READY pgs=753 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5623ebe7c4f0 0x5623ebe84f30 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f8251ffb700 0 client.21453 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:46:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623ebe76960 0x5623ebe869b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 --2- 172.21.15.35:0/3594538124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623ebe7bbe0 0x5623ebe86ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 >> 172.21.15.35:0/3594538124 conn(0x5623ebcd36b0 msgr2=0x5623ebe79650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 shutdown_connections 2023-03-17T11:46:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 1 -- 172.21.15.35:0/3594538124 wait complete. 2023-03-17T11:46:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.341+0000 7f827c9efb80 20 client.21453 trim_cache size 0 max 16384 2023-03-17T11:46:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f825409f6c0 msgr2=0x7f82540a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f825409f6c0 0x7f82540a1b70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f825c007be0 tx=0x7f825c0073d0 comp rx=0 tx=0).stop 2023-03-17T11:46:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 msgr2=0x7f826c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:10.409 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:31 smithi035 ceph-mon[92535]: pgmap v5592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:46:11.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c101290 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f826000b580 tx=0x7f8260009580 comp rx=0 tx=0).stop 2023-03-17T11:46:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 shutdown_connections 2023-03-17T11:46:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f825409f6c0 0x7f82540a1b70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f826c104390 0x7f826c1a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0ff350 0x7f826c100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 --2- 172.21.15.35:0/2043154731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f826c0ffcf0 0x7f826c101290 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:13.532 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 >> 172.21.15.35:0/2043154731 conn(0x7f826c076330 msgr2=0x7f826c0680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 shutdown_connections 2023-03-17T11:46:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:22:52.342+0000 7f8270862700 1 -- 172.21.15.35:0/2043154731 wait complete. 2023-03-17T11:46:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 -- 172.21.15.35:0/1540758398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ffd00 msgr2=0x7f5ea010a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/1540758398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ffd00 0x7f5ea010a770 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f5e880099c0 tx=0x7f5e88009cd0 comp rx=0 tx=0).stop 2023-03-17T11:46:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 -- 172.21.15.35:0/1540758398 shutdown_connections 2023-03-17T11:46:13.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/1540758398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea010acb0 0x7f5ea010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/1540758398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea00ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/1540758398 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ffd00 0x7f5ea010a770 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 -- 172.21.15.35:0/1540758398 >> 172.21.15.35:0/1540758398 conn(0x7f5ea00749e0 msgr2=0x7f5ea0074de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 -- 172.21.15.35:0/1540758398 shutdown_connections 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 -- 172.21.15.35:0/1540758398 wait complete. 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 Processor -- start 2023-03-17T11:46:15.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.466+0000 7f5ea59e8700 1 -- start start 2023-03-17T11:46:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea0196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:15.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea00ffd00 0x7f5ea01967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea010acb0 0x7f5ea019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea019b250 con 0x7f5ea00ff3f0 2023-03-17T11:46:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea019b3c0 con 0x7f5ea00ffd00 2023-03-17T11:46:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea019b580 con 0x7f5ea010acb0 2023-03-17T11:46:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea0196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea0196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57014/0 (socket says 172.21.15.35:57014) 2023-03-17T11:46:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 -- 172.21.15.35:0/776572837 learned_addr learned my addr 172.21.15.35:0/776572837 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e97fff700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea00ffd00 0x7f5ea01967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:19.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9f7fe700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea010acb0 0x7f5ea019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:19.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 -- 172.21.15.35:0/776572837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea010acb0 msgr2=0x7f5ea019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:19.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea010acb0 0x7f5ea019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:19.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 -- 172.21.15.35:0/776572837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea00ffd00 msgr2=0x7f5ea01967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:19.719 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea00ffd00 0x7f5ea01967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:19.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 -- 172.21.15.35:0/776572837 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880095f0 con 0x7f5ea00ff3f0 2023-03-17T11:46:19.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5e9effd700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea0196270 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000e9a0 tx=0x7f5e9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:19.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea49e6700 1 -- 172.21.15.35:0/776572837 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90009790 con 0x7f5ea00ff3f0 2023-03-17T11:46:19.720 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea49e6700 1 -- 172.21.15.35:0/776572837 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e90010430 con 0x7f5ea00ff3f0 2023-03-17T11:46:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea0110150 con 0x7f5ea00ff3f0 2023-03-17T11:46:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.467+0000 7f5ea49e6700 1 -- 172.21.15.35:0/776572837 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000cea0 con 0x7f5ea00ff3f0 2023-03-17T11:46:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.468+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea010ffc0 con 0x7f5ea00ff3f0 2023-03-17T11:46:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.470+0000 7f5ea49e6700 1 -- 172.21.15.35:0/776572837 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5e900105a0 con 0x7f5ea00ff3f0 2023-03-17T11:46:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.471+0000 7f5ea49e6700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e8c09f6c0 0x7f5e8c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.471+0000 7f5ea49e6700 1 -- 172.21.15.35:0/776572837 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(391..391 src has 1..391) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5e90014070 con 0x7f5ea00ff3f0 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.471+0000 7f5e97fff700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e8c09f6c0 0x7f5e8c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e8c09f6c0 0x7f5e8c0a1b70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800b580 tx=0x7f5e88005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 Processor -- start 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 -- start start 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc97dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 0x5566cc978420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc978960 0x5566cc978d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc87f010 con 0x5566cc97e4f0 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc8d1950 con 0x5566cc97dbe0 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc8cade0 con 0x5566cc978960 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 0x5566cc978420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 0x5566cc978420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57024/0 (socket says 172.21.15.35:57024) 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 -- 172.21.15.35:0/2902486974 learned_addr learned my addr 172.21.15.35:0/2902486974 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e9effd700 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc97dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e9f7fe700 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc978960 0x5566cc978d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 -- 172.21.15.35:0/2902486974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc978960 msgr2=0x5566cc978d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc978960 0x5566cc978d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 -- 172.21.15.35:0/2902486974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 msgr2=0x5566cc97dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:26.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc97dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e97fff700 1 -- 172.21.15.35:0/2902486974 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566cc74c5d0 con 0x5566cc97e4f0 2023-03-17T11:46:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.472+0000 7f5e9effd700 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc97dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:46:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.473+0000 7f5e97fff700 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 0x5566cc978420 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f5e88015000 tx=0x7f5e8801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c419ba0ddb4f6c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.473+0000 7f5e95ffb700 1 -- 172.21.15.35:0/2902486974 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88028070 con 0x5566cc97e4f0 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.473+0000 7f5e95ffb700 1 -- 172.21.15.35:0/2902486974 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e8801e040 con 0x5566cc97e4f0 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.473+0000 7f5e95ffb700 1 -- 172.21.15.35:0/2902486974 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800f6c0 con 0x5566cc97e4f0 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/2902486974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 msgr2=0x5566cc978420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 0x5566cc978420 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f5e88015000 tx=0x7f5e8801f000 comp rx=0 tx=0).stop 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/2902486974 shutdown_connections 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc978960 0x5566cc978d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc97dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/2902486974 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc97e4f0 0x5566cc978420 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/2902486974 >> 172.21.15.35:0/2902486974 conn(0x5566cc7d56b0 msgr2=0x5566cc972a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/2902486974 shutdown_connections 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/2902486974 wait complete. 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 -- start start 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.474+0000 7f5eb1b75b80 1 Processor -- start 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc9844b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc981730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc981dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc74e8c0 con 0x5566cc978960 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc982540 con 0x5566cc97dbe0 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc98df20 con 0x5566cc97e4f0 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 10 client.0 _ll_register_callbacks cb 0x5566cc770230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:46:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc9844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc9844b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57028/0 (socket says 172.21.15.35:57028) 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 -- 172.21.15.35:0/4009179699 learned_addr learned my addr 172.21.15.35:0/4009179699 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e97fff700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc981730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9f7fe700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc981dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 -- 172.21.15.35:0/4009179699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 msgr2=0x5566cc981dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc981dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 -- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 msgr2=0x5566cc981730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc981730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 -- 172.21.15.35:0/4009179699 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea010d8f0 con 0x5566cc978960 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e9effd700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc9844b0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f5e90094850 tx=0x7f5e90010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7e104edecadb5e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e7effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e7effd700 1 -- 172.21.15.35:0/4009179699 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9009c160 con 0x5566cc978960 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e7effd700 1 -- 172.21.15.35:0/4009179699 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(391..391 src has 1..391) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5e900a0540 con 0x5566cc978960 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566cc88d390 con 0x5566cc978960 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.475+0000 7f5e7effd700 1 -- 172.21.15.35:0/4009179699 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e900a00b0 con 0x5566cc978960 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 10 client.21465 fetch_fsmap learned FSMap version 108 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5566cc6f8d80 con 0x5566cc978960 2023-03-17T11:46:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5e7effd700 1 -- 172.21.15.35:0/4009179699 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e900b4020 con 0x5566cc978960 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5e7effd700 1 -- 172.21.15.35:0/4009179699 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5e900972b0 con 0x5566cc978960 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 10 client.21465 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 10 client.21465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 20 client.21465 populate_metadata read hostname 'smithi035' 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc992100 0x5566cc9944e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 4 client.21465 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566cc899600 con 0x5566cc992100 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5e97fff700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc992100 0x5566cc9944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5e7effd700 10 client.21465 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.476+0000 7f5e97fff700 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc992100 0x5566cc9944e0 crc :-1 s=READY pgs=754 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=560a06ba8058c043 server_cookie=9e0761e0753a9a09 in_seq=0 out_seq=0 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5e7effd700 1 -- 172.21.15.35:0/4009179699 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5566cc899600 con 0x5566cc992100 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5e7effd700 10 client.21465 handle_command_reply: tid=0 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 client.21465 shutdown 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 msgr2=0x5566cc9844b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:29.201 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc9844b0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f5e90094850 tx=0x7f5e90010880 comp rx=0 tx=0).stop 2023-03-17T11:46:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 shutdown_connections 2023-03-17T11:46:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc992100 0x5566cc9944e0 crc :-1 s=READY pgs=754 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc981dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc9844b0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5e7effd700 0 client.21465 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:46:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/4009179699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc981730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.477+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 >> 172.21.15.35:0/4009179699 conn(0x5566cc7d56b0 msgr2=0x5566cc977410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.478+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 shutdown_connections 2023-03-17T11:46:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.478+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/4009179699 wait complete. 2023-03-17T11:46:29.997 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.478+0000 7f5eb1b75b80 20 client.21465 trim_cache size 0 max 16384 2023-03-17T11:46:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 Processor -- start 2023-03-17T11:46:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 -- start start 2023-03-17T11:46:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc988ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc984050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc97b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc9787d0 con 0x5566cc978960 2023-03-17T11:46:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc98f770 con 0x5566cc97dbe0 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc97d800 con 0x5566cc97e4f0 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc988ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc988ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57036/0 (socket says 172.21.15.35:57036) 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.493+0000 7f5e9effd700 1 -- 172.21.15.35:0/3483662630 learned_addr learned my addr 172.21.15.35:0/3483662630 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9f7fe700 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc97b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e97fff700 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc984050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:32.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9effd700 1 -- 172.21.15.35:0/3483662630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 msgr2=0x5566cc97b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9effd700 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc97b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9effd700 1 -- 172.21.15.35:0/3483662630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 msgr2=0x5566cc984050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9effd700 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc984050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9effd700 1 -- 172.21.15.35:0/3483662630 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566cc891130 con 0x5566cc978960 2023-03-17T11:46:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e97fff700 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc984050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:46:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e9effd700 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc988ef0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000e970 tx=0x7f5e90098250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64a66d384235fef server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e967fc700 1 -- 172.21.15.35:0/3483662630 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9009c160 con 0x5566cc978960 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e967fc700 1 -- 172.21.15.35:0/3483662630 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e900b4070 con 0x5566cc978960 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.494+0000 7f5e967fc700 1 -- 172.21.15.35:0/3483662630 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90094500 con 0x5566cc978960 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/3483662630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 msgr2=0x5566cc988ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc988ef0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000e970 tx=0x7f5e90098250 comp rx=0 tx=0).stop 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/3483662630 shutdown_connections 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97e4f0 0x5566cc97b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:33.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc988ef0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:33 smithi035 ceph-mon[92535]: pgmap v5593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:35 smithi035 ceph-mon[92535]: pgmap v5594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:37 smithi035 ceph-mon[92535]: pgmap v5595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:39 smithi035 ceph-mon[92535]: pgmap v5596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:41 smithi035 ceph-mon[92535]: pgmap v5597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:42 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:46:33.457 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:43 smithi035 ceph-mon[92535]: pgmap v5598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:46:33.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:46:33.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:46:33.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:46:33.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:44 smithi035 ceph-mon[92535]: pgmap v5599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:44 smithi035 ceph-mon[92535]: pgmap v5600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:46 smithi035 ceph-mon[92535]: pgmap v5601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:48 smithi035 ceph-mon[92535]: pgmap v5602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:50 smithi035 ceph-mon[92535]: pgmap v5603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:52 smithi035 ceph-mon[92535]: pgmap v5604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:54 smithi035 ceph-mon[92535]: pgmap v5605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:56 smithi035 ceph-mon[92535]: pgmap v5606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:35:58 smithi035 ceph-mon[92535]: pgmap v5607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:46:35.881 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:00 smithi035 ceph-mon[92535]: pgmap v5608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:02 smithi035 ceph-mon[92535]: pgmap v5609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:04 smithi035 ceph-mon[92535]: pgmap v5610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:06 smithi035 ceph-mon[92535]: pgmap v5611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:08 smithi035 ceph-mon[92535]: pgmap v5612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:09 smithi035 ceph-mon[92535]: osdmap e419: 12 total, 12 up, 12 in 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:10 smithi035 ceph-mon[92535]: pgmap v5614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:46:37.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:12 smithi035 ceph-mon[92535]: pgmap v5615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:46:37.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:14 smithi035 ceph-mon[92535]: pgmap v5616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:46:37.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:16 smithi035 ceph-mon[92535]: pgmap v5617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:46:37.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:18 smithi035 ceph-mon[92535]: pgmap v5618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:46:37.613 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:18 smithi035 ceph-mon[92535]: osdmap e420: 12 total, 12 up, 12 in 2023-03-17T11:46:38.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:20 smithi035 ceph-mon[92535]: pgmap v5620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:46:38.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:22 smithi035 ceph-mon[92535]: pgmap v5621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:46:38.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:24 smithi035 ceph-mon[92535]: pgmap v5622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:46:38.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:26 smithi035 ceph-mon[92535]: pgmap v5623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:46:38.242 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:28 smithi035 ceph-mon[92535]: pgmap v5624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:46:39.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:30 smithi035 ceph-mon[92535]: pgmap v5625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T11:46:39.426 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:32 smithi035 ceph-mon[92535]: pgmap v5626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:39.426 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:34 smithi035 ceph-mon[92535]: pgmap v5627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:46:41.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:36 smithi035 ceph-mon[92535]: pgmap v5628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:41.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:38 smithi035 ceph-mon[92535]: pgmap v5629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:46:42.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:40 smithi035 ceph-mon[92535]: pgmap v5630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:42.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:42 smithi035 ceph-mon[92535]: pgmap v5631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:42.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:43 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:46:42.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:44 smithi035 ceph-mon[92535]: pgmap v5632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:46:42.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:46:42.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:46:42.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:46:42.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:45 smithi035 ceph-mon[92535]: pgmap v5633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:46:42.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:45 smithi035 ceph-mon[92535]: pgmap v5634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T11:46:42.558 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:47 smithi035 ceph-mon[92535]: pgmap v5635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:46:43.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:49 smithi035 ceph-mon[92535]: pgmap v5636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T11:46:43.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:51 smithi035 ceph-mon[92535]: pgmap v5637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T11:46:43.202 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:53 smithi035 ceph-mon[92535]: pgmap v5638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T11:46:44.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:55 smithi035 ceph-mon[92535]: pgmap v5639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:46:44.825 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:57 smithi035 ceph-mon[92535]: pgmap v5640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:46:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:46:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:46:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/3483662630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97dbe0 0x5566cc984050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/3483662630 >> 172.21.15.35:0/3483662630 conn(0x5566cc7d56b0 msgr2=0x5566cc977a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/3483662630 shutdown_connections 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/3483662630 wait complete. 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 -- start start 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.495+0000 7f5eb1b75b80 1 Processor -- start 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc986c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97dbe0 0x5566cc987150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97e4f0 0x5566cc9e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:46.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc9878d0 con 0x5566cc978960 2023-03-17T11:46:46.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc9e54e0 con 0x5566cc97e4f0 2023-03-17T11:46:46.165 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cc9e56a0 con 0x5566cc97dbe0 2023-03-17T11:46:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 10 client.0 _ll_register_callbacks cb 0x5566cc770230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:46:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc986c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc986c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57042/0 (socket says 172.21.15.35:57042) 2023-03-17T11:46:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 -- 172.21.15.35:0/1440337847 learned_addr learned my addr 172.21.15.35:0/1440337847 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e97fff700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97dbe0 0x5566cc987150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:48.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9f7fe700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97e4f0 0x5566cc9e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 -- 172.21.15.35:0/1440337847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97dbe0 msgr2=0x5566cc987150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97dbe0 0x5566cc987150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 -- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97e4f0 msgr2=0x5566cc9e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97e4f0 0x5566cc9e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 -- 172.21.15.35:0/1440337847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566cc6f8d80 con 0x5566cc978960 2023-03-17T11:46:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e9effd700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc986c10 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f5e900a0010 tx=0x7f5e900984d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7939639b68c3653 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e7effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:46:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e7effd700 1 -- 172.21.15.35:0/1440337847 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e900b62b0 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5e7effd700 1 -- 172.21.15.35:0/1440337847 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(391..391 src has 1..391) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5e9007b060 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.496+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566cc9481e0 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5e7effd700 1 -- 172.21.15.35:0/1440337847 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e900a0540 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 10 client.21471 fetch_fsmap learned FSMap version 108 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5566cc71f1f0 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5e7effd700 1 -- 172.21.15.35:0/1440337847 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5566cc9481e0 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5e7effd700 1 -- 172.21.15.35:0/1440337847 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5e900b0570 con 0x5566cc978960 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 10 client.21471 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 10 client.21471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 20 client.21471 populate_metadata read hostname 'smithi035' 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc9e68c0 0x5566cc9e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 4 client.21471 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:46:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5566cc74ef00 con 0x5566cc9e68c0 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5e97fff700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc9e68c0 0x5566cc9e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5e97fff700 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc9e68c0 0x5566cc9e8ca0 crc :-1 s=READY pgs=755 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49cc8ab08019bad1 server_cookie=9b6b779eeb495bed in_seq=0 out_seq=0 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.497+0000 7f5e7effd700 10 client.21471 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5e7effd700 1 -- 172.21.15.35:0/1440337847 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5566cc74ef00 con 0x5566cc9e68c0 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5e7effd700 10 client.21471 handle_command_reply: tid=0 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 client.21471 shutdown 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 msgr2=0x5566cc986c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc986c10 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f5e900a0010 tx=0x7f5e900984d0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 shutdown_connections 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5566cc9e68c0 0x5566cc9e8ca0 crc :-1 s=READY pgs=755 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566cc97e4f0 0x5566cc9e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5566cc978960 0x5566cc986c10 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 --2- 172.21.15.35:0/1440337847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5566cc97dbe0 0x5566cc987150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5e7effd700 0 client.21471 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:46:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 >> 172.21.15.35:0/1440337847 conn(0x5566cc7d56b0 msgr2=0x5566cc97b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 shutdown_connections 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 1 -- 172.21.15.35:0/1440337847 wait complete. 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.518+0000 7f5eb1b75b80 20 client.21471 trim_cache size 0 max 16384 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e8c09f6c0 msgr2=0x7f5e8c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e8c09f6c0 0x7f5e8c0a1b70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800b580 tx=0x7f5e88005c00 comp rx=0 tx=0).stop 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 msgr2=0x7f5ea0196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea0196270 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000e9a0 tx=0x7f5e9000ecb0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 shutdown_connections 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5e8c09f6c0 0x7f5e8c0a1b70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea010acb0 0x7f5ea019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5ea00ff3f0 0x7f5ea0196270 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 --2- 172.21.15.35:0/776572837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ea00ffd00 0x7f5ea01967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 >> 172.21.15.35:0/776572837 conn(0x7f5ea00749e0 msgr2=0x7f5ea00fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 shutdown_connections 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:05.519+0000 7f5ea59e8700 1 -- 172.21.15.35:0/776572837 wait complete. 2023-03-17T11:46:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 -- 172.21.15.35:0/486094065 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d48104390 msgr2=0x7f2d4810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/486094065 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d48104390 0x7f2d4810bf60 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b0d0 tx=0x7f2d4000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 -- 172.21.15.35:0/486094065 shutdown_connections 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/486094065 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d48104390 0x7f2d4810bf60 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/486094065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ff350 0x7f2d480ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/486094065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d480ffcf0 0x7f2d48103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 -- 172.21.15.35:0/486094065 >> 172.21.15.35:0/486094065 conn(0x7f2d48076330 msgr2=0x7f2d48076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 -- 172.21.15.35:0/486094065 shutdown_connections 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.641+0000 7f2d4d41a700 1 -- 172.21.15.35:0/486094065 wait complete. 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 Processor -- start 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 -- start start 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 0x7f2d48195240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ffcf0 0x7f2d48195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d48104390 0x7f2d48199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4819a220 con 0x7f2d480ff350 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4819a390 con 0x7f2d480ffcf0 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d4d41a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4819a550 con 0x7f2d48104390 2023-03-17T11:46:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.642+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 0x7f2d48195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 0x7f2d48195240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57056/0 (socket says 172.21.15.35:57056) 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 -- 172.21.15.35:0/1671921767 learned_addr learned my addr 172.21.15.35:0/1671921767 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d467fc700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ffcf0 0x7f2d48195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d477fe700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d48104390 0x7f2d48199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 -- 172.21.15.35:0/1671921767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d48104390 msgr2=0x7f2d48199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d48104390 0x7f2d48199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 -- 172.21.15.35:0/1671921767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ffcf0 msgr2=0x7f2d48195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ffcf0 0x7f2d48195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 -- 172.21.15.35:0/1671921767 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009d00 con 0x7f2d480ff350 2023-03-17T11:46:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d467fc700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ffcf0 0x7f2d48195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:46:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 0x7f2d48195240 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00e9a0 tx=0x7f2d3c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d2ffff700 1 -- 172.21.15.35:0/1671921767 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c009790 con 0x7f2d480ff350 2023-03-17T11:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d2ffff700 1 -- 172.21.15.35:0/1671921767 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d3c00cbd0 con 0x7f2d480ff350 2023-03-17T11:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4810efc0 con 0x7f2d480ff350 2023-03-17T11:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d2ffff700 1 -- 172.21.15.35:0/1671921767 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c018680 con 0x7f2d480ff350 2023-03-17T11:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.643+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4810ee30 con 0x7f2d480ff350 2023-03-17T11:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.645+0000 7f2d2ffff700 1 -- 172.21.15.35:0/1671921767 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2d3c00cd40 con 0x7f2d480ff350 2023-03-17T11:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.646+0000 7f2d2ffff700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2d3009f640 0x7f2d300a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.646+0000 7f2d467fc700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2d3009f640 0x7f2d300a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.647+0000 7f2d2ffff700 1 -- 172.21.15.35:0/1671921767 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2d3c014070 con 0x7f2d480ff350 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.647+0000 7f2d467fc700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2d3009f640 0x7f2d300a1af0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2d48196850 tx=0x7f2d38009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.647+0000 7f2d595a7b80 1 Processor -- start 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 -- start start 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a8dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a88420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a88d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37698f010 con 0x55c376a8dbe0 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3769e1950 con 0x55c376a88960 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3769dade0 con 0x55c376a8e4f0 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a8dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a8dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57064/0 (socket says 172.21.15.35:57064) 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 -- 172.21.15.35:0/331247258 learned_addr learned my addr 172.21.15.35:0/331247258 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d477fe700 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a88d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d467fc700 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a88420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:46:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 -- 172.21.15.35:0/331247258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 msgr2=0x55c376a88420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a88420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 -- 172.21.15.35:0/331247258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 msgr2=0x55c376a88d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:46:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a88d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 -- 172.21.15.35:0/331247258 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c37685c5d0 con 0x55c376a8dbe0 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d477fe700 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a88d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a8dfb0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0949f0 tx=0x7f2d3c098140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669d9e70d1a50f85 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.648+0000 7f2d2d7fa700 1 -- 172.21.15.35:0/331247258 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0966f0 con 0x55c376a8dbe0 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d2d7fa700 1 -- 172.21.15.35:0/331247258 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d3c098750 con 0x55c376a8dbe0 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d2d7fa700 1 -- 172.21.15.35:0/331247258 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0a0450 con 0x55c376a8dbe0 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 -- 172.21.15.35:0/331247258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 msgr2=0x55c376a8dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a8dfb0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0949f0 tx=0x7f2d3c098140 comp rx=0 tx=0).stop 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 -- 172.21.15.35:0/331247258 shutdown_connections 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a88d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a8dfb0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/331247258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a88420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 -- 172.21.15.35:0/331247258 >> 172.21.15.35:0/331247258 conn(0x55c3768e56b0 msgr2=0x55c376a82a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 -- 172.21.15.35:0/331247258 shutdown_connections 2023-03-17T11:46:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.649+0000 7f2d595a7b80 1 -- 172.21.15.35:0/331247258 wait complete. 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 -- start start 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 Processor -- start 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a94460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a916e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a91d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c37685e8c0 con 0x55c376a8dbe0 2023-03-17T11:46:57.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376a924d0 con 0x55c376a88960 2023-03-17T11:47:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376a9e000 con 0x55c376a8e4f0 2023-03-17T11:47:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d595a7b80 10 client.0 _ll_register_callbacks cb 0x55c376880230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:47:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a916e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a916e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57072/0 (socket says 172.21.15.35:57072) 2023-03-17T11:47:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a94460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 -- 172.21.15.35:0/2758318432 learned_addr learned my addr 172.21.15.35:0/2758318432 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d477fe700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a91d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 -- 172.21.15.35:0/2758318432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 msgr2=0x55c376a91d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a91d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 -- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 msgr2=0x55c376a94460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a94460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d467fc700 1 -- 172.21.15.35:0/2758318432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4810ee30 con 0x55c376a8dbe0 2023-03-17T11:47:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d477fe700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a91d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:00.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:36:59 smithi035 ceph-mon[92535]: pgmap v5641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:47:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.650+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a94460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d467fc700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a916e0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f2d3801c780 tx=0x7f2d380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefddb8b7cbc9983 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d2aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d2aff5700 1 -- 172.21.15.35:0/2758318432 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38021070 con 0x55c376a8dbe0 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d2aff5700 1 -- 172.21.15.35:0/2758318432 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2d3801cc70 con 0x55c376a8dbe0 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c37699d390 con 0x55c376a8dbe0 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d2aff5700 1 -- 172.21.15.35:0/2758318432 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d3801ce30 con 0x55c376a8dbe0 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 10 client.21483 fetch_fsmap learned FSMap version 108 2023-03-17T11:47:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55c376808d80 con 0x55c376a8dbe0 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d2aff5700 1 -- 172.21.15.35:0/2758318432 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c37699d390 con 0x55c376a8dbe0 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d2aff5700 1 -- 172.21.15.35:0/2758318432 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2d3801a410 con 0x55c376a8dbe0 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 10 client.21483 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 10 client.21483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 20 client.21483 populate_metadata read hostname 'smithi035' 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376aa2110 0x55c376aa4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 4 client.21483 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.651+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3769a9600 con 0x55c376aa2110 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.652+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376aa2110 0x55c376aa4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.652+0000 7f2d2aff5700 10 client.21483 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.652+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376aa2110 0x55c376aa4520 crc :-1 s=READY pgs=756 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853bb1450ef9e127 server_cookie=dd12b5f77a89b34c in_seq=0 out_seq=0 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d2aff5700 1 -- 172.21.15.35:0/2758318432 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55c3769a9600 con 0x55c376aa2110 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d2aff5700 10 client.21483 handle_command_reply: tid=0 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 client.21483 shutdown 2023-03-17T11:47:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 msgr2=0x55c376a916e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a916e0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f2d3801c780 tx=0x7f2d380047c0 comp rx=0 tx=0).stop 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 shutdown_connections 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376aa2110 0x55c376aa4520 crc :-1 s=READY pgs=756 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a91d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a88960 0x55c376a94460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d2aff5700 0 client.21483 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2758318432 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8dbe0 0x55c376a916e0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 >> 172.21.15.35:0/2758318432 conn(0x55c3768e56b0 msgr2=0x55c376a87410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 shutdown_connections 2023-03-17T11:47:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2758318432 wait complete. 2023-03-17T11:47:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.653+0000 7f2d595a7b80 20 client.21483 trim_cache size 0 max 16384 2023-03-17T11:47:07.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 Processor -- start 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 -- start start 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 0x55c376a82ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a98f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a9d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376a83000 con 0x55c376a88960 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376a7e0d0 con 0x55c376a8dbe0 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376a92610 con 0x55c376a8e4f0 2023-03-17T11:47:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 0x55c376a82ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:07.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d46ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 0x55c376a82ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57078/0 (socket says 172.21.15.35:57078) 2023-03-17T11:47:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.668+0000 7f2d46ffd700 1 -- 172.21.15.35:0/2556226411 learned_addr learned my addr 172.21.15.35:0/2556226411 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d467fc700 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a98f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d46ffd700 1 -- 172.21.15.35:0/2556226411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 msgr2=0x55c376a9d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d477fe700 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a9d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:08.451 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a9d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d46ffd700 1 -- 172.21.15.35:0/2556226411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 msgr2=0x55c376a98f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a98f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d46ffd700 1 -- 172.21.15.35:0/2556226411 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c376a89000 con 0x55c376a88960 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d467fc700 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a98f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 0x55c376a82ac0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0c8280 tx=0x7f2d3c00efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4433ac93a840a9b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d2dffb700 1 -- 172.21.15.35:0/2556226411 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0979e0 con 0x55c376a88960 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d2dffb700 1 -- 172.21.15.35:0/2556226411 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d3c097b40 con 0x55c376a88960 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.669+0000 7f2d2dffb700 1 -- 172.21.15.35:0/2556226411 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0976b0 con 0x55c376a88960 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2556226411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 msgr2=0x55c376a82ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 0x55c376a82ac0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0c8280 tx=0x7f2d3c00efa0 comp rx=0 tx=0).stop 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2556226411 shutdown_connections 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a8e4f0 0x55c376a9d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a88960 0x55c376a82ac0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/2556226411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a98f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2556226411 >> 172.21.15.35:0/2556226411 conn(0x55c3768e56b0 msgr2=0x55c376a87b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:08.452 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2556226411 shutdown_connections 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- 172.21.15.35:0/2556226411 wait complete. 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- start start 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 Processor -- start 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a88960 0x55c376a97120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a97660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 0x55c376af9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376a97db0 con 0x55c376a8e4f0 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376af98c0 con 0x55c376a8dbe0 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c376af9a80 con 0x55c376a88960 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d595a7b80 10 client.0 _ll_register_callbacks cb 0x55c376880230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 0x55c376af9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d477fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 0x55c376af9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57088/0 (socket says 172.21.15.35:57088) 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.670+0000 7f2d477fe700 1 -- 172.21.15.35:0/1332067921 learned_addr learned my addr 172.21.15.35:0/1332067921 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a88960 0x55c376a97120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d477fe700 1 -- 172.21.15.35:0/1332067921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a88960 msgr2=0x55c376a97120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d477fe700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a88960 0x55c376a97120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:09.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d467fc700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a97660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d477fe700 1 -- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 msgr2=0x55c376a97660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d477fe700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a97660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d477fe700 1 -- 172.21.15.35:0/1332067921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c37685c5d0 con 0x55c376a8e4f0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a88960 0x55c376a97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d467fc700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a97660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d477fe700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 0x55c376af9380 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b0d0 tx=0x7f2d40007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5535460c6440031d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d2aff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d2aff5700 1 -- 172.21.15.35:0/1332067921 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000e040 con 0x55c376a8e4f0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d2aff5700 1 -- 172.21.15.35:0/1332067921 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2d400074e0 con 0x55c376a8e4f0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c376a581e0 con 0x55c376a8e4f0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d2aff5700 1 -- 172.21.15.35:0/1332067921 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d400076e0 con 0x55c376a8e4f0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d595a7b80 10 client.21489 fetch_fsmap learned FSMap version 108 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55c3767f1c00 con 0x55c376a8e4f0 2023-03-17T11:47:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.671+0000 7f2d2aff5700 1 -- 172.21.15.35:0/1332067921 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c376a581e0 con 0x55c376a8e4f0 2023-03-17T11:47:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d2aff5700 1 -- 172.21.15.35:0/1332067921 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2d40023020 con 0x55c376a8e4f0 2023-03-17T11:47:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d595a7b80 10 client.21489 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:47:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d595a7b80 10 client.21489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:47:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d595a7b80 20 client.21489 populate_metadata read hostname 'smithi035' 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376afb1f0 0x55c376afd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d595a7b80 4 client.21489 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c37685ef00 con 0x55c376afb1f0 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376afb1f0 0x55c376afd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d46ffd700 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376afb1f0 0x55c376afd600 crc :-1 s=READY pgs=757 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a28dc209875f808 server_cookie=a5acacca40580785 in_seq=0 out_seq=0 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.672+0000 7f2d2aff5700 10 client.21489 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d2aff5700 1 -- 172.21.15.35:0/1332067921 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c37685ef00 con 0x55c376afb1f0 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d2aff5700 10 client.21489 handle_command_reply: tid=0 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d595a7b80 1 client.21489 shutdown 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 msgr2=0x55c376af9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 0x55c376af9380 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000b0d0 tx=0x7f2d40007ee0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 shutdown_connections 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.689+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55c376afb1f0 0x55c376afd600 crc :-1 s=READY pgs=757 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55c376a8e4f0 0x55c376af9380 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d2aff5700 0 client.21489 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c376a88960 0x55c376a97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 1 --2- 172.21.15.35:0/1332067921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c376a8dbe0 0x55c376a97660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 >> 172.21.15.35:0/1332067921 conn(0x55c3768e56b0 msgr2=0x55c376a9e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 shutdown_connections 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 1 -- 172.21.15.35:0/1332067921 wait complete. 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d595a7b80 20 client.21489 trim_cache size 0 max 16384 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2d3009f640 msgr2=0x7f2d300a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2d3009f640 0x7f2d300a1af0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2d48196850 tx=0x7f2d38009260 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 msgr2=0x7f2d48195240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 0x7f2d48195240 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00e9a0 tx=0x7f2d3c00ed60 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 shutdown_connections 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2d3009f640 0x7f2d300a1af0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d48104390 0x7f2d48199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2d480ff350 0x7f2d48195240 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 --2- 172.21.15.35:0/1671921767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d480ffcf0 0x7f2d48195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 >> 172.21.15.35:0/1671921767 conn(0x7f2d48076330 msgr2=0x7f2d480fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 shutdown_connections 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:18.690+0000 7f2d4d41a700 1 -- 172.21.15.35:0/1671921767 wait complete. 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 -- 172.21.15.35:0/1902425382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f88104390 msgr2=0x7f6f8810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 --2- 172.21.15.35:0/1902425382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f88104390 0x7f6f8810bf60 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b0d0 tx=0x7f6f8000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 -- 172.21.15.35:0/1902425382 shutdown_connections 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 --2- 172.21.15.35:0/1902425382 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f88104390 0x7f6f8810bf60 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 --2- 172.21.15.35:0/1902425382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f880ff350 0x7f6f880ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 --2- 172.21.15.35:0/1902425382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f880ffcf0 0x7f6f88103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 -- 172.21.15.35:0/1902425382 >> 172.21.15.35:0/1902425382 conn(0x7f6f88076330 msgr2=0x7f6f88076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 -- 172.21.15.35:0/1902425382 shutdown_connections 2023-03-17T11:47:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.812+0000 7f6f904c5700 1 -- 172.21.15.35:0/1902425382 wait complete. 2023-03-17T11:47:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.813+0000 7f6f904c5700 1 Processor -- start 2023-03-17T11:47:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.813+0000 7f6f904c5700 1 -- start start 2023-03-17T11:47:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f904c5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 0x7f6f88195240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:13.867 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f904c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f880ffcf0 0x7f6f88195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f904c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f88104390 0x7f6f88199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f904c5700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8819a220 con 0x7f6f880ff350 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f904c5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8819a390 con 0x7f6f880ffcf0 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f904c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8819a550 con 0x7f6f88104390 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 0x7f6f88195240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 0x7f6f88195240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57098/0 (socket says 172.21.15.35:57098) 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 -- 172.21.15.35:0/396183321 learned_addr learned my addr 172.21.15.35:0/396183321 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8da60700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f880ffcf0 0x7f6f88195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f88104390 0x7f6f88199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 -- 172.21.15.35:0/396183321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f88104390 msgr2=0x7f6f88199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f88104390 0x7f6f88199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 -- 172.21.15.35:0/396183321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f880ffcf0 msgr2=0x7f6f88195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f880ffcf0 0x7f6f88195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 -- 172.21.15.35:0/396183321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80009d00 con 0x7f6f880ff350 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f88104390 0x7f6f88199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:47:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.814+0000 7f6f8e261700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 0x7f6f88195240 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400d980 tx=0x7f6f8400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.815+0000 7f6f7f7fe700 1 -- 172.21.15.35:0/396183321 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84004220 con 0x7f6f880ff350 2023-03-17T11:47:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.815+0000 7f6f7f7fe700 1 -- 172.21.15.35:0/396183321 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6f84007640 con 0x7f6f880ff350 2023-03-17T11:47:13.869 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:01 smithi035 ceph-mon[92535]: pgmap v5642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:47:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.815+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8810efc0 con 0x7f6f880ff350 2023-03-17T11:47:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.815+0000 7f6f7f7fe700 1 -- 172.21.15.35:0/396183321 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840055e0 con 0x7f6f880ff350 2023-03-17T11:47:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.815+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8810ee30 con 0x7f6f880ff350 2023-03-17T11:47:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.817+0000 7f6f7f7fe700 1 -- 172.21.15.35:0/396183321 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6f84004750 con 0x7f6f880ff350 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.818+0000 7f6f7f7fe700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6f7409f6c0 0x7f6f740a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.818+0000 7f6f7f7fe700 1 -- 172.21.15.35:0/396183321 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6f840ca460 con 0x7f6f880ff350 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.818+0000 7f6f8da60700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6f7409f6c0 0x7f6f740a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f8da60700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6f7409f6c0 0x7f6f740a1b70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6f88196850 tx=0x7f6f78009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 Processor -- start 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 -- start start 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d82218fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82213420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8211a010 con 0x560d82213960 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8216c950 con 0x560d82218be0 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.819+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d82165de0 con 0x560d822194f0 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57110/0 (socket says 172.21.15.35:57110) 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 -- 172.21.15.35:0/1370883604 learned_addr learned my addr 172.21.15.35:0/1370883604 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82213420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d82218fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 -- 172.21.15.35:0/1370883604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 msgr2=0x560d82213420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82213420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 -- 172.21.15.35:0/1370883604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 msgr2=0x560d82218fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d82218fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 -- 172.21.15.35:0/1370883604 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d81fe75d0 con 0x560d82213960 2023-03-17T11:47:15.525 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d82218fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82213420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:47:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213d90 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009c90 tx=0x7f6f800092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cce03f4bfab391 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f7cff9700 1 -- 172.21.15.35:0/1370883604 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000e030 con 0x560d82213960 2023-03-17T11:47:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f7cff9700 1 -- 172.21.15.35:0/1370883604 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6f80007d90 con 0x560d82213960 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.820+0000 7f6f7cff9700 1 -- 172.21.15.35:0/1370883604 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80004c90 con 0x560d82213960 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1370883604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 msgr2=0x560d82213d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213d90 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009c90 tx=0x7f6f800092e0 comp rx=0 tx=0).stop 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1370883604 shutdown_connections 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213d90 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d82218fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1370883604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82213420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1370883604 >> 172.21.15.35:0/1370883604 conn(0x560d820706b0 msgr2=0x560d8220da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1370883604 shutdown_connections 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.821+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1370883604 wait complete. 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 -- start start 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 Processor -- start 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d8221f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d8221c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d8221cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d81fe98c0 con 0x560d82218be0 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8221d410 con 0x560d822194f0 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d82228fd0 con 0x560d82213960 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f9c652b80 10 client.0 _ll_register_callbacks cb 0x560d8200b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f8da60700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d8221c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f8da60700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d8221c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57114/0 (socket says 172.21.15.35:57114) 2023-03-17T11:47:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.822+0000 7f6f8da60700 1 -- 172.21.15.35:0/1532946488 learned_addr learned my addr 172.21.15.35:0/1532946488 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d8221cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:20.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d8221f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8da60700 1 -- 172.21.15.35:0/1532946488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 msgr2=0x560d8221f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:20.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d8221f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8da60700 1 -- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 msgr2=0x560d8221cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d8221cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8da60700 1 -- 172.21.15.35:0/1532946488 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8810c7a0 con 0x560d82218be0 2023-03-17T11:47:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d8221c670 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f6f7801a960 tx=0x7f6f780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c350f0b2e485de server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1532946488 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78004030 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d82128390 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1532946488 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6f78004190 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1532946488 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f78004350 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f9c652b80 10 client.21501 fetch_fsmap learned FSMap version 108 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x560d81f93d80 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.823+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1532946488 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d82128390 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1532946488 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6f78003970 con 0x560d82218be0 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f9c652b80 10 client.21501 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f9c652b80 10 client.21501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f9c652b80 20 client.21501 populate_metadata read hostname 'smithi035' 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d8222d090 0x560d8222f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f9c652b80 4 client.21501 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:47:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d82134600 con 0x560d8222d090 2023-03-17T11:47:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d8222d090 0x560d8222f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f71ffb700 10 client.21501 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.824+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d8222d090 0x560d8222f4a0 crc :-1 s=READY pgs=758 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f09c90462b194f2d server_cookie=37ea20cff878a8c7 in_seq=0 out_seq=0 2023-03-17T11:47:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1532946488 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560d82134600 con 0x560d8222d090 2023-03-17T11:47:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f71ffb700 10 client.21501 handle_command_reply: tid=0 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 client.21501 shutdown 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 msgr2=0x560d8221c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d8221c670 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f6f7801a960 tx=0x7f6f780047c0 comp rx=0 tx=0).stop 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 shutdown_connections 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d8222d090 0x560d8222f4a0 crc :-1 s=READY pgs=758 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d8221cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d8221f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1532946488 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d8221c670 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f71ffb700 0 client.21501 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 >> 172.21.15.35:0/1532946488 conn(0x560d820706b0 msgr2=0x560d8220da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 shutdown_connections 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1532946488 wait complete. 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.825+0000 7f6f9c652b80 20 client.21501 trim_cache size 0 max 16384 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 Processor -- start 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 -- start start 2023-03-17T11:47:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d8220dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82223f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8220e000 con 0x560d82213960 2023-03-17T11:47:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d822090d0 con 0x560d82218be0 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8220a5c0 con 0x560d822194f0 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57120/0 (socket says 172.21.15.35:57120) 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 -- 172.21.15.35:0/396800522 learned_addr learned my addr 172.21.15.35:0/396800522 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8da60700 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d8220dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 -- 172.21.15.35:0/396800522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 msgr2=0x560d82223f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82223f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82223f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 -- 172.21.15.35:0/396800522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 msgr2=0x560d8220dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d8220dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.841+0000 7f6f8e261700 1 -- 172.21.15.35:0/396800522 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d8212c130 con 0x560d82213960 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f8e261700 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213420 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f6f84094920 tx=0x7f6f840074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a528256549339b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f7d7fa700 1 -- 172.21.15.35:0/396800522 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840a00a0 con 0x560d82213960 2023-03-17T11:47:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f7d7fa700 1 -- 172.21.15.35:0/396800522 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6f84095ff0 con 0x560d82213960 2023-03-17T11:47:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f7d7fa700 1 -- 172.21.15.35:0/396800522 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84097600 con 0x560d82213960 2023-03-17T11:47:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f9c652b80 1 -- 172.21.15.35:0/396800522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 msgr2=0x560d82213420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213420 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f6f84094920 tx=0x7f6f840074f0 comp rx=0 tx=0).stop 2023-03-17T11:47:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f9c652b80 1 -- 172.21.15.35:0/396800522 shutdown_connections 2023-03-17T11:47:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d822194f0 0x560d82223f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82213960 0x560d82213420 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.842+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/396800522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d82218be0 0x560d8220dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- 172.21.15.35:0/396800522 >> 172.21.15.35:0/396800522 conn(0x560d820706b0 msgr2=0x560d82216840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- 172.21.15.35:0/396800522 shutdown_connections 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- 172.21.15.35:0/396800522 wait complete. 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- start start 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 Processor -- start 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d82224110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d82214a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d82215180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d82215850 con 0x560d82218be0 2023-03-17T11:47:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d82280f30 con 0x560d822194f0 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.843+0000 7f6f9c652b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d82281070 con 0x560d82213960 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f9c652b80 10 client.0 _ll_register_callbacks cb 0x560d8200b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d82214a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d82214a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57128/0 (socket says 172.21.15.35:57128) 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 -- 172.21.15.35:0/1635860123 learned_addr learned my addr 172.21.15.35:0/1635860123 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d82224110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d82215180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 -- 172.21.15.35:0/1635860123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 msgr2=0x560d82224110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d82224110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 -- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 msgr2=0x560d82215180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d82215180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 -- 172.21.15.35:0/1635860123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8810ee30 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d82224110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8ea62700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d82215180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f8da60700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d82214a90 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f6f78003d50 tx=0x7f6f78009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce7fec81272abf3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1635860123 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780039d0 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1635860123 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6f78003fc0 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d821e31e0 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1635860123 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f78004180 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f9c652b80 10 client.21507 fetch_fsmap learned FSMap version 108 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.844+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x560d81fba1f0 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1635860123 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d821e31e0 con 0x560d82218be0 2023-03-17T11:47:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1635860123 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6f7802a6c0 con 0x560d82218be0 2023-03-17T11:47:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f9c652b80 10 client.21507 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:47:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f9c652b80 10 client.21507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:47:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f9c652b80 20 client.21507 populate_metadata read hostname 'smithi035' 2023-03-17T11:47:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d82282640 0x560d82284a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f9c652b80 4 client.21507 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:47:30.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:03 smithi035 ceph-mon[92535]: pgmap v5643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:47:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d81fe9f00 con 0x560d82282640 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d82282640 0x560d82284a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f8e261700 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d82282640 0x560d82284a50 crc :-1 s=READY pgs=759 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f947344b7e719ff server_cookie=6c252a58476afc9c in_seq=0 out_seq=0 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.845+0000 7f6f71ffb700 10 client.21507 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f71ffb700 1 -- 172.21.15.35:0/1635860123 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d81fe9f00 con 0x560d82282640 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f71ffb700 10 client.21507 handle_command_reply: tid=0 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 client.21507 shutdown 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 msgr2=0x560d82214a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d82214a90 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f6f78003d50 tx=0x7f6f78009380 comp rx=0 tx=0).stop 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 shutdown_connections 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d82282640 0x560d82284a50 crc :-1 s=READY pgs=759 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d822194f0 0x560d82215180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f71ffb700 0 client.21507 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d82213960 0x560d82224110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 --2- 172.21.15.35:0/1635860123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d82218be0 0x560d82214a90 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 >> 172.21.15.35:0/1635860123 conn(0x560d820706b0 msgr2=0x560d82219990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 shutdown_connections 2023-03-17T11:47:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 1 -- 172.21.15.35:0/1635860123 wait complete. 2023-03-17T11:47:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.858+0000 7f6f9c652b80 20 client.21507 trim_cache size 0 max 16384 2023-03-17T11:47:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6f7409f6c0 msgr2=0x7f6f740a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6f7409f6c0 0x7f6f740a1b70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6f88196850 tx=0x7f6f78009260 comp rx=0 tx=0).stop 2023-03-17T11:47:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 msgr2=0x7f6f88195240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 0x7f6f88195240 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400d980 tx=0x7f6f8400dc90 comp rx=0 tx=0).stop 2023-03-17T11:47:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 shutdown_connections 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6f7409f6c0 0x7f6f740a1b70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f88104390 0x7f6f88199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6f880ff350 0x7f6f88195240 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 --2- 172.21.15.35:0/396183321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6f880ffcf0 0x7f6f88195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 >> 172.21.15.35:0/396183321 conn(0x7f6f88076330 msgr2=0x7f6f880fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 shutdown_connections 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:31.859+0000 7f6f904c5700 1 -- 172.21.15.35:0/396183321 wait complete. 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3509486066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ffcf0 msgr2=0x7fc8b4103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3509486066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ffcf0 0x7fc8b4103cb0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0099c0 tx=0x7fc89c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:47:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3509486066 shutdown_connections 2023-03-17T11:47:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3509486066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b4104390 0x7fc8b410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3509486066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b40ff350 0x7fc8b40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3509486066 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ffcf0 0x7fc8b4103cb0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3509486066 >> 172.21.15.35:0/3509486066 conn(0x7fc8b4076330 msgr2=0x7fc8b4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3509486066 shutdown_connections 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.981+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3509486066 wait complete. 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 Processor -- start 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 -- start start 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 0x7fc8b4194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b40ffcf0 0x7fc8b4195430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b4104390 0x7fc8b4195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41a4730 con 0x7fc8b40ff350 2023-03-17T11:47:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41a48a0 con 0x7fc8b40ffcf0 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b8efb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41a4a60 con 0x7fc8b4104390 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 0x7fc8b4194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 0x7fc8b4194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57140/0 (socket says 172.21.15.35:57140) 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b259c700 1 -- 172.21.15.35:0/3423232966 learned_addr learned my addr 172.21.15.35:0/3423232966 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8abfff700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b40ffcf0 0x7fc8b4195430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b4104390 0x7fc8b4195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b259c700 1 -- 172.21.15.35:0/3423232966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b4104390 msgr2=0x7fc8b4195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b259c700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b4104390 0x7fc8b4195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.982+0000 7fc8b259c700 1 -- 172.21.15.35:0/3423232966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b40ffcf0 msgr2=0x7fc8b4195430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8b259c700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b40ffcf0 0x7fc8b4195430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8b259c700 1 -- 172.21.15.35:0/3423232966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0095f0 con 0x7fc8b40ff350 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8b259c700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 0x7fc8b4194ef0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400e9a0 tx=0x7fc8a400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8ab7fe700 1 -- 172.21.15.35:0/3423232966 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4009790 con 0x7fc8b40ff350 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8ab7fe700 1 -- 172.21.15.35:0/3423232966 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8a400cbd0 con 0x7fc8b40ff350 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8ab7fe700 1 -- 172.21.15.35:0/3423232966 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4018680 con 0x7fc8b40ff350 2023-03-17T11:47:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b410efc0 con 0x7fc8b40ff350 2023-03-17T11:47:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.983+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b410ee30 con 0x7fc8b40ff350 2023-03-17T11:47:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.985+0000 7fc8ab7fe700 1 -- 172.21.15.35:0/3423232966 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fc8a400cd40 con 0x7fc8b40ff350 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.986+0000 7fc8ab7fe700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8a009f640 0x7fc8a00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.986+0000 7fc8ab7fe700 1 -- 172.21.15.35:0/3423232966 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc8a4014070 con 0x7fc8b40ff350 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.986+0000 7fc8abfff700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8a009f640 0x7fc8a00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.986+0000 7fc8abfff700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8a009f640 0x7fc8a00a1af0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009990 tx=0x7fc89c01a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 Processor -- start 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 -- start start 2023-03-17T11:47:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606374bb010 con 0x5606375b4960 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063750d950 con 0x5606375b9be0 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560637506de0 con 0x5606375ba4f0 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8b2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8b2d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57152/0 (socket says 172.21.15.35:57152) 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.987+0000 7fc8b2d9d700 1 -- 172.21.15.35:0/2485469390 learned_addr learned my addr 172.21.15.35:0/2485469390 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8abfff700 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b259c700 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b2d9d700 1 -- 172.21.15.35:0/2485469390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 msgr2=0x5606375b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b2d9d700 1 -- 172.21.15.35:0/2485469390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 msgr2=0x5606375b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b2d9d700 1 -- 172.21.15.35:0/2485469390 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606373885d0 con 0x5606375b4960 2023-03-17T11:47:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375b4d90 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fd0 tx=0x7fc8ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcd3b94eed3d99c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8a8ff9700 1 -- 172.21.15.35:0/2485469390 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac009e70 con 0x5606375b4960 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8a8ff9700 1 -- 172.21.15.35:0/2485469390 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8ac011040 con 0x5606375b4960 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.988+0000 7fc8a8ff9700 1 -- 172.21.15.35:0/2485469390 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0153f0 con 0x5606375b4960 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2485469390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 msgr2=0x5606375b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375b4d90 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fd0 tx=0x7fc8ac009920 comp rx=0 tx=0).stop 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2485469390 shutdown_connections 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375b4d90 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2485469390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2485469390 >> 172.21.15.35:0/2485469390 conn(0x5606374116b0 msgr2=0x5606375aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2485469390 shutdown_connections 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2485469390 wait complete. 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 -- start start 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.989+0000 7fc8c5088b80 1 Processor -- start 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:37.187 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b9be0 0x5606375bd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063738a8c0 con 0x5606375b4960 2023-03-17T11:47:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606375be3f0 con 0x5606375ba4f0 2023-03-17T11:47:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606375ca030 con 0x5606375b9be0 2023-03-17T11:47:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 10 client.0 _ll_register_callbacks cb 0x5606373ac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:47:37.188 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57154/0 (socket says 172.21.15.35:57154) 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 -- 172.21.15.35:0/2695386273 learned_addr learned my addr 172.21.15.35:0/2695386273 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8abfff700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b9be0 0x5606375bd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 -- 172.21.15.35:0/2695386273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b9be0 msgr2=0x5606375bd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b9be0 0x5606375bd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 -- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 msgr2=0x5606375bdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 -- 172.21.15.35:0/2695386273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac009050 con 0x5606375b4960 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8b259c700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c0410 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40c8260 tx=0x7fc8a4098650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0df3d45fd1fd32 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc899ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc899ffb700 1 -- 172.21.15.35:0/2695386273 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4094040 con 0x5606375b4960 2023-03-17T11:47:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc899ffb700 1 -- 172.21.15.35:0/2695386273 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc8a40a0280 con 0x5606375b4960 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.990+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606374c9390 con 0x5606375b4960 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc899ffb700 1 -- 172.21.15.35:0/2695386273 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a4097ce0 con 0x5606375b4960 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 10 client.21519 fetch_fsmap learned FSMap version 108 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x560637334d80 con 0x5606375b4960 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc899ffb700 1 -- 172.21.15.35:0/2695386273 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5606374c9390 con 0x5606375b4960 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc899ffb700 1 -- 172.21.15.35:0/2695386273 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc8a4099300 con 0x5606375b4960 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 10 client.21519 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 10 client.21519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 20 client.21519 populate_metadata read hostname 'smithi035' 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 4 client.21519 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606374d5600 con 0x5606375ce0e0 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.991+0000 7fc8abfff700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc899ffb700 10 client.21519 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:38.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc8abfff700 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375d04c0 crc :-1 s=READY pgs=760 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967ba5494554c9a6 server_cookie=6c5e43a38fddef2a in_seq=0 out_seq=0 2023-03-17T11:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc899ffb700 1 -- 172.21.15.35:0/2695386273 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5606374d5600 con 0x5606375ce0e0 2023-03-17T11:47:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc899ffb700 10 client.21519 handle_command_reply: tid=0 2023-03-17T11:47:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc8c5088b80 1 client.21519 shutdown 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 msgr2=0x5606375c0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.992+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c0410 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40c8260 tx=0x7fc8a4098650 comp rx=0 tx=0).stop 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 shutdown_connections 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375d04c0 crc :-1 s=READY pgs=760 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c0410 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc899ffb700 0 client.21519 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/2695386273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b9be0 0x5606375bd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 >> 172.21.15.35:0/2695386273 conn(0x5606374116b0 msgr2=0x5606375aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 shutdown_connections 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 1 -- 172.21.15.35:0/2695386273 wait complete. 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:44.993+0000 7fc8c5088b80 20 client.21519 trim_cache size 0 max 16384 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.007+0000 7fc8c5088b80 1 Processor -- start 2023-03-17T11:47:42.629 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 -- start start 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b4960 0x5606375aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 0x5606375bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606374d5630 con 0x5606375b9be0 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606374c93c0 con 0x5606375ba4f0 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606375aa0f0 con 0x5606375b4960 2023-03-17T11:47:42.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 0x5606375bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:42.631 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:05 smithi035 ceph-mon[92535]: pgmap v5644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:07 smithi035 ceph-mon[92535]: pgmap v5645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:09 smithi035 ceph-mon[92535]: pgmap v5646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:09 smithi035 ceph-mon[92535]: osdmap e421: 12 total, 12 up, 12 in 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:11 smithi035 ceph-mon[92535]: pgmap v5648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:13 smithi035 ceph-mon[92535]: pgmap v5649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:15 smithi035 ceph-mon[92535]: pgmap v5650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:17 smithi035 ceph-mon[92535]: pgmap v5651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:47:44.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:17 smithi035 ceph-mon[92535]: osdmap e422: 12 total, 12 up, 12 in 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:19 smithi035 ceph-mon[92535]: pgmap v5653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 11 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:21 smithi035 ceph-mon[92535]: pgmap v5654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:23 smithi035 ceph-mon[92535]: pgmap v5655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:25 smithi035 ceph-mon[92535]: pgmap v5656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:27 smithi035 ceph-mon[92535]: pgmap v5657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:29 smithi035 ceph-mon[92535]: pgmap v5658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:31 smithi035 ceph-mon[92535]: pgmap v5659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:33 smithi035 ceph-mon[92535]: pgmap v5660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:35 smithi035 ceph-mon[92535]: pgmap v5661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:37 smithi035 ceph-mon[92535]: pgmap v5662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:39 smithi035 ceph-mon[92535]: pgmap v5663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:41 smithi035 ceph-mon[92535]: pgmap v5664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:43 smithi035 ceph-mon[92535]: pgmap v5665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:44 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:45 smithi035 ceph-mon[92535]: pgmap v5666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:47:44.703 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:45 smithi035 ceph-mon[92535]: pgmap v5667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 851 B/s wr, 9 op/s 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:45 smithi035 ceph-mon[92535]: pgmap v5668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:47 smithi035 ceph-mon[92535]: pgmap v5669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:49 smithi035 ceph-mon[92535]: pgmap v5670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:51 smithi035 ceph-mon[92535]: pgmap v5671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:53 smithi035 ceph-mon[92535]: pgmap v5672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T11:47:44.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:55 smithi035 ceph-mon[92535]: pgmap v5673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:57 smithi035 ceph-mon[92535]: pgmap v5674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:37:59 smithi035 ceph-mon[92535]: pgmap v5675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:01 smithi035 ceph-mon[92535]: pgmap v5676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:03 smithi035 ceph-mon[92535]: pgmap v5677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:05 smithi035 ceph-mon[92535]: pgmap v5678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:07 smithi035 ceph-mon[92535]: pgmap v5679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:09 smithi035 ceph-mon[92535]: osdmap e423: 12 total, 12 up, 12 in 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:09 smithi035 ceph-mon[92535]: pgmap v5681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:47:47.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:11 smithi035 ceph-mon[92535]: pgmap v5682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:47:47.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:13 smithi035 ceph-mon[92535]: pgmap v5683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:47:47.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:15 smithi035 ceph-mon[92535]: pgmap v5684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:47:47.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:17 smithi035 ceph-mon[92535]: pgmap v5685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:47:47.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:18 smithi035 ceph-mon[92535]: osdmap e424: 12 total, 12 up, 12 in 2023-03-17T11:47:48.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:19 smithi035 ceph-mon[92535]: pgmap v5687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:47:48.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:21 smithi035 ceph-mon[92535]: pgmap v5688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:47:48.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:23 smithi035 ceph-mon[92535]: pgmap v5689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:47:48.657 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:25 smithi035 ceph-mon[92535]: pgmap v5690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:47:49.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:27 smithi035 ceph-mon[92535]: pgmap v5691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T11:47:49.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:29 smithi035 ceph-mon[92535]: pgmap v5692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 360 B/s wr, 9 op/s 2023-03-17T11:47:49.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:31 smithi035 ceph-mon[92535]: pgmap v5693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:47:49.204 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:33 smithi035 ceph-mon[92535]: pgmap v5694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:47:49.205 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:47:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:47:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:47:50.667 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:47:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:47:50.669 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 0x5606375bb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57164/0 (socket says 172.21.15.35:57164) 2023-03-17T11:47:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 -- 172.21.15.35:0/4163060788 learned_addr learned my addr 172.21.15.35:0/4163060788 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8b259c700 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b4960 0x5606375aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 -- 172.21.15.35:0/4163060788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b4960 msgr2=0x5606375aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b4960 0x5606375aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 -- 172.21.15.35:0/4163060788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 msgr2=0x5606375bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 -- 172.21.15.35:0/4163060788 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606374cd130 con 0x5606375b9be0 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8b259c700 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b4960 0x5606375aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8abfff700 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 0x5606375bb0a0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000c00 tx=0x7fc89c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89870f66ddee8163 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8a97fa700 1 -- 172.21.15.35:0/4163060788 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c01d040 con 0x5606375b9be0 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.008+0000 7fc8a97fa700 1 -- 172.21.15.35:0/4163060788 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc89c029040 con 0x5606375b9be0 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8a97fa700 1 -- 172.21.15.35:0/4163060788 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c023e40 con 0x5606375b9be0 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 -- 172.21.15.35:0/4163060788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 msgr2=0x5606375bb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 0x5606375bb0a0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000c00 tx=0x7fc89c023000 comp rx=0 tx=0).stop 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 -- 172.21.15.35:0/4163060788 shutdown_connections 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375ba4f0 0x5606375bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375b4960 0x5606375aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/4163060788 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b9be0 0x5606375bb0a0 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 -- 172.21.15.35:0/4163060788 >> 172.21.15.35:0/4163060788 conn(0x5606374116b0 msgr2=0x5606375ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 -- 172.21.15.35:0/4163060788 shutdown_connections 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 -- 172.21.15.35:0/4163060788 wait complete. 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 -- start start 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.009+0000 7fc8c5088b80 1 Processor -- start 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606375c3ed0 con 0x5606375b4960 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606375c4010 con 0x5606375b9be0 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606375c41d0 con 0x5606375ba4f0 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57168/0 (socket says 172.21.15.35:57168) 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8c5088b80 10 client.0 _ll_register_callbacks cb 0x5606373ac230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:47:55.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 -- 172.21.15.35:0/3795533368 learned_addr learned my addr 172.21.15.35:0/3795533368 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8abfff700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 -- 172.21.15.35:0/3795533368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 msgr2=0x5606375c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 -- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 msgr2=0x5606375c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 -- 172.21.15.35:0/3795533368 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b410c7a0 con 0x5606375b4960 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b2d9d700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc8b259c700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c4f00 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4098220 tx=0x7fc8a40a05b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ac5f8410b5e500 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc899ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.010+0000 7fc899ffb700 1 -- 172.21.15.35:0/3795533368 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4094040 con 0x5606375b4960 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc899ffb700 1 -- 172.21.15.35:0/3795533368 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(393..393 src has 1..393) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fc8a40b6250 con 0x5606375b4960 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606375841e0 con 0x5606375b4960 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc899ffb700 1 -- 172.21.15.35:0/3795533368 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a4097ce0 con 0x5606375b4960 2023-03-17T11:47:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 10 client.21525 fetch_fsmap learned FSMap version 108 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x56063735b1f0 con 0x5606375b4960 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc899ffb700 1 -- 172.21.15.35:0/3795533368 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8a407b080 con 0x5606375b4960 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc899ffb700 1 -- 172.21.15.35:0/3795533368 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fc8a40b0c30 con 0x5606375b4960 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 10 client.21525 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 10 client.21525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 20 client.21525 populate_metadata read hostname 'smithi035' 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 4 client.21525 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56063738af00 con 0x5606375ce0e0 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.011+0000 7fc8abfff700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.012+0000 7fc8abfff700 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375ddff0 crc :-1 s=READY pgs=761 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d540a4f2391b30d5 server_cookie=9ee713892dcd70c9 in_seq=0 out_seq=0 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.012+0000 7fc899ffb700 10 client.21525 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.020+0000 7fc899ffb700 1 -- 172.21.15.35:0/3795533368 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56063738af00 con 0x5606375ce0e0 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.020+0000 7fc899ffb700 10 client.21525 handle_command_reply: tid=0 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.020+0000 7fc8c5088b80 1 client.21525 shutdown 2023-03-17T11:47:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 msgr2=0x5606375c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c4f00 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4098220 tx=0x7fc8a40a05b0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 shutdown_connections 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5606375ce0e0 0x5606375ddff0 crc :-1 s=READY pgs=761 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606375ba4f0 0x5606375c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5606375b4960 0x5606375c4f00 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc899ffb700 0 client.21525 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 --2- 172.21.15.35:0/3795533368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5606375b9be0 0x5606375c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 >> 172.21.15.35:0/3795533368 conn(0x5606374116b0 msgr2=0x5606375b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 shutdown_connections 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 1 -- 172.21.15.35:0/3795533368 wait complete. 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8c5088b80 20 client.21525 trim_cache size 0 max 16384 2023-03-17T11:47:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8a009f640 msgr2=0x7fc8a00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8a009f640 0x7fc8a00a1af0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009990 tx=0x7fc89c01a040 comp rx=0 tx=0).stop 2023-03-17T11:47:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 msgr2=0x7fc8b4194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 0x7fc8b4194ef0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400e9a0 tx=0x7fc8a400ed60 comp rx=0 tx=0).stop 2023-03-17T11:47:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 shutdown_connections 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fc8a009f640 0x7fc8a00a1af0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8b4104390 0x7fc8b4195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fc8b40ff350 0x7fc8b4194ef0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 --2- 172.21.15.35:0/3423232966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b40ffcf0 0x7fc8b4195430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 >> 172.21.15.35:0/3423232966 conn(0x7fc8b4076330 msgr2=0x7fc8b40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 shutdown_connections 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:23:45.021+0000 7fc8b8efb700 1 -- 172.21.15.35:0/3423232966 wait complete. 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 -- 172.21.15.35:0/994620509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9580101270 msgr2=0x7f9580101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 --2- 172.21.15.35:0/994620509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9580101270 0x7f9580101640 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f9574009990 tx=0x7f9574009ca0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 -- 172.21.15.35:0/994620509 shutdown_connections 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 --2- 172.21.15.35:0/994620509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958010a790 0x7f958010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 --2- 172.21.15.35:0/994620509 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9580101270 0x7f9580101640 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 --2- 172.21.15.35:0/994620509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9580101b80 0x7f958010a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 -- 172.21.15.35:0/994620509 >> 172.21.15.35:0/994620509 conn(0x7f9580076330 msgr2=0x7f9580076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:47:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 -- 172.21.15.35:0/994620509 shutdown_connections 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.303+0000 7f95860bf700 1 -- 172.21.15.35:0/994620509 wait complete. 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 Processor -- start 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 -- start start 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9580101270 0x7f9580196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9580101b80 0x7f95801967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 0x7f958019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:47:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958019b270 con 0x7f958010a790 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958019b3e0 con 0x7f9580101b80 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f95860bf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958019b5a0 con 0x7f9580101270 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f957ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 0x7f958019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f957ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 0x7f958019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57186/0 (socket says 172.21.15.35:57186) 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.304+0000 7f957ffff700 1 -- 172.21.15.35:0/1831963342 learned_addr learned my addr 172.21.15.35:0/1831963342 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957effd700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9580101b80 0x7f95801967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957f7fe700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9580101270 0x7f9580196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957ffff700 1 -- 172.21.15.35:0/1831963342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9580101270 msgr2=0x7f9580196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957ffff700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9580101270 0x7f9580196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957ffff700 1 -- 172.21.15.35:0/1831963342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9580101b80 msgr2=0x7f95801967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957ffff700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9580101b80 0x7f95801967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957ffff700 1 -- 172.21.15.35:0/1831963342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740095f0 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957ffff700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 0x7f958019ac30 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f957800ef30 tx=0x7f957800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957cff9700 1 -- 172.21.15.35:0/1831963342 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578018070 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9580110100 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957cff9700 1 -- 172.21.15.35:0/1831963342 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f957800f040 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f957cff9700 1 -- 172.21.15.35:0/1831963342 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578003d00 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.305+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958010ff70 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.307+0000 7f957cff9700 1 -- 172.21.15.35:0/1831963342 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f957800caa0 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.308+0000 7f957cff9700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956809f640 0x7f95680a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.308+0000 7f957cff9700 1 -- 172.21.15.35:0/1831963342 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95780ca2e0 con 0x7f958010a790 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.308+0000 7f957f7fe700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956809f640 0x7f95680a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.308+0000 7f957f7fe700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956809f640 0x7f95680a1af0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9574006010 tx=0x7f957400b260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 Processor -- start 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 -- start start 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x557315587fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x557315582420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x557315582d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557315489010 con 0x5573155884f0 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573154db950 con 0x557315582960 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f959224cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573154d4de0 con 0x557315587be0 2023-03-17T11:48:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x557315582420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x557315582420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57192/0 (socket says 172.21.15.35:57192) 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957effd700 1 -- 172.21.15.35:0/971892758 learned_addr learned my addr 172.21.15.35:0/971892758 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957f7fe700 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x557315587fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957ffff700 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x557315582d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957effd700 1 -- 172.21.15.35:0/971892758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 msgr2=0x557315587fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.309+0000 7f957effd700 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x557315587fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f957effd700 1 -- 172.21.15.35:0/971892758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 msgr2=0x557315582d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f957effd700 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x557315582d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f957effd700 1 -- 172.21.15.35:0/971892758 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573153565d0 con 0x5573155884f0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f957ffff700 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x557315582d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f957effd700 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x557315582420 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f957000bd10 tx=0x7f957000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde6f26492d9971 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f9565ffb700 1 -- 172.21.15.35:0/971892758 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000fda0 con 0x5573155884f0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f9565ffb700 1 -- 172.21.15.35:0/971892758 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f957000be60 con 0x5573155884f0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.310+0000 7f9565ffb700 1 -- 172.21.15.35:0/971892758 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700116d0 con 0x5573155884f0 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 -- 172.21.15.35:0/971892758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 msgr2=0x557315582420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:00.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x557315582420 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f957000bd10 tx=0x7f957000f640 comp rx=0 tx=0).stop 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 -- 172.21.15.35:0/971892758 shutdown_connections 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x557315582d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x557315587fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 --2- 172.21.15.35:0/971892758 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x557315582420 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 -- 172.21.15.35:0/971892758 >> 172.21.15.35:0/971892758 conn(0x5573153df6b0 msgr2=0x55731557ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 -- 172.21.15.35:0/971892758 shutdown_connections 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 -- 172.21.15.35:0/971892758 wait complete. 2023-03-17T11:48:00.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 -- start start 2023-03-17T11:48:00.823 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:35 smithi035 ceph-mon[92535]: pgmap v5695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.311+0000 7f959224cb80 1 Processor -- start 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x55731558e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x55731558b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x55731558bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573153588c0 con 0x5573155884f0 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731558c4a0 con 0x557315582960 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557315598000 con 0x557315587be0 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 10 client.0 _ll_register_callbacks cb 0x55731537a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x55731558bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x55731558bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57200/0 (socket says 172.21.15.35:57200) 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 -- 172.21.15.35:0/2129350815 learned_addr learned my addr 172.21.15.35:0/2129350815 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957effd700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x55731558b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957f7fe700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x55731558e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 -- 172.21.15.35:0/2129350815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 msgr2=0x55731558b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:00.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x55731558b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 -- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 msgr2=0x55731558e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x55731558e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 -- 172.21.15.35:0/2129350815 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957000b940 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f957ffff700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x55731558bd30 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f9578094320 tx=0x7f9578004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81f1b58240001bb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f955effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f955effd700 1 -- 172.21.15.35:0/2129350815 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578097510 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f955effd700 1 -- 172.21.15.35:0/2129350815 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f957809ff80 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.312+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557315497390 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f955effd700 1 -- 172.21.15.35:0/2129350815 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f957809faf0 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 10 client.21537 fetch_fsmap learned FSMap version 108 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x557315302d80 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f955effd700 1 -- 172.21.15.35:0/2129350815 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557315497390 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f955effd700 1 -- 172.21.15.35:0/2129350815 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9578096d80 con 0x5573155884f0 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 10 client.21537 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 10 client.21537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:48:00.825 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 20 client.21537 populate_metadata read hostname 'smithi035' 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55731559c1a0 0x55731559e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 4 client.21537 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573154a3600 con 0x55731559c1a0 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.313+0000 7f957f7fe700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55731559c1a0 0x55731559e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.314+0000 7f955effd700 10 client.21537 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.314+0000 7f957f7fe700 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55731559c1a0 0x55731559e5b0 crc :-1 s=READY pgs=762 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a812eef8467210 server_cookie=c4dea21b5552073b in_seq=0 out_seq=0 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.314+0000 7f955effd700 1 -- 172.21.15.35:0/2129350815 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5573154a3600 con 0x55731559c1a0 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.314+0000 7f955effd700 10 client.21537 handle_command_reply: tid=0 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.314+0000 7f959224cb80 1 client.21537 shutdown 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 msgr2=0x55731558bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x55731558bd30 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f9578094320 tx=0x7f9578004bc0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 shutdown_connections 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55731559c1a0 0x55731559e5b0 crc :-1 s=READY pgs=762 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x55731558bd30 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f955effd700 0 client.21537 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315582960 0x55731558e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.826 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 --2- 172.21.15.35:0/2129350815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315587be0 0x55731558b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 >> 172.21.15.35:0/2129350815 conn(0x5573153df6b0 msgr2=0x557315581410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 shutdown_connections 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 1 -- 172.21.15.35:0/2129350815 wait complete. 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.315+0000 7f959224cb80 20 client.21537 trim_cache size 0 max 16384 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 Processor -- start 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 -- start start 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x557315592f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315587be0 0x55731558dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x5573155856b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573154a3600 con 0x5573155884f0 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557315497390 con 0x557315587be0 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f959224cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731558c6e0 con 0x557315582960 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x5573155856b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x5573155856b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57208/0 (socket says 172.21.15.35:57208) 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 -- 172.21.15.35:0/2792269403 learned_addr learned my addr 172.21.15.35:0/2792269403 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957effd700 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315587be0 0x55731558dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:00.827 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957f7fe700 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x557315592f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 -- 172.21.15.35:0/2792269403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 msgr2=0x557315592f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x557315592f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 -- 172.21.15.35:0/2792269403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315587be0 msgr2=0x55731558dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315587be0 0x55731558dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 -- 172.21.15.35:0/2792269403 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55731549b130 con 0x5573155884f0 2023-03-17T11:48:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957f7fe700 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x557315592f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.330+0000 7f957ffff700 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x5573155856b0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f95780090a0 tx=0x7f95780963d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5a56a8407816a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f95667fc700 1 -- 172.21.15.35:0/2792269403 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957809ff80 con 0x5573155884f0 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f95667fc700 1 -- 172.21.15.35:0/2792269403 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9578096d80 con 0x5573155884f0 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f95667fc700 1 -- 172.21.15.35:0/2792269403 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957809fd10 con 0x5573155884f0 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 -- 172.21.15.35:0/2792269403 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 msgr2=0x5573155856b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x5573155856b0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f95780090a0 tx=0x7f95780963d0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 -- 172.21.15.35:0/2792269403 shutdown_connections 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5573155884f0 0x5573155856b0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x557315592f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 --2- 172.21.15.35:0/2792269403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557315587be0 0x55731558dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 -- 172.21.15.35:0/2792269403 >> 172.21.15.35:0/2792269403 conn(0x5573153df6b0 msgr2=0x557315581a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 -- 172.21.15.35:0/2792269403 shutdown_connections 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.331+0000 7f959224cb80 1 -- 172.21.15.35:0/2792269403 wait complete. 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 -- start start 2023-03-17T11:48:03.050 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 Processor -- start 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x5573155e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 0x5573155e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5573155884f0 0x5573155ef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573155ef590 con 0x557315587be0 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573155ef6d0 con 0x5573155884f0 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573155ef810 con 0x557315582960 2023-03-17T11:48:03.051 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f959224cb80 10 client.0 _ll_register_callbacks cb 0x55731537a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 0x5573155e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 0x5573155e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57212/0 (socket says 172.21.15.35:57212) 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 -- 172.21.15.35:0/1234949664 learned_addr learned my addr 172.21.15.35:0/1234949664 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957f7fe700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x5573155e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957ffff700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5573155884f0 0x5573155ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 -- 172.21.15.35:0/1234949664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 msgr2=0x5573155e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x5573155e41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 -- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5573155884f0 msgr2=0x5573155ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5573155884f0 0x5573155ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957effd700 1 -- 172.21.15.35:0/1234949664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557315302d80 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.332+0000 7f957ffff700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5573155884f0 0x5573155ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f957effd700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 0x5573155e4700 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f957000b700 tx=0x7f957000fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3054303c0d055a37 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f955effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f955effd700 1 -- 172.21.15.35:0/1234949664 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570020040 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f955effd700 1 -- 172.21.15.35:0/1234949664 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9570004510 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573155521e0 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f955effd700 1 -- 172.21.15.35:0/1234949664 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9570005040 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 10 client.21543 fetch_fsmap learned FSMap version 108 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x5573153291f0 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f955effd700 1 -- 172.21.15.35:0/1234949664 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5573155521e0 con 0x557315587be0 2023-03-17T11:48:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f955effd700 1 -- 172.21.15.35:0/1234949664 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f9570003680 con 0x557315587be0 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 10 client.21543 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 10 client.21543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 20 client.21543 populate_metadata read hostname 'smithi035' 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5573155f0dd0 0x5573155f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 4 client.21543 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.333+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557315358f00 con 0x5573155f0dd0 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.334+0000 7f957f7fe700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5573155f0dd0 0x5573155f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.334+0000 7f955effd700 10 client.21543 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.334+0000 7f957f7fe700 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5573155f0dd0 0x5573155f31e0 crc :-1 s=READY pgs=763 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31b8437b29cc28da server_cookie=ef4666d6b0fd4513 in_seq=0 out_seq=0 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.352+0000 7f955effd700 1 -- 172.21.15.35:0/1234949664 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557315358f00 con 0x5573155f0dd0 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f955effd700 10 client.21543 handle_command_reply: tid=0 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 client.21543 shutdown 2023-03-17T11:48:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 msgr2=0x5573155e4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 0x5573155e4700 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f957000b700 tx=0x7f957000fe80 comp rx=0 tx=0).stop 2023-03-17T11:48:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 shutdown_connections 2023-03-17T11:48:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5573155f0dd0 0x5573155f31e0 crc :-1 s=READY pgs=763 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:09.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5573155884f0 0x5573155ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f955effd700 0 client.21543 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557315582960 0x5573155e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 --2- 172.21.15.35:0/1234949664 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557315587be0 0x5573155e4700 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 >> 172.21.15.35:0/1234949664 conn(0x5573153df6b0 msgr2=0x5573155856b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 shutdown_connections 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 1 -- 172.21.15.35:0/1234949664 wait complete. 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f959224cb80 20 client.21543 trim_cache size 0 max 16384 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956809f640 msgr2=0x7f95680a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f95860bf700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956809f640 0x7f95680a1af0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9574006010 tx=0x7f957400b260 comp rx=0 tx=0).stop 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.353+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 msgr2=0x7f958019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 0x7f958019ac30 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f957800ef30 tx=0x7f957800c450 comp rx=0 tx=0).stop 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 shutdown_connections 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956809f640 0x7f95680a1af0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958010a790 0x7f958019ac30 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9580101270 0x7f9580196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 --2- 172.21.15.35:0/1831963342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9580101b80 0x7f95801967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 >> 172.21.15.35:0/1831963342 conn(0x7f9580076330 msgr2=0x7f95801021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 shutdown_connections 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:34.354+0000 7f95860bf700 1 -- 172.21.15.35:0/1831963342 wait complete. 2023-03-17T11:48:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 -- 172.21.15.35:0/2263660197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f49641045a0 msgr2=0x7f496410c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 --2- 172.21.15.35:0/2263660197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f49641045a0 0x7f496410c170 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f495c00b0d0 tx=0x7f495c00b3e0 comp rx=0 tx=0).stop 2023-03-17T11:48:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 -- 172.21.15.35:0/2263660197 shutdown_connections 2023-03-17T11:48:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 --2- 172.21.15.35:0/2263660197 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f49641045a0 0x7f496410c170 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 --2- 172.21.15.35:0/2263660197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49640ffa80 0x7f49640ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 --2- 172.21.15.35:0/2263660197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4964100420 0x7f4964103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 -- 172.21.15.35:0/2263660197 >> 172.21.15.35:0/2263660197 conn(0x7f49640757a0 msgr2=0x7f4964075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 -- 172.21.15.35:0/2263660197 shutdown_connections 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.476+0000 7f496acf4700 1 -- 172.21.15.35:0/2263660197 wait complete. 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 Processor -- start 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 -- start start 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49640ffa80 0x7f4964196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 0x7f4964196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:14.606 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49641045a0 0x7f496419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496419b520 con 0x7f4964100420 2023-03-17T11:48:14.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496419b690 con 0x7f49641045a0 2023-03-17T11:48:14.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:37 smithi035 ceph-mon[92535]: pgmap v5696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:48:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f496acf4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496419b850 con 0x7f49640ffa80 2023-03-17T11:48:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 0x7f4964196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 0x7f4964196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57226/0 (socket says 172.21.15.35:57226) 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 -- 172.21.15.35:0/1297226567 learned_addr learned my addr 172.21.15.35:0/1297226567 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4969291700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49641045a0 0x7f496419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4968a90700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49640ffa80 0x7f4964196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 -- 172.21.15.35:0/1297226567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49640ffa80 msgr2=0x7f4964196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49640ffa80 0x7f4964196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 -- 172.21.15.35:0/1297226567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49641045a0 msgr2=0x7f496419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49641045a0 0x7f496419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.477+0000 7f4963fff700 1 -- 172.21.15.35:0/1297226567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009d00 con 0x7f4964100420 2023-03-17T11:48:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.478+0000 7f4963fff700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 0x7f4964196a80 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f495000d950 tx=0x7f495000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:17.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.478+0000 7f4961ffb700 1 -- 172.21.15.35:0/1297226567 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950004220 con 0x7f4964100420 2023-03-17T11:48:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.478+0000 7f4961ffb700 1 -- 172.21.15.35:0/1297226567 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4950004cc0 con 0x7f4964100420 2023-03-17T11:48:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.478+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49641102f0 con 0x7f4964100420 2023-03-17T11:48:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.478+0000 7f4961ffb700 1 -- 172.21.15.35:0/1297226567 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49500055b0 con 0x7f4964100420 2023-03-17T11:48:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.478+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4964110160 con 0x7f4964100420 2023-03-17T11:48:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.480+0000 7f4961ffb700 1 -- 172.21.15.35:0/1297226567 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f4950004750 con 0x7f4964100420 2023-03-17T11:48:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.481+0000 7f4961ffb700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f495409f6c0 0x7f49540a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.481+0000 7f4961ffb700 1 -- 172.21.15.35:0/1297226567 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f49500ca380 con 0x7f4964100420 2023-03-17T11:48:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.481+0000 7f4968a90700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f495409f6c0 0x7f49540a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.481+0000 7f4968a90700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f495409f6c0 0x7f49540a1b70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4958009bf0 tx=0x7f4958009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 Processor -- start 2023-03-17T11:48:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 -- start start 2023-03-17T11:48:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ff4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ff8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ff95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39ef7010 con 0x55eb39ff9170 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39f49950 con 0x55eb39ff4a20 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4976e81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39f42de0 con 0x55eb39ff5330 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4969291700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ff95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4969291700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ff95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57236/0 (socket says 172.21.15.35:57236) 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4969291700 1 -- 172.21.15.35:0/2519378810 learned_addr learned my addr 172.21.15.35:0/2519378810 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.482+0000 7f4963fff700 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ff8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4968a90700 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ff4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4969291700 1 -- 172.21.15.35:0/2519378810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 msgr2=0x55eb39ff8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4969291700 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ff8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4969291700 1 -- 172.21.15.35:0/2519378810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 msgr2=0x55eb39ff4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4969291700 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ff4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4969291700 1 -- 172.21.15.35:0/2519378810 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb39dc45d0 con 0x55eb39ff9170 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.483+0000 7f4969291700 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ff95c0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f495c005ad0 tx=0x7f495c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dea8d796c33db06 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.485+0000 7f494effd700 1 -- 172.21.15.35:0/2519378810 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00e040 con 0x55eb39ff9170 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f494effd700 1 -- 172.21.15.35:0/2519378810 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f495c007b90 con 0x55eb39ff9170 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f494effd700 1 -- 172.21.15.35:0/2519378810 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c003c60 con 0x55eb39ff9170 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 -- 172.21.15.35:0/2519378810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 msgr2=0x55eb39ff95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ff95c0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f495c005ad0 tx=0x7f495c009c90 comp rx=0 tx=0).stop 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 -- 172.21.15.35:0/2519378810 shutdown_connections 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ff95c0 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ff4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2519378810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ff8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 -- 172.21.15.35:0/2519378810 >> 172.21.15.35:0/2519378810 conn(0x55eb39e4d6b0 msgr2=0x55eb39feaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 -- 172.21.15.35:0/2519378810 shutdown_connections 2023-03-17T11:48:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.486+0000 7f4976e81b80 1 -- 172.21.15.35:0/2519378810 wait complete. 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 -- start start 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 Processor -- start 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff4a20 0x55eb3a000870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb39ffdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff9170 0x55eb39ffe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39dc68c0 con 0x55eb39ff5330 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39ffe920 con 0x55eb39ff9170 2023-03-17T11:48:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3a00a410 con 0x55eb39ff4a20 2023-03-17T11:48:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4976e81b80 10 client.0 _ll_register_callbacks cb 0x55eb39de8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:48:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.487+0000 7f4963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb39ffdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb39ffdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57240/0 (socket says 172.21.15.35:57240) 2023-03-17T11:48:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 -- 172.21.15.35:0/2469028217 learned_addr learned my addr 172.21.15.35:0/2469028217 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4968a90700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff4a20 0x55eb3a000870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4969291700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff9170 0x55eb39ffe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 -- 172.21.15.35:0/2469028217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff4a20 msgr2=0x55eb3a000870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff4a20 0x55eb3a000870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 -- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff9170 msgr2=0x55eb39ffe1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff9170 0x55eb39ffe1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 -- 172.21.15.35:0/2469028217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496410c9b0 con 0x55eb39ff5330 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4963fff700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb39ffdb60 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f4950094840 tx=0x7f4950005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d2c390f30327c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4943fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4943fff700 1 -- 172.21.15.35:0/2469028217 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495009ffc0 con 0x55eb39ff5330 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4943fff700 1 -- 172.21.15.35:0/2469028217 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f495000fc70 con 0x55eb39ff5330 2023-03-17T11:48:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb39f05390 con 0x55eb39ff5330 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4943fff700 1 -- 172.21.15.35:0/2469028217 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f495000fe30 con 0x55eb39ff5330 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4976e81b80 10 client.21555 fetch_fsmap learned FSMap version 108 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.488+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55eb39d70d80 con 0x55eb39ff5330 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4943fff700 1 -- 172.21.15.35:0/2469028217 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f49500b5020 con 0x55eb39ff5330 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4943fff700 1 -- 172.21.15.35:0/2469028217 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f49500972c0 con 0x55eb39ff5330 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4976e81b80 10 client.21555 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4976e81b80 10 client.21555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4976e81b80 20 client.21555 populate_metadata read hostname 'smithi035' 2023-03-17T11:48:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a00e3c0 0x55eb3a0107d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4976e81b80 4 client.21555 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:48:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb39f11600 con 0x55eb3a00e3c0 2023-03-17T11:48:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.489+0000 7f4968a90700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a00e3c0 0x55eb3a0107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:27.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4943fff700 10 client.21555 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:28.305 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4968a90700 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a00e3c0 0x55eb3a0107d0 crc :-1 s=READY pgs=764 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0dde2256adff613 server_cookie=5bd92762abee706e in_seq=0 out_seq=0 2023-03-17T11:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4943fff700 1 -- 172.21.15.35:0/2469028217 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55eb39f11600 con 0x55eb3a00e3c0 2023-03-17T11:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4943fff700 10 client.21555 handle_command_reply: tid=0 2023-03-17T11:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 client.21555 shutdown 2023-03-17T11:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 msgr2=0x55eb39ffdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb39ffdb60 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f4950094840 tx=0x7f4950005790 comp rx=0 tx=0).stop 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 shutdown_connections 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a00e3c0 0x55eb3a0107d0 crc :-1 s=READY pgs=764 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff9170 0x55eb39ffe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4943fff700 0 client.21555 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff4a20 0x55eb3a000870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2469028217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb39ffdb60 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.490+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 >> 172.21.15.35:0/2469028217 conn(0x55eb39e4d6b0 msgr2=0x55eb39fef410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.491+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 shutdown_connections 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.491+0000 7f4976e81b80 1 -- 172.21.15.35:0/2469028217 wait complete. 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.491+0000 7f4976e81b80 20 client.21555 trim_cache size 0 max 16384 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.505+0000 7f4976e81b80 1 Processor -- start 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.505+0000 7f4976e81b80 1 -- start start 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39feaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb3a005350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff9170 0x55eb39ffa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4976e81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39feb6d0 con 0x55eb39ff5330 2023-03-17T11:48:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4976e81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39fff0d0 con 0x55eb39ff4a20 2023-03-17T11:48:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4976e81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39ffeeb0 con 0x55eb39ff9170 2023-03-17T11:48:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb3a005350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb3a005350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57248/0 (socket says 172.21.15.35:57248) 2023-03-17T11:48:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 -- 172.21.15.35:0/1892537582 learned_addr learned my addr 172.21.15.35:0/1892537582 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4968a90700 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39feaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4969291700 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff9170 0x55eb39ffa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 -- 172.21.15.35:0/1892537582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff9170 msgr2=0x55eb39ffa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:35.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff9170 0x55eb39ffa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 -- 172.21.15.35:0/1892537582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 msgr2=0x55eb39feaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39feaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 -- 172.21.15.35:0/1892537582 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb3a015400 con 0x55eb39ff5330 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f4963fff700 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb3a005350 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f4950097f90 tx=0x7f4950096380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390256132cb999ea server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f494f7fe700 1 -- 172.21.15.35:0/1892537582 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495009fc00 con 0x55eb39ff5330 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f494f7fe700 1 -- 172.21.15.35:0/1892537582 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4950014070 con 0x55eb39ff5330 2023-03-17T11:48:35.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.506+0000 7f494f7fe700 1 -- 172.21.15.35:0/1892537582 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950098030 con 0x55eb39ff5330 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 -- 172.21.15.35:0/1892537582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 msgr2=0x55eb3a005350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb3a005350 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f4950097f90 tx=0x7f4950096380 comp rx=0 tx=0).stop 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 -- 172.21.15.35:0/1892537582 shutdown_connections 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff9170 0x55eb39ffa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39feaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 --2- 172.21.15.35:0/1892537582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff5330 0x55eb3a005350 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 -- 172.21.15.35:0/1892537582 >> 172.21.15.35:0/1892537582 conn(0x55eb39e4d6b0 msgr2=0x55eb39fec3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:35.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 -- 172.21.15.35:0/1892537582 shutdown_connections 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 -- 172.21.15.35:0/1892537582 wait complete. 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 -- start start 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.507+0000 7f4976e81b80 1 Processor -- start 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ffd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ffd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ffc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39ffdff0 con 0x55eb39ff9170 2023-03-17T11:48:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39ffc850 con 0x55eb39ff4a20 2023-03-17T11:48:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb39ffca10 con 0x55eb39ff5330 2023-03-17T11:48:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4976e81b80 10 client.0 _ll_register_callbacks cb 0x55eb39de8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:48:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ffc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:36.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ffc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57256/0 (socket says 172.21.15.35:57256) 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 -- 172.21.15.35:0/2365798070 learned_addr learned my addr 172.21.15.35:0/2365798070 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4963fff700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ffd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4968a90700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ffd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 -- 172.21.15.35:0/2365798070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 msgr2=0x55eb39ffd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ffd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 -- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 msgr2=0x55eb39ffd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ffd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 -- 172.21.15.35:0/2365798070 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb39d70d80 con 0x55eb39ff9170 2023-03-17T11:48:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4969291700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ffc310 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f495c0061a0 tx=0x7f495c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c37a6352223ca90 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.508+0000 7f4943fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:48:39.393 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:39 smithi035 ceph-mon[92535]: pgmap v5697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:48:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4943fff700 1 -- 172.21.15.35:0/2365798070 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00e040 con 0x55eb39ff9170 2023-03-17T11:48:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4943fff700 1 -- 172.21.15.35:0/2365798070 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f495c02a070 con 0x55eb39ff9170 2023-03-17T11:48:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb39fc01e0 con 0x55eb39ff9170 2023-03-17T11:48:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4943fff700 1 -- 172.21.15.35:0/2365798070 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f495c0076a0 con 0x55eb39ff9170 2023-03-17T11:48:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 10 client.21561 fetch_fsmap learned FSMap version 108 2023-03-17T11:48:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55eb39d59c00 con 0x55eb39ff9170 2023-03-17T11:48:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4943fff700 1 -- 172.21.15.35:0/2365798070 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f495c03a080 con 0x55eb39ff9170 2023-03-17T11:48:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4943fff700 1 -- 172.21.15.35:0/2365798070 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f495c00b100 con 0x55eb39ff9170 2023-03-17T11:48:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 10 client.21561 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:48:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 10 client.21561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:48:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 20 client.21561 populate_metadata read hostname 'smithi035' 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a062a40 0x55eb3a064e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 4 client.21561 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb39dc6f00 con 0x55eb3a062a40 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.509+0000 7f4968a90700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a062a40 0x55eb3a064e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.510+0000 7f4943fff700 10 client.21561 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.510+0000 7f4968a90700 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a062a40 0x55eb3a064e50 crc :-1 s=READY pgs=765 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de935e41bfdf24c server_cookie=aeb33e01b88d7152 in_seq=0 out_seq=0 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4943fff700 1 -- 172.21.15.35:0/2365798070 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb39dc6f00 con 0x55eb3a062a40 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4943fff700 10 client.21561 handle_command_reply: tid=0 2023-03-17T11:48:42.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 client.21561 shutdown 2023-03-17T11:48:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 msgr2=0x55eb39ffc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ffc310 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f495c0061a0 tx=0x7f495c007f70 comp rx=0 tx=0).stop 2023-03-17T11:48:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 shutdown_connections 2023-03-17T11:48:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55eb3a062a40 0x55eb3a064e50 crc :-1 s=READY pgs=765 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55eb39ff9170 0x55eb39ffc310 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb39ff4a20 0x55eb39ffd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 --2- 172.21.15.35:0/2365798070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eb39ff5330 0x55eb39ffd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4943fff700 0 client.21561 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 >> 172.21.15.35:0/2365798070 conn(0x55eb39e4d6b0 msgr2=0x55eb39ff71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 shutdown_connections 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 1 -- 172.21.15.35:0/2365798070 wait complete. 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.519+0000 7f4976e81b80 20 client.21561 trim_cache size 0 max 16384 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f495409f6c0 msgr2=0x7f49540a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:45.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f495409f6c0 0x7f49540a1b70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4958009bf0 tx=0x7f4958009260 comp rx=0 tx=0).stop 2023-03-17T11:48:45.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 msgr2=0x7f4964196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 0x7f4964196a80 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f495000d950 tx=0x7f495000dc60 comp rx=0 tx=0).stop 2023-03-17T11:48:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 shutdown_connections 2023-03-17T11:48:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f495409f6c0 0x7f49540a1b70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49641045a0 0x7f496419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49640ffa80 0x7f4964196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 --2- 172.21.15.35:0/1297226567 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f4964100420 0x7f4964196a80 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:47.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 >> 172.21.15.35:0/1297226567 conn(0x7f49640757a0 msgr2=0x7f49640fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 shutdown_connections 2023-03-17T11:48:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:25:47.520+0000 7f496acf4700 1 -- 172.21.15.35:0/1297226567 wait complete. 2023-03-17T11:48:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.632+0000 7f7bc8021700 1 -- 172.21.15.35:0/4204867753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 msgr2=0x7f7bc010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.632+0000 7f7bc8021700 1 --2- 172.21.15.35:0/4204867753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc010bf60 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b0d0 tx=0x7f7bb800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:48:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.632+0000 7f7bc8021700 1 -- 172.21.15.35:0/4204867753 shutdown_connections 2023-03-17T11:48:47.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 --2- 172.21.15.35:0/4204867753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc010bf60 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 --2- 172.21.15.35:0/4204867753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 0x7f7bc00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 --2- 172.21.15.35:0/4204867753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc00ffcf0 0x7f7bc0103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 -- 172.21.15.35:0/4204867753 >> 172.21.15.35:0/4204867753 conn(0x7f7bc0076330 msgr2=0x7f7bc0076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 -- 172.21.15.35:0/4204867753 shutdown_connections 2023-03-17T11:48:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 -- 172.21.15.35:0/4204867753 wait complete. 2023-03-17T11:48:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 Processor -- start 2023-03-17T11:48:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 -- start start 2023-03-17T11:48:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 0x7f7bc0197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.633+0000 7f7bc8021700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc00ffcf0 0x7f7bc01976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc8021700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc01a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc8021700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0198010 con 0x7f7bc0104390 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc8021700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01a2750 con 0x7f7bc00ff350 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc8021700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01a2910 con 0x7f7bc00ffcf0 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc01a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc01a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57270/0 (socket says 172.21.15.35:57270) 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 -- 172.21.15.35:0/1546091311 learned_addr learned my addr 172.21.15.35:0/1546091311 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc00ffcf0 0x7f7bc01976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 0x7f7bc0197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:52.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 -- 172.21.15.35:0/1546091311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc00ffcf0 msgr2=0x7f7bc01976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc00ffcf0 0x7f7bc01976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 -- 172.21.15.35:0/1546091311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 msgr2=0x7f7bc0197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:52.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 0x7f7bc0197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 -- 172.21.15.35:0/1546091311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009d00 con 0x7f7bc0104390 2023-03-17T11:48:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 0x7f7bc0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc65be700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc01a2210 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8008e50 tx=0x7f7bb8008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bb2ffd700 1 -- 172.21.15.35:0/1546091311 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800e040 con 0x7f7bc0104390 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc010efc0 con 0x7f7bc0104390 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bb2ffd700 1 -- 172.21.15.35:0/1546091311 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bb8003e90 con 0x7f7bc0104390 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bb2ffd700 1 -- 172.21.15.35:0/1546091311 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb801b6c0 con 0x7f7bc0104390 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.634+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc010ee30 con 0x7f7bc0104390 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.637+0000 7f7bb2ffd700 1 -- 172.21.15.35:0/1546091311 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7bb8003a00 con 0x7f7bc0104390 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.637+0000 7f7bb2ffd700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7bac09f640 0x7f7bac0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.637+0000 7f7bb2ffd700 1 -- 172.21.15.35:0/1546091311 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7bb80cb7d0 con 0x7f7bc0104390 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.637+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7bac09f640 0x7f7bac0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.638+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7bac09f640 0x7f7bac0a1af0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009be0 tx=0x7f7bbc009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.638+0000 7f7bd41aeb80 1 Processor -- start 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.638+0000 7f7bd41aeb80 1 -- start start 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 0x560593c96fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c91420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c91960 0x560593c91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593b98010 con 0x560593c96be0 2023-03-17T11:48:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593bea950 con 0x560593c974f0 2023-03-17T11:48:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593be3de0 con 0x560593c91960 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 0x560593c96fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 0x560593c96fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57274/0 (socket says 172.21.15.35:57274) 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/464653565 learned_addr learned my addr 172.21.15.35:0/464653565 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc65be700 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c91960 0x560593c91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c91420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/464653565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c91960 msgr2=0x560593c91d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c91960 0x560593c91d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/464653565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 msgr2=0x560593c91420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c91420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/464653565 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560593a655d0 con 0x560593c96be0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc65be700 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c91960 0x560593c91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 0x560593c96fb0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc010d00 tx=0x7f7bbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565daa03e5149058 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7babfff700 1 -- 172.21.15.35:0/464653565 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc012ab0 con 0x560593c96be0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7babfff700 1 -- 172.21.15.35:0/464653565 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bbc012c10 con 0x560593c96be0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.639+0000 7f7babfff700 1 -- 172.21.15.35:0/464653565 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc01e610 con 0x560593c96be0 2023-03-17T11:48:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/464653565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 msgr2=0x560593c96fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 0x560593c96fb0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc010d00 tx=0x7f7bbc013000 comp rx=0 tx=0).stop 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/464653565 shutdown_connections 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c91960 0x560593c91d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c96be0 0x560593c96fb0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/464653565 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c91420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/464653565 >> 172.21.15.35:0/464653565 conn(0x560593aee6b0 msgr2=0x560593c8ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/464653565 shutdown_connections 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.640+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/464653565 wait complete. 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 -- start start 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 Processor -- start 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593a678c0 con 0x560593c91960 2023-03-17T11:48:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593c9b3d0 con 0x560593c974f0 2023-03-17T11:48:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593ca7000 con 0x560593c96be0 2023-03-17T11:48:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bd41aeb80 10 client.0 _ll_register_callbacks cb 0x560593a89230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57280/0 (socket says 172.21.15.35:57280) 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/3112552365 learned_addr learned my addr 172.21.15.35:0/3112552365 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bc65be700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.641+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/3112552365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 msgr2=0x560593c9a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 msgr2=0x560593c9ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/3112552365 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bbc0109b0 con 0x560593c91960 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9d400 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc010950 tx=0x7f7bbc012b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3030dde4efda2a1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7ba97fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7ba97fa700 1 -- 172.21.15.35:0/3112552365 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc02f070 con 0x560593c91960 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7ba97fa700 1 -- 172.21.15.35:0/3112552365 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7bbc020e70 con 0x560593c91960 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560593ba6390 con 0x560593c91960 2023-03-17T11:48:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7ba97fa700 1 -- 172.21.15.35:0/3112552365 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bbc005040 con 0x560593c91960 2023-03-17T11:48:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 10 client.21573 fetch_fsmap learned FSMap version 108 2023-03-17T11:48:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x560593a11d80 con 0x560593c91960 2023-03-17T11:48:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7ba97fa700 1 -- 172.21.15.35:0/3112552365 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560593ba6390 con 0x560593c91960 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7ba97fa700 1 -- 172.21.15.35:0/3112552365 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7bbc0036a0 con 0x560593c91960 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 10 client.21573 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 10 client.21573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 20 client.21573 populate_metadata read hostname 'smithi035' 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cab060 0x560593cad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 4 client.21573 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:49:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.642+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560593bb2600 con 0x560593cab060 2023-03-17T11:49:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.643+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cab060 0x560593cad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.643+0000 7f7ba97fa700 10 client.21573 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.643+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cab060 0x560593cad470 crc :-1 s=READY pgs=766 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2296a2aa94c8eb90 server_cookie=ad8ae3553c7cf4c5 in_seq=0 out_seq=0 2023-03-17T11:49:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7ba97fa700 1 -- 172.21.15.35:0/3112552365 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560593bb2600 con 0x560593cab060 2023-03-17T11:49:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7ba97fa700 10 client.21573 handle_command_reply: tid=0 2023-03-17T11:49:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 client.21573 shutdown 2023-03-17T11:49:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 msgr2=0x560593c9d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9d400 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc010950 tx=0x7f7bbc012b30 comp rx=0 tx=0).stop 2023-03-17T11:49:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 shutdown_connections 2023-03-17T11:49:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cab060 0x560593cad470 crc :-1 s=READY pgs=766 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9d400 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:02.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:41 smithi035 ceph-mon[92535]: pgmap v5698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:49:02.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:43 smithi035 ceph-mon[92535]: pgmap v5699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:49:02.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:45 smithi035 ceph-mon[92535]: pgmap v5700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:49:02.210 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:49:03.787 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:49:03.787 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:49:04.684 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:46 smithi035 ceph-mon[92535]: pgmap v5701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T11:49:04.684 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:46 smithi035 ceph-mon[92535]: pgmap v5702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:49:04.684 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:49:05.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:48 smithi035 ceph-mon[92535]: pgmap v5703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:49:05.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:50 smithi035 ceph-mon[92535]: pgmap v5704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:49:05.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:52 smithi035 ceph-mon[92535]: pgmap v5705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:54 smithi035 ceph-mon[92535]: pgmap v5706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:56 smithi035 ceph-mon[92535]: pgmap v5707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:38:58 smithi035 ceph-mon[92535]: pgmap v5708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:00 smithi035 ceph-mon[92535]: pgmap v5709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:02 smithi035 ceph-mon[92535]: pgmap v5710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:04 smithi035 ceph-mon[92535]: pgmap v5711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:06 smithi035 ceph-mon[92535]: pgmap v5712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:08 smithi035 ceph-mon[92535]: pgmap v5713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:49:07.880 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:09 smithi035 ceph-mon[92535]: osdmap e425: 12 total, 12 up, 12 in 2023-03-17T11:49:08.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:10 smithi035 ceph-mon[92535]: pgmap v5715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:49:08.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:12 smithi035 ceph-mon[92535]: pgmap v5716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:49:08.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:14 smithi035 ceph-mon[92535]: pgmap v5717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:49:08.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:16 smithi035 ceph-mon[92535]: pgmap v5718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:18 smithi035 ceph-mon[92535]: osdmap e426: 12 total, 12 up, 12 in 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:18 smithi035 ceph-mon[92535]: pgmap v5720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:20 smithi035 ceph-mon[92535]: pgmap v5721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:22 smithi035 ceph-mon[92535]: pgmap v5722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:24 smithi035 ceph-mon[92535]: pgmap v5723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:26 smithi035 ceph-mon[92535]: pgmap v5724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:28 smithi035 ceph-mon[92535]: pgmap v5725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:30 smithi035 ceph-mon[92535]: pgmap v5726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:32 smithi035 ceph-mon[92535]: pgmap v5727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:34 smithi035 ceph-mon[92535]: pgmap v5728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:49:10.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:36 smithi035 ceph-mon[92535]: pgmap v5729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:38 smithi035 ceph-mon[92535]: pgmap v5730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:40 smithi035 ceph-mon[92535]: pgmap v5731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:42 smithi035 ceph-mon[92535]: pgmap v5732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:44 smithi035 ceph-mon[92535]: pgmap v5733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:46 smithi035 ceph-mon[92535]: pgmap v5734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:46 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:48 smithi035 ceph-mon[92535]: pgmap v5735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:50 smithi035 ceph-mon[92535]: pgmap v5736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:49:10.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:52 smithi035 ceph-mon[92535]: pgmap v5737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:49:11.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:54 smithi035 ceph-mon[92535]: pgmap v5738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T11:49:11.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:56 smithi035 ceph-mon[92535]: pgmap v5739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:49:11.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:39:58 smithi035 ceph-mon[92535]: pgmap v5740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T11:49:11.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:00 smithi035 ceph-mon[92535]: pgmap v5741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:11.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:49:11.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:02 smithi035 ceph-mon[92535]: pgmap v5742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:04 smithi035 ceph-mon[92535]: pgmap v5743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:07 smithi035 ceph-mon[92535]: pgmap v5744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:09 smithi035 ceph-mon[92535]: pgmap v5745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:10 smithi035 ceph-mon[92535]: osdmap e427: 12 total, 12 up, 12 in 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:11 smithi035 ceph-mon[92535]: pgmap v5747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:13 smithi035 ceph-mon[92535]: pgmap v5748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:49:11.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:15 smithi035 ceph-mon[92535]: pgmap v5749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:49:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:49:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:49:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/3112552365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7ba97fa700 0 client.21573 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 >> 172.21.15.35:0/3112552365 conn(0x560593aee6b0 msgr2=0x560593c90410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 shutdown_connections 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/3112552365 wait complete. 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.644+0000 7f7bd41aeb80 20 client.21573 trim_cache size 0 max 16384 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 Processor -- start 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 -- start start 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593ca1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593ca7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593c88ba0 con 0x560593c91960 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593c9bc60 con 0x560593c974f0 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593c8c3b0 con 0x560593c96be0 2023-03-17T11:49:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593ca1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593ca1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57288/0 (socket says 172.21.15.35:57288) 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/200847744 learned_addr learned my addr 172.21.15.35:0/200847744 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc65be700 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593ca7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/200847744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 msgr2=0x560593ca7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593ca7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/200847744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 msgr2=0x560593c9cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.659+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/200847744 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560593baa130 con 0x560593c91960 2023-03-17T11:49:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593ca1f50 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc003a00 tx=0x7f7bbc012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6fb19df639ce3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bb0ff9700 1 -- 172.21.15.35:0/200847744 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc02f020 con 0x560593c91960 2023-03-17T11:49:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bb0ff9700 1 -- 172.21.15.35:0/200847744 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bbc005560 con 0x560593c91960 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bb0ff9700 1 -- 172.21.15.35:0/200847744 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc01fb00 con 0x560593c91960 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/200847744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 msgr2=0x560593ca1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593ca1f50 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc003a00 tx=0x7f7bbc012c20 comp rx=0 tx=0).stop 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/200847744 shutdown_connections 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593c9cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593ca1f50 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/200847744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593ca7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/200847744 >> 172.21.15.35:0/200847744 conn(0x560593aee6b0 msgr2=0x560593c90bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/200847744 shutdown_connections 2023-03-17T11:49:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.660+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/200847744 wait complete. 2023-03-17T11:49:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 -- start start 2023-03-17T11:49:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 Processor -- start 2023-03-17T11:49:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593cfdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593ca06c0 con 0x560593c91960 2023-03-17T11:49:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593ca0830 con 0x560593c974f0 2023-03-17T11:49:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560593cfe480 con 0x560593c96be0 2023-03-17T11:49:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bd41aeb80 10 client.0 _ll_register_callbacks cb 0x560593a89230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:49:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bc5dbd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57294/0 (socket says 172.21.15.35:57294) 2023-03-17T11:49:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/1730989735 learned_addr learned my addr 172.21.15.35:0/1730989735 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:24.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.661+0000 7f7bc65be700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593cfdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/1730989735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 msgr2=0x560593c9fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:26.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 msgr2=0x560593cfdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593cfdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc5dbd700 1 -- 172.21.15.35:0/1730989735 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560593a11d80 con 0x560593c91960 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc65be700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593cfdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bc5dbd700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9f980 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c00 tx=0x7f7bbc0038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1611378c30674c67 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7ba97fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7ba97fa700 1 -- 172.21.15.35:0/1730989735 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc02f030 con 0x560593c91960 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7ba97fa700 1 -- 172.21.15.35:0/1730989735 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(397..397 src has 1..397) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7bbc028660 con 0x560593c91960 2023-03-17T11:49:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560593c611e0 con 0x560593c91960 2023-03-17T11:49:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7ba97fa700 1 -- 172.21.15.35:0/1730989735 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bbc028820 con 0x560593c91960 2023-03-17T11:49:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 10 client.21579 fetch_fsmap learned FSMap version 108 2023-03-17T11:49:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x560593a381f0 con 0x560593c91960 2023-03-17T11:49:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7ba97fa700 1 -- 172.21.15.35:0/1730989735 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560593c611e0 con 0x560593c91960 2023-03-17T11:49:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7ba97fa700 1 -- 172.21.15.35:0/1730989735 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 108) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7bbc01f980 con 0x560593c91960 2023-03-17T11:49:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 10 client.21579 fetch_fsmap finished waiting for FSMap version 108 2023-03-17T11:49:27.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 10 client.21579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:49:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 20 client.21579 populate_metadata read hostname 'smithi035' 2023-03-17T11:49:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cff6c0 0x560593d01aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:27.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 4 client.21579 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:49:29.081 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.662+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560593a67f00 con 0x560593cff6c0 2023-03-17T11:49:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.663+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cff6c0 0x560593d01aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.663+0000 7f7ba97fa700 10 client.21579 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:00.663+0000 7f7bc55bc700 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cff6c0 0x560593d01aa0 crc :-1 s=READY pgs=767 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25cceebecb6928a3 server_cookie=133ab3de1902ed8c in_seq=0 out_seq=0 2023-03-17T11:49:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7ba97fa700 1 -- 172.21.15.35:0/1730989735 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560593a67f00 con 0x560593cff6c0 2023-03-17T11:49:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7ba97fa700 10 client.21579 handle_command_reply: tid=0 2023-03-17T11:49:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 client.21579 shutdown 2023-03-17T11:49:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 msgr2=0x560593c9f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9f980 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c00 tx=0x7f7bbc0038b0 comp rx=0 tx=0).stop 2023-03-17T11:49:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 shutdown_connections 2023-03-17T11:49:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560593cff6c0 0x560593d01aa0 crc :-1 s=READY pgs=767 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560593c974f0 0x560593cfdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:31.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560593c91960 0x560593c9f980 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 --2- 172.21.15.35:0/1730989735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560593c96be0 0x560593c9fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7ba97fa700 0 client.21579 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 >> 172.21.15.35:0/1730989735 conn(0x560593aee6b0 msgr2=0x560593c946b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 shutdown_connections 2023-03-17T11:49:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.444+0000 7f7bd41aeb80 1 -- 172.21.15.35:0/1730989735 wait complete. 2023-03-17T11:49:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bd41aeb80 20 client.21579 trim_cache size 0 max 16384 2023-03-17T11:49:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7bac09f640 msgr2=0x7f7bac0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7bac09f640 0x7f7bac0a1af0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009be0 tx=0x7f7bbc009260 comp rx=0 tx=0).stop 2023-03-17T11:49:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 msgr2=0x7f7bc01a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc01a2210 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8008e50 tx=0x7f7bb8008e80 comp rx=0 tx=0).stop 2023-03-17T11:49:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 shutdown_connections 2023-03-17T11:49:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7bac09f640 0x7f7bac0a1af0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7bc0104390 0x7f7bc01a2210 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bc00ff350 0x7f7bc0197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 --2- 172.21.15.35:0/1546091311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc00ffcf0 0x7f7bc01976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.445+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 >> 172.21.15.35:0/1546091311 conn(0x7f7bc0076330 msgr2=0x7f7bc00fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.446+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 shutdown_connections 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:03.446+0000 7f7bc8021700 1 -- 172.21.15.35:0/1546091311 wait complete. 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 -- 172.21.15.35:0/560548000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55441054f0 msgr2=0x7f554410d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 --2- 172.21.15.35:0/560548000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55441054f0 0x7f554410d100 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f553c00b0d0 tx=0x7f553c00b3e0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 -- 172.21.15.35:0/560548000 shutdown_connections 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 --2- 172.21.15.35:0/560548000 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f55441054f0 0x7f554410d100 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 --2- 172.21.15.35:0/560548000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5544100be0 0x7f5544100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 --2- 172.21.15.35:0/560548000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544101580 0x7f5544104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.573+0000 7f554b770700 1 -- 172.21.15.35:0/560548000 >> 172.21.15.35:0/560548000 conn(0x7f55440774e0 msgr2=0x7f55440778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 -- 172.21.15.35:0/560548000 shutdown_connections 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 -- 172.21.15.35:0/560548000 wait complete. 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 Processor -- start 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 -- start start 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 0x7f5544196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544101580 0x7f5544196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441054f0 0x7f554419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554419b330 con 0x7f5544100be0 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554419b4a0 con 0x7f55441054f0 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.574+0000 7f554b770700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554419b660 con 0x7f5544101580 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 0x7f5544196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 0x7f5544196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57332/0 (socket says 172.21.15.35:57332) 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 -- 172.21.15.35:0/3510214163 learned_addr learned my addr 172.21.15.35:0/3510214163 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544101580 0x7f5544196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441054f0 0x7f554419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 -- 172.21.15.35:0/3510214163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544101580 msgr2=0x7f5544196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544101580 0x7f5544196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 -- 172.21.15.35:0/3510214163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441054f0 msgr2=0x7f554419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441054f0 0x7f554419acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 -- 172.21.15.35:0/3510214163 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c009d00 con 0x7f5544100be0 2023-03-17T11:49:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441054f0 0x7f554419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:49:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554950c700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 0x7f5544196350 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f553400e9a0 tx=0x7f553400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f553a7fc700 1 -- 172.21.15.35:0/3510214163 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534009790 con 0x7f5544100be0 2023-03-17T11:49:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f553a7fc700 1 -- 172.21.15.35:0/3510214163 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f553400cbd0 con 0x7f5544100be0 2023-03-17T11:49:35.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55441101c0 con 0x7f5544100be0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f553a7fc700 1 -- 172.21.15.35:0/3510214163 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534018680 con 0x7f5544100be0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.575+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5544110030 con 0x7f5544100be0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.577+0000 7f553a7fc700 1 -- 172.21.15.35:0/3510214163 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f553400cd40 con 0x7f5544100be0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.578+0000 7f553a7fc700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f553009f640 0x7f55300a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.578+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f553009f640 0x7f55300a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.578+0000 7f553a7fc700 1 -- 172.21.15.35:0/3510214163 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(400..400 src has 1..400) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f5534014070 con 0x7f5544100be0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.579+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f553009f640 0x7f55300a1af0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5544197960 tx=0x7f554000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 Processor -- start 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 -- start start 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56347127cbe0 0x56347127cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471277420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563471277960 0x563471277d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56347117e010 con 0x56347127d4f0 2023-03-17T11:49:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634711d0950 con 0x56347127cbe0 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f55578fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634711c9de0 con 0x563471277960 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471277420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471277420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57342/0 (socket says 172.21.15.35:57342) 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 -- 172.21.15.35:0/439921960 learned_addr learned my addr 172.21.15.35:0/439921960 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f554950c700 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56347127cbe0 0x56347127cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5549d0d700 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563471277960 0x563471277d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 -- 172.21.15.35:0/439921960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563471277960 msgr2=0x563471277d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563471277960 0x563471277d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 -- 172.21.15.35:0/439921960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56347127cbe0 msgr2=0x56347127cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56347127cbe0 0x56347127cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.580+0000 7f5548d0b700 1 -- 172.21.15.35:0/439921960 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56347104b5d0 con 0x56347127d4f0 2023-03-17T11:49:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.581+0000 7f554950c700 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56347127cbe0 0x56347127cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.581+0000 7f5548d0b700 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471277420 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f5540010db0 tx=0x7f5540013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe00fa90ec847798 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.581+0000 7f552f7fe700 1 -- 172.21.15.35:0/439921960 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001e420 con 0x56347127d4f0 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.581+0000 7f552f7fe700 1 -- 172.21.15.35:0/439921960 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5540015070 con 0x56347127d4f0 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.581+0000 7f552f7fe700 1 -- 172.21.15.35:0/439921960 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001c870 con 0x56347127d4f0 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 -- 172.21.15.35:0/439921960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 msgr2=0x563471277420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471277420 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f5540010db0 tx=0x7f5540013000 comp rx=0 tx=0).stop 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 -- 172.21.15.35:0/439921960 shutdown_connections 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563471277960 0x563471277d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56347127cbe0 0x56347127cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 --2- 172.21.15.35:0/439921960 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471277420 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 -- 172.21.15.35:0/439921960 >> 172.21.15.35:0/439921960 conn(0x5634710d46b0 msgr2=0x563471271a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 -- 172.21.15.35:0/439921960 shutdown_connections 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 -- 172.21.15.35:0/439921960 wait complete. 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 -- start start 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.582+0000 7f55578fdb80 1 Processor -- start 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471283480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127cbe0 0x563471280700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471280d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56347104d8c0 con 0x56347127d4f0 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634712814d0 con 0x563471277960 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56347128d030 con 0x56347127cbe0 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 10 client.0 _ll_register_callbacks cb 0x56347106f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471280d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471280d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57350/0 (socket says 172.21.15.35:57350) 2023-03-17T11:49:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 -- 172.21.15.35:0/3373407334 learned_addr learned my addr 172.21.15.35:0/3373407334 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127cbe0 0x563471280700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f554950c700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471283480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 -- 172.21.15.35:0/3373407334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127cbe0 msgr2=0x563471280700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127cbe0 0x563471280700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 -- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 msgr2=0x563471283480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471283480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 -- 172.21.15.35:0/3373407334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5540010a60 con 0x56347127d4f0 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471280d60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f553c007f00 tx=0x7f553c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857c6373bcdb2e5a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f552cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f552cff9700 1 -- 172.21.15.35:0/3373407334 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00e070 con 0x56347127d4f0 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f552cff9700 1 -- 172.21.15.35:0/3373407334 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(400..400 src has 1..400) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f553c00baa0 con 0x56347127d4f0 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.583+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56347118c390 con 0x56347127d4f0 2023-03-17T11:49:44.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f552cff9700 1 -- 172.21.15.35:0/3373407334 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f553c0078d0 con 0x56347127d4f0 2023-03-17T11:49:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 10 client.21597 fetch_fsmap learned FSMap version 110 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x563470ff7d80 con 0x56347127d4f0 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f552cff9700 1 -- 172.21.15.35:0/3373407334 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56347118c390 con 0x56347127d4f0 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f552cff9700 1 -- 172.21.15.35:0/3373407334 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f553c00b100 con 0x56347127d4f0 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 10 client.21597 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 10 client.21597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 20 client.21597 populate_metadata read hostname 'smithi035' 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563471291010 0x563471293420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 4 client.21597 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563471198600 con 0x563471291010 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.584+0000 7f554950c700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563471291010 0x563471293420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f554950c700 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563471291010 0x563471293420 crc :-1 s=READY pgs=768 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b56023269fee4fa server_cookie=d031145f4ba02826 in_seq=0 out_seq=0 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f552cff9700 10 client.21597 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f552cff9700 1 -- 172.21.15.35:0/3373407334 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563471198600 con 0x563471291010 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f552cff9700 10 client.21597 handle_command_reply: tid=0 2023-03-17T11:49:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 client.21597 shutdown 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 msgr2=0x563471280d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471280d60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f553c007f00 tx=0x7f553c007f30 comp rx=0 tx=0).stop 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 shutdown_connections 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563471291010 0x563471293420 crc :-1 s=READY pgs=768 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127d4f0 0x563471280d60 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f552cff9700 0 client.21597 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471283480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3373407334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127cbe0 0x563471280700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.585+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 >> 172.21.15.35:0/3373407334 conn(0x5634710d46b0 msgr2=0x563471276410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.586+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 shutdown_connections 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.586+0000 7f55578fdb80 1 -- 172.21.15.35:0/3373407334 wait complete. 2023-03-17T11:49:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.586+0000 7f55578fdb80 20 client.21597 trim_cache size 0 max 16384 2023-03-17T11:49:47.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 Processor -- start 2023-03-17T11:49:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 -- start start 2023-03-17T11:49:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471287f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x563471283020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x56347127a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563471273c10 con 0x56347127cbe0 2023-03-17T11:49:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563471277330 con 0x563471277960 2023-03-17T11:49:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f55578fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634712777c0 con 0x56347127d4f0 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f5548d0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x563471283020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f5548d0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x563471283020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57354/0 (socket says 172.21.15.35:57354) 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.601+0000 7f5548d0b700 1 -- 172.21.15.35:0/2556578271 learned_addr learned my addr 172.21.15.35:0/2556578271 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f554950c700 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471287f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5548d0b700 1 -- 172.21.15.35:0/2556578271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 msgr2=0x56347127a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5549d0d700 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x56347127a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5548d0b700 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x56347127a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5548d0b700 1 -- 172.21.15.35:0/2556578271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 msgr2=0x563471287f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5548d0b700 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471287f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5548d0b700 1 -- 172.21.15.35:0/2556578271 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563471190130 con 0x56347127cbe0 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f554950c700 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471287f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:49:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f5548d0b700 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x563471283020 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f5540011ab0 tx=0x7f5540010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a9f2e0a86c6c82 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f552ffff700 1 -- 172.21.15.35:0/2556578271 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554002c040 con 0x56347127cbe0 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f552ffff700 1 -- 172.21.15.35:0/2556578271 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5540015040 con 0x56347127cbe0 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f552ffff700 1 -- 172.21.15.35:0/2556578271 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001e420 con 0x56347127cbe0 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 -- 172.21.15.35:0/2556578271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 msgr2=0x563471283020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x563471283020 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f5540011ab0 tx=0x7f5540010f50 comp rx=0 tx=0).stop 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 -- 172.21.15.35:0/2556578271 shutdown_connections 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x56347127a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x563471287f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 --2- 172.21.15.35:0/2556578271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x563471283020 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.602+0000 7f55578fdb80 1 -- 172.21.15.35:0/2556578271 >> 172.21.15.35:0/2556578271 conn(0x5634710d46b0 msgr2=0x563471276c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 -- 172.21.15.35:0/2556578271 shutdown_connections 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 -- 172.21.15.35:0/2556578271 wait complete. 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 -- start start 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 Processor -- start 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x5634712de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x5634712decf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x5634712d8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634712d94e0 con 0x56347127cbe0 2023-03-17T11:49:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634712d9650 con 0x563471277960 2023-03-17T11:49:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634712d9810 con 0x56347127d4f0 2023-03-17T11:49:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f55578fdb80 10 client.0 _ll_register_callbacks cb 0x56347106f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:49:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.603+0000 7f5548d0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x5634712decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x5634712decf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57362/0 (socket says 172.21.15.35:57362) 2023-03-17T11:49:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 -- 172.21.15.35:0/3430178777 learned_addr learned my addr 172.21.15.35:0/3430178777 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:49:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x5634712d8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f554950c700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x5634712de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 -- 172.21.15.35:0/3430178777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 msgr2=0x5634712d8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x5634712d8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 -- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 msgr2=0x5634712de7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x5634712de7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 -- 172.21.15.35:0/3430178777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56347104b5d0 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5549d0d700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x5634712d8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f5548d0b700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x5634712decf0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f5540004fd0 tx=0x7f5540004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32db0ad2ca16495 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f552cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f552cff9700 1 -- 172.21.15.35:0/3430178777 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554002c050 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f552cff9700 1 -- 172.21.15.35:0/3430178777 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(400..400 src has 1..400) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f5540017070 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634712471e0 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f552cff9700 1 -- 172.21.15.35:0/3430178777 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5540004a20 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f55578fdb80 10 client.21603 fetch_fsmap learned FSMap version 110 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56347101e1f0 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.604+0000 7f552cff9700 1 -- 172.21.15.35:0/3430178777 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634712471e0 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f552cff9700 1 -- 172.21.15.35:0/3430178777 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5540038070 con 0x56347127cbe0 2023-03-17T11:49:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f55578fdb80 10 client.21603 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f55578fdb80 10 client.21603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f55578fdb80 20 client.21603 populate_metadata read hostname 'smithi035' 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634712e6090 0x5634712e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f55578fdb80 4 client.21603 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56347104df00 con 0x5634712e6090 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f554950c700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634712e6090 0x5634712e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:49:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f554950c700 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634712e6090 0x5634712e84a0 crc :-1 s=READY pgs=769 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5d9027b1d0e7dc server_cookie=1474ddca374712ac in_seq=0 out_seq=0 2023-03-17T11:49:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.605+0000 7f552cff9700 10 client.21603 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f552cff9700 1 -- 172.21.15.35:0/3430178777 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56347104df00 con 0x5634712e6090 2023-03-17T11:49:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f552cff9700 10 client.21603 handle_command_reply: tid=0 2023-03-17T11:49:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 client.21603 shutdown 2023-03-17T11:49:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 msgr2=0x5634712decf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:56.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x5634712decf0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f5540004fd0 tx=0x7f5540004740 comp rx=0 tx=0).stop 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 shutdown_connections 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5634712e6090 0x5634712e84a0 crc :-1 s=READY pgs=769 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56347127d4f0 0x5634712d8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563471277960 0x5634712de7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 --2- 172.21.15.35:0/3430178777 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56347127cbe0 0x5634712decf0 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f552cff9700 0 client.21603 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 >> 172.21.15.35:0/3430178777 conn(0x5634710d46b0 msgr2=0x56347127a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 shutdown_connections 2023-03-17T11:49:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.623+0000 7f55578fdb80 1 -- 172.21.15.35:0/3430178777 wait complete. 2023-03-17T11:49:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f55578fdb80 20 client.21603 trim_cache size 0 max 16384 2023-03-17T11:49:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f553009f640 msgr2=0x7f55300a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f553009f640 0x7f55300a1af0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5544197960 tx=0x7f554000b410 comp rx=0 tx=0).stop 2023-03-17T11:49:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 msgr2=0x7f5544196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:49:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 0x7f5544196350 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f553400e9a0 tx=0x7f553400ecb0 comp rx=0 tx=0).stop 2023-03-17T11:49:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 shutdown_connections 2023-03-17T11:49:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f553009f640 0x7f55300a1af0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55441054f0 0x7f554419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:49:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5544100be0 0x7f5544196350 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:01.313 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 --2- 172.21.15.35:0/3510214163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544101580 0x7f5544196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 >> 172.21.15.35:0/3510214163 conn(0x7f55440774e0 msgr2=0x7f55440fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 shutdown_connections 2023-03-17T11:50:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:16.624+0000 7f554b770700 1 -- 172.21.15.35:0/3510214163 wait complete. 2023-03-17T11:50:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 -- 172.21.15.35:0/2592198966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 msgr2=0x7f691c10c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:02.955 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:17 smithi035 ceph-mon[92535]: pgmap v5750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T11:50:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 --2- 172.21.15.35:0/2592198966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c10c0a0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f691400b0d0 tx=0x7f691400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 -- 172.21.15.35:0/2592198966 shutdown_connections 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 --2- 172.21.15.35:0/2592198966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c10c0a0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 --2- 172.21.15.35:0/2592198966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c0ff4b0 0x7f691c0ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 --2- 172.21.15.35:0/2592198966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f691c0ffe50 0x7f691c103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 -- 172.21.15.35:0/2592198966 >> 172.21.15.35:0/2592198966 conn(0x7f691c077220 msgr2=0x7f691c077620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 -- 172.21.15.35:0/2592198966 shutdown_connections 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.746+0000 7f69218b3700 1 -- 172.21.15.35:0/2592198966 wait complete. 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 Processor -- start 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 -- start start 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c0ff4b0 0x7f691c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f691c0ffe50 0x7f691c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c1a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c198040 con 0x7f691c1044d0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c1a2780 con 0x7f691c0ffe50 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f69218b3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c1a2940 con 0x7f691c0ff4b0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c1a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c1a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57378/0 (socket says 172.21.15.35:57378) 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f691b7fe700 1 -- 172.21.15.35:0/449105209 learned_addr learned my addr 172.21.15.35:0/449105209 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f6913fff700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f691c0ffe50 0x7f691c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.747+0000 7f691affd700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c0ff4b0 0x7f691c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f691b7fe700 1 -- 172.21.15.35:0/449105209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c0ff4b0 msgr2=0x7f691c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f691b7fe700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c0ff4b0 0x7f691c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f691b7fe700 1 -- 172.21.15.35:0/449105209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f691c0ffe50 msgr2=0x7f691c197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f691b7fe700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f691c0ffe50 0x7f691c197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f691b7fe700 1 -- 172.21.15.35:0/449105209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914009d00 con 0x7f691c1044d0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f691b7fe700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c1a2240 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f6914009fd0 tx=0x7f691400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f69208b1700 1 -- 172.21.15.35:0/449105209 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400e040 con 0x7f691c1044d0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f69208b1700 1 -- 172.21.15.35:0/449105209 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6914003e10 con 0x7f691c1044d0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c10f130 con 0x7f691c1044d0 2023-03-17T11:50:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f69208b1700 1 -- 172.21.15.35:0/449105209 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140052a0 con 0x7f691c1044d0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.748+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c10efa0 con 0x7f691c1044d0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.750+0000 7f69208b1700 1 -- 172.21.15.35:0/449105209 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6914005400 con 0x7f691c1044d0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.751+0000 7f69208b1700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f69080039d0 0x7f6908005e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.751+0000 7f69208b1700 1 -- 172.21.15.35:0/449105209 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(400..400 src has 1..400) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f69140cb7c0 con 0x7f691c1044d0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.751+0000 7f691affd700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f69080039d0 0x7f6908005e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.751+0000 7f691affd700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f69080039d0 0x7f6908005e80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f690c005950 tx=0x7f690c0058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 Processor -- start 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 -- start start 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e792fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e78dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e683010 con 0x56443e792bf0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e6d5950 con 0x56443e793500 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f692da40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e6cede0 con 0x56443e78d970 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f691affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e792fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f691affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e792fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57382/0 (socket says 172.21.15.35:57382) 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.752+0000 7f691affd700 1 -- 172.21.15.35:0/3480235579 learned_addr learned my addr 172.21.15.35:0/3480235579 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f691affd700 1 -- 172.21.15.35:0/3480235579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 msgr2=0x56443e78dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f691affd700 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e78dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f691affd700 1 -- 172.21.15.35:0/3480235579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 msgr2=0x56443e78d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f6913fff700 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f691affd700 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f691affd700 1 -- 172.21.15.35:0/3480235579 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443e5505d0 con 0x56443e792bf0 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f6913fff700 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f691affd700 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e792fc0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f690c00fd70 tx=0x7f690c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4364220bb85f058c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f6911ffb700 1 -- 172.21.15.35:0/3480235579 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c011c60 con 0x56443e792bf0 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f6911ffb700 1 -- 172.21.15.35:0/3480235579 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f690c011dc0 con 0x56443e792bf0 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.753+0000 7f6911ffb700 1 -- 172.21.15.35:0/3480235579 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c01d750 con 0x56443e792bf0 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 -- 172.21.15.35:0/3480235579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 msgr2=0x56443e792fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e792fc0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f690c00fd70 tx=0x7f690c012000 comp rx=0 tx=0).stop 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 -- 172.21.15.35:0/3480235579 shutdown_connections 2023-03-17T11:50:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e78dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e792fc0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:07.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 --2- 172.21.15.35:0/3480235579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 -- 172.21.15.35:0/3480235579 >> 172.21.15.35:0/3480235579 conn(0x56443e5d96b0 msgr2=0x56443e776a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 -- 172.21.15.35:0/3480235579 shutdown_connections 2023-03-17T11:50:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 -- 172.21.15.35:0/3480235579 wait complete. 2023-03-17T11:50:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 -- start start 2023-03-17T11:50:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.754+0000 7f692da40b80 1 Processor -- start 2023-03-17T11:50:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e784960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e784ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e5528c0 con 0x56443e793500 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e780520 con 0x56443e792bf0 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e7806e0 con 0x56443e78d970 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 10 client.0 _ll_register_callbacks cb 0x56443e574230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57392/0 (socket says 172.21.15.35:57392) 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 -- 172.21.15.35:0/2066935255 learned_addr learned my addr 172.21.15.35:0/2066935255 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f6913fff700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e784ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691affd700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e784960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 -- 172.21.15.35:0/2066935255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 msgr2=0x56443e784960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e784960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 -- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 msgr2=0x56443e784ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e784ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 -- 172.21.15.35:0/2066935255 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c00fa20 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77fdb0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f6914098fd0 tx=0x7f6914098e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd09f2fb3c458a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f68faffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f68faffd700 1 -- 172.21.15.35:0/2066935255 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691401a3b0 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f68faffd700 1 -- 172.21.15.35:0/2066935255 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(400..400 src has 1..400) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f69140992d0 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.755+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56443e691390 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f68faffd700 1 -- 172.21.15.35:0/2066935255 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69140a1430 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 10 client.21615 fetch_fsmap learned FSMap version 110 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56443e4fcd80 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f68faffd700 1 -- 172.21.15.35:0/2066935255 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56443e691390 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f68faffd700 1 -- 172.21.15.35:0/2066935255 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f69140a0fa0 con 0x56443e793500 2023-03-17T11:50:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 10 client.21615 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 10 client.21615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 20 client.21615 populate_metadata read hostname 'smithi035' 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e795ee0 0x56443e7982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 4 client.21615 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56443e69d600 con 0x56443e795ee0 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.756+0000 7f691affd700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e795ee0 0x56443e7982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.757+0000 7f691affd700 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e795ee0 0x56443e7982f0 crc :-1 s=READY pgs=770 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f5fa029609be71b server_cookie=57a6661d7c5bfd88 in_seq=0 out_seq=0 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.757+0000 7f68faffd700 10 client.21615 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.757+0000 7f68faffd700 1 -- 172.21.15.35:0/2066935255 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56443e69d600 con 0x56443e795ee0 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.757+0000 7f68faffd700 10 client.21615 handle_command_reply: tid=0 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.757+0000 7f692da40b80 1 client.21615 shutdown 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 msgr2=0x56443e77fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77fdb0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f6914098fd0 tx=0x7f6914098e10 comp rx=0 tx=0).stop 2023-03-17T11:50:10.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 shutdown_connections 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e795ee0 0x56443e7982f0 crc :-1 s=READY pgs=770 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77fdb0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e784960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f68faffd700 0 client.21615 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 --2- 172.21.15.35:0/2066935255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e784ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 >> 172.21.15.35:0/2066935255 conn(0x56443e5d96b0 msgr2=0x56443e790810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 shutdown_connections 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 1 -- 172.21.15.35:0/2066935255 wait complete. 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.758+0000 7f692da40b80 20 client.21615 trim_cache size 0 max 16384 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.772+0000 7f692da40b80 1 Processor -- start 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.772+0000 7f692da40b80 1 -- start start 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f692da40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e776ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:10.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f692da40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e789670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f692da40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f692da40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e7720d0 con 0x56443e792bf0 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f692da40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e78d7d0 con 0x56443e793500 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f692da40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e7776d0 con 0x56443e78d970 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e789670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e789670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57398/0 (socket says 172.21.15.35:57398) 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 -- 172.21.15.35:0/2700302225 learned_addr learned my addr 172.21.15.35:0/2700302225 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:10.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f691affd700 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e776ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 -- 172.21.15.35:0/2700302225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 msgr2=0x56443e776ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e776ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 -- 172.21.15.35:0/2700302225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 msgr2=0x56443e78c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 -- 172.21.15.35:0/2700302225 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56443e695130 con 0x56443e792bf0 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f6913fff700 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e789670 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f691c069080 tx=0x7f6904012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113064a13b7c0e78 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.773+0000 7f69127fc700 1 -- 172.21.15.35:0/2700302225 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904017070 con 0x56443e792bf0 2023-03-17T11:50:10.095 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f69127fc700 1 -- 172.21.15.35:0/2700302225 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6904004cc0 con 0x56443e792bf0 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f69127fc700 1 -- 172.21.15.35:0/2700302225 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040054a0 con 0x56443e792bf0 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 -- 172.21.15.35:0/2700302225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 msgr2=0x56443e789670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e789670 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f691c069080 tx=0x7f6904012730 comp rx=0 tx=0).stop 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 -- 172.21.15.35:0/2700302225 shutdown_connections 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e793500 0x56443e78c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e776ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 --2- 172.21.15.35:0/2700302225 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e792bf0 0x56443e789670 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 -- 172.21.15.35:0/2700302225 >> 172.21.15.35:0/2700302225 conn(0x56443e5d96b0 msgr2=0x56443e78be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 -- 172.21.15.35:0/2700302225 shutdown_connections 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 -- 172.21.15.35:0/2700302225 wait complete. 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.774+0000 7f692da40b80 1 -- start start 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 Processor -- start 2023-03-17T11:50:10.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e789890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e77c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e77cdf0 con 0x56443e793500 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e7e9d40 con 0x56443e792bf0 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56443e7e9f00 con 0x56443e78d970 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f692da40b80 10 client.0 _ll_register_callbacks cb 0x56443e574230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:50:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:12.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:18 smithi035 ceph-mon[92535]: pgmap v5751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:50:12.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:18 smithi035 ceph-mon[92535]: osdmap e428: 12 total, 12 up, 12 in 2023-03-17T11:50:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57406/0 (socket says 172.21.15.35:57406) 2023-03-17T11:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 -- 172.21.15.35:0/2505287919 learned_addr learned my addr 172.21.15.35:0/2505287919 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f6913fff700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e77c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691affd700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e789890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 -- 172.21.15.35:0/2505287919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 msgr2=0x56443e789890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e789890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 -- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 msgr2=0x56443e77c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e77c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691b7fe700 1 -- 172.21.15.35:0/2505287919 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904009ae0 con 0x56443e793500 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.775+0000 7f691affd700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e789890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f691b7fe700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77c6f0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f6914097620 tx=0x7f691409d190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ab25ee0be58091 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f68faffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f68faffd700 1 -- 172.21.15.35:0/2505287919 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691407c070 con 0x56443e793500 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f68faffd700 1 -- 172.21.15.35:0/2505287919 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(400..400 src has 1..400) v4 ==== 8411+0+0 (secure 0 0 0) 0x7f691401a3b0 con 0x56443e793500 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56443e74c1e0 con 0x56443e793500 2023-03-17T11:50:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f68faffd700 1 -- 172.21.15.35:0/2505287919 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6914009550 con 0x56443e793500 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 10 client.21621 fetch_fsmap learned FSMap version 110 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56443e5231f0 con 0x56443e793500 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f68faffd700 1 -- 172.21.15.35:0/2505287919 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56443e74c1e0 con 0x56443e793500 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f68faffd700 1 -- 172.21.15.35:0/2505287919 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f691407f020 con 0x56443e793500 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 10 client.21621 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 10 client.21621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 20 client.21621 populate_metadata read hostname 'smithi035' 2023-03-17T11:50:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e7eb0e0 0x56443e7ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:17.480 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 4 client.21621 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:50:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.776+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56443e552f00 con 0x56443e7eb0e0 2023-03-17T11:50:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.777+0000 7f691affd700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e7eb0e0 0x56443e7ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.777+0000 7f68faffd700 10 client.21621 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.777+0000 7f691affd700 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e7eb0e0 0x56443e7ed4c0 crc :-1 s=READY pgs=771 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42d769398d52b44 server_cookie=6b68cd8aad7afff4 in_seq=0 out_seq=0 2023-03-17T11:50:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.785+0000 7f68faffd700 1 -- 172.21.15.35:0/2505287919 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56443e552f00 con 0x56443e7eb0e0 2023-03-17T11:50:18.012 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.785+0000 7f68faffd700 10 client.21621 handle_command_reply: tid=0 2023-03-17T11:50:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.785+0000 7f692da40b80 1 client.21621 shutdown 2023-03-17T11:50:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 msgr2=0x56443e77c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77c6f0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f6914097620 tx=0x7f691409d190 comp rx=0 tx=0).stop 2023-03-17T11:50:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 shutdown_connections 2023-03-17T11:50:18.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56443e7eb0e0 0x56443e7ed4c0 crc :-1 s=READY pgs=771 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56443e793500 0x56443e77c6f0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56443e78d970 0x56443e789890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f68faffd700 0 client.21621 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 --2- 172.21.15.35:0/2505287919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56443e792bf0 0x56443e77c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 >> 172.21.15.35:0/2505287919 conn(0x56443e5d96b0 msgr2=0x56443e78c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 shutdown_connections 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 1 -- 172.21.15.35:0/2505287919 wait complete. 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f692da40b80 20 client.21621 trim_cache size 0 max 16384 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f69080039d0 msgr2=0x7f6908005e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f69218b3700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f69080039d0 0x7f6908005e80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f690c005950 tx=0x7f690c0058e0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 msgr2=0x7f691c1a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.786+0000 7f69218b3700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c1a2240 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f6914009fd0 tx=0x7f691400cce0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 shutdown_connections 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f69080039d0 0x7f6908005e80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f691c1044d0 0x7f691c1a2240 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c0ff4b0 0x7f691c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 --2- 172.21.15.35:0/449105209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f691c0ffe50 0x7f691c197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 >> 172.21.15.35:0/449105209 conn(0x7f691c077220 msgr2=0x7f691c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 shutdown_connections 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:26:29.787+0000 7f69218b3700 1 -- 172.21.15.35:0/449105209 wait complete. 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 -- 172.21.15.35:0/890135205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 msgr2=0x7f00ec103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 --2- 172.21.15.35:0/890135205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec103cf0 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f00d40099c0 tx=0x7f00d4009cd0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 -- 172.21.15.35:0/890135205 shutdown_connections 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 --2- 172.21.15.35:0/890135205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec104420 0x7f00ec10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 --2- 172.21.15.35:0/890135205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 0x7f00ec0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 --2- 172.21.15.35:0/890135205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec103cf0 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 -- 172.21.15.35:0/890135205 >> 172.21.15.35:0/890135205 conn(0x7f00ec074590 msgr2=0x7f00ec074990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 -- 172.21.15.35:0/890135205 shutdown_connections 2023-03-17T11:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.819+0000 7f00f248f700 1 -- 172.21.15.35:0/890135205 wait complete. 2023-03-17T11:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 Processor -- start 2023-03-17T11:50:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 -- start start 2023-03-17T11:50:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 0x7f00ec196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec104420 0x7f00ec19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec19b360 con 0x7f00ec1004c0 2023-03-17T11:50:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec19b4d0 con 0x7f00ec0ffb20 2023-03-17T11:50:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00f248f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec19b690 con 0x7f00ec104420 2023-03-17T11:50:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:24.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.820+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec1968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57422/0 (socket says 172.21.15.35:57422) 2023-03-17T11:50:24.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 -- 172.21.15.35:0/3946076411 learned_addr learned my addr 172.21.15.35:0/3946076411 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:24.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00ebfff700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 0x7f00ec196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:24.374 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 -- 172.21.15.35:0/3946076411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec104420 msgr2=0x7f00ec19ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec104420 0x7f00ec19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec104420 0x7f00ec19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 -- 172.21.15.35:0/3946076411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 msgr2=0x7f00ec196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 0x7f00ec196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 -- 172.21.15.35:0/3946076411 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40095f0 con 0x7f00ec1004c0 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00ebfff700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 0x7f00ec196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec1968c0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f00d4006010 tx=0x7f00d4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00e97fa700 1 -- 172.21.15.35:0/3946076411 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d401d070 con 0x7f00ec1004c0 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00e97fa700 1 -- 172.21.15.35:0/3946076411 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00d4004100 con 0x7f00ec1004c0 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec10f000 con 0x7f00ec1004c0 2023-03-17T11:50:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00e97fa700 1 -- 172.21.15.35:0/3946076411 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4022d70 con 0x7f00ec1004c0 2023-03-17T11:50:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.821+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec10ee70 con 0x7f00ec1004c0 2023-03-17T11:50:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.824+0000 7f00e97fa700 1 -- 172.21.15.35:0/3946076411 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f00d4022570 con 0x7f00ec1004c0 2023-03-17T11:50:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.824+0000 7f00e97fa700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f00d809f6c0 0x7f00d80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.824+0000 7f00e97fa700 1 -- 172.21.15.35:0/3946076411 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(403..403 src has 1..403) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f00d40cb940 con 0x7f00ec1004c0 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.824+0000 7f00ebfff700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f00d809f6c0 0x7f00d80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00ebfff700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f00d809f6c0 0x7f00d80a1b70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f00dc005fd0 tx=0x7f00dc005ee0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 Processor -- start 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 -- start start 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd405fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd400420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd307010 con 0x5564dd400960 2023-03-17T11:50:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd359950 con 0x5564dd4064f0 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.825+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd352de0 con 0x5564dd405be0 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57432/0 (socket says 172.21.15.35:57432) 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd400420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 -- 172.21.15.35:0/1388892781 learned_addr learned my addr 172.21.15.35:0/1388892781 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00ebfff700 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd405fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 -- 172.21.15.35:0/1388892781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 msgr2=0x5564dd405fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd405fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 -- 172.21.15.35:0/1388892781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 msgr2=0x5564dd400420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd400420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 -- 172.21.15.35:0/1388892781 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564dd1d45d0 con 0x5564dd400960 2023-03-17T11:50:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400d90 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009c30 tx=0x7f00e4009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80221bd0fe1a0abe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00e27fc700 1 -- 172.21.15.35:0/1388892781 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4004bb0 con 0x5564dd400960 2023-03-17T11:50:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00e27fc700 1 -- 172.21.15.35:0/1388892781 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00e4004d10 con 0x5564dd400960 2023-03-17T11:50:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.826+0000 7f00e27fc700 1 -- 172.21.15.35:0/1388892781 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4014660 con 0x5564dd400960 2023-03-17T11:50:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 -- 172.21.15.35:0/1388892781 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 msgr2=0x5564dd400d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400d90 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009c30 tx=0x7f00e4009f40 comp rx=0 tx=0).stop 2023-03-17T11:50:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 -- 172.21.15.35:0/1388892781 shutdown_connections 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400d90 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd405fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/1388892781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd400420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 -- 172.21.15.35:0/1388892781 >> 172.21.15.35:0/1388892781 conn(0x5564dd25d6b0 msgr2=0x5564dd3faa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 -- 172.21.15.35:0/1388892781 shutdown_connections 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 -- 172.21.15.35:0/1388892781 wait complete. 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.827+0000 7f00fe61cb80 1 -- start start 2023-03-17T11:50:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 Processor -- start 2023-03-17T11:50:32.244 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd400960 0x5564dd40c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd409600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd409b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd1d68c0 con 0x5564dd405be0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd40a310 con 0x5564dd4064f0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd40a4d0 con 0x5564dd400960 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00fe61cb80 10 client.0 _ll_register_callbacks cb 0x5564dd1f8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd409600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd409600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57436/0 (socket says 172.21.15.35:57436) 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2035343965 learned_addr learned my addr 172.21.15.35:0/2035343965 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd409b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.828+0000 7f00ebfff700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd400960 0x5564dd40c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2035343965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd400960 msgr2=0x5564dd40c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd400960 0x5564dd40c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 msgr2=0x5564dd409b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd409b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2035343965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e4009860 con 0x5564dd405be0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd409600 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f00d4095950 tx=0x7f00d40992a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3be59899cf0f76 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:50:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2035343965 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40b0070 con 0x5564dd405be0 2023-03-17T11:50:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2035343965 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(403..403 src has 1..403) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f00d409f0b0 con 0x5564dd405be0 2023-03-17T11:50:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564dd315390 con 0x5564dd405be0 2023-03-17T11:50:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2035343965 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00d4098db0 con 0x5564dd405be0 2023-03-17T11:50:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 10 client.21633 fetch_fsmap learned FSMap version 110 2023-03-17T11:50:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5564dd180d80 con 0x5564dd405be0 2023-03-17T11:50:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2035343965 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564dd315390 con 0x5564dd405be0 2023-03-17T11:50:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2035343965 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f00d40a1120 con 0x5564dd405be0 2023-03-17T11:50:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 10 client.21633 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:50:35.317 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 10 client.21633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:50:37.354 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 20 client.21633 populate_metadata read hostname 'smithi035' 2023-03-17T11:50:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd419c80 0x5564dd41c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 4 client.21633 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:50:38.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:20 smithi035 ceph-mon[92535]: pgmap v5753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:50:40.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:22 smithi035 ceph-mon[92535]: pgmap v5754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T11:50:40.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:24 smithi035 ceph-mon[92535]: pgmap v5755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:26 smithi035 ceph-mon[92535]: pgmap v5756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:28 smithi035 ceph-mon[92535]: pgmap v5757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:30 smithi035 ceph-mon[92535]: pgmap v5758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 268 B/s wr, 9 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:32 smithi035 ceph-mon[92535]: pgmap v5759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:34 smithi035 ceph-mon[92535]: pgmap v5760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:36 smithi035 ceph-mon[92535]: pgmap v5761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:38 smithi035 ceph-mon[92535]: pgmap v5762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:50:40.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:40 smithi035 ceph-mon[92535]: pgmap v5763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:50:40.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:42 smithi035 ceph-mon[92535]: pgmap v5764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:50:40.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:44 smithi035 ceph-mon[92535]: pgmap v5765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:50:40.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:46 smithi035 ceph-mon[92535]: pgmap v5766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:50:40.209 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:50:41.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:47 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:41.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:48 smithi035 ceph-mon[92535]: pgmap v5767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:50:41.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:48 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:41.658 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: pgmap v5768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.355 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:52 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:52 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:52 smithi035 ceph-mon[92535]: pgmap v5769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 257 B/s wr, 8 op/s 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:52 smithi035 ceph-mon[92535]: pgmap v5770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 310 B/s wr, 10 op/s 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:54 smithi035 ceph-mon[92535]: pgmap v5771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:56 smithi035 ceph-mon[92535]: pgmap v5772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:50:43.356 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:40:58 smithi035 ceph-mon[92535]: pgmap v5773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:50:46.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:00 smithi035 ceph-mon[92535]: pgmap v5774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:50:46.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:02 smithi035 ceph-mon[92535]: pgmap v5775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:50:46.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:04 smithi035 ceph-mon[92535]: pgmap v5776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:50:46.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:06 smithi035 ceph-mon[92535]: pgmap v5777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:50:46.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:08 smithi035 ceph-mon[92535]: pgmap v5778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:50:46.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:09 smithi035 ceph-mon[92535]: osdmap e429: 12 total, 12 up, 12 in 2023-03-17T11:50:47.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:10 smithi035 ceph-mon[92535]: pgmap v5780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:50:47.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:12 smithi035 ceph-mon[92535]: pgmap v5781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:50:47.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:14 smithi035 ceph-mon[92535]: pgmap v5782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:50:47.846 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:16 smithi035 ceph-mon[92535]: pgmap v5783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:50:47.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:18 smithi035 ceph-mon[92535]: pgmap v5784: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:50:47.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:18 smithi035 ceph-mon[92535]: osdmap e430: 12 total, 12 up, 12 in 2023-03-17T11:50:47.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:20 smithi035 ceph-mon[92535]: pgmap v5786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:50:47.847 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:22 smithi035 ceph-mon[92535]: pgmap v5787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:50:47.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:50:47.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:50:47.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:50:47.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:50:47.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:50:47.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:50:47.848 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:50:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.829+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564dd321600 con 0x5564dd419c80 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.830+0000 7f00ebfff700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd419c80 0x5564dd41c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.830+0000 7f00ebfff700 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd419c80 0x5564dd41c060 crc :-1 s=READY pgs=772 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203d4d4730444fe4 server_cookie=56e4b38d25feaf22 in_seq=0 out_seq=0 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.830+0000 7f00cb7fe700 10 client.21633 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2035343965 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5564dd321600 con 0x5564dd419c80 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00cb7fe700 10 client.21633 handle_command_reply: tid=0 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 client.21633 shutdown 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 msgr2=0x5564dd409600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:49.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd409600 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f00d4095950 tx=0x7f00d40992a0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 shutdown_connections 2023-03-17T11:50:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd419c80 0x5564dd41c060 crc :-1 s=READY pgs=772 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd409b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd400960 0x5564dd40c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00cb7fe700 0 client.21633 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2035343965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd409600 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 >> 172.21.15.35:0/2035343965 conn(0x5564dd25d6b0 msgr2=0x5564dd3faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 shutdown_connections 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2035343965 wait complete. 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.831+0000 7f00fe61cb80 20 client.21633 trim_cache size 0 max 16384 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 Processor -- start 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 -- start start 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd3faac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd410f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd3fb000 con 0x5564dd400960 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd3f60d0 con 0x5564dd4064f0 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd3fcc00 con 0x5564dd405be0 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57442/0 (socket says 172.21.15.35:57442) 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.846+0000 7f00ebfff700 1 -- 172.21.15.35:0/4166828638 learned_addr learned my addr 172.21.15.35:0/4166828638 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd3faac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00ebfff700 1 -- 172.21.15.35:0/4166828638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 msgr2=0x5564dd3faac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd410f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00ebfff700 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd3faac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00ebfff700 1 -- 172.21.15.35:0/4166828638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 msgr2=0x5564dd410f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00ebfff700 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd410f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00ebfff700 1 -- 172.21.15.35:0/4166828638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564dd319130 con 0x5564dd400960 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00ebfff700 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400420 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009410 tx=0x7f00dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da72d31b673b8903 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00e2ffd700 1 -- 172.21.15.35:0/4166828638 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc025040 con 0x5564dd400960 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00e2ffd700 1 -- 172.21.15.35:0/4166828638 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00dc0044b0 con 0x5564dd400960 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.847+0000 7f00e2ffd700 1 -- 172.21.15.35:0/4166828638 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc028d50 con 0x5564dd400960 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 -- 172.21.15.35:0/4166828638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 msgr2=0x5564dd400420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400420 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009410 tx=0x7f00dc009f90 comp rx=0 tx=0).stop 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 -- 172.21.15.35:0/4166828638 shutdown_connections 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd4064f0 0x5564dd410f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd400960 0x5564dd400420 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/4166828638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd405be0 0x5564dd3faac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 -- 172.21.15.35:0/4166828638 >> 172.21.15.35:0/4166828638 conn(0x5564dd25d6b0 msgr2=0x5564dd4037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 -- 172.21.15.35:0/4166828638 shutdown_connections 2023-03-17T11:50:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 -- 172.21.15.35:0/4166828638 wait complete. 2023-03-17T11:50:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 -- start start 2023-03-17T11:50:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.848+0000 7f00fe61cb80 1 Processor -- start 2023-03-17T11:50:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd400960 0x5564dd402b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd4016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd4064f0 0x5564dd401be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd403260 con 0x5564dd405be0 2023-03-17T11:50:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd402120 con 0x5564dd400960 2023-03-17T11:50:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dd4022e0 con 0x5564dd4064f0 2023-03-17T11:50:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00fe61cb80 10 client.0 _ll_register_callbacks cb 0x5564dd1f8230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:50:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd4016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:52.747 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd4016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57450/0 (socket says 172.21.15.35:57450) 2023-03-17T11:50:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd400960 0x5564dd402b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2225374659 learned_addr learned my addr 172.21.15.35:0/2225374659 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00f0a2c700 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd4064f0 0x5564dd401be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2225374659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd4064f0 msgr2=0x5564dd401be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd4064f0 0x5564dd401be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd400960 msgr2=0x5564dd402b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd400960 0x5564dd402b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 -- 172.21.15.35:0/2225374659 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc00edf0 con 0x5564dd405be0 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00eb7fe700 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd4016a0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f00d4005f50 tx=0x7f00d40950d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1172557e0ccc83f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.849+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2225374659 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40b0070 con 0x5564dd405be0 2023-03-17T11:50:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.850+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2225374659 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(403..403 src has 1..403) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f00d4099450 con 0x5564dd405be0 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.850+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564dd3d01e0 con 0x5564dd405be0 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.850+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2225374659 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00d4009290 con 0x5564dd405be0 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.850+0000 7f00fe61cb80 10 client.21639 fetch_fsmap learned FSMap version 110 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.850+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5564dd1a71f0 con 0x5564dd405be0 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.850+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2225374659 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564dd3d01e0 con 0x5564dd405be0 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2225374659 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f00d4095330 con 0x5564dd405be0 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00fe61cb80 10 client.21639 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:50:54.094 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00fe61cb80 10 client.21639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:50:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00fe61cb80 20 client.21639 populate_metadata read hostname 'smithi035' 2023-03-17T11:50:54.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd46e7a0 0x5564dd470b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00fe61cb80 4 client.21639 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5564dd1d6f00 con 0x5564dd46e7a0 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00ebfff700 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd46e7a0 0x5564dd470b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00cb7fe700 10 client.21639 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.851+0000 7f00ebfff700 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd46e7a0 0x5564dd470b80 crc :-1 s=READY pgs=773 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22166f55557553d5 server_cookie=474182e11eea47ba in_seq=0 out_seq=0 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.867+0000 7f00cb7fe700 1 -- 172.21.15.35:0/2225374659 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5564dd1d6f00 con 0x5564dd46e7a0 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.867+0000 7f00cb7fe700 10 client.21639 handle_command_reply: tid=0 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.867+0000 7f00fe61cb80 1 client.21639 shutdown 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 msgr2=0x5564dd4016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:54.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd4016a0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f00d4005f50 tx=0x7f00d40950d0 comp rx=0 tx=0).stop 2023-03-17T11:50:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 shutdown_connections 2023-03-17T11:50:54.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5564dd46e7a0 0x5564dd470b80 crc :-1 s=READY pgs=773 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5564dd4064f0 0x5564dd401be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00cb7fe700 0 client.21639 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564dd400960 0x5564dd402b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 --2- 172.21.15.35:0/2225374659 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5564dd405be0 0x5564dd4016a0 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 >> 172.21.15.35:0/2225374659 conn(0x5564dd25d6b0 msgr2=0x5564dd4095a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 shutdown_connections 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 1 -- 172.21.15.35:0/2225374659 wait complete. 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00fe61cb80 20 client.21639 trim_cache size 0 max 16384 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f00d809f6c0 msgr2=0x7f00d80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f00d809f6c0 0x7f00d80a1b70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f00dc005fd0 tx=0x7f00dc005ee0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 msgr2=0x7f00ec1968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec1968c0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f00d4006010 tx=0x7f00d4009510 comp rx=0 tx=0).stop 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 shutdown_connections 2023-03-17T11:50:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f00d809f6c0 0x7f00d80a1b70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00ec104420 0x7f00ec19ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ec0ffb20 0x7f00ec196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 --2- 172.21.15.35:0/3946076411 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f00ec1004c0 0x7f00ec1968c0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 >> 172.21.15.35:0/3946076411 conn(0x7f00ec074590 msgr2=0x7f00ec0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.868+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 shutdown_connections 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:14.869+0000 7f00f248f700 1 -- 172.21.15.35:0/3946076411 wait complete. 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 -- 172.21.15.35:0/3155561193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b8100e70 msgr2=0x7f23b8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 --2- 172.21.15.35:0/3155561193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b8100e70 0x7f23b8104de0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f23a40099c0 tx=0x7f23a4009cd0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 -- 172.21.15.35:0/3155561193 shutdown_connections 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 --2- 172.21.15.35:0/3155561193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23b81054c0 0x7f23b810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 --2- 172.21.15.35:0/3155561193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b81004d0 0x7f23b81008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 --2- 172.21.15.35:0/3155561193 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b8100e70 0x7f23b8104de0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 -- 172.21.15.35:0/3155561193 >> 172.21.15.35:0/3155561193 conn(0x7f23b8078170 msgr2=0x7f23b8078570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 -- 172.21.15.35:0/3155561193 shutdown_connections 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.991+0000 7f23bee4c700 1 -- 172.21.15.35:0/3155561193 wait complete. 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 Processor -- start 2023-03-17T11:50:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 -- start start 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 0x7f23b8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23b8100e70 0x7f23b8196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b81054c0 0x7f23b819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b819b230 con 0x7f23b81004d0 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b819b3a0 con 0x7f23b8100e70 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bee4c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b819b560 con 0x7f23b81054c0 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 0x7f23b8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 0x7f23b8196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57462/0 (socket says 172.21.15.35:57462) 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 -- 172.21.15.35:0/927063938 learned_addr learned my addr 172.21.15.35:0/927063938 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:50:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23b7fff700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23b8100e70 0x7f23b8196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 -- 172.21.15.35:0/927063938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b81054c0 msgr2=0x7f23b819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:56.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b81054c0 0x7f23b819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b81054c0 0x7f23b819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:56.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 -- 172.21.15.35:0/927063938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23b8100e70 msgr2=0x7f23b8196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:50:56.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23b8100e70 0x7f23b8196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:50:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.992+0000 7f23bcbe8700 1 -- 172.21.15.35:0/927063938 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40095f0 con 0x7f23b81004d0 2023-03-17T11:50:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.993+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 0x7f23b8196250 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00d980 tx=0x7f23ac00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.993+0000 7f23b5ffb700 1 -- 172.21.15.35:0/927063938 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00bb60 con 0x7f23b81004d0 2023-03-17T11:50:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.993+0000 7f23b5ffb700 1 -- 172.21.15.35:0/927063938 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23ac007640 con 0x7f23b81004d0 2023-03-17T11:50:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.993+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b81100f0 con 0x7f23b81004d0 2023-03-17T11:50:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.993+0000 7f23b5ffb700 1 -- 172.21.15.35:0/927063938 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac004d60 con 0x7f23b81004d0 2023-03-17T11:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.993+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b810ff60 con 0x7f23b81004d0 2023-03-17T11:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.995+0000 7f23b5ffb700 1 -- 172.21.15.35:0/927063938 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f23ac004020 con 0x7f23b81004d0 2023-03-17T11:50:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.996+0000 7f23b5ffb700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f23a809f6c0 0x7f23a80a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:50:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.996+0000 7f23b7fff700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f23a809f6c0 0x7f23a80a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:50:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.996+0000 7f23b5ffb700 1 -- 172.21.15.35:0/927063938 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f23ac0ca450 con 0x7f23b81004d0 2023-03-17T11:50:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23b7fff700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f23a809f6c0 0x7f23a80a1b70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009990 tx=0x7f23a4005ec0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:50:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 Processor -- start 2023-03-17T11:50:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 -- start start 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaaa4010 con 0x5602aab9d960 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaaf6950 con 0x5602aaba34f0 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.997+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaaefde0 con 0x5602aaba2be0 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57474/0 (socket says 172.21.15.35:57474) 2023-03-17T11:51:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 -- 172.21.15.35:0/1686744879 learned_addr learned my addr 172.21.15.35:0/1686744879 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:00.298 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:24 smithi035 ceph-mon[92535]: pgmap v5788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:51:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23b7fff700 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 -- 172.21.15.35:0/1686744879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 msgr2=0x5602aaba2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 -- 172.21.15.35:0/1686744879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 msgr2=0x5602aab9d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 -- 172.21.15.35:0/1686744879 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602aa9715d0 con 0x5602aab9d960 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9dd90 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f23b000d200 tx=0x7f23b0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dc216424bb8bb1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23a2ffd700 1 -- 172.21.15.35:0/1686744879 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000dd20 con 0x5602aab9d960 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23a2ffd700 1 -- 172.21.15.35:0/1686744879 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23b000de80 con 0x5602aab9d960 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.998+0000 7f23a2ffd700 1 -- 172.21.15.35:0/1686744879 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00123f0 con 0x5602aab9d960 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 -- 172.21.15.35:0/1686744879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 msgr2=0x5602aab9dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9dd90 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f23b000d200 tx=0x7f23b0007f90 comp rx=0 tx=0).stop 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 -- 172.21.15.35:0/1686744879 shutdown_connections 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9dd90 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/1686744879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 -- 172.21.15.35:0/1686744879 >> 172.21.15.35:0/1686744879 conn(0x5602aa9fa6b0 msgr2=0x5602aab97a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:04.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 -- 172.21.15.35:0/1686744879 shutdown_connections 2023-03-17T11:51:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 -- 172.21.15.35:0/1686744879 wait complete. 2023-03-17T11:51:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 -- start start 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:27.999+0000 7f23cafd9b80 1 Processor -- start 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aaba9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba2be0 0x5602aaba6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba34f0 0x5602aaba6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aa9738c0 con 0x5602aab9d960 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaba7320 con 0x5602aaba2be0 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaba74e0 con 0x5602aaba34f0 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23cafd9b80 10 client.0 _ll_register_callbacks cb 0x5602aa995230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aaba9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aaba9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57476/0 (socket says 172.21.15.35:57476) 2023-03-17T11:51:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 -- 172.21.15.35:0/384706296 learned_addr learned my addr 172.21.15.35:0/384706296 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23b7fff700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba2be0 0x5602aaba6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba34f0 0x5602aaba6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 -- 172.21.15.35:0/384706296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba34f0 msgr2=0x5602aaba6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba34f0 0x5602aaba6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 -- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba2be0 msgr2=0x5602aaba6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:08.068 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba2be0 0x5602aaba6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.000+0000 7f23bcbe8700 1 -- 172.21.15.35:0/384706296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0007c70 con 0x5602aab9d960 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba34f0 0x5602aaba6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aaba9430 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f23ac097c00 tx=0x7f23ac00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cee840e6a867a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f2397fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f2397fff700 1 -- 172.21.15.35:0/384706296 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac0b0260 con 0x5602aab9d960 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f2397fff700 1 -- 172.21.15.35:0/384706296 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f23ac0973f0 con 0x5602aab9d960 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602aaab2390 con 0x5602aab9d960 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f2397fff700 1 -- 172.21.15.35:0/384706296 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23ac0975b0 con 0x5602aab9d960 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 10 client.21651 fetch_fsmap learned FSMap version 110 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5602aa91dd80 con 0x5602aab9d960 2023-03-17T11:51:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f2397fff700 1 -- 172.21.15.35:0/384706296 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5602aaab2390 con 0x5602aab9d960 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f2397fff700 1 -- 172.21.15.35:0/384706296 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f23ac093e80 con 0x5602aab9d960 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 10 client.21651 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 10 client.21651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 20 client.21651 populate_metadata read hostname 'smithi035' 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aabb6ed0 0x5602aabb92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 4 client.21651 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.001+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602aaabe600 con 0x5602aabb6ed0 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.002+0000 7f23b7fff700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aabb6ed0 0x5602aabb92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.002+0000 7f23b7fff700 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aabb6ed0 0x5602aabb92b0 crc :-1 s=READY pgs=774 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954effe215c90206 server_cookie=5094d874f5cbca13 in_seq=0 out_seq=0 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.002+0000 7f2397fff700 10 client.21651 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f2397fff700 1 -- 172.21.15.35:0/384706296 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5602aaabe600 con 0x5602aabb6ed0 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f2397fff700 10 client.21651 handle_command_reply: tid=0 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 client.21651 shutdown 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 msgr2=0x5602aaba9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aaba9430 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f23ac097c00 tx=0x7f23ac00de60 comp rx=0 tx=0).stop 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 shutdown_connections 2023-03-17T11:51:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aabb6ed0 0x5602aabb92b0 crc :-1 s=READY pgs=774 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba34f0 0x5602aaba6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f2397fff700 0 client.21651 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aaba9430 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/384706296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba2be0 0x5602aaba6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.003+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 >> 172.21.15.35:0/384706296 conn(0x5602aa9fa6b0 msgr2=0x5602aab97a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.004+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 shutdown_connections 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.004+0000 7f23cafd9b80 1 -- 172.21.15.35:0/384706296 wait complete. 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.004+0000 7f23cafd9b80 20 client.21651 trim_cache size 0 max 16384 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 Processor -- start 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 -- start start 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab97ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaabe600 con 0x5602aab9d960 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaab2390 con 0x5602aaba34f0 2023-03-17T11:51:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaba3360 con 0x5602aaba2be0 2023-03-17T11:51:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57484/0 (socket says 172.21.15.35:57484) 2023-03-17T11:51:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.019+0000 7f23bcbe8700 1 -- 172.21.15.35:0/394030189 learned_addr learned my addr 172.21.15.35:0/394030189 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23b7fff700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bcbe8700 1 -- 172.21.15.35:0/394030189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 msgr2=0x5602aaba65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab97ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bcbe8700 1 -- 172.21.15.35:0/394030189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 msgr2=0x5602aab97ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab97ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bcbe8700 1 -- 172.21.15.35:0/394030189 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602aaab6130 con 0x5602aab9d960 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23b7fff700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab97ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9d420 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f23ac017000 tx=0x7f23ac00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2958285f1024f62b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23a37fe700 1 -- 172.21.15.35:0/394030189 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac07d070 con 0x5602aab9d960 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23a37fe700 1 -- 172.21.15.35:0/394030189 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23ac097cd0 con 0x5602aab9d960 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.020+0000 7f23a37fe700 1 -- 172.21.15.35:0/394030189 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac09fc60 con 0x5602aab9d960 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- 172.21.15.35:0/394030189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 msgr2=0x5602aab9d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9d420 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f23ac017000 tx=0x7f23ac00bf50 comp rx=0 tx=0).stop 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- 172.21.15.35:0/394030189 shutdown_connections 2023-03-17T11:51:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab97ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9d420 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/394030189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aaba65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- 172.21.15.35:0/394030189 >> 172.21.15.35:0/394030189 conn(0x5602aa9fa6b0 msgr2=0x5602aaba5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- 172.21.15.35:0/394030189 shutdown_connections 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- 172.21.15.35:0/394030189 wait complete. 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- start start 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 Processor -- start 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aab9e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaba0060 con 0x5602aab9d960 2023-03-17T11:51:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aaba01d0 con 0x5602aaba34f0 2023-03-17T11:51:17.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.021+0000 7f23cafd9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aab9f120 con 0x5602aaba2be0 2023-03-17T11:51:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23cafd9b80 10 client.0 _ll_register_callbacks cb 0x5602aa995230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:51:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:17.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57490/0 (socket says 172.21.15.35:57490) 2023-03-17T11:51:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 -- 172.21.15.35:0/768501981 learned_addr learned my addr 172.21.15.35:0/768501981 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23b7fff700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aab9e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 -- 172.21.15.35:0/768501981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 msgr2=0x5602aab9e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aab9e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 -- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 msgr2=0x5602aab9ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 -- 172.21.15.35:0/768501981 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602aa91dd80 con 0x5602aab9d960 2023-03-17T11:51:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bd3e9700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23b7fff700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aab9e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23bcbe8700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9fa40 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0980c0 tx=0x7f23ac00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8eca9ebef75273 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f2397fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f2397fff700 1 -- 172.21.15.35:0/768501981 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac07d070 con 0x5602aab9d960 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f2397fff700 1 -- 172.21.15.35:0/768501981 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f23ac09fe70 con 0x5602aab9d960 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602aab6d1e0 con 0x5602aab9d960 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f2397fff700 1 -- 172.21.15.35:0/768501981 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23ac0973f0 con 0x5602aab9d960 2023-03-17T11:51:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23cafd9b80 10 client.21657 fetch_fsmap learned FSMap version 110 2023-03-17T11:51:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.022+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5602aa9441f0 con 0x5602aab9d960 2023-03-17T11:51:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f2397fff700 1 -- 172.21.15.35:0/768501981 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5602aab6d1e0 con 0x5602aab9d960 2023-03-17T11:51:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f2397fff700 1 -- 172.21.15.35:0/768501981 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f23ac098ce0 con 0x5602aab9d960 2023-03-17T11:51:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23cafd9b80 10 client.21657 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:51:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23cafd9b80 10 client.21657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:51:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23cafd9b80 20 client.21657 populate_metadata read hostname 'smithi035' 2023-03-17T11:51:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aac0b850 0x5602aac0dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23cafd9b80 4 client.21657 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5602aa973f00 con 0x5602aac0b850 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23b7fff700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aac0b850 0x5602aac0dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f2397fff700 10 client.21657 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.023+0000 7f23b7fff700 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aac0b850 0x5602aac0dc30 crc :-1 s=READY pgs=775 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c51c07005202e7 server_cookie=298fb4d58d143425 in_seq=0 out_seq=0 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f2397fff700 1 -- 172.21.15.35:0/768501981 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5602aa973f00 con 0x5602aac0b850 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f2397fff700 10 client.21657 handle_command_reply: tid=0 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 client.21657 shutdown 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 msgr2=0x5602aab9fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9fa40 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0980c0 tx=0x7f23ac00de60 comp rx=0 tx=0).stop 2023-03-17T11:51:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 shutdown_connections 2023-03-17T11:51:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5602aac0b850 0x5602aac0dc30 crc :-1 s=READY pgs=775 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602aaba34f0 0x5602aab9ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f2397fff700 0 client.21657 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5602aab9d960 0x5602aab9fa40 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 --2- 172.21.15.35:0/768501981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602aaba2be0 0x5602aab9e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 >> 172.21.15.35:0/768501981 conn(0x5602aa9fa6b0 msgr2=0x5602aaba3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 shutdown_connections 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.032+0000 7f23cafd9b80 1 -- 172.21.15.35:0/768501981 wait complete. 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23cafd9b80 20 client.21657 trim_cache size 0 max 16384 2023-03-17T11:51:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f23a809f6c0 msgr2=0x7f23a80a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:25.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:26 smithi035 ceph-mon[92535]: pgmap v5789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:51:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f23a809f6c0 0x7f23a80a1b70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009990 tx=0x7f23a4005ec0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 msgr2=0x7f23b8196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 0x7f23b8196250 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00d980 tx=0x7f23ac00dd40 comp rx=0 tx=0).stop 2023-03-17T11:51:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 shutdown_connections 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f23a809f6c0 0x7f23a80a1b70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23b81054c0 0x7f23b819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23b81004d0 0x7f23b8196250 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 --2- 172.21.15.35:0/927063938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23b8100e70 0x7f23b8196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 >> 172.21.15.35:0/927063938 conn(0x7f23b8078170 msgr2=0x7f23b80fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 shutdown_connections 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:28.033+0000 7f23bee4c700 1 -- 172.21.15.35:0/927063938 wait complete. 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 -- 172.21.15.35:0/836638894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1601043b0 msgr2=0x7fb16010bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 --2- 172.21.15.35:0/836638894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1601043b0 0x7fb16010bf80 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fb15800b0d0 tx=0x7fb15800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 -- 172.21.15.35:0/836638894 shutdown_connections 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 --2- 172.21.15.35:0/836638894 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1601043b0 0x7fb16010bf80 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 --2- 172.21.15.35:0/836638894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1600ff370 0x7fb1600ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 --2- 172.21.15.35:0/836638894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1600ffd10 0x7fb160103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 -- 172.21.15.35:0/836638894 >> 172.21.15.35:0/836638894 conn(0x7fb160076160 msgr2=0x7fb160076560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 -- 172.21.15.35:0/836638894 shutdown_connections 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.156+0000 7fb165419700 1 -- 172.21.15.35:0/836638894 wait complete. 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 Processor -- start 2023-03-17T11:51:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 -- start start 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1600ff370 0x7fb160196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 0x7fb1601968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1601043b0 0x7fb16019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16019b350 con 0x7fb1600ffd10 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16019b4c0 con 0x7fb1600ff370 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb165419700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16019b680 con 0x7fb1601043b0 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb15e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 0x7fb1601968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb15e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 0x7fb1601968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57506/0 (socket says 172.21.15.35:57506) 2023-03-17T11:51:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1182309170 learned_addr learned my addr 172.21.15.35:0/1182309170 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb15effd700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1600ff370 0x7fb160196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.157+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1601043b0 0x7fb16019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1182309170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1601043b0 msgr2=0x7fb16019ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1601043b0 0x7fb16019ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1182309170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1600ff370 msgr2=0x7fb160196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1600ff370 0x7fb160196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1182309170 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158009d00 con 0x7fb1600ffd10 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 0x7fb1601968b0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fb15000e940 tx=0x7fb15000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb147fff700 1 -- 172.21.15.35:0/1182309170 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150009730 con 0x7fb1600ffd10 2023-03-17T11:51:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb147fff700 1 -- 172.21.15.35:0/1182309170 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb15000ce70 con 0x7fb1600ffd10 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb147fff700 1 -- 172.21.15.35:0/1182309170 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150018420 con 0x7fb1600ffd10 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16010efe0 con 0x7fb1600ffd10 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.158+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16010ee50 con 0x7fb1600ffd10 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.160+0000 7fb147fff700 1 -- 172.21.15.35:0/1182309170 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fb15000c9e0 con 0x7fb1600ffd10 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.161+0000 7fb147fff700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb14809f6c0 0x7fb1480a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.161+0000 7fb147fff700 1 -- 172.21.15.35:0/1182309170 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb150014070 con 0x7fb1600ffd10 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.161+0000 7fb15effd700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb14809f6c0 0x7fb1480a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.161+0000 7fb15effd700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb14809f6c0 0x7fb1480a1b70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb154009c60 tx=0x7fb154009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 Processor -- start 2023-03-17T11:51:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 -- start start 2023-03-17T11:51:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf90df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:30.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bf94c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf955c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7be93010 con 0x561f7bf95170 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bee5950 con 0x561f7bf90a20 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bedede0 con 0x561f7bf91330 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb15f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb15f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57516/0 (socket says 172.21.15.35:57516) 2023-03-17T11:51:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb15f7fe700 1 -- 172.21.15.35:0/503964274 learned_addr learned my addr 172.21.15.35:0/503964274 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bf94c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.162+0000 7fb15effd700 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf90df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15f7fe700 1 -- 172.21.15.35:0/503964274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 msgr2=0x561f7bf94c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bf94c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15f7fe700 1 -- 172.21.15.35:0/503964274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 msgr2=0x561f7bf90df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf90df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15f7fe700 1 -- 172.21.15.35:0/503964274 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f7bd605d0 con 0x561f7bf95170 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15effd700 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf90df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf955c0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fb158009c90 tx=0x7fb158005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2775f8bec6640e57 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb1457fa700 1 -- 172.21.15.35:0/503964274 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800e040 con 0x561f7bf95170 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb1457fa700 1 -- 172.21.15.35:0/503964274 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb158007b90 con 0x561f7bf95170 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.163+0000 7fb1457fa700 1 -- 172.21.15.35:0/503964274 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158003a00 con 0x561f7bf95170 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 -- 172.21.15.35:0/503964274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 msgr2=0x561f7bf955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf955c0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fb158009c90 tx=0x7fb158005a20 comp rx=0 tx=0).stop 2023-03-17T11:51:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 -- 172.21.15.35:0/503964274 shutdown_connections 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf955c0 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf90df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/503964274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bf94c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 -- 172.21.15.35:0/503964274 >> 172.21.15.35:0/503964274 conn(0x561f7bde96b0 msgr2=0x561f7bf86a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 -- 172.21.15.35:0/503964274 shutdown_connections 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 -- 172.21.15.35:0/503964274 wait complete. 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 -- start start 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.164+0000 7fb1715a6b80 1 Processor -- start 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf90a20 0x561f7bf9c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 0x561f7bf99b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf95170 0x561f7bf9a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bd628c0 con 0x561f7bf91330 2023-03-17T11:51:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bf9a8d0 con 0x561f7bf95170 2023-03-17T11:51:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bfa63b0 con 0x561f7bf90a20 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb1715a6b80 10 client.0 _ll_register_callbacks cb 0x561f7bd84230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 0x561f7bf99b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 0x561f7bf99b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57520/0 (socket says 172.21.15.35:57520) 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1782643588 learned_addr learned my addr 172.21.15.35:0/1782643588 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15effd700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf90a20 0x561f7bf9c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf95170 0x561f7bf9a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1782643588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf90a20 msgr2=0x561f7bf9c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf90a20 0x561f7bf9c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf95170 msgr2=0x561f7bf9a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf95170 0x561f7bf9a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 -- 172.21.15.35:0/1782643588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16010c7c0 con 0x561f7bf91330 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf95170 0x561f7bf9a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 0x561f7bf99b30 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fb15000f010 tx=0x7fb150097c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d34a5b5e2056ed0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.165+0000 7fb142ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:51:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb142ff5700 1 -- 172.21.15.35:0/1782643588 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150097940 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb142ff5700 1 -- 172.21.15.35:0/1782643588 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb150098250 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f7bea1390 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb142ff5700 1 -- 172.21.15.35:0/1782643588 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1500a0440 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 10 client.21669 fetch_fsmap learned FSMap version 110 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561f7bd0cd80 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb142ff5700 1 -- 172.21.15.35:0/1782643588 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561f7bea1390 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb142ff5700 1 -- 172.21.15.35:0/1782643588 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb1500abaf0 con 0x561f7bf91330 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 10 client.21669 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 10 client.21669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 20 client.21669 populate_metadata read hostname 'smithi035' 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfaa490 0x561f7bfac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 4 client.21669 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f7bead600 con 0x561f7bfaa490 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.166+0000 7fb15effd700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfaa490 0x561f7bfac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.167+0000 7fb15effd700 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfaa490 0x561f7bfac8a0 crc :-1 s=READY pgs=779 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf48b33f9ec0b3f7 server_cookie=1d0d5306b756f47a in_seq=0 out_seq=0 2023-03-17T11:51:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.167+0000 7fb142ff5700 10 client.21669 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb142ff5700 1 -- 172.21.15.35:0/1782643588 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561f7bead600 con 0x561f7bfaa490 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb142ff5700 10 client.21669 handle_command_reply: tid=0 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 client.21669 shutdown 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 msgr2=0x561f7bf99b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 0x561f7bf99b30 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fb15000f010 tx=0x7fb150097c30 comp rx=0 tx=0).stop 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 shutdown_connections 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfaa490 0x561f7bfac8a0 crc :-1 s=READY pgs=779 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf95170 0x561f7bf9a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb142ff5700 0 client.21669 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf90a20 0x561f7bf9c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/1782643588 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf91330 0x561f7bf99b30 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 >> 172.21.15.35:0/1782643588 conn(0x561f7bde96b0 msgr2=0x561f7bf8b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 shutdown_connections 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 1 -- 172.21.15.35:0/1782643588 wait complete. 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.168+0000 7fb1715a6b80 20 client.21669 trim_cache size 0 max 16384 2023-03-17T11:51:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 Processor -- start 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 -- start start 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf86ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bfa1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf97550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bf82120 con 0x561f7bf95170 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bf87030 con 0x561f7bf90a20 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bf876d0 con 0x561f7bf91330 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf97550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf97550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57530/0 (socket says 172.21.15.35:57530) 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 -- 172.21.15.35:0/2299902297 learned_addr learned my addr 172.21.15.35:0/2299902297 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15effd700 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf86ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bfa1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 -- 172.21.15.35:0/2299902297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 msgr2=0x561f7bfa1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bfa1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 -- 172.21.15.35:0/2299902297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 msgr2=0x561f7bf86ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf86ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 -- 172.21.15.35:0/2299902297 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f7bfb14d0 con 0x561f7bf95170 2023-03-17T11:51:38.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.183+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf97550 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fb158009fd0 tx=0x7fb158006140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91e53f947c061d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:38.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb145ffb700 1 -- 172.21.15.35:0/2299902297 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800e040 con 0x561f7bf95170 2023-03-17T11:51:38.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb145ffb700 1 -- 172.21.15.35:0/2299902297 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb158007d90 con 0x561f7bf95170 2023-03-17T11:51:38.456 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb145ffb700 1 -- 172.21.15.35:0/2299902297 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158003d30 con 0x561f7bf95170 2023-03-17T11:51:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 -- 172.21.15.35:0/2299902297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 msgr2=0x561f7bf97550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:40.437 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:28 smithi035 ceph-mon[92535]: pgmap v5790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:51:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf97550 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fb158009fd0 tx=0x7fb158006140 comp rx=0 tx=0).stop 2023-03-17T11:51:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 -- 172.21.15.35:0/2299902297 shutdown_connections 2023-03-17T11:51:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf95170 0x561f7bf97550 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf90a20 0x561f7bf86ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/2299902297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf91330 0x561f7bfa1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 -- 172.21.15.35:0/2299902297 >> 172.21.15.35:0/2299902297 conn(0x561f7bde96b0 msgr2=0x561f7bfa5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 -- 172.21.15.35:0/2299902297 shutdown_connections 2023-03-17T11:51:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 -- 172.21.15.35:0/2299902297 wait complete. 2023-03-17T11:51:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.184+0000 7fb1715a6b80 1 -- start start 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 Processor -- start 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 0x561f7bf9f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf91330 0x561f7bf9fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf95170 0x561f7bff7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bff7840 con 0x561f7bf90a20 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bff79b0 con 0x561f7bf91330 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f7bff7b70 con 0x561f7bf95170 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb1715a6b80 10 client.0 _ll_register_callbacks cb 0x561f7bd84230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 0x561f7bf9f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 0x561f7bf9f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57532/0 (socket says 172.21.15.35:57532) 2023-03-17T11:51:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 -- 172.21.15.35:0/3453475976 learned_addr learned my addr 172.21.15.35:0/3453475976 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf91330 0x561f7bf9fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf95170 0x561f7bff7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 -- 172.21.15.35:0/3453475976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf95170 msgr2=0x561f7bff7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf95170 0x561f7bff7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 -- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf91330 msgr2=0x561f7bf9fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf91330 0x561f7bf9fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 -- 172.21.15.35:0/3453475976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f7bd605d0 con 0x561f7bf90a20 2023-03-17T11:51:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15f7fe700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf95170 0x561f7bff7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb15effd700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 0x561f7bf9f4d0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fb154013010 tx=0x7fb1540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c4a7698e85c316 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.185+0000 7fb142ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb142ff5700 1 -- 172.21.15.35:0/3453475976 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154023040 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb142ff5700 1 -- 172.21.15.35:0/3453475976 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fb154028a00 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f7bf5c1e0 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb142ff5700 1 -- 172.21.15.35:0/3453475976 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb154028bc0 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 10 client.21675 fetch_fsmap learned FSMap version 110 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561f7bcf5c00 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb142ff5700 1 -- 172.21.15.35:0/3453475976 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561f7bf5c1e0 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb142ff5700 1 -- 172.21.15.35:0/3453475976 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fb154031500 con 0x561f7bf90a20 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 10 client.21675 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 10 client.21675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 20 client.21675 populate_metadata read hostname 'smithi035' 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfff260 0x561f7c001670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 4 client.21675 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561f7bd62f00 con 0x561f7bfff260 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.186+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfff260 0x561f7c001670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.187+0000 7fb142ff5700 10 client.21675 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.187+0000 7fb15e7fc700 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfff260 0x561f7c001670 crc :-1 s=READY pgs=780 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf8a9c5dec22713 server_cookie=146499e85fd6cd47 in_seq=0 out_seq=0 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.195+0000 7fb142ff5700 1 -- 172.21.15.35:0/3453475976 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561f7bd62f00 con 0x561f7bfff260 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.195+0000 7fb142ff5700 10 client.21675 handle_command_reply: tid=0 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.195+0000 7fb1715a6b80 1 client.21675 shutdown 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.195+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 msgr2=0x561f7bf9f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.195+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 0x561f7bf9f4d0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fb154013010 tx=0x7fb1540047c0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 shutdown_connections 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561f7bfff260 0x561f7c001670 crc :-1 s=READY pgs=780 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561f7bf95170 0x561f7bff7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561f7bf90a20 0x561f7bf9f4d0 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb142ff5700 0 client.21675 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 --2- 172.21.15.35:0/3453475976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f7bf91330 0x561f7bf9fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 >> 172.21.15.35:0/3453475976 conn(0x561f7bde96b0 msgr2=0x561f7bf931f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 shutdown_connections 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 1 -- 172.21.15.35:0/3453475976 wait complete. 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb1715a6b80 20 client.21675 trim_cache size 0 max 16384 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb14809f6c0 msgr2=0x7fb1480a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb14809f6c0 0x7fb1480a1b70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb154009c60 tx=0x7fb154009260 comp rx=0 tx=0).stop 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 msgr2=0x7fb1601968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 0x7fb1601968b0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fb15000e940 tx=0x7fb15000ec50 comp rx=0 tx=0).stop 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 shutdown_connections 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fb14809f6c0 0x7fb1480a1b70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1601043b0 0x7fb16019ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1600ff370 0x7fb160196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 --2- 172.21.15.35:0/1182309170 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fb1600ffd10 0x7fb1601968b0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.196+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 >> 172.21.15.35:0/1182309170 conn(0x7fb160076160 msgr2=0x7fb160102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.197+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 shutdown_connections 2023-03-17T11:51:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:41.197+0000 7fb165419700 1 -- 172.21.15.35:0/1182309170 wait complete. 2023-03-17T11:51:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 -- 172.21.15.35:0/2481996900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f40ff3b0 msgr2=0x7f95f40ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 --2- 172.21.15.35:0/2481996900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f40ff3b0 0x7f95f40ff780 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f95f00099c0 tx=0x7f95f0009cd0 comp rx=0 tx=0).stop 2023-03-17T11:51:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 -- 172.21.15.35:0/2481996900 shutdown_connections 2023-03-17T11:51:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 --2- 172.21.15.35:0/2481996900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95f41043f0 0x7f95f410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 --2- 172.21.15.35:0/2481996900 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f40ff3b0 0x7f95f40ff780 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 --2- 172.21.15.35:0/2481996900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f40ffd50 0x7f95f4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 -- 172.21.15.35:0/2481996900 >> 172.21.15.35:0/2481996900 conn(0x7f95f4075f60 msgr2=0x7f95f4076360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 -- 172.21.15.35:0/2481996900 shutdown_connections 2023-03-17T11:51:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.318+0000 7f95fc423700 1 -- 172.21.15.35:0/2481996900 wait complete. 2023-03-17T11:51:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 Processor -- start 2023-03-17T11:51:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 -- start start 2023-03-17T11:51:53.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95f40ff3b0 0x7f95f4100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f40ffd50 0x7f95f41012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 0x7f95f41a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4101b20 con 0x7f95f41043f0 2023-03-17T11:51:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f41a4990 con 0x7f95f40ff3b0 2023-03-17T11:51:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fc423700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f41a4ad0 con 0x7f95f40ffd50 2023-03-17T11:51:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 0x7f95f41a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 0x7f95f41a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57552/0 (socket says 172.21.15.35:57552) 2023-03-17T11:51:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 -- 172.21.15.35:0/3904401053 learned_addr learned my addr 172.21.15.35:0/3904401053 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95f99be700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f40ffd50 0x7f95f41012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95f40ff3b0 0x7f95f4100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 -- 172.21.15.35:0/3904401053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f40ffd50 msgr2=0x7f95f41012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f40ffd50 0x7f95f41012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 -- 172.21.15.35:0/3904401053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95f40ff3b0 msgr2=0x7f95f4100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95f40ff3b0 0x7f95f4100db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 -- 172.21.15.35:0/3904401053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00095f0 con 0x7f95f41043f0 2023-03-17T11:51:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.319+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 0x7f95f41a4450 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f95ec007ee0 tx=0x7f95ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.320+0000 7f95eb7fe700 1 -- 172.21.15.35:0/3904401053 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00dd20 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.320+0000 7f95eb7fe700 1 -- 172.21.15.35:0/3904401053 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95ec00f040 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.320+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f410f060 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.320+0000 7f95eb7fe700 1 -- 172.21.15.35:0/3904401053 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004750 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.320+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f410eed0 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.322+0000 7f95eb7fe700 1 -- 172.21.15.35:0/3904401053 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f95ec003a00 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.323+0000 7f95eb7fe700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95e009f6c0 0x7f95e00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.323+0000 7f95eb7fe700 1 -- 172.21.15.35:0/3904401053 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95ec0c9e40 con 0x7f95f41043f0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.323+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95e009f6c0 0x7f95e00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.323+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95e009f6c0 0x7f95e00a1b70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f95f000b580 tx=0x7f95f0005c00 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.323+0000 7f96085b0b80 1 Processor -- start 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 -- start start 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f7efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f7f4f0 0x5646e5f79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f79960 0x5646e5f79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5e80010 con 0x5646e5f7ebe0 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5ed2950 con 0x5646e5f7f4f0 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f96085b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5ecbde0 con 0x5646e5f79960 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f7efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f7efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57556/0 (socket says 172.21.15.35:57556) 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 -- 172.21.15.35:0/2325772595 learned_addr learned my addr 172.21.15.35:0/2325772595 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95f99be700 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f7f4f0 0x5646e5f79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 -- 172.21.15.35:0/2325772595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f79960 msgr2=0x5646e5f79d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f79960 0x5646e5f79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f79960 0x5646e5f79d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 -- 172.21.15.35:0/2325772595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f7f4f0 msgr2=0x5646e5f79420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.324+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f7f4f0 0x5646e5f79420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.325+0000 7f95fa1bf700 1 -- 172.21.15.35:0/2325772595 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e5d4d5d0 con 0x5646e5f7ebe0 2023-03-17T11:51:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.325+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f7efb0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f95f0015000 tx=0x7f95f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc5f91e9fba1e8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:51:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.325+0000 7f95e8dae700 1 -- 172.21.15.35:0/2325772595 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0028070 con 0x5646e5f7ebe0 2023-03-17T11:51:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.325+0000 7f95e8dae700 1 -- 172.21.15.35:0/2325772595 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f001e040 con 0x5646e5f7ebe0 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.325+0000 7f95e8dae700 1 -- 172.21.15.35:0/2325772595 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000f6c0 con 0x5646e5f7ebe0 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- 172.21.15.35:0/2325772595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 msgr2=0x5646e5f7efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f7efb0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f95f0015000 tx=0x7f95f001f000 comp rx=0 tx=0).stop 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- 172.21.15.35:0/2325772595 shutdown_connections 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f79960 0x5646e5f79d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f7efb0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2325772595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f7f4f0 0x5646e5f79420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- 172.21.15.35:0/2325772595 >> 172.21.15.35:0/2325772595 conn(0x5646e5dd66b0 msgr2=0x5646e5f73a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- 172.21.15.35:0/2325772595 shutdown_connections 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- 172.21.15.35:0/2325772595 wait complete. 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- start start 2023-03-17T11:51:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 Processor -- start 2023-03-17T11:51:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f854f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f82700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f82e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5d4f8c0 con 0x5646e5f7ebe0 2023-03-17T11:52:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f83580 con 0x5646e5f79960 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.326+0000 7f96085b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f8f000 con 0x5646e5f7f4f0 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f96085b0b80 10 client.0 _ll_register_callbacks cb 0x5646e5d71230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f82700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f82700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57564/0 (socket says 172.21.15.35:57564) 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 -- 172.21.15.35:0/2093651044 learned_addr learned my addr 172.21.15.35:0/2093651044 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f82e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 -- 172.21.15.35:0/2093651044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 msgr2=0x5646e5f82e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f82e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 -- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 msgr2=0x5646e5f854f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f854f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 -- 172.21.15.35:0/2093651044 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f410c800 con 0x5646e5f7ebe0 2023-03-17T11:52:02.766 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:30 smithi035 ceph-mon[92535]: pgmap v5791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:52:04.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:32 smithi035 ceph-mon[92535]: pgmap v5792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:04.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:34 smithi035 ceph-mon[92535]: pgmap v5793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:04.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:36 smithi035 ceph-mon[92535]: pgmap v5794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:04.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:38 smithi035 ceph-mon[92535]: pgmap v5795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:04.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:40 smithi035 ceph-mon[92535]: pgmap v5796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:04.407 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:42 smithi035 ceph-mon[92535]: pgmap v5797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:04.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:44 smithi035 ceph-mon[92535]: pgmap v5798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:04.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:46 smithi035 ceph-mon[92535]: pgmap v5799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:04.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:48 smithi035 ceph-mon[92535]: pgmap v5800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:04.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:50 smithi035 ceph-mon[92535]: pgmap v5801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:04.408 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:52:06.410 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:52 smithi035 ceph-mon[92535]: pgmap v5802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:54 smithi035 ceph-mon[92535]: pgmap v5803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:56 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:57 smithi035 ceph-mon[92535]: pgmap v5804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:57 smithi035 ceph-mon[92535]: pgmap v5805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:52:06.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:41:59 smithi035 ceph-mon[92535]: pgmap v5806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:52:08.053 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:00 smithi035 ceph-mon[92535]: pgmap v5807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:52:11.429 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:02 smithi035 ceph-mon[92535]: pgmap v5808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T11:52:12.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:04 smithi035 ceph-mon[92535]: pgmap v5809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:52:12.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:06 smithi035 ceph-mon[92535]: pgmap v5810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:52:12.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:08 smithi035 ceph-mon[92535]: pgmap v5811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:52:15.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:09 smithi035 ceph-mon[92535]: osdmap e431: 12 total, 12 up, 12 in 2023-03-17T11:52:15.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:10 smithi035 ceph-mon[92535]: pgmap v5813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:52:15.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:12 smithi035 ceph-mon[92535]: pgmap v5814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:52:15.979 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:14 smithi035 ceph-mon[92535]: pgmap v5815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:52:16.771 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:16 smithi035 ceph-mon[92535]: pgmap v5816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:18 smithi035 ceph-mon[92535]: pgmap v5817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:18 smithi035 ceph-mon[92535]: osdmap e432: 12 total, 12 up, 12 in 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:20 smithi035 ceph-mon[92535]: pgmap v5819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:22 smithi035 ceph-mon[92535]: pgmap v5820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:24 smithi035 ceph-mon[92535]: pgmap v5821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:26 smithi035 ceph-mon[92535]: pgmap v5822: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:28 smithi035 ceph-mon[92535]: pgmap v5823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:30 smithi035 ceph-mon[92535]: pgmap v5824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 8 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:32 smithi035 ceph-mon[92535]: pgmap v5825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:34 smithi035 ceph-mon[92535]: pgmap v5826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:36 smithi035 ceph-mon[92535]: pgmap v5827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:38 smithi035 ceph-mon[92535]: pgmap v5828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:40 smithi035 ceph-mon[92535]: pgmap v5829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:42 smithi035 ceph-mon[92535]: pgmap v5830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:44 smithi035 ceph-mon[92535]: pgmap v5831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:16.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:46 smithi035 ceph-mon[92535]: pgmap v5832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:16.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:48 smithi035 ceph-mon[92535]: pgmap v5833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:16.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:50 smithi035 ceph-mon[92535]: pgmap v5834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:16.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:52 smithi035 ceph-mon[92535]: pgmap v5835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:16.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:54 smithi035 ceph-mon[92535]: pgmap v5836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:56 smithi035 ceph-mon[92535]: pgmap v5837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:58 smithi035 ceph-mon[92535]: pgmap v5838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:18.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:52:18.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:52:18.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:59 smithi035 ceph-mon[92535]: pgmap v5839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T11:52:18.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:59 smithi035 ceph-mon[92535]: pgmap v5840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T11:52:18.330 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:42:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:52:19.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:01 smithi035 ceph-mon[92535]: pgmap v5841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T11:52:19.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:03 smithi035 ceph-mon[92535]: pgmap v5842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T11:52:19.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:05 smithi035 ceph-mon[92535]: pgmap v5843: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T11:52:19.644 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:07 smithi035 ceph-mon[92535]: pgmap v5844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 55 KiB/s wr, 23 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:09 smithi035 ceph-mon[92535]: pgmap v5845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 30 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:09 smithi035 ceph-mon[92535]: osdmap e433: 12 total, 12 up, 12 in 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:11 smithi035 ceph-mon[92535]: pgmap v5847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 30 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:13 smithi035 ceph-mon[92535]: pgmap v5848: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:15 smithi035 ceph-mon[92535]: pgmap v5849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:17 smithi035 ceph-mon[92535]: pgmap v5850: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:17 smithi035 ceph-mon[92535]: osdmap e434: 12 total, 12 up, 12 in 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:19 smithi035 ceph-mon[92535]: pgmap v5852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T11:52:19.645 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:21 smithi035 ceph-mon[92535]: pgmap v5853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:52:21.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:23 smithi035 ceph-mon[92535]: pgmap v5854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:52:21.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:25 smithi035 ceph-mon[92535]: pgmap v5855: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:52:21.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:27 smithi035 ceph-mon[92535]: pgmap v5856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:52:21.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:29 smithi035 ceph-mon[92535]: pgmap v5857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 370 B/s wr, 9 op/s 2023-03-17T11:52:21.047 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:31 smithi035 ceph-mon[92535]: pgmap v5858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:52:21.048 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:33 smithi035 ceph-mon[92535]: pgmap v5859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:52:21.048 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:35 smithi035 ceph-mon[92535]: pgmap v5860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:37 smithi035 ceph-mon[92535]: pgmap v5861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:39 smithi035 ceph-mon[92535]: pgmap v5862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:41 smithi035 ceph-mon[92535]: pgmap v5863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:43 smithi035 ceph-mon[92535]: pgmap v5864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:45 smithi035 ceph-mon[92535]: pgmap v5865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:47 smithi035 ceph-mon[92535]: pgmap v5866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:52:21.568 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:49 smithi035 ceph-mon[92535]: pgmap v5867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T11:52:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:52:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:52:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:52:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:52:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f854f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:52:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95f99be700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f82700 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f95e40126e0 tx=0x7f95e40129f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10cf91a713ba606 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:52:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95ddffb700 1 -- 172.21.15.35:0/2093651044 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4017070 con 0x5646e5f7ebe0 2023-03-17T11:52:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95ddffb700 1 -- 172.21.15.35:0/2093651044 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95e400f480 con 0x5646e5f7ebe0 2023-03-17T11:52:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646e5e8e390 con 0x5646e5f7ebe0 2023-03-17T11:52:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f95ddffb700 1 -- 172.21.15.35:0/2093651044 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95e400f640 con 0x5646e5f7ebe0 2023-03-17T11:52:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f96085b0b80 10 client.21687 fetch_fsmap learned FSMap version 110 2023-03-17T11:52:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.327+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5646e5cf9d80 con 0x5646e5f7ebe0 2023-03-17T11:52:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f95ddffb700 1 -- 172.21.15.35:0/2093651044 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5646e5e8e390 con 0x5646e5f7ebe0 2023-03-17T11:52:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f95ddffb700 1 -- 172.21.15.35:0/2093651044 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f95e4010700 con 0x5646e5f7ebe0 2023-03-17T11:52:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f96085b0b80 10 client.21687 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:52:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f96085b0b80 10 client.21687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:52:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f96085b0b80 20 client.21687 populate_metadata read hostname 'smithi035' 2023-03-17T11:52:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5f931d0 0x5646e5f955e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f96085b0b80 4 client.21687 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:52:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646e5e9a600 con 0x5646e5f931d0 2023-03-17T11:52:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5f931d0 0x5646e5f955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f95ddffb700 10 client.21687 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:52:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.328+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5f931d0 0x5646e5f955e0 crc :-1 s=READY pgs=781 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6794484551d9e56f server_cookie=3a9b64e5f58d9be6 in_seq=0 out_seq=0 2023-03-17T11:52:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f95ddffb700 1 -- 172.21.15.35:0/2093651044 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5646e5e9a600 con 0x5646e5f931d0 2023-03-17T11:52:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f95ddffb700 10 client.21687 handle_command_reply: tid=0 2023-03-17T11:52:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 client.21687 shutdown 2023-03-17T11:52:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 msgr2=0x5646e5f82700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f82700 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f95e40126e0 tx=0x7f95e40129f0 comp rx=0 tx=0).stop 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 shutdown_connections 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5f931d0 0x5646e5f955e0 crc :-1 s=READY pgs=781 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f82e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f854f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 --2- 172.21.15.35:0/2093651044 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f82700 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f95ddffb700 0 client.21687 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 >> 172.21.15.35:0/2093651044 conn(0x5646e5dd66b0 msgr2=0x5646e5f78410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 shutdown_connections 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.329+0000 7f96085b0b80 1 -- 172.21.15.35:0/2093651044 wait complete. 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.330+0000 7f96085b0b80 20 client.21687 trim_cache size 0 max 16384 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.344+0000 7f96085b0b80 1 Processor -- start 2023-03-17T11:52:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.344+0000 7f96085b0b80 1 -- start start 2023-03-17T11:52:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f73ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f85020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f96085b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f705c0 con 0x5646e5f7ebe0 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f96085b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f753d0 con 0x5646e5f79960 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f96085b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5e9a600 con 0x5646e5f7f4f0 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f89f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57572/0 (socket says 172.21.15.35:57572) 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 -- 172.21.15.35:0/235223480 learned_addr learned my addr 172.21.15.35:0/235223480 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f85020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f73ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 -- 172.21.15.35:0/235223480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 msgr2=0x5646e5f85020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f85020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 -- 172.21.15.35:0/235223480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 msgr2=0x5646e5f73ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f73ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 -- 172.21.15.35:0/235223480 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e5e92130 con 0x5646e5f7ebe0 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f85020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95f99be700 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f89f50 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f95e40058f0 tx=0x7f95e4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a18d907823f5827 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95e95af700 1 -- 172.21.15.35:0/235223480 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4017040 con 0x5646e5f7ebe0 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95e95af700 1 -- 172.21.15.35:0/235223480 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95e4010630 con 0x5646e5f7ebe0 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.345+0000 7f95e95af700 1 -- 172.21.15.35:0/235223480 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4025440 con 0x5646e5f7ebe0 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 -- 172.21.15.35:0/235223480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 msgr2=0x5646e5f89f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f89f50 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f95e40058f0 tx=0x7f95e4005780 comp rx=0 tx=0).stop 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 -- 172.21.15.35:0/235223480 shutdown_connections 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7f4f0 0x5646e5f85020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5f73ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 --2- 172.21.15.35:0/235223480 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7ebe0 0x5646e5f89f50 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 -- 172.21.15.35:0/235223480 >> 172.21.15.35:0/235223480 conn(0x5646e5dd66b0 msgr2=0x5646e5f78b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 -- 172.21.15.35:0/235223480 shutdown_connections 2023-03-17T11:52:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 -- 172.21.15.35:0/235223480 wait complete. 2023-03-17T11:52:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.346+0000 7f96085b0b80 1 -- start start 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 Processor -- start 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5fe0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7ebe0 0x5646e5fe08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 0x5646e5f87f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f884f0 con 0x5646e5f7f4f0 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f88660 con 0x5646e5f79960 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e5f88820 con 0x5646e5f7ebe0 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f96085b0b80 10 client.0 _ll_register_callbacks cb 0x5646e5d71230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 0x5646e5f87f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 0x5646e5f87f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57580/0 (socket says 172.21.15.35:57580) 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 -- 172.21.15.35:0/1845987736 learned_addr learned my addr 172.21.15.35:0/1845987736 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5fe0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95f99be700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7ebe0 0x5646e5fe08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 -- 172.21.15.35:0/1845987736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7ebe0 msgr2=0x5646e5fe08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7ebe0 0x5646e5fe08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 -- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 msgr2=0x5646e5fe0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5fe0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.347+0000 7f95fa9c0700 1 -- 172.21.15.35:0/1845987736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646e5cf9d80 con 0x5646e5f7f4f0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95fa9c0700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 0x5646e5f87f30 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0c75d0 tx=0x7f95ec003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b633b7e7221125db server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95ddffb700 1 -- 172.21.15.35:0/1845987736 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0ac040 con 0x5646e5f7f4f0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95ddffb700 1 -- 172.21.15.35:0/1845987736 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(404..404 src has 1..404) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95ec00de80 con 0x5646e5f7f4f0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646e5f491e0 con 0x5646e5f7f4f0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95ddffb700 1 -- 172.21.15.35:0/1845987736 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95ec0c72f0 con 0x5646e5f7f4f0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 10 client.21693 fetch_fsmap learned FSMap version 110 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5646e5d201f0 con 0x5646e5f7f4f0 2023-03-17T11:52:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95ddffb700 1 -- 172.21.15.35:0/1845987736 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5646e5f491e0 con 0x5646e5f7f4f0 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f95ddffb700 1 -- 172.21.15.35:0/1845987736 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f95ec0af050 con 0x5646e5f7f4f0 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 10 client.21693 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 10 client.21693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 20 client.21693 populate_metadata read hostname 'smithi035' 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5fe8150 0x5646e5fea560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 4 client.21693 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.348+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646e5d4ff00 con 0x5646e5fe8150 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.349+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5fe8150 0x5646e5fea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.349+0000 7f95ddffb700 10 client.21693 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:52:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.349+0000 7f95fa1bf700 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5fe8150 0x5646e5fea560 crc :-1 s=READY pgs=782 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc056a4d1f1d597 server_cookie=c2ed60c4d125debc in_seq=0 out_seq=0 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f95ddffb700 1 -- 172.21.15.35:0/1845987736 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646e5d4ff00 con 0x5646e5fe8150 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f95ddffb700 10 client.21693 handle_command_reply: tid=0 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 client.21693 shutdown 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 msgr2=0x5646e5f87f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 0x5646e5f87f30 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0c75d0 tx=0x7f95ec003cb0 comp rx=0 tx=0).stop 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 shutdown_connections 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5646e5fe8150 0x5646e5fea560 crc :-1 s=READY pgs=782 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5646e5f7f4f0 0x5646e5f87f30 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5646e5f79960 0x5646e5fe0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 --2- 172.21.15.35:0/1845987736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646e5f7ebe0 0x5646e5fe08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f95ddffb700 0 client.21693 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 >> 172.21.15.35:0/1845987736 conn(0x5646e5dd66b0 msgr2=0x5646e5f81fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 shutdown_connections 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 1 -- 172.21.15.35:0/1845987736 wait complete. 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.358+0000 7f96085b0b80 20 client.21693 trim_cache size 0 max 16384 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95e009f6c0 msgr2=0x7f95e00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95e009f6c0 0x7f95e00a1b70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f95f000b580 tx=0x7f95f0005c00 comp rx=0 tx=0).stop 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 msgr2=0x7f95f41a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 0x7f95f41a4450 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f95ec007ee0 tx=0x7f95ec00d3b0 comp rx=0 tx=0).stop 2023-03-17T11:52:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 shutdown_connections 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f95e009f6c0 0x7f95e00a1b70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f95f41043f0 0x7f95f41a4450 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95f40ff3b0 0x7f95f4100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 --2- 172.21.15.35:0/3904401053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f40ffd50 0x7f95f41012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 >> 172.21.15.35:0/3904401053 conn(0x7f95f4075f60 msgr2=0x7f95f4102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 shutdown_connections 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:28:54.359+0000 7f95fc423700 1 -- 172.21.15.35:0/3904401053 wait complete. 2023-03-17T11:52:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 -- 172.21.15.35:0/1281515333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f11380745d0 msgr2=0x7f1138072cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:32.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 --2- 172.21.15.35:0/1281515333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f11380745d0 0x7f1138072cb0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f112c009990 tx=0x7f112c009ca0 comp rx=0 tx=0).stop 2023-03-17T11:52:35.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 -- 172.21.15.35:0/1281515333 shutdown_connections 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 --2- 172.21.15.35:0/1281515333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f113810cde0 0x7f113810f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 --2- 172.21.15.35:0/1281515333 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f11380745d0 0x7f1138072cb0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 --2- 172.21.15.35:0/1281515333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1138074a30 0x7f11380731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 -- 172.21.15.35:0/1281515333 >> 172.21.15.35:0/1281515333 conn(0x7f11380774e0 msgr2=0x7f11380778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 -- 172.21.15.35:0/1281515333 shutdown_connections 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.438+0000 7f113ff49700 1 -- 172.21.15.35:0/1281515333 wait complete. 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 Processor -- start 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 -- start start 2023-03-17T11:52:35.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11380745d0 0x7f11381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 0x7f1138198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f113810cde0 0x7f113819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:35.099 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113819d3c0 con 0x7f1138074a30 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113819d530 con 0x7f113810cde0 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113ff49700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113819d6f0 con 0x7f11380745d0 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113d4e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 0x7f1138198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113d4e4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 0x7f1138198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57710/0 (socket says 172.21.15.35:57710) 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.439+0000 7f113d4e4700 1 -- 172.21.15.35:0/1193374629 learned_addr learned my addr 172.21.15.35:0/1193374629 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113dce5700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11380745d0 0x7f11381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113e4e6700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f113810cde0 0x7f113819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113d4e4700 1 -- 172.21.15.35:0/1193374629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11380745d0 msgr2=0x7f11381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11380745d0 0x7f11381983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113d4e4700 1 -- 172.21.15.35:0/1193374629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f113810cde0 msgr2=0x7f113819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f113810cde0 0x7f113819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113d4e4700 1 -- 172.21.15.35:0/1193374629 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0095f0 con 0x7f1138074a30 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113e4e6700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f113810cde0 0x7f113819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 0x7f1138198920 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f113400c9e0 tx=0x7f113400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f112affd700 1 -- 172.21.15.35:0/1193374629 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134007aa0 con 0x7f1138074a30 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f112affd700 1 -- 172.21.15.35:0/1193374629 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1134007c00 con 0x7f1138074a30 2023-03-17T11:52:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138112320 con 0x7f1138074a30 2023-03-17T11:52:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f112affd700 1 -- 172.21.15.35:0/1193374629 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134018660 con 0x7f1138074a30 2023-03-17T11:52:39.218 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-03-17T11:52:41.350 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-03-17T11:52:41.360 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T11:52:45.800 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:51 smithi035 ceph-mon[92535]: pgmap v5868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.440+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138112190 con 0x7f1138074a30 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.442+0000 7f112affd700 1 -- 172.21.15.35:0/1193374629 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f113400f450 con 0x7f1138074a30 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.443+0000 7f112affd700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f112409f640 0x7f11240a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.443+0000 7f112affd700 1 -- 172.21.15.35:0/1193374629 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(409..409 src has 1..409) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f11340ca680 con 0x7f1138074a30 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.443+0000 7f113dce5700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f112409f640 0x7f11240a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.443+0000 7f113dce5700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f112409f640 0x7f11240a1af0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f112c00b5c0 tx=0x7f112c005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 Processor -- start 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 -- start start 2023-03-17T11:52:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc3306cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc33067420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc32f6e010 con 0x55cc33067960 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc32fc0950 con 0x55cc3306d4f0 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.444+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc32fb9de0 con 0x55cc3306cbe0 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57720/0 (socket says 172.21.15.35:57720) 2023-03-17T11:52:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 -- 172.21.15.35:0/881221652 learned_addr learned my addr 172.21.15.35:0/881221652 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113dce5700 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc3306cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113d4e4700 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc33067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 -- 172.21.15.35:0/881221652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 msgr2=0x55cc3306cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc3306cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:47.240 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 -- 172.21.15.35:0/881221652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 msgr2=0x55cc33067420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc33067420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:48.646 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 -- 172.21.15.35:0/881221652 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc32e3b5d0 con 0x55cc33067960 2023-03-17T11:52:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f113e4e6700 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33067d90 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f1130009ca0 tx=0x7f1130007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f445c160518e14 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f1123fff700 1 -- 172.21.15.35:0/881221652 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130014600 con 0x55cc33067960 2023-03-17T11:52:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f1123fff700 1 -- 172.21.15.35:0/881221652 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1130007e40 con 0x55cc33067960 2023-03-17T11:52:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.445+0000 7f1123fff700 1 -- 172.21.15.35:0/881221652 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130013a50 con 0x55cc33067960 2023-03-17T11:52:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 -- 172.21.15.35:0/881221652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 msgr2=0x55cc33067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:50.785 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33067d90 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f1130009ca0 tx=0x7f1130007500 comp rx=0 tx=0).stop 2023-03-17T11:52:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 -- 172.21.15.35:0/881221652 shutdown_connections 2023-03-17T11:52:50.786 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33067d90 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc3306cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/881221652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc33067420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 -- 172.21.15.35:0/881221652 >> 172.21.15.35:0/881221652 conn(0x55cc32ec46b0 msgr2=0x55cc33061a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 -- 172.21.15.35:0/881221652 shutdown_connections 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 -- 172.21.15.35:0/881221652 wait complete. 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 -- start start 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.446+0000 7f114c0d6b80 1 Processor -- start 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc33067960 0x55cc330733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306cbe0 0x55cc33070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc32e3d8c0 con 0x55cc3306d4f0 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc330712e0 con 0x55cc3306cbe0 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc330714a0 con 0x55cc33067960 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f114c0d6b80 10 client.0 _ll_register_callbacks cb 0x55cc32e5f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57726/0 (socket says 172.21.15.35:57726) 2023-03-17T11:52:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 -- 172.21.15.35:0/3808538205 learned_addr learned my addr 172.21.15.35:0/3808538205 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113d4e4700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306cbe0 0x55cc33070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113dce5700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc33067960 0x55cc330733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 -- 172.21.15.35:0/3808538205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc33067960 msgr2=0x55cc330733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc33067960 0x55cc330733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 -- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306cbe0 msgr2=0x55cc33070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306cbe0 0x55cc33070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.447+0000 7f113e4e6700 1 -- 172.21.15.35:0/3808538205 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130009900 con 0x55cc3306d4f0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f113d4e4700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306cbe0 0x55cc33070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f113e4e6700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33070ba0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f1130000f80 tx=0x7f1130013900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf20cbf427dc357b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f11217fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f11217fa700 1 -- 172.21.15.35:0/3808538205 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130004ea0 con 0x55cc3306d4f0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f11217fa700 1 -- 172.21.15.35:0/3808538205 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(409..409 src has 1..409) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f1130007e40 con 0x55cc3306d4f0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc32f7c390 con 0x55cc3306d4f0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f11217fa700 1 -- 172.21.15.35:0/3808538205 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11300134b0 con 0x55cc3306d4f0 2023-03-17T11:52:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f114c0d6b80 10 client.21723 fetch_fsmap learned FSMap version 110 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55cc32de7d80 con 0x55cc3306d4f0 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f11217fa700 1 -- 172.21.15.35:0/3808538205 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cc32f7c390 con 0x55cc3306d4f0 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f11217fa700 1 -- 172.21.15.35:0/3808538205 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f113001d4c0 con 0x55cc3306d4f0 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.448+0000 7f114c0d6b80 10 client.21723 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f114c0d6b80 10 client.21723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f114c0d6b80 20 client.21723 populate_metadata read hostname 'smithi035' 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc33080fe0 0x55cc330833f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:54.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f114c0d6b80 4 client.21723 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:52:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc32f88600 con 0x55cc33080fe0 2023-03-17T11:52:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f113dce5700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc33080fe0 0x55cc330833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f11217fa700 10 client.21723 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:52:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.449+0000 7f113dce5700 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc33080fe0 0x55cc330833f0 crc :-1 s=READY pgs=786 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08ea30006a7e6e3 server_cookie=2d93a6e2bb14d705 in_seq=0 out_seq=0 2023-03-17T11:52:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f11217fa700 1 -- 172.21.15.35:0/3808538205 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55cc32f88600 con 0x55cc33080fe0 2023-03-17T11:52:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f11217fa700 10 client.21723 handle_command_reply: tid=0 2023-03-17T11:52:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 client.21723 shutdown 2023-03-17T11:52:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 msgr2=0x55cc33070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33070ba0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f1130000f80 tx=0x7f1130013900 comp rx=0 tx=0).stop 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 shutdown_connections 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc33080fe0 0x55cc330833f0 crc :-1 s=READY pgs=786 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33070ba0 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc33067960 0x55cc330733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/3808538205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306cbe0 0x55cc33070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f11217fa700 0 client.21723 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 >> 172.21.15.35:0/3808538205 conn(0x55cc32ec46b0 msgr2=0x55cc33061a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 shutdown_connections 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 1 -- 172.21.15.35:0/3808538205 wait complete. 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.450+0000 7f114c0d6b80 20 client.21723 trim_cache size 0 max 16384 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 Processor -- start 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 -- start start 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc33067960 0x55cc33067420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33077f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:52:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc32f7c390 con 0x55cc3306d4f0 2023-03-17T11:52:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3306d360 con 0x55cc33067960 2023-03-17T11:52:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.465+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc33062000 con 0x55cc3306cbe0 2023-03-17T11:52:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33077f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33077f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57734/0 (socket says 172.21.15.35:57734) 2023-03-17T11:52:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 -- 172.21.15.35:0/4134942963 learned_addr learned my addr 172.21.15.35:0/4134942963 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113d4e4700 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113dce5700 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc33067960 0x55cc33067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 -- 172.21.15.35:0/4134942963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 msgr2=0x55cc33061ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33061ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 -- 172.21.15.35:0/4134942963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc33067960 msgr2=0x55cc33067420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc33067960 0x55cc33067420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 -- 172.21.15.35:0/4134942963 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc33068000 con 0x55cc3306d4f0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f113e4e6700 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33077f70 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f1130009bf0 tx=0x7f1130007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520fcbefcdee1e26 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f1128ff9700 1 -- 172.21.15.35:0/4134942963 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130013a20 con 0x55cc3306d4f0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f1128ff9700 1 -- 172.21.15.35:0/4134942963 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f113001db40 con 0x55cc3306d4f0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.466+0000 7f1128ff9700 1 -- 172.21.15.35:0/4134942963 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113002eb70 con 0x55cc3306d4f0 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 -- 172.21.15.35:0/4134942963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 msgr2=0x55cc33077f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33077f70 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f1130009bf0 tx=0x7f1130007900 comp rx=0 tx=0).stop 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 -- 172.21.15.35:0/4134942963 shutdown_connections 2023-03-17T11:52:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc3306d4f0 0x55cc33077f70 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc33067960 0x55cc33067420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/4134942963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33061ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:52:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 -- 172.21.15.35:0/4134942963 >> 172.21.15.35:0/4134942963 conn(0x55cc32ec46b0 msgr2=0x55cc3306d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:52:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 -- 172.21.15.35:0/4134942963 shutdown_connections 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 -- 172.21.15.35:0/4134942963 wait complete. 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 -- start start 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.467+0000 7f114c0d6b80 1 Processor -- start 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33074490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc330749d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc330d3f10 con 0x55cc33067960 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc330d4050 con 0x55cc3306d4f0 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc330d4210 con 0x55cc3306cbe0 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f114c0d6b80 10 client.0 _ll_register_callbacks cb 0x55cc32e5f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:53:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33073f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57736/0 (socket says 172.21.15.35:57736) 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 -- 172.21.15.35:0/1082421555 learned_addr learned my addr 172.21.15.35:0/1082421555 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113e4e6700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc330749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 -- 172.21.15.35:0/1082421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 msgr2=0x55cc33074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 -- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 msgr2=0x55cc330749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc330749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113dce5700 1 -- 172.21.15.35:0/1082421555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc32de7d80 con 0x55cc33067960 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.468+0000 7f113e4e6700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc330749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f113dce5700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33073f50 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098e0 tx=0x7f112c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f20cfc829f35f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f11217fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f11217fa700 1 -- 172.21.15.35:0/1082421555 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c035ad0 con 0x55cc33067960 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f11217fa700 1 -- 172.21.15.35:0/1082421555 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(409..409 src has 1..409) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f112c035c30 con 0x55cc33067960 2023-03-17T11:53:00.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc330371e0 con 0x55cc33067960 2023-03-17T11:53:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f11217fa700 1 -- 172.21.15.35:0/1082421555 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f112c035df0 con 0x55cc33067960 2023-03-17T11:53:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 10 client.21729 fetch_fsmap learned FSMap version 110 2023-03-17T11:53:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55cc32dd0c00 con 0x55cc33067960 2023-03-17T11:53:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f11217fa700 1 -- 172.21.15.35:0/1082421555 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f112c04a080 con 0x55cc33067960 2023-03-17T11:53:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f11217fa700 1 -- 172.21.15.35:0/1082421555 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f112c004870 con 0x55cc33067960 2023-03-17T11:53:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 10 client.21729 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:53:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 10 client.21729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:53:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 20 client.21729 populate_metadata read hostname 'smithi035' 2023-03-17T11:53:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc330d58f0 0x55cc330d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 4 client.21729 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:53:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.469+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc32e3df00 con 0x55cc330d58f0 2023-03-17T11:53:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.470+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc330d58f0 0x55cc330d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:05.151 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:53 smithi035 ceph-mon[92535]: pgmap v5869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.470+0000 7f113d4e4700 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc330d58f0 0x55cc330d7d00 crc :-1 s=READY pgs=787 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914c050ae69076c3 server_cookie=9559f4a1b4320192 in_seq=0 out_seq=0 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.470+0000 7f11217fa700 10 client.21729 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f11217fa700 1 -- 172.21.15.35:0/1082421555 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc32e3df00 con 0x55cc330d58f0 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f11217fa700 10 client.21729 handle_command_reply: tid=0 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 client.21729 shutdown 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 msgr2=0x55cc33073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33073f50 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098e0 tx=0x7f112c009ca0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 shutdown_connections 2023-03-17T11:53:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cc330d58f0 0x55cc330d7d00 crc :-1 s=READY pgs=787 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc3306d4f0 0x55cc330749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f11217fa700 0 client.21729 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cc33067960 0x55cc33073f50 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 --2- 172.21.15.35:0/1082421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc3306cbe0 0x55cc33074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 >> 172.21.15.35:0/1082421555 conn(0x55cc32ec46b0 msgr2=0x55cc3306e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 shutdown_connections 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 1 -- 172.21.15.35:0/1082421555 wait complete. 2023-03-17T11:53:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f114c0d6b80 20 client.21729 trim_cache size 0 max 16384 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f112409f640 msgr2=0x7f11240a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f112409f640 0x7f11240a1af0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f112c00b5c0 tx=0x7f112c005fb0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 msgr2=0x7f1138198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 0x7f1138198920 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f113400c9e0 tx=0x7f113400ccf0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 shutdown_connections 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f112409f640 0x7f11240a1af0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f113810cde0 0x7f113819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11380745d0 0x7f11381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 --2- 172.21.15.35:0/1193374629 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1138074a30 0x7f1138198920 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 >> 172.21.15.35:0/1193374629 conn(0x7f11380774e0 msgr2=0x7f1138104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 shutdown_connections 2023-03-17T11:53:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:11.492+0000 7f113ff49700 1 -- 172.21.15.35:0/1193374629 wait complete. 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 -- 172.21.15.35:0/1776031421 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc10cb60 msgr2=0x7f99cc10ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/1776031421 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc10cb60 0x7f99cc10ef40 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f99c400b0a0 tx=0x7f99c400b3b0 comp rx=0 tx=0).stop 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 -- 172.21.15.35:0/1776031421 shutdown_connections 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/1776031421 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc10cb60 0x7f99cc10ef40 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/1776031421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99cc0fefb0 0x7f99cc0ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/1776031421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 0x7f99cc10c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 -- 172.21.15.35:0/1776031421 >> 172.21.15.35:0/1776031421 conn(0x7f99cc076330 msgr2=0x7f99cc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 -- 172.21.15.35:0/1776031421 shutdown_connections 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.614+0000 7f99d2a8b700 1 -- 172.21.15.35:0/1776031421 wait complete. 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 Processor -- start 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 -- start start 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 0x7f99cc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 0x7f99cc198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99cc10cb60 0x7f99cc19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc19d5b0 con 0x7f99cc0fefb0 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc19d720 con 0x7f99cc10cb60 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d2a8b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc19d8e0 con 0x7f99cc0ff8c0 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d0827700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 0x7f99cc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d0827700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 0x7f99cc1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57750/0 (socket says 172.21.15.35:57750) 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d0827700 1 -- 172.21.15.35:0/247749347 learned_addr learned my addr 172.21.15.35:0/247749347 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99d1028700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99cc10cb60 0x7f99cc19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.615+0000 7f99cbfff700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 0x7f99cc198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d0827700 1 -- 172.21.15.35:0/247749347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 msgr2=0x7f99cc198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d0827700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 0x7f99cc198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d0827700 1 -- 172.21.15.35:0/247749347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99cc10cb60 msgr2=0x7f99cc19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d0827700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99cc10cb60 0x7f99cc19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d0827700 1 -- 172.21.15.35:0/247749347 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009d00 con 0x7f99cc0fefb0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99cbfff700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 0x7f99cc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d0827700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 0x7f99cc1985d0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f99c000d950 tx=0x7f99c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99c9ffb700 1 -- 172.21.15.35:0/247749347 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0009940 con 0x7f99cc0fefb0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc112270 con 0x7f99cc0fefb0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99c9ffb700 1 -- 172.21.15.35:0/247749347 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c0010460 con 0x7f99cc0fefb0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99c9ffb700 1 -- 172.21.15.35:0/247749347 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000f620 con 0x7f99cc0fefb0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.616+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc1120e0 con 0x7f99cc0fefb0 2023-03-17T11:53:10.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.618+0000 7f99c9ffb700 1 -- 172.21.15.35:0/247749347 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f99c00105d0 con 0x7f99cc0fefb0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.619+0000 7f99c9ffb700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f99bc09f640 0x7f99bc0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.619+0000 7f99cbfff700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f99bc09f640 0x7f99bc0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.619+0000 7f99c9ffb700 1 -- 172.21.15.35:0/247749347 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99c00ca470 con 0x7f99cc0fefb0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.620+0000 7f99cbfff700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f99bc09f640 0x7f99bc0a1af0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f99cc199be0 tx=0x7f99b8009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.620+0000 7f99dec18b80 1 Processor -- start 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.620+0000 7f99dec18b80 1 -- start start 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1166b4f0 0x560d11665420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11665960 0x560d11665d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99dec18b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1156c010 con 0x560d1166abe0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99dec18b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d115be950 con 0x560d1166b4f0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99dec18b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d115b7de0 con 0x560d11665960 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57758/0 (socket says 172.21.15.35:57758) 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 -- 172.21.15.35:0/580742319 learned_addr learned my addr 172.21.15.35:0/580742319 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d1028700 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11665960 0x560d11665d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:10.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99cbfff700 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1166b4f0 0x560d11665420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 -- 172.21.15.35:0/580742319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11665960 msgr2=0x560d11665d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11665960 0x560d11665d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 -- 172.21.15.35:0/580742319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1166b4f0 msgr2=0x560d11665420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1166b4f0 0x560d11665420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 -- 172.21.15.35:0/580742319 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d114395d0 con 0x560d1166abe0 2023-03-17T11:53:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d1028700 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11665960 0x560d11665d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:53:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.621+0000 7f99d0827700 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166afb0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f99c0094420 tx=0x7f99c0097900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289cbcedf1fd13c1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99b6ffd700 1 -- 172.21.15.35:0/580742319 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00962c0 con 0x560d1166abe0 2023-03-17T11:53:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99b6ffd700 1 -- 172.21.15.35:0/580742319 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c0098180 con 0x560d1166abe0 2023-03-17T11:53:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99b6ffd700 1 -- 172.21.15.35:0/580742319 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c009fc80 con 0x560d1166abe0 2023-03-17T11:53:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 -- 172.21.15.35:0/580742319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 msgr2=0x560d1166afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166afb0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f99c0094420 tx=0x7f99c0097900 comp rx=0 tx=0).stop 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 -- 172.21.15.35:0/580742319 shutdown_connections 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d11665960 0x560d11665d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166afb0 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 --2- 172.21.15.35:0/580742319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d1166b4f0 0x560d11665420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 -- 172.21.15.35:0/580742319 >> 172.21.15.35:0/580742319 conn(0x560d114c26b0 msgr2=0x560d1165fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 -- 172.21.15.35:0/580742319 shutdown_connections 2023-03-17T11:53:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.622+0000 7f99dec18b80 1 -- 172.21.15.35:0/580742319 wait complete. 2023-03-17T11:53:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.623+0000 7f99dec18b80 1 -- start start 2023-03-17T11:53:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.623+0000 7f99dec18b80 1 Processor -- start 2023-03-17T11:53:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d116714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1143b8c0 con 0x560d1166abe0 2023-03-17T11:53:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1166f5f0 con 0x560d11665960 2023-03-17T11:53:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1167b060 con 0x560d1166b4f0 2023-03-17T11:53:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 10 client.0 _ll_register_callbacks cb 0x560d1145d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:53:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57766/0 (socket says 172.21.15.35:57766) 2023-03-17T11:53:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 -- 172.21.15.35:0/3326613500 learned_addr learned my addr 172.21.15.35:0/3326613500 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99d1028700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:18.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99d0827700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d116714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 -- 172.21.15.35:0/3326613500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 msgr2=0x560d1166ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 -- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 msgr2=0x560d116714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d116714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 -- 172.21.15.35:0/3326613500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc1120e0 con 0x560d1166abe0 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99d0827700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d116714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99cbfff700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166e740 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f99b8011920 tx=0x7f99b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896bcd02e314245f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99abfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99abfff700 1 -- 172.21.15.35:0/3326613500 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b801ea50 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99abfff700 1 -- 172.21.15.35:0/3326613500 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99b8017070 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.624+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d1157a390 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99abfff700 1 -- 172.21.15.35:0/3326613500 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b8011e50 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 10 client.21741 fetch_fsmap learned FSMap version 110 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x560d113e5d80 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99abfff700 1 -- 172.21.15.35:0/3326613500 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d1157a390 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99abfff700 1 -- 172.21.15.35:0/3326613500 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f99b8028b90 con 0x560d1166abe0 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 10 client.21741 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 10 client.21741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 20 client.21741 populate_metadata read hostname 'smithi035' 2023-03-17T11:53:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d1167f1f0 0x560d11681600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 4 client.21741 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:53:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d11586600 con 0x560d1167f1f0 2023-03-17T11:53:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.625+0000 7f99d0827700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d1167f1f0 0x560d11681600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.626+0000 7f99abfff700 10 client.21741 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.626+0000 7f99d0827700 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d1167f1f0 0x560d11681600 crc :-1 s=READY pgs=788 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89558f337b0517cd server_cookie=ecc7da09365b669d in_seq=0 out_seq=0 2023-03-17T11:53:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.626+0000 7f99abfff700 1 -- 172.21.15.35:0/3326613500 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560d11586600 con 0x560d1167f1f0 2023-03-17T11:53:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.626+0000 7f99abfff700 10 client.21741 handle_command_reply: tid=0 2023-03-17T11:53:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.626+0000 7f99dec18b80 1 client.21741 shutdown 2023-03-17T11:53:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 msgr2=0x560d1166e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166e740 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f99b8011920 tx=0x7f99b80047c0 comp rx=0 tx=0).stop 2023-03-17T11:53:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 shutdown_connections 2023-03-17T11:53:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d1167f1f0 0x560d11681600 crc :-1 s=READY pgs=788 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d116714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3326613500 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d1166e740 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99abfff700 0 client.21741 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 >> 172.21.15.35:0/3326613500 conn(0x560d114c26b0 msgr2=0x560d11664410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 shutdown_connections 2023-03-17T11:53:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 1 -- 172.21.15.35:0/3326613500 wait complete. 2023-03-17T11:53:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.627+0000 7f99dec18b80 20 client.21741 trim_cache size 0 max 16384 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 Processor -- start 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 -- start start 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d11671060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1157a390 con 0x560d1166abe0 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1157b050 con 0x560d11665960 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.642+0000 7f99dec18b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1165b0f0 con 0x560d1166b4f0 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d11671060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d11671060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57774/0 (socket says 172.21.15.35:57774) 2023-03-17T11:53:24.480 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:55 smithi035 ceph-mon[92535]: pgmap v5870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:53:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 -- 172.21.15.35:0/2569700228 learned_addr learned my addr 172.21.15.35:0/2569700228 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99d1028700 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99d0827700 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 -- 172.21.15.35:0/2569700228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 msgr2=0x560d1166df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 -- 172.21.15.35:0/2569700228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 msgr2=0x560d11675f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 -- 172.21.15.35:0/2569700228 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d11666000 con 0x560d1166abe0 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99cbfff700 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d11671060 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f99b8032fd0 tx=0x7f99b8009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0da6d92e559fe7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99b77fe700 1 -- 172.21.15.35:0/2569700228 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b801fa60 con 0x560d1166abe0 2023-03-17T11:53:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99b77fe700 1 -- 172.21.15.35:0/2569700228 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99b8023070 con 0x560d1166abe0 2023-03-17T11:53:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.643+0000 7f99b77fe700 1 -- 172.21.15.35:0/2569700228 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b801ed90 con 0x560d1166abe0 2023-03-17T11:53:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 -- 172.21.15.35:0/2569700228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 msgr2=0x560d11671060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d11671060 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f99b8032fd0 tx=0x7f99b8009350 comp rx=0 tx=0).stop 2023-03-17T11:53:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 -- 172.21.15.35:0/2569700228 shutdown_connections 2023-03-17T11:53:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166b4f0 0x560d1166df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 --2- 172.21.15.35:0/2569700228 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166abe0 0x560d11671060 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 -- 172.21.15.35:0/2569700228 >> 172.21.15.35:0/2569700228 conn(0x560d114c26b0 msgr2=0x560d1167b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 -- 172.21.15.35:0/2569700228 shutdown_connections 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 -- 172.21.15.35:0/2569700228 wait complete. 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 -- start start 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.644+0000 7f99dec18b80 1 Processor -- start 2023-03-17T11:53:28.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166abe0 0x560d11673fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 0x560d11674500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11676590 con 0x560d1166b4f0 2023-03-17T11:53:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11674a40 con 0x560d11665960 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d11674bb0 con 0x560d1166abe0 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99dec18b80 10 client.0 _ll_register_callbacks cb 0x560d1145d230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 0x560d11674500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 0x560d11674500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57782/0 (socket says 172.21.15.35:57782) 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 -- 172.21.15.35:0/3554786553 learned_addr learned my addr 172.21.15.35:0/3554786553 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99cbfff700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166abe0 0x560d11673fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d0827700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 -- 172.21.15.35:0/3554786553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166abe0 msgr2=0x560d11673fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166abe0 0x560d11673fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 -- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 msgr2=0x560d11675c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 -- 172.21.15.35:0/3554786553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d113e5d80 con 0x560d1166b4f0 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d0827700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99d1028700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 0x560d11674500 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f99cc101190 tx=0x7f99c400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b39a3265d57fa1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.645+0000 7f99abfff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:53:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99abfff700 1 -- 172.21.15.35:0/3554786553 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400e040 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d116351e0 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99abfff700 1 -- 172.21.15.35:0/3554786553 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99c4003a00 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99abfff700 1 -- 172.21.15.35:0/3554786553 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c40078f0 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99dec18b80 10 client.21747 fetch_fsmap learned FSMap version 110 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x560d113cec00 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.646+0000 7f99abfff700 1 -- 172.21.15.35:0/3554786553 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d116351e0 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99abfff700 1 -- 172.21.15.35:0/3554786553 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f99c400b0d0 con 0x560d1166b4f0 2023-03-17T11:53:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99dec18b80 10 client.21747 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99dec18b80 10 client.21747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99dec18b80 20 client.21747 populate_metadata read hostname 'smithi035' 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d116d4340 0x560d116d6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99dec18b80 4 client.21747 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d1143bf00 con 0x560d116d4340 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99d0827700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d116d4340 0x560d116d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99abfff700 10 client.21747 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.647+0000 7f99d0827700 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d116d4340 0x560d116d6750 crc :-1 s=READY pgs=789 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85b418efcf0f139 server_cookie=6f49bca9e6dd418a in_seq=0 out_seq=0 2023-03-17T11:53:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99abfff700 1 -- 172.21.15.35:0/3554786553 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d1143bf00 con 0x560d116d4340 2023-03-17T11:53:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99abfff700 10 client.21747 handle_command_reply: tid=0 2023-03-17T11:53:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 client.21747 shutdown 2023-03-17T11:53:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 msgr2=0x560d11674500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 0x560d11674500 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f99cc101190 tx=0x7f99c400bce0 comp rx=0 tx=0).stop 2023-03-17T11:53:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 shutdown_connections 2023-03-17T11:53:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d116d4340 0x560d116d6750 crc :-1 s=READY pgs=789 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d1166b4f0 0x560d11674500 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99abfff700 0 client.21747 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d11665960 0x560d11675c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.660+0000 7f99dec18b80 1 --2- 172.21.15.35:0/3554786553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d1166abe0 0x560d11673fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 >> 172.21.15.35:0/3554786553 conn(0x560d114c26b0 msgr2=0x560d116686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 shutdown_connections 2023-03-17T11:53:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99dec18b80 1 -- 172.21.15.35:0/3554786553 wait complete. 2023-03-17T11:53:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99dec18b80 20 client.21747 trim_cache size 0 max 16384 2023-03-17T11:53:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f99bc09f640 msgr2=0x7f99bc0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f99bc09f640 0x7f99bc0a1af0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f99cc199be0 tx=0x7f99b8009260 comp rx=0 tx=0).stop 2023-03-17T11:53:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 msgr2=0x7f99cc1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 0x7f99cc1985d0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f99c000d950 tx=0x7f99c000dc60 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 shutdown_connections 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f99bc09f640 0x7f99bc0a1af0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99cc10cb60 0x7f99cc19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99cc0fefb0 0x7f99cc1985d0 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 --2- 172.21.15.35:0/247749347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99cc0ff8c0 0x7f99cc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 >> 172.21.15.35:0/247749347 conn(0x7f99cc076330 msgr2=0x7f99cc0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 shutdown_connections 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:24.661+0000 7f99d2a8b700 1 -- 172.21.15.35:0/247749347 wait complete. 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.784+0000 7ff675efb700 1 -- 172.21.15.35:0/770176798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff670100420 msgr2=0x7ff670103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.784+0000 7ff675efb700 1 --2- 172.21.15.35:0/770176798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff670100420 0x7ff670103ec0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7ff6600099c0 tx=0x7ff660009cd0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 -- 172.21.15.35:0/770176798 shutdown_connections 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 --2- 172.21.15.35:0/770176798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6701045a0 0x7ff67010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 --2- 172.21.15.35:0/770176798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6700ffa80 0x7ff6700ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 --2- 172.21.15.35:0/770176798 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff670100420 0x7ff670103ec0 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 -- 172.21.15.35:0/770176798 >> 172.21.15.35:0/770176798 conn(0x7ff6700757a0 msgr2=0x7ff670075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 -- 172.21.15.35:0/770176798 shutdown_connections 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 -- 172.21.15.35:0/770176798 wait complete. 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.785+0000 7ff675efb700 1 Processor -- start 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 -- start start 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 0x7ff670100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff670100420 0x7ff6701014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6701045a0 0x7ff6701a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670101cd0 con 0x7ff6700ffa80 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701a4b20 con 0x7ff6701045a0 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff675efb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701a4c60 con 0x7ff670100420 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 0x7ff670100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 0x7ff670100f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57792/0 (socket says 172.21.15.35:57792) 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 -- 172.21.15.35:0/136228237 learned_addr learned my addr 172.21.15.35:0/136228237 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66effd700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff670100420 0x7ff6701014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66ffff700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6701045a0 0x7ff6701a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 -- 172.21.15.35:0/136228237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff670100420 msgr2=0x7ff6701014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff670100420 0x7ff6701014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 -- 172.21.15.35:0/136228237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6701045a0 msgr2=0x7ff6701a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6701045a0 0x7ff6701a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 -- 172.21.15.35:0/136228237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600095f0 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66effd700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff670100420 0x7ff6701014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.786+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 0x7ff670100f60 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c9b0 tx=0x7ff65800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.787+0000 7ff66cff9700 1 -- 172.21.15.35:0/136228237 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658007b00 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.787+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67010f220 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.787+0000 7ff66cff9700 1 -- 172.21.15.35:0/136228237 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff658007c60 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.787+0000 7ff66cff9700 1 -- 172.21.15.35:0/136228237 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658018660 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.787+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67010f090 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.789+0000 7ff66cff9700 1 -- 172.21.15.35:0/136228237 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ff65800f450 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.790+0000 7ff66cff9700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff65c09f640 0x7ff65c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.790+0000 7ff66cff9700 1 -- 172.21.15.35:0/136228237 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff6580ca710 con 0x7ff6700ffa80 2023-03-17T11:53:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.790+0000 7ff66effd700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff65c09f640 0x7ff65c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.790+0000 7ff66effd700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff65c09f640 0x7ff65c0a1af0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff66000b580 tx=0x7ff660005fd0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.790+0000 7ff682088b80 1 Processor -- start 2023-03-17T11:53:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 -- start start 2023-03-17T11:53:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3cbe0 0x56250ff3cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3d4f0 0x56250ff37420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff37d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250fe3e010 con 0x56250ff37960 2023-03-17T11:53:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250fe90950 con 0x56250ff3d4f0 2023-03-17T11:53:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff682088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250fe89de0 con 0x56250ff3cbe0 2023-03-17T11:53:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff37d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff37d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57804/0 (socket says 172.21.15.35:57804) 2023-03-17T11:53:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 -- 172.21.15.35:0/350405767 learned_addr learned my addr 172.21.15.35:0/350405767 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66effd700 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3d4f0 0x56250ff37420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3cbe0 0x56250ff3cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 -- 172.21.15.35:0/350405767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3cbe0 msgr2=0x56250ff3cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3cbe0 0x56250ff3cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 -- 172.21.15.35:0/350405767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3d4f0 msgr2=0x56250ff37420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3d4f0 0x56250ff37420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.791+0000 7ff66ffff700 1 -- 172.21.15.35:0/350405767 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56250fd0b5d0 con 0x56250ff37960 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.792+0000 7ff66ffff700 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff37d90 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7ff668009cf0 tx=0x7ff668007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a428b24447159a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.792+0000 7ff665ffb700 1 -- 172.21.15.35:0/350405767 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668018070 con 0x56250ff37960 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.792+0000 7ff665ffb700 1 -- 172.21.15.35:0/350405767 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff66800f050 con 0x56250ff37960 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.792+0000 7ff665ffb700 1 -- 172.21.15.35:0/350405767 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668005910 con 0x56250ff37960 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.792+0000 7ff682088b80 1 -- 172.21.15.35:0/350405767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 msgr2=0x56250ff37d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:37.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.792+0000 7ff682088b80 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff37d90 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7ff668009cf0 tx=0x7ff668007500 comp rx=0 tx=0).stop 2023-03-17T11:53:37.527 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 -- 172.21.15.35:0/350405767 shutdown_connections 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff37d90 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3cbe0 0x56250ff3cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 --2- 172.21.15.35:0/350405767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3d4f0 0x56250ff37420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 -- 172.21.15.35:0/350405767 >> 172.21.15.35:0/350405767 conn(0x56250fd946b0 msgr2=0x56250ff31a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 -- 172.21.15.35:0/350405767 shutdown_connections 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 -- 172.21.15.35:0/350405767 wait complete. 2023-03-17T11:53:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 -- start start 2023-03-17T11:53:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.793+0000 7ff682088b80 1 Processor -- start 2023-03-17T11:53:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff43330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:39.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:57 smithi035 ceph-mon[92535]: pgmap v5871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:53:39.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:59 smithi035 ceph-mon[92535]: pgmap v5872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:53:39.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:43:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:53:39.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:01 smithi035 ceph-mon[92535]: pgmap v5873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:39.385 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:53:39.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:53:39.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:53:39.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:53:41.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: pgmap v5874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:53:41.281 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: pgmap v5875: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T11:53:42.342 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:05 smithi035 ceph-mon[92535]: pgmap v5876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:07 smithi035 ceph-mon[92535]: pgmap v5877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:09 smithi035 ceph-mon[92535]: pgmap v5878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:09 smithi035 ceph-mon[92535]: osdmap e435: 12 total, 12 up, 12 in 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:11 smithi035 ceph-mon[92535]: pgmap v5880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:13 smithi035 ceph-mon[92535]: pgmap v5881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:15 smithi035 ceph-mon[92535]: pgmap v5882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:53:42.343 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:17 smithi035 ceph-mon[92535]: pgmap v5883: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:17 smithi035 ceph-mon[92535]: osdmap e436: 12 total, 12 up, 12 in 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:19 smithi035 ceph-mon[92535]: pgmap v5885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:21 smithi035 ceph-mon[92535]: pgmap v5886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:23 smithi035 ceph-mon[92535]: pgmap v5887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:25 smithi035 ceph-mon[92535]: pgmap v5888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:27 smithi035 ceph-mon[92535]: pgmap v5889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:29 smithi035 ceph-mon[92535]: pgmap v5890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:31 smithi035 ceph-mon[92535]: pgmap v5891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:42.344 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:33 smithi035 ceph-mon[92535]: pgmap v5892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:35 smithi035 ceph-mon[92535]: pgmap v5893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:37 smithi035 ceph-mon[92535]: pgmap v5894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:39 smithi035 ceph-mon[92535]: pgmap v5895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:41 smithi035 ceph-mon[92535]: pgmap v5896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:43 smithi035 ceph-mon[92535]: pgmap v5897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:45 smithi035 ceph-mon[92535]: pgmap v5898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:47 smithi035 ceph-mon[92535]: pgmap v5899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:42.345 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:49 smithi035 ceph-mon[92535]: pgmap v5900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:53:42.346 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:51 smithi035 ceph-mon[92535]: pgmap v5901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:53 smithi035 ceph-mon[92535]: pgmap v5902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:55 smithi035 ceph-mon[92535]: pgmap v5903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:57 smithi035 ceph-mon[92535]: pgmap v5904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:44:59 smithi035 ceph-mon[92535]: pgmap v5905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:01 smithi035 ceph-mon[92535]: pgmap v5906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:03 smithi035 ceph-mon[92535]: pgmap v5907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:04 smithi035 ceph-mon[92535]: pgmap v5908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T11:53:44.370 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:04 smithi035 ceph-mon[92535]: pgmap v5909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:53:44.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:06 smithi035 ceph-mon[92535]: pgmap v5910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:53:44.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:08 smithi035 ceph-mon[92535]: pgmap v5911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:53:44.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:09 smithi035 ceph-mon[92535]: osdmap e437: 12 total, 12 up, 12 in 2023-03-17T11:53:44.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:10 smithi035 ceph-mon[92535]: pgmap v5913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T11:53:44.371 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:12 smithi035 ceph-mon[92535]: pgmap v5914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T11:53:44.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:53:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:53:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:53:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:53:48.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff40620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff40b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250fd0d8c0 con 0x56250ff37960 2023-03-17T11:53:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff412a0 con 0x56250ff3cbe0 2023-03-17T11:53:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff41460 con 0x56250ff3d4f0 2023-03-17T11:53:48.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 10 client.0 _ll_register_callbacks cb 0x56250fd2f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:53:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff43330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff43330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57806/0 (socket says 172.21.15.35:57806) 2023-03-17T11:53:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 -- 172.21.15.35:0/1969198530 learned_addr learned my addr 172.21.15.35:0/1969198530 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66ffff700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff40b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66effd700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff40620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:50.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 -- 172.21.15.35:0/1969198530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 msgr2=0x56250ff40b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:50.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff40b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:50.772 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 -- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 msgr2=0x56250ff40620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff40620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:51.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 -- 172.21.15.35:0/1969198530 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff668009920 con 0x56250ff37960 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff43330 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7ff65800afd0 tx=0x7ff658097ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f959ae1efbc2b0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff64effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff64effd700 1 -- 172.21.15.35:0/1969198530 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580a0350 con 0x56250ff37960 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff64effd700 1 -- 172.21.15.35:0/1969198530 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff65800f700 con 0x56250ff37960 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.794+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56250fe4c390 con 0x56250ff37960 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff64effd700 1 -- 172.21.15.35:0/1969198530 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff65800f8c0 con 0x56250ff37960 2023-03-17T11:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 10 client.21759 fetch_fsmap learned FSMap version 110 2023-03-17T11:53:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56250fcb7d80 con 0x56250ff37960 2023-03-17T11:53:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff64effd700 1 -- 172.21.15.35:0/1969198530 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56250fe4c390 con 0x56250ff37960 2023-03-17T11:53:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff64effd700 1 -- 172.21.15.35:0/1969198530 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff658097670 con 0x56250ff37960 2023-03-17T11:53:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 10 client.21759 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:53:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 10 client.21759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:53:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 20 client.21759 populate_metadata read hostname 'smithi035' 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ff50fe0 0x56250ff533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 4 client.21759 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56250fe58600 con 0x56250ff50fe0 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.795+0000 7ff66effd700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ff50fe0 0x56250ff533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.796+0000 7ff64effd700 10 client.21759 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.796+0000 7ff66effd700 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ff50fe0 0x56250ff533f0 crc :-1 s=READY pgs=790 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1d64ba210d5a89 server_cookie=3ab536dbb376b91 in_seq=0 out_seq=0 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.796+0000 7ff64effd700 1 -- 172.21.15.35:0/1969198530 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56250fe58600 con 0x56250ff50fe0 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.796+0000 7ff64effd700 10 client.21759 handle_command_reply: tid=0 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.796+0000 7ff682088b80 1 client.21759 shutdown 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 msgr2=0x56250ff43330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff43330 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7ff65800afd0 tx=0x7ff658097ac0 comp rx=0 tx=0).stop 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 shutdown_connections 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ff50fe0 0x56250ff533f0 crc :-1 s=READY pgs=790 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff40b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff64effd700 0 client.21759 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff43330 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 --2- 172.21.15.35:0/1969198530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff40620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 >> 172.21.15.35:0/1969198530 conn(0x56250fd946b0 msgr2=0x56250ff31a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 shutdown_connections 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 1 -- 172.21.15.35:0/1969198530 wait complete. 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.797+0000 7ff682088b80 20 client.21759 trim_cache size 0 max 16384 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 Processor -- start 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 -- start start 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff37960 0x56250ff31ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 0x56250ff3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff42ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff32000 con 0x56250ff3cbe0 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff32e10 con 0x56250ff37960 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff682088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff3d370 con 0x56250ff3d4f0 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff66effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 0x56250ff3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff66effd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 0x56250ff3e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57816/0 (socket says 172.21.15.35:57816) 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.812+0000 7ff66effd700 1 -- 172.21.15.35:0/3086789881 learned_addr learned my addr 172.21.15.35:0/3086789881 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66ffff700 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff42ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff37960 0x56250ff31ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66effd700 1 -- 172.21.15.35:0/3086789881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 msgr2=0x56250ff42ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66effd700 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff42ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66effd700 1 -- 172.21.15.35:0/3086789881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff37960 msgr2=0x56250ff31ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:54.804 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66effd700 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff37960 0x56250ff31ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66effd700 1 -- 172.21.15.35:0/3086789881 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56250fe50130 con 0x56250ff3cbe0 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff37960 0x56250ff31ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff66effd700 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 0x56250ff3e0a0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7ff6600099c0 tx=0x7ff66001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5230610e83a7d498 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff6667fc700 1 -- 172.21.15.35:0/3086789881 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66002b040 con 0x56250ff3cbe0 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff6667fc700 1 -- 172.21.15.35:0/3086789881 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff66002c040 con 0x56250ff3cbe0 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.813+0000 7ff6667fc700 1 -- 172.21.15.35:0/3086789881 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660004e20 con 0x56250ff3cbe0 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 -- 172.21.15.35:0/3086789881 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 msgr2=0x56250ff3e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 0x56250ff3e0a0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7ff6600099c0 tx=0x7ff66001f000 comp rx=0 tx=0).stop 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 -- 172.21.15.35:0/3086789881 shutdown_connections 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff42ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff37960 0x56250ff31ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 --2- 172.21.15.35:0/3086789881 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff3cbe0 0x56250ff3e0a0 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 -- 172.21.15.35:0/3086789881 >> 172.21.15.35:0/3086789881 conn(0x56250fd946b0 msgr2=0x56250ff3d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 -- 172.21.15.35:0/3086789881 shutdown_connections 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 -- 172.21.15.35:0/3086789881 wait complete. 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 -- start start 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.814+0000 7ff682088b80 1 Processor -- start 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff48020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff46900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff46fd0 con 0x56250ff37960 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ff47140 con 0x56250ff3cbe0 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250ffa4e90 con 0x56250ff3d4f0 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 10 client.0 _ll_register_callbacks cb 0x56250fd2f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff48020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff48020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57820/0 (socket says 172.21.15.35:57820) 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 -- 172.21.15.35:0/675506675 learned_addr learned my addr 172.21.15.35:0/675506675 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66ffff700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff46900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 -- 172.21.15.35:0/675506675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 msgr2=0x56250ff46900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66effd700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff46900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 -- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 msgr2=0x56250ff463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:53:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 -- 172.21.15.35:0/675506675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67010c9b0 con 0x56250ff37960 2023-03-17T11:53:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66ffff700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff46900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:53:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66effd700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:53:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff66f7fe700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff48020 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7ff658097e60 tx=0x7ff6580982e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bfe6fedcb05c65 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:53:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff64effd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:53:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff64effd700 1 -- 172.21.15.35:0/675506675 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800f900 con 0x56250ff37960 2023-03-17T11:53:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff64effd700 1 -- 172.21.15.35:0/675506675 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7ff6580a0130 con 0x56250ff37960 2023-03-17T11:53:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56250ff071e0 con 0x56250ff37960 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff64effd700 1 -- 172.21.15.35:0/675506675 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6580a0350 con 0x56250ff37960 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 10 client.21765 fetch_fsmap learned FSMap version 110 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.815+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56250fcde1f0 con 0x56250ff37960 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff64effd700 1 -- 172.21.15.35:0/675506675 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56250ff071e0 con 0x56250ff37960 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff64effd700 1 -- 172.21.15.35:0/675506675 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ff6580ca2b0 con 0x56250ff37960 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff682088b80 10 client.21765 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff682088b80 10 client.21765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff682088b80 20 client.21765 populate_metadata read hostname 'smithi035' 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff682088b80 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ffa6150 0x56250ffa8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:53:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff682088b80 4 client.21765 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:53:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56250fd0df00 con 0x56250ffa6150 2023-03-17T11:53:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff66effd700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ffa6150 0x56250ffa8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:53:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff64effd700 10 client.21765 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.816+0000 7ff66effd700 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ffa6150 0x56250ffa8560 crc :-1 s=READY pgs=791 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1f15ee93366615 server_cookie=9eaf62b11e35ca20 in_seq=0 out_seq=0 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff64effd700 1 -- 172.21.15.35:0/675506675 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56250fd0df00 con 0x56250ffa6150 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff64effd700 10 client.21765 handle_command_reply: tid=0 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 client.21765 shutdown 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 msgr2=0x56250ff48020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff48020 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7ff658097e60 tx=0x7ff6580982e0 comp rx=0 tx=0).stop 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 shutdown_connections 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56250ffa6150 0x56250ffa8560 crc :-1 s=READY pgs=791 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56250ff3d4f0 0x56250ff46900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56250ff37960 0x56250ff48020 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff64effd700 0 client.21765 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 --2- 172.21.15.35:0/675506675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56250ff3cbe0 0x56250ff463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.829+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 >> 172.21.15.35:0/675506675 conn(0x56250fd946b0 msgr2=0x56250ff3b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 shutdown_connections 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff682088b80 1 -- 172.21.15.35:0/675506675 wait complete. 2023-03-17T11:53:59.163 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff682088b80 20 client.21765 trim_cache size 0 max 16384 2023-03-17T11:53:59.164 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff65c09f640 msgr2=0x7ff65c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff65c09f640 0x7ff65c0a1af0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff66000b580 tx=0x7ff660005fd0 comp rx=0 tx=0).stop 2023-03-17T11:54:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 msgr2=0x7ff670100f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 0x7ff670100f60 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c9b0 tx=0x7ff65800cd70 comp rx=0 tx=0).stop 2023-03-17T11:54:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 shutdown_connections 2023-03-17T11:54:00.590 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ff65c09f640 0x7ff65c0a1af0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:01.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6701045a0 0x7ff6701a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ff6700ffa80 0x7ff670100f60 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 --2- 172.21.15.35:0/136228237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff670100420 0x7ff6701014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 >> 172.21.15.35:0/136228237 conn(0x7ff6700757a0 msgr2=0x7ff6701030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 shutdown_connections 2023-03-17T11:54:01.311 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:37.830+0000 7ff675efb700 1 -- 172.21.15.35:0/136228237 wait complete. 2023-03-17T11:54:02.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 -- 172.21.15.35:0/4279512703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 msgr2=0x7f210410cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:02.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 --2- 172.21.15.35:0/4279512703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210410cbd0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00b0a0 tx=0x7f20fc00b3b0 comp rx=0 tx=0).stop 2023-03-17T11:54:02.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 -- 172.21.15.35:0/4279512703 shutdown_connections 2023-03-17T11:54:02.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 --2- 172.21.15.35:0/4279512703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210410cbd0 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 --2- 172.21.15.35:0/4279512703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 0x7f2104101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 --2- 172.21.15.35:0/4279512703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2104101b80 0x7f210410a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 -- 172.21.15.35:0/4279512703 >> 172.21.15.35:0/4279512703 conn(0x7f2104076330 msgr2=0x7f2104076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 -- 172.21.15.35:0/4279512703 shutdown_connections 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.953+0000 7f210b27b700 1 -- 172.21.15.35:0/4279512703 wait complete. 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 Processor -- start 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 -- start start 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 0x7f2104198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2104101b80 0x7f2104198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210419d420 con 0x7f210410a790 2023-03-17T11:54:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210419d590 con 0x7f2104101270 2023-03-17T11:54:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f210b27b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210419d750 con 0x7f2104101b80 2023-03-17T11:54:06.867 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:14 smithi035 ceph-mon[92535]: pgmap v5915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:54:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57838/0 (socket says 172.21.15.35:57838) 2023-03-17T11:54:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 -- 172.21.15.35:0/1644180596 learned_addr learned my addr 172.21.15.35:0/1644180596 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109017700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 0x7f2104198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2108816700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2104101b80 0x7f2104198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 -- 172.21.15.35:0/1644180596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2104101b80 msgr2=0x7f2104198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2104101b80 0x7f2104198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 -- 172.21.15.35:0/1644180596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 msgr2=0x7f2104198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 0x7f2104198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109818700 1 -- 172.21.15.35:0/1644180596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc009d00 con 0x7f210410a790 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.954+0000 7f2109017700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 0x7f2104198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.955+0000 7f2109818700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210419cde0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0062a0 tx=0x7f20fc004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.955+0000 7f20fa7fc700 1 -- 172.21.15.35:0/1644180596 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00e040 con 0x7f210410a790 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.955+0000 7f20fa7fc700 1 -- 172.21.15.35:0/1644180596 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20fc003e90 con 0x7f210410a790 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.955+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21041100a0 con 0x7f210410a790 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.955+0000 7f20fa7fc700 1 -- 172.21.15.35:0/1644180596 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc004020 con 0x7f210410a790 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.955+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210410ff10 con 0x7f210410a790 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.958+0000 7f2117408b80 1 Processor -- start 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.958+0000 7f2117408b80 1 -- start start 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2117408b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5fbe0 0x562247a5ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2117408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a5a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2117408b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 0x562247a5ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2117408b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247961010 con 0x562247a5a960 2023-03-17T11:54:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2117408b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622479b3950 con 0x562247a5fbe0 2023-03-17T11:54:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2117408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622479acde0 con 0x562247a604f0 2023-03-17T11:54:09.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 0x562247a5ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 0x562247a5ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57844/0 (socket says 172.21.15.35:57844) 2023-03-17T11:54:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 -- 172.21.15.35:0/3980169076 learned_addr learned my addr 172.21.15.35:0/3980169076 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2109017700 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a5a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5fbe0 0x562247a5ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 -- 172.21.15.35:0/3980169076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 msgr2=0x562247a5a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a5a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 -- 172.21.15.35:0/3980169076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5fbe0 msgr2=0x562247a5ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5fbe0 0x562247a5ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 -- 172.21.15.35:0/3980169076 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56224782e5d0 con 0x562247a5a960 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.959+0000 7f2108816700 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 0x562247a5ad90 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f21000125a0 tx=0x7f210000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63428f9940ba7b49 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.960+0000 7f20ef7fe700 1 -- 172.21.15.35:0/3980169076 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100018070 con 0x562247a5a960 2023-03-17T11:54:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.960+0000 7f20ef7fe700 1 -- 172.21.15.35:0/3980169076 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f210000e900 con 0x562247a5a960 2023-03-17T11:54:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.960+0000 7f20ef7fe700 1 -- 172.21.15.35:0/3980169076 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21000107a0 con 0x562247a5a960 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.960+0000 7f2117408b80 1 -- 172.21.15.35:0/3980169076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 msgr2=0x562247a5ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.960+0000 7f2117408b80 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 0x562247a5ad90 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f21000125a0 tx=0x7f210000b660 comp rx=0 tx=0).stop 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f20fa7fc700 1 -- 172.21.15.35:0/1644180596 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f20fc01b760 con 0x7f210410a790 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 -- 172.21.15.35:0/3980169076 shutdown_connections 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5a960 0x562247a5ad90 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5fbe0 0x562247a5ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 --2- 172.21.15.35:0/3980169076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a5a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 -- 172.21.15.35:0/3980169076 >> 172.21.15.35:0/3980169076 conn(0x5622478b76b0 msgr2=0x562247a54a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 -- 172.21.15.35:0/3980169076 shutdown_connections 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 -- 172.21.15.35:0/3980169076 wait complete. 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 -- start start 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2117408b80 1 Processor -- start 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f20fa7fc700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f20f009f550 0x7f20f00a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f2108816700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f20f009f550 0x7f20f00a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.961+0000 7f20fa7fc700 1 -- 172.21.15.35:0/1644180596 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f20fc0cbdd0 con 0x7f210410a790 2023-03-17T11:54:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a63e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622478308c0 con 0x562247a5fbe0 2023-03-17T11:54:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247a64560 con 0x562247a5a960 2023-03-17T11:54:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247a70030 con 0x562247a604f0 2023-03-17T11:54:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2117408b80 10 client.0 _ll_register_callbacks cb 0x562247852230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:54:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:15.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2109017700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:15.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f20f009f550 0x7f20f00a1a00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2100005e30 tx=0x7f21000058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:15.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a637a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57852/0 (socket says 172.21.15.35:57852) 2023-03-17T11:54:15.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 -- 172.21.15.35:0/1706974041 learned_addr learned my addr 172.21.15.35:0/1706974041 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:15.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2109818700 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a63e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 -- 172.21.15.35:0/1706974041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 msgr2=0x562247a63e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a63e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 -- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 msgr2=0x562247a664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 -- 172.21.15.35:0/1706974041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210000bd90 con 0x562247a5fbe0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f2108816700 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a637a0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f2100004a30 tx=0x7f210000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8992c915e156bb05 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.962+0000 7f20ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f20ecff9700 1 -- 172.21.15.35:0/1706974041 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000e9c0 con 0x562247a5fbe0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f20ecff9700 1 -- 172.21.15.35:0/1706974041 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2100000e40 con 0x562247a5fbe0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56224796f390 con 0x562247a5fbe0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f20ecff9700 1 -- 172.21.15.35:0/1706974041 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f210000eb20 con 0x562247a5fbe0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 10 client.21777 fetch_fsmap learned FSMap version 110 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5622477dad80 con 0x562247a5fbe0 2023-03-17T11:54:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f20ecff9700 1 -- 172.21.15.35:0/1706974041 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56224796f390 con 0x562247a5fbe0 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f20ecff9700 1 -- 172.21.15.35:0/1706974041 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2100003a70 con 0x562247a5fbe0 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 10 client.21777 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 10 client.21777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 20 client.21777 populate_metadata read hostname 'smithi035' 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247a74020 0x562247a76430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 4 client.21777 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.963+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56224797b600 con 0x562247a74020 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.964+0000 7f2109017700 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247a74020 0x562247a76430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.964+0000 7f20ecff9700 10 client.21777 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.964+0000 7f2109017700 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247a74020 0x562247a76430 crc :-1 s=READY pgs=792 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c399a3ac2943baa server_cookie=46867d2b351911 in_seq=0 out_seq=0 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f20ecff9700 1 -- 172.21.15.35:0/1706974041 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56224797b600 con 0x562247a74020 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f20ecff9700 10 client.21777 handle_command_reply: tid=0 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 client.21777 shutdown 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 msgr2=0x562247a637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:19.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a637a0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f2100004a30 tx=0x7f210000bf20 comp rx=0 tx=0).stop 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 shutdown_connections 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247a74020 0x562247a76430 crc :-1 s=READY pgs=792 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a63e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f20ecff9700 0 client.21777 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 --2- 172.21.15.35:0/1706974041 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a637a0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 >> 172.21.15.35:0/1706974041 conn(0x5622478b76b0 msgr2=0x562247a59410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 shutdown_connections 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 1 -- 172.21.15.35:0/1706974041 wait complete. 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.965+0000 7f2117408b80 20 client.21777 trim_cache size 0 max 16384 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.980+0000 7f2117408b80 1 Processor -- start 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.980+0000 7f2117408b80 1 -- start start 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2117408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a5a960 0x562247a54ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2117408b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a6af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2117408b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a604f0 0x562247a62f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2117408b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247a5a3d0 con 0x562247a5fbe0 2023-03-17T11:54:19.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2117408b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247a55000 con 0x562247a604f0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2117408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247a556d0 con 0x562247a5a960 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a6af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a6af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57858/0 (socket says 172.21.15.35:57858) 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 -- 172.21.15.35:0/1443773952 learned_addr learned my addr 172.21.15.35:0/1443773952 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2109818700 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a604f0 0x562247a62f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2109017700 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a5a960 0x562247a54ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 -- 172.21.15.35:0/1443773952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a5a960 msgr2=0x562247a54ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a5a960 0x562247a54ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 -- 172.21.15.35:0/1443773952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a604f0 msgr2=0x562247a62f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a604f0 0x562247a62f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 -- 172.21.15.35:0/1443773952 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562247973130 con 0x562247a5fbe0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f2108816700 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a6af80 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f210000b390 tx=0x7f210000b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a54ced362726ae server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f20effff700 1 -- 172.21.15.35:0/1443773952 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100003880 con 0x562247a5fbe0 2023-03-17T11:54:19.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f20effff700 1 -- 172.21.15.35:0/1443773952 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2100019040 con 0x562247a5fbe0 2023-03-17T11:54:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.981+0000 7f20effff700 1 -- 172.21.15.35:0/1443773952 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000ea00 con 0x562247a5fbe0 2023-03-17T11:54:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 -- 172.21.15.35:0/1443773952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 msgr2=0x562247a6af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a6af80 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f210000b390 tx=0x7f210000b5e0 comp rx=0 tx=0).stop 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 -- 172.21.15.35:0/1443773952 shutdown_connections 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a604f0 0x562247a62f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a5a960 0x562247a54ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 --2- 172.21.15.35:0/1443773952 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a6af80 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 -- 172.21.15.35:0/1443773952 >> 172.21.15.35:0/1443773952 conn(0x5622478b76b0 msgr2=0x562247a59cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 -- 172.21.15.35:0/1443773952 shutdown_connections 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 -- 172.21.15.35:0/1443773952 wait complete. 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.982+0000 7f2117408b80 1 -- start start 2023-03-17T11:54:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 Processor -- start 2023-03-17T11:54:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a68f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a69a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247ac70c0 con 0x562247a5fbe0 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247ac7230 con 0x562247a5a960 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562247ac73f0 con 0x562247a604f0 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2117408b80 10 client.0 _ll_register_callbacks cb 0x562247852230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2108816700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57864/0 (socket says 172.21.15.35:57864) 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109017700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a68f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2108816700 1 -- 172.21.15.35:0/1956229765 learned_addr learned my addr 172.21.15.35:0/1956229765 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109818700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a69a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109017700 1 -- 172.21.15.35:0/1956229765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 msgr2=0x562247a69a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109017700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a69a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109017700 1 -- 172.21.15.35:0/1956229765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 msgr2=0x562247a694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109017700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.983+0000 7f2109017700 1 -- 172.21.15.35:0/1956229765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622477dad80 con 0x562247a5a960 2023-03-17T11:54:23.651 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f2108816700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:54:23.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:16 smithi035 ceph-mon[92535]: pgmap v5916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:54:23.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f2109017700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a68f60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x562247a76d00 tx=0x7f20f4004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f8932c8f2b9ba8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f20ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f20ecff9700 1 -- 172.21.15.35:0/1956229765 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4016040 con 0x562247a5a960 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562247a2a1e0 con 0x562247a5a960 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f20ecff9700 1 -- 172.21.15.35:0/1956229765 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f20f401be10 con 0x562247a5a960 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f20ecff9700 1 -- 172.21.15.35:0/1956229765 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20f4003680 con 0x562247a5a960 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f2117408b80 10 client.30671 fetch_fsmap learned FSMap version 110 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5622478011f0 con 0x562247a5a960 2023-03-17T11:54:23.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.984+0000 7f20ecff9700 1 -- 172.21.15.35:0/1956229765 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562247a2a1e0 con 0x562247a5a960 2023-03-17T11:54:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f20ecff9700 1 -- 172.21.15.35:0/1956229765 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f20f4010960 con 0x562247a5a960 2023-03-17T11:54:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2117408b80 10 client.30671 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:54:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2117408b80 10 client.30671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2117408b80 20 client.30671 populate_metadata read hostname 'smithi035' 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2117408b80 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247ac8b80 0x562247acaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2117408b80 4 client.30671 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562247830f00 con 0x562247ac8b80 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2108816700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247ac8b80 0x562247acaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f20ecff9700 10 client.30671 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.985+0000 7f2108816700 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247ac8b80 0x562247acaf90 crc :-1 s=READY pgs=793 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8721ef74ed5a6cfa server_cookie=12101c72773724c7 in_seq=0 out_seq=0 2023-03-17T11:54:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f20ecff9700 1 -- 172.21.15.35:0/1956229765 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562247830f00 con 0x562247ac8b80 2023-03-17T11:54:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f20ecff9700 10 client.30671 handle_command_reply: tid=0 2023-03-17T11:54:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 client.30671 shutdown 2023-03-17T11:54:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 msgr2=0x562247a68f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a68f60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x562247a76d00 tx=0x7f20f4004320 comp rx=0 tx=0).stop 2023-03-17T11:54:28.582 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 shutdown_connections 2023-03-17T11:54:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562247ac8b80 0x562247acaf90 crc :-1 s=READY pgs=793 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562247a604f0 0x562247a69a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f20ecff9700 0 client.30671 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562247a5a960 0x562247a68f60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 --2- 172.21.15.35:0/1956229765 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562247a5fbe0 0x562247a694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.997+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 >> 172.21.15.35:0/1956229765 conn(0x5622478b76b0 msgr2=0x562247a703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 shutdown_connections 2023-03-17T11:54:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f2117408b80 1 -- 172.21.15.35:0/1956229765 wait complete. 2023-03-17T11:54:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f2117408b80 20 client.30671 trim_cache size 0 max 16384 2023-03-17T11:54:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f20f009f550 msgr2=0x7f20f00a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f20f009f550 0x7f20f00a1a00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2100005e30 tx=0x7f21000058e0 comp rx=0 tx=0).stop 2023-03-17T11:54:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 msgr2=0x7f210419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210419cde0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0062a0 tx=0x7f20fc004db0 comp rx=0 tx=0).stop 2023-03-17T11:54:34.998 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 shutdown_connections 2023-03-17T11:54:34.999 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f20f009f550 0x7f20f00a1a00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f210410a790 0x7f210419cde0 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2104101270 0x7f2104198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 --2- 172.21.15.35:0/1644180596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2104101b80 0x7f2104198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 >> 172.21.15.35:0/1644180596 conn(0x7f2104076330 msgr2=0x7f21040ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 shutdown_connections 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:31:50.998+0000 7f210b27b700 1 -- 172.21.15.35:0/1644180596 wait complete. 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 -- 172.21.15.35:0/3670583926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820100220 msgr2=0x7f282010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 --2- 172.21.15.35:0/3670583926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820100220 0x7f282010beb0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f281800b0d0 tx=0x7f281800b3e0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 -- 172.21.15.35:0/3670583926 shutdown_connections 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 --2- 172.21.15.35:0/3670583926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820100220 0x7f282010beb0 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 --2- 172.21.15.35:0/3670583926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2820104040 0x7f2820104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 --2- 172.21.15.35:0/3670583926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 0x7f28200ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 -- 172.21.15.35:0/3670583926 >> 172.21.15.35:0/3670583926 conn(0x7f28200757a0 msgr2=0x7f2820075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 -- 172.21.15.35:0/3670583926 shutdown_connections 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.121+0000 7f28261c0700 1 -- 172.21.15.35:0/3670583926 wait complete. 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 Processor -- start 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 -- start start 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 0x7f2820198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2820100220 0x7f28201989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 0x7f282019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282019d450 con 0x7f2820104040 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282019d5c0 con 0x7f2820100220 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f28261c0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282019d780 con 0x7f28200ff870 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f281ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 0x7f282019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f281ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 0x7f282019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57882/0 (socket says 172.21.15.35:57882) 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.122+0000 7f281ffff700 1 -- 172.21.15.35:0/1680028080 learned_addr learned my addr 172.21.15.35:0/1680028080 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281effd700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2820100220 0x7f28201989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281f7fe700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 0x7f2820198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281ffff700 1 -- 172.21.15.35:0/1680028080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 msgr2=0x7f2820198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281ffff700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 0x7f2820198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281ffff700 1 -- 172.21.15.35:0/1680028080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2820100220 msgr2=0x7f28201989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281ffff700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2820100220 0x7f28201989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281ffff700 1 -- 172.21.15.35:0/1680028080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818009d00 con 0x7f2820104040 2023-03-17T11:54:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281f7fe700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 0x7f2820198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:54:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281ffff700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 0x7f282019ce10 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f2818009450 tx=0x7f2818009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281cff9700 1 -- 172.21.15.35:0/1680028080 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800e040 con 0x7f2820104040 2023-03-17T11:54:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281cff9700 1 -- 172.21.15.35:0/1680028080 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2818003e10 con 0x7f2820104040 2023-03-17T11:54:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282010f0a0 con 0x7f2820104040 2023-03-17T11:54:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f281cff9700 1 -- 172.21.15.35:0/1680028080 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818005570 con 0x7f2820104040 2023-03-17T11:54:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.123+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282010ef10 con 0x7f2820104040 2023-03-17T11:54:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.126+0000 7f281cff9700 1 -- 172.21.15.35:0/1680028080 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2818012c20 con 0x7f2820104040 2023-03-17T11:54:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.126+0000 7f281cff9700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f280809f640 0x7f28080a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f281cff9700 1 -- 172.21.15.35:0/1680028080 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f28180cbf90 con 0x7f2820104040 2023-03-17T11:54:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f281f7fe700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f280809f640 0x7f28080a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f281f7fe700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f280809f640 0x7f28080a1af0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2814005fd0 tx=0x7f2814005e20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f283234db80 1 Processor -- start 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f283234db80 1 -- start start 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f283234db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 0x562a50a87fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f283234db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a884f0 0x562a50a82420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f283234db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a82960 0x562a50a82d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.127+0000 7f283234db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50989010 con 0x562a50a87be0 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f283234db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a509db950 con 0x562a50a82960 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f283234db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a509d4de0 con 0x562a50a884f0 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 0x562a50a87fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 0x562a50a87fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57886/0 (socket says 172.21.15.35:57886) 2023-03-17T11:54:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 -- 172.21.15.35:0/2718473858 learned_addr learned my addr 172.21.15.35:0/2718473858 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281ffff700 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a82960 0x562a50a82d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:40.284 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281effd700 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a884f0 0x562a50a82420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 -- 172.21.15.35:0/2718473858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a884f0 msgr2=0x562a50a82420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a884f0 0x562a50a82420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 -- 172.21.15.35:0/2718473858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a82960 msgr2=0x562a50a82d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a82960 0x562a50a82d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:40.285 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 -- 172.21.15.35:0/2718473858 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a508565d0 con 0x562a50a87be0 2023-03-17T11:54:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281effd700 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a884f0 0x562a50a82420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:54:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f281f7fe700 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 0x562a50a87fb0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f281400dc60 tx=0x7f2814010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fa5422fd6bfd67 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f2805ffb700 1 -- 172.21.15.35:0/2718473858 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400f930 con 0x562a50a87be0 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f2805ffb700 1 -- 172.21.15.35:0/2718473858 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f281401c450 con 0x562a50a87be0 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.128+0000 7f2805ffb700 1 -- 172.21.15.35:0/2718473858 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281401b610 con 0x562a50a87be0 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 -- 172.21.15.35:0/2718473858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 msgr2=0x562a50a87fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 0x562a50a87fb0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f281400dc60 tx=0x7f2814010000 comp rx=0 tx=0).stop 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 -- 172.21.15.35:0/2718473858 shutdown_connections 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a82960 0x562a50a82d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a87be0 0x562a50a87fb0 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 --2- 172.21.15.35:0/2718473858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a884f0 0x562a50a82420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 -- 172.21.15.35:0/2718473858 >> 172.21.15.35:0/2718473858 conn(0x562a508df6b0 msgr2=0x562a50a7ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 -- 172.21.15.35:0/2718473858 shutdown_connections 2023-03-17T11:54:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 -- 172.21.15.35:0/2718473858 wait complete. 2023-03-17T11:54:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.129+0000 7f283234db80 1 -- start start 2023-03-17T11:54:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 Processor -- start 2023-03-17T11:54:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a8e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50a8b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a8bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a508588c0 con 0x562a50a82960 2023-03-17T11:54:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a8c2f0 con 0x562a50a884f0 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a8c4b0 con 0x562a50a87be0 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f283234db80 10 client.0 _ll_register_callbacks cb 0x562a5087a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a8e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a8e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57892/0 (socket says 172.21.15.35:57892) 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.130+0000 7f281f7fe700 1 -- 172.21.15.35:0/3810474575 learned_addr learned my addr 172.21.15.35:0/3810474575 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281ffff700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a8bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281effd700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50a8b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281f7fe700 1 -- 172.21.15.35:0/3810474575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 msgr2=0x562a50a8b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281f7fe700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50a8b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281f7fe700 1 -- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 msgr2=0x562a50a8bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281f7fe700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a8bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281f7fe700 1 -- 172.21.15.35:0/3810474575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281400d910 con 0x562a50a82960 2023-03-17T11:54:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f281f7fe700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a8e3d0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f281400f990 tx=0x7f281400fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8571438d887cdc1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f27feffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:54:47.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f27feffd700 1 -- 172.21.15.35:0/3810474575 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281402b070 con 0x562a50a82960 2023-03-17T11:54:47.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f27feffd700 1 -- 172.21.15.35:0/3810474575 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f281401c9a0 con 0x562a50a82960 2023-03-17T11:54:47.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a50997390 con 0x562a50a82960 2023-03-17T11:54:47.709 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f27feffd700 1 -- 172.21.15.35:0/3810474575 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f281403a470 con 0x562a50a82960 2023-03-17T11:54:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f283234db80 10 client.21795 fetch_fsmap learned FSMap version 110 2023-03-17T11:54:51.742 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x562a50802d80 con 0x562a50a82960 2023-03-17T11:54:51.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.131+0000 7f27feffd700 1 -- 172.21.15.35:0/3810474575 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a50997390 con 0x562a50a82960 2023-03-17T11:54:51.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f27feffd700 1 -- 172.21.15.35:0/3810474575 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2814025c70 con 0x562a50a82960 2023-03-17T11:54:51.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f283234db80 10 client.21795 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:54:51.743 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f283234db80 10 client.21795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f283234db80 20 client.21795 populate_metadata read hostname 'smithi035' 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f283234db80 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50a9bfc0 0x562a50a9e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f283234db80 4 client.21795 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a509a3600 con 0x562a50a9bfc0 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f281effd700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50a9bfc0 0x562a50a9e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f27feffd700 10 client.21795 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.132+0000 7f281effd700 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50a9bfc0 0x562a50a9e3d0 crc :-1 s=READY pgs=794 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e7d4cc4eea89d2 server_cookie=a6a062393ca24795 in_seq=0 out_seq=0 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f27feffd700 1 -- 172.21.15.35:0/3810474575 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x562a509a3600 con 0x562a50a9bfc0 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f27feffd700 10 client.21795 handle_command_reply: tid=0 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 client.21795 shutdown 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 msgr2=0x562a50a8e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a8e3d0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f281400f990 tx=0x7f281400fa70 comp rx=0 tx=0).stop 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 shutdown_connections 2023-03-17T11:54:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50a9bfc0 0x562a50a9e3d0 crc :-1 s=READY pgs=794 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:52.907 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:18 smithi035 ceph-mon[92535]: pgmap v5917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:54:52.907 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:18 smithi035 ceph-mon[92535]: osdmap e438: 12 total, 12 up, 12 in 2023-03-17T11:54:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a8bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f27feffd700 0 client.21795 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a8e3d0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 --2- 172.21.15.35:0/3810474575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50a8b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 >> 172.21.15.35:0/3810474575 conn(0x562a508df6b0 msgr2=0x562a50a81410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 shutdown_connections 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 1 -- 172.21.15.35:0/3810474575 wait complete. 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.133+0000 7f283234db80 20 client.21795 trim_cache size 0 max 16384 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.148+0000 7f283234db80 1 Processor -- start 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.148+0000 7f283234db80 1 -- start start 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.148+0000 7f283234db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a82960 0x562a50a7cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.148+0000 7f283234db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a87be0 0x562a50a8df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f283234db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 0x562a50a817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f283234db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a7d000 con 0x562a50a884f0 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f283234db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a861b0 con 0x562a50a87be0 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f283234db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a7e3d0 con 0x562a50a82960 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 0x562a50a817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 0x562a50a817d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57904/0 (socket says 172.21.15.35:57904) 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 -- 172.21.15.35:0/4158464687 learned_addr learned my addr 172.21.15.35:0/4158464687 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281f7fe700 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a82960 0x562a50a7cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 -- 172.21.15.35:0/4158464687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a82960 msgr2=0x562a50a7cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a82960 0x562a50a7cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 -- 172.21.15.35:0/4158464687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a87be0 msgr2=0x562a50a8df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a87be0 0x562a50a8df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:56.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 -- 172.21.15.35:0/4158464687 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a5099b130 con 0x562a50a884f0 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f281ffff700 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 0x562a50a817d0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f2818007590 tx=0x7f28180cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8764a247a2ffdc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f28067fc700 1 -- 172.21.15.35:0/4158464687 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180c9940 con 0x562a50a884f0 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f28067fc700 1 -- 172.21.15.35:0/4158464687 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28180c9aa0 con 0x562a50a884f0 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.149+0000 7f28067fc700 1 -- 172.21.15.35:0/4158464687 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818099cd0 con 0x562a50a884f0 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 -- 172.21.15.35:0/4158464687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 msgr2=0x562a50a817d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 0x562a50a817d0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f2818007590 tx=0x7f28180cb040 comp rx=0 tx=0).stop 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 -- 172.21.15.35:0/4158464687 shutdown_connections 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a884f0 0x562a50a817d0 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a82960 0x562a50a7cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 --2- 172.21.15.35:0/4158464687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a87be0 0x562a50a8df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 -- 172.21.15.35:0/4158464687 >> 172.21.15.35:0/4158464687 conn(0x562a508df6b0 msgr2=0x562a50a85650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 -- 172.21.15.35:0/4158464687 shutdown_connections 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 -- 172.21.15.35:0/4158464687 wait complete. 2023-03-17T11:54:56.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 -- start start 2023-03-17T11:54:57.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.150+0000 7f283234db80 1 Processor -- start 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a92cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50aede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a90ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a933d0 con 0x562a50a82960 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a93540 con 0x562a50a884f0 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a50a91530 con 0x562a50a87be0 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 10 client.0 _ll_register_callbacks cb 0x562a5087a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:54:57.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a92cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a92cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57908/0 (socket says 172.21.15.35:57908) 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 -- 172.21.15.35:0/3414583053 learned_addr learned my addr 172.21.15.35:0/3414583053 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281effd700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50aede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281ffff700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a90ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 -- 172.21.15.35:0/3414583053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 msgr2=0x562a50aede20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50aede20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 -- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 msgr2=0x562a50a90ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a90ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 -- 172.21.15.35:0/3414583053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282010ef10 con 0x562a50a82960 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f281f7fe700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a92cc0 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f281400dc60 tx=0x7f281402eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790ead3b80e54a1e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f27feffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f27feffd700 1 -- 172.21.15.35:0/3414583053 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281402b030 con 0x562a50a82960 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a50a521e0 con 0x562a50a82960 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.151+0000 7f27feffd700 1 -- 172.21.15.35:0/3414583053 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(410..410 src has 1..410) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f281402c070 con 0x562a50a82960 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f27feffd700 1 -- 172.21.15.35:0/3414583053 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f281400d620 con 0x562a50a82960 2023-03-17T11:54:57.568 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 10 client.21801 fetch_fsmap learned FSMap version 110 2023-03-17T11:54:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x562a508291f0 con 0x562a50a82960 2023-03-17T11:54:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f27feffd700 1 -- 172.21.15.35:0/3414583053 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a50a521e0 con 0x562a50a82960 2023-03-17T11:54:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f27feffd700 1 -- 172.21.15.35:0/3414583053 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f281403ac90 con 0x562a50a82960 2023-03-17T11:54:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 10 client.21801 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:54:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 10 client.21801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:54:57.569 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 20 client.21801 populate_metadata read hostname 'smithi035' 2023-03-17T11:54:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50aeecb0 0x562a50af10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:54:58.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 4 client.21801 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:54:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a50858f00 con 0x562a50aeecb0 2023-03-17T11:54:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.152+0000 7f281effd700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50aeecb0 0x562a50af10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:54:58.666 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.153+0000 7f27feffd700 10 client.21801 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.153+0000 7f281effd700 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50aeecb0 0x562a50af10c0 crc :-1 s=READY pgs=795 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8529e949f080a187 server_cookie=de1e6a6c4543bd31 in_seq=0 out_seq=0 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.169+0000 7f27feffd700 1 -- 172.21.15.35:0/3414583053 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a50858f00 con 0x562a50aeecb0 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.169+0000 7f27feffd700 10 client.21801 handle_command_reply: tid=0 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.169+0000 7f283234db80 1 client.21801 shutdown 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 msgr2=0x562a50a92cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a92cc0 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f281400dc60 tx=0x7f281402eb20 comp rx=0 tx=0).stop 2023-03-17T11:54:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 shutdown_connections 2023-03-17T11:55:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x562a50aeecb0 0x562a50af10c0 crc :-1 s=READY pgs=795 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562a50a884f0 0x562a50a90ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f27feffd700 0 client.21801 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x562a50a82960 0x562a50a92cc0 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 --2- 172.21.15.35:0/3414583053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a50a87be0 0x562a50aede20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 >> 172.21.15.35:0/3414583053 conn(0x562a508df6b0 msgr2=0x562a50a817d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 shutdown_connections 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 1 -- 172.21.15.35:0/3414583053 wait complete. 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f283234db80 20 client.21801 trim_cache size 0 max 16384 2023-03-17T11:55:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f280809f640 msgr2=0x7f28080a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f280809f640 0x7f28080a1af0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2814005fd0 tx=0x7f2814005e20 comp rx=0 tx=0).stop 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 msgr2=0x7f282019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 0x7f282019ce10 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f2818009450 tx=0x7f2818009530 comp rx=0 tx=0).stop 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 shutdown_connections 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f280809f640 0x7f28080a1af0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2820104040 0x7f282019ce10 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28200ff870 0x7f2820198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 --2- 172.21.15.35:0/1680028080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2820100220 0x7f28201989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.170+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 >> 172.21.15.35:0/1680028080 conn(0x7f28200757a0 msgr2=0x7f2820100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.171+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 shutdown_connections 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:32:04.171+0000 7f28261c0700 1 -- 172.21.15.35:0/1680028080 wait complete. 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 -- 172.21.15.35:0/2448223958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc1054f0 msgr2=0x7fbedc10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/2448223958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc1054f0 0x7fbedc10d100 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fbed400b0d0 tx=0x7fbed400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 -- 172.21.15.35:0/2448223958 shutdown_connections 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/2448223958 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc1054f0 0x7fbedc10d100 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/2448223958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbedc100be0 0x7fbedc100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/2448223958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc101580 0x7fbedc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:01.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.694+0000 7fbee3cd4700 1 -- 172.21.15.35:0/2448223958 >> 172.21.15.35:0/2448223958 conn(0x7fbedc0774e0 msgr2=0x7fbedc0778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:03.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 -- 172.21.15.35:0/2448223958 shutdown_connections 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 -- 172.21.15.35:0/2448223958 wait complete. 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 Processor -- start 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 -- start start 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc100be0 0x7fbedc196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 0x7fbedc196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbedc1054f0 0x7fbedc19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc19b320 con 0x7fbedc101580 2023-03-17T11:55:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc19b490 con 0x7fbedc100be0 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee3cd4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc19b650 con 0x7fbedc1054f0 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.695+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 0x7fbedc196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 0x7fbedc196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57924/0 (socket says 172.21.15.35:57924) 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 -- 172.21.15.35:0/169605797 learned_addr learned my addr 172.21.15.35:0/169605797 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee1a70700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc100be0 0x7fbedc196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee2271700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbedc1054f0 0x7fbedc19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 -- 172.21.15.35:0/169605797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbedc1054f0 msgr2=0x7fbedc19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbedc1054f0 0x7fbedc19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 -- 172.21.15.35:0/169605797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc100be0 msgr2=0x7fbedc196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc100be0 0x7fbedc196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 -- 172.21.15.35:0/169605797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009d00 con 0x7fbedc101580 2023-03-17T11:55:05.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee1a70700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc100be0 0x7fbedc196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee126f700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 0x7fbedc196880 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00d950 tx=0x7fbecc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbed2ffd700 1 -- 172.21.15.35:0/169605797 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009b40 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc1101c0 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbed2ffd700 1 -- 172.21.15.35:0/169605797 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbecc00de30 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbed2ffd700 1 -- 172.21.15.35:0/169605797 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00f620 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.696+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc110030 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.699+0000 7fbed2ffd700 1 -- 172.21.15.35:0/169605797 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbecc010460 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.699+0000 7fbed2ffd700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbec809f640 0x7fbec80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.700+0000 7fbee1a70700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbec809f640 0x7fbec80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.700+0000 7fbed2ffd700 1 -- 172.21.15.35:0/169605797 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(412..412 src has 1..412) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbecc0ca1f0 con 0x7fbedc101580 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.700+0000 7fbee1a70700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbec809f640 0x7fbec80a1af0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005950 tx=0x7fbed80058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.700+0000 7fbeefe61b80 1 Processor -- start 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 -- start start 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f12ff0 0x560d80f133c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:05.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 0x560d80f0d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f0e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80e10010 con 0x560d80f13900 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80e62950 con 0x560d80f12ff0 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80e5bde0 con 0x560d80f0ddc0 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 0x560d80f0d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 0x560d80f0d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57932/0 (socket says 172.21.15.35:57932) 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 -- 172.21.15.35:0/4040403345 learned_addr learned my addr 172.21.15.35:0/4040403345 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee1a70700 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f12ff0 0x560d80f133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee2271700 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f0e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 -- 172.21.15.35:0/4040403345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 msgr2=0x560d80f0e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f0e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 -- 172.21.15.35:0/4040403345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f12ff0 msgr2=0x560d80f133c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f12ff0 0x560d80f133c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee126f700 1 -- 172.21.15.35:0/4040403345 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d80cdd5d0 con 0x560d80f13900 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.701+0000 7fbee2271700 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f0e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:55:05.020 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.702+0000 7fbee126f700 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 0x560d80f0d830 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0941a0 tx=0x7fbecc097600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ff97b77a889210 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:20 smithi035 ceph-mon[92535]: pgmap v5919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:55:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:22 smithi035 ceph-mon[92535]: pgmap v5920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:55:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:24 smithi035 ceph-mon[92535]: pgmap v5921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:55:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:26 smithi035 ceph-mon[92535]: pgmap v5922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:55:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:28 smithi035 ceph-mon[92535]: pgmap v5923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:55:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:30 smithi035 ceph-mon[92535]: pgmap v5924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:32 smithi035 ceph-mon[92535]: pgmap v5925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:34 smithi035 ceph-mon[92535]: pgmap v5926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:36 smithi035 ceph-mon[92535]: pgmap v5927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:38 smithi035 ceph-mon[92535]: pgmap v5928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:40 smithi035 ceph-mon[92535]: pgmap v5929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:42 smithi035 ceph-mon[92535]: pgmap v5930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:44 smithi035 ceph-mon[92535]: pgmap v5931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T11:55:06.464 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:46 smithi035 ceph-mon[92535]: pgmap v5932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T11:55:06.920 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:48 smithi035 ceph-mon[92535]: pgmap v5933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T11:55:06.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:50 smithi035 ceph-mon[92535]: pgmap v5934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T11:55:06.921 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:52 smithi035 ceph-mon[92535]: pgmap v5935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:54 smithi035 ceph-mon[92535]: pgmap v5936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:56 smithi035 ceph-mon[92535]: pgmap v5937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:45:58 smithi035 ceph-mon[92535]: pgmap v5938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:00 smithi035 ceph-mon[92535]: pgmap v5939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:02 smithi035 ceph-mon[92535]: pgmap v5940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:04 smithi035 ceph-mon[92535]: pgmap v5941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:05 smithi035 ceph-mon[92535]: pgmap v5942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 26 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:05 smithi035 ceph-mon[92535]: pgmap v5943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 32 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:07 smithi035 ceph-mon[92535]: pgmap v5944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T11:55:07.256 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:09 smithi035 ceph-mon[92535]: pgmap v5945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 32 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:09 smithi035 ceph-mon[92535]: osdmap e439: 12 total, 12 up, 12 in 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:11 smithi035 ceph-mon[92535]: pgmap v5947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:13 smithi035 ceph-mon[92535]: pgmap v5948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:15 smithi035 ceph-mon[92535]: pgmap v5949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:17 smithi035 ceph-mon[92535]: pgmap v5950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:17 smithi035 ceph-mon[92535]: osdmap e440: 12 total, 12 up, 12 in 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:19 smithi035 ceph-mon[92535]: pgmap v5952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 109 B/s wr, 11 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:21 smithi035 ceph-mon[92535]: pgmap v5953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:23 smithi035 ceph-mon[92535]: pgmap v5954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:25 smithi035 ceph-mon[92535]: pgmap v5955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:27 smithi035 ceph-mon[92535]: pgmap v5956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:29 smithi035 ceph-mon[92535]: pgmap v5957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 392 B/s wr, 10 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:31 smithi035 ceph-mon[92535]: pgmap v5958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:33 smithi035 ceph-mon[92535]: pgmap v5959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:35 smithi035 ceph-mon[92535]: pgmap v5960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:37 smithi035 ceph-mon[92535]: pgmap v5961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:39 smithi035 ceph-mon[92535]: pgmap v5962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:55:07.257 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:41 smithi035 ceph-mon[92535]: pgmap v5963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:55:07.258 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:43 smithi035 ceph-mon[92535]: pgmap v5964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:55:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:55:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:55:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:55:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:55:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:55:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:55:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:55:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:55:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.702+0000 7fbec7fff700 1 -- 172.21.15.35:0/4040403345 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc096040 con 0x560d80f13900 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.702+0000 7fbec7fff700 1 -- 172.21.15.35:0/4040403345 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbecc010710 con 0x560d80f13900 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.702+0000 7fbec7fff700 1 -- 172.21.15.35:0/4040403345 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc097190 con 0x560d80f13900 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.702+0000 7fbeefe61b80 1 -- 172.21.15.35:0/4040403345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 msgr2=0x560d80f0d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.702+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 0x560d80f0d830 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0941a0 tx=0x7fbecc097600 comp rx=0 tx=0).stop 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 -- 172.21.15.35:0/4040403345 shutdown_connections 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f0e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f12ff0 0x560d80f133c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/4040403345 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f13900 0x560d80f0d830 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 -- 172.21.15.35:0/4040403345 >> 172.21.15.35:0/4040403345 conn(0x560d80d666b0 msgr2=0x560d80f03a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 -- 172.21.15.35:0/4040403345 shutdown_connections 2023-03-17T11:55:08.464 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 -- 172.21.15.35:0/4040403345 wait complete. 2023-03-17T11:55:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 -- start start 2023-03-17T11:55:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.703+0000 7fbeefe61b80 1 Processor -- start 2023-03-17T11:55:08.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f16ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:10.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f17620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80cdf8c0 con 0x560d80f12ff0 2023-03-17T11:55:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f23370 con 0x560d80f0ddc0 2023-03-17T11:55:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f234b0 con 0x560d80f13900 2023-03-17T11:55:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 10 client.0 _ll_register_callbacks cb 0x560d80d01230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:55:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f170e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57938/0 (socket says 172.21.15.35:57938) 2023-03-17T11:55:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 -- 172.21.15.35:0/2163327234 learned_addr learned my addr 172.21.15.35:0/2163327234 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee2271700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f17620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee1a70700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f16ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 -- 172.21.15.35:0/2163327234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 msgr2=0x560d80f17620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f17620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 -- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 msgr2=0x560d80f16ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f16ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 -- 172.21.15.35:0/2163327234 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc110030 con 0x560d80f12ff0 2023-03-17T11:55:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee1a70700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f16ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbee126f700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f170e0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0c7f80 tx=0x7fbecc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a0aeb10dda7fd5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbec57fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbec57fa700 1 -- 172.21.15.35:0/2163327234 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc097190 con 0x560d80f12ff0 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbec57fa700 1 -- 172.21.15.35:0/2163327234 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(412..412 src has 1..412) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbecc0972f0 con 0x560d80f12ff0 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.704+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d80e1e390 con 0x560d80f12ff0 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbec57fa700 1 -- 172.21.15.35:0/2163327234 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbecc0642d0 con 0x560d80f12ff0 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 10 client.21813 fetch_fsmap learned FSMap version 110 2023-03-17T11:55:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x560d80c89d80 con 0x560d80f12ff0 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbec57fa700 1 -- 172.21.15.35:0/2163327234 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d80e1e390 con 0x560d80f12ff0 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbec57fa700 1 -- 172.21.15.35:0/2163327234 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbecc0c1d20 con 0x560d80f12ff0 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 10 client.21813 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 10 client.21813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 20 client.21813 populate_metadata read hostname 'smithi035' 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f27090 0x560d80f294a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 4 client.21813 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d80e2a600 con 0x560d80f27090 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.705+0000 7fbee1a70700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f27090 0x560d80f294a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbec57fa700 10 client.21813 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbee1a70700 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f27090 0x560d80f294a0 crc :-1 s=READY pgs=798 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=345f23b452c668b2 server_cookie=c644877361225c1a in_seq=0 out_seq=0 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbec57fa700 1 -- 172.21.15.35:0/2163327234 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560d80e2a600 con 0x560d80f27090 2023-03-17T11:55:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbec57fa700 10 client.21813 handle_command_reply: tid=0 2023-03-17T11:55:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 client.21813 shutdown 2023-03-17T11:55:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 msgr2=0x560d80f170e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f170e0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0c7f80 tx=0x7fbecc009650 comp rx=0 tx=0).stop 2023-03-17T11:55:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 shutdown_connections 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f27090 0x560d80f294a0 crc :-1 s=READY pgs=798 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f17620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f16ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/2163327234 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f170e0 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbec57fa700 0 client.21813 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 >> 172.21.15.35:0/2163327234 conn(0x560d80d666b0 msgr2=0x560d80f08410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 shutdown_connections 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.706+0000 7fbeefe61b80 1 -- 172.21.15.35:0/2163327234 wait complete. 2023-03-17T11:55:17.069 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.707+0000 7fbeefe61b80 20 client.21813 trim_cache size 0 max 16384 2023-03-17T11:55:17.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.721+0000 7fbeefe61b80 1 Processor -- start 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.721+0000 7fbeefe61b80 1 -- start start 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f08a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f03ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f13900 0x560d80f12330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f053d0 con 0x560d80f12ff0 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f04000 con 0x560d80f13900 2023-03-17T11:55:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80eff0d0 con 0x560d80f0ddc0 2023-03-17T11:55:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f03ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f03ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57946/0 (socket says 172.21.15.35:57946) 2023-03-17T11:55:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 -- 172.21.15.35:0/699607669 learned_addr learned my addr 172.21.15.35:0/699607669 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee1a70700 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f08a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee2271700 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f13900 0x560d80f12330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 -- 172.21.15.35:0/699607669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 msgr2=0x560d80f08a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f08a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 -- 172.21.15.35:0/699607669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f13900 msgr2=0x560d80f12330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f13900 0x560d80f12330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 -- 172.21.15.35:0/699607669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d80f0e460 con 0x560d80f12ff0 2023-03-17T11:55:20.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbee126f700 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f03ac0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fbecc010c00 tx=0x7fbecc0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ca2c7b2935d35f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbed0ff9700 1 -- 172.21.15.35:0/699607669 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc014070 con 0x560d80f12ff0 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbed0ff9700 1 -- 172.21.15.35:0/699607669 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbecc09fca0 con 0x560d80f12ff0 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.722+0000 7fbed0ff9700 1 -- 172.21.15.35:0/699607669 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc098160 con 0x560d80f12ff0 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 -- 172.21.15.35:0/699607669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 msgr2=0x560d80f03ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f03ac0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fbecc010c00 tx=0x7fbecc0096c0 comp rx=0 tx=0).stop 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 -- 172.21.15.35:0/699607669 shutdown_connections 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f13900 0x560d80f12330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f0ddc0 0x560d80f08a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/699607669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f03ac0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 -- 172.21.15.35:0/699607669 >> 172.21.15.35:0/699607669 conn(0x560d80d666b0 msgr2=0x560d80f11c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 -- 172.21.15.35:0/699607669 shutdown_connections 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 -- 172.21.15.35:0/699607669 wait complete. 2023-03-17T11:55:20.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 -- start start 2023-03-17T11:55:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.723+0000 7fbeefe61b80 1 Processor -- start 2023-03-17T11:55:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f1e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f1c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f1c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f1ce60 con 0x560d80f12ff0 2023-03-17T11:55:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f1cfd0 con 0x560d80f0ddc0 2023-03-17T11:55:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d80f1d190 con 0x560d80f13900 2023-03-17T11:55:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbeefe61b80 10 client.0 _ll_register_callbacks cb 0x560d80d01230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:55:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f1c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee126f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f1c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57952/0 (socket says 172.21.15.35:57952) 2023-03-17T11:55:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee1a70700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f1e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee126f700 1 -- 172.21.15.35:0/42869857 learned_addr learned my addr 172.21.15.35:0/42869857 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee2271700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f1c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee1a70700 1 -- 172.21.15.35:0/42869857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 msgr2=0x560d80f1c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee1a70700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f1c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee1a70700 1 -- 172.21.15.35:0/42869857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 msgr2=0x560d80f1c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee1a70700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f1c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.724+0000 7fbee1a70700 1 -- 172.21.15.35:0/42869857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d80c89d80 con 0x560d80f0ddc0 2023-03-17T11:55:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbee126f700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:55:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbee1a70700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f1e0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x560d80f29d40 tx=0x7fbed8015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5096eda089e925 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbec57fa700 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-03-17T11:55:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbec57fa700 1 -- 172.21.15.35:0/42869857 <== mon.2 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8017040 con 0x560d80f0ddc0 2023-03-17T11:55:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d80ed91e0 con 0x560d80f0ddc0 2023-03-17T11:55:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbec57fa700 1 -- 172.21.15.35:0/42869857 <== mon.2 v2:172.21.15.78:3300/0 2 ==== osd_map(412..412 src has 1..412) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbed8028520 con 0x560d80f0ddc0 2023-03-17T11:55:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbec57fa700 1 -- 172.21.15.35:0/42869857 <== mon.2 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbed8028850 con 0x560d80f0ddc0 2023-03-17T11:55:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbeefe61b80 10 client.30701 fetch_fsmap learned FSMap version 110 2023-03-17T11:55:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x560d80c72c00 con 0x560d80f0ddc0 2023-03-17T11:55:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbec57fa700 1 -- 172.21.15.35:0/42869857 <== mon.2 v2:172.21.15.78:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d80ed91e0 con 0x560d80f0ddc0 2023-03-17T11:55:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.725+0000 7fbec57fa700 1 -- 172.21.15.35:0/42869857 <== mon.2 v2:172.21.15.78:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbed8003ad0 con 0x560d80f0ddc0 2023-03-17T11:55:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbeefe61b80 10 client.30701 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:55:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbeefe61b80 10 client.30701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:55:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbeefe61b80 20 client.30701 populate_metadata read hostname 'smithi035' 2023-03-17T11:55:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f7c2d0 0x560d80f7e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbeefe61b80 4 client.30701 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:55:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d80cdff00 con 0x560d80f7c2d0 2023-03-17T11:55:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbee126f700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f7c2d0 0x560d80f7e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbec57fa700 10 client.30701 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.726+0000 7fbee126f700 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f7c2d0 0x560d80f7e6e0 crc :-1 s=READY pgs=799 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd74cdcb09152d34 server_cookie=7b35c0881f13d82 in_seq=0 out_seq=0 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.742+0000 7fbec57fa700 1 -- 172.21.15.35:0/42869857 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d80cdff00 con 0x560d80f7c2d0 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.742+0000 7fbec57fa700 10 client.30701 handle_command_reply: tid=0 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.742+0000 7fbeefe61b80 1 client.30701 shutdown 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.742+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 msgr2=0x560d80f1e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.742+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f1e0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x560d80f29d40 tx=0x7fbed8015000 comp rx=0 tx=0).stop 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 shutdown_connections 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560d80f7c2d0 0x560d80f7e6e0 crc :-1 s=READY pgs=799 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d80f13900 0x560d80f1c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbec57fa700 0 client.30701 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560d80f0ddc0 0x560d80f1e0b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 --2- 172.21.15.35:0/42869857 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560d80f12ff0 0x560d80f1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 >> 172.21.15.35:0/42869857 conn(0x560d80d666b0 msgr2=0x560d80f15350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 shutdown_connections 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 1 -- 172.21.15.35:0/42869857 wait complete. 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbeefe61b80 20 client.30701 trim_cache size 0 max 16384 2023-03-17T11:55:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbec809f640 msgr2=0x7fbec80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbec809f640 0x7fbec80a1af0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005950 tx=0x7fbed80058e0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 msgr2=0x7fbedc196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 0x7fbedc196880 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00d950 tx=0x7fbecc00dd10 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 shutdown_connections 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbec809f640 0x7fbec80a1af0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbedc1054f0 0x7fbedc19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc100be0 0x7fbedc196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 --2- 172.21.15.35:0/169605797 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbedc101580 0x7fbedc196880 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 >> 172.21.15.35:0/169605797 conn(0x7fbedc0774e0 msgr2=0x7fbedc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 shutdown_connections 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:04.743+0000 7fbee3cd4700 1 -- 172.21.15.35:0/169605797 wait complete. 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 -- 172.21.15.35:0/2284813679 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc0100be0 msgr2=0x7fdbc0100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/2284813679 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc0100be0 0x7fdbc0100fb0 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40099c0 tx=0x7fdbb4009cd0 comp rx=0 tx=0).stop 2023-03-17T11:55:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 -- 172.21.15.35:0/2284813679 shutdown_connections 2023-03-17T11:55:29.236 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:45 smithi035 ceph-mon[92535]: pgmap v5965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:55:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/2284813679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc01054f0 0x7fdbc010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/2284813679 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc0100be0 0x7fdbc0100fb0 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/2284813679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc0101580 0x7fdbc0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 -- 172.21.15.35:0/2284813679 >> 172.21.15.35:0/2284813679 conn(0x7fdbc00774e0 msgr2=0x7fdbc00778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 -- 172.21.15.35:0/2284813679 shutdown_connections 2023-03-17T11:55:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.865+0000 7fdbc4b81700 1 -- 172.21.15.35:0/2284813679 wait complete. 2023-03-17T11:55:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 Processor -- start 2023-03-17T11:55:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 -- start start 2023-03-17T11:55:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc0100be0 0x7fdbc0072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc0101580 0x7fdbc00732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 0x7fdbc01a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0073af0 con 0x7fdbc01054f0 2023-03-17T11:55:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01a48b0 con 0x7fdbc0101580 2023-03-17T11:55:31.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbc4b81700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01a49f0 con 0x7fdbc0100be0 2023-03-17T11:55:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.866+0000 7fdbbed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 0x7fdbc01a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:31.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 0x7fdbc01a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57968/0 (socket says 172.21.15.35:57968) 2023-03-17T11:55:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1069317391 learned_addr learned my addr 172.21.15.35:0/1069317391 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc0100be0 0x7fdbc0072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc0101580 0x7fdbc00732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1069317391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc0100be0 msgr2=0x7fdbc0072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc0100be0 0x7fdbc0072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1069317391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc0101580 msgr2=0x7fdbc00732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc0101580 0x7fdbc00732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1069317391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40095f0 con 0x7fdbc01054f0 2023-03-17T11:55:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 0x7fdbc01a4370 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8007d70 tx=0x7fdbb800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbaf7fe700 1 -- 172.21.15.35:0/1069317391 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800ad40 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc01101c0 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbaf7fe700 1 -- 172.21.15.35:0/1069317391 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbb80128b0 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbaf7fe700 1 -- 172.21.15.35:0/1069317391 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80115c0 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.867+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc0110030 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.870+0000 7fdbaf7fe700 1 -- 172.21.15.35:0/1069317391 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fdbb8012a20 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.870+0000 7fdbaf7fe700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdba809f640 0x7fdba80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.870+0000 7fdbaf7fe700 1 -- 172.21.15.35:0/1069317391 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdbb80ca6e0 con 0x7fdbc01054f0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.870+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdba809f640 0x7fdba80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.871+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdba809f640 0x7fdba80a1af0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400b580 tx=0x7fdbb4009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.871+0000 7fdbd0d0eb80 1 Processor -- start 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.871+0000 7fdbd0d0eb80 1 -- start start 2023-03-17T11:55:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 0x561b9d908fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:33.708 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d903420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d903d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d80a010 con 0x561b9d908be0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d85c950 con 0x561b9d903960 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d855de0 con 0x561b9d9094f0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 0x561b9d908fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 0x561b9d908fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57972/0 (socket says 172.21.15.35:57972) 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 -- 172.21.15.35:0/2934422194 learned_addr learned my addr 172.21.15.35:0/2934422194 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d903420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d903d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 -- 172.21.15.35:0/2934422194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 msgr2=0x561b9d903420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d903420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 -- 172.21.15.35:0/2934422194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 msgr2=0x561b9d903d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d903d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 -- 172.21.15.35:0/2934422194 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b9d6d75d0 con 0x561b9d908be0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 0x561b9d908fb0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4015000 tx=0x7fdbb4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3a00f80b45ef97 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.872+0000 7fdbacff9700 1 -- 172.21.15.35:0/2934422194 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400be20 con 0x561b9d908be0 2023-03-17T11:55:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbacff9700 1 -- 172.21.15.35:0/2934422194 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbb401e040 con 0x561b9d908be0 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbacff9700 1 -- 172.21.15.35:0/2934422194 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4003a20 con 0x561b9d908be0 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/2934422194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 msgr2=0x561b9d908fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 0x561b9d908fb0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4015000 tx=0x7fdbb4020000 comp rx=0 tx=0).stop 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/2934422194 shutdown_connections 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d903d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d908be0 0x561b9d908fb0 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/2934422194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d903420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/2934422194 >> 172.21.15.35:0/2934422194 conn(0x561b9d7606b0 msgr2=0x561b9d8fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/2934422194 shutdown_connections 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.873+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/2934422194 wait complete. 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 -- start start 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 Processor -- start 2023-03-17T11:55:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d90f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d6d98c0 con 0x561b9d903960 2023-03-17T11:55:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d90d670 con 0x561b9d908be0 2023-03-17T11:55:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d918fa0 con 0x561b9d9094f0 2023-03-17T11:55:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbd0d0eb80 10 client.0 _ll_register_callbacks cb 0x561b9d6fb230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:55:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbbe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d90f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbbe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d90f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57978/0 (socket says 172.21.15.35:57978) 2023-03-17T11:55:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbbe59c700 1 -- 172.21.15.35:0/41975725 learned_addr learned my addr 172.21.15.35:0/41975725 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.874+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbbe59c700 1 -- 172.21.15.35:0/41975725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 msgr2=0x561b9d90cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbbe59c700 1 -- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 msgr2=0x561b9d90c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbbe59c700 1 -- 172.21.15.35:0/41975725 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc010d940 con 0x561b9d903960 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d90f4d0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004730 tx=0x7fdbb4004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe356192cc604462 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdba5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdba5ffb700 1 -- 172.21.15.35:0/41975725 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004e90 con 0x561b9d903960 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdba5ffb700 1 -- 172.21.15.35:0/41975725 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdbb4003820 con 0x561b9d903960 2023-03-17T11:55:38.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b9d818390 con 0x561b9d903960 2023-03-17T11:55:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdba5ffb700 1 -- 172.21.15.35:0/41975725 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbb40039e0 con 0x561b9d903960 2023-03-17T11:55:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbd0d0eb80 10 client.21831 fetch_fsmap learned FSMap version 110 2023-03-17T11:55:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561b9d683d80 con 0x561b9d903960 2023-03-17T11:55:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.875+0000 7fdba5ffb700 1 -- 172.21.15.35:0/41975725 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbb4045080 con 0x561b9d903960 2023-03-17T11:55:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdba5ffb700 1 -- 172.21.15.35:0/41975725 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdbb40387d0 con 0x561b9d903960 2023-03-17T11:55:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbd0d0eb80 10 client.21831 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:55:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbd0d0eb80 10 client.21831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:55:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbd0d0eb80 20 client.21831 populate_metadata read hostname 'smithi035' 2023-03-17T11:55:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d91cbc0 0x561b9d91efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbd0d0eb80 4 client.21831 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b9d824600 con 0x561b9d91cbc0 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d91cbc0 0x561b9d91efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdba5ffb700 10 client.21831 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.876+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d91cbc0 0x561b9d91efa0 crc :-1 s=READY pgs=800 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ac4fe4c2b131523 server_cookie=b91fa175b2c6d931 in_seq=0 out_seq=0 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdba5ffb700 1 -- 172.21.15.35:0/41975725 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561b9d824600 con 0x561b9d91cbc0 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdba5ffb700 10 client.21831 handle_command_reply: tid=0 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 client.21831 shutdown 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 msgr2=0x561b9d90f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d90f4d0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4004730 tx=0x7fdbb4004760 comp rx=0 tx=0).stop 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 shutdown_connections 2023-03-17T11:55:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d91cbc0 0x561b9d91efa0 crc :-1 s=READY pgs=800 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d90f4d0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/41975725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdba5ffb700 0 client.21831 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 >> 172.21.15.35:0/41975725 conn(0x561b9d7606b0 msgr2=0x561b9d902410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 shutdown_connections 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/41975725 wait complete. 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.877+0000 7fdbd0d0eb80 20 client.21831 trim_cache size 0 max 16384 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 Processor -- start 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 -- start start 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d913ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d90d760 con 0x561b9d903960 2023-03-17T11:55:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d902b20 con 0x561b9d908be0 2023-03-17T11:55:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d8fab60 con 0x561b9d9094f0 2023-03-17T11:55:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d913ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d913ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57986/0 (socket says 172.21.15.35:57986) 2023-03-17T11:55:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 -- 172.21.15.35:0/1410771970 learned_addr learned my addr 172.21.15.35:0/1410771970 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 -- 172.21.15.35:0/1410771970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 msgr2=0x561b9d90f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 -- 172.21.15.35:0/1410771970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 msgr2=0x561b9d90f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.893+0000 7fdbbe59c700 1 -- 172.21.15.35:0/1410771970 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b9d81c130 con 0x561b9d903960 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d913ef0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4006010 tx=0x7fdbb4005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e626eb7071e037e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbad7fa700 1 -- 172.21.15.35:0/1410771970 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004dc0 con 0x561b9d903960 2023-03-17T11:55:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbad7fa700 1 -- 172.21.15.35:0/1410771970 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561b9d818390 con 0x561b9d903960 2023-03-17T11:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbad7fa700 1 -- 172.21.15.35:0/1410771970 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4003cb0 con 0x561b9d903960 2023-03-17T11:55:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1410771970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 msgr2=0x561b9d913ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d913ef0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4006010 tx=0x7fdbb4005810 comp rx=0 tx=0).stop 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1410771970 shutdown_connections 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d9094f0 0x561b9d90f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d903960 0x561b9d913ef0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1410771970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d908be0 0x561b9d90f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1410771970 >> 172.21.15.35:0/1410771970 conn(0x561b9d7606b0 msgr2=0x561b9d902410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1410771970 shutdown_connections 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.894+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1410771970 wait complete. 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 -- start start 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 Processor -- start 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d9138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d908be0 0x561b9d913e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 0x561b9d911ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d9124b0 con 0x561b9d9094f0 2023-03-17T11:55:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d912620 con 0x561b9d903960 2023-03-17T11:55:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b9d9127e0 con 0x561b9d908be0 2023-03-17T11:55:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbd0d0eb80 10 client.0 _ll_register_callbacks cb 0x561b9d6fb230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:55:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 0x561b9d911ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 0x561b9d911ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:57996/0 (socket says 172.21.15.35:57996) 2023-03-17T11:55:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1887252119 learned_addr learned my addr 172.21.15.35:0/1887252119 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:45.660 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:47 smithi035 ceph-mon[92535]: pgmap v5966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:55:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d9138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:48.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbdd9b700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d908be0 0x561b9d913e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1887252119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d908be0 msgr2=0x561b9d913e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:48.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d908be0 0x561b9d913e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 msgr2=0x561b9d9138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d9138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.895+0000 7fdbbed9d700 1 -- 172.21.15.35:0/1887252119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b9d683d80 con 0x561b9d9094f0 2023-03-17T11:55:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbbed9d700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 0x561b9d911ed0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8007d40 tx=0x7fdbb8094710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe683c50610277dd server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdba5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:55:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdba5ffb700 1 -- 172.21.15.35:0/1887252119 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8098700 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdba5ffb700 1 -- 172.21.15.35:0/1887252119 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fdbb8097790 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b9d8d31e0 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdba5ffb700 1 -- 172.21.15.35:0/1887252119 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbb8097970 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 10 client.21837 fetch_fsmap learned FSMap version 110 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561b9d6aa1f0 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdba5ffb700 1 -- 172.21.15.35:0/1887252119 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561b9d8d31e0 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdba5ffb700 1 -- 172.21.15.35:0/1887252119 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fdbb80abbd0 con 0x561b9d9094f0 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 10 client.21837 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 10 client.21837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 20 client.21837 populate_metadata read hostname 'smithi035' 2023-03-17T11:55:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d971c20 0x561b9d974030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 4 client.21837 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.896+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561b9d6d9f00 con 0x561b9d971c20 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.897+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d971c20 0x561b9d974030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.897+0000 7fdbbe59c700 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d971c20 0x561b9d974030 crc :-1 s=READY pgs=801 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecbd7ae0e4aa6d03 server_cookie=a66536b6e443ec1f in_seq=0 out_seq=0 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.897+0000 7fdba5ffb700 10 client.21837 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdba5ffb700 1 -- 172.21.15.35:0/1887252119 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561b9d6d9f00 con 0x561b9d971c20 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdba5ffb700 10 client.21837 handle_command_reply: tid=0 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 client.21837 shutdown 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 msgr2=0x561b9d911ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 0x561b9d911ed0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8007d40 tx=0x7fdbb8094710 comp rx=0 tx=0).stop 2023-03-17T11:55:48.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 shutdown_connections 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561b9d971c20 0x561b9d974030 crc :-1 s=READY pgs=801 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561b9d9094f0 0x561b9d911ed0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdba5ffb700 0 client.21837 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b9d903960 0x561b9d9138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 --2- 172.21.15.35:0/1887252119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b9d908be0 0x561b9d913e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 >> 172.21.15.35:0/1887252119 conn(0x561b9d7606b0 msgr2=0x561b9d9066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 shutdown_connections 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 1 -- 172.21.15.35:0/1887252119 wait complete. 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.915+0000 7fdbd0d0eb80 20 client.21837 trim_cache size 0 max 16384 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdba809f640 msgr2=0x7fdba80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdba809f640 0x7fdba80a1af0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400b580 tx=0x7fdbb4009f10 comp rx=0 tx=0).stop 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 msgr2=0x7fdbc01a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 0x7fdbc01a4370 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8007d70 tx=0x7fdbb800a340 comp rx=0 tx=0).stop 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 shutdown_connections 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fdba809f640 0x7fdba80a1af0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fdbc01054f0 0x7fdbc01a4370 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc0100be0 0x7fdbc0072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 --2- 172.21.15.35:0/1069317391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc0101580 0x7fdbc00732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 >> 172.21.15.35:0/1069317391 conn(0x7fdbc00774e0 msgr2=0x7fdbc00fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 shutdown_connections 2023-03-17T11:55:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:17.916+0000 7fdbc4b81700 1 -- 172.21.15.35:0/1069317391 wait complete. 2023-03-17T11:55:48.740 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 -- 172.21.15.35:0/3636504944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958410a750 msgr2=0x7f958410cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 --2- 172.21.15.35:0/3636504944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958410a750 0x7f958410cbc0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f957c00b0a0 tx=0x7f957c00b3b0 comp rx=0 tx=0).stop 2023-03-17T11:55:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 -- 172.21.15.35:0/3636504944 shutdown_connections 2023-03-17T11:55:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 --2- 172.21.15.35:0/3636504944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f958410a750 0x7f958410cbc0 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 --2- 172.21.15.35:0/3636504944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9584101410 0x7f95841017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 --2- 172.21.15.35:0/3636504944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9584101d20 0x7f958410a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 -- 172.21.15.35:0/3636504944 >> 172.21.15.35:0/3636504944 conn(0x7f9584076330 msgr2=0x7f9584076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 -- 172.21.15.35:0/3636504944 shutdown_connections 2023-03-17T11:55:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.038+0000 7f958944d700 1 -- 172.21.15.35:0/3636504944 wait complete. 2023-03-17T11:55:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 Processor -- start 2023-03-17T11:55:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 -- start start 2023-03-17T11:55:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9584101410 0x7f95840ff060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 0x7f95840ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958410a750 0x7f95841a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840ffdd0 con 0x7f9584101d20 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841a4a80 con 0x7f9584101410 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f958944d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841a4bc0 con 0x7f958410a750 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 0x7f95840ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 0x7f95840ff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58008/0 (socket says 172.21.15.35:58008) 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f95827fc700 1 -- 172.21.15.35:0/3453444263 learned_addr learned my addr 172.21.15.35:0/3453444263 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.039+0000 7f9582ffd700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9584101410 0x7f95840ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95837fe700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958410a750 0x7f95841a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95827fc700 1 -- 172.21.15.35:0/3453444263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958410a750 msgr2=0x7f95841a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95827fc700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958410a750 0x7f95841a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95827fc700 1 -- 172.21.15.35:0/3453444263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9584101410 msgr2=0x7f95840ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95827fc700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9584101410 0x7f95840ff060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95827fc700 1 -- 172.21.15.35:0/3453444263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009d00 con 0x7f9584101d20 2023-03-17T11:55:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95837fe700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958410a750 0x7f95841a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f95827fc700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 0x7f95840ff5a0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f957400d950 tx=0x7f957400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f956bfff700 1 -- 172.21.15.35:0/3453444263 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574009940 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f956bfff700 1 -- 172.21.15.35:0/3453444263 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9574010460 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95841100a0 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f956bfff700 1 -- 172.21.15.35:0/3453444263 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400f620 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.040+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958410ff10 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.042+0000 7f956bfff700 1 -- 172.21.15.35:0/3453444263 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f95740105d0 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.043+0000 7f956bfff700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956c09f640 0x7f956c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.043+0000 7f9582ffd700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956c09f640 0x7f956c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.043+0000 7f956bfff700 1 -- 172.21.15.35:0/3453444263 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95740ca3d0 con 0x7f9584101d20 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.044+0000 7f9582ffd700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956c09f640 0x7f956c0a1af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9578005950 tx=0x7f957800b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.044+0000 7f95955dab80 1 Processor -- start 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.044+0000 7f95955dab80 1 -- start start 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95955dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561444242be0 0x561444242fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95955dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 0x56144423d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95955dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144423dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95955dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444144010 con 0x5614442434f0 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95955dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444196950 con 0x561444242be0 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95955dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56144418fde0 con 0x56144423d960 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 0x56144423d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 0x56144423d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58016/0 (socket says 172.21.15.35:58016) 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 -- 172.21.15.35:0/3632140098 learned_addr learned my addr 172.21.15.35:0/3632140098 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95837fe700 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144423dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f9582ffd700 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561444242be0 0x561444242fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 -- 172.21.15.35:0/3632140098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 msgr2=0x56144423dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144423dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 -- 172.21.15.35:0/3632140098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561444242be0 msgr2=0x561444242fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561444242be0 0x561444242fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 -- 172.21.15.35:0/3632140098 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614440115d0 con 0x5614442434f0 2023-03-17T11:55:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95827fc700 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 0x56144423d420 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f9574097e10 tx=0x7f95740977e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb8d63c6d11b2c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95697fa700 1 -- 172.21.15.35:0/3632140098 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740b0210 con 0x5614442434f0 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95697fa700 1 -- 172.21.15.35:0/3632140098 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95740a0070 con 0x5614442434f0 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.045+0000 7f95697fa700 1 -- 172.21.15.35:0/3632140098 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957409fbe0 con 0x5614442434f0 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 -- 172.21.15.35:0/3632140098 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 msgr2=0x56144423d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 0x56144423d420 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f9574097e10 tx=0x7f95740977e0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 -- 172.21.15.35:0/3632140098 shutdown_connections 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144423dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561444242be0 0x561444242fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 --2- 172.21.15.35:0/3632140098 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5614442434f0 0x56144423d420 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 -- 172.21.15.35:0/3632140098 >> 172.21.15.35:0/3632140098 conn(0x56144409a6b0 msgr2=0x561444237a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 -- 172.21.15.35:0/3632140098 shutdown_connections 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.046+0000 7f95955dab80 1 -- 172.21.15.35:0/3632140098 wait complete. 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 -- start start 2023-03-17T11:55:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 Processor -- start 2023-03-17T11:55:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56144423d960 0x561444249490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x561444246710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614442434f0 0x561444246db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614440138c0 con 0x561444242be0 2023-03-17T11:55:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444247520 con 0x56144423d960 2023-03-17T11:55:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444253000 con 0x5614442434f0 2023-03-17T11:55:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95955dab80 10 client.0 _ll_register_callbacks cb 0x561444035230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:55:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x561444246710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x561444246710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58022/0 (socket says 172.21.15.35:58022) 2023-03-17T11:55:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 -- 172.21.15.35:0/1240715575 learned_addr learned my addr 172.21.15.35:0/1240715575 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:55:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f9582ffd700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56144423d960 0x561444249490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:55.125 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95837fe700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614442434f0 0x561444246db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 -- 172.21.15.35:0/1240715575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614442434f0 msgr2=0x561444246db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614442434f0 0x561444246db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 -- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56144423d960 msgr2=0x561444249490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56144423d960 0x561444249490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95827fc700 1 -- 172.21.15.35:0/1240715575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958410ff10 con 0x561444242be0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.047+0000 7f95837fe700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614442434f0 0x561444246db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95827fc700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x561444246710 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8160 tx=0x7f9574098310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21865c55723ed67 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f9566ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f9566ff5700 1 -- 172.21.15.35:0/1240715575 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740b0210 con 0x561444242be0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f9566ff5700 1 -- 172.21.15.35:0/1240715575 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9574097580 con 0x561444242be0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561444152390 con 0x561444242be0 2023-03-17T11:55:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f9566ff5700 1 -- 172.21.15.35:0/1240715575 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95740a0070 con 0x561444242be0 2023-03-17T11:55:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 10 client.21849 fetch_fsmap learned FSMap version 110 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561443fbdd80 con 0x561444242be0 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f9566ff5700 1 -- 172.21.15.35:0/1240715575 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9574064030 con 0x561444242be0 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f9566ff5700 1 -- 172.21.15.35:0/1240715575 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f95740c9040 con 0x561444242be0 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 10 client.21849 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 10 client.21849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 20 client.21849 populate_metadata read hostname 'smithi035' 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561444256c90 0x5614442590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 4 client.21849 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.048+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56144415e600 con 0x561444256c90 2023-03-17T11:55:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.049+0000 7f9582ffd700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561444256c90 0x5614442590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:55:55.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:49 smithi035 ceph-mon[92535]: pgmap v5967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:55:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.049+0000 7f9582ffd700 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561444256c90 0x5614442590a0 crc :-1 s=READY pgs=802 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf16aa0c55945e50 server_cookie=599ce086ae3f5e8b in_seq=0 out_seq=0 2023-03-17T11:55:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.049+0000 7f9566ff5700 10 client.21849 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f9566ff5700 1 -- 172.21.15.35:0/1240715575 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56144415e600 con 0x561444256c90 2023-03-17T11:55:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f9566ff5700 10 client.21849 handle_command_reply: tid=0 2023-03-17T11:55:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 client.21849 shutdown 2023-03-17T11:55:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 msgr2=0x561444246710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:55:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x561444246710 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8160 tx=0x7f9574098310 comp rx=0 tx=0).stop 2023-03-17T11:55:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 shutdown_connections 2023-03-17T11:55:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561444256c90 0x5614442590a0 crc :-1 s=READY pgs=802 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614442434f0 0x561444246db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56144423d960 0x561444249490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 --2- 172.21.15.35:0/1240715575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x561444246710 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f9566ff5700 0 client.21849 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 >> 172.21.15.35:0/1240715575 conn(0x56144409a6b0 msgr2=0x56144423c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 shutdown_connections 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 1 -- 172.21.15.35:0/1240715575 wait complete. 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.050+0000 7f95955dab80 20 client.21849 trim_cache size 0 max 16384 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.065+0000 7f95955dab80 1 Processor -- start 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.065+0000 7f95955dab80 1 -- start start 2023-03-17T11:55:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.065+0000 7f95955dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x561444237ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95955dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95955dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144423ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95955dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444238030 con 0x561444242be0 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95955dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444233100 con 0x5614442434f0 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95955dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561444249c50 con 0x56144423d960 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58030/0 (socket says 172.21.15.35:58030) 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 -- 172.21.15.35:0/3148621371 learned_addr learned my addr 172.21.15.35:0/3148621371 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f9582ffd700 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x561444237ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95837fe700 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144423ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 -- 172.21.15.35:0/3148621371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 msgr2=0x561444237ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x561444237ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 -- 172.21.15.35:0/3148621371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 msgr2=0x56144423ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144423ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 -- 172.21.15.35:0/3148621371 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561444156130 con 0x561444242be0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f95827fc700 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424df50 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f957400b2f0 tx=0x7f95740942f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a07f1e2f71cdd9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f9569ffb700 1 -- 172.21.15.35:0/3148621371 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740971b0 con 0x561444242be0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f9569ffb700 1 -- 172.21.15.35:0/3148621371 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9574064040 con 0x561444242be0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.066+0000 7f9569ffb700 1 -- 172.21.15.35:0/3148621371 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957409fbe0 con 0x561444242be0 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 -- 172.21.15.35:0/3148621371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 msgr2=0x56144424df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424df50 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f957400b2f0 tx=0x7f95740942f0 comp rx=0 tx=0).stop 2023-03-17T11:56:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 -- 172.21.15.35:0/3148621371 shutdown_connections 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144423ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x561444237ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 --2- 172.21.15.35:0/3148621371 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424df50 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 -- 172.21.15.35:0/3148621371 >> 172.21.15.35:0/3148621371 conn(0x56144409a6b0 msgr2=0x5614442526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 -- 172.21.15.35:0/3148621371 shutdown_connections 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 -- 172.21.15.35:0/3148621371 wait complete. 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 -- start start 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.067+0000 7f95955dab80 1 Processor -- start 2023-03-17T11:56:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144424d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144424bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56144424c540 con 0x561444242be0 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56144424c6b0 con 0x5614442434f0 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56144424c870 con 0x56144423d960 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95955dab80 10 client.0 _ll_register_callbacks cb 0x561444035230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58036/0 (socket says 172.21.15.35:58036) 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 -- 172.21.15.35:0/1035518684 learned_addr learned my addr 172.21.15.35:0/1035518684 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f9582ffd700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144424d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95837fe700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144424bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 -- 172.21.15.35:0/1035518684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 msgr2=0x56144424d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144424d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 -- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 msgr2=0x56144424bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144424bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 -- 172.21.15.35:0/1035518684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561443fbdd80 con 0x561444242be0 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f95827fc700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424dee0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8160 tx=0x7f957400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53036ca73f987aab server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.068+0000 7f9566ff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f9566ff5700 1 -- 172.21.15.35:0/1035518684 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740a0070 con 0x561444242be0 2023-03-17T11:56:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56144420d1e0 con 0x561444242be0 2023-03-17T11:56:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f9566ff5700 1 -- 172.21.15.35:0/1035518684 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f957409fdf0 con 0x561444242be0 2023-03-17T11:56:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f9566ff5700 1 -- 172.21.15.35:0/1035518684 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95740971b0 con 0x561444242be0 2023-03-17T11:56:02.890 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 10 client.21855 fetch_fsmap learned FSMap version 110 2023-03-17T11:56:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561443fe41f0 con 0x561444242be0 2023-03-17T11:56:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f9566ff5700 1 -- 172.21.15.35:0/1035518684 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56144420d1e0 con 0x561444242be0 2023-03-17T11:56:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f9566ff5700 1 -- 172.21.15.35:0/1035518684 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f95740c9050 con 0x561444242be0 2023-03-17T11:56:02.891 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 10 client.21855 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:56:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 10 client.21855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:56:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 20 client.21855 populate_metadata read hostname 'smithi035' 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5614442ab8b0 0x5614442adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 4 client.21855 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561444013f00 con 0x5614442ab8b0 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.069+0000 7f9582ffd700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5614442ab8b0 0x5614442adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.070+0000 7f9566ff5700 10 client.21855 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.070+0000 7f9582ffd700 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5614442ab8b0 0x5614442adc90 crc :-1 s=READY pgs=803 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a7f1f95d5fac0c server_cookie=34231a6108a5fbd1 in_seq=0 out_seq=0 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.078+0000 7f9566ff5700 1 -- 172.21.15.35:0/1035518684 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561444013f00 con 0x5614442ab8b0 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.078+0000 7f9566ff5700 10 client.21855 handle_command_reply: tid=0 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.078+0000 7f95955dab80 1 client.21855 shutdown 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 msgr2=0x56144424dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424dee0 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f95740c8160 tx=0x7f957400bf90 comp rx=0 tx=0).stop 2023-03-17T11:56:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 shutdown_connections 2023-03-17T11:56:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5614442ab8b0 0x5614442adc90 crc :-1 s=READY pgs=803 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5614442434f0 0x56144424bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f9566ff5700 0 client.21855 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56144423d960 0x56144424d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 --2- 172.21.15.35:0/1035518684 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561444242be0 0x56144424dee0 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 >> 172.21.15.35:0/1035518684 conn(0x56144409a6b0 msgr2=0x561444240650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 shutdown_connections 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 1 -- 172.21.15.35:0/1035518684 wait complete. 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f95955dab80 20 client.21855 trim_cache size 0 max 16384 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956c09f640 msgr2=0x7f956c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956c09f640 0x7f956c0a1af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9578005950 tx=0x7f957800b410 comp rx=0 tx=0).stop 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 msgr2=0x7f95840ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 0x7f95840ff5a0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f957400d950 tx=0x7f957400dc60 comp rx=0 tx=0).stop 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 shutdown_connections 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956c09f640 0x7f956c0a1af0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f958410a750 0x7f95841a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9584101410 0x7f95840ff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 --2- 172.21.15.35:0/3453444263 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f9584101d20 0x7f95840ff5a0 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.079+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 >> 172.21.15.35:0/3453444263 conn(0x7f9584076330 msgr2=0x7f95841021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.080+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 shutdown_connections 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:31.080+0000 7f958944d700 1 -- 172.21.15.35:0/3453444263 wait complete. 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 -- 172.21.15.35:0/4216153933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 msgr2=0x7f99b410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 --2- 172.21.15.35:0/4216153933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b410bf60 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b0d0 tx=0x7f99ac00b3e0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 -- 172.21.15.35:0/4216153933 shutdown_connections 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 --2- 172.21.15.35:0/4216153933 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b410bf60 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 --2- 172.21.15.35:0/4216153933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99b40ff350 0x7f99b40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 --2- 172.21.15.35:0/4216153933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b40ffcf0 0x7f99b4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 -- 172.21.15.35:0/4216153933 >> 172.21.15.35:0/4216153933 conn(0x7f99b4076330 msgr2=0x7f99b4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 -- 172.21.15.35:0/4216153933 shutdown_connections 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.202+0000 7f99b9c83700 1 -- 172.21.15.35:0/4216153933 wait complete. 2023-03-17T11:56:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 Processor -- start 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 -- start start 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99b40ff350 0x7f99b41952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b40ffcf0 0x7f99b4195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b4199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b419a2c0 con 0x7f99b4104390 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b419a430 con 0x7f99b40ffcf0 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b9c83700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b419a5f0 con 0x7f99b40ff350 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b4199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b4199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58052/0 (socket says 172.21.15.35:58052) 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b3fff700 1 -- 172.21.15.35:0/3000793676 learned_addr learned my addr 172.21.15.35:0/3000793676 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.203+0000 7f99b37fe700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99b40ff350 0x7f99b41952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b40ffcf0 0x7f99b4195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b3fff700 1 -- 172.21.15.35:0/3000793676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99b40ff350 msgr2=0x7f99b41952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b3fff700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99b40ff350 0x7f99b41952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b3fff700 1 -- 172.21.15.35:0/3000793676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b40ffcf0 msgr2=0x7f99b4195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b3fff700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b40ffcf0 0x7f99b4195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b3fff700 1 -- 172.21.15.35:0/3000793676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009d00 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b3fff700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b4199c80 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009fd0 tx=0x7f99ac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b0ff9700 1 -- 172.21.15.35:0/3000793676 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00e040 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b0ff9700 1 -- 172.21.15.35:0/3000793676 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99ac0094a0 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b410f010 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b0ff9700 1 -- 172.21.15.35:0/3000793676 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac005040 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.204+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b410ee80 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.206+0000 7f99b0ff9700 1 -- 172.21.15.35:0/3000793676 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f99ac01b450 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.207+0000 7f99b0ff9700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f999c09f640 0x7f999c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.207+0000 7f99b0ff9700 1 -- 172.21.15.35:0/3000793676 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99ac0cb6d0 con 0x7f99b4104390 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.207+0000 7f99b37fe700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f999c09f640 0x7f999c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99b37fe700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f999c09f640 0x7f999c0a1af0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009c60 tx=0x7f99a4009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 Processor -- start 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 -- start start 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d43071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d43120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d43149c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d420d010 con 0x5562d4306de0 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d425f950 con 0x5562d43076f0 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d4258de0 con 0x5562d43125e0 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d43071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d43071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58056/0 (socket says 172.21.15.35:58056) 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.208+0000 7f99b37fe700 1 -- 172.21.15.35:0/130756391 learned_addr learned my addr 172.21.15.35:0/130756391 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f99b37fe700 1 -- 172.21.15.35:0/130756391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 msgr2=0x5562d43149c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f99b37fe700 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d43149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:06.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:51 smithi035 ceph-mon[92535]: pgmap v5968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:56:06.275 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:53 smithi035 ceph-mon[92535]: pgmap v5969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:56:06.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:55 smithi035 ceph-mon[92535]: pgmap v5970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:56:06.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:46:58 smithi035 ceph-mon[92535]: pgmap v5971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:56:06.276 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:00 smithi035 ceph-mon[92535]: pgmap v5972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:56:08.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:02 smithi035 ceph-mon[92535]: pgmap v5973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:56:08.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:04 smithi035 ceph-mon[92535]: pgmap v5974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:56:08.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:56:08.726 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:06 smithi035 ceph-mon[92535]: pgmap v5975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-03-17T11:56:08.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:56:08.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:56:08.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:06 smithi035 ceph-mon[92535]: pgmap v5976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T11:56:08.727 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:06 smithi035 ceph-mon[92535]: pgmap v5977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:08 smithi035 ceph-mon[92535]: pgmap v5978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:10 smithi035 ceph-mon[92535]: pgmap v5979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:10 smithi035 ceph-mon[92535]: osdmap e441: 12 total, 12 up, 12 in 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:11 smithi035 ceph-mon[92535]: pgmap v5981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:13 smithi035 ceph-mon[92535]: pgmap v5982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:16 smithi035 ceph-mon[92535]: pgmap v5983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:56:08.728 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:18 smithi035 ceph-mon[92535]: pgmap v5984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:56:08.729 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:18 smithi035 ceph-mon[92535]: osdmap e442: 12 total, 12 up, 12 in 2023-03-17T11:56:08.729 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:19 smithi035 ceph-mon[92535]: pgmap v5986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T11:56:08.729 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:22 smithi035 ceph-mon[92535]: pgmap v5987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:56:08.729 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:23 smithi035 ceph-mon[92535]: pgmap v5988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:56:08.729 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:26 smithi035 ceph-mon[92535]: pgmap v5989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:56:09.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:27 smithi035 ceph-mon[92535]: pgmap v5990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T11:56:09.773 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:30 smithi035 ceph-mon[92535]: pgmap v5991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T11:56:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f99b37fe700 1 -- 172.21.15.35:0/130756391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 msgr2=0x5562d43120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:11.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f99b37fe700 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d43120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:11.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f99b37fe700 1 -- 172.21.15.35:0/130756391 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d40da5d0 con 0x5562d4306de0 2023-03-17T11:56:11.222 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f99b37fe700 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d43071b0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f99a400e4e0 tx=0x7f99a4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4ac18f62a9b8e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f9999ffb700 1 -- 172.21.15.35:0/130756391 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4026430 con 0x5562d4306de0 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f9999ffb700 1 -- 172.21.15.35:0/130756391 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99a4021070 con 0x5562d4306de0 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.209+0000 7f9999ffb700 1 -- 172.21.15.35:0/130756391 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a401d610 con 0x5562d4306de0 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 -- 172.21.15.35:0/130756391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 msgr2=0x5562d43071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d43071b0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f99a400e4e0 tx=0x7f99a4014000 comp rx=0 tx=0).stop 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 -- 172.21.15.35:0/130756391 shutdown_connections 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d43149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d43071b0 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/130756391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d43120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 -- 172.21.15.35:0/130756391 >> 172.21.15.35:0/130756391 conn(0x5562d41636b0 msgr2=0x5562d43038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 -- 172.21.15.35:0/130756391 shutdown_connections 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 -- 172.21.15.35:0/130756391 wait complete. 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 -- start start 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.210+0000 7f99c5e10b80 1 Processor -- start 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d430f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43076f0 0x5562d430f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d430feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d40dc8c0 con 0x5562d4306de0 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d431e210 con 0x5562d43125e0 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d431e350 con 0x5562d43076f0 2023-03-17T11:56:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99c5e10b80 10 client.0 _ll_register_callbacks cb 0x5562d40fe230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d430f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d430f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58062/0 (socket says 172.21.15.35:58062) 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 -- 172.21.15.35:0/2451397584 learned_addr learned my addr 172.21.15.35:0/2451397584 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43076f0 0x5562d430f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b3fff700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d430feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 -- 172.21.15.35:0/2451397584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43076f0 msgr2=0x5562d430f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43076f0 0x5562d430f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 -- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 msgr2=0x5562d430feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d430feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 -- 172.21.15.35:0/2451397584 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a4017070 con 0x5562d4306de0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f99b37fe700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d430f430 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009340 tx=0x7f99a401cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57caac5416c62cee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f9992ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f9992ffd700 1 -- 172.21.15.35:0/2451397584 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4005250 con 0x5562d4306de0 2023-03-17T11:56:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.211+0000 7f9992ffd700 1 -- 172.21.15.35:0/2451397584 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99a40053b0 con 0x5562d4306de0 2023-03-17T11:56:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562d421b390 con 0x5562d4306de0 2023-03-17T11:56:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f9992ffd700 1 -- 172.21.15.35:0/2451397584 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99a40055b0 con 0x5562d4306de0 2023-03-17T11:56:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 10 client.21867 fetch_fsmap learned FSMap version 110 2023-03-17T11:56:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5562d4086d80 con 0x5562d4306de0 2023-03-17T11:56:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f9992ffd700 1 -- 172.21.15.35:0/2451397584 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562d421b390 con 0x5562d4306de0 2023-03-17T11:56:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f9992ffd700 1 -- 172.21.15.35:0/2451397584 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f99a4003840 con 0x5562d4306de0 2023-03-17T11:56:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 10 client.21867 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:56:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 10 client.21867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:56:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 20 client.21867 populate_metadata read hostname 'smithi035' 2023-03-17T11:56:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4324760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 4 client.21867 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:56:15.333 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562d4227600 con 0x5562d4322350 2023-03-17T11:56:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.212+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4324760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.213+0000 7f9992ffd700 10 client.21867 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.213+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4324760 crc :-1 s=READY pgs=804 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5bf90ba3093b57 server_cookie=823859f2fa53aa5c in_seq=0 out_seq=0 2023-03-17T11:56:15.334 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.213+0000 7f9992ffd700 1 -- 172.21.15.35:0/2451397584 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5562d4227600 con 0x5562d4322350 2023-03-17T11:56:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.213+0000 7f9992ffd700 10 client.21867 handle_command_reply: tid=0 2023-03-17T11:56:16.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.213+0000 7f99c5e10b80 1 client.21867 shutdown 2023-03-17T11:56:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 msgr2=0x5562d430f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d430f430 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009340 tx=0x7f99a401cfb0 comp rx=0 tx=0).stop 2023-03-17T11:56:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 shutdown_connections 2023-03-17T11:56:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4324760 crc :-1 s=READY pgs=804 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d430feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d430f430 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f9992ffd700 0 client.21867 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2451397584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43076f0 0x5562d430f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 >> 172.21.15.35:0/2451397584 conn(0x5562d41636b0 msgr2=0x5562d4308ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 shutdown_connections 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2451397584 wait complete. 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.214+0000 7f99c5e10b80 20 client.21867 trim_cache size 0 max 16384 2023-03-17T11:56:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 Processor -- start 2023-03-17T11:56:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 -- start start 2023-03-17T11:56:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d4306de0 0x5562d4319160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 0x5562d430fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d42ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d42fc0f0 con 0x5562d43076f0 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d42fd5c0 con 0x5562d43125e0 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d4304910 con 0x5562d4306de0 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99b2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 0x5562d430fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99b2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 0x5562d430fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58072/0 (socket says 172.21.15.35:58072) 2023-03-17T11:56:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99b2ffd700 1 -- 172.21.15.35:0/2141489551 learned_addr learned my addr 172.21.15.35:0/2141489551 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99b3fff700 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d42ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99b37fe700 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d4306de0 0x5562d4319160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.229+0000 7f99b2ffd700 1 -- 172.21.15.35:0/2141489551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d4306de0 msgr2=0x5562d4319160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d4306de0 0x5562d4319160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99b2ffd700 1 -- 172.21.15.35:0/2141489551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 msgr2=0x5562d42ffab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d42ffab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99b2ffd700 1 -- 172.21.15.35:0/2141489551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d421f130 con 0x5562d43076f0 2023-03-17T11:56:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99b37fe700 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d4306de0 0x5562d4319160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:56:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 0x5562d430fce0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f99b406a350 tx=0x7f99a8004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b696b217e8708d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f999a7fc700 1 -- 172.21.15.35:0/2141489551 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8016040 con 0x5562d43076f0 2023-03-17T11:56:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f999a7fc700 1 -- 172.21.15.35:0/2141489551 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99a801b5a0 con 0x5562d43076f0 2023-03-17T11:56:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f999a7fc700 1 -- 172.21.15.35:0/2141489551 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8010690 con 0x5562d43076f0 2023-03-17T11:56:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2141489551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 msgr2=0x5562d430fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:20.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 0x5562d430fce0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f99b406a350 tx=0x7f99a8004320 comp rx=0 tx=0).stop 2023-03-17T11:56:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2141489551 shutdown_connections 2023-03-17T11:56:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43125e0 0x5562d42ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d4306de0 0x5562d4319160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/2141489551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d43076f0 0x5562d430fce0 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.230+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2141489551 >> 172.21.15.35:0/2141489551 conn(0x5562d41636b0 msgr2=0x5562d4303400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2141489551 shutdown_connections 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 -- 172.21.15.35:0/2141489551 wait complete. 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 -- start start 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 Processor -- start 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d4318e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:22.542 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d4319390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:22.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d4317340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:22.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d4317a10 con 0x5562d4306de0 2023-03-17T11:56:22.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d4317b80 con 0x5562d43076f0 2023-03-17T11:56:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d4317d40 con 0x5562d43125e0 2023-03-17T11:56:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99c5e10b80 10 client.0 _ll_register_callbacks cb 0x5562d40fe230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:56:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d4318e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99b37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d4318e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58076/0 (socket says 172.21.15.35:58076) 2023-03-17T11:56:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.231+0000 7f99b37fe700 1 -- 172.21.15.35:0/3922533948 learned_addr learned my addr 172.21.15.35:0/3922533948 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b3fff700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d4317340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d4319390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b37fe700 1 -- 172.21.15.35:0/3922533948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 msgr2=0x5562d4317340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b37fe700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d4317340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b37fe700 1 -- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 msgr2=0x5562d4319390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b37fe700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d4319390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b37fe700 1 -- 172.21.15.35:0/3922533948 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a8009d30 con 0x5562d4306de0 2023-03-17T11:56:24.086 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d4319390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:56:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99b37fe700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d4318e50 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f99a4016040 tx=0x7f99a4009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ad468cbb329cb9 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f9992ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:56:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f9992ffd700 1 -- 172.21.15.35:0/3922533948 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4005250 con 0x5562d4306de0 2023-03-17T11:56:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f9992ffd700 1 -- 172.21.15.35:0/3922533948 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f99a40053b0 con 0x5562d4306de0 2023-03-17T11:56:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562d42d61e0 con 0x5562d4306de0 2023-03-17T11:56:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f9992ffd700 1 -- 172.21.15.35:0/3922533948 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99a4005570 con 0x5562d4306de0 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99c5e10b80 10 client.21873 fetch_fsmap learned FSMap version 110 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5562d40ad1f0 con 0x5562d4306de0 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.232+0000 7f9992ffd700 1 -- 172.21.15.35:0/3922533948 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99a4045080 con 0x5562d4306de0 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f9992ffd700 1 -- 172.21.15.35:0/3922533948 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f99a4026740 con 0x5562d4306de0 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99c5e10b80 10 client.21873 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99c5e10b80 10 client.21873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99c5e10b80 20 client.21873 populate_metadata read hostname 'smithi035' 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4379150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99c5e10b80 4 client.21873 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5562d40dcf00 con 0x5562d4322350 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4379150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f99b2ffd700 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4379150 crc :-1 s=READY pgs=805 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee9ac55babbea5d5 server_cookie=1fd07fd463af1336 in_seq=0 out_seq=0 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.233+0000 7f9992ffd700 10 client.21873 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f9992ffd700 1 -- 172.21.15.35:0/3922533948 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5562d40dcf00 con 0x5562d4322350 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f9992ffd700 10 client.21873 handle_command_reply: tid=0 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 client.21873 shutdown 2023-03-17T11:56:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 msgr2=0x5562d4318e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d4318e50 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f99a4016040 tx=0x7f99a4009370 comp rx=0 tx=0).stop 2023-03-17T11:56:28.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 shutdown_connections 2023-03-17T11:56:28.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5562d4322350 0x5562d4379150 crc :-1 s=READY pgs=805 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:28.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562d43125e0 0x5562d4317340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:28.620 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5562d4306de0 0x5562d4318e50 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 --2- 172.21.15.35:0/3922533948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562d43076f0 0x5562d4319390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 >> 172.21.15.35:0/3922533948 conn(0x5562d41636b0 msgr2=0x5562d42ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f9992ffd700 0 client.21873 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 shutdown_connections 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 1 -- 172.21.15.35:0/3922533948 wait complete. 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.242+0000 7f99c5e10b80 20 client.21873 trim_cache size 0 max 16384 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f999c09f640 msgr2=0x7f999c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f999c09f640 0x7f999c0a1af0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009c60 tx=0x7f99a4009260 comp rx=0 tx=0).stop 2023-03-17T11:56:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 msgr2=0x7f99b4199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b4199c80 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009fd0 tx=0x7f99ac00cce0 comp rx=0 tx=0).stop 2023-03-17T11:56:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 shutdown_connections 2023-03-17T11:56:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f999c09f640 0x7f999c0a1af0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f99b4104390 0x7f99b4199c80 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99b40ff350 0x7f99b41952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 --2- 172.21.15.35:0/3000793676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99b40ffcf0 0x7f99b4195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:31.876 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:31 smithi035 ceph-mon[92535]: pgmap v5992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:56:31.876 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 >> 172.21.15.35:0/3000793676 conn(0x7f99b4076330 msgr2=0x7f99b40fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 shutdown_connections 2023-03-17T11:56:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:44.243+0000 7f99b9c83700 1 -- 172.21.15.35:0/3000793676 wait complete. 2023-03-17T11:56:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 -- 172.21.15.35:0/2207874934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 msgr2=0x7f7cfc10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 --2- 172.21.15.35:0/2207874934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc10bf60 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400b0d0 tx=0x7f7cf400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 -- 172.21.15.35:0/2207874934 shutdown_connections 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 --2- 172.21.15.35:0/2207874934 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc10bf60 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 --2- 172.21.15.35:0/2207874934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cfc0ff350 0x7f7cfc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 --2- 172.21.15.35:0/2207874934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cfc0ffcf0 0x7f7cfc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 -- 172.21.15.35:0/2207874934 >> 172.21.15.35:0/2207874934 conn(0x7f7cfc076330 msgr2=0x7f7cfc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.364+0000 7f7d032a9700 1 -- 172.21.15.35:0/2207874934 shutdown_connections 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 -- 172.21.15.35:0/2207874934 wait complete. 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 Processor -- start 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 -- start start 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cfc0ff350 0x7f7cfc196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cfc0ffcf0 0x7f7cfc196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc19b300 con 0x7f7cfc104390 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc19b470 con 0x7f7cfc0ff350 2023-03-17T11:56:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d032a9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc19b630 con 0x7f7cfc0ffcf0 2023-03-17T11:56:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.365+0000 7f7d01846700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc19acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58094/0 (socket says 172.21.15.35:58094) 2023-03-17T11:56:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 -- 172.21.15.35:0/3349535863 learned_addr learned my addr 172.21.15.35:0/3349535863 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d00844700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cfc0ffcf0 0x7f7cfc196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01045700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cfc0ff350 0x7f7cfc196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 -- 172.21.15.35:0/3349535863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cfc0ffcf0 msgr2=0x7f7cfc196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cfc0ffcf0 0x7f7cfc196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 -- 172.21.15.35:0/3349535863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cfc0ff350 msgr2=0x7f7cfc196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cfc0ff350 0x7f7cfc196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 -- 172.21.15.35:0/3349535863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4009d00 con 0x7f7cfc104390 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d01846700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc19acc0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009380 tx=0x7f7cf40093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7cf27fc700 1 -- 172.21.15.35:0/3349535863 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400e040 con 0x7f7cfc104390 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc10f010 con 0x7f7cfc104390 2023-03-17T11:56:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7cf27fc700 1 -- 172.21.15.35:0/3349535863 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cf4003e10 con 0x7f7cfc104390 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7cf27fc700 1 -- 172.21.15.35:0/3349535863 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf401ba00 con 0x7f7cfc104390 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.366+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc10ee80 con 0x7f7cfc104390 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.368+0000 7f7cf27fc700 1 -- 172.21.15.35:0/3349535863 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7cf4024410 con 0x7f7cfc104390 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.369+0000 7f7cf27fc700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7ce809f640 0x7f7ce80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.369+0000 7f7cf27fc700 1 -- 172.21.15.35:0/3349535863 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cf40cbdb0 con 0x7f7cfc104390 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.369+0000 7f7d01045700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7ce809f640 0x7f7ce80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.370+0000 7f7d01045700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7ce809f640 0x7f7ce80a1af0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8005950 tx=0x7f7cf80058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.370+0000 7f7d0f436b80 1 Processor -- start 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.370+0000 7f7d0f436b80 1 -- start start 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bdefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bd9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8ae0010 con 0x5629d8bdebe0 2023-03-17T11:56:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8b32950 con 0x5629d8bd9960 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8b2bde0 con 0x5629d8bdf4f0 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d01045700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bdefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d01045700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bdefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58098/0 (socket says 172.21.15.35:58098) 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bd9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d01045700 1 -- 172.21.15.35:0/190701186 learned_addr learned my addr 172.21.15.35:0/190701186 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d01846700 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 -- 172.21.15.35:0/190701186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 msgr2=0x5629d8bd9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 -- 172.21.15.35:0/190701186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 msgr2=0x5629d8bdefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bdefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 -- 172.21.15.35:0/190701186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629d89ad5d0 con 0x5629d8bdf4f0 2023-03-17T11:56:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d01045700 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bdefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:56:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d01846700 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:56:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.371+0000 7f7d00844700 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bd9420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7cec005950 tx=0x7f7cec00bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d57244e12caae4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7ce77fe700 1 -- 172.21.15.35:0/190701186 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec010c10 con 0x5629d8bdf4f0 2023-03-17T11:56:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7ce77fe700 1 -- 172.21.15.35:0/190701186 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cec015070 con 0x5629d8bdf4f0 2023-03-17T11:56:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7ce77fe700 1 -- 172.21.15.35:0/190701186 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec004dc0 con 0x5629d8bdf4f0 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 -- 172.21.15.35:0/190701186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 msgr2=0x5629d8bd9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bd9420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7cec005950 tx=0x7f7cec00bee0 comp rx=0 tx=0).stop 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 -- 172.21.15.35:0/190701186 shutdown_connections 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bdefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/190701186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bd9420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 -- 172.21.15.35:0/190701186 >> 172.21.15.35:0/190701186 conn(0x5629d8a366b0 msgr2=0x5629d8bd3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 -- 172.21.15.35:0/190701186 shutdown_connections 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.372+0000 7f7d0f436b80 1 -- 172.21.15.35:0/190701186 wait complete. 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.373+0000 7f7d0f436b80 1 -- start start 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.373+0000 7f7d0f436b80 1 Processor -- start 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bd9960 0x5629d8be5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bdebe0 0x5629d8be2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 0x5629d8be2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d89af8c0 con 0x5629d8bdf4f0 2023-03-17T11:56:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8be34a0 con 0x5629d8bdebe0 2023-03-17T11:56:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8bef000 con 0x5629d8bd9960 2023-03-17T11:56:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 10 client.0 _ll_register_callbacks cb 0x5629d89d1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:56:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 0x5629d8be2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01045700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bd9960 0x5629d8be5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 0x5629d8be2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58108/0 (socket says 172.21.15.35:58108) 2023-03-17T11:56:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 -- 172.21.15.35:0/3391508731 learned_addr learned my addr 172.21.15.35:0/3391508731 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01045700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bd9960 0x5629d8be5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:49870/0 (socket says 172.21.15.35:49870) 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d00844700 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bdebe0 0x5629d8be2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 -- 172.21.15.35:0/3391508731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bd9960 msgr2=0x5629d8be5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bd9960 0x5629d8be5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 -- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bdebe0 msgr2=0x5629d8be2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bdebe0 0x5629d8be2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 -- 172.21.15.35:0/3391508731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec00b860 con 0x5629d8bdf4f0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d01846700 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 0x5629d8be2d30 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4099590 tx=0x7f7cf4099270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8861a35462cfcb5d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7ce4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/3391508731 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40a19f0 con 0x5629d8bdf4f0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/3391508731 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cf4098d80 con 0x5629d8bdf4f0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.374+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629d8aee390 con 0x5629d8bdf4f0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/3391508731 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cf4098f40 con 0x5629d8bdf4f0 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 10 client.21885 fetch_fsmap learned FSMap version 110 2023-03-17T11:56:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5629d8959d80 con 0x5629d8bdf4f0 2023-03-17T11:56:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/3391508731 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cf40b5020 con 0x5629d8bdf4f0 2023-03-17T11:56:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/3391508731 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7cf4095710 con 0x5629d8bdf4f0 2023-03-17T11:56:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 10 client.21885 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:56:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 10 client.21885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:56:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 20 client.21885 populate_metadata read hostname 'smithi035' 2023-03-17T11:56:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8bf2e30 0x5629d8bf5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 4 client.21885 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:56:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629d8afa600 con 0x5629d8bf2e30 2023-03-17T11:56:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.375+0000 7f7d01045700 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8bf2e30 0x5629d8bf5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7ce4ff9700 10 client.21885 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7d01045700 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8bf2e30 0x5629d8bf5240 crc :-1 s=READY pgs=806 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a675e62572dc6f47 server_cookie=a6ec7e74c514e396 in_seq=0 out_seq=0 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/3391508731 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5629d8afa600 con 0x5629d8bf2e30 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7ce4ff9700 10 client.21885 handle_command_reply: tid=0 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7d0f436b80 1 client.21885 shutdown 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 msgr2=0x5629d8be2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 0x5629d8be2d30 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4099590 tx=0x7f7cf4099270 comp rx=0 tx=0).stop 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.376+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 shutdown_connections 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8bf2e30 0x5629d8bf5240 crc :-1 s=READY pgs=806 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdf4f0 0x5629d8be2d30 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bd9960 0x5629d8be5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7ce4ff9700 0 client.21885 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/3391508731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bdebe0 0x5629d8be2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 >> 172.21.15.35:0/3391508731 conn(0x5629d8a366b0 msgr2=0x5629d8bd8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 shutdown_connections 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 1 -- 172.21.15.35:0/3391508731 wait complete. 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.377+0000 7f7d0f436b80 20 client.21885 trim_cache size 0 max 16384 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.391+0000 7f7d0f436b80 1 Processor -- start 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 -- start start 2023-03-17T11:56:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8be9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8bd0b60 con 0x5629d8bdebe0 2023-03-17T11:56:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8bd8a90 con 0x5629d8bd9960 2023-03-17T11:56:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8bd4000 con 0x5629d8bdf4f0 2023-03-17T11:56:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8be9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8be9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58114/0 (socket says 172.21.15.35:58114) 2023-03-17T11:56:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 -- 172.21.15.35:0/2320234637 learned_addr learned my addr 172.21.15.35:0/2320234637 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d01045700 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d01846700 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 -- 172.21.15.35:0/2320234637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 msgr2=0x5629d8bee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 -- 172.21.15.35:0/2320234637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 msgr2=0x5629d8bd3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 -- 172.21.15.35:0/2320234637 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629d8bda040 con 0x5629d8bdebe0 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7d00844700 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8be9f50 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x5629d8bd46a0 tx=0x7f7cec010ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ed75402da5a968 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7ce7fff700 1 -- 172.21.15.35:0/2320234637 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec020040 con 0x5629d8bdebe0 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.392+0000 7f7ce7fff700 1 -- 172.21.15.35:0/2320234637 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cec015050 con 0x5629d8bdebe0 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7ce7fff700 1 -- 172.21.15.35:0/2320234637 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec004d00 con 0x5629d8bdebe0 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 -- 172.21.15.35:0/2320234637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 msgr2=0x5629d8be9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8be9f50 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x5629d8bd46a0 tx=0x7f7cec010ac0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 -- 172.21.15.35:0/2320234637 shutdown_connections 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8bee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bd3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/2320234637 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8be9f50 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 -- 172.21.15.35:0/2320234637 >> 172.21.15.35:0/2320234637 conn(0x5629d8a366b0 msgr2=0x5629d8be5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:44.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 -- 172.21.15.35:0/2320234637 shutdown_connections 2023-03-17T11:56:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 -- 172.21.15.35:0/2320234637 wait complete. 2023-03-17T11:56:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.393+0000 7f7d0f436b80 1 -- start start 2023-03-17T11:56:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 Processor -- start 2023-03-17T11:56:44.775 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bfec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:44.776 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:33 smithi035 ceph-mon[92535]: pgmap v5993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8c02db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8bff940 con 0x5629d8bdebe0 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8c032f0 con 0x5629d8bd9960 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629d8c03460 con 0x5629d8bdf4f0 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d0f436b80 10 client.0 _ll_register_callbacks cb 0x5629d89d1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58120/0 (socket says 172.21.15.35:58120) 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 -- 172.21.15.35:0/1889756523 learned_addr learned my addr 172.21.15.35:0/1889756523 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d01045700 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bfec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 -- 172.21.15.35:0/1889756523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 msgr2=0x5629d8c02db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8c02db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.777 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 -- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 msgr2=0x5629d8bfec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.394+0000 7f7d00844700 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bfec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d00844700 1 -- 172.21.15.35:0/1889756523 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629d89ad5d0 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d00844700 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bff1b0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00bb50 tx=0x7f7cec0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12d6737f2f6900 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7ce4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/1889756523 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec020030 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/1889756523 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(414..414 src has 1..414) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7cec017070 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629d8ba91e0 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/1889756523 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cec004590 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 10 client.21891 fetch_fsmap learned FSMap version 110 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5629d8942c00 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/1889756523 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cec03e020 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/1889756523 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7cec03a770 con 0x5629d8bdebe0 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 10 client.21891 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 10 client.21891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 20 client.21891 populate_metadata read hostname 'smithi035' 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8c47ea0 0x5629d8c4a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:44.778 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 4 client.21891 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:56:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.395+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5629d89aff00 con 0x5629d8c47ea0 2023-03-17T11:56:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.396+0000 7f7d01045700 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8c47ea0 0x5629d8c4a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.396+0000 7f7ce4ff9700 10 client.21891 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:44.779 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.396+0000 7f7d01045700 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8c47ea0 0x5629d8c4a2b0 crc :-1 s=READY pgs=807 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c07559f9af06120 server_cookie=79b49082142610a9 in_seq=0 out_seq=0 2023-03-17T11:56:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7ce4ff9700 1 -- 172.21.15.35:0/1889756523 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5629d89aff00 con 0x5629d8c47ea0 2023-03-17T11:56:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7ce4ff9700 10 client.21891 handle_command_reply: tid=0 2023-03-17T11:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 client.21891 shutdown 2023-03-17T11:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 msgr2=0x5629d8bff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bff1b0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00bb50 tx=0x7f7cec0047f0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 shutdown_connections 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5629d8c47ea0 0x5629d8c4a2b0 crc :-1 s=READY pgs=807 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629d8bdf4f0 0x5629d8c02db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7ce4ff9700 0 client.21891 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5629d8bd9960 0x5629d8bfec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 --2- 172.21.15.35:0/1889756523 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5629d8bdebe0 0x5629d8bff1b0 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 >> 172.21.15.35:0/1889756523 conn(0x5629d8a366b0 msgr2=0x5629d8bee6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 shutdown_connections 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 1 -- 172.21.15.35:0/1889756523 wait complete. 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.405+0000 7f7d0f436b80 20 client.21891 trim_cache size 0 max 16384 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7ce809f640 msgr2=0x7f7ce80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7ce809f640 0x7f7ce80a1af0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8005950 tx=0x7f7cf80058e0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 msgr2=0x7f7cfc19acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc19acc0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009380 tx=0x7f7cf40093b0 comp rx=0 tx=0).stop 2023-03-17T11:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 shutdown_connections 2023-03-17T11:56:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f7ce809f640 0x7f7ce80a1af0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f7cfc104390 0x7f7cfc19acc0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cfc0ff350 0x7f7cfc196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 --2- 172.21.15.35:0/3349535863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cfc0ffcf0 0x7f7cfc196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 >> 172.21.15.35:0/3349535863 conn(0x7f7cfc076330 msgr2=0x7f7cfc102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 shutdown_connections 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:33:57.406+0000 7f7d032a9700 1 -- 172.21.15.35:0/3349535863 wait complete. 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 -- 172.21.15.35:0/476690078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf68101580 msgr2=0x7faf68104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 --2- 172.21.15.35:0/476690078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf68101580 0x7faf68104e10 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7faf640099c0 tx=0x7faf64009cd0 comp rx=0 tx=0).stop 2023-03-17T11:56:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 -- 172.21.15.35:0/476690078 shutdown_connections 2023-03-17T11:56:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 --2- 172.21.15.35:0/476690078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf681054f0 0x7faf6810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 --2- 172.21.15.35:0/476690078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf68100be0 0x7faf68100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 --2- 172.21.15.35:0/476690078 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf68101580 0x7faf68104e10 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 -- 172.21.15.35:0/476690078 >> 172.21.15.35:0/476690078 conn(0x7faf680774e0 msgr2=0x7faf680778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:56:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 -- 172.21.15.35:0/476690078 shutdown_connections 2023-03-17T11:56:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.011+0000 7faf7010f700 1 -- 172.21.15.35:0/476690078 wait complete. 2023-03-17T11:56:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 Processor -- start 2023-03-17T11:56:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 -- start start 2023-03-17T11:56:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf68100be0 0x7faf68072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf68101580 0x7faf680732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 0x7faf681a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68073af0 con 0x7faf681054f0 2023-03-17T11:56:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681a4aa0 con 0x7faf68100be0 2023-03-17T11:56:50.604 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf7010f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681a4be0 con 0x7faf68101580 2023-03-17T11:56:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf6e6ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 0x7faf681a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf6e6ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 0x7faf681a4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58136/0 (socket says 172.21.15.35:58136) 2023-03-17T11:56:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf6e6ac700 1 -- 172.21.15.35:0/4222689235 learned_addr learned my addr 172.21.15.35:0/4222689235 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf68101580 0x7faf680732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.012+0000 7faf6deab700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf68100be0 0x7faf68072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf6e6ac700 1 -- 172.21.15.35:0/4222689235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf68101580 msgr2=0x7faf680732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf68101580 0x7faf680732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf6e6ac700 1 -- 172.21.15.35:0/4222689235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf68100be0 msgr2=0x7faf68072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:56:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf68100be0 0x7faf68072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf6e6ac700 1 -- 172.21.15.35:0/4222689235 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640095f0 con 0x7faf681054f0 2023-03-17T11:56:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 0x7faf681a4560 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7faf60007ee0 tx=0x7faf6000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf5affd700 1 -- 172.21.15.35:0/4222689235 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60017070 con 0x7faf681054f0 2023-03-17T11:56:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf5affd700 1 -- 172.21.15.35:0/4222689235 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf6000f040 con 0x7faf681054f0 2023-03-17T11:56:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf681101b0 con 0x7faf681054f0 2023-03-17T11:56:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf5affd700 1 -- 172.21.15.35:0/4222689235 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60005570 con 0x7faf681054f0 2023-03-17T11:56:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.013+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf68110020 con 0x7faf681054f0 2023-03-17T11:56:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.015+0000 7faf5affd700 1 -- 172.21.15.35:0/4222689235 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7faf6000db20 con 0x7faf681054f0 2023-03-17T11:56:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.016+0000 7faf5affd700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf5409f640 0x7faf540a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.016+0000 7faf5affd700 1 -- 172.21.15.35:0/4222689235 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(416..416 src has 1..416) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faf600c9d80 con 0x7faf681054f0 2023-03-17T11:56:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.016+0000 7faf6deab700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf5409f640 0x7faf540a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf6deab700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf5409f640 0x7faf540a1af0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005950 tx=0x7faf5c00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:56:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 Processor -- start 2023-03-17T11:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 -- start start 2023-03-17T11:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2e2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:56:55.126 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f1e9010 con 0x55a23f2e84f0 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f23b950 con 0x55a23f2e7be0 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f234de0 con 0x55a23f2e2960 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf6d6aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf6d6aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2e2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58142/0 (socket says 172.21.15.35:58142) 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.017+0000 7faf6d6aa700 1 -- 172.21.15.35:0/601808617 learned_addr learned my addr 172.21.15.35:0/601808617 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6deab700 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:56:55.788 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6d6aa700 1 -- 172.21.15.35:0/601808617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 msgr2=0x55a23f2e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2e2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6d6aa700 1 -- 172.21.15.35:0/601808617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 msgr2=0x55a23f2e7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:56:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2e7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:56:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6d6aa700 1 -- 172.21.15.35:0/601808617 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a23f0b65d0 con 0x55a23f2e84f0 2023-03-17T11:56:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2e2420 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7faf640099c0 tx=0x7faf64009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc12e446084cb6c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf53fff700 1 -- 172.21.15.35:0/601808617 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6401d070 con 0x55a23f2e84f0 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf53fff700 1 -- 172.21.15.35:0/601808617 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf6401e040 con 0x55a23f2e84f0 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.018+0000 7faf53fff700 1 -- 172.21.15.35:0/601808617 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64004500 con 0x55a23f2e84f0 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 -- 172.21.15.35:0/601808617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 msgr2=0x55a23f2e2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2e2420 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7faf640099c0 tx=0x7faf64009f10 comp rx=0 tx=0).stop 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 -- 172.21.15.35:0/601808617 shutdown_connections 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2e7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/601808617 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2e2420 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 -- 172.21.15.35:0/601808617 >> 172.21.15.35:0/601808617 conn(0x55a23f13f6b0 msgr2=0x55a23f2dca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 -- 172.21.15.35:0/601808617 shutdown_connections 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 -- 172.21.15.35:0/601808617 wait complete. 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 -- start start 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.019+0000 7faf7c29cb80 1 Processor -- start 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f0b88c0 con 0x55a23f2e84f0 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f2ec460 con 0x55a23f2e7be0 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f2f7fa0 con 0x55a23f2e2960 2023-03-17T11:57:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf7c29cb80 10 client.0 _ll_register_callbacks cb 0x55a23f0da230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:57:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2ebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58150/0 (socket says 172.21.15.35:58150) 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 -- 172.21.15.35:0/2416269506 learned_addr learned my addr 172.21.15.35:0/2416269506 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6deab700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 -- 172.21.15.35:0/2416269506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 msgr2=0x55a23f2ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 -- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 msgr2=0x55a23f2eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2eb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.020+0000 7faf6e6ac700 1 -- 172.21.15.35:0/2416269506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6810d940 con 0x55a23f2e84f0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2ebcf0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7faf600c7510 tx=0x7faf60004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9fdd254a6181ec server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf517fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf517fa700 1 -- 172.21.15.35:0/2416269506 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60004c40 con 0x55a23f2e84f0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf517fa700 1 -- 172.21.15.35:0/2416269506 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(416..416 src has 1..416) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faf6000ddd0 con 0x55a23f2e84f0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a23f1f7390 con 0x55a23f2e84f0 2023-03-17T11:57:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf517fa700 1 -- 172.21.15.35:0/2416269506 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf600977d0 con 0x55a23f2e84f0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 10 client.21903 fetch_fsmap learned FSMap version 110 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55a23f062d80 con 0x55a23f2e84f0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf517fa700 1 -- 172.21.15.35:0/2416269506 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf600b3020 con 0x55a23f2e84f0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf517fa700 1 -- 172.21.15.35:0/2416269506 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7faf6009f530 con 0x55a23f2e84f0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 10 client.21903 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 10 client.21903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 20 client.21903 populate_metadata read hostname 'smithi035' 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f2fc050 0x55a23f2fe460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 4 client.21903 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.021+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a23f203600 con 0x55a23f2fc050 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.022+0000 7faf6deab700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f2fc050 0x55a23f2fe460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.022+0000 7faf6deab700 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f2fc050 0x55a23f2fe460 crc :-1 s=READY pgs=808 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e881ba5897dee7b6 server_cookie=95d5172f5a786777 in_seq=0 out_seq=0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.022+0000 7faf517fa700 10 client.21903 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf517fa700 1 -- 172.21.15.35:0/2416269506 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a23f203600 con 0x55a23f2fc050 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf517fa700 10 client.21903 handle_command_reply: tid=0 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 client.21903 shutdown 2023-03-17T11:57:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 msgr2=0x55a23f2ebcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2ebcf0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7faf600c7510 tx=0x7faf60004ff0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 shutdown_connections 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f2fc050 0x55a23f2fe460 crc :-1 s=READY pgs=808 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e84f0 0x55a23f2ebcf0 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2416269506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e7be0 0x55a23f2eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf517fa700 0 client.21903 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 >> 172.21.15.35:0/2416269506 conn(0x55a23f13f6b0 msgr2=0x55a23f2e1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 shutdown_connections 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2416269506 wait complete. 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.023+0000 7faf7c29cb80 20 client.21903 trim_cache size 0 max 16384 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 Processor -- start 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 -- start start 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f2f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f2f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f2dd000 con 0x55a23f2e7be0 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f2d95c0 con 0x55a23f2e84f0 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f2dd6d0 con 0x55a23f2e2960 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f2f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f2f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58156/0 (socket says 172.21.15.35:58156) 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 -- 172.21.15.35:0/2699567207 learned_addr learned my addr 172.21.15.35:0/2699567207 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6deab700 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f2f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:03.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 -- 172.21.15.35:0/2699567207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 msgr2=0x55a23f2dcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2dcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 -- 172.21.15.35:0/2699567207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 msgr2=0x55a23f2f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f2f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6d6aa700 1 -- 172.21.15.35:0/2699567207 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a23f1fb130 con 0x55a23f2e7be0 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.038+0000 7faf6deab700 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2dcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f2f2ef0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7faf64009520 tx=0x7faf64005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bf4af1e0a8fe28 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf58ff9700 1 -- 172.21.15.35:0/2699567207 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6401d040 con 0x55a23f2e7be0 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf58ff9700 1 -- 172.21.15.35:0/2699567207 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf64030070 con 0x55a23f2e7be0 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf58ff9700 1 -- 172.21.15.35:0/2699567207 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64004760 con 0x55a23f2e7be0 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2699567207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 msgr2=0x55a23f2f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f2f2ef0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7faf64009520 tx=0x7faf64005fd0 comp rx=0 tx=0).stop 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2699567207 shutdown_connections 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f2f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f2dcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/2699567207 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f2f2ef0 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2699567207 >> 172.21.15.35:0/2699567207 conn(0x55a23f13f6b0 msgr2=0x55a23f2e1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2699567207 shutdown_connections 2023-03-17T11:57:06.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.039+0000 7faf7c29cb80 1 -- 172.21.15.35:0/2699567207 wait complete. 2023-03-17T11:57:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 -- start start 2023-03-17T11:57:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 Processor -- start 2023-03-17T11:57:09.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f344070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:09.378 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f3445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f34ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f34f440 con 0x55a23f2e7be0 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f34f580 con 0x55a23f2e84f0 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a23f34f6f0 con 0x55a23f2e2960 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf7c29cb80 10 client.0 _ll_register_callbacks cb 0x55a23f0da230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf6d6aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f3445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf6d6aa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f3445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58162/0 (socket says 172.21.15.35:58162) 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf6d6aa700 1 -- 172.21.15.35:0/4048591107 learned_addr learned my addr 172.21.15.35:0/4048591107 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:09.379 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.040+0000 7faf6deab700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f344070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f34ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6d6aa700 1 -- 172.21.15.35:0/4048591107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 msgr2=0x55a23f344070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:10.781 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f344070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6d6aa700 1 -- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 msgr2=0x55a23f34ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f34ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6d6aa700 1 -- 172.21.15.35:0/4048591107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a23f0b65d0 con 0x55a23f2e7be0 2023-03-17T11:57:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6e6ac700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f34ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:57:11.399 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf6d6aa700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f3445b0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7faf64000c00 tx=0x7faf640056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb544bdcc967e78 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf517fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:57:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf517fa700 1 -- 172.21.15.35:0/4048591107 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6400bba0 con 0x55a23f2e7be0 2023-03-17T11:57:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf517fa700 1 -- 172.21.15.35:0/4048591107 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(416..416 src has 1..416) v4 ==== 8455+0+0 (secure 0 0 0) 0x7faf6400bd00 con 0x55a23f2e7be0 2023-03-17T11:57:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a23f2b21e0 con 0x55a23f2e7be0 2023-03-17T11:57:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf517fa700 1 -- 172.21.15.35:0/4048591107 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf6400bec0 con 0x55a23f2e7be0 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf7c29cb80 10 client.21909 fetch_fsmap learned FSMap version 110 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55a23f0891f0 con 0x55a23f2e7be0 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.041+0000 7faf517fa700 1 -- 172.21.15.35:0/4048591107 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a23f2b21e0 con 0x55a23f2e7be0 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf517fa700 1 -- 172.21.15.35:0/4048591107 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7faf640039b0 con 0x55a23f2e7be0 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf7c29cb80 10 client.21909 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf7c29cb80 10 client.21909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:57:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf7c29cb80 20 client.21909 populate_metadata read hostname 'smithi035' 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f3509a0 0x55a23f352db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf7c29cb80 4 client.21909 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a23f0b8f00 con 0x55a23f3509a0 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf6deab700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f3509a0 0x55a23f352db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.043+0000 7faf517fa700 10 client.21909 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.042+0000 7faf6deab700 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f3509a0 0x55a23f352db0 crc :-1 s=READY pgs=809 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72a79aa2e8d3a74 server_cookie=3661a399aef1d399 in_seq=0 out_seq=0 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.059+0000 7faf517fa700 1 -- 172.21.15.35:0/4048591107 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a23f0b8f00 con 0x55a23f3509a0 2023-03-17T11:57:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.059+0000 7faf517fa700 10 client.21909 handle_command_reply: tid=0 2023-03-17T11:57:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 client.21909 shutdown 2023-03-17T11:57:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 msgr2=0x55a23f3445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f3445b0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7faf64000c00 tx=0x7faf640056e0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 shutdown_connections 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a23f3509a0 0x55a23f352db0 crc :-1 s=READY pgs=809 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a23f2e84f0 0x55a23f34ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a23f2e2960 0x55a23f344070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 --2- 172.21.15.35:0/4048591107 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a23f2e7be0 0x55a23f3445b0 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 >> 172.21.15.35:0/4048591107 conn(0x55a23f13f6b0 msgr2=0x55a23f2e56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf517fa700 0 client.21909 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 shutdown_connections 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 1 -- 172.21.15.35:0/4048591107 wait complete. 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7c29cb80 20 client.21909 trim_cache size 0 max 16384 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf5409f640 msgr2=0x7faf540a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.060+0000 7faf7010f700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf5409f640 0x7faf540a1af0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005950 tx=0x7faf5c00b410 comp rx=0 tx=0).stop 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 msgr2=0x7faf681a4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 0x7faf681a4560 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7faf60007ee0 tx=0x7faf6000d3b0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 shutdown_connections 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7faf5409f640 0x7faf540a1af0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7faf681054f0 0x7faf681a4560 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf68100be0 0x7faf68072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 --2- 172.21.15.35:0/4222689235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf68101580 0x7faf680732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 >> 172.21.15.35:0/4222689235 conn(0x7faf680774e0 msgr2=0x7faf680fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 shutdown_connections 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:06.061+0000 7faf7010f700 1 -- 172.21.15.35:0/4222689235 wait complete. 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 -- 172.21.15.35:0/4105706926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 msgr2=0x7f7204103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 --2- 172.21.15.35:0/4105706926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f7204103cb0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f71f80099c0 tx=0x7f71f8009cd0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 -- 172.21.15.35:0/4105706926 shutdown_connections 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 --2- 172.21.15.35:0/4105706926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7204104390 0x7f720410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 --2- 172.21.15.35:0/4105706926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72040ff350 0x7f72040ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 --2- 172.21.15.35:0/4105706926 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f7204103cb0 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 -- 172.21.15.35:0/4105706926 >> 172.21.15.35:0/4105706926 conn(0x7f7204076330 msgr2=0x7f7204076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 -- 172.21.15.35:0/4105706926 shutdown_connections 2023-03-17T11:57:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.183+0000 7f720a427700 1 -- 172.21.15.35:0/4105706926 wait complete. 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 Processor -- start 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 -- start start 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72040ff350 0x7f72041951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f72041956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7204104390 0x7f7204199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720419a180 con 0x7f72040ffcf0 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720419a2f0 con 0x7f7204104390 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f720a427700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720419a4b0 con 0x7f72040ff350 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f72041956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f72041956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58176/0 (socket says 172.21.15.35:58176) 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 -- 172.21.15.35:0/3465537962 learned_addr learned my addr 172.21.15.35:0/3465537962 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72089c4700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7204104390 0x7f7204199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f7203fff700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72040ff350 0x7f72041951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 -- 172.21.15.35:0/3465537962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72040ff350 msgr2=0x7f72041951a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72040ff350 0x7f72041951a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 -- 172.21.15.35:0/3465537962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7204104390 msgr2=0x7f7204199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7204104390 0x7f7204199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.184+0000 7f72037fe700 1 -- 172.21.15.35:0/3465537962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80095f0 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.185+0000 7f72037fe700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f72041956e0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f71f8006010 tx=0x7f71f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.185+0000 7f72017fa700 1 -- 172.21.15.35:0/3465537962 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f801d070 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.185+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720410efc0 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.185+0000 7f72017fa700 1 -- 172.21.15.35:0/3465537962 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71f80041f0 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.185+0000 7f72017fa700 1 -- 172.21.15.35:0/3465537962 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8004a90 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.185+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720410ee30 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.187+0000 7f72017fa700 1 -- 172.21.15.35:0/3465537962 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f71f80052c0 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.188+0000 7f72017fa700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f71ec09f640 0x7f71ec0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.188+0000 7f7203fff700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f71ec09f640 0x7f71ec0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.188+0000 7f72017fa700 1 -- 172.21.15.35:0/3465537962 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f71f80cb620 con 0x7f72040ffcf0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.188+0000 7f7203fff700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f71ec09f640 0x7f71ec0a1af0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005fd0 tx=0x7f71f400a560 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 Processor -- start 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 -- start start 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7dbe0 0x560ee3b7dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b7c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3a83010 con 0x560ee3b7c420 2023-03-17T11:57:13.449 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:36 smithi035 ceph-mon[92535]: pgmap v5994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:57:14.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:37 smithi035 ceph-mon[92535]: pgmap v5995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T11:57:14.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:39 smithi035 ceph-mon[92535]: pgmap v5996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T11:57:14.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:41 smithi035 ceph-mon[92535]: pgmap v5997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T11:57:14.059 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:43 smithi035 ceph-mon[92535]: pgmap v5998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:45 smithi035 ceph-mon[92535]: pgmap v5999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:47 smithi035 ceph-mon[92535]: pgmap v6000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:49 smithi035 ceph-mon[92535]: pgmap v6001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:51 smithi035 ceph-mon[92535]: pgmap v6002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:53 smithi035 ceph-mon[92535]: pgmap v6003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:55 smithi035 ceph-mon[92535]: pgmap v6004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:57 smithi035 ceph-mon[92535]: pgmap v6005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:47:59 smithi035 ceph-mon[92535]: pgmap v6006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:01 smithi035 ceph-mon[92535]: pgmap v6007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-mon[92535]: pgmap v6008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:04 smithi035 ceph-mon[92535]: osdmap e443: 12 total, 12 up, 12 in 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:05 smithi035 ceph-mon[92535]: pgmap v6010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:06 smithi035 ceph-mon[92535]: pgmap v6011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 26 op/s 2023-03-17T11:57:14.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:06 smithi035 ceph-mon[92535]: pgmap v6012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T11:57:14.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:57:14.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:08 smithi035 ceph-mon[92535]: pgmap v6013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 80 KiB/s wr, 41 op/s 2023-03-17T11:57:14.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:10 smithi035 ceph-mon[92535]: pgmap v6014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 600 B/s wr, 7 op/s 2023-03-17T11:57:14.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:13 smithi035 ceph-mon[92535]: pgmap v6015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 634 B/s wr, 7 op/s 2023-03-17T11:57:14.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:13 smithi035 ceph-mon[92535]: osdmap e444: 12 total, 12 up, 12 in 2023-03-17T11:57:14.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:15 smithi035 ceph-mon[92535]: pgmap v6017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T11:57:14.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:16 smithi035 ceph-mon[92535]: daemon mds.d restarted 2023-03-17T11:57:14.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:16 smithi035 ceph-mon[92535]: osdmap e445: 12 total, 12 up, 12 in 2023-03-17T11:57:14.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:17 smithi035 ceph-mon[92535]: pgmap v6019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:17 smithi035 ceph-mon[92535]: mds.? [v2:172.21.15.35:6836/506999199,v1:172.21.15.35:6837/506999199] up:boot 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:17 smithi035 ceph-mon[92535]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:17 smithi035 ceph-mon[92535]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:18 smithi035 ceph-mon[92535]: pgmap v6020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:21 smithi035 ceph-mon[92535]: pgmap v6021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:23 smithi035 ceph-mon[92535]: pgmap v6022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 451 B/s wr, 7 op/s 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:25 smithi035 ceph-mon[92535]: pgmap v6023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T11:57:14.841 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:27 smithi035 ceph-mon[92535]: pgmap v6024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 374 B/s wr, 9 op/s 2023-03-17T11:57:15.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:28 smithi035 ceph-mon[92535]: pgmap v6025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:57:15.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:31 smithi035 ceph-mon[92535]: pgmap v6026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:57:15.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:33 smithi035 ceph-mon[92535]: pgmap v6027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T11:57:15.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:35 smithi035 ceph-mon[92535]: pgmap v6028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-17T11:57:15.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:37 smithi035 ceph-mon[92535]: pgmap v6029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:57:15.398 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:38 smithi035 ceph-mon[92535]: pgmap v6030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:57:15.399 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: *** Caught signal (Segmentation fault) ** 2023-03-17T11:57:16.246 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: in thread 7f8086628700 thread_name:md_log_replay 2023-03-17T11:57:16.246 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:57:16.767 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f80971d2cf0] 2023-03-17T11:57:16.767 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56061c25e71f] 2023-03-17T11:57:18.671 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56061c260953] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 4: (MDLog::_replay_thread()+0x66d) [0x56061c2cc07d] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56061bf7fd91] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f80971c81ca] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 7: clone() 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:48:03.550+0000 7f8086628700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: in thread 7f8086628700 thread_name:md_log_replay 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f80971d2cf0] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56061c25e71f] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56061c260953] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 4: (MDLog::_replay_thread()+0x66d) [0x56061c2cc07d] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56061bf7fd91] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f80971c81ca] 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 7: clone() 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T11:57:18.672 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 0> 2023-03-17T11:48:03.550+0000 7f8086628700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: in thread 7f8086628700 thread_name:md_log_replay 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f80971d2cf0] 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56061c25e71f] 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56061c260953] 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 4: (MDLog::_replay_thread()+0x66d) [0x56061c2cc07d] 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56061bf7fd91] 2023-03-17T11:57:18.673 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f80971c81ca] 2023-03-17T11:57:19.851 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 7: clone() 2023-03-17T11:57:19.851 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T11:57:19.851 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:57:19.852 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 0> 2023-03-17T11:48:03.550+0000 7f8086628700 -1 *** Caught signal (Segmentation fault) ** 2023-03-17T11:57:19.852 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: in thread 7f8086628700 thread_name:md_log_replay 2023-03-17T11:57:20.360 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:57:20.360 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: ceph version 18.0.0-3051-g4aa791bf (4aa791bf129eece187e94ddbfa7c2b475588cf0c) reef (dev) 2023-03-17T11:57:20.360 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f80971d2cf0] 2023-03-17T11:57:20.360 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2: /usr/bin/ceph-mds(+0x4bd71f) [0x56061c25e71f] 2023-03-17T11:57:20.951 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x56061c260953] 2023-03-17T11:57:22.454 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 4: (MDLog::_replay_thread()+0x66d) [0x56061c2cc07d] 2023-03-17T11:57:22.454 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 5: (MDLog::ReplayThread::entry()+0x11) [0x56061bf7fd91] 2023-03-17T11:57:22.454 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f80971c81ca] 2023-03-17T11:57:22.454 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 7: clone() 2023-03-17T11:57:22.454 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-03-17T11:57:22.454 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:03 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[207457]: 2023-03-17T11:57:22.455 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Main process exited, code=exited, status=139/n/a 2023-03-17T11:57:22.455 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:04 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Failed with result 'exit-code'. 2023-03-17T11:57:24.102 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Service RestartSec=10s expired, scheduling restart. 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:14 smithi035 systemd[1]: ceph-80b32574-c497-11ed-9afb-001a4aab830c@mds.d.service: Scheduled restart job, restart counter is at 7. 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:14 smithi035 systemd[1]: Stopped Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:14 smithi035 systemd[1]: Starting Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c... 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:14 smithi035 podman[214608]: 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:15 smithi035 ceph-mds[214649]: -- 172.21.15.35:0/1991774992 <== mon.0 v2:172.21.15.35:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557774364b60 con 0x55777433b000 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:15 smithi035 bash[214608]: 8727cae1eb9e07d18ee8b37c49c150dccd7dace572fb1caf794266c296b86ddc 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:15 smithi035 ceph-80b32574-c497-11ed-9afb-001a4aab830c-mds-d[214624]: starting mds.d at 2023-03-17T11:57:24.103 INFO:journalctl@ceph.mds.d.smithi035.stdout:Mar 17 11:48:15 smithi035 systemd[1]: Started Ceph mds.d for 80b32574-c497-11ed-9afb-001a4aab830c. 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:57:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:57:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:57:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:57:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:57:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:57:25.453 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:57:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3ad5950 con 0x560ee3b7cdd0 2023-03-17T11:57:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72165b4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3acede0 con 0x560ee3b7dbe0 2023-03-17T11:57:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b7c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72037fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b7c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58184/0 (socket says 172.21.15.35:58184) 2023-03-17T11:57:25.454 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.189+0000 7f72037fe700 1 -- 172.21.15.35:0/1113551753 learned_addr learned my addr 172.21.15.35:0/1113551753 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:26.382 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72089c4700 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f7203fff700 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7dbe0 0x560ee3b7dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72037fe700 1 -- 172.21.15.35:0/1113551753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7dbe0 msgr2=0x560ee3b7dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72037fe700 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7dbe0 0x560ee3b7dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72037fe700 1 -- 172.21.15.35:0/1113551753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 msgr2=0x560ee3b8cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72037fe700 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72037fe700 1 -- 172.21.15.35:0/1113551753 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee39505d0 con 0x560ee3b7c420 2023-03-17T11:57:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72089c4700 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:57:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f72037fe700 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b7c890 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f71f80a0d30 tx=0x7f71f80954c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0764868e95a7cb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f71ea7fc700 1 -- 172.21.15.35:0/1113551753 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f809e040 con 0x560ee3b7c420 2023-03-17T11:57:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f71ea7fc700 1 -- 172.21.15.35:0/1113551753 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71f8097300 con 0x560ee3b7c420 2023-03-17T11:57:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.190+0000 7f71ea7fc700 1 -- 172.21.15.35:0/1113551753 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f80a1030 con 0x560ee3b7c420 2023-03-17T11:57:26.889 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 -- 172.21.15.35:0/1113551753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 msgr2=0x560ee3b7c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b7c890 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f71f80a0d30 tx=0x7f71f80954c0 comp rx=0 tx=0).stop 2023-03-17T11:57:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 -- 172.21.15.35:0/1113551753 shutdown_connections 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7dbe0 0x560ee3b7dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1113551753 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b7c890 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 -- 172.21.15.35:0/1113551753 >> 172.21.15.35:0/1113551753 conn(0x560ee39d96b0 msgr2=0x560ee3b76a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 -- 172.21.15.35:0/1113551753 shutdown_connections 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 -- 172.21.15.35:0/1113551753 wait complete. 2023-03-17T11:57:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 -- start start 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.191+0000 7f72165b4b80 1 Processor -- start 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b8f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7dbe0 0x560ee3b89c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee39528c0 con 0x560ee3b7c420 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3b8a210 con 0x560ee3b7dbe0 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3b8a3d0 con 0x560ee3b7cdd0 2023-03-17T11:57:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72165b4b80 10 client.0 _ll_register_callbacks cb 0x560ee3974230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:57:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b8f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b8f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58188/0 (socket says 172.21.15.35:58188) 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 -- 172.21.15.35:0/3329363820 learned_addr learned my addr 172.21.15.35:0/3329363820 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72037fe700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f72089c4700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7dbe0 0x560ee3b89c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 -- 172.21.15.35:0/3329363820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7cdd0 msgr2=0x560ee3b8fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 -- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7dbe0 msgr2=0x560ee3b89c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7dbe0 0x560ee3b89c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.192+0000 7f7203fff700 1 -- 172.21.15.35:0/3329363820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720410ee30 con 0x560ee3b7c420 2023-03-17T11:57:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f7203fff700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b8f9b0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f71f40109b0 tx=0x7f71f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6b12aa2d8477ca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f71e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f71e37fe700 1 -- 172.21.15.35:0/3329363820 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4004a30 con 0x560ee3b7c420 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f71e37fe700 1 -- 172.21.15.35:0/3329363820 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f71f4004b90 con 0x560ee3b7c420 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ee3a91390 con 0x560ee3b7c420 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f71e37fe700 1 -- 172.21.15.35:0/3329363820 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71f4004d50 con 0x560ee3b7c420 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 10 client.21921 fetch_fsmap learned FSMap version 110 2023-03-17T11:57:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x560ee38fcd80 con 0x560ee3b7c420 2023-03-17T11:57:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f71e37fe700 1 -- 172.21.15.35:0/3329363820 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ee3a91390 con 0x560ee3b7c420 2023-03-17T11:57:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f71e37fe700 1 -- 172.21.15.35:0/3329363820 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f71f4024030 con 0x560ee3b7c420 2023-03-17T11:57:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 10 client.21921 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:57:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 10 client.21921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:57:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 20 client.21921 populate_metadata read hostname 'smithi035' 2023-03-17T11:57:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3b9a0f0 0x560ee3b9c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 4 client.21921 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:57:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.193+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ee3a9d600 con 0x560ee3b9a0f0 2023-03-17T11:57:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.194+0000 7f72037fe700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3b9a0f0 0x560ee3b9c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.194+0000 7f72037fe700 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3b9a0f0 0x560ee3b9c500 crc :-1 s=READY pgs=810 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9e9e3cdcd4582f server_cookie=2f94161d88203121 in_seq=0 out_seq=0 2023-03-17T11:57:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.194+0000 7f71e37fe700 10 client.21921 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f71e37fe700 1 -- 172.21.15.35:0/3329363820 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560ee3a9d600 con 0x560ee3b9a0f0 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f71e37fe700 10 client.21921 handle_command_reply: tid=0 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 client.21921 shutdown 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 msgr2=0x560ee3b8f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b8f9b0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f71f40109b0 tx=0x7f71f4004750 comp rx=0 tx=0).stop 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 shutdown_connections 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3b9a0f0 0x560ee3b9c500 crc :-1 s=READY pgs=810 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7dbe0 0x560ee3b89c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7c420 0x560ee3b8f9b0 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f71e37fe700 0 client.21921 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3329363820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 >> 172.21.15.35:0/3329363820 conn(0x560ee39d96b0 msgr2=0x560ee3b7b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 shutdown_connections 2023-03-17T11:57:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 1 -- 172.21.15.35:0/3329363820 wait complete. 2023-03-17T11:57:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.195+0000 7f72165b4b80 20 client.21921 trim_cache size 0 max 16384 2023-03-17T11:57:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.210+0000 7f72165b4b80 1 Processor -- start 2023-03-17T11:57:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.210+0000 7f72165b4b80 1 -- start start 2023-03-17T11:57:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.210+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3b7bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.210+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3b8fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72165b4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3b77b70 con 0x560ee3b7dbe0 2023-03-17T11:57:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72165b4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3b735c0 con 0x560ee3b7cdd0 2023-03-17T11:57:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72165b4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3b73b60 con 0x560ee3b7c420 2023-03-17T11:57:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3b8fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3b8fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58200/0 (socket says 172.21.15.35:58200) 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 -- 172.21.15.35:0/3396259944 learned_addr learned my addr 172.21.15.35:0/3396259944 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f7203fff700 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3b7bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72037fe700 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 -- 172.21.15.35:0/3396259944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 msgr2=0x560ee3b7bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3b7bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 -- 172.21.15.35:0/3396259944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 msgr2=0x560ee3b8f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 -- 172.21.15.35:0/3396259944 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ee3a95130 con 0x560ee3b7dbe0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f72089c4700 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3b8fa80 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f71fc008770 tx=0x7f71fc0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91c5be2653b3839 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f71eaffd700 1 -- 172.21.15.35:0/3396259944 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00f070 con 0x560ee3b7dbe0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f71eaffd700 1 -- 172.21.15.35:0/3396259944 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71fc010040 con 0x560ee3b7dbe0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.211+0000 7f71eaffd700 1 -- 172.21.15.35:0/3396259944 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc017690 con 0x560ee3b7dbe0 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 -- 172.21.15.35:0/3396259944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 msgr2=0x560ee3b8fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3b8fa80 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f71fc008770 tx=0x7f71fc0078d0 comp rx=0 tx=0).stop 2023-03-17T11:57:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 -- 172.21.15.35:0/3396259944 shutdown_connections 2023-03-17T11:57:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3b8fa80 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3b7bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 --2- 172.21.15.35:0/3396259944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3b8f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 -- 172.21.15.35:0/3396259944 >> 172.21.15.35:0/3396259944 conn(0x560ee39d96b0 msgr2=0x560ee3b7b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 -- 172.21.15.35:0/3396259944 shutdown_connections 2023-03-17T11:57:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 -- 172.21.15.35:0/3396259944 wait complete. 2023-03-17T11:57:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.212+0000 7f72165b4b80 1 -- start start 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 Processor -- start 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3be78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3be7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3be1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3be24f0 con 0x560ee3b7dbe0 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3be2660 con 0x560ee3b7cdd0 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ee3be2820 con 0x560ee3b7c420 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72165b4b80 10 client.0 _ll_register_callbacks cb 0x560ee3974230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:57:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3be1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3be1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58206/0 (socket says 172.21.15.35:58206) 2023-03-17T11:57:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 -- 172.21.15.35:0/1574094491 learned_addr learned my addr 172.21.15.35:0/1574094491 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f7203fff700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3be78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72037fe700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3be7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 -- 172.21.15.35:0/1574094491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 msgr2=0x560ee3be78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3be78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 -- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 msgr2=0x560ee3be7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3be7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.213+0000 7f72089c4700 1 -- 172.21.15.35:0/1574094491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc0083f0 con 0x560ee3b7dbe0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72089c4700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3be1ee0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f71fc007b80 tx=0x7f71fc004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee60d1a67372a2a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f71e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f71e37fe700 1 -- 172.21.15.35:0/1574094491 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x560ee3b7dbe0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f71e37fe700 1 -- 172.21.15.35:0/1574094491 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f71fc003a00 con 0x560ee3b7dbe0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ee3b4c1e0 con 0x560ee3b7dbe0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f71e37fe700 1 -- 172.21.15.35:0/1574094491 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71fc003bc0 con 0x560ee3b7dbe0 2023-03-17T11:57:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 10 client.21927 fetch_fsmap learned FSMap version 110 2023-03-17T11:57:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x560ee39231f0 con 0x560ee3b7dbe0 2023-03-17T11:57:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f71e37fe700 1 -- 172.21.15.35:0/1574094491 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ee3b4c1e0 con 0x560ee3b7dbe0 2023-03-17T11:57:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f71e37fe700 1 -- 172.21.15.35:0/1574094491 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f71fc01d020 con 0x560ee3b7dbe0 2023-03-17T11:57:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 10 client.21927 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:57:40.273 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 10 client.21927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:57:40.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 20 client.21927 populate_metadata read hostname 'smithi035' 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3bef6b0 0x560ee3bf1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 4 client.21927 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ee3952f00 con 0x560ee3bef6b0 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.214+0000 7f7203fff700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3bef6b0 0x560ee3bf1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.215+0000 7f71e37fe700 10 client.21927 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.215+0000 7f7203fff700 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3bef6b0 0x560ee3bf1ac0 crc :-1 s=READY pgs=811 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd4ca90a32e455c server_cookie=3724146766df9847 in_seq=0 out_seq=0 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f71e37fe700 1 -- 172.21.15.35:0/1574094491 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ee3952f00 con 0x560ee3bef6b0 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f71e37fe700 10 client.21927 handle_command_reply: tid=0 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 client.21927 shutdown 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 msgr2=0x560ee3be1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:40.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3be1ee0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f71fc007b80 tx=0x7f71fc004300 comp rx=0 tx=0).stop 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 shutdown_connections 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x560ee3bef6b0 0x560ee3bf1ac0 crc :-1 s=READY pgs=811 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x560ee3b7dbe0 0x560ee3be1ee0 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ee3b7c420 0x560ee3be78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f71e37fe700 0 client.21927 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 --2- 172.21.15.35:0/1574094491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ee3b7cdd0 0x560ee3be7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 >> 172.21.15.35:0/1574094491 conn(0x560ee39d96b0 msgr2=0x560ee3b75ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 shutdown_connections 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 1 -- 172.21.15.35:0/1574094491 wait complete. 2023-03-17T11:57:40.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.233+0000 7f72165b4b80 20 client.21927 trim_cache size 0 max 16384 2023-03-17T11:57:40.763 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:41 smithi035 ceph-mon[92535]: pgmap v6031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f71ec09f640 msgr2=0x7f71ec0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f71ec09f640 0x7f71ec0a1af0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005fd0 tx=0x7f71f400a560 comp rx=0 tx=0).stop 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 msgr2=0x7f72041956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f72041956e0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f71f8006010 tx=0x7f71f8004730 comp rx=0 tx=0).stop 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 shutdown_connections 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f71ec09f640 0x7f71ec0a1af0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7204104390 0x7f7204199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72040ff350 0x7f72041951a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 --2- 172.21.15.35:0/3465537962 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f72040ffcf0 0x7f72041956e0 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 >> 172.21.15.35:0/3465537962 conn(0x7f7204076330 msgr2=0x7f72040fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 shutdown_connections 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:19.234+0000 7f720a427700 1 -- 172.21.15.35:0/3465537962 wait complete. 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 -- 172.21.15.35:0/1393490850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f940ffcf0 msgr2=0x7f5f94103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 --2- 172.21.15.35:0/1393490850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f940ffcf0 0x7f5f94103cb0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0099c0 tx=0x7f5f7c009cd0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 -- 172.21.15.35:0/1393490850 shutdown_connections 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 --2- 172.21.15.35:0/1393490850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f94104390 0x7f5f9410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 --2- 172.21.15.35:0/1393490850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f940ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 --2- 172.21.15.35:0/1393490850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f940ffcf0 0x7f5f94103cb0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 -- 172.21.15.35:0/1393490850 >> 172.21.15.35:0/1393490850 conn(0x7f5f94076330 msgr2=0x7f5f94076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 -- 172.21.15.35:0/1393490850 shutdown_connections 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.355+0000 7f5f9af24700 1 -- 172.21.15.35:0/1393490850 wait complete. 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.356+0000 7f5f9af24700 1 Processor -- start 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.356+0000 7f5f9af24700 1 -- start start 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f9af24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f9af24700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f941956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f9af24700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f94199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f9af24700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9419a180 con 0x7f5f94104390 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f9af24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9419a2f0 con 0x7f5f940ff350 2023-03-17T11:57:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f9af24700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9419a4b0 con 0x7f5f940ffcf0 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f94199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f94199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58220/0 (socket says 172.21.15.35:58220) 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 -- 172.21.15.35:0/962289607 learned_addr learned my addr 172.21.15.35:0/962289607 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f93fff700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f941956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 -- 172.21.15.35:0/962289607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 msgr2=0x7f5f941956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f941956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 -- 172.21.15.35:0/962289607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 msgr2=0x7f5f941951a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941951a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 -- 172.21.15.35:0/962289607 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0095f0 con 0x7f5f94104390 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f994c1700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f94199b40 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007f10 tx=0x7f5f8c00f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.357+0000 7f5f91ffb700 1 -- 172.21.15.35:0/962289607 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00fde0 con 0x7f5f94104390 2023-03-17T11:57:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.358+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9410efc0 con 0x7f5f94104390 2023-03-17T11:57:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.358+0000 7f5f91ffb700 1 -- 172.21.15.35:0/962289607 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f8c004bb0 con 0x7f5f94104390 2023-03-17T11:57:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.358+0000 7f5f91ffb700 1 -- 172.21.15.35:0/962289607 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c005020 con 0x7f5f94104390 2023-03-17T11:57:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.358+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9410ee30 con 0x7f5f94104390 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.360+0000 7f5f91ffb700 1 -- 172.21.15.35:0/962289607 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f5f8c004d20 con 0x7f5f94104390 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.361+0000 7f5f91ffb700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.361+0000 7f5f91ffb700 1 -- 172.21.15.35:0/962289607 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f8c0cc900 con 0x7f5f94104390 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.361+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.361+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5f84005950 tx=0x7f5f8400a300 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 Processor -- start 2023-03-17T11:57:42.195 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 -- start start 2023-03-17T11:57:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb1a8010 con 0x55b4eb2a6330 2023-03-17T11:57:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb1fa950 con 0x55b4eb2a5a20 2023-03-17T11:57:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb1f3de0 con 0x55b4eb2aa170 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58226/0 (socket says 172.21.15.35:58226) 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 -- 172.21.15.35:0/3509490127 learned_addr learned my addr 172.21.15.35:0/3509490127 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f994c1700 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 -- 172.21.15.35:0/3509490127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 msgr2=0x55b4eb2aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 -- 172.21.15.35:0/3509490127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 msgr2=0x55b4eb2a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.362+0000 7f5f93fff700 1 -- 172.21.15.35:0/3509490127 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4eb0755d0 con 0x55b4eb2a6330 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5f93fff700 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2a9c30 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0036c0 tx=0x7f5f7c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdb84dc227511b8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5f8affd700 1 -- 172.21.15.35:0/3509490127 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0053c0 con 0x55b4eb2a6330 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5f8affd700 1 -- 172.21.15.35:0/3509490127 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f7c01e040 con 0x55b4eb2a6330 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5f8affd700 1 -- 172.21.15.35:0/3509490127 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004860 con 0x55b4eb2a6330 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3509490127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 msgr2=0x55b4eb2a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2a9c30 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0036c0 tx=0x7f5f7c005c80 comp rx=0 tx=0).stop 2023-03-17T11:57:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3509490127 shutdown_connections 2023-03-17T11:57:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:43.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3509490127 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2a9c30 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.363+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3509490127 >> 172.21.15.35:0/3509490127 conn(0x55b4eb0fe6b0 msgr2=0x55b4eb29ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3509490127 shutdown_connections 2023-03-17T11:57:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3509490127 wait complete. 2023-03-17T11:57:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 -- start start 2023-03-17T11:57:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 Processor -- start 2023-03-17T11:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb0778c0 con 0x55b4eb2a6330 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2af9f0 con 0x55b4eb2a5a20 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.364+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2bb380 con 0x55b4eb2aa170 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5fa70b1b80 10 client.0 _ll_register_callbacks cb 0x55b4eb099230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58232/0 (socket says 172.21.15.35:58232) 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 -- 172.21.15.35:0/1328199623 learned_addr learned my addr 172.21.15.35:0/1328199623 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f994c1700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 -- 172.21.15.35:0/1328199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 msgr2=0x55b4eb2af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 -- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 msgr2=0x55b4eb2b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 -- 172.21.15.35:0/1328199623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9410c7a0 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f994c1700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f93fff700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2aeb70 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0098e0 tx=0x7f5f7c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f19c663edfa4f86 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f73fff700 1 -- 172.21.15.35:0/1328199623 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004500 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4eb1b6390 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f73fff700 1 -- 172.21.15.35:0/1328199623 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f7c004660 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5f73fff700 1 -- 172.21.15.35:0/1328199623 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f7c004820 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5fa70b1b80 10 client.21939 fetch_fsmap learned FSMap version 110 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.365+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55b4eb021d80 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5f73fff700 1 -- 172.21.15.35:0/1328199623 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b4eb1b6390 con 0x55b4eb2a6330 2023-03-17T11:57:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5f73fff700 1 -- 172.21.15.35:0/1328199623 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f7c003ce0 con 0x55b4eb2a6330 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5fa70b1b80 10 client.21939 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5fa70b1b80 10 client.21939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5fa70b1b80 20 client.21939 populate_metadata read hostname 'smithi035' 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb2bf090 0x55b4eb2c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5fa70b1b80 4 client.21939 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4eb1c2600 con 0x55b4eb2bf090 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.366+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb2bf090 0x55b4eb2c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb2bf090 0x55b4eb2c14a0 crc :-1 s=READY pgs=812 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a87d112eb799ac server_cookie=d24a263f3b04f50d in_seq=0 out_seq=0 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5f73fff700 10 client.21939 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5f73fff700 1 -- 172.21.15.35:0/1328199623 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b4eb1c2600 con 0x55b4eb2bf090 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5f73fff700 10 client.21939 handle_command_reply: tid=0 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 client.21939 shutdown 2023-03-17T11:57:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 msgr2=0x55b4eb2aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2aeb70 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0098e0 tx=0x7f5f7c00b840 comp rx=0 tx=0).stop 2023-03-17T11:57:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 shutdown_connections 2023-03-17T11:57:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb2bf090 0x55b4eb2c14a0 crc :-1 s=READY pgs=812 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2aa170 0x55b4eb2af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5f73fff700 0 client.21939 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:46.914 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.367+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/1328199623 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2aeb70 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.368+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 >> 172.21.15.35:0/1328199623 conn(0x55b4eb0fe6b0 msgr2=0x55b4eb2a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.368+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 shutdown_connections 2023-03-17T11:57:48.545 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.368+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/1328199623 wait complete. 2023-03-17T11:57:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.368+0000 7f5fa70b1b80 20 client.21939 trim_cache size 0 max 16384 2023-03-17T11:57:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 Processor -- start 2023-03-17T11:57:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 -- start start 2023-03-17T11:57:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:48.546 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2af8b0 con 0x55b4eb2a6330 2023-03-17T11:57:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2970d0 con 0x55b4eb2aa170 2023-03-17T11:57:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb29c6d0 con 0x55b4eb2a5a20 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5f994c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5f93fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58240/0 (socket says 172.21.15.35:58240) 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5f93fff700 1 -- 172.21.15.35:0/3131346598 learned_addr learned my addr 172.21.15.35:0/3131346598 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.383+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f93fff700 1 -- 172.21.15.35:0/3131346598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 msgr2=0x55b4eb2b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f93fff700 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f93fff700 1 -- 172.21.15.35:0/3131346598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2aa170 msgr2=0x55b4eb2b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f93fff700 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f93fff700 1 -- 172.21.15.35:0/3131346598 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4eb1ba130 con 0x55b4eb2a6330 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f994c1700 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f93fff700 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b1420 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c004110 tx=0x7f5f7c009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f751bae6d0480b99 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f8b7fe700 1 -- 172.21.15.35:0/3131346598 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004230 con 0x55b4eb2a6330 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f8b7fe700 1 -- 172.21.15.35:0/3131346598 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f7c01e040 con 0x55b4eb2a6330 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.384+0000 7f5f8b7fe700 1 -- 172.21.15.35:0/3131346598 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00f8b0 con 0x55b4eb2a6330 2023-03-17T11:57:50.064 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3131346598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 msgr2=0x55b4eb2b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:50.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:43 smithi035 ceph-mon[92535]: pgmap v6032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-17T11:57:50.738 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b1420 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c004110 tx=0x7f5f7c009290 comp rx=0 tx=0).stop 2023-03-17T11:57:51.415 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3131346598 shutdown_connections 2023-03-17T11:57:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/3131346598 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b1420 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3131346598 >> 172.21.15.35:0/3131346598 conn(0x55b4eb0fe6b0 msgr2=0x55b4eb2bb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3131346598 shutdown_connections 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/3131346598 wait complete. 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 -- start start 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.385+0000 7f5fa70b1b80 1 Processor -- start 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2b4880 con 0x55b4eb2aa170 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2b49f0 con 0x55b4eb2a6330 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4eb2b4bb0 con 0x55b4eb2a5a20 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 10 client.0 _ll_register_callbacks cb 0x55b4eb099230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58248/0 (socket says 172.21.15.35:58248) 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 -- 172.21.15.35:0/88623669 learned_addr learned my addr 172.21.15.35:0/88623669 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f93fff700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 -- 172.21.15.35:0/88623669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 msgr2=0x55b4eb2b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 -- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a6330 msgr2=0x55b4eb2b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 -- 172.21.15.35:0/88623669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9410ee30 con 0x55b4eb2aa170 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f93fff700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f994c1700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b42b0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c09a2e0 tx=0x7f5f8c0a2540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a883c8e82602236 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f73fff700 1 -- 172.21.15.35:0/88623669 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c09e190 con 0x55b4eb2aa170 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5f73fff700 1 -- 172.21.15.35:0/88623669 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f5f8c099840 con 0x55b4eb2aa170 2023-03-17T11:57:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.386+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4eb2711e0 con 0x55b4eb2aa170 2023-03-17T11:57:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5f73fff700 1 -- 172.21.15.35:0/88623669 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f8c099a00 con 0x55b4eb2aa170 2023-03-17T11:57:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 10 client.21945 fetch_fsmap learned FSMap version 110 2023-03-17T11:57:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55b4eb021d80 con 0x55b4eb2aa170 2023-03-17T11:57:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5f73fff700 1 -- 172.21.15.35:0/88623669 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f8c0c9030 con 0x55b4eb2aa170 2023-03-17T11:57:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5f73fff700 1 -- 172.21.15.35:0/88623669 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f5f8c012460 con 0x55b4eb2aa170 2023-03-17T11:57:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 10 client.21945 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 10 client.21945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 20 client.21945 populate_metadata read hostname 'smithi035' 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb3140f0 0x55b4eb316500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 4 client.21945 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b4eb077f00 con 0x55b4eb3140f0 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.387+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb3140f0 0x55b4eb316500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.388+0000 7f5f73fff700 10 client.21945 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.388+0000 7f5f98cc0700 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb3140f0 0x55b4eb316500 crc :-1 s=READY pgs=813 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f6205e15b8e228 server_cookie=bc6d54ba69f8bbe1 in_seq=0 out_seq=0 2023-03-17T11:57:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.397+0000 7f5f73fff700 1 -- 172.21.15.35:0/88623669 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b4eb077f00 con 0x55b4eb3140f0 2023-03-17T11:57:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.397+0000 7f5f73fff700 10 client.21945 handle_command_reply: tid=0 2023-03-17T11:57:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.397+0000 7f5fa70b1b80 1 client.21945 shutdown 2023-03-17T11:57:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.397+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 msgr2=0x55b4eb2b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.397+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b42b0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c09a2e0 tx=0x7f5f8c0a2540 comp rx=0 tx=0).stop 2023-03-17T11:57:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 shutdown_connections 2023-03-17T11:57:54.994 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b4eb3140f0 0x55b4eb316500 crc :-1 s=READY pgs=813 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b4eb2aa170 0x55b4eb2b42b0 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f73fff700 0 client.21945 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4eb2a5a20 0x55b4eb2b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 --2- 172.21.15.35:0/88623669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b4eb2a6330 0x55b4eb2b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 >> 172.21.15.35:0/88623669 conn(0x55b4eb0fe6b0 msgr2=0x55b4eb2a9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 shutdown_connections 2023-03-17T11:57:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 1 -- 172.21.15.35:0/88623669 wait complete. 2023-03-17T11:57:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5fa70b1b80 20 client.21945 trim_cache size 0 max 16384 2023-03-17T11:57:57.756 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 msgr2=0x7f5f800a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5f84005950 tx=0x7f5f8400a300 comp rx=0 tx=0).stop 2023-03-17T11:57:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 msgr2=0x7f5f94199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:57:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f94199b40 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007f10 tx=0x7f5f8c00f5c0 comp rx=0 tx=0).stop 2023-03-17T11:57:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 shutdown_connections 2023-03-17T11:57:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f5f8009f640 0x7f5f800a1af0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f5f94104390 0x7f5f94199b40 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:57:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f940ff350 0x7f5f941951a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 --2- 172.21.15.35:0/962289607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f940ffcf0 0x7f5f941956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.398+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 >> 172.21.15.35:0/962289607 conn(0x7f5f94076330 msgr2=0x7f5f940fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.399+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 shutdown_connections 2023-03-17T11:58:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:32.399+0000 7f5f9af24700 1 -- 172.21.15.35:0/962289607 wait complete. 2023-03-17T11:58:01.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.520+0000 7fa99236b700 1 -- 172.21.15.35:0/3703578950 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c104390 msgr2=0x7fa98c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.520+0000 7fa99236b700 1 --2- 172.21.15.35:0/3703578950 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c104390 0x7fa98c10bf60 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7fa98400b0d0 tx=0x7fa98400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.520+0000 7fa99236b700 1 -- 172.21.15.35:0/3703578950 shutdown_connections 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.520+0000 7fa99236b700 1 --2- 172.21.15.35:0/3703578950 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c104390 0x7fa98c10bf60 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.520+0000 7fa99236b700 1 --2- 172.21.15.35:0/3703578950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa98c0ff350 0x7fa98c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.520+0000 7fa99236b700 1 --2- 172.21.15.35:0/3703578950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c0ffcf0 0x7fa98c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.521+0000 7fa99236b700 1 -- 172.21.15.35:0/3703578950 >> 172.21.15.35:0/3703578950 conn(0x7fa98c076330 msgr2=0x7fa98c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.521+0000 7fa99236b700 1 -- 172.21.15.35:0/3703578950 shutdown_connections 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.521+0000 7fa99236b700 1 -- 172.21.15.35:0/3703578950 wait complete. 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.521+0000 7fa99236b700 1 Processor -- start 2023-03-17T11:58:01.713 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.521+0000 7fa99236b700 1 -- start start 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa99236b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 0x7fa98c1951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa99236b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa98c0ffcf0 0x7fa98c195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa99236b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c104390 0x7fa98c199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa99236b700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c19a1c0 con 0x7fa98c0ff350 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa99236b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c19a330 con 0x7fa98c104390 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa99236b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c19a4f0 con 0x7fa98c0ffcf0 2023-03-17T11:58:01.714 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 0x7fa98c1951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:02.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 0x7fa98c1951e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58258/0 (socket says 172.21.15.35:58258) 2023-03-17T11:58:02.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 -- 172.21.15.35:0/977992019 learned_addr learned my addr 172.21.15.35:0/977992019 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:02.943 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa98c0ffcf0 0x7fa98c195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa990908700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c104390 0x7fa98c199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 -- 172.21.15.35:0/977992019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa98c0ffcf0 msgr2=0x7fa98c195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa98c0ffcf0 0x7fa98c195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 -- 172.21.15.35:0/977992019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c104390 msgr2=0x7fa98c199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c104390 0x7fa98c199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa98bfff700 1 -- 172.21.15.35:0/977992019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984009d00 con 0x7fa98c0ff350 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.522+0000 7fa990908700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c104390 0x7fa98c199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.523+0000 7fa98bfff700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 0x7fa98c1951e0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00d980 tx=0x7fa97c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.523+0000 7fa9897fa700 1 -- 172.21.15.35:0/977992019 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c009b40 con 0x7fa98c0ff350 2023-03-17T11:58:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.523+0000 7fa9897fa700 1 -- 172.21.15.35:0/977992019 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa97c00de60 con 0x7fa98c0ff350 2023-03-17T11:58:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.523+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c10f030 con 0x7fa98c0ff350 2023-03-17T11:58:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.523+0000 7fa9897fa700 1 -- 172.21.15.35:0/977992019 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0054e0 con 0x7fa98c0ff350 2023-03-17T11:58:04.257 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.523+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c10eea0 con 0x7fa98c0ff350 2023-03-17T11:58:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.525+0000 7fa9897fa700 1 -- 172.21.15.35:0/977992019 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa97c004750 con 0x7fa98c0ff350 2023-03-17T11:58:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.526+0000 7fa9897fa700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa97409f640 0x7fa9740a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.526+0000 7fa9897fa700 1 -- 172.21.15.35:0/977992019 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa97c0ca5e0 con 0x7fa98c0ff350 2023-03-17T11:58:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.526+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa97409f640 0x7fa9740a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.526+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa97409f640 0x7fa9740a1af0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa980005fd0 tx=0x7fa98000af20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 Processor -- start 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 -- start start 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d5888be0 0x55b8d5888fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d58894f0 0x55b8d5883420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d5883d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d578a010 con 0x55b8d5883960 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d57dc950 con 0x55b8d5888be0 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d57d5de0 con 0x55b8d58894f0 2023-03-17T11:58:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d5883d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d5883d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58270/0 (socket says 172.21.15.35:58270) 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 -- 172.21.15.35:0/269247136 learned_addr learned my addr 172.21.15.35:0/269247136 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d58894f0 0x55b8d5883420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa98bfff700 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d5888be0 0x55b8d5888fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 -- 172.21.15.35:0/269247136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d58894f0 msgr2=0x55b8d5883420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d58894f0 0x55b8d5883420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 -- 172.21.15.35:0/269247136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d5888be0 msgr2=0x55b8d5888fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d5888be0 0x55b8d5888fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa990908700 1 -- 172.21.15.35:0/269247136 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8d56575d0 con 0x55b8d5883960 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.527+0000 7fa98bfff700 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d5888be0 0x55b8d5888fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:58:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa990908700 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d5883d90 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fa984009c90 tx=0x7fa98400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948826791b0d6de0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa9727fc700 1 -- 172.21.15.35:0/269247136 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400e070 con 0x55b8d5883960 2023-03-17T11:58:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa9727fc700 1 -- 172.21.15.35:0/269247136 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa984004a50 con 0x55b8d5883960 2023-03-17T11:58:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa9727fc700 1 -- 172.21.15.35:0/269247136 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984005040 con 0x55b8d5883960 2023-03-17T11:58:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/269247136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 msgr2=0x55b8d5883d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d5883d90 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fa984009c90 tx=0x7fa98400cd70 comp rx=0 tx=0).stop 2023-03-17T11:58:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/269247136 shutdown_connections 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d5883d90 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d5888be0 0x55b8d5888fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.528+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/269247136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d58894f0 0x55b8d5883420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/269247136 >> 172.21.15.35:0/269247136 conn(0x55b8d56e06b0 msgr2=0x55b8d587da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/269247136 shutdown_connections 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/269247136 wait complete. 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 -- start start 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 Processor -- start 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d588f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.529+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5888be0 0x55b8d588c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d56598c0 con 0x55b8d5883960 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d588d3f0 con 0x55b8d58894f0 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d5898fa0 con 0x55b8d5888be0 2023-03-17T11:58:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa99e4f8b80 10 client.0 _ll_register_callbacks cb 0x55b8d567b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d588f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d588f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58272/0 (socket says 172.21.15.35:58272) 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 -- 172.21.15.35:0/2511145665 learned_addr learned my addr 172.21.15.35:0/2511145665 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5888be0 0x55b8d588c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa990908700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 -- 172.21.15.35:0/2511145665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5888be0 msgr2=0x55b8d588c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5888be0 0x55b8d588c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:09.501 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:45 smithi035 ceph-mon[92535]: pgmap v6033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2023-03-17T11:58:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 -- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 msgr2=0x55b8d588ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 -- 172.21.15.35:0/2511145665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c10c7a0 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5888be0 0x55b8d588c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa990908700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa98bfff700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d588f410 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7fa97c097d30 tx=0x7fa97c0a03a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fb6f126c886567 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa96b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2511145665 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0ca2e0 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2511145665 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa97c00ec00 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8d5798390 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.530+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2511145665 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa97c00edc0 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 10 client.21957 fetch_fsmap learned FSMap version 110 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55b8d5603d80 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2511145665 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b8d5798390 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2511145665 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa97c0c7020 con 0x55b8d5883960 2023-03-17T11:58:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 10 client.21957 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:58:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 10 client.21957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:58:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 20 client.21957 populate_metadata read hostname 'smithi035' 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d589cf40 0x55b8d589f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 4 client.21957 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8d57a4600 con 0x55b8d589cf40 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.531+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d589cf40 0x55b8d589f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d589cf40 0x55b8d589f320 crc :-1 s=READY pgs=814 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e1e1d741dff692 server_cookie=2ab5cbe75ff125 in_seq=0 out_seq=0 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa96b7fe700 10 client.21957 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2511145665 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b8d57a4600 con 0x55b8d589cf40 2023-03-17T11:58:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa96b7fe700 10 client.21957 handle_command_reply: tid=0 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 client.21957 shutdown 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 msgr2=0x55b8d588f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d588f410 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7fa97c097d30 tx=0x7fa97c0a03a0 comp rx=0 tx=0).stop 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 shutdown_connections 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d589cf40 0x55b8d589f320 crc :-1 s=READY pgs=814 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5883960 0x55b8d588f410 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2511145665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5888be0 0x55b8d588c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.532+0000 7fa96b7fe700 0 client.21957 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.533+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 >> 172.21.15.35:0/2511145665 conn(0x55b8d56e06b0 msgr2=0x55b8d587da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.533+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 shutdown_connections 2023-03-17T11:58:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.533+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2511145665 wait complete. 2023-03-17T11:58:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.533+0000 7fa99e4f8b80 20 client.21957 trim_cache size 0 max 16384 2023-03-17T11:58:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 Processor -- start 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 -- start start 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d587dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d588a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d5888fb0 con 0x55b8d5888be0 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d587e000 con 0x55b8d58894f0 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d587a5f0 con 0x55b8d5883960 2023-03-17T11:58:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d588a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d588a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58282/0 (socket says 172.21.15.35:58282) 2023-03-17T11:58:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.548+0000 7fa98b7fe700 1 -- 172.21.15.35:0/3704264883 learned_addr learned my addr 172.21.15.35:0/3704264883 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98bfff700 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d587dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa990908700 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98b7fe700 1 -- 172.21.15.35:0/3704264883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 msgr2=0x55b8d587dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d587dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:15.120 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98b7fe700 1 -- 172.21.15.35:0/3704264883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 msgr2=0x55b8d588efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98b7fe700 1 -- 172.21.15.35:0/3704264883 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8d579c130 con 0x55b8d5888be0 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d588a0a0 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7fa98c06a350 tx=0x7fa98000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac8ab87edc88a70 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa972ffd700 1 -- 172.21.15.35:0/3704264883 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980025070 con 0x55b8d5888be0 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa972ffd700 1 -- 172.21.15.35:0/3704264883 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa98001e430 con 0x55b8d5888be0 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.549+0000 7fa972ffd700 1 -- 172.21.15.35:0/3704264883 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980010690 con 0x55b8d5888be0 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/3704264883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 msgr2=0x55b8d588a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d588a0a0 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7fa98c06a350 tx=0x7fa98000af90 comp rx=0 tx=0).stop 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/3704264883 shutdown_connections 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d588efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d587dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/3704264883 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d588a0a0 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/3704264883 >> 172.21.15.35:0/3704264883 conn(0x55b8d56e06b0 msgr2=0x55b8d5889990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/3704264883 shutdown_connections 2023-03-17T11:58:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/3704264883 wait complete. 2023-03-17T11:58:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 -- start start 2023-03-17T11:58:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 Processor -- start 2023-03-17T11:58:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d5893c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d5891ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.550+0000 7fa99e4f8b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d5892410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d5894500 con 0x55b8d5888be0 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d5892950 con 0x55b8d58894f0 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8d5892ac0 con 0x55b8d5883960 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 10 client.0 _ll_register_callbacks cb 0x55b8d567b230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d5891ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d5891ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58288/0 (socket says 172.21.15.35:58288) 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 -- 172.21.15.35:0/2942309187 learned_addr learned my addr 172.21.15.35:0/2942309187 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98bfff700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d5893c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa990908700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d5892410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 -- 172.21.15.35:0/2942309187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 msgr2=0x55b8d5893c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d5893c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 -- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 msgr2=0x55b8d5892410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d5892410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 -- 172.21.15.35:0/2942309187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98000e970 con 0x55b8d5888be0 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa990908700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d5892410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa98b7fe700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d5891ed0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fa98002b000 tx=0x7fa98001ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e894534d24b689 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa96b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2942309187 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980025040 con 0x55b8d5888be0 2023-03-17T11:58:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2942309187 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa980026250 con 0x55b8d5888be0 2023-03-17T11:58:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8d58531e0 con 0x55b8d5888be0 2023-03-17T11:58:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2942309187 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa980026410 con 0x55b8d5888be0 2023-03-17T11:58:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 10 client.21963 fetch_fsmap learned FSMap version 110 2023-03-17T11:58:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.551+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55b8d562a1f0 con 0x55b8d5888be0 2023-03-17T11:58:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2942309187 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b8d58531e0 con 0x55b8d5888be0 2023-03-17T11:58:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2942309187 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa980004910 con 0x55b8d5888be0 2023-03-17T11:58:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa99e4f8b80 10 client.21963 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa99e4f8b80 10 client.21963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa99e4f8b80 20 client.21963 populate_metadata read hostname 'smithi035' 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d58f2120 0x55b8d58f4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa99e4f8b80 4 client.21963 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b8d5659f00 con 0x55b8d58f2120 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa98bfff700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d58f2120 0x55b8d58f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa98bfff700 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d58f2120 0x55b8d58f4530 crc :-1 s=READY pgs=815 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a559e1aeca8e810 server_cookie=4b4d6f8be478364f in_seq=0 out_seq=0 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.552+0000 7fa96b7fe700 10 client.21963 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.561+0000 7fa96b7fe700 1 -- 172.21.15.35:0/2942309187 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b8d5659f00 con 0x55b8d58f2120 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.561+0000 7fa96b7fe700 10 client.21963 handle_command_reply: tid=0 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 client.21963 shutdown 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 msgr2=0x55b8d5891ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d5891ed0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fa98002b000 tx=0x7fa98001ff90 comp rx=0 tx=0).stop 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 shutdown_connections 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b8d58f2120 0x55b8d58f4530 crc :-1 s=READY pgs=815 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b8d58894f0 0x55b8d5892410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa96b7fe700 0 client.21963 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8d5883960 0x55b8d5893c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 --2- 172.21.15.35:0/2942309187 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b8d5888be0 0x55b8d5891ed0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 >> 172.21.15.35:0/2942309187 conn(0x55b8d56e06b0 msgr2=0x55b8d5887790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 shutdown_connections 2023-03-17T11:58:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 1 -- 172.21.15.35:0/2942309187 wait complete. 2023-03-17T11:58:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.562+0000 7fa99e4f8b80 20 client.21963 trim_cache size 0 max 16384 2023-03-17T11:58:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa97409f640 msgr2=0x7fa9740a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa97409f640 0x7fa9740a1af0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa980005fd0 tx=0x7fa98000af20 comp rx=0 tx=0).stop 2023-03-17T11:58:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 msgr2=0x7fa98c1951e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 0x7fa98c1951e0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00d980 tx=0x7fa97c00dd40 comp rx=0 tx=0).stop 2023-03-17T11:58:17.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 shutdown_connections 2023-03-17T11:58:17.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa97409f640 0x7fa9740a1af0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c104390 0x7fa98c199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa98c0ff350 0x7fa98c1951e0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:17.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 --2- 172.21.15.35:0/977992019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa98c0ffcf0 0x7fa98c195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 >> 172.21.15.35:0/977992019 conn(0x7fa98c076330 msgr2=0x7fa98c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 shutdown_connections 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:45.563+0000 7fa99236b700 1 -- 172.21.15.35:0/977992019 wait complete. 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/4187926456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b181054f0 msgr2=0x7f6b1810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/4187926456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b181054f0 0x7f6b1810d100 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000b0d0 tx=0x7f6b1000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/4187926456 shutdown_connections 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/4187926456 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b181054f0 0x7f6b1810d100 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/4187926456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18100be0 0x7f6b18100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/4187926456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b18101580 0x7f6b18104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/4187926456 >> 172.21.15.35:0/4187926456 conn(0x7f6b180774e0 msgr2=0x7f6b180778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/4187926456 shutdown_connections 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.684+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/4187926456 wait complete. 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 Processor -- start 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 -- start start 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 0x7f6b18196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18101580 0x7f6b18196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b181054f0 0x7f6b1819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819b330 con 0x7f6b18100be0 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819b4a0 con 0x7f6b181054f0 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ecf1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819b660 con 0x7f6b18101580 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 0x7f6b18196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 0x7f6b18196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58300/0 (socket says 172.21.15.35:58300) 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/3824461823 learned_addr learned my addr 172.21.15.35:0/3824461823 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b181054f0 0x7f6b1819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b17fff700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18101580 0x7f6b18196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/3824461823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18101580 msgr2=0x7f6b18196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18101580 0x7f6b18196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/3824461823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b181054f0 msgr2=0x7f6b1819acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b181054f0 0x7f6b1819acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/3824461823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009d00 con 0x7f6b18100be0 2023-03-17T11:58:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.685+0000 7f6b17fff700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18101580 0x7f6b18196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:58:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.686+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 0x7f6b18196350 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800d950 tx=0x7f6b0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:19.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:47 smithi035 ceph-mon[92535]: pgmap v6034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:19.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:48 smithi035 ceph-mon[92535]: pgmap v6035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:19.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:51 smithi035 ceph-mon[92535]: pgmap v6036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:19.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:53 smithi035 ceph-mon[92535]: pgmap v6037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T11:58:19.134 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:55 smithi035 ceph-mon[92535]: pgmap v6038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:57 smithi035 ceph-mon[92535]: pgmap v6039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:48:58 smithi035 ceph-mon[92535]: pgmap v6040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:01 smithi035 ceph-mon[92535]: pgmap v6041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:03 smithi035 ceph-mon[92535]: pgmap v6042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 23 KiB/s wr, 12 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:05 smithi035 ceph-mon[92535]: pgmap v6043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:07 smithi035 ceph-mon[92535]: pgmap v6044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:08 smithi035 ceph-mon[92535]: pgmap v6045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:08 smithi035 ceph-mon[92535]: pgmap v6046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:10 smithi035 ceph-mon[92535]: pgmap v6047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:10 smithi035 ceph-mon[92535]: osdmap e446: 12 total, 12 up, 12 in 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:12 smithi035 ceph-mon[92535]: pgmap v6049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T11:58:19.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:14 smithi035 ceph-mon[92535]: pgmap v6050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T11:58:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:16 smithi035 ceph-mon[92535]: pgmap v6051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:58:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:18 smithi035 ceph-mon[92535]: pgmap v6052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:58:19.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:18 smithi035 ceph-mon[92535]: osdmap e447: 12 total, 12 up, 12 in 2023-03-17T11:58:21.870 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:20 smithi035 ceph-mon[92535]: pgmap v6054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T11:58:23.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:22 smithi035 ceph-mon[92535]: pgmap v6055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:58:23.326 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:24 smithi035 ceph-mon[92535]: pgmap v6056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:58:23.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:26 smithi035 ceph-mon[92535]: pgmap v6057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:58:23.327 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:28 smithi035 ceph-mon[92535]: pgmap v6058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:30 smithi035 ceph-mon[92535]: pgmap v6059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:32 smithi035 ceph-mon[92535]: pgmap v6060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:34 smithi035 ceph-mon[92535]: pgmap v6061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:36 smithi035 ceph-mon[92535]: pgmap v6062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:38 smithi035 ceph-mon[92535]: pgmap v6063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:40 smithi035 ceph-mon[92535]: pgmap v6064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:23.928 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:42 smithi035 ceph-mon[92535]: pgmap v6065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:44 smithi035 ceph-mon[92535]: pgmap v6066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:46 smithi035 ceph-mon[92535]: pgmap v6067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:48 smithi035 ceph-mon[92535]: pgmap v6068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:50 smithi035 ceph-mon[92535]: pgmap v6069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:52 smithi035 ceph-mon[92535]: pgmap v6070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:54 smithi035 ceph-mon[92535]: pgmap v6071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:56 smithi035 ceph-mon[92535]: pgmap v6072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:49:58 smithi035 ceph-mon[92535]: pgmap v6073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:00 smithi035 ceph-mon[92535]: pgmap v6074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:02 smithi035 ceph-mon[92535]: pgmap v6075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T11:58:23.929 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:04 smithi035 ceph-mon[92535]: pgmap v6076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:06 smithi035 ceph-mon[92535]: pgmap v6077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:08 smithi035 ceph-mon[92535]: pgmap v6078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:09 smithi035 ceph-mon[92535]: pgmap v6079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:09 smithi035 ceph-mon[92535]: pgmap v6080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 59 KiB/s wr, 30 op/s 2023-03-17T11:58:24.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:10 smithi035 ceph-mon[92535]: osdmap e448: 12 total, 12 up, 12 in 2023-03-17T11:58:24.422 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:11 smithi035 ceph-mon[92535]: pgmap v6082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T11:58:24.422 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:58:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:58:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:58:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:58:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:58:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:58:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:58:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.686+0000 7f6b15ffb700 1 -- 172.21.15.35:0/3824461823 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08009940 con 0x7f6b18100be0 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.686+0000 7f6b15ffb700 1 -- 172.21.15.35:0/3824461823 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b08010460 con 0x7f6b18100be0 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.686+0000 7f6b15ffb700 1 -- 172.21.15.35:0/3824461823 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800f620 con 0x7f6b18100be0 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.686+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b181101c0 con 0x7f6b18100be0 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.686+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18110030 con 0x7f6b18100be0 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.688+0000 7f6b15ffb700 1 -- 172.21.15.35:0/3824461823 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f6b080105d0 con 0x7f6b18100be0 2023-03-17T11:58:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.689+0000 7f6b15ffb700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6b0409f6c0 0x7f6b040a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.689+0000 7f6b15ffb700 1 -- 172.21.15.35:0/3824461823 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6b080ca3b0 con 0x7f6b18100be0 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.689+0000 7f6b17fff700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6b0409f6c0 0x7f6b040a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b17fff700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6b0409f6c0 0x7f6b040a1b70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6b00005fd0 tx=0x7f6b00005db0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 Processor -- start 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 -- start start 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316ab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5315b2010 con 0x55e5316b0be0 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e531604950 con 0x55e5316b14f0 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5315fdde0 con 0x55e5316ab960 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.690+0000 7f6b1ca8d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58308/0 (socket says 172.21.15.35:58308) 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/575361126 learned_addr learned my addr 172.21.15.35:0/575361126 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:28.281 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b17fff700 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/575361126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 msgr2=0x55e5316abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/575361126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 msgr2=0x55e5316ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 -- 172.21.15.35:0/575361126 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e53147f5d0 con 0x55e5316b0be0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b17fff700 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b0fb0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f6b08097df0 tx=0x7f6b08097840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e112dba9b60ea8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b0effd700 1 -- 172.21.15.35:0/575361126 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080a0050 con 0x55e5316b0be0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b0effd700 1 -- 172.21.15.35:0/575361126 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b080980c0 con 0x55e5316b0be0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.691+0000 7f6b0effd700 1 -- 172.21.15.35:0/575361126 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0809fdc0 con 0x55e5316b0be0 2023-03-17T11:58:28.282 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/575361126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 msgr2=0x55e5316b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b0fb0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f6b08097df0 tx=0x7f6b08097840 comp rx=0 tx=0).stop 2023-03-17T11:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/575361126 shutdown_connections 2023-03-17T11:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b0fb0 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/575361126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/575361126 >> 172.21.15.35:0/575361126 conn(0x55e5315086b0 msgr2=0x55e5316a5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/575361126 shutdown_connections 2023-03-17T11:58:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/575361126 wait complete. 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 -- start start 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.692+0000 7f6b2ae7eb80 1 Processor -- start 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316b5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5314818c0 con 0x55e5316b0be0 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316b7920 con 0x55e5316b14f0 2023-03-17T11:58:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316becd0 con 0x55e5316ab960 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b2ae7eb80 10 client.0 _ll_register_callbacks cb 0x55e5314a3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58316/0 (socket says 172.21.15.35:58316) 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 -- 172.21.15.35:0/454623364 learned_addr learned my addr 172.21.15.35:0/454623364 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 -- 172.21.15.35:0/454623364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 msgr2=0x55e5316b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 -- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 msgr2=0x55e5316b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 -- 172.21.15.35:0/454623364 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18110030 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6b17fff700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b4d00 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f6b18101950 tx=0x7f6b00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268fe0d545a4a76c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.693+0000 7f6af7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6af7fff700 1 -- 172.21.15.35:0/454623364 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00004a30 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6af7fff700 1 -- 172.21.15.35:0/454623364 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6b00004b90 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5315c0390 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6af7fff700 1 -- 172.21.15.35:0/454623364 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b00004d50 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 10 client.21975 fetch_fsmap learned FSMap version 110 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55e53142bd80 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6af7fff700 1 -- 172.21.15.35:0/454623364 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e5315c0390 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6af7fff700 1 -- 172.21.15.35:0/454623364 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6b00067030 con 0x55e5316b0be0 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 10 client.21975 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 10 client.21975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 20 client.21975 populate_metadata read hostname 'smithi035' 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5316c5050 0x55e5316c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 4 client.21975 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.694+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5315cc600 con 0x55e5316c5050 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.695+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5316c5050 0x55e5316c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.695+0000 7f6af7fff700 10 client.21975 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.695+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5316c5050 0x55e5316c7460 crc :-1 s=READY pgs=816 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c871fa22c3f55391 server_cookie=92ff196987c0b752 in_seq=0 out_seq=0 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6af7fff700 1 -- 172.21.15.35:0/454623364 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e5315cc600 con 0x55e5316c5050 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6af7fff700 10 client.21975 handle_command_reply: tid=0 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 client.21975 shutdown 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 msgr2=0x55e5316b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b4d00 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f6b18101950 tx=0x7f6b00004750 comp rx=0 tx=0).stop 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 shutdown_connections 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e5316c5050 0x55e5316c7460 crc :-1 s=READY pgs=816 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b14f0 0x55e5316b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/454623364 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b0be0 0x55e5316b4d00 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6af7fff700 0 client.21975 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 >> 172.21.15.35:0/454623364 conn(0x55e5315086b0 msgr2=0x55e5316aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 shutdown_connections 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/454623364 wait complete. 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.696+0000 7f6b2ae7eb80 20 client.21975 trim_cache size 0 max 16384 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 Processor -- start 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 -- start start 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316a10f0 con 0x55e5316b14f0 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316a6b70 con 0x55e5316b0be0 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316a6000 con 0x55e5316ab960 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b1d28e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b1d28e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58326/0 (socket says 172.21.15.35:58326) 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b1d28e700 1 -- 172.21.15.35:0/1083842737 learned_addr learned my addr 172.21.15.35:0/1083842737 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.711+0000 7f6b17fff700 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1d28e700 1 -- 172.21.15.35:0/1083842737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 msgr2=0x55e5316a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1d28e700 1 -- 172.21.15.35:0/1083842737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 msgr2=0x55e5316b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1d28e700 1 -- 172.21.15.35:0/1083842737 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5315c4130 con 0x55e5316b14f0 2023-03-17T11:58:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:58:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316ae6b0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f6b10015000 tx=0x7f6b1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fd7ce2c031b9e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b0f7fe700 1 -- 172.21.15.35:0/1083842737 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000e040 con 0x55e5316b14f0 2023-03-17T11:58:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b0f7fe700 1 -- 172.21.15.35:0/1083842737 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b10003e90 con 0x55e5316b14f0 2023-03-17T11:58:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.712+0000 7f6b0f7fe700 1 -- 172.21.15.35:0/1083842737 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10005650 con 0x55e5316b14f0 2023-03-17T11:58:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/1083842737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 msgr2=0x55e5316ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316ae6b0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f6b10015000 tx=0x7f6b1000b040 comp rx=0 tx=0).stop 2023-03-17T11:58:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/1083842737 shutdown_connections 2023-03-17T11:58:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316ae6b0 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:37.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/1083842737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/1083842737 >> 172.21.15.35:0/1083842737 conn(0x55e5315086b0 msgr2=0x55e5316bf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/1083842737 shutdown_connections 2023-03-17T11:58:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/1083842737 wait complete. 2023-03-17T11:58:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- start start 2023-03-17T11:58:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 Processor -- start 2023-03-17T11:58:37.359 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316ba430 con 0x55e5316b14f0 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316ba5a0 con 0x55e5316b0be0 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5316ba760 con 0x55e5316ab960 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.713+0000 7f6b2ae7eb80 10 client.0 _ll_register_callbacks cb 0x55e5314a3230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58332/0 (socket says 172.21.15.35:58332) 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 -- 172.21.15.35:0/2599302195 learned_addr learned my addr 172.21.15.35:0/2599302195 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b17fff700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 -- 172.21.15.35:0/2599302195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 msgr2=0x55e5316bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 -- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 msgr2=0x55e5316bbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316bbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 -- 172.21.15.35:0/2599302195 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1810d940 con 0x55e5316b14f0 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b1d28e700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316b9d60 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000d010 tx=0x7f6b100076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92afd2965fc2536 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6af7fff700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6af7fff700 1 -- 172.21.15.35:0/2599302195 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000e040 con 0x55e5316b14f0 2023-03-17T11:58:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6af7fff700 1 -- 172.21.15.35:0/2599302195 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(418..418 src has 1..418) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f6b100056e0 con 0x55e5316b14f0 2023-03-17T11:58:38.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e53167b1e0 con 0x55e5316b14f0 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6af7fff700 1 -- 172.21.15.35:0/2599302195 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b10009480 con 0x55e5316b14f0 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b2ae7eb80 10 client.21981 fetch_fsmap learned FSMap version 110 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.714+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55e5314521f0 con 0x55e5316b14f0 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6af7fff700 1 -- 172.21.15.35:0/2599302195 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e53167b1e0 con 0x55e5316b14f0 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6af7fff700 1 -- 172.21.15.35:0/2599302195 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f6b10023020 con 0x55e5316b14f0 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b2ae7eb80 10 client.21981 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b2ae7eb80 10 client.21981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b2ae7eb80 20 client.21981 populate_metadata read hostname 'smithi035' 2023-03-17T11:58:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e531719d10 0x55e53171c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:40.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:13 smithi035 ceph-mon[92535]: pgmap v6083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T11:58:40.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:13 smithi035 ceph-mon[92535]: osdmap e449: 12 total, 12 up, 12 in 2023-03-17T11:58:40.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b2ae7eb80 4 client.21981 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:58:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e531481f00 con 0x55e531719d10 2023-03-17T11:58:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e531719d10 0x55e53171c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6af7fff700 10 client.21981 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.715+0000 7f6b1ca8d700 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e531719d10 0x55e53171c120 crc :-1 s=READY pgs=817 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0d2c6e4d8ec74a server_cookie=7b4f0baa17d36584 in_seq=0 out_seq=0 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6af7fff700 1 -- 172.21.15.35:0/2599302195 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e531481f00 con 0x55e531719d10 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6af7fff700 10 client.21981 handle_command_reply: tid=0 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 client.21981 shutdown 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 msgr2=0x55e5316b9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316b9d60 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000d010 tx=0x7f6b100076d0 comp rx=0 tx=0).stop 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 shutdown_connections 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e531719d10 0x55e53171c120 crc :-1 s=READY pgs=817 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e5316b14f0 0x55e5316b9d60 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6af7fff700 0 client.21981 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e5316ab960 0x55e5316bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 --2- 172.21.15.35:0/2599302195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5316b0be0 0x55e5316bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 >> 172.21.15.35:0/2599302195 conn(0x55e5315086b0 msgr2=0x55e5316b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 shutdown_connections 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 1 -- 172.21.15.35:0/2599302195 wait complete. 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.725+0000 7f6b2ae7eb80 20 client.21981 trim_cache size 0 max 16384 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6b0409f6c0 msgr2=0x7f6b040a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6b0409f6c0 0x7f6b040a1b70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6b00005fd0 tx=0x7f6b00005db0 comp rx=0 tx=0).stop 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 msgr2=0x7f6b18196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 0x7f6b18196350 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800d950 tx=0x7f6b0800dc60 comp rx=0 tx=0).stop 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 shutdown_connections 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f6b0409f6c0 0x7f6b040a1b70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b181054f0 0x7f6b1819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f6b18100be0 0x7f6b18196350 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 --2- 172.21.15.35:0/3824461823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b18101580 0x7f6b18196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 >> 172.21.15.35:0/3824461823 conn(0x7f6b180774e0 msgr2=0x7f6b180fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:45.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 shutdown_connections 2023-03-17T11:58:45.402 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:35:58.726+0000 7f6b1ecf1700 1 -- 172.21.15.35:0/3824461823 wait complete. 2023-03-17T11:58:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.523+0000 7f2a703a6700 1 -- 172.21.15.35:0/3633513237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a68104390 msgr2=0x7f2a6810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:46.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.523+0000 7f2a703a6700 1 --2- 172.21.15.35:0/3633513237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a68104390 0x7f2a6810bf60 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000b0d0 tx=0x7f2a6000b3e0 comp rx=0 tx=0).stop 2023-03-17T11:58:46.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 -- 172.21.15.35:0/3633513237 shutdown_connections 2023-03-17T11:58:46.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 --2- 172.21.15.35:0/3633513237 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a68104390 0x7f2a6810bf60 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:46.563 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 --2- 172.21.15.35:0/3633513237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a680ff350 0x7f2a680ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 --2- 172.21.15.35:0/3633513237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a680ffcf0 0x7f2a68103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 -- 172.21.15.35:0/3633513237 >> 172.21.15.35:0/3633513237 conn(0x7f2a68076330 msgr2=0x7f2a68076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 -- 172.21.15.35:0/3633513237 shutdown_connections 2023-03-17T11:58:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 -- 172.21.15.35:0/3633513237 wait complete. 2023-03-17T11:58:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 Processor -- start 2023-03-17T11:58:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 -- start start 2023-03-17T11:58:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a680ff350 0x7f2a681963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 0x7f2a68196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.524+0000 7f2a703a6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a68104390 0x7f2a6819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a703a6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6819b3d0 con 0x7f2a680ffcf0 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a703a6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6819b540 con 0x7f2a680ff350 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a703a6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6819b700 con 0x7f2a68104390 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 0x7f2a68196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 0x7f2a68196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58344/0 (socket says 172.21.15.35:58344) 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 -- 172.21.15.35:0/1357408283 learned_addr learned my addr 172.21.15.35:0/1357408283 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6e142700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a680ff350 0x7f2a681963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6e943700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a68104390 0x7f2a6819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 -- 172.21.15.35:0/1357408283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a68104390 msgr2=0x7f2a6819ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:50.548 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a68104390 0x7f2a6819ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 -- 172.21.15.35:0/1357408283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a680ff350 msgr2=0x7f2a681963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a680ff350 0x7f2a681963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 -- 172.21.15.35:0/1357408283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a60009d00 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a6d941700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 0x7f2a68196930 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800d950 tx=0x7f2a5800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a5f7fe700 1 -- 172.21.15.35:0/1357408283 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58009930 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a5f7fe700 1 -- 172.21.15.35:0/1357408283 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a58010460 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6810f010 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a5f7fe700 1 -- 172.21.15.35:0/1357408283 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800f620 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.525+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6810ee80 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.528+0000 7f2a5f7fe700 1 -- 172.21.15.35:0/1357408283 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2a58009a90 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.528+0000 7f2a5f7fe700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a5409f6c0 0x7f2a540a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.528+0000 7f2a5f7fe700 1 -- 172.21.15.35:0/1357408283 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2a580ca0c0 con 0x7f2a680ffcf0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.529+0000 7f2a6e142700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a5409f6c0 0x7f2a540a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.529+0000 7f2a6e142700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a5409f6c0 0x7f2a540a1b70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009c60 tx=0x7f2a64009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:50.549 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.529+0000 7f2a7c533b80 1 Processor -- start 2023-03-17T11:58:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.529+0000 7f2a7c533b80 1 -- start start 2023-03-17T11:58:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3255fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 0x55a6b3250420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b3250960 0x55a6b3250d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3157010 con 0x55a6b32564f0 2023-03-17T11:58:50.550 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b31a9950 con 0x55a6b3255be0 2023-03-17T11:58:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b31a2de0 con 0x55a6b3250960 2023-03-17T11:58:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 0x55a6b3250420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 0x55a6b3250420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58352/0 (socket says 172.21.15.35:58352) 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 -- 172.21.15.35:0/2887430112 learned_addr learned my addr 172.21.15.35:0/2887430112 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6e142700 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3255fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6e943700 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b3250960 0x55a6b3250d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 -- 172.21.15.35:0/2887430112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b3250960 msgr2=0x55a6b3250d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b3250960 0x55a6b3250d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 -- 172.21.15.35:0/2887430112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 msgr2=0x55a6b3255fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3255fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 -- 172.21.15.35:0/2887430112 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6b30245d0 con 0x55a6b32564f0 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a6d941700 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 0x55a6b3250420 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f2a58094070 tx=0x7f2a58097780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbe9fc09adbb8fe server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.530+0000 7f2a5cdae700 1 -- 172.21.15.35:0/2887430112 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5809fd60 con 0x55a6b32564f0 2023-03-17T11:58:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a5cdae700 1 -- 172.21.15.35:0/2887430112 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a58095f10 con 0x55a6b32564f0 2023-03-17T11:58:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a5cdae700 1 -- 172.21.15.35:0/2887430112 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58097060 con 0x55a6b32564f0 2023-03-17T11:58:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2887430112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 msgr2=0x55a6b3250420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 0x55a6b3250420 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f2a58094070 tx=0x7f2a58097780 comp rx=0 tx=0).stop 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2887430112 shutdown_connections 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b3250960 0x55a6b3250d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3255fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2887430112 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b32564f0 0x55a6b3250420 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2887430112 >> 172.21.15.35:0/2887430112 conn(0x55a6b30ad6b0 msgr2=0x55a6b324aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2887430112 shutdown_connections 2023-03-17T11:58:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.531+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2887430112 wait complete. 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 -- start start 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 Processor -- start 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 0x55a6b325c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3259780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3259e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b30268c0 con 0x55a6b3250960 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b325a590 con 0x55a6b3255be0 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3265e50 con 0x55a6b32564f0 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a7c533b80 10 client.0 _ll_register_callbacks cb 0x55a6b3048230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a6e142700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 0x55a6b325c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a6e142700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 0x55a6b325c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58356/0 (socket says 172.21.15.35:58356) 2023-03-17T11:58:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a6e142700 1 -- 172.21.15.35:0/7979461 learned_addr learned my addr 172.21.15.35:0/7979461 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.532+0000 7f2a6d941700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3259780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e142700 1 -- 172.21.15.35:0/7979461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 msgr2=0x55a6b3259e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e943700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3259e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e142700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3259e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e142700 1 -- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 msgr2=0x55a6b3259780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e142700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3259780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e142700 1 -- 172.21.15.35:0/7979461 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6810ee80 con 0x55a6b3250960 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6d941700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3259780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a6e142700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 0x55a6b325c490 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f2a6401ec10 tx=0x7f2a640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f994ac33392197d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a51ffb700 1 -- 172.21.15.35:0/7979461 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400ec20 con 0x55a6b3250960 2023-03-17T11:58:59.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a51ffb700 1 -- 172.21.15.35:0/7979461 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2a6400ed80 con 0x55a6b3250960 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6b3165390 con 0x55a6b3250960 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a51ffb700 1 -- 172.21.15.35:0/7979461 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a64031420 con 0x55a6b3250960 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a7c533b80 10 client.21993 fetch_fsmap learned FSMap version 110 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55a6b2fd0d80 con 0x55a6b3250960 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a51ffb700 1 -- 172.21.15.35:0/7979461 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6b3165390 con 0x55a6b3250960 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.533+0000 7f2a51ffb700 1 -- 172.21.15.35:0/7979461 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2a6401c410 con 0x55a6b3250960 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a7c533b80 10 client.21993 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a7c533b80 10 client.21993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:58:59.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a7c533b80 20 client.21993 populate_metadata read hostname 'smithi035' 2023-03-17T11:59:00.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b326a070 0x55a6b326c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:00.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a7c533b80 4 client.21993 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:59:00.419 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6b3171600 con 0x55a6b326a070 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a6d941700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b326a070 0x55a6b326c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a51ffb700 10 client.21993 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.534+0000 7f2a6d941700 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b326a070 0x55a6b326c480 crc :-1 s=READY pgs=818 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e31a728230efd8 server_cookie=b7b05be7d80512ac in_seq=0 out_seq=0 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a51ffb700 1 -- 172.21.15.35:0/7979461 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55a6b3171600 con 0x55a6b326a070 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a51ffb700 10 client.21993 handle_command_reply: tid=0 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 client.21993 shutdown 2023-03-17T11:59:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 msgr2=0x55a6b325c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 0x55a6b325c490 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f2a6401ec10 tx=0x7f2a640047c0 comp rx=0 tx=0).stop 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 shutdown_connections 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b326a070 0x55a6b326c480 crc :-1 s=READY pgs=818 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3259e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a51ffb700 0 client.21993 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3250960 0x55a6b325c490 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/7979461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3255be0 0x55a6b3259780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 >> 172.21.15.35:0/7979461 conn(0x55a6b30ad6b0 msgr2=0x55a6b324f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 shutdown_connections 2023-03-17T11:59:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 1 -- 172.21.15.35:0/7979461 wait complete. 2023-03-17T11:59:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.535+0000 7f2a7c533b80 20 client.21993 trim_cache size 0 max 16384 2023-03-17T11:59:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.550+0000 7f2a7c533b80 1 Processor -- start 2023-03-17T11:59:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.550+0000 7f2a7c533b80 1 -- start start 2023-03-17T11:59:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.550+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b3260d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.550+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3258f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b32676a0 con 0x55a6b3255be0 2023-03-17T11:59:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b324b380 con 0x55a6b3250960 2023-03-17T11:59:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3247b60 con 0x55a6b32564f0 2023-03-17T11:59:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:08.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:15 smithi035 ceph-mon[92535]: pgmap v6085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58366/0 (socket says 172.21.15.35:58366) 2023-03-17T11:59:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 -- 172.21.15.35:0/857704558 learned_addr learned my addr 172.21.15.35:0/857704558 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6e142700 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b3260d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6e943700 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3258f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 -- 172.21.15.35:0/857704558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 msgr2=0x55a6b3258f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3258f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 -- 172.21.15.35:0/857704558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 msgr2=0x55a6b3260d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b3260d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 -- 172.21.15.35:0/857704558 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6b3251000 con 0x55a6b3255be0 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6e142700 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b3260d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a6d941700 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325c030 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f2a580c7dd0 tx=0x7f2a58093fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84292ec7c6d9ef46 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a5d5af700 1 -- 172.21.15.35:0/857704558 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5809fd60 con 0x55a6b3255be0 2023-03-17T11:59:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a5d5af700 1 -- 172.21.15.35:0/857704558 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a58095f10 con 0x55a6b3255be0 2023-03-17T11:59:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.551+0000 7f2a5d5af700 1 -- 172.21.15.35:0/857704558 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580972c0 con 0x55a6b3255be0 2023-03-17T11:59:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 -- 172.21.15.35:0/857704558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 msgr2=0x55a6b325c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325c030 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f2a580c7dd0 tx=0x7f2a58093fe0 comp rx=0 tx=0).stop 2023-03-17T11:59:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 -- 172.21.15.35:0/857704558 shutdown_connections 2023-03-17T11:59:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b3258f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b3260d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/857704558 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325c030 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 -- 172.21.15.35:0/857704558 >> 172.21.15.35:0/857704558 conn(0x55a6b30ad6b0 msgr2=0x55a6b324c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 -- 172.21.15.35:0/857704558 shutdown_connections 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 -- 172.21.15.35:0/857704558 wait complete. 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 -- start start 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.552+0000 7f2a7c533b80 1 Processor -- start 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b325ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b32bb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b32bb930 con 0x55a6b3255be0 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b32bbaa0 con 0x55a6b3250960 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b32bbc60 con 0x55a6b32564f0 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 10 client.0 _ll_register_callbacks cb 0x55a6b3048230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58372/0 (socket says 172.21.15.35:58372) 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 -- 172.21.15.35:0/2828803027 learned_addr learned my addr 172.21.15.35:0/2828803027 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6e142700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b325ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6e943700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b32bb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 -- 172.21.15.35:0/2828803027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 msgr2=0x55a6b32bb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b32bb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 -- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 msgr2=0x55a6b325ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b325ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 -- 172.21.15.35:0/2828803027 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6b30245d0 con 0x55a6b3255be0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a6d941700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325f470 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f2a580c7900 tx=0x7f2a58097580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad0b7d64e69adba server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a51ffb700 1 -- 172.21.15.35:0/2828803027 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58097dd0 con 0x55a6b3255be0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a51ffb700 1 -- 172.21.15.35:0/2828803027 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f2a580b2050 con 0x55a6b3255be0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6b32201e0 con 0x55a6b3255be0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a51ffb700 1 -- 172.21.15.35:0/2828803027 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a58097f30 con 0x55a6b3255be0 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 10 client.21999 fetch_fsmap learned FSMap version 110 2023-03-17T11:59:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.553+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55a6b2fb9c00 con 0x55a6b3255be0 2023-03-17T11:59:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a51ffb700 1 -- 172.21.15.35:0/2828803027 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6b32201e0 con 0x55a6b3255be0 2023-03-17T11:59:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a51ffb700 1 -- 172.21.15.35:0/2828803027 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f2a580b4030 con 0x55a6b3255be0 2023-03-17T11:59:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a7c533b80 10 client.21999 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:59:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a7c533b80 10 client.21999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:59:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a7c533b80 20 client.21999 populate_metadata read hostname 'smithi035' 2023-03-17T11:59:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b32c2e00 0x55a6b32c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a7c533b80 4 client.21999 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:59:12.437 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a6b3026f00 con 0x55a6b32c2e00 2023-03-17T11:59:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a6e142700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b32c2e00 0x55a6b32c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a51ffb700 10 client.21999 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.554+0000 7f2a6e142700 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b32c2e00 0x55a6b32c51e0 crc :-1 s=READY pgs=819 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d3f55a37d232411 server_cookie=72c0562a97b265bc in_seq=0 out_seq=0 2023-03-17T11:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a51ffb700 1 -- 172.21.15.35:0/2828803027 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a6b3026f00 con 0x55a6b32c2e00 2023-03-17T11:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a51ffb700 10 client.21999 handle_command_reply: tid=0 2023-03-17T11:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 client.21999 shutdown 2023-03-17T11:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 msgr2=0x55a6b325f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325f470 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f2a580c7900 tx=0x7f2a58097580 comp rx=0 tx=0).stop 2023-03-17T11:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 shutdown_connections 2023-03-17T11:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55a6b32c2e00 0x55a6b32c51e0 crc :-1 s=READY pgs=819 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6b32564f0 0x55a6b32bb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a51ffb700 0 client.21999 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a6b3250960 0x55a6b325ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 --2- 172.21.15.35:0/2828803027 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55a6b3255be0 0x55a6b325f470 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 >> 172.21.15.35:0/2828803027 conn(0x55a6b30ad6b0 msgr2=0x55a6b3253650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:24.128 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 shutdown_connections 2023-03-17T11:59:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 1 -- 172.21.15.35:0/2828803027 wait complete. 2023-03-17T11:59:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.572+0000 7f2a7c533b80 20 client.21999 trim_cache size 0 max 16384 2023-03-17T11:59:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a5409f6c0 msgr2=0x7f2a540a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a5409f6c0 0x7f2a540a1b70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009c60 tx=0x7f2a64009260 comp rx=0 tx=0).stop 2023-03-17T11:59:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 msgr2=0x7f2a68196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 0x7f2a68196930 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800d950 tx=0x7f2a5800dc60 comp rx=0 tx=0).stop 2023-03-17T11:59:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 shutdown_connections 2023-03-17T11:59:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f2a5409f6c0 0x7f2a540a1b70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a68104390 0x7f2a6819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a680ff350 0x7f2a681963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 --2- 172.21.15.35:0/1357408283 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2a680ffcf0 0x7f2a68196930 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 >> 172.21.15.35:0/1357408283 conn(0x7f2a68076330 msgr2=0x7f2a68068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 shutdown_connections 2023-03-17T11:59:28.591 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:41.573+0000 7f2a703a6700 1 -- 172.21.15.35:0/1357408283 wait complete. 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 -- 172.21.15.35:0/1728615712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 msgr2=0x7f957c10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 --2- 172.21.15.35:0/1728615712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c10bf60 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f957400b0d0 tx=0x7f957400b3e0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 -- 172.21.15.35:0/1728615712 shutdown_connections 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 --2- 172.21.15.35:0/1728615712 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c10bf60 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 --2- 172.21.15.35:0/1728615712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f957c0ff350 0x7f957c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 --2- 172.21.15.35:0/1728615712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c0ffcf0 0x7f957c103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.695+0000 7f9582119700 1 -- 172.21.15.35:0/1728615712 >> 172.21.15.35:0/1728615712 conn(0x7f957c076330 msgr2=0x7f957c076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.696+0000 7f9582119700 1 -- 172.21.15.35:0/1728615712 shutdown_connections 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.696+0000 7f9582119700 1 -- 172.21.15.35:0/1728615712 wait complete. 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.696+0000 7f9582119700 1 Processor -- start 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.696+0000 7f9582119700 1 -- start start 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c0ff350 0x7f957c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f957c0ffcf0 0x7f957c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c19b390 con 0x7f957c104390 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c19b500 con 0x7f957c0ff350 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c19b6c0 con 0x7f957c0ffcf0 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c19ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58388/0 (socket says 172.21.15.35:58388) 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f957c0ffcf0 0x7f957c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 -- 172.21.15.35:0/4232193379 learned_addr learned my addr 172.21.15.35:0/4232193379 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957b7fe700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c0ff350 0x7f957c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 -- 172.21.15.35:0/4232193379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f957c0ffcf0 msgr2=0x7f957c1968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f957c0ffcf0 0x7f957c1968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 -- 172.21.15.35:0/4232193379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c0ff350 msgr2=0x7f957c1963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c0ff350 0x7f957c1963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 -- 172.21.15.35:0/4232193379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9574009d00 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f957bfff700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c19ad50 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f9574009380 tx=0x7f95740093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9578ff9700 1 -- 172.21.15.35:0/4232193379 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400e040 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c10f010 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.697+0000 7f9578ff9700 1 -- 172.21.15.35:0/4232193379 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9574003e10 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.698+0000 7f9578ff9700 1 -- 172.21.15.35:0/4232193379 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957401b940 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.698+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c10ee80 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.700+0000 7f9578ff9700 1 -- 172.21.15.35:0/4232193379 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f9574005690 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.700+0000 7f9578ff9700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956409f640 0x7f95640a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.700+0000 7f9578ff9700 1 -- 172.21.15.35:0/4232193379 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f95740cbc70 con 0x7f957c104390 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f957b7fe700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956409f640 0x7f95640a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f957b7fe700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956409f640 0x7f95640a1af0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9570005950 tx=0x7f957000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 Processor -- start 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 -- start start 2023-03-17T11:59:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c902fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c8fd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c8fdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c804010 con 0x56249c9034f0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c856950 con 0x56249c902be0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.701+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c84fde0 con 0x56249c8fd960 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c8fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c8fd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58394/0 (socket says 172.21.15.35:58394) 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 -- 172.21.15.35:0/2455925728 learned_addr learned my addr 172.21.15.35:0/2455925728 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c902fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957bfff700 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c8fdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 -- 172.21.15.35:0/2455925728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 msgr2=0x56249c8fdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c8fdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 -- 172.21.15.35:0/2455925728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 msgr2=0x56249c902fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c902fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 -- 172.21.15.35:0/2455925728 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56249c6d15d0 con 0x56249c9034f0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f957affd700 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c8fd420 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f956c00bc30 tx=0x7f956c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e180c4f615594d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f9561ffb700 1 -- 172.21.15.35:0/2455925728 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c010d50 con 0x56249c9034f0 2023-03-17T11:59:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f9561ffb700 1 -- 172.21.15.35:0/2455925728 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f956c015070 con 0x56249c9034f0 2023-03-17T11:59:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.702+0000 7f9561ffb700 1 -- 172.21.15.35:0/2455925728 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c005020 con 0x56249c9034f0 2023-03-17T11:59:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2455925728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 msgr2=0x56249c8fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c8fd420 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f956c00bc30 tx=0x7f956c00bf40 comp rx=0 tx=0).stop 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2455925728 shutdown_connections 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c8fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c902fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2455925728 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c8fd420 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2455925728 >> 172.21.15.35:0/2455925728 conn(0x56249c75a6b0 msgr2=0x56249c8f7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2455925728 shutdown_connections 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2455925728 wait complete. 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.703+0000 7f958e2a6b80 1 -- start start 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 Processor -- start 2023-03-17T11:59:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c909440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 0x56249c9066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.966 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:17 smithi035 ceph-mon[92535]: pgmap v6086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T11:59:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c9034f0 0x56249c906cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c6d38c0 con 0x56249c902be0 2023-03-17T11:59:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c907460 con 0x56249c9034f0 2023-03-17T11:59:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c913000 con 0x56249c8fd960 2023-03-17T11:59:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f958e2a6b80 10 client.0 _ll_register_callbacks cb 0x56249c6f5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:59:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f957affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 0x56249c9066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f957affd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 0x56249c9066c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58402/0 (socket says 172.21.15.35:58402) 2023-03-17T11:59:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f957affd700 1 -- 172.21.15.35:0/1033585805 learned_addr learned my addr 172.21.15.35:0/1033585805 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f957bfff700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c9034f0 0x56249c906cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.704+0000 7f957b7fe700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c909440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f957affd700 1 -- 172.21.15.35:0/1033585805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 msgr2=0x56249c909440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:32.033 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f957affd700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c909440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f957affd700 1 -- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c9034f0 msgr2=0x56249c906cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f957affd700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c9034f0 0x56249c906cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f957affd700 1 -- 172.21.15.35:0/1033585805 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c00b860 con 0x56249c902be0 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f957affd700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 0x56249c9066c0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b2b0 tx=0x7f956c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90754cc2c8325917 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f955affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f955affd700 1 -- 172.21.15.35:0/1033585805 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c004450 con 0x56249c902be0 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f955affd700 1 -- 172.21.15.35:0/1033585805 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f956c017070 con 0x56249c902be0 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56249c812390 con 0x56249c902be0 2023-03-17T11:59:32.034 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f955affd700 1 -- 172.21.15.35:0/1033585805 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f956c0045b0 con 0x56249c902be0 2023-03-17T11:59:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 10 client.22011 fetch_fsmap learned FSMap version 110 2023-03-17T11:59:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56249c67dd80 con 0x56249c902be0 2023-03-17T11:59:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f955affd700 1 -- 172.21.15.35:0/1033585805 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56249c812390 con 0x56249c902be0 2023-03-17T11:59:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f955affd700 1 -- 172.21.15.35:0/1033585805 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f956c02e740 con 0x56249c902be0 2023-03-17T11:59:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 10 client.22011 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:59:32.373 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 10 client.22011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:59:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 20 client.22011 populate_metadata read hostname 'smithi035' 2023-03-17T11:59:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c916fd0 0x56249c9193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 4 client.22011 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.705+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56249c81e600 con 0x56249c916fd0 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.706+0000 7f957b7fe700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c916fd0 0x56249c9193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.706+0000 7f955affd700 10 client.22011 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.706+0000 7f957b7fe700 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c916fd0 0x56249c9193e0 crc :-1 s=READY pgs=820 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8c8ef84bcb41d1 server_cookie=fcf32b718d89fc4 in_seq=0 out_seq=0 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f955affd700 1 -- 172.21.15.35:0/1033585805 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56249c81e600 con 0x56249c916fd0 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f955affd700 10 client.22011 handle_command_reply: tid=0 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 client.22011 shutdown 2023-03-17T11:59:34.735 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 msgr2=0x56249c9066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 0x56249c9066c0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b2b0 tx=0x7f956c010d80 comp rx=0 tx=0).stop 2023-03-17T11:59:35.869 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 shutdown_connections 2023-03-17T11:59:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c916fd0 0x56249c9193e0 crc :-1 s=READY pgs=820 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c9034f0 0x56249c906cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c8fd960 0x56249c909440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/1033585805 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c902be0 0x56249c9066c0 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f955affd700 0 client.22011 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:35.870 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 >> 172.21.15.35:0/1033585805 conn(0x56249c75a6b0 msgr2=0x56249c8fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 shutdown_connections 2023-03-17T11:59:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 1 -- 172.21.15.35:0/1033585805 wait complete. 2023-03-17T11:59:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.707+0000 7f958e2a6b80 20 client.22011 trim_cache size 0 max 16384 2023-03-17T11:59:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.722+0000 7f958e2a6b80 1 Processor -- start 2023-03-17T11:59:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.722+0000 7f958e2a6b80 1 -- start start 2023-03-17T11:59:35.871 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 0x56249c8f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:35.872 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c90df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c9034f0 0x56249c9126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c8f8000 con 0x56249c8fd960 2023-03-17T11:59:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c8f30d0 con 0x56249c902be0 2023-03-17T11:59:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c8f45c0 con 0x56249c9034f0 2023-03-17T11:59:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 0x56249c8f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 0x56249c8f7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58406/0 (socket says 172.21.15.35:58406) 2023-03-17T11:59:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 -- 172.21.15.35:0/2255973529 learned_addr learned my addr 172.21.15.35:0/2255973529 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:36.980 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957bfff700 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c9034f0 0x56249c9126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 -- 172.21.15.35:0/2255973529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c9034f0 msgr2=0x56249c9126e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957affd700 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c90df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c9034f0 0x56249c9126e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 -- 172.21.15.35:0/2255973529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 msgr2=0x56249c90df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c90df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 -- 172.21.15.35:0/2255973529 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56249c816130 con 0x56249c8fd960 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957affd700 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c90df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 0x56249c8f7ac0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f9570005d90 tx=0x7f9570013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9535067d43a7fa2 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f95627fc700 1 -- 172.21.15.35:0/2255973529 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570024070 con 0x56249c8fd960 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f95627fc700 1 -- 172.21.15.35:0/2255973529 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9570015070 con 0x56249c8fd960 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.723+0000 7f95627fc700 1 -- 172.21.15.35:0/2255973529 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570026570 con 0x56249c8fd960 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2255973529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 msgr2=0x56249c8f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 0x56249c8f7ac0 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f9570005d90 tx=0x7f9570013000 comp rx=0 tx=0).stop 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2255973529 shutdown_connections 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c9034f0 0x56249c9126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c8fd960 0x56249c8f7ac0 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2255973529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c902be0 0x56249c90df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2255973529 >> 172.21.15.35:0/2255973529 conn(0x56249c75a6b0 msgr2=0x56249c8fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2255973529 shutdown_connections 2023-03-17T11:59:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2255973529 wait complete. 2023-03-17T11:59:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.724+0000 7f958e2a6b80 1 -- start start 2023-03-17T11:59:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 Processor -- start 2023-03-17T11:59:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c8fd960 0x56249c90c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c902be0 0x56249c90cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c90d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c96ae80 con 0x56249c9034f0 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c96afc0 con 0x56249c8fd960 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56249c96b180 con 0x56249c902be0 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f958e2a6b80 10 client.0 _ll_register_callbacks cb 0x56249c6f5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c90d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c90d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58416/0 (socket says 172.21.15.35:58416) 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 -- 172.21.15.35:0/2001138217 learned_addr learned my addr 172.21.15.35:0/2001138217 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957affd700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c902be0 0x56249c90cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c8fd960 0x56249c90c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 -- 172.21.15.35:0/2001138217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c902be0 msgr2=0x56249c90cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c902be0 0x56249c90cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 -- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c8fd960 msgr2=0x56249c90c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c8fd960 0x56249c90c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957bfff700 1 -- 172.21.15.35:0/2001138217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570010c50 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c8fd960 0x56249c90c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.725+0000 7f957affd700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c902be0 0x56249c90cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f957bfff700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c90d0f0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f95740c9460 tx=0x7f95740992f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e73bf82a8a9619 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f955affd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f955affd700 1 -- 172.21.15.35:0/2001138217 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740a1910 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f955affd700 1 -- 172.21.15.35:0/2001138217 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f9574098ca0 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56249c8cd1e0 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f955affd700 1 -- 172.21.15.35:0/2001138217 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9574098e60 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 10 client.22017 fetch_fsmap learned FSMap version 110 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x56249c6a41f0 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f955affd700 1 -- 172.21.15.35:0/2001138217 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56249c8cd1e0 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f955affd700 1 -- 172.21.15.35:0/2001138217 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f957409f2b0 con 0x56249c9034f0 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 10 client.22017 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 10 client.22017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 20 client.22017 populate_metadata read hostname 'smithi035' 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c96c600 0x56249c96ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 4 client.22017 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56249c6d3f00 con 0x56249c96c600 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.726+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c96c600 0x56249c96ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.727+0000 7f955affd700 10 client.22017 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.727+0000 7f957b7fe700 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c96c600 0x56249c96ea10 crc :-1 s=READY pgs=821 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a308e625ae5a6bc3 server_cookie=f9d3dd212169e295 in_seq=0 out_seq=0 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.735+0000 7f955affd700 1 -- 172.21.15.35:0/2001138217 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56249c6d3f00 con 0x56249c96c600 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.735+0000 7f955affd700 10 client.22017 handle_command_reply: tid=0 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.735+0000 7f958e2a6b80 1 client.22017 shutdown 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.735+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 msgr2=0x56249c90d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.735+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c90d0f0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f95740c9460 tx=0x7f95740992f0 comp rx=0 tx=0).stop 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 shutdown_connections 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x56249c96c600 0x56249c96ea10 crc :-1 s=READY pgs=821 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56249c9034f0 0x56249c90d0f0 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56249c8fd960 0x56249c90c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f955affd700 0 client.22017 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T11:59:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 --2- 172.21.15.35:0/2001138217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56249c902be0 0x56249c90cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 >> 172.21.15.35:0/2001138217 conn(0x56249c75a6b0 msgr2=0x56249c913390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 shutdown_connections 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 1 -- 172.21.15.35:0/2001138217 wait complete. 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f958e2a6b80 20 client.22017 trim_cache size 0 max 16384 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956409f640 msgr2=0x7f95640a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956409f640 0x7f95640a1af0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9570005950 tx=0x7f957000b410 comp rx=0 tx=0).stop 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 msgr2=0x7f957c19ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c19ad50 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f9574009380 tx=0x7f95740093b0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 shutdown_connections 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f956409f640 0x7f95640a1af0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f957c104390 0x7f957c19ad50 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f957c0ff350 0x7f957c1963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 --2- 172.21.15.35:0/4232193379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f957c0ffcf0 0x7f957c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 >> 172.21.15.35:0/4232193379 conn(0x7f957c076330 msgr2=0x7f957c067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 shutdown_connections 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:37:54.736+0000 7f9582119700 1 -- 172.21.15.35:0/4232193379 wait complete. 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2506812071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc64104390 msgr2=0x7fcc6410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2506812071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc64104390 0x7fcc6410bf60 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00b0d0 tx=0x7fcc5c00b3e0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2506812071 shutdown_connections 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2506812071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc64104390 0x7fcc6410bf60 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2506812071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc640ff350 0x7fcc640ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2506812071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc640ffcf0 0x7fcc64103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2506812071 >> 172.21.15.35:0/2506812071 conn(0x7fcc64076330 msgr2=0x7fcc64076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2506812071 shutdown_connections 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.860+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2506812071 wait complete. 2023-03-17T11:59:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 Processor -- start 2023-03-17T11:59:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 -- start start 2023-03-17T11:59:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 0x7fcc64196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc640ffcf0 0x7fcc64196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc64104390 0x7fcc6419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6419b330 con 0x7fcc640ff350 2023-03-17T11:59:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6419b4a0 con 0x7fcc64104390 2023-03-17T11:59:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc68f6d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6419b660 con 0x7fcc640ffcf0 2023-03-17T11:59:42.991 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:18 smithi035 ceph-mon[92535]: pgmap v6087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 114 B/s wr, 11 op/s 2023-03-17T11:59:46.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:21 smithi035 ceph-mon[92535]: pgmap v6088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T11:59:46.474 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:23 smithi035 ceph-mon[92535]: pgmap v6089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:25 smithi035 ceph-mon[92535]: pgmap v6090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 459 B/s wr, 9 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:27 smithi035 ceph-mon[92535]: pgmap v6091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:28 smithi035 ceph-mon[92535]: pgmap v6092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:31 smithi035 ceph-mon[92535]: pgmap v6093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:33 smithi035 ceph-mon[92535]: pgmap v6094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:35 smithi035 ceph-mon[92535]: pgmap v6095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:37 smithi035 ceph-mon[92535]: pgmap v6096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:38 smithi035 ceph-mon[92535]: pgmap v6097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:41 smithi035 ceph-mon[92535]: pgmap v6098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:43 smithi035 ceph-mon[92535]: pgmap v6099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:45 smithi035 ceph-mon[92535]: pgmap v6100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:47 smithi035 ceph-mon[92535]: pgmap v6101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:48 smithi035 ceph-mon[92535]: pgmap v6102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:51 smithi035 ceph-mon[92535]: pgmap v6103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:53 smithi035 ceph-mon[92535]: pgmap v6104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:55 smithi035 ceph-mon[92535]: pgmap v6105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:46.475 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:57 smithi035 ceph-mon[92535]: pgmap v6106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:50:58 smithi035 ceph-mon[92535]: pgmap v6107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:01 smithi035 ceph-mon[92535]: pgmap v6108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:03 smithi035 ceph-mon[92535]: pgmap v6109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:05 smithi035 ceph-mon[92535]: pgmap v6110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:07 smithi035 ceph-mon[92535]: pgmap v6111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:08 smithi035 ceph-mon[92535]: pgmap v6112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:08 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:09 smithi035 ceph-mon[92535]: osdmap e450: 12 total, 12 up, 12 in 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:10 smithi035 ceph-mon[92535]: pgmap v6114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:46.476 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:47.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:47.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: pgmap v6115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T11:59:47.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:47.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:47.322 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:48.868 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:48.868 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:48.868 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:50.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T11:59:50.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:59:50.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:50.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:50.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:50.906 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:50.906 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:51.456 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:52.091 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:53.192 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T11:59:53.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T11:59:53.193 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T11:59:54.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T11:59:54.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:14 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T11:59:54.222 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:14 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T11:59:54.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:14 smithi035 ceph-mon[92535]: pgmap v6116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-17T11:59:54.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:14 smithi035 ceph-mon[92535]: pgmap v6117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 322 B/s wr, 16 op/s 2023-03-17T11:59:54.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:16 smithi035 ceph-mon[92535]: pgmap v6118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 161 B/s wr, 8 op/s 2023-03-17T11:59:54.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:18 smithi035 ceph-mon[92535]: pgmap v6119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 136 B/s wr, 6 op/s 2023-03-17T11:59:54.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:18 smithi035 ceph-mon[92535]: osdmap e451: 12 total, 12 up, 12 in 2023-03-17T11:59:54.840 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:20 smithi035 ceph-mon[92535]: pgmap v6121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 161 B/s wr, 8 op/s 2023-03-17T11:59:55.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:22 smithi035 ceph-mon[92535]: pgmap v6122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T11:59:55.625 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:24 smithi035 ceph-mon[92535]: pgmap v6123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:26 smithi035 ceph-mon[92535]: pgmap v6124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:28 smithi035 ceph-mon[92535]: pgmap v6125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:30 smithi035 ceph-mon[92535]: pgmap v6126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:32 smithi035 ceph-mon[92535]: pgmap v6127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:34 smithi035 ceph-mon[92535]: pgmap v6128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:36 smithi035 ceph-mon[92535]: pgmap v6129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:55.626 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:38 smithi035 ceph-mon[92535]: pgmap v6130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T11:59:56.952 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:59:57.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:59:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:59:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:59:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T11:59:57.858 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T11:59:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T11:59:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 0x7fcc64196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 0x7fcc64196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58426/0 (socket says 172.21.15.35:58426) 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 -- 172.21.15.35:0/2745976535 learned_addr learned my addr 172.21.15.35:0/2745976535 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc64104390 0x7fcc6419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc640ffcf0 0x7fcc64196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 -- 172.21.15.35:0/2745976535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc640ffcf0 msgr2=0x7fcc64196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc640ffcf0 0x7fcc64196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 -- 172.21.15.35:0/2745976535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc64104390 msgr2=0x7fcc6419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc64104390 0x7fcc6419acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T11:59:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.861+0000 7fcc6259c700 1 -- 172.21.15.35:0/2745976535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c009d00 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.862+0000 7fcc6259c700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 0x7fcc64196350 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400d950 tx=0x7fcc5400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.862+0000 7fcc537fe700 1 -- 172.21.15.35:0/2745976535 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400f890 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.862+0000 7fcc537fe700 1 -- 172.21.15.35:0/2745976535 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc5400fe80 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.862+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6410efc0 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.862+0000 7fcc537fe700 1 -- 172.21.15.35:0/2745976535 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400e3b0 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.862+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6410ee30 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.865+0000 7fcc537fe700 1 -- 172.21.15.35:0/2745976535 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fcc54010460 con 0x7fcc640ff350 2023-03-17T11:59:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.865+0000 7fcc537fe700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc4c09f6c0 0x7fcc4c0a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T11:59:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.865+0000 7fcc537fe700 1 -- 172.21.15.35:0/2745976535 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcc540ca390 con 0x7fcc640ff350 2023-03-17T12:00:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.865+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc4c09f6c0 0x7fcc4c0a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc4c09f6c0 0x7fcc4c0a1b70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcc64197960 tx=0x7fcc58009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 Processor -- start 2023-03-17T12:00:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 -- start start 2023-03-17T12:00:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc7060420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7060960 0x557cc7060d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc6f67010 con 0x557cc70664f0 2023-03-17T12:00:01.836 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc6fb9950 con 0x557cc7060960 2023-03-17T12:00:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.866+0000 7fcc750fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc6fb2de0 con 0x557cc7065be0 2023-03-17T12:00:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc7060420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc7060420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58436/0 (socket says 172.21.15.35:58436) 2023-03-17T12:00:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 -- 172.21.15.35:0/1720160624 learned_addr learned my addr 172.21.15.35:0/1720160624 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:01.837 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc6259c700 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:01.839 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7060960 0x557cc7060d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 -- 172.21.15.35:0/1720160624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 msgr2=0x557cc7065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 -- 172.21.15.35:0/1720160624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7060960 msgr2=0x557cc7060d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7060960 0x557cc7060d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 -- 172.21.15.35:0/1720160624 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cc6e345d0 con 0x557cc70664f0 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7060960 0x557cc7060d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc7060420 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7fcc58011cd0 tx=0x7fcc58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fa33a942c3b83a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc50ff9700 1 -- 172.21.15.35:0/1720160624 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58004030 con 0x557cc70664f0 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc50ff9700 1 -- 172.21.15.35:0/1720160624 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc5800e8f0 con 0x557cc70664f0 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.867+0000 7fcc50ff9700 1 -- 172.21.15.35:0/1720160624 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58003ac0 con 0x557cc70664f0 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 -- 172.21.15.35:0/1720160624 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 msgr2=0x557cc7060420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc7060420 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7fcc58011cd0 tx=0x7fcc58014000 comp rx=0 tx=0).stop 2023-03-17T12:00:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 -- 172.21.15.35:0/1720160624 shutdown_connections 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7060960 0x557cc7060d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 --2- 172.21.15.35:0/1720160624 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc7060420 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 -- 172.21.15.35:0/1720160624 >> 172.21.15.35:0/1720160624 conn(0x557cc6ebd6b0 msgr2=0x557cc705aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 -- 172.21.15.35:0/1720160624 shutdown_connections 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.868+0000 7fcc750fab80 1 -- 172.21.15.35:0/1720160624 wait complete. 2023-03-17T12:00:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 -- start start 2023-03-17T12:00:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 Processor -- start 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc706c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7069720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc70664f0 0x557cc7069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc6e368c0 con 0x557cc7060960 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc706a4d0 con 0x557cc70664f0 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc7076030 con 0x557cc7065be0 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc750fab80 10 client.0 _ll_register_callbacks cb 0x557cc6e58230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc706c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc706c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58440/0 (socket says 172.21.15.35:58440) 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 -- 172.21.15.35:0/4179550575 learned_addr learned my addr 172.21.15.35:0/4179550575 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc70664f0 0x557cc7069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 -- 172.21.15.35:0/4179550575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 msgr2=0x557cc7069720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7069720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 -- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc70664f0 msgr2=0x557cc7069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc70664f0 0x557cc7069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc6259c700 1 -- 172.21.15.35:0/4179550575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc58017070 con 0x557cc7060960 2023-03-17T12:00:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.869+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc70664f0 0x557cc7069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:00:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc6259c700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc706c430 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7fcc540c8120 tx=0x7fcc54010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5993297132c071ca server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:00:05.073 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc49ffb700 1 -- 172.21.15.35:0/4179550575 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54097330 con 0x557cc7060960 2023-03-17T12:00:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc49ffb700 1 -- 172.21.15.35:0/4179550575 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcc54097490 con 0x557cc7060960 2023-03-17T12:00:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cc6f75390 con 0x557cc7060960 2023-03-17T12:00:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc49ffb700 1 -- 172.21.15.35:0/4179550575 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc5409fba0 con 0x557cc7060960 2023-03-17T12:00:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 10 client.22029 fetch_fsmap learned FSMap version 110 2023-03-17T12:00:07.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x557cc6de0d80 con 0x557cc7060960 2023-03-17T12:00:07.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc49ffb700 1 -- 172.21.15.35:0/4179550575 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557cc6f75390 con 0x557cc7060960 2023-03-17T12:00:07.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc49ffb700 1 -- 172.21.15.35:0/4179550575 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcc54093cc0 con 0x557cc7060960 2023-03-17T12:00:07.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 10 client.22029 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:00:07.234 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 10 client.22029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 20 client.22029 populate_metadata read hostname 'smithi035' 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc707a120 0x557cc707c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 4 client.22029 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.870+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cc6f81600 con 0x557cc707a120 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.871+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc707a120 0x557cc707c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.871+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc707a120 0x557cc707c530 crc :-1 s=READY pgs=822 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9900935f05969ef2 server_cookie=90d30e2b5d44bb2c in_seq=0 out_seq=0 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.871+0000 7fcc49ffb700 10 client.22029 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc49ffb700 1 -- 172.21.15.35:0/4179550575 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x557cc6f81600 con 0x557cc707a120 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc49ffb700 10 client.22029 handle_command_reply: tid=0 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 client.22029 shutdown 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 msgr2=0x557cc706c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:07.235 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc706c430 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7fcc540c8120 tx=0x7fcc54010810 comp rx=0 tx=0).stop 2023-03-17T12:00:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 shutdown_connections 2023-03-17T12:00:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc707a120 0x557cc707c530 crc :-1 s=READY pgs=822 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc70664f0 0x557cc7069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc49ffb700 0 client.22029 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc706c430 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 --2- 172.21.15.35:0/4179550575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7065be0 0x557cc7069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 >> 172.21.15.35:0/4179550575 conn(0x557cc6ebd6b0 msgr2=0x557cc705f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 shutdown_connections 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 1 -- 172.21.15.35:0/4179550575 wait complete. 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.872+0000 7fcc750fab80 20 client.22029 trim_cache size 0 max 16384 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 Processor -- start 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 -- start start 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc7070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc706bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:10.267 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc70664f0 0x557cc70636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc7056120 con 0x557cc7060960 2023-03-17T12:00:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc7077840 con 0x557cc7065be0 2023-03-17T12:00:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc750fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc70607c0 con 0x557cc70664f0 2023-03-17T12:00:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc7070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc6259c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc7070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58448/0 (socket says 172.21.15.35:58448) 2023-03-17T12:00:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.887+0000 7fcc6259c700 1 -- 172.21.15.35:0/3262524920 learned_addr learned my addr 172.21.15.35:0/3262524920 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc706bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc70664f0 0x557cc70636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc6259c700 1 -- 172.21.15.35:0/3262524920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc70664f0 msgr2=0x557cc70636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc6259c700 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc70664f0 0x557cc70636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc6259c700 1 -- 172.21.15.35:0/3262524920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 msgr2=0x557cc706bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc6259c700 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc706bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc6259c700 1 -- 172.21.15.35:0/3262524920 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cc6f79130 con 0x557cc7060960 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc70664f0 0x557cc70636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc6259c700 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc7070f80 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fcc54097b40 tx=0x7fcc54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5020ddd47b0535b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc517fa700 1 -- 172.21.15.35:0/3262524920 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54014070 con 0x557cc7060960 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc517fa700 1 -- 172.21.15.35:0/3262524920 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc54096df0 con 0x557cc7060960 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc517fa700 1 -- 172.21.15.35:0/3262524920 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5409fe00 con 0x557cc7060960 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc750fab80 1 -- 172.21.15.35:0/3262524920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 msgr2=0x557cc7070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc7070f80 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fcc54097b40 tx=0x7fcc54000bc0 comp rx=0 tx=0).stop 2023-03-17T12:00:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc750fab80 1 -- 172.21.15.35:0/3262524920 shutdown_connections 2023-03-17T12:00:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc70664f0 0x557cc70636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.888+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc7060960 0x557cc7070f80 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3262524920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc706bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- 172.21.15.35:0/3262524920 >> 172.21.15.35:0/3262524920 conn(0x557cc6ebd6b0 msgr2=0x557cc70763f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- 172.21.15.35:0/3262524920 shutdown_connections 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- 172.21.15.35:0/3262524920 wait complete. 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- start start 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 Processor -- start 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7060960 0x557cc70708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc7070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc706edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc706f380 con 0x557cc70664f0 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc706f4f0 con 0x557cc7065be0 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cc706f6b0 con 0x557cc7060960 2023-03-17T12:00:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc750fab80 10 client.0 _ll_register_callbacks cb 0x557cc6e58230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:00:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc62d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc706edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc62d9d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc706edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58458/0 (socket says 172.21.15.35:58458) 2023-03-17T12:00:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc62d9d700 1 -- 172.21.15.35:0/3940019100 learned_addr learned my addr 172.21.15.35:0/3940019100 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc6259c700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7060960 0x557cc70708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.889+0000 7fcc61d9b700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc7070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc62d9d700 1 -- 172.21.15.35:0/3940019100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7060960 msgr2=0x557cc70708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7060960 0x557cc70708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc62d9d700 1 -- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 msgr2=0x557cc7070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc7070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:16.950 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:40 smithi035 ceph-mon[92535]: pgmap v6131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc62d9d700 1 -- 172.21.15.35:0/3940019100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cc6de0d80 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc62d9d700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc706edb0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c015000 tx=0x7fcc5c008fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda784bd8b5c68a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc49ffb700 1 -- 172.21.15.35:0/3940019100 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00e040 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc49ffb700 1 -- 172.21.15.35:0/3940019100 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(422..422 src has 1..422) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fcc5c0074e0 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cc70301e0 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc49ffb700 1 -- 172.21.15.35:0/3940019100 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc5c0076a0 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc750fab80 10 client.22035 fetch_fsmap learned FSMap version 110 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x557cc6e071f0 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc49ffb700 1 -- 172.21.15.35:0/3940019100 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557cc70301e0 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc49ffb700 1 -- 172.21.15.35:0/3940019100 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fcc5c00b100 con 0x557cc70664f0 2023-03-17T12:00:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.890+0000 7fcc750fab80 10 client.22035 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc750fab80 10 client.22035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc750fab80 20 client.22035 populate_metadata read hostname 'smithi035' 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc70d3490 0x557cc70d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc750fab80 4 client.22035 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557cc6e36f00 con 0x557cc70d3490 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc6259c700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc70d3490 0x557cc70d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc49ffb700 10 client.22035 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.891+0000 7fcc6259c700 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc70d3490 0x557cc70d58a0 crc :-1 s=READY pgs=823 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1128739a28d98bc4 server_cookie=175b5ca280d2d8a in_seq=0 out_seq=0 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.910+0000 7fcc49ffb700 1 -- 172.21.15.35:0/3940019100 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557cc6e36f00 con 0x557cc70d3490 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.910+0000 7fcc49ffb700 10 client.22035 handle_command_reply: tid=0 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 client.22035 shutdown 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 msgr2=0x557cc706edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc706edb0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c015000 tx=0x7fcc5c008fe0 comp rx=0 tx=0).stop 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 shutdown_connections 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x557cc70d3490 0x557cc70d58a0 crc :-1 s=READY pgs=823 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x557cc70664f0 0x557cc706edb0 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc49ffb700 0 client.22035 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557cc7060960 0x557cc70708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 --2- 172.21.15.35:0/3940019100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cc7065be0 0x557cc7070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 >> 172.21.15.35:0/3940019100 conn(0x557cc6ebd6b0 msgr2=0x557cc70636b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 shutdown_connections 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 1 -- 172.21.15.35:0/3940019100 wait complete. 2023-03-17T12:00:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc750fab80 20 client.22035 trim_cache size 0 max 16384 2023-03-17T12:00:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc4c09f6c0 msgr2=0x7fcc4c0a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.911+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc4c09f6c0 0x7fcc4c0a1b70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcc64197960 tx=0x7fcc58009260 comp rx=0 tx=0).stop 2023-03-17T12:00:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 msgr2=0x7fcc64196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 0x7fcc64196350 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400d950 tx=0x7fcc5400dc60 comp rx=0 tx=0).stop 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 shutdown_connections 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fcc4c09f6c0 0x7fcc4c0a1b70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc64104390 0x7fcc6419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fcc640ff350 0x7fcc64196350 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 --2- 172.21.15.35:0/2745976535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc640ffcf0 0x7fcc64196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 >> 172.21.15.35:0/2745976535 conn(0x7fcc64076330 msgr2=0x7fcc64068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 shutdown_connections 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:07.912+0000 7fcc68f6d700 1 -- 172.21.15.35:0/2745976535 wait complete. 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.033+0000 7f16aa3b6700 1 -- 172.21.15.35:0/631676177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ff350 msgr2=0x7f16a40ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:21.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.033+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/631676177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ff350 0x7f16a40ff720 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f16940099c0 tx=0x7f1694009cd0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 -- 172.21.15.35:0/631676177 shutdown_connections 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/631676177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a4104390 0x7f16a410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/631676177 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ff350 0x7f16a40ff720 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/631676177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40ffcf0 0x7f16a4103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 -- 172.21.15.35:0/631676177 >> 172.21.15.35:0/631676177 conn(0x7f16a4076330 msgr2=0x7f16a4076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 -- 172.21.15.35:0/631676177 shutdown_connections 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 -- 172.21.15.35:0/631676177 wait complete. 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 Processor -- start 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.034+0000 7f16aa3b6700 1 -- start start 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16aa3b6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40ff350 0x7f16a4100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16aa3b6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 0x7f16a4101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16aa3b6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a4104390 0x7f16a41a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16aa3b6700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a4101ac0 con 0x7f16a40ffcf0 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16aa3b6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a41a4900 con 0x7f16a40ff350 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16aa3b6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a41a4a40 con 0x7f16a4104390 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 0x7f16a4101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 0x7f16a4101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58470/0 (socket says 172.21.15.35:58470) 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 -- 172.21.15.35:0/3675160374 learned_addr learned my addr 172.21.15.35:0/3675160374 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a8953700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a4104390 0x7f16a41a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a3fff700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40ff350 0x7f16a4100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 -- 172.21.15.35:0/3675160374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a4104390 msgr2=0x7f16a41a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a4104390 0x7f16a41a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 -- 172.21.15.35:0/3675160374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40ff350 msgr2=0x7f16a4100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40ff350 0x7f16a4100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 -- 172.21.15.35:0/3675160374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940095f0 con 0x7f16a40ffcf0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a37fe700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 0x7f16a4101290 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f169800c9b0 tx=0x7f169800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.035+0000 7f16a17fa700 1 -- 172.21.15.35:0/3675160374 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698007aa0 con 0x7f16a40ffcf0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.036+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a410f050 con 0x7f16a40ffcf0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.036+0000 7f16a17fa700 1 -- 172.21.15.35:0/3675160374 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f169800ce50 con 0x7f16a40ffcf0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.036+0000 7f16a17fa700 1 -- 172.21.15.35:0/3675160374 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698018400 con 0x7f16a40ffcf0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.036+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a410eec0 con 0x7f16a40ffcf0 2023-03-17T12:00:21.881 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.038+0000 7f16a17fa700 1 -- 172.21.15.35:0/3675160374 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f169800f450 con 0x7f16a40ffcf0 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.039+0000 7f16a17fa700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f168c09f640 0x7f168c0a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.039+0000 7f16a3fff700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f168c09f640 0x7f168c0a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.039+0000 7f16a17fa700 1 -- 172.21.15.35:0/3675160374 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(424..424 src has 1..424) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f16980ca430 con 0x7f16a40ffcf0 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.039+0000 7f16a3fff700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f168c09f640 0x7f168c0a1af0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1694000c00 tx=0x7f1694009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 Processor -- start 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 -- start start 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb4cbe0 0x561a9eb4cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb47420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 0x561a9eb47d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9ea4e010 con 0x561a9eb47960 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eaa0950 con 0x561a9eb4cbe0 2023-03-17T12:00:21.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16b6543b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9ea99de0 con 0x561a9eb4d4f0 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16a8953700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 0x561a9eb47d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16a8953700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 0x561a9eb47d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58480/0 (socket says 172.21.15.35:58480) 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16a8953700 1 -- 172.21.15.35:0/1898835939 learned_addr learned my addr 172.21.15.35:0/1898835939 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.040+0000 7f16a3fff700 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb4cbe0 0x561a9eb4cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a37fe700 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb47420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a8953700 1 -- 172.21.15.35:0/1898835939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 msgr2=0x561a9eb47420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a8953700 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb47420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a8953700 1 -- 172.21.15.35:0/1898835939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb4cbe0 msgr2=0x561a9eb4cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a8953700 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb4cbe0 0x561a9eb4cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a8953700 1 -- 172.21.15.35:0/1898835939 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a9e91b5d0 con 0x561a9eb47960 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f16a8953700 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 0x561a9eb47d90 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f169c003f40 tx=0x7f169c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c948800e491bfb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f168a7fc700 1 -- 172.21.15.35:0/1898835939 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c019070 con 0x561a9eb47960 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f168a7fc700 1 -- 172.21.15.35:0/1898835939 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f169c00f040 con 0x561a9eb47960 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.041+0000 7f168a7fc700 1 -- 172.21.15.35:0/1898835939 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0078e0 con 0x561a9eb47960 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 -- 172.21.15.35:0/1898835939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 msgr2=0x561a9eb47d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 0x561a9eb47d90 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f169c003f40 tx=0x7f169c009ba0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 -- 172.21.15.35:0/1898835939 shutdown_connections 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb47960 0x561a9eb47d90 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb4cbe0 0x561a9eb4cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 --2- 172.21.15.35:0/1898835939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb47420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 -- 172.21.15.35:0/1898835939 >> 172.21.15.35:0/1898835939 conn(0x561a9e9a46b0 msgr2=0x561a9eb41a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 -- 172.21.15.35:0/1898835939 shutdown_connections 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 -- 172.21.15.35:0/1898835939 wait complete. 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 -- start start 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.042+0000 7f16b6543b80 1 Processor -- start 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 0x561a9eb50670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb50c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9e91d8c0 con 0x561a9eb4cbe0 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb51410 con 0x561a9eb47960 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb5d000 con 0x561a9eb4d4f0 2023-03-17T12:00:21.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16b6543b80 10 client.0 _ll_register_callbacks cb 0x561a9e93f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:00:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 0x561a9eb50670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 0x561a9eb50670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58484/0 (socket says 172.21.15.35:58484) 2023-03-17T12:00:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 -- 172.21.15.35:0/2841912966 learned_addr learned my addr 172.21.15.35:0/2841912966 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a8953700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb50c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a3fff700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 -- 172.21.15.35:0/2841912966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 msgr2=0x561a9eb50c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb50c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 -- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 msgr2=0x561a9eb533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 -- 172.21.15.35:0/2841912966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c003b70 con 0x561a9eb4cbe0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a3fff700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16a37fe700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 0x561a9eb50670 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f1698097e20 tx=0x7f1698007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c800f2fccca0d021 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.043+0000 7f16837fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16837fe700 1 -- 172.21.15.35:0/2841912966 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800f700 con 0x561a9eb4cbe0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16837fe700 1 -- 172.21.15.35:0/2841912966 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(424..424 src has 1..424) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f169800f860 con 0x561a9eb4cbe0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a9ea5c390 con 0x561a9eb4cbe0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16837fe700 1 -- 172.21.15.35:0/2841912966 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1698098140 con 0x561a9eb4cbe0 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 10 client.22047 fetch_fsmap learned FSMap version 110 2023-03-17T12:00:25.447 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561a9e8c7d80 con 0x561a9eb4cbe0 2023-03-17T12:00:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16837fe700 1 -- 172.21.15.35:0/2841912966 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1698062020 con 0x561a9eb4cbe0 2023-03-17T12:00:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16837fe700 1 -- 172.21.15.35:0/2841912966 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f169809fc40 con 0x561a9eb4cbe0 2023-03-17T12:00:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 10 client.22047 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:00:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 10 client.22047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 20 client.22047 populate_metadata read hostname 'smithi035' 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9eb61010 0x561a9eb633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 4 client.22047 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.044+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a9ea68600 con 0x561a9eb61010 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.045+0000 7f16a3fff700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9eb61010 0x561a9eb633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.045+0000 7f16a3fff700 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9eb61010 0x561a9eb633f0 crc :-1 s=READY pgs=824 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e51b3e3b30455 server_cookie=f7c70739783e536a in_seq=0 out_seq=0 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.045+0000 7f16837fe700 10 client.22047 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16837fe700 1 -- 172.21.15.35:0/2841912966 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x561a9ea68600 con 0x561a9eb61010 2023-03-17T12:00:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16837fe700 10 client.22047 handle_command_reply: tid=0 2023-03-17T12:00:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 client.22047 shutdown 2023-03-17T12:00:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 msgr2=0x561a9eb50670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 0x561a9eb50670 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f1698097e20 tx=0x7f1698007f20 comp rx=0 tx=0).stop 2023-03-17T12:00:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 shutdown_connections 2023-03-17T12:00:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9eb61010 0x561a9eb633f0 crc :-1 s=READY pgs=824 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:26.967 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:42 smithi035 ceph-mon[92535]: pgmap v6132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4d4f0 0x561a9eb50c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 --2- 172.21.15.35:0/2841912966 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4cbe0 0x561a9eb50670 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16837fe700 0 client.22047 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 >> 172.21.15.35:0/2841912966 conn(0x561a9e9a46b0 msgr2=0x561a9eb41a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 shutdown_connections 2023-03-17T12:00:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 1 -- 172.21.15.35:0/2841912966 wait complete. 2023-03-17T12:00:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.046+0000 7f16b6543b80 20 client.22047 trim_cache size 0 max 16384 2023-03-17T12:00:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 Processor -- start 2023-03-17T12:00:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 -- start start 2023-03-17T12:00:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb4e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb42720 con 0x561a9eb4d4f0 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb42030 con 0x561a9eb47960 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.061+0000 7f16b6543b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb3eb60 con 0x561a9eb4cbe0 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb4e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb4e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58494/0 (socket says 172.21.15.35:58494) 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 -- 172.21.15.35:0/76096638 learned_addr learned my addr 172.21.15.35:0/76096638 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a3fff700 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a37fe700 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 -- 172.21.15.35:0/76096638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 msgr2=0x561a9eb57f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb57f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 -- 172.21.15.35:0/76096638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 msgr2=0x561a9eb41ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb41ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 -- 172.21.15.35:0/76096638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a9ea60130 con 0x561a9eb4d4f0 2023-03-17T12:00:29.759 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a37fe700 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb57f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f16a8953700 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb4e0a0 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f169c018000 tx=0x7f169c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f11fc6d0f611cce server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f168affd700 1 -- 172.21.15.35:0/76096638 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c019030 con 0x561a9eb4d4f0 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f168affd700 1 -- 172.21.15.35:0/76096638 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f169c00f040 con 0x561a9eb4d4f0 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.062+0000 7f168affd700 1 -- 172.21.15.35:0/76096638 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c007a70 con 0x561a9eb4d4f0 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 -- 172.21.15.35:0/76096638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 msgr2=0x561a9eb4e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb4e0a0 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f169c018000 tx=0x7f169c009840 comp rx=0 tx=0).stop 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 -- 172.21.15.35:0/76096638 shutdown_connections 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb4e0a0 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 --2- 172.21.15.35:0/76096638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb57f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 -- 172.21.15.35:0/76096638 >> 172.21.15.35:0/76096638 conn(0x561a9e9a46b0 msgr2=0x561a9eb4d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 -- 172.21.15.35:0/76096638 shutdown_connections 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 -- 172.21.15.35:0/76096638 wait complete. 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 -- start start 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.063+0000 7f16b6543b80 1 Processor -- start 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb57f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb48780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb48cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb49290 con 0x561a9eb4d4f0 2023-03-17T12:00:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb493d0 con 0x561a9eb47960 2023-03-17T12:00:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a9eb49560 con 0x561a9eb4cbe0 2023-03-17T12:00:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16b6543b80 10 client.0 _ll_register_callbacks cb 0x561a9e93f230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:00:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb48cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb48cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58500/0 (socket says 172.21.15.35:58500) 2023-03-17T12:00:30.637 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 -- 172.21.15.35:0/253178854 learned_addr learned my addr 172.21.15.35:0/253178854 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a3fff700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb57f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a37fe700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb48780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 -- 172.21.15.35:0/253178854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 msgr2=0x561a9eb48780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb48780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 -- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 msgr2=0x561a9eb57f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb57f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 -- 172.21.15.35:0/253178854 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a9e91b5d0 con 0x561a9eb4d4f0 2023-03-17T12:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16a8953700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb48cc0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f169c004960 tx=0x7f169c004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efb9d7d56537245 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.064+0000 7f16837fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16837fe700 1 -- 172.21.15.35:0/253178854 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c019040 con 0x561a9eb4d4f0 2023-03-17T12:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16837fe700 1 -- 172.21.15.35:0/253178854 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(424..424 src has 1..424) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f169c01a070 con 0x561a9eb4d4f0 2023-03-17T12:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a9eb171e0 con 0x561a9eb4d4f0 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16837fe700 1 -- 172.21.15.35:0/253178854 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f169c003f10 con 0x561a9eb4d4f0 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 10 client.22053 fetch_fsmap learned FSMap version 110 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x561a9e8ee1f0 con 0x561a9eb4d4f0 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16837fe700 1 -- 172.21.15.35:0/253178854 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a9eb171e0 con 0x561a9eb4d4f0 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16837fe700 1 -- 172.21.15.35:0/253178854 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f169c028910 con 0x561a9eb4d4f0 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 10 client.22053 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 10 client.22053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 20 client.22053 populate_metadata read hostname 'smithi035' 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9ebb5f10 0x561a9ebb82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 4 client.22053 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T12:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.065+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561a9e91df00 con 0x561a9ebb5f10 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.066+0000 7f16a3fff700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9ebb5f10 0x561a9ebb82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.066+0000 7f16837fe700 10 client.22053 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.066+0000 7f16a3fff700 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9ebb5f10 0x561a9ebb82f0 crc :-1 s=READY pgs=825 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17426775342361fa server_cookie=7c50b03fb9857a43 in_seq=0 out_seq=0 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.084+0000 7f16837fe700 1 -- 172.21.15.35:0/253178854 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561a9e91df00 con 0x561a9ebb5f10 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.084+0000 7f16837fe700 10 client.22053 handle_command_reply: tid=0 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.084+0000 7f16b6543b80 1 client.22053 shutdown 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 msgr2=0x561a9eb48cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb48cc0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f169c004960 tx=0x7f169c004990 comp rx=0 tx=0).stop 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 shutdown_connections 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x561a9ebb5f10 0x561a9ebb82f0 crc :-1 s=READY pgs=825 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x561a9eb4d4f0 0x561a9eb48cc0 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16837fe700 0 client.22053 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561a9eb47960 0x561a9eb57f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 --2- 172.21.15.35:0/253178854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a9eb4cbe0 0x561a9eb48780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 >> 172.21.15.35:0/253178854 conn(0x561a9e9a46b0 msgr2=0x561a9eb4e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 shutdown_connections 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 1 -- 172.21.15.35:0/253178854 wait complete. 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16b6543b80 20 client.22053 trim_cache size 0 max 16384 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f168c09f640 msgr2=0x7f168c0a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f168c09f640 0x7f168c0a1af0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1694000c00 tx=0x7f1694009f10 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 msgr2=0x7f16a4101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.085+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 0x7f16a4101290 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f169800c9b0 tx=0x7f169800ccc0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 shutdown_connections 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f168c09f640 0x7f168c0a1af0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a4104390 0x7f16a41a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16a40ff350 0x7f16a4100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 --2- 172.21.15.35:0/3675160374 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f16a40ffcf0 0x7f16a4101290 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 >> 172.21.15.35:0/3675160374 conn(0x7f16a4076330 msgr2=0x7f16a4068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 shutdown_connections 2023-03-17T12:00:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:21.086+0000 7f16aa3b6700 1 -- 172.21.15.35:0/3675160374 wait complete. 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 -- 172.21.15.35:0/1769119294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc104080 msgr2=0x7fbabc104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 --2- 172.21.15.35:0/1769119294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc104080 0x7fbabc104450 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7fbab80099c0 tx=0x7fbab8009cd0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 -- 172.21.15.35:0/1769119294 shutdown_connections 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 --2- 172.21.15.35:0/1769119294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc1001e0 0x7fbabc10bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 --2- 172.21.15.35:0/1769119294 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc104080 0x7fbabc104450 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 --2- 172.21.15.35:0/1769119294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc0ff830 0x7fbabc0ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 -- 172.21.15.35:0/1769119294 >> 172.21.15.35:0/1769119294 conn(0x7fbabc0757a0 msgr2=0x7fbabc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 -- 172.21.15.35:0/1769119294 shutdown_connections 2023-03-17T12:00:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.208+0000 7fbac41a3700 1 -- 172.21.15.35:0/1769119294 wait complete. 2023-03-17T12:00:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 Processor -- start 2023-03-17T12:00:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 -- start start 2023-03-17T12:00:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc0ff830 0x7fbabc196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 0x7fbabc196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc104080 0x7fbabc19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc19b320 con 0x7fbabc1001e0 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc19b490 con 0x7fbabc0ff830 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac41a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc19b650 con 0x7fbabc104080 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 0x7fbabc196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 0x7fbabc196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58512/0 (socket says 172.21.15.35:58512) 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 -- 172.21.15.35:0/402817551 learned_addr learned my addr 172.21.15.35:0/402817551 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac2740700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc104080 0x7fbabc19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc0ff830 0x7fbabc196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 -- 172.21.15.35:0/402817551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc104080 msgr2=0x7fbabc19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc104080 0x7fbabc19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 -- 172.21.15.35:0/402817551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc0ff830 msgr2=0x7fbabc196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc0ff830 0x7fbabc196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 -- 172.21.15.35:0/402817551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80095f0 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc0ff830 0x7fbabc196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.209+0000 7fbac173e700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 0x7fbabc196880 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0074f0 tx=0x7fbaac007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.210+0000 7fbab2ffd700 1 -- 172.21.15.35:0/402817551 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac004a30 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.210+0000 7fbab2ffd700 1 -- 172.21.15.35:0/402817551 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaac029070 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.210+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc10efa0 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.210+0000 7fbab2ffd700 1 -- 172.21.15.35:0/402817551 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac014570 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.210+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc10ee10 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.213+0000 7fbab2ffd700 1 -- 172.21.15.35:0/402817551 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fbaac0146d0 con 0x7fbabc1001e0 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbab2ffd700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbaa80c16d0 0x7fbaa80c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbab2ffd700 1 -- 172.21.15.35:0/402817551 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(424..424 src has 1..424) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbaac0dae20 con 0x7fbabc1001e0 2023-03-17T12:00:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbaa80c16d0 0x7fbaa80c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbaa80c16d0 0x7fbaa80c3b80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbab8000c00 tx=0x7fbab8005fb0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 Processor -- start 2023-03-17T12:00:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 -- start start 2023-03-17T12:00:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355a2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e4355a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4354a9010 con 0x55e4355a84f0 2023-03-17T12:00:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.214+0000 7fbad0330b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4354fb950 con 0x55e4355a2960 2023-03-17T12:00:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbad0330b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4354f4de0 con 0x55e4355a7be0 2023-03-17T12:00:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355a2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355a2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58520/0 (socket says 172.21.15.35:58520) 2023-03-17T12:00:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 -- 172.21.15.35:0/3719461779 learned_addr learned my addr 172.21.15.35:0/3719461779 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac2740700 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e4355a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 -- 172.21.15.35:0/3719461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 msgr2=0x55e4355a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 -- 172.21.15.35:0/3719461779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 msgr2=0x55e4355a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e4355a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 -- 172.21.15.35:0/3719461779 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4353765d0 con 0x55e4355a84f0 2023-03-17T12:00:42.341 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:44 smithi035 ceph-mon[92535]: pgmap v6133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac2740700 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e4355a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbac173e700 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355a2420 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0a4dd0 tx=0x7fbaac0a8300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ac5e90e03bde8 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbaa7fff700 1 -- 172.21.15.35:0/3719461779 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0d82b0 con 0x55e4355a84f0 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbaa7fff700 1 -- 172.21.15.35:0/3719461779 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaac0a6a10 con 0x55e4355a84f0 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.215+0000 7fbaa7fff700 1 -- 172.21.15.35:0/3719461779 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0a4fe0 con 0x55e4355a84f0 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 -- 172.21.15.35:0/3719461779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 msgr2=0x55e4355a2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355a2420 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0a4dd0 tx=0x7fbaac0a8300 comp rx=0 tx=0).stop 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 -- 172.21.15.35:0/3719461779 shutdown_connections 2023-03-17T12:00:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e4355a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3719461779 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355a2420 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 -- 172.21.15.35:0/3719461779 >> 172.21.15.35:0/3719461779 conn(0x55e4353ff6b0 msgr2=0x55e43559ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 -- 172.21.15.35:0/3719461779 shutdown_connections 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 -- 172.21.15.35:0/3719461779 wait complete. 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 -- start start 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.216+0000 7fbad0330b80 1 Processor -- start 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355ab710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4353788c0 con 0x55e4355a84f0 2023-03-17T12:00:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4355ac4b0 con 0x55e4355a7be0 2023-03-17T12:00:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4355fc070 con 0x55e4355a2960 2023-03-17T12:00:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbad0330b80 10 client.0 _ll_register_callbacks cb 0x55e43539a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:00:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbac2740700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbac2740700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58528/0 (socket says 172.21.15.35:58528) 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbac2740700 1 -- 172.21.15.35:0/1913376117 learned_addr learned my addr 172.21.15.35:0/1913376117 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbac173e700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.217+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac2740700 1 -- 172.21.15.35:0/1913376117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 msgr2=0x55e4355ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac2740700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac2740700 1 -- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 msgr2=0x55e4355ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac2740700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac2740700 1 -- 172.21.15.35:0/1913376117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc10ee10 con 0x55e4355a84f0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac173e700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbac2740700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355abd40 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009d80 tx=0x7fbab4004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec34b1e33e66ea7 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbaa57fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbaa57fa700 1 -- 172.21.15.35:0/1913376117 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4004bb0 con 0x55e4355a84f0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4354b7390 con 0x55e4355a84f0 2023-03-17T12:00:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbaa57fa700 1 -- 172.21.15.35:0/1913376117 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(424..424 src has 1..424) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbab4004d10 con 0x55e4355a84f0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbaa57fa700 1 -- 172.21.15.35:0/1913376117 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbab4005020 con 0x55e4355a84f0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 10 client.22065 fetch_fsmap learned FSMap version 110 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55e435322d80 con 0x55e4355a84f0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbaa57fa700 1 -- 172.21.15.35:0/1913376117 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e4354b7390 con 0x55e4355a84f0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbaa57fa700 1 -- 172.21.15.35:0/1913376117 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbab40a6420 con 0x55e4355a84f0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 10 client.22065 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 10 client.22065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 20 client.22065 populate_metadata read hostname 'smithi035' 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4355b13d0 0x55e4355b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 4 client.22065 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.218+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4354c3600 con 0x55e4355b13d0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.219+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4355b13d0 0x55e4355b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.219+0000 7fbaa57fa700 10 client.22065 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.219+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4355b13d0 0x55e4355b37e0 crc :-1 s=READY pgs=826 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db46b0440ea53111 server_cookie=a44a7dc71be7e63c in_seq=0 out_seq=0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbaa57fa700 1 -- 172.21.15.35:0/1913376117 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e4354c3600 con 0x55e4355b13d0 2023-03-17T12:00:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbaa57fa700 10 client.22065 handle_command_reply: tid=0 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 client.22065 shutdown 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 msgr2=0x55e4355abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355abd40 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009d80 tx=0x7fbab4004320 comp rx=0 tx=0).stop 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 shutdown_connections 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e4355b13d0 0x55e4355b37e0 crc :-1 s=READY pgs=826 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355abd40 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbaa57fa700 0 client.22065 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 --2- 172.21.15.35:0/1913376117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 >> 172.21.15.35:0/1913376117 conn(0x55e4353ff6b0 msgr2=0x55e4355a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 shutdown_connections 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 1 -- 172.21.15.35:0/1913376117 wait complete. 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.220+0000 7fbad0330b80 20 client.22065 trim_cache size 0 max 16384 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 Processor -- start 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 -- start start 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e43559cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4355980d0 con 0x55e4355a84f0 2023-03-17T12:00:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e435599b60 con 0x55e4355a2960 2023-03-17T12:00:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbad0330b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4355a2790 con 0x55e4355a7be0 2023-03-17T12:00:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbac2740700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbac2740700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58536/0 (socket says 172.21.15.35:58536) 2023-03-17T12:00:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbac2740700 1 -- 172.21.15.35:0/3935123473 learned_addr learned my addr 172.21.15.35:0/3935123473 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbac173e700 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.235+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e43559cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbac2740700 1 -- 172.21.15.35:0/3935123473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 msgr2=0x55e4355f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbac2740700 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbac2740700 1 -- 172.21.15.35:0/3935123473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 msgr2=0x55e43559cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbac2740700 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e43559cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbac2740700 1 -- 172.21.15.35:0/3935123473 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e43559e9a0 con 0x55e4355a84f0 2023-03-17T12:00:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbac2740700 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f21d0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000f80 tx=0x7fbab4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29896bf95434c6c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbab0ff9700 1 -- 172.21.15.35:0/3935123473 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40a6400 con 0x55e4355a84f0 2023-03-17T12:00:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbab0ff9700 1 -- 172.21.15.35:0/3935123473 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbab40a6560 con 0x55e4355a84f0 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbab0ff9700 1 -- 172.21.15.35:0/3935123473 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab409d770 con 0x55e4355a84f0 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbad0330b80 1 -- 172.21.15.35:0/3935123473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 msgr2=0x55e4355f21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f21d0 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000f80 tx=0x7fbab4005b50 comp rx=0 tx=0).stop 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbad0330b80 1 -- 172.21.15.35:0/3935123473 shutdown_connections 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f21d0 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a2960 0x55e43559cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.236+0000 7fbad0330b80 1 --2- 172.21.15.35:0/3935123473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a7be0 0x55e4355f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 -- 172.21.15.35:0/3935123473 >> 172.21.15.35:0/3935123473 conn(0x55e4353ff6b0 msgr2=0x55e4355fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 -- 172.21.15.35:0/3935123473 shutdown_connections 2023-03-17T12:00:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 -- 172.21.15.35:0/3935123473 wait complete. 2023-03-17T12:00:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 -- start start 2023-03-17T12:00:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 Processor -- start 2023-03-17T12:00:51.558 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbad0330b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbac2740700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbad0330b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4355f6000 con 0x55e4355a84f0 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.237+0000 7fbac1f3f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbad0330b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4355f6170 con 0x55e4355a7be0 2023-03-17T12:00:51.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbad0330b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e43571f870 con 0x55e4355a2960 2023-03-17T12:00:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:50304/0 (socket says 172.21.15.35:50304) 2023-03-17T12:00:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac2740700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58542/0 (socket says 172.21.15.35:58542) 2023-03-17T12:00:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 -- 172.21.15.35:0/867939631 learned_addr learned my addr 172.21.15.35:0/867939631 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:00:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac173e700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbad0330b80 10 client.0 _ll_register_callbacks cb 0x55e43539a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:00:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 -- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 msgr2=0x55e4355f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 -- 172.21.15.35:0/867939631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 msgr2=0x55e4355f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:00:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 -- 172.21.15.35:0/867939631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e435322d80 con 0x55e4355a2960 2023-03-17T12:00:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac2740700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:00:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbac1f3f700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355f6f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbab8005f50 tx=0x7fbab801a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d87e556eba3feda5 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbaa57fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbaa57fa700 1 -- 172.21.15.35:0/867939631 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab802d040 con 0x55e4355a2960 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4355721e0 con 0x55e4355a2960 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.238+0000 7fbaa57fa700 1 -- 172.21.15.35:0/867939631 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(424..424 src has 1..424) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fbab8035250 con 0x55e4355a2960 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbaa57fa700 1 -- 172.21.15.35:0/867939631 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbab8035410 con 0x55e4355a2960 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 10 client.30805 fetch_fsmap learned FSMap version 110 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55e43530bc00 con 0x55e4355a2960 2023-03-17T12:00:53.198 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbaa57fa700 1 -- 172.21.15.35:0/867939631 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e4355721e0 con 0x55e4355a2960 2023-03-17T12:00:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbaa57fa700 1 -- 172.21.15.35:0/867939631 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fbab803b020 con 0x55e4355a2960 2023-03-17T12:00:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 10 client.30805 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:00:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 10 client.30805 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:00:53.199 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 20 client.30805 populate_metadata read hostname 'smithi035' 2023-03-17T12:00:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e435720cc0 0x55e4357230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:00:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 4 client.30805 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T12:00:54.238 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e435378f00 con 0x55e435720cc0 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.239+0000 7fbac173e700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e435720cc0 0x55e4357230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.240+0000 7fbac173e700 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e435720cc0 0x55e4357230d0 crc :-1 s=READY pgs=827 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3784c964ffaa0d2 server_cookie=c52260f1938ef502 in_seq=0 out_seq=0 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.240+0000 7fbaa57fa700 10 client.30805 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.251+0000 7fbaa57fa700 1 -- 172.21.15.35:0/867939631 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e435378f00 con 0x55e435720cc0 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.251+0000 7fbaa57fa700 10 client.30805 handle_command_reply: tid=0 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.251+0000 7fbad0330b80 1 client.30805 shutdown 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 msgr2=0x55e4355f6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355f6f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbab8005f50 tx=0x7fbab801a050 comp rx=0 tx=0).stop 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 shutdown_connections 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55e435720cc0 0x55e4357230d0 crc :-1 s=READY pgs=827 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55e4355a84f0 0x55e4355f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbaa57fa700 0 client.30805 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e4355a2960 0x55e4355f6f70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 --2- 172.21.15.35:0/867939631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4355a7be0 0x55e4355f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 >> 172.21.15.35:0/867939631 conn(0x55e4353ff6b0 msgr2=0x55e4355a1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 shutdown_connections 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 1 -- 172.21.15.35:0/867939631 wait complete. 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.252+0000 7fbad0330b80 20 client.30805 trim_cache size 0 max 16384 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbaa80c16d0 msgr2=0x7fbaa80c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbaa80c16d0 0x7fbaa80c3b80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbab8000c00 tx=0x7fbab8005fb0 comp rx=0 tx=0).stop 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 msgr2=0x7fbabc196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 0x7fbabc196880 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0074f0 tx=0x7fbaac007800 comp rx=0 tx=0).stop 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 shutdown_connections 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fbaa80c16d0 0x7fbaa80c3b80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc104080 0x7fbabc19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbabc0ff830 0x7fbabc196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 --2- 172.21.15.35:0/402817551 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fbabc1001e0 0x7fbabc196880 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:00:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 >> 172.21.15.35:0/402817551 conn(0x7fbabc0757a0 msgr2=0x7fbabc0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:00:55.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:46 smithi035 ceph-mon[92535]: pgmap v6134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:48 smithi035 ceph-mon[92535]: pgmap v6135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:50 smithi035 ceph-mon[92535]: pgmap v6136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:56.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:52 smithi035 ceph-mon[92535]: pgmap v6137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.450 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:54 smithi035 ceph-mon[92535]: pgmap v6138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:56 smithi035 ceph-mon[92535]: pgmap v6139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:51:58 smithi035 ceph-mon[92535]: pgmap v6140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:00 smithi035 ceph-mon[92535]: pgmap v6141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:02 smithi035 ceph-mon[92535]: pgmap v6142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:04 smithi035 ceph-mon[92535]: pgmap v6143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:06 smithi035 ceph-mon[92535]: pgmap v6144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:08 smithi035 ceph-mon[92535]: pgmap v6145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:10 smithi035 ceph-mon[92535]: pgmap v6146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:00:56.451 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:10 smithi035 ceph-mon[92535]: osdmap e452: 12 total, 12 up, 12 in 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:12 smithi035 ceph-mon[92535]: pgmap v6148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:14 smithi035 ceph-mon[92535]: pgmap v6149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:15 smithi035 ceph-mon[92535]: pgmap v6150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:15 smithi035 ceph-mon[92535]: pgmap v6151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:00:56.452 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:16 smithi035 ceph-mon[92535]: pgmap v6152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:18 smithi035 ceph-mon[92535]: pgmap v6153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:18 smithi035 ceph-mon[92535]: osdmap e453: 12 total, 12 up, 12 in 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:20 smithi035 ceph-mon[92535]: pgmap v6155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:22 smithi035 ceph-mon[92535]: pgmap v6156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:24 smithi035 ceph-mon[92535]: pgmap v6157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:26 smithi035 ceph-mon[92535]: pgmap v6158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:28 smithi035 ceph-mon[92535]: pgmap v6159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:30 smithi035 ceph-mon[92535]: pgmap v6160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 361 B/s wr, 9 op/s 2023-03-17T12:00:56.453 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:32 smithi035 ceph-mon[92535]: pgmap v6161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:00:56.454 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:34 smithi035 ceph-mon[92535]: pgmap v6162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:00:56.454 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:36 smithi035 ceph-mon[92535]: pgmap v6163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:56.454 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:38 smithi035 ceph-mon[92535]: pgmap v6164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:00:57.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:40 smithi035 ceph-mon[92535]: pgmap v6165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:00:57.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:42 smithi035 ceph-mon[92535]: pgmap v6166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:00:57.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:44 smithi035 ceph-mon[92535]: pgmap v6167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:00:57.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:46 smithi035 ceph-mon[92535]: pgmap v6168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:00:57.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:48 smithi035 ceph-mon[92535]: pgmap v6169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:00:57.885 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:50 smithi035 ceph-mon[92535]: pgmap v6170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:52 smithi035 ceph-mon[92535]: pgmap v6171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:54 smithi035 ceph-mon[92535]: pgmap v6172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:56 smithi035 ceph-mon[92535]: pgmap v6173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:52:59 smithi035 ceph-mon[92535]: pgmap v6174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:01 smithi035 ceph-mon[92535]: pgmap v6175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:03 smithi035 ceph-mon[92535]: pgmap v6176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:05 smithi035 ceph-mon[92535]: pgmap v6177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:00:57.886 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:07 smithi035 ceph-mon[92535]: pgmap v6178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:00:57.887 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:09 smithi035 ceph-mon[92535]: pgmap v6179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:00:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:10 smithi035 ceph-mon[92535]: osdmap e454: 12 total, 12 up, 12 in 2023-03-17T12:00:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:11 smithi035 ceph-mon[92535]: pgmap v6181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:00:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:13 smithi035 ceph-mon[92535]: pgmap v6182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:00:59.932 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:01:00.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:01:00.547 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:01:01.401 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:15 smithi035 ceph-mon[92535]: pgmap v6183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:01:02.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:01:02.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:01:02.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:01:02.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:16 smithi035 ceph-mon[92535]: pgmap v6184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:01:02.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:16 smithi035 ceph-mon[92535]: pgmap v6185: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:01:03.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:18 smithi035 ceph-mon[92535]: pgmap v6186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 135 B/s wr, 6 op/s 2023-03-17T12:01:03.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:18 smithi035 ceph-mon[92535]: osdmap e455: 12 total, 12 up, 12 in 2023-03-17T12:01:03.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:20 smithi035 ceph-mon[92535]: pgmap v6188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:01:03.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:22 smithi035 ceph-mon[92535]: pgmap v6189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:01:03.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:24 smithi035 ceph-mon[92535]: pgmap v6190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:{ 2023-03-17T12:01:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "message": "", 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout: "return_code": 0 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stdout:} 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 shutdown_connections 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:38:34.253+0000 7fbac41a3700 1 -- 172.21.15.35:0/402817551 wait complete. 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 -- 172.21.15.35:0/3546261631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3480ff350 msgr2=0x7fd3480ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 --2- 172.21.15.35:0/3546261631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3480ff350 0x7fd3480ff720 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7fd3440099c0 tx=0x7fd344009cd0 comp rx=0 tx=0).stop 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 -- 172.21.15.35:0/3546261631 shutdown_connections 2023-03-17T12:01:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 --2- 172.21.15.35:0/3546261631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd348104390 0x7fd34810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 --2- 172.21.15.35:0/3546261631 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd3480ff350 0x7fd3480ff720 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 --2- 172.21.15.35:0/3546261631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3480ffcf0 0x7fd348103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 -- 172.21.15.35:0/3546261631 >> 172.21.15.35:0/3546261631 conn(0x7fd348076330 msgr2=0x7fd348076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 -- 172.21.15.35:0/3546261631 shutdown_connections 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.641+0000 7fd34feb4700 1 -- 172.21.15.35:0/3546261631 wait complete. 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 Processor -- start 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 -- start start 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3480ff350 0x7fd348195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3480ffcf0 0x7fd3481956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 0x7fd348199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34819a150 con 0x7fd348104390 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34819a2c0 con 0x7fd3480ff350 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34feb4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34819a480 con 0x7fd3480ffcf0 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34e451700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 0x7fd348199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34e451700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 0x7fd348199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58556/0 (socket says 172.21.15.35:58556) 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34e451700 1 -- 172.21.15.35:0/504221548 learned_addr learned my addr 172.21.15.35:0/504221548 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34d44f700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3480ffcf0 0x7fd3481956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.642+0000 7fd34dc50700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3480ff350 0x7fd348195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34e451700 1 -- 172.21.15.35:0/504221548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3480ffcf0 msgr2=0x7fd3481956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34e451700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3480ffcf0 0x7fd3481956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34e451700 1 -- 172.21.15.35:0/504221548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3480ff350 msgr2=0x7fd348195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34e451700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3480ff350 0x7fd348195170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34e451700 1 -- 172.21.15.35:0/504221548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440095f0 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34e451700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 0x7fd348199b10 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7fd340007f10 tx=0x7fd34000f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd33effd700 1 -- 172.21.15.35:0/504221548 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000fd30 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd33effd700 1 -- 172.21.15.35:0/504221548 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd34000fe90 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34810f000 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd33effd700 1 -- 172.21.15.35:0/504221548 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340012e60 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.643+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34810ee70 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.645+0000 7fd33effd700 1 -- 172.21.15.35:0/504221548 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fd340012460 con 0x7fd348104390 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.646+0000 7fd33effd700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd33409f6c0 0x7fd3340a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.646+0000 7fd33effd700 1 -- 172.21.15.35:0/504221548 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(426..426 src has 1..426) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd3400cc760 con 0x7fd348104390 2023-03-17T12:01:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.646+0000 7fd34dc50700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd33409f6c0 0x7fd3340a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.646+0000 7fd34dc50700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd33409f6c0 0x7fd3340a1b70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd34400b580 tx=0x7fd344009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 Processor -- start 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 -- start start 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 0x563d86acbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acc4f0 0x563d86ac6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ac6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d869cd010 con 0x563d86acbbe0 2023-03-17T12:01:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86a1f950 con 0x563d86ac6960 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd35c041b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86a18de0 con 0x563d86acc4f0 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd34dc50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 0x563d86acbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd34dc50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 0x563d86acbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58560/0 (socket says 172.21.15.35:58560) 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.647+0000 7fd34dc50700 1 -- 172.21.15.35:0/3492539268 learned_addr learned my addr 172.21.15.35:0/3492539268 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34d44f700 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acc4f0 0x563d86ac6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34e451700 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ac6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34dc50700 1 -- 172.21.15.35:0/3492539268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acc4f0 msgr2=0x563d86ac6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34dc50700 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acc4f0 0x563d86ac6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34dc50700 1 -- 172.21.15.35:0/3492539268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 msgr2=0x563d86ac6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34dc50700 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ac6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34dc50700 1 -- 172.21.15.35:0/3492539268 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d8689a5d0 con 0x563d86acbbe0 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34e451700 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ac6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:01:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd34dc50700 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 0x563d86acbfb0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7fd344015000 tx=0x7fd344020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc876d226c2df2f server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd333fff700 1 -- 172.21.15.35:0/3492539268 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400be20 con 0x563d86acbbe0 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd333fff700 1 -- 172.21.15.35:0/3492539268 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd34401e040 con 0x563d86acbbe0 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.648+0000 7fd333fff700 1 -- 172.21.15.35:0/3492539268 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344003a80 con 0x563d86acbbe0 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 -- 172.21.15.35:0/3492539268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 msgr2=0x563d86acbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 0x563d86acbfb0 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7fd344015000 tx=0x7fd344020000 comp rx=0 tx=0).stop 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 -- 172.21.15.35:0/3492539268 shutdown_connections 2023-03-17T12:01:06.471 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ac6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acbbe0 0x563d86acbfb0 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3492539268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acc4f0 0x563d86ac6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 -- 172.21.15.35:0/3492539268 >> 172.21.15.35:0/3492539268 conn(0x563d869236b0 msgr2=0x563d86ac0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 -- 172.21.15.35:0/3492539268 shutdown_connections 2023-03-17T12:01:07.200 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 -- 172.21.15.35:0/3492539268 wait complete. 2023-03-17T12:01:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.649+0000 7fd35c041b80 1 -- start start 2023-03-17T12:01:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 Processor -- start 2023-03-17T12:01:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 0x563d86ad2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acbbe0 0x563d86acf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86acfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8689c8c0 con 0x563d86acc4f0 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86ad05f0 con 0x563d86acbbe0 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86adc000 con 0x563d86ac6960 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd35c041b80 10 client.0 _ll_register_callbacks cb 0x563d868be230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd34dc50700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 0x563d86ad2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd34e451700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86acfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd34dc50700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 0x563d86ad2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.35:50332/0 (socket says 172.21.15.35:50332) 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd34e451700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86acfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58570/0 (socket says 172.21.15.35:58570) 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd34dc50700 1 -- 172.21.15.35:0/1163647674 learned_addr learned my addr 172.21.15.35:0/1163647674 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.650+0000 7fd34d44f700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acbbe0 0x563d86acf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34dc50700 1 -- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acbbe0 msgr2=0x563d86acf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34dc50700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acbbe0 0x563d86acf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34dc50700 1 -- 172.21.15.35:0/1163647674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 msgr2=0x563d86acfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34dc50700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86acfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34dc50700 1 -- 172.21.15.35:0/1163647674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34810c7a0 con 0x563d86ac6960 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34e451700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86acfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd34dc50700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 0x563d86ad2560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd344005a60 tx=0x7fd344004fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81c7087c5d0e95b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd3317fa700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd3317fa700 1 -- 172.21.15.35:0/1163647674 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344003d40 con 0x563d86ac6960 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d869db390 con 0x563d86ac6960 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd3317fa700 1 -- 172.21.15.35:0/1163647674 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(426..426 src has 1..426) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd344003ea0 con 0x563d86ac6960 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd3317fa700 1 -- 172.21.15.35:0/1163647674 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd344004060 con 0x563d86ac6960 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd35c041b80 10 client.30817 fetch_fsmap learned FSMap version 110 2023-03-17T12:01:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x563d86846d80 con 0x563d86ac6960 2023-03-17T12:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.651+0000 7fd3317fa700 1 -- 172.21.15.35:0/1163647674 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d869db390 con 0x563d86ac6960 2023-03-17T12:01:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd3317fa700 1 -- 172.21.15.35:0/1163647674 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fd34400f710 con 0x563d86ac6960 2023-03-17T12:01:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd35c041b80 10 client.30817 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:01:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd35c041b80 10 client.30817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:01:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd35c041b80 20 client.30817 populate_metadata read hostname 'smithi035' 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd35c041b80 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86adfcc0 0x563d86ae20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd35c041b80 4 client.30817 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d869e7600 con 0x563d86adfcc0 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd34d44f700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86adfcc0 0x563d86ae20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd34d44f700 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86adfcc0 0x563d86ae20d0 crc :-1 s=READY pgs=828 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=617ba817f4c44987 server_cookie=c873f90149f4db64 in_seq=0 out_seq=0 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.652+0000 7fd3317fa700 10 client.30817 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd3317fa700 1 -- 172.21.15.35:0/1163647674 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563d869e7600 con 0x563d86adfcc0 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd3317fa700 10 client.30817 handle_command_reply: tid=0 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 client.30817 shutdown 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 msgr2=0x563d86ad2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 0x563d86ad2560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd344005a60 tx=0x7fd344004fc0 comp rx=0 tx=0).stop 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 shutdown_connections 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86adfcc0 0x563d86ae20d0 crc :-1 s=READY pgs=828 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86acfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86ac6960 0x563d86ad2560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 --2- 172.21.15.35:0/1163647674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acbbe0 0x563d86acf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd3317fa700 0 client.30817 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 >> 172.21.15.35:0/1163647674 conn(0x563d869236b0 msgr2=0x563d86ac5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.653+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 shutdown_connections 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.654+0000 7fd35c041b80 1 -- 172.21.15.35:0/1163647674 wait complete. 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.654+0000 7fd35c041b80 20 client.30817 trim_cache size 0 max 16384 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.668+0000 7fd35c041b80 1 Processor -- start 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.668+0000 7fd35c041b80 1 -- start start 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 0x563d86ac0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acc4f0 0x563d86acf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd35c041b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86ac1000 con 0x563d86ac6960 2023-03-17T12:01:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd35c041b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86abc0d0 con 0x563d86acc4f0 2023-03-17T12:01:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd35c041b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86ad0710 con 0x563d86acbbe0 2023-03-17T12:01:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 0x563d86ac0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 0x563d86ac0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58574/0 (socket says 172.21.15.35:58574) 2023-03-17T12:01:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 -- 172.21.15.35:0/2267305682 learned_addr learned my addr 172.21.15.35:0/2267305682 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34d44f700 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 -- 172.21.15.35:0/2267305682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 msgr2=0x563d86ad6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 -- 172.21.15.35:0/2267305682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acc4f0 msgr2=0x563d86acf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acc4f0 0x563d86acf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 -- 172.21.15.35:0/2267305682 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d869df130 con 0x563d86ac6960 2023-03-17T12:01:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd34dc50700 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 0x563d86ac0ac0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7fd344009d10 tx=0x7fd3440094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a739fd1d06fbf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd33cff9700 1 -- 172.21.15.35:0/2267305682 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344004c40 con 0x563d86ac6960 2023-03-17T12:01:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd33cff9700 1 -- 172.21.15.35:0/2267305682 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd34401e040 con 0x563d86ac6960 2023-03-17T12:01:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.669+0000 7fd33cff9700 1 -- 172.21.15.35:0/2267305682 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400f660 con 0x563d86ac6960 2023-03-17T12:01:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 -- 172.21.15.35:0/2267305682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 msgr2=0x563d86ac0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 0x563d86ac0ac0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7fd344009d10 tx=0x7fd3440094b0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 -- 172.21.15.35:0/2267305682 shutdown_connections 2023-03-17T12:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86acc4f0 0x563d86acf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86ac6960 0x563d86ac0ac0 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 --2- 172.21.15.35:0/2267305682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 -- 172.21.15.35:0/2267305682 >> 172.21.15.35:0/2267305682 conn(0x563d869236b0 msgr2=0x563d86adb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 -- 172.21.15.35:0/2267305682 shutdown_connections 2023-03-17T12:01:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 -- 172.21.15.35:0/2267305682 wait complete. 2023-03-17T12:01:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 -- start start 2023-03-17T12:01:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.670+0000 7fd35c041b80 1 Processor -- start 2023-03-17T12:01:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ad4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86ad59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:13.884 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T12:01:13.884 INFO:teuthology.orchestra.run.smithi035.stdout: "status": "no active scrubs running", 2023-03-17T12:01:13.884 INFO:teuthology.orchestra.run.smithi035.stdout: "scrubs": {} 2023-03-17T12:01:13.884 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 -- 172.21.15.35:0/3805389437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 msgr2=0x7fa67410d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 --2- 172.21.15.35:0/3805389437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa67410d160 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b0a0 tx=0x7fa66c00b3b0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 -- 172.21.15.35:0/3805389437 shutdown_connections 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 --2- 172.21.15.35:0/3805389437 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa67410d160 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 --2- 172.21.15.35:0/3805389437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa674106430 0x7fa674106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 --2- 172.21.15.35:0/3805389437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 0x7fa674100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 -- 172.21.15.35:0/3805389437 >> 172.21.15.35:0/3805389437 conn(0x7fa674077580 msgr2=0x7fa674077980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 -- 172.21.15.35:0/3805389437 shutdown_connections 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.918+0000 7fa67b931700 1 -- 172.21.15.35:0/3805389437 wait complete. 2023-03-17T12:01:13.885 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 Processor -- start 2023-03-17T12:01:13.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 -- start start 2023-03-17T12:01:13.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 0x7fa674072d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:13.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa6740732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:13.886 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa674106430 0x7fa6741a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674073af0 con 0x7fa674101320 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741a4b00 con 0x7fa674106430 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa67b931700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741a4c40 con 0x7fa674100970 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa678ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa6740732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa678ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa6740732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59620/0 (socket says 172.21.15.35:59620) 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa678ecc700 1 -- 172.21.15.35:0/1191203242 learned_addr learned my addr 172.21.15.35:0/1191203242 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa679ece700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa674106430 0x7fa6741a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:15.503 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.919+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 0x7fa674072d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa678ecc700 1 -- 172.21.15.35:0/1191203242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 msgr2=0x7fa674072d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa678ecc700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 0x7fa674072d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa678ecc700 1 -- 172.21.15.35:0/1191203242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa674106430 msgr2=0x7fa6741a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa678ecc700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa674106430 0x7fa6741a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa678ecc700 1 -- 172.21.15.35:0/1191203242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009d00 con 0x7fa674101320 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 0x7fa674072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa678ecc700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa6740732c0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c9b0 tx=0x7fa67000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:16.184 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa66a7fc700 1 -- 172.21.15.35:0/1191203242 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670007b00 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa66a7fc700 1 -- 172.21.15.35:0/1191203242 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa670007c60 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa674110290 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa66a7fc700 1 -- 172.21.15.35:0/1191203242 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670018660 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.920+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674110100 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.922+0000 7fa66a7fc700 1 -- 172.21.15.35:0/1191203242 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fa67000f450 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.923+0000 7fa66a7fc700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa66009f6c0 0x7fa6600a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.923+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa66009f6c0 0x7fa6600a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.923+0000 7fa66a7fc700 1 -- 172.21.15.35:0/1191203242 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(451..451 src has 1..451) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa6700ca590 con 0x7fa674101320 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.923+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa66009f6c0 0x7fa6600a1b70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa66400bc00 tx=0x7fa664005ef0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 Processor -- start 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 -- start start 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d044ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 0x55b40d0490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.717 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d049a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40cf4b070 con 0x55b40d0450e0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40cf9d9b0 con 0x55b40d0447d0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa687abeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40cf96e40 con 0x55b40d049630 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 0x55b40d0490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 0x55b40d0490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59630/0 (socket says 172.21.15.35:59630) 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 -- 172.21.15.35:0/3257196850 learned_addr learned my addr 172.21.15.35:0/3257196850 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa6796cd700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d044ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 -- 172.21.15.35:0/3257196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 msgr2=0x55b40d049a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa679ece700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d049a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d049a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 -- 172.21.15.35:0/3257196850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 msgr2=0x55b40d044ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d044ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa678ecc700 1 -- 172.21.15.35:0/3257196850 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40ce18630 con 0x55b40d0450e0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa6796cd700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d044ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.924+0000 7fa679ece700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d049a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa678ecc700 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 0x55b40d0490f0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7fa670097fd0 tx=0x7fa670097a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4cebd0c8ea7bf3 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:19.718 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa65f7fe700 1 -- 172.21.15.35:0/3257196850 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700a0230 con 0x55b40d0450e0 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa65f7fe700 1 -- 172.21.15.35:0/3257196850 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6700963e0 con 0x55b40d0450e0 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa65f7fe700 1 -- 172.21.15.35:0/3257196850 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700982a0 con 0x55b40d0450e0 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 -- 172.21.15.35:0/3257196850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 msgr2=0x55b40d0490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 0x55b40d0490f0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7fa670097fd0 tx=0x7fa670097a90 comp rx=0 tx=0).stop 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 -- 172.21.15.35:0/3257196850 shutdown_connections 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d049a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d044ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 --2- 172.21.15.35:0/3257196850 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0450e0 0x55b40d0490f0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.925+0000 7fa687abeb80 1 -- 172.21.15.35:0/3257196850 >> 172.21.15.35:0/3257196850 conn(0x55b40d03f030 msgr2=0x55b40d03f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.926+0000 7fa687abeb80 1 -- 172.21.15.35:0/3257196850 shutdown_connections 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.926+0000 7fa687abeb80 1 -- 172.21.15.35:0/3257196850 wait complete. 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.926+0000 7fa687abeb80 1 -- start start 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.926+0000 7fa687abeb80 1 Processor -- start 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 0x55b40d050de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.719 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d04e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d04e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:19.720 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40ce1a920 con 0x55b40d0447d0 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d04ef10 con 0x55b40d0450e0 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d05a7f0 con 0x55b40d049630 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 10 client.0 _ll_register_callbacks cb 0x55b40ce3c290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 0x55b40d050de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 0x55b40d050de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59638/0 (socket says 172.21.15.35:59638) 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 -- 172.21.15.35:0/1053579483 learned_addr learned my addr 172.21.15.35:0/1053579483 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa679ece700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d04e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa678ecc700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d04e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 -- 172.21.15.35:0/1053579483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 msgr2=0x55b40d04e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d04e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 -- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 msgr2=0x55b40d04e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d04e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 -- 172.21.15.35:0/1053579483 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674110100 con 0x55b40d0447d0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa6796cd700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 0x55b40d050de0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7fa66400ff20 tx=0x7fa664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29e4ff924b24d62 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa65cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa65cff9700 1 -- 172.21.15.35:0/1053579483 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66401f430 con 0x55b40d0447d0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa65cff9700 1 -- 172.21.15.35:0/1053579483 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(451..451 src has 1..451) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa66401f590 con 0x55b40d0447d0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.927+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b40cf593f0 con 0x55b40d0447d0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa65cff9700 1 -- 172.21.15.35:0/1053579483 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa66401f750 con 0x55b40d0447d0 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 10 client.22503 fetch_fsmap learned FSMap version 112 2023-03-17T12:01:19.722 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55b40cdc4de0 con 0x55b40d0447d0 2023-03-17T12:01:21.993 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa65cff9700 1 -- 172.21.15.35:0/1053579483 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b40cf593f0 con 0x55b40d0447d0 2023-03-17T12:01:24.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa65cff9700 1 -- 172.21.15.35:0/1053579483 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa664025020 con 0x55b40d0447d0 2023-03-17T12:01:24.112 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 10 client.22503 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:01:24.993 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 10 client.22503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T12:01:26.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 20 client.22503 populate_metadata read hostname 'smithi035' 2023-03-17T12:01:26.878 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d05e810 0x55b40d060c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:27.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 4 client.22503 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:01:27.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b40cf65660 con 0x55b40d05e810 2023-03-17T12:01:27.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.928+0000 7fa678ecc700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d05e810 0x55b40d060c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:27.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa65cff9700 10 client.22503 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:27.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa678ecc700 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d05e810 0x55b40d060c20 crc :-1 s=READY pgs=879 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9946b31ffc1b9004 server_cookie=389b022f2eedad98 in_seq=0 out_seq=0 2023-03-17T12:01:27.551 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa65cff9700 1 -- 172.21.15.35:0/1053579483 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55b40cf65660 con 0x55b40d05e810 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa65cff9700 10 client.22503 handle_command_reply: tid=0 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa687abeb80 1 client.22503 shutdown 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 msgr2=0x55b40d050de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.929+0000 7fa687abeb80 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 0x55b40d050de0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7fa66400ff20 tx=0x7fa664004750 comp rx=0 tx=0).stop 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 shutdown_connections 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d05e810 0x55b40d060c20 crc :-1 s=READY pgs=879 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d049630 0x55b40d04e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:27.552 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa65cff9700 0 client.22503 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d0447d0 0x55b40d050de0 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 --2- 172.21.15.35:0/1053579483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d04e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 >> 172.21.15.35:0/1053579483 conn(0x55b40d03f030 msgr2=0x55b40d03e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 shutdown_connections 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 1 -- 172.21.15.35:0/1053579483 wait complete. 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.930+0000 7fa687abeb80 20 client.22503 trim_cache size 0 max 16384 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 Processor -- start 2023-03-17T12:01:31.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 -- start start 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d055700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0450e0 0x55b40d050980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d047830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d05bfc0 con 0x55b40d049630 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d03fef0 con 0x55b40d0447d0 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.947+0000 7fa687abeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d045940 con 0x55b40d0450e0 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d047830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d047830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59646/0 (socket says 172.21.15.35:59646) 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 -- 172.21.15.35:0/2526857262 learned_addr learned my addr 172.21.15.35:0/2526857262 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa6796cd700 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d055700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa678ecc700 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0450e0 0x55b40d050980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 -- 172.21.15.35:0/2526857262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0450e0 msgr2=0x55b40d050980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0450e0 0x55b40d050980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 -- 172.21.15.35:0/2526857262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 msgr2=0x55b40d055700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d055700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:31.495 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 -- 172.21.15.35:0/2526857262 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b40cf5d190 con 0x55b40d049630 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa6796cd700 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d055700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa679ece700 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d047830 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b0a0 tx=0x7fa66c0090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50e96ca0d645f6c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa65ffff700 1 -- 172.21.15.35:0/2526857262 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00e040 con 0x55b40d049630 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa65ffff700 1 -- 172.21.15.35:0/2526857262 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa66c003a00 con 0x55b40d049630 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.948+0000 7fa65ffff700 1 -- 172.21.15.35:0/2526857262 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c005460 con 0x55b40d049630 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 -- 172.21.15.35:0/2526857262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 msgr2=0x55b40d047830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:31.496 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d047830 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b0a0 tx=0x7fa66c0090d0 comp rx=0 tx=0).stop 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 -- 172.21.15.35:0/2526857262 shutdown_connections 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d047830 unknown :-1 s=CLOSED pgs=2596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0447d0 0x55b40d055700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2526857262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0450e0 0x55b40d050980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 -- 172.21.15.35:0/2526857262 >> 172.21.15.35:0/2526857262 conn(0x55b40d03f030 msgr2=0x55b40d059e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 -- 172.21.15.35:0/2526857262 shutdown_connections 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 -- 172.21.15.35:0/2526857262 wait complete. 2023-03-17T12:01:35.594 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 -- start start 2023-03-17T12:01:35.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.949+0000 7fa687abeb80 1 Processor -- start 2023-03-17T12:01:35.595 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0447d0 0x55b40d053f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:35.595 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:26 smithi035 ceph-mon[92535]: pgmap v6191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:01:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86b32c50 con 0x563d86acc4f0 2023-03-17T12:01:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86b32dc0 con 0x563d86ac6960 2023-03-17T12:01:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d86b32f80 con 0x563d86acbbe0 2023-03-17T12:01:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd35c041b80 10 client.0 _ll_register_callbacks cb 0x563d868be230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:01:38.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86ad59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:38.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86ad59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58584/0 (socket says 172.21.15.35:58584) 2023-03-17T12:01:38.362 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 -- 172.21.15.35:0/3878755602 learned_addr learned my addr 172.21.15.35:0/3878755602 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34dc50700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ad4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34d44f700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 -- 172.21.15.35:0/3878755602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 msgr2=0x563d86ad5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 -- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 msgr2=0x563d86ad4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ad4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34e451700 1 -- 172.21.15.35:0/3878755602 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d86846d80 con 0x563d86acc4f0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.671+0000 7fd34d44f700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd34e451700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86ad59b0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7fd3400ca4f0 tx=0x7fd34009a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a75999d13a0a54 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd3317fa700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd3317fa700 1 -- 172.21.15.35:0/3878755602 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340098670 con 0x563d86acc4f0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd3317fa700 1 -- 172.21.15.35:0/3878755602 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(426..426 src has 1..426) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fd340099700 con 0x563d86acc4f0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d86a961e0 con 0x563d86acc4f0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd3317fa700 1 -- 172.21.15.35:0/3878755602 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3400998c0 con 0x563d86acc4f0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 10 client.22089 fetch_fsmap learned FSMap version 110 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x563d8686d1f0 con 0x563d86acc4f0 2023-03-17T12:01:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd3317fa700 1 -- 172.21.15.35:0/3878755602 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d86a961e0 con 0x563d86acc4f0 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd3317fa700 1 -- 172.21.15.35:0/3878755602 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fd3400b2340 con 0x563d86acc4f0 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 10 client.22089 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 10 client.22089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 20 client.22089 populate_metadata read hostname 'smithi035' 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86b34730 0x563d86b36b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 4 client.22089 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.672+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563d8689cf00 con 0x563d86b34730 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.673+0000 7fd34dc50700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86b34730 0x563d86b36b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.673+0000 7fd34dc50700 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86b34730 0x563d86b36b10 crc :-1 s=READY pgs=829 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7438ad3299376e0 server_cookie=b05ebd53f6477862 in_seq=0 out_seq=0 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.673+0000 7fd3317fa700 10 client.22089 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd3317fa700 1 -- 172.21.15.35:0/3878755602 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563d8689cf00 con 0x563d86b34730 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd3317fa700 10 client.22089 handle_command_reply: tid=0 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 client.22089 shutdown 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 msgr2=0x563d86ad59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86ad59b0 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7fd3400ca4f0 tx=0x7fd34009a2d0 comp rx=0 tx=0).stop 2023-03-17T12:01:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 shutdown_connections 2023-03-17T12:01:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x563d86b34730 0x563d86b36b10 crc :-1 s=READY pgs=829 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x563d86acc4f0 0x563d86ad59b0 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd3317fa700 0 client.22089 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563d86ac6960 0x563d86ad4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 --2- 172.21.15.35:0/3878755602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d86acbbe0 0x563d86ad5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 >> 172.21.15.35:0/3878755602 conn(0x563d869236b0 msgr2=0x563d86acefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 shutdown_connections 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 1 -- 172.21.15.35:0/3878755602 wait complete. 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.690+0000 7fd35c041b80 20 client.22089 trim_cache size 0 max 16384 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd33409f6c0 msgr2=0x7fd3340a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd33409f6c0 0x7fd3340a1b70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd34400b580 tx=0x7fd344009f10 comp rx=0 tx=0).stop 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 msgr2=0x7fd348199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 0x7fd348199b10 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7fd340007f10 tx=0x7fd34000f5c0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 shutdown_connections 2023-03-17T12:01:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fd33409f6c0 0x7fd3340a1b70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fd348104390 0x7fd348199b10 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3480ff350 0x7fd348195170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 --2- 172.21.15.35:0/504221548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3480ffcf0 0x7fd3481956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 >> 172.21.15.35:0/504221548 conn(0x7fd348076330 msgr2=0x7fd3480fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 shutdown_connections 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:39:58.691+0000 7fd34feb4700 1 -- 172.21.15.35:0/504221548 wait complete. 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 -- 172.21.15.35:0/2353410499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ff350 msgr2=0x7ffb440ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/2353410499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ff350 0x7ffb440ff720 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7ffb400099c0 tx=0x7ffb40009cd0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 -- 172.21.15.35:0/2353410499 shutdown_connections 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/2353410499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 0x7ffb4410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/2353410499 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ff350 0x7ffb440ff720 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/2353410499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb440ffcf0 0x7ffb44103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 -- 172.21.15.35:0/2353410499 >> 172.21.15.35:0/2353410499 conn(0x7ffb44076330 msgr2=0x7ffb44076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 -- 172.21.15.35:0/2353410499 shutdown_connections 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.813+0000 7ffb4c43f700 1 -- 172.21.15.35:0/2353410499 wait complete. 2023-03-17T12:01:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 Processor -- start 2023-03-17T12:01:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 -- start start 2023-03-17T12:01:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb440ff350 0x7ffb441961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 0x7ffb44196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 0x7ffb4419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4419b1a0 con 0x7ffb440ffcf0 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4419b310 con 0x7ffb44104390 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4c43f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4419b4d0 con 0x7ffb440ff350 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 0x7ffb44196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 0x7ffb44196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58596/0 (socket says 172.21.15.35:58596) 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 -- 172.21.15.35:0/42926257 learned_addr learned my addr 172.21.15.35:0/42926257 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb440ff350 0x7ffb441961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 0x7ffb4419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 -- 172.21.15.35:0/42926257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb440ff350 msgr2=0x7ffb441961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb440ff350 0x7ffb441961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 -- 172.21.15.35:0/42926257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 msgr2=0x7ffb4419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 0x7ffb4419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb499da700 1 -- 172.21.15.35:0/42926257 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb400095f0 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.814+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 0x7ffb4419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.815+0000 7ffb499da700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 0x7ffb44196700 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400d950 tx=0x7ffb3400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.815+0000 7ffb3b7fe700 1 -- 172.21.15.35:0/42926257 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34009930 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.815+0000 7ffb3b7fe700 1 -- 172.21.15.35:0/42926257 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb34010460 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.815+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4410f000 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.815+0000 7ffb3b7fe700 1 -- 172.21.15.35:0/42926257 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400f620 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.815+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4410ee70 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.817+0000 7ffb3b7fe700 1 -- 172.21.15.35:0/42926257 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7ffb34009a90 con 0x7ffb440ffcf0 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.818+0000 7ffb3b7fe700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffb3009f640 0x7ffb300a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.818+0000 7ffb3b7fe700 1 -- 172.21.15.35:0/42926257 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(427..427 src has 1..427) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ffb340ca230 con 0x7ffb440ffcf0 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.818+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffb3009f640 0x7ffb300a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.818+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffb3009f640 0x7ffb300a1af0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000b580 tx=0x7ffb40009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 Processor -- start 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 -- start start 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83a6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83a6960 0x5563a83a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a82ad010 con 0x5563a83ac4f0 2023-03-17T12:01:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a82ff950 con 0x5563a83abbe0 2023-03-17T12:01:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.819+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a82f8de0 con 0x5563a83a6960 2023-03-17T12:01:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83a6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58604/0 (socket says 172.21.15.35:58604) 2023-03-17T12:01:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 -- 172.21.15.35:0/939895254 learned_addr learned my addr 172.21.15.35:0/939895254 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83a6960 0x5563a83a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 -- 172.21.15.35:0/939895254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83a6960 msgr2=0x5563a83a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83a6960 0x5563a83a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 -- 172.21.15.35:0/939895254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 msgr2=0x5563a83abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 -- 172.21.15.35:0/939895254 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563a817a5d0 con 0x5563a83ac4f0 2023-03-17T12:01:43.248 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb499da700 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83a6420 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7ffb34094150 tx=0x7ffb34097b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1475680a7e2dc92c server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb38dae700 1 -- 172.21.15.35:0/939895254 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3409fe40 con 0x5563a83ac4f0 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb38dae700 1 -- 172.21.15.35:0/939895254 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb34095ff0 con 0x5563a83ac4f0 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.820+0000 7ffb38dae700 1 -- 172.21.15.35:0/939895254 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34097140 con 0x5563a83ac4f0 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 -- 172.21.15.35:0/939895254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 msgr2=0x5563a83a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83a6420 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7ffb34094150 tx=0x7ffb34097b50 comp rx=0 tx=0).stop 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 -- 172.21.15.35:0/939895254 shutdown_connections 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83a6960 0x5563a83a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/939895254 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83a6420 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 -- 172.21.15.35:0/939895254 >> 172.21.15.35:0/939895254 conn(0x5563a82036b0 msgr2=0x5563a83a0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 -- 172.21.15.35:0/939895254 shutdown_connections 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 -- 172.21.15.35:0/939895254 wait complete. 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 -- start start 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.821+0000 7ffb585ccb80 1 Processor -- start 2023-03-17T12:01:43.249 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83a6960 0x5563a83b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83abbe0 0x5563a83af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a817c8c0 con 0x5563a83ac4f0 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a83b05f0 con 0x5563a83a6960 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a83bc000 con 0x5563a83abbe0 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb585ccb80 10 client.0 _ll_register_callbacks cb 0x5563a819e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58612/0 (socket says 172.21.15.35:58612) 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a1db700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83a6960 0x5563a83b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 -- 172.21.15.35:0/1575792732 learned_addr learned my addr 172.21.15.35:0/1575792732 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb499da700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83abbe0 0x5563a83af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 -- 172.21.15.35:0/1575792732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83abbe0 msgr2=0x5563a83af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83abbe0 0x5563a83af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 -- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83a6960 msgr2=0x5563a83b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83a6960 0x5563a83b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb4a9dc700 1 -- 172.21.15.35:0/1575792732 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4410ee70 con 0x5563a83ac4f0 2023-03-17T12:01:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.822+0000 7ffb499da700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83abbe0 0x5563a83af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:01:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83afe80 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c010b00 tx=0x7ffb3c010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd53050175d0fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:01:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb2dffb700 1 -- 172.21.15.35:0/1575792732 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c003a00 con 0x5563a83ac4f0 2023-03-17T12:01:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb2dffb700 1 -- 172.21.15.35:0/1575792732 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(427..427 src has 1..427) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ffb3c003b60 con 0x5563a83ac4f0 2023-03-17T12:01:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563a82bb390 con 0x5563a83ac4f0 2023-03-17T12:01:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb2dffb700 1 -- 172.21.15.35:0/1575792732 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb3c003d20 con 0x5563a83ac4f0 2023-03-17T12:01:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 10 client.22101 fetch_fsmap learned FSMap version 110 2023-03-17T12:01:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5563a8126d80 con 0x5563a83ac4f0 2023-03-17T12:01:43.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d054470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:43.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d0549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:43.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d0b27c0 con 0x55b40d049630 2023-03-17T12:01:45.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d0b2930 con 0x55b40d0450e0 2023-03-17T12:01:45.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b40d0b2af0 con 0x55b40d0447d0 2023-03-17T12:01:45.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa687abeb80 10 client.0 _ll_register_callbacks cb 0x55b40ce3c290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:01:45.111 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d0549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:45.112 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d0549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59652/0 (socket says 172.21.15.35:59652) 2023-03-17T12:01:46.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 -- 172.21.15.35:0/2181617866 learned_addr learned my addr 172.21.15.35:0/2181617866 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:46.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa6796cd700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0447d0 0x55b40d053f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:46.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa678ecc700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d054470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:46.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 -- 172.21.15.35:0/2181617866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0447d0 msgr2=0x55b40d053f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:47.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0447d0 0x55b40d053f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:47.265 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 -- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 msgr2=0x55b40d054470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:48.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d054470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:48.777 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 -- 172.21.15.35:0/2181617866 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67410da60 con 0x55b40d049630 2023-03-17T12:01:48.778 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa679ece700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d0549b0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b070 tx=0x7fa66c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e994f26abd1e5404 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.950+0000 7fa65cff9700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa65cff9700 1 -- 172.21.15.35:0/2181617866 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00e030 con 0x55b40d049630 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b40d014240 con 0x55b40d049630 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa65cff9700 1 -- 172.21.15.35:0/2181617866 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(451..451 src has 1..451) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fa66c005270 con 0x55b40d049630 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa65cff9700 1 -- 172.21.15.35:0/2181617866 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa66c005470 con 0x55b40d049630 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 10 client.22509 fetch_fsmap learned FSMap version 112 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55b40cdeb250 con 0x55b40d049630 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa65cff9700 1 -- 172.21.15.35:0/2181617866 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b40d014240 con 0x55b40d049630 2023-03-17T12:01:50.546 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa65cff9700 1 -- 172.21.15.35:0/2181617866 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7fa66c025030 con 0x55b40d049630 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 10 client.22509 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 10 client.22509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 20 client.22509 populate_metadata read hostname 'smithi035' 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d0b3e90 0x55b40d0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 4 client.22509 mds_command: new command op to 24452 tid=0[{"prefix": "scrub status"}] 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b40ce1af60 con 0x55b40d0b3e90 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.951+0000 7fa6796cd700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d0b3e90 0x55b40d0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa65cff9700 10 client.22509 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa6796cd700 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d0b3e90 0x55b40d0b62a0 crc :-1 s=READY pgs=880 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed621df5d3b79fa server_cookie=c4e6cce30592bd2 in_seq=0 out_seq=0 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa65cff9700 1 -- 172.21.15.35:0/2181617866 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b40ce1af60 con 0x55b40d0b3e90 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa65cff9700 10 client.22509 handle_command_reply: tid=0 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 client.22509 shutdown 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 msgr2=0x55b40d0549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d0549b0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b070 tx=0x7fa66c009780 comp rx=0 tx=0).stop 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 shutdown_connections 2023-03-17T12:01:50.547 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55b40d0b3e90 0x55b40d0b62a0 crc :-1 s=READY pgs=880 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:50.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55b40d049630 0x55b40d0549b0 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:50.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b40d0447d0 0x55b40d053f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:50.928 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa65cff9700 0 client.22509 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:50.967 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 --2- 172.21.15.35:0/2181617866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b40d0450e0 0x55b40d054470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 >> 172.21.15.35:0/2181617866 conn(0x55b40d03f030 msgr2=0x55b40d047830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 shutdown_connections 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.952+0000 7fa687abeb80 1 -- 172.21.15.35:0/2181617866 wait complete. 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa687abeb80 20 client.22509 trim_cache size 0 max 16384 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa66009f6c0 msgr2=0x7fa6600a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa66009f6c0 0x7fa6600a1b70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa66400bc00 tx=0x7fa664005ef0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 msgr2=0x7fa6740732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa6740732c0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c9b0 tx=0x7fa67000ccc0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 shutdown_connections 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fa66009f6c0 0x7fa6600a1b70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa674106430 0x7fa6741a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa674100970 0x7fa674072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.750 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 --2- 172.21.15.35:0/1191203242 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fa674101320 0x7fa6740732c0 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:51.751 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 >> 172.21.15.35:0/1191203242 conn(0x7fa674077580 msgr2=0x7fa6740fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:51.751 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 shutdown_connections 2023-03-17T12:01:51.751 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T11:52:02.953+0000 7fa67b931700 1 -- 172.21.15.35:0/1191203242 wait complete. 2023-03-17T12:01:51.752 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:28 smithi035 ceph-mon[92535]: pgmap v6192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:01:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb2dffb700 1 -- 172.21.15.35:0/1575792732 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563a82bb390 con 0x5563a83ac4f0 2023-03-17T12:01:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb2dffb700 1 -- 172.21.15.35:0/1575792732 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ffb3c015670 con 0x5563a83ac4f0 2023-03-17T12:01:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 10 client.22101 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:01:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 10 client.22101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:01:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 20 client.22101 populate_metadata read hostname 'smithi035' 2023-03-17T12:01:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a83c01e0 0x5563a83c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 4 client.22101 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:01:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.823+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563a82c7600 con 0x5563a83c01e0 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.824+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a83c01e0 0x5563a83c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.824+0000 7ffb2dffb700 10 client.22101 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.824+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a83c01e0 0x5563a83c25f0 crc :-1 s=READY pgs=830 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d17c4f67aa9451c9 server_cookie=86b1c33366481d18 in_seq=0 out_seq=0 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb2dffb700 1 -- 172.21.15.35:0/1575792732 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5563a82c7600 con 0x5563a83c01e0 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb2dffb700 10 client.22101 handle_command_reply: tid=0 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 client.22101 shutdown 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 msgr2=0x5563a83afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83afe80 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c010b00 tx=0x7ffb3c010e10 comp rx=0 tx=0).stop 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 shutdown_connections 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a83c01e0 0x5563a83c25f0 crc :-1 s=READY pgs=830 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83ac4f0 0x5563a83afe80 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb2dffb700 0 client.22101 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83a6960 0x5563a83b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/1575792732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83abbe0 0x5563a83af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 >> 172.21.15.35:0/1575792732 conn(0x5563a82036b0 msgr2=0x5563a83a5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:01:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 shutdown_connections 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 1 -- 172.21.15.35:0/1575792732 wait complete. 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.825+0000 7ffb585ccb80 20 client.22101 trim_cache size 0 max 16384 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 Processor -- start 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 -- start start 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a83b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a839c0d0 con 0x5563a83a6960 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a83a67c0 con 0x5563a83abbe0 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a83a16d0 con 0x5563a83ac4f0 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58616/0 (socket says 172.21.15.35:58616) 2023-03-17T12:01:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 -- 172.21.15.35:0/900651271 learned_addr learned my addr 172.21.15.35:0/900651271 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:01:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb499da700 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:01:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 -- 172.21.15.35:0/900651271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 msgr2=0x5563a83b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a83b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 -- 172.21.15.35:0/900651271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 msgr2=0x5563a83b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:01:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:01:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 -- 172.21.15.35:0/900651271 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563a82bf130 con 0x5563a83a6960 2023-03-17T12:01:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83a0ac0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7ffb400098e0 tx=0x7ffb40020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45667c4301378227 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:01:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb395af700 1 -- 172.21.15.35:0/900651271 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40005640 con 0x5563a83a6960 2023-03-17T12:01:57.757 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb395af700 1 -- 172.21.15.35:0/900651271 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb4001e040 con 0x5563a83a6960 2023-03-17T12:01:59.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.841+0000 7ffb395af700 1 -- 172.21.15.35:0/900651271 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40004740 con 0x5563a83a6960 2023-03-17T12:01:59.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 -- 172.21.15.35:0/900651271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 msgr2=0x5563a83a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:01:59.726 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83a0ac0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7ffb400098e0 tx=0x7ffb40020000 comp rx=0 tx=0).stop 2023-03-17T12:02:01.365 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 -- 172.21.15.35:0/900651271 shutdown_connections 2023-03-17T12:02:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a83b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:01.366 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83a0ac0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/900651271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 -- 172.21.15.35:0/900651271 >> 172.21.15.35:0/900651271 conn(0x5563a82036b0 msgr2=0x5563a83bb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 -- 172.21.15.35:0/900651271 shutdown_connections 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 -- 172.21.15.35:0/900651271 wait complete. 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 -- start start 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.842+0000 7ffb585ccb80 1 Processor -- start 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a840d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:03.078 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a840d600 con 0x5563a83a6960 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a840d770 con 0x5563a83abbe0 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563a840d930 con 0x5563a83ac4f0 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 10 client.0 _ll_register_callbacks cb 0x5563a819e230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58622/0 (socket says 172.21.15.35:58622) 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 -- 172.21.15.35:0/2643223114 learned_addr learned my addr 172.21.15.35:0/2643223114 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb499da700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a9dc700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a840d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:03.079 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 -- 172.21.15.35:0/2643223114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 msgr2=0x5563a840d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a840d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 -- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 msgr2=0x5563a83b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 -- 172.21.15.35:0/2643223114 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4002c040 con 0x5563a83a6960 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb499da700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb4a1db700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83b50f0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c010 tx=0x7ffb40005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3fa83e137f8ef server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb2dffb700 1 -- 172.21.15.35:0/2643223114 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400353c0 con 0x5563a83a6960 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563a83761e0 con 0x5563a83a6960 2023-03-17T12:02:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb2dffb700 1 -- 172.21.15.35:0/2643223114 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(427..427 src has 1..427) v4 ==== 8499+0+0 (secure 0 0 0) 0x7ffb40035520 con 0x5563a83a6960 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.843+0000 7ffb2dffb700 1 -- 172.21.15.35:0/2643223114 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb40042800 con 0x5563a83a6960 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 10 client.22107 fetch_fsmap learned FSMap version 110 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5563a814d1f0 con 0x5563a83a6960 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb2dffb700 1 -- 172.21.15.35:0/2643223114 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563a83761e0 con 0x5563a83a6960 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb2dffb700 1 -- 172.21.15.35:0/2643223114 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7ffb40004a70 con 0x5563a83a6960 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 10 client.22107 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 10 client.22107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 20 client.22107 populate_metadata read hostname 'smithi035' 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a8414be0 0x5563a8416fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 4 client.22107 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5563a817cf00 con 0x5563a8414be0 2023-03-17T12:02:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb499da700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a8414be0 0x5563a8416fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb2dffb700 10 client.22107 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.844+0000 7ffb499da700 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a8414be0 0x5563a8416fc0 crc :-1 s=READY pgs=831 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0f6dcc5fa8d7e8 server_cookie=2def08101839370a in_seq=0 out_seq=0 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb2dffb700 1 -- 172.21.15.35:0/2643223114 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5563a817cf00 con 0x5563a8414be0 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb2dffb700 10 client.22107 handle_command_reply: tid=0 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 client.22107 shutdown 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 msgr2=0x5563a83b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83b50f0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c010 tx=0x7ffb40005bc0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 shutdown_connections 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x5563a8414be0 0x5563a8416fc0 crc :-1 s=READY pgs=831 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5563a83ac4f0 0x5563a840d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5563a83a6960 0x5563a83b50f0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 --2- 172.21.15.35:0/2643223114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5563a83abbe0 0x5563a83b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb2dffb700 0 client.22107 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.865+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 >> 172.21.15.35:0/2643223114 conn(0x5563a82036b0 msgr2=0x5563a83a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 shutdown_connections 2023-03-17T12:02:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb585ccb80 1 -- 172.21.15.35:0/2643223114 wait complete. 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb585ccb80 20 client.22107 trim_cache size 0 max 16384 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffb3009f640 msgr2=0x7ffb300a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffb3009f640 0x7ffb300a1af0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000b580 tx=0x7ffb40009f10 comp rx=0 tx=0).stop 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 msgr2=0x7ffb44196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 0x7ffb44196700 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400d950 tx=0x7ffb3400dc60 comp rx=0 tx=0).stop 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 shutdown_connections 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7ffb3009f640 0x7ffb300a1af0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb44104390 0x7ffb4419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb440ff350 0x7ffb441961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 --2- 172.21.15.35:0/42926257 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7ffb440ffcf0 0x7ffb44196700 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 >> 172.21.15.35:0/42926257 conn(0x7ffb44076330 msgr2=0x7ffb44102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 shutdown_connections 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:11.866+0000 7ffb4c43f700 1 -- 172.21.15.35:0/42926257 wait complete. 2023-03-17T12:02:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 -- 172.21.15.35:0/3710379290 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc104390 msgr2=0x7f32fc10bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 --2- 172.21.15.35:0/3710379290 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc104390 0x7f32fc10bf60 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f32f400b0d0 tx=0x7f32f400b3e0 comp rx=0 tx=0).stop 2023-03-17T12:02:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 -- 172.21.15.35:0/3710379290 shutdown_connections 2023-03-17T12:02:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 --2- 172.21.15.35:0/3710379290 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc104390 0x7f32fc10bf60 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 --2- 172.21.15.35:0/3710379290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32fc0ff350 0x7f32fc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 --2- 172.21.15.35:0/3710379290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32fc0ffcf0 0x7f32fc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 -- 172.21.15.35:0/3710379290 >> 172.21.15.35:0/3710379290 conn(0x7f32fc076330 msgr2=0x7f32fc076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 -- 172.21.15.35:0/3710379290 shutdown_connections 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 -- 172.21.15.35:0/3710379290 wait complete. 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.987+0000 7f3301031700 1 Processor -- start 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 -- start start 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32fc0ff350 0x7f32fc100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc0ffcf0 0x7f32fc101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32fc104390 0x7f32fc1a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc101ac0 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1a4ad0 con 0x7f32fc0ff350 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f3301031700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1a4c10 con 0x7f32fc104390 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc0ffcf0 0x7f32fc101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc0ffcf0 0x7f32fc101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58638/0 (socket says 172.21.15.35:58638) 2023-03-17T12:02:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 -- 172.21.15.35:0/2856529936 learned_addr learned my addr 172.21.15.35:0/2856529936 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32fc0ff350 0x7f32fc100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32fc104390 0x7f32fc1a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 -- 172.21.15.35:0/2856529936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32fc104390 msgr2=0x7f32fc1a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32fc104390 0x7f32fc1a4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 -- 172.21.15.35:0/2856529936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32fc0ff350 msgr2=0x7f32fc100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.988+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32fc0ff350 0x7f32fc100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f32fa59c700 1 -- 172.21.15.35:0/2856529936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009d00 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f32fc0ffcf0 0x7f32fc101290 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f32f000d980 tx=0x7f32f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f32e3fff700 1 -- 172.21.15.35:0/2856529936 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0004a30 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f32e3fff700 1 -- 172.21.15.35:0/2856529936 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32f00054b0 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f32e3fff700 1 -- 172.21.15.35:0/2856529936 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000fb50 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f3301031700 1 -- 172.21.15.35:0/2856529936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc10f060 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.989+0000 7f3301031700 1 -- 172.21.15.35:0/2856529936 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc10eed0 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.991+0000 7f32e3fff700 1 -- 172.21.15.35:0/2856529936 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f32f0004c20 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.992+0000 7f32e3fff700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f32e409f6c0 0x7f32e40a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.992+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f32e409f6c0 0x7f32e40a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.992+0000 7f32e3fff700 1 -- 172.21.15.35:0/2856529936 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(428..428 src has 1..428) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f32f00c9c90 con 0x7f32fc0ffcf0 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.992+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2856529936 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f32e409f6c0 0x7f32e40a1b70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f32ec005950 tx=0x7f32ec00b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 Processor -- start 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 -- start start 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e72fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e6d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e6dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054d74010 con 0x55f054e734f0 2023-03-17T12:02:11.543 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-03-17T12:02:13.419 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:30 smithi035 ceph-mon[92535]: pgmap v6193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:32 smithi035 ceph-mon[92535]: pgmap v6194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:34 smithi035 ceph-mon[92535]: pgmap v6195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:36 smithi035 ceph-mon[92535]: pgmap v6196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:38 smithi035 ceph-mon[92535]: pgmap v6197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:40 smithi035 ceph-mon[92535]: pgmap v6198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:42 smithi035 ceph-mon[92535]: pgmap v6199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:44 smithi035 ceph-mon[92535]: pgmap v6200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:46 smithi035 ceph-mon[92535]: pgmap v6201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:48 smithi035 ceph-mon[92535]: pgmap v6202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.420 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:50 smithi035 ceph-mon[92535]: pgmap v6203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:13.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:52 smithi035 ceph-mon[92535]: pgmap v6204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:54 smithi035 ceph-mon[92535]: pgmap v6205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:13.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:56 smithi035 ceph-mon[92535]: pgmap v6206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:13.421 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:53:58 smithi035 ceph-mon[92535]: pgmap v6207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:14.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:00 smithi035 ceph-mon[92535]: pgmap v6208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:14.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:02 smithi035 ceph-mon[92535]: pgmap v6209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:14.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:04 smithi035 ceph-mon[92535]: pgmap v6210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:02:14.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:06 smithi035 ceph-mon[92535]: pgmap v6211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:02:14.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:08 smithi035 ceph-mon[92535]: pgmap v6212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:02:14.503 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:10 smithi035 ceph-mon[92535]: pgmap v6213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:02:16.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:10 smithi035 ceph-mon[92535]: osdmap e456: 12 total, 12 up, 12 in 2023-03-17T12:02:16.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:12 smithi035 ceph-mon[92535]: pgmap v6215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:02:16.438 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:14 smithi035 ceph-mon[92535]: pgmap v6216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:16.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:02:16.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:16 smithi035 ceph-mon[92535]: pgmap v6217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:16.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:02:16.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:02:16.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:02:16.439 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:17 smithi035 ceph-mon[92535]: pgmap v6218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:02:16.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:17 smithi035 ceph-mon[92535]: pgmap v6219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:16.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:18 smithi035 ceph-mon[92535]: pgmap v6220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-17T12:02:16.971 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:18 smithi035 ceph-mon[92535]: osdmap e457: 12 total, 12 up, 12 in 2023-03-17T12:02:18.161 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:20 smithi035 ceph-mon[92535]: pgmap v6222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:18.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:22 smithi035 ceph-mon[92535]: pgmap v6223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:18.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:24 smithi035 ceph-mon[92535]: pgmap v6224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:02:18.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:26 smithi035 ceph-mon[92535]: pgmap v6225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:02:18.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:28 smithi035 ceph-mon[92535]: pgmap v6226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:02:18.834 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:30 smithi035 ceph-mon[92535]: pgmap v6227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:02:18.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:32 smithi035 ceph-mon[92535]: pgmap v6228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:18.835 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:34 smithi035 ceph-mon[92535]: pgmap v6229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:19.179 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:36 smithi035 ceph-mon[92535]: pgmap v6230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:19.179 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:39 smithi035 ceph-mon[92535]: pgmap v6231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:41 smithi035 ceph-mon[92535]: pgmap v6232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:43 smithi035 ceph-mon[92535]: pgmap v6233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:45 smithi035 ceph-mon[92535]: pgmap v6234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:47 smithi035 ceph-mon[92535]: pgmap v6235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:49 smithi035 ceph-mon[92535]: pgmap v6236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:51 smithi035 ceph-mon[92535]: pgmap v6237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:53 smithi035 ceph-mon[92535]: pgmap v6238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:20.196 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:55 smithi035 ceph-mon[92535]: pgmap v6239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:20.675 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:57 smithi035 ceph-mon[92535]: pgmap v6240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:21.097 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:54:59 smithi035 ceph-mon[92535]: pgmap v6241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:21.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:01 smithi035 ceph-mon[92535]: pgmap v6242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:21.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:03 smithi035 ceph-mon[92535]: pgmap v6243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:21.098 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:05 smithi035 ceph-mon[92535]: pgmap v6244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:02:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054dc6950 con 0x55f054e72be0 2023-03-17T12:02:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f330d1beb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054dbfde0 con 0x55f054e6d960 2023-03-17T12:02:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e6d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e6d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58646/0 (socket says 172.21.15.35:58646) 2023-03-17T12:02:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fa59c700 1 -- 172.21.15.35:0/2623141090 learned_addr learned my addr 172.21.15.35:0/2623141090 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:02:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e72fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e6dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fa59c700 1 -- 172.21.15.35:0/2623141090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 msgr2=0x55f054e6dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e6dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.993+0000 7f32fa59c700 1 -- 172.21.15.35:0/2623141090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 msgr2=0x55f054e72fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e72fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32fa59c700 1 -- 172.21.15.35:0/2623141090 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f054c415d0 con 0x55f054e734f0 2023-03-17T12:02:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e72fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:02:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e6d420 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f32f0093c40 tx=0x7f32f0097120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6141d11a4b086b85 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32e17fa700 1 -- 172.21.15.35:0/2623141090 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0095ae0 con 0x55f054e734f0 2023-03-17T12:02:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32e17fa700 1 -- 172.21.15.35:0/2623141090 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32f000fcb0 con 0x55f054e734f0 2023-03-17T12:02:24.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.994+0000 7f32e17fa700 1 -- 172.21.15.35:0/2623141090 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0096c30 con 0x55f054e734f0 2023-03-17T12:02:24.400 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- 172.21.15.35:0/2623141090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 msgr2=0x55f054e6d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e6d420 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f32f0093c40 tx=0x7f32f0097120 comp rx=0 tx=0).stop 2023-03-17T12:02:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- 172.21.15.35:0/2623141090 shutdown_connections 2023-03-17T12:02:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e6dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e72fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2623141090 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e6d420 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:24.401 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- 172.21.15.35:0/2623141090 >> 172.21.15.35:0/2623141090 conn(0x55f054cca6b0 msgr2=0x55f054e67a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- 172.21.15.35:0/2623141090 shutdown_connections 2023-03-17T12:02:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- 172.21.15.35:0/2623141090 wait complete. 2023-03-17T12:02:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- start start 2023-03-17T12:02:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 Processor -- start 2023-03-17T12:02:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e6d960 0x55f054e79480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e72be0 0x55f054e76700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e76da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054c438c0 con 0x55f054e734f0 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e77510 con 0x55f054e6d960 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e82e50 con 0x55f054e72be0 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.995+0000 7f330d1beb80 10 client.0 _ll_register_callbacks cb 0x55f054c65230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e76da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e76da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58654/0 (socket says 172.21.15.35:58654) 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 -- 172.21.15.35:0/2064311636 learned_addr learned my addr 172.21.15.35:0/2064311636 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e6d960 0x55f054e79480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e72be0 0x55f054e76700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 -- 172.21.15.35:0/2064311636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e72be0 msgr2=0x55f054e76700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e72be0 0x55f054e76700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 -- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e6d960 msgr2=0x55f054e79480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e6d960 0x55f054e79480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 -- 172.21.15.35:0/2064311636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc10eed0 con 0x55f054e734f0 2023-03-17T12:02:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e72be0 0x55f054e76700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:02:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e76da0 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009cd0 tx=0x7f32f40077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5b23ff5fc8c16 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32deff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32deff5700 1 -- 172.21.15.35:0/2064311636 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400e070 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32deff5700 1 -- 172.21.15.35:0/2064311636 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(428..428 src has 1..428) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f32f4003e10 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f054d82390 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f32deff5700 1 -- 172.21.15.35:0/2064311636 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f4005040 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f330d1beb80 10 client.22119 fetch_fsmap learned FSMap version 110 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.996+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55f054bedd80 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f32deff5700 1 -- 172.21.15.35:0/2064311636 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f054d82390 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f32deff5700 1 -- 172.21.15.35:0/2064311636 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f32f4019030 con 0x55f054e734f0 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f330d1beb80 10 client.22119 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f330d1beb80 10 client.22119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f330d1beb80 20 client.22119 populate_metadata read hostname 'smithi035' 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054e86f60 0x55f054e89370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f330d1beb80 4 client.22119 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:02:28.412 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f054d8e600 con 0x55f054e86f60 2023-03-17T12:02:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.997+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054e86f60 0x55f054e89370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f32deff5700 10 client.22119 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f32fad9d700 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054e86f60 0x55f054e89370 crc :-1 s=READY pgs=832 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92714e934ff892e5 server_cookie=99e01341a4a2c076 in_seq=0 out_seq=0 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f32deff5700 1 -- 172.21.15.35:0/2064311636 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55f054d8e600 con 0x55f054e86f60 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f32deff5700 10 client.22119 handle_command_reply: tid=0 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 client.22119 shutdown 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 msgr2=0x55f054e76da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e76da0 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009cd0 tx=0x7f32f40077c0 comp rx=0 tx=0).stop 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 shutdown_connections 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054e86f60 0x55f054e89370 crc :-1 s=READY pgs=832 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e76da0 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f32deff5700 0 client.22119 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.998+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e6d960 0x55f054e79480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.999+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2064311636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e72be0 0x55f054e76700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.999+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 >> 172.21.15.35:0/2064311636 conn(0x55f054cca6b0 msgr2=0x55f054e6c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.999+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 shutdown_connections 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.999+0000 7f330d1beb80 1 -- 172.21.15.35:0/2064311636 wait complete. 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:24.999+0000 7f330d1beb80 20 client.22119 trim_cache size 0 max 16384 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.013+0000 7f330d1beb80 1 Processor -- start 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.013+0000 7f330d1beb80 1 -- start start 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e67ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e7dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f330d1beb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e773c0 con 0x55f054e734f0 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f330d1beb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e68030 con 0x55f054e72be0 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f330d1beb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e6d7c0 con 0x55f054e6d960 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e67ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e824f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58662/0 (socket says 172.21.15.35:58662) 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 -- 172.21.15.35:0/2689211401 learned_addr learned my addr 172.21.15.35:0/2689211401 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e7dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 -- 172.21.15.35:0/2689211401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 msgr2=0x55f054e67ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e67ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 -- 172.21.15.35:0/2689211401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 msgr2=0x55f054e7dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e7dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 -- 172.21.15.35:0/2689211401 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f054d86130 con 0x55f054e734f0 2023-03-17T12:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fa59c700 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e7dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32fb59e700 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e824f0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f32f400b420 tx=0x7f32f401eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329810de70977303 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.014+0000 7f32e1ffb700 1 -- 172.21.15.35:0/2689211401 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400e040 con 0x55f054e734f0 2023-03-17T12:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f32e1ffb700 1 -- 172.21.15.35:0/2689211401 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32f401d4a0 con 0x55f054e734f0 2023-03-17T12:02:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f32e1ffb700 1 -- 172.21.15.35:0/2689211401 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4005440 con 0x55f054e734f0 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 -- 172.21.15.35:0/2689211401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 msgr2=0x55f054e824f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e824f0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f32f400b420 tx=0x7f32f401eed0 comp rx=0 tx=0).stop 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 -- 172.21.15.35:0/2689211401 shutdown_connections 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e734f0 0x55f054e824f0 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e67ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 --2- 172.21.15.35:0/2689211401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e72be0 0x55f054e7dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 -- 172.21.15.35:0/2689211401 >> 172.21.15.35:0/2689211401 conn(0x55f054cca6b0 msgr2=0x55f054e790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:02:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 -- 172.21.15.35:0/2689211401 shutdown_connections 2023-03-17T12:02:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 -- 172.21.15.35:0/2689211401 wait complete. 2023-03-17T12:02:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.015+0000 7f330d1beb80 1 -- start start 2023-03-17T12:02:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 Processor -- start 2023-03-17T12:02:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e7d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:34.813 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 0x55f054e7dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:34.814 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e734f0 0x55f054e7be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:35.302 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e7c540 con 0x55f054e72be0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e7c6b0 con 0x55f054e734f0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054e7c870 con 0x55f054e6d960 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f330d1beb80 10 client.0 _ll_register_callbacks cb 0x55f054c65230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 0x55f054e7dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 0x55f054e7dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:58666/0 (socket says 172.21.15.35:58666) 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 -- 172.21.15.35:0/3859050150 learned_addr learned my addr 172.21.15.35:0/3859050150 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fad9d700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e7d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fb59e700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e734f0 0x55f054e7be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 -- 172.21.15.35:0/3859050150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 msgr2=0x55f054e7d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e7d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 -- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e734f0 msgr2=0x55f054e7be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e734f0 0x55f054e7be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.016+0000 7f32fa59c700 1 -- 172.21.15.35:0/3859050150 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f054bedd80 con 0x55f054e72be0 2023-03-17T12:02:35.303 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32fa59c700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 0x55f054e7dee0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f32f00c9f70 tx=0x7f32f0004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732c3a9aecc80030 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32deff5700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32deff5700 1 -- 172.21.15.35:0/3859050150 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0096e30 con 0x55f054e72be0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32deff5700 1 -- 172.21.15.35:0/3859050150 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(428..428 src has 1..428) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f32f00c7120 con 0x55f054e72be0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 1 -- 172.21.15.35:0/3859050150 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f054e3d1e0 con 0x55f054e72be0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32deff5700 1 -- 172.21.15.35:0/3859050150 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f000fec0 con 0x55f054e72be0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 10 client.22125 fetch_fsmap learned FSMap version 110 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 1 -- 172.21.15.35:0/3859050150 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55f054c141f0 con 0x55f054e72be0 2023-03-17T12:02:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32deff5700 1 -- 172.21.15.35:0/3859050150 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f054e3d1e0 con 0x55f054e72be0 2023-03-17T12:02:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32deff5700 1 -- 172.21.15.35:0/3859050150 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 110) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f32f00b3c80 con 0x55f054e72be0 2023-03-17T12:02:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 10 client.22125 fetch_fsmap finished waiting for FSMap version 110 2023-03-17T12:02:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 10 client.22125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-03-17T12:02:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 20 client.22125 populate_metadata read hostname 'smithi035' 2023-03-17T12:02:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054edbc20 0x55f054ede030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:02:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 4 client.22125 mds_command: new command op to 24452 tid=0[{"prefix": "flush journal"}] 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f330d1beb80 1 -- 172.21.15.35:0/3859050150 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f054c43f00 con 0x55f054edbc20 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.017+0000 7f32fad9d700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054edbc20 0x55f054ede030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.018+0000 7f32deff5700 10 client.22125 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.018+0000 7f32fad9d700 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054edbc20 0x55f054ede030 crc :-1 s=READY pgs=833 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a138bc78a2fe7c1 server_cookie=c6d6647daf68a139 in_seq=0 out_seq=0 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f32deff5700 1 -- 172.21.15.35:0/3859050150 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f054c43f00 con 0x55f054edbc20 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f32deff5700 10 client.22125 handle_command_reply: tid=0 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 client.22125 shutdown 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 -- 172.21.15.35:0/3859050150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 msgr2=0x55f054e7dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 0x55f054e7dee0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f32f00c9f70 tx=0x7f32f0004ed0 comp rx=0 tx=0).stop 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 -- 172.21.15.35:0/3859050150 shutdown_connections 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55f054edbc20 0x55f054ede030 crc :-1 s=READY pgs=833 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f054e734f0 0x55f054e7be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f32deff5700 0 client.22125 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:02:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f054e6d960 0x55f054e7d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi035.front.sepia.ceph.com.smithi035.stderr:2023-03-17T11:40:25.027+0000 7f330d1beb80 1 --2- 172.21.15.35:0/3859050150 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55f054e72be0 0x55f054e7dee0 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:02:36.960 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-03-17T12:02:36.961 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:07 smithi035 ceph-mon[92535]: pgmap v6245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:02:36.962 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:09 smithi035 ceph-mon[92535]: pgmap v6246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:02:36.964 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:10 smithi035 ceph-mon[92535]: osdmap e458: 12 total, 12 up, 12 in 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:11 smithi035 ceph-mon[92535]: pgmap v6248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:13 smithi035 ceph-mon[92535]: pgmap v6249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:15 smithi035 ceph-mon[92535]: pgmap v6250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:17 smithi035 ceph-mon[92535]: pgmap v6251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:18 smithi035 ceph-mon[92535]: pgmap v6252: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 115 B/s wr, 5 op/s 2023-03-17T12:02:38.545 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:18 smithi035 ceph-mon[92535]: pgmap v6253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:02:39.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:18 smithi035 ceph-mon[92535]: osdmap e459: 12 total, 12 up, 12 in 2023-03-17T12:02:39.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:20 smithi035 ceph-mon[92535]: pgmap v6255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:02:39.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:22 smithi035 ceph-mon[92535]: pgmap v6256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:02:39.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:24 smithi035 ceph-mon[92535]: pgmap v6257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:26 smithi035 ceph-mon[92535]: pgmap v6258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:28 smithi035 ceph-mon[92535]: pgmap v6259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:30 smithi035 ceph-mon[92535]: pgmap v6260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:32 smithi035 ceph-mon[92535]: pgmap v6261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:34 smithi035 ceph-mon[92535]: pgmap v6262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:36 smithi035 ceph-mon[92535]: pgmap v6263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:38 smithi035 ceph-mon[92535]: pgmap v6264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:40 smithi035 ceph-mon[92535]: pgmap v6265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:42 smithi035 ceph-mon[92535]: pgmap v6266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:39.121 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:44 smithi035 ceph-mon[92535]: pgmap v6267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:40.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:46 smithi035 ceph-mon[92535]: pgmap v6268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:40.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:48 smithi035 ceph-mon[92535]: pgmap v6269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:40.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:50 smithi035 ceph-mon[92535]: pgmap v6270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:40.893 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:52 smithi035 ceph-mon[92535]: pgmap v6271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:42.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:54 smithi035 ceph-mon[92535]: pgmap v6272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:42.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:56 smithi035 ceph-mon[92535]: pgmap v6273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:42.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:55:58 smithi035 ceph-mon[92535]: pgmap v6274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:42.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:00 smithi035 ceph-mon[92535]: pgmap v6275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:42.517 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:02 smithi035 ceph-mon[92535]: pgmap v6276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:45.130 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:04 smithi035 ceph-mon[92535]: pgmap v6277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:02:45.132 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:06 smithi035 ceph-mon[92535]: pgmap v6278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:02:45.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:08 smithi035 ceph-mon[92535]: pgmap v6279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:02:48.707 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:10 smithi035 ceph-mon[92535]: pgmap v6280: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:02:51.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:10 smithi035 ceph-mon[92535]: osdmap e460: 12 total, 12 up, 12 in 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:12 smithi035 ceph-mon[92535]: pgmap v6282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:14 smithi035 ceph-mon[92535]: pgmap v6283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:16 smithi035 ceph-mon[92535]: pgmap v6284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:02:51.672 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:18 smithi035 ceph-mon[92535]: pgmap v6285: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:51.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:18 smithi035 ceph-mon[92535]: pgmap v6286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:18 smithi035 ceph-mon[92535]: pgmap v6287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 259 B/s wr, 13 op/s 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:18 smithi035 ceph-mon[92535]: osdmap e461: 12 total, 12 up, 12 in 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:20 smithi035 ceph-mon[92535]: pgmap v6289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:22 smithi035 ceph-mon[92535]: pgmap v6290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:24 smithi035 ceph-mon[92535]: pgmap v6291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:26 smithi035 ceph-mon[92535]: pgmap v6292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:02:53.283 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:28 smithi035 ceph-mon[92535]: pgmap v6293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:30 smithi035 ceph-mon[92535]: pgmap v6294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:32 smithi035 ceph-mon[92535]: pgmap v6295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:34 smithi035 ceph-mon[92535]: pgmap v6296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:36 smithi035 ceph-mon[92535]: pgmap v6297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:38 smithi035 ceph-mon[92535]: pgmap v6298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:40 smithi035 ceph-mon[92535]: pgmap v6299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:42 smithi035 ceph-mon[92535]: pgmap v6300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:44 smithi035 ceph-mon[92535]: pgmap v6301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:46 smithi035 ceph-mon[92535]: pgmap v6302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:48 smithi035 ceph-mon[92535]: pgmap v6303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:50 smithi035 ceph-mon[92535]: pgmap v6304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:52 smithi035 ceph-mon[92535]: pgmap v6305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:54 smithi035 ceph-mon[92535]: pgmap v6306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:56 smithi035 ceph-mon[92535]: pgmap v6307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:56:58 smithi035 ceph-mon[92535]: pgmap v6308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:00 smithi035 ceph-mon[92535]: pgmap v6309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:02 smithi035 ceph-mon[92535]: pgmap v6310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:04 smithi035 ceph-mon[92535]: pgmap v6311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:06 smithi035 ceph-mon[92535]: pgmap v6312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:08 smithi035 ceph-mon[92535]: pgmap v6313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:10 smithi035 ceph-mon[92535]: pgmap v6314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:10 smithi035 ceph-mon[92535]: osdmap e462: 12 total, 12 up, 12 in 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:12 smithi035 ceph-mon[92535]: pgmap v6316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:14 smithi035 ceph-mon[92535]: pgmap v6317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:16 smithi035 ceph-mon[92535]: pgmap v6318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:18 smithi035 ceph-mon[92535]: pgmap v6319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:18 smithi035 ceph-mon[92535]: osdmap e463: 12 total, 12 up, 12 in 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:19 smithi035 ceph-mon[92535]: pgmap v6320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:02:53.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:19 smithi035 ceph-mon[92535]: pgmap v6321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:02:53.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:21 smithi035 ceph-mon[92535]: pgmap v6323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:53.286 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:23 smithi035 ceph-mon[92535]: pgmap v6324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:02:53.287 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:25 smithi035 ceph-mon[92535]: pgmap v6325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-03-17T12:02:55.311 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:27 smithi035 ceph-mon[92535]: pgmap v6326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:02:57.166 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:29 smithi035 ceph-mon[92535]: pgmap v6327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:02:57.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:31 smithi035 ceph-mon[92535]: pgmap v6328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:57.168 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:33 smithi035 ceph-mon[92535]: pgmap v6329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:02:57.169 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:35 smithi035 ceph-mon[92535]: pgmap v6330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:00.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:37 smithi035 ceph-mon[92535]: pgmap v6331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:39 smithi035 ceph-mon[92535]: pgmap v6332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:41 smithi035 ceph-mon[92535]: pgmap v6333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:43 smithi035 ceph-mon[92535]: pgmap v6334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:45 smithi035 ceph-mon[92535]: pgmap v6335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:47 smithi035 ceph-mon[92535]: pgmap v6336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:49 smithi035 ceph-mon[92535]: pgmap v6337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:51 smithi035 ceph-mon[92535]: pgmap v6338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.064 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:53 smithi035 ceph-mon[92535]: pgmap v6339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.065 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:55 smithi035 ceph-mon[92535]: pgmap v6340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:00.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:57 smithi035 ceph-mon[92535]: pgmap v6341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:57:59 smithi035 ceph-mon[92535]: pgmap v6342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:00.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:01 smithi035 ceph-mon[92535]: pgmap v6343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:00.829 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:03 smithi035 ceph-mon[92535]: pgmap v6344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:04.350 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:05 smithi035 ceph-mon[92535]: pgmap v6345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:03:04.350 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:07 smithi035 ceph-mon[92535]: pgmap v6346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:07.115 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:09 smithi035 ceph-mon[92535]: pgmap v6347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:03:07.116 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:10 smithi035 ceph-mon[92535]: osdmap e464: 12 total, 12 up, 12 in 2023-03-17T12:03:07.117 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:11 smithi035 ceph-mon[92535]: pgmap v6349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:08.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:13 smithi035 ceph-mon[92535]: pgmap v6350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:08.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:15 smithi035 ceph-mon[92535]: pgmap v6351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:08.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:17 smithi035 ceph-mon[92535]: pgmap v6352: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:08.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:03:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:18 smithi035 ceph-mon[92535]: osdmap e465: 12 total, 12 up, 12 in 2023-03-17T12:03:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:19 smithi035 ceph-mon[92535]: pgmap v6353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:20 smithi035 ceph-mon[92535]: pgmap v6355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:20 smithi035 ceph-mon[92535]: pgmap v6356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:21 smithi035 ceph-mon[92535]: pgmap v6357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:24 smithi035 ceph-mon[92535]: pgmap v6358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:26 smithi035 ceph-mon[92535]: pgmap v6359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:28 smithi035 ceph-mon[92535]: pgmap v6360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:30 smithi035 ceph-mon[92535]: pgmap v6361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:32 smithi035 ceph-mon[92535]: pgmap v6362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:34 smithi035 ceph-mon[92535]: pgmap v6363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:36 smithi035 ceph-mon[92535]: pgmap v6364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:38 smithi035 ceph-mon[92535]: pgmap v6365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:40 smithi035 ceph-mon[92535]: pgmap v6366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:42 smithi035 ceph-mon[92535]: pgmap v6367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:12.077 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:44 smithi035 ceph-mon[92535]: pgmap v6368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:14.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:46 smithi035 ceph-mon[92535]: pgmap v6369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:14.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:48 smithi035 ceph-mon[92535]: pgmap v6370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:14.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:50 smithi035 ceph-mon[92535]: pgmap v6371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:14.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:52 smithi035 ceph-mon[92535]: pgmap v6372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:14.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:54 smithi035 ceph-mon[92535]: pgmap v6373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:14.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:56 smithi035 ceph-mon[92535]: pgmap v6374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:14.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:58:58 smithi035 ceph-mon[92535]: pgmap v6375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:14.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:00 smithi035 ceph-mon[92535]: pgmap v6376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:14.138 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:02 smithi035 ceph-mon[92535]: pgmap v6377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:14.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:04 smithi035 ceph-mon[92535]: pgmap v6378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:03:14.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:06 smithi035 ceph-mon[92535]: pgmap v6379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:14.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:08 smithi035 ceph-mon[92535]: pgmap v6380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:14.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:10 smithi035 ceph-mon[92535]: pgmap v6381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:03:14.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:10 smithi035 ceph-mon[92535]: osdmap e466: 12 total, 12 up, 12 in 2023-03-17T12:03:16.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:12 smithi035 ceph-mon[92535]: pgmap v6383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:16.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:14 smithi035 ceph-mon[92535]: pgmap v6384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:16.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:16 smithi035 ceph-mon[92535]: pgmap v6385: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:16.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:18 smithi035 ceph-mon[92535]: pgmap v6386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:16.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:18 smithi035 ceph-mon[92535]: osdmap e467: 12 total, 12 up, 12 in 2023-03-17T12:03:16.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:03:16.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:20 smithi035 ceph-mon[92535]: pgmap v6388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:03:16.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:03:16.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:03:18.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:18.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:21 smithi035 ceph-mon[92535]: pgmap v6389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:03:18.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:21 smithi035 ceph-mon[92535]: pgmap v6390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:03:18.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:23 smithi035 ceph-mon[92535]: pgmap v6391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:03:18.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:25 smithi035 ceph-mon[92535]: pgmap v6392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:03:18.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:27 smithi035 ceph-mon[92535]: pgmap v6393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-03-17T12:03:18.676 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:29 smithi035 ceph-mon[92535]: pgmap v6394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:03:18.677 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:31 smithi035 ceph-mon[92535]: pgmap v6395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:03:18.677 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:33 smithi035 ceph-mon[92535]: pgmap v6396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:03:18.677 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:35 smithi035 ceph-mon[92535]: pgmap v6397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:18.677 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:37 smithi035 ceph-mon[92535]: pgmap v6398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:19.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:39 smithi035 ceph-mon[92535]: pgmap v6399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:20.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:41 smithi035 ceph-mon[92535]: pgmap v6400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:20.358 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:43 smithi035 ceph-mon[92535]: pgmap v6401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:20.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:45 smithi035 ceph-mon[92535]: pgmap v6402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:20.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:47 smithi035 ceph-mon[92535]: pgmap v6403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:20.359 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:49 smithi035 ceph-mon[92535]: pgmap v6404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:21.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:51 smithi035 ceph-mon[92535]: pgmap v6405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:21.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:53 smithi035 ceph-mon[92535]: pgmap v6406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:21.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:55 smithi035 ceph-mon[92535]: pgmap v6407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:21.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:57 smithi035 ceph-mon[92535]: pgmap v6408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:21.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 11:59:59 smithi035 ceph-mon[92535]: pgmap v6409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:24.248 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:03:24.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:01 smithi035 ceph-mon[92535]: pgmap v6410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:24.249 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:03 smithi035 ceph-mon[92535]: pgmap v6411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:05 smithi035 ceph-mon[92535]: pgmap v6412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:07 smithi035 ceph-mon[92535]: pgmap v6413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:09 smithi035 ceph-mon[92535]: pgmap v6414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:10 smithi035 ceph-mon[92535]: osdmap e468: 12 total, 12 up, 12 in 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:11 smithi035 ceph-mon[92535]: pgmap v6416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:13 smithi035 ceph-mon[92535]: pgmap v6417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:15 smithi035 ceph-mon[92535]: pgmap v6418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:17 smithi035 ceph-mon[92535]: pgmap v6419: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:19 smithi035 ceph-mon[92535]: pgmap v6420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:19 smithi035 ceph-mon[92535]: osdmap e469: 12 total, 12 up, 12 in 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:03:24.250 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:21 smithi035 ceph-mon[92535]: pgmap v6422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:22 smithi035 ceph-mon[92535]: pgmap v6423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:22 smithi035 ceph-mon[92535]: pgmap v6424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 143 B/s wr, 7 op/s 2023-03-17T12:03:25.788 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:24 smithi035 ceph-mon[92535]: pgmap v6425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 143 B/s wr, 14 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:26 smithi035 ceph-mon[92535]: pgmap v6426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:28 smithi035 ceph-mon[92535]: pgmap v6427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:30 smithi035 ceph-mon[92535]: pgmap v6428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:32 smithi035 ceph-mon[92535]: pgmap v6429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:34 smithi035 ceph-mon[92535]: pgmap v6430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:36 smithi035 ceph-mon[92535]: pgmap v6431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:38 smithi035 ceph-mon[92535]: pgmap v6432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:40 smithi035 ceph-mon[92535]: pgmap v6433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:42 smithi035 ceph-mon[92535]: pgmap v6434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:44 smithi035 ceph-mon[92535]: pgmap v6435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:46 smithi035 ceph-mon[92535]: pgmap v6436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:48 smithi035 ceph-mon[92535]: pgmap v6437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:50 smithi035 ceph-mon[92535]: pgmap v6438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:52 smithi035 ceph-mon[92535]: pgmap v6439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:54 smithi035 ceph-mon[92535]: pgmap v6440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:25.789 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:56 smithi035 ceph-mon[92535]: pgmap v6441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:00:58 smithi035 ceph-mon[92535]: pgmap v6442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:00 smithi035 ceph-mon[92535]: pgmap v6443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:25.790 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:02 smithi035 ceph-mon[92535]: pgmap v6444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:25.791 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:04 smithi035 ceph-mon[92535]: pgmap v6445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:03:26.827 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:06 smithi035 ceph-mon[92535]: pgmap v6446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:27.252 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:08 smithi035 ceph-mon[92535]: pgmap v6447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:27.253 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:10 smithi035 ceph-mon[92535]: pgmap v6448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-03-17T12:03:27.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:10 smithi035 ceph-mon[92535]: osdmap e470: 12 total, 12 up, 12 in 2023-03-17T12:03:27.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:12 smithi035 ceph-mon[92535]: pgmap v6450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:27.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:14 smithi035 ceph-mon[92535]: pgmap v6451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:27.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:16 smithi035 ceph-mon[92535]: pgmap v6452: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:27.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:18 smithi035 ceph-mon[92535]: pgmap v6453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:29.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:18 smithi035 ceph-mon[92535]: osdmap e471: 12 total, 12 up, 12 in 2023-03-17T12:03:29.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:20 smithi035 ceph-mon[92535]: pgmap v6455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-17T12:03:29.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:21 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:03:29.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:22 smithi035 ceph-mon[92535]: pgmap v6456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:29.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.060 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:22 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: pgmap v6457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:24 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.061 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.062 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:03:29.063 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:03:29.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:03:30.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: pgmap v6458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:03:30.910 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:26 smithi035 ceph-mon[92535]: pgmap v6459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 129 B/s wr, 12 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:27 smithi035 ceph-mon[92535]: pgmap v6460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:30 smithi035 ceph-mon[92535]: pgmap v6461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:32 smithi035 ceph-mon[92535]: pgmap v6462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:34 smithi035 ceph-mon[92535]: pgmap v6463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:36 smithi035 ceph-mon[92535]: pgmap v6464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:38 smithi035 ceph-mon[92535]: pgmap v6465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:40 smithi035 ceph-mon[92535]: pgmap v6466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:42 smithi035 ceph-mon[92535]: pgmap v6467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:44 smithi035 ceph-mon[92535]: pgmap v6468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:46 smithi035 ceph-mon[92535]: pgmap v6469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:48 smithi035 ceph-mon[92535]: pgmap v6470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:30.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:50 smithi035 ceph-mon[92535]: pgmap v6471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:30.912 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:52 smithi035 ceph-mon[92535]: pgmap v6472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:30.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:54 smithi035 ceph-mon[92535]: pgmap v6473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:33.805 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:56 smithi035 ceph-mon[92535]: pgmap v6474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:33.806 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:01:58 smithi035 ceph-mon[92535]: pgmap v6475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:00 smithi035 ceph-mon[92535]: pgmap v6476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:02 smithi035 ceph-mon[92535]: pgmap v6477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:04 smithi035 ceph-mon[92535]: pgmap v6478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:06 smithi035 ceph-mon[92535]: pgmap v6479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:08 smithi035 ceph-mon[92535]: pgmap v6480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:10 smithi035 ceph-mon[92535]: pgmap v6481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:10 smithi035 ceph-mon[92535]: osdmap e472: 12 total, 12 up, 12 in 2023-03-17T12:03:33.807 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:12 smithi035 ceph-mon[92535]: pgmap v6483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:14 smithi035 ceph-mon[92535]: pgmap v6484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:16 smithi035 ceph-mon[92535]: pgmap v6485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:18 smithi035 ceph-mon[92535]: pgmap v6486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:18 smithi035 ceph-mon[92535]: osdmap e473: 12 total, 12 up, 12 in 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:20 smithi035 ceph-mon[92535]: pgmap v6488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:22 smithi035 ceph-mon[92535]: pgmap v6489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:24 smithi035 ceph-mon[92535]: pgmap v6490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:03:34.563 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:25 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:03:34.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:26 smithi035 ceph-mon[92535]: pgmap v6491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:03:34.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:03:34.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:03:34.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:34.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:27 smithi035 ceph-mon[92535]: pgmap v6492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:03:34.564 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:27 smithi035 ceph-mon[92535]: pgmap v6493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:03:36.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:29 smithi035 ceph-mon[92535]: pgmap v6494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:03:36.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:31 smithi035 ceph-mon[92535]: pgmap v6495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:03:36.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:33 smithi035 ceph-mon[92535]: pgmap v6496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:03:36.580 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:35 smithi035 ceph-mon[92535]: pgmap v6497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:03:36.581 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:37 smithi035 ceph-mon[92535]: pgmap v6498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:03:36.582 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:39 smithi035 ceph-mon[92535]: pgmap v6499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:36.583 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:41 smithi035 ceph-mon[92535]: pgmap v6500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:36.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:43 smithi035 ceph-mon[92535]: pgmap v6501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:36.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:45 smithi035 ceph-mon[92535]: pgmap v6502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:36.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:47 smithi035 ceph-mon[92535]: pgmap v6503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:36.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:49 smithi035 ceph-mon[92535]: pgmap v6504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:36.585 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:51 smithi035 ceph-mon[92535]: pgmap v6505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:37.951 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-03-17T12:03:40.075 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-03-17T12:03:43.339 INFO:teuthology.task.exec:Executing custom commands... 2023-03-17T12:03:46.772 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi035.front.sepia.ceph.com 2023-03-17T12:03:46.773 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-03-17T12:03:47.942 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:53 smithi035 ceph-mon[92535]: pgmap v6506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:55 smithi035 ceph-mon[92535]: pgmap v6507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:57 smithi035 ceph-mon[92535]: pgmap v6508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:02:59 smithi035 ceph-mon[92535]: pgmap v6509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:03:51.282 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:01 smithi035 ceph-mon[92535]: pgmap v6510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:53.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:03 smithi035 ceph-mon[92535]: pgmap v6511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:03:53.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:05 smithi035 ceph-mon[92535]: pgmap v6512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:03:53.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:07 smithi035 ceph-mon[92535]: pgmap v6513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:03:53.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:09 smithi035 ceph-mon[92535]: pgmap v6514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:03:53.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:10 smithi035 ceph-mon[92535]: osdmap e474: 12 total, 12 up, 12 in 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:11 smithi035 ceph-mon[92535]: pgmap v6516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:13 smithi035 ceph-mon[92535]: pgmap v6517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:15 smithi035 ceph-mon[92535]: pgmap v6518: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:17 smithi035 ceph-mon[92535]: pgmap v6519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:19 smithi035 ceph-mon[92535]: pgmap v6520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:19 smithi035 ceph-mon[92535]: osdmap e475: 12 total, 12 up, 12 in 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:21 smithi035 ceph-mon[92535]: pgmap v6522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:55.055 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:23 smithi035 ceph-mon[92535]: pgmap v6523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:25 smithi035 ceph-mon[92535]: pgmap v6524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:26 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:27 smithi035 ceph-mon[92535]: pgmap v6525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:28 smithi035 ceph-mon[92535]: pgmap v6526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:28 smithi035 ceph-mon[92535]: pgmap v6527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:30 smithi035 ceph-mon[92535]: pgmap v6528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:03:55.056 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:32 smithi035 ceph-mon[92535]: pgmap v6529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:03:55.064 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 -- 172.21.15.35:0/518037582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe328069030 msgr2=0x7fe3280694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:03:58.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/518037582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe328069030 0x7fe3280694a0 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7fe310009990 tx=0x7fe310009ca0 comp rx=0 tx=0).stop 2023-03-17T12:03:58.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 -- 172.21.15.35:0/518037582 shutdown_connections 2023-03-17T12:03:58.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/518037582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3280699e0 0x7fe32810cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:03:58.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/518037582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe328106330 0x7fe328106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:03:58.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/518037582 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe328069030 0x7fe3280694a0 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:03:58.725 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 -- 172.21.15.35:0/518037582 >> 172.21.15.35:0/518037582 conn(0x7fe328074ec0 msgr2=0x7fe3280752c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:03:59.701 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 -- 172.21.15.35:0/518037582 shutdown_connections 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.960+0000 7fe32d8d4700 1 -- 172.21.15.35:0/518037582 wait complete. 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 Processor -- start 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 -- start start 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328069030 0x7fe3280ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 0x7fe3280ff710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe328106330 0x7fe3281a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:03:59.702 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280fff40 con 0x7fe3280699e0 2023-03-17T12:04:00.612 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281a4900 con 0x7fe328069030 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe32d8d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281a4a40 con 0x7fe328106330 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe3267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 0x7fe3280ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe3267fc700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 0x7fe3280ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59882/0 (socket says 172.21.15.35:59882) 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe3267fc700 1 -- 172.21.15.35:0/1170454406 learned_addr learned my addr 172.21.15.35:0/1170454406 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.961+0000 7fe326ffd700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328069030 0x7fe3280ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3277fe700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe328106330 0x7fe3281a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3267fc700 1 -- 172.21.15.35:0/1170454406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe328106330 msgr2=0x7fe3281a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:00.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3267fc700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe328106330 0x7fe3281a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:02.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3267fc700 1 -- 172.21.15.35:0/1170454406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328069030 msgr2=0x7fe3280ff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:02.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3267fc700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328069030 0x7fe3280ff1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:02.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3267fc700 1 -- 172.21.15.35:0/1170454406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100095f0 con 0x7fe3280699e0 2023-03-17T12:04:02.674 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe3267fc700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 0x7fe3280ff710 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7fe310005910 tx=0x7fe3100047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31001d070 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe328110130 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe310021410 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310017650 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.962+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32810ffa0 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.963+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328067dc0 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.964+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7fe31000fb00 con 0x7fe3280699e0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.965+0000 7fe32c8d2700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe31409f640 0x7fe3140a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.965+0000 7fe326ffd700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe31409f640 0x7fe3140a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:02.675 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.965+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(475..475 src has 1..475) v4 ==== 8455+0+0 (secure 0 0 0) 0x7fe3100cbae0 con 0x7fe3280699e0 2023-03-17T12:04:03.268 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.965+0000 7fe326ffd700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe31409f640 0x7fe3140a1af0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe318009be0 tx=0x7fe318009260 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:03.268 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:33.969+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7fe310095900 con 0x7fe3280699e0 2023-03-17T12:04:03.268 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.220+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe328100700 con 0x7fe3280699e0 2023-03-17T12:04:03.268 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.221+0000 7fe32c8d2700 1 -- 172.21.15.35:0/1170454406 <== mon.0 v2:172.21.15.35:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+10087 (secure 0 0 0) 0x7fe310098f20 con 0x7fe3280699e0 2023-03-17T12:04:03.269 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-03-17T12:04:03.269 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":112,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14481,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.35:6835/3728573608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6834","nonce":3728573608},{"type":"v1","addr":"172.21.15.35:6835","nonce":3728573608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":112,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-03-17T08:13:31.987985+0000","modified":"2023-03-17T11:48:16.012555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24451,"mds_2":24445,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14511":{"gid":14511,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6839/1982578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6838","nonce":1982578351},{"type":"v1","addr":"172.21.15.35:6839","nonce":1982578351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14517":{"gid":14517,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6841/3680182485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6840","nonce":3680182485},{"type":"v1","addr":"172.21.15.35:6841","nonce":3680182485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_22383":{"gid":22383,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.35:6837/506999199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.35:6836","nonce":506999199},{"type":"v1","addr":"172.21.15.35:6837","nonce":506999199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24404":{"gid":24404,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.78:6833/3173843386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3173843386},{"type":"v1","addr":"172.21.15.78:6833","nonce":3173843386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24415":{"gid":24415,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6833/1456535346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1456535346},{"type":"v1","addr":"172.21.15.82:6833","nonce":1456535346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":68,"addr":"172.21.15.78:6837/2030646762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2030646762},{"type":"v1","addr":"172.21.15.78:6837","nonce":2030646762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6835/3844512343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3844512343},{"type":"v1","addr":"172.21.15.82:6835","nonce":3844512343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":68,"addr":"172.21.15.82:6837/1283255314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1283255314},{"type":"v1","addr":"172.21.15.82:6837","nonce":1283255314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24451":{"gid":24451,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":66,"addr":"172.21.15.82:6839/2918814393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":2918814393},{"type":"v1","addr":"172.21.15.82:6839","nonce":2918814393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":46,"addr":"172.21.15.78:6839/3357054531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":3357054531},{"type":"v1","addr":"172.21.15.78:6839","nonce":3357054531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-17T12:04:03.272 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe31409f640 msgr2=0x7fe3140a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:04.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe31409f640 0x7fe3140a1af0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe318009be0 tx=0x7fe318009260 comp rx=0 tx=0).stop 2023-03-17T12:04:04.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 msgr2=0x7fe3280ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:04.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 0x7fe3280ff710 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7fe310005910 tx=0x7fe3100047b0 comp rx=0 tx=0).stop 2023-03-17T12:04:04.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 shutdown_connections 2023-03-17T12:04:04.736 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7fe31409f640 0x7fe3140a1af0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:06.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe328106330 0x7fe3281a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:06.491 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe328069030 0x7fe3280ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:06.491 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 --2- 172.21.15.35:0/1170454406 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7fe3280699e0 0x7fe3280ff710 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:06.491 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 >> 172.21.15.35:0/1170454406 conn(0x7fe328074ec0 msgr2=0x7fe3280fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:06.491 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 shutdown_connections 2023-03-17T12:04:06.491 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:03:34.223+0000 7fe32d8d4700 1 -- 172.21.15.35:0/1170454406 wait complete. 2023-03-17T12:04:06.491 INFO:teuthology.orchestra.run.smithi035.stderr:dumped fsmap epoch 112 2023-03-17T12:04:06.492 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-03-17T12:04:08.317 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:34 smithi035 ceph-mon[92535]: pgmap v6530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-03-17T12:04:10.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:35 smithi035 ceph-mon[92535]: from='client.? 172.21.15.35:0/1170454406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T12:04:10.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:36 smithi035 ceph-mon[92535]: pgmap v6531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-03-17T12:04:10.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:38 smithi035 ceph-mon[92535]: pgmap v6532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:04:10.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:40 smithi035 ceph-mon[92535]: pgmap v6533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:04:10.348 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:42 smithi035 ceph-mon[92535]: pgmap v6534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:04:10.349 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:44 smithi035 ceph-mon[92535]: pgmap v6535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:04:10.349 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:46 smithi035 ceph-mon[92535]: pgmap v6536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:10.349 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:48 smithi035 ceph-mon[92535]: pgmap v6537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:50 smithi035 ceph-mon[92535]: pgmap v6538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:52 smithi035 ceph-mon[92535]: pgmap v6539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:54 smithi035 ceph-mon[92535]: pgmap v6540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:56 smithi035 ceph-mon[92535]: pgmap v6541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:03:58 smithi035 ceph-mon[92535]: pgmap v6542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:00 smithi035 ceph-mon[92535]: pgmap v6543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:02 smithi035 ceph-mon[92535]: pgmap v6544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:04 smithi035 ceph-mon[92535]: pgmap v6545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:04:12.157 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:06 smithi035 ceph-mon[92535]: pgmap v6546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:04:12.162 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-03-17T12:04:13.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:08 smithi035 ceph-mon[92535]: pgmap v6547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:04:13.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:10 smithi035 ceph-mon[92535]: pgmap v6548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:04:13.587 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:10 smithi035 ceph-mon[92535]: osdmap e476: 12 total, 12 up, 12 in 2023-03-17T12:04:13.615 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 -- 172.21.15.35:0/1807559965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8106430 msgr2=0x7f38b8106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:15.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 --2- 172.21.15.35:0/1807559965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8106430 0x7f38b8106800 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f38a80099a0 tx=0x7f38a8009cb0 comp rx=0 tx=0).stop 2023-03-17T12:04:15.660 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 -- 172.21.15.35:0/1807559965 shutdown_connections 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 --2- 172.21.15.35:0/1807559965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8101320 0x7f38b810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 --2- 172.21.15.35:0/1807559965 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8106430 0x7f38b8106800 unknown :-1 s=CLOSED pgs=2618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 --2- 172.21.15.35:0/1807559965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b8100970 0x7f38b8100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 -- 172.21.15.35:0/1807559965 >> 172.21.15.35:0/1807559965 conn(0x7f38b8077580 msgr2=0x7f38b8077980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 -- 172.21.15.35:0/1807559965 shutdown_connections 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.298+0000 7f38be801700 1 -- 172.21.15.35:0/1807559965 wait complete. 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.299+0000 7f38be801700 1 Processor -- start 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.299+0000 7f38be801700 1 -- start start 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.299+0000 7f38be801700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b8100970 0x7f38b8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.299+0000 7f38be801700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 0x7f38b8196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.299+0000 7f38be801700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8106430 0x7f38b819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:15.661 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.299+0000 7f38be801700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b819b3c0 con 0x7f38b8101320 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38be801700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b819b530 con 0x7f38b8106430 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38be801700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b819b6f0 con 0x7f38b8100970 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 0x7f38b8196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 0x7f38b8196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59898/0 (socket says 172.21.15.35:59898) 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 -- 172.21.15.35:0/348307831 learned_addr learned my addr 172.21.15.35:0/348307831 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b7fff700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b8100970 0x7f38b8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38bcd9e700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8106430 0x7f38b819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 -- 172.21.15.35:0/348307831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b8100970 msgr2=0x7f38b8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b8100970 0x7f38b8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 -- 172.21.15.35:0/348307831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8106430 msgr2=0x7f38b819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:15.662 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8106430 0x7f38b819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:18.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 -- 172.21.15.35:0/348307831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a8009580 con 0x7f38b8101320 2023-03-17T12:04:18.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38bcd9e700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8106430 0x7f38b819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b77fe700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 0x7f38b8196970 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c970 tx=0x7f38ac00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b57fa700 1 -- 172.21.15.35:0/348307831 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac007aa0 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b57fa700 1 -- 172.21.15.35:0/348307831 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38ac004cc0 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b81102b0 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38b57fa700 1 -- 172.21.15.35:0/348307831 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0054a0 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.300+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b8110120 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.303+0000 7f38b57fa700 1 -- 172.21.15.35:0/348307831 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f38ac004750 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.303+0000 7f38b57fa700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f38a009f6c0 0x7f38a00a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.304+0000 7f38b7fff700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f38a009f6c0 0x7f38a00a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.304+0000 7f38b57fa700 1 -- 172.21.15.35:0/348307831 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(476..476 src has 1..476) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f38ac013070 con 0x7f38b8101320 2023-03-17T12:04:18.437 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.304+0000 7f38b7fff700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f38a009f6c0 0x7f38a00a1b70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f38a800b5c0 tx=0x7f38a8005a70 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.304+0000 7f38ca98eb80 1 Processor -- start 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.304+0000 7f38ca98eb80 1 -- start start 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734c7d0 0x55baa734cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa73510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7351a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa7253070 con 0x55baa734d0e0 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa72a59b0 con 0x55baa734c7d0 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa729ee40 con 0x55baa7351630 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa73510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:20.381 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa73510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59906/0 (socket says 172.21.15.35:59906) 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 -- 172.21.15.35:0/2872734840 learned_addr learned my addr 172.21.15.35:0/2872734840 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b7fff700 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734c7d0 0x55baa734cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38bcd9e700 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7351a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 -- 172.21.15.35:0/2872734840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 msgr2=0x55baa7351a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7351a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 -- 172.21.15.35:0/2872734840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734c7d0 msgr2=0x55baa734cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734c7d0 0x55baa734cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 -- 172.21.15.35:0/2872734840 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baa7120630 con 0x55baa734d0e0 2023-03-17T12:04:21.818 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f38b77fe700 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa73510f0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f38ac094b30 tx=0x7f38ac097af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c660a15c4a841491 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.305+0000 7f389e7fc700 1 -- 172.21.15.35:0/2872734840 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac096460 con 0x55baa734d0e0 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f389e7fc700 1 -- 172.21.15.35:0/2872734840 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38ac005660 con 0x55baa734d0e0 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f389e7fc700 1 -- 172.21.15.35:0/2872734840 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac098380 con 0x55baa734d0e0 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2872734840 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 msgr2=0x55baa73510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa73510f0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f38ac094b30 tx=0x7f38ac097af0 comp rx=0 tx=0).stop 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2872734840 shutdown_connections 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7351a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734c7d0 0x55baa734cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2872734840 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa73510f0 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2872734840 >> 172.21.15.35:0/2872734840 conn(0x55baa7347030 msgr2=0x55baa7347400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2872734840 shutdown_connections 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.306+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2872734840 wait complete. 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 -- start start 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 Processor -- start 2023-03-17T12:04:21.819 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734c7d0 0x55baa7356110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa7356650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa7356b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa7122920 con 0x55baa734d0e0 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa7359240 con 0x55baa7351630 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa7362910 con 0x55baa734c7d0 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38ca98eb80 10 client.0 _ll_register_callbacks cb 0x55baa7144290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa7356650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:21.820 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38b77fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa7356650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59912/0 (socket says 172.21.15.35:59912) 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734c7d0 0x55baa7356110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.307+0000 7f38b77fe700 1 -- 172.21.15.35:0/2345656154 learned_addr learned my addr 172.21.15.35:0/2345656154 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38bcd9e700 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa7356b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38b77fe700 1 -- 172.21.15.35:0/2345656154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734c7d0 msgr2=0x55baa7356110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38b77fe700 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734c7d0 0x55baa7356110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38b77fe700 1 -- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 msgr2=0x55baa7356b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38b77fe700 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa7356b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38b77fe700 1 -- 172.21.15.35:0/2345656154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b8110120 con 0x55baa734d0e0 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38b77fe700 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa7356650 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0c8290 tx=0x7f38ac0c7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fd6c02218a08ef server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:22.600 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38977fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:04:22.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38977fe700 1 -- 172.21.15.35:0/2345656154 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac0975b0 con 0x55baa734d0e0 2023-03-17T12:04:22.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38977fe700 1 -- 172.21.15.35:0/2345656154 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(476..476 src has 1..476) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f38ac097710 con 0x55baa734d0e0 2023-03-17T12:04:22.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baa72613f0 con 0x55baa734d0e0 2023-03-17T12:04:22.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38977fe700 1 -- 172.21.15.35:0/2345656154 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38ac098320 con 0x55baa734d0e0 2023-03-17T12:04:22.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38ca98eb80 10 client.22581 fetch_fsmap learned FSMap version 112 2023-03-17T12:04:22.601 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.308+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55baa70ccde0 con 0x55baa734d0e0 2023-03-17T12:04:23.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38977fe700 1 -- 172.21.15.35:0/2345656154 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55baa72613f0 con 0x55baa734d0e0 2023-03-17T12:04:23.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38977fe700 1 -- 172.21.15.35:0/2345656154 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f38ac09fd90 con 0x55baa734d0e0 2023-03-17T12:04:23.986 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38ca98eb80 10 client.22581 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:04:24.408 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38ca98eb80 10 client.22581 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-03-17T12:04:24.408 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38ca98eb80 20 client.22581 populate_metadata read hostname 'smithi035' 2023-03-17T12:04:24.408 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa7366530 0x55baa7368910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38ca98eb80 4 client.22581 mds_command: new command op to 24431 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baa726d660 con 0x55baa7366530 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38b7fff700 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa7366530 0x55baa7368910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38977fe700 10 client.22581 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.309+0000 7f38b7fff700 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa7366530 0x55baa7368910 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6fe8832cd457ad0b server_cookie=6122e40c6ec9bb59 in_seq=0 out_seq=0 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38977fe700 1 -- 172.21.15.35:0/2345656154 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55baa726d660 con 0x55baa7366530 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38977fe700 10 client.22581 handle_command_reply: tid=0 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 client.22581 shutdown 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 msgr2=0x55baa7356650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa7356650 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0c8290 tx=0x7f38ac0c7cb0 comp rx=0 tx=0).stop 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 shutdown_connections 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa7366530 0x55baa7368910 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa7356b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734c7d0 0x55baa7356110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:24.409 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38977fe700 0 client.22581 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T12:04:24.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/2345656154 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734d0e0 0x55baa7356650 unknown :-1 s=CLOSED pgs=2621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:24.410 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 >> 172.21.15.35:0/2345656154 conn(0x55baa7347030 msgr2=0x55baa7346710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:25.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 shutdown_connections 2023-03-17T12:04:25.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.310+0000 7f38ca98eb80 1 -- 172.21.15.35:0/2345656154 wait complete. 2023-03-17T12:04:25.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.311+0000 7f38ca98eb80 20 client.22581 trim_cache size 0 max 16384 2023-03-17T12:04:25.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.324+0000 7f38ca98eb80 1 Processor -- start 2023-03-17T12:04:25.613 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.324+0000 7f38ca98eb80 1 -- start start 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.324+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.324+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734d0e0 0x55baa73569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.324+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa73506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.324+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa733f690 con 0x55baa734c7d0 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa7348e70 con 0x55baa7351630 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa734d940 con 0x55baa734d0e0 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59918/0 (socket says 172.21.15.35:59918) 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 -- 172.21.15.35:0/3105002071 learned_addr learned my addr 172.21.15.35:0/3105002071 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b77fe700 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734d0e0 0x55baa73569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 -- 172.21.15.35:0/3105002071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734d0e0 msgr2=0x55baa73569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734d0e0 0x55baa73569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 -- 172.21.15.35:0/3105002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 msgr2=0x55baa73506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38bcd9e700 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa73506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:25.614 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa73506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:26.270 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 -- 172.21.15.35:0/3105002071 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baa7343a50 con 0x55baa734c7d0 2023-03-17T12:04:26.271 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b77fe700 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734d0e0 0x55baa73569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:04:26.850 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f38b7fff700 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735d820 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009fa0 tx=0x7f38a8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1283c2ea46d4abee server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:27.489 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f389effd700 1 -- 172.21.15.35:0/3105002071 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a802c030 con 0x55baa734c7d0 2023-03-17T12:04:27.490 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f389effd700 1 -- 172.21.15.35:0/3105002071 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a802d040 con 0x55baa734c7d0 2023-03-17T12:04:27.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.325+0000 7f389effd700 1 -- 172.21.15.35:0/3105002071 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a800f460 con 0x55baa734c7d0 2023-03-17T12:04:27.865 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3105002071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 msgr2=0x55baa735d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735d820 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009fa0 tx=0x7f38a8023000 comp rx=0 tx=0).stop 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3105002071 shutdown_connections 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa7351630 0x55baa73506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735d820 unknown :-1 s=CLOSED pgs=2622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3105002071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa734d0e0 0x55baa73569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3105002071 >> 172.21.15.35:0/3105002071 conn(0x55baa7347030 msgr2=0x55baa734f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3105002071 shutdown_connections 2023-03-17T12:04:27.866 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3105002071 wait complete. 2023-03-17T12:04:27.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.326+0000 7f38ca98eb80 1 -- start start 2023-03-17T12:04:27.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 Processor -- start 2023-03-17T12:04:27.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:27.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734d0e0 0x55baa7352ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:27.867 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7353020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:28.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa73536f0 con 0x55baa734c7d0 2023-03-17T12:04:28.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa7353860 con 0x55baa734d0e0 2023-03-17T12:04:28.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa73ba330 con 0x55baa7351630 2023-03-17T12:04:28.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38ca98eb80 10 client.0 _ll_register_callbacks cb 0x55baa7144290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:04:28.969 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:29.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59924/0 (socket says 172.21.15.35:59924) 2023-03-17T12:04:29.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 -- 172.21.15.35:0/3641543711 learned_addr learned my addr 172.21.15.35:0/3641543711 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:29.479 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38bcd9e700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7353020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b77fe700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734d0e0 0x55baa7352ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 -- 172.21.15.35:0/3641543711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 msgr2=0x55baa7353020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7353020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 -- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734d0e0 msgr2=0x55baa7352ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734d0e0 0x55baa7352ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 -- 172.21.15.35:0/3641543711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b810da60 con 0x55baa734c7d0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38b7fff700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735da20 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f38a8005000 tx=0x7f38a8035d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47c36083b90be48 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.327+0000 7f38977fe700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38977fe700 1 -- 172.21.15.35:0/3641543711 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a802c040 con 0x55baa734c7d0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38977fe700 1 -- 172.21.15.35:0/3641543711 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(476..476 src has 1..476) v4 ==== 8499+0+0 (secure 0 0 0) 0x7f38a8034520 con 0x55baa734c7d0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baa731c240 con 0x55baa734c7d0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38977fe700 1 -- 172.21.15.35:0/3641543711 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38a80046d0 con 0x55baa734c7d0 2023-03-17T12:04:30.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 10 client.22587 fetch_fsmap learned FSMap version 112 2023-03-17T12:04:30.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55baa70b5c60 con 0x55baa734c7d0 2023-03-17T12:04:30.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38977fe700 1 -- 172.21.15.35:0/3641543711 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a8049020 con 0x55baa734c7d0 2023-03-17T12:04:30.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38977fe700 1 -- 172.21.15.35:0/3641543711 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f38a800f8c0 con 0x55baa734c7d0 2023-03-17T12:04:30.071 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 10 client.22587 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 10 client.22587 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 20 client.22587 populate_metadata read hostname 'smithi035' 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa73bb470 0x55baa73bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 4 client.22587 mds_command: new command op to 24431 tid=0[{"prefix": "damage ls"}] 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 --> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55baa7122f60 con 0x55baa73bb470 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.328+0000 7f38b77fe700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa73bb470 0x55baa73bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:30.686 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38977fe700 10 client.22587 ms_handle_connect on v2:172.21.15.78:6836/2030646762 2023-03-17T12:04:31.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38b77fe700 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa73bb470 0x55baa73bd880 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a49b6c749d6fad36 server_cookie=c7901c5cee2f2713 in_seq=0 out_seq=0 2023-03-17T12:04:31.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38977fe700 1 -- 172.21.15.35:0/3641543711 <== mds.4 v2:172.21.15.78:6836/2030646762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55baa7122f60 con 0x55baa73bb470 2023-03-17T12:04:31.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38977fe700 10 client.22587 handle_command_reply: tid=0 2023-03-17T12:04:31.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 client.22587 shutdown 2023-03-17T12:04:31.796 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 msgr2=0x55baa735da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:34.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735da20 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f38a8005000 tx=0x7f38a8035d20 comp rx=0 tx=0).stop 2023-03-17T12:04:34.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 shutdown_connections 2023-03-17T12:04:34.074 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baa7351630 0x55baa7353020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:35.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55baa734c7d0 0x55baa735da20 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:35.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:6836/2030646762,v1:172.21.15.78:6837/2030646762] conn(0x55baa73bb470 0x55baa73bd880 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:35.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 --2- 172.21.15.35:0/3641543711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55baa734d0e0 0x55baa7352ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:35.398 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 >> 172.21.15.35:0/3641543711 conn(0x55baa7347030 msgr2=0x55baa73506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:35.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38977fe700 0 client.22587 ms_handle_reset on v2:172.21.15.78:6836/2030646762 2023-03-17T12:04:35.399 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 shutdown_connections 2023-03-17T12:04:36.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 1 -- 172.21.15.35:0/3641543711 wait complete. 2023-03-17T12:04:36.782 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.329+0000 7f38ca98eb80 20 client.22587 trim_cache size 0 max 16384 2023-03-17T12:04:36.783 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T12:04:36.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f38a009f6c0 msgr2=0x7f38a00a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:38.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f38a009f6c0 0x7f38a00a1b70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f38a800b5c0 tx=0x7f38a8005a70 comp rx=0 tx=0).stop 2023-03-17T12:04:38.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 msgr2=0x7f38b8196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:38.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 0x7f38b8196970 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c970 tx=0x7f38ac00cd30 comp rx=0 tx=0).stop 2023-03-17T12:04:38.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 shutdown_connections 2023-03-17T12:04:38.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f38a009f6c0 0x7f38a00a1b70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:38.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b8106430 0x7f38b819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:38.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38b8100970 0x7f38b8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:38.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 --2- 172.21.15.35:0/348307831 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f38b8101320 0x7f38b8196970 unknown :-1 s=CLOSED pgs=2619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:38.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 >> 172.21.15.35:0/348307831 conn(0x7f38b8077580 msgr2=0x7f38b80fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:38.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 shutdown_connections 2023-03-17T12:04:38.575 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:12.330+0000 7f38be801700 1 -- 172.21.15.35:0/348307831 wait complete. 2023-03-17T12:04:38.576 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-03-17T12:04:39.203 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:12 smithi035 ceph-mon[92535]: pgmap v6550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:04:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:14 smithi035 ceph-mon[92535]: pgmap v6551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:04:40.537 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:16 smithi035 ceph-mon[92535]: pgmap v6552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:04:40.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:18 smithi035 ceph-mon[92535]: pgmap v6553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:04:40.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:18 smithi035 ceph-mon[92535]: osdmap e477: 12 total, 12 up, 12 in 2023-03-17T12:04:40.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:20 smithi035 ceph-mon[92535]: pgmap v6555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-17T12:04:40.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:22 smithi035 ceph-mon[92535]: pgmap v6556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:04:40.538 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:24 smithi035 ceph-mon[92535]: pgmap v6557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:04:43.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:26 smithi035 ceph-mon[92535]: pgmap v6558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:27 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:28 smithi035 ceph-mon[92535]: pgmap v6559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:29 smithi035 ceph-mon[92535]: pgmap v6560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:29 smithi035 ceph-mon[92535]: pgmap v6561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:04:43.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:31 smithi035 ceph-mon[92535]: pgmap v6562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:04:43.514 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:33 smithi035 ceph-mon[92535]: pgmap v6563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:04:43.514 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:35 smithi035 ceph-mon[92535]: pgmap v6564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:04:43.514 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:37 smithi035 ceph-mon[92535]: pgmap v6565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:04:45.792 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-03-17T12:04:48.162 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:39 smithi035 ceph-mon[92535]: pgmap v6566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:04:49.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:41 smithi035 ceph-mon[92535]: pgmap v6567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:49.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:43 smithi035 ceph-mon[92535]: pgmap v6568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:04:49.518 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:45 smithi035 ceph-mon[92535]: pgmap v6569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:04:49.549 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 -- 172.21.15.35:0/3114813459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 msgr2=0x7f22c4103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:53.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 --2- 172.21.15.35:0/3114813459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4103ce0 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f22b80099c0 tx=0x7f22b8009cd0 comp rx=0 tx=0).stop 2023-03-17T12:04:53.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 -- 172.21.15.35:0/3114813459 shutdown_connections 2023-03-17T12:04:53.948 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 --2- 172.21.15.35:0/3114813459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22c41043c0 0x7f22c410bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:53.949 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 --2- 172.21.15.35:0/3114813459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22c40ff380 0x7f22c40ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:56.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 --2- 172.21.15.35:0/3114813459 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4103ce0 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:56.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.969+0000 7f22cc359700 1 -- 172.21.15.35:0/3114813459 >> 172.21.15.35:0/3114813459 conn(0x7f22c4076300 msgr2=0x7f22c4076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:04:56.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.970+0000 7f22cc359700 1 -- 172.21.15.35:0/3114813459 shutdown_connections 2023-03-17T12:04:56.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.970+0000 7f22cc359700 1 -- 172.21.15.35:0/3114813459 wait complete. 2023-03-17T12:04:56.117 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.970+0000 7f22cc359700 1 Processor -- start 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.970+0000 7f22cc359700 1 -- start start 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.970+0000 7f22cc359700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22c40ff380 0x7f22c4196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.970+0000 7f22cc359700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22cc359700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22c41043c0 0x7f22c419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22cc359700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c419b230 con 0x7f22c40ffd20 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22cc359700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c419b3a0 con 0x7f22c40ff380 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22cc359700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c419b560 con 0x7f22c41043c0 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59938/0 (socket says 172.21.15.35:59938) 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 -- 172.21.15.35:0/2572378447 learned_addr learned my addr 172.21.15.35:0/2572378447 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22c40ff380 0x7f22c4196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22c41043c0 0x7f22c419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 -- 172.21.15.35:0/2572378447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22c41043c0 msgr2=0x7f22c419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22c41043c0 0x7f22c419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 -- 172.21.15.35:0/2572378447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22c40ff380 msgr2=0x7f22c4196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22c40ff380 0x7f22c4196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:04:56.118 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 -- 172.21.15.35:0/2572378447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80095f0 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22c98f4700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4196790 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f22b8006010 tx=0x7f22b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22b77fe700 1 -- 172.21.15.35:0/2572378447 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b801d070 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22b77fe700 1 -- 172.21.15.35:0/2572378447 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22b8004c70 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c41101a0 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22b77fe700 1 -- 172.21.15.35:0/2572378447 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8003af0 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.971+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c4110010 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.974+0000 7f22b77fe700 1 -- 172.21.15.35:0/2572378447 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f22b80050c0 con 0x7f22c40ffd20 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.975+0000 7f22b77fe700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f22b009f640 0x7f22b00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:04:58.025 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.975+0000 7f22b77fe700 1 -- 172.21.15.35:0/2572378447 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(477..477 src has 1..477) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f22b80cb360 con 0x7f22c40ffd20 2023-03-17T12:04:58.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.975+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f22b009f640 0x7f22b00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:04:58.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.975+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f22b009f640 0x7f22b00a1af0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f22c0005950 tx=0x7f22c000b410 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:04:58.026 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.975+0000 7f22d84e6b80 1 Processor -- start 2023-03-17T12:05:00.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 -- start start 2023-03-17T12:05:00.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c77d0 0x5616629c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:00.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:00.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:00.008 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616628ce070 con 0x5616629cc630 2023-03-17T12:05:01.452 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629209b0 con 0x5616629c80e0 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561662919e40 con 0x5616629c77d0 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59948/0 (socket says 172.21.15.35:59948) 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 -- 172.21.15.35:0/1388233611 learned_addr learned my addr 172.21.15.35:0/1388233611 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c77d0 0x5616629c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22c98f4700 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:02.679 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 -- 172.21.15.35:0/1388233611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c77d0 msgr2=0x5616629c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c77d0 0x5616629c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 -- 172.21.15.35:0/1388233611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 msgr2=0x5616629cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca8f6700 1 -- 172.21.15.35:0/1388233611 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56166279b630 con 0x5616629cc630 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.976+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c77d0 0x5616629c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.977+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629cca80 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003f30 tx=0x7f22bc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a949e28dbe8b75 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.977+0000 7f22b4dae700 1 -- 172.21.15.35:0/1388233611 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc003a00 con 0x5616629cc630 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.977+0000 7f22b4dae700 1 -- 172.21.15.35:0/1388233611 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22bc00f040 con 0x5616629cc630 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.977+0000 7f22b4dae700 1 -- 172.21.15.35:0/1388233611 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0156a0 con 0x5616629cc630 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.977+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1388233611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 msgr2=0x5616629cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.977+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629cca80 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f22bc003f30 tx=0x7f22bc009c20 comp rx=0 tx=0).stop 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1388233611 shutdown_connections 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629cca80 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c77d0 0x5616629c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1388233611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:02.680 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1388233611 >> 172.21.15.35:0/1388233611 conn(0x5616629c2030 msgr2=0x5616629c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1388233611 shutdown_connections 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1388233611 wait complete. 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- start start 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 Processor -- start 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c80e0 0x5616629d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56166279d920 con 0x5616629cc630 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629d1dd0 con 0x5616629c77d0 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629dd8e0 con 0x5616629c80e0 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.978+0000 7f22d84e6b80 10 client.0 _ll_register_callbacks cb 0x5616627bf290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:05:02.681 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:04.145 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59954/0 (socket says 172.21.15.35:59954) 2023-03-17T12:05:04.145 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 -- 172.21.15.35:0/3028851273 learned_addr learned my addr 172.21.15.35:0/3028851273 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:04.145 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:04.145 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22c98f4700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c80e0 0x5616629d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:04.145 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 -- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c80e0 msgr2=0x5616629d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c80e0 0x5616629d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 -- 172.21.15.35:0/3028851273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 msgr2=0x5616629d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 -- 172.21.15.35:0/3028851273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc003b60 con 0x5616629cc630 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629d1660 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0095f0 tx=0x7f22bc007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf46ace5b514ad1 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22adffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:05:04.808 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22adffb700 1 -- 172.21.15.35:0/3028851273 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc004470 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22adffb700 1 -- 172.21.15.35:0/3028851273 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(477..477 src has 1..477) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f22bc0045d0 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616628dc3f0 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22adffb700 1 -- 172.21.15.35:0/3028851273 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22bc004790 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22d84e6b80 10 client.22599 fetch_fsmap learned FSMap version 112 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.979+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x561662747de0 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22adffb700 1 -- 172.21.15.35:0/3028851273 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5616628dc3f0 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22adffb700 1 -- 172.21.15.35:0/3028851273 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f22bc005050 con 0x5616629cc630 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22d84e6b80 10 client.22599 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22d84e6b80 10 client.22599 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22d84e6b80 20 client.22599 populate_metadata read hostname 'smithi035' 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x5616629e1830 0x5616629e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22d84e6b80 4 client.22599 mds_command: new command op to 24439 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616628e8660 con 0x5616629e1830 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.980+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x5616629e1830 0x5616629e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22adffb700 10 client.22599 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T12:05:04.809 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x5616629e1830 0x5616629e3c40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=21e6f5e17c961dc2 server_cookie=c4457e164b9f0e2c in_seq=0 out_seq=0 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22adffb700 1 -- 172.21.15.35:0/3028851273 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5616628e8660 con 0x5616629e1830 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22adffb700 10 client.22599 handle_command_reply: tid=0 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 client.22599 shutdown 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 msgr2=0x5616629d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629d1660 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0095f0 tx=0x7f22bc007730 comp rx=0 tx=0).stop 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 shutdown_connections 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x5616629e1830 0x5616629e3c40 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629cc630 0x5616629d1660 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22adffb700 0 client.22599 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:04.810 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/3028851273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629c80e0 0x5616629d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 >> 172.21.15.35:0/3028851273 conn(0x5616629c2030 msgr2=0x5616629c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.981+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 shutdown_connections 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.982+0000 7f22d84e6b80 1 -- 172.21.15.35:0/3028851273 wait complete. 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.982+0000 7f22d84e6b80 20 client.22599 trim_cache size 0 max 16384 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 Processor -- start 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 -- start start 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 0x5616629ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629cf590 con 0x5616629c80e0 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629d8d70 con 0x5616629c77d0 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629de240 con 0x5616629cc630 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 0x5616629ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 0x5616629ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59960/0 (socket says 172.21.15.35:59960) 2023-03-17T12:05:06.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 -- 172.21.15.35:0/1977552407 learned_addr learned my addr 172.21.15.35:0/1977552407 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:06.135 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:07.841 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:09.821 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 -- 172.21.15.35:0/1977552407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 msgr2=0x5616629c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:11.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:11.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 -- 172.21.15.35:0/1977552407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 msgr2=0x5616629d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:11.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:11.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.995+0000 7f22c98f4700 1 -- 172.21.15.35:0/1977552407 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616628e0190 con 0x5616629c80e0 2023-03-17T12:05:11.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22c98f4700 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 0x5616629ddd00 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f22b80958b0 tx=0x7f22b809e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ce5be96eb26d7d server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:11.748 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22b55af700 1 -- 172.21.15.35:0/1977552407 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b80a0fa0 con 0x5616629c80e0 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22b55af700 1 -- 172.21.15.35:0/1977552407 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22b80971e0 con 0x5616629c80e0 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22b55af700 1 -- 172.21.15.35:0/1977552407 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8095730 con 0x5616629c80e0 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1977552407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 msgr2=0x5616629ddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 0x5616629ddd00 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f22b80958b0 tx=0x7f22b809e040 comp rx=0 tx=0).stop 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1977552407 shutdown_connections 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:12.340 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c77d0 0x5616629d8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:13.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/1977552407 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c80e0 0x5616629ddd00 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:13.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1977552407 >> 172.21.15.35:0/1977552407 conn(0x5616629c2030 msgr2=0x5616629cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:13.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1977552407 shutdown_connections 2023-03-17T12:05:13.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.996+0000 7f22d84e6b80 1 -- 172.21.15.35:0/1977552407 wait complete. 2023-03-17T12:05:13.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 -- start start 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 Processor -- start 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 0x5616629d8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629d6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629d6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629d7200 con 0x5616629c77d0 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629d7370 con 0x5616629c80e0 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616629d7530 con 0x5616629cc630 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22d84e6b80 10 client.0 _ll_register_callbacks cb 0x5616627bf290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:05:13.927 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 0x5616629d8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:16.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 0x5616629d8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59964/0 (socket says 172.21.15.35:59964) 2023-03-17T12:05:16.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 -- 172.21.15.35:0/2979640703 learned_addr learned my addr 172.21.15.35:0/2979640703 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:16.146 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22c98f4700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca8f6700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629d6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 -- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 msgr2=0x5616629d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629d6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 -- 172.21.15.35:0/2979640703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 msgr2=0x5616629d6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629d6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.997+0000 7f22ca0f5700 1 -- 172.21.15.35:0/2979640703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b809ce70 con 0x5616629c77d0 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22ca0f5700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 0x5616629d8450 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x5616629e4550 tx=0x7f22c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26fd2c62d3406e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:17.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22adffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:05:17.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22adffb700 1 -- 172.21.15.35:0/2979640703 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0024040 con 0x5616629c77d0 2023-03-17T12:05:17.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22adffb700 1 -- 172.21.15.35:0/2979640703 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(477..477 src has 1..477) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f22c0017070 con 0x5616629c77d0 2023-03-17T12:05:17.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561662997240 con 0x5616629c77d0 2023-03-17T12:05:17.045 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22adffb700 1 -- 172.21.15.35:0/2979640703 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22c0029e90 con 0x5616629c77d0 2023-03-17T12:05:18.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 10 client.22605 fetch_fsmap learned FSMap version 112 2023-03-17T12:05:18.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x56166276e250 con 0x5616629c77d0 2023-03-17T12:05:18.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22adffb700 1 -- 172.21.15.35:0/2979640703 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561662997240 con 0x5616629c77d0 2023-03-17T12:05:18.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22adffb700 1 -- 172.21.15.35:0/2979640703 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f22c003b5d0 con 0x5616629c77d0 2023-03-17T12:05:18.786 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 10 client.22605 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 10 client.22605 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 20 client.22605 populate_metadata read hostname 'smithi035' 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x561662a36b10 0x561662a38f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 4 client.22605 mds_command: new command op to 24439 tid=0[{"prefix": "damage ls"}] 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.998+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 --> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56166279df60 con 0x561662a36b10 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22c98f4700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x561662a36b10 0x561662a38f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22c98f4700 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x561662a36b10 0x561662a38f20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8d47de071d661f7c server_cookie=502b7daf6de47c10 in_seq=0 out_seq=0 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22adffb700 10 client.22605 ms_handle_connect on v2:172.21.15.82:6834/3844512343 2023-03-17T12:05:20.333 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22adffb700 1 -- 172.21.15.35:0/2979640703 <== mds.3 v2:172.21.15.82:6834/3844512343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56166279df60 con 0x561662a36b10 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22adffb700 10 client.22605 handle_command_reply: tid=0 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 client.22605 shutdown 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 msgr2=0x5616629d8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 0x5616629d8450 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x5616629e4550 tx=0x7f22c00047c0 comp rx=0 tx=0).stop 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 shutdown_connections 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:6834/3844512343,v1:172.21.15.82:6835/3844512343] conn(0x561662a36b10 0x561662a38f20 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616629cc630 0x5616629d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x5616629c77d0 0x5616629d8450 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22adffb700 0 client.22605 ms_handle_reset on v2:172.21.15.82:6834/3844512343 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 --2- 172.21.15.35:0/2979640703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5616629c80e0 0x5616629d6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 >> 172.21.15.35:0/2979640703 conn(0x5616629c2030 msgr2=0x5616629cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 shutdown_connections 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:45.999+0000 7f22d84e6b80 1 -- 172.21.15.35:0/2979640703 wait complete. 2023-03-17T12:05:20.334 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22d84e6b80 20 client.22605 trim_cache size 0 max 16384 2023-03-17T12:05:20.335 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T12:05:20.338 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f22b009f640 msgr2=0x7f22b00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f22b009f640 0x7f22b00a1af0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f22c0005950 tx=0x7f22c000b410 comp rx=0 tx=0).stop 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 msgr2=0x7f22c4196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4196790 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f22b8006010 tx=0x7f22b8004730 comp rx=0 tx=0).stop 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 shutdown_connections 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f22b009f640 0x7f22b00a1af0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22c41043c0 0x7f22c419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22c40ff380 0x7f22c4196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 --2- 172.21.15.35:0/2572378447 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f22c40ffd20 0x7f22c4196790 unknown :-1 s=CLOSED pgs=2625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 >> 172.21.15.35:0/2572378447 conn(0x7f22c4076300 msgr2=0x7f22c4103550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 shutdown_connections 2023-03-17T12:05:22.187 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:04:46.000+0000 7f22cc359700 1 -- 172.21.15.35:0/2572378447 wait complete. 2023-03-17T12:05:22.188 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-03-17T12:05:22.192 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:47 smithi035 ceph-mon[92535]: pgmap v6570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:49 smithi035 ceph-mon[92535]: pgmap v6571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:05:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:51 smithi035 ceph-mon[92535]: pgmap v6572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:53 smithi035 ceph-mon[92535]: pgmap v6573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:55 smithi035 ceph-mon[92535]: pgmap v6574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:05:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:57 smithi035 ceph-mon[92535]: pgmap v6575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:23.214 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:04:59 smithi035 ceph-mon[92535]: pgmap v6576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:01 smithi035 ceph-mon[92535]: pgmap v6577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:03 smithi035 ceph-mon[92535]: pgmap v6578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:05 smithi035 ceph-mon[92535]: pgmap v6579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:07 smithi035 ceph-mon[92535]: pgmap v6580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:09 smithi035 ceph-mon[92535]: pgmap v6581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:10 smithi035 ceph-mon[92535]: osdmap e478: 12 total, 12 up, 12 in 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:11 smithi035 ceph-mon[92535]: pgmap v6583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:13 smithi035 ceph-mon[92535]: pgmap v6584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:14 smithi035 ceph-mon[92535]: pgmap v6585: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:16 smithi035 ceph-mon[92535]: pgmap v6586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:19 smithi035 ceph-mon[92535]: pgmap v6587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:19 smithi035 ceph-mon[92535]: osdmap e479: 12 total, 12 up, 12 in 2023-03-17T12:05:23.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:21 smithi035 ceph-mon[92535]: pgmap v6589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:05:23.222 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 -- 172.21.15.35:0/47407245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14440ffcf0 msgr2=0x7f1444103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:24.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 --2- 172.21.15.35:0/47407245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14440ffcf0 0x7f1444103cb0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f14300099c0 tx=0x7f1430009cd0 comp rx=0 tx=0).stop 2023-03-17T12:05:24.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 -- 172.21.15.35:0/47407245 shutdown_connections 2023-03-17T12:05:24.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 --2- 172.21.15.35:0/47407245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1444104390 0x7f144410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:24.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 --2- 172.21.15.35:0/47407245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14440ff350 0x7f14440ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:24.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 --2- 172.21.15.35:0/47407245 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f14440ffcf0 0x7f1444103cb0 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:24.229 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 -- 172.21.15.35:0/47407245 >> 172.21.15.35:0/47407245 conn(0x7f1444076330 msgr2=0x7f1444076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 -- 172.21.15.35:0/47407245 shutdown_connections 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.326+0000 7f144b0fa700 1 -- 172.21.15.35:0/47407245 wait complete. 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 Processor -- start 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 -- start start 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14440ff350 0x7f14441962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14440ffcf0 0x7f14441967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 0x7f144419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144419b280 con 0x7f1444104390 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144419b3f0 con 0x7f14440ffcf0 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f144b0fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144419b5b0 con 0x7f14440ff350 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 0x7f144419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 0x7f144419ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59982/0 (socket says 172.21.15.35:59982) 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 -- 172.21.15.35:0/4030823719 learned_addr learned my addr 172.21.15.35:0/4030823719 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1443fff700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14440ffcf0 0x7f14441967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1448e96700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14440ff350 0x7f14441962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:24.230 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 -- 172.21.15.35:0/4030823719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14440ff350 msgr2=0x7f14441962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:24.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14440ff350 0x7f14441962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:24.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 -- 172.21.15.35:0/4030823719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14440ffcf0 msgr2=0x7f14441967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:24.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14440ffcf0 0x7f14441967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:24.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.327+0000 7f1449697700 1 -- 172.21.15.35:0/4030823719 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300095f0 con 0x7f1444104390 2023-03-17T12:05:24.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.328+0000 7f1449697700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 0x7f144419ac40 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f143c007ee0 tx=0x7f143c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:24.860 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.328+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c017070 con 0x7f1444104390 2023-03-17T12:05:24.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.328+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f143c00f040 con 0x7f1444104390 2023-03-17T12:05:24.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.328+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144410efc0 con 0x7f1444104390 2023-03-17T12:05:24.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.328+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c005570 con 0x7f1444104390 2023-03-17T12:05:24.861 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.328+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144410ee30 con 0x7f1444104390 2023-03-17T12:05:24.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.329+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144410f150 con 0x7f1444104390 2023-03-17T12:05:24.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.330+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f143c00db20 con 0x7f1444104390 2023-03-17T12:05:24.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.332+0000 7f1441ffb700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f143409f6c0 0x7f14340a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:24.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.332+0000 7f1448e96700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f143409f6c0 0x7f14340a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:24.862 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.332+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f143c0c9cc0 con 0x7f1444104390 2023-03-17T12:05:24.863 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.332+0000 7f1448e96700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f143409f6c0 0x7f14340a1b70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1438005950 tx=0x7f143800a300 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:24.863 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.336+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f143c093ab0 con 0x7f1444104390 2023-03-17T12:05:24.863 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.565+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 --> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f14440687d0 con 0x7f143409f6c0 2023-03-17T12:05:26.200 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.579+0000 7f1441ffb700 1 -- 172.21.15.35:0/4030823719 <== mgr.15318 v2:172.21.15.35:6800/1224511514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+338 (secure 0 0 0) 0x7f14440687d0 con 0x7f143409f6c0 2023-03-17T12:05:26.201 INFO:teuthology.orchestra.run.smithi035.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-03-17T00:00:00", "created": "2023-03-17T08:49:05", "first": "2023-03-17T08:50:00", "last": "2023-03-17T12:05:00", "last_pruned": "2023-03-17T12:05:00", "created_count": 196, "pruned_count": 187, "active": true} 2023-03-17T12:05:26.204 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f143409f6c0 msgr2=0x7f14340a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:27.527 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f143409f6c0 0x7f14340a1b70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1438005950 tx=0x7f143800a300 comp rx=0 tx=0).stop 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 msgr2=0x7f144419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 0x7f144419ac40 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f143c007ee0 tx=0x7f143c00d3b0 comp rx=0 tx=0).stop 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 shutdown_connections 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f143409f6c0 0x7f14340a1b70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f1444104390 0x7f144419ac40 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14440ff350 0x7f14441962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 --2- 172.21.15.35:0/4030823719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14440ffcf0 0x7f14441967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 >> 172.21.15.35:0/4030823719 conn(0x7f1444076330 msgr2=0x7f14440680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 shutdown_connections 2023-03-17T12:05:27.528 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:22.582+0000 7f144b0fa700 1 -- 172.21.15.35:0/4030823719 wait complete. 2023-03-17T12:05:27.529 DEBUG:teuthology.orchestra.run.smithi035:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-03-17T12:05:30.044 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 -- 172.21.15.35:0/2838277342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e580ff380 msgr2=0x7f3e580ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 --2- 172.21.15.35:0/2838277342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e580ff380 0x7f3e580ff750 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7f3e540099c0 tx=0x7f3e54009cd0 comp rx=0 tx=0).stop 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 -- 172.21.15.35:0/2838277342 shutdown_connections 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 --2- 172.21.15.35:0/2838277342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e581043c0 0x7f3e5810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 --2- 172.21.15.35:0/2838277342 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e580ff380 0x7f3e580ff750 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 --2- 172.21.15.35:0/2838277342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e580ffd20 0x7f3e58103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 -- 172.21.15.35:0/2838277342 >> 172.21.15.35:0/2838277342 conn(0x7f3e58076300 msgr2=0x7f3e58076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 -- 172.21.15.35:0/2838277342 shutdown_connections 2023-03-17T12:05:31.573 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.347+0000 7f3e60478700 1 -- 172.21.15.35:0/2838277342 wait complete. 2023-03-17T12:05:31.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 Processor -- start 2023-03-17T12:05:31.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 -- start start 2023-03-17T12:05:31.574 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e580ff380 0x7f3e581970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:32.982 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e580ffd20 0x7f3e58197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:32.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 0x7f3e581a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:32.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58197f20 con 0x7f3e581043c0 2023-03-17T12:05:32.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581a2690 con 0x7f3e580ff380 2023-03-17T12:05:32.983 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e60478700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581a2800 con 0x7f3e580ffd20 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 0x7f3e581a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 0x7f3e581a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:59996/0 (socket says 172.21.15.35:59996) 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 -- 172.21.15.35:0/411318841 learned_addr learned my addr 172.21.15.35:0/411318841 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5e214700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e580ff380 0x7f3e581970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5da13700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e580ffd20 0x7f3e58197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 -- 172.21.15.35:0/411318841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e580ffd20 msgr2=0x7f3e58197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e580ffd20 0x7f3e58197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:33.991 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 -- 172.21.15.35:0/411318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e580ff380 msgr2=0x7f3e581970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:33.992 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e580ff380 0x7f3e581970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:35.494 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.348+0000 7f3e5ea15700 1 -- 172.21.15.35:0/411318841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540095f0 con 0x7f3e581043c0 2023-03-17T12:05:36.154 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.349+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 0x7f3e581a2150 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f3e50007d70 tx=0x7f3e5000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:36.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.349+0000 7f3e4f7fe700 1 -- 172.21.15.35:0/411318841 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000ac90 con 0x7f3e581043c0 2023-03-17T12:05:36.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.349+0000 7f3e4f7fe700 1 -- 172.21.15.35:0/411318841 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e5000adf0 con 0x7f3e581043c0 2023-03-17T12:05:36.155 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.349+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5810f030 con 0x7f3e581043c0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.349+0000 7f3e4f7fe700 1 -- 172.21.15.35:0/411318841 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500115e0 con 0x7f3e581043c0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.349+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5810eea0 con 0x7f3e581043c0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.351+0000 7f3e4f7fe700 1 -- 172.21.15.35:0/411318841 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f3e50012420 con 0x7f3e581043c0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.352+0000 7f3e4f7fe700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3e4409f640 0x7f3e440a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.352+0000 7f3e4f7fe700 1 -- 172.21.15.35:0/411318841 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3e500ca6e0 con 0x7f3e581043c0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.352+0000 7f3e5e214700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3e4409f640 0x7f3e440a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.352+0000 7f3e5e214700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3e4409f640 0x7f3e440a1af0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3e54000c00 tx=0x7f3e54009f10 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.352+0000 7f3e6c605b80 1 Processor -- start 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 -- start start 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:38.164 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb236b6070 con 0x55bb237b00e0 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237089b0 con 0x55bb237af7d0 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb23701e40 con 0x55bb237b4630 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60002/0 (socket says 172.21.15.35:60002) 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 -- 172.21.15.35:0/284173491 learned_addr learned my addr 172.21.15.35:0/284173491 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5e214700 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 -- 172.21.15.35:0/284173491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 msgr2=0x55bb237b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 -- 172.21.15.35:0/284173491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 msgr2=0x55bb237afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5da13700 1 -- 172.21.15.35:0/284173491 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb23583630 con 0x55bb237b00e0 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.353+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:05:38.165 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e5da13700 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b40f0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f3e48007c70 tx=0x7f3e48007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5cd7949f2b1409 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:39.739 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e4cdae700 1 -- 172.21.15.35:0/284173491 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48004310 con 0x55bb237b00e0 2023-03-17T12:05:39.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e4cdae700 1 -- 172.21.15.35:0/284173491 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e48010e10 con 0x55bb237b00e0 2023-03-17T12:05:39.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e4cdae700 1 -- 172.21.15.35:0/284173491 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48003da0 con 0x55bb237b00e0 2023-03-17T12:05:39.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 -- 172.21.15.35:0/284173491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 msgr2=0x55bb237b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:39.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b40f0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f3e48007c70 tx=0x7f3e48007f80 comp rx=0 tx=0).stop 2023-03-17T12:05:39.740 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 -- 172.21.15.35:0/284173491 shutdown_connections 2023-03-17T12:05:41.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:41.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:41.003 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/284173491 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b40f0 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.354+0000 7f3e6c605b80 1 -- 172.21.15.35:0/284173491 >> 172.21.15.35:0/284173491 conn(0x55bb237aa030 msgr2=0x55bb237aa400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 -- 172.21.15.35:0/284173491 shutdown_connections 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 -- 172.21.15.35:0/284173491 wait complete. 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 -- start start 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 Processor -- start 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb23585920 con 0x55bb237b00e0 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237b9f00 con 0x55bb237af7d0 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237c5940 con 0x55bb237b4630 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e6c605b80 10 client.0 _ll_register_callbacks cb 0x55bb235a7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e5da13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:41.004 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.355+0000 7f3e5da13700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60008/0 (socket says 172.21.15.35:60008) 2023-03-17T12:05:41.005 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 -- 172.21.15.35:0/3110234431 learned_addr learned my addr 172.21.15.35:0/3110234431 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:41.005 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5e214700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:41.005 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:41.005 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 -- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 msgr2=0x55bb237b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:43.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:43.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 -- 172.21.15.35:0/3110234431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 msgr2=0x55bb237bbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:43.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237bbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:43.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 -- 172.21.15.35:0/3110234431 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e480078a0 con 0x55bb237b00e0 2023-03-17T12:05:43.017 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:05:43.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e5da13700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b90a0 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f3e48003cb0 tx=0x7f3e48003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf977044603c5304 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e41ffb700 1 -- 172.21.15.35:0/3110234431 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4801f070 con 0x55bb237b00e0 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e41ffb700 1 -- 172.21.15.35:0/3110234431 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3e480037c0 con 0x55bb237b00e0 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb236c43f0 con 0x55bb237b00e0 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e41ffb700 1 -- 172.21.15.35:0/3110234431 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e48004320 con 0x55bb237b00e0 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e6c605b80 10 client.22623 fetch_fsmap learned FSMap version 112 2023-03-17T12:05:43.486 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.356+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55bb2352fde0 con 0x55bb237b00e0 2023-03-17T12:05:43.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e41ffb700 1 -- 172.21.15.35:0/3110234431 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb236c43f0 con 0x55bb237b00e0 2023-03-17T12:05:43.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e41ffb700 1 -- 172.21.15.35:0/3110234431 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3e480053e0 con 0x55bb237b00e0 2023-03-17T12:05:43.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e6c605b80 10 client.22623 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:05:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e6c605b80 10 client.22623 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-17T12:05:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e6c605b80 20 client.22623 populate_metadata read hostname 'smithi035' 2023-03-17T12:05:45.676 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb237c97e0 0x55bb237cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:45.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e6c605b80 4 client.22623 mds_command: new command op to 24445 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:05:45.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb236d0660 con 0x55bb237c97e0 2023-03-17T12:05:45.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.357+0000 7f3e5e214700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb237c97e0 0x55bb237cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:45.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e41ffb700 10 client.22623 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T12:05:45.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e5e214700 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb237c97e0 0x55bb237cbbf0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a806d2fc103c86 server_cookie=4dc54147eb6e0d2f in_seq=0 out_seq=0 2023-03-17T12:05:45.677 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e41ffb700 1 -- 172.21.15.35:0/3110234431 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55bb236d0660 con 0x55bb237c97e0 2023-03-17T12:05:45.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e41ffb700 10 client.22623 handle_command_reply: tid=0 2023-03-17T12:05:45.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e6c605b80 1 client.22623 shutdown 2023-03-17T12:05:45.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 msgr2=0x55bb237b90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:45.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b90a0 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f3e48003cb0 tx=0x7f3e48003d90 comp rx=0 tx=0).stop 2023-03-17T12:05:45.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 shutdown_connections 2023-03-17T12:05:45.678 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.358+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb237c97e0 0x55bb237cbbf0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:46.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b4630 0x55bb237b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:46.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e41ffb700 0 client.22623 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T12:05:46.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:46.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/3110234431 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b00e0 0x55bb237b90a0 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:46.538 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 >> 172.21.15.35:0/3110234431 conn(0x55bb237aa030 msgr2=0x55bb237a9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 shutdown_connections 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 1 -- 172.21.15.35:0/3110234431 wait complete. 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.359+0000 7f3e6c605b80 20 client.22623 trim_cache size 0 max 16384 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 Processor -- start 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 -- start start 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237c0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:46.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 0x55bb237c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb236c43f0 con 0x55bb237b4630 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237b0940 con 0x55bb237af7d0 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237b7600 con 0x55bb237b00e0 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 0x55bb237c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 0x55bb237c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60018/0 (socket says 172.21.15.35:60018) 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 -- 172.21.15.35:0/581059638 learned_addr learned my addr 172.21.15.35:0/581059638 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:46.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5e214700 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237c0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 -- 172.21.15.35:0/581059638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 msgr2=0x55bb237a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5da13700 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237a9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 -- 172.21.15.35:0/581059638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 msgr2=0x55bb237c0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237c0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 -- 172.21.15.35:0/581059638 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb237aa6d0 con 0x55bb237b4630 2023-03-17T12:05:46.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5e214700 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:05:47.309 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.372+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 0x55bb237c4ff0 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f3e50094cb0 tx=0x7f3e50097cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f14f511d5acd61 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:47.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e4d5af700 1 -- 172.21.15.35:0/581059638 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500af070 con 0x55bb237b4630 2023-03-17T12:05:47.926 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e4d5af700 1 -- 172.21.15.35:0/581059638 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e50098240 con 0x55bb237b4630 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e4d5af700 1 -- 172.21.15.35:0/581059638 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50097990 con 0x55bb237b4630 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 -- 172.21.15.35:0/581059638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 msgr2=0x55bb237c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 0x55bb237c4ff0 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f3e50094cb0 tx=0x7f3e50097cc0 comp rx=0 tx=0).stop 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 -- 172.21.15.35:0/581059638 shutdown_connections 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237b4630 0x55bb237c4ff0 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237af7d0 0x55bb237c0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/581059638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 -- 172.21.15.35:0/581059638 >> 172.21.15.35:0/581059638 conn(0x55bb237aa030 msgr2=0x55bb237c5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 -- 172.21.15.35:0/581059638 shutdown_connections 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.373+0000 7f3e6c605b80 1 -- 172.21.15.35:0/581059638 wait complete. 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 -- start start 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 Processor -- start 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 0x55bb237c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:48.833 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237b4630 0x55bb237bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237bf400 con 0x55bb237af7d0 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237bf540 con 0x55bb237b4630 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb237bf700 con 0x55bb237b00e0 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 0x55bb237c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e6c605b80 10 client.0 _ll_register_callbacks cb 0x55bb235a7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 0x55bb237c05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60020/0 (socket says 172.21.15.35:60020) 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 -- 172.21.15.35:0/1447105123 learned_addr learned my addr 172.21.15.35:0/1447105123 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5ea15700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237b4630 0x55bb237bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5da13700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 -- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 msgr2=0x55bb237be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:48.834 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:50.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 -- 172.21.15.35:0/1447105123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237b4630 msgr2=0x55bb237bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:05:50.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237b4630 0x55bb237bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:50.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5e214700 1 -- 172.21.15.35:0/1447105123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5810eea0 con 0x55bb237af7d0 2023-03-17T12:05:50.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.374+0000 7f3e5da13700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:05:50.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e5e214700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 0x55bb237c05c0 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400a010 tx=0x7f3e54009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25efa8651a730668 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:50.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:05:50.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e41ffb700 1 -- 172.21.15.35:0/1447105123 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54036370 con 0x55bb237af7d0 2023-03-17T12:05:50.192 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e41ffb700 1 -- 172.21.15.35:0/1447105123 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f3e540364d0 con 0x55bb237af7d0 2023-03-17T12:05:50.193 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb2377f240 con 0x55bb237af7d0 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e41ffb700 1 -- 172.21.15.35:0/1447105123 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e5400b9b0 con 0x55bb237af7d0 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 10 client.22629 fetch_fsmap learned FSMap version 112 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55bb23518c60 con 0x55bb237af7d0 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e41ffb700 1 -- 172.21.15.35:0/1447105123 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb2377f240 con 0x55bb237af7d0 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e41ffb700 1 -- 172.21.15.35:0/1447105123 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f3e540048c0 con 0x55bb237af7d0 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 10 client.22629 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 10 client.22629 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 20 client.22629 populate_metadata read hostname 'smithi035' 2023-03-17T12:05:50.843 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb2381eb10 0x55bb23820f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:51.304 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 4 client.22629 mds_command: new command op to 24445 tid=0[{"prefix": "damage ls"}] 2023-03-17T12:05:52.241 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 --> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bb23585f60 con 0x55bb2381eb10 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.375+0000 7f3e5da13700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb2381eb10 0x55bb23820f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e41ffb700 10 client.22629 ms_handle_connect on v2:172.21.15.82:6836/1283255314 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e5da13700 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb2381eb10 0x55bb23820f20 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb66e4dfb2e04ab4 server_cookie=9abb99b539e4b93a in_seq=0 out_seq=0 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e41ffb700 1 -- 172.21.15.35:0/1447105123 <== mds.2 v2:172.21.15.82:6836/1283255314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bb23585f60 con 0x55bb2381eb10 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e41ffb700 10 client.22629 handle_command_reply: tid=0 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 client.22629 shutdown 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 msgr2=0x55bb237c05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 0x55bb237c05c0 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400a010 tx=0x7f3e54009cd0 comp rx=0 tx=0).stop 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 shutdown_connections 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:6836/1283255314,v1:172.21.15.82:6837/1283255314] conn(0x55bb2381eb10 0x55bb23820f20 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bb237b4630 0x55bb237bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e41ffb700 0 client.22629 ms_handle_reset on v2:172.21.15.82:6836/1283255314 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55bb237af7d0 0x55bb237c05c0 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:52.242 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 --2- 172.21.15.35:0/1447105123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb237b00e0 0x55bb237be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:52.243 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 >> 172.21.15.35:0/1447105123 conn(0x55bb237aa030 msgr2=0x55bb237a9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:52.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 shutdown_connections 2023-03-17T12:05:52.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 1 -- 172.21.15.35:0/1447105123 wait complete. 2023-03-17T12:05:52.920 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.376+0000 7f3e6c605b80 20 client.22629 trim_cache size 0 max 16384 2023-03-17T12:05:52.920 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T12:05:52.923 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3e4409f640 msgr2=0x7f3e440a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3e4409f640 0x7f3e440a1af0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3e54000c00 tx=0x7f3e54009f10 comp rx=0 tx=0).stop 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 msgr2=0x7f3e581a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 0x7f3e581a2150 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f3e50007d70 tx=0x7f3e5000a340 comp rx=0 tx=0).stop 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 shutdown_connections 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f3e4409f640 0x7f3e440a1af0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f3e581043c0 0x7f3e581a2150 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:54.149 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e580ff380 0x7f3e581970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:54.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 --2- 172.21.15.35:0/411318841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e580ffd20 0x7f3e58197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:54.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 >> 172.21.15.35:0/411318841 conn(0x7f3e58076300 msgr2=0x7f3e580fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:54.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 shutdown_connections 2023-03-17T12:05:54.726 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:23.377+0000 7f3e60478700 1 -- 172.21.15.35:0/411318841 wait complete. 2023-03-17T12:05:54.727 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-03-17T12:05:55.314 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:23 smithi035 ceph-mon[92535]: pgmap v6590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:05:56.306 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:24 smithi035 ceph-mon[92535]: from='client.22611 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:25 smithi035 ceph-mon[92535]: pgmap v6591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:27 smithi035 ceph-mon[92535]: pgmap v6592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:28 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:29 smithi035 ceph-mon[92535]: pgmap v6593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 11 op/s 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:30 smithi035 ceph-mon[92535]: pgmap v6594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:30 smithi035 ceph-mon[92535]: pgmap v6595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:32 smithi035 ceph-mon[92535]: pgmap v6596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:05:56.307 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:34 smithi035 ceph-mon[92535]: pgmap v6597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:36 smithi035 ceph-mon[92535]: pgmap v6598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:38 smithi035 ceph-mon[92535]: pgmap v6599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:40 smithi035 ceph-mon[92535]: pgmap v6600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:42 smithi035 ceph-mon[92535]: pgmap v6601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:44 smithi035 ceph-mon[92535]: pgmap v6602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:46 smithi035 ceph-mon[92535]: pgmap v6603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:56.908 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:48 smithi035 ceph-mon[92535]: pgmap v6604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:56.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:50 smithi035 ceph-mon[92535]: pgmap v6605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:05:56.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:52 smithi035 ceph-mon[92535]: pgmap v6606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:05:56.909 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:54 smithi035 ceph-mon[92535]: pgmap v6607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:05:56.916 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 -- 172.21.15.35:0/866337229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2368104390 msgr2=0x7f236810bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 --2- 172.21.15.35:0/866337229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2368104390 0x7f236810bf60 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7f236000b0d0 tx=0x7f236000b3e0 comp rx=0 tx=0).stop 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 -- 172.21.15.35:0/866337229 shutdown_connections 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 --2- 172.21.15.35:0/866337229 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f2368104390 0x7f236810bf60 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 --2- 172.21.15.35:0/866337229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23680ff350 0x7f23680ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 --2- 172.21.15.35:0/866337229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23680ffcf0 0x7f2368103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 -- 172.21.15.35:0/866337229 >> 172.21.15.35:0/866337229 conn(0x7f2368076330 msgr2=0x7f2368076730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:05:58.258 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 -- 172.21.15.35:0/866337229 shutdown_connections 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 -- 172.21.15.35:0/866337229 wait complete. 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 Processor -- start 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.451+0000 7f236fbfb700 1 -- start start 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 0x7f2368195230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23680ffcf0 0x7f2368195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368104390 0x7f2368199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236819a210 con 0x7f23680ff350 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236819a380 con 0x7f23680ffcf0 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236819a540 con 0x7f2368104390 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 0x7f2368195230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 0x7f2368195230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60034/0 (socket says 172.21.15.35:60034) 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 -- 172.21.15.35:0/1533340813 learned_addr learned my addr 172.21.15.35:0/1533340813 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236e198700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368104390 0x7f2368199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d196700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23680ffcf0 0x7f2368195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 -- 172.21.15.35:0/1533340813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368104390 msgr2=0x7f2368199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:58.259 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368104390 0x7f2368199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:58.260 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 -- 172.21.15.35:0/1533340813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23680ffcf0 msgr2=0x7f2368195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:05:58.260 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23680ffcf0 0x7f2368195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:05:58.260 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 -- 172.21.15.35:0/1533340813 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360009d00 con 0x7f23680ff350 2023-03-17T12:05:58.260 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236d997700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 0x7f2368195230 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f236400d980 tx=0x7f236400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364004220 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2364007640 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23640055e0 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.452+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236810f010 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.453+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236810ee80 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.453+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236810f1a0 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.455+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f2364004750 con 0x7f23680ff350 2023-03-17T12:05:59.133 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.455+0000 7f235effd700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f235409f6c0 0x7f23540a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.455+0000 7f236d196700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f235409f6c0 0x7f23540a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.455+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f23640ca8b0 con 0x7f23680ff350 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.456+0000 7f236d196700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f235409f6c0 0x7f23540a1b70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2358005fd0 tx=0x7f235800af20 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.459+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mon.0 v2:172.21.15.35:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177564 (secure 0 0 0) 0x7f23640946a0 con 0x7f23680ff350 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.690+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 --> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f23680fd080 con 0x7f235409f6c0 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.704+0000 7f235effd700 1 -- 172.21.15.35:0/1533340813 <== mgr.15318 v2:172.21.15.35:6800/1224511514 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f23680fd080 con 0x7f235409f6c0 2023-03-17T12:05:59.134 INFO:teuthology.orchestra.run.smithi035.stdout:/ 1M 6M3h 2023-03-17T12:05:59.137 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f235409f6c0 msgr2=0x7f23540a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f235409f6c0 0x7f23540a1b70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2358005fd0 tx=0x7f235800af20 comp rx=0 tx=0).stop 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 msgr2=0x7f2368195230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 0x7f2368195230 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f236400d980 tx=0x7f236400dc90 comp rx=0 tx=0).stop 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 shutdown_connections 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f235409f6c0 0x7f23540a1b70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368104390 0x7f2368199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f23680ff350 0x7f2368195230 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 --2- 172.21.15.35:0/1533340813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23680ffcf0 0x7f2368195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:00.618 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 >> 172.21.15.35:0/1533340813 conn(0x7f2368076330 msgr2=0x7f23680fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:00.619 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 shutdown_connections 2023-03-17T12:06:00.619 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:55.706+0000 7f236fbfb700 1 -- 172.21.15.35:0/1533340813 wait complete. 2023-03-17T12:06:00.619 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-03-17T12:06:01.815 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-03-17T12:06:04.086 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:56 smithi035 ceph-mon[92535]: pgmap v6608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:06:04.115 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 -- 172.21.15.35:0/3656112570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ffd20 msgr2=0x7f58d4103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/3656112570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ffd20 0x7f58d4103ce0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0099c0 tx=0x7f58bc009cd0 comp rx=0 tx=0).stop 2023-03-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 -- 172.21.15.35:0/3656112570 shutdown_connections 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/3656112570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d41043c0 0x7f58d410bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/3656112570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d40ff380 0x7f58d40ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/3656112570 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ffd20 0x7f58d4103ce0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 -- 172.21.15.35:0/3656112570 >> 172.21.15.35:0/3656112570 conn(0x7f58d4076300 msgr2=0x7f58d4076700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 -- 172.21.15.35:0/3656112570 shutdown_connections 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.048+0000 7f58d9f7c700 1 -- 172.21.15.35:0/3656112570 wait complete. 2023-03-17T12:06:07.699 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 Processor -- start 2023-03-17T12:06:08.420 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 -- start start 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 0x7f58d4196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d40ffd20 0x7f58d4196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d41043c0 0x7f58d419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d419b220 con 0x7f58d40ff380 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d419b390 con 0x7f58d41043c0 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d9f7c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d419b550 con 0x7f58d40ffd20 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 0x7f58d4196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 0x7f58d4196240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60048/0 (socket says 172.21.15.35:60048) 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d37fe700 1 -- 172.21.15.35:0/267366937 learned_addr learned my addr 172.21.15.35:0/267366937 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d3fff700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d41043c0 0x7f58d419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.049+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d40ffd20 0x7f58d4196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:09.596 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d37fe700 1 -- 172.21.15.35:0/267366937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d40ffd20 msgr2=0x7f58d4196780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d37fe700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d40ffd20 0x7f58d4196780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d37fe700 1 -- 172.21.15.35:0/267366937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d41043c0 msgr2=0x7f58d419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d37fe700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d41043c0 0x7f58d419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d37fe700 1 -- 172.21.15.35:0/267366937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc0095f0 con 0x7f58d40ff380 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d37fe700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 0x7f58d4196240 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f58c400e9a0 tx=0x7f58c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d0ff9700 1 -- 172.21.15.35:0/267366937 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4009790 con 0x7f58d40ff380 2023-03-17T12:06:10.301 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d0ff9700 1 -- 172.21.15.35:0/267366937 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c400cbd0 con 0x7f58d40ff380 2023-03-17T12:06:10.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d410eff0 con 0x7f58d40ff380 2023-03-17T12:06:10.302 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d0ff9700 1 -- 172.21.15.35:0/267366937 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4018680 con 0x7f58d40ff380 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.050+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d410ee60 con 0x7f58d40ff380 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.052+0000 7f58d0ff9700 1 -- 172.21.15.35:0/267366937 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f58c400cd40 con 0x7f58d40ff380 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.053+0000 7f58d0ff9700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f58c009f640 0x7f58c00a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.053+0000 7f58d0ff9700 1 -- 172.21.15.35:0/267366937 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f58c4014070 con 0x7f58d40ff380 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.053+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f58c009f640 0x7f58c00a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.053+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f58c009f640 0x7f58c00a1af0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009990 tx=0x7f58bc01a040 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 Processor -- start 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 -- start start 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:10.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:10.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:10.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a4ce070 con 0x56323a5c77d0 2023-03-17T12:06:10.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5209b0 con 0x56323a5cc630 2023-03-17T12:06:10.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58e6109b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a519e40 con 0x56323a5c80e0 2023-03-17T12:06:10.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:12.682 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60056/0 (socket says 172.21.15.35:60056) 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58d37fe700 1 -- 172.21.15.35:0/1706879793 learned_addr learned my addr 172.21.15.35:0/1706879793 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58d3fff700 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.054+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d37fe700 1 -- 172.21.15.35:0/1706879793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 msgr2=0x56323a5cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d37fe700 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d37fe700 1 -- 172.21.15.35:0/1706879793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 msgr2=0x56323a5cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d37fe700 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d37fe700 1 -- 172.21.15.35:0/1706879793 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56323a39b630 con 0x56323a5c77d0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58d37fe700 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5c7ba0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f58c40a0160 tx=0x7f58c4098100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2744e7bb9c8265e server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58c9ffb700 1 -- 172.21.15.35:0/1706879793 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40af070 con 0x56323a5c77d0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58c9ffb700 1 -- 172.21.15.35:0/1706879793 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c40a0690 con 0x56323a5c77d0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.055+0000 7f58c9ffb700 1 -- 172.21.15.35:0/1706879793 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4097990 con 0x56323a5c77d0 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 -- 172.21.15.35:0/1706879793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 msgr2=0x56323a5c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5c7ba0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f58c40a0160 tx=0x7f58c4098100 comp rx=0 tx=0).stop 2023-03-17T12:06:12.683 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 -- 172.21.15.35:0/1706879793 shutdown_connections 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5c7ba0 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1706879793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 -- 172.21.15.35:0/1706879793 >> 172.21.15.35:0/1706879793 conn(0x56323a5c2030 msgr2=0x56323a5c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 -- 172.21.15.35:0/1706879793 shutdown_connections 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 -- 172.21.15.35:0/1706879793 wait complete. 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 -- start start 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.056+0000 7f58e6109b80 1 Processor -- start 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5c77d0 0x56323a5d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 0x56323a5d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a39d920 con 0x56323a5cc630 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5dd8e0 con 0x56323a5c77d0 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5dda20 con 0x56323a5c80e0 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 10 client.0 _ll_register_callbacks cb 0x56323a3bf290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 0x56323a5d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:12.684 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 0x56323a5d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60064/0 (socket says 172.21.15.35:60064) 2023-03-17T12:06:12.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5c77d0 0x56323a5d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:12.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 -- 172.21.15.35:0/1296815531 learned_addr learned my addr 172.21.15.35:0/1296815531 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:12.685 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:16.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 -- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 msgr2=0x56323a5d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:16.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:16.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 -- 172.21.15.35:0/1296815531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5c77d0 msgr2=0x56323a5d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:16.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5c77d0 0x56323a5d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:16.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 -- 172.21.15.35:0/1296815531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d410ee60 con 0x56323a5cc630 2023-03-17T12:06:16.783 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d37fe700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5c77d0 0x56323a5d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58d3fff700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 0x56323a5d1c10 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7f58cc012eb0 tx=0x7f58cc014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f1c52a07c928da server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58b2ffd700 1 -- 172.21.15.35:0/1296815531 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00e040 con 0x56323a5cc630 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58b2ffd700 1 -- 172.21.15.35:0/1296815531 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f58cc014ae0 con 0x56323a5cc630 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.057+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56323a4dc3f0 con 0x56323a5cc630 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58b2ffd700 1 -- 172.21.15.35:0/1296815531 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58cc014ca0 con 0x56323a5cc630 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 10 client.22647 fetch_fsmap learned FSMap version 112 2023-03-17T12:06:16.784 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x56323a347de0 con 0x56323a5cc630 2023-03-17T12:06:21.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58b2ffd700 1 -- 172.21.15.35:0/1296815531 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56323a4dc3f0 con 0x56323a5cc630 2023-03-17T12:06:21.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58b2ffd700 1 -- 172.21.15.35:0/1296815531 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f58cc01c020 con 0x56323a5cc630 2023-03-17T12:06:21.372 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 10 client.22647 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:06:21.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 10 client.22647 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-17T12:06:21.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 20 client.22647 populate_metadata read hostname 'smithi035' 2023-03-17T12:06:21.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a5e1ae0 0x56323a5e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:21.373 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 4 client.22647 mds_command: new command op to 24451 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:06:22.059 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56323a4e8660 con 0x56323a5e1ae0 2023-03-17T12:06:22.059 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.058+0000 7f58d37fe700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a5e1ae0 0x56323a5e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:22.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.059+0000 7f58b2ffd700 10 client.22647 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T12:06:22.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.059+0000 7f58d37fe700 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a5e1ae0 0x56323a5e3ef0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d247bab97d73074 server_cookie=a5928cd5da70ad3d in_seq=0 out_seq=0 2023-03-17T12:06:22.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.059+0000 7f58b2ffd700 1 -- 172.21.15.35:0/1296815531 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x56323a4e8660 con 0x56323a5e1ae0 2023-03-17T12:06:22.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.059+0000 7f58b2ffd700 10 client.22647 handle_command_reply: tid=0 2023-03-17T12:06:22.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 client.22647 shutdown 2023-03-17T12:06:22.060 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 msgr2=0x56323a5d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:23.244 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 0x56323a5d1c10 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7f58cc012eb0 tx=0x7f58cc014600 comp rx=0 tx=0).stop 2023-03-17T12:06:23.244 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 shutdown_connections 2023-03-17T12:06:23.244 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a5e1ae0 0x56323a5e3ef0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:23.244 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5cc630 0x56323a5d1c10 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:23.244 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5c77d0 0x56323a5d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:23.245 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58b2ffd700 0 client.22647 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T12:06:23.245 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 --2- 172.21.15.35:0/1296815531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:23.245 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 >> 172.21.15.35:0/1296815531 conn(0x56323a5c2030 msgr2=0x56323a5c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:23.752 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 shutdown_connections 2023-03-17T12:06:23.752 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 1 -- 172.21.15.35:0/1296815531 wait complete. 2023-03-17T12:06:24.806 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.060+0000 7f58e6109b80 20 client.22647 trim_cache size 0 max 16384 2023-03-17T12:06:25.374 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 Processor -- start 2023-03-17T12:06:25.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 -- start start 2023-03-17T12:06:25.616 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c77d0 0x56323a5c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 0x56323a5d8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5c8940 con 0x56323a5c80e0 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5de540 con 0x56323a5cc630 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58e6109b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5d8d70 con 0x56323a5c77d0 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58d2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 0x56323a5d8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:26.098 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58d2ffd700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 0x56323a5d8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60070/0 (socket says 172.21.15.35:60070) 2023-03-17T12:06:26.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58d2ffd700 1 -- 172.21.15.35:0/753233093 learned_addr learned my addr 172.21.15.35:0/753233093 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:26.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58d37fe700 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c77d0 0x56323a5c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:26.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.073+0000 7f58d3fff700 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:26.505 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d2ffd700 1 -- 172.21.15.35:0/753233093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c77d0 msgr2=0x56323a5c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c77d0 0x56323a5c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d2ffd700 1 -- 172.21.15.35:0/753233093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 msgr2=0x56323a5ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:26.902 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:26.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d2ffd700 1 -- 172.21.15.35:0/753233093 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56323a4e0190 con 0x56323a5c80e0 2023-03-17T12:06:26.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d3fff700 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:06:26.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 0x56323a5d8830 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0099c0 tx=0x7f58bc022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25905c01bb0b439 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:26.903 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58ca7fc700 1 -- 172.21.15.35:0/753233093 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc028030 con 0x56323a5c80e0 2023-03-17T12:06:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58ca7fc700 1 -- 172.21.15.35:0/753233093 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58bc029040 con 0x56323a5c80e0 2023-03-17T12:06:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.074+0000 7f58ca7fc700 1 -- 172.21.15.35:0/753233093 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc01d040 con 0x56323a5c80e0 2023-03-17T12:06:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- 172.21.15.35:0/753233093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 msgr2=0x56323a5d8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 0x56323a5d8830 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0099c0 tx=0x7f58bc022000 comp rx=0 tx=0).stop 2023-03-17T12:06:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- 172.21.15.35:0/753233093 shutdown_connections 2023-03-17T12:06:27.070 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:28.094 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c77d0 0x56323a5c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:29.770 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- 172.21.15.35:0/753233093 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c80e0 0x56323a5d8830 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:30.690 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- 172.21.15.35:0/753233093 >> 172.21.15.35:0/753233093 conn(0x56323a5c2030 msgr2=0x56323a5dde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:30.690 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- 172.21.15.35:0/753233093 shutdown_connections 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- 172.21.15.35:0/753233093 wait complete. 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- start start 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 Processor -- start 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5d6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5d7290 con 0x56323a5c77d0 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5d7400 con 0x56323a5cc630 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.075+0000 7f58e6109b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56323a5d75c0 con 0x56323a5c80e0 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58e6109b80 10 client.0 _ll_register_callbacks cb 0x56323a3bf290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5d8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60074/0 (socket says 172.21.15.35:60074) 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 -- 172.21.15.35:0/4055372794 learned_addr learned my addr 172.21.15.35:0/4055372794 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:30.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:30.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d3fff700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5d6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:30.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 -- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 msgr2=0x56323a5d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:30.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:32.123 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 -- 172.21.15.35:0/4055372794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 msgr2=0x56323a5d6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:34.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5d6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:34.191 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 -- 172.21.15.35:0/4055372794 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d410c7d0 con 0x56323a5c77d0 2023-03-17T12:06:34.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d3fff700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5d6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:06:34.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58d37fe700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5d8380 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f58c4098430 tx=0x7f58c4094890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbaffe5ff0316cb server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:34.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:06:34.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58b2ffd700 1 -- 172.21.15.35:0/4055372794 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40af040 con 0x56323a5c77d0 2023-03-17T12:06:34.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58b2ffd700 1 -- 172.21.15.35:0/4055372794 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(479..479 src has 1..479) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f58c40b6270 con 0x56323a5c77d0 2023-03-17T12:06:34.621 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56323a597240 con 0x56323a5c77d0 2023-03-17T12:06:35.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58b2ffd700 1 -- 172.21.15.35:0/4055372794 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58c40b6430 con 0x56323a5c77d0 2023-03-17T12:06:35.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58e6109b80 10 client.22653 fetch_fsmap learned FSMap version 112 2023-03-17T12:06:35.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.076+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x56323a36e250 con 0x56323a5c77d0 2023-03-17T12:06:35.297 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58b2ffd700 1 -- 172.21.15.35:0/4055372794 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58c407b020 con 0x56323a5c77d0 2023-03-17T12:06:35.298 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58b2ffd700 1 -- 172.21.15.35:0/4055372794 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f58c40a0300 con 0x56323a5c77d0 2023-03-17T12:06:36.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58e6109b80 10 client.22653 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:06:36.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58e6109b80 10 client.22653 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-03-17T12:06:36.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58e6109b80 20 client.22653 populate_metadata read hostname 'smithi035' 2023-03-17T12:06:36.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58e6109b80 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a636890 0x56323a638ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:36.728 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58e6109b80 4 client.22653 mds_command: new command op to 24451 tid=0[{"prefix": "damage ls"}] 2023-03-17T12:06:36.729 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 --> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56323a39df60 con 0x56323a636890 2023-03-17T12:06:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a636890 0x56323a638ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58b2ffd700 10 client.22653 ms_handle_connect on v2:172.21.15.82:6838/2918814393 2023-03-17T12:06:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.077+0000 7f58d2ffd700 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a636890 0x56323a638ca0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=162824f57284a7d8 server_cookie=eaf2ab3997c7ae41 in_seq=0 out_seq=0 2023-03-17T12:06:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58b2ffd700 1 -- 172.21.15.35:0/4055372794 <== mds.1 v2:172.21.15.82:6838/2918814393 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56323a39df60 con 0x56323a636890 2023-03-17T12:06:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58b2ffd700 10 client.22653 handle_command_reply: tid=0 2023-03-17T12:06:37.107 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 client.22653 shutdown 2023-03-17T12:06:37.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 msgr2=0x56323a5d8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:37.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5d8380 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f58c4098430 tx=0x7f58c4094890 comp rx=0 tx=0).stop 2023-03-17T12:06:37.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 shutdown_connections 2023-03-17T12:06:37.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56323a5cc630 0x56323a5d6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:37.108 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:6838/2918814393,v1:172.21.15.82:6839/2918814393] conn(0x56323a636890 0x56323a638ca0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:39.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x56323a5c77d0 0x56323a5d8380 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:39.721 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 --2- 172.21.15.35:0/4055372794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56323a5c80e0 0x56323a5d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:39.724 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58b2ffd700 0 client.22653 ms_handle_reset on v2:172.21.15.82:6838/2918814393 2023-03-17T12:06:42.261 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 >> 172.21.15.35:0/4055372794 conn(0x56323a5c2030 msgr2=0x56323a5c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:42.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 shutdown_connections 2023-03-17T12:06:42.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 1 -- 172.21.15.35:0/4055372794 wait complete. 2023-03-17T12:06:42.262 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58e6109b80 20 client.22653 trim_cache size 0 max 16384 2023-03-17T12:06:42.263 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T12:06:42.266 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f58c009f640 msgr2=0x7f58c00a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f58c009f640 0x7f58c00a1af0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009990 tx=0x7f58bc01a040 comp rx=0 tx=0).stop 2023-03-17T12:06:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 msgr2=0x7f58d4196240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.078+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 0x7f58d4196240 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f58c400e9a0 tx=0x7f58c400ecb0 comp rx=0 tx=0).stop 2023-03-17T12:06:44.449 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 shutdown_connections 2023-03-17T12:06:45.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f58c009f640 0x7f58c00a1af0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:45.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58d41043c0 0x7f58d419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:45.353 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f58d40ff380 0x7f58d4196240 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 --2- 172.21.15.35:0/267366937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58d40ffd20 0x7f58d4196780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 >> 172.21.15.35:0/267366937 conn(0x7f58d4076300 msgr2=0x7f58d4067ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 shutdown_connections 2023-03-17T12:06:47.093 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:05:57.079+0000 7f58d9f7c700 1 -- 172.21.15.35:0/267366937 wait complete. 2023-03-17T12:06:47.094 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-03-17T12:06:47.099 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:57 smithi035 ceph-mon[92535]: from='client.22635 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T12:06:48.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:05:58 smithi035 ceph-mon[92535]: pgmap v6609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:06:48.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:00 smithi035 ceph-mon[92535]: pgmap v6610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:06:48.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:02 smithi035 ceph-mon[92535]: pgmap v6611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T12:06:48.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:04 smithi035 ceph-mon[92535]: pgmap v6612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:06:48.181 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:06 smithi035 ceph-mon[92535]: pgmap v6613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-17T12:06:48.801 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:08 smithi035 ceph-mon[92535]: pgmap v6614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-17T12:06:50.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:10 smithi035 ceph-mon[92535]: pgmap v6615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:06:50.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:10 smithi035 ceph-mon[92535]: osdmap e480: 12 total, 12 up, 12 in 2023-03-17T12:06:50.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:12 smithi035 ceph-mon[92535]: pgmap v6617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:06:50.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:14 smithi035 ceph-mon[92535]: pgmap v6618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:06:50.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:16 smithi035 ceph-mon[92535]: pgmap v6619: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:06:50.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:18 smithi035 ceph-mon[92535]: pgmap v6620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:18 smithi035 ceph-mon[92535]: osdmap e481: 12 total, 12 up, 12 in 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:20 smithi035 ceph-mon[92535]: pgmap v6622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:22 smithi035 ceph-mon[92535]: pgmap v6623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:24 smithi035 ceph-mon[92535]: pgmap v6624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:26 smithi035 ceph-mon[92535]: pgmap v6625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:28 smithi035 ceph-mon[92535]: pgmap v6626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:29 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:30 smithi035 ceph-mon[92535]: pgmap v6627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:30 smithi035 ceph-mon[92535]: pgmap v6628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:30 smithi035 ceph-mon[92535]: pgmap v6629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:31 smithi035 ceph-mon[92535]: pgmap v6630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:34 smithi035 ceph-mon[92535]: pgmap v6631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:35 smithi035 ceph-mon[92535]: pgmap v6632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:06:50.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:37 smithi035 ceph-mon[92535]: pgmap v6633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:06:51.379 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:39 smithi035 ceph-mon[92535]: pgmap v6634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:06:52.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:41 smithi035 ceph-mon[92535]: pgmap v6635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:06:52.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:44 smithi035 ceph-mon[92535]: pgmap v6636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:06:52.911 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:45 smithi035 ceph-mon[92535]: pgmap v6637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:06:52.913 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:47 smithi035 ceph-mon[92535]: pgmap v6638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:06:54.495 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:49 smithi035 ceph-mon[92535]: pgmap v6639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:06:54.496 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:51 smithi035 ceph-mon[92535]: pgmap v6640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:06:54.524 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 -- 172.21.15.35:0/424202010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240ff260 msgr2=0x7f742410b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 --2- 172.21.15.35:0/424202010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240ff260 0x7f742410b6f0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7f741c00b0a0 tx=0x7f741c00b3b0 comp rx=0 tx=0).stop 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 -- 172.21.15.35:0/424202010 shutdown_connections 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 --2- 172.21.15.35:0/424202010 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240ff260 0x7f742410b6f0 unknown :-1 s=CLOSED pgs=2646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 --2- 172.21.15.35:0/424202010 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74241048c0 0x7f7424104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 --2- 172.21.15.35:0/424202010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74240fe8b0 0x7f74240fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 -- 172.21.15.35:0/424202010 >> 172.21.15.35:0/424202010 conn(0x7f74240757a0 msgr2=0x7f7424075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 -- 172.21.15.35:0/424202010 shutdown_connections 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 -- 172.21.15.35:0/424202010 wait complete. 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 Processor -- start 2023-03-17T12:06:55.692 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.051+0000 7f742c282700 1 -- start start 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 0x7f7424196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74240ff260 0x7f7424196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241048c0 0x7f742419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419b2f0 con 0x7f74240fe8b0 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419b460 con 0x7f74240ff260 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419b620 con 0x7f74241048c0 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 0x7f7424196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 0x7f7424196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60088/0 (socket says 172.21.15.35:60088) 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 -- 172.21.15.35:0/1950342022 learned_addr learned my addr 172.21.15.35:0/1950342022 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a81f700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241048c0 0x7f742419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:55.693 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742981d700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74240ff260 0x7f7424196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 -- 172.21.15.35:0/1950342022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241048c0 msgr2=0x7f742419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241048c0 0x7f742419acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 -- 172.21.15.35:0/1950342022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74240ff260 msgr2=0x7f7424196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74240ff260 0x7f7424196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 -- 172.21.15.35:0/1950342022 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c009d00 con 0x7f74240fe8b0 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a81f700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241048c0 0x7f742419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:06:56.251 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742981d700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74240ff260 0x7f7424196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-17T12:06:56.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742a01e700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 0x7f7424196310 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7f741400e970 tx=0x7f741400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:56.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f741b7fe700 1 -- 172.21.15.35:0/1950342022 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414009790 con 0x7f74240fe8b0 2023-03-17T12:06:56.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f741b7fe700 1 -- 172.21.15.35:0/1950342022 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74140044b0 con 0x7f74240fe8b0 2023-03-17T12:06:56.252 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742410efe0 con 0x7f74240fe8b0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.052+0000 7f741b7fe700 1 -- 172.21.15.35:0/1950342022 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414003dd0 con 0x7f74240fe8b0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.053+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742410ee50 con 0x7f74240fe8b0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.055+0000 7f741b7fe700 1 -- 172.21.15.35:0/1950342022 <== mon.0 v2:172.21.15.35:3300/0 4 ==== mgrmap(e 25) v1 ==== 133392+0+0 (secure 0 0 0) 0x7f7414004000 con 0x7f74240fe8b0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.055+0000 7f741b7fe700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f741009f6c0 0x7f74100a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.055+0000 7f741b7fe700 1 -- 172.21.15.35:0/1950342022 <== mon.0 v2:172.21.15.35:3300/0 5 ==== osd_map(481..481 src has 1..481) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7414014070 con 0x7f74240fe8b0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.055+0000 7f742981d700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f741009f6c0 0x7f74100a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.056+0000 7f742981d700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f741009f6c0 0x7f74100a1b70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7420005950 tx=0x7f74200058e0 comp rx=0 tx=0).ready entity=mgr.15318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.056+0000 7f743840fb80 1 Processor -- start 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.056+0000 7f743840fb80 1 -- start start 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f743840fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 0x55cd10a20ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f743840fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:57.539 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f743840fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a25630 0x55cd10a25a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f743840fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10927070 con 0x55cd10a207d0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f743840fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd109799b0 con 0x55cd10a25630 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f743840fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10972e40 con 0x55cd10a210e0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 0x55cd10a20ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 0x55cd10a20ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60096/0 (socket says 172.21.15.35:60096) 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 -- 172.21.15.35:0/2343309975 learned_addr learned my addr 172.21.15.35:0/2343309975 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742981d700 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a81f700 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a25630 0x55cd10a25a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 -- 172.21.15.35:0/2343309975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 msgr2=0x55cd10a250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 -- 172.21.15.35:0/2343309975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a25630 msgr2=0x55cd10a25a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a25630 0x55cd10a25a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 -- 172.21.15.35:0/2343309975 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd107f4630 con 0x55cd10a207d0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f742a01e700 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 0x55cd10a20ba0 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f74140a0140 tx=0x7f7414098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9e4b584450c53a server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.057+0000 7f7418dae700 1 -- 172.21.15.35:0/2343309975 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414098480 con 0x55cd10a207d0 2023-03-17T12:06:57.540 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f7418dae700 1 -- 172.21.15.35:0/2343309975 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74140a0670 con 0x55cd10a207d0 2023-03-17T12:06:57.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f7418dae700 1 -- 172.21.15.35:0/2343309975 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414094b90 con 0x55cd10a207d0 2023-03-17T12:06:57.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 -- 172.21.15.35:0/2343309975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 msgr2=0x55cd10a20ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:06:57.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 0x55cd10a20ba0 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f74140a0140 tx=0x7f7414098040 comp rx=0 tx=0).stop 2023-03-17T12:06:57.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 -- 172.21.15.35:0/2343309975 shutdown_connections 2023-03-17T12:06:57.541 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a25630 0x55cd10a25a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:58.156 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a207d0 0x55cd10a20ba0 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 --2- 172.21.15.35:0/2343309975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 -- 172.21.15.35:0/2343309975 >> 172.21.15.35:0/2343309975 conn(0x55cd10a1b030 msgr2=0x55cd10a1b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 -- 172.21.15.35:0/2343309975 shutdown_connections 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.058+0000 7f743840fb80 1 -- 172.21.15.35:0/2343309975 wait complete. 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 -- start start 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 Processor -- start 2023-03-17T12:06:58.157 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a207d0 0x55cd10a2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:06:59.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a210e0 0x55cd10a2a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:01.019 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a2ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd107f6920 con 0x55cd10a25630 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a2d230 con 0x55cd10a210e0 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a368e0 con 0x55cd10a207d0 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f743840fb80 10 client.0 _ll_register_callbacks cb 0x55cd10818290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f742a81f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a2ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f742a81f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a2ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60106/0 (socket says 172.21.15.35:60106) 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f742a81f700 1 -- 172.21.15.35:0/2901361465 learned_addr learned my addr 172.21.15.35:0/2901361465 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f742a01e700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a207d0 0x55cd10a2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.059+0000 7f742981d700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a210e0 0x55cd10a2a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f742a81f700 1 -- 172.21.15.35:0/2901361465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a207d0 msgr2=0x55cd10a2a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f742a81f700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a207d0 0x55cd10a2a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f742a81f700 1 -- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a210e0 msgr2=0x55cd10a2a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:07:01.020 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f742a81f700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a210e0 0x55cd10a2a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:01.021 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f742a81f700 1 -- 172.21.15.35:0/2901361465 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742410ee50 con 0x55cd10a25630 2023-03-17T12:07:01.021 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f742a81f700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a2ab10 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f741c015000 tx=0x7f741c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1764c5c1d453c9ba server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:07:01.021 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f740dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:07:01.021 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f740dffb700 1 -- 172.21.15.35:0/2901361465 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c00e040 con 0x55cd10a25630 2023-03-17T12:07:01.021 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f740dffb700 1 -- 172.21.15.35:0/2901361465 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(481..481 src has 1..481) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f741c0076e0 con 0x55cd10a25630 2023-03-17T12:07:01.021 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd109353f0 con 0x55cd10a25630 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f740dffb700 1 -- 172.21.15.35:0/2901361465 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f741c0078e0 con 0x55cd10a25630 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f743840fb80 10 client.22665 fetch_fsmap learned FSMap version 112 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.060+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55cd107a0de0 con 0x55cd10a25630 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f740dffb700 1 -- 172.21.15.35:0/2901361465 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd109353f0 con 0x55cd10a25630 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f740dffb700 1 -- 172.21.15.35:0/2901361465 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f741c024030 con 0x55cd10a25630 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f743840fb80 10 client.22665 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f743840fb80 10 client.22665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f743840fb80 20 client.22665 populate_metadata read hostname 'smithi035' 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f743840fb80 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a3aa20 0x55cd10a3ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f743840fb80 4 client.22665 mds_command: new command op to 24452 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd10941660 con 0x55cd10a3aa20 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f742a01e700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a3aa20 0x55cd10a3ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f740dffb700 10 client.22665 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:07:03.080 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.061+0000 7f742a01e700 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a3aa20 0x55cd10a3ce30 crc :-1 s=READY pgs=894 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=985b42323d4361ec server_cookie=caadde528f09dbbc in_seq=0 out_seq=0 2023-03-17T12:07:03.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f740dffb700 1 -- 172.21.15.35:0/2901361465 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55cd10941660 con 0x55cd10a3aa20 2023-03-17T12:07:03.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f740dffb700 10 client.22665 handle_command_reply: tid=0 2023-03-17T12:07:03.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 client.22665 shutdown 2023-03-17T12:07:03.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 msgr2=0x55cd10a2ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:07:03.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a2ab10 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f741c015000 tx=0x7f741c007f90 comp rx=0 tx=0).stop 2023-03-17T12:07:03.081 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 shutdown_connections 2023-03-17T12:07:04.102 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a3aa20 0x55cd10a3ce30 crc :-1 s=READY pgs=894 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:04.103 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a2ab10 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:04.103 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f740dffb700 0 client.22665 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:07:04.103 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a207d0 0x55cd10a2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:04.103 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 --2- 172.21.15.35:0/2901361465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a210e0 0x55cd10a2a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:04.103 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 >> 172.21.15.35:0/2901361465 conn(0x55cd10a1b030 msgr2=0x55cd10a1a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:07:05.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 shutdown_connections 2023-03-17T12:07:05.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 1 -- 172.21.15.35:0/2901361465 wait complete. 2023-03-17T12:07:05.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.062+0000 7f743840fb80 20 client.22665 trim_cache size 0 max 16384 2023-03-17T12:07:05.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 Processor -- start 2023-03-17T12:07:05.564 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 -- start start 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a2a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a23750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a13660 con 0x55cd10a25630 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a17b40 con 0x55cd10a207d0 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f743840fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a17cb0 con 0x55cd10a210e0 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f742a81f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a23750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f742a81f700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a23750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60114/0 (socket says 172.21.15.35:60114) 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f742a81f700 1 -- 172.21.15.35:0/527359020 learned_addr learned my addr 172.21.15.35:0/527359020 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.076+0000 7f742a01e700 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742981d700 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a2a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742a81f700 1 -- 172.21.15.35:0/527359020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 msgr2=0x55cd10a2a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742a81f700 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a2a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:05.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742a81f700 1 -- 172.21.15.35:0/527359020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 msgr2=0x55cd10a1a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:07:06.597 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742a81f700 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a1a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:07.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742a81f700 1 -- 172.21.15.35:0/527359020 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd10939190 con 0x55cd10a25630 2023-03-17T12:07:07.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f742a81f700 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a23750 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f741c0057c0 tx=0x7f741c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ece1e74c12bc29b server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:07:07.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f74195af700 1 -- 172.21.15.35:0/527359020 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c00e040 con 0x55cd10a25630 2023-03-17T12:07:07.565 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f74195af700 1 -- 172.21.15.35:0/527359020 <== mon.0 v2:172.21.15.35:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f741c00b700 con 0x55cd10a25630 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f74195af700 1 -- 172.21.15.35:0/527359020 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c004f10 con 0x55cd10a25630 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f743840fb80 1 -- 172.21.15.35:0/527359020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 msgr2=0x55cd10a23750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.077+0000 7f743840fb80 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a23750 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f741c0057c0 tx=0x7f741c00b3b0 comp rx=0 tx=0).stop 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- 172.21.15.35:0/527359020 shutdown_connections 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a25630 0x55cd10a23750 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a1a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 --2- 172.21.15.35:0/527359020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a210e0 0x55cd10a2a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- 172.21.15.35:0/527359020 >> 172.21.15.35:0/527359020 conn(0x55cd10a1b030 msgr2=0x55cd10a36d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:07:09.590 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- 172.21.15.35:0/527359020 shutdown_connections 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- 172.21.15.35:0/527359020 wait complete. 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- start start 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 Processor -- start 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a8bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 0x55cd10a8c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a25630 0x55cd10a86340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a86920 con 0x55cd10a210e0 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a86a90 con 0x55cd10a207d0 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10a86c50 con 0x55cd10a25630 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f743840fb80 10 client.0 _ll_register_callbacks cb 0x55cd10818290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f742981d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 0x55cd10a8c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f742981d700 1 --2- >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 0x55cd10a8c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.35:3300/0 says I am v2:172.21.15.35:60118/0 (socket says 172.21.15.35:60118) 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.078+0000 7f742981d700 1 -- 172.21.15.35:0/2999364182 learned_addr learned my addr 172.21.15.35:0/2999364182 (peer_addr_for_me v2:172.21.15.35:0/0) 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742a01e700 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a8bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:09.591 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742981d700 1 -- 172.21.15.35:0/2999364182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a25630 msgr2=0x55cd10a86340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:07:09.592 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742981d700 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a25630 0x55cd10a86340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:09.592 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742981d700 1 -- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 msgr2=0x55cd10a8bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-17T12:07:09.592 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742981d700 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a8bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:09.592 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742981d700 1 -- 172.21.15.35:0/2999364182 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd107a0de0 con 0x55cd10a210e0 2023-03-17T12:07:09.592 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f742981d700 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 0x55cd10a8c4e0 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f742000b5d0 tx=0x7f7420004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4582cc6f066d32fc server_cookie=0 in_seq=0 out_seq=0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f740dffb700 10 client.0 ms_handle_connect on v2:172.21.15.35:3300/0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f740dffb700 1 -- 172.21.15.35:0/2999364182 <== mon.0 v2:172.21.15.35:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420017040 con 0x55cd10a210e0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f740dffb700 1 -- 172.21.15.35:0/2999364182 <== mon.0 v2:172.21.15.35:3300/0 2 ==== osd_map(481..481 src has 1..481) v4 ==== 8455+0+0 (secure 0 0 0) 0x7f7420003a90 con 0x55cd10a210e0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd109f0240 con 0x55cd10a210e0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f740dffb700 1 -- 172.21.15.35:0/2999364182 <== mon.0 v2:172.21.15.35:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7420003c50 con 0x55cd10a210e0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f743840fb80 10 client.22671 fetch_fsmap learned FSMap version 112 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 --> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55cd107c7250 con 0x55cd10a210e0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.079+0000 7f740dffb700 1 -- 172.21.15.35:0/2999364182 <== mon.0 v2:172.21.15.35:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd109f0240 con 0x55cd10a210e0 2023-03-17T12:07:11.461 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f740dffb700 1 -- 172.21.15.35:0/2999364182 <== mon.0 v2:172.21.15.35:3300/0 5 ==== fsmap(e 112) v1 ==== 6917+0+0 (secure 0 0 0) 0x7f7420011440 con 0x55cd10a210e0 2023-03-17T12:07:12.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f743840fb80 10 client.22671 fetch_fsmap finished waiting for FSMap version 112 2023-03-17T12:07:12.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f743840fb80 10 client.22671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-03-17T12:07:12.456 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f743840fb80 20 client.22671 populate_metadata read hostname 'smithi035' 2023-03-17T12:07:13.875 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f743840fb80 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a93f10 0x55cd10a96320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-17T12:07:13.875 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f743840fb80 4 client.22671 mds_command: new command op to 24452 tid=0[{"prefix": "damage ls"}] 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 --> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cd107f6f60 con 0x55cd10a93f10 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f742a01e700 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a93f10 0x55cd10a96320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f740dffb700 10 client.22671 ms_handle_connect on v2:172.21.15.78:6838/3357054531 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.080+0000 7f742a01e700 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a93f10 0x55cd10a96320 crc :-1 s=READY pgs=895 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44dd555b2ae171f server_cookie=b875ff2db3b317b3 in_seq=0 out_seq=0 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f740dffb700 1 -- 172.21.15.35:0/2999364182 <== mds.0 v2:172.21.15.78:6838/3357054531 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cd107f6f60 con 0x55cd10a93f10 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f740dffb700 10 client.22671 handle_command_reply: tid=0 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 client.22671 shutdown 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 msgr2=0x55cd10a8c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 0x55cd10a8c4e0 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f742000b5d0 tx=0x7f7420004750 comp rx=0 tx=0).stop 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 shutdown_connections 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:6838/3357054531,v1:172.21.15.78:6839/3357054531] conn(0x55cd10a93f10 0x55cd10a96320 crc :-1 s=READY pgs=895 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cd10a25630 0x55cd10a86340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cd10a207d0 0x55cd10a8bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:13.876 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f740dffb700 0 client.22671 ms_handle_reset on v2:172.21.15.78:6838/3357054531 2023-03-17T12:07:13.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 --2- 172.21.15.35:0/2999364182 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x55cd10a210e0 0x55cd10a8c4e0 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:13.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 >> 172.21.15.35:0/2999364182 conn(0x55cd10a1b030 msgr2=0x55cd10a1a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:07:13.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 shutdown_connections 2023-03-17T12:07:13.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 1 -- 172.21.15.35:0/2999364182 wait complete. 2023-03-17T12:07:13.877 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f743840fb80 20 client.22671 trim_cache size 0 max 16384 2023-03-17T12:07:13.878 INFO:teuthology.orchestra.run.smithi035.stdout:[] 2023-03-17T12:07:13.881 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f741009f6c0 msgr2=0x7f74100a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f741009f6c0 0x7f74100a1b70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7420005950 tx=0x7f74200058e0 comp rx=0 tx=0).stop 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 msgr2=0x7f7424196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 0x7f7424196310 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7f741400e970 tx=0x7f741400ed30 comp rx=0 tx=0).stop 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 shutdown_connections 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:6800/1224511514,v1:172.21.15.35:6801/1224511514] conn(0x7f741009f6c0 0x7f74100a1b70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241048c0 0x7f742419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:16.382 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.35:3300/0,v1:172.21.15.35:6789/0] conn(0x7f74240fe8b0 0x7f7424196310 unknown :-1 s=CLOSED pgs=2647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:16.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 --2- 172.21.15.35:0/1950342022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74240ff260 0x7f7424196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-17T12:07:16.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.081+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 >> 172.21.15.35:0/1950342022 conn(0x7f74240757a0 msgr2=0x7f74240fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-17T12:07:16.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.082+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 shutdown_connections 2023-03-17T12:07:16.383 INFO:teuthology.orchestra.run.smithi035.stderr:2023-03-17T12:06:53.082+0000 7f742c282700 1 -- 172.21.15.35:0/1950342022 wait complete. 2023-03-17T12:07:16.387 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:54 smithi035 ceph-mon[92535]: pgmap v6641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:07:18.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:55 smithi035 ceph-mon[92535]: pgmap v6642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:07:18.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:57 smithi035 ceph-mon[92535]: pgmap v6643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:07:18.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:06:59 smithi035 ceph-mon[92535]: pgmap v6644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:07:18.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:01 smithi035 ceph-mon[92535]: pgmap v6645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:07:18.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:04 smithi035 ceph-mon[92535]: pgmap v6646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:07:18.309 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:05 smithi035 ceph-mon[92535]: pgmap v6647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:07:18.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:07 smithi035 ceph-mon[92535]: pgmap v6648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:07:18.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:10 smithi035 ceph-mon[92535]: osdmap e482: 12 total, 12 up, 12 in 2023-03-17T12:07:18.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:10 smithi035 ceph-mon[92535]: pgmap v6650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:07:18.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:11 smithi035 ceph-mon[92535]: pgmap v6651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:07:18.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:14 smithi035 ceph-mon[92535]: pgmap v6652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:07:18.310 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:15 smithi035 ceph-mon[92535]: pgmap v6653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:07:18.310 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2023-03-17T12:07:18.311 INFO:tasks.fwd_scrub:done joining 2023-03-17T12:07:18.311 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-03-17T12:07:18.325 DEBUG:tasks.check_counter:Getting stats from a 2023-03-17T12:07:20.507 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph daemon mds.a perf dump 2023-03-17T12:07:20.509 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:17 smithi035 ceph-mon[92535]: pgmap v6654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:07:21.694 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:19 smithi035 ceph-mon[92535]: osdmap e483: 12 total, 12 up, 12 in 2023-03-17T12:07:21.696 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:20 smithi035 ceph-mon[92535]: pgmap v6656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:07:21.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:21 smithi035 ceph-mon[92535]: pgmap v6657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:07:24.797 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-0": { 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 18707, 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 18613, 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 79382302, 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 6725956, 2023-03-17T12:07:24.799 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 17, 2023-03-17T12:07:25.804 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 3, 2023-03-17T12:07:25.804 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 2.539569401, 2023-03-17T12:07:25.804 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.832371954, 2023-03-17T12:07:25.804 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.679992183, 2023-03-17T12:07:26.634 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.784781315, 2023-03-17T12:07:26.634 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:07:26.634 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 18612, 2023-03-17T12:07:26.634 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 1.029005722, 2023-03-17T12:07:26.634 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000055287 2023-03-17T12:07:26.634 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 3253472, 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 2218944 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-1": { 2023-03-17T12:07:29.078 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 25967, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 28810, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 119817330, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 13871426, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 30, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 5, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 2.592863005, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.761448625, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.639764720, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.964361564, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 28808, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 1.232674371, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000042789 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:29.079 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 4832, 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 5800608 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-2": { 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 689, 2023-03-17T12:07:29.080 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 691, 2023-03-17T12:07:31.628 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 88261703, 2023-03-17T12:07:31.628 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 214291, 2023-03-17T12:07:31.628 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 50, 2023-03-17T12:07:31.628 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 4, 2023-03-17T12:07:31.628 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 0.133765627, 2023-03-17T12:07:31.628 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.014108091, 2023-03-17T12:07:31.629 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.091155429, 2023-03-17T12:07:31.629 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.020423292, 2023-03-17T12:07:31.629 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 689, 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.025829322, 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000037488 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:32.583 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:33.529 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 0, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 0 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "cct": { 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "total_workers": 1, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "unhealthy_workers": 0 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "finisher-MDSRank": { 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "queue_len": 0, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "complete_latency": { 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 69331, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 2.361910708, 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000034067 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:07:33.530 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:36.776 INFO:teuthology.orchestra.run.smithi035.stdout: "finisher-PurgeQueue": { 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "queue_len": 0, 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "complete_latency": { 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "mds": { 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "request": 0, 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "reply": 0, 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "reply_latency": { 2023-03-17T12:07:36.777 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:36.778 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:36.778 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:36.778 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:36.778 INFO:teuthology.orchestra.run.smithi035.stdout: "slow_reply": 0, 2023-03-17T12:07:36.778 INFO:teuthology.orchestra.run.smithi035.stdout: "forward": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_fetch_complete": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_fetch_keys": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_commit": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_split": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_merge": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes": 9673, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_top": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_bottom": 0, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_pin_tail": 9673, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_pinned": 9673, 2023-03-17T12:07:36.779 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_expired": 0, 2023-03-17T12:07:38.504 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_with_caps": 0, 2023-03-17T12:07:38.504 INFO:teuthology.orchestra.run.smithi035.stdout: "caps": 0, 2023-03-17T12:07:38.504 INFO:teuthology.orchestra.run.smithi035.stdout: "subtrees": 1, 2023-03-17T12:07:38.505 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse": 0, 2023-03-17T12:07:38.505 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_hit": 0, 2023-03-17T12:07:39.389 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_forward": 0, 2023-03-17T12:07:39.389 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_discover": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_dir_fetch": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_remote_ino": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_lock": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "load_cent": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "q": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "exported": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "exported_inodes": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "imported": 0, 2023-03-17T12:07:40.104 INFO:teuthology.orchestra.run.smithi035.stdout: "imported_inodes": 0, 2023-03-17T12:07:40.747 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_dir_fetch": 0, 2023-03-17T12:07:40.747 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_backtrace_fetch": 0, 2023-03-17T12:07:43.310 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_peer_discover": 0, 2023-03-17T12:07:43.311 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rfiles": 0, 2023-03-17T12:07:43.311 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rbytes": 0, 2023-03-17T12:07:43.311 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rsnaps": 0, 2023-03-17T12:07:43.311 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_backtrace_fetch": 0, 2023-03-17T12:07:43.984 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_set_tag": 0, 2023-03-17T12:07:43.984 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_backtrace_repaired": 0, 2023-03-17T12:07:43.984 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_inotable_repaired": 0, 2023-03-17T12:07:43.984 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dir_inodes": 0, 2023-03-17T12:07:43.985 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dir_base_inodes": 0, 2023-03-17T12:07:45.221 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dirfrag_rstats": 0, 2023-03-17T12:07:45.222 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_file_inodes": 0, 2023-03-17T12:07:46.843 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_inode_file_caps": 0, 2023-03-17T12:07:46.846 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_revoke": 0, 2023-03-17T12:07:48.373 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_grant": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_trunc": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_flush_ack": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_caps": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_caps_dirty": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_cap_release": 0, 2023-03-17T12:07:48.374 INFO:teuthology.orchestra.run.smithi035.stdout: "process_request_cap_release": 0 2023-03-17T12:07:48.375 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:48.375 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache": { 2023-03-17T12:07:48.375 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_update": 0, 2023-03-17T12:07:48.375 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_update_receipt": 0, 2023-03-17T12:07:49.643 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_try_discover": 0, 2023-03-17T12:07:49.644 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_send_discover": 0, 2023-03-17T12:07:49.644 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_handle_discover": 0, 2023-03-17T12:07:49.644 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays": 0, 2023-03-17T12:07:49.644 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays_delayed": 0, 2023-03-17T12:07:50.269 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays_enqueuing": 0, 2023-03-17T12:07:50.269 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_created": 0, 2023-03-17T12:07:51.420 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_enqueued": 0, 2023-03-17T12:07:51.420 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_reintegrated": 0, 2023-03-17T12:07:51.420 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_migrated": 0, 2023-03-17T12:07:51.420 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_processing": 0, 2023-03-17T12:07:51.420 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_enqueued": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_prioritized": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "recovery_started": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "recovery_completed": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_enqueue_scrub": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_exportdir": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_flush": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_fragmentdir": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_fragstats": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_inodestats": 0 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log": { 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "evadd": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "evex": 0, 2023-03-17T12:07:54.553 INFO:teuthology.orchestra.run.smithi035.stdout: "evtrm": 0, 2023-03-17T12:07:54.554 INFO:teuthology.orchestra.run.smithi035.stdout: "ev": 0, 2023-03-17T12:07:54.554 INFO:teuthology.orchestra.run.smithi035.stdout: "evexg": 0, 2023-03-17T12:07:55.805 INFO:teuthology.orchestra.run.smithi035.stdout: "evexd": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "segadd": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "segex": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "segtrm": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "seg": 76, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "segexg": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "segexd": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "expos": 4194304, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "wrpos": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "rdpos": 276778287, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "jlat": { 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: "replayed": 48756 2023-03-17T12:07:55.806 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_mem": { 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "ino": 1588, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "ino+": 9761, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "ino-": 8173, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "dir": 59, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "dir+": 101, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "dir-": 42, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "dn": 9673, 2023-03-17T12:07:55.807 INFO:teuthology.orchestra.run.smithi035.stdout: "dn+": 10120, 2023-03-17T12:07:57.510 INFO:teuthology.orchestra.run.smithi035.stdout: "dn-": 447, 2023-03-17T12:07:57.510 INFO:teuthology.orchestra.run.smithi035.stdout: "cap": 0, 2023-03-17T12:07:57.510 INFO:teuthology.orchestra.run.smithi035.stdout: "cap+": 0, 2023-03-17T12:07:57.510 INFO:teuthology.orchestra.run.smithi035.stdout: "cap-": 0, 2023-03-17T12:07:57.510 INFO:teuthology.orchestra.run.smithi035.stdout: "rss": 67040, 2023-03-17T12:07:57.510 INFO:teuthology.orchestra.run.smithi035.stdout: "heap": 207156 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_server": { 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: "dispatch_client_request": 0, 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: "dispatch_server_request": 0, 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_request": 0, 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_session": 0, 2023-03-17T12:07:57.511 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_peer_request": 0, 2023-03-17T12:07:58.776 INFO:teuthology.orchestra.run.smithi035.stdout: "req_create_latency": { 2023-03-17T12:07:58.776 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:58.776 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:58.776 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:58.776 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:07:58.776 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getattr_latency": { 2023-03-17T12:07:59.996 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:07:59.996 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:07:59.996 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:07:59.996 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:01.259 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getfilelock_latency": { 2023-03-17T12:08:01.260 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:01.260 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:01.262 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:02.647 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:02.647 INFO:teuthology.orchestra.run.smithi035.stdout: "req_link_latency": { 2023-03-17T12:08:03.370 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookup_latency": { 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookuphash_latency": { 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:03.371 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupino_latency": { 2023-03-17T12:08:03.372 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:03.372 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:03.372 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:03.372 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:03.372 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupname_latency": { 2023-03-17T12:08:03.372 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupparent_latency": { 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:04.653 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupsnap_latency": { 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lssnap_latency": { 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mkdir_latency": { 2023-03-17T12:08:05.818 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mknod_latency": { 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mksnap_latency": { 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:05.819 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:05.820 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:05.820 INFO:teuthology.orchestra.run.smithi035.stdout: "req_open_latency": { 2023-03-17T12:08:06.367 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:07.359 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:07.870 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:08.718 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:08.718 INFO:teuthology.orchestra.run.smithi035.stdout: "req_readdir_latency": { 2023-03-17T12:08:08.719 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rename_latency": { 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "req_renamesnap_latency": { 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:10.254 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmdir_latency": { 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmsnap_latency": { 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:13.123 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:13.124 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:13.124 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:13.124 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmxattr_latency": { 2023-03-17T12:08:13.124 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:13.124 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:13.124 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setattr_latency": { 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setdirlayout_latency": { 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:15.567 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:16.389 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:18.169 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:18.169 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setfilelock_latency": { 2023-03-17T12:08:18.169 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setlayout_latency": { 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:19.458 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setxattr_latency": { 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "req_symlink_latency": { 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:21.770 INFO:teuthology.orchestra.run.smithi035.stdout: "req_unlink_latency": { 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "cap_revoke_eviction": 0, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "cap_acquisition_throttle": 0, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getvxattr_latency": { 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_sessions": { 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "session_count": 2, 2023-03-17T12:08:21.771 INFO:teuthology.orchestra.run.smithi035.stdout: "session_add": 4, 2023-03-17T12:08:21.772 INFO:teuthology.orchestra.run.smithi035.stdout: "session_remove": 2, 2023-03-17T12:08:21.772 INFO:teuthology.orchestra.run.smithi035.stdout: "sessions_open": 2, 2023-03-17T12:08:21.772 INFO:teuthology.orchestra.run.smithi035.stdout: "sessions_stale": 0, 2023-03-17T12:08:21.772 INFO:teuthology.orchestra.run.smithi035.stdout: "total_load": 0, 2023-03-17T12:08:23.359 INFO:teuthology.orchestra.run.smithi035.stdout: "average_load": 0, 2023-03-17T12:08:23.359 INFO:teuthology.orchestra.run.smithi035.stdout: "avg_session_uptime": 26537 2023-03-17T12:08:23.359 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "mempool": { 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bloom_filter_bytes": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bloom_filter_items": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_bytes": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_items": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_data_bytes": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_data_items": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_onode_bytes": 0, 2023-03-17T12:08:23.360 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_onode_items": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_bytes": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_items": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_other_bytes": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_other_items": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_buffer_bytes": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_buffer_items": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_bytes": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_items": 0, 2023-03-17T12:08:23.361 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blob_bytes": 0, 2023-03-17T12:08:24.176 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blob_items": 0, 2023-03-17T12:08:24.176 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_shared_blob_bytes": 0, 2023-03-17T12:08:24.177 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_shared_blob_items": 0, 2023-03-17T12:08:24.177 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_inline_bl_bytes": 0, 2023-03-17T12:08:24.177 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_inline_bl_items": 0, 2023-03-17T12:08:24.177 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_bytes": 0, 2023-03-17T12:08:24.177 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_items": 0, 2023-03-17T12:08:24.177 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_txc_bytes": 0, 2023-03-17T12:08:26.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_txc_items": 0, 2023-03-17T12:08:27.523 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_deferred_bytes": 0, 2023-03-17T12:08:27.523 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_deferred_items": 0, 2023-03-17T12:08:27.523 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_bytes": 0, 2023-03-17T12:08:27.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_items": 0, 2023-03-17T12:08:27.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_bytes": 0, 2023-03-17T12:08:27.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_items": 0, 2023-03-17T12:08:27.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_reader_bytes": 0, 2023-03-17T12:08:27.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_reader_items": 0, 2023-03-17T12:08:27.524 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_writer_bytes": 0, 2023-03-17T12:08:28.755 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_writer_items": 0, 2023-03-17T12:08:28.755 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_anon_bytes": 240672, 2023-03-17T12:08:28.755 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_anon_items": 80, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_meta_bytes": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_meta_items": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bytes": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_items": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mapbl_bytes": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mapbl_items": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pglog_bytes": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pglog_items": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_bytes": 7840, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_items": 163, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_mapping_bytes": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_mapping_items": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "pgmap_bytes": 0, 2023-03-17T12:08:28.756 INFO:teuthology.orchestra.run.smithi035.stdout: "pgmap_items": 0, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_co_bytes": 10405726, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_co_items": 46569, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_1_bytes": 0, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_1_items": 0, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_2_bytes": 0, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_2_items": 0 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter": { 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_active": 0, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_laggy": 0, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_send": 41132, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_send_bytes": 21, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_resend": 3, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_reply": 41132, 2023-03-17T12:08:28.757 INFO:teuthology.orchestra.run.smithi035.stdout: "op_latency": { 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 41132, 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 26.723448999, 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000649699 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "op_inflight": 0, 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "oplen_avg": { 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 41132, 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 41133 2023-03-17T12:08:28.758 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:29.392 INFO:teuthology.orchestra.run.smithi035.stdout: "op": 41132, 2023-03-17T12:08:29.392 INFO:teuthology.orchestra.run.smithi035.stdout: "op_r": 41132, 2023-03-17T12:08:29.392 INFO:teuthology.orchestra.run.smithi035.stdout: "op_w": 0, 2023-03-17T12:08:29.392 INFO:teuthology.orchestra.run.smithi035.stdout: "op_rmw": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "op_pg": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_stat": 26404, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_create": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_read": 14726, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_write": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_writefull": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_writesame": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_append": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_zero": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_truncate": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_delete": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_mapext": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_sparse_read": 0, 2023-03-17T12:08:30.506 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_clonerange": 0, 2023-03-17T12:08:32.014 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_getxattr": 1, 2023-03-17T12:08:32.014 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_setxattr": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_cmpxattr": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_rmxattr": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_resetxattrs": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_call": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_watch": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_notify": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_src_cmpxattr": 0, 2023-03-17T12:08:32.015 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_pgls": 0, 2023-03-17T12:08:32.016 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_pgls_filter": 0, 2023-03-17T12:08:32.016 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_other": 0, 2023-03-17T12:08:32.016 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_active": 0, 2023-03-17T12:08:32.016 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_send": 0, 2023-03-17T12:08:32.016 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_resend": 0, 2023-03-17T12:08:32.016 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_ping": 0, 2023-03-17T12:08:33.704 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_active": 0, 2023-03-17T12:08:33.704 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_send": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_resend": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_active": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_send": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_resend": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_active": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_send": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_resend": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "command_active": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "command_send": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "command_resend": 0, 2023-03-17T12:08:33.705 INFO:teuthology.orchestra.run.smithi035.stdout: "map_epoch": 483, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "map_full": 0, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "map_inc": 392, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_sessions": 11, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_session_open": 76, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_session_close": 65, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_laggy": 0, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_wr": 0, 2023-03-17T12:08:34.655 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_rd": 2, 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_del": 0 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "oft": { 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_objs": 0, 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_kv_pairs": 0, 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_updates": 0, 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_removes": 0 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "osd-slow-ops": { 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: "slow_ops_count": 0 2023-03-17T12:08:36.231 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "purge_queue": { 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_ops": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_ops_high_water": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_high_water": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executed": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_item_in_journal": 0 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 104857600, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 45359, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 283159787, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 45359, 2023-03-17T12:08:36.232 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:08:36.233 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:08:36.233 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 45359, 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 283159787, 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-objecter_bytes": { 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:08:38.952 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 104857600, 2023-03-17T12:08:38.953 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:08:40.146 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:08:40.146 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:08:40.146 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:08:40.146 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:08:40.147 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 41132, 2023-03-17T12:08:40.147 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 272602435, 2023-03-17T12:08:40.147 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 41132, 2023-03-17T12:08:40.147 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 272602435, 2023-03-17T12:08:43.137 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:08:43.137 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:43.137 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:44.068 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:44.068 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:44.068 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:44.068 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-objecter_ops": { 2023-03-17T12:08:44.068 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:08:45.141 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 1024, 2023-03-17T12:08:45.141 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:08:48.179 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:08:48.179 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:08:48.179 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:08:48.179 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:08:48.179 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 41132, 2023-03-17T12:08:54.274 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 41132, 2023-03-17T12:08:54.274 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 41132, 2023-03-17T12:08:54.274 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 41132, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-write_buf_throttle": { 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 3758096384, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:08:54.275 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-write_buf_throttle-0x560f1a5ac0a0": { 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 3758096384, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:08:54.276 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:08:56.934 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:08:56.934 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:08:57.679 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 0, 2023-03-17T12:08:57.679 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 0, 2023-03-17T12:08:57.679 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:08:57.679 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:08:57.679 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:08:57.680 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:08:57.680 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:57.680 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:08:57.680 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T12:08:57.681 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-03-17T12:08:58.189 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-03-17T12:08:58.189 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-03-17T12:08:58.189 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-03-17T12:08:58.189 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-03-17T12:08:59.474 DEBUG:tasks.check_counter:Getting stats from d 2023-03-17T12:08:59.475 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph daemon mds.d perf dump 2023-03-17T12:08:59.485 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:24 smithi035 ceph-mon[92535]: pgmap v6658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:03.289 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:25 smithi035 ceph-mon[92535]: pgmap v6659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:27 smithi035 ceph-mon[92535]: pgmap v6660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:29 smithi035 ceph-mon[92535]: pgmap v6661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:30 smithi035 ceph-mon[92535]: pgmap v6662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:30 smithi035 ceph-mon[92535]: pgmap v6663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:30 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:33 smithi035 ceph-mon[92535]: pgmap v6664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:35 smithi035 ceph-mon[92535]: pgmap v6665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:37 smithi035 ceph-mon[92535]: pgmap v6666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:09:03.290 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:39 smithi035 ceph-mon[92535]: pgmap v6667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:05.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:41 smithi035 ceph-mon[92535]: pgmap v6668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:09:05.183 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:43 smithi035 ceph-mon[92535]: pgmap v6669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:45 smithi035 ceph-mon[92535]: pgmap v6670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:47 smithi035 ceph-mon[92535]: pgmap v6671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:49 smithi035 ceph-mon[92535]: pgmap v6672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:51 smithi035 ceph-mon[92535]: pgmap v6673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:53 smithi035 ceph-mon[92535]: pgmap v6674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:55 smithi035 ceph-mon[92535]: pgmap v6675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:57 smithi035 ceph-mon[92535]: pgmap v6676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:07:59 smithi035 ceph-mon[92535]: pgmap v6677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:05.184 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:01 smithi035 ceph-mon[92535]: pgmap v6678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:03 smithi035 ceph-mon[92535]: pgmap v6679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:05 smithi035 ceph-mon[92535]: pgmap v6680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:07 smithi035 ceph-mon[92535]: pgmap v6681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:09 smithi035 ceph-mon[92535]: pgmap v6682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:10 smithi035 ceph-mon[92535]: osdmap e484: 12 total, 12 up, 12 in 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:11 smithi035 ceph-mon[92535]: pgmap v6684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:05.185 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:13 smithi035 ceph-mon[92535]: pgmap v6685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:07.073 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:13 smithi035 ceph-mon[92535]: osdmap e485: 12 total, 12 up, 12 in 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:15 smithi035 ceph-mon[92535]: pgmap v6687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:17 smithi035 ceph-mon[92535]: pgmap v6688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:19 smithi035 ceph-mon[92535]: pgmap v6689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 227 B/s wr, 11 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:21 smithi035 ceph-mon[92535]: pgmap v6690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:23 smithi035 ceph-mon[92535]: pgmap v6691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:25 smithi035 ceph-mon[92535]: pgmap v6692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:27 smithi035 ceph-mon[92535]: pgmap v6693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:09:08.382 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:29 smithi035 ceph-mon[92535]: pgmap v6694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:31 smithi035 ceph-mon[92535]: pgmap v6695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:32 smithi035 ceph-mon[92535]: pgmap v6696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:32 smithi035 ceph-mon[92535]: pgmap v6697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:34 smithi035 ceph-mon[92535]: pgmap v6698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:36 smithi035 ceph-mon[92535]: pgmap v6699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:38 smithi035 ceph-mon[92535]: pgmap v6700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:08.383 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:40 smithi035 ceph-mon[92535]: pgmap v6701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:09:08.934 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:42 smithi035 ceph-mon[92535]: pgmap v6702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:09:08.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:44 smithi035 ceph-mon[92535]: pgmap v6703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:08.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:46 smithi035 ceph-mon[92535]: pgmap v6704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:08.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:48 smithi035 ceph-mon[92535]: pgmap v6705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:08.935 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:50 smithi035 ceph-mon[92535]: pgmap v6706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:10.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:52 smithi035 ceph-mon[92535]: pgmap v6707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:10.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:54 smithi035 ceph-mon[92535]: pgmap v6708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:10.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:56 smithi035 ceph-mon[92535]: pgmap v6709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:10.710 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:08:58 smithi035 ceph-mon[92535]: pgmap v6710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:10.715 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:00 smithi035 ceph-mon[92535]: pgmap v6711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:12.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:02 smithi035 ceph-mon[92535]: pgmap v6712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:12.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:04 smithi035 ceph-mon[92535]: pgmap v6713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:12.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:06 smithi035 ceph-mon[92535]: pgmap v6714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:12.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:08 smithi035 ceph-mon[92535]: pgmap v6715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:12.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:10 smithi035 ceph-mon[92535]: pgmap v6716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:09:12.234 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:10 smithi035 ceph-mon[92535]: osdmap e486: 12 total, 12 up, 12 in 2023-03-17T12:09:12.235 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T12:09:12.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:30 smithi082 ceph-mon[94281]: pgmap v769: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:13.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:32 smithi082 ceph-mon[94281]: pgmap v770: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:13.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:34 smithi082 ceph-mon[94281]: pgmap v771: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:36 smithi082 ceph-mon[94281]: pgmap v772: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:38 smithi082 ceph-mon[94281]: pgmap v773: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:40 smithi082 ceph-mon[94281]: pgmap v774: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:42 smithi082 ceph-mon[94281]: pgmap v775: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:44 smithi082 ceph-mon[94281]: pgmap v776: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:46 smithi082 ceph-mon[94281]: pgmap v777: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:48 smithi082 ceph-mon[94281]: pgmap v778: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:50 smithi082 ceph-mon[94281]: pgmap v779: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:52 smithi082 ceph-mon[94281]: pgmap v780: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:54 smithi082 ceph-mon[94281]: pgmap v781: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:56 smithi082 ceph-mon[94281]: pgmap v782: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:58 smithi082 ceph-mon[94281]: pgmap v783: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:10:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:00 smithi082 ceph-mon[94281]: pgmap v784: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:13.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:14.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:14.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:02 smithi082 ceph-mon[94281]: pgmap v785: 97 pgs: 97 active+clean; 1.4 MiB data, 150 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:14.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:04 smithi082 ceph-mon[94281]: pgmap v786: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:14.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:06 smithi082 ceph-mon[94281]: pgmap v787: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:09:14.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:08 smithi082 ceph-mon[94281]: pgmap v788: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:14.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:09 smithi082 ceph-mon[94281]: osdmap e125: 12 total, 12 up, 12 in 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:10 smithi082 ceph-mon[94281]: pgmap v790: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:12 smithi082 ceph-mon[94281]: pgmap v791: 97 pgs: 97 active+clean; 1.4 MiB data, 151 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:14 smithi082 ceph-mon[94281]: pgmap v792: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:16 smithi082 ceph-mon[94281]: osdmap e126: 12 total, 12 up, 12 in 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:16 smithi082 ceph-mon[94281]: pgmap v794: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:18 smithi082 ceph-mon[94281]: pgmap v795: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:20 smithi082 ceph-mon[94281]: pgmap v796: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:22 smithi082 ceph-mon[94281]: pgmap v797: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:24 smithi082 ceph-mon[94281]: pgmap v798: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:26 smithi082 ceph-mon[94281]: pgmap v799: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:09:14.950 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:28 smithi082 ceph-mon[94281]: pgmap v800: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:15.376 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:30 smithi082 ceph-mon[94281]: pgmap v801: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:15.376 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:32 smithi082 ceph-mon[94281]: pgmap v802: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:15.376 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:34 smithi082 ceph-mon[94281]: pgmap v803: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:16.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:36 smithi082 ceph-mon[94281]: pgmap v804: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:16.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:38 smithi082 ceph-mon[94281]: pgmap v805: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:16.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:40 smithi082 ceph-mon[94281]: pgmap v806: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:16.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:42 smithi082 ceph-mon[94281]: pgmap v807: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:16.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:44 smithi082 ceph-mon[94281]: pgmap v808: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:16.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:46 smithi082 ceph-mon[94281]: pgmap v809: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:48 smithi082 ceph-mon[94281]: pgmap v810: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:50 smithi082 ceph-mon[94281]: pgmap v811: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:52 smithi082 ceph-mon[94281]: pgmap v812: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:54 smithi082 ceph-mon[94281]: pgmap v813: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:56 smithi082 ceph-mon[94281]: pgmap v814: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:11:58 smithi082 ceph-mon[94281]: pgmap v815: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:17.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:00 smithi082 ceph-mon[94281]: pgmap v816: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:02 smithi082 ceph-mon[94281]: pgmap v817: 97 pgs: 97 active+clean; 1.4 MiB data, 152 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:04 smithi082 ceph-mon[94281]: pgmap v818: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:06 smithi082 ceph-mon[94281]: pgmap v819: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:08 smithi082 ceph-mon[94281]: pgmap v820: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:17.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:09 smithi082 ceph-mon[94281]: osdmap e127: 12 total, 12 up, 12 in 2023-03-17T12:09:19.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:10 smithi082 ceph-mon[94281]: pgmap v822: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:19.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:12 smithi082 ceph-mon[94281]: pgmap v823: 97 pgs: 97 active+clean; 1.4 MiB data, 153 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:20.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:14 smithi082 ceph-mon[94281]: pgmap v824: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:20.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:16 smithi082 ceph-mon[94281]: osdmap e128: 12 total, 12 up, 12 in 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:16 smithi082 ceph-mon[94281]: pgmap v826: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:18 smithi082 ceph-mon[94281]: pgmap v827: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:20 smithi082 ceph-mon[94281]: pgmap v828: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:22 smithi082 ceph-mon[94281]: pgmap v829: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:24 smithi082 ceph-mon[94281]: pgmap v830: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:26 smithi082 ceph-mon[94281]: pgmap v831: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:09:22.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:28 smithi082 ceph-mon[94281]: pgmap v832: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:30 smithi082 ceph-mon[94281]: pgmap v833: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:32 smithi082 ceph-mon[94281]: pgmap v834: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:34 smithi082 ceph-mon[94281]: pgmap v835: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:36 smithi082 ceph-mon[94281]: pgmap v836: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:38 smithi082 ceph-mon[94281]: pgmap v837: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:40 smithi082 ceph-mon[94281]: pgmap v838: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:42 smithi082 ceph-mon[94281]: pgmap v839: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:22.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:44 smithi082 ceph-mon[94281]: pgmap v840: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:23.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:46 smithi082 ceph-mon[94281]: pgmap v841: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:23.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:48 smithi082 ceph-mon[94281]: pgmap v842: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:25.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:50 smithi082 ceph-mon[94281]: pgmap v843: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:25.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:52 smithi082 ceph-mon[94281]: pgmap v844: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:25.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:54 smithi082 ceph-mon[94281]: pgmap v845: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:25.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:56 smithi082 ceph-mon[94281]: pgmap v846: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:25.012 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:12:58 smithi082 ceph-mon[94281]: pgmap v847: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:25.903 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:00 smithi082 ceph-mon[94281]: pgmap v848: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:27.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:27.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:02 smithi082 ceph-mon[94281]: pgmap v849: 97 pgs: 97 active+clean; 1.4 MiB data, 154 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:27.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:29.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:29.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:04 smithi082 ceph-mon[94281]: pgmap v850: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:09:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:06 smithi082 ceph-mon[94281]: pgmap v851: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:09:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:08 smithi082 ceph-mon[94281]: pgmap v852: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:09 smithi082 ceph-mon[94281]: osdmap e129: 12 total, 12 up, 12 in 2023-03-17T12:09:29.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:10 smithi082 ceph-mon[94281]: pgmap v854: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:09:29.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:12 smithi082 ceph-mon[94281]: pgmap v855: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:09:29.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:14 smithi082 ceph-mon[94281]: pgmap v856: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:32.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:16 smithi082 ceph-mon[94281]: osdmap e130: 12 total, 12 up, 12 in 2023-03-17T12:09:32.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:16 smithi082 ceph-mon[94281]: pgmap v858: 97 pgs: 97 active+clean; 1.4 MiB data, 155 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:32.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:18 smithi082 ceph-mon[94281]: pgmap v859: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:09:32.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:20 smithi082 ceph-mon[94281]: pgmap v860: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:09:32.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:22 smithi082 ceph-mon[94281]: pgmap v861: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:24 smithi082 ceph-mon[94281]: pgmap v862: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:26 smithi082 ceph-mon[94281]: pgmap v863: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 813 B/s wr, 10 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:28 smithi082 ceph-mon[94281]: pgmap v864: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:30 smithi082 ceph-mon[94281]: pgmap v865: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:32 smithi082 ceph-mon[94281]: pgmap v866: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:34 smithi082 ceph-mon[94281]: pgmap v867: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:36 smithi082 ceph-mon[94281]: pgmap v868: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:38 smithi082 ceph-mon[94281]: pgmap v869: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:40 smithi082 ceph-mon[94281]: pgmap v870: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:42 smithi082 ceph-mon[94281]: pgmap v871: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:32.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:44 smithi082 ceph-mon[94281]: pgmap v872: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:46 smithi082 ceph-mon[94281]: pgmap v873: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:48 smithi082 ceph-mon[94281]: pgmap v874: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:50 smithi082 ceph-mon[94281]: pgmap v875: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:52 smithi082 ceph-mon[94281]: pgmap v876: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:54 smithi082 ceph-mon[94281]: pgmap v877: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:56 smithi082 ceph-mon[94281]: pgmap v878: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:13:58 smithi082 ceph-mon[94281]: pgmap v879: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:00 smithi082 ceph-mon[94281]: pgmap v880: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:02 smithi082 ceph-mon[94281]: pgmap v881: 97 pgs: 97 active+clean; 1.4 MiB data, 156 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:04 smithi082 ceph-mon[94281]: pgmap v882: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:06 smithi082 ceph-mon[94281]: pgmap v883: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:08 smithi082 ceph-mon[94281]: pgmap v884: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:32.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:09 smithi082 ceph-mon[94281]: osdmap e131: 12 total, 12 up, 12 in 2023-03-17T12:09:34.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:10 smithi082 ceph-mon[94281]: pgmap v886: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:12 smithi082 ceph-mon[94281]: pgmap v887: 97 pgs: 97 active+clean; 1.4 MiB data, 161 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:14 smithi082 ceph-mon[94281]: pgmap v888: 97 pgs: 97 active+clean; 1.4 MiB data, 165 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:16 smithi082 ceph-mon[94281]: osdmap e132: 12 total, 12 up, 12 in 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:16 smithi082 ceph-mon[94281]: pgmap v890: 97 pgs: 97 active+clean; 1.4 MiB data, 165 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:18 smithi082 ceph-mon[94281]: pgmap v891: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:20 smithi082 ceph-mon[94281]: pgmap v892: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:22 smithi082 ceph-mon[94281]: pgmap v893: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:24 smithi082 ceph-mon[94281]: pgmap v894: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:26 smithi082 ceph-mon[94281]: pgmap v895: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:09:36.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:28 smithi082 ceph-mon[94281]: pgmap v896: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:09:36.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:30 smithi082 ceph-mon[94281]: pgmap v897: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:36.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:32 smithi082 ceph-mon[94281]: pgmap v898: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:36.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:34 smithi082 ceph-mon[94281]: pgmap v899: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:36.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:36 smithi082 ceph-mon[94281]: pgmap v900: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:36.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:38 smithi082 ceph-mon[94281]: pgmap v901: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:39.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:40 smithi082 ceph-mon[94281]: pgmap v902: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:42 smithi082 ceph-mon[94281]: pgmap v903: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:44 smithi082 ceph-mon[94281]: pgmap v904: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:46 smithi082 ceph-mon[94281]: pgmap v905: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:48 smithi082 ceph-mon[94281]: pgmap v906: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:50 smithi082 ceph-mon[94281]: pgmap v907: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:52 smithi082 ceph-mon[94281]: pgmap v908: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:54 smithi082 ceph-mon[94281]: pgmap v909: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:39.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:56 smithi082 ceph-mon[94281]: pgmap v910: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:39.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:14:58 smithi082 ceph-mon[94281]: pgmap v911: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:41.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:00 smithi082 ceph-mon[94281]: pgmap v912: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:41.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:02 smithi082 ceph-mon[94281]: pgmap v913: 97 pgs: 97 active+clean; 1.4 MiB data, 166 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:41.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:41.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:41.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:41.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:04 smithi082 ceph-mon[94281]: pgmap v914: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:06 smithi082 ceph-mon[94281]: pgmap v915: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:08 smithi082 ceph-mon[94281]: pgmap v916: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:09 smithi082 ceph-mon[94281]: osdmap e133: 12 total, 12 up, 12 in 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:10 smithi082 ceph-mon[94281]: pgmap v918: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:12 smithi082 ceph-mon[94281]: pgmap v919: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:14 smithi082 ceph-mon[94281]: pgmap v920: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:16 smithi082 ceph-mon[94281]: osdmap e134: 12 total, 12 up, 12 in 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:16 smithi082 ceph-mon[94281]: pgmap v922: 97 pgs: 97 active+clean; 1.4 MiB data, 167 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:41.173 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:18 smithi082 ceph-mon[94281]: pgmap v923: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:09:42.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:20 smithi082 ceph-mon[94281]: pgmap v924: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:22 smithi082 ceph-mon[94281]: pgmap v925: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:24 smithi082 ceph-mon[94281]: pgmap v926: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:26 smithi082 ceph-mon[94281]: pgmap v927: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 915 B/s wr, 10 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:28 smithi082 ceph-mon[94281]: pgmap v928: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:30 smithi082 ceph-mon[94281]: pgmap v929: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:32 smithi082 ceph-mon[94281]: pgmap v930: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:34 smithi082 ceph-mon[94281]: pgmap v931: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:36 smithi082 ceph-mon[94281]: pgmap v932: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:42.790 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:38 smithi082 ceph-mon[94281]: pgmap v933: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:43.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:40 smithi082 ceph-mon[94281]: pgmap v934: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:43.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:42 smithi082 ceph-mon[94281]: pgmap v935: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:43.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:44 smithi082 ceph-mon[94281]: pgmap v936: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:43.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:46 smithi082 ceph-mon[94281]: pgmap v937: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:43.869 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:48 smithi082 ceph-mon[94281]: pgmap v938: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:44.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:50 smithi082 ceph-mon[94281]: pgmap v939: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:44.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:52 smithi082 ceph-mon[94281]: pgmap v940: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:44.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:54 smithi082 ceph-mon[94281]: pgmap v941: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:44.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:56 smithi082 ceph-mon[94281]: pgmap v942: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:44.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:15:58 smithi082 ceph-mon[94281]: pgmap v943: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:44.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:00 smithi082 ceph-mon[94281]: pgmap v944: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:02 smithi082 ceph-mon[94281]: pgmap v945: 97 pgs: 97 active+clean; 1.4 MiB data, 168 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:04 smithi082 ceph-mon[94281]: pgmap v946: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:06 smithi082 ceph-mon[94281]: pgmap v947: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:08 smithi082 ceph-mon[94281]: pgmap v948: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:44.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:09 smithi082 ceph-mon[94281]: osdmap e135: 12 total, 12 up, 12 in 2023-03-17T12:09:45.836 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:10 smithi082 ceph-mon[94281]: pgmap v950: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:45.836 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:12 smithi082 ceph-mon[94281]: pgmap v951: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:47.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:14 smithi082 ceph-mon[94281]: pgmap v952: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:09:47.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:16 smithi082 ceph-mon[94281]: osdmap e136: 12 total, 12 up, 12 in 2023-03-17T12:09:47.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:16 smithi082 ceph-mon[94281]: pgmap v954: 97 pgs: 97 active+clean; 1.5 MiB data, 169 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:09:47.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:18 smithi082 ceph-mon[94281]: pgmap v955: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 915 B/s wr, 11 op/s 2023-03-17T12:09:47.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:20 smithi082 ceph-mon[94281]: pgmap v956: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:09:47.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:22 smithi082 ceph-mon[94281]: pgmap v957: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:09:47.420 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:24 smithi082 ceph-mon[94281]: pgmap v958: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:09:47.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:26 smithi082 ceph-mon[94281]: pgmap v959: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:09:47.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:28 smithi082 ceph-mon[94281]: pgmap v960: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:09:47.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:30 smithi082 ceph-mon[94281]: pgmap v961: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:47.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:32 smithi082 ceph-mon[94281]: pgmap v962: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:47.935 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:34 smithi082 ceph-mon[94281]: pgmap v963: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:36 smithi082 ceph-mon[94281]: pgmap v964: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:38 smithi082 ceph-mon[94281]: pgmap v965: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:40 smithi082 ceph-mon[94281]: pgmap v966: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:42 smithi082 ceph-mon[94281]: pgmap v967: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:44 smithi082 ceph-mon[94281]: pgmap v968: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:46 smithi082 ceph-mon[94281]: pgmap v969: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:48 smithi082 ceph-mon[94281]: pgmap v970: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:50 smithi082 ceph-mon[94281]: pgmap v971: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:52 smithi082 ceph-mon[94281]: pgmap v972: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:48.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:54 smithi082 ceph-mon[94281]: pgmap v973: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:49.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:56 smithi082 ceph-mon[94281]: pgmap v974: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:16:58 smithi082 ceph-mon[94281]: pgmap v975: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:00 smithi082 ceph-mon[94281]: pgmap v976: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:02 smithi082 ceph-mon[94281]: pgmap v977: 97 pgs: 97 active+clean; 1.5 MiB data, 170 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:04 smithi082 ceph-mon[94281]: pgmap v978: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:06 smithi082 ceph-mon[94281]: pgmap v979: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:50.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: pgmap v980: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:10 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:09:50.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:10 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:10 smithi082 ceph-mon[94281]: osdmap e137: 12 total, 12 up, 12 in 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:10 smithi082 ceph-mon[94281]: pgmap v982: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:12 smithi082 ceph-mon[94281]: pgmap v983: 97 pgs: 97 active+clean; 1.5 MiB data, 171 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:14 smithi082 ceph-mon[94281]: pgmap v984: 97 pgs: 97 active+clean; 1.5 MiB data, 179 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:16 smithi082 ceph-mon[94281]: osdmap e138: 12 total, 12 up, 12 in 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:16 smithi082 ceph-mon[94281]: pgmap v986: 97 pgs: 97 active+clean; 1.5 MiB data, 179 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:18 smithi082 ceph-mon[94281]: pgmap v987: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 12 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:20 smithi082 ceph-mon[94281]: pgmap v988: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:22 smithi082 ceph-mon[94281]: pgmap v989: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:24 smithi082 ceph-mon[94281]: pgmap v990: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:26 smithi082 ceph-mon[94281]: pgmap v991: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:28 smithi082 ceph-mon[94281]: pgmap v992: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:30 smithi082 ceph-mon[94281]: pgmap v993: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:32 smithi082 ceph-mon[94281]: pgmap v994: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:34 smithi082 ceph-mon[94281]: pgmap v995: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:36 smithi082 ceph-mon[94281]: pgmap v996: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:38 smithi082 ceph-mon[94281]: pgmap v997: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.803 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:40 smithi082 ceph-mon[94281]: pgmap v998: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:42 smithi082 ceph-mon[94281]: pgmap v999: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:44 smithi082 ceph-mon[94281]: pgmap v1000: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:46 smithi082 ceph-mon[94281]: pgmap v1001: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:48 smithi082 ceph-mon[94281]: pgmap v1002: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:50 smithi082 ceph-mon[94281]: pgmap v1003: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:52 smithi082 ceph-mon[94281]: pgmap v1004: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:54 smithi082 ceph-mon[94281]: pgmap v1005: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:56 smithi082 ceph-mon[94281]: pgmap v1006: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:17:58 smithi082 ceph-mon[94281]: pgmap v1007: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:00 smithi082 ceph-mon[94281]: pgmap v1008: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:02 smithi082 ceph-mon[94281]: pgmap v1009: 97 pgs: 97 active+clean; 1.5 MiB data, 180 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:04 smithi082 ceph-mon[94281]: pgmap v1010: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:06 smithi082 ceph-mon[94281]: pgmap v1011: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:08 smithi082 ceph-mon[94281]: pgmap v1012: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:09 smithi082 ceph-mon[94281]: osdmap e139: 12 total, 12 up, 12 in 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:10 smithi082 ceph-mon[94281]: pgmap v1014: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:50.804 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:12 smithi082 ceph-mon[94281]: pgmap v1015: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:14 smithi082 ceph-mon[94281]: pgmap v1016: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:16 smithi082 ceph-mon[94281]: osdmap e140: 12 total, 12 up, 12 in 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:16 smithi082 ceph-mon[94281]: pgmap v1018: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:18 smithi082 ceph-mon[94281]: pgmap v1019: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:20 smithi082 ceph-mon[94281]: pgmap v1020: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:22 smithi082 ceph-mon[94281]: pgmap v1021: 97 pgs: 97 active+clean; 1.5 MiB data, 181 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:24 smithi082 ceph-mon[94281]: pgmap v1022: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:09:50.805 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:26 smithi082 ceph-mon[94281]: pgmap v1023: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 914 B/s wr, 10 op/s 2023-03-17T12:09:51.827 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:28 smithi082 ceph-mon[94281]: pgmap v1024: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:09:51.827 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:30 smithi082 ceph-mon[94281]: pgmap v1025: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:51.827 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:32 smithi082 ceph-mon[94281]: pgmap v1026: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:51.827 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:34 smithi082 ceph-mon[94281]: pgmap v1027: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:36 smithi082 ceph-mon[94281]: pgmap v1028: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:38 smithi082 ceph-mon[94281]: pgmap v1029: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:40 smithi082 ceph-mon[94281]: pgmap v1030: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:42 smithi082 ceph-mon[94281]: pgmap v1031: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:44 smithi082 ceph-mon[94281]: pgmap v1032: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:46 smithi082 ceph-mon[94281]: pgmap v1033: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:48 smithi082 ceph-mon[94281]: pgmap v1034: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:50 smithi082 ceph-mon[94281]: pgmap v1035: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:51.828 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:52 smithi082 ceph-mon[94281]: pgmap v1036: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:52.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:54 smithi082 ceph-mon[94281]: pgmap v1037: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:52.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:56 smithi082 ceph-mon[94281]: pgmap v1038: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:52.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:18:58 smithi082 ceph-mon[94281]: pgmap v1039: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:52.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:00 smithi082 ceph-mon[94281]: pgmap v1040: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:52.919 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:02 smithi082 ceph-mon[94281]: pgmap v1041: 97 pgs: 97 active+clean; 1.5 MiB data, 182 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:52.919 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:04 smithi082 ceph-mon[94281]: pgmap v1042: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:09:52.919 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:04 smithi082 ceph-mon[94281]: osdmap e141: 12 total, 12 up, 12 in 2023-03-17T12:09:53.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:06 smithi082 ceph-mon[94281]: pgmap v1044: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:53.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:08 smithi082 ceph-mon[94281]: pgmap v1045: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:09:53.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:10 smithi082 ceph-mon[94281]: pgmap v1046: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:09:53.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:53.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:10 smithi082 ceph-mon[94281]: osdmap e142: 12 total, 12 up, 12 in 2023-03-17T12:09:54.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:56.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:56.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:56.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:12 smithi082 ceph-mon[94281]: pgmap v1048: 97 pgs: 97 active+clean; 1.5 MiB data, 183 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:14 smithi082 ceph-mon[94281]: pgmap v1049: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 514 B/s wr, 9 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:16 smithi082 ceph-mon[94281]: pgmap v1050: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:16 smithi082 ceph-mon[94281]: daemon mds.e restarted 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:16 smithi082 ceph-mon[94281]: osdmap e143: 12 total, 12 up, 12 in 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:17 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.78:6834/649712286,v1:172.21.15.78:6835/649712286] up:boot 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:17 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:17 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:18 smithi082 ceph-mon[94281]: pgmap v1052: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:20 smithi082 ceph-mon[94281]: pgmap v1053: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 563 B/s wr, 10 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:22 smithi082 ceph-mon[94281]: pgmap v1054: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:24 smithi082 ceph-mon[94281]: pgmap v1055: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:09:57.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:26 smithi082 ceph-mon[94281]: pgmap v1056: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:28 smithi082 ceph-mon[94281]: pgmap v1057: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:30 smithi082 ceph-mon[94281]: pgmap v1058: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:32 smithi082 ceph-mon[94281]: pgmap v1059: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:34 smithi082 ceph-mon[94281]: pgmap v1060: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:36 smithi082 ceph-mon[94281]: pgmap v1061: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:38 smithi082 ceph-mon[94281]: pgmap v1062: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:40 smithi082 ceph-mon[94281]: pgmap v1063: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:42 smithi082 ceph-mon[94281]: pgmap v1064: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:44 smithi082 ceph-mon[94281]: pgmap v1065: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:46 smithi082 ceph-mon[94281]: pgmap v1066: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:48 smithi082 ceph-mon[94281]: pgmap v1067: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:50 smithi082 ceph-mon[94281]: pgmap v1068: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:52 smithi082 ceph-mon[94281]: pgmap v1069: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:54 smithi082 ceph-mon[94281]: pgmap v1070: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:56 smithi082 ceph-mon[94281]: pgmap v1071: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:19:58 smithi082 ceph-mon[94281]: pgmap v1072: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:00 smithi082 ceph-mon[94281]: pgmap v1073: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:00 smithi082 ceph-mon[94281]: overall HEALTH_OK 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:02 smithi082 ceph-mon[94281]: pgmap v1074: 97 pgs: 97 active+clean; 1.5 MiB data, 184 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:04 smithi082 ceph-mon[94281]: pgmap v1075: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:06 smithi082 ceph-mon[94281]: pgmap v1076: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:08 smithi082 ceph-mon[94281]: pgmap v1077: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:09 smithi082 ceph-mon[94281]: osdmap e144: 12 total, 12 up, 12 in 2023-03-17T12:09:57.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:10 smithi082 ceph-mon[94281]: pgmap v1079: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:12 smithi082 ceph-mon[94281]: pgmap v1080: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:09:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:14 smithi082 ceph-mon[94281]: pgmap v1081: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:16 smithi082 ceph-mon[94281]: osdmap e145: 12 total, 12 up, 12 in 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:16 smithi082 ceph-mon[94281]: pgmap v1083: 97 pgs: 97 active+clean; 1.5 MiB data, 185 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:18 smithi082 ceph-mon[94281]: pgmap v1084: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:20 smithi082 ceph-mon[94281]: pgmap v1085: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:22 smithi082 ceph-mon[94281]: pgmap v1086: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:24 smithi082 ceph-mon[94281]: pgmap v1087: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:26 smithi082 ceph-mon[94281]: pgmap v1088: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:28 smithi082 ceph-mon[94281]: pgmap v1089: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:30 smithi082 ceph-mon[94281]: pgmap v1090: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:32 smithi082 ceph-mon[94281]: pgmap v1091: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:34 smithi082 ceph-mon[94281]: pgmap v1092: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:36 smithi082 ceph-mon[94281]: pgmap v1093: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:38 smithi082 ceph-mon[94281]: pgmap v1094: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:40 smithi082 ceph-mon[94281]: pgmap v1095: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:59.134 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:42 smithi082 ceph-mon[94281]: pgmap v1096: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:44 smithi082 ceph-mon[94281]: pgmap v1097: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:46 smithi082 ceph-mon[94281]: pgmap v1098: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:48 smithi082 ceph-mon[94281]: pgmap v1099: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:50 smithi082 ceph-mon[94281]: pgmap v1100: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:52 smithi082 ceph-mon[94281]: pgmap v1101: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:54 smithi082 ceph-mon[94281]: pgmap v1102: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:56 smithi082 ceph-mon[94281]: pgmap v1103: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:20:58 smithi082 ceph-mon[94281]: pgmap v1104: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:00 smithi082 ceph-mon[94281]: pgmap v1105: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:02 smithi082 ceph-mon[94281]: pgmap v1106: 97 pgs: 97 active+clean; 1.5 MiB data, 190 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:04 smithi082 ceph-mon[94281]: pgmap v1107: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:04 smithi082 ceph-mon[94281]: osdmap e146: 12 total, 12 up, 12 in 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:06 smithi082 ceph-mon[94281]: pgmap v1109: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:08 smithi082 ceph-mon[94281]: pgmap v1110: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:10 smithi082 ceph-mon[94281]: pgmap v1111: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:10 smithi082 ceph-mon[94281]: osdmap e147: 12 total, 12 up, 12 in 2023-03-17T12:09:59.135 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:12 smithi082 ceph-mon[94281]: pgmap v1113: 97 pgs: 97 active+clean; 1.5 MiB data, 191 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 383 B/s wr, 6 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:14 smithi082 ceph-mon[94281]: pgmap v1114: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 412 B/s wr, 9 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:16 smithi082 ceph-mon[94281]: pgmap v1115: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 409 B/s wr, 8 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:18 smithi082 ceph-mon[94281]: pgmap v1116: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:20 smithi082 ceph-mon[94281]: pgmap v1117: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:20 smithi082 ceph-mon[94281]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:20 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:22 smithi082 ceph-mon[94281]: pgmap v1118: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 462 B/s wr, 7 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:24 smithi082 ceph-mon[94281]: pgmap v1119: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:26 smithi082 ceph-mon[94281]: pgmap v1120: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:09:59.136 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:28 smithi082 ceph-mon[94281]: pgmap v1121: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:30 smithi082 ceph-mon[94281]: pgmap v1122: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:32 smithi082 ceph-mon[94281]: pgmap v1123: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:34 smithi082 ceph-mon[94281]: pgmap v1124: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:36 smithi082 ceph-mon[94281]: pgmap v1125: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:38 smithi082 ceph-mon[94281]: pgmap v1126: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:40 smithi082 ceph-mon[94281]: pgmap v1127: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:42 smithi082 ceph-mon[94281]: pgmap v1128: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:44 smithi082 ceph-mon[94281]: pgmap v1129: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:46 smithi082 ceph-mon[94281]: pgmap v1130: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:48 smithi082 ceph-mon[94281]: pgmap v1131: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:50 smithi082 ceph-mon[94281]: pgmap v1132: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:52 smithi082 ceph-mon[94281]: pgmap v1133: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:54 smithi082 ceph-mon[94281]: pgmap v1134: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:56 smithi082 ceph-mon[94281]: pgmap v1135: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:21:58 smithi082 ceph-mon[94281]: pgmap v1136: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:00 smithi082 ceph-mon[94281]: pgmap v1137: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:02 smithi082 ceph-mon[94281]: pgmap v1138: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:09:59.137 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:04 smithi082 ceph-mon[94281]: pgmap v1139: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:09:59.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:06 smithi082 ceph-mon[94281]: pgmap v1140: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:09:59.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:08 smithi082 ceph-mon[94281]: pgmap v1141: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:09 smithi082 ceph-mon[94281]: osdmap e148: 12 total, 12 up, 12 in 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:10 smithi082 ceph-mon[94281]: pgmap v1143: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:12 smithi082 ceph-mon[94281]: pgmap v1144: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:14 smithi082 ceph-mon[94281]: pgmap v1145: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:01.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:16 smithi082 ceph-mon[94281]: osdmap e149: 12 total, 12 up, 12 in 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:16 smithi082 ceph-mon[94281]: pgmap v1147: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:18 smithi082 ceph-mon[94281]: pgmap v1148: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:20 smithi082 ceph-mon[94281]: pgmap v1149: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:22 smithi082 ceph-mon[94281]: pgmap v1150: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:24 smithi082 ceph-mon[94281]: pgmap v1151: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:26 smithi082 ceph-mon[94281]: pgmap v1152: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:10:01.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:28 smithi082 ceph-mon[94281]: pgmap v1153: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:10:01.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:30 smithi082 ceph-mon[94281]: pgmap v1154: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:01.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:32 smithi082 ceph-mon[94281]: pgmap v1155: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:01.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:34 smithi082 ceph-mon[94281]: pgmap v1156: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:02.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:36 smithi082 ceph-mon[94281]: pgmap v1157: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:02.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:38 smithi082 ceph-mon[94281]: pgmap v1158: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:02.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:38 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1078072470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T12:10:02.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:40 smithi082 ceph-mon[94281]: pgmap v1159: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:02.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:42 smithi082 ceph-mon[94281]: pgmap v1160: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:02.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:44 smithi082 ceph-mon[94281]: pgmap v1161: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:02.686 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:46 smithi082 ceph-mon[94281]: pgmap v1162: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:03.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:48 smithi082 ceph-mon[94281]: pgmap v1163: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:03.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:50 smithi082 ceph-mon[94281]: pgmap v1164: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:03.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:52 smithi082 ceph-mon[94281]: pgmap v1165: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:03.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:54 smithi082 ceph-mon[94281]: pgmap v1166: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:03.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:56 smithi082 ceph-mon[94281]: pgmap v1167: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:22:58 smithi082 ceph-mon[94281]: pgmap v1168: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:00 smithi082 ceph-mon[94281]: pgmap v1169: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:02 smithi082 ceph-mon[94281]: pgmap v1170: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:04 smithi082 ceph-mon[94281]: pgmap v1171: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:06 smithi082 ceph-mon[94281]: pgmap v1172: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:08 smithi082 ceph-mon[94281]: pgmap v1173: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:09 smithi082 ceph-mon[94281]: osdmap e150: 12 total, 12 up, 12 in 2023-03-17T12:10:03.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:10 smithi082 ceph-mon[94281]: pgmap v1175: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:12 smithi082 ceph-mon[94281]: pgmap v1176: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:14 smithi082 ceph-mon[94281]: pgmap v1177: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:16 smithi082 ceph-mon[94281]: osdmap e151: 12 total, 12 up, 12 in 2023-03-17T12:10:03.885 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:16 smithi082 ceph-mon[94281]: pgmap v1179: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:10:03.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:18 smithi082 ceph-mon[94281]: pgmap v1180: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T12:10:03.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:20 smithi082 ceph-mon[94281]: pgmap v1181: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:03.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:22 smithi082 ceph-mon[94281]: pgmap v1182: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:03.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:24 smithi082 ceph-mon[94281]: pgmap v1183: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:10:03.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:26 smithi082 ceph-mon[94281]: pgmap v1184: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 304 B/s wr, 10 op/s 2023-03-17T12:10:03.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:28 smithi082 ceph-mon[94281]: pgmap v1185: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:04.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:30 smithi082 ceph-mon[94281]: pgmap v1186: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:32 smithi082 ceph-mon[94281]: pgmap v1187: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:34 smithi082 ceph-mon[94281]: pgmap v1188: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:36 smithi082 ceph-mon[94281]: pgmap v1189: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:38 smithi082 ceph-mon[94281]: pgmap v1190: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:40 smithi082 ceph-mon[94281]: pgmap v1191: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:42 smithi082 ceph-mon[94281]: pgmap v1192: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:44 smithi082 ceph-mon[94281]: pgmap v1193: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:46 smithi082 ceph-mon[94281]: pgmap v1194: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:48 smithi082 ceph-mon[94281]: pgmap v1195: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:50 smithi082 ceph-mon[94281]: pgmap v1196: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:52 smithi082 ceph-mon[94281]: pgmap v1197: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:54 smithi082 ceph-mon[94281]: pgmap v1198: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:04.396 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:56 smithi082 ceph-mon[94281]: pgmap v1199: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:23:58 smithi082 ceph-mon[94281]: pgmap v1200: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:00 smithi082 ceph-mon[94281]: pgmap v1201: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:02 smithi082 ceph-mon[94281]: pgmap v1202: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:04 smithi082 ceph-mon[94281]: pgmap v1203: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:06 smithi082 ceph-mon[94281]: pgmap v1204: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:08 smithi082 ceph-mon[94281]: pgmap v1205: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:09 smithi082 ceph-mon[94281]: osdmap e152: 12 total, 12 up, 12 in 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:10 smithi082 ceph-mon[94281]: pgmap v1207: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:12 smithi082 ceph-mon[94281]: pgmap v1208: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:05.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:14 smithi082 ceph-mon[94281]: pgmap v1209: 97 pgs: 97 active+clean; 1.5 MiB data, 209 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:15 smithi082 ceph-mon[94281]: osdmap e153: 12 total, 12 up, 12 in 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:16 smithi082 ceph-mon[94281]: pgmap v1211: 97 pgs: 97 active+clean; 1.5 MiB data, 209 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:18 smithi082 ceph-mon[94281]: pgmap v1212: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:20 smithi082 ceph-mon[94281]: pgmap v1213: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:22 smithi082 ceph-mon[94281]: pgmap v1214: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:24 smithi082 ceph-mon[94281]: pgmap v1215: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:26 smithi082 ceph-mon[94281]: pgmap v1216: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:28 smithi082 ceph-mon[94281]: pgmap v1217: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:30 smithi082 ceph-mon[94281]: pgmap v1218: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:32 smithi082 ceph-mon[94281]: pgmap v1219: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:34 smithi082 ceph-mon[94281]: pgmap v1220: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:36 smithi082 ceph-mon[94281]: pgmap v1221: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:38 smithi082 ceph-mon[94281]: pgmap v1222: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:05.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:40 smithi082 ceph-mon[94281]: pgmap v1223: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:42 smithi082 ceph-mon[94281]: pgmap v1224: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:44 smithi082 ceph-mon[94281]: pgmap v1225: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:46 smithi082 ceph-mon[94281]: pgmap v1226: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:48 smithi082 ceph-mon[94281]: pgmap v1227: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:50 smithi082 ceph-mon[94281]: pgmap v1228: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:52 smithi082 ceph-mon[94281]: pgmap v1229: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:54 smithi082 ceph-mon[94281]: pgmap v1230: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:56 smithi082 ceph-mon[94281]: pgmap v1231: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:24:58 smithi082 ceph-mon[94281]: pgmap v1232: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:00 smithi082 ceph-mon[94281]: pgmap v1233: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:02 smithi082 ceph-mon[94281]: pgmap v1234: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:04 smithi082 ceph-mon[94281]: pgmap v1235: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:06 smithi082 ceph-mon[94281]: pgmap v1236: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:08 smithi082 ceph-mon[94281]: pgmap v1237: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:09 smithi082 ceph-mon[94281]: osdmap e154: 12 total, 12 up, 12 in 2023-03-17T12:10:05.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:10 smithi082 ceph-mon[94281]: pgmap v1239: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:12 smithi082 ceph-mon[94281]: pgmap v1240: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:14 smithi082 ceph-mon[94281]: pgmap v1241: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:16 smithi082 ceph-mon[94281]: osdmap e155: 12 total, 12 up, 12 in 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:16 smithi082 ceph-mon[94281]: pgmap v1243: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:18 smithi082 ceph-mon[94281]: pgmap v1244: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 114 B/s wr, 11 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:20 smithi082 ceph-mon[94281]: pgmap v1245: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:22 smithi082 ceph-mon[94281]: pgmap v1246: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:24 smithi082 ceph-mon[94281]: pgmap v1247: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:26 smithi082 ceph-mon[94281]: pgmap v1248: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 507 B/s wr, 10 op/s 2023-03-17T12:10:05.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:28 smithi082 ceph-mon[94281]: pgmap v1249: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T12:10:05.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:30 smithi082 ceph-mon[94281]: pgmap v1250: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:10:05.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:32 smithi082 ceph-mon[94281]: pgmap v1251: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:10:05.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:34 smithi082 ceph-mon[94281]: pgmap v1252: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:10:05.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:36 smithi082 ceph-mon[94281]: pgmap v1253: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:38 smithi082 ceph-mon[94281]: pgmap v1254: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:09.711 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:40 smithi082 ceph-mon[94281]: pgmap v1255: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:09.712 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:42 smithi082 ceph-mon[94281]: pgmap v1256: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:09.712 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:44 smithi082 ceph-mon[94281]: pgmap v1257: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:09.712 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:46 smithi082 ceph-mon[94281]: pgmap v1258: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:11.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:48 smithi082 ceph-mon[94281]: pgmap v1259: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:11.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:50 smithi082 ceph-mon[94281]: pgmap v1260: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:11.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:52 smithi082 ceph-mon[94281]: pgmap v1261: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:11.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:54 smithi082 ceph-mon[94281]: pgmap v1262: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:56 smithi082 ceph-mon[94281]: pgmap v1263: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:25:58 smithi082 ceph-mon[94281]: pgmap v1264: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:00 smithi082 ceph-mon[94281]: pgmap v1265: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:02 smithi082 ceph-mon[94281]: pgmap v1266: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:04 smithi082 ceph-mon[94281]: pgmap v1267: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:06 smithi082 ceph-mon[94281]: pgmap v1268: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:08 smithi082 ceph-mon[94281]: pgmap v1269: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:13.103 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:09 smithi082 ceph-mon[94281]: osdmap e156: 12 total, 12 up, 12 in 2023-03-17T12:10:13.616 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:10 smithi082 ceph-mon[94281]: pgmap v1271: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:13.616 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:12 smithi082 ceph-mon[94281]: pgmap v1272: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:13.616 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:14 smithi082 ceph-mon[94281]: pgmap v1273: 97 pgs: 97 active+clean; 1.5 MiB data, 217 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:14.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:16 smithi082 ceph-mon[94281]: osdmap e157: 12 total, 12 up, 12 in 2023-03-17T12:10:15.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:16 smithi082 ceph-mon[94281]: pgmap v1275: 97 pgs: 97 active+clean; 1.5 MiB data, 217 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:15.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:15.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:15.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:15.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:15.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:17 smithi082 ceph-mon[94281]: pgmap v1276: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:20 smithi082 ceph-mon[94281]: pgmap v1277: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:22 smithi082 ceph-mon[94281]: pgmap v1278: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:24 smithi082 ceph-mon[94281]: pgmap v1279: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:26 smithi082 ceph-mon[94281]: pgmap v1280: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:28 smithi082 ceph-mon[94281]: pgmap v1281: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:10:16.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:30 smithi082 ceph-mon[94281]: pgmap v1282: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:32 smithi082 ceph-mon[94281]: pgmap v1283: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:34 smithi082 ceph-mon[94281]: pgmap v1284: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:36 smithi082 ceph-mon[94281]: pgmap v1285: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:38 smithi082 ceph-mon[94281]: pgmap v1286: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:40 smithi082 ceph-mon[94281]: pgmap v1287: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:42 smithi082 ceph-mon[94281]: pgmap v1288: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:44 smithi082 ceph-mon[94281]: pgmap v1289: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:46 smithi082 ceph-mon[94281]: pgmap v1290: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:48 smithi082 ceph-mon[94281]: pgmap v1291: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:50 smithi082 ceph-mon[94281]: pgmap v1292: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:52 smithi082 ceph-mon[94281]: pgmap v1293: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:54 smithi082 ceph-mon[94281]: pgmap v1294: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:16.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:56 smithi082 ceph-mon[94281]: pgmap v1295: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:16.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:26:58 smithi082 ceph-mon[94281]: pgmap v1296: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:16.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:00 smithi082 ceph-mon[94281]: pgmap v1297: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:02 smithi082 ceph-mon[94281]: pgmap v1298: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:16.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:04 smithi082 ceph-mon[94281]: pgmap v1299: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:16.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:06 smithi082 ceph-mon[94281]: pgmap v1300: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:17.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:08 smithi082 ceph-mon[94281]: pgmap v1301: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:09 smithi082 ceph-mon[94281]: osdmap e158: 12 total, 12 up, 12 in 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:10 smithi082 ceph-mon[94281]: pgmap v1303: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:12 smithi082 ceph-mon[94281]: pgmap v1304: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:14 smithi082 ceph-mon[94281]: pgmap v1305: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:16 smithi082 ceph-mon[94281]: osdmap e159: 12 total, 12 up, 12 in 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:16 smithi082 ceph-mon[94281]: pgmap v1307: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:18 smithi082 ceph-mon[94281]: pgmap v1308: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T12:10:17.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:20 smithi082 ceph-mon[94281]: pgmap v1309: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:10:20.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: pgmap v1310: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 839 B/s wr, 11 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:22 smithi082 ceph-mon[94281]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:23 smithi082 ceph-mon[94281]: pgmap v1311: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 734 B/s wr, 11 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:26 smithi082 ceph-mon[94281]: pgmap v1312: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 727 B/s wr, 10 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:28 smithi082 ceph-mon[94281]: pgmap v1313: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 870 B/s wr, 13 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:30 smithi082 ceph-mon[94281]: pgmap v1314: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 261 B/s wr, 8 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:32 smithi082 ceph-mon[94281]: pgmap v1315: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 261 B/s wr, 8 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:34 smithi082 ceph-mon[94281]: pgmap v1316: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:36 smithi082 ceph-mon[94281]: pgmap v1317: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:38 smithi082 ceph-mon[94281]: pgmap v1318: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:40 smithi082 ceph-mon[94281]: pgmap v1319: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:20.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:42 smithi082 ceph-mon[94281]: pgmap v1320: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:20.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:44 smithi082 ceph-mon[94281]: pgmap v1321: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:20.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:46 smithi082 ceph-mon[94281]: pgmap v1322: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:20.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:48 smithi082 ceph-mon[94281]: pgmap v1323: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:20.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:50 smithi082 ceph-mon[94281]: pgmap v1324: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:20.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:52 smithi082 ceph-mon[94281]: pgmap v1325: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:21.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:54 smithi082 ceph-mon[94281]: pgmap v1326: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:10:21.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:56 smithi082 ceph-mon[94281]: pgmap v1327: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:27:58 smithi082 ceph-mon[94281]: pgmap v1328: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:00 smithi082 ceph-mon[94281]: pgmap v1329: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:02 smithi082 ceph-mon[94281]: pgmap v1330: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:04 smithi082 ceph-mon[94281]: pgmap v1331: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:06 smithi082 ceph-mon[94281]: pgmap v1332: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:08 smithi082 ceph-mon[94281]: pgmap v1333: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:09 smithi082 ceph-mon[94281]: osdmap e160: 12 total, 12 up, 12 in 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:10 smithi082 ceph-mon[94281]: pgmap v1335: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:12 smithi082 ceph-mon[94281]: pgmap v1336: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:14 smithi082 ceph-mon[94281]: pgmap v1337: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:16 smithi082 ceph-mon[94281]: pgmap v1338: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:21.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:16 smithi082 ceph-mon[94281]: osdmap e161: 12 total, 12 up, 12 in 2023-03-17T12:10:25.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:18 smithi082 ceph-mon[94281]: pgmap v1340: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:10:26.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:20 smithi082 ceph-mon[94281]: pgmap v1341: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:26.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:26.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:22 smithi082 ceph-mon[94281]: pgmap v1342: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:26.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:23 smithi082 ceph-mon[94281]: pgmap v1343: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:23 smithi082 ceph-mon[94281]: pgmap v1344: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 149 B/s wr, 14 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:25 smithi082 ceph-mon[94281]: pgmap v1345: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 118 B/s wr, 11 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:27 smithi082 ceph-mon[94281]: pgmap v1346: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:29 smithi082 ceph-mon[94281]: pgmap v1347: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:31 smithi082 ceph-mon[94281]: pgmap v1348: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:33 smithi082 ceph-mon[94281]: pgmap v1349: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:35 smithi082 ceph-mon[94281]: pgmap v1350: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:37 smithi082 ceph-mon[94281]: pgmap v1351: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:39 smithi082 ceph-mon[94281]: pgmap v1352: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:41 smithi082 ceph-mon[94281]: pgmap v1353: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:43 smithi082 ceph-mon[94281]: pgmap v1354: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:45 smithi082 ceph-mon[94281]: pgmap v1355: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:47 smithi082 ceph-mon[94281]: pgmap v1356: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:49 smithi082 ceph-mon[94281]: pgmap v1357: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:51 smithi082 ceph-mon[94281]: pgmap v1358: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:53 smithi082 ceph-mon[94281]: pgmap v1359: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:55 smithi082 ceph-mon[94281]: pgmap v1360: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:57 smithi082 ceph-mon[94281]: pgmap v1361: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:28:59 smithi082 ceph-mon[94281]: pgmap v1362: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:01 smithi082 ceph-mon[94281]: pgmap v1363: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:03 smithi082 ceph-mon[94281]: pgmap v1364: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:05 smithi082 ceph-mon[94281]: pgmap v1365: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:27.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:07 smithi082 ceph-mon[94281]: pgmap v1366: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:09 smithi082 ceph-mon[94281]: pgmap v1367: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:09 smithi082 ceph-mon[94281]: osdmap e162: 12 total, 12 up, 12 in 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:11 smithi082 ceph-mon[94281]: pgmap v1369: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:13 smithi082 ceph-mon[94281]: pgmap v1370: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:15 smithi082 ceph-mon[94281]: pgmap v1371: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:15 smithi082 ceph-mon[94281]: osdmap e163: 12 total, 12 up, 12 in 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:17 smithi082 ceph-mon[94281]: pgmap v1373: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:19 smithi082 ceph-mon[94281]: pgmap v1374: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:21 smithi082 ceph-mon[94281]: pgmap v1375: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:27.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:23 smithi082 ceph-mon[94281]: pgmap v1376: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:24 smithi082 ceph-mon[94281]: pgmap v1377: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 991 B/s wr, 11 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:24 smithi082 ceph-mon[94281]: pgmap v1378: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:26 smithi082 ceph-mon[94281]: pgmap v1379: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 991 B/s wr, 11 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:28 smithi082 ceph-mon[94281]: pgmap v1380: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:30 smithi082 ceph-mon[94281]: pgmap v1381: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:32 smithi082 ceph-mon[94281]: pgmap v1382: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:34 smithi082 ceph-mon[94281]: pgmap v1383: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:10:27.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:36 smithi082 ceph-mon[94281]: pgmap v1384: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:38 smithi082 ceph-mon[94281]: pgmap v1385: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:40 smithi082 ceph-mon[94281]: pgmap v1386: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:42 smithi082 ceph-mon[94281]: pgmap v1387: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:44 smithi082 ceph-mon[94281]: pgmap v1388: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:46 smithi082 ceph-mon[94281]: pgmap v1389: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:48 smithi082 ceph-mon[94281]: pgmap v1390: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:50 smithi082 ceph-mon[94281]: pgmap v1391: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:52 smithi082 ceph-mon[94281]: pgmap v1392: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:54 smithi082 ceph-mon[94281]: pgmap v1393: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:29.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:56 smithi082 ceph-mon[94281]: pgmap v1394: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:29:58 smithi082 ceph-mon[94281]: pgmap v1395: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:00 smithi082 ceph-mon[94281]: pgmap v1396: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:00 smithi082 ceph-mon[94281]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:00 smithi082 ceph-mon[94281]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:00 smithi082 ceph-mon[94281]: daemon mds.e on smithi078 is in error state 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:02 smithi082 ceph-mon[94281]: pgmap v1397: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:04 smithi082 ceph-mon[94281]: pgmap v1398: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:06 smithi082 ceph-mon[94281]: pgmap v1399: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:08 smithi082 ceph-mon[94281]: pgmap v1400: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:09 smithi082 ceph-mon[94281]: osdmap e164: 12 total, 12 up, 12 in 2023-03-17T12:10:29.160 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:10 smithi082 ceph-mon[94281]: pgmap v1402: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:30.015 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:12 smithi082 ceph-mon[94281]: pgmap v1403: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:14 smithi082 ceph-mon[94281]: pgmap v1404: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:16 smithi082 ceph-mon[94281]: pgmap v1405: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:16 smithi082 ceph-mon[94281]: osdmap e165: 12 total, 12 up, 12 in 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:18 smithi082 ceph-mon[94281]: pgmap v1407: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 931 B/s wr, 12 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:20 smithi082 ceph-mon[94281]: pgmap v1408: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:22 smithi082 ceph-mon[94281]: pgmap v1409: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:24 smithi082 ceph-mon[94281]: pgmap v1410: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:30.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:30.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:25 smithi082 ceph-mon[94281]: pgmap v1411: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:25 smithi082 ceph-mon[94281]: pgmap v1412: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:27 smithi082 ceph-mon[94281]: pgmap v1413: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:29 smithi082 ceph-mon[94281]: pgmap v1414: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:31 smithi082 ceph-mon[94281]: pgmap v1415: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:30.967 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:33 smithi082 ceph-mon[94281]: pgmap v1416: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:35 smithi082 ceph-mon[94281]: pgmap v1417: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:37 smithi082 ceph-mon[94281]: pgmap v1418: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:39 smithi082 ceph-mon[94281]: pgmap v1419: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:41 smithi082 ceph-mon[94281]: pgmap v1420: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:43 smithi082 ceph-mon[94281]: pgmap v1421: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:45 smithi082 ceph-mon[94281]: pgmap v1422: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:47 smithi082 ceph-mon[94281]: pgmap v1423: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:49 smithi082 ceph-mon[94281]: pgmap v1424: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:51 smithi082 ceph-mon[94281]: pgmap v1425: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:33.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:53 smithi082 ceph-mon[94281]: pgmap v1426: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:34.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:55 smithi082 ceph-mon[94281]: pgmap v1427: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:34.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:57 smithi082 ceph-mon[94281]: pgmap v1428: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:34.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:30:59 smithi082 ceph-mon[94281]: pgmap v1429: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:01 smithi082 ceph-mon[94281]: pgmap v1430: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:03 smithi082 ceph-mon[94281]: pgmap v1431: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:05 smithi082 ceph-mon[94281]: pgmap v1432: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:07 smithi082 ceph-mon[94281]: pgmap v1433: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:09 smithi082 ceph-mon[94281]: pgmap v1434: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:09 smithi082 ceph-mon[94281]: osdmap e166: 12 total, 12 up, 12 in 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:11 smithi082 ceph-mon[94281]: pgmap v1436: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:13 smithi082 ceph-mon[94281]: pgmap v1437: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:15 smithi082 ceph-mon[94281]: pgmap v1438: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:15 smithi082 ceph-mon[94281]: osdmap e167: 12 total, 12 up, 12 in 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:17 smithi082 ceph-mon[94281]: pgmap v1440: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:19 smithi082 ceph-mon[94281]: pgmap v1441: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:10:34.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:21 smithi082 ceph-mon[94281]: pgmap v1442: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:36.321 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:23 smithi082 ceph-mon[94281]: pgmap v1443: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:36.321 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:36.321 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:25 smithi082 ceph-mon[94281]: pgmap v1444: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:36.321 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:38.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:26 smithi082 ceph-mon[94281]: pgmap v1445: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 106 B/s wr, 10 op/s 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:26 smithi082 ceph-mon[94281]: pgmap v1446: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:28 smithi082 ceph-mon[94281]: pgmap v1447: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:30 smithi082 ceph-mon[94281]: pgmap v1448: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:32 smithi082 ceph-mon[94281]: pgmap v1449: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:34 smithi082 ceph-mon[94281]: pgmap v1450: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:38.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:36 smithi082 ceph-mon[94281]: pgmap v1451: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:40.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:38 smithi082 ceph-mon[94281]: pgmap v1452: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:40.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:40 smithi082 ceph-mon[94281]: pgmap v1453: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:40.992 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:42 smithi082 ceph-mon[94281]: pgmap v1454: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:40.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:44 smithi082 ceph-mon[94281]: pgmap v1455: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:40.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:46 smithi082 ceph-mon[94281]: pgmap v1456: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:40.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:48 smithi082 ceph-mon[94281]: pgmap v1457: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:40.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:50 smithi082 ceph-mon[94281]: pgmap v1458: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:40.993 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:52 smithi082 ceph-mon[94281]: pgmap v1459: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:41.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:54 smithi082 ceph-mon[94281]: pgmap v1460: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:41.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:56 smithi082 ceph-mon[94281]: pgmap v1461: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:41.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:31:58 smithi082 ceph-mon[94281]: pgmap v1462: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:42.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:00 smithi082 ceph-mon[94281]: pgmap v1463: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:42.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:02 smithi082 ceph-mon[94281]: pgmap v1464: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:42.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:04 smithi082 ceph-mon[94281]: pgmap v1465: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:42.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:06 smithi082 ceph-mon[94281]: pgmap v1466: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:42.171 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:08 smithi082 ceph-mon[94281]: pgmap v1467: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:09 smithi082 ceph-mon[94281]: osdmap e168: 12 total, 12 up, 12 in 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:10 smithi082 ceph-mon[94281]: pgmap v1469: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:11 smithi082 ceph-mon[94281]: pgmap v1470: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:14 smithi082 ceph-mon[94281]: pgmap v1471: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:16 smithi082 ceph-mon[94281]: pgmap v1472: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:16 smithi082 ceph-mon[94281]: osdmap e169: 12 total, 12 up, 12 in 2023-03-17T12:10:42.172 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:18 smithi082 ceph-mon[94281]: pgmap v1474: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 970 B/s wr, 13 op/s 2023-03-17T12:10:44.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:20 smithi082 ceph-mon[94281]: pgmap v1475: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:22 smithi082 ceph-mon[94281]: pgmap v1476: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:24 smithi082 ceph-mon[94281]: pgmap v1477: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:26 smithi082 ceph-mon[94281]: pgmap v1478: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:44.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:46.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:27 smithi082 ceph-mon[94281]: pgmap v1479: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 490 B/s wr, 10 op/s 2023-03-17T12:10:47.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:27 smithi082 ceph-mon[94281]: pgmap v1480: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 464 B/s wr, 6 op/s 2023-03-17T12:10:47.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:29 smithi082 ceph-mon[94281]: pgmap v1481: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 464 B/s wr, 11 op/s 2023-03-17T12:10:47.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:31 smithi082 ceph-mon[94281]: pgmap v1482: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 464 B/s wr, 11 op/s 2023-03-17T12:10:48.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:33 smithi082 ceph-mon[94281]: pgmap v1483: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:10:48.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:35 smithi082 ceph-mon[94281]: pgmap v1484: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:10:48.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:37 smithi082 ceph-mon[94281]: pgmap v1485: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:10:48.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:39 smithi082 ceph-mon[94281]: pgmap v1486: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:48.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:41 smithi082 ceph-mon[94281]: pgmap v1487: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:48.021 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:43 smithi082 ceph-mon[94281]: pgmap v1488: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:48.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:45 smithi082 ceph-mon[94281]: pgmap v1489: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:48.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:47 smithi082 ceph-mon[94281]: pgmap v1490: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:48.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:49 smithi082 ceph-mon[94281]: pgmap v1491: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:48.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:51 smithi082 ceph-mon[94281]: pgmap v1492: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:48.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:53 smithi082 ceph-mon[94281]: pgmap v1493: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:48.022 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:55 smithi082 ceph-mon[94281]: pgmap v1494: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:57 smithi082 ceph-mon[94281]: pgmap v1495: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:32:59 smithi082 ceph-mon[94281]: pgmap v1496: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:01 smithi082 ceph-mon[94281]: pgmap v1497: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:03 smithi082 ceph-mon[94281]: pgmap v1498: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:05 smithi082 ceph-mon[94281]: pgmap v1499: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:07 smithi082 ceph-mon[94281]: pgmap v1500: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:09 smithi082 ceph-mon[94281]: pgmap v1501: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:09 smithi082 ceph-mon[94281]: osdmap e170: 12 total, 12 up, 12 in 2023-03-17T12:10:49.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:11 smithi082 ceph-mon[94281]: pgmap v1503: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:49.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:13 smithi082 ceph-mon[94281]: pgmap v1504: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:49.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:15 smithi082 ceph-mon[94281]: pgmap v1505: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:49.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:15 smithi082 ceph-mon[94281]: osdmap e171: 12 total, 12 up, 12 in 2023-03-17T12:10:50.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:17 smithi082 ceph-mon[94281]: pgmap v1507: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:50.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:19 smithi082 ceph-mon[94281]: pgmap v1508: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:10:50.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:21 smithi082 ceph-mon[94281]: pgmap v1509: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:23 smithi082 ceph-mon[94281]: pgmap v1510: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:25 smithi082 ceph-mon[94281]: pgmap v1511: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:27 smithi082 ceph-mon[94281]: pgmap v1512: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:50.847 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:28 smithi082 ceph-mon[94281]: pgmap v1513: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:28 smithi082 ceph-mon[94281]: pgmap v1514: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:30 smithi082 ceph-mon[94281]: pgmap v1515: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:32 smithi082 ceph-mon[94281]: pgmap v1516: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:34 smithi082 ceph-mon[94281]: pgmap v1517: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:36 smithi082 ceph-mon[94281]: pgmap v1518: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:38 smithi082 ceph-mon[94281]: pgmap v1519: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:40 smithi082 ceph-mon[94281]: pgmap v1520: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:50.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:42 smithi082 ceph-mon[94281]: pgmap v1521: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:50.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:44 smithi082 ceph-mon[94281]: pgmap v1522: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:51.424 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:46 smithi082 ceph-mon[94281]: pgmap v1523: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:51.424 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:48 smithi082 ceph-mon[94281]: pgmap v1524: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:51.424 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:50 smithi082 ceph-mon[94281]: pgmap v1525: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:10:51.424 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:52 smithi082 ceph-mon[94281]: pgmap v1526: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:52.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:54 smithi082 ceph-mon[94281]: pgmap v1527: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:10:52.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:56 smithi082 ceph-mon[94281]: pgmap v1528: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:52.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:33:58 smithi082 ceph-mon[94281]: pgmap v1529: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:00 smithi082 ceph-mon[94281]: pgmap v1530: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:02 smithi082 ceph-mon[94281]: pgmap v1531: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:04 smithi082 ceph-mon[94281]: pgmap v1532: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:06 smithi082 ceph-mon[94281]: pgmap v1533: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:08 smithi082 ceph-mon[94281]: pgmap v1534: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:09 smithi082 ceph-mon[94281]: osdmap e172: 12 total, 12 up, 12 in 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:09 smithi082 ceph-mon[94281]: pgmap v1536: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:12 smithi082 ceph-mon[94281]: pgmap v1537: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:10:52.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:14 smithi082 ceph-mon[94281]: pgmap v1538: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:16 smithi082 ceph-mon[94281]: pgmap v1539: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:16 smithi082 ceph-mon[94281]: osdmap e173: 12 total, 12 up, 12 in 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:18 smithi082 ceph-mon[94281]: pgmap v1541: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 126 B/s wr, 6 op/s 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:20 smithi082 ceph-mon[94281]: pgmap v1542: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:22 smithi082 ceph-mon[94281]: pgmap v1543: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:24 smithi082 ceph-mon[94281]: pgmap v1544: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:10:52.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:26 smithi082 ceph-mon[94281]: pgmap v1545: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:10:53.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:53.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:28 smithi082 ceph-mon[94281]: pgmap v1546: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 637 B/s wr, 10 op/s 2023-03-17T12:10:53.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:53.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:53.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:28 smithi082 ceph-mon[94281]: pgmap v1547: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 947 B/s wr, 14 op/s 2023-03-17T12:10:53.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:28 smithi082 ceph-mon[94281]: pgmap v1548: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:30 smithi082 ceph-mon[94281]: pgmap v1549: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:32 smithi082 ceph-mon[94281]: pgmap v1550: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:34 smithi082 ceph-mon[94281]: pgmap v1551: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:36 smithi082 ceph-mon[94281]: pgmap v1552: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:38 smithi082 ceph-mon[94281]: pgmap v1553: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:40 smithi082 ceph-mon[94281]: pgmap v1554: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:42 smithi082 ceph-mon[94281]: pgmap v1555: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:44 smithi082 ceph-mon[94281]: pgmap v1556: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:46 smithi082 ceph-mon[94281]: pgmap v1557: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:48 smithi082 ceph-mon[94281]: pgmap v1558: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:50 smithi082 ceph-mon[94281]: pgmap v1559: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.974 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:52 smithi082 ceph-mon[94281]: pgmap v1560: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:54 smithi082 ceph-mon[94281]: pgmap v1561: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:56 smithi082 ceph-mon[94281]: pgmap v1562: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:34:58 smithi082 ceph-mon[94281]: pgmap v1563: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:00 smithi082 ceph-mon[94281]: pgmap v1564: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:02 smithi082 ceph-mon[94281]: pgmap v1565: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:04 smithi082 ceph-mon[94281]: pgmap v1566: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:06 smithi082 ceph-mon[94281]: pgmap v1567: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:08 smithi082 ceph-mon[94281]: pgmap v1568: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:09 smithi082 ceph-mon[94281]: osdmap e174: 12 total, 12 up, 12 in 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:10 smithi082 ceph-mon[94281]: pgmap v1570: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:12 smithi082 ceph-mon[94281]: pgmap v1571: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:14 smithi082 ceph-mon[94281]: pgmap v1572: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:53.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:16 smithi082 ceph-mon[94281]: osdmap e175: 12 total, 12 up, 12 in 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:16 smithi082 ceph-mon[94281]: pgmap v1574: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:18 smithi082 ceph-mon[94281]: pgmap v1575: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:20 smithi082 ceph-mon[94281]: pgmap v1576: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:22 smithi082 ceph-mon[94281]: pgmap v1577: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:24 smithi082 ceph-mon[94281]: pgmap v1578: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:26 smithi082 ceph-mon[94281]: pgmap v1579: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:28 smithi082 ceph-mon[94281]: pgmap v1580: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:29 smithi082 ceph-mon[94281]: pgmap v1581: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:29 smithi082 ceph-mon[94281]: pgmap v1582: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:31 smithi082 ceph-mon[94281]: pgmap v1583: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:53.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:33 smithi082 ceph-mon[94281]: pgmap v1584: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:35 smithi082 ceph-mon[94281]: pgmap v1585: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:37 smithi082 ceph-mon[94281]: pgmap v1586: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:39 smithi082 ceph-mon[94281]: pgmap v1587: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:41 smithi082 ceph-mon[94281]: pgmap v1588: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:43 smithi082 ceph-mon[94281]: pgmap v1589: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:45 smithi082 ceph-mon[94281]: pgmap v1590: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:47 smithi082 ceph-mon[94281]: pgmap v1591: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:49 smithi082 ceph-mon[94281]: pgmap v1592: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:51 smithi082 ceph-mon[94281]: pgmap v1593: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:53 smithi082 ceph-mon[94281]: pgmap v1594: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:55 smithi082 ceph-mon[94281]: pgmap v1595: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:57 smithi082 ceph-mon[94281]: pgmap v1596: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:35:59 smithi082 ceph-mon[94281]: pgmap v1597: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:10:53.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:01 smithi082 ceph-mon[94281]: pgmap v1598: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:53.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:03 smithi082 ceph-mon[94281]: pgmap v1599: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:04 smithi082 ceph-mon[94281]: osdmap e176: 12 total, 12 up, 12 in 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:04 smithi082 ceph-mon[94281]: pgmap v1601: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:07 smithi082 ceph-mon[94281]: pgmap v1602: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:09 smithi082 ceph-mon[94281]: pgmap v1603: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:11 smithi082 ceph-mon[94281]: pgmap v1604: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:11 smithi082 ceph-mon[94281]: osdmap e177: 12 total, 12 up, 12 in 2023-03-17T12:10:54.879 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:13 smithi082 ceph-mon[94281]: pgmap v1606: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.0 KiB/s wr, 10 op/s 2023-03-17T12:10:54.880 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:15 smithi082 ceph-mon[94281]: pgmap v1607: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 921 B/s wr, 9 op/s 2023-03-17T12:10:55.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:15 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:10:55.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:15 smithi082 ceph-mon[94281]: osdmap e178: 12 total, 12 up, 12 in 2023-03-17T12:10:55.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/1872850599,v1:172.21.15.35:6837/1872850599] up:boot 2023-03-17T12:10:55.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:10:55.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:10:55.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:17 smithi082 ceph-mon[94281]: pgmap v1609: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:10:56.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:19 smithi082 ceph-mon[94281]: pgmap v1610: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:10:56.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:21 smithi082 ceph-mon[94281]: pgmap v1611: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 517 B/s wr, 10 op/s 2023-03-17T12:10:56.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:23 smithi082 ceph-mon[94281]: pgmap v1612: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:10:56.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:25 smithi082 ceph-mon[94281]: pgmap v1613: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:10:56.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:27 smithi082 ceph-mon[94281]: pgmap v1614: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 361 B/s wr, 9 op/s 2023-03-17T12:10:56.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:56.920 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:29 smithi082 ceph-mon[94281]: pgmap v1615: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:10:56.920 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:56.920 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:56.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:10:56.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:10:56.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:30 smithi082 ceph-mon[94281]: pgmap v1616: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:30 smithi082 ceph-mon[94281]: pgmap v1617: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:31 smithi082 ceph-mon[94281]: pgmap v1618: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:33 smithi082 ceph-mon[94281]: pgmap v1619: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:36 smithi082 ceph-mon[94281]: pgmap v1620: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:37 smithi082 ceph-mon[94281]: pgmap v1621: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:39 smithi082 ceph-mon[94281]: pgmap v1622: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:41 smithi082 ceph-mon[94281]: pgmap v1623: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:43 smithi082 ceph-mon[94281]: pgmap v1624: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:57.433 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:46 smithi082 ceph-mon[94281]: pgmap v1625: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:10:58.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:47 smithi082 ceph-mon[94281]: pgmap v1626: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:58.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:49 smithi082 ceph-mon[94281]: pgmap v1627: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:58.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:51 smithi082 ceph-mon[94281]: pgmap v1628: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:58.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:53 smithi082 ceph-mon[94281]: pgmap v1629: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:10:58.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:56 smithi082 ceph-mon[94281]: pgmap v1630: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:58.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:57 smithi082 ceph-mon[94281]: pgmap v1631: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:36:59 smithi082 ceph-mon[94281]: pgmap v1632: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:01 smithi082 ceph-mon[94281]: pgmap v1633: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:03 smithi082 ceph-mon[94281]: pgmap v1634: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:06 smithi082 ceph-mon[94281]: pgmap v1635: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:07 smithi082 ceph-mon[94281]: pgmap v1636: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:09 smithi082 ceph-mon[94281]: osdmap e179: 12 total, 12 up, 12 in 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:09 smithi082 ceph-mon[94281]: pgmap v1638: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:11 smithi082 ceph-mon[94281]: pgmap v1639: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:13 smithi082 ceph-mon[94281]: pgmap v1640: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:58.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:16 smithi082 ceph-mon[94281]: osdmap e180: 12 total, 12 up, 12 in 2023-03-17T12:10:59.639 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:16 smithi082 ceph-mon[94281]: pgmap v1642: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:18 smithi082 ceph-mon[94281]: pgmap v1643: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 343 B/s wr, 11 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:21 smithi082 ceph-mon[94281]: pgmap v1644: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:23 smithi082 ceph-mon[94281]: pgmap v1645: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:25 smithi082 ceph-mon[94281]: pgmap v1646: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:27 smithi082 ceph-mon[94281]: pgmap v1647: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 201 B/s wr, 10 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:29 smithi082 ceph-mon[94281]: pgmap v1648: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:31 smithi082 ceph-mon[94281]: pgmap v1649: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:10:59.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: pgmap v1650: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:00.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:00.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:00.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:11:02.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:02.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: pgmap v1651: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: pgmap v1652: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:03.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:36 smithi082 ceph-mon[94281]: pgmap v1653: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:38 smithi082 ceph-mon[94281]: pgmap v1654: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:40 smithi082 ceph-mon[94281]: pgmap v1655: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:42 smithi082 ceph-mon[94281]: pgmap v1656: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:44 smithi082 ceph-mon[94281]: pgmap v1657: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:46 smithi082 ceph-mon[94281]: pgmap v1658: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:48 smithi082 ceph-mon[94281]: pgmap v1659: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:03.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:50 smithi082 ceph-mon[94281]: pgmap v1660: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:52 smithi082 ceph-mon[94281]: pgmap v1661: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:54 smithi082 ceph-mon[94281]: pgmap v1662: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:05.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:56 smithi082 ceph-mon[94281]: pgmap v1663: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:37:58 smithi082 ceph-mon[94281]: pgmap v1664: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:05.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:00 smithi082 ceph-mon[94281]: pgmap v1665: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:02 smithi082 ceph-mon[94281]: pgmap v1666: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:04 smithi082 ceph-mon[94281]: pgmap v1667: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:06 smithi082 ceph-mon[94281]: pgmap v1668: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:08 smithi082 ceph-mon[94281]: pgmap v1669: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:09 smithi082 ceph-mon[94281]: osdmap e181: 12 total, 12 up, 12 in 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:10 smithi082 ceph-mon[94281]: pgmap v1671: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:12 smithi082 ceph-mon[94281]: pgmap v1672: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:14 smithi082 ceph-mon[94281]: pgmap v1673: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:16 smithi082 ceph-mon[94281]: osdmap e182: 12 total, 12 up, 12 in 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:16 smithi082 ceph-mon[94281]: pgmap v1675: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:18 smithi082 ceph-mon[94281]: pgmap v1676: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:11:05.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:20 smithi082 ceph-mon[94281]: pgmap v1677: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:22 smithi082 ceph-mon[94281]: pgmap v1678: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:24 smithi082 ceph-mon[94281]: pgmap v1679: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:26 smithi082 ceph-mon[94281]: pgmap v1680: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:28 smithi082 ceph-mon[94281]: pgmap v1681: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:30 smithi082 ceph-mon[94281]: pgmap v1682: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:32 smithi082 ceph-mon[94281]: pgmap v1683: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:34 smithi082 ceph-mon[94281]: pgmap v1684: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:36 smithi082 ceph-mon[94281]: pgmap v1685: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: pgmap v1686: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-17T12:11:05.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: pgmap v1687: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:06.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:06.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:40 smithi082 ceph-mon[94281]: pgmap v1688: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:06.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:42 smithi082 ceph-mon[94281]: pgmap v1689: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:06.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:44 smithi082 ceph-mon[94281]: pgmap v1690: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:06.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:46 smithi082 ceph-mon[94281]: pgmap v1691: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:48 smithi082 ceph-mon[94281]: pgmap v1692: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:50 smithi082 ceph-mon[94281]: pgmap v1693: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:52 smithi082 ceph-mon[94281]: pgmap v1694: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:54 smithi082 ceph-mon[94281]: pgmap v1695: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:56 smithi082 ceph-mon[94281]: pgmap v1696: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:38:58 smithi082 ceph-mon[94281]: pgmap v1697: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:06.578 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:00 smithi082 ceph-mon[94281]: pgmap v1698: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:11:09.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:02 smithi082 ceph-mon[94281]: pgmap v1699: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:11:09.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:04 smithi082 ceph-mon[94281]: pgmap v1700: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:11:09.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:06 smithi082 ceph-mon[94281]: pgmap v1701: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:10.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:08 smithi082 ceph-mon[94281]: pgmap v1702: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:11:10.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:09 smithi082 ceph-mon[94281]: osdmap e183: 12 total, 12 up, 12 in 2023-03-17T12:11:10.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:10 smithi082 ceph-mon[94281]: pgmap v1704: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:11:10.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:12 smithi082 ceph-mon[94281]: pgmap v1705: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:11:10.856 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:14 smithi082 ceph-mon[94281]: pgmap v1706: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:16 smithi082 ceph-mon[94281]: pgmap v1707: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:16 smithi082 ceph-mon[94281]: osdmap e184: 12 total, 12 up, 12 in 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:18 smithi082 ceph-mon[94281]: pgmap v1709: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 119 B/s wr, 12 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:20 smithi082 ceph-mon[94281]: pgmap v1710: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:22 smithi082 ceph-mon[94281]: pgmap v1711: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:24 smithi082 ceph-mon[94281]: pgmap v1712: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:26 smithi082 ceph-mon[94281]: pgmap v1713: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:11:10.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:28 smithi082 ceph-mon[94281]: pgmap v1714: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 440 B/s wr, 13 op/s 2023-03-17T12:11:12.798 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:30 smithi082 ceph-mon[94281]: pgmap v1715: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:11:13.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:32 smithi082 ceph-mon[94281]: pgmap v1716: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:11:13.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:34 smithi082 ceph-mon[94281]: pgmap v1717: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:36 smithi082 ceph-mon[94281]: pgmap v1718: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:38 smithi082 ceph-mon[94281]: pgmap v1719: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:40 smithi082 ceph-mon[94281]: pgmap v1720: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:13.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:13.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:13.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:13.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:41 smithi082 ceph-mon[94281]: pgmap v1721: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 269 B/s wr, 9 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:41 smithi082 ceph-mon[94281]: pgmap v1722: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:43 smithi082 ceph-mon[94281]: pgmap v1723: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:45 smithi082 ceph-mon[94281]: pgmap v1724: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:47 smithi082 ceph-mon[94281]: pgmap v1725: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:49 smithi082 ceph-mon[94281]: pgmap v1726: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:51 smithi082 ceph-mon[94281]: pgmap v1727: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:11:15.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:53 smithi082 ceph-mon[94281]: pgmap v1728: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:55 smithi082 ceph-mon[94281]: pgmap v1729: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:57 smithi082 ceph-mon[94281]: pgmap v1730: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:39:59 smithi082 ceph-mon[94281]: pgmap v1731: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:01 smithi082 ceph-mon[94281]: pgmap v1732: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:03 smithi082 ceph-mon[94281]: pgmap v1733: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:05 smithi082 ceph-mon[94281]: pgmap v1734: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:07 smithi082 ceph-mon[94281]: pgmap v1735: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:09 smithi082 ceph-mon[94281]: pgmap v1736: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:09 smithi082 ceph-mon[94281]: osdmap e185: 12 total, 12 up, 12 in 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:11 smithi082 ceph-mon[94281]: pgmap v1738: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:13 smithi082 ceph-mon[94281]: pgmap v1739: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:15 smithi082 ceph-mon[94281]: pgmap v1740: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:15 smithi082 ceph-mon[94281]: osdmap e186: 12 total, 12 up, 12 in 2023-03-17T12:11:15.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:17 smithi082 ceph-mon[94281]: pgmap v1742: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:11:16.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:19 smithi082 ceph-mon[94281]: pgmap v1743: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:11:16.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:21 smithi082 ceph-mon[94281]: pgmap v1744: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:16.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:23 smithi082 ceph-mon[94281]: pgmap v1745: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:16.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:25 smithi082 ceph-mon[94281]: pgmap v1746: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:19.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:27 smithi082 ceph-mon[94281]: pgmap v1747: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-03-17T12:11:20.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:29 smithi082 ceph-mon[94281]: pgmap v1748: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:11:20.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:31 smithi082 ceph-mon[94281]: pgmap v1749: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:20.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:33 smithi082 ceph-mon[94281]: pgmap v1750: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:20.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:35 smithi082 ceph-mon[94281]: pgmap v1751: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:20.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:37 smithi082 ceph-mon[94281]: pgmap v1752: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:20.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:39 smithi082 ceph-mon[94281]: pgmap v1753: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:20.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:41 smithi082 ceph-mon[94281]: pgmap v1754: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:20.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:20.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:43 smithi082 ceph-mon[94281]: pgmap v1755: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:20.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:20.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: pgmap v1756: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: pgmap v1757: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:47 smithi082 ceph-mon[94281]: pgmap v1758: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:21.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:49 smithi082 ceph-mon[94281]: pgmap v1759: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:22.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:51 smithi082 ceph-mon[94281]: pgmap v1760: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:22.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:53 smithi082 ceph-mon[94281]: pgmap v1761: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:11:22.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:55 smithi082 ceph-mon[94281]: pgmap v1762: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:11:22.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:57 smithi082 ceph-mon[94281]: pgmap v1763: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:22.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:40:59 smithi082 ceph-mon[94281]: pgmap v1764: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:22.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:01 smithi082 ceph-mon[94281]: pgmap v1765: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:22.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:03 smithi082 ceph-mon[94281]: pgmap v1766: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:23.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:05 smithi082 ceph-mon[94281]: pgmap v1767: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:23.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:07 smithi082 ceph-mon[94281]: pgmap v1768: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:23.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:09 smithi082 ceph-mon[94281]: pgmap v1769: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:23.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:09 smithi082 ceph-mon[94281]: osdmap e187: 12 total, 12 up, 12 in 2023-03-17T12:11:23.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:11 smithi082 ceph-mon[94281]: pgmap v1771: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:23.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:13 smithi082 ceph-mon[94281]: pgmap v1772: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:23.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:15 smithi082 ceph-mon[94281]: pgmap v1773: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:23.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:15 smithi082 ceph-mon[94281]: osdmap e188: 12 total, 12 up, 12 in 2023-03-17T12:11:23.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:17 smithi082 ceph-mon[94281]: pgmap v1775: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:19 smithi082 ceph-mon[94281]: pgmap v1776: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:21 smithi082 ceph-mon[94281]: pgmap v1777: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:23 smithi082 ceph-mon[94281]: pgmap v1778: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:25 smithi082 ceph-mon[94281]: pgmap v1779: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:27 smithi082 ceph-mon[94281]: pgmap v1780: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:29 smithi082 ceph-mon[94281]: pgmap v1781: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:31 smithi082 ceph-mon[94281]: pgmap v1782: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:33 smithi082 ceph-mon[94281]: pgmap v1783: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:35 smithi082 ceph-mon[94281]: pgmap v1784: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:23.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:37 smithi082 ceph-mon[94281]: pgmap v1785: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:23.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:39 smithi082 ceph-mon[94281]: pgmap v1786: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:23.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:41 smithi082 ceph-mon[94281]: pgmap v1787: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:23.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:43 smithi082 ceph-mon[94281]: pgmap v1788: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:11:24.196 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:24.196 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:45 smithi082 ceph-mon[94281]: pgmap v1789: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:11:24.196 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:24.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:24.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:25.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:46 smithi082 ceph-mon[94281]: pgmap v1790: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 754 B/s wr, 9 op/s 2023-03-17T12:11:25.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:46 smithi082 ceph-mon[94281]: pgmap v1791: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T12:11:25.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:48 smithi082 ceph-mon[94281]: pgmap v1792: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T12:11:25.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:50 smithi082 ceph-mon[94281]: pgmap v1793: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:52 smithi082 ceph-mon[94281]: pgmap v1794: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:54 smithi082 ceph-mon[94281]: pgmap v1795: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:56 smithi082 ceph-mon[94281]: pgmap v1796: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:41:58 smithi082 ceph-mon[94281]: pgmap v1797: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:00 smithi082 ceph-mon[94281]: pgmap v1798: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:02 smithi082 ceph-mon[94281]: pgmap v1799: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:26.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:04 smithi082 ceph-mon[94281]: pgmap v1800: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:26.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:06 smithi082 ceph-mon[94281]: pgmap v1801: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:11:26.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:08 smithi082 ceph-mon[94281]: pgmap v1802: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:26.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:09 smithi082 ceph-mon[94281]: osdmap e189: 12 total, 12 up, 12 in 2023-03-17T12:11:26.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:10 smithi082 ceph-mon[94281]: pgmap v1804: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:26.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:11 smithi082 ceph-mon[94281]: pgmap v1805: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:26.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:14 smithi082 ceph-mon[94281]: pgmap v1806: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:11:26.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:16 smithi082 ceph-mon[94281]: pgmap v1807: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:11:26.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:16 smithi082 ceph-mon[94281]: osdmap e190: 12 total, 12 up, 12 in 2023-03-17T12:11:26.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:18 smithi082 ceph-mon[94281]: pgmap v1809: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 972 B/s wr, 13 op/s 2023-03-17T12:11:26.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:20 smithi082 ceph-mon[94281]: pgmap v1810: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:11:26.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:22 smithi082 ceph-mon[94281]: pgmap v1811: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:11:26.855 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:24 smithi082 ceph-mon[94281]: pgmap v1812: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:11:26.856 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:26 smithi082 ceph-mon[94281]: pgmap v1813: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:11:26.856 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:28 smithi082 ceph-mon[94281]: pgmap v1814: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 443 B/s wr, 13 op/s 2023-03-17T12:11:27.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:30 smithi082 ceph-mon[94281]: pgmap v1815: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:11:27.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:32 smithi082 ceph-mon[94281]: pgmap v1816: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:11:27.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:34 smithi082 ceph-mon[94281]: pgmap v1817: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:11:27.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:36 smithi082 ceph-mon[94281]: pgmap v1818: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:27.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:38 smithi082 ceph-mon[94281]: pgmap v1819: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:27.823 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:40 smithi082 ceph-mon[94281]: pgmap v1820: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:28.983 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:42 smithi082 ceph-mon[94281]: pgmap v1821: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:44 smithi082 ceph-mon[94281]: pgmap v1822: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:46 smithi082 ceph-mon[94281]: pgmap v1823: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:47 smithi082 ceph-mon[94281]: pgmap v1824: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:11:29.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:47 smithi082 ceph-mon[94281]: pgmap v1825: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:11:29.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:49 smithi082 ceph-mon[94281]: pgmap v1826: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:30.449 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:51 smithi082 ceph-mon[94281]: pgmap v1827: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:30.449 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:53 smithi082 ceph-mon[94281]: pgmap v1828: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:30.450 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:55 smithi082 ceph-mon[94281]: pgmap v1829: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:30.450 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:57 smithi082 ceph-mon[94281]: pgmap v1830: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:11:30.450 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:42:59 smithi082 ceph-mon[94281]: pgmap v1831: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:30.450 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:01 smithi082 ceph-mon[94281]: pgmap v1832: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:30.450 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:03 smithi082 ceph-mon[94281]: pgmap v1833: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:30.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:05 smithi082 ceph-mon[94281]: pgmap v1834: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:30.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:07 smithi082 ceph-mon[94281]: pgmap v1835: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:30.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:09 smithi082 ceph-mon[94281]: pgmap v1836: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:30.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:09 smithi082 ceph-mon[94281]: osdmap e191: 12 total, 12 up, 12 in 2023-03-17T12:11:30.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:11 smithi082 ceph-mon[94281]: pgmap v1838: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:30.853 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:13 smithi082 ceph-mon[94281]: pgmap v1839: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:31.372 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:15 smithi082 ceph-mon[94281]: pgmap v1840: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:31.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:15 smithi082 ceph-mon[94281]: osdmap e192: 12 total, 12 up, 12 in 2023-03-17T12:11:31.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:17 smithi082 ceph-mon[94281]: pgmap v1842: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:11:31.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:19 smithi082 ceph-mon[94281]: pgmap v1843: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:11:31.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:21 smithi082 ceph-mon[94281]: pgmap v1844: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:31.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:23 smithi082 ceph-mon[94281]: pgmap v1845: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:31.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:25 smithi082 ceph-mon[94281]: pgmap v1846: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:32.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:27 smithi082 ceph-mon[94281]: pgmap v1847: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:11:32.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:29 smithi082 ceph-mon[94281]: pgmap v1848: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:11:32.237 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:31 smithi082 ceph-mon[94281]: pgmap v1849: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:32.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:32 smithi082 ceph-mon[94281]: pgmap v1850: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:35 smithi082 ceph-mon[94281]: pgmap v1851: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:37 smithi082 ceph-mon[94281]: pgmap v1852: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:39 smithi082 ceph-mon[94281]: pgmap v1853: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:41 smithi082 ceph-mon[94281]: pgmap v1854: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:43 smithi082 ceph-mon[94281]: pgmap v1855: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:45 smithi082 ceph-mon[94281]: pgmap v1856: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:32.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:47 smithi082 ceph-mon[94281]: pgmap v1857: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:48 smithi082 ceph-mon[94281]: pgmap v1858: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:48 smithi082 ceph-mon[94281]: pgmap v1859: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:50 smithi082 ceph-mon[94281]: pgmap v1860: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:52 smithi082 ceph-mon[94281]: pgmap v1861: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:54 smithi082 ceph-mon[94281]: pgmap v1862: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:56 smithi082 ceph-mon[94281]: pgmap v1863: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:43:58 smithi082 ceph-mon[94281]: pgmap v1864: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:00 smithi082 ceph-mon[94281]: pgmap v1865: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:02 smithi082 ceph-mon[94281]: pgmap v1866: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:11:34.644 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:04 smithi082 ceph-mon[94281]: pgmap v1867: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:11:34.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:04 smithi082 ceph-mon[94281]: osdmap e193: 12 total, 12 up, 12 in 2023-03-17T12:11:36.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:06 smithi082 ceph-mon[94281]: pgmap v1869: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:36.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:08 smithi082 ceph-mon[94281]: pgmap v1870: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:36.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:10 smithi082 ceph-mon[94281]: pgmap v1871: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:11:36.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:10 smithi082 ceph-mon[94281]: osdmap e194: 12 total, 12 up, 12 in 2023-03-17T12:11:36.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:12 smithi082 ceph-mon[94281]: pgmap v1873: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:11:36.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:14 smithi082 ceph-mon[94281]: pgmap v1874: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1010 B/s wr, 12 op/s 2023-03-17T12:11:36.303 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:16 smithi082 ceph-mon[94281]: pgmap v1875: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:11:38.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:18 smithi082 ceph-mon[94281]: pgmap v1876: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:11:38.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:20 smithi082 ceph-mon[94281]: pgmap v1877: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:11:38.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:22 smithi082 ceph-mon[94281]: pgmap v1878: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 503 B/s wr, 10 op/s 2023-03-17T12:11:38.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:24 smithi082 ceph-mon[94281]: pgmap v1879: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:11:38.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:26 smithi082 ceph-mon[94281]: pgmap v1880: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:11:39.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:28 smithi082 ceph-mon[94281]: pgmap v1881: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2023-03-17T12:11:39.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:30 smithi082 ceph-mon[94281]: pgmap v1882: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:11:39.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:32 smithi082 ceph-mon[94281]: pgmap v1883: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:39.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:34 smithi082 ceph-mon[94281]: pgmap v1884: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:39.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:36 smithi082 ceph-mon[94281]: pgmap v1885: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:39.889 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:38 smithi082 ceph-mon[94281]: pgmap v1886: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-17T12:11:39.890 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:40 smithi082 ceph-mon[94281]: pgmap v1887: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:39.890 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:42 smithi082 ceph-mon[94281]: pgmap v1888: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:42.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:44 smithi082 ceph-mon[94281]: pgmap v1889: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:42.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:46 smithi082 ceph-mon[94281]: pgmap v1890: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:42.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:42.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:42.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:42.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:42.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:48 smithi082 ceph-mon[94281]: pgmap v1891: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:42.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:48 smithi082 ceph-mon[94281]: pgmap v1892: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:11:42.832 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:48 smithi082 ceph-mon[94281]: pgmap v1893: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:44.266 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:49 smithi082 ceph-mon[94281]: pgmap v1894: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:44.266 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:52 smithi082 ceph-mon[94281]: pgmap v1895: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:11:44.266 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:54 smithi082 ceph-mon[94281]: pgmap v1896: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:56 smithi082 ceph-mon[94281]: pgmap v1897: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:44:58 smithi082 ceph-mon[94281]: pgmap v1898: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:00 smithi082 ceph-mon[94281]: pgmap v1899: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:02 smithi082 ceph-mon[94281]: pgmap v1900: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:04 smithi082 ceph-mon[94281]: pgmap v1901: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:06 smithi082 ceph-mon[94281]: pgmap v1902: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:08 smithi082 ceph-mon[94281]: pgmap v1903: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:09 smithi082 ceph-mon[94281]: osdmap e195: 12 total, 12 up, 12 in 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:10 smithi082 ceph-mon[94281]: pgmap v1905: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:12 smithi082 ceph-mon[94281]: pgmap v1906: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:14 smithi082 ceph-mon[94281]: pgmap v1907: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:46.086 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:16 smithi082 ceph-mon[94281]: pgmap v1908: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:16 smithi082 ceph-mon[94281]: osdmap e196: 12 total, 12 up, 12 in 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:18 smithi082 ceph-mon[94281]: pgmap v1910: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:20 smithi082 ceph-mon[94281]: pgmap v1911: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:22 smithi082 ceph-mon[94281]: pgmap v1912: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:24 smithi082 ceph-mon[94281]: pgmap v1913: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:26 smithi082 ceph-mon[94281]: pgmap v1914: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:28 smithi082 ceph-mon[94281]: pgmap v1915: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:30 smithi082 ceph-mon[94281]: pgmap v1916: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:46.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:32 smithi082 ceph-mon[94281]: pgmap v1917: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:34 smithi082 ceph-mon[94281]: pgmap v1918: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:36 smithi082 ceph-mon[94281]: pgmap v1919: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:38 smithi082 ceph-mon[94281]: pgmap v1920: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:40 smithi082 ceph-mon[94281]: pgmap v1921: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:42 smithi082 ceph-mon[94281]: pgmap v1922: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:44 smithi082 ceph-mon[94281]: pgmap v1923: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:48.202 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:46 smithi082 ceph-mon[94281]: pgmap v1924: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:48 smithi082 ceph-mon[94281]: pgmap v1925: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:49 smithi082 ceph-mon[94281]: pgmap v1926: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:49 smithi082 ceph-mon[94281]: pgmap v1927: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:51 smithi082 ceph-mon[94281]: pgmap v1928: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:53 smithi082 ceph-mon[94281]: pgmap v1929: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:55 smithi082 ceph-mon[94281]: pgmap v1930: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:11:48.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:57 smithi082 ceph-mon[94281]: pgmap v1931: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:45:59 smithi082 ceph-mon[94281]: pgmap v1932: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:01 smithi082 ceph-mon[94281]: pgmap v1933: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:03 smithi082 ceph-mon[94281]: pgmap v1934: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:05 smithi082 ceph-mon[94281]: pgmap v1935: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:07 smithi082 ceph-mon[94281]: pgmap v1936: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:09 smithi082 ceph-mon[94281]: pgmap v1937: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:09 smithi082 ceph-mon[94281]: osdmap e197: 12 total, 12 up, 12 in 2023-03-17T12:11:50.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:11 smithi082 ceph-mon[94281]: pgmap v1939: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:11:50.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:13 smithi082 ceph-mon[94281]: pgmap v1940: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:11:50.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:15 smithi082 ceph-mon[94281]: pgmap v1941: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:11:50.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:15 smithi082 ceph-mon[94281]: osdmap e198: 12 total, 12 up, 12 in 2023-03-17T12:11:52.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:17 smithi082 ceph-mon[94281]: pgmap v1943: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:11:52.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:19 smithi082 ceph-mon[94281]: pgmap v1944: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 843 B/s wr, 11 op/s 2023-03-17T12:11:52.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:21 smithi082 ceph-mon[94281]: pgmap v1945: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:11:52.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:23 smithi082 ceph-mon[94281]: pgmap v1946: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:11:52.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:25 smithi082 ceph-mon[94281]: pgmap v1947: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:11:52.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:26 smithi082 ceph-mon[94281]: pgmap v1948: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 664 B/s wr, 10 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:29 smithi082 ceph-mon[94281]: pgmap v1949: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:31 smithi082 ceph-mon[94281]: pgmap v1950: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:33 smithi082 ceph-mon[94281]: pgmap v1951: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:35 smithi082 ceph-mon[94281]: pgmap v1952: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:37 smithi082 ceph-mon[94281]: pgmap v1953: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:39 smithi082 ceph-mon[94281]: pgmap v1954: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:41 smithi082 ceph-mon[94281]: pgmap v1955: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:43 smithi082 ceph-mon[94281]: pgmap v1956: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:45 smithi082 ceph-mon[94281]: pgmap v1957: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:52.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:47 smithi082 ceph-mon[94281]: pgmap v1958: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:11:52.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:11:52.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:49 smithi082 ceph-mon[94281]: pgmap v1959: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:11:52.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:52.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:53.146 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:11:53.146 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:11:53.146 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:50 smithi082 ceph-mon[94281]: pgmap v1960: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 272 B/s wr, 9 op/s 2023-03-17T12:11:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:50 smithi082 ceph-mon[94281]: pgmap v1961: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:11:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:11:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:51 smithi082 ceph-mon[94281]: pgmap v1962: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:11:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:53 smithi082 ceph-mon[94281]: pgmap v1963: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:11:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:56 smithi082 ceph-mon[94281]: pgmap v1964: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:11:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:46:58 smithi082 ceph-mon[94281]: pgmap v1965: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:11:57.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:00 smithi082 ceph-mon[94281]: pgmap v1966: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:11:57.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:02 smithi082 ceph-mon[94281]: pgmap v1967: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:57.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:04 smithi082 ceph-mon[94281]: pgmap v1968: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:11:59.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:06 smithi082 ceph-mon[94281]: pgmap v1969: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:11:59.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:08 smithi082 ceph-mon[94281]: pgmap v1970: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:11:59.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:10 smithi082 ceph-mon[94281]: osdmap e199: 12 total, 12 up, 12 in 2023-03-17T12:11:59.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:10 smithi082 ceph-mon[94281]: pgmap v1972: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:11:59.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:12 smithi082 ceph-mon[94281]: pgmap v1973: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:11:59.588 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:14 smithi082 ceph-mon[94281]: pgmap v1974: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:12:00.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:16 smithi082 ceph-mon[94281]: osdmap e200: 12 total, 12 up, 12 in 2023-03-17T12:12:00.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:16 smithi082 ceph-mon[94281]: pgmap v1976: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2023-03-17T12:12:00.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:18 smithi082 ceph-mon[94281]: pgmap v1977: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 344 B/s wr, 11 op/s 2023-03-17T12:12:00.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:20 smithi082 ceph-mon[94281]: pgmap v1978: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:12:00.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:22 smithi082 ceph-mon[94281]: pgmap v1979: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:12:01.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:24 smithi082 ceph-mon[94281]: pgmap v1980: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:12:01.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:26 smithi082 ceph-mon[94281]: pgmap v1981: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:12:01.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:28 smithi082 ceph-mon[94281]: pgmap v1982: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:12:02.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:30 smithi082 ceph-mon[94281]: pgmap v1983: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:02.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:32 smithi082 ceph-mon[94281]: pgmap v1984: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:02.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:34 smithi082 ceph-mon[94281]: pgmap v1985: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:02.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:36 smithi082 ceph-mon[94281]: pgmap v1986: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:02.466 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:38 smithi082 ceph-mon[94281]: pgmap v1987: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:03.309 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:40 smithi082 ceph-mon[94281]: pgmap v1988: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:04.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:42 smithi082 ceph-mon[94281]: pgmap v1989: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:04.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:44 smithi082 ceph-mon[94281]: pgmap v1990: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:46 smithi082 ceph-mon[94281]: pgmap v1991: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:48 smithi082 ceph-mon[94281]: pgmap v1992: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:50 smithi082 ceph-mon[94281]: pgmap v1993: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:52 smithi082 ceph-mon[94281]: pgmap v1994: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:05.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:05.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:05.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:05.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:05.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:12:05.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: pgmap v1995: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:55 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:55 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:55 smithi082 ceph-mon[94281]: pgmap v1996: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:55 smithi082 ceph-mon[94281]: pgmap v1997: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:57 smithi082 ceph-mon[94281]: pgmap v1998: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:12:08.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:47:59 smithi082 ceph-mon[94281]: pgmap v1999: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:12:08.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:01 smithi082 ceph-mon[94281]: pgmap v2000: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:12:08.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:03 smithi082 ceph-mon[94281]: pgmap v2001: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 33 op/s 2023-03-17T12:12:08.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:05 smithi082 ceph-mon[94281]: pgmap v2002: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:10.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:07 smithi082 ceph-mon[94281]: pgmap v2003: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:09 smithi082 ceph-mon[94281]: pgmap v2004: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:09 smithi082 ceph-mon[94281]: osdmap e201: 12 total, 12 up, 12 in 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:11 smithi082 ceph-mon[94281]: pgmap v2006: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:13 smithi082 ceph-mon[94281]: pgmap v2007: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:15 smithi082 ceph-mon[94281]: pgmap v2008: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:15 smithi082 ceph-mon[94281]: osdmap e202: 12 total, 12 up, 12 in 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:17 smithi082 ceph-mon[94281]: pgmap v2010: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:19 smithi082 ceph-mon[94281]: pgmap v2011: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:21 smithi082 ceph-mon[94281]: pgmap v2012: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:23 smithi082 ceph-mon[94281]: pgmap v2013: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:25 smithi082 ceph-mon[94281]: pgmap v2014: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:12:10.479 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:27 smithi082 ceph-mon[94281]: pgmap v2015: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:29 smithi082 ceph-mon[94281]: pgmap v2016: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:31 smithi082 ceph-mon[94281]: pgmap v2017: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:33 smithi082 ceph-mon[94281]: pgmap v2018: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:35 smithi082 ceph-mon[94281]: pgmap v2019: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:37 smithi082 ceph-mon[94281]: pgmap v2020: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:39 smithi082 ceph-mon[94281]: pgmap v2021: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:41 smithi082 ceph-mon[94281]: pgmap v2022: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:43 smithi082 ceph-mon[94281]: pgmap v2023: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:45 smithi082 ceph-mon[94281]: pgmap v2024: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:47 smithi082 ceph-mon[94281]: pgmap v2025: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:49 smithi082 ceph-mon[94281]: pgmap v2026: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:51 smithi082 ceph-mon[94281]: pgmap v2027: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:53 smithi082 ceph-mon[94281]: pgmap v2028: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:55 smithi082 ceph-mon[94281]: pgmap v2029: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:12:10.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:10.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:10.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:10.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:56 smithi082 ceph-mon[94281]: pgmap v2030: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 757 B/s wr, 10 op/s 2023-03-17T12:12:10.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:56 smithi082 ceph-mon[94281]: pgmap v2031: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:12:12.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:48:58 smithi082 ceph-mon[94281]: pgmap v2032: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:12:14.174 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:00 smithi082 ceph-mon[94281]: pgmap v2033: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:12:14.174 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:02 smithi082 ceph-mon[94281]: pgmap v2034: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:04 smithi082 ceph-mon[94281]: pgmap v2035: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:06 smithi082 ceph-mon[94281]: pgmap v2036: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:08 smithi082 ceph-mon[94281]: pgmap v2037: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:09 smithi082 ceph-mon[94281]: osdmap e203: 12 total, 12 up, 12 in 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:09 smithi082 ceph-mon[94281]: pgmap v2039: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:12 smithi082 ceph-mon[94281]: pgmap v2040: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:14 smithi082 ceph-mon[94281]: pgmap v2041: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:16 smithi082 ceph-mon[94281]: pgmap v2042: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:16 smithi082 ceph-mon[94281]: osdmap e204: 12 total, 12 up, 12 in 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:18 smithi082 ceph-mon[94281]: pgmap v2044: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:12:14.175 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:20 smithi082 ceph-mon[94281]: pgmap v2045: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:12:14.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:22 smithi082 ceph-mon[94281]: pgmap v2046: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:12:14.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:24 smithi082 ceph-mon[94281]: pgmap v2047: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:16.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:26 smithi082 ceph-mon[94281]: pgmap v2048: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:16.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:28 smithi082 ceph-mon[94281]: pgmap v2049: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 456 B/s wr, 14 op/s 2023-03-17T12:12:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:30 smithi082 ceph-mon[94281]: pgmap v2050: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:12:16.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:32 smithi082 ceph-mon[94281]: pgmap v2051: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:12:17.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:34 smithi082 ceph-mon[94281]: pgmap v2052: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:12:17.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:36 smithi082 ceph-mon[94281]: pgmap v2053: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:17.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:38 smithi082 ceph-mon[94281]: pgmap v2054: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:40 smithi082 ceph-mon[94281]: pgmap v2055: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:42 smithi082 ceph-mon[94281]: pgmap v2056: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:44 smithi082 ceph-mon[94281]: pgmap v2057: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:46 smithi082 ceph-mon[94281]: pgmap v2058: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:48 smithi082 ceph-mon[94281]: pgmap v2059: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:50 smithi082 ceph-mon[94281]: pgmap v2060: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:17.878 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:52 smithi082 ceph-mon[94281]: pgmap v2061: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:54 smithi082 ceph-mon[94281]: pgmap v2062: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:56 smithi082 ceph-mon[94281]: pgmap v2063: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:18.858 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:20.152 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:57 smithi082 ceph-mon[94281]: pgmap v2064: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:12:20.152 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:57 smithi082 ceph-mon[94281]: pgmap v2065: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:12:20.152 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:49:59 smithi082 ceph-mon[94281]: pgmap v2066: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:12:20.152 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:12:20.152 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:01 smithi082 ceph-mon[94281]: pgmap v2067: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:12:20.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:03 smithi082 ceph-mon[94281]: pgmap v2068: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T12:12:20.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:05 smithi082 ceph-mon[94281]: pgmap v2069: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T12:12:20.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:07 smithi082 ceph-mon[94281]: pgmap v2070: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:20.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:09 smithi082 ceph-mon[94281]: pgmap v2071: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:12:20.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:09 smithi082 ceph-mon[94281]: osdmap e205: 12 total, 12 up, 12 in 2023-03-17T12:12:20.153 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:11 smithi082 ceph-mon[94281]: pgmap v2073: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:20.154 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:13 smithi082 ceph-mon[94281]: pgmap v2074: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:20.154 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:15 smithi082 ceph-mon[94281]: pgmap v2075: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:21.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:15 smithi082 ceph-mon[94281]: osdmap e206: 12 total, 12 up, 12 in 2023-03-17T12:12:21.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:17 smithi082 ceph-mon[94281]: pgmap v2077: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:12:21.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:19 smithi082 ceph-mon[94281]: pgmap v2078: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-17T12:12:21.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:21 smithi082 ceph-mon[94281]: pgmap v2079: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:21.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:23 smithi082 ceph-mon[94281]: pgmap v2080: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:12:21.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:25 smithi082 ceph-mon[94281]: pgmap v2081: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:12:22.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:27 smithi082 ceph-mon[94281]: pgmap v2082: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:29 smithi082 ceph-mon[94281]: pgmap v2083: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:31 smithi082 ceph-mon[94281]: pgmap v2084: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:33 smithi082 ceph-mon[94281]: pgmap v2085: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:35 smithi082 ceph-mon[94281]: pgmap v2086: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:37 smithi082 ceph-mon[94281]: pgmap v2087: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:39 smithi082 ceph-mon[94281]: pgmap v2088: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:41 smithi082 ceph-mon[94281]: pgmap v2089: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:43 smithi082 ceph-mon[94281]: pgmap v2090: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:45 smithi082 ceph-mon[94281]: pgmap v2091: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:47 smithi082 ceph-mon[94281]: pgmap v2092: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:49 smithi082 ceph-mon[94281]: pgmap v2093: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:51 smithi082 ceph-mon[94281]: pgmap v2094: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:53 smithi082 ceph-mon[94281]: pgmap v2095: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:55 smithi082 ceph-mon[94281]: pgmap v2096: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:24.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:57 smithi082 ceph-mon[94281]: pgmap v2097: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:58 smithi082 ceph-mon[94281]: pgmap v2098: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 283 B/s wr, 14 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:50:58 smithi082 ceph-mon[94281]: pgmap v2099: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:00 smithi082 ceph-mon[94281]: pgmap v2100: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:02 smithi082 ceph-mon[94281]: pgmap v2101: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 347 B/s wr, 6 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:04 smithi082 ceph-mon[94281]: pgmap v2102: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:06 smithi082 ceph-mon[94281]: pgmap v2103: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:24.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:08 smithi082 ceph-mon[94281]: pgmap v2104: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:09 smithi082 ceph-mon[94281]: osdmap e207: 12 total, 12 up, 12 in 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:10 smithi082 ceph-mon[94281]: pgmap v2106: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:12 smithi082 ceph-mon[94281]: pgmap v2107: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:14 smithi082 ceph-mon[94281]: pgmap v2108: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:16 smithi082 ceph-mon[94281]: pgmap v2109: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:16 smithi082 ceph-mon[94281]: osdmap e208: 12 total, 12 up, 12 in 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:18 smithi082 ceph-mon[94281]: pgmap v2111: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 998 B/s wr, 13 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:20 smithi082 ceph-mon[94281]: pgmap v2112: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:12:26.310 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:22 smithi082 ceph-mon[94281]: pgmap v2113: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:12:26.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:24 smithi082 ceph-mon[94281]: pgmap v2114: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:26.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:26 smithi082 ceph-mon[94281]: pgmap v2115: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:26.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:28 smithi082 ceph-mon[94281]: pgmap v2116: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 456 B/s wr, 14 op/s 2023-03-17T12:12:26.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:30 smithi082 ceph-mon[94281]: pgmap v2117: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:12:26.311 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:32 smithi082 ceph-mon[94281]: pgmap v2118: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:12:27.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:34 smithi082 ceph-mon[94281]: pgmap v2119: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:12:27.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:36 smithi082 ceph-mon[94281]: pgmap v2120: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:27.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:38 smithi082 ceph-mon[94281]: pgmap v2121: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:40 smithi082 ceph-mon[94281]: pgmap v2122: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:42 smithi082 ceph-mon[94281]: pgmap v2123: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:44 smithi082 ceph-mon[94281]: pgmap v2124: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:46 smithi082 ceph-mon[94281]: pgmap v2125: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:48 smithi082 ceph-mon[94281]: pgmap v2126: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:50 smithi082 ceph-mon[94281]: pgmap v2127: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:52 smithi082 ceph-mon[94281]: pgmap v2128: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:54 smithi082 ceph-mon[94281]: pgmap v2129: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:56 smithi082 ceph-mon[94281]: pgmap v2130: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:27.591 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:29.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:58 smithi082 ceph-mon[94281]: pgmap v2131: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:29.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:58 smithi082 ceph-mon[94281]: pgmap v2132: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:12:29.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:51:58 smithi082 ceph-mon[94281]: pgmap v2133: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:12:29.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:00 smithi082 ceph-mon[94281]: pgmap v2134: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:03 smithi082 ceph-mon[94281]: pgmap v2135: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:04 smithi082 ceph-mon[94281]: pgmap v2136: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:06 smithi082 ceph-mon[94281]: pgmap v2137: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:08 smithi082 ceph-mon[94281]: pgmap v2138: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:10 smithi082 ceph-mon[94281]: osdmap e209: 12 total, 12 up, 12 in 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:10 smithi082 ceph-mon[94281]: pgmap v2140: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:12 smithi082 ceph-mon[94281]: pgmap v2141: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:29.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:14 smithi082 ceph-mon[94281]: pgmap v2142: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:29.983 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:16 smithi082 ceph-mon[94281]: osdmap e210: 12 total, 12 up, 12 in 2023-03-17T12:12:29.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:16 smithi082 ceph-mon[94281]: pgmap v2144: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:12:29.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:18 smithi082 ceph-mon[94281]: pgmap v2145: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:12:29.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:20 smithi082 ceph-mon[94281]: pgmap v2146: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:22 smithi082 ceph-mon[94281]: pgmap v2147: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:24 smithi082 ceph-mon[94281]: pgmap v2148: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:26 smithi082 ceph-mon[94281]: pgmap v2149: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:28 smithi082 ceph-mon[94281]: pgmap v2150: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:30 smithi082 ceph-mon[94281]: pgmap v2151: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:32 smithi082 ceph-mon[94281]: pgmap v2152: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:34 smithi082 ceph-mon[94281]: pgmap v2153: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:36 smithi082 ceph-mon[94281]: pgmap v2154: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:38 smithi082 ceph-mon[94281]: pgmap v2155: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:40 smithi082 ceph-mon[94281]: pgmap v2156: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:42 smithi082 ceph-mon[94281]: pgmap v2157: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:29.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:44 smithi082 ceph-mon[94281]: pgmap v2158: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:30.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:46 smithi082 ceph-mon[94281]: pgmap v2159: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:30.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:48 smithi082 ceph-mon[94281]: pgmap v2160: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:30.557 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:50 smithi082 ceph-mon[94281]: pgmap v2161: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:52 smithi082 ceph-mon[94281]: pgmap v2162: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:54 smithi082 ceph-mon[94281]: pgmap v2163: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:56 smithi082 ceph-mon[94281]: pgmap v2164: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:58 smithi082 ceph-mon[94281]: pgmap v2165: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:59 smithi082 ceph-mon[94281]: pgmap v2166: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:12:31.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:59 smithi082 ceph-mon[94281]: pgmap v2167: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:12:31.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:52:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:31.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:01 smithi082 ceph-mon[94281]: pgmap v2168: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:12:31.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:03 smithi082 ceph-mon[94281]: pgmap v2169: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:04 smithi082 ceph-mon[94281]: osdmap e211: 12 total, 12 up, 12 in 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:05 smithi082 ceph-mon[94281]: pgmap v2171: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:07 smithi082 ceph-mon[94281]: pgmap v2172: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 67 KiB/s wr, 28 op/s 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:09 smithi082 ceph-mon[94281]: pgmap v2173: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:11 smithi082 ceph-mon[94281]: pgmap v2174: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:11 smithi082 ceph-mon[94281]: osdmap e212: 12 total, 12 up, 12 in 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:13 smithi082 ceph-mon[94281]: pgmap v2176: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 463 B/s wr, 10 op/s 2023-03-17T12:12:32.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:14 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:12:33.144 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:14 smithi082 ceph-mon[94281]: osdmap e213: 12 total, 12 up, 12 in 2023-03-17T12:12:33.145 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:15 smithi082 ceph-mon[94281]: pgmap v2178: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 11 op/s 2023-03-17T12:12:33.145 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/2800644014,v1:172.21.15.35:6837/2800644014] up:boot 2023-03-17T12:12:33.146 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:12:35.340 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:12:35.340 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:12:35.340 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:17 smithi082 ceph-mon[94281]: pgmap v2179: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:19 smithi082 ceph-mon[94281]: pgmap v2180: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:21 smithi082 ceph-mon[94281]: pgmap v2181: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 519 B/s wr, 9 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:23 smithi082 ceph-mon[94281]: pgmap v2182: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:25 smithi082 ceph-mon[94281]: pgmap v2183: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 408 B/s wr, 10 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:27 smithi082 ceph-mon[94281]: pgmap v2184: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:29 smithi082 ceph-mon[94281]: pgmap v2185: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:32 smithi082 ceph-mon[94281]: pgmap v2186: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:34 smithi082 ceph-mon[94281]: pgmap v2187: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:36 smithi082 ceph-mon[94281]: pgmap v2188: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:38 smithi082 ceph-mon[94281]: pgmap v2189: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:40 smithi082 ceph-mon[94281]: pgmap v2190: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:36.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:42 smithi082 ceph-mon[94281]: pgmap v2191: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:44 smithi082 ceph-mon[94281]: pgmap v2192: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:46 smithi082 ceph-mon[94281]: pgmap v2193: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:47 smithi082 ceph-mon[94281]: pgmap v2194: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:49 smithi082 ceph-mon[94281]: pgmap v2195: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:51 smithi082 ceph-mon[94281]: pgmap v2196: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:53 smithi082 ceph-mon[94281]: pgmap v2197: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:55 smithi082 ceph-mon[94281]: pgmap v2198: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:57 smithi082 ceph-mon[94281]: pgmap v2199: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:59 smithi082 ceph-mon[94281]: pgmap v2200: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:53:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:00 smithi082 ceph-mon[94281]: pgmap v2201: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:12:36.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:00 smithi082 ceph-mon[94281]: pgmap v2202: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:12:36.643 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:02 smithi082 ceph-mon[94281]: pgmap v2203: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:12:36.643 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:05 smithi082 ceph-mon[94281]: pgmap v2204: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:39.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:07 smithi082 ceph-mon[94281]: pgmap v2205: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:09 smithi082 ceph-mon[94281]: pgmap v2206: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:10 smithi082 ceph-mon[94281]: osdmap e214: 12 total, 12 up, 12 in 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:11 smithi082 ceph-mon[94281]: pgmap v2208: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:13 smithi082 ceph-mon[94281]: pgmap v2209: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:15 smithi082 ceph-mon[94281]: pgmap v2210: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:16 smithi082 ceph-mon[94281]: pgmap v2211: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:40.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:16 smithi082 ceph-mon[94281]: osdmap e215: 12 total, 12 up, 12 in 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:18 smithi082 ceph-mon[94281]: pgmap v2213: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 355 B/s wr, 12 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:20 smithi082 ceph-mon[94281]: pgmap v2214: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:22 smithi082 ceph-mon[94281]: pgmap v2215: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:24 smithi082 ceph-mon[94281]: pgmap v2216: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:26 smithi082 ceph-mon[94281]: pgmap v2217: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:28 smithi082 ceph-mon[94281]: pgmap v2218: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 175 B/s wr, 13 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:31 smithi082 ceph-mon[94281]: pgmap v2219: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:40.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:33 smithi082 ceph-mon[94281]: pgmap v2220: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:42.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:35 smithi082 ceph-mon[94281]: pgmap v2221: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:44.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:37 smithi082 ceph-mon[94281]: pgmap v2222: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:39 smithi082 ceph-mon[94281]: pgmap v2223: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:41 smithi082 ceph-mon[94281]: pgmap v2224: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:43 smithi082 ceph-mon[94281]: pgmap v2225: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:45 smithi082 ceph-mon[94281]: pgmap v2226: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:47 smithi082 ceph-mon[94281]: pgmap v2227: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:49 smithi082 ceph-mon[94281]: pgmap v2228: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:51 smithi082 ceph-mon[94281]: pgmap v2229: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:52 smithi082 ceph-mon[94281]: pgmap v2230: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:54 smithi082 ceph-mon[94281]: pgmap v2231: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:56 smithi082 ceph-mon[94281]: pgmap v2232: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:58 smithi082 ceph-mon[94281]: pgmap v2233: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:54:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:01 smithi082 ceph-mon[94281]: pgmap v2234: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:44.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:02 smithi082 ceph-mon[94281]: pgmap v2235: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:12:45.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:02 smithi082 ceph-mon[94281]: pgmap v2236: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:12:45.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:04 smithi082 ceph-mon[94281]: pgmap v2237: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:46.895 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:06 smithi082 ceph-mon[94281]: pgmap v2238: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:46.895 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:08 smithi082 ceph-mon[94281]: pgmap v2239: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:12:46.895 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:10 smithi082 ceph-mon[94281]: pgmap v2240: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:12:47.829 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:10 smithi082 ceph-mon[94281]: osdmap e216: 12 total, 12 up, 12 in 2023-03-17T12:12:47.829 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:12 smithi082 ceph-mon[94281]: pgmap v2242: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:12:47.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:14 smithi082 ceph-mon[94281]: pgmap v2243: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:47.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:16 smithi082 ceph-mon[94281]: pgmap v2244: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:48.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:16 smithi082 ceph-mon[94281]: osdmap e217: 12 total, 12 up, 12 in 2023-03-17T12:12:48.753 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:17 smithi082 ceph-mon[94281]: pgmap v2246: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:12:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:19 smithi082 ceph-mon[94281]: pgmap v2247: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-17T12:12:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:21 smithi082 ceph-mon[94281]: pgmap v2248: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:12:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:24 smithi082 ceph-mon[94281]: pgmap v2249: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:12:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:26 smithi082 ceph-mon[94281]: pgmap v2250: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:12:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:28 smithi082 ceph-mon[94281]: pgmap v2251: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 877 B/s wr, 10 op/s 2023-03-17T12:12:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:30 smithi082 ceph-mon[94281]: pgmap v2252: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:32 smithi082 ceph-mon[94281]: pgmap v2253: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:34 smithi082 ceph-mon[94281]: pgmap v2254: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:36 smithi082 ceph-mon[94281]: pgmap v2255: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:38 smithi082 ceph-mon[94281]: pgmap v2256: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:40 smithi082 ceph-mon[94281]: pgmap v2257: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:42 smithi082 ceph-mon[94281]: pgmap v2258: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:44 smithi082 ceph-mon[94281]: pgmap v2259: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:46 smithi082 ceph-mon[94281]: pgmap v2260: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:48 smithi082 ceph-mon[94281]: pgmap v2261: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:52.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:50 smithi082 ceph-mon[94281]: pgmap v2262: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:52 smithi082 ceph-mon[94281]: pgmap v2263: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:54 smithi082 ceph-mon[94281]: pgmap v2264: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:56 smithi082 ceph-mon[94281]: pgmap v2265: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:55:58 smithi082 ceph-mon[94281]: pgmap v2266: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:00 smithi082 ceph-mon[94281]: pgmap v2267: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:02 smithi082 ceph-mon[94281]: pgmap v2268: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:03 smithi082 ceph-mon[94281]: pgmap v2269: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:03 smithi082 ceph-mon[94281]: pgmap v2270: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:05 smithi082 ceph-mon[94281]: pgmap v2271: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:05 smithi082 ceph-mon[94281]: osdmap e218: 12 total, 12 up, 12 in 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:07 smithi082 ceph-mon[94281]: pgmap v2273: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T12:12:52.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:09 smithi082 ceph-mon[94281]: pgmap v2274: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 79 KiB/s wr, 40 op/s 2023-03-17T12:12:52.049 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:10 smithi082 ceph-mon[94281]: pgmap v2275: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-17T12:12:52.049 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:12 smithi082 ceph-mon[94281]: osdmap e219: 12 total, 12 up, 12 in 2023-03-17T12:12:52.049 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:13 smithi082 ceph-mon[94281]: pgmap v2277: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2023-03-17T12:12:52.049 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:15 smithi082 ceph-mon[94281]: pgmap v2278: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 551 B/s wr, 9 op/s 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:15 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:15 smithi082 ceph-mon[94281]: osdmap e220: 12 total, 12 up, 12 in 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:16 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/4214884183,v1:172.21.15.35:6837/4214884183] up:boot 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:16 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:16 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:12:54.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:17 smithi082 ceph-mon[94281]: pgmap v2280: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:19 smithi082 ceph-mon[94281]: pgmap v2281: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 127 B/s wr, 11 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:21 smithi082 ceph-mon[94281]: pgmap v2282: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 123 B/s wr, 11 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:23 smithi082 ceph-mon[94281]: pgmap v2283: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:25 smithi082 ceph-mon[94281]: pgmap v2284: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:27 smithi082 ceph-mon[94281]: pgmap v2285: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:29 smithi082 ceph-mon[94281]: pgmap v2286: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:31 smithi082 ceph-mon[94281]: pgmap v2287: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:33 smithi082 ceph-mon[94281]: pgmap v2288: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:35 smithi082 ceph-mon[94281]: pgmap v2289: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:37 smithi082 ceph-mon[94281]: pgmap v2290: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:39 smithi082 ceph-mon[94281]: pgmap v2291: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:41 smithi082 ceph-mon[94281]: pgmap v2292: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:43 smithi082 ceph-mon[94281]: pgmap v2293: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:45 smithi082 ceph-mon[94281]: pgmap v2294: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:54.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:47 smithi082 ceph-mon[94281]: pgmap v2295: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:49 smithi082 ceph-mon[94281]: pgmap v2296: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:54.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:51 smithi082 ceph-mon[94281]: pgmap v2297: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:52 smithi082 ceph-mon[94281]: pgmap v2298: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:54.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:54 smithi082 ceph-mon[94281]: pgmap v2299: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:57 smithi082 ceph-mon[94281]: pgmap v2300: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:56:59 smithi082 ceph-mon[94281]: pgmap v2301: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:12:55.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:01 smithi082 ceph-mon[94281]: pgmap v2302: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:55.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:56.741 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:57.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:57.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:03 smithi082 ceph-mon[94281]: pgmap v2303: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:57.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:12:57.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:12:57.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:57.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:04 smithi082 ceph-mon[94281]: pgmap v2304: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 28 op/s 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:04 smithi082 ceph-mon[94281]: pgmap v2305: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:06 smithi082 ceph-mon[94281]: pgmap v2306: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:08 smithi082 ceph-mon[94281]: pgmap v2307: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 57 KiB/s wr, 24 op/s 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:10 smithi082 ceph-mon[94281]: pgmap v2308: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:10 smithi082 ceph-mon[94281]: osdmap e221: 12 total, 12 up, 12 in 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:12 smithi082 ceph-mon[94281]: pgmap v2310: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:12:57.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:14 smithi082 ceph-mon[94281]: pgmap v2311: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:12:58.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:16 smithi082 ceph-mon[94281]: pgmap v2312: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:12:58.770 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:17 smithi082 ceph-mon[94281]: osdmap e222: 12 total, 12 up, 12 in 2023-03-17T12:12:58.770 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:18 smithi082 ceph-mon[94281]: pgmap v2314: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:12:59.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:20 smithi082 ceph-mon[94281]: pgmap v2315: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 535 B/s wr, 11 op/s 2023-03-17T12:12:59.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:22 smithi082 ceph-mon[94281]: pgmap v2316: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:59.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:24 smithi082 ceph-mon[94281]: pgmap v2317: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:59.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:26 smithi082 ceph-mon[94281]: pgmap v2318: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:12:59.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:27 smithi082 ceph-mon[94281]: pgmap v2319: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 483 B/s wr, 10 op/s 2023-03-17T12:12:59.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:29 smithi082 ceph-mon[94281]: pgmap v2320: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:32 smithi082 ceph-mon[94281]: pgmap v2321: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:34 smithi082 ceph-mon[94281]: pgmap v2322: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:36 smithi082 ceph-mon[94281]: pgmap v2323: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:38 smithi082 ceph-mon[94281]: pgmap v2324: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:40 smithi082 ceph-mon[94281]: pgmap v2325: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:42 smithi082 ceph-mon[94281]: pgmap v2326: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:44 smithi082 ceph-mon[94281]: pgmap v2327: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:46 smithi082 ceph-mon[94281]: pgmap v2328: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:48 smithi082 ceph-mon[94281]: pgmap v2329: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:50 smithi082 ceph-mon[94281]: pgmap v2330: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:52 smithi082 ceph-mon[94281]: pgmap v2331: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.647 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:54 smithi082 ceph-mon[94281]: pgmap v2332: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:56 smithi082 ceph-mon[94281]: pgmap v2333: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:57:58 smithi082 ceph-mon[94281]: pgmap v2334: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:00 smithi082 ceph-mon[94281]: pgmap v2335: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:02 smithi082 ceph-mon[94281]: pgmap v2336: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:04 smithi082 ceph-mon[94281]: pgmap v2337: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: pgmap v2338: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:59.648 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:59.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:59.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:12:59.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:13:00.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:13:00.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:01.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:13:01.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:13:01.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: pgmap v2339: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:01.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:13:02.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:13:02.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: pgmap v2340: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:02.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:08 smithi082 ceph-mon[94281]: pgmap v2341: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 66 KiB/s wr, 28 op/s 2023-03-17T12:13:02.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:09 smithi082 ceph-mon[94281]: pgmap v2342: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 34 op/s 2023-03-17T12:13:02.548 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:10 smithi082 ceph-mon[94281]: osdmap e223: 12 total, 12 up, 12 in 2023-03-17T12:13:03.124 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:12 smithi082 ceph-mon[94281]: pgmap v2344: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T12:13:03.124 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:14 smithi082 ceph-mon[94281]: pgmap v2345: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 340 B/s wr, 17 op/s 2023-03-17T12:13:03.124 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:16 smithi082 ceph-mon[94281]: pgmap v2346: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:03.124 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:16 smithi082 ceph-mon[94281]: osdmap e224: 12 total, 12 up, 12 in 2023-03-17T12:13:03.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:18 smithi082 ceph-mon[94281]: pgmap v2348: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:13:03.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:20 smithi082 ceph-mon[94281]: pgmap v2349: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 321 B/s wr, 10 op/s 2023-03-17T12:13:03.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:22 smithi082 ceph-mon[94281]: pgmap v2350: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:13:03.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:24 smithi082 ceph-mon[94281]: pgmap v2351: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:03.941 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:26 smithi082 ceph-mon[94281]: pgmap v2352: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:03.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:28 smithi082 ceph-mon[94281]: pgmap v2353: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 193 B/s wr, 9 op/s 2023-03-17T12:13:03.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:30 smithi082 ceph-mon[94281]: pgmap v2354: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:13:03.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:32 smithi082 ceph-mon[94281]: pgmap v2355: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:03.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:34 smithi082 ceph-mon[94281]: pgmap v2356: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:03.942 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:36 smithi082 ceph-mon[94281]: pgmap v2357: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:04.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:37 smithi082 ceph-mon[94281]: pgmap v2358: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:06.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:39 smithi082 ceph-mon[94281]: pgmap v2359: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:06.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:42 smithi082 ceph-mon[94281]: pgmap v2360: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:06.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:44 smithi082 ceph-mon[94281]: pgmap v2361: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:06.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:46 smithi082 ceph-mon[94281]: pgmap v2362: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:06.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:48 smithi082 ceph-mon[94281]: pgmap v2363: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:06.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:50 smithi082 ceph-mon[94281]: pgmap v2364: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:06.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:52 smithi082 ceph-mon[94281]: pgmap v2365: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:06.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:54 smithi082 ceph-mon[94281]: pgmap v2366: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:06.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:55 smithi082 ceph-mon[94281]: pgmap v2367: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:58:58 smithi082 ceph-mon[94281]: pgmap v2368: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:00 smithi082 ceph-mon[94281]: pgmap v2369: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:02 smithi082 ceph-mon[94281]: pgmap v2370: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:04 smithi082 ceph-mon[94281]: pgmap v2371: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:06 smithi082 ceph-mon[94281]: pgmap v2372: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:08 smithi082 ceph-mon[94281]: pgmap v2373: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:07.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:08 smithi082 ceph-mon[94281]: pgmap v2374: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:08 smithi082 ceph-mon[94281]: pgmap v2375: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:10 smithi082 ceph-mon[94281]: osdmap e225: 12 total, 12 up, 12 in 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:10 smithi082 ceph-mon[94281]: pgmap v2377: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:13 smithi082 ceph-mon[94281]: pgmap v2378: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:15 smithi082 ceph-mon[94281]: pgmap v2379: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:17 smithi082 ceph-mon[94281]: pgmap v2380: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:17 smithi082 ceph-mon[94281]: osdmap e226: 12 total, 12 up, 12 in 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:19 smithi082 ceph-mon[94281]: pgmap v2382: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:21 smithi082 ceph-mon[94281]: pgmap v2383: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:23 smithi082 ceph-mon[94281]: pgmap v2384: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:25 smithi082 ceph-mon[94281]: pgmap v2385: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:27 smithi082 ceph-mon[94281]: pgmap v2386: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:28 smithi082 ceph-mon[94281]: pgmap v2387: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 807 B/s wr, 14 op/s 2023-03-17T12:13:07.743 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:30 smithi082 ceph-mon[94281]: pgmap v2388: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:07.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:33 smithi082 ceph-mon[94281]: pgmap v2389: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:07.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:35 smithi082 ceph-mon[94281]: pgmap v2390: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:07.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:37 smithi082 ceph-mon[94281]: pgmap v2391: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:08.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:39 smithi082 ceph-mon[94281]: pgmap v2392: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:09.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:41 smithi082 ceph-mon[94281]: pgmap v2393: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:09.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:42 smithi082 ceph-mon[94281]: pgmap v2394: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:44 smithi082 ceph-mon[94281]: pgmap v2395: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:47 smithi082 ceph-mon[94281]: pgmap v2396: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:49 smithi082 ceph-mon[94281]: pgmap v2397: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:51 smithi082 ceph-mon[94281]: pgmap v2398: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:53 smithi082 ceph-mon[94281]: pgmap v2399: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:54 smithi082 ceph-mon[94281]: pgmap v2400: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:09.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:57 smithi082 ceph-mon[94281]: pgmap v2401: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 09:59:59 smithi082 ceph-mon[94281]: pgmap v2402: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:01 smithi082 ceph-mon[94281]: pgmap v2403: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:02 smithi082 ceph-mon[94281]: pgmap v2404: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:04 smithi082 ceph-mon[94281]: osdmap e227: 12 total, 12 up, 12 in 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:04 smithi082 ceph-mon[94281]: pgmap v2406: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:09.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:07 smithi082 ceph-mon[94281]: pgmap v2407: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:09.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:09.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:09.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:09 smithi082 ceph-mon[94281]: pgmap v2408: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:13:09.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:09.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:09.142 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:10.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:10 smithi082 ceph-mon[94281]: pgmap v2409: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:10 smithi082 ceph-mon[94281]: pgmap v2410: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 74 KiB/s wr, 38 op/s 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:12 smithi082 ceph-mon[94281]: pgmap v2411: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 550 B/s wr, 6 op/s 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:12 smithi082 ceph-mon[94281]: osdmap e228: 12 total, 12 up, 12 in 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:14 smithi082 ceph-mon[94281]: pgmap v2413: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 700 B/s wr, 12 op/s 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:15 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:15 smithi082 ceph-mon[94281]: osdmap e229: 12 total, 12 up, 12 in 2023-03-17T12:13:10.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:16 smithi082 ceph-mon[94281]: pgmap v2415: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-03-17T12:13:10.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:16 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/1983264099,v1:172.21.15.35:6837/1983264099] up:boot 2023-03-17T12:13:10.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:16 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:13:10.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:13:10.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:16 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:13:10.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:18 smithi082 ceph-mon[94281]: pgmap v2416: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:13:10.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:19 smithi082 ceph-mon[94281]: pgmap v2417: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:22 smithi082 ceph-mon[94281]: pgmap v2418: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 526 B/s wr, 10 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:24 smithi082 ceph-mon[94281]: pgmap v2419: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:26 smithi082 ceph-mon[94281]: pgmap v2420: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 407 B/s wr, 10 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:27 smithi082 ceph-mon[94281]: pgmap v2421: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:29 smithi082 ceph-mon[94281]: pgmap v2422: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:32 smithi082 ceph-mon[94281]: pgmap v2423: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:34 smithi082 ceph-mon[94281]: pgmap v2424: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:13:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:35 smithi082 ceph-mon[94281]: pgmap v2425: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:37 smithi082 ceph-mon[94281]: pgmap v2426: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:39 smithi082 ceph-mon[94281]: pgmap v2427: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:42 smithi082 ceph-mon[94281]: pgmap v2428: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:43 smithi082 ceph-mon[94281]: pgmap v2429: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:45 smithi082 ceph-mon[94281]: pgmap v2430: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:48 smithi082 ceph-mon[94281]: pgmap v2431: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:49 smithi082 ceph-mon[94281]: pgmap v2432: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:52 smithi082 ceph-mon[94281]: pgmap v2433: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:53 smithi082 ceph-mon[94281]: pgmap v2434: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:55 smithi082 ceph-mon[94281]: pgmap v2435: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:57 smithi082 ceph-mon[94281]: pgmap v2436: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:00:59 smithi082 ceph-mon[94281]: pgmap v2437: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:02 smithi082 ceph-mon[94281]: pgmap v2438: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:03 smithi082 ceph-mon[94281]: pgmap v2439: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:05 smithi082 ceph-mon[94281]: pgmap v2440: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:11.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:07 smithi082 ceph-mon[94281]: pgmap v2441: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:12.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:09 smithi082 ceph-mon[94281]: osdmap e230: 12 total, 12 up, 12 in 2023-03-17T12:13:12.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:09 smithi082 ceph-mon[94281]: pgmap v2443: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:12.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:12.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:12.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:12.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:10 smithi082 ceph-mon[94281]: pgmap v2444: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:13:12.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:10 smithi082 ceph-mon[94281]: pgmap v2445: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:13:12.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:12.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:12 smithi082 ceph-mon[94281]: pgmap v2446: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:13:12.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:14 smithi082 ceph-mon[94281]: pgmap v2447: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:13:12.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:16 smithi082 ceph-mon[94281]: pgmap v2448: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:13:13.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:16 smithi082 ceph-mon[94281]: osdmap e231: 12 total, 12 up, 12 in 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:18 smithi082 ceph-mon[94281]: pgmap v2450: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:20 smithi082 ceph-mon[94281]: pgmap v2451: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:22 smithi082 ceph-mon[94281]: pgmap v2452: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:24 smithi082 ceph-mon[94281]: pgmap v2453: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:26 smithi082 ceph-mon[94281]: pgmap v2454: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:28 smithi082 ceph-mon[94281]: pgmap v2455: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:30 smithi082 ceph-mon[94281]: pgmap v2456: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:32 smithi082 ceph-mon[94281]: pgmap v2457: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:34 smithi082 ceph-mon[94281]: pgmap v2458: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:36 smithi082 ceph-mon[94281]: pgmap v2459: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:38 smithi082 ceph-mon[94281]: pgmap v2460: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:40 smithi082 ceph-mon[94281]: pgmap v2461: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:42 smithi082 ceph-mon[94281]: pgmap v2462: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:13.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:44 smithi082 ceph-mon[94281]: pgmap v2463: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:46 smithi082 ceph-mon[94281]: pgmap v2464: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:48 smithi082 ceph-mon[94281]: pgmap v2465: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:50 smithi082 ceph-mon[94281]: pgmap v2466: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:52 smithi082 ceph-mon[94281]: pgmap v2467: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:54 smithi082 ceph-mon[94281]: pgmap v2468: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:56 smithi082 ceph-mon[94281]: pgmap v2469: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:01:58 smithi082 ceph-mon[94281]: pgmap v2470: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:00 smithi082 ceph-mon[94281]: pgmap v2471: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:02 smithi082 ceph-mon[94281]: pgmap v2472: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:04 smithi082 ceph-mon[94281]: osdmap e232: 12 total, 12 up, 12 in 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:04 smithi082 ceph-mon[94281]: pgmap v2474: 97 pgs: 97 active+clean; 1.7 MiB data, 312 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:06 smithi082 ceph-mon[94281]: pgmap v2475: 97 pgs: 97 active+clean; 1.7 MiB data, 312 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:08 smithi082 ceph-mon[94281]: pgmap v2476: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:10 smithi082 ceph-mon[94281]: pgmap v2477: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:13.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:11 smithi082 ceph-mon[94281]: pgmap v2478: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:11 smithi082 ceph-mon[94281]: pgmap v2479: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 431 B/s wr, 6 op/s 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:11 smithi082 ceph-mon[94281]: osdmap e233: 12 total, 12 up, 12 in 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:13 smithi082 ceph-mon[94281]: pgmap v2481: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 601 B/s wr, 13 op/s 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:14 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:14 smithi082 ceph-mon[94281]: osdmap e234: 12 total, 12 up, 12 in 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:15 smithi082 ceph-mon[94281]: pgmap v2482: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 150 B/s wr, 6 op/s 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:15 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/257124184,v1:172.21.15.35:6837/257124184] up:boot 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:17 smithi082 ceph-mon[94281]: pgmap v2484: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-03-17T12:13:13.543 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:19 smithi082 ceph-mon[94281]: pgmap v2485: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:13:13.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:21 smithi082 ceph-mon[94281]: pgmap v2486: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 546 B/s wr, 10 op/s 2023-03-17T12:13:13.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:23 smithi082 ceph-mon[94281]: pgmap v2487: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:13:13.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:25 smithi082 ceph-mon[94281]: pgmap v2488: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:13:13.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:27 smithi082 ceph-mon[94281]: pgmap v2489: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 342 B/s wr, 9 op/s 2023-03-17T12:13:13.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:29 smithi082 ceph-mon[94281]: pgmap v2490: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:13:13.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:31 smithi082 ceph-mon[94281]: pgmap v2491: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:15.619 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:33 smithi082 ceph-mon[94281]: pgmap v2492: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:35 smithi082 ceph-mon[94281]: pgmap v2493: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:37 smithi082 ceph-mon[94281]: pgmap v2494: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:39 smithi082 ceph-mon[94281]: pgmap v2495: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:41 smithi082 ceph-mon[94281]: pgmap v2496: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:43 smithi082 ceph-mon[94281]: pgmap v2497: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:45 smithi082 ceph-mon[94281]: pgmap v2498: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:47 smithi082 ceph-mon[94281]: pgmap v2499: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:15.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:49 smithi082 ceph-mon[94281]: pgmap v2500: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:17.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:51 smithi082 ceph-mon[94281]: pgmap v2501: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:17.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:53 smithi082 ceph-mon[94281]: pgmap v2502: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:17.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:55 smithi082 ceph-mon[94281]: pgmap v2503: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:18.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:57 smithi082 ceph-mon[94281]: pgmap v2504: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:18.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:02:59 smithi082 ceph-mon[94281]: pgmap v2505: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:18.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:01 smithi082 ceph-mon[94281]: pgmap v2506: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:18.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:03 smithi082 ceph-mon[94281]: pgmap v2507: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:18.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:05 smithi082 ceph-mon[94281]: pgmap v2508: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:18.269 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:07 smithi082 ceph-mon[94281]: pgmap v2509: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:18.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:09 smithi082 ceph-mon[94281]: osdmap e235: 12 total, 12 up, 12 in 2023-03-17T12:13:18.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:09 smithi082 ceph-mon[94281]: pgmap v2511: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:18.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:11 smithi082 ceph-mon[94281]: pgmap v2512: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:18.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:18.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:12 smithi082 ceph-mon[94281]: pgmap v2513: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:12 smithi082 ceph-mon[94281]: pgmap v2514: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:14 smithi082 ceph-mon[94281]: pgmap v2515: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:16 smithi082 ceph-mon[94281]: pgmap v2516: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 147 B/s wr, 7 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:16 smithi082 ceph-mon[94281]: osdmap e236: 12 total, 12 up, 12 in 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:18 smithi082 ceph-mon[94281]: pgmap v2518: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:20 smithi082 ceph-mon[94281]: pgmap v2519: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:22 smithi082 ceph-mon[94281]: pgmap v2520: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:18.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:24 smithi082 ceph-mon[94281]: pgmap v2521: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:26 smithi082 ceph-mon[94281]: pgmap v2522: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:28 smithi082 ceph-mon[94281]: pgmap v2523: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 91 B/s wr, 13 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:30 smithi082 ceph-mon[94281]: pgmap v2524: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:32 smithi082 ceph-mon[94281]: pgmap v2525: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:34 smithi082 ceph-mon[94281]: pgmap v2526: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:36 smithi082 ceph-mon[94281]: pgmap v2527: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:38 smithi082 ceph-mon[94281]: pgmap v2528: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:40 smithi082 ceph-mon[94281]: pgmap v2529: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:42 smithi082 ceph-mon[94281]: pgmap v2530: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:44 smithi082 ceph-mon[94281]: pgmap v2531: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:46 smithi082 ceph-mon[94281]: pgmap v2532: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.824 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:48 smithi082 ceph-mon[94281]: pgmap v2533: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:19.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:50 smithi082 ceph-mon[94281]: pgmap v2534: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:52 smithi082 ceph-mon[94281]: pgmap v2535: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:54 smithi082 ceph-mon[94281]: pgmap v2536: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:19.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:56 smithi082 ceph-mon[94281]: pgmap v2537: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:19.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:03:58 smithi082 ceph-mon[94281]: pgmap v2538: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:20.598 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:00 smithi082 ceph-mon[94281]: pgmap v2539: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:20.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:02 smithi082 ceph-mon[94281]: pgmap v2540: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:20.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:04 smithi082 ceph-mon[94281]: pgmap v2541: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:13:20.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:06 smithi082 ceph-mon[94281]: pgmap v2542: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:13:20.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:08 smithi082 ceph-mon[94281]: pgmap v2543: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:13:20.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:09 smithi082 ceph-mon[94281]: osdmap e237: 12 total, 12 up, 12 in 2023-03-17T12:13:22.366 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:10 smithi082 ceph-mon[94281]: pgmap v2545: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:13:22.366 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:12 smithi082 ceph-mon[94281]: pgmap v2546: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:13 smithi082 ceph-mon[94281]: pgmap v2547: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:13 smithi082 ceph-mon[94281]: pgmap v2548: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.2 KiB/s wr, 15 op/s 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:15 smithi082 ceph-mon[94281]: pgmap v2549: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-03-17T12:13:22.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:17 smithi082 ceph-mon[94281]: pgmap v2550: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:17 smithi082 ceph-mon[94281]: osdmap e238: 12 total, 12 up, 12 in 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:19 smithi082 ceph-mon[94281]: pgmap v2552: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 150 B/s wr, 15 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:21 smithi082 ceph-mon[94281]: pgmap v2553: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:23 smithi082 ceph-mon[94281]: pgmap v2554: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:25 smithi082 ceph-mon[94281]: pgmap v2555: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:27 smithi082 ceph-mon[94281]: pgmap v2556: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:29 smithi082 ceph-mon[94281]: pgmap v2557: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:31 smithi082 ceph-mon[94281]: pgmap v2558: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:33 smithi082 ceph-mon[94281]: pgmap v2559: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:35 smithi082 ceph-mon[94281]: pgmap v2560: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:37 smithi082 ceph-mon[94281]: pgmap v2561: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:39 smithi082 ceph-mon[94281]: pgmap v2562: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:41 smithi082 ceph-mon[94281]: pgmap v2563: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:43 smithi082 ceph-mon[94281]: pgmap v2564: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:45 smithi082 ceph-mon[94281]: pgmap v2565: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:47 smithi082 ceph-mon[94281]: pgmap v2566: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:22.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:49 smithi082 ceph-mon[94281]: pgmap v2567: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:51 smithi082 ceph-mon[94281]: pgmap v2568: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:53 smithi082 ceph-mon[94281]: pgmap v2569: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:55 smithi082 ceph-mon[94281]: pgmap v2570: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:57 smithi082 ceph-mon[94281]: pgmap v2571: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:04:59 smithi082 ceph-mon[94281]: pgmap v2572: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:01 smithi082 ceph-mon[94281]: pgmap v2573: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:03 smithi082 ceph-mon[94281]: pgmap v2574: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:05 smithi082 ceph-mon[94281]: pgmap v2575: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:07 smithi082 ceph-mon[94281]: pgmap v2576: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:09 smithi082 ceph-mon[94281]: pgmap v2577: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:11 smithi082 ceph-mon[94281]: pgmap v2578: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: pgmap v2579: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T12:13:22.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: pgmap v2580: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 189 B/s wr, 9 op/s 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: pgmap v2581: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:16 smithi082 ceph-mon[94281]: pgmap v2582: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:13:25.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:17 smithi082 ceph-mon[94281]: pgmap v2583: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 10 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:20 smithi082 ceph-mon[94281]: pgmap v2584: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:22 smithi082 ceph-mon[94281]: pgmap v2585: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:24 smithi082 ceph-mon[94281]: pgmap v2586: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:26 smithi082 ceph-mon[94281]: pgmap v2587: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:27 smithi082 ceph-mon[94281]: pgmap v2588: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:30 smithi082 ceph-mon[94281]: pgmap v2589: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:29.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:32 smithi082 ceph-mon[94281]: pgmap v2590: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:34 smithi082 ceph-mon[94281]: pgmap v2591: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:36 smithi082 ceph-mon[94281]: pgmap v2592: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:37 smithi082 ceph-mon[94281]: pgmap v2593: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:40 smithi082 ceph-mon[94281]: pgmap v2594: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:42 smithi082 ceph-mon[94281]: pgmap v2595: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:44 smithi082 ceph-mon[94281]: pgmap v2596: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:46 smithi082 ceph-mon[94281]: pgmap v2597: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:47 smithi082 ceph-mon[94281]: pgmap v2598: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:50 smithi082 ceph-mon[94281]: pgmap v2599: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:52 smithi082 ceph-mon[94281]: pgmap v2600: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:30.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:54 smithi082 ceph-mon[94281]: pgmap v2601: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:31.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:56 smithi082 ceph-mon[94281]: pgmap v2602: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:31.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:05:57 smithi082 ceph-mon[94281]: pgmap v2603: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:31.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:00 smithi082 ceph-mon[94281]: pgmap v2604: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:31.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:02 smithi082 ceph-mon[94281]: pgmap v2605: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:04 smithi082 ceph-mon[94281]: pgmap v2606: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:06 smithi082 ceph-mon[94281]: pgmap v2607: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:07 smithi082 ceph-mon[94281]: pgmap v2608: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:09 smithi082 ceph-mon[94281]: osdmap e239: 12 total, 12 up, 12 in 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:09 smithi082 ceph-mon[94281]: pgmap v2610: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:12 smithi082 ceph-mon[94281]: pgmap v2611: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:14 smithi082 ceph-mon[94281]: pgmap v2612: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:31.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:34.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:34.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:34.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:15 smithi082 ceph-mon[94281]: pgmap v2613: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:13:34.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:15 smithi082 ceph-mon[94281]: pgmap v2614: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:17 smithi082 ceph-mon[94281]: pgmap v2615: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 137 B/s wr, 6 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:17 smithi082 ceph-mon[94281]: osdmap e240: 12 total, 12 up, 12 in 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:19 smithi082 ceph-mon[94281]: pgmap v2617: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:21 smithi082 ceph-mon[94281]: pgmap v2618: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:22 smithi082 ceph-mon[94281]: pgmap v2619: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:24 smithi082 ceph-mon[94281]: pgmap v2620: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:26 smithi082 ceph-mon[94281]: pgmap v2621: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:28 smithi082 ceph-mon[94281]: pgmap v2622: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 705 B/s wr, 13 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:30 smithi082 ceph-mon[94281]: pgmap v2623: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:32 smithi082 ceph-mon[94281]: pgmap v2624: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:34 smithi082 ceph-mon[94281]: pgmap v2625: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:34.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:36 smithi082 ceph-mon[94281]: pgmap v2626: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:38 smithi082 ceph-mon[94281]: pgmap v2627: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:40 smithi082 ceph-mon[94281]: pgmap v2628: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:42 smithi082 ceph-mon[94281]: pgmap v2629: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:44 smithi082 ceph-mon[94281]: pgmap v2630: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:46 smithi082 ceph-mon[94281]: pgmap v2631: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:48 smithi082 ceph-mon[94281]: pgmap v2632: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:34.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:50 smithi082 ceph-mon[94281]: pgmap v2633: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:52 smithi082 ceph-mon[94281]: pgmap v2634: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:54 smithi082 ceph-mon[94281]: pgmap v2635: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:56 smithi082 ceph-mon[94281]: pgmap v2636: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:06:58 smithi082 ceph-mon[94281]: pgmap v2637: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:00 smithi082 ceph-mon[94281]: pgmap v2638: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:02 smithi082 ceph-mon[94281]: pgmap v2639: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:04 smithi082 ceph-mon[94281]: pgmap v2640: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:06 smithi082 ceph-mon[94281]: pgmap v2641: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:08 smithi082 ceph-mon[94281]: pgmap v2642: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:09 smithi082 ceph-mon[94281]: osdmap e241: 12 total, 12 up, 12 in 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:10 smithi082 ceph-mon[94281]: pgmap v2644: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:12 smithi082 ceph-mon[94281]: pgmap v2645: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:34.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:14 smithi082 ceph-mon[94281]: pgmap v2646: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:13:36.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:36.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:36.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:36.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:36.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:37.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:15 smithi082 ceph-mon[94281]: pgmap v2647: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 883 B/s wr, 11 op/s 2023-03-17T12:13:37.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:15 smithi082 ceph-mon[94281]: pgmap v2648: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 986 B/s wr, 7 op/s 2023-03-17T12:13:37.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:37.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:17 smithi082 ceph-mon[94281]: osdmap e242: 12 total, 12 up, 12 in 2023-03-17T12:13:38.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:17 smithi082 ceph-mon[94281]: pgmap v2650: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 15 op/s 2023-03-17T12:13:38.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:20 smithi082 ceph-mon[94281]: pgmap v2651: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 15 op/s 2023-03-17T12:13:38.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:22 smithi082 ceph-mon[94281]: pgmap v2652: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:13:38.419 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:24 smithi082 ceph-mon[94281]: pgmap v2653: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:13:40.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:26 smithi082 ceph-mon[94281]: pgmap v2654: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:40.039 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:27 smithi082 ceph-mon[94281]: pgmap v2655: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:30 smithi082 ceph-mon[94281]: pgmap v2656: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:32 smithi082 ceph-mon[94281]: pgmap v2657: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:34 smithi082 ceph-mon[94281]: pgmap v2658: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:36 smithi082 ceph-mon[94281]: pgmap v2659: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:37 smithi082 ceph-mon[94281]: pgmap v2660: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:40 smithi082 ceph-mon[94281]: pgmap v2661: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:42 smithi082 ceph-mon[94281]: pgmap v2662: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:44 smithi082 ceph-mon[94281]: pgmap v2663: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:40.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:46 smithi082 ceph-mon[94281]: pgmap v2664: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:41.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:47 smithi082 ceph-mon[94281]: pgmap v2665: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:41.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:50 smithi082 ceph-mon[94281]: pgmap v2666: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:41.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:52 smithi082 ceph-mon[94281]: pgmap v2667: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:41.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:54 smithi082 ceph-mon[94281]: pgmap v2668: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:41.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:56 smithi082 ceph-mon[94281]: pgmap v2669: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:41.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:07:57 smithi082 ceph-mon[94281]: pgmap v2670: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:41.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:00 smithi082 ceph-mon[94281]: pgmap v2671: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:41.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:02 smithi082 ceph-mon[94281]: pgmap v2672: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:41.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:04 smithi082 ceph-mon[94281]: pgmap v2673: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:41.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:06 smithi082 ceph-mon[94281]: pgmap v2674: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:41.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:07 smithi082 ceph-mon[94281]: pgmap v2675: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:41.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:09 smithi082 ceph-mon[94281]: osdmap e243: 12 total, 12 up, 12 in 2023-03-17T12:13:43.046 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:09 smithi082 ceph-mon[94281]: pgmap v2677: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:43.047 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:12 smithi082 ceph-mon[94281]: pgmap v2678: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:43.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:14 smithi082 ceph-mon[94281]: pgmap v2679: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:43.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:16 smithi082 ceph-mon[94281]: pgmap v2680: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:43.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:43.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:45.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:45.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:17 smithi082 ceph-mon[94281]: osdmap e244: 12 total, 12 up, 12 in 2023-03-17T12:13:45.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:17 smithi082 ceph-mon[94281]: pgmap v2682: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-17T12:13:45.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:45.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:45.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:47.018 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:47.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:47.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:47.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:47.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:47.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:47.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.844 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:13:48.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:13:48.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:13:48.845 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: pgmap v2683: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: pgmap v2684: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:22 smithi082 ceph-mon[94281]: pgmap v2685: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:24 smithi082 ceph-mon[94281]: pgmap v2686: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:26 smithi082 ceph-mon[94281]: pgmap v2687: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 115 B/s wr, 11 op/s 2023-03-17T12:13:50.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:27 smithi082 ceph-mon[94281]: pgmap v2688: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:51.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:30 smithi082 ceph-mon[94281]: pgmap v2689: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:51.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:32 smithi082 ceph-mon[94281]: pgmap v2690: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:34 smithi082 ceph-mon[94281]: pgmap v2691: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:36 smithi082 ceph-mon[94281]: pgmap v2692: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:37 smithi082 ceph-mon[94281]: pgmap v2693: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:40 smithi082 ceph-mon[94281]: pgmap v2694: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:42 smithi082 ceph-mon[94281]: pgmap v2695: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:44 smithi082 ceph-mon[94281]: pgmap v2696: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:46 smithi082 ceph-mon[94281]: pgmap v2697: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:47 smithi082 ceph-mon[94281]: pgmap v2698: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:50 smithi082 ceph-mon[94281]: pgmap v2699: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:52 smithi082 ceph-mon[94281]: pgmap v2700: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:54 smithi082 ceph-mon[94281]: pgmap v2701: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:56 smithi082 ceph-mon[94281]: pgmap v2702: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:51.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:08:57 smithi082 ceph-mon[94281]: pgmap v2703: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:00 smithi082 ceph-mon[94281]: pgmap v2704: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:02 smithi082 ceph-mon[94281]: pgmap v2705: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:04 smithi082 ceph-mon[94281]: pgmap v2706: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:06 smithi082 ceph-mon[94281]: pgmap v2707: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:07 smithi082 ceph-mon[94281]: pgmap v2708: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:09 smithi082 ceph-mon[94281]: osdmap e245: 12 total, 12 up, 12 in 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:09 smithi082 ceph-mon[94281]: pgmap v2710: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:12 smithi082 ceph-mon[94281]: pgmap v2711: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:14 smithi082 ceph-mon[94281]: pgmap v2712: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:13:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:16 smithi082 ceph-mon[94281]: pgmap v2713: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:17 smithi082 ceph-mon[94281]: osdmap e246: 12 total, 12 up, 12 in 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:17 smithi082 ceph-mon[94281]: pgmap v2715: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:20 smithi082 ceph-mon[94281]: pgmap v2716: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:22 smithi082 ceph-mon[94281]: pgmap v2717: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: pgmap v2718: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 952 B/s wr, 11 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: pgmap v2719: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:25 smithi082 ceph-mon[94281]: pgmap v2720: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:27 smithi082 ceph-mon[94281]: pgmap v2721: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 847 B/s wr, 6 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:29 smithi082 ceph-mon[94281]: pgmap v2722: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 847 B/s wr, 11 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:31 smithi082 ceph-mon[94281]: pgmap v2723: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 847 B/s wr, 11 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:33 smithi082 ceph-mon[94281]: pgmap v2724: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:35 smithi082 ceph-mon[94281]: pgmap v2725: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:37 smithi082 ceph-mon[94281]: pgmap v2726: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:39 smithi082 ceph-mon[94281]: pgmap v2727: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:41 smithi082 ceph-mon[94281]: pgmap v2728: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:43 smithi082 ceph-mon[94281]: pgmap v2729: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:45 smithi082 ceph-mon[94281]: pgmap v2730: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:47 smithi082 ceph-mon[94281]: pgmap v2731: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:49 smithi082 ceph-mon[94281]: pgmap v2732: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:51 smithi082 ceph-mon[94281]: pgmap v2733: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:53 smithi082 ceph-mon[94281]: pgmap v2734: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:55 smithi082 ceph-mon[94281]: pgmap v2735: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:57 smithi082 ceph-mon[94281]: pgmap v2736: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:09:59 smithi082 ceph-mon[94281]: pgmap v2737: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:01 smithi082 ceph-mon[94281]: pgmap v2738: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:03 smithi082 ceph-mon[94281]: pgmap v2739: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:05 smithi082 ceph-mon[94281]: pgmap v2740: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:07 smithi082 ceph-mon[94281]: pgmap v2741: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:09 smithi082 ceph-mon[94281]: osdmap e247: 12 total, 12 up, 12 in 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:09 smithi082 ceph-mon[94281]: pgmap v2743: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:11 smithi082 ceph-mon[94281]: pgmap v2744: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:13 smithi082 ceph-mon[94281]: pgmap v2745: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:15 smithi082 ceph-mon[94281]: pgmap v2746: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:17 smithi082 ceph-mon[94281]: osdmap e248: 12 total, 12 up, 12 in 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:17 smithi082 ceph-mon[94281]: pgmap v2748: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 970 B/s wr, 7 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:19 smithi082 ceph-mon[94281]: pgmap v2749: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:21 smithi082 ceph-mon[94281]: pgmap v2750: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:23 smithi082 ceph-mon[94281]: pgmap v2751: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:52.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:25 smithi082 ceph-mon[94281]: pgmap v2752: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:53.705 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:53.705 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:53.705 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:53.705 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:54.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: pgmap v2753: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:13:54.643 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: pgmap v2754: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:13:54.643 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:55.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:29 smithi082 ceph-mon[94281]: pgmap v2755: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:13:55.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:31 smithi082 ceph-mon[94281]: pgmap v2756: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:13:55.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:32 smithi082 ceph-mon[94281]: pgmap v2757: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:13:55.537 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:35 smithi082 ceph-mon[94281]: pgmap v2758: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:13:55.985 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:37 smithi082 ceph-mon[94281]: pgmap v2759: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:55.986 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:39 smithi082 ceph-mon[94281]: pgmap v2760: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:55.986 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:41 smithi082 ceph-mon[94281]: pgmap v2761: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:57.322 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:42 smithi082 ceph-mon[94281]: pgmap v2762: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:57.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:45 smithi082 ceph-mon[94281]: pgmap v2763: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:57.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:47 smithi082 ceph-mon[94281]: pgmap v2764: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:57.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:49 smithi082 ceph-mon[94281]: pgmap v2765: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:57.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:51 smithi082 ceph-mon[94281]: pgmap v2766: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:57.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:52 smithi082 ceph-mon[94281]: pgmap v2767: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:57.868 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:55 smithi082 ceph-mon[94281]: pgmap v2768: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:57 smithi082 ceph-mon[94281]: pgmap v2769: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:10:59 smithi082 ceph-mon[94281]: pgmap v2770: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:01 smithi082 ceph-mon[94281]: pgmap v2771: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:02 smithi082 ceph-mon[94281]: pgmap v2772: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:05 smithi082 ceph-mon[94281]: pgmap v2773: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:07 smithi082 ceph-mon[94281]: pgmap v2774: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:09 smithi082 ceph-mon[94281]: pgmap v2775: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:10 smithi082 ceph-mon[94281]: osdmap e249: 12 total, 12 up, 12 in 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:11 smithi082 ceph-mon[94281]: pgmap v2777: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:12 smithi082 ceph-mon[94281]: pgmap v2778: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:15 smithi082 ceph-mon[94281]: pgmap v2779: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:58.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:17 smithi082 ceph-mon[94281]: pgmap v2780: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:17 smithi082 ceph-mon[94281]: osdmap e250: 12 total, 12 up, 12 in 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:19 smithi082 ceph-mon[94281]: pgmap v2782: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:21 smithi082 ceph-mon[94281]: pgmap v2783: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:22 smithi082 ceph-mon[94281]: pgmap v2784: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:25 smithi082 ceph-mon[94281]: pgmap v2785: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:27 smithi082 ceph-mon[94281]: pgmap v2786: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:29 smithi082 ceph-mon[94281]: pgmap v2787: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: pgmap v2788: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:13:58.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: pgmap v2789: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:32 smithi082 ceph-mon[94281]: pgmap v2790: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:34 smithi082 ceph-mon[94281]: pgmap v2791: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:36 smithi082 ceph-mon[94281]: pgmap v2792: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:38 smithi082 ceph-mon[94281]: pgmap v2793: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:40 smithi082 ceph-mon[94281]: pgmap v2794: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:42 smithi082 ceph-mon[94281]: pgmap v2795: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:44 smithi082 ceph-mon[94281]: pgmap v2796: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:46 smithi082 ceph-mon[94281]: pgmap v2797: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:48 smithi082 ceph-mon[94281]: pgmap v2798: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:50 smithi082 ceph-mon[94281]: pgmap v2799: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:52 smithi082 ceph-mon[94281]: pgmap v2800: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:54 smithi082 ceph-mon[94281]: pgmap v2801: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:56 smithi082 ceph-mon[94281]: pgmap v2802: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:11:58 smithi082 ceph-mon[94281]: pgmap v2803: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:13:58.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:00 smithi082 ceph-mon[94281]: pgmap v2804: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:02 smithi082 ceph-mon[94281]: pgmap v2805: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:04 smithi082 ceph-mon[94281]: pgmap v2806: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:06 smithi082 ceph-mon[94281]: pgmap v2807: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:08 smithi082 ceph-mon[94281]: pgmap v2808: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:09 smithi082 ceph-mon[94281]: osdmap e251: 12 total, 12 up, 12 in 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:10 smithi082 ceph-mon[94281]: pgmap v2810: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:12 smithi082 ceph-mon[94281]: pgmap v2811: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:14 smithi082 ceph-mon[94281]: pgmap v2812: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:16 smithi082 ceph-mon[94281]: pgmap v2813: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:16 smithi082 ceph-mon[94281]: osdmap e252: 12 total, 12 up, 12 in 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:18 smithi082 ceph-mon[94281]: pgmap v2815: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:20 smithi082 ceph-mon[94281]: pgmap v2816: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:22 smithi082 ceph-mon[94281]: pgmap v2817: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:24 smithi082 ceph-mon[94281]: pgmap v2818: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:26 smithi082 ceph-mon[94281]: pgmap v2819: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:28 smithi082 ceph-mon[94281]: pgmap v2820: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 89 B/s wr, 13 op/s 2023-03-17T12:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:30 smithi082 ceph-mon[94281]: pgmap v2821: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:31 smithi082 ceph-mon[94281]: pgmap v2822: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:31 smithi082 ceph-mon[94281]: pgmap v2823: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:33 smithi082 ceph-mon[94281]: pgmap v2824: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:35 smithi082 ceph-mon[94281]: pgmap v2825: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:37 smithi082 ceph-mon[94281]: pgmap v2826: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:39 smithi082 ceph-mon[94281]: pgmap v2827: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:41 smithi082 ceph-mon[94281]: pgmap v2828: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:43 smithi082 ceph-mon[94281]: pgmap v2829: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:45 smithi082 ceph-mon[94281]: pgmap v2830: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:47 smithi082 ceph-mon[94281]: pgmap v2831: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:13:59.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:49 smithi082 ceph-mon[94281]: pgmap v2832: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:51 smithi082 ceph-mon[94281]: pgmap v2833: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:53 smithi082 ceph-mon[94281]: pgmap v2834: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:55 smithi082 ceph-mon[94281]: pgmap v2835: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:57 smithi082 ceph-mon[94281]: pgmap v2836: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:12:59 smithi082 ceph-mon[94281]: pgmap v2837: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:01 smithi082 ceph-mon[94281]: pgmap v2838: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:03 smithi082 ceph-mon[94281]: pgmap v2839: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:05 smithi082 ceph-mon[94281]: pgmap v2840: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:07 smithi082 ceph-mon[94281]: pgmap v2841: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:09 smithi082 ceph-mon[94281]: osdmap e253: 12 total, 12 up, 12 in 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:09 smithi082 ceph-mon[94281]: pgmap v2843: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:13:59.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:11 smithi082 ceph-mon[94281]: pgmap v2844: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:13 smithi082 ceph-mon[94281]: pgmap v2845: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:15 smithi082 ceph-mon[94281]: pgmap v2846: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:17 smithi082 ceph-mon[94281]: osdmap e254: 12 total, 12 up, 12 in 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:17 smithi082 ceph-mon[94281]: pgmap v2848: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 874 B/s wr, 7 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:19 smithi082 ceph-mon[94281]: pgmap v2849: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:21 smithi082 ceph-mon[94281]: pgmap v2850: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:23 smithi082 ceph-mon[94281]: pgmap v2851: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:25 smithi082 ceph-mon[94281]: pgmap v2852: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:14:00.465 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:27 smithi082 ceph-mon[94281]: pgmap v2853: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 498 B/s wr, 10 op/s 2023-03-17T12:14:01.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:29 smithi082 ceph-mon[94281]: pgmap v2854: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:14:02.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:31 smithi082 ceph-mon[94281]: pgmap v2855: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:14:02.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:02.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:02.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:02.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:03.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:32 smithi082 ceph-mon[94281]: pgmap v2856: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:32 smithi082 ceph-mon[94281]: pgmap v2857: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:34 smithi082 ceph-mon[94281]: pgmap v2858: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:36 smithi082 ceph-mon[94281]: pgmap v2859: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:38 smithi082 ceph-mon[94281]: pgmap v2860: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:40 smithi082 ceph-mon[94281]: pgmap v2861: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:42 smithi082 ceph-mon[94281]: pgmap v2862: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:44 smithi082 ceph-mon[94281]: pgmap v2863: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:14:03.519 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:46 smithi082 ceph-mon[94281]: pgmap v2864: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:14:03.520 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:48 smithi082 ceph-mon[94281]: pgmap v2865: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:14:03.520 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:50 smithi082 ceph-mon[94281]: pgmap v2866: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:04.299 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:52 smithi082 ceph-mon[94281]: pgmap v2867: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:05.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:54 smithi082 ceph-mon[94281]: pgmap v2868: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:14:05.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:56 smithi082 ceph-mon[94281]: pgmap v2869: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:05.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:13:58 smithi082 ceph-mon[94281]: pgmap v2870: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:14:05.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:00 smithi082 ceph-mon[94281]: pgmap v2871: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:05.734 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:02 smithi082 ceph-mon[94281]: pgmap v2872: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:05.734 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:04 smithi082 ceph-mon[94281]: pgmap v2873: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:14:05.734 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:06 smithi082 ceph-mon[94281]: pgmap v2874: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:14:06.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:08 smithi082 ceph-mon[94281]: pgmap v2875: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:14:06.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:09 smithi082 ceph-mon[94281]: osdmap e255: 12 total, 12 up, 12 in 2023-03-17T12:14:06.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:10 smithi082 ceph-mon[94281]: pgmap v2877: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:14:06.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:12 smithi082 ceph-mon[94281]: pgmap v2878: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:14:06.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:14 smithi082 ceph-mon[94281]: pgmap v2879: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:16 smithi082 ceph-mon[94281]: pgmap v2880: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:16 smithi082 ceph-mon[94281]: osdmap e256: 12 total, 12 up, 12 in 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:18 smithi082 ceph-mon[94281]: pgmap v2882: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:20 smithi082 ceph-mon[94281]: pgmap v2883: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:22 smithi082 ceph-mon[94281]: pgmap v2884: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:24 smithi082 ceph-mon[94281]: pgmap v2885: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:14:07.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:26 smithi082 ceph-mon[94281]: pgmap v2886: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:14:07.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:28 smithi082 ceph-mon[94281]: pgmap v2887: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 92 B/s wr, 13 op/s 2023-03-17T12:14:07.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:30 smithi082 ceph-mon[94281]: pgmap v2888: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:07.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: pgmap v2889: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:14:07.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:07.975 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: pgmap v2890: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 36 op/s 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: pgmap v2891: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.5 MiB/s wr, 39 op/s 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:34 smithi082 ceph-mon[94281]: pgmap v2892: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.5 MiB/s wr, 39 op/s 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:36 smithi082 ceph-mon[94281]: pgmap v2893: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:38 smithi082 ceph-mon[94281]: pgmap v2894: 97 pgs: 97 active+clean; 27 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 3.5 MiB/s wr, 123 op/s 2023-03-17T12:14:07.976 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:40 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:08.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:40 smithi082 ceph-mon[94281]: pgmap v2895: 97 pgs: 97 active+clean; 27 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 3.5 MiB/s wr, 123 op/s 2023-03-17T12:14:08.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:42 smithi082 ceph-mon[94281]: pgmap v2896: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2023-03-17T12:14:08.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:44 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:08.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:44 smithi082 ceph-mon[94281]: pgmap v2897: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2023-03-17T12:14:08.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:46 smithi082 ceph-mon[94281]: pgmap v2898: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2023-03-17T12:14:08.367 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:48 smithi082 ceph-mon[94281]: pgmap v2899: 97 pgs: 97 active+clean; 29 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 1.9 MiB/s wr, 173 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:50 smithi082 ceph-mon[94281]: pgmap v2900: 97 pgs: 97 active+clean; 29 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 1.2 MiB/s wr, 107 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:52 smithi082 ceph-mon[94281]: pgmap v2901: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:54 smithi082 ceph-mon[94281]: pgmap v2902: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:56 smithi082 ceph-mon[94281]: pgmap v2903: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:14:58 smithi082 ceph-mon[94281]: pgmap v2904: 97 pgs: 97 active+clean; 32 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:00 smithi082 ceph-mon[94281]: pgmap v2905: 97 pgs: 97 active+clean; 32 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:02 smithi082 ceph-mon[94281]: pgmap v2906: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:04 smithi082 ceph-mon[94281]: osdmap e257: 12 total, 12 up, 12 in 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:04 smithi082 ceph-mon[94281]: pgmap v2908: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:06 smithi082 ceph-mon[94281]: pgmap v2909: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:08 smithi082 ceph-mon[94281]: pgmap v2910: 97 pgs: 97 active+clean; 30 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:10 smithi082 ceph-mon[94281]: pgmap v2911: 97 pgs: 97 active+clean; 30 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:12 smithi082 ceph-mon[94281]: osdmap e258: 12 total, 12 up, 12 in 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:12 smithi082 ceph-mon[94281]: pgmap v2913: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.4 MiB/s wr, 165 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:14 smithi082 ceph-mon[94281]: pgmap v2914: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-03-17T12:14:08.368 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:16 smithi082 ceph-mon[94281]: pgmap v2915: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:18 smithi082 ceph-mon[94281]: pgmap v2916: 97 pgs: 97 active+clean; 35 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:20 smithi082 ceph-mon[94281]: pgmap v2917: 97 pgs: 97 active+clean; 35 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:22 smithi082 ceph-mon[94281]: pgmap v2918: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.9 MiB/s wr, 198 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:24 smithi082 ceph-mon[94281]: pgmap v2919: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:26 smithi082 ceph-mon[94281]: pgmap v2920: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:28 smithi082 ceph-mon[94281]: pgmap v2921: 97 pgs: 97 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.7 MiB/s wr, 179 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:30 smithi082 ceph-mon[94281]: pgmap v2922: 97 pgs: 97 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:32 smithi082 ceph-mon[94281]: pgmap v2923: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.7 MiB/s wr, 178 op/s 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:08.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:09.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:09.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:33 smithi082 ceph-mon[94281]: pgmap v2924: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:14:09.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:33 smithi082 ceph-mon[94281]: pgmap v2925: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:14:09.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:10.223 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:36 smithi082 ceph-mon[94281]: pgmap v2926: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:14:10.223 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:37 smithi082 ceph-mon[94281]: pgmap v2927: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2023-03-17T12:14:10.223 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:40 smithi082 ceph-mon[94281]: pgmap v2928: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2023-03-17T12:14:10.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:42 smithi082 ceph-mon[94281]: pgmap v2929: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 635 KiB/s wr, 81 op/s 2023-03-17T12:14:10.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:44 smithi082 ceph-mon[94281]: pgmap v2930: 97 pgs: 97 active+clean; 43 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1.3 MiB/s wr, 144 op/s 2023-03-17T12:14:10.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:46 smithi082 ceph-mon[94281]: pgmap v2931: 97 pgs: 97 active+clean; 43 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T12:14:10.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:47 smithi082 ceph-mon[94281]: pgmap v2932: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2023-03-17T12:14:11.079 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:50 smithi082 ceph-mon[94281]: pgmap v2933: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:14:11.079 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:52 smithi082 ceph-mon[94281]: pgmap v2934: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:14:11.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:54 smithi082 ceph-mon[94281]: pgmap v2935: 97 pgs: 97 active+clean; 45 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.8 MiB/s wr, 178 op/s 2023-03-17T12:14:12.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:56 smithi082 ceph-mon[94281]: pgmap v2936: 97 pgs: 97 active+clean; 45 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:14:12.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:15:57 smithi082 ceph-mon[94281]: pgmap v2937: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2023-03-17T12:14:12.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:00 smithi082 ceph-mon[94281]: pgmap v2938: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:02 smithi082 ceph-mon[94281]: pgmap v2939: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:04 smithi082 ceph-mon[94281]: pgmap v2940: 97 pgs: 97 active+clean; 50 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:05 smithi082 ceph-mon[94281]: osdmap e259: 12 total, 12 up, 12 in 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:06 smithi082 ceph-mon[94281]: pgmap v2942: 97 pgs: 97 active+clean; 50 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:07 smithi082 ceph-mon[94281]: pgmap v2943: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:10 smithi082 ceph-mon[94281]: pgmap v2944: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:12 smithi082 ceph-mon[94281]: pgmap v2945: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:12 smithi082 ceph-mon[94281]: osdmap e260: 12 total, 12 up, 12 in 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:14 smithi082 ceph-mon[94281]: pgmap v2947: 97 pgs: 97 active+clean; 53 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 1.5 MiB/s wr, 162 op/s 2023-03-17T12:14:13.924 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:16 smithi082 ceph-mon[94281]: pgmap v2948: 97 pgs: 97 active+clean; 53 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:17 smithi082 ceph-mon[94281]: pgmap v2949: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:20 smithi082 ceph-mon[94281]: pgmap v2950: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:22 smithi082 ceph-mon[94281]: pgmap v2951: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:24 smithi082 ceph-mon[94281]: pgmap v2952: 97 pgs: 97 active+clean; 59 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 1.8 MiB/s wr, 186 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:26 smithi082 ceph-mon[94281]: pgmap v2953: 97 pgs: 97 active+clean; 59 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.3 MiB/s wr, 117 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:27 smithi082 ceph-mon[94281]: pgmap v2954: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:30 smithi082 ceph-mon[94281]: pgmap v2955: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:32 smithi082 ceph-mon[94281]: pgmap v2956: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:34 smithi082 ceph-mon[94281]: pgmap v2957: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:13.925 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:15.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:16.070 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:16.070 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:35 smithi082 ceph-mon[94281]: pgmap v2958: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2023-03-17T12:14:16.070 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:35 smithi082 ceph-mon[94281]: pgmap v2959: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.7 MiB/s wr, 168 op/s 2023-03-17T12:14:16.070 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:35 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:16.070 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:37 smithi082 ceph-mon[94281]: pgmap v2960: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 963 KiB/s wr, 83 op/s 2023-03-17T12:14:16.070 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:39 smithi082 ceph-mon[94281]: pgmap v2961: 97 pgs: 97 active+clean; 65 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.8 MiB/s wr, 159 op/s 2023-03-17T12:14:16.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:41 smithi082 ceph-mon[94281]: pgmap v2962: 97 pgs: 97 active+clean; 65 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.8 MiB/s wr, 159 op/s 2023-03-17T12:14:16.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:42 smithi082 ceph-mon[94281]: pgmap v2963: 97 pgs: 97 active+clean; 66 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2023-03-17T12:14:16.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:44 smithi082 ceph-mon[94281]: pgmap v2964: 97 pgs: 97 active+clean; 65 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.3 MiB/s wr, 138 op/s 2023-03-17T12:14:16.071 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:46 smithi082 ceph-mon[94281]: pgmap v2965: 97 pgs: 97 active+clean; 65 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:49 smithi082 ceph-mon[94281]: pgmap v2966: 97 pgs: 97 active+clean; 68 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.7 MiB/s wr, 177 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:51 smithi082 ceph-mon[94281]: pgmap v2967: 97 pgs: 97 active+clean; 68 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:52 smithi082 ceph-mon[94281]: pgmap v2968: 97 pgs: 97 active+clean; 70 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 1.5 MiB/s wr, 174 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:54 smithi082 ceph-mon[94281]: pgmap v2969: 97 pgs: 97 active+clean; 70 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:57 smithi082 ceph-mon[94281]: pgmap v2970: 97 pgs: 97 active+clean; 70 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:16:59 smithi082 ceph-mon[94281]: pgmap v2971: 97 pgs: 97 active+clean; 72 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.9 MiB/s wr, 178 op/s 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:00 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:16.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:01 smithi082 ceph-mon[94281]: pgmap v2972: 97 pgs: 97 active+clean; 72 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 1.2 MiB/s wr, 116 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:02 smithi082 ceph-mon[94281]: pgmap v2973: 97 pgs: 97 active+clean; 56 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.6 MiB/s wr, 193 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:04 smithi082 ceph-mon[94281]: osdmap e261: 12 total, 12 up, 12 in 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:04 smithi082 ceph-mon[94281]: pgmap v2975: 97 pgs: 97 active+clean; 57 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:07 smithi082 ceph-mon[94281]: pgmap v2976: 97 pgs: 97 active+clean; 57 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:09 smithi082 ceph-mon[94281]: pgmap v2977: 97 pgs: 97 active+clean; 61 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:11 smithi082 ceph-mon[94281]: pgmap v2978: 97 pgs: 97 active+clean; 61 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:12 smithi082 ceph-mon[94281]: osdmap e262: 12 total, 12 up, 12 in 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:12 smithi082 ceph-mon[94281]: pgmap v2980: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:14 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:14 smithi082 ceph-mon[94281]: pgmap v2981: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.5 MiB/s wr, 139 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:17 smithi082 ceph-mon[94281]: pgmap v2982: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.5 MiB/s wr, 139 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:19 smithi082 ceph-mon[94281]: pgmap v2983: 97 pgs: 97 active+clean; 59 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:21 smithi082 ceph-mon[94281]: pgmap v2984: 97 pgs: 97 active+clean; 59 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:14:16.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:22 smithi082 ceph-mon[94281]: pgmap v2985: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 2.0 MiB/s wr, 206 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:25 smithi082 ceph-mon[94281]: pgmap v2986: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:27 smithi082 ceph-mon[94281]: pgmap v2987: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:29 smithi082 ceph-mon[94281]: pgmap v2988: 97 pgs: 97 active+clean; 61 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.9 MiB/s wr, 184 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:31 smithi082 ceph-mon[94281]: pgmap v2989: 97 pgs: 97 active+clean; 61 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:32 smithi082 ceph-mon[94281]: pgmap v2990: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.8 MiB/s wr, 181 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:35 smithi082 ceph-mon[94281]: pgmap v2991: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:36 smithi082 ceph-mon[94281]: pgmap v2992: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-03-17T12:14:16.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:36 smithi082 ceph-mon[94281]: pgmap v2993: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.4 MiB/s wr, 161 op/s 2023-03-17T12:14:17.403 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:17.403 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:37 smithi082 ceph-mon[94281]: pgmap v2994: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2023-03-17T12:14:17.403 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:40 smithi082 ceph-mon[94281]: pgmap v2995: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2023-03-17T12:14:17.403 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:42 smithi082 ceph-mon[94281]: pgmap v2996: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 927 KiB/s wr, 78 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:44 smithi082 ceph-mon[94281]: pgmap v2997: 97 pgs: 97 active+clean; 67 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:46 smithi082 ceph-mon[94281]: pgmap v2998: 97 pgs: 97 active+clean; 67 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.6 MiB/s wr, 143 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:47 smithi082 ceph-mon[94281]: pgmap v2999: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.9 MiB/s wr, 181 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:50 smithi082 ceph-mon[94281]: pgmap v3000: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:52 smithi082 ceph-mon[94281]: pgmap v3001: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:54 smithi082 ceph-mon[94281]: pgmap v3002: 97 pgs: 97 active+clean; 72 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T12:14:17.404 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:56 smithi082 ceph-mon[94281]: pgmap v3003: 97 pgs: 97 active+clean; 72 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2023-03-17T12:14:17.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:17:57 smithi082 ceph-mon[94281]: pgmap v3004: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T12:14:17.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:00 smithi082 ceph-mon[94281]: pgmap v3005: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2023-03-17T12:14:17.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:02 smithi082 ceph-mon[94281]: pgmap v3006: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2023-03-17T12:14:17.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:04 smithi082 ceph-mon[94281]: pgmap v3007: 97 pgs: 97 active+clean; 68 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.7 MiB/s wr, 185 op/s 2023-03-17T12:14:17.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:05 smithi082 ceph-mon[94281]: osdmap e263: 12 total, 12 up, 12 in 2023-03-17T12:14:17.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:06 smithi082 ceph-mon[94281]: pgmap v3009: 97 pgs: 97 active+clean; 68 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2023-03-17T12:14:17.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:07 smithi082 ceph-mon[94281]: pgmap v3010: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:14:17.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:10 smithi082 ceph-mon[94281]: pgmap v3011: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:14:17.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:12 smithi082 ceph-mon[94281]: pgmap v3012: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:14:17.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:12 smithi082 ceph-mon[94281]: osdmap e264: 12 total, 12 up, 12 in 2023-03-17T12:14:17.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:14 smithi082 ceph-mon[94281]: pgmap v3014: 97 pgs: 97 active+clean; 72 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.2 MiB/s wr, 114 op/s 2023-03-17T12:14:17.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:16 smithi082 ceph-mon[94281]: pgmap v3015: 97 pgs: 97 active+clean; 72 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.1 MiB/s wr, 102 op/s 2023-03-17T12:14:17.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:17 smithi082 ceph-mon[94281]: pgmap v3016: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T12:14:17.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:20 smithi082 ceph-mon[94281]: pgmap v3017: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T12:14:17.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:22 smithi082 ceph-mon[94281]: pgmap v3018: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T12:14:17.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:24 smithi082 ceph-mon[94281]: pgmap v3019: 97 pgs: 97 active+clean; 78 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2023-03-17T12:14:17.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:26 smithi082 ceph-mon[94281]: pgmap v3020: 97 pgs: 97 active+clean; 78 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 1.2 MiB/s wr, 109 op/s 2023-03-17T12:14:17.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:27 smithi082 ceph-mon[94281]: pgmap v3021: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2023-03-17T12:14:18.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:30 smithi082 ceph-mon[94281]: pgmap v3022: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-03-17T12:14:18.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:32 smithi082 ceph-mon[94281]: pgmap v3023: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-03-17T12:14:18.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:34 smithi082 ceph-mon[94281]: pgmap v3024: 97 pgs: 97 active+clean; 84 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.9 MiB/s wr, 173 op/s 2023-03-17T12:14:18.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:36 smithi082 ceph-mon[94281]: pgmap v3025: 97 pgs: 97 active+clean; 84 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 1.4 MiB/s wr, 115 op/s 2023-03-17T12:14:18.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:19.552 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:19.552 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:19.552 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:37 smithi082 ceph-mon[94281]: pgmap v3026: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 172 op/s 2023-03-17T12:14:19.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:19.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:19.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:19.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:20.326 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:21.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: pgmap v3027: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:41 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:14:22.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:41 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:14:23.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:41 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:14:23.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:41 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:14:23.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:41 smithi082 ceph-mon[94281]: pgmap v3028: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.3 MiB/s wr, 121 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:41 smithi082 ceph-mon[94281]: pgmap v3029: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:42 smithi082 ceph-mon[94281]: pgmap v3030: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:45 smithi082 ceph-mon[94281]: pgmap v3031: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:47 smithi082 ceph-mon[94281]: pgmap v3032: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 924 KiB/s wr, 77 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:49 smithi082 ceph-mon[94281]: pgmap v3033: 97 pgs: 97 active+clean; 91 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:51 smithi082 ceph-mon[94281]: pgmap v3034: 97 pgs: 97 active+clean; 91 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:52 smithi082 ceph-mon[94281]: pgmap v3035: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.8 MiB/s wr, 175 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:55 smithi082 ceph-mon[94281]: pgmap v3036: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:14:25.286 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:57 smithi082 ceph-mon[94281]: pgmap v3037: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:18:59 smithi082 ceph-mon[94281]: pgmap v3038: 97 pgs: 97 active+clean; 80 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.9 MiB/s wr, 177 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:01 smithi082 ceph-mon[94281]: pgmap v3039: 97 pgs: 97 active+clean; 80 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 1.2 MiB/s wr, 123 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:02 smithi082 ceph-mon[94281]: pgmap v3040: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 1.9 MiB/s wr, 193 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:04 smithi082 ceph-mon[94281]: osdmap e265: 12 total, 12 up, 12 in 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:04 smithi082 ceph-mon[94281]: pgmap v3042: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:07 smithi082 ceph-mon[94281]: pgmap v3043: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:09 smithi082 ceph-mon[94281]: pgmap v3044: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:11 smithi082 ceph-mon[94281]: pgmap v3045: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:12 smithi082 ceph-mon[94281]: osdmap e266: 12 total, 12 up, 12 in 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:12 smithi082 ceph-mon[94281]: pgmap v3047: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 1.7 MiB/s wr, 166 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:15 smithi082 ceph-mon[94281]: pgmap v3048: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:17 smithi082 ceph-mon[94281]: pgmap v3049: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:19 smithi082 ceph-mon[94281]: pgmap v3050: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:21 smithi082 ceph-mon[94281]: pgmap v3051: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2023-03-17T12:14:25.287 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:22 smithi082 ceph-mon[94281]: pgmap v3052: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.1 MiB/s wr, 199 op/s 2023-03-17T12:14:25.288 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:25 smithi082 ceph-mon[94281]: pgmap v3053: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:14:26.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:27 smithi082 ceph-mon[94281]: pgmap v3054: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:14:26.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:29 smithi082 ceph-mon[94281]: pgmap v3055: 97 pgs: 97 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.9 MiB/s wr, 179 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:31 smithi082 ceph-mon[94281]: pgmap v3056: 97 pgs: 97 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:32 smithi082 ceph-mon[94281]: pgmap v3057: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.9 MiB/s wr, 177 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:35 smithi082 ceph-mon[94281]: pgmap v3058: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.4 MiB/s wr, 118 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:37 smithi082 ceph-mon[94281]: pgmap v3059: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.4 MiB/s wr, 118 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:39 smithi082 ceph-mon[94281]: pgmap v3060: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.9 MiB/s wr, 176 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:41 smithi082 ceph-mon[94281]: pgmap v3061: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:28.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:29.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:29.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:42 smithi082 ceph-mon[94281]: pgmap v3062: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:42 smithi082 ceph-mon[94281]: pgmap v3063: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 675 KiB/s wr, 79 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:44 smithi082 ceph-mon[94281]: pgmap v3064: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:46 smithi082 ceph-mon[94281]: pgmap v3065: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:47 smithi082 ceph-mon[94281]: pgmap v3066: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.7 MiB/s wr, 154 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:50 smithi082 ceph-mon[94281]: pgmap v3067: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.9 MiB/s wr, 157 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:52 smithi082 ceph-mon[94281]: pgmap v3068: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.7 MiB/s wr, 139 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:54 smithi082 ceph-mon[94281]: pgmap v3069: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 1.9 MiB/s wr, 176 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:56 smithi082 ceph-mon[94281]: pgmap v3070: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 115 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:19:57 smithi082 ceph-mon[94281]: pgmap v3071: 97 pgs: 97 active+clean; 100 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.7 MiB/s wr, 176 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:00 smithi082 ceph-mon[94281]: pgmap v3072: 97 pgs: 97 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.4 MiB/s wr, 123 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:02 smithi082 ceph-mon[94281]: pgmap v3073: 97 pgs: 97 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:14:29.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:04 smithi082 ceph-mon[94281]: pgmap v3074: 97 pgs: 97 active+clean; 104 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.9 MiB/s wr, 190 op/s 2023-03-17T12:14:31.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:05 smithi082 ceph-mon[94281]: osdmap e267: 12 total, 12 up, 12 in 2023-03-17T12:14:31.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:06 smithi082 ceph-mon[94281]: pgmap v3076: 97 pgs: 97 active+clean; 104 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T12:14:31.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:07 smithi082 ceph-mon[94281]: pgmap v3077: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:10 smithi082 ceph-mon[94281]: pgmap v3078: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.5 MiB/s wr, 152 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:12 smithi082 ceph-mon[94281]: pgmap v3079: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.5 MiB/s wr, 152 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:12 smithi082 ceph-mon[94281]: osdmap e268: 12 total, 12 up, 12 in 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:14 smithi082 ceph-mon[94281]: pgmap v3081: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:16 smithi082 ceph-mon[94281]: pgmap v3082: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 1.5 MiB/s wr, 143 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:17 smithi082 ceph-mon[94281]: pgmap v3083: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:20 smithi082 ceph-mon[94281]: pgmap v3084: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:22 smithi082 ceph-mon[94281]: pgmap v3085: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:24 smithi082 ceph-mon[94281]: pgmap v3086: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.9 MiB/s wr, 179 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:26 smithi082 ceph-mon[94281]: pgmap v3087: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:27 smithi082 ceph-mon[94281]: pgmap v3088: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.8 MiB/s wr, 171 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:30 smithi082 ceph-mon[94281]: pgmap v3089: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:32 smithi082 ceph-mon[94281]: pgmap v3090: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:34 smithi082 ceph-mon[94281]: pgmap v3091: 97 pgs: 97 active+clean; 122 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:36 smithi082 ceph-mon[94281]: pgmap v3092: 97 pgs: 97 active+clean; 122 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.5 MiB/s wr, 113 op/s 2023-03-17T12:14:31.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:37 smithi082 ceph-mon[94281]: pgmap v3093: 97 pgs: 97 active+clean; 124 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2023-03-17T12:14:31.604 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:40 smithi082 ceph-mon[94281]: pgmap v3094: 97 pgs: 97 active+clean; 123 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 1.4 MiB/s wr, 113 op/s 2023-03-17T12:14:32.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:42 smithi082 ceph-mon[94281]: pgmap v3095: 97 pgs: 97 active+clean; 123 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-03-17T12:14:32.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:32.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:32.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:32.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:32.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:32.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:44 smithi082 ceph-mon[94281]: pgmap v3096: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.1 MiB/s wr, 180 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:44 smithi082 ceph-mon[94281]: pgmap v3097: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:46 smithi082 ceph-mon[94281]: pgmap v3098: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:48 smithi082 ceph-mon[94281]: pgmap v3099: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:50 smithi082 ceph-mon[94281]: pgmap v3100: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.8 MiB/s wr, 141 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:52 smithi082 ceph-mon[94281]: pgmap v3101: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.8 MiB/s wr, 141 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:54 smithi082 ceph-mon[94281]: pgmap v3102: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.4 MiB/s wr, 136 op/s 2023-03-17T12:14:33.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:56 smithi082 ceph-mon[94281]: pgmap v3103: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:20:58 smithi082 ceph-mon[94281]: pgmap v3104: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:00 smithi082 ceph-mon[94281]: pgmap v3105: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 1.9 MiB/s wr, 169 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:02 smithi082 ceph-mon[94281]: pgmap v3106: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.3 MiB/s wr, 117 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:04 smithi082 ceph-mon[94281]: pgmap v3107: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.0 MiB/s wr, 187 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:05 smithi082 ceph-mon[94281]: osdmap e269: 12 total, 12 up, 12 in 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:06 smithi082 ceph-mon[94281]: pgmap v3109: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 150 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:08 smithi082 ceph-mon[94281]: pgmap v3110: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 150 op/s 2023-03-17T12:14:33.550 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:10 smithi082 ceph-mon[94281]: pgmap v3111: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-03-17T12:14:34.862 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:12 smithi082 ceph-mon[94281]: pgmap v3112: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-03-17T12:14:37.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:12 smithi082 ceph-mon[94281]: osdmap e270: 12 total, 12 up, 12 in 2023-03-17T12:14:37.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:14 smithi082 ceph-mon[94281]: pgmap v3114: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 2.0 MiB/s wr, 170 op/s 2023-03-17T12:14:37.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:16 smithi082 ceph-mon[94281]: pgmap v3115: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2023-03-17T12:14:37.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:18 smithi082 ceph-mon[94281]: pgmap v3116: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2023-03-17T12:14:37.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:20 smithi082 ceph-mon[94281]: pgmap v3117: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2023-03-17T12:14:38.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:22 smithi082 ceph-mon[94281]: pgmap v3118: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2023-03-17T12:14:38.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:24 smithi082 ceph-mon[94281]: pgmap v3119: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 2.2 MiB/s wr, 187 op/s 2023-03-17T12:14:38.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:26 smithi082 ceph-mon[94281]: pgmap v3120: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2023-03-17T12:14:38.138 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:28 smithi082 ceph-mon[94281]: pgmap v3121: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:30 smithi082 ceph-mon[94281]: pgmap v3122: 97 pgs: 97 active+clean; 155 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:32 smithi082 ceph-mon[94281]: pgmap v3123: 97 pgs: 97 active+clean; 155 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:34 smithi082 ceph-mon[94281]: pgmap v3124: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:36 smithi082 ceph-mon[94281]: pgmap v3125: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:38 smithi082 ceph-mon[94281]: pgmap v3126: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:40 smithi082 ceph-mon[94281]: pgmap v3127: 97 pgs: 97 active+clean; 162 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.0 MiB/s wr, 169 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:42 smithi082 ceph-mon[94281]: pgmap v3128: 97 pgs: 97 active+clean; 162 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.3 MiB/s wr, 112 op/s 2023-03-17T12:14:38.139 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:38.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:44 smithi082 ceph-mon[94281]: pgmap v3129: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T12:14:38.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:38.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:38.140 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:44 smithi082 ceph-mon[94281]: pgmap v3130: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.5 MiB/s wr, 127 op/s 2023-03-17T12:14:40.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:44 smithi082 ceph-mon[94281]: pgmap v3131: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T12:14:40.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:40.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:46 smithi082 ceph-mon[94281]: pgmap v3132: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T12:14:40.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:47 smithi082 ceph-mon[94281]: pgmap v3133: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.6 MiB/s wr, 155 op/s 2023-03-17T12:14:40.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:50 smithi082 ceph-mon[94281]: pgmap v3134: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.6 MiB/s wr, 155 op/s 2023-03-17T12:14:40.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:52 smithi082 ceph-mon[94281]: pgmap v3135: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 698 KiB/s wr, 74 op/s 2023-03-17T12:14:40.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:54 smithi082 ceph-mon[94281]: pgmap v3136: 97 pgs: 97 active+clean; 130 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2023-03-17T12:14:41.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:56 smithi082 ceph-mon[94281]: pgmap v3137: 97 pgs: 97 active+clean; 130 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-03-17T12:14:41.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:21:57 smithi082 ceph-mon[94281]: pgmap v3138: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T12:14:41.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:00 smithi082 ceph-mon[94281]: pgmap v3139: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-03-17T12:14:41.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:02 smithi082 ceph-mon[94281]: pgmap v3140: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-03-17T12:14:41.031 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:04 smithi082 ceph-mon[94281]: pgmap v3141: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.0 MiB/s wr, 190 op/s 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:05 smithi082 ceph-mon[94281]: osdmap e271: 12 total, 12 up, 12 in 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:06 smithi082 ceph-mon[94281]: pgmap v3143: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:07 smithi082 ceph-mon[94281]: pgmap v3144: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:10 smithi082 ceph-mon[94281]: pgmap v3145: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:12 smithi082 ceph-mon[94281]: pgmap v3146: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:12 smithi082 ceph-mon[94281]: osdmap e272: 12 total, 12 up, 12 in 2023-03-17T12:14:42.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:13 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:13 smithi082 ceph-mon[94281]: pgmap v3148: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.9 MiB/s wr, 155 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:16 smithi082 ceph-mon[94281]: pgmap v3149: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 1.7 MiB/s wr, 139 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:17 smithi082 ceph-mon[94281]: pgmap v3150: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:19 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:19 smithi082 ceph-mon[94281]: pgmap v3151: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:22 smithi082 ceph-mon[94281]: pgmap v3152: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:23 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:23 smithi082 ceph-mon[94281]: pgmap v3153: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.7 MiB/s wr, 153 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:24 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:25 smithi082 ceph-mon[94281]: pgmap v3154: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.0 MiB/s wr, 97 op/s 2023-03-17T12:14:43.480 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:27 smithi082 ceph-mon[94281]: pgmap v3155: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.2 MiB/s wr, 110 op/s 2023-03-17T12:14:43.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:30 smithi082 ceph-mon[94281]: pgmap v3156: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 677 KiB/s wr, 52 op/s 2023-03-17T12:14:43.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:32 smithi082 ceph-mon[94281]: pgmap v3157: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 677 KiB/s wr, 52 op/s 2023-03-17T12:14:43.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:33 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:43.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:33 smithi082 ceph-mon[94281]: pgmap v3158: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.1 MiB/s wr, 108 op/s 2023-03-17T12:14:43.481 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:36 smithi082 ceph-mon[94281]: pgmap v3159: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 599 KiB/s wr, 68 op/s 2023-03-17T12:14:45.344 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:37 smithi082 ceph-mon[94281]: pgmap v3160: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T12:14:45.344 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:40 smithi082 ceph-mon[94281]: pgmap v3161: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 918 KiB/s wr, 90 op/s 2023-03-17T12:14:45.344 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:42 smithi082 ceph-mon[94281]: pgmap v3162: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 918 KiB/s wr, 90 op/s 2023-03-17T12:14:48.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:44 smithi082 ceph-mon[94281]: pgmap v3163: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 955 KiB/s wr, 100 op/s 2023-03-17T12:14:48.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:48.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:48.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:48.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:48.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:45 smithi082 ceph-mon[94281]: pgmap v3164: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 544 KiB/s wr, 49 op/s 2023-03-17T12:14:50.987 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:45 smithi082 ceph-mon[94281]: pgmap v3165: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 667 KiB/s wr, 60 op/s 2023-03-17T12:14:50.987 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:47 smithi082 ceph-mon[94281]: pgmap v3166: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 KiB/s wr, 12 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:49 smithi082 ceph-mon[94281]: pgmap v3167: 97 pgs: 97 active+clean; 134 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 665 KiB/s wr, 70 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:51 smithi082 ceph-mon[94281]: pgmap v3168: 97 pgs: 97 active+clean; 134 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 665 KiB/s wr, 70 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:52 smithi082 ceph-mon[94281]: pgmap v3169: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:55 smithi082 ceph-mon[94281]: pgmap v3170: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.2 MiB/s wr, 105 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:57 smithi082 ceph-mon[94281]: pgmap v3171: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 1004 KiB/s wr, 87 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:22:59 smithi082 ceph-mon[94281]: pgmap v3172: 97 pgs: 97 active+clean; 136 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.0 MiB/s wr, 98 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:01 smithi082 ceph-mon[94281]: pgmap v3173: 97 pgs: 97 active+clean; 136 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 590 KiB/s wr, 56 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:02 smithi082 ceph-mon[94281]: pgmap v3174: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 751 KiB/s wr, 81 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:04 smithi082 ceph-mon[94281]: osdmap e273: 12 total, 12 up, 12 in 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:04 smithi082 ceph-mon[94281]: pgmap v3176: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 241 KiB/s wr, 43 op/s 2023-03-17T12:14:50.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:07 smithi082 ceph-mon[94281]: pgmap v3177: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 241 KiB/s wr, 43 op/s 2023-03-17T12:14:53.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:09 smithi082 ceph-mon[94281]: pgmap v3178: 97 pgs: 97 active+clean; 139 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 762 KiB/s wr, 93 op/s 2023-03-17T12:14:53.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:11 smithi082 ceph-mon[94281]: pgmap v3179: 97 pgs: 97 active+clean; 139 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 762 KiB/s wr, 93 op/s 2023-03-17T12:14:53.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:12 smithi082 ceph-mon[94281]: osdmap e274: 12 total, 12 up, 12 in 2023-03-17T12:14:54.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:12 smithi082 ceph-mon[94281]: pgmap v3181: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T12:14:54.581 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:15 smithi082 ceph-mon[94281]: pgmap v3182: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T12:14:55.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:17 smithi082 ceph-mon[94281]: pgmap v3183: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T12:14:55.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:19 smithi082 ceph-mon[94281]: pgmap v3184: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 605 KiB/s wr, 50 op/s 2023-03-17T12:14:55.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:21 smithi082 ceph-mon[94281]: pgmap v3185: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 605 KiB/s wr, 50 op/s 2023-03-17T12:14:55.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:22 smithi082 ceph-mon[94281]: pgmap v3186: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:25 smithi082 ceph-mon[94281]: pgmap v3187: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 552 KiB/s wr, 63 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:27 smithi082 ceph-mon[94281]: pgmap v3188: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 552 KiB/s wr, 63 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:29 smithi082 ceph-mon[94281]: pgmap v3189: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.0 MiB/s wr, 98 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:31 smithi082 ceph-mon[94281]: pgmap v3190: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:32 smithi082 ceph-mon[94281]: pgmap v3191: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:35 smithi082 ceph-mon[94281]: pgmap v3192: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 553 KiB/s wr, 44 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:37 smithi082 ceph-mon[94281]: pgmap v3193: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 553 KiB/s wr, 44 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:39 smithi082 ceph-mon[94281]: pgmap v3194: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.0 MiB/s wr, 100 op/s 2023-03-17T12:14:55.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:41 smithi082 ceph-mon[94281]: pgmap v3195: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 563 KiB/s wr, 65 op/s 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:42 smithi082 ceph-mon[94281]: pgmap v3196: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 101 op/s 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:45 smithi082 ceph-mon[94281]: pgmap v3197: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.0 MiB/s wr, 91 op/s 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:14:55.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:46 smithi082 ceph-mon[94281]: pgmap v3198: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-03-17T12:14:56.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:46 smithi082 ceph-mon[94281]: pgmap v3199: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2023-03-17T12:14:57.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:47 smithi082 ceph-mon[94281]: pgmap v3200: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 747 KiB/s wr, 62 op/s 2023-03-17T12:14:57.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:49 smithi082 ceph-mon[94281]: pgmap v3201: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 748 KiB/s wr, 62 op/s 2023-03-17T12:14:57.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:51 smithi082 ceph-mon[94281]: pgmap v3202: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 51 KiB/s wr, 13 op/s 2023-03-17T12:14:57.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:53 smithi082 ceph-mon[94281]: pgmap v3203: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 790 KiB/s wr, 91 op/s 2023-03-17T12:14:57.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:55 smithi082 ceph-mon[94281]: pgmap v3204: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 697 KiB/s wr, 80 op/s 2023-03-17T12:14:57.897 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:57 smithi082 ceph-mon[94281]: pgmap v3205: 97 pgs: 97 active+clean; 157 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 933 KiB/s wr, 99 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:23:59 smithi082 ceph-mon[94281]: pgmap v3206: 97 pgs: 97 active+clean; 158 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.0 MiB/s wr, 90 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:01 smithi082 ceph-mon[94281]: pgmap v3207: 97 pgs: 97 active+clean; 158 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:03 smithi082 ceph-mon[94281]: pgmap v3208: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:04 smithi082 ceph-mon[94281]: osdmap e275: 12 total, 12 up, 12 in 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:05 smithi082 ceph-mon[94281]: pgmap v3210: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 647 KiB/s wr, 53 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:07 smithi082 ceph-mon[94281]: pgmap v3211: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 841 KiB/s wr, 95 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:09 smithi082 ceph-mon[94281]: pgmap v3212: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 775 KiB/s wr, 96 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:11 smithi082 ceph-mon[94281]: pgmap v3213: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 775 KiB/s wr, 96 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:11 smithi082 ceph-mon[94281]: osdmap e276: 12 total, 12 up, 12 in 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:13 smithi082 ceph-mon[94281]: pgmap v3215: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:15 smithi082 ceph-mon[94281]: pgmap v3216: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.3 MiB/s wr, 123 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:17 smithi082 ceph-mon[94281]: pgmap v3217: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 792 KiB/s wr, 53 op/s 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:18 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:14:57.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:19 smithi082 ceph-mon[94281]: pgmap v3218: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 692 KiB/s wr, 52 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:21 smithi082 ceph-mon[94281]: pgmap v3219: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 692 KiB/s wr, 52 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:23 smithi082 ceph-mon[94281]: pgmap v3220: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 734 KiB/s wr, 56 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:25 smithi082 ceph-mon[94281]: pgmap v3221: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 169 KiB/s wr, 19 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:27 smithi082 ceph-mon[94281]: pgmap v3222: 97 pgs: 97 active+clean; 168 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 637 KiB/s wr, 73 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:29 smithi082 ceph-mon[94281]: pgmap v3223: 97 pgs: 97 active+clean; 167 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 686 KiB/s wr, 66 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:31 smithi082 ceph-mon[94281]: pgmap v3224: 97 pgs: 97 active+clean; 167 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 681 KiB/s wr, 66 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:33 smithi082 ceph-mon[94281]: pgmap v3225: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2023-03-17T12:14:57.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:35 smithi082 ceph-mon[94281]: pgmap v3226: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 980 KiB/s wr, 85 op/s 2023-03-17T12:14:57.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:37 smithi082 ceph-mon[94281]: pgmap v3227: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1012 KiB/s wr, 94 op/s 2023-03-17T12:14:57.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:39 smithi082 ceph-mon[94281]: pgmap v3228: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 547 KiB/s wr, 41 op/s 2023-03-17T12:14:57.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:41 smithi082 ceph-mon[94281]: pgmap v3229: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 459 KiB/s wr, 39 op/s 2023-03-17T12:14:59.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:43 smithi082 ceph-mon[94281]: pgmap v3230: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 588 KiB/s wr, 50 op/s 2023-03-17T12:14:59.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:45 smithi082 ceph-mon[94281]: pgmap v3231: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 163 KiB/s wr, 20 op/s 2023-03-17T12:14:59.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:14:59.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:14:59.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:46 smithi082 ceph-mon[94281]: pgmap v3232: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:46 smithi082 ceph-mon[94281]: pgmap v3233: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 178 KiB/s wr, 15 op/s 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:48 smithi082 ceph-mon[94281]: pgmap v3234: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 946 KiB/s wr, 91 op/s 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:50 smithi082 ceph-mon[94281]: pgmap v3235: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 946 KiB/s wr, 91 op/s 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:52 smithi082 ceph-mon[94281]: pgmap v3236: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 771 KiB/s wr, 76 op/s 2023-03-17T12:15:00.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:54 smithi082 ceph-mon[94281]: pgmap v3237: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2023-03-17T12:15:01.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:56 smithi082 ceph-mon[94281]: pgmap v3238: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T12:15:01.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:24:58 smithi082 ceph-mon[94281]: pgmap v3239: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T12:15:01.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:00 smithi082 ceph-mon[94281]: pgmap v3240: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 468 KiB/s wr, 47 op/s 2023-03-17T12:15:01.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:02 smithi082 ceph-mon[94281]: pgmap v3241: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 468 KiB/s wr, 47 op/s 2023-03-17T12:15:01.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:04 smithi082 ceph-mon[94281]: osdmap e277: 12 total, 12 up, 12 in 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:04 smithi082 ceph-mon[94281]: pgmap v3243: 97 pgs: 97 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 702 KiB/s wr, 95 op/s 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:06 smithi082 ceph-mon[94281]: pgmap v3244: 97 pgs: 97 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 702 KiB/s wr, 95 op/s 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:08 smithi082 ceph-mon[94281]: pgmap v3245: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:10 smithi082 ceph-mon[94281]: pgmap v3246: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:12 smithi082 ceph-mon[94281]: osdmap e278: 12 total, 12 up, 12 in 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:12 smithi082 ceph-mon[94281]: pgmap v3248: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 762 KiB/s wr, 55 op/s 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:14 smithi082 ceph-mon[94281]: pgmap v3249: 97 pgs: 97 active+clean; 152 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 679 KiB/s wr, 57 op/s 2023-03-17T12:15:02.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:16 smithi082 ceph-mon[94281]: pgmap v3250: 97 pgs: 97 active+clean; 152 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 679 KiB/s wr, 57 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:18 smithi082 ceph-mon[94281]: pgmap v3251: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 704 KiB/s wr, 83 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:18 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:20 smithi082 ceph-mon[94281]: pgmap v3252: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 704 KiB/s wr, 83 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:22 smithi082 ceph-mon[94281]: pgmap v3253: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 682 KiB/s wr, 81 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:23 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:24 smithi082 ceph-mon[94281]: pgmap v3254: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1.1 MiB/s wr, 106 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:26 smithi082 ceph-mon[94281]: pgmap v3255: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.0 MiB/s wr, 96 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:28 smithi082 ceph-mon[94281]: pgmap v3256: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 1.1 MiB/s wr, 107 op/s 2023-03-17T12:15:02.058 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:30 smithi082 ceph-mon[94281]: pgmap v3257: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 552 KiB/s wr, 46 op/s 2023-03-17T12:15:03.977 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:32 smithi082 ceph-mon[94281]: pgmap v3258: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 552 KiB/s wr, 46 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:33 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:34 smithi082 ceph-mon[94281]: pgmap v3259: 97 pgs: 97 active+clean; 155 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 863 KiB/s wr, 81 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:36 smithi082 ceph-mon[94281]: pgmap v3260: 97 pgs: 97 active+clean; 155 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 353 KiB/s wr, 44 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:38 smithi082 ceph-mon[94281]: pgmap v3261: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 968 KiB/s wr, 97 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:40 smithi082 ceph-mon[94281]: pgmap v3262: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 926 KiB/s wr, 86 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:42 smithi082 ceph-mon[94281]: pgmap v3263: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 926 KiB/s wr, 86 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:44 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:44 smithi082 ceph-mon[94281]: pgmap v3264: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:46 smithi082 ceph-mon[94281]: pgmap v3265: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 752 KiB/s wr, 69 op/s 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:15:05.695 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:47 smithi082 ceph-mon[94281]: pgmap v3266: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 832 KiB/s wr, 76 op/s 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:47 smithi082 ceph-mon[94281]: pgmap v3267: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 185 KiB/s wr, 22 op/s 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:49 smithi082 ceph-mon[94281]: pgmap v3268: 97 pgs: 97 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 581 KiB/s wr, 65 op/s 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:51 smithi082 ceph-mon[94281]: pgmap v3269: 97 pgs: 97 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 581 KiB/s wr, 65 op/s 2023-03-17T12:15:06.475 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:53 smithi082 ceph-mon[94281]: pgmap v3270: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:15:08.455 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:55 smithi082 ceph-mon[94281]: pgmap v3271: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:15:08.455 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:57 smithi082 ceph-mon[94281]: pgmap v3272: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.1 MiB/s wr, 104 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:25:59 smithi082 ceph-mon[94281]: pgmap v3273: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.0 MiB/s wr, 102 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:01 smithi082 ceph-mon[94281]: pgmap v3274: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 761 KiB/s wr, 70 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:03 smithi082 ceph-mon[94281]: pgmap v3275: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:04 smithi082 ceph-mon[94281]: osdmap e279: 12 total, 12 up, 12 in 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:05 smithi082 ceph-mon[94281]: pgmap v3277: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 527 KiB/s wr, 74 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:07 smithi082 ceph-mon[94281]: pgmap v3278: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 527 KiB/s wr, 74 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:09 smithi082 ceph-mon[94281]: pgmap v3279: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:11 smithi082 ceph-mon[94281]: pgmap v3280: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:11 smithi082 ceph-mon[94281]: osdmap e280: 12 total, 12 up, 12 in 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:13 smithi082 ceph-mon[94281]: pgmap v3282: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.0 MiB/s wr, 94 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:15 smithi082 ceph-mon[94281]: pgmap v3283: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 943 KiB/s wr, 84 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:17 smithi082 ceph-mon[94281]: pgmap v3284: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 943 KiB/s wr, 84 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:19 smithi082 ceph-mon[94281]: pgmap v3285: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 30 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:21 smithi082 ceph-mon[94281]: pgmap v3286: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 30 op/s 2023-03-17T12:15:08.456 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:23 smithi082 ceph-mon[94281]: pgmap v3287: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 783 KiB/s wr, 89 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:25 smithi082 ceph-mon[94281]: pgmap v3288: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 585 KiB/s wr, 66 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:27 smithi082 ceph-mon[94281]: pgmap v3289: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 585 KiB/s wr, 66 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:29 smithi082 ceph-mon[94281]: pgmap v3290: 97 pgs: 97 active+clean; 173 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:31 smithi082 ceph-mon[94281]: pgmap v3291: 97 pgs: 97 active+clean; 173 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:33 smithi082 ceph-mon[94281]: pgmap v3292: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 8.0 MiB/s wr, 148 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:35 smithi082 ceph-mon[94281]: pgmap v3293: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 7.5 MiB/s wr, 90 op/s 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:36 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:08.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:37 smithi082 ceph-mon[94281]: pgmap v3294: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 7.5 MiB/s wr, 90 op/s 2023-03-17T12:15:08.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:39 smithi082 ceph-mon[94281]: pgmap v3295: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 18 MiB/s wr, 217 op/s 2023-03-17T12:15:08.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:41 smithi082 ceph-mon[94281]: pgmap v3296: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 18 MiB/s wr, 181 op/s 2023-03-17T12:15:08.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:41 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:08.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:43 smithi082 ceph-mon[94281]: pgmap v3297: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 19 MiB/s wr, 270 op/s 2023-03-17T12:15:09.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:44 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:10.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:45 smithi082 ceph-mon[94281]: pgmap v3298: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 12 MiB/s wr, 215 op/s 2023-03-17T12:15:10.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:47 smithi082 ceph-mon[94281]: pgmap v3299: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 12 MiB/s wr, 215 op/s 2023-03-17T12:15:13.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:48 smithi082 ceph-mon[94281]: pgmap v3300: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 326 op/s 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:48 smithi082 ceph-mon[94281]: pgmap v3301: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:50 smithi082 ceph-mon[94281]: pgmap v3302: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-03-17T12:15:19.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:52 smithi082 ceph-mon[94281]: pgmap v3303: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 2.0 MiB/s wr, 109 op/s 2023-03-17T12:15:19.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:54 smithi082 ceph-mon[94281]: pgmap v3304: 97 pgs: 97 active+clean; 414 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.3 MiB/s wr, 223 op/s 2023-03-17T12:15:19.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:56 smithi082 ceph-mon[94281]: pgmap v3305: 97 pgs: 97 active+clean; 414 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.3 MiB/s wr, 223 op/s 2023-03-17T12:15:19.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:26:58 smithi082 ceph-mon[94281]: pgmap v3306: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.4 MiB/s wr, 249 op/s 2023-03-17T12:15:19.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:00 smithi082 ceph-mon[94281]: pgmap v3307: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T12:15:19.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:02 smithi082 ceph-mon[94281]: pgmap v3308: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T12:15:19.042 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:04 smithi082 ceph-mon[94281]: osdmap e281: 12 total, 12 up, 12 in 2023-03-17T12:15:21.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:04 smithi082 ceph-mon[94281]: pgmap v3310: 97 pgs: 97 active+clean; 385 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2023-03-17T12:15:21.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:06 smithi082 ceph-mon[94281]: pgmap v3311: 97 pgs: 97 active+clean; 385 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2023-03-17T12:15:21.077 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:08 smithi082 ceph-mon[94281]: pgmap v3312: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2023-03-17T12:15:25.239 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:10 smithi082 ceph-mon[94281]: pgmap v3313: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2023-03-17T12:15:27.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:12 smithi082 ceph-mon[94281]: osdmap e282: 12 total, 12 up, 12 in 2023-03-17T12:15:27.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:12 smithi082 ceph-mon[94281]: pgmap v3315: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:15:27.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:14 smithi082 ceph-mon[94281]: pgmap v3316: 97 pgs: 97 active+clean; 407 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2023-03-17T12:15:27.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:16 smithi082 ceph-mon[94281]: pgmap v3317: 97 pgs: 97 active+clean; 407 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2023-03-17T12:15:27.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:18 smithi082 ceph-mon[94281]: pgmap v3318: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2023-03-17T12:15:27.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:20 smithi082 ceph-mon[94281]: pgmap v3319: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2023-03-17T12:15:30.363 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:22 smithi082 ceph-mon[94281]: pgmap v3320: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 225 op/s 2023-03-17T12:15:30.363 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:24 smithi082 ceph-mon[94281]: pgmap v3321: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.4 MiB/s wr, 313 op/s 2023-03-17T12:15:31.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:26 smithi082 ceph-mon[94281]: pgmap v3322: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 211 op/s 2023-03-17T12:15:31.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:28 smithi082 ceph-mon[94281]: pgmap v3323: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 336 op/s 2023-03-17T12:15:31.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:30 smithi082 ceph-mon[94281]: pgmap v3324: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2023-03-17T12:15:31.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:32 smithi082 ceph-mon[94281]: pgmap v3325: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2023-03-17T12:15:31.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:34 smithi082 ceph-mon[94281]: pgmap v3326: 97 pgs: 97 active+clean; 424 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 349 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:36 smithi082 ceph-mon[94281]: pgmap v3327: 97 pgs: 97 active+clean; 424 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 2.9 MiB/s wr, 226 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:38 smithi082 ceph-mon[94281]: pgmap v3328: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:40 smithi082 ceph-mon[94281]: pgmap v3329: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:42 smithi082 ceph-mon[94281]: pgmap v3330: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:44 smithi082 ceph-mon[94281]: pgmap v3331: 97 pgs: 97 active+clean; 448 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 295 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:46 smithi082 ceph-mon[94281]: pgmap v3332: 97 pgs: 97 active+clean; 448 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 194 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:48 smithi082 ceph-mon[94281]: pgmap v3333: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 310 op/s 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:48 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:31.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:49 smithi082 ceph-mon[94281]: pgmap v3334: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 219 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:49 smithi082 ceph-mon[94281]: pgmap v3335: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 265 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:52 smithi082 ceph-mon[94281]: pgmap v3336: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 265 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:54 smithi082 ceph-mon[94281]: pgmap v3337: 97 pgs: 97 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:56 smithi082 ceph-mon[94281]: pgmap v3338: 97 pgs: 97 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:27:57 smithi082 ceph-mon[94281]: pgmap v3339: 97 pgs: 97 active+clean; 452 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:00 smithi082 ceph-mon[94281]: pgmap v3340: 97 pgs: 97 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 264 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:02 smithi082 ceph-mon[94281]: pgmap v3341: 97 pgs: 97 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 3.1 MiB/s wr, 220 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:04 smithi082 ceph-mon[94281]: pgmap v3342: 97 pgs: 97 active+clean; 468 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 328 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:05 smithi082 ceph-mon[94281]: osdmap e283: 12 total, 12 up, 12 in 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:06 smithi082 ceph-mon[94281]: pgmap v3344: 97 pgs: 97 active+clean; 468 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 242 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:07 smithi082 ceph-mon[94281]: pgmap v3345: 97 pgs: 97 active+clean; 484 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 254 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:10 smithi082 ceph-mon[94281]: pgmap v3346: 97 pgs: 97 active+clean; 485 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 255 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:12 smithi082 ceph-mon[94281]: pgmap v3347: 97 pgs: 97 active+clean; 485 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 255 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:12 smithi082 ceph-mon[94281]: osdmap e284: 12 total, 12 up, 12 in 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:14 smithi082 ceph-mon[94281]: pgmap v3349: 97 pgs: 97 active+clean; 494 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 292 op/s 2023-03-17T12:15:31.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:16 smithi082 ceph-mon[94281]: pgmap v3350: 97 pgs: 97 active+clean; 494 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 261 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:17 smithi082 ceph-mon[94281]: pgmap v3351: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 258 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:20 smithi082 ceph-mon[94281]: pgmap v3352: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 259 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:22 smithi082 ceph-mon[94281]: pgmap v3353: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 259 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:23 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:23 smithi082 ceph-mon[94281]: pgmap v3354: 97 pgs: 97 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 326 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:26 smithi082 ceph-mon[94281]: pgmap v3355: 97 pgs: 97 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 4.0 MiB/s wr, 200 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:27 smithi082 ceph-mon[94281]: pgmap v3356: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.9 MiB/s wr, 287 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:30 smithi082 ceph-mon[94281]: pgmap v3357: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 206 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:31 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:32 smithi082 ceph-mon[94281]: pgmap v3358: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 199 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:34 smithi082 ceph-mon[94281]: pgmap v3359: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 311 op/s 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:34 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:31.940 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:36 smithi082 ceph-mon[94281]: pgmap v3360: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 214 op/s 2023-03-17T12:15:32.594 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:37 smithi082 ceph-mon[94281]: pgmap v3361: 97 pgs: 97 active+clean; 528 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 310 op/s 2023-03-17T12:15:33.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:40 smithi082 ceph-mon[94281]: pgmap v3362: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2023-03-17T12:15:33.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:42 smithi082 ceph-mon[94281]: pgmap v3363: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 221 op/s 2023-03-17T12:15:34.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:44 smithi082 ceph-mon[94281]: pgmap v3364: 97 pgs: 97 active+clean; 541 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 314 op/s 2023-03-17T12:15:34.857 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:46 smithi082 ceph-mon[94281]: pgmap v3365: 97 pgs: 97 active+clean; 541 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 202 op/s 2023-03-17T12:15:35.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:47 smithi082 ceph-mon[94281]: pgmap v3366: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 290 op/s 2023-03-17T12:15:35.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:50 smithi082 ceph-mon[94281]: pgmap v3367: 97 pgs: 97 active+clean; 556 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 198 op/s 2023-03-17T12:15:35.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:15:37.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:37.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:37.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:51 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:37.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:51 smithi082 ceph-mon[94281]: pgmap v3368: 97 pgs: 97 active+clean; 556 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2023-03-17T12:15:37.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:37.473 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:38.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:38.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:38.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:38.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:38.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:15:38.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:15:38.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: pgmap v3369: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.4 MiB/s wr, 297 op/s 2023-03-17T12:15:38.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:38.911 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:55 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:15:40.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:55 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:15:40.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:55 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:55 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:55 smithi082 ceph-mon[94281]: pgmap v3370: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 223 op/s 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:57 smithi082 ceph-mon[94281]: pgmap v3371: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 223 op/s 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:28:59 smithi082 ceph-mon[94281]: pgmap v3372: 97 pgs: 97 active+clean; 553 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 250 op/s 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:01 smithi082 ceph-mon[94281]: pgmap v3373: 97 pgs: 97 active+clean; 553 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 246 op/s 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:02 smithi082 ceph-mon[94281]: pgmap v3374: 97 pgs: 97 active+clean; 565 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.5 MiB/s wr, 362 op/s 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:04 smithi082 ceph-mon[94281]: osdmap e285: 12 total, 12 up, 12 in 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:04 smithi082 ceph-mon[94281]: pgmap v3376: 97 pgs: 97 active+clean; 566 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-03-17T12:15:40.227 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:06 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:06 smithi082 ceph-mon[94281]: pgmap v3377: 97 pgs: 97 active+clean; 566 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:09 smithi082 ceph-mon[94281]: pgmap v3378: 97 pgs: 97 active+clean; 585 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:11 smithi082 ceph-mon[94281]: pgmap v3379: 97 pgs: 97 active+clean; 585 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:12 smithi082 ceph-mon[94281]: osdmap e286: 12 total, 12 up, 12 in 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:12 smithi082 ceph-mon[94281]: pgmap v3381: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 262 op/s 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:14 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:40.228 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:14 smithi082 ceph-mon[94281]: pgmap v3382: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 231 op/s 2023-03-17T12:15:43.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:17 smithi082 ceph-mon[94281]: pgmap v3383: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 231 op/s 2023-03-17T12:15:43.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:18 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:45.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:18 smithi082 ceph-mon[94281]: pgmap v3384: 97 pgs: 97 active+clean; 605 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-03-17T12:15:45.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:21 smithi082 ceph-mon[94281]: pgmap v3385: 97 pgs: 97 active+clean; 605 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:22 smithi082 ceph-mon[94281]: pgmap v3386: 97 pgs: 97 active+clean; 604 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 364 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:25 smithi082 ceph-mon[94281]: pgmap v3387: 97 pgs: 97 active+clean; 602 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 239 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:27 smithi082 ceph-mon[94281]: pgmap v3388: 97 pgs: 97 active+clean; 602 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 232 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:29 smithi082 ceph-mon[94281]: pgmap v3389: 97 pgs: 97 active+clean; 617 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:31 smithi082 ceph-mon[94281]: pgmap v3390: 97 pgs: 97 active+clean; 617 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:32 smithi082 ceph-mon[94281]: pgmap v3391: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 296 op/s 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:34 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:47.225 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:34 smithi082 ceph-mon[94281]: pgmap v3392: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 189 op/s 2023-03-17T12:15:47.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:37 smithi082 ceph-mon[94281]: pgmap v3393: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 182 op/s 2023-03-17T12:15:47.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:39 smithi082 ceph-mon[94281]: pgmap v3394: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 290 op/s 2023-03-17T12:15:47.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:40 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:15:47.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:41 smithi082 ceph-mon[94281]: pgmap v3395: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 199 op/s 2023-03-17T12:15:47.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:42 smithi082 ceph-mon[94281]: pgmap v3396: 97 pgs: 97 active+clean; 634 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 307 op/s 2023-03-17T12:15:47.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:45 smithi082 ceph-mon[94281]: pgmap v3397: 97 pgs: 97 active+clean; 635 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 228 op/s 2023-03-17T12:15:48.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:47 smithi082 ceph-mon[94281]: pgmap v3398: 97 pgs: 97 active+clean; 635 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:49 smithi082 ceph-mon[94281]: pgmap v3399: 97 pgs: 97 active+clean; 645 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 334 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:51 smithi082 ceph-mon[94281]: pgmap v3400: 97 pgs: 97 active+clean; 645 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 226 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:52 smithi082 ceph-mon[94281]: pgmap v3401: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 312 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:55 smithi082 ceph-mon[94281]: pgmap v3402: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 209 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:56 smithi082 ceph-mon[94281]: pgmap v3403: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:56 smithi082 ceph-mon[94281]: pgmap v3404: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 270 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:29:57 smithi082 ceph-mon[94281]: pgmap v3405: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 270 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:00 smithi082 ceph-mon[94281]: pgmap v3406: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 270 op/s 2023-03-17T12:15:48.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:02 smithi082 ceph-mon[94281]: pgmap v3407: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 2.5 MiB/s wr, 155 op/s 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:04 smithi082 ceph-mon[94281]: pgmap v3408: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 296 op/s 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:05 smithi082 ceph-mon[94281]: osdmap e287: 12 total, 12 up, 12 in 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:06 smithi082 ceph-mon[94281]: pgmap v3410: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 268 op/s 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:07 smithi082 ceph-mon[94281]: pgmap v3411: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:10 smithi082 ceph-mon[94281]: pgmap v3412: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:12 smithi082 ceph-mon[94281]: pgmap v3413: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:12 smithi082 ceph-mon[94281]: osdmap e288: 12 total, 12 up, 12 in 2023-03-17T12:15:48.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:14 smithi082 ceph-mon[94281]: pgmap v3415: 97 pgs: 97 active+clean; 674 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 310 op/s 2023-03-17T12:15:49.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:16 smithi082 ceph-mon[94281]: pgmap v3416: 97 pgs: 97 active+clean; 674 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 277 op/s 2023-03-17T12:15:49.848 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:17 smithi082 ceph-mon[94281]: pgmap v3417: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T12:15:51.638 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:20 smithi082 ceph-mon[94281]: pgmap v3418: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T12:15:51.639 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:22 smithi082 ceph-mon[94281]: pgmap v3419: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T12:15:51.639 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:24 smithi082 ceph-mon[94281]: pgmap v3420: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 340 op/s 2023-03-17T12:15:51.639 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:26 smithi082 ceph-mon[94281]: pgmap v3421: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T12:15:51.639 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:27 smithi082 ceph-mon[94281]: pgmap v3422: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.8 MiB/s wr, 331 op/s 2023-03-17T12:15:51.639 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:30 smithi082 ceph-mon[94281]: pgmap v3423: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2023-03-17T12:15:53.970 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:32 smithi082 ceph-mon[94281]: pgmap v3424: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2023-03-17T12:15:53.970 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:34 smithi082 ceph-mon[94281]: pgmap v3425: 97 pgs: 97 active+clean; 703 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 335 op/s 2023-03-17T12:15:53.970 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:36 smithi082 ceph-mon[94281]: pgmap v3426: 97 pgs: 97 active+clean; 703 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2023-03-17T12:15:53.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:37 smithi082 ceph-mon[94281]: pgmap v3427: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 316 op/s 2023-03-17T12:15:53.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:40 smithi082 ceph-mon[94281]: pgmap v3428: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 193 op/s 2023-03-17T12:15:54.533 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:42 smithi082 ceph-mon[94281]: pgmap v3429: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 193 op/s 2023-03-17T12:15:56.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:44 smithi082 ceph-mon[94281]: pgmap v3430: 97 pgs: 97 active+clean; 724 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 307 op/s 2023-03-17T12:15:56.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:46 smithi082 ceph-mon[94281]: pgmap v3431: 97 pgs: 97 active+clean; 724 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2023-03-17T12:15:56.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:47 smithi082 ceph-mon[94281]: pgmap v3432: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.3 MiB/s wr, 318 op/s 2023-03-17T12:15:56.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:50 smithi082 ceph-mon[94281]: pgmap v3433: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 225 op/s 2023-03-17T12:15:56.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:52 smithi082 ceph-mon[94281]: pgmap v3434: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 225 op/s 2023-03-17T12:15:56.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:54 smithi082 ceph-mon[94281]: pgmap v3435: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 351 op/s 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:56 smithi082 ceph-mon[94281]: pgmap v3436: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 237 op/s 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:15:56.782 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:57 smithi082 ceph-mon[94281]: pgmap v3437: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 241 op/s 2023-03-17T12:15:57.806 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:57 smithi082 ceph-mon[94281]: pgmap v3438: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 1.9 MiB/s wr, 155 op/s 2023-03-17T12:15:57.806 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:15:57.806 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:30:59 smithi082 ceph-mon[94281]: pgmap v3439: 97 pgs: 97 active+clean; 738 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 275 op/s 2023-03-17T12:15:57.806 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:01 smithi082 ceph-mon[94281]: pgmap v3440: 97 pgs: 97 active+clean; 738 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 275 op/s 2023-03-17T12:15:57.806 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:03 smithi082 ceph-mon[94281]: pgmap v3441: 97 pgs: 97 active+clean; 758 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.7 MiB/s wr, 243 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:04 smithi082 ceph-mon[94281]: osdmap e289: 12 total, 12 up, 12 in 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:05 smithi082 ceph-mon[94281]: pgmap v3443: 97 pgs: 97 active+clean; 758 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 298 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:07 smithi082 ceph-mon[94281]: pgmap v3444: 97 pgs: 97 active+clean; 767 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 300 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:09 smithi082 ceph-mon[94281]: pgmap v3445: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 252 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:11 smithi082 ceph-mon[94281]: pgmap v3446: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 252 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:11 smithi082 ceph-mon[94281]: osdmap e290: 12 total, 12 up, 12 in 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:13 smithi082 ceph-mon[94281]: pgmap v3448: 97 pgs: 97 active+clean; 785 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 289 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:15 smithi082 ceph-mon[94281]: pgmap v3449: 97 pgs: 97 active+clean; 785 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 259 op/s 2023-03-17T12:15:57.807 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:17 smithi082 ceph-mon[94281]: pgmap v3450: 97 pgs: 97 active+clean; 791 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 280 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:19 smithi082 ceph-mon[94281]: pgmap v3451: 97 pgs: 97 active+clean; 792 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 247 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:21 smithi082 ceph-mon[94281]: pgmap v3452: 97 pgs: 97 active+clean; 792 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 247 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:23 smithi082 ceph-mon[94281]: pgmap v3453: 97 pgs: 97 active+clean; 808 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 313 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:25 smithi082 ceph-mon[94281]: pgmap v3454: 97 pgs: 97 active+clean; 808 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 188 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:27 smithi082 ceph-mon[94281]: pgmap v3455: 97 pgs: 97 active+clean; 822 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 252 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:29 smithi082 ceph-mon[94281]: pgmap v3456: 97 pgs: 97 active+clean; 827 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 215 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:31 smithi082 ceph-mon[94281]: pgmap v3457: 97 pgs: 97 active+clean; 827 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2023-03-17T12:15:57.808 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:33 smithi082 ceph-mon[94281]: pgmap v3458: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.0 MiB/s wr, 297 op/s 2023-03-17T12:16:00.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:35 smithi082 ceph-mon[94281]: pgmap v3459: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 208 op/s 2023-03-17T12:16:00.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:37 smithi082 ceph-mon[94281]: pgmap v3460: 97 pgs: 97 active+clean; 828 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 287 op/s 2023-03-17T12:16:00.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:39 smithi082 ceph-mon[94281]: pgmap v3461: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 257 op/s 2023-03-17T12:16:01.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:41 smithi082 ceph-mon[94281]: pgmap v3462: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 224 op/s 2023-03-17T12:16:01.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:43 smithi082 ceph-mon[94281]: pgmap v3463: 97 pgs: 97 active+clean; 841 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 324 op/s 2023-03-17T12:16:01.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:45 smithi082 ceph-mon[94281]: pgmap v3464: 97 pgs: 97 active+clean; 841 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 211 op/s 2023-03-17T12:16:01.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:47 smithi082 ceph-mon[94281]: pgmap v3465: 97 pgs: 97 active+clean; 851 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 268 op/s 2023-03-17T12:16:01.982 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:49 smithi082 ceph-mon[94281]: pgmap v3466: 97 pgs: 97 active+clean; 855 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 218 op/s 2023-03-17T12:16:01.983 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:51 smithi082 ceph-mon[94281]: pgmap v3467: 97 pgs: 97 active+clean; 855 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 185 op/s 2023-03-17T12:16:02.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:53 smithi082 ceph-mon[94281]: pgmap v3468: 97 pgs: 97 active+clean; 870 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 283 op/s 2023-03-17T12:16:02.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:55 smithi082 ceph-mon[94281]: pgmap v3469: 97 pgs: 97 active+clean; 870 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 183 op/s 2023-03-17T12:16:02.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:57 smithi082 ceph-mon[94281]: pgmap v3470: 97 pgs: 97 active+clean; 873 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 251 op/s 2023-03-17T12:16:02.535 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:03.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:31:59 smithi082 ceph-mon[94281]: pgmap v3471: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-03-17T12:16:07.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:01 smithi082 ceph-mon[94281]: pgmap v3472: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 197 op/s 2023-03-17T12:16:07.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:07.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:07.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:01 smithi082 ceph-mon[94281]: pgmap v3473: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 230 op/s 2023-03-17T12:16:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:04 smithi082 ceph-mon[94281]: pgmap v3474: 97 pgs: 97 active+clean; 879 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-03-17T12:16:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:05 smithi082 ceph-mon[94281]: osdmap e291: 12 total, 12 up, 12 in 2023-03-17T12:16:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:06 smithi082 ceph-mon[94281]: pgmap v3476: 97 pgs: 97 active+clean; 879 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 218 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:07 smithi082 ceph-mon[94281]: pgmap v3477: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:10 smithi082 ceph-mon[94281]: pgmap v3478: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:12 smithi082 ceph-mon[94281]: pgmap v3479: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 264 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:12 smithi082 ceph-mon[94281]: osdmap e292: 12 total, 12 up, 12 in 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:14 smithi082 ceph-mon[94281]: pgmap v3481: 97 pgs: 97 active+clean; 898 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 253 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:16 smithi082 ceph-mon[94281]: pgmap v3482: 97 pgs: 97 active+clean; 898 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 226 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:17 smithi082 ceph-mon[94281]: pgmap v3483: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:20 smithi082 ceph-mon[94281]: pgmap v3484: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:22 smithi082 ceph-mon[94281]: pgmap v3485: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T12:16:08.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:24 smithi082 ceph-mon[94281]: pgmap v3486: 97 pgs: 97 active+clean; 916 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 304 op/s 2023-03-17T12:16:08.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:26 smithi082 ceph-mon[94281]: pgmap v3487: 97 pgs: 97 active+clean; 916 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 206 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:27 smithi082 ceph-mon[94281]: pgmap v3488: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 315 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:30 smithi082 ceph-mon[94281]: pgmap v3489: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:32 smithi082 ceph-mon[94281]: pgmap v3490: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:34 smithi082 ceph-mon[94281]: pgmap v3491: 97 pgs: 97 active+clean; 936 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 307 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:36 smithi082 ceph-mon[94281]: pgmap v3492: 97 pgs: 97 active+clean; 936 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 205 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:37 smithi082 ceph-mon[94281]: pgmap v3493: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 300 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:40 smithi082 ceph-mon[94281]: pgmap v3494: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 190 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:42 smithi082 ceph-mon[94281]: pgmap v3495: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 190 op/s 2023-03-17T12:16:10.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:44 smithi082 ceph-mon[94281]: pgmap v3496: 97 pgs: 97 active+clean; 957 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 295 op/s 2023-03-17T12:16:10.306 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:46 smithi082 ceph-mon[94281]: pgmap v3497: 97 pgs: 97 active+clean; 957 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T12:16:10.306 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:47 smithi082 ceph-mon[94281]: pgmap v3498: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 293 op/s 2023-03-17T12:16:10.306 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:50 smithi082 ceph-mon[94281]: pgmap v3499: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 199 op/s 2023-03-17T12:16:10.306 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:52 smithi082 ceph-mon[94281]: pgmap v3500: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 199 op/s 2023-03-17T12:16:12.529 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:54 smithi082 ceph-mon[94281]: pgmap v3501: 97 pgs: 97 active+clean; 973 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 305 op/s 2023-03-17T12:16:12.530 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:56 smithi082 ceph-mon[94281]: pgmap v3502: 97 pgs: 97 active+clean; 973 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2023-03-17T12:16:13.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:32:57 smithi082 ceph-mon[94281]: pgmap v3503: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 296 op/s 2023-03-17T12:16:13.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:00 smithi082 ceph-mon[94281]: pgmap v3504: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 201 op/s 2023-03-17T12:16:13.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:02 smithi082 ceph-mon[94281]: pgmap v3505: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 201 op/s 2023-03-17T12:16:13.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:13.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:14.385 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:15.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:15.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:04 smithi082 ceph-mon[94281]: pgmap v3506: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 344 op/s 2023-03-17T12:16:15.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:04 smithi082 ceph-mon[94281]: pgmap v3507: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.2 MiB/s wr, 279 op/s 2023-03-17T12:16:15.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:05 smithi082 ceph-mon[94281]: osdmap e293: 12 total, 12 up, 12 in 2023-03-17T12:16:15.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:06 smithi082 ceph-mon[94281]: pgmap v3509: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 200 op/s 2023-03-17T12:16:15.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:08 smithi082 ceph-mon[94281]: pgmap v3510: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 200 op/s 2023-03-17T12:16:15.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:10 smithi082 ceph-mon[94281]: pgmap v3511: 97 pgs: 97 active+clean; 1013 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.0 MiB/s wr, 366 op/s 2023-03-17T12:16:17.649 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:12 smithi082 ceph-mon[94281]: pgmap v3512: 97 pgs: 97 active+clean; 1013 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 149 op/s 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:12 smithi082 ceph-mon[94281]: osdmap e294: 12 total, 12 up, 12 in 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:14 smithi082 ceph-mon[94281]: pgmap v3514: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 292 op/s 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:16 smithi082 ceph-mon[94281]: pgmap v3515: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:18 smithi082 ceph-mon[94281]: pgmap v3516: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:20 smithi082 ceph-mon[94281]: pgmap v3517: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:22 smithi082 ceph-mon[94281]: pgmap v3518: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-03-17T12:16:17.822 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:24 smithi082 ceph-mon[94281]: pgmap v3519: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.2 MiB/s wr, 344 op/s 2023-03-17T12:16:19.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:26 smithi082 ceph-mon[94281]: pgmap v3520: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 211 op/s 2023-03-17T12:16:19.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:28 smithi082 ceph-mon[94281]: pgmap v3521: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 211 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:30 smithi082 ceph-mon[94281]: pgmap v3522: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 330 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:32 smithi082 ceph-mon[94281]: pgmap v3523: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 224 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:34 smithi082 ceph-mon[94281]: pgmap v3524: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 322 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:36 smithi082 ceph-mon[94281]: pgmap v3525: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:38 smithi082 ceph-mon[94281]: pgmap v3526: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:40 smithi082 ceph-mon[94281]: pgmap v3527: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 343 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:42 smithi082 ceph-mon[94281]: pgmap v3528: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 224 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:44 smithi082 ceph-mon[94281]: pgmap v3529: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 324 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:46 smithi082 ceph-mon[94281]: pgmap v3530: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 225 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:48 smithi082 ceph-mon[94281]: pgmap v3531: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 225 op/s 2023-03-17T12:16:19.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:50 smithi082 ceph-mon[94281]: pgmap v3532: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 331 op/s 2023-03-17T12:16:20.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:52 smithi082 ceph-mon[94281]: pgmap v3533: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 204 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:54 smithi082 ceph-mon[94281]: pgmap v3534: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.0 MiB/s wr, 313 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:56 smithi082 ceph-mon[94281]: pgmap v3535: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 214 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:33:58 smithi082 ceph-mon[94281]: pgmap v3536: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 214 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:00 smithi082 ceph-mon[94281]: pgmap v3537: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 321 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:02 smithi082 ceph-mon[94281]: pgmap v3538: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 216 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:04 smithi082 ceph-mon[94281]: pgmap v3539: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 342 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:05 smithi082 ceph-mon[94281]: pgmap v3540: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 244 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:05 smithi082 ceph-mon[94281]: pgmap v3541: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:05 smithi082 ceph-mon[94281]: osdmap e295: 12 total, 12 up, 12 in 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:07 smithi082 ceph-mon[94281]: pgmap v3543: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2023-03-17T12:16:20.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:09 smithi082 ceph-mon[94281]: pgmap v3544: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 347 op/s 2023-03-17T12:16:22.972 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:11 smithi082 ceph-mon[94281]: pgmap v3545: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 145 op/s 2023-03-17T12:16:22.972 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:12 smithi082 ceph-mon[94281]: osdmap e296: 12 total, 12 up, 12 in 2023-03-17T12:16:22.972 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:12 smithi082 ceph-mon[94281]: pgmap v3547: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 252 op/s 2023-03-17T12:16:22.972 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:14 smithi082 ceph-mon[94281]: pgmap v3548: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 229 op/s 2023-03-17T12:16:23.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:16 smithi082 ceph-mon[94281]: pgmap v3549: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 220 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:18 smithi082 ceph-mon[94281]: pgmap v3550: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 237 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:20 smithi082 ceph-mon[94281]: pgmap v3551: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 237 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:22 smithi082 ceph-mon[94281]: pgmap v3552: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 304 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:24 smithi082 ceph-mon[94281]: pgmap v3553: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:25 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:26 smithi082 ceph-mon[94281]: pgmap v3554: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:28 smithi082 ceph-mon[94281]: pgmap v3555: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 326 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:30 smithi082 ceph-mon[94281]: pgmap v3556: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 221 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:32 smithi082 ceph-mon[94281]: pgmap v3557: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 281 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:34 smithi082 ceph-mon[94281]: pgmap v3558: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 251 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:36 smithi082 ceph-mon[94281]: pgmap v3559: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 200 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:38 smithi082 ceph-mon[94281]: pgmap v3560: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.8 MiB/s wr, 293 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:40 smithi082 ceph-mon[94281]: pgmap v3561: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 186 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:42 smithi082 ceph-mon[94281]: pgmap v3562: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 255 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:44 smithi082 ceph-mon[94281]: pgmap v3563: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 228 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:46 smithi082 ceph-mon[94281]: pgmap v3564: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 195 op/s 2023-03-17T12:16:23.990 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:48 smithi082 ceph-mon[94281]: pgmap v3565: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 291 op/s 2023-03-17T12:16:25.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:50 smithi082 ceph-mon[94281]: pgmap v3566: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 198 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:52 smithi082 ceph-mon[94281]: pgmap v3567: 97 pgs: 97 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 272 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:54 smithi082 ceph-mon[94281]: pgmap v3568: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 228 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:56 smithi082 ceph-mon[94281]: pgmap v3569: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 195 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:34:58 smithi082 ceph-mon[94281]: pgmap v3570: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 290 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:00 smithi082 ceph-mon[94281]: pgmap v3571: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:02 smithi082 ceph-mon[94281]: pgmap v3572: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.4 MiB/s wr, 291 op/s 2023-03-17T12:16:25.580 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:04 smithi082 ceph-mon[94281]: osdmap e297: 12 total, 12 up, 12 in 2023-03-17T12:16:26.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:04 smithi082 ceph-mon[94281]: pgmap v3574: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 258 op/s 2023-03-17T12:16:26.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:26.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:26.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:26.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:05 smithi082 ceph-mon[94281]: pgmap v3575: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 275 op/s 2023-03-17T12:16:26.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:05 smithi082 ceph-mon[94281]: pgmap v3576: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 195 op/s 2023-03-17T12:16:27.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:27.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:07 smithi082 ceph-mon[94281]: pgmap v3577: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 353 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:10 smithi082 ceph-mon[94281]: pgmap v3578: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 195 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:12 smithi082 ceph-mon[94281]: pgmap v3579: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 151 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:12 smithi082 ceph-mon[94281]: osdmap e298: 12 total, 12 up, 12 in 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:14 smithi082 ceph-mon[94281]: pgmap v3581: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 294 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:16 smithi082 ceph-mon[94281]: pgmap v3582: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 235 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:17 smithi082 ceph-mon[94281]: pgmap v3583: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:20 smithi082 ceph-mon[94281]: pgmap v3584: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:22 smithi082 ceph-mon[94281]: pgmap v3585: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T12:16:29.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:24 smithi082 ceph-mon[94281]: pgmap v3586: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 290 op/s 2023-03-17T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:26 smithi082 ceph-mon[94281]: pgmap v3587: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 183 op/s 2023-03-17T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:27 smithi082 ceph-mon[94281]: pgmap v3588: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 299 op/s 2023-03-17T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:30 smithi082 ceph-mon[94281]: pgmap v3589: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 203 op/s 2023-03-17T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:32 smithi082 ceph-mon[94281]: pgmap v3590: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 203 op/s 2023-03-17T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:34 smithi082 ceph-mon[94281]: pgmap v3591: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 297 op/s 2023-03-17T12:16:29.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:36 smithi082 ceph-mon[94281]: pgmap v3592: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 210 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:37 smithi082 ceph-mon[94281]: pgmap v3593: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 314 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:40 smithi082 ceph-mon[94281]: pgmap v3594: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:42 smithi082 ceph-mon[94281]: pgmap v3595: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:44 smithi082 ceph-mon[94281]: pgmap v3596: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 293 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:46 smithi082 ceph-mon[94281]: pgmap v3597: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 199 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:47 smithi082 ceph-mon[94281]: pgmap v3598: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.4 MiB/s wr, 298 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:50 smithi082 ceph-mon[94281]: pgmap v3599: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 193 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:52 smithi082 ceph-mon[94281]: pgmap v3600: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 193 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:54 smithi082 ceph-mon[94281]: pgmap v3601: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 304 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:56 smithi082 ceph-mon[94281]: pgmap v3602: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 210 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:35:57 smithi082 ceph-mon[94281]: pgmap v3603: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.8 MiB/s wr, 305 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:00 smithi082 ceph-mon[94281]: pgmap v3604: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 206 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:02 smithi082 ceph-mon[94281]: pgmap v3605: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 206 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:04 smithi082 ceph-mon[94281]: pgmap v3606: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 324 op/s 2023-03-17T12:16:29.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:04 smithi082 ceph-mon[94281]: osdmap e299: 12 total, 12 up, 12 in 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:06 smithi082 ceph-mon[94281]: pgmap v3608: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 255 op/s 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:07 smithi082 ceph-mon[94281]: pgmap v3609: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 157 op/s 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:07 smithi082 ceph-mon[94281]: pgmap v3610: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 203 op/s 2023-03-17T12:16:29.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:09 smithi082 ceph-mon[94281]: pgmap v3611: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.2 MiB/s wr, 362 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:11 smithi082 ceph-mon[94281]: pgmap v3612: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 158 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:12 smithi082 ceph-mon[94281]: osdmap e300: 12 total, 12 up, 12 in 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:12 smithi082 ceph-mon[94281]: pgmap v3614: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.7 MiB/s wr, 329 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:15 smithi082 ceph-mon[94281]: pgmap v3615: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.6 MiB/s wr, 287 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:17 smithi082 ceph-mon[94281]: pgmap v3616: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 229 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:19 smithi082 ceph-mon[94281]: pgmap v3617: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 245 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:21 smithi082 ceph-mon[94281]: pgmap v3618: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 245 op/s 2023-03-17T12:16:32.213 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:22 smithi082 ceph-mon[94281]: pgmap v3619: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.2 MiB/s wr, 350 op/s 2023-03-17T12:16:32.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:25 smithi082 ceph-mon[94281]: pgmap v3620: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T12:16:32.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:27 smithi082 ceph-mon[94281]: pgmap v3621: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T12:16:32.214 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:29 smithi082 ceph-mon[94281]: pgmap v3622: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 339 op/s 2023-03-17T12:16:33.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:30 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:34.748 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:31 smithi082 ceph-mon[94281]: pgmap v3623: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 233 op/s 2023-03-17T12:16:34.748 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:32 smithi082 ceph-mon[94281]: pgmap v3624: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 326 op/s 2023-03-17T12:16:35.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:35 smithi082 ceph-mon[94281]: pgmap v3625: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:37 smithi082 ceph-mon[94281]: pgmap v3626: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:38 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:38 smithi082 ceph-mon[94281]: osdmap e301: 12 total, 12 up, 12 in 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:39 smithi082 ceph-mon[94281]: pgmap v3628: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 242 op/s 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:39 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/515552454,v1:172.21.15.35:6837/515552454] up:boot 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:39 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:16:36.082 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:39 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:41 smithi082 ceph-mon[94281]: pgmap v3629: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 242 op/s 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:42 smithi082 ceph-mon[94281]: pgmap v3630: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:45 smithi082 ceph-mon[94281]: pgmap v3631: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:47 smithi082 ceph-mon[94281]: pgmap v3632: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:49 smithi082 ceph-mon[94281]: pgmap v3633: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 256 op/s 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:51 smithi082 ceph-mon[94281]: pgmap v3634: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 216 op/s 2023-03-17T12:16:36.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:52 smithi082 ceph-mon[94281]: pgmap v3635: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 337 op/s 2023-03-17T12:16:38.563 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:55 smithi082 ceph-mon[94281]: pgmap v3636: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2023-03-17T12:16:39.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:57 smithi082 ceph-mon[94281]: pgmap v3637: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2023-03-17T12:16:39.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:36:59 smithi082 ceph-mon[94281]: pgmap v3638: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 316 op/s 2023-03-17T12:16:39.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:01 smithi082 ceph-mon[94281]: pgmap v3639: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:02 smithi082 ceph-mon[94281]: pgmap v3640: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 331 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:04 smithi082 ceph-mon[94281]: osdmap e302: 12 total, 12 up, 12 in 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:04 smithi082 ceph-mon[94281]: pgmap v3642: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 252 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:07 smithi082 ceph-mon[94281]: pgmap v3643: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 252 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:08 smithi082 ceph-mon[94281]: pgmap v3644: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.3 MiB/s wr, 296 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:08 smithi082 ceph-mon[94281]: pgmap v3645: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.1 MiB/s wr, 380 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:10 smithi082 ceph-mon[94281]: pgmap v3646: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:12 smithi082 ceph-mon[94281]: pgmap v3647: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:12 smithi082 ceph-mon[94281]: osdmap e303: 12 total, 12 up, 12 in 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:14 smithi082 ceph-mon[94281]: pgmap v3649: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.1 MiB/s wr, 356 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:16 smithi082 ceph-mon[94281]: pgmap v3650: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 157 op/s 2023-03-17T12:16:39.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:17 smithi082 ceph-mon[94281]: pgmap v3651: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T12:16:39.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:20 smithi082 ceph-mon[94281]: pgmap v3652: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T12:16:39.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:21 smithi082 ceph-mon[94281]: pgmap v3653: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T12:16:39.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:23 smithi082 ceph-mon[94281]: pgmap v3654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.4 MiB/s wr, 324 op/s 2023-03-17T12:16:41.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:25 smithi082 ceph-mon[94281]: pgmap v3655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 211 op/s 2023-03-17T12:16:41.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:27 smithi082 ceph-mon[94281]: pgmap v3656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 315 op/s 2023-03-17T12:16:41.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:29 smithi082 ceph-mon[94281]: pgmap v3657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-03-17T12:16:41.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:31 smithi082 ceph-mon[94281]: pgmap v3658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-03-17T12:16:41.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:33 smithi082 ceph-mon[94281]: pgmap v3659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 314 op/s 2023-03-17T12:16:43.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:35 smithi082 ceph-mon[94281]: pgmap v3660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 196 op/s 2023-03-17T12:16:43.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:37 smithi082 ceph-mon[94281]: pgmap v3661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 301 op/s 2023-03-17T12:16:43.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:39 smithi082 ceph-mon[94281]: pgmap v3662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T12:16:43.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:41 smithi082 ceph-mon[94281]: pgmap v3663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:43 smithi082 ceph-mon[94281]: pgmap v3664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.1 MiB/s wr, 291 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:45 smithi082 ceph-mon[94281]: pgmap v3665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 197 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:47 smithi082 ceph-mon[94281]: pgmap v3666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.1 MiB/s wr, 300 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:49 smithi082 ceph-mon[94281]: pgmap v3667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 195 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:51 smithi082 ceph-mon[94281]: pgmap v3668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 195 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:53 smithi082 ceph-mon[94281]: pgmap v3669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 297 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:55 smithi082 ceph-mon[94281]: pgmap v3670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 204 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:57 smithi082 ceph-mon[94281]: pgmap v3671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 298 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:37:59 smithi082 ceph-mon[94281]: pgmap v3672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 195 op/s 2023-03-17T12:16:44.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:01 smithi082 ceph-mon[94281]: pgmap v3673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 195 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:04 smithi082 ceph-mon[94281]: pgmap v3674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.5 MiB/s wr, 317 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:04 smithi082 ceph-mon[94281]: osdmap e304: 12 total, 12 up, 12 in 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:05 smithi082 ceph-mon[94281]: pgmap v3676: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:07 smithi082 ceph-mon[94281]: pgmap v3677: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:10 smithi082 ceph-mon[94281]: pgmap v3678: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:11 smithi082 ceph-mon[94281]: pgmap v3679: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:12 smithi082 ceph-mon[94281]: osdmap e305: 12 total, 12 up, 12 in 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:12 smithi082 ceph-mon[94281]: pgmap v3681: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.1 MiB/s wr, 285 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:12 smithi082 ceph-mon[94281]: pgmap v3682: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.2 MiB/s wr, 370 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:15 smithi082 ceph-mon[94281]: pgmap v3683: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 199 op/s 2023-03-17T12:16:44.680 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:17 smithi082 ceph-mon[94281]: pgmap v3684: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 199 op/s 2023-03-17T12:16:44.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:19 smithi082 ceph-mon[94281]: pgmap v3685: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.9 MiB/s wr, 382 op/s 2023-03-17T12:16:44.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:21 smithi082 ceph-mon[94281]: pgmap v3686: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.1 MiB/s wr, 303 op/s 2023-03-17T12:16:44.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:22 smithi082 ceph-mon[94281]: pgmap v3687: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 229 op/s 2023-03-17T12:16:45.323 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:25 smithi082 ceph-mon[94281]: pgmap v3688: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 191 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:27 smithi082 ceph-mon[94281]: pgmap v3689: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 191 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:29 smithi082 ceph-mon[94281]: pgmap v3690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 289 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:31 smithi082 ceph-mon[94281]: pgmap v3691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 188 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:32 smithi082 ceph-mon[94281]: pgmap v3692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.7 MiB/s wr, 286 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:35 smithi082 ceph-mon[94281]: pgmap v3693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 195 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:36 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:37 smithi082 ceph-mon[94281]: pgmap v3694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 195 op/s 2023-03-17T12:16:45.324 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:38 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:46.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:38 smithi082 ceph-mon[94281]: pgmap v3695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.6 MiB/s wr, 292 op/s 2023-03-17T12:16:46.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:41 smithi082 ceph-mon[94281]: pgmap v3696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 193 op/s 2023-03-17T12:16:46.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:42 smithi082 ceph-mon[94281]: pgmap v3697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 204 op/s 2023-03-17T12:16:46.549 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:45 smithi082 ceph-mon[94281]: pgmap v3698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 428 KiB/s wr, 106 op/s 2023-03-17T12:16:48.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:47 smithi082 ceph-mon[94281]: pgmap v3699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 428 KiB/s wr, 106 op/s 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:49 smithi082 ceph-mon[94281]: pgmap v3700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 444 KiB/s wr, 114 op/s 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:51 smithi082 ceph-mon[94281]: pgmap v3701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 18 op/s 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:52 smithi082 ceph-mon[94281]: pgmap v3702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 67 KiB/s wr, 23 op/s 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:54 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:54 smithi082 ceph-mon[94281]: pgmap v3703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 13 op/s 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:57 smithi082 ceph-mon[94281]: pgmap v3704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 13 op/s 2023-03-17T12:16:48.114 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:58 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:48.115 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:58 smithi082 ceph-mon[94281]: pgmap v3705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 72 KiB/s wr, 20 op/s 2023-03-17T12:16:48.115 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:38:59 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:48.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:00 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:50.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:00 smithi082 ceph-mon[94281]: pgmap v3706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 12 op/s 2023-03-17T12:16:50.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:02 smithi082 ceph-mon[94281]: pgmap v3707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 170 KiB/s wr, 34 op/s 2023-03-17T12:16:50.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:03 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:50.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:04 smithi082 ceph-mon[94281]: pgmap v3708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 28 op/s 2023-03-17T12:16:50.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:07 smithi082 ceph-mon[94281]: pgmap v3709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 28 op/s 2023-03-17T12:16:50.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:08 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:50.797 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:09 smithi082 ceph-mon[94281]: pgmap v3710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 535 KiB/s wr, 49 op/s 2023-03-17T12:16:51.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:10 smithi082 ceph-mon[94281]: osdmap e306: 12 total, 12 up, 12 in 2023-03-17T12:16:51.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:11 smithi082 ceph-mon[94281]: pgmap v3712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 585 KiB/s wr, 50 op/s 2023-03-17T12:16:51.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:12 smithi082 ceph-mon[94281]: pgmap v3713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T12:16:51.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:16:53.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:14 smithi082 ceph-mon[94281]: pgmap v3714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T12:16:53.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:53.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:53.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:17 smithi082 ceph-mon[94281]: pgmap v3715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:17 smithi082 ceph-mon[94281]: osdmap e307: 12 total, 12 up, 12 in 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:53.167 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:54.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:54.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:16:54.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:16:54.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:16:54.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:16:54.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: pgmap v3717: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 70 KiB/s wr, 42 op/s 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:16:54.439 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:16:55.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: pgmap v3718: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-03-17T12:16:55.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: pgmap v3719: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 51 op/s 2023-03-17T12:16:55.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:16:55.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:21 smithi082 ceph-mon[94281]: pgmap v3720: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 51 op/s 2023-03-17T12:16:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:22 smithi082 ceph-mon[94281]: pgmap v3721: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 443 KiB/s wr, 77 op/s 2023-03-17T12:16:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:24 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:24 smithi082 ceph-mon[94281]: pgmap v3722: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 364 KiB/s wr, 63 op/s 2023-03-17T12:16:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:26 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:55.646 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:26 smithi082 ceph-mon[94281]: pgmap v3723: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 261 KiB/s wr, 19 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:29 smithi082 ceph-mon[94281]: pgmap v3724: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 424 KiB/s wr, 35 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:31 smithi082 ceph-mon[94281]: pgmap v3725: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 353 KiB/s wr, 29 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:31 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:32 smithi082 ceph-mon[94281]: pgmap v3726: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 357 KiB/s wr, 34 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:35 smithi082 ceph-mon[94281]: pgmap v3727: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 180 KiB/s wr, 21 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:37 smithi082 ceph-mon[94281]: pgmap v3728: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 180 KiB/s wr, 21 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:39 smithi082 ceph-mon[94281]: pgmap v3729: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-03-17T12:16:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:41 smithi082 ceph-mon[94281]: pgmap v3730: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:42 smithi082 ceph-mon[94281]: pgmap v3731: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:45 smithi082 ceph-mon[94281]: pgmap v3732: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:47 smithi082 ceph-mon[94281]: pgmap v3733: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:49 smithi082 ceph-mon[94281]: pgmap v3734: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 18 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:51 smithi082 ceph-mon[94281]: pgmap v3735: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 13 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:52 smithi082 ceph-mon[94281]: pgmap v3736: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 18 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:55 smithi082 ceph-mon[94281]: pgmap v3737: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:57 smithi082 ceph-mon[94281]: pgmap v3738: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:39:59 smithi082 ceph-mon[94281]: pgmap v3739: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:16:57.510 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:01 smithi082 ceph-mon[94281]: pgmap v3740: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2023-03-17T12:16:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:02 smithi082 ceph-mon[94281]: pgmap v3741: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 28 op/s 2023-03-17T12:16:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:05 smithi082 ceph-mon[94281]: pgmap v3742: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:16:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:07 smithi082 ceph-mon[94281]: pgmap v3743: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:16:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:09 smithi082 ceph-mon[94281]: pgmap v3744: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 29 op/s 2023-03-17T12:16:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:10 smithi082 ceph-mon[94281]: osdmap e308: 12 total, 12 up, 12 in 2023-03-17T12:16:59.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:11 smithi082 ceph-mon[94281]: pgmap v3746: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:17:00.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:12 smithi082 ceph-mon[94281]: pgmap v3747: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:00.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:15 smithi082 ceph-mon[94281]: pgmap v3748: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:01.972 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:17 smithi082 ceph-mon[94281]: pgmap v3749: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:01.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:17 smithi082 ceph-mon[94281]: osdmap e309: 12 total, 12 up, 12 in 2023-03-17T12:17:01.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:19 smithi082 ceph-mon[94281]: pgmap v3751: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 114 B/s wr, 12 op/s 2023-03-17T12:17:02.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:02.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:21 smithi082 ceph-mon[94281]: pgmap v3752: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:02.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: pgmap v3753: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:17:02.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:02.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: pgmap v3754: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 127 B/s wr, 13 op/s 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: pgmap v3755: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 169 B/s wr, 18 op/s 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:25 smithi082 ceph-mon[94281]: pgmap v3756: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 136 B/s wr, 14 op/s 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:27 smithi082 ceph-mon[94281]: pgmap v3757: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:17:02.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:29 smithi082 ceph-mon[94281]: pgmap v3758: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 op/s 2023-03-17T12:17:04.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:31 smithi082 ceph-mon[94281]: pgmap v3759: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:17:08.668 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:32 smithi082 ceph-mon[94281]: pgmap v3760: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:35 smithi082 ceph-mon[94281]: pgmap v3761: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:37 smithi082 ceph-mon[94281]: pgmap v3762: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:39 smithi082 ceph-mon[94281]: pgmap v3763: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:41 smithi082 ceph-mon[94281]: pgmap v3764: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:42 smithi082 ceph-mon[94281]: pgmap v3765: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:45 smithi082 ceph-mon[94281]: pgmap v3766: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:47 smithi082 ceph-mon[94281]: pgmap v3767: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:49 smithi082 ceph-mon[94281]: pgmap v3768: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:10.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:50 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:51 smithi082 ceph-mon[94281]: pgmap v3769: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:52 smithi082 ceph-mon[94281]: pgmap v3770: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:55 smithi082 ceph-mon[94281]: pgmap v3771: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:57 smithi082 ceph-mon[94281]: pgmap v3772: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:40:59 smithi082 ceph-mon[94281]: pgmap v3773: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:01 smithi082 ceph-mon[94281]: pgmap v3774: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:02 smithi082 ceph-mon[94281]: pgmap v3775: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:03 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:04 smithi082 ceph-mon[94281]: pgmap v3776: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:07 smithi082 ceph-mon[94281]: pgmap v3777: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:09 smithi082 ceph-mon[94281]: pgmap v3778: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:10 smithi082 ceph-mon[94281]: osdmap e310: 12 total, 12 up, 12 in 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:11 smithi082 ceph-mon[94281]: pgmap v3780: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:17:10.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:12 smithi082 ceph-mon[94281]: pgmap v3781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:15 smithi082 ceph-mon[94281]: pgmap v3782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:17 smithi082 ceph-mon[94281]: pgmap v3783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:17 smithi082 ceph-mon[94281]: osdmap e311: 12 total, 12 up, 12 in 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:19 smithi082 ceph-mon[94281]: pgmap v3785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 12 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:21 smithi082 ceph-mon[94281]: pgmap v3786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:22 smithi082 ceph-mon[94281]: pgmap v3787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:23 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:24 smithi082 ceph-mon[94281]: pgmap v3788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:26 smithi082 ceph-mon[94281]: pgmap v3789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 105 B/s wr, 11 op/s 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:29 smithi082 ceph-mon[94281]: pgmap v3790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 91 B/s wr, 14 op/s 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:31 smithi082 ceph-mon[94281]: pgmap v3791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:17:11.973 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:32 smithi082 ceph-mon[94281]: pgmap v3792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-17T12:17:12.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:35 smithi082 ceph-mon[94281]: pgmap v3793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:17:12.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:36 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:12.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:37 smithi082 ceph-mon[94281]: pgmap v3794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:17:12.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:39 smithi082 ceph-mon[94281]: pgmap v3795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:12.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:41 smithi082 ceph-mon[94281]: pgmap v3796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:12.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:43 smithi082 ceph-mon[94281]: pgmap v3797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-03-17T12:17:12.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:43 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:12.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:45 smithi082 ceph-mon[94281]: pgmap v3798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:17:16.185 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:47 smithi082 ceph-mon[94281]: pgmap v3799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:16.186 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:48 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:16.186 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:49 smithi082 ceph-mon[94281]: pgmap v3800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:16.186 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:49 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:17.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:51 smithi082 ceph-mon[94281]: pgmap v3801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:17.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:52 smithi082 ceph-mon[94281]: pgmap v3802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-03-17T12:17:17.268 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:55 smithi082 ceph-mon[94281]: pgmap v3803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:17:19.863 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:57 smithi082 ceph-mon[94281]: pgmap v3804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:19.863 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:41:59 smithi082 ceph-mon[94281]: pgmap v3805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:19.863 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:01 smithi082 ceph-mon[94281]: pgmap v3806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:19.863 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:02 smithi082 ceph-mon[94281]: pgmap v3807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 23 op/s 2023-03-17T12:17:22.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:04 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:22.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:04 smithi082 ceph-mon[94281]: pgmap v3808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-03-17T12:17:22.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:06 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:22.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:06 smithi082 ceph-mon[94281]: pgmap v3809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:17:22.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:08 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:23.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:08 smithi082 ceph-mon[94281]: pgmap v3810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:09 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:09 smithi082 ceph-mon[94281]: osdmap e312: 12 total, 12 up, 12 in 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:10 smithi082 ceph-mon[94281]: pgmap v3812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:12 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:12 smithi082 ceph-mon[94281]: pgmap v3813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 14 op/s 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:14 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:23.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:14 smithi082 ceph-mon[94281]: pgmap v3814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:15 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:16 smithi082 ceph-mon[94281]: pgmap v3815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:16 smithi082 ceph-mon[94281]: osdmap e313: 12 total, 12 up, 12 in 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:19 smithi082 ceph-mon[94281]: pgmap v3817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:20 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:21 smithi082 ceph-mon[94281]: pgmap v3818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:22 smithi082 ceph-mon[94281]: pgmap v3819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:25 smithi082 ceph-mon[94281]: pgmap v3820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:27 smithi082 ceph-mon[94281]: pgmap v3821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:24.723 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:29 smithi082 ceph-mon[94281]: pgmap v3822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-03-17T12:17:24.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: pgmap v3823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:24.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:24.724 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:26.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:26.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:26.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: pgmap v3824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:26.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: pgmap v3825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:26.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:26.017 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:32 smithi082 ceph-mon[94281]: pgmap v3826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:17:26.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:35 smithi082 ceph-mon[94281]: pgmap v3827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:17:26.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:37 smithi082 ceph-mon[94281]: pgmap v3828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-03-17T12:17:27.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:39 smithi082 ceph-mon[94281]: pgmap v3829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:17:27.304 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:41 smithi082 ceph-mon[94281]: pgmap v3830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:17:27.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:42 smithi082 ceph-mon[94281]: pgmap v3831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:17:27.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:45 smithi082 ceph-mon[94281]: pgmap v3832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:27.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:47 smithi082 ceph-mon[94281]: pgmap v3833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:27.305 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:49 smithi082 ceph-mon[94281]: pgmap v3834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:17:28.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:51 smithi082 ceph-mon[94281]: pgmap v3835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:28.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:52 smithi082 ceph-mon[94281]: pgmap v3836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:17:28.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:55 smithi082 ceph-mon[94281]: pgmap v3837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:57 smithi082 ceph-mon[94281]: pgmap v3838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:42:59 smithi082 ceph-mon[94281]: pgmap v3839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:01 smithi082 ceph-mon[94281]: pgmap v3840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:02 smithi082 ceph-mon[94281]: pgmap v3841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:05 smithi082 ceph-mon[94281]: pgmap v3842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:07 smithi082 ceph-mon[94281]: pgmap v3843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:09 smithi082 ceph-mon[94281]: pgmap v3844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:10 smithi082 ceph-mon[94281]: osdmap e314: 12 total, 12 up, 12 in 2023-03-17T12:17:29.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:11 smithi082 ceph-mon[94281]: pgmap v3846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:17:30.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:12 smithi082 ceph-mon[94281]: pgmap v3847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:30.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:15 smithi082 ceph-mon[94281]: pgmap v3848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:30.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:17 smithi082 ceph-mon[94281]: pgmap v3849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:30.905 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:17 smithi082 ceph-mon[94281]: osdmap e315: 12 total, 12 up, 12 in 2023-03-17T12:17:30.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:19 smithi082 ceph-mon[94281]: pgmap v3851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 13 op/s 2023-03-17T12:17:30.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:21 smithi082 ceph-mon[94281]: pgmap v3852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:17:30.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:22 smithi082 ceph-mon[94281]: pgmap v3853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:31.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:25 smithi082 ceph-mon[94281]: pgmap v3854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:31.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:27 smithi082 ceph-mon[94281]: pgmap v3855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:31.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:29 smithi082 ceph-mon[94281]: pgmap v3856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 90 B/s wr, 14 op/s 2023-03-17T12:17:31.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:31 smithi082 ceph-mon[94281]: pgmap v3857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:31.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:31.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:31.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:33.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:33.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:32 smithi082 ceph-mon[94281]: pgmap v3858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:17:33.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:32 smithi082 ceph-mon[94281]: pgmap v3859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:17:33.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:34 smithi082 ceph-mon[94281]: pgmap v3860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:33.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:36 smithi082 ceph-mon[94281]: pgmap v3861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:33.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:37 smithi082 ceph-mon[94281]: pgmap v3862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:17:33.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:39 smithi082 ceph-mon[94281]: pgmap v3863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:33.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:41 smithi082 ceph-mon[94281]: pgmap v3864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:34.306 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:43 smithi082 ceph-mon[94281]: pgmap v3865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:34.306 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:45 smithi082 ceph-mon[94281]: pgmap v3866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:34.307 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:47 smithi082 ceph-mon[94281]: pgmap v3867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:34.307 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:49 smithi082 ceph-mon[94281]: pgmap v3868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:34.307 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:51 smithi082 ceph-mon[94281]: pgmap v3869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:34.954 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:53 smithi082 ceph-mon[94281]: pgmap v3870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:34.954 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:55 smithi082 ceph-mon[94281]: pgmap v3871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:35.376 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:57 smithi082 ceph-mon[94281]: pgmap v3872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:35.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:43:59 smithi082 ceph-mon[94281]: pgmap v3873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:35.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:01 smithi082 ceph-mon[94281]: pgmap v3874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:35.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:03 smithi082 ceph-mon[94281]: pgmap v3875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:17:35.377 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:05 smithi082 ceph-mon[94281]: pgmap v3876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:17:37.476 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:07 smithi082 ceph-mon[94281]: pgmap v3877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:17:37.476 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:09 smithi082 ceph-mon[94281]: osdmap e316: 12 total, 12 up, 12 in 2023-03-17T12:17:37.476 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:09 smithi082 ceph-mon[94281]: pgmap v3879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:17:38.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:11 smithi082 ceph-mon[94281]: pgmap v3880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:17:38.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:13 smithi082 ceph-mon[94281]: pgmap v3881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:38.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:15 smithi082 ceph-mon[94281]: pgmap v3882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:38.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:17 smithi082 ceph-mon[94281]: osdmap e317: 12 total, 12 up, 12 in 2023-03-17T12:17:38.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:17 smithi082 ceph-mon[94281]: pgmap v3884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 B/s wr, 7 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:19 smithi082 ceph-mon[94281]: pgmap v3885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:21 smithi082 ceph-mon[94281]: pgmap v3886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:23 smithi082 ceph-mon[94281]: pgmap v3887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:25 smithi082 ceph-mon[94281]: pgmap v3888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:27 smithi082 ceph-mon[94281]: pgmap v3889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 100 B/s wr, 11 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:29 smithi082 ceph-mon[94281]: pgmap v3890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2023-03-17T12:17:39.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:31 smithi082 ceph-mon[94281]: pgmap v3891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:39.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:39.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:39.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:39.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:42.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:32 smithi082 ceph-mon[94281]: pgmap v3892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:17:42.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:32 smithi082 ceph-mon[94281]: pgmap v3893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:17:42.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:34 smithi082 ceph-mon[94281]: pgmap v3894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:42.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:36 smithi082 ceph-mon[94281]: pgmap v3895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:42.036 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:38 smithi082 ceph-mon[94281]: pgmap v3896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:42.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:40 smithi082 ceph-mon[94281]: pgmap v3897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:42.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:42 smithi082 ceph-mon[94281]: pgmap v3898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:42.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:44 smithi082 ceph-mon[94281]: pgmap v3899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:42.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:47 smithi082 ceph-mon[94281]: pgmap v3900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:42.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:49 smithi082 ceph-mon[94281]: pgmap v3901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:42.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:51 smithi082 ceph-mon[94281]: pgmap v3902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:42.038 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:53 smithi082 ceph-mon[94281]: pgmap v3903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:43.965 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:55 smithi082 ceph-mon[94281]: pgmap v3904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:57 smithi082 ceph-mon[94281]: pgmap v3905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:44:59 smithi082 ceph-mon[94281]: pgmap v3906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:01 smithi082 ceph-mon[94281]: pgmap v3907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:03 smithi082 ceph-mon[94281]: pgmap v3908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:05 smithi082 ceph-mon[94281]: pgmap v3909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:07 smithi082 ceph-mon[94281]: pgmap v3910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:09 smithi082 ceph-mon[94281]: pgmap v3911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:10 smithi082 ceph-mon[94281]: osdmap e318: 12 total, 12 up, 12 in 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:11 smithi082 ceph-mon[94281]: pgmap v3913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:17:43.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:13 smithi082 ceph-mon[94281]: pgmap v3914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:17:45.423 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:15 smithi082 ceph-mon[94281]: pgmap v3915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:45.423 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:17 smithi082 ceph-mon[94281]: pgmap v3916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:45.423 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:17 smithi082 ceph-mon[94281]: osdmap e319: 12 total, 12 up, 12 in 2023-03-17T12:17:46.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:19 smithi082 ceph-mon[94281]: pgmap v3918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 14 op/s 2023-03-17T12:17:46.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:21 smithi082 ceph-mon[94281]: pgmap v3919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:17:46.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:23 smithi082 ceph-mon[94281]: pgmap v3920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:17:46.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:25 smithi082 ceph-mon[94281]: pgmap v3921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:17:46.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:27 smithi082 ceph-mon[94281]: pgmap v3922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:17:46.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:29 smithi082 ceph-mon[94281]: pgmap v3923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2023-03-17T12:17:46.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:31 smithi082 ceph-mon[94281]: pgmap v3924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:46.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:32 smithi082 ceph-mon[94281]: pgmap v3925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:48.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:48.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:48.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:48.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:48.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:34 smithi082 ceph-mon[94281]: pgmap v3926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 KiB/s wr, 15 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:34 smithi082 ceph-mon[94281]: pgmap v3927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:36 smithi082 ceph-mon[94281]: pgmap v3928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:38 smithi082 ceph-mon[94281]: pgmap v3929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:40 smithi082 ceph-mon[94281]: pgmap v3930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:42 smithi082 ceph-mon[94281]: pgmap v3931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:44 smithi082 ceph-mon[94281]: pgmap v3932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:46 smithi082 ceph-mon[94281]: pgmap v3933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:48 smithi082 ceph-mon[94281]: pgmap v3934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:50 smithi082 ceph-mon[94281]: pgmap v3935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:52 smithi082 ceph-mon[94281]: pgmap v3936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:54 smithi082 ceph-mon[94281]: pgmap v3937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:17:49.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:56 smithi082 ceph-mon[94281]: pgmap v3938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:51.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:45:58 smithi082 ceph-mon[94281]: pgmap v3939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:51.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:00 smithi082 ceph-mon[94281]: pgmap v3940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:17:51.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:02 smithi082 ceph-mon[94281]: pgmap v3941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:51.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:04 smithi082 ceph-mon[94281]: pgmap v3942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:17:51.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:06 smithi082 ceph-mon[94281]: pgmap v3943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:08 smithi082 ceph-mon[94281]: pgmap v3944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:10 smithi082 ceph-mon[94281]: pgmap v3945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:10 smithi082 ceph-mon[94281]: osdmap e320: 12 total, 12 up, 12 in 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:12 smithi082 ceph-mon[94281]: pgmap v3947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:14 smithi082 ceph-mon[94281]: pgmap v3948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:16 smithi082 ceph-mon[94281]: pgmap v3949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:17 smithi082 ceph-mon[94281]: pgmap v3950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:17 smithi082 ceph-mon[94281]: osdmap e321: 12 total, 12 up, 12 in 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:19 smithi082 ceph-mon[94281]: pgmap v3952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 325 B/s wr, 12 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:21 smithi082 ceph-mon[94281]: pgmap v3953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:23 smithi082 ceph-mon[94281]: pgmap v3954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:25 smithi082 ceph-mon[94281]: pgmap v3955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:51.471 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:27 smithi082 ceph-mon[94281]: pgmap v3956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:29 smithi082 ceph-mon[94281]: pgmap v3957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 173 B/s wr, 14 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:31 smithi082 ceph-mon[94281]: pgmap v3958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:33 smithi082 ceph-mon[94281]: pgmap v3959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:33 smithi082 ceph-mon[94281]: pgmap v3960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:33 smithi082 ceph-mon[94281]: pgmap v3961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:36 smithi082 ceph-mon[94281]: pgmap v3962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:37 smithi082 ceph-mon[94281]: pgmap v3963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:40 smithi082 ceph-mon[94281]: pgmap v3964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:42 smithi082 ceph-mon[94281]: pgmap v3965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:44 smithi082 ceph-mon[94281]: pgmap v3966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:51.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:46 smithi082 ceph-mon[94281]: pgmap v3967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:52.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:47 smithi082 ceph-mon[94281]: pgmap v3968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:50 smithi082 ceph-mon[94281]: pgmap v3969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:52 smithi082 ceph-mon[94281]: pgmap v3970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:54 smithi082 ceph-mon[94281]: pgmap v3971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:56 smithi082 ceph-mon[94281]: pgmap v3972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:46:57 smithi082 ceph-mon[94281]: pgmap v3973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:00 smithi082 ceph-mon[94281]: pgmap v3974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:02 smithi082 ceph-mon[94281]: pgmap v3975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:04 smithi082 ceph-mon[94281]: pgmap v3976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:06 smithi082 ceph-mon[94281]: pgmap v3977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:17:52.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:07 smithi082 ceph-mon[94281]: pgmap v3978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:09 smithi082 ceph-mon[94281]: osdmap e322: 12 total, 12 up, 12 in 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:09 smithi082 ceph-mon[94281]: pgmap v3980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:12 smithi082 ceph-mon[94281]: pgmap v3981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:14 smithi082 ceph-mon[94281]: pgmap v3982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:16 smithi082 ceph-mon[94281]: pgmap v3983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:17 smithi082 ceph-mon[94281]: osdmap e323: 12 total, 12 up, 12 in 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:17 smithi082 ceph-mon[94281]: pgmap v3985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 13 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:20 smithi082 ceph-mon[94281]: pgmap v3986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:52.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:22 smithi082 ceph-mon[94281]: pgmap v3987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:17:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:24 smithi082 ceph-mon[94281]: pgmap v3988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:52.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:26 smithi082 ceph-mon[94281]: pgmap v3989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:17:53.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:27 smithi082 ceph-mon[94281]: pgmap v3990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 96 B/s wr, 15 op/s 2023-03-17T12:17:53.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:30 smithi082 ceph-mon[94281]: pgmap v3991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:53.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:32 smithi082 ceph-mon[94281]: pgmap v3992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:53.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:34 smithi082 ceph-mon[94281]: pgmap v3993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:55.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:17:55.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:17:55.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:35 smithi082 ceph-mon[94281]: pgmap v3994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:35 smithi082 ceph-mon[94281]: pgmap v3995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:37 smithi082 ceph-mon[94281]: pgmap v3996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:39 smithi082 ceph-mon[94281]: pgmap v3997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:41 smithi082 ceph-mon[94281]: pgmap v3998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:42 smithi082 ceph-mon[94281]: pgmap v3999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:45 smithi082 ceph-mon[94281]: pgmap v4000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:47 smithi082 ceph-mon[94281]: pgmap v4001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:49 smithi082 ceph-mon[94281]: pgmap v4002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:51 smithi082 ceph-mon[94281]: pgmap v4003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:52 smithi082 ceph-mon[94281]: pgmap v4004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:55.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:55 smithi082 ceph-mon[94281]: pgmap v4005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:55.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:57 smithi082 ceph-mon[94281]: pgmap v4006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:55.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:47:59 smithi082 ceph-mon[94281]: pgmap v4007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:17:55.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:01 smithi082 ceph-mon[94281]: pgmap v4008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:17:55.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:02 smithi082 ceph-mon[94281]: pgmap v4009: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:17:55.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:05 smithi082 ceph-mon[94281]: pgmap v4010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:17:55.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:07 smithi082 ceph-mon[94281]: pgmap v4011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:17:57.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:09 smithi082 ceph-mon[94281]: pgmap v4012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:17:57.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:10 smithi082 ceph-mon[94281]: osdmap e324: 12 total, 12 up, 12 in 2023-03-17T12:17:57.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:11 smithi082 ceph-mon[94281]: pgmap v4014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:17:57.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:12 smithi082 ceph-mon[94281]: pgmap v4015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:17:57.289 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:15 smithi082 ceph-mon[94281]: pgmap v4016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:17:57.290 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:17 smithi082 ceph-mon[94281]: pgmap v4017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:17:57.290 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:17 smithi082 ceph-mon[94281]: osdmap e325: 12 total, 12 up, 12 in 2023-03-17T12:17:57.290 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:19 smithi082 ceph-mon[94281]: pgmap v4019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2023-03-17T12:17:57.290 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:21 smithi082 ceph-mon[94281]: pgmap v4020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:17:57.290 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:22 smithi082 ceph-mon[94281]: pgmap v4021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T12:17:59.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:25 smithi082 ceph-mon[94281]: pgmap v4022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T12:17:59.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:27 smithi082 ceph-mon[94281]: pgmap v4023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T12:17:59.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:29 smithi082 ceph-mon[94281]: pgmap v4024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2023-03-17T12:17:59.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:31 smithi082 ceph-mon[94281]: pgmap v4025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:17:59.006 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:32 smithi082 ceph-mon[94281]: pgmap v4026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:00.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:35 smithi082 ceph-mon[94281]: pgmap v4027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:00.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:00.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:00.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:00.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:00.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:02.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:03.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:37 smithi082 ceph-mon[94281]: pgmap v4028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2023-03-17T12:18:03.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:37 smithi082 ceph-mon[94281]: pgmap v4029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:18:03.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:39 smithi082 ceph-mon[94281]: pgmap v4030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:18:03.544 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:41 smithi082 ceph-mon[94281]: pgmap v4031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:43 smithi082 ceph-mon[94281]: pgmap v4032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:45 smithi082 ceph-mon[94281]: pgmap v4033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:47 smithi082 ceph-mon[94281]: pgmap v4034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:49 smithi082 ceph-mon[94281]: pgmap v4035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:51 smithi082 ceph-mon[94281]: pgmap v4036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:53 smithi082 ceph-mon[94281]: pgmap v4037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:03.545 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:55 smithi082 ceph-mon[94281]: pgmap v4038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T12:18:03.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:57 smithi082 ceph-mon[94281]: pgmap v4039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:04.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:48:59 smithi082 ceph-mon[94281]: pgmap v4040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:04.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:01 smithi082 ceph-mon[94281]: pgmap v4041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:04.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:03 smithi082 ceph-mon[94281]: pgmap v4042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:04.793 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:05 smithi082 ceph-mon[94281]: pgmap v4043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:18:04.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:07 smithi082 ceph-mon[94281]: pgmap v4044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:04.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:09 smithi082 ceph-mon[94281]: pgmap v4045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:04.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:10 smithi082 ceph-mon[94281]: osdmap e326: 12 total, 12 up, 12 in 2023-03-17T12:18:04.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:11 smithi082 ceph-mon[94281]: pgmap v4047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:05.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:13 smithi082 ceph-mon[94281]: pgmap v4048: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:05.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:15 smithi082 ceph-mon[94281]: pgmap v4049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:18:05.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:17 smithi082 ceph-mon[94281]: pgmap v4050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:18:05.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:17 smithi082 ceph-mon[94281]: osdmap e327: 12 total, 12 up, 12 in 2023-03-17T12:18:06.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:19 smithi082 ceph-mon[94281]: pgmap v4052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 375 B/s wr, 14 op/s 2023-03-17T12:18:06.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:21 smithi082 ceph-mon[94281]: pgmap v4053: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:18:06.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:23 smithi082 ceph-mon[94281]: pgmap v4054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:18:06.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:25 smithi082 ceph-mon[94281]: pgmap v4055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:06.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:27 smithi082 ceph-mon[94281]: pgmap v4056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:06.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:29 smithi082 ceph-mon[94281]: pgmap v4057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 15 op/s 2023-03-17T12:18:06.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:31 smithi082 ceph-mon[94281]: pgmap v4058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:06.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:33 smithi082 ceph-mon[94281]: pgmap v4059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:35 smithi082 ceph-mon[94281]: pgmap v4060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:37 smithi082 ceph-mon[94281]: pgmap v4061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: pgmap v4062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:08.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:09.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:09.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:09.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:09.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:09.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:09.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: pgmap v4063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:18:10.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:10.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:14.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:14.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:18:14.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:18:14.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:14.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:14.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: pgmap v4064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2023-03-17T12:18:14.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: pgmap v4065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:18:14.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:14.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:42 smithi082 ceph-mon[94281]: pgmap v4066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 op/s 2023-03-17T12:18:14.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:45 smithi082 ceph-mon[94281]: pgmap v4067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:47 smithi082 ceph-mon[94281]: pgmap v4068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:49 smithi082 ceph-mon[94281]: pgmap v4069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:51 smithi082 ceph-mon[94281]: pgmap v4070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:52 smithi082 ceph-mon[94281]: pgmap v4071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:55 smithi082 ceph-mon[94281]: pgmap v4072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:57 smithi082 ceph-mon[94281]: pgmap v4073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:49:59 smithi082 ceph-mon[94281]: pgmap v4074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:14.091 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:01 smithi082 ceph-mon[94281]: pgmap v4075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:02 smithi082 ceph-mon[94281]: pgmap v4076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:05 smithi082 ceph-mon[94281]: pgmap v4077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:07 smithi082 ceph-mon[94281]: pgmap v4078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:09 smithi082 ceph-mon[94281]: pgmap v4079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:10 smithi082 ceph-mon[94281]: osdmap e328: 12 total, 12 up, 12 in 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:11 smithi082 ceph-mon[94281]: pgmap v4081: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:12 smithi082 ceph-mon[94281]: pgmap v4082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:15 smithi082 ceph-mon[94281]: pgmap v4083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:17 smithi082 ceph-mon[94281]: pgmap v4084: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:17 smithi082 ceph-mon[94281]: osdmap e329: 12 total, 12 up, 12 in 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:19 smithi082 ceph-mon[94281]: pgmap v4086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 228 B/s wr, 12 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:21 smithi082 ceph-mon[94281]: pgmap v4087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:22 smithi082 ceph-mon[94281]: pgmap v4088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:25 smithi082 ceph-mon[94281]: pgmap v4089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:27 smithi082 ceph-mon[94281]: pgmap v4090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:14.092 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:29 smithi082 ceph-mon[94281]: pgmap v4091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:31 smithi082 ceph-mon[94281]: pgmap v4092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:32 smithi082 ceph-mon[94281]: pgmap v4093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:35 smithi082 ceph-mon[94281]: pgmap v4094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:37 smithi082 ceph-mon[94281]: pgmap v4095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:39 smithi082 ceph-mon[94281]: pgmap v4096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:41 smithi082 ceph-mon[94281]: pgmap v4097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:42 smithi082 ceph-mon[94281]: pgmap v4098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:42 smithi082 ceph-mon[94281]: pgmap v4099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:44 smithi082 ceph-mon[94281]: pgmap v4100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:46 smithi082 ceph-mon[94281]: pgmap v4101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:48 smithi082 ceph-mon[94281]: pgmap v4102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:50 smithi082 ceph-mon[94281]: pgmap v4103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:14.093 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:52 smithi082 ceph-mon[94281]: pgmap v4104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:14.094 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:54 smithi082 ceph-mon[94281]: pgmap v4105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:14.094 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:56 smithi082 ceph-mon[94281]: pgmap v4106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:16.056 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:50:58 smithi082 ceph-mon[94281]: pgmap v4107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:16.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:00 smithi082 ceph-mon[94281]: pgmap v4108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:18:16.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:02 smithi082 ceph-mon[94281]: pgmap v4109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:18:16.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:04 smithi082 ceph-mon[94281]: pgmap v4110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:18:16.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:06 smithi082 ceph-mon[94281]: pgmap v4111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:18:16.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:08 smithi082 ceph-mon[94281]: pgmap v4112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:18:16.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:10 smithi082 ceph-mon[94281]: pgmap v4113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T12:18:17.168 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:10 smithi082 ceph-mon[94281]: osdmap e330: 12 total, 12 up, 12 in 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:12 smithi082 ceph-mon[94281]: pgmap v4115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:14 smithi082 ceph-mon[94281]: pgmap v4116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:16 smithi082 ceph-mon[94281]: pgmap v4117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:17 smithi082 ceph-mon[94281]: pgmap v4118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:17 smithi082 ceph-mon[94281]: osdmap e331: 12 total, 12 up, 12 in 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:19 smithi082 ceph-mon[94281]: pgmap v4120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 105 B/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:21 smithi082 ceph-mon[94281]: pgmap v4121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:23 smithi082 ceph-mon[94281]: pgmap v4122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:25 smithi082 ceph-mon[94281]: pgmap v4123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:27 smithi082 ceph-mon[94281]: pgmap v4124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:29 smithi082 ceph-mon[94281]: pgmap v4125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:31 smithi082 ceph-mon[94281]: pgmap v4126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:33 smithi082 ceph-mon[94281]: pgmap v4127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:35 smithi082 ceph-mon[94281]: pgmap v4128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:17.169 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:37 smithi082 ceph-mon[94281]: pgmap v4129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:17.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:39 smithi082 ceph-mon[94281]: pgmap v4130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:17.170 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:21.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:42 smithi082 ceph-mon[94281]: pgmap v4131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:21.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:21.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:21.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:43 smithi082 ceph-mon[94281]: pgmap v4132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 15 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:43 smithi082 ceph-mon[94281]: pgmap v4133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:45 smithi082 ceph-mon[94281]: pgmap v4134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:47 smithi082 ceph-mon[94281]: pgmap v4135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:49 smithi082 ceph-mon[94281]: pgmap v4136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:51 smithi082 ceph-mon[94281]: pgmap v4137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:52 smithi082 ceph-mon[94281]: pgmap v4138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:55 smithi082 ceph-mon[94281]: pgmap v4139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:57 smithi082 ceph-mon[94281]: pgmap v4140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:51:59 smithi082 ceph-mon[94281]: pgmap v4141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:01 smithi082 ceph-mon[94281]: pgmap v4142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:02 smithi082 ceph-mon[94281]: pgmap v4143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:05 smithi082 ceph-mon[94281]: pgmap v4144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:21.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:07 smithi082 ceph-mon[94281]: pgmap v4145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:21.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:09 smithi082 ceph-mon[94281]: pgmap v4146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:21.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:10 smithi082 ceph-mon[94281]: osdmap e332: 12 total, 12 up, 12 in 2023-03-17T12:18:21.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:11 smithi082 ceph-mon[94281]: pgmap v4148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:21.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:12 smithi082 ceph-mon[94281]: pgmap v4149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:22.238 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:15 smithi082 ceph-mon[94281]: pgmap v4150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:22.238 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:17 smithi082 ceph-mon[94281]: pgmap v4151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:22.238 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:17 smithi082 ceph-mon[94281]: osdmap e333: 12 total, 12 up, 12 in 2023-03-17T12:18:24.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:19 smithi082 ceph-mon[94281]: pgmap v4153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 12 op/s 2023-03-17T12:18:24.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:21 smithi082 ceph-mon[94281]: pgmap v4154: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:24.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:22 smithi082 ceph-mon[94281]: pgmap v4155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:24.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:25 smithi082 ceph-mon[94281]: pgmap v4156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:27 smithi082 ceph-mon[94281]: pgmap v4157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:29 smithi082 ceph-mon[94281]: pgmap v4158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:31 smithi082 ceph-mon[94281]: pgmap v4159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:32 smithi082 ceph-mon[94281]: pgmap v4160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:35 smithi082 ceph-mon[94281]: pgmap v4161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:37 smithi082 ceph-mon[94281]: pgmap v4162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:39 smithi082 ceph-mon[94281]: pgmap v4163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:41 smithi082 ceph-mon[94281]: pgmap v4164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:42 smithi082 ceph-mon[94281]: pgmap v4165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:27.558 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:30.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:30.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:43 smithi082 ceph-mon[94281]: pgmap v4166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:18:30.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:43 smithi082 ceph-mon[94281]: pgmap v4167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:30.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:30.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:46 smithi082 ceph-mon[94281]: pgmap v4168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:30.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:47 smithi082 ceph-mon[94281]: pgmap v4169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:50 smithi082 ceph-mon[94281]: pgmap v4170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:52 smithi082 ceph-mon[94281]: pgmap v4171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:54 smithi082 ceph-mon[94281]: pgmap v4172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:56 smithi082 ceph-mon[94281]: pgmap v4173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:52:57 smithi082 ceph-mon[94281]: pgmap v4174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:00 smithi082 ceph-mon[94281]: pgmap v4175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:02 smithi082 ceph-mon[94281]: pgmap v4176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:04 smithi082 ceph-mon[94281]: pgmap v4177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:06 smithi082 ceph-mon[94281]: pgmap v4178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:07 smithi082 ceph-mon[94281]: pgmap v4179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:09 smithi082 ceph-mon[94281]: osdmap e334: 12 total, 12 up, 12 in 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:09 smithi082 ceph-mon[94281]: pgmap v4181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:12 smithi082 ceph-mon[94281]: pgmap v4182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:14 smithi082 ceph-mon[94281]: pgmap v4183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:16 smithi082 ceph-mon[94281]: pgmap v4184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:30.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:17 smithi082 ceph-mon[94281]: osdmap e335: 12 total, 12 up, 12 in 2023-03-17T12:18:30.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:17 smithi082 ceph-mon[94281]: pgmap v4186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 14 op/s 2023-03-17T12:18:30.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:20 smithi082 ceph-mon[94281]: pgmap v4187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:30.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:22 smithi082 ceph-mon[94281]: pgmap v4188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:30.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:24 smithi082 ceph-mon[94281]: pgmap v4189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:30.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:26 smithi082 ceph-mon[94281]: pgmap v4190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:30.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:27 smithi082 ceph-mon[94281]: pgmap v4191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:30 smithi082 ceph-mon[94281]: pgmap v4192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:32 smithi082 ceph-mon[94281]: pgmap v4193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:34 smithi082 ceph-mon[94281]: pgmap v4194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:36 smithi082 ceph-mon[94281]: pgmap v4195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:37 smithi082 ceph-mon[94281]: pgmap v4196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:40 smithi082 ceph-mon[94281]: pgmap v4197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:34.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:42 smithi082 ceph-mon[94281]: pgmap v4198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:35.000 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:44 smithi082 ceph-mon[94281]: pgmap v4199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:18:35.000 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:35.000 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:37.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:37.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:37.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:45 smithi082 ceph-mon[94281]: pgmap v4200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 KiB/s wr, 10 op/s 2023-03-17T12:18:37.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:45 smithi082 ceph-mon[94281]: pgmap v4201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:18:37.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:47 smithi082 ceph-mon[94281]: pgmap v4202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2023-03-17T12:18:37.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:49 smithi082 ceph-mon[94281]: pgmap v4203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:18:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:51 smithi082 ceph-mon[94281]: pgmap v4204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:18:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:53 smithi082 ceph-mon[94281]: pgmap v4205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6 op/s 2023-03-17T12:18:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:55 smithi082 ceph-mon[94281]: pgmap v4206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:57 smithi082 ceph-mon[94281]: pgmap v4207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:53:59 smithi082 ceph-mon[94281]: pgmap v4208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:01 smithi082 ceph-mon[94281]: pgmap v4209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:03 smithi082 ceph-mon[94281]: pgmap v4210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:05 smithi082 ceph-mon[94281]: pgmap v4211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:07 smithi082 ceph-mon[94281]: pgmap v4212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:09 smithi082 ceph-mon[94281]: pgmap v4213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:10 smithi082 ceph-mon[94281]: osdmap e336: 12 total, 12 up, 12 in 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:11 smithi082 ceph-mon[94281]: pgmap v4215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:13 smithi082 ceph-mon[94281]: pgmap v4216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:15 smithi082 ceph-mon[94281]: pgmap v4217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:17 smithi082 ceph-mon[94281]: pgmap v4218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:17 smithi082 ceph-mon[94281]: osdmap e337: 12 total, 12 up, 12 in 2023-03-17T12:18:38.612 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:19 smithi082 ceph-mon[94281]: pgmap v4220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:18:39.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:21 smithi082 ceph-mon[94281]: pgmap v4221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:39.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:23 smithi082 ceph-mon[94281]: pgmap v4222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:39.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:25 smithi082 ceph-mon[94281]: pgmap v4223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:18:39.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:27 smithi082 ceph-mon[94281]: pgmap v4224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:18:39.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:29 smithi082 ceph-mon[94281]: pgmap v4225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2023-03-17T12:18:39.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:31 smithi082 ceph-mon[94281]: pgmap v4226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:33 smithi082 ceph-mon[94281]: pgmap v4227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:35 smithi082 ceph-mon[94281]: pgmap v4228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:37 smithi082 ceph-mon[94281]: pgmap v4229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:39 smithi082 ceph-mon[94281]: pgmap v4230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:41 smithi082 ceph-mon[94281]: pgmap v4231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:43 smithi082 ceph-mon[94281]: pgmap v4232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:45 smithi082 ceph-mon[94281]: pgmap v4233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:39.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:46 smithi082 ceph-mon[94281]: pgmap v4234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:48 smithi082 ceph-mon[94281]: pgmap v4235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:50 smithi082 ceph-mon[94281]: pgmap v4236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:52 smithi082 ceph-mon[94281]: pgmap v4237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:54 smithi082 ceph-mon[94281]: pgmap v4238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 15 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:56 smithi082 ceph-mon[94281]: pgmap v4239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:54:58 smithi082 ceph-mon[94281]: pgmap v4240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:00 smithi082 ceph-mon[94281]: pgmap v4241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:02 smithi082 ceph-mon[94281]: pgmap v4242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:04 smithi082 ceph-mon[94281]: pgmap v4243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:06 smithi082 ceph-mon[94281]: pgmap v4244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:08 smithi082 ceph-mon[94281]: pgmap v4245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:10 smithi082 ceph-mon[94281]: pgmap v4246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:10 smithi082 ceph-mon[94281]: osdmap e338: 12 total, 12 up, 12 in 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:12 smithi082 ceph-mon[94281]: pgmap v4248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:39.251 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:14 smithi082 ceph-mon[94281]: pgmap v4249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:16 smithi082 ceph-mon[94281]: pgmap v4250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:17 smithi082 ceph-mon[94281]: pgmap v4251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:17 smithi082 ceph-mon[94281]: osdmap e339: 12 total, 12 up, 12 in 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:19 smithi082 ceph-mon[94281]: pgmap v4253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 12 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:21 smithi082 ceph-mon[94281]: pgmap v4254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:23 smithi082 ceph-mon[94281]: pgmap v4255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:25 smithi082 ceph-mon[94281]: pgmap v4256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:27 smithi082 ceph-mon[94281]: pgmap v4257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:29 smithi082 ceph-mon[94281]: pgmap v4258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:31 smithi082 ceph-mon[94281]: pgmap v4259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:33 smithi082 ceph-mon[94281]: pgmap v4260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:35 smithi082 ceph-mon[94281]: pgmap v4261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:37 smithi082 ceph-mon[94281]: pgmap v4262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:39 smithi082 ceph-mon[94281]: pgmap v4263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:41 smithi082 ceph-mon[94281]: pgmap v4264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:43 smithi082 ceph-mon[94281]: pgmap v4265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:39.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:46 smithi082 ceph-mon[94281]: pgmap v4266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:46 smithi082 ceph-mon[94281]: pgmap v4267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:46 smithi082 ceph-mon[94281]: pgmap v4268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:47 smithi082 ceph-mon[94281]: pgmap v4269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:50 smithi082 ceph-mon[94281]: pgmap v4270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:52 smithi082 ceph-mon[94281]: pgmap v4271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:54 smithi082 ceph-mon[94281]: pgmap v4272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:56 smithi082 ceph-mon[94281]: pgmap v4273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:55:57 smithi082 ceph-mon[94281]: pgmap v4274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:00 smithi082 ceph-mon[94281]: pgmap v4275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:02 smithi082 ceph-mon[94281]: pgmap v4276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:04 smithi082 ceph-mon[94281]: pgmap v4277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:06 smithi082 ceph-mon[94281]: pgmap v4278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:39.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:07 smithi082 ceph-mon[94281]: pgmap v4279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:09 smithi082 ceph-mon[94281]: osdmap e340: 12 total, 12 up, 12 in 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:09 smithi082 ceph-mon[94281]: pgmap v4281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:12 smithi082 ceph-mon[94281]: pgmap v4282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:14 smithi082 ceph-mon[94281]: pgmap v4283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:16 smithi082 ceph-mon[94281]: pgmap v4284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:17 smithi082 ceph-mon[94281]: osdmap e341: 12 total, 12 up, 12 in 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:17 smithi082 ceph-mon[94281]: pgmap v4286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 13 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:20 smithi082 ceph-mon[94281]: pgmap v4287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:22 smithi082 ceph-mon[94281]: pgmap v4288: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:24 smithi082 ceph-mon[94281]: pgmap v4289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:26 smithi082 ceph-mon[94281]: pgmap v4290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:27 smithi082 ceph-mon[94281]: pgmap v4291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:30 smithi082 ceph-mon[94281]: pgmap v4292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:32 smithi082 ceph-mon[94281]: pgmap v4293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:34 smithi082 ceph-mon[94281]: pgmap v4294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:39.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:36 smithi082 ceph-mon[94281]: pgmap v4295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:39.922 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:37 smithi082 ceph-mon[94281]: pgmap v4296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:18:39.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:40 smithi082 ceph-mon[94281]: pgmap v4297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:18:39.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:42 smithi082 ceph-mon[94281]: pgmap v4298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:18:39.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:44 smithi082 ceph-mon[94281]: pgmap v4299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:18:39.923 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:46 smithi082 ceph-mon[94281]: pgmap v4300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:18:41.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:41.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:41.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:47 smithi082 ceph-mon[94281]: pgmap v4301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:47 smithi082 ceph-mon[94281]: pgmap v4302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:49 smithi082 ceph-mon[94281]: pgmap v4303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:51 smithi082 ceph-mon[94281]: pgmap v4304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:52 smithi082 ceph-mon[94281]: pgmap v4305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:18:41.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:55 smithi082 ceph-mon[94281]: pgmap v4306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:18:42.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:57 smithi082 ceph-mon[94281]: pgmap v4307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:18:42.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:56:59 smithi082 ceph-mon[94281]: pgmap v4308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:42.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:01 smithi082 ceph-mon[94281]: pgmap v4309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:43.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:02 smithi082 ceph-mon[94281]: pgmap v4310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:18:43.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:05 smithi082 ceph-mon[94281]: pgmap v4311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:18:43.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:07 smithi082 ceph-mon[94281]: pgmap v4312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:18:43.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:09 smithi082 ceph-mon[94281]: pgmap v4313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:18:45.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:09 smithi082 ceph-mon[94281]: osdmap e342: 12 total, 12 up, 12 in 2023-03-17T12:18:45.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:11 smithi082 ceph-mon[94281]: pgmap v4315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 59 KiB/s wr, 29 op/s 2023-03-17T12:18:45.681 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:12 smithi082 ceph-mon[94281]: pgmap v4316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:15 smithi082 ceph-mon[94281]: pgmap v4317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:17 smithi082 ceph-mon[94281]: pgmap v4318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:17 smithi082 ceph-mon[94281]: osdmap e343: 12 total, 12 up, 12 in 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:19 smithi082 ceph-mon[94281]: pgmap v4320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:21 smithi082 ceph-mon[94281]: pgmap v4321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:22 smithi082 ceph-mon[94281]: pgmap v4322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:25 smithi082 ceph-mon[94281]: pgmap v4323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:27 smithi082 ceph-mon[94281]: pgmap v4324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:29 smithi082 ceph-mon[94281]: pgmap v4325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:31 smithi082 ceph-mon[94281]: pgmap v4326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:32 smithi082 ceph-mon[94281]: pgmap v4327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:35 smithi082 ceph-mon[94281]: pgmap v4328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:37 smithi082 ceph-mon[94281]: pgmap v4329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:45.682 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:39 smithi082 ceph-mon[94281]: pgmap v4330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:41 smithi082 ceph-mon[94281]: pgmap v4331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:43 smithi082 ceph-mon[94281]: pgmap v4332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:45 smithi082 ceph-mon[94281]: pgmap v4333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:47 smithi082 ceph-mon[94281]: pgmap v4334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:48 smithi082 ceph-mon[94281]: pgmap v4335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 15 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:48 smithi082 ceph-mon[94281]: pgmap v4336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:46.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:50 smithi082 ceph-mon[94281]: pgmap v4337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:52 smithi082 ceph-mon[94281]: pgmap v4338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-03-17T12:18:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:54 smithi082 ceph-mon[94281]: pgmap v4339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:56 smithi082 ceph-mon[94281]: pgmap v4340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:18:46.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:57:58 smithi082 ceph-mon[94281]: pgmap v4341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:18:46.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:00 smithi082 ceph-mon[94281]: pgmap v4342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:47.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:02 smithi082 ceph-mon[94281]: pgmap v4343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:47.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:04 smithi082 ceph-mon[94281]: pgmap v4344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:47.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:06 smithi082 ceph-mon[94281]: pgmap v4345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:47.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:08 smithi082 ceph-mon[94281]: pgmap v4346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:49.002 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:10 smithi082 ceph-mon[94281]: osdmap e344: 12 total, 12 up, 12 in 2023-03-17T12:18:49.002 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:10 smithi082 ceph-mon[94281]: pgmap v4348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:49.002 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:12 smithi082 ceph-mon[94281]: pgmap v4349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:14 smithi082 ceph-mon[94281]: pgmap v4350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:16 smithi082 ceph-mon[94281]: pgmap v4351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:18 smithi082 ceph-mon[94281]: osdmap e345: 12 total, 12 up, 12 in 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:18 smithi082 ceph-mon[94281]: pgmap v4353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 13 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:20 smithi082 ceph-mon[94281]: pgmap v4354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:22 smithi082 ceph-mon[94281]: pgmap v4355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:24 smithi082 ceph-mon[94281]: pgmap v4356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:26 smithi082 ceph-mon[94281]: pgmap v4357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:28 smithi082 ceph-mon[94281]: pgmap v4358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:30 smithi082 ceph-mon[94281]: pgmap v4359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:32 smithi082 ceph-mon[94281]: pgmap v4360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:34 smithi082 ceph-mon[94281]: pgmap v4361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:36 smithi082 ceph-mon[94281]: pgmap v4362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:18:50.458 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:38 smithi082 ceph-mon[94281]: pgmap v4363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:40 smithi082 ceph-mon[94281]: pgmap v4364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:42 smithi082 ceph-mon[94281]: pgmap v4365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:44 smithi082 ceph-mon[94281]: pgmap v4366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:46 smithi082 ceph-mon[94281]: pgmap v4367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:48 smithi082 ceph-mon[94281]: pgmap v4368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:49 smithi082 ceph-mon[94281]: pgmap v4369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:51 smithi082 ceph-mon[94281]: pgmap v4370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:53 smithi082 ceph-mon[94281]: pgmap v4371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 14 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:55 smithi082 ceph-mon[94281]: pgmap v4372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:57 smithi082 ceph-mon[94281]: pgmap v4373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:58:59 smithi082 ceph-mon[94281]: pgmap v4374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T12:18:50.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:01 smithi082 ceph-mon[94281]: pgmap v4375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:03 smithi082 ceph-mon[94281]: pgmap v4376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:05 smithi082 ceph-mon[94281]: pgmap v4377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:07 smithi082 ceph-mon[94281]: pgmap v4378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:09 smithi082 ceph-mon[94281]: pgmap v4379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:09 smithi082 ceph-mon[94281]: osdmap e346: 12 total, 12 up, 12 in 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:11 smithi082 ceph-mon[94281]: pgmap v4381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:13 smithi082 ceph-mon[94281]: pgmap v4382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:15 smithi082 ceph-mon[94281]: pgmap v4383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:17 smithi082 ceph-mon[94281]: pgmap v4384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:17 smithi082 ceph-mon[94281]: osdmap e347: 12 total, 12 up, 12 in 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:19 smithi082 ceph-mon[94281]: pgmap v4386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 11 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:21 smithi082 ceph-mon[94281]: pgmap v4387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:23 smithi082 ceph-mon[94281]: pgmap v4388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T12:18:50.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:25 smithi082 ceph-mon[94281]: pgmap v4389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:27 smithi082 ceph-mon[94281]: pgmap v4390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:29 smithi082 ceph-mon[94281]: pgmap v4391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:31 smithi082 ceph-mon[94281]: pgmap v4392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:33 smithi082 ceph-mon[94281]: pgmap v4393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:35 smithi082 ceph-mon[94281]: pgmap v4394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:37 smithi082 ceph-mon[94281]: pgmap v4395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:39 smithi082 ceph-mon[94281]: pgmap v4396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:41 smithi082 ceph-mon[94281]: pgmap v4397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:43 smithi082 ceph-mon[94281]: pgmap v4398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:45 smithi082 ceph-mon[94281]: pgmap v4399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:47 smithi082 ceph-mon[94281]: pgmap v4400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:49 smithi082 ceph-mon[94281]: pgmap v4401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:51 smithi082 ceph-mon[94281]: pgmap v4402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:18:50.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:50.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:52.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:52.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:18:54.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: pgmap v4403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: pgmap v4404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: pgmap v4405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:55 smithi082 ceph-mon[94281]: pgmap v4406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:18:54.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:57 smithi082 ceph-mon[94281]: pgmap v4407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-03-17T12:18:54.854 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 10:59:59 smithi082 ceph-mon[94281]: pgmap v4408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:01 smithi082 ceph-mon[94281]: pgmap v4409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:03 smithi082 ceph-mon[94281]: pgmap v4410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:05 smithi082 ceph-mon[94281]: pgmap v4411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:07 smithi082 ceph-mon[94281]: pgmap v4412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:09 smithi082 ceph-mon[94281]: pgmap v4413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:18:57.459 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:09 smithi082 ceph-mon[94281]: osdmap e348: 12 total, 12 up, 12 in 2023-03-17T12:18:57.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:11 smithi082 ceph-mon[94281]: pgmap v4415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:18:59.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:13 smithi082 ceph-mon[94281]: pgmap v4416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:15 smithi082 ceph-mon[94281]: pgmap v4417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:17 smithi082 ceph-mon[94281]: pgmap v4418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:17 smithi082 ceph-mon[94281]: osdmap e349: 12 total, 12 up, 12 in 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:19 smithi082 ceph-mon[94281]: pgmap v4420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:21 smithi082 ceph-mon[94281]: pgmap v4421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:23 smithi082 ceph-mon[94281]: pgmap v4422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:19:00.792 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:25 smithi082 ceph-mon[94281]: pgmap v4423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:19:02.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:27 smithi082 ceph-mon[94281]: pgmap v4424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:19:02.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:29 smithi082 ceph-mon[94281]: pgmap v4425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 89 B/s wr, 11 op/s 2023-03-17T12:19:02.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:31 smithi082 ceph-mon[94281]: pgmap v4426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:02.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:33 smithi082 ceph-mon[94281]: pgmap v4427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:19:02.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:35 smithi082 ceph-mon[94281]: pgmap v4428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:02.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:37 smithi082 ceph-mon[94281]: pgmap v4429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:39 smithi082 ceph-mon[94281]: pgmap v4430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:41 smithi082 ceph-mon[94281]: pgmap v4431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:43 smithi082 ceph-mon[94281]: pgmap v4432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:45 smithi082 ceph-mon[94281]: pgmap v4433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:47 smithi082 ceph-mon[94281]: pgmap v4434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:49 smithi082 ceph-mon[94281]: pgmap v4435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:51 smithi082 ceph-mon[94281]: pgmap v4436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:53 smithi082 ceph-mon[94281]: pgmap v4437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:03.477 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:03.478 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:54 smithi082 ceph-mon[94281]: pgmap v4438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:19:05.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:54 smithi082 ceph-mon[94281]: pgmap v4439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:19:05.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:05.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:56 smithi082 ceph-mon[94281]: pgmap v4440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:19:05.405 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:00:58 smithi082 ceph-mon[94281]: pgmap v4441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:19:05.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:00 smithi082 ceph-mon[94281]: pgmap v4442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:19:05.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:02 smithi082 ceph-mon[94281]: pgmap v4443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:19:05.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:04 smithi082 ceph-mon[94281]: pgmap v4444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:19:05.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:06 smithi082 ceph-mon[94281]: pgmap v4445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:19:05.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:08 smithi082 ceph-mon[94281]: pgmap v4446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:10 smithi082 ceph-mon[94281]: osdmap e350: 12 total, 12 up, 12 in 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:10 smithi082 ceph-mon[94281]: pgmap v4448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:12 smithi082 ceph-mon[94281]: pgmap v4449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:14 smithi082 ceph-mon[94281]: pgmap v4450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:16 smithi082 ceph-mon[94281]: pgmap v4451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:18 smithi082 ceph-mon[94281]: osdmap e351: 12 total, 12 up, 12 in 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:18 smithi082 ceph-mon[94281]: pgmap v4453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 13 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:20 smithi082 ceph-mon[94281]: pgmap v4454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:05.978 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:22 smithi082 ceph-mon[94281]: pgmap v4455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:24 smithi082 ceph-mon[94281]: pgmap v4456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:25 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:26 smithi082 ceph-mon[94281]: pgmap v4457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:26 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:28 smithi082 ceph-mon[94281]: pgmap v4458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 293 KiB/s wr, 26 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:28 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:30 smithi082 ceph-mon[94281]: pgmap v4459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 22 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:32 smithi082 ceph-mon[94281]: pgmap v4460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 22 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:34 smithi082 ceph-mon[94281]: pgmap v4461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 259 KiB/s wr, 29 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:36 smithi082 ceph-mon[94281]: pgmap v4462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 259 KiB/s wr, 25 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:38 smithi082 ceph-mon[94281]: pgmap v4463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 266 KiB/s wr, 30 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:40 smithi082 ceph-mon[94281]: pgmap v4464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:42 smithi082 ceph-mon[94281]: pgmap v4465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:44 smithi082 ceph-mon[94281]: pgmap v4466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 16 op/s 2023-03-17T12:19:05.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:46 smithi082 ceph-mon[94281]: pgmap v4467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 KiB/s wr, 9 op/s 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:48 smithi082 ceph-mon[94281]: pgmap v4468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 KiB/s wr, 13 op/s 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:50 smithi082 ceph-mon[94281]: pgmap v4469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:52 smithi082 ceph-mon[94281]: pgmap v4470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:54 smithi082 ceph-mon[94281]: pgmap v4471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.2 KiB/s wr, 25 op/s 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:05.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:55 smithi082 ceph-mon[94281]: pgmap v4472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9.8 KiB/s wr, 22 op/s 2023-03-17T12:19:06.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:55 smithi082 ceph-mon[94281]: pgmap v4473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T12:19:06.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:06.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:56 smithi082 ceph-mon[94281]: pgmap v4474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 KiB/s wr, 21 op/s 2023-03-17T12:19:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:01:58 smithi082 ceph-mon[94281]: pgmap v4475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T12:19:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:00 smithi082 ceph-mon[94281]: pgmap v4476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T12:19:07.339 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:03 smithi082 ceph-mon[94281]: pgmap v4477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:04 smithi082 ceph-mon[94281]: pgmap v4478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:06 smithi082 ceph-mon[94281]: pgmap v4479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:09 smithi082 ceph-mon[94281]: osdmap e352: 12 total, 12 up, 12 in 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:09 smithi082 ceph-mon[94281]: pgmap v4481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:10 smithi082 ceph-mon[94281]: pgmap v4482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:13 smithi082 ceph-mon[94281]: pgmap v4483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T12:19:08.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:14 smithi082 ceph-mon[94281]: pgmap v4484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T12:19:08.292 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:16 smithi082 ceph-mon[94281]: pgmap v4485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:18 smithi082 ceph-mon[94281]: osdmap e353: 12 total, 12 up, 12 in 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:19 smithi082 ceph-mon[94281]: pgmap v4487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:20 smithi082 ceph-mon[94281]: pgmap v4488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:23 smithi082 ceph-mon[94281]: pgmap v4489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:24 smithi082 ceph-mon[94281]: pgmap v4490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:26 smithi082 ceph-mon[94281]: pgmap v4491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:28 smithi082 ceph-mon[94281]: pgmap v4492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 265 B/s wr, 9 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:30 smithi082 ceph-mon[94281]: pgmap v4493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:33 smithi082 ceph-mon[94281]: pgmap v4494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:19:09.495 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:34 smithi082 ceph-mon[94281]: pgmap v4495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:36 smithi082 ceph-mon[94281]: pgmap v4496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:38 smithi082 ceph-mon[94281]: pgmap v4497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:40 smithi082 ceph-mon[94281]: pgmap v4498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:43 smithi082 ceph-mon[94281]: pgmap v4499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:44 smithi082 ceph-mon[94281]: pgmap v4500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:46 smithi082 ceph-mon[94281]: pgmap v4501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:48 smithi082 ceph-mon[94281]: pgmap v4502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:50 smithi082 ceph-mon[94281]: pgmap v4503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:53 smithi082 ceph-mon[94281]: pgmap v4504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:54 smithi082 ceph-mon[94281]: pgmap v4505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:55 smithi082 ceph-mon[94281]: pgmap v4506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:19:09.496 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:55 smithi082 ceph-mon[94281]: pgmap v4507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:02:58 smithi082 ceph-mon[94281]: pgmap v4508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:00 smithi082 ceph-mon[94281]: pgmap v4509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:02 smithi082 ceph-mon[94281]: pgmap v4510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:04 smithi082 ceph-mon[94281]: pgmap v4511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:06 smithi082 ceph-mon[94281]: pgmap v4512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:08 smithi082 ceph-mon[94281]: pgmap v4513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:10 smithi082 ceph-mon[94281]: osdmap e354: 12 total, 12 up, 12 in 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:10 smithi082 ceph-mon[94281]: pgmap v4515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:12 smithi082 ceph-mon[94281]: pgmap v4516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:14 smithi082 ceph-mon[94281]: pgmap v4517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:16 smithi082 ceph-mon[94281]: pgmap v4518: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:09.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:18 smithi082 ceph-mon[94281]: osdmap e355: 12 total, 12 up, 12 in 2023-03-17T12:19:11.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:18 smithi082 ceph-mon[94281]: pgmap v4520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-17T12:19:11.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:20 smithi082 ceph-mon[94281]: pgmap v4521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:11.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:22 smithi082 ceph-mon[94281]: pgmap v4522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:11.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:24 smithi082 ceph-mon[94281]: pgmap v4523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:11.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:26 smithi082 ceph-mon[94281]: pgmap v4524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:28 smithi082 ceph-mon[94281]: pgmap v4525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:30 smithi082 ceph-mon[94281]: pgmap v4526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:32 smithi082 ceph-mon[94281]: pgmap v4527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:34 smithi082 ceph-mon[94281]: pgmap v4528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:36 smithi082 ceph-mon[94281]: pgmap v4529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:38 smithi082 ceph-mon[94281]: pgmap v4530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:40 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:40 smithi082 ceph-mon[94281]: pgmap v4531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.962 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:41 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:42 smithi082 ceph-mon[94281]: pgmap v4532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:43 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:44 smithi082 ceph-mon[94281]: pgmap v4533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:46 smithi082 ceph-mon[94281]: pgmap v4534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:48 smithi082 ceph-mon[94281]: pgmap v4535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:50 smithi082 ceph-mon[94281]: pgmap v4536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:52 smithi082 ceph-mon[94281]: pgmap v4537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:54 smithi082 ceph-mon[94281]: pgmap v4538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:56 smithi082 ceph-mon[94281]: pgmap v4539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:57 smithi082 ceph-mon[94281]: pgmap v4540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:19:11.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:57 smithi082 ceph-mon[94281]: pgmap v4541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:19:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:03:59 smithi082 ceph-mon[94281]: pgmap v4542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:19:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:01 smithi082 ceph-mon[94281]: pgmap v4543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:19:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:03 smithi082 ceph-mon[94281]: pgmap v4544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:19:11.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:05 smithi082 ceph-mon[94281]: pgmap v4545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:19:13.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:07 smithi082 ceph-mon[94281]: pgmap v4546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:13.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:09 smithi082 ceph-mon[94281]: pgmap v4547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:19:13.098 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:10 smithi082 ceph-mon[94281]: osdmap e356: 12 total, 12 up, 12 in 2023-03-17T12:19:13.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:11 smithi082 ceph-mon[94281]: pgmap v4549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:13 smithi082 ceph-mon[94281]: pgmap v4550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:15 smithi082 ceph-mon[94281]: pgmap v4551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:17 smithi082 ceph-mon[94281]: pgmap v4552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:17 smithi082 ceph-mon[94281]: osdmap e357: 12 total, 12 up, 12 in 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:19 smithi082 ceph-mon[94281]: pgmap v4554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:21 smithi082 ceph-mon[94281]: pgmap v4555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:23 smithi082 ceph-mon[94281]: pgmap v4556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:25 smithi082 ceph-mon[94281]: pgmap v4557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:27 smithi082 ceph-mon[94281]: pgmap v4558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:29 smithi082 ceph-mon[94281]: pgmap v4559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:31 smithi082 ceph-mon[94281]: pgmap v4560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:33 smithi082 ceph-mon[94281]: pgmap v4561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:14.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:35 smithi082 ceph-mon[94281]: pgmap v4562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:37 smithi082 ceph-mon[94281]: pgmap v4563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:39 smithi082 ceph-mon[94281]: pgmap v4564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:41 smithi082 ceph-mon[94281]: pgmap v4565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:43 smithi082 ceph-mon[94281]: pgmap v4566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:45 smithi082 ceph-mon[94281]: pgmap v4567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:47 smithi082 ceph-mon[94281]: pgmap v4568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:49 smithi082 ceph-mon[94281]: pgmap v4569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:14.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:51 smithi082 ceph-mon[94281]: pgmap v4570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:53 smithi082 ceph-mon[94281]: pgmap v4571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:55 smithi082 ceph-mon[94281]: pgmap v4572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:57 smithi082 ceph-mon[94281]: pgmap v4573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:58 smithi082 ceph-mon[94281]: pgmap v4574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 283 B/s wr, 14 op/s 2023-03-17T12:19:15.037 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:04:58 smithi082 ceph-mon[94281]: pgmap v4575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:19:15.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:00 smithi082 ceph-mon[94281]: pgmap v4576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:19:15.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:02 smithi082 ceph-mon[94281]: pgmap v4577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:19:15.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:04 smithi082 ceph-mon[94281]: pgmap v4578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 KiB/s wr, 28 op/s 2023-03-17T12:19:15.360 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:06 smithi082 ceph-mon[94281]: pgmap v4579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 KiB/s wr, 28 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:08 smithi082 ceph-mon[94281]: pgmap v4580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 25 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:10 smithi082 ceph-mon[94281]: pgmap v4581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:12 smithi082 ceph-mon[94281]: pgmap v4582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:14 smithi082 ceph-mon[94281]: pgmap v4583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:16 smithi082 ceph-mon[94281]: pgmap v4584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:18 smithi082 ceph-mon[94281]: pgmap v4585: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:20 smithi082 ceph-mon[94281]: pgmap v4586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:22 smithi082 ceph-mon[94281]: pgmap v4587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:24 smithi082 ceph-mon[94281]: pgmap v4588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:26 smithi082 ceph-mon[94281]: pgmap v4589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:28 smithi082 ceph-mon[94281]: pgmap v4590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:30 smithi082 ceph-mon[94281]: pgmap v4591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:32 smithi082 ceph-mon[94281]: pgmap v4592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.361 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:34 smithi082 ceph-mon[94281]: pgmap v4593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:36 smithi082 ceph-mon[94281]: pgmap v4594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:38 smithi082 ceph-mon[94281]: pgmap v4595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:40 smithi082 ceph-mon[94281]: pgmap v4596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:42 smithi082 ceph-mon[94281]: pgmap v4597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:44 smithi082 ceph-mon[94281]: pgmap v4598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:46 smithi082 ceph-mon[94281]: pgmap v4599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:48 smithi082 ceph-mon[94281]: pgmap v4600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:50 smithi082 ceph-mon[94281]: pgmap v4601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:52 smithi082 ceph-mon[94281]: pgmap v4602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:19:15.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:54 smithi082 ceph-mon[94281]: pgmap v4603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:17.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:56 smithi082 ceph-mon[94281]: pgmap v4604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:19:17.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:58 smithi082 ceph-mon[94281]: pgmap v4605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:17.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:17.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:17.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:17.277 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:05:59 smithi082 ceph-mon[94281]: pgmap v4606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:01 smithi082 ceph-mon[94281]: pgmap v4607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:03 smithi082 ceph-mon[94281]: pgmap v4608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 27 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:05 smithi082 ceph-mon[94281]: pgmap v4609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:07 smithi082 ceph-mon[94281]: pgmap v4610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:09 smithi082 ceph-mon[94281]: pgmap v4611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:10 smithi082 ceph-mon[94281]: osdmap e358: 12 total, 12 up, 12 in 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:11 smithi082 ceph-mon[94281]: pgmap v4613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:19.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:13 smithi082 ceph-mon[94281]: pgmap v4614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:15 smithi082 ceph-mon[94281]: pgmap v4615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:17 smithi082 ceph-mon[94281]: pgmap v4616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:17 smithi082 ceph-mon[94281]: osdmap e359: 12 total, 12 up, 12 in 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:19 smithi082 ceph-mon[94281]: pgmap v4618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:21 smithi082 ceph-mon[94281]: pgmap v4619: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:23 smithi082 ceph-mon[94281]: pgmap v4620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:25 smithi082 ceph-mon[94281]: pgmap v4621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:27 smithi082 ceph-mon[94281]: pgmap v4622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:29 smithi082 ceph-mon[94281]: pgmap v4623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 850 B/s wr, 10 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:31 smithi082 ceph-mon[94281]: pgmap v4624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:33 smithi082 ceph-mon[94281]: pgmap v4625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:35 smithi082 ceph-mon[94281]: pgmap v4626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:37 smithi082 ceph-mon[94281]: pgmap v4627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:39 smithi082 ceph-mon[94281]: pgmap v4628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:41 smithi082 ceph-mon[94281]: pgmap v4629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:43 smithi082 ceph-mon[94281]: pgmap v4630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:19.718 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:45 smithi082 ceph-mon[94281]: pgmap v4631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:47 smithi082 ceph-mon[94281]: pgmap v4632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:49 smithi082 ceph-mon[94281]: pgmap v4633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:51 smithi082 ceph-mon[94281]: pgmap v4634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:53 smithi082 ceph-mon[94281]: pgmap v4635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:55 smithi082 ceph-mon[94281]: pgmap v4636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:57 smithi082 ceph-mon[94281]: pgmap v4637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:59 smithi082 ceph-mon[94281]: pgmap v4638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:06:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:00 smithi082 ceph-mon[94281]: pgmap v4639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:00 smithi082 ceph-mon[94281]: pgmap v4640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:19:19.719 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:02 smithi082 ceph-mon[94281]: pgmap v4641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:19:19.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:04 smithi082 ceph-mon[94281]: pgmap v4642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:19:19.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:06 smithi082 ceph-mon[94281]: pgmap v4643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:19:19.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:08 smithi082 ceph-mon[94281]: pgmap v4644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 26 op/s 2023-03-17T12:19:19.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:10 smithi082 ceph-mon[94281]: pgmap v4645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:19:19.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:10 smithi082 ceph-mon[94281]: osdmap e360: 12 total, 12 up, 12 in 2023-03-17T12:19:19.720 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:12 smithi082 ceph-mon[94281]: pgmap v4647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:14 smithi082 ceph-mon[94281]: pgmap v4648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:16 smithi082 ceph-mon[94281]: pgmap v4649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:18 smithi082 ceph-mon[94281]: pgmap v4650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:18 smithi082 ceph-mon[94281]: osdmap e361: 12 total, 12 up, 12 in 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:20 smithi082 ceph-mon[94281]: pgmap v4652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 967 B/s wr, 11 op/s 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:22 smithi082 ceph-mon[94281]: pgmap v4653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:19:21.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:24 smithi082 ceph-mon[94281]: pgmap v4654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:26 smithi082 ceph-mon[94281]: pgmap v4655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:28 smithi082 ceph-mon[94281]: pgmap v4656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:30 smithi082 ceph-mon[94281]: pgmap v4657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:32 smithi082 ceph-mon[94281]: pgmap v4658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:34 smithi082 ceph-mon[94281]: pgmap v4659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:36 smithi082 ceph-mon[94281]: pgmap v4660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:38 smithi082 ceph-mon[94281]: pgmap v4661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:40 smithi082 ceph-mon[94281]: pgmap v4662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:42 smithi082 ceph-mon[94281]: pgmap v4663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:44 smithi082 ceph-mon[94281]: pgmap v4664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:22.840 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:46 smithi082 ceph-mon[94281]: pgmap v4665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:22.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:48 smithi082 ceph-mon[94281]: pgmap v4666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:22.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:50 smithi082 ceph-mon[94281]: pgmap v4667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:22.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:52 smithi082 ceph-mon[94281]: pgmap v4668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:22.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:54 smithi082 ceph-mon[94281]: pgmap v4669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:24.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:56 smithi082 ceph-mon[94281]: pgmap v4670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:58 smithi082 ceph-mon[94281]: pgmap v4671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:07:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:00 smithi082 ceph-mon[94281]: pgmap v4672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:00 smithi082 ceph-mon[94281]: pgmap v4673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:00 smithi082 ceph-mon[94281]: pgmap v4674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:02 smithi082 ceph-mon[94281]: pgmap v4675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:19:25.110 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:04 smithi082 ceph-mon[94281]: pgmap v4676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:19:25.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:06 smithi082 ceph-mon[94281]: pgmap v4677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:19:26.655 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:08 smithi082 ceph-mon[94281]: pgmap v4678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:19:26.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:10 smithi082 ceph-mon[94281]: osdmap e362: 12 total, 12 up, 12 in 2023-03-17T12:19:26.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:10 smithi082 ceph-mon[94281]: pgmap v4680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:26.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:12 smithi082 ceph-mon[94281]: pgmap v4681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:26.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:14 smithi082 ceph-mon[94281]: pgmap v4682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:26.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:16 smithi082 ceph-mon[94281]: pgmap v4683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:26.656 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:18 smithi082 ceph-mon[94281]: osdmap e363: 12 total, 12 up, 12 in 2023-03-17T12:19:26.657 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:18 smithi082 ceph-mon[94281]: pgmap v4685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-17T12:19:26.657 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:20 smithi082 ceph-mon[94281]: pgmap v4686: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:22 smithi082 ceph-mon[94281]: pgmap v4687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:24 smithi082 ceph-mon[94281]: pgmap v4688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:26 smithi082 ceph-mon[94281]: pgmap v4689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:28 smithi082 ceph-mon[94281]: pgmap v4690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:30 smithi082 ceph-mon[94281]: pgmap v4691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:32 smithi082 ceph-mon[94281]: pgmap v4692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:34 smithi082 ceph-mon[94281]: pgmap v4693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:36 smithi082 ceph-mon[94281]: pgmap v4694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:27.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:38 smithi082 ceph-mon[94281]: pgmap v4695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:27.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:40 smithi082 ceph-mon[94281]: pgmap v4696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:27.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:42 smithi082 ceph-mon[94281]: pgmap v4697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:27.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:44 smithi082 ceph-mon[94281]: pgmap v4698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:19:28.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:46 smithi082 ceph-mon[94281]: pgmap v4699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:19:28.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:48 smithi082 ceph-mon[94281]: pgmap v4700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:19:28.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:50 smithi082 ceph-mon[94281]: pgmap v4701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:19:28.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:52 smithi082 ceph-mon[94281]: pgmap v4702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:19:28.603 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:54 smithi082 ceph-mon[94281]: pgmap v4703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:56 smithi082 ceph-mon[94281]: pgmap v4704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:08:58 smithi082 ceph-mon[94281]: pgmap v4705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:00 smithi082 ceph-mon[94281]: pgmap v4706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:29.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:02 smithi082 ceph-mon[94281]: pgmap v4707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 272 B/s wr, 9 op/s 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:02 smithi082 ceph-mon[94281]: pgmap v4708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:04 smithi082 ceph-mon[94281]: pgmap v4709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:04 smithi082 ceph-mon[94281]: osdmap e364: 12 total, 12 up, 12 in 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:06 smithi082 ceph-mon[94281]: pgmap v4711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 73 KiB/s wr, 30 op/s 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:08 smithi082 ceph-mon[94281]: pgmap v4712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 74 KiB/s wr, 38 op/s 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:10 smithi082 ceph-mon[94281]: pgmap v4713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 68 KiB/s wr, 35 op/s 2023-03-17T12:19:29.675 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:12 smithi082 ceph-mon[94281]: pgmap v4714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:12 smithi082 ceph-mon[94281]: osdmap e365: 12 total, 12 up, 12 in 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:14 smithi082 ceph-mon[94281]: pgmap v4716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:16 smithi082 ceph-mon[94281]: pgmap v4717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:18 smithi082 ceph-mon[94281]: pgmap v4718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:20 smithi082 ceph-mon[94281]: pgmap v4719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:22 smithi082 ceph-mon[94281]: pgmap v4720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:24 smithi082 ceph-mon[94281]: pgmap v4721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 381 B/s wr, 9 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:26 smithi082 ceph-mon[94281]: pgmap v4722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:28 smithi082 ceph-mon[94281]: pgmap v4723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:30 smithi082 ceph-mon[94281]: pgmap v4724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:32 smithi082 ceph-mon[94281]: pgmap v4725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:30.236 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:34 smithi082 ceph-mon[94281]: pgmap v4726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:36 smithi082 ceph-mon[94281]: pgmap v4727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:38 smithi082 ceph-mon[94281]: pgmap v4728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:40 smithi082 ceph-mon[94281]: pgmap v4729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:42 smithi082 ceph-mon[94281]: pgmap v4730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:44 smithi082 ceph-mon[94281]: pgmap v4731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:46 smithi082 ceph-mon[94281]: pgmap v4732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:48 smithi082 ceph-mon[94281]: pgmap v4733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:50 smithi082 ceph-mon[94281]: pgmap v4734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:52 smithi082 ceph-mon[94281]: pgmap v4735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:54 smithi082 ceph-mon[94281]: pgmap v4736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:56 smithi082 ceph-mon[94281]: pgmap v4737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:09:58 smithi082 ceph-mon[94281]: pgmap v4738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:00 smithi082 ceph-mon[94281]: pgmap v4739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:02 smithi082 ceph-mon[94281]: pgmap v4740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: pgmap v4741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:31.242 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.278 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.279 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:06 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:19:33.280 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:06 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:06 smithi082 ceph-mon[94281]: pgmap v4742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:06 smithi082 ceph-mon[94281]: pgmap v4743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:08 smithi082 ceph-mon[94281]: pgmap v4744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 22 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:09 smithi082 ceph-mon[94281]: osdmap e366: 12 total, 12 up, 12 in 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:10 smithi082 ceph-mon[94281]: pgmap v4746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 68 KiB/s wr, 35 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:12 smithi082 ceph-mon[94281]: pgmap v4747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 129 B/s wr, 6 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:14 smithi082 ceph-mon[94281]: pgmap v4748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:16 smithi082 ceph-mon[94281]: pgmap v4749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:18 smithi082 ceph-mon[94281]: pgmap v4750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:18 smithi082 ceph-mon[94281]: osdmap e367: 12 total, 12 up, 12 in 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:20 smithi082 ceph-mon[94281]: pgmap v4752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:22 smithi082 ceph-mon[94281]: pgmap v4753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:35.584 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:24 smithi082 ceph-mon[94281]: pgmap v4754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:26 smithi082 ceph-mon[94281]: pgmap v4755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:28 smithi082 ceph-mon[94281]: pgmap v4756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:30 smithi082 ceph-mon[94281]: pgmap v4757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:32 smithi082 ceph-mon[94281]: pgmap v4758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:34 smithi082 ceph-mon[94281]: pgmap v4759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:36 smithi082 ceph-mon[94281]: pgmap v4760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:38 smithi082 ceph-mon[94281]: pgmap v4761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:40 smithi082 ceph-mon[94281]: pgmap v4762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:42 smithi082 ceph-mon[94281]: pgmap v4763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:44 smithi082 ceph-mon[94281]: pgmap v4764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:35.585 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:46 smithi082 ceph-mon[94281]: pgmap v4765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:48 smithi082 ceph-mon[94281]: pgmap v4766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:50 smithi082 ceph-mon[94281]: pgmap v4767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:52 smithi082 ceph-mon[94281]: pgmap v4768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:54 smithi082 ceph-mon[94281]: pgmap v4769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:56 smithi082 ceph-mon[94281]: pgmap v4770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:10:58 smithi082 ceph-mon[94281]: pgmap v4771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:00 smithi082 ceph-mon[94281]: pgmap v4772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:02 smithi082 ceph-mon[94281]: pgmap v4773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:04 smithi082 ceph-mon[94281]: pgmap v4774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:06 smithi082 ceph-mon[94281]: pgmap v4775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:19:37.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:08 smithi082 ceph-mon[94281]: pgmap v4776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: pgmap v4777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: pgmap v4778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:09 smithi082 ceph-mon[94281]: osdmap e368: 12 total, 12 up, 12 in 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:11 smithi082 ceph-mon[94281]: pgmap v4780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 128 B/s wr, 6 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:14 smithi082 ceph-mon[94281]: pgmap v4781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 256 B/s wr, 13 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:16 smithi082 ceph-mon[94281]: pgmap v4782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 256 B/s wr, 13 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:18 smithi082 ceph-mon[94281]: pgmap v4783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:18 smithi082 ceph-mon[94281]: osdmap e369: 12 total, 12 up, 12 in 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:20 smithi082 ceph-mon[94281]: pgmap v4785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 962 B/s wr, 11 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:22 smithi082 ceph-mon[94281]: pgmap v4786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:19:37.337 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:24 smithi082 ceph-mon[94281]: pgmap v4787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:19:37.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:26 smithi082 ceph-mon[94281]: pgmap v4788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:19:37.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:28 smithi082 ceph-mon[94281]: pgmap v4789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:19:37.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:30 smithi082 ceph-mon[94281]: pgmap v4790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 263 B/s wr, 8 op/s 2023-03-17T12:19:37.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:32 smithi082 ceph-mon[94281]: pgmap v4791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:37.338 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:34 smithi082 ceph-mon[94281]: pgmap v4792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:39.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:36 smithi082 ceph-mon[94281]: pgmap v4793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:39.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:38 smithi082 ceph-mon[94281]: pgmap v4794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:39.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:40 smithi082 ceph-mon[94281]: pgmap v4795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:39.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:42 smithi082 ceph-mon[94281]: pgmap v4796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:39.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:44 smithi082 ceph-mon[94281]: pgmap v4797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:39.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:46 smithi082 ceph-mon[94281]: pgmap v4798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:48 smithi082 ceph-mon[94281]: pgmap v4799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:50 smithi082 ceph-mon[94281]: pgmap v4800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:52 smithi082 ceph-mon[94281]: pgmap v4801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:54 smithi082 ceph-mon[94281]: pgmap v4802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:56 smithi082 ceph-mon[94281]: pgmap v4803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:11:58 smithi082 ceph-mon[94281]: pgmap v4804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:00 smithi082 ceph-mon[94281]: pgmap v4805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:02 smithi082 ceph-mon[94281]: pgmap v4806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:04 smithi082 ceph-mon[94281]: pgmap v4807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:19:39.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:06 smithi082 ceph-mon[94281]: pgmap v4808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:19:41.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:08 smithi082 ceph-mon[94281]: pgmap v4809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:19:41.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:09 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:10 smithi082 ceph-mon[94281]: pgmap v4810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:10 smithi082 ceph-mon[94281]: osdmap e370: 12 total, 12 up, 12 in 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:12 smithi082 ceph-mon[94281]: pgmap v4812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:42.556 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:13 smithi082 ceph-mon[94281]: pgmap v4813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:15 smithi082 ceph-mon[94281]: pgmap v4814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:17 smithi082 ceph-mon[94281]: pgmap v4815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:17 smithi082 ceph-mon[94281]: osdmap e371: 12 total, 12 up, 12 in 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:19 smithi082 ceph-mon[94281]: pgmap v4817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 112 B/s wr, 11 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:21 smithi082 ceph-mon[94281]: pgmap v4818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 107 B/s wr, 10 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:23 smithi082 ceph-mon[94281]: pgmap v4819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:25 smithi082 ceph-mon[94281]: pgmap v4820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:27 smithi082 ceph-mon[94281]: pgmap v4821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:29 smithi082 ceph-mon[94281]: pgmap v4822: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:19:43.415 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:31 smithi082 ceph-mon[94281]: pgmap v4823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:33 smithi082 ceph-mon[94281]: pgmap v4824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:35 smithi082 ceph-mon[94281]: pgmap v4825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:37 smithi082 ceph-mon[94281]: pgmap v4826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:39 smithi082 ceph-mon[94281]: pgmap v4827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:41 smithi082 ceph-mon[94281]: pgmap v4828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:43 smithi082 ceph-mon[94281]: pgmap v4829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:45 smithi082 ceph-mon[94281]: pgmap v4830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:47 smithi082 ceph-mon[94281]: pgmap v4831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:43.416 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:49 smithi082 ceph-mon[94281]: pgmap v4832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:44.943 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:51 smithi082 ceph-mon[94281]: pgmap v4833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:46.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:53 smithi082 ceph-mon[94281]: pgmap v4834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:46.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:55 smithi082 ceph-mon[94281]: pgmap v4835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:46.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:57 smithi082 ceph-mon[94281]: pgmap v4836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:46.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:12:59 smithi082 ceph-mon[94281]: pgmap v4837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:48.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:01 smithi082 ceph-mon[94281]: pgmap v4838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:48.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:03 smithi082 ceph-mon[94281]: pgmap v4839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:19:48.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:05 smithi082 ceph-mon[94281]: pgmap v4840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:07 smithi082 ceph-mon[94281]: pgmap v4841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:09 smithi082 ceph-mon[94281]: pgmap v4842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:09 smithi082 ceph-mon[94281]: osdmap e372: 12 total, 12 up, 12 in 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:11 smithi082 ceph-mon[94281]: pgmap v4844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:13 smithi082 ceph-mon[94281]: pgmap v4845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:15 smithi082 ceph-mon[94281]: pgmap v4846: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:17 smithi082 ceph-mon[94281]: pgmap v4847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:18 smithi082 ceph-mon[94281]: osdmap e373: 12 total, 12 up, 12 in 2023-03-17T12:19:48.128 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:19 smithi082 ceph-mon[94281]: pgmap v4849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:21 smithi082 ceph-mon[94281]: pgmap v4850: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:23 smithi082 ceph-mon[94281]: pgmap v4851: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:25 smithi082 ceph-mon[94281]: pgmap v4852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:27 smithi082 ceph-mon[94281]: pgmap v4853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:29 smithi082 ceph-mon[94281]: pgmap v4854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 844 B/s wr, 9 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:31 smithi082 ceph-mon[94281]: pgmap v4855: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:33 smithi082 ceph-mon[94281]: pgmap v4856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:35 smithi082 ceph-mon[94281]: pgmap v4857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:37 smithi082 ceph-mon[94281]: pgmap v4858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:39 smithi082 ceph-mon[94281]: pgmap v4859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:41 smithi082 ceph-mon[94281]: pgmap v4860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:43 smithi082 ceph-mon[94281]: pgmap v4861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:45 smithi082 ceph-mon[94281]: pgmap v4862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:47 smithi082 ceph-mon[94281]: pgmap v4863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:49 smithi082 ceph-mon[94281]: pgmap v4864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:48.129 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:51 smithi082 ceph-mon[94281]: pgmap v4865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:53 smithi082 ceph-mon[94281]: pgmap v4866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:55 smithi082 ceph-mon[94281]: pgmap v4867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:57 smithi082 ceph-mon[94281]: pgmap v4868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:13:59 smithi082 ceph-mon[94281]: pgmap v4869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:01 smithi082 ceph-mon[94281]: pgmap v4870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:03 smithi082 ceph-mon[94281]: pgmap v4871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:05 smithi082 ceph-mon[94281]: pgmap v4872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:07 smithi082 ceph-mon[94281]: pgmap v4873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:19:48.130 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:09 smithi082 ceph-mon[94281]: pgmap v4874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:19:49.673 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:10 smithi082 ceph-mon[94281]: osdmap e374: 12 total, 12 up, 12 in 2023-03-17T12:19:49.673 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:11 smithi082 ceph-mon[94281]: pgmap v4876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:19:49.673 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:13 smithi082 ceph-mon[94281]: pgmap v4877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:15 smithi082 ceph-mon[94281]: pgmap v4878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:17 smithi082 ceph-mon[94281]: pgmap v4879: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:17 smithi082 ceph-mon[94281]: osdmap e375: 12 total, 12 up, 12 in 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:18 smithi082 ceph-mon[94281]: pgmap v4880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:19:51.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:18 smithi082 ceph-mon[94281]: pgmap v4881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T12:19:52.818 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:20 smithi082 ceph-mon[94281]: pgmap v4883: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-03-17T12:19:52.819 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:22 smithi082 ceph-mon[94281]: pgmap v4884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-03-17T12:19:53.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:24 smithi082 ceph-mon[94281]: pgmap v4885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:19:53.577 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:26 smithi082 ceph-mon[94281]: pgmap v4886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:19:55.497 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:28 smithi082 ceph-mon[94281]: pgmap v4887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:19:56.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:30 smithi082 ceph-mon[94281]: pgmap v4888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:19:56.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:32 smithi082 ceph-mon[94281]: pgmap v4889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:56.048 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:34 smithi082 ceph-mon[94281]: pgmap v4890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:57.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:36 smithi082 ceph-mon[94281]: pgmap v4891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:57.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:38 smithi082 ceph-mon[94281]: pgmap v4892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:57.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:40 smithi082 ceph-mon[94281]: pgmap v4893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:57.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:42 smithi082 ceph-mon[94281]: pgmap v4894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:57.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:44 smithi082 ceph-mon[94281]: pgmap v4895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:59.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:46 smithi082 ceph-mon[94281]: pgmap v4896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:59.274 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:48 smithi082 ceph-mon[94281]: pgmap v4897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:19:59.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:50 smithi082 ceph-mon[94281]: pgmap v4898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:19:59.275 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:52 smithi082 ceph-mon[94281]: pgmap v4899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:54 smithi082 ceph-mon[94281]: pgmap v4900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:56 smithi082 ceph-mon[94281]: pgmap v4901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:14:58 smithi082 ceph-mon[94281]: pgmap v4902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:00 smithi082 ceph-mon[94281]: pgmap v4903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:02 smithi082 ceph-mon[94281]: pgmap v4904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:04 smithi082 ceph-mon[94281]: pgmap v4905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:06 smithi082 ceph-mon[94281]: pgmap v4906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:01.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:08 smithi082 ceph-mon[94281]: pgmap v4907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:09 smithi082 ceph-mon[94281]: osdmap e376: 12 total, 12 up, 12 in 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:10 smithi082 ceph-mon[94281]: pgmap v4909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:12 smithi082 ceph-mon[94281]: pgmap v4910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:14 smithi082 ceph-mon[94281]: pgmap v4911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:16 smithi082 ceph-mon[94281]: pgmap v4912: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:17 smithi082 ceph-mon[94281]: osdmap e377: 12 total, 12 up, 12 in 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:18 smithi082 ceph-mon[94281]: pgmap v4913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:19 smithi082 ceph-mon[94281]: pgmap v4915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:19 smithi082 ceph-mon[94281]: pgmap v4916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:20:01.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:21 smithi082 ceph-mon[94281]: pgmap v4917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:20:04.701 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:23 smithi082 ceph-mon[94281]: pgmap v4918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:20:04.701 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:25 smithi082 ceph-mon[94281]: pgmap v4919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:27 smithi082 ceph-mon[94281]: pgmap v4920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:29 smithi082 ceph-mon[94281]: pgmap v4921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:31 smithi082 ceph-mon[94281]: pgmap v4922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:33 smithi082 ceph-mon[94281]: pgmap v4923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:35 smithi082 ceph-mon[94281]: pgmap v4924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:37 smithi082 ceph-mon[94281]: pgmap v4925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:39 smithi082 ceph-mon[94281]: pgmap v4926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:41 smithi082 ceph-mon[94281]: pgmap v4927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:43 smithi082 ceph-mon[94281]: pgmap v4928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:45 smithi082 ceph-mon[94281]: pgmap v4929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:47 smithi082 ceph-mon[94281]: pgmap v4930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:49 smithi082 ceph-mon[94281]: pgmap v4931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:51 smithi082 ceph-mon[94281]: pgmap v4932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:04.702 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:53 smithi082 ceph-mon[94281]: pgmap v4933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:06.451 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:55 smithi082 ceph-mon[94281]: pgmap v4934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:20:06.451 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:57 smithi082 ceph-mon[94281]: pgmap v4935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:06.451 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:15:59 smithi082 ceph-mon[94281]: pgmap v4936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:01 smithi082 ceph-mon[94281]: pgmap v4937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:03 smithi082 ceph-mon[94281]: pgmap v4938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:05 smithi082 ceph-mon[94281]: pgmap v4939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:07 smithi082 ceph-mon[94281]: pgmap v4940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:09 smithi082 ceph-mon[94281]: pgmap v4941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:09 smithi082 ceph-mon[94281]: osdmap e378: 12 total, 12 up, 12 in 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:11 smithi082 ceph-mon[94281]: pgmap v4943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:20:06.452 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:13 smithi082 ceph-mon[94281]: pgmap v4944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-17T12:20:09.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:15 smithi082 ceph-mon[94281]: pgmap v4945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:09.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:17 smithi082 ceph-mon[94281]: pgmap v4946: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:09.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:17 smithi082 ceph-mon[94281]: osdmap e379: 12 total, 12 up, 12 in 2023-03-17T12:20:11.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:12.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:19 smithi082 ceph-mon[94281]: pgmap v4948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:20:12.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:12.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:12.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:19 smithi082 ceph-mon[94281]: pgmap v4949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:20:12.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:19 smithi082 ceph-mon[94281]: pgmap v4950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 150 B/s wr, 9 op/s 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:21 smithi082 ceph-mon[94281]: pgmap v4951: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:23 smithi082 ceph-mon[94281]: pgmap v4952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:25 smithi082 ceph-mon[94281]: pgmap v4953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:27 smithi082 ceph-mon[94281]: pgmap v4954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:29 smithi082 ceph-mon[94281]: pgmap v4955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:12.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:31 smithi082 ceph-mon[94281]: pgmap v4956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:33 smithi082 ceph-mon[94281]: pgmap v4957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:35 smithi082 ceph-mon[94281]: pgmap v4958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:37 smithi082 ceph-mon[94281]: pgmap v4959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:39 smithi082 ceph-mon[94281]: pgmap v4960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:41 smithi082 ceph-mon[94281]: pgmap v4961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:43 smithi082 ceph-mon[94281]: pgmap v4962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:45 smithi082 ceph-mon[94281]: pgmap v4963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.517 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:47 smithi082 ceph-mon[94281]: pgmap v4964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:49 smithi082 ceph-mon[94281]: pgmap v4965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:51 smithi082 ceph-mon[94281]: pgmap v4966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:53 smithi082 ceph-mon[94281]: pgmap v4967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:55 smithi082 ceph-mon[94281]: pgmap v4968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:57 smithi082 ceph-mon[94281]: pgmap v4969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:16:59 smithi082 ceph-mon[94281]: pgmap v4970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:01 smithi082 ceph-mon[94281]: pgmap v4971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:03 smithi082 ceph-mon[94281]: pgmap v4972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:05 smithi082 ceph-mon[94281]: pgmap v4973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:13.518 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:07 smithi082 ceph-mon[94281]: pgmap v4974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:15.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:09 smithi082 ceph-mon[94281]: pgmap v4975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:15.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:09 smithi082 ceph-mon[94281]: osdmap e380: 12 total, 12 up, 12 in 2023-03-17T12:20:15.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:11 smithi082 ceph-mon[94281]: pgmap v4977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:15.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:13 smithi082 ceph-mon[94281]: pgmap v4978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:15.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:15 smithi082 ceph-mon[94281]: pgmap v4979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:17 smithi082 ceph-mon[94281]: pgmap v4980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:17 smithi082 ceph-mon[94281]: osdmap e381: 12 total, 12 up, 12 in 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:19 smithi082 ceph-mon[94281]: pgmap v4982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:20 smithi082 ceph-mon[94281]: pgmap v4983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:20 smithi082 ceph-mon[94281]: pgmap v4984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:22 smithi082 ceph-mon[94281]: pgmap v4985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:20:15.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:24 smithi082 ceph-mon[94281]: pgmap v4986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:20:17.382 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:26 smithi082 ceph-mon[94281]: pgmap v4987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:20:17.382 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:28 smithi082 ceph-mon[94281]: pgmap v4988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:20:17.948 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:30 smithi082 ceph-mon[94281]: pgmap v4989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:17.949 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:32 smithi082 ceph-mon[94281]: pgmap v4990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T12:20:17.949 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:34 smithi082 ceph-mon[94281]: pgmap v4991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:17.949 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:36 smithi082 ceph-mon[94281]: pgmap v4992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:38 smithi082 ceph-mon[94281]: pgmap v4993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:40 smithi082 ceph-mon[94281]: pgmap v4994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:42 smithi082 ceph-mon[94281]: pgmap v4995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:44 smithi082 ceph-mon[94281]: pgmap v4996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:46 smithi082 ceph-mon[94281]: pgmap v4997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:48 smithi082 ceph-mon[94281]: pgmap v4998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:50 smithi082 ceph-mon[94281]: pgmap v4999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:18.605 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:52 smithi082 ceph-mon[94281]: pgmap v5000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:54 smithi082 ceph-mon[94281]: pgmap v5001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:56 smithi082 ceph-mon[94281]: pgmap v5002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:17:58 smithi082 ceph-mon[94281]: pgmap v5003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:00 smithi082 ceph-mon[94281]: pgmap v5004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:02 smithi082 ceph-mon[94281]: pgmap v5005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:04 smithi082 ceph-mon[94281]: pgmap v5006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:06 smithi082 ceph-mon[94281]: pgmap v5007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:08 smithi082 ceph-mon[94281]: pgmap v5008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:10 smithi082 ceph-mon[94281]: osdmap e382: 12 total, 12 up, 12 in 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:10 smithi082 ceph-mon[94281]: pgmap v5010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:12 smithi082 ceph-mon[94281]: pgmap v5011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:14 smithi082 ceph-mon[94281]: pgmap v5012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:16 smithi082 ceph-mon[94281]: pgmap v5013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:18 smithi082 ceph-mon[94281]: osdmap e383: 12 total, 12 up, 12 in 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:18 smithi082 ceph-mon[94281]: pgmap v5015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 124 B/s wr, 12 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:20 smithi082 ceph-mon[94281]: pgmap v5016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:18.606 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:21 smithi082 ceph-mon[94281]: pgmap v5017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 115 B/s wr, 11 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:21 smithi082 ceph-mon[94281]: pgmap v5018: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:23 smithi082 ceph-mon[94281]: pgmap v5019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 149 B/s wr, 14 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:25 smithi082 ceph-mon[94281]: pgmap v5020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:27 smithi082 ceph-mon[94281]: pgmap v5021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:29 smithi082 ceph-mon[94281]: pgmap v5022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:31 smithi082 ceph-mon[94281]: pgmap v5023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:33 smithi082 ceph-mon[94281]: pgmap v5024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:35 smithi082 ceph-mon[94281]: pgmap v5025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:18.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:37 smithi082 ceph-mon[94281]: pgmap v5026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:39 smithi082 ceph-mon[94281]: pgmap v5027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:19.641 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:41 smithi082 ceph-mon[94281]: pgmap v5028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:19.642 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:43 smithi082 ceph-mon[94281]: pgmap v5029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:20.052 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:45 smithi082 ceph-mon[94281]: pgmap v5030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:20.052 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:47 smithi082 ceph-mon[94281]: pgmap v5031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:20.052 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:49 smithi082 ceph-mon[94281]: pgmap v5032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:20.052 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:51 smithi082 ceph-mon[94281]: pgmap v5033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:20.052 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:53 smithi082 ceph-mon[94281]: pgmap v5034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:20.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:55 smithi082 ceph-mon[94281]: pgmap v5035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:20.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:57 smithi082 ceph-mon[94281]: pgmap v5036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:20.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:18:59 smithi082 ceph-mon[94281]: pgmap v5037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:20.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:01 smithi082 ceph-mon[94281]: pgmap v5038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:20.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:03 smithi082 ceph-mon[94281]: pgmap v5039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:20:20.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:05 smithi082 ceph-mon[94281]: pgmap v5040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:20.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:07 smithi082 ceph-mon[94281]: pgmap v5041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:21.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:09 smithi082 ceph-mon[94281]: pgmap v5042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:21.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:09 smithi082 ceph-mon[94281]: osdmap e384: 12 total, 12 up, 12 in 2023-03-17T12:20:21.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:11 smithi082 ceph-mon[94281]: pgmap v5044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:21.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:13 smithi082 ceph-mon[94281]: pgmap v5045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:21.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:15 smithi082 ceph-mon[94281]: pgmap v5046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:21.846 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:17 smithi082 ceph-mon[94281]: pgmap v5047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:22.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:17 smithi082 ceph-mon[94281]: osdmap e385: 12 total, 12 up, 12 in 2023-03-17T12:20:22.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:19 smithi082 ceph-mon[94281]: pgmap v5049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:20:22.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:21 smithi082 ceph-mon[94281]: pgmap v5050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:22.593 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:23.618 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:23.618 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:24.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:24.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:24.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:22 smithi082 ceph-mon[94281]: pgmap v5051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:22 smithi082 ceph-mon[94281]: pgmap v5052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:24 smithi082 ceph-mon[94281]: pgmap v5053: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 140 B/s wr, 14 op/s 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:26 smithi082 ceph-mon[94281]: pgmap v5054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:28 smithi082 ceph-mon[94281]: pgmap v5055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:30 smithi082 ceph-mon[94281]: pgmap v5056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:32 smithi082 ceph-mon[94281]: pgmap v5057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:34 smithi082 ceph-mon[94281]: pgmap v5058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:36 smithi082 ceph-mon[94281]: pgmap v5059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:38 smithi082 ceph-mon[94281]: pgmap v5060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:40 smithi082 ceph-mon[94281]: pgmap v5061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:42 smithi082 ceph-mon[94281]: pgmap v5062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:44 smithi082 ceph-mon[94281]: pgmap v5063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:46 smithi082 ceph-mon[94281]: pgmap v5064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:48 smithi082 ceph-mon[94281]: pgmap v5065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:25.756 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:50 smithi082 ceph-mon[94281]: pgmap v5066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:52 smithi082 ceph-mon[94281]: pgmap v5067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:54 smithi082 ceph-mon[94281]: pgmap v5068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:56 smithi082 ceph-mon[94281]: pgmap v5069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:19:58 smithi082 ceph-mon[94281]: pgmap v5070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:00 smithi082 ceph-mon[94281]: pgmap v5071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:02 smithi082 ceph-mon[94281]: pgmap v5072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:27.513 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:04 smithi082 ceph-mon[94281]: pgmap v5073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:06 smithi082 ceph-mon[94281]: pgmap v5074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:08 smithi082 ceph-mon[94281]: pgmap v5075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:10 smithi082 ceph-mon[94281]: osdmap e386: 12 total, 12 up, 12 in 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:10 smithi082 ceph-mon[94281]: pgmap v5077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:12 smithi082 ceph-mon[94281]: pgmap v5078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:14 smithi082 ceph-mon[94281]: pgmap v5079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:16 smithi082 ceph-mon[94281]: pgmap v5080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:18 smithi082 ceph-mon[94281]: osdmap e387: 12 total, 12 up, 12 in 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:18 smithi082 ceph-mon[94281]: pgmap v5082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-17T12:20:27.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:20 smithi082 ceph-mon[94281]: pgmap v5083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:22 smithi082 ceph-mon[94281]: pgmap v5084: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:24 smithi082 ceph-mon[94281]: pgmap v5085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:20:28.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:26 smithi082 ceph-mon[94281]: pgmap v5086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: pgmap v5087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: pgmap v5088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:29 smithi082 ceph-mon[94281]: pgmap v5089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:31 smithi082 ceph-mon[94281]: pgmap v5090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:20:28.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:33 smithi082 ceph-mon[94281]: pgmap v5091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:20:29.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:35 smithi082 ceph-mon[94281]: pgmap v5092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:20:29.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:37 smithi082 ceph-mon[94281]: pgmap v5093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:30.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:39 smithi082 ceph-mon[94281]: pgmap v5094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:30.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:41 smithi082 ceph-mon[94281]: pgmap v5095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:30.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:43 smithi082 ceph-mon[94281]: pgmap v5096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:30.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:45 smithi082 ceph-mon[94281]: pgmap v5097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:30.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:47 smithi082 ceph-mon[94281]: pgmap v5098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:30.622 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:49 smithi082 ceph-mon[94281]: pgmap v5099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:51 smithi082 ceph-mon[94281]: pgmap v5100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:53 smithi082 ceph-mon[94281]: pgmap v5101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:55 smithi082 ceph-mon[94281]: pgmap v5102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:57 smithi082 ceph-mon[94281]: pgmap v5103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:20:59 smithi082 ceph-mon[94281]: pgmap v5104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:01 smithi082 ceph-mon[94281]: pgmap v5105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:03 smithi082 ceph-mon[94281]: pgmap v5106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:05 smithi082 ceph-mon[94281]: pgmap v5107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:07 smithi082 ceph-mon[94281]: pgmap v5108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:09 smithi082 ceph-mon[94281]: pgmap v5109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:09 smithi082 ceph-mon[94281]: osdmap e388: 12 total, 12 up, 12 in 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:11 smithi082 ceph-mon[94281]: pgmap v5111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:13 smithi082 ceph-mon[94281]: pgmap v5112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:15 smithi082 ceph-mon[94281]: pgmap v5113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:17 smithi082 ceph-mon[94281]: pgmap v5114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:17 smithi082 ceph-mon[94281]: osdmap e389: 12 total, 12 up, 12 in 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:19 smithi082 ceph-mon[94281]: pgmap v5116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 104 B/s wr, 10 op/s 2023-03-17T12:20:30.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:21 smithi082 ceph-mon[94281]: pgmap v5117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:30.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:23 smithi082 ceph-mon[94281]: pgmap v5118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:25 smithi082 ceph-mon[94281]: pgmap v5119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:27 smithi082 ceph-mon[94281]: pgmap v5120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:28 smithi082 ceph-mon[94281]: pgmap v5121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 422 B/s wr, 10 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:28 smithi082 ceph-mon[94281]: pgmap v5122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:30 smithi082 ceph-mon[94281]: pgmap v5123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:32 smithi082 ceph-mon[94281]: pgmap v5124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:34 smithi082 ceph-mon[94281]: pgmap v5125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:36 smithi082 ceph-mon[94281]: pgmap v5126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:32.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:38 smithi082 ceph-mon[94281]: pgmap v5127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:40 smithi082 ceph-mon[94281]: pgmap v5128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:42 smithi082 ceph-mon[94281]: pgmap v5129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:44 smithi082 ceph-mon[94281]: pgmap v5130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:46 smithi082 ceph-mon[94281]: pgmap v5131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:48 smithi082 ceph-mon[94281]: pgmap v5132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:50 smithi082 ceph-mon[94281]: pgmap v5133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:52 smithi082 ceph-mon[94281]: pgmap v5134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:54 smithi082 ceph-mon[94281]: pgmap v5135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:56 smithi082 ceph-mon[94281]: pgmap v5136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:21:58 smithi082 ceph-mon[94281]: pgmap v5137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:00 smithi082 ceph-mon[94281]: pgmap v5138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:02 smithi082 ceph-mon[94281]: pgmap v5139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:32.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:04 smithi082 ceph-mon[94281]: pgmap v5140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:20:33.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:06 smithi082 ceph-mon[94281]: pgmap v5141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:33.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:08 smithi082 ceph-mon[94281]: pgmap v5142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:33.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:09 smithi082 ceph-mon[94281]: osdmap e390: 12 total, 12 up, 12 in 2023-03-17T12:20:33.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:10 smithi082 ceph-mon[94281]: pgmap v5144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:33.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:12 smithi082 ceph-mon[94281]: pgmap v5145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:33.141 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:14 smithi082 ceph-mon[94281]: pgmap v5146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:33.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:16 smithi082 ceph-mon[94281]: pgmap v5147: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:33.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:18 smithi082 ceph-mon[94281]: pgmap v5148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:33.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:18 smithi082 ceph-mon[94281]: osdmap e391: 12 total, 12 up, 12 in 2023-03-17T12:20:33.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:20 smithi082 ceph-mon[94281]: pgmap v5150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:35.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:22 smithi082 ceph-mon[94281]: pgmap v5151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:24 smithi082 ceph-mon[94281]: pgmap v5152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:26 smithi082 ceph-mon[94281]: pgmap v5153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:28 smithi082 ceph-mon[94281]: pgmap v5154: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:29 smithi082 ceph-mon[94281]: pgmap v5155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:29 smithi082 ceph-mon[94281]: pgmap v5156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:31 smithi082 ceph-mon[94281]: pgmap v5157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:33 smithi082 ceph-mon[94281]: pgmap v5158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:35 smithi082 ceph-mon[94281]: pgmap v5159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:37 smithi082 ceph-mon[94281]: pgmap v5160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:20:35.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:39 smithi082 ceph-mon[94281]: pgmap v5161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:36.721 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:41 smithi082 ceph-mon[94281]: pgmap v5162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:36.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:43 smithi082 ceph-mon[94281]: pgmap v5163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:36.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:45 smithi082 ceph-mon[94281]: pgmap v5164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:36.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:47 smithi082 ceph-mon[94281]: pgmap v5165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:36.722 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:49 smithi082 ceph-mon[94281]: pgmap v5166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:38.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:51 smithi082 ceph-mon[94281]: pgmap v5167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:38.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:53 smithi082 ceph-mon[94281]: pgmap v5168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:38.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:55 smithi082 ceph-mon[94281]: pgmap v5169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:38.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:57 smithi082 ceph-mon[94281]: pgmap v5170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:38.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:22:59 smithi082 ceph-mon[94281]: pgmap v5171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:38.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:01 smithi082 ceph-mon[94281]: pgmap v5172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:38.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:03 smithi082 ceph-mon[94281]: pgmap v5173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:38.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:05 smithi082 ceph-mon[94281]: pgmap v5174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:20:38.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:07 smithi082 ceph-mon[94281]: pgmap v5175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:09 smithi082 ceph-mon[94281]: pgmap v5176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 28 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:09 smithi082 ceph-mon[94281]: osdmap e392: 12 total, 12 up, 12 in 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:11 smithi082 ceph-mon[94281]: pgmap v5178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:13 smithi082 ceph-mon[94281]: pgmap v5179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:15 smithi082 ceph-mon[94281]: pgmap v5180: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:17 smithi082 ceph-mon[94281]: pgmap v5181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:17 smithi082 ceph-mon[94281]: osdmap e393: 12 total, 12 up, 12 in 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:19 smithi082 ceph-mon[94281]: pgmap v5183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 106 B/s wr, 10 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:21 smithi082 ceph-mon[94281]: pgmap v5184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:40.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:23 smithi082 ceph-mon[94281]: pgmap v5185: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:25 smithi082 ceph-mon[94281]: pgmap v5186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:27 smithi082 ceph-mon[94281]: pgmap v5187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:29 smithi082 ceph-mon[94281]: pgmap v5188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 372 B/s wr, 9 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:30 smithi082 ceph-mon[94281]: pgmap v5189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:30 smithi082 ceph-mon[94281]: pgmap v5190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:32 smithi082 ceph-mon[94281]: pgmap v5191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:34 smithi082 ceph-mon[94281]: pgmap v5192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:36 smithi082 ceph-mon[94281]: pgmap v5193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:38 smithi082 ceph-mon[94281]: pgmap v5194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:40 smithi082 ceph-mon[94281]: pgmap v5195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:20:40.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:42 smithi082 ceph-mon[94281]: pgmap v5196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:40.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:44 smithi082 ceph-mon[94281]: pgmap v5197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:40.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:46 smithi082 ceph-mon[94281]: pgmap v5198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:40.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:48 smithi082 ceph-mon[94281]: pgmap v5199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:41.484 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:50 smithi082 ceph-mon[94281]: pgmap v5200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:41.485 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:52 smithi082 ceph-mon[94281]: pgmap v5201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:41.485 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:54 smithi082 ceph-mon[94281]: pgmap v5202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:41.485 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:56 smithi082 ceph-mon[94281]: pgmap v5203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:41.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:23:58 smithi082 ceph-mon[94281]: pgmap v5204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:41.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:00 smithi082 ceph-mon[94281]: pgmap v5205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:41.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:02 smithi082 ceph-mon[94281]: pgmap v5206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:43.106 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:04 smithi082 ceph-mon[94281]: pgmap v5207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:20:43.106 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:06 smithi082 ceph-mon[94281]: pgmap v5208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:08 smithi082 ceph-mon[94281]: pgmap v5209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:09 smithi082 ceph-mon[94281]: osdmap e394: 12 total, 12 up, 12 in 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:10 smithi082 ceph-mon[94281]: pgmap v5211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:12 smithi082 ceph-mon[94281]: pgmap v5212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:14 smithi082 ceph-mon[94281]: pgmap v5213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:16 smithi082 ceph-mon[94281]: pgmap v5214: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:18 smithi082 ceph-mon[94281]: pgmap v5215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:18 smithi082 ceph-mon[94281]: osdmap e395: 12 total, 12 up, 12 in 2023-03-17T12:20:43.107 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:20 smithi082 ceph-mon[94281]: pgmap v5217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:22 smithi082 ceph-mon[94281]: pgmap v5218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:24 smithi082 ceph-mon[94281]: pgmap v5219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:26 smithi082 ceph-mon[94281]: pgmap v5220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:28 smithi082 ceph-mon[94281]: pgmap v5221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:30 smithi082 ceph-mon[94281]: pgmap v5222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:43.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:43.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:43.921 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:44.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:31 smithi082 ceph-mon[94281]: pgmap v5223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:20:44.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:31 smithi082 ceph-mon[94281]: pgmap v5224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:44.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:33 smithi082 ceph-mon[94281]: pgmap v5225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:44.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:35 smithi082 ceph-mon[94281]: pgmap v5226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:37 smithi082 ceph-mon[94281]: pgmap v5227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:39 smithi082 ceph-mon[94281]: pgmap v5228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:41 smithi082 ceph-mon[94281]: pgmap v5229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:43 smithi082 ceph-mon[94281]: pgmap v5230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:45 smithi082 ceph-mon[94281]: pgmap v5231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:47 smithi082 ceph-mon[94281]: pgmap v5232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:49 smithi082 ceph-mon[94281]: pgmap v5233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:51 smithi082 ceph-mon[94281]: pgmap v5234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:46.984 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:53 smithi082 ceph-mon[94281]: pgmap v5235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:55 smithi082 ceph-mon[94281]: pgmap v5236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:57 smithi082 ceph-mon[94281]: pgmap v5237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:24:59 smithi082 ceph-mon[94281]: pgmap v5238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:01 smithi082 ceph-mon[94281]: pgmap v5239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:03 smithi082 ceph-mon[94281]: pgmap v5240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:05 smithi082 ceph-mon[94281]: pgmap v5241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:47.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:07 smithi082 ceph-mon[94281]: pgmap v5242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:47.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:09 smithi082 ceph-mon[94281]: pgmap v5243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:47.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:09 smithi082 ceph-mon[94281]: osdmap e396: 12 total, 12 up, 12 in 2023-03-17T12:20:47.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:11 smithi082 ceph-mon[94281]: pgmap v5245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:47.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:13 smithi082 ceph-mon[94281]: pgmap v5246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:47.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:15 smithi082 ceph-mon[94281]: pgmap v5247: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:49.281 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:17 smithi082 ceph-mon[94281]: pgmap v5248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:49.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:17 smithi082 ceph-mon[94281]: osdmap e397: 12 total, 12 up, 12 in 2023-03-17T12:20:49.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:19 smithi082 ceph-mon[94281]: pgmap v5250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-17T12:20:49.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:21 smithi082 ceph-mon[94281]: pgmap v5251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:49.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:23 smithi082 ceph-mon[94281]: pgmap v5252: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:49.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:25 smithi082 ceph-mon[94281]: pgmap v5253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:49.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:27 smithi082 ceph-mon[94281]: pgmap v5254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:29 smithi082 ceph-mon[94281]: pgmap v5255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:31 smithi082 ceph-mon[94281]: pgmap v5256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:31 smithi082 ceph-mon[94281]: pgmap v5257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:31 smithi082 ceph-mon[94281]: pgmap v5258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:51.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:33 smithi082 ceph-mon[94281]: pgmap v5259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:51.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:34 smithi082 ceph-mon[94281]: pgmap v5260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:20:51.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:36 smithi082 ceph-mon[94281]: pgmap v5261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 116 B/s wr, 7 op/s 2023-03-17T12:20:51.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:38 smithi082 ceph-mon[94281]: pgmap v5262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:20:51.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:40 smithi082 ceph-mon[94281]: pgmap v5263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:20:51.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:43 smithi082 ceph-mon[94281]: pgmap v5264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:20:52.309 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:44 smithi082 ceph-mon[94281]: pgmap v5265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:52.309 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:46 smithi082 ceph-mon[94281]: pgmap v5266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:20:53.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:48 smithi082 ceph-mon[94281]: pgmap v5267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:20:53.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:50 smithi082 ceph-mon[94281]: pgmap v5268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:53.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:53 smithi082 ceph-mon[94281]: pgmap v5269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:54 smithi082 ceph-mon[94281]: pgmap v5270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:56 smithi082 ceph-mon[94281]: pgmap v5271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:25:58 smithi082 ceph-mon[94281]: pgmap v5272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:00 smithi082 ceph-mon[94281]: pgmap v5273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:03 smithi082 ceph-mon[94281]: pgmap v5274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:04 smithi082 ceph-mon[94281]: osdmap e398: 12 total, 12 up, 12 in 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:05 smithi082 ceph-mon[94281]: pgmap v5276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:06 smithi082 ceph-mon[94281]: pgmap v5277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:08 smithi082 ceph-mon[94281]: pgmap v5278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:10 smithi082 ceph-mon[94281]: pgmap v5279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:13 smithi082 ceph-mon[94281]: osdmap e399: 12 total, 12 up, 12 in 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:13 smithi082 ceph-mon[94281]: pgmap v5281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 542 B/s wr, 9 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:14 smithi082 ceph-mon[94281]: pgmap v5282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T12:20:53.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:15 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:15 smithi082 ceph-mon[94281]: osdmap e400: 12 total, 12 up, 12 in 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:17 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/1305502887,v1:172.21.15.35:6837/1305502887] up:boot 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:17 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:17 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:17 smithi082 ceph-mon[94281]: pgmap v5284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 639 B/s wr, 9 op/s 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:18 smithi082 ceph-mon[94281]: pgmap v5285: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:20 smithi082 ceph-mon[94281]: pgmap v5286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 485 B/s wr, 6 op/s 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:23 smithi082 ceph-mon[94281]: pgmap v5287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:20:53.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:24 smithi082 ceph-mon[94281]: pgmap v5288: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:20:53.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:26 smithi082 ceph-mon[94281]: pgmap v5289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 351 B/s wr, 12 op/s 2023-03-17T12:20:53.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:28 smithi082 ceph-mon[94281]: pgmap v5290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T12:20:53.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:30 smithi082 ceph-mon[94281]: pgmap v5291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:53.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:20:53.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:20:53.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:20:53.926 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:32 smithi082 ceph-mon[94281]: pgmap v5292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:20:54.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:32 smithi082 ceph-mon[94281]: pgmap v5293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:20:56.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:20:56.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:34 smithi082 ceph-mon[94281]: pgmap v5294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:20:56.312 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:36 smithi082 ceph-mon[94281]: pgmap v5295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 348 B/s wr, 7 op/s 2023-03-17T12:20:57.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:38 smithi082 ceph-mon[94281]: pgmap v5296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:20:57.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:40 smithi082 ceph-mon[94281]: pgmap v5297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:20:57.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:42 smithi082 ceph-mon[94281]: pgmap v5298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:20:57.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:44 smithi082 ceph-mon[94281]: pgmap v5299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:20:57.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:46 smithi082 ceph-mon[94281]: pgmap v5300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:57.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:48 smithi082 ceph-mon[94281]: pgmap v5301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:57.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:50 smithi082 ceph-mon[94281]: pgmap v5302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:57.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:52 smithi082 ceph-mon[94281]: pgmap v5303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:57.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:54 smithi082 ceph-mon[94281]: pgmap v5304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:57.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:56 smithi082 ceph-mon[94281]: pgmap v5305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:58.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:26:58 smithi082 ceph-mon[94281]: pgmap v5306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:20:58.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:00 smithi082 ceph-mon[94281]: pgmap v5307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:58.461 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:02 smithi082 ceph-mon[94281]: pgmap v5308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:20:58.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:04 smithi082 ceph-mon[94281]: pgmap v5309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:20:58.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:06 smithi082 ceph-mon[94281]: pgmap v5310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:20:58.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:08 smithi082 ceph-mon[94281]: pgmap v5311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:20:58.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:09 smithi082 ceph-mon[94281]: osdmap e401: 12 total, 12 up, 12 in 2023-03-17T12:20:58.462 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:10 smithi082 ceph-mon[94281]: pgmap v5313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:58.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:12 smithi082 ceph-mon[94281]: pgmap v5314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:20:58.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:14 smithi082 ceph-mon[94281]: pgmap v5315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:58.899 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:16 smithi082 ceph-mon[94281]: pgmap v5316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:58.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:18 smithi082 ceph-mon[94281]: osdmap e402: 12 total, 12 up, 12 in 2023-03-17T12:20:58.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:18 smithi082 ceph-mon[94281]: pgmap v5318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-17T12:20:58.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:20 smithi082 ceph-mon[94281]: pgmap v5319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:58.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:22 smithi082 ceph-mon[94281]: pgmap v5320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:20:58.900 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:24 smithi082 ceph-mon[94281]: pgmap v5321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:26 smithi082 ceph-mon[94281]: pgmap v5322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:28 smithi082 ceph-mon[94281]: pgmap v5323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:30 smithi082 ceph-mon[94281]: pgmap v5324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:32 smithi082 ceph-mon[94281]: pgmap v5325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:33 smithi082 ceph-mon[94281]: pgmap v5326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:21:00.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:33 smithi082 ceph-mon[94281]: pgmap v5327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:35 smithi082 ceph-mon[94281]: pgmap v5328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:37 smithi082 ceph-mon[94281]: pgmap v5329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:39 smithi082 ceph-mon[94281]: pgmap v5330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:41 smithi082 ceph-mon[94281]: pgmap v5331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:43 smithi082 ceph-mon[94281]: pgmap v5332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:45 smithi082 ceph-mon[94281]: pgmap v5333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:47 smithi082 ceph-mon[94281]: pgmap v5334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:49 smithi082 ceph-mon[94281]: pgmap v5335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:51 smithi082 ceph-mon[94281]: pgmap v5336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:00.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:53 smithi082 ceph-mon[94281]: pgmap v5337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:01.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:55 smithi082 ceph-mon[94281]: pgmap v5338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:01.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:57 smithi082 ceph-mon[94281]: pgmap v5339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:01.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:27:59 smithi082 ceph-mon[94281]: pgmap v5340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:01.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:01 smithi082 ceph-mon[94281]: pgmap v5341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:01.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:03 smithi082 ceph-mon[94281]: pgmap v5342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:01.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:05 smithi082 ceph-mon[94281]: pgmap v5343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:01.547 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:07 smithi082 ceph-mon[94281]: pgmap v5344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:01.547 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:09 smithi082 ceph-mon[94281]: pgmap v5345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:01.547 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:09 smithi082 ceph-mon[94281]: osdmap e403: 12 total, 12 up, 12 in 2023-03-17T12:21:03.246 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:11 smithi082 ceph-mon[94281]: pgmap v5347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:03.246 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:13 smithi082 ceph-mon[94281]: pgmap v5348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:03.246 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:15 smithi082 ceph-mon[94281]: pgmap v5349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:17 smithi082 ceph-mon[94281]: pgmap v5350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:17 smithi082 ceph-mon[94281]: osdmap e404: 12 total, 12 up, 12 in 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:19 smithi082 ceph-mon[94281]: pgmap v5352: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:21 smithi082 ceph-mon[94281]: pgmap v5353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:23 smithi082 ceph-mon[94281]: pgmap v5354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:25 smithi082 ceph-mon[94281]: pgmap v5355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:27 smithi082 ceph-mon[94281]: pgmap v5356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:29 smithi082 ceph-mon[94281]: pgmap v5357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:21:03.247 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:31 smithi082 ceph-mon[94281]: pgmap v5358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:33 smithi082 ceph-mon[94281]: pgmap v5359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:34 smithi082 ceph-mon[94281]: pgmap v5360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 285 B/s wr, 9 op/s 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:34 smithi082 ceph-mon[94281]: pgmap v5361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:36 smithi082 ceph-mon[94281]: pgmap v5362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:21:03.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:38 smithi082 ceph-mon[94281]: pgmap v5363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:40 smithi082 ceph-mon[94281]: pgmap v5364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:42 smithi082 ceph-mon[94281]: pgmap v5365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:44 smithi082 ceph-mon[94281]: pgmap v5366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:46 smithi082 ceph-mon[94281]: pgmap v5367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:48 smithi082 ceph-mon[94281]: pgmap v5368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:50 smithi082 ceph-mon[94281]: pgmap v5369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:52 smithi082 ceph-mon[94281]: pgmap v5370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:03.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:54 smithi082 ceph-mon[94281]: pgmap v5371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:03.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:56 smithi082 ceph-mon[94281]: pgmap v5372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:03.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:28:58 smithi082 ceph-mon[94281]: pgmap v5373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:03.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:00 smithi082 ceph-mon[94281]: pgmap v5374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:04.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:02 smithi082 ceph-mon[94281]: pgmap v5375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:04.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:04 smithi082 ceph-mon[94281]: pgmap v5376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:05.933 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:06 smithi082 ceph-mon[94281]: pgmap v5377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:21:05.933 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:08 smithi082 ceph-mon[94281]: pgmap v5378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:06.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:09 smithi082 ceph-mon[94281]: osdmap e405: 12 total, 12 up, 12 in 2023-03-17T12:21:06.386 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:10 smithi082 ceph-mon[94281]: pgmap v5380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:08.120 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:12 smithi082 ceph-mon[94281]: pgmap v5381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:08.120 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:14 smithi082 ceph-mon[94281]: pgmap v5382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:08.120 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:16 smithi082 ceph-mon[94281]: pgmap v5383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:08.120 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:18 smithi082 ceph-mon[94281]: pgmap v5384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:08.120 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:18 smithi082 ceph-mon[94281]: osdmap e406: 12 total, 12 up, 12 in 2023-03-17T12:21:08.120 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:20 smithi082 ceph-mon[94281]: pgmap v5386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:22 smithi082 ceph-mon[94281]: pgmap v5387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:24 smithi082 ceph-mon[94281]: pgmap v5388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:26 smithi082 ceph-mon[94281]: pgmap v5389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:28 smithi082 ceph-mon[94281]: pgmap v5390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:10.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:30 smithi082 ceph-mon[94281]: pgmap v5391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:10.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:32 smithi082 ceph-mon[94281]: pgmap v5392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:10.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:10.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:34 smithi082 ceph-mon[94281]: pgmap v5393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:10.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:10.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:10.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:35 smithi082 ceph-mon[94281]: pgmap v5394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:35 smithi082 ceph-mon[94281]: pgmap v5395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:37 smithi082 ceph-mon[94281]: pgmap v5396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:38 smithi082 ceph-mon[94281]: pgmap v5397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:41 smithi082 ceph-mon[94281]: pgmap v5398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:43 smithi082 ceph-mon[94281]: pgmap v5399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:10.428 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:45 smithi082 ceph-mon[94281]: pgmap v5400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:10.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:47 smithi082 ceph-mon[94281]: pgmap v5401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:10.429 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:49 smithi082 ceph-mon[94281]: pgmap v5402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:11.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:51 smithi082 ceph-mon[94281]: pgmap v5403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:11.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:53 smithi082 ceph-mon[94281]: pgmap v5404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:11.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:55 smithi082 ceph-mon[94281]: pgmap v5405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:11.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:57 smithi082 ceph-mon[94281]: pgmap v5406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:11.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:29:59 smithi082 ceph-mon[94281]: pgmap v5407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:01 smithi082 ceph-mon[94281]: pgmap v5408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:03 smithi082 ceph-mon[94281]: pgmap v5409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:12.870 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:05 smithi082 ceph-mon[94281]: pgmap v5410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:07 smithi082 ceph-mon[94281]: pgmap v5411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:09 smithi082 ceph-mon[94281]: pgmap v5412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:09 smithi082 ceph-mon[94281]: osdmap e407: 12 total, 12 up, 12 in 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:11 smithi082 ceph-mon[94281]: pgmap v5414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:13 smithi082 ceph-mon[94281]: pgmap v5415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:15 smithi082 ceph-mon[94281]: pgmap v5416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:17 smithi082 ceph-mon[94281]: pgmap v5417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:17 smithi082 ceph-mon[94281]: osdmap e408: 12 total, 12 up, 12 in 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:19 smithi082 ceph-mon[94281]: pgmap v5419: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:21 smithi082 ceph-mon[94281]: pgmap v5420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:23 smithi082 ceph-mon[94281]: pgmap v5421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:25 smithi082 ceph-mon[94281]: pgmap v5422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:27 smithi082 ceph-mon[94281]: pgmap v5423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:29 smithi082 ceph-mon[94281]: pgmap v5424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:21:12.871 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:31 smithi082 ceph-mon[94281]: pgmap v5425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:33 smithi082 ceph-mon[94281]: pgmap v5426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:35 smithi082 ceph-mon[94281]: pgmap v5427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:35 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:37 smithi082 ceph-mon[94281]: pgmap v5428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: scrub queued for path: / 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: scrub summary: idle+waiting paths [/] 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: scrub summary: active paths [/] 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: scrub summary: idle+waiting paths [/] 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:12.872 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:12.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:12.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:12.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:12.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:13.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:13.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:38 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:13.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:21:13.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:21:14.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:21:14.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:21:14.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: scrub summary: idle 2023-03-17T12:21:14.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:21:14.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: pgmap v5429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:39 smithi082 ceph-mon[94281]: pgmap v5430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:41 smithi082 ceph-mon[94281]: pgmap v5431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:43 smithi082 ceph-mon[94281]: pgmap v5432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:45 smithi082 ceph-mon[94281]: pgmap v5433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:47 smithi082 ceph-mon[94281]: pgmap v5434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:49 smithi082 ceph-mon[94281]: pgmap v5435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:51 smithi082 ceph-mon[94281]: pgmap v5436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:53 smithi082 ceph-mon[94281]: pgmap v5437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 15 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:55 smithi082 ceph-mon[94281]: pgmap v5438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:14.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:57 smithi082 ceph-mon[94281]: pgmap v5439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:14.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:30:59 smithi082 ceph-mon[94281]: pgmap v5440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:14.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:01 smithi082 ceph-mon[94281]: pgmap v5441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:15.466 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:03 smithi082 ceph-mon[94281]: pgmap v5442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:15.466 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:05 smithi082 ceph-mon[94281]: pgmap v5443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:15.466 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:07 smithi082 ceph-mon[94281]: pgmap v5444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:15.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:09 smithi082 ceph-mon[94281]: pgmap v5445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:16.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:09 smithi082 ceph-mon[94281]: osdmap e409: 12 total, 12 up, 12 in 2023-03-17T12:21:16.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:11 smithi082 ceph-mon[94281]: pgmap v5447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:16.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:13 smithi082 ceph-mon[94281]: pgmap v5448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T12:21:16.685 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:15 smithi082 ceph-mon[94281]: pgmap v5449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:17 smithi082 ceph-mon[94281]: pgmap v5450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:17 smithi082 ceph-mon[94281]: osdmap e410: 12 total, 12 up, 12 in 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:19 smithi082 ceph-mon[94281]: pgmap v5452: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 927 B/s wr, 12 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:21 smithi082 ceph-mon[94281]: pgmap v5453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:23 smithi082 ceph-mon[94281]: pgmap v5454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:25 smithi082 ceph-mon[94281]: pgmap v5455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:27 smithi082 ceph-mon[94281]: pgmap v5456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:17.298 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:29 smithi082 ceph-mon[94281]: pgmap v5457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 277 B/s wr, 9 op/s 2023-03-17T12:21:17.299 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:31 smithi082 ceph-mon[94281]: pgmap v5458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:17.299 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:33 smithi082 ceph-mon[94281]: pgmap v5459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:17.299 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:35 smithi082 ceph-mon[94281]: pgmap v5460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:17.299 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:37 smithi082 ceph-mon[94281]: pgmap v5461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:17.299 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:39 smithi082 ceph-mon[94281]: pgmap v5462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:17.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:17.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:17.912 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:17.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:17.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:40 smithi082 ceph-mon[94281]: pgmap v5463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:21:17.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:40 smithi082 ceph-mon[94281]: pgmap v5464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:21:17.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:42 smithi082 ceph-mon[94281]: pgmap v5465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:21:17.913 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:44 smithi082 ceph-mon[94281]: pgmap v5466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:17.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:46 smithi082 ceph-mon[94281]: pgmap v5467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:17.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:48 smithi082 ceph-mon[94281]: pgmap v5468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:17.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:50 smithi082 ceph-mon[94281]: pgmap v5469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:17.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:52 smithi082 ceph-mon[94281]: pgmap v5470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:17.914 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:54 smithi082 ceph-mon[94281]: pgmap v5471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:21:19.345 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:56 smithi082 ceph-mon[94281]: pgmap v5472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:19.345 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:31:58 smithi082 ceph-mon[94281]: pgmap v5473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:20.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:00 smithi082 ceph-mon[94281]: pgmap v5474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:20.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:02 smithi082 ceph-mon[94281]: pgmap v5475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:20.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:04 smithi082 ceph-mon[94281]: pgmap v5476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:20.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:06 smithi082 ceph-mon[94281]: pgmap v5477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:20.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:08 smithi082 ceph-mon[94281]: pgmap v5478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:20.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:09 smithi082 ceph-mon[94281]: osdmap e411: 12 total, 12 up, 12 in 2023-03-17T12:21:21.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:10 smithi082 ceph-mon[94281]: pgmap v5480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:23.238 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:12 smithi082 ceph-mon[94281]: pgmap v5481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:24.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:14 smithi082 ceph-mon[94281]: pgmap v5482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:24.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:16 smithi082 ceph-mon[94281]: pgmap v5483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:24.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:18 smithi082 ceph-mon[94281]: pgmap v5484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:25.665 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:18 smithi082 ceph-mon[94281]: osdmap e412: 12 total, 12 up, 12 in 2023-03-17T12:21:25.665 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:20 smithi082 ceph-mon[94281]: pgmap v5486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:25.665 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:22 smithi082 ceph-mon[94281]: pgmap v5487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:25.665 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:24 smithi082 ceph-mon[94281]: pgmap v5488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:25.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:26 smithi082 ceph-mon[94281]: pgmap v5489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:25.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:28 smithi082 ceph-mon[94281]: pgmap v5490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:25.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:30 smithi082 ceph-mon[94281]: pgmap v5491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:26.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:32 smithi082 ceph-mon[94281]: pgmap v5492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:26.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:34 smithi082 ceph-mon[94281]: pgmap v5493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:26.353 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:36 smithi082 ceph-mon[94281]: pgmap v5494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:27.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:38 smithi082 ceph-mon[94281]: pgmap v5495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:27.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:39 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:27.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:40 smithi082 ceph-mon[94281]: pgmap v5496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:27.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:27.084 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:40 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:27.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:27.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:27.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:41 smithi082 ceph-mon[94281]: pgmap v5497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:21:27.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:41 smithi082 ceph-mon[94281]: pgmap v5498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:27.085 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:29.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:43 smithi082 ceph-mon[94281]: pgmap v5499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:29.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:45 smithi082 ceph-mon[94281]: pgmap v5500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:29.068 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:47 smithi082 ceph-mon[94281]: pgmap v5501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:21:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:49 smithi082 ceph-mon[94281]: pgmap v5502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:21:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:51 smithi082 ceph-mon[94281]: pgmap v5503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:53 smithi082 ceph-mon[94281]: pgmap v5504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:55 smithi082 ceph-mon[94281]: pgmap v5505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:57 smithi082 ceph-mon[94281]: pgmap v5506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:32:59 smithi082 ceph-mon[94281]: pgmap v5507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:31.528 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:01 smithi082 ceph-mon[94281]: pgmap v5508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:31.528 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:03 smithi082 ceph-mon[94281]: pgmap v5509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:31.528 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:05 smithi082 ceph-mon[94281]: pgmap v5510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:32.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:07 smithi082 ceph-mon[94281]: pgmap v5511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:32.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:09 smithi082 ceph-mon[94281]: pgmap v5512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:33.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:09 smithi082 ceph-mon[94281]: osdmap e413: 12 total, 12 up, 12 in 2023-03-17T12:21:33.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:11 smithi082 ceph-mon[94281]: pgmap v5514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:33.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:13 smithi082 ceph-mon[94281]: pgmap v5515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:33.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:15 smithi082 ceph-mon[94281]: pgmap v5516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:33.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:17 smithi082 ceph-mon[94281]: pgmap v5517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:33.273 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:17 smithi082 ceph-mon[94281]: osdmap e414: 12 total, 12 up, 12 in 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:19 smithi082 ceph-mon[94281]: pgmap v5519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:21 smithi082 ceph-mon[94281]: pgmap v5520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:23 smithi082 ceph-mon[94281]: pgmap v5521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:25 smithi082 ceph-mon[94281]: pgmap v5522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:27 smithi082 ceph-mon[94281]: pgmap v5523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:29 smithi082 ceph-mon[94281]: pgmap v5524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 366 B/s wr, 9 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:31 smithi082 ceph-mon[94281]: pgmap v5525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:33 smithi082 ceph-mon[94281]: pgmap v5526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:35 smithi082 ceph-mon[94281]: pgmap v5527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:37 smithi082 ceph-mon[94281]: pgmap v5528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:39 smithi082 ceph-mon[94281]: pgmap v5529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:34.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:41 smithi082 ceph-mon[94281]: pgmap v5530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:42 smithi082 ceph-mon[94281]: pgmap v5531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:42 smithi082 ceph-mon[94281]: pgmap v5532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:44 smithi082 ceph-mon[94281]: pgmap v5533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:46 smithi082 ceph-mon[94281]: pgmap v5534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:48 smithi082 ceph-mon[94281]: pgmap v5535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:50 smithi082 ceph-mon[94281]: pgmap v5536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:52 smithi082 ceph-mon[94281]: pgmap v5537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:54 smithi082 ceph-mon[94281]: pgmap v5538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:56 smithi082 ceph-mon[94281]: pgmap v5539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:33:58 smithi082 ceph-mon[94281]: pgmap v5540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:34.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:00 smithi082 ceph-mon[94281]: pgmap v5541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:02 smithi082 ceph-mon[94281]: pgmap v5542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:04 smithi082 ceph-mon[94281]: pgmap v5543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:06 smithi082 ceph-mon[94281]: pgmap v5544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:08 smithi082 ceph-mon[94281]: pgmap v5545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:09 smithi082 ceph-mon[94281]: osdmap e415: 12 total, 12 up, 12 in 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:10 smithi082 ceph-mon[94281]: pgmap v5547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:12 smithi082 ceph-mon[94281]: pgmap v5548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:14 smithi082 ceph-mon[94281]: pgmap v5549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:16 smithi082 ceph-mon[94281]: pgmap v5550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:18 smithi082 ceph-mon[94281]: pgmap v5552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:18 smithi082 ceph-mon[94281]: osdmap e416: 12 total, 12 up, 12 in 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:20 smithi082 ceph-mon[94281]: pgmap v5553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:22 smithi082 ceph-mon[94281]: pgmap v5554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:24 smithi082 ceph-mon[94281]: pgmap v5555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:26 smithi082 ceph-mon[94281]: pgmap v5556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:28 smithi082 ceph-mon[94281]: pgmap v5557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:30 smithi082 ceph-mon[94281]: pgmap v5558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:32 smithi082 ceph-mon[94281]: pgmap v5559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:34 smithi082 ceph-mon[94281]: pgmap v5560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:36 smithi082 ceph-mon[94281]: pgmap v5561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:38 smithi082 ceph-mon[94281]: pgmap v5562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:40 smithi082 ceph-mon[94281]: pgmap v5563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:42 smithi082 ceph-mon[94281]: pgmap v5564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:43 smithi082 ceph-mon[94281]: pgmap v5565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:21:34.395 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:43 smithi082 ceph-mon[94281]: pgmap v5566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:45 smithi082 ceph-mon[94281]: pgmap v5567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:47 smithi082 ceph-mon[94281]: pgmap v5568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:49 smithi082 ceph-mon[94281]: pgmap v5569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:51 smithi082 ceph-mon[94281]: pgmap v5570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:53 smithi082 ceph-mon[94281]: pgmap v5571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:55 smithi082 ceph-mon[94281]: pgmap v5572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:57 smithi082 ceph-mon[94281]: pgmap v5573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:35.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:34:59 smithi082 ceph-mon[94281]: pgmap v5574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:01 smithi082 ceph-mon[94281]: pgmap v5575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:03 smithi082 ceph-mon[94281]: pgmap v5576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:05 smithi082 ceph-mon[94281]: pgmap v5577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:07 smithi082 ceph-mon[94281]: pgmap v5578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:09 smithi082 ceph-mon[94281]: pgmap v5579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:09 smithi082 ceph-mon[94281]: osdmap e417: 12 total, 12 up, 12 in 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:11 smithi082 ceph-mon[94281]: pgmap v5581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:13 smithi082 ceph-mon[94281]: pgmap v5582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:15 smithi082 ceph-mon[94281]: pgmap v5583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:17 smithi082 ceph-mon[94281]: pgmap v5584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:17 smithi082 ceph-mon[94281]: osdmap e418: 12 total, 12 up, 12 in 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:19 smithi082 ceph-mon[94281]: pgmap v5586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 105 B/s wr, 10 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:21 smithi082 ceph-mon[94281]: pgmap v5587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:23 smithi082 ceph-mon[94281]: pgmap v5588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:35.426 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:25 smithi082 ceph-mon[94281]: pgmap v5589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:27 smithi082 ceph-mon[94281]: pgmap v5590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:29 smithi082 ceph-mon[94281]: pgmap v5591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:31 smithi082 ceph-mon[94281]: pgmap v5592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:33 smithi082 ceph-mon[94281]: pgmap v5593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:35 smithi082 ceph-mon[94281]: pgmap v5594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:37 smithi082 ceph-mon[94281]: pgmap v5595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:35.427 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:39 smithi082 ceph-mon[94281]: pgmap v5596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:36.223 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:41 smithi082 ceph-mon[94281]: pgmap v5597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:37.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:42 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:37.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:43 smithi082 ceph-mon[94281]: pgmap v5598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:37.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:44 smithi082 ceph-mon[94281]: pgmap v5599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:44 smithi082 ceph-mon[94281]: pgmap v5600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:46 smithi082 ceph-mon[94281]: pgmap v5601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:48 smithi082 ceph-mon[94281]: pgmap v5602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:50 smithi082 ceph-mon[94281]: pgmap v5603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:21:38.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:52 smithi082 ceph-mon[94281]: pgmap v5604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:54 smithi082 ceph-mon[94281]: pgmap v5605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:56 smithi082 ceph-mon[94281]: pgmap v5606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:35:58 smithi082 ceph-mon[94281]: pgmap v5607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:00 smithi082 ceph-mon[94281]: pgmap v5608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:02 smithi082 ceph-mon[94281]: pgmap v5609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:04 smithi082 ceph-mon[94281]: pgmap v5610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:06 smithi082 ceph-mon[94281]: pgmap v5611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:21:38.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:08 smithi082 ceph-mon[94281]: pgmap v5612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:39.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:09 smithi082 ceph-mon[94281]: osdmap e419: 12 total, 12 up, 12 in 2023-03-17T12:21:39.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:10 smithi082 ceph-mon[94281]: pgmap v5614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:39.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:12 smithi082 ceph-mon[94281]: pgmap v5615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:40.438 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:14 smithi082 ceph-mon[94281]: pgmap v5616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:40.440 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:16 smithi082 ceph-mon[94281]: pgmap v5617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:40.440 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:18 smithi082 ceph-mon[94281]: pgmap v5618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:40.440 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:18 smithi082 ceph-mon[94281]: osdmap e420: 12 total, 12 up, 12 in 2023-03-17T12:21:40.440 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:20 smithi082 ceph-mon[94281]: pgmap v5620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:40.440 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:22 smithi082 ceph-mon[94281]: pgmap v5621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:40.440 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:24 smithi082 ceph-mon[94281]: pgmap v5622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:40.441 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:26 smithi082 ceph-mon[94281]: pgmap v5623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:41.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:28 smithi082 ceph-mon[94281]: pgmap v5624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:43.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:30 smithi082 ceph-mon[94281]: pgmap v5625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:21:43.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:32 smithi082 ceph-mon[94281]: pgmap v5626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:43.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:34 smithi082 ceph-mon[94281]: pgmap v5627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:36 smithi082 ceph-mon[94281]: pgmap v5628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:38 smithi082 ceph-mon[94281]: pgmap v5629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:40 smithi082 ceph-mon[94281]: pgmap v5630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:42 smithi082 ceph-mon[94281]: pgmap v5631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:43 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:44 smithi082 ceph-mon[94281]: pgmap v5632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:45 smithi082 ceph-mon[94281]: pgmap v5633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:21:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:45 smithi082 ceph-mon[94281]: pgmap v5634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:21:44.744 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:47 smithi082 ceph-mon[94281]: pgmap v5635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:49 smithi082 ceph-mon[94281]: pgmap v5636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:51 smithi082 ceph-mon[94281]: pgmap v5637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:53 smithi082 ceph-mon[94281]: pgmap v5638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:55 smithi082 ceph-mon[94281]: pgmap v5639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:57 smithi082 ceph-mon[94281]: pgmap v5640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:36:59 smithi082 ceph-mon[94281]: pgmap v5641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:01 smithi082 ceph-mon[94281]: pgmap v5642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:03 smithi082 ceph-mon[94281]: pgmap v5643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:05 smithi082 ceph-mon[94281]: pgmap v5644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:07 smithi082 ceph-mon[94281]: pgmap v5645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:09 smithi082 ceph-mon[94281]: pgmap v5646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:09 smithi082 ceph-mon[94281]: osdmap e421: 12 total, 12 up, 12 in 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:11 smithi082 ceph-mon[94281]: pgmap v5648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:44.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:13 smithi082 ceph-mon[94281]: pgmap v5649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:15 smithi082 ceph-mon[94281]: pgmap v5650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:17 smithi082 ceph-mon[94281]: pgmap v5651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:17 smithi082 ceph-mon[94281]: osdmap e422: 12 total, 12 up, 12 in 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:19 smithi082 ceph-mon[94281]: pgmap v5653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 11 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:21 smithi082 ceph-mon[94281]: pgmap v5654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:23 smithi082 ceph-mon[94281]: pgmap v5655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:25 smithi082 ceph-mon[94281]: pgmap v5656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:27 smithi082 ceph-mon[94281]: pgmap v5657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:29 smithi082 ceph-mon[94281]: pgmap v5658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:31 smithi082 ceph-mon[94281]: pgmap v5659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:33 smithi082 ceph-mon[94281]: pgmap v5660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:35 smithi082 ceph-mon[94281]: pgmap v5661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:37 smithi082 ceph-mon[94281]: pgmap v5662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:44.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:39 smithi082 ceph-mon[94281]: pgmap v5663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:41 smithi082 ceph-mon[94281]: pgmap v5664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:43 smithi082 ceph-mon[94281]: pgmap v5665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:44 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:45 smithi082 ceph-mon[94281]: pgmap v5666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:45.555 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:45 smithi082 ceph-mon[94281]: pgmap v5667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 851 B/s wr, 9 op/s 2023-03-17T12:21:47.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:45 smithi082 ceph-mon[94281]: pgmap v5668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:21:47.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:47.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:47 smithi082 ceph-mon[94281]: pgmap v5669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:21:47.865 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:49 smithi082 ceph-mon[94281]: pgmap v5670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:51 smithi082 ceph-mon[94281]: pgmap v5671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:53 smithi082 ceph-mon[94281]: pgmap v5672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:55 smithi082 ceph-mon[94281]: pgmap v5673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:57 smithi082 ceph-mon[94281]: pgmap v5674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:37:59 smithi082 ceph-mon[94281]: pgmap v5675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:01 smithi082 ceph-mon[94281]: pgmap v5676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:03 smithi082 ceph-mon[94281]: pgmap v5677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:05 smithi082 ceph-mon[94281]: pgmap v5678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:07 smithi082 ceph-mon[94281]: pgmap v5679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:09 smithi082 ceph-mon[94281]: osdmap e423: 12 total, 12 up, 12 in 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:09 smithi082 ceph-mon[94281]: pgmap v5681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:11 smithi082 ceph-mon[94281]: pgmap v5682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:13 smithi082 ceph-mon[94281]: pgmap v5683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:47.866 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:15 smithi082 ceph-mon[94281]: pgmap v5684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:47.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:17 smithi082 ceph-mon[94281]: pgmap v5685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:47.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:18 smithi082 ceph-mon[94281]: osdmap e424: 12 total, 12 up, 12 in 2023-03-17T12:21:47.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:19 smithi082 ceph-mon[94281]: pgmap v5687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:47.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:21 smithi082 ceph-mon[94281]: pgmap v5688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:21:47.867 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:23 smithi082 ceph-mon[94281]: pgmap v5689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:25 smithi082 ceph-mon[94281]: pgmap v5690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:27 smithi082 ceph-mon[94281]: pgmap v5691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:29 smithi082 ceph-mon[94281]: pgmap v5692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 360 B/s wr, 9 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:31 smithi082 ceph-mon[94281]: pgmap v5693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:33 smithi082 ceph-mon[94281]: pgmap v5694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:35 smithi082 ceph-mon[94281]: pgmap v5695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:37 smithi082 ceph-mon[94281]: pgmap v5696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:50.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:39 smithi082 ceph-mon[94281]: pgmap v5697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:51.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:41 smithi082 ceph-mon[94281]: pgmap v5698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:51.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:43 smithi082 ceph-mon[94281]: pgmap v5699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:21:51.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:45 smithi082 ceph-mon[94281]: pgmap v5700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:21:51.335 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:46 smithi082 ceph-mon[94281]: pgmap v5701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:46 smithi082 ceph-mon[94281]: pgmap v5702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:48 smithi082 ceph-mon[94281]: pgmap v5703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:50 smithi082 ceph-mon[94281]: pgmap v5704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:52 smithi082 ceph-mon[94281]: pgmap v5705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:54 smithi082 ceph-mon[94281]: pgmap v5706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:56 smithi082 ceph-mon[94281]: pgmap v5707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:38:58 smithi082 ceph-mon[94281]: pgmap v5708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:00 smithi082 ceph-mon[94281]: pgmap v5709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:51.336 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:02 smithi082 ceph-mon[94281]: pgmap v5710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:52.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:04 smithi082 ceph-mon[94281]: pgmap v5711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:21:52.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:06 smithi082 ceph-mon[94281]: pgmap v5712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:21:52.051 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:08 smithi082 ceph-mon[94281]: pgmap v5713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:53.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:09 smithi082 ceph-mon[94281]: osdmap e425: 12 total, 12 up, 12 in 2023-03-17T12:21:53.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:10 smithi082 ceph-mon[94281]: pgmap v5715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:53.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:12 smithi082 ceph-mon[94281]: pgmap v5716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:21:53.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:14 smithi082 ceph-mon[94281]: pgmap v5717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:53.205 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:16 smithi082 ceph-mon[94281]: pgmap v5718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:53.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:18 smithi082 ceph-mon[94281]: osdmap e426: 12 total, 12 up, 12 in 2023-03-17T12:21:53.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:18 smithi082 ceph-mon[94281]: pgmap v5720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:21:57.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:20 smithi082 ceph-mon[94281]: pgmap v5721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:57.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:22 smithi082 ceph-mon[94281]: pgmap v5722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:21:57.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:24 smithi082 ceph-mon[94281]: pgmap v5723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:57.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:26 smithi082 ceph-mon[94281]: pgmap v5724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:21:57.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:28 smithi082 ceph-mon[94281]: pgmap v5725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:21:57.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:30 smithi082 ceph-mon[94281]: pgmap v5726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:32 smithi082 ceph-mon[94281]: pgmap v5727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:34 smithi082 ceph-mon[94281]: pgmap v5728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:36 smithi082 ceph-mon[94281]: pgmap v5729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:38 smithi082 ceph-mon[94281]: pgmap v5730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:40 smithi082 ceph-mon[94281]: pgmap v5731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:42 smithi082 ceph-mon[94281]: pgmap v5732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:44 smithi082 ceph-mon[94281]: pgmap v5733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:46 smithi082 ceph-mon[94281]: pgmap v5734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:21:57.630 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:46 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:48 smithi082 ceph-mon[94281]: pgmap v5735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:50 smithi082 ceph-mon[94281]: pgmap v5736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:52 smithi082 ceph-mon[94281]: pgmap v5737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:54 smithi082 ceph-mon[94281]: pgmap v5738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:56 smithi082 ceph-mon[94281]: pgmap v5739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:39:58 smithi082 ceph-mon[94281]: pgmap v5740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T12:21:57.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:00 smithi082 ceph-mon[94281]: pgmap v5741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:02 smithi082 ceph-mon[94281]: pgmap v5742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:04 smithi082 ceph-mon[94281]: pgmap v5743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:07 smithi082 ceph-mon[94281]: pgmap v5744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:09 smithi082 ceph-mon[94281]: pgmap v5745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:10 smithi082 ceph-mon[94281]: osdmap e427: 12 total, 12 up, 12 in 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:11 smithi082 ceph-mon[94281]: pgmap v5747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:13 smithi082 ceph-mon[94281]: pgmap v5748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:21:57.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:15 smithi082 ceph-mon[94281]: pgmap v5749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:21:59.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:17 smithi082 ceph-mon[94281]: pgmap v5750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:21:59.670 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:18 smithi082 ceph-mon[94281]: pgmap v5751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:22:00.539 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:18 smithi082 ceph-mon[94281]: osdmap e428: 12 total, 12 up, 12 in 2023-03-17T12:22:02.292 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:20 smithi082 ceph-mon[94281]: pgmap v5753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:22:02.292 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:22 smithi082 ceph-mon[94281]: pgmap v5754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:22:03.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:24 smithi082 ceph-mon[94281]: pgmap v5755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:22:03.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:26 smithi082 ceph-mon[94281]: pgmap v5756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:22:03.825 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:28 smithi082 ceph-mon[94281]: pgmap v5757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:22:03.826 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:30 smithi082 ceph-mon[94281]: pgmap v5758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 268 B/s wr, 9 op/s 2023-03-17T12:22:03.826 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:32 smithi082 ceph-mon[94281]: pgmap v5759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:04.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:34 smithi082 ceph-mon[94281]: pgmap v5760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:04.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:36 smithi082 ceph-mon[94281]: pgmap v5761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:38 smithi082 ceph-mon[94281]: pgmap v5762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:40 smithi082 ceph-mon[94281]: pgmap v5763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:42 smithi082 ceph-mon[94281]: pgmap v5764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:44 smithi082 ceph-mon[94281]: pgmap v5765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:46 smithi082 ceph-mon[94281]: pgmap v5766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:04.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:47 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:48 smithi082 ceph-mon[94281]: pgmap v5767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:48 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: pgmap v5768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.851 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:04.852 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:05.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:06.841 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:06.842 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:06.842 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:22:09.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:22:09.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:22:09.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:22:09.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:09.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:22:11.149 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:14.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:14.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:14.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:52 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:22:14.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:52 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:22:14.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:52 smithi082 ceph-mon[94281]: pgmap v5769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 257 B/s wr, 8 op/s 2023-03-17T12:22:14.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:52 smithi082 ceph-mon[94281]: pgmap v5770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 310 B/s wr, 10 op/s 2023-03-17T12:22:14.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:54 smithi082 ceph-mon[94281]: pgmap v5771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:14.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:56 smithi082 ceph-mon[94281]: pgmap v5772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:14.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:40:58 smithi082 ceph-mon[94281]: pgmap v5773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:16.300 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:00 smithi082 ceph-mon[94281]: pgmap v5774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:16.300 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:02 smithi082 ceph-mon[94281]: pgmap v5775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:22:16.300 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:04 smithi082 ceph-mon[94281]: pgmap v5776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:22:16.300 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:06 smithi082 ceph-mon[94281]: pgmap v5777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:22:16.300 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:08 smithi082 ceph-mon[94281]: pgmap v5778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:16.300 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:09 smithi082 ceph-mon[94281]: osdmap e429: 12 total, 12 up, 12 in 2023-03-17T12:22:16.301 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:10 smithi082 ceph-mon[94281]: pgmap v5780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:22:18.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:12 smithi082 ceph-mon[94281]: pgmap v5781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:22:18.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:14 smithi082 ceph-mon[94281]: pgmap v5782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:18.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:16 smithi082 ceph-mon[94281]: pgmap v5783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:18.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:18 smithi082 ceph-mon[94281]: pgmap v5784: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:18.016 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:18 smithi082 ceph-mon[94281]: osdmap e430: 12 total, 12 up, 12 in 2023-03-17T12:22:18.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:20 smithi082 ceph-mon[94281]: pgmap v5786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:18.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:22 smithi082 ceph-mon[94281]: pgmap v5787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:18.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:24 smithi082 ceph-mon[94281]: pgmap v5788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:18.614 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:26 smithi082 ceph-mon[94281]: pgmap v5789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:20.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:28 smithi082 ceph-mon[94281]: pgmap v5790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:22:20.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:30 smithi082 ceph-mon[94281]: pgmap v5791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:22:20.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:32 smithi082 ceph-mon[94281]: pgmap v5792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:20.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:34 smithi082 ceph-mon[94281]: pgmap v5793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:20.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:36 smithi082 ceph-mon[94281]: pgmap v5794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:21.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:38 smithi082 ceph-mon[94281]: pgmap v5795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:21.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:40 smithi082 ceph-mon[94281]: pgmap v5796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:21.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:42 smithi082 ceph-mon[94281]: pgmap v5797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:22.629 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:44 smithi082 ceph-mon[94281]: pgmap v5798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:46 smithi082 ceph-mon[94281]: pgmap v5799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:48 smithi082 ceph-mon[94281]: pgmap v5800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:50 smithi082 ceph-mon[94281]: pgmap v5801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:52 smithi082 ceph-mon[94281]: pgmap v5802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:54 smithi082 ceph-mon[94281]: pgmap v5803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:23.658 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:24.880 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:56 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:57 smithi082 ceph-mon[94281]: pgmap v5804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:57 smithi082 ceph-mon[94281]: pgmap v5805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:41:59 smithi082 ceph-mon[94281]: pgmap v5806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:24.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:00 smithi082 ceph-mon[94281]: pgmap v5807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:02 smithi082 ceph-mon[94281]: pgmap v5808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:04 smithi082 ceph-mon[94281]: pgmap v5809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:06 smithi082 ceph-mon[94281]: pgmap v5810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:08 smithi082 ceph-mon[94281]: pgmap v5811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:09 smithi082 ceph-mon[94281]: osdmap e431: 12 total, 12 up, 12 in 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:10 smithi082 ceph-mon[94281]: pgmap v5813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:12 smithi082 ceph-mon[94281]: pgmap v5814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:14 smithi082 ceph-mon[94281]: pgmap v5815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:25.291 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:16 smithi082 ceph-mon[94281]: pgmap v5816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:26.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:18 smithi082 ceph-mon[94281]: pgmap v5817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T12:22:26.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:18 smithi082 ceph-mon[94281]: osdmap e432: 12 total, 12 up, 12 in 2023-03-17T12:22:26.453 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:20 smithi082 ceph-mon[94281]: pgmap v5819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:22 smithi082 ceph-mon[94281]: pgmap v5820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:24 smithi082 ceph-mon[94281]: pgmap v5821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:26 smithi082 ceph-mon[94281]: pgmap v5822: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:28 smithi082 ceph-mon[94281]: pgmap v5823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:30 smithi082 ceph-mon[94281]: pgmap v5824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 8 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:32 smithi082 ceph-mon[94281]: pgmap v5825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2023-03-17T12:22:26.454 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:34 smithi082 ceph-mon[94281]: pgmap v5826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:36 smithi082 ceph-mon[94281]: pgmap v5827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:38 smithi082 ceph-mon[94281]: pgmap v5828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:40 smithi082 ceph-mon[94281]: pgmap v5829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:42 smithi082 ceph-mon[94281]: pgmap v5830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:44 smithi082 ceph-mon[94281]: pgmap v5831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:46 smithi082 ceph-mon[94281]: pgmap v5832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.346 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:48 smithi082 ceph-mon[94281]: pgmap v5833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:50 smithi082 ceph-mon[94281]: pgmap v5834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:52 smithi082 ceph-mon[94281]: pgmap v5835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:54 smithi082 ceph-mon[94281]: pgmap v5836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:56 smithi082 ceph-mon[94281]: pgmap v5837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:58 smithi082 ceph-mon[94281]: pgmap v5838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:59 smithi082 ceph-mon[94281]: pgmap v5839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:59 smithi082 ceph-mon[94281]: pgmap v5840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:42:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:27.347 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:01 smithi082 ceph-mon[94281]: pgmap v5841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:03 smithi082 ceph-mon[94281]: pgmap v5842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:05 smithi082 ceph-mon[94281]: pgmap v5843: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:07 smithi082 ceph-mon[94281]: pgmap v5844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 55 KiB/s wr, 23 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:09 smithi082 ceph-mon[94281]: pgmap v5845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 30 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:09 smithi082 ceph-mon[94281]: osdmap e433: 12 total, 12 up, 12 in 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:11 smithi082 ceph-mon[94281]: pgmap v5847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 30 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:13 smithi082 ceph-mon[94281]: pgmap v5848: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:15 smithi082 ceph-mon[94281]: pgmap v5849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:17 smithi082 ceph-mon[94281]: pgmap v5850: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:17 smithi082 ceph-mon[94281]: osdmap e434: 12 total, 12 up, 12 in 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:19 smithi082 ceph-mon[94281]: pgmap v5852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:21 smithi082 ceph-mon[94281]: pgmap v5853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:23 smithi082 ceph-mon[94281]: pgmap v5854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:25 smithi082 ceph-mon[94281]: pgmap v5855: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:27 smithi082 ceph-mon[94281]: pgmap v5856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:29 smithi082 ceph-mon[94281]: pgmap v5857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 370 B/s wr, 9 op/s 2023-03-17T12:22:27.348 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:31 smithi082 ceph-mon[94281]: pgmap v5858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:33 smithi082 ceph-mon[94281]: pgmap v5859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:35 smithi082 ceph-mon[94281]: pgmap v5860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:37 smithi082 ceph-mon[94281]: pgmap v5861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:39 smithi082 ceph-mon[94281]: pgmap v5862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:41 smithi082 ceph-mon[94281]: pgmap v5863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:43 smithi082 ceph-mon[94281]: pgmap v5864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:45 smithi082 ceph-mon[94281]: pgmap v5865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:47 smithi082 ceph-mon[94281]: pgmap v5866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:49 smithi082 ceph-mon[94281]: pgmap v5867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:51 smithi082 ceph-mon[94281]: pgmap v5868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:53 smithi082 ceph-mon[94281]: pgmap v5869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:55 smithi082 ceph-mon[94281]: pgmap v5870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:57 smithi082 ceph-mon[94281]: pgmap v5871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:59 smithi082 ceph-mon[94281]: pgmap v5872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:43:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:27.349 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:01 smithi082 ceph-mon[94281]: pgmap v5873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:27.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:27.350 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: pgmap v5874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: pgmap v5875: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:05 smithi082 ceph-mon[94281]: pgmap v5876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:07 smithi082 ceph-mon[94281]: pgmap v5877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:09 smithi082 ceph-mon[94281]: pgmap v5878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:22:28.212 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:09 smithi082 ceph-mon[94281]: osdmap e435: 12 total, 12 up, 12 in 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:11 smithi082 ceph-mon[94281]: pgmap v5880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:13 smithi082 ceph-mon[94281]: pgmap v5881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:15 smithi082 ceph-mon[94281]: pgmap v5882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:17 smithi082 ceph-mon[94281]: pgmap v5883: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:17 smithi082 ceph-mon[94281]: osdmap e436: 12 total, 12 up, 12 in 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:19 smithi082 ceph-mon[94281]: pgmap v5885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:21 smithi082 ceph-mon[94281]: pgmap v5886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:23 smithi082 ceph-mon[94281]: pgmap v5887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:25 smithi082 ceph-mon[94281]: pgmap v5888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:27 smithi082 ceph-mon[94281]: pgmap v5889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:29 smithi082 ceph-mon[94281]: pgmap v5890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:22:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:31 smithi082 ceph-mon[94281]: pgmap v5891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:33 smithi082 ceph-mon[94281]: pgmap v5892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:35 smithi082 ceph-mon[94281]: pgmap v5893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:37 smithi082 ceph-mon[94281]: pgmap v5894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:39 smithi082 ceph-mon[94281]: pgmap v5895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:41 smithi082 ceph-mon[94281]: pgmap v5896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:43 smithi082 ceph-mon[94281]: pgmap v5897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:45 smithi082 ceph-mon[94281]: pgmap v5898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:47 smithi082 ceph-mon[94281]: pgmap v5899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:49 smithi082 ceph-mon[94281]: pgmap v5900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:51 smithi082 ceph-mon[94281]: pgmap v5901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:53 smithi082 ceph-mon[94281]: pgmap v5902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:55 smithi082 ceph-mon[94281]: pgmap v5903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:57 smithi082 ceph-mon[94281]: pgmap v5904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:44:59 smithi082 ceph-mon[94281]: pgmap v5905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:01 smithi082 ceph-mon[94281]: pgmap v5906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:03 smithi082 ceph-mon[94281]: pgmap v5907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:04 smithi082 ceph-mon[94281]: pgmap v5908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:22:29.752 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:04 smithi082 ceph-mon[94281]: pgmap v5909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:22:31.194 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:06 smithi082 ceph-mon[94281]: pgmap v5910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:22:31.194 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:08 smithi082 ceph-mon[94281]: pgmap v5911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:22:32.742 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:09 smithi082 ceph-mon[94281]: osdmap e437: 12 total, 12 up, 12 in 2023-03-17T12:22:33.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:10 smithi082 ceph-mon[94281]: pgmap v5913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:22:33.595 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:12 smithi082 ceph-mon[94281]: pgmap v5914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:22:33.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:14 smithi082 ceph-mon[94281]: pgmap v5915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:33.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:16 smithi082 ceph-mon[94281]: pgmap v5916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:33.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:18 smithi082 ceph-mon[94281]: pgmap v5917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:33.596 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:18 smithi082 ceph-mon[94281]: osdmap e438: 12 total, 12 up, 12 in 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:20 smithi082 ceph-mon[94281]: pgmap v5919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:22 smithi082 ceph-mon[94281]: pgmap v5920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:24 smithi082 ceph-mon[94281]: pgmap v5921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:26 smithi082 ceph-mon[94281]: pgmap v5922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:28 smithi082 ceph-mon[94281]: pgmap v5923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:30 smithi082 ceph-mon[94281]: pgmap v5924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:22:34.697 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:32 smithi082 ceph-mon[94281]: pgmap v5925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:35.012 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:34 smithi082 ceph-mon[94281]: pgmap v5926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:36 smithi082 ceph-mon[94281]: pgmap v5927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:38 smithi082 ceph-mon[94281]: pgmap v5928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:40 smithi082 ceph-mon[94281]: pgmap v5929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:42 smithi082 ceph-mon[94281]: pgmap v5930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:44 smithi082 ceph-mon[94281]: pgmap v5931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:46 smithi082 ceph-mon[94281]: pgmap v5932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:22:35.013 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:48 smithi082 ceph-mon[94281]: pgmap v5933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:22:35.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:50 smithi082 ceph-mon[94281]: pgmap v5934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:22:35.014 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:52 smithi082 ceph-mon[94281]: pgmap v5935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:54 smithi082 ceph-mon[94281]: pgmap v5936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:56 smithi082 ceph-mon[94281]: pgmap v5937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:45:58 smithi082 ceph-mon[94281]: pgmap v5938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:00 smithi082 ceph-mon[94281]: pgmap v5939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:02 smithi082 ceph-mon[94281]: pgmap v5940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:04 smithi082 ceph-mon[94281]: pgmap v5941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:38.536 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:05 smithi082 ceph-mon[94281]: pgmap v5942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 26 op/s 2023-03-17T12:22:39.882 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:05 smithi082 ceph-mon[94281]: pgmap v5943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 32 op/s 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:07 smithi082 ceph-mon[94281]: pgmap v5944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:09 smithi082 ceph-mon[94281]: pgmap v5945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 32 op/s 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:09 smithi082 ceph-mon[94281]: osdmap e439: 12 total, 12 up, 12 in 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:11 smithi082 ceph-mon[94281]: pgmap v5947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:13 smithi082 ceph-mon[94281]: pgmap v5948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:15 smithi082 ceph-mon[94281]: pgmap v5949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T12:22:39.883 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:17 smithi082 ceph-mon[94281]: pgmap v5950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T12:22:39.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:17 smithi082 ceph-mon[94281]: osdmap e440: 12 total, 12 up, 12 in 2023-03-17T12:22:41.219 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:19 smithi082 ceph-mon[94281]: pgmap v5952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 109 B/s wr, 11 op/s 2023-03-17T12:22:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:21 smithi082 ceph-mon[94281]: pgmap v5953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:41.220 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:23 smithi082 ceph-mon[94281]: pgmap v5954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:42.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:25 smithi082 ceph-mon[94281]: pgmap v5955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:42.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:27 smithi082 ceph-mon[94281]: pgmap v5956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:42.983 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:29 smithi082 ceph-mon[94281]: pgmap v5957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 392 B/s wr, 10 op/s 2023-03-17T12:22:43.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:31 smithi082 ceph-mon[94281]: pgmap v5958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:22:43.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:33 smithi082 ceph-mon[94281]: pgmap v5959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:22:43.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:35 smithi082 ceph-mon[94281]: pgmap v5960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:37 smithi082 ceph-mon[94281]: pgmap v5961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:39 smithi082 ceph-mon[94281]: pgmap v5962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:41 smithi082 ceph-mon[94281]: pgmap v5963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:43 smithi082 ceph-mon[94281]: pgmap v5964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:45 smithi082 ceph-mon[94281]: pgmap v5965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:47 smithi082 ceph-mon[94281]: pgmap v5966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:49 smithi082 ceph-mon[94281]: pgmap v5967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:43.964 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:51 smithi082 ceph-mon[94281]: pgmap v5968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:46.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:53 smithi082 ceph-mon[94281]: pgmap v5969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:46.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:55 smithi082 ceph-mon[94281]: pgmap v5970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:46.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:46:58 smithi082 ceph-mon[94281]: pgmap v5971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:46.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:00 smithi082 ceph-mon[94281]: pgmap v5972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:48.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:02 smithi082 ceph-mon[94281]: pgmap v5973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:48.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:04 smithi082 ceph-mon[94281]: pgmap v5974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:06 smithi082 ceph-mon[94281]: pgmap v5975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:06 smithi082 ceph-mon[94281]: pgmap v5976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:06 smithi082 ceph-mon[94281]: pgmap v5977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:48.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:08 smithi082 ceph-mon[94281]: pgmap v5978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:10 smithi082 ceph-mon[94281]: pgmap v5979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:10 smithi082 ceph-mon[94281]: osdmap e441: 12 total, 12 up, 12 in 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:11 smithi082 ceph-mon[94281]: pgmap v5981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:13 smithi082 ceph-mon[94281]: pgmap v5982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:16 smithi082 ceph-mon[94281]: pgmap v5983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:18 smithi082 ceph-mon[94281]: pgmap v5984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:18 smithi082 ceph-mon[94281]: osdmap e442: 12 total, 12 up, 12 in 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:19 smithi082 ceph-mon[94281]: pgmap v5986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:22:48.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:22 smithi082 ceph-mon[94281]: pgmap v5987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:22:48.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:23 smithi082 ceph-mon[94281]: pgmap v5988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:48.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:26 smithi082 ceph-mon[94281]: pgmap v5989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:22:48.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:27 smithi082 ceph-mon[94281]: pgmap v5990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:22:48.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:30 smithi082 ceph-mon[94281]: pgmap v5991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:22:50.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:31 smithi082 ceph-mon[94281]: pgmap v5992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:52.815 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:33 smithi082 ceph-mon[94281]: pgmap v5993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:36 smithi082 ceph-mon[94281]: pgmap v5994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:37 smithi082 ceph-mon[94281]: pgmap v5995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:39 smithi082 ceph-mon[94281]: pgmap v5996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:41 smithi082 ceph-mon[94281]: pgmap v5997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:43 smithi082 ceph-mon[94281]: pgmap v5998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:45 smithi082 ceph-mon[94281]: pgmap v5999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:47 smithi082 ceph-mon[94281]: pgmap v6000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:22:52.816 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:49 smithi082 ceph-mon[94281]: pgmap v6001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:52.817 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:51 smithi082 ceph-mon[94281]: pgmap v6002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:55.791 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:53 smithi082 ceph-mon[94281]: pgmap v6003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:55.791 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:55 smithi082 ceph-mon[94281]: pgmap v6004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:55.791 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:57 smithi082 ceph-mon[94281]: pgmap v6005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:55.791 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:47:59 smithi082 ceph-mon[94281]: pgmap v6006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:56.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:01 smithi082 ceph-mon[94281]: pgmap v6007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:56.884 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:03 smithi082 ceph-mon[94281]: pgmap v6008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:22:57.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:04 smithi082 ceph-mon[94281]: osdmap e443: 12 total, 12 up, 12 in 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:05 smithi082 ceph-mon[94281]: pgmap v6010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:06 smithi082 ceph-mon[94281]: pgmap v6011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 26 op/s 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:06 smithi082 ceph-mon[94281]: pgmap v6012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:22:57.716 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:08 smithi082 ceph-mon[94281]: pgmap v6013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 80 KiB/s wr, 41 op/s 2023-03-17T12:22:57.717 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:10 smithi082 ceph-mon[94281]: pgmap v6014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 600 B/s wr, 7 op/s 2023-03-17T12:22:58.381 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:13 smithi082 ceph-mon[94281]: pgmap v6015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 634 B/s wr, 7 op/s 2023-03-17T12:22:58.382 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:13 smithi082 ceph-mon[94281]: osdmap e444: 12 total, 12 up, 12 in 2023-03-17T12:22:58.382 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:15 smithi082 ceph-mon[94281]: pgmap v6017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:22:58.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:16 smithi082 ceph-mon[94281]: daemon mds.d restarted 2023-03-17T12:22:58.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:16 smithi082 ceph-mon[94281]: osdmap e445: 12 total, 12 up, 12 in 2023-03-17T12:22:58.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:17 smithi082 ceph-mon[94281]: pgmap v6019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:22:58.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:17 smithi082 ceph-mon[94281]: mds.? [v2:172.21.15.35:6836/506999199,v1:172.21.15.35:6837/506999199] up:boot 2023-03-17T12:22:58.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:17 smithi082 ceph-mon[94281]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:22:58.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:22:58.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:17 smithi082 ceph-mon[94281]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:22:58.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:18 smithi082 ceph-mon[94281]: pgmap v6020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:22:59.226 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:21 smithi082 ceph-mon[94281]: pgmap v6021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:22:59.464 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:23 smithi082 ceph-mon[94281]: pgmap v6022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 451 B/s wr, 7 op/s 2023-03-17T12:22:59.464 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:25 smithi082 ceph-mon[94281]: pgmap v6023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:22:59.467 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:27 smithi082 ceph-mon[94281]: pgmap v6024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 374 B/s wr, 9 op/s 2023-03-17T12:22:59.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:28 smithi082 ceph-mon[94281]: pgmap v6025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:22:59.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:31 smithi082 ceph-mon[94281]: pgmap v6026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:59.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:33 smithi082 ceph-mon[94281]: pgmap v6027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T12:22:59.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:35 smithi082 ceph-mon[94281]: pgmap v6028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-17T12:22:59.745 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:37 smithi082 ceph-mon[94281]: pgmap v6029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:38 smithi082 ceph-mon[94281]: pgmap v6030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:41 smithi082 ceph-mon[94281]: pgmap v6031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:43 smithi082 ceph-mon[94281]: pgmap v6032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:45 smithi082 ceph-mon[94281]: pgmap v6033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:47 smithi082 ceph-mon[94281]: pgmap v6034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:48 smithi082 ceph-mon[94281]: pgmap v6035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:22:59.746 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:51 smithi082 ceph-mon[94281]: pgmap v6036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:22:59.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:53 smithi082 ceph-mon[94281]: pgmap v6037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:22:59.747 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:55 smithi082 ceph-mon[94281]: pgmap v6038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:23:00.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:57 smithi082 ceph-mon[94281]: pgmap v6039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:48:58 smithi082 ceph-mon[94281]: pgmap v6040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:00.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:01 smithi082 ceph-mon[94281]: pgmap v6041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.087 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:03 smithi082 ceph-mon[94281]: pgmap v6042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 23 KiB/s wr, 12 op/s 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:05 smithi082 ceph-mon[94281]: pgmap v6043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:07 smithi082 ceph-mon[94281]: pgmap v6044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:08 smithi082 ceph-mon[94281]: pgmap v6045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:23:00.088 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:08 smithi082 ceph-mon[94281]: pgmap v6046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:23:00.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:10 smithi082 ceph-mon[94281]: pgmap v6047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:23:00.089 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:10 smithi082 ceph-mon[94281]: osdmap e446: 12 total, 12 up, 12 in 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:12 smithi082 ceph-mon[94281]: pgmap v6049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:14 smithi082 ceph-mon[94281]: pgmap v6050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:16 smithi082 ceph-mon[94281]: pgmap v6051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:18 smithi082 ceph-mon[94281]: pgmap v6052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:18 smithi082 ceph-mon[94281]: osdmap e447: 12 total, 12 up, 12 in 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:20 smithi082 ceph-mon[94281]: pgmap v6054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:22 smithi082 ceph-mon[94281]: pgmap v6055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:24 smithi082 ceph-mon[94281]: pgmap v6056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:26 smithi082 ceph-mon[94281]: pgmap v6057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:28 smithi082 ceph-mon[94281]: pgmap v6058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:30 smithi082 ceph-mon[94281]: pgmap v6059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:32 smithi082 ceph-mon[94281]: pgmap v6060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:34 smithi082 ceph-mon[94281]: pgmap v6061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:00.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:36 smithi082 ceph-mon[94281]: pgmap v6062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:38 smithi082 ceph-mon[94281]: pgmap v6063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:40 smithi082 ceph-mon[94281]: pgmap v6064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:42 smithi082 ceph-mon[94281]: pgmap v6065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:44 smithi082 ceph-mon[94281]: pgmap v6066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:46 smithi082 ceph-mon[94281]: pgmap v6067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:48 smithi082 ceph-mon[94281]: pgmap v6068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:50 smithi082 ceph-mon[94281]: pgmap v6069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:52 smithi082 ceph-mon[94281]: pgmap v6070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:54 smithi082 ceph-mon[94281]: pgmap v6071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:56 smithi082 ceph-mon[94281]: pgmap v6072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:49:58 smithi082 ceph-mon[94281]: pgmap v6073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:00 smithi082 ceph-mon[94281]: pgmap v6074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:23:00.678 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:02 smithi082 ceph-mon[94281]: pgmap v6075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T12:23:00.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:04 smithi082 ceph-mon[94281]: pgmap v6076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:00.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:06 smithi082 ceph-mon[94281]: pgmap v6077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:23:00.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:00.679 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:08 smithi082 ceph-mon[94281]: pgmap v6078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:23:01.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:01.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:01.255 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:01.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:01.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:01.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:09 smithi082 ceph-mon[94281]: pgmap v6079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:23:01.256 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:09 smithi082 ceph-mon[94281]: pgmap v6080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 59 KiB/s wr, 30 op/s 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:10 smithi082 ceph-mon[94281]: osdmap e448: 12 total, 12 up, 12 in 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:11 smithi082 ceph-mon[94281]: pgmap v6082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:13 smithi082 ceph-mon[94281]: pgmap v6083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:13 smithi082 ceph-mon[94281]: osdmap e449: 12 total, 12 up, 12 in 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:15 smithi082 ceph-mon[94281]: pgmap v6085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:17 smithi082 ceph-mon[94281]: pgmap v6086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:18 smithi082 ceph-mon[94281]: pgmap v6087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 114 B/s wr, 11 op/s 2023-03-17T12:23:02.072 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:21 smithi082 ceph-mon[94281]: pgmap v6088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:23 smithi082 ceph-mon[94281]: pgmap v6089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:25 smithi082 ceph-mon[94281]: pgmap v6090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 459 B/s wr, 9 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:27 smithi082 ceph-mon[94281]: pgmap v6091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:28 smithi082 ceph-mon[94281]: pgmap v6092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:31 smithi082 ceph-mon[94281]: pgmap v6093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:33 smithi082 ceph-mon[94281]: pgmap v6094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:35 smithi082 ceph-mon[94281]: pgmap v6095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:02.073 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:37 smithi082 ceph-mon[94281]: pgmap v6096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:02.074 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:38 smithi082 ceph-mon[94281]: pgmap v6097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:41 smithi082 ceph-mon[94281]: pgmap v6098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:43 smithi082 ceph-mon[94281]: pgmap v6099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:45 smithi082 ceph-mon[94281]: pgmap v6100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:47 smithi082 ceph-mon[94281]: pgmap v6101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:48 smithi082 ceph-mon[94281]: pgmap v6102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:51 smithi082 ceph-mon[94281]: pgmap v6103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:03.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:53 smithi082 ceph-mon[94281]: pgmap v6104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:55 smithi082 ceph-mon[94281]: pgmap v6105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:57 smithi082 ceph-mon[94281]: pgmap v6106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:50:58 smithi082 ceph-mon[94281]: pgmap v6107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:01 smithi082 ceph-mon[94281]: pgmap v6108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:03 smithi082 ceph-mon[94281]: pgmap v6109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:05 smithi082 ceph-mon[94281]: pgmap v6110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:07 smithi082 ceph-mon[94281]: pgmap v6111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:03.503 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:08 smithi082 ceph-mon[94281]: pgmap v6112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:08 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:09 smithi082 ceph-mon[94281]: osdmap e450: 12 total, 12 up, 12 in 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:10 smithi082 ceph-mon[94281]: pgmap v6114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: pgmap v6115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.504 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.505 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:14 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:14 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:14 smithi082 ceph-mon[94281]: pgmap v6116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:14 smithi082 ceph-mon[94281]: pgmap v6117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 322 B/s wr, 16 op/s 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:16 smithi082 ceph-mon[94281]: pgmap v6118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 161 B/s wr, 8 op/s 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:18 smithi082 ceph-mon[94281]: pgmap v6119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 136 B/s wr, 6 op/s 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:18 smithi082 ceph-mon[94281]: osdmap e451: 12 total, 12 up, 12 in 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:20 smithi082 ceph-mon[94281]: pgmap v6121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 161 B/s wr, 8 op/s 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:22 smithi082 ceph-mon[94281]: pgmap v6122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:23:03.506 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:24 smithi082 ceph-mon[94281]: pgmap v6123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:03.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:26 smithi082 ceph-mon[94281]: pgmap v6124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:03.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:28 smithi082 ceph-mon[94281]: pgmap v6125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:30 smithi082 ceph-mon[94281]: pgmap v6126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:32 smithi082 ceph-mon[94281]: pgmap v6127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:34 smithi082 ceph-mon[94281]: pgmap v6128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:36 smithi082 ceph-mon[94281]: pgmap v6129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:38 smithi082 ceph-mon[94281]: pgmap v6130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:40 smithi082 ceph-mon[94281]: pgmap v6131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:04.391 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:42 smithi082 ceph-mon[94281]: pgmap v6132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:44 smithi082 ceph-mon[94281]: pgmap v6133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:46 smithi082 ceph-mon[94281]: pgmap v6134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:48 smithi082 ceph-mon[94281]: pgmap v6135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:50 smithi082 ceph-mon[94281]: pgmap v6136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:52 smithi082 ceph-mon[94281]: pgmap v6137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:54 smithi082 ceph-mon[94281]: pgmap v6138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:56 smithi082 ceph-mon[94281]: pgmap v6139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:51:58 smithi082 ceph-mon[94281]: pgmap v6140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.392 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:00 smithi082 ceph-mon[94281]: pgmap v6141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:04.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:02 smithi082 ceph-mon[94281]: pgmap v6142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:04.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:04 smithi082 ceph-mon[94281]: pgmap v6143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:04.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:06 smithi082 ceph-mon[94281]: pgmap v6144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:05.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:08 smithi082 ceph-mon[94281]: pgmap v6145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:10 smithi082 ceph-mon[94281]: pgmap v6146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:10 smithi082 ceph-mon[94281]: osdmap e452: 12 total, 12 up, 12 in 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:12 smithi082 ceph-mon[94281]: pgmap v6148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:14 smithi082 ceph-mon[94281]: pgmap v6149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:06.849 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:06.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:15 smithi082 ceph-mon[94281]: pgmap v6150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:23:06.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:15 smithi082 ceph-mon[94281]: pgmap v6151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:23:06.850 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:16 smithi082 ceph-mon[94281]: pgmap v6152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:23:07.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:18 smithi082 ceph-mon[94281]: pgmap v6153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:18 smithi082 ceph-mon[94281]: osdmap e453: 12 total, 12 up, 12 in 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:20 smithi082 ceph-mon[94281]: pgmap v6155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:22 smithi082 ceph-mon[94281]: pgmap v6156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:24 smithi082 ceph-mon[94281]: pgmap v6157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:26 smithi082 ceph-mon[94281]: pgmap v6158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:28 smithi082 ceph-mon[94281]: pgmap v6159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:23:09.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:30 smithi082 ceph-mon[94281]: pgmap v6160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 361 B/s wr, 9 op/s 2023-03-17T12:23:10.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:32 smithi082 ceph-mon[94281]: pgmap v6161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:23:10.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:34 smithi082 ceph-mon[94281]: pgmap v6162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:23:10.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:36 smithi082 ceph-mon[94281]: pgmap v6163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:38 smithi082 ceph-mon[94281]: pgmap v6164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:40 smithi082 ceph-mon[94281]: pgmap v6165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:42 smithi082 ceph-mon[94281]: pgmap v6166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:44 smithi082 ceph-mon[94281]: pgmap v6167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:46 smithi082 ceph-mon[94281]: pgmap v6168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:48 smithi082 ceph-mon[94281]: pgmap v6169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:50 smithi082 ceph-mon[94281]: pgmap v6170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:52 smithi082 ceph-mon[94281]: pgmap v6171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:54 smithi082 ceph-mon[94281]: pgmap v6172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:56 smithi082 ceph-mon[94281]: pgmap v6173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:52:59 smithi082 ceph-mon[94281]: pgmap v6174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:01 smithi082 ceph-mon[94281]: pgmap v6175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:10.351 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:03 smithi082 ceph-mon[94281]: pgmap v6176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:11.125 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:05 smithi082 ceph-mon[94281]: pgmap v6177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:11.125 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:07 smithi082 ceph-mon[94281]: pgmap v6178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:11.125 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:09 smithi082 ceph-mon[94281]: pgmap v6179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:10 smithi082 ceph-mon[94281]: osdmap e454: 12 total, 12 up, 12 in 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:11 smithi082 ceph-mon[94281]: pgmap v6181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:13 smithi082 ceph-mon[94281]: pgmap v6182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:12.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:15 smithi082 ceph-mon[94281]: pgmap v6183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:12.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:12.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:12.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:12.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:16 smithi082 ceph-mon[94281]: pgmap v6184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:23:13.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:16 smithi082 ceph-mon[94281]: pgmap v6185: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:23:13.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:18 smithi082 ceph-mon[94281]: pgmap v6186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 135 B/s wr, 6 op/s 2023-03-17T12:23:13.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:18 smithi082 ceph-mon[94281]: osdmap e455: 12 total, 12 up, 12 in 2023-03-17T12:23:13.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:20 smithi082 ceph-mon[94281]: pgmap v6188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:23:13.632 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:22 smithi082 ceph-mon[94281]: pgmap v6189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:24 smithi082 ceph-mon[94281]: pgmap v6190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:26 smithi082 ceph-mon[94281]: pgmap v6191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:28 smithi082 ceph-mon[94281]: pgmap v6192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:30 smithi082 ceph-mon[94281]: pgmap v6193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:32 smithi082 ceph-mon[94281]: pgmap v6194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:34 smithi082 ceph-mon[94281]: pgmap v6195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:36 smithi082 ceph-mon[94281]: pgmap v6196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:38 smithi082 ceph-mon[94281]: pgmap v6197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:40 smithi082 ceph-mon[94281]: pgmap v6198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:42 smithi082 ceph-mon[94281]: pgmap v6199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:44 smithi082 ceph-mon[94281]: pgmap v6200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:46 smithi082 ceph-mon[94281]: pgmap v6201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:48 smithi082 ceph-mon[94281]: pgmap v6202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:50 smithi082 ceph-mon[94281]: pgmap v6203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:52 smithi082 ceph-mon[94281]: pgmap v6204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.634 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:54 smithi082 ceph-mon[94281]: pgmap v6205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:13.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:56 smithi082 ceph-mon[94281]: pgmap v6206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:53:58 smithi082 ceph-mon[94281]: pgmap v6207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:00 smithi082 ceph-mon[94281]: pgmap v6208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:13.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:02 smithi082 ceph-mon[94281]: pgmap v6209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:13.635 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:04 smithi082 ceph-mon[94281]: pgmap v6210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:16.522 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:06 smithi082 ceph-mon[94281]: pgmap v6211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:18.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:08 smithi082 ceph-mon[94281]: pgmap v6212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:18.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:10 smithi082 ceph-mon[94281]: pgmap v6213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:18.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:10 smithi082 ceph-mon[94281]: osdmap e456: 12 total, 12 up, 12 in 2023-03-17T12:23:18.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:12 smithi082 ceph-mon[94281]: pgmap v6215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:18.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:14 smithi082 ceph-mon[94281]: pgmap v6216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:18.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:20.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:16 smithi082 ceph-mon[94281]: pgmap v6217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:20.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:20.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:20.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:20.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:17 smithi082 ceph-mon[94281]: pgmap v6218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:23:20.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:17 smithi082 ceph-mon[94281]: pgmap v6219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:20.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:18 smithi082 ceph-mon[94281]: pgmap v6220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-17T12:23:20.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:18 smithi082 ceph-mon[94281]: osdmap e457: 12 total, 12 up, 12 in 2023-03-17T12:23:20.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:20 smithi082 ceph-mon[94281]: pgmap v6222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:20.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:22 smithi082 ceph-mon[94281]: pgmap v6223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:20.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:24 smithi082 ceph-mon[94281]: pgmap v6224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:23:20.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:26 smithi082 ceph-mon[94281]: pgmap v6225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:20.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:28 smithi082 ceph-mon[94281]: pgmap v6226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:20.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:30 smithi082 ceph-mon[94281]: pgmap v6227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:23:21.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:32 smithi082 ceph-mon[94281]: pgmap v6228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:21.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:34 smithi082 ceph-mon[94281]: pgmap v6229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:21.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:36 smithi082 ceph-mon[94281]: pgmap v6230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:21.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:39 smithi082 ceph-mon[94281]: pgmap v6231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:21.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:41 smithi082 ceph-mon[94281]: pgmap v6232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:43 smithi082 ceph-mon[94281]: pgmap v6233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.254 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:45 smithi082 ceph-mon[94281]: pgmap v6234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:47 smithi082 ceph-mon[94281]: pgmap v6235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:49 smithi082 ceph-mon[94281]: pgmap v6236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:51 smithi082 ceph-mon[94281]: pgmap v6237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:53 smithi082 ceph-mon[94281]: pgmap v6238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:55 smithi082 ceph-mon[94281]: pgmap v6239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:57 smithi082 ceph-mon[94281]: pgmap v6240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:54:59 smithi082 ceph-mon[94281]: pgmap v6241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:24.873 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:01 smithi082 ceph-mon[94281]: pgmap v6242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:03 smithi082 ceph-mon[94281]: pgmap v6243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:05 smithi082 ceph-mon[94281]: pgmap v6244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:07 smithi082 ceph-mon[94281]: pgmap v6245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:09 smithi082 ceph-mon[94281]: pgmap v6246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:10 smithi082 ceph-mon[94281]: osdmap e458: 12 total, 12 up, 12 in 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:11 smithi082 ceph-mon[94281]: pgmap v6248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:13 smithi082 ceph-mon[94281]: pgmap v6249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:15 smithi082 ceph-mon[94281]: pgmap v6250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:17 smithi082 ceph-mon[94281]: pgmap v6251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:18 smithi082 ceph-mon[94281]: pgmap v6252: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 115 B/s wr, 5 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:18 smithi082 ceph-mon[94281]: pgmap v6253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:18 smithi082 ceph-mon[94281]: osdmap e459: 12 total, 12 up, 12 in 2023-03-17T12:23:24.874 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:20 smithi082 ceph-mon[94281]: pgmap v6255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:22 smithi082 ceph-mon[94281]: pgmap v6256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:24 smithi082 ceph-mon[94281]: pgmap v6257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:26 smithi082 ceph-mon[94281]: pgmap v6258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:28 smithi082 ceph-mon[94281]: pgmap v6259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:30 smithi082 ceph-mon[94281]: pgmap v6260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:32 smithi082 ceph-mon[94281]: pgmap v6261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:34 smithi082 ceph-mon[94281]: pgmap v6262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:36 smithi082 ceph-mon[94281]: pgmap v6263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:38 smithi082 ceph-mon[94281]: pgmap v6264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:40 smithi082 ceph-mon[94281]: pgmap v6265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:24.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:42 smithi082 ceph-mon[94281]: pgmap v6266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:44 smithi082 ceph-mon[94281]: pgmap v6267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:26.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:46 smithi082 ceph-mon[94281]: pgmap v6268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:48 smithi082 ceph-mon[94281]: pgmap v6269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:50 smithi082 ceph-mon[94281]: pgmap v6270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:26.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:52 smithi082 ceph-mon[94281]: pgmap v6271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:54 smithi082 ceph-mon[94281]: pgmap v6272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:26.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:56 smithi082 ceph-mon[94281]: pgmap v6273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:55:58 smithi082 ceph-mon[94281]: pgmap v6274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.951 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:00 smithi082 ceph-mon[94281]: pgmap v6275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:26.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:02 smithi082 ceph-mon[94281]: pgmap v6276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:26.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:04 smithi082 ceph-mon[94281]: pgmap v6277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:26.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:06 smithi082 ceph-mon[94281]: pgmap v6278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:26.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:08 smithi082 ceph-mon[94281]: pgmap v6279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:29.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:10 smithi082 ceph-mon[94281]: pgmap v6280: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:29.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:10 smithi082 ceph-mon[94281]: osdmap e460: 12 total, 12 up, 12 in 2023-03-17T12:23:29.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:12 smithi082 ceph-mon[94281]: pgmap v6282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:14 smithi082 ceph-mon[94281]: pgmap v6283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:16 smithi082 ceph-mon[94281]: pgmap v6284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:18 smithi082 ceph-mon[94281]: pgmap v6285: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:18 smithi082 ceph-mon[94281]: pgmap v6286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:18 smithi082 ceph-mon[94281]: pgmap v6287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 259 B/s wr, 13 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:18 smithi082 ceph-mon[94281]: osdmap e461: 12 total, 12 up, 12 in 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:20 smithi082 ceph-mon[94281]: pgmap v6289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:29.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:22 smithi082 ceph-mon[94281]: pgmap v6290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:29.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:24 smithi082 ceph-mon[94281]: pgmap v6291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:23:29.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:26 smithi082 ceph-mon[94281]: pgmap v6292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:28 smithi082 ceph-mon[94281]: pgmap v6293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:30 smithi082 ceph-mon[94281]: pgmap v6294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:32 smithi082 ceph-mon[94281]: pgmap v6295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:34 smithi082 ceph-mon[94281]: pgmap v6296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:36 smithi082 ceph-mon[94281]: pgmap v6297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:38 smithi082 ceph-mon[94281]: pgmap v6298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:30.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:40 smithi082 ceph-mon[94281]: pgmap v6299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:23:31.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:42 smithi082 ceph-mon[94281]: pgmap v6300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:23:31.599 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:44 smithi082 ceph-mon[94281]: pgmap v6301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:32.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:46 smithi082 ceph-mon[94281]: pgmap v6302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:32.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:48 smithi082 ceph-mon[94281]: pgmap v6303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:32.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:50 smithi082 ceph-mon[94281]: pgmap v6304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:32.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:52 smithi082 ceph-mon[94281]: pgmap v6305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:32.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:54 smithi082 ceph-mon[94281]: pgmap v6306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:32.156 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:56 smithi082 ceph-mon[94281]: pgmap v6307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:32.157 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:56:58 smithi082 ceph-mon[94281]: pgmap v6308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:33.417 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:00 smithi082 ceph-mon[94281]: pgmap v6309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:33.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:02 smithi082 ceph-mon[94281]: pgmap v6310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:33.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:04 smithi082 ceph-mon[94281]: pgmap v6311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:34.810 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:06 smithi082 ceph-mon[94281]: pgmap v6312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:34.811 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:08 smithi082 ceph-mon[94281]: pgmap v6313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:34.811 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:10 smithi082 ceph-mon[94281]: pgmap v6314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:23:34.811 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:10 smithi082 ceph-mon[94281]: osdmap e462: 12 total, 12 up, 12 in 2023-03-17T12:23:34.811 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:12 smithi082 ceph-mon[94281]: pgmap v6316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:34.811 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:14 smithi082 ceph-mon[94281]: pgmap v6317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:16 smithi082 ceph-mon[94281]: pgmap v6318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:18 smithi082 ceph-mon[94281]: pgmap v6319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:18 smithi082 ceph-mon[94281]: osdmap e463: 12 total, 12 up, 12 in 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:19 smithi082 ceph-mon[94281]: pgmap v6320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:19 smithi082 ceph-mon[94281]: pgmap v6321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:21 smithi082 ceph-mon[94281]: pgmap v6323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:23 smithi082 ceph-mon[94281]: pgmap v6324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:25 smithi082 ceph-mon[94281]: pgmap v6325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-03-17T12:23:35.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:27 smithi082 ceph-mon[94281]: pgmap v6326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:29 smithi082 ceph-mon[94281]: pgmap v6327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:31 smithi082 ceph-mon[94281]: pgmap v6328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:33 smithi082 ceph-mon[94281]: pgmap v6329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:35 smithi082 ceph-mon[94281]: pgmap v6330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:37 smithi082 ceph-mon[94281]: pgmap v6331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:39 smithi082 ceph-mon[94281]: pgmap v6332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:41 smithi082 ceph-mon[94281]: pgmap v6333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:43 smithi082 ceph-mon[94281]: pgmap v6334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:45 smithi082 ceph-mon[94281]: pgmap v6335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:47 smithi082 ceph-mon[94281]: pgmap v6336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:49 smithi082 ceph-mon[94281]: pgmap v6337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:51 smithi082 ceph-mon[94281]: pgmap v6338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:53 smithi082 ceph-mon[94281]: pgmap v6339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:55 smithi082 ceph-mon[94281]: pgmap v6340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:57 smithi082 ceph-mon[94281]: pgmap v6341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:57:59 smithi082 ceph-mon[94281]: pgmap v6342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.906 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:01 smithi082 ceph-mon[94281]: pgmap v6343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:03 smithi082 ceph-mon[94281]: pgmap v6344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:05 smithi082 ceph-mon[94281]: pgmap v6345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:07 smithi082 ceph-mon[94281]: pgmap v6346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:09 smithi082 ceph-mon[94281]: pgmap v6347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:10 smithi082 ceph-mon[94281]: osdmap e464: 12 total, 12 up, 12 in 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:11 smithi082 ceph-mon[94281]: pgmap v6349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:13 smithi082 ceph-mon[94281]: pgmap v6350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:15 smithi082 ceph-mon[94281]: pgmap v6351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:17 smithi082 ceph-mon[94281]: pgmap v6352: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:18 smithi082 ceph-mon[94281]: osdmap e465: 12 total, 12 up, 12 in 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:19 smithi082 ceph-mon[94281]: pgmap v6353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:20 smithi082 ceph-mon[94281]: pgmap v6355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:20 smithi082 ceph-mon[94281]: pgmap v6356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:23:36.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:21 smithi082 ceph-mon[94281]: pgmap v6357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:24 smithi082 ceph-mon[94281]: pgmap v6358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:26 smithi082 ceph-mon[94281]: pgmap v6359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:28 smithi082 ceph-mon[94281]: pgmap v6360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:30 smithi082 ceph-mon[94281]: pgmap v6361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:32 smithi082 ceph-mon[94281]: pgmap v6362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:34 smithi082 ceph-mon[94281]: pgmap v6363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:36 smithi082 ceph-mon[94281]: pgmap v6364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:38 smithi082 ceph-mon[94281]: pgmap v6365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:40 smithi082 ceph-mon[94281]: pgmap v6366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:42 smithi082 ceph-mon[94281]: pgmap v6367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:44 smithi082 ceph-mon[94281]: pgmap v6368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:46 smithi082 ceph-mon[94281]: pgmap v6369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:48 smithi082 ceph-mon[94281]: pgmap v6370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:50 smithi082 ceph-mon[94281]: pgmap v6371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:52 smithi082 ceph-mon[94281]: pgmap v6372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:54 smithi082 ceph-mon[94281]: pgmap v6373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:56 smithi082 ceph-mon[94281]: pgmap v6374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:58:58 smithi082 ceph-mon[94281]: pgmap v6375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:00 smithi082 ceph-mon[94281]: pgmap v6376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:02 smithi082 ceph-mon[94281]: pgmap v6377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:04 smithi082 ceph-mon[94281]: pgmap v6378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:06 smithi082 ceph-mon[94281]: pgmap v6379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:08 smithi082 ceph-mon[94281]: pgmap v6380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:10 smithi082 ceph-mon[94281]: pgmap v6381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:10 smithi082 ceph-mon[94281]: osdmap e466: 12 total, 12 up, 12 in 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:12 smithi082 ceph-mon[94281]: pgmap v6383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:14 smithi082 ceph-mon[94281]: pgmap v6384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:16 smithi082 ceph-mon[94281]: pgmap v6385: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:18 smithi082 ceph-mon[94281]: pgmap v6386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:18 smithi082 ceph-mon[94281]: osdmap e467: 12 total, 12 up, 12 in 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:20 smithi082 ceph-mon[94281]: pgmap v6388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:23:36.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:36.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:36.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:36.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:21 smithi082 ceph-mon[94281]: pgmap v6389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:23:36.910 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:21 smithi082 ceph-mon[94281]: pgmap v6390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:23 smithi082 ceph-mon[94281]: pgmap v6391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:25 smithi082 ceph-mon[94281]: pgmap v6392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:27 smithi082 ceph-mon[94281]: pgmap v6393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:29 smithi082 ceph-mon[94281]: pgmap v6394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:31 smithi082 ceph-mon[94281]: pgmap v6395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:33 smithi082 ceph-mon[94281]: pgmap v6396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:23:38.609 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:35 smithi082 ceph-mon[94281]: pgmap v6397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:37 smithi082 ceph-mon[94281]: pgmap v6398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:39 smithi082 ceph-mon[94281]: pgmap v6399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:41 smithi082 ceph-mon[94281]: pgmap v6400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:43 smithi082 ceph-mon[94281]: pgmap v6401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:45 smithi082 ceph-mon[94281]: pgmap v6402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:47 smithi082 ceph-mon[94281]: pgmap v6403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:38.610 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:49 smithi082 ceph-mon[94281]: pgmap v6404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:51 smithi082 ceph-mon[94281]: pgmap v6405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:53 smithi082 ceph-mon[94281]: pgmap v6406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:55 smithi082 ceph-mon[94281]: pgmap v6407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:38.611 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:57 smithi082 ceph-mon[94281]: pgmap v6408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 11:59:59 smithi082 ceph-mon[94281]: pgmap v6409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:01 smithi082 ceph-mon[94281]: pgmap v6410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:03 smithi082 ceph-mon[94281]: pgmap v6411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:05 smithi082 ceph-mon[94281]: pgmap v6412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:07 smithi082 ceph-mon[94281]: pgmap v6413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:40.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:09 smithi082 ceph-mon[94281]: pgmap v6414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:10 smithi082 ceph-mon[94281]: osdmap e468: 12 total, 12 up, 12 in 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:11 smithi082 ceph-mon[94281]: pgmap v6416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:13 smithi082 ceph-mon[94281]: pgmap v6417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:15 smithi082 ceph-mon[94281]: pgmap v6418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:17 smithi082 ceph-mon[94281]: pgmap v6419: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:19 smithi082 ceph-mon[94281]: pgmap v6420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:19 smithi082 ceph-mon[94281]: osdmap e469: 12 total, 12 up, 12 in 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:21 smithi082 ceph-mon[94281]: pgmap v6422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:40.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:41.626 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:41.626 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:41.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:41.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:41.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:22 smithi082 ceph-mon[94281]: pgmap v6423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:23:41.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:22 smithi082 ceph-mon[94281]: pgmap v6424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 143 B/s wr, 7 op/s 2023-03-17T12:23:41.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:24 smithi082 ceph-mon[94281]: pgmap v6425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 143 B/s wr, 14 op/s 2023-03-17T12:23:41.627 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:26 smithi082 ceph-mon[94281]: pgmap v6426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-03-17T12:23:42.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:28 smithi082 ceph-mon[94281]: pgmap v6427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:23:42.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:30 smithi082 ceph-mon[94281]: pgmap v6428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:23:42.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:32 smithi082 ceph-mon[94281]: pgmap v6429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:42.637 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:34 smithi082 ceph-mon[94281]: pgmap v6430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:36 smithi082 ceph-mon[94281]: pgmap v6431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:38 smithi082 ceph-mon[94281]: pgmap v6432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:40 smithi082 ceph-mon[94281]: pgmap v6433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:42 smithi082 ceph-mon[94281]: pgmap v6434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:44 smithi082 ceph-mon[94281]: pgmap v6435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:46 smithi082 ceph-mon[94281]: pgmap v6436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:48 smithi082 ceph-mon[94281]: pgmap v6437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:50 smithi082 ceph-mon[94281]: pgmap v6438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:52 smithi082 ceph-mon[94281]: pgmap v6439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:54 smithi082 ceph-mon[94281]: pgmap v6440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:56 smithi082 ceph-mon[94281]: pgmap v6441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:00:58 smithi082 ceph-mon[94281]: pgmap v6442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:00 smithi082 ceph-mon[94281]: pgmap v6443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:43.624 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:02 smithi082 ceph-mon[94281]: pgmap v6444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:04 smithi082 ceph-mon[94281]: pgmap v6445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:06 smithi082 ceph-mon[94281]: pgmap v6446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:08 smithi082 ceph-mon[94281]: pgmap v6447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:10 smithi082 ceph-mon[94281]: pgmap v6448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:10 smithi082 ceph-mon[94281]: osdmap e470: 12 total, 12 up, 12 in 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:12 smithi082 ceph-mon[94281]: pgmap v6450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:14 smithi082 ceph-mon[94281]: pgmap v6451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:43.625 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:16 smithi082 ceph-mon[94281]: pgmap v6452: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:44.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:18 smithi082 ceph-mon[94281]: pgmap v6453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:44.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:18 smithi082 ceph-mon[94281]: osdmap e471: 12 total, 12 up, 12 in 2023-03-17T12:23:44.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:20 smithi082 ceph-mon[94281]: pgmap v6455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-17T12:23:44.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:21 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:44.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:22 smithi082 ceph-mon[94281]: pgmap v6456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:44.671 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:22 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: pgmap v6457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:24 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:46.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:46.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:46.963 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:48.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:48.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:48.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:48.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:48.715 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:49.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:49.988 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:23:49.989 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:23:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: pgmap v6458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:23:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:26 smithi082 ceph-mon[94281]: pgmap v6459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 129 B/s wr, 12 op/s 2023-03-17T12:23:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:27 smithi082 ceph-mon[94281]: pgmap v6460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:23:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:30 smithi082 ceph-mon[94281]: pgmap v6461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:23:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:32 smithi082 ceph-mon[94281]: pgmap v6462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:23:51.161 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:34 smithi082 ceph-mon[94281]: pgmap v6463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:36 smithi082 ceph-mon[94281]: pgmap v6464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:38 smithi082 ceph-mon[94281]: pgmap v6465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:40 smithi082 ceph-mon[94281]: pgmap v6466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:42 smithi082 ceph-mon[94281]: pgmap v6467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:44 smithi082 ceph-mon[94281]: pgmap v6468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:46 smithi082 ceph-mon[94281]: pgmap v6469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:48 smithi082 ceph-mon[94281]: pgmap v6470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:50 smithi082 ceph-mon[94281]: pgmap v6471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:52 smithi082 ceph-mon[94281]: pgmap v6472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:54 smithi082 ceph-mon[94281]: pgmap v6473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:56 smithi082 ceph-mon[94281]: pgmap v6474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:01:58 smithi082 ceph-mon[94281]: pgmap v6475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:00 smithi082 ceph-mon[94281]: pgmap v6476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:02 smithi082 ceph-mon[94281]: pgmap v6477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:04 smithi082 ceph-mon[94281]: pgmap v6478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:06 smithi082 ceph-mon[94281]: pgmap v6479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:51.162 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:08 smithi082 ceph-mon[94281]: pgmap v6480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:51.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:10 smithi082 ceph-mon[94281]: pgmap v6481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:51.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:10 smithi082 ceph-mon[94281]: osdmap e472: 12 total, 12 up, 12 in 2023-03-17T12:23:51.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:12 smithi082 ceph-mon[94281]: pgmap v6483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:51.163 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:14 smithi082 ceph-mon[94281]: pgmap v6484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:16 smithi082 ceph-mon[94281]: pgmap v6485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:18 smithi082 ceph-mon[94281]: pgmap v6486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:18 smithi082 ceph-mon[94281]: osdmap e473: 12 total, 12 up, 12 in 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:20 smithi082 ceph-mon[94281]: pgmap v6488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:22 smithi082 ceph-mon[94281]: pgmap v6489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:24 smithi082 ceph-mon[94281]: pgmap v6490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:25 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:26 smithi082 ceph-mon[94281]: pgmap v6491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:52.248 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:27 smithi082 ceph-mon[94281]: pgmap v6492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:27 smithi082 ceph-mon[94281]: pgmap v6493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:29 smithi082 ceph-mon[94281]: pgmap v6494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:31 smithi082 ceph-mon[94281]: pgmap v6495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:33 smithi082 ceph-mon[94281]: pgmap v6496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:35 smithi082 ceph-mon[94281]: pgmap v6497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:37 smithi082 ceph-mon[94281]: pgmap v6498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:39 smithi082 ceph-mon[94281]: pgmap v6499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:41 smithi082 ceph-mon[94281]: pgmap v6500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:43 smithi082 ceph-mon[94281]: pgmap v6501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:45 smithi082 ceph-mon[94281]: pgmap v6502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:47 smithi082 ceph-mon[94281]: pgmap v6503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:49 smithi082 ceph-mon[94281]: pgmap v6504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:51 smithi082 ceph-mon[94281]: pgmap v6505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:53 smithi082 ceph-mon[94281]: pgmap v6506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:55 smithi082 ceph-mon[94281]: pgmap v6507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:52.249 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:57 smithi082 ceph-mon[94281]: pgmap v6508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:52.250 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:02:59 smithi082 ceph-mon[94281]: pgmap v6509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:53.417 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:01 smithi082 ceph-mon[94281]: pgmap v6510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:53.417 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:03 smithi082 ceph-mon[94281]: pgmap v6511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:53.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:05 smithi082 ceph-mon[94281]: pgmap v6512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:53.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:07 smithi082 ceph-mon[94281]: pgmap v6513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:53.418 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:09 smithi082 ceph-mon[94281]: pgmap v6514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:54.388 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:10 smithi082 ceph-mon[94281]: osdmap e474: 12 total, 12 up, 12 in 2023-03-17T12:23:54.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:11 smithi082 ceph-mon[94281]: pgmap v6516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:54.389 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:13 smithi082 ceph-mon[94281]: pgmap v6517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:55.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:15 smithi082 ceph-mon[94281]: pgmap v6518: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:55.245 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:17 smithi082 ceph-mon[94281]: pgmap v6519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:56.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:19 smithi082 ceph-mon[94281]: pgmap v6520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:58.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:19 smithi082 ceph-mon[94281]: osdmap e475: 12 total, 12 up, 12 in 2023-03-17T12:23:58.043 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:21 smithi082 ceph-mon[94281]: pgmap v6522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:58.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:23 smithi082 ceph-mon[94281]: pgmap v6523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:58.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:25 smithi082 ceph-mon[94281]: pgmap v6524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:58.044 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:26 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:27 smithi082 ceph-mon[94281]: pgmap v6525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:23:59.294 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:28 smithi082 ceph-mon[94281]: pgmap v6526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:28 smithi082 ceph-mon[94281]: pgmap v6527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:30 smithi082 ceph-mon[94281]: pgmap v6528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:32 smithi082 ceph-mon[94281]: pgmap v6529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:34 smithi082 ceph-mon[94281]: pgmap v6530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:35 smithi082 ceph-mon[94281]: from='client.? 172.21.15.35:0/1170454406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:36 smithi082 ceph-mon[94281]: pgmap v6531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:38 smithi082 ceph-mon[94281]: pgmap v6532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:40 smithi082 ceph-mon[94281]: pgmap v6533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:42 smithi082 ceph-mon[94281]: pgmap v6534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:44 smithi082 ceph-mon[94281]: pgmap v6535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:46 smithi082 ceph-mon[94281]: pgmap v6536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:48 smithi082 ceph-mon[94281]: pgmap v6537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:50 smithi082 ceph-mon[94281]: pgmap v6538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:52 smithi082 ceph-mon[94281]: pgmap v6539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:54 smithi082 ceph-mon[94281]: pgmap v6540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:56 smithi082 ceph-mon[94281]: pgmap v6541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:59.295 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:03:58 smithi082 ceph-mon[94281]: pgmap v6542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:00 smithi082 ceph-mon[94281]: pgmap v6543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:02 smithi082 ceph-mon[94281]: pgmap v6544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:04 smithi082 ceph-mon[94281]: pgmap v6545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:06 smithi082 ceph-mon[94281]: pgmap v6546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:08 smithi082 ceph-mon[94281]: pgmap v6547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:10 smithi082 ceph-mon[94281]: pgmap v6548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:10 smithi082 ceph-mon[94281]: osdmap e476: 12 total, 12 up, 12 in 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:12 smithi082 ceph-mon[94281]: pgmap v6550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:14 smithi082 ceph-mon[94281]: pgmap v6551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:16 smithi082 ceph-mon[94281]: pgmap v6552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:18 smithi082 ceph-mon[94281]: pgmap v6553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:18 smithi082 ceph-mon[94281]: osdmap e477: 12 total, 12 up, 12 in 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:20 smithi082 ceph-mon[94281]: pgmap v6555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:22 smithi082 ceph-mon[94281]: pgmap v6556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:24 smithi082 ceph-mon[94281]: pgmap v6557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:26 smithi082 ceph-mon[94281]: pgmap v6558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:27 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:23:59.296 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:28 smithi082 ceph-mon[94281]: pgmap v6559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:23:59.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:23:59.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:23:59.297 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:29 smithi082 ceph-mon[94281]: pgmap v6560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:29 smithi082 ceph-mon[94281]: pgmap v6561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:31 smithi082 ceph-mon[94281]: pgmap v6562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:33 smithi082 ceph-mon[94281]: pgmap v6563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:35 smithi082 ceph-mon[94281]: pgmap v6564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:37 smithi082 ceph-mon[94281]: pgmap v6565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:39 smithi082 ceph-mon[94281]: pgmap v6566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:41 smithi082 ceph-mon[94281]: pgmap v6567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:43 smithi082 ceph-mon[94281]: pgmap v6568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:01.057 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:45 smithi082 ceph-mon[94281]: pgmap v6569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:02.633 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:47 smithi082 ceph-mon[94281]: pgmap v6570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:03.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:49 smithi082 ceph-mon[94281]: pgmap v6571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:03.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:51 smithi082 ceph-mon[94281]: pgmap v6572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:03.534 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:53 smithi082 ceph-mon[94281]: pgmap v6573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:04.099 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:55 smithi082 ceph-mon[94281]: pgmap v6574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:04.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:57 smithi082 ceph-mon[94281]: pgmap v6575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:04.100 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:04:59 smithi082 ceph-mon[94281]: pgmap v6576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:05.108 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:01 smithi082 ceph-mon[94281]: pgmap v6577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:05.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:03 smithi082 ceph-mon[94281]: pgmap v6578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:05.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:05 smithi082 ceph-mon[94281]: pgmap v6579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:05.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:07 smithi082 ceph-mon[94281]: pgmap v6580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:24:05.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:09 smithi082 ceph-mon[94281]: pgmap v6581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:24:05.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:10 smithi082 ceph-mon[94281]: osdmap e478: 12 total, 12 up, 12 in 2023-03-17T12:24:05.620 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:11 smithi082 ceph-mon[94281]: pgmap v6583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:13 smithi082 ceph-mon[94281]: pgmap v6584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:14 smithi082 ceph-mon[94281]: pgmap v6585: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:16 smithi082 ceph-mon[94281]: pgmap v6586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:19 smithi082 ceph-mon[94281]: pgmap v6587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:19 smithi082 ceph-mon[94281]: osdmap e479: 12 total, 12 up, 12 in 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:21 smithi082 ceph-mon[94281]: pgmap v6589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:23 smithi082 ceph-mon[94281]: pgmap v6590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:24 smithi082 ceph-mon[94281]: from='client.22611 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:25 smithi082 ceph-mon[94281]: pgmap v6591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:05.621 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:27 smithi082 ceph-mon[94281]: pgmap v6592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:07.451 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:28 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:24:08.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:29 smithi082 ceph-mon[94281]: pgmap v6593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 11 op/s 2023-03-17T12:24:08.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:30 smithi082 ceph-mon[94281]: pgmap v6594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:30 smithi082 ceph-mon[94281]: pgmap v6595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:32 smithi082 ceph-mon[94281]: pgmap v6596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:34 smithi082 ceph-mon[94281]: pgmap v6597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:36 smithi082 ceph-mon[94281]: pgmap v6598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:38 smithi082 ceph-mon[94281]: pgmap v6599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:40 smithi082 ceph-mon[94281]: pgmap v6600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:24:10.674 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:42 smithi082 ceph-mon[94281]: pgmap v6601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:44 smithi082 ceph-mon[94281]: pgmap v6602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:46 smithi082 ceph-mon[94281]: pgmap v6603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:48 smithi082 ceph-mon[94281]: pgmap v6604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:50 smithi082 ceph-mon[94281]: pgmap v6605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:52 smithi082 ceph-mon[94281]: pgmap v6606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:54 smithi082 ceph-mon[94281]: pgmap v6607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:11.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:56 smithi082 ceph-mon[94281]: pgmap v6608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:57 smithi082 ceph-mon[94281]: from='client.22635 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:05:58 smithi082 ceph-mon[94281]: pgmap v6609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:00 smithi082 ceph-mon[94281]: pgmap v6610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:02 smithi082 ceph-mon[94281]: pgmap v6611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:04 smithi082 ceph-mon[94281]: pgmap v6612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:06 smithi082 ceph-mon[94281]: pgmap v6613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:08 smithi082 ceph-mon[94281]: pgmap v6614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:10 smithi082 ceph-mon[94281]: pgmap v6615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:10 smithi082 ceph-mon[94281]: osdmap e480: 12 total, 12 up, 12 in 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:12 smithi082 ceph-mon[94281]: pgmap v6617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:14 smithi082 ceph-mon[94281]: pgmap v6618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:16 smithi082 ceph-mon[94281]: pgmap v6619: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:18 smithi082 ceph-mon[94281]: pgmap v6620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:18 smithi082 ceph-mon[94281]: osdmap e481: 12 total, 12 up, 12 in 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:20 smithi082 ceph-mon[94281]: pgmap v6622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-17T12:24:11.887 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:22 smithi082 ceph-mon[94281]: pgmap v6623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:11.888 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:24 smithi082 ceph-mon[94281]: pgmap v6624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:14.181 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:26 smithi082 ceph-mon[94281]: pgmap v6625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:14.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:28 smithi082 ceph-mon[94281]: pgmap v6626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:14.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:29 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:24:14.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:30 smithi082 ceph-mon[94281]: pgmap v6627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:24:14.875 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:30 smithi082 ceph-mon[94281]: pgmap v6628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:30 smithi082 ceph-mon[94281]: pgmap v6629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:31 smithi082 ceph-mon[94281]: pgmap v6630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:34 smithi082 ceph-mon[94281]: pgmap v6631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:35 smithi082 ceph-mon[94281]: pgmap v6632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:37 smithi082 ceph-mon[94281]: pgmap v6633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:39 smithi082 ceph-mon[94281]: pgmap v6634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:41 smithi082 ceph-mon[94281]: pgmap v6635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:44 smithi082 ceph-mon[94281]: pgmap v6636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:45 smithi082 ceph-mon[94281]: pgmap v6637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:47 smithi082 ceph-mon[94281]: pgmap v6638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:49 smithi082 ceph-mon[94281]: pgmap v6639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:51 smithi082 ceph-mon[94281]: pgmap v6640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:54 smithi082 ceph-mon[94281]: pgmap v6641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:55 smithi082 ceph-mon[94281]: pgmap v6642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:14.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:57 smithi082 ceph-mon[94281]: pgmap v6643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:06:59 smithi082 ceph-mon[94281]: pgmap v6644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:01 smithi082 ceph-mon[94281]: pgmap v6645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:04 smithi082 ceph-mon[94281]: pgmap v6646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:05 smithi082 ceph-mon[94281]: pgmap v6647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:07 smithi082 ceph-mon[94281]: pgmap v6648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:10 smithi082 ceph-mon[94281]: osdmap e482: 12 total, 12 up, 12 in 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:10 smithi082 ceph-mon[94281]: pgmap v6650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:11 smithi082 ceph-mon[94281]: pgmap v6651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:14 smithi082 ceph-mon[94281]: pgmap v6652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:15 smithi082 ceph-mon[94281]: pgmap v6653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:17 smithi082 ceph-mon[94281]: pgmap v6654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:19 smithi082 ceph-mon[94281]: osdmap e483: 12 total, 12 up, 12 in 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:20 smithi082 ceph-mon[94281]: pgmap v6656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:21 smithi082 ceph-mon[94281]: pgmap v6657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:14.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:24 smithi082 ceph-mon[94281]: pgmap v6658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:15.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:25 smithi082 ceph-mon[94281]: pgmap v6659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:15.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:27 smithi082 ceph-mon[94281]: pgmap v6660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:24:15.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:29 smithi082 ceph-mon[94281]: pgmap v6661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:24:15.501 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:24:15.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:24:15.502 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:24:17.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:30 smithi082 ceph-mon[94281]: pgmap v6662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:24:17.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:30 smithi082 ceph-mon[94281]: pgmap v6663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:17.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:30 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:24:17.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:33 smithi082 ceph-mon[94281]: pgmap v6664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:17.025 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:35 smithi082 ceph-mon[94281]: pgmap v6665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:17.026 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:37 smithi082 ceph-mon[94281]: pgmap v6666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:24:17.026 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:39 smithi082 ceph-mon[94281]: pgmap v6667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:17.026 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:41 smithi082 ceph-mon[94281]: pgmap v6668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:43 smithi082 ceph-mon[94281]: pgmap v6669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:45 smithi082 ceph-mon[94281]: pgmap v6670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:47 smithi082 ceph-mon[94281]: pgmap v6671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:49 smithi082 ceph-mon[94281]: pgmap v6672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:51 smithi082 ceph-mon[94281]: pgmap v6673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:53 smithi082 ceph-mon[94281]: pgmap v6674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:17.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:55 smithi082 ceph-mon[94281]: pgmap v6675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:18.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:57 smithi082 ceph-mon[94281]: pgmap v6676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:18.794 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:07:59 smithi082 ceph-mon[94281]: pgmap v6677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:01 smithi082 ceph-mon[94281]: pgmap v6678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:03 smithi082 ceph-mon[94281]: pgmap v6679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:05 smithi082 ceph-mon[94281]: pgmap v6680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:07 smithi082 ceph-mon[94281]: pgmap v6681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:09 smithi082 ceph-mon[94281]: pgmap v6682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:10 smithi082 ceph-mon[94281]: osdmap e484: 12 total, 12 up, 12 in 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:11 smithi082 ceph-mon[94281]: pgmap v6684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:13 smithi082 ceph-mon[94281]: pgmap v6685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:13 smithi082 ceph-mon[94281]: osdmap e485: 12 total, 12 up, 12 in 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:15 smithi082 ceph-mon[94281]: pgmap v6687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:17 smithi082 ceph-mon[94281]: pgmap v6688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:19 smithi082 ceph-mon[94281]: pgmap v6689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 227 B/s wr, 11 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:21 smithi082 ceph-mon[94281]: pgmap v6690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:23 smithi082 ceph-mon[94281]: pgmap v6691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:25 smithi082 ceph-mon[94281]: pgmap v6692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T12:24:18.795 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:27 smithi082 ceph-mon[94281]: pgmap v6693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:29 smithi082 ceph-mon[94281]: pgmap v6694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:31 smithi082 ceph-mon[94281]: pgmap v6695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:32 smithi082 ceph-mon[94281]: pgmap v6696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:32 smithi082 ceph-mon[94281]: pgmap v6697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:34 smithi082 ceph-mon[94281]: pgmap v6698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:36 smithi082 ceph-mon[94281]: pgmap v6699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:38 smithi082 ceph-mon[94281]: pgmap v6700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:18.796 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:40 smithi082 ceph-mon[94281]: pgmap v6701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:24:20.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:42 smithi082 ceph-mon[94281]: pgmap v6702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:24:20.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:44 smithi082 ceph-mon[94281]: pgmap v6703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:20.105 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:46 smithi082 ceph-mon[94281]: pgmap v6704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:48 smithi082 ceph-mon[94281]: pgmap v6705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:50 smithi082 ceph-mon[94281]: pgmap v6706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:52 smithi082 ceph-mon[94281]: pgmap v6707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:54 smithi082 ceph-mon[94281]: pgmap v6708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:56 smithi082 ceph-mon[94281]: pgmap v6709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:08:58 smithi082 ceph-mon[94281]: pgmap v6710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:00 smithi082 ceph-mon[94281]: pgmap v6711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:20.653 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:02 smithi082 ceph-mon[94281]: pgmap v6712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:24:21.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:04 smithi082 ceph-mon[94281]: pgmap v6713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:21.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:06 smithi082 ceph-mon[94281]: pgmap v6714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:24:21.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:08 smithi082 ceph-mon[94281]: pgmap v6715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:24:21.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:10 smithi082 ceph-mon[94281]: pgmap v6716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:24:21.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:10 smithi082 ceph-mon[94281]: osdmap e486: 12 total, 12 up, 12 in 2023-03-17T12:24:22.364 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:12 smithi035 ceph-mon[92535]: pgmap v6718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:24:22.366 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-0": { 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 2897, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 2894, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 1017312, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 981069, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 5, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 1, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 0.363980122, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.112821016, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.088586700, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.129961541, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 2894, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.132933197, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000045934 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:24.136 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 283904, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 200144 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-1": { 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 1348, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 1602, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 499029, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 935326, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 6, 2023-03-17T12:24:24.137 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 4, 2023-03-17T12:24:25.209 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 0.171114728, 2023-03-17T12:24:25.731 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.061582196, 2023-03-17T12:24:26.980 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.039882742, 2023-03-17T12:24:26.980 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.051481796, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 1600, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.079094144, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000049433 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 160, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 516352 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-2": { 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 6, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 8, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 2961, 2023-03-17T12:24:26.981 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 1882, 2023-03-17T12:24:26.982 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 7, 2023-03-17T12:24:26.982 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 4, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 0.002674544, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.000082290, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.002182342, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.000180373, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 6, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.004222347, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000703724 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:24:29.549 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 0, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 0 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "cct": { 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "total_workers": 1, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "unhealthy_workers": 0 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "finisher-MDSRank": { 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "queue_len": 0, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "complete_latency": { 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 6418, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.241450571, 2023-03-17T12:24:29.550 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000037620 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "finisher-PurgeQueue": { 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "queue_len": 0, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "complete_latency": { 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "mds": { 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "request": 0, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "reply": 0, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "reply_latency": { 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:29.551 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:29.552 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:29.552 INFO:teuthology.orchestra.run.smithi035.stdout: "slow_reply": 0, 2023-03-17T12:24:30.638 INFO:teuthology.orchestra.run.smithi035.stdout: "forward": 0, 2023-03-17T12:24:30.638 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_fetch_complete": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_fetch_keys": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_commit": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_split": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_merge": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_top": 0, 2023-03-17T12:24:31.723 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_bottom": 0, 2023-03-17T12:24:31.724 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_pin_tail": 0, 2023-03-17T12:24:31.724 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_pinned": 0, 2023-03-17T12:24:31.724 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_expired": 0, 2023-03-17T12:24:31.724 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_with_caps": 0, 2023-03-17T12:24:31.724 INFO:teuthology.orchestra.run.smithi035.stdout: "caps": 0, 2023-03-17T12:24:32.289 INFO:teuthology.orchestra.run.smithi035.stdout: "subtrees": 2, 2023-03-17T12:24:32.289 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse": 0, 2023-03-17T12:24:32.289 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_hit": 0, 2023-03-17T12:24:32.290 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_forward": 0, 2023-03-17T12:24:32.290 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_discover": 0, 2023-03-17T12:24:34.322 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_dir_fetch": 0, 2023-03-17T12:24:34.322 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_remote_ino": 0, 2023-03-17T12:24:34.322 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_lock": 0, 2023-03-17T12:24:34.322 INFO:teuthology.orchestra.run.smithi035.stdout: "load_cent": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "q": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "exported": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "exported_inodes": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "imported": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "imported_inodes": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_dir_fetch": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_backtrace_fetch": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_peer_discover": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rfiles": 4, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rbytes": 246, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rsnaps": 9, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_backtrace_fetch": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_set_tag": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_backtrace_repaired": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_inotable_repaired": 0, 2023-03-17T12:24:34.323 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dir_inodes": 0, 2023-03-17T12:24:34.324 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dir_base_inodes": 0, 2023-03-17T12:24:35.281 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dirfrag_rstats": 0, 2023-03-17T12:24:35.281 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_file_inodes": 0, 2023-03-17T12:24:35.281 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_inode_file_caps": 0, 2023-03-17T12:24:35.281 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_revoke": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_grant": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_trunc": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_flush_ack": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_caps": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_caps_dirty": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_cap_release": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "process_request_cap_release": 0 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache": { 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_update": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_update_receipt": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_try_discover": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_send_discover": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_handle_discover": 0, 2023-03-17T12:24:35.282 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays": 0, 2023-03-17T12:24:36.274 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays_delayed": 0, 2023-03-17T12:24:36.274 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays_enqueuing": 0, 2023-03-17T12:24:36.274 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_created": 0, 2023-03-17T12:24:36.274 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_enqueued": 0, 2023-03-17T12:24:36.801 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_reintegrated": 0, 2023-03-17T12:24:36.802 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_migrated": 0, 2023-03-17T12:24:36.802 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_processing": 0, 2023-03-17T12:24:36.802 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_enqueued": 0, 2023-03-17T12:24:37.779 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_prioritized": 0, 2023-03-17T12:24:37.779 INFO:teuthology.orchestra.run.smithi035.stdout: "recovery_started": 0, 2023-03-17T12:24:37.779 INFO:teuthology.orchestra.run.smithi035.stdout: "recovery_completed": 0, 2023-03-17T12:24:38.667 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_enqueue_scrub": 0, 2023-03-17T12:24:38.667 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_exportdir": 0, 2023-03-17T12:24:39.644 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_flush": 0, 2023-03-17T12:24:39.644 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_fragmentdir": 0, 2023-03-17T12:24:39.644 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_fragstats": 0, 2023-03-17T12:24:39.644 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_inodestats": 0 2023-03-17T12:24:39.644 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:39.644 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log": { 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "evadd": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "evex": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "evtrm": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "ev": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "evexg": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "evexd": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "segadd": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "segex": 0, 2023-03-17T12:24:39.645 INFO:teuthology.orchestra.run.smithi035.stdout: "segtrm": 0, 2023-03-17T12:24:41.497 INFO:teuthology.orchestra.run.smithi035.stdout: "seg": 2, 2023-03-17T12:24:41.497 INFO:teuthology.orchestra.run.smithi035.stdout: "segexg": 0, 2023-03-17T12:24:41.497 INFO:teuthology.orchestra.run.smithi035.stdout: "segexd": 0, 2023-03-17T12:24:41.497 INFO:teuthology.orchestra.run.smithi035.stdout: "expos": 389673753, 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "wrpos": 0, 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "rdpos": 389784939, 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "jlat": { 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:41.498 INFO:teuthology.orchestra.run.smithi035.stdout: "replayed": 202 2023-03-17T12:24:43.125 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:43.125 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_mem": { 2023-03-17T12:24:43.125 INFO:teuthology.orchestra.run.smithi035.stdout: "ino": 3, 2023-03-17T12:24:43.125 INFO:teuthology.orchestra.run.smithi035.stdout: "ino+": 3, 2023-03-17T12:24:43.125 INFO:teuthology.orchestra.run.smithi035.stdout: "ino-": 0, 2023-03-17T12:24:43.917 INFO:teuthology.orchestra.run.smithi035.stdout: "dir": 2, 2023-03-17T12:24:43.917 INFO:teuthology.orchestra.run.smithi035.stdout: "dir+": 2, 2023-03-17T12:24:43.917 INFO:teuthology.orchestra.run.smithi035.stdout: "dir-": 0, 2023-03-17T12:24:45.324 INFO:teuthology.orchestra.run.smithi035.stdout: "dn": 0, 2023-03-17T12:24:45.325 INFO:teuthology.orchestra.run.smithi035.stdout: "dn+": 0, 2023-03-17T12:24:45.325 INFO:teuthology.orchestra.run.smithi035.stdout: "dn-": 0, 2023-03-17T12:24:45.325 INFO:teuthology.orchestra.run.smithi035.stdout: "cap": 0, 2023-03-17T12:24:45.325 INFO:teuthology.orchestra.run.smithi035.stdout: "cap+": 0, 2023-03-17T12:24:46.158 INFO:teuthology.orchestra.run.smithi035.stdout: "cap-": 0, 2023-03-17T12:24:46.158 INFO:teuthology.orchestra.run.smithi035.stdout: "rss": 46436, 2023-03-17T12:24:46.158 INFO:teuthology.orchestra.run.smithi035.stdout: "heap": 207156 2023-03-17T12:24:46.158 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:47.625 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_server": { 2023-03-17T12:24:47.625 INFO:teuthology.orchestra.run.smithi035.stdout: "dispatch_client_request": 0, 2023-03-17T12:24:47.625 INFO:teuthology.orchestra.run.smithi035.stdout: "dispatch_server_request": 0, 2023-03-17T12:24:47.625 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_request": 0, 2023-03-17T12:24:48.415 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_session": 0, 2023-03-17T12:24:48.415 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_peer_request": 0, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "req_create_latency": { 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getattr_latency": { 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getfilelock_latency": { 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "req_link_latency": { 2023-03-17T12:24:48.416 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:50.721 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:50.721 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:50.721 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookup_latency": { 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookuphash_latency": { 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.313 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupino_latency": { 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupname_latency": { 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupparent_latency": { 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.314 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupsnap_latency": { 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lssnap_latency": { 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mkdir_latency": { 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mknod_latency": { 2023-03-17T12:24:51.315 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:51.316 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:51.316 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:51.316 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:51.316 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mksnap_latency": { 2023-03-17T12:24:52.560 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:52.560 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:52.560 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:52.560 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:52.560 INFO:teuthology.orchestra.run.smithi035.stdout: "req_open_latency": { 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "req_readdir_latency": { 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:52.561 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rename_latency": { 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:52.562 INFO:teuthology.orchestra.run.smithi035.stdout: "req_renamesnap_latency": { 2023-03-17T12:24:53.333 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:53.865 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:55.235 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:55.235 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmdir_latency": { 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmsnap_latency": { 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmxattr_latency": { 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:55.236 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:55.237 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setattr_latency": { 2023-03-17T12:24:55.859 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setdirlayout_latency": { 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setfilelock_latency": { 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setlayout_latency": { 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.134 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setxattr_latency": { 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "req_symlink_latency": { 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "req_unlink_latency": { 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "cap_revoke_eviction": 0, 2023-03-17T12:24:58.135 INFO:teuthology.orchestra.run.smithi035.stdout: "cap_acquisition_throttle": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getvxattr_latency": { 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_sessions": { 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "session_count": 2, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "session_add": 2, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "session_remove": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "sessions_open": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "sessions_stale": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "total_load": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "average_load": 0, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "avg_session_uptime": 17007 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "mempool": { 2023-03-17T12:24:58.136 INFO:teuthology.orchestra.run.smithi035.stdout: "bloom_filter_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bloom_filter_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_data_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_data_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_onode_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_onode_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_other_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_other_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_buffer_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_buffer_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_items": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blob_bytes": 0, 2023-03-17T12:24:58.137 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blob_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_shared_blob_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_shared_blob_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_inline_bl_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_inline_bl_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_txc_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_txc_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_deferred_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_deferred_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_reader_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_reader_items": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_writer_bytes": 0, 2023-03-17T12:24:58.138 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_writer_items": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_anon_bytes": 198247, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_anon_items": 56, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_meta_bytes": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_meta_items": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bytes": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_items": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mapbl_bytes": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mapbl_items": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pglog_bytes": 0, 2023-03-17T12:24:58.139 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pglog_items": 0, 2023-03-17T12:24:59.280 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_bytes": 7960, 2023-03-17T12:24:59.280 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_items": 166, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_mapping_bytes": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_mapping_items": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "pgmap_bytes": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "pgmap_items": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_co_bytes": 11328, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_co_items": 22, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_1_bytes": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_1_items": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_2_bytes": 0, 2023-03-17T12:24:59.281 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_2_items": 0 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter": { 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_active": 0, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_laggy": 0, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_send": 3864, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_send_bytes": 26, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_resend": 4, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_reply": 3864, 2023-03-17T12:24:59.282 INFO:teuthology.orchestra.run.smithi035.stdout: "op_latency": { 2023-03-17T12:24:59.283 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 3864, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 2.250953729, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000582544 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "op_inflight": 0, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "oplen_avg": { 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 3864, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 3865 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "op": 3864, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "op_r": 3864, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "op_w": 0, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "op_rmw": 0, 2023-03-17T12:24:59.938 INFO:teuthology.orchestra.run.smithi035.stdout: "op_pg": 0, 2023-03-17T12:24:59.939 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_stat": 2510, 2023-03-17T12:24:59.939 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_create": 0, 2023-03-17T12:24:59.939 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_read": 1351, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_write": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_writefull": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_writesame": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_append": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_zero": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_truncate": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_delete": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_mapext": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_sparse_read": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_clonerange": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_getxattr": 2, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_setxattr": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_cmpxattr": 0, 2023-03-17T12:25:01.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_rmxattr": 0, 2023-03-17T12:25:01.813 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_resetxattrs": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_call": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_watch": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_notify": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_src_cmpxattr": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_pgls": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_pgls_filter": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_other": 0, 2023-03-17T12:25:03.660 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_active": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_send": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_resend": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_ping": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_active": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_send": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_resend": 0, 2023-03-17T12:25:07.126 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_active": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_send": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_resend": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_active": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_send": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_resend": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "command_active": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "command_send": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "command_resend": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "map_epoch": 486, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "map_full": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "map_inc": 41, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_sessions": 6, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_session_open": 9, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_session_close": 3, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_laggy": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_wr": 0, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_rd": 2, 2023-03-17T12:25:07.127 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_del": 0 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "oft": { 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_objs": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_kv_pairs": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_updates": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_removes": 0 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "osd-slow-ops": { 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "slow_ops_count": 0 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "purge_queue": { 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_ops": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_ops_high_water": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_high_water": 0, 2023-03-17T12:25:07.128 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executed": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_item_in_journal": 0 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 104857600, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 4247, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 1114581, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 4247, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 4247, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 1114581, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:25:07.129 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:25:07.130 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-objecter_bytes": { 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 104857600, 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:25:08.373 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:25:09.720 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:25:09.720 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 3864, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 146424, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 3864, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 146424, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-objecter_ops": { 2023-03-17T12:25:09.721 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:25:10.240 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 1024, 2023-03-17T12:25:10.240 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:25:12.900 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 3864, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 3864, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 3864, 2023-03-17T12:25:15.362 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 3864, 2023-03-17T12:25:15.363 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:25:15.363 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:25:16.725 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-write_buf_throttle": { 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 3758096384, 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:25:17.973 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:25:19.068 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:25:19.069 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:25:19.069 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:25:19.069 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:25:19.069 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 0, 2023-03-17T12:25:19.663 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 0, 2023-03-17T12:25:19.663 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:25:21.192 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:25:21.192 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:25:21.192 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:25:21.192 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:25:21.832 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:25:21.832 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-write_buf_throttle-0x5577752d60a0": { 2023-03-17T12:25:21.832 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:25:21.832 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 3758096384, 2023-03-17T12:25:21.832 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:25:22.946 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:25:22.946 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:25:22.946 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 0, 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 0, 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:25:22.947 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:25:24.682 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:25:24.682 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:25:24.682 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:25:24.682 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:25:24.682 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T12:25:24.684 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2023-03-17T12:25:24.684 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2023-03-17T12:25:24.684 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=9 2023-03-17T12:25:24.684 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2023-03-17T12:25:24.684 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2023-03-17T12:25:24.684 DEBUG:tasks.check_counter:Getting stats from g 2023-03-17T12:25:24.684 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph daemon mds.g perf dump 2023-03-17T12:25:26.514 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:12 smithi082 ceph-mon[94281]: pgmap v6718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:28.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:14 smithi082 ceph-mon[94281]: pgmap v6719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:28.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:16 smithi082 ceph-mon[94281]: pgmap v6720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:28.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:18 smithi082 ceph-mon[94281]: pgmap v6721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:28.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:18 smithi082 ceph-mon[94281]: osdmap e487: 12 total, 12 up, 12 in 2023-03-17T12:25:28.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:20 smithi082 ceph-mon[94281]: pgmap v6723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:25:28.589 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:22 smithi082 ceph-mon[94281]: pgmap v6724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:24 smithi082 ceph-mon[94281]: pgmap v6725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:26 smithi082 ceph-mon[94281]: pgmap v6726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:28 smithi082 ceph-mon[94281]: pgmap v6727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:30 smithi082 ceph-mon[94281]: pgmap v6728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:31 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:32 smithi082 ceph-mon[94281]: pgmap v6729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:33 smithi082 ceph-mon[94281]: pgmap v6730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:25:28.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:33 smithi082 ceph-mon[94281]: pgmap v6731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:25:30.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:35 smithi082 ceph-mon[94281]: pgmap v6732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:25:30.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:37 smithi082 ceph-mon[94281]: pgmap v6733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:25:30.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:39 smithi082 ceph-mon[94281]: pgmap v6734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:25:30.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:41 smithi082 ceph-mon[94281]: pgmap v6735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:25:30.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:43 smithi082 ceph-mon[94281]: pgmap v6736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:31.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:45 smithi082 ceph-mon[94281]: pgmap v6737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:31.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:47 smithi082 ceph-mon[94281]: pgmap v6738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:31.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:49 smithi082 ceph-mon[94281]: pgmap v6739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:31.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:51 smithi082 ceph-mon[94281]: pgmap v6740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:31.253 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:53 smithi082 ceph-mon[94281]: pgmap v6741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:55 smithi082 ceph-mon[94281]: pgmap v6742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:57 smithi082 ceph-mon[94281]: pgmap v6743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:09:59 smithi082 ceph-mon[94281]: pgmap v6744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:01 smithi082 ceph-mon[94281]: pgmap v6745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:03 smithi082 ceph-mon[94281]: pgmap v6746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:05 smithi082 ceph-mon[94281]: pgmap v6747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:32.241 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:07 smithi082 ceph-mon[94281]: pgmap v6748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:32.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:09 smithi082 ceph-mon[94281]: pgmap v6749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:32.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:10 smithi082 ceph-mon[94281]: osdmap e488: 12 total, 12 up, 12 in 2023-03-17T12:25:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:11 smithi082 ceph-mon[94281]: pgmap v6751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:12 smithi082 ceph-mon[94281]: pgmap v6752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:15 smithi082 ceph-mon[94281]: pgmap v6753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:17 smithi082 ceph-mon[94281]: pgmap v6754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:19 smithi082 ceph-mon[94281]: pgmap v6755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:33.781 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:19 smithi082 ceph-mon[94281]: osdmap e489: 12 total, 12 up, 12 in 2023-03-17T12:25:34.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:21 smithi082 ceph-mon[94281]: pgmap v6757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:34.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:23 smithi082 ceph-mon[94281]: pgmap v6758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:34.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:25 smithi082 ceph-mon[94281]: pgmap v6759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:34.917 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:27 smithi082 ceph-mon[94281]: pgmap v6760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:35.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:29 smithi082 ceph-mon[94281]: pgmap v6761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:35.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:31 smithi082 ceph-mon[94281]: pgmap v6762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:25:35.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:32 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:25:35.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:33 smithi082 ceph-mon[94281]: pgmap v6763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:35.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:35.493 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:36.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:25:36.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:25:36.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:36.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:34 smithi082 ceph-mon[94281]: pgmap v6764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 op/s 2023-03-17T12:25:36.553 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:34 smithi082 ceph-mon[94281]: pgmap v6765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:36 smithi082 ceph-mon[94281]: pgmap v6766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:38 smithi082 ceph-mon[94281]: pgmap v6767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:40 smithi082 ceph-mon[94281]: pgmap v6768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:42 smithi082 ceph-mon[94281]: pgmap v6769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:44 smithi082 ceph-mon[94281]: pgmap v6770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:46 smithi082 ceph-mon[94281]: pgmap v6771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:36.554 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:48 smithi082 ceph-mon[94281]: pgmap v6772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:50 smithi082 ceph-mon[94281]: pgmap v6773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:52 smithi082 ceph-mon[94281]: pgmap v6774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:54 smithi082 ceph-mon[94281]: pgmap v6775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:56 smithi082 ceph-mon[94281]: pgmap v6776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:10:58 smithi082 ceph-mon[94281]: pgmap v6777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:00 smithi082 ceph-mon[94281]: pgmap v6778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:25:37.406 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:02 smithi082 ceph-mon[94281]: pgmap v6779: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:04 smithi082 ceph-mon[94281]: pgmap v6780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:06 smithi082 ceph-mon[94281]: pgmap v6781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:08 smithi082 ceph-mon[94281]: pgmap v6782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:10 smithi082 ceph-mon[94281]: pgmap v6783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:10 smithi082 ceph-mon[94281]: osdmap e490: 12 total, 12 up, 12 in 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:12 smithi082 ceph-mon[94281]: pgmap v6785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:14 smithi082 ceph-mon[94281]: pgmap v6786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:16 smithi082 ceph-mon[94281]: pgmap v6787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:18 smithi082 ceph-mon[94281]: pgmap v6788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:18 smithi082 ceph-mon[94281]: osdmap e491: 12 total, 12 up, 12 in 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:20 smithi082 ceph-mon[94281]: pgmap v6790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:22 smithi082 ceph-mon[94281]: pgmap v6791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:24 smithi082 ceph-mon[94281]: pgmap v6792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:26 smithi082 ceph-mon[94281]: pgmap v6793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:37.407 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:28 smithi082 ceph-mon[94281]: pgmap v6794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:30 smithi082 ceph-mon[94281]: pgmap v6795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:32 smithi082 ceph-mon[94281]: pgmap v6796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:33 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:34 smithi082 ceph-mon[94281]: pgmap v6797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:34 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:37.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:36 smithi082 ceph-mon[94281]: pgmap v6798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:36 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:38.683 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.112 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.112 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:39.113 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:40.441 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:40.441 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:40.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:25:40.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:25:40.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:25:40.442 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:41.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:25:41.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:25:41.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:25:41.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:25:41.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:25:41.739 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: pgmap v6799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:38 smithi082 ceph-mon[94281]: pgmap v6800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:40 smithi082 ceph-mon[94281]: pgmap v6801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:42 smithi082 ceph-mon[94281]: pgmap v6802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:44 smithi082 ceph-mon[94281]: pgmap v6803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:46 smithi082 ceph-mon[94281]: pgmap v6804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:48 smithi082 ceph-mon[94281]: pgmap v6805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:50 smithi082 ceph-mon[94281]: pgmap v6806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:52 smithi082 ceph-mon[94281]: pgmap v6807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:54 smithi082 ceph-mon[94281]: pgmap v6808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:41.740 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:56 smithi082 ceph-mon[94281]: pgmap v6809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:58 smithi082 ceph-mon[94281]: pgmap v6810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:11:59 smithi082 ceph-mon[94281]: pgmap v6811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:02 smithi082 ceph-mon[94281]: pgmap v6812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:04 smithi082 ceph-mon[94281]: pgmap v6813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:06 smithi082 ceph-mon[94281]: pgmap v6814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:08 smithi082 ceph-mon[94281]: pgmap v6815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:25:42.523 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:10 smithi082 ceph-mon[94281]: pgmap v6816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:10 smithi082 ceph-mon[94281]: osdmap e492: 12 total, 12 up, 12 in 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:12 smithi082 ceph-mon[94281]: pgmap v6818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:14 smithi082 ceph-mon[94281]: pgmap v6819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:16 smithi082 ceph-mon[94281]: pgmap v6820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:18 smithi082 ceph-mon[94281]: pgmap v6821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:18 smithi082 ceph-mon[94281]: osdmap e493: 12 total, 12 up, 12 in 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:20 smithi082 ceph-mon[94281]: pgmap v6823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:22 smithi082 ceph-mon[94281]: pgmap v6824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:24 smithi082 ceph-mon[94281]: pgmap v6825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:26 smithi082 ceph-mon[94281]: pgmap v6826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:28 smithi082 ceph-mon[94281]: pgmap v6827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:30 smithi082 ceph-mon[94281]: pgmap v6828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:25:42.524 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:32 smithi082 ceph-mon[94281]: pgmap v6829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:34 smithi082 ceph-mon[94281]: pgmap v6830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:36 smithi082 ceph-mon[94281]: pgmap v6831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:37 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:38 smithi082 ceph-mon[94281]: pgmap v6832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:40 smithi082 ceph-mon[94281]: pgmap v6833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:43.206 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: pgmap v6834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: pgmap v6835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:44 smithi082 ceph-mon[94281]: pgmap v6836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:46 smithi082 ceph-mon[94281]: pgmap v6837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:48 smithi082 ceph-mon[94281]: pgmap v6838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2023-03-17T12:25:43.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:50 smithi082 ceph-mon[94281]: pgmap v6839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:52 smithi082 ceph-mon[94281]: pgmap v6840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:54 smithi082 ceph-mon[94281]: pgmap v6841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:56 smithi082 ceph-mon[94281]: pgmap v6842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:12:58 smithi082 ceph-mon[94281]: pgmap v6843: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:00 smithi082 ceph-mon[94281]: pgmap v6844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:02 smithi082 ceph-mon[94281]: pgmap v6845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:04 smithi082 ceph-mon[94281]: pgmap v6846: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:06 smithi082 ceph-mon[94281]: pgmap v6847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:08 smithi082 ceph-mon[94281]: pgmap v6848: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:44.472 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:10 smithi082 ceph-mon[94281]: pgmap v6849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:45.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:10 smithi082 ceph-mon[94281]: osdmap e494: 12 total, 12 up, 12 in 2023-03-17T12:25:45.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:12 smithi082 ceph-mon[94281]: pgmap v6851: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:45.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:14 smithi082 ceph-mon[94281]: pgmap v6852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:45.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:16 smithi082 ceph-mon[94281]: pgmap v6853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:45.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:18 smithi082 ceph-mon[94281]: pgmap v6854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:47.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:18 smithi082 ceph-mon[94281]: osdmap e495: 12 total, 12 up, 12 in 2023-03-17T12:25:47.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:20 smithi082 ceph-mon[94281]: pgmap v6856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-17T12:25:47.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:22 smithi082 ceph-mon[94281]: pgmap v6857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:47.221 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:24 smithi082 ceph-mon[94281]: pgmap v6858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:26 smithi082 ceph-mon[94281]: pgmap v6859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:28 smithi082 ceph-mon[94281]: pgmap v6860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:30 smithi082 ceph-mon[94281]: pgmap v6861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:32 smithi082 ceph-mon[94281]: pgmap v6862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:34 smithi082 ceph-mon[94281]: pgmap v6863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:36 smithi082 ceph-mon[94281]: pgmap v6864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:48.628 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:38 smithi082 ceph-mon[94281]: pgmap v6865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:51.155 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:40 smithi082 ceph-mon[94281]: pgmap v6866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:51.155 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:25:51.155 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:51.155 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:41 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:42 smithi082 ceph-mon[94281]: pgmap v6867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:44 smithi082 ceph-mon[94281]: pgmap v6868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:25:52.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: pgmap v6869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: pgmap v6870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:47 smithi082 ceph-mon[94281]: pgmap v6871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:50 smithi082 ceph-mon[94281]: pgmap v6872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:52 smithi082 ceph-mon[94281]: pgmap v6873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:54 smithi082 ceph-mon[94281]: pgmap v6874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:56 smithi082 ceph-mon[94281]: pgmap v6875: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:13:58 smithi082 ceph-mon[94281]: pgmap v6876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:00 smithi082 ceph-mon[94281]: pgmap v6877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:53.938 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:02 smithi082 ceph-mon[94281]: pgmap v6878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:04 smithi082 ceph-mon[94281]: pgmap v6879: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:06 smithi082 ceph-mon[94281]: pgmap v6880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:08 smithi082 ceph-mon[94281]: pgmap v6881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:10 smithi082 ceph-mon[94281]: pgmap v6882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:10 smithi082 ceph-mon[94281]: osdmap e496: 12 total, 12 up, 12 in 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:12 smithi082 ceph-mon[94281]: pgmap v6884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:14 smithi082 ceph-mon[94281]: pgmap v6885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:16 smithi082 ceph-mon[94281]: pgmap v6886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:53.939 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:18 smithi082 ceph-mon[94281]: pgmap v6887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:55.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:18 smithi082 ceph-mon[94281]: osdmap e497: 12 total, 12 up, 12 in 2023-03-17T12:25:55.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:20 smithi082 ceph-mon[94281]: pgmap v6889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:22 smithi082 ceph-mon[94281]: pgmap v6890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:24 smithi082 ceph-mon[94281]: pgmap v6891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:26 smithi082 ceph-mon[94281]: pgmap v6892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:28 smithi082 ceph-mon[94281]: pgmap v6893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:30 smithi082 ceph-mon[94281]: pgmap v6894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:32 smithi082 ceph-mon[94281]: pgmap v6895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:34 smithi082 ceph-mon[94281]: pgmap v6896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:57.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:36 smithi082 ceph-mon[94281]: pgmap v6897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:38 smithi082 ceph-mon[94281]: pgmap v6898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:40 smithi082 ceph-mon[94281]: pgmap v6899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:42 smithi082 ceph-mon[94281]: pgmap v6900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:44 smithi082 ceph-mon[94281]: pgmap v6901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:45 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:46 smithi082 ceph-mon[94281]: pgmap v6902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:48 smithi082 ceph-mon[94281]: pgmap v6903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:57.102 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: pgmap v6904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: pgmap v6905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:51 smithi082 ceph-mon[94281]: pgmap v6906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:54 smithi082 ceph-mon[94281]: pgmap v6907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:56 smithi082 ceph-mon[94281]: pgmap v6908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:14:58 smithi082 ceph-mon[94281]: pgmap v6909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:25:58.352 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:00 smithi082 ceph-mon[94281]: pgmap v6910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:02 smithi082 ceph-mon[94281]: pgmap v6911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:04 smithi082 ceph-mon[94281]: pgmap v6912: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:06 smithi082 ceph-mon[94281]: pgmap v6913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:08 smithi082 ceph-mon[94281]: pgmap v6914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:10 smithi082 ceph-mon[94281]: pgmap v6915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:10 smithi082 ceph-mon[94281]: osdmap e498: 12 total, 12 up, 12 in 2023-03-17T12:25:59.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:12 smithi082 ceph-mon[94281]: pgmap v6917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:14 smithi082 ceph-mon[94281]: pgmap v6918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:16 smithi082 ceph-mon[94281]: pgmap v6919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:18 smithi082 ceph-mon[94281]: pgmap v6920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:18 smithi082 ceph-mon[94281]: osdmap e499: 12 total, 12 up, 12 in 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:20 smithi082 ceph-mon[94281]: pgmap v6922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:22 smithi082 ceph-mon[94281]: pgmap v6923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:24 smithi082 ceph-mon[94281]: pgmap v6924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:26 smithi082 ceph-mon[94281]: pgmap v6925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:28 smithi082 ceph-mon[94281]: pgmap v6926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:30 smithi082 ceph-mon[94281]: pgmap v6927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:32 smithi082 ceph-mon[94281]: pgmap v6928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:34 smithi082 ceph-mon[94281]: pgmap v6929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:36 smithi082 ceph-mon[94281]: pgmap v6930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:59.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:38 smithi082 ceph-mon[94281]: pgmap v6931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:59.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:40 smithi082 ceph-mon[94281]: pgmap v6932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:59.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:42 smithi082 ceph-mon[94281]: pgmap v6933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:25:59.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:44 smithi082 ceph-mon[94281]: pgmap v6934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:25:59.542 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:46 smithi082 ceph-mon[94281]: pgmap v6935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:48 smithi082 ceph-mon[94281]: pgmap v6936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:49 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:50 smithi082 ceph-mon[94281]: pgmap v6937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:51 smithi082 ceph-mon[94281]: pgmap v6938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:51 smithi082 ceph-mon[94281]: pgmap v6939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:53 smithi082 ceph-mon[94281]: pgmap v6940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:01.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:55 smithi082 ceph-mon[94281]: pgmap v6941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:01.363 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:57 smithi082 ceph-mon[94281]: pgmap v6942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:01.363 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:15:59 smithi082 ceph-mon[94281]: pgmap v6943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:03.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:01 smithi082 ceph-mon[94281]: pgmap v6944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:03.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:03 smithi082 ceph-mon[94281]: pgmap v6945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:03.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:05 smithi082 ceph-mon[94281]: pgmap v6946: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:03.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:07 smithi082 ceph-mon[94281]: pgmap v6947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:26:03.019 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:09 smithi082 ceph-mon[94281]: pgmap v6948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:06.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:10 smithi082 ceph-mon[94281]: osdmap e500: 12 total, 12 up, 12 in 2023-03-17T12:26:06.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:11 smithi082 ceph-mon[94281]: pgmap v6950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:06.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:12 smithi082 ceph-mon[94281]: pgmap v6951: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:06.083 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:15 smithi082 ceph-mon[94281]: pgmap v6952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:08.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:17 smithi082 ceph-mon[94281]: pgmap v6953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:08.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:19 smithi082 ceph-mon[94281]: pgmap v6954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:08.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:19 smithi082 ceph-mon[94281]: osdmap e501: 12 total, 12 up, 12 in 2023-03-17T12:26:08.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:21 smithi082 ceph-mon[94281]: pgmap v6956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:08.342 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:23 smithi082 ceph-mon[94281]: pgmap v6957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:08.342 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:25 smithi082 ceph-mon[94281]: pgmap v6958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:08.342 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:27 smithi082 ceph-mon[94281]: pgmap v6959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:08.342 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:29 smithi082 ceph-mon[94281]: pgmap v6960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:08.342 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:31 smithi082 ceph-mon[94281]: pgmap v6961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:26:08.342 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:33 smithi082 ceph-mon[94281]: pgmap v6962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:35 smithi082 ceph-mon[94281]: pgmap v6963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:37 smithi082 ceph-mon[94281]: pgmap v6964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:39 smithi082 ceph-mon[94281]: pgmap v6965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:41 smithi082 ceph-mon[94281]: pgmap v6966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:43 smithi082 ceph-mon[94281]: pgmap v6967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:45 smithi082 ceph-mon[94281]: pgmap v6968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:47 smithi082 ceph-mon[94281]: pgmap v6969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:49 smithi082 ceph-mon[94281]: pgmap v6970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:09.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:50 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:51 smithi082 ceph-mon[94281]: pgmap v6971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:51 smithi082 ceph-mon[94281]: pgmap v6972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:51 smithi082 ceph-mon[94281]: pgmap v6973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:53 smithi082 ceph-mon[94281]: pgmap v6974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:55 smithi082 ceph-mon[94281]: pgmap v6975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:57 smithi082 ceph-mon[94281]: pgmap v6976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:16:59 smithi082 ceph-mon[94281]: pgmap v6977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:01 smithi082 ceph-mon[94281]: pgmap v6978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:03 smithi082 ceph-mon[94281]: pgmap v6979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:05 smithi082 ceph-mon[94281]: pgmap v6980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:26:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:07 smithi082 ceph-mon[94281]: pgmap v6981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:26:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:09 smithi082 ceph-mon[94281]: pgmap v6982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:12.234 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:10 smithi082 ceph-mon[94281]: osdmap e502: 12 total, 12 up, 12 in 2023-03-17T12:26:12.234 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:11 smithi082 ceph-mon[94281]: pgmap v6984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:12.234 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:13 smithi082 ceph-mon[94281]: pgmap v6985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:12.234 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:13 smithi082 ceph-mon[94281]: osdmap e503: 12 total, 12 up, 12 in 2023-03-17T12:26:12.234 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:15 smithi082 ceph-mon[94281]: pgmap v6987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:26:12.234 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:17 smithi082 ceph-mon[94281]: pgmap v6988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:26:14.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:19 smithi082 ceph-mon[94281]: pgmap v6989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-17T12:26:14.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:21 smithi082 ceph-mon[94281]: pgmap v6990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:14.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:23 smithi082 ceph-mon[94281]: pgmap v6991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:14.672 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:25 smithi082 ceph-mon[94281]: pgmap v6992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T12:26:15.995 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:27 smithi082 ceph-mon[94281]: pgmap v6993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:26:15.996 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:29 smithi082 ceph-mon[94281]: pgmap v6994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:26:16.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:30 smithi082 ceph-mon[94281]: pgmap v6995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:16.540 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:33 smithi082 ceph-mon[94281]: pgmap v6996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:16.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:35 smithi082 ceph-mon[94281]: pgmap v6997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:16.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:37 smithi082 ceph-mon[94281]: pgmap v6998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:16.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:39 smithi082 ceph-mon[94281]: pgmap v6999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:16.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:41 smithi082 ceph-mon[94281]: pgmap v7000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:16.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:43 smithi082 ceph-mon[94281]: pgmap v7001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:16.541 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:45 smithi082 ceph-mon[94281]: pgmap v7002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:17.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:47 smithi082 ceph-mon[94281]: pgmap v7003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:17.730 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:49 smithi082 ceph-mon[94281]: pgmap v7004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:51 smithi082 ceph-mon[94281]: pgmap v7005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:52 smithi082 ceph-mon[94281]: pgmap v7006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:52 smithi082 ceph-mon[94281]: pgmap v7007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:54 smithi082 ceph-mon[94281]: pgmap v7008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:56 smithi082 ceph-mon[94281]: pgmap v7009: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:17:58 smithi082 ceph-mon[94281]: pgmap v7010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:00 smithi082 ceph-mon[94281]: pgmap v7011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:02 smithi082 ceph-mon[94281]: pgmap v7012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:18.737 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:04 smithi082 ceph-mon[94281]: pgmap v7013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:18.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:06 smithi082 ceph-mon[94281]: pgmap v7014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:26:18.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:08 smithi082 ceph-mon[94281]: pgmap v7015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:18.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:10 smithi082 ceph-mon[94281]: pgmap v7016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:26:18.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:10 smithi082 ceph-mon[94281]: osdmap e504: 12 total, 12 up, 12 in 2023-03-17T12:26:18.738 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:12 smithi082 ceph-mon[94281]: pgmap v7018: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:19.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:14 smithi082 ceph-mon[94281]: pgmap v7019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:19.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:16 smithi082 ceph-mon[94281]: pgmap v7020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:19.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:18 smithi082 ceph-mon[94281]: pgmap v7021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:19.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:18 smithi082 ceph-mon[94281]: osdmap e505: 12 total, 12 up, 12 in 2023-03-17T12:26:19.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:20 smithi082 ceph-mon[94281]: pgmap v7023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:26:19.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:22 smithi082 ceph-mon[94281]: pgmap v7024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:20.590 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:24 smithi082 ceph-mon[94281]: pgmap v7025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:21.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:25 smithi082 ceph-mon[94281]: pgmap v7026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:21.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:28 smithi082 ceph-mon[94281]: pgmap v7027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:21.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:30 smithi082 ceph-mon[94281]: pgmap v7028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:21.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:32 smithi082 ceph-mon[94281]: pgmap v7029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:21.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:34 smithi082 ceph-mon[94281]: pgmap v7030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:21.224 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:36 smithi082 ceph-mon[94281]: pgmap v7031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:38 smithi082 ceph-mon[94281]: pgmap v7032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:40 smithi082 ceph-mon[94281]: pgmap v7033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:42 smithi082 ceph-mon[94281]: pgmap v7034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:44 smithi082 ceph-mon[94281]: pgmap v7035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:46 smithi082 ceph-mon[94281]: pgmap v7036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:48 smithi082 ceph-mon[94281]: pgmap v7037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:22.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:50 smithi082 ceph-mon[94281]: pgmap v7038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:51 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:52 smithi082 ceph-mon[94281]: pgmap v7039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:53 smithi082 ceph-mon[94281]: pgmap v7040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:53 smithi082 ceph-mon[94281]: pgmap v7041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:55 smithi082 ceph-mon[94281]: pgmap v7042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:57 smithi082 ceph-mon[94281]: pgmap v7043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:18:59 smithi082 ceph-mon[94281]: pgmap v7044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:01 smithi082 ceph-mon[94281]: pgmap v7045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:03 smithi082 ceph-mon[94281]: pgmap v7046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:05 smithi082 ceph-mon[94281]: pgmap v7047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:07 smithi082 ceph-mon[94281]: pgmap v7048: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:09 smithi082 ceph-mon[94281]: pgmap v7049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:10 smithi082 ceph-mon[94281]: osdmap e506: 12 total, 12 up, 12 in 2023-03-17T12:26:22.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:11 smithi082 ceph-mon[94281]: pgmap v7051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:13 smithi082 ceph-mon[94281]: pgmap v7052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:13 smithi082 ceph-mon[94281]: osdmap e507: 12 total, 12 up, 12 in 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:15 smithi082 ceph-mon[94281]: pgmap v7054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:17 smithi082 ceph-mon[94281]: pgmap v7055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:19 smithi082 ceph-mon[94281]: pgmap v7056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:21 smithi082 ceph-mon[94281]: pgmap v7057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:23 smithi082 ceph-mon[94281]: pgmap v7058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:25 smithi082 ceph-mon[94281]: pgmap v7059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 96 B/s wr, 9 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:27 smithi082 ceph-mon[94281]: pgmap v7060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:29 smithi082 ceph-mon[94281]: pgmap v7061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:31 smithi082 ceph-mon[94281]: pgmap v7062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:33 smithi082 ceph-mon[94281]: pgmap v7063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:22.789 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:35 smithi082 ceph-mon[94281]: pgmap v7064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:24.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:36 smithi082 ceph-mon[94281]: pgmap v7065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:24.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:39 smithi082 ceph-mon[94281]: pgmap v7066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:41 smithi082 ceph-mon[94281]: pgmap v7067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:43 smithi082 ceph-mon[94281]: pgmap v7068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:45 smithi082 ceph-mon[94281]: pgmap v7069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:47 smithi082 ceph-mon[94281]: pgmap v7070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:49 smithi082 ceph-mon[94281]: pgmap v7071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:51 smithi082 ceph-mon[94281]: pgmap v7072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:52 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:53 smithi082 ceph-mon[94281]: pgmap v7073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:54 smithi082 ceph-mon[94281]: pgmap v7074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:54 smithi082 ceph-mon[94281]: pgmap v7075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:24.499 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:56 smithi082 ceph-mon[94281]: pgmap v7076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:24.500 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:19:58 smithi082 ceph-mon[94281]: pgmap v7077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:24.500 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:00 smithi082 ceph-mon[94281]: pgmap v7078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:24.500 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:26:25.332 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:02 smithi082 ceph-mon[94281]: pgmap v7079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:25.332 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:04 smithi082 ceph-mon[94281]: pgmap v7080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:25.332 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:06 smithi082 ceph-mon[94281]: pgmap v7081: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:08 smithi082 ceph-mon[94281]: pgmap v7082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:10 smithi082 ceph-mon[94281]: pgmap v7083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:10 smithi082 ceph-mon[94281]: osdmap e508: 12 total, 12 up, 12 in 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:12 smithi082 ceph-mon[94281]: pgmap v7085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:14 smithi082 ceph-mon[94281]: pgmap v7086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:16 smithi082 ceph-mon[94281]: pgmap v7087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:18 smithi082 ceph-mon[94281]: pgmap v7088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:18 smithi082 ceph-mon[94281]: osdmap e509: 12 total, 12 up, 12 in 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:20 smithi082 ceph-mon[94281]: pgmap v7090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:22 smithi082 ceph-mon[94281]: pgmap v7091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:24 smithi082 ceph-mon[94281]: pgmap v7092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:26 smithi082 ceph-mon[94281]: pgmap v7093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:28 smithi082 ceph-mon[94281]: pgmap v7094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:30 smithi082 ceph-mon[94281]: pgmap v7095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:32 smithi082 ceph-mon[94281]: pgmap v7096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.333 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:34 smithi082 ceph-mon[94281]: pgmap v7097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:36 smithi082 ceph-mon[94281]: pgmap v7098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:38 smithi082 ceph-mon[94281]: pgmap v7099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:40 smithi082 ceph-mon[94281]: pgmap v7100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:42 smithi082 ceph-mon[94281]: pgmap v7101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:44 smithi082 ceph-mon[94281]: pgmap v7102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:46 smithi082 ceph-mon[94281]: pgmap v7103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:47 smithi082 ceph-mon[94281]: pgmap v7104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:50 smithi082 ceph-mon[94281]: pgmap v7105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:52 smithi082 ceph-mon[94281]: pgmap v7106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:53 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:25.334 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:54 smithi082 ceph-mon[94281]: pgmap v7107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:55 smithi082 ceph-mon[94281]: pgmap v7108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:55 smithi082 ceph-mon[94281]: pgmap v7109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:57 smithi082 ceph-mon[94281]: pgmap v7110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:26:27.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:20:59 smithi082 ceph-mon[94281]: pgmap v7111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:01 smithi082 ceph-mon[94281]: pgmap v7112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:03 smithi082 ceph-mon[94281]: pgmap v7113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 KiB/s wr, 26 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:05 smithi082 ceph-mon[94281]: pgmap v7114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:07 smithi082 ceph-mon[94281]: pgmap v7115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:09 smithi082 ceph-mon[94281]: pgmap v7116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:10 smithi082 ceph-mon[94281]: osdmap e510: 12 total, 12 up, 12 in 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:11 smithi082 ceph-mon[94281]: pgmap v7118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:13 smithi082 ceph-mon[94281]: pgmap v7119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:15 smithi082 ceph-mon[94281]: pgmap v7120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:17 smithi082 ceph-mon[94281]: pgmap v7121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:19 smithi082 ceph-mon[94281]: pgmap v7122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:28.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:19 smithi082 ceph-mon[94281]: osdmap e511: 12 total, 12 up, 12 in 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:21 smithi082 ceph-mon[94281]: pgmap v7124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:23 smithi082 ceph-mon[94281]: pgmap v7125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:25 smithi082 ceph-mon[94281]: pgmap v7126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:27 smithi082 ceph-mon[94281]: pgmap v7127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:29 smithi082 ceph-mon[94281]: pgmap v7128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:31 smithi082 ceph-mon[94281]: pgmap v7129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:33 smithi082 ceph-mon[94281]: pgmap v7130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:35 smithi082 ceph-mon[94281]: pgmap v7131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:37 smithi082 ceph-mon[94281]: pgmap v7132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:39 smithi082 ceph-mon[94281]: pgmap v7133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:41 smithi082 ceph-mon[94281]: pgmap v7134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:43 smithi082 ceph-mon[94281]: pgmap v7135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:45 smithi082 ceph-mon[94281]: pgmap v7136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:47 smithi082 ceph-mon[94281]: pgmap v7137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:49 smithi082 ceph-mon[94281]: pgmap v7138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:28.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:51 smithi082 ceph-mon[94281]: pgmap v7139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:53 smithi082 ceph-mon[94281]: pgmap v7140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:54 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:55 smithi082 ceph-mon[94281]: pgmap v7141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:55 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: pgmap v7142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:28.470 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:57 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.750 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: pgmap v7143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:29.751 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: pgmap v7144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: pgmap v7145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:21:58 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:00 smithi082 ceph-mon[94281]: pgmap v7146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:02 smithi082 ceph-mon[94281]: pgmap v7147: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:04 smithi082 ceph-mon[94281]: pgmap v7148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:06 smithi082 ceph-mon[94281]: pgmap v7149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 63 KiB/s wr, 26 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:09 smithi082 ceph-mon[94281]: pgmap v7150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:10 smithi082 ceph-mon[94281]: osdmap e512: 12 total, 12 up, 12 in 2023-03-17T12:26:32.189 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:11 smithi082 ceph-mon[94281]: pgmap v7152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:32.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:12 smithi082 ceph-mon[94281]: pgmap v7153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:32.190 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:14 smithi082 ceph-mon[94281]: osdmap e513: 12 total, 12 up, 12 in 2023-03-17T12:26:33.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:15 smithi082 ceph-mon[94281]: pgmap v7155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:26:33.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:16 smithi082 ceph-mon[94281]: pgmap v7156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:26:33.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:19 smithi082 ceph-mon[94281]: pgmap v7157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 226 B/s wr, 11 op/s 2023-03-17T12:26:33.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:20 smithi082 ceph-mon[94281]: pgmap v7158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:33.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:22 smithi082 ceph-mon[94281]: pgmap v7159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:26:33.579 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:24 smithi082 ceph-mon[94281]: pgmap v7160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 92 B/s wr, 8 op/s 2023-03-17T12:26:34.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:26 smithi082 ceph-mon[94281]: pgmap v7161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:26:34.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:29 smithi082 ceph-mon[94281]: pgmap v7162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:26:34.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:30 smithi082 ceph-mon[94281]: pgmap v7163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:26:34.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:32 smithi082 ceph-mon[94281]: pgmap v7164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:26:34.413 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:34 smithi082 ceph-mon[94281]: pgmap v7165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:35.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:36 smithi082 ceph-mon[94281]: pgmap v7166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:35.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:39 smithi082 ceph-mon[94281]: pgmap v7167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:35.570 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:40 smithi082 ceph-mon[94281]: pgmap v7168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:42 smithi082 ceph-mon[94281]: pgmap v7169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:44 smithi082 ceph-mon[94281]: pgmap v7170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:46 smithi082 ceph-mon[94281]: pgmap v7171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:49 smithi082 ceph-mon[94281]: pgmap v7172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:50 smithi082 ceph-mon[94281]: pgmap v7173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:52 smithi082 ceph-mon[94281]: pgmap v7174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:54 smithi082 ceph-mon[94281]: pgmap v7175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:56 smithi082 ceph-mon[94281]: pgmap v7176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:59 smithi082 ceph-mon[94281]: pgmap v7177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:37.474 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:40.038 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:22:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:40.038 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:00 smithi082 ceph-mon[94281]: pgmap v7178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:40.038 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:00 smithi082 ceph-mon[94281]: pgmap v7179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:26:42.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:02 smithi082 ceph-mon[94281]: pgmap v7180: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:42.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:04 smithi082 ceph-mon[94281]: pgmap v7181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:26:42.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:06 smithi082 ceph-mon[94281]: pgmap v7182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:26:42.527 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:08 smithi082 ceph-mon[94281]: pgmap v7183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:10 smithi082 ceph-mon[94281]: pgmap v7184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:10 smithi082 ceph-mon[94281]: osdmap e514: 12 total, 12 up, 12 in 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:12 smithi082 ceph-mon[94281]: pgmap v7186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:14 smithi082 ceph-mon[94281]: pgmap v7187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:16 smithi082 ceph-mon[94281]: pgmap v7188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:18 smithi082 ceph-mon[94281]: pgmap v7189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:18 smithi082 ceph-mon[94281]: osdmap e515: 12 total, 12 up, 12 in 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:20 smithi082 ceph-mon[94281]: pgmap v7191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:22 smithi082 ceph-mon[94281]: pgmap v7192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:24 smithi082 ceph-mon[94281]: pgmap v7193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:26 smithi082 ceph-mon[94281]: pgmap v7194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:28 smithi082 ceph-mon[94281]: pgmap v7195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:30 smithi082 ceph-mon[94281]: pgmap v7196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:44.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:32 smithi082 ceph-mon[94281]: pgmap v7197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:44.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:34 smithi082 ceph-mon[94281]: pgmap v7198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:45.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:36 smithi082 ceph-mon[94281]: pgmap v7199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:45.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:38 smithi082 ceph-mon[94281]: pgmap v7200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:45.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:40 smithi082 ceph-mon[94281]: pgmap v7201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:45.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:42 smithi082 ceph-mon[94281]: pgmap v7202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:45.813 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:44 smithi082 ceph-mon[94281]: pgmap v7203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:45.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:45 smithi082 ceph-mon[94281]: pgmap v7204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:45.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:48 smithi082 ceph-mon[94281]: pgmap v7205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:45.814 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:50 smithi082 ceph-mon[94281]: pgmap v7206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:46.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:52 smithi082 ceph-mon[94281]: pgmap v7207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:46.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:54 smithi082 ceph-mon[94281]: pgmap v7208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:56 smithi082 ceph-mon[94281]: pgmap v7209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:58 smithi082 ceph-mon[94281]: pgmap v7210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:23:59 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:00 smithi082 ceph-mon[94281]: pgmap v7211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:00 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:47.521 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:48.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:48.271 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:02 smithi082 ceph-mon[94281]: pgmap v7212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:26:48.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:02 smithi082 ceph-mon[94281]: pgmap v7213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:26:48.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:04 smithi082 ceph-mon[94281]: pgmap v7214: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:26:48.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:06 smithi082 ceph-mon[94281]: pgmap v7215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:26:48.272 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:08 smithi082 ceph-mon[94281]: pgmap v7216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 57 KiB/s wr, 24 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:10 smithi082 ceph-mon[94281]: pgmap v7217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:10 smithi082 ceph-mon[94281]: osdmap e516: 12 total, 12 up, 12 in 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:12 smithi082 ceph-mon[94281]: pgmap v7219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:14 smithi082 ceph-mon[94281]: pgmap v7220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:16 smithi082 ceph-mon[94281]: pgmap v7221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:18 smithi082 ceph-mon[94281]: pgmap v7222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:18 smithi082 ceph-mon[94281]: osdmap e517: 12 total, 12 up, 12 in 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:20 smithi082 ceph-mon[94281]: pgmap v7224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:22 smithi082 ceph-mon[94281]: pgmap v7225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:24 smithi082 ceph-mon[94281]: pgmap v7226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:26 smithi082 ceph-mon[94281]: pgmap v7227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:48.959 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:28 smithi082 ceph-mon[94281]: pgmap v7228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:30 smithi082 ceph-mon[94281]: pgmap v7229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:32 smithi082 ceph-mon[94281]: pgmap v7230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:34 smithi082 ceph-mon[94281]: pgmap v7231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:36 smithi082 ceph-mon[94281]: pgmap v7232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:37 smithi082 ceph-mon[94281]: pgmap v7233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:40 smithi082 ceph-mon[94281]: pgmap v7234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:42 smithi082 ceph-mon[94281]: pgmap v7235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:44 smithi082 ceph-mon[94281]: pgmap v7236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:46 smithi082 ceph-mon[94281]: pgmap v7237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:48 smithi082 ceph-mon[94281]: pgmap v7238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:50 smithi082 ceph-mon[94281]: pgmap v7239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:52 smithi082 ceph-mon[94281]: pgmap v7240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:54 smithi082 ceph-mon[94281]: pgmap v7241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:56 smithi082 ceph-mon[94281]: pgmap v7242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.486 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:24:58 smithi082 ceph-mon[94281]: pgmap v7243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:00 smithi082 ceph-mon[94281]: pgmap v7244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:01 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:02 smithi082 ceph-mon[94281]: pgmap v7245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:02 smithi082 ceph-mon[94281]: pgmap v7246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:02 smithi082 ceph-mon[94281]: pgmap v7247: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:04 smithi082 ceph-mon[94281]: pgmap v7248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:06 smithi082 ceph-mon[94281]: pgmap v7249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:08 smithi082 ceph-mon[94281]: pgmap v7250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:10 smithi082 ceph-mon[94281]: pgmap v7251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:10 smithi082 ceph-mon[94281]: osdmap e518: 12 total, 12 up, 12 in 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:12 smithi082 ceph-mon[94281]: pgmap v7253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:14 smithi082 ceph-mon[94281]: pgmap v7254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:16 smithi082 ceph-mon[94281]: pgmap v7255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:49.487 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:18 smithi082 ceph-mon[94281]: pgmap v7256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:49.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:18 smithi082 ceph-mon[94281]: osdmap e519: 12 total, 12 up, 12 in 2023-03-17T12:26:49.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:20 smithi082 ceph-mon[94281]: pgmap v7258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:49.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:22 smithi082 ceph-mon[94281]: pgmap v7259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:49.488 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:24 smithi082 ceph-mon[94281]: pgmap v7260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:49.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:26 smithi082 ceph-mon[94281]: pgmap v7261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:50.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:28 smithi082 ceph-mon[94281]: pgmap v7262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:50.571 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:30 smithi082 ceph-mon[94281]: pgmap v7263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:32 smithi082 ceph-mon[94281]: pgmap v7264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:34 smithi082 ceph-mon[94281]: pgmap v7265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:36 smithi082 ceph-mon[94281]: pgmap v7266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:38 smithi082 ceph-mon[94281]: pgmap v7267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:40 smithi082 ceph-mon[94281]: pgmap v7268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:42 smithi082 ceph-mon[94281]: pgmap v7269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:44 smithi082 ceph-mon[94281]: pgmap v7270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:50.572 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:46 smithi082 ceph-mon[94281]: pgmap v7271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:50.573 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:48 smithi082 ceph-mon[94281]: pgmap v7272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:51.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:50 smithi082 ceph-mon[94281]: pgmap v7273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:51.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:52 smithi082 ceph-mon[94281]: pgmap v7274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:51.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:54 smithi082 ceph-mon[94281]: pgmap v7275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:51.677 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:56 smithi082 ceph-mon[94281]: pgmap v7276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:25:58 smithi082 ceph-mon[94281]: pgmap v7277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:00 smithi082 ceph-mon[94281]: pgmap v7278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:02 smithi082 ceph-mon[94281]: pgmap v7279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:03 smithi082 ceph-mon[94281]: pgmap v7280: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:03 smithi082 ceph-mon[94281]: pgmap v7281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:04 smithi082 ceph-mon[94281]: pgmap v7282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:53.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:07 smithi082 ceph-mon[94281]: pgmap v7283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:09 smithi082 ceph-mon[94281]: pgmap v7284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:10 smithi082 ceph-mon[94281]: osdmap e520: 12 total, 12 up, 12 in 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:11 smithi082 ceph-mon[94281]: pgmap v7286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:13 smithi082 ceph-mon[94281]: pgmap v7287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:13 smithi082 ceph-mon[94281]: osdmap e521: 12 total, 12 up, 12 in 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:15 smithi082 ceph-mon[94281]: pgmap v7289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:26:55.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:17 smithi082 ceph-mon[94281]: pgmap v7290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:19 smithi082 ceph-mon[94281]: pgmap v7291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:21 smithi082 ceph-mon[94281]: pgmap v7292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:23 smithi082 ceph-mon[94281]: pgmap v7293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:25 smithi082 ceph-mon[94281]: pgmap v7294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:27 smithi082 ceph-mon[94281]: pgmap v7295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:29 smithi082 ceph-mon[94281]: pgmap v7296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:31 smithi082 ceph-mon[94281]: pgmap v7297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:33 smithi082 ceph-mon[94281]: pgmap v7298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:35 smithi082 ceph-mon[94281]: pgmap v7299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:37 smithi082 ceph-mon[94281]: pgmap v7300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:39 smithi082 ceph-mon[94281]: pgmap v7301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:41 smithi082 ceph-mon[94281]: pgmap v7302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:43 smithi082 ceph-mon[94281]: pgmap v7303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:44 smithi082 ceph-mon[94281]: pgmap v7304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:55.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:47 smithi082 ceph-mon[94281]: pgmap v7305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:55.412 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:14 smithi035 ceph-mon[92535]: pgmap v6719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:56.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:16 smithi035 ceph-mon[92535]: pgmap v6720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:56.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:18 smithi035 ceph-mon[92535]: pgmap v6721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:56.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:18 smithi035 ceph-mon[92535]: osdmap e487: 12 total, 12 up, 12 in 2023-03-17T12:26:56.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:20 smithi035 ceph-mon[92535]: pgmap v6723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:26:56.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:22 smithi035 ceph-mon[92535]: pgmap v6724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:26:56.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:24 smithi035 ceph-mon[92535]: pgmap v6725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:56.702 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:26 smithi035 ceph-mon[92535]: pgmap v6726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:26:58.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:28 smithi035 ceph-mon[92535]: pgmap v6727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:26:58.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:30 smithi035 ceph-mon[92535]: pgmap v6728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:58.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:31 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:26:58.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:32 smithi035 ceph-mon[92535]: pgmap v6729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:26:58.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:26:59.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:26:59.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:26:59.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:33 smithi035 ceph-mon[92535]: pgmap v6730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:26:59.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:33 smithi035 ceph-mon[92535]: pgmap v6731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:26:59.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:35 smithi035 ceph-mon[92535]: pgmap v6732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:37 smithi035 ceph-mon[92535]: pgmap v6733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:39 smithi035 ceph-mon[92535]: pgmap v6734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:41 smithi035 ceph-mon[92535]: pgmap v6735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:43 smithi035 ceph-mon[92535]: pgmap v6736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:45 smithi035 ceph-mon[92535]: pgmap v6737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:47 smithi035 ceph-mon[92535]: pgmap v6738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:00.487 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:49 smithi035 ceph-mon[92535]: pgmap v6739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:51 smithi035 ceph-mon[92535]: pgmap v6740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:53 smithi035 ceph-mon[92535]: pgmap v6741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:55 smithi035 ceph-mon[92535]: pgmap v6742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:57 smithi035 ceph-mon[92535]: pgmap v6743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:09:59 smithi035 ceph-mon[92535]: pgmap v6744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:01 smithi035 ceph-mon[92535]: pgmap v6745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:03 smithi035 ceph-mon[92535]: pgmap v6746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:01.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:05 smithi035 ceph-mon[92535]: pgmap v6747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:02.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:07 smithi035 ceph-mon[92535]: pgmap v6748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:02.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:09 smithi035 ceph-mon[92535]: pgmap v6749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:02.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:10 smithi035 ceph-mon[92535]: osdmap e488: 12 total, 12 up, 12 in 2023-03-17T12:27:02.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:11 smithi035 ceph-mon[92535]: pgmap v6751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:02.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:12 smithi035 ceph-mon[92535]: pgmap v6752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:02.267 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:15 smithi035 ceph-mon[92535]: pgmap v6753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:02.673 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:17 smithi035 ceph-mon[92535]: pgmap v6754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:02.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:19 smithi035 ceph-mon[92535]: pgmap v6755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:02.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:19 smithi035 ceph-mon[92535]: osdmap e489: 12 total, 12 up, 12 in 2023-03-17T12:27:02.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:21 smithi035 ceph-mon[92535]: pgmap v6757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:02.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:23 smithi035 ceph-mon[92535]: pgmap v6758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:02.674 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:25 smithi035 ceph-mon[92535]: pgmap v6759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:03.902 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:27 smithi035 ceph-mon[92535]: pgmap v6760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:04.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:29 smithi035 ceph-mon[92535]: pgmap v6761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:04.722 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:31 smithi035 ceph-mon[92535]: pgmap v6762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:27:07.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:32 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:07.853 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:33 smithi035 ceph-mon[92535]: pgmap v6763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:07.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:07.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:07.854 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:34 smithi035 ceph-mon[92535]: pgmap v6764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 op/s 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:34 smithi035 ceph-mon[92535]: pgmap v6765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:36 smithi035 ceph-mon[92535]: pgmap v6766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:38 smithi035 ceph-mon[92535]: pgmap v6767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:40 smithi035 ceph-mon[92535]: pgmap v6768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:42 smithi035 ceph-mon[92535]: pgmap v6769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:08.512 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:44 smithi035 ceph-mon[92535]: pgmap v6770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:08.513 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:46 smithi035 ceph-mon[92535]: pgmap v6771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:09.700 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:48 smithi035 ceph-mon[92535]: pgmap v6772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:09.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:50 smithi035 ceph-mon[92535]: pgmap v6773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:09.701 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:52 smithi035 ceph-mon[92535]: pgmap v6774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:54 smithi035 ceph-mon[92535]: pgmap v6775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:56 smithi035 ceph-mon[92535]: pgmap v6776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:10:58 smithi035 ceph-mon[92535]: pgmap v6777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:00 smithi035 ceph-mon[92535]: pgmap v6778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:02 smithi035 ceph-mon[92535]: pgmap v6779: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:04 smithi035 ceph-mon[92535]: pgmap v6780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:06 smithi035 ceph-mon[92535]: pgmap v6781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:08 smithi035 ceph-mon[92535]: pgmap v6782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:10 smithi035 ceph-mon[92535]: pgmap v6783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:10 smithi035 ceph-mon[92535]: osdmap e490: 12 total, 12 up, 12 in 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:12 smithi035 ceph-mon[92535]: pgmap v6785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:14 smithi035 ceph-mon[92535]: pgmap v6786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:11.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:16 smithi035 ceph-mon[92535]: pgmap v6787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:11.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:18 smithi035 ceph-mon[92535]: pgmap v6788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:11.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:18 smithi035 ceph-mon[92535]: osdmap e491: 12 total, 12 up, 12 in 2023-03-17T12:27:11.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:20 smithi035 ceph-mon[92535]: pgmap v6790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:27:11.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:22 smithi035 ceph-mon[92535]: pgmap v6791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:11.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:24 smithi035 ceph-mon[92535]: pgmap v6792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:11.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:26 smithi035 ceph-mon[92535]: pgmap v6793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:12.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:28 smithi035 ceph-mon[92535]: pgmap v6794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:12.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:30 smithi035 ceph-mon[92535]: pgmap v6795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:27:12.019 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:32 smithi035 ceph-mon[92535]: pgmap v6796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:12.424 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:33 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:34 smithi035 ceph-mon[92535]: pgmap v6797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:34 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:36 smithi035 ceph-mon[92535]: pgmap v6798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:36 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.425 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.426 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:12.426 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:27:13.655 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: pgmap v6799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:38 smithi035 ceph-mon[92535]: pgmap v6800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:40 smithi035 ceph-mon[92535]: pgmap v6801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:42 smithi035 ceph-mon[92535]: pgmap v6802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:13.656 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:44 smithi035 ceph-mon[92535]: pgmap v6803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:15.158 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:46 smithi035 ceph-mon[92535]: pgmap v6804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:15.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:48 smithi035 ceph-mon[92535]: pgmap v6805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:15.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:50 smithi035 ceph-mon[92535]: pgmap v6806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:27:15.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:52 smithi035 ceph-mon[92535]: pgmap v6807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:15.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:54 smithi035 ceph-mon[92535]: pgmap v6808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:15.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:56 smithi035 ceph-mon[92535]: pgmap v6809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:15.159 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:58 smithi035 ceph-mon[92535]: pgmap v6810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:11:59 smithi035 ceph-mon[92535]: pgmap v6811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:02 smithi035 ceph-mon[92535]: pgmap v6812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:04 smithi035 ceph-mon[92535]: pgmap v6813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:06 smithi035 ceph-mon[92535]: pgmap v6814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:08 smithi035 ceph-mon[92535]: pgmap v6815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:10 smithi035 ceph-mon[92535]: pgmap v6816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:15.760 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:10 smithi035 ceph-mon[92535]: osdmap e492: 12 total, 12 up, 12 in 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:12 smithi035 ceph-mon[92535]: pgmap v6818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:14 smithi035 ceph-mon[92535]: pgmap v6819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:16 smithi035 ceph-mon[92535]: pgmap v6820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:18 smithi035 ceph-mon[92535]: pgmap v6821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:18 smithi035 ceph-mon[92535]: osdmap e493: 12 total, 12 up, 12 in 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:20 smithi035 ceph-mon[92535]: pgmap v6823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:22 smithi035 ceph-mon[92535]: pgmap v6824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:24 smithi035 ceph-mon[92535]: pgmap v6825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:26 smithi035 ceph-mon[92535]: pgmap v6826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:28 smithi035 ceph-mon[92535]: pgmap v6827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:30 smithi035 ceph-mon[92535]: pgmap v6828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:32 smithi035 ceph-mon[92535]: pgmap v6829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:34 smithi035 ceph-mon[92535]: pgmap v6830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:15.761 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:36 smithi035 ceph-mon[92535]: pgmap v6831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:15.762 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:37 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:38 smithi035 ceph-mon[92535]: pgmap v6832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:40 smithi035 ceph-mon[92535]: pgmap v6833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: pgmap v6834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:17.135 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: pgmap v6835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:17.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:17.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:44 smithi035 ceph-mon[92535]: pgmap v6836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:17.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:46 smithi035 ceph-mon[92535]: pgmap v6837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:17.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:48 smithi035 ceph-mon[92535]: pgmap v6838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2023-03-17T12:27:17.958 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:50 smithi035 ceph-mon[92535]: pgmap v6839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:52 smithi035 ceph-mon[92535]: pgmap v6840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:54 smithi035 ceph-mon[92535]: pgmap v6841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:56 smithi035 ceph-mon[92535]: pgmap v6842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:12:58 smithi035 ceph-mon[92535]: pgmap v6843: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:00 smithi035 ceph-mon[92535]: pgmap v6844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:02 smithi035 ceph-mon[92535]: pgmap v6845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:04 smithi035 ceph-mon[92535]: pgmap v6846: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:06 smithi035 ceph-mon[92535]: pgmap v6847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:08 smithi035 ceph-mon[92535]: pgmap v6848: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:10 smithi035 ceph-mon[92535]: pgmap v6849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:10 smithi035 ceph-mon[92535]: osdmap e494: 12 total, 12 up, 12 in 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:12 smithi035 ceph-mon[92535]: pgmap v6851: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:18.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:14 smithi035 ceph-mon[92535]: pgmap v6852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:16 smithi035 ceph-mon[92535]: pgmap v6853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:18 smithi035 ceph-mon[92535]: pgmap v6854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:18 smithi035 ceph-mon[92535]: osdmap e495: 12 total, 12 up, 12 in 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:20 smithi035 ceph-mon[92535]: pgmap v6856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:22 smithi035 ceph-mon[92535]: pgmap v6857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:24 smithi035 ceph-mon[92535]: pgmap v6858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:26 smithi035 ceph-mon[92535]: pgmap v6859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:28 smithi035 ceph-mon[92535]: pgmap v6860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:18.786 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:30 smithi035 ceph-mon[92535]: pgmap v6861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:27:20.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:32 smithi035 ceph-mon[92535]: pgmap v6862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:20.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:34 smithi035 ceph-mon[92535]: pgmap v6863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:20.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:36 smithi035 ceph-mon[92535]: pgmap v6864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:20.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:38 smithi035 ceph-mon[92535]: pgmap v6865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:20.999 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:40 smithi035 ceph-mon[92535]: pgmap v6866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:21.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:21.000 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:41 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:42 smithi035 ceph-mon[92535]: pgmap v6867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:44 smithi035 ceph-mon[92535]: pgmap v6868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:23.386 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:24.772 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: pgmap v6869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:25.324 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: pgmap v6870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:47 smithi035 ceph-mon[92535]: pgmap v6871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:50 smithi035 ceph-mon[92535]: pgmap v6872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:52 smithi035 ceph-mon[92535]: pgmap v6873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:54 smithi035 ceph-mon[92535]: pgmap v6874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:56 smithi035 ceph-mon[92535]: pgmap v6875: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:13:58 smithi035 ceph-mon[92535]: pgmap v6876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:00 smithi035 ceph-mon[92535]: pgmap v6877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:02 smithi035 ceph-mon[92535]: pgmap v6878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:04 smithi035 ceph-mon[92535]: pgmap v6879: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:26.799 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:06 smithi035 ceph-mon[92535]: pgmap v6880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:27.963 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:08 smithi035 ceph-mon[92535]: pgmap v6881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:10 smithi035 ceph-mon[92535]: pgmap v6882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:10 smithi035 ceph-mon[92535]: osdmap e496: 12 total, 12 up, 12 in 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:12 smithi035 ceph-mon[92535]: pgmap v6884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:14 smithi035 ceph-mon[92535]: pgmap v6885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:16 smithi035 ceph-mon[92535]: pgmap v6886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:18 smithi035 ceph-mon[92535]: pgmap v6887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:18 smithi035 ceph-mon[92535]: osdmap e497: 12 total, 12 up, 12 in 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:20 smithi035 ceph-mon[92535]: pgmap v6889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:22 smithi035 ceph-mon[92535]: pgmap v6890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:29.329 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:24 smithi035 ceph-mon[92535]: pgmap v6891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:26 smithi035 ceph-mon[92535]: pgmap v6892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:28 smithi035 ceph-mon[92535]: pgmap v6893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:30 smithi035 ceph-mon[92535]: pgmap v6894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:32 smithi035 ceph-mon[92535]: pgmap v6895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:34 smithi035 ceph-mon[92535]: pgmap v6896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:36 smithi035 ceph-mon[92535]: pgmap v6897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:38 smithi035 ceph-mon[92535]: pgmap v6898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:40 smithi035 ceph-mon[92535]: pgmap v6899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:42 smithi035 ceph-mon[92535]: pgmap v6900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:44 smithi035 ceph-mon[92535]: pgmap v6901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:45 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:46 smithi035 ceph-mon[92535]: pgmap v6902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:48 smithi035 ceph-mon[92535]: pgmap v6903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:30.491 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: pgmap v6904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: pgmap v6905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:30.492 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:51 smithi035 ceph-mon[92535]: pgmap v6906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:32.020 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:54 smithi035 ceph-mon[92535]: pgmap v6907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:56 smithi035 ceph-mon[92535]: pgmap v6908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:14:58 smithi035 ceph-mon[92535]: pgmap v6909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:00 smithi035 ceph-mon[92535]: pgmap v6910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:02 smithi035 ceph-mon[92535]: pgmap v6911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:04 smithi035 ceph-mon[92535]: pgmap v6912: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:06 smithi035 ceph-mon[92535]: pgmap v6913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:08 smithi035 ceph-mon[92535]: pgmap v6914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:32.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:10 smithi035 ceph-mon[92535]: pgmap v6915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:32.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:10 smithi035 ceph-mon[92535]: osdmap e498: 12 total, 12 up, 12 in 2023-03-17T12:27:32.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:12 smithi035 ceph-mon[92535]: pgmap v6917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:32.022 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:14 smithi035 ceph-mon[92535]: pgmap v6918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:32.822 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:16 smithi035 ceph-mon[92535]: pgmap v6919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:32.822 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:18 smithi035 ceph-mon[92535]: pgmap v6920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:32.822 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:18 smithi035 ceph-mon[92535]: osdmap e499: 12 total, 12 up, 12 in 2023-03-17T12:27:34.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:20 smithi035 ceph-mon[92535]: pgmap v6922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:27:34.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:22 smithi035 ceph-mon[92535]: pgmap v6923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:34.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:24 smithi035 ceph-mon[92535]: pgmap v6924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:34.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:26 smithi035 ceph-mon[92535]: pgmap v6925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:28 smithi035 ceph-mon[92535]: pgmap v6926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:30 smithi035 ceph-mon[92535]: pgmap v6927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:32 smithi035 ceph-mon[92535]: pgmap v6928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:34 smithi035 ceph-mon[92535]: pgmap v6929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:36 smithi035 ceph-mon[92535]: pgmap v6930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:38 smithi035 ceph-mon[92535]: pgmap v6931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:40 smithi035 ceph-mon[92535]: pgmap v6932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:42 smithi035 ceph-mon[92535]: pgmap v6933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:35.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:44 smithi035 ceph-mon[92535]: pgmap v6934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:46 smithi035 ceph-mon[92535]: pgmap v6935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:48 smithi035 ceph-mon[92535]: pgmap v6936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:49 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:50 smithi035 ceph-mon[92535]: pgmap v6937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:51 smithi035 ceph-mon[92535]: pgmap v6938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:27:36.400 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:51 smithi035 ceph-mon[92535]: pgmap v6939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-03-17T12:27:36.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:53 smithi035 ceph-mon[92535]: pgmap v6940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:36.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:55 smithi035 ceph-mon[92535]: pgmap v6941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:36.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:57 smithi035 ceph-mon[92535]: pgmap v6942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:36.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:15:59 smithi035 ceph-mon[92535]: pgmap v6943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:36.741 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:01 smithi035 ceph-mon[92535]: pgmap v6944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:03 smithi035 ceph-mon[92535]: pgmap v6945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:05 smithi035 ceph-mon[92535]: pgmap v6946: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:07 smithi035 ceph-mon[92535]: pgmap v6947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:09 smithi035 ceph-mon[92535]: pgmap v6948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:10 smithi035 ceph-mon[92535]: osdmap e500: 12 total, 12 up, 12 in 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:11 smithi035 ceph-mon[92535]: pgmap v6950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:12 smithi035 ceph-mon[92535]: pgmap v6951: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:37.602 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:15 smithi035 ceph-mon[92535]: pgmap v6952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:17 smithi035 ceph-mon[92535]: pgmap v6953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:19 smithi035 ceph-mon[92535]: pgmap v6954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:19 smithi035 ceph-mon[92535]: osdmap e501: 12 total, 12 up, 12 in 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:21 smithi035 ceph-mon[92535]: pgmap v6956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:23 smithi035 ceph-mon[92535]: pgmap v6957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:25 smithi035 ceph-mon[92535]: pgmap v6958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:27 smithi035 ceph-mon[92535]: pgmap v6959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:29 smithi035 ceph-mon[92535]: pgmap v6960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:31 smithi035 ceph-mon[92535]: pgmap v6961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:33 smithi035 ceph-mon[92535]: pgmap v6962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:35 smithi035 ceph-mon[92535]: pgmap v6963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:37 smithi035 ceph-mon[92535]: pgmap v6964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:39 smithi035 ceph-mon[92535]: pgmap v6965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:41 smithi035 ceph-mon[92535]: pgmap v6966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:43 smithi035 ceph-mon[92535]: pgmap v6967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:45 smithi035 ceph-mon[92535]: pgmap v6968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:37.603 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:47 smithi035 ceph-mon[92535]: pgmap v6969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:37.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:49 smithi035 ceph-mon[92535]: pgmap v6970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:37.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:37.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:37.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:37.604 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:50 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:38.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:51 smithi035 ceph-mon[92535]: pgmap v6971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:38.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:51 smithi035 ceph-mon[92535]: pgmap v6972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:27:38.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:51 smithi035 ceph-mon[92535]: pgmap v6973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:38.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:53 smithi035 ceph-mon[92535]: pgmap v6974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:38.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:55 smithi035 ceph-mon[92535]: pgmap v6975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:38.848 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:57 smithi035 ceph-mon[92535]: pgmap v6976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:16:59 smithi035 ceph-mon[92535]: pgmap v6977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:01 smithi035 ceph-mon[92535]: pgmap v6978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:03 smithi035 ceph-mon[92535]: pgmap v6979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:05 smithi035 ceph-mon[92535]: pgmap v6980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:07 smithi035 ceph-mon[92535]: pgmap v6981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:09 smithi035 ceph-mon[92535]: pgmap v6982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:10 smithi035 ceph-mon[92535]: osdmap e502: 12 total, 12 up, 12 in 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:11 smithi035 ceph-mon[92535]: pgmap v6984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:13 smithi035 ceph-mon[92535]: pgmap v6985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:13 smithi035 ceph-mon[92535]: osdmap e503: 12 total, 12 up, 12 in 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:15 smithi035 ceph-mon[92535]: pgmap v6987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:17 smithi035 ceph-mon[92535]: pgmap v6988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:19 smithi035 ceph-mon[92535]: pgmap v6989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-17T12:27:38.849 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:21 smithi035 ceph-mon[92535]: pgmap v6990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:38.850 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:23 smithi035 ceph-mon[92535]: pgmap v6991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:39.622 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:25 smithi035 ceph-mon[92535]: pgmap v6992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T12:27:39.622 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:27 smithi035 ceph-mon[92535]: pgmap v6993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:27:39.622 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:29 smithi035 ceph-mon[92535]: pgmap v6994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:27:39.622 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:30 smithi035 ceph-mon[92535]: pgmap v6995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:39.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:33 smithi035 ceph-mon[92535]: pgmap v6996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:39.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:35 smithi035 ceph-mon[92535]: pgmap v6997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:39.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:37 smithi035 ceph-mon[92535]: pgmap v6998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:39.623 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:39 smithi035 ceph-mon[92535]: pgmap v6999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:40.570 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:41 smithi035 ceph-mon[92535]: pgmap v7000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:43 smithi035 ceph-mon[92535]: pgmap v7001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:45 smithi035 ceph-mon[92535]: pgmap v7002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:47 smithi035 ceph-mon[92535]: pgmap v7003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:49 smithi035 ceph-mon[92535]: pgmap v7004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:51 smithi035 ceph-mon[92535]: pgmap v7005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:40.571 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:41.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:41.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:41.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:52 smithi035 ceph-mon[92535]: pgmap v7006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:27:41.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:52 smithi035 ceph-mon[92535]: pgmap v7007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:54 smithi035 ceph-mon[92535]: pgmap v7008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:56 smithi035 ceph-mon[92535]: pgmap v7009: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:17:58 smithi035 ceph-mon[92535]: pgmap v7010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:00 smithi035 ceph-mon[92535]: pgmap v7011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:02 smithi035 ceph-mon[92535]: pgmap v7012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:04 smithi035 ceph-mon[92535]: pgmap v7013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:06 smithi035 ceph-mon[92535]: pgmap v7014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:08 smithi035 ceph-mon[92535]: pgmap v7015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:10 smithi035 ceph-mon[92535]: pgmap v7016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:10 smithi035 ceph-mon[92535]: osdmap e504: 12 total, 12 up, 12 in 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:12 smithi035 ceph-mon[92535]: pgmap v7018: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:14 smithi035 ceph-mon[92535]: pgmap v7019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:42.215 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:16 smithi035 ceph-mon[92535]: pgmap v7020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:42.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:18 smithi035 ceph-mon[92535]: pgmap v7021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:42.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:18 smithi035 ceph-mon[92535]: osdmap e505: 12 total, 12 up, 12 in 2023-03-17T12:27:42.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:20 smithi035 ceph-mon[92535]: pgmap v7023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:27:42.216 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:22 smithi035 ceph-mon[92535]: pgmap v7024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:24 smithi035 ceph-mon[92535]: pgmap v7025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:25 smithi035 ceph-mon[92535]: pgmap v7026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:28 smithi035 ceph-mon[92535]: pgmap v7027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:30 smithi035 ceph-mon[92535]: pgmap v7028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:32 smithi035 ceph-mon[92535]: pgmap v7029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:34 smithi035 ceph-mon[92535]: pgmap v7030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:36 smithi035 ceph-mon[92535]: pgmap v7031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:38 smithi035 ceph-mon[92535]: pgmap v7032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:40 smithi035 ceph-mon[92535]: pgmap v7033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:42 smithi035 ceph-mon[92535]: pgmap v7034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:44 smithi035 ceph-mon[92535]: pgmap v7035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:44.004 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:46 smithi035 ceph-mon[92535]: pgmap v7036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:48 smithi035 ceph-mon[92535]: pgmap v7037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:50 smithi035 ceph-mon[92535]: pgmap v7038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:51 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:52 smithi035 ceph-mon[92535]: pgmap v7039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:44.005 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:45.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:53 smithi035 ceph-mon[92535]: pgmap v7040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:27:45.488 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:53 smithi035 ceph-mon[92535]: pgmap v7041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:55 smithi035 ceph-mon[92535]: pgmap v7042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:57 smithi035 ceph-mon[92535]: pgmap v7043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:18:59 smithi035 ceph-mon[92535]: pgmap v7044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:01 smithi035 ceph-mon[92535]: pgmap v7045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:03 smithi035 ceph-mon[92535]: pgmap v7046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:05 smithi035 ceph-mon[92535]: pgmap v7047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:07 smithi035 ceph-mon[92535]: pgmap v7048: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:09 smithi035 ceph-mon[92535]: pgmap v7049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:10 smithi035 ceph-mon[92535]: osdmap e506: 12 total, 12 up, 12 in 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:11 smithi035 ceph-mon[92535]: pgmap v7051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:46.141 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:13 smithi035 ceph-mon[92535]: pgmap v7052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:13 smithi035 ceph-mon[92535]: osdmap e507: 12 total, 12 up, 12 in 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:15 smithi035 ceph-mon[92535]: pgmap v7054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:17 smithi035 ceph-mon[92535]: pgmap v7055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:19 smithi035 ceph-mon[92535]: pgmap v7056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:21 smithi035 ceph-mon[92535]: pgmap v7057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:23 smithi035 ceph-mon[92535]: pgmap v7058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:25 smithi035 ceph-mon[92535]: pgmap v7059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 96 B/s wr, 9 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:27 smithi035 ceph-mon[92535]: pgmap v7060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:29 smithi035 ceph-mon[92535]: pgmap v7061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:31 smithi035 ceph-mon[92535]: pgmap v7062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:33 smithi035 ceph-mon[92535]: pgmap v7063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:35 smithi035 ceph-mon[92535]: pgmap v7064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:36 smithi035 ceph-mon[92535]: pgmap v7065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:39 smithi035 ceph-mon[92535]: pgmap v7066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:41 smithi035 ceph-mon[92535]: pgmap v7067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:43 smithi035 ceph-mon[92535]: pgmap v7068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:46.142 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:45 smithi035 ceph-mon[92535]: pgmap v7069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:47 smithi035 ceph-mon[92535]: pgmap v7070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:49 smithi035 ceph-mon[92535]: pgmap v7071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:46.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:51 smithi035 ceph-mon[92535]: pgmap v7072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:46.143 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:52 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:53 smithi035 ceph-mon[92535]: pgmap v7073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:54 smithi035 ceph-mon[92535]: pgmap v7074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:54 smithi035 ceph-mon[92535]: pgmap v7075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:56 smithi035 ceph-mon[92535]: pgmap v7076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:19:58 smithi035 ceph-mon[92535]: pgmap v7077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:00 smithi035 ceph-mon[92535]: pgmap v7078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:02 smithi035 ceph-mon[92535]: pgmap v7079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:04 smithi035 ceph-mon[92535]: pgmap v7080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:48.295 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:06 smithi035 ceph-mon[92535]: pgmap v7081: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:08 smithi035 ceph-mon[92535]: pgmap v7082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:10 smithi035 ceph-mon[92535]: pgmap v7083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:10 smithi035 ceph-mon[92535]: osdmap e508: 12 total, 12 up, 12 in 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:12 smithi035 ceph-mon[92535]: pgmap v7085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:14 smithi035 ceph-mon[92535]: pgmap v7086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:16 smithi035 ceph-mon[92535]: pgmap v7087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:18 smithi035 ceph-mon[92535]: pgmap v7088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:18 smithi035 ceph-mon[92535]: osdmap e509: 12 total, 12 up, 12 in 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:20 smithi035 ceph-mon[92535]: pgmap v7090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:22 smithi035 ceph-mon[92535]: pgmap v7091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:24 smithi035 ceph-mon[92535]: pgmap v7092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:26 smithi035 ceph-mon[92535]: pgmap v7093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:28 smithi035 ceph-mon[92535]: pgmap v7094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:30 smithi035 ceph-mon[92535]: pgmap v7095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:32 smithi035 ceph-mon[92535]: pgmap v7096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:34 smithi035 ceph-mon[92535]: pgmap v7097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:48.296 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:36 smithi035 ceph-mon[92535]: pgmap v7098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:38 smithi035 ceph-mon[92535]: pgmap v7099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:40 smithi035 ceph-mon[92535]: pgmap v7100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:42 smithi035 ceph-mon[92535]: pgmap v7101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:44 smithi035 ceph-mon[92535]: pgmap v7102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:46 smithi035 ceph-mon[92535]: pgmap v7103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:47 smithi035 ceph-mon[92535]: pgmap v7104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:50 smithi035 ceph-mon[92535]: pgmap v7105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:48.297 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:52 smithi035 ceph-mon[92535]: pgmap v7106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:50.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:53 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:27:50.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:54 smithi035 ceph-mon[92535]: pgmap v7107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:55 smithi035 ceph-mon[92535]: pgmap v7108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:55 smithi035 ceph-mon[92535]: pgmap v7109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:50.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:57 smithi035 ceph-mon[92535]: pgmap v7110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:50.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:20:59 smithi035 ceph-mon[92535]: pgmap v7111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:50.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:01 smithi035 ceph-mon[92535]: pgmap v7112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:27:50.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:03 smithi035 ceph-mon[92535]: pgmap v7113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 KiB/s wr, 26 op/s 2023-03-17T12:27:50.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:05 smithi035 ceph-mon[92535]: pgmap v7114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:50.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:07 smithi035 ceph-mon[92535]: pgmap v7115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:27:50.507 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:09 smithi035 ceph-mon[92535]: pgmap v7116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:27:52.084 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:10 smithi035 ceph-mon[92535]: osdmap e510: 12 total, 12 up, 12 in 2023-03-17T12:27:52.085 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:11 smithi035 ceph-mon[92535]: pgmap v7118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:27:53.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:13 smithi035 ceph-mon[92535]: pgmap v7119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-03-17T12:27:53.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:15 smithi035 ceph-mon[92535]: pgmap v7120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:53.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:17 smithi035 ceph-mon[92535]: pgmap v7121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:54.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:19 smithi035 ceph-mon[92535]: pgmap v7122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:54.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:19 smithi035 ceph-mon[92535]: osdmap e511: 12 total, 12 up, 12 in 2023-03-17T12:27:54.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:21 smithi035 ceph-mon[92535]: pgmap v7124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:27:54.482 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:23 smithi035 ceph-mon[92535]: pgmap v7125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:54.483 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:25 smithi035 ceph-mon[92535]: pgmap v7126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:55.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:27 smithi035 ceph-mon[92535]: pgmap v7127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:27:55.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:29 smithi035 ceph-mon[92535]: pgmap v7128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:27:55.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:31 smithi035 ceph-mon[92535]: pgmap v7129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:27:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:33 smithi035 ceph-mon[92535]: pgmap v7130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:35 smithi035 ceph-mon[92535]: pgmap v7131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:37 smithi035 ceph-mon[92535]: pgmap v7132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:57.263 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:39 smithi035 ceph-mon[92535]: pgmap v7133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:59.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:41 smithi035 ceph-mon[92535]: pgmap v7134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:59.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:43 smithi035 ceph-mon[92535]: pgmap v7135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:59.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:45 smithi035 ceph-mon[92535]: pgmap v7136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:59.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:47 smithi035 ceph-mon[92535]: pgmap v7137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:59.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:49 smithi035 ceph-mon[92535]: pgmap v7138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:59.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:51 smithi035 ceph-mon[92535]: pgmap v7139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:27:59.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:53 smithi035 ceph-mon[92535]: pgmap v7140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:27:59.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:54 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:28:01.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:55 smithi035 ceph-mon[92535]: pgmap v7141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:01.175 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:55 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: pgmap v7142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:57 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:01.176 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:02.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:02.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.704 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: pgmap v7143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:02.705 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: pgmap v7144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: pgmap v7145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:21:58 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:00 smithi035 ceph-mon[92535]: pgmap v7146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:02 smithi035 ceph-mon[92535]: pgmap v7147: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2023-03-17T12:28:02.706 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:04 smithi035 ceph-mon[92535]: pgmap v7148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2023-03-17T12:28:04.820 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:06 smithi035 ceph-mon[92535]: pgmap v7149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 63 KiB/s wr, 26 op/s 2023-03-17T12:28:04.820 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:09 smithi035 ceph-mon[92535]: pgmap v7150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:28:04.820 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:10 smithi035 ceph-mon[92535]: osdmap e512: 12 total, 12 up, 12 in 2023-03-17T12:28:04.820 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:11 smithi035 ceph-mon[92535]: pgmap v7152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:28:04.820 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:12 smithi035 ceph-mon[92535]: pgmap v7153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:05.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:14 smithi035 ceph-mon[92535]: osdmap e513: 12 total, 12 up, 12 in 2023-03-17T12:28:05.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:15 smithi035 ceph-mon[92535]: pgmap v7155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:28:05.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:16 smithi035 ceph-mon[92535]: pgmap v7156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:28:05.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:19 smithi035 ceph-mon[92535]: pgmap v7157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 226 B/s wr, 11 op/s 2023-03-17T12:28:05.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:20 smithi035 ceph-mon[92535]: pgmap v7158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:05.711 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:22 smithi035 ceph-mon[92535]: pgmap v7159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:28:06.500 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:24 smithi035 ceph-mon[92535]: pgmap v7160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 92 B/s wr, 8 op/s 2023-03-17T12:28:07.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:26 smithi035 ceph-mon[92535]: pgmap v7161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:28:07.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:29 smithi035 ceph-mon[92535]: pgmap v7162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:28:07.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:30 smithi035 ceph-mon[92535]: pgmap v7163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:28:07.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:32 smithi035 ceph-mon[92535]: pgmap v7164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:28:07.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:34 smithi035 ceph-mon[92535]: pgmap v7165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:28:07.803 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:36 smithi035 ceph-mon[92535]: pgmap v7166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:28:07.804 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:39 smithi035 ceph-mon[92535]: pgmap v7167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:40 smithi035 ceph-mon[92535]: pgmap v7168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:42 smithi035 ceph-mon[92535]: pgmap v7169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:44 smithi035 ceph-mon[92535]: pgmap v7170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:46 smithi035 ceph-mon[92535]: pgmap v7171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:49 smithi035 ceph-mon[92535]: pgmap v7172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:50 smithi035 ceph-mon[92535]: pgmap v7173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:52 smithi035 ceph-mon[92535]: pgmap v7174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:54 smithi035 ceph-mon[92535]: pgmap v7175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:56 smithi035 ceph-mon[92535]: pgmap v7176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:59 smithi035 ceph-mon[92535]: pgmap v7177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:28:10.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:22:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:00 smithi035 ceph-mon[92535]: pgmap v7178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:00 smithi035 ceph-mon[92535]: pgmap v7179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:02 smithi035 ceph-mon[92535]: pgmap v7180: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:04 smithi035 ceph-mon[92535]: pgmap v7181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:06 smithi035 ceph-mon[92535]: pgmap v7182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:08 smithi035 ceph-mon[92535]: pgmap v7183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:10 smithi035 ceph-mon[92535]: pgmap v7184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:10 smithi035 ceph-mon[92535]: osdmap e514: 12 total, 12 up, 12 in 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:12 smithi035 ceph-mon[92535]: pgmap v7186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:14 smithi035 ceph-mon[92535]: pgmap v7187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:16 smithi035 ceph-mon[92535]: pgmap v7188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:10.068 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:18 smithi035 ceph-mon[92535]: pgmap v7189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:18 smithi035 ceph-mon[92535]: osdmap e515: 12 total, 12 up, 12 in 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:20 smithi035 ceph-mon[92535]: pgmap v7191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:22 smithi035 ceph-mon[92535]: pgmap v7192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:24 smithi035 ceph-mon[92535]: pgmap v7193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:26 smithi035 ceph-mon[92535]: pgmap v7194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:28 smithi035 ceph-mon[92535]: pgmap v7195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:30 smithi035 ceph-mon[92535]: pgmap v7196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:32 smithi035 ceph-mon[92535]: pgmap v7197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:34 smithi035 ceph-mon[92535]: pgmap v7198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:36 smithi035 ceph-mon[92535]: pgmap v7199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:38 smithi035 ceph-mon[92535]: pgmap v7200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:40 smithi035 ceph-mon[92535]: pgmap v7201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:42 smithi035 ceph-mon[92535]: pgmap v7202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.730 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:44 smithi035 ceph-mon[92535]: pgmap v7203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:45 smithi035 ceph-mon[92535]: pgmap v7204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:48 smithi035 ceph-mon[92535]: pgmap v7205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:50 smithi035 ceph-mon[92535]: pgmap v7206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:52 smithi035 ceph-mon[92535]: pgmap v7207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:54 smithi035 ceph-mon[92535]: pgmap v7208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:56 smithi035 ceph-mon[92535]: pgmap v7209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:58 smithi035 ceph-mon[92535]: pgmap v7210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:23:59 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:00 smithi035 ceph-mon[92535]: pgmap v7211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:00 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:02 smithi035 ceph-mon[92535]: pgmap v7212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:02 smithi035 ceph-mon[92535]: pgmap v7213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:28:13.731 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:04 smithi035 ceph-mon[92535]: pgmap v7214: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:28:13.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:06 smithi035 ceph-mon[92535]: pgmap v7215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:08 smithi035 ceph-mon[92535]: pgmap v7216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 57 KiB/s wr, 24 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:10 smithi035 ceph-mon[92535]: pgmap v7217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:10 smithi035 ceph-mon[92535]: osdmap e516: 12 total, 12 up, 12 in 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:12 smithi035 ceph-mon[92535]: pgmap v7219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:14 smithi035 ceph-mon[92535]: pgmap v7220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:16 smithi035 ceph-mon[92535]: pgmap v7221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:18 smithi035 ceph-mon[92535]: pgmap v7222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:18 smithi035 ceph-mon[92535]: osdmap e517: 12 total, 12 up, 12 in 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:20 smithi035 ceph-mon[92535]: pgmap v7224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:22 smithi035 ceph-mon[92535]: pgmap v7225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:24 smithi035 ceph-mon[92535]: pgmap v7226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:17.584 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:26 smithi035 ceph-mon[92535]: pgmap v7227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:18.814 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:28 smithi035 ceph-mon[92535]: pgmap v7228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:19.985 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:30 smithi035 ceph-mon[92535]: pgmap v7229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:28:19.986 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:32 smithi035 ceph-mon[92535]: pgmap v7230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:21.020 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:34 smithi035 ceph-mon[92535]: pgmap v7231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:21.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:36 smithi035 ceph-mon[92535]: pgmap v7232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:21.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:37 smithi035 ceph-mon[92535]: pgmap v7233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:21.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:40 smithi035 ceph-mon[92535]: pgmap v7234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:22.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:42 smithi035 ceph-mon[92535]: pgmap v7235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:22.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:44 smithi035 ceph-mon[92535]: pgmap v7236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:22.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:46 smithi035 ceph-mon[92535]: pgmap v7237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:28:22.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:48 smithi035 ceph-mon[92535]: pgmap v7238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:28:22.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:50 smithi035 ceph-mon[92535]: pgmap v7239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:22.043 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:52 smithi035 ceph-mon[92535]: pgmap v7240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:28:23.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:54 smithi035 ceph-mon[92535]: pgmap v7241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:23.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:56 smithi035 ceph-mon[92535]: pgmap v7242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:23.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:24:58 smithi035 ceph-mon[92535]: pgmap v7243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:23.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:00 smithi035 ceph-mon[92535]: pgmap v7244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:23.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:28:23.873 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:01 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:02 smithi035 ceph-mon[92535]: pgmap v7245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:02 smithi035 ceph-mon[92535]: pgmap v7246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:02 smithi035 ceph-mon[92535]: pgmap v7247: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:04 smithi035 ceph-mon[92535]: pgmap v7248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:06 smithi035 ceph-mon[92535]: pgmap v7249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:08 smithi035 ceph-mon[92535]: pgmap v7250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:10 smithi035 ceph-mon[92535]: pgmap v7251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:10 smithi035 ceph-mon[92535]: osdmap e518: 12 total, 12 up, 12 in 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:12 smithi035 ceph-mon[92535]: pgmap v7253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:14 smithi035 ceph-mon[92535]: pgmap v7254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:25.207 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:16 smithi035 ceph-mon[92535]: pgmap v7255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:18 smithi035 ceph-mon[92535]: pgmap v7256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:18 smithi035 ceph-mon[92535]: osdmap e519: 12 total, 12 up, 12 in 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:20 smithi035 ceph-mon[92535]: pgmap v7258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:22 smithi035 ceph-mon[92535]: pgmap v7259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:24 smithi035 ceph-mon[92535]: pgmap v7260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:26 smithi035 ceph-mon[92535]: pgmap v7261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:28:25.208 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:28 smithi035 ceph-mon[92535]: pgmap v7262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:28:25.930 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:30 smithi035 ceph-mon[92535]: pgmap v7263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:28:25.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:32 smithi035 ceph-mon[92535]: pgmap v7264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:25.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:34 smithi035 ceph-mon[92535]: pgmap v7265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:25.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:36 smithi035 ceph-mon[92535]: pgmap v7266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:25.931 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:38 smithi035 ceph-mon[92535]: pgmap v7267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:40 smithi035 ceph-mon[92535]: pgmap v7268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:42 smithi035 ceph-mon[92535]: pgmap v7269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:44 smithi035 ceph-mon[92535]: pgmap v7270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:46 smithi035 ceph-mon[92535]: pgmap v7271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:48 smithi035 ceph-mon[92535]: pgmap v7272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:50 smithi035 ceph-mon[92535]: pgmap v7273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.351 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:52 smithi035 ceph-mon[92535]: pgmap v7274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:54 smithi035 ceph-mon[92535]: pgmap v7275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:56 smithi035 ceph-mon[92535]: pgmap v7276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:25:58 smithi035 ceph-mon[92535]: pgmap v7277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:00 smithi035 ceph-mon[92535]: pgmap v7278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:02 smithi035 ceph-mon[92535]: pgmap v7279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:28:27.352 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:03 smithi035 ceph-mon[92535]: pgmap v7280: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:03 smithi035 ceph-mon[92535]: pgmap v7281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:04 smithi035 ceph-mon[92535]: pgmap v7282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:07 smithi035 ceph-mon[92535]: pgmap v7283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:09 smithi035 ceph-mon[92535]: pgmap v7284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:10 smithi035 ceph-mon[92535]: osdmap e520: 12 total, 12 up, 12 in 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:11 smithi035 ceph-mon[92535]: pgmap v7286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:13 smithi035 ceph-mon[92535]: pgmap v7287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:29.136 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:13 smithi035 ceph-mon[92535]: osdmap e521: 12 total, 12 up, 12 in 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:15 smithi035 ceph-mon[92535]: pgmap v7289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:17 smithi035 ceph-mon[92535]: pgmap v7290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:19 smithi035 ceph-mon[92535]: pgmap v7291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:21 smithi035 ceph-mon[92535]: pgmap v7292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:23 smithi035 ceph-mon[92535]: pgmap v7293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:25 smithi035 ceph-mon[92535]: pgmap v7294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:27 smithi035 ceph-mon[92535]: pgmap v7295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:28:29.137 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:29 smithi035 ceph-mon[92535]: pgmap v7296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:28:32.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:31 smithi035 ceph-mon[92535]: pgmap v7297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T12:28:32.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:33 smithi035 ceph-mon[92535]: pgmap v7298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:28:32.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:35 smithi035 ceph-mon[92535]: pgmap v7299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:32.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:37 smithi035 ceph-mon[92535]: pgmap v7300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:32.066 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:39 smithi035 ceph-mon[92535]: pgmap v7301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:32.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:41 smithi035 ceph-mon[92535]: pgmap v7302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:32.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:43 smithi035 ceph-mon[92535]: pgmap v7303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:32.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:44 smithi035 ceph-mon[92535]: pgmap v7304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:32.067 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:47 smithi035 ceph-mon[92535]: pgmap v7305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:28:32.069 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:49 smithi035 ceph-mon[92535]: pgmap v7306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:28:33.273 INFO:teuthology.orchestra.run.smithi035.stderr:Inferring config /var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/mon.a/config 2023-03-17T12:28:33.274 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-03-17T12:28:33.274 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-0": { 2023-03-17T12:28:33.274 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 20153, 2023-03-17T12:28:33.274 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 20059, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 75679036, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 7252264, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 19, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 3, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 2.613637878, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 1.072132145, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.616034383, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.669951699, 2023-03-17T12:28:33.275 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:28:35.380 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 20058, 2023-03-17T12:28:35.380 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 1.151468208, 2023-03-17T12:28:35.380 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000057406 2023-03-17T12:28:35.380 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:35.380 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:28:36.093 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:36.093 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:36.093 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:36.094 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:36.094 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 3374144, 2023-03-17T12:28:37.284 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 2403152 2023-03-17T12:28:37.284 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:37.284 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-1": { 2023-03-17T12:28:37.284 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 15140, 2023-03-17T12:28:37.284 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 18218, 2023-03-17T12:28:37.285 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 100334214, 2023-03-17T12:28:37.668 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 11071619, 2023-03-17T12:28:37.668 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 46, 2023-03-17T12:28:37.668 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 5, 2023-03-17T12:28:37.668 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 1.421955782, 2023-03-17T12:28:37.669 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.468374476, 2023-03-17T12:28:37.669 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.358419326, 2023-03-17T12:28:37.669 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.465061198, 2023-03-17T12:28:39.058 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:28:39.058 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 18215, 2023-03-17T12:28:39.059 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.663854429, 2023-03-17T12:28:39.059 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000036445 2023-03-17T12:28:39.059 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:39.059 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 2240, 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 6367376 2023-03-17T12:28:41.101 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:41.716 INFO:teuthology.orchestra.run.smithi035.stdout: "AsyncMessenger::Worker-2": { 2023-03-17T12:28:41.717 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_messages": 13889, 2023-03-17T12:28:41.717 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages": 13889, 2023-03-17T12:28:41.717 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_bytes": 134359294, 2023-03-17T12:28:41.717 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_bytes": 4318695, 2023-03-17T12:28:41.717 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_created_connections": 42, 2023-03-17T12:28:41.717 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_active_connections": 4, 2023-03-17T12:28:42.126 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_total_time": 1.184713568, 2023-03-17T12:28:43.153 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_send_time": 0.302122433, 2023-03-17T12:28:43.153 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_recv_time": 0.355165980, 2023-03-17T12:28:43.153 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_running_fast_dispatch_time": 0.433260285, 2023-03-17T12:28:43.153 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_messages_queue_lat": { 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 13888, 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.496834517, 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000035774 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_handle_ack_lat": { 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:43.154 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:44.426 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:44.426 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:44.426 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_recv_encrypted_bytes": 2912, 2023-03-17T12:28:44.426 INFO:teuthology.orchestra.run.smithi035.stdout: "msgr_send_encrypted_bytes": 448 2023-03-17T12:28:44.426 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:45.890 INFO:teuthology.orchestra.run.smithi035.stdout: "cct": { 2023-03-17T12:28:45.890 INFO:teuthology.orchestra.run.smithi035.stdout: "total_workers": 1, 2023-03-17T12:28:45.890 INFO:teuthology.orchestra.run.smithi035.stdout: "unhealthy_workers": 0 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "finisher-MDSRank": { 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "queue_len": 0, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "complete_latency": { 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 75292, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 2.142035991, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000028449 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "finisher-PurgeQueue": { 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "queue_len": 0, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "complete_latency": { 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:45.891 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "mds": { 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "request": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "reply": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "reply_latency": { 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "slow_reply": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "forward": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_fetch_complete": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_fetch_keys": 0, 2023-03-17T12:28:45.892 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_commit": 0, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_split": 0, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_merge": 0, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes": 10893, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_top": 0, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_bottom": 0, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_pin_tail": 10893, 2023-03-17T12:28:46.673 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_pinned": 10893, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_expired": 0, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "inodes_with_caps": 0, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "caps": 0, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "subtrees": 1, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse": 0, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_hit": 0, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_forward": 0, 2023-03-17T12:28:47.437 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_discover": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_dir_fetch": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_remote_ino": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "traverse_lock": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "load_cent": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "q": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "exported": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "exported_inodes": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "imported": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "imported_inodes": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_dir_fetch": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_backtrace_fetch": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "openino_peer_discover": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rfiles": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rbytes": 0, 2023-03-17T12:28:48.529 INFO:teuthology.orchestra.run.smithi035.stdout: "root_rsnaps": 0, 2023-03-17T12:28:48.530 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_backtrace_fetch": 0, 2023-03-17T12:28:48.530 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_set_tag": 0, 2023-03-17T12:28:48.530 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_backtrace_repaired": 0, 2023-03-17T12:28:48.530 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_inotable_repaired": 0, 2023-03-17T12:28:48.530 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dir_inodes": 0, 2023-03-17T12:28:48.530 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dir_base_inodes": 0, 2023-03-17T12:28:48.870 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_dirfrag_rstats": 0, 2023-03-17T12:28:48.870 INFO:teuthology.orchestra.run.smithi035.stdout: "scrub_file_inodes": 0, 2023-03-17T12:28:48.870 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_inode_file_caps": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_revoke": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_grant": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_trunc": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "ceph_cap_op_flush_ack": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_caps": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_caps_dirty": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_cap_release": 0, 2023-03-17T12:28:48.871 INFO:teuthology.orchestra.run.smithi035.stdout: "process_request_cap_release": 0 2023-03-17T12:28:49.341 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:49.341 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache": { 2023-03-17T12:28:49.341 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_update": 0, 2023-03-17T12:28:49.341 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_update_receipt": 0, 2023-03-17T12:28:49.341 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_try_discover": 0, 2023-03-17T12:28:49.341 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_send_discover": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "dir_handle_discover": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays_delayed": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "num_strays_enqueuing": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_created": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_enqueued": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_reintegrated": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "strays_migrated": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_processing": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_enqueued": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "num_recovering_prioritized": 0, 2023-03-17T12:28:49.789 INFO:teuthology.orchestra.run.smithi035.stdout: "recovery_started": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "recovery_completed": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_enqueue_scrub": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_exportdir": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_flush": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_fragmentdir": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_fragstats": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ireq_inodestats": 0 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log": { 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "evadd": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "evex": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "evtrm": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ev": 0, 2023-03-17T12:28:49.790 INFO:teuthology.orchestra.run.smithi035.stdout: "evexg": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "evexd": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "segadd": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "segex": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "segtrm": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "seg": 92, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "segexg": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "segexd": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "expos": 4194304, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "wrpos": 0, 2023-03-17T12:28:49.791 INFO:teuthology.orchestra.run.smithi035.stdout: "rdpos": 298569942, 2023-03-17T12:28:50.965 INFO:teuthology.orchestra.run.smithi035.stdout: "jlat": { 2023-03-17T12:28:50.965 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: "replayed": 66746 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_mem": { 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: "ino": 1563, 2023-03-17T12:28:51.549 INFO:teuthology.orchestra.run.smithi035.stdout: "ino+": 11889, 2023-03-17T12:28:52.498 INFO:teuthology.orchestra.run.smithi035.stdout: "ino-": 10326, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dir": 59, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dir+": 130, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dir-": 71, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dn": 10893, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dn+": 12478, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dn-": 1585, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "cap": 0, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "cap+": 0, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "cap-": 0, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "rss": 66744, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "heap": 207156 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_server": { 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dispatch_client_request": 0, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "dispatch_server_request": 0, 2023-03-17T12:28:52.499 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_request": 0, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_client_session": 0, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "handle_peer_request": 0, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "req_create_latency": { 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getattr_latency": { 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getfilelock_latency": { 2023-03-17T12:28:52.500 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.826 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.826 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.826 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "req_link_latency": { 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookup_latency": { 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookuphash_latency": { 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.827 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupino_latency": { 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupname_latency": { 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupparent_latency": { 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.828 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lookupsnap_latency": { 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "req_lssnap_latency": { 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mkdir_latency": { 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mknod_latency": { 2023-03-17T12:28:53.829 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "req_mksnap_latency": { 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "req_open_latency": { 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "req_readdir_latency": { 2023-03-17T12:28:53.830 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:55.105 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:55.105 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:55.106 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:55.106 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rename_latency": { 2023-03-17T12:28:55.106 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:55.106 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:55.106 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:55.447 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:55.447 INFO:teuthology.orchestra.run.smithi035.stdout: "req_renamesnap_latency": { 2023-03-17T12:28:55.447 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:55.447 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:55.448 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:55.448 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:55.448 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmdir_latency": { 2023-03-17T12:28:55.448 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:55.448 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmsnap_latency": { 2023-03-17T12:28:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "req_rmxattr_latency": { 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setattr_latency": { 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setdirlayout_latency": { 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setfilelock_latency": { 2023-03-17T12:28:58.101 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setlayout_latency": { 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:58.691 INFO:teuthology.orchestra.run.smithi035.stdout: "req_setxattr_latency": { 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "req_symlink_latency": { 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "req_unlink_latency": { 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:28:58.692 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:28:59.085 INFO:teuthology.orchestra.run.smithi035.stdout: "cap_revoke_eviction": 0, 2023-03-17T12:28:59.085 INFO:teuthology.orchestra.run.smithi035.stdout: "cap_acquisition_throttle": 0, 2023-03-17T12:29:00.230 INFO:teuthology.orchestra.run.smithi035.stdout: "req_getvxattr_latency": { 2023-03-17T12:29:00.231 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:29:00.231 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:29:00.231 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:29:00.231 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:00.231 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:00.231 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_sessions": { 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "session_count": 1, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "session_add": 1, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "session_remove": 0, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "sessions_open": 1, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "sessions_stale": 0, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "total_load": 0, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "average_load": 0, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "avg_session_uptime": 18066 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "mempool": { 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "bloom_filter_bytes": 0, 2023-03-17T12:29:00.637 INFO:teuthology.orchestra.run.smithi035.stdout: "bloom_filter_items": 0, 2023-03-17T12:29:01.675 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_bytes": 0, 2023-03-17T12:29:02.038 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_items": 0, 2023-03-17T12:29:02.039 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_data_bytes": 0, 2023-03-17T12:29:03.709 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_data_items": 0, 2023-03-17T12:29:04.145 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_onode_bytes": 0, 2023-03-17T12:29:04.145 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_onode_items": 0, 2023-03-17T12:29:04.145 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_bytes": 0, 2023-03-17T12:29:04.145 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_items": 0, 2023-03-17T12:29:04.768 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_other_bytes": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_other_items": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_buffer_bytes": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_buffer_items": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_bytes": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_items": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blob_bytes": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blob_items": 0, 2023-03-17T12:29:04.769 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_shared_blob_bytes": 0, 2023-03-17T12:29:04.770 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_shared_blob_items": 0, 2023-03-17T12:29:04.770 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_inline_bl_bytes": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_inline_bl_items": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_bytes": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_items": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_txc_bytes": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_txc_items": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_deferred_bytes": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_deferred_items": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_bytes": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_writing_items": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_bytes": 0, 2023-03-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_items": 0, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_reader_bytes": 0, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_reader_items": 0, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_writer_bytes": 0, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_file_writer_items": 0, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_anon_bytes": 240672, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_anon_items": 80, 2023-03-17T12:29:08.998 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_meta_bytes": 0, 2023-03-17T12:29:09.839 INFO:teuthology.orchestra.run.smithi035.stdout: "buffer_meta_items": 0, 2023-03-17T12:29:09.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bytes": 0, 2023-03-17T12:29:09.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_items": 0, 2023-03-17T12:29:09.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mapbl_bytes": 0, 2023-03-17T12:29:09.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mapbl_items": 0, 2023-03-17T12:29:09.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pglog_bytes": 0, 2023-03-17T12:29:09.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pglog_items": 0, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_bytes": 7840, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_items": 163, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_mapping_bytes": 0, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "osdmap_mapping_items": 0, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "pgmap_bytes": 0, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "pgmap_items": 0, 2023-03-17T12:29:10.589 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_co_bytes": 11217806, 2023-03-17T12:29:11.918 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_co_items": 51355, 2023-03-17T12:29:11.918 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_1_bytes": 0, 2023-03-17T12:29:11.918 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_1_items": 0, 2023-03-17T12:29:11.918 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_2_bytes": 0, 2023-03-17T12:29:11.918 INFO:teuthology.orchestra.run.smithi035.stdout: "unittest_2_items": 0 2023-03-17T12:29:11.918 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:12.539 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter": { 2023-03-17T12:29:12.539 INFO:teuthology.orchestra.run.smithi035.stdout: "op_active": 0, 2023-03-17T12:29:12.539 INFO:teuthology.orchestra.run.smithi035.stdout: "op_laggy": 0, 2023-03-17T12:29:12.539 INFO:teuthology.orchestra.run.smithi035.stdout: "op_send": 44603, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op_send_bytes": 21, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op_resend": 3, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op_reply": 44603, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op_latency": { 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 44603, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 23.974505943, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000537508 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op_inflight": 0, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "oplen_avg": { 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 44603, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 44604 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op": 44603, 2023-03-17T12:29:12.540 INFO:teuthology.orchestra.run.smithi035.stdout: "op_r": 44603, 2023-03-17T12:29:13.697 INFO:teuthology.orchestra.run.smithi035.stdout: "op_w": 0, 2023-03-17T12:29:14.241 INFO:teuthology.orchestra.run.smithi035.stdout: "op_rmw": 0, 2023-03-17T12:29:15.325 INFO:teuthology.orchestra.run.smithi035.stdout: "op_pg": 0, 2023-03-17T12:29:15.325 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_stat": 28748, 2023-03-17T12:29:15.325 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_create": 0, 2023-03-17T12:29:16.761 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_read": 15853, 2023-03-17T12:29:16.761 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_write": 0, 2023-03-17T12:29:16.761 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_writefull": 0, 2023-03-17T12:29:16.761 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_writesame": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_append": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_zero": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_truncate": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_delete": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_mapext": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_sparse_read": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_clonerange": 0, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_getxattr": 1, 2023-03-17T12:29:16.762 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_setxattr": 0, 2023-03-17T12:29:18.431 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_cmpxattr": 0, 2023-03-17T12:29:18.431 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_rmxattr": 0, 2023-03-17T12:29:18.431 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_resetxattrs": 0, 2023-03-17T12:29:18.431 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_call": 0, 2023-03-17T12:29:18.431 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_watch": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_notify": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_src_cmpxattr": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_pgls": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_pgls_filter": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "osdop_other": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_active": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_send": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_resend": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "linger_ping": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_active": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_send": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "poolop_resend": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_active": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_send": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "poolstat_resend": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_active": 0, 2023-03-17T12:29:18.432 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_send": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "statfs_resend": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "command_active": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "command_send": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "command_resend": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "map_epoch": 521, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "map_full": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "map_inc": 430, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_sessions": 11, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_session_open": 84, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_session_close": 73, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_laggy": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_wr": 0, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_rd": 2, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_del": 0 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:18.433 INFO:teuthology.orchestra.run.smithi035.stdout: "oft": { 2023-03-17T12:29:18.434 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_objs": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_kv_pairs": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_updates": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "omap_total_removes": 0 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "osd-slow-ops": { 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "slow_ops_count": 0 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "purge_queue": { 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_ops": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_ops_high_water": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executing_high_water": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_executed": 0, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "pq_item_in_journal": 0 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:19.995 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-03-17T12:29:19.996 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:29:19.996 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 104857600, 2023-03-17T12:29:19.996 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:29:21.332 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 49178, 2023-03-17T12:29:21.332 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 305709453, 2023-03-17T12:29:21.332 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:29:21.332 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 49178, 2023-03-17T12:29:21.332 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:29:23.610 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:29:23.611 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 49178, 2023-03-17T12:29:23.611 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 305709453, 2023-03-17T12:29:23.611 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-objecter_bytes": { 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 104857600, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:29:26.011 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 44603, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 294393186, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 44603, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 294393186, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:29:26.012 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:29:27.452 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:27.452 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:27.452 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-objecter_ops": { 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 1024, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 44603, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 44603, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 44603, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 44603, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:29:27.453 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:29:27.454 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:27.454 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:29.191 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-write_buf_throttle": { 2023-03-17T12:29:29.191 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:29:29.191 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 3758096384, 2023-03-17T12:29:29.192 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 0, 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:29:31.053 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: }, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "throttle-write_buf_throttle-0x560d36e6e0a0": { 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "val": 0, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "max": 3758096384, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "get_started": 0, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "get": 0, 2023-03-17T12:29:31.054 INFO:teuthology.orchestra.run.smithi035.stdout: "get_sum": 0, 2023-03-17T12:29:32.286 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_fail": 0, 2023-03-17T12:29:32.286 INFO:teuthology.orchestra.run.smithi035.stdout: "get_or_fail_success": 0, 2023-03-17T12:29:33.481 INFO:teuthology.orchestra.run.smithi035.stdout: "take": 0, 2023-03-17T12:29:33.481 INFO:teuthology.orchestra.run.smithi035.stdout: "take_sum": 0, 2023-03-17T12:29:33.481 INFO:teuthology.orchestra.run.smithi035.stdout: "put": 0, 2023-03-17T12:29:34.144 INFO:teuthology.orchestra.run.smithi035.stdout: "put_sum": 0, 2023-03-17T12:29:34.144 INFO:teuthology.orchestra.run.smithi035.stdout: "wait": { 2023-03-17T12:29:34.145 INFO:teuthology.orchestra.run.smithi035.stdout: "avgcount": 0, 2023-03-17T12:29:34.145 INFO:teuthology.orchestra.run.smithi035.stdout: "sum": 0.000000000, 2023-03-17T12:29:34.769 INFO:teuthology.orchestra.run.smithi035.stdout: "avgtime": 0.000000000 2023-03-17T12:29:35.784 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:35.784 INFO:teuthology.orchestra.run.smithi035.stdout: } 2023-03-17T12:29:35.784 INFO:teuthology.orchestra.run.smithi035.stdout:} 2023-03-17T12:29:35.785 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:51 smithi035 ceph-mon[92535]: pgmap v7307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:37.016 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-03-17T12:29:38.242 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-03-17T12:29:38.242 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-03-17T12:29:38.242 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-03-17T12:29:38.242 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-03-17T12:29:38.242 DEBUG:tasks.check_counter:Getting stats from j 2023-03-17T12:29:38.935 DEBUG:teuthology.orchestra.run.smithi035:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4aa791bf129eece187e94ddbfa7c2b475588cf0c shell --fsid 80b32574-c497-11ed-9afb-001a4aab830c -- ceph daemon mds.j perf dump 2023-03-17T12:29:38.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:14 smithi078 ceph-mon[94114]: pgmap v1114: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 412 B/s wr, 9 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:16 smithi078 ceph-mon[94114]: pgmap v1115: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 409 B/s wr, 8 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:18 smithi078 ceph-mon[94114]: pgmap v1116: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:20 smithi078 ceph-mon[94114]: pgmap v1117: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 8 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:20 smithi078 ceph-mon[94114]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:20 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:22 smithi078 ceph-mon[94114]: pgmap v1118: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 462 B/s wr, 7 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:24 smithi078 ceph-mon[94114]: pgmap v1119: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:26 smithi078 ceph-mon[94114]: pgmap v1120: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:29:40.043 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:28 smithi078 ceph-mon[94114]: pgmap v1121: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:30 smithi078 ceph-mon[94114]: pgmap v1122: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:32 smithi078 ceph-mon[94114]: pgmap v1123: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:34 smithi078 ceph-mon[94114]: pgmap v1124: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 255 B/s wr, 13 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:36 smithi078 ceph-mon[94114]: pgmap v1125: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:38 smithi078 ceph-mon[94114]: pgmap v1126: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:40 smithi078 ceph-mon[94114]: pgmap v1127: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:42 smithi078 ceph-mon[94114]: pgmap v1128: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:44 smithi078 ceph-mon[94114]: pgmap v1129: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:46 smithi078 ceph-mon[94114]: pgmap v1130: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:48 smithi078 ceph-mon[94114]: pgmap v1131: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:50 smithi078 ceph-mon[94114]: pgmap v1132: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:52 smithi078 ceph-mon[94114]: pgmap v1133: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:54 smithi078 ceph-mon[94114]: pgmap v1134: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:56 smithi078 ceph-mon[94114]: pgmap v1135: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:40.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:21:58 smithi078 ceph-mon[94114]: pgmap v1136: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:00 smithi078 ceph-mon[94114]: pgmap v1137: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:02 smithi078 ceph-mon[94114]: pgmap v1138: 97 pgs: 97 active+clean; 1.5 MiB data, 192 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:04 smithi078 ceph-mon[94114]: pgmap v1139: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:06 smithi078 ceph-mon[94114]: pgmap v1140: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:08 smithi078 ceph-mon[94114]: pgmap v1141: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:09 smithi078 ceph-mon[94114]: osdmap e148: 12 total, 12 up, 12 in 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:10 smithi078 ceph-mon[94114]: pgmap v1143: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:12 smithi078 ceph-mon[94114]: pgmap v1144: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:14 smithi078 ceph-mon[94114]: pgmap v1145: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:29:40.045 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:16 smithi078 ceph-mon[94114]: osdmap e149: 12 total, 12 up, 12 in 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:16 smithi078 ceph-mon[94114]: pgmap v1147: 97 pgs: 97 active+clean; 1.5 MiB data, 193 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:18 smithi078 ceph-mon[94114]: pgmap v1148: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:20 smithi078 ceph-mon[94114]: pgmap v1149: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:22 smithi078 ceph-mon[94114]: pgmap v1150: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:24 smithi078 ceph-mon[94114]: pgmap v1151: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:26 smithi078 ceph-mon[94114]: pgmap v1152: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:29:40.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:28 smithi078 ceph-mon[94114]: pgmap v1153: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:29:42.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:30 smithi078 ceph-mon[94114]: pgmap v1154: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:42.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:32 smithi078 ceph-mon[94114]: pgmap v1155: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:42.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:34 smithi078 ceph-mon[94114]: pgmap v1156: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:29:44.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:36 smithi078 ceph-mon[94114]: pgmap v1157: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:29:44.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:38 smithi078 ceph-mon[94114]: pgmap v1158: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:29:44.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:38 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1078072470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T12:29:44.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:40 smithi078 ceph-mon[94114]: pgmap v1159: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:29:44.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:42 smithi078 ceph-mon[94114]: pgmap v1160: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:29:45.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:44 smithi078 ceph-mon[94114]: pgmap v1161: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:29:45.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:46 smithi078 ceph-mon[94114]: pgmap v1162: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:45.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:48 smithi078 ceph-mon[94114]: pgmap v1163: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:50 smithi078 ceph-mon[94114]: pgmap v1164: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:52 smithi078 ceph-mon[94114]: pgmap v1165: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:54 smithi078 ceph-mon[94114]: pgmap v1166: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:56 smithi078 ceph-mon[94114]: pgmap v1167: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:22:58 smithi078 ceph-mon[94114]: pgmap v1168: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:00 smithi078 ceph-mon[94114]: pgmap v1169: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:02 smithi078 ceph-mon[94114]: pgmap v1170: 97 pgs: 97 active+clean; 1.5 MiB data, 194 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:45.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:04 smithi078 ceph-mon[94114]: pgmap v1171: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:29:45.404 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:06 smithi078 ceph-mon[94114]: pgmap v1172: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:29:45.404 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:08 smithi078 ceph-mon[94114]: pgmap v1173: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:29:45.404 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:09 smithi078 ceph-mon[94114]: osdmap e150: 12 total, 12 up, 12 in 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:10 smithi078 ceph-mon[94114]: pgmap v1175: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:12 smithi078 ceph-mon[94114]: pgmap v1176: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:14 smithi078 ceph-mon[94114]: pgmap v1177: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:29:46.998 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:16 smithi078 ceph-mon[94114]: osdmap e151: 12 total, 12 up, 12 in 2023-03-17T12:29:46.999 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:16 smithi078 ceph-mon[94114]: pgmap v1179: 97 pgs: 97 active+clean; 1.5 MiB data, 199 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:29:46.999 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:18 smithi078 ceph-mon[94114]: pgmap v1180: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 915 B/s wr, 12 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:20 smithi078 ceph-mon[94114]: pgmap v1181: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:22 smithi078 ceph-mon[94114]: pgmap v1182: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:24 smithi078 ceph-mon[94114]: pgmap v1183: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:26 smithi078 ceph-mon[94114]: pgmap v1184: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 304 B/s wr, 10 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:28 smithi078 ceph-mon[94114]: pgmap v1185: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:30 smithi078 ceph-mon[94114]: pgmap v1186: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:32 smithi078 ceph-mon[94114]: pgmap v1187: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:47.674 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:34 smithi078 ceph-mon[94114]: pgmap v1188: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:47.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:36 smithi078 ceph-mon[94114]: pgmap v1189: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:47.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:38 smithi078 ceph-mon[94114]: pgmap v1190: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:47.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:40 smithi078 ceph-mon[94114]: pgmap v1191: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:29:47.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:42 smithi078 ceph-mon[94114]: pgmap v1192: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:44 smithi078 ceph-mon[94114]: pgmap v1193: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:46 smithi078 ceph-mon[94114]: pgmap v1194: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:48 smithi078 ceph-mon[94114]: pgmap v1195: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:50 smithi078 ceph-mon[94114]: pgmap v1196: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:52 smithi078 ceph-mon[94114]: pgmap v1197: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:54 smithi078 ceph-mon[94114]: pgmap v1198: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:56 smithi078 ceph-mon[94114]: pgmap v1199: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:48.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:23:58 smithi078 ceph-mon[94114]: pgmap v1200: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:00 smithi078 ceph-mon[94114]: pgmap v1201: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:29:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:02 smithi078 ceph-mon[94114]: pgmap v1202: 97 pgs: 97 active+clean; 1.5 MiB data, 200 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:29:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:04 smithi078 ceph-mon[94114]: pgmap v1203: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:29:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:06 smithi078 ceph-mon[94114]: pgmap v1204: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:29:48.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:08 smithi078 ceph-mon[94114]: pgmap v1205: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:29:50.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:09 smithi078 ceph-mon[94114]: osdmap e152: 12 total, 12 up, 12 in 2023-03-17T12:29:50.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:10 smithi078 ceph-mon[94114]: pgmap v1207: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:29:50.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:12 smithi078 ceph-mon[94114]: pgmap v1208: 97 pgs: 97 active+clean; 1.5 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:29:50.350 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:14 smithi078 ceph-mon[94114]: pgmap v1209: 97 pgs: 97 active+clean; 1.5 MiB data, 209 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:29:51.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:15 smithi078 ceph-mon[94114]: osdmap e153: 12 total, 12 up, 12 in 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:16 smithi078 ceph-mon[94114]: pgmap v1211: 97 pgs: 97 active+clean; 1.5 MiB data, 209 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:18 smithi078 ceph-mon[94114]: pgmap v1212: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:20 smithi078 ceph-mon[94114]: pgmap v1213: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:29:51.650 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:22 smithi078 ceph-mon[94114]: pgmap v1214: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:29:52.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:24 smithi078 ceph-mon[94114]: pgmap v1215: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:29:52.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:26 smithi078 ceph-mon[94114]: pgmap v1216: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:29:52.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:28 smithi078 ceph-mon[94114]: pgmap v1217: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:29:52.787 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:30 smithi078 ceph-mon[94114]: pgmap v1218: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:54.740 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:32 smithi078 ceph-mon[94114]: pgmap v1219: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:34 smithi078 ceph-mon[94114]: pgmap v1220: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:36 smithi078 ceph-mon[94114]: pgmap v1221: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:38 smithi078 ceph-mon[94114]: pgmap v1222: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:40 smithi078 ceph-mon[94114]: pgmap v1223: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:42 smithi078 ceph-mon[94114]: pgmap v1224: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:44 smithi078 ceph-mon[94114]: pgmap v1225: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:46 smithi078 ceph-mon[94114]: pgmap v1226: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:29:54.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:48 smithi078 ceph-mon[94114]: pgmap v1227: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:29:56.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:50 smithi078 ceph-mon[94114]: pgmap v1228: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:29:56.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:52 smithi078 ceph-mon[94114]: pgmap v1229: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:29:56.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:54 smithi078 ceph-mon[94114]: pgmap v1230: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:29:56.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:56 smithi078 ceph-mon[94114]: pgmap v1231: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:29:56.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:24:58 smithi078 ceph-mon[94114]: pgmap v1232: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:29:56.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:00 smithi078 ceph-mon[94114]: pgmap v1233: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:56.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:02 smithi078 ceph-mon[94114]: pgmap v1234: 97 pgs: 97 active+clean; 1.5 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:29:56.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:04 smithi078 ceph-mon[94114]: pgmap v1235: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:06 smithi078 ceph-mon[94114]: pgmap v1236: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:08 smithi078 ceph-mon[94114]: pgmap v1237: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:09 smithi078 ceph-mon[94114]: osdmap e154: 12 total, 12 up, 12 in 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:10 smithi078 ceph-mon[94114]: pgmap v1239: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:12 smithi078 ceph-mon[94114]: pgmap v1240: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:14 smithi078 ceph-mon[94114]: pgmap v1241: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:16 smithi078 ceph-mon[94114]: osdmap e155: 12 total, 12 up, 12 in 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:16 smithi078 ceph-mon[94114]: pgmap v1243: 97 pgs: 97 active+clean; 1.5 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:29:58.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:29:58.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:29:58.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:29:58.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:18 smithi078 ceph-mon[94114]: pgmap v1244: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 114 B/s wr, 11 op/s 2023-03-17T12:29:58.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:20 smithi078 ceph-mon[94114]: pgmap v1245: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:29:58.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:22 smithi078 ceph-mon[94114]: pgmap v1246: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:24 smithi078 ceph-mon[94114]: pgmap v1247: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:26 smithi078 ceph-mon[94114]: pgmap v1248: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 507 B/s wr, 10 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:28 smithi078 ceph-mon[94114]: pgmap v1249: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:30 smithi078 ceph-mon[94114]: pgmap v1250: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:32 smithi078 ceph-mon[94114]: pgmap v1251: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:34 smithi078 ceph-mon[94114]: pgmap v1252: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:36 smithi078 ceph-mon[94114]: pgmap v1253: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:38 smithi078 ceph-mon[94114]: pgmap v1254: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:40 smithi078 ceph-mon[94114]: pgmap v1255: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:29:58.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:42 smithi078 ceph-mon[94114]: pgmap v1256: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:44 smithi078 ceph-mon[94114]: pgmap v1257: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:46 smithi078 ceph-mon[94114]: pgmap v1258: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:48 smithi078 ceph-mon[94114]: pgmap v1259: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:50 smithi078 ceph-mon[94114]: pgmap v1260: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:52 smithi078 ceph-mon[94114]: pgmap v1261: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:54 smithi078 ceph-mon[94114]: pgmap v1262: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:56 smithi078 ceph-mon[94114]: pgmap v1263: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:25:58 smithi078 ceph-mon[94114]: pgmap v1264: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:00 smithi078 ceph-mon[94114]: pgmap v1265: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:02 smithi078 ceph-mon[94114]: pgmap v1266: 97 pgs: 97 active+clean; 1.5 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:00.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:04 smithi078 ceph-mon[94114]: pgmap v1267: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:06 smithi078 ceph-mon[94114]: pgmap v1268: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:08 smithi078 ceph-mon[94114]: pgmap v1269: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:09 smithi078 ceph-mon[94114]: osdmap e156: 12 total, 12 up, 12 in 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:10 smithi078 ceph-mon[94114]: pgmap v1271: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:12 smithi078 ceph-mon[94114]: pgmap v1272: 97 pgs: 97 active+clean; 1.5 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:14 smithi078 ceph-mon[94114]: pgmap v1273: 97 pgs: 97 active+clean; 1.5 MiB data, 217 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:16 smithi078 ceph-mon[94114]: osdmap e157: 12 total, 12 up, 12 in 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:16 smithi078 ceph-mon[94114]: pgmap v1275: 97 pgs: 97 active+clean; 1.5 MiB data, 217 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:17 smithi078 ceph-mon[94114]: pgmap v1276: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:20 smithi078 ceph-mon[94114]: pgmap v1277: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:00.874 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:22 smithi078 ceph-mon[94114]: pgmap v1278: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:00.875 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:24 smithi078 ceph-mon[94114]: pgmap v1279: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:00.875 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:26 smithi078 ceph-mon[94114]: pgmap v1280: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:30:03.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:28 smithi078 ceph-mon[94114]: pgmap v1281: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:30:03.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:30 smithi078 ceph-mon[94114]: pgmap v1282: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:32 smithi078 ceph-mon[94114]: pgmap v1283: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:34 smithi078 ceph-mon[94114]: pgmap v1284: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:03.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:36 smithi078 ceph-mon[94114]: pgmap v1285: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.414 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:38 smithi078 ceph-mon[94114]: pgmap v1286: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:40 smithi078 ceph-mon[94114]: pgmap v1287: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:42 smithi078 ceph-mon[94114]: pgmap v1288: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:44 smithi078 ceph-mon[94114]: pgmap v1289: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:46 smithi078 ceph-mon[94114]: pgmap v1290: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:48 smithi078 ceph-mon[94114]: pgmap v1291: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:50 smithi078 ceph-mon[94114]: pgmap v1292: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:52 smithi078 ceph-mon[94114]: pgmap v1293: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:54 smithi078 ceph-mon[94114]: pgmap v1294: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:03.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:56 smithi078 ceph-mon[94114]: pgmap v1295: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:30:03.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:26:58 smithi078 ceph-mon[94114]: pgmap v1296: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:03.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:00 smithi078 ceph-mon[94114]: pgmap v1297: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:03.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:02 smithi078 ceph-mon[94114]: pgmap v1298: 97 pgs: 97 active+clean; 1.5 MiB data, 218 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:04 smithi078 ceph-mon[94114]: pgmap v1299: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:06 smithi078 ceph-mon[94114]: pgmap v1300: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:08 smithi078 ceph-mon[94114]: pgmap v1301: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:09 smithi078 ceph-mon[94114]: osdmap e158: 12 total, 12 up, 12 in 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:10 smithi078 ceph-mon[94114]: pgmap v1303: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:12 smithi078 ceph-mon[94114]: pgmap v1304: 97 pgs: 97 active+clean; 1.5 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:14 smithi078 ceph-mon[94114]: pgmap v1305: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:16 smithi078 ceph-mon[94114]: osdmap e159: 12 total, 12 up, 12 in 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:16 smithi078 ceph-mon[94114]: pgmap v1307: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:18 smithi078 ceph-mon[94114]: pgmap v1308: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 916 B/s wr, 12 op/s 2023-03-17T12:30:05.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:20 smithi078 ceph-mon[94114]: pgmap v1309: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: pgmap v1310: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 839 B/s wr, 11 op/s 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:22 smithi078 ceph-mon[94114]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:23 smithi078 ceph-mon[94114]: pgmap v1311: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 734 B/s wr, 11 op/s 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:26 smithi078 ceph-mon[94114]: pgmap v1312: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 727 B/s wr, 10 op/s 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:28 smithi078 ceph-mon[94114]: pgmap v1313: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 870 B/s wr, 13 op/s 2023-03-17T12:30:05.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:30 smithi078 ceph-mon[94114]: pgmap v1314: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 261 B/s wr, 8 op/s 2023-03-17T12:30:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:32 smithi078 ceph-mon[94114]: pgmap v1315: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 261 B/s wr, 8 op/s 2023-03-17T12:30:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:34 smithi078 ceph-mon[94114]: pgmap v1316: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:36 smithi078 ceph-mon[94114]: pgmap v1317: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:38 smithi078 ceph-mon[94114]: pgmap v1318: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:05.733 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:40 smithi078 ceph-mon[94114]: pgmap v1319: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:07.330 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:42 smithi078 ceph-mon[94114]: pgmap v1320: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:09.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:44 smithi078 ceph-mon[94114]: pgmap v1321: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:09.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:46 smithi078 ceph-mon[94114]: pgmap v1322: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:09.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:48 smithi078 ceph-mon[94114]: pgmap v1323: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:10.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:50 smithi078 ceph-mon[94114]: pgmap v1324: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:10.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:52 smithi078 ceph-mon[94114]: pgmap v1325: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:10.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:54 smithi078 ceph-mon[94114]: pgmap v1326: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:30:11.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:56 smithi078 ceph-mon[94114]: pgmap v1327: 97 pgs: 97 active+clean; 1.5 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:11.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:27:58 smithi078 ceph-mon[94114]: pgmap v1328: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:11.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:00 smithi078 ceph-mon[94114]: pgmap v1329: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:11.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:02 smithi078 ceph-mon[94114]: pgmap v1330: 97 pgs: 97 active+clean; 1.5 MiB data, 224 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:11.422 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:04 smithi078 ceph-mon[94114]: pgmap v1331: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:06 smithi078 ceph-mon[94114]: pgmap v1332: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:08 smithi078 ceph-mon[94114]: pgmap v1333: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:09 smithi078 ceph-mon[94114]: osdmap e160: 12 total, 12 up, 12 in 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:10 smithi078 ceph-mon[94114]: pgmap v1335: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:12 smithi078 ceph-mon[94114]: pgmap v1336: 97 pgs: 97 active+clean; 1.5 MiB data, 228 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:14 smithi078 ceph-mon[94114]: pgmap v1337: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:16 smithi078 ceph-mon[94114]: pgmap v1338: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:16 smithi078 ceph-mon[94114]: osdmap e161: 12 total, 12 up, 12 in 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:18 smithi078 ceph-mon[94114]: pgmap v1340: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:20 smithi078 ceph-mon[94114]: pgmap v1341: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:22 smithi078 ceph-mon[94114]: pgmap v1342: 97 pgs: 97 active+clean; 1.5 MiB data, 229 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:11.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:11.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:11.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:12.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:23 smithi078 ceph-mon[94114]: pgmap v1343: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:30:12.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:23 smithi078 ceph-mon[94114]: pgmap v1344: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 149 B/s wr, 14 op/s 2023-03-17T12:30:12.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:25 smithi078 ceph-mon[94114]: pgmap v1345: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 118 B/s wr, 11 op/s 2023-03-17T12:30:12.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:27 smithi078 ceph-mon[94114]: pgmap v1346: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:30:12.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:29 smithi078 ceph-mon[94114]: pgmap v1347: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:12.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:31 smithi078 ceph-mon[94114]: pgmap v1348: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:14.439 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:33 smithi078 ceph-mon[94114]: pgmap v1349: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:14.439 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:35 smithi078 ceph-mon[94114]: pgmap v1350: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:14.439 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:37 smithi078 ceph-mon[94114]: pgmap v1351: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:15.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:39 smithi078 ceph-mon[94114]: pgmap v1352: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:15.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:41 smithi078 ceph-mon[94114]: pgmap v1353: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:15.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:43 smithi078 ceph-mon[94114]: pgmap v1354: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:15.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:45 smithi078 ceph-mon[94114]: pgmap v1355: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:17.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:47 smithi078 ceph-mon[94114]: pgmap v1356: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:17.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:49 smithi078 ceph-mon[94114]: pgmap v1357: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:17.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:51 smithi078 ceph-mon[94114]: pgmap v1358: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:17.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:53 smithi078 ceph-mon[94114]: pgmap v1359: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:17.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:55 smithi078 ceph-mon[94114]: pgmap v1360: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:17.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:57 smithi078 ceph-mon[94114]: pgmap v1361: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:18.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:28:59 smithi078 ceph-mon[94114]: pgmap v1362: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:18.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:01 smithi078 ceph-mon[94114]: pgmap v1363: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:18.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:03 smithi078 ceph-mon[94114]: pgmap v1364: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:18.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:05 smithi078 ceph-mon[94114]: pgmap v1365: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:18.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:07 smithi078 ceph-mon[94114]: pgmap v1366: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:18.432 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:09 smithi078 ceph-mon[94114]: pgmap v1367: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:09 smithi078 ceph-mon[94114]: osdmap e162: 12 total, 12 up, 12 in 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:11 smithi078 ceph-mon[94114]: pgmap v1369: 97 pgs: 97 active+clean; 1.5 MiB data, 230 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:13 smithi078 ceph-mon[94114]: pgmap v1370: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:15 smithi078 ceph-mon[94114]: pgmap v1371: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:15 smithi078 ceph-mon[94114]: osdmap e163: 12 total, 12 up, 12 in 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:17 smithi078 ceph-mon[94114]: pgmap v1373: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:19 smithi078 ceph-mon[94114]: pgmap v1374: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:21 smithi078 ceph-mon[94114]: pgmap v1375: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:23 smithi078 ceph-mon[94114]: pgmap v1376: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:18.433 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:18.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:18.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:18.434 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:24 smithi078 ceph-mon[94114]: pgmap v1377: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 991 B/s wr, 11 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:24 smithi078 ceph-mon[94114]: pgmap v1378: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:26 smithi078 ceph-mon[94114]: pgmap v1379: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 991 B/s wr, 11 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:28 smithi078 ceph-mon[94114]: pgmap v1380: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:30 smithi078 ceph-mon[94114]: pgmap v1381: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:32 smithi078 ceph-mon[94114]: pgmap v1382: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:34 smithi078 ceph-mon[94114]: pgmap v1383: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:36 smithi078 ceph-mon[94114]: pgmap v1384: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:19.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:38 smithi078 ceph-mon[94114]: pgmap v1385: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:20.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:40 smithi078 ceph-mon[94114]: pgmap v1386: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:21.347 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:42 smithi078 ceph-mon[94114]: pgmap v1387: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:21.851 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:44 smithi078 ceph-mon[94114]: pgmap v1388: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:22.617 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:46 smithi078 ceph-mon[94114]: pgmap v1389: 97 pgs: 97 active+clean; 1.5 MiB data, 235 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:22.617 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:48 smithi078 ceph-mon[94114]: pgmap v1390: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:22.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:50 smithi078 ceph-mon[94114]: pgmap v1391: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:22.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:52 smithi078 ceph-mon[94114]: pgmap v1392: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:22.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:54 smithi078 ceph-mon[94114]: pgmap v1393: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:23.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:56 smithi078 ceph-mon[94114]: pgmap v1394: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:23.767 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:29:58 smithi078 ceph-mon[94114]: pgmap v1395: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:30:23.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:00 smithi078 ceph-mon[94114]: pgmap v1396: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:23.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:00 smithi078 ceph-mon[94114]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:30:23.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:00 smithi078 ceph-mon[94114]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2023-03-17T12:30:23.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:00 smithi078 ceph-mon[94114]: daemon mds.e on smithi078 is in error state 2023-03-17T12:30:23.768 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:02 smithi078 ceph-mon[94114]: pgmap v1397: 97 pgs: 97 active+clean; 1.5 MiB data, 236 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:25.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:04 smithi078 ceph-mon[94114]: pgmap v1398: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:06 smithi078 ceph-mon[94114]: pgmap v1399: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:08 smithi078 ceph-mon[94114]: pgmap v1400: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:09 smithi078 ceph-mon[94114]: osdmap e164: 12 total, 12 up, 12 in 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:10 smithi078 ceph-mon[94114]: pgmap v1402: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:12 smithi078 ceph-mon[94114]: pgmap v1403: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:14 smithi078 ceph-mon[94114]: pgmap v1404: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:16 smithi078 ceph-mon[94114]: pgmap v1405: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:16 smithi078 ceph-mon[94114]: osdmap e165: 12 total, 12 up, 12 in 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:18 smithi078 ceph-mon[94114]: pgmap v1407: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 931 B/s wr, 12 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:20 smithi078 ceph-mon[94114]: pgmap v1408: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:22 smithi078 ceph-mon[94114]: pgmap v1409: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:24 smithi078 ceph-mon[94114]: pgmap v1410: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:25.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:25 smithi078 ceph-mon[94114]: pgmap v1411: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:25 smithi078 ceph-mon[94114]: pgmap v1412: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:27 smithi078 ceph-mon[94114]: pgmap v1413: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:29 smithi078 ceph-mon[94114]: pgmap v1414: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:31 smithi078 ceph-mon[94114]: pgmap v1415: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:33 smithi078 ceph-mon[94114]: pgmap v1416: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:35 smithi078 ceph-mon[94114]: pgmap v1417: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:25.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:37 smithi078 ceph-mon[94114]: pgmap v1418: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:27.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:39 smithi078 ceph-mon[94114]: pgmap v1419: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:27.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:41 smithi078 ceph-mon[94114]: pgmap v1420: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:43 smithi078 ceph-mon[94114]: pgmap v1421: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:45 smithi078 ceph-mon[94114]: pgmap v1422: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:47 smithi078 ceph-mon[94114]: pgmap v1423: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:49 smithi078 ceph-mon[94114]: pgmap v1424: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:51 smithi078 ceph-mon[94114]: pgmap v1425: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:53 smithi078 ceph-mon[94114]: pgmap v1426: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:28.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:55 smithi078 ceph-mon[94114]: pgmap v1427: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:29.187 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:57 smithi078 ceph-mon[94114]: pgmap v1428: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:29.187 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:30:59 smithi078 ceph-mon[94114]: pgmap v1429: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:29.187 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:01 smithi078 ceph-mon[94114]: pgmap v1430: 97 pgs: 97 active+clean; 1.5 MiB data, 237 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:03 smithi078 ceph-mon[94114]: pgmap v1431: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:05 smithi078 ceph-mon[94114]: pgmap v1432: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:07 smithi078 ceph-mon[94114]: pgmap v1433: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:09 smithi078 ceph-mon[94114]: pgmap v1434: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:09 smithi078 ceph-mon[94114]: osdmap e166: 12 total, 12 up, 12 in 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:11 smithi078 ceph-mon[94114]: pgmap v1436: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:13 smithi078 ceph-mon[94114]: pgmap v1437: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:15 smithi078 ceph-mon[94114]: pgmap v1438: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:15 smithi078 ceph-mon[94114]: osdmap e167: 12 total, 12 up, 12 in 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:17 smithi078 ceph-mon[94114]: pgmap v1440: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:19 smithi078 ceph-mon[94114]: pgmap v1441: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:21 smithi078 ceph-mon[94114]: pgmap v1442: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:23 smithi078 ceph-mon[94114]: pgmap v1443: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:25 smithi078 ceph-mon[94114]: pgmap v1444: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:29.188 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:26 smithi078 ceph-mon[94114]: pgmap v1445: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 106 B/s wr, 10 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:26 smithi078 ceph-mon[94114]: pgmap v1446: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:28 smithi078 ceph-mon[94114]: pgmap v1447: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:30 smithi078 ceph-mon[94114]: pgmap v1448: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:32 smithi078 ceph-mon[94114]: pgmap v1449: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:34 smithi078 ceph-mon[94114]: pgmap v1450: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:36 smithi078 ceph-mon[94114]: pgmap v1451: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:29.189 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:38 smithi078 ceph-mon[94114]: pgmap v1452: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:40 smithi078 ceph-mon[94114]: pgmap v1453: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:42 smithi078 ceph-mon[94114]: pgmap v1454: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:44 smithi078 ceph-mon[94114]: pgmap v1455: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:30:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:46 smithi078 ceph-mon[94114]: pgmap v1456: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:30:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:48 smithi078 ceph-mon[94114]: pgmap v1457: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:30:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:50 smithi078 ceph-mon[94114]: pgmap v1458: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:30:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:52 smithi078 ceph-mon[94114]: pgmap v1459: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:30:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:54 smithi078 ceph-mon[94114]: pgmap v1460: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:30:30.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:56 smithi078 ceph-mon[94114]: pgmap v1461: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:30.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:31:58 smithi078 ceph-mon[94114]: pgmap v1462: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:30.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:00 smithi078 ceph-mon[94114]: pgmap v1463: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:30.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:02 smithi078 ceph-mon[94114]: pgmap v1464: 97 pgs: 97 active+clean; 1.5 MiB data, 239 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:31.112 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:04 smithi078 ceph-mon[94114]: pgmap v1465: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:31.112 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:06 smithi078 ceph-mon[94114]: pgmap v1466: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:08 smithi078 ceph-mon[94114]: pgmap v1467: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:09 smithi078 ceph-mon[94114]: osdmap e168: 12 total, 12 up, 12 in 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:10 smithi078 ceph-mon[94114]: pgmap v1469: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:11 smithi078 ceph-mon[94114]: pgmap v1470: 97 pgs: 97 active+clean; 1.5 MiB data, 240 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:14 smithi078 ceph-mon[94114]: pgmap v1471: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:16 smithi078 ceph-mon[94114]: pgmap v1472: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:16 smithi078 ceph-mon[94114]: osdmap e169: 12 total, 12 up, 12 in 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:18 smithi078 ceph-mon[94114]: pgmap v1474: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 970 B/s wr, 13 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:20 smithi078 ceph-mon[94114]: pgmap v1475: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:22 smithi078 ceph-mon[94114]: pgmap v1476: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:24 smithi078 ceph-mon[94114]: pgmap v1477: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:26 smithi078 ceph-mon[94114]: pgmap v1478: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:31.113 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:27 smithi078 ceph-mon[94114]: pgmap v1479: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 490 B/s wr, 10 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:27 smithi078 ceph-mon[94114]: pgmap v1480: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 464 B/s wr, 6 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:29 smithi078 ceph-mon[94114]: pgmap v1481: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 464 B/s wr, 11 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:31 smithi078 ceph-mon[94114]: pgmap v1482: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 464 B/s wr, 11 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:33 smithi078 ceph-mon[94114]: pgmap v1483: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:35 smithi078 ceph-mon[94114]: pgmap v1484: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:37 smithi078 ceph-mon[94114]: pgmap v1485: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:39 smithi078 ceph-mon[94114]: pgmap v1486: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:41 smithi078 ceph-mon[94114]: pgmap v1487: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:43 smithi078 ceph-mon[94114]: pgmap v1488: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:45 smithi078 ceph-mon[94114]: pgmap v1489: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:47 smithi078 ceph-mon[94114]: pgmap v1490: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:31.114 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:49 smithi078 ceph-mon[94114]: pgmap v1491: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:31.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:51 smithi078 ceph-mon[94114]: pgmap v1492: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:33.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:53 smithi078 ceph-mon[94114]: pgmap v1493: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:55 smithi078 ceph-mon[94114]: pgmap v1494: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:57 smithi078 ceph-mon[94114]: pgmap v1495: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:32:59 smithi078 ceph-mon[94114]: pgmap v1496: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:01 smithi078 ceph-mon[94114]: pgmap v1497: 97 pgs: 97 active+clean; 1.5 MiB data, 241 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:03 smithi078 ceph-mon[94114]: pgmap v1498: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:05 smithi078 ceph-mon[94114]: pgmap v1499: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:07 smithi078 ceph-mon[94114]: pgmap v1500: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:09 smithi078 ceph-mon[94114]: pgmap v1501: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:09 smithi078 ceph-mon[94114]: osdmap e170: 12 total, 12 up, 12 in 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:11 smithi078 ceph-mon[94114]: pgmap v1503: 97 pgs: 97 active+clean; 1.6 MiB data, 242 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:13 smithi078 ceph-mon[94114]: pgmap v1504: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:15 smithi078 ceph-mon[94114]: pgmap v1505: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:33.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:15 smithi078 ceph-mon[94114]: osdmap e171: 12 total, 12 up, 12 in 2023-03-17T12:30:33.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:17 smithi078 ceph-mon[94114]: pgmap v1507: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:34.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:19 smithi078 ceph-mon[94114]: pgmap v1508: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:30:34.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:21 smithi078 ceph-mon[94114]: pgmap v1509: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:34.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:23 smithi078 ceph-mon[94114]: pgmap v1510: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:25 smithi078 ceph-mon[94114]: pgmap v1511: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:27 smithi078 ceph-mon[94114]: pgmap v1512: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:28 smithi078 ceph-mon[94114]: pgmap v1513: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 94 B/s wr, 9 op/s 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:28 smithi078 ceph-mon[94114]: pgmap v1514: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:30:34.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:30 smithi078 ceph-mon[94114]: pgmap v1515: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:36.404 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:32 smithi078 ceph-mon[94114]: pgmap v1516: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:30:36.404 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:34 smithi078 ceph-mon[94114]: pgmap v1517: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:36.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:36 smithi078 ceph-mon[94114]: pgmap v1518: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:36.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:38 smithi078 ceph-mon[94114]: pgmap v1519: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:36.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:40 smithi078 ceph-mon[94114]: pgmap v1520: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:36.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:42 smithi078 ceph-mon[94114]: pgmap v1521: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:37.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:44 smithi078 ceph-mon[94114]: pgmap v1522: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:37.551 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:46 smithi078 ceph-mon[94114]: pgmap v1523: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:48 smithi078 ceph-mon[94114]: pgmap v1524: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:50 smithi078 ceph-mon[94114]: pgmap v1525: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:52 smithi078 ceph-mon[94114]: pgmap v1526: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:54 smithi078 ceph-mon[94114]: pgmap v1527: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:56 smithi078 ceph-mon[94114]: pgmap v1528: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:33:58 smithi078 ceph-mon[94114]: pgmap v1529: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:00 smithi078 ceph-mon[94114]: pgmap v1530: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:02 smithi078 ceph-mon[94114]: pgmap v1531: 97 pgs: 97 active+clean; 1.6 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:04 smithi078 ceph-mon[94114]: pgmap v1532: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:06 smithi078 ceph-mon[94114]: pgmap v1533: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:08 smithi078 ceph-mon[94114]: pgmap v1534: 97 pgs: 97 active+clean; 1.6 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:09 smithi078 ceph-mon[94114]: osdmap e172: 12 total, 12 up, 12 in 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:09 smithi078 ceph-mon[94114]: pgmap v1536: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:30:37.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:12 smithi078 ceph-mon[94114]: pgmap v1537: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:30:37.553 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:14 smithi078 ceph-mon[94114]: pgmap v1538: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:40.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:16 smithi078 ceph-mon[94114]: pgmap v1539: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:40.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:16 smithi078 ceph-mon[94114]: osdmap e173: 12 total, 12 up, 12 in 2023-03-17T12:30:40.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:18 smithi078 ceph-mon[94114]: pgmap v1541: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 126 B/s wr, 6 op/s 2023-03-17T12:30:40.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:20 smithi078 ceph-mon[94114]: pgmap v1542: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:40.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:22 smithi078 ceph-mon[94114]: pgmap v1543: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:30:40.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:24 smithi078 ceph-mon[94114]: pgmap v1544: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:30:40.036 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:26 smithi078 ceph-mon[94114]: pgmap v1545: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:30:40.036 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:40.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:28 smithi078 ceph-mon[94114]: pgmap v1546: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 637 B/s wr, 10 op/s 2023-03-17T12:30:40.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:40.884 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:40.885 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:28 smithi078 ceph-mon[94114]: pgmap v1547: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 947 B/s wr, 14 op/s 2023-03-17T12:30:40.885 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:28 smithi078 ceph-mon[94114]: pgmap v1548: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:30:43.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:43.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:30 smithi078 ceph-mon[94114]: pgmap v1549: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:30:43.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:32 smithi078 ceph-mon[94114]: pgmap v1550: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:30:43.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:34 smithi078 ceph-mon[94114]: pgmap v1551: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:30:43.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:36 smithi078 ceph-mon[94114]: pgmap v1552: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:30:43.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:38 smithi078 ceph-mon[94114]: pgmap v1553: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:43.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:40 smithi078 ceph-mon[94114]: pgmap v1554: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:43.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:42 smithi078 ceph-mon[94114]: pgmap v1555: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:43.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:44 smithi078 ceph-mon[94114]: pgmap v1556: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:44.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:46 smithi078 ceph-mon[94114]: pgmap v1557: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:46.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:48 smithi078 ceph-mon[94114]: pgmap v1558: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:46.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:50 smithi078 ceph-mon[94114]: pgmap v1559: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:46.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:52 smithi078 ceph-mon[94114]: pgmap v1560: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:46.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:54 smithi078 ceph-mon[94114]: pgmap v1561: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:46.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:56 smithi078 ceph-mon[94114]: pgmap v1562: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:46.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:34:58 smithi078 ceph-mon[94114]: pgmap v1563: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:00 smithi078 ceph-mon[94114]: pgmap v1564: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:02 smithi078 ceph-mon[94114]: pgmap v1565: 97 pgs: 97 active+clean; 1.6 MiB data, 249 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:04 smithi078 ceph-mon[94114]: pgmap v1566: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:06 smithi078 ceph-mon[94114]: pgmap v1567: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:08 smithi078 ceph-mon[94114]: pgmap v1568: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:09 smithi078 ceph-mon[94114]: osdmap e174: 12 total, 12 up, 12 in 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:10 smithi078 ceph-mon[94114]: pgmap v1570: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:12 smithi078 ceph-mon[94114]: pgmap v1571: 97 pgs: 97 active+clean; 1.6 MiB data, 250 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:47.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:14 smithi078 ceph-mon[94114]: pgmap v1572: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:16 smithi078 ceph-mon[94114]: osdmap e175: 12 total, 12 up, 12 in 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:16 smithi078 ceph-mon[94114]: pgmap v1574: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:18 smithi078 ceph-mon[94114]: pgmap v1575: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:20 smithi078 ceph-mon[94114]: pgmap v1576: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:22 smithi078 ceph-mon[94114]: pgmap v1577: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:24 smithi078 ceph-mon[94114]: pgmap v1578: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:26 smithi078 ceph-mon[94114]: pgmap v1579: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:28 smithi078 ceph-mon[94114]: pgmap v1580: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:29 smithi078 ceph-mon[94114]: pgmap v1581: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:30:47.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:29 smithi078 ceph-mon[94114]: pgmap v1582: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:31 smithi078 ceph-mon[94114]: pgmap v1583: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:33 smithi078 ceph-mon[94114]: pgmap v1584: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:35 smithi078 ceph-mon[94114]: pgmap v1585: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:37 smithi078 ceph-mon[94114]: pgmap v1586: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:39 smithi078 ceph-mon[94114]: pgmap v1587: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:41 smithi078 ceph-mon[94114]: pgmap v1588: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:43 smithi078 ceph-mon[94114]: pgmap v1589: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:45 smithi078 ceph-mon[94114]: pgmap v1590: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:47 smithi078 ceph-mon[94114]: pgmap v1591: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:49 smithi078 ceph-mon[94114]: pgmap v1592: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:51 smithi078 ceph-mon[94114]: pgmap v1593: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:53 smithi078 ceph-mon[94114]: pgmap v1594: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:55 smithi078 ceph-mon[94114]: pgmap v1595: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:57 smithi078 ceph-mon[94114]: pgmap v1596: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:35:59 smithi078 ceph-mon[94114]: pgmap v1597: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:30:47.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:01 smithi078 ceph-mon[94114]: pgmap v1598: 97 pgs: 97 active+clean; 1.6 MiB data, 251 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:30:47.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:03 smithi078 ceph-mon[94114]: pgmap v1599: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:47.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:04 smithi078 ceph-mon[94114]: osdmap e176: 12 total, 12 up, 12 in 2023-03-17T12:30:47.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:04 smithi078 ceph-mon[94114]: pgmap v1601: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:47.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:07 smithi078 ceph-mon[94114]: pgmap v1602: 97 pgs: 97 active+clean; 1.6 MiB data, 252 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:47.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:09 smithi078 ceph-mon[94114]: pgmap v1603: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:30:47.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:11 smithi078 ceph-mon[94114]: pgmap v1604: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:30:50.463 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:11 smithi078 ceph-mon[94114]: osdmap e177: 12 total, 12 up, 12 in 2023-03-17T12:30:50.463 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:13 smithi078 ceph-mon[94114]: pgmap v1606: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.0 KiB/s wr, 10 op/s 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:15 smithi078 ceph-mon[94114]: pgmap v1607: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 921 B/s wr, 9 op/s 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:15 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:15 smithi078 ceph-mon[94114]: osdmap e178: 12 total, 12 up, 12 in 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/1872850599,v1:172.21.15.35:6837/1872850599] up:boot 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:17 smithi078 ceph-mon[94114]: pgmap v1609: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:19 smithi078 ceph-mon[94114]: pgmap v1610: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:30:50.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:21 smithi078 ceph-mon[94114]: pgmap v1611: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 517 B/s wr, 10 op/s 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:23 smithi078 ceph-mon[94114]: pgmap v1612: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:25 smithi078 ceph-mon[94114]: pgmap v1613: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:27 smithi078 ceph-mon[94114]: pgmap v1614: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 361 B/s wr, 9 op/s 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:29 smithi078 ceph-mon[94114]: pgmap v1615: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:50.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:30 smithi078 ceph-mon[94114]: pgmap v1616: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:30 smithi078 ceph-mon[94114]: pgmap v1617: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:31 smithi078 ceph-mon[94114]: pgmap v1618: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:33 smithi078 ceph-mon[94114]: pgmap v1619: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:30:50.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:36 smithi078 ceph-mon[94114]: pgmap v1620: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:30:50.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:37 smithi078 ceph-mon[94114]: pgmap v1621: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:30:50.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:39 smithi078 ceph-mon[94114]: pgmap v1622: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:30:50.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:41 smithi078 ceph-mon[94114]: pgmap v1623: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:50.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:43 smithi078 ceph-mon[94114]: pgmap v1624: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:50.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:46 smithi078 ceph-mon[94114]: pgmap v1625: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:30:50.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:47 smithi078 ceph-mon[94114]: pgmap v1626: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:50.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:49 smithi078 ceph-mon[94114]: pgmap v1627: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:50.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:51 smithi078 ceph-mon[94114]: pgmap v1628: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:53 smithi078 ceph-mon[94114]: pgmap v1629: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:56 smithi078 ceph-mon[94114]: pgmap v1630: 97 pgs: 97 active+clean; 1.6 MiB data, 253 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:57 smithi078 ceph-mon[94114]: pgmap v1631: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:36:59 smithi078 ceph-mon[94114]: pgmap v1632: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:01 smithi078 ceph-mon[94114]: pgmap v1633: 97 pgs: 97 active+clean; 1.6 MiB data, 254 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:03 smithi078 ceph-mon[94114]: pgmap v1634: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:06 smithi078 ceph-mon[94114]: pgmap v1635: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:30:52.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:07 smithi078 ceph-mon[94114]: pgmap v1636: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:30:52.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:09 smithi078 ceph-mon[94114]: osdmap e179: 12 total, 12 up, 12 in 2023-03-17T12:30:52.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:09 smithi078 ceph-mon[94114]: pgmap v1638: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:52.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:11 smithi078 ceph-mon[94114]: pgmap v1639: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:30:52.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:13 smithi078 ceph-mon[94114]: pgmap v1640: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:52.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:16 smithi078 ceph-mon[94114]: osdmap e180: 12 total, 12 up, 12 in 2023-03-17T12:30:53.011 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:16 smithi078 ceph-mon[94114]: pgmap v1642: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:30:55.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:18 smithi078 ceph-mon[94114]: pgmap v1643: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 343 B/s wr, 11 op/s 2023-03-17T12:30:55.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:21 smithi078 ceph-mon[94114]: pgmap v1644: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:30:55.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:23 smithi078 ceph-mon[94114]: pgmap v1645: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:30:55.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:25 smithi078 ceph-mon[94114]: pgmap v1646: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:30:55.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:27 smithi078 ceph-mon[94114]: pgmap v1647: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 201 B/s wr, 10 op/s 2023-03-17T12:30:59.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:29 smithi078 ceph-mon[94114]: pgmap v1648: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:31:01.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:01.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.468 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:31 smithi078 ceph-mon[94114]: pgmap v1649: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:01.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: pgmap v1650: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:01.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:01.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:05.550 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:05.550 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:31:06.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:31:06.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:31:06.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: pgmap v1651: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:31:07.981 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: pgmap v1652: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:36 smithi078 ceph-mon[94114]: pgmap v1653: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:38 smithi078 ceph-mon[94114]: pgmap v1654: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:40 smithi078 ceph-mon[94114]: pgmap v1655: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:42 smithi078 ceph-mon[94114]: pgmap v1656: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:44 smithi078 ceph-mon[94114]: pgmap v1657: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:31:08.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:46 smithi078 ceph-mon[94114]: pgmap v1658: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:48 smithi078 ceph-mon[94114]: pgmap v1659: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:50 smithi078 ceph-mon[94114]: pgmap v1660: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:52 smithi078 ceph-mon[94114]: pgmap v1661: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:54 smithi078 ceph-mon[94114]: pgmap v1662: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:56 smithi078 ceph-mon[94114]: pgmap v1663: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:37:58 smithi078 ceph-mon[94114]: pgmap v1664: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:00 smithi078 ceph-mon[94114]: pgmap v1665: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:02 smithi078 ceph-mon[94114]: pgmap v1666: 97 pgs: 97 active+clean; 1.6 MiB data, 255 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:04 smithi078 ceph-mon[94114]: pgmap v1667: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:06 smithi078 ceph-mon[94114]: pgmap v1668: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:08.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:08 smithi078 ceph-mon[94114]: pgmap v1669: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:09 smithi078 ceph-mon[94114]: osdmap e181: 12 total, 12 up, 12 in 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:10 smithi078 ceph-mon[94114]: pgmap v1671: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:12 smithi078 ceph-mon[94114]: pgmap v1672: 97 pgs: 97 active+clean; 1.6 MiB data, 256 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:14 smithi078 ceph-mon[94114]: pgmap v1673: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:16 smithi078 ceph-mon[94114]: osdmap e182: 12 total, 12 up, 12 in 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:16 smithi078 ceph-mon[94114]: pgmap v1675: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:31:09.661 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:18 smithi078 ceph-mon[94114]: pgmap v1676: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:20 smithi078 ceph-mon[94114]: pgmap v1677: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:22 smithi078 ceph-mon[94114]: pgmap v1678: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:24 smithi078 ceph-mon[94114]: pgmap v1679: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:26 smithi078 ceph-mon[94114]: pgmap v1680: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:28 smithi078 ceph-mon[94114]: pgmap v1681: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:30 smithi078 ceph-mon[94114]: pgmap v1682: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:32 smithi078 ceph-mon[94114]: pgmap v1683: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:34 smithi078 ceph-mon[94114]: pgmap v1684: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:36 smithi078 ceph-mon[94114]: pgmap v1685: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:09.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: pgmap v1686: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 12 op/s 2023-03-17T12:31:09.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: pgmap v1687: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:09.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:09.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:40 smithi078 ceph-mon[94114]: pgmap v1688: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:09.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:42 smithi078 ceph-mon[94114]: pgmap v1689: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:09.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:44 smithi078 ceph-mon[94114]: pgmap v1690: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:46 smithi078 ceph-mon[94114]: pgmap v1691: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:48 smithi078 ceph-mon[94114]: pgmap v1692: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:50 smithi078 ceph-mon[94114]: pgmap v1693: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:52 smithi078 ceph-mon[94114]: pgmap v1694: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:54 smithi078 ceph-mon[94114]: pgmap v1695: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:56 smithi078 ceph-mon[94114]: pgmap v1696: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:38:58 smithi078 ceph-mon[94114]: pgmap v1697: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:00 smithi078 ceph-mon[94114]: pgmap v1698: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:02 smithi078 ceph-mon[94114]: pgmap v1699: 97 pgs: 97 active+clean; 1.6 MiB data, 257 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:31:10.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:04 smithi078 ceph-mon[94114]: pgmap v1700: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:31:10.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:06 smithi078 ceph-mon[94114]: pgmap v1701: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:10.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:08 smithi078 ceph-mon[94114]: pgmap v1702: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:31:10.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:09 smithi078 ceph-mon[94114]: osdmap e183: 12 total, 12 up, 12 in 2023-03-17T12:31:10.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:10 smithi078 ceph-mon[94114]: pgmap v1704: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:12 smithi078 ceph-mon[94114]: pgmap v1705: 97 pgs: 97 active+clean; 1.6 MiB data, 258 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:14 smithi078 ceph-mon[94114]: pgmap v1706: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:16 smithi078 ceph-mon[94114]: pgmap v1707: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 818 B/s wr, 11 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:16 smithi078 ceph-mon[94114]: osdmap e184: 12 total, 12 up, 12 in 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:18 smithi078 ceph-mon[94114]: pgmap v1709: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 119 B/s wr, 12 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:20 smithi078 ceph-mon[94114]: pgmap v1710: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:22 smithi078 ceph-mon[94114]: pgmap v1711: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:12.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:24 smithi078 ceph-mon[94114]: pgmap v1712: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:26 smithi078 ceph-mon[94114]: pgmap v1713: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:28 smithi078 ceph-mon[94114]: pgmap v1714: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 440 B/s wr, 13 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:30 smithi078 ceph-mon[94114]: pgmap v1715: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:32 smithi078 ceph-mon[94114]: pgmap v1716: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:34 smithi078 ceph-mon[94114]: pgmap v1717: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:36 smithi078 ceph-mon[94114]: pgmap v1718: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:38 smithi078 ceph-mon[94114]: pgmap v1719: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:40 smithi078 ceph-mon[94114]: pgmap v1720: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:12.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:41 smithi078 ceph-mon[94114]: pgmap v1721: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 269 B/s wr, 9 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:41 smithi078 ceph-mon[94114]: pgmap v1722: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:43 smithi078 ceph-mon[94114]: pgmap v1723: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:45 smithi078 ceph-mon[94114]: pgmap v1724: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:47 smithi078 ceph-mon[94114]: pgmap v1725: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:49 smithi078 ceph-mon[94114]: pgmap v1726: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 326 B/s wr, 11 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:51 smithi078 ceph-mon[94114]: pgmap v1727: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:53 smithi078 ceph-mon[94114]: pgmap v1728: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:55 smithi078 ceph-mon[94114]: pgmap v1729: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:57 smithi078 ceph-mon[94114]: pgmap v1730: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:12.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:39:59 smithi078 ceph-mon[94114]: pgmap v1731: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:12.834 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:31:12.834 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:01 smithi078 ceph-mon[94114]: pgmap v1732: 97 pgs: 97 active+clean; 1.6 MiB data, 259 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:14.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:03 smithi078 ceph-mon[94114]: pgmap v1733: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:05 smithi078 ceph-mon[94114]: pgmap v1734: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:07 smithi078 ceph-mon[94114]: pgmap v1735: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:09 smithi078 ceph-mon[94114]: pgmap v1736: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:09 smithi078 ceph-mon[94114]: osdmap e185: 12 total, 12 up, 12 in 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:11 smithi078 ceph-mon[94114]: pgmap v1738: 97 pgs: 97 active+clean; 1.6 MiB data, 260 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:13 smithi078 ceph-mon[94114]: pgmap v1739: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:15 smithi078 ceph-mon[94114]: pgmap v1740: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:14.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:15 smithi078 ceph-mon[94114]: osdmap e186: 12 total, 12 up, 12 in 2023-03-17T12:31:14.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:17 smithi078 ceph-mon[94114]: pgmap v1742: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:31:14.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:19 smithi078 ceph-mon[94114]: pgmap v1743: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:31:16.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:21 smithi078 ceph-mon[94114]: pgmap v1744: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:16.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:23 smithi078 ceph-mon[94114]: pgmap v1745: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:16.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:25 smithi078 ceph-mon[94114]: pgmap v1746: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:16.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:27 smithi078 ceph-mon[94114]: pgmap v1747: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 92 B/s wr, 9 op/s 2023-03-17T12:31:16.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:29 smithi078 ceph-mon[94114]: pgmap v1748: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:31:16.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:31 smithi078 ceph-mon[94114]: pgmap v1749: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:33 smithi078 ceph-mon[94114]: pgmap v1750: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:35 smithi078 ceph-mon[94114]: pgmap v1751: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:37 smithi078 ceph-mon[94114]: pgmap v1752: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:39 smithi078 ceph-mon[94114]: pgmap v1753: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:41 smithi078 ceph-mon[94114]: pgmap v1754: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:43 smithi078 ceph-mon[94114]: pgmap v1755: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:17.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:17.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: pgmap v1756: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:31:17.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: pgmap v1757: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:17.670 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:47 smithi078 ceph-mon[94114]: pgmap v1758: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:49 smithi078 ceph-mon[94114]: pgmap v1759: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:51 smithi078 ceph-mon[94114]: pgmap v1760: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:53 smithi078 ceph-mon[94114]: pgmap v1761: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:55 smithi078 ceph-mon[94114]: pgmap v1762: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:57 smithi078 ceph-mon[94114]: pgmap v1763: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:40:59 smithi078 ceph-mon[94114]: pgmap v1764: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:01 smithi078 ceph-mon[94114]: pgmap v1765: 97 pgs: 97 active+clean; 1.6 MiB data, 261 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:03 smithi078 ceph-mon[94114]: pgmap v1766: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:05 smithi078 ceph-mon[94114]: pgmap v1767: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:07 smithi078 ceph-mon[94114]: pgmap v1768: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:09 smithi078 ceph-mon[94114]: pgmap v1769: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:09 smithi078 ceph-mon[94114]: osdmap e187: 12 total, 12 up, 12 in 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:11 smithi078 ceph-mon[94114]: pgmap v1771: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:18.086 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:13 smithi078 ceph-mon[94114]: pgmap v1772: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:15 smithi078 ceph-mon[94114]: pgmap v1773: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:15 smithi078 ceph-mon[94114]: osdmap e188: 12 total, 12 up, 12 in 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:17 smithi078 ceph-mon[94114]: pgmap v1775: 97 pgs: 97 active+clean; 1.6 MiB data, 262 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:19 smithi078 ceph-mon[94114]: pgmap v1776: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:21 smithi078 ceph-mon[94114]: pgmap v1777: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:23 smithi078 ceph-mon[94114]: pgmap v1778: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:25 smithi078 ceph-mon[94114]: pgmap v1779: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:27 smithi078 ceph-mon[94114]: pgmap v1780: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 95 B/s wr, 9 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:29 smithi078 ceph-mon[94114]: pgmap v1781: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:31 smithi078 ceph-mon[94114]: pgmap v1782: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:19.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:33 smithi078 ceph-mon[94114]: pgmap v1783: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:19.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:35 smithi078 ceph-mon[94114]: pgmap v1784: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:19.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:37 smithi078 ceph-mon[94114]: pgmap v1785: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:19.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:39 smithi078 ceph-mon[94114]: pgmap v1786: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:19.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:41 smithi078 ceph-mon[94114]: pgmap v1787: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:19.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:43 smithi078 ceph-mon[94114]: pgmap v1788: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:31:20.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:20.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:45 smithi078 ceph-mon[94114]: pgmap v1789: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:31:20.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:46 smithi078 ceph-mon[94114]: pgmap v1790: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 754 B/s wr, 9 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:46 smithi078 ceph-mon[94114]: pgmap v1791: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:48 smithi078 ceph-mon[94114]: pgmap v1792: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:50 smithi078 ceph-mon[94114]: pgmap v1793: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 925 B/s wr, 12 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:52 smithi078 ceph-mon[94114]: pgmap v1794: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:54 smithi078 ceph-mon[94114]: pgmap v1795: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:56 smithi078 ceph-mon[94114]: pgmap v1796: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:41:58 smithi078 ceph-mon[94114]: pgmap v1797: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:00 smithi078 ceph-mon[94114]: pgmap v1798: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:02 smithi078 ceph-mon[94114]: pgmap v1799: 97 pgs: 97 active+clean; 1.6 MiB data, 263 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:04 smithi078 ceph-mon[94114]: pgmap v1800: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:06 smithi078 ceph-mon[94114]: pgmap v1801: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:31:20.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:08 smithi078 ceph-mon[94114]: pgmap v1802: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:09 smithi078 ceph-mon[94114]: osdmap e189: 12 total, 12 up, 12 in 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:10 smithi078 ceph-mon[94114]: pgmap v1804: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:11 smithi078 ceph-mon[94114]: pgmap v1805: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:14 smithi078 ceph-mon[94114]: pgmap v1806: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:16 smithi078 ceph-mon[94114]: pgmap v1807: 97 pgs: 97 active+clean; 1.6 MiB data, 264 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:16 smithi078 ceph-mon[94114]: osdmap e190: 12 total, 12 up, 12 in 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:18 smithi078 ceph-mon[94114]: pgmap v1809: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 972 B/s wr, 13 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:20 smithi078 ceph-mon[94114]: pgmap v1810: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:22 smithi078 ceph-mon[94114]: pgmap v1811: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:24 smithi078 ceph-mon[94114]: pgmap v1812: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:26 smithi078 ceph-mon[94114]: pgmap v1813: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:28 smithi078 ceph-mon[94114]: pgmap v1814: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 443 B/s wr, 13 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:30 smithi078 ceph-mon[94114]: pgmap v1815: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:32 smithi078 ceph-mon[94114]: pgmap v1816: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:31:20.078 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:34 smithi078 ceph-mon[94114]: pgmap v1817: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:36 smithi078 ceph-mon[94114]: pgmap v1818: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:38 smithi078 ceph-mon[94114]: pgmap v1819: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:40 smithi078 ceph-mon[94114]: pgmap v1820: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:42 smithi078 ceph-mon[94114]: pgmap v1821: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:44 smithi078 ceph-mon[94114]: pgmap v1822: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:46 smithi078 ceph-mon[94114]: pgmap v1823: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:47 smithi078 ceph-mon[94114]: pgmap v1824: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:47 smithi078 ceph-mon[94114]: pgmap v1825: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:49 smithi078 ceph-mon[94114]: pgmap v1826: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:51 smithi078 ceph-mon[94114]: pgmap v1827: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:20.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:53 smithi078 ceph-mon[94114]: pgmap v1828: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:55 smithi078 ceph-mon[94114]: pgmap v1829: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:57 smithi078 ceph-mon[94114]: pgmap v1830: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:42:59 smithi078 ceph-mon[94114]: pgmap v1831: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:01 smithi078 ceph-mon[94114]: pgmap v1832: 97 pgs: 97 active+clean; 1.6 MiB data, 265 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:03 smithi078 ceph-mon[94114]: pgmap v1833: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:05 smithi078 ceph-mon[94114]: pgmap v1834: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:07 smithi078 ceph-mon[94114]: pgmap v1835: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:09 smithi078 ceph-mon[94114]: pgmap v1836: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:22.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:09 smithi078 ceph-mon[94114]: osdmap e191: 12 total, 12 up, 12 in 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:11 smithi078 ceph-mon[94114]: pgmap v1838: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:13 smithi078 ceph-mon[94114]: pgmap v1839: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:15 smithi078 ceph-mon[94114]: pgmap v1840: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:15 smithi078 ceph-mon[94114]: osdmap e192: 12 total, 12 up, 12 in 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:17 smithi078 ceph-mon[94114]: pgmap v1842: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:19 smithi078 ceph-mon[94114]: pgmap v1843: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:21 smithi078 ceph-mon[94114]: pgmap v1844: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:23 smithi078 ceph-mon[94114]: pgmap v1845: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:23.784 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:25 smithi078 ceph-mon[94114]: pgmap v1846: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:23.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:27 smithi078 ceph-mon[94114]: pgmap v1847: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:31:23.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:29 smithi078 ceph-mon[94114]: pgmap v1848: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:31:23.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:31 smithi078 ceph-mon[94114]: pgmap v1849: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:23.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:32 smithi078 ceph-mon[94114]: pgmap v1850: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:23.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:35 smithi078 ceph-mon[94114]: pgmap v1851: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:23.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:37 smithi078 ceph-mon[94114]: pgmap v1852: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:24.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:39 smithi078 ceph-mon[94114]: pgmap v1853: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:24.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:41 smithi078 ceph-mon[94114]: pgmap v1854: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:24.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:43 smithi078 ceph-mon[94114]: pgmap v1855: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:26.637 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:45 smithi078 ceph-mon[94114]: pgmap v1856: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:26.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:26.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:47 smithi078 ceph-mon[94114]: pgmap v1857: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:26.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:26.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:26.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:26.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:48 smithi078 ceph-mon[94114]: pgmap v1858: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:31:29.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:48 smithi078 ceph-mon[94114]: pgmap v1859: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:31:29.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:50 smithi078 ceph-mon[94114]: pgmap v1860: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:29.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:52 smithi078 ceph-mon[94114]: pgmap v1861: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:31:29.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:54 smithi078 ceph-mon[94114]: pgmap v1862: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:31:29.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:56 smithi078 ceph-mon[94114]: pgmap v1863: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:31:29.038 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:43:58 smithi078 ceph-mon[94114]: pgmap v1864: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:00 smithi078 ceph-mon[94114]: pgmap v1865: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:02 smithi078 ceph-mon[94114]: pgmap v1866: 97 pgs: 97 active+clean; 1.6 MiB data, 271 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:04 smithi078 ceph-mon[94114]: pgmap v1867: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:04 smithi078 ceph-mon[94114]: osdmap e193: 12 total, 12 up, 12 in 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:06 smithi078 ceph-mon[94114]: pgmap v1869: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:08 smithi078 ceph-mon[94114]: pgmap v1870: 97 pgs: 97 active+clean; 1.6 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:10 smithi078 ceph-mon[94114]: pgmap v1871: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:10 smithi078 ceph-mon[94114]: osdmap e194: 12 total, 12 up, 12 in 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:12 smithi078 ceph-mon[94114]: pgmap v1873: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:14 smithi078 ceph-mon[94114]: pgmap v1874: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1010 B/s wr, 12 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:16 smithi078 ceph-mon[94114]: pgmap v1875: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:18 smithi078 ceph-mon[94114]: pgmap v1876: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:20 smithi078 ceph-mon[94114]: pgmap v1877: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:31:29.039 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:22 smithi078 ceph-mon[94114]: pgmap v1878: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 503 B/s wr, 10 op/s 2023-03-17T12:31:30.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:24 smithi078 ceph-mon[94114]: pgmap v1879: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:31:30.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:26 smithi078 ceph-mon[94114]: pgmap v1880: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:31:30.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:28 smithi078 ceph-mon[94114]: pgmap v1881: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2023-03-17T12:31:30.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:30 smithi078 ceph-mon[94114]: pgmap v1882: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:31:30.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:32 smithi078 ceph-mon[94114]: pgmap v1883: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:30.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:34 smithi078 ceph-mon[94114]: pgmap v1884: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:30.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:36 smithi078 ceph-mon[94114]: pgmap v1885: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:30.476 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:38 smithi078 ceph-mon[94114]: pgmap v1886: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-17T12:31:31.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:40 smithi078 ceph-mon[94114]: pgmap v1887: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:31.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:42 smithi078 ceph-mon[94114]: pgmap v1888: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:31.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:44 smithi078 ceph-mon[94114]: pgmap v1889: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:34.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:46 smithi078 ceph-mon[94114]: pgmap v1890: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:34.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:48 smithi078 ceph-mon[94114]: pgmap v1891: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:48 smithi078 ceph-mon[94114]: pgmap v1892: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:48 smithi078 ceph-mon[94114]: pgmap v1893: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:34.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:49 smithi078 ceph-mon[94114]: pgmap v1894: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:34.075 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:52 smithi078 ceph-mon[94114]: pgmap v1895: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:31:34.075 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:54 smithi078 ceph-mon[94114]: pgmap v1896: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:36.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:56 smithi078 ceph-mon[94114]: pgmap v1897: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-17T12:31:36.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:44:58 smithi078 ceph-mon[94114]: pgmap v1898: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:31:36.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:00 smithi078 ceph-mon[94114]: pgmap v1899: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:36.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:02 smithi078 ceph-mon[94114]: pgmap v1900: 97 pgs: 97 active+clean; 1.6 MiB data, 277 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:36.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:04 smithi078 ceph-mon[94114]: pgmap v1901: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:36.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:06 smithi078 ceph-mon[94114]: pgmap v1902: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:31:37.794 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:08 smithi078 ceph-mon[94114]: pgmap v1903: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:38.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:09 smithi078 ceph-mon[94114]: osdmap e195: 12 total, 12 up, 12 in 2023-03-17T12:31:40.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:10 smithi078 ceph-mon[94114]: pgmap v1905: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:40.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:12 smithi078 ceph-mon[94114]: pgmap v1906: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:40.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:14 smithi078 ceph-mon[94114]: pgmap v1907: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:40.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:16 smithi078 ceph-mon[94114]: pgmap v1908: 97 pgs: 97 active+clean; 1.6 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:40.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:16 smithi078 ceph-mon[94114]: osdmap e196: 12 total, 12 up, 12 in 2023-03-17T12:31:40.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:18 smithi078 ceph-mon[94114]: pgmap v1910: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:31:40.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:20 smithi078 ceph-mon[94114]: pgmap v1911: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:41.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:22 smithi078 ceph-mon[94114]: pgmap v1912: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:31:42.406 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:24 smithi078 ceph-mon[94114]: pgmap v1913: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:42.406 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:26 smithi078 ceph-mon[94114]: pgmap v1914: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:42.406 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:28 smithi078 ceph-mon[94114]: pgmap v1915: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:31:42.406 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:30 smithi078 ceph-mon[94114]: pgmap v1916: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:42.406 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:32 smithi078 ceph-mon[94114]: pgmap v1917: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:42.406 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:34 smithi078 ceph-mon[94114]: pgmap v1918: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:42.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:36 smithi078 ceph-mon[94114]: pgmap v1919: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:42.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:38 smithi078 ceph-mon[94114]: pgmap v1920: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:42.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:40 smithi078 ceph-mon[94114]: pgmap v1921: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:42.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:42 smithi078 ceph-mon[94114]: pgmap v1922: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:42.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:44 smithi078 ceph-mon[94114]: pgmap v1923: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:42.407 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:46 smithi078 ceph-mon[94114]: pgmap v1924: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:43.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:48 smithi078 ceph-mon[94114]: pgmap v1925: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:43.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:49 smithi078 ceph-mon[94114]: pgmap v1926: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:49 smithi078 ceph-mon[94114]: pgmap v1927: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:51 smithi078 ceph-mon[94114]: pgmap v1928: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:53 smithi078 ceph-mon[94114]: pgmap v1929: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:43.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:55 smithi078 ceph-mon[94114]: pgmap v1930: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:31:45.159 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:57 smithi078 ceph-mon[94114]: pgmap v1931: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:31:47.122 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:45:59 smithi078 ceph-mon[94114]: pgmap v1932: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:31:48.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:01 smithi078 ceph-mon[94114]: pgmap v1933: 97 pgs: 97 active+clean; 1.6 MiB data, 279 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:48.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:03 smithi078 ceph-mon[94114]: pgmap v1934: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:31:48.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:05 smithi078 ceph-mon[94114]: pgmap v1935: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:31:48.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:07 smithi078 ceph-mon[94114]: pgmap v1936: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:31:48.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:09 smithi078 ceph-mon[94114]: pgmap v1937: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:31:48.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:09 smithi078 ceph-mon[94114]: osdmap e197: 12 total, 12 up, 12 in 2023-03-17T12:31:48.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:11 smithi078 ceph-mon[94114]: pgmap v1939: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:31:48.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:13 smithi078 ceph-mon[94114]: pgmap v1940: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:15 smithi078 ceph-mon[94114]: pgmap v1941: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:15 smithi078 ceph-mon[94114]: osdmap e198: 12 total, 12 up, 12 in 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:17 smithi078 ceph-mon[94114]: pgmap v1943: 97 pgs: 97 active+clean; 1.6 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:19 smithi078 ceph-mon[94114]: pgmap v1944: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 843 B/s wr, 11 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:21 smithi078 ceph-mon[94114]: pgmap v1945: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:23 smithi078 ceph-mon[94114]: pgmap v1946: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:25 smithi078 ceph-mon[94114]: pgmap v1947: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:26 smithi078 ceph-mon[94114]: pgmap v1948: 97 pgs: 97 active+clean; 1.6 MiB data, 285 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 664 B/s wr, 10 op/s 2023-03-17T12:31:51.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:29 smithi078 ceph-mon[94114]: pgmap v1949: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:31 smithi078 ceph-mon[94114]: pgmap v1950: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:33 smithi078 ceph-mon[94114]: pgmap v1951: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:35 smithi078 ceph-mon[94114]: pgmap v1952: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:37 smithi078 ceph-mon[94114]: pgmap v1953: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:39 smithi078 ceph-mon[94114]: pgmap v1954: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:41 smithi078 ceph-mon[94114]: pgmap v1955: 97 pgs: 97 active+clean; 1.6 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:43 smithi078 ceph-mon[94114]: pgmap v1956: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:45 smithi078 ceph-mon[94114]: pgmap v1957: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:47 smithi078 ceph-mon[94114]: pgmap v1958: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:49 smithi078 ceph-mon[94114]: pgmap v1959: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:51.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:50 smithi078 ceph-mon[94114]: pgmap v1960: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 272 B/s wr, 9 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:50 smithi078 ceph-mon[94114]: pgmap v1961: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:51 smithi078 ceph-mon[94114]: pgmap v1962: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:54 smithi078 ceph-mon[94114]: pgmap v1963: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:56 smithi078 ceph-mon[94114]: pgmap v1964: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:46:58 smithi078 ceph-mon[94114]: pgmap v1965: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:00 smithi078 ceph-mon[94114]: pgmap v1966: 97 pgs: 97 active+clean; 1.6 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:31:53.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:02 smithi078 ceph-mon[94114]: pgmap v1967: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:04 smithi078 ceph-mon[94114]: pgmap v1968: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:06 smithi078 ceph-mon[94114]: pgmap v1969: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:08 smithi078 ceph-mon[94114]: pgmap v1970: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:10 smithi078 ceph-mon[94114]: osdmap e199: 12 total, 12 up, 12 in 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:10 smithi078 ceph-mon[94114]: pgmap v1972: 97 pgs: 97 active+clean; 1.6 MiB data, 270 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:12 smithi078 ceph-mon[94114]: pgmap v1973: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:14 smithi078 ceph-mon[94114]: pgmap v1974: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:16 smithi078 ceph-mon[94114]: osdmap e200: 12 total, 12 up, 12 in 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:16 smithi078 ceph-mon[94114]: pgmap v1976: 97 pgs: 97 active+clean; 1.6 MiB data, 274 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:18 smithi078 ceph-mon[94114]: pgmap v1977: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 344 B/s wr, 11 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:20 smithi078 ceph-mon[94114]: pgmap v1978: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:22 smithi078 ceph-mon[94114]: pgmap v1979: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:24 smithi078 ceph-mon[94114]: pgmap v1980: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:26 smithi078 ceph-mon[94114]: pgmap v1981: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:28 smithi078 ceph-mon[94114]: pgmap v1982: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:30 smithi078 ceph-mon[94114]: pgmap v1983: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:32 smithi078 ceph-mon[94114]: pgmap v1984: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:53.864 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:34 smithi078 ceph-mon[94114]: pgmap v1985: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:53.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:36 smithi078 ceph-mon[94114]: pgmap v1986: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:53.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:38 smithi078 ceph-mon[94114]: pgmap v1987: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:53.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:40 smithi078 ceph-mon[94114]: pgmap v1988: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:55.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:42 smithi078 ceph-mon[94114]: pgmap v1989: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:55.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:44 smithi078 ceph-mon[94114]: pgmap v1990: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:56.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:46 smithi078 ceph-mon[94114]: pgmap v1991: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:56.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:48 smithi078 ceph-mon[94114]: pgmap v1992: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:56.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:50 smithi078 ceph-mon[94114]: pgmap v1993: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:56.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:31:56.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:56.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:56.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:52 smithi078 ceph-mon[94114]: pgmap v1994: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:31:56.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.272 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:58.273 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: pgmap v1995: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.804 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:31:59.805 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:55 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:32:01.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:55 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:55 smithi078 ceph-mon[94114]: pgmap v1996: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:55 smithi078 ceph-mon[94114]: pgmap v1997: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:57 smithi078 ceph-mon[94114]: pgmap v1998: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:47:59 smithi078 ceph-mon[94114]: pgmap v1999: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:01 smithi078 ceph-mon[94114]: pgmap v2000: 97 pgs: 97 active+clean; 1.6 MiB data, 275 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:03 smithi078 ceph-mon[94114]: pgmap v2001: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 64 KiB/s wr, 33 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:05 smithi078 ceph-mon[94114]: pgmap v2002: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:07 smithi078 ceph-mon[94114]: pgmap v2003: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:09 smithi078 ceph-mon[94114]: pgmap v2004: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:09 smithi078 ceph-mon[94114]: osdmap e201: 12 total, 12 up, 12 in 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:11 smithi078 ceph-mon[94114]: pgmap v2006: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:13 smithi078 ceph-mon[94114]: pgmap v2007: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:02.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:15 smithi078 ceph-mon[94114]: pgmap v2008: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:02.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:15 smithi078 ceph-mon[94114]: osdmap e202: 12 total, 12 up, 12 in 2023-03-17T12:32:02.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:17 smithi078 ceph-mon[94114]: pgmap v2010: 97 pgs: 97 active+clean; 1.6 MiB data, 276 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:32:02.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:19 smithi078 ceph-mon[94114]: pgmap v2011: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:21 smithi078 ceph-mon[94114]: pgmap v2012: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:23 smithi078 ceph-mon[94114]: pgmap v2013: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:25 smithi078 ceph-mon[94114]: pgmap v2014: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:27 smithi078 ceph-mon[94114]: pgmap v2015: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:29 smithi078 ceph-mon[94114]: pgmap v2016: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:31 smithi078 ceph-mon[94114]: pgmap v2017: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:33 smithi078 ceph-mon[94114]: pgmap v2018: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:04.293 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:35 smithi078 ceph-mon[94114]: pgmap v2019: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:04.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:37 smithi078 ceph-mon[94114]: pgmap v2020: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:04.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:39 smithi078 ceph-mon[94114]: pgmap v2021: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:04.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:41 smithi078 ceph-mon[94114]: pgmap v2022: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:43 smithi078 ceph-mon[94114]: pgmap v2023: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:45 smithi078 ceph-mon[94114]: pgmap v2024: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:47 smithi078 ceph-mon[94114]: pgmap v2025: 97 pgs: 97 active+clean; 1.6 MiB data, 280 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:49 smithi078 ceph-mon[94114]: pgmap v2026: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:51 smithi078 ceph-mon[94114]: pgmap v2027: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:53 smithi078 ceph-mon[94114]: pgmap v2028: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:55 smithi078 ceph-mon[94114]: pgmap v2029: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:05.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:56 smithi078 ceph-mon[94114]: pgmap v2030: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 757 B/s wr, 10 op/s 2023-03-17T12:32:06.457 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:56 smithi078 ceph-mon[94114]: pgmap v2031: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:32:06.457 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:48:58 smithi078 ceph-mon[94114]: pgmap v2032: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:32:06.457 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:00 smithi078 ceph-mon[94114]: pgmap v2033: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:32:07.255 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:02 smithi078 ceph-mon[94114]: pgmap v2034: 97 pgs: 97 active+clean; 1.6 MiB data, 281 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:32:07.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:04 smithi078 ceph-mon[94114]: pgmap v2035: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:07.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:06 smithi078 ceph-mon[94114]: pgmap v2036: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:07.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:08 smithi078 ceph-mon[94114]: pgmap v2037: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:32:07.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:09 smithi078 ceph-mon[94114]: osdmap e203: 12 total, 12 up, 12 in 2023-03-17T12:32:07.256 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:09 smithi078 ceph-mon[94114]: pgmap v2039: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:07.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:12 smithi078 ceph-mon[94114]: pgmap v2040: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:14 smithi078 ceph-mon[94114]: pgmap v2041: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:16 smithi078 ceph-mon[94114]: pgmap v2042: 97 pgs: 97 active+clean; 1.6 MiB data, 282 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:16 smithi078 ceph-mon[94114]: osdmap e204: 12 total, 12 up, 12 in 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:18 smithi078 ceph-mon[94114]: pgmap v2044: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:20 smithi078 ceph-mon[94114]: pgmap v2045: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:22 smithi078 ceph-mon[94114]: pgmap v2046: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:24 smithi078 ceph-mon[94114]: pgmap v2047: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:26 smithi078 ceph-mon[94114]: pgmap v2048: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:08.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:28 smithi078 ceph-mon[94114]: pgmap v2049: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 456 B/s wr, 14 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:30 smithi078 ceph-mon[94114]: pgmap v2050: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:32 smithi078 ceph-mon[94114]: pgmap v2051: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:34 smithi078 ceph-mon[94114]: pgmap v2052: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:36 smithi078 ceph-mon[94114]: pgmap v2053: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:38 smithi078 ceph-mon[94114]: pgmap v2054: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:40 smithi078 ceph-mon[94114]: pgmap v2055: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:42 smithi078 ceph-mon[94114]: pgmap v2056: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:44 smithi078 ceph-mon[94114]: pgmap v2057: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:46 smithi078 ceph-mon[94114]: pgmap v2058: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:48 smithi078 ceph-mon[94114]: pgmap v2059: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:50 smithi078 ceph-mon[94114]: pgmap v2060: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:52 smithi078 ceph-mon[94114]: pgmap v2061: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:08.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:54 smithi078 ceph-mon[94114]: pgmap v2062: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:56 smithi078 ceph-mon[94114]: pgmap v2063: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:57 smithi078 ceph-mon[94114]: pgmap v2064: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:57 smithi078 ceph-mon[94114]: pgmap v2065: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:49:59 smithi078 ceph-mon[94114]: pgmap v2066: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:01 smithi078 ceph-mon[94114]: pgmap v2067: 97 pgs: 97 active+clean; 1.6 MiB data, 283 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:03 smithi078 ceph-mon[94114]: pgmap v2068: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:05 smithi078 ceph-mon[94114]: pgmap v2069: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:07 smithi078 ceph-mon[94114]: pgmap v2070: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:09 smithi078 ceph-mon[94114]: pgmap v2071: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:32:08.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:09 smithi078 ceph-mon[94114]: osdmap e205: 12 total, 12 up, 12 in 2023-03-17T12:32:08.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:11 smithi078 ceph-mon[94114]: pgmap v2073: 97 pgs: 97 active+clean; 1.7 MiB data, 284 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:08.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:13 smithi078 ceph-mon[94114]: pgmap v2074: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:15 smithi078 ceph-mon[94114]: pgmap v2075: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:15 smithi078 ceph-mon[94114]: osdmap e206: 12 total, 12 up, 12 in 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:17 smithi078 ceph-mon[94114]: pgmap v2077: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:19 smithi078 ceph-mon[94114]: pgmap v2078: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:21 smithi078 ceph-mon[94114]: pgmap v2079: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:23 smithi078 ceph-mon[94114]: pgmap v2080: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:25 smithi078 ceph-mon[94114]: pgmap v2081: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:27 smithi078 ceph-mon[94114]: pgmap v2082: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 98 B/s wr, 9 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:29 smithi078 ceph-mon[94114]: pgmap v2083: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:31 smithi078 ceph-mon[94114]: pgmap v2084: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:33 smithi078 ceph-mon[94114]: pgmap v2085: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:35 smithi078 ceph-mon[94114]: pgmap v2086: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:37 smithi078 ceph-mon[94114]: pgmap v2087: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:39 smithi078 ceph-mon[94114]: pgmap v2088: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:09.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:41 smithi078 ceph-mon[94114]: pgmap v2089: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:43 smithi078 ceph-mon[94114]: pgmap v2090: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:45 smithi078 ceph-mon[94114]: pgmap v2091: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:47 smithi078 ceph-mon[94114]: pgmap v2092: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:49 smithi078 ceph-mon[94114]: pgmap v2093: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:51 smithi078 ceph-mon[94114]: pgmap v2094: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:53 smithi078 ceph-mon[94114]: pgmap v2095: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:55 smithi078 ceph-mon[94114]: pgmap v2096: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:09.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:57 smithi078 ceph-mon[94114]: pgmap v2097: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:58 smithi078 ceph-mon[94114]: pgmap v2098: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 283 B/s wr, 14 op/s 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:50:58 smithi078 ceph-mon[94114]: pgmap v2099: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:00 smithi078 ceph-mon[94114]: pgmap v2100: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:32:09.838 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:02 smithi078 ceph-mon[94114]: pgmap v2101: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 347 B/s wr, 6 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:04 smithi078 ceph-mon[94114]: pgmap v2102: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:06 smithi078 ceph-mon[94114]: pgmap v2103: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:08 smithi078 ceph-mon[94114]: pgmap v2104: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:09 smithi078 ceph-mon[94114]: osdmap e207: 12 total, 12 up, 12 in 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:10 smithi078 ceph-mon[94114]: pgmap v2106: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:12 smithi078 ceph-mon[94114]: pgmap v2107: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:14 smithi078 ceph-mon[94114]: pgmap v2108: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:16 smithi078 ceph-mon[94114]: pgmap v2109: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:32:10.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:16 smithi078 ceph-mon[94114]: osdmap e208: 12 total, 12 up, 12 in 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:18 smithi078 ceph-mon[94114]: pgmap v2111: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 998 B/s wr, 13 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:20 smithi078 ceph-mon[94114]: pgmap v2112: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:22 smithi078 ceph-mon[94114]: pgmap v2113: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:24 smithi078 ceph-mon[94114]: pgmap v2114: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:26 smithi078 ceph-mon[94114]: pgmap v2115: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:28 smithi078 ceph-mon[94114]: pgmap v2116: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 456 B/s wr, 14 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:30 smithi078 ceph-mon[94114]: pgmap v2117: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:32:10.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:32 smithi078 ceph-mon[94114]: pgmap v2118: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:32:12.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:34 smithi078 ceph-mon[94114]: pgmap v2119: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:32:12.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:36 smithi078 ceph-mon[94114]: pgmap v2120: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:12.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:38 smithi078 ceph-mon[94114]: pgmap v2121: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:12.458 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:40 smithi078 ceph-mon[94114]: pgmap v2122: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:42 smithi078 ceph-mon[94114]: pgmap v2123: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:44 smithi078 ceph-mon[94114]: pgmap v2124: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:46 smithi078 ceph-mon[94114]: pgmap v2125: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:48 smithi078 ceph-mon[94114]: pgmap v2126: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:50 smithi078 ceph-mon[94114]: pgmap v2127: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:52 smithi078 ceph-mon[94114]: pgmap v2128: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:54 smithi078 ceph-mon[94114]: pgmap v2129: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:56 smithi078 ceph-mon[94114]: pgmap v2130: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:58 smithi078 ceph-mon[94114]: pgmap v2131: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:58 smithi078 ceph-mon[94114]: pgmap v2132: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:32:12.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:51:58 smithi078 ceph-mon[94114]: pgmap v2133: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:32:12.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:00 smithi078 ceph-mon[94114]: pgmap v2134: 97 pgs: 97 active+clean; 1.7 MiB data, 295 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:32:14.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:03 smithi078 ceph-mon[94114]: pgmap v2135: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:14.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:04 smithi078 ceph-mon[94114]: pgmap v2136: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:14.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:06 smithi078 ceph-mon[94114]: pgmap v2137: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:32:14.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:08 smithi078 ceph-mon[94114]: pgmap v2138: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:14.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:10 smithi078 ceph-mon[94114]: osdmap e209: 12 total, 12 up, 12 in 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:10 smithi078 ceph-mon[94114]: pgmap v2140: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:12 smithi078 ceph-mon[94114]: pgmap v2141: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:14 smithi078 ceph-mon[94114]: pgmap v2142: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:16 smithi078 ceph-mon[94114]: osdmap e210: 12 total, 12 up, 12 in 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:16 smithi078 ceph-mon[94114]: pgmap v2144: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:18 smithi078 ceph-mon[94114]: pgmap v2145: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:20 smithi078 ceph-mon[94114]: pgmap v2146: 97 pgs: 97 active+clean; 1.7 MiB data, 296 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:22 smithi078 ceph-mon[94114]: pgmap v2147: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:32:14.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:24 smithi078 ceph-mon[94114]: pgmap v2148: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:32:14.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:26 smithi078 ceph-mon[94114]: pgmap v2149: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 101 B/s wr, 10 op/s 2023-03-17T12:32:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:28 smithi078 ceph-mon[94114]: pgmap v2150: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:32:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:30 smithi078 ceph-mon[94114]: pgmap v2151: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:32 smithi078 ceph-mon[94114]: pgmap v2152: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:34 smithi078 ceph-mon[94114]: pgmap v2153: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:36 smithi078 ceph-mon[94114]: pgmap v2154: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:38 smithi078 ceph-mon[94114]: pgmap v2155: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:15.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:40 smithi078 ceph-mon[94114]: pgmap v2156: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:15.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:42 smithi078 ceph-mon[94114]: pgmap v2157: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:15.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:44 smithi078 ceph-mon[94114]: pgmap v2158: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:15.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:46 smithi078 ceph-mon[94114]: pgmap v2159: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:15.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:48 smithi078 ceph-mon[94114]: pgmap v2160: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:15.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:50 smithi078 ceph-mon[94114]: pgmap v2161: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:32:15.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:52 smithi078 ceph-mon[94114]: pgmap v2162: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:16.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:54 smithi078 ceph-mon[94114]: pgmap v2163: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:32:16.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:56 smithi078 ceph-mon[94114]: pgmap v2164: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:32:16.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:58 smithi078 ceph-mon[94114]: pgmap v2165: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:16.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:59 smithi078 ceph-mon[94114]: pgmap v2166: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:59 smithi078 ceph-mon[94114]: pgmap v2167: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:52:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:01 smithi078 ceph-mon[94114]: pgmap v2168: 97 pgs: 97 active+clean; 1.7 MiB data, 297 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:03 smithi078 ceph-mon[94114]: pgmap v2169: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:04 smithi078 ceph-mon[94114]: osdmap e211: 12 total, 12 up, 12 in 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:05 smithi078 ceph-mon[94114]: pgmap v2171: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:07 smithi078 ceph-mon[94114]: pgmap v2172: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 67 KiB/s wr, 28 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:09 smithi078 ceph-mon[94114]: pgmap v2173: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:11 smithi078 ceph-mon[94114]: pgmap v2174: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:11 smithi078 ceph-mon[94114]: osdmap e212: 12 total, 12 up, 12 in 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:13 smithi078 ceph-mon[94114]: pgmap v2176: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 463 B/s wr, 10 op/s 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:14 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:32:16.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:14 smithi078 ceph-mon[94114]: osdmap e213: 12 total, 12 up, 12 in 2023-03-17T12:32:16.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:15 smithi078 ceph-mon[94114]: pgmap v2178: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 11 op/s 2023-03-17T12:32:16.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/2800644014,v1:172.21.15.35:6837/2800644014] up:boot 2023-03-17T12:32:16.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:32:16.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:32:16.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:32:17.292 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:17 smithi078 ceph-mon[94114]: pgmap v2179: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:32:17.292 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:19 smithi078 ceph-mon[94114]: pgmap v2180: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:32:17.292 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:21 smithi078 ceph-mon[94114]: pgmap v2181: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 519 B/s wr, 9 op/s 2023-03-17T12:32:17.292 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:23 smithi078 ceph-mon[94114]: pgmap v2182: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:32:17.292 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:25 smithi078 ceph-mon[94114]: pgmap v2183: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 408 B/s wr, 10 op/s 2023-03-17T12:32:17.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:27 smithi078 ceph-mon[94114]: pgmap v2184: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:32:19.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:29 smithi078 ceph-mon[94114]: pgmap v2185: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:32:19.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:32 smithi078 ceph-mon[94114]: pgmap v2186: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:19.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:34 smithi078 ceph-mon[94114]: pgmap v2187: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:19.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:36 smithi078 ceph-mon[94114]: pgmap v2188: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:19.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:38 smithi078 ceph-mon[94114]: pgmap v2189: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:19.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:40 smithi078 ceph-mon[94114]: pgmap v2190: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:42 smithi078 ceph-mon[94114]: pgmap v2191: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:44 smithi078 ceph-mon[94114]: pgmap v2192: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:19.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:46 smithi078 ceph-mon[94114]: pgmap v2193: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:19.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:47 smithi078 ceph-mon[94114]: pgmap v2194: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:49 smithi078 ceph-mon[94114]: pgmap v2195: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:51 smithi078 ceph-mon[94114]: pgmap v2196: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:53 smithi078 ceph-mon[94114]: pgmap v2197: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:55 smithi078 ceph-mon[94114]: pgmap v2198: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:57 smithi078 ceph-mon[94114]: pgmap v2199: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:59 smithi078 ceph-mon[94114]: pgmap v2200: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:53:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:00 smithi078 ceph-mon[94114]: pgmap v2201: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:32:19.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:00 smithi078 ceph-mon[94114]: pgmap v2202: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:32:21.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:02 smithi078 ceph-mon[94114]: pgmap v2203: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:32:21.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:05 smithi078 ceph-mon[94114]: pgmap v2204: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:07 smithi078 ceph-mon[94114]: pgmap v2205: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:09 smithi078 ceph-mon[94114]: pgmap v2206: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:10 smithi078 ceph-mon[94114]: osdmap e214: 12 total, 12 up, 12 in 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:11 smithi078 ceph-mon[94114]: pgmap v2208: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:13 smithi078 ceph-mon[94114]: pgmap v2209: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:15 smithi078 ceph-mon[94114]: pgmap v2210: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:21.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:16 smithi078 ceph-mon[94114]: pgmap v2211: 97 pgs: 97 active+clean; 1.7 MiB data, 288 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:16 smithi078 ceph-mon[94114]: osdmap e215: 12 total, 12 up, 12 in 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:18 smithi078 ceph-mon[94114]: pgmap v2213: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 355 B/s wr, 12 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:20 smithi078 ceph-mon[94114]: pgmap v2214: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:22 smithi078 ceph-mon[94114]: pgmap v2215: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:24 smithi078 ceph-mon[94114]: pgmap v2216: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:26 smithi078 ceph-mon[94114]: pgmap v2217: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:28 smithi078 ceph-mon[94114]: pgmap v2218: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 175 B/s wr, 13 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:31 smithi078 ceph-mon[94114]: pgmap v2219: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:33 smithi078 ceph-mon[94114]: pgmap v2220: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:35 smithi078 ceph-mon[94114]: pgmap v2221: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:37 smithi078 ceph-mon[94114]: pgmap v2222: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:23.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:39 smithi078 ceph-mon[94114]: pgmap v2223: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:23.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:41 smithi078 ceph-mon[94114]: pgmap v2224: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:23.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:43 smithi078 ceph-mon[94114]: pgmap v2225: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:23.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:45 smithi078 ceph-mon[94114]: pgmap v2226: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:23.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:47 smithi078 ceph-mon[94114]: pgmap v2227: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:23.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:49 smithi078 ceph-mon[94114]: pgmap v2228: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:24.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:51 smithi078 ceph-mon[94114]: pgmap v2229: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:24.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:52 smithi078 ceph-mon[94114]: pgmap v2230: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:24.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:54 smithi078 ceph-mon[94114]: pgmap v2231: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:24.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:56 smithi078 ceph-mon[94114]: pgmap v2232: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:24.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:58 smithi078 ceph-mon[94114]: pgmap v2233: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:24.354 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:54:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:24.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:01 smithi078 ceph-mon[94114]: pgmap v2234: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:02 smithi078 ceph-mon[94114]: pgmap v2235: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:02 smithi078 ceph-mon[94114]: pgmap v2236: 97 pgs: 97 active+clean; 1.7 MiB data, 289 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:04 smithi078 ceph-mon[94114]: pgmap v2237: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:25.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:06 smithi078 ceph-mon[94114]: pgmap v2238: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:08 smithi078 ceph-mon[94114]: pgmap v2239: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:10 smithi078 ceph-mon[94114]: pgmap v2240: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:10 smithi078 ceph-mon[94114]: osdmap e216: 12 total, 12 up, 12 in 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:12 smithi078 ceph-mon[94114]: pgmap v2242: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:14 smithi078 ceph-mon[94114]: pgmap v2243: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:16 smithi078 ceph-mon[94114]: pgmap v2244: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:16 smithi078 ceph-mon[94114]: osdmap e217: 12 total, 12 up, 12 in 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:17 smithi078 ceph-mon[94114]: pgmap v2246: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:19 smithi078 ceph-mon[94114]: pgmap v2247: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:21 smithi078 ceph-mon[94114]: pgmap v2248: 97 pgs: 97 active+clean; 1.7 MiB data, 290 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:24 smithi078 ceph-mon[94114]: pgmap v2249: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:26 smithi078 ceph-mon[94114]: pgmap v2250: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:28 smithi078 ceph-mon[94114]: pgmap v2251: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 877 B/s wr, 10 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:30 smithi078 ceph-mon[94114]: pgmap v2252: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:32 smithi078 ceph-mon[94114]: pgmap v2253: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:32:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:34 smithi078 ceph-mon[94114]: pgmap v2254: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:36 smithi078 ceph-mon[94114]: pgmap v2255: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:38 smithi078 ceph-mon[94114]: pgmap v2256: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:40 smithi078 ceph-mon[94114]: pgmap v2257: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:42 smithi078 ceph-mon[94114]: pgmap v2258: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:44 smithi078 ceph-mon[94114]: pgmap v2259: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:46 smithi078 ceph-mon[94114]: pgmap v2260: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:48 smithi078 ceph-mon[94114]: pgmap v2261: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:50 smithi078 ceph-mon[94114]: pgmap v2262: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:26.285 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:52 smithi078 ceph-mon[94114]: pgmap v2263: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:54 smithi078 ceph-mon[94114]: pgmap v2264: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:56 smithi078 ceph-mon[94114]: pgmap v2265: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:55:58 smithi078 ceph-mon[94114]: pgmap v2266: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:00 smithi078 ceph-mon[94114]: pgmap v2267: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:02 smithi078 ceph-mon[94114]: pgmap v2268: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:03 smithi078 ceph-mon[94114]: pgmap v2269: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:32:26.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:03 smithi078 ceph-mon[94114]: pgmap v2270: 97 pgs: 97 active+clean; 1.7 MiB data, 291 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:32:27.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:05 smithi078 ceph-mon[94114]: pgmap v2271: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:05 smithi078 ceph-mon[94114]: osdmap e218: 12 total, 12 up, 12 in 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:07 smithi078 ceph-mon[94114]: pgmap v2273: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:09 smithi078 ceph-mon[94114]: pgmap v2274: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 79 KiB/s wr, 40 op/s 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:10 smithi078 ceph-mon[94114]: pgmap v2275: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 67 KiB/s wr, 34 op/s 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:12 smithi078 ceph-mon[94114]: osdmap e219: 12 total, 12 up, 12 in 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:13 smithi078 ceph-mon[94114]: pgmap v2277: 97 pgs: 97 active+clean; 1.7 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:15 smithi078 ceph-mon[94114]: pgmap v2278: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 551 B/s wr, 9 op/s 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:15 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:32:27.409 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:15 smithi078 ceph-mon[94114]: osdmap e220: 12 total, 12 up, 12 in 2023-03-17T12:32:28.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:16 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/4214884183,v1:172.21.15.35:6837/4214884183] up:boot 2023-03-17T12:32:28.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:16 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:32:28.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:32:28.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:16 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:32:29.654 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:17 smithi078 ceph-mon[94114]: pgmap v2280: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:32:30.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:19 smithi078 ceph-mon[94114]: pgmap v2281: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 127 B/s wr, 11 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:21 smithi078 ceph-mon[94114]: pgmap v2282: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 123 B/s wr, 11 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:23 smithi078 ceph-mon[94114]: pgmap v2283: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:25 smithi078 ceph-mon[94114]: pgmap v2284: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:27 smithi078 ceph-mon[94114]: pgmap v2285: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:29 smithi078 ceph-mon[94114]: pgmap v2286: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 12 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:31 smithi078 ceph-mon[94114]: pgmap v2287: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:33 smithi078 ceph-mon[94114]: pgmap v2288: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:33.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:35 smithi078 ceph-mon[94114]: pgmap v2289: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:37 smithi078 ceph-mon[94114]: pgmap v2290: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:39 smithi078 ceph-mon[94114]: pgmap v2291: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:41 smithi078 ceph-mon[94114]: pgmap v2292: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:33.106 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:43 smithi078 ceph-mon[94114]: pgmap v2293: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:34.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:45 smithi078 ceph-mon[94114]: pgmap v2294: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:34.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:47 smithi078 ceph-mon[94114]: pgmap v2295: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:34.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:49 smithi078 ceph-mon[94114]: pgmap v2296: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:34.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:51 smithi078 ceph-mon[94114]: pgmap v2297: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:34.397 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:52 smithi078 ceph-mon[94114]: pgmap v2298: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:35.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:54 smithi078 ceph-mon[94114]: pgmap v2299: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:35.022 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:57 smithi078 ceph-mon[94114]: pgmap v2300: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:35.022 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:56:59 smithi078 ceph-mon[94114]: pgmap v2301: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:36.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:01 smithi078 ceph-mon[94114]: pgmap v2302: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:36.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:36.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:36.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:36.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:03 smithi078 ceph-mon[94114]: pgmap v2303: 97 pgs: 97 active+clean; 1.7 MiB data, 293 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:36.828 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:36.828 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:36.828 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:36.829 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:04 smithi078 ceph-mon[94114]: pgmap v2304: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 28 op/s 2023-03-17T12:32:37.445 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:04 smithi078 ceph-mon[94114]: pgmap v2305: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:32:38.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:06 smithi078 ceph-mon[94114]: pgmap v2306: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:32:40.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:08 smithi078 ceph-mon[94114]: pgmap v2307: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 57 KiB/s wr, 24 op/s 2023-03-17T12:32:40.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:10 smithi078 ceph-mon[94114]: pgmap v2308: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 30 op/s 2023-03-17T12:32:40.286 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:10 smithi078 ceph-mon[94114]: osdmap e221: 12 total, 12 up, 12 in 2023-03-17T12:32:41.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:12 smithi078 ceph-mon[94114]: pgmap v2310: 97 pgs: 97 active+clean; 1.7 MiB data, 294 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:32:41.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:14 smithi078 ceph-mon[94114]: pgmap v2311: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:32:41.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:16 smithi078 ceph-mon[94114]: pgmap v2312: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:32:41.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:17 smithi078 ceph-mon[94114]: osdmap e222: 12 total, 12 up, 12 in 2023-03-17T12:32:43.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:18 smithi078 ceph-mon[94114]: pgmap v2314: 97 pgs: 97 active+clean; 1.7 MiB data, 298 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:20 smithi078 ceph-mon[94114]: pgmap v2315: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 535 B/s wr, 11 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:22 smithi078 ceph-mon[94114]: pgmap v2316: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:24 smithi078 ceph-mon[94114]: pgmap v2317: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:26 smithi078 ceph-mon[94114]: pgmap v2318: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:27 smithi078 ceph-mon[94114]: pgmap v2319: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 483 B/s wr, 10 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:29 smithi078 ceph-mon[94114]: pgmap v2320: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:32 smithi078 ceph-mon[94114]: pgmap v2321: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:34 smithi078 ceph-mon[94114]: pgmap v2322: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:36 smithi078 ceph-mon[94114]: pgmap v2323: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:38 smithi078 ceph-mon[94114]: pgmap v2324: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:40 smithi078 ceph-mon[94114]: pgmap v2325: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:42 smithi078 ceph-mon[94114]: pgmap v2326: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:44 smithi078 ceph-mon[94114]: pgmap v2327: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:46 smithi078 ceph-mon[94114]: pgmap v2328: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:48 smithi078 ceph-mon[94114]: pgmap v2329: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:50 smithi078 ceph-mon[94114]: pgmap v2330: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:52 smithi078 ceph-mon[94114]: pgmap v2331: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:54 smithi078 ceph-mon[94114]: pgmap v2332: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:56 smithi078 ceph-mon[94114]: pgmap v2333: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:57:58 smithi078 ceph-mon[94114]: pgmap v2334: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:00 smithi078 ceph-mon[94114]: pgmap v2335: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:02 smithi078 ceph-mon[94114]: pgmap v2336: 97 pgs: 97 active+clean; 1.7 MiB data, 299 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:04 smithi078 ceph-mon[94114]: pgmap v2337: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:32:45.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: pgmap v2338: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:45.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.359 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:49.359 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: pgmap v2339: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:32:52.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:32:53.591 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: pgmap v2340: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:55.484 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:08 smithi078 ceph-mon[94114]: pgmap v2341: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 66 KiB/s wr, 28 op/s 2023-03-17T12:32:55.484 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:09 smithi078 ceph-mon[94114]: pgmap v2342: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 66 KiB/s wr, 34 op/s 2023-03-17T12:32:55.485 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:10 smithi078 ceph-mon[94114]: osdmap e223: 12 total, 12 up, 12 in 2023-03-17T12:32:55.485 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:12 smithi078 ceph-mon[94114]: pgmap v2344: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T12:32:55.485 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:14 smithi078 ceph-mon[94114]: pgmap v2345: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 340 B/s wr, 17 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:16 smithi078 ceph-mon[94114]: pgmap v2346: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:16 smithi078 ceph-mon[94114]: osdmap e224: 12 total, 12 up, 12 in 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:18 smithi078 ceph-mon[94114]: pgmap v2348: 97 pgs: 97 active+clean; 1.7 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:20 smithi078 ceph-mon[94114]: pgmap v2349: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 321 B/s wr, 10 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:22 smithi078 ceph-mon[94114]: pgmap v2350: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:24 smithi078 ceph-mon[94114]: pgmap v2351: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:26 smithi078 ceph-mon[94114]: pgmap v2352: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:28 smithi078 ceph-mon[94114]: pgmap v2353: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 193 B/s wr, 9 op/s 2023-03-17T12:32:57.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:30 smithi078 ceph-mon[94114]: pgmap v2354: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:32 smithi078 ceph-mon[94114]: pgmap v2355: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:34 smithi078 ceph-mon[94114]: pgmap v2356: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:36 smithi078 ceph-mon[94114]: pgmap v2357: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:37 smithi078 ceph-mon[94114]: pgmap v2358: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:39 smithi078 ceph-mon[94114]: pgmap v2359: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:42 smithi078 ceph-mon[94114]: pgmap v2360: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:44 smithi078 ceph-mon[94114]: pgmap v2361: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:46 smithi078 ceph-mon[94114]: pgmap v2362: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:58.222 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:48 smithi078 ceph-mon[94114]: pgmap v2363: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:50 smithi078 ceph-mon[94114]: pgmap v2364: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:59.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:52 smithi078 ceph-mon[94114]: pgmap v2365: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:54 smithi078 ceph-mon[94114]: pgmap v2366: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:59.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:55 smithi078 ceph-mon[94114]: pgmap v2367: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:58:58 smithi078 ceph-mon[94114]: pgmap v2368: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:00 smithi078 ceph-mon[94114]: pgmap v2369: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:02 smithi078 ceph-mon[94114]: pgmap v2370: 97 pgs: 97 active+clean; 1.7 MiB data, 301 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:04 smithi078 ceph-mon[94114]: pgmap v2371: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:06 smithi078 ceph-mon[94114]: pgmap v2372: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:08 smithi078 ceph-mon[94114]: pgmap v2373: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:08 smithi078 ceph-mon[94114]: pgmap v2374: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:08 smithi078 ceph-mon[94114]: pgmap v2375: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:10 smithi078 ceph-mon[94114]: osdmap e225: 12 total, 12 up, 12 in 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:10 smithi078 ceph-mon[94114]: pgmap v2377: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:32:59.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:13 smithi078 ceph-mon[94114]: pgmap v2378: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:15 smithi078 ceph-mon[94114]: pgmap v2379: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:17 smithi078 ceph-mon[94114]: pgmap v2380: 97 pgs: 97 active+clean; 1.7 MiB data, 302 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:17 smithi078 ceph-mon[94114]: osdmap e226: 12 total, 12 up, 12 in 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:19 smithi078 ceph-mon[94114]: pgmap v2382: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:21 smithi078 ceph-mon[94114]: pgmap v2383: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:23 smithi078 ceph-mon[94114]: pgmap v2384: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:25 smithi078 ceph-mon[94114]: pgmap v2385: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:27 smithi078 ceph-mon[94114]: pgmap v2386: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:28 smithi078 ceph-mon[94114]: pgmap v2387: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 807 B/s wr, 14 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:30 smithi078 ceph-mon[94114]: pgmap v2388: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:33 smithi078 ceph-mon[94114]: pgmap v2389: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:35 smithi078 ceph-mon[94114]: pgmap v2390: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:37 smithi078 ceph-mon[94114]: pgmap v2391: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:39 smithi078 ceph-mon[94114]: pgmap v2392: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:41 smithi078 ceph-mon[94114]: pgmap v2393: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:42 smithi078 ceph-mon[94114]: pgmap v2394: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:44 smithi078 ceph-mon[94114]: pgmap v2395: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:47 smithi078 ceph-mon[94114]: pgmap v2396: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:49 smithi078 ceph-mon[94114]: pgmap v2397: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:51 smithi078 ceph-mon[94114]: pgmap v2398: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:53 smithi078 ceph-mon[94114]: pgmap v2399: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:54 smithi078 ceph-mon[94114]: pgmap v2400: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:57 smithi078 ceph-mon[94114]: pgmap v2401: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 09:59:59 smithi078 ceph-mon[94114]: pgmap v2402: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:32:59.820 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:01 smithi078 ceph-mon[94114]: pgmap v2403: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:02 smithi078 ceph-mon[94114]: pgmap v2404: 97 pgs: 97 active+clean; 1.7 MiB data, 303 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:04 smithi078 ceph-mon[94114]: osdmap e227: 12 total, 12 up, 12 in 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:04 smithi078 ceph-mon[94114]: pgmap v2406: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:07 smithi078 ceph-mon[94114]: pgmap v2407: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:09 smithi078 ceph-mon[94114]: pgmap v2408: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:10 smithi078 ceph-mon[94114]: pgmap v2409: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T12:32:59.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:10 smithi078 ceph-mon[94114]: pgmap v2410: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 74 KiB/s wr, 38 op/s 2023-03-17T12:33:01.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:12 smithi078 ceph-mon[94114]: pgmap v2411: 97 pgs: 97 active+clean; 1.7 MiB data, 304 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 550 B/s wr, 6 op/s 2023-03-17T12:33:01.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:12 smithi078 ceph-mon[94114]: osdmap e228: 12 total, 12 up, 12 in 2023-03-17T12:33:01.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:14 smithi078 ceph-mon[94114]: pgmap v2413: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 700 B/s wr, 12 op/s 2023-03-17T12:33:01.190 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:15 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:33:03.904 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:15 smithi078 ceph-mon[94114]: osdmap e229: 12 total, 12 up, 12 in 2023-03-17T12:33:03.904 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:16 smithi078 ceph-mon[94114]: pgmap v2415: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-03-17T12:33:03.904 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:16 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/1983264099,v1:172.21.15.35:6837/1983264099] up:boot 2023-03-17T12:33:03.904 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:16 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:33:03.904 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:33:07.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:16 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:33:07.300 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:18 smithi078 ceph-mon[94114]: pgmap v2416: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:33:07.300 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:19 smithi078 ceph-mon[94114]: pgmap v2417: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:33:07.300 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:22 smithi078 ceph-mon[94114]: pgmap v2418: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 526 B/s wr, 10 op/s 2023-03-17T12:33:07.300 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:24 smithi078 ceph-mon[94114]: pgmap v2419: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:33:07.300 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:26 smithi078 ceph-mon[94114]: pgmap v2420: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 407 B/s wr, 10 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:27 smithi078 ceph-mon[94114]: pgmap v2421: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:29 smithi078 ceph-mon[94114]: pgmap v2422: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:32 smithi078 ceph-mon[94114]: pgmap v2423: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:34 smithi078 ceph-mon[94114]: pgmap v2424: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:35 smithi078 ceph-mon[94114]: pgmap v2425: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:37 smithi078 ceph-mon[94114]: pgmap v2426: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:39 smithi078 ceph-mon[94114]: pgmap v2427: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:42 smithi078 ceph-mon[94114]: pgmap v2428: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:43 smithi078 ceph-mon[94114]: pgmap v2429: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:45 smithi078 ceph-mon[94114]: pgmap v2430: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:48 smithi078 ceph-mon[94114]: pgmap v2431: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:49 smithi078 ceph-mon[94114]: pgmap v2432: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:07.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:52 smithi078 ceph-mon[94114]: pgmap v2433: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:53 smithi078 ceph-mon[94114]: pgmap v2434: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:55 smithi078 ceph-mon[94114]: pgmap v2435: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:57 smithi078 ceph-mon[94114]: pgmap v2436: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:00:59 smithi078 ceph-mon[94114]: pgmap v2437: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:02 smithi078 ceph-mon[94114]: pgmap v2438: 97 pgs: 97 active+clean; 1.7 MiB data, 309 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:03 smithi078 ceph-mon[94114]: pgmap v2439: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:05 smithi078 ceph-mon[94114]: pgmap v2440: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:07 smithi078 ceph-mon[94114]: pgmap v2441: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:09 smithi078 ceph-mon[94114]: osdmap e230: 12 total, 12 up, 12 in 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:09 smithi078 ceph-mon[94114]: pgmap v2443: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:10 smithi078 ceph-mon[94114]: pgmap v2444: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:33:07.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:10 smithi078 ceph-mon[94114]: pgmap v2445: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:12 smithi078 ceph-mon[94114]: pgmap v2446: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:14 smithi078 ceph-mon[94114]: pgmap v2447: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:16 smithi078 ceph-mon[94114]: pgmap v2448: 97 pgs: 97 active+clean; 1.7 MiB data, 310 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:16 smithi078 ceph-mon[94114]: osdmap e231: 12 total, 12 up, 12 in 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:18 smithi078 ceph-mon[94114]: pgmap v2450: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:20 smithi078 ceph-mon[94114]: pgmap v2451: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:22 smithi078 ceph-mon[94114]: pgmap v2452: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:07.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:24 smithi078 ceph-mon[94114]: pgmap v2453: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:33:08.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:26 smithi078 ceph-mon[94114]: pgmap v2454: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:33:08.556 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:28 smithi078 ceph-mon[94114]: pgmap v2455: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 88 B/s wr, 13 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:30 smithi078 ceph-mon[94114]: pgmap v2456: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:32 smithi078 ceph-mon[94114]: pgmap v2457: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:34 smithi078 ceph-mon[94114]: pgmap v2458: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:36 smithi078 ceph-mon[94114]: pgmap v2459: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:38 smithi078 ceph-mon[94114]: pgmap v2460: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:40 smithi078 ceph-mon[94114]: pgmap v2461: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:42 smithi078 ceph-mon[94114]: pgmap v2462: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:33:08.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:44 smithi078 ceph-mon[94114]: pgmap v2463: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:46 smithi078 ceph-mon[94114]: pgmap v2464: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:48 smithi078 ceph-mon[94114]: pgmap v2465: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:50 smithi078 ceph-mon[94114]: pgmap v2466: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:52 smithi078 ceph-mon[94114]: pgmap v2467: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:54 smithi078 ceph-mon[94114]: pgmap v2468: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:56 smithi078 ceph-mon[94114]: pgmap v2469: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:01:58 smithi078 ceph-mon[94114]: pgmap v2470: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:00 smithi078 ceph-mon[94114]: pgmap v2471: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:08.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:02 smithi078 ceph-mon[94114]: pgmap v2472: 97 pgs: 97 active+clean; 1.7 MiB data, 311 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:08.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:04 smithi078 ceph-mon[94114]: osdmap e232: 12 total, 12 up, 12 in 2023-03-17T12:33:08.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:04 smithi078 ceph-mon[94114]: pgmap v2474: 97 pgs: 97 active+clean; 1.7 MiB data, 312 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:09.944 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:06 smithi078 ceph-mon[94114]: pgmap v2475: 97 pgs: 97 active+clean; 1.7 MiB data, 312 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:08 smithi078 ceph-mon[94114]: pgmap v2476: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:10 smithi078 ceph-mon[94114]: pgmap v2477: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:11 smithi078 ceph-mon[94114]: pgmap v2478: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:33:12.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:11 smithi078 ceph-mon[94114]: pgmap v2479: 97 pgs: 97 active+clean; 1.7 MiB data, 320 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 431 B/s wr, 6 op/s 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:11 smithi078 ceph-mon[94114]: osdmap e233: 12 total, 12 up, 12 in 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:13 smithi078 ceph-mon[94114]: pgmap v2481: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 601 B/s wr, 13 op/s 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:14 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:14 smithi078 ceph-mon[94114]: osdmap e234: 12 total, 12 up, 12 in 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:15 smithi078 ceph-mon[94114]: pgmap v2482: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 150 B/s wr, 6 op/s 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:15 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/257124184,v1:172.21.15.35:6837/257124184] up:boot 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:33:12.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:33:12.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:33:12.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:17 smithi078 ceph-mon[94114]: pgmap v2484: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2023-03-17T12:33:12.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:19 smithi078 ceph-mon[94114]: pgmap v2485: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 639 B/s wr, 12 op/s 2023-03-17T12:33:12.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:21 smithi078 ceph-mon[94114]: pgmap v2486: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 546 B/s wr, 10 op/s 2023-03-17T12:33:13.694 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:23 smithi078 ceph-mon[94114]: pgmap v2487: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:33:13.694 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:25 smithi078 ceph-mon[94114]: pgmap v2488: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:33:13.694 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:27 smithi078 ceph-mon[94114]: pgmap v2489: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 342 B/s wr, 9 op/s 2023-03-17T12:33:15.318 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:29 smithi078 ceph-mon[94114]: pgmap v2490: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 341 B/s wr, 13 op/s 2023-03-17T12:33:15.318 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:31 smithi078 ceph-mon[94114]: pgmap v2491: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:15.318 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:33 smithi078 ceph-mon[94114]: pgmap v2492: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:15.318 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:35 smithi078 ceph-mon[94114]: pgmap v2493: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:16.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:37 smithi078 ceph-mon[94114]: pgmap v2494: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:16.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:39 smithi078 ceph-mon[94114]: pgmap v2495: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:16.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:41 smithi078 ceph-mon[94114]: pgmap v2496: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:16.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:43 smithi078 ceph-mon[94114]: pgmap v2497: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:16.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:45 smithi078 ceph-mon[94114]: pgmap v2498: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:16.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:47 smithi078 ceph-mon[94114]: pgmap v2499: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:16.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:49 smithi078 ceph-mon[94114]: pgmap v2500: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:18.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:51 smithi078 ceph-mon[94114]: pgmap v2501: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:18.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:53 smithi078 ceph-mon[94114]: pgmap v2502: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:18.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:55 smithi078 ceph-mon[94114]: pgmap v2503: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:18.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:57 smithi078 ceph-mon[94114]: pgmap v2504: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:18.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:02:59 smithi078 ceph-mon[94114]: pgmap v2505: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:20.243 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:01 smithi078 ceph-mon[94114]: pgmap v2506: 97 pgs: 97 active+clean; 1.7 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:03 smithi078 ceph-mon[94114]: pgmap v2507: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:05 smithi078 ceph-mon[94114]: pgmap v2508: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:07 smithi078 ceph-mon[94114]: pgmap v2509: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:09 smithi078 ceph-mon[94114]: osdmap e235: 12 total, 12 up, 12 in 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:09 smithi078 ceph-mon[94114]: pgmap v2511: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:11 smithi078 ceph-mon[94114]: pgmap v2512: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:12 smithi078 ceph-mon[94114]: pgmap v2513: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:12 smithi078 ceph-mon[94114]: pgmap v2514: 97 pgs: 97 active+clean; 1.7 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:14 smithi078 ceph-mon[94114]: pgmap v2515: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:16 smithi078 ceph-mon[94114]: pgmap v2516: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 147 B/s wr, 7 op/s 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:16 smithi078 ceph-mon[94114]: osdmap e236: 12 total, 12 up, 12 in 2023-03-17T12:33:20.244 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:18 smithi078 ceph-mon[94114]: pgmap v2518: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:20 smithi078 ceph-mon[94114]: pgmap v2519: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:22 smithi078 ceph-mon[94114]: pgmap v2520: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:24 smithi078 ceph-mon[94114]: pgmap v2521: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:26 smithi078 ceph-mon[94114]: pgmap v2522: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:28 smithi078 ceph-mon[94114]: pgmap v2523: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 91 B/s wr, 13 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:30 smithi078 ceph-mon[94114]: pgmap v2524: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:32 smithi078 ceph-mon[94114]: pgmap v2525: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:34 smithi078 ceph-mon[94114]: pgmap v2526: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:36 smithi078 ceph-mon[94114]: pgmap v2527: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:38 smithi078 ceph-mon[94114]: pgmap v2528: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:40 smithi078 ceph-mon[94114]: pgmap v2529: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:42 smithi078 ceph-mon[94114]: pgmap v2530: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:44 smithi078 ceph-mon[94114]: pgmap v2531: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:46 smithi078 ceph-mon[94114]: pgmap v2532: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:48 smithi078 ceph-mon[94114]: pgmap v2533: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:20.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:50 smithi078 ceph-mon[94114]: pgmap v2534: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:52 smithi078 ceph-mon[94114]: pgmap v2535: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:54 smithi078 ceph-mon[94114]: pgmap v2536: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:56 smithi078 ceph-mon[94114]: pgmap v2537: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:03:58 smithi078 ceph-mon[94114]: pgmap v2538: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:00 smithi078 ceph-mon[94114]: pgmap v2539: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:02 smithi078 ceph-mon[94114]: pgmap v2540: 97 pgs: 97 active+clean; 1.7 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:04 smithi078 ceph-mon[94114]: pgmap v2541: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:06 smithi078 ceph-mon[94114]: pgmap v2542: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:08 smithi078 ceph-mon[94114]: pgmap v2543: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:09 smithi078 ceph-mon[94114]: osdmap e237: 12 total, 12 up, 12 in 2023-03-17T12:33:20.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:10 smithi078 ceph-mon[94114]: pgmap v2545: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:33:21.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:12 smithi078 ceph-mon[94114]: pgmap v2546: 97 pgs: 97 active+clean; 1.7 MiB data, 324 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:13 smithi078 ceph-mon[94114]: pgmap v2547: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 929 B/s wr, 12 op/s 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:13 smithi078 ceph-mon[94114]: pgmap v2548: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.2 KiB/s wr, 15 op/s 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:15 smithi078 ceph-mon[94114]: pgmap v2549: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:17 smithi078 ceph-mon[94114]: pgmap v2550: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:17 smithi078 ceph-mon[94114]: osdmap e238: 12 total, 12 up, 12 in 2023-03-17T12:33:23.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:19 smithi078 ceph-mon[94114]: pgmap v2552: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 150 B/s wr, 15 op/s 2023-03-17T12:33:25.979 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:21 smithi078 ceph-mon[94114]: pgmap v2553: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:33:25.979 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:23 smithi078 ceph-mon[94114]: pgmap v2554: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:33:25.979 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:25 smithi078 ceph-mon[94114]: pgmap v2555: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:33:25.979 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:27 smithi078 ceph-mon[94114]: pgmap v2556: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:33:25.979 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:29 smithi078 ceph-mon[94114]: pgmap v2557: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:33:25.979 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:31 smithi078 ceph-mon[94114]: pgmap v2558: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:33:28.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:33 smithi078 ceph-mon[94114]: pgmap v2559: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:33:28.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:35 smithi078 ceph-mon[94114]: pgmap v2560: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:28.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:37 smithi078 ceph-mon[94114]: pgmap v2561: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:28.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:39 smithi078 ceph-mon[94114]: pgmap v2562: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:28.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:41 smithi078 ceph-mon[94114]: pgmap v2563: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:43 smithi078 ceph-mon[94114]: pgmap v2564: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:45 smithi078 ceph-mon[94114]: pgmap v2565: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:47 smithi078 ceph-mon[94114]: pgmap v2566: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:49 smithi078 ceph-mon[94114]: pgmap v2567: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:51 smithi078 ceph-mon[94114]: pgmap v2568: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:53 smithi078 ceph-mon[94114]: pgmap v2569: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:29.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:55 smithi078 ceph-mon[94114]: pgmap v2570: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:29.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:57 smithi078 ceph-mon[94114]: pgmap v2571: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:29.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:04:59 smithi078 ceph-mon[94114]: pgmap v2572: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:29.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:01 smithi078 ceph-mon[94114]: pgmap v2573: 97 pgs: 97 active+clean; 1.7 MiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:29.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:03 smithi078 ceph-mon[94114]: pgmap v2574: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2023-03-17T12:33:29.811 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:05 smithi078 ceph-mon[94114]: pgmap v2575: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:07 smithi078 ceph-mon[94114]: pgmap v2576: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:09 smithi078 ceph-mon[94114]: pgmap v2577: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:11 smithi078 ceph-mon[94114]: pgmap v2578: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: pgmap v2579: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 25 op/s 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:32.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:32.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: pgmap v2580: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 189 B/s wr, 9 op/s 2023-03-17T12:33:32.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: pgmap v2581: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:33:32.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:33.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:16 smithi078 ceph-mon[94114]: pgmap v2582: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:33:33.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:17 smithi078 ceph-mon[94114]: pgmap v2583: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 10 op/s 2023-03-17T12:33:35.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:20 smithi078 ceph-mon[94114]: pgmap v2584: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:33:35.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:22 smithi078 ceph-mon[94114]: pgmap v2585: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:33:35.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:24 smithi078 ceph-mon[94114]: pgmap v2586: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:33:35.686 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:26 smithi078 ceph-mon[94114]: pgmap v2587: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:35.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:27 smithi078 ceph-mon[94114]: pgmap v2588: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:35.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:30 smithi078 ceph-mon[94114]: pgmap v2589: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:35.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:32 smithi078 ceph-mon[94114]: pgmap v2590: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:35.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:34 smithi078 ceph-mon[94114]: pgmap v2591: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:35.687 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:36 smithi078 ceph-mon[94114]: pgmap v2592: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:36.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:37 smithi078 ceph-mon[94114]: pgmap v2593: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:36.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:40 smithi078 ceph-mon[94114]: pgmap v2594: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:36.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:42 smithi078 ceph-mon[94114]: pgmap v2595: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:36.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:44 smithi078 ceph-mon[94114]: pgmap v2596: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:37.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:46 smithi078 ceph-mon[94114]: pgmap v2597: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:37.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:47 smithi078 ceph-mon[94114]: pgmap v2598: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:50 smithi078 ceph-mon[94114]: pgmap v2599: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:52 smithi078 ceph-mon[94114]: pgmap v2600: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:54 smithi078 ceph-mon[94114]: pgmap v2601: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:56 smithi078 ceph-mon[94114]: pgmap v2602: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:05:57 smithi078 ceph-mon[94114]: pgmap v2603: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:00 smithi078 ceph-mon[94114]: pgmap v2604: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:37.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:02 smithi078 ceph-mon[94114]: pgmap v2605: 97 pgs: 97 active+clean; 1.7 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:04 smithi078 ceph-mon[94114]: pgmap v2606: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:06 smithi078 ceph-mon[94114]: pgmap v2607: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:07 smithi078 ceph-mon[94114]: pgmap v2608: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:09 smithi078 ceph-mon[94114]: osdmap e239: 12 total, 12 up, 12 in 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:09 smithi078 ceph-mon[94114]: pgmap v2610: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:12 smithi078 ceph-mon[94114]: pgmap v2611: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:38.763 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:14 smithi078 ceph-mon[94114]: pgmap v2612: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:15 smithi078 ceph-mon[94114]: pgmap v2613: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:15 smithi078 ceph-mon[94114]: pgmap v2614: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:33:38.764 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:17 smithi078 ceph-mon[94114]: pgmap v2615: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 137 B/s wr, 6 op/s 2023-03-17T12:33:39.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:17 smithi078 ceph-mon[94114]: osdmap e240: 12 total, 12 up, 12 in 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:19 smithi078 ceph-mon[94114]: pgmap v2617: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:21 smithi078 ceph-mon[94114]: pgmap v2618: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:22 smithi078 ceph-mon[94114]: pgmap v2619: 97 pgs: 97 active+clean; 1.7 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:24 smithi078 ceph-mon[94114]: pgmap v2620: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:26 smithi078 ceph-mon[94114]: pgmap v2621: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:28 smithi078 ceph-mon[94114]: pgmap v2622: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 705 B/s wr, 13 op/s 2023-03-17T12:33:39.920 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:30 smithi078 ceph-mon[94114]: pgmap v2623: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:39.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:32 smithi078 ceph-mon[94114]: pgmap v2624: 97 pgs: 97 active+clean; 1.7 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:39.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:34 smithi078 ceph-mon[94114]: pgmap v2625: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:40.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:36 smithi078 ceph-mon[94114]: pgmap v2626: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:40.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:38 smithi078 ceph-mon[94114]: pgmap v2627: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:40.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:40 smithi078 ceph-mon[94114]: pgmap v2628: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:40.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:42 smithi078 ceph-mon[94114]: pgmap v2629: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:41.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:44 smithi078 ceph-mon[94114]: pgmap v2630: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:33:41.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:46 smithi078 ceph-mon[94114]: pgmap v2631: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:41.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:48 smithi078 ceph-mon[94114]: pgmap v2632: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:41.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:50 smithi078 ceph-mon[94114]: pgmap v2633: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:41.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:52 smithi078 ceph-mon[94114]: pgmap v2634: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:41.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:54 smithi078 ceph-mon[94114]: pgmap v2635: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:56 smithi078 ceph-mon[94114]: pgmap v2636: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:06:58 smithi078 ceph-mon[94114]: pgmap v2637: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:00 smithi078 ceph-mon[94114]: pgmap v2638: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:02 smithi078 ceph-mon[94114]: pgmap v2639: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:04 smithi078 ceph-mon[94114]: pgmap v2640: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:06 smithi078 ceph-mon[94114]: pgmap v2641: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:08 smithi078 ceph-mon[94114]: pgmap v2642: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:41.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:09 smithi078 ceph-mon[94114]: osdmap e241: 12 total, 12 up, 12 in 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:10 smithi078 ceph-mon[94114]: pgmap v2644: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:12 smithi078 ceph-mon[94114]: pgmap v2645: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:14 smithi078 ceph-mon[94114]: pgmap v2646: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:42.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:15 smithi078 ceph-mon[94114]: pgmap v2647: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 883 B/s wr, 11 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:15 smithi078 ceph-mon[94114]: pgmap v2648: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 986 B/s wr, 7 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:17 smithi078 ceph-mon[94114]: osdmap e242: 12 total, 12 up, 12 in 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:17 smithi078 ceph-mon[94114]: pgmap v2650: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 15 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:20 smithi078 ceph-mon[94114]: pgmap v2651: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.1 KiB/s wr, 15 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:22 smithi078 ceph-mon[94114]: pgmap v2652: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:24 smithi078 ceph-mon[94114]: pgmap v2653: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:26 smithi078 ceph-mon[94114]: pgmap v2654: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:27 smithi078 ceph-mon[94114]: pgmap v2655: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 94 B/s wr, 13 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:30 smithi078 ceph-mon[94114]: pgmap v2656: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:32 smithi078 ceph-mon[94114]: pgmap v2657: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:34 smithi078 ceph-mon[94114]: pgmap v2658: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:36 smithi078 ceph-mon[94114]: pgmap v2659: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:33:43.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:37 smithi078 ceph-mon[94114]: pgmap v2660: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:40 smithi078 ceph-mon[94114]: pgmap v2661: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:42 smithi078 ceph-mon[94114]: pgmap v2662: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:44 smithi078 ceph-mon[94114]: pgmap v2663: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:46 smithi078 ceph-mon[94114]: pgmap v2664: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:47 smithi078 ceph-mon[94114]: pgmap v2665: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:50 smithi078 ceph-mon[94114]: pgmap v2666: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:52 smithi078 ceph-mon[94114]: pgmap v2667: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:54 smithi078 ceph-mon[94114]: pgmap v2668: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:56 smithi078 ceph-mon[94114]: pgmap v2669: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:07:57 smithi078 ceph-mon[94114]: pgmap v2670: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:00 smithi078 ceph-mon[94114]: pgmap v2671: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:02 smithi078 ceph-mon[94114]: pgmap v2672: 97 pgs: 97 active+clean; 1.8 MiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:43.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:04 smithi078 ceph-mon[94114]: pgmap v2673: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:43.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:06 smithi078 ceph-mon[94114]: pgmap v2674: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:43.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:07 smithi078 ceph-mon[94114]: pgmap v2675: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:43.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:09 smithi078 ceph-mon[94114]: osdmap e243: 12 total, 12 up, 12 in 2023-03-17T12:33:43.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:09 smithi078 ceph-mon[94114]: pgmap v2677: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:43.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:12 smithi078 ceph-mon[94114]: pgmap v2678: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:44.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:14 smithi078 ceph-mon[94114]: pgmap v2679: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:44.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:16 smithi078 ceph-mon[94114]: pgmap v2680: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:44.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:44.212 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:17 smithi078 ceph-mon[94114]: osdmap e244: 12 total, 12 up, 12 in 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:17 smithi078 ceph-mon[94114]: pgmap v2682: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 234 B/s wr, 11 op/s 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.213 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:44.214 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:44.214 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:44.214 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:44.214 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:44.214 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:44.214 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:33:45.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: pgmap v2683: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: pgmap v2684: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:22 smithi078 ceph-mon[94114]: pgmap v2685: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:24 smithi078 ceph-mon[94114]: pgmap v2686: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:26 smithi078 ceph-mon[94114]: pgmap v2687: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 115 B/s wr, 11 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:27 smithi078 ceph-mon[94114]: pgmap v2688: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:30 smithi078 ceph-mon[94114]: pgmap v2689: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:32 smithi078 ceph-mon[94114]: pgmap v2690: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:45.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:34 smithi078 ceph-mon[94114]: pgmap v2691: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:36 smithi078 ceph-mon[94114]: pgmap v2692: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:37 smithi078 ceph-mon[94114]: pgmap v2693: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:40 smithi078 ceph-mon[94114]: pgmap v2694: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:42 smithi078 ceph-mon[94114]: pgmap v2695: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:44 smithi078 ceph-mon[94114]: pgmap v2696: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:46 smithi078 ceph-mon[94114]: pgmap v2697: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:45.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:47 smithi078 ceph-mon[94114]: pgmap v2698: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:48.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:50 smithi078 ceph-mon[94114]: pgmap v2699: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:48.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:52 smithi078 ceph-mon[94114]: pgmap v2700: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:48.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:54 smithi078 ceph-mon[94114]: pgmap v2701: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:50.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:56 smithi078 ceph-mon[94114]: pgmap v2702: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:52.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:08:57 smithi078 ceph-mon[94114]: pgmap v2703: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:00 smithi078 ceph-mon[94114]: pgmap v2704: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:02 smithi078 ceph-mon[94114]: pgmap v2705: 97 pgs: 97 active+clean; 1.8 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:04 smithi078 ceph-mon[94114]: pgmap v2706: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:06 smithi078 ceph-mon[94114]: pgmap v2707: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:07 smithi078 ceph-mon[94114]: pgmap v2708: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:09 smithi078 ceph-mon[94114]: osdmap e245: 12 total, 12 up, 12 in 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:09 smithi078 ceph-mon[94114]: pgmap v2710: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:12 smithi078 ceph-mon[94114]: pgmap v2711: 97 pgs: 97 active+clean; 1.8 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:14 smithi078 ceph-mon[94114]: pgmap v2712: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:16 smithi078 ceph-mon[94114]: pgmap v2713: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:17 smithi078 ceph-mon[94114]: osdmap e246: 12 total, 12 up, 12 in 2023-03-17T12:33:55.000 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:17 smithi078 ceph-mon[94114]: pgmap v2715: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:20 smithi078 ceph-mon[94114]: pgmap v2716: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:22 smithi078 ceph-mon[94114]: pgmap v2717: 97 pgs: 97 active+clean; 1.8 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: pgmap v2718: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 952 B/s wr, 11 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: pgmap v2719: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:25 smithi078 ceph-mon[94114]: pgmap v2720: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:27 smithi078 ceph-mon[94114]: pgmap v2721: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 847 B/s wr, 6 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:29 smithi078 ceph-mon[94114]: pgmap v2722: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 847 B/s wr, 11 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:31 smithi078 ceph-mon[94114]: pgmap v2723: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 847 B/s wr, 11 op/s 2023-03-17T12:33:55.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:33 smithi078 ceph-mon[94114]: pgmap v2724: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:33:56.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:35 smithi078 ceph-mon[94114]: pgmap v2725: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:56.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:37 smithi078 ceph-mon[94114]: pgmap v2726: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:57.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:39 smithi078 ceph-mon[94114]: pgmap v2727: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:57.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:41 smithi078 ceph-mon[94114]: pgmap v2728: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:57.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:43 smithi078 ceph-mon[94114]: pgmap v2729: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:57.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:45 smithi078 ceph-mon[94114]: pgmap v2730: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:57.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:47 smithi078 ceph-mon[94114]: pgmap v2731: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:57.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:49 smithi078 ceph-mon[94114]: pgmap v2732: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:51 smithi078 ceph-mon[94114]: pgmap v2733: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:53 smithi078 ceph-mon[94114]: pgmap v2734: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:55 smithi078 ceph-mon[94114]: pgmap v2735: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:57 smithi078 ceph-mon[94114]: pgmap v2736: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:09:59 smithi078 ceph-mon[94114]: pgmap v2737: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:01 smithi078 ceph-mon[94114]: pgmap v2738: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:03 smithi078 ceph-mon[94114]: pgmap v2739: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:33:57.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:05 smithi078 ceph-mon[94114]: pgmap v2740: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:33:57.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:07 smithi078 ceph-mon[94114]: pgmap v2741: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:09 smithi078 ceph-mon[94114]: osdmap e247: 12 total, 12 up, 12 in 2023-03-17T12:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:09 smithi078 ceph-mon[94114]: pgmap v2743: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:33:57.907 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:11 smithi078 ceph-mon[94114]: pgmap v2744: 97 pgs: 97 active+clean; 1.8 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:13 smithi078 ceph-mon[94114]: pgmap v2745: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:15 smithi078 ceph-mon[94114]: pgmap v2746: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:17 smithi078 ceph-mon[94114]: osdmap e248: 12 total, 12 up, 12 in 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:17 smithi078 ceph-mon[94114]: pgmap v2748: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 970 B/s wr, 7 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:19 smithi078 ceph-mon[94114]: pgmap v2749: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:21 smithi078 ceph-mon[94114]: pgmap v2750: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:23 smithi078 ceph-mon[94114]: pgmap v2751: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:25 smithi078 ceph-mon[94114]: pgmap v2752: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:00.757 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:01.744 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: pgmap v2753: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: pgmap v2754: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:29 smithi078 ceph-mon[94114]: pgmap v2755: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:31 smithi078 ceph-mon[94114]: pgmap v2756: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:32 smithi078 ceph-mon[94114]: pgmap v2757: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:34:01.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:35 smithi078 ceph-mon[94114]: pgmap v2758: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:34:01.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:37 smithi078 ceph-mon[94114]: pgmap v2759: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:34:01.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:39 smithi078 ceph-mon[94114]: pgmap v2760: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:41 smithi078 ceph-mon[94114]: pgmap v2761: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:42 smithi078 ceph-mon[94114]: pgmap v2762: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:45 smithi078 ceph-mon[94114]: pgmap v2763: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:47 smithi078 ceph-mon[94114]: pgmap v2764: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:49 smithi078 ceph-mon[94114]: pgmap v2765: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:51 smithi078 ceph-mon[94114]: pgmap v2766: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:52 smithi078 ceph-mon[94114]: pgmap v2767: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:55 smithi078 ceph-mon[94114]: pgmap v2768: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:57 smithi078 ceph-mon[94114]: pgmap v2769: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.798 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:10:59 smithi078 ceph-mon[94114]: pgmap v2770: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:01 smithi078 ceph-mon[94114]: pgmap v2771: 97 pgs: 97 active+clean; 1.8 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:02 smithi078 ceph-mon[94114]: pgmap v2772: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:05 smithi078 ceph-mon[94114]: pgmap v2773: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:07 smithi078 ceph-mon[94114]: pgmap v2774: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:09 smithi078 ceph-mon[94114]: pgmap v2775: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:10 smithi078 ceph-mon[94114]: osdmap e249: 12 total, 12 up, 12 in 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:11 smithi078 ceph-mon[94114]: pgmap v2777: 97 pgs: 97 active+clean; 1.8 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:12 smithi078 ceph-mon[94114]: pgmap v2778: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:15 smithi078 ceph-mon[94114]: pgmap v2779: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:17 smithi078 ceph-mon[94114]: pgmap v2780: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:17 smithi078 ceph-mon[94114]: osdmap e250: 12 total, 12 up, 12 in 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:19 smithi078 ceph-mon[94114]: pgmap v2782: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:21 smithi078 ceph-mon[94114]: pgmap v2783: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:22 smithi078 ceph-mon[94114]: pgmap v2784: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:25 smithi078 ceph-mon[94114]: pgmap v2785: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:27 smithi078 ceph-mon[94114]: pgmap v2786: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:02.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:29 smithi078 ceph-mon[94114]: pgmap v2787: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 86 B/s wr, 12 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: pgmap v2788: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: pgmap v2789: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:32 smithi078 ceph-mon[94114]: pgmap v2790: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:34 smithi078 ceph-mon[94114]: pgmap v2791: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:36 smithi078 ceph-mon[94114]: pgmap v2792: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:38 smithi078 ceph-mon[94114]: pgmap v2793: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:40 smithi078 ceph-mon[94114]: pgmap v2794: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:34:02.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:42 smithi078 ceph-mon[94114]: pgmap v2795: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:44 smithi078 ceph-mon[94114]: pgmap v2796: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:46 smithi078 ceph-mon[94114]: pgmap v2797: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:02.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:48 smithi078 ceph-mon[94114]: pgmap v2798: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:02.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:50 smithi078 ceph-mon[94114]: pgmap v2799: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:34:02.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:52 smithi078 ceph-mon[94114]: pgmap v2800: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:34:02.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:54 smithi078 ceph-mon[94114]: pgmap v2801: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:56 smithi078 ceph-mon[94114]: pgmap v2802: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:34:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:11:58 smithi078 ceph-mon[94114]: pgmap v2803: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:00 smithi078 ceph-mon[94114]: pgmap v2804: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:02 smithi078 ceph-mon[94114]: pgmap v2805: 97 pgs: 97 active+clean; 1.8 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:04.072 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:04 smithi078 ceph-mon[94114]: pgmap v2806: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:06 smithi078 ceph-mon[94114]: pgmap v2807: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:08 smithi078 ceph-mon[94114]: pgmap v2808: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:09 smithi078 ceph-mon[94114]: osdmap e251: 12 total, 12 up, 12 in 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:10 smithi078 ceph-mon[94114]: pgmap v2810: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:12 smithi078 ceph-mon[94114]: pgmap v2811: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:14 smithi078 ceph-mon[94114]: pgmap v2812: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:05.507 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:16 smithi078 ceph-mon[94114]: pgmap v2813: 97 pgs: 97 active+clean; 1.8 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:05.902 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:16 smithi078 ceph-mon[94114]: osdmap e252: 12 total, 12 up, 12 in 2023-03-17T12:34:06.943 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:18 smithi078 ceph-mon[94114]: pgmap v2815: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:34:06.943 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:20 smithi078 ceph-mon[94114]: pgmap v2816: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:08.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:22 smithi078 ceph-mon[94114]: pgmap v2817: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:08.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:24 smithi078 ceph-mon[94114]: pgmap v2818: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:26 smithi078 ceph-mon[94114]: pgmap v2819: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:28 smithi078 ceph-mon[94114]: pgmap v2820: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 89 B/s wr, 13 op/s 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:30 smithi078 ceph-mon[94114]: pgmap v2821: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:31 smithi078 ceph-mon[94114]: pgmap v2822: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:31 smithi078 ceph-mon[94114]: pgmap v2823: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:34:08.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:33 smithi078 ceph-mon[94114]: pgmap v2824: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:34:08.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:35 smithi078 ceph-mon[94114]: pgmap v2825: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:34:08.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:37 smithi078 ceph-mon[94114]: pgmap v2826: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:39 smithi078 ceph-mon[94114]: pgmap v2827: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:41 smithi078 ceph-mon[94114]: pgmap v2828: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:43 smithi078 ceph-mon[94114]: pgmap v2829: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:45 smithi078 ceph-mon[94114]: pgmap v2830: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:47 smithi078 ceph-mon[94114]: pgmap v2831: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:49 smithi078 ceph-mon[94114]: pgmap v2832: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:34:10.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:51 smithi078 ceph-mon[94114]: pgmap v2833: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:34:12.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:53 smithi078 ceph-mon[94114]: pgmap v2834: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 13 op/s 2023-03-17T12:34:12.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:55 smithi078 ceph-mon[94114]: pgmap v2835: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:34:12.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:57 smithi078 ceph-mon[94114]: pgmap v2836: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:34:12.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:12:59 smithi078 ceph-mon[94114]: pgmap v2837: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:34:12.819 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:01 smithi078 ceph-mon[94114]: pgmap v2838: 97 pgs: 97 active+clean; 1.8 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:34:13.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:03 smithi078 ceph-mon[94114]: pgmap v2839: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:13.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:05 smithi078 ceph-mon[94114]: pgmap v2840: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:34:13.680 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:07 smithi078 ceph-mon[94114]: pgmap v2841: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:09 smithi078 ceph-mon[94114]: osdmap e253: 12 total, 12 up, 12 in 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:09 smithi078 ceph-mon[94114]: pgmap v2843: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:11 smithi078 ceph-mon[94114]: pgmap v2844: 97 pgs: 97 active+clean; 1.8 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:13 smithi078 ceph-mon[94114]: pgmap v2845: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:15 smithi078 ceph-mon[94114]: pgmap v2846: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:17 smithi078 ceph-mon[94114]: osdmap e254: 12 total, 12 up, 12 in 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:17 smithi078 ceph-mon[94114]: pgmap v2848: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 874 B/s wr, 7 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:19 smithi078 ceph-mon[94114]: pgmap v2849: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:21 smithi078 ceph-mon[94114]: pgmap v2850: 97 pgs: 97 active+clean; 1.8 MiB data, 336 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:23 smithi078 ceph-mon[94114]: pgmap v2851: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:25 smithi078 ceph-mon[94114]: pgmap v2852: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:34:13.681 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:27 smithi078 ceph-mon[94114]: pgmap v2853: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 498 B/s wr, 10 op/s 2023-03-17T12:34:13.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:29 smithi078 ceph-mon[94114]: pgmap v2854: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 13 op/s 2023-03-17T12:34:13.682 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:31 smithi078 ceph-mon[94114]: pgmap v2855: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:34:14.578 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:14.578 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:14.578 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:14.579 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:16.564 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:32 smithi078 ceph-mon[94114]: pgmap v2856: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:32 smithi078 ceph-mon[94114]: pgmap v2857: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:34 smithi078 ceph-mon[94114]: pgmap v2858: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:36 smithi078 ceph-mon[94114]: pgmap v2859: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:38 smithi078 ceph-mon[94114]: pgmap v2860: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:40 smithi078 ceph-mon[94114]: pgmap v2861: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:42 smithi078 ceph-mon[94114]: pgmap v2862: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:44 smithi078 ceph-mon[94114]: pgmap v2863: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:46 smithi078 ceph-mon[94114]: pgmap v2864: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:48 smithi078 ceph-mon[94114]: pgmap v2865: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:50 smithi078 ceph-mon[94114]: pgmap v2866: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:52 smithi078 ceph-mon[94114]: pgmap v2867: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:16.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:54 smithi078 ceph-mon[94114]: pgmap v2868: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:17.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:56 smithi078 ceph-mon[94114]: pgmap v2869: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:17.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:13:58 smithi078 ceph-mon[94114]: pgmap v2870: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:34:17.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:00 smithi078 ceph-mon[94114]: pgmap v2871: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:17.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:02 smithi078 ceph-mon[94114]: pgmap v2872: 97 pgs: 97 active+clean; 1.8 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:17.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:04 smithi078 ceph-mon[94114]: pgmap v2873: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:17.258 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:06 smithi078 ceph-mon[94114]: pgmap v2874: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:34:17.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:08 smithi078 ceph-mon[94114]: pgmap v2875: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:09 smithi078 ceph-mon[94114]: osdmap e255: 12 total, 12 up, 12 in 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:10 smithi078 ceph-mon[94114]: pgmap v2877: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:12 smithi078 ceph-mon[94114]: pgmap v2878: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:14 smithi078 ceph-mon[94114]: pgmap v2879: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:16 smithi078 ceph-mon[94114]: pgmap v2880: 97 pgs: 97 active+clean; 1.8 MiB data, 322 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:16 smithi078 ceph-mon[94114]: osdmap e256: 12 total, 12 up, 12 in 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:18 smithi078 ceph-mon[94114]: pgmap v2882: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 228 B/s wr, 11 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:20 smithi078 ceph-mon[94114]: pgmap v2883: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:22 smithi078 ceph-mon[94114]: pgmap v2884: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:34:17.993 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:24 smithi078 ceph-mon[94114]: pgmap v2885: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:17.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:26 smithi078 ceph-mon[94114]: pgmap v2886: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:34:19.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:28 smithi078 ceph-mon[94114]: pgmap v2887: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 92 B/s wr, 13 op/s 2023-03-17T12:34:19.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:30 smithi078 ceph-mon[94114]: pgmap v2888: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:19.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: pgmap v2889: 97 pgs: 97 active+clean; 1.8 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: pgmap v2890: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 36 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: pgmap v2891: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.5 MiB/s wr, 39 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:34 smithi078 ceph-mon[94114]: pgmap v2892: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.5 MiB/s wr, 39 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:36 smithi078 ceph-mon[94114]: pgmap v2893: 97 pgs: 97 active+clean; 23 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 33 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:38 smithi078 ceph-mon[94114]: pgmap v2894: 97 pgs: 97 active+clean; 27 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 3.5 MiB/s wr, 123 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:40 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:40 smithi078 ceph-mon[94114]: pgmap v2895: 97 pgs: 97 active+clean; 27 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 3.5 MiB/s wr, 123 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:42 smithi078 ceph-mon[94114]: pgmap v2896: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2023-03-17T12:34:19.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:44 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:34:19.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:44 smithi078 ceph-mon[94114]: pgmap v2897: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2023-03-17T12:34:19.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:46 smithi078 ceph-mon[94114]: pgmap v2898: 97 pgs: 97 active+clean; 28 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2023-03-17T12:34:19.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:48 smithi078 ceph-mon[94114]: pgmap v2899: 97 pgs: 97 active+clean; 29 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 1.9 MiB/s wr, 173 op/s 2023-03-17T12:34:19.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:50 smithi078 ceph-mon[94114]: pgmap v2900: 97 pgs: 97 active+clean; 29 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 1.2 MiB/s wr, 107 op/s 2023-03-17T12:34:19.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:52 smithi078 ceph-mon[94114]: pgmap v2901: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.6 MiB/s wr, 175 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:54 smithi078 ceph-mon[94114]: pgmap v2902: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:56 smithi078 ceph-mon[94114]: pgmap v2903: 97 pgs: 97 active+clean; 28 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.0 MiB/s wr, 124 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:14:58 smithi078 ceph-mon[94114]: pgmap v2904: 97 pgs: 97 active+clean; 32 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 1.6 MiB/s wr, 182 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:00 smithi078 ceph-mon[94114]: pgmap v2905: 97 pgs: 97 active+clean; 32 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:02 smithi078 ceph-mon[94114]: pgmap v2906: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:04 smithi078 ceph-mon[94114]: osdmap e257: 12 total, 12 up, 12 in 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:04 smithi078 ceph-mon[94114]: pgmap v2908: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:06 smithi078 ceph-mon[94114]: pgmap v2909: 97 pgs: 97 active+clean; 30 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-03-17T12:34:19.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:08 smithi078 ceph-mon[94114]: pgmap v2910: 97 pgs: 97 active+clean; 30 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-03-17T12:34:20.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:10 smithi078 ceph-mon[94114]: pgmap v2911: 97 pgs: 97 active+clean; 30 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.3 MiB/s wr, 164 op/s 2023-03-17T12:34:20.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:12 smithi078 ceph-mon[94114]: osdmap e258: 12 total, 12 up, 12 in 2023-03-17T12:34:20.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:12 smithi078 ceph-mon[94114]: pgmap v2913: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.4 MiB/s wr, 165 op/s 2023-03-17T12:34:20.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:14 smithi078 ceph-mon[94114]: pgmap v2914: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-03-17T12:34:20.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:16 smithi078 ceph-mon[94114]: pgmap v2915: 97 pgs: 97 active+clean; 34 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 1.3 MiB/s wr, 147 op/s 2023-03-17T12:34:20.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:18 smithi078 ceph-mon[94114]: pgmap v2916: 97 pgs: 97 active+clean; 35 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2023-03-17T12:34:20.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:20 smithi078 ceph-mon[94114]: pgmap v2917: 97 pgs: 97 active+clean; 35 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2023-03-17T12:34:20.985 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:22 smithi078 ceph-mon[94114]: pgmap v2918: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.9 MiB/s wr, 198 op/s 2023-03-17T12:34:20.985 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:24 smithi078 ceph-mon[94114]: pgmap v2919: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-03-17T12:34:20.985 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:26 smithi078 ceph-mon[94114]: pgmap v2920: 97 pgs: 97 active+clean; 34 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.1 MiB/s wr, 118 op/s 2023-03-17T12:34:20.985 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:28 smithi078 ceph-mon[94114]: pgmap v2921: 97 pgs: 97 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.7 MiB/s wr, 179 op/s 2023-03-17T12:34:22.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:30 smithi078 ceph-mon[94114]: pgmap v2922: 97 pgs: 97 active+clean; 39 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T12:34:22.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:32 smithi078 ceph-mon[94114]: pgmap v2923: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.7 MiB/s wr, 178 op/s 2023-03-17T12:34:22.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:22.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:22.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:22.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:33 smithi078 ceph-mon[94114]: pgmap v2924: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:34:26.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:33 smithi078 ceph-mon[94114]: pgmap v2925: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:34:26.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:26.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:36 smithi078 ceph-mon[94114]: pgmap v2926: 97 pgs: 97 active+clean; 39 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:34:26.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:37 smithi078 ceph-mon[94114]: pgmap v2927: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2023-03-17T12:34:26.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:40 smithi078 ceph-mon[94114]: pgmap v2928: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:42 smithi078 ceph-mon[94114]: pgmap v2929: 97 pgs: 97 active+clean; 39 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 635 KiB/s wr, 81 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:44 smithi078 ceph-mon[94114]: pgmap v2930: 97 pgs: 97 active+clean; 43 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1.3 MiB/s wr, 144 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:46 smithi078 ceph-mon[94114]: pgmap v2931: 97 pgs: 97 active+clean; 43 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:47 smithi078 ceph-mon[94114]: pgmap v2932: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:50 smithi078 ceph-mon[94114]: pgmap v2933: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:52 smithi078 ceph-mon[94114]: pgmap v2934: 97 pgs: 97 active+clean; 44 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:34:26.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:54 smithi078 ceph-mon[94114]: pgmap v2935: 97 pgs: 97 active+clean; 45 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.8 MiB/s wr, 178 op/s 2023-03-17T12:34:27.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:56 smithi078 ceph-mon[94114]: pgmap v2936: 97 pgs: 97 active+clean; 45 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:34:27.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:15:57 smithi078 ceph-mon[94114]: pgmap v2937: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 1.6 MiB/s wr, 180 op/s 2023-03-17T12:34:28.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:00 smithi078 ceph-mon[94114]: pgmap v2938: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-03-17T12:34:28.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:02 smithi078 ceph-mon[94114]: pgmap v2939: 97 pgs: 97 active+clean; 45 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-03-17T12:34:28.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:04 smithi078 ceph-mon[94114]: pgmap v2940: 97 pgs: 97 active+clean; 50 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.7 MiB/s wr, 189 op/s 2023-03-17T12:34:28.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:05 smithi078 ceph-mon[94114]: osdmap e259: 12 total, 12 up, 12 in 2023-03-17T12:34:29.536 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:06 smithi078 ceph-mon[94114]: pgmap v2942: 97 pgs: 97 active+clean; 50 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2023-03-17T12:34:29.536 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:07 smithi078 ceph-mon[94114]: pgmap v2943: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:34:29.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:10 smithi078 ceph-mon[94114]: pgmap v2944: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:34:29.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:12 smithi078 ceph-mon[94114]: pgmap v2945: 97 pgs: 97 active+clean; 54 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:34:29.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:12 smithi078 ceph-mon[94114]: osdmap e260: 12 total, 12 up, 12 in 2023-03-17T12:34:29.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:14 smithi078 ceph-mon[94114]: pgmap v2947: 97 pgs: 97 active+clean; 53 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 1.5 MiB/s wr, 162 op/s 2023-03-17T12:34:29.537 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:16 smithi078 ceph-mon[94114]: pgmap v2948: 97 pgs: 97 active+clean; 53 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:34:30.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:17 smithi078 ceph-mon[94114]: pgmap v2949: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:20 smithi078 ceph-mon[94114]: pgmap v2950: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:22 smithi078 ceph-mon[94114]: pgmap v2951: 97 pgs: 97 active+clean; 58 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:24 smithi078 ceph-mon[94114]: pgmap v2952: 97 pgs: 97 active+clean; 59 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 1.8 MiB/s wr, 186 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:26 smithi078 ceph-mon[94114]: pgmap v2953: 97 pgs: 97 active+clean; 59 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.3 MiB/s wr, 117 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:27 smithi078 ceph-mon[94114]: pgmap v2954: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 1.9 MiB/s wr, 180 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:30 smithi078 ceph-mon[94114]: pgmap v2955: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:32 smithi078 ceph-mon[94114]: pgmap v2956: 97 pgs: 97 active+clean; 59 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:34 smithi078 ceph-mon[94114]: pgmap v2957: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:35 smithi078 ceph-mon[94114]: pgmap v2958: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.3 MiB/s wr, 137 op/s 2023-03-17T12:34:30.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:35 smithi078 ceph-mon[94114]: pgmap v2959: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.7 MiB/s wr, 168 op/s 2023-03-17T12:34:30.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:35 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:34:30.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:37 smithi078 ceph-mon[94114]: pgmap v2960: 97 pgs: 97 active+clean; 64 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 963 KiB/s wr, 83 op/s 2023-03-17T12:34:30.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:39 smithi078 ceph-mon[94114]: pgmap v2961: 97 pgs: 97 active+clean; 65 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.8 MiB/s wr, 159 op/s 2023-03-17T12:34:32.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:41 smithi078 ceph-mon[94114]: pgmap v2962: 97 pgs: 97 active+clean; 65 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.8 MiB/s wr, 159 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:42 smithi078 ceph-mon[94114]: pgmap v2963: 97 pgs: 97 active+clean; 66 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:44 smithi078 ceph-mon[94114]: pgmap v2964: 97 pgs: 97 active+clean; 65 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.3 MiB/s wr, 138 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:46 smithi078 ceph-mon[94114]: pgmap v2965: 97 pgs: 97 active+clean; 65 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:49 smithi078 ceph-mon[94114]: pgmap v2966: 97 pgs: 97 active+clean; 68 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 1.7 MiB/s wr, 177 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:51 smithi078 ceph-mon[94114]: pgmap v2967: 97 pgs: 97 active+clean; 68 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 1.1 MiB/s wr, 120 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:52 smithi078 ceph-mon[94114]: pgmap v2968: 97 pgs: 97 active+clean; 70 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 1.5 MiB/s wr, 174 op/s 2023-03-17T12:34:35.924 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:54 smithi078 ceph-mon[94114]: pgmap v2969: 97 pgs: 97 active+clean; 70 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:57 smithi078 ceph-mon[94114]: pgmap v2970: 97 pgs: 97 active+clean; 70 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:16:59 smithi078 ceph-mon[94114]: pgmap v2971: 97 pgs: 97 active+clean; 72 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.9 MiB/s wr, 178 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:00 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:01 smithi078 ceph-mon[94114]: pgmap v2972: 97 pgs: 97 active+clean; 72 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 1.2 MiB/s wr, 116 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:02 smithi078 ceph-mon[94114]: pgmap v2973: 97 pgs: 97 active+clean; 56 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 1.6 MiB/s wr, 193 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:04 smithi078 ceph-mon[94114]: osdmap e261: 12 total, 12 up, 12 in 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:04 smithi078 ceph-mon[94114]: pgmap v2975: 97 pgs: 97 active+clean; 57 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:07 smithi078 ceph-mon[94114]: pgmap v2976: 97 pgs: 97 active+clean; 57 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:09 smithi078 ceph-mon[94114]: pgmap v2977: 97 pgs: 97 active+clean; 61 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:11 smithi078 ceph-mon[94114]: pgmap v2978: 97 pgs: 97 active+clean; 61 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:12 smithi078 ceph-mon[94114]: osdmap e262: 12 total, 12 up, 12 in 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:12 smithi078 ceph-mon[94114]: pgmap v2980: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:14 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:34:36.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:14 smithi078 ceph-mon[94114]: pgmap v2981: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.5 MiB/s wr, 139 op/s 2023-03-17T12:34:36.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:17 smithi078 ceph-mon[94114]: pgmap v2982: 97 pgs: 97 active+clean; 63 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.5 MiB/s wr, 139 op/s 2023-03-17T12:34:36.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:19 smithi078 ceph-mon[94114]: pgmap v2983: 97 pgs: 97 active+clean; 59 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:34:36.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:21 smithi078 ceph-mon[94114]: pgmap v2984: 97 pgs: 97 active+clean; 59 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.4 MiB/s wr, 149 op/s 2023-03-17T12:34:39.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:22 smithi078 ceph-mon[94114]: pgmap v2985: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 2.0 MiB/s wr, 206 op/s 2023-03-17T12:34:39.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:25 smithi078 ceph-mon[94114]: pgmap v2986: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:27 smithi078 ceph-mon[94114]: pgmap v2987: 97 pgs: 97 active+clean; 63 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:29 smithi078 ceph-mon[94114]: pgmap v2988: 97 pgs: 97 active+clean; 61 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.9 MiB/s wr, 184 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:31 smithi078 ceph-mon[94114]: pgmap v2989: 97 pgs: 97 active+clean; 61 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:32 smithi078 ceph-mon[94114]: pgmap v2990: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 1.8 MiB/s wr, 181 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:35 smithi078 ceph-mon[94114]: pgmap v2991: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 1.1 MiB/s wr, 123 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:36 smithi078 ceph-mon[94114]: pgmap v2992: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1.2 MiB/s wr, 132 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:36 smithi078 ceph-mon[94114]: pgmap v2993: 97 pgs: 97 active+clean; 61 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.4 MiB/s wr, 161 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:37 smithi078 ceph-mon[94114]: pgmap v2994: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2023-03-17T12:34:39.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:40 smithi078 ceph-mon[94114]: pgmap v2995: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 158 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:42 smithi078 ceph-mon[94114]: pgmap v2996: 97 pgs: 97 active+clean; 65 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 927 KiB/s wr, 78 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:44 smithi078 ceph-mon[94114]: pgmap v2997: 97 pgs: 97 active+clean; 67 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:46 smithi078 ceph-mon[94114]: pgmap v2998: 97 pgs: 97 active+clean; 67 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 1.6 MiB/s wr, 143 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:47 smithi078 ceph-mon[94114]: pgmap v2999: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.9 MiB/s wr, 181 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:50 smithi078 ceph-mon[94114]: pgmap v3000: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:52 smithi078 ceph-mon[94114]: pgmap v3001: 97 pgs: 97 active+clean; 67 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:54 smithi078 ceph-mon[94114]: pgmap v3002: 97 pgs: 97 active+clean; 72 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:56 smithi078 ceph-mon[94114]: pgmap v3003: 97 pgs: 97 active+clean; 72 MiB data, 896 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 1.2 MiB/s wr, 122 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:17:57 smithi078 ceph-mon[94114]: pgmap v3004: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2023-03-17T12:34:39.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:00 smithi078 ceph-mon[94114]: pgmap v3005: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2023-03-17T12:34:40.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:02 smithi078 ceph-mon[94114]: pgmap v3006: 97 pgs: 97 active+clean; 69 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2023-03-17T12:34:40.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:04 smithi078 ceph-mon[94114]: pgmap v3007: 97 pgs: 97 active+clean; 68 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.7 MiB/s wr, 185 op/s 2023-03-17T12:34:40.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:05 smithi078 ceph-mon[94114]: osdmap e263: 12 total, 12 up, 12 in 2023-03-17T12:34:40.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:06 smithi078 ceph-mon[94114]: pgmap v3009: 97 pgs: 97 active+clean; 68 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.2 MiB/s wr, 149 op/s 2023-03-17T12:34:40.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:07 smithi078 ceph-mon[94114]: pgmap v3010: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:34:40.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:10 smithi078 ceph-mon[94114]: pgmap v3011: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:34:40.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:12 smithi078 ceph-mon[94114]: pgmap v3012: 97 pgs: 97 active+clean; 74 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-03-17T12:34:40.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:12 smithi078 ceph-mon[94114]: osdmap e264: 12 total, 12 up, 12 in 2023-03-17T12:34:40.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:14 smithi078 ceph-mon[94114]: pgmap v3014: 97 pgs: 97 active+clean; 72 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.2 MiB/s wr, 114 op/s 2023-03-17T12:34:40.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:16 smithi078 ceph-mon[94114]: pgmap v3015: 97 pgs: 97 active+clean; 72 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 1.1 MiB/s wr, 102 op/s 2023-03-17T12:34:40.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:17 smithi078 ceph-mon[94114]: pgmap v3016: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T12:34:40.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:20 smithi078 ceph-mon[94114]: pgmap v3017: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T12:34:40.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:22 smithi078 ceph-mon[94114]: pgmap v3018: 97 pgs: 97 active+clean; 77 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2023-03-17T12:34:40.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:24 smithi078 ceph-mon[94114]: pgmap v3019: 97 pgs: 97 active+clean; 78 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.4 MiB/s wr, 141 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:26 smithi078 ceph-mon[94114]: pgmap v3020: 97 pgs: 97 active+clean; 78 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 1.2 MiB/s wr, 109 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:27 smithi078 ceph-mon[94114]: pgmap v3021: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:30 smithi078 ceph-mon[94114]: pgmap v3022: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:32 smithi078 ceph-mon[94114]: pgmap v3023: 97 pgs: 97 active+clean; 82 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 1.2 MiB/s wr, 118 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:34 smithi078 ceph-mon[94114]: pgmap v3024: 97 pgs: 97 active+clean; 84 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.9 MiB/s wr, 173 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:36 smithi078 ceph-mon[94114]: pgmap v3025: 97 pgs: 97 active+clean; 84 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 1.4 MiB/s wr, 115 op/s 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:43.493 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:37 smithi078 ceph-mon[94114]: pgmap v3026: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 172 op/s 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:34:43.494 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:34:43.495 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: pgmap v3027: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-03-17T12:34:43.495 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:46.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:46.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:46.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:46.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:46.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:46.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:47.777 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:41 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:41 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:34:47.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:41 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:34:49.071 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:41 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:34:49.071 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:41 smithi078 ceph-mon[94114]: pgmap v3028: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.3 MiB/s wr, 121 op/s 2023-03-17T12:34:49.071 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:41 smithi078 ceph-mon[94114]: pgmap v3029: 97 pgs: 97 active+clean; 85 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:42 smithi078 ceph-mon[94114]: pgmap v3030: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:45 smithi078 ceph-mon[94114]: pgmap v3031: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.6 MiB/s wr, 153 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:47 smithi078 ceph-mon[94114]: pgmap v3032: 97 pgs: 97 active+clean; 89 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 924 KiB/s wr, 77 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:49 smithi078 ceph-mon[94114]: pgmap v3033: 97 pgs: 97 active+clean; 91 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:51 smithi078 ceph-mon[94114]: pgmap v3034: 97 pgs: 97 active+clean; 91 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.6 MiB/s wr, 133 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:52 smithi078 ceph-mon[94114]: pgmap v3035: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.8 MiB/s wr, 175 op/s 2023-03-17T12:34:51.144 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:55 smithi078 ceph-mon[94114]: pgmap v3036: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:34:51.145 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:57 smithi078 ceph-mon[94114]: pgmap v3037: 97 pgs: 97 active+clean; 75 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:34:51.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:18:59 smithi078 ceph-mon[94114]: pgmap v3038: 97 pgs: 97 active+clean; 80 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.9 MiB/s wr, 177 op/s 2023-03-17T12:34:51.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:01 smithi078 ceph-mon[94114]: pgmap v3039: 97 pgs: 97 active+clean; 80 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 1.2 MiB/s wr, 123 op/s 2023-03-17T12:34:51.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:02 smithi078 ceph-mon[94114]: pgmap v3040: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 1.9 MiB/s wr, 193 op/s 2023-03-17T12:34:51.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:04 smithi078 ceph-mon[94114]: osdmap e265: 12 total, 12 up, 12 in 2023-03-17T12:34:51.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:04 smithi078 ceph-mon[94114]: pgmap v3042: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T12:34:53.332 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:07 smithi078 ceph-mon[94114]: pgmap v3043: 97 pgs: 97 active+clean; 83 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T12:34:53.332 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:09 smithi078 ceph-mon[94114]: pgmap v3044: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2023-03-17T12:34:53.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:11 smithi078 ceph-mon[94114]: pgmap v3045: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 1.4 MiB/s wr, 155 op/s 2023-03-17T12:34:53.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:12 smithi078 ceph-mon[94114]: osdmap e266: 12 total, 12 up, 12 in 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:12 smithi078 ceph-mon[94114]: pgmap v3047: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 1.7 MiB/s wr, 166 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:15 smithi078 ceph-mon[94114]: pgmap v3048: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:17 smithi078 ceph-mon[94114]: pgmap v3049: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 1.5 MiB/s wr, 144 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:19 smithi078 ceph-mon[94114]: pgmap v3050: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:21 smithi078 ceph-mon[94114]: pgmap v3051: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:22 smithi078 ceph-mon[94114]: pgmap v3052: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.1 MiB/s wr, 199 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:25 smithi078 ceph-mon[94114]: pgmap v3053: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:27 smithi078 ceph-mon[94114]: pgmap v3054: 97 pgs: 97 active+clean; 89 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:29 smithi078 ceph-mon[94114]: pgmap v3055: 97 pgs: 97 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.9 MiB/s wr, 179 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:31 smithi078 ceph-mon[94114]: pgmap v3056: 97 pgs: 97 active+clean; 94 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:32 smithi078 ceph-mon[94114]: pgmap v3057: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.9 MiB/s wr, 177 op/s 2023-03-17T12:34:55.478 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:35 smithi078 ceph-mon[94114]: pgmap v3058: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.4 MiB/s wr, 118 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:37 smithi078 ceph-mon[94114]: pgmap v3059: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.4 MiB/s wr, 118 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:39 smithi078 ceph-mon[94114]: pgmap v3060: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.9 MiB/s wr, 176 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:41 smithi078 ceph-mon[94114]: pgmap v3061: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:42 smithi078 ceph-mon[94114]: pgmap v3062: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.3 MiB/s wr, 127 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:42 smithi078 ceph-mon[94114]: pgmap v3063: 97 pgs: 97 active+clean; 92 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 675 KiB/s wr, 79 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:44 smithi078 ceph-mon[94114]: pgmap v3064: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:46 smithi078 ceph-mon[94114]: pgmap v3065: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.7 MiB/s wr, 162 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:47 smithi078 ceph-mon[94114]: pgmap v3066: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.7 MiB/s wr, 154 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:50 smithi078 ceph-mon[94114]: pgmap v3067: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 1.9 MiB/s wr, 157 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:52 smithi078 ceph-mon[94114]: pgmap v3068: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 1.7 MiB/s wr, 139 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:54 smithi078 ceph-mon[94114]: pgmap v3069: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 1.9 MiB/s wr, 176 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:56 smithi078 ceph-mon[94114]: pgmap v3070: 97 pgs: 97 active+clean; 96 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 115 op/s 2023-03-17T12:34:55.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:19:57 smithi078 ceph-mon[94114]: pgmap v3071: 97 pgs: 97 active+clean; 100 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.7 MiB/s wr, 176 op/s 2023-03-17T12:34:55.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:00 smithi078 ceph-mon[94114]: pgmap v3072: 97 pgs: 97 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.4 MiB/s wr, 123 op/s 2023-03-17T12:34:55.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:34:55.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:02 smithi078 ceph-mon[94114]: pgmap v3073: 97 pgs: 97 active+clean; 101 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2023-03-17T12:34:55.480 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:04 smithi078 ceph-mon[94114]: pgmap v3074: 97 pgs: 97 active+clean; 104 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.9 MiB/s wr, 190 op/s 2023-03-17T12:34:57.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:05 smithi078 ceph-mon[94114]: osdmap e267: 12 total, 12 up, 12 in 2023-03-17T12:34:57.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:06 smithi078 ceph-mon[94114]: pgmap v3076: 97 pgs: 97 active+clean; 104 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 1.7 MiB/s wr, 155 op/s 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:07 smithi078 ceph-mon[94114]: pgmap v3077: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 150 op/s 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:10 smithi078 ceph-mon[94114]: pgmap v3078: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.5 MiB/s wr, 152 op/s 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:12 smithi078 ceph-mon[94114]: pgmap v3079: 97 pgs: 97 active+clean; 106 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.5 MiB/s wr, 152 op/s 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:12 smithi078 ceph-mon[94114]: osdmap e268: 12 total, 12 up, 12 in 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:14 smithi078 ceph-mon[94114]: pgmap v3081: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 1.7 MiB/s wr, 160 op/s 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:16 smithi078 ceph-mon[94114]: pgmap v3082: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 1.5 MiB/s wr, 143 op/s 2023-03-17T12:34:57.004 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:17 smithi078 ceph-mon[94114]: pgmap v3083: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.6 MiB/s wr, 139 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:20 smithi078 ceph-mon[94114]: pgmap v3084: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:22 smithi078 ceph-mon[94114]: pgmap v3085: 97 pgs: 97 active+clean; 114 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:24 smithi078 ceph-mon[94114]: pgmap v3086: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.9 MiB/s wr, 179 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:26 smithi078 ceph-mon[94114]: pgmap v3087: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:27 smithi078 ceph-mon[94114]: pgmap v3088: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 1.8 MiB/s wr, 171 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:30 smithi078 ceph-mon[94114]: pgmap v3089: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:32 smithi078 ceph-mon[94114]: pgmap v3090: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:34:57.005 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:34 smithi078 ceph-mon[94114]: pgmap v3091: 97 pgs: 97 active+clean; 122 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T12:34:57.936 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:36 smithi078 ceph-mon[94114]: pgmap v3092: 97 pgs: 97 active+clean; 122 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.5 MiB/s wr, 113 op/s 2023-03-17T12:34:57.937 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:37 smithi078 ceph-mon[94114]: pgmap v3093: 97 pgs: 97 active+clean; 124 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.9 MiB/s wr, 170 op/s 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:40 smithi078 ceph-mon[94114]: pgmap v3094: 97 pgs: 97 active+clean; 123 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 1.4 MiB/s wr, 113 op/s 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:42 smithi078 ceph-mon[94114]: pgmap v3095: 97 pgs: 97 active+clean; 123 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:01.625 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:44 smithi078 ceph-mon[94114]: pgmap v3096: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.1 MiB/s wr, 180 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:44 smithi078 ceph-mon[94114]: pgmap v3097: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:46 smithi078 ceph-mon[94114]: pgmap v3098: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:48 smithi078 ceph-mon[94114]: pgmap v3099: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:50 smithi078 ceph-mon[94114]: pgmap v3100: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.8 MiB/s wr, 141 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:52 smithi078 ceph-mon[94114]: pgmap v3101: 97 pgs: 97 active+clean; 130 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.8 MiB/s wr, 141 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:54 smithi078 ceph-mon[94114]: pgmap v3102: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.4 MiB/s wr, 136 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:56 smithi078 ceph-mon[94114]: pgmap v3103: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:20:58 smithi078 ceph-mon[94114]: pgmap v3104: 97 pgs: 97 active+clean; 131 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:00 smithi078 ceph-mon[94114]: pgmap v3105: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 1.9 MiB/s wr, 169 op/s 2023-03-17T12:35:01.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:02 smithi078 ceph-mon[94114]: pgmap v3106: 97 pgs: 97 active+clean; 137 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.3 MiB/s wr, 117 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:04 smithi078 ceph-mon[94114]: pgmap v3107: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.0 MiB/s wr, 187 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:05 smithi078 ceph-mon[94114]: osdmap e269: 12 total, 12 up, 12 in 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:06 smithi078 ceph-mon[94114]: pgmap v3109: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 150 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:08 smithi078 ceph-mon[94114]: pgmap v3110: 97 pgs: 97 active+clean; 139 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.7 MiB/s wr, 150 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:10 smithi078 ceph-mon[94114]: pgmap v3111: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:12 smithi078 ceph-mon[94114]: pgmap v3112: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.6 MiB/s wr, 156 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:12 smithi078 ceph-mon[94114]: osdmap e270: 12 total, 12 up, 12 in 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:14 smithi078 ceph-mon[94114]: pgmap v3114: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 2.0 MiB/s wr, 170 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:16 smithi078 ceph-mon[94114]: pgmap v3115: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:18 smithi078 ceph-mon[94114]: pgmap v3116: 97 pgs: 97 active+clean; 146 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:20 smithi078 ceph-mon[94114]: pgmap v3117: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:22 smithi078 ceph-mon[94114]: pgmap v3118: 97 pgs: 97 active+clean; 149 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.7 MiB/s wr, 136 op/s 2023-03-17T12:35:01.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:24 smithi078 ceph-mon[94114]: pgmap v3119: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 2.2 MiB/s wr, 187 op/s 2023-03-17T12:35:03.885 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:26 smithi078 ceph-mon[94114]: pgmap v3120: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2023-03-17T12:35:03.885 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:28 smithi078 ceph-mon[94114]: pgmap v3121: 97 pgs: 97 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2023-03-17T12:35:03.885 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:30 smithi078 ceph-mon[94114]: pgmap v3122: 97 pgs: 97 active+clean; 155 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:32 smithi078 ceph-mon[94114]: pgmap v3123: 97 pgs: 97 active+clean; 155 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:34 smithi078 ceph-mon[94114]: pgmap v3124: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 2.0 MiB/s wr, 171 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:36 smithi078 ceph-mon[94114]: pgmap v3125: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:38 smithi078 ceph-mon[94114]: pgmap v3126: 97 pgs: 97 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:40 smithi078 ceph-mon[94114]: pgmap v3127: 97 pgs: 97 active+clean; 162 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 2.0 MiB/s wr, 169 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:42 smithi078 ceph-mon[94114]: pgmap v3128: 97 pgs: 97 active+clean; 162 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.3 MiB/s wr, 112 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:44 smithi078 ceph-mon[94114]: pgmap v3129: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:44 smithi078 ceph-mon[94114]: pgmap v3130: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.5 MiB/s wr, 127 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:44 smithi078 ceph-mon[94114]: pgmap v3131: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:46 smithi078 ceph-mon[94114]: pgmap v3132: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:47 smithi078 ceph-mon[94114]: pgmap v3133: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.6 MiB/s wr, 155 op/s 2023-03-17T12:35:03.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:50 smithi078 ceph-mon[94114]: pgmap v3134: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 1.6 MiB/s wr, 155 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:52 smithi078 ceph-mon[94114]: pgmap v3135: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 698 KiB/s wr, 74 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:54 smithi078 ceph-mon[94114]: pgmap v3136: 97 pgs: 97 active+clean; 130 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:56 smithi078 ceph-mon[94114]: pgmap v3137: 97 pgs: 97 active+clean; 130 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.3 MiB/s wr, 115 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:21:57 smithi078 ceph-mon[94114]: pgmap v3138: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 2.0 MiB/s wr, 172 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:00 smithi078 ceph-mon[94114]: pgmap v3139: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:02 smithi078 ceph-mon[94114]: pgmap v3140: 97 pgs: 97 active+clean; 128 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.5 MiB/s wr, 117 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:04 smithi078 ceph-mon[94114]: pgmap v3141: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.0 MiB/s wr, 190 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:05 smithi078 ceph-mon[94114]: osdmap e271: 12 total, 12 up, 12 in 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:06 smithi078 ceph-mon[94114]: pgmap v3143: 97 pgs: 97 active+clean; 129 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 1.5 MiB/s wr, 155 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:07 smithi078 ceph-mon[94114]: pgmap v3144: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:10 smithi078 ceph-mon[94114]: pgmap v3145: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:12 smithi078 ceph-mon[94114]: pgmap v3146: 97 pgs: 97 active+clean; 128 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 1.6 MiB/s wr, 163 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:12 smithi078 ceph-mon[94114]: osdmap e272: 12 total, 12 up, 12 in 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:13 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:13 smithi078 ceph-mon[94114]: pgmap v3148: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.9 MiB/s wr, 155 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:16 smithi078 ceph-mon[94114]: pgmap v3149: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 1.7 MiB/s wr, 139 op/s 2023-03-17T12:35:03.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:17 smithi078 ceph-mon[94114]: pgmap v3150: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:19 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:19 smithi078 ceph-mon[94114]: pgmap v3151: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:22 smithi078 ceph-mon[94114]: pgmap v3152: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.4 MiB/s wr, 132 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:23 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:23 smithi078 ceph-mon[94114]: pgmap v3153: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.7 MiB/s wr, 153 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:24 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:25 smithi078 ceph-mon[94114]: pgmap v3154: 97 pgs: 97 active+clean; 130 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.0 MiB/s wr, 97 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:27 smithi078 ceph-mon[94114]: pgmap v3155: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.2 MiB/s wr, 110 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:30 smithi078 ceph-mon[94114]: pgmap v3156: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 677 KiB/s wr, 52 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:32 smithi078 ceph-mon[94114]: pgmap v3157: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 677 KiB/s wr, 52 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:33 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:33 smithi078 ceph-mon[94114]: pgmap v3158: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.1 MiB/s wr, 108 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:36 smithi078 ceph-mon[94114]: pgmap v3159: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 599 KiB/s wr, 68 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:37 smithi078 ceph-mon[94114]: pgmap v3160: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:40 smithi078 ceph-mon[94114]: pgmap v3161: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 918 KiB/s wr, 90 op/s 2023-03-17T12:35:03.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:42 smithi078 ceph-mon[94114]: pgmap v3162: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 918 KiB/s wr, 90 op/s 2023-03-17T12:35:05.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:44 smithi078 ceph-mon[94114]: pgmap v3163: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 955 KiB/s wr, 100 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:45 smithi078 ceph-mon[94114]: pgmap v3164: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 544 KiB/s wr, 49 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:45 smithi078 ceph-mon[94114]: pgmap v3165: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 667 KiB/s wr, 60 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:47 smithi078 ceph-mon[94114]: pgmap v3166: 97 pgs: 97 active+clean; 131 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 KiB/s wr, 12 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:49 smithi078 ceph-mon[94114]: pgmap v3167: 97 pgs: 97 active+clean; 134 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 665 KiB/s wr, 70 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:51 smithi078 ceph-mon[94114]: pgmap v3168: 97 pgs: 97 active+clean; 134 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 665 KiB/s wr, 70 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:52 smithi078 ceph-mon[94114]: pgmap v3169: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T12:35:05.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:55 smithi078 ceph-mon[94114]: pgmap v3170: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.2 MiB/s wr, 105 op/s 2023-03-17T12:35:05.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:57 smithi078 ceph-mon[94114]: pgmap v3171: 97 pgs: 97 active+clean; 135 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 1004 KiB/s wr, 87 op/s 2023-03-17T12:35:05.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:22:59 smithi078 ceph-mon[94114]: pgmap v3172: 97 pgs: 97 active+clean; 136 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.0 MiB/s wr, 98 op/s 2023-03-17T12:35:05.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:01 smithi078 ceph-mon[94114]: pgmap v3173: 97 pgs: 97 active+clean; 136 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 590 KiB/s wr, 56 op/s 2023-03-17T12:35:05.194 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:02 smithi078 ceph-mon[94114]: pgmap v3174: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 751 KiB/s wr, 81 op/s 2023-03-17T12:35:05.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:04 smithi078 ceph-mon[94114]: osdmap e273: 12 total, 12 up, 12 in 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:04 smithi078 ceph-mon[94114]: pgmap v3176: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 241 KiB/s wr, 43 op/s 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:07 smithi078 ceph-mon[94114]: pgmap v3177: 97 pgs: 97 active+clean; 137 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 241 KiB/s wr, 43 op/s 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:09 smithi078 ceph-mon[94114]: pgmap v3178: 97 pgs: 97 active+clean; 139 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 762 KiB/s wr, 93 op/s 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:11 smithi078 ceph-mon[94114]: pgmap v3179: 97 pgs: 97 active+clean; 139 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 762 KiB/s wr, 93 op/s 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:12 smithi078 ceph-mon[94114]: osdmap e274: 12 total, 12 up, 12 in 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:12 smithi078 ceph-mon[94114]: pgmap v3181: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:15 smithi078 ceph-mon[94114]: pgmap v3182: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T12:35:05.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:17 smithi078 ceph-mon[94114]: pgmap v3183: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T12:35:05.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:19 smithi078 ceph-mon[94114]: pgmap v3184: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 605 KiB/s wr, 50 op/s 2023-03-17T12:35:05.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:21 smithi078 ceph-mon[94114]: pgmap v3185: 97 pgs: 97 active+clean; 143 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 605 KiB/s wr, 50 op/s 2023-03-17T12:35:05.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:22 smithi078 ceph-mon[94114]: pgmap v3186: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2023-03-17T12:35:05.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:25 smithi078 ceph-mon[94114]: pgmap v3187: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 552 KiB/s wr, 63 op/s 2023-03-17T12:35:05.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:27 smithi078 ceph-mon[94114]: pgmap v3188: 97 pgs: 97 active+clean; 144 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 552 KiB/s wr, 63 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:29 smithi078 ceph-mon[94114]: pgmap v3189: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.0 MiB/s wr, 98 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:31 smithi078 ceph-mon[94114]: pgmap v3190: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:32 smithi078 ceph-mon[94114]: pgmap v3191: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:35 smithi078 ceph-mon[94114]: pgmap v3192: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 553 KiB/s wr, 44 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:37 smithi078 ceph-mon[94114]: pgmap v3193: 97 pgs: 97 active+clean; 148 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 553 KiB/s wr, 44 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:39 smithi078 ceph-mon[94114]: pgmap v3194: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.0 MiB/s wr, 100 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:41 smithi078 ceph-mon[94114]: pgmap v3195: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 563 KiB/s wr, 65 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:42 smithi078 ceph-mon[94114]: pgmap v3196: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 101 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:45 smithi078 ceph-mon[94114]: pgmap v3197: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 1.0 MiB/s wr, 91 op/s 2023-03-17T12:35:07.975 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:46 smithi078 ceph-mon[94114]: pgmap v3198: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:46 smithi078 ceph-mon[94114]: pgmap v3199: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.4 MiB/s wr, 124 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:47 smithi078 ceph-mon[94114]: pgmap v3200: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 747 KiB/s wr, 62 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:49 smithi078 ceph-mon[94114]: pgmap v3201: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 748 KiB/s wr, 62 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:51 smithi078 ceph-mon[94114]: pgmap v3202: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 51 KiB/s wr, 13 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:53 smithi078 ceph-mon[94114]: pgmap v3203: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 790 KiB/s wr, 91 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:55 smithi078 ceph-mon[94114]: pgmap v3204: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 697 KiB/s wr, 80 op/s 2023-03-17T12:35:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:57 smithi078 ceph-mon[94114]: pgmap v3205: 97 pgs: 97 active+clean; 157 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 933 KiB/s wr, 99 op/s 2023-03-17T12:35:08.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:23:59 smithi078 ceph-mon[94114]: pgmap v3206: 97 pgs: 97 active+clean; 158 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.0 MiB/s wr, 90 op/s 2023-03-17T12:35:08.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:01 smithi078 ceph-mon[94114]: pgmap v3207: 97 pgs: 97 active+clean; 158 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 1.0 MiB/s wr, 89 op/s 2023-03-17T12:35:08.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:03 smithi078 ceph-mon[94114]: pgmap v3208: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2023-03-17T12:35:08.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:04 smithi078 ceph-mon[94114]: osdmap e275: 12 total, 12 up, 12 in 2023-03-17T12:35:08.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:05 smithi078 ceph-mon[94114]: pgmap v3210: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 647 KiB/s wr, 53 op/s 2023-03-17T12:35:08.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:07 smithi078 ceph-mon[94114]: pgmap v3211: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 841 KiB/s wr, 95 op/s 2023-03-17T12:35:08.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:09 smithi078 ceph-mon[94114]: pgmap v3212: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 775 KiB/s wr, 96 op/s 2023-03-17T12:35:08.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:11 smithi078 ceph-mon[94114]: pgmap v3213: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 775 KiB/s wr, 96 op/s 2023-03-17T12:35:08.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:11 smithi078 ceph-mon[94114]: osdmap e276: 12 total, 12 up, 12 in 2023-03-17T12:35:08.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:13 smithi078 ceph-mon[94114]: pgmap v3215: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 1.5 MiB/s wr, 138 op/s 2023-03-17T12:35:09.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:15 smithi078 ceph-mon[94114]: pgmap v3216: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.3 MiB/s wr, 123 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:17 smithi078 ceph-mon[94114]: pgmap v3217: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 792 KiB/s wr, 53 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:18 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:19 smithi078 ceph-mon[94114]: pgmap v3218: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 692 KiB/s wr, 52 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:21 smithi078 ceph-mon[94114]: pgmap v3219: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 692 KiB/s wr, 52 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:23 smithi078 ceph-mon[94114]: pgmap v3220: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 734 KiB/s wr, 56 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:25 smithi078 ceph-mon[94114]: pgmap v3221: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 169 KiB/s wr, 19 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:27 smithi078 ceph-mon[94114]: pgmap v3222: 97 pgs: 97 active+clean; 168 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 637 KiB/s wr, 73 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:29 smithi078 ceph-mon[94114]: pgmap v3223: 97 pgs: 97 active+clean; 167 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 686 KiB/s wr, 66 op/s 2023-03-17T12:35:09.690 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:31 smithi078 ceph-mon[94114]: pgmap v3224: 97 pgs: 97 active+clean; 167 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 681 KiB/s wr, 66 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:33 smithi078 ceph-mon[94114]: pgmap v3225: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:35 smithi078 ceph-mon[94114]: pgmap v3226: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 980 KiB/s wr, 85 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:37 smithi078 ceph-mon[94114]: pgmap v3227: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1012 KiB/s wr, 94 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:39 smithi078 ceph-mon[94114]: pgmap v3228: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 547 KiB/s wr, 41 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:41 smithi078 ceph-mon[94114]: pgmap v3229: 97 pgs: 97 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 459 KiB/s wr, 39 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:43 smithi078 ceph-mon[94114]: pgmap v3230: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 588 KiB/s wr, 50 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:45 smithi078 ceph-mon[94114]: pgmap v3231: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 163 KiB/s wr, 20 op/s 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:09.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:11.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:11.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:46 smithi078 ceph-mon[94114]: pgmap v3232: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 180 KiB/s wr, 22 op/s 2023-03-17T12:35:11.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:46 smithi078 ceph-mon[94114]: pgmap v3233: 97 pgs: 97 active+clean; 172 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 178 KiB/s wr, 15 op/s 2023-03-17T12:35:11.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:48 smithi078 ceph-mon[94114]: pgmap v3234: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 946 KiB/s wr, 91 op/s 2023-03-17T12:35:11.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:50 smithi078 ceph-mon[94114]: pgmap v3235: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 946 KiB/s wr, 91 op/s 2023-03-17T12:35:11.139 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:52 smithi078 ceph-mon[94114]: pgmap v3236: 97 pgs: 97 active+clean; 173 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 771 KiB/s wr, 76 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:54 smithi078 ceph-mon[94114]: pgmap v3237: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:56 smithi078 ceph-mon[94114]: pgmap v3238: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:24:58 smithi078 ceph-mon[94114]: pgmap v3239: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:00 smithi078 ceph-mon[94114]: pgmap v3240: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 468 KiB/s wr, 47 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:02 smithi078 ceph-mon[94114]: pgmap v3241: 97 pgs: 97 active+clean; 149 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 468 KiB/s wr, 47 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:04 smithi078 ceph-mon[94114]: osdmap e277: 12 total, 12 up, 12 in 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:04 smithi078 ceph-mon[94114]: pgmap v3243: 97 pgs: 97 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 702 KiB/s wr, 95 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:06 smithi078 ceph-mon[94114]: pgmap v3244: 97 pgs: 97 active+clean; 150 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 702 KiB/s wr, 95 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:08 smithi078 ceph-mon[94114]: pgmap v3245: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-03-17T12:35:11.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:10 smithi078 ceph-mon[94114]: pgmap v3246: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2023-03-17T12:35:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:12 smithi078 ceph-mon[94114]: osdmap e278: 12 total, 12 up, 12 in 2023-03-17T12:35:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:12 smithi078 ceph-mon[94114]: pgmap v3248: 97 pgs: 97 active+clean; 151 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 762 KiB/s wr, 55 op/s 2023-03-17T12:35:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:14 smithi078 ceph-mon[94114]: pgmap v3249: 97 pgs: 97 active+clean; 152 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 679 KiB/s wr, 57 op/s 2023-03-17T12:35:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:16 smithi078 ceph-mon[94114]: pgmap v3250: 97 pgs: 97 active+clean; 152 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 679 KiB/s wr, 57 op/s 2023-03-17T12:35:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:18 smithi078 ceph-mon[94114]: pgmap v3251: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 704 KiB/s wr, 83 op/s 2023-03-17T12:35:14.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:18 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:14.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:20 smithi078 ceph-mon[94114]: pgmap v3252: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 704 KiB/s wr, 83 op/s 2023-03-17T12:35:14.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:22 smithi078 ceph-mon[94114]: pgmap v3253: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 682 KiB/s wr, 81 op/s 2023-03-17T12:35:14.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:23 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:14.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:24 smithi078 ceph-mon[94114]: pgmap v3254: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 1.1 MiB/s wr, 106 op/s 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:26 smithi078 ceph-mon[94114]: pgmap v3255: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.0 MiB/s wr, 96 op/s 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:28 smithi078 ceph-mon[94114]: pgmap v3256: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 1.1 MiB/s wr, 107 op/s 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:30 smithi078 ceph-mon[94114]: pgmap v3257: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 552 KiB/s wr, 46 op/s 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:32 smithi078 ceph-mon[94114]: pgmap v3258: 97 pgs: 97 active+clean; 153 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 552 KiB/s wr, 46 op/s 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:33 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:34 smithi078 ceph-mon[94114]: pgmap v3259: 97 pgs: 97 active+clean; 155 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 863 KiB/s wr, 81 op/s 2023-03-17T12:35:14.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:36 smithi078 ceph-mon[94114]: pgmap v3260: 97 pgs: 97 active+clean; 155 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 353 KiB/s wr, 44 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:38 smithi078 ceph-mon[94114]: pgmap v3261: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 968 KiB/s wr, 97 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:40 smithi078 ceph-mon[94114]: pgmap v3262: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 926 KiB/s wr, 86 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:42 smithi078 ceph-mon[94114]: pgmap v3263: 97 pgs: 97 active+clean; 157 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 926 KiB/s wr, 86 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:44 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:44 smithi078 ceph-mon[94114]: pgmap v3264: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 1.0 MiB/s wr, 103 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:46 smithi078 ceph-mon[94114]: pgmap v3265: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 752 KiB/s wr, 69 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:47 smithi078 ceph-mon[94114]: pgmap v3266: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 832 KiB/s wr, 76 op/s 2023-03-17T12:35:16.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:47 smithi078 ceph-mon[94114]: pgmap v3267: 97 pgs: 97 active+clean; 158 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 185 KiB/s wr, 22 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:49 smithi078 ceph-mon[94114]: pgmap v3268: 97 pgs: 97 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 581 KiB/s wr, 65 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:51 smithi078 ceph-mon[94114]: pgmap v3269: 97 pgs: 97 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 581 KiB/s wr, 65 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:53 smithi078 ceph-mon[94114]: pgmap v3270: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:55 smithi078 ceph-mon[94114]: pgmap v3271: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:57 smithi078 ceph-mon[94114]: pgmap v3272: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.1 MiB/s wr, 104 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:25:59 smithi078 ceph-mon[94114]: pgmap v3273: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.0 MiB/s wr, 102 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:01 smithi078 ceph-mon[94114]: pgmap v3274: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 761 KiB/s wr, 70 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:03 smithi078 ceph-mon[94114]: pgmap v3275: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 1.1 MiB/s wr, 117 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:04 smithi078 ceph-mon[94114]: osdmap e279: 12 total, 12 up, 12 in 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:05 smithi078 ceph-mon[94114]: pgmap v3277: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 527 KiB/s wr, 74 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:07 smithi078 ceph-mon[94114]: pgmap v3278: 97 pgs: 97 active+clean; 165 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 527 KiB/s wr, 74 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:09 smithi078 ceph-mon[94114]: pgmap v3279: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:11 smithi078 ceph-mon[94114]: pgmap v3280: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 1.2 MiB/s wr, 120 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:11 smithi078 ceph-mon[94114]: osdmap e280: 12 total, 12 up, 12 in 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:13 smithi078 ceph-mon[94114]: pgmap v3282: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.0 MiB/s wr, 94 op/s 2023-03-17T12:35:16.640 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:15 smithi078 ceph-mon[94114]: pgmap v3283: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 943 KiB/s wr, 84 op/s 2023-03-17T12:35:16.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:17 smithi078 ceph-mon[94114]: pgmap v3284: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 943 KiB/s wr, 84 op/s 2023-03-17T12:35:16.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:19 smithi078 ceph-mon[94114]: pgmap v3285: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 30 op/s 2023-03-17T12:35:16.641 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:21 smithi078 ceph-mon[94114]: pgmap v3286: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 227 KiB/s wr, 30 op/s 2023-03-17T12:35:17.904 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:23 smithi078 ceph-mon[94114]: pgmap v3287: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 783 KiB/s wr, 89 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:25 smithi078 ceph-mon[94114]: pgmap v3288: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 585 KiB/s wr, 66 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:27 smithi078 ceph-mon[94114]: pgmap v3289: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 585 KiB/s wr, 66 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:29 smithi078 ceph-mon[94114]: pgmap v3290: 97 pgs: 97 active+clean; 173 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 1.1 MiB/s wr, 103 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:31 smithi078 ceph-mon[94114]: pgmap v3291: 97 pgs: 97 active+clean; 173 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.0 MiB/s wr, 93 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:33 smithi078 ceph-mon[94114]: pgmap v3292: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 8.0 MiB/s wr, 148 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:35 smithi078 ceph-mon[94114]: pgmap v3293: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 7.5 MiB/s wr, 90 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:36 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:37 smithi078 ceph-mon[94114]: pgmap v3294: 97 pgs: 97 active+clean; 255 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 7.5 MiB/s wr, 90 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:39 smithi078 ceph-mon[94114]: pgmap v3295: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 18 MiB/s wr, 217 op/s 2023-03-17T12:35:17.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:41 smithi078 ceph-mon[94114]: pgmap v3296: 97 pgs: 97 active+clean; 379 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 18 MiB/s wr, 181 op/s 2023-03-17T12:35:17.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:41 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:17.906 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:43 smithi078 ceph-mon[94114]: pgmap v3297: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 19 MiB/s wr, 270 op/s 2023-03-17T12:35:18.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:44 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:18.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:45 smithi078 ceph-mon[94114]: pgmap v3298: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 12 MiB/s wr, 215 op/s 2023-03-17T12:35:18.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:47 smithi078 ceph-mon[94114]: pgmap v3299: 97 pgs: 97 active+clean; 384 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 12 MiB/s wr, 215 op/s 2023-03-17T12:35:18.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:48 smithi078 ceph-mon[94114]: pgmap v3300: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 326 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:48 smithi078 ceph-mon[94114]: pgmap v3301: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:50 smithi078 ceph-mon[94114]: pgmap v3302: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 228 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:52 smithi078 ceph-mon[94114]: pgmap v3303: 97 pgs: 97 active+clean; 392 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 2.0 MiB/s wr, 109 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:54 smithi078 ceph-mon[94114]: pgmap v3304: 97 pgs: 97 active+clean; 414 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.3 MiB/s wr, 223 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:56 smithi078 ceph-mon[94114]: pgmap v3305: 97 pgs: 97 active+clean; 414 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.3 MiB/s wr, 223 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:26:58 smithi078 ceph-mon[94114]: pgmap v3306: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.4 MiB/s wr, 249 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:00 smithi078 ceph-mon[94114]: pgmap v3307: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:02 smithi078 ceph-mon[94114]: pgmap v3308: 97 pgs: 97 active+clean; 400 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T12:35:18.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:04 smithi078 ceph-mon[94114]: osdmap e281: 12 total, 12 up, 12 in 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:04 smithi078 ceph-mon[94114]: pgmap v3310: 97 pgs: 97 active+clean; 385 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:06 smithi078 ceph-mon[94114]: pgmap v3311: 97 pgs: 97 active+clean; 385 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 320 op/s 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:08 smithi078 ceph-mon[94114]: pgmap v3312: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:10 smithi078 ceph-mon[94114]: pgmap v3313: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:12 smithi078 ceph-mon[94114]: osdmap e282: 12 total, 12 up, 12 in 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:12 smithi078 ceph-mon[94114]: pgmap v3315: 97 pgs: 97 active+clean; 391 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.6 MiB/s wr, 149 op/s 2023-03-17T12:35:19.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:14 smithi078 ceph-mon[94114]: pgmap v3316: 97 pgs: 97 active+clean; 407 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2023-03-17T12:35:20.145 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:16 smithi078 ceph-mon[94114]: pgmap v3317: 97 pgs: 97 active+clean; 407 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2023-03-17T12:35:20.145 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:18 smithi078 ceph-mon[94114]: pgmap v3318: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2023-03-17T12:35:20.145 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:20 smithi078 ceph-mon[94114]: pgmap v3319: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 227 op/s 2023-03-17T12:35:20.145 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:22 smithi078 ceph-mon[94114]: pgmap v3320: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 225 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:24 smithi078 ceph-mon[94114]: pgmap v3321: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.4 MiB/s wr, 313 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:26 smithi078 ceph-mon[94114]: pgmap v3322: 97 pgs: 97 active+clean; 423 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.3 MiB/s wr, 211 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:28 smithi078 ceph-mon[94114]: pgmap v3323: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 336 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:30 smithi078 ceph-mon[94114]: pgmap v3324: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:32 smithi078 ceph-mon[94114]: pgmap v3325: 97 pgs: 97 active+clean; 416 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:34 smithi078 ceph-mon[94114]: pgmap v3326: 97 pgs: 97 active+clean; 424 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 349 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:36 smithi078 ceph-mon[94114]: pgmap v3327: 97 pgs: 97 active+clean; 424 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 2.9 MiB/s wr, 226 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:38 smithi078 ceph-mon[94114]: pgmap v3328: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:40 smithi078 ceph-mon[94114]: pgmap v3329: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:42 smithi078 ceph-mon[94114]: pgmap v3330: 97 pgs: 97 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 3.8 MiB/s wr, 203 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:44 smithi078 ceph-mon[94114]: pgmap v3331: 97 pgs: 97 active+clean; 448 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 295 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:46 smithi078 ceph-mon[94114]: pgmap v3332: 97 pgs: 97 active+clean; 448 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 194 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:48 smithi078 ceph-mon[94114]: pgmap v3333: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 310 op/s 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:48 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:20.146 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:20.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:49 smithi078 ceph-mon[94114]: pgmap v3334: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 219 op/s 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:49 smithi078 ceph-mon[94114]: pgmap v3335: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 265 op/s 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:52 smithi078 ceph-mon[94114]: pgmap v3336: 97 pgs: 97 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 265 op/s 2023-03-17T12:35:21.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:54 smithi078 ceph-mon[94114]: pgmap v3337: 97 pgs: 97 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2023-03-17T12:35:22.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:56 smithi078 ceph-mon[94114]: pgmap v3338: 97 pgs: 97 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2023-03-17T12:35:22.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:27:57 smithi078 ceph-mon[94114]: pgmap v3339: 97 pgs: 97 active+clean; 452 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2023-03-17T12:35:22.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:00 smithi078 ceph-mon[94114]: pgmap v3340: 97 pgs: 97 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 264 op/s 2023-03-17T12:35:23.275 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:02 smithi078 ceph-mon[94114]: pgmap v3341: 97 pgs: 97 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 3.1 MiB/s wr, 220 op/s 2023-03-17T12:35:23.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:04 smithi078 ceph-mon[94114]: pgmap v3342: 97 pgs: 97 active+clean; 468 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.6 MiB/s wr, 328 op/s 2023-03-17T12:35:23.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:05 smithi078 ceph-mon[94114]: osdmap e283: 12 total, 12 up, 12 in 2023-03-17T12:35:23.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:06 smithi078 ceph-mon[94114]: pgmap v3344: 97 pgs: 97 active+clean; 468 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.0 MiB/s wr, 242 op/s 2023-03-17T12:35:23.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:07 smithi078 ceph-mon[94114]: pgmap v3345: 97 pgs: 97 active+clean; 484 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 254 op/s 2023-03-17T12:35:23.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:10 smithi078 ceph-mon[94114]: pgmap v3346: 97 pgs: 97 active+clean; 485 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 255 op/s 2023-03-17T12:35:23.276 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:12 smithi078 ceph-mon[94114]: pgmap v3347: 97 pgs: 97 active+clean; 485 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.3 MiB/s wr, 255 op/s 2023-03-17T12:35:24.016 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:12 smithi078 ceph-mon[94114]: osdmap e284: 12 total, 12 up, 12 in 2023-03-17T12:35:24.016 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:14 smithi078 ceph-mon[94114]: pgmap v3349: 97 pgs: 97 active+clean; 494 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 292 op/s 2023-03-17T12:35:24.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:16 smithi078 ceph-mon[94114]: pgmap v3350: 97 pgs: 97 active+clean; 494 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 261 op/s 2023-03-17T12:35:24.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:17 smithi078 ceph-mon[94114]: pgmap v3351: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 258 op/s 2023-03-17T12:35:24.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:20 smithi078 ceph-mon[94114]: pgmap v3352: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 259 op/s 2023-03-17T12:35:24.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:22 smithi078 ceph-mon[94114]: pgmap v3353: 97 pgs: 97 active+clean; 504 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 259 op/s 2023-03-17T12:35:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:23 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:23 smithi078 ceph-mon[94114]: pgmap v3354: 97 pgs: 97 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 326 op/s 2023-03-17T12:35:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:26 smithi078 ceph-mon[94114]: pgmap v3355: 97 pgs: 97 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 4.0 MiB/s wr, 200 op/s 2023-03-17T12:35:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:27 smithi078 ceph-mon[94114]: pgmap v3356: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.9 MiB/s wr, 287 op/s 2023-03-17T12:35:25.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:30 smithi078 ceph-mon[94114]: pgmap v3357: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 206 op/s 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:31 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:32 smithi078 ceph-mon[94114]: pgmap v3358: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 199 op/s 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:34 smithi078 ceph-mon[94114]: pgmap v3359: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 311 op/s 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:34 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:36 smithi078 ceph-mon[94114]: pgmap v3360: 97 pgs: 97 active+clean; 529 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 214 op/s 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:37 smithi078 ceph-mon[94114]: pgmap v3361: 97 pgs: 97 active+clean; 528 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 310 op/s 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:40 smithi078 ceph-mon[94114]: pgmap v3362: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2023-03-17T12:35:25.338 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:42 smithi078 ceph-mon[94114]: pgmap v3363: 97 pgs: 97 active+clean; 527 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 221 op/s 2023-03-17T12:35:25.339 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:44 smithi078 ceph-mon[94114]: pgmap v3364: 97 pgs: 97 active+clean; 541 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 314 op/s 2023-03-17T12:35:26.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:46 smithi078 ceph-mon[94114]: pgmap v3365: 97 pgs: 97 active+clean; 541 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 202 op/s 2023-03-17T12:35:26.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:47 smithi078 ceph-mon[94114]: pgmap v3366: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.7 MiB/s wr, 290 op/s 2023-03-17T12:35:27.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:50 smithi078 ceph-mon[94114]: pgmap v3367: 97 pgs: 97 active+clean; 556 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 198 op/s 2023-03-17T12:35:27.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:27.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:27.225 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:51 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:51 smithi078 ceph-mon[94114]: pgmap v3368: 97 pgs: 97 active+clean; 556 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:27.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:28.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:29.580 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:29.580 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:29.581 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:30.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:30.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:35:30.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:35:30.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: pgmap v3369: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.4 MiB/s wr, 297 op/s 2023-03-17T12:35:31.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:35:31.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:32.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:32.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:32.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:55 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:35:32.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:55 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:35:32.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:55 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:35:32.355 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:55 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:35:32.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:55 smithi078 ceph-mon[94114]: pgmap v3370: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 223 op/s 2023-03-17T12:35:32.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:57 smithi078 ceph-mon[94114]: pgmap v3371: 97 pgs: 97 active+clean; 555 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 223 op/s 2023-03-17T12:35:32.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:28:59 smithi078 ceph-mon[94114]: pgmap v3372: 97 pgs: 97 active+clean; 553 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 250 op/s 2023-03-17T12:35:33.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:01 smithi078 ceph-mon[94114]: pgmap v3373: 97 pgs: 97 active+clean; 553 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 246 op/s 2023-03-17T12:35:33.886 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:02 smithi078 ceph-mon[94114]: pgmap v3374: 97 pgs: 97 active+clean; 565 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.5 MiB/s wr, 362 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:04 smithi078 ceph-mon[94114]: osdmap e285: 12 total, 12 up, 12 in 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:04 smithi078 ceph-mon[94114]: pgmap v3376: 97 pgs: 97 active+clean; 566 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:06 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:06 smithi078 ceph-mon[94114]: pgmap v3377: 97 pgs: 97 active+clean; 566 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:09 smithi078 ceph-mon[94114]: pgmap v3378: 97 pgs: 97 active+clean; 585 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:11 smithi078 ceph-mon[94114]: pgmap v3379: 97 pgs: 97 active+clean; 585 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:12 smithi078 ceph-mon[94114]: osdmap e286: 12 total, 12 up, 12 in 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:12 smithi078 ceph-mon[94114]: pgmap v3381: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 262 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:14 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:14 smithi078 ceph-mon[94114]: pgmap v3382: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 231 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:17 smithi078 ceph-mon[94114]: pgmap v3383: 97 pgs: 97 active+clean; 598 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 231 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:18 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:18 smithi078 ceph-mon[94114]: pgmap v3384: 97 pgs: 97 active+clean; 605 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:21 smithi078 ceph-mon[94114]: pgmap v3385: 97 pgs: 97 active+clean; 605 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 248 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:22 smithi078 ceph-mon[94114]: pgmap v3386: 97 pgs: 97 active+clean; 604 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.4 MiB/s wr, 364 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:25 smithi078 ceph-mon[94114]: pgmap v3387: 97 pgs: 97 active+clean; 602 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 239 op/s 2023-03-17T12:35:33.887 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:27 smithi078 ceph-mon[94114]: pgmap v3388: 97 pgs: 97 active+clean; 602 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.6 MiB/s wr, 232 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:29 smithi078 ceph-mon[94114]: pgmap v3389: 97 pgs: 97 active+clean; 617 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:31 smithi078 ceph-mon[94114]: pgmap v3390: 97 pgs: 97 active+clean; 617 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:32 smithi078 ceph-mon[94114]: pgmap v3391: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 296 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:34 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:34 smithi078 ceph-mon[94114]: pgmap v3392: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 189 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:37 smithi078 ceph-mon[94114]: pgmap v3393: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 182 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:39 smithi078 ceph-mon[94114]: pgmap v3394: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 290 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:40 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:41 smithi078 ceph-mon[94114]: pgmap v3395: 97 pgs: 97 active+clean; 632 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 199 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:42 smithi078 ceph-mon[94114]: pgmap v3396: 97 pgs: 97 active+clean; 634 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 307 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:45 smithi078 ceph-mon[94114]: pgmap v3397: 97 pgs: 97 active+clean; 635 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 228 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:47 smithi078 ceph-mon[94114]: pgmap v3398: 97 pgs: 97 active+clean; 635 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:49 smithi078 ceph-mon[94114]: pgmap v3399: 97 pgs: 97 active+clean; 645 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 334 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:51 smithi078 ceph-mon[94114]: pgmap v3400: 97 pgs: 97 active+clean; 645 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 226 op/s 2023-03-17T12:35:33.888 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:52 smithi078 ceph-mon[94114]: pgmap v3401: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 312 op/s 2023-03-17T12:35:33.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:55 smithi078 ceph-mon[94114]: pgmap v3402: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 209 op/s 2023-03-17T12:35:33.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:56 smithi078 ceph-mon[94114]: pgmap v3403: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 221 op/s 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:56 smithi078 ceph-mon[94114]: pgmap v3404: 97 pgs: 97 active+clean; 657 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 270 op/s 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:29:57 smithi078 ceph-mon[94114]: pgmap v3405: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 270 op/s 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:00 smithi078 ceph-mon[94114]: pgmap v3406: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 270 op/s 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:02 smithi078 ceph-mon[94114]: pgmap v3407: 97 pgs: 97 active+clean; 637 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 2.5 MiB/s wr, 155 op/s 2023-03-17T12:35:34.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:04 smithi078 ceph-mon[94114]: pgmap v3408: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.9 MiB/s wr, 296 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:05 smithi078 ceph-mon[94114]: osdmap e287: 12 total, 12 up, 12 in 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:06 smithi078 ceph-mon[94114]: pgmap v3410: 97 pgs: 97 active+clean; 643 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.4 MiB/s wr, 268 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:07 smithi078 ceph-mon[94114]: pgmap v3411: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:10 smithi078 ceph-mon[94114]: pgmap v3412: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:12 smithi078 ceph-mon[94114]: pgmap v3413: 97 pgs: 97 active+clean; 658 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:12 smithi078 ceph-mon[94114]: osdmap e288: 12 total, 12 up, 12 in 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:14 smithi078 ceph-mon[94114]: pgmap v3415: 97 pgs: 97 active+clean; 674 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 310 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:16 smithi078 ceph-mon[94114]: pgmap v3416: 97 pgs: 97 active+clean; 674 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 277 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:17 smithi078 ceph-mon[94114]: pgmap v3417: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:20 smithi078 ceph-mon[94114]: pgmap v3418: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:22 smithi078 ceph-mon[94114]: pgmap v3419: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 258 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:24 smithi078 ceph-mon[94114]: pgmap v3420: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 340 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:26 smithi078 ceph-mon[94114]: pgmap v3421: 97 pgs: 97 active+clean; 692 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 208 op/s 2023-03-17T12:35:34.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:27 smithi078 ceph-mon[94114]: pgmap v3422: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.8 MiB/s wr, 331 op/s 2023-03-17T12:35:36.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:30 smithi078 ceph-mon[94114]: pgmap v3423: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2023-03-17T12:35:36.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:32 smithi078 ceph-mon[94114]: pgmap v3424: 97 pgs: 97 active+clean; 690 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2023-03-17T12:35:36.268 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:34 smithi078 ceph-mon[94114]: pgmap v3425: 97 pgs: 97 active+clean; 703 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 335 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:36 smithi078 ceph-mon[94114]: pgmap v3426: 97 pgs: 97 active+clean; 703 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:37 smithi078 ceph-mon[94114]: pgmap v3427: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 316 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:40 smithi078 ceph-mon[94114]: pgmap v3428: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 193 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:42 smithi078 ceph-mon[94114]: pgmap v3429: 97 pgs: 97 active+clean; 717 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 193 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:44 smithi078 ceph-mon[94114]: pgmap v3430: 97 pgs: 97 active+clean; 724 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 307 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:46 smithi078 ceph-mon[94114]: pgmap v3431: 97 pgs: 97 active+clean; 724 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:47 smithi078 ceph-mon[94114]: pgmap v3432: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.3 MiB/s wr, 318 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:50 smithi078 ceph-mon[94114]: pgmap v3433: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 225 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:52 smithi078 ceph-mon[94114]: pgmap v3434: 97 pgs: 97 active+clean; 726 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 225 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:54 smithi078 ceph-mon[94114]: pgmap v3435: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 351 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:56 smithi078 ceph-mon[94114]: pgmap v3436: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 237 op/s 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:57 smithi078 ceph-mon[94114]: pgmap v3437: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 241 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:57 smithi078 ceph-mon[94114]: pgmap v3438: 97 pgs: 97 active+clean; 722 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 1.9 MiB/s wr, 155 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:30:59 smithi078 ceph-mon[94114]: pgmap v3439: 97 pgs: 97 active+clean; 738 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 275 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:01 smithi078 ceph-mon[94114]: pgmap v3440: 97 pgs: 97 active+clean; 738 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 275 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:03 smithi078 ceph-mon[94114]: pgmap v3441: 97 pgs: 97 active+clean; 758 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.7 MiB/s wr, 243 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:04 smithi078 ceph-mon[94114]: osdmap e289: 12 total, 12 up, 12 in 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:05 smithi078 ceph-mon[94114]: pgmap v3443: 97 pgs: 97 active+clean; 758 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 298 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:07 smithi078 ceph-mon[94114]: pgmap v3444: 97 pgs: 97 active+clean; 767 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 300 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:09 smithi078 ceph-mon[94114]: pgmap v3445: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 252 op/s 2023-03-17T12:35:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:11 smithi078 ceph-mon[94114]: pgmap v3446: 97 pgs: 97 active+clean; 778 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 252 op/s 2023-03-17T12:35:36.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:11 smithi078 ceph-mon[94114]: osdmap e290: 12 total, 12 up, 12 in 2023-03-17T12:35:36.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:13 smithi078 ceph-mon[94114]: pgmap v3448: 97 pgs: 97 active+clean; 785 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 289 op/s 2023-03-17T12:35:36.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:15 smithi078 ceph-mon[94114]: pgmap v3449: 97 pgs: 97 active+clean; 785 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.5 MiB/s wr, 259 op/s 2023-03-17T12:35:37.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:17 smithi078 ceph-mon[94114]: pgmap v3450: 97 pgs: 97 active+clean; 791 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 280 op/s 2023-03-17T12:35:37.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:19 smithi078 ceph-mon[94114]: pgmap v3451: 97 pgs: 97 active+clean; 792 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 247 op/s 2023-03-17T12:35:37.073 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:21 smithi078 ceph-mon[94114]: pgmap v3452: 97 pgs: 97 active+clean; 792 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 247 op/s 2023-03-17T12:35:37.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:23 smithi078 ceph-mon[94114]: pgmap v3453: 97 pgs: 97 active+clean; 808 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 313 op/s 2023-03-17T12:35:37.074 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:25 smithi078 ceph-mon[94114]: pgmap v3454: 97 pgs: 97 active+clean; 808 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 188 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:27 smithi078 ceph-mon[94114]: pgmap v3455: 97 pgs: 97 active+clean; 822 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 252 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:29 smithi078 ceph-mon[94114]: pgmap v3456: 97 pgs: 97 active+clean; 827 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 215 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:31 smithi078 ceph-mon[94114]: pgmap v3457: 97 pgs: 97 active+clean; 827 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:33 smithi078 ceph-mon[94114]: pgmap v3458: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.0 MiB/s wr, 297 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:35 smithi078 ceph-mon[94114]: pgmap v3459: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 208 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:37 smithi078 ceph-mon[94114]: pgmap v3460: 97 pgs: 97 active+clean; 828 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 287 op/s 2023-03-17T12:35:38.498 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:39 smithi078 ceph-mon[94114]: pgmap v3461: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 257 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:41 smithi078 ceph-mon[94114]: pgmap v3462: 97 pgs: 97 active+clean; 830 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 224 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:43 smithi078 ceph-mon[94114]: pgmap v3463: 97 pgs: 97 active+clean; 841 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 324 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:45 smithi078 ceph-mon[94114]: pgmap v3464: 97 pgs: 97 active+clean; 841 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 211 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:47 smithi078 ceph-mon[94114]: pgmap v3465: 97 pgs: 97 active+clean; 851 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.9 MiB/s wr, 268 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:49 smithi078 ceph-mon[94114]: pgmap v3466: 97 pgs: 97 active+clean; 855 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 218 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:51 smithi078 ceph-mon[94114]: pgmap v3467: 97 pgs: 97 active+clean; 855 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 185 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:53 smithi078 ceph-mon[94114]: pgmap v3468: 97 pgs: 97 active+clean; 870 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 283 op/s 2023-03-17T12:35:39.107 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:55 smithi078 ceph-mon[94114]: pgmap v3469: 97 pgs: 97 active+clean; 870 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 183 op/s 2023-03-17T12:35:39.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:57 smithi078 ceph-mon[94114]: pgmap v3470: 97 pgs: 97 active+clean; 873 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 251 op/s 2023-03-17T12:35:39.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:39.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:31:59 smithi078 ceph-mon[94114]: pgmap v3471: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 226 op/s 2023-03-17T12:35:39.108 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:01 smithi078 ceph-mon[94114]: pgmap v3472: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 197 op/s 2023-03-17T12:35:40.756 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:42.175 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:42.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:01 smithi078 ceph-mon[94114]: pgmap v3473: 97 pgs: 97 active+clean; 875 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 230 op/s 2023-03-17T12:35:42.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:42.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:04 smithi078 ceph-mon[94114]: pgmap v3474: 97 pgs: 97 active+clean; 879 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.5 MiB/s wr, 256 op/s 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:05 smithi078 ceph-mon[94114]: osdmap e291: 12 total, 12 up, 12 in 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:06 smithi078 ceph-mon[94114]: pgmap v3476: 97 pgs: 97 active+clean; 879 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 218 op/s 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:07 smithi078 ceph-mon[94114]: pgmap v3477: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:10 smithi078 ceph-mon[94114]: pgmap v3478: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 319 op/s 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:12 smithi078 ceph-mon[94114]: pgmap v3479: 97 pgs: 97 active+clean; 876 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 264 op/s 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:12 smithi078 ceph-mon[94114]: osdmap e292: 12 total, 12 up, 12 in 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:14 smithi078 ceph-mon[94114]: pgmap v3481: 97 pgs: 97 active+clean; 898 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.9 MiB/s wr, 253 op/s 2023-03-17T12:35:43.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:16 smithi078 ceph-mon[94114]: pgmap v3482: 97 pgs: 97 active+clean; 898 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 226 op/s 2023-03-17T12:35:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:17 smithi078 ceph-mon[94114]: pgmap v3483: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T12:35:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:20 smithi078 ceph-mon[94114]: pgmap v3484: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T12:35:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:22 smithi078 ceph-mon[94114]: pgmap v3485: 97 pgs: 97 active+clean; 909 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 230 op/s 2023-03-17T12:35:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:24 smithi078 ceph-mon[94114]: pgmap v3486: 97 pgs: 97 active+clean; 916 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 304 op/s 2023-03-17T12:35:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:26 smithi078 ceph-mon[94114]: pgmap v3487: 97 pgs: 97 active+clean; 916 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 206 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:27 smithi078 ceph-mon[94114]: pgmap v3488: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 315 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:30 smithi078 ceph-mon[94114]: pgmap v3489: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:32 smithi078 ceph-mon[94114]: pgmap v3490: 97 pgs: 97 active+clean; 925 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 211 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:34 smithi078 ceph-mon[94114]: pgmap v3491: 97 pgs: 97 active+clean; 936 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 307 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:36 smithi078 ceph-mon[94114]: pgmap v3492: 97 pgs: 97 active+clean; 936 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.0 MiB/s wr, 205 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:37 smithi078 ceph-mon[94114]: pgmap v3493: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 300 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:40 smithi078 ceph-mon[94114]: pgmap v3494: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 190 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:42 smithi078 ceph-mon[94114]: pgmap v3495: 97 pgs: 97 active+clean; 953 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 190 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:44 smithi078 ceph-mon[94114]: pgmap v3496: 97 pgs: 97 active+clean; 957 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.7 MiB/s wr, 295 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:46 smithi078 ceph-mon[94114]: pgmap v3497: 97 pgs: 97 active+clean; 957 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:47 smithi078 ceph-mon[94114]: pgmap v3498: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 293 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:50 smithi078 ceph-mon[94114]: pgmap v3499: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 199 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:52 smithi078 ceph-mon[94114]: pgmap v3500: 97 pgs: 97 active+clean; 964 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 199 op/s 2023-03-17T12:35:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:54 smithi078 ceph-mon[94114]: pgmap v3501: 97 pgs: 97 active+clean; 973 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 305 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:56 smithi078 ceph-mon[94114]: pgmap v3502: 97 pgs: 97 active+clean; 973 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:32:57 smithi078 ceph-mon[94114]: pgmap v3503: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 296 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:00 smithi078 ceph-mon[94114]: pgmap v3504: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 201 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:02 smithi078 ceph-mon[94114]: pgmap v3505: 97 pgs: 97 active+clean; 986 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 201 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:04 smithi078 ceph-mon[94114]: pgmap v3506: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.4 MiB/s wr, 344 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:04 smithi078 ceph-mon[94114]: pgmap v3507: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.2 MiB/s wr, 279 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:05 smithi078 ceph-mon[94114]: osdmap e293: 12 total, 12 up, 12 in 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:06 smithi078 ceph-mon[94114]: pgmap v3509: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 200 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:08 smithi078 ceph-mon[94114]: pgmap v3510: 97 pgs: 97 active+clean; 1003 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 200 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:10 smithi078 ceph-mon[94114]: pgmap v3511: 97 pgs: 97 active+clean; 1013 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.0 MiB/s wr, 366 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:12 smithi078 ceph-mon[94114]: pgmap v3512: 97 pgs: 97 active+clean; 1013 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 149 op/s 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:12 smithi078 ceph-mon[94114]: osdmap e294: 12 total, 12 up, 12 in 2023-03-17T12:35:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:14 smithi078 ceph-mon[94114]: pgmap v3514: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 292 op/s 2023-03-17T12:35:44.712 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:16 smithi078 ceph-mon[94114]: pgmap v3515: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2023-03-17T12:35:46.124 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:18 smithi078 ceph-mon[94114]: pgmap v3516: 97 pgs: 97 active+clean; 1.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2023-03-17T12:35:46.124 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:20 smithi078 ceph-mon[94114]: pgmap v3517: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-03-17T12:35:46.124 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:22 smithi078 ceph-mon[94114]: pgmap v3518: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.1 MiB/s wr, 246 op/s 2023-03-17T12:35:46.124 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:24 smithi078 ceph-mon[94114]: pgmap v3519: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.2 MiB/s wr, 344 op/s 2023-03-17T12:35:46.124 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:26 smithi078 ceph-mon[94114]: pgmap v3520: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 211 op/s 2023-03-17T12:35:46.124 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:28 smithi078 ceph-mon[94114]: pgmap v3521: 97 pgs: 97 active+clean; 1018 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 MiB/s wr, 211 op/s 2023-03-17T12:35:46.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:30 smithi078 ceph-mon[94114]: pgmap v3522: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 330 op/s 2023-03-17T12:35:46.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:32 smithi078 ceph-mon[94114]: pgmap v3523: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 224 op/s 2023-03-17T12:35:46.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:34 smithi078 ceph-mon[94114]: pgmap v3524: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 322 op/s 2023-03-17T12:35:46.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:36 smithi078 ceph-mon[94114]: pgmap v3525: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-03-17T12:35:48.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:38 smithi078 ceph-mon[94114]: pgmap v3526: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 216 op/s 2023-03-17T12:35:48.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:40 smithi078 ceph-mon[94114]: pgmap v3527: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 343 op/s 2023-03-17T12:35:48.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:42 smithi078 ceph-mon[94114]: pgmap v3528: 97 pgs: 97 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 224 op/s 2023-03-17T12:35:48.076 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:44 smithi078 ceph-mon[94114]: pgmap v3529: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 324 op/s 2023-03-17T12:35:48.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:46 smithi078 ceph-mon[94114]: pgmap v3530: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 225 op/s 2023-03-17T12:35:48.077 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:48 smithi078 ceph-mon[94114]: pgmap v3531: 97 pgs: 97 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 225 op/s 2023-03-17T12:35:48.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:50 smithi078 ceph-mon[94114]: pgmap v3532: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 331 op/s 2023-03-17T12:35:48.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:52 smithi078 ceph-mon[94114]: pgmap v3533: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.4 MiB/s wr, 204 op/s 2023-03-17T12:35:48.653 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:54 smithi078 ceph-mon[94114]: pgmap v3534: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.0 MiB/s wr, 313 op/s 2023-03-17T12:35:50.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:56 smithi078 ceph-mon[94114]: pgmap v3535: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 214 op/s 2023-03-17T12:35:50.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:33:58 smithi078 ceph-mon[94114]: pgmap v3536: 97 pgs: 97 active+clean; 1.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 214 op/s 2023-03-17T12:35:50.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:00 smithi078 ceph-mon[94114]: pgmap v3537: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 321 op/s 2023-03-17T12:35:50.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:02 smithi078 ceph-mon[94114]: pgmap v3538: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 216 op/s 2023-03-17T12:35:50.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:50.223 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:04 smithi078 ceph-mon[94114]: pgmap v3539: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 342 op/s 2023-03-17T12:35:50.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:50.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:50.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:50.224 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:05 smithi078 ceph-mon[94114]: pgmap v3540: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 244 op/s 2023-03-17T12:35:50.987 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:05 smithi078 ceph-mon[94114]: pgmap v3541: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2023-03-17T12:35:50.987 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:05 smithi078 ceph-mon[94114]: osdmap e295: 12 total, 12 up, 12 in 2023-03-17T12:35:53.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:07 smithi078 ceph-mon[94114]: pgmap v3543: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2023-03-17T12:35:53.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:09 smithi078 ceph-mon[94114]: pgmap v3544: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 347 op/s 2023-03-17T12:35:53.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:11 smithi078 ceph-mon[94114]: pgmap v3545: 97 pgs: 97 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 145 op/s 2023-03-17T12:35:53.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:12 smithi078 ceph-mon[94114]: osdmap e296: 12 total, 12 up, 12 in 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:12 smithi078 ceph-mon[94114]: pgmap v3547: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 252 op/s 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:14 smithi078 ceph-mon[94114]: pgmap v3548: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 229 op/s 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:16 smithi078 ceph-mon[94114]: pgmap v3549: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 220 op/s 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:18 smithi078 ceph-mon[94114]: pgmap v3550: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 237 op/s 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:20 smithi078 ceph-mon[94114]: pgmap v3551: 97 pgs: 97 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 237 op/s 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:22 smithi078 ceph-mon[94114]: pgmap v3552: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 304 op/s 2023-03-17T12:35:53.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:24 smithi078 ceph-mon[94114]: pgmap v3553: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-03-17T12:35:54.565 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:25 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:35:55.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:26 smithi078 ceph-mon[94114]: pgmap v3554: 97 pgs: 97 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2023-03-17T12:35:55.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:28 smithi078 ceph-mon[94114]: pgmap v3555: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 326 op/s 2023-03-17T12:35:55.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:30 smithi078 ceph-mon[94114]: pgmap v3556: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 221 op/s 2023-03-17T12:35:55.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:32 smithi078 ceph-mon[94114]: pgmap v3557: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.8 MiB/s wr, 281 op/s 2023-03-17T12:35:55.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:34 smithi078 ceph-mon[94114]: pgmap v3558: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 251 op/s 2023-03-17T12:35:55.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:36 smithi078 ceph-mon[94114]: pgmap v3559: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 200 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:38 smithi078 ceph-mon[94114]: pgmap v3560: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.8 MiB/s wr, 293 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:40 smithi078 ceph-mon[94114]: pgmap v3561: 97 pgs: 97 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 186 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:42 smithi078 ceph-mon[94114]: pgmap v3562: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 255 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:44 smithi078 ceph-mon[94114]: pgmap v3563: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 228 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:46 smithi078 ceph-mon[94114]: pgmap v3564: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 195 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:48 smithi078 ceph-mon[94114]: pgmap v3565: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 291 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:50 smithi078 ceph-mon[94114]: pgmap v3566: 97 pgs: 97 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 198 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:52 smithi078 ceph-mon[94114]: pgmap v3567: 97 pgs: 97 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.7 MiB/s wr, 272 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:54 smithi078 ceph-mon[94114]: pgmap v3568: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 228 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:56 smithi078 ceph-mon[94114]: pgmap v3569: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 195 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:34:58 smithi078 ceph-mon[94114]: pgmap v3570: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.6 MiB/s wr, 290 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:00 smithi078 ceph-mon[94114]: pgmap v3571: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:02 smithi078 ceph-mon[94114]: pgmap v3572: 97 pgs: 97 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.4 MiB/s wr, 291 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:04 smithi078 ceph-mon[94114]: osdmap e297: 12 total, 12 up, 12 in 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:04 smithi078 ceph-mon[94114]: pgmap v3574: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 258 op/s 2023-03-17T12:35:55.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:05 smithi078 ceph-mon[94114]: pgmap v3575: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 275 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:05 smithi078 ceph-mon[94114]: pgmap v3576: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 195 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:07 smithi078 ceph-mon[94114]: pgmap v3577: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.9 MiB/s wr, 353 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:10 smithi078 ceph-mon[94114]: pgmap v3578: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 195 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:12 smithi078 ceph-mon[94114]: pgmap v3579: 97 pgs: 97 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 151 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:12 smithi078 ceph-mon[94114]: osdmap e298: 12 total, 12 up, 12 in 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:14 smithi078 ceph-mon[94114]: pgmap v3581: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 294 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:16 smithi078 ceph-mon[94114]: pgmap v3582: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.3 MiB/s wr, 235 op/s 2023-03-17T12:35:55.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:17 smithi078 ceph-mon[94114]: pgmap v3583: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T12:35:55.240 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:20 smithi078 ceph-mon[94114]: pgmap v3584: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T12:35:58.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:22 smithi078 ceph-mon[94114]: pgmap v3585: 97 pgs: 97 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.8 MiB/s wr, 234 op/s 2023-03-17T12:35:58.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:24 smithi078 ceph-mon[94114]: pgmap v3586: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.4 MiB/s wr, 290 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:26 smithi078 ceph-mon[94114]: pgmap v3587: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 183 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:27 smithi078 ceph-mon[94114]: pgmap v3588: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 299 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:30 smithi078 ceph-mon[94114]: pgmap v3589: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 203 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:32 smithi078 ceph-mon[94114]: pgmap v3590: 97 pgs: 97 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 203 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:34 smithi078 ceph-mon[94114]: pgmap v3591: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 297 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:36 smithi078 ceph-mon[94114]: pgmap v3592: 97 pgs: 97 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 210 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:37 smithi078 ceph-mon[94114]: pgmap v3593: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 314 op/s 2023-03-17T12:35:58.105 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:40 smithi078 ceph-mon[94114]: pgmap v3594: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2023-03-17T12:35:58.933 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:42 smithi078 ceph-mon[94114]: pgmap v3595: 97 pgs: 97 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 198 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:44 smithi078 ceph-mon[94114]: pgmap v3596: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.4 MiB/s wr, 293 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:46 smithi078 ceph-mon[94114]: pgmap v3597: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 199 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:47 smithi078 ceph-mon[94114]: pgmap v3598: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.4 MiB/s wr, 298 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:50 smithi078 ceph-mon[94114]: pgmap v3599: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 193 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:52 smithi078 ceph-mon[94114]: pgmap v3600: 97 pgs: 97 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 193 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:54 smithi078 ceph-mon[94114]: pgmap v3601: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 304 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:56 smithi078 ceph-mon[94114]: pgmap v3602: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 210 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:35:57 smithi078 ceph-mon[94114]: pgmap v3603: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.8 MiB/s wr, 305 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:00 smithi078 ceph-mon[94114]: pgmap v3604: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 206 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:02 smithi078 ceph-mon[94114]: pgmap v3605: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 206 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:04 smithi078 ceph-mon[94114]: pgmap v3606: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.5 MiB/s wr, 324 op/s 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:04 smithi078 ceph-mon[94114]: osdmap e299: 12 total, 12 up, 12 in 2023-03-17T12:35:58.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:06 smithi078 ceph-mon[94114]: pgmap v3608: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 255 op/s 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:07 smithi078 ceph-mon[94114]: pgmap v3609: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 157 op/s 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:07 smithi078 ceph-mon[94114]: pgmap v3610: 97 pgs: 97 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 203 op/s 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:09 smithi078 ceph-mon[94114]: pgmap v3611: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.2 MiB/s wr, 362 op/s 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:11 smithi078 ceph-mon[94114]: pgmap v3612: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 158 op/s 2023-03-17T12:35:58.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:12 smithi078 ceph-mon[94114]: osdmap e300: 12 total, 12 up, 12 in 2023-03-17T12:35:59.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:12 smithi078 ceph-mon[94114]: pgmap v3614: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.7 MiB/s wr, 329 op/s 2023-03-17T12:35:59.668 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:15 smithi078 ceph-mon[94114]: pgmap v3615: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.6 MiB/s wr, 287 op/s 2023-03-17T12:35:59.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:17 smithi078 ceph-mon[94114]: pgmap v3616: 97 pgs: 97 active+clean; 1.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 229 op/s 2023-03-17T12:35:59.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:19 smithi078 ceph-mon[94114]: pgmap v3617: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 245 op/s 2023-03-17T12:35:59.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:21 smithi078 ceph-mon[94114]: pgmap v3618: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 245 op/s 2023-03-17T12:35:59.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:22 smithi078 ceph-mon[94114]: pgmap v3619: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.2 MiB/s wr, 350 op/s 2023-03-17T12:35:59.669 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:25 smithi078 ceph-mon[94114]: pgmap v3620: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T12:36:01.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:27 smithi078 ceph-mon[94114]: pgmap v3621: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T12:36:01.236 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:29 smithi078 ceph-mon[94114]: pgmap v3622: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.0 MiB/s wr, 339 op/s 2023-03-17T12:36:01.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:30 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:31 smithi078 ceph-mon[94114]: pgmap v3623: 97 pgs: 97 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 233 op/s 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:32 smithi078 ceph-mon[94114]: pgmap v3624: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 326 op/s 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:35 smithi078 ceph-mon[94114]: pgmap v3625: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:37 smithi078 ceph-mon[94114]: pgmap v3626: 97 pgs: 97 active+clean; 1.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:38 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:38 smithi078 ceph-mon[94114]: osdmap e301: 12 total, 12 up, 12 in 2023-03-17T12:36:01.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:39 smithi078 ceph-mon[94114]: pgmap v3628: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 242 op/s 2023-03-17T12:36:02.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:39 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/515552454,v1:172.21.15.35:6837/515552454] up:boot 2023-03-17T12:36:02.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:39 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:36:02.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:36:02.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:39 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:04.058 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:41 smithi078 ceph-mon[94114]: pgmap v3629: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 242 op/s 2023-03-17T12:36:04.058 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:42 smithi078 ceph-mon[94114]: pgmap v3630: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T12:36:04.058 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:45 smithi078 ceph-mon[94114]: pgmap v3631: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T12:36:04.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:47 smithi078 ceph-mon[94114]: pgmap v3632: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 265 op/s 2023-03-17T12:36:04.059 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:49 smithi078 ceph-mon[94114]: pgmap v3633: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 256 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:51 smithi078 ceph-mon[94114]: pgmap v3634: 97 pgs: 97 active+clean; 1.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 216 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:52 smithi078 ceph-mon[94114]: pgmap v3635: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 337 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:55 smithi078 ceph-mon[94114]: pgmap v3636: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:57 smithi078 ceph-mon[94114]: pgmap v3637: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 224 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:36:59 smithi078 ceph-mon[94114]: pgmap v3638: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 316 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:01 smithi078 ceph-mon[94114]: pgmap v3639: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.6 MiB/s wr, 212 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:02 smithi078 ceph-mon[94114]: pgmap v3640: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 331 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:04 smithi078 ceph-mon[94114]: osdmap e302: 12 total, 12 up, 12 in 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:04 smithi078 ceph-mon[94114]: pgmap v3642: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 252 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:07 smithi078 ceph-mon[94114]: pgmap v3643: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.0 MiB/s wr, 252 op/s 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:06.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:08 smithi078 ceph-mon[94114]: pgmap v3644: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.3 MiB/s wr, 296 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:08 smithi078 ceph-mon[94114]: pgmap v3645: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.1 MiB/s wr, 380 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:10 smithi078 ceph-mon[94114]: pgmap v3646: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:12 smithi078 ceph-mon[94114]: pgmap v3647: 97 pgs: 97 active+clean; 1.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 162 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:12 smithi078 ceph-mon[94114]: osdmap e303: 12 total, 12 up, 12 in 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:14 smithi078 ceph-mon[94114]: pgmap v3649: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.1 MiB/s wr, 356 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:16 smithi078 ceph-mon[94114]: pgmap v3650: 97 pgs: 97 active+clean; 1.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 157 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:17 smithi078 ceph-mon[94114]: pgmap v3651: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:20 smithi078 ceph-mon[94114]: pgmap v3652: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:21 smithi078 ceph-mon[94114]: pgmap v3653: 97 pgs: 97 active+clean; 1.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.8 MiB/s wr, 238 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:23 smithi078 ceph-mon[94114]: pgmap v3654: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.4 MiB/s wr, 324 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:25 smithi078 ceph-mon[94114]: pgmap v3655: 97 pgs: 97 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 211 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:27 smithi078 ceph-mon[94114]: pgmap v3656: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 315 op/s 2023-03-17T12:36:06.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:29 smithi078 ceph-mon[94114]: pgmap v3657: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-03-17T12:36:06.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:31 smithi078 ceph-mon[94114]: pgmap v3658: 97 pgs: 97 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 221 op/s 2023-03-17T12:36:07.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:33 smithi078 ceph-mon[94114]: pgmap v3659: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 314 op/s 2023-03-17T12:36:07.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:35 smithi078 ceph-mon[94114]: pgmap v3660: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 196 op/s 2023-03-17T12:36:07.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:37 smithi078 ceph-mon[94114]: pgmap v3661: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.3 MiB/s wr, 301 op/s 2023-03-17T12:36:07.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:39 smithi078 ceph-mon[94114]: pgmap v3662: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:41 smithi078 ceph-mon[94114]: pgmap v3663: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 198 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:43 smithi078 ceph-mon[94114]: pgmap v3664: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.1 MiB/s wr, 291 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:45 smithi078 ceph-mon[94114]: pgmap v3665: 97 pgs: 97 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 197 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:47 smithi078 ceph-mon[94114]: pgmap v3666: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.1 MiB/s wr, 300 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:49 smithi078 ceph-mon[94114]: pgmap v3667: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 195 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:51 smithi078 ceph-mon[94114]: pgmap v3668: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 195 op/s 2023-03-17T12:36:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:53 smithi078 ceph-mon[94114]: pgmap v3669: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 297 op/s 2023-03-17T12:36:08.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:55 smithi078 ceph-mon[94114]: pgmap v3670: 97 pgs: 97 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 204 op/s 2023-03-17T12:36:08.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:57 smithi078 ceph-mon[94114]: pgmap v3671: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.1 MiB/s wr, 298 op/s 2023-03-17T12:36:08.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:37:59 smithi078 ceph-mon[94114]: pgmap v3672: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 195 op/s 2023-03-17T12:36:08.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:01 smithi078 ceph-mon[94114]: pgmap v3673: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 195 op/s 2023-03-17T12:36:08.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:04 smithi078 ceph-mon[94114]: pgmap v3674: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.5 MiB/s wr, 317 op/s 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:04 smithi078 ceph-mon[94114]: osdmap e304: 12 total, 12 up, 12 in 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:05 smithi078 ceph-mon[94114]: pgmap v3676: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:07 smithi078 ceph-mon[94114]: pgmap v3677: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:10 smithi078 ceph-mon[94114]: pgmap v3678: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:36:08.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:11 smithi078 ceph-mon[94114]: pgmap v3679: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.1 MiB/s wr, 259 op/s 2023-03-17T12:36:09.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:12 smithi078 ceph-mon[94114]: osdmap e305: 12 total, 12 up, 12 in 2023-03-17T12:36:09.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:09.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:09.426 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:12 smithi078 ceph-mon[94114]: pgmap v3681: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.1 MiB/s wr, 285 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:12 smithi078 ceph-mon[94114]: pgmap v3682: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.2 MiB/s wr, 370 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:15 smithi078 ceph-mon[94114]: pgmap v3683: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 199 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:17 smithi078 ceph-mon[94114]: pgmap v3684: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 199 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:19 smithi078 ceph-mon[94114]: pgmap v3685: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.9 MiB/s wr, 382 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:21 smithi078 ceph-mon[94114]: pgmap v3686: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.1 MiB/s wr, 303 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:22 smithi078 ceph-mon[94114]: pgmap v3687: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.7 MiB/s wr, 229 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:25 smithi078 ceph-mon[94114]: pgmap v3688: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 191 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:27 smithi078 ceph-mon[94114]: pgmap v3689: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 191 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:29 smithi078 ceph-mon[94114]: pgmap v3690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 289 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:31 smithi078 ceph-mon[94114]: pgmap v3691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 188 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:32 smithi078 ceph-mon[94114]: pgmap v3692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.7 MiB/s wr, 286 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:35 smithi078 ceph-mon[94114]: pgmap v3693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 195 op/s 2023-03-17T12:36:10.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:36 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:37 smithi078 ceph-mon[94114]: pgmap v3694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.2 MiB/s wr, 195 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:38 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:38 smithi078 ceph-mon[94114]: pgmap v3695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.6 MiB/s wr, 292 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:41 smithi078 ceph-mon[94114]: pgmap v3696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 193 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:42 smithi078 ceph-mon[94114]: pgmap v3697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 204 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:45 smithi078 ceph-mon[94114]: pgmap v3698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 428 KiB/s wr, 106 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:47 smithi078 ceph-mon[94114]: pgmap v3699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 428 KiB/s wr, 106 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:49 smithi078 ceph-mon[94114]: pgmap v3700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 444 KiB/s wr, 114 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:51 smithi078 ceph-mon[94114]: pgmap v3701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 18 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:52 smithi078 ceph-mon[94114]: pgmap v3702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 67 KiB/s wr, 23 op/s 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:54 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:10.931 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:54 smithi078 ceph-mon[94114]: pgmap v3703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 13 op/s 2023-03-17T12:36:12.305 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:57 smithi078 ceph-mon[94114]: pgmap v3704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 13 op/s 2023-03-17T12:36:12.305 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:58 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:12.305 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:58 smithi078 ceph-mon[94114]: pgmap v3705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 72 KiB/s wr, 20 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:38:59 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:00 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:00 smithi078 ceph-mon[94114]: pgmap v3706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 12 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:02 smithi078 ceph-mon[94114]: pgmap v3707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 170 KiB/s wr, 34 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:03 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:04 smithi078 ceph-mon[94114]: pgmap v3708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 28 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:07 smithi078 ceph-mon[94114]: pgmap v3709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 28 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:08 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:09 smithi078 ceph-mon[94114]: pgmap v3710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 535 KiB/s wr, 49 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:10 smithi078 ceph-mon[94114]: osdmap e306: 12 total, 12 up, 12 in 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:11 smithi078 ceph-mon[94114]: pgmap v3712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 585 KiB/s wr, 50 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:12 smithi078 ceph-mon[94114]: pgmap v3713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:12.306 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:14 smithi078 ceph-mon[94114]: pgmap v3714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:17 smithi078 ceph-mon[94114]: pgmap v3715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 451 KiB/s wr, 30 op/s 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:17 smithi078 ceph-mon[94114]: osdmap e307: 12 total, 12 up, 12 in 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:12.307 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.308 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:12.308 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:36:15.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:36:15.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:36:15.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:36:15.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: pgmap v3717: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 70 KiB/s wr, 42 op/s 2023-03-17T12:36:15.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:15.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:15.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: pgmap v3718: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 77 KiB/s wr, 46 op/s 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: pgmap v3719: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 51 op/s 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:16.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:21 smithi078 ceph-mon[94114]: pgmap v3720: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 51 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:22 smithi078 ceph-mon[94114]: pgmap v3721: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 443 KiB/s wr, 77 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:24 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:24 smithi078 ceph-mon[94114]: pgmap v3722: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 364 KiB/s wr, 63 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:26 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:26 smithi078 ceph-mon[94114]: pgmap v3723: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 261 KiB/s wr, 19 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:29 smithi078 ceph-mon[94114]: pgmap v3724: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 424 KiB/s wr, 35 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:31 smithi078 ceph-mon[94114]: pgmap v3725: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 353 KiB/s wr, 29 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:31 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:32 smithi078 ceph-mon[94114]: pgmap v3726: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 357 KiB/s wr, 34 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:35 smithi078 ceph-mon[94114]: pgmap v3727: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 180 KiB/s wr, 21 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:37 smithi078 ceph-mon[94114]: pgmap v3728: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 180 KiB/s wr, 21 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:39 smithi078 ceph-mon[94114]: pgmap v3729: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 181 KiB/s wr, 26 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:41 smithi078 ceph-mon[94114]: pgmap v3730: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:42 smithi078 ceph-mon[94114]: pgmap v3731: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2023-03-17T12:36:16.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:45 smithi078 ceph-mon[94114]: pgmap v3732: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:47 smithi078 ceph-mon[94114]: pgmap v3733: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 13 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:49 smithi078 ceph-mon[94114]: pgmap v3734: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 18 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:51 smithi078 ceph-mon[94114]: pgmap v3735: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 KiB/s wr, 13 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:52 smithi078 ceph-mon[94114]: pgmap v3736: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 KiB/s wr, 18 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:55 smithi078 ceph-mon[94114]: pgmap v3737: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:57 smithi078 ceph-mon[94114]: pgmap v3738: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:39:59 smithi078 ceph-mon[94114]: pgmap v3739: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:01 smithi078 ceph-mon[94114]: pgmap v3740: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:02 smithi078 ceph-mon[94114]: pgmap v3741: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 28 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:05 smithi078 ceph-mon[94114]: pgmap v3742: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:07 smithi078 ceph-mon[94114]: pgmap v3743: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:09 smithi078 ceph-mon[94114]: pgmap v3744: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 29 op/s 2023-03-17T12:36:16.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:10 smithi078 ceph-mon[94114]: osdmap e308: 12 total, 12 up, 12 in 2023-03-17T12:36:18.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:11 smithi078 ceph-mon[94114]: pgmap v3746: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:36:18.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:12 smithi078 ceph-mon[94114]: pgmap v3747: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:18.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:15 smithi078 ceph-mon[94114]: pgmap v3748: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:18.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:17 smithi078 ceph-mon[94114]: pgmap v3749: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:18.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:17 smithi078 ceph-mon[94114]: osdmap e309: 12 total, 12 up, 12 in 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:19 smithi078 ceph-mon[94114]: pgmap v3751: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 114 B/s wr, 12 op/s 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:21 smithi078 ceph-mon[94114]: pgmap v3752: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: pgmap v3753: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: pgmap v3754: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 127 B/s wr, 13 op/s 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: pgmap v3755: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 169 B/s wr, 18 op/s 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:20.062 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:25 smithi078 ceph-mon[94114]: pgmap v3756: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 136 B/s wr, 14 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:27 smithi078 ceph-mon[94114]: pgmap v3757: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:29 smithi078 ceph-mon[94114]: pgmap v3758: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:31 smithi078 ceph-mon[94114]: pgmap v3759: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:32 smithi078 ceph-mon[94114]: pgmap v3760: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:35 smithi078 ceph-mon[94114]: pgmap v3761: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:37 smithi078 ceph-mon[94114]: pgmap v3762: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:39 smithi078 ceph-mon[94114]: pgmap v3763: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:41 smithi078 ceph-mon[94114]: pgmap v3764: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:42 smithi078 ceph-mon[94114]: pgmap v3765: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:45 smithi078 ceph-mon[94114]: pgmap v3766: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:47 smithi078 ceph-mon[94114]: pgmap v3767: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:49 smithi078 ceph-mon[94114]: pgmap v3768: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:50 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:20.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:51 smithi078 ceph-mon[94114]: pgmap v3769: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:21.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:52 smithi078 ceph-mon[94114]: pgmap v3770: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:21.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:55 smithi078 ceph-mon[94114]: pgmap v3771: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:21.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:57 smithi078 ceph-mon[94114]: pgmap v3772: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:21.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:40:59 smithi078 ceph-mon[94114]: pgmap v3773: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:01 smithi078 ceph-mon[94114]: pgmap v3774: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:02 smithi078 ceph-mon[94114]: pgmap v3775: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:03 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:04 smithi078 ceph-mon[94114]: pgmap v3776: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:07 smithi078 ceph-mon[94114]: pgmap v3777: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:09 smithi078 ceph-mon[94114]: pgmap v3778: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:36:21.590 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:10 smithi078 ceph-mon[94114]: osdmap e310: 12 total, 12 up, 12 in 2023-03-17T12:36:22.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:11 smithi078 ceph-mon[94114]: pgmap v3780: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:12 smithi078 ceph-mon[94114]: pgmap v3781: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:15 smithi078 ceph-mon[94114]: pgmap v3782: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:17 smithi078 ceph-mon[94114]: pgmap v3783: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:17 smithi078 ceph-mon[94114]: osdmap e311: 12 total, 12 up, 12 in 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:19 smithi078 ceph-mon[94114]: pgmap v3785: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 12 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:21 smithi078 ceph-mon[94114]: pgmap v3786: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:22 smithi078 ceph-mon[94114]: pgmap v3787: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:23 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:24 smithi078 ceph-mon[94114]: pgmap v3788: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:23.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:23.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:23.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:23.467 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:24.644 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:26 smithi078 ceph-mon[94114]: pgmap v3789: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 105 B/s wr, 11 op/s 2023-03-17T12:36:24.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:25.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:29 smithi078 ceph-mon[94114]: pgmap v3790: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 91 B/s wr, 14 op/s 2023-03-17T12:36:25.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:31 smithi078 ceph-mon[94114]: pgmap v3791: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:36:25.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:32 smithi078 ceph-mon[94114]: pgmap v3792: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-17T12:36:25.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:35 smithi078 ceph-mon[94114]: pgmap v3793: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:36:25.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:36 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:37 smithi078 ceph-mon[94114]: pgmap v3794: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:39 smithi078 ceph-mon[94114]: pgmap v3795: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:41 smithi078 ceph-mon[94114]: pgmap v3796: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:43 smithi078 ceph-mon[94114]: pgmap v3797: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:43 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:45 smithi078 ceph-mon[94114]: pgmap v3798: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:47 smithi078 ceph-mon[94114]: pgmap v3799: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:48 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:49 smithi078 ceph-mon[94114]: pgmap v3800: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:49 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:51 smithi078 ceph-mon[94114]: pgmap v3801: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:52 smithi078 ceph-mon[94114]: pgmap v3802: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:55 smithi078 ceph-mon[94114]: pgmap v3803: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:36:25.196 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:57 smithi078 ceph-mon[94114]: pgmap v3804: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:41:59 smithi078 ceph-mon[94114]: pgmap v3805: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:01 smithi078 ceph-mon[94114]: pgmap v3806: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:02 smithi078 ceph-mon[94114]: pgmap v3807: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 23 op/s 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:04 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:04 smithi078 ceph-mon[94114]: pgmap v3808: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:06 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:25.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:06 smithi078 ceph-mon[94114]: pgmap v3809: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:36:25.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:08 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:27.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:08 smithi078 ceph-mon[94114]: pgmap v3810: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:36:27.840 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:09 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:09 smithi078 ceph-mon[94114]: osdmap e312: 12 total, 12 up, 12 in 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:10 smithi078 ceph-mon[94114]: pgmap v3812: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:12 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:12 smithi078 ceph-mon[94114]: pgmap v3813: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 14 op/s 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:14 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:14 smithi078 ceph-mon[94114]: pgmap v3814: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:15 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:16 smithi078 ceph-mon[94114]: pgmap v3815: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:16 smithi078 ceph-mon[94114]: osdmap e313: 12 total, 12 up, 12 in 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:19 smithi078 ceph-mon[94114]: pgmap v3817: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:36:27.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:20 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:36:27.842 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:21 smithi078 ceph-mon[94114]: pgmap v3818: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2023-03-17T12:36:29.029 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:22 smithi078 ceph-mon[94114]: pgmap v3819: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2023-03-17T12:36:29.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:25 smithi078 ceph-mon[94114]: pgmap v3820: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2023-03-17T12:36:29.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:27 smithi078 ceph-mon[94114]: pgmap v3821: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2023-03-17T12:36:29.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:29.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:29 smithi078 ceph-mon[94114]: pgmap v3822: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-03-17T12:36:29.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: pgmap v3823: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:29.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: pgmap v3824: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: pgmap v3825: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:30.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:32 smithi078 ceph-mon[94114]: pgmap v3826: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:36:30.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:35 smithi078 ceph-mon[94114]: pgmap v3827: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:36:30.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:37 smithi078 ceph-mon[94114]: pgmap v3828: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-03-17T12:36:30.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:39 smithi078 ceph-mon[94114]: pgmap v3829: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:36:30.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:41 smithi078 ceph-mon[94114]: pgmap v3830: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:36:30.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:42 smithi078 ceph-mon[94114]: pgmap v3831: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:30.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:45 smithi078 ceph-mon[94114]: pgmap v3832: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:31.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:47 smithi078 ceph-mon[94114]: pgmap v3833: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:32.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:49 smithi078 ceph-mon[94114]: pgmap v3834: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:33.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:51 smithi078 ceph-mon[94114]: pgmap v3835: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:33.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:52 smithi078 ceph-mon[94114]: pgmap v3836: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:33.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:55 smithi078 ceph-mon[94114]: pgmap v3837: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:33.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:57 smithi078 ceph-mon[94114]: pgmap v3838: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:34.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:42:59 smithi078 ceph-mon[94114]: pgmap v3839: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T12:36:34.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:01 smithi078 ceph-mon[94114]: pgmap v3840: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:02 smithi078 ceph-mon[94114]: pgmap v3841: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:05 smithi078 ceph-mon[94114]: pgmap v3842: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:07 smithi078 ceph-mon[94114]: pgmap v3843: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:09 smithi078 ceph-mon[94114]: pgmap v3844: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:10 smithi078 ceph-mon[94114]: osdmap e314: 12 total, 12 up, 12 in 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:11 smithi078 ceph-mon[94114]: pgmap v3846: 97 pgs: 97 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:34.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:12 smithi078 ceph-mon[94114]: pgmap v3847: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:15 smithi078 ceph-mon[94114]: pgmap v3848: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:17 smithi078 ceph-mon[94114]: pgmap v3849: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:17 smithi078 ceph-mon[94114]: osdmap e315: 12 total, 12 up, 12 in 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:19 smithi078 ceph-mon[94114]: pgmap v3851: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 13 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:21 smithi078 ceph-mon[94114]: pgmap v3852: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 11 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:22 smithi078 ceph-mon[94114]: pgmap v3853: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:25 smithi078 ceph-mon[94114]: pgmap v3854: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:36.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:27 smithi078 ceph-mon[94114]: pgmap v3855: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:29 smithi078 ceph-mon[94114]: pgmap v3856: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 90 B/s wr, 14 op/s 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:31 smithi078 ceph-mon[94114]: pgmap v3857: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:32 smithi078 ceph-mon[94114]: pgmap v3858: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:36:36.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:32 smithi078 ceph-mon[94114]: pgmap v3859: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:36:36.765 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:34 smithi078 ceph-mon[94114]: pgmap v3860: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:37.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:36 smithi078 ceph-mon[94114]: pgmap v3861: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:37.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:37 smithi078 ceph-mon[94114]: pgmap v3862: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:36:37.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:39 smithi078 ceph-mon[94114]: pgmap v3863: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:37.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:41 smithi078 ceph-mon[94114]: pgmap v3864: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:43 smithi078 ceph-mon[94114]: pgmap v3865: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:45 smithi078 ceph-mon[94114]: pgmap v3866: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:47 smithi078 ceph-mon[94114]: pgmap v3867: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:49 smithi078 ceph-mon[94114]: pgmap v3868: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:51 smithi078 ceph-mon[94114]: pgmap v3869: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:53 smithi078 ceph-mon[94114]: pgmap v3870: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:55 smithi078 ceph-mon[94114]: pgmap v3871: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:57 smithi078 ceph-mon[94114]: pgmap v3872: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:43:59 smithi078 ceph-mon[94114]: pgmap v3873: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:01 smithi078 ceph-mon[94114]: pgmap v3874: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:03 smithi078 ceph-mon[94114]: pgmap v3875: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:05 smithi078 ceph-mon[94114]: pgmap v3876: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:07 smithi078 ceph-mon[94114]: pgmap v3877: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:36:37.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:09 smithi078 ceph-mon[94114]: osdmap e316: 12 total, 12 up, 12 in 2023-03-17T12:36:40.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:09 smithi078 ceph-mon[94114]: pgmap v3879: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:36:40.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:11 smithi078 ceph-mon[94114]: pgmap v3880: 97 pgs: 97 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:36:40.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:13 smithi078 ceph-mon[94114]: pgmap v3881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:15 smithi078 ceph-mon[94114]: pgmap v3882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:17 smithi078 ceph-mon[94114]: osdmap e317: 12 total, 12 up, 12 in 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:17 smithi078 ceph-mon[94114]: pgmap v3884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 B/s wr, 7 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:19 smithi078 ceph-mon[94114]: pgmap v3885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:21 smithi078 ceph-mon[94114]: pgmap v3886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:23 smithi078 ceph-mon[94114]: pgmap v3887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:25 smithi078 ceph-mon[94114]: pgmap v3888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:27 smithi078 ceph-mon[94114]: pgmap v3889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 100 B/s wr, 11 op/s 2023-03-17T12:36:42.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:29 smithi078 ceph-mon[94114]: pgmap v3890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 13 op/s 2023-03-17T12:36:42.198 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:31 smithi078 ceph-mon[94114]: pgmap v3891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:43.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:43.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:43.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:43.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:43.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:32 smithi078 ceph-mon[94114]: pgmap v3892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:36:44.391 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:32 smithi078 ceph-mon[94114]: pgmap v3893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:34 smithi078 ceph-mon[94114]: pgmap v3894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:36 smithi078 ceph-mon[94114]: pgmap v3895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:38 smithi078 ceph-mon[94114]: pgmap v3896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:40 smithi078 ceph-mon[94114]: pgmap v3897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:42 smithi078 ceph-mon[94114]: pgmap v3898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:44 smithi078 ceph-mon[94114]: pgmap v3899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:47 smithi078 ceph-mon[94114]: pgmap v3900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.392 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:49 smithi078 ceph-mon[94114]: pgmap v3901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:44.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:51 smithi078 ceph-mon[94114]: pgmap v3902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.393 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:53 smithi078 ceph-mon[94114]: pgmap v3903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:55 smithi078 ceph-mon[94114]: pgmap v3904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:57 smithi078 ceph-mon[94114]: pgmap v3905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:44:59 smithi078 ceph-mon[94114]: pgmap v3906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:01 smithi078 ceph-mon[94114]: pgmap v3907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:03 smithi078 ceph-mon[94114]: pgmap v3908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:05 smithi078 ceph-mon[94114]: pgmap v3909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:07 smithi078 ceph-mon[94114]: pgmap v3910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:36:44.950 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:09 smithi078 ceph-mon[94114]: pgmap v3911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:10 smithi078 ceph-mon[94114]: osdmap e318: 12 total, 12 up, 12 in 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:11 smithi078 ceph-mon[94114]: pgmap v3913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:13 smithi078 ceph-mon[94114]: pgmap v3914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:15 smithi078 ceph-mon[94114]: pgmap v3915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:17 smithi078 ceph-mon[94114]: pgmap v3916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:17 smithi078 ceph-mon[94114]: osdmap e319: 12 total, 12 up, 12 in 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:19 smithi078 ceph-mon[94114]: pgmap v3918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 KiB/s wr, 14 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:21 smithi078 ceph-mon[94114]: pgmap v3919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:23 smithi078 ceph-mon[94114]: pgmap v3920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:25 smithi078 ceph-mon[94114]: pgmap v3921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:27 smithi078 ceph-mon[94114]: pgmap v3922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:29 smithi078 ceph-mon[94114]: pgmap v3923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:31 smithi078 ceph-mon[94114]: pgmap v3924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:32 smithi078 ceph-mon[94114]: pgmap v3925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:44.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:44.952 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:44.952 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:44.952 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:34 smithi078 ceph-mon[94114]: pgmap v3926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 KiB/s wr, 15 op/s 2023-03-17T12:36:44.952 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:34 smithi078 ceph-mon[94114]: pgmap v3927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:36:44.952 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:36 smithi078 ceph-mon[94114]: pgmap v3928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:38 smithi078 ceph-mon[94114]: pgmap v3929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:40 smithi078 ceph-mon[94114]: pgmap v3930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:42 smithi078 ceph-mon[94114]: pgmap v3931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:44 smithi078 ceph-mon[94114]: pgmap v3932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:46 smithi078 ceph-mon[94114]: pgmap v3933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:48 smithi078 ceph-mon[94114]: pgmap v3934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:50 smithi078 ceph-mon[94114]: pgmap v3935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:45.505 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:52 smithi078 ceph-mon[94114]: pgmap v3936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:45.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:54 smithi078 ceph-mon[94114]: pgmap v3937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:45.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:56 smithi078 ceph-mon[94114]: pgmap v3938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:45.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:45:58 smithi078 ceph-mon[94114]: pgmap v3939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:45.506 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:00 smithi078 ceph-mon[94114]: pgmap v3940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:02 smithi078 ceph-mon[94114]: pgmap v3941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:04 smithi078 ceph-mon[94114]: pgmap v3942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:06 smithi078 ceph-mon[94114]: pgmap v3943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:08 smithi078 ceph-mon[94114]: pgmap v3944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:10 smithi078 ceph-mon[94114]: pgmap v3945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:10 smithi078 ceph-mon[94114]: osdmap e320: 12 total, 12 up, 12 in 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:12 smithi078 ceph-mon[94114]: pgmap v3947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:14 smithi078 ceph-mon[94114]: pgmap v3948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:16 smithi078 ceph-mon[94114]: pgmap v3949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:17 smithi078 ceph-mon[94114]: pgmap v3950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:46.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:17 smithi078 ceph-mon[94114]: osdmap e321: 12 total, 12 up, 12 in 2023-03-17T12:36:47.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:19 smithi078 ceph-mon[94114]: pgmap v3952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 325 B/s wr, 12 op/s 2023-03-17T12:36:47.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:21 smithi078 ceph-mon[94114]: pgmap v3953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:36:47.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:23 smithi078 ceph-mon[94114]: pgmap v3954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:48.541 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:25 smithi078 ceph-mon[94114]: pgmap v3955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:49.734 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:27 smithi078 ceph-mon[94114]: pgmap v3956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:49.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:29 smithi078 ceph-mon[94114]: pgmap v3957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 173 B/s wr, 14 op/s 2023-03-17T12:36:49.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:31 smithi078 ceph-mon[94114]: pgmap v3958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:49.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:49.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:33 smithi078 ceph-mon[94114]: pgmap v3959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:49.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:49.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:50.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:33 smithi078 ceph-mon[94114]: pgmap v3960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:36:50.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:33 smithi078 ceph-mon[94114]: pgmap v3961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:50.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:36 smithi078 ceph-mon[94114]: pgmap v3962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:37 smithi078 ceph-mon[94114]: pgmap v3963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:40 smithi078 ceph-mon[94114]: pgmap v3964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:42 smithi078 ceph-mon[94114]: pgmap v3965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:44 smithi078 ceph-mon[94114]: pgmap v3966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:46 smithi078 ceph-mon[94114]: pgmap v3967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:47 smithi078 ceph-mon[94114]: pgmap v3968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:50 smithi078 ceph-mon[94114]: pgmap v3969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:52 smithi078 ceph-mon[94114]: pgmap v3970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:54 smithi078 ceph-mon[94114]: pgmap v3971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:56 smithi078 ceph-mon[94114]: pgmap v3972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:46:57 smithi078 ceph-mon[94114]: pgmap v3973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:00 smithi078 ceph-mon[94114]: pgmap v3974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:02 smithi078 ceph-mon[94114]: pgmap v3975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:36:50.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:04 smithi078 ceph-mon[94114]: pgmap v3976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:50.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:06 smithi078 ceph-mon[94114]: pgmap v3977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:36:50.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:07 smithi078 ceph-mon[94114]: pgmap v3978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:50.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:09 smithi078 ceph-mon[94114]: osdmap e322: 12 total, 12 up, 12 in 2023-03-17T12:36:50.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:09 smithi078 ceph-mon[94114]: pgmap v3980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:50.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:12 smithi078 ceph-mon[94114]: pgmap v3981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:51.111 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:14 smithi078 ceph-mon[94114]: pgmap v3982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:51.652 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:16 smithi078 ceph-mon[94114]: pgmap v3983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:52.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:17 smithi078 ceph-mon[94114]: osdmap e323: 12 total, 12 up, 12 in 2023-03-17T12:36:52.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:17 smithi078 ceph-mon[94114]: pgmap v3985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 238 B/s wr, 13 op/s 2023-03-17T12:36:52.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:20 smithi078 ceph-mon[94114]: pgmap v3986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:52.628 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:22 smithi078 ceph-mon[94114]: pgmap v3987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:24 smithi078 ceph-mon[94114]: pgmap v3988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:26 smithi078 ceph-mon[94114]: pgmap v3989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:27 smithi078 ceph-mon[94114]: pgmap v3990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 96 B/s wr, 15 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:30 smithi078 ceph-mon[94114]: pgmap v3991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:32 smithi078 ceph-mon[94114]: pgmap v3992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:34 smithi078 ceph-mon[94114]: pgmap v3993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:52.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:35 smithi078 ceph-mon[94114]: pgmap v3994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:35 smithi078 ceph-mon[94114]: pgmap v3995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:37 smithi078 ceph-mon[94114]: pgmap v3996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:39 smithi078 ceph-mon[94114]: pgmap v3997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:52.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:41 smithi078 ceph-mon[94114]: pgmap v3998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:52.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:42 smithi078 ceph-mon[94114]: pgmap v3999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:36:52.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:45 smithi078 ceph-mon[94114]: pgmap v4000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:52.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:47 smithi078 ceph-mon[94114]: pgmap v4001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:52.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:49 smithi078 ceph-mon[94114]: pgmap v4002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:52.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:51 smithi078 ceph-mon[94114]: pgmap v4003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:52.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:52 smithi078 ceph-mon[94114]: pgmap v4004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:53.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:55 smithi078 ceph-mon[94114]: pgmap v4005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:53.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:57 smithi078 ceph-mon[94114]: pgmap v4006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:53.245 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:47:59 smithi078 ceph-mon[94114]: pgmap v4007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:53.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:01 smithi078 ceph-mon[94114]: pgmap v4008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:53.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:02 smithi078 ceph-mon[94114]: pgmap v4009: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:36:53.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:05 smithi078 ceph-mon[94114]: pgmap v4010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:36:53.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:07 smithi078 ceph-mon[94114]: pgmap v4011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:36:53.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:09 smithi078 ceph-mon[94114]: pgmap v4012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:36:53.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:10 smithi078 ceph-mon[94114]: osdmap e324: 12 total, 12 up, 12 in 2023-03-17T12:36:54.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:11 smithi078 ceph-mon[94114]: pgmap v4014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:36:54.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:12 smithi078 ceph-mon[94114]: pgmap v4015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:36:54.060 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:15 smithi078 ceph-mon[94114]: pgmap v4016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:17 smithi078 ceph-mon[94114]: pgmap v4017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:17 smithi078 ceph-mon[94114]: osdmap e325: 12 total, 12 up, 12 in 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:19 smithi078 ceph-mon[94114]: pgmap v4019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:21 smithi078 ceph-mon[94114]: pgmap v4020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:22 smithi078 ceph-mon[94114]: pgmap v4021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:25 smithi078 ceph-mon[94114]: pgmap v4022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:27 smithi078 ceph-mon[94114]: pgmap v4023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:29 smithi078 ceph-mon[94114]: pgmap v4024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 KiB/s wr, 14 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:31 smithi078 ceph-mon[94114]: pgmap v4025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:32 smithi078 ceph-mon[94114]: pgmap v4026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:35 smithi078 ceph-mon[94114]: pgmap v4027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:54.061 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:37 smithi078 ceph-mon[94114]: pgmap v4028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:37 smithi078 ceph-mon[94114]: pgmap v4029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:39 smithi078 ceph-mon[94114]: pgmap v4030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:41 smithi078 ceph-mon[94114]: pgmap v4031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:43 smithi078 ceph-mon[94114]: pgmap v4032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:45 smithi078 ceph-mon[94114]: pgmap v4033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:36:54.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:47 smithi078 ceph-mon[94114]: pgmap v4034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:49 smithi078 ceph-mon[94114]: pgmap v4035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:51 smithi078 ceph-mon[94114]: pgmap v4036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:53 smithi078 ceph-mon[94114]: pgmap v4037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:55 smithi078 ceph-mon[94114]: pgmap v4038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:57 smithi078 ceph-mon[94114]: pgmap v4039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:48:59 smithi078 ceph-mon[94114]: pgmap v4040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:01 smithi078 ceph-mon[94114]: pgmap v4041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:03 smithi078 ceph-mon[94114]: pgmap v4042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:05 smithi078 ceph-mon[94114]: pgmap v4043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:07 smithi078 ceph-mon[94114]: pgmap v4044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:09 smithi078 ceph-mon[94114]: pgmap v4045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:10 smithi078 ceph-mon[94114]: osdmap e326: 12 total, 12 up, 12 in 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:11 smithi078 ceph-mon[94114]: pgmap v4047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:54.879 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:13 smithi078 ceph-mon[94114]: pgmap v4048: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:15 smithi078 ceph-mon[94114]: pgmap v4049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:17 smithi078 ceph-mon[94114]: pgmap v4050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:17 smithi078 ceph-mon[94114]: osdmap e327: 12 total, 12 up, 12 in 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:19 smithi078 ceph-mon[94114]: pgmap v4052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 375 B/s wr, 14 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:21 smithi078 ceph-mon[94114]: pgmap v4053: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:23 smithi078 ceph-mon[94114]: pgmap v4054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 11 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:25 smithi078 ceph-mon[94114]: pgmap v4055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:27 smithi078 ceph-mon[94114]: pgmap v4056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:29 smithi078 ceph-mon[94114]: pgmap v4057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 95 B/s wr, 15 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:31 smithi078 ceph-mon[94114]: pgmap v4058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:33 smithi078 ceph-mon[94114]: pgmap v4059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:35 smithi078 ceph-mon[94114]: pgmap v4060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:37 smithi078 ceph-mon[94114]: pgmap v4061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:54.880 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: pgmap v4062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: pgmap v4063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:54.881 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:55.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:55.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:55.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.516 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:36:56.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: pgmap v4064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: pgmap v4065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:42 smithi078 ceph-mon[94114]: pgmap v4066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:45 smithi078 ceph-mon[94114]: pgmap v4067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:47 smithi078 ceph-mon[94114]: pgmap v4068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:49 smithi078 ceph-mon[94114]: pgmap v4069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:51 smithi078 ceph-mon[94114]: pgmap v4070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:52 smithi078 ceph-mon[94114]: pgmap v4071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:55 smithi078 ceph-mon[94114]: pgmap v4072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:36:56.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:57 smithi078 ceph-mon[94114]: pgmap v4073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:58.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:49:59 smithi078 ceph-mon[94114]: pgmap v4074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:58.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:36:58.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:01 smithi078 ceph-mon[94114]: pgmap v4075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:58.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:02 smithi078 ceph-mon[94114]: pgmap v4076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:05 smithi078 ceph-mon[94114]: pgmap v4077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:07 smithi078 ceph-mon[94114]: pgmap v4078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:09 smithi078 ceph-mon[94114]: pgmap v4079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:10 smithi078 ceph-mon[94114]: osdmap e328: 12 total, 12 up, 12 in 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:11 smithi078 ceph-mon[94114]: pgmap v4081: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:12 smithi078 ceph-mon[94114]: pgmap v4082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:15 smithi078 ceph-mon[94114]: pgmap v4083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:17 smithi078 ceph-mon[94114]: pgmap v4084: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:58.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:17 smithi078 ceph-mon[94114]: osdmap e329: 12 total, 12 up, 12 in 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:19 smithi078 ceph-mon[94114]: pgmap v4086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 228 B/s wr, 12 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:21 smithi078 ceph-mon[94114]: pgmap v4087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:22 smithi078 ceph-mon[94114]: pgmap v4088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:25 smithi078 ceph-mon[94114]: pgmap v4089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:27 smithi078 ceph-mon[94114]: pgmap v4090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:29 smithi078 ceph-mon[94114]: pgmap v4091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:31 smithi078 ceph-mon[94114]: pgmap v4092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:32 smithi078 ceph-mon[94114]: pgmap v4093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:59.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:35 smithi078 ceph-mon[94114]: pgmap v4094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:59.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:37 smithi078 ceph-mon[94114]: pgmap v4095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:36:59.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:39 smithi078 ceph-mon[94114]: pgmap v4096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:36:59.679 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:41 smithi078 ceph-mon[94114]: pgmap v4097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:00.933 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:42 smithi078 ceph-mon[94114]: pgmap v4098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:42 smithi078 ceph-mon[94114]: pgmap v4099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:44 smithi078 ceph-mon[94114]: pgmap v4100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:46 smithi078 ceph-mon[94114]: pgmap v4101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:48 smithi078 ceph-mon[94114]: pgmap v4102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:50 smithi078 ceph-mon[94114]: pgmap v4103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:52 smithi078 ceph-mon[94114]: pgmap v4104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:54 smithi078 ceph-mon[94114]: pgmap v4105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:56 smithi078 ceph-mon[94114]: pgmap v4106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:50:58 smithi078 ceph-mon[94114]: pgmap v4107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:00.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:00 smithi078 ceph-mon[94114]: pgmap v4108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:37:00.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:02 smithi078 ceph-mon[94114]: pgmap v4109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:37:00.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:04 smithi078 ceph-mon[94114]: pgmap v4110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:37:03.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:06 smithi078 ceph-mon[94114]: pgmap v4111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:37:03.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:08 smithi078 ceph-mon[94114]: pgmap v4112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:37:03.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:10 smithi078 ceph-mon[94114]: pgmap v4113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T12:37:03.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:10 smithi078 ceph-mon[94114]: osdmap e330: 12 total, 12 up, 12 in 2023-03-17T12:37:03.479 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:12 smithi078 ceph-mon[94114]: pgmap v4115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:37:04.019 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:14 smithi078 ceph-mon[94114]: pgmap v4116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:05.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:16 smithi078 ceph-mon[94114]: pgmap v4117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:05.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:17 smithi078 ceph-mon[94114]: pgmap v4118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:05.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:17 smithi078 ceph-mon[94114]: osdmap e331: 12 total, 12 up, 12 in 2023-03-17T12:37:07.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:19 smithi078 ceph-mon[94114]: pgmap v4120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 105 B/s wr, 11 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:21 smithi078 ceph-mon[94114]: pgmap v4121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:23 smithi078 ceph-mon[94114]: pgmap v4122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:25 smithi078 ceph-mon[94114]: pgmap v4123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:27 smithi078 ceph-mon[94114]: pgmap v4124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:29 smithi078 ceph-mon[94114]: pgmap v4125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:31 smithi078 ceph-mon[94114]: pgmap v4126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:33 smithi078 ceph-mon[94114]: pgmap v4127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 14 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:35 smithi078 ceph-mon[94114]: pgmap v4128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:10.371 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:37 smithi078 ceph-mon[94114]: pgmap v4129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:39 smithi078 ceph-mon[94114]: pgmap v4130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:42 smithi078 ceph-mon[94114]: pgmap v4131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:43 smithi078 ceph-mon[94114]: pgmap v4132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 15 op/s 2023-03-17T12:37:10.372 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:43 smithi078 ceph-mon[94114]: pgmap v4133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:45 smithi078 ceph-mon[94114]: pgmap v4134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:47 smithi078 ceph-mon[94114]: pgmap v4135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:49 smithi078 ceph-mon[94114]: pgmap v4136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:51 smithi078 ceph-mon[94114]: pgmap v4137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:52 smithi078 ceph-mon[94114]: pgmap v4138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:55 smithi078 ceph-mon[94114]: pgmap v4139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:57 smithi078 ceph-mon[94114]: pgmap v4140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:12.532 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:51:59 smithi078 ceph-mon[94114]: pgmap v4141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:12.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:01 smithi078 ceph-mon[94114]: pgmap v4142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:12.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:02 smithi078 ceph-mon[94114]: pgmap v4143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:12.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:05 smithi078 ceph-mon[94114]: pgmap v4144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:12.533 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:07 smithi078 ceph-mon[94114]: pgmap v4145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:14.141 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:09 smithi078 ceph-mon[94114]: pgmap v4146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:14.141 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:10 smithi078 ceph-mon[94114]: osdmap e332: 12 total, 12 up, 12 in 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:11 smithi078 ceph-mon[94114]: pgmap v4148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:12 smithi078 ceph-mon[94114]: pgmap v4149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:15 smithi078 ceph-mon[94114]: pgmap v4150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:17 smithi078 ceph-mon[94114]: pgmap v4151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:17 smithi078 ceph-mon[94114]: osdmap e333: 12 total, 12 up, 12 in 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:19 smithi078 ceph-mon[94114]: pgmap v4153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 12 op/s 2023-03-17T12:37:14.142 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:21 smithi078 ceph-mon[94114]: pgmap v4154: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:22 smithi078 ceph-mon[94114]: pgmap v4155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:25 smithi078 ceph-mon[94114]: pgmap v4156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:27 smithi078 ceph-mon[94114]: pgmap v4157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:29 smithi078 ceph-mon[94114]: pgmap v4158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:31 smithi078 ceph-mon[94114]: pgmap v4159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:32 smithi078 ceph-mon[94114]: pgmap v4160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:35 smithi078 ceph-mon[94114]: pgmap v4161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:37 smithi078 ceph-mon[94114]: pgmap v4162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:39 smithi078 ceph-mon[94114]: pgmap v4163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:41 smithi078 ceph-mon[94114]: pgmap v4164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:42 smithi078 ceph-mon[94114]: pgmap v4165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:14.143 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:15.358 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:43 smithi078 ceph-mon[94114]: pgmap v4166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:43 smithi078 ceph-mon[94114]: pgmap v4167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:46 smithi078 ceph-mon[94114]: pgmap v4168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:47 smithi078 ceph-mon[94114]: pgmap v4169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:50 smithi078 ceph-mon[94114]: pgmap v4170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:52 smithi078 ceph-mon[94114]: pgmap v4171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:54 smithi078 ceph-mon[94114]: pgmap v4172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:56 smithi078 ceph-mon[94114]: pgmap v4173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:16.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:52:57 smithi078 ceph-mon[94114]: pgmap v4174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:18.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:00 smithi078 ceph-mon[94114]: pgmap v4175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:18.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:02 smithi078 ceph-mon[94114]: pgmap v4176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:04 smithi078 ceph-mon[94114]: pgmap v4177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:06 smithi078 ceph-mon[94114]: pgmap v4178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:07 smithi078 ceph-mon[94114]: pgmap v4179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:09 smithi078 ceph-mon[94114]: osdmap e334: 12 total, 12 up, 12 in 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:09 smithi078 ceph-mon[94114]: pgmap v4181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:12 smithi078 ceph-mon[94114]: pgmap v4182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:14 smithi078 ceph-mon[94114]: pgmap v4183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:16 smithi078 ceph-mon[94114]: pgmap v4184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:17 smithi078 ceph-mon[94114]: osdmap e335: 12 total, 12 up, 12 in 2023-03-17T12:37:18.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:17 smithi078 ceph-mon[94114]: pgmap v4186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 252 B/s wr, 14 op/s 2023-03-17T12:37:18.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:20 smithi078 ceph-mon[94114]: pgmap v4187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:18.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:22 smithi078 ceph-mon[94114]: pgmap v4188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:18.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:24 smithi078 ceph-mon[94114]: pgmap v4189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:18.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:26 smithi078 ceph-mon[94114]: pgmap v4190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:18.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:27 smithi078 ceph-mon[94114]: pgmap v4191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 13 op/s 2023-03-17T12:37:18.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:30 smithi078 ceph-mon[94114]: pgmap v4192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:32 smithi078 ceph-mon[94114]: pgmap v4193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:34 smithi078 ceph-mon[94114]: pgmap v4194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:36 smithi078 ceph-mon[94114]: pgmap v4195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:37 smithi078 ceph-mon[94114]: pgmap v4196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:40 smithi078 ceph-mon[94114]: pgmap v4197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:42 smithi078 ceph-mon[94114]: pgmap v4198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:44 smithi078 ceph-mon[94114]: pgmap v4199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:19.437 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:19.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:20.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:20.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:45 smithi078 ceph-mon[94114]: pgmap v4200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 KiB/s wr, 10 op/s 2023-03-17T12:37:20.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:45 smithi078 ceph-mon[94114]: pgmap v4201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:37:20.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:47 smithi078 ceph-mon[94114]: pgmap v4202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7.3 KiB/s wr, 7 op/s 2023-03-17T12:37:20.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:49 smithi078 ceph-mon[94114]: pgmap v4203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:37:20.138 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:51 smithi078 ceph-mon[94114]: pgmap v4204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:37:21.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:53 smithi078 ceph-mon[94114]: pgmap v4205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6 op/s 2023-03-17T12:37:21.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:55 smithi078 ceph-mon[94114]: pgmap v4206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 op/s 2023-03-17T12:37:21.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:57 smithi078 ceph-mon[94114]: pgmap v4207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:53:59 smithi078 ceph-mon[94114]: pgmap v4208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:01 smithi078 ceph-mon[94114]: pgmap v4209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:03 smithi078 ceph-mon[94114]: pgmap v4210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:05 smithi078 ceph-mon[94114]: pgmap v4211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:07 smithi078 ceph-mon[94114]: pgmap v4212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:09 smithi078 ceph-mon[94114]: pgmap v4213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:10 smithi078 ceph-mon[94114]: osdmap e336: 12 total, 12 up, 12 in 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:11 smithi078 ceph-mon[94114]: pgmap v4215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:13 smithi078 ceph-mon[94114]: pgmap v4216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:21.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:15 smithi078 ceph-mon[94114]: pgmap v4217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:21.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:17 smithi078 ceph-mon[94114]: pgmap v4218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:21.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:17 smithi078 ceph-mon[94114]: osdmap e337: 12 total, 12 up, 12 in 2023-03-17T12:37:21.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:19 smithi078 ceph-mon[94114]: pgmap v4220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2023-03-17T12:37:21.092 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:21 smithi078 ceph-mon[94114]: pgmap v4221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:21.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:23 smithi078 ceph-mon[94114]: pgmap v4222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:21.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:25 smithi078 ceph-mon[94114]: pgmap v4223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:37:21.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:27 smithi078 ceph-mon[94114]: pgmap v4224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2023-03-17T12:37:21.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:29 smithi078 ceph-mon[94114]: pgmap v4225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 12 op/s 2023-03-17T12:37:21.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:31 smithi078 ceph-mon[94114]: pgmap v4226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T12:37:21.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:33 smithi078 ceph-mon[94114]: pgmap v4227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2023-03-17T12:37:21.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:35 smithi078 ceph-mon[94114]: pgmap v4228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2023-03-17T12:37:21.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:37 smithi078 ceph-mon[94114]: pgmap v4229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:21.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:39 smithi078 ceph-mon[94114]: pgmap v4230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:21.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:41 smithi078 ceph-mon[94114]: pgmap v4231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:21.299 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:43 smithi078 ceph-mon[94114]: pgmap v4232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:21.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:21.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:45 smithi078 ceph-mon[94114]: pgmap v4233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:21.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:21.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:21.781 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:46 smithi078 ceph-mon[94114]: pgmap v4234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:48 smithi078 ceph-mon[94114]: pgmap v4235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:50 smithi078 ceph-mon[94114]: pgmap v4236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:52 smithi078 ceph-mon[94114]: pgmap v4237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:54 smithi078 ceph-mon[94114]: pgmap v4238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 15 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:56 smithi078 ceph-mon[94114]: pgmap v4239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:54:58 smithi078 ceph-mon[94114]: pgmap v4240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:00 smithi078 ceph-mon[94114]: pgmap v4241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:02 smithi078 ceph-mon[94114]: pgmap v4242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:04 smithi078 ceph-mon[94114]: pgmap v4243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:22.923 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:06 smithi078 ceph-mon[94114]: pgmap v4244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:23.492 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:08 smithi078 ceph-mon[94114]: pgmap v4245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:24.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:10 smithi078 ceph-mon[94114]: pgmap v4246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:24.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:10 smithi078 ceph-mon[94114]: osdmap e338: 12 total, 12 up, 12 in 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:12 smithi078 ceph-mon[94114]: pgmap v4248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:14 smithi078 ceph-mon[94114]: pgmap v4249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:16 smithi078 ceph-mon[94114]: pgmap v4250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:17 smithi078 ceph-mon[94114]: pgmap v4251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:17 smithi078 ceph-mon[94114]: osdmap e339: 12 total, 12 up, 12 in 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:19 smithi078 ceph-mon[94114]: pgmap v4253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 12 op/s 2023-03-17T12:37:26.020 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:21 smithi078 ceph-mon[94114]: pgmap v4254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:23 smithi078 ceph-mon[94114]: pgmap v4255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:25 smithi078 ceph-mon[94114]: pgmap v4256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:27 smithi078 ceph-mon[94114]: pgmap v4257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:29 smithi078 ceph-mon[94114]: pgmap v4258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:31 smithi078 ceph-mon[94114]: pgmap v4259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:33 smithi078 ceph-mon[94114]: pgmap v4260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:35 smithi078 ceph-mon[94114]: pgmap v4261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:37 smithi078 ceph-mon[94114]: pgmap v4262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:39 smithi078 ceph-mon[94114]: pgmap v4263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:41 smithi078 ceph-mon[94114]: pgmap v4264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:43 smithi078 ceph-mon[94114]: pgmap v4265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:26.021 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:27.462 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:46 smithi078 ceph-mon[94114]: pgmap v4266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:29.082 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:29.082 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:29.082 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:46 smithi078 ceph-mon[94114]: pgmap v4267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:30.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:46 smithi078 ceph-mon[94114]: pgmap v4268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:30.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:30.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:47 smithi078 ceph-mon[94114]: pgmap v4269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:32.914 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:50 smithi078 ceph-mon[94114]: pgmap v4270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:32.914 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:52 smithi078 ceph-mon[94114]: pgmap v4271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:37:32.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:54 smithi078 ceph-mon[94114]: pgmap v4272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:56 smithi078 ceph-mon[94114]: pgmap v4273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:55:57 smithi078 ceph-mon[94114]: pgmap v4274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:00 smithi078 ceph-mon[94114]: pgmap v4275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:02 smithi078 ceph-mon[94114]: pgmap v4276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:04 smithi078 ceph-mon[94114]: pgmap v4277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:06 smithi078 ceph-mon[94114]: pgmap v4278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:07 smithi078 ceph-mon[94114]: pgmap v4279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:09 smithi078 ceph-mon[94114]: osdmap e340: 12 total, 12 up, 12 in 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:09 smithi078 ceph-mon[94114]: pgmap v4281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:12 smithi078 ceph-mon[94114]: pgmap v4282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:14 smithi078 ceph-mon[94114]: pgmap v4283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:16 smithi078 ceph-mon[94114]: pgmap v4284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:17 smithi078 ceph-mon[94114]: osdmap e341: 12 total, 12 up, 12 in 2023-03-17T12:37:33.662 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:17 smithi078 ceph-mon[94114]: pgmap v4286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 13 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:20 smithi078 ceph-mon[94114]: pgmap v4287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:22 smithi078 ceph-mon[94114]: pgmap v4288: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:24 smithi078 ceph-mon[94114]: pgmap v4289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:26 smithi078 ceph-mon[94114]: pgmap v4290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:27 smithi078 ceph-mon[94114]: pgmap v4291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:30 smithi078 ceph-mon[94114]: pgmap v4292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:32 smithi078 ceph-mon[94114]: pgmap v4293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:34 smithi078 ceph-mon[94114]: pgmap v4294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:36 smithi078 ceph-mon[94114]: pgmap v4295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:37 smithi078 ceph-mon[94114]: pgmap v4296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:37:33.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:40 smithi078 ceph-mon[94114]: pgmap v4297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:42 smithi078 ceph-mon[94114]: pgmap v4298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:44 smithi078 ceph-mon[94114]: pgmap v4299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:46 smithi078 ceph-mon[94114]: pgmap v4300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:47 smithi078 ceph-mon[94114]: pgmap v4301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.9 KiB/s wr, 11 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:47 smithi078 ceph-mon[94114]: pgmap v4302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:49 smithi078 ceph-mon[94114]: pgmap v4303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:51 smithi078 ceph-mon[94114]: pgmap v4304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:52 smithi078 ceph-mon[94114]: pgmap v4305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:55 smithi078 ceph-mon[94114]: pgmap v4306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:57 smithi078 ceph-mon[94114]: pgmap v4307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:56:59 smithi078 ceph-mon[94114]: pgmap v4308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:33.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:01 smithi078 ceph-mon[94114]: pgmap v4309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:33.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:02 smithi078 ceph-mon[94114]: pgmap v4310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:37:33.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:05 smithi078 ceph-mon[94114]: pgmap v4311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:37:33.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:07 smithi078 ceph-mon[94114]: pgmap v4312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 49 KiB/s wr, 24 op/s 2023-03-17T12:37:33.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:09 smithi078 ceph-mon[94114]: pgmap v4313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2023-03-17T12:37:33.665 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:09 smithi078 ceph-mon[94114]: osdmap e342: 12 total, 12 up, 12 in 2023-03-17T12:37:37.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:11 smithi078 ceph-mon[94114]: pgmap v4315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 59 KiB/s wr, 29 op/s 2023-03-17T12:37:37.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:12 smithi078 ceph-mon[94114]: pgmap v4316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:37:37.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:15 smithi078 ceph-mon[94114]: pgmap v4317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:37:37.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:17 smithi078 ceph-mon[94114]: pgmap v4318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:37:37.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:17 smithi078 ceph-mon[94114]: osdmap e343: 12 total, 12 up, 12 in 2023-03-17T12:37:37.128 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:19 smithi078 ceph-mon[94114]: pgmap v4320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:21 smithi078 ceph-mon[94114]: pgmap v4321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:22 smithi078 ceph-mon[94114]: pgmap v4322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:25 smithi078 ceph-mon[94114]: pgmap v4323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:27 smithi078 ceph-mon[94114]: pgmap v4324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:29 smithi078 ceph-mon[94114]: pgmap v4325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:31 smithi078 ceph-mon[94114]: pgmap v4326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:33 smithi078 ceph-mon[94114]: pgmap v4327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:35 smithi078 ceph-mon[94114]: pgmap v4328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:37 smithi078 ceph-mon[94114]: pgmap v4329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:39 smithi078 ceph-mon[94114]: pgmap v4330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:41 smithi078 ceph-mon[94114]: pgmap v4331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:43 smithi078 ceph-mon[94114]: pgmap v4332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:45 smithi078 ceph-mon[94114]: pgmap v4333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:47 smithi078 ceph-mon[94114]: pgmap v4334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:37.129 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:48 smithi078 ceph-mon[94114]: pgmap v4335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 15 op/s 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:48 smithi078 ceph-mon[94114]: pgmap v4336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:50 smithi078 ceph-mon[94114]: pgmap v4337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:52 smithi078 ceph-mon[94114]: pgmap v4338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2023-03-17T12:37:37.130 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:54 smithi078 ceph-mon[94114]: pgmap v4339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:37.131 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:56 smithi078 ceph-mon[94114]: pgmap v4340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 12 op/s 2023-03-17T12:37:41.175 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:57:58 smithi078 ceph-mon[94114]: pgmap v4341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:37:41.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:00 smithi078 ceph-mon[94114]: pgmap v4342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:41.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:02 smithi078 ceph-mon[94114]: pgmap v4343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:41.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:04 smithi078 ceph-mon[94114]: pgmap v4344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:41.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:06 smithi078 ceph-mon[94114]: pgmap v4345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:41.176 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:08 smithi078 ceph-mon[94114]: pgmap v4346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:41.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:10 smithi078 ceph-mon[94114]: osdmap e344: 12 total, 12 up, 12 in 2023-03-17T12:37:41.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:10 smithi078 ceph-mon[94114]: pgmap v4348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:41.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:12 smithi078 ceph-mon[94114]: pgmap v4349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:42.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:14 smithi078 ceph-mon[94114]: pgmap v4350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:42.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:16 smithi078 ceph-mon[94114]: pgmap v4351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:45.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:18 smithi078 ceph-mon[94114]: osdmap e345: 12 total, 12 up, 12 in 2023-03-17T12:37:47.093 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:18 smithi078 ceph-mon[94114]: pgmap v4353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 250 B/s wr, 13 op/s 2023-03-17T12:37:47.093 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:20 smithi078 ceph-mon[94114]: pgmap v4354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:22 smithi078 ceph-mon[94114]: pgmap v4355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:24 smithi078 ceph-mon[94114]: pgmap v4356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:26 smithi078 ceph-mon[94114]: pgmap v4357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:28 smithi078 ceph-mon[94114]: pgmap v4358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 13 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:30 smithi078 ceph-mon[94114]: pgmap v4359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:32 smithi078 ceph-mon[94114]: pgmap v4360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:34 smithi078 ceph-mon[94114]: pgmap v4361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:36 smithi078 ceph-mon[94114]: pgmap v4362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:38 smithi078 ceph-mon[94114]: pgmap v4363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:40 smithi078 ceph-mon[94114]: pgmap v4364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:47.094 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:42 smithi078 ceph-mon[94114]: pgmap v4365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:48.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:44 smithi078 ceph-mon[94114]: pgmap v4366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:48.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:46 smithi078 ceph-mon[94114]: pgmap v4367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:37:48.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:48 smithi078 ceph-mon[94114]: pgmap v4368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:48.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:49 smithi078 ceph-mon[94114]: pgmap v4369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:51 smithi078 ceph-mon[94114]: pgmap v4370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:53 smithi078 ceph-mon[94114]: pgmap v4371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 14 op/s 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:55 smithi078 ceph-mon[94114]: pgmap v4372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T12:37:50.715 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:57 smithi078 ceph-mon[94114]: pgmap v4373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:58:59 smithi078 ceph-mon[94114]: pgmap v4374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:01 smithi078 ceph-mon[94114]: pgmap v4375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:03 smithi078 ceph-mon[94114]: pgmap v4376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:05 smithi078 ceph-mon[94114]: pgmap v4377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:07 smithi078 ceph-mon[94114]: pgmap v4378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:09 smithi078 ceph-mon[94114]: pgmap v4379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:09 smithi078 ceph-mon[94114]: osdmap e346: 12 total, 12 up, 12 in 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:11 smithi078 ceph-mon[94114]: pgmap v4381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:13 smithi078 ceph-mon[94114]: pgmap v4382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:15 smithi078 ceph-mon[94114]: pgmap v4383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:17 smithi078 ceph-mon[94114]: pgmap v4384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:17 smithi078 ceph-mon[94114]: osdmap e347: 12 total, 12 up, 12 in 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:19 smithi078 ceph-mon[94114]: pgmap v4386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 11 op/s 2023-03-17T12:37:50.716 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:21 smithi078 ceph-mon[94114]: pgmap v4387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:23 smithi078 ceph-mon[94114]: pgmap v4388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:25 smithi078 ceph-mon[94114]: pgmap v4389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:27 smithi078 ceph-mon[94114]: pgmap v4390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:29 smithi078 ceph-mon[94114]: pgmap v4391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 12 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:31 smithi078 ceph-mon[94114]: pgmap v4392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:33 smithi078 ceph-mon[94114]: pgmap v4393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:35 smithi078 ceph-mon[94114]: pgmap v4394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:37 smithi078 ceph-mon[94114]: pgmap v4395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:39 smithi078 ceph-mon[94114]: pgmap v4396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:41 smithi078 ceph-mon[94114]: pgmap v4397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:43 smithi078 ceph-mon[94114]: pgmap v4398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:45 smithi078 ceph-mon[94114]: pgmap v4399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:47 smithi078 ceph-mon[94114]: pgmap v4400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:49 smithi078 ceph-mon[94114]: pgmap v4401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:50.717 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:51 smithi078 ceph-mon[94114]: pgmap v4402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:50.718 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:37:50.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:37:50.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:37:50.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: pgmap v4403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: pgmap v4404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2023-03-17T12:37:52.334 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: pgmap v4405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:55 smithi078 ceph-mon[94114]: pgmap v4406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:57 smithi078 ceph-mon[94114]: pgmap v4407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 10:59:59 smithi078 ceph-mon[94114]: pgmap v4408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 KiB/s wr, 14 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:01 smithi078 ceph-mon[94114]: pgmap v4409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:03 smithi078 ceph-mon[94114]: pgmap v4410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:05 smithi078 ceph-mon[94114]: pgmap v4411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:07 smithi078 ceph-mon[94114]: pgmap v4412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 24 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:09 smithi078 ceph-mon[94114]: pgmap v4413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 50 KiB/s wr, 29 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:09 smithi078 ceph-mon[94114]: osdmap e348: 12 total, 12 up, 12 in 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:11 smithi078 ceph-mon[94114]: pgmap v4415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 60 KiB/s wr, 29 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:13 smithi078 ceph-mon[94114]: pgmap v4416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:15 smithi078 ceph-mon[94114]: pgmap v4417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:52.335 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:17 smithi078 ceph-mon[94114]: pgmap v4418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:52.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:17 smithi078 ceph-mon[94114]: osdmap e349: 12 total, 12 up, 12 in 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:19 smithi078 ceph-mon[94114]: pgmap v4420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:21 smithi078 ceph-mon[94114]: pgmap v4421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 12 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:23 smithi078 ceph-mon[94114]: pgmap v4422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:25 smithi078 ceph-mon[94114]: pgmap v4423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:27 smithi078 ceph-mon[94114]: pgmap v4424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:29 smithi078 ceph-mon[94114]: pgmap v4425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 89 B/s wr, 11 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:31 smithi078 ceph-mon[94114]: pgmap v4426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:33 smithi078 ceph-mon[94114]: pgmap v4427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:53.639 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:35 smithi078 ceph-mon[94114]: pgmap v4428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:55.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:37 smithi078 ceph-mon[94114]: pgmap v4429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:55.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:39 smithi078 ceph-mon[94114]: pgmap v4430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:55.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:41 smithi078 ceph-mon[94114]: pgmap v4431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:55.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:43 smithi078 ceph-mon[94114]: pgmap v4432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:55.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:45 smithi078 ceph-mon[94114]: pgmap v4433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:47 smithi078 ceph-mon[94114]: pgmap v4434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:49 smithi078 ceph-mon[94114]: pgmap v4435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:51 smithi078 ceph-mon[94114]: pgmap v4436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:53 smithi078 ceph-mon[94114]: pgmap v4437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:54 smithi078 ceph-mon[94114]: pgmap v4438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:54 smithi078 ceph-mon[94114]: pgmap v4439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:56 smithi078 ceph-mon[94114]: pgmap v4440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:00:58 smithi078 ceph-mon[94114]: pgmap v4441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:00 smithi078 ceph-mon[94114]: pgmap v4442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:02 smithi078 ceph-mon[94114]: pgmap v4443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:04 smithi078 ceph-mon[94114]: pgmap v4444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:06 smithi078 ceph-mon[94114]: pgmap v4445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:08 smithi078 ceph-mon[94114]: pgmap v4446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:37:55.378 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:10 smithi078 ceph-mon[94114]: osdmap e350: 12 total, 12 up, 12 in 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:10 smithi078 ceph-mon[94114]: pgmap v4448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:12 smithi078 ceph-mon[94114]: pgmap v4449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:14 smithi078 ceph-mon[94114]: pgmap v4450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:16 smithi078 ceph-mon[94114]: pgmap v4451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:18 smithi078 ceph-mon[94114]: osdmap e351: 12 total, 12 up, 12 in 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:18 smithi078 ceph-mon[94114]: pgmap v4453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 13 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:20 smithi078 ceph-mon[94114]: pgmap v4454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:22 smithi078 ceph-mon[94114]: pgmap v4455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 11 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:24 smithi078 ceph-mon[94114]: pgmap v4456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:25 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:26 smithi078 ceph-mon[94114]: pgmap v4457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 11 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:26 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:28 smithi078 ceph-mon[94114]: pgmap v4458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 293 KiB/s wr, 26 op/s 2023-03-17T12:37:55.379 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:28 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:37:55.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:30 smithi078 ceph-mon[94114]: pgmap v4459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 22 op/s 2023-03-17T12:37:55.380 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:32 smithi078 ceph-mon[94114]: pgmap v4460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 22 op/s 2023-03-17T12:37:56.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:34 smithi078 ceph-mon[94114]: pgmap v4461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 259 KiB/s wr, 29 op/s 2023-03-17T12:37:56.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:36 smithi078 ceph-mon[94114]: pgmap v4462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 259 KiB/s wr, 25 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:38 smithi078 ceph-mon[94114]: pgmap v4463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 266 KiB/s wr, 30 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:40 smithi078 ceph-mon[94114]: pgmap v4464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:42 smithi078 ceph-mon[94114]: pgmap v4465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:44 smithi078 ceph-mon[94114]: pgmap v4466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 16 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:46 smithi078 ceph-mon[94114]: pgmap v4467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 KiB/s wr, 9 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:48 smithi078 ceph-mon[94114]: pgmap v4468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 KiB/s wr, 13 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:50 smithi078 ceph-mon[94114]: pgmap v4469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:52 smithi078 ceph-mon[94114]: pgmap v4470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:54 smithi078 ceph-mon[94114]: pgmap v4471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.2 KiB/s wr, 25 op/s 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:37:56.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:55 smithi078 ceph-mon[94114]: pgmap v4472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 9.8 KiB/s wr, 22 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:55 smithi078 ceph-mon[94114]: pgmap v4473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:56 smithi078 ceph-mon[94114]: pgmap v4474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 12 KiB/s wr, 21 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:01:58 smithi078 ceph-mon[94114]: pgmap v4475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:00 smithi078 ceph-mon[94114]: pgmap v4476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 12 KiB/s wr, 27 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:03 smithi078 ceph-mon[94114]: pgmap v4477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:04 smithi078 ceph-mon[94114]: pgmap v4478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:06 smithi078 ceph-mon[94114]: pgmap v4479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:09 smithi078 ceph-mon[94114]: osdmap e352: 12 total, 12 up, 12 in 2023-03-17T12:37:56.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:09 smithi078 ceph-mon[94114]: pgmap v4481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:10 smithi078 ceph-mon[94114]: pgmap v4482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 29 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:13 smithi078 ceph-mon[94114]: pgmap v4483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:14 smithi078 ceph-mon[94114]: pgmap v4484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:16 smithi078 ceph-mon[94114]: pgmap v4485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:18 smithi078 ceph-mon[94114]: osdmap e353: 12 total, 12 up, 12 in 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:19 smithi078 ceph-mon[94114]: pgmap v4487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:20 smithi078 ceph-mon[94114]: pgmap v4488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:23 smithi078 ceph-mon[94114]: pgmap v4489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:24 smithi078 ceph-mon[94114]: pgmap v4490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:26 smithi078 ceph-mon[94114]: pgmap v4491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:28 smithi078 ceph-mon[94114]: pgmap v4492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 265 B/s wr, 9 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:30 smithi078 ceph-mon[94114]: pgmap v4493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:33 smithi078 ceph-mon[94114]: pgmap v4494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:37:58.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:34 smithi078 ceph-mon[94114]: pgmap v4495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:37:58.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:36 smithi078 ceph-mon[94114]: pgmap v4496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:37:58.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:38 smithi078 ceph-mon[94114]: pgmap v4497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:37:58.649 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:40 smithi078 ceph-mon[94114]: pgmap v4498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:00.032 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:43 smithi078 ceph-mon[94114]: pgmap v4499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:44 smithi078 ceph-mon[94114]: pgmap v4500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:46 smithi078 ceph-mon[94114]: pgmap v4501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:48 smithi078 ceph-mon[94114]: pgmap v4502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:50 smithi078 ceph-mon[94114]: pgmap v4503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:53 smithi078 ceph-mon[94114]: pgmap v4504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:54 smithi078 ceph-mon[94114]: pgmap v4505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:55 smithi078 ceph-mon[94114]: pgmap v4506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:38:00.033 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:55 smithi078 ceph-mon[94114]: pgmap v4507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:38:01.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:01.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:02:58 smithi078 ceph-mon[94114]: pgmap v4508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:38:01.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:00 smithi078 ceph-mon[94114]: pgmap v4509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:38:01.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:02 smithi078 ceph-mon[94114]: pgmap v4510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:38:01.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:04 smithi078 ceph-mon[94114]: pgmap v4511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:38:01.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:06 smithi078 ceph-mon[94114]: pgmap v4512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:01.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:08 smithi078 ceph-mon[94114]: pgmap v4513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:38:01.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:10 smithi078 ceph-mon[94114]: osdmap e354: 12 total, 12 up, 12 in 2023-03-17T12:38:01.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:10 smithi078 ceph-mon[94114]: pgmap v4515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:12 smithi078 ceph-mon[94114]: pgmap v4516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:14 smithi078 ceph-mon[94114]: pgmap v4517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:16 smithi078 ceph-mon[94114]: pgmap v4518: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:18 smithi078 ceph-mon[94114]: osdmap e355: 12 total, 12 up, 12 in 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:18 smithi078 ceph-mon[94114]: pgmap v4520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 244 B/s wr, 12 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:20 smithi078 ceph-mon[94114]: pgmap v4521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:22 smithi078 ceph-mon[94114]: pgmap v4522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:04.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:24 smithi078 ceph-mon[94114]: pgmap v4523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:04.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:26 smithi078 ceph-mon[94114]: pgmap v4524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:04.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:28 smithi078 ceph-mon[94114]: pgmap v4525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:30 smithi078 ceph-mon[94114]: pgmap v4526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:32 smithi078 ceph-mon[94114]: pgmap v4527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:34 smithi078 ceph-mon[94114]: pgmap v4528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:36 smithi078 ceph-mon[94114]: pgmap v4529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:38 smithi078 ceph-mon[94114]: pgmap v4530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:40 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:40 smithi078 ceph-mon[94114]: pgmap v4531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.741 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:41 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:42 smithi078 ceph-mon[94114]: pgmap v4532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:43 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:44 smithi078 ceph-mon[94114]: pgmap v4533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:46 smithi078 ceph-mon[94114]: pgmap v4534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:48 smithi078 ceph-mon[94114]: pgmap v4535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:50 smithi078 ceph-mon[94114]: pgmap v4536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:52 smithi078 ceph-mon[94114]: pgmap v4537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:04.742 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:54 smithi078 ceph-mon[94114]: pgmap v4538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:05.331 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:56 smithi078 ceph-mon[94114]: pgmap v4539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:57 smithi078 ceph-mon[94114]: pgmap v4540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:57 smithi078 ceph-mon[94114]: pgmap v4541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:03:59 smithi078 ceph-mon[94114]: pgmap v4542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:38:06.323 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:01 smithi078 ceph-mon[94114]: pgmap v4543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:03 smithi078 ceph-mon[94114]: pgmap v4544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:05 smithi078 ceph-mon[94114]: pgmap v4545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:07 smithi078 ceph-mon[94114]: pgmap v4546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:09 smithi078 ceph-mon[94114]: pgmap v4547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:10 smithi078 ceph-mon[94114]: osdmap e356: 12 total, 12 up, 12 in 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:11 smithi078 ceph-mon[94114]: pgmap v4549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:13 smithi078 ceph-mon[94114]: pgmap v4550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:15 smithi078 ceph-mon[94114]: pgmap v4551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:17 smithi078 ceph-mon[94114]: pgmap v4552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:17 smithi078 ceph-mon[94114]: osdmap e357: 12 total, 12 up, 12 in 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:19 smithi078 ceph-mon[94114]: pgmap v4554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:21 smithi078 ceph-mon[94114]: pgmap v4555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:23 smithi078 ceph-mon[94114]: pgmap v4556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:25 smithi078 ceph-mon[94114]: pgmap v4557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:38:06.324 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:27 smithi078 ceph-mon[94114]: pgmap v4558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:29 smithi078 ceph-mon[94114]: pgmap v4559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:31 smithi078 ceph-mon[94114]: pgmap v4560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:33 smithi078 ceph-mon[94114]: pgmap v4561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:35 smithi078 ceph-mon[94114]: pgmap v4562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:37 smithi078 ceph-mon[94114]: pgmap v4563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:39 smithi078 ceph-mon[94114]: pgmap v4564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:41 smithi078 ceph-mon[94114]: pgmap v4565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:43 smithi078 ceph-mon[94114]: pgmap v4566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:45 smithi078 ceph-mon[94114]: pgmap v4567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:47 smithi078 ceph-mon[94114]: pgmap v4568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:49 smithi078 ceph-mon[94114]: pgmap v4569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:51 smithi078 ceph-mon[94114]: pgmap v4570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:53 smithi078 ceph-mon[94114]: pgmap v4571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:55 smithi078 ceph-mon[94114]: pgmap v4572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:57 smithi078 ceph-mon[94114]: pgmap v4573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:06.325 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:58 smithi078 ceph-mon[94114]: pgmap v4574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 283 B/s wr, 14 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:04:58 smithi078 ceph-mon[94114]: pgmap v4575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:00 smithi078 ceph-mon[94114]: pgmap v4576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:02 smithi078 ceph-mon[94114]: pgmap v4577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:04 smithi078 ceph-mon[94114]: pgmap v4578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 KiB/s wr, 28 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:06 smithi078 ceph-mon[94114]: pgmap v4579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 KiB/s wr, 28 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:08 smithi078 ceph-mon[94114]: pgmap v4580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 27 KiB/s wr, 25 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:10 smithi078 ceph-mon[94114]: pgmap v4581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:12 smithi078 ceph-mon[94114]: pgmap v4582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:14 smithi078 ceph-mon[94114]: pgmap v4583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:16 smithi078 ceph-mon[94114]: pgmap v4584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:18 smithi078 ceph-mon[94114]: pgmap v4585: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:20 smithi078 ceph-mon[94114]: pgmap v4586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:06.326 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:22 smithi078 ceph-mon[94114]: pgmap v4587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:06.327 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:24 smithi078 ceph-mon[94114]: pgmap v4588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:38:06.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:26 smithi078 ceph-mon[94114]: pgmap v4589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:07.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:28 smithi078 ceph-mon[94114]: pgmap v4590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:07.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:30 smithi078 ceph-mon[94114]: pgmap v4591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.697 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:32 smithi078 ceph-mon[94114]: pgmap v4592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:34 smithi078 ceph-mon[94114]: pgmap v4593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:36 smithi078 ceph-mon[94114]: pgmap v4594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:38 smithi078 ceph-mon[94114]: pgmap v4595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:40 smithi078 ceph-mon[94114]: pgmap v4596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:42 smithi078 ceph-mon[94114]: pgmap v4597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:44 smithi078 ceph-mon[94114]: pgmap v4598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:46 smithi078 ceph-mon[94114]: pgmap v4599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:48 smithi078 ceph-mon[94114]: pgmap v4600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:50 smithi078 ceph-mon[94114]: pgmap v4601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:52 smithi078 ceph-mon[94114]: pgmap v4602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:54 smithi078 ceph-mon[94114]: pgmap v4603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:56 smithi078 ceph-mon[94114]: pgmap v4604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:58 smithi078 ceph-mon[94114]: pgmap v4605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:08.698 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:05:59 smithi078 ceph-mon[94114]: pgmap v4606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:01 smithi078 ceph-mon[94114]: pgmap v4607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:03 smithi078 ceph-mon[94114]: pgmap v4608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 27 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:05 smithi078 ceph-mon[94114]: pgmap v4609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:07 smithi078 ceph-mon[94114]: pgmap v4610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:09 smithi078 ceph-mon[94114]: pgmap v4611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:10 smithi078 ceph-mon[94114]: osdmap e358: 12 total, 12 up, 12 in 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:11 smithi078 ceph-mon[94114]: pgmap v4613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:13 smithi078 ceph-mon[94114]: pgmap v4614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:15 smithi078 ceph-mon[94114]: pgmap v4615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:17 smithi078 ceph-mon[94114]: pgmap v4616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:17 smithi078 ceph-mon[94114]: osdmap e359: 12 total, 12 up, 12 in 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:19 smithi078 ceph-mon[94114]: pgmap v4618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:21 smithi078 ceph-mon[94114]: pgmap v4619: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:23 smithi078 ceph-mon[94114]: pgmap v4620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:25 smithi078 ceph-mon[94114]: pgmap v4621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:08.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:27 smithi078 ceph-mon[94114]: pgmap v4622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:29 smithi078 ceph-mon[94114]: pgmap v4623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 850 B/s wr, 10 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:31 smithi078 ceph-mon[94114]: pgmap v4624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:33 smithi078 ceph-mon[94114]: pgmap v4625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:35 smithi078 ceph-mon[94114]: pgmap v4626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:37 smithi078 ceph-mon[94114]: pgmap v4627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:39 smithi078 ceph-mon[94114]: pgmap v4628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:41 smithi078 ceph-mon[94114]: pgmap v4629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:43 smithi078 ceph-mon[94114]: pgmap v4630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:45 smithi078 ceph-mon[94114]: pgmap v4631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:47 smithi078 ceph-mon[94114]: pgmap v4632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:49 smithi078 ceph-mon[94114]: pgmap v4633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:51 smithi078 ceph-mon[94114]: pgmap v4634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:53 smithi078 ceph-mon[94114]: pgmap v4635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:55 smithi078 ceph-mon[94114]: pgmap v4636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:57 smithi078 ceph-mon[94114]: pgmap v4637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:08.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:59 smithi078 ceph-mon[94114]: pgmap v4638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:06:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:00 smithi078 ceph-mon[94114]: pgmap v4639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:00 smithi078 ceph-mon[94114]: pgmap v4640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:02 smithi078 ceph-mon[94114]: pgmap v4641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:04 smithi078 ceph-mon[94114]: pgmap v4642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:06 smithi078 ceph-mon[94114]: pgmap v4643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:08 smithi078 ceph-mon[94114]: pgmap v4644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 26 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:10 smithi078 ceph-mon[94114]: pgmap v4645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:10 smithi078 ceph-mon[94114]: osdmap e360: 12 total, 12 up, 12 in 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:12 smithi078 ceph-mon[94114]: pgmap v4647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:14 smithi078 ceph-mon[94114]: pgmap v4648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:16 smithi078 ceph-mon[94114]: pgmap v4649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:08.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:18 smithi078 ceph-mon[94114]: pgmap v4650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:18 smithi078 ceph-mon[94114]: osdmap e361: 12 total, 12 up, 12 in 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:20 smithi078 ceph-mon[94114]: pgmap v4652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 967 B/s wr, 11 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:22 smithi078 ceph-mon[94114]: pgmap v4653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:24 smithi078 ceph-mon[94114]: pgmap v4654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:26 smithi078 ceph-mon[94114]: pgmap v4655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:28 smithi078 ceph-mon[94114]: pgmap v4656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:30 smithi078 ceph-mon[94114]: pgmap v4657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:32 smithi078 ceph-mon[94114]: pgmap v4658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:34 smithi078 ceph-mon[94114]: pgmap v4659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:36 smithi078 ceph-mon[94114]: pgmap v4660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:38 smithi078 ceph-mon[94114]: pgmap v4661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:40 smithi078 ceph-mon[94114]: pgmap v4662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:42 smithi078 ceph-mon[94114]: pgmap v4663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:44 smithi078 ceph-mon[94114]: pgmap v4664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:46 smithi078 ceph-mon[94114]: pgmap v4665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:48 smithi078 ceph-mon[94114]: pgmap v4666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:50 smithi078 ceph-mon[94114]: pgmap v4667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:52 smithi078 ceph-mon[94114]: pgmap v4668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:54 smithi078 ceph-mon[94114]: pgmap v4669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:08.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:56 smithi078 ceph-mon[94114]: pgmap v4670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:58 smithi078 ceph-mon[94114]: pgmap v4671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:08.703 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:07:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:10.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:00 smithi078 ceph-mon[94114]: pgmap v4672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:10.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:00 smithi078 ceph-mon[94114]: pgmap v4673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:00 smithi078 ceph-mon[94114]: pgmap v4674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:02 smithi078 ceph-mon[94114]: pgmap v4675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:04 smithi078 ceph-mon[94114]: pgmap v4676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:06 smithi078 ceph-mon[94114]: pgmap v4677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:08 smithi078 ceph-mon[94114]: pgmap v4678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:10 smithi078 ceph-mon[94114]: osdmap e362: 12 total, 12 up, 12 in 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:10 smithi078 ceph-mon[94114]: pgmap v4680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:12 smithi078 ceph-mon[94114]: pgmap v4681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:14 smithi078 ceph-mon[94114]: pgmap v4682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:16 smithi078 ceph-mon[94114]: pgmap v4683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:10.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:18 smithi078 ceph-mon[94114]: osdmap e363: 12 total, 12 up, 12 in 2023-03-17T12:38:10.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:18 smithi078 ceph-mon[94114]: pgmap v4685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-17T12:38:10.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:20 smithi078 ceph-mon[94114]: pgmap v4686: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:10.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:22 smithi078 ceph-mon[94114]: pgmap v4687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:10.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:24 smithi078 ceph-mon[94114]: pgmap v4688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:10.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:26 smithi078 ceph-mon[94114]: pgmap v4689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:10.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:28 smithi078 ceph-mon[94114]: pgmap v4690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:38:14.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:30 smithi078 ceph-mon[94114]: pgmap v4691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:14.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:32 smithi078 ceph-mon[94114]: pgmap v4692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:14.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:34 smithi078 ceph-mon[94114]: pgmap v4693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:14.963 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:36 smithi078 ceph-mon[94114]: pgmap v4694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:38 smithi078 ceph-mon[94114]: pgmap v4695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:40 smithi078 ceph-mon[94114]: pgmap v4696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:42 smithi078 ceph-mon[94114]: pgmap v4697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:44 smithi078 ceph-mon[94114]: pgmap v4698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:46 smithi078 ceph-mon[94114]: pgmap v4699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:48 smithi078 ceph-mon[94114]: pgmap v4700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:38:14.964 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:50 smithi078 ceph-mon[94114]: pgmap v4701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:38:14.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:52 smithi078 ceph-mon[94114]: pgmap v4702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:38:14.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:54 smithi078 ceph-mon[94114]: pgmap v4703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 13 op/s 2023-03-17T12:38:14.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:56 smithi078 ceph-mon[94114]: pgmap v4704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:14.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:08:58 smithi078 ceph-mon[94114]: pgmap v4705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:00 smithi078 ceph-mon[94114]: pgmap v4706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:02 smithi078 ceph-mon[94114]: pgmap v4707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 272 B/s wr, 9 op/s 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:02 smithi078 ceph-mon[94114]: pgmap v4708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 331 B/s wr, 11 op/s 2023-03-17T12:38:14.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:04 smithi078 ceph-mon[94114]: pgmap v4709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 58 KiB/s wr, 29 op/s 2023-03-17T12:38:17.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:04 smithi078 ceph-mon[94114]: osdmap e364: 12 total, 12 up, 12 in 2023-03-17T12:38:17.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:06 smithi078 ceph-mon[94114]: pgmap v4711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 73 KiB/s wr, 30 op/s 2023-03-17T12:38:17.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:08 smithi078 ceph-mon[94114]: pgmap v4712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 74 KiB/s wr, 38 op/s 2023-03-17T12:38:17.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:10 smithi078 ceph-mon[94114]: pgmap v4713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 68 KiB/s wr, 35 op/s 2023-03-17T12:38:17.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:12 smithi078 ceph-mon[94114]: pgmap v4714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:38:17.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:12 smithi078 ceph-mon[94114]: osdmap e365: 12 total, 12 up, 12 in 2023-03-17T12:38:17.229 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:14 smithi078 ceph-mon[94114]: pgmap v4716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2023-03-17T12:38:20.375 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:16 smithi078 ceph-mon[94114]: pgmap v4717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:18 smithi078 ceph-mon[94114]: pgmap v4718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:20 smithi078 ceph-mon[94114]: pgmap v4719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:22 smithi078 ceph-mon[94114]: pgmap v4720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:24 smithi078 ceph-mon[94114]: pgmap v4721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 381 B/s wr, 9 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:26 smithi078 ceph-mon[94114]: pgmap v4722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:28 smithi078 ceph-mon[94114]: pgmap v4723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:30 smithi078 ceph-mon[94114]: pgmap v4724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:32 smithi078 ceph-mon[94114]: pgmap v4725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:34 smithi078 ceph-mon[94114]: pgmap v4726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:36 smithi078 ceph-mon[94114]: pgmap v4727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:38 smithi078 ceph-mon[94114]: pgmap v4728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:40 smithi078 ceph-mon[94114]: pgmap v4729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:42 smithi078 ceph-mon[94114]: pgmap v4730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:44 smithi078 ceph-mon[94114]: pgmap v4731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:46 smithi078 ceph-mon[94114]: pgmap v4732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:48 smithi078 ceph-mon[94114]: pgmap v4733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:50 smithi078 ceph-mon[94114]: pgmap v4734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:52 smithi078 ceph-mon[94114]: pgmap v4735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:54 smithi078 ceph-mon[94114]: pgmap v4736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:56 smithi078 ceph-mon[94114]: pgmap v4737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:20.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:09:58 smithi078 ceph-mon[94114]: pgmap v4738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:22.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:00 smithi078 ceph-mon[94114]: pgmap v4739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:22.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:38:22.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:02 smithi078 ceph-mon[94114]: pgmap v4740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: pgmap v4741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:06 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:06 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:06 smithi078 ceph-mon[94114]: pgmap v4742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:06 smithi078 ceph-mon[94114]: pgmap v4743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:38:22.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:08 smithi078 ceph-mon[94114]: pgmap v4744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 54 KiB/s wr, 22 op/s 2023-03-17T12:38:22.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:09 smithi078 ceph-mon[94114]: osdmap e366: 12 total, 12 up, 12 in 2023-03-17T12:38:23.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:10 smithi078 ceph-mon[94114]: pgmap v4746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 68 KiB/s wr, 35 op/s 2023-03-17T12:38:23.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:12 smithi078 ceph-mon[94114]: pgmap v4747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 129 B/s wr, 6 op/s 2023-03-17T12:38:23.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:14 smithi078 ceph-mon[94114]: pgmap v4748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:23.915 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:16 smithi078 ceph-mon[94114]: pgmap v4749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:26.207 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:18 smithi078 ceph-mon[94114]: pgmap v4750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:26.208 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:18 smithi078 ceph-mon[94114]: osdmap e367: 12 total, 12 up, 12 in 2023-03-17T12:38:27.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:20 smithi078 ceph-mon[94114]: pgmap v4752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:29.524 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:22 smithi078 ceph-mon[94114]: pgmap v4753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:29.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:24 smithi078 ceph-mon[94114]: pgmap v4754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:29.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:26 smithi078 ceph-mon[94114]: pgmap v4755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:29.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:28 smithi078 ceph-mon[94114]: pgmap v4756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:29.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:30 smithi078 ceph-mon[94114]: pgmap v4757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:38:29.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:32 smithi078 ceph-mon[94114]: pgmap v4758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:29.525 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:34 smithi078 ceph-mon[94114]: pgmap v4759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:29.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:36 smithi078 ceph-mon[94114]: pgmap v4760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:29.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:38 smithi078 ceph-mon[94114]: pgmap v4761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:29.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:40 smithi078 ceph-mon[94114]: pgmap v4762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:29.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:42 smithi078 ceph-mon[94114]: pgmap v4763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:29.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:44 smithi078 ceph-mon[94114]: pgmap v4764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:29.526 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:46 smithi078 ceph-mon[94114]: pgmap v4765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:31.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:48 smithi078 ceph-mon[94114]: pgmap v4766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:31.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:50 smithi078 ceph-mon[94114]: pgmap v4767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:31.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:52 smithi078 ceph-mon[94114]: pgmap v4768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:31.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:54 smithi078 ceph-mon[94114]: pgmap v4769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:56 smithi078 ceph-mon[94114]: pgmap v4770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:10:58 smithi078 ceph-mon[94114]: pgmap v4771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:00 smithi078 ceph-mon[94114]: pgmap v4772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:02 smithi078 ceph-mon[94114]: pgmap v4773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:04 smithi078 ceph-mon[94114]: pgmap v4774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:06 smithi078 ceph-mon[94114]: pgmap v4775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:38:31.178 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:08 smithi078 ceph-mon[94114]: pgmap v4776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: pgmap v4777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: pgmap v4778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:09 smithi078 ceph-mon[94114]: osdmap e368: 12 total, 12 up, 12 in 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:11 smithi078 ceph-mon[94114]: pgmap v4780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 128 B/s wr, 6 op/s 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:14 smithi078 ceph-mon[94114]: pgmap v4781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 256 B/s wr, 13 op/s 2023-03-17T12:38:31.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:16 smithi078 ceph-mon[94114]: pgmap v4782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 256 B/s wr, 13 op/s 2023-03-17T12:38:32.140 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:18 smithi078 ceph-mon[94114]: pgmap v4783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:38:34.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:18 smithi078 ceph-mon[94114]: osdmap e369: 12 total, 12 up, 12 in 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:20 smithi078 ceph-mon[94114]: pgmap v4785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 962 B/s wr, 11 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:22 smithi078 ceph-mon[94114]: pgmap v4786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:24 smithi078 ceph-mon[94114]: pgmap v4787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:26 smithi078 ceph-mon[94114]: pgmap v4788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:28 smithi078 ceph-mon[94114]: pgmap v4789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:30 smithi078 ceph-mon[94114]: pgmap v4790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 263 B/s wr, 8 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:32 smithi078 ceph-mon[94114]: pgmap v4791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:34 smithi078 ceph-mon[94114]: pgmap v4792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:38.162 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:36 smithi078 ceph-mon[94114]: pgmap v4793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:38.844 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:38 smithi078 ceph-mon[94114]: pgmap v4794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:39.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:40 smithi078 ceph-mon[94114]: pgmap v4795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:39.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:42 smithi078 ceph-mon[94114]: pgmap v4796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:39.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:44 smithi078 ceph-mon[94114]: pgmap v4797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:39.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:46 smithi078 ceph-mon[94114]: pgmap v4798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:48 smithi078 ceph-mon[94114]: pgmap v4799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:50 smithi078 ceph-mon[94114]: pgmap v4800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:52 smithi078 ceph-mon[94114]: pgmap v4801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:54 smithi078 ceph-mon[94114]: pgmap v4802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:56 smithi078 ceph-mon[94114]: pgmap v4803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:11:58 smithi078 ceph-mon[94114]: pgmap v4804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:00 smithi078 ceph-mon[94114]: pgmap v4805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:02 smithi078 ceph-mon[94114]: pgmap v4806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:39.399 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:04 smithi078 ceph-mon[94114]: pgmap v4807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:38:39.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:06 smithi078 ceph-mon[94114]: pgmap v4808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:38:39.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:08 smithi078 ceph-mon[94114]: pgmap v4809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:38:39.953 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:09 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:10 smithi078 ceph-mon[94114]: pgmap v4810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:10 smithi078 ceph-mon[94114]: osdmap e370: 12 total, 12 up, 12 in 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:12 smithi078 ceph-mon[94114]: pgmap v4812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:39.954 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:13 smithi078 ceph-mon[94114]: pgmap v4813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:15 smithi078 ceph-mon[94114]: pgmap v4814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:17 smithi078 ceph-mon[94114]: pgmap v4815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 969 B/s wr, 11 op/s 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:17 smithi078 ceph-mon[94114]: osdmap e371: 12 total, 12 up, 12 in 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:19 smithi078 ceph-mon[94114]: pgmap v4817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 112 B/s wr, 11 op/s 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:21 smithi078 ceph-mon[94114]: pgmap v4818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 107 B/s wr, 10 op/s 2023-03-17T12:38:42.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:23 smithi078 ceph-mon[94114]: pgmap v4819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:42.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:25 smithi078 ceph-mon[94114]: pgmap v4820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:42.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:27 smithi078 ceph-mon[94114]: pgmap v4821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:42.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:29 smithi078 ceph-mon[94114]: pgmap v4822: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:38:42.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:31 smithi078 ceph-mon[94114]: pgmap v4823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:33 smithi078 ceph-mon[94114]: pgmap v4824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:35 smithi078 ceph-mon[94114]: pgmap v4825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:37 smithi078 ceph-mon[94114]: pgmap v4826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:39 smithi078 ceph-mon[94114]: pgmap v4827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:41 smithi078 ceph-mon[94114]: pgmap v4828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.709 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:43 smithi078 ceph-mon[94114]: pgmap v4829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:45 smithi078 ceph-mon[94114]: pgmap v4830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:47 smithi078 ceph-mon[94114]: pgmap v4831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:49 smithi078 ceph-mon[94114]: pgmap v4832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:51 smithi078 ceph-mon[94114]: pgmap v4833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:53 smithi078 ceph-mon[94114]: pgmap v4834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:55 smithi078 ceph-mon[94114]: pgmap v4835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:57 smithi078 ceph-mon[94114]: pgmap v4836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:12:59 smithi078 ceph-mon[94114]: pgmap v4837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:01 smithi078 ceph-mon[94114]: pgmap v4838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:03 smithi078 ceph-mon[94114]: pgmap v4839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:05 smithi078 ceph-mon[94114]: pgmap v4840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:07 smithi078 ceph-mon[94114]: pgmap v4841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:09 smithi078 ceph-mon[94114]: pgmap v4842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:38:44.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:09 smithi078 ceph-mon[94114]: osdmap e372: 12 total, 12 up, 12 in 2023-03-17T12:38:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:11 smithi078 ceph-mon[94114]: pgmap v4844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:13 smithi078 ceph-mon[94114]: pgmap v4845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:15 smithi078 ceph-mon[94114]: pgmap v4846: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:44.711 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:49.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:49.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:17 smithi078 ceph-mon[94114]: pgmap v4847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:18 smithi078 ceph-mon[94114]: osdmap e373: 12 total, 12 up, 12 in 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:19 smithi078 ceph-mon[94114]: pgmap v4849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:21 smithi078 ceph-mon[94114]: pgmap v4850: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:23 smithi078 ceph-mon[94114]: pgmap v4851: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:25 smithi078 ceph-mon[94114]: pgmap v4852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:27 smithi078 ceph-mon[94114]: pgmap v4853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:29 smithi078 ceph-mon[94114]: pgmap v4854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 844 B/s wr, 9 op/s 2023-03-17T12:38:49.278 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:31 smithi078 ceph-mon[94114]: pgmap v4855: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:38:50.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:33 smithi078 ceph-mon[94114]: pgmap v4856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:38:50.349 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:35 smithi078 ceph-mon[94114]: pgmap v4857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:51.251 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:37 smithi078 ceph-mon[94114]: pgmap v4858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:51.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:39 smithi078 ceph-mon[94114]: pgmap v4859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:51.252 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:41 smithi078 ceph-mon[94114]: pgmap v4860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:43 smithi078 ceph-mon[94114]: pgmap v4861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:45 smithi078 ceph-mon[94114]: pgmap v4862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:47 smithi078 ceph-mon[94114]: pgmap v4863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:49 smithi078 ceph-mon[94114]: pgmap v4864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:51 smithi078 ceph-mon[94114]: pgmap v4865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:53 smithi078 ceph-mon[94114]: pgmap v4866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:55 smithi078 ceph-mon[94114]: pgmap v4867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:57 smithi078 ceph-mon[94114]: pgmap v4868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:13:59 smithi078 ceph-mon[94114]: pgmap v4869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:01 smithi078 ceph-mon[94114]: pgmap v4870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:03 smithi078 ceph-mon[94114]: pgmap v4871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:05 smithi078 ceph-mon[94114]: pgmap v4872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:07 smithi078 ceph-mon[94114]: pgmap v4873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:09 smithi078 ceph-mon[94114]: pgmap v4874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:38:52.309 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:10 smithi078 ceph-mon[94114]: osdmap e374: 12 total, 12 up, 12 in 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:11 smithi078 ceph-mon[94114]: pgmap v4876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:13 smithi078 ceph-mon[94114]: pgmap v4877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:15 smithi078 ceph-mon[94114]: pgmap v4878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:17 smithi078 ceph-mon[94114]: pgmap v4879: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:17 smithi078 ceph-mon[94114]: osdmap e375: 12 total, 12 up, 12 in 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:18 smithi078 ceph-mon[94114]: pgmap v4880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:18 smithi078 ceph-mon[94114]: pgmap v4881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:20 smithi078 ceph-mon[94114]: pgmap v4883: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:22 smithi078 ceph-mon[94114]: pgmap v4884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:24 smithi078 ceph-mon[94114]: pgmap v4885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:26 smithi078 ceph-mon[94114]: pgmap v4886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:28 smithi078 ceph-mon[94114]: pgmap v4887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:38:52.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:30 smithi078 ceph-mon[94114]: pgmap v4888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:38:52.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:32 smithi078 ceph-mon[94114]: pgmap v4889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:52.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:34 smithi078 ceph-mon[94114]: pgmap v4890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:52.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:36 smithi078 ceph-mon[94114]: pgmap v4891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:53.722 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:38 smithi078 ceph-mon[94114]: pgmap v4892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:53.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:40 smithi078 ceph-mon[94114]: pgmap v4893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:53.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:42 smithi078 ceph-mon[94114]: pgmap v4894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:53.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:44 smithi078 ceph-mon[94114]: pgmap v4895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:53.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:46 smithi078 ceph-mon[94114]: pgmap v4896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:53.723 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:48 smithi078 ceph-mon[94114]: pgmap v4897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:50 smithi078 ceph-mon[94114]: pgmap v4898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:52 smithi078 ceph-mon[94114]: pgmap v4899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:54 smithi078 ceph-mon[94114]: pgmap v4900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:56 smithi078 ceph-mon[94114]: pgmap v4901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:14:58 smithi078 ceph-mon[94114]: pgmap v4902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:00 smithi078 ceph-mon[94114]: pgmap v4903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:55.125 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:02 smithi078 ceph-mon[94114]: pgmap v4904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:38:56.734 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:04 smithi078 ceph-mon[94114]: pgmap v4905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:38:56.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:06 smithi078 ceph-mon[94114]: pgmap v4906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:38:56.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:08 smithi078 ceph-mon[94114]: pgmap v4907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:38:56.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:09 smithi078 ceph-mon[94114]: osdmap e376: 12 total, 12 up, 12 in 2023-03-17T12:38:56.735 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:10 smithi078 ceph-mon[94114]: pgmap v4909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:57.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:12 smithi078 ceph-mon[94114]: pgmap v4910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:38:57.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:14 smithi078 ceph-mon[94114]: pgmap v4911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:00.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:16 smithi078 ceph-mon[94114]: pgmap v4912: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:00.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:00.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:17 smithi078 ceph-mon[94114]: osdmap e377: 12 total, 12 up, 12 in 2023-03-17T12:39:00.997 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:18 smithi078 ceph-mon[94114]: pgmap v4913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 818 B/s wr, 10 op/s 2023-03-17T12:39:03.744 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:03.744 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:03.744 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:03.744 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:19 smithi078 ceph-mon[94114]: pgmap v4915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:39:05.608 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:19 smithi078 ceph-mon[94114]: pgmap v4916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:39:05.608 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:21 smithi078 ceph-mon[94114]: pgmap v4917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:39:05.608 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:23 smithi078 ceph-mon[94114]: pgmap v4918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:25 smithi078 ceph-mon[94114]: pgmap v4919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:27 smithi078 ceph-mon[94114]: pgmap v4920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:29 smithi078 ceph-mon[94114]: pgmap v4921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:31 smithi078 ceph-mon[94114]: pgmap v4922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:33 smithi078 ceph-mon[94114]: pgmap v4923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:35 smithi078 ceph-mon[94114]: pgmap v4924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:37 smithi078 ceph-mon[94114]: pgmap v4925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:39 smithi078 ceph-mon[94114]: pgmap v4926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:41 smithi078 ceph-mon[94114]: pgmap v4927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:43 smithi078 ceph-mon[94114]: pgmap v4928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:45 smithi078 ceph-mon[94114]: pgmap v4929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:47 smithi078 ceph-mon[94114]: pgmap v4930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:49 smithi078 ceph-mon[94114]: pgmap v4931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:51 smithi078 ceph-mon[94114]: pgmap v4932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:53 smithi078 ceph-mon[94114]: pgmap v4933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:55 smithi078 ceph-mon[94114]: pgmap v4934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:39:05.610 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:57 smithi078 ceph-mon[94114]: pgmap v4935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.610 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:15:59 smithi078 ceph-mon[94114]: pgmap v4936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:05.610 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:01 smithi078 ceph-mon[94114]: pgmap v4937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:05.610 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:03 smithi078 ceph-mon[94114]: pgmap v4938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 23 KiB/s wr, 14 op/s 2023-03-17T12:39:07.237 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:05 smithi078 ceph-mon[94114]: pgmap v4939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:07 smithi078 ceph-mon[94114]: pgmap v4940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:09 smithi078 ceph-mon[94114]: pgmap v4941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:09 smithi078 ceph-mon[94114]: osdmap e378: 12 total, 12 up, 12 in 2023-03-17T12:39:07.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:11 smithi078 ceph-mon[94114]: pgmap v4943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:13 smithi078 ceph-mon[94114]: pgmap v4944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 25 op/s 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:15 smithi078 ceph-mon[94114]: pgmap v4945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:17 smithi078 ceph-mon[94114]: pgmap v4946: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:17 smithi078 ceph-mon[94114]: osdmap e379: 12 total, 12 up, 12 in 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:19 smithi078 ceph-mon[94114]: pgmap v4948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:39:08.246 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:19 smithi078 ceph-mon[94114]: pgmap v4949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:19 smithi078 ceph-mon[94114]: pgmap v4950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 150 B/s wr, 9 op/s 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:21 smithi078 ceph-mon[94114]: pgmap v4951: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:23 smithi078 ceph-mon[94114]: pgmap v4952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:25 smithi078 ceph-mon[94114]: pgmap v4953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:39:10.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:27 smithi078 ceph-mon[94114]: pgmap v4954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:29 smithi078 ceph-mon[94114]: pgmap v4955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:31 smithi078 ceph-mon[94114]: pgmap v4956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:33 smithi078 ceph-mon[94114]: pgmap v4957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:35 smithi078 ceph-mon[94114]: pgmap v4958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:37 smithi078 ceph-mon[94114]: pgmap v4959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:39 smithi078 ceph-mon[94114]: pgmap v4960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:41 smithi078 ceph-mon[94114]: pgmap v4961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:43 smithi078 ceph-mon[94114]: pgmap v4962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:45 smithi078 ceph-mon[94114]: pgmap v4963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:47 smithi078 ceph-mon[94114]: pgmap v4964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:49 smithi078 ceph-mon[94114]: pgmap v4965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:51 smithi078 ceph-mon[94114]: pgmap v4966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:53 smithi078 ceph-mon[94114]: pgmap v4967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:55 smithi078 ceph-mon[94114]: pgmap v4968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:57 smithi078 ceph-mon[94114]: pgmap v4969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:16:59 smithi078 ceph-mon[94114]: pgmap v4970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:10.402 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:01 smithi078 ceph-mon[94114]: pgmap v4971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:39:10.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:03 smithi078 ceph-mon[94114]: pgmap v4972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:39:10.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:05 smithi078 ceph-mon[94114]: pgmap v4973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:10.403 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:07 smithi078 ceph-mon[94114]: pgmap v4974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:09 smithi078 ceph-mon[94114]: pgmap v4975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:09 smithi078 ceph-mon[94114]: osdmap e380: 12 total, 12 up, 12 in 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:11 smithi078 ceph-mon[94114]: pgmap v4977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:13 smithi078 ceph-mon[94114]: pgmap v4978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:15 smithi078 ceph-mon[94114]: pgmap v4979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:17 smithi078 ceph-mon[94114]: pgmap v4980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:14.336 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:17 smithi078 ceph-mon[94114]: osdmap e381: 12 total, 12 up, 12 in 2023-03-17T12:39:14.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:19 smithi078 ceph-mon[94114]: pgmap v4982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:39:14.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:14.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:14.337 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:17.034 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:17.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:20 smithi078 ceph-mon[94114]: pgmap v4983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:39:17.035 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:20 smithi078 ceph-mon[94114]: pgmap v4984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:39:19.053 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:22 smithi078 ceph-mon[94114]: pgmap v4985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:39:19.053 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:24 smithi078 ceph-mon[94114]: pgmap v4986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:39:19.053 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:26 smithi078 ceph-mon[94114]: pgmap v4987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:39:19.053 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:28 smithi078 ceph-mon[94114]: pgmap v4988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:30 smithi078 ceph-mon[94114]: pgmap v4989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:32 smithi078 ceph-mon[94114]: pgmap v4990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:34 smithi078 ceph-mon[94114]: pgmap v4991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:36 smithi078 ceph-mon[94114]: pgmap v4992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:38 smithi078 ceph-mon[94114]: pgmap v4993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:40 smithi078 ceph-mon[94114]: pgmap v4994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:42 smithi078 ceph-mon[94114]: pgmap v4995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:44 smithi078 ceph-mon[94114]: pgmap v4996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:46 smithi078 ceph-mon[94114]: pgmap v4997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:48 smithi078 ceph-mon[94114]: pgmap v4998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:50 smithi078 ceph-mon[94114]: pgmap v4999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:52 smithi078 ceph-mon[94114]: pgmap v5000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:54 smithi078 ceph-mon[94114]: pgmap v5001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:56 smithi078 ceph-mon[94114]: pgmap v5002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:17:58 smithi078 ceph-mon[94114]: pgmap v5003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:00 smithi078 ceph-mon[94114]: pgmap v5004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:19.054 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:02 smithi078 ceph-mon[94114]: pgmap v5005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:19.055 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:04 smithi078 ceph-mon[94114]: pgmap v5006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:20.451 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:06 smithi078 ceph-mon[94114]: pgmap v5007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:39:20.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:08 smithi078 ceph-mon[94114]: pgmap v5008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:10 smithi078 ceph-mon[94114]: osdmap e382: 12 total, 12 up, 12 in 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:10 smithi078 ceph-mon[94114]: pgmap v5010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:12 smithi078 ceph-mon[94114]: pgmap v5011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:14 smithi078 ceph-mon[94114]: pgmap v5012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:16 smithi078 ceph-mon[94114]: pgmap v5013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:18 smithi078 ceph-mon[94114]: osdmap e383: 12 total, 12 up, 12 in 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:18 smithi078 ceph-mon[94114]: pgmap v5015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 124 B/s wr, 12 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:20 smithi078 ceph-mon[94114]: pgmap v5016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:21 smithi078 ceph-mon[94114]: pgmap v5017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 115 B/s wr, 11 op/s 2023-03-17T12:39:21.168 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:21 smithi078 ceph-mon[94114]: pgmap v5018: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:23 smithi078 ceph-mon[94114]: pgmap v5019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 149 B/s wr, 14 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:25 smithi078 ceph-mon[94114]: pgmap v5020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:27 smithi078 ceph-mon[94114]: pgmap v5021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:29 smithi078 ceph-mon[94114]: pgmap v5022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:31 smithi078 ceph-mon[94114]: pgmap v5023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:33 smithi078 ceph-mon[94114]: pgmap v5024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:35 smithi078 ceph-mon[94114]: pgmap v5025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:37 smithi078 ceph-mon[94114]: pgmap v5026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:39 smithi078 ceph-mon[94114]: pgmap v5027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:41 smithi078 ceph-mon[94114]: pgmap v5028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:43 smithi078 ceph-mon[94114]: pgmap v5029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:45 smithi078 ceph-mon[94114]: pgmap v5030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:47 smithi078 ceph-mon[94114]: pgmap v5031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:49 smithi078 ceph-mon[94114]: pgmap v5032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:51 smithi078 ceph-mon[94114]: pgmap v5033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:53 smithi078 ceph-mon[94114]: pgmap v5034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:55 smithi078 ceph-mon[94114]: pgmap v5035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:57 smithi078 ceph-mon[94114]: pgmap v5036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:18:59 smithi078 ceph-mon[94114]: pgmap v5037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:01 smithi078 ceph-mon[94114]: pgmap v5038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:03 smithi078 ceph-mon[94114]: pgmap v5039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:05 smithi078 ceph-mon[94114]: pgmap v5040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:21.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:07 smithi078 ceph-mon[94114]: pgmap v5041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:22.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:09 smithi078 ceph-mon[94114]: pgmap v5042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:22.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:09 smithi078 ceph-mon[94114]: osdmap e384: 12 total, 12 up, 12 in 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:11 smithi078 ceph-mon[94114]: pgmap v5044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:13 smithi078 ceph-mon[94114]: pgmap v5045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:15 smithi078 ceph-mon[94114]: pgmap v5046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:17 smithi078 ceph-mon[94114]: pgmap v5047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:17 smithi078 ceph-mon[94114]: osdmap e385: 12 total, 12 up, 12 in 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:19 smithi078 ceph-mon[94114]: pgmap v5049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:21 smithi078 ceph-mon[94114]: pgmap v5050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:22 smithi078 ceph-mon[94114]: pgmap v5051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 110 B/s wr, 5 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:22 smithi078 ceph-mon[94114]: pgmap v5052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:24 smithi078 ceph-mon[94114]: pgmap v5053: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 140 B/s wr, 14 op/s 2023-03-17T12:39:22.612 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:26 smithi078 ceph-mon[94114]: pgmap v5054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:28 smithi078 ceph-mon[94114]: pgmap v5055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:30 smithi078 ceph-mon[94114]: pgmap v5056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:32 smithi078 ceph-mon[94114]: pgmap v5057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:34 smithi078 ceph-mon[94114]: pgmap v5058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:36 smithi078 ceph-mon[94114]: pgmap v5059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:38 smithi078 ceph-mon[94114]: pgmap v5060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:40 smithi078 ceph-mon[94114]: pgmap v5061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:42 smithi078 ceph-mon[94114]: pgmap v5062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:44 smithi078 ceph-mon[94114]: pgmap v5063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:46 smithi078 ceph-mon[94114]: pgmap v5064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:48 smithi078 ceph-mon[94114]: pgmap v5065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:50 smithi078 ceph-mon[94114]: pgmap v5066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:52 smithi078 ceph-mon[94114]: pgmap v5067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:54 smithi078 ceph-mon[94114]: pgmap v5068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:56 smithi078 ceph-mon[94114]: pgmap v5069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.613 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:19:58 smithi078 ceph-mon[94114]: pgmap v5070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:22.614 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:00 smithi078 ceph-mon[94114]: pgmap v5071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:22.614 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:39:23.866 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:02 smithi078 ceph-mon[94114]: pgmap v5072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:24.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:04 smithi078 ceph-mon[94114]: pgmap v5073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:39:24.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:06 smithi078 ceph-mon[94114]: pgmap v5074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:24.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:08 smithi078 ceph-mon[94114]: pgmap v5075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:24.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:10 smithi078 ceph-mon[94114]: osdmap e386: 12 total, 12 up, 12 in 2023-03-17T12:39:24.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:10 smithi078 ceph-mon[94114]: pgmap v5077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:24.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:12 smithi078 ceph-mon[94114]: pgmap v5078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:14 smithi078 ceph-mon[94114]: pgmap v5079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:16 smithi078 ceph-mon[94114]: pgmap v5080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:18 smithi078 ceph-mon[94114]: osdmap e387: 12 total, 12 up, 12 in 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:18 smithi078 ceph-mon[94114]: pgmap v5082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 246 B/s wr, 12 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:20 smithi078 ceph-mon[94114]: pgmap v5083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:22 smithi078 ceph-mon[94114]: pgmap v5084: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:24 smithi078 ceph-mon[94114]: pgmap v5085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:24.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:24.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:26 smithi078 ceph-mon[94114]: pgmap v5086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:25.795 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: pgmap v5087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: pgmap v5088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:29 smithi078 ceph-mon[94114]: pgmap v5089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:31 smithi078 ceph-mon[94114]: pgmap v5090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:33 smithi078 ceph-mon[94114]: pgmap v5091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:39:25.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:35 smithi078 ceph-mon[94114]: pgmap v5092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:39:25.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:37 smithi078 ceph-mon[94114]: pgmap v5093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:25.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:39 smithi078 ceph-mon[94114]: pgmap v5094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:25.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:41 smithi078 ceph-mon[94114]: pgmap v5095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:25.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:43 smithi078 ceph-mon[94114]: pgmap v5096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:26.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:45 smithi078 ceph-mon[94114]: pgmap v5097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:26.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:47 smithi078 ceph-mon[94114]: pgmap v5098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:26.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:49 smithi078 ceph-mon[94114]: pgmap v5099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:26.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:51 smithi078 ceph-mon[94114]: pgmap v5100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:26.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:53 smithi078 ceph-mon[94114]: pgmap v5101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:26.230 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:55 smithi078 ceph-mon[94114]: pgmap v5102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:57 smithi078 ceph-mon[94114]: pgmap v5103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:20:59 smithi078 ceph-mon[94114]: pgmap v5104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:01 smithi078 ceph-mon[94114]: pgmap v5105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:03 smithi078 ceph-mon[94114]: pgmap v5106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:05 smithi078 ceph-mon[94114]: pgmap v5107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:07 smithi078 ceph-mon[94114]: pgmap v5108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:09 smithi078 ceph-mon[94114]: pgmap v5109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 28 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:09 smithi078 ceph-mon[94114]: osdmap e388: 12 total, 12 up, 12 in 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:11 smithi078 ceph-mon[94114]: pgmap v5111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:39:26.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:13 smithi078 ceph-mon[94114]: pgmap v5112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:15 smithi078 ceph-mon[94114]: pgmap v5113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:17 smithi078 ceph-mon[94114]: pgmap v5114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:17 smithi078 ceph-mon[94114]: osdmap e389: 12 total, 12 up, 12 in 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:19 smithi078 ceph-mon[94114]: pgmap v5116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 104 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:21 smithi078 ceph-mon[94114]: pgmap v5117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:23 smithi078 ceph-mon[94114]: pgmap v5118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:25 smithi078 ceph-mon[94114]: pgmap v5119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:26.232 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:27 smithi078 ceph-mon[94114]: pgmap v5120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:28 smithi078 ceph-mon[94114]: pgmap v5121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 422 B/s wr, 10 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:28 smithi078 ceph-mon[94114]: pgmap v5122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:30 smithi078 ceph-mon[94114]: pgmap v5123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:32 smithi078 ceph-mon[94114]: pgmap v5124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:34 smithi078 ceph-mon[94114]: pgmap v5125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:36 smithi078 ceph-mon[94114]: pgmap v5126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:26.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:38 smithi078 ceph-mon[94114]: pgmap v5127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:40 smithi078 ceph-mon[94114]: pgmap v5128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:42 smithi078 ceph-mon[94114]: pgmap v5129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:44 smithi078 ceph-mon[94114]: pgmap v5130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:46 smithi078 ceph-mon[94114]: pgmap v5131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:48 smithi078 ceph-mon[94114]: pgmap v5132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:50 smithi078 ceph-mon[94114]: pgmap v5133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:52 smithi078 ceph-mon[94114]: pgmap v5134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:26.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:54 smithi078 ceph-mon[94114]: pgmap v5135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:28.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:56 smithi078 ceph-mon[94114]: pgmap v5136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:28.195 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:21:58 smithi078 ceph-mon[94114]: pgmap v5137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:30.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:00 smithi078 ceph-mon[94114]: pgmap v5138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:30.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:02 smithi078 ceph-mon[94114]: pgmap v5139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:30.831 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:04 smithi078 ceph-mon[94114]: pgmap v5140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:06 smithi078 ceph-mon[94114]: pgmap v5141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:08 smithi078 ceph-mon[94114]: pgmap v5142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:09 smithi078 ceph-mon[94114]: osdmap e390: 12 total, 12 up, 12 in 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:10 smithi078 ceph-mon[94114]: pgmap v5144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:12 smithi078 ceph-mon[94114]: pgmap v5145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:14 smithi078 ceph-mon[94114]: pgmap v5146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:30.832 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:16 smithi078 ceph-mon[94114]: pgmap v5147: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:18 smithi078 ceph-mon[94114]: pgmap v5148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:18 smithi078 ceph-mon[94114]: osdmap e391: 12 total, 12 up, 12 in 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:20 smithi078 ceph-mon[94114]: pgmap v5150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:22 smithi078 ceph-mon[94114]: pgmap v5151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:24 smithi078 ceph-mon[94114]: pgmap v5152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:26 smithi078 ceph-mon[94114]: pgmap v5153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:28 smithi078 ceph-mon[94114]: pgmap v5154: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:30.833 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:32.566 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:32.566 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:29 smithi078 ceph-mon[94114]: pgmap v5155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:29 smithi078 ceph-mon[94114]: pgmap v5156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:31 smithi078 ceph-mon[94114]: pgmap v5157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:33 smithi078 ceph-mon[94114]: pgmap v5158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:35 smithi078 ceph-mon[94114]: pgmap v5159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:37 smithi078 ceph-mon[94114]: pgmap v5160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:39 smithi078 ceph-mon[94114]: pgmap v5161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:41 smithi078 ceph-mon[94114]: pgmap v5162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:43 smithi078 ceph-mon[94114]: pgmap v5163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:45 smithi078 ceph-mon[94114]: pgmap v5164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:47 smithi078 ceph-mon[94114]: pgmap v5165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:49 smithi078 ceph-mon[94114]: pgmap v5166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:51 smithi078 ceph-mon[94114]: pgmap v5167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:32.567 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:53 smithi078 ceph-mon[94114]: pgmap v5168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:55 smithi078 ceph-mon[94114]: pgmap v5169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:57 smithi078 ceph-mon[94114]: pgmap v5170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:22:59 smithi078 ceph-mon[94114]: pgmap v5171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:01 smithi078 ceph-mon[94114]: pgmap v5172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:03 smithi078 ceph-mon[94114]: pgmap v5173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:05 smithi078 ceph-mon[94114]: pgmap v5174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:07 smithi078 ceph-mon[94114]: pgmap v5175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:09 smithi078 ceph-mon[94114]: pgmap v5176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 28 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:09 smithi078 ceph-mon[94114]: osdmap e392: 12 total, 12 up, 12 in 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:11 smithi078 ceph-mon[94114]: pgmap v5178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:13 smithi078 ceph-mon[94114]: pgmap v5179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:15 smithi078 ceph-mon[94114]: pgmap v5180: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:17 smithi078 ceph-mon[94114]: pgmap v5181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:17 smithi078 ceph-mon[94114]: osdmap e393: 12 total, 12 up, 12 in 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:19 smithi078 ceph-mon[94114]: pgmap v5183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 106 B/s wr, 10 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:21 smithi078 ceph-mon[94114]: pgmap v5184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:32.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:23 smithi078 ceph-mon[94114]: pgmap v5185: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:39:32.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:25 smithi078 ceph-mon[94114]: pgmap v5186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:39:32.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:27 smithi078 ceph-mon[94114]: pgmap v5187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:39:32.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:33.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:29 smithi078 ceph-mon[94114]: pgmap v5188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 372 B/s wr, 9 op/s 2023-03-17T12:39:33.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:33.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:34.637 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:35.486 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:30 smithi078 ceph-mon[94114]: pgmap v5189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T12:39:35.486 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:30 smithi078 ceph-mon[94114]: pgmap v5190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 464 B/s wr, 12 op/s 2023-03-17T12:39:35.486 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:32 smithi078 ceph-mon[94114]: pgmap v5191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:34 smithi078 ceph-mon[94114]: pgmap v5192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:36 smithi078 ceph-mon[94114]: pgmap v5193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:38 smithi078 ceph-mon[94114]: pgmap v5194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:40 smithi078 ceph-mon[94114]: pgmap v5195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:42 smithi078 ceph-mon[94114]: pgmap v5196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:44 smithi078 ceph-mon[94114]: pgmap v5197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:46 smithi078 ceph-mon[94114]: pgmap v5198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:48 smithi078 ceph-mon[94114]: pgmap v5199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:50 smithi078 ceph-mon[94114]: pgmap v5200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:52 smithi078 ceph-mon[94114]: pgmap v5201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:54 smithi078 ceph-mon[94114]: pgmap v5202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:56 smithi078 ceph-mon[94114]: pgmap v5203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:23:58 smithi078 ceph-mon[94114]: pgmap v5204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:00 smithi078 ceph-mon[94114]: pgmap v5205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:02 smithi078 ceph-mon[94114]: pgmap v5206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:35.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:04 smithi078 ceph-mon[94114]: pgmap v5207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:06 smithi078 ceph-mon[94114]: pgmap v5208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:08 smithi078 ceph-mon[94114]: pgmap v5209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:09 smithi078 ceph-mon[94114]: osdmap e394: 12 total, 12 up, 12 in 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:10 smithi078 ceph-mon[94114]: pgmap v5211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:12 smithi078 ceph-mon[94114]: pgmap v5212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:14 smithi078 ceph-mon[94114]: pgmap v5213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:16 smithi078 ceph-mon[94114]: pgmap v5214: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:35.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:18 smithi078 ceph-mon[94114]: pgmap v5215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:37.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:18 smithi078 ceph-mon[94114]: osdmap e395: 12 total, 12 up, 12 in 2023-03-17T12:39:37.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:20 smithi078 ceph-mon[94114]: pgmap v5217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:37.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:22 smithi078 ceph-mon[94114]: pgmap v5218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:24 smithi078 ceph-mon[94114]: pgmap v5219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:26 smithi078 ceph-mon[94114]: pgmap v5220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:28 smithi078 ceph-mon[94114]: pgmap v5221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:30 smithi078 ceph-mon[94114]: pgmap v5222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:37.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:39.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:31 smithi078 ceph-mon[94114]: pgmap v5223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:39:39.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:31 smithi078 ceph-mon[94114]: pgmap v5224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:39.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:33 smithi078 ceph-mon[94114]: pgmap v5225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:39.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:35 smithi078 ceph-mon[94114]: pgmap v5226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:41.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:37 smithi078 ceph-mon[94114]: pgmap v5227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:41.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:39 smithi078 ceph-mon[94114]: pgmap v5228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:41.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:41 smithi078 ceph-mon[94114]: pgmap v5229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:41.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:43 smithi078 ceph-mon[94114]: pgmap v5230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:41.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:45 smithi078 ceph-mon[94114]: pgmap v5231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:41.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:47 smithi078 ceph-mon[94114]: pgmap v5232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:41.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:49 smithi078 ceph-mon[94114]: pgmap v5233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:41.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:51 smithi078 ceph-mon[94114]: pgmap v5234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:41.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:53 smithi078 ceph-mon[94114]: pgmap v5235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:41.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:55 smithi078 ceph-mon[94114]: pgmap v5236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:39:42.865 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:57 smithi078 ceph-mon[94114]: pgmap v5237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:39:44.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:24:59 smithi078 ceph-mon[94114]: pgmap v5238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:44.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:01 smithi078 ceph-mon[94114]: pgmap v5239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:39:44.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:03 smithi078 ceph-mon[94114]: pgmap v5240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:39:44.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:05 smithi078 ceph-mon[94114]: pgmap v5241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:07 smithi078 ceph-mon[94114]: pgmap v5242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:09 smithi078 ceph-mon[94114]: pgmap v5243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:09 smithi078 ceph-mon[94114]: osdmap e396: 12 total, 12 up, 12 in 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:11 smithi078 ceph-mon[94114]: pgmap v5245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:13 smithi078 ceph-mon[94114]: pgmap v5246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:15 smithi078 ceph-mon[94114]: pgmap v5247: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:45.424 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:17 smithi078 ceph-mon[94114]: pgmap v5248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:17 smithi078 ceph-mon[94114]: osdmap e397: 12 total, 12 up, 12 in 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:19 smithi078 ceph-mon[94114]: pgmap v5250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:21 smithi078 ceph-mon[94114]: pgmap v5251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:23 smithi078 ceph-mon[94114]: pgmap v5252: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:25 smithi078 ceph-mon[94114]: pgmap v5253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:27 smithi078 ceph-mon[94114]: pgmap v5254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:47.376 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:29 smithi078 ceph-mon[94114]: pgmap v5255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:39:47.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:47.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:31 smithi078 ceph-mon[94114]: pgmap v5256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:47.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:47.377 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:48.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:31 smithi078 ceph-mon[94114]: pgmap v5257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:39:48.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:31 smithi078 ceph-mon[94114]: pgmap v5258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:48.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:48.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:33 smithi078 ceph-mon[94114]: pgmap v5259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:48.638 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:34 smithi078 ceph-mon[94114]: pgmap v5260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:49.177 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:36 smithi078 ceph-mon[94114]: pgmap v5261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 116 B/s wr, 7 op/s 2023-03-17T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:38 smithi078 ceph-mon[94114]: pgmap v5262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:40 smithi078 ceph-mon[94114]: pgmap v5263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:43 smithi078 ceph-mon[94114]: pgmap v5264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:44 smithi078 ceph-mon[94114]: pgmap v5265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:46 smithi078 ceph-mon[94114]: pgmap v5266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2023-03-17T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:48 smithi078 ceph-mon[94114]: pgmap v5267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:50 smithi078 ceph-mon[94114]: pgmap v5268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:53 smithi078 ceph-mon[94114]: pgmap v5269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:54 smithi078 ceph-mon[94114]: pgmap v5270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:56 smithi078 ceph-mon[94114]: pgmap v5271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:25:58 smithi078 ceph-mon[94114]: pgmap v5272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:00 smithi078 ceph-mon[94114]: pgmap v5273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:03 smithi078 ceph-mon[94114]: pgmap v5274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:04 smithi078 ceph-mon[94114]: osdmap e398: 12 total, 12 up, 12 in 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:05 smithi078 ceph-mon[94114]: pgmap v5276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:06 smithi078 ceph-mon[94114]: pgmap v5277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:08 smithi078 ceph-mon[94114]: pgmap v5278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:10 smithi078 ceph-mon[94114]: pgmap v5279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-03-17T12:39:50.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:13 smithi078 ceph-mon[94114]: osdmap e399: 12 total, 12 up, 12 in 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:13 smithi078 ceph-mon[94114]: pgmap v5281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 542 B/s wr, 9 op/s 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:14 smithi078 ceph-mon[94114]: pgmap v5282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 9 op/s 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:15 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:15 smithi078 ceph-mon[94114]: osdmap e400: 12 total, 12 up, 12 in 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:17 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/1305502887,v1:172.21.15.35:6837/1305502887] up:boot 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:17 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:17 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:17 smithi078 ceph-mon[94114]: pgmap v5284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 639 B/s wr, 9 op/s 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:18 smithi078 ceph-mon[94114]: pgmap v5285: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:20 smithi078 ceph-mon[94114]: pgmap v5286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 485 B/s wr, 6 op/s 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:23 smithi078 ceph-mon[94114]: pgmap v5287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:39:50.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:24 smithi078 ceph-mon[94114]: pgmap v5288: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:39:50.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:26 smithi078 ceph-mon[94114]: pgmap v5289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 351 B/s wr, 12 op/s 2023-03-17T12:39:50.991 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:28 smithi078 ceph-mon[94114]: pgmap v5290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T12:39:52.495 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:30 smithi078 ceph-mon[94114]: pgmap v5291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:32 smithi078 ceph-mon[94114]: pgmap v5292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:32 smithi078 ceph-mon[94114]: pgmap v5293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:34 smithi078 ceph-mon[94114]: pgmap v5294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:36 smithi078 ceph-mon[94114]: pgmap v5295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 348 B/s wr, 7 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:38 smithi078 ceph-mon[94114]: pgmap v5296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:40 smithi078 ceph-mon[94114]: pgmap v5297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:42 smithi078 ceph-mon[94114]: pgmap v5298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:44 smithi078 ceph-mon[94114]: pgmap v5299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:46 smithi078 ceph-mon[94114]: pgmap v5300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:48 smithi078 ceph-mon[94114]: pgmap v5301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:52.496 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:50 smithi078 ceph-mon[94114]: pgmap v5302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:52.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:52 smithi078 ceph-mon[94114]: pgmap v5303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:52.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:54 smithi078 ceph-mon[94114]: pgmap v5304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:52.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:56 smithi078 ceph-mon[94114]: pgmap v5305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:52.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:26:58 smithi078 ceph-mon[94114]: pgmap v5306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:52.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:00 smithi078 ceph-mon[94114]: pgmap v5307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:53.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:02 smithi078 ceph-mon[94114]: pgmap v5308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:53.786 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:04 smithi078 ceph-mon[94114]: pgmap v5309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:39:55.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:06 smithi078 ceph-mon[94114]: pgmap v5310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:55.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:08 smithi078 ceph-mon[94114]: pgmap v5311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:55.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:09 smithi078 ceph-mon[94114]: osdmap e401: 12 total, 12 up, 12 in 2023-03-17T12:39:55.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:10 smithi078 ceph-mon[94114]: pgmap v5313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:55.544 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:12 smithi078 ceph-mon[94114]: pgmap v5314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:56.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:14 smithi078 ceph-mon[94114]: pgmap v5315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:56.821 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:16 smithi078 ceph-mon[94114]: pgmap v5316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:18 smithi078 ceph-mon[94114]: osdmap e402: 12 total, 12 up, 12 in 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:18 smithi078 ceph-mon[94114]: pgmap v5318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:20 smithi078 ceph-mon[94114]: pgmap v5319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:22 smithi078 ceph-mon[94114]: pgmap v5320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:24 smithi078 ceph-mon[94114]: pgmap v5321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:26 smithi078 ceph-mon[94114]: pgmap v5322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:28 smithi078 ceph-mon[94114]: pgmap v5323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:30 smithi078 ceph-mon[94114]: pgmap v5324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.822 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:32 smithi078 ceph-mon[94114]: pgmap v5325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:33 smithi078 ceph-mon[94114]: pgmap v5326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:33 smithi078 ceph-mon[94114]: pgmap v5327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:56.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:35 smithi078 ceph-mon[94114]: pgmap v5328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:37 smithi078 ceph-mon[94114]: pgmap v5329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:39 smithi078 ceph-mon[94114]: pgmap v5330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:41 smithi078 ceph-mon[94114]: pgmap v5331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:43 smithi078 ceph-mon[94114]: pgmap v5332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:45 smithi078 ceph-mon[94114]: pgmap v5333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:47 smithi078 ceph-mon[94114]: pgmap v5334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:49 smithi078 ceph-mon[94114]: pgmap v5335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:51 smithi078 ceph-mon[94114]: pgmap v5336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:53 smithi078 ceph-mon[94114]: pgmap v5337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:55 smithi078 ceph-mon[94114]: pgmap v5338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:57 smithi078 ceph-mon[94114]: pgmap v5339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:27:59 smithi078 ceph-mon[94114]: pgmap v5340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:01 smithi078 ceph-mon[94114]: pgmap v5341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:03 smithi078 ceph-mon[94114]: pgmap v5342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:05 smithi078 ceph-mon[94114]: pgmap v5343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:07 smithi078 ceph-mon[94114]: pgmap v5344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:09 smithi078 ceph-mon[94114]: pgmap v5345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:39:56.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:09 smithi078 ceph-mon[94114]: osdmap e403: 12 total, 12 up, 12 in 2023-03-17T12:39:56.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:11 smithi078 ceph-mon[94114]: pgmap v5347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:39:56.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:13 smithi078 ceph-mon[94114]: pgmap v5348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:56.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:15 smithi078 ceph-mon[94114]: pgmap v5349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:56.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:17 smithi078 ceph-mon[94114]: pgmap v5350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:39:57.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:17 smithi078 ceph-mon[94114]: osdmap e404: 12 total, 12 up, 12 in 2023-03-17T12:39:57.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:19 smithi078 ceph-mon[94114]: pgmap v5352: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2023-03-17T12:39:57.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:21 smithi078 ceph-mon[94114]: pgmap v5353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:39:57.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:23 smithi078 ceph-mon[94114]: pgmap v5354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:57.360 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:25 smithi078 ceph-mon[94114]: pgmap v5355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:57.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:27 smithi078 ceph-mon[94114]: pgmap v5356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:39:58.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:29 smithi078 ceph-mon[94114]: pgmap v5357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:39:58.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:31 smithi078 ceph-mon[94114]: pgmap v5358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:39:58.405 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:33 smithi078 ceph-mon[94114]: pgmap v5359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:39:58.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:39:58.873 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:39:59.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:39:59.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:39:59.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:34 smithi078 ceph-mon[94114]: pgmap v5360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 285 B/s wr, 9 op/s 2023-03-17T12:39:59.869 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:34 smithi078 ceph-mon[94114]: pgmap v5361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:39:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:36 smithi078 ceph-mon[94114]: pgmap v5362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:39:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:38 smithi078 ceph-mon[94114]: pgmap v5363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:39:59.870 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:40 smithi078 ceph-mon[94114]: pgmap v5364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 350 B/s wr, 11 op/s 2023-03-17T12:40:00.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:42 smithi078 ceph-mon[94114]: pgmap v5365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:40:00.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:44 smithi078 ceph-mon[94114]: pgmap v5366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:00.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:46 smithi078 ceph-mon[94114]: pgmap v5367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:00.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:48 smithi078 ceph-mon[94114]: pgmap v5368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:00.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:50 smithi078 ceph-mon[94114]: pgmap v5369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:00.511 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:52 smithi078 ceph-mon[94114]: pgmap v5370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:01.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:54 smithi078 ceph-mon[94114]: pgmap v5371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:01.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:56 smithi078 ceph-mon[94114]: pgmap v5372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:01.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:28:58 smithi078 ceph-mon[94114]: pgmap v5373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:01.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:00 smithi078 ceph-mon[94114]: pgmap v5374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:01.643 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:02 smithi078 ceph-mon[94114]: pgmap v5375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:02.644 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:04 smithi078 ceph-mon[94114]: pgmap v5376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:02.644 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:06 smithi078 ceph-mon[94114]: pgmap v5377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:40:02.644 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:08 smithi078 ceph-mon[94114]: pgmap v5378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:04.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:09 smithi078 ceph-mon[94114]: osdmap e405: 12 total, 12 up, 12 in 2023-03-17T12:40:04.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:10 smithi078 ceph-mon[94114]: pgmap v5380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:40:04.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:12 smithi078 ceph-mon[94114]: pgmap v5381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:40:04.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:14 smithi078 ceph-mon[94114]: pgmap v5382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:04.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:16 smithi078 ceph-mon[94114]: pgmap v5383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:04.006 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:18 smithi078 ceph-mon[94114]: pgmap v5384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:04.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:18 smithi078 ceph-mon[94114]: osdmap e406: 12 total, 12 up, 12 in 2023-03-17T12:40:04.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:20 smithi078 ceph-mon[94114]: pgmap v5386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:04.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:22 smithi078 ceph-mon[94114]: pgmap v5387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:04.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:24 smithi078 ceph-mon[94114]: pgmap v5388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:04.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:26 smithi078 ceph-mon[94114]: pgmap v5389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:28 smithi078 ceph-mon[94114]: pgmap v5390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:30 smithi078 ceph-mon[94114]: pgmap v5391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:32 smithi078 ceph-mon[94114]: pgmap v5392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:34 smithi078 ceph-mon[94114]: pgmap v5393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:06.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:06.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:06.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:06.894 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:35 smithi078 ceph-mon[94114]: pgmap v5394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:35 smithi078 ceph-mon[94114]: pgmap v5395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:37 smithi078 ceph-mon[94114]: pgmap v5396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:38 smithi078 ceph-mon[94114]: pgmap v5397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:41 smithi078 ceph-mon[94114]: pgmap v5398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:43 smithi078 ceph-mon[94114]: pgmap v5399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:45 smithi078 ceph-mon[94114]: pgmap v5400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:06.895 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:47 smithi078 ceph-mon[94114]: pgmap v5401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:49 smithi078 ceph-mon[94114]: pgmap v5402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:51 smithi078 ceph-mon[94114]: pgmap v5403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:53 smithi078 ceph-mon[94114]: pgmap v5404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:55 smithi078 ceph-mon[94114]: pgmap v5405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:57 smithi078 ceph-mon[94114]: pgmap v5406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:29:59 smithi078 ceph-mon[94114]: pgmap v5407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:01 smithi078 ceph-mon[94114]: pgmap v5408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.896 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:03 smithi078 ceph-mon[94114]: pgmap v5409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:05 smithi078 ceph-mon[94114]: pgmap v5410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:07 smithi078 ceph-mon[94114]: pgmap v5411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:09 smithi078 ceph-mon[94114]: pgmap v5412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:09 smithi078 ceph-mon[94114]: osdmap e407: 12 total, 12 up, 12 in 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:11 smithi078 ceph-mon[94114]: pgmap v5414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:13 smithi078 ceph-mon[94114]: pgmap v5415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:15 smithi078 ceph-mon[94114]: pgmap v5416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:17 smithi078 ceph-mon[94114]: pgmap v5417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:06.897 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:17 smithi078 ceph-mon[94114]: osdmap e408: 12 total, 12 up, 12 in 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:19 smithi078 ceph-mon[94114]: pgmap v5419: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:21 smithi078 ceph-mon[94114]: pgmap v5420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:23 smithi078 ceph-mon[94114]: pgmap v5421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:25 smithi078 ceph-mon[94114]: pgmap v5422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:27 smithi078 ceph-mon[94114]: pgmap v5423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:29 smithi078 ceph-mon[94114]: pgmap v5424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:40:06.898 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:31 smithi078 ceph-mon[94114]: pgmap v5425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:33 smithi078 ceph-mon[94114]: pgmap v5426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:06.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:35 smithi078 ceph-mon[94114]: pgmap v5427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:06.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:06.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:35 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:37 smithi078 ceph-mon[94114]: pgmap v5428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: scrub queued for path: / 2023-03-17T12:40:09.724 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: scrub summary: idle+waiting paths [/] 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: scrub summary: active paths [/] 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: scrub summary: idle+waiting paths [/] 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:09.726 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:38 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:40:11.663 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:40:11.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:40:11.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: scrub summary: idle 2023-03-17T12:40:11.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:40:11.664 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:40:12.714 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: pgmap v5429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:40:12.714 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:39 smithi078 ceph-mon[94114]: pgmap v5430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:40:12.714 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:41 smithi078 ceph-mon[94114]: pgmap v5431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:40:13.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:43 smithi078 ceph-mon[94114]: pgmap v5432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:40:13.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:45 smithi078 ceph-mon[94114]: pgmap v5433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:40:13.946 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:47 smithi078 ceph-mon[94114]: pgmap v5434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:40:14.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:49 smithi078 ceph-mon[94114]: pgmap v5435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 13 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:51 smithi078 ceph-mon[94114]: pgmap v5436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:53 smithi078 ceph-mon[94114]: pgmap v5437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 15 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:55 smithi078 ceph-mon[94114]: pgmap v5438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:57 smithi078 ceph-mon[94114]: pgmap v5439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:30:59 smithi078 ceph-mon[94114]: pgmap v5440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:01 smithi078 ceph-mon[94114]: pgmap v5441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:15.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:03 smithi078 ceph-mon[94114]: pgmap v5442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:05 smithi078 ceph-mon[94114]: pgmap v5443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:07 smithi078 ceph-mon[94114]: pgmap v5444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:09 smithi078 ceph-mon[94114]: pgmap v5445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:09 smithi078 ceph-mon[94114]: osdmap e409: 12 total, 12 up, 12 in 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:11 smithi078 ceph-mon[94114]: pgmap v5447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:13 smithi078 ceph-mon[94114]: pgmap v5448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:15 smithi078 ceph-mon[94114]: pgmap v5449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:17 smithi078 ceph-mon[94114]: pgmap v5450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 12 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:17 smithi078 ceph-mon[94114]: osdmap e410: 12 total, 12 up, 12 in 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:19 smithi078 ceph-mon[94114]: pgmap v5452: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 927 B/s wr, 12 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:21 smithi078 ceph-mon[94114]: pgmap v5453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 11 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:23 smithi078 ceph-mon[94114]: pgmap v5454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:15.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:25 smithi078 ceph-mon[94114]: pgmap v5455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:27 smithi078 ceph-mon[94114]: pgmap v5456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:29 smithi078 ceph-mon[94114]: pgmap v5457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 277 B/s wr, 9 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:31 smithi078 ceph-mon[94114]: pgmap v5458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:33 smithi078 ceph-mon[94114]: pgmap v5459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:35 smithi078 ceph-mon[94114]: pgmap v5460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:37 smithi078 ceph-mon[94114]: pgmap v5461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:39 smithi078 ceph-mon[94114]: pgmap v5462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:40 smithi078 ceph-mon[94114]: pgmap v5463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:40 smithi078 ceph-mon[94114]: pgmap v5464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:40:15.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:42 smithi078 ceph-mon[94114]: pgmap v5465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:40:16.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:44 smithi078 ceph-mon[94114]: pgmap v5466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:40:16.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:46 smithi078 ceph-mon[94114]: pgmap v5467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:40:20.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:48 smithi078 ceph-mon[94114]: pgmap v5468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:40:20.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:50 smithi078 ceph-mon[94114]: pgmap v5469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:20.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:52 smithi078 ceph-mon[94114]: pgmap v5470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:20.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:54 smithi078 ceph-mon[94114]: pgmap v5471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:40:22.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:56 smithi078 ceph-mon[94114]: pgmap v5472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:22.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:31:58 smithi078 ceph-mon[94114]: pgmap v5473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:22.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:00 smithi078 ceph-mon[94114]: pgmap v5474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:22.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:02 smithi078 ceph-mon[94114]: pgmap v5475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:22.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:04 smithi078 ceph-mon[94114]: pgmap v5476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:06 smithi078 ceph-mon[94114]: pgmap v5477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:08 smithi078 ceph-mon[94114]: pgmap v5478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:09 smithi078 ceph-mon[94114]: osdmap e411: 12 total, 12 up, 12 in 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:10 smithi078 ceph-mon[94114]: pgmap v5480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:12 smithi078 ceph-mon[94114]: pgmap v5481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:14 smithi078 ceph-mon[94114]: pgmap v5482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:16 smithi078 ceph-mon[94114]: pgmap v5483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:18 smithi078 ceph-mon[94114]: pgmap v5484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:18 smithi078 ceph-mon[94114]: osdmap e412: 12 total, 12 up, 12 in 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:20 smithi078 ceph-mon[94114]: pgmap v5486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:22.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:22 smithi078 ceph-mon[94114]: pgmap v5487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:23.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:24 smithi078 ceph-mon[94114]: pgmap v5488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:23.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:26 smithi078 ceph-mon[94114]: pgmap v5489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:23.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:28 smithi078 ceph-mon[94114]: pgmap v5490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:30 smithi078 ceph-mon[94114]: pgmap v5491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:32 smithi078 ceph-mon[94114]: pgmap v5492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:34 smithi078 ceph-mon[94114]: pgmap v5493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:36 smithi078 ceph-mon[94114]: pgmap v5494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:38 smithi078 ceph-mon[94114]: pgmap v5495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:39 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:40 smithi078 ceph-mon[94114]: pgmap v5496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:23.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:40 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:41 smithi078 ceph-mon[94114]: pgmap v5497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:41 smithi078 ceph-mon[94114]: pgmap v5498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:43 smithi078 ceph-mon[94114]: pgmap v5499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:23.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:45 smithi078 ceph-mon[94114]: pgmap v5500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:24.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:47 smithi078 ceph-mon[94114]: pgmap v5501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:40:24.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:49 smithi078 ceph-mon[94114]: pgmap v5502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:40:24.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:51 smithi078 ceph-mon[94114]: pgmap v5503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:24.398 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:53 smithi078 ceph-mon[94114]: pgmap v5504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:25.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:55 smithi078 ceph-mon[94114]: pgmap v5505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:25.629 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:57 smithi078 ceph-mon[94114]: pgmap v5506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:25.630 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:32:59 smithi078 ceph-mon[94114]: pgmap v5507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:01 smithi078 ceph-mon[94114]: pgmap v5508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:03 smithi078 ceph-mon[94114]: pgmap v5509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:05 smithi078 ceph-mon[94114]: pgmap v5510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:07 smithi078 ceph-mon[94114]: pgmap v5511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:09 smithi078 ceph-mon[94114]: pgmap v5512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:09 smithi078 ceph-mon[94114]: osdmap e413: 12 total, 12 up, 12 in 2023-03-17T12:40:27.096 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:11 smithi078 ceph-mon[94114]: pgmap v5514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:40:29.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:13 smithi078 ceph-mon[94114]: pgmap v5515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:29.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:15 smithi078 ceph-mon[94114]: pgmap v5516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:29.891 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:17 smithi078 ceph-mon[94114]: pgmap v5517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:30.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:17 smithi078 ceph-mon[94114]: osdmap e414: 12 total, 12 up, 12 in 2023-03-17T12:40:30.400 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:19 smithi078 ceph-mon[94114]: pgmap v5519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:40:30.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:21 smithi078 ceph-mon[94114]: pgmap v5520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:30.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:23 smithi078 ceph-mon[94114]: pgmap v5521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:40:30.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:25 smithi078 ceph-mon[94114]: pgmap v5522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:40:30.989 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:27 smithi078 ceph-mon[94114]: pgmap v5523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:29 smithi078 ceph-mon[94114]: pgmap v5524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 366 B/s wr, 9 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:31 smithi078 ceph-mon[94114]: pgmap v5525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:33 smithi078 ceph-mon[94114]: pgmap v5526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 13 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:35 smithi078 ceph-mon[94114]: pgmap v5527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:37 smithi078 ceph-mon[94114]: pgmap v5528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:39 smithi078 ceph-mon[94114]: pgmap v5529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:30.990 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:41 smithi078 ceph-mon[94114]: pgmap v5530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:32.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:32.423 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:33.856 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:36.269 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:42 smithi078 ceph-mon[94114]: pgmap v5531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:40:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:42 smithi078 ceph-mon[94114]: pgmap v5532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2023-03-17T12:40:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:44 smithi078 ceph-mon[94114]: pgmap v5533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:40:36.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:46 smithi078 ceph-mon[94114]: pgmap v5534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2023-03-17T12:40:38.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:48 smithi078 ceph-mon[94114]: pgmap v5535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:40:40.373 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:50 smithi078 ceph-mon[94114]: pgmap v5536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 347 B/s wr, 11 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:52 smithi078 ceph-mon[94114]: pgmap v5537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:54 smithi078 ceph-mon[94114]: pgmap v5538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:56 smithi078 ceph-mon[94114]: pgmap v5539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:33:58 smithi078 ceph-mon[94114]: pgmap v5540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:00 smithi078 ceph-mon[94114]: pgmap v5541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:02 smithi078 ceph-mon[94114]: pgmap v5542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:40.374 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:04 smithi078 ceph-mon[94114]: pgmap v5543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:06 smithi078 ceph-mon[94114]: pgmap v5544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:08 smithi078 ceph-mon[94114]: pgmap v5545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:09 smithi078 ceph-mon[94114]: osdmap e415: 12 total, 12 up, 12 in 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:10 smithi078 ceph-mon[94114]: pgmap v5547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:12 smithi078 ceph-mon[94114]: pgmap v5548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:14 smithi078 ceph-mon[94114]: pgmap v5549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:43.056 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:16 smithi078 ceph-mon[94114]: pgmap v5550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:18 smithi078 ceph-mon[94114]: pgmap v5552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:18 smithi078 ceph-mon[94114]: osdmap e416: 12 total, 12 up, 12 in 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:20 smithi078 ceph-mon[94114]: pgmap v5553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:22 smithi078 ceph-mon[94114]: pgmap v5554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:24 smithi078 ceph-mon[94114]: pgmap v5555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:26 smithi078 ceph-mon[94114]: pgmap v5556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:28 smithi078 ceph-mon[94114]: pgmap v5557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:30 smithi078 ceph-mon[94114]: pgmap v5558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:32 smithi078 ceph-mon[94114]: pgmap v5559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:34 smithi078 ceph-mon[94114]: pgmap v5560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:43.057 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:36 smithi078 ceph-mon[94114]: pgmap v5561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:45.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:38 smithi078 ceph-mon[94114]: pgmap v5562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:45.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:40 smithi078 ceph-mon[94114]: pgmap v5563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:45.955 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:42 smithi078 ceph-mon[94114]: pgmap v5564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:43 smithi078 ceph-mon[94114]: pgmap v5565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:43 smithi078 ceph-mon[94114]: pgmap v5566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:45 smithi078 ceph-mon[94114]: pgmap v5567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:47 smithi078 ceph-mon[94114]: pgmap v5568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:49 smithi078 ceph-mon[94114]: pgmap v5569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:51 smithi078 ceph-mon[94114]: pgmap v5570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:53 smithi078 ceph-mon[94114]: pgmap v5571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:40:48.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:55 smithi078 ceph-mon[94114]: pgmap v5572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:57 smithi078 ceph-mon[94114]: pgmap v5573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:34:59 smithi078 ceph-mon[94114]: pgmap v5574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:01 smithi078 ceph-mon[94114]: pgmap v5575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:03 smithi078 ceph-mon[94114]: pgmap v5576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:05 smithi078 ceph-mon[94114]: pgmap v5577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:07 smithi078 ceph-mon[94114]: pgmap v5578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:09 smithi078 ceph-mon[94114]: pgmap v5579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:09 smithi078 ceph-mon[94114]: osdmap e417: 12 total, 12 up, 12 in 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:11 smithi078 ceph-mon[94114]: pgmap v5581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:40:49.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:13 smithi078 ceph-mon[94114]: pgmap v5582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:15 smithi078 ceph-mon[94114]: pgmap v5583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:17 smithi078 ceph-mon[94114]: pgmap v5584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:17 smithi078 ceph-mon[94114]: osdmap e418: 12 total, 12 up, 12 in 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:19 smithi078 ceph-mon[94114]: pgmap v5586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 105 B/s wr, 10 op/s 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:21 smithi078 ceph-mon[94114]: pgmap v5587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:23 smithi078 ceph-mon[94114]: pgmap v5588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:40:49.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:25 smithi078 ceph-mon[94114]: pgmap v5589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:40:49.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:27 smithi078 ceph-mon[94114]: pgmap v5590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:29 smithi078 ceph-mon[94114]: pgmap v5591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 378 B/s wr, 9 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:31 smithi078 ceph-mon[94114]: pgmap v5592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:33 smithi078 ceph-mon[94114]: pgmap v5593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:35 smithi078 ceph-mon[94114]: pgmap v5594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:37 smithi078 ceph-mon[94114]: pgmap v5595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:39 smithi078 ceph-mon[94114]: pgmap v5596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:51.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:41 smithi078 ceph-mon[94114]: pgmap v5597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:40:55.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:42 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:40:55.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:43 smithi078 ceph-mon[94114]: pgmap v5598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:40:55.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:40:55.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:40:56.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:40:58.183 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:44 smithi078 ceph-mon[94114]: pgmap v5599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:41:00.517 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:44 smithi078 ceph-mon[94114]: pgmap v5600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:46 smithi078 ceph-mon[94114]: pgmap v5601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:48 smithi078 ceph-mon[94114]: pgmap v5602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:50 smithi078 ceph-mon[94114]: pgmap v5603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 348 B/s wr, 11 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:52 smithi078 ceph-mon[94114]: pgmap v5604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 348 B/s wr, 6 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:54 smithi078 ceph-mon[94114]: pgmap v5605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:56 smithi078 ceph-mon[94114]: pgmap v5606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:35:58 smithi078 ceph-mon[94114]: pgmap v5607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:00 smithi078 ceph-mon[94114]: pgmap v5608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:02 smithi078 ceph-mon[94114]: pgmap v5609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:04 smithi078 ceph-mon[94114]: pgmap v5610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:06 smithi078 ceph-mon[94114]: pgmap v5611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:08 smithi078 ceph-mon[94114]: pgmap v5612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:09 smithi078 ceph-mon[94114]: osdmap e419: 12 total, 12 up, 12 in 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:10 smithi078 ceph-mon[94114]: pgmap v5614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:41:00.518 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:12 smithi078 ceph-mon[94114]: pgmap v5615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:41:00.519 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:14 smithi078 ceph-mon[94114]: pgmap v5616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:00.519 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:16 smithi078 ceph-mon[94114]: pgmap v5617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:00.519 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:18 smithi078 ceph-mon[94114]: pgmap v5618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:00.519 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:18 smithi078 ceph-mon[94114]: osdmap e420: 12 total, 12 up, 12 in 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:20 smithi078 ceph-mon[94114]: pgmap v5620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:22 smithi078 ceph-mon[94114]: pgmap v5621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:24 smithi078 ceph-mon[94114]: pgmap v5622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:26 smithi078 ceph-mon[94114]: pgmap v5623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:28 smithi078 ceph-mon[94114]: pgmap v5624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:30 smithi078 ceph-mon[94114]: pgmap v5625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:32 smithi078 ceph-mon[94114]: pgmap v5626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:34 smithi078 ceph-mon[94114]: pgmap v5627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:36 smithi078 ceph-mon[94114]: pgmap v5628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:38 smithi078 ceph-mon[94114]: pgmap v5629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:02.796 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:40 smithi078 ceph-mon[94114]: pgmap v5630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:02.797 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:42 smithi078 ceph-mon[94114]: pgmap v5631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:04.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:43 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:04.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:44 smithi078 ceph-mon[94114]: pgmap v5632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:04.905 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:05.420 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:45 smithi078 ceph-mon[94114]: pgmap v5633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:45 smithi078 ceph-mon[94114]: pgmap v5634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:47 smithi078 ceph-mon[94114]: pgmap v5635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:49 smithi078 ceph-mon[94114]: pgmap v5636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:51 smithi078 ceph-mon[94114]: pgmap v5637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:53 smithi078 ceph-mon[94114]: pgmap v5638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:55 smithi078 ceph-mon[94114]: pgmap v5639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:57 smithi078 ceph-mon[94114]: pgmap v5640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:36:59 smithi078 ceph-mon[94114]: pgmap v5641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:01 smithi078 ceph-mon[94114]: pgmap v5642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:05.421 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:03 smithi078 ceph-mon[94114]: pgmap v5643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:41:06.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:05 smithi078 ceph-mon[94114]: pgmap v5644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:41:06.233 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:07 smithi078 ceph-mon[94114]: pgmap v5645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:41:06.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:09 smithi078 ceph-mon[94114]: pgmap v5646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:06.234 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:09 smithi078 ceph-mon[94114]: osdmap e421: 12 total, 12 up, 12 in 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:11 smithi078 ceph-mon[94114]: pgmap v5648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:13 smithi078 ceph-mon[94114]: pgmap v5649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:15 smithi078 ceph-mon[94114]: pgmap v5650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:17 smithi078 ceph-mon[94114]: pgmap v5651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:17 smithi078 ceph-mon[94114]: osdmap e422: 12 total, 12 up, 12 in 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:19 smithi078 ceph-mon[94114]: pgmap v5653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 216 B/s wr, 11 op/s 2023-03-17T12:41:06.808 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:21 smithi078 ceph-mon[94114]: pgmap v5654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:06.809 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:23 smithi078 ceph-mon[94114]: pgmap v5655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:06.809 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:25 smithi078 ceph-mon[94114]: pgmap v5656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:06.809 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:27 smithi078 ceph-mon[94114]: pgmap v5657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:06.810 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:29 smithi078 ceph-mon[94114]: pgmap v5658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:41:08.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:31 smithi078 ceph-mon[94114]: pgmap v5659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:08.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:33 smithi078 ceph-mon[94114]: pgmap v5660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:08.270 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:35 smithi078 ceph-mon[94114]: pgmap v5661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:08.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:37 smithi078 ceph-mon[94114]: pgmap v5662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:08.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:39 smithi078 ceph-mon[94114]: pgmap v5663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:08.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:41 smithi078 ceph-mon[94114]: pgmap v5664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:08.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:43 smithi078 ceph-mon[94114]: pgmap v5665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:41:09.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:44 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:09.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:45 smithi078 ceph-mon[94114]: pgmap v5666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T12:41:09.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:45 smithi078 ceph-mon[94114]: pgmap v5667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 851 B/s wr, 9 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:45 smithi078 ceph-mon[94114]: pgmap v5668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:47 smithi078 ceph-mon[94114]: pgmap v5669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:49 smithi078 ceph-mon[94114]: pgmap v5670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:51 smithi078 ceph-mon[94114]: pgmap v5671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:53 smithi078 ceph-mon[94114]: pgmap v5672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:55 smithi078 ceph-mon[94114]: pgmap v5673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:57 smithi078 ceph-mon[94114]: pgmap v5674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:37:59 smithi078 ceph-mon[94114]: pgmap v5675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:09.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:01 smithi078 ceph-mon[94114]: pgmap v5676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:09.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:03 smithi078 ceph-mon[94114]: pgmap v5677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:05 smithi078 ceph-mon[94114]: pgmap v5678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:07 smithi078 ceph-mon[94114]: pgmap v5679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:09 smithi078 ceph-mon[94114]: osdmap e423: 12 total, 12 up, 12 in 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:09 smithi078 ceph-mon[94114]: pgmap v5681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:11 smithi078 ceph-mon[94114]: pgmap v5682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:13 smithi078 ceph-mon[94114]: pgmap v5683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:15 smithi078 ceph-mon[94114]: pgmap v5684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:17 smithi078 ceph-mon[94114]: pgmap v5685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:09.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:18 smithi078 ceph-mon[94114]: osdmap e424: 12 total, 12 up, 12 in 2023-03-17T12:41:11.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:19 smithi078 ceph-mon[94114]: pgmap v5687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:11.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:21 smithi078 ceph-mon[94114]: pgmap v5688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:11.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:23 smithi078 ceph-mon[94114]: pgmap v5689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:11.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:25 smithi078 ceph-mon[94114]: pgmap v5690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:11.295 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:27 smithi078 ceph-mon[94114]: pgmap v5691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:41:11.295 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:29 smithi078 ceph-mon[94114]: pgmap v5692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 360 B/s wr, 9 op/s 2023-03-17T12:41:11.295 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:31 smithi078 ceph-mon[94114]: pgmap v5693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:41:12.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:33 smithi078 ceph-mon[94114]: pgmap v5694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:41:13.320 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:35 smithi078 ceph-mon[94114]: pgmap v5695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:13.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:37 smithi078 ceph-mon[94114]: pgmap v5696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:13.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:39 smithi078 ceph-mon[94114]: pgmap v5697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:13.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:41 smithi078 ceph-mon[94114]: pgmap v5698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:13.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:43 smithi078 ceph-mon[94114]: pgmap v5699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:13.321 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:45 smithi078 ceph-mon[94114]: pgmap v5700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:14.382 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:14.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:14.626 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:14.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:46 smithi078 ceph-mon[94114]: pgmap v5701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 283 B/s wr, 9 op/s 2023-03-17T12:41:14.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:46 smithi078 ceph-mon[94114]: pgmap v5702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:41:14.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:14.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:48 smithi078 ceph-mon[94114]: pgmap v5703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:41:14.627 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:50 smithi078 ceph-mon[94114]: pgmap v5704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:41:15.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:52 smithi078 ceph-mon[94114]: pgmap v5705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:41:15.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:54 smithi078 ceph-mon[94114]: pgmap v5706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:41:15.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:56 smithi078 ceph-mon[94114]: pgmap v5707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:41:15.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:38:58 smithi078 ceph-mon[94114]: pgmap v5708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:15.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:00 smithi078 ceph-mon[94114]: pgmap v5709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:15.588 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:02 smithi078 ceph-mon[94114]: pgmap v5710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:15.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:04 smithi078 ceph-mon[94114]: pgmap v5711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:41:15.589 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:06 smithi078 ceph-mon[94114]: pgmap v5712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:41:15.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:08 smithi078 ceph-mon[94114]: pgmap v5713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:15.847 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:09 smithi078 ceph-mon[94114]: osdmap e425: 12 total, 12 up, 12 in 2023-03-17T12:41:16.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:10 smithi078 ceph-mon[94114]: pgmap v5715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:16.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:12 smithi078 ceph-mon[94114]: pgmap v5716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:16.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:14 smithi078 ceph-mon[94114]: pgmap v5717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:16.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:16 smithi078 ceph-mon[94114]: pgmap v5718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:16.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:18 smithi078 ceph-mon[94114]: osdmap e426: 12 total, 12 up, 12 in 2023-03-17T12:41:16.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:18 smithi078 ceph-mon[94114]: pgmap v5720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:41:16.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:20 smithi078 ceph-mon[94114]: pgmap v5721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:16.799 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:22 smithi078 ceph-mon[94114]: pgmap v5722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:24 smithi078 ceph-mon[94114]: pgmap v5723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:26 smithi078 ceph-mon[94114]: pgmap v5724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:28 smithi078 ceph-mon[94114]: pgmap v5725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:30 smithi078 ceph-mon[94114]: pgmap v5726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:32 smithi078 ceph-mon[94114]: pgmap v5727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:34 smithi078 ceph-mon[94114]: pgmap v5728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:36 smithi078 ceph-mon[94114]: pgmap v5729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:16.800 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:38 smithi078 ceph-mon[94114]: pgmap v5730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:16.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:40 smithi078 ceph-mon[94114]: pgmap v5731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:16.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:42 smithi078 ceph-mon[94114]: pgmap v5732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:16.801 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:44 smithi078 ceph-mon[94114]: pgmap v5733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:17.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:46 smithi078 ceph-mon[94114]: pgmap v5734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:17.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:17.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:17.899 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:46 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:17.901 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:19.829 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:48 smithi078 ceph-mon[94114]: pgmap v5735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:50 smithi078 ceph-mon[94114]: pgmap v5736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:52 smithi078 ceph-mon[94114]: pgmap v5737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:54 smithi078 ceph-mon[94114]: pgmap v5738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:56 smithi078 ceph-mon[94114]: pgmap v5739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:39:58 smithi078 ceph-mon[94114]: pgmap v5740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 13 op/s 2023-03-17T12:41:19.830 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:00 smithi078 ceph-mon[94114]: pgmap v5741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:02 smithi078 ceph-mon[94114]: pgmap v5742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:04 smithi078 ceph-mon[94114]: pgmap v5743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:07 smithi078 ceph-mon[94114]: pgmap v5744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:09 smithi078 ceph-mon[94114]: pgmap v5745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:10 smithi078 ceph-mon[94114]: osdmap e427: 12 total, 12 up, 12 in 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:11 smithi078 ceph-mon[94114]: pgmap v5747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:13 smithi078 ceph-mon[94114]: pgmap v5748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:15 smithi078 ceph-mon[94114]: pgmap v5749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:41:21.558 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:17 smithi078 ceph-mon[94114]: pgmap v5750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 11 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:18 smithi078 ceph-mon[94114]: pgmap v5751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:18 smithi078 ceph-mon[94114]: osdmap e428: 12 total, 12 up, 12 in 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:20 smithi078 ceph-mon[94114]: pgmap v5753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:22 smithi078 ceph-mon[94114]: pgmap v5754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:24 smithi078 ceph-mon[94114]: pgmap v5755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:26 smithi078 ceph-mon[94114]: pgmap v5756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:28 smithi078 ceph-mon[94114]: pgmap v5757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:30 smithi078 ceph-mon[94114]: pgmap v5758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 268 B/s wr, 9 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:32 smithi078 ceph-mon[94114]: pgmap v5759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:34 smithi078 ceph-mon[94114]: pgmap v5760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:36 smithi078 ceph-mon[94114]: pgmap v5761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:38 smithi078 ceph-mon[94114]: pgmap v5762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:40 smithi078 ceph-mon[94114]: pgmap v5763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:42 smithi078 ceph-mon[94114]: pgmap v5764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:44 smithi078 ceph-mon[94114]: pgmap v5765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:46 smithi078 ceph-mon[94114]: pgmap v5766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:21.559 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:47 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:48 smithi078 ceph-mon[94114]: pgmap v5767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:48 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: pgmap v5768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.560 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.561 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:41:21.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:21.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:21.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:24.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:52 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:41:24.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:52 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:52 smithi078 ceph-mon[94114]: pgmap v5769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 257 B/s wr, 8 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:52 smithi078 ceph-mon[94114]: pgmap v5770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 310 B/s wr, 10 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:54 smithi078 ceph-mon[94114]: pgmap v5771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:56 smithi078 ceph-mon[94114]: pgmap v5772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:40:58 smithi078 ceph-mon[94114]: pgmap v5773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:00 smithi078 ceph-mon[94114]: pgmap v5774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:02 smithi078 ceph-mon[94114]: pgmap v5775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:41:24.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:04 smithi078 ceph-mon[94114]: pgmap v5776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:41:24.823 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:06 smithi078 ceph-mon[94114]: pgmap v5777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:08 smithi078 ceph-mon[94114]: pgmap v5778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:09 smithi078 ceph-mon[94114]: osdmap e429: 12 total, 12 up, 12 in 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:10 smithi078 ceph-mon[94114]: pgmap v5780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:12 smithi078 ceph-mon[94114]: pgmap v5781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:14 smithi078 ceph-mon[94114]: pgmap v5782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:16 smithi078 ceph-mon[94114]: pgmap v5783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:18 smithi078 ceph-mon[94114]: pgmap v5784: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:18 smithi078 ceph-mon[94114]: osdmap e430: 12 total, 12 up, 12 in 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:20 smithi078 ceph-mon[94114]: pgmap v5786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:24.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:22 smithi078 ceph-mon[94114]: pgmap v5787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:26.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:24 smithi078 ceph-mon[94114]: pgmap v5788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:26.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:26 smithi078 ceph-mon[94114]: pgmap v5789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:26.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:28 smithi078 ceph-mon[94114]: pgmap v5790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:41:29.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:30 smithi078 ceph-mon[94114]: pgmap v5791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:41:31.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:32 smithi078 ceph-mon[94114]: pgmap v5792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:31.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:34 smithi078 ceph-mon[94114]: pgmap v5793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:31.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:36 smithi078 ceph-mon[94114]: pgmap v5794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:31.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:38 smithi078 ceph-mon[94114]: pgmap v5795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:31.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:40 smithi078 ceph-mon[94114]: pgmap v5796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:31.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:42 smithi078 ceph-mon[94114]: pgmap v5797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:44 smithi078 ceph-mon[94114]: pgmap v5798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:46 smithi078 ceph-mon[94114]: pgmap v5799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:48 smithi078 ceph-mon[94114]: pgmap v5800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:50 smithi078 ceph-mon[94114]: pgmap v5801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:52 smithi078 ceph-mon[94114]: pgmap v5802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:54 smithi078 ceph-mon[94114]: pgmap v5803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:32.934 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:32.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:32.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:56 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:32.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:57 smithi078 ceph-mon[94114]: pgmap v5804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:32.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:57 smithi078 ceph-mon[94114]: pgmap v5805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:32.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:41:59 smithi078 ceph-mon[94114]: pgmap v5806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:34.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:00 smithi078 ceph-mon[94114]: pgmap v5807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:34.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:02 smithi078 ceph-mon[94114]: pgmap v5808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:41:34.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:04 smithi078 ceph-mon[94114]: pgmap v5809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:34.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:06 smithi078 ceph-mon[94114]: pgmap v5810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:34.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:08 smithi078 ceph-mon[94114]: pgmap v5811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:09 smithi078 ceph-mon[94114]: osdmap e431: 12 total, 12 up, 12 in 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:10 smithi078 ceph-mon[94114]: pgmap v5813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:12 smithi078 ceph-mon[94114]: pgmap v5814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:14 smithi078 ceph-mon[94114]: pgmap v5815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:16 smithi078 ceph-mon[94114]: pgmap v5816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:18 smithi078 ceph-mon[94114]: pgmap v5817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:18 smithi078 ceph-mon[94114]: osdmap e432: 12 total, 12 up, 12 in 2023-03-17T12:41:36.940 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:20 smithi078 ceph-mon[94114]: pgmap v5819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:22 smithi078 ceph-mon[94114]: pgmap v5820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:24 smithi078 ceph-mon[94114]: pgmap v5821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:26 smithi078 ceph-mon[94114]: pgmap v5822: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 10 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:28 smithi078 ceph-mon[94114]: pgmap v5823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:30 smithi078 ceph-mon[94114]: pgmap v5824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 8 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:32 smithi078 ceph-mon[94114]: pgmap v5825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:34 smithi078 ceph-mon[94114]: pgmap v5826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:36 smithi078 ceph-mon[94114]: pgmap v5827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:38 smithi078 ceph-mon[94114]: pgmap v5828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:40 smithi078 ceph-mon[94114]: pgmap v5829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:36.941 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:42 smithi078 ceph-mon[94114]: pgmap v5830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:37.510 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:44 smithi078 ceph-mon[94114]: pgmap v5831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:46 smithi078 ceph-mon[94114]: pgmap v5832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:48 smithi078 ceph-mon[94114]: pgmap v5833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:50 smithi078 ceph-mon[94114]: pgmap v5834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:52 smithi078 ceph-mon[94114]: pgmap v5835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:54 smithi078 ceph-mon[94114]: pgmap v5836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:38.538 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:39.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:39.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:56 smithi078 ceph-mon[94114]: pgmap v5837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:39.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:58 smithi078 ceph-mon[94114]: pgmap v5838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:59 smithi078 ceph-mon[94114]: pgmap v5839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:59 smithi078 ceph-mon[94114]: pgmap v5840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:41:39.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:42:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:41.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:01 smithi078 ceph-mon[94114]: pgmap v5841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:41:41.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:03 smithi078 ceph-mon[94114]: pgmap v5842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:41:41.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:05 smithi078 ceph-mon[94114]: pgmap v5843: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:41:41.814 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:07 smithi078 ceph-mon[94114]: pgmap v5844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 55 KiB/s wr, 23 op/s 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:09 smithi078 ceph-mon[94114]: pgmap v5845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 30 op/s 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:09 smithi078 ceph-mon[94114]: osdmap e433: 12 total, 12 up, 12 in 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:11 smithi078 ceph-mon[94114]: pgmap v5847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 56 KiB/s wr, 30 op/s 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:13 smithi078 ceph-mon[94114]: pgmap v5848: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:15 smithi078 ceph-mon[94114]: pgmap v5849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:17 smithi078 ceph-mon[94114]: pgmap v5850: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2023-03-17T12:41:41.815 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:17 smithi078 ceph-mon[94114]: osdmap e434: 12 total, 12 up, 12 in 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:19 smithi078 ceph-mon[94114]: pgmap v5852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:21 smithi078 ceph-mon[94114]: pgmap v5853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:23 smithi078 ceph-mon[94114]: pgmap v5854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:25 smithi078 ceph-mon[94114]: pgmap v5855: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:27 smithi078 ceph-mon[94114]: pgmap v5856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:29 smithi078 ceph-mon[94114]: pgmap v5857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 370 B/s wr, 9 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:31 smithi078 ceph-mon[94114]: pgmap v5858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:33 smithi078 ceph-mon[94114]: pgmap v5859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:35 smithi078 ceph-mon[94114]: pgmap v5860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:41.816 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:37 smithi078 ceph-mon[94114]: pgmap v5861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:39 smithi078 ceph-mon[94114]: pgmap v5862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:41 smithi078 ceph-mon[94114]: pgmap v5863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:43 smithi078 ceph-mon[94114]: pgmap v5864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:45 smithi078 ceph-mon[94114]: pgmap v5865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:47 smithi078 ceph-mon[94114]: pgmap v5866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:49 smithi078 ceph-mon[94114]: pgmap v5867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 13 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:51 smithi078 ceph-mon[94114]: pgmap v5868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:53 smithi078 ceph-mon[94114]: pgmap v5869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:41.817 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:55 smithi078 ceph-mon[94114]: pgmap v5870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:41.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:57 smithi078 ceph-mon[94114]: pgmap v5871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:41.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:59 smithi078 ceph-mon[94114]: pgmap v5872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:41.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:43:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:41.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:01 smithi078 ceph-mon[94114]: pgmap v5873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:41.818 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:43.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:44.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:46.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:46.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: pgmap v5874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:46.089 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: pgmap v5875: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:41:46.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:46.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:05 smithi078 ceph-mon[94114]: pgmap v5876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:41:46.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:07 smithi078 ceph-mon[94114]: pgmap v5877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:41:46.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:09 smithi078 ceph-mon[94114]: pgmap v5878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 28 op/s 2023-03-17T12:41:46.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:09 smithi078 ceph-mon[94114]: osdmap e435: 12 total, 12 up, 12 in 2023-03-17T12:41:46.090 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:11 smithi078 ceph-mon[94114]: pgmap v5880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:41:46.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:13 smithi078 ceph-mon[94114]: pgmap v5881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:46.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:15 smithi078 ceph-mon[94114]: pgmap v5882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:46.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:17 smithi078 ceph-mon[94114]: pgmap v5883: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:46.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:17 smithi078 ceph-mon[94114]: osdmap e436: 12 total, 12 up, 12 in 2023-03-17T12:41:46.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:19 smithi078 ceph-mon[94114]: pgmap v5885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 207 B/s wr, 10 op/s 2023-03-17T12:41:46.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:21 smithi078 ceph-mon[94114]: pgmap v5886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:48.229 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:23 smithi078 ceph-mon[94114]: pgmap v5887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:48.777 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:25 smithi078 ceph-mon[94114]: pgmap v5888: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:27 smithi078 ceph-mon[94114]: pgmap v5889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:29 smithi078 ceph-mon[94114]: pgmap v5890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:31 smithi078 ceph-mon[94114]: pgmap v5891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:33 smithi078 ceph-mon[94114]: pgmap v5892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:35 smithi078 ceph-mon[94114]: pgmap v5893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:37 smithi078 ceph-mon[94114]: pgmap v5894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:39 smithi078 ceph-mon[94114]: pgmap v5895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:41 smithi078 ceph-mon[94114]: pgmap v5896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:43 smithi078 ceph-mon[94114]: pgmap v5897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:45 smithi078 ceph-mon[94114]: pgmap v5898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:47 smithi078 ceph-mon[94114]: pgmap v5899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:49 smithi078 ceph-mon[94114]: pgmap v5900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:51 smithi078 ceph-mon[94114]: pgmap v5901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.778 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:53 smithi078 ceph-mon[94114]: pgmap v5902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:55 smithi078 ceph-mon[94114]: pgmap v5903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:57 smithi078 ceph-mon[94114]: pgmap v5904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:44:59 smithi078 ceph-mon[94114]: pgmap v5905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:01 smithi078 ceph-mon[94114]: pgmap v5906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:03 smithi078 ceph-mon[94114]: pgmap v5907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:04 smithi078 ceph-mon[94114]: pgmap v5908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:41:48.779 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:04 smithi078 ceph-mon[94114]: pgmap v5909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:06 smithi078 ceph-mon[94114]: pgmap v5910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:08 smithi078 ceph-mon[94114]: pgmap v5911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:09 smithi078 ceph-mon[94114]: osdmap e437: 12 total, 12 up, 12 in 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:10 smithi078 ceph-mon[94114]: pgmap v5913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:12 smithi078 ceph-mon[94114]: pgmap v5914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:14 smithi078 ceph-mon[94114]: pgmap v5915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:53.773 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:16 smithi078 ceph-mon[94114]: pgmap v5916: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:18 smithi078 ceph-mon[94114]: pgmap v5917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:18 smithi078 ceph-mon[94114]: osdmap e438: 12 total, 12 up, 12 in 2023-03-17T12:41:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:20 smithi078 ceph-mon[94114]: pgmap v5919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:53.774 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:22 smithi078 ceph-mon[94114]: pgmap v5920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:41:55.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:24 smithi078 ceph-mon[94114]: pgmap v5921: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:55.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:26 smithi078 ceph-mon[94114]: pgmap v5922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:55.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:28 smithi078 ceph-mon[94114]: pgmap v5923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:41:57.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:30 smithi078 ceph-mon[94114]: pgmap v5924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:41:57.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:32 smithi078 ceph-mon[94114]: pgmap v5925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:57.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:34 smithi078 ceph-mon[94114]: pgmap v5926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:57.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:36 smithi078 ceph-mon[94114]: pgmap v5927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:57.415 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:38 smithi078 ceph-mon[94114]: pgmap v5928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:40 smithi078 ceph-mon[94114]: pgmap v5929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:42 smithi078 ceph-mon[94114]: pgmap v5930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:44 smithi078 ceph-mon[94114]: pgmap v5931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:46 smithi078 ceph-mon[94114]: pgmap v5932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:48 smithi078 ceph-mon[94114]: pgmap v5933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:50 smithi078 ceph-mon[94114]: pgmap v5934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:52 smithi078 ceph-mon[94114]: pgmap v5935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:54 smithi078 ceph-mon[94114]: pgmap v5936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:56 smithi078 ceph-mon[94114]: pgmap v5937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:45:58 smithi078 ceph-mon[94114]: pgmap v5938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:00 smithi078 ceph-mon[94114]: pgmap v5939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:02 smithi078 ceph-mon[94114]: pgmap v5940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:57.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:04 smithi078 ceph-mon[94114]: pgmap v5941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:57.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:05 smithi078 ceph-mon[94114]: pgmap v5942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 50 KiB/s wr, 26 op/s 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:05 smithi078 ceph-mon[94114]: pgmap v5943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 32 op/s 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:07 smithi078 ceph-mon[94114]: pgmap v5944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:09 smithi078 ceph-mon[94114]: pgmap v5945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 62 KiB/s wr, 32 op/s 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:09 smithi078 ceph-mon[94114]: osdmap e439: 12 total, 12 up, 12 in 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:11 smithi078 ceph-mon[94114]: pgmap v5947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2023-03-17T12:41:59.416 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:13 smithi078 ceph-mon[94114]: pgmap v5948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:15 smithi078 ceph-mon[94114]: pgmap v5949: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:17 smithi078 ceph-mon[94114]: pgmap v5950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:17 smithi078 ceph-mon[94114]: osdmap e440: 12 total, 12 up, 12 in 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:19 smithi078 ceph-mon[94114]: pgmap v5952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 109 B/s wr, 11 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:21 smithi078 ceph-mon[94114]: pgmap v5953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:23 smithi078 ceph-mon[94114]: pgmap v5954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:25 smithi078 ceph-mon[94114]: pgmap v5955: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:27 smithi078 ceph-mon[94114]: pgmap v5956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:29 smithi078 ceph-mon[94114]: pgmap v5957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 392 B/s wr, 10 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:31 smithi078 ceph-mon[94114]: pgmap v5958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:33 smithi078 ceph-mon[94114]: pgmap v5959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:35 smithi078 ceph-mon[94114]: pgmap v5960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:37 smithi078 ceph-mon[94114]: pgmap v5961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:39 smithi078 ceph-mon[94114]: pgmap v5962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:41 smithi078 ceph-mon[94114]: pgmap v5963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:59.417 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:43 smithi078 ceph-mon[94114]: pgmap v5964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:45 smithi078 ceph-mon[94114]: pgmap v5965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:47 smithi078 ceph-mon[94114]: pgmap v5966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:49 smithi078 ceph-mon[94114]: pgmap v5967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:51 smithi078 ceph-mon[94114]: pgmap v5968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:53 smithi078 ceph-mon[94114]: pgmap v5969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:55 smithi078 ceph-mon[94114]: pgmap v5970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:46:58 smithi078 ceph-mon[94114]: pgmap v5971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:00 smithi078 ceph-mon[94114]: pgmap v5972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:02 smithi078 ceph-mon[94114]: pgmap v5973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:04 smithi078 ceph-mon[94114]: pgmap v5974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:06 smithi078 ceph-mon[94114]: pgmap v5975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:06 smithi078 ceph-mon[94114]: pgmap v5976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:41:59.418 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:06 smithi078 ceph-mon[94114]: pgmap v5977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:41:59.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:41:59.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:08 smithi078 ceph-mon[94114]: pgmap v5978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:41:59.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:10 smithi078 ceph-mon[94114]: pgmap v5979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:41:59.419 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:10 smithi078 ceph-mon[94114]: osdmap e441: 12 total, 12 up, 12 in 2023-03-17T12:42:00.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:11 smithi078 ceph-mon[94114]: pgmap v5981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:00.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:13 smithi078 ceph-mon[94114]: pgmap v5982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:00.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:16 smithi078 ceph-mon[94114]: pgmap v5983: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:00.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:18 smithi078 ceph-mon[94114]: pgmap v5984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:18 smithi078 ceph-mon[94114]: osdmap e442: 12 total, 12 up, 12 in 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:19 smithi078 ceph-mon[94114]: pgmap v5986: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:22 smithi078 ceph-mon[94114]: pgmap v5987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:23 smithi078 ceph-mon[94114]: pgmap v5988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:26 smithi078 ceph-mon[94114]: pgmap v5989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:27 smithi078 ceph-mon[94114]: pgmap v5990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:30 smithi078 ceph-mon[94114]: pgmap v5991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:42:02.301 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:31 smithi078 ceph-mon[94114]: pgmap v5992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:33 smithi078 ceph-mon[94114]: pgmap v5993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:36 smithi078 ceph-mon[94114]: pgmap v5994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:37 smithi078 ceph-mon[94114]: pgmap v5995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:39 smithi078 ceph-mon[94114]: pgmap v5996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:41 smithi078 ceph-mon[94114]: pgmap v5997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:43 smithi078 ceph-mon[94114]: pgmap v5998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:45 smithi078 ceph-mon[94114]: pgmap v5999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:47 smithi078 ceph-mon[94114]: pgmap v6000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:49 smithi078 ceph-mon[94114]: pgmap v6001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:51 smithi078 ceph-mon[94114]: pgmap v6002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:53 smithi078 ceph-mon[94114]: pgmap v6003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:55 smithi078 ceph-mon[94114]: pgmap v6004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:57 smithi078 ceph-mon[94114]: pgmap v6005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:47:59 smithi078 ceph-mon[94114]: pgmap v6006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:01 smithi078 ceph-mon[94114]: pgmap v6007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:02.302 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:03 smithi078 ceph-mon[94114]: pgmap v6008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:04 smithi078 ceph-mon[94114]: osdmap e443: 12 total, 12 up, 12 in 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:05 smithi078 ceph-mon[94114]: pgmap v6010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:06 smithi078 ceph-mon[94114]: pgmap v6011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 26 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:06 smithi078 ceph-mon[94114]: pgmap v6012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 79 KiB/s wr, 33 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:08 smithi078 ceph-mon[94114]: pgmap v6013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 80 KiB/s wr, 41 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:10 smithi078 ceph-mon[94114]: pgmap v6014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 600 B/s wr, 7 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:13 smithi078 ceph-mon[94114]: pgmap v6015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 634 B/s wr, 7 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:13 smithi078 ceph-mon[94114]: osdmap e444: 12 total, 12 up, 12 in 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:15 smithi078 ceph-mon[94114]: pgmap v6017: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:16 smithi078 ceph-mon[94114]: daemon mds.d restarted 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:16 smithi078 ceph-mon[94114]: osdmap e445: 12 total, 12 up, 12 in 2023-03-17T12:42:02.303 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:17 smithi078 ceph-mon[94114]: pgmap v6019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 127 B/s wr, 5 op/s 2023-03-17T12:42:02.304 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:17 smithi078 ceph-mon[94114]: mds.? [v2:172.21.15.35:6836/506999199,v1:172.21.15.35:6837/506999199] up:boot 2023-03-17T12:42:02.304 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:17 smithi078 ceph-mon[94114]: fsmap cephfs:5 4 up:standby-replay 2 up:standby 5 up:active 2023-03-17T12:42:02.304 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-03-17T12:42:04.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:17 smithi078 ceph-mon[94114]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2023-03-17T12:42:04.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:18 smithi078 ceph-mon[94114]: pgmap v6020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 639 B/s wr, 11 op/s 2023-03-17T12:42:04.546 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:21 smithi078 ceph-mon[94114]: pgmap v6021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:42:11.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:23 smithi078 ceph-mon[94114]: pgmap v6022: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 451 B/s wr, 7 op/s 2023-03-17T12:42:11.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:25 smithi078 ceph-mon[94114]: pgmap v6023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:42:11.488 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:27 smithi078 ceph-mon[94114]: pgmap v6024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 374 B/s wr, 9 op/s 2023-03-17T12:42:12.775 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:28 smithi078 ceph-mon[94114]: pgmap v6025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:42:12.775 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:31 smithi078 ceph-mon[94114]: pgmap v6026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:33 smithi078 ceph-mon[94114]: pgmap v6027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:35 smithi078 ceph-mon[94114]: pgmap v6028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:37 smithi078 ceph-mon[94114]: pgmap v6029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:38 smithi078 ceph-mon[94114]: pgmap v6030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:41 smithi078 ceph-mon[94114]: pgmap v6031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:43 smithi078 ceph-mon[94114]: pgmap v6032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:45 smithi078 ceph-mon[94114]: pgmap v6033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:47 smithi078 ceph-mon[94114]: pgmap v6034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:12.776 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:48 smithi078 ceph-mon[94114]: pgmap v6035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:15.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:51 smithi078 ceph-mon[94114]: pgmap v6036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:15.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:53 smithi078 ceph-mon[94114]: pgmap v6037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:42:15.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:55 smithi078 ceph-mon[94114]: pgmap v6038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:42:15.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:57 smithi078 ceph-mon[94114]: pgmap v6039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:15.857 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:48:58 smithi078 ceph-mon[94114]: pgmap v6040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:01 smithi078 ceph-mon[94114]: pgmap v6041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:03 smithi078 ceph-mon[94114]: pgmap v6042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 23 KiB/s wr, 12 op/s 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:05 smithi078 ceph-mon[94114]: pgmap v6043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:07 smithi078 ceph-mon[94114]: pgmap v6044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:15.858 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:08 smithi078 ceph-mon[94114]: pgmap v6045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:42:15.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:08 smithi078 ceph-mon[94114]: pgmap v6046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:42:15.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:10 smithi078 ceph-mon[94114]: pgmap v6047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:42:15.859 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:10 smithi078 ceph-mon[94114]: osdmap e446: 12 total, 12 up, 12 in 2023-03-17T12:42:18.876 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:12 smithi078 ceph-mon[94114]: pgmap v6049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:18.876 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:14 smithi078 ceph-mon[94114]: pgmap v6050: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:16 smithi078 ceph-mon[94114]: pgmap v6051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:18 smithi078 ceph-mon[94114]: pgmap v6052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:18 smithi078 ceph-mon[94114]: osdmap e447: 12 total, 12 up, 12 in 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:20 smithi078 ceph-mon[94114]: pgmap v6054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:22 smithi078 ceph-mon[94114]: pgmap v6055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:24 smithi078 ceph-mon[94114]: pgmap v6056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:18.877 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:26 smithi078 ceph-mon[94114]: pgmap v6057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:18.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:28 smithi078 ceph-mon[94114]: pgmap v6058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:18.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:30 smithi078 ceph-mon[94114]: pgmap v6059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:42:18.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:32 smithi078 ceph-mon[94114]: pgmap v6060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:18.878 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:34 smithi078 ceph-mon[94114]: pgmap v6061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:21.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:36 smithi078 ceph-mon[94114]: pgmap v6062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:38 smithi078 ceph-mon[94114]: pgmap v6063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:40 smithi078 ceph-mon[94114]: pgmap v6064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:21.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:42 smithi078 ceph-mon[94114]: pgmap v6065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.340 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:44 smithi078 ceph-mon[94114]: pgmap v6066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:46 smithi078 ceph-mon[94114]: pgmap v6067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:48 smithi078 ceph-mon[94114]: pgmap v6068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:50 smithi078 ceph-mon[94114]: pgmap v6069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:52 smithi078 ceph-mon[94114]: pgmap v6070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:54 smithi078 ceph-mon[94114]: pgmap v6071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:56 smithi078 ceph-mon[94114]: pgmap v6072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:49:58 smithi078 ceph-mon[94114]: pgmap v6073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:21.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:00 smithi078 ceph-mon[94114]: pgmap v6074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2023-03-17T12:42:21.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:42:21.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:02 smithi078 ceph-mon[94114]: pgmap v6075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 8 op/s 2023-03-17T12:42:24.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:04 smithi078 ceph-mon[94114]: pgmap v6076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:24.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:06 smithi078 ceph-mon[94114]: pgmap v6077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:42:24.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:24.701 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:08 smithi078 ceph-mon[94114]: pgmap v6078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:42:24.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:24.702 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:09 smithi078 ceph-mon[94114]: pgmap v6079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:09 smithi078 ceph-mon[94114]: pgmap v6080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 59 KiB/s wr, 30 op/s 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:10 smithi078 ceph-mon[94114]: osdmap e448: 12 total, 12 up, 12 in 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:11 smithi078 ceph-mon[94114]: pgmap v6082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:42:25.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:13 smithi078 ceph-mon[94114]: pgmap v6083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2023-03-17T12:42:25.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:13 smithi078 ceph-mon[94114]: osdmap e449: 12 total, 12 up, 12 in 2023-03-17T12:42:25.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:15 smithi078 ceph-mon[94114]: pgmap v6085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:25.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:17 smithi078 ceph-mon[94114]: pgmap v6086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:18 smithi078 ceph-mon[94114]: pgmap v6087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 114 B/s wr, 11 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:21 smithi078 ceph-mon[94114]: pgmap v6088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:23 smithi078 ceph-mon[94114]: pgmap v6089: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:25 smithi078 ceph-mon[94114]: pgmap v6090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 459 B/s wr, 9 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:27 smithi078 ceph-mon[94114]: pgmap v6091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:28 smithi078 ceph-mon[94114]: pgmap v6092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:31 smithi078 ceph-mon[94114]: pgmap v6093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:42:27.472 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:33 smithi078 ceph-mon[94114]: pgmap v6094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:35 smithi078 ceph-mon[94114]: pgmap v6095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:37 smithi078 ceph-mon[94114]: pgmap v6096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:38 smithi078 ceph-mon[94114]: pgmap v6097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:41 smithi078 ceph-mon[94114]: pgmap v6098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:43 smithi078 ceph-mon[94114]: pgmap v6099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:45 smithi078 ceph-mon[94114]: pgmap v6100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:47 smithi078 ceph-mon[94114]: pgmap v6101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:48 smithi078 ceph-mon[94114]: pgmap v6102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:51 smithi078 ceph-mon[94114]: pgmap v6103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:53 smithi078 ceph-mon[94114]: pgmap v6104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:55 smithi078 ceph-mon[94114]: pgmap v6105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:27.473 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:57 smithi078 ceph-mon[94114]: pgmap v6106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:50:58 smithi078 ceph-mon[94114]: pgmap v6107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:01 smithi078 ceph-mon[94114]: pgmap v6108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:03 smithi078 ceph-mon[94114]: pgmap v6109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:05 smithi078 ceph-mon[94114]: pgmap v6110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:07 smithi078 ceph-mon[94114]: pgmap v6111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:08 smithi078 ceph-mon[94114]: pgmap v6112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:27.474 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:27.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:08 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:27.475 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:09 smithi078 ceph-mon[94114]: osdmap e450: 12 total, 12 up, 12 in 2023-03-17T12:42:28.769 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:10 smithi078 ceph-mon[94114]: pgmap v6114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:28.770 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:29.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:29.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:29.976 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:31.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:31.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:31.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: pgmap v6115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:32.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:32.158 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:34.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.453 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.454 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:34.455 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:42:36.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:36.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:14 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:14 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:14 smithi078 ceph-mon[94114]: pgmap v6116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 245 B/s wr, 12 op/s 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:14 smithi078 ceph-mon[94114]: pgmap v6117: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 322 B/s wr, 16 op/s 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:16 smithi078 ceph-mon[94114]: pgmap v6118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 161 B/s wr, 8 op/s 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:18 smithi078 ceph-mon[94114]: pgmap v6119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 136 B/s wr, 6 op/s 2023-03-17T12:42:36.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:18 smithi078 ceph-mon[94114]: osdmap e451: 12 total, 12 up, 12 in 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:20 smithi078 ceph-mon[94114]: pgmap v6121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 161 B/s wr, 8 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:22 smithi078 ceph-mon[94114]: pgmap v6122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:24 smithi078 ceph-mon[94114]: pgmap v6123: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:26 smithi078 ceph-mon[94114]: pgmap v6124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:28 smithi078 ceph-mon[94114]: pgmap v6125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:30 smithi078 ceph-mon[94114]: pgmap v6126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:32 smithi078 ceph-mon[94114]: pgmap v6127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:34 smithi078 ceph-mon[94114]: pgmap v6128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:36 smithi078 ceph-mon[94114]: pgmap v6129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:38 smithi078 ceph-mon[94114]: pgmap v6130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:40 smithi078 ceph-mon[94114]: pgmap v6131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:36.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:42 smithi078 ceph-mon[94114]: pgmap v6132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:44 smithi078 ceph-mon[94114]: pgmap v6133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:36.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:46 smithi078 ceph-mon[94114]: pgmap v6134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:48 smithi078 ceph-mon[94114]: pgmap v6135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:50 smithi078 ceph-mon[94114]: pgmap v6136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:36.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:52 smithi078 ceph-mon[94114]: pgmap v6137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:54 smithi078 ceph-mon[94114]: pgmap v6138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:36.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:56 smithi078 ceph-mon[94114]: pgmap v6139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:36.450 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:51:58 smithi078 ceph-mon[94114]: pgmap v6140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:39.217 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:00 smithi078 ceph-mon[94114]: pgmap v6141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:39.921 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:02 smithi078 ceph-mon[94114]: pgmap v6142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:41.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:04 smithi078 ceph-mon[94114]: pgmap v6143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:42:41.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:06 smithi078 ceph-mon[94114]: pgmap v6144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:41.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:08 smithi078 ceph-mon[94114]: pgmap v6145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:41.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:10 smithi078 ceph-mon[94114]: pgmap v6146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:42.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:10 smithi078 ceph-mon[94114]: osdmap e452: 12 total, 12 up, 12 in 2023-03-17T12:42:42.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:12 smithi078 ceph-mon[94114]: pgmap v6148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:42.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:42.469 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:14 smithi078 ceph-mon[94114]: pgmap v6149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 921 B/s wr, 10 op/s 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:15 smithi078 ceph-mon[94114]: pgmap v6150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 KiB/s wr, 12 op/s 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:15 smithi078 ceph-mon[94114]: pgmap v6151: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.3 KiB/s wr, 16 op/s 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:16 smithi078 ceph-mon[94114]: pgmap v6152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:18 smithi078 ceph-mon[94114]: pgmap v6153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-03-17T12:42:42.470 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:18 smithi078 ceph-mon[94114]: osdmap e453: 12 total, 12 up, 12 in 2023-03-17T12:42:42.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:20 smithi078 ceph-mon[94114]: pgmap v6155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:42.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:22 smithi078 ceph-mon[94114]: pgmap v6156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:42:42.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:24 smithi078 ceph-mon[94114]: pgmap v6157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:42:42.471 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:26 smithi078 ceph-mon[94114]: pgmap v6158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2023-03-17T12:42:44.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:28 smithi078 ceph-mon[94114]: pgmap v6159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 409 B/s wr, 10 op/s 2023-03-17T12:42:44.314 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:30 smithi078 ceph-mon[94114]: pgmap v6160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 361 B/s wr, 9 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:32 smithi078 ceph-mon[94114]: pgmap v6161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:34 smithi078 ceph-mon[94114]: pgmap v6162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 12 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:36 smithi078 ceph-mon[94114]: pgmap v6163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:38 smithi078 ceph-mon[94114]: pgmap v6164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:40 smithi078 ceph-mon[94114]: pgmap v6165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:42 smithi078 ceph-mon[94114]: pgmap v6166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:44 smithi078 ceph-mon[94114]: pgmap v6167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:46 smithi078 ceph-mon[94114]: pgmap v6168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:48 smithi078 ceph-mon[94114]: pgmap v6169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:50 smithi078 ceph-mon[94114]: pgmap v6170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:52 smithi078 ceph-mon[94114]: pgmap v6171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:54 smithi078 ceph-mon[94114]: pgmap v6172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:56 smithi078 ceph-mon[94114]: pgmap v6173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:52:59 smithi078 ceph-mon[94114]: pgmap v6174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:01 smithi078 ceph-mon[94114]: pgmap v6175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:44.315 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:03 smithi078 ceph-mon[94114]: pgmap v6176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:05 smithi078 ceph-mon[94114]: pgmap v6177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:07 smithi078 ceph-mon[94114]: pgmap v6178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:09 smithi078 ceph-mon[94114]: pgmap v6179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:10 smithi078 ceph-mon[94114]: osdmap e454: 12 total, 12 up, 12 in 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:11 smithi078 ceph-mon[94114]: pgmap v6181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:13 smithi078 ceph-mon[94114]: pgmap v6182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:15 smithi078 ceph-mon[94114]: pgmap v6183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:16 smithi078 ceph-mon[94114]: pgmap v6184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:42:44.316 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:16 smithi078 ceph-mon[94114]: pgmap v6185: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:42:44.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:18 smithi078 ceph-mon[94114]: pgmap v6186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 135 B/s wr, 6 op/s 2023-03-17T12:42:44.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:18 smithi078 ceph-mon[94114]: osdmap e455: 12 total, 12 up, 12 in 2023-03-17T12:42:44.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:20 smithi078 ceph-mon[94114]: pgmap v6188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:42:44.317 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:22 smithi078 ceph-mon[94114]: pgmap v6189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:42:45.900 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:24 smithi078 ceph-mon[94114]: pgmap v6190: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:42:45.900 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:26 smithi078 ceph-mon[94114]: pgmap v6191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:45.900 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:28 smithi078 ceph-mon[94114]: pgmap v6192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:46.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:30 smithi078 ceph-mon[94114]: pgmap v6193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:42:46.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:32 smithi078 ceph-mon[94114]: pgmap v6194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:46.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:34 smithi078 ceph-mon[94114]: pgmap v6195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:46.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:36 smithi078 ceph-mon[94114]: pgmap v6196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:46.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:38 smithi078 ceph-mon[94114]: pgmap v6197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:46.294 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:40 smithi078 ceph-mon[94114]: pgmap v6198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:46.812 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:42 smithi078 ceph-mon[94114]: pgmap v6199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:46.812 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:44 smithi078 ceph-mon[94114]: pgmap v6200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:46.812 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:46 smithi078 ceph-mon[94114]: pgmap v6201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:47.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:48 smithi078 ceph-mon[94114]: pgmap v6202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:47.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:50 smithi078 ceph-mon[94114]: pgmap v6203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:47.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:52 smithi078 ceph-mon[94114]: pgmap v6204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:47.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:54 smithi078 ceph-mon[94114]: pgmap v6205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:47.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:56 smithi078 ceph-mon[94114]: pgmap v6206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:47.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:53:58 smithi078 ceph-mon[94114]: pgmap v6207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:47.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:00 smithi078 ceph-mon[94114]: pgmap v6208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:47.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:02 smithi078 ceph-mon[94114]: pgmap v6209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:47.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:04 smithi078 ceph-mon[94114]: pgmap v6210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:42:47.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:06 smithi078 ceph-mon[94114]: pgmap v6211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:48.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:08 smithi078 ceph-mon[94114]: pgmap v6212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:48.842 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:10 smithi078 ceph-mon[94114]: pgmap v6213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:48.842 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:10 smithi078 ceph-mon[94114]: osdmap e456: 12 total, 12 up, 12 in 2023-03-17T12:42:48.842 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:12 smithi078 ceph-mon[94114]: pgmap v6215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:48.842 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:14 smithi078 ceph-mon[94114]: pgmap v6216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:50.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:50.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:16 smithi078 ceph-mon[94114]: pgmap v6217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:50.172 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:50.173 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:51.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:51.218 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:17 smithi078 ceph-mon[94114]: pgmap v6218: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:17 smithi078 ceph-mon[94114]: pgmap v6219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:18 smithi078 ceph-mon[94114]: pgmap v6220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 248 B/s wr, 12 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:18 smithi078 ceph-mon[94114]: osdmap e457: 12 total, 12 up, 12 in 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:20 smithi078 ceph-mon[94114]: pgmap v6222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:22 smithi078 ceph-mon[94114]: pgmap v6223: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:24 smithi078 ceph-mon[94114]: pgmap v6224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:26 smithi078 ceph-mon[94114]: pgmap v6225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:28 smithi078 ceph-mon[94114]: pgmap v6226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:30 smithi078 ceph-mon[94114]: pgmap v6227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:32 smithi078 ceph-mon[94114]: pgmap v6228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:34 smithi078 ceph-mon[94114]: pgmap v6229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:36 smithi078 ceph-mon[94114]: pgmap v6230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.219 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:39 smithi078 ceph-mon[94114]: pgmap v6231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:41 smithi078 ceph-mon[94114]: pgmap v6232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:43 smithi078 ceph-mon[94114]: pgmap v6233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:45 smithi078 ceph-mon[94114]: pgmap v6234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:47 smithi078 ceph-mon[94114]: pgmap v6235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:49 smithi078 ceph-mon[94114]: pgmap v6236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:51 smithi078 ceph-mon[94114]: pgmap v6237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:53 smithi078 ceph-mon[94114]: pgmap v6238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:55 smithi078 ceph-mon[94114]: pgmap v6239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:57 smithi078 ceph-mon[94114]: pgmap v6240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:54:59 smithi078 ceph-mon[94114]: pgmap v6241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:01 smithi078 ceph-mon[94114]: pgmap v6242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:03 smithi078 ceph-mon[94114]: pgmap v6243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:05 smithi078 ceph-mon[94114]: pgmap v6244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:07 smithi078 ceph-mon[94114]: pgmap v6245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:51.220 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:09 smithi078 ceph-mon[94114]: pgmap v6246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:52.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:10 smithi078 ceph-mon[94114]: osdmap e458: 12 total, 12 up, 12 in 2023-03-17T12:42:52.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:11 smithi078 ceph-mon[94114]: pgmap v6248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:52.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:13 smithi078 ceph-mon[94114]: pgmap v6249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:52.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:15 smithi078 ceph-mon[94114]: pgmap v6250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:52.401 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:54.508 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:17 smithi078 ceph-mon[94114]: pgmap v6251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:18 smithi078 ceph-mon[94114]: pgmap v6252: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 115 B/s wr, 5 op/s 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:18 smithi078 ceph-mon[94114]: pgmap v6253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:18 smithi078 ceph-mon[94114]: osdmap e459: 12 total, 12 up, 12 in 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:20 smithi078 ceph-mon[94114]: pgmap v6255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:22 smithi078 ceph-mon[94114]: pgmap v6256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:42:55.247 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:24 smithi078 ceph-mon[94114]: pgmap v6257: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:26 smithi078 ceph-mon[94114]: pgmap v6258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:28 smithi078 ceph-mon[94114]: pgmap v6259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:30 smithi078 ceph-mon[94114]: pgmap v6260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:32 smithi078 ceph-mon[94114]: pgmap v6261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:34 smithi078 ceph-mon[94114]: pgmap v6262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:36 smithi078 ceph-mon[94114]: pgmap v6263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:38 smithi078 ceph-mon[94114]: pgmap v6264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:40 smithi078 ceph-mon[94114]: pgmap v6265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:42 smithi078 ceph-mon[94114]: pgmap v6266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:44 smithi078 ceph-mon[94114]: pgmap v6267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:46 smithi078 ceph-mon[94114]: pgmap v6268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:48 smithi078 ceph-mon[94114]: pgmap v6269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:50 smithi078 ceph-mon[94114]: pgmap v6270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:52 smithi078 ceph-mon[94114]: pgmap v6271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:54 smithi078 ceph-mon[94114]: pgmap v6272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:55.248 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:56 smithi078 ceph-mon[94114]: pgmap v6273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:55:58 smithi078 ceph-mon[94114]: pgmap v6274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:00 smithi078 ceph-mon[94114]: pgmap v6275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:02 smithi078 ceph-mon[94114]: pgmap v6276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:04 smithi078 ceph-mon[94114]: pgmap v6277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:06 smithi078 ceph-mon[94114]: pgmap v6278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:08 smithi078 ceph-mon[94114]: pgmap v6279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:10 smithi078 ceph-mon[94114]: pgmap v6280: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:10 smithi078 ceph-mon[94114]: osdmap e460: 12 total, 12 up, 12 in 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:12 smithi078 ceph-mon[94114]: pgmap v6282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:42:55.249 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:14 smithi078 ceph-mon[94114]: pgmap v6283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:59.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:16 smithi078 ceph-mon[94114]: pgmap v6284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:59.001 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:18 smithi078 ceph-mon[94114]: pgmap v6285: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:18 smithi078 ceph-mon[94114]: pgmap v6286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:18 smithi078 ceph-mon[94114]: pgmap v6287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 259 B/s wr, 13 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:18 smithi078 ceph-mon[94114]: osdmap e461: 12 total, 12 up, 12 in 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:20 smithi078 ceph-mon[94114]: pgmap v6289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:22 smithi078 ceph-mon[94114]: pgmap v6290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:24 smithi078 ceph-mon[94114]: pgmap v6291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:26 smithi078 ceph-mon[94114]: pgmap v6292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:28 smithi078 ceph-mon[94114]: pgmap v6293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:30 smithi078 ceph-mon[94114]: pgmap v6294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:32 smithi078 ceph-mon[94114]: pgmap v6295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:59.002 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:34 smithi078 ceph-mon[94114]: pgmap v6296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:36 smithi078 ceph-mon[94114]: pgmap v6297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:38 smithi078 ceph-mon[94114]: pgmap v6298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:40 smithi078 ceph-mon[94114]: pgmap v6299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:42 smithi078 ceph-mon[94114]: pgmap v6300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:44 smithi078 ceph-mon[94114]: pgmap v6301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:46 smithi078 ceph-mon[94114]: pgmap v6302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:42:59.003 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:48 smithi078 ceph-mon[94114]: pgmap v6303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:50 smithi078 ceph-mon[94114]: pgmap v6304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:52 smithi078 ceph-mon[94114]: pgmap v6305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:54 smithi078 ceph-mon[94114]: pgmap v6306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:56 smithi078 ceph-mon[94114]: pgmap v6307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:56:58 smithi078 ceph-mon[94114]: pgmap v6308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:00 smithi078 ceph-mon[94114]: pgmap v6309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:02 smithi078 ceph-mon[94114]: pgmap v6310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:00.676 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:04 smithi078 ceph-mon[94114]: pgmap v6311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:06 smithi078 ceph-mon[94114]: pgmap v6312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:08 smithi078 ceph-mon[94114]: pgmap v6313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:10 smithi078 ceph-mon[94114]: pgmap v6314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:10 smithi078 ceph-mon[94114]: osdmap e462: 12 total, 12 up, 12 in 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:12 smithi078 ceph-mon[94114]: pgmap v6316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:14 smithi078 ceph-mon[94114]: pgmap v6317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:16 smithi078 ceph-mon[94114]: pgmap v6318: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:18 smithi078 ceph-mon[94114]: pgmap v6319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:18 smithi078 ceph-mon[94114]: osdmap e463: 12 total, 12 up, 12 in 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:19 smithi078 ceph-mon[94114]: pgmap v6320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:43:00.677 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:19 smithi078 ceph-mon[94114]: pgmap v6321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:21 smithi078 ceph-mon[94114]: pgmap v6323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:23 smithi078 ceph-mon[94114]: pgmap v6324: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:25 smithi078 ceph-mon[94114]: pgmap v6325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:27 smithi078 ceph-mon[94114]: pgmap v6326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:29 smithi078 ceph-mon[94114]: pgmap v6327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:31 smithi078 ceph-mon[94114]: pgmap v6328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:00.678 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:33 smithi078 ceph-mon[94114]: pgmap v6329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:35 smithi078 ceph-mon[94114]: pgmap v6330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:37 smithi078 ceph-mon[94114]: pgmap v6331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:39 smithi078 ceph-mon[94114]: pgmap v6332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:41 smithi078 ceph-mon[94114]: pgmap v6333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:43 smithi078 ceph-mon[94114]: pgmap v6334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:45 smithi078 ceph-mon[94114]: pgmap v6335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:47 smithi078 ceph-mon[94114]: pgmap v6336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:49 smithi078 ceph-mon[94114]: pgmap v6337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:51 smithi078 ceph-mon[94114]: pgmap v6338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:53 smithi078 ceph-mon[94114]: pgmap v6339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:55 smithi078 ceph-mon[94114]: pgmap v6340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:57 smithi078 ceph-mon[94114]: pgmap v6341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:02.728 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:57:59 smithi078 ceph-mon[94114]: pgmap v6342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:01 smithi078 ceph-mon[94114]: pgmap v6343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:03 smithi078 ceph-mon[94114]: pgmap v6344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:05 smithi078 ceph-mon[94114]: pgmap v6345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:07 smithi078 ceph-mon[94114]: pgmap v6346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:09 smithi078 ceph-mon[94114]: pgmap v6347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:10 smithi078 ceph-mon[94114]: osdmap e464: 12 total, 12 up, 12 in 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:11 smithi078 ceph-mon[94114]: pgmap v6349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:03.939 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:13 smithi078 ceph-mon[94114]: pgmap v6350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:04.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:15 smithi078 ceph-mon[94114]: pgmap v6351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:04.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:17 smithi078 ceph-mon[94114]: pgmap v6352: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:18 smithi078 ceph-mon[94114]: osdmap e465: 12 total, 12 up, 12 in 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:19 smithi078 ceph-mon[94114]: pgmap v6353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:20 smithi078 ceph-mon[94114]: pgmap v6355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:20 smithi078 ceph-mon[94114]: pgmap v6356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:43:04.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:21 smithi078 ceph-mon[94114]: pgmap v6357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:43:05.353 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:24 smithi078 ceph-mon[94114]: pgmap v6358: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:43:06.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:26 smithi078 ceph-mon[94114]: pgmap v6359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-03-17T12:43:06.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:28 smithi078 ceph-mon[94114]: pgmap v6360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:43:06.675 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:30 smithi078 ceph-mon[94114]: pgmap v6361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:07.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:32 smithi078 ceph-mon[94114]: pgmap v6362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:34 smithi078 ceph-mon[94114]: pgmap v6363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:07.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:36 smithi078 ceph-mon[94114]: pgmap v6364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:38 smithi078 ceph-mon[94114]: pgmap v6365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:40 smithi078 ceph-mon[94114]: pgmap v6366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:07.044 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:42 smithi078 ceph-mon[94114]: pgmap v6367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:44 smithi078 ceph-mon[94114]: pgmap v6368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:46 smithi078 ceph-mon[94114]: pgmap v6369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:48 smithi078 ceph-mon[94114]: pgmap v6370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:50 smithi078 ceph-mon[94114]: pgmap v6371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:52 smithi078 ceph-mon[94114]: pgmap v6372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:54 smithi078 ceph-mon[94114]: pgmap v6373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:56 smithi078 ceph-mon[94114]: pgmap v6374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:07.707 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:58:58 smithi078 ceph-mon[94114]: pgmap v6375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:00 smithi078 ceph-mon[94114]: pgmap v6376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:02 smithi078 ceph-mon[94114]: pgmap v6377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:04 smithi078 ceph-mon[94114]: pgmap v6378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:08.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:06 smithi078 ceph-mon[94114]: pgmap v6379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:08.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:08 smithi078 ceph-mon[94114]: pgmap v6380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:08.965 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:10 smithi078 ceph-mon[94114]: pgmap v6381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:10 smithi078 ceph-mon[94114]: osdmap e466: 12 total, 12 up, 12 in 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:12 smithi078 ceph-mon[94114]: pgmap v6383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:14 smithi078 ceph-mon[94114]: pgmap v6384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:16 smithi078 ceph-mon[94114]: pgmap v6385: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:18 smithi078 ceph-mon[94114]: pgmap v6386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:18 smithi078 ceph-mon[94114]: osdmap e467: 12 total, 12 up, 12 in 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:20 smithi078 ceph-mon[94114]: pgmap v6388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:21 smithi078 ceph-mon[94114]: pgmap v6389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:21 smithi078 ceph-mon[94114]: pgmap v6390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:23 smithi078 ceph-mon[94114]: pgmap v6391: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:25 smithi078 ceph-mon[94114]: pgmap v6392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:27 smithi078 ceph-mon[94114]: pgmap v6393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-03-17T12:43:08.966 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:29 smithi078 ceph-mon[94114]: pgmap v6394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:31 smithi078 ceph-mon[94114]: pgmap v6395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:33 smithi078 ceph-mon[94114]: pgmap v6396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:35 smithi078 ceph-mon[94114]: pgmap v6397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:37 smithi078 ceph-mon[94114]: pgmap v6398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:39 smithi078 ceph-mon[94114]: pgmap v6399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:41 smithi078 ceph-mon[94114]: pgmap v6400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:43 smithi078 ceph-mon[94114]: pgmap v6401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:45 smithi078 ceph-mon[94114]: pgmap v6402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:47 smithi078 ceph-mon[94114]: pgmap v6403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:49 smithi078 ceph-mon[94114]: pgmap v6404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:51 smithi078 ceph-mon[94114]: pgmap v6405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:53 smithi078 ceph-mon[94114]: pgmap v6406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:55 smithi078 ceph-mon[94114]: pgmap v6407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:57 smithi078 ceph-mon[94114]: pgmap v6408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 11:59:59 smithi078 ceph-mon[94114]: pgmap v6409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:43:08.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:01 smithi078 ceph-mon[94114]: pgmap v6410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:03 smithi078 ceph-mon[94114]: pgmap v6411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:05 smithi078 ceph-mon[94114]: pgmap v6412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:07 smithi078 ceph-mon[94114]: pgmap v6413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:09 smithi078 ceph-mon[94114]: pgmap v6414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:10 smithi078 ceph-mon[94114]: osdmap e468: 12 total, 12 up, 12 in 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:11 smithi078 ceph-mon[94114]: pgmap v6416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:08.968 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:13 smithi078 ceph-mon[94114]: pgmap v6417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:15 smithi078 ceph-mon[94114]: pgmap v6418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:17 smithi078 ceph-mon[94114]: pgmap v6419: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:19 smithi078 ceph-mon[94114]: pgmap v6420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:19 smithi078 ceph-mon[94114]: osdmap e469: 12 total, 12 up, 12 in 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:21 smithi078 ceph-mon[94114]: pgmap v6422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:10.192 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:22 smithi078 ceph-mon[94114]: pgmap v6423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:22 smithi078 ceph-mon[94114]: pgmap v6424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 143 B/s wr, 7 op/s 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:24 smithi078 ceph-mon[94114]: pgmap v6425: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 143 B/s wr, 14 op/s 2023-03-17T12:43:10.193 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:26 smithi078 ceph-mon[94114]: pgmap v6426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2023-03-17T12:43:12.384 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:28 smithi078 ceph-mon[94114]: pgmap v6427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:43:12.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:30 smithi078 ceph-mon[94114]: pgmap v6428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:43:12.385 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:32 smithi078 ceph-mon[94114]: pgmap v6429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:13.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:34 smithi078 ceph-mon[94114]: pgmap v6430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:13.452 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:36 smithi078 ceph-mon[94114]: pgmap v6431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:38 smithi078 ceph-mon[94114]: pgmap v6432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:40 smithi078 ceph-mon[94114]: pgmap v6433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:42 smithi078 ceph-mon[94114]: pgmap v6434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:44 smithi078 ceph-mon[94114]: pgmap v6435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:46 smithi078 ceph-mon[94114]: pgmap v6436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:48 smithi078 ceph-mon[94114]: pgmap v6437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:50 smithi078 ceph-mon[94114]: pgmap v6438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:52 smithi078 ceph-mon[94114]: pgmap v6439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:54 smithi078 ceph-mon[94114]: pgmap v6440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:56 smithi078 ceph-mon[94114]: pgmap v6441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:00:58 smithi078 ceph-mon[94114]: pgmap v6442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:00 smithi078 ceph-mon[94114]: pgmap v6443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:02 smithi078 ceph-mon[94114]: pgmap v6444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:17.631 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:04 smithi078 ceph-mon[94114]: pgmap v6445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:06 smithi078 ceph-mon[94114]: pgmap v6446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:08 smithi078 ceph-mon[94114]: pgmap v6447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:10 smithi078 ceph-mon[94114]: pgmap v6448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:10 smithi078 ceph-mon[94114]: osdmap e470: 12 total, 12 up, 12 in 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:12 smithi078 ceph-mon[94114]: pgmap v6450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:14 smithi078 ceph-mon[94114]: pgmap v6451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:16 smithi078 ceph-mon[94114]: pgmap v6452: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:18 smithi078 ceph-mon[94114]: pgmap v6453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:18 smithi078 ceph-mon[94114]: osdmap e471: 12 total, 12 up, 12 in 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:20 smithi078 ceph-mon[94114]: pgmap v6455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 215 B/s wr, 10 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:21 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:22 smithi078 ceph-mon[94114]: pgmap v6456: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:22 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: pgmap v6457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:24 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.633 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:17.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:17.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:17.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:17.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:43:17.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:43:17.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: pgmap v6458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 103 B/s wr, 10 op/s 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:26 smithi078 ceph-mon[94114]: pgmap v6459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 129 B/s wr, 12 op/s 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:27 smithi078 ceph-mon[94114]: pgmap v6460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:30 smithi078 ceph-mon[94114]: pgmap v6461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:43:18.575 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:32 smithi078 ceph-mon[94114]: pgmap v6462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:34 smithi078 ceph-mon[94114]: pgmap v6463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:36 smithi078 ceph-mon[94114]: pgmap v6464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:38 smithi078 ceph-mon[94114]: pgmap v6465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:40 smithi078 ceph-mon[94114]: pgmap v6466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:42 smithi078 ceph-mon[94114]: pgmap v6467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:44 smithi078 ceph-mon[94114]: pgmap v6468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:46 smithi078 ceph-mon[94114]: pgmap v6469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:48 smithi078 ceph-mon[94114]: pgmap v6470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:50 smithi078 ceph-mon[94114]: pgmap v6471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:52 smithi078 ceph-mon[94114]: pgmap v6472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:54 smithi078 ceph-mon[94114]: pgmap v6473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:18.576 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:56 smithi078 ceph-mon[94114]: pgmap v6474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:19.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:01:58 smithi078 ceph-mon[94114]: pgmap v6475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:19.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:00 smithi078 ceph-mon[94114]: pgmap v6476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:19.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:02 smithi078 ceph-mon[94114]: pgmap v6477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:21.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:04 smithi078 ceph-mon[94114]: pgmap v6478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:21.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:06 smithi078 ceph-mon[94114]: pgmap v6479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:21.262 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:08 smithi078 ceph-mon[94114]: pgmap v6480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:21.263 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:10 smithi078 ceph-mon[94114]: pgmap v6481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:21.263 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:10 smithi078 ceph-mon[94114]: osdmap e472: 12 total, 12 up, 12 in 2023-03-17T12:43:21.263 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:12 smithi078 ceph-mon[94114]: pgmap v6483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:23.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:14 smithi078 ceph-mon[94114]: pgmap v6484: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:23.079 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:16 smithi078 ceph-mon[94114]: pgmap v6485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:23.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:18 smithi078 ceph-mon[94114]: pgmap v6486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:23.604 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:18 smithi078 ceph-mon[94114]: osdmap e473: 12 total, 12 up, 12 in 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:20 smithi078 ceph-mon[94114]: pgmap v6488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 214 B/s wr, 10 op/s 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:22 smithi078 ceph-mon[94114]: pgmap v6489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:24 smithi078 ceph-mon[94114]: pgmap v6490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:25 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:26 smithi078 ceph-mon[94114]: pgmap v6491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:23.605 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:27 smithi078 ceph-mon[94114]: pgmap v6492: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:27 smithi078 ceph-mon[94114]: pgmap v6493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:29 smithi078 ceph-mon[94114]: pgmap v6494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:31 smithi078 ceph-mon[94114]: pgmap v6495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:33 smithi078 ceph-mon[94114]: pgmap v6496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:35 smithi078 ceph-mon[94114]: pgmap v6497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:23.606 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:37 smithi078 ceph-mon[94114]: pgmap v6498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:39 smithi078 ceph-mon[94114]: pgmap v6499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:41 smithi078 ceph-mon[94114]: pgmap v6500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:43 smithi078 ceph-mon[94114]: pgmap v6501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:45 smithi078 ceph-mon[94114]: pgmap v6502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:47 smithi078 ceph-mon[94114]: pgmap v6503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:49 smithi078 ceph-mon[94114]: pgmap v6504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:51 smithi078 ceph-mon[94114]: pgmap v6505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:53 smithi078 ceph-mon[94114]: pgmap v6506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:55 smithi078 ceph-mon[94114]: pgmap v6507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:57 smithi078 ceph-mon[94114]: pgmap v6508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:02:59 smithi078 ceph-mon[94114]: pgmap v6509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:01 smithi078 ceph-mon[94114]: pgmap v6510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:03 smithi078 ceph-mon[94114]: pgmap v6511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:05 smithi078 ceph-mon[94114]: pgmap v6512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:07 smithi078 ceph-mon[94114]: pgmap v6513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:23.607 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:09 smithi078 ceph-mon[94114]: pgmap v6514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:25.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:10 smithi078 ceph-mon[94114]: osdmap e474: 12 total, 12 up, 12 in 2023-03-17T12:43:25.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:11 smithi078 ceph-mon[94114]: pgmap v6516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:13 smithi078 ceph-mon[94114]: pgmap v6517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:15 smithi078 ceph-mon[94114]: pgmap v6518: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:17 smithi078 ceph-mon[94114]: pgmap v6519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:19 smithi078 ceph-mon[94114]: pgmap v6520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:19 smithi078 ceph-mon[94114]: osdmap e475: 12 total, 12 up, 12 in 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:21 smithi078 ceph-mon[94114]: pgmap v6522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:23 smithi078 ceph-mon[94114]: pgmap v6523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:25 smithi078 ceph-mon[94114]: pgmap v6524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:26 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:27 smithi078 ceph-mon[94114]: pgmap v6525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:28 smithi078 ceph-mon[94114]: pgmap v6526: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-03-17T12:43:25.647 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:28 smithi078 ceph-mon[94114]: pgmap v6527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:30 smithi078 ceph-mon[94114]: pgmap v6528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:32 smithi078 ceph-mon[94114]: pgmap v6529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:34 smithi078 ceph-mon[94114]: pgmap v6530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:35 smithi078 ceph-mon[94114]: from='client.? 172.21.15.35:0/1170454406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:36 smithi078 ceph-mon[94114]: pgmap v6531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:38 smithi078 ceph-mon[94114]: pgmap v6532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:40 smithi078 ceph-mon[94114]: pgmap v6533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:42 smithi078 ceph-mon[94114]: pgmap v6534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:44 smithi078 ceph-mon[94114]: pgmap v6535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:46 smithi078 ceph-mon[94114]: pgmap v6536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:48 smithi078 ceph-mon[94114]: pgmap v6537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:50 smithi078 ceph-mon[94114]: pgmap v6538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:52 smithi078 ceph-mon[94114]: pgmap v6539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:54 smithi078 ceph-mon[94114]: pgmap v6540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:56 smithi078 ceph-mon[94114]: pgmap v6541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:25.648 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:03:58 smithi078 ceph-mon[94114]: pgmap v6542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:00 smithi078 ceph-mon[94114]: pgmap v6543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:02 smithi078 ceph-mon[94114]: pgmap v6544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:04 smithi078 ceph-mon[94114]: pgmap v6545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:06 smithi078 ceph-mon[94114]: pgmap v6546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:08 smithi078 ceph-mon[94114]: pgmap v6547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:10 smithi078 ceph-mon[94114]: pgmap v6548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:10 smithi078 ceph-mon[94114]: osdmap e476: 12 total, 12 up, 12 in 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:12 smithi078 ceph-mon[94114]: pgmap v6550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:14 smithi078 ceph-mon[94114]: pgmap v6551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:16 smithi078 ceph-mon[94114]: pgmap v6552: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:18 smithi078 ceph-mon[94114]: pgmap v6553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:26.719 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:18 smithi078 ceph-mon[94114]: osdmap e477: 12 total, 12 up, 12 in 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:20 smithi078 ceph-mon[94114]: pgmap v6555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 212 B/s wr, 10 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:22 smithi078 ceph-mon[94114]: pgmap v6556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:24 smithi078 ceph-mon[94114]: pgmap v6557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:26 smithi078 ceph-mon[94114]: pgmap v6558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:27 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:28 smithi078 ceph-mon[94114]: pgmap v6559: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:29 smithi078 ceph-mon[94114]: pgmap v6560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:29 smithi078 ceph-mon[94114]: pgmap v6561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:31 smithi078 ceph-mon[94114]: pgmap v6562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:33 smithi078 ceph-mon[94114]: pgmap v6563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:26.720 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:35 smithi078 ceph-mon[94114]: pgmap v6564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:28.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:37 smithi078 ceph-mon[94114]: pgmap v6565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:28.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:39 smithi078 ceph-mon[94114]: pgmap v6566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:28.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:41 smithi078 ceph-mon[94114]: pgmap v6567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:28.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:43 smithi078 ceph-mon[94114]: pgmap v6568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:28.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:45 smithi078 ceph-mon[94114]: pgmap v6569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:28.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:47 smithi078 ceph-mon[94114]: pgmap v6570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:28.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:49 smithi078 ceph-mon[94114]: pgmap v6571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:28.582 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:51 smithi078 ceph-mon[94114]: pgmap v6572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:28.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:53 smithi078 ceph-mon[94114]: pgmap v6573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:31.007 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:55 smithi078 ceph-mon[94114]: pgmap v6574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:31.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:57 smithi078 ceph-mon[94114]: pgmap v6575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:31.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:04:59 smithi078 ceph-mon[94114]: pgmap v6576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:31.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:01 smithi078 ceph-mon[94114]: pgmap v6577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:31.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:03 smithi078 ceph-mon[94114]: pgmap v6578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:31.008 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:05 smithi078 ceph-mon[94114]: pgmap v6579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:31.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:07 smithi078 ceph-mon[94114]: pgmap v6580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:31.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:09 smithi078 ceph-mon[94114]: pgmap v6581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2023-03-17T12:43:31.009 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:10 smithi078 ceph-mon[94114]: osdmap e478: 12 total, 12 up, 12 in 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:11 smithi078 ceph-mon[94114]: pgmap v6583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:13 smithi078 ceph-mon[94114]: pgmap v6584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:14 smithi078 ceph-mon[94114]: pgmap v6585: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:16 smithi078 ceph-mon[94114]: pgmap v6586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:19 smithi078 ceph-mon[94114]: pgmap v6587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:19 smithi078 ceph-mon[94114]: osdmap e479: 12 total, 12 up, 12 in 2023-03-17T12:43:31.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:21 smithi078 ceph-mon[94114]: pgmap v6589: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:33.115 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:23 smithi078 ceph-mon[94114]: pgmap v6590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:33.115 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:24 smithi078 ceph-mon[94114]: from='client.22611 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T12:43:33.115 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:25 smithi078 ceph-mon[94114]: pgmap v6591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:33.116 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:27 smithi078 ceph-mon[94114]: pgmap v6592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:33.116 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:28 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:34.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:29 smithi078 ceph-mon[94114]: pgmap v6593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 0 B/s wr, 11 op/s 2023-03-17T12:43:36.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:36.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:36.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:36.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:30 smithi078 ceph-mon[94114]: pgmap v6594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2023-03-17T12:43:36.557 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:30 smithi078 ceph-mon[94114]: pgmap v6595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:43:37.750 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:32 smithi078 ceph-mon[94114]: pgmap v6596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:43:40.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:34 smithi078 ceph-mon[94114]: pgmap v6597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:43:40.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:36 smithi078 ceph-mon[94114]: pgmap v6598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:43:40.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:38 smithi078 ceph-mon[94114]: pgmap v6599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:40.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:40 smithi078 ceph-mon[94114]: pgmap v6600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:40.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:42 smithi078 ceph-mon[94114]: pgmap v6601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:40.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:44 smithi078 ceph-mon[94114]: pgmap v6602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:46 smithi078 ceph-mon[94114]: pgmap v6603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:48 smithi078 ceph-mon[94114]: pgmap v6604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:50 smithi078 ceph-mon[94114]: pgmap v6605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:52 smithi078 ceph-mon[94114]: pgmap v6606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:54 smithi078 ceph-mon[94114]: pgmap v6607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:56 smithi078 ceph-mon[94114]: pgmap v6608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:57 smithi078 ceph-mon[94114]: from='client.22635 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:05:58 smithi078 ceph-mon[94114]: pgmap v6609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:41.573 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:00 smithi078 ceph-mon[94114]: pgmap v6610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 0 B/s wr, 13 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:02 smithi078 ceph-mon[94114]: pgmap v6611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:04 smithi078 ceph-mon[94114]: pgmap v6612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:06 smithi078 ceph-mon[94114]: pgmap v6613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:08 smithi078 ceph-mon[94114]: pgmap v6614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:10 smithi078 ceph-mon[94114]: pgmap v6615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 28 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:10 smithi078 ceph-mon[94114]: osdmap e480: 12 total, 12 up, 12 in 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:12 smithi078 ceph-mon[94114]: pgmap v6617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:14 smithi078 ceph-mon[94114]: pgmap v6618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:41.574 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:16 smithi078 ceph-mon[94114]: pgmap v6619: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:42.614 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:18 smithi078 ceph-mon[94114]: pgmap v6620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:18 smithi078 ceph-mon[94114]: osdmap e481: 12 total, 12 up, 12 in 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:20 smithi078 ceph-mon[94114]: pgmap v6622: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 221 B/s wr, 11 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:22 smithi078 ceph-mon[94114]: pgmap v6623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:24 smithi078 ceph-mon[94114]: pgmap v6624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:26 smithi078 ceph-mon[94114]: pgmap v6625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:28 smithi078 ceph-mon[94114]: pgmap v6626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:29 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:30 smithi078 ceph-mon[94114]: pgmap v6627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:30 smithi078 ceph-mon[94114]: pgmap v6628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:30 smithi078 ceph-mon[94114]: pgmap v6629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:31 smithi078 ceph-mon[94114]: pgmap v6630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:42.615 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:34 smithi078 ceph-mon[94114]: pgmap v6631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:43.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:35 smithi078 ceph-mon[94114]: pgmap v6632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:43.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:37 smithi078 ceph-mon[94114]: pgmap v6633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-03-17T12:43:43.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:39 smithi078 ceph-mon[94114]: pgmap v6634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:43:43.938 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:41 smithi078 ceph-mon[94114]: pgmap v6635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:43:45.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:44 smithi078 ceph-mon[94114]: pgmap v6636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:45.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:45 smithi078 ceph-mon[94114]: pgmap v6637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:43:45.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:47 smithi078 ceph-mon[94114]: pgmap v6638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:45.046 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:49 smithi078 ceph-mon[94114]: pgmap v6639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:45.949 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:51 smithi078 ceph-mon[94114]: pgmap v6640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:46.332 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:54 smithi078 ceph-mon[94114]: pgmap v6641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:46.332 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:55 smithi078 ceph-mon[94114]: pgmap v6642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:46.333 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:57 smithi078 ceph-mon[94114]: pgmap v6643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:47.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:06:59 smithi078 ceph-mon[94114]: pgmap v6644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:47.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:01 smithi078 ceph-mon[94114]: pgmap v6645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:47.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:04 smithi078 ceph-mon[94114]: pgmap v6646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:47.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:05 smithi078 ceph-mon[94114]: pgmap v6647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:47.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:07 smithi078 ceph-mon[94114]: pgmap v6648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:47.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:10 smithi078 ceph-mon[94114]: osdmap e482: 12 total, 12 up, 12 in 2023-03-17T12:43:47.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:10 smithi078 ceph-mon[94114]: pgmap v6650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:47.611 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:11 smithi078 ceph-mon[94114]: pgmap v6651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:48.389 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:14 smithi078 ceph-mon[94114]: pgmap v6652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:48.389 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:15 smithi078 ceph-mon[94114]: pgmap v6653: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:17 smithi078 ceph-mon[94114]: pgmap v6654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:19 smithi078 ceph-mon[94114]: osdmap e483: 12 total, 12 up, 12 in 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:20 smithi078 ceph-mon[94114]: pgmap v6656: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:21 smithi078 ceph-mon[94114]: pgmap v6657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:24 smithi078 ceph-mon[94114]: pgmap v6658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:25 smithi078 ceph-mon[94114]: pgmap v6659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:27 smithi078 ceph-mon[94114]: pgmap v6660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:48.390 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:29 smithi078 ceph-mon[94114]: pgmap v6661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:43:49.016 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:49.016 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:49.016 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:49.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:30 smithi078 ceph-mon[94114]: pgmap v6662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:43:49.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:30 smithi078 ceph-mon[94114]: pgmap v6663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:49.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:30 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:49.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:33 smithi078 ceph-mon[94114]: pgmap v6664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:49.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:35 smithi078 ceph-mon[94114]: pgmap v6665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:50.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:37 smithi078 ceph-mon[94114]: pgmap v6666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:50.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:39 smithi078 ceph-mon[94114]: pgmap v6667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:50.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:41 smithi078 ceph-mon[94114]: pgmap v6668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:50.063 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:43 smithi078 ceph-mon[94114]: pgmap v6669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:45 smithi078 ceph-mon[94114]: pgmap v6670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:47 smithi078 ceph-mon[94114]: pgmap v6671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:49 smithi078 ceph-mon[94114]: pgmap v6672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:51 smithi078 ceph-mon[94114]: pgmap v6673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:53 smithi078 ceph-mon[94114]: pgmap v6674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:55 smithi078 ceph-mon[94114]: pgmap v6675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:57 smithi078 ceph-mon[94114]: pgmap v6676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.064 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:07:59 smithi078 ceph-mon[94114]: pgmap v6677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:01 smithi078 ceph-mon[94114]: pgmap v6678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:03 smithi078 ceph-mon[94114]: pgmap v6679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:05 smithi078 ceph-mon[94114]: pgmap v6680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:07 smithi078 ceph-mon[94114]: pgmap v6681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:09 smithi078 ceph-mon[94114]: pgmap v6682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:10 smithi078 ceph-mon[94114]: osdmap e484: 12 total, 12 up, 12 in 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:11 smithi078 ceph-mon[94114]: pgmap v6684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:50.065 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:13 smithi078 ceph-mon[94114]: pgmap v6685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:50.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:13 smithi078 ceph-mon[94114]: osdmap e485: 12 total, 12 up, 12 in 2023-03-17T12:43:50.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:15 smithi078 ceph-mon[94114]: pgmap v6687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:43:50.066 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:17 smithi078 ceph-mon[94114]: pgmap v6688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:43:50.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:19 smithi078 ceph-mon[94114]: pgmap v6689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 227 B/s wr, 11 op/s 2023-03-17T12:43:50.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:21 smithi078 ceph-mon[94114]: pgmap v6690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:50.791 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:23 smithi078 ceph-mon[94114]: pgmap v6691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:25 smithi078 ceph-mon[94114]: pgmap v6692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:27 smithi078 ceph-mon[94114]: pgmap v6693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:29 smithi078 ceph-mon[94114]: pgmap v6694: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:31 smithi078 ceph-mon[94114]: pgmap v6695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:32 smithi078 ceph-mon[94114]: pgmap v6696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:32 smithi078 ceph-mon[94114]: pgmap v6697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:34 smithi078 ceph-mon[94114]: pgmap v6698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:36 smithi078 ceph-mon[94114]: pgmap v6699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:38 smithi078 ceph-mon[94114]: pgmap v6700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:40 smithi078 ceph-mon[94114]: pgmap v6701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:42 smithi078 ceph-mon[94114]: pgmap v6702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:50.792 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:44 smithi078 ceph-mon[94114]: pgmap v6703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:46 smithi078 ceph-mon[94114]: pgmap v6704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:48 smithi078 ceph-mon[94114]: pgmap v6705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:50 smithi078 ceph-mon[94114]: pgmap v6706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:52 smithi078 ceph-mon[94114]: pgmap v6707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:54 smithi078 ceph-mon[94114]: pgmap v6708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:56 smithi078 ceph-mon[94114]: pgmap v6709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:08:58 smithi078 ceph-mon[94114]: pgmap v6710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:00 smithi078 ceph-mon[94114]: pgmap v6711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:02 smithi078 ceph-mon[94114]: pgmap v6712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:04 smithi078 ceph-mon[94114]: pgmap v6713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:06 smithi078 ceph-mon[94114]: pgmap v6714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:08 smithi078 ceph-mon[94114]: pgmap v6715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:10 smithi078 ceph-mon[94114]: pgmap v6716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:10 smithi078 ceph-mon[94114]: osdmap e486: 12 total, 12 up, 12 in 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:12 smithi078 ceph-mon[94114]: pgmap v6718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:50.793 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:14 smithi078 ceph-mon[94114]: pgmap v6719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:51.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:16 smithi078 ceph-mon[94114]: pgmap v6720: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:51.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:18 smithi078 ceph-mon[94114]: pgmap v6721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:51.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:18 smithi078 ceph-mon[94114]: osdmap e487: 12 total, 12 up, 12 in 2023-03-17T12:43:51.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:20 smithi078 ceph-mon[94114]: pgmap v6723: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:43:51.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:22 smithi078 ceph-mon[94114]: pgmap v6724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:51.513 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:24 smithi078 ceph-mon[94114]: pgmap v6725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:51.513 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:26 smithi078 ceph-mon[94114]: pgmap v6726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:51.513 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:28 smithi078 ceph-mon[94114]: pgmap v6727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:30 smithi078 ceph-mon[94114]: pgmap v6728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:31 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:32 smithi078 ceph-mon[94114]: pgmap v6729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:33 smithi078 ceph-mon[94114]: pgmap v6730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:33 smithi078 ceph-mon[94114]: pgmap v6731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:35 smithi078 ceph-mon[94114]: pgmap v6732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:37 smithi078 ceph-mon[94114]: pgmap v6733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:39 smithi078 ceph-mon[94114]: pgmap v6734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:41 smithi078 ceph-mon[94114]: pgmap v6735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:43 smithi078 ceph-mon[94114]: pgmap v6736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:45 smithi078 ceph-mon[94114]: pgmap v6737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:51.935 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:47 smithi078 ceph-mon[94114]: pgmap v6738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:51.936 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:49 smithi078 ceph-mon[94114]: pgmap v6739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:52.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:51 smithi078 ceph-mon[94114]: pgmap v6740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:52.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:53 smithi078 ceph-mon[94114]: pgmap v6741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:52.351 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:55 smithi078 ceph-mon[94114]: pgmap v6742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:53.097 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:57 smithi078 ceph-mon[94114]: pgmap v6743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:09:59 smithi078 ceph-mon[94114]: pgmap v6744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:01 smithi078 ceph-mon[94114]: pgmap v6745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:03 smithi078 ceph-mon[94114]: pgmap v6746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:05 smithi078 ceph-mon[94114]: pgmap v6747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:07 smithi078 ceph-mon[94114]: pgmap v6748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:53.098 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:09 smithi078 ceph-mon[94114]: pgmap v6749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:53.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:10 smithi078 ceph-mon[94114]: osdmap e488: 12 total, 12 up, 12 in 2023-03-17T12:43:53.099 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:11 smithi078 ceph-mon[94114]: pgmap v6751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:53.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:12 smithi078 ceph-mon[94114]: pgmap v6752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:53.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:15 smithi078 ceph-mon[94114]: pgmap v6753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:53.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:17 smithi078 ceph-mon[94114]: pgmap v6754: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:53.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:19 smithi078 ceph-mon[94114]: pgmap v6755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:53.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:19 smithi078 ceph-mon[94114]: osdmap e489: 12 total, 12 up, 12 in 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:21 smithi078 ceph-mon[94114]: pgmap v6757: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:23 smithi078 ceph-mon[94114]: pgmap v6758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:25 smithi078 ceph-mon[94114]: pgmap v6759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:27 smithi078 ceph-mon[94114]: pgmap v6760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:29 smithi078 ceph-mon[94114]: pgmap v6761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:31 smithi078 ceph-mon[94114]: pgmap v6762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:43:55.259 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:32 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:33 smithi078 ceph-mon[94114]: pgmap v6763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:34 smithi078 ceph-mon[94114]: pgmap v6764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 13 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:34 smithi078 ceph-mon[94114]: pgmap v6765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:36 smithi078 ceph-mon[94114]: pgmap v6766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:38 smithi078 ceph-mon[94114]: pgmap v6767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:40 smithi078 ceph-mon[94114]: pgmap v6768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:42 smithi078 ceph-mon[94114]: pgmap v6769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:44 smithi078 ceph-mon[94114]: pgmap v6770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:46 smithi078 ceph-mon[94114]: pgmap v6771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:55.260 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:48 smithi078 ceph-mon[94114]: pgmap v6772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:55.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:50 smithi078 ceph-mon[94114]: pgmap v6773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:55.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:52 smithi078 ceph-mon[94114]: pgmap v6774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:55.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:54 smithi078 ceph-mon[94114]: pgmap v6775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:56 smithi078 ceph-mon[94114]: pgmap v6776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:10:58 smithi078 ceph-mon[94114]: pgmap v6777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:00 smithi078 ceph-mon[94114]: pgmap v6778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:02 smithi078 ceph-mon[94114]: pgmap v6779: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:04 smithi078 ceph-mon[94114]: pgmap v6780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:06 smithi078 ceph-mon[94114]: pgmap v6781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:08 smithi078 ceph-mon[94114]: pgmap v6782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:10 smithi078 ceph-mon[94114]: pgmap v6783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:10 smithi078 ceph-mon[94114]: osdmap e490: 12 total, 12 up, 12 in 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:12 smithi078 ceph-mon[94114]: pgmap v6785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:14 smithi078 ceph-mon[94114]: pgmap v6786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:16 smithi078 ceph-mon[94114]: pgmap v6787: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:55.977 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:18 smithi078 ceph-mon[94114]: pgmap v6788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:18 smithi078 ceph-mon[94114]: osdmap e491: 12 total, 12 up, 12 in 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:20 smithi078 ceph-mon[94114]: pgmap v6790: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 210 B/s wr, 10 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:22 smithi078 ceph-mon[94114]: pgmap v6791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:24 smithi078 ceph-mon[94114]: pgmap v6792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:26 smithi078 ceph-mon[94114]: pgmap v6793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:28 smithi078 ceph-mon[94114]: pgmap v6794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:30 smithi078 ceph-mon[94114]: pgmap v6795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:32 smithi078 ceph-mon[94114]: pgmap v6796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:33 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:34 smithi078 ceph-mon[94114]: pgmap v6797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:34 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:36 smithi078 ceph-mon[94114]: pgmap v6798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:55.978 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:57.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:57.562 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:36 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:58.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:58.602 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:43:58.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:58.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:58.603 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.892 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:43:59.893 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:44:01.961 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:44:01.962 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: pgmap v6799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s 2023-03-17T12:44:01.962 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:38 smithi078 ceph-mon[94114]: pgmap v6800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:03.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:40 smithi078 ceph-mon[94114]: pgmap v6801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:07.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:42 smithi078 ceph-mon[94114]: pgmap v6802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:07.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:44 smithi078 ceph-mon[94114]: pgmap v6803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:07.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:46 smithi078 ceph-mon[94114]: pgmap v6804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:07.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:48 smithi078 ceph-mon[94114]: pgmap v6805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:07.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:50 smithi078 ceph-mon[94114]: pgmap v6806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:44:07.271 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:52 smithi078 ceph-mon[94114]: pgmap v6807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:07.272 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:54 smithi078 ceph-mon[94114]: pgmap v6808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:08.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:56 smithi078 ceph-mon[94114]: pgmap v6809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:08.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:58 smithi078 ceph-mon[94114]: pgmap v6810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:44:08.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:11:59 smithi078 ceph-mon[94114]: pgmap v6811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:44:08.438 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:02 smithi078 ceph-mon[94114]: pgmap v6812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:04 smithi078 ceph-mon[94114]: pgmap v6813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:06 smithi078 ceph-mon[94114]: pgmap v6814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:08 smithi078 ceph-mon[94114]: pgmap v6815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:10 smithi078 ceph-mon[94114]: pgmap v6816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:10 smithi078 ceph-mon[94114]: osdmap e492: 12 total, 12 up, 12 in 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:12 smithi078 ceph-mon[94114]: pgmap v6818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:14 smithi078 ceph-mon[94114]: pgmap v6819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:16 smithi078 ceph-mon[94114]: pgmap v6820: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:18 smithi078 ceph-mon[94114]: pgmap v6821: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:18 smithi078 ceph-mon[94114]: osdmap e493: 12 total, 12 up, 12 in 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:20 smithi078 ceph-mon[94114]: pgmap v6823: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:22 smithi078 ceph-mon[94114]: pgmap v6824: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:09.394 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:24 smithi078 ceph-mon[94114]: pgmap v6825: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:26 smithi078 ceph-mon[94114]: pgmap v6826: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:28 smithi078 ceph-mon[94114]: pgmap v6827: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:30 smithi078 ceph-mon[94114]: pgmap v6828: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:32 smithi078 ceph-mon[94114]: pgmap v6829: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:34 smithi078 ceph-mon[94114]: pgmap v6830: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:36 smithi078 ceph-mon[94114]: pgmap v6831: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:37 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:38 smithi078 ceph-mon[94114]: pgmap v6832: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:40 smithi078 ceph-mon[94114]: pgmap v6833: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:09.395 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: pgmap v6834: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: pgmap v6835: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:44 smithi078 ceph-mon[94114]: pgmap v6836: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:46 smithi078 ceph-mon[94114]: pgmap v6837: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:48 smithi078 ceph-mon[94114]: pgmap v6838: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:50 smithi078 ceph-mon[94114]: pgmap v6839: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:52 smithi078 ceph-mon[94114]: pgmap v6840: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:54 smithi078 ceph-mon[94114]: pgmap v6841: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:56 smithi078 ceph-mon[94114]: pgmap v6842: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:12:58 smithi078 ceph-mon[94114]: pgmap v6843: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:09.396 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:00 smithi078 ceph-mon[94114]: pgmap v6844: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:11.104 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:02 smithi078 ceph-mon[94114]: pgmap v6845: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:11.481 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:04 smithi078 ceph-mon[94114]: pgmap v6846: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:13.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:06 smithi078 ceph-mon[94114]: pgmap v6847: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:13.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:08 smithi078 ceph-mon[94114]: pgmap v6848: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:13.600 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:10 smithi078 ceph-mon[94114]: pgmap v6849: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:15.150 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:10 smithi078 ceph-mon[94114]: osdmap e494: 12 total, 12 up, 12 in 2023-03-17T12:44:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:12 smithi078 ceph-mon[94114]: pgmap v6851: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:14 smithi078 ceph-mon[94114]: pgmap v6852: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:15.151 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:16 smithi078 ceph-mon[94114]: pgmap v6853: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:18 smithi078 ceph-mon[94114]: pgmap v6854: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:18 smithi078 ceph-mon[94114]: osdmap e495: 12 total, 12 up, 12 in 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:20 smithi078 ceph-mon[94114]: pgmap v6856: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 217 B/s wr, 11 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:22 smithi078 ceph-mon[94114]: pgmap v6857: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:24 smithi078 ceph-mon[94114]: pgmap v6858: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:26 smithi078 ceph-mon[94114]: pgmap v6859: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:28 smithi078 ceph-mon[94114]: pgmap v6860: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:30 smithi078 ceph-mon[94114]: pgmap v6861: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:44:15.658 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:32 smithi078 ceph-mon[94114]: pgmap v6862: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:15.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:34 smithi078 ceph-mon[94114]: pgmap v6863: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:15.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:36 smithi078 ceph-mon[94114]: pgmap v6864: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:15.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:38 smithi078 ceph-mon[94114]: pgmap v6865: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:15.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:40 smithi078 ceph-mon[94114]: pgmap v6866: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:15.659 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:17.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:17.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:41 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:17.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:42 smithi078 ceph-mon[94114]: pgmap v6867: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:17.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:44 smithi078 ceph-mon[94114]: pgmap v6868: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:17.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:17.428 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: pgmap v6869: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: pgmap v6870: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:47 smithi078 ceph-mon[94114]: pgmap v6871: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:50 smithi078 ceph-mon[94114]: pgmap v6872: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:17.429 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:52 smithi078 ceph-mon[94114]: pgmap v6873: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:17.430 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:54 smithi078 ceph-mon[94114]: pgmap v6874: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2023-03-17T12:44:19.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:56 smithi078 ceph-mon[94114]: pgmap v6875: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:19.983 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:13:58 smithi078 ceph-mon[94114]: pgmap v6876: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:20.386 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:00 smithi078 ceph-mon[94114]: pgmap v6877: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:21.184 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:02 smithi078 ceph-mon[94114]: pgmap v6878: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:21.184 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:04 smithi078 ceph-mon[94114]: pgmap v6879: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:21.184 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:06 smithi078 ceph-mon[94114]: pgmap v6880: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:08 smithi078 ceph-mon[94114]: pgmap v6881: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:10 smithi078 ceph-mon[94114]: pgmap v6882: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:10 smithi078 ceph-mon[94114]: osdmap e496: 12 total, 12 up, 12 in 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:12 smithi078 ceph-mon[94114]: pgmap v6884: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:14 smithi078 ceph-mon[94114]: pgmap v6885: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:16 smithi078 ceph-mon[94114]: pgmap v6886: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:18 smithi078 ceph-mon[94114]: pgmap v6887: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:21.185 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:18 smithi078 ceph-mon[94114]: osdmap e497: 12 total, 12 up, 12 in 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:20 smithi078 ceph-mon[94114]: pgmap v6889: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:22 smithi078 ceph-mon[94114]: pgmap v6890: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:24 smithi078 ceph-mon[94114]: pgmap v6891: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:26 smithi078 ceph-mon[94114]: pgmap v6892: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:28 smithi078 ceph-mon[94114]: pgmap v6893: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:30 smithi078 ceph-mon[94114]: pgmap v6894: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:32 smithi078 ceph-mon[94114]: pgmap v6895: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:21.186 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:34 smithi078 ceph-mon[94114]: pgmap v6896: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:21.427 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:36 smithi078 ceph-mon[94114]: pgmap v6897: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:38 smithi078 ceph-mon[94114]: pgmap v6898: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:40 smithi078 ceph-mon[94114]: pgmap v6899: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:42 smithi078 ceph-mon[94114]: pgmap v6900: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:44 smithi078 ceph-mon[94114]: pgmap v6901: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:45 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:46 smithi078 ceph-mon[94114]: pgmap v6902: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:48 smithi078 ceph-mon[94114]: pgmap v6903: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:22.283 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: pgmap v6904: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: pgmap v6905: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:51 smithi078 ceph-mon[94114]: pgmap v6906: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:54 smithi078 ceph-mon[94114]: pgmap v6907: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:56 smithi078 ceph-mon[94114]: pgmap v6908: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:14:58 smithi078 ceph-mon[94114]: pgmap v6909: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:00 smithi078 ceph-mon[94114]: pgmap v6910: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:02 smithi078 ceph-mon[94114]: pgmap v6911: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:04 smithi078 ceph-mon[94114]: pgmap v6912: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:06 smithi078 ceph-mon[94114]: pgmap v6913: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:08 smithi078 ceph-mon[94114]: pgmap v6914: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:22.284 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:10 smithi078 ceph-mon[94114]: pgmap v6915: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:23.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:10 smithi078 ceph-mon[94114]: osdmap e498: 12 total, 12 up, 12 in 2023-03-17T12:44:23.410 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:12 smithi078 ceph-mon[94114]: pgmap v6917: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:14 smithi078 ceph-mon[94114]: pgmap v6918: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:16 smithi078 ceph-mon[94114]: pgmap v6919: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:18 smithi078 ceph-mon[94114]: pgmap v6920: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:18 smithi078 ceph-mon[94114]: osdmap e499: 12 total, 12 up, 12 in 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:20 smithi078 ceph-mon[94114]: pgmap v6922: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:22 smithi078 ceph-mon[94114]: pgmap v6923: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:24.169 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:24 smithi078 ceph-mon[94114]: pgmap v6924: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:26 smithi078 ceph-mon[94114]: pgmap v6925: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:28 smithi078 ceph-mon[94114]: pgmap v6926: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:30 smithi078 ceph-mon[94114]: pgmap v6927: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:32 smithi078 ceph-mon[94114]: pgmap v6928: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:34 smithi078 ceph-mon[94114]: pgmap v6929: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:36 smithi078 ceph-mon[94114]: pgmap v6930: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:38 smithi078 ceph-mon[94114]: pgmap v6931: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:40 smithi078 ceph-mon[94114]: pgmap v6932: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:42 smithi078 ceph-mon[94114]: pgmap v6933: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:44 smithi078 ceph-mon[94114]: pgmap v6934: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:46 smithi078 ceph-mon[94114]: pgmap v6935: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:48 smithi078 ceph-mon[94114]: pgmap v6936: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:44:24.170 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:49 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:24.171 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:50 smithi078 ceph-mon[94114]: pgmap v6937: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:25.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:25.583 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:51 smithi078 ceph-mon[94114]: pgmap v6938: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:51 smithi078 ceph-mon[94114]: pgmap v6939: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:53 smithi078 ceph-mon[94114]: pgmap v6940: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:55 smithi078 ceph-mon[94114]: pgmap v6941: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:57 smithi078 ceph-mon[94114]: pgmap v6942: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:15:59 smithi078 ceph-mon[94114]: pgmap v6943: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:01 smithi078 ceph-mon[94114]: pgmap v6944: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:25.584 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:03 smithi078 ceph-mon[94114]: pgmap v6945: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:05 smithi078 ceph-mon[94114]: pgmap v6946: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:07 smithi078 ceph-mon[94114]: pgmap v6947: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:09 smithi078 ceph-mon[94114]: pgmap v6948: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:10 smithi078 ceph-mon[94114]: osdmap e500: 12 total, 12 up, 12 in 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:11 smithi078 ceph-mon[94114]: pgmap v6950: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:12 smithi078 ceph-mon[94114]: pgmap v6951: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:15 smithi078 ceph-mon[94114]: pgmap v6952: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:25.585 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:17 smithi078 ceph-mon[94114]: pgmap v6953: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:25.586 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:19 smithi078 ceph-mon[94114]: pgmap v6954: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:25.586 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:19 smithi078 ceph-mon[94114]: osdmap e501: 12 total, 12 up, 12 in 2023-03-17T12:44:25.586 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:21 smithi078 ceph-mon[94114]: pgmap v6956: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:25.586 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:23 smithi078 ceph-mon[94114]: pgmap v6957: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:25.586 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:25 smithi078 ceph-mon[94114]: pgmap v6958: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:25.994 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:27 smithi078 ceph-mon[94114]: pgmap v6959: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:27.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:29 smithi078 ceph-mon[94114]: pgmap v6960: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:27.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:31 smithi078 ceph-mon[94114]: pgmap v6961: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:44:27.310 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:33 smithi078 ceph-mon[94114]: pgmap v6962: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:28.030 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:35 smithi078 ceph-mon[94114]: pgmap v6963: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:28.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:37 smithi078 ceph-mon[94114]: pgmap v6964: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:28.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:39 smithi078 ceph-mon[94114]: pgmap v6965: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:28.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:41 smithi078 ceph-mon[94114]: pgmap v6966: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:28.031 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:43 smithi078 ceph-mon[94114]: pgmap v6967: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:45 smithi078 ceph-mon[94114]: pgmap v6968: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:47 smithi078 ceph-mon[94114]: pgmap v6969: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:49 smithi078 ceph-mon[94114]: pgmap v6970: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:50 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:28.729 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:51 smithi078 ceph-mon[94114]: pgmap v6971: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:51 smithi078 ceph-mon[94114]: pgmap v6972: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:51 smithi078 ceph-mon[94114]: pgmap v6973: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:53 smithi078 ceph-mon[94114]: pgmap v6974: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:55 smithi078 ceph-mon[94114]: pgmap v6975: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:57 smithi078 ceph-mon[94114]: pgmap v6976: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:16:59 smithi078 ceph-mon[94114]: pgmap v6977: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:01 smithi078 ceph-mon[94114]: pgmap v6978: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:28.730 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:03 smithi078 ceph-mon[94114]: pgmap v6979: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:05 smithi078 ceph-mon[94114]: pgmap v6980: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:07 smithi078 ceph-mon[94114]: pgmap v6981: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:09 smithi078 ceph-mon[94114]: pgmap v6982: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:10 smithi078 ceph-mon[94114]: osdmap e502: 12 total, 12 up, 12 in 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:11 smithi078 ceph-mon[94114]: pgmap v6984: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:13 smithi078 ceph-mon[94114]: pgmap v6985: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:13 smithi078 ceph-mon[94114]: osdmap e503: 12 total, 12 up, 12 in 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:15 smithi078 ceph-mon[94114]: pgmap v6987: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:17 smithi078 ceph-mon[94114]: pgmap v6988: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:44:28.731 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:19 smithi078 ceph-mon[94114]: pgmap v6989: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 230 B/s wr, 11 op/s 2023-03-17T12:44:28.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:21 smithi078 ceph-mon[94114]: pgmap v6990: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:28.732 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:23 smithi078 ceph-mon[94114]: pgmap v6991: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:29.341 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:25 smithi078 ceph-mon[94114]: pgmap v6992: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 93 B/s wr, 9 op/s 2023-03-17T12:44:29.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:27 smithi078 ceph-mon[94114]: pgmap v6993: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:44:29.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:29 smithi078 ceph-mon[94114]: pgmap v6994: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:44:29.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:30 smithi078 ceph-mon[94114]: pgmap v6995: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:29.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:33 smithi078 ceph-mon[94114]: pgmap v6996: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:29.342 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:35 smithi078 ceph-mon[94114]: pgmap v6997: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:29.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:37 smithi078 ceph-mon[94114]: pgmap v6998: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:29.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:39 smithi078 ceph-mon[94114]: pgmap v6999: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:29.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:41 smithi078 ceph-mon[94114]: pgmap v7000: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:29.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:43 smithi078 ceph-mon[94114]: pgmap v7001: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:29.853 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:45 smithi078 ceph-mon[94114]: pgmap v7002: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:29.854 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:47 smithi078 ceph-mon[94114]: pgmap v7003: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:30.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:49 smithi078 ceph-mon[94114]: pgmap v7004: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:30.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:51 smithi078 ceph-mon[94114]: pgmap v7005: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:52 smithi078 ceph-mon[94114]: pgmap v7006: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:52 smithi078 ceph-mon[94114]: pgmap v7007: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:54 smithi078 ceph-mon[94114]: pgmap v7008: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:56 smithi078 ceph-mon[94114]: pgmap v7009: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:17:58 smithi078 ceph-mon[94114]: pgmap v7010: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:00 smithi078 ceph-mon[94114]: pgmap v7011: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:02 smithi078 ceph-mon[94114]: pgmap v7012: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:04 smithi078 ceph-mon[94114]: pgmap v7013: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:06 smithi078 ceph-mon[94114]: pgmap v7014: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:30.366 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:08 smithi078 ceph-mon[94114]: pgmap v7015: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:10 smithi078 ceph-mon[94114]: pgmap v7016: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:10 smithi078 ceph-mon[94114]: osdmap e504: 12 total, 12 up, 12 in 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:12 smithi078 ceph-mon[94114]: pgmap v7018: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:14 smithi078 ceph-mon[94114]: pgmap v7019: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:16 smithi078 ceph-mon[94114]: pgmap v7020: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:18 smithi078 ceph-mon[94114]: pgmap v7021: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:18 smithi078 ceph-mon[94114]: osdmap e505: 12 total, 12 up, 12 in 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:20 smithi078 ceph-mon[94114]: pgmap v7023: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:22 smithi078 ceph-mon[94114]: pgmap v7024: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:24 smithi078 ceph-mon[94114]: pgmap v7025: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:25 smithi078 ceph-mon[94114]: pgmap v7026: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:30.367 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:28 smithi078 ceph-mon[94114]: pgmap v7027: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:31.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:30 smithi078 ceph-mon[94114]: pgmap v7028: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:44:32.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:32 smithi078 ceph-mon[94114]: pgmap v7029: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:32.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:34 smithi078 ceph-mon[94114]: pgmap v7030: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:32.191 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:36 smithi078 ceph-mon[94114]: pgmap v7031: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:33.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:38 smithi078 ceph-mon[94114]: pgmap v7032: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:33.841 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:40 smithi078 ceph-mon[94114]: pgmap v7033: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:33.842 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:42 smithi078 ceph-mon[94114]: pgmap v7034: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:44 smithi078 ceph-mon[94114]: pgmap v7035: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:46 smithi078 ceph-mon[94114]: pgmap v7036: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:48 smithi078 ceph-mon[94114]: pgmap v7037: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:50 smithi078 ceph-mon[94114]: pgmap v7038: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:51 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:52 smithi078 ceph-mon[94114]: pgmap v7039: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:34.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:35.261 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:53 smithi078 ceph-mon[94114]: pgmap v7040: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 13 op/s 2023-03-17T12:44:35.967 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:53 smithi078 ceph-mon[94114]: pgmap v7041: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:39.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:55 smithi078 ceph-mon[94114]: pgmap v7042: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:39.632 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:57 smithi078 ceph-mon[94114]: pgmap v7043: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:18:59 smithi078 ceph-mon[94114]: pgmap v7044: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:01 smithi078 ceph-mon[94114]: pgmap v7045: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:03 smithi078 ceph-mon[94114]: pgmap v7046: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:05 smithi078 ceph-mon[94114]: pgmap v7047: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:07 smithi078 ceph-mon[94114]: pgmap v7048: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:09 smithi078 ceph-mon[94114]: pgmap v7049: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:10 smithi078 ceph-mon[94114]: osdmap e506: 12 total, 12 up, 12 in 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:11 smithi078 ceph-mon[94114]: pgmap v7051: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:42.745 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:13 smithi078 ceph-mon[94114]: pgmap v7052: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:13 smithi078 ceph-mon[94114]: osdmap e507: 12 total, 12 up, 12 in 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:15 smithi078 ceph-mon[94114]: pgmap v7054: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:17 smithi078 ceph-mon[94114]: pgmap v7055: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:19 smithi078 ceph-mon[94114]: pgmap v7056: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 239 B/s wr, 12 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:21 smithi078 ceph-mon[94114]: pgmap v7057: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:23 smithi078 ceph-mon[94114]: pgmap v7058: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:25 smithi078 ceph-mon[94114]: pgmap v7059: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 96 B/s wr, 9 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:27 smithi078 ceph-mon[94114]: pgmap v7060: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:29 smithi078 ceph-mon[94114]: pgmap v7061: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:31 smithi078 ceph-mon[94114]: pgmap v7062: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:33 smithi078 ceph-mon[94114]: pgmap v7063: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:35 smithi078 ceph-mon[94114]: pgmap v7064: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:36 smithi078 ceph-mon[94114]: pgmap v7065: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:39 smithi078 ceph-mon[94114]: pgmap v7066: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:41 smithi078 ceph-mon[94114]: pgmap v7067: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.746 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:43 smithi078 ceph-mon[94114]: pgmap v7068: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:42.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:45 smithi078 ceph-mon[94114]: pgmap v7069: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:47 smithi078 ceph-mon[94114]: pgmap v7070: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:49 smithi078 ceph-mon[94114]: pgmap v7071: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:42.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:51 smithi078 ceph-mon[94114]: pgmap v7072: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:42.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:52 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:42.747 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:53 smithi078 ceph-mon[94114]: pgmap v7073: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:44.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:44.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:44.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:44.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:54 smithi078 ceph-mon[94114]: pgmap v7074: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:44:44.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:54 smithi078 ceph-mon[94114]: pgmap v7075: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:44.996 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:56 smithi078 ceph-mon[94114]: pgmap v7076: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:47.205 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:19:58 smithi078 ceph-mon[94114]: pgmap v7077: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:44:47.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:00 smithi078 ceph-mon[94114]: pgmap v7078: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:44:47.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:44:47.277 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:02 smithi078 ceph-mon[94114]: pgmap v7079: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:44:47.862 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:04 smithi078 ceph-mon[94114]: pgmap v7080: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:47.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:06 smithi078 ceph-mon[94114]: pgmap v7081: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:47.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:08 smithi078 ceph-mon[94114]: pgmap v7082: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:44:47.863 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:10 smithi078 ceph-mon[94114]: pgmap v7083: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:48.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:10 smithi078 ceph-mon[94114]: osdmap e508: 12 total, 12 up, 12 in 2023-03-17T12:44:48.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:12 smithi078 ceph-mon[94114]: pgmap v7085: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:48.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:14 smithi078 ceph-mon[94114]: pgmap v7086: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:48.408 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:16 smithi078 ceph-mon[94114]: pgmap v7087: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:49.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:18 smithi078 ceph-mon[94114]: pgmap v7088: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:49.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:18 smithi078 ceph-mon[94114]: osdmap e509: 12 total, 12 up, 12 in 2023-03-17T12:44:49.466 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:20 smithi078 ceph-mon[94114]: pgmap v7090: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:22 smithi078 ceph-mon[94114]: pgmap v7091: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:24 smithi078 ceph-mon[94114]: pgmap v7092: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:26 smithi078 ceph-mon[94114]: pgmap v7093: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:28 smithi078 ceph-mon[94114]: pgmap v7094: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:30 smithi078 ceph-mon[94114]: pgmap v7095: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:32 smithi078 ceph-mon[94114]: pgmap v7096: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:50.930 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:34 smithi078 ceph-mon[94114]: pgmap v7097: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:52.943 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:36 smithi078 ceph-mon[94114]: pgmap v7098: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:52.944 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:38 smithi078 ceph-mon[94114]: pgmap v7099: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:52.944 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:40 smithi078 ceph-mon[94114]: pgmap v7100: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:52.944 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:42 smithi078 ceph-mon[94114]: pgmap v7101: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:52.944 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:44 smithi078 ceph-mon[94114]: pgmap v7102: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:52.944 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:46 smithi078 ceph-mon[94114]: pgmap v7103: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:47 smithi078 ceph-mon[94114]: pgmap v7104: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:50 smithi078 ceph-mon[94114]: pgmap v7105: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:52 smithi078 ceph-mon[94114]: pgmap v7106: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:53 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:54 smithi078 ceph-mon[94114]: pgmap v7107: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:44:53.785 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:55 smithi078 ceph-mon[94114]: pgmap v7108: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:44:56.102 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:55 smithi078 ceph-mon[94114]: pgmap v7109: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:44:56.103 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:57 smithi078 ceph-mon[94114]: pgmap v7110: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:20:59 smithi078 ceph-mon[94114]: pgmap v7111: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:01 smithi078 ceph-mon[94114]: pgmap v7112: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:03 smithi078 ceph-mon[94114]: pgmap v7113: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 KiB/s wr, 26 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:05 smithi078 ceph-mon[94114]: pgmap v7114: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:07 smithi078 ceph-mon[94114]: pgmap v7115: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:09 smithi078 ceph-mon[94114]: pgmap v7116: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:44:56.824 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:10 smithi078 ceph-mon[94114]: osdmap e510: 12 total, 12 up, 12 in 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:11 smithi078 ceph-mon[94114]: pgmap v7118: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:13 smithi078 ceph-mon[94114]: pgmap v7119: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:15 smithi078 ceph-mon[94114]: pgmap v7120: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:17 smithi078 ceph-mon[94114]: pgmap v7121: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:19 smithi078 ceph-mon[94114]: pgmap v7122: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:19 smithi078 ceph-mon[94114]: osdmap e511: 12 total, 12 up, 12 in 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:21 smithi078 ceph-mon[94114]: pgmap v7124: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:44:59.117 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:23 smithi078 ceph-mon[94114]: pgmap v7125: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:25 smithi078 ceph-mon[94114]: pgmap v7126: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:27 smithi078 ceph-mon[94114]: pgmap v7127: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:29 smithi078 ceph-mon[94114]: pgmap v7128: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:31 smithi078 ceph-mon[94114]: pgmap v7129: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:33 smithi078 ceph-mon[94114]: pgmap v7130: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:35 smithi078 ceph-mon[94114]: pgmap v7131: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:37 smithi078 ceph-mon[94114]: pgmap v7132: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:39 smithi078 ceph-mon[94114]: pgmap v7133: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:41 smithi078 ceph-mon[94114]: pgmap v7134: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:43 smithi078 ceph-mon[94114]: pgmap v7135: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:45 smithi078 ceph-mon[94114]: pgmap v7136: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:47 smithi078 ceph-mon[94114]: pgmap v7137: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:49 smithi078 ceph-mon[94114]: pgmap v7138: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:51 smithi078 ceph-mon[94114]: pgmap v7139: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:53 smithi078 ceph-mon[94114]: pgmap v7140: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:54 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:44:59.118 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:55 smithi078 ceph-mon[94114]: pgmap v7141: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:44:59.945 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:55 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: pgmap v7142: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:57 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:02.010 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.241 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: pgmap v7143: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:45:04.242 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: pgmap v7144: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: pgmap v7145: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:21:58 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:00 smithi078 ceph-mon[94114]: pgmap v7146: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:02 smithi078 ceph-mon[94114]: pgmap v7147: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:04 smithi078 ceph-mon[94114]: pgmap v7148: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 63 KiB/s wr, 32 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:06 smithi078 ceph-mon[94114]: pgmap v7149: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 63 KiB/s wr, 26 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:09 smithi078 ceph-mon[94114]: pgmap v7150: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:10 smithi078 ceph-mon[94114]: osdmap e512: 12 total, 12 up, 12 in 2023-03-17T12:45:06.091 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:11 smithi078 ceph-mon[94114]: pgmap v7152: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:08.109 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:12 smithi078 ceph-mon[94114]: pgmap v7153: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:14 smithi078 ceph-mon[94114]: osdmap e513: 12 total, 12 up, 12 in 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:15 smithi078 ceph-mon[94114]: pgmap v7155: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:16 smithi078 ceph-mon[94114]: pgmap v7156: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:19 smithi078 ceph-mon[94114]: pgmap v7157: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 226 B/s wr, 11 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:20 smithi078 ceph-mon[94114]: pgmap v7158: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:22 smithi078 ceph-mon[94114]: pgmap v7159: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 9 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:24 smithi078 ceph-mon[94114]: pgmap v7160: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 92 B/s wr, 8 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:26 smithi078 ceph-mon[94114]: pgmap v7161: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:29 smithi078 ceph-mon[94114]: pgmap v7162: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:30 smithi078 ceph-mon[94114]: pgmap v7163: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2023-03-17T12:45:08.110 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:32 smithi078 ceph-mon[94114]: pgmap v7164: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2023-03-17T12:45:09.958 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:34 smithi078 ceph-mon[94114]: pgmap v7165: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:36 smithi078 ceph-mon[94114]: pgmap v7166: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:39 smithi078 ceph-mon[94114]: pgmap v7167: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:40 smithi078 ceph-mon[94114]: pgmap v7168: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:42 smithi078 ceph-mon[94114]: pgmap v7169: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:44 smithi078 ceph-mon[94114]: pgmap v7170: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:46 smithi078 ceph-mon[94114]: pgmap v7171: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:49 smithi078 ceph-mon[94114]: pgmap v7172: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:50 smithi078 ceph-mon[94114]: pgmap v7173: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:52 smithi078 ceph-mon[94114]: pgmap v7174: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:54 smithi078 ceph-mon[94114]: pgmap v7175: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:56 smithi078 ceph-mon[94114]: pgmap v7176: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:59 smithi078 ceph-mon[94114]: pgmap v7177: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:09.959 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:09.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:09.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:22:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:09.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:00 smithi078 ceph-mon[94114]: pgmap v7178: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:45:09.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:00 smithi078 ceph-mon[94114]: pgmap v7179: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-03-17T12:45:09.960 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:02 smithi078 ceph-mon[94114]: pgmap v7180: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:45:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:04 smithi078 ceph-mon[94114]: pgmap v7181: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:06 smithi078 ceph-mon[94114]: pgmap v7182: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:12.545 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:08 smithi078 ceph-mon[94114]: pgmap v7183: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:13.164 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:10 smithi078 ceph-mon[94114]: pgmap v7184: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:10 smithi078 ceph-mon[94114]: osdmap e514: 12 total, 12 up, 12 in 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:12 smithi078 ceph-mon[94114]: pgmap v7186: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:14 smithi078 ceph-mon[94114]: pgmap v7187: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:16 smithi078 ceph-mon[94114]: pgmap v7188: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:18 smithi078 ceph-mon[94114]: pgmap v7189: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:18 smithi078 ceph-mon[94114]: osdmap e515: 12 total, 12 up, 12 in 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:20 smithi078 ceph-mon[94114]: pgmap v7191: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 208 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:22 smithi078 ceph-mon[94114]: pgmap v7192: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:24 smithi078 ceph-mon[94114]: pgmap v7193: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:26 smithi078 ceph-mon[94114]: pgmap v7194: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:28 smithi078 ceph-mon[94114]: pgmap v7195: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:30 smithi078 ceph-mon[94114]: pgmap v7196: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:45:13.165 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:32 smithi078 ceph-mon[94114]: pgmap v7197: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:13.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:34 smithi078 ceph-mon[94114]: pgmap v7198: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:13.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:36 smithi078 ceph-mon[94114]: pgmap v7199: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:13.166 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:38 smithi078 ceph-mon[94114]: pgmap v7200: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:40 smithi078 ceph-mon[94114]: pgmap v7201: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:42 smithi078 ceph-mon[94114]: pgmap v7202: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:44 smithi078 ceph-mon[94114]: pgmap v7203: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:45 smithi078 ceph-mon[94114]: pgmap v7204: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:48 smithi078 ceph-mon[94114]: pgmap v7205: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:50 smithi078 ceph-mon[94114]: pgmap v7206: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:52 smithi078 ceph-mon[94114]: pgmap v7207: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:54 smithi078 ceph-mon[94114]: pgmap v7208: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:56 smithi078 ceph-mon[94114]: pgmap v7209: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:58 smithi078 ceph-mon[94114]: pgmap v7210: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.618 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:23:59 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:00 smithi078 ceph-mon[94114]: pgmap v7211: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:00 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:02 smithi078 ceph-mon[94114]: pgmap v7212: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:02 smithi078 ceph-mon[94114]: pgmap v7213: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:04 smithi078 ceph-mon[94114]: pgmap v7214: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:06 smithi078 ceph-mon[94114]: pgmap v7215: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:08 smithi078 ceph-mon[94114]: pgmap v7216: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 57 KiB/s wr, 24 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:10 smithi078 ceph-mon[94114]: pgmap v7217: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 29 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:10 smithi078 ceph-mon[94114]: osdmap e516: 12 total, 12 up, 12 in 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:12 smithi078 ceph-mon[94114]: pgmap v7219: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:14 smithi078 ceph-mon[94114]: pgmap v7220: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:16 smithi078 ceph-mon[94114]: pgmap v7221: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:14.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:18 smithi078 ceph-mon[94114]: pgmap v7222: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:18 smithi078 ceph-mon[94114]: osdmap e517: 12 total, 12 up, 12 in 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:20 smithi078 ceph-mon[94114]: pgmap v7224: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 223 B/s wr, 11 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:22 smithi078 ceph-mon[94114]: pgmap v7225: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:24 smithi078 ceph-mon[94114]: pgmap v7226: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:26 smithi078 ceph-mon[94114]: pgmap v7227: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:28 smithi078 ceph-mon[94114]: pgmap v7228: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:30 smithi078 ceph-mon[94114]: pgmap v7229: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:32 smithi078 ceph-mon[94114]: pgmap v7230: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:34 smithi078 ceph-mon[94114]: pgmap v7231: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:36 smithi078 ceph-mon[94114]: pgmap v7232: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:37 smithi078 ceph-mon[94114]: pgmap v7233: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:40 smithi078 ceph-mon[94114]: pgmap v7234: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:42 smithi078 ceph-mon[94114]: pgmap v7235: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:44 smithi078 ceph-mon[94114]: pgmap v7236: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:46 smithi078 ceph-mon[94114]: pgmap v7237: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:14.620 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:48 smithi078 ceph-mon[94114]: pgmap v7238: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:50 smithi078 ceph-mon[94114]: pgmap v7239: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:52 smithi078 ceph-mon[94114]: pgmap v7240: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:54 smithi078 ceph-mon[94114]: pgmap v7241: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:56 smithi078 ceph-mon[94114]: pgmap v7242: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:15.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:24:58 smithi078 ceph-mon[94114]: pgmap v7243: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:00 smithi078 ceph-mon[94114]: pgmap v7244: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:01 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:02 smithi078 ceph-mon[94114]: pgmap v7245: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:02 smithi078 ceph-mon[94114]: pgmap v7246: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:02 smithi078 ceph-mon[94114]: pgmap v7247: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:04 smithi078 ceph-mon[94114]: pgmap v7248: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:06 smithi078 ceph-mon[94114]: pgmap v7249: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:15.228 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:08 smithi078 ceph-mon[94114]: pgmap v7250: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:15.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:10 smithi078 ceph-mon[94114]: pgmap v7251: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:15.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:10 smithi078 ceph-mon[94114]: osdmap e518: 12 total, 12 up, 12 in 2023-03-17T12:45:15.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:12 smithi078 ceph-mon[94114]: pgmap v7253: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:15.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:14 smithi078 ceph-mon[94114]: pgmap v7254: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:15.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:16 smithi078 ceph-mon[94114]: pgmap v7255: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:15.621 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:18 smithi078 ceph-mon[94114]: pgmap v7256: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:15.622 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:18 smithi078 ceph-mon[94114]: osdmap e519: 12 total, 12 up, 12 in 2023-03-17T12:45:15.622 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:20 smithi078 ceph-mon[94114]: pgmap v7258: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:22 smithi078 ceph-mon[94114]: pgmap v7259: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:24 smithi078 ceph-mon[94114]: pgmap v7260: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:26 smithi078 ceph-mon[94114]: pgmap v7261: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:28 smithi078 ceph-mon[94114]: pgmap v7262: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:30 smithi078 ceph-mon[94114]: pgmap v7263: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:32 smithi078 ceph-mon[94114]: pgmap v7264: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:34 smithi078 ceph-mon[94114]: pgmap v7265: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:36 smithi078 ceph-mon[94114]: pgmap v7266: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:38 smithi078 ceph-mon[94114]: pgmap v7267: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:40 smithi078 ceph-mon[94114]: pgmap v7268: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:42 smithi078 ceph-mon[94114]: pgmap v7269: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.704 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:44 smithi078 ceph-mon[94114]: pgmap v7270: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:46 smithi078 ceph-mon[94114]: pgmap v7271: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:48 smithi078 ceph-mon[94114]: pgmap v7272: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:50 smithi078 ceph-mon[94114]: pgmap v7273: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:52 smithi078 ceph-mon[94114]: pgmap v7274: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:54 smithi078 ceph-mon[94114]: pgmap v7275: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:56 smithi078 ceph-mon[94114]: pgmap v7276: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:25:58 smithi078 ceph-mon[94114]: pgmap v7277: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:00 smithi078 ceph-mon[94114]: pgmap v7278: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:02 smithi078 ceph-mon[94114]: pgmap v7279: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:03 smithi078 ceph-mon[94114]: pgmap v7280: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 49 KiB/s wr, 30 op/s 2023-03-17T12:45:16.705 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:03 smithi078 ceph-mon[94114]: pgmap v7281: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:04 smithi078 ceph-mon[94114]: pgmap v7282: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:07 smithi078 ceph-mon[94114]: pgmap v7283: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:09 smithi078 ceph-mon[94114]: pgmap v7284: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:10 smithi078 ceph-mon[94114]: osdmap e520: 12 total, 12 up, 12 in 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:11 smithi078 ceph-mon[94114]: pgmap v7286: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:13 smithi078 ceph-mon[94114]: pgmap v7287: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:16.706 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:13 smithi078 ceph-mon[94114]: osdmap e521: 12 total, 12 up, 12 in 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:15 smithi078 ceph-mon[94114]: pgmap v7289: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:17 smithi078 ceph-mon[94114]: pgmap v7290: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:19 smithi078 ceph-mon[94114]: pgmap v7291: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:21 smithi078 ceph-mon[94114]: pgmap v7292: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:23 smithi078 ceph-mon[94114]: pgmap v7293: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:25 smithi078 ceph-mon[94114]: pgmap v7294: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 284 B/s wr, 9 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:27 smithi078 ceph-mon[94114]: pgmap v7295: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:29 smithi078 ceph-mon[94114]: pgmap v7296: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:31 smithi078 ceph-mon[94114]: pgmap v7297: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:33 smithi078 ceph-mon[94114]: pgmap v7298: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:35 smithi078 ceph-mon[94114]: pgmap v7299: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:37 smithi078 ceph-mon[94114]: pgmap v7300: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:39 smithi078 ceph-mon[94114]: pgmap v7301: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:17.446 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:41 smithi078 ceph-mon[94114]: pgmap v7302: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:43 smithi078 ceph-mon[94114]: pgmap v7303: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:17.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:44 smithi078 ceph-mon[94114]: pgmap v7304: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.447 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:47 smithi078 ceph-mon[94114]: pgmap v7305: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.812 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:49 smithi078 ceph-mon[94114]: pgmap v7306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:17.812 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:51 smithi078 ceph-mon[94114]: pgmap v7307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.813 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:53 smithi078 ceph-mon[94114]: pgmap v7308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:17.813 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:55 smithi078 ceph-mon[94114]: pgmap v7309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.813 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:57 smithi078 ceph-mon[94114]: pgmap v7310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:17.813 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:26:59 smithi078 ceph-mon[94114]: pgmap v7311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:20.179 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:01 smithi078 ceph-mon[94114]: pgmap v7312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:20.180 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:02 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:20.180 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:03 smithi078 ceph-mon[94114]: pgmap v7313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:45:24.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:24.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:24.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:24.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:04 smithi078 ceph-mon[94114]: pgmap v7314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:24.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:04 smithi078 ceph-mon[94114]: pgmap v7315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:24.922 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:06 smithi078 ceph-mon[94114]: pgmap v7316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:26.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:08 smithi078 ceph-mon[94114]: pgmap v7317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:26.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:09 smithi078 ceph-mon[94114]: osdmap e522: 12 total, 12 up, 12 in 2023-03-17T12:45:26.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:10 smithi078 ceph-mon[94114]: pgmap v7319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:26.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:12 smithi078 ceph-mon[94114]: pgmap v7320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:45:26.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:14 smithi078 ceph-mon[94114]: pgmap v7321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:26.688 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:16 smithi078 ceph-mon[94114]: pgmap v7322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:18 smithi078 ceph-mon[94114]: pgmap v7323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:18 smithi078 ceph-mon[94114]: osdmap e523: 12 total, 12 up, 12 in 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:20 smithi078 ceph-mon[94114]: pgmap v7325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:22 smithi078 ceph-mon[94114]: pgmap v7326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:24 smithi078 ceph-mon[94114]: pgmap v7327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:26 smithi078 ceph-mon[94114]: pgmap v7328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:28 smithi078 ceph-mon[94114]: pgmap v7329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:26.689 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:30 smithi078 ceph-mon[94114]: pgmap v7330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:45:28.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:32 smithi078 ceph-mon[94114]: pgmap v7331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:34 smithi078 ceph-mon[94114]: pgmap v7332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:36 smithi078 ceph-mon[94114]: pgmap v7333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:38 smithi078 ceph-mon[94114]: pgmap v7334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:40 smithi078 ceph-mon[94114]: pgmap v7335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:42 smithi078 ceph-mon[94114]: pgmap v7336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:30.226 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:44 smithi078 ceph-mon[94114]: pgmap v7337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:46 smithi078 ceph-mon[94114]: pgmap v7338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:48 smithi078 ceph-mon[94114]: pgmap v7339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:30.227 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:50 smithi078 ceph-mon[94114]: pgmap v7340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:31.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:52 smithi078 ceph-mon[94114]: pgmap v7341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:54 smithi078 ceph-mon[94114]: pgmap v7342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:56 smithi078 ceph-mon[94114]: pgmap v7343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:27:58 smithi078 ceph-mon[94114]: pgmap v7344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:00 smithi078 ceph-mon[94114]: pgmap v7345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:02 smithi078 ceph-mon[94114]: pgmap v7346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:03 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:04 smithi078 ceph-mon[94114]: pgmap v7347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:31.312 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:31.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:31.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:05 smithi078 ceph-mon[94114]: pgmap v7348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:31.313 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:05 smithi078 ceph-mon[94114]: pgmap v7349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:06 smithi078 ceph-mon[94114]: pgmap v7350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:09 smithi078 ceph-mon[94114]: pgmap v7351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:09 smithi078 ceph-mon[94114]: osdmap e524: 12 total, 12 up, 12 in 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:11 smithi078 ceph-mon[94114]: pgmap v7353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:13 smithi078 ceph-mon[94114]: pgmap v7354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:15 smithi078 ceph-mon[94114]: pgmap v7355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:31.783 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:17 smithi078 ceph-mon[94114]: pgmap v7356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:32.770 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:19 smithi078 ceph-mon[94114]: pgmap v7357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:19 smithi078 ceph-mon[94114]: osdmap e525: 12 total, 12 up, 12 in 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:21 smithi078 ceph-mon[94114]: pgmap v7359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:23 smithi078 ceph-mon[94114]: pgmap v7360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:25 smithi078 ceph-mon[94114]: pgmap v7361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:27 smithi078 ceph-mon[94114]: pgmap v7362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:29 smithi078 ceph-mon[94114]: pgmap v7363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:31 smithi078 ceph-mon[94114]: pgmap v7364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:33 smithi078 ceph-mon[94114]: pgmap v7365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:35 smithi078 ceph-mon[94114]: pgmap v7366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:37 smithi078 ceph-mon[94114]: pgmap v7367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:39 smithi078 ceph-mon[94114]: pgmap v7368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:41 smithi078 ceph-mon[94114]: pgmap v7369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:43 smithi078 ceph-mon[94114]: pgmap v7370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:45 smithi078 ceph-mon[94114]: pgmap v7371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:47 smithi078 ceph-mon[94114]: pgmap v7372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:32.771 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:49 smithi078 ceph-mon[94114]: pgmap v7373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:51 smithi078 ceph-mon[94114]: pgmap v7374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:53 smithi078 ceph-mon[94114]: pgmap v7375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:55 smithi078 ceph-mon[94114]: pgmap v7376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:57 smithi078 ceph-mon[94114]: pgmap v7377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:28:59 smithi078 ceph-mon[94114]: pgmap v7378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:01 smithi078 ceph-mon[94114]: pgmap v7379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:03 smithi078 ceph-mon[94114]: pgmap v7380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:04 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:05 smithi078 ceph-mon[94114]: pgmap v7381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:06 smithi078 ceph-mon[94114]: pgmap v7382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:06 smithi078 ceph-mon[94114]: pgmap v7383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:08 smithi078 ceph-mon[94114]: pgmap v7384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:45:32.772 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:09 smithi078 ceph-mon[94114]: osdmap e526: 12 total, 12 up, 12 in 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:10 smithi078 ceph-mon[94114]: pgmap v7386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 38 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:12 smithi078 ceph-mon[94114]: pgmap v7387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:14 smithi078 ceph-mon[94114]: pgmap v7388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:16 smithi078 ceph-mon[94114]: pgmap v7389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:18 smithi078 ceph-mon[94114]: pgmap v7390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:18 smithi078 ceph-mon[94114]: osdmap e527: 12 total, 12 up, 12 in 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:19 smithi078 ceph-mon[94114]: pgmap v7392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:21 smithi078 ceph-mon[94114]: pgmap v7393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:35.024 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:24 smithi078 ceph-mon[94114]: pgmap v7394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:35.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:26 smithi078 ceph-mon[94114]: pgmap v7395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:35.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:28 smithi078 ceph-mon[94114]: pgmap v7396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:36.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:30 smithi078 ceph-mon[94114]: pgmap v7397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:45:36.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:32 smithi078 ceph-mon[94114]: pgmap v7398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:36.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:34 smithi078 ceph-mon[94114]: pgmap v7399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:36.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:36 smithi078 ceph-mon[94114]: pgmap v7400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:36.699 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:38 smithi078 ceph-mon[94114]: pgmap v7401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:36.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:49 smithi082 ceph-mon[94281]: pgmap v7306: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:38.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:51 smithi082 ceph-mon[94281]: pgmap v7307: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:38.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:53 smithi082 ceph-mon[94281]: pgmap v7308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:38.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:55 smithi082 ceph-mon[94281]: pgmap v7309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:38.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:57 smithi082 ceph-mon[94281]: pgmap v7310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:38.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:26:59 smithi082 ceph-mon[94281]: pgmap v7311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:38.830 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:01 smithi082 ceph-mon[94281]: pgmap v7312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:38.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:02 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:38.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:03 smithi082 ceph-mon[94281]: pgmap v7313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:45:38.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:38.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:38.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:38.831 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:04 smithi082 ceph-mon[94281]: pgmap v7314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:04 smithi082 ceph-mon[94281]: pgmap v7315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:06 smithi082 ceph-mon[94281]: pgmap v7316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:08 smithi082 ceph-mon[94281]: pgmap v7317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:09 smithi082 ceph-mon[94281]: osdmap e522: 12 total, 12 up, 12 in 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:10 smithi082 ceph-mon[94281]: pgmap v7319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:12 smithi082 ceph-mon[94281]: pgmap v7320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:14 smithi082 ceph-mon[94281]: pgmap v7321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:16 smithi082 ceph-mon[94281]: pgmap v7322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:18 smithi082 ceph-mon[94281]: pgmap v7323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:18 smithi082 ceph-mon[94281]: osdmap e523: 12 total, 12 up, 12 in 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:20 smithi082 ceph-mon[94281]: pgmap v7325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:22 smithi082 ceph-mon[94281]: pgmap v7326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:24 smithi082 ceph-mon[94281]: pgmap v7327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:41.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:26 smithi082 ceph-mon[94281]: pgmap v7328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:28 smithi082 ceph-mon[94281]: pgmap v7329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:30 smithi082 ceph-mon[94281]: pgmap v7330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:32 smithi082 ceph-mon[94281]: pgmap v7331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:34 smithi082 ceph-mon[94281]: pgmap v7332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:36 smithi082 ceph-mon[94281]: pgmap v7333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:38 smithi082 ceph-mon[94281]: pgmap v7334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:40 smithi082 ceph-mon[94281]: pgmap v7335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:42 smithi082 ceph-mon[94281]: pgmap v7336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:44 smithi082 ceph-mon[94281]: pgmap v7337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:46 smithi082 ceph-mon[94281]: pgmap v7338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:48 smithi082 ceph-mon[94281]: pgmap v7339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:50 smithi082 ceph-mon[94281]: pgmap v7340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:52 smithi082 ceph-mon[94281]: pgmap v7341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:54 smithi082 ceph-mon[94281]: pgmap v7342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:56 smithi082 ceph-mon[94281]: pgmap v7343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:27:58 smithi082 ceph-mon[94281]: pgmap v7344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:41.315 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:00 smithi082 ceph-mon[94281]: pgmap v7345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:02 smithi082 ceph-mon[94281]: pgmap v7346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:03 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:04 smithi082 ceph-mon[94281]: pgmap v7347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:05 smithi082 ceph-mon[94281]: pgmap v7348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:05 smithi082 ceph-mon[94281]: pgmap v7349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:06 smithi082 ceph-mon[94281]: pgmap v7350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:09 smithi082 ceph-mon[94281]: pgmap v7351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:09 smithi082 ceph-mon[94281]: osdmap e524: 12 total, 12 up, 12 in 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:11 smithi082 ceph-mon[94281]: pgmap v7353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:13 smithi082 ceph-mon[94281]: pgmap v7354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:15 smithi082 ceph-mon[94281]: pgmap v7355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:17 smithi082 ceph-mon[94281]: pgmap v7356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:19 smithi082 ceph-mon[94281]: pgmap v7357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:19 smithi082 ceph-mon[94281]: osdmap e525: 12 total, 12 up, 12 in 2023-03-17T12:45:41.316 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:21 smithi082 ceph-mon[94281]: pgmap v7359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:41.317 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:23 smithi082 ceph-mon[94281]: pgmap v7360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:43.892 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:25 smithi082 ceph-mon[94281]: pgmap v7361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:27 smithi082 ceph-mon[94281]: pgmap v7362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:29 smithi082 ceph-mon[94281]: pgmap v7363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:31 smithi082 ceph-mon[94281]: pgmap v7364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:33 smithi082 ceph-mon[94281]: pgmap v7365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:35 smithi082 ceph-mon[94281]: pgmap v7366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:37 smithi082 ceph-mon[94281]: pgmap v7367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:39 smithi082 ceph-mon[94281]: pgmap v7368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:41 smithi082 ceph-mon[94281]: pgmap v7369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:43 smithi082 ceph-mon[94281]: pgmap v7370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:45 smithi082 ceph-mon[94281]: pgmap v7371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:47 smithi082 ceph-mon[94281]: pgmap v7372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:49 smithi082 ceph-mon[94281]: pgmap v7373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:51 smithi082 ceph-mon[94281]: pgmap v7374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:43.893 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:53 smithi082 ceph-mon[94281]: pgmap v7375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:55 smithi082 ceph-mon[94281]: pgmap v7376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:57 smithi082 ceph-mon[94281]: pgmap v7377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:28:59 smithi082 ceph-mon[94281]: pgmap v7378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:01 smithi082 ceph-mon[94281]: pgmap v7379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:03 smithi082 ceph-mon[94281]: pgmap v7380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:04 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:05 smithi082 ceph-mon[94281]: pgmap v7381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:06 smithi082 ceph-mon[94281]: pgmap v7382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:06 smithi082 ceph-mon[94281]: pgmap v7383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:08 smithi082 ceph-mon[94281]: pgmap v7384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:09 smithi082 ceph-mon[94281]: osdmap e526: 12 total, 12 up, 12 in 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:10 smithi082 ceph-mon[94281]: pgmap v7386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 38 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:12 smithi082 ceph-mon[94281]: pgmap v7387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:43.894 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:14 smithi082 ceph-mon[94281]: pgmap v7388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:45:43.895 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:16 smithi082 ceph-mon[94281]: pgmap v7389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:43.895 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:18 smithi082 ceph-mon[94281]: pgmap v7390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:43.895 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:18 smithi082 ceph-mon[94281]: osdmap e527: 12 total, 12 up, 12 in 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:19 smithi082 ceph-mon[94281]: pgmap v7392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:21 smithi082 ceph-mon[94281]: pgmap v7393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:24 smithi082 ceph-mon[94281]: pgmap v7394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:26 smithi082 ceph-mon[94281]: pgmap v7395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:28 smithi082 ceph-mon[94281]: pgmap v7396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:30 smithi082 ceph-mon[94281]: pgmap v7397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:32 smithi082 ceph-mon[94281]: pgmap v7398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:34 smithi082 ceph-mon[94281]: pgmap v7399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:36 smithi082 ceph-mon[94281]: pgmap v7400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:38 smithi082 ceph-mon[94281]: pgmap v7401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:40 smithi082 ceph-mon[94281]: pgmap v7402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:42 smithi082 ceph-mon[94281]: pgmap v7403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:44 smithi082 ceph-mon[94281]: pgmap v7404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:46 smithi082 ceph-mon[94281]: pgmap v7405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:48 smithi082 ceph-mon[94281]: pgmap v7406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:50 smithi082 ceph-mon[94281]: pgmap v7407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:52 smithi082 ceph-mon[94281]: pgmap v7408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:54 smithi082 ceph-mon[94281]: pgmap v7409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:56 smithi082 ceph-mon[94281]: pgmap v7410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:29:58 smithi082 ceph-mon[94281]: pgmap v7411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:00 smithi082 ceph-mon[94281]: pgmap v7412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:02 smithi082 ceph-mon[94281]: pgmap v7413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:04 smithi082 ceph-mon[94281]: pgmap v7414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:45:46.232 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:05 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:47.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:06 smithi082 ceph-mon[94281]: pgmap v7415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:45:47.666 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:47.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:47.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:47.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:07 smithi082 ceph-mon[94281]: pgmap v7416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:45:47.667 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:07 smithi082 ceph-mon[94281]: pgmap v7417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:48.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:09 smithi082 ceph-mon[94281]: pgmap v7418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:45:48.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:09 smithi082 ceph-mon[94281]: osdmap e528: 12 total, 12 up, 12 in 2023-03-17T12:45:48.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:10 smithi082 ceph-mon[94281]: pgmap v7420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:48.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:12 smithi082 ceph-mon[94281]: pgmap v7421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:45:48.546 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:15 smithi082 ceph-mon[94281]: pgmap v7422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:45:49.032 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:17 smithi082 ceph-mon[94281]: pgmap v7423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:19 smithi082 ceph-mon[94281]: pgmap v7424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:19 smithi082 ceph-mon[94281]: osdmap e529: 12 total, 12 up, 12 in 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:21 smithi082 ceph-mon[94281]: pgmap v7426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:23 smithi082 ceph-mon[94281]: pgmap v7427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:25 smithi082 ceph-mon[94281]: pgmap v7428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:27 smithi082 ceph-mon[94281]: pgmap v7429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:29 smithi082 ceph-mon[94281]: pgmap v7430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:45:49.033 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:31 smithi082 ceph-mon[94281]: pgmap v7431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:33 smithi082 ceph-mon[94281]: pgmap v7432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:35 smithi082 ceph-mon[94281]: pgmap v7433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:37 smithi082 ceph-mon[94281]: pgmap v7434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:39 smithi082 ceph-mon[94281]: pgmap v7435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:41 smithi082 ceph-mon[94281]: pgmap v7436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:43 smithi082 ceph-mon[94281]: pgmap v7437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:44 smithi082 ceph-mon[94281]: pgmap v7438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:46 smithi082 ceph-mon[94281]: pgmap v7439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.034 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:49 smithi082 ceph-mon[94281]: pgmap v7440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:49.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:51 smithi082 ceph-mon[94281]: pgmap v7441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:53 smithi082 ceph-mon[94281]: pgmap v7442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:55 smithi082 ceph-mon[94281]: pgmap v7443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:49.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:57 smithi082 ceph-mon[94281]: pgmap v7444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:49.035 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:30:59 smithi082 ceph-mon[94281]: pgmap v7445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:50.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:01 smithi082 ceph-mon[94281]: pgmap v7446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:50.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:03 smithi082 ceph-mon[94281]: pgmap v7447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:50.184 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:05 smithi082 ceph-mon[94281]: pgmap v7448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:45:51.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:51.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:51.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:06 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:51.600 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:07 smithi082 ceph-mon[94281]: pgmap v7449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:08 smithi082 ceph-mon[94281]: pgmap v7450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 27 op/s 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:08 smithi082 ceph-mon[94281]: pgmap v7451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:09 smithi082 ceph-mon[94281]: osdmap e530: 12 total, 12 up, 12 in 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:09 smithi082 ceph-mon[94281]: pgmap v7453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 73 KiB/s wr, 38 op/s 2023-03-17T12:45:51.601 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:11 smithi082 ceph-mon[94281]: pgmap v7454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:45:51.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:14 smithi082 ceph-mon[94281]: pgmap v7455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 281 B/s wr, 14 op/s 2023-03-17T12:45:51.602 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:14 smithi082 ceph-mon[94281]: osdmap e531: 12 total, 12 up, 12 in 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:16 smithi082 ceph-mon[94281]: pgmap v7457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:18 smithi082 ceph-mon[94281]: pgmap v7458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 123 B/s wr, 11 op/s 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:20 smithi082 ceph-mon[94281]: pgmap v7459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:22 smithi082 ceph-mon[94281]: pgmap v7460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:24 smithi082 ceph-mon[94281]: pgmap v7461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:26 smithi082 ceph-mon[94281]: pgmap v7462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 8 op/s 2023-03-17T12:45:53.362 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:28 smithi082 ceph-mon[94281]: pgmap v7463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:30 smithi082 ceph-mon[94281]: pgmap v7464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:32 smithi082 ceph-mon[94281]: pgmap v7465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:34 smithi082 ceph-mon[94281]: pgmap v7466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:36 smithi082 ceph-mon[94281]: pgmap v7467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:37 smithi082 ceph-mon[94281]: pgmap v7468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:40 smithi082 ceph-mon[94281]: pgmap v7469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:42 smithi082 ceph-mon[94281]: pgmap v7470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:44 smithi082 ceph-mon[94281]: pgmap v7471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:46 smithi082 ceph-mon[94281]: pgmap v7472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:48 smithi082 ceph-mon[94281]: pgmap v7473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:50 smithi082 ceph-mon[94281]: pgmap v7474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:52 smithi082 ceph-mon[94281]: pgmap v7475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:54 smithi082 ceph-mon[94281]: pgmap v7476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:56 smithi082 ceph-mon[94281]: pgmap v7477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:31:58 smithi082 ceph-mon[94281]: pgmap v7478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T12:45:58.726 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:00 smithi082 ceph-mon[94281]: pgmap v7479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:01 smithi082 ceph-mon[94281]: pgmap v7480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:04 smithi082 ceph-mon[94281]: pgmap v7481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:06 smithi082 ceph-mon[94281]: pgmap v7482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:07 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:08 smithi082 ceph-mon[94281]: pgmap v7483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:09 smithi082 ceph-mon[94281]: osdmap e532: 12 total, 12 up, 12 in 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: pgmap v7485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:45:58.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:10 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:46:01.319 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:46:01.320 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:03.444 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:03.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:11 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:03.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:12 smithi082 ceph-mon[94281]: pgmap v7486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:03.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:12 smithi082 ceph-mon[94281]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:46:03.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:12 smithi082 ceph-mon[94281]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:46:03.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:12 smithi082 ceph-mon[94281]: pgmap v7487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:46:04.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:12 smithi082 ceph-mon[94281]: pgmap v7488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 169 B/s wr, 8 op/s 2023-03-17T12:46:04.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:14 smithi082 ceph-mon[94281]: pgmap v7489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 338 B/s wr, 10 op/s 2023-03-17T12:46:04.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:16 smithi082 ceph-mon[94281]: pgmap v7490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 160 B/s wr, 8 op/s 2023-03-17T12:46:04.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:18 smithi082 ceph-mon[94281]: pgmap v7491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 254 B/s wr, 12 op/s 2023-03-17T12:46:04.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:18 smithi082 ceph-mon[94281]: osdmap e533: 12 total, 12 up, 12 in 2023-03-17T12:46:04.328 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:20 smithi082 ceph-mon[94281]: pgmap v7493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:04.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:22 smithi082 ceph-mon[94281]: pgmap v7494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:04.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:24 smithi082 ceph-mon[94281]: pgmap v7495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:06.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:26 smithi082 ceph-mon[94281]: pgmap v7496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:06.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:28 smithi082 ceph-mon[94281]: pgmap v7497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:06.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:30 smithi082 ceph-mon[94281]: pgmap v7498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:46:06.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:31 smithi082 ceph-mon[94281]: pgmap v7499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:06.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:34 smithi082 ceph-mon[94281]: pgmap v7500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:06.329 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:36 smithi082 ceph-mon[94281]: pgmap v7501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:06.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:38 smithi082 ceph-mon[94281]: pgmap v7502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:06.330 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:40 smithi082 ceph-mon[94281]: pgmap v7503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:42 smithi082 ceph-mon[94281]: pgmap v7504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:44 smithi082 ceph-mon[94281]: pgmap v7505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:07.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:46 smithi082 ceph-mon[94281]: pgmap v7506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:48 smithi082 ceph-mon[94281]: pgmap v7507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:49 smithi082 ceph-mon[94281]: pgmap v7508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:52 smithi082 ceph-mon[94281]: pgmap v7509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:54 smithi082 ceph-mon[94281]: pgmap v7510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:56 smithi082 ceph-mon[94281]: pgmap v7511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:32:58 smithi082 ceph-mon[94281]: pgmap v7512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:00 smithi082 ceph-mon[94281]: pgmap v7513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:02 smithi082 ceph-mon[94281]: pgmap v7514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:04 smithi082 ceph-mon[94281]: pgmap v7515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:06 smithi082 ceph-mon[94281]: pgmap v7516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:08 smithi082 ceph-mon[94281]: pgmap v7517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:09 smithi082 ceph-mon[94281]: osdmap e534: 12 total, 12 up, 12 in 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:09 smithi082 ceph-mon[94281]: pgmap v7519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:07.929 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:12 smithi082 ceph-mon[94281]: pgmap v7520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:13 smithi082 ceph-mon[94281]: pgmap v7521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:13 smithi082 ceph-mon[94281]: pgmap v7522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:15 smithi082 ceph-mon[94281]: pgmap v7523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:17 smithi082 ceph-mon[94281]: pgmap v7524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:19 smithi082 ceph-mon[94281]: pgmap v7525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:19 smithi082 ceph-mon[94281]: osdmap e535: 12 total, 12 up, 12 in 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:21 smithi082 ceph-mon[94281]: pgmap v7527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:23 smithi082 ceph-mon[94281]: pgmap v7528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:07.930 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:25 smithi082 ceph-mon[94281]: pgmap v7529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:27 smithi082 ceph-mon[94281]: pgmap v7530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:29 smithi082 ceph-mon[94281]: pgmap v7531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:31 smithi082 ceph-mon[94281]: pgmap v7532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:33 smithi082 ceph-mon[94281]: pgmap v7533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:34 smithi082 ceph-mon[94281]: pgmap v7534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:36 smithi082 ceph-mon[94281]: pgmap v7535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:39 smithi082 ceph-mon[94281]: pgmap v7536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:41 smithi082 ceph-mon[94281]: pgmap v7537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.800 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:43 smithi082 ceph-mon[94281]: pgmap v7538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:45 smithi082 ceph-mon[94281]: pgmap v7539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:47 smithi082 ceph-mon[94281]: pgmap v7540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:49 smithi082 ceph-mon[94281]: pgmap v7541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:50 smithi082 ceph-mon[94281]: pgmap v7542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:52 smithi082 ceph-mon[94281]: pgmap v7543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:55 smithi082 ceph-mon[94281]: pgmap v7544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:57 smithi082 ceph-mon[94281]: pgmap v7545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:33:59 smithi082 ceph-mon[94281]: pgmap v7546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:01 smithi082 ceph-mon[94281]: pgmap v7547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.801 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:02 smithi082 ceph-mon[94281]: pgmap v7548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:10.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:05 smithi082 ceph-mon[94281]: pgmap v7549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:10.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:07 smithi082 ceph-mon[94281]: pgmap v7550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:10.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:09 smithi082 ceph-mon[94281]: pgmap v7551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:10.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:09 smithi082 ceph-mon[94281]: osdmap e536: 12 total, 12 up, 12 in 2023-03-17T12:46:10.802 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:10 smithi082 ceph-mon[94281]: pgmap v7553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:11.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:12 smithi082 ceph-mon[94281]: pgmap v7554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:11.425 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:14.131 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:12 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:13 smithi082 ceph-mon[94281]: pgmap v7555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:13 smithi082 ceph-mon[94281]: pgmap v7556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:13 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:16 smithi082 ceph-mon[94281]: pgmap v7557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:46:14.132 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:18 smithi082 ceph-mon[94281]: pgmap v7558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-17T12:46:14.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:19 smithi082 ceph-mon[94281]: osdmap e537: 12 total, 12 up, 12 in 2023-03-17T12:46:14.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:20 smithi082 ceph-mon[94281]: pgmap v7560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:46:14.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:22 smithi082 ceph-mon[94281]: pgmap v7561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:46:14.133 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:24 smithi082 ceph-mon[94281]: pgmap v7562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:25 smithi082 ceph-mon[94281]: pgmap v7563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:28 smithi082 ceph-mon[94281]: pgmap v7564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:30 smithi082 ceph-mon[94281]: pgmap v7565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:32 smithi082 ceph-mon[94281]: pgmap v7566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:34 smithi082 ceph-mon[94281]: pgmap v7567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:36 smithi082 ceph-mon[94281]: pgmap v7568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:37 smithi082 ceph-mon[94281]: pgmap v7569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:40 smithi082 ceph-mon[94281]: pgmap v7570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:42 smithi082 ceph-mon[94281]: pgmap v7571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:44 smithi082 ceph-mon[94281]: pgmap v7572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:45 smithi082 ceph-mon[94281]: pgmap v7573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.393 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:48 smithi082 ceph-mon[94281]: pgmap v7574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:50 smithi082 ceph-mon[94281]: pgmap v7575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:52 smithi082 ceph-mon[94281]: pgmap v7576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:54 smithi082 ceph-mon[94281]: pgmap v7577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:56 smithi082 ceph-mon[94281]: pgmap v7578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:58 smithi082 ceph-mon[94281]: pgmap v7579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:34:59 smithi082 ceph-mon[94281]: pgmap v7580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:02 smithi082 ceph-mon[94281]: pgmap v7581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:04 smithi082 ceph-mon[94281]: pgmap v7582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:06 smithi082 ceph-mon[94281]: pgmap v7583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:08 smithi082 ceph-mon[94281]: pgmap v7584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:09 smithi082 ceph-mon[94281]: osdmap e538: 12 total, 12 up, 12 in 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:09 smithi082 ceph-mon[94281]: pgmap v7586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:12 smithi082 ceph-mon[94281]: pgmap v7587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:14 smithi082 ceph-mon[94281]: pgmap v7588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:17.394 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:14 smithi082 ceph-mon[94281]: osdmap e539: 12 total, 12 up, 12 in 2023-03-17T12:46:19.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:19.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:19.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:19.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:15 smithi082 ceph-mon[94281]: pgmap v7590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:46:19.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:15 smithi082 ceph-mon[94281]: pgmap v7591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 191 B/s wr, 9 op/s 2023-03-17T12:46:19.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:17 smithi082 ceph-mon[94281]: pgmap v7592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:19 smithi082 ceph-mon[94281]: pgmap v7593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:21 smithi082 ceph-mon[94281]: pgmap v7594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:22 smithi082 ceph-mon[94281]: pgmap v7595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 122 B/s wr, 12 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:25 smithi082 ceph-mon[94281]: pgmap v7596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:26 smithi082 ceph-mon[94281]: pgmap v7597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:29 smithi082 ceph-mon[94281]: pgmap v7598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:31 smithi082 ceph-mon[94281]: pgmap v7599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:19.709 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:32 smithi082 ceph-mon[94281]: pgmap v7600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:21.069 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:35 smithi082 ceph-mon[94281]: pgmap v7601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.410 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:36 smithi082 ceph-mon[94281]: pgmap v7602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:39 smithi082 ceph-mon[94281]: pgmap v7603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:40 smithi082 ceph-mon[94281]: pgmap v7604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:43 smithi082 ceph-mon[94281]: pgmap v7605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:44 smithi082 ceph-mon[94281]: pgmap v7606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:47 smithi082 ceph-mon[94281]: pgmap v7607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:49 smithi082 ceph-mon[94281]: pgmap v7608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:50 smithi082 ceph-mon[94281]: pgmap v7609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:53 smithi082 ceph-mon[94281]: pgmap v7610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:54 smithi082 ceph-mon[94281]: pgmap v7611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:22.411 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:57 smithi082 ceph-mon[94281]: pgmap v7612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:24.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:35:59 smithi082 ceph-mon[94281]: pgmap v7613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:24.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:01 smithi082 ceph-mon[94281]: pgmap v7614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:24.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:03 smithi082 ceph-mon[94281]: pgmap v7615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:24.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:04 smithi082 ceph-mon[94281]: pgmap v7616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:24.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:07 smithi082 ceph-mon[94281]: pgmap v7617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:24.229 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:09 smithi082 ceph-mon[94281]: pgmap v7618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:10 smithi082 ceph-mon[94281]: osdmap e540: 12 total, 12 up, 12 in 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:11 smithi082 ceph-mon[94281]: pgmap v7620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:13 smithi082 ceph-mon[94281]: pgmap v7621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:14 smithi082 ceph-mon[94281]: osdmap e541: 12 total, 12 up, 12 in 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:14 smithi082 ceph-mon[94281]: pgmap v7623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:14 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:15 smithi082 ceph-mon[94281]: pgmap v7624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:15 smithi082 ceph-mon[94281]: pgmap v7625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 177 B/s wr, 9 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:17 smithi082 ceph-mon[94281]: pgmap v7626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:19 smithi082 ceph-mon[94281]: pgmap v7627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:21 smithi082 ceph-mon[94281]: pgmap v7628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:23 smithi082 ceph-mon[94281]: pgmap v7629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:25 smithi082 ceph-mon[94281]: pgmap v7630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:24.230 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:27 smithi082 ceph-mon[94281]: pgmap v7631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:46:24.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:29 smithi082 ceph-mon[94281]: pgmap v7632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:46:24.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:31 smithi082 ceph-mon[94281]: pgmap v7633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:24.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:33 smithi082 ceph-mon[94281]: pgmap v7634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:24.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:35 smithi082 ceph-mon[94281]: pgmap v7635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:24.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:37 smithi082 ceph-mon[94281]: pgmap v7636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:24.231 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:39 smithi082 ceph-mon[94281]: pgmap v7637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:25.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:41 smithi082 ceph-mon[94281]: pgmap v7638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:25.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:43 smithi082 ceph-mon[94281]: pgmap v7639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:25.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:45 smithi082 ceph-mon[94281]: pgmap v7640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:25.369 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:47 smithi082 ceph-mon[94281]: pgmap v7641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:25.886 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:49 smithi082 ceph-mon[94281]: pgmap v7642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:27.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:51 smithi082 ceph-mon[94281]: pgmap v7643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:27.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:53 smithi082 ceph-mon[94281]: pgmap v7644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:27.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:55 smithi082 ceph-mon[94281]: pgmap v7645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:27.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:57 smithi082 ceph-mon[94281]: pgmap v7646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:27.060 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:36:59 smithi082 ceph-mon[94281]: pgmap v7647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:01 smithi082 ceph-mon[94281]: pgmap v7648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:03 smithi082 ceph-mon[94281]: pgmap v7649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:05 smithi082 ceph-mon[94281]: pgmap v7650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:07 smithi082 ceph-mon[94281]: pgmap v7651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:09 smithi082 ceph-mon[94281]: pgmap v7652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:09 smithi082 ceph-mon[94281]: osdmap e542: 12 total, 12 up, 12 in 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:11 smithi082 ceph-mon[94281]: pgmap v7654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:27.061 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:13 smithi082 ceph-mon[94281]: pgmap v7655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:13 smithi082 ceph-mon[94281]: osdmap e543: 12 total, 12 up, 12 in 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: pgmap v7657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: pgmap v7658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:27.062 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: pgmap v7659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 151 B/s wr, 7 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:15 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:17 smithi082 ceph-mon[94281]: pgmap v7660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:19 smithi082 ceph-mon[94281]: pgmap v7661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:21 smithi082 ceph-mon[94281]: pgmap v7662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 128 B/s wr, 6 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:23 smithi082 ceph-mon[94281]: pgmap v7663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:25 smithi082 ceph-mon[94281]: pgmap v7664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:27 smithi082 ceph-mon[94281]: pgmap v7665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:29 smithi082 ceph-mon[94281]: pgmap v7666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:31 smithi082 ceph-mon[94281]: pgmap v7667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.399 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:33 smithi082 ceph-mon[94281]: pgmap v7668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:35 smithi082 ceph-mon[94281]: pgmap v7669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:37 smithi082 ceph-mon[94281]: pgmap v7670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:39 smithi082 ceph-mon[94281]: pgmap v7671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:41 smithi082 ceph-mon[94281]: pgmap v7672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:43 smithi082 ceph-mon[94281]: pgmap v7673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:45 smithi082 ceph-mon[94281]: pgmap v7674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:47 smithi082 ceph-mon[94281]: pgmap v7675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:49 smithi082 ceph-mon[94281]: pgmap v7676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:51 smithi082 ceph-mon[94281]: pgmap v7677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:53 smithi082 ceph-mon[94281]: pgmap v7678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:55 smithi082 ceph-mon[94281]: pgmap v7679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:57 smithi082 ceph-mon[94281]: pgmap v7680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:37:59 smithi082 ceph-mon[94281]: pgmap v7681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:01 smithi082 ceph-mon[94281]: pgmap v7682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:03 smithi082 ceph-mon[94281]: pgmap v7683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:05 smithi082 ceph-mon[94281]: pgmap v7684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:29.400 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:07 smithi082 ceph-mon[94281]: pgmap v7685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:29.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:09 smithi082 ceph-mon[94281]: osdmap e544: 12 total, 12 up, 12 in 2023-03-17T12:46:29.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:09 smithi082 ceph-mon[94281]: pgmap v7687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:29.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:11 smithi082 ceph-mon[94281]: pgmap v7688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:29.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:13 smithi082 ceph-mon[94281]: pgmap v7689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:29.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:15 smithi082 ceph-mon[94281]: pgmap v7690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:29.401 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:30.661 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:30.661 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:30.661 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:16 smithi082 ceph-mon[94281]: pgmap v7691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:16 smithi082 ceph-mon[94281]: pgmap v7692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 132 B/s wr, 6 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:16 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:19 smithi082 ceph-mon[94281]: pgmap v7693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:19 smithi082 ceph-mon[94281]: osdmap e545: 12 total, 12 up, 12 in 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:21 smithi082 ceph-mon[94281]: pgmap v7695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:23 smithi082 ceph-mon[94281]: pgmap v7696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:24 smithi082 ceph-mon[94281]: pgmap v7697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:27 smithi082 ceph-mon[94281]: pgmap v7698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:46:30.662 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:29 smithi082 ceph-mon[94281]: pgmap v7699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:30.663 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:31 smithi082 ceph-mon[94281]: pgmap v7700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:33 smithi082 ceph-mon[94281]: pgmap v7701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:33.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:34 smithi082 ceph-mon[94281]: pgmap v7702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:37 smithi082 ceph-mon[94281]: pgmap v7703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:39 smithi082 ceph-mon[94281]: pgmap v7704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:41 smithi082 ceph-mon[94281]: pgmap v7705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:43 smithi082 ceph-mon[94281]: pgmap v7706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:44 smithi082 ceph-mon[94281]: pgmap v7707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:47 smithi082 ceph-mon[94281]: pgmap v7708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:49 smithi082 ceph-mon[94281]: pgmap v7709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:51 smithi082 ceph-mon[94281]: pgmap v7710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:53 smithi082 ceph-mon[94281]: pgmap v7711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:54 smithi082 ceph-mon[94281]: pgmap v7712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:57 smithi082 ceph-mon[94281]: pgmap v7713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:38:59 smithi082 ceph-mon[94281]: pgmap v7714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:01 smithi082 ceph-mon[94281]: pgmap v7715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:33.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:03 smithi082 ceph-mon[94281]: pgmap v7716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:35.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:04 smithi082 ceph-mon[94281]: pgmap v7717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:35.979 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:07 smithi082 ceph-mon[94281]: pgmap v7718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:35.980 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:09 smithi082 ceph-mon[94281]: pgmap v7719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:09 smithi082 ceph-mon[94281]: osdmap e546: 12 total, 12 up, 12 in 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:11 smithi082 ceph-mon[94281]: pgmap v7721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:13 smithi082 ceph-mon[94281]: pgmap v7722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:14 smithi082 ceph-mon[94281]: osdmap e547: 12 total, 12 up, 12 in 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:14 smithi082 ceph-mon[94281]: pgmap v7724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:17 smithi082 ceph-mon[94281]: pgmap v7725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:17 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:37.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:18 smithi082 ceph-mon[94281]: pgmap v7726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:18 smithi082 ceph-mon[94281]: pgmap v7727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:19 smithi082 ceph-mon[94281]: pgmap v7728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:22 smithi082 ceph-mon[94281]: pgmap v7729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 134 B/s wr, 6 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:24 smithi082 ceph-mon[94281]: pgmap v7730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:26 smithi082 ceph-mon[94281]: pgmap v7731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:28 smithi082 ceph-mon[94281]: pgmap v7732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:29 smithi082 ceph-mon[94281]: pgmap v7733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:32 smithi082 ceph-mon[94281]: pgmap v7734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:34 smithi082 ceph-mon[94281]: pgmap v7735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:37.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:36 smithi082 ceph-mon[94281]: pgmap v7736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:37.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:38 smithi082 ceph-mon[94281]: pgmap v7737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:37.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:39 smithi082 ceph-mon[94281]: pgmap v7738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:39.631 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:42 smithi082 ceph-mon[94281]: pgmap v7739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:40.430 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:44 smithi082 ceph-mon[94281]: pgmap v7740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:42.650 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:46 smithi082 ceph-mon[94281]: pgmap v7741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:42.650 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:48 smithi082 ceph-mon[94281]: pgmap v7742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:42.650 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:49 smithi082 ceph-mon[94281]: pgmap v7743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:42.650 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:52 smithi082 ceph-mon[94281]: pgmap v7744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:42.650 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:54 smithi082 ceph-mon[94281]: pgmap v7745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:42.650 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:56 smithi082 ceph-mon[94281]: pgmap v7746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:42.651 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:58 smithi082 ceph-mon[94281]: pgmap v7747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:42.651 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:39:59 smithi082 ceph-mon[94281]: pgmap v7748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:42.651 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:00 smithi082 ceph-mon[94281]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:46:42.651 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:01 smithi082 ceph-mon[94281]: pgmap v7749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:42.651 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:04 smithi082 ceph-mon[94281]: pgmap v7750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:42.651 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:06 smithi082 ceph-mon[94281]: pgmap v7751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:43.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:08 smithi082 ceph-mon[94281]: pgmap v7752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:43.270 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:10 smithi082 ceph-mon[94281]: pgmap v7753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:46:44.003 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:10 smithi082 ceph-mon[94281]: osdmap e548: 12 total, 12 up, 12 in 2023-03-17T12:46:44.003 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:12 smithi082 ceph-mon[94281]: pgmap v7755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:14 smithi082 ceph-mon[94281]: pgmap v7756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:14 smithi082 ceph-mon[94281]: osdmap e549: 12 total, 12 up, 12 in 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:16 smithi082 ceph-mon[94281]: pgmap v7758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:18 smithi082 ceph-mon[94281]: pgmap v7759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:18 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:44.004 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:19 smithi082 ceph-mon[94281]: pgmap v7760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:19 smithi082 ceph-mon[94281]: pgmap v7761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:21 smithi082 ceph-mon[94281]: pgmap v7762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:23 smithi082 ceph-mon[94281]: pgmap v7763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 121 B/s wr, 12 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:24 smithi082 ceph-mon[94281]: pgmap v7764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:27 smithi082 ceph-mon[94281]: pgmap v7765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:29 smithi082 ceph-mon[94281]: pgmap v7766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:31 smithi082 ceph-mon[94281]: pgmap v7767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:33 smithi082 ceph-mon[94281]: pgmap v7768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:34 smithi082 ceph-mon[94281]: pgmap v7769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:37 smithi082 ceph-mon[94281]: pgmap v7770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:39 smithi082 ceph-mon[94281]: pgmap v7771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:41 smithi082 ceph-mon[94281]: pgmap v7772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:46:44.005 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:43 smithi082 ceph-mon[94281]: pgmap v7773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:46.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:44 smithi082 ceph-mon[94281]: pgmap v7774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:46:46.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:47 smithi082 ceph-mon[94281]: pgmap v7775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:46:48.996 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:49 smithi082 ceph-mon[94281]: pgmap v7776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:48.996 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:51 smithi082 ceph-mon[94281]: pgmap v7777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:48.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:53 smithi082 ceph-mon[94281]: pgmap v7778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:48.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:54 smithi082 ceph-mon[94281]: pgmap v7779: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:48.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:57 smithi082 ceph-mon[94281]: pgmap v7780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:48.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:40:59 smithi082 ceph-mon[94281]: pgmap v7781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:48.997 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:01 smithi082 ceph-mon[94281]: pgmap v7782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:03 smithi082 ceph-mon[94281]: pgmap v7783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:04 smithi082 ceph-mon[94281]: pgmap v7784: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:07 smithi082 ceph-mon[94281]: pgmap v7785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:09 smithi082 ceph-mon[94281]: pgmap v7786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:10 smithi082 ceph-mon[94281]: osdmap e550: 12 total, 12 up, 12 in 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:11 smithi082 ceph-mon[94281]: pgmap v7788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:13 smithi082 ceph-mon[94281]: pgmap v7789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:14 smithi082 ceph-mon[94281]: osdmap e551: 12 total, 12 up, 12 in 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:14 smithi082 ceph-mon[94281]: pgmap v7791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:46:51.118 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:17 smithi082 ceph-mon[94281]: pgmap v7792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:19 smithi082 ceph-mon[94281]: pgmap v7793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:19 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:46:52.489 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:20 smithi082 ceph-mon[94281]: pgmap v7794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:46:52.490 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:20 smithi082 ceph-mon[94281]: pgmap v7795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:46:54.956 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:20 smithi082 ceph-mon[94281]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:46:54.956 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:22 smithi082 ceph-mon[94281]: pgmap v7796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 132 B/s wr, 6 op/s 2023-03-17T12:46:54.956 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:24 smithi082 ceph-mon[94281]: pgmap v7797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:26 smithi082 ceph-mon[94281]: pgmap v7798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:28 smithi082 ceph-mon[94281]: pgmap v7799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:29 smithi082 ceph-mon[94281]: pgmap v7800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:32 smithi082 ceph-mon[94281]: pgmap v7801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:34 smithi082 ceph-mon[94281]: pgmap v7802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:36 smithi082 ceph-mon[94281]: pgmap v7803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:38 smithi082 ceph-mon[94281]: pgmap v7804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:39 smithi082 ceph-mon[94281]: pgmap v7805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:42 smithi082 ceph-mon[94281]: pgmap v7806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:44 smithi082 ceph-mon[94281]: pgmap v7807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:46 smithi082 ceph-mon[94281]: pgmap v7808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:48 smithi082 ceph-mon[94281]: pgmap v7809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:49 smithi082 ceph-mon[94281]: pgmap v7810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:52 smithi082 ceph-mon[94281]: pgmap v7811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:46:54.957 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:54 smithi082 ceph-mon[94281]: pgmap v7812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:54.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:56 smithi082 ceph-mon[94281]: pgmap v7813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:46:54.958 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:58 smithi082 ceph-mon[94281]: pgmap v7814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:57.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:41:59 smithi082 ceph-mon[94281]: pgmap v7815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:57.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:42:02 smithi082 ceph-mon[94281]: pgmap v7816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:57.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:42:04 smithi082 ceph-mon[94281]: pgmap v7817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:57.178 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:42:06 smithi082 ceph-mon[94281]: pgmap v7818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:46:58.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:42:08 smithi082 ceph-mon[94281]: pgmap v7819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:46:58.698 INFO:journalctl@ceph.mon.c.smithi082.stdout:Mar 17 12:42:09 smithi082 ceph-mon[94281]: osdmap e552: 12 total, 12 up, 12 in 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:40 smithi078 ceph-mon[94114]: pgmap v7402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:42 smithi078 ceph-mon[94114]: pgmap v7403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:44 smithi078 ceph-mon[94114]: pgmap v7404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:46 smithi078 ceph-mon[94114]: pgmap v7405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:48 smithi078 ceph-mon[94114]: pgmap v7406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:50 smithi078 ceph-mon[94114]: pgmap v7407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:52 smithi078 ceph-mon[94114]: pgmap v7408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:54 smithi078 ceph-mon[94114]: pgmap v7409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:56 smithi078 ceph-mon[94114]: pgmap v7410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:29:58 smithi078 ceph-mon[94114]: pgmap v7411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:00 smithi078 ceph-mon[94114]: pgmap v7412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:46:58.700 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:47:01.951 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:02 smithi078 ceph-mon[94114]: pgmap v7413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:04.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:04 smithi078 ceph-mon[94114]: pgmap v7414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:04.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:05 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:04.725 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:06 smithi078 ceph-mon[94114]: pgmap v7415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:07 smithi078 ceph-mon[94114]: pgmap v7416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:07 smithi078 ceph-mon[94114]: pgmap v7417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:09 smithi078 ceph-mon[94114]: pgmap v7418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:09 smithi078 ceph-mon[94114]: osdmap e528: 12 total, 12 up, 12 in 2023-03-17T12:47:06.634 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:10 smithi078 ceph-mon[94114]: pgmap v7420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:12 smithi078 ceph-mon[94114]: pgmap v7421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:15 smithi078 ceph-mon[94114]: pgmap v7422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:17 smithi078 ceph-mon[94114]: pgmap v7423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:19 smithi078 ceph-mon[94114]: pgmap v7424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:19 smithi078 ceph-mon[94114]: osdmap e529: 12 total, 12 up, 12 in 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:21 smithi078 ceph-mon[94114]: pgmap v7426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:23 smithi078 ceph-mon[94114]: pgmap v7427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:25 smithi078 ceph-mon[94114]: pgmap v7428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:06.635 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:27 smithi078 ceph-mon[94114]: pgmap v7429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:29 smithi078 ceph-mon[94114]: pgmap v7430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:31 smithi078 ceph-mon[94114]: pgmap v7431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:33 smithi078 ceph-mon[94114]: pgmap v7432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:35 smithi078 ceph-mon[94114]: pgmap v7433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:37 smithi078 ceph-mon[94114]: pgmap v7434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:39 smithi078 ceph-mon[94114]: pgmap v7435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:41 smithi078 ceph-mon[94114]: pgmap v7436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.909 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:43 smithi078 ceph-mon[94114]: pgmap v7437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:44 smithi078 ceph-mon[94114]: pgmap v7438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:46 smithi078 ceph-mon[94114]: pgmap v7439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:49 smithi078 ceph-mon[94114]: pgmap v7440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:51 smithi078 ceph-mon[94114]: pgmap v7441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:53 smithi078 ceph-mon[94114]: pgmap v7442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:55 smithi078 ceph-mon[94114]: pgmap v7443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:57 smithi078 ceph-mon[94114]: pgmap v7444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:30:59 smithi078 ceph-mon[94114]: pgmap v7445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:01 smithi078 ceph-mon[94114]: pgmap v7446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:03 smithi078 ceph-mon[94114]: pgmap v7447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:05 smithi078 ceph-mon[94114]: pgmap v7448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:06 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:07 smithi078 ceph-mon[94114]: pgmap v7449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:09.910 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:08 smithi078 ceph-mon[94114]: pgmap v7450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 27 op/s 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:08 smithi078 ceph-mon[94114]: pgmap v7451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:09 smithi078 ceph-mon[94114]: osdmap e530: 12 total, 12 up, 12 in 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:09 smithi078 ceph-mon[94114]: pgmap v7453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 73 KiB/s wr, 38 op/s 2023-03-17T12:47:09.911 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:11 smithi078 ceph-mon[94114]: pgmap v7454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:47:11.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:14 smithi078 ceph-mon[94114]: pgmap v7455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 281 B/s wr, 14 op/s 2023-03-17T12:47:11.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:14 smithi078 ceph-mon[94114]: osdmap e531: 12 total, 12 up, 12 in 2023-03-17T12:47:11.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:16 smithi078 ceph-mon[94114]: pgmap v7457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-17T12:47:11.231 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:18 smithi078 ceph-mon[94114]: pgmap v7458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 123 B/s wr, 11 op/s 2023-03-17T12:47:11.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:20 smithi078 ceph-mon[94114]: pgmap v7459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:11.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:22 smithi078 ceph-mon[94114]: pgmap v7460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:11.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:24 smithi078 ceph-mon[94114]: pgmap v7461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:11.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:26 smithi078 ceph-mon[94114]: pgmap v7462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 8 op/s 2023-03-17T12:47:12.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:28 smithi078 ceph-mon[94114]: pgmap v7463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-17T12:47:12.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:30 smithi078 ceph-mon[94114]: pgmap v7464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T12:47:12.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:32 smithi078 ceph-mon[94114]: pgmap v7465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:12.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:34 smithi078 ceph-mon[94114]: pgmap v7466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:12.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:36 smithi078 ceph-mon[94114]: pgmap v7467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:12.435 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:37 smithi078 ceph-mon[94114]: pgmap v7468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:47:12.436 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:40 smithi078 ceph-mon[94114]: pgmap v7469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:42 smithi078 ceph-mon[94114]: pgmap v7470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:44 smithi078 ceph-mon[94114]: pgmap v7471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:46 smithi078 ceph-mon[94114]: pgmap v7472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:48 smithi078 ceph-mon[94114]: pgmap v7473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:50 smithi078 ceph-mon[94114]: pgmap v7474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:52 smithi078 ceph-mon[94114]: pgmap v7475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-17T12:47:13.691 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:54 smithi078 ceph-mon[94114]: pgmap v7476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:47:13.692 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:56 smithi078 ceph-mon[94114]: pgmap v7477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:15.519 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:31:58 smithi078 ceph-mon[94114]: pgmap v7478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T12:47:17.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:00 smithi078 ceph-mon[94114]: pgmap v7479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:17.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:01 smithi078 ceph-mon[94114]: pgmap v7480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:17.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:04 smithi078 ceph-mon[94114]: pgmap v7481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:47:17.499 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:06 smithi078 ceph-mon[94114]: pgmap v7482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:17.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:17.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:07 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:08 smithi078 ceph-mon[94114]: pgmap v7483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:47:17.500 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:09 smithi078 ceph-mon[94114]: osdmap e532: 12 total, 12 up, 12 in 2023-03-17T12:47:17.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: pgmap v7485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:17.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.882 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:17.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:17.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:17.883 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.845 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:10 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:18.846 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:11 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:12 smithi078 ceph-mon[94114]: pgmap v7486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:12 smithi078 ceph-mon[94114]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:12 smithi078 ceph-mon[94114]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:12 smithi078 ceph-mon[94114]: pgmap v7487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:12 smithi078 ceph-mon[94114]: pgmap v7488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 169 B/s wr, 8 op/s 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:14 smithi078 ceph-mon[94114]: pgmap v7489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 338 B/s wr, 10 op/s 2023-03-17T12:47:19.363 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:16 smithi078 ceph-mon[94114]: pgmap v7490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 160 B/s wr, 8 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:18 smithi078 ceph-mon[94114]: pgmap v7491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 254 B/s wr, 12 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:18 smithi078 ceph-mon[94114]: osdmap e533: 12 total, 12 up, 12 in 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:20 smithi078 ceph-mon[94114]: pgmap v7493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:22 smithi078 ceph-mon[94114]: pgmap v7494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:24 smithi078 ceph-mon[94114]: pgmap v7495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:26 smithi078 ceph-mon[94114]: pgmap v7496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:28 smithi078 ceph-mon[94114]: pgmap v7497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:30 smithi078 ceph-mon[94114]: pgmap v7498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:31 smithi078 ceph-mon[94114]: pgmap v7499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:34 smithi078 ceph-mon[94114]: pgmap v7500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:36 smithi078 ceph-mon[94114]: pgmap v7501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:38 smithi078 ceph-mon[94114]: pgmap v7502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:40 smithi078 ceph-mon[94114]: pgmap v7503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:42 smithi078 ceph-mon[94114]: pgmap v7504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:44 smithi078 ceph-mon[94114]: pgmap v7505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:46 smithi078 ceph-mon[94114]: pgmap v7506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.364 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:48 smithi078 ceph-mon[94114]: pgmap v7507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:49 smithi078 ceph-mon[94114]: pgmap v7508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:52 smithi078 ceph-mon[94114]: pgmap v7509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:54 smithi078 ceph-mon[94114]: pgmap v7510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:56 smithi078 ceph-mon[94114]: pgmap v7511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:32:58 smithi078 ceph-mon[94114]: pgmap v7512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:00 smithi078 ceph-mon[94114]: pgmap v7513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:02 smithi078 ceph-mon[94114]: pgmap v7514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:04 smithi078 ceph-mon[94114]: pgmap v7515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:19.365 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:06 smithi078 ceph-mon[94114]: pgmap v7516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:19.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:08 smithi078 ceph-mon[94114]: pgmap v7517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:19.710 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:09 smithi078 ceph-mon[94114]: osdmap e534: 12 total, 12 up, 12 in 2023-03-17T12:47:20.052 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:09 smithi078 ceph-mon[94114]: pgmap v7519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:20.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:12 smithi078 ceph-mon[94114]: pgmap v7520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:20.459 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:13 smithi078 ceph-mon[94114]: pgmap v7521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:13 smithi078 ceph-mon[94114]: pgmap v7522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:15 smithi078 ceph-mon[94114]: pgmap v7523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:17 smithi078 ceph-mon[94114]: pgmap v7524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:19 smithi078 ceph-mon[94114]: pgmap v7525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:47:20.460 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:19 smithi078 ceph-mon[94114]: osdmap e535: 12 total, 12 up, 12 in 2023-03-17T12:47:20.461 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:21 smithi078 ceph-mon[94114]: pgmap v7527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:21.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:23 smithi078 ceph-mon[94114]: pgmap v7528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:21.969 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:25 smithi078 ceph-mon[94114]: pgmap v7529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:27 smithi078 ceph-mon[94114]: pgmap v7530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:29 smithi078 ceph-mon[94114]: pgmap v7531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:31 smithi078 ceph-mon[94114]: pgmap v7532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:33 smithi078 ceph-mon[94114]: pgmap v7533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:34 smithi078 ceph-mon[94114]: pgmap v7534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:36 smithi078 ceph-mon[94114]: pgmap v7535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:39 smithi078 ceph-mon[94114]: pgmap v7536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:41 smithi078 ceph-mon[94114]: pgmap v7537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.970 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:43 smithi078 ceph-mon[94114]: pgmap v7538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:45 smithi078 ceph-mon[94114]: pgmap v7539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:47 smithi078 ceph-mon[94114]: pgmap v7540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:49 smithi078 ceph-mon[94114]: pgmap v7541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:50 smithi078 ceph-mon[94114]: pgmap v7542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:52 smithi078 ceph-mon[94114]: pgmap v7543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:55 smithi078 ceph-mon[94114]: pgmap v7544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:57 smithi078 ceph-mon[94114]: pgmap v7545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:33:59 smithi078 ceph-mon[94114]: pgmap v7546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:21.971 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:01 smithi078 ceph-mon[94114]: pgmap v7547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.972 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:02 smithi078 ceph-mon[94114]: pgmap v7548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:21.972 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:05 smithi078 ceph-mon[94114]: pgmap v7549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:21.972 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:07 smithi078 ceph-mon[94114]: pgmap v7550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:21.972 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:09 smithi078 ceph-mon[94114]: pgmap v7551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:21.972 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:09 smithi078 ceph-mon[94114]: osdmap e536: 12 total, 12 up, 12 in 2023-03-17T12:47:22.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:10 smithi078 ceph-mon[94114]: pgmap v7553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:22.839 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:12 smithi078 ceph-mon[94114]: pgmap v7554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:22.840 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:12 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:13 smithi078 ceph-mon[94114]: pgmap v7555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:13 smithi078 ceph-mon[94114]: pgmap v7556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:13 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:16 smithi078 ceph-mon[94114]: pgmap v7557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:47:23.448 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:18 smithi078 ceph-mon[94114]: pgmap v7558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-17T12:47:23.449 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:19 smithi078 ceph-mon[94114]: osdmap e537: 12 total, 12 up, 12 in 2023-03-17T12:47:24.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:20 smithi078 ceph-mon[94114]: pgmap v7560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:47:24.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:22 smithi078 ceph-mon[94114]: pgmap v7561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:47:24.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:24 smithi078 ceph-mon[94114]: pgmap v7562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:24.926 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:25 smithi078 ceph-mon[94114]: pgmap v7563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:28 smithi078 ceph-mon[94114]: pgmap v7564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:30 smithi078 ceph-mon[94114]: pgmap v7565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:32 smithi078 ceph-mon[94114]: pgmap v7566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:34 smithi078 ceph-mon[94114]: pgmap v7567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:36 smithi078 ceph-mon[94114]: pgmap v7568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:37 smithi078 ceph-mon[94114]: pgmap v7569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:40 smithi078 ceph-mon[94114]: pgmap v7570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:42 smithi078 ceph-mon[94114]: pgmap v7571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:44 smithi078 ceph-mon[94114]: pgmap v7572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:45 smithi078 ceph-mon[94114]: pgmap v7573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:48 smithi078 ceph-mon[94114]: pgmap v7574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:50 smithi078 ceph-mon[94114]: pgmap v7575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.927 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:52 smithi078 ceph-mon[94114]: pgmap v7576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:54 smithi078 ceph-mon[94114]: pgmap v7577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:56 smithi078 ceph-mon[94114]: pgmap v7578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:58 smithi078 ceph-mon[94114]: pgmap v7579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:34:59 smithi078 ceph-mon[94114]: pgmap v7580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:02 smithi078 ceph-mon[94114]: pgmap v7581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:04 smithi078 ceph-mon[94114]: pgmap v7582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:06 smithi078 ceph-mon[94114]: pgmap v7583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:08 smithi078 ceph-mon[94114]: pgmap v7584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:24.928 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:09 smithi078 ceph-mon[94114]: osdmap e538: 12 total, 12 up, 12 in 2023-03-17T12:47:24.929 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:09 smithi078 ceph-mon[94114]: pgmap v7586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:26.486 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:12 smithi078 ceph-mon[94114]: pgmap v7587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:26.487 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:14 smithi078 ceph-mon[94114]: pgmap v7588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:14 smithi078 ceph-mon[94114]: osdmap e539: 12 total, 12 up, 12 in 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:15 smithi078 ceph-mon[94114]: pgmap v7590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:47:28.552 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:15 smithi078 ceph-mon[94114]: pgmap v7591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 191 B/s wr, 9 op/s 2023-03-17T12:47:28.553 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:17 smithi078 ceph-mon[94114]: pgmap v7592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:47:29.497 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:19 smithi078 ceph-mon[94114]: pgmap v7593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:47:32.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:21 smithi078 ceph-mon[94114]: pgmap v7594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:47:32.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:22 smithi078 ceph-mon[94114]: pgmap v7595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 122 B/s wr, 12 op/s 2023-03-17T12:47:32.835 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:25 smithi078 ceph-mon[94114]: pgmap v7596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:26 smithi078 ceph-mon[94114]: pgmap v7597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:29 smithi078 ceph-mon[94114]: pgmap v7598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:31 smithi078 ceph-mon[94114]: pgmap v7599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:32 smithi078 ceph-mon[94114]: pgmap v7600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:35 smithi078 ceph-mon[94114]: pgmap v7601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:36 smithi078 ceph-mon[94114]: pgmap v7602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:39 smithi078 ceph-mon[94114]: pgmap v7603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:32.836 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:40 smithi078 ceph-mon[94114]: pgmap v7604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:32.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:43 smithi078 ceph-mon[94114]: pgmap v7605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:32.837 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:44 smithi078 ceph-mon[94114]: pgmap v7606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:35.311 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:47 smithi078 ceph-mon[94114]: pgmap v7607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:35.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:49 smithi078 ceph-mon[94114]: pgmap v7608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:35.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:50 smithi078 ceph-mon[94114]: pgmap v7609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:35.925 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:53 smithi078 ceph-mon[94114]: pgmap v7610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:37.608 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:54 smithi078 ceph-mon[94114]: pgmap v7611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:37.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:57 smithi078 ceph-mon[94114]: pgmap v7612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:37.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:35:59 smithi078 ceph-mon[94114]: pgmap v7613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:37.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:01 smithi078 ceph-mon[94114]: pgmap v7614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:37.609 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:03 smithi078 ceph-mon[94114]: pgmap v7615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:39.254 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:04 smithi078 ceph-mon[94114]: pgmap v7616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:39.254 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:07 smithi078 ceph-mon[94114]: pgmap v7617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:39.254 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:09 smithi078 ceph-mon[94114]: pgmap v7618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:39.254 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:10 smithi078 ceph-mon[94114]: osdmap e540: 12 total, 12 up, 12 in 2023-03-17T12:47:39.254 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:11 smithi078 ceph-mon[94114]: pgmap v7620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:40.119 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:13 smithi078 ceph-mon[94114]: pgmap v7621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:40.119 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:14 smithi078 ceph-mon[94114]: osdmap e541: 12 total, 12 up, 12 in 2023-03-17T12:47:40.119 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:14 smithi078 ceph-mon[94114]: pgmap v7623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:40.119 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:14 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:15 smithi078 ceph-mon[94114]: pgmap v7624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:15 smithi078 ceph-mon[94114]: pgmap v7625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 177 B/s wr, 9 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:17 smithi078 ceph-mon[94114]: pgmap v7626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:19 smithi078 ceph-mon[94114]: pgmap v7627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:21 smithi078 ceph-mon[94114]: pgmap v7628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:23 smithi078 ceph-mon[94114]: pgmap v7629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:25 smithi078 ceph-mon[94114]: pgmap v7630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:27 smithi078 ceph-mon[94114]: pgmap v7631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:29 smithi078 ceph-mon[94114]: pgmap v7632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:47:43.133 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:31 smithi078 ceph-mon[94114]: pgmap v7633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:43.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:33 smithi078 ceph-mon[94114]: pgmap v7634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:43.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:35 smithi078 ceph-mon[94114]: pgmap v7635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:43.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:37 smithi078 ceph-mon[94114]: pgmap v7636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:43.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:39 smithi078 ceph-mon[94114]: pgmap v7637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:43.134 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:41 smithi078 ceph-mon[94114]: pgmap v7638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:43 smithi078 ceph-mon[94114]: pgmap v7639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:44.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:45 smithi078 ceph-mon[94114]: pgmap v7640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:47 smithi078 ceph-mon[94114]: pgmap v7641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:49 smithi078 ceph-mon[94114]: pgmap v7642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:44.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:51 smithi078 ceph-mon[94114]: pgmap v7643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.514 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:53 smithi078 ceph-mon[94114]: pgmap v7644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:55 smithi078 ceph-mon[94114]: pgmap v7645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:57 smithi078 ceph-mon[94114]: pgmap v7646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:36:59 smithi078 ceph-mon[94114]: pgmap v7647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:01 smithi078 ceph-mon[94114]: pgmap v7648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:03 smithi078 ceph-mon[94114]: pgmap v7649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:05 smithi078 ceph-mon[94114]: pgmap v7650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:07 smithi078 ceph-mon[94114]: pgmap v7651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:09 smithi078 ceph-mon[94114]: pgmap v7652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:09 smithi078 ceph-mon[94114]: osdmap e542: 12 total, 12 up, 12 in 2023-03-17T12:47:44.515 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:11 smithi078 ceph-mon[94114]: pgmap v7654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:13 smithi078 ceph-mon[94114]: pgmap v7655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:13 smithi078 ceph-mon[94114]: osdmap e543: 12 total, 12 up, 12 in 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: pgmap v7657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: pgmap v7658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: pgmap v7659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 151 B/s wr, 7 op/s 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:15 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:17 smithi078 ceph-mon[94114]: pgmap v7660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:47:46.238 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:19 smithi078 ceph-mon[94114]: pgmap v7661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:21 smithi078 ceph-mon[94114]: pgmap v7662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 128 B/s wr, 6 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:23 smithi078 ceph-mon[94114]: pgmap v7663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:25 smithi078 ceph-mon[94114]: pgmap v7664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:27 smithi078 ceph-mon[94114]: pgmap v7665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:29 smithi078 ceph-mon[94114]: pgmap v7666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:31 smithi078 ceph-mon[94114]: pgmap v7667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:33 smithi078 ceph-mon[94114]: pgmap v7668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:35 smithi078 ceph-mon[94114]: pgmap v7669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:37 smithi078 ceph-mon[94114]: pgmap v7670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:39 smithi078 ceph-mon[94114]: pgmap v7671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:41 smithi078 ceph-mon[94114]: pgmap v7672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:46.239 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:43 smithi078 ceph-mon[94114]: pgmap v7673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:45 smithi078 ceph-mon[94114]: pgmap v7674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:47 smithi078 ceph-mon[94114]: pgmap v7675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:49 smithi078 ceph-mon[94114]: pgmap v7676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:51 smithi078 ceph-mon[94114]: pgmap v7677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:53 smithi078 ceph-mon[94114]: pgmap v7678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:55 smithi078 ceph-mon[94114]: pgmap v7679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:57 smithi078 ceph-mon[94114]: pgmap v7680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:37:59 smithi078 ceph-mon[94114]: pgmap v7681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:01 smithi078 ceph-mon[94114]: pgmap v7682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:03 smithi078 ceph-mon[94114]: pgmap v7683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:05 smithi078 ceph-mon[94114]: pgmap v7684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:07 smithi078 ceph-mon[94114]: pgmap v7685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:09 smithi078 ceph-mon[94114]: osdmap e544: 12 total, 12 up, 12 in 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:09 smithi078 ceph-mon[94114]: pgmap v7687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:47.645 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:11 smithi078 ceph-mon[94114]: pgmap v7688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:13 smithi078 ceph-mon[94114]: pgmap v7689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:15 smithi078 ceph-mon[94114]: pgmap v7690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:16 smithi078 ceph-mon[94114]: pgmap v7691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:16 smithi078 ceph-mon[94114]: pgmap v7692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 132 B/s wr, 6 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:16 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:19 smithi078 ceph-mon[94114]: pgmap v7693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:19 smithi078 ceph-mon[94114]: osdmap e545: 12 total, 12 up, 12 in 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:21 smithi078 ceph-mon[94114]: pgmap v7695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:23 smithi078 ceph-mon[94114]: pgmap v7696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:24 smithi078 ceph-mon[94114]: pgmap v7697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:27 smithi078 ceph-mon[94114]: pgmap v7698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:47:47.646 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:29 smithi078 ceph-mon[94114]: pgmap v7699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:49.100 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:31 smithi078 ceph-mon[94114]: pgmap v7700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:49.100 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:33 smithi078 ceph-mon[94114]: pgmap v7701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:49.101 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:34 smithi078 ceph-mon[94114]: pgmap v7702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:49.101 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:37 smithi078 ceph-mon[94114]: pgmap v7703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:49.101 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:39 smithi078 ceph-mon[94114]: pgmap v7704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:49.101 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:41 smithi078 ceph-mon[94114]: pgmap v7705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:49.101 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:43 smithi078 ceph-mon[94114]: pgmap v7706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:49.101 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:44 smithi078 ceph-mon[94114]: pgmap v7707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:52.197 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:47 smithi078 ceph-mon[94114]: pgmap v7708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:54.025 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:49 smithi078 ceph-mon[94114]: pgmap v7709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:54.026 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:51 smithi078 ceph-mon[94114]: pgmap v7710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:55.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:53 smithi078 ceph-mon[94114]: pgmap v7711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:55.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:54 smithi078 ceph-mon[94114]: pgmap v7712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:55.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:57 smithi078 ceph-mon[94114]: pgmap v7713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:55.568 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:38:59 smithi078 ceph-mon[94114]: pgmap v7714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:01 smithi078 ceph-mon[94114]: pgmap v7715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:03 smithi078 ceph-mon[94114]: pgmap v7716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:04 smithi078 ceph-mon[94114]: pgmap v7717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:07 smithi078 ceph-mon[94114]: pgmap v7718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:09 smithi078 ceph-mon[94114]: pgmap v7719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:09 smithi078 ceph-mon[94114]: osdmap e546: 12 total, 12 up, 12 in 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:11 smithi078 ceph-mon[94114]: pgmap v7721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:55.569 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:13 smithi078 ceph-mon[94114]: pgmap v7722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:55.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:14 smithi078 ceph-mon[94114]: osdmap e547: 12 total, 12 up, 12 in 2023-03-17T12:47:55.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:14 smithi078 ceph-mon[94114]: pgmap v7724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:55.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:17 smithi078 ceph-mon[94114]: pgmap v7725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:47:55.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:55.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:55.570 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:56.889 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:17 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:18 smithi078 ceph-mon[94114]: pgmap v7726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:18 smithi078 ceph-mon[94114]: pgmap v7727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:19 smithi078 ceph-mon[94114]: pgmap v7728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:22 smithi078 ceph-mon[94114]: pgmap v7729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 134 B/s wr, 6 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:24 smithi078 ceph-mon[94114]: pgmap v7730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:26 smithi078 ceph-mon[94114]: pgmap v7731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:28 smithi078 ceph-mon[94114]: pgmap v7732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:56.890 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:29 smithi078 ceph-mon[94114]: pgmap v7733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:57.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:32 smithi078 ceph-mon[94114]: pgmap v7734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:57.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:34 smithi078 ceph-mon[94114]: pgmap v7735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:57.619 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:36 smithi078 ceph-mon[94114]: pgmap v7736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:38 smithi078 ceph-mon[94114]: pgmap v7737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:39 smithi078 ceph-mon[94114]: pgmap v7738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:42 smithi078 ceph-mon[94114]: pgmap v7739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:44 smithi078 ceph-mon[94114]: pgmap v7740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:46 smithi078 ceph-mon[94114]: pgmap v7741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:48 smithi078 ceph-mon[94114]: pgmap v7742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.916 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:49 smithi078 ceph-mon[94114]: pgmap v7743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:52 smithi078 ceph-mon[94114]: pgmap v7744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:54 smithi078 ceph-mon[94114]: pgmap v7745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:56 smithi078 ceph-mon[94114]: pgmap v7746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:58 smithi078 ceph-mon[94114]: pgmap v7747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:39:59 smithi078 ceph-mon[94114]: pgmap v7748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:00 smithi078 ceph-mon[94114]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:01 smithi078 ceph-mon[94114]: pgmap v7749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:04 smithi078 ceph-mon[94114]: pgmap v7750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:06 smithi078 ceph-mon[94114]: pgmap v7751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:08 smithi078 ceph-mon[94114]: pgmap v7752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:10 smithi078 ceph-mon[94114]: pgmap v7753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:10 smithi078 ceph-mon[94114]: osdmap e548: 12 total, 12 up, 12 in 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:12 smithi078 ceph-mon[94114]: pgmap v7755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:14 smithi078 ceph-mon[94114]: pgmap v7756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:14 smithi078 ceph-mon[94114]: osdmap e549: 12 total, 12 up, 12 in 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:16 smithi078 ceph-mon[94114]: pgmap v7758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:47:58.917 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:18 smithi078 ceph-mon[94114]: pgmap v7759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:18 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:19 smithi078 ceph-mon[94114]: pgmap v7760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:19 smithi078 ceph-mon[94114]: pgmap v7761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:21 smithi078 ceph-mon[94114]: pgmap v7762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:23 smithi078 ceph-mon[94114]: pgmap v7763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 121 B/s wr, 12 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:24 smithi078 ceph-mon[94114]: pgmap v7764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:27 smithi078 ceph-mon[94114]: pgmap v7765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:29 smithi078 ceph-mon[94114]: pgmap v7766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:31 smithi078 ceph-mon[94114]: pgmap v7767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:33 smithi078 ceph-mon[94114]: pgmap v7768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:34 smithi078 ceph-mon[94114]: pgmap v7769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:37 smithi078 ceph-mon[94114]: pgmap v7770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:39 smithi078 ceph-mon[94114]: pgmap v7771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.918 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:41 smithi078 ceph-mon[94114]: pgmap v7772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:43 smithi078 ceph-mon[94114]: pgmap v7773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:44 smithi078 ceph-mon[94114]: pgmap v7774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:47 smithi078 ceph-mon[94114]: pgmap v7775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:49 smithi078 ceph-mon[94114]: pgmap v7776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:51 smithi078 ceph-mon[94114]: pgmap v7777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:53 smithi078 ceph-mon[94114]: pgmap v7778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:54 smithi078 ceph-mon[94114]: pgmap v7779: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:57 smithi078 ceph-mon[94114]: pgmap v7780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:47:58.919 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:40:59 smithi078 ceph-mon[94114]: pgmap v7781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:00.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:01 smithi078 ceph-mon[94114]: pgmap v7782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:00.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:03 smithi078 ceph-mon[94114]: pgmap v7783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:00.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:04 smithi078 ceph-mon[94114]: pgmap v7784: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:00.947 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:07 smithi078 ceph-mon[94114]: pgmap v7785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:01.530 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:09 smithi078 ceph-mon[94114]: pgmap v7786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:01.530 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:10 smithi078 ceph-mon[94114]: osdmap e550: 12 total, 12 up, 12 in 2023-03-17T12:48:01.530 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:11 smithi078 ceph-mon[94114]: pgmap v7788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:01.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:13 smithi078 ceph-mon[94114]: pgmap v7789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:01.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:14 smithi078 ceph-mon[94114]: osdmap e551: 12 total, 12 up, 12 in 2023-03-17T12:48:01.531 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:14 smithi078 ceph-mon[94114]: pgmap v7791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:02.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:17 smithi078 ceph-mon[94114]: pgmap v7792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:48:02.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:19 smithi078 ceph-mon[94114]: pgmap v7793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:48:02.825 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:19 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:20 smithi078 ceph-mon[94114]: pgmap v7794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:20 smithi078 ceph-mon[94114]: pgmap v7795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:20 smithi078 ceph-mon[94114]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:02.826 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:22 smithi078 ceph-mon[94114]: pgmap v7796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 132 B/s wr, 6 op/s 2023-03-17T12:48:02.827 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:24 smithi078 ceph-mon[94114]: pgmap v7797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:48:02.827 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:26 smithi078 ceph-mon[94114]: pgmap v7798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:48:02.827 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:28 smithi078 ceph-mon[94114]: pgmap v7799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:48:04.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:29 smithi078 ceph-mon[94114]: pgmap v7800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:04.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:32 smithi078 ceph-mon[94114]: pgmap v7801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:04.464 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:34 smithi078 ceph-mon[94114]: pgmap v7802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:04.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:36 smithi078 ceph-mon[94114]: pgmap v7803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:04.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:38 smithi078 ceph-mon[94114]: pgmap v7804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:04.465 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:39 smithi078 ceph-mon[94114]: pgmap v7805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:05.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:42 smithi078 ceph-mon[94114]: pgmap v7806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:05.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:44 smithi078 ceph-mon[94114]: pgmap v7807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:05.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:46 smithi078 ceph-mon[94114]: pgmap v7808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:05.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:48 smithi078 ceph-mon[94114]: pgmap v7809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:05.017 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:49 smithi078 ceph-mon[94114]: pgmap v7810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:52 smithi078 ceph-mon[94114]: pgmap v7811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:54 smithi078 ceph-mon[94114]: pgmap v7812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:56 smithi078 ceph-mon[94114]: pgmap v7813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:58 smithi078 ceph-mon[94114]: pgmap v7814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:41:59 smithi078 ceph-mon[94114]: pgmap v7815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:42:02 smithi078 ceph-mon[94114]: pgmap v7816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:42:04 smithi078 ceph-mon[94114]: pgmap v7817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:42:06 smithi078 ceph-mon[94114]: pgmap v7818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:42:08 smithi078 ceph-mon[94114]: pgmap v7819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:05.018 INFO:journalctl@ceph.mon.b.smithi078.stdout:Mar 17 12:42:09 smithi078 ceph-mon[94114]: osdmap e552: 12 total, 12 up, 12 in 2023-03-17T12:48:05.021 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:53 smithi035 ceph-mon[92535]: pgmap v7308: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:55 smithi035 ceph-mon[92535]: pgmap v7309: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:57 smithi035 ceph-mon[92535]: pgmap v7310: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:26:59 smithi035 ceph-mon[92535]: pgmap v7311: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:01 smithi035 ceph-mon[92535]: pgmap v7312: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:02 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:03 smithi035 ceph-mon[92535]: pgmap v7313: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:06.944 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:06.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:06.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:04 smithi035 ceph-mon[92535]: pgmap v7314: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:48:06.945 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:04 smithi035 ceph-mon[92535]: pgmap v7315: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:48:07.592 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:06 smithi035 ceph-mon[92535]: pgmap v7316: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:08 smithi035 ceph-mon[92535]: pgmap v7317: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:09 smithi035 ceph-mon[92535]: osdmap e522: 12 total, 12 up, 12 in 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:10 smithi035 ceph-mon[92535]: pgmap v7319: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:12 smithi035 ceph-mon[92535]: pgmap v7320: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:14 smithi035 ceph-mon[92535]: pgmap v7321: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:16 smithi035 ceph-mon[92535]: pgmap v7322: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:18 smithi035 ceph-mon[92535]: pgmap v7323: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:18 smithi035 ceph-mon[92535]: osdmap e523: 12 total, 12 up, 12 in 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:20 smithi035 ceph-mon[92535]: pgmap v7325: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:22 smithi035 ceph-mon[92535]: pgmap v7326: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:07.593 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:24 smithi035 ceph-mon[92535]: pgmap v7327: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:26 smithi035 ceph-mon[92535]: pgmap v7328: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:28 smithi035 ceph-mon[92535]: pgmap v7329: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:30 smithi035 ceph-mon[92535]: pgmap v7330: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:32 smithi035 ceph-mon[92535]: pgmap v7331: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:34 smithi035 ceph-mon[92535]: pgmap v7332: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:36 smithi035 ceph-mon[92535]: pgmap v7333: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:38 smithi035 ceph-mon[92535]: pgmap v7334: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:40 smithi035 ceph-mon[92535]: pgmap v7335: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:42 smithi035 ceph-mon[92535]: pgmap v7336: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:44 smithi035 ceph-mon[92535]: pgmap v7337: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:46 smithi035 ceph-mon[92535]: pgmap v7338: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:48 smithi035 ceph-mon[92535]: pgmap v7339: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:50 smithi035 ceph-mon[92535]: pgmap v7340: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:07.594 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:52 smithi035 ceph-mon[92535]: pgmap v7341: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.897 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:54 smithi035 ceph-mon[92535]: pgmap v7342: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:08.897 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:56 smithi035 ceph-mon[92535]: pgmap v7343: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.897 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:27:58 smithi035 ceph-mon[92535]: pgmap v7344: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:08.897 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:00 smithi035 ceph-mon[92535]: pgmap v7345: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:02 smithi035 ceph-mon[92535]: pgmap v7346: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:03 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:04 smithi035 ceph-mon[92535]: pgmap v7347: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:05 smithi035 ceph-mon[92535]: pgmap v7348: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:05 smithi035 ceph-mon[92535]: pgmap v7349: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 60 KiB/s wr, 31 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:06 smithi035 ceph-mon[92535]: pgmap v7350: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 60 KiB/s wr, 25 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:09 smithi035 ceph-mon[92535]: pgmap v7351: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:09 smithi035 ceph-mon[92535]: osdmap e524: 12 total, 12 up, 12 in 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:11 smithi035 ceph-mon[92535]: pgmap v7353: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:08.898 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:13 smithi035 ceph-mon[92535]: pgmap v7354: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:15 smithi035 ceph-mon[92535]: pgmap v7355: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:17 smithi035 ceph-mon[92535]: pgmap v7356: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:19 smithi035 ceph-mon[92535]: pgmap v7357: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:19 smithi035 ceph-mon[92535]: osdmap e525: 12 total, 12 up, 12 in 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:21 smithi035 ceph-mon[92535]: pgmap v7359: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:23 smithi035 ceph-mon[92535]: pgmap v7360: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:25 smithi035 ceph-mon[92535]: pgmap v7361: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:27 smithi035 ceph-mon[92535]: pgmap v7362: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:29 smithi035 ceph-mon[92535]: pgmap v7363: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:31 smithi035 ceph-mon[92535]: pgmap v7364: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:33 smithi035 ceph-mon[92535]: pgmap v7365: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:35 smithi035 ceph-mon[92535]: pgmap v7366: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:37 smithi035 ceph-mon[92535]: pgmap v7367: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:39 smithi035 ceph-mon[92535]: pgmap v7368: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:41 smithi035 ceph-mon[92535]: pgmap v7369: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.899 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:43 smithi035 ceph-mon[92535]: pgmap v7370: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:48:08.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:45 smithi035 ceph-mon[92535]: pgmap v7371: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:48:08.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:47 smithi035 ceph-mon[92535]: pgmap v7372: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:49 smithi035 ceph-mon[92535]: pgmap v7373: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:08.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:51 smithi035 ceph-mon[92535]: pgmap v7374: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:08.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:53 smithi035 ceph-mon[92535]: pgmap v7375: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:48:08.900 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:55 smithi035 ceph-mon[92535]: pgmap v7376: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:48:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:57 smithi035 ceph-mon[92535]: pgmap v7377: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:28:59 smithi035 ceph-mon[92535]: pgmap v7378: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:01 smithi035 ceph-mon[92535]: pgmap v7379: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:03 smithi035 ceph-mon[92535]: pgmap v7380: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-03-17T12:48:10.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:04 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:05 smithi035 ceph-mon[92535]: pgmap v7381: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:06 smithi035 ceph-mon[92535]: pgmap v7382: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:06 smithi035 ceph-mon[92535]: pgmap v7383: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:08 smithi035 ceph-mon[92535]: pgmap v7384: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 61 KiB/s wr, 25 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:09 smithi035 ceph-mon[92535]: osdmap e526: 12 total, 12 up, 12 in 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:10 smithi035 ceph-mon[92535]: pgmap v7386: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 38 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:12 smithi035 ceph-mon[92535]: pgmap v7387: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:14 smithi035 ceph-mon[92535]: pgmap v7388: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:16 smithi035 ceph-mon[92535]: pgmap v7389: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:18 smithi035 ceph-mon[92535]: pgmap v7390: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:18 smithi035 ceph-mon[92535]: osdmap e527: 12 total, 12 up, 12 in 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:19 smithi035 ceph-mon[92535]: pgmap v7392: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:10.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:21 smithi035 ceph-mon[92535]: pgmap v7393: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:24 smithi035 ceph-mon[92535]: pgmap v7394: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:26 smithi035 ceph-mon[92535]: pgmap v7395: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:28 smithi035 ceph-mon[92535]: pgmap v7396: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:30 smithi035 ceph-mon[92535]: pgmap v7397: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:32 smithi035 ceph-mon[92535]: pgmap v7398: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:34 smithi035 ceph-mon[92535]: pgmap v7399: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:36 smithi035 ceph-mon[92535]: pgmap v7400: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:38 smithi035 ceph-mon[92535]: pgmap v7401: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:40 smithi035 ceph-mon[92535]: pgmap v7402: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:42 smithi035 ceph-mon[92535]: pgmap v7403: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:44 smithi035 ceph-mon[92535]: pgmap v7404: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:46 smithi035 ceph-mon[92535]: pgmap v7405: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:48 smithi035 ceph-mon[92535]: pgmap v7406: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:50 smithi035 ceph-mon[92535]: pgmap v7407: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:10.681 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:52 smithi035 ceph-mon[92535]: pgmap v7408: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:10.682 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:54 smithi035 ceph-mon[92535]: pgmap v7409: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:56 smithi035 ceph-mon[92535]: pgmap v7410: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:29:58 smithi035 ceph-mon[92535]: pgmap v7411: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:00 smithi035 ceph-mon[92535]: pgmap v7412: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:02 smithi035 ceph-mon[92535]: pgmap v7413: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:04 smithi035 ceph-mon[92535]: pgmap v7414: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:05 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:06 smithi035 ceph-mon[92535]: pgmap v7415: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:07 smithi035 ceph-mon[92535]: pgmap v7416: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 49 KiB/s wr, 25 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:07 smithi035 ceph-mon[92535]: pgmap v7417: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:48:12.271 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:09 smithi035 ceph-mon[92535]: pgmap v7418: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 61 KiB/s wr, 31 op/s 2023-03-17T12:48:12.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:09 smithi035 ceph-mon[92535]: osdmap e528: 12 total, 12 up, 12 in 2023-03-17T12:48:12.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:10 smithi035 ceph-mon[92535]: pgmap v7420: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:12.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:12 smithi035 ceph-mon[92535]: pgmap v7421: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:12.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:15 smithi035 ceph-mon[92535]: pgmap v7422: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:12.272 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:17 smithi035 ceph-mon[92535]: pgmap v7423: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:13.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:19 smithi035 ceph-mon[92535]: pgmap v7424: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:13.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:19 smithi035 ceph-mon[92535]: osdmap e529: 12 total, 12 up, 12 in 2023-03-17T12:48:13.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:21 smithi035 ceph-mon[92535]: pgmap v7426: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:13.732 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:23 smithi035 ceph-mon[92535]: pgmap v7427: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:25 smithi035 ceph-mon[92535]: pgmap v7428: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:27 smithi035 ceph-mon[92535]: pgmap v7429: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:29 smithi035 ceph-mon[92535]: pgmap v7430: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:31 smithi035 ceph-mon[92535]: pgmap v7431: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:33 smithi035 ceph-mon[92535]: pgmap v7432: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:35 smithi035 ceph-mon[92535]: pgmap v7433: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:37 smithi035 ceph-mon[92535]: pgmap v7434: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:39 smithi035 ceph-mon[92535]: pgmap v7435: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:41 smithi035 ceph-mon[92535]: pgmap v7436: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:43 smithi035 ceph-mon[92535]: pgmap v7437: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:44 smithi035 ceph-mon[92535]: pgmap v7438: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:46 smithi035 ceph-mon[92535]: pgmap v7439: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:49 smithi035 ceph-mon[92535]: pgmap v7440: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:51 smithi035 ceph-mon[92535]: pgmap v7441: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.733 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:53 smithi035 ceph-mon[92535]: pgmap v7442: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:55 smithi035 ceph-mon[92535]: pgmap v7443: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:57 smithi035 ceph-mon[92535]: pgmap v7444: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:30:59 smithi035 ceph-mon[92535]: pgmap v7445: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:01 smithi035 ceph-mon[92535]: pgmap v7446: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:03 smithi035 ceph-mon[92535]: pgmap v7447: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:05 smithi035 ceph-mon[92535]: pgmap v7448: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:06 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:07 smithi035 ceph-mon[92535]: pgmap v7449: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:13.734 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:16.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:08 smithi035 ceph-mon[92535]: pgmap v7450: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 27 op/s 2023-03-17T12:48:16.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:08 smithi035 ceph-mon[92535]: pgmap v7451: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 28 op/s 2023-03-17T12:48:16.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:09 smithi035 ceph-mon[92535]: osdmap e530: 12 total, 12 up, 12 in 2023-03-17T12:48:16.118 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:09 smithi035 ceph-mon[92535]: pgmap v7453: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 73 KiB/s wr, 38 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:11 smithi035 ceph-mon[92535]: pgmap v7454: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:14 smithi035 ceph-mon[92535]: pgmap v7455: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 281 B/s wr, 14 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:14 smithi035 ceph-mon[92535]: osdmap e531: 12 total, 12 up, 12 in 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:16 smithi035 ceph-mon[92535]: pgmap v7457: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:18 smithi035 ceph-mon[92535]: pgmap v7458: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 123 B/s wr, 11 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:20 smithi035 ceph-mon[92535]: pgmap v7459: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:22 smithi035 ceph-mon[92535]: pgmap v7460: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:16.119 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:24 smithi035 ceph-mon[92535]: pgmap v7461: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:26 smithi035 ceph-mon[92535]: pgmap v7462: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 8 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:28 smithi035 ceph-mon[92535]: pgmap v7463: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:30 smithi035 ceph-mon[92535]: pgmap v7464: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:32 smithi035 ceph-mon[92535]: pgmap v7465: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:34 smithi035 ceph-mon[92535]: pgmap v7466: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:36 smithi035 ceph-mon[92535]: pgmap v7467: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:37 smithi035 ceph-mon[92535]: pgmap v7468: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:40 smithi035 ceph-mon[92535]: pgmap v7469: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-03-17T12:48:16.120 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:42 smithi035 ceph-mon[92535]: pgmap v7470: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:16.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:44 smithi035 ceph-mon[92535]: pgmap v7471: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:16.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:46 smithi035 ceph-mon[92535]: pgmap v7472: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:16.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:48 smithi035 ceph-mon[92535]: pgmap v7473: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T12:48:16.901 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:50 smithi035 ceph-mon[92535]: pgmap v7474: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:52 smithi035 ceph-mon[92535]: pgmap v7475: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:54 smithi035 ceph-mon[92535]: pgmap v7476: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:56 smithi035 ceph-mon[92535]: pgmap v7477: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:31:58 smithi035 ceph-mon[92535]: pgmap v7478: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:00 smithi035 ceph-mon[92535]: pgmap v7479: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:01 smithi035 ceph-mon[92535]: pgmap v7480: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:04 smithi035 ceph-mon[92535]: pgmap v7481: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:06 smithi035 ceph-mon[92535]: pgmap v7482: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:07 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:08 smithi035 ceph-mon[92535]: pgmap v7483: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 26 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:09 smithi035 ceph-mon[92535]: osdmap e532: 12 total, 12 up, 12 in 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: pgmap v7485: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:17.925 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:17.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:17.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:17.926 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.573 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:10 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi078 to 196.2M 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi078 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi035 to 197.2M 2023-03-17T12:48:19.574 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi035 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-03-17T12:48:19.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:19.575 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-03-17T12:48:20.093 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:21.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:21.411 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:11 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:21.827 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:12 smithi035 ceph-mon[92535]: pgmap v7486: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:22.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:12 smithi035 ceph-mon[92535]: Adjusting osd_memory_target on smithi082 to 196.2M 2023-03-17T12:48:22.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:12 smithi035 ceph-mon[92535]: Unable to set osd_memory_target on smithi082 to 205745254: error parsing value: Value '205745254' is below minimum 939524096 2023-03-17T12:48:22.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:12 smithi035 ceph-mon[92535]: pgmap v7487: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:48:22.418 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:12 smithi035 ceph-mon[92535]: pgmap v7488: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 169 B/s wr, 8 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:14 smithi035 ceph-mon[92535]: pgmap v7489: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 338 B/s wr, 10 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:16 smithi035 ceph-mon[92535]: pgmap v7490: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 160 B/s wr, 8 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:18 smithi035 ceph-mon[92535]: pgmap v7491: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 254 B/s wr, 12 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:18 smithi035 ceph-mon[92535]: osdmap e533: 12 total, 12 up, 12 in 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:20 smithi035 ceph-mon[92535]: pgmap v7493: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:22 smithi035 ceph-mon[92535]: pgmap v7494: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:24 smithi035 ceph-mon[92535]: pgmap v7495: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:26 smithi035 ceph-mon[92535]: pgmap v7496: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:23.713 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:28 smithi035 ceph-mon[92535]: pgmap v7497: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:30 smithi035 ceph-mon[92535]: pgmap v7498: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:31 smithi035 ceph-mon[92535]: pgmap v7499: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:34 smithi035 ceph-mon[92535]: pgmap v7500: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:36 smithi035 ceph-mon[92535]: pgmap v7501: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:38 smithi035 ceph-mon[92535]: pgmap v7502: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:40 smithi035 ceph-mon[92535]: pgmap v7503: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:42 smithi035 ceph-mon[92535]: pgmap v7504: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:44 smithi035 ceph-mon[92535]: pgmap v7505: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:46 smithi035 ceph-mon[92535]: pgmap v7506: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:48 smithi035 ceph-mon[92535]: pgmap v7507: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:49 smithi035 ceph-mon[92535]: pgmap v7508: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:52 smithi035 ceph-mon[92535]: pgmap v7509: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:54 smithi035 ceph-mon[92535]: pgmap v7510: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:23.714 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:56 smithi035 ceph-mon[92535]: pgmap v7511: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:24.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:32:58 smithi035 ceph-mon[92535]: pgmap v7512: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:24.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:00 smithi035 ceph-mon[92535]: pgmap v7513: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:24.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:02 smithi035 ceph-mon[92535]: pgmap v7514: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:24.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:04 smithi035 ceph-mon[92535]: pgmap v7515: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:24.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:06 smithi035 ceph-mon[92535]: pgmap v7516: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:24.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:08 smithi035 ceph-mon[92535]: pgmap v7517: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:24.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:09 smithi035 ceph-mon[92535]: osdmap e534: 12 total, 12 up, 12 in 2023-03-17T12:48:24.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:09 smithi035 ceph-mon[92535]: pgmap v7519: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:25.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:12 smithi035 ceph-mon[92535]: pgmap v7520: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:25.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:25.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:25.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:25.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:25.388 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:13 smithi035 ceph-mon[92535]: pgmap v7521: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:13 smithi035 ceph-mon[92535]: pgmap v7522: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:15 smithi035 ceph-mon[92535]: pgmap v7523: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:17 smithi035 ceph-mon[92535]: pgmap v7524: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:19 smithi035 ceph-mon[92535]: pgmap v7525: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:19 smithi035 ceph-mon[92535]: osdmap e535: 12 total, 12 up, 12 in 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:21 smithi035 ceph-mon[92535]: pgmap v7527: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:23 smithi035 ceph-mon[92535]: pgmap v7528: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:25.389 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:25 smithi035 ceph-mon[92535]: pgmap v7529: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:25.390 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:27 smithi035 ceph-mon[92535]: pgmap v7530: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:25.390 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:29 smithi035 ceph-mon[92535]: pgmap v7531: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:25.390 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:31 smithi035 ceph-mon[92535]: pgmap v7532: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-03-17T12:48:25.390 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:33 smithi035 ceph-mon[92535]: pgmap v7533: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:26.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:34 smithi035 ceph-mon[92535]: pgmap v7534: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:26.736 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:36 smithi035 ceph-mon[92535]: pgmap v7535: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:39 smithi035 ceph-mon[92535]: pgmap v7536: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:41 smithi035 ceph-mon[92535]: pgmap v7537: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:43 smithi035 ceph-mon[92535]: pgmap v7538: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:45 smithi035 ceph-mon[92535]: pgmap v7539: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:47 smithi035 ceph-mon[92535]: pgmap v7540: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:49 smithi035 ceph-mon[92535]: pgmap v7541: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:26.737 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:50 smithi035 ceph-mon[92535]: pgmap v7542: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:27.505 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:52 smithi035 ceph-mon[92535]: pgmap v7543: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:27.506 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:55 smithi035 ceph-mon[92535]: pgmap v7544: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:57 smithi035 ceph-mon[92535]: pgmap v7545: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:33:59 smithi035 ceph-mon[92535]: pgmap v7546: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:01 smithi035 ceph-mon[92535]: pgmap v7547: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:02 smithi035 ceph-mon[92535]: pgmap v7548: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:05 smithi035 ceph-mon[92535]: pgmap v7549: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:07 smithi035 ceph-mon[92535]: pgmap v7550: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:09 smithi035 ceph-mon[92535]: pgmap v7551: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:09 smithi035 ceph-mon[92535]: osdmap e536: 12 total, 12 up, 12 in 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:10 smithi035 ceph-mon[92535]: pgmap v7553: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:12 smithi035 ceph-mon[92535]: pgmap v7554: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:28.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:12 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:30.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:30.186 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:30.189 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:13 smithi035 ceph-mon[92535]: pgmap v7555: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2023-03-17T12:48:32.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:13 smithi035 ceph-mon[92535]: pgmap v7556: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:48:32.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:13 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:32.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:16 smithi035 ceph-mon[92535]: pgmap v7557: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:48:32.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:18 smithi035 ceph-mon[92535]: pgmap v7558: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 241 B/s wr, 12 op/s 2023-03-17T12:48:32.229 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:19 smithi035 ceph-mon[92535]: osdmap e537: 12 total, 12 up, 12 in 2023-03-17T12:48:32.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:20 smithi035 ceph-mon[92535]: pgmap v7560: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 280 B/s wr, 14 op/s 2023-03-17T12:48:32.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:22 smithi035 ceph-mon[92535]: pgmap v7561: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:48:32.230 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:24 smithi035 ceph-mon[92535]: pgmap v7562: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:32.938 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:25 smithi035 ceph-mon[92535]: pgmap v7563: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:33.284 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:28 smithi035 ceph-mon[92535]: pgmap v7564: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:33.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:30 smithi035 ceph-mon[92535]: pgmap v7565: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-03-17T12:48:33.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:32 smithi035 ceph-mon[92535]: pgmap v7566: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:33.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:34 smithi035 ceph-mon[92535]: pgmap v7567: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:33.285 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:36 smithi035 ceph-mon[92535]: pgmap v7568: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:34.717 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:37 smithi035 ceph-mon[92535]: pgmap v7569: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:34.717 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:40 smithi035 ceph-mon[92535]: pgmap v7570: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:34.717 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:42 smithi035 ceph-mon[92535]: pgmap v7571: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:34.717 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:44 smithi035 ceph-mon[92535]: pgmap v7572: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:45 smithi035 ceph-mon[92535]: pgmap v7573: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:48 smithi035 ceph-mon[92535]: pgmap v7574: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:50 smithi035 ceph-mon[92535]: pgmap v7575: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:52 smithi035 ceph-mon[92535]: pgmap v7576: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:54 smithi035 ceph-mon[92535]: pgmap v7577: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:56 smithi035 ceph-mon[92535]: pgmap v7578: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:58 smithi035 ceph-mon[92535]: pgmap v7579: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:36.678 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:34:59 smithi035 ceph-mon[92535]: pgmap v7580: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:36.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:02 smithi035 ceph-mon[92535]: pgmap v7581: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:36.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:04 smithi035 ceph-mon[92535]: pgmap v7582: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:36.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:06 smithi035 ceph-mon[92535]: pgmap v7583: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:36.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:08 smithi035 ceph-mon[92535]: pgmap v7584: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:36.679 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:09 smithi035 ceph-mon[92535]: osdmap e538: 12 total, 12 up, 12 in 2023-03-17T12:48:36.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:09 smithi035 ceph-mon[92535]: pgmap v7586: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:36.680 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:12 smithi035 ceph-mon[92535]: pgmap v7587: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:14 smithi035 ceph-mon[92535]: pgmap v7588: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:14 smithi035 ceph-mon[92535]: osdmap e539: 12 total, 12 up, 12 in 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:15 smithi035 ceph-mon[92535]: pgmap v7590: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:48:37.891 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:15 smithi035 ceph-mon[92535]: pgmap v7591: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 191 B/s wr, 9 op/s 2023-03-17T12:48:37.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:17 smithi035 ceph-mon[92535]: pgmap v7592: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:48:37.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:19 smithi035 ceph-mon[92535]: pgmap v7593: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 299 B/s wr, 15 op/s 2023-03-17T12:48:37.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:21 smithi035 ceph-mon[92535]: pgmap v7594: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 149 B/s wr, 7 op/s 2023-03-17T12:48:37.892 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:22 smithi035 ceph-mon[92535]: pgmap v7595: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 122 B/s wr, 12 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:25 smithi035 ceph-mon[92535]: pgmap v7596: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:26 smithi035 ceph-mon[92535]: pgmap v7597: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:29 smithi035 ceph-mon[92535]: pgmap v7598: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:31 smithi035 ceph-mon[92535]: pgmap v7599: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:32 smithi035 ceph-mon[92535]: pgmap v7600: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:35 smithi035 ceph-mon[92535]: pgmap v7601: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:36 smithi035 ceph-mon[92535]: pgmap v7602: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:39 smithi035 ceph-mon[92535]: pgmap v7603: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:40 smithi035 ceph-mon[92535]: pgmap v7604: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:43 smithi035 ceph-mon[92535]: pgmap v7605: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:44 smithi035 ceph-mon[92535]: pgmap v7606: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:47 smithi035 ceph-mon[92535]: pgmap v7607: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:49 smithi035 ceph-mon[92535]: pgmap v7608: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:50 smithi035 ceph-mon[92535]: pgmap v7609: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.980 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:53 smithi035 ceph-mon[92535]: pgmap v7610: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:38.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:54 smithi035 ceph-mon[92535]: pgmap v7611: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:57 smithi035 ceph-mon[92535]: pgmap v7612: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:38.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:35:59 smithi035 ceph-mon[92535]: pgmap v7613: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:38.981 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:01 smithi035 ceph-mon[92535]: pgmap v7614: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:40.608 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:03 smithi035 ceph-mon[92535]: pgmap v7615: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:04 smithi035 ceph-mon[92535]: pgmap v7616: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:07 smithi035 ceph-mon[92535]: pgmap v7617: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:09 smithi035 ceph-mon[92535]: pgmap v7618: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:10 smithi035 ceph-mon[92535]: osdmap e540: 12 total, 12 up, 12 in 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:11 smithi035 ceph-mon[92535]: pgmap v7620: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:13 smithi035 ceph-mon[92535]: pgmap v7621: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:40.609 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:14 smithi035 ceph-mon[92535]: osdmap e541: 12 total, 12 up, 12 in 2023-03-17T12:48:41.244 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:14 smithi035 ceph-mon[92535]: pgmap v7623: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:42.668 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:14 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:42.668 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:42.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:42.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:15 smithi035 ceph-mon[92535]: pgmap v7624: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:15 smithi035 ceph-mon[92535]: pgmap v7625: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 177 B/s wr, 9 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:17 smithi035 ceph-mon[92535]: pgmap v7626: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:19 smithi035 ceph-mon[92535]: pgmap v7627: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:21 smithi035 ceph-mon[92535]: pgmap v7628: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 142 B/s wr, 7 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:23 smithi035 ceph-mon[92535]: pgmap v7629: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:25 smithi035 ceph-mon[92535]: pgmap v7630: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:27 smithi035 ceph-mon[92535]: pgmap v7631: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:29 smithi035 ceph-mon[92535]: pgmap v7632: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:31 smithi035 ceph-mon[92535]: pgmap v7633: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:33 smithi035 ceph-mon[92535]: pgmap v7634: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:44.240 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:35 smithi035 ceph-mon[92535]: pgmap v7635: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:37 smithi035 ceph-mon[92535]: pgmap v7636: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:39 smithi035 ceph-mon[92535]: pgmap v7637: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:41 smithi035 ceph-mon[92535]: pgmap v7638: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:43 smithi035 ceph-mon[92535]: pgmap v7639: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:45 smithi035 ceph-mon[92535]: pgmap v7640: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:47 smithi035 ceph-mon[92535]: pgmap v7641: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:49 smithi035 ceph-mon[92535]: pgmap v7642: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:51 smithi035 ceph-mon[92535]: pgmap v7643: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:53 smithi035 ceph-mon[92535]: pgmap v7644: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:55 smithi035 ceph-mon[92535]: pgmap v7645: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:57 smithi035 ceph-mon[92535]: pgmap v7646: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:36:59 smithi035 ceph-mon[92535]: pgmap v7647: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:01 smithi035 ceph-mon[92535]: pgmap v7648: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:03 smithi035 ceph-mon[92535]: pgmap v7649: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:44.241 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:05 smithi035 ceph-mon[92535]: pgmap v7650: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:44.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:07 smithi035 ceph-mon[92535]: pgmap v7651: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:44.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:09 smithi035 ceph-mon[92535]: pgmap v7652: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:44.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:09 smithi035 ceph-mon[92535]: osdmap e542: 12 total, 12 up, 12 in 2023-03-17T12:48:44.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:11 smithi035 ceph-mon[92535]: pgmap v7654: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:44.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:13 smithi035 ceph-mon[92535]: pgmap v7655: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:44.914 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:13 smithi035 ceph-mon[92535]: osdmap e543: 12 total, 12 up, 12 in 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: pgmap v7657: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: pgmap v7658: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: pgmap v7659: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 151 B/s wr, 7 op/s 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:15 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:17 smithi035 ceph-mon[92535]: pgmap v7660: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:48:44.915 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:19 smithi035 ceph-mon[92535]: pgmap v7661: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:44.916 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:21 smithi035 ceph-mon[92535]: pgmap v7662: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 128 B/s wr, 6 op/s 2023-03-17T12:48:47.858 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:23 smithi035 ceph-mon[92535]: pgmap v7663: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:25 smithi035 ceph-mon[92535]: pgmap v7664: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:27 smithi035 ceph-mon[92535]: pgmap v7665: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:29 smithi035 ceph-mon[92535]: pgmap v7666: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:31 smithi035 ceph-mon[92535]: pgmap v7667: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:33 smithi035 ceph-mon[92535]: pgmap v7668: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:35 smithi035 ceph-mon[92535]: pgmap v7669: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:37 smithi035 ceph-mon[92535]: pgmap v7670: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:39 smithi035 ceph-mon[92535]: pgmap v7671: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:41 smithi035 ceph-mon[92535]: pgmap v7672: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:43 smithi035 ceph-mon[92535]: pgmap v7673: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:45 smithi035 ceph-mon[92535]: pgmap v7674: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:47 smithi035 ceph-mon[92535]: pgmap v7675: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:49 smithi035 ceph-mon[92535]: pgmap v7676: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.859 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:51 smithi035 ceph-mon[92535]: pgmap v7677: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:53 smithi035 ceph-mon[92535]: pgmap v7678: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:55 smithi035 ceph-mon[92535]: pgmap v7679: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:57 smithi035 ceph-mon[92535]: pgmap v7680: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:37:59 smithi035 ceph-mon[92535]: pgmap v7681: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:01 smithi035 ceph-mon[92535]: pgmap v7682: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:03 smithi035 ceph-mon[92535]: pgmap v7683: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:05 smithi035 ceph-mon[92535]: pgmap v7684: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:07 smithi035 ceph-mon[92535]: pgmap v7685: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:09 smithi035 ceph-mon[92535]: osdmap e544: 12 total, 12 up, 12 in 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:09 smithi035 ceph-mon[92535]: pgmap v7687: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:11 smithi035 ceph-mon[92535]: pgmap v7688: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:47.860 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:13 smithi035 ceph-mon[92535]: pgmap v7689: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:15 smithi035 ceph-mon[92535]: pgmap v7690: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:16 smithi035 ceph-mon[92535]: pgmap v7691: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 116 B/s wr, 5 op/s 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:16 smithi035 ceph-mon[92535]: pgmap v7692: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 132 B/s wr, 6 op/s 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:16 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:49.903 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:19 smithi035 ceph-mon[92535]: pgmap v7693: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 232 B/s wr, 11 op/s 2023-03-17T12:48:51.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:19 smithi035 ceph-mon[92535]: osdmap e545: 12 total, 12 up, 12 in 2023-03-17T12:48:51.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:21 smithi035 ceph-mon[92535]: pgmap v7695: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:51.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:23 smithi035 ceph-mon[92535]: pgmap v7696: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 150 B/s wr, 14 op/s 2023-03-17T12:48:51.669 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:24 smithi035 ceph-mon[92535]: pgmap v7697: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 127 B/s wr, 12 op/s 2023-03-17T12:48:51.670 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:27 smithi035 ceph-mon[92535]: pgmap v7698: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-03-17T12:48:53.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:29 smithi035 ceph-mon[92535]: pgmap v7699: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:53.154 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:31 smithi035 ceph-mon[92535]: pgmap v7700: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:33 smithi035 ceph-mon[92535]: pgmap v7701: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:34 smithi035 ceph-mon[92535]: pgmap v7702: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:37 smithi035 ceph-mon[92535]: pgmap v7703: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:39 smithi035 ceph-mon[92535]: pgmap v7704: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:41 smithi035 ceph-mon[92535]: pgmap v7705: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:43 smithi035 ceph-mon[92535]: pgmap v7706: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:44 smithi035 ceph-mon[92535]: pgmap v7707: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:47 smithi035 ceph-mon[92535]: pgmap v7708: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.155 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:49 smithi035 ceph-mon[92535]: pgmap v7709: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:51 smithi035 ceph-mon[92535]: pgmap v7710: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:53 smithi035 ceph-mon[92535]: pgmap v7711: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:54 smithi035 ceph-mon[92535]: pgmap v7712: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:57 smithi035 ceph-mon[92535]: pgmap v7713: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:38:59 smithi035 ceph-mon[92535]: pgmap v7714: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:01 smithi035 ceph-mon[92535]: pgmap v7715: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:03 smithi035 ceph-mon[92535]: pgmap v7716: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:04 smithi035 ceph-mon[92535]: pgmap v7717: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:07 smithi035 ceph-mon[92535]: pgmap v7718: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:09 smithi035 ceph-mon[92535]: pgmap v7719: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:09 smithi035 ceph-mon[92535]: osdmap e546: 12 total, 12 up, 12 in 2023-03-17T12:48:53.156 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:11 smithi035 ceph-mon[92535]: pgmap v7721: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:55.038 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:13 smithi035 ceph-mon[92535]: pgmap v7722: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:14 smithi035 ceph-mon[92535]: osdmap e547: 12 total, 12 up, 12 in 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:14 smithi035 ceph-mon[92535]: pgmap v7724: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:17 smithi035 ceph-mon[92535]: pgmap v7725: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:55.039 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:17 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:18 smithi035 ceph-mon[92535]: pgmap v7726: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:18 smithi035 ceph-mon[92535]: pgmap v7727: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:19 smithi035 ceph-mon[92535]: pgmap v7728: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:22 smithi035 ceph-mon[92535]: pgmap v7729: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 134 B/s wr, 6 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:24 smithi035 ceph-mon[92535]: pgmap v7730: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:26 smithi035 ceph-mon[92535]: pgmap v7731: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:28 smithi035 ceph-mon[92535]: pgmap v7732: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:29 smithi035 ceph-mon[92535]: pgmap v7733: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:32 smithi035 ceph-mon[92535]: pgmap v7734: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:34 smithi035 ceph-mon[92535]: pgmap v7735: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:55.040 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:36 smithi035 ceph-mon[92535]: pgmap v7736: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:55.041 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:38 smithi035 ceph-mon[92535]: pgmap v7737: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:56.303 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:39 smithi035 ceph-mon[92535]: pgmap v7738: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.303 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:42 smithi035 ceph-mon[92535]: pgmap v7739: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.303 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:44 smithi035 ceph-mon[92535]: pgmap v7740: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:56.303 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:46 smithi035 ceph-mon[92535]: pgmap v7741: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:48 smithi035 ceph-mon[92535]: pgmap v7742: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:56.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:49 smithi035 ceph-mon[92535]: pgmap v7743: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:52 smithi035 ceph-mon[92535]: pgmap v7744: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:54 smithi035 ceph-mon[92535]: pgmap v7745: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:56.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:56 smithi035 ceph-mon[92535]: pgmap v7746: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.304 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:58 smithi035 ceph-mon[92535]: pgmap v7747: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:56.305 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:39:59 smithi035 ceph-mon[92535]: pgmap v7748: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:56.305 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:00 smithi035 ceph-mon[92535]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2023-03-17T12:48:57.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:01 smithi035 ceph-mon[92535]: pgmap v7749: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:57.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:04 smithi035 ceph-mon[92535]: pgmap v7750: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:57.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:06 smithi035 ceph-mon[92535]: pgmap v7751: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:57.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:08 smithi035 ceph-mon[92535]: pgmap v7752: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:57.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:10 smithi035 ceph-mon[92535]: pgmap v7753: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-03-17T12:48:57.553 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:10 smithi035 ceph-mon[92535]: osdmap e548: 12 total, 12 up, 12 in 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:12 smithi035 ceph-mon[92535]: pgmap v7755: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:14 smithi035 ceph-mon[92535]: pgmap v7756: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:14 smithi035 ceph-mon[92535]: osdmap e549: 12 total, 12 up, 12 in 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:16 smithi035 ceph-mon[92535]: pgmap v7758: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:18 smithi035 ceph-mon[92535]: pgmap v7759: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:48:57.554 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:18 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:19 smithi035 ceph-mon[92535]: pgmap v7760: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 233 B/s wr, 11 op/s 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:19 smithi035 ceph-mon[92535]: pgmap v7761: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 300 B/s wr, 15 op/s 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:21 smithi035 ceph-mon[92535]: pgmap v7762: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 150 B/s wr, 7 op/s 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:23 smithi035 ceph-mon[92535]: pgmap v7763: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 121 B/s wr, 12 op/s 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:24 smithi035 ceph-mon[92535]: pgmap v7764: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 116 B/s wr, 11 op/s 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:27 smithi035 ceph-mon[92535]: pgmap v7765: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-03-17T12:48:57.555 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:29 smithi035 ceph-mon[92535]: pgmap v7766: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:31 smithi035 ceph-mon[92535]: pgmap v7767: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:33 smithi035 ceph-mon[92535]: pgmap v7768: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:34 smithi035 ceph-mon[92535]: pgmap v7769: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:37 smithi035 ceph-mon[92535]: pgmap v7770: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:39 smithi035 ceph-mon[92535]: pgmap v7771: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:41 smithi035 ceph-mon[92535]: pgmap v7772: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:43 smithi035 ceph-mon[92535]: pgmap v7773: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:44 smithi035 ceph-mon[92535]: pgmap v7774: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:57.556 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:47 smithi035 ceph-mon[92535]: pgmap v7775: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:48:57.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:49 smithi035 ceph-mon[92535]: pgmap v7776: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:57.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:51 smithi035 ceph-mon[92535]: pgmap v7777: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:57.557 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:53 smithi035 ceph-mon[92535]: pgmap v7778: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:58.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:54 smithi035 ceph-mon[92535]: pgmap v7779: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:58.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:57 smithi035 ceph-mon[92535]: pgmap v7780: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:58.777 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:40:59 smithi035 ceph-mon[92535]: pgmap v7781: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:01 smithi035 ceph-mon[92535]: pgmap v7782: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:03 smithi035 ceph-mon[92535]: pgmap v7783: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:04 smithi035 ceph-mon[92535]: pgmap v7784: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:07 smithi035 ceph-mon[92535]: pgmap v7785: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:09 smithi035 ceph-mon[92535]: pgmap v7786: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:10 smithi035 ceph-mon[92535]: osdmap e550: 12 total, 12 up, 12 in 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:11 smithi035 ceph-mon[92535]: pgmap v7788: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-03-17T12:48:58.778 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:13 smithi035 ceph-mon[92535]: pgmap v7789: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:14 smithi035 ceph-mon[92535]: osdmap e551: 12 total, 12 up, 12 in 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:14 smithi035 ceph-mon[92535]: pgmap v7791: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:17 smithi035 ceph-mon[92535]: pgmap v7792: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:19 smithi035 ceph-mon[92535]: pgmap v7793: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:19 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-03-17T12:49:00.018 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:20 smithi035 ceph-mon[92535]: pgmap v7794: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2023-03-17T12:49:00.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:20 smithi035 ceph-mon[92535]: pgmap v7795: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 140 B/s wr, 7 op/s 2023-03-17T12:49:00.652 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:20 smithi035 ceph-mon[92535]: from='mgr.15318 172.21.15.35:0/675424165' entity='mgr.x' 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:22 smithi035 ceph-mon[92535]: pgmap v7796: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 132 B/s wr, 6 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:24 smithi035 ceph-mon[92535]: pgmap v7797: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:26 smithi035 ceph-mon[92535]: pgmap v7798: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:28 smithi035 ceph-mon[92535]: pgmap v7799: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:29 smithi035 ceph-mon[92535]: pgmap v7800: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:32 smithi035 ceph-mon[92535]: pgmap v7801: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:34 smithi035 ceph-mon[92535]: pgmap v7802: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:36 smithi035 ceph-mon[92535]: pgmap v7803: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:38 smithi035 ceph-mon[92535]: pgmap v7804: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:39 smithi035 ceph-mon[92535]: pgmap v7805: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:42 smithi035 ceph-mon[92535]: pgmap v7806: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:00.653 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:44 smithi035 ceph-mon[92535]: pgmap v7807: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:49:02.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:46 smithi035 ceph-mon[92535]: pgmap v7808: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:02.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:48 smithi035 ceph-mon[92535]: pgmap v7809: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:49:02.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:49 smithi035 ceph-mon[92535]: pgmap v7810: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:49:02.320 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:52 smithi035 ceph-mon[92535]: pgmap v7811: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:54 smithi035 ceph-mon[92535]: pgmap v7812: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:56 smithi035 ceph-mon[92535]: pgmap v7813: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:58 smithi035 ceph-mon[92535]: pgmap v7814: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:41:59 smithi035 ceph-mon[92535]: pgmap v7815: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:42:02 smithi035 ceph-mon[92535]: pgmap v7816: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:42:04 smithi035 ceph-mon[92535]: pgmap v7817: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:42:06 smithi035 ceph-mon[92535]: pgmap v7818: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2023-03-17T12:49:02.321 INFO:journalctl@ceph.mon.a.smithi035.stdout:Mar 17 12:42:08 smithi035 ceph-mon[92535]: pgmap v7819: 97 pgs: 97 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 27 op/s 2023-03-17T12:49:02.324 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-03-17T12:49:05.489 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-03-17T12:49:05.500 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-03-17T12:49:08.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:09.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:12.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:14.288 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_fuse.py", line 175, in task yield all_mounts File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_fuse.py", line 182, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 253, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:49:15.010 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-03-17T12:49:15.022 INFO:tasks.cephadm:Teardown begin 2023-03-17T12:49:15.757 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 1671, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-03-17T12:49:15.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:15.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:16.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:17.295 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-03-17T12:49:17.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:17.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:20.357 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:20.531 INFO:tasks.cephadm:Archiving crash dumps... 2023-03-17T12:49:20.533 DEBUG:teuthology.misc:Transferring archived files from smithi035:/var/lib/ceph/80b32574-c497-11ed-9afb-001a4aab830c/crash to /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223/remote/smithi035/crash 2023-03-17T12:49:22.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:22.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:23.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:25.179 INFO:tasks.cephadm:Checking cluster log for badness... 2023-03-17T12:49:27.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:27.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:30.405 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:32.276 INFO:tasks.cephadm:Removing cluster... 2023-03-17T12:49:32.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:32.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:33.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:33.772 INFO:tasks.cephadm:Teardown complete 2023-03-17T12:49:33.772 ERROR:teuthology.run_tasks:Manager failed: cephadm Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 1419, in distribute_config_and_admin_keyring yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 1671, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 1674, in task log.info('Teardown begin') File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 1552, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 140, in download_cephadm _rm_cluster(ctx, cluster_name) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/cephadm.py", line 259, in _rm_cluster ctx.cluster.run(args=[ File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:49:35.749 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-03-17T12:49:35.769 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-03-17T12:49:36.632 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-03-17T12:49:36.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:36.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:39.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:42.141 ERROR:teuthology.run_tasks:Manager failed: install Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/util.py", line 148, in ship_utilities yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/__init__.py", line 619, in task yield File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/__init__.py", line 220, in install yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/util.py", line 150, in ship_utilities _remove_utilities(ctx, filenames) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/install/util.py", line 121, in _remove_utilities ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:49:44.813 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-03-17T12:49:44.828 INFO:teuthology.task.clock:Checking final clock skew... 2023-03-17T12:49:47.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:47.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:50.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:49:53.719 ERROR:teuthology.run_tasks:Manager failed: clock Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/clock.py", line 66, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/clock.py", line 72, in task cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:49:53.720 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-03-17T12:49:53.731 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-03-17T12:49:55.712 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-03-17T12:49:55.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:49:56.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:49:59.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:50:00.296 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:50:00.297 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-03-17T12:50:00.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-03-17T12:50:02.165 INFO:teuthology.task.internal:Duration was 19187.879199 seconds 2023-03-17T12:50:03.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-03-17T12:50:03.451 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-03-17T12:50:06.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:50:06.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:50:09.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:50:09.823 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/syslog.py", line 85, in syslog cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:50:11.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-03-17T12:50:11.063 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-03-17T12:50:12.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:50:12.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:50:16.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:50:17.854 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 453, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 456, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:50:17.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-03-17T12:50:17.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:50:18.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:50:19.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:50:22.449 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 489, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 493, in coredump cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:50:22.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-03-17T12:50:22.474 INFO:teuthology.task.internal:Transferring archived files... 2023-03-17T12:50:28.553 DEBUG:teuthology.misc:Transferring archived files from smithi035:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-03-16_23:18:17-fs:workload-wip-pdonnell-testing-20230316.214637-distro-default-smithi/7211223/remote/smithi035 2023-03-17T12:50:28.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:50:30.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:50:33.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:50:35.504 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 393, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 419, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/misc.py", line 748, in pull_directory r = remote.get_tar_stream(remotedir, sudo=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 664, in get_tar_stream return self.run(args=args, wait=False, stdout=run.PIPE) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:50:35.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-03-17T12:50:35.516 INFO:teuthology.task.internal:Not uploading archives. 2023-03-17T12:50:37.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-03-17T12:50:37.672 INFO:teuthology.task.internal:Tidying up after the test... 2023-03-17T12:50:40.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-03-17T12:50:40.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-17T12:50:43.077 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.35 2023-03-17T12:50:44.340 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 49, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/check_counter.py", line 71, in end proc = manager.admin_socket(daemon_type, daemon_id, ["perf", "dump"]) File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 1835, in admin_socket return shell( File "/home/teuthworker/src/git.ceph.com_ceph-c_4aa791bf129eece187e94ddbfa7c2b475588cf0c/qa/tasks/ceph_manager.py", line 43, in shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 516, in exec_command chan.exec_command(command) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 72, in _check return func(self, *args, **kwds) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 257, in exec_command self._wait_for_event() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1226, in _wait_for_event raise e File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/task/internal/__init__.py", line 55, in base ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi035 2023-03-17T12:50:44.341 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-03-17T12:50:44.355 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: EOFError: 2023-03-17T12:50:46.012 INFO:teuthology.nuke:Checking targets against current locks 2023-03-17T12:50:46.045 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run.py", line 411, in main run_tasks(tasks=config['tasks'], ctx=fake_ctx) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run_tasks.py", line 216, in run_tasks raise SystemExit(1) SystemExit: 1 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/bin/teuthology", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run.py", line 414, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/run.py", line 271, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/nuke/__init__.py", line 247, in nuke if ctx.name and ctx.name not in status.get('description', ""): TypeError: argument of type 'NoneType' is not iterable